2024-05-30T06:27:14.418 INFO:root:teuthology version: 0.0.1.dev296+ge1979f0 2024-05-30T06:27:14.418 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027 --owner scheduled_rishabh@teuthology --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} -- /home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027/orig.config.yaml 2024-05-30T06:27:14.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-30T06:27:14.554 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027 branch: rishabh-clone-stats description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} email: null first_in_suite: false job_id: '7734027' kernel: client: branch: testing flavor: default kdb: 1 sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: rishabh-clone-stats ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: mgr-vol-clone-stats sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4766 sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 sleep_before_teardown: 0 suite: fs:volumes suite_branch: mgr-vol-clone-stats suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPxBWzaBjqfXc3wCuNvFIMAhOW+1Cf+0Qsxr+0WjAX7WY7f0yEZKsSU334ANRWdnBiGvpwYyx07wU1s9+aOetaw= smithi105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFMAcnXSaELV3e9SHWazFhj1NpErpfqBFtJ0ncGbBp//g1a9vEPwGjrqvg/u21rkMrK1NAmyGRGOykrBZIHJmx0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestCloneProgressReporter teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e1979f064b0becde2020282c7e87cf3c5e98026c timestamp: 2024-05-30_06:18:46 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-30T06:27:14.554 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa; will attempt to use it 2024-05-30T06:27:14.555 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks 2024-05-30T06:27:14.555 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-30T06:27:14.557 INFO:teuthology.task.internal:Checking packages... 2024-05-30T06:27:14.578 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '9ed025fbf4406fb54980a0647506b15895b6d863' 2024-05-30T06:27:14.578 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-30T06:27:14.578 INFO:teuthology.packaging:ref: None 2024-05-30T06:27:14.578 INFO:teuthology.packaging:tag: None 2024-05-30T06:27:14.579 INFO:teuthology.packaging:branch: rishabh-clone-stats 2024-05-30T06:27:14.579 INFO:teuthology.packaging:sha1: 9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T06:27:14.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=rishabh-clone-stats 2024-05-30T06:27:14.730 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3154-g9ed025fb-1jammy 2024-05-30T06:27:14.732 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-30T06:27:14.738 INFO:teuthology.task.internal:no buildpackages task found 2024-05-30T06:27:14.739 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-30T06:27:14.754 INFO:teuthology.task.internal:Saving configuration 2024-05-30T06:27:14.770 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-30T06:27:14.777 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-30T06:27:14.802 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-30 06:21:36.151705', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGLtOJKFZ7WUDZPk8RLlobGfZn2LfVl6Hx3Lz5iG6MG+'} 2024-05-30T06:27:14.826 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-30 06:21:36.154211', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDa+zHbmxeXZSfcsddhnNgsC6TA2nOONPEnpwEUODj1v'} 2024-05-30T06:27:14.826 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-30T06:27:14.831 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-30T06:27:14.832 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-30T06:27:14.832 INFO:teuthology.run_tasks:Running task console_log... 2024-05-30T06:27:14.929 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f40cbaffbe0>, signals=[15]) 2024-05-30T06:27:14.929 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-30T06:27:14.934 INFO:teuthology.task.internal:Opening connections... 2024-05-30T06:27:14.934 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:27:14.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T06:27:15.019 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2024-05-30T06:27:15.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T06:27:15.097 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-30T06:27:15.104 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-05-30T06:27:15.109 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-05-30T06:27:15.109 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-05-30T06:27:15.157 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-30T06:27:15.157 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu" 2024-05-30T06:27:15.157 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="22.04" 2024-05-30T06:27:15.157 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-30T06:27:15.157 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=jammy 2024-05-30T06:27:15.157 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu 2024-05-30T06:27:15.157 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian 2024-05-30T06:27:15.158 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-30T06:27:15.158 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-30T06:27:15.158 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-30T06:27:15.158 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-30T06:27:15.158 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=jammy 2024-05-30T06:27:15.158 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-05-30T06:27:15.182 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-05-30T06:27:15.187 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-05-30T06:27:15.187 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-05-30T06:27:15.235 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-30T06:27:15.235 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Ubuntu" 2024-05-30T06:27:15.236 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="22.04" 2024-05-30T06:27:15.236 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-30T06:27:15.236 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_CODENAME=jammy 2024-05-30T06:27:15.236 INFO:teuthology.orchestra.run.smithi105.stdout:ID=ubuntu 2024-05-30T06:27:15.236 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE=debian 2024-05-30T06:27:15.236 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-30T06:27:15.236 INFO:teuthology.orchestra.run.smithi105.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-30T06:27:15.236 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-30T06:27:15.236 INFO:teuthology.orchestra.run.smithi105.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-30T06:27:15.236 INFO:teuthology.orchestra.run.smithi105.stdout:UBUNTU_CODENAME=jammy 2024-05-30T06:27:15.237 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-05-30T06:27:15.257 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-30T06:27:15.265 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-30T06:27:15.270 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-30T06:27:15.270 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-05-30T06:27:15.273 DEBUG:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2024-05-30T06:27:15.283 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-30T06:27:15.288 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-30T06:27:15.288 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-05-30T06:27:15.318 DEBUG:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2024-05-30T06:27:15.331 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-30T06:27:15.382 INFO:teuthology.run_tasks:Running task kernel... 2024-05-30T06:27:15.396 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'} 2024-05-30T06:27:15.396 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-05-30T06:27:15.396 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-05-30T06:27:15.397 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-30T06:27:15.397 DEBUG:teuthology.orchestra.run.smithi105:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-30T06:27:15.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:27:15.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:27:15.404 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-05-30T06:27:15.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-05-30T06:27:15.575 DEBUG:teuthology.task.kernel:sha1 for client.1 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T06:27:15.575 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-30T06:27:15.575 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2024-05-30T06:27:15.581 INFO:teuthology.orchestra.run.smithi105.stdout:5.15.0-56-generic 2024-05-30T06:27:15.581 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T06:27:15.582 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-30T06:27:15.582 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-05-30T06:27:15.582 DEBUG:teuthology.orchestra.run.smithi105:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-05-30T06:27:15.589 DEBUG:teuthology.task.kernel:sha1 for client.0 is b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T06:27:15.589 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "b9459a26b0888785d05c47deb35abc9d0354ab93"... 2024-05-30T06:27:15.590 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-05-30T06:27:15.595 INFO:teuthology.orchestra.run.smithi037.stdout:5.15.0-56-generic 2024-05-30T06:27:15.595 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T06:27:15.595 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-30T06:27:15.596 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-05-30T06:27:15.596 DEBUG:teuthology.orchestra.run.smithi037:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-05-30T06:27:15.647 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-05-30T06:27:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-05-30T06:27:15.792 INFO:teuthology.orchestra.run.smithi105.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-05-30T06:27:15.792 INFO:teuthology.orchestra.run.smithi105.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-05-30T06:27:15.792 INFO:teuthology.orchestra.run.smithi105.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-05-30T06:27:15.792 INFO:teuthology.orchestra.run.smithi105.stderr:hint: 2024-05-30T06:27:15.792 INFO:teuthology.orchestra.run.smithi105.stderr:hint: git config --global init.defaultBranch 2024-05-30T06:27:15.792 INFO:teuthology.orchestra.run.smithi105.stderr:hint: 2024-05-30T06:27:15.792 INFO:teuthology.orchestra.run.smithi105.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-05-30T06:27:15.792 INFO:teuthology.orchestra.run.smithi105.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-05-30T06:27:15.792 INFO:teuthology.orchestra.run.smithi105.stderr:hint: 2024-05-30T06:27:15.792 INFO:teuthology.orchestra.run.smithi105.stderr:hint: git branch -m 2024-05-30T06:27:15.793 INFO:teuthology.orchestra.run.smithi105.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-05-30T06:27:15.795 DEBUG:teuthology.orchestra.run.smithi105:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-05-30T06:27:15.825 INFO:teuthology.orchestra.run.smithi037.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-05-30T06:27:15.825 INFO:teuthology.orchestra.run.smithi037.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-05-30T06:27:15.825 INFO:teuthology.orchestra.run.smithi037.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-05-30T06:27:15.825 INFO:teuthology.orchestra.run.smithi037.stderr:hint: 2024-05-30T06:27:15.825 INFO:teuthology.orchestra.run.smithi037.stderr:hint: git config --global init.defaultBranch 2024-05-30T06:27:15.825 INFO:teuthology.orchestra.run.smithi037.stderr:hint: 2024-05-30T06:27:15.825 INFO:teuthology.orchestra.run.smithi037.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-05-30T06:27:15.825 INFO:teuthology.orchestra.run.smithi037.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-05-30T06:27:15.825 INFO:teuthology.orchestra.run.smithi037.stderr:hint: 2024-05-30T06:27:15.826 INFO:teuthology.orchestra.run.smithi037.stderr:hint: git branch -m 2024-05-30T06:27:15.826 INFO:teuthology.orchestra.run.smithi037.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-05-30T06:27:15.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-05-30T06:27:15.867 DEBUG:teuthology.orchestra.run.smithi105:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-05-30T06:27:15.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-05-30T06:27:15.925 DEBUG:teuthology.orchestra.run.smithi105:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-05-30T06:27:15.954 DEBUG:teuthology.orchestra.run.smithi037:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-05-30T06:27:53.062 INFO:teuthology.orchestra.run.smithi037.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-05-30T06:27:53.063 INFO:teuthology.orchestra.run.smithi037.stderr: * [new branch] main -> origin/main 2024-05-30T06:27:53.082 INFO:teuthology.orchestra.run.smithi105.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-05-30T06:27:53.082 INFO:teuthology.orchestra.run.smithi105.stderr: * [new branch] main -> origin/main 2024-05-30T06:27:53.097 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190312 -> 20190312 2024-05-30T06:27:53.098 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190416 -> 20190416 2024-05-30T06:27:53.098 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190514 -> 20190514 2024-05-30T06:27:53.098 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190618 -> 20190618 2024-05-30T06:27:53.099 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190717 -> 20190717 2024-05-30T06:27:53.099 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190815 -> 20190815 2024-05-30T06:27:53.099 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190923 -> 20190923 2024-05-30T06:27:53.099 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20191022 -> 20191022 2024-05-30T06:27:53.099 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20191215 -> 20191215 2024-05-30T06:27:53.099 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200122 -> 20200122 2024-05-30T06:27:53.099 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200316 -> 20200316 2024-05-30T06:27:53.099 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200421 -> 20200421 2024-05-30T06:27:53.100 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200519 -> 20200519 2024-05-30T06:27:53.101 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200619 -> 20200619 2024-05-30T06:27:53.101 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200721 -> 20200721 2024-05-30T06:27:53.101 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200817 -> 20200817 2024-05-30T06:27:53.101 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200918 -> 20200918 2024-05-30T06:27:53.101 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20201022 -> 20201022 2024-05-30T06:27:53.101 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20201118 -> 20201118 2024-05-30T06:27:53.101 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20201218 -> 20201218 2024-05-30T06:27:53.101 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20210208 -> 20210208 2024-05-30T06:27:53.102 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20210315 -> 20210315 2024-05-30T06:27:53.102 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20210511 -> 20210511 2024-05-30T06:27:53.102 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20210716 -> 20210716 2024-05-30T06:27:53.102 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20210818 -> 20210818 2024-05-30T06:27:53.102 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20210919 -> 20210919 2024-05-30T06:27:53.104 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20211027 -> 20211027 2024-05-30T06:27:53.104 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20211216 -> 20211216 2024-05-30T06:27:53.104 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220209 -> 20220209 2024-05-30T06:27:53.104 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220310 -> 20220310 2024-05-30T06:27:53.104 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220411 -> 20220411 2024-05-30T06:27:53.104 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220509 -> 20220509 2024-05-30T06:27:53.104 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220610 -> 20220610 2024-05-30T06:27:53.104 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220708 -> 20220708 2024-05-30T06:27:53.104 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220815 -> 20220815 2024-05-30T06:27:53.104 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220913 -> 20220913 2024-05-30T06:27:53.104 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20221012 -> 20221012 2024-05-30T06:27:53.104 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20221109 -> 20221109 2024-05-30T06:27:53.105 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20221214 -> 20221214 2024-05-30T06:27:53.105 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230117 -> 20230117 2024-05-30T06:27:53.105 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230210 -> 20230210 2024-05-30T06:27:53.105 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230310 -> 20230310 2024-05-30T06:27:53.106 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230404 -> 20230404 2024-05-30T06:27:53.106 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230515 -> 20230515 2024-05-30T06:27:53.106 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230625 -> 20230625 2024-05-30T06:27:53.107 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230804 -> 20230804 2024-05-30T06:27:53.107 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230919 -> 20230919 2024-05-30T06:27:53.107 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20231030 -> 20231030 2024-05-30T06:27:53.107 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20231111 -> 20231111 2024-05-30T06:27:53.107 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20231211 -> 20231211 2024-05-30T06:27:53.107 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20240115 -> 20240115 2024-05-30T06:27:53.107 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20240220 -> 20240220 2024-05-30T06:27:53.107 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20240312 -> 20240312 2024-05-30T06:27:53.107 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20240410 -> 20240410 2024-05-30T06:27:53.107 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20240513 -> 20240513 2024-05-30T06:27:53.115 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190312 -> 20190312 2024-05-30T06:27:53.115 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190416 -> 20190416 2024-05-30T06:27:53.116 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190514 -> 20190514 2024-05-30T06:27:53.116 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190618 -> 20190618 2024-05-30T06:27:53.117 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190717 -> 20190717 2024-05-30T06:27:53.117 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190815 -> 20190815 2024-05-30T06:27:53.117 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20190923 -> 20190923 2024-05-30T06:27:53.117 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20191022 -> 20191022 2024-05-30T06:27:53.117 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20191215 -> 20191215 2024-05-30T06:27:53.117 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200122 -> 20200122 2024-05-30T06:27:53.117 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200316 -> 20200316 2024-05-30T06:27:53.117 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200421 -> 20200421 2024-05-30T06:27:53.118 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200519 -> 20200519 2024-05-30T06:27:53.118 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200619 -> 20200619 2024-05-30T06:27:53.118 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200721 -> 20200721 2024-05-30T06:27:53.120 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200817 -> 20200817 2024-05-30T06:27:53.120 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20200918 -> 20200918 2024-05-30T06:27:53.120 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20201022 -> 20201022 2024-05-30T06:27:53.120 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20201118 -> 20201118 2024-05-30T06:27:53.120 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20201218 -> 20201218 2024-05-30T06:27:53.120 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20210208 -> 20210208 2024-05-30T06:27:53.120 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20210315 -> 20210315 2024-05-30T06:27:53.120 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20210511 -> 20210511 2024-05-30T06:27:53.120 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20210716 -> 20210716 2024-05-30T06:27:53.120 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20210818 -> 20210818 2024-05-30T06:27:53.120 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20210919 -> 20210919 2024-05-30T06:27:53.120 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20211027 -> 20211027 2024-05-30T06:27:53.121 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20211216 -> 20211216 2024-05-30T06:27:53.121 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220209 -> 20220209 2024-05-30T06:27:53.121 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220310 -> 20220310 2024-05-30T06:27:53.121 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220411 -> 20220411 2024-05-30T06:27:53.121 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220509 -> 20220509 2024-05-30T06:27:53.121 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220610 -> 20220610 2024-05-30T06:27:53.123 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220708 -> 20220708 2024-05-30T06:27:53.123 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220815 -> 20220815 2024-05-30T06:27:53.123 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20220913 -> 20220913 2024-05-30T06:27:53.123 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20221012 -> 20221012 2024-05-30T06:27:53.123 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20221109 -> 20221109 2024-05-30T06:27:53.123 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20221214 -> 20221214 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230117 -> 20230117 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230210 -> 20230210 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230310 -> 20230310 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230404 -> 20230404 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230515 -> 20230515 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230625 -> 20230625 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230804 -> 20230804 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20230919 -> 20230919 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20231030 -> 20231030 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20231111 -> 20231111 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20231211 -> 20231211 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20240115 -> 20240115 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20240220 -> 20240220 2024-05-30T06:27:53.124 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20240312 -> 20240312 2024-05-30T06:27:53.125 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20240410 -> 20240410 2024-05-30T06:27:53.125 INFO:teuthology.orchestra.run.smithi105.stderr: * [new tag] 20240513 -> 20240513 2024-05-30T06:27:57.445 INFO:teuthology.orchestra.run.smithi105.stderr:Updating files: 45% (1541/3422) Updating files: 46% (1575/3422) Updating files: 47% (1609/3422) Updating files: 48% (1643/3422) Updating files: 49% (1677/3422) Updating files: 50% (1711/3422) Updating files: 51% (1746/3422) Updating files: 52% (1780/3422) Updating files: 53% (1814/3422) Updating files: 54% (1848/3422) Updating files: 55% (1883/3422) Updating files: 56% (1917/3422) Updating files: 57% (1951/3422) Updating files: 58% (1985/3422) Updating files: 59% (2019/3422) Updating files: 59% (2034/3422) Updating files: 60% (2054/3422) Updating files: 61% (2088/3422) Updating files: 62% (2122/3422) Updating files: 63% (2156/3422) Updating files: 64% (2191/3422) Updating files: 65% (2225/3422) Updating files: 66% (2259/3422) Updating files: 67% (2293/3422) Updating files: 68% (2327/3422) Updating files: 69% (2362/3422) Updating files: 70% (2396/3422) Updating files: 70% (2402/3422) Updating files: 71% (2430/3422) Updating files: 72% (2464/3422) Updating files: 73% (2499/3422) Updating files: 74% (2533/3422) Updating files: 75% (2567/3422) Updating files: 76% (2601/3422) Updating files: 77% (2635/3422) Updating files: 78% (2670/3422) Updating files: 79% (2704/3422) Updating files: 80% (2738/3422) Updating files: 81% (2772/3422) Updating files: 82% (2807/3422) Updating files: 83% (2841/3422) Updating files: 83% (2842/3422) Updating files: 84% (2875/3422) Updating files: 85% (2909/3422) Updating files: 86% (2943/3422) Updating files: 87% (2978/3422) Updating files: 88% (3012/3422) Updating files: 89% (3046/3422) Updating files: 90% (3080/3422) Updating files: 91% (3115/3422) Updating files: 92% (3149/3422) Updating files: 93% (3183/3422) Updating files: 94% (3217/3422) Updating files: 95% (3251/3422) Updating files: 96% (3286/3422) Updating files: 97% (3320/3422) Updating files: 98% (3354/3422) Updating files: 99% (3388/3422) Updating files: 100% (3422/3422) Updating files: 100% (3422/3422), done. 2024-05-30T06:27:57.450 INFO:teuthology.orchestra.run.smithi105.stdout:HEAD is now at 92d264e8 Merge branch 'robot/patch-0-1716949439' into 'main' 2024-05-30T06:27:57.472 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.1... 2024-05-30T06:27:57.473 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T06:27:57.624 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ 2024-05-30T06:27:57.625 DEBUG:teuthology.orchestra.run.smithi105:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ --input-file=- 2024-05-30T06:27:57.627 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi105.front.sepia.ceph.com to complete... 2024-05-30T06:27:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:Updating files: 44% (1524/3422) Updating files: 45% (1540/3422) Updating files: 46% (1575/3422) Updating files: 47% (1609/3422) Updating files: 48% (1643/3422) Updating files: 49% (1677/3422) Updating files: 50% (1711/3422) Updating files: 51% (1746/3422) Updating files: 52% (1780/3422) Updating files: 53% (1814/3422) Updating files: 54% (1848/3422) Updating files: 55% (1883/3422) Updating files: 56% (1917/3422) Updating files: 57% (1951/3422) Updating files: 58% (1985/3422) Updating files: 58% (2013/3422) Updating files: 59% (2019/3422) Updating files: 60% (2054/3422) Updating files: 61% (2088/3422) Updating files: 62% (2122/3422) Updating files: 63% (2156/3422) Updating files: 64% (2191/3422) Updating files: 65% (2225/3422) Updating files: 66% (2259/3422) Updating files: 67% (2293/3422) Updating files: 68% (2327/3422) Updating files: 69% (2362/3422) Updating files: 69% (2366/3422) Updating files: 70% (2396/3422) Updating files: 71% (2430/3422) Updating files: 72% (2464/3422) Updating files: 73% (2499/3422) Updating files: 74% (2533/3422) Updating files: 75% (2567/3422) Updating files: 76% (2601/3422) Updating files: 77% (2635/3422) Updating files: 78% (2670/3422) Updating files: 79% (2704/3422) Updating files: 80% (2738/3422) Updating files: 81% (2772/3422) Updating files: 82% (2807/3422) Updating files: 82% (2820/3422) Updating files: 83% (2841/3422) Updating files: 84% (2875/3422) Updating files: 85% (2909/3422) Updating files: 86% (2943/3422) Updating files: 87% (2978/3422) Updating files: 88% (3012/3422) Updating files: 89% (3046/3422) Updating files: 90% (3080/3422) Updating files: 91% (3115/3422) Updating files: 92% (3149/3422) Updating files: 93% (3183/3422) Updating files: 94% (3217/3422) Updating files: 95% (3251/3422) Updating files: 96% (3286/3422) Updating files: 97% (3320/3422) Updating files: 98% (3354/3422) Updating files: 99% (3388/3422) Updating files: 100% (3422/3422) Updating files: 100% (3422/3422), done. 2024-05-30T06:27:57.653 INFO:teuthology.orchestra.run.smithi037.stdout:HEAD is now at 92d264e8 Merge branch 'robot/patch-0-1716949439' into 'main' 2024-05-30T06:27:57.676 INFO:teuthology.task.kernel:Downloading kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-05-30T06:27:57.676 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b9459a26b0888785d05c47deb35abc9d0354ab93 2024-05-30T06:27:57.900 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ 2024-05-30T06:27:57.900 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/ --input-file=- 2024-05-30T06:27:57.902 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi037.front.sepia.ceph.com to complete... 2024-05-30T06:28:00.086 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30 06:28:00 URL:https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb [44988888/44988888] -> "/tmp/linux-image.deb" [1] 2024-05-30T06:28:00.086 INFO:teuthology.orchestra.run.smithi105.stderr:FINISHED --2024-05-30 06:28:00-- 2024-05-30T06:28:00.086 INFO:teuthology.orchestra.run.smithi105.stderr:Total wall clock time: 2.4s 2024-05-30T06:28:00.086 INFO:teuthology.orchestra.run.smithi105.stderr:Downloaded: 1 files, 43M in 2.2s (19.2 MB/s) 2024-05-30T06:28:00.090 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.1... 2024-05-30T06:28:00.091 DEBUG:teuthology.orchestra.run.smithi105:> sudo dpkg -i /tmp/linux-image.deb 2024-05-30T06:28:00.341 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package linux-image-6.9.0-gb9459a26b088. 2024-05-30T06:28:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30 06:28:01 URL:https://2.chacra.ceph.com/r/kernel/testing/b9459a26b0888785d05c47deb35abc9d0354ab93/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-gb9459a26b088/linux-image-6.9.0-gb9459a26b088_6.9.0-gb9459a26b088-1_amd64.deb [44988888/44988888] -> "/tmp/linux-image.deb" [1] 2024-05-30T06:28:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:FINISHED --2024-05-30 06:28:01-- 2024-05-30T06:28:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:Total wall clock time: 3.4s 2024-05-30T06:28:01.442 INFO:teuthology.orchestra.run.smithi037.stderr:Downloaded: 1 files, 43M in 3.2s (13.2 MB/s) 2024-05-30T06:28:01.446 INFO:teuthology.task.kernel:Installing kernel b9459a26b0888785d05c47deb35abc9d0354ab93 on client.0... 2024-05-30T06:28:01.447 DEBUG:teuthology.orchestra.run.smithi037:> sudo dpkg -i /tmp/linux-image.deb 2024-05-30T06:28:01.700 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package linux-image-6.9.0-gb9459a26b088. 2024-05-30T06:28:02.345 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-05-30T06:28:02.349 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-05-30T06:28:02.473 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-30T06:28:03.723 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-05-30T06:28:03.727 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-05-30T06:28:03.885 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-30T06:28:06.181 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-30T06:28:06.290 INFO:teuthology.orchestra.run.smithi105.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-30T06:28:07.966 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-image-6.9.0-gb9459a26b088 (6.9.0-gb9459a26b088-1) ... 2024-05-30T06:28:08.062 INFO:teuthology.orchestra.run.smithi037.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-30T06:28:28.788 INFO:teuthology.orchestra.run.smithi105.stderr:Sourcing file `/etc/default/grub' 2024-05-30T06:28:28.805 INFO:teuthology.orchestra.run.smithi105.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-30T06:28:28.835 INFO:teuthology.orchestra.run.smithi105.stderr:Generating grub configuration file ... 2024-05-30T06:28:29.178 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T06:28:29.197 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-30T06:28:29.464 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-30T06:28:29.471 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-30T06:28:29.531 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-30T06:28:29.537 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-30T06:28:29.677 INFO:teuthology.orchestra.run.smithi105.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-30T06:28:29.677 INFO:teuthology.orchestra.run.smithi105.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-30T06:28:29.677 INFO:teuthology.orchestra.run.smithi105.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-30T06:28:29.714 INFO:teuthology.orchestra.run.smithi105.stderr:done 2024-05-30T06:28:29.890 DEBUG:teuthology.orchestra.run.smithi105:> dpkg-deb -c /tmp/linux-image.deb 2024-05-30T06:28:29.938 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./ 2024-05-30T06:28:29.938 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./boot/ 2024-05-30T06:28:29.938 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7004139 2024-05-23 11:07 ./boot/System.map-6.9.0-gb9459a26b088 2024-05-30T06:28:29.956 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 172251 2024-05-23 11:07 ./boot/config-6.9.0-gb9459a26b088 2024-05-30T06:28:29.956 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13136896 2024-05-23 11:07 ./boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T06:28:29.976 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/ 2024-05-30T06:28:29.976 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/ 2024-05-30T06:28:29.976 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postinst.d/ 2024-05-30T06:28:29.976 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postrm.d/ 2024-05-30T06:28:29.976 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/preinst.d/ 2024-05-30T06:28:29.976 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/prerm.d/ 2024-05-30T06:28:29.976 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/ 2024-05-30T06:28:29.976 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/ 2024-05-30T06:28:29.976 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/ 2024-05-30T06:28:29.977 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/ 2024-05-30T06:28:29.977 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/ 2024-05-30T06:28:29.977 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/ 2024-05-30T06:28:29.977 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ 2024-05-30T06:28:29.977 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 507497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/aesni-intel.ko 2024-05-30T06:28:29.979 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-30T06:28:29.979 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-30T06:28:29.979 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-30T06:28:29.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 97945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-30T06:28:29.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 109897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-30T06:28:29.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 155241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-30T06:28:29.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-30T06:28:29.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-30T06:28:29.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 87001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-30T06:28:29.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-30T06:28:29.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-30T06:28:29.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-30T06:28:29.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-30T06:28:29.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-30T06:28:29.980 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-30T06:28:29.981 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-30T06:28:29.981 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-30T06:28:29.981 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-30T06:28:29.981 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-30T06:28:29.981 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/ 2024-05-30T06:28:29.981 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/ 2024-05-30T06:28:29.981 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/ 2024-05-30T06:28:29.981 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-30T06:28:29.981 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpuid.ko 2024-05-30T06:28:29.981 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/msr.ko 2024-05-30T06:28:29.981 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/ 2024-05-30T06:28:29.981 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 443289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-30T06:28:29.982 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1037081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-30T06:28:29.982 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 2850153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-30T06:28:29.997 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ 2024-05-30T06:28:29.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/af_alg.ko 2024-05-30T06:28:29.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_hash.ko 2024-05-30T06:28:29.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_skcipher.ko 2024-05-30T06:28:29.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-30T06:28:29.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-30T06:28:29.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-30T06:28:29.997 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/ 2024-05-30T06:28:29.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-05-30T06:28:29.997 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/ 2024-05-30T06:28:29.997 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-30T06:28:29.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-30T06:28:29.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-30T06:28:29.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-30T06:28:29.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-30T06:28:29.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-30T06:28:29.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-30T06:28:29.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-30T06:28:29.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-30T06:28:29.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-30T06:28:29.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-30T06:28:29.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-30T06:28:29.998 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-30T06:28:29.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-30T06:28:29.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-30T06:28:29.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-30T06:28:29.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-30T06:28:29.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-30T06:28:29.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cryptd.ko 2024-05-30T06:28:29.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-30T06:28:29.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_simd.ko 2024-05-30T06:28:29.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-30T06:28:29.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-30T06:28:29.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-30T06:28:29.999 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-30T06:28:30.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-30T06:28:30.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-30T06:28:30.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-30T06:28:30.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-30T06:28:30.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lrw.ko 2024-05-30T06:28:30.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-30T06:28:30.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-30T06:28:30.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-30T06:28:30.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-30T06:28:30.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-30T06:28:30.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-30T06:28:30.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-30T06:28:30.000 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-30T06:28:30.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-30T06:28:30.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 169057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-30T06:28:30.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-30T06:28:30.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-30T06:28:30.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-30T06:28:30.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-30T06:28:30.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-30T06:28:30.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-30T06:28:30.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-30T06:28:30.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xts.ko 2024-05-30T06:28:30.001 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-30T06:28:30.001 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ 2024-05-30T06:28:30.002 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ 2024-05-30T06:28:30.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_extlog.ko 2024-05-30T06:28:30.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-30T06:28:30.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-30T06:28:30.002 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/ 2024-05-30T06:28:30.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/einj.ko 2024-05-30T06:28:30.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-30T06:28:30.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-30T06:28:30.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-30T06:28:30.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-30T06:28:30.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 119017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-30T06:28:30.002 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ 2024-05-30T06:28:30.002 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-30T06:28:30.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 99177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci.ko 2024-05-30T06:28:30.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-30T06:28:30.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 107729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci.ko 2024-05-30T06:28:30.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-30T06:28:30.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-30T06:28:30.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-30T06:28:30.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-30T06:28:30.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-30T06:28:30.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-30T06:28:30.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-30T06:28:30.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-30T06:28:30.003 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-30T06:28:30.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-30T06:28:30.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-30T06:28:30.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-30T06:28:30.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-30T06:28:30.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-30T06:28:30.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-30T06:28:30.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-30T06:28:30.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-30T06:28:30.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-30T06:28:30.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_legacy.ko 2024-05-30T06:28:30.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-30T06:28:30.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-30T06:28:30.004 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-30T06:28:30.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-30T06:28:30.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-30T06:28:30.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-30T06:28:30.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-30T06:28:30.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-30T06:28:30.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-30T06:28:30.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-30T06:28:30.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-30T06:28:30.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-30T06:28:30.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-30T06:28:30.005 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_radisys.ko 2024-05-30T06:28:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-30T06:28:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rz1000.ko 2024-05-30T06:28:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-30T06:28:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-30T06:28:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-30T06:28:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-30T06:28:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-30T06:28:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-30T06:28:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-30T06:28:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-30T06:28:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 102113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-30T06:28:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-30T06:28:30.006 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-30T06:28:30.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-30T06:28:30.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-30T06:28:30.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-30T06:28:30.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-30T06:28:30.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-30T06:28:30.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-30T06:28:30.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-30T06:28:30.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-30T06:28:30.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-30T06:28:30.007 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ 2024-05-30T06:28:30.007 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-30T06:28:30.007 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/ 2024-05-30T06:28:30.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 163833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-30T06:28:30.008 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/ 2024-05-30T06:28:30.008 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/ 2024-05-30T06:28:30.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 140833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-30T06:28:30.008 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/ 2024-05-30T06:28:30.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1241585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-30T06:28:30.008 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 203281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-30T06:28:30.061 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/ 2024-05-30T06:28:30.061 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 115257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-30T06:28:30.061 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 143425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-30T06:28:30.061 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/ 2024-05-30T06:28:30.062 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 126609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-30T06:28:30.062 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 119865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-30T06:28:30.062 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 313209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-30T06:28:30.062 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/ 2024-05-30T06:28:30.062 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 117217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-30T06:28:30.062 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/ 2024-05-30T06:28:30.062 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-30T06:28:30.062 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ 2024-05-30T06:28:30.062 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/applicom.ko 2024-05-30T06:28:30.062 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-30T06:28:30.062 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/ 2024-05-30T06:28:30.062 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-30T06:28:30.063 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-30T06:28:30.063 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-30T06:28:30.063 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-30T06:28:30.063 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-30T06:28:30.063 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ 2024-05-30T06:28:30.063 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-30T06:28:30.063 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 186913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-30T06:28:30.063 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-30T06:28:30.063 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 179441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-30T06:28:30.063 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-30T06:28:30.063 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-30T06:28:30.063 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-30T06:28:30.064 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/ 2024-05-30T06:28:30.064 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 103385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-30T06:28:30.064 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/nvram.ko 2024-05-30T06:28:30.064 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-30T06:28:30.064 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-30T06:28:30.064 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/ 2024-05-30T06:28:30.064 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-30T06:28:30.064 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-05-30T06:28:30.064 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-05-30T06:28:30.064 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-05-30T06:28:30.064 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-30T06:28:30.064 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-30T06:28:30.064 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-05-30T06:28:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/ 2024-05-30T06:28:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_class.ko 2024-05-30T06:28:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_core.ko 2024-05-30T06:28:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-05-30T06:28:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/ 2024-05-30T06:28:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-palmas.ko 2024-05-30T06:28:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-si5351.ko 2024-05-30T06:28:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-twl6040.ko 2024-05-30T06:28:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-wm831x.ko 2024-05-30T06:28:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/ 2024-05-30T06:28:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-30T06:28:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-30T06:28:30.065 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-30T06:28:30.066 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ 2024-05-30T06:28:30.066 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ 2024-05-30T06:28:30.066 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 89209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-30T06:28:30.066 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 333593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-30T06:28:30.066 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/ 2024-05-30T06:28:30.066 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/ 2024-05-30T06:28:30.066 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/ 2024-05-30T06:28:30.066 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 751433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-30T06:28:30.066 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-05-30T06:28:30.066 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-30T06:28:30.066 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-30T06:28:30.066 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-30T06:28:30.067 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/ 2024-05-30T06:28:30.067 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 90465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-30T06:28:30.067 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/ 2024-05-30T06:28:30.067 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-30T06:28:30.067 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ 2024-05-30T06:28:30.067 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/ 2024-05-30T06:28:30.067 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-30T06:28:30.067 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ 2024-05-30T06:28:30.067 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 146745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-30T06:28:30.067 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ 2024-05-30T06:28:30.067 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 96137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-30T06:28:30.067 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-30T06:28:30.068 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-30T06:28:30.068 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-30T06:28:30.068 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-30T06:28:30.068 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-30T06:28:30.068 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-30T06:28:30.068 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-30T06:28:30.068 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 64153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-30T06:28:30.068 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-30T06:28:30.068 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-30T06:28:30.068 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 68689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-30T06:28:30.068 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-30T06:28:30.068 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/ 2024-05-30T06:28:30.068 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-gpio.ko 2024-05-30T06:28:30.069 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max14577.ko 2024-05-30T06:28:30.069 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max77693.ko 2024-05-30T06:28:30.069 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max8997.ko 2024-05-30T06:28:30.069 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-palmas.ko 2024-05-30T06:28:30.069 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-rt8973a.ko 2024-05-30T06:28:30.069 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-sm5502.ko 2024-05-30T06:28:30.069 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/ 2024-05-30T06:28:30.069 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/dmi-sysfs.ko 2024-05-30T06:28:30.069 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/ 2024-05-30T06:28:30.069 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/efi-pstore.ko 2024-05-30T06:28:30.069 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-30T06:28:30.069 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/ 2024-05-30T06:28:30.070 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-adp5520.ko 2024-05-30T06:28:30.070 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-amd8111.ko 2024-05-30T06:28:30.070 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-arizona.ko 2024-05-30T06:28:30.070 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9052.ko 2024-05-30T06:28:30.070 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9055.ko 2024-05-30T06:28:30.070 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-dln2.ko 2024-05-30T06:28:30.070 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 81065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-f7188x.ko 2024-05-30T06:28:30.070 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-generic.ko 2024-05-30T06:28:30.070 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-30T06:28:30.070 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-05-30T06:28:30.070 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-kempld.ko 2024-05-30T06:28:30.070 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-lp3943.ko 2024-05-30T06:28:30.070 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max7300.ko 2024-05-30T06:28:30.071 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max730x.ko 2024-05-30T06:28:30.071 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max732x.ko 2024-05-30T06:28:30.071 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-05-30T06:28:30.071 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pca953x.ko 2024-05-30T06:28:30.071 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pcf857x.ko 2024-05-30T06:28:30.071 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-rdc321x.ko 2024-05-30T06:28:30.071 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch.ko 2024-05-30T06:28:30.071 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch311x.ko 2024-05-30T06:28:30.071 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-tps65912.ko 2024-05-30T06:28:30.071 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl4030.ko 2024-05-30T06:28:30.071 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl6040.ko 2024-05-30T06:28:30.071 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-30T06:28:30.072 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-vx855.ko 2024-05-30T06:28:30.072 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm831x.ko 2024-05-30T06:28:30.072 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8350.ko 2024-05-30T06:28:30.072 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8994.ko 2024-05-30T06:28:30.072 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/ 2024-05-30T06:28:30.072 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-a4tech.ko 2024-05-30T06:28:30.072 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-apple.ko 2024-05-30T06:28:30.072 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-30T06:28:30.072 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-30T06:28:30.072 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-30T06:28:30.072 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-belkin.ko 2024-05-30T06:28:30.072 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cherry.ko 2024-05-30T06:28:30.073 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-chicony.ko 2024-05-30T06:28:30.073 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 74385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cp2112.ko 2024-05-30T06:28:30.073 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cypress.ko 2024-05-30T06:28:30.073 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-30T06:28:30.073 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-30T06:28:30.073 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-30T06:28:30.073 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-30T06:28:30.073 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ezkey.ko 2024-05-30T06:28:30.073 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-30T06:28:30.073 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-generic.ko 2024-05-30T06:28:30.073 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-30T06:28:30.073 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-30T06:28:30.074 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-30T06:28:30.074 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-30T06:28:30.074 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-30T06:28:30.074 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-30T06:28:30.074 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-30T06:28:30.074 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kensington.ko 2024-05-30T06:28:30.074 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-30T06:28:30.074 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-30T06:28:30.074 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-30T06:28:30.074 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-30T06:28:30.074 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lg-g15.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 121361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 97929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-magicmouse.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-microsoft.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-monterey.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 58993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ntrig.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 91217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-30T06:28:30.075 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-30T06:28:30.076 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-30T06:28:30.076 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-30T06:28:30.076 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-30T06:28:30.076 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-30T06:28:30.076 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-30T06:28:30.076 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-30T06:28:30.076 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-30T06:28:30.076 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-30T06:28:30.076 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-30T06:28:30.076 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-30T06:28:30.076 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-30T06:28:30.076 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-30T06:28:30.076 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-30T06:28:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-30T06:28:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-30T06:28:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-30T06:28:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-30T06:28:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-30T06:28:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-30T06:28:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-30T06:28:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-30T06:28:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-30T06:28:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-30T06:28:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-30T06:28:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-30T06:28:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-30T06:28:30.078 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-30T06:28:30.078 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-30T06:28:30.078 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 81097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-30T06:28:30.078 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-30T06:28:30.078 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 184729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-30T06:28:30.078 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-30T06:28:30.078 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-30T06:28:30.078 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-30T06:28:30.078 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 319897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid.ko 2024-05-30T06:28:30.078 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-30T06:28:30.078 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/ 2024-05-30T06:28:30.078 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 153617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbhid.ko 2024-05-30T06:28:30.079 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbkbd.ko 2024-05-30T06:28:30.079 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbmouse.ko 2024-05-30T06:28:30.079 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 261929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-30T06:28:30.079 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/ 2024-05-30T06:28:30.079 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 75057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-30T06:28:30.079 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 110657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-30T06:28:30.079 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 381625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-30T06:28:30.079 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ 2024-05-30T06:28:30.079 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 77145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-30T06:28:30.079 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-30T06:28:30.079 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-30T06:28:30.079 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-30T06:28:30.080 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-30T06:28:30.080 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-30T06:28:30.080 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-30T06:28:30.080 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 115049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-30T06:28:30.080 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-30T06:28:30.080 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-30T06:28:30.080 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-30T06:28:30.080 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-30T06:28:30.080 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-30T06:28:30.080 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-30T06:28:30.080 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 89017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-30T06:28:30.080 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-30T06:28:30.080 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 81465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-30T06:28:30.081 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-30T06:28:30.081 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-30T06:28:30.081 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 68857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-30T06:28:30.081 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-30T06:28:30.081 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 69001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-30T06:28:30.081 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-30T06:28:30.081 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-30T06:28:30.081 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-30T06:28:30.081 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9052-hwmon.ko 2024-05-30T06:28:30.081 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9055-hwmon.ko 2024-05-30T06:28:30.081 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-30T06:28:30.081 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 113129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-30T06:28:30.082 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-30T06:28:30.082 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-30T06:28:30.082 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-30T06:28:30.082 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc2103.ko 2024-05-30T06:28:30.082 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-30T06:28:30.082 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-30T06:28:30.082 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 108953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-30T06:28:30.082 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-30T06:28:30.082 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-30T06:28:30.082 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-30T06:28:30.082 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-30T06:28:30.082 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-30T06:28:30.083 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-30T06:28:30.083 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 56305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-30T06:28:30.083 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hih6130.ko 2024-05-30T06:28:30.083 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-30T06:28:30.083 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-30T06:28:30.083 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-30T06:28:30.083 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-30T06:28:30.083 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-30T06:28:30.083 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-30T06:28:30.083 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-30T06:28:30.083 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 156457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-30T06:28:30.084 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/jc42.ko 2024-05-30T06:28:30.084 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-30T06:28:30.084 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-30T06:28:30.084 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-30T06:28:30.084 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-30T06:28:30.084 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-30T06:28:30.084 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-30T06:28:30.084 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-30T06:28:30.084 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-30T06:28:30.084 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-30T06:28:30.084 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-30T06:28:30.084 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 86489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-30T06:28:30.084 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-30T06:28:30.085 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 76481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-30T06:28:30.085 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-30T06:28:30.085 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 131497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-30T06:28:30.085 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-30T06:28:30.085 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-30T06:28:30.085 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-30T06:28:30.085 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-30T06:28:30.085 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-30T06:28:30.085 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-30T06:28:30.085 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-30T06:28:30.085 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-30T06:28:30.085 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-30T06:28:30.086 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-30T06:28:30.086 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-30T06:28:30.086 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-30T06:28:30.086 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-30T06:28:30.086 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-30T06:28:30.086 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-30T06:28:30.086 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-30T06:28:30.086 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-30T06:28:30.086 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mc13783-adc.ko 2024-05-30T06:28:30.086 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-30T06:28:30.086 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-05-30T06:28:30.087 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 56497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-30T06:28:30.087 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 141345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-30T06:28:30.087 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 72729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-30T06:28:30.087 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-30T06:28:30.087 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 97769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-30T06:28:30.087 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-30T06:28:30.087 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-30T06:28:30.087 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ 2024-05-30T06:28:30.087 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-30T06:28:30.087 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-30T06:28:30.087 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-30T06:28:30.087 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-30T06:28:30.088 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-30T06:28:30.088 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-30T06:28:30.088 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-30T06:28:30.088 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 101225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-30T06:28:30.088 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-30T06:28:30.088 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-30T06:28:30.088 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-30T06:28:30.088 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-30T06:28:30.088 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-30T06:28:30.088 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-30T06:28:30.088 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-30T06:28:30.088 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-30T06:28:30.089 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-30T06:28:30.089 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-30T06:28:30.089 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-30T06:28:30.089 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-30T06:28:30.089 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-30T06:28:30.089 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-30T06:28:30.089 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-30T06:28:30.089 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-30T06:28:30.089 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-30T06:28:30.089 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-30T06:28:30.089 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-30T06:28:30.089 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-30T06:28:30.089 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-30T06:28:30.090 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-30T06:28:30.090 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-30T06:28:30.090 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-30T06:28:30.090 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 71161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-30T06:28:30.090 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 96569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-30T06:28:30.090 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-30T06:28:30.090 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 75121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-30T06:28:30.090 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 83417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-30T06:28:30.090 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 116769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-30T06:28:30.090 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 134433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-30T06:28:30.090 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-30T06:28:30.090 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-30T06:28:30.091 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-05-30T06:28:30.091 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-05-30T06:28:30.091 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/ 2024-05-30T06:28:30.091 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/ 2024-05-30T06:28:30.091 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-30T06:28:30.091 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-30T06:28:30.091 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/ 2024-05-30T06:28:30.091 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-05-30T06:28:30.091 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-05-30T06:28:30.091 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-05-30T06:28:30.091 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-30T06:28:30.092 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-30T06:28:30.092 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-30T06:28:30.092 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-05-30T06:28:30.092 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-30T06:28:30.092 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-05-30T06:28:30.092 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 64217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-30T06:28:30.092 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-30T06:28:30.092 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-30T06:28:30.092 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-30T06:28:30.092 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-05-30T06:28:30.092 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-05-30T06:28:30.092 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 76961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-30T06:28:30.092 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-30T06:28:30.093 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-30T06:28:30.093 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-05-30T06:28:30.093 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-30T06:28:30.093 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-30T06:28:30.093 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-05-30T06:28:30.093 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-30T06:28:30.093 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-30T06:28:30.093 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-30T06:28:30.093 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-05-30T06:28:30.093 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-30T06:28:30.093 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-30T06:28:30.094 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-05-30T06:28:30.094 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-05-30T06:28:30.094 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-30T06:28:30.094 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-05-30T06:28:30.094 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-30T06:28:30.094 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-30T06:28:30.094 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-30T06:28:30.094 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-30T06:28:30.094 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-05-30T06:28:30.094 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-30T06:28:30.095 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-30T06:28:30.095 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-30T06:28:30.095 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/ 2024-05-30T06:28:30.095 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-05-30T06:28:30.095 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-05-30T06:28:30.095 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-05-30T06:28:30.095 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ 2024-05-30T06:28:30.095 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ 2024-05-30T06:28:30.095 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 329681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-30T06:28:30.095 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1119785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-30T06:28:30.095 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 83897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-30T06:28:30.095 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 408329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-30T06:28:30.096 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 120905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-30T06:28:30.096 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 347201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-30T06:28:30.096 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 84937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-30T06:28:30.096 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ 2024-05-30T06:28:30.096 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/ 2024-05-30T06:28:30.096 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 590873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-30T06:28:30.096 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/ 2024-05-30T06:28:30.096 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 514577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-30T06:28:30.096 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/ 2024-05-30T06:28:30.096 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 911649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-30T06:28:30.097 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ 2024-05-30T06:28:30.097 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 375449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-30T06:28:30.097 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ 2024-05-30T06:28:30.097 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 197097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-05-30T06:28:30.097 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/ 2024-05-30T06:28:30.097 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 212497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-05-30T06:28:30.097 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ 2024-05-30T06:28:30.097 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ 2024-05-30T06:28:30.097 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 334353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-30T06:28:30.097 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ 2024-05-30T06:28:30.097 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 120649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-30T06:28:30.098 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ 2024-05-30T06:28:30.098 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 132577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-30T06:28:30.098 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ 2024-05-30T06:28:30.098 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 157929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-30T06:28:30.098 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ 2024-05-30T06:28:30.098 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 156665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-30T06:28:30.098 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ 2024-05-30T06:28:30.098 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/evbug.ko 2024-05-30T06:28:30.098 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ff-memless.ko 2024-05-30T06:28:30.098 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/ 2024-05-30T06:28:30.098 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-30T06:28:30.098 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-30T06:28:30.099 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-30T06:28:30.099 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-30T06:28:30.099 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/ 2024-05-30T06:28:30.099 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-05-30T06:28:30.099 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-05-30T06:28:30.099 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-05-30T06:28:30.099 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-05-30T06:28:30.099 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-30T06:28:30.099 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-05-30T06:28:30.099 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lkkbd.ko 2024-05-30T06:28:30.099 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8323.ko 2024-05-30T06:28:30.099 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8333.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/newtonkbd.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt1070.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt2160.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/stowaway.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/sunkbd.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-05-30T06:28:30.100 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-05-30T06:28:30.101 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/xtkbd.ko 2024-05-30T06:28:30.101 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/matrix-keymap.ko 2024-05-30T06:28:30.101 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/ 2024-05-30T06:28:30.101 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-30T06:28:30.101 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-30T06:28:30.101 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 159993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-30T06:28:30.101 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 114193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-30T06:28:30.101 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/gpio_mouse.ko 2024-05-30T06:28:30.101 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 428121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/psmouse.ko 2024-05-30T06:28:30.101 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-30T06:28:30.101 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-30T06:28:30.101 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-30T06:28:30.102 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-30T06:28:30.102 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/ 2024-05-30T06:28:30.102 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 140921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-30T06:28:30.102 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ 2024-05-30T06:28:30.102 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-30T06:28:30.102 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-30T06:28:30.102 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ct82c710.ko 2024-05-30T06:28:30.102 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-30T06:28:30.102 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/parkbd.ko 2024-05-30T06:28:30.102 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/pcips2.ko 2024-05-30T06:28:30.102 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ps2mult.ko 2024-05-30T06:28:30.102 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-30T06:28:30.103 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serport.ko 2024-05-30T06:28:30.103 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-30T06:28:30.103 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/ 2024-05-30T06:28:30.103 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-88pm860x.ko 2024-05-30T06:28:30.103 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-adp5520.ko 2024-05-30T06:28:30.103 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 77193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-bd2802.ko 2024-05-30T06:28:30.103 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-30T06:28:30.103 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da903x.ko 2024-05-30T06:28:30.103 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da9052.ko 2024-05-30T06:28:30.103 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-gpio.ko 2024-05-30T06:28:30.103 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-30T06:28:30.103 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3533.ko 2024-05-30T06:28:30.103 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm355x.ko 2024-05-30T06:28:30.104 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3642.ko 2024-05-30T06:28:30.104 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-30T06:28:30.104 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp8788.ko 2024-05-30T06:28:30.104 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-max8997.ko 2024-05-30T06:28:30.104 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-mc13783.ko 2024-05-30T06:28:30.104 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-menf21bmc.ko 2024-05-30T06:28:30.104 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca9532.ko 2024-05-30T06:28:30.104 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca955x.ko 2024-05-30T06:28:30.104 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca963x.ko 2024-05-30T06:28:30.104 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-30T06:28:30.104 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-tca6507.ko 2024-05-30T06:28:30.104 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm831x-status.ko 2024-05-30T06:28:30.104 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm8350.ko 2024-05-30T06:28:30.105 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ 2024-05-30T06:28:30.105 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-30T06:28:30.105 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-30T06:28:30.105 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-30T06:28:30.105 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-30T06:28:30.105 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-30T06:28:30.105 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-30T06:28:30.105 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-30T06:28:30.105 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-30T06:28:30.105 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-30T06:28:30.105 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/ 2024-05-30T06:28:30.105 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/ 2024-05-30T06:28:30.106 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 790665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-30T06:28:30.106 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-30T06:28:30.106 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 116817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bufio.ko 2024-05-30T06:28:30.106 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 58273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-30T06:28:30.106 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 199017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-30T06:28:30.106 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 134937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-30T06:28:30.106 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-30T06:28:30.106 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-era.ko 2024-05-30T06:28:30.106 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-30T06:28:30.106 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-30T06:28:30.106 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log.ko 2024-05-30T06:28:30.106 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-mirror.ko 2024-05-30T06:28:30.107 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 97193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-30T06:28:30.107 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-30T06:28:30.107 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-30T06:28:30.107 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-region-hash.ko 2024-05-30T06:28:30.107 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-30T06:28:30.107 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-30T06:28:30.107 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 139793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-snapshot.ko 2024-05-30T06:28:30.107 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-30T06:28:30.107 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 234441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-30T06:28:30.107 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-30T06:28:30.107 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-zero.ko 2024-05-30T06:28:30.108 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/ 2024-05-30T06:28:30.108 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 264273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-30T06:28:30.108 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-30T06:28:30.108 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 124705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-30T06:28:30.108 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 157673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-30T06:28:30.108 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 444649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-30T06:28:30.108 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/ 2024-05-30T06:28:30.108 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/ 2024-05-30T06:28:30.108 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 214833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-30T06:28:30.108 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 77977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-30T06:28:30.109 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-30T06:28:30.109 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-30T06:28:30.109 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 150753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-30T06:28:30.109 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 97209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-30T06:28:30.109 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 63865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-30T06:28:30.109 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/ 2024-05-30T06:28:30.109 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm800.ko 2024-05-30T06:28:30.109 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm805.ko 2024-05-30T06:28:30.109 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm80x.ko 2024-05-30T06:28:30.109 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona-i2c.ko 2024-05-30T06:28:30.109 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 148545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona.ko 2024-05-30T06:28:30.110 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/bcm590xx.ko 2024-05-30T06:28:30.110 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/cros_ec_dev.ko 2024-05-30T06:28:30.110 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/dln2.ko 2024-05-30T06:28:30.110 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/janz-cmodio.ko 2024-05-30T06:28:30.110 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/kempld-core.ko 2024-05-30T06:28:30.110 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-core.ko 2024-05-30T06:28:30.110 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-05-30T06:28:30.110 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lp3943.ko 2024-05-30T06:28:30.110 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-30T06:28:30.110 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-30T06:28:30.110 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/max8907.ko 2024-05-30T06:28:30.111 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-core.ko 2024-05-30T06:28:30.111 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-05-30T06:28:30.111 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/menf21bmc.ko 2024-05-30T06:28:30.111 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-adc.ko 2024-05-30T06:28:30.111 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-gpio.ko 2024-05-30T06:28:30.111 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633.ko 2024-05-30T06:28:30.111 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-05-30T06:28:30.111 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/retu-mfd.ko 2024-05-30T06:28:30.111 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 99409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/si476x-core.ko 2024-05-30T06:28:30.111 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 58049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-30T06:28:30.112 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps65010.ko 2024-05-30T06:28:30.112 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps6507x.ko 2024-05-30T06:28:30.112 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-30T06:28:30.112 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-30T06:28:30.112 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-30T06:28:30.112 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wm8994.ko 2024-05-30T06:28:30.112 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ 2024-05-30T06:28:30.112 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-05-30T06:28:30.112 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 64257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot.ko 2024-05-30T06:28:30.112 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/ 2024-05-30T06:28:30.112 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-30T06:28:30.112 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-30T06:28:30.113 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-30T06:28:30.113 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 58625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-30T06:28:30.113 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/ 2024-05-30T06:28:30.113 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-05-30T06:28:30.113 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/core.ko 2024-05-30T06:28:30.113 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/ 2024-05-30T06:28:30.113 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-30T06:28:30.113 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ds1682.ko 2024-05-30T06:28:30.113 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/dummy-irq.ko 2024-05-30T06:28:30.113 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/ 2024-05-30T06:28:30.113 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/echo.ko 2024-05-30T06:28:30.113 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/ 2024-05-30T06:28:30.113 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-30T06:28:30.114 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-30T06:28:30.114 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-30T06:28:30.114 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-30T06:28:30.114 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/ 2024-05-30T06:28:30.114 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 191617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-05-30T06:28:30.114 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hmc6352.ko 2024-05-30T06:28:30.114 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-30T06:28:30.114 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ 2024-05-30T06:28:30.114 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 92289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-05-30T06:28:30.114 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ics932s401.ko 2024-05-30T06:28:30.114 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-30T06:28:30.114 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-30T06:28:30.115 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/ 2024-05-30T06:28:30.115 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-30T06:28:30.115 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-30T06:28:30.115 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/ 2024-05-30T06:28:30.115 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 154257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-30T06:28:30.115 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 69793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-30T06:28:30.115 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 388977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-30T06:28:30.115 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/phantom.ko 2024-05-30T06:28:30.115 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/ 2024-05-30T06:28:30.115 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 91129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/st_drv.ko 2024-05-30T06:28:30.115 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-30T06:28:30.115 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-30T06:28:30.115 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-30T06:28:30.116 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-30T06:28:30.116 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/ 2024-05-30T06:28:30.116 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 234849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-30T06:28:30.116 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ 2024-05-30T06:28:30.116 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/ 2024-05-30T06:28:30.116 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 620849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-30T06:28:30.116 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/ 2024-05-30T06:28:30.116 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/ 2024-05-30T06:28:30.116 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 139745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-30T06:28:30.116 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-30T06:28:30.116 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-30T06:28:30.116 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/ 2024-05-30T06:28:30.116 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 589537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-30T06:28:30.167 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-30T06:28:30.167 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-30T06:28:30.167 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ 2024-05-30T06:28:30.168 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/ 2024-05-30T06:28:30.168 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-30T06:28:30.168 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-30T06:28:30.168 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 158641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-30T06:28:30.168 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-30T06:28:30.168 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ 2024-05-30T06:28:30.168 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-30T06:28:30.168 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-30T06:28:30.168 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-30T06:28:30.168 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 109513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-30T06:28:30.168 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/ 2024-05-30T06:28:30.168 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 64697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-30T06:28:30.169 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/ 2024-05-30T06:28:30.169 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 84321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-30T06:28:30.169 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/ 2024-05-30T06:28:30.169 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-30T06:28:30.169 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/ 2024-05-30T06:28:30.169 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-30T06:28:30.169 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/ 2024-05-30T06:28:30.169 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-30T06:28:30.169 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 56049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-30T06:28:30.169 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 115873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-30T06:28:30.169 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/ 2024-05-30T06:28:30.169 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/ 2024-05-30T06:28:30.170 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 124481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-30T06:28:30.170 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-05-30T06:28:30.170 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 128393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-30T06:28:30.170 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-05-30T06:28:30.170 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 110321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-30T06:28:30.170 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/ 2024-05-30T06:28:30.170 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 101849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-30T06:28:30.170 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 88945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-30T06:28:30.170 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/ 2024-05-30T06:28:30.170 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 105625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-30T06:28:30.171 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 228977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-30T06:28:30.171 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-05-30T06:28:30.171 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1733297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-30T06:28:30.171 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 167177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-30T06:28:30.171 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/ 2024-05-30T06:28:30.171 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 164249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-30T06:28:30.171 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 440553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-30T06:28:30.171 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/ 2024-05-30T06:28:30.171 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/ 2024-05-30T06:28:30.171 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 432145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-30T06:28:30.171 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/ 2024-05-30T06:28:30.171 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-05-30T06:28:30.172 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 257145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-30T06:28:30.172 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-05-30T06:28:30.172 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 446057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-30T06:28:30.172 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-05-30T06:28:30.172 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1311193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-30T06:28:30.172 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-05-30T06:28:30.172 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 206673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-30T06:28:30.172 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-05-30T06:28:30.172 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-30T06:28:30.172 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/ 2024-05-30T06:28:30.172 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/ 2024-05-30T06:28:30.172 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 269249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-30T06:28:30.173 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/ 2024-05-30T06:28:30.173 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/ 2024-05-30T06:28:30.173 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-30T06:28:30.173 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 77449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-30T06:28:30.173 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 169041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-30T06:28:30.173 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-30T06:28:30.173 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 76201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-30T06:28:30.173 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-30T06:28:30.173 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/ 2024-05-30T06:28:30.173 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 75937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-30T06:28:30.173 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-30T06:28:30.174 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-30T06:28:30.174 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ec_bhf.ko 2024-05-30T06:28:30.174 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/ 2024-05-30T06:28:30.174 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/ 2024-05-30T06:28:30.174 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 356353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-30T06:28:30.174 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-30T06:28:30.174 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 63177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-30T06:28:30.174 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/ 2024-05-30T06:28:30.174 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-05-30T06:28:30.174 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ 2024-05-30T06:28:30.174 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 115561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-30T06:28:30.174 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/ 2024-05-30T06:28:30.174 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 366193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-30T06:28:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/ 2024-05-30T06:28:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 755673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-30T06:28:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/ 2024-05-30T06:28:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 324513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-30T06:28:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/ 2024-05-30T06:28:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1196201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-30T06:28:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/ 2024-05-30T06:28:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 362609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-30T06:28:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/ 2024-05-30T06:28:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 672313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-30T06:28:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/ 2024-05-30T06:28:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 121513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-30T06:28:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-05-30T06:28:30.176 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 966601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-30T06:28:30.176 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-05-30T06:28:30.176 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 193465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-30T06:28:30.176 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 108625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-30T06:28:30.176 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/ 2024-05-30T06:28:30.176 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-30T06:28:30.176 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 126873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-30T06:28:30.176 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 150769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-30T06:28:30.176 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/ 2024-05-30T06:28:30.176 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-05-30T06:28:30.176 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 904929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-30T06:28:30.176 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 344089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-30T06:28:30.176 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-05-30T06:28:30.177 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-05-30T06:28:30.177 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1413529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-30T06:28:30.177 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ 2024-05-30T06:28:30.177 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-05-30T06:28:30.177 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-05-30T06:28:30.177 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-05-30T06:28:30.177 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 117345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-30T06:28:30.177 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/ 2024-05-30T06:28:30.177 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-05-30T06:28:30.177 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 131353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-30T06:28:30.177 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ 2024-05-30T06:28:30.177 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 91457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-30T06:28:30.178 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 56681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-30T06:28:30.178 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/ 2024-05-30T06:28:30.178 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 181201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-30T06:28:30.178 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/ 2024-05-30T06:28:30.178 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 171409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-30T06:28:30.178 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/ 2024-05-30T06:28:30.178 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 58241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-30T06:28:30.178 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-30T06:28:30.178 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/ 2024-05-30T06:28:30.178 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-05-30T06:28:30.178 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 300793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-30T06:28:30.178 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 105681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-30T06:28:30.179 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-05-30T06:28:30.179 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 885057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-30T06:28:30.179 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/ 2024-05-30T06:28:30.179 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-30T06:28:30.179 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/ 2024-05-30T06:28:30.179 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 81633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-30T06:28:30.179 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 100681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-30T06:28:30.179 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-30T06:28:30.179 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 264145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-30T06:28:30.179 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/ 2024-05-30T06:28:30.179 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-05-30T06:28:30.179 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 142401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-05-30T06:28:30.179 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/ 2024-05-30T06:28:30.180 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1350201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-30T06:28:30.180 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/ 2024-05-30T06:28:30.180 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-30T06:28:30.180 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/ 2024-05-30T06:28:30.180 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-30T06:28:30.180 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 80057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-30T06:28:30.180 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/ 2024-05-30T06:28:30.180 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 74281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-30T06:28:30.180 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 79449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-30T06:28:30.180 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 100777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-30T06:28:30.180 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 83433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-30T06:28:30.180 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/ 2024-05-30T06:28:30.180 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-05-30T06:28:30.181 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-05-30T06:28:30.181 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-30T06:28:30.181 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-05-30T06:28:30.181 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 644329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-30T06:28:30.181 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/ 2024-05-30T06:28:30.181 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 128489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-30T06:28:30.181 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 207985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-30T06:28:30.181 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 82625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-30T06:28:30.181 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 91345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-30T06:28:30.181 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/ 2024-05-30T06:28:30.181 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-30T06:28:30.181 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/ 2024-05-30T06:28:30.181 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 110721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-30T06:28:30.182 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/ 2024-05-30T06:28:30.182 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 98681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-30T06:28:30.182 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 102505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-30T06:28:30.182 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/ 2024-05-30T06:28:30.182 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-30T06:28:30.182 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-30T06:28:30.182 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/ 2024-05-30T06:28:30.182 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 69905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-30T06:28:30.182 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/ 2024-05-30T06:28:30.182 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/defxx.ko 2024-05-30T06:28:30.182 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/ 2024-05-30T06:28:30.182 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 275713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/skfp.ko 2024-05-30T06:28:30.182 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 91665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-30T06:28:30.183 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/ 2024-05-30T06:28:30.183 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 290441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-30T06:28:30.183 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/ 2024-05-30T06:28:30.183 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-30T06:28:30.183 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-30T06:28:30.183 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ 2024-05-30T06:28:30.183 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-30T06:28:30.183 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-30T06:28:30.183 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-30T06:28:30.183 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/ 2024-05-30T06:28:30.183 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-30T06:28:30.183 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-30T06:28:30.184 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-gpio.ko 2024-05-30T06:28:30.184 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-30T06:28:30.184 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-30T06:28:30.184 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-30T06:28:30.184 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-30T06:28:30.184 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-30T06:28:30.184 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/ 2024-05-30T06:28:30.184 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-30T06:28:30.184 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-30T06:28:30.184 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ 2024-05-30T06:28:30.184 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-30T06:28:30.184 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-30T06:28:30.184 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-30T06:28:30.185 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-30T06:28:30.185 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-30T06:28:30.185 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-30T06:28:30.185 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-30T06:28:30.185 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-30T06:28:30.185 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-30T06:28:30.185 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-30T06:28:30.185 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 103369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-30T06:28:30.185 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 96017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-30T06:28:30.185 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-30T06:28:30.185 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 121097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-30T06:28:30.185 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-30T06:28:30.185 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-30T06:28:30.186 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-30T06:28:30.186 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-30T06:28:30.186 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-30T06:28:30.186 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/ 2024-05-30T06:28:30.186 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/plip.ko 2024-05-30T06:28:30.186 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ 2024-05-30T06:28:30.186 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-30T06:28:30.186 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-30T06:28:30.186 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-30T06:28:30.186 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-30T06:28:30.186 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-30T06:28:30.186 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-30T06:28:30.187 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-30T06:28:30.187 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-30T06:28:30.187 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sb1000.ko 2024-05-30T06:28:30.187 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/ 2024-05-30T06:28:30.187 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-30T06:28:30.187 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-30T06:28:30.187 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 80153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-30T06:28:30.187 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/ 2024-05-30T06:28:30.187 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 137313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-30T06:28:30.187 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-30T06:28:30.187 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-30T06:28:30.187 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-30T06:28:30.187 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-30T06:28:30.188 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-30T06:28:30.188 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 108081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-30T06:28:30.188 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/ 2024-05-30T06:28:30.188 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 176481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-30T06:28:30.188 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/ 2024-05-30T06:28:30.188 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 384329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-30T06:28:30.188 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/ 2024-05-30T06:28:30.188 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 175513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-30T06:28:30.188 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ 2024-05-30T06:28:30.188 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-30T06:28:30.188 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/ 2024-05-30T06:28:30.189 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/ 2024-05-30T06:28:30.189 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 335489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-30T06:28:30.189 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 127497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-30T06:28:30.189 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/ 2024-05-30T06:28:30.189 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 168113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-30T06:28:30.189 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-30T06:28:30.189 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 103881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-30T06:28:30.189 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-30T06:28:30.189 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/ 2024-05-30T06:28:30.189 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/ 2024-05-30T06:28:30.189 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-30T06:28:30.189 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-05-30T06:28:30.189 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-05-30T06:28:30.190 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pci-stub.ko 2024-05-30T06:28:30.190 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-30T06:28:30.190 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/ 2024-05-30T06:28:30.190 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-30T06:28:30.190 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 179937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia.ko 2024-05-30T06:28:30.190 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_core.ko 2024-05-30T06:28:30.190 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-05-30T06:28:30.190 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-30T06:28:30.190 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 133745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-30T06:28:30.190 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/ 2024-05-30T06:28:30.190 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/ 2024-05-30T06:28:30.190 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-05-30T06:28:30.191 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/ 2024-05-30T06:28:30.191 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-05-30T06:28:30.191 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/ 2024-05-30T06:28:30.191 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/ 2024-05-30T06:28:30.191 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-30T06:28:30.191 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/ 2024-05-30T06:28:30.191 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/ 2024-05-30T06:28:30.191 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-05-30T06:28:30.191 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec.ko 2024-05-30T06:28:30.191 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-05-30T06:28:30.191 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-05-30T06:28:30.191 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-05-30T06:28:30.192 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-05-30T06:28:30.192 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-05-30T06:28:30.192 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ 2024-05-30T06:28:30.192 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 87929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-30T06:28:30.192 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-30T06:28:30.192 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-30T06:28:30.192 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-30T06:28:30.192 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-30T06:28:30.192 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 164761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-30T06:28:30.192 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-30T06:28:30.192 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-30T06:28:30.192 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-30T06:28:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-30T06:28:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-30T06:28:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-30T06:28:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ibm_rtl.ko 2024-05-30T06:28:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/ 2024-05-30T06:28:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-30T06:28:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-05-30T06:28:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-30T06:28:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-30T06:28:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-30T06:28:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-30T06:28:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-30T06:28:30.193 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-30T06:28:30.194 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-30T06:28:30.194 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-30T06:28:30.194 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-30T06:28:30.194 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-30T06:28:30.194 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-30T06:28:30.194 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/ 2024-05-30T06:28:30.194 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ 2024-05-30T06:28:30.194 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_battery.ko 2024-05-30T06:28:30.194 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_charger.ko 2024-05-30T06:28:30.194 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 68825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq2415x_charger.ko 2024-05-30T06:28:30.194 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 73065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24190_charger.ko 2024-05-30T06:28:30.194 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24735-charger.ko 2024-05-30T06:28:30.195 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-05-30T06:28:30.195 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9030_battery.ko 2024-05-30T06:28:30.195 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9052-battery.ko 2024-05-30T06:28:30.195 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2760_battery.ko 2024-05-30T06:28:30.195 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2780_battery.ko 2024-05-30T06:28:30.195 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2781_battery.ko 2024-05-30T06:28:30.195 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2782_battery.ko 2024-05-30T06:28:30.195 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/gpio-charger.ko 2024-05-30T06:28:30.195 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/isp1704_charger.ko 2024-05-30T06:28:30.195 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/lp8727_charger.ko 2024-05-30T06:28:30.195 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max14577_charger.ko 2024-05-30T06:28:30.195 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max17042_battery.ko 2024-05-30T06:28:30.195 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8903_charger.ko 2024-05-30T06:28:30.196 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8925_power.ko 2024-05-30T06:28:30.196 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/pcf50633-charger.ko 2024-05-30T06:28:30.196 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/sbs-battery.ko 2024-05-30T06:28:30.196 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/test_power.ko 2024-05-30T06:28:30.196 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/tps65090-charger.ko 2024-05-30T06:28:30.196 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_backup.ko 2024-05-30T06:28:30.196 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_power.ko 2024-05-30T06:28:30.196 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm8350_power.ko 2024-05-30T06:28:30.196 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/ 2024-05-30T06:28:30.196 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 73289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-30T06:28:30.196 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-30T06:28:30.196 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/ 2024-05-30T06:28:30.197 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/ 2024-05-30T06:28:30.197 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-30T06:28:30.197 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-30T06:28:30.197 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-30T06:28:30.197 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-30T06:28:30.197 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ 2024-05-30T06:28:30.197 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 91369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-30T06:28:30.197 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-30T06:28:30.197 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/ 2024-05-30T06:28:30.197 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/ 2024-05-30T06:28:30.197 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/ 2024-05-30T06:28:30.197 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-30T06:28:30.197 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-30T06:28:30.198 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/ 2024-05-30T06:28:30.198 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm80x.ko 2024-05-30T06:28:30.198 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm860x.ko 2024-05-30T06:28:30.198 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-30T06:28:30.198 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9052.ko 2024-05-30T06:28:30.198 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9055.ko 2024-05-30T06:28:30.198 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9063.ko 2024-05-30T06:28:30.198 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-30T06:28:30.198 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 82217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-30T06:28:30.198 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-30T06:28:30.198 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-30T06:28:30.199 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-30T06:28:30.199 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-30T06:28:30.199 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-30T06:28:30.199 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-30T06:28:30.199 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-30T06:28:30.199 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-30T06:28:30.199 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-30T06:28:30.199 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-30T06:28:30.199 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-30T06:28:30.199 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-lp8788.ko 2024-05-30T06:28:30.199 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-30T06:28:30.199 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-30T06:28:30.200 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-30T06:28:30.200 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t86.ko 2024-05-30T06:28:30.200 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-30T06:28:30.200 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8907.ko 2024-05-30T06:28:30.200 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8925.ko 2024-05-30T06:28:30.200 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8997.ko 2024-05-30T06:28:30.200 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8998.ko 2024-05-30T06:28:30.200 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-05-30T06:28:30.200 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-30T06:28:30.200 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-palmas.ko 2024-05-30T06:28:30.200 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 56769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-30T06:28:30.201 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf50633.ko 2024-05-30T06:28:30.201 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-30T06:28:30.201 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-30T06:28:30.201 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-30T06:28:30.201 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-30T06:28:30.201 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rc5t583.ko 2024-05-30T06:28:30.201 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-30T06:28:30.201 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-30T06:28:30.201 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-30T06:28:30.201 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-30T06:28:30.201 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-30T06:28:30.201 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-s35390a.ko 2024-05-30T06:28:30.202 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-30T06:28:30.202 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps6586x.ko 2024-05-30T06:28:30.202 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps65910.ko 2024-05-30T06:28:30.202 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm831x.ko 2024-05-30T06:28:30.202 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm8350.ko 2024-05-30T06:28:30.202 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-30T06:28:30.202 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ 2024-05-30T06:28:30.202 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 90369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-30T06:28:30.202 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 69585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-30T06:28:30.202 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-30T06:28:30.203 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 164473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-30T06:28:30.203 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-30T06:28:30.203 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/ 2024-05-30T06:28:30.203 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 340689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-30T06:28:30.203 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 120393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-30T06:28:30.203 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/ 2024-05-30T06:28:30.203 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 468049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-30T06:28:30.203 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 380633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-30T06:28:30.203 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/ 2024-05-30T06:28:30.203 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 243649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-05-30T06:28:30.203 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-30T06:28:30.204 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/ 2024-05-30T06:28:30.204 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 135601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-30T06:28:30.204 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-30T06:28:30.204 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/ 2024-05-30T06:28:30.204 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 304969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-30T06:28:30.204 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/ 2024-05-30T06:28:30.204 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1527017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-30T06:28:30.204 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/ 2024-05-30T06:28:30.204 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 297769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-30T06:28:30.204 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/ 2024-05-30T06:28:30.204 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 144377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-30T06:28:30.204 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-30T06:28:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/ 2024-05-30T06:28:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 390657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-30T06:28:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/ 2024-05-30T06:28:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-05-30T06:28:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 88873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-30T06:28:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-05-30T06:28:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 117473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-30T06:28:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 173009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-30T06:28:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 91497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-30T06:28:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-30T06:28:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/ 2024-05-30T06:28:30.205 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 267521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-30T06:28:30.206 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-30T06:28:30.206 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/ 2024-05-30T06:28:30.206 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 95321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-30T06:28:30.206 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 194001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-30T06:28:30.206 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fdomain.ko 2024-05-30T06:28:30.206 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/ 2024-05-30T06:28:30.206 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 366457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-30T06:28:30.206 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 251497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-30T06:28:30.206 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-30T06:28:30.206 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-30T06:28:30.206 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/imm.ko 2024-05-30T06:28:30.207 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-30T06:28:30.207 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 327833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-30T06:28:30.207 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 129777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-30T06:28:30.207 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/ 2024-05-30T06:28:30.207 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 397657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-30T06:28:30.207 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-30T06:28:30.207 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 63113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-30T06:28:30.207 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/ 2024-05-30T06:28:30.207 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 386801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-30T06:28:30.207 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 178169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-30T06:28:30.207 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 64801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-30T06:28:30.207 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/ 2024-05-30T06:28:30.207 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 273953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-30T06:28:30.208 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/ 2024-05-30T06:28:30.208 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 2735913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-30T06:28:30.208 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/ 2024-05-30T06:28:30.208 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 88521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-30T06:28:30.208 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-30T06:28:30.208 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 389089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-30T06:28:30.208 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 104761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-30T06:28:30.208 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/ 2024-05-30T06:28:30.208 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 836897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-30T06:28:30.208 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/ 2024-05-30T06:28:30.208 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 158705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-30T06:28:30.208 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 96529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-30T06:28:30.208 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/ 2024-05-30T06:28:30.209 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 101609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-05-30T06:28:30.209 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-05-30T06:28:30.209 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-05-30T06:28:30.209 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-05-30T06:28:30.209 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/ 2024-05-30T06:28:30.209 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 443713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-30T06:28:30.209 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 152025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-30T06:28:30.209 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ppa.ko 2024-05-30T06:28:30.209 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-30T06:28:30.209 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/ 2024-05-30T06:28:30.209 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 2324713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-30T06:28:30.209 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 103593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-30T06:28:30.209 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/ 2024-05-30T06:28:30.210 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 697281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-30T06:28:30.210 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qlogicfas408.ko 2024-05-30T06:28:30.210 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-30T06:28:30.210 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 322857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-30T06:28:30.210 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 219849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-30T06:28:30.210 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 357145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-30T06:28:30.210 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 121177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-30T06:28:30.210 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 93473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-30T06:28:30.210 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-30T06:28:30.210 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-30T06:28:30.210 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 138113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-30T06:28:30.210 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 57393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-30T06:28:30.211 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/ 2024-05-30T06:28:30.211 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 205001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-30T06:28:30.211 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-30T06:28:30.211 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-30T06:28:30.211 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-30T06:28:30.211 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/xen-scsifront.ko 2024-05-30T06:28:30.211 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ 2024-05-30T06:28:30.211 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 174865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-30T06:28:30.211 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/ 2024-05-30T06:28:30.211 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/ 2024-05-30T06:28:30.211 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 920073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-30T06:28:30.211 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/ 2024-05-30T06:28:30.212 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-30T06:28:30.212 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-30T06:28:30.212 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-30T06:28:30.212 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1170873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-30T06:28:30.212 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-30T06:28:30.212 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 149777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-30T06:28:30.212 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/ 2024-05-30T06:28:30.212 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 90033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-30T06:28:30.212 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/ 2024-05-30T06:28:30.212 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/ 2024-05-30T06:28:30.212 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/ 2024-05-30T06:28:30.213 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-30T06:28:30.213 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-30T06:28:30.213 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-30T06:28:30.213 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-30T06:28:30.213 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-30T06:28:30.213 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-30T06:28:30.213 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-30T06:28:30.213 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-30T06:28:30.213 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-30T06:28:30.213 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-30T06:28:30.213 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-30T06:28:30.214 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-30T06:28:30.214 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-30T06:28:30.214 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-30T06:28:30.214 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-30T06:28:30.214 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-05-30T06:28:30.214 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-30T06:28:30.214 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-30T06:28:30.214 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-30T06:28:30.214 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ 2024-05-30T06:28:30.214 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ 2024-05-30T06:28:30.214 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 99289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-30T06:28:30.215 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 69721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/moxa.ko 2024-05-30T06:28:30.215 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/mxser.ko 2024-05-30T06:28:30.215 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 134329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-30T06:28:30.215 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-30T06:28:30.215 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-30T06:28:30.215 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/ 2024-05-30T06:28:30.215 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/ 2024-05-30T06:28:30.215 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-05-30T06:28:30.215 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-30T06:28:30.215 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-05-30T06:28:30.215 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_uart.ko 2024-05-30T06:28:30.215 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-30T06:28:30.216 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 91593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-05-30T06:28:30.216 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/ 2024-05-30T06:28:30.216 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 120553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-30T06:28:30.216 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/rp2.ko 2024-05-30T06:28:30.216 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/sc16is7xx.ko 2024-05-30T06:28:30.216 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/ 2024-05-30T06:28:30.216 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ 2024-05-30T06:28:30.216 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 693057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-30T06:28:30.216 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ 2024-05-30T06:28:30.216 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-30T06:28:30.216 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-05-30T06:28:30.216 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/ 2024-05-30T06:28:30.216 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-30T06:28:30.217 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-30T06:28:30.217 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-30T06:28:30.217 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_dmem_genirq.ko 2024-05-30T06:28:30.217 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_mf624.ko 2024-05-30T06:28:30.217 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_netx.ko 2024-05-30T06:28:30.217 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-30T06:28:30.217 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-05-30T06:28:30.217 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-30T06:28:30.217 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/ 2024-05-30T06:28:30.217 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/ 2024-05-30T06:28:30.217 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 90297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/c67x00.ko 2024-05-30T06:28:30.217 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ 2024-05-30T06:28:30.218 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 189169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-05-30T06:28:30.218 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-05-30T06:28:30.218 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-05-30T06:28:30.218 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-05-30T06:28:30.218 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-05-30T06:28:30.218 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/ 2024-05-30T06:28:30.218 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 101537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-30T06:28:30.218 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 63017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-30T06:28:30.218 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 56713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-30T06:28:30.218 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 107409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-30T06:28:30.218 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ 2024-05-30T06:28:30.219 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ulpi.ko 2024-05-30T06:28:30.219 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/ 2024-05-30T06:28:30.219 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-05-30T06:28:30.219 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/ 2024-05-30T06:28:30.219 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-05-30T06:28:30.219 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-05-30T06:28:30.219 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 575217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3.ko 2024-05-30T06:28:30.219 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/ 2024-05-30T06:28:30.219 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/ 2024-05-30T06:28:30.219 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 72241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_ether.ko 2024-05-30T06:28:30.219 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_serial.ko 2024-05-30T06:28:30.220 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-05-30T06:28:30.220 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-05-30T06:28:30.220 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-05-30T06:28:30.220 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-05-30T06:28:30.220 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 131513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-05-30T06:28:30.220 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-05-30T06:28:30.220 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 146601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-05-30T06:28:30.220 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-05-30T06:28:30.220 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-05-30T06:28:30.220 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-05-30T06:28:30.220 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-05-30T06:28:30.220 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 101233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-05-30T06:28:30.221 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-05-30T06:28:30.221 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 71241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-05-30T06:28:30.221 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 84929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-05-30T06:28:30.221 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/ 2024-05-30T06:28:30.221 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-05-30T06:28:30.221 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-05-30T06:28:30.221 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-05-30T06:28:30.221 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-05-30T06:28:30.221 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-05-30T06:28:30.221 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-05-30T06:28:30.221 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-05-30T06:28:30.221 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-05-30T06:28:30.222 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-05-30T06:28:30.222 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-05-30T06:28:30.222 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-05-30T06:28:30.222 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-05-30T06:28:30.222 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-05-30T06:28:30.222 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-05-30T06:28:30.222 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 204009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/libcomposite.ko 2024-05-30T06:28:30.222 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/ 2024-05-30T06:28:30.222 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-05-30T06:28:30.222 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/ 2024-05-30T06:28:30.222 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 182537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-05-30T06:28:30.222 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-05-30T06:28:30.222 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-05-30T06:28:30.223 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-05-30T06:28:30.223 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 69305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-05-30T06:28:30.223 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 90305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2272.ko 2024-05-30T06:28:30.223 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 90353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2280.ko 2024-05-30T06:28:30.223 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 94833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-05-30T06:28:30.223 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 80513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-05-30T06:28:30.223 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 87457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-05-30T06:28:30.223 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 95433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-05-30T06:28:30.223 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 195953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-05-30T06:28:30.256 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ 2024-05-30T06:28:30.256 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/bcma-hcd.ko 2024-05-30T06:28:30.256 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/isp116x-hcd.ko 2024-05-30T06:28:30.256 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 104433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-05-30T06:28:30.256 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 102265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-05-30T06:28:30.256 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-30T06:28:30.256 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811_cs.ko 2024-05-30T06:28:30.256 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ssb-hcd.ko 2024-05-30T06:28:30.256 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-05-30T06:28:30.257 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/ 2024-05-30T06:28:30.257 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-30T06:28:30.257 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-30T06:28:30.257 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ 2024-05-30T06:28:30.257 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-30T06:28:30.257 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-30T06:28:30.257 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-05-30T06:28:30.257 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cytherm.ko 2024-05-30T06:28:30.257 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ehset.ko 2024-05-30T06:28:30.257 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-30T06:28:30.257 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-30T06:28:30.258 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-30T06:28:30.258 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-30T06:28:30.258 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-30T06:28:30.258 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-30T06:28:30.258 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-30T06:28:30.258 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-30T06:28:30.258 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/lvstest.ko 2024-05-30T06:28:30.258 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/ 2024-05-30T06:28:30.258 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-30T06:28:30.258 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-30T06:28:30.258 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-30T06:28:30.258 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-30T06:28:30.259 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-30T06:28:30.259 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 84257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbtest.ko 2024-05-30T06:28:30.259 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-30T06:28:30.259 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-30T06:28:30.259 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/ 2024-05-30T06:28:30.259 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 91505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/usbmon.ko 2024-05-30T06:28:30.259 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/ 2024-05-30T06:28:30.259 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 396169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/musb_hdrc.ko 2024-05-30T06:28:30.259 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/ 2024-05-30T06:28:30.259 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-30T06:28:30.259 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-05-30T06:28:30.259 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-isp1301.ko 2024-05-30T06:28:30.260 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-tahvo.ko 2024-05-30T06:28:30.260 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ 2024-05-30T06:28:30.260 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-30T06:28:30.260 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-30T06:28:30.260 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-30T06:28:30.260 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-30T06:28:30.260 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-30T06:28:30.260 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-30T06:28:30.260 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-30T06:28:30.260 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 58321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-30T06:28:30.260 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-30T06:28:30.260 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/f81232.ko 2024-05-30T06:28:30.260 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 188601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-30T06:28:30.261 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-30T06:28:30.261 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 152297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-30T06:28:30.261 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 142825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-30T06:28:30.261 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 69209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-30T06:28:30.261 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-30T06:28:30.261 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-30T06:28:30.261 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-30T06:28:30.261 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 122321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-30T06:28:30.261 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-30T06:28:30.261 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-30T06:28:30.261 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-30T06:28:30.261 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-30T06:28:30.262 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/metro-usb.ko 2024-05-30T06:28:30.262 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-30T06:28:30.262 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 89961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-30T06:28:30.262 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mxuport.ko 2024-05-30T06:28:30.262 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-30T06:28:30.262 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-30T06:28:30.262 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-30T06:28:30.262 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 197201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-30T06:28:30.262 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-30T06:28:30.262 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-30T06:28:30.262 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-30T06:28:30.262 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-30T06:28:30.262 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-30T06:28:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-30T06:28:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-30T06:28:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-30T06:28:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-30T06:28:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-30T06:28:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-30T06:28:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-30T06:28:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-30T06:28:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-30T06:28:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 151121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usbserial.ko 2024-05-30T06:28:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-30T06:28:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-30T06:28:30.263 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/wishbone-serial.ko 2024-05-30T06:28:30.264 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-30T06:28:30.264 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ 2024-05-30T06:28:30.264 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 64041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-30T06:28:30.264 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-30T06:28:30.264 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-30T06:28:30.264 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-30T06:28:30.264 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-30T06:28:30.264 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-30T06:28:30.264 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-30T06:28:30.264 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-30T06:28:30.264 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-30T06:28:30.264 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-30T06:28:30.264 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-30T06:28:30.265 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-30T06:28:30.265 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-30T06:28:30.265 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-30T06:28:30.265 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 201145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-30T06:28:30.265 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/ 2024-05-30T06:28:30.265 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 76025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-30T06:28:30.265 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-30T06:28:30.265 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 122233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-30T06:28:30.265 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/ 2024-05-30T06:28:30.265 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/ 2024-05-30T06:28:30.265 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 206897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-30T06:28:30.265 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-30T06:28:30.265 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 134241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-30T06:28:30.266 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 93665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-30T06:28:30.266 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/ 2024-05-30T06:28:30.266 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 138641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-30T06:28:30.266 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-30T06:28:30.266 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 71273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-30T06:28:30.266 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 107897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-30T06:28:30.266 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/ 2024-05-30T06:28:30.266 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/ 2024-05-30T06:28:30.266 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-05-30T06:28:30.266 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/aat2870_bl.ko 2024-05-30T06:28:30.266 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp5520_bl.ko 2024-05-30T06:28:30.266 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8860_bl.ko 2024-05-30T06:28:30.267 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 51737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8870_bl.ko 2024-05-30T06:28:30.267 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-30T06:28:30.267 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/as3711_bl.ko 2024-05-30T06:28:30.267 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/bd6107.ko 2024-05-30T06:28:30.267 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da903x_bl.ko 2024-05-30T06:28:30.267 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da9052_bl.ko 2024-05-30T06:28:30.267 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/gpio_backlight.ko 2024-05-30T06:28:30.267 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/kb3886_bl.ko 2024-05-30T06:28:30.267 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-30T06:28:30.267 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3533_bl.ko 2024-05-30T06:28:30.267 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3639_bl.ko 2024-05-30T06:28:30.267 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lv5207lp.ko 2024-05-30T06:28:30.267 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/max8925_bl.ko 2024-05-30T06:28:30.268 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pandora_bl.ko 2024-05-30T06:28:30.268 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-05-30T06:28:30.268 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-30T06:28:30.268 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/wm831x_bl.ko 2024-05-30T06:28:30.268 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/ 2024-05-30T06:28:30.268 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ 2024-05-30T06:28:30.268 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-30T06:28:30.268 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-30T06:28:30.268 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/matrox_w1.ko 2024-05-30T06:28:30.268 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/w1-gpio.ko 2024-05-30T06:28:30.268 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/ 2024-05-30T06:28:30.268 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-30T06:28:30.268 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-30T06:28:30.269 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-30T06:28:30.269 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-30T06:28:30.269 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-30T06:28:30.269 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-30T06:28:30.269 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-30T06:28:30.269 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-30T06:28:30.269 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-30T06:28:30.269 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-30T06:28:30.269 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-30T06:28:30.269 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 129409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-30T06:28:30.269 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ 2024-05-30T06:28:30.269 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/acquirewdt.ko 2024-05-30T06:28:30.269 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/advantechwdt.ko 2024-05-30T06:28:30.270 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-30T06:28:30.270 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-30T06:28:30.270 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/cpu5wdt.ko 2024-05-30T06:28:30.270 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9052_wdt.ko 2024-05-30T06:28:30.270 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9055_wdt.ko 2024-05-30T06:28:30.270 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9063_wdt.ko 2024-05-30T06:28:30.270 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/dw_wdt.ko 2024-05-30T06:28:30.270 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/eurotechwdt.ko 2024-05-30T06:28:30.270 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-30T06:28:30.270 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-30T06:28:30.270 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-30T06:28:30.270 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-30T06:28:30.270 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-30T06:28:30.271 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-30T06:28:30.271 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-30T06:28:30.271 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-30T06:28:30.271 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-30T06:28:30.271 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-30T06:28:30.271 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/kempld_wdt.ko 2024-05-30T06:28:30.271 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-30T06:28:30.271 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/mena21_wdt.ko 2024-05-30T06:28:30.271 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-05-30T06:28:30.271 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-30T06:28:30.271 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-05-30T06:28:30.271 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pc87413_wdt.ko 2024-05-30T06:28:30.272 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-30T06:28:30.272 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-30T06:28:30.272 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/retu_wdt.ko 2024-05-30T06:28:30.272 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-05-30T06:28:30.272 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-05-30T06:28:30.272 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-30T06:28:30.272 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sc1200wdt.ko 2024-05-30T06:28:30.272 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-30T06:28:30.272 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-05-30T06:28:30.272 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-30T06:28:30.272 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-30T06:28:30.273 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/twl4030_wdt.ko 2024-05-30T06:28:30.273 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-30T06:28:30.273 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-30T06:28:30.273 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-30T06:28:30.273 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-30T06:28:30.273 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wafer5823wdt.ko 2024-05-30T06:28:30.273 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-30T06:28:30.273 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm831x_wdt.ko 2024-05-30T06:28:30.273 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm8350_wdt.ko 2024-05-30T06:28:30.273 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-30T06:28:30.273 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/ 2024-05-30T06:28:30.273 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-30T06:28:30.273 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-30T06:28:30.274 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-30T06:28:30.274 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/ 2024-05-30T06:28:30.274 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 213865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-30T06:28:30.274 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-30T06:28:30.274 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-scsiback.ko 2024-05-30T06:28:30.274 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/ 2024-05-30T06:28:30.274 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-30T06:28:30.274 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ 2024-05-30T06:28:30.274 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/ 2024-05-30T06:28:30.274 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 194449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-30T06:28:30.274 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/ 2024-05-30T06:28:30.274 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 78049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/adfs.ko 2024-05-30T06:28:30.275 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/ 2024-05-30T06:28:30.275 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 197801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-30T06:28:30.275 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/ 2024-05-30T06:28:30.275 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1260937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/kafs.ko 2024-05-30T06:28:30.275 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/ 2024-05-30T06:28:30.275 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 127337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/autofs4.ko 2024-05-30T06:28:30.275 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/ 2024-05-30T06:28:30.275 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 80481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-30T06:28:30.275 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/ 2024-05-30T06:28:30.275 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/bfs.ko 2024-05-30T06:28:30.275 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-30T06:28:30.275 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/ 2024-05-30T06:28:30.276 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 4491713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-30T06:28:30.276 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/ 2024-05-30T06:28:30.276 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 376801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-30T06:28:30.276 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ 2024-05-30T06:28:30.276 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1586617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-30T06:28:30.276 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/ 2024-05-30T06:28:30.276 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 130017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-30T06:28:30.276 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/ 2024-05-30T06:28:30.276 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 139049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/configfs.ko 2024-05-30T06:28:30.276 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/ 2024-05-30T06:28:30.276 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-30T06:28:30.276 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/ 2024-05-30T06:28:30.276 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 813137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-30T06:28:30.277 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/ 2024-05-30T06:28:30.277 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/efs.ko 2024-05-30T06:28:30.277 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/ 2024-05-30T06:28:30.277 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1906713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-30T06:28:30.277 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/ 2024-05-30T06:28:30.277 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-30T06:28:30.277 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/ 2024-05-30T06:28:30.277 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/freevxfs.ko 2024-05-30T06:28:30.277 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/ 2024-05-30T06:28:30.277 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-30T06:28:30.277 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/ 2024-05-30T06:28:30.277 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1486393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-30T06:28:30.277 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/ 2024-05-30T06:28:30.278 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 183217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-30T06:28:30.278 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/ 2024-05-30T06:28:30.278 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 281993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-30T06:28:30.278 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/ 2024-05-30T06:28:30.278 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 248945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/hpfs.ko 2024-05-30T06:28:30.278 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/ 2024-05-30T06:28:30.278 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 92985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-30T06:28:30.278 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/ 2024-05-30T06:28:30.278 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 532953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-30T06:28:30.278 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/ 2024-05-30T06:28:30.278 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 361281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-30T06:28:30.278 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/ 2024-05-30T06:28:30.278 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 112569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-30T06:28:30.279 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/ 2024-05-30T06:28:30.279 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 591625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-30T06:28:30.279 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/ 2024-05-30T06:28:30.279 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/ 2024-05-30T06:28:30.279 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 102537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-30T06:28:30.279 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/ 2024-05-30T06:28:30.279 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 74337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-30T06:28:30.279 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/ 2024-05-30T06:28:30.279 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 147673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-30T06:28:30.279 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1320377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-30T06:28:30.279 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 82089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv2.ko 2024-05-30T06:28:30.279 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 151617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-30T06:28:30.280 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 2518385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-30T06:28:30.280 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/ 2024-05-30T06:28:30.280 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-30T06:28:30.280 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-30T06:28:30.280 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/ 2024-05-30T06:28:30.280 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 2021969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-30T06:28:30.280 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/ 2024-05-30T06:28:30.280 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 733969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-30T06:28:30.280 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/ 2024-05-30T06:28:30.280 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-30T06:28:30.280 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-30T06:28:30.280 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-30T06:28:30.280 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-30T06:28:30.281 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-30T06:28:30.281 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-30T06:28:30.281 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-30T06:28:30.281 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-30T06:28:30.281 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-30T06:28:30.281 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-30T06:28:30.281 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-30T06:28:30.281 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ascii.ko 2024-05-30T06:28:30.281 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-30T06:28:30.281 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-30T06:28:30.281 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-30T06:28:30.281 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-30T06:28:30.281 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-30T06:28:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-30T06:28:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-30T06:28:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-30T06:28:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-30T06:28:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-30T06:28:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-30T06:28:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-30T06:28:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-30T06:28:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-30T06:28:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-30T06:28:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-30T06:28:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-30T06:28:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-30T06:28:30.283 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 95617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-30T06:28:30.283 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 144201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-30T06:28:30.283 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 167129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-30T06:28:30.283 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 119505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-30T06:28:30.283 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-30T06:28:30.283 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-30T06:28:30.283 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-30T06:28:30.283 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-30T06:28:30.283 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-30T06:28:30.283 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-30T06:28:30.283 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-30T06:28:30.283 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-30T06:28:30.283 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-30T06:28:30.284 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-30T06:28:30.284 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-30T06:28:30.284 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-30T06:28:30.284 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-30T06:28:30.284 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-30T06:28:30.284 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-30T06:28:30.284 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-30T06:28:30.284 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-30T06:28:30.284 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ 2024-05-30T06:28:30.284 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 634457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ntfs3.ko 2024-05-30T06:28:30.284 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ 2024-05-30T06:28:30.284 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ 2024-05-30T06:28:30.284 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 302033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-30T06:28:30.285 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ 2024-05-30T06:28:30.285 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 548057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-30T06:28:30.285 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ 2024-05-30T06:28:30.285 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-30T06:28:30.285 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 3245449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-30T06:28:30.285 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 22105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-30T06:28:30.285 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-30T06:28:30.285 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-30T06:28:30.285 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/ 2024-05-30T06:28:30.285 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/omfs.ko 2024-05-30T06:28:30.285 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/ 2024-05-30T06:28:30.285 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 462817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-30T06:28:30.285 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ 2024-05-30T06:28:30.286 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-30T06:28:30.286 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/ 2024-05-30T06:28:30.286 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/qnx4.ko 2024-05-30T06:28:30.286 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/ 2024-05-30T06:28:30.286 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 56073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/qnx6.ko 2024-05-30T06:28:30.286 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/ 2024-05-30T06:28:30.286 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_tree.ko 2024-05-30T06:28:30.286 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v1.ko 2024-05-30T06:28:30.286 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v2.ko 2024-05-30T06:28:30.286 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/ 2024-05-30T06:28:30.286 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 684713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-30T06:28:30.286 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/ 2024-05-30T06:28:30.286 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-30T06:28:30.287 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/ 2024-05-30T06:28:30.287 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/ 2024-05-30T06:28:30.287 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 3350841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-30T06:28:30.287 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/ 2024-05-30T06:28:30.287 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-30T06:28:30.287 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-30T06:28:30.287 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/ 2024-05-30T06:28:30.287 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 164145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-30T06:28:30.287 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/ 2024-05-30T06:28:30.287 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 115865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-30T06:28:30.287 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/ 2024-05-30T06:28:30.287 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 309937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-30T06:28:30.288 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ 2024-05-30T06:28:30.288 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 198185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-30T06:28:30.288 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/ 2024-05-30T06:28:30.288 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 5192193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-30T06:28:30.288 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/ 2024-05-30T06:28:30.288 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/ 2024-05-30T06:28:30.288 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 97617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/locktorture.ko 2024-05-30T06:28:30.288 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/ 2024-05-30T06:28:30.288 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/test_udelay.ko 2024-05-30T06:28:30.288 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 72657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-30T06:28:30.288 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc7.ko 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/ 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/interval_tree_test.ko 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/ 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/ 2024-05-30T06:28:30.289 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-30T06:28:30.290 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/memory-notifier-error-inject.ko 2024-05-30T06:28:30.290 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/notifier-error-inject.ko 2024-05-30T06:28:30.290 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/percpu_test.ko 2024-05-30T06:28:30.290 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/pm-notifier-error-inject.ko 2024-05-30T06:28:30.290 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/ 2024-05-30T06:28:30.290 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 151945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-30T06:28:30.290 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/rbtree_test.ko 2024-05-30T06:28:30.290 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/ 2024-05-30T06:28:30.290 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-30T06:28:30.290 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test-kstrtox.ko 2024-05-30T06:28:30.290 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 4912433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_bpf.ko 2024-05-30T06:28:30.290 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 61161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_firmware.ko 2024-05-30T06:28:30.291 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_module.ko 2024-05-30T06:28:30.291 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_user_copy.ko 2024-05-30T06:28:30.291 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-30T06:28:30.291 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-30T06:28:30.291 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-30T06:28:30.291 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/ 2024-05-30T06:28:30.291 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/xz_dec_test.ko 2024-05-30T06:28:30.291 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/ 2024-05-30T06:28:30.291 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-30T06:28:30.291 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ 2024-05-30T06:28:30.291 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/ 2024-05-30T06:28:30.291 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-30T06:28:30.292 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-30T06:28:30.292 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-30T06:28:30.292 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-30T06:28:30.292 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-30T06:28:30.292 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-30T06:28:30.292 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-30T06:28:30.292 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-30T06:28:30.292 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/ 2024-05-30T06:28:30.292 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-30T06:28:30.292 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-30T06:28:30.292 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-30T06:28:30.292 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-30T06:28:30.293 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-30T06:28:30.293 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/ 2024-05-30T06:28:30.293 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 106697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-30T06:28:30.293 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/ 2024-05-30T06:28:30.293 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 236769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-30T06:28:30.293 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-30T06:28:30.293 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-30T06:28:30.293 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-30T06:28:30.293 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/ 2024-05-30T06:28:30.293 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 879593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-30T06:28:30.293 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/ 2024-05-30T06:28:30.294 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-30T06:28:30.294 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1031177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-30T06:28:30.324 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ 2024-05-30T06:28:30.324 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-30T06:28:30.324 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-30T06:28:30.324 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-30T06:28:30.324 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-30T06:28:30.324 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-30T06:28:30.324 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-30T06:28:30.324 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-30T06:28:30.324 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-30T06:28:30.324 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-30T06:28:30.325 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-30T06:28:30.325 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-30T06:28:30.325 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-30T06:28:30.325 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-30T06:28:30.325 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-30T06:28:30.325 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-30T06:28:30.325 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-30T06:28:30.325 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-30T06:28:30.325 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-30T06:28:30.325 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-30T06:28:30.325 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-30T06:28:30.325 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-30T06:28:30.326 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-30T06:28:30.326 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-30T06:28:30.326 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/ 2024-05-30T06:28:30.326 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1243369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-30T06:28:30.326 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/ 2024-05-30T06:28:30.326 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 153793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-30T06:28:30.326 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/ 2024-05-30T06:28:30.326 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 244825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-30T06:28:30.326 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-30T06:28:30.326 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 71025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-30T06:28:30.326 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 74985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-30T06:28:30.326 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/ 2024-05-30T06:28:30.327 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 507649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-30T06:28:30.327 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-30T06:28:30.327 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-30T06:28:30.327 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-30T06:28:30.327 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-30T06:28:30.327 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/ 2024-05-30T06:28:30.327 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 128577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/hsr.ko 2024-05-30T06:28:30.327 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ 2024-05-30T06:28:30.327 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ 2024-05-30T06:28:30.327 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-30T06:28:30.327 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 357369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-30T06:28:30.327 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 59385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-30T06:28:30.328 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ 2024-05-30T06:28:30.328 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-30T06:28:30.328 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-30T06:28:30.328 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-30T06:28:30.328 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-30T06:28:30.328 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-30T06:28:30.328 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 75481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-30T06:28:30.328 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 77713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-30T06:28:30.328 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-30T06:28:30.328 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-30T06:28:30.328 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ip_tables.ko 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-30T06:28:30.329 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-30T06:28:30.330 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-30T06:28:30.330 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-30T06:28:30.330 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-30T06:28:30.330 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-30T06:28:30.330 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-30T06:28:30.330 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-30T06:28:30.330 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-05-30T06:28:30.330 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-30T06:28:30.330 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-30T06:28:30.330 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-30T06:28:30.330 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-30T06:28:30.330 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-30T06:28:30.331 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 54425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 47425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 103169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_gre.ko 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 118873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 71081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/mip6.ko 2024-05-30T06:28:30.332 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-30T06:28:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-30T06:28:30.334 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-30T06:28:30.334 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-30T06:28:30.334 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-30T06:28:30.334 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-30T06:28:30.334 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-30T06:28:30.334 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 29809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-30T06:28:30.334 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-30T06:28:30.334 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-30T06:28:30.334 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-30T06:28:30.334 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-30T06:28:30.334 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-30T06:28:30.334 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 94081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-30T06:28:30.334 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 30289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/ 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 106361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/ 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 153209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 66233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/ 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 63321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/lapb.ko 2024-05-30T06:28:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/ 2024-05-30T06:28:30.336 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-30T06:28:30.336 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 332817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc2.ko 2024-05-30T06:28:30.336 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/ 2024-05-30T06:28:30.336 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 388817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-30T06:28:30.336 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/ 2024-05-30T06:28:30.336 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-30T06:28:30.336 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ 2024-05-30T06:28:30.336 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ 2024-05-30T06:28:30.336 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 147729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-30T06:28:30.336 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-30T06:28:30.336 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-30T06:28:30.337 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-30T06:28:30.337 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 124033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-30T06:28:30.337 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 124337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-30T06:28:30.337 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 126673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-30T06:28:30.337 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 126465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-30T06:28:30.337 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 137825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-30T06:28:30.337 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 72345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-30T06:28:30.337 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 133673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-30T06:28:30.337 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 139065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-30T06:28:30.337 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 138257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-30T06:28:30.337 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 136169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-30T06:28:30.337 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 139889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-30T06:28:30.337 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-30T06:28:30.338 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ 2024-05-30T06:28:30.338 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 534033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-30T06:28:30.338 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-30T06:28:30.338 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-30T06:28:30.338 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-30T06:28:30.338 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-30T06:28:30.338 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-30T06:28:30.338 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-30T06:28:30.338 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-30T06:28:30.338 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-30T06:28:30.338 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-30T06:28:30.339 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-30T06:28:30.339 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-30T06:28:30.339 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-30T06:28:30.339 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-30T06:28:30.339 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 55209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-30T06:28:30.339 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 496713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-30T06:28:30.339 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-30T06:28:30.339 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-30T06:28:30.339 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-30T06:28:30.339 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 134361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-30T06:28:30.339 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-30T06:28:30.339 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-30T06:28:30.340 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 140793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-30T06:28:30.340 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-30T06:28:30.340 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-30T06:28:30.340 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 79865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-30T06:28:30.340 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-30T06:28:30.340 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-30T06:28:30.340 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-30T06:28:30.340 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 117385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-30T06:28:30.340 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-30T06:28:30.340 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 46097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-30T06:28:30.341 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 118337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-30T06:28:30.341 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-30T06:28:30.341 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-30T06:28:30.341 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-30T06:28:30.341 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-30T06:28:30.341 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-30T06:28:30.341 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-30T06:28:30.341 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 811705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-30T06:28:30.341 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-30T06:28:30.341 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-30T06:28:30.341 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-05-30T06:28:30.341 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-30T06:28:30.342 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-30T06:28:30.342 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 65137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-30T06:28:30.342 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-30T06:28:30.342 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-30T06:28:30.342 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 50649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-30T06:28:30.342 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-30T06:28:30.342 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-30T06:28:30.342 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-30T06:28:30.342 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-30T06:28:30.342 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-30T06:28:30.343 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-30T06:28:30.343 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-30T06:28:30.343 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-30T06:28:30.343 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-30T06:28:30.343 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_osf.ko 2024-05-30T06:28:30.343 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-30T06:28:30.343 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-30T06:28:30.343 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-30T06:28:30.343 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-30T06:28:30.343 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-30T06:28:30.343 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 24985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_synproxy.ko 2024-05-30T06:28:30.343 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tproxy.ko 2024-05-30T06:28:30.344 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 108385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/x_tables.ko 2024-05-30T06:28:30.344 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-30T06:28:30.344 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-30T06:28:30.344 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-30T06:28:30.344 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-30T06:28:30.344 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 21857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-30T06:28:30.344 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-30T06:28:30.344 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-30T06:28:30.344 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-30T06:28:30.344 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-30T06:28:30.344 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-30T06:28:30.344 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-30T06:28:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-30T06:28:30.346 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-30T06:28:30.346 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-30T06:28:30.346 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-30T06:28:30.346 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-30T06:28:30.346 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-30T06:28:30.346 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-30T06:28:30.346 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-30T06:28:30.346 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-30T06:28:30.346 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-30T06:28:30.346 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-30T06:28:30.346 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-30T06:28:30.346 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-30T06:28:30.347 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-30T06:28:30.347 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-30T06:28:30.347 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 52809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-30T06:28:30.347 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-30T06:28:30.347 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-30T06:28:30.347 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-30T06:28:30.347 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-30T06:28:30.347 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-30T06:28:30.347 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-30T06:28:30.347 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-30T06:28:30.347 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-30T06:28:30.347 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-30T06:28:30.348 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-30T06:28:30.348 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-30T06:28:30.348 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 16153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-30T06:28:30.348 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-30T06:28:30.348 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-30T06:28:30.348 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-30T06:28:30.348 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-30T06:28:30.348 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-30T06:28:30.348 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-30T06:28:30.348 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-30T06:28:30.348 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 11873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-30T06:28:30.349 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-30T06:28:30.349 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-30T06:28:30.349 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-30T06:28:30.349 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-30T06:28:30.349 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-30T06:28:30.349 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-30T06:28:30.349 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-30T06:28:30.349 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-30T06:28:30.349 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-30T06:28:30.349 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpudp.ko 2024-05-30T06:28:30.349 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-30T06:28:30.349 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-30T06:28:30.350 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/ 2024-05-30T06:28:30.350 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 17225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-30T06:28:30.350 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/ 2024-05-30T06:28:30.350 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-30T06:28:30.350 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/ 2024-05-30T06:28:30.350 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 488457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-30T06:28:30.350 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-30T06:28:30.350 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-30T06:28:30.350 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-30T06:28:30.350 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/ 2024-05-30T06:28:30.350 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-30T06:28:30.350 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/ 2024-05-30T06:28:30.351 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 141993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/phonet.ko 2024-05-30T06:28:30.351 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 68801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/pn_pep.ko 2024-05-30T06:28:30.351 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/ 2024-05-30T06:28:30.351 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 318537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-30T06:28:30.351 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 202249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-30T06:28:30.351 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 85073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-30T06:28:30.351 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/ 2024-05-30T06:28:30.351 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1028129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/rxrpc.ko 2024-05-30T06:28:30.351 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/ 2024-05-30T06:28:30.351 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-30T06:28:30.351 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 28713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-30T06:28:30.351 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-30T06:28:30.352 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-30T06:28:30.352 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 53457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-30T06:28:30.352 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-30T06:28:30.352 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-30T06:28:30.352 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-30T06:28:30.352 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 45665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-30T06:28:30.352 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-30T06:28:30.352 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 41449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-30T06:28:30.352 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_cgroup.ko 2024-05-30T06:28:30.352 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 37297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-30T06:28:30.352 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-30T06:28:30.353 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 49313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-30T06:28:30.353 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 79137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-30T06:28:30.353 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-30T06:28:30.353 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-30T06:28:30.353 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 48777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-30T06:28:30.353 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-30T06:28:30.353 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-30T06:28:30.353 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-30T06:28:30.353 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-30T06:28:30.353 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 25089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-30T06:28:30.353 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-30T06:28:30.353 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 43145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-30T06:28:30.354 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 39169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq_codel.ko 2024-05-30T06:28:30.354 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-30T06:28:30.354 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 62809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-30T06:28:30.354 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-30T06:28:30.354 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 81825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-30T06:28:30.354 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-30T06:28:30.354 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 36617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-30T06:28:30.354 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-30T06:28:30.354 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-30T06:28:30.354 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 44785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-30T06:28:30.354 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 32825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-30T06:28:30.355 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 13497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-30T06:28:30.355 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-30T06:28:30.355 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 60241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-30T06:28:30.355 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-30T06:28:30.355 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 33425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-30T06:28:30.355 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-30T06:28:30.355 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 35769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-30T06:28:30.355 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 34153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-30T06:28:30.355 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/ 2024-05-30T06:28:30.355 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1187153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-30T06:28:30.355 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-30T06:28:30.355 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/ 2024-05-30T06:28:30.356 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/ 2024-05-30T06:28:30.356 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 432225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-30T06:28:30.356 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-30T06:28:30.356 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1940753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-30T06:28:30.356 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/ 2024-05-30T06:28:30.356 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 889729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-30T06:28:30.356 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/ 2024-05-30T06:28:30.356 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 1122273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-30T06:28:30.356 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-30T06:28:30.356 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/ 2024-05-30T06:28:30.356 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 18793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-30T06:28:30.357 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/ 2024-05-30T06:28:30.357 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 105601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-30T06:28:30.357 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 90249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-30T06:28:30.357 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 123745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-30T06:28:30.357 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-30T06:28:30.357 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-30T06:28:30.357 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/ 2024-05-30T06:28:30.357 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 165777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/x25.ko 2024-05-30T06:28:30.357 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/ 2024-05-30T06:28:30.357 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_algo.ko 2024-05-30T06:28:30.357 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-30T06:28:30.357 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 131857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_user.ko 2024-05-30T06:28:30.358 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 646387 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-30T06:28:30.358 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 630543 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-30T06:28:30.358 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 7706 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-30T06:28:30.358 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 23609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-30T06:28:30.358 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 9941 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-30T06:28:30.358 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 70990 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-30T06:28:30.358 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 146985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-30T06:28:30.358 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 232892 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-30T06:28:30.358 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 210 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-30T06:28:30.358 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 72627 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-30T06:28:30.358 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 879 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-30T06:28:30.358 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 258450 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-30T06:28:30.359 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 313019 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-30T06:28:30.359 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/ 2024-05-30T06:28:30.359 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/ 2024-05-30T06:28:30.359 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/ 2024-05-30T06:28:30.359 INFO:teuthology.orchestra.run.smithi105.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/ 2024-05-30T06:28:30.359 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 171 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/changelog.Debian.gz 2024-05-30T06:28:30.359 INFO:teuthology.orchestra.run.smithi105.stdout:-rw-r--r-- root/root 691 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/copyright 2024-05-30T06:28:30.364 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-30T06:28:30.364 INFO:teuthology.task.kernel:searching for kernel 6.9.0-gb9459a26b088 2024-05-30T06:28:30.365 DEBUG:teuthology.orchestra.run.smithi105:> egrep '(submenu|menuentry.*6.9.0-gb9459a26b088).*{' /boot/grub/grub.cfg 2024-05-30T06:28:30.372 INFO:teuthology.orchestra.run.smithi105.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-30T06:28:30.372 INFO:teuthology.orchestra.run.smithi105.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-30T06:28:30.373 INFO:teuthology.orchestra.run.smithi105.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-30T06:28:30.373 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-05-30T06:28:30.373 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-gb9459a26b088 2024-05-30T06:28:30.373 DEBUG:teuthology.orchestra.run.smithi105:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-05-30T06:28:30.420 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi105.front.sepia.ceph.com to complete... 2024-05-30T06:28:30.832 INFO:teuthology.orchestra.run.smithi105.stderr:Sourcing file `/etc/default/grub' 2024-05-30T06:28:30.833 INFO:teuthology.orchestra.run.smithi105.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-30T06:28:30.862 INFO:teuthology.orchestra.run.smithi105.stderr:Generating grub configuration file ... 2024-05-30T06:28:31.060 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T06:28:31.065 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-30T06:28:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:Sourcing file `/etc/default/grub' 2024-05-30T06:28:31.282 INFO:teuthology.orchestra.run.smithi037.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-30T06:28:31.300 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-30T06:28:31.305 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-30T06:28:31.317 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2024-05-30T06:28:31.347 INFO:teuthology.orchestra.run.smithi105.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-30T06:28:31.352 INFO:teuthology.orchestra.run.smithi105.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-30T06:28:31.507 INFO:teuthology.orchestra.run.smithi105.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-30T06:28:31.507 INFO:teuthology.orchestra.run.smithi105.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-30T06:28:31.507 INFO:teuthology.orchestra.run.smithi105.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-30T06:28:31.523 INFO:teuthology.orchestra.run.smithi105.stderr:done 2024-05-30T06:28:31.643 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T06:28:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-30T06:28:32.016 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-30T06:28:32.027 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-30T06:28:32.095 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-30T06:28:32.101 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-30T06:28:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-30T06:28:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-30T06:28:32.260 INFO:teuthology.orchestra.run.smithi037.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-30T06:28:32.305 INFO:teuthology.orchestra.run.smithi037.stderr:done 2024-05-30T06:28:32.499 DEBUG:teuthology.orchestra.run.smithi037:> dpkg-deb -c /tmp/linux-image.deb 2024-05-30T06:28:32.507 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./ 2024-05-30T06:28:32.507 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./boot/ 2024-05-30T06:28:32.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7004139 2024-05-23 11:07 ./boot/System.map-6.9.0-gb9459a26b088 2024-05-30T06:28:32.526 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 172251 2024-05-23 11:07 ./boot/config-6.9.0-gb9459a26b088 2024-05-30T06:28:32.526 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13136896 2024-05-23 11:07 ./boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T06:28:32.548 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/ 2024-05-30T06:28:32.548 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/ 2024-05-30T06:28:32.548 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postinst.d/ 2024-05-30T06:28:32.548 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/postrm.d/ 2024-05-30T06:28:32.548 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/preinst.d/ 2024-05-30T06:28:32.548 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./etc/kernel/prerm.d/ 2024-05-30T06:28:32.548 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/ 2024-05-30T06:28:32.548 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/ 2024-05-30T06:28:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/ 2024-05-30T06:28:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/ 2024-05-30T06:28:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/ 2024-05-30T06:28:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/ 2024-05-30T06:28:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ 2024-05-30T06:28:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 507497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/aesni-intel.ko 2024-05-30T06:28:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-30T06:28:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-30T06:28:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-30T06:28:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 97945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-30T06:28:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 109897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-30T06:28:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 155241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-30T06:28:32.552 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-30T06:28:32.552 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-30T06:28:32.552 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 87001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-30T06:28:32.552 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-30T06:28:32.552 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-30T06:28:32.552 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-30T06:28:32.552 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-30T06:28:32.552 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-30T06:28:32.552 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-30T06:28:32.552 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 62865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-30T06:28:32.552 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-30T06:28:32.553 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-30T06:28:32.553 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-30T06:28:32.553 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/ 2024-05-30T06:28:32.553 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/ 2024-05-30T06:28:32.553 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/ 2024-05-30T06:28:32.553 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-30T06:28:32.553 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/cpuid.ko 2024-05-30T06:28:32.553 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kernel/msr.ko 2024-05-30T06:28:32.553 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/ 2024-05-30T06:28:32.553 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 443289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-30T06:28:32.553 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1037081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-30T06:28:32.554 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 2850153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/arch/x86/kvm/kvm.ko 2024-05-30T06:28:32.567 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ 2024-05-30T06:28:32.567 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/af_alg.ko 2024-05-30T06:28:32.567 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_hash.ko 2024-05-30T06:28:32.567 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/algif_skcipher.ko 2024-05-30T06:28:32.567 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ansi_cprng.ko 2024-05-30T06:28:32.567 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/anubis.ko 2024-05-30T06:28:32.567 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/arc4.ko 2024-05-30T06:28:32.567 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/ 2024-05-30T06:28:32.567 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-05-30T06:28:32.567 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/ 2024-05-30T06:28:32.567 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_memcpy.ko 2024-05-30T06:28:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_pq.ko 2024-05-30T06:28:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-30T06:28:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_tx.ko 2024-05-30T06:28:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/async_xor.ko 2024-05-30T06:28:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/async_tx/raid6test.ko 2024-05-30T06:28:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authenc.ko 2024-05-30T06:28:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/authencesn.ko 2024-05-30T06:28:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blake2b_generic.ko 2024-05-30T06:28:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_common.ko 2024-05-30T06:28:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/blowfish_generic.ko 2024-05-30T06:28:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/camellia_generic.ko 2024-05-30T06:28:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast5_generic.ko 2024-05-30T06:28:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast6_generic.ko 2024-05-30T06:28:32.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cast_common.ko 2024-05-30T06:28:32.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/ccm.ko 2024-05-30T06:28:32.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cmac.ko 2024-05-30T06:28:32.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crc32_generic.ko 2024-05-30T06:28:32.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cryptd.ko 2024-05-30T06:28:32.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_engine.ko 2024-05-30T06:28:32.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_simd.ko 2024-05-30T06:28:32.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/crypto_user.ko 2024-05-30T06:28:32.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/cts.ko 2024-05-30T06:28:32.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/des_generic.ko 2024-05-30T06:28:32.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/dh_generic.ko 2024-05-30T06:28:32.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/echainiv.ko 2024-05-30T06:28:32.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/essiv.ko 2024-05-30T06:28:32.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/fcrypt.ko 2024-05-30T06:28:32.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/khazad.ko 2024-05-30T06:28:32.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lrw.ko 2024-05-30T06:28:32.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4.ko 2024-05-30T06:28:32.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/lz4hc.ko 2024-05-30T06:28:32.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/md4.ko 2024-05-30T06:28:32.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/michael_mic.ko 2024-05-30T06:28:32.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcbc.ko 2024-05-30T06:28:32.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/pcrypt.ko 2024-05-30T06:28:32.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/rmd160.ko 2024-05-30T06:28:32.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/seed.ko 2024-05-30T06:28:32.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/serpent_generic.ko 2024-05-30T06:28:32.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 169057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tcrypt.ko 2024-05-30T06:28:32.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/tea.ko 2024-05-30T06:28:32.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_common.ko 2024-05-30T06:28:32.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/twofish_generic.ko 2024-05-30T06:28:32.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/vmac.ko 2024-05-30T06:28:32.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/wp512.ko 2024-05-30T06:28:32.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xcbc.ko 2024-05-30T06:28:32.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xor.ko 2024-05-30T06:28:32.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xts.ko 2024-05-30T06:28:32.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/crypto/xxhash_generic.ko 2024-05-30T06:28:32.571 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ 2024-05-30T06:28:32.571 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ 2024-05-30T06:28:32.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_extlog.ko 2024-05-30T06:28:32.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/acpi_pad.ko 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/ 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/apei/einj.ko 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/ec_sys.ko 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/platform_profile.ko 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbs.ko 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/sbshc.ko 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 119017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/acpi/video.ko 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/acard-ahci.ko 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 99177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci.ko 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/ahci_platform.ko 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 107729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci.ko 2024-05-30T06:28:32.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/libahci_platform.ko 2024-05-30T06:28:32.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_acpi.ko 2024-05-30T06:28:32.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ali.ko 2024-05-30T06:28:32.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_amd.ko 2024-05-30T06:28:32.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_artop.ko 2024-05-30T06:28:32.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atiixp.ko 2024-05-30T06:28:32.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_atp867x.ko 2024-05-30T06:28:32.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd640.ko 2024-05-30T06:28:32.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cmd64x.ko 2024-05-30T06:28:32.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_cypress.ko 2024-05-30T06:28:32.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_efar.ko 2024-05-30T06:28:32.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt366.ko 2024-05-30T06:28:32.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt37x.ko 2024-05-30T06:28:32.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it8213.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_it821x.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_jmicron.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_legacy.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_marvell.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_mpiix.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_netcell.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ninja32.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87410.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_ns87415.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_oldpiix.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_opti.ko 2024-05-30T06:28:32.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_optidma.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pcmcia.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_piccolo.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_radisys.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rdc.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_rz1000.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sch.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_serverworks.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sil680.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_sl82c105.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_triflex.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pata_via.ko 2024-05-30T06:28:32.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/pdc_adma.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_inic162x.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 102113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_mv.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_nv.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_promise.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_qstor.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sil24.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sis.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_svw.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_sx4.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_uli.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_via.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ata/sata_vsc.ko 2024-05-30T06:28:32.576 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ 2024-05-30T06:28:32.577 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/auxdisplay/ks0108.ko 2024-05-30T06:28:32.577 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/ 2024-05-30T06:28:32.577 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 163833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/bcma/bcma.ko 2024-05-30T06:28:32.577 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/ 2024-05-30T06:28:32.577 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/ 2024-05-30T06:28:32.577 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 140833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/aoe/aoe.ko 2024-05-30T06:28:32.577 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/ 2024-05-30T06:28:32.577 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1241585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/drbd/drbd.ko 2024-05-30T06:28:32.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 203281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/floppy.ko 2024-05-30T06:28:32.607 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/ 2024-05-30T06:28:32.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 115257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-30T06:28:32.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 143425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/nbd.ko 2024-05-30T06:28:32.607 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/ 2024-05-30T06:28:32.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 126609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/null_blk/null_blk.ko 2024-05-30T06:28:32.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 119865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/pktcdvd.ko 2024-05-30T06:28:32.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 313209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/rbd.ko 2024-05-30T06:28:32.607 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/ 2024-05-30T06:28:32.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 117217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-30T06:28:32.607 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/ 2024-05-30T06:28:32.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/block/zram/zram.ko 2024-05-30T06:28:32.608 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ 2024-05-30T06:28:32.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/applicom.ko 2024-05-30T06:28:32.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hangcheck-timer.ko 2024-05-30T06:28:32.608 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/ 2024-05-30T06:28:32.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-30T06:28:32.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-30T06:28:32.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-30T06:28:32.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/via-rng.ko 2024-05-30T06:28:32.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-30T06:28:32.608 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ 2024-05-30T06:28:32.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-30T06:28:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 186913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-30T06:28:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-30T06:28:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 179441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-30T06:28:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-30T06:28:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-30T06:28:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/lp.ko 2024-05-30T06:28:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/ 2024-05-30T06:28:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 103385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/mwave/mwave.ko 2024-05-30T06:28:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/nvram.ko 2024-05-30T06:28:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/ppdev.ko 2024-05-30T06:28:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tlclk.ko 2024-05-30T06:28:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/ 2024-05-30T06:28:32.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-30T06:28:32.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-05-30T06:28:32.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-05-30T06:28:32.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-05-30T06:28:32.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-30T06:28:32.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-30T06:28:32.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-05-30T06:28:32.610 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/ 2024-05-30T06:28:32.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_class.ko 2024-05-30T06:28:32.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 62537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_core.ko 2024-05-30T06:28:32.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-05-30T06:28:32.610 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/ 2024-05-30T06:28:32.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-palmas.ko 2024-05-30T06:28:32.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-si5351.ko 2024-05-30T06:28:32.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-twl6040.ko 2024-05-30T06:28:32.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/clk/clk-wm831x.ko 2024-05-30T06:28:32.611 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/ 2024-05-30T06:28:32.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-30T06:28:32.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-30T06:28:32.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-30T06:28:32.611 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ 2024-05-30T06:28:32.611 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ 2024-05-30T06:28:32.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 89209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-30T06:28:32.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 333593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/ccp/ccp.ko 2024-05-30T06:28:32.611 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/ 2024-05-30T06:28:32.611 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/ 2024-05-30T06:28:32.611 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/ 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 751433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-aes.ko 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/padlock-sha.ko 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/ 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 90465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/ 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dca/dca.ko 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/ 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ 2024-05-30T06:28:32.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 146745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-30T06:28:32.613 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ 2024-05-30T06:28:32.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 96137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/amd64_edac.ko 2024-05-30T06:28:32.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/e752x_edac.ko 2024-05-30T06:28:32.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/edac_mce_amd.ko 2024-05-30T06:28:32.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3000_edac.ko 2024-05-30T06:28:32.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i3200_edac.ko 2024-05-30T06:28:32.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5100_edac.ko 2024-05-30T06:28:32.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i5400_edac.ko 2024-05-30T06:28:32.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7300_edac.ko 2024-05-30T06:28:32.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 64153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i7core_edac.ko 2024-05-30T06:28:32.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/i82975x_edac.ko 2024-05-30T06:28:32.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/ie31200_edac.ko 2024-05-30T06:28:32.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 68689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/sb_edac.ko 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/edac/x38_edac.ko 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/ 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-gpio.ko 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max14577.ko 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max77693.ko 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-max8997.ko 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-palmas.ko 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-rt8973a.ko 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/extcon/extcon-sm5502.ko 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/ 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/dmi-sysfs.ko 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/ 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/efi/efi-pstore.ko 2024-05-30T06:28:32.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/ 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-adp5520.ko 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-amd8111.ko 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-arizona.ko 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9052.ko 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-da9055.ko 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-dln2.ko 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 81065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-f7188x.ko 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-generic.ko 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ich.ko 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-kempld.ko 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-lp3943.ko 2024-05-30T06:28:32.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max7300.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max730x.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-max732x.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pca953x.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-pcf857x.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-rdc321x.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-sch311x.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-tps65912.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl4030.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-twl6040.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-vx855.ko 2024-05-30T06:28:32.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm831x.ko 2024-05-30T06:28:32.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8350.ko 2024-05-30T06:28:32.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/gpio/gpio-wm8994.ko 2024-05-30T06:28:32.617 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/ 2024-05-30T06:28:32.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-a4tech.ko 2024-05-30T06:28:32.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-apple.ko 2024-05-30T06:28:32.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-appleir.ko 2024-05-30T06:28:32.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-aureal.ko 2024-05-30T06:28:32.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-axff.ko 2024-05-30T06:28:32.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-belkin.ko 2024-05-30T06:28:32.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cherry.ko 2024-05-30T06:28:32.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-chicony.ko 2024-05-30T06:28:32.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 74385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cp2112.ko 2024-05-30T06:28:32.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-cypress.ko 2024-05-30T06:28:32.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-dr.ko 2024-05-30T06:28:32.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elecom.ko 2024-05-30T06:28:32.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-elo.ko 2024-05-30T06:28:32.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-emsff.ko 2024-05-30T06:28:32.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ezkey.ko 2024-05-30T06:28:32.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gaff.ko 2024-05-30T06:28:32.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-generic.ko 2024-05-30T06:28:32.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gt683r.ko 2024-05-30T06:28:32.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-gyration.ko 2024-05-30T06:28:32.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-30T06:28:32.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-30T06:28:32.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-holtekff.ko 2024-05-30T06:28:32.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-hyperv.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-icade.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kensington.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-keytouch.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-kye.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lcpower.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-led.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lenovo.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-lg-g15.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 121361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 97929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-logitech.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-magicmouse.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-microsoft.ko 2024-05-30T06:28:32.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-monterey.ko 2024-05-30T06:28:32.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 58993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-multitouch.ko 2024-05-30T06:28:32.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ntrig.ko 2024-05-30T06:28:32.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-ortek.ko 2024-05-30T06:28:32.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-penmount.ko 2024-05-30T06:28:32.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-petalynx.ko 2024-05-30T06:28:32.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 91217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-picolcd.ko 2024-05-30T06:28:32.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-pl.ko 2024-05-30T06:28:32.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-plantronics.ko 2024-05-30T06:28:32.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-primax.ko 2024-05-30T06:28:32.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-rmi.ko 2024-05-30T06:28:32.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-30T06:28:32.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-common.ko 2024-05-30T06:28:32.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-30T06:28:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-30T06:28:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-30T06:28:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-30T06:28:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-30T06:28:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-30T06:28:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-30T06:28:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-30T06:28:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-30T06:28:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-roccat.ko 2024-05-30T06:28:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-saitek.ko 2024-05-30T06:28:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-samsung.ko 2024-05-30T06:28:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-30T06:28:32.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sjoy.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 62121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sony.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-speedlink.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-steelseries.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-sunplus.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tivo.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-tmff.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-topseed.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-twinhan.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 81097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-uclogic.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-waltop.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 184729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-wiimote.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-xinmo.ko 2024-05-30T06:28:32.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zpff.ko 2024-05-30T06:28:32.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid-zydacron.ko 2024-05-30T06:28:32.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 319897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/hid.ko 2024-05-30T06:28:32.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/uhid.ko 2024-05-30T06:28:32.623 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/ 2024-05-30T06:28:32.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 153617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbhid.ko 2024-05-30T06:28:32.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbkbd.ko 2024-05-30T06:28:32.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/usbhid/usbmouse.ko 2024-05-30T06:28:32.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 261929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hid/wacom.ko 2024-05-30T06:28:32.623 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/ 2024-05-30T06:28:32.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 75057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_balloon.ko 2024-05-30T06:28:32.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 110657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_utils.ko 2024-05-30T06:28:32.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 381625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hv/hv_vmbus.ko 2024-05-30T06:28:32.623 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 77145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru.ko 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 67001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/abituguru3.ko 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7414.ko 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ad7418.ko 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adc128d818.ko 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1025.ko 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 115049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1026.ko 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1029.ko 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm1031.ko 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adm9240.ko 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ads7828.ko 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7410.ko 2024-05-30T06:28:32.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7411.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 89017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7462.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7470.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 81465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7475.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/adt7x10.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/amc6821.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 68857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/applesmc.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asb100.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 69001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asc7621.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/atxp1.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/coretemp.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9052-hwmon.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/da9055-hwmon.ko 2024-05-30T06:28:32.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-30T06:28:32.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 113129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/dme1737.ko 2024-05-30T06:28:32.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds1621.ko 2024-05-30T06:28:32.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ds620.ko 2024-05-30T06:28:32.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc1403.ko 2024-05-30T06:28:32.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc2103.ko 2024-05-30T06:28:32.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/emc6w201.ko 2024-05-30T06:28:32.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71805f.ko 2024-05-30T06:28:32.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 108953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f71882fg.ko 2024-05-30T06:28:32.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/f75375s.ko 2024-05-30T06:28:32.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fam15h_power.ko 2024-05-30T06:28:32.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/fschmd.ko 2024-05-30T06:28:32.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g760a.ko 2024-05-30T06:28:32.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/g762.ko 2024-05-30T06:28:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl518sm.ko 2024-05-30T06:28:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 56305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/gl520sm.ko 2024-05-30T06:28:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hih6130.ko 2024-05-30T06:28:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-30T06:28:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5500_temp.ko 2024-05-30T06:28:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/i5k_amb.ko 2024-05-30T06:28:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmaem.ko 2024-05-30T06:28:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ibmpex.ko 2024-05-30T06:28:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina209.ko 2024-05-30T06:28:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ina2xx.ko 2024-05-30T06:28:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 156457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/it87.ko 2024-05-30T06:28:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/jc42.ko 2024-05-30T06:28:32.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k10temp.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/k8temp.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lineage-pem.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm63.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm73.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm75.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm77.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm78.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm80.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm83.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 86489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm85.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm87.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 76481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm90.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm92.ko 2024-05-30T06:28:32.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 131497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm93.ko 2024-05-30T06:28:32.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95234.ko 2024-05-30T06:28:32.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95241.ko 2024-05-30T06:28:32.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/lm95245.ko 2024-05-30T06:28:32.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc2945.ko 2024-05-30T06:28:32.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4151.ko 2024-05-30T06:28:32.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4215.ko 2024-05-30T06:28:32.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4222.ko 2024-05-30T06:28:32.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4245.ko 2024-05-30T06:28:32.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4260.ko 2024-05-30T06:28:32.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/ltc4261.ko 2024-05-30T06:28:32.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max16065.ko 2024-05-30T06:28:32.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1619.ko 2024-05-30T06:28:32.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max1668.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max197.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6639.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6650.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/max6697.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mc13783-adc.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/mcp3021.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 56497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6683.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 141345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775-core.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 72729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct6775.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 67769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/nct7802.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 97769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87360.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pc87427.ko 2024-05-30T06:28:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pcf8591.ko 2024-05-30T06:28:32.631 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ 2024-05-30T06:28:32.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-30T06:28:32.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-30T06:28:32.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-30T06:28:32.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-30T06:28:32.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-30T06:28:32.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-30T06:28:32.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-30T06:28:32.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 101225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-30T06:28:32.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-30T06:28:32.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-30T06:28:32.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-30T06:28:32.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/powr1220.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5627.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch5636.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht15.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sht21.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/shtc1.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/sis5595.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47b397.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m1.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/smsc47m192.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/thmc50.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp102.ko 2024-05-30T06:28:32.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp103.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp401.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/tmp421.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via-cputemp.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/via686a.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt1211.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 62729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/vt8231.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 71161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627ehf.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 96569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83627hf.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83781d.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 75121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83791d.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 83417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83792d.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 116769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83793.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 134433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83795.ko 2024-05-30T06:28:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l785ts.ko 2024-05-30T06:28:32.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/w83l786ng.ko 2024-05-30T06:28:32.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-05-30T06:28:32.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-05-30T06:28:32.634 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/ 2024-05-30T06:28:32.634 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/ 2024-05-30T06:28:32.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-30T06:28:32.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-30T06:28:32.634 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/ 2024-05-30T06:28:32.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-05-30T06:28:32.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-05-30T06:28:32.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-05-30T06:28:32.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-30T06:28:32.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 64217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 76961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-30T06:28:32.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-05-30T06:28:32.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-mux.ko 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-smbus.ko 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/i2c-stub.ko 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/ 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ 2024-05-30T06:28:32.637 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 329681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-30T06:28:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1119785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_core.ko 2024-05-30T06:28:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 83897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-30T06:28:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 408329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-30T06:28:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 120905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-30T06:28:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 347201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-30T06:28:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 84937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-30T06:28:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ 2024-05-30T06:28:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/ 2024-05-30T06:28:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 590873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-30T06:28:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/ 2024-05-30T06:28:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 514577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-30T06:28:32.660 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/ 2024-05-30T06:28:32.661 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 911649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-30T06:28:32.661 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ 2024-05-30T06:28:32.661 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 375449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-30T06:28:32.661 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ 2024-05-30T06:28:32.661 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 197097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-05-30T06:28:32.661 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/ 2024-05-30T06:28:32.661 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 212497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-05-30T06:28:32.661 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ 2024-05-30T06:28:32.661 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ 2024-05-30T06:28:32.661 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 334353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-30T06:28:32.661 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 120649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 132577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 157929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 156665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/evbug.ko 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/ff-memless.ko 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/ 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-30T06:28:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/gameport/gameport.ko 2024-05-30T06:28:32.663 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/joydev.ko 2024-05-30T06:28:32.663 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/ 2024-05-30T06:28:32.663 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-05-30T06:28:32.663 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-05-30T06:28:32.663 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-05-30T06:28:32.663 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-05-30T06:28:32.663 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-30T06:28:32.663 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-05-30T06:28:32.663 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lkkbd.ko 2024-05-30T06:28:32.663 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8323.ko 2024-05-30T06:28:32.663 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/lm8333.ko 2024-05-30T06:28:32.663 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/newtonkbd.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt1070.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/qt2160.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/stowaway.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/sunkbd.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-05-30T06:28:32.664 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/keyboard/xtkbd.ko 2024-05-30T06:28:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/matrix-keymap.ko 2024-05-30T06:28:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/ 2024-05-30T06:28:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/appletouch.ko 2024-05-30T06:28:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/bcm5974.ko 2024-05-30T06:28:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 159993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/cyapatp.ko 2024-05-30T06:28:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 114193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-30T06:28:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/gpio_mouse.ko 2024-05-30T06:28:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 428121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/psmouse.ko 2024-05-30T06:28:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/sermouse.ko 2024-05-30T06:28:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-30T06:28:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-30T06:28:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-30T06:28:32.665 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/ 2024-05-30T06:28:32.666 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 140921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-30T06:28:32.666 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ 2024-05-30T06:28:32.666 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/altera_ps2.ko 2024-05-30T06:28:32.666 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/arc_ps2.ko 2024-05-30T06:28:32.666 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ct82c710.ko 2024-05-30T06:28:32.666 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-30T06:28:32.666 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/parkbd.ko 2024-05-30T06:28:32.666 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/pcips2.ko 2024-05-30T06:28:32.666 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/ps2mult.ko 2024-05-30T06:28:32.666 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serio_raw.ko 2024-05-30T06:28:32.666 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/serio/serport.ko 2024-05-30T06:28:32.666 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/input/sparse-keymap.ko 2024-05-30T06:28:32.667 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/ 2024-05-30T06:28:32.667 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-88pm860x.ko 2024-05-30T06:28:32.667 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-adp5520.ko 2024-05-30T06:28:32.667 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 77193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-bd2802.ko 2024-05-30T06:28:32.667 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-blinkm.ko 2024-05-30T06:28:32.667 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da903x.ko 2024-05-30T06:28:32.667 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-da9052.ko 2024-05-30T06:28:32.667 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-gpio.ko 2024-05-30T06:28:32.667 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3530.ko 2024-05-30T06:28:32.667 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3533.ko 2024-05-30T06:28:32.667 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm355x.ko 2024-05-30T06:28:32.667 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lm3642.ko 2024-05-30T06:28:32.667 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp3944.ko 2024-05-30T06:28:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-lp8788.ko 2024-05-30T06:28:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-max8997.ko 2024-05-30T06:28:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-mc13783.ko 2024-05-30T06:28:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-menf21bmc.ko 2024-05-30T06:28:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca9532.ko 2024-05-30T06:28:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca955x.ko 2024-05-30T06:28:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-pca963x.ko 2024-05-30T06:28:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-ss4200.ko 2024-05-30T06:28:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-tca6507.ko 2024-05-30T06:28:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm831x-status.ko 2024-05-30T06:28:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/leds-wm8350.ko 2024-05-30T06:28:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ 2024-05-30T06:28:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-30T06:28:32.669 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-30T06:28:32.669 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-30T06:28:32.669 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-30T06:28:32.669 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-30T06:28:32.669 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-30T06:28:32.669 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-30T06:28:32.669 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-30T06:28:32.669 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-30T06:28:32.669 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/ 2024-05-30T06:28:32.669 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/ 2024-05-30T06:28:32.669 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 790665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/bcache/bcache.ko 2024-05-30T06:28:32.669 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bio-prison.ko 2024-05-30T06:28:32.669 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 116817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-bufio.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 58273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache-smq.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 199017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-cache.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 134937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-crypt.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-delay.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 67489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-era.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-flakey.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log-userspace.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-log.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-mirror.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 97193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-multipath.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-queue-length.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-raid.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-region-hash.ko 2024-05-30T06:28:32.670 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-round-robin.ko 2024-05-30T06:28:32.671 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-service-time.ko 2024-05-30T06:28:32.671 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 139793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-snapshot.ko 2024-05-30T06:28:32.671 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-switch.ko 2024-05-30T06:28:32.671 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 234441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-thin-pool.ko 2024-05-30T06:28:32.671 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-verity.ko 2024-05-30T06:28:32.671 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/dm-zero.ko 2024-05-30T06:28:32.671 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/ 2024-05-30T06:28:32.671 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 264273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-30T06:28:32.671 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid0.ko 2024-05-30T06:28:32.671 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 124705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid1.ko 2024-05-30T06:28:32.671 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 157673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid10.ko 2024-05-30T06:28:32.671 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 444649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/md/raid456.ko 2024-05-30T06:28:32.671 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/ 2024-05-30T06:28:32.672 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/ 2024-05-30T06:28:32.672 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 214833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptbase.ko 2024-05-30T06:28:32.672 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 77977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptctl.ko 2024-05-30T06:28:32.672 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptfc.ko 2024-05-30T06:28:32.672 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptlan.ko 2024-05-30T06:28:32.672 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 150753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptsas.ko 2024-05-30T06:28:32.672 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 97209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptscsih.ko 2024-05-30T06:28:32.672 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 63865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/message/fusion/mptspi.ko 2024-05-30T06:28:32.672 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/ 2024-05-30T06:28:32.672 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm800.ko 2024-05-30T06:28:32.672 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm805.ko 2024-05-30T06:28:32.672 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/88pm80x.ko 2024-05-30T06:28:32.673 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona-i2c.ko 2024-05-30T06:28:32.673 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 148545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/arizona.ko 2024-05-30T06:28:32.673 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/bcm590xx.ko 2024-05-30T06:28:32.673 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/cros_ec_dev.ko 2024-05-30T06:28:32.673 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/dln2.ko 2024-05-30T06:28:32.673 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/janz-cmodio.ko 2024-05-30T06:28:32.673 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/kempld-core.ko 2024-05-30T06:28:32.673 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-core.ko 2024-05-30T06:28:32.673 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-05-30T06:28:32.673 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lp3943.ko 2024-05-30T06:28:32.673 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_ich.ko 2024-05-30T06:28:32.673 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/lpc_sch.ko 2024-05-30T06:28:32.674 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/max8907.ko 2024-05-30T06:28:32.674 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-core.ko 2024-05-30T06:28:32.674 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-05-30T06:28:32.674 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/menf21bmc.ko 2024-05-30T06:28:32.674 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-adc.ko 2024-05-30T06:28:32.674 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633-gpio.ko 2024-05-30T06:28:32.674 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/pcf50633.ko 2024-05-30T06:28:32.674 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-05-30T06:28:32.674 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/retu-mfd.ko 2024-05-30T06:28:32.674 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 99409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/si476x-core.ko 2024-05-30T06:28:32.674 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 58049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/sm501.ko 2024-05-30T06:28:32.674 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps65010.ko 2024-05-30T06:28:32.674 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/tps6507x.ko 2024-05-30T06:28:32.675 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/viperboard.ko 2024-05-30T06:28:32.675 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/vx855.ko 2024-05-30T06:28:32.675 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wl1273-core.ko 2024-05-30T06:28:32.675 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/mfd/wm8994.ko 2024-05-30T06:28:32.675 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ 2024-05-30T06:28:32.675 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-05-30T06:28:32.675 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 64257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ad525x_dpot.ko 2024-05-30T06:28:32.675 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/ 2024-05-30T06:28:32.675 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-30T06:28:32.675 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds9802als.ko 2024-05-30T06:28:32.675 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/apds990x.ko 2024-05-30T06:28:32.675 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 58625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/bh1770glc.ko 2024-05-30T06:28:32.675 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/ 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/c2port/core.ko 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/ 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/cb710/cb710.ko 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ds1682.ko 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/dummy-irq.ko 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/ 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/echo/echo.ko 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/ 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/at24.ko 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/eeprom/max6875.ko 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/enclosure.ko 2024-05-30T06:28:32.676 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/ 2024-05-30T06:28:32.677 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 191617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-05-30T06:28:32.677 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hmc6352.ko 2024-05-30T06:28:32.677 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/hpilo.ko 2024-05-30T06:28:32.677 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ 2024-05-30T06:28:32.677 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 92289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-05-30T06:28:32.677 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ics932s401.ko 2024-05-30T06:28:32.677 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29003.ko 2024-05-30T06:28:32.677 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/isl29020.ko 2024-05-30T06:28:32.677 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/ 2024-05-30T06:28:32.677 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-30T06:28:32.677 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-30T06:28:32.677 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/ 2024-05-30T06:28:32.678 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 154257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-me.ko 2024-05-30T06:28:32.678 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 69793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei-txe.ko 2024-05-30T06:28:32.678 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 388977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/mei/mei.ko 2024-05-30T06:28:32.678 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/phantom.ko 2024-05-30T06:28:32.678 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/ 2024-05-30T06:28:32.678 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 91129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/ti-st/st_drv.ko 2024-05-30T06:28:32.678 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_7xx1.ko 2024-05-30T06:28:32.678 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tifm_core.ko 2024-05-30T06:28:32.678 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/tsl2550.ko 2024-05-30T06:28:32.678 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_balloon.ko 2024-05-30T06:28:32.678 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/ 2024-05-30T06:28:32.678 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 234849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/ 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 620849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/bonding/bonding.ko 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/ 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/ 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 139745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/ 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 589537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/dummy.ko 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/eql.ko 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ 2024-05-30T06:28:32.679 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/ 2024-05-30T06:28:32.680 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-30T06:28:32.680 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-30T06:28:32.680 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 158641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-30T06:28:32.680 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-30T06:28:32.680 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ 2024-05-30T06:28:32.680 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-30T06:28:32.680 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-30T06:28:32.680 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-30T06:28:32.680 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 109513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-30T06:28:32.680 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/ 2024-05-30T06:28:32.680 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 64697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-30T06:28:32.680 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/ 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 84321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/ 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/ 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/ 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 56049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 115873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/ 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/ 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 124481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-05-30T06:28:32.681 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 128393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-30T06:28:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-05-30T06:28:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 110321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-30T06:28:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/ 2024-05-30T06:28:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 101849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-30T06:28:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 88945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-30T06:28:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/ 2024-05-30T06:28:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 105625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-30T06:28:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 228977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-30T06:28:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-05-30T06:28:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1733297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-30T06:28:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 167177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-30T06:28:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/ 2024-05-30T06:28:32.682 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 164249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-30T06:28:32.683 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 440553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-30T06:28:32.683 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/ 2024-05-30T06:28:32.683 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/ 2024-05-30T06:28:32.683 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 432145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-30T06:28:32.683 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/ 2024-05-30T06:28:32.683 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-05-30T06:28:32.683 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 257145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-30T06:28:32.683 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-05-30T06:28:32.683 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 446057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-30T06:28:32.683 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-05-30T06:28:32.683 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1311193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-30T06:28:32.683 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-05-30T06:28:32.683 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 206673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/ 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/ 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 269249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/ 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/ 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 77449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 169041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 76201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-30T06:28:32.684 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/ 2024-05-30T06:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 75937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-30T06:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-30T06:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/dnet.ko 2024-05-30T06:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ec_bhf.ko 2024-05-30T06:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/ 2024-05-30T06:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/ 2024-05-30T06:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 356353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-30T06:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ethoc.ko 2024-05-30T06:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 63177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fealnx.ko 2024-05-30T06:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/ 2024-05-30T06:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-05-30T06:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ 2024-05-30T06:28:32.685 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 115561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-30T06:28:32.686 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/ 2024-05-30T06:28:32.686 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 366193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-30T06:28:32.686 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/ 2024-05-30T06:28:32.686 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 755673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-30T06:28:32.686 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/ 2024-05-30T06:28:32.686 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 324513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-30T06:28:32.686 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/ 2024-05-30T06:28:32.686 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1196201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-30T06:28:32.686 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/ 2024-05-30T06:28:32.686 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 362609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-30T06:28:32.686 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/ 2024-05-30T06:28:32.686 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 672313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-30T06:28:32.710 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/ 2024-05-30T06:28:32.710 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 121513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-30T06:28:32.710 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-05-30T06:28:32.710 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 966601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-30T06:28:32.710 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-05-30T06:28:32.710 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 193465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-30T06:28:32.710 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 108625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/jme.ko 2024-05-30T06:28:32.710 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/ 2024-05-30T06:28:32.710 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-30T06:28:32.711 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 126873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-30T06:28:32.711 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 150769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-30T06:28:32.711 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/ 2024-05-30T06:28:32.711 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-05-30T06:28:32.711 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 904929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-30T06:28:32.711 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 344089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-30T06:28:32.711 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-05-30T06:28:32.711 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-05-30T06:28:32.711 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1413529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-30T06:28:32.711 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ 2024-05-30T06:28:32.711 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-05-30T06:28:32.711 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-05-30T06:28:32.711 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-05-30T06:28:32.712 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 117345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-30T06:28:32.712 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/ 2024-05-30T06:28:32.712 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-05-30T06:28:32.712 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 131353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-30T06:28:32.712 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ 2024-05-30T06:28:32.712 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 91457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-30T06:28:32.712 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 56681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-30T06:28:32.712 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/ 2024-05-30T06:28:32.712 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 181201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-30T06:28:32.712 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/ 2024-05-30T06:28:32.712 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 171409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-30T06:28:32.712 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/ 2024-05-30T06:28:32.712 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 58241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-30T06:28:32.713 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-30T06:28:32.713 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/ 2024-05-30T06:28:32.713 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-05-30T06:28:32.713 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 300793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-30T06:28:32.713 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 105681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-30T06:28:32.713 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-05-30T06:28:32.713 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 885057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-30T06:28:32.713 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/ 2024-05-30T06:28:32.713 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-30T06:28:32.713 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/ 2024-05-30T06:28:32.713 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 81633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-30T06:28:32.713 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 100681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-30T06:28:32.714 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-30T06:28:32.714 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 264145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-30T06:28:32.714 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/ 2024-05-30T06:28:32.714 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-05-30T06:28:32.714 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 142401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-05-30T06:28:32.714 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/ 2024-05-30T06:28:32.714 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1350201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-30T06:28:32.714 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/ 2024-05-30T06:28:32.714 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-30T06:28:32.714 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/ 2024-05-30T06:28:32.714 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-30T06:28:32.714 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 80057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-30T06:28:32.714 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/ 2024-05-30T06:28:32.715 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 74281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-30T06:28:32.715 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 79449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-30T06:28:32.715 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 100777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-30T06:28:32.715 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 83433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-30T06:28:32.715 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/ 2024-05-30T06:28:32.715 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-05-30T06:28:32.715 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-05-30T06:28:32.715 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-30T06:28:32.715 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-05-30T06:28:32.715 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 644329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-30T06:28:32.715 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/ 2024-05-30T06:28:32.715 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 128489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-30T06:28:32.716 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 207985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-30T06:28:32.716 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 82625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-30T06:28:32.716 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 91345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-30T06:28:32.716 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/ 2024-05-30T06:28:32.716 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-30T06:28:32.716 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/ 2024-05-30T06:28:32.716 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 110721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-30T06:28:32.716 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/ 2024-05-30T06:28:32.716 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 98681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-30T06:28:32.716 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 102505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-30T06:28:32.716 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/ 2024-05-30T06:28:32.716 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-30T06:28:32.716 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-30T06:28:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/ 2024-05-30T06:28:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 69905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-30T06:28:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/ 2024-05-30T06:28:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/defxx.ko 2024-05-30T06:28:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/ 2024-05-30T06:28:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 275713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/fddi/skfp/skfp.ko 2024-05-30T06:28:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 91665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/geneve.ko 2024-05-30T06:28:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/ 2024-05-30T06:28:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 290441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-30T06:28:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/ 2024-05-30T06:28:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-30T06:28:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ifb.ko 2024-05-30T06:28:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ 2024-05-30T06:28:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-30T06:28:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvlan.ko 2024-05-30T06:28:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/macvtap.ko 2024-05-30T06:28:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/ 2024-05-30T06:28:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-30T06:28:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-30T06:28:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-gpio.ko 2024-05-30T06:28:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-30T06:28:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mdio.ko 2024-05-30T06:28:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/mii.ko 2024-05-30T06:28:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 62673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/netconsole.ko 2024-05-30T06:28:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/nlmon.ko 2024-05-30T06:28:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/ 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/amd.ko 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/bcm87xx.ko 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/broadcom.ko 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/cicada.ko 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/davicom.ko 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/et1011c.ko 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/icplus.ko 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/lxt.ko 2024-05-30T06:28:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 103369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/marvell.ko 2024-05-30T06:28:32.720 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 96017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/micrel.ko 2024-05-30T06:28:32.720 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/national.ko 2024-05-30T06:28:32.720 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 121097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/phylink.ko 2024-05-30T06:28:32.720 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/qsemi.ko 2024-05-30T06:28:32.720 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 62105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/realtek.ko 2024-05-30T06:28:32.720 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/smsc.ko 2024-05-30T06:28:32.720 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/ste10Xp.ko 2024-05-30T06:28:32.720 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/phy/vitesse.ko 2024-05-30T06:28:32.720 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/ 2024-05-30T06:28:32.720 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/plip/plip.ko 2024-05-30T06:28:32.720 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ 2024-05-30T06:28:32.720 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-30T06:28:32.720 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_async.ko 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppoe.ko 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pppox.ko 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/ppp/pptp.ko 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sb1000.ko 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/ 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/slip/slip.ko 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/sungem_phy.ko 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 80153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/tap.ko 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/ 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 137313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team.ko 2024-05-30T06:28:32.721 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-30T06:28:32.722 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-30T06:28:32.722 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-30T06:28:32.722 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_random.ko 2024-05-30T06:28:32.722 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-30T06:28:32.722 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 108081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/veth.ko 2024-05-30T06:28:32.722 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/ 2024-05-30T06:28:32.722 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 176481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-30T06:28:32.722 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/ 2024-05-30T06:28:32.722 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 384329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/vxlan/vxlan.ko 2024-05-30T06:28:32.722 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/ 2024-05-30T06:28:32.722 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 175513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-30T06:28:32.722 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ 2024-05-30T06:28:32.722 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ntb/ntb.ko 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/ 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/ 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 335489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme-core.ko 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 127497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/nvme/host/nvme.ko 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/ 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 168113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport.ko 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_cs.ko 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 103881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_pc.ko 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/parport/parport_serial.ko 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/ 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/ 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-05-30T06:28:32.723 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-05-30T06:28:32.724 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/pci-stub.ko 2024-05-30T06:28:32.724 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pci/xen-pcifront.ko 2024-05-30T06:28:32.724 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/ 2024-05-30T06:28:32.724 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/i82092.ko 2024-05-30T06:28:32.724 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 179937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia.ko 2024-05-30T06:28:32.724 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_core.ko 2024-05-30T06:28:32.724 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-05-30T06:28:32.724 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/pd6729.ko 2024-05-30T06:28:32.724 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 133745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-30T06:28:32.724 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/ 2024-05-30T06:28:32.724 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/ 2024-05-30T06:28:32.724 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-05-30T06:28:32.724 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/ 2024-05-30T06:28:32.725 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-05-30T06:28:32.725 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/ 2024-05-30T06:28:32.725 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/ 2024-05-30T06:28:32.725 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-30T06:28:32.725 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/ 2024-05-30T06:28:32.725 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/ 2024-05-30T06:28:32.725 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-05-30T06:28:32.725 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec.ko 2024-05-30T06:28:32.725 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-05-30T06:28:32.725 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-05-30T06:28:32.725 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-05-30T06:28:32.725 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-05-30T06:28:32.725 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-05-30T06:28:32.726 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ 2024-05-30T06:28:32.726 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 87929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-30T06:28:32.726 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/acerhdf.ko 2024-05-30T06:28:32.726 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-30T06:28:32.726 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 73857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-30T06:28:32.726 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-30T06:28:32.726 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 164761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-30T06:28:32.726 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-30T06:28:32.726 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 62065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-30T06:28:32.726 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-30T06:28:32.726 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-30T06:28:32.726 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-30T06:28:32.726 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/hdaps.ko 2024-05-30T06:28:32.727 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/ibm_rtl.ko 2024-05-30T06:28:32.727 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/ 2024-05-30T06:28:32.727 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-30T06:28:32.727 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-05-30T06:28:32.727 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/intel_ips.ko 2024-05-30T06:28:32.727 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-30T06:28:32.727 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-30T06:28:32.727 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-30T06:28:32.727 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-30T06:28:32.727 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-30T06:28:32.727 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-30T06:28:32.727 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/platform/x86/wmi.ko 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/ 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_battery.ko 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/88pm860x_charger.ko 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 68825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq2415x_charger.ko 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 73065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24190_charger.ko 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/bq24735-charger.ko 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9030_battery.ko 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/da9052-battery.ko 2024-05-30T06:28:32.728 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2760_battery.ko 2024-05-30T06:28:32.729 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2780_battery.ko 2024-05-30T06:28:32.729 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2781_battery.ko 2024-05-30T06:28:32.729 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/ds2782_battery.ko 2024-05-30T06:28:32.729 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/gpio-charger.ko 2024-05-30T06:28:32.729 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/isp1704_charger.ko 2024-05-30T06:28:32.729 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/lp8727_charger.ko 2024-05-30T06:28:32.729 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max14577_charger.ko 2024-05-30T06:28:32.729 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max17042_battery.ko 2024-05-30T06:28:32.729 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8903_charger.ko 2024-05-30T06:28:32.729 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/max8925_power.ko 2024-05-30T06:28:32.729 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/pcf50633-charger.ko 2024-05-30T06:28:32.729 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/sbs-battery.ko 2024-05-30T06:28:32.729 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/test_power.ko 2024-05-30T06:28:32.730 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/tps65090-charger.ko 2024-05-30T06:28:32.730 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_backup.ko 2024-05-30T06:28:32.730 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm831x_power.ko 2024-05-30T06:28:32.730 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/power/supply/wm8350_power.ko 2024-05-30T06:28:32.730 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/ 2024-05-30T06:28:32.730 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 73289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-30T06:28:32.730 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-30T06:28:32.730 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/ 2024-05-30T06:28:32.730 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/ 2024-05-30T06:28:32.730 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-30T06:28:32.730 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-30T06:28:32.730 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/clients/pps_parport.ko 2024-05-30T06:28:32.730 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/pps/pps_core.ko 2024-05-30T06:28:32.731 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ 2024-05-30T06:28:32.731 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 91369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp.ko 2024-05-30T06:28:32.731 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ptp/ptp_kvm.ko 2024-05-30T06:28:32.731 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/ 2024-05-30T06:28:32.731 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/ 2024-05-30T06:28:32.731 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/ 2024-05-30T06:28:32.731 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 67473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-30T06:28:32.731 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ras/amd/fmpm.ko 2024-05-30T06:28:32.731 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/ 2024-05-30T06:28:32.731 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm80x.ko 2024-05-30T06:28:32.731 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-88pm860x.ko 2024-05-30T06:28:32.731 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-30T06:28:32.732 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9052.ko 2024-05-30T06:28:32.732 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9055.ko 2024-05-30T06:28:32.732 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-da9063.ko 2024-05-30T06:28:32.732 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-30T06:28:32.732 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 82217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-30T06:28:32.732 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-30T06:28:32.732 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-30T06:28:32.732 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-30T06:28:32.732 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-30T06:28:32.732 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-30T06:28:32.732 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-30T06:28:32.732 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-30T06:28:32.732 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-em3027.ko 2024-05-30T06:28:32.733 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-30T06:28:32.733 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-30T06:28:32.733 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-30T06:28:32.733 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-lp8788.ko 2024-05-30T06:28:32.733 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-30T06:28:32.733 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-30T06:28:32.733 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-30T06:28:32.733 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-m48t86.ko 2024-05-30T06:28:32.733 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max6900.ko 2024-05-30T06:28:32.733 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8907.ko 2024-05-30T06:28:32.733 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8925.ko 2024-05-30T06:28:32.733 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8997.ko 2024-05-30T06:28:32.733 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-max8998.ko 2024-05-30T06:28:32.734 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-05-30T06:28:32.734 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-30T06:28:32.734 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-palmas.ko 2024-05-30T06:28:32.734 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 56769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-30T06:28:32.734 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf50633.ko 2024-05-30T06:28:32.734 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-30T06:28:32.734 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-30T06:28:32.734 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-30T06:28:32.734 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-30T06:28:32.734 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rc5t583.ko 2024-05-30T06:28:32.734 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-30T06:28:32.734 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-30T06:28:32.735 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-30T06:28:32.735 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-30T06:28:32.735 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-30T06:28:32.735 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-s35390a.ko 2024-05-30T06:28:32.735 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-30T06:28:32.735 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps6586x.ko 2024-05-30T06:28:32.735 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-tps65910.ko 2024-05-30T06:28:32.735 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm831x.ko 2024-05-30T06:28:32.735 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-wm8350.ko 2024-05-30T06:28:32.735 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/rtc/rtc-x1205.ko 2024-05-30T06:28:32.735 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ 2024-05-30T06:28:32.735 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 90369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-9xxx.ko 2024-05-30T06:28:32.735 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 69585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-sas.ko 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/3w-xxxx.ko 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 164473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/BusLogic.ko 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/a100u2w.ko 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/ 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 340689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 120393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/advansys.ko 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/ 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 468049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 380633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/ 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 243649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/am53c974.ko 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/ 2024-05-30T06:28:32.736 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 135601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-30T06:28:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/atp870u.ko 2024-05-30T06:28:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/ 2024-05-30T06:28:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 304969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-30T06:28:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/ 2024-05-30T06:28:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1527017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bfa/bfa.ko 2024-05-30T06:28:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/ 2024-05-30T06:28:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 297769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-30T06:28:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/ 2024-05-30T06:28:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 144377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-30T06:28:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ch.ko 2024-05-30T06:28:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/ 2024-05-30T06:28:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 390657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-30T06:28:32.737 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/ 2024-05-30T06:28:32.738 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-05-30T06:28:32.738 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 88873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-30T06:28:32.738 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-05-30T06:28:32.738 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 117473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-30T06:28:32.738 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 173009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-30T06:28:32.757 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 91497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dc395x.ko 2024-05-30T06:28:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/dmx3191d.ko 2024-05-30T06:28:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/ 2024-05-30T06:28:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 267521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-30T06:28:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/esp_scsi.ko 2024-05-30T06:28:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/ 2024-05-30T06:28:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 95321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-30T06:28:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 194001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-30T06:28:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fdomain.ko 2024-05-30T06:28:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/ 2024-05-30T06:28:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 366457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/fnic/fnic.ko 2024-05-30T06:28:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 251497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hpsa.ko 2024-05-30T06:28:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hptiop.ko 2024-05-30T06:28:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/hv_storvsc.ko 2024-05-30T06:28:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/imm.ko 2024-05-30T06:28:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/initio.ko 2024-05-30T06:28:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 327833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ipr.ko 2024-05-30T06:28:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 129777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ips.ko 2024-05-30T06:28:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/ 2024-05-30T06:28:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 397657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/isci/isci.ko 2024-05-30T06:28:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-30T06:28:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 63113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-30T06:28:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/ 2024-05-30T06:28:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 386801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libfc/libfc.ko 2024-05-30T06:28:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 178169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi.ko 2024-05-30T06:28:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 64801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-30T06:28:32.759 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/ 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 273953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/libsas/libsas.ko 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/ 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 2735913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/ 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 88521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 389089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 104761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/megaraid.ko 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/ 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 836897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/ 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 158705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 96529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/mvumi.ko 2024-05-30T06:28:32.760 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/ 2024-05-30T06:28:32.761 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 101609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-05-30T06:28:32.761 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-05-30T06:28:32.761 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-05-30T06:28:32.761 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-05-30T06:28:32.761 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/ 2024-05-30T06:28:32.761 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 443713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-30T06:28:32.761 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 152025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/pmcraid.ko 2024-05-30T06:28:32.761 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ppa.ko 2024-05-30T06:28:32.761 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla1280.ko 2024-05-30T06:28:32.761 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/ 2024-05-30T06:28:32.761 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 2324713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-30T06:28:32.761 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 103593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-30T06:28:32.761 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/ 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 697281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/qlogicfas408.ko 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/raid_class.ko 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 322857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_debug.ko 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 219849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 357145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 121177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 93473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/ses.ko 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 138113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/st.ko 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/stex.ko 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/ 2024-05-30T06:28:32.762 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 205001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-30T06:28:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/virtio_scsi.ko 2024-05-30T06:28:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-30T06:28:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/wd719x.ko 2024-05-30T06:28:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/scsi/xen-scsifront.ko 2024-05-30T06:28:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ 2024-05-30T06:28:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 174865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ssb/ssb.ko 2024-05-30T06:28:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/ 2024-05-30T06:28:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/ 2024-05-30T06:28:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 920073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-30T06:28:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/ 2024-05-30T06:28:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-30T06:28:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_file.ko 2024-05-30T06:28:32.763 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_iblock.ko 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1170873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_mod.ko 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_pscsi.ko 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 149777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/target_core_user.ko 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/ 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 90033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/ 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/ 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/ 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-30T06:28:32.764 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-30T06:28:32.765 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ 2024-05-30T06:28:32.766 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ 2024-05-30T06:28:32.766 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 99289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-30T06:28:32.766 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 69721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/moxa.ko 2024-05-30T06:28:32.766 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/mxser.ko 2024-05-30T06:28:32.766 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 134329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_gsm.ko 2024-05-30T06:28:32.766 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/n_hdlc.ko 2024-05-30T06:28:32.766 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/nozomi.ko 2024-05-30T06:28:32.766 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/ 2024-05-30T06:28:32.766 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/ 2024-05-30T06:28:32.766 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-05-30T06:28:32.766 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-30T06:28:32.766 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-05-30T06:28:32.766 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/altera_uart.ko 2024-05-30T06:28:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/arc_uart.ko 2024-05-30T06:28:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 91593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-05-30T06:28:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/ 2024-05-30T06:28:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 120553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-30T06:28:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/rp2.ko 2024-05-30T06:28:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/tty/serial/sc16is7xx.ko 2024-05-30T06:28:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/ 2024-05-30T06:28:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ 2024-05-30T06:28:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 693057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-30T06:28:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ 2024-05-30T06:28:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-30T06:28:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-05-30T06:28:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/ 2024-05-30T06:28:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio.ko 2024-05-30T06:28:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_aec.ko 2024-05-30T06:28:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_cif.ko 2024-05-30T06:28:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_dmem_genirq.ko 2024-05-30T06:28:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_mf624.ko 2024-05-30T06:28:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_netx.ko 2024-05-30T06:28:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pci_generic.ko 2024-05-30T06:28:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-05-30T06:28:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/uio/uio_sercos3.ko 2024-05-30T06:28:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/ 2024-05-30T06:28:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/ 2024-05-30T06:28:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 90297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/c67x00/c67x00.ko 2024-05-30T06:28:32.768 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ 2024-05-30T06:28:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 189169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-05-30T06:28:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-05-30T06:28:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-05-30T06:28:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-05-30T06:28:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-05-30T06:28:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/ 2024-05-30T06:28:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 101537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-acm.ko 2024-05-30T06:28:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 63017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-30T06:28:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 56713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usblp.ko 2024-05-30T06:28:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 107409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/class/usbtmc.ko 2024-05-30T06:28:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ 2024-05-30T06:28:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/common/ulpi.ko 2024-05-30T06:28:32.769 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/ 2024-05-30T06:28:32.770 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-05-30T06:28:32.770 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/ 2024-05-30T06:28:32.770 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-05-30T06:28:32.770 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-05-30T06:28:32.770 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 575217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/dwc3/dwc3.ko 2024-05-30T06:28:32.770 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/ 2024-05-30T06:28:32.770 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/ 2024-05-30T06:28:32.770 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 72241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_ether.ko 2024-05-30T06:28:32.770 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/u_serial.ko 2024-05-30T06:28:32.770 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-05-30T06:28:32.770 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-05-30T06:28:32.770 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-05-30T06:28:32.770 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 131513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 62313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 146601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 101233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 71241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 84929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/ 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-05-30T06:28:32.771 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 204009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/libcomposite.ko 2024-05-30T06:28:32.772 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/ 2024-05-30T06:28:32.773 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-05-30T06:28:32.773 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/ 2024-05-30T06:28:32.773 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 182537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-05-30T06:28:32.773 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-05-30T06:28:32.773 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-05-30T06:28:32.773 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-05-30T06:28:32.773 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 69305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-05-30T06:28:32.773 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 90305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2272.ko 2024-05-30T06:28:32.773 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 90353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/net2280.ko 2024-05-30T06:28:32.773 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 94833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-05-30T06:28:32.773 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 80513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-05-30T06:28:32.773 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 87457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-05-30T06:28:32.773 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 95433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 195953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/bcma-hcd.ko 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 108313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/isp116x-hcd.ko 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 104433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 102265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/sl811_cs.ko 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/ssb-hcd.ko 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/ 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/mdc800.ko 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/image/microtek.ko 2024-05-30T06:28:32.774 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ 2024-05-30T06:28:32.775 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/adutux.ko 2024-05-30T06:28:32.775 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/appledisplay.ko 2024-05-30T06:28:32.775 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-05-30T06:28:32.775 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/cytherm.ko 2024-05-30T06:28:32.775 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ehset.ko 2024-05-30T06:28:32.775 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi26.ko 2024-05-30T06:28:32.775 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/emi62.ko 2024-05-30T06:28:32.775 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ezusb.ko 2024-05-30T06:28:32.775 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/idmouse.ko 2024-05-30T06:28:32.775 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/iowarrior.ko 2024-05-30T06:28:32.775 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-30T06:28:32.775 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/ldusb.ko 2024-05-30T06:28:32.775 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/legousbtower.ko 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/lvstest.ko 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/ 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usb3503.ko 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usblcd.ko 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 84257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/usbtest.ko 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/uss720.ko 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/misc/yurex.ko 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/ 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 91505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/mon/usbmon.ko 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/ 2024-05-30T06:28:32.776 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 396169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/musb/musb_hdrc.ko 2024-05-30T06:28:32.777 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/ 2024-05-30T06:28:32.777 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-generic.ko 2024-05-30T06:28:32.777 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-05-30T06:28:32.777 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-isp1301.ko 2024-05-30T06:28:32.777 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/phy/phy-tahvo.ko 2024-05-30T06:28:32.777 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ 2024-05-30T06:28:32.777 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/aircable.ko 2024-05-30T06:28:32.777 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ark3116.ko 2024-05-30T06:28:32.777 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-30T06:28:32.777 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ch341.ko 2024-05-30T06:28:32.777 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cp210x.ko 2024-05-30T06:28:32.777 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cyberjack.ko 2024-05-30T06:28:32.778 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-30T06:28:32.778 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 58321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-30T06:28:32.778 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/empeg.ko 2024-05-30T06:28:32.778 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/f81232.ko 2024-05-30T06:28:32.778 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 188601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-30T06:28:32.778 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-30T06:28:32.778 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 152297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-30T06:28:32.778 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 142825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/io_ti.ko 2024-05-30T06:28:32.778 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 69209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipaq.ko 2024-05-30T06:28:32.778 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ipw.ko 2024-05-30T06:28:32.778 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ir-usb.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 122321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mct_u232.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/metro-usb.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 79673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7720.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 89961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mos7840.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/mxuport.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/navman.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/omninet.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/opticon.ko 2024-05-30T06:28:32.779 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 197201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/option.ko 2024-05-30T06:28:32.793 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/oti6858.ko 2024-05-30T06:28:32.794 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/pl2303.ko 2024-05-30T06:28:32.794 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcaux.ko 2024-05-30T06:28:32.794 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/qcserial.ko 2024-05-30T06:28:32.794 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/quatech2.ko 2024-05-30T06:28:32.794 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/safe_serial.ko 2024-05-30T06:28:32.794 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/sierra.ko 2024-05-30T06:28:32.794 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-30T06:28:32.794 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ssu100.ko 2024-05-30T06:28:32.794 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/symbolserial.ko 2024-05-30T06:28:32.794 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-30T06:28:32.794 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-30T06:28:32.794 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_debug.ko 2024-05-30T06:28:32.795 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-30T06:28:32.795 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 151121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/usbserial.ko 2024-05-30T06:28:32.795 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/visor.ko 2024-05-30T06:28:32.795 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/whiteheat.ko 2024-05-30T06:28:32.795 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/wishbone-serial.ko 2024-05-30T06:28:32.795 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-30T06:28:32.795 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ 2024-05-30T06:28:32.795 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 64041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/uas.ko 2024-05-30T06:28:32.795 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-30T06:28:32.795 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-30T06:28:32.795 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-30T06:28:32.795 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-30T06:28:32.795 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-karma.ko 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 201145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/storage/usb-storage.ko 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/ 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 76025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 122233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-30T06:28:32.796 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/ 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/ 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 206897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 134241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio.ko 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 93665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/ 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 138641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost.ko 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 71273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_net.ko 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 107897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/vhost/vhost_scsi.ko 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/ 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/ 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-05-30T06:28:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/aat2870_bl.ko 2024-05-30T06:28:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp5520_bl.ko 2024-05-30T06:28:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8860_bl.ko 2024-05-30T06:28:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/adp8870_bl.ko 2024-05-30T06:28:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/apple_bl.ko 2024-05-30T06:28:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/as3711_bl.ko 2024-05-30T06:28:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/bd6107.ko 2024-05-30T06:28:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da903x_bl.ko 2024-05-30T06:28:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/da9052_bl.ko 2024-05-30T06:28:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/gpio_backlight.ko 2024-05-30T06:28:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/kb3886_bl.ko 2024-05-30T06:28:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lcd.ko 2024-05-30T06:28:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3533_bl.ko 2024-05-30T06:28:32.798 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lm3639_bl.ko 2024-05-30T06:28:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/lv5207lp.ko 2024-05-30T06:28:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/max8925_bl.ko 2024-05-30T06:28:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pandora_bl.ko 2024-05-30T06:28:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-05-30T06:28:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-30T06:28:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/video/backlight/wm831x_bl.ko 2024-05-30T06:28:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/ 2024-05-30T06:28:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ 2024-05-30T06:28:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2482.ko 2024-05-30T06:28:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/ds2490.ko 2024-05-30T06:28:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/matrox_w1.ko 2024-05-30T06:28:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/masters/w1-gpio.ko 2024-05-30T06:28:32.799 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/ 2024-05-30T06:28:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-30T06:28:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-30T06:28:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-30T06:28:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-30T06:28:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-30T06:28:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-30T06:28:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-30T06:28:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-30T06:28:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-30T06:28:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-30T06:28:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-30T06:28:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 129409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/w1/wire.ko 2024-05-30T06:28:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ 2024-05-30T06:28:32.801 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/acquirewdt.ko 2024-05-30T06:28:32.801 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/advantechwdt.ko 2024-05-30T06:28:32.801 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-30T06:28:32.801 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-30T06:28:32.801 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/cpu5wdt.ko 2024-05-30T06:28:32.801 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9052_wdt.ko 2024-05-30T06:28:32.801 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9055_wdt.ko 2024-05-30T06:28:32.801 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/da9063_wdt.ko 2024-05-30T06:28:32.801 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/dw_wdt.ko 2024-05-30T06:28:32.801 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/eurotechwdt.ko 2024-05-30T06:28:32.801 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-30T06:28:32.801 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/hpwdt.ko 2024-05-30T06:28:32.801 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/i6300esb.ko 2024-05-30T06:28:32.802 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-30T06:28:32.802 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-30T06:28:32.802 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ib700wdt.ko 2024-05-30T06:28:32.802 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ibmasr.ko 2024-05-30T06:28:32.802 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-30T06:28:32.802 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-30T06:28:32.802 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/it87_wdt.ko 2024-05-30T06:28:32.802 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/kempld_wdt.ko 2024-05-30T06:28:32.802 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/machzwd.ko 2024-05-30T06:28:32.802 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/mena21_wdt.ko 2024-05-30T06:28:32.802 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-05-30T06:28:32.802 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/nv_tco.ko 2024-05-30T06:28:32.802 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pc87413_wdt.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/retu_wdt.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sc1200wdt.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/softdog.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/twl4030_wdt.ko 2024-05-30T06:28:32.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/via_wdt.ko 2024-05-30T06:28:32.804 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-30T06:28:32.804 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-30T06:28:32.804 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-30T06:28:32.804 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wafer5823wdt.ko 2024-05-30T06:28:32.804 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wdt_pci.ko 2024-05-30T06:28:32.804 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm831x_wdt.ko 2024-05-30T06:28:32.804 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/wm8350_wdt.ko 2024-05-30T06:28:32.804 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/watchdog/xen_wdt.ko 2024-05-30T06:28:32.804 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/ 2024-05-30T06:28:32.804 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-evtchn.ko 2024-05-30T06:28:32.804 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntalloc.ko 2024-05-30T06:28:32.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-gntdev.ko 2024-05-30T06:28:32.805 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/ 2024-05-30T06:28:32.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 213865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-30T06:28:32.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-privcmd.ko 2024-05-30T06:28:32.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xen-scsiback.ko 2024-05-30T06:28:32.805 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/ 2024-05-30T06:28:32.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23417 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-30T06:28:32.805 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ 2024-05-30T06:28:32.805 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/ 2024-05-30T06:28:32.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 194449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/9p/9p.ko 2024-05-30T06:28:32.805 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/ 2024-05-30T06:28:32.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/adfs/adfs.ko 2024-05-30T06:28:32.805 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/ 2024-05-30T06:28:32.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 197801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/affs/affs.ko 2024-05-30T06:28:32.806 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/ 2024-05-30T06:28:32.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1260937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/afs/kafs.ko 2024-05-30T06:28:32.806 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/ 2024-05-30T06:28:32.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 127337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/autofs/autofs4.ko 2024-05-30T06:28:32.806 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/ 2024-05-30T06:28:32.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 80481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/befs/befs.ko 2024-05-30T06:28:32.806 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/ 2024-05-30T06:28:32.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/bfs/bfs.ko 2024-05-30T06:28:32.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/binfmt_misc.ko 2024-05-30T06:28:32.806 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/ 2024-05-30T06:28:32.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 4491713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/btrfs/btrfs.ko 2024-05-30T06:28:32.806 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/ 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 376801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cachefiles/cachefiles.ko 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1586617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ceph/ceph.ko 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/ 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 130017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/coda/coda.ko 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/ 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 139049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/configfs/configfs.ko 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/ 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/cramfs/cramfs.ko 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/ 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 813137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/dlm/dlm.ko 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/ 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/efs/efs.ko 2024-05-30T06:28:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/ 2024-05-30T06:28:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1906713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/f2fs/f2fs.ko 2024-05-30T06:28:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/ 2024-05-30T06:28:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fat/msdos.ko 2024-05-30T06:28:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/ 2024-05-30T06:28:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/freevxfs/freevxfs.ko 2024-05-30T06:28:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/ 2024-05-30T06:28:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/fuse/cuse.ko 2024-05-30T06:28:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/ 2024-05-30T06:28:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1486393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/gfs2/gfs2.ko 2024-05-30T06:28:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/ 2024-05-30T06:28:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 183217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfs/hfs.ko 2024-05-30T06:28:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/ 2024-05-30T06:28:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 281993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hfsplus/hfsplus.ko 2024-05-30T06:28:32.809 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/ 2024-05-30T06:28:32.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 248945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/hpfs/hpfs.ko 2024-05-30T06:28:32.809 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/ 2024-05-30T06:28:32.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 92985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/isofs/isofs.ko 2024-05-30T06:28:32.809 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/ 2024-05-30T06:28:32.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 532953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/jfs/jfs.ko 2024-05-30T06:28:32.809 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/ 2024-05-30T06:28:32.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 361281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/lockd/lockd.ko 2024-05-30T06:28:32.809 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/ 2024-05-30T06:28:32.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 112569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/minix/minix.ko 2024-05-30T06:28:32.809 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/ 2024-05-30T06:28:32.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 591625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/netfs/netfs.ko 2024-05-30T06:28:32.810 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/ 2024-05-30T06:28:32.810 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/ 2024-05-30T06:28:32.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 102537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-30T06:28:32.810 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/ 2024-05-30T06:28:32.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 74337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-30T06:28:32.810 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/ 2024-05-30T06:28:32.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 147673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-30T06:28:32.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1320377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfs.ko 2024-05-30T06:28:32.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 82089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv2.ko 2024-05-30T06:28:32.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 151617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv3.ko 2024-05-30T06:28:32.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 2518385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs/nfsv4.ko 2024-05-30T06:28:32.815 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/ 2024-05-30T06:28:32.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/grace.ko 2024-05-30T06:28:32.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfs_common/nfs_acl.ko 2024-05-30T06:28:32.815 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/ 2024-05-30T06:28:32.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 2021969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nfsd/nfsd.ko 2024-05-30T06:28:32.815 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/ 2024-05-30T06:28:32.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 733969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nilfs2/nilfs2.ko 2024-05-30T06:28:32.816 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/ 2024-05-30T06:28:32.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-celtic.ko 2024-05-30T06:28:32.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-centeuro.ko 2024-05-30T06:28:32.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-croatian.ko 2024-05-30T06:28:32.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-cyrillic.ko 2024-05-30T06:28:32.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-gaelic.ko 2024-05-30T06:28:32.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-greek.ko 2024-05-30T06:28:32.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-iceland.ko 2024-05-30T06:28:32.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-inuit.ko 2024-05-30T06:28:32.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-roman.ko 2024-05-30T06:28:32.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-romanian.ko 2024-05-30T06:28:32.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/mac-turkish.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ascii.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1250.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1251.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp1255.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp737.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp775.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp850.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp852.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp855.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp857.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp860.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp861.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp862.ko 2024-05-30T06:28:32.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp863.ko 2024-05-30T06:28:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp864.ko 2024-05-30T06:28:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp865.ko 2024-05-30T06:28:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp866.ko 2024-05-30T06:28:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp869.ko 2024-05-30T06:28:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp874.ko 2024-05-30T06:28:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 95617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp932.ko 2024-05-30T06:28:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 144201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp936.ko 2024-05-30T06:28:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 167129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp949.ko 2024-05-30T06:28:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 119505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_cp950.ko 2024-05-30T06:28:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_euc-jp.ko 2024-05-30T06:28:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-1.ko 2024-05-30T06:28:32.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-13.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-14.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-15.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-2.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-3.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-4.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-5.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-6.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-7.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_iso8859-9.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-r.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-ru.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_koi8-u.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-30T06:28:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/nls/nls_utf8.ko 2024-05-30T06:28:32.820 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ 2024-05-30T06:28:32.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 634457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ntfs3/ntfs3.ko 2024-05-30T06:28:32.820 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ 2024-05-30T06:28:32.820 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ 2024-05-30T06:28:32.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 302033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-30T06:28:32.820 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ 2024-05-30T06:28:32.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 548057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-30T06:28:32.820 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ 2024-05-30T06:28:32.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-30T06:28:32.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 3245449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2.ko 2024-05-30T06:28:32.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-30T06:28:32.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/ 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 67465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/omfs/omfs.ko 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/ 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 462817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/overlayfs/overlay.ko 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 67961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/pstore/ramoops.ko 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/ 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx4/qnx4.ko 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/ 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 56073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/qnx6/qnx6.ko 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/ 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_tree.ko 2024-05-30T06:28:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v1.ko 2024-05-30T06:28:32.822 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/quota/quota_v2.ko 2024-05-30T06:28:32.822 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/ 2024-05-30T06:28:32.822 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 684713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/reiserfs/reiserfs.ko 2024-05-30T06:28:32.823 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/ 2024-05-30T06:28:32.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/romfs/romfs.ko 2024-05-30T06:28:32.823 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/ 2024-05-30T06:28:32.823 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/ 2024-05-30T06:28:32.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 3350841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/client/cifs.ko 2024-05-30T06:28:32.823 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/ 2024-05-30T06:28:32.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_arc4.ko 2024-05-30T06:28:32.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/smb/common/cifs_md4.ko 2024-05-30T06:28:32.823 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/ 2024-05-30T06:28:32.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 164145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/squashfs/squashfs.ko 2024-05-30T06:28:32.824 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/ 2024-05-30T06:28:32.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 115865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/sysv/sysv.ko 2024-05-30T06:28:32.824 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/ 2024-05-30T06:28:32.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 309937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/udf/udf.ko 2024-05-30T06:28:32.824 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ 2024-05-30T06:28:32.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 198185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/ufs/ufs.ko 2024-05-30T06:28:32.824 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/ 2024-05-30T06:28:32.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 5192193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/fs/xfs/xfs.ko 2024-05-30T06:28:32.832 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/ 2024-05-30T06:28:32.833 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/ 2024-05-30T06:28:32.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 97617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/locking/locktorture.ko 2024-05-30T06:28:32.833 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/ 2024-05-30T06:28:32.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/time/test_udelay.ko 2024-05-30T06:28:32.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 72657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/kernel/torture.ko 2024-05-30T06:28:32.833 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ 2024-05-30T06:28:32.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc-itu-t.ko 2024-05-30T06:28:32.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc7.ko 2024-05-30T06:28:32.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crc8.ko 2024-05-30T06:28:32.833 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/ 2024-05-30T06:28:32.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libarc4.ko 2024-05-30T06:28:32.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/crypto/libdes.ko 2024-05-30T06:28:32.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/interval_tree_test.ko 2024-05-30T06:28:32.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/libcrc32c.ko 2024-05-30T06:28:32.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lru_cache.ko 2024-05-30T06:28:32.834 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/ 2024-05-30T06:28:32.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4_compress.ko 2024-05-30T06:28:32.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/lz4/lz4hc_compress.ko 2024-05-30T06:28:32.834 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/ 2024-05-30T06:28:32.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/math/cordic.ko 2024-05-30T06:28:32.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/memory-notifier-error-inject.ko 2024-05-30T06:28:32.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/notifier-error-inject.ko 2024-05-30T06:28:32.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/percpu_test.ko 2024-05-30T06:28:32.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/pm-notifier-error-inject.ko 2024-05-30T06:28:32.834 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/ 2024-05-30T06:28:32.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 151945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/raid6/raid6_pq.ko 2024-05-30T06:28:32.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/rbtree_test.ko 2024-05-30T06:28:32.835 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/ 2024-05-30T06:28:32.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-30T06:28:32.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test-kstrtox.ko 2024-05-30T06:28:32.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 4912433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_bpf.ko 2024-05-30T06:28:32.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_firmware.ko 2024-05-30T06:28:32.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7113 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_module.ko 2024-05-30T06:28:32.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/test_user_copy.ko 2024-05-30T06:28:32.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_bm.ko 2024-05-30T06:28:32.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_fsm.ko 2024-05-30T06:28:32.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/ts_kmp.ko 2024-05-30T06:28:32.838 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/ 2024-05-30T06:28:32.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/lib/xz/xz_dec_test.ko 2024-05-30T06:28:32.838 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/ 2024-05-30T06:28:32.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/mm/hwpoison-inject.ko 2024-05-30T06:28:32.838 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ 2024-05-30T06:28:32.838 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/ 2024-05-30T06:28:32.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/6lowpan.ko 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_dest.ko 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_fragment.ko 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_hop.ko 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_mobility.ko 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_routing.ko 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/6lowpan/nhc_udp.ko 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/ 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/garp.ko 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/mrp.ko 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/p8022.ko 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/psnap.ko 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13529 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/802/stp.ko 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/ 2024-05-30T06:28:32.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 106697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/8021q/8021q.ko 2024-05-30T06:28:32.840 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/ 2024-05-30T06:28:32.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 236769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet.ko 2024-05-30T06:28:32.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_fd.ko 2024-05-30T06:28:32.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_rdma.ko 2024-05-30T06:28:32.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/9p/9pnet_virtio.ko 2024-05-30T06:28:32.840 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/ 2024-05-30T06:28:32.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 879593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/batman-adv/batman-adv.ko 2024-05-30T06:28:32.842 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/ 2024-05-30T06:28:32.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/br_netfilter.ko 2024-05-30T06:28:32.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1031177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/bridge.ko 2024-05-30T06:28:32.842 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ 2024-05-30T06:28:32.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-30T06:28:32.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-30T06:28:32.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-30T06:28:32.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-30T06:28:32.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-30T06:28:32.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-30T06:28:32.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10329 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-30T06:28:32.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-30T06:28:32.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-30T06:28:32.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-30T06:28:32.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-30T06:28:32.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9561 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-30T06:28:32.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-30T06:28:32.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-30T06:28:32.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-30T06:28:32.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-30T06:28:32.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-30T06:28:32.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-30T06:28:32.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-30T06:28:32.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-30T06:28:32.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/ebtables.ko 2024-05-30T06:28:32.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-30T06:28:32.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-30T06:28:32.844 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/ 2024-05-30T06:28:32.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1243369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ceph/libceph.ko 2024-05-30T06:28:32.846 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/ 2024-05-30T06:28:32.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 153793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/core/pktgen.ko 2024-05-30T06:28:32.846 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/ 2024-05-30T06:28:32.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 244825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp.ko 2024-05-30T06:28:32.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_diag.ko 2024-05-30T06:28:32.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 71025 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv4.ko 2024-05-30T06:28:32.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 74985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dccp/dccp_ipv6.ko 2024-05-30T06:28:32.846 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/ 2024-05-30T06:28:32.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 507649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/dsa_core.ko 2024-05-30T06:28:32.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_brcm.ko 2024-05-30T06:28:32.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_dsa.ko 2024-05-30T06:28:32.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_none.ko 2024-05-30T06:28:32.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/dsa/tag_trailer.ko 2024-05-30T06:28:32.847 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/ 2024-05-30T06:28:32.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 128577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/hsr/hsr.ko 2024-05-30T06:28:32.847 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ 2024-05-30T06:28:32.847 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ 2024-05-30T06:28:32.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-30T06:28:32.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 357369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154.ko 2024-05-30T06:28:32.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-30T06:28:32.847 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ 2024-05-30T06:28:32.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ah4.ko 2024-05-30T06:28:32.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/esp4.ko 2024-05-30T06:28:32.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/fou.ko 2024-05-30T06:28:32.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/gre.ko 2024-05-30T06:28:32.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/inet_diag.ko 2024-05-30T06:28:32.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 75481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_gre.ko 2024-05-30T06:28:32.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 77713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_tunnel.ko 2024-05-30T06:28:32.858 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ip_vti.ko 2024-05-30T06:28:32.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipcomp.ko 2024-05-30T06:28:32.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/ipip.ko 2024-05-30T06:28:32.859 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ 2024-05-30T06:28:32.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-30T06:28:32.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-30T06:28:32.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-30T06:28:32.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50161 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ip_tables.ko 2024-05-30T06:28:32.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-30T06:28:32.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-05-30T06:28:32.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-30T06:28:32.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-30T06:28:32.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-30T06:28:32.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9697 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-30T06:28:32.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-30T06:28:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-30T06:28:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_bic.ko 2024-05-30T06:28:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_dctcp.ko 2024-05-30T06:28:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_diag.ko 2024-05-30T06:28:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_highspeed.ko 2024-05-30T06:28:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_htcp.ko 2024-05-30T06:28:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11657 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_hybla.ko 2024-05-30T06:28:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_illinois.ko 2024-05-30T06:28:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_lp.ko 2024-05-30T06:28:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_scalable.ko 2024-05-30T06:28:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_vegas.ko 2024-05-30T06:28:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_veno.ko 2024-05-30T06:28:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_westwood.ko 2024-05-30T06:28:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tcp_yeah.ko 2024-05-30T06:28:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/tunnel4.ko 2024-05-30T06:28:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_diag.ko 2024-05-30T06:28:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/udp_tunnel.ko 2024-05-30T06:28:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-30T06:28:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ 2024-05-30T06:28:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ah6.ko 2024-05-30T06:28:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/esp6.ko 2024-05-30T06:28:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17105 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/fou6.ko 2024-05-30T06:28:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 103169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_gre.ko 2024-05-30T06:28:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 118873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_tunnel.ko 2024-05-30T06:28:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-30T06:28:32.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 71081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ip6_vti.ko 2024-05-30T06:28:32.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/ipcomp6.ko 2024-05-30T06:28:32.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/mip6.ko 2024-05-30T06:28:32.863 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ 2024-05-30T06:28:32.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-30T06:28:32.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-05-30T06:28:32.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11521 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-30T06:28:32.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-30T06:28:32.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-30T06:28:32.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-30T06:28:32.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-30T06:28:32.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-30T06:28:32.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-30T06:28:32.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-30T06:28:32.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-30T06:28:32.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-30T06:28:32.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-30T06:28:32.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-30T06:28:32.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-30T06:28:32.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-30T06:28:32.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-30T06:28:32.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-30T06:28:32.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-30T06:28:32.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-30T06:28:32.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-30T06:28:32.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-30T06:28:32.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-30T06:28:32.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-30T06:28:32.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-30T06:28:32.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 94081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/sit.ko 2024-05-30T06:28:32.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/tunnel6.ko 2024-05-30T06:28:32.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-30T06:28:32.865 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/ 2024-05-30T06:28:32.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 106361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/key/af_key.ko 2024-05-30T06:28:32.865 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/ 2024-05-30T06:28:32.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 153209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_core.ko 2024-05-30T06:28:32.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-30T06:28:32.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_eth.ko 2024-05-30T06:28:32.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip.ko 2024-05-30T06:28:32.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ip6.ko 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_netlink.ko 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/l2tp/l2tp_ppp.ko 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/ 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 63321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/lapb/lapb.ko 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/ 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc.ko 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 332817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/llc/llc2.ko 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/ 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 388817 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mac802154/mac802154.ko 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/ 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/mpls/mpls_gso.ko 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ 2024-05-30T06:28:32.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 147729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set.ko 2024-05-30T06:28:32.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-30T06:28:32.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-30T06:28:32.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-30T06:28:32.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 124033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-30T06:28:32.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 124337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-30T06:28:32.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 126673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-30T06:28:32.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 126465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-30T06:28:32.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 137825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-30T06:28:32.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 72345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-30T06:28:32.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 133673 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-30T06:28:32.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 139065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-30T06:28:32.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 138257 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-30T06:28:32.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 136169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-30T06:28:32.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 139889 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-30T06:28:32.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-30T06:28:32.868 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ 2024-05-30T06:28:32.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 534033 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-30T06:28:32.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14193 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-30T06:28:32.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-30T06:28:32.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-30T06:28:32.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20945 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-30T06:28:32.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24569 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-30T06:28:32.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-30T06:28:32.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-30T06:28:32.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12641 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15969 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conncount.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 496713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 134361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24505 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-30T06:28:32.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 140793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-30T06:28:32.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-30T06:28:32.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-30T06:28:32.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 79865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-30T06:28:32.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12553 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-30T06:28:32.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-30T06:28:32.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-30T06:28:32.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 117385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table.ko 2024-05-30T06:28:32.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-30T06:28:32.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46097 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_log_syslog.ko 2024-05-30T06:28:32.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 118337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat.ko 2024-05-30T06:28:32.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-30T06:28:32.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14177 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-30T06:28:32.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13337 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_irc.ko 2024-05-30T06:28:32.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_sip.ko 2024-05-30T06:28:32.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-30T06:28:32.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-30T06:28:32.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 811705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nf_tables.ko 2024-05-30T06:28:32.884 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53041 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink.ko 2024-05-30T06:28:32.884 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-30T06:28:32.884 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-05-30T06:28:32.884 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_log.ko 2024-05-30T06:28:32.884 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-30T06:28:32.884 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-30T06:28:32.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_chain_nat.ko 2024-05-30T06:28:32.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_compat.ko 2024-05-30T06:28:32.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_ct.ko 2024-05-30T06:28:32.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-30T06:28:32.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fib.ko 2024-05-30T06:28:32.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-30T06:28:32.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_hash.ko 2024-05-30T06:28:32.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_limit.ko 2024-05-30T06:28:32.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17913 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_log.ko 2024-05-30T06:28:32.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_masq.ko 2024-05-30T06:28:32.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_nat.ko 2024-05-30T06:28:32.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16465 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_numgen.ko 2024-05-30T06:28:32.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13937 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_osf.ko 2024-05-30T06:28:32.886 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_queue.ko 2024-05-30T06:28:32.886 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_redir.ko 2024-05-30T06:28:32.886 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject.ko 2024-05-30T06:28:32.886 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_reject_inet.ko 2024-05-30T06:28:32.886 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15049 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_socket.ko 2024-05-30T06:28:32.886 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_synproxy.ko 2024-05-30T06:28:32.886 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/nft_tproxy.ko 2024-05-30T06:28:32.886 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 108385 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/x_tables.ko 2024-05-30T06:28:32.886 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_AUDIT.ko 2024-05-30T06:28:32.886 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-30T06:28:32.886 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-30T06:28:32.886 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-30T06:28:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_CT.ko 2024-05-30T06:28:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12281 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_DSCP.ko 2024-05-30T06:28:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11065 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HL.ko 2024-05-30T06:28:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15737 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_HMARK.ko 2024-05-30T06:28:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45209 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-30T06:28:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15929 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LED.ko 2024-05-30T06:28:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13009 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_LOG.ko 2024-05-30T06:28:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13369 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-30T06:28:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NETMAP.ko 2024-05-30T06:28:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10849 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFLOG.ko 2024-05-30T06:28:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15353 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-30T06:28:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_RATEEST.ko 2024-05-30T06:28:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-30T06:28:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16681 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_SECMARK.ko 2024-05-30T06:28:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18977 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-30T06:28:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11761 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-30T06:28:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20689 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TEE.ko 2024-05-30T06:28:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TPROXY.ko 2024-05-30T06:28:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_TRACE.ko 2024-05-30T06:28:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_addrtype.ko 2024-05-30T06:28:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16625 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_bpf.ko 2024-05-30T06:28:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cgroup.ko 2024-05-30T06:28:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cluster.ko 2024-05-30T06:28:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_comment.ko 2024-05-30T06:28:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11953 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connbytes.ko 2024-05-30T06:28:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlabel.ko 2024-05-30T06:28:32.889 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connlimit.ko 2024-05-30T06:28:32.889 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15833 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_connmark.ko 2024-05-30T06:28:32.889 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14201 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_conntrack.ko 2024-05-30T06:28:32.889 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_cpu.ko 2024-05-30T06:28:32.889 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dccp.ko 2024-05-30T06:28:32.889 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_devgroup.ko 2024-05-30T06:28:32.889 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_dscp.ko 2024-05-30T06:28:32.889 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12649 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ecn.ko 2024-05-30T06:28:32.889 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_esp.ko 2024-05-30T06:28:32.889 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hashlimit.ko 2024-05-30T06:28:32.889 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_helper.ko 2024-05-30T06:28:32.889 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_hl.ko 2024-05-30T06:28:32.889 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipcomp.ko 2024-05-30T06:28:32.890 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_iprange.ko 2024-05-30T06:28:32.890 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_ipvs.ko 2024-05-30T06:28:32.890 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19185 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_l2tp.ko 2024-05-30T06:28:32.890 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_length.ko 2024-05-30T06:28:32.890 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11513 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_limit.ko 2024-05-30T06:28:32.890 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mac.ko 2024-05-30T06:28:32.890 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_mark.ko 2024-05-30T06:28:32.890 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_multiport.ko 2024-05-30T06:28:32.890 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nat.ko 2024-05-30T06:28:32.890 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_nfacct.ko 2024-05-30T06:28:32.890 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_osf.ko 2024-05-30T06:28:32.890 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11489 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_owner.ko 2024-05-30T06:28:32.891 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_physdev.ko 2024-05-30T06:28:32.891 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_pkttype.ko 2024-05-30T06:28:32.891 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13545 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_policy.ko 2024-05-30T06:28:32.891 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_quota.ko 2024-05-30T06:28:32.891 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11873 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_rateest.ko 2024-05-30T06:28:32.891 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9265 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_realm.ko 2024-05-30T06:28:32.891 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_recent.ko 2024-05-30T06:28:32.891 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_sctp.ko 2024-05-30T06:28:32.891 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36481 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_set.ko 2024-05-30T06:28:32.891 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_socket.ko 2024-05-30T06:28:32.891 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_state.ko 2024-05-30T06:28:32.891 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10841 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_statistic.ko 2024-05-30T06:28:32.891 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10017 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_string.ko 2024-05-30T06:28:32.892 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpmss.ko 2024-05-30T06:28:32.892 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18441 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_tcpudp.ko 2024-05-30T06:28:32.892 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12433 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_time.ko 2024-05-30T06:28:32.892 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netfilter/xt_u32.ko 2024-05-30T06:28:32.892 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/ 2024-05-30T06:28:32.892 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/netlink/netlink_diag.ko 2024-05-30T06:28:32.892 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/ 2024-05-30T06:28:32.892 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/nsh/nsh.ko 2024-05-30T06:28:32.892 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/ 2024-05-30T06:28:32.892 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 488457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/openvswitch.ko 2024-05-30T06:28:32.892 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12001 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-geneve.ko 2024-05-30T06:28:32.892 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10865 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-gre.ko 2024-05-30T06:28:32.892 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/openvswitch/vport-vxlan.ko 2024-05-30T06:28:32.893 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/ 2024-05-30T06:28:32.893 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15921 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/packet/af_packet_diag.ko 2024-05-30T06:28:32.893 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/ 2024-05-30T06:28:32.893 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 141993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/phonet.ko 2024-05-30T06:28:32.893 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 68801 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/phonet/pn_pep.ko 2024-05-30T06:28:32.893 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/ 2024-05-30T06:28:32.893 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 318537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds.ko 2024-05-30T06:28:32.893 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 202249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_rdma.ko 2024-05-30T06:28:32.893 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85073 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rds/rds_tcp.ko 2024-05-30T06:28:32.893 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/ 2024-05-30T06:28:32.893 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1028129 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/rxrpc/rxrpc.ko 2024-05-30T06:28:32.893 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/ 2024-05-30T06:28:32.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38993 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_csum.ko 2024-05-30T06:28:32.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28713 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_gact.ko 2024-05-30T06:28:32.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45401 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_mirred.ko 2024-05-30T06:28:32.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27585 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_nat.ko 2024-05-30T06:28:32.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53457 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_pedit.ko 2024-05-30T06:28:32.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38633 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_police.ko 2024-05-30T06:28:32.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23961 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_simple.ko 2024-05-30T06:28:32.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43409 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_skbedit.ko 2024-05-30T06:28:32.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45665 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/act_vlan.ko 2024-05-30T06:28:32.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32121 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_basic.ko 2024-05-30T06:28:32.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41449 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_bpf.ko 2024-05-30T06:28:32.894 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23217 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_cgroup.ko 2024-05-30T06:28:32.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37297 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_flow.ko 2024-05-30T06:28:32.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39593 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_fw.ko 2024-05-30T06:28:32.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49313 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_route.ko 2024-05-30T06:28:32.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 79137 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/cls_u32.ko 2024-05-30T06:28:32.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8705 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_cmp.ko 2024-05-30T06:28:32.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15377 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_ipset.ko 2024-05-30T06:28:32.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_meta.ko 2024-05-30T06:28:32.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9233 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_nbyte.ko 2024-05-30T06:28:32.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13361 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_text.ko 2024-05-30T06:28:32.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8305 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/em_u32.ko 2024-05-30T06:28:32.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_choke.ko 2024-05-30T06:28:32.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25089 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_codel.ko 2024-05-30T06:28:32.895 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43473 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_drr.ko 2024-05-30T06:28:32.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq.ko 2024-05-30T06:28:32.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39169 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_fq_codel.ko 2024-05-30T06:28:32.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_gred.ko 2024-05-30T06:28:32.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 62809 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hfsc.ko 2024-05-30T06:28:32.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26577 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_hhf.ko 2024-05-30T06:28:32.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 81825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_htb.ko 2024-05-30T06:28:32.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33537 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_ingress.ko 2024-05-30T06:28:32.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36617 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio.ko 2024-05-30T06:28:32.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12289 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_mqprio_lib.ko 2024-05-30T06:28:32.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33057 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_multiq.ko 2024-05-30T06:28:32.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44785 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_netem.ko 2024-05-30T06:28:32.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32825 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_pie.ko 2024-05-30T06:28:32.896 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13497 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_plug.ko 2024-05-30T06:28:32.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_prio.ko 2024-05-30T06:28:32.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60241 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_qfq.ko 2024-05-30T06:28:32.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40881 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_red.ko 2024-05-30T06:28:32.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33425 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfb.ko 2024-05-30T06:28:32.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38321 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_sfq.ko 2024-05-30T06:28:32.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35769 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_tbf.ko 2024-05-30T06:28:32.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sched/sch_teql.ko 2024-05-30T06:28:32.897 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/ 2024-05-30T06:28:32.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1187153 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp.ko 2024-05-30T06:28:32.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23905 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sctp/sctp_diag.ko 2024-05-30T06:28:32.897 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/ 2024-05-30T06:28:32.897 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/ 2024-05-30T06:28:32.897 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 432225 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-30T06:28:32.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70081 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-30T06:28:32.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1940753 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/sunrpc.ko 2024-05-30T06:28:32.898 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/ 2024-05-30T06:28:32.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 889729 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-30T06:28:32.898 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/ 2024-05-30T06:28:32.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1122273 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc.ko 2024-05-30T06:28:32.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12145 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/tipc/tipc_diag.ko 2024-05-30T06:28:32.898 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/ 2024-05-30T06:28:32.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18793 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/unix/unix_diag.ko 2024-05-30T06:28:32.898 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/ 2024-05-30T06:28:32.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 105601 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-30T06:28:32.898 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 90249 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-30T06:28:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 123745 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock.ko 2024-05-30T06:28:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12897 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-30T06:28:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20393 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-30T06:28:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/ 2024-05-30T06:28:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 165777 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/x25/x25.ko 2024-05-30T06:28:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/ 2024-05-30T06:28:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26721 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_algo.ko 2024-05-30T06:28:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23345 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-30T06:28:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 131857 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/kernel/net/xfrm/xfrm_user.ko 2024-05-30T06:28:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 646387 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias 2024-05-30T06:28:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 630543 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.alias.bin 2024-05-30T06:28:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7706 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin 2024-05-30T06:28:32.899 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23609 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.alias.bin 2024-05-30T06:28:32.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9941 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.bin 2024-05-30T06:28:32.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70990 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.builtin.modinfo 2024-05-30T06:28:32.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 146985 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep 2024-05-30T06:28:32.900 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 232892 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.dep.bin 2024-05-30T06:28:32.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 210 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.devname 2024-05-30T06:28:32.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 72627 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.order 2024-05-30T06:28:32.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 879 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.softdep 2024-05-30T06:28:32.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 258450 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols 2024-05-30T06:28:32.901 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 313019 2024-05-23 11:07 ./lib/modules/6.9.0-gb9459a26b088/modules.symbols.bin 2024-05-30T06:28:32.901 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/ 2024-05-30T06:28:32.902 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/ 2024-05-30T06:28:32.902 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/ 2024-05-30T06:28:32.902 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/ 2024-05-30T06:28:32.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 171 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/changelog.Debian.gz 2024-05-30T06:28:32.902 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 691 2024-05-23 11:07 ./usr/share/doc/linux-image-6.9.0-gb9459a26b088/copyright 2024-05-30T06:28:32.906 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-gb9459a26b088 2024-05-30T06:28:32.906 INFO:teuthology.task.kernel:searching for kernel 6.9.0-gb9459a26b088 2024-05-30T06:28:32.907 DEBUG:teuthology.orchestra.run.smithi037:> egrep '(submenu|menuentry.*6.9.0-gb9459a26b088).*{' /boot/grub/grub.cfg 2024-05-30T06:28:32.950 INFO:teuthology.orchestra.run.smithi037.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-30T06:28:32.950 INFO:teuthology.orchestra.run.smithi037.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-30T06:28:32.950 INFO:teuthology.orchestra.run.smithi037.stdout: menuentry 'Ubuntu, with Linux 6.9.0-gb9459a26b088 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-gb9459a26b088-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-30T06:28:32.951 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-05-30T06:28:32.951 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-gb9459a26b088 2024-05-30T06:28:32.951 DEBUG:teuthology.orchestra.run.smithi037:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-05-30T06:28:32.997 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi037.front.sepia.ceph.com to complete... 2024-05-30T06:28:33.439 INFO:teuthology.orchestra.run.smithi037.stderr:Sourcing file `/etc/default/grub' 2024-05-30T06:28:33.440 INFO:teuthology.orchestra.run.smithi037.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-30T06:28:33.447 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2024-05-30T06:28:33.704 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-6.9.0-gb9459a26b088 2024-05-30T06:28:33.711 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-6.9.0-gb9459a26b088 2024-05-30T06:28:33.994 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-30T06:28:34.000 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-30T06:28:34.045 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-30T06:28:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-30T06:28:34.175 INFO:teuthology.orchestra.run.smithi037.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-30T06:28:34.175 INFO:teuthology.orchestra.run.smithi037.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-30T06:28:34.175 INFO:teuthology.orchestra.run.smithi037.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-30T06:28:34.188 INFO:teuthology.orchestra.run.smithi037.stderr:done 2024-05-30T06:29:02.671 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-30T06:29:02.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-05-30T06:29:02.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T06:29:05.320 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-30T06:29:05.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-30T06:29:05.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T06:29:37.183 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-05-30T06:29:46.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-05-30T06:29:46.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T06:30:04.574 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-05-30T06:30:05.324 DEBUG:teuthology.orchestra.remote:timed out 2024-05-30T06:30:14.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-30T06:30:14.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T06:30:14.580 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-05-30T06:30:15.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-30T06:30:15.175 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-gb9459a26b088"... 2024-05-30T06:30:15.175 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-05-30T06:30:15.224 INFO:teuthology.orchestra.run.smithi037.stdout:6.9.0-gb9459a26b088 2024-05-30T06:30:15.225 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-30T06:30:15.225 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-30T06:30:15.225 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-30T06:30:16.229 DEBUG:teuthology.parallel:result is None 2024-05-30T06:30:16.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-05-30T06:30:16.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T06:30:18.706 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-05-30T06:30:19.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-05-30T06:30:19.518 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-gb9459a26b088"... 2024-05-30T06:30:19.518 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2024-05-30T06:30:19.572 INFO:teuthology.orchestra.run.smithi105.stdout:6.9.0-gb9459a26b088 2024-05-30T06:30:19.572 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-gb9459a26b088 vs 6.9.0-gb9459a26b088 2024-05-30T06:30:19.572 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-30T06:30:19.572 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-30T06:30:20.573 DEBUG:teuthology.parallel:result is None 2024-05-30T06:30:20.573 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-30T06:30:20.581 INFO:teuthology.task.internal:Creating test directory... 2024-05-30T06:30:20.582 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-30T06:30:20.585 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-30T06:30:20.594 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-30T06:30:20.683 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-30T06:30:20.692 INFO:teuthology.task.internal:Creating archive directory... 2024-05-30T06:30:20.692 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-30T06:30:20.695 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-30T06:30:20.744 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-30T06:30:20.752 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-30T06:30:20.752 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-30T06:30:20.755 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-30T06:30:20.834 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-30T06:30:20.859 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-30T06:30:21.274 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-30T06:30:21.339 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-30T06:30:21.342 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-30T06:30:21.349 INFO:teuthology.task.internal:Configuring sudo... 2024-05-30T06:30:21.349 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-30T06:30:21.353 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-30T06:30:21.375 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-30T06:30:21.384 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-30T06:30:21.384 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-30T06:30:21.415 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-30T06:30:21.425 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-30T06:30:21.473 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-30T06:30:21.529 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:30:21.529 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-30T06:30:21.602 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-30T06:30:21.611 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-30T06:30:21.665 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:30:21.665 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-30T06:30:21.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-05-30T06:30:21.751 DEBUG:teuthology.orchestra.run.smithi105:> sudo service rsyslog restart 2024-05-30T06:30:21.936 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-30T06:30:21.948 INFO:teuthology.task.internal:Starting timer... 2024-05-30T06:30:21.948 INFO:teuthology.run_tasks:Running task pcp... 2024-05-30T06:30:21.965 INFO:teuthology.run_tasks:Running task selinux... 2024-05-30T06:30:21.977 DEBUG:teuthology.task.selinux:Excluding smithi037: OS 'ubuntu' does not support SELinux 2024-05-30T06:30:21.978 DEBUG:teuthology.task.selinux:Excluding smithi105: OS 'ubuntu' does not support SELinux 2024-05-30T06:30:21.978 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-30T06:30:21.978 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-30T06:30:21.978 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-30T06:30:21.979 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-30T06:30:21.992 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-30T06:30:22.003 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-30T06:30:22.004 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi105.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-30T06:38:07.387 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi105.front.sepia.ceph.com')] 2024-05-30T06:38:07.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-30T06:38:07.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T06:38:07.479 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-05-30T06:38:07.609 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-05-30T06:38:07.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-05-30T06:38:07.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-30T06:38:07.690 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-05-30T06:38:07.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-05-30T06:38:07.825 INFO:teuthology.run_tasks:Running task clock... 2024-05-30T06:38:07.836 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-30T06:38:07.836 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-30T06:38:07.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-30T06:38:07.840 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-30T06:38:07.840 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-30T06:38:07.877 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-30T06:38:07.878 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: Command line: ntpd -gq 2024-05-30T06:38:07.878 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: ---------------------------------------------------- 2024-05-30T06:38:07.878 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: ntp-4 is maintained by Network Time Foundation, 2024-05-30T06:38:07.878 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-30T06:38:07.878 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: corporation. Support and training for ntp-4 are 2024-05-30T06:38:07.878 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: available at https://www.nwtime.org/support 2024-05-30T06:38:07.878 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: ---------------------------------------------------- 2024-05-30T06:38:07.879 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: proto: precision = 0.045 usec (-24) 2024-05-30T06:38:07.879 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: basedate set to 2022-02-04 2024-05-30T06:38:07.879 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: gps base set to 2022-02-06 (week 2196) 2024-05-30T06:38:07.879 INFO:teuthology.orchestra.run.smithi037.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-30T06:38:07.880 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-30T06:38:07.880 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: restrict ::: KOD does nothing without LIMITED. 2024-05-30T06:38:07.880 INFO:teuthology.orchestra.run.smithi037.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-30T06:38:07.881 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: Listen and drop on 0 v6wildcard [::]:123 2024-05-30T06:38:07.881 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-30T06:38:07.881 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: Listen normally on 2 lo 127.0.0.1:123 2024-05-30T06:38:07.881 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: Listen normally on 3 ens1f0 172.21.15.37:123 2024-05-30T06:38:07.881 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: Listen normally on 4 lo [::1]:123 2024-05-30T06:38:07.881 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:fe88:7794%3]:123 2024-05-30T06:38:07.881 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:07 ntpd[17471]: Listening on routing socket on fd #22 for interface updates 2024-05-30T06:38:07.907 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-30T06:38:07.907 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: Command line: ntpd -gq 2024-05-30T06:38:07.907 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: ---------------------------------------------------- 2024-05-30T06:38:07.907 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: ntp-4 is maintained by Network Time Foundation, 2024-05-30T06:38:07.907 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-30T06:38:07.907 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: corporation. Support and training for ntp-4 are 2024-05-30T06:38:07.907 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: available at https://www.nwtime.org/support 2024-05-30T06:38:07.907 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: ---------------------------------------------------- 2024-05-30T06:38:07.908 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: proto: precision = 0.042 usec (-24) 2024-05-30T06:38:07.908 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: basedate set to 2022-02-04 2024-05-30T06:38:07.908 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: gps base set to 2022-02-06 (week 2196) 2024-05-30T06:38:07.909 INFO:teuthology.orchestra.run.smithi105.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-30T06:38:07.909 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-30T06:38:07.909 INFO:teuthology.orchestra.run.smithi105.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-30T06:38:07.910 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: restrict ::: KOD does nothing without LIMITED. 2024-05-30T06:38:07.910 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: Listen and drop on 0 v6wildcard [::]:123 2024-05-30T06:38:07.910 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-30T06:38:07.910 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: Listen normally on 2 lo 127.0.0.1:123 2024-05-30T06:38:07.910 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: Listen normally on 3 enp3s0f1 172.21.15.105:123 2024-05-30T06:38:07.911 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: Listen normally on 4 lo [::1]:123 2024-05-30T06:38:07.911 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d429%5]:123 2024-05-30T06:38:07.911 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:07 ntpd[17582]: Listening on routing socket on fd #22 for interface updates 2024-05-30T06:38:08.879 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:08.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:08.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:08.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:08.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:08.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:08.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:08.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:08 ntpd[17471]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:08.908 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:08 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:08.908 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:08 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:08.908 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:08 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:08.908 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:08 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:08.908 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:08 ntpd[17582]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:08.908 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:08 ntpd[17582]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:10.879 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:10.879 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:10.879 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:10.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:10.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:10.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:10.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:10.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:10.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:10.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:10.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:10.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:10.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:10.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:10.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:10.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:10.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:10.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:10 ntpd[17471]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:10.908 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:10 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:10.908 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:10 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:10.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:10 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:10.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:10 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:10.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:10 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:10.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:10 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:10.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:10 ntpd[17582]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:10.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:10 ntpd[17582]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:10.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:10 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:10.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:10 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:10.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:10 ntpd[17582]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:10.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:10 ntpd[17582]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:12.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:12.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:12.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:12.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:12.881 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:12 ntpd[17471]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:12.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:12.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:12.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:12.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:12.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:12.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:12.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:12.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:12 ntpd[17582]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:14 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:14 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:14 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:14 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:14 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:14 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:14 ntpd[17471]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:14 ntpd[17471]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:14 ntpd[17471]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:14 ntpd[17471]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:14.880 INFO:teuthology.orchestra.run.smithi037.stdout:30 May 06:38:14 ntpd[17471]: ntpd: time slew -0.000647 s 2024-05-30T06:38:14.880 INFO:teuthology.orchestra.run.smithi037.stdout:ntpd: time slew -0.000647s 2024-05-30T06:38:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:14 ntpd[17471]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-30T06:38:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:30 May 06:38:14 ntpd[17471]: can't open /var/log/ntpstats/loopstats.20240530: Permission denied 2024-05-30T06:38:14.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:14.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:14.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:14.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:14.909 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:14.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:14.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:14.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:14.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:14.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:14.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:14.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:14.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:14.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:14.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-30T06:38:14.910 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: can't open /var/log/ntpstats/rawstats.20240530: Permission denied 2024-05-30T06:38:14.911 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-30T06:38:14.911 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: can't open /var/log/ntpstats/peerstats.20240530: Permission denied 2024-05-30T06:38:14.911 INFO:teuthology.orchestra.run.smithi105.stdout:30 May 06:38:14 ntpd[17582]: ntpd: time slew +0.001766 s 2024-05-30T06:38:14.911 INFO:teuthology.orchestra.run.smithi105.stdout:ntpd: time slew +0.001766s 2024-05-30T06:38:14.911 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-30T06:38:14.911 INFO:teuthology.orchestra.run.smithi105.stderr:30 May 06:38:14 ntpd[17582]: can't open /var/log/ntpstats/loopstats.20240530: Permission denied 2024-05-30T06:38:14.976 INFO:teuthology.orchestra.run.smithi037.stdout: remote refid st t when poll reach delay offset jitter 2024-05-30T06:38:14.976 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================== 2024-05-30T06:38:14.976 INFO:teuthology.orchestra.run.smithi037.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T06:38:14.976 INFO:teuthology.orchestra.run.smithi037.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T06:38:14.976 INFO:teuthology.orchestra.run.smithi037.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T06:38:14.976 INFO:teuthology.orchestra.run.smithi037.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T06:38:14.998 INFO:teuthology.orchestra.run.smithi105.stdout: remote refid st t when poll reach delay offset jitter 2024-05-30T06:38:14.999 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================== 2024-05-30T06:38:14.999 INFO:teuthology.orchestra.run.smithi105.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T06:38:14.999 INFO:teuthology.orchestra.run.smithi105.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T06:38:14.999 INFO:teuthology.orchestra.run.smithi105.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T06:38:14.999 INFO:teuthology.orchestra.run.smithi105.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-30T06:38:15.000 INFO:teuthology.run_tasks:Running task install... 2024-05-30T06:38:15.008 DEBUG:teuthology.task.install:project ceph 2024-05-30T06:38:15.008 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}} 2024-05-30T06:38:15.009 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'} 2024-05-30T06:38:15.009 INFO:teuthology.task.install:Using flavor: default 2024-05-30T06:38:15.014 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-30T06:38:15.014 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-30T06:38:15.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-key list | grep Ceph 2024-05-30T06:38:15.015 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-key list | grep Ceph 2024-05-30T06:38:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-30T06:38:15.143 INFO:teuthology.orchestra.run.smithi105.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-30T06:38:15.181 INFO:teuthology.orchestra.run.smithi037.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-30T06:38:15.181 INFO:teuthology.orchestra.run.smithi037.stdout:uid [ unknown] Ceph.com (release key) 2024-05-30T06:38:15.182 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-30T06:38:15.182 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-30T06:38:15.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T06:38:15.193 INFO:teuthology.orchestra.run.smithi105.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-30T06:38:15.193 INFO:teuthology.orchestra.run.smithi105.stdout:uid [ unknown] Ceph.com (release key) 2024-05-30T06:38:15.194 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-30T06:38:15.194 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-30T06:38:15.194 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T06:38:15.332 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default/ 2024-05-30T06:38:15.332 INFO:teuthology.task.install.deb:Package version is 19.0.0-3154-g9ed025fb-1jammy 2024-05-30T06:38:15.409 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default/ 2024-05-30T06:38:15.410 INFO:teuthology.task.install.deb:Package version is 19.0.0-3154-g9ed025fb-1jammy 2024-05-30T06:38:15.448 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:38:15.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-30T06:38:15.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get update 2024-05-30T06:38:15.589 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:38:15.589 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-30T06:38:15.608 DEBUG:teuthology.orchestra.run.smithi105:> sudo apt-get update 2024-05-30T06:38:15.676 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-30T06:38:15.686 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-30T06:38:15.688 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-30T06:38:15.707 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-30T06:38:15.717 INFO:teuthology.orchestra.run.smithi037.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy InRelease 2024-05-30T06:38:15.740 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-30T06:38:15.762 INFO:teuthology.orchestra.run.smithi037.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-30T06:38:15.785 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-05-30T06:38:15.797 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-30T06:38:15.807 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-30T06:38:15.819 INFO:teuthology.orchestra.run.smithi037.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-30T06:38:15.827 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-30T06:38:15.901 INFO:teuthology.orchestra.run.smithi105.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy InRelease 2024-05-30T06:38:15.909 INFO:teuthology.orchestra.run.smithi105.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-30T06:38:15.938 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-30T06:38:15.976 INFO:teuthology.orchestra.run.smithi105.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-30T06:38:16.013 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-30T06:38:16.096 INFO:teuthology.orchestra.run.smithi105.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,409 B] 2024-05-30T06:38:16.291 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 29.2 kB in 1s (50.4 kB/s) 2024-05-30T06:38:16.389 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 29.2 kB in 1s (52.2 kB/s) 2024-05-30T06:38:17.324 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2024-05-30T06:38:17.339 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3154-g9ed025fb-1jammy cephadm=19.0.0-3154-g9ed025fb-1jammy ceph-mds=19.0.0-3154-g9ed025fb-1jammy ceph-mgr=19.0.0-3154-g9ed025fb-1jammy ceph-common=19.0.0-3154-g9ed025fb-1jammy ceph-fuse=19.0.0-3154-g9ed025fb-1jammy ceph-test=19.0.0-3154-g9ed025fb-1jammy ceph-volume=19.0.0-3154-g9ed025fb-1jammy radosgw=19.0.0-3154-g9ed025fb-1jammy python3-rados=19.0.0-3154-g9ed025fb-1jammy python3-rgw=19.0.0-3154-g9ed025fb-1jammy python3-cephfs=19.0.0-3154-g9ed025fb-1jammy python3-rbd=19.0.0-3154-g9ed025fb-1jammy libcephfs2=19.0.0-3154-g9ed025fb-1jammy libcephfs-dev=19.0.0-3154-g9ed025fb-1jammy librados2=19.0.0-3154-g9ed025fb-1jammy librbd1=19.0.0-3154-g9ed025fb-1jammy rbd-fuse=19.0.0-3154-g9ed025fb-1jammy python3-cephfs=19.0.0-3154-g9ed025fb-1jammy cephfs-shell=19.0.0-3154-g9ed025fb-1jammy cephfs-top=19.0.0-3154-g9ed025fb-1jammy cephfs-mirror=19.0.0-3154-g9ed025fb-1jammy 2024-05-30T06:38:17.387 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2024-05-30T06:38:17.402 DEBUG:teuthology.orchestra.run.smithi105:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3154-g9ed025fb-1jammy cephadm=19.0.0-3154-g9ed025fb-1jammy ceph-mds=19.0.0-3154-g9ed025fb-1jammy ceph-mgr=19.0.0-3154-g9ed025fb-1jammy ceph-common=19.0.0-3154-g9ed025fb-1jammy ceph-fuse=19.0.0-3154-g9ed025fb-1jammy ceph-test=19.0.0-3154-g9ed025fb-1jammy ceph-volume=19.0.0-3154-g9ed025fb-1jammy radosgw=19.0.0-3154-g9ed025fb-1jammy python3-rados=19.0.0-3154-g9ed025fb-1jammy python3-rgw=19.0.0-3154-g9ed025fb-1jammy python3-cephfs=19.0.0-3154-g9ed025fb-1jammy python3-rbd=19.0.0-3154-g9ed025fb-1jammy libcephfs2=19.0.0-3154-g9ed025fb-1jammy libcephfs-dev=19.0.0-3154-g9ed025fb-1jammy librados2=19.0.0-3154-g9ed025fb-1jammy librbd1=19.0.0-3154-g9ed025fb-1jammy rbd-fuse=19.0.0-3154-g9ed025fb-1jammy python3-cephfs=19.0.0-3154-g9ed025fb-1jammy cephfs-shell=19.0.0-3154-g9ed025fb-1jammy cephfs-top=19.0.0-3154-g9ed025fb-1jammy cephfs-mirror=19.0.0-3154-g9ed025fb-1jammy 2024-05-30T06:38:17.419 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2024-05-30T06:38:17.478 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2024-05-30T06:38:17.605 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2024-05-30T06:38:17.605 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2024-05-30T06:38:17.653 INFO:teuthology.orchestra.run.smithi105.stdout:Building dependency tree... 2024-05-30T06:38:17.654 INFO:teuthology.orchestra.run.smithi105.stdout:Reading state information... 2024-05-30T06:38:17.795 INFO:teuthology.orchestra.run.smithi037.stdout:The following packages were automatically installed and are no longer required: 2024-05-30T06:38:17.795 INFO:teuthology.orchestra.run.smithi037.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-30T06:38:17.795 INFO:teuthology.orchestra.run.smithi037.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-30T06:38:17.795 INFO:teuthology.orchestra.run.smithi037.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-30T06:38:17.796 INFO:teuthology.orchestra.run.smithi037.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-30T06:38:17.796 INFO:teuthology.orchestra.run.smithi037.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-30T06:38:17.796 INFO:teuthology.orchestra.run.smithi037.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-30T06:38:17.796 INFO:teuthology.orchestra.run.smithi037.stdout:The following additional packages will be installed: 2024-05-30T06:38:17.796 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-30T06:38:17.797 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-30T06:38:17.797 INFO:teuthology.orchestra.run.smithi037.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-30T06:38:17.797 INFO:teuthology.orchestra.run.smithi037.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-30T06:38:17.799 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-30T06:38:17.799 INFO:teuthology.orchestra.run.smithi037.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-30T06:38:17.799 INFO:teuthology.orchestra.run.smithi037.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-30T06:38:17.799 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-30T06:38:17.799 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-30T06:38:17.799 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-30T06:38:17.799 INFO:teuthology.orchestra.run.smithi037.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-30T06:38:17.799 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-30T06:38:17.799 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-30T06:38:17.799 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-30T06:38:17.799 INFO:teuthology.orchestra.run.smithi037.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-30T06:38:17.800 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-30T06:38:17.800 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-30T06:38:17.800 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-30T06:38:17.800 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-30T06:38:17.800 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-30T06:38:17.800 INFO:teuthology.orchestra.run.smithi037.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-30T06:38:17.800 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-30T06:38:17.800 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-30T06:38:17.800 INFO:teuthology.orchestra.run.smithi037.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-30T06:38:17.800 INFO:teuthology.orchestra.run.smithi037.stdout:Suggested packages: 2024-05-30T06:38:17.801 INFO:teuthology.orchestra.run.smithi037.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-30T06:38:17.801 INFO:teuthology.orchestra.run.smithi037.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-30T06:38:17.801 INFO:teuthology.orchestra.run.smithi037.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-30T06:38:17.801 INFO:teuthology.orchestra.run.smithi037.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-30T06:38:17.801 INFO:teuthology.orchestra.run.smithi037.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-30T06:38:17.801 INFO:teuthology.orchestra.run.smithi037.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-30T06:38:17.801 INFO:teuthology.orchestra.run.smithi037.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-30T06:38:17.801 INFO:teuthology.orchestra.run.smithi037.stdout:Recommended packages: 2024-05-30T06:38:17.801 INFO:teuthology.orchestra.run.smithi037.stdout: btrfs-tools 2024-05-30T06:38:17.830 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages were automatically installed and are no longer required: 2024-05-30T06:38:17.830 INFO:teuthology.orchestra.run.smithi105.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-30T06:38:17.830 INFO:teuthology.orchestra.run.smithi105.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-30T06:38:17.830 INFO:teuthology.orchestra.run.smithi105.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-30T06:38:17.831 INFO:teuthology.orchestra.run.smithi105.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-30T06:38:17.831 INFO:teuthology.orchestra.run.smithi105.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-30T06:38:17.831 INFO:teuthology.orchestra.run.smithi105.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-30T06:38:17.832 INFO:teuthology.orchestra.run.smithi105.stdout:The following additional packages will be installed: 2024-05-30T06:38:17.832 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-30T06:38:17.832 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-30T06:38:17.832 INFO:teuthology.orchestra.run.smithi105.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-30T06:38:17.832 INFO:teuthology.orchestra.run.smithi105.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-30T06:38:17.833 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-30T06:38:17.834 INFO:teuthology.orchestra.run.smithi105.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-30T06:38:17.834 INFO:teuthology.orchestra.run.smithi105.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-30T06:38:17.834 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-30T06:38:17.834 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-30T06:38:17.834 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-30T06:38:17.834 INFO:teuthology.orchestra.run.smithi105.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-30T06:38:17.834 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-30T06:38:17.834 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-30T06:38:17.834 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-30T06:38:17.834 INFO:teuthology.orchestra.run.smithi105.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-30T06:38:17.834 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-30T06:38:17.834 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-30T06:38:17.835 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-30T06:38:17.835 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-30T06:38:17.835 INFO:teuthology.orchestra.run.smithi105.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-30T06:38:17.835 INFO:teuthology.orchestra.run.smithi105.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-30T06:38:17.835 INFO:teuthology.orchestra.run.smithi105.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-30T06:38:17.835 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-30T06:38:17.835 INFO:teuthology.orchestra.run.smithi105.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-30T06:38:17.835 INFO:teuthology.orchestra.run.smithi105.stdout:Suggested packages: 2024-05-30T06:38:17.835 INFO:teuthology.orchestra.run.smithi105.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-30T06:38:17.836 INFO:teuthology.orchestra.run.smithi105.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-30T06:38:17.836 INFO:teuthology.orchestra.run.smithi105.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-30T06:38:17.836 INFO:teuthology.orchestra.run.smithi105.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-30T06:38:17.836 INFO:teuthology.orchestra.run.smithi105.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-30T06:38:17.836 INFO:teuthology.orchestra.run.smithi105.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-30T06:38:17.836 INFO:teuthology.orchestra.run.smithi105.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-30T06:38:17.836 INFO:teuthology.orchestra.run.smithi105.stdout:Recommended packages: 2024-05-30T06:38:17.836 INFO:teuthology.orchestra.run.smithi105.stdout: btrfs-tools 2024-05-30T06:38:17.961 INFO:teuthology.orchestra.run.smithi037.stdout:The following NEW packages will be installed: 2024-05-30T06:38:17.962 INFO:teuthology.orchestra.run.smithi037.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-30T06:38:17.962 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-30T06:38:17.962 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-30T06:38:17.962 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-30T06:38:17.964 INFO:teuthology.orchestra.run.smithi037.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-30T06:38:17.964 INFO:teuthology.orchestra.run.smithi037.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-30T06:38:17.964 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-30T06:38:17.964 INFO:teuthology.orchestra.run.smithi037.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-30T06:38:17.964 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-30T06:38:17.964 INFO:teuthology.orchestra.run.smithi037.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-30T06:38:17.964 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-30T06:38:17.964 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-30T06:38:17.965 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-30T06:38:17.965 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-30T06:38:17.965 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-30T06:38:17.965 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-30T06:38:17.965 INFO:teuthology.orchestra.run.smithi037.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-30T06:38:17.965 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-30T06:38:17.965 INFO:teuthology.orchestra.run.smithi037.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-30T06:38:17.965 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-30T06:38:17.965 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-30T06:38:17.965 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-30T06:38:17.965 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-30T06:38:17.965 INFO:teuthology.orchestra.run.smithi037.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-30T06:38:17.966 INFO:teuthology.orchestra.run.smithi037.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-30T06:38:17.966 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-30T06:38:17.966 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-30T06:38:17.966 INFO:teuthology.orchestra.run.smithi037.stdout: socat unzip xmlstarlet zip 2024-05-30T06:38:17.991 INFO:teuthology.orchestra.run.smithi105.stdout:The following NEW packages will be installed: 2024-05-30T06:38:17.991 INFO:teuthology.orchestra.run.smithi105.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-30T06:38:17.991 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-30T06:38:17.991 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-30T06:38:17.991 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-30T06:38:17.993 INFO:teuthology.orchestra.run.smithi105.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-30T06:38:17.993 INFO:teuthology.orchestra.run.smithi105.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-30T06:38:17.993 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-30T06:38:17.993 INFO:teuthology.orchestra.run.smithi105.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-30T06:38:17.993 INFO:teuthology.orchestra.run.smithi105.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-30T06:38:17.993 INFO:teuthology.orchestra.run.smithi105.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-30T06:38:17.993 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-30T06:38:17.994 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-30T06:38:17.994 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-30T06:38:17.994 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-30T06:38:17.994 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-30T06:38:17.994 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-30T06:38:17.994 INFO:teuthology.orchestra.run.smithi105.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-30T06:38:17.994 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-30T06:38:17.994 INFO:teuthology.orchestra.run.smithi105.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-30T06:38:17.994 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-30T06:38:17.994 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-30T06:38:17.994 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-30T06:38:17.994 INFO:teuthology.orchestra.run.smithi105.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-30T06:38:17.994 INFO:teuthology.orchestra.run.smithi105.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-30T06:38:17.995 INFO:teuthology.orchestra.run.smithi105.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-30T06:38:17.995 INFO:teuthology.orchestra.run.smithi105.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-30T06:38:17.995 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-30T06:38:17.995 INFO:teuthology.orchestra.run.smithi105.stdout: socat unzip xmlstarlet zip 2024-05-30T06:38:18.039 INFO:teuthology.orchestra.run.smithi037.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-30T06:38:18.039 INFO:teuthology.orchestra.run.smithi037.stdout:Need to get 182 MB of archives. 2024-05-30T06:38:18.039 INFO:teuthology.orchestra.run.smithi037.stdout:After this operation, 831 MB of additional disk space will be used. 2024-05-30T06:38:18.039 INFO:teuthology.orchestra.run.smithi037.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-30T06:38:18.061 INFO:teuthology.orchestra.run.smithi037.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-30T06:38:18.067 INFO:teuthology.orchestra.run.smithi105.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-30T06:38:18.067 INFO:teuthology.orchestra.run.smithi105.stdout:Need to get 182 MB of archives. 2024-05-30T06:38:18.068 INFO:teuthology.orchestra.run.smithi105.stdout:After this operation, 831 MB of additional disk space will be used. 2024-05-30T06:38:18.068 INFO:teuthology.orchestra.run.smithi105.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-30T06:38:18.072 INFO:teuthology.orchestra.run.smithi037.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-30T06:38:18.089 INFO:teuthology.orchestra.run.smithi105.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-30T06:38:18.100 INFO:teuthology.orchestra.run.smithi105.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-30T06:38:18.124 INFO:teuthology.orchestra.run.smithi037.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-30T06:38:18.150 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-30T06:38:18.153 INFO:teuthology.orchestra.run.smithi105.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-30T06:38:18.154 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-30T06:38:18.167 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-30T06:38:18.179 INFO:teuthology.orchestra.run.smithi105.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-30T06:38:18.182 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-30T06:38:18.194 INFO:teuthology.orchestra.run.smithi105.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3154-g9ed025fb-1jammy [3,555 kB] 2024-05-30T06:38:18.196 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-30T06:38:18.213 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-30T06:38:18.216 INFO:teuthology.orchestra.run.smithi037.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-30T06:38:18.225 INFO:teuthology.orchestra.run.smithi037.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-30T06:38:18.228 INFO:teuthology.orchestra.run.smithi037.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-30T06:38:18.228 INFO:teuthology.orchestra.run.smithi037.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-30T06:38:18.236 INFO:teuthology.orchestra.run.smithi037.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-30T06:38:18.238 INFO:teuthology.orchestra.run.smithi037.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-30T06:38:18.241 INFO:teuthology.orchestra.run.smithi037.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-30T06:38:18.242 INFO:teuthology.orchestra.run.smithi037.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-30T06:38:18.243 INFO:teuthology.orchestra.run.smithi037.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3154-g9ed025fb-1jammy [3,555 kB] 2024-05-30T06:38:18.245 INFO:teuthology.orchestra.run.smithi037.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-30T06:38:18.251 INFO:teuthology.orchestra.run.smithi105.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-30T06:38:18.253 INFO:teuthology.orchestra.run.smithi105.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-30T06:38:18.261 INFO:teuthology.orchestra.run.smithi105.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-30T06:38:18.264 INFO:teuthology.orchestra.run.smithi037.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-30T06:38:18.265 INFO:teuthology.orchestra.run.smithi105.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-30T06:38:18.266 INFO:teuthology.orchestra.run.smithi037.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-30T06:38:18.266 INFO:teuthology.orchestra.run.smithi105.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-30T06:38:18.267 INFO:teuthology.orchestra.run.smithi037.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-30T06:38:18.268 INFO:teuthology.orchestra.run.smithi037.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-30T06:38:18.268 INFO:teuthology.orchestra.run.smithi037.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-30T06:38:18.270 INFO:teuthology.orchestra.run.smithi037.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-30T06:38:18.270 INFO:teuthology.orchestra.run.smithi037.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-30T06:38:18.270 INFO:teuthology.orchestra.run.smithi037.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-30T06:38:18.271 INFO:teuthology.orchestra.run.smithi037.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-30T06:38:18.274 INFO:teuthology.orchestra.run.smithi105.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-30T06:38:18.276 INFO:teuthology.orchestra.run.smithi105.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-30T06:38:18.278 INFO:teuthology.orchestra.run.smithi105.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-30T06:38:18.279 INFO:teuthology.orchestra.run.smithi105.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-30T06:38:18.279 INFO:teuthology.orchestra.run.smithi105.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-30T06:38:18.289 INFO:teuthology.orchestra.run.smithi037.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-30T06:38:18.290 INFO:teuthology.orchestra.run.smithi037.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-30T06:38:18.298 INFO:teuthology.orchestra.run.smithi105.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-30T06:38:18.300 INFO:teuthology.orchestra.run.smithi105.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-30T06:38:18.301 INFO:teuthology.orchestra.run.smithi105.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-30T06:38:18.302 INFO:teuthology.orchestra.run.smithi105.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-30T06:38:18.302 INFO:teuthology.orchestra.run.smithi105.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-30T06:38:18.310 INFO:teuthology.orchestra.run.smithi037.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-30T06:38:18.312 INFO:teuthology.orchestra.run.smithi037.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-30T06:38:18.312 INFO:teuthology.orchestra.run.smithi037.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-30T06:38:18.313 INFO:teuthology.orchestra.run.smithi037.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-30T06:38:18.313 INFO:teuthology.orchestra.run.smithi037.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-30T06:38:18.314 INFO:teuthology.orchestra.run.smithi037.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-30T06:38:18.314 INFO:teuthology.orchestra.run.smithi037.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-30T06:38:18.315 INFO:teuthology.orchestra.run.smithi037.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-30T06:38:18.319 INFO:teuthology.orchestra.run.smithi105.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-30T06:38:18.319 INFO:teuthology.orchestra.run.smithi105.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-30T06:38:18.320 INFO:teuthology.orchestra.run.smithi105.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-30T06:38:18.320 INFO:teuthology.orchestra.run.smithi105.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-30T06:38:18.321 INFO:teuthology.orchestra.run.smithi105.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-30T06:38:18.330 INFO:teuthology.orchestra.run.smithi037.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-30T06:38:18.331 INFO:teuthology.orchestra.run.smithi037.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-30T06:38:18.340 INFO:teuthology.orchestra.run.smithi105.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-30T06:38:18.340 INFO:teuthology.orchestra.run.smithi105.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-30T06:38:18.342 INFO:teuthology.orchestra.run.smithi105.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-30T06:38:18.343 INFO:teuthology.orchestra.run.smithi105.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-30T06:38:18.343 INFO:teuthology.orchestra.run.smithi105.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-30T06:38:18.351 INFO:teuthology.orchestra.run.smithi037.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-30T06:38:18.357 INFO:teuthology.orchestra.run.smithi037.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-30T06:38:18.357 INFO:teuthology.orchestra.run.smithi037.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-30T06:38:18.357 INFO:teuthology.orchestra.run.smithi037.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-30T06:38:18.358 INFO:teuthology.orchestra.run.smithi037.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-30T06:38:18.359 INFO:teuthology.orchestra.run.smithi037.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-30T06:38:18.361 INFO:teuthology.orchestra.run.smithi037.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-05-30T06:38:18.361 INFO:teuthology.orchestra.run.smithi105.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-30T06:38:18.362 INFO:teuthology.orchestra.run.smithi037.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-30T06:38:18.362 INFO:teuthology.orchestra.run.smithi105.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-30T06:38:18.363 INFO:teuthology.orchestra.run.smithi105.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-30T06:38:18.363 INFO:teuthology.orchestra.run.smithi105.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-30T06:38:18.364 INFO:teuthology.orchestra.run.smithi105.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-30T06:38:18.368 INFO:teuthology.orchestra.run.smithi105.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3154-g9ed025fb-1jammy [3,224 kB] 2024-05-30T06:38:18.372 INFO:teuthology.orchestra.run.smithi037.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-30T06:38:18.372 INFO:teuthology.orchestra.run.smithi037.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-05-30T06:38:18.382 INFO:teuthology.orchestra.run.smithi105.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-30T06:38:18.382 INFO:teuthology.orchestra.run.smithi105.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-30T06:38:18.387 INFO:teuthology.orchestra.run.smithi105.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-30T06:38:18.387 INFO:teuthology.orchestra.run.smithi105.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-30T06:38:18.388 INFO:teuthology.orchestra.run.smithi105.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-30T06:38:18.392 INFO:teuthology.orchestra.run.smithi037.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-30T06:38:18.393 INFO:teuthology.orchestra.run.smithi037.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-30T06:38:18.394 INFO:teuthology.orchestra.run.smithi037.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-30T06:38:18.396 INFO:teuthology.orchestra.run.smithi037.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-30T06:38:18.412 INFO:teuthology.orchestra.run.smithi105.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-30T06:38:18.414 INFO:teuthology.orchestra.run.smithi105.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-30T06:38:18.417 INFO:teuthology.orchestra.run.smithi105.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-05-30T06:38:18.418 INFO:teuthology.orchestra.run.smithi105.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-30T06:38:18.419 INFO:teuthology.orchestra.run.smithi105.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-30T06:38:18.449 INFO:teuthology.orchestra.run.smithi037.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-30T06:38:18.450 INFO:teuthology.orchestra.run.smithi037.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-05-30T06:38:18.451 INFO:teuthology.orchestra.run.smithi105.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-05-30T06:38:18.451 INFO:teuthology.orchestra.run.smithi037.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-30T06:38:18.452 INFO:teuthology.orchestra.run.smithi037.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-30T06:38:18.453 INFO:teuthology.orchestra.run.smithi037.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-30T06:38:18.453 INFO:teuthology.orchestra.run.smithi105.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-30T06:38:18.454 INFO:teuthology.orchestra.run.smithi105.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-30T06:38:18.454 INFO:teuthology.orchestra.run.smithi105.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-30T06:38:18.456 INFO:teuthology.orchestra.run.smithi105.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3154-g9ed025fb-1jammy [712 kB] 2024-05-30T06:38:18.456 INFO:teuthology.orchestra.run.smithi105.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-30T06:38:18.467 INFO:teuthology.orchestra.run.smithi105.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3154-g9ed025fb-1jammy [356 kB] 2024-05-30T06:38:18.481 INFO:teuthology.orchestra.run.smithi105.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3154-g9ed025fb-1jammy [32.8 kB] 2024-05-30T06:38:18.482 INFO:teuthology.orchestra.run.smithi105.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3154-g9ed025fb-1jammy [180 kB] 2024-05-30T06:38:18.535 INFO:teuthology.orchestra.run.smithi105.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3154-g9ed025fb-1jammy [66.9 kB] 2024-05-30T06:38:18.537 INFO:teuthology.orchestra.run.smithi105.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3154-g9ed025fb-1jammy [330 kB] 2024-05-30T06:38:18.553 INFO:teuthology.orchestra.run.smithi037.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-30T06:38:18.555 INFO:teuthology.orchestra.run.smithi037.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-30T06:38:18.556 INFO:teuthology.orchestra.run.smithi037.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-30T06:38:18.560 INFO:teuthology.orchestra.run.smithi105.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3154-g9ed025fb-1jammy [6,895 kB] 2024-05-30T06:38:18.570 INFO:teuthology.orchestra.run.smithi105.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-30T06:38:18.571 INFO:teuthology.orchestra.run.smithi105.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-05-30T06:38:18.572 INFO:teuthology.orchestra.run.smithi105.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-30T06:38:18.573 INFO:teuthology.orchestra.run.smithi105.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-30T06:38:18.573 INFO:teuthology.orchestra.run.smithi037.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-30T06:38:18.573 INFO:teuthology.orchestra.run.smithi037.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-30T06:38:18.574 INFO:teuthology.orchestra.run.smithi105.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-30T06:38:18.574 INFO:teuthology.orchestra.run.smithi037.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-30T06:38:18.574 INFO:teuthology.orchestra.run.smithi037.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-30T06:38:18.575 INFO:teuthology.orchestra.run.smithi037.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-30T06:38:18.575 INFO:teuthology.orchestra.run.smithi037.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-30T06:38:18.578 INFO:teuthology.orchestra.run.smithi037.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-30T06:38:18.595 INFO:teuthology.orchestra.run.smithi105.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-30T06:38:18.597 INFO:teuthology.orchestra.run.smithi105.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-30T06:38:18.597 INFO:teuthology.orchestra.run.smithi105.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-30T06:38:18.602 INFO:teuthology.orchestra.run.smithi037.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-30T06:38:18.609 INFO:teuthology.orchestra.run.smithi037.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-30T06:38:18.614 INFO:teuthology.orchestra.run.smithi037.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-30T06:38:18.614 INFO:teuthology.orchestra.run.smithi037.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-30T06:38:18.614 INFO:teuthology.orchestra.run.smithi037.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-30T06:38:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-30T06:38:18.623 INFO:teuthology.orchestra.run.smithi105.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-30T06:38:18.624 INFO:teuthology.orchestra.run.smithi105.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-30T06:38:18.624 INFO:teuthology.orchestra.run.smithi037.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-30T06:38:18.624 INFO:teuthology.orchestra.run.smithi037.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-30T06:38:18.625 INFO:teuthology.orchestra.run.smithi037.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-30T06:38:18.627 INFO:teuthology.orchestra.run.smithi105.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-30T06:38:18.628 INFO:teuthology.orchestra.run.smithi105.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-30T06:38:18.628 INFO:teuthology.orchestra.run.smithi105.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-30T06:38:18.629 INFO:teuthology.orchestra.run.smithi105.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-30T06:38:18.635 INFO:teuthology.orchestra.run.smithi037.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-30T06:38:18.640 INFO:teuthology.orchestra.run.smithi037.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-30T06:38:18.640 INFO:teuthology.orchestra.run.smithi037.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-30T06:38:18.644 INFO:teuthology.orchestra.run.smithi037.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-30T06:38:18.648 INFO:teuthology.orchestra.run.smithi105.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-30T06:38:18.648 INFO:teuthology.orchestra.run.smithi105.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-30T06:38:18.652 INFO:teuthology.orchestra.run.smithi105.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-30T06:38:18.654 INFO:teuthology.orchestra.run.smithi105.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-30T06:38:18.655 INFO:teuthology.orchestra.run.smithi105.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-30T06:38:18.656 INFO:teuthology.orchestra.run.smithi105.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-30T06:38:18.658 INFO:teuthology.orchestra.run.smithi037.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-30T06:38:18.659 INFO:teuthology.orchestra.run.smithi037.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-30T06:38:18.659 INFO:teuthology.orchestra.run.smithi037.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-30T06:38:18.661 INFO:teuthology.orchestra.run.smithi037.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-30T06:38:18.661 INFO:teuthology.orchestra.run.smithi037.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-30T06:38:18.668 INFO:teuthology.orchestra.run.smithi105.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-30T06:38:18.669 INFO:teuthology.orchestra.run.smithi037.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-30T06:38:18.671 INFO:teuthology.orchestra.run.smithi105.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-30T06:38:18.672 INFO:teuthology.orchestra.run.smithi105.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-30T06:38:18.673 INFO:teuthology.orchestra.run.smithi105.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-30T06:38:18.678 INFO:teuthology.orchestra.run.smithi037.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-30T06:38:18.679 INFO:teuthology.orchestra.run.smithi037.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-30T06:38:18.681 INFO:teuthology.orchestra.run.smithi105.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3154-g9ed025fb-1jammy [112 kB] 2024-05-30T06:38:18.681 INFO:teuthology.orchestra.run.smithi037.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-30T06:38:18.682 INFO:teuthology.orchestra.run.smithi037.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-30T06:38:18.698 INFO:teuthology.orchestra.run.smithi105.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-30T06:38:18.699 INFO:teuthology.orchestra.run.smithi105.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3154-g9ed025fb-1jammy [466 kB] 2024-05-30T06:38:18.703 INFO:teuthology.orchestra.run.smithi105.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-30T06:38:18.704 INFO:teuthology.orchestra.run.smithi105.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-30T06:38:18.707 INFO:teuthology.orchestra.run.smithi105.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-30T06:38:18.707 INFO:teuthology.orchestra.run.smithi105.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-30T06:38:18.708 INFO:teuthology.orchestra.run.smithi105.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-30T06:38:18.719 INFO:teuthology.orchestra.run.smithi105.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-30T06:38:18.721 INFO:teuthology.orchestra.run.smithi105.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-30T06:38:18.722 INFO:teuthology.orchestra.run.smithi105.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-30T06:38:18.729 INFO:teuthology.orchestra.run.smithi105.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-30T06:38:18.736 INFO:teuthology.orchestra.run.smithi105.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3154-g9ed025fb-1jammy [25.8 MB] 2024-05-30T06:38:18.740 INFO:teuthology.orchestra.run.smithi105.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-30T06:38:18.740 INFO:teuthology.orchestra.run.smithi105.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-30T06:38:18.742 INFO:teuthology.orchestra.run.smithi105.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-30T06:38:18.743 INFO:teuthology.orchestra.run.smithi105.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-30T06:38:19.558 INFO:teuthology.orchestra.run.smithi105.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3154-g9ed025fb-1jammy [5,092 kB] 2024-05-30T06:38:19.689 INFO:teuthology.orchestra.run.smithi105.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3154-g9ed025fb-1jammy [247 kB] 2024-05-30T06:38:19.695 INFO:teuthology.orchestra.run.smithi105.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3154-g9ed025fb-1jammy [124 kB] 2024-05-30T06:38:19.713 INFO:teuthology.orchestra.run.smithi105.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3154-g9ed025fb-1jammy [1,527 kB] 2024-05-30T06:38:19.752 INFO:teuthology.orchestra.run.smithi105.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3154-g9ed025fb-1jammy [6,257 kB] 2024-05-30T06:38:19.928 INFO:teuthology.orchestra.run.smithi105.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3154-g9ed025fb-1jammy [22.8 MB] 2024-05-30T06:38:20.642 INFO:teuthology.orchestra.run.smithi105.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3154-g9ed025fb-1jammy [14.1 kB] 2024-05-30T06:38:20.652 INFO:teuthology.orchestra.run.smithi105.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3154-g9ed025fb-1jammy [870 kB] 2024-05-30T06:38:20.674 INFO:teuthology.orchestra.run.smithi105.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3154-g9ed025fb-1jammy [2,436 kB] 2024-05-30T06:38:20.754 INFO:teuthology.orchestra.run.smithi105.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3154-g9ed025fb-1jammy [791 kB] 2024-05-30T06:38:20.805 INFO:teuthology.orchestra.run.smithi105.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3154-g9ed025fb-1jammy [148 kB] 2024-05-30T06:38:20.842 INFO:teuthology.orchestra.run.smithi105.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3154-g9ed025fb-1jammy [2,297 kB] 2024-05-30T06:38:20.878 INFO:teuthology.orchestra.run.smithi105.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3154-g9ed025fb-1jammy [8,625 kB] 2024-05-30T06:38:20.879 INFO:teuthology.orchestra.run.smithi037.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3154-g9ed025fb-1jammy [3,224 kB] 2024-05-30T06:38:21.146 INFO:teuthology.orchestra.run.smithi105.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3154-g9ed025fb-1jammy [14.2 kB] 2024-05-30T06:38:21.148 INFO:teuthology.orchestra.run.smithi105.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3154-g9ed025fb-1jammy [51.6 MB] 2024-05-30T06:38:23.145 INFO:teuthology.orchestra.run.smithi105.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3154-g9ed025fb-1jammy [124 kB] 2024-05-30T06:38:23.145 INFO:teuthology.orchestra.run.smithi105.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3154-g9ed025fb-1jammy [232 kB] 2024-05-30T06:38:23.147 INFO:teuthology.orchestra.run.smithi105.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3154-g9ed025fb-1jammy [33.9 kB] 2024-05-30T06:38:23.148 INFO:teuthology.orchestra.run.smithi105.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3154-g9ed025fb-1jammy [23.4 kB] 2024-05-30T06:38:23.156 INFO:teuthology.orchestra.run.smithi105.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3154-g9ed025fb-1jammy [38.9 kB] 2024-05-30T06:38:23.157 INFO:teuthology.orchestra.run.smithi105.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3154-g9ed025fb-1jammy [13.6 MB] 2024-05-30T06:38:23.528 INFO:teuthology.orchestra.run.smithi105.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3154-g9ed025fb-1jammy [91.2 kB] 2024-05-30T06:38:23.695 INFO:teuthology.orchestra.run.smithi037.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3154-g9ed025fb-1jammy [712 kB] 2024-05-30T06:38:23.767 INFO:teuthology.orchestra.run.smithi037.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3154-g9ed025fb-1jammy [356 kB] 2024-05-30T06:38:23.771 INFO:teuthology.orchestra.run.smithi037.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3154-g9ed025fb-1jammy [32.8 kB] 2024-05-30T06:38:23.772 INFO:teuthology.orchestra.run.smithi037.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3154-g9ed025fb-1jammy [180 kB] 2024-05-30T06:38:23.774 INFO:teuthology.orchestra.run.smithi037.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3154-g9ed025fb-1jammy [66.9 kB] 2024-05-30T06:38:23.799 INFO:teuthology.orchestra.run.smithi037.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3154-g9ed025fb-1jammy [330 kB] 2024-05-30T06:38:23.803 INFO:teuthology.orchestra.run.smithi037.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3154-g9ed025fb-1jammy [6,895 kB] 2024-05-30T06:38:24.063 INFO:teuthology.orchestra.run.smithi037.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3154-g9ed025fb-1jammy [112 kB] 2024-05-30T06:38:24.064 INFO:teuthology.orchestra.run.smithi037.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3154-g9ed025fb-1jammy [466 kB] 2024-05-30T06:38:24.069 INFO:teuthology.orchestra.run.smithi037.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3154-g9ed025fb-1jammy [25.8 MB] 2024-05-30T06:38:24.177 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 182 MB in 6s (32.9 MB/s) 2024-05-30T06:38:24.369 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-30T06:38:24.435 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132924 files and directories currently installed.) 2024-05-30T06:38:24.438 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-30T06:38:24.485 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-30T06:38:24.863 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-30T06:38:24.876 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-30T06:38:24.921 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-30T06:38:24.953 INFO:teuthology.orchestra.run.smithi037.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3154-g9ed025fb-1jammy [5,092 kB] 2024-05-30T06:38:25.109 INFO:teuthology.orchestra.run.smithi037.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3154-g9ed025fb-1jammy [247 kB] 2024-05-30T06:38:25.113 INFO:teuthology.orchestra.run.smithi037.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3154-g9ed025fb-1jammy [124 kB] 2024-05-30T06:38:25.114 INFO:teuthology.orchestra.run.smithi037.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3154-g9ed025fb-1jammy [1,527 kB] 2024-05-30T06:38:25.175 INFO:teuthology.orchestra.run.smithi037.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3154-g9ed025fb-1jammy [6,257 kB] 2024-05-30T06:38:25.324 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cmd2. 2024-05-30T06:38:25.337 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-30T06:38:25.365 INFO:teuthology.orchestra.run.smithi037.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3154-g9ed025fb-1jammy [22.8 MB] 2024-05-30T06:38:25.382 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-30T06:38:25.794 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-30T06:38:25.807 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-30T06:38:25.927 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-30T06:38:26.085 INFO:teuthology.orchestra.run.smithi037.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3154-g9ed025fb-1jammy [14.1 kB] 2024-05-30T06:38:26.086 INFO:teuthology.orchestra.run.smithi037.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3154-g9ed025fb-1jammy [870 kB] 2024-05-30T06:38:26.103 INFO:teuthology.orchestra.run.smithi037.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3154-g9ed025fb-1jammy [2,436 kB] 2024-05-30T06:38:26.176 INFO:teuthology.orchestra.run.smithi037.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3154-g9ed025fb-1jammy [791 kB] 2024-05-30T06:38:26.201 INFO:teuthology.orchestra.run.smithi037.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3154-g9ed025fb-1jammy [148 kB] 2024-05-30T06:38:26.203 INFO:teuthology.orchestra.run.smithi037.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3154-g9ed025fb-1jammy [2,297 kB] 2024-05-30T06:38:26.274 INFO:teuthology.orchestra.run.smithi037.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3154-g9ed025fb-1jammy [8,625 kB] 2024-05-30T06:38:26.297 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-30T06:38:26.311 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-30T06:38:26.355 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-30T06:38:26.531 INFO:teuthology.orchestra.run.smithi037.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3154-g9ed025fb-1jammy [14.2 kB] 2024-05-30T06:38:26.531 INFO:teuthology.orchestra.run.smithi037.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3154-g9ed025fb-1jammy [51.6 MB] 2024-05-30T06:38:26.684 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-30T06:38:26.698 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-30T06:38:26.733 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-30T06:38:27.162 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-30T06:38:27.176 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-30T06:38:27.228 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T06:38:27.649 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-30T06:38:27.662 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-30T06:38:27.707 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T06:38:28.002 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-30T06:38:28.015 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-30T06:38:28.022 INFO:teuthology.orchestra.run.smithi037.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3154-g9ed025fb-1jammy [124 kB] 2024-05-30T06:38:28.024 INFO:teuthology.orchestra.run.smithi037.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3154-g9ed025fb-1jammy [232 kB] 2024-05-30T06:38:28.029 INFO:teuthology.orchestra.run.smithi037.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3154-g9ed025fb-1jammy [33.9 kB] 2024-05-30T06:38:28.030 INFO:teuthology.orchestra.run.smithi037.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3154-g9ed025fb-1jammy [23.4 kB] 2024-05-30T06:38:28.031 INFO:teuthology.orchestra.run.smithi037.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3154-g9ed025fb-1jammy [38.9 kB] 2024-05-30T06:38:28.031 INFO:teuthology.orchestra.run.smithi037.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3154-g9ed025fb-1jammy [13.6 MB] 2024-05-30T06:38:28.051 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T06:38:28.438 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-30T06:38:28.449 INFO:teuthology.orchestra.run.smithi037.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/rishabh-clone-stats/9ed025fbf4406fb54980a0647506b15895b6d863/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3154-g9ed025fb-1jammy [91.2 kB] 2024-05-30T06:38:28.452 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-30T06:38:28.496 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-30T06:38:28.816 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package librados2. 2024-05-30T06:38:28.830 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../010-librados2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:28.874 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librados2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:29.125 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 182 MB in 10s (17.3 MB/s) 2024-05-30T06:38:29.281 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-30T06:38:29.285 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package librbd1. 2024-05-30T06:38:29.299 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../011-librbd1_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:29.335 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librbd1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:29.349 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132924 files and directories currently installed.) 2024-05-30T06:38:29.352 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-30T06:38:29.397 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-30T06:38:29.667 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-30T06:38:29.680 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-30T06:38:29.722 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libcephfs2. 2024-05-30T06:38:29.725 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-30T06:38:29.735 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:29.780 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libcephfs2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:30.052 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cmd2. 2024-05-30T06:38:30.067 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-30T06:38:30.111 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-30T06:38:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rados. 2024-05-30T06:38:30.296 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:30.340 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rados (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:30.464 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-30T06:38:30.479 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-30T06:38:30.564 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-30T06:38:30.677 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-30T06:38:30.690 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:38:30.743 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-ceph-argparse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:30.884 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-30T06:38:30.900 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-30T06:38:30.934 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-30T06:38:31.013 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cephfs. 2024-05-30T06:38:31.026 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:31.079 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cephfs (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:31.270 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-30T06:38:31.286 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-30T06:38:31.329 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-30T06:38:31.499 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-30T06:38:31.513 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:38:31.565 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:31.782 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-30T06:38:31.797 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-30T06:38:31.849 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T06:38:31.960 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-prettytable. 2024-05-30T06:38:31.974 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-30T06:38:32.026 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-30T06:38:32.219 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-30T06:38:32.234 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-30T06:38:32.269 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T06:38:32.346 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rbd. 2024-05-30T06:38:32.360 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:32.412 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rbd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-30T06:38:32.645 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-30T06:38:32.688 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T06:38:32.766 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-30T06:38:32.780 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-30T06:38:32.823 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-30T06:38:33.041 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-30T06:38:33.057 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-30T06:38:33.100 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-30T06:38:33.135 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-30T06:38:33.149 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-30T06:38:33.193 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-30T06:38:33.386 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librados2. 2024-05-30T06:38:33.402 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../010-librados2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:33.436 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librados2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:33.471 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-30T06:38:33.485 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-30T06:38:33.521 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-30T06:38:33.847 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librbd1. 2024-05-30T06:38:33.849 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package lua5.1. 2024-05-30T06:38:33.862 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../011-librbd1_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:33.863 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-30T06:38:33.905 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librbd1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:33.940 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-30T06:38:34.302 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package lua-any. 2024-05-30T06:38:34.316 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-30T06:38:34.333 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libcephfs2. 2024-05-30T06:38:34.348 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:34.377 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-30T06:38:34.399 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libcephfs2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:34.669 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rados. 2024-05-30T06:38:34.672 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package zip. 2024-05-30T06:38:34.684 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:34.686 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-30T06:38:34.727 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rados (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:34.755 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking zip (3.0-12build2) ... 2024-05-30T06:38:35.005 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-30T06:38:35.020 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:38:35.055 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-ceph-argparse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:35.108 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package unzip. 2024-05-30T06:38:35.123 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-30T06:38:35.166 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-30T06:38:35.290 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cephfs. 2024-05-30T06:38:35.306 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:35.349 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cephfs (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:35.654 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package luarocks. 2024-05-30T06:38:35.668 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-30T06:38:35.720 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-30T06:38:35.860 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-30T06:38:35.876 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:38:35.919 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:36.145 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package librgw2. 2024-05-30T06:38:36.158 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../027-librgw2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:36.203 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking librgw2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:36.247 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-prettytable. 2024-05-30T06:38:36.263 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-30T06:38:36.313 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-30T06:38:36.641 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rbd. 2024-05-30T06:38:36.657 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:36.707 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rbd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:36.714 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rgw. 2024-05-30T06:38:36.727 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:36.772 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:37.083 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-30T06:38:37.097 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-30T06:38:37.127 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-30T06:38:37.142 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-30T06:38:37.143 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-30T06:38:37.194 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-30T06:38:37.478 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libradosstriper1. 2024-05-30T06:38:37.492 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:37.505 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-30T06:38:37.520 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-30T06:38:37.544 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libradosstriper1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:37.563 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-30T06:38:37.916 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-30T06:38:37.932 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-30T06:38:37.965 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-common. 2024-05-30T06:38:37.979 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:37.983 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-30T06:38:38.022 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:38.378 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package lua5.1. 2024-05-30T06:38:38.394 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-30T06:38:38.453 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-30T06:38:38.781 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package lua-any. 2024-05-30T06:38:38.797 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-30T06:38:38.839 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-30T06:38:39.100 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package zip. 2024-05-30T06:38:39.116 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-30T06:38:39.152 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking zip (3.0-12build2) ... 2024-05-30T06:38:39.153 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-base. 2024-05-30T06:38:39.168 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:39.220 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-base (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:39.455 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package unzip. 2024-05-30T06:38:39.471 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-30T06:38:39.513 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-30T06:38:39.791 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-30T06:38:39.804 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-30T06:38:39.849 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-30T06:38:39.892 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package luarocks. 2024-05-30T06:38:39.908 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-30T06:38:39.950 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-30T06:38:40.214 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cheroot. 2024-05-30T06:38:40.228 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-30T06:38:40.375 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librgw2. 2024-05-30T06:38:40.384 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-30T06:38:40.390 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../027-librgw2_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:40.433 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librgw2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:40.746 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-30T06:38:40.760 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-30T06:38:40.804 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-30T06:38:41.057 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-30T06:38:41.071 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-30T06:38:41.107 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-30T06:38:41.178 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rgw. 2024-05-30T06:38:41.193 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:41.468 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-30T06:38:41.482 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-30T06:38:41.535 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-30T06:38:41.564 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-30T06:38:41.580 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-30T06:38:41.622 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-30T06:38:41.863 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-tempora. 2024-05-30T06:38:41.876 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-30T06:38:41.921 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-30T06:38:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libradosstriper1. 2024-05-30T06:38:41.948 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:41.992 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libradosstriper1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:42.291 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-portend. 2024-05-30T06:38:42.304 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-30T06:38:42.357 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-30T06:38:42.503 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-common. 2024-05-30T06:38:42.519 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:42.561 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:42.718 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-30T06:38:42.732 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-30T06:38:42.778 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-30T06:38:43.171 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-30T06:38:43.185 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-30T06:38:43.238 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-30T06:38:43.666 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-natsort. 2024-05-30T06:38:43.680 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-30T06:38:43.733 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-30T06:38:43.733 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-base. 2024-05-30T06:38:43.751 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:43.801 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-base (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:44.111 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-logutils. 2024-05-30T06:38:44.124 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-30T06:38:44.178 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-30T06:38:44.330 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-30T06:38:44.344 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-30T06:38:44.379 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-30T06:38:44.564 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-30T06:38:44.578 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-30T06:38:44.622 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-30T06:38:44.699 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cheroot. 2024-05-30T06:38:44.714 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-30T06:38:44.757 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-30T06:38:44.925 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-mako. 2024-05-30T06:38:44.938 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-30T06:38:44.975 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-30T06:38:45.085 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-30T06:38:45.100 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-30T06:38:45.143 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-30T06:38:45.304 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-30T06:38:45.317 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-30T06:38:45.354 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-30T06:38:45.455 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-30T06:38:45.470 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-30T06:38:45.504 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-30T06:38:45.623 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-30T06:38:45.638 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-30T06:38:45.681 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-30T06:38:45.782 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-30T06:38:45.798 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-30T06:38:45.840 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-30T06:38:46.009 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-webob. 2024-05-30T06:38:46.022 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-30T06:38:46.100 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-30T06:38:46.127 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-tempora. 2024-05-30T06:38:46.142 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-30T06:38:46.185 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-30T06:38:46.446 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-portend. 2024-05-30T06:38:46.462 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-30T06:38:46.462 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-waitress. 2024-05-30T06:38:46.476 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-30T06:38:46.496 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-30T06:38:46.522 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-30T06:38:46.766 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-30T06:38:46.781 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-30T06:38:46.815 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-tempita. 2024-05-30T06:38:46.828 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-30T06:38:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-30T06:38:46.906 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-30T06:38:47.127 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-30T06:38:47.142 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-30T06:38:47.185 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-30T06:38:47.218 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-paste. 2024-05-30T06:38:47.231 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-30T06:38:47.276 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-30T06:38:47.530 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-natsort. 2024-05-30T06:38:47.546 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-30T06:38:47.589 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-30T06:38:47.596 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-30T06:38:47.609 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-30T06:38:47.654 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-30T06:38:47.886 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-logutils. 2024-05-30T06:38:47.899 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-30T06:38:47.967 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-30T06:38:47.973 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-30T06:38:47.987 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-30T06:38:48.032 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-30T06:38:48.261 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-30T06:38:48.277 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-30T06:38:48.320 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-30T06:38:48.326 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-webtest. 2024-05-30T06:38:48.340 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-30T06:38:48.376 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-30T06:38:48.589 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-mako. 2024-05-30T06:38:48.605 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-30T06:38:48.647 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-30T06:38:48.706 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pecan. 2024-05-30T06:38:48.720 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-30T06:38:48.764 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-30T06:38:48.967 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-30T06:38:48.983 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-30T06:38:49.084 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-30T06:38:49.144 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-certifi. 2024-05-30T06:38:49.158 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-30T06:38:49.202 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-30T06:38:49.387 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-30T06:38:49.402 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-30T06:38:49.445 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-30T06:38:49.539 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-idna. 2024-05-30T06:38:49.552 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-05-30T06:38:49.597 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-05-30T06:38:49.706 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-webob. 2024-05-30T06:38:49.721 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-30T06:38:49.756 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-30T06:38:49.883 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-urllib3. 2024-05-30T06:38:49.896 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-30T06:38:49.934 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-30T06:38:50.084 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-waitress. 2024-05-30T06:38:50.098 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-30T06:38:50.145 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-30T06:38:50.244 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-requests. 2024-05-30T06:38:50.258 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-30T06:38:50.294 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-30T06:38:50.445 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-tempita. 2024-05-30T06:38:50.461 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-30T06:38:50.504 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-30T06:38:50.572 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-30T06:38:50.586 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-05-30T06:38:50.630 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-05-30T06:38:51.302 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-paste. 2024-05-30T06:38:51.319 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-30T06:38:51.642 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-30T06:38:51.658 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:38:51.717 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:51.790 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-30T06:38:52.085 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-30T06:38:52.100 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-30T06:38:52.105 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-30T06:38:52.118 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:52.135 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-30T06:38:52.163 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:52.405 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-30T06:38:52.420 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-30T06:38:52.441 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-30T06:38:52.455 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-30T06:38:52.488 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-30T06:38:52.524 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-30T06:38:52.791 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-webtest. 2024-05-30T06:38:52.806 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-30T06:38:52.827 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-openssl. 2024-05-30T06:38:52.840 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-30T06:38:52.849 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-30T06:38:52.885 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-30T06:38:53.143 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pecan. 2024-05-30T06:38:53.159 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-30T06:38:53.201 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-30T06:38:53.221 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr. 2024-05-30T06:38:53.235 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:53.305 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:53.565 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-certifi. 2024-05-30T06:38:53.580 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-30T06:38:53.633 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mon. 2024-05-30T06:38:53.647 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:53.648 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-30T06:38:53.683 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mon (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:53.934 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-idna. 2024-05-30T06:38:53.949 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-05-30T06:38:53.984 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-05-30T06:38:54.278 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-osd. 2024-05-30T06:38:54.287 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-urllib3. 2024-05-30T06:38:54.292 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:54.303 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-30T06:38:54.336 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-osd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:54.345 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-30T06:38:54.657 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-requests. 2024-05-30T06:38:54.673 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-30T06:38:54.715 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-30T06:38:55.043 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-30T06:38:55.059 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-05-30T06:38:55.081 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph. 2024-05-30T06:38:55.094 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../068-ceph_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:55.101 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-05-30T06:38:55.131 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:55.388 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-30T06:38:55.404 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:38:55.446 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:55.467 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-fuse. 2024-05-30T06:38:55.478 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:55.683 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:55.826 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-30T06:38:55.841 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:55.875 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:56.045 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mds. 2024-05-30T06:38:56.056 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:56.095 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mds (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:56.162 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-30T06:38:56.177 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-30T06:38:56.220 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-30T06:38:56.482 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephadm. 2024-05-30T06:38:56.492 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../071-cephadm_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:56.531 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-openssl. 2024-05-30T06:38:56.547 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-30T06:38:56.565 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:56.590 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-30T06:38:56.859 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-30T06:38:56.870 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-30T06:38:56.908 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-30T06:38:56.934 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr. 2024-05-30T06:38:56.950 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:56.992 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:57.219 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-30T06:38:57.230 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-30T06:38:57.269 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-30T06:38:57.388 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mon. 2024-05-30T06:38:57.403 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:57.446 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mon (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:57.999 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-osd. 2024-05-30T06:38:58.015 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:58.057 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-osd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:58.275 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-babel. 2024-05-30T06:38:58.286 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-30T06:38:58.325 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-30T06:38:58.644 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-jinja2. 2024-05-30T06:38:58.655 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-05-30T06:38:58.694 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-05-30T06:38:58.861 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph. 2024-05-30T06:38:58.876 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../068-ceph_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:58.919 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:59.072 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-30T06:38:59.082 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:38:59.122 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:59.238 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-fuse. 2024-05-30T06:38:59.254 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:59.296 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:59.467 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-30T06:38:59.480 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-30T06:38:59.525 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-30T06:38:59.641 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mds. 2024-05-30T06:38:59.657 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:38:59.691 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mds (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:38:59.853 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-routes. 2024-05-30T06:38:59.864 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-30T06:38:59.903 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-30T06:39:00.069 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package cephadm. 2024-05-30T06:39:00.085 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../071-cephadm_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:39:00.127 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:00.231 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-30T06:39:00.243 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:39:00.280 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:00.455 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-30T06:39:00.471 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-30T06:39:00.513 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-30T06:39:00.849 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-30T06:39:00.865 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-30T06:39:00.907 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-30T06:39:01.453 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-30T06:39:01.465 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-30T06:39:01.503 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-30T06:39:01.896 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-babel. 2024-05-30T06:39:01.910 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-30T06:39:01.954 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-30T06:39:01.972 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-joblib. 2024-05-30T06:39:01.984 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-30T06:39:02.022 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-30T06:39:02.241 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jinja2. 2024-05-30T06:39:02.255 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-05-30T06:39:02.290 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-05-30T06:39:02.392 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-30T06:39:02.404 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-30T06:39:02.519 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-30T06:39:02.618 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-30T06:39:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:39:02.668 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:02.822 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-sklearn. 2024-05-30T06:39:02.836 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-30T06:39:02.880 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-30T06:39:03.039 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-30T06:39:03.055 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-30T06:39:03.096 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-30T06:39:03.383 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-routes. 2024-05-30T06:39:03.398 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-30T06:39:03.441 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-30T06:39:03.531 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-30T06:39:03.547 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:39:03.581 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:03.719 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-30T06:39:03.735 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:39:03.769 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:04.576 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-cachetools. 2024-05-30T06:39:04.591 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-30T06:39:04.634 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-30T06:39:04.920 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-30T06:39:04.936 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-30T06:39:04.971 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-30T06:39:05.057 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-30T06:39:05.072 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-30T06:39:05.115 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-30T06:39:05.298 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-30T06:39:05.306 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-30T06:39:05.373 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-30T06:39:05.636 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-joblib. 2024-05-30T06:39:05.651 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-30T06:39:05.660 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-rsa. 2024-05-30T06:39:05.670 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-30T06:39:05.694 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-30T06:39:05.709 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-30T06:39:06.039 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-30T06:39:06.055 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-30T06:39:06.191 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-30T06:39:06.255 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-google-auth. 2024-05-30T06:39:06.264 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-30T06:39:06.305 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-30T06:39:06.527 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-sklearn. 2024-05-30T06:39:06.542 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-30T06:39:06.585 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-30T06:39:06.650 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-30T06:39:06.659 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-30T06:39:06.699 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-30T06:39:07.011 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-websocket. 2024-05-30T06:39:07.023 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-30T06:39:07.061 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-30T06:39:07.378 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-30T06:39:07.381 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-30T06:39:07.390 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-30T06:39:07.392 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:39:07.430 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-30T06:39:07.461 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:08.094 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-30T06:39:08.103 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:39:08.144 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:08.464 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-30T06:39:08.472 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-30T06:39:08.498 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cachetools. 2024-05-30T06:39:08.513 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-30T06:39:08.516 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-30T06:39:08.598 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-30T06:39:08.867 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-30T06:39:08.876 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-30T06:39:08.901 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-30T06:39:08.916 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-30T06:39:08.917 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-30T06:39:08.959 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-30T06:39:09.136 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package jq. 2024-05-30T06:39:09.147 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-30T06:39:09.177 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-30T06:39:09.287 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-30T06:39:09.303 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-30T06:39:09.345 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-30T06:39:09.455 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package socat. 2024-05-30T06:39:09.465 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-30T06:39:09.505 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-30T06:39:09.690 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rsa. 2024-05-30T06:39:09.706 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-30T06:39:09.748 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-30T06:39:09.800 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package xmlstarlet. 2024-05-30T06:39:09.810 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-30T06:39:09.850 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-30T06:39:10.069 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-google-auth. 2024-05-30T06:39:10.085 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-30T06:39:10.127 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-30T06:39:10.246 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-test. 2024-05-30T06:39:10.255 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:39:10.295 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-test (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:10.430 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-30T06:39:10.447 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-30T06:39:10.489 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-30T06:39:10.734 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-websocket. 2024-05-30T06:39:10.749 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-30T06:39:10.814 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-30T06:39:11.145 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-30T06:39:11.161 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-30T06:39:11.202 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-30T06:39:11.858 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-30T06:39:11.873 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:39:11.908 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:12.236 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-30T06:39:12.250 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-30T06:39:12.294 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-30T06:39:12.325 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ceph-volume. 2024-05-30T06:39:12.336 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:39:12.374 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ceph-volume (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:12.639 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-30T06:39:12.654 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-30T06:39:12.697 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-30T06:39:12.770 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-30T06:39:12.782 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:39:12.820 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephfs-mirror (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:12.933 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package jq. 2024-05-30T06:39:12.948 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-30T06:39:12.983 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-30T06:39:13.107 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-colorama. 2024-05-30T06:39:13.117 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-30T06:39:13.156 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-30T06:39:13.244 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package socat. 2024-05-30T06:39:13.259 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-30T06:39:13.302 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-30T06:39:13.359 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephfs-shell. 2024-05-30T06:39:13.370 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:39:13.409 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephfs-shell (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:13.597 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package xmlstarlet. 2024-05-30T06:39:13.613 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-30T06:39:13.656 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-30T06:39:13.703 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package cephfs-top. 2024-05-30T06:39:13.714 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:39:13.753 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking cephfs-top (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:14.001 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-test. 2024-05-30T06:39:14.005 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-30T06:39:14.016 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:39:14.017 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:39:14.051 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-test (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:14.055 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libcephfs-dev (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:14.392 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-30T06:39:14.403 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-30T06:39:14.441 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-30T06:39:14.796 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-30T06:39:14.807 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-30T06:39:14.845 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-30T06:39:15.225 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package nvme-cli. 2024-05-30T06:39:15.236 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-30T06:39:15.274 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-30T06:39:15.663 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package pkg-config. 2024-05-30T06:39:15.674 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-30T06:39:15.704 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-30T06:39:15.957 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-30T06:39:15.968 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-30T06:39:16.114 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-volume. 2024-05-30T06:39:16.125 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:39:16.164 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-volume (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:16.249 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-30T06:39:16.560 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-30T06:39:16.569 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:39:16.609 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking cephfs-mirror (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:16.627 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-30T06:39:16.638 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-30T06:39:16.677 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-30T06:39:16.904 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-colorama. 2024-05-30T06:39:16.913 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-30T06:39:16.979 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-30T06:39:17.004 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pastescript. 2024-05-30T06:39:17.016 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-30T06:39:17.054 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-30T06:39:17.225 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package cephfs-shell. 2024-05-30T06:39:17.235 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:39:17.275 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking cephfs-shell (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:17.341 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pluggy. 2024-05-30T06:39:17.351 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-30T06:39:17.399 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-30T06:39:17.544 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package cephfs-top. 2024-05-30T06:39:17.554 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3154-g9ed025fb-1jammy_all.deb ... 2024-05-30T06:39:17.594 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking cephfs-top (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:17.744 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-psutil. 2024-05-30T06:39:17.755 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-30T06:39:17.793 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-30T06:39:17.830 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-30T06:39:17.839 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:39:17.879 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libcephfs-dev (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:18.121 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-py. 2024-05-30T06:39:18.132 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-30T06:39:18.171 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-30T06:39:18.207 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-30T06:39:18.217 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-30T06:39:18.249 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-30T06:39:18.533 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pygments. 2024-05-30T06:39:18.544 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-30T06:39:18.579 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-30T06:39:18.588 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-30T06:39:18.591 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-30T06:39:18.628 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-30T06:39:18.982 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package nvme-cli. 2024-05-30T06:39:18.991 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-30T06:39:19.020 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-30T06:39:19.030 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-30T06:39:19.032 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-30T06:39:19.070 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-30T06:39:19.406 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-toml. 2024-05-30T06:39:19.416 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-30T06:39:19.456 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-30T06:39:19.479 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package pkg-config. 2024-05-30T06:39:19.488 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-30T06:39:19.529 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-30T06:39:19.759 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-pytest. 2024-05-30T06:39:19.768 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-30T06:39:19.773 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-30T06:39:19.783 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-30T06:39:19.808 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-30T06:39:19.823 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-30T06:39:20.145 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package python3-simplejson. 2024-05-30T06:39:20.155 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-30T06:39:20.195 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-30T06:39:20.268 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-30T06:39:20.277 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-30T06:39:20.318 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-30T06:39:20.465 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-30T06:39:20.474 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-30T06:39:20.514 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-30T06:39:20.570 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pastescript. 2024-05-30T06:39:20.580 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-30T06:39:20.612 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-30T06:39:20.915 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pluggy. 2024-05-30T06:39:20.925 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-30T06:39:20.965 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-30T06:39:21.218 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package radosgw. 2024-05-30T06:39:21.229 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../122-radosgw_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:39:21.260 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-psutil. 2024-05-30T06:39:21.268 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking radosgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:21.269 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-30T06:39:21.309 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-30T06:39:21.671 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-py. 2024-05-30T06:39:21.680 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-30T06:39:21.720 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-30T06:39:21.888 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package rbd-fuse. 2024-05-30T06:39:21.898 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:39:21.938 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking rbd-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:22.032 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pygments. 2024-05-30T06:39:22.041 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-30T06:39:22.082 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-30T06:39:22.219 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-30T06:39:22.518 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-30T06:39:22.536 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-30T06:39:22.544 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-30T06:39:22.586 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-30T06:39:22.669 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-30T06:39:22.905 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-toml. 2024-05-30T06:39:22.914 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-30T06:39:22.924 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-30T06:39:22.955 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-30T06:39:23.224 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pytest. 2024-05-30T06:39:23.234 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-30T06:39:23.274 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-30T06:39:23.330 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-30T06:39:23.620 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-simplejson. 2024-05-30T06:39:23.629 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-30T06:39:23.669 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-30T06:39:23.950 INFO:teuthology.orchestra.run.smithi105.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-30T06:39:23.964 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-30T06:39:23.974 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-30T06:39:23.997 INFO:teuthology.orchestra.run.smithi105.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-05-30T06:39:24.013 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-30T06:39:24.054 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:24.615 INFO:teuthology.orchestra.run.smithi105.stdout:Adding system user cephadm....done 2024-05-30T06:39:24.768 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-30T06:39:24.776 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package radosgw. 2024-05-30T06:39:24.784 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../122-radosgw_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:39:24.826 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking radosgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:25.044 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-30T06:39:25.296 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-30T06:39:25.447 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-30T06:39:25.462 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package rbd-fuse. 2024-05-30T06:39:25.471 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3154-g9ed025fb-1jammy_amd64.deb ... 2024-05-30T06:39:25.512 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking rbd-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:25.714 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-30T06:39:25.828 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-30T06:39:26.009 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-30T06:39:26.109 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-30T06:39:26.167 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-30T06:39:26.268 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-30T06:39:26.502 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-30T06:39:26.538 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-30T06:39:26.929 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-30T06:39:26.930 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-30T06:39:27.205 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-30T06:39:27.473 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-30T06:39:27.507 INFO:teuthology.orchestra.run.smithi037.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-30T06:39:27.555 INFO:teuthology.orchestra.run.smithi037.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-05-30T06:39:27.603 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:27.758 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-30T06:39:28.134 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-30T06:39:28.138 INFO:teuthology.orchestra.run.smithi037.stdout:Adding system user cephadm....done 2024-05-30T06:39:28.309 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-30T06:39:28.427 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-30T06:39:28.593 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-30T06:39:28.712 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-30T06:39:28.861 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-30T06:39:28.987 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-30T06:39:28.988 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-ceph-argparse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:29.255 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-30T06:39:29.272 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-30T06:39:29.398 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-30T06:39:29.506 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-30T06:39:29.523 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-30T06:39:29.607 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-30T06:39:29.817 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-30T06:39:29.959 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-30T06:39:29.968 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-30T06:39:30.244 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-30T06:39:30.336 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-30T06:39:30.604 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-30T06:39:30.666 INFO:teuthology.orchestra.run.smithi105.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-30T06:39:30.716 INFO:teuthology.orchestra.run.smithi105.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-30T06:39:30.780 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-30T06:39:30.880 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-30T06:39:30.906 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-30T06:39:31.165 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-30T06:39:31.274 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-30T06:39:31.399 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-30T06:39:31.452 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-30T06:39:31.667 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-30T06:39:31.920 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-30T06:39:31.962 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-30T06:39:32.228 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-ceph-argparse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:32.242 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-30T06:39:32.504 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-30T06:39:32.574 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up zip (3.0-12build2) ... 2024-05-30T06:39:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-30T06:39:32.699 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-30T06:39:32.739 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-30T06:39:32.990 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-30T06:39:33.124 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-30T06:39:33.392 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-30T06:39:33.409 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-30T06:39:33.702 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-30T06:39:33.771 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-30T06:39:33.798 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-30T06:39:33.870 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-30T06:39:33.870 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-30T06:39:33.996 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-30T06:39:34.021 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-30T06:39:34.355 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-30T06:39:34.372 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-30T06:39:34.473 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-30T06:39:34.733 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-30T06:39:34.756 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-30T06:39:35.016 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-30T06:39:35.017 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-30T06:39:35.353 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up zip (3.0-12build2) ... 2024-05-30T06:39:35.444 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-30T06:39:35.486 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-30T06:39:35.769 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-30T06:39:36.095 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-05-30T06:39:36.213 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-30T06:39:36.463 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-30T06:39:36.481 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-30T06:39:36.607 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-30T06:39:36.716 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-30T06:39:36.730 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-30T06:39:36.856 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:37.042 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-30T06:39:37.166 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-05-30T06:39:37.452 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-30T06:39:37.534 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-30T06:39:38.145 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-30T06:39:38.555 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-30T06:39:38.806 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-30T06:39:38.847 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-30T06:39:39.066 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T06:39:39.157 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-05-30T06:39:39.242 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-30T06:39:39.501 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-30T06:39:39.527 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-30T06:39:39.678 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-30T06:39:39.768 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-30T06:39:39.820 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-30T06:39:39.894 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:40.122 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-30T06:39:40.228 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-05-30T06:39:40.431 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-30T06:39:40.588 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-30T06:39:40.699 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T06:39:40.825 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-30T06:39:41.143 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-30T06:39:41.403 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-30T06:39:41.671 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-30T06:39:41.877 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-30T06:39:41.938 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-30T06:39:42.162 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T06:39:42.197 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-30T06:39:42.321 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-30T06:39:42.474 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-30T06:39:42.580 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-30T06:39:42.599 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-30T06:39:42.681 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-30T06:39:42.791 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-30T06:39:42.917 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-30T06:39:43.027 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-30T06:39:43.101 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-30T06:39:43.311 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-30T06:39:43.385 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-30T06:39:43.653 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T06:39:43.654 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-30T06:39:43.779 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-30T06:39:43.930 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-30T06:39:44.056 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-30T06:39:44.105 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-30T06:39:44.182 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-30T06:39:44.295 INFO:teuthology.orchestra.run.smithi105.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-30T06:39:44.348 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-30T06:39:44.550 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-30T06:39:44.599 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-30T06:39:44.676 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-30T06:39:44.875 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-30T06:39:45.053 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-30T06:39:45.143 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-30T06:39:45.320 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-30T06:39:45.436 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-30T06:39:45.446 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-30T06:39:45.561 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-30T06:39:45.714 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T06:39:45.866 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-05-30T06:39:45.896 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-30T06:39:46.013 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-30T06:39:46.191 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-30T06:39:46.298 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-30T06:39:46.509 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-30T06:39:46.599 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-30T06:39:46.793 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-30T06:39:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-30T06:39:46.996 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-30T06:39:47.001 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-30T06:39:47.127 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-30T06:39:47.216 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-30T06:39:47.273 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-30T06:39:47.462 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-30T06:39:47.549 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-30T06:39:47.588 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-30T06:39:47.817 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-30T06:39:47.973 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-30T06:39:48.194 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-30T06:39:48.232 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-30T06:39:48.367 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-30T06:39:48.512 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-30T06:39:48.643 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-30T06:39:48.769 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-05-30T06:39:48.864 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-30T06:39:48.990 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librados2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:49.112 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-30T06:39:49.141 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:49.267 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-30T06:39:49.438 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-30T06:39:49.595 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libcephfs2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:49.722 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libradosstriper1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:49.722 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-30T06:39:49.872 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-30T06:39:49.917 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-30T06:39:50.165 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librbd1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:50.210 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-30T06:39:50.291 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-modules-core (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:50.417 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:50.495 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-30T06:39:50.618 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-30T06:39:50.618 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-30T06:39:50.771 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-30T06:39:51.164 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-30T06:39:51.252 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libcephfs-dev (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:51.370 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rados (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:51.465 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-30T06:39:51.521 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up librgw2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:51.663 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephfs-top (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:51.789 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-30T06:39:51.826 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-30T06:39:51.953 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librados2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:52.078 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:52.205 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-30T06:39:52.516 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libcephfs2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:52.642 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libradosstriper1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:52.768 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-30T06:39:53.062 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librbd1 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:53.076 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rbd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:53.186 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up rbd-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:53.187 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-modules-core (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:53.304 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-rgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:53.313 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:53.429 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up python3-cephfs (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:53.530 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-30T06:39:53.530 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-30T06:39:53.555 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephfs-shell (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:53.681 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:54.164 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libcephfs-dev (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:54.268 INFO:teuthology.orchestra.run.smithi105.stdout:Adding group ceph....done 2024-05-30T06:39:54.290 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rados (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:54.416 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librgw2 (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:54.534 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up cephfs-top (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:54.635 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-30T06:39:54.670 INFO:teuthology.orchestra.run.smithi105.stdout:Adding system user ceph....done 2024-05-30T06:39:54.846 INFO:teuthology.orchestra.run.smithi105.stdout:Setting system user ceph properties....done 2024-05-30T06:39:54.863 INFO:teuthology.orchestra.run.smithi105.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-30T06:39:55.009 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-30T06:39:55.408 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-30T06:39:55.955 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rbd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:56.056 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up rbd-fuse (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:56.057 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up cephfs-mirror (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:56.157 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:56.266 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-30T06:39:56.266 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-30T06:39:56.266 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cephfs (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:56.401 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up cephfs-shell (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:56.527 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-common (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:56.950 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-test (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:57.060 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up radosgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:57.088 INFO:teuthology.orchestra.run.smithi037.stdout:Adding group ceph....done 2024-05-30T06:39:57.439 INFO:teuthology.orchestra.run.smithi037.stdout:Adding system user ceph....done 2024-05-30T06:39:57.609 INFO:teuthology.orchestra.run.smithi037.stdout:Setting system user ceph properties....done 2024-05-30T06:39:57.625 INFO:teuthology.orchestra.run.smithi037.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-30T06:39:57.774 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-30T06:39:58.178 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-30T06:39:58.245 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-30T06:39:58.245 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-30T06:39:58.845 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up cephfs-mirror (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:58.881 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-base (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:59.052 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-30T06:39:59.052 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-30T06:39:59.237 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-30T06:39:59.671 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-test (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:59.797 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up radosgw (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:39:59.891 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mds (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:00.131 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-30T06:40:00.131 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-30T06:40:00.326 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-30T06:40:00.326 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-30T06:40:00.767 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:00.965 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-base (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:01.080 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-30T06:40:01.080 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-30T06:40:01.303 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-30T06:40:01.710 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-osd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:02.034 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mds (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:02.037 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-30T06:40:02.038 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-30T06:40:02.272 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-30T06:40:02.272 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-30T06:40:02.700 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:02.830 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:02.927 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:03.356 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mon (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:03.436 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-30T06:40:03.437 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-30T06:40:03.564 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-30T06:40:03.564 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-30T06:40:04.070 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-osd (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:04.256 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:04.394 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-30T06:40:04.394 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-30T06:40:04.449 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:04.592 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-mgr-dashboard (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:04.718 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ceph-volume (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:05.047 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:05.089 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-30T06:40:05.172 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:05.265 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-30T06:40:05.315 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mon (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:05.484 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-30T06:40:05.532 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-30T06:40:05.532 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-30T06:40:06.175 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-cephadm (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:06.452 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-dashboard (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:06.594 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-volume (19.0.0-3154-g9ed025fb-1jammy) ... 2024-05-30T06:40:06.966 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-30T06:40:06.972 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-30T06:40:07.073 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-30T06:40:07.225 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-30T06:40:07.668 INFO:teuthology.orchestra.run.smithi105.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-30T06:40:07.672 DEBUG:teuthology.orchestra.run.smithi105:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-30T06:40:07.748 INFO:teuthology.orchestra.run.smithi105.stdout:Reading package lists... 2024-05-30T06:40:07.924 INFO:teuthology.orchestra.run.smithi105.stdout:Building dependency tree... 2024-05-30T06:40:07.924 INFO:teuthology.orchestra.run.smithi105.stdout:Reading state information... 2024-05-30T06:40:08.097 INFO:teuthology.orchestra.run.smithi105.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-30T06:40:08.097 INFO:teuthology.orchestra.run.smithi105.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-30T06:40:08.097 INFO:teuthology.orchestra.run.smithi105.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-30T06:40:08.097 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages were automatically installed and are no longer required: 2024-05-30T06:40:08.098 INFO:teuthology.orchestra.run.smithi105.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-30T06:40:08.098 INFO:teuthology.orchestra.run.smithi105.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-30T06:40:08.098 INFO:teuthology.orchestra.run.smithi105.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-30T06:40:08.098 INFO:teuthology.orchestra.run.smithi105.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-30T06:40:08.099 INFO:teuthology.orchestra.run.smithi105.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-30T06:40:08.099 INFO:teuthology.orchestra.run.smithi105.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-30T06:40:08.099 INFO:teuthology.orchestra.run.smithi105.stdout:The following additional packages will be installed: 2024-05-30T06:40:08.099 INFO:teuthology.orchestra.run.smithi105.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-30T06:40:08.099 INFO:teuthology.orchestra.run.smithi105.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-30T06:40:08.100 INFO:teuthology.orchestra.run.smithi105.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-30T06:40:08.100 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-30T06:40:08.100 INFO:teuthology.orchestra.run.smithi105.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-30T06:40:08.100 INFO:teuthology.orchestra.run.smithi105.stdout:Suggested packages: 2024-05-30T06:40:08.100 INFO:teuthology.orchestra.run.smithi105.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-30T06:40:08.100 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-30T06:40:08.100 INFO:teuthology.orchestra.run.smithi105.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-30T06:40:08.154 INFO:teuthology.orchestra.run.smithi105.stdout:The following NEW packages will be installed: 2024-05-30T06:40:08.155 INFO:teuthology.orchestra.run.smithi105.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-30T06:40:08.155 INFO:teuthology.orchestra.run.smithi105.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-30T06:40:08.155 INFO:teuthology.orchestra.run.smithi105.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-30T06:40:08.155 INFO:teuthology.orchestra.run.smithi105.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-30T06:40:08.155 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-30T06:40:08.156 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-30T06:40:08.156 INFO:teuthology.orchestra.run.smithi105.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-30T06:40:08.156 INFO:teuthology.orchestra.run.smithi105.stdout:The following packages will be upgraded: 2024-05-30T06:40:08.157 INFO:teuthology.orchestra.run.smithi105.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-30T06:40:08.221 INFO:teuthology.orchestra.run.smithi105.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-30T06:40:08.221 INFO:teuthology.orchestra.run.smithi105.stdout:Need to get 55.7 MB of archives. 2024-05-30T06:40:08.221 INFO:teuthology.orchestra.run.smithi105.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-30T06:40:08.221 INFO:teuthology.orchestra.run.smithi105.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-30T06:40:08.320 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-30T06:40:08.385 INFO:teuthology.orchestra.run.smithi105.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-30T06:40:08.391 INFO:teuthology.orchestra.run.smithi105.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-30T06:40:08.425 INFO:teuthology.orchestra.run.smithi105.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-30T06:40:08.425 INFO:teuthology.orchestra.run.smithi105.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-30T06:40:08.426 INFO:teuthology.orchestra.run.smithi105.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-30T06:40:08.440 INFO:teuthology.orchestra.run.smithi105.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-30T06:40:08.441 INFO:teuthology.orchestra.run.smithi105.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-30T06:40:08.442 INFO:teuthology.orchestra.run.smithi105.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-30T06:40:08.444 INFO:teuthology.orchestra.run.smithi105.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-30T06:40:08.444 INFO:teuthology.orchestra.run.smithi105.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-30T06:40:08.445 INFO:teuthology.orchestra.run.smithi105.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-30T06:40:08.456 INFO:teuthology.orchestra.run.smithi105.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-30T06:40:08.457 INFO:teuthology.orchestra.run.smithi105.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-30T06:40:08.457 INFO:teuthology.orchestra.run.smithi105.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-30T06:40:08.476 INFO:teuthology.orchestra.run.smithi105.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-30T06:40:09.052 INFO:teuthology.orchestra.run.smithi105.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-30T06:40:09.053 INFO:teuthology.orchestra.run.smithi105.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-30T06:40:09.054 INFO:teuthology.orchestra.run.smithi105.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-30T06:40:09.057 INFO:teuthology.orchestra.run.smithi105.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-30T06:40:09.057 INFO:teuthology.orchestra.run.smithi105.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-30T06:40:09.062 INFO:teuthology.orchestra.run.smithi105.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-30T06:40:09.064 INFO:teuthology.orchestra.run.smithi105.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-30T06:40:09.071 INFO:teuthology.orchestra.run.smithi105.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-30T06:40:09.072 INFO:teuthology.orchestra.run.smithi105.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-30T06:40:09.100 INFO:teuthology.orchestra.run.smithi105.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-30T06:40:09.103 INFO:teuthology.orchestra.run.smithi105.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-30T06:40:09.114 INFO:teuthology.orchestra.run.smithi105.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-30T06:40:09.159 INFO:teuthology.orchestra.run.smithi105.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-30T06:40:09.163 INFO:teuthology.orchestra.run.smithi105.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-30T06:40:09.164 INFO:teuthology.orchestra.run.smithi105.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-30T06:40:09.164 INFO:teuthology.orchestra.run.smithi105.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-30T06:40:09.165 INFO:teuthology.orchestra.run.smithi105.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-30T06:40:09.180 INFO:teuthology.orchestra.run.smithi105.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-30T06:40:09.190 INFO:teuthology.orchestra.run.smithi105.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-30T06:40:09.323 INFO:teuthology.orchestra.run.smithi037.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-30T06:40:09.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-30T06:40:09.406 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2024-05-30T06:40:09.472 INFO:teuthology.orchestra.run.smithi105.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-30T06:40:09.473 INFO:teuthology.orchestra.run.smithi105.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-30T06:40:09.473 INFO:teuthology.orchestra.run.smithi105.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-30T06:40:09.473 INFO:teuthology.orchestra.run.smithi105.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-30T06:40:09.474 INFO:teuthology.orchestra.run.smithi105.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-30T06:40:09.474 INFO:teuthology.orchestra.run.smithi105.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-30T06:40:09.499 INFO:teuthology.orchestra.run.smithi105.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-30T06:40:09.499 INFO:teuthology.orchestra.run.smithi105.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-30T06:40:09.586 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2024-05-30T06:40:09.587 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2024-05-30T06:40:09.764 INFO:teuthology.orchestra.run.smithi037.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-30T06:40:09.765 INFO:teuthology.orchestra.run.smithi037.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-30T06:40:09.765 INFO:teuthology.orchestra.run.smithi037.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-30T06:40:09.765 INFO:teuthology.orchestra.run.smithi037.stdout:The following packages were automatically installed and are no longer required: 2024-05-30T06:40:09.765 INFO:teuthology.orchestra.run.smithi037.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-30T06:40:09.765 INFO:teuthology.orchestra.run.smithi037.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-30T06:40:09.765 INFO:teuthology.orchestra.run.smithi037.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-30T06:40:09.766 INFO:teuthology.orchestra.run.smithi037.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-30T06:40:09.766 INFO:teuthology.orchestra.run.smithi037.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-30T06:40:09.766 INFO:teuthology.orchestra.run.smithi037.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-30T06:40:09.766 INFO:teuthology.orchestra.run.smithi037.stdout:The following additional packages will be installed: 2024-05-30T06:40:09.766 INFO:teuthology.orchestra.run.smithi037.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-30T06:40:09.767 INFO:teuthology.orchestra.run.smithi037.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-30T06:40:09.767 INFO:teuthology.orchestra.run.smithi037.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-30T06:40:09.767 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-30T06:40:09.767 INFO:teuthology.orchestra.run.smithi037.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-30T06:40:09.768 INFO:teuthology.orchestra.run.smithi037.stdout:Suggested packages: 2024-05-30T06:40:09.768 INFO:teuthology.orchestra.run.smithi037.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-30T06:40:09.768 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-30T06:40:09.768 INFO:teuthology.orchestra.run.smithi037.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-30T06:40:09.824 INFO:teuthology.orchestra.run.smithi037.stdout:The following NEW packages will be installed: 2024-05-30T06:40:09.824 INFO:teuthology.orchestra.run.smithi037.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-30T06:40:09.825 INFO:teuthology.orchestra.run.smithi037.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-30T06:40:09.825 INFO:teuthology.orchestra.run.smithi037.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-30T06:40:09.825 INFO:teuthology.orchestra.run.smithi037.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-30T06:40:09.825 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-30T06:40:09.826 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-30T06:40:09.826 INFO:teuthology.orchestra.run.smithi037.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-30T06:40:09.826 INFO:teuthology.orchestra.run.smithi037.stdout:The following packages will be upgraded: 2024-05-30T06:40:09.827 INFO:teuthology.orchestra.run.smithi037.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-30T06:40:09.885 INFO:teuthology.orchestra.run.smithi105.stdout:Preconfiguring packages ... 2024-05-30T06:40:10.013 INFO:teuthology.orchestra.run.smithi037.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-30T06:40:10.013 INFO:teuthology.orchestra.run.smithi037.stdout:Need to get 55.7 MB of archives. 2024-05-30T06:40:10.013 INFO:teuthology.orchestra.run.smithi037.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-30T06:40:10.013 INFO:teuthology.orchestra.run.smithi037.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-30T06:40:10.063 INFO:teuthology.orchestra.run.smithi105.stdout:Fetched 55.7 MB in 1s (41.7 MB/s) 2024-05-30T06:40:10.350 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-05-30T06:40:10.354 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-30T06:40:10.497 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-30T06:40:10.677 INFO:teuthology.orchestra.run.smithi037.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-30T06:40:10.704 INFO:teuthology.orchestra.run.smithi037.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-30T06:40:10.847 INFO:teuthology.orchestra.run.smithi037.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-30T06:40:10.848 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-30T06:40:10.849 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-30T06:40:10.872 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-30T06:40:10.873 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-30T06:40:10.877 INFO:teuthology.orchestra.run.smithi037.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-30T06:40:10.880 INFO:teuthology.orchestra.run.smithi037.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-30T06:40:10.880 INFO:teuthology.orchestra.run.smithi037.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-30T06:40:11.047 INFO:teuthology.orchestra.run.smithi037.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-30T06:40:11.129 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-30T06:40:11.329 INFO:teuthology.orchestra.run.smithi037.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-30T06:40:11.339 INFO:teuthology.orchestra.run.smithi037.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-30T06:40:11.347 INFO:teuthology.orchestra.run.smithi037.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-30T06:40:11.433 INFO:teuthology.orchestra.run.smithi037.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-30T06:40:12.394 INFO:teuthology.orchestra.run.smithi105.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-30T06:40:12.426 INFO:teuthology.orchestra.run.smithi037.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-30T06:40:12.428 INFO:teuthology.orchestra.run.smithi037.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-30T06:40:12.429 INFO:teuthology.orchestra.run.smithi037.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-30T06:40:12.458 INFO:teuthology.orchestra.run.smithi037.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-30T06:40:12.459 INFO:teuthology.orchestra.run.smithi037.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-30T06:40:12.463 INFO:teuthology.orchestra.run.smithi037.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-30T06:40:12.635 INFO:teuthology.orchestra.run.smithi037.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-30T06:40:12.685 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package flex. 2024-05-30T06:40:12.756 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-05-30T06:40:12.759 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-30T06:40:12.891 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-30T06:40:13.403 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-30T06:40:13.417 INFO:teuthology.orchestra.run.smithi037.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-30T06:40:13.417 INFO:teuthology.orchestra.run.smithi037.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-30T06:40:13.581 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-30T06:40:13.822 INFO:teuthology.orchestra.run.smithi037.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-30T06:40:13.823 INFO:teuthology.orchestra.run.smithi037.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-30T06:40:13.902 INFO:teuthology.orchestra.run.smithi037.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-30T06:40:13.962 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-30T06:40:14.024 INFO:teuthology.orchestra.run.smithi037.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-30T06:40:14.034 INFO:teuthology.orchestra.run.smithi037.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-30T06:40:14.035 INFO:teuthology.orchestra.run.smithi037.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-30T06:40:14.036 INFO:teuthology.orchestra.run.smithi037.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-30T06:40:14.039 INFO:teuthology.orchestra.run.smithi037.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-30T06:40:14.324 INFO:teuthology.orchestra.run.smithi037.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-30T06:40:14.527 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-05-30T06:40:14.530 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-30T06:40:14.655 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-30T06:40:14.746 INFO:teuthology.orchestra.run.smithi037.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-30T06:40:15.050 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-30T06:40:15.178 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-30T06:40:15.475 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-30T06:40:15.546 INFO:teuthology.orchestra.run.smithi037.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-30T06:40:15.547 INFO:teuthology.orchestra.run.smithi037.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-30T06:40:15.547 INFO:teuthology.orchestra.run.smithi037.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-30T06:40:15.547 INFO:teuthology.orchestra.run.smithi037.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-30T06:40:15.547 INFO:teuthology.orchestra.run.smithi037.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-30T06:40:15.547 INFO:teuthology.orchestra.run.smithi037.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-30T06:40:15.578 INFO:teuthology.orchestra.run.smithi037.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-30T06:40:15.578 INFO:teuthology.orchestra.run.smithi037.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-30T06:40:15.845 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package bison. 2024-05-30T06:40:15.916 INFO:teuthology.orchestra.run.smithi105.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-05-30T06:40:15.920 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-30T06:40:15.955 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-30T06:40:15.980 INFO:teuthology.orchestra.run.smithi037.stdout:Preconfiguring packages ... 2024-05-30T06:40:16.135 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 55.7 MB in 6s (9,703 kB/s) 2024-05-30T06:40:16.357 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-30T06:40:16.371 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-30T06:40:16.440 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-30T06:40:16.450 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-05-30T06:40:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-30T06:40:16.593 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-30T06:40:16.751 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package dump. 2024-05-30T06:40:16.766 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-30T06:40:16.801 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking dump (0.4b47-3) ... 2024-05-30T06:40:17.047 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package indent. 2024-05-30T06:40:17.061 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-30T06:40:17.105 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-30T06:40:17.243 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-30T06:40:17.383 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-30T06:40:17.398 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-30T06:40:17.441 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-30T06:40:17.770 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-30T06:40:17.785 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-30T06:40:17.828 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-30T06:40:18.072 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-30T06:40:18.088 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-30T06:40:18.130 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-30T06:40:18.374 INFO:teuthology.orchestra.run.smithi037.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-30T06:40:18.459 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-30T06:40:18.474 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-30T06:40:18.517 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-30T06:40:18.680 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package flex. 2024-05-30T06:40:18.753 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-05-30T06:40:18.757 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-30T06:40:18.769 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-30T06:40:18.785 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-30T06:40:18.804 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-30T06:40:18.853 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-30T06:40:19.089 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libjson-perl. 2024-05-30T06:40:19.105 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-30T06:40:19.139 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-30T06:40:19.399 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-30T06:40:19.434 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-30T06:40:19.449 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-30T06:40:19.492 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-30T06:40:19.609 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-30T06:40:20.068 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-30T06:40:20.640 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-05-30T06:40:20.644 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-30T06:40:20.750 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-30T06:40:20.820 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-30T06:40:20.836 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-30T06:40:20.878 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T06:40:21.139 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-30T06:40:21.154 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-30T06:40:21.171 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-30T06:40:21.197 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T06:40:21.306 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-30T06:40:21.550 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-30T06:40:21.566 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-30T06:40:21.609 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T06:40:21.621 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-30T06:40:21.945 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-30T06:40:21.961 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-30T06:40:21.973 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package bison. 2024-05-30T06:40:21.997 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-30T06:40:22.051 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-05-30T06:40:22.055 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-30T06:40:22.100 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-30T06:40:22.333 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-30T06:40:22.348 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-30T06:40:22.391 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-30T06:40:22.493 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-30T06:40:22.508 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-30T06:40:22.551 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-30T06:40:22.736 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-30T06:40:22.752 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-30T06:40:22.794 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-30T06:40:22.896 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package dump. 2024-05-30T06:40:22.911 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-30T06:40:22.945 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking dump (0.4b47-3) ... 2024-05-30T06:40:23.122 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-30T06:40:23.137 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-30T06:40:23.188 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T06:40:23.258 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package indent. 2024-05-30T06:40:23.273 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-30T06:40:23.316 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-30T06:40:23.458 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-30T06:40:23.473 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-30T06:40:23.508 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T06:40:23.585 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-30T06:40:23.613 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-30T06:40:23.643 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-30T06:40:23.702 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-30T06:40:23.717 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-30T06:40:23.785 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-30T06:40:23.947 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-30T06:40:23.964 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-30T06:40:24.005 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-30T06:40:24.272 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-30T06:40:24.287 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-30T06:40:24.330 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-30T06:40:24.383 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-30T06:40:24.400 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-30T06:40:24.441 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-30T06:40:24.633 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package modemmanager. 2024-05-30T06:40:24.649 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-30T06:40:24.683 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T06:40:24.787 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-30T06:40:24.803 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-30T06:40:24.845 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-30T06:40:25.097 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-30T06:40:25.113 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-30T06:40:25.147 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-30T06:40:25.290 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package network-manager. 2024-05-30T06:40:25.306 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-30T06:40:25.358 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libjson-perl. 2024-05-30T06:40:25.375 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-30T06:40:25.390 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-30T06:40:25.416 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-30T06:40:25.778 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-30T06:40:25.794 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-30T06:40:25.836 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-30T06:40:25.972 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package ppp. 2024-05-30T06:40:25.988 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-30T06:40:26.334 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-30T06:40:26.652 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package pptp-linux. 2024-05-30T06:40:26.666 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-30T06:40:26.710 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-30T06:40:26.982 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-30T06:40:26.997 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-30T06:40:27.046 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-30T06:40:27.189 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-30T06:40:27.206 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-30T06:40:27.247 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T06:40:27.425 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-30T06:40:27.439 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-30T06:40:27.474 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking postgresql-client-common (238) ... 2024-05-30T06:40:27.483 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-30T06:40:27.500 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-30T06:40:27.541 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T06:40:27.720 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-30T06:40:27.734 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-30T06:40:27.795 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-30T06:40:27.853 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-30T06:40:27.869 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-30T06:40:27.911 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T06:40:28.297 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-30T06:40:28.314 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-30T06:40:28.355 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-30T06:40:28.358 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package postgresql-common. 2024-05-30T06:40:28.373 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-30T06:40:28.425 INFO:teuthology.orchestra.run.smithi105.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-30T06:40:28.456 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking postgresql-common (238) ... 2024-05-30T06:40:28.642 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-30T06:40:28.658 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-30T06:40:28.691 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-30T06:40:28.957 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package postgresql-14. 2024-05-30T06:40:28.971 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-30T06:40:29.018 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-30T06:40:29.027 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-30T06:40:29.044 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-30T06:40:29.086 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-30T06:40:29.506 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-30T06:40:29.522 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-30T06:40:29.564 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T06:40:29.850 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-30T06:40:29.866 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-30T06:40:29.916 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T06:40:30.043 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package postgresql. 2024-05-30T06:40:30.057 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-30T06:40:30.101 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking postgresql (14+238) ... 2024-05-30T06:40:30.210 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-30T06:40:30.226 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-30T06:40:30.313 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-30T06:40:30.370 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package postgresql-client. 2024-05-30T06:40:30.384 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-30T06:40:30.428 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking postgresql-client (14+238) ... 2024-05-30T06:40:30.655 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-30T06:40:30.670 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-30T06:40:30.713 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-30T06:40:30.847 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-30T06:40:30.863 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-30T06:40:30.905 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-30T06:40:31.300 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package modemmanager. 2024-05-30T06:40:31.317 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-30T06:40:31.367 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T06:40:31.458 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package tcl8.6. 2024-05-30T06:40:31.474 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-30T06:40:31.518 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-30T06:40:31.812 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package tcl. 2024-05-30T06:40:31.828 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-30T06:40:31.873 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-30T06:40:31.965 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package network-manager. 2024-05-30T06:40:31.981 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-30T06:40:32.032 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-30T06:40:32.205 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package wpasupplicant. 2024-05-30T06:40:32.221 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-30T06:40:32.263 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-30T06:40:32.689 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ppp. 2024-05-30T06:40:32.700 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-30T06:40:32.705 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-30T06:40:32.716 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-30T06:40:32.759 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-30T06:40:33.063 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-30T06:40:33.120 INFO:teuthology.orchestra.run.smithi105.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-30T06:40:33.136 INFO:teuthology.orchestra.run.smithi105.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-30T06:40:33.187 INFO:teuthology.orchestra.run.smithi105.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-30T06:40:33.410 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package pptp-linux. 2024-05-30T06:40:33.424 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-30T06:40:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-30T06:40:33.514 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up postgresql-client-common (238) ... 2024-05-30T06:40:33.726 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-30T06:40:33.754 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-30T06:40:33.769 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-30T06:40:33.813 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-30T06:40:33.852 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-30T06:40:33.978 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-30T06:40:34.074 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-30T06:40:34.088 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-30T06:40:34.095 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-30T06:40:34.124 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql-client-common (238) ... 2024-05-30T06:40:34.197 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-30T06:40:34.356 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-30T06:40:34.427 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-30T06:40:34.442 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-30T06:40:34.535 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-30T06:40:35.149 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql-common. 2024-05-30T06:40:35.164 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-30T06:40:35.226 INFO:teuthology.orchestra.run.smithi037.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-30T06:40:35.256 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql-common (238) ... 2024-05-30T06:40:35.319 INFO:teuthology.orchestra.run.smithi105.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-30T06:40:35.420 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-30T06:40:35.680 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql-14. 2024-05-30T06:40:35.696 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-30T06:40:35.733 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-30T06:40:35.797 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-30T06:40:35.797 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-30T06:40:36.507 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-30T06:40:36.657 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-30T06:40:36.767 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-30T06:40:36.783 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql. 2024-05-30T06:40:36.798 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-30T06:40:36.833 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql (14+238) ... 2024-05-30T06:40:36.876 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-30T06:40:37.002 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-30T06:40:37.035 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql-client. 2024-05-30T06:40:37.050 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-30T06:40:37.116 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql-client (14+238) ... 2024-05-30T06:40:37.128 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-30T06:40:37.254 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-30T06:40:37.354 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-30T06:40:37.355 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-30T06:40:37.369 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-30T06:40:37.412 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-30T06:40:37.740 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package tcl8.6. 2024-05-30T06:40:37.755 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-30T06:40:37.798 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-30T06:40:38.067 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package tcl. 2024-05-30T06:40:38.084 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-30T06:40:38.130 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-30T06:40:38.143 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-30T06:40:38.294 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up dump (0.4b47-3) ... 2024-05-30T06:40:38.389 INFO:teuthology.orchestra.run.smithi105.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-30T06:40:38.445 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package wpasupplicant. 2024-05-30T06:40:38.446 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T06:40:38.461 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-30T06:40:38.503 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-30T06:40:38.547 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-30T06:40:38.673 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-30T06:40:38.799 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-30T06:40:38.857 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-30T06:40:38.873 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-30T06:40:38.915 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-30T06:40:38.925 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-30T06:40:39.015 INFO:teuthology.orchestra.run.smithi105.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-30T06:40:39.110 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-30T06:40:39.236 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-30T06:40:39.293 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-30T06:40:39.310 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-30T06:40:39.360 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-30T06:40:39.420 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-30T06:40:39.546 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T06:40:39.664 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-30T06:40:39.807 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up postgresql-client (14+238) ... 2024-05-30T06:40:39.958 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-30T06:40:40.397 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql-client-common (238) ... 2024-05-30T06:40:40.534 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:40:40.535 INFO:teuthology.orchestra.run.smithi105.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-30T06:40:40.535 INFO:teuthology.orchestra.run.smithi105.stdout:which means they are currently configured by ifupdown: 2024-05-30T06:40:40.535 INFO:teuthology.orchestra.run.smithi105.stdout:- enp3s0f1 2024-05-30T06:40:40.535 INFO:teuthology.orchestra.run.smithi105.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-30T06:40:40.535 INFO:teuthology.orchestra.run.smithi105.stdout:remove their configuration from /etc/network/interfaces. 2024-05-30T06:40:40.535 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:40:40.608 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-30T06:40:40.667 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-30T06:40:40.717 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-30T06:40:40.843 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-30T06:40:40.969 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-30T06:40:41.072 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-30T06:40:41.095 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-30T06:40:41.221 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-30T06:40:41.485 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-30T06:40:42.176 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-30T06:40:42.219 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T06:40:42.276 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-30T06:40:42.387 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-30T06:40:42.513 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-30T06:40:42.639 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up postgresql-common (238) ... 2024-05-30T06:40:42.662 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-30T06:40:42.662 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-30T06:40:43.346 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-30T06:40:43.447 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-30T06:40:43.564 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-30T06:40:43.580 INFO:teuthology.orchestra.run.smithi105.stdout:Adding user postgres to group ssl-cert 2024-05-30T06:40:43.690 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-30T06:40:43.816 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-30T06:40:43.823 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:40:43.823 INFO:teuthology.orchestra.run.smithi105.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-30T06:40:43.942 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-30T06:40:44.073 INFO:teuthology.orchestra.run.smithi105.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-30T06:40:44.073 INFO:teuthology.orchestra.run.smithi105.stdout:Removing obsolete dictionary files: 2024-05-30T06:40:44.093 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-30T06:40:44.219 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-30T06:40:44.810 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-30T06:40:44.941 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-30T06:40:45.067 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up dump (0.4b47-3) ... 2024-05-30T06:40:45.162 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-30T06:40:45.243 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T06:40:45.298 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-30T06:40:45.369 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-30T06:40:45.495 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-30T06:40:45.613 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-30T06:40:45.722 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-30T06:40:45.795 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-30T06:40:45.800 INFO:teuthology.orchestra.run.smithi105.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-30T06:40:45.817 INFO:teuthology.orchestra.run.smithi105.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-30T06:40:45.874 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-30T06:40:45.876 INFO:teuthology.orchestra.run.smithi105.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-30T06:40:45.876 INFO:teuthology.orchestra.run.smithi105.stdout:This user must also own the server process. 2024-05-30T06:40:45.876 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:40:45.877 INFO:teuthology.orchestra.run.smithi105.stdout:The database cluster will be initialized with locale "en_US". 2024-05-30T06:40:45.877 INFO:teuthology.orchestra.run.smithi105.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-30T06:40:45.877 INFO:teuthology.orchestra.run.smithi105.stdout:The default text search configuration will be set to "english". 2024-05-30T06:40:45.877 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:40:45.877 INFO:teuthology.orchestra.run.smithi105.stdout:Data page checksums are disabled. 2024-05-30T06:40:45.877 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:40:45.877 INFO:teuthology.orchestra.run.smithi105.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-30T06:40:45.878 INFO:teuthology.orchestra.run.smithi105.stdout:creating subdirectories ... ok 2024-05-30T06:40:45.878 INFO:teuthology.orchestra.run.smithi105.stdout:selecting dynamic shared memory implementation ... posix 2024-05-30T06:40:45.901 INFO:teuthology.orchestra.run.smithi105.stdout:selecting default max_connections ... 100 2024-05-30T06:40:45.933 INFO:teuthology.orchestra.run.smithi105.stdout:selecting default shared_buffers ... 128MB 2024-05-30T06:40:45.948 INFO:teuthology.orchestra.run.smithi105.stdout:selecting default time zone ... Etc/UTC 2024-05-30T06:40:45.949 INFO:teuthology.orchestra.run.smithi105.stdout:creating configuration files ... ok 2024-05-30T06:40:46.000 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-30T06:40:46.113 INFO:teuthology.orchestra.run.smithi105.stdout:running bootstrap script ... ok 2024-05-30T06:40:46.176 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-30T06:40:46.302 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T06:40:46.453 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-30T06:40:46.621 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql-client (14+238) ... 2024-05-30T06:40:46.730 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-30T06:40:46.749 INFO:teuthology.orchestra.run.smithi105.stdout:performing post-bootstrap initialization ... ok 2024-05-30T06:40:47.290 INFO:teuthology.orchestra.run.smithi105.stdout:syncing data to disk ... ok 2024-05-30T06:40:47.294 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:40:47.294 INFO:teuthology.orchestra.run.smithi037.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-30T06:40:47.294 INFO:teuthology.orchestra.run.smithi037.stdout:which means they are currently configured by ifupdown: 2024-05-30T06:40:47.294 INFO:teuthology.orchestra.run.smithi037.stdout:- ens1f0 2024-05-30T06:40:47.294 INFO:teuthology.orchestra.run.smithi037.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-30T06:40:47.294 INFO:teuthology.orchestra.run.smithi037.stdout:remove their configuration from /etc/network/interfaces. 2024-05-30T06:40:47.294 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:40:47.433 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-30T06:40:47.814 INFO:teuthology.orchestra.run.smithi105.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-30T06:40:47.837 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-30T06:40:48.223 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-30T06:40:48.933 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-30T06:40:49.084 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-30T06:40:49.210 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-30T06:40:49.336 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql-common (238) ... 2024-05-30T06:40:50.462 INFO:teuthology.orchestra.run.smithi037.stdout:Adding user postgres to group ssl-cert 2024-05-30T06:40:50.702 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:40:50.702 INFO:teuthology.orchestra.run.smithi037.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-30T06:40:50.906 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T06:40:50.967 INFO:teuthology.orchestra.run.smithi037.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-30T06:40:50.967 INFO:teuthology.orchestra.run.smithi037.stdout:Removing obsolete dictionary files: 2024-05-30T06:40:51.016 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-30T06:40:51.158 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up postgresql (14+238) ... 2024-05-30T06:40:51.284 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T06:40:51.410 INFO:teuthology.orchestra.run.smithi105.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T06:40:51.654 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-30T06:40:51.654 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-30T06:40:51.671 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-30T06:40:52.254 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-30T06:40:52.429 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-30T06:40:52.522 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-30T06:40:52.610 INFO:teuthology.orchestra.run.smithi037.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-30T06:40:52.632 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-30T06:40:52.694 INFO:teuthology.orchestra.run.smithi037.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-30T06:40:52.694 INFO:teuthology.orchestra.run.smithi037.stdout:This user must also own the server process. 2024-05-30T06:40:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:40:52.694 INFO:teuthology.orchestra.run.smithi037.stdout:The database cluster will be initialized with locale "en_US". 2024-05-30T06:40:52.694 INFO:teuthology.orchestra.run.smithi037.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-30T06:40:52.694 INFO:teuthology.orchestra.run.smithi037.stdout:The default text search configuration will be set to "english". 2024-05-30T06:40:52.694 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:40:52.695 INFO:teuthology.orchestra.run.smithi037.stdout:Data page checksums are disabled. 2024-05-30T06:40:52.695 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:40:52.695 INFO:teuthology.orchestra.run.smithi037.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-30T06:40:52.695 INFO:teuthology.orchestra.run.smithi037.stdout:creating subdirectories ... ok 2024-05-30T06:40:52.695 INFO:teuthology.orchestra.run.smithi037.stdout:selecting dynamic shared memory implementation ... posix 2024-05-30T06:40:52.719 INFO:teuthology.orchestra.run.smithi037.stdout:selecting default max_connections ... 100 2024-05-30T06:40:52.754 INFO:teuthology.orchestra.run.smithi037.stdout:selecting default shared_buffers ... 128MB 2024-05-30T06:40:52.770 INFO:teuthology.orchestra.run.smithi037.stdout:selecting default time zone ... Etc/UTC 2024-05-30T06:40:52.770 INFO:teuthology.orchestra.run.smithi037.stdout:creating configuration files ... ok 2024-05-30T06:40:52.865 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-30T06:40:52.944 INFO:teuthology.orchestra.run.smithi037.stdout:running bootstrap script ... ok 2024-05-30T06:40:53.017 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-30T06:40:53.599 INFO:teuthology.orchestra.run.smithi037.stdout:performing post-bootstrap initialization ... ok 2024-05-30T06:40:54.168 INFO:teuthology.orchestra.run.smithi037.stdout:syncing data to disk ... ok 2024-05-30T06:40:54.394 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-30T06:40:54.495 INFO:teuthology.orchestra.run.smithi105.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-30T06:40:54.673 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-30T06:40:55.038 INFO:teuthology.orchestra.run.smithi105.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-30T06:40:55.047 DEBUG:teuthology.parallel:result is None 2024-05-30T06:40:57.744 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T06:40:57.870 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-30T06:40:57.981 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql (14+238) ... 2024-05-30T06:40:58.107 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-30T06:40:58.233 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-30T06:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-30T06:40:58.504 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-30T06:40:59.227 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-30T06:40:59.328 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-30T06:40:59.671 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-30T06:40:59.832 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-30T06:41:01.484 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-30T06:41:01.576 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-30T06:41:02.121 INFO:teuthology.orchestra.run.smithi037.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-30T06:41:02.128 DEBUG:teuthology.parallel:result is None 2024-05-30T06:41:02.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T06:41:02.360 DEBUG:teuthology.orchestra.run.smithi037:> dpkg-query -W -f '${Version}' ceph 2024-05-30T06:41:02.382 INFO:teuthology.orchestra.run.smithi037.stdout:19.0.0-3154-g9ed025fb-1jammy 2024-05-30T06:41:02.383 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154-g9ed025fb-1jammy 2024-05-30T06:41:02.383 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154-g9ed025fb-1jammy is installed. 2024-05-30T06:41:02.385 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9ed025fbf4406fb54980a0647506b15895b6d863 2024-05-30T06:41:02.526 DEBUG:teuthology.orchestra.run.smithi105:> dpkg-query -W -f '${Version}' ceph 2024-05-30T06:41:02.550 INFO:teuthology.orchestra.run.smithi105.stdout:19.0.0-3154-g9ed025fb-1jammy 2024-05-30T06:41:02.550 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154-g9ed025fb-1jammy 2024-05-30T06:41:02.551 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154-g9ed025fb-1jammy is installed. 2024-05-30T06:41:02.552 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-30T06:41:02.553 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:02.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-30T06:41:02.573 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:02.573 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-30T06:41:02.615 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-30T06:41:02.615 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:02.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-05-30T06:41:02.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-30T06:41:02.700 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:02.700 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/daemon-helper 2024-05-30T06:41:02.720 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-30T06:41:02.785 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-30T06:41:02.785 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:02.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-30T06:41:02.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-30T06:41:02.868 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:02.868 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-30T06:41:02.890 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-30T06:41:02.957 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-30T06:41:02.957 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:02.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-05-30T06:41:02.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-30T06:41:03.043 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:03.043 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/stdin-killer 2024-05-30T06:41:03.064 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-30T06:41:03.125 INFO:teuthology.run_tasks:Running task ceph... 2024-05-30T06:41:03.196 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-30T06:41:03.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2024-05-30T06:41:03.199 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 777 /var/log/ceph 2024-05-30T06:41:03.220 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-30T06:41:03.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-30T06:41:03.259 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-30T06:41:03.281 INFO:tasks.ceph:Creating extra log directories... 2024-05-30T06:41:03.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-30T06:41:03.319 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-30T06:41:03.352 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-30T06:41:03.352 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-30T06:41:03.352 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-30T06:41:03.352 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:03.352 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-30T06:41:03.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-30T06:41:03.479 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:03.479 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-30T06:41:03.488 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-30T06:41:03.582 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-30T06:41:03.582 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-30T06:41:03.583 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027', 'branch': 'rishabh-clone-stats', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}}', 'email': None, 'first_in_suite': False, 'job_id': '7734027', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'rishabh-clone-stats'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'mgr-vol-clone-stats', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4766, 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'mgr-vol-clone-stats', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '9ed025fbf4406fb54980a0647506b15895b6d863', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPxBWzaBjqfXc3wCuNvFIMAhOW+1Cf+0Qsxr+0WjAX7WY7f0yEZKsSU334ANRWdnBiGvpwYyx07wU1s9+aOetaw=', 'smithi105.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFMAcnXSaELV3e9SHWazFhj1NpErpfqBFtJ0ncGbBp//g1a9vEPwGjrqvg/u21rkMrK1NAmyGRGOykrBZIHJmx0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': 1, 'sha1': 'b9459a26b0888785d05c47deb35abc9d0354ab93'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '9ed025fbf4406fb54980a0647506b15895b6d863', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestCloneProgressReporter']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e1979f064b0becde2020282c7e87cf3c5e98026c', 'timestamp': '2024-05-30_06:18:46', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-05-30T06:41:03.583 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-30T06:41:03.586 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-30T06:41:03.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2024-05-30T06:41:03.639 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/run/ceph 2024-05-30T06:41:03.660 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:03.660 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-05-30T06:41:03.708 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-30T06:41:03.708 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-05-30T06:41:03.761 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-30T06:41:03.761 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T06:41:03.761 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 901 Links: 1 2024-05-30T06:41:03.761 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T06:41:03.761 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-05-30 06:34:36.950746313 +0000 2024-05-30T06:41:03.761 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-05-30 06:34:36.670748814 +0000 2024-05-30T06:41:03.761 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-05-30 06:34:36.670748814 +0000 2024-05-30T06:41:03.761 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-05-30 06:34:36.670748814 +0000 2024-05-30T06:41:03.762 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-30T06:41:03.826 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-05-30T06:41:03.826 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-05-30T06:41:03.826 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000354738 s, 1.4 MB/s 2024-05-30T06:41:03.828 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-30T06:41:03.879 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-05-30T06:41:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-30T06:41:03.929 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T06:41:03.929 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 918 Links: 1 2024-05-30T06:41:03.929 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T06:41:03.929 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-05-30 06:34:37.518741239 +0000 2024-05-30T06:41:03.930 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-05-30 06:34:37.246743669 +0000 2024-05-30T06:41:03.930 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-05-30 06:34:37.246743669 +0000 2024-05-30T06:41:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-05-30 06:34:37.246743669 +0000 2024-05-30T06:41:03.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-30T06:41:03.994 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-05-30T06:41:03.994 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-05-30T06:41:03.994 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000346325 s, 1.5 MB/s 2024-05-30T06:41:03.996 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-30T06:41:04.047 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-05-30T06:41:04.096 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-30T06:41:04.097 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T06:41:04.097 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 934 Links: 1 2024-05-30T06:41:04.097 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T06:41:04.097 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-05-30 06:34:38.086736166 +0000 2024-05-30T06:41:04.097 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-05-30 06:34:37.822738524 +0000 2024-05-30T06:41:04.097 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-05-30 06:34:37.822738524 +0000 2024-05-30T06:41:04.097 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-05-30 06:34:37.822738524 +0000 2024-05-30T06:41:04.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-30T06:41:04.158 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-05-30T06:41:04.158 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-05-30T06:41:04.158 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000349876 s, 1.5 MB/s 2024-05-30T06:41:04.160 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-30T06:41:04.210 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-05-30T06:41:04.261 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-30T06:41:04.261 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T06:41:04.261 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 950 Links: 1 2024-05-30T06:41:04.261 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T06:41:04.261 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-05-30 06:34:38.666730986 +0000 2024-05-30T06:41:04.261 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-05-30 06:34:38.398733379 +0000 2024-05-30T06:41:04.261 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-05-30 06:34:38.398733379 +0000 2024-05-30T06:41:04.261 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-05-30 06:34:38.398733379 +0000 2024-05-30T06:41:04.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-30T06:41:04.323 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-05-30T06:41:04.323 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-05-30T06:41:04.323 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000365075 s, 1.4 MB/s 2024-05-30T06:41:04.325 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-30T06:41:04.379 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T06:41:04.379 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:04.379 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/scratch_devs of=/dev/stdout 2024-05-30T06:41:04.388 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-30T06:41:04.388 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_1 2024-05-30T06:41:04.438 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-30T06:41:04.438 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T06:41:04.438 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 894 Links: 1 2024-05-30T06:41:04.438 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T06:41:04.438 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-05-30 06:34:31.514048359 +0000 2024-05-30T06:41:04.438 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-05-30 06:34:31.254050682 +0000 2024-05-30T06:41:04.438 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-05-30 06:34:31.254050682 +0000 2024-05-30T06:41:04.438 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-05-30 06:34:31.254050682 +0000 2024-05-30T06:41:04.439 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-30T06:41:04.499 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-05-30T06:41:04.500 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-05-30T06:41:04.500 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000395084 s, 1.3 MB/s 2024-05-30T06:41:04.502 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-30T06:41:04.555 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_2 2024-05-30T06:41:04.610 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-30T06:41:04.610 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T06:41:04.610 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 910 Links: 1 2024-05-30T06:41:04.610 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T06:41:04.610 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-05-30 06:34:32.062043464 +0000 2024-05-30T06:41:04.610 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-05-30 06:34:31.814045679 +0000 2024-05-30T06:41:04.610 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-05-30 06:34:31.814045679 +0000 2024-05-30T06:41:04.610 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-05-30 06:34:31.814045679 +0000 2024-05-30T06:41:04.611 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-30T06:41:04.672 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-05-30T06:41:04.673 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-05-30T06:41:04.673 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000657834 s, 778 kB/s 2024-05-30T06:41:04.674 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-30T06:41:04.731 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_3 2024-05-30T06:41:04.781 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-30T06:41:04.781 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T06:41:04.782 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 929 Links: 1 2024-05-30T06:41:04.782 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T06:41:04.782 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-05-30 06:34:32.606038606 +0000 2024-05-30T06:41:04.782 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-05-30 06:34:32.366040749 +0000 2024-05-30T06:41:04.782 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-05-30 06:34:32.366040749 +0000 2024-05-30T06:41:04.782 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-05-30 06:34:32.366040749 +0000 2024-05-30T06:41:04.782 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-30T06:41:04.844 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-05-30T06:41:04.844 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-05-30T06:41:04.844 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000380034 s, 1.3 MB/s 2024-05-30T06:41:04.846 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-30T06:41:04.899 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_4 2024-05-30T06:41:04.950 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-30T06:41:04.950 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-30T06:41:04.950 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 947 Links: 1 2024-05-30T06:41:04.950 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-30T06:41:04.951 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-05-30 06:34:33.154033710 +0000 2024-05-30T06:41:04.951 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-05-30 06:34:32.898035997 +0000 2024-05-30T06:41:04.951 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-05-30 06:34:32.898035997 +0000 2024-05-30T06:41:04.951 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-05-30 06:34:32.898035997 +0000 2024-05-30T06:41:04.951 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-30T06:41:05.012 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-05-30T06:41:05.012 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-05-30T06:41:05.012 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000655145 s, 782 kB/s 2024-05-30T06:41:05.015 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-30T06:41:05.068 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T06:41:05.068 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-30T06:41:05.068 INFO:tasks.ceph:Generating config... 2024-05-30T06:41:05.071 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-30T06:41:05.071 INFO:tasks.ceph:[client] debug client = 20 2024-05-30T06:41:05.071 INFO:tasks.ceph:[client] debug ms = 1 2024-05-30T06:41:05.071 INFO:tasks.ceph:[client] pid file = 2024-05-30T06:41:05.071 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-30T06:41:05.072 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-30T06:41:05.072 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-30T06:41:05.072 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-30T06:41:05.072 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-30T06:41:05.072 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-30T06:41:05.072 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-30T06:41:05.073 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-30T06:41:05.073 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-30T06:41:05.073 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-30T06:41:05.073 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-30T06:41:05.073 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-30T06:41:05.073 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-30T06:41:05.074 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-30T06:41:05.074 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-05-30T06:41:05.075 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-30T06:41:05.075 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-30T06:41:05.075 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-30T06:41:05.075 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-30T06:41:05.075 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-30T06:41:05.075 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-30T06:41:05.075 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-30T06:41:05.075 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-30T06:41:05.075 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-30T06:41:05.075 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-30T06:41:05.075 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-30T06:41:05.075 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-30T06:41:05.075 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-30T06:41:05.076 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-30T06:41:05.076 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-30T06:41:05.076 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-30T06:41:05.076 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-30T06:41:05.076 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-30T06:41:05.076 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-30T06:41:05.076 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-30T06:41:05.076 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-30T06:41:05.076 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-30T06:41:05.076 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-30T06:41:05.076 INFO:tasks.ceph:Setting up mon.a... 2024-05-30T06:41:05.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-30T06:41:05.124 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2024-05-30T06:41:05.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-30T06:41:05.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-30T06:41:05.252 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.b', '172.21.15.105'), ('mon.c', '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]')] 2024-05-30T06:41:05.253 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-30T06:41:05.254 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:05.254 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-30T06:41:05.301 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --add b 172.21.15.105 --addv c '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:05.397 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:05.397 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid 393250aa-2b42-4955-adf1-f790b8ba4d8c 2024-05-30T06:41:05.397 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-05-30T06:41:05.397 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2024-05-30T06:41:05.397 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 393250aa-2b42-4955-adf1-f790b8ba4d8c 2024-05-30T06:41:05.397 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2024-05-30T06:41:05.399439+0000 2024-05-30T06:41:05.397 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-05-30T06:41:05.399439+0000 2024-05-30T06:41:05.397 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 17 (quincy) 2024-05-30T06:41:05.397 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2024-05-30T06:41:05.397 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-05-30T06:41:05.397 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-05-30T06:41:05.398 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] mon.c 2024-05-30T06:41:05.398 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-30T06:41:05.400 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-30T06:41:05.408 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 393250aa-2b42-4955-adf1-f790b8ba4d8c... 2024-05-30T06:41:05.409 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-30T06:41:05.451 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-30T06:41:05.492 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-05-30T06:41:05.492 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2024-05-30T06:41:05.492 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-30T06:41:05.492 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2024-05-30T06:41:05.492 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.492 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2024-05-30T06:41:05.493 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-30T06:41:05.494 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.494 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2024-05-30T06:41:05.494 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.494 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2024-05-30T06:41:05.494 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2024-05-30T06:41:05.494 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2024-05-30T06:41:05.494 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2024-05-30T06:41:05.494 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2024-05-30T06:41:05.494 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2024-05-30T06:41:05.494 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2024-05-30T06:41:05.494 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-30T06:41:05.494 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-30T06:41:05.495 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2024-05-30T06:41:05.495 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.495 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-30T06:41:05.495 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.495 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2024-05-30T06:41:05.495 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.495 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2024-05-30T06:41:05.495 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.495 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2024-05-30T06:41:05.495 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2024-05-30T06:41:05.495 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2024-05-30T06:41:05.495 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2024-05-30T06:41:05.496 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on skipped message = False 2024-05-30T06:41:05.496 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 393250aa-2b42-4955-adf1-f790b8ba4d8c 2024-05-30T06:41:05.496 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.496 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2024-05-30T06:41:05.496 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2024-05-30T06:41:05.496 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.496 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2024-05-30T06:41:05.496 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2024-05-30T06:41:05.496 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2024-05-30T06:41:05.496 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.496 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2024-05-30T06:41:05.496 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2024-05-30T06:41:05.496 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.497 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2024-05-30T06:41:05.497 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2024-05-30T06:41:05.497 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2024-05-30T06:41:05.497 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2024-05-30T06:41:05.497 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.497 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2024-05-30T06:41:05.497 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2024-05-30T06:41:05.497 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.497 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2024-05-30T06:41:05.497 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.497 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2024-05-30T06:41:05.497 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.497 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2024-05-30T06:41:05.498 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.498 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2024-05-30T06:41:05.498 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2024-05-30T06:41:05.498 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.498 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2024-05-30T06:41:05.498 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2024-05-30T06:41:05.498 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2024-05-30T06:41:05.498 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2024-05-30T06:41:05.498 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2024-05-30T06:41:05.498 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2024-05-30T06:41:05.498 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2024-05-30T06:41:05.498 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2024-05-30T06:41:05.499 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2024-05-30T06:41:05.499 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-30T06:41:05.499 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2024-05-30T06:41:05.499 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2024-05-30T06:41:05.499 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2024-05-30T06:41:05.499 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2024-05-30T06:41:05.499 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2024-05-30T06:41:05.499 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2024-05-30T06:41:05.499 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2024-05-30T06:41:05.499 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-05-30T06:41:05.499 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.499 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2024-05-30T06:41:05.499 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout: debug finisher = 20 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2024-05-30T06:41:05.500 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-30T06:41:05.501 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout: mon down mkfs grace = 300 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-30T06:41:05.502 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2024-05-30T06:41:05.503 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2024-05-30T06:41:05.504 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2024-05-30T06:41:05.504 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-05-30T06:41:05.505 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2024-05-30T06:41:05.505 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2024-05-30T06:41:05.505 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2024-05-30T06:41:05.505 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2024-05-30T06:41:05.505 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2024-05-30T06:41:05.505 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2024-05-30T06:41:05.505 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2024-05-30T06:41:05.506 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2024-05-30T06:41:05.506 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2024-05-30T06:41:05.506 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-30T06:41:05.506 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2024-05-30T06:41:05.506 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.506 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2024-05-30T06:41:05.506 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.506 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2024-05-30T06:41:05.506 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2024-05-30T06:41:05.507 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2024-05-30T06:41:05.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2024-05-30T06:41:05.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2024-05-30T06:41:05.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2024-05-30T06:41:05.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2024-05-30T06:41:05.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2024-05-30T06:41:05.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-30T06:41:05.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-30T06:41:05.508 INFO:teuthology.orchestra.run.smithi105.stdout: mon_allow_pool_size_one = true 2024-05-30T06:41:05.508 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.508 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-30T06:41:05.508 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.508 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2024-05-30T06:41:05.509 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.509 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2024-05-30T06:41:05.509 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.509 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2024-05-30T06:41:05.509 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2024-05-30T06:41:05.509 INFO:teuthology.orchestra.run.smithi105.stdout: mon health detail to clog = false 2024-05-30T06:41:05.509 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.37,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2024-05-30T06:41:05.509 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on skipped message = False 2024-05-30T06:41:05.509 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = 393250aa-2b42-4955-adf1-f790b8ba4d8c 2024-05-30T06:41:05.509 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.509 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2024-05-30T06:41:05.509 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2024-05-30T06:41:05.509 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.510 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2024-05-30T06:41:05.510 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2024-05-30T06:41:05.510 INFO:teuthology.orchestra.run.smithi105.stdout: osd mclock profile = high_recovery_ops 2024-05-30T06:41:05.510 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.510 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2024-05-30T06:41:05.510 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2024-05-30T06:41:05.510 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.510 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2024-05-30T06:41:05.510 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2024-05-30T06:41:05.510 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2024-05-30T06:41:05.510 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug trim objects = true 2024-05-30T06:41:05.510 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.511 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2024-05-30T06:41:05.511 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2024-05-30T06:41:05.511 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.511 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2024-05-30T06:41:05.511 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.511 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2024-05-30T06:41:05.511 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.511 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2024-05-30T06:41:05.511 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.511 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2024-05-30T06:41:05.511 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2024-05-30T06:41:05.511 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: bdev async discard = True 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: bdev enable discard = True 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore allocator = bitmap 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 1/20 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 1/20 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 20 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 4/10 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2024-05-30T06:41:05.512 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: debug finisher = 20 2024-05-30T06:41:05.513 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.514 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2024-05-30T06:41:05.514 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-05-30T06:41:05.514 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2024-05-30T06:41:05.514 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2024-05-30T06:41:05.514 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2024-05-30T06:41:05.514 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2024-05-30T06:41:05.514 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2024-05-30T06:41:05.514 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2024-05-30T06:41:05.514 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2024-05-30T06:41:05.514 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2024-05-30T06:41:05.514 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2024-05-30T06:41:05.514 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.515 INFO:teuthology.orchestra.run.smithi105.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-30T06:41:05.515 INFO:teuthology.orchestra.run.smithi105.stdout: auth mon ticket ttl = 660 # 11m 2024-05-30T06:41:05.515 INFO:teuthology.orchestra.run.smithi105.stdout: auth service ticket ttl = 240 # 4m 2024-05-30T06:41:05.515 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.515 INFO:teuthology.orchestra.run.smithi105.stdout: # don't complain about insecure global_id in the test suite 2024-05-30T06:41:05.515 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-30T06:41:05.515 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-30T06:41:05.515 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.515 INFO:teuthology.orchestra.run.smithi105.stdout: # 1m isn't quite enough 2024-05-30T06:41:05.515 INFO:teuthology.orchestra.run.smithi105.stdout: mon_down_mkfs_grace = 2m 2024-05-30T06:41:05.515 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.515 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_filestore_osds = false 2024-05-30T06:41:05.515 INFO:teuthology.orchestra.run.smithi105.stdout: mon down mkfs grace = 300 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout: mon op complaint time = 120 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout: client mount timeout = 600 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = "" 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2024-05-30T06:41:05.516 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2024-05-30T06:41:05.517 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2024-05-30T06:41:05.517 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2024-05-30T06:41:05.517 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2024-05-30T06:41:05.517 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2024-05-30T06:41:05.517 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2024-05-30T06:41:05.517 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2024-05-30T06:41:05.517 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2024-05-30T06:41:05.517 INFO:teuthology.orchestra.run.smithi105.stdout:[mds] 2024-05-30T06:41:05.517 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds = 20 2024-05-30T06:41:05.517 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds balancer = 20 2024-05-30T06:41:05.517 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-05-30T06:41:05.517 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug frag = True 2024-05-30T06:41:05.517 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug scatterstat = True 2024-05-30T06:41:05.518 INFO:teuthology.orchestra.run.smithi105.stdout: mds op complaint time = 180 2024-05-30T06:41:05.518 INFO:teuthology.orchestra.run.smithi105.stdout: mds verify scatter = True 2024-05-30T06:41:05.518 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2024-05-30T06:41:05.518 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2024-05-30T06:41:05.518 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2024-05-30T06:41:05.519 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-30T06:41:05.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-30T06:41:05.617 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-30T06:41:05.617 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:05.617 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-30T06:41:05.626 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:05.626 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-30T06:41:05.680 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:41:05.680 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:05.680 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-30T06:41:05.680 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-30T06:41:05.756 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:05.756 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:05.804 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi105.front.sepia.ceph.com 2024-05-30T06:41:05.805 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:05.805 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-30T06:41:05.805 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-30T06:41:05.840 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:05.840 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:05.889 INFO:tasks.ceph:Setting up mon nodes... 2024-05-30T06:41:05.890 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-30T06:41:05.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-30T06:41:05.946 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-30T06:41:05.952 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-30T06:41:06.010 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-30T06:41:06.024 INFO:tasks.ceph:Setting up mds nodes... 2024-05-30T06:41:06.024 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-30T06:41:06.079 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-30T06:41:06.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-30T06:41:06.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-30T06:41:06.201 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-30T06:41:06.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-30T06:41:06.225 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-30T06:41:06.283 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-30T06:41:06.288 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-30T06:41:06.309 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-30T06:41:06.404 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-30T06:41:06.408 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-30T06:41:06.428 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-30T06:41:06.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-30T06:41:06.471 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-30T06:41:06.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-30T06:41:06.576 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-30T06:41:06.593 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-30T06:41:06.634 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-30T06:41:06.651 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-30T06:41:06.735 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-30T06:41:06.751 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-30T06:41:06.751 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-30T06:41:06.751 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-30T06:41:06.771 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T06:41:06.771 INFO:tasks.ceph:role: osd.0 2024-05-30T06:41:06.771 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:41:06.771 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-30T06:41:06.839 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T06:41:06.840 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T06:41:06.840 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T06:41:06.840 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T06:41:06.840 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T06:41:06.840 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-05-30T06:41:06.840 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T06:41:06.840 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T06:41:06.840 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T06:41:06.840 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T06:41:07.225 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-05-30T06:41:07.227 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-05-30T06:41:07.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-30T06:41:07.325 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-30T06:41:07.342 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T06:41:07.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:41:07.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-30T06:41:07.404 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T06:41:07.404 INFO:tasks.ceph:role: osd.1 2024-05-30T06:41:07.404 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:41:07.404 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-30T06:41:07.476 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T06:41:07.476 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T06:41:07.476 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T06:41:07.476 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T06:41:07.476 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T06:41:07.476 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-05-30T06:41:07.476 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T06:41:07.476 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T06:41:07.476 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T06:41:07.476 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T06:41:07.868 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-05-30T06:41:07.871 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-05-30T06:41:07.872 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-30T06:41:07.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-30T06:41:08.012 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T06:41:08.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:41:08.014 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-30T06:41:08.078 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T06:41:08.078 INFO:tasks.ceph:role: osd.2 2024-05-30T06:41:08.078 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:41:08.078 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-30T06:41:08.149 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T06:41:08.150 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T06:41:08.150 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T06:41:08.150 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T06:41:08.150 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T06:41:08.150 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-05-30T06:41:08.150 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T06:41:08.150 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T06:41:08.150 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T06:41:08.150 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T06:41:08.564 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-05-30T06:41:08.567 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-05-30T06:41:08.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-30T06:41:08.710 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-30T06:41:08.728 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T06:41:08.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:41:08.729 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-30T06:41:08.794 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-30T06:41:08.794 INFO:tasks.ceph:role: osd.3 2024-05-30T06:41:08.794 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:41:08.794 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-30T06:41:08.865 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T06:41:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T06:41:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T06:41:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T06:41:08.866 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T06:41:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-05-30T06:41:08.866 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T06:41:08.866 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T06:41:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T06:41:08.866 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T06:41:09.221 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-05-30T06:41:09.224 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-05-30T06:41:09.224 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-30T06:41:09.307 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-30T06:41:09.366 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T06:41:09.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:41:09.367 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:09.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:09.504+0000 7fdfecde17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-30T06:41:09.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:09.508+0000 7fdfecde17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-30T06:41:09.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:09.508+0000 7fdfecde17c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-30T06:41:09.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:09.508+0000 7fdfecde17c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-30T06:41:09.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:09.508+0000 7fdfecde17c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-30T06:41:09.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:09.512+0000 7fdfecde17c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-30T06:41:12.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-30T06:41:12.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:12.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:12.684+0000 7feb7e2a27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-30T06:41:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:12.684+0000 7feb7e2a27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-30T06:41:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:12.684+0000 7feb7e2a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-30T06:41:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:12.684+0000 7feb7e2a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-30T06:41:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:12.684+0000 7feb7e2a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-30T06:41:12.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:12.684+0000 7feb7e2a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-30T06:41:15.751 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-30T06:41:15.773 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:15.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:15.872+0000 7fd7d4a8c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-30T06:41:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:15.872+0000 7fd7d4a8c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-30T06:41:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:15.872+0000 7fd7d4a8c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-30T06:41:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:15.872+0000 7fd7d4a8c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-30T06:41:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:15.872+0000 7fd7d4a8c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-30T06:41:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:15.872+0000 7fd7d4a8c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-30T06:41:18.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-30T06:41:18.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:19.044+0000 7fdd3adda7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-30T06:41:19.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:19.044+0000 7fdd3adda7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-30T06:41:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:19.044+0000 7fdd3adda7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-30T06:41:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:19.044+0000 7fdd3adda7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-30T06:41:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:19.044+0000 7fdd3adda7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-30T06:41:19.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:19.048+0000 7fdd3adda7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-30T06:41:22.099 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-30T06:41:22.121 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-30T06:41:22.142 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T06:41:22.142 INFO:tasks.ceph:role: osd.4 2024-05-30T06:41:22.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com 2024-05-30T06:41:22.143 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-30T06:41:22.217 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T06:41:22.217 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T06:41:22.217 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T06:41:22.218 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T06:41:22.218 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T06:41:22.218 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-05-30T06:41:22.218 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T06:41:22.218 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T06:41:22.218 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T06:41:22.218 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T06:41:22.631 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-05-30T06:41:22.634 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-05-30T06:41:22.635 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-30T06:41:22.776 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-30T06:41:22.794 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T06:41:22.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:41:22.795 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-30T06:41:22.857 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T06:41:22.857 INFO:tasks.ceph:role: osd.5 2024-05-30T06:41:22.857 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com 2024-05-30T06:41:22.857 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-30T06:41:22.933 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T06:41:22.933 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T06:41:22.933 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T06:41:22.933 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T06:41:22.933 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T06:41:22.933 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-05-30T06:41:22.933 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T06:41:22.933 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T06:41:22.933 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T06:41:22.933 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T06:41:23.294 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-05-30T06:41:23.297 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-05-30T06:41:23.298 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-30T06:41:23.377 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-30T06:41:23.437 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T06:41:23.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:41:23.438 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-30T06:41:23.505 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T06:41:23.505 INFO:tasks.ceph:role: osd.6 2024-05-30T06:41:23.505 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com 2024-05-30T06:41:23.505 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-30T06:41:23.577 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T06:41:23.577 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T06:41:23.578 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T06:41:23.578 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T06:41:23.578 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T06:41:23.578 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-05-30T06:41:23.578 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T06:41:23.578 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T06:41:23.578 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T06:41:23.578 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T06:41:23.967 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-05-30T06:41:23.970 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-05-30T06:41:23.971 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-30T06:41:24.076 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-30T06:41:24.092 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T06:41:24.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:41:24.094 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-30T06:41:24.157 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-30T06:41:24.157 INFO:tasks.ceph:role: osd.7 2024-05-30T06:41:24.157 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com 2024-05-30T06:41:24.158 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-30T06:41:24.229 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-30T06:41:24.229 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-30T06:41:24.229 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-30T06:41:24.230 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-30T06:41:24.230 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-30T06:41:24.230 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-05-30T06:41:24.230 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-30T06:41:24.230 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-30T06:41:24.230 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-30T06:41:24.230 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-30T06:41:24.650 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-05-30T06:41:24.654 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-05-30T06:41:24.654 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-30T06:41:24.796 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-30T06:41:24.813 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: /sbin/restorecon: command not found 2024-05-30T06:41:24.813 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:41:24.814 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:24.940 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:24.939+0000 7f86020fb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-30T06:41:24.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:24.947+0000 7f86020fb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-30T06:41:24.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:24.947+0000 7f86020fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-30T06:41:24.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:24.947+0000 7f86020fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-30T06:41:24.948 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:24.947+0000 7f86020fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-30T06:41:24.956 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:24.955+0000 7f86020fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-30T06:41:28.029 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-30T06:41:28.049 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:28.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:28.143+0000 7f0b48a2b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-30T06:41:28.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:28.143+0000 7f0b48a2b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-30T06:41:28.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:28.143+0000 7f0b48a2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-30T06:41:28.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:28.143+0000 7f0b48a2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-30T06:41:28.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:28.143+0000 7f0b48a2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-30T06:41:28.145 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:28.147+0000 7f0b48a2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-30T06:41:31.176 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-30T06:41:31.196 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:31.287 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:31.287+0000 7fa92d0297c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-30T06:41:31.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:31.287+0000 7fa92d0297c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-30T06:41:31.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:31.287+0000 7fa92d0297c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-30T06:41:31.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:31.287+0000 7fa92d0297c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-30T06:41:31.288 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:31.287+0000 7fa92d0297c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-30T06:41:31.289 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:31.291+0000 7fa92d0297c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-30T06:41:33.584 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:41:33.588 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:41:34.378 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-30T06:41:34.398 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:34.495 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:34.494+0000 7f3d151677c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-30T06:41:34.496 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:34.494+0000 7f3d151677c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-30T06:41:34.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:34.494+0000 7f3d151677c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-30T06:41:34.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:34.494+0000 7f3d151677c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-30T06:41:34.497 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:34.494+0000 7f3d151677c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-30T06:41:34.498 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:34.498+0000 7f3d151677c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-30T06:41:37.543 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-30T06:41:37.564 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-30T06:41:37.564 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:37.564 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-30T06:41:37.587 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:37.587 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-30T06:41:37.654 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:37.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-30T06:41:37.721 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:37.721 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-30T06:41:37.789 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:37.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-30T06:41:37.857 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:37.857 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-30T06:41:37.924 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:37.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-30T06:41:37.992 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:37.992 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-30T06:41:38.014 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:38.014 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-30T06:41:38.082 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:38.082 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-30T06:41:38.146 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:38.146 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-30T06:41:38.209 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:38.210 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-30T06:41:38.273 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:38.274 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-30T06:41:38.333 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:38.334 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-30T06:41:38.397 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:38.397 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-30T06:41:38.406 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:38.406 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-30T06:41:38.461 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:38.461 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-30T06:41:38.470 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:38.470 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-30T06:41:38.522 INFO:tasks.ceph:Adding keys to all mons... 2024-05-30T06:41:38.522 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-30T06:41:38.525 DEBUG:teuthology.orchestra.run.smithi105:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-30T06:41:38.573 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2024-05-30T06:41:38.573 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCBH1hmNdeSOBAA3V4vK0bNlWFoosV41f/ASQ== 2024-05-30T06:41:38.573 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2024-05-30T06:41:38.573 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmcRfnBBAAk60J/SRTolMhKoS8b8A9jQ== 2024-05-30T06:41:38.573 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2024-05-30T06:41:38.574 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hm2jEhDBAAGKUYGtJznRYpt1LHlMOTrw== 2024-05-30T06:41:38.574 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2024-05-30T06:41:38.574 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCFH1hmygxjHhAA1ee1eBP6dvsC0K9w+6d0OQ== 2024-05-30T06:41:38.574 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2024-05-30T06:41:38.574 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCIH1hmNJsBKRAAhns5CNodS7CKFU1Jg3PFCA== 2024-05-30T06:41:38.574 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2024-05-30T06:41:38.574 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCLH1hmlx5FNBAAn2Iann8U/uTZy0tFcFx04w== 2024-05-30T06:41:38.574 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2024-05-30T06:41:38.574 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCPH1hmxJnxAhAAt5cEb3YVLDhkQD5WjLQuog== 2024-05-30T06:41:38.574 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2024-05-30T06:41:38.574 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmN/fjABAAdldbCncRiHy6RFEF9H7gnQ== 2024-05-30T06:41:38.574 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2024-05-30T06:41:38.574 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmzScrERAAbIJ5somf+sguc6jEuR04zg== 2024-05-30T06:41:38.575 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2024-05-30T06:41:38.575 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hm95RdGBAAaaaNAKnr4Dtmu+L1NaMVbw== 2024-05-30T06:41:38.575 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2024-05-30T06:41:38.575 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCUH1hmEn5cOBAAFzBuH8TO418e4obqTNeIXg== 2024-05-30T06:41:38.575 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2024-05-30T06:41:38.575 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCYH1hmij3RCBAAHzQPoM1ClYGGEt6ly6ZrqQ== 2024-05-30T06:41:38.575 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2024-05-30T06:41:38.575 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCbH1hmDqdpERAA46/Bs4B/xVjviQ1gNpNaaw== 2024-05-30T06:41:38.575 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2024-05-30T06:41:38.575 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCeH1hmnrfVHRAAlqk48vSVw45YDCXWWb/MUA== 2024-05-30T06:41:38.575 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-30T06:41:38.575 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A== 2024-05-30T06:41:38.576 INFO:teuthology.orchestra.run.smithi037.stdout:[client.2] 2024-05-30T06:41:38.576 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hm1qB9IhAAszAwOgm2Igb1DM4diPC7ow== 2024-05-30T06:41:38.576 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2024-05-30T06:41:38.576 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmf8sdJhAATAP7EzLJxXXnXeEQL9fdpw== 2024-05-30T06:41:38.576 INFO:teuthology.orchestra.run.smithi037.stdout:[client.3] 2024-05-30T06:41:38.576 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmY6AULBAAYNza0fpC3KO69ulNQaSldQ== 2024-05-30T06:41:38.587 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.y] 2024-05-30T06:41:38.588 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCBH1hmNdeSOBAA3V4vK0bNlWFoosV41f/ASQ== 2024-05-30T06:41:38.588 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2024-05-30T06:41:38.588 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCCH1hmcRfnBBAAk60J/SRTolMhKoS8b8A9jQ== 2024-05-30T06:41:38.588 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2024-05-30T06:41:38.588 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCCH1hm2jEhDBAAGKUYGtJznRYpt1LHlMOTrw== 2024-05-30T06:41:38.588 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.0] 2024-05-30T06:41:38.588 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCFH1hmygxjHhAA1ee1eBP6dvsC0K9w+6d0OQ== 2024-05-30T06:41:38.588 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.1] 2024-05-30T06:41:38.588 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCIH1hmNJsBKRAAhns5CNodS7CKFU1Jg3PFCA== 2024-05-30T06:41:38.588 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.2] 2024-05-30T06:41:38.588 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCLH1hmlx5FNBAAn2Iann8U/uTZy0tFcFx04w== 2024-05-30T06:41:38.589 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.3] 2024-05-30T06:41:38.589 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCPH1hmxJnxAhAAt5cEb3YVLDhkQD5WjLQuog== 2024-05-30T06:41:38.589 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.x] 2024-05-30T06:41:38.589 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCCH1hmN/fjABAAdldbCncRiHy6RFEF9H7gnQ== 2024-05-30T06:41:38.589 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2024-05-30T06:41:38.589 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCCH1hmzScrERAAbIJ5somf+sguc6jEuR04zg== 2024-05-30T06:41:38.589 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2024-05-30T06:41:38.589 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCCH1hm95RdGBAAaaaNAKnr4Dtmu+L1NaMVbw== 2024-05-30T06:41:38.589 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.4] 2024-05-30T06:41:38.589 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCUH1hmEn5cOBAAFzBuH8TO418e4obqTNeIXg== 2024-05-30T06:41:38.589 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.5] 2024-05-30T06:41:38.589 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCYH1hmij3RCBAAHzQPoM1ClYGGEt6ly6ZrqQ== 2024-05-30T06:41:38.590 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.6] 2024-05-30T06:41:38.590 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCbH1hmDqdpERAA46/Bs4B/xVjviQ1gNpNaaw== 2024-05-30T06:41:38.590 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.7] 2024-05-30T06:41:38.590 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCeH1hmnrfVHRAAlqk48vSVw45YDCXWWb/MUA== 2024-05-30T06:41:38.590 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-05-30T06:41:38.590 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A== 2024-05-30T06:41:38.590 INFO:teuthology.orchestra.run.smithi105.stdout:[client.2] 2024-05-30T06:41:38.590 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCCH1hm1qB9IhAAszAwOgm2Igb1DM4diPC7ow== 2024-05-30T06:41:38.590 INFO:teuthology.orchestra.run.smithi105.stdout:[client.1] 2024-05-30T06:41:38.590 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCCH1hmf8sdJhAATAP7EzLJxXXnXeEQL9fdpw== 2024-05-30T06:41:38.590 INFO:teuthology.orchestra.run.smithi105.stdout:[client.3] 2024-05-30T06:41:38.590 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQCCH1hmY6AULBAAYNza0fpC3KO69ulNQaSldQ== 2024-05-30T06:41:38.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-30T06:41:38.623 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-30T06:41:38.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T06:41:38.695 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T06:41:38.830 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T06:41:38.833 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T06:41:38.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:38.893 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:38.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:38.949 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:39.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:39.006 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:39.059 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:39.062 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:39.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-30T06:41:39.118 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-30T06:41:39.171 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T06:41:39.174 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T06:41:39.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T06:41:39.234 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-30T06:41:39.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:39.293 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:39.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:39.349 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:39.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:39.406 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:39.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:39.462 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-30T06:41:39.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T06:41:39.520 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T06:41:39.576 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T06:41:39.579 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T06:41:39.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T06:41:39.638 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T06:41:39.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T06:41:39.698 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-30T06:41:39.754 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-30T06:41:39.754 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-30T06:41:39.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-30T06:41:39.884 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-30T06:41:39.904 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-30T06:41:39.924 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-30T06:41:40.036 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-30T06:41:40.055 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-30T06:41:40.116 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-30T06:41:40.224 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-30T06:41:40.243 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:40.247 DEBUG:teuthology.orchestra.run.smithi105:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-30T06:41:40.293 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-30T06:41:40.294 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-30T06:41:40.294 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-30T06:41:40.299 INFO:tasks.ceph.mon.a:Started 2024-05-30T06:41:40.299 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-30T06:41:40.299 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-30T06:41:40.336 INFO:tasks.ceph.mon.b:Started 2024-05-30T06:41:40.336 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-30T06:41:40.337 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-30T06:41:40.339 INFO:tasks.ceph.mon.c:Started 2024-05-30T06:41:40.339 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-30T06:41:40.340 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-30T06:41:40.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-30T06:41:40.343 INFO:tasks.ceph.mgr.y:Started 2024-05-30T06:41:40.343 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-30T06:41:40.343 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-30T06:41:40.346 INFO:tasks.ceph.mgr.x:Started 2024-05-30T06:41:40.346 INFO:tasks.ceph:Setting crush tunables to default 2024-05-30T06:41:40.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2024-05-30T06:41:40.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.483+0000 7f288dc00640 1 Processor -- start 2024-05-30T06:41:40.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.483+0000 7f288dc00640 1 -- start start 2024-05-30T06:41:40.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f288dc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:40.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f288dc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:40.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f288dc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2888070eb0 con 0x7f288806fd30 2024-05-30T06:41:40.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f288dc00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2888162500 con 0x7f28880b0920 2024-05-30T06:41:40.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f288dc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f288806ef70 con 0x7f2888070a10 2024-05-30T06:41:40.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f2886a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:40.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f2886a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52226/0 (socket says 172.21.15.37:52226) 2024-05-30T06:41:40.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 learned_addr learned my addr 172.21.15.37:0/2242485960 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:41:40.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:40.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 msgr2=0x7f28880704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-30T06:41:40.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 msgr2=0x7f28880704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T06:41:40.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T06:41:40.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-30T06:41:40.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f287fe00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 msgr2=0x7f288806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-30T06:41:40.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f287fe00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 msgr2=0x7f288806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T06:41:40.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T06:41:40.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.487+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-30T06:41:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.691+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.691+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.691+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 msgr2=0x7f28880704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-30T06:41:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.691+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 msgr2=0x7f28880704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T06:41:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.691+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T06:41:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.691+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-30T06:41:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.691+0000 7f287fe00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 msgr2=0x7f288806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-30T06:41:40.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.691+0000 7f287fe00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 msgr2=0x7f288806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T06:41:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.691+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T06:41:40.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:40.691+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-30T06:41:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.095+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.095+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 msgr2=0x7f28880704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-30T06:41:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.095+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 msgr2=0x7f28880704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T06:41:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.095+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T06:41:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.095+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.095+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-30T06:41:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.095+0000 7f287fe00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 msgr2=0x7f288806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-30T06:41:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.095+0000 7f287fe00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 msgr2=0x7f288806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T06:41:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.095+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T06:41:41.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.095+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-30T06:41:41.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.899+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:41.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.899+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 msgr2=0x7f28880704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-30T06:41:41.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.899+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 msgr2=0x7f28880704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T06:41:41.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.899+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:41.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.899+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T06:41:41.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.899+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-30T06:41:41.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.899+0000 7f287fe00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 msgr2=0x7f288806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-30T06:41:41.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.899+0000 7f287fe00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 msgr2=0x7f288806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T06:41:41.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.899+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T06:41:41.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:41.899+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-30T06:41:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.487+0000 7f2884c00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 msgr2=0x7f288806b960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T06:41:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.487+0000 7f2884c00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.105:3300/0 conn(0x7f2888070a10 0x7f288806b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.487+0000 7f2884c00640 1 -- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 msgr2=0x7f28880704d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T06:41:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.487+0000 7f2884c00640 1 --2- 172.21.15.37:0/2242485960 >> v2:172.21.15.37:3300/0 conn(0x7f28880b0920 0x7f28880704d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.487+0000 7f2884c00640 1 -- 172.21.15.37:0/2242485960 >> v1:172.21.15.105:6789/0 conn(0x7f288806fd30 legacy=0x7f28881626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.487+0000 7f2884c00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.487+0000 7f2884c00640 1 -- 172.21.15.37:0/2242485960 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f288806f250 con 0x7f28640061f0 2024-05-30T06:41:43.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.487+0000 7f2884c00640 1 -- 172.21.15.37:0/2242485960 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2888162500 con 0x7f2864003680 2024-05-30T06:41:43.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.487+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:43.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.487+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 msgr2=0x7f2864005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-30T06:41:43.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.487+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 msgr2=0x7f2864005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T06:41:43.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.487+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T06:41:43.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.487+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-30T06:41:43.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.691+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:43.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.691+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 msgr2=0x7f2864005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-30T06:41:43.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.691+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 msgr2=0x7f2864005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T06:41:43.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.691+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T06:41:43.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:43.691+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-30T06:41:44.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:44.095+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:44.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:44.095+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 msgr2=0x7f2864005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-30T06:41:44.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:44.095+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 msgr2=0x7f2864005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T06:41:44.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:44.095+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T06:41:44.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:44.095+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-30T06:41:44.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:44.899+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:44.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:44.899+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 msgr2=0x7f2864005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-30T06:41:44.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:44.899+0000 7f2886a00640 1 -- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 msgr2=0x7f2864005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-30T06:41:44.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:44.899+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-30T06:41:44.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:44.899+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-30T06:41:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 -- 172.21.15.37:0/2242485960 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 244444850 0 0) 0x7f288806f250 con 0x7f28640061f0 2024-05-30T06:41:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 -- 172.21.15.37:0/2242485960 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f286c003530 con 0x7f28640061f0 2024-05-30T06:41:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 -- 172.21.15.37:0/2242485960 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3653376489 0 0) 0x7f286c003530 con 0x7f28640061f0 2024-05-30T06:41:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 -- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 msgr2=0x7f2864005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T06:41:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f2864005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 -- 172.21.15.37:0/2242485960 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286400afc0 con 0x7f28640061f0 2024-05-30T06:41:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 -- 172.21.15.37:0/2242485960 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f287000f040 con 0x7f28640061f0 2024-05-30T06:41:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 -- 172.21.15.37:0/2242485960 >> v1:172.21.15.37:6789/0 conn(0x7f28640061f0 legacy=0x7f28640086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2887400640 1 -- 172.21.15.37:0/2242485960 reap_dead start 2024-05-30T06:41:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f286c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f286c003fd0 0x7f286c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f286c004d50 0x7f286c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 -- 172.21.15.37:0/2242485960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2888162500 con 0x7f286c003fd0 2024-05-30T06:41:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 -- 172.21.15.37:0/2242485960 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f286c00bcb0 con 0x7f286c004d50 2024-05-30T06:41:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886000640 1 -- 172.21.15.37:0/2242485960 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f286c00beb0 con 0x7f2864003680 2024-05-30T06:41:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f286c003fd0 0x7f286c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2886a00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f286c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f2887400640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f286c004d50 0x7f286c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f287fe00640 1 -- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 msgr2=0x7f286c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f286c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f287fe00640 1 -- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f286c004d50 msgr2=0x7f286c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f286c004d50 0x7f286c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:45.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.655+0000 7f287fe00640 1 -- 172.21.15.37:0/2242485960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c003530 con 0x7f286c003fd0 2024-05-30T06:41:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.659+0000 7f287fe00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f286c003fd0 0x7f286c004810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2870014370 tx=0x7f287001d930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267a954ed9d6fef5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.659+0000 7f2886000640 1 -- 172.21.15.37:0/2242485960 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28700ac070 con 0x7f286c003fd0 2024-05-30T06:41:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.659+0000 7f2886000640 1 -- 172.21.15.37:0/2242485960 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28700a67e0 con 0x7f286c003fd0 2024-05-30T06:41:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.659+0000 7f2886000640 1 -- 172.21.15.37:0/2242485960 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287000ecd0 con 0x7f286c003fd0 2024-05-30T06:41:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.659+0000 7f288dc00640 1 -- 172.21.15.37:0/2242485960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f286c003fd0 msgr2=0x7f286c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.659+0000 7f288dc00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f286c003fd0 0x7f286c004810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2870014370 tx=0x7f287001d930 comp rx=0 tx=0).stop 2024-05-30T06:41:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.659+0000 7f288dc00640 1 -- 172.21.15.37:0/2242485960 shutdown_connections 2024-05-30T06:41:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.659+0000 7f288dc00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f286c004d50 0x7f286c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.659+0000 7f288dc00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f286c003fd0 0x7f286c004810 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.659+0000 7f288dc00640 1 --2- 172.21.15.37:0/2242485960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2864003680 0x7f286c0039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.659+0000 7f288dc00640 1 -- 172.21.15.37:0/2242485960 >> 172.21.15.37:0/2242485960 conn(0x7f288809aa60 msgr2=0x7f28880d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.663+0000 7f288dc00640 1 -- 172.21.15.37:0/2242485960 shutdown_connections 2024-05-30T06:41:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.663+0000 7f288dc00640 1 -- 172.21.15.37:0/2242485960 wait complete. 2024-05-30T06:41:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.663+0000 7f288dc00640 1 Processor -- start 2024-05-30T06:41:45.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.663+0000 7f288dc00640 1 -- start start 2024-05-30T06:41:45.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.663+0000 7f288dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2864003680 0x7f288814aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:45.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.663+0000 7f288dc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f286c003fd0 0x7f28880b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:45.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.663+0000 7f288dc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f286c004d50 0x7f28880b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.663+0000 7f288dc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f28880d21b0 con 0x7f2864003680 2024-05-30T06:41:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.663+0000 7f288dc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f288806f810 con 0x7f286c003fd0 2024-05-30T06:41:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.663+0000 7f288dc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f28880d2330 con 0x7f286c004d50 2024-05-30T06:41:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.663+0000 7f2886a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2864003680 0x7f288814aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f2886a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2864003680 0x7f288814aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52320/0 (socket says 172.21.15.37:52320) 2024-05-30T06:41:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f2886a00640 1 -- 172.21.15.37:0/1696525970 learned_addr learned my addr 172.21.15.37:0/1696525970 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:41:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f2887400640 1 --2- 172.21.15.37:0/1696525970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f286c004d50 0x7f28880b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f287fe00640 1 --2- 172.21.15.37:0/1696525970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f286c003fd0 0x7f28880b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f2886a00640 1 -- 172.21.15.37:0/1696525970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f286c004d50 msgr2=0x7f28880b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f2886a00640 1 --2- 172.21.15.37:0/1696525970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f286c004d50 0x7f28880b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f2886a00640 1 -- 172.21.15.37:0/1696525970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f286c003fd0 msgr2=0x7f28880b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f2886a00640 1 --2- 172.21.15.37:0/1696525970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f286c003fd0 0x7f28880b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f2886a00640 1 -- 172.21.15.37:0/1696525970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28880c93d0 con 0x7f2864003680 2024-05-30T06:41:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f2886a00640 1 --2- 172.21.15.37:0/1696525970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2864003680 0x7f288814aed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2878017a50 tx=0x7f2878017f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f287ea00640 1 -- 172.21.15.37:0/1696525970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878028070 con 0x7f2864003680 2024-05-30T06:41:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f287ea00640 1 -- 172.21.15.37:0/1696525970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2878016e00 con 0x7f2864003680 2024-05-30T06:41:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f287ea00640 1 -- 172.21.15.37:0/1696525970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287800f040 con 0x7f2864003680 2024-05-30T06:41:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f288dc00640 1 -- 172.21.15.37:0/1696525970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28880c96b0 con 0x7f2864003680 2024-05-30T06:41:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f288dc00640 1 -- 172.21.15.37:0/1696525970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28880c9c70 con 0x7f2864003680 2024-05-30T06:41:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f287ea00640 1 -- 172.21.15.37:0/1696525970 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f287802b070 con 0x7f2864003680 2024-05-30T06:41:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f287ea00640 1 -- 172.21.15.37:0/1696525970 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f287802d780 con 0x7f2864003680 2024-05-30T06:41:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.667+0000 7f288dc00640 1 -- 172.21.15.37:0/1696525970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2888068bc0 con 0x7f2864003680 2024-05-30T06:41:45.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.787+0000 7f287ea00640 1 -- 172.21.15.37:0/1696525970 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2878020070 con 0x7f2864003680 2024-05-30T06:41:45.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.851+0000 7f288dc00640 1 -- 172.21.15.37:0/1696525970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f288814b410 con 0x7f2864003680 2024-05-30T06:41:45.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.855+0000 7f287ea00640 1 -- 172.21.15.37:0/1696525970 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f28780042d0 con 0x7f2864003680 2024-05-30T06:41:45.858 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-05-30T06:41:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.855+0000 7f288dc00640 1 -- 172.21.15.37:0/1696525970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2864003680 msgr2=0x7f288814aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.855+0000 7f288dc00640 1 --2- 172.21.15.37:0/1696525970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2864003680 0x7f288814aed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2878017a50 tx=0x7f2878017f10 comp rx=0 tx=0).stop 2024-05-30T06:41:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.855+0000 7f288dc00640 1 -- 172.21.15.37:0/1696525970 shutdown_connections 2024-05-30T06:41:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.855+0000 7f288dc00640 1 --2- 172.21.15.37:0/1696525970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f286c004d50 0x7f28880b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.855+0000 7f288dc00640 1 --2- 172.21.15.37:0/1696525970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f286c003fd0 0x7f28880b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.855+0000 7f288dc00640 1 --2- 172.21.15.37:0/1696525970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2864003680 0x7f288814aed0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.855+0000 7f288dc00640 1 -- 172.21.15.37:0/1696525970 >> 172.21.15.37:0/1696525970 conn(0x7f288809aa60 msgr2=0x7f2888070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.855+0000 7f288dc00640 1 -- 172.21.15.37:0/1696525970 shutdown_connections 2024-05-30T06:41:45.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:45.855+0000 7f288dc00640 1 -- 172.21.15.37:0/1696525970 wait complete. 2024-05-30T06:41:45.879 INFO:tasks.ceph:check_enable_crimson: False 2024-05-30T06:41:45.879 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-30T06:41:45.880 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:45.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-30T06:41:45.882 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:45.881+0000 7f00d0d7b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-30T06:41:45.900 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:45.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-30T06:41:45.960 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:45.960 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-30T06:41:45.992 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:45.987+0000 7f23e4ce2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-30T06:41:46.012 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:41:46.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-30T06:41:46.072 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:46.072 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-30T06:41:46.092 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:46.092 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-30T06:41:46.157 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:46.158 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-30T06:41:46.217 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:41:46.217 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-30T06:41:46.277 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 7d9265cc-51a9-4bb9-a791-a7f42216685f 0 2024-05-30T06:41:46.372 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:46.373+0000 7f00d0d7b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-30T06:41:46.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.453+0000 7f5e4b200640 1 Processor -- start 2024-05-30T06:41:46.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.453+0000 7f5e4b200640 1 -- start start 2024-05-30T06:41:46.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.453+0000 7f5e4b200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e440cdc90 0x7f5e440b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.453+0000 7f5e4b200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5e440b3c80 0x7f5e440d1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.453+0000 7f5e4b200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e4406ff80 con 0x7f5e4415e9f0 2024-05-30T06:41:46.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.453+0000 7f5e4b200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5e44074030 con 0x7f5e440cdc90 2024-05-30T06:41:46.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.453+0000 7f5e4b200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5e4406f9c0 con 0x7f5e440b3c80 2024-05-30T06:41:46.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.453+0000 7f5e49200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5e440b3c80 0x7f5e440d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.453+0000 7f5e43e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f5e4415e9f0 0x7f5e44073920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:52966/0 (socket says 172.21.15.105:52966) 2024-05-30T06:41:46.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.453+0000 7f5e43e00640 1 -- 172.21.15.105:0/3788239395 learned_addr learned my addr 172.21.15.105:0/3788239395 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-05-30T06:41:46.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.453+0000 7f5e3be00640 1 --2- 172.21.15.105:0/3788239395 >> v2:172.21.15.37:3300/0 conn(0x7f5e440cdc90 0x7f5e440b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.457+0000 7f5e49200640 1 -- 172.21.15.105:0/3788239395 >> v2:172.21.15.37:3300/0 conn(0x7f5e440cdc90 msgr2=0x7f5e440b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:46.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.457+0000 7f5e49200640 1 --2- 172.21.15.105:0/3788239395 >> v2:172.21.15.37:3300/0 conn(0x7f5e440cdc90 0x7f5e440b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.457+0000 7f5e49200640 1 -- 172.21.15.105:0/3788239395 >> v1:172.21.15.105:6789/0 conn(0x7f5e4415e9f0 legacy=0x7f5e44073920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.457+0000 7f5e43400640 1 -- 172.21.15.105:0/3788239395 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 279935962 0 0) 0x7f5e4406ff80 con 0x7f5e4415e9f0 2024-05-30T06:41:46.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.457+0000 7f5e49200640 1 -- 172.21.15.105:0/3788239395 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4406fca0 con 0x7f5e440b3c80 2024-05-30T06:41:46.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.457+0000 7f5e49200640 1 --2- 172.21.15.105:0/3788239395 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e440b3c80 0x7f5e440d1490 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009d90 tx=0x7f5e3c01c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79e58753309a9deb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:46.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.457+0000 7f5e43400640 1 -- 172.21.15.105:0/3788239395 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0b2070 con 0x7f5e440b3c80 2024-05-30T06:41:46.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.457+0000 7f5e43400640 1 -- 172.21.15.105:0/3788239395 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c0a57c0 con 0x7f5e440b3c80 2024-05-30T06:41:46.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.457+0000 7f5e43400640 1 -- 172.21.15.105:0/3788239395 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0a5b90 con 0x7f5e440b3c80 2024-05-30T06:41:46.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.457+0000 7f5e4b200640 1 -- 172.21.15.105:0/3788239395 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e440b3c80 msgr2=0x7f5e440d1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.457+0000 7f5e4b200640 1 --2- 172.21.15.105:0/3788239395 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e440b3c80 0x7f5e440d1490 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009d90 tx=0x7f5e3c01c810 comp rx=0 tx=0).stop 2024-05-30T06:41:46.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 -- 172.21.15.105:0/3788239395 shutdown_connections 2024-05-30T06:41:46.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 --2- 172.21.15.105:0/3788239395 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e440b3c80 0x7f5e440d1490 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 --2- 172.21.15.105:0/3788239395 >> v2:172.21.15.37:3300/0 conn(0x7f5e440cdc90 0x7f5e440b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 -- 172.21.15.105:0/3788239395 >> 172.21.15.105:0/3788239395 conn(0x7f5e440b6c70 msgr2=0x7f5e440b7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:46.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 -- 172.21.15.105:0/3788239395 shutdown_connections 2024-05-30T06:41:46.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 -- 172.21.15.105:0/3788239395 wait complete. 2024-05-30T06:41:46.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 Processor -- start 2024-05-30T06:41:46.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 -- start start 2024-05-30T06:41:46.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e440b3c80 0x7f5e44156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e440cdc90 0x7f5e44158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e4415e9f0 0x7f5e440ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4415ef50 con 0x7f5e440cdc90 2024-05-30T06:41:46.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4415edd0 con 0x7f5e4415e9f0 2024-05-30T06:41:46.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e4b200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5e440d21e0 con 0x7f5e440b3c80 2024-05-30T06:41:46.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e43e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e440b3c80 0x7f5e44156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e43e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e440b3c80 0x7f5e44156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44050/0 (socket says 172.21.15.105:44050) 2024-05-30T06:41:46.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e43e00640 1 -- 172.21.15.105:0/3314917788 learned_addr learned my addr 172.21.15.105:0/3314917788 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-05-30T06:41:46.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e49200640 1 --2- 172.21.15.105:0/3314917788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e4415e9f0 0x7f5e440ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e3be00640 1 --2- 172.21.15.105:0/3314917788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e440cdc90 0x7f5e44158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e43e00640 1 -- 172.21.15.105:0/3314917788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e4415e9f0 msgr2=0x7f5e440ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e43e00640 1 --2- 172.21.15.105:0/3314917788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e4415e9f0 0x7f5e440ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e43e00640 1 -- 172.21.15.105:0/3314917788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e440cdc90 msgr2=0x7f5e44158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e43e00640 1 --2- 172.21.15.105:0/3314917788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e440cdc90 0x7f5e44158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e43e00640 1 -- 172.21.15.105:0/3314917788 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e44150290 con 0x7f5e440b3c80 2024-05-30T06:41:46.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e43e00640 1 --2- 172.21.15.105:0/3314917788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e440b3c80 0x7f5e44156e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400c480 tx=0x7f5e3400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:46.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e40c00640 1 -- 172.21.15.105:0/3314917788 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34018070 con 0x7f5e440b3c80 2024-05-30T06:41:46.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e40c00640 1 -- 172.21.15.105:0/3314917788 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e34007500 con 0x7f5e440b3c80 2024-05-30T06:41:46.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.461+0000 7f5e40c00640 1 -- 172.21.15.105:0/3314917788 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34004a30 con 0x7f5e440b3c80 2024-05-30T06:41:46.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.465+0000 7f5e4b200640 1 -- 172.21.15.105:0/3314917788 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4414f1f0 con 0x7f5e440b3c80 2024-05-30T06:41:46.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.465+0000 7f5e4b200640 1 -- 172.21.15.105:0/3314917788 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e4414f7b0 con 0x7f5e440b3c80 2024-05-30T06:41:46.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.465+0000 7f5e40c00640 1 -- 172.21.15.105:0/3314917788 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5e3401b070 con 0x7f5e440b3c80 2024-05-30T06:41:46.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.465+0000 7f5e40c00640 1 -- 172.21.15.105:0/3314917788 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f5e34012740 con 0x7f5e440b3c80 2024-05-30T06:41:46.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.465+0000 7f5e4b200640 1 -- 172.21.15.105:0/3314917788 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e440d1490 con 0x7f5e440b3c80 2024-05-30T06:41:46.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.477+0000 7f5e40c00640 1 -- 172.21.15.105:0/3314917788 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5e44150290 con 0x7f5e440b3c80 2024-05-30T06:41:46.542 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.541+0000 7f5e4b200640 1 -- 172.21.15.105:0/3314917788 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7d9265cc-51a9-4bb9-a791-a7f42216685f", "id": 0} v 0) -- 0x7f5e4415c650 con 0x7f5e440b3c80 2024-05-30T06:41:46.549 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.549+0000 7f5e40c00640 1 -- 172.21.15.105:0/3314917788 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7d9265cc-51a9-4bb9-a791-a7f42216685f", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f5e34004cc0 con 0x7f5e440b3c80 2024-05-30T06:41:46.549 INFO:teuthology.orchestra.run.smithi105.stdout:0 2024-05-30T06:41:46.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.549+0000 7f5e4b200640 1 -- 172.21.15.105:0/3314917788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e440b3c80 msgr2=0x7f5e44156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.549+0000 7f5e4b200640 1 --2- 172.21.15.105:0/3314917788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e440b3c80 0x7f5e44156e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400c480 tx=0x7f5e3400c940 comp rx=0 tx=0).stop 2024-05-30T06:41:46.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.549+0000 7f5e4b200640 1 -- 172.21.15.105:0/3314917788 shutdown_connections 2024-05-30T06:41:46.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.549+0000 7f5e4b200640 1 --2- 172.21.15.105:0/3314917788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e4415e9f0 0x7f5e440ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.549+0000 7f5e4b200640 1 --2- 172.21.15.105:0/3314917788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e440cdc90 0x7f5e44158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.549+0000 7f5e4b200640 1 --2- 172.21.15.105:0/3314917788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e440b3c80 0x7f5e44156e50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.549+0000 7f5e4b200640 1 -- 172.21.15.105:0/3314917788 >> 172.21.15.105:0/3314917788 conn(0x7f5e440b6c70 msgr2=0x7f5e4406ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:46.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.549+0000 7f5e4b200640 1 -- 172.21.15.105:0/3314917788 shutdown_connections 2024-05-30T06:41:46.550 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.549+0000 7f5e4b200640 1 -- 172.21.15.105:0/3314917788 wait complete. 2024-05-30T06:41:46.568 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe 1 2024-05-30T06:41:46.591 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:46.593+0000 7f00d0d7b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-30T06:41:46.621 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:46.619+0000 7f23e4ce2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-30T06:41:46.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.705+0000 7f8f63e00640 1 Processor -- start 2024-05-30T06:41:46.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.705+0000 7f8f63e00640 1 -- start start 2024-05-30T06:41:46.707 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f63e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0d03c0 0x7f8f5c09aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f63e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f5c0b14b0 0x7f8f5c09afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f63e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f5c09bb80 con 0x7f8f5c15c870 2024-05-30T06:41:46.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f63e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8f5c0cd110 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f63e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8f5c09be60 con 0x7f8f5c0d03c0 2024-05-30T06:41:46.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f60a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0d03c0 0x7f8f5c09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f60a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0d03c0 0x7f8f5c09aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44062/0 (socket says 172.21.15.105:44062) 2024-05-30T06:41:46.708 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f60a00640 1 -- 172.21.15.105:0/142614795 learned_addr learned my addr 172.21.15.105:0/142614795 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-05-30T06:41:46.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f61e00640 1 --2- 172.21.15.105:0/142614795 >> v2:172.21.15.37:3300/0 conn(0x7f8f5c0b14b0 0x7f8f5c09afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f60a00640 1 -- 172.21.15.105:0/142614795 >> v2:172.21.15.37:3300/0 conn(0x7f8f5c0b14b0 msgr2=0x7f8f5c09afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:46.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f60a00640 1 --2- 172.21.15.105:0/142614795 >> v2:172.21.15.37:3300/0 conn(0x7f8f5c0b14b0 0x7f8f5c09afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f60a00640 1 -- 172.21.15.105:0/142614795 >> v1:172.21.15.37:6789/0 conn(0x7f8f5c15c870 legacy=0x7f8f5c0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:46.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f60a00640 1 -- 172.21.15.105:0/142614795 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5c0cd340 con 0x7f8f5c0d03c0 2024-05-30T06:41:46.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.709+0000 7f8f61e00640 1 --2- 172.21.15.105:0/142614795 >> v2:172.21.15.37:3300/0 conn(0x7f8f5c0b14b0 0x7f8f5c09afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:41:46.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f60a00640 1 --2- 172.21.15.105:0/142614795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0d03c0 0x7f8f5c09aa60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009870 tx=0x7f8f4801c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9405b91e376481b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:46.711 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f5be00640 1 -- 172.21.15.105:0/142614795 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f480b0070 con 0x7f8f5c0d03c0 2024-05-30T06:41:46.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f5be00640 1 -- 172.21.15.105:0/142614795 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f480ab600 con 0x7f8f5c0d03c0 2024-05-30T06:41:46.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f5be00640 1 -- 172.21.15.105:0/142614795 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f480ab9d0 con 0x7f8f5c0d03c0 2024-05-30T06:41:46.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f63e00640 1 -- 172.21.15.105:0/142614795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0d03c0 msgr2=0x7f8f5c09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f63e00640 1 --2- 172.21.15.105:0/142614795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0d03c0 0x7f8f5c09aa60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009870 tx=0x7f8f4801c520 comp rx=0 tx=0).stop 2024-05-30T06:41:46.712 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f63e00640 1 -- 172.21.15.105:0/142614795 shutdown_connections 2024-05-30T06:41:46.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f63e00640 1 --2- 172.21.15.105:0/142614795 >> v2:172.21.15.37:3300/0 conn(0x7f8f5c0b14b0 0x7f8f5c09afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f63e00640 1 --2- 172.21.15.105:0/142614795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0d03c0 0x7f8f5c09aa60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f63e00640 1 -- 172.21.15.105:0/142614795 >> 172.21.15.105:0/142614795 conn(0x7f8f5c0b4060 msgr2=0x7f8f5c0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:46.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f63e00640 1 -- 172.21.15.105:0/142614795 shutdown_connections 2024-05-30T06:41:46.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f63e00640 1 -- 172.21.15.105:0/142614795 wait complete. 2024-05-30T06:41:46.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f63e00640 1 Processor -- start 2024-05-30T06:41:46.713 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f63e00640 1 -- start start 2024-05-30T06:41:46.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.713+0000 7f8f63e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0b14b0 0x7f8f5c155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f63e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f5c0d03c0 0x7f8f5c14f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f63e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c15c870 0x7f8f5c0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f63e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5c169800 con 0x7f8f5c0d03c0 2024-05-30T06:41:46.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f63e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5c0ce530 con 0x7f8f5c15c870 2024-05-30T06:41:46.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f63e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8f5c169980 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f61400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0b14b0 0x7f8f5c155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f61400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0b14b0 0x7f8f5c155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44066/0 (socket says 172.21.15.105:44066) 2024-05-30T06:41:46.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f61400640 1 -- 172.21.15.105:0/3894430699 learned_addr learned my addr 172.21.15.105:0/3894430699 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-05-30T06:41:46.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f61e00640 1 --2- 172.21.15.105:0/3894430699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c15c870 0x7f8f5c0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f60a00640 1 --2- 172.21.15.105:0/3894430699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f5c0d03c0 0x7f8f5c14f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f61400640 1 -- 172.21.15.105:0/3894430699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c15c870 msgr2=0x7f8f5c0b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f61400640 1 --2- 172.21.15.105:0/3894430699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c15c870 0x7f8f5c0b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f61400640 1 -- 172.21.15.105:0/3894430699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f5c0d03c0 msgr2=0x7f8f5c14f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f61400640 1 --2- 172.21.15.105:0/3894430699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f5c0d03c0 0x7f8f5c14f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f61400640 1 -- 172.21.15.105:0/3894430699 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5c150040 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f61400640 1 --2- 172.21.15.105:0/3894430699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0b14b0 0x7f8f5c155130 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000c480 tx=0x7f8f5000c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:46.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f59600640 1 -- 172.21.15.105:0/3894430699 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f50012830 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f59600640 1 -- 172.21.15.105:0/3894430699 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f50017070 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f59600640 1 -- 172.21.15.105:0/3894430699 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f50012c30 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f63e00640 1 -- 172.21.15.105:0/3894430699 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f5c150320 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f63e00640 1 -- 172.21.15.105:0/3894430699 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f5c1508e0 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f59600640 1 -- 172.21.15.105:0/3894430699 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f5001c460 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f59600640 1 -- 172.21.15.105:0/3894430699 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8f5001b7b0 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.717+0000 7f8f63e00640 1 -- 172.21.15.105:0/3894430699 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f5c068bc0 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.721+0000 7f8f59600640 1 -- 172.21.15.105:0/3894430699 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8f50012dd0 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.785 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.785+0000 7f8f63e00640 1 -- 172.21.15.105:0/3894430699 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe", "id": 1} v 0) -- 0x7f8f5c070390 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.791 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.793+0000 7f8f59600640 1 -- 172.21.15.105:0/3894430699 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8f5001b9b0 con 0x7f8f5c0b14b0 2024-05-30T06:41:46.791 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-05-30T06:41:46.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.793+0000 7f8f63e00640 1 -- 172.21.15.105:0/3894430699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0b14b0 msgr2=0x7f8f5c155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.793+0000 7f8f63e00640 1 --2- 172.21.15.105:0/3894430699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0b14b0 0x7f8f5c155130 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000c480 tx=0x7f8f5000c940 comp rx=0 tx=0).stop 2024-05-30T06:41:46.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.793+0000 7f8f63e00640 1 -- 172.21.15.105:0/3894430699 shutdown_connections 2024-05-30T06:41:46.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.793+0000 7f8f63e00640 1 --2- 172.21.15.105:0/3894430699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f5c15c870 0x7f8f5c0b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.793+0000 7f8f63e00640 1 --2- 172.21.15.105:0/3894430699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f5c0d03c0 0x7f8f5c14f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.792 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.793+0000 7f8f63e00640 1 --2- 172.21.15.105:0/3894430699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f5c0b14b0 0x7f8f5c155130 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.793+0000 7f8f63e00640 1 -- 172.21.15.105:0/3894430699 >> 172.21.15.105:0/3894430699 conn(0x7f8f5c0b4060 msgr2=0x7f8f5c0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:46.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.793+0000 7f8f63e00640 1 -- 172.21.15.105:0/3894430699 shutdown_connections 2024-05-30T06:41:46.793 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.793+0000 7f8f63e00640 1 -- 172.21.15.105:0/3894430699 wait complete. 2024-05-30T06:41:46.810 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 606f08ec-cad4-404f-a19d-e815cd5f631b 2 2024-05-30T06:41:46.857 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:46.855+0000 7f23e4ce2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-30T06:41:46.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ecb600640 1 Processor -- start 2024-05-30T06:41:46.988 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ecb600640 1 -- start start 2024-05-30T06:41:46.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ecb600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ec40b3e50 0x7f5ec4169640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ecb600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec406ff80 con 0x7f5ec40cdc90 2024-05-30T06:41:46.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ecb600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec406f9c0 con 0x7f5ec415e9f0 2024-05-30T06:41:46.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ecb600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5ec40d24a0 con 0x7f5ec40b3e50 2024-05-30T06:41:46.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ec8c00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f5ec415e9f0 0x7f5ec4073920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:52980/0 (socket says 172.21.15.105:52980) 2024-05-30T06:41:46.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ec8c00640 1 -- 172.21.15.105:0/3275409356 learned_addr learned my addr 172.21.15.105:0/3275409356 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-05-30T06:41:46.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ec9600640 1 --2- 172.21.15.105:0/3275409356 >> v2:172.21.15.37:3300/0 conn(0x7f5ec40b3e50 0x7f5ec4169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ec3400640 1 -- 172.21.15.105:0/3275409356 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700355691 0 0) 0x7f5ec406f9c0 con 0x7f5ec415e9f0 2024-05-30T06:41:46.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ec3400640 1 -- 172.21.15.105:0/3275409356 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eac003530 con 0x7f5ec415e9f0 2024-05-30T06:41:46.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ec3400640 1 -- 172.21.15.105:0/3275409356 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324976649 0 0) 0x7f5ec406ff80 con 0x7f5ec40cdc90 2024-05-30T06:41:46.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ec3400640 1 -- 172.21.15.105:0/3275409356 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ec406f9c0 con 0x7f5ec40cdc90 2024-05-30T06:41:46.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ec9600640 1 -- 172.21.15.105:0/3275409356 >> v1:172.21.15.105:6789/0 conn(0x7f5ec415e9f0 legacy=0x7f5ec4073920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ec9600640 1 -- 172.21.15.105:0/3275409356 >> v1:172.21.15.37:6789/0 conn(0x7f5ec40cdc90 legacy=0x7f5ec40b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.991 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.989+0000 7f5ec9600640 1 -- 172.21.15.105:0/3275409356 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec406fca0 con 0x7f5ec40b3e50 2024-05-30T06:41:46.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.993+0000 7f5ec9600640 1 --2- 172.21.15.105:0/3275409356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec40b3e50 0x7f5ec4169640 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009dc0 tx=0x7f5ebc01c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31221a3b27487bc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:46.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.993+0000 7f5ec3400640 1 -- 172.21.15.105:0/3275409356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0b2070 con 0x7f5ec40b3e50 2024-05-30T06:41:46.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.993+0000 7f5ec3400640 1 -- 172.21.15.105:0/3275409356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ebc0a57e0 con 0x7f5ec40b3e50 2024-05-30T06:41:46.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.993+0000 7f5ec3400640 1 -- 172.21.15.105:0/3275409356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0a5bb0 con 0x7f5ec40b3e50 2024-05-30T06:41:46.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.993+0000 7f5ecb600640 1 -- 172.21.15.105:0/3275409356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec40b3e50 msgr2=0x7f5ec4169640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.993+0000 7f5ecb600640 1 --2- 172.21.15.105:0/3275409356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec40b3e50 0x7f5ec4169640 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009dc0 tx=0x7f5ebc01c830 comp rx=0 tx=0).stop 2024-05-30T06:41:46.994 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.993+0000 7f5ecb600640 1 -- 172.21.15.105:0/3275409356 shutdown_connections 2024-05-30T06:41:46.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.993+0000 7f5ecb600640 1 --2- 172.21.15.105:0/3275409356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec40b3e50 0x7f5ec4169640 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.993+0000 7f5ecb600640 1 -- 172.21.15.105:0/3275409356 >> 172.21.15.105:0/3275409356 conn(0x7f5ec40b6c70 msgr2=0x7f5ec40b7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:46.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.993+0000 7f5ecb600640 1 -- 172.21.15.105:0/3275409356 shutdown_connections 2024-05-30T06:41:46.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.993+0000 7f5ecb600640 1 -- 172.21.15.105:0/3275409356 wait complete. 2024-05-30T06:41:46.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ecb600640 1 Processor -- start 2024-05-30T06:41:46.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ecb600640 1 -- start start 2024-05-30T06:41:46.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ecb600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec40b3e50 0x7f5ec4141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ecb600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec40cdc90 0x7f5ec415be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ecb600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ec415e9f0 0x7f5ec415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:46.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ecb600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec415ef50 con 0x7f5ec40cdc90 2024-05-30T06:41:46.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ecb600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec415edd0 con 0x7f5ec40b3e50 2024-05-30T06:41:46.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ecb600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec416c7b0 con 0x7f5ec415e9f0 2024-05-30T06:41:46.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec8c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec40b3e50 0x7f5ec4141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec8c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec40b3e50 0x7f5ec4141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50134/0 (socket says 172.21.15.105:50134) 2024-05-30T06:41:46.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec8c00640 1 -- 172.21.15.105:0/391984018 learned_addr learned my addr 172.21.15.105:0/391984018 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-05-30T06:41:46.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec3e00640 1 --2- 172.21.15.105:0/391984018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec40cdc90 0x7f5ec415be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec9600640 1 --2- 172.21.15.105:0/391984018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ec415e9f0 0x7f5ec415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:46.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec8c00640 1 -- 172.21.15.105:0/391984018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ec415e9f0 msgr2=0x7f5ec415c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec8c00640 1 --2- 172.21.15.105:0/391984018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ec415e9f0 0x7f5ec415c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:46.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec8c00640 1 -- 172.21.15.105:0/391984018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec40cdc90 msgr2=0x7f5ec415be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:46.999 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec8c00640 1 --2- 172.21.15.105:0/391984018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec40cdc90 0x7f5ec415be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec8c00640 1 -- 172.21.15.105:0/391984018 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec414cab0 con 0x7f5ec40b3e50 2024-05-30T06:41:47.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec3e00640 1 --2- 172.21.15.105:0/391984018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec40cdc90 0x7f5ec415be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:41:47.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec8c00640 1 --2- 172.21.15.105:0/391984018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec40b3e50 0x7f5ec4141590 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800c4d0 tx=0x7f5eb800c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:47.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec0c00640 1 -- 172.21.15.105:0/391984018 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8017070 con 0x7f5ec40b3e50 2024-05-30T06:41:47.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec0c00640 1 -- 172.21.15.105:0/391984018 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb8005cf0 con 0x7f5ec40b3e50 2024-05-30T06:41:47.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec0c00640 1 -- 172.21.15.105:0/391984018 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8007270 con 0x7f5ec40b3e50 2024-05-30T06:41:47.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ecb600640 1 -- 172.21.15.105:0/391984018 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec414cd90 con 0x7f5ec40b3e50 2024-05-30T06:41:47.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ecb600640 1 -- 172.21.15.105:0/391984018 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec414d350 con 0x7f5ec40b3e50 2024-05-30T06:41:47.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:46.997+0000 7f5ec0c00640 1 -- 172.21.15.105:0/391984018 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5eb801a070 con 0x7f5ec40b3e50 2024-05-30T06:41:47.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.001+0000 7f5ec0c00640 1 -- 172.21.15.105:0/391984018 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f5eb801c440 con 0x7f5ec40b3e50 2024-05-30T06:41:47.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.001+0000 7f5ecb600640 1 -- 172.21.15.105:0/391984018 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec4075580 con 0x7f5ec40b3e50 2024-05-30T06:41:47.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.001+0000 7f5ec0c00640 1 -- 172.21.15.105:0/391984018 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5eb801c760 con 0x7f5ec40b3e50 2024-05-30T06:41:47.068 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.069+0000 7f5ecb600640 1 -- 172.21.15.105:0/391984018 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "606f08ec-cad4-404f-a19d-e815cd5f631b", "id": 2} v 0) -- 0x7f5ec4074cf0 con 0x7f5ec40b3e50 2024-05-30T06:41:47.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.073+0000 7f5ec0c00640 1 -- 172.21.15.105:0/391984018 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "606f08ec-cad4-404f-a19d-e815cd5f631b", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f5eb801cb70 con 0x7f5ec40b3e50 2024-05-30T06:41:47.074 INFO:teuthology.orchestra.run.smithi105.stdout:2 2024-05-30T06:41:47.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.077+0000 7f5ecb600640 1 -- 172.21.15.105:0/391984018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec40b3e50 msgr2=0x7f5ec4141590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.077+0000 7f5ecb600640 1 --2- 172.21.15.105:0/391984018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec40b3e50 0x7f5ec4141590 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800c4d0 tx=0x7f5eb800c990 comp rx=0 tx=0).stop 2024-05-30T06:41:47.075 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.077+0000 7f5ecb600640 1 -- 172.21.15.105:0/391984018 shutdown_connections 2024-05-30T06:41:47.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.077+0000 7f5ecb600640 1 --2- 172.21.15.105:0/391984018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ec415e9f0 0x7f5ec415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.077+0000 7f5ecb600640 1 --2- 172.21.15.105:0/391984018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec40cdc90 0x7f5ec415be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.077+0000 7f5ecb600640 1 --2- 172.21.15.105:0/391984018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5ec40b3e50 0x7f5ec4141590 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.077+0000 7f5ecb600640 1 -- 172.21.15.105:0/391984018 >> 172.21.15.105:0/391984018 conn(0x7f5ec40b6c70 msgr2=0x7f5ec415d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:47.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.077+0000 7f5ecb600640 1 -- 172.21.15.105:0/391984018 shutdown_connections 2024-05-30T06:41:47.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.077+0000 7f5ecb600640 1 -- 172.21.15.105:0/391984018 wait complete. 2024-05-30T06:41:47.093 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 940a004d-18ba-4e27-ba3d-8c5e9880099a 3 2024-05-30T06:41:47.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7ac600640 1 Processor -- start 2024-05-30T06:41:47.228 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7ac600640 1 -- start start 2024-05-30T06:41:47.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7ac600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa7a415ebc0 0x7fa7a40d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7ac600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 0x7fa7a406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.229 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7ac600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7a40d0840 con 0x7fa7a406dcf0 2024-05-30T06:41:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7ac600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa7a409bce0 con 0x7fa7a415ebc0 2024-05-30T06:41:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7ac600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a40d0ae0 con 0x7fa7a409b800 2024-05-30T06:41:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7a9200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 0x7fa7a406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7a9c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa7a415ebc0 0x7fa7a40d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7a9200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 0x7fa7a406d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44096/0 (socket says 172.21.15.105:44096) 2024-05-30T06:41:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7a9200640 1 -- 172.21.15.105:0/4011348654 learned_addr learned my addr 172.21.15.105:0/4011348654 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-05-30T06:41:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7a9200640 1 -- 172.21.15.105:0/4011348654 >> v2:172.21.15.105:3300/0 conn(0x7fa7a415ebc0 msgr2=0x7fa7a40d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7a9200640 1 --2- 172.21.15.105:0/4011348654 >> v2:172.21.15.105:3300/0 conn(0x7fa7a415ebc0 0x7fa7a40d15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7a9200640 1 -- 172.21.15.105:0/4011348654 >> v1:172.21.15.37:6789/0 conn(0x7fa7a406dcf0 legacy=0x7fa7a409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:47.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.229+0000 7fa7a9200640 1 -- 172.21.15.105:0/4011348654 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a40d0dc0 con 0x7fa7a409b800 2024-05-30T06:41:47.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.233+0000 7fa7a9200640 1 --2- 172.21.15.105:0/4011348654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 0x7fa7a406d7b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa790009870 tx=0x7fa79001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9836413dc33f55 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:47.232 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.233+0000 7fa7a3e00640 1 -- 172.21.15.105:0/4011348654 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7900b0070 con 0x7fa7a409b800 2024-05-30T06:41:47.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.233+0000 7fa7a3e00640 1 -- 172.21.15.105:0/4011348654 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7900ab600 con 0x7fa7a409b800 2024-05-30T06:41:47.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.233+0000 7fa7a3e00640 1 -- 172.21.15.105:0/4011348654 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7900ab9d0 con 0x7fa7a409b800 2024-05-30T06:41:47.233 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.233+0000 7fa7ac600640 1 -- 172.21.15.105:0/4011348654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 msgr2=0x7fa7a406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.233+0000 7fa7ac600640 1 --2- 172.21.15.105:0/4011348654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 0x7fa7a406d7b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa790009870 tx=0x7fa79001c520 comp rx=0 tx=0).stop 2024-05-30T06:41:47.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.233+0000 7fa7ac600640 1 -- 172.21.15.105:0/4011348654 shutdown_connections 2024-05-30T06:41:47.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.233+0000 7fa7ac600640 1 --2- 172.21.15.105:0/4011348654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 0x7fa7a406d7b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.233+0000 7fa7ac600640 1 --2- 172.21.15.105:0/4011348654 >> v2:172.21.15.105:3300/0 conn(0x7fa7a415ebc0 0x7fa7a40d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.233+0000 7fa7ac600640 1 -- 172.21.15.105:0/4011348654 >> 172.21.15.105:0/4011348654 conn(0x7fa7a40b4060 msgr2=0x7fa7a40b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:47.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.233+0000 7fa7ac600640 1 -- 172.21.15.105:0/4011348654 shutdown_connections 2024-05-30T06:41:47.234 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.233+0000 7fa7ac600640 1 -- 172.21.15.105:0/4011348654 wait complete. 2024-05-30T06:41:47.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7ac600640 1 Processor -- start 2024-05-30T06:41:47.235 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7ac600640 1 -- start start 2024-05-30T06:41:47.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7ac600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7a406dcf0 0x7fa7a40af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7ac600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 0x7fa7a41535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7ac600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7a415ebc0 0x7fa7a415fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7ac600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a409b2f0 con 0x7fa7a406dcf0 2024-05-30T06:41:47.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7ac600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a409b170 con 0x7fa7a415ebc0 2024-05-30T06:41:47.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7ac600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a40cd3d0 con 0x7fa7a409b800 2024-05-30T06:41:47.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a9200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 0x7fa7a41535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7aa600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7a415ebc0 0x7fa7a415fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a9200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 0x7fa7a41535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44106/0 (socket says 172.21.15.105:44106) 2024-05-30T06:41:47.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7aa600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7a415ebc0 0x7fa7a415fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50138/0 (socket says 172.21.15.105:50138) 2024-05-30T06:41:47.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a9200640 1 -- 172.21.15.105:0/1735602802 learned_addr learned my addr 172.21.15.105:0/1735602802 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-05-30T06:41:47.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a9c00640 1 --2- 172.21.15.105:0/1735602802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7a406dcf0 0x7fa7a40af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a9200640 1 -- 172.21.15.105:0/1735602802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7a415ebc0 msgr2=0x7fa7a415fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a9200640 1 --2- 172.21.15.105:0/1735602802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7a415ebc0 0x7fa7a415fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a9200640 1 -- 172.21.15.105:0/1735602802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7a406dcf0 msgr2=0x7fa7a40af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a9200640 1 --2- 172.21.15.105:0/1735602802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7a406dcf0 0x7fa7a40af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.238 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a9200640 1 -- 172.21.15.105:0/1735602802 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a4160400 con 0x7fa7a409b800 2024-05-30T06:41:47.238 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:47.237+0000 7f00d0d7b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-30T06:41:47.239 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a9200640 1 --2- 172.21.15.105:0/1735602802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 0x7fa7a41535c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa7900ae040 tx=0x7fa7900192c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:47.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a1600640 1 -- 172.21.15.105:0/1735602802 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7900b0040 con 0x7fa7a409b800 2024-05-30T06:41:47.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a1600640 1 -- 172.21.15.105:0/1735602802 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7900b4420 con 0x7fa7a409b800 2024-05-30T06:41:47.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7ac600640 1 -- 172.21.15.105:0/1735602802 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a40caec0 con 0x7fa7a409b800 2024-05-30T06:41:47.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a1600640 1 -- 172.21.15.105:0/1735602802 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7900b4810 con 0x7fa7a409b800 2024-05-30T06:41:47.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7ac600640 1 -- 172.21.15.105:0/1735602802 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a40cb480 con 0x7fa7a409b800 2024-05-30T06:41:47.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a1600640 1 -- 172.21.15.105:0/1735602802 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa7900b49b0 con 0x7fa7a409b800 2024-05-30T06:41:47.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.237+0000 7fa7a1600640 1 -- 172.21.15.105:0/1735602802 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa7900b4ca0 con 0x7fa7a409b800 2024-05-30T06:41:47.240 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.241+0000 7fa7ac600640 1 -- 172.21.15.105:0/1735602802 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a4068bc0 con 0x7fa7a409b800 2024-05-30T06:41:47.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.241+0000 7fa7a1600640 1 -- 172.21.15.105:0/1735602802 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa790016110 con 0x7fa7a409b800 2024-05-30T06:41:47.301 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:47.301+0000 7f00d0d7b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-30T06:41:47.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.309+0000 7fa7ac600640 1 -- 172.21.15.105:0/1735602802 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "940a004d-18ba-4e27-ba3d-8c5e9880099a", "id": 3} v 0) -- 0x7fa7a40cac90 con 0x7fa7a409b800 2024-05-30T06:41:47.311 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.313+0000 7fa7a1600640 1 -- 172.21.15.105:0/1735602802 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "940a004d-18ba-4e27-ba3d-8c5e9880099a", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa7900bd400 con 0x7fa7a409b800 2024-05-30T06:41:47.311 INFO:teuthology.orchestra.run.smithi105.stdout:3 2024-05-30T06:41:47.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.313+0000 7fa7ac600640 1 -- 172.21.15.105:0/1735602802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 msgr2=0x7fa7a41535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.312 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.313+0000 7fa7ac600640 1 --2- 172.21.15.105:0/1735602802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 0x7fa7a41535c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa7900ae040 tx=0x7fa7900192c0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.313+0000 7fa7ac600640 1 -- 172.21.15.105:0/1735602802 shutdown_connections 2024-05-30T06:41:47.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.313+0000 7fa7ac600640 1 --2- 172.21.15.105:0/1735602802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7a415ebc0 0x7fa7a415fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.313+0000 7fa7ac600640 1 --2- 172.21.15.105:0/1735602802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7a409b800 0x7fa7a41535c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.313+0000 7fa7ac600640 1 --2- 172.21.15.105:0/1735602802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7a406dcf0 0x7fa7a40af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.313+0000 7fa7ac600640 1 -- 172.21.15.105:0/1735602802 >> 172.21.15.105:0/1735602802 conn(0x7fa7a40b4060 msgr2=0x7fa7a40b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:47.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.313+0000 7fa7ac600640 1 -- 172.21.15.105:0/1735602802 shutdown_connections 2024-05-30T06:41:47.313 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.313+0000 7fa7ac600640 1 -- 172.21.15.105:0/1735602802 wait complete. 2024-05-30T06:41:47.330 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 64901865-0e8d-4da6-92d6-42e5ee643071 4 2024-05-30T06:41:47.366 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:47.365+0000 7f00d0d7b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-30T06:41:47.456 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:47.457+0000 7f00d0d7b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-30T06:41:47.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.465+0000 7fc948000640 1 Processor -- start 2024-05-30T06:41:47.465 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.465+0000 7fc948000640 1 -- start start 2024-05-30T06:41:47.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc948000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc94009aa60 0x7fc94009ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc948000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc94009b3b0 con 0x7fc94015ebc0 2024-05-30T06:41:47.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc948000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9400d0840 con 0x7fc94009b800 2024-05-30T06:41:47.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc948000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc94006dec0 con 0x7fc94009aa60 2024-05-30T06:41:47.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc944c00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fc94009b800 0x7fc94006d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:52996/0 (socket says 172.21.15.105:52996) 2024-05-30T06:41:47.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc944c00640 1 -- 172.21.15.105:0/2825404498 learned_addr learned my addr 172.21.15.105:0/2825404498 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-05-30T06:41:47.467 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc946000640 1 --2- 172.21.15.105:0/2825404498 >> v2:172.21.15.37:3300/0 conn(0x7fc94009aa60 0x7fc94009ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc93fe00640 1 -- 172.21.15.105:0/2825404498 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3114262089 0 0) 0x7fc9400d0840 con 0x7fc94009b800 2024-05-30T06:41:47.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc93fe00640 1 -- 172.21.15.105:0/2825404498 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc928003530 con 0x7fc94009b800 2024-05-30T06:41:47.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc93fe00640 1 -- 172.21.15.105:0/2825404498 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97397104 0 0) 0x7fc934001120 con 0x7fc94015ebc0 2024-05-30T06:41:47.468 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc93fe00640 1 -- 172.21.15.105:0/2825404498 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9400d0840 con 0x7fc94015ebc0 2024-05-30T06:41:47.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc946000640 1 -- 172.21.15.105:0/2825404498 >> v1:172.21.15.105:6789/0 conn(0x7fc94009b800 legacy=0x7fc94006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc946000640 1 -- 172.21.15.105:0/2825404498 >> v1:172.21.15.37:6789/0 conn(0x7fc94015ebc0 legacy=0x7fc9400d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.469 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.469+0000 7fc946000640 1 -- 172.21.15.105:0/2825404498 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94009bce0 con 0x7fc94009aa60 2024-05-30T06:41:47.472 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.473+0000 7fc946000640 1 --2- 172.21.15.105:0/2825404498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc94009aa60 0x7fc94009ae70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc938009d90 tx=0x7fc93801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a291f5cdaefbe9d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:47.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.473+0000 7fc93fe00640 1 -- 172.21.15.105:0/2825404498 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9380b2070 con 0x7fc94009aa60 2024-05-30T06:41:47.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.473+0000 7fc93fe00640 1 -- 172.21.15.105:0/2825404498 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9380a5830 con 0x7fc94009aa60 2024-05-30T06:41:47.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.473+0000 7fc93fe00640 1 -- 172.21.15.105:0/2825404498 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9380a5c00 con 0x7fc94009aa60 2024-05-30T06:41:47.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.473+0000 7fc948000640 1 -- 172.21.15.105:0/2825404498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc94009aa60 msgr2=0x7fc94009ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.473 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.473+0000 7fc948000640 1 --2- 172.21.15.105:0/2825404498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc94009aa60 0x7fc94009ae70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc938009d90 tx=0x7fc93801c970 comp rx=0 tx=0).stop 2024-05-30T06:41:47.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.473+0000 7fc948000640 1 -- 172.21.15.105:0/2825404498 shutdown_connections 2024-05-30T06:41:47.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.473+0000 7fc948000640 1 --2- 172.21.15.105:0/2825404498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc94009aa60 0x7fc94009ae70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.473+0000 7fc948000640 1 -- 172.21.15.105:0/2825404498 >> 172.21.15.105:0/2825404498 conn(0x7fc9400b4060 msgr2=0x7fc9400b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:47.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.473+0000 7fc948000640 1 -- 172.21.15.105:0/2825404498 shutdown_connections 2024-05-30T06:41:47.474 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.473+0000 7fc948000640 1 -- 172.21.15.105:0/2825404498 wait complete. 2024-05-30T06:41:47.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc948000640 1 Processor -- start 2024-05-30T06:41:47.475 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc948000640 1 -- start start 2024-05-30T06:41:47.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc948000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc94009aa60 0x7fc9401546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.476 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc948000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94009b800 0x7fc9401523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc948000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc94015ebc0 0x7fc9400af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc948000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9400cd3d0 con 0x7fc94015ebc0 2024-05-30T06:41:47.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc948000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc94015efa0 con 0x7fc94009aa60 2024-05-30T06:41:47.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc948000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc9400cd550 con 0x7fc94009b800 2024-05-30T06:41:47.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc944c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94009b800 0x7fc9401523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc945600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc94009aa60 0x7fc9401546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc944c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94009b800 0x7fc9401523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44118/0 (socket says 172.21.15.105:44118) 2024-05-30T06:41:47.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc944c00640 1 -- 172.21.15.105:0/2142637930 learned_addr learned my addr 172.21.15.105:0/2142637930 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-05-30T06:41:47.477 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc946000640 1 --2- 172.21.15.105:0/2142637930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc94015ebc0 0x7fc9400af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc945600640 1 -- 172.21.15.105:0/2142637930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94009b800 msgr2=0x7fc9401523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.478 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc945600640 1 --2- 172.21.15.105:0/2142637930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94009b800 0x7fc9401523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc945600640 1 -- 172.21.15.105:0/2142637930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc94015ebc0 msgr2=0x7fc9400af630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc945600640 1 --2- 172.21.15.105:0/2142637930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc94015ebc0 0x7fc9400af630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc945600640 1 -- 172.21.15.105:0/2142637930 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc940152e90 con 0x7fc94009aa60 2024-05-30T06:41:47.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc944c00640 1 --2- 172.21.15.105:0/2142637930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94009b800 0x7fc9401523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:41:47.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc945600640 1 --2- 172.21.15.105:0/2142637930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc94009aa60 0x7fc9401546c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc93400c390 tx=0x7fc93400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:47.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc93d600640 1 -- 172.21.15.105:0/2142637930 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9340052d0 con 0x7fc94009aa60 2024-05-30T06:41:47.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc93d600640 1 -- 172.21.15.105:0/2142637930 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc934005490 con 0x7fc94009aa60 2024-05-30T06:41:47.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc948000640 1 -- 172.21.15.105:0/2142637930 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc940153170 con 0x7fc94009aa60 2024-05-30T06:41:47.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc93d600640 1 -- 172.21.15.105:0/2142637930 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934006c10 con 0x7fc94009aa60 2024-05-30T06:41:47.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc948000640 1 -- 172.21.15.105:0/2142637930 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc940153a10 con 0x7fc94009aa60 2024-05-30T06:41:47.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc93d600640 1 -- 172.21.15.105:0/2142637930 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc934007050 con 0x7fc94009aa60 2024-05-30T06:41:47.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.477+0000 7fc93d600640 1 -- 172.21.15.105:0/2142637930 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fc934006db0 con 0x7fc94009aa60 2024-05-30T06:41:47.479 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.481+0000 7fc948000640 1 -- 172.21.15.105:0/2142637930 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc940153340 con 0x7fc94009aa60 2024-05-30T06:41:47.481 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.481+0000 7fc93d600640 1 -- 172.21.15.105:0/2142637930 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc94009b3b0 con 0x7fc94009aa60 2024-05-30T06:41:47.504 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:47.499+0000 7f23e4ce2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-30T06:41:47.522 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:47.521+0000 7f00d0d7b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-30T06:41:47.547 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.549+0000 7fc948000640 1 -- 172.21.15.105:0/2142637930 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "64901865-0e8d-4da6-92d6-42e5ee643071", "id": 4} v 0) -- 0x7fc9400cf320 con 0x7fc94009aa60 2024-05-30T06:41:47.553 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.553+0000 7fc93d600640 1 -- 172.21.15.105:0/2142637930 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "64901865-0e8d-4da6-92d6-42e5ee643071", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fc934003e20 con 0x7fc94009aa60 2024-05-30T06:41:47.553 INFO:teuthology.orchestra.run.smithi105.stdout:4 2024-05-30T06:41:47.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.553+0000 7fc948000640 1 -- 172.21.15.105:0/2142637930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc94009aa60 msgr2=0x7fc9401546c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.553+0000 7fc948000640 1 --2- 172.21.15.105:0/2142637930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc94009aa60 0x7fc9401546c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc93400c390 tx=0x7fc93400c850 comp rx=0 tx=0).stop 2024-05-30T06:41:47.554 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.553+0000 7fc948000640 1 -- 172.21.15.105:0/2142637930 shutdown_connections 2024-05-30T06:41:47.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.553+0000 7fc948000640 1 --2- 172.21.15.105:0/2142637930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc94015ebc0 0x7fc9400af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.553+0000 7fc948000640 1 --2- 172.21.15.105:0/2142637930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc94009b800 0x7fc9401523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.553+0000 7fc948000640 1 --2- 172.21.15.105:0/2142637930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc94009aa60 0x7fc9401546c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.553+0000 7fc948000640 1 -- 172.21.15.105:0/2142637930 >> 172.21.15.105:0/2142637930 conn(0x7fc9400b4060 msgr2=0x7fc9400cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:47.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.553+0000 7fc948000640 1 -- 172.21.15.105:0/2142637930 shutdown_connections 2024-05-30T06:41:47.555 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.553+0000 7fc948000640 1 -- 172.21.15.105:0/2142637930 wait complete. 2024-05-30T06:41:47.570 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:47.567+0000 7f23e4ce2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-30T06:41:47.572 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new faa3858b-7d23-487a-983c-126643838d76 5 2024-05-30T06:41:47.613 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:47.613+0000 7f00d0d7b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-30T06:41:47.634 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:47.631+0000 7f23e4ce2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-30T06:41:47.681 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:47.681+0000 7f00d0d7b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-30T06:41:47.727 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:47.723+0000 7f23e4ce2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-30T06:41:47.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b3e00640 1 Processor -- start 2024-05-30T06:41:47.751 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b3e00640 1 -- start start 2024-05-30T06:41:47.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96b40c7dd0 0x7f96b40c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b3e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f96b409aa60 0x7f96b409aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b3e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b40c86f0 con 0x7f96b415cb90 2024-05-30T06:41:47.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b3e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f96b40d0c50 con 0x7f96b40c7dd0 2024-05-30T06:41:47.753 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b3e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f96b409b5d0 con 0x7f96b409aa60 2024-05-30T06:41:47.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96abe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f96b409aa60 0x7f96b409aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b3400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f96b415cb90 0x7f96b415d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:53012/0 (socket says 172.21.15.105:53012) 2024-05-30T06:41:47.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b3400640 1 -- 172.21.15.105:0/4255378072 learned_addr learned my addr 172.21.15.105:0/4255378072 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-05-30T06:41:47.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b2a00640 1 --2- 172.21.15.105:0/4255378072 >> v2:172.21.15.37:3300/0 conn(0x7f96b40c7dd0 0x7f96b40c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b2a00640 1 -- 172.21.15.105:0/4255378072 >> v2:172.21.15.105:3300/0 conn(0x7f96b409aa60 msgr2=0x7f96b409aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:47.754 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b2a00640 1 --2- 172.21.15.105:0/4255378072 >> v2:172.21.15.105:3300/0 conn(0x7f96b409aa60 0x7f96b409aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b2a00640 1 -- 172.21.15.105:0/4255378072 >> v1:172.21.15.105:6789/0 conn(0x7f96b415cb90 legacy=0x7f96b415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.755 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.753+0000 7f96b2a00640 1 -- 172.21.15.105:0/4255378072 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b409b8b0 con 0x7f96b40c7dd0 2024-05-30T06:41:47.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.757+0000 7f96b2a00640 1 --2- 172.21.15.105:0/4255378072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b40c7dd0 0x7f96b40c81b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96b4073640 tx=0x7f96a401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304947adf4dd7720 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:47.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.757+0000 7f96b2000640 1 -- 172.21.15.105:0/4255378072 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a40b1070 con 0x7f96b40c7dd0 2024-05-30T06:41:47.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.757+0000 7f96b2000640 1 -- 172.21.15.105:0/4255378072 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a40ac5f0 con 0x7f96b40c7dd0 2024-05-30T06:41:47.757 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.757+0000 7f96b2000640 1 -- 172.21.15.105:0/4255378072 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a40ac9c0 con 0x7f96b40c7dd0 2024-05-30T06:41:47.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.757+0000 7f96b3e00640 1 -- 172.21.15.105:0/4255378072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b40c7dd0 msgr2=0x7f96b40c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.757+0000 7f96b3e00640 1 --2- 172.21.15.105:0/4255378072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b40c7dd0 0x7f96b40c81b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96b4073640 tx=0x7f96a401c480 comp rx=0 tx=0).stop 2024-05-30T06:41:47.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.757+0000 7f96b3e00640 1 -- 172.21.15.105:0/4255378072 shutdown_connections 2024-05-30T06:41:47.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.757+0000 7f96b3e00640 1 --2- 172.21.15.105:0/4255378072 >> v2:172.21.15.105:3300/0 conn(0x7f96b409aa60 0x7f96b409aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.757+0000 7f96b3e00640 1 --2- 172.21.15.105:0/4255378072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b40c7dd0 0x7f96b40c81b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.757+0000 7f96b3e00640 1 -- 172.21.15.105:0/4255378072 >> 172.21.15.105:0/4255378072 conn(0x7f96b40cef80 msgr2=0x7f96b40cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:47.758 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.757+0000 7f96b3e00640 1 -- 172.21.15.105:0/4255378072 shutdown_connections 2024-05-30T06:41:47.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.757+0000 7f96b3e00640 1 -- 172.21.15.105:0/4255378072 wait complete. 2024-05-30T06:41:47.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3e00640 1 Processor -- start 2024-05-30T06:41:47.759 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3e00640 1 -- start start 2024-05-30T06:41:47.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96b409aa60 0x7f96b415c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b40c7dd0 0x7f96b415b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96b415cb90 0x7f96b40b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96b40ce8a0 con 0x7f96b40c7dd0 2024-05-30T06:41:47.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f96b40ce720 con 0x7f96b415cb90 2024-05-30T06:41:47.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f96b40d20f0 con 0x7f96b409aa60 2024-05-30T06:41:47.762 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96b415cb90 0x7f96b40b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b2a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96b409aa60 0x7f96b415c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96b415cb90 0x7f96b40b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50178/0 (socket says 172.21.15.105:50178) 2024-05-30T06:41:47.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3400640 1 -- 172.21.15.105:0/2336409460 learned_addr learned my addr 172.21.15.105:0/2336409460 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-05-30T06:41:47.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96abe00640 1 --2- 172.21.15.105:0/2336409460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b40c7dd0 0x7f96b415b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3400640 1 -- 172.21.15.105:0/2336409460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96b409aa60 msgr2=0x7f96b415c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3400640 1 --2- 172.21.15.105:0/2336409460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96b409aa60 0x7f96b415c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3400640 1 -- 172.21.15.105:0/2336409460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b40c7dd0 msgr2=0x7f96b415b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3400640 1 --2- 172.21.15.105:0/2336409460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b40c7dd0 0x7f96b415b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3400640 1 -- 172.21.15.105:0/2336409460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b4159f60 con 0x7f96b415cb90 2024-05-30T06:41:47.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3400640 1 --2- 172.21.15.105:0/2336409460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96b415cb90 0x7f96b40b6ea0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00cbc0 tx=0x7f96ac00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:47.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96aaa00640 1 -- 172.21.15.105:0/2336409460 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac017070 con 0x7f96b415cb90 2024-05-30T06:41:47.763 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96aaa00640 1 -- 172.21.15.105:0/2336409460 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ac00ad40 con 0x7f96b415cb90 2024-05-30T06:41:47.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3e00640 1 -- 172.21.15.105:0/2336409460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b415a240 con 0x7f96b415cb90 2024-05-30T06:41:47.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96aaa00640 1 -- 172.21.15.105:0/2336409460 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac012600 con 0x7f96b415cb90 2024-05-30T06:41:47.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96b3e00640 1 -- 172.21.15.105:0/2336409460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b415a800 con 0x7f96b415cb90 2024-05-30T06:41:47.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96aaa00640 1 -- 172.21.15.105:0/2336409460 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f96ac01a070 con 0x7f96b415cb90 2024-05-30T06:41:47.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.761+0000 7f96aaa00640 1 -- 172.21.15.105:0/2336409460 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f96ac01c440 con 0x7f96b415cb90 2024-05-30T06:41:47.764 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.765+0000 7f96b3e00640 1 -- 172.21.15.105:0/2336409460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b4075580 con 0x7f96b415cb90 2024-05-30T06:41:47.765 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.765+0000 7f96aaa00640 1 -- 172.21.15.105:0/2336409460 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f96ac0127a0 con 0x7f96b415cb90 2024-05-30T06:41:47.790 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:47.787+0000 7f23e4ce2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-30T06:41:47.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.833+0000 7f96b3e00640 1 -- 172.21.15.105:0/2336409460 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "faa3858b-7d23-487a-983c-126643838d76", "id": 5} v 0) -- 0x7f96b415fcc0 con 0x7f96b415cb90 2024-05-30T06:41:47.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.837+0000 7f96aaa00640 1 -- 172.21.15.105:0/2336409460 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "faa3858b-7d23-487a-983c-126643838d76", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f96ac012980 con 0x7f96b415cb90 2024-05-30T06:41:47.836 INFO:teuthology.orchestra.run.smithi105.stdout:5 2024-05-30T06:41:47.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.837+0000 7f96b3e00640 1 -- 172.21.15.105:0/2336409460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96b415cb90 msgr2=0x7f96b40b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.837+0000 7f96b3e00640 1 --2- 172.21.15.105:0/2336409460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96b415cb90 0x7f96b40b6ea0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f96ac00cbc0 tx=0x7f96ac00a430 comp rx=0 tx=0).stop 2024-05-30T06:41:47.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.837+0000 7f96b3e00640 1 -- 172.21.15.105:0/2336409460 shutdown_connections 2024-05-30T06:41:47.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.837+0000 7f96b3e00640 1 --2- 172.21.15.105:0/2336409460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96b415cb90 0x7f96b40b6ea0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.837+0000 7f96b3e00640 1 --2- 172.21.15.105:0/2336409460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96b40c7dd0 0x7f96b415b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.837+0000 7f96b3e00640 1 --2- 172.21.15.105:0/2336409460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96b409aa60 0x7f96b415c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.837+0000 7f96b3e00640 1 -- 172.21.15.105:0/2336409460 >> 172.21.15.105:0/2336409460 conn(0x7f96b40cef80 msgr2=0x7f96b41606e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:47.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.837+0000 7f96b3e00640 1 -- 172.21.15.105:0/2336409460 shutdown_connections 2024-05-30T06:41:47.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.837+0000 7f96b3e00640 1 -- 172.21.15.105:0/2336409460 wait complete. 2024-05-30T06:41:47.854 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:47.853+0000 7f00d0d7b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-30T06:41:47.856 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new ed48d033-1dc8-4b7b-9450-2f03dd492dc8 6 2024-05-30T06:41:47.883 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:47.879+0000 7f23e4ce2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-30T06:41:47.927 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:47.929+0000 7f00d0d7b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-30T06:41:47.948 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:47.943+0000 7f23e4ce2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-30T06:41:47.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.989+0000 7f3a2aa00640 1 Processor -- start 2024-05-30T06:41:47.990 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.989+0000 7f3a2aa00640 1 -- start start 2024-05-30T06:41:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.993+0000 7f3a2aa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a24156e40 0x7f3a240d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.993+0000 7f3a2aa00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a240cfb80 con 0x7f3a24070950 2024-05-30T06:41:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.993+0000 7f3a2aa00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a240b0270 con 0x7f3a2406d080 2024-05-30T06:41:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.993+0000 7f3a2aa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3a240d0170 con 0x7f3a24156e40 2024-05-30T06:41:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.993+0000 7f3a23e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a24156e40 0x7f3a240d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.993+0000 7f3a28a00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3a2406d080 0x7f3a2415cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:53022/0 (socket says 172.21.15.105:53022) 2024-05-30T06:41:47.992 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.993+0000 7f3a28a00640 1 -- 172.21.15.105:0/161627306 learned_addr learned my addr 172.21.15.105:0/161627306 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-05-30T06:41:47.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.993+0000 7f3a22a00640 1 -- 172.21.15.105:0/161627306 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2002911502 0 0) 0x7f3a240b0270 con 0x7f3a2406d080 2024-05-30T06:41:47.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.993+0000 7f3a22a00640 1 -- 172.21.15.105:0/161627306 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a08003530 con 0x7f3a2406d080 2024-05-30T06:41:47.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.993+0000 7f3a23e00640 1 -- 172.21.15.105:0/161627306 >> v1:172.21.15.105:6789/0 conn(0x7f3a2406d080 legacy=0x7f3a2415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.993+0000 7f3a23e00640 1 -- 172.21.15.105:0/161627306 >> v1:172.21.15.37:6789/0 conn(0x7f3a24070950 legacy=0x7f3a2406c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.993 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.993+0000 7f3a23e00640 1 -- 172.21.15.105:0/161627306 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a240731e0 con 0x7f3a24156e40 2024-05-30T06:41:47.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.997+0000 7f3a23e00640 1 --2- 172.21.15.105:0/161627306 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a24156e40 0x7f3a240d0600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a240d02f0 tx=0x7f3a1401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a6826b86debf792 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:47.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.997+0000 7f3a22a00640 1 -- 172.21.15.105:0/161627306 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a140b0070 con 0x7f3a24156e40 2024-05-30T06:41:47.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.997+0000 7f3a22a00640 1 -- 172.21.15.105:0/161627306 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a140ab600 con 0x7f3a24156e40 2024-05-30T06:41:47.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.997+0000 7f3a22a00640 1 -- 172.21.15.105:0/161627306 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a140ab9b0 con 0x7f3a24156e40 2024-05-30T06:41:47.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.997+0000 7f3a2aa00640 1 -- 172.21.15.105:0/161627306 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a24156e40 msgr2=0x7f3a240d0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:47.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.997+0000 7f3a2aa00640 1 --2- 172.21.15.105:0/161627306 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a24156e40 0x7f3a240d0600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a240d02f0 tx=0x7f3a1401c4c0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.996 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.997+0000 7f3a2aa00640 1 -- 172.21.15.105:0/161627306 shutdown_connections 2024-05-30T06:41:47.997 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.997+0000 7f3a2aa00640 1 --2- 172.21.15.105:0/161627306 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a24156e40 0x7f3a240d0600 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:47.997 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.997+0000 7f3a2aa00640 1 -- 172.21.15.105:0/161627306 >> 172.21.15.105:0/161627306 conn(0x7f3a240726c0 msgr2=0x7f3a24072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:47.997 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.997+0000 7f3a2aa00640 1 -- 172.21.15.105:0/161627306 shutdown_connections 2024-05-30T06:41:47.997 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.997+0000 7f3a2aa00640 1 -- 172.21.15.105:0/161627306 wait complete. 2024-05-30T06:41:47.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.997+0000 7f3a2aa00640 1 Processor -- start 2024-05-30T06:41:47.998 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:47.997+0000 7f3a2aa00640 1 -- start start 2024-05-30T06:41:48.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a2aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a2406d080 0x7f3a2414ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a2aa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a24070950 0x7f3a24145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a2aa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24156e40 0x7f3a24148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a2aa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2415d8e0 con 0x7f3a2406d080 2024-05-30T06:41:48.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a2aa00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2415d760 con 0x7f3a24156e40 2024-05-30T06:41:48.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a2aa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2416aa80 con 0x7f3a24070950 2024-05-30T06:41:48.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a28a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24156e40 0x7f3a24148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.000 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a23400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a24070950 0x7f3a24145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a28a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24156e40 0x7f3a24148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50182/0 (socket says 172.21.15.105:50182) 2024-05-30T06:41:48.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a28a00640 1 -- 172.21.15.105:0/197597051 learned_addr learned my addr 172.21.15.105:0/197597051 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-05-30T06:41:48.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a23e00640 1 --2- 172.21.15.105:0/197597051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a2406d080 0x7f3a2414ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a28a00640 1 -- 172.21.15.105:0/197597051 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a24070950 msgr2=0x7f3a24145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:48.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a28a00640 1 --2- 172.21.15.105:0/197597051 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a24070950 0x7f3a24145e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a28a00640 1 -- 172.21.15.105:0/197597051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a2406d080 msgr2=0x7f3a2414ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:48.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a28a00640 1 --2- 172.21.15.105:0/197597051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a2406d080 0x7f3a2414ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a28a00640 1 -- 172.21.15.105:0/197597051 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a240adf80 con 0x7f3a24156e40 2024-05-30T06:41:48.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a23400640 1 --2- 172.21.15.105:0/197597051 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a24070950 0x7f3a24145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:41:48.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a23e00640 1 --2- 172.21.15.105:0/197597051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a2406d080 0x7f3a2414ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:41:48.001 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a28a00640 1 --2- 172.21.15.105:0/197597051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24156e40 0x7f3a24148030 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00cbb0 tx=0x7f3a1c00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:48.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a1be00640 1 -- 172.21.15.105:0/197597051 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c017070 con 0x7f3a24156e40 2024-05-30T06:41:48.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a2aa00640 1 -- 172.21.15.105:0/197597051 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a240ae260 con 0x7f3a24156e40 2024-05-30T06:41:48.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a1be00640 1 -- 172.21.15.105:0/197597051 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1c00ad40 con 0x7f3a24156e40 2024-05-30T06:41:48.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a1be00640 1 -- 172.21.15.105:0/197597051 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c012600 con 0x7f3a24156e40 2024-05-30T06:41:48.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a2aa00640 1 -- 172.21.15.105:0/197597051 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2406e880 con 0x7f3a24156e40 2024-05-30T06:41:48.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a1be00640 1 -- 172.21.15.105:0/197597051 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3a1c01a070 con 0x7f3a24156e40 2024-05-30T06:41:48.002 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a1be00640 1 -- 172.21.15.105:0/197597051 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f3a1c01c440 con 0x7f3a24156e40 2024-05-30T06:41:48.003 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.001+0000 7f3a2aa00640 1 -- 172.21.15.105:0/197597051 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a24075580 con 0x7f3a24156e40 2024-05-30T06:41:48.004 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.005+0000 7f3a1be00640 1 -- 172.21.15.105:0/197597051 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3a1c0127a0 con 0x7f3a24156e40 2024-05-30T06:41:48.070 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.069+0000 7f3a2aa00640 1 -- 172.21.15.105:0/197597051 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ed48d033-1dc8-4b7b-9450-2f03dd492dc8", "id": 6} v 0) -- 0x7f3a2414c240 con 0x7f3a24156e40 2024-05-30T06:41:48.074 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.073+0000 7f3a1be00640 1 -- 172.21.15.105:0/197597051 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ed48d033-1dc8-4b7b-9450-2f03dd492dc8", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f3a1c012980 con 0x7f3a24156e40 2024-05-30T06:41:48.075 INFO:teuthology.orchestra.run.smithi105.stdout:6 2024-05-30T06:41:48.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.077+0000 7f3a2aa00640 1 -- 172.21.15.105:0/197597051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24156e40 msgr2=0x7f3a24148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:48.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.077+0000 7f3a2aa00640 1 --2- 172.21.15.105:0/197597051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24156e40 0x7f3a24148030 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00cbb0 tx=0x7f3a1c00a430 comp rx=0 tx=0).stop 2024-05-30T06:41:48.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.077+0000 7f3a2aa00640 1 -- 172.21.15.105:0/197597051 shutdown_connections 2024-05-30T06:41:48.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.077+0000 7f3a2aa00640 1 --2- 172.21.15.105:0/197597051 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a24156e40 0x7f3a24148030 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.077+0000 7f3a2aa00640 1 --2- 172.21.15.105:0/197597051 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a24070950 0x7f3a24145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.077+0000 7f3a2aa00640 1 --2- 172.21.15.105:0/197597051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a2406d080 0x7f3a2414ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.077+0000 7f3a2aa00640 1 -- 172.21.15.105:0/197597051 >> 172.21.15.105:0/197597051 conn(0x7f3a240726c0 msgr2=0x7f3a2415f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:48.076 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.077+0000 7f3a2aa00640 1 -- 172.21.15.105:0/197597051 shutdown_connections 2024-05-30T06:41:48.077 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.077+0000 7f3a2aa00640 1 -- 172.21.15.105:0/197597051 wait complete. 2024-05-30T06:41:48.093 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 785ed1bd-614f-420c-8d7e-d71aa396af96 7 2024-05-30T06:41:48.123 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:48.119+0000 7f23e4ce2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-30T06:41:48.197 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:48.191+0000 7f23e4ce2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-30T06:41:48.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.237+0000 7ff178c00640 1 Processor -- start 2024-05-30T06:41:48.237 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.237+0000 7ff178c00640 1 -- start start 2024-05-30T06:41:48.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.241+0000 7ff178c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff1740b56e0 0x7ff174071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.241+0000 7ff173400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff17415a770 0x7ff1740b4fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:53036/0 (socket says 172.21.15.105:53036) 2024-05-30T06:41:48.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.241+0000 7ff173400640 1 -- 172.21.15.105:0/1110620766 learned_addr learned my addr 172.21.15.105:0/1110620766 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-05-30T06:41:48.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.241+0000 7ff178c00640 1 --2- 172.21.15.105:0/1110620766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17406c070 0x7ff174072340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.241+0000 7ff178c00640 1 -- 172.21.15.105:0/1110620766 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff17415ab50 con 0x7ff17415a770 2024-05-30T06:41:48.241 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.241+0000 7ff178c00640 1 -- 172.21.15.105:0/1110620766 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff17406de40 con 0x7ff1740b56e0 2024-05-30T06:41:48.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.241+0000 7ff178c00640 1 -- 172.21.15.105:0/1110620766 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff17406e090 con 0x7ff17406c070 2024-05-30T06:41:48.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.241+0000 7ff172a00640 1 --2- 172.21.15.105:0/1110620766 >> v2:172.21.15.105:3300/0 conn(0x7ff1740b56e0 0x7ff174071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.242 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.241+0000 7ff173e00640 1 --2- 172.21.15.105:0/1110620766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17406c070 0x7ff174072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.241+0000 7ff173e00640 1 -- 172.21.15.105:0/1110620766 >> v2:172.21.15.105:3300/0 conn(0x7ff1740b56e0 msgr2=0x7ff174071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:48.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.241+0000 7ff173e00640 1 --2- 172.21.15.105:0/1110620766 >> v2:172.21.15.105:3300/0 conn(0x7ff1740b56e0 0x7ff174071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.241+0000 7ff173e00640 1 -- 172.21.15.105:0/1110620766 >> v1:172.21.15.105:6789/0 conn(0x7ff17415a770 legacy=0x7ff1740b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:48.247 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.241+0000 7ff173e00640 1 -- 172.21.15.105:0/1110620766 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17406e370 con 0x7ff17406c070 2024-05-30T06:41:48.248 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.249+0000 7ff173e00640 1 --2- 172.21.15.105:0/1110620766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17406c070 0x7ff174072340 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff16400dbe0 tx=0x7ff164020640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2f022e69b49d575 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:48.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.249+0000 7ff172000640 1 -- 172.21.15.105:0/1110620766 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16400d2d0 con 0x7ff17406c070 2024-05-30T06:41:48.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.249+0000 7ff172000640 1 -- 172.21.15.105:0/1110620766 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1640b3070 con 0x7ff17406c070 2024-05-30T06:41:48.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.249+0000 7ff172000640 1 -- 172.21.15.105:0/1110620766 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16400b670 con 0x7ff17406c070 2024-05-30T06:41:48.249 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.249+0000 7ff178c00640 1 -- 172.21.15.105:0/1110620766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17406c070 msgr2=0x7ff174072340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:48.250 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.249+0000 7ff178c00640 1 --2- 172.21.15.105:0/1110620766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17406c070 0x7ff174072340 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff16400dbe0 tx=0x7ff164020640 comp rx=0 tx=0).stop 2024-05-30T06:41:48.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.249+0000 7ff178c00640 1 -- 172.21.15.105:0/1110620766 shutdown_connections 2024-05-30T06:41:48.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.249+0000 7ff178c00640 1 --2- 172.21.15.105:0/1110620766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17406c070 0x7ff174072340 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.249+0000 7ff178c00640 1 --2- 172.21.15.105:0/1110620766 >> v2:172.21.15.105:3300/0 conn(0x7ff1740b56e0 0x7ff174071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.249+0000 7ff178c00640 1 -- 172.21.15.105:0/1110620766 >> 172.21.15.105:0/1110620766 conn(0x7ff174067b60 msgr2=0x7ff17406b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:48.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.253+0000 7ff178c00640 1 -- 172.21.15.105:0/1110620766 shutdown_connections 2024-05-30T06:41:48.251 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.253+0000 7ff178c00640 1 -- 172.21.15.105:0/1110620766 wait complete. 2024-05-30T06:41:48.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.257+0000 7ff178c00640 1 Processor -- start 2024-05-30T06:41:48.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.257+0000 7ff178c00640 1 -- start start 2024-05-30T06:41:48.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.261+0000 7ff178c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff17406c070 0x7ff1742079d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.261+0000 7ff178c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1740b56e0 0x7ff174203bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.261+0000 7ff178c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17415a770 0x7ff174159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.261+0000 7ff173400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff17406c070 0x7ff1742079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.261+0000 7ff173400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff17406c070 0x7ff1742079d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:50196/0 (socket says 172.21.15.105:50196) 2024-05-30T06:41:48.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.261+0000 7ff173400640 1 -- 172.21.15.105:0/252981768 learned_addr learned my addr 172.21.15.105:0/252981768 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-05-30T06:41:48.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.261+0000 7ff178c00640 1 -- 172.21.15.105:0/252981768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff1740b3db0 con 0x7ff1740b56e0 2024-05-30T06:41:48.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.261+0000 7ff172a00640 1 --2- 172.21.15.105:0/252981768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1740b56e0 0x7ff174203bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.261+0000 7ff178c00640 1 -- 172.21.15.105:0/252981768 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff1740b3c30 con 0x7ff17406c070 2024-05-30T06:41:48.263 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff178c00640 1 -- 172.21.15.105:0/252981768 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff1740b3f30 con 0x7ff17415a770 2024-05-30T06:41:48.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff173e00640 1 --2- 172.21.15.105:0/252981768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17415a770 0x7ff174159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff173e00640 1 -- 172.21.15.105:0/252981768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff17406c070 msgr2=0x7ff1742079d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:48.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff173e00640 1 --2- 172.21.15.105:0/252981768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff17406c070 0x7ff1742079d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff173e00640 1 -- 172.21.15.105:0/252981768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1740b56e0 msgr2=0x7ff174203bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:48.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff173e00640 1 --2- 172.21.15.105:0/252981768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1740b56e0 0x7ff174203bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff173e00640 1 -- 172.21.15.105:0/252981768 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff174208900 con 0x7ff17415a770 2024-05-30T06:41:48.264 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff173e00640 1 --2- 172.21.15.105:0/252981768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17415a770 0x7ff174159540 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff17406dfc0 tx=0x7ff16401ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:48.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff16b400640 1 -- 172.21.15.105:0/252981768 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1640bd020 con 0x7ff17415a770 2024-05-30T06:41:48.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff16b400640 1 -- 172.21.15.105:0/252981768 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1640b9660 con 0x7ff17415a770 2024-05-30T06:41:48.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff16b400640 1 -- 172.21.15.105:0/252981768 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1640bd020 con 0x7ff17415a770 2024-05-30T06:41:48.265 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff178c00640 1 -- 172.21.15.105:0/252981768 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff174208340 con 0x7ff17415a770 2024-05-30T06:41:48.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff178c00640 1 -- 172.21.15.105:0/252981768 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff17414f250 con 0x7ff17415a770 2024-05-30T06:41:48.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff16b400640 1 -- 172.21.15.105:0/252981768 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff1640c0070 con 0x7ff17415a770 2024-05-30T06:41:48.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff168c00640 1 -- 172.21.15.105:0/252981768 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff174068ab0 con 0x7ff17415a770 2024-05-30T06:41:48.266 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.265+0000 7ff16b400640 1 -- 172.21.15.105:0/252981768 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff1640b9810 con 0x7ff17415a770 2024-05-30T06:41:48.271 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.273+0000 7ff16b400640 1 -- 172.21.15.105:0/252981768 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff1640c7080 con 0x7ff17415a770 2024-05-30T06:41:48.360 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.361+0000 7ff168c00640 1 -- 172.21.15.105:0/252981768 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "785ed1bd-614f-420c-8d7e-d71aa396af96", "id": 7} v 0) -- 0x7ff174068ab0 con 0x7ff17415a770 2024-05-30T06:41:48.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.365+0000 7ff16b400640 1 -- 172.21.15.105:0/252981768 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "785ed1bd-614f-420c-8d7e-d71aa396af96", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff16401a2c0 con 0x7ff17415a770 2024-05-30T06:41:48.364 INFO:teuthology.orchestra.run.smithi105.stdout:7 2024-05-30T06:41:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.365+0000 7ff168c00640 1 -- 172.21.15.105:0/252981768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17415a770 msgr2=0x7ff174159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.365+0000 7ff168c00640 1 --2- 172.21.15.105:0/252981768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17415a770 0x7ff174159540 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff17406dfc0 tx=0x7ff16401ee80 comp rx=0 tx=0).stop 2024-05-30T06:41:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.365+0000 7ff168c00640 1 -- 172.21.15.105:0/252981768 shutdown_connections 2024-05-30T06:41:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.365+0000 7ff168c00640 1 --2- 172.21.15.105:0/252981768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17415a770 0x7ff174159540 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.365+0000 7ff168c00640 1 --2- 172.21.15.105:0/252981768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1740b56e0 0x7ff174203bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.365+0000 7ff168c00640 1 --2- 172.21.15.105:0/252981768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff17406c070 0x7ff1742079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.365+0000 7ff168c00640 1 -- 172.21.15.105:0/252981768 >> 172.21.15.105:0/252981768 conn(0x7ff174067b60 msgr2=0x7ff1740b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:48.366 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.365+0000 7ff168c00640 1 -- 172.21.15.105:0/252981768 shutdown_connections 2024-05-30T06:41:48.367 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:41:48.365+0000 7ff168c00640 1 -- 172.21.15.105:0/252981768 wait complete. 2024-05-30T06:41:48.383 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-30T06:41:48.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-30T06:41:48.386 INFO:tasks.ceph.osd.0:Started 2024-05-30T06:41:48.387 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-30T06:41:48.387 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-30T06:41:48.390 INFO:tasks.ceph.osd.1:Started 2024-05-30T06:41:48.390 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-30T06:41:48.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-30T06:41:48.393 INFO:tasks.ceph.osd.2:Started 2024-05-30T06:41:48.393 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-30T06:41:48.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-30T06:41:48.396 INFO:tasks.ceph.osd.3:Started 2024-05-30T06:41:48.396 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-30T06:41:48.396 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-30T06:41:48.399 INFO:tasks.ceph.osd.4:Started 2024-05-30T06:41:48.399 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-30T06:41:48.399 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-30T06:41:48.404 INFO:tasks.ceph.osd.5:Started 2024-05-30T06:41:48.404 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-30T06:41:48.405 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-30T06:41:48.409 INFO:tasks.ceph.osd.6:Started 2024-05-30T06:41:48.409 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-30T06:41:48.409 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-30T06:41:48.413 INFO:tasks.ceph.osd.7:Started 2024-05-30T06:41:48.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:41:48.542 INFO:tasks.ceph.mgr.x.smithi105.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-30T06:41:48.543 INFO:tasks.ceph.mgr.x.smithi105.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-30T06:41:48.543 INFO:tasks.ceph.mgr.x.smithi105.stderr: from numpy import show_config as show_numpy_config 2024-05-30T06:41:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.575+0000 7fd7ec000640 1 Processor -- start 2024-05-30T06:41:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.579+0000 7fd7ec000640 1 -- start start 2024-05-30T06:41:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.579+0000 7fd7ec000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7e415a8d0 0x7fd7e40cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.579+0000 7fd7e9600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7e415a8d0 0x7fd7e40cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.579+0000 7fd7e9600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7e415a8d0 0x7fd7e40cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55964/0 (socket says 172.21.15.37:55964) 2024-05-30T06:41:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.579+0000 7fd7e9600640 1 -- 172.21.15.37:0/4277768574 learned_addr learned my addr 172.21.15.37:0/4277768574 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:41:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.583+0000 7fd7ec000640 1 --2- 172.21.15.37:0/4277768574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e40af730 0x7fd7e4071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.583+0000 7fd7ec000640 1 --2- 172.21.15.37:0/4277768574 >> v2:172.21.15.105:3300/0 conn(0x7fd7e40724e0 0x7fd7e406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.583+0000 7fd7ec000640 1 -- 172.21.15.37:0/4277768574 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e40b4630 con 0x7fd7e415a8d0 2024-05-30T06:41:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.583+0000 7fd7ec000640 1 -- 172.21.15.37:0/4277768574 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e40b54e0 con 0x7fd7e40724e0 2024-05-30T06:41:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.583+0000 7fd7ec000640 1 -- 172.21.15.37:0/4277768574 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e40b57c0 con 0x7fd7e40af730 2024-05-30T06:41:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.583+0000 7fd7ea000640 1 --2- 172.21.15.37:0/4277768574 >> v2:172.21.15.105:3300/0 conn(0x7fd7e40724e0 0x7fd7e406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.583+0000 7fd7e8c00640 1 --2- 172.21.15.37:0/4277768574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e40af730 0x7fd7e4071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.583+0000 7fd7ea000640 1 -- 172.21.15.37:0/4277768574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e40af730 msgr2=0x7fd7e4071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.583+0000 7fd7ea000640 1 --2- 172.21.15.37:0/4277768574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e40af730 0x7fd7e4071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.583+0000 7fd7ea000640 1 -- 172.21.15.37:0/4277768574 >> v2:172.21.15.37:3300/0 conn(0x7fd7e415a8d0 msgr2=0x7fd7e40cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.583+0000 7fd7ea000640 1 --2- 172.21.15.37:0/4277768574 >> v2:172.21.15.37:3300/0 conn(0x7fd7e415a8d0 0x7fd7e40cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.583+0000 7fd7ea000640 1 -- 172.21.15.37:0/4277768574 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e40b42c0 con 0x7fd7e40724e0 2024-05-30T06:41:48.587 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:48.589+0000 7f00d0d7b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-30T06:41:48.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.587+0000 7fd7ea000640 1 --2- 172.21.15.37:0/4277768574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e40724e0 0x7fd7e406e000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40b45a0 tx=0x7fd7d801eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63c57bae656178e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:48.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.587+0000 7fd7e3e00640 1 -- 172.21.15.37:0/4277768574 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80b4070 con 0x7fd7e40724e0 2024-05-30T06:41:48.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.587+0000 7fd7e3e00640 1 -- 172.21.15.37:0/4277768574 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d80a7a00 con 0x7fd7e40724e0 2024-05-30T06:41:48.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.587+0000 7fd7e3e00640 1 -- 172.21.15.37:0/4277768574 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80a7e10 con 0x7fd7e40724e0 2024-05-30T06:41:48.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.591+0000 7fd7ec000640 1 -- 172.21.15.37:0/4277768574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e40724e0 msgr2=0x7fd7e406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:48.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.591+0000 7fd7ec000640 1 --2- 172.21.15.37:0/4277768574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e40724e0 0x7fd7e406e000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40b45a0 tx=0x7fd7d801eb70 comp rx=0 tx=0).stop 2024-05-30T06:41:48.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.591+0000 7fd7ec000640 1 -- 172.21.15.37:0/4277768574 shutdown_connections 2024-05-30T06:41:48.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.591+0000 7fd7ec000640 1 --2- 172.21.15.37:0/4277768574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e40724e0 0x7fd7e406e000 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.591+0000 7fd7ec000640 1 --2- 172.21.15.37:0/4277768574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e40af730 0x7fd7e4071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.591+0000 7fd7ec000640 1 --2- 172.21.15.37:0/4277768574 >> v2:172.21.15.37:3300/0 conn(0x7fd7e415a8d0 0x7fd7e40cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.591+0000 7fd7ec000640 1 -- 172.21.15.37:0/4277768574 >> 172.21.15.37:0/4277768574 conn(0x7fd7e406b960 msgr2=0x7fd7e406bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.591+0000 7fd7ec000640 1 -- 172.21.15.37:0/4277768574 shutdown_connections 2024-05-30T06:41:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.591+0000 7fd7ec000640 1 -- 172.21.15.37:0/4277768574 wait complete. 2024-05-30T06:41:48.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.595+0000 7fd7ec000640 1 Processor -- start 2024-05-30T06:41:48.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.595+0000 7fd7ec000640 1 -- start start 2024-05-30T06:41:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.595+0000 7fd7ec000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40724e0 0x7fd7e414ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.595+0000 7fd7ec000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e40af730 0x7fd7e414c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.595+0000 7fd7ec000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e415a8d0 0x7fd7e414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.595+0000 7fd7ec000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e40cea70 con 0x7fd7e40724e0 2024-05-30T06:41:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.595+0000 7fd7ea000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e415a8d0 0x7fd7e414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.595+0000 7fd7ea000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e415a8d0 0x7fd7e414ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:49836/0 (socket says 172.21.15.37:49836) 2024-05-30T06:41:48.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.595+0000 7fd7ea000640 1 -- 172.21.15.37:0/1215033313 learned_addr learned my addr 172.21.15.37:0/1215033313 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:41:48.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.595+0000 7fd7ec000640 1 -- 172.21.15.37:0/1215033313 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e415aec0 con 0x7fd7e40af730 2024-05-30T06:41:48.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.595+0000 7fd7ec000640 1 -- 172.21.15.37:0/1215033313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e40cebf0 con 0x7fd7e415a8d0 2024-05-30T06:41:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7e8c00640 1 --2- 172.21.15.37:0/1215033313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e40af730 0x7fd7e414c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7e9600640 1 --2- 172.21.15.37:0/1215033313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40724e0 0x7fd7e414ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7ea000640 1 -- 172.21.15.37:0/1215033313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e40af730 msgr2=0x7fd7e414c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7ea000640 1 --2- 172.21.15.37:0/1215033313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e40af730 0x7fd7e414c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7ea000640 1 -- 172.21.15.37:0/1215033313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40724e0 msgr2=0x7fd7e414ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7ea000640 1 --2- 172.21.15.37:0/1215033313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40724e0 0x7fd7e414ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7ea000640 1 -- 172.21.15.37:0/1215033313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e406f700 con 0x7fd7e415a8d0 2024-05-30T06:41:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7ea000640 1 --2- 172.21.15.37:0/1215033313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e415a8d0 0x7fd7e414ccc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd7d801f410 tx=0x7fd7d801b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7e1600640 1 -- 172.21.15.37:0/1215033313 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80bd070 con 0x7fd7e415a8d0 2024-05-30T06:41:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7e1600640 1 -- 172.21.15.37:0/1215033313 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d80af640 con 0x7fd7e415a8d0 2024-05-30T06:41:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7e1600640 1 -- 172.21.15.37:0/1215033313 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80b4040 con 0x7fd7e415a8d0 2024-05-30T06:41:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7ec000640 1 -- 172.21.15.37:0/1215033313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e406bf50 con 0x7fd7e415a8d0 2024-05-30T06:41:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7ec000640 1 -- 172.21.15.37:0/1215033313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e414a370 con 0x7fd7e415a8d0 2024-05-30T06:41:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7e1600640 1 -- 172.21.15.37:0/1215033313 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd7d80afa30 con 0x7fd7e415a8d0 2024-05-30T06:41:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7e1600640 1 -- 172.21.15.37:0/1215033313 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd7d80b7a90 con 0x7fd7e415a8d0 2024-05-30T06:41:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.599+0000 7fd7ec000640 1 -- 172.21.15.37:0/1215033313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e4068b20 con 0x7fd7e415a8d0 2024-05-30T06:41:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.603+0000 7fd7e1600640 1 -- 172.21.15.37:0/1215033313 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd7d80c6020 con 0x7fd7e415a8d0 2024-05-30T06:41:48.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.687+0000 7fd7ec000640 1 -- 172.21.15.37:0/1215033313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7e414d3c0 con 0x7fd7e415a8d0 2024-05-30T06:41:48.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.687+0000 7fd7e1600640 1 -- 172.21.15.37:0/1215033313 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd7e414d3c0 con 0x7fd7e415a8d0 2024-05-30T06:41:48.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:41:48.692 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:41:48.364349+0000","last_up_change":"0.000000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:41:48.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.687+0000 7fd7ec000640 1 -- 172.21.15.37:0/1215033313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e415a8d0 msgr2=0x7fd7e414ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.687+0000 7fd7ec000640 1 --2- 172.21.15.37:0/1215033313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e415a8d0 0x7fd7e414ccc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd7d801f410 tx=0x7fd7d801b910 comp rx=0 tx=0).stop 2024-05-30T06:41:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.687+0000 7fd7ec000640 1 -- 172.21.15.37:0/1215033313 shutdown_connections 2024-05-30T06:41:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.687+0000 7fd7ec000640 1 --2- 172.21.15.37:0/1215033313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7e415a8d0 0x7fd7e414ccc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.687+0000 7fd7ec000640 1 --2- 172.21.15.37:0/1215033313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7e40af730 0x7fd7e414c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.687+0000 7fd7ec000640 1 --2- 172.21.15.37:0/1215033313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e40724e0 0x7fd7e414ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.687+0000 7fd7ec000640 1 -- 172.21.15.37:0/1215033313 >> 172.21.15.37:0/1215033313 conn(0x7fd7e406b960 msgr2=0x7fd7e415d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.687+0000 7fd7ec000640 1 -- 172.21.15.37:0/1215033313 shutdown_connections 2024-05-30T06:41:48.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:41:48.687+0000 7fd7ec000640 1 -- 172.21.15.37:0/1215033313 wait complete. 2024-05-30T06:41:48.710 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-30T06:41:48.711 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-30T06:41:48.738 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:48.737+0000 7f00d0d7b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-30T06:41:48.912 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:48.913+0000 7f00d0d7b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-30T06:41:48.968 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-30T06:41:48.968 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-30T06:41:48.968 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2024-05-30T06:41:48.993 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:48.993+0000 7f00d0d7b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-30T06:41:49.034 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:49.031+0000 7f23e4ce2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-30T06:41:49.048 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-05-30T06:41:49.049+0000 7f2ca7e2b7c0 -1 Falling back to public interface 2024-05-30T06:41:49.054 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-05-30T06:41:49.051+0000 7f752802b7c0 -1 Falling back to public interface 2024-05-30T06:41:49.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-05-30T06:41:49.055+0000 7f8067fb67c0 -1 Falling back to public interface 2024-05-30T06:41:49.064 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-05-30T06:41:49.065+0000 7faed4edb7c0 -1 Falling back to public interface 2024-05-30T06:41:49.076 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-05-30T06:41:49.077+0000 7f06f4e597c0 -1 Falling back to public interface 2024-05-30T06:41:49.076 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-05-30T06:41:49.077+0000 7f57b7bb67c0 -1 Falling back to public interface 2024-05-30T06:41:49.077 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-05-30T06:41:49.077+0000 7f06f3a00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2024-05-30T06:41:49.086 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-05-30T06:41:49.083+0000 7f3dedeba7c0 -1 Falling back to public interface 2024-05-30T06:41:49.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-05-30T06:41:49.087+0000 7efeb6e1e7c0 -1 Falling back to public interface 2024-05-30T06:41:49.147 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:49.149+0000 7f00d0d7b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-30T06:41:49.196 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:49.191+0000 7f23e4ce2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-30T06:41:49.494 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:49.491+0000 7f23e4ce2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-30T06:41:49.515 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-30T06:41:49.571 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:49.567+0000 7f23e4ce2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-30T06:41:49.646 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb936c00640 1 Processor -- start 2024-05-30T06:41:49.646 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb936c00640 1 -- start start 2024-05-30T06:41:49.647 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb936c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb930146000 0x7fb9300ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:49.648 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb936c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb9301463e0 0x7fb9300d2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:49.648 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb936c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9300cd350 con 0x7fb9300b4260 2024-05-30T06:41:49.648 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb936c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb9300d34b0 con 0x7fb9301463e0 2024-05-30T06:41:49.648 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb936c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb9300cd630 con 0x7fb930146000 2024-05-30T06:41:49.649 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb92fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb930146000 0x7fb9300ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:49.649 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb92fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb930146000 0x7fb9300ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:49840/0 (socket says 172.21.15.37:49840) 2024-05-30T06:41:49.649 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb92fe00640 1 -- 172.21.15.37:0/4007816651 learned_addr learned my addr 172.21.15.37:0/4007816651 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:41:49.649 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb927e00640 1 --2- 172.21.15.37:0/4007816651 >> v2:172.21.15.105:3300/0 conn(0x7fb9301463e0 0x7fb9300d2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:49.649 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb92fe00640 1 -- 172.21.15.37:0/4007816651 >> v2:172.21.15.105:3300/0 conn(0x7fb9301463e0 msgr2=0x7fb9300d2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:49.649 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb92fe00640 1 --2- 172.21.15.37:0/4007816651 >> v2:172.21.15.105:3300/0 conn(0x7fb9301463e0 0x7fb9300d2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:49.649 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb92fe00640 1 -- 172.21.15.37:0/4007816651 >> v1:172.21.15.105:6789/0 conn(0x7fb9300b4260 legacy=0x7fb9301603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:49.649 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb92f400640 1 -- 172.21.15.37:0/4007816651 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 877159900 0 0) 0x7fb9300cd350 con 0x7fb9300b4260 2024-05-30T06:41:49.649 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.643+0000 7fb92fe00640 1 -- 172.21.15.37:0/4007816651 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9300d0320 con 0x7fb930146000 2024-05-30T06:41:49.651 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.647+0000 7fb92fe00640 1 --2- 172.21.15.37:0/4007816651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb930146000 0x7fb9300ccc90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb920009870 tx=0x7fb92001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f292d26f4035a12 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:49.652 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.647+0000 7fb92f400640 1 -- 172.21.15.37:0/4007816651 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9200aa650 con 0x7fb930146000 2024-05-30T06:41:49.652 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.647+0000 7fb92f400640 1 -- 172.21.15.37:0/4007816651 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9200af070 con 0x7fb930146000 2024-05-30T06:41:49.652 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.647+0000 7fb92f400640 1 -- 172.21.15.37:0/4007816651 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9200aaa10 con 0x7fb930146000 2024-05-30T06:41:49.652 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.647+0000 7fb936c00640 1 -- 172.21.15.37:0/4007816651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb930146000 msgr2=0x7fb9300ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:49.653 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.647+0000 7fb936c00640 1 --2- 172.21.15.37:0/4007816651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb930146000 0x7fb9300ccc90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb920009870 tx=0x7fb92001c530 comp rx=0 tx=0).stop 2024-05-30T06:41:49.653 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.647+0000 7fb936c00640 1 -- 172.21.15.37:0/4007816651 shutdown_connections 2024-05-30T06:41:49.653 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.647+0000 7fb936c00640 1 --2- 172.21.15.37:0/4007816651 >> v2:172.21.15.105:3300/0 conn(0x7fb9301463e0 0x7fb9300d2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:49.653 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.647+0000 7fb936c00640 1 --2- 172.21.15.37:0/4007816651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb930146000 0x7fb9300ccc90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:49.653 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.647+0000 7fb936c00640 1 -- 172.21.15.37:0/4007816651 >> 172.21.15.37:0/4007816651 conn(0x7fb93006b990 msgr2=0x7fb93006bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:49.653 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.647+0000 7fb936c00640 1 -- 172.21.15.37:0/4007816651 shutdown_connections 2024-05-30T06:41:49.653 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.647+0000 7fb936c00640 1 -- 172.21.15.37:0/4007816651 wait complete. 2024-05-30T06:41:49.654 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb936c00640 1 Processor -- start 2024-05-30T06:41:49.654 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb936c00640 1 -- start start 2024-05-30T06:41:49.656 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb936c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9300b4260 0x7fb9301598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:49.656 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb936c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb930146000 0x7fb93015ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:49.656 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb936c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9301463e0 0x7fb9300cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:49.656 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb936c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb930169910 con 0x7fb9301463e0 2024-05-30T06:41:49.656 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb936c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb930169790 con 0x7fb930146000 2024-05-30T06:41:49.656 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb936c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb930169a90 con 0x7fb9300b4260 2024-05-30T06:41:49.656 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb934c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9301463e0 0x7fb9300cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:49.657 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb934c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9301463e0 0x7fb9300cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55992/0 (socket says 172.21.15.37:55992) 2024-05-30T06:41:49.657 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb934c00640 1 -- 172.21.15.37:0/3983695453 learned_addr learned my addr 172.21.15.37:0/3983695453 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:41:49.657 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb92fe00640 1 --2- 172.21.15.37:0/3983695453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9300b4260 0x7fb9301598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:49.657 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb927e00640 1 --2- 172.21.15.37:0/3983695453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb930146000 0x7fb93015ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:49.657 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb934c00640 1 -- 172.21.15.37:0/3983695453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9300b4260 msgr2=0x7fb9301598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:49.657 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb934c00640 1 --2- 172.21.15.37:0/3983695453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9300b4260 0x7fb9301598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:49.657 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb934c00640 1 -- 172.21.15.37:0/3983695453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb930146000 msgr2=0x7fb93015ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:49.657 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb934c00640 1 --2- 172.21.15.37:0/3983695453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb930146000 0x7fb93015ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:49.657 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb934c00640 1 -- 172.21.15.37:0/3983695453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93015ed70 con 0x7fb9301463e0 2024-05-30T06:41:49.657 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb934c00640 1 --2- 172.21.15.37:0/3983695453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9301463e0 0x7fb9300cb950 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb92800c7b0 tx=0x7fb92800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:49.658 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb92cc00640 1 -- 172.21.15.37:0/3983695453 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928003db0 con 0x7fb9301463e0 2024-05-30T06:41:49.658 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb92cc00640 1 -- 172.21.15.37:0/3983695453 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb928005070 con 0x7fb9301463e0 2024-05-30T06:41:49.658 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb92cc00640 1 -- 172.21.15.37:0/3983695453 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928005460 con 0x7fb9301463e0 2024-05-30T06:41:49.658 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.651+0000 7fb936c00640 1 -- 172.21.15.37:0/3983695453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93015d8f0 con 0x7fb9301463e0 2024-05-30T06:41:49.658 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.655+0000 7fb936c00640 1 -- 172.21.15.37:0/3983695453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb93015eff0 con 0x7fb9301463e0 2024-05-30T06:41:49.659 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.655+0000 7fb92cc00640 1 -- 172.21.15.37:0/3983695453 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb928005600 con 0x7fb9301463e0 2024-05-30T06:41:49.659 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.655+0000 7fb92cc00640 1 -- 172.21.15.37:0/3983695453 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb928012400 con 0x7fb9301463e0 2024-05-30T06:41:49.659 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.655+0000 7fb936c00640 1 -- 172.21.15.37:0/3983695453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9300693e0 con 0x7fb9301463e0 2024-05-30T06:41:49.660 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.655+0000 7fb92cc00640 1 -- 172.21.15.37:0/3983695453 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb93015ed70 con 0x7fb9301463e0 2024-05-30T06:41:49.720 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.715+0000 7fb936c00640 1 -- 172.21.15.37:0/3983695453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb930074fd0 con 0x7fb9301463e0 2024-05-30T06:41:49.721 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.719+0000 7fb92cc00640 1 -- 172.21.15.37:0/3983695453 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb92800a640 con 0x7fb9301463e0 2024-05-30T06:41:49.721 INFO:teuthology.misc.health.smithi037.stdout: 2024-05-30T06:41:49.721 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":10,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:41:48.364349+0000","last_up_change":"0.000000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:41:49.722 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.719+0000 7fb936c00640 1 -- 172.21.15.37:0/3983695453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9301463e0 msgr2=0x7fb9300cb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:49.722 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.719+0000 7fb936c00640 1 --2- 172.21.15.37:0/3983695453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9301463e0 0x7fb9300cb950 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb92800c7b0 tx=0x7fb92800cc70 comp rx=0 tx=0).stop 2024-05-30T06:41:49.722 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.719+0000 7fb936c00640 1 -- 172.21.15.37:0/3983695453 shutdown_connections 2024-05-30T06:41:49.722 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.719+0000 7fb936c00640 1 --2- 172.21.15.37:0/3983695453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9301463e0 0x7fb9300cb950 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:49.722 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.719+0000 7fb936c00640 1 --2- 172.21.15.37:0/3983695453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb930146000 0x7fb93015ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:49.723 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.719+0000 7fb936c00640 1 --2- 172.21.15.37:0/3983695453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9300b4260 0x7fb9301598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:49.723 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.719+0000 7fb936c00640 1 -- 172.21.15.37:0/3983695453 >> 172.21.15.37:0/3983695453 conn(0x7fb93006b990 msgr2=0x7fb93006bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:49.723 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.719+0000 7fb936c00640 1 -- 172.21.15.37:0/3983695453 shutdown_connections 2024-05-30T06:41:49.723 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:49.719+0000 7fb936c00640 1 -- 172.21.15.37:0/3983695453 wait complete. 2024-05-30T06:41:49.735 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:49.731+0000 7f23e4ce2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-30T06:41:49.739 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-30T06:41:49.847 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:49.849+0000 7f00d0d7b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-30T06:41:49.934 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:49.933+0000 7f00d0d7b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-30T06:41:50.139 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:50.141+0000 7f00d0d7b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-30T06:41:50.222 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:50.221+0000 7f00d0d7b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-30T06:41:50.461 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:50.459+0000 7f23e4ce2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-30T06:41:50.549 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:50.549+0000 7f00d0d7b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-30T06:41:50.552 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:50.547+0000 7f23e4ce2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-30T06:41:50.620 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:50.621+0000 7f00d0d7b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-30T06:41:50.773 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:50.771+0000 7f23e4ce2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-30T06:41:50.861 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:50.859+0000 7f23e4ce2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-30T06:41:51.207 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:51.203+0000 7f23e4ce2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-30T06:41:51.281 INFO:tasks.ceph.mgr.y.smithi037.stderr:2024-05-30T06:41:51.279+0000 7f23e4ce2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-30T06:41:51.645 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:51.645+0000 7f0076e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-30T06:41:51.645 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:41:51.645+0000 7f0076e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-30T06:41:52.964 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-05-30T06:41:52.965+0000 7f2ca7e2b7c0 -1 osd.4 0 log_to_monitors true 2024-05-30T06:41:52.990 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-05-30T06:41:52.987+0000 7f752802b7c0 -1 osd.0 0 log_to_monitors true 2024-05-30T06:41:52.993 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-05-30T06:41:52.993+0000 7faed4edb7c0 -1 osd.5 0 log_to_monitors true 2024-05-30T06:41:53.060 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-05-30T06:41:53.055+0000 7f3dedeba7c0 -1 osd.3 0 log_to_monitors true 2024-05-30T06:41:53.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-05-30T06:41:53.079+0000 7efeb6e1e7c0 -1 osd.2 0 log_to_monitors true 2024-05-30T06:41:53.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-05-30T06:41:53.083+0000 7f8067fb67c0 -1 osd.1 0 log_to_monitors true 2024-05-30T06:41:53.170 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-05-30T06:41:53.169+0000 7f57b7bb67c0 -1 osd.6 0 log_to_monitors true 2024-05-30T06:41:53.175 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-05-30T06:41:53.177+0000 7f06f4e597c0 -1 osd.7 0 log_to_monitors true 2024-05-30T06:41:56.545 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-30T06:41:56.782 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.779+0000 7f68c8600640 1 Processor -- start 2024-05-30T06:41:56.782 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.779+0000 7f68c8600640 1 -- start start 2024-05-30T06:41:56.786 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68c8600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c00cfb20 0x7f68c015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:56.786 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68c8600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c01604a0 con 0x7f68c0146030 2024-05-30T06:41:56.786 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68c8600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c0160780 con 0x7f68c015d500 2024-05-30T06:41:56.786 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68c8600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68c015dd80 con 0x7f68c00cfb20 2024-05-30T06:41:56.787 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68c5c00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f68c0146030 0x7f68c00cf410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51412/0 (socket says 172.21.15.37:51412) 2024-05-30T06:41:56.787 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68c5c00640 1 -- 172.21.15.37:0/1103226241 learned_addr learned my addr 172.21.15.37:0/1103226241 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:41:56.787 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68c5200640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c00cfb20 0x7f68c015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:56.787 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2641443925 0 0) 0x7f68c01604a0 con 0x7f68c0146030 2024-05-30T06:41:56.787 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68a8003530 con 0x7f68c0146030 2024-05-30T06:41:56.788 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709358133 0 0) 0x7f68c0160780 con 0x7f68c015d500 2024-05-30T06:41:56.789 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68c01604a0 con 0x7f68c015d500 2024-05-30T06:41:56.789 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 875335550 0 0) 0x7f68c01604a0 con 0x7f68c015d500 2024-05-30T06:41:56.789 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c00cfb20 msgr2=0x7f68c015cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:56.789 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c00cfb20 0x7f68c015cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:56.789 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 >> v1:172.21.15.37:6789/0 conn(0x7f68c0146030 legacy=0x7f68c00cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:56.789 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c00cf220 con 0x7f68c015d500 2024-05-30T06:41:56.789 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f68b8001a00 con 0x7f68c015d500 2024-05-30T06:41:56.789 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68c5200640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c00cfb20 0x7f68c015cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:41:56.789 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 >> v1:172.21.15.105:6789/0 conn(0x7f68c015d500 legacy=0x7f68c006e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:56.789 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a8003b80 0x7f68a8003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:56.789 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a8004810 0x7f68a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:56.789 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c00cfb20 0x7f68a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:56.790 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68c015dd80 con 0x7f68a8003b80 2024-05-30T06:41:56.790 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68a800ba80 con 0x7f68a8004810 2024-05-30T06:41:56.790 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68a800bc80 con 0x7f68c00cfb20 2024-05-30T06:41:56.790 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.783+0000 7f68c5c00640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a8003b80 0x7f68a8003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:56.790 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.787+0000 7f68c5200640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a8004810 0x7f68a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:56.790 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.787+0000 7f68c6600640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c00cfb20 0x7f68a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:56.790 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.787+0000 7f68c5c00640 1 -- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c00cfb20 msgr2=0x7f68a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:56.790 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.787+0000 7f68c5c00640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c00cfb20 0x7f68a80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:56.790 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.787+0000 7f68c5c00640 1 -- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a8004810 msgr2=0x7f68a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:41:56.791 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.787+0000 7f68c5c00640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a8004810 0x7f68a8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:56.791 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.787+0000 7f68c5c00640 1 -- 172.21.15.37:0/1103226241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c01604a0 con 0x7f68a8003b80 2024-05-30T06:41:56.791 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.787+0000 7f68c6600640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68c00cfb20 0x7f68a80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:41:56.791 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.787+0000 7f68c5200640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a8004810 0x7f68a8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:41:56.793 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.791+0000 7f68c5c00640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a8003b80 0x7f68a8003f60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f68b400c190 tx=0x7f68b401cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31638c3bb789b1a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:56.794 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.791+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4007c30 con 0x7f68a8003b80 2024-05-30T06:41:56.794 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.791+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b40a9020 con 0x7f68a8003b80 2024-05-30T06:41:56.794 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.791+0000 7f68bfe00640 1 -- 172.21.15.37:0/1103226241 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4004ad0 con 0x7f68a8003b80 2024-05-30T06:41:56.795 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.791+0000 7f68c8600640 1 -- 172.21.15.37:0/1103226241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a8003b80 msgr2=0x7f68a8003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:56.795 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.791+0000 7f68c8600640 1 --2- 172.21.15.37:0/1103226241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a8003b80 0x7f68a8003f60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f68b400c190 tx=0x7f68b401cb70 comp rx=0 tx=0).stop 2024-05-30T06:41:56.795 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.791+0000 7f68c6600640 1 -- 172.21.15.37:0/1103226241 reap_dead start 2024-05-30T06:41:56.796 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.791+0000 7f68c8600640 1 -- 172.21.15.37:0/1103226241 shutdown_connections 2024-05-30T06:41:56.796 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.791+0000 7f68c8600640 1 -- 172.21.15.37:0/1103226241 >> 172.21.15.37:0/1103226241 conn(0x7f68c00703c0 msgr2=0x7f68c006b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:56.796 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.791+0000 7f68c8600640 1 -- 172.21.15.37:0/1103226241 shutdown_connections 2024-05-30T06:41:56.796 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.791+0000 7f68c8600640 1 -- 172.21.15.37:0/1103226241 wait complete. 2024-05-30T06:41:56.798 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.795+0000 7f68c8600640 1 Processor -- start 2024-05-30T06:41:56.798 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.795+0000 7f68c8600640 1 -- start start 2024-05-30T06:41:56.800 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.795+0000 7f68c8600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a8003b80 0x7f68c0143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:56.801 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.795+0000 7f68c8600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c0168ae0 0x7f68c0168f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:56.801 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.795+0000 7f68c8600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68c016a8f0 0x7f68c016ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:56.801 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.795+0000 7f68c5c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a8003b80 0x7f68c0143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:56.801 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.795+0000 7f68c8600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0146590 con 0x7f68c016a8f0 2024-05-30T06:41:56.801 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.795+0000 7f68c8600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0146410 con 0x7f68c0168ae0 2024-05-30T06:41:56.801 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.795+0000 7f68c8600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68c015d930 con 0x7f68a8003b80 2024-05-30T06:41:56.801 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68c5200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c0168ae0 0x7f68c0168f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:56.801 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68c5200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c0168ae0 0x7f68c0168f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:44714/0 (socket says 172.21.15.37:44714) 2024-05-30T06:41:56.802 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68c5200640 1 -- 172.21.15.37:0/2137998482 learned_addr learned my addr 172.21.15.37:0/2137998482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:41:56.802 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68c6600640 1 --2- 172.21.15.37:0/2137998482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68c016a8f0 0x7f68c016ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:56.802 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68c5200640 1 -- 172.21.15.37:0/2137998482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a8003b80 msgr2=0x7f68c0143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:56.802 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68c5200640 1 --2- 172.21.15.37:0/2137998482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a8003b80 0x7f68c0143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:56.802 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68c5200640 1 -- 172.21.15.37:0/2137998482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68c016a8f0 msgr2=0x7f68c016ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:56.802 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68c5200640 1 --2- 172.21.15.37:0/2137998482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68c016a8f0 0x7f68c016ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:56.803 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68c5200640 1 -- 172.21.15.37:0/2137998482 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c0166a70 con 0x7f68c0168ae0 2024-05-30T06:41:56.803 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68c5200640 1 --2- 172.21.15.37:0/2137998482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c0168ae0 0x7f68c0168f60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0108c0 tx=0x7f68ac010d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:56.804 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68bd600640 1 -- 172.21.15.37:0/2137998482 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac01a020 con 0x7f68c0168ae0 2024-05-30T06:41:56.804 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68bd600640 1 -- 172.21.15.37:0/2137998482 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ac00eb60 con 0x7f68c0168ae0 2024-05-30T06:41:56.804 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68bd600640 1 -- 172.21.15.37:0/2137998482 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac00f040 con 0x7f68c0168ae0 2024-05-30T06:41:56.804 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68c8600640 1 -- 172.21.15.37:0/2137998482 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c0166d50 con 0x7f68c0168ae0 2024-05-30T06:41:56.804 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.799+0000 7f68c8600640 1 -- 172.21.15.37:0/2137998482 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c016b2b0 con 0x7f68c0168ae0 2024-05-30T06:41:56.805 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.803+0000 7f68c8600640 1 -- 172.21.15.37:0/2137998482 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c00693e0 con 0x7f68c0168ae0 2024-05-30T06:41:56.809 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.807+0000 7f68bd600640 1 -- 172.21.15.37:0/2137998482 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f68ac01d020 con 0x7f68c0168ae0 2024-05-30T06:41:56.811 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.807+0000 7f68bd600640 1 --2- 172.21.15.37:0/2137998482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68a0068320 0x7f68a006a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:41:56.811 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.807+0000 7f68bd600640 1 -- 172.21.15.37:0/2137998482 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f68ac0868f0 con 0x7f68c0168ae0 2024-05-30T06:41:56.811 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.807+0000 7f68c5c00640 1 --2- 172.21.15.37:0/2137998482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68a0068320 0x7f68a006a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:41:56.815 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.811+0000 7f68c5c00640 1 --2- 172.21.15.37:0/2137998482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68a0068320 0x7f68a006a7e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f68b400c160 tx=0x7f68b40a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:41:56.818 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:56.815+0000 7f68bd600640 1 -- 172.21.15.37:0/2137998482 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f68ac0576b0 con 0x7f68c0168ae0 2024-05-30T06:41:56.947 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-05-30T06:41:56.943+0000 7f3de8e00640 -1 osd.3 0 waiting for initial osdmap 2024-05-30T06:41:56.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-05-30T06:41:56.967+0000 7f8062e00640 -1 osd.1 0 waiting for initial osdmap 2024-05-30T06:41:56.982 INFO:tasks.ceph.osd.3.smithi037.stderr:2024-05-30T06:41:56.979+0000 7f3ddee00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T06:41:56.989 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-05-30T06:41:56.988+0000 7f06f0800640 -1 osd.7 0 waiting for initial osdmap 2024-05-30T06:41:57.000 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-05-30T06:41:57.000+0000 7faecfe00640 -1 osd.5 0 waiting for initial osdmap 2024-05-30T06:41:57.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2024-05-30T06:41:57.003+0000 7f8058e00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T06:41:57.010 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-05-30T06:41:57.008+0000 7f57b2a00640 -1 osd.6 0 waiting for initial osdmap 2024-05-30T06:41:57.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-05-30T06:41:57.011+0000 7efeb1c00640 -1 osd.2 0 waiting for initial osdmap 2024-05-30T06:41:57.024 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-05-30T06:41:57.024+0000 7f06e5e00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T06:41:57.036 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-05-30T06:41:57.036+0000 7f2ca2c00640 -1 osd.4 0 waiting for initial osdmap 2024-05-30T06:41:57.040 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-05-30T06:41:57.040+0000 7f57a8a00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T06:41:57.044 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-05-30T06:41:57.044+0000 7faec5e00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T06:41:57.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2024-05-30T06:41:57.043+0000 7efea7c00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T06:41:57.052 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-05-30T06:41:57.047+0000 7f7522400640 -1 osd.0 0 waiting for initial osdmap 2024-05-30T06:41:57.064 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-05-30T06:41:57.064+0000 7f2c98200640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T06:41:57.078 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-05-30T06:41:57.075+0000 7f7518400640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-30T06:41:57.081 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68c8600640 1 -- 172.21.15.37:0/2137998482 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68c006c340 con 0x7f68c0168ae0 2024-05-30T06:41:57.082 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68bd600640 1 -- 172.21.15.37:0/2137998482 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f68ac05b9b0 con 0x7f68c0168ae0 2024-05-30T06:41:57.082 INFO:teuthology.misc.health.smithi037.stdout: 2024-05-30T06:41:57.083 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":12,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:41:54.680125+0000","last_up_change":"0.000000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:41:57.084 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68c8600640 1 -- 172.21.15.37:0/2137998482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68a0068320 msgr2=0x7f68a006a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:57.084 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68c8600640 1 --2- 172.21.15.37:0/2137998482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68a0068320 0x7f68a006a7e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f68b400c160 tx=0x7f68b40a7070 comp rx=0 tx=0).stop 2024-05-30T06:41:57.085 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68c8600640 1 -- 172.21.15.37:0/2137998482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c0168ae0 msgr2=0x7f68c0168f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:41:57.085 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68c8600640 1 --2- 172.21.15.37:0/2137998482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c0168ae0 0x7f68c0168f60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0108c0 tx=0x7f68ac010d80 comp rx=0 tx=0).stop 2024-05-30T06:41:57.085 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68c8600640 1 -- 172.21.15.37:0/2137998482 shutdown_connections 2024-05-30T06:41:57.085 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68c8600640 1 --2- 172.21.15.37:0/2137998482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68c016a8f0 0x7f68c016ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:57.085 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68c8600640 1 --2- 172.21.15.37:0/2137998482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68a0068320 0x7f68a006a7e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:57.085 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68c8600640 1 --2- 172.21.15.37:0/2137998482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68c0168ae0 0x7f68c0168f60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:57.085 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68c8600640 1 --2- 172.21.15.37:0/2137998482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a8003b80 0x7f68c0143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:41:57.085 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68c8600640 1 -- 172.21.15.37:0/2137998482 >> 172.21.15.37:0/2137998482 conn(0x7f68c00703c0 msgr2=0x7f68c0144f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:41:57.085 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68c8600640 1 -- 172.21.15.37:0/2137998482 shutdown_connections 2024-05-30T06:41:57.085 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:41:57.079+0000 7f68c8600640 1 -- 172.21.15.37:0/2137998482 wait complete. 2024-05-30T06:41:57.101 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-30T06:42:03.665 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:42:03.669 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:42:03.909 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:04.051 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.051+0000 7fef03400640 1 Processor -- start 2024-05-30T06:42:04.051 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.051+0000 7fef03400640 1 -- start start 2024-05-30T06:42:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.051+0000 7fef03400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feefc0cd650 0x7feefc0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.051+0000 7fef03400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feefc06e5d0 0x7feefc06ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.051+0000 7fef03400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feefc0ce340 con 0x7feefc15f250 2024-05-30T06:42:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.051+0000 7fef03400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7feefc0ce620 con 0x7feefc06e5d0 2024-05-30T06:42:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.051+0000 7fef03400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feefc0ce900 con 0x7feefc0cd650 2024-05-30T06:42:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.055+0000 7fef01400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feefc06e5d0 0x7feefc06ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.055+0000 7fef01400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feefc06e5d0 0x7feefc06ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58576/0 (socket says 172.21.15.37:58576) 2024-05-30T06:42:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.055+0000 7fef01400640 1 -- 172.21.15.37:0/3176680106 learned_addr learned my addr 172.21.15.37:0/3176680106 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:04.054 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.055+0000 7feef3e00640 1 --2- 172.21.15.37:0/3176680106 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feefc0cd650 0x7feefc0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.054 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.055+0000 7fef01400640 1 -- 172.21.15.37:0/3176680106 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feefc0cd650 msgr2=0x7feefc0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:04.054 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.055+0000 7fef01400640 1 --2- 172.21.15.37:0/3176680106 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feefc0cd650 0x7feefc0cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.054 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.055+0000 7fef01400640 1 -- 172.21.15.37:0/3176680106 >> v1:172.21.15.105:6789/0 conn(0x7feefc15f250 legacy=0x7feefc15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.054 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.055+0000 7fef01400640 1 -- 172.21.15.37:0/3176680106 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc06e0b0 con 0x7feefc06e5d0 2024-05-30T06:42:04.056 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.055+0000 7fef01400640 1 --2- 172.21.15.37:0/3176680106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feefc06e5d0 0x7feefc06ea60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7feef4009e50 tx=0x7feef401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d46f41b05765e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:04.056 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.055+0000 7feefbe00640 1 -- 172.21.15.37:0/3176680106 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef40a56f0 con 0x7feefc06e5d0 2024-05-30T06:42:04.057 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.055+0000 7feefbe00640 1 -- 172.21.15.37:0/3176680106 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef40a5890 con 0x7feefc06e5d0 2024-05-30T06:42:04.057 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.055+0000 7feefbe00640 1 -- 172.21.15.37:0/3176680106 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef40a5c60 con 0x7feefc06e5d0 2024-05-30T06:42:04.057 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 -- 172.21.15.37:0/3176680106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feefc06e5d0 msgr2=0x7feefc06ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.057 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 --2- 172.21.15.37:0/3176680106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feefc06e5d0 0x7feefc06ea60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7feef4009e50 tx=0x7feef401c910 comp rx=0 tx=0).stop 2024-05-30T06:42:04.057 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 -- 172.21.15.37:0/3176680106 shutdown_connections 2024-05-30T06:42:04.058 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 --2- 172.21.15.37:0/3176680106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feefc06e5d0 0x7feefc06ea60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.058 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 --2- 172.21.15.37:0/3176680106 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feefc0cd650 0x7feefc0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.058 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 -- 172.21.15.37:0/3176680106 >> 172.21.15.37:0/3176680106 conn(0x7feefc067f60 msgr2=0x7feefc06b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:04.058 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 -- 172.21.15.37:0/3176680106 shutdown_connections 2024-05-30T06:42:04.058 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 -- 172.21.15.37:0/3176680106 wait complete. 2024-05-30T06:42:04.059 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 Processor -- start 2024-05-30T06:42:04.059 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 -- start start 2024-05-30T06:42:04.062 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feefc06e5d0 0x7feefc13de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.062 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feefc0cd650 0x7feefc15e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.062 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feefc15f250 0x7feefc15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.062 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feefc168980 con 0x7feefc06e5d0 2024-05-30T06:42:04.062 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feefc168800 con 0x7feefc0cd650 2024-05-30T06:42:04.062 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef03400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feefc168b00 con 0x7feefc15f250 2024-05-30T06:42:04.062 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef00a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feefc06e5d0 0x7feefc13de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.062 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef00a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feefc06e5d0 0x7feefc13de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58578/0 (socket says 172.21.15.37:58578) 2024-05-30T06:42:04.062 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef00a00640 1 -- 172.21.15.37:0/1326103738 learned_addr learned my addr 172.21.15.37:0/1326103738 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:04.063 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7feef3e00640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feefc0cd650 0x7feefc15e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.063 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef01400640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feefc15f250 0x7feefc15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.063 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef00a00640 1 -- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feefc15f250 msgr2=0x7feefc15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.063 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef00a00640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feefc15f250 0x7feefc15ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.063 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef00a00640 1 -- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feefc0cd650 msgr2=0x7feefc15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.063 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef00a00640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feefc0cd650 0x7feefc15e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.063 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.059+0000 7fef00a00640 1 -- 172.21.15.37:0/1326103738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc15d8c0 con 0x7feefc06e5d0 2024-05-30T06:42:04.063 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.063+0000 7fef00a00640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feefc06e5d0 0x7feefc13de80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feeec00c420 tx=0x7feeec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:04.063 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.063+0000 7feef9600640 1 -- 172.21.15.37:0/1326103738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec0052d0 con 0x7feefc06e5d0 2024-05-30T06:42:04.063 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.063+0000 7feef9600640 1 -- 172.21.15.37:0/1326103738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec005470 con 0x7feefc06e5d0 2024-05-30T06:42:04.063 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.063+0000 7feef9600640 1 -- 172.21.15.37:0/1326103738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec007260 con 0x7feefc06e5d0 2024-05-30T06:42:04.063 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.063+0000 7fef03400640 1 -- 172.21.15.37:0/1326103738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feefc15dba0 con 0x7feefc06e5d0 2024-05-30T06:42:04.063 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.063+0000 7fef03400640 1 -- 172.21.15.37:0/1326103738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feefc15e4d0 con 0x7feefc06e5d0 2024-05-30T06:42:04.064 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.063+0000 7fef03400640 1 -- 172.21.15.37:0/1326103738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feefc15e6d0 con 0x7feefc06e5d0 2024-05-30T06:42:04.064 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.063+0000 7feef9600640 1 -- 172.21.15.37:0/1326103738 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feeec007400 con 0x7feefc06e5d0 2024-05-30T06:42:04.064 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.063+0000 7feef9600640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feed8068380 0x7feed806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.065 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.063+0000 7feef9600640 1 -- 172.21.15.37:0/1326103738 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7feeec085a90 con 0x7feefc06e5d0 2024-05-30T06:42:04.065 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.067+0000 7feef3e00640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feed8068380 0x7feed806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.065 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.067+0000 7feef3e00640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feed8068380 0x7feed806a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feefc15df30 tx=0x7feee4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:04.069 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.071+0000 7feef9600640 1 -- 172.21.15.37:0/1326103738 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feefc15e6d0 con 0x7feefc06e5d0 2024-05-30T06:42:04.235 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.235+0000 7fef03400640 1 -- 172.21.15.37:0/1326103738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feefc0693e0 con 0x7feefc06e5d0 2024-05-30T06:42:04.236 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.235+0000 7feef9600640 1 -- 172.21.15.37:0/1326103738 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7feeec055d40 con 0x7feefc06e5d0 2024-05-30T06:42:04.236 INFO:teuthology.misc.health.smithi037.stdout: 2024-05-30T06:42:04.237 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":16,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:00.997166+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:04.239 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.239+0000 7fef03400640 1 -- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feed8068380 msgr2=0x7feed806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.239 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.239+0000 7fef03400640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feed8068380 0x7feed806a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feefc15df30 tx=0x7feee4009190 comp rx=0 tx=0).stop 2024-05-30T06:42:04.239 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.239+0000 7fef03400640 1 -- 172.21.15.37:0/1326103738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feefc06e5d0 msgr2=0x7feefc13de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.239 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.239+0000 7fef03400640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feefc06e5d0 0x7feefc13de80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feeec00c420 tx=0x7feeec00c8e0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.239 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.239+0000 7fef03400640 1 -- 172.21.15.37:0/1326103738 shutdown_connections 2024-05-30T06:42:04.239 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.239+0000 7fef03400640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feefc15f250 0x7feefc15ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.239 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.239+0000 7fef03400640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feed8068380 0x7feed806a840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.239 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.239+0000 7fef03400640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feefc0cd650 0x7feefc15e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.239 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.239+0000 7fef03400640 1 --2- 172.21.15.37:0/1326103738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feefc06e5d0 0x7feefc13de80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.239 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.239+0000 7fef03400640 1 -- 172.21.15.37:0/1326103738 >> 172.21.15.37:0/1326103738 conn(0x7feefc067f60 msgr2=0x7feefc0cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:04.239 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.239+0000 7fef03400640 1 -- 172.21.15.37:0/1326103738 shutdown_connections 2024-05-30T06:42:04.240 INFO:teuthology.misc.health.smithi037.stderr:2024-05-30T06:42:04.239+0000 7fef03400640 1 -- 172.21.15.37:0/1326103738 wait complete. 2024-05-30T06:42:04.256 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-30T06:42:04.256 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-30T06:42:04.256 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T06:42:04.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T06:42:04.259 INFO:tasks.ceph.mds.a:Started 2024-05-30T06:42:04.260 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T06:42:04.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T06:42:04.263 INFO:tasks.ceph.mds.c:Started 2024-05-30T06:42:04.263 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T06:42:04.263 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T06:42:04.266 INFO:tasks.ceph.mds.b:Started 2024-05-30T06:42:04.266 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T06:42:04.267 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T06:42:04.270 INFO:tasks.ceph.mds.d:Started 2024-05-30T06:42:04.270 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-30T06:42:04.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:04.354 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-30T06:42:04.357 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-30T06:42:04.376 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-05-30T06:42:04.376 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-05-30T06:42:04.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.419+0000 7f64a5c00640 1 Processor -- start 2024-05-30T06:42:04.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.419+0000 7f64a5c00640 1 -- start start 2024-05-30T06:42:04.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.419+0000 7f64a5c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f64a009b9a0 0x7f64a01625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.419+0000 7f64a5c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a0162f00 con 0x7f64a0162ae0 2024-05-30T06:42:04.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.419+0000 7f64a5c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a009abe0 con 0x7f64a015e930 2024-05-30T06:42:04.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.419+0000 7f64a5c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f64a009aec0 con 0x7f64a009b9a0 2024-05-30T06:42:04.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.419+0000 7f649f400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f64a0162ae0 0x7f64a00ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50128/0 (socket says 172.21.15.37:50128) 2024-05-30T06:42:04.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.419+0000 7f649f400640 1 -- 172.21.15.37:0/3289601813 learned_addr learned my addr 172.21.15.37:0/3289601813 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:04.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f6496000640 1 --2- 172.21.15.37:0/3289601813 >> v2:172.21.15.105:3300/0 conn(0x7f64a009b9a0 0x7f64a01625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097297068 0 0) 0x7f64a0162f00 con 0x7f64a0162ae0 2024-05-30T06:42:04.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6484003530 con 0x7f64a0162ae0 2024-05-30T06:42:04.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1347693919 0 0) 0x7f64a009abe0 con 0x7f64a015e930 2024-05-30T06:42:04.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64a0162f00 con 0x7f64a015e930 2024-05-30T06:42:04.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1591433574 0 0) 0x7f6484003530 con 0x7f64a0162ae0 2024-05-30T06:42:04.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 >> v2:172.21.15.105:3300/0 conn(0x7f64a009b9a0 msgr2=0x7f64a01625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:04.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 --2- 172.21.15.37:0/3289601813 >> v2:172.21.15.105:3300/0 conn(0x7f64a009b9a0 0x7f64a01625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 >> v1:172.21.15.105:6789/0 conn(0x7f64a015e930 legacy=0x7f64a00d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a009b1a0 con 0x7f64a0162ae0 2024-05-30T06:42:04.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f6498001a00 con 0x7f64a0162ae0 2024-05-30T06:42:04.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f6496000640 1 --2- 172.21.15.37:0/3289601813 >> v2:172.21.15.105:3300/0 conn(0x7f64a009b9a0 0x7f64a01625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:04.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 >> v1:172.21.15.37:6789/0 conn(0x7f64a0162ae0 legacy=0x7f64a00ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 --2- 172.21.15.37:0/3289601813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6484003b50 0x7f6484003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 --2- 172.21.15.37:0/3289601813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6484004810 0x7f6484004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 --2- 172.21.15.37:0/3289601813 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64840051d0 0x7f648400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f64a009aec0 con 0x7f6484003b50 2024-05-30T06:42:04.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f648400c050 con 0x7f6484004810 2024-05-30T06:42:04.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f648400c250 con 0x7f64840051d0 2024-05-30T06:42:04.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649ea00640 1 --2- 172.21.15.37:0/3289601813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6484003b50 0x7f6484003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649f400640 1 --2- 172.21.15.37:0/3289601813 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64840051d0 0x7f648400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f6496000640 1 --2- 172.21.15.37:0/3289601813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6484004810 0x7f6484004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649ea00640 1 -- 172.21.15.37:0/3289601813 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64840051d0 msgr2=0x7f648400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:04.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649ea00640 1 --2- 172.21.15.37:0/3289601813 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64840051d0 0x7f648400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649ea00640 1 -- 172.21.15.37:0/3289601813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6484004810 msgr2=0x7f6484004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:04.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649ea00640 1 --2- 172.21.15.37:0/3289601813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6484004810 0x7f6484004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649ea00640 1 -- 172.21.15.37:0/3289601813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6484003530 con 0x7f6484003b50 2024-05-30T06:42:04.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f6496000640 1 --2- 172.21.15.37:0/3289601813 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6484004810 0x7f6484004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:04.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.423+0000 7f649f400640 1 -- 172.21.15.37:0/3289601813 reap_dead start 2024-05-30T06:42:04.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f649ea00640 1 --2- 172.21.15.37:0/3289601813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6484003b50 0x7f6484003f50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f64900018d0 tx=0x7f649001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0c0d7806631ac4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:04.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490001520 con 0x7f6484003b50 2024-05-30T06:42:04.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64900052f0 con 0x7f6484003b50 2024-05-30T06:42:04.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f649e000640 1 -- 172.21.15.37:0/3289601813 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490003840 con 0x7f6484003b50 2024-05-30T06:42:04.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 -- 172.21.15.37:0/3289601813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6484003b50 msgr2=0x7f6484003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 --2- 172.21.15.37:0/3289601813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6484003b50 0x7f6484003f50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f64900018d0 tx=0x7f649001c520 comp rx=0 tx=0).stop 2024-05-30T06:42:04.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 -- 172.21.15.37:0/3289601813 shutdown_connections 2024-05-30T06:42:04.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 --2- 172.21.15.37:0/3289601813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6484003b50 0x7f6484003f50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 -- 172.21.15.37:0/3289601813 >> 172.21.15.37:0/3289601813 conn(0x7f64a00b4100 msgr2=0x7f64a00b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:04.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 -- 172.21.15.37:0/3289601813 shutdown_connections 2024-05-30T06:42:04.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 -- 172.21.15.37:0/3289601813 wait complete. 2024-05-30T06:42:04.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 Processor -- start 2024-05-30T06:42:04.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 -- start start 2024-05-30T06:42:04.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6484003b50 0x7f64a00c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64a00b7f10 0x7f64a0153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64a00c6f30 0x7f64a00ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f64a015ee90 con 0x7f6484003b50 2024-05-30T06:42:04.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f64a015ed10 con 0x7f64a00b7f10 2024-05-30T06:42:04.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.427+0000 7f64a5c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f64a00ccc60 con 0x7f64a00c6f30 2024-05-30T06:42:04.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f649ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6484003b50 0x7f64a00c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f649ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6484003b50 0x7f64a00c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58610/0 (socket says 172.21.15.37:58610) 2024-05-30T06:42:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f649ea00640 1 -- 172.21.15.37:0/583253365 learned_addr learned my addr 172.21.15.37:0/583253365 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f649f400640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64a00c6f30 0x7f64a00ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f6496000640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64a00b7f10 0x7f64a0153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f649ea00640 1 -- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64a00c6f30 msgr2=0x7f64a00ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f649ea00640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64a00c6f30 0x7f64a00ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f649ea00640 1 -- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64a00b7f10 msgr2=0x7f64a0153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f649ea00640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64a00b7f10 0x7f64a0153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f649ea00640 1 -- 172.21.15.37:0/583253365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a00c7780 con 0x7f6484003b50 2024-05-30T06:42:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f649f400640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64a00c6f30 0x7f64a00ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f649ea00640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6484003b50 0x7f64a00c8820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f649001c350 tx=0x7f6484005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f6497400640 1 -- 172.21.15.37:0/583253365 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900054a0 con 0x7f6484003b50 2024-05-30T06:42:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f6497400640 1 -- 172.21.15.37:0/583253365 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6490001500 con 0x7f6484003b50 2024-05-30T06:42:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f64a5c00640 1 -- 172.21.15.37:0/583253365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a00c7a60 con 0x7f6484003b50 2024-05-30T06:42:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f6497400640 1 -- 172.21.15.37:0/583253365 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900067e0 con 0x7f6484003b50 2024-05-30T06:42:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f64a5c00640 1 -- 172.21.15.37:0/583253365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a00c8020 con 0x7f6484003b50 2024-05-30T06:42:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f64a5c00640 1 -- 172.21.15.37:0/583253365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a0068b20 con 0x7f6484003b50 2024-05-30T06:42:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f6497400640 1 -- 172.21.15.37:0/583253365 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6490006980 con 0x7f6484003b50 2024-05-30T06:42:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.431+0000 7f6497400640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f647c0683b0 0x7f647c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.435+0000 7f6497400640 1 -- 172.21.15.37:0/583253365 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6490120a10 con 0x7f6484003b50 2024-05-30T06:42:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.435+0000 7f6496000640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f647c0683b0 0x7f647c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.435+0000 7f6496000640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f647c0683b0 0x7f647c06a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f64a015d710 tx=0x7f6488008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.439+0000 7f6497400640 1 -- 172.21.15.37:0/583253365 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f64900bb020 con 0x7f6484003b50 2024-05-30T06:42:04.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.607+0000 7f64a5c00640 1 -- 172.21.15.37:0/583253365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f64a006e350 con 0x7f6484003b50 2024-05-30T06:42:04.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.607+0000 7f6497400640 1 -- 172.21.15.37:0/583253365 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7f6490016230 con 0x7f6484003b50 2024-05-30T06:42:04.608 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:04.608 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:00.997166+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.611+0000 7f64a5c00640 1 -- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f647c0683b0 msgr2=0x7f647c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.611+0000 7f64a5c00640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f647c0683b0 0x7f647c06a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f64a015d710 tx=0x7f6488008040 comp rx=0 tx=0).stop 2024-05-30T06:42:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.611+0000 7f64a5c00640 1 -- 172.21.15.37:0/583253365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6484003b50 msgr2=0x7f64a00c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.611+0000 7f64a5c00640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6484003b50 0x7f64a00c8820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f649001c350 tx=0x7f6484005840 comp rx=0 tx=0).stop 2024-05-30T06:42:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.611+0000 7f64a5c00640 1 -- 172.21.15.37:0/583253365 shutdown_connections 2024-05-30T06:42:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.611+0000 7f64a5c00640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64a00c6f30 0x7f64a00ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.611+0000 7f64a5c00640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f647c0683b0 0x7f647c06a870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.611+0000 7f64a5c00640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64a00b7f10 0x7f64a0153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.611+0000 7f64a5c00640 1 --2- 172.21.15.37:0/583253365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6484003b50 0x7f64a00c8820 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.611+0000 7f64a5c00640 1 -- 172.21.15.37:0/583253365 >> 172.21.15.37:0/583253365 conn(0x7f64a00b4100 msgr2=0x7f64a00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:04.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.611+0000 7f64a5c00640 1 -- 172.21.15.37:0/583253365 shutdown_connections 2024-05-30T06:42:04.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.611+0000 7f64a5c00640 1 -- 172.21.15.37:0/583253365 wait complete. 2024-05-30T06:42:04.629 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:04.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:04.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.775+0000 7f1000000640 1 Processor -- start 2024-05-30T06:42:04.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.775+0000 7f1000000640 1 -- start start 2024-05-30T06:42:04.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.775+0000 7f1000000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ff8155da0 0x7f0ff80cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.775+0000 7f1000000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff815f310 con 0x7f0ff806f770 2024-05-30T06:42:04.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.775+0000 7f1000000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff815f5f0 con 0x7f0ff80cd440 2024-05-30T06:42:04.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.775+0000 7f1000000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff815f8d0 con 0x7f0ff8155da0 2024-05-30T06:42:04.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.775+0000 7f0ffd600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ff8155da0 0x7f0ff80cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.775+0000 7f0ffe000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0ff806f770 0x7f0ff80b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50140/0 (socket says 172.21.15.37:50140) 2024-05-30T06:42:04.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.775+0000 7f0ffe000640 1 -- 172.21.15.37:0/298218643 learned_addr learned my addr 172.21.15.37:0/298218643 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:04.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.775+0000 7f0ffd600640 1 -- 172.21.15.37:0/298218643 >> v1:172.21.15.105:6789/0 conn(0x7f0ff80cd440 legacy=0x7f0ff806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.775+0000 7f0ffd600640 1 -- 172.21.15.37:0/298218643 >> v1:172.21.15.37:6789/0 conn(0x7f0ff806f770 legacy=0x7f0ff80b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.775+0000 7f0ffd600640 1 -- 172.21.15.37:0/298218643 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff815fbb0 con 0x7f0ff8155da0 2024-05-30T06:42:04.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.775+0000 7f0ff7e00640 1 -- 172.21.15.37:0/298218643 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2447193571 0 0) 0x7f0ff815f5f0 con 0x7f0ff80cd440 2024-05-30T06:42:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.779+0000 7f0ffd600640 1 --2- 172.21.15.37:0/298218643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff8155da0 0x7f0ff80cd950 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0097c0 tx=0x7f0fec01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c086b98017e174f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.779+0000 7f0ff7e00640 1 -- 172.21.15.37:0/298218643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0aa660 con 0x7f0ff8155da0 2024-05-30T06:42:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.779+0000 7f0ff7e00640 1 -- 172.21.15.37:0/298218643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fec0af070 con 0x7f0ff8155da0 2024-05-30T06:42:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.779+0000 7f0ff7e00640 1 -- 172.21.15.37:0/298218643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0aaa20 con 0x7f0ff8155da0 2024-05-30T06:42:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.779+0000 7f1000000640 1 -- 172.21.15.37:0/298218643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff8155da0 msgr2=0x7f0ff80cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.779+0000 7f1000000640 1 --2- 172.21.15.37:0/298218643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff8155da0 0x7f0ff80cd950 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0097c0 tx=0x7f0fec01bf80 comp rx=0 tx=0).stop 2024-05-30T06:42:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.779+0000 7f1000000640 1 -- 172.21.15.37:0/298218643 shutdown_connections 2024-05-30T06:42:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.779+0000 7f1000000640 1 --2- 172.21.15.37:0/298218643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff8155da0 0x7f0ff80cd950 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.779+0000 7f1000000640 1 -- 172.21.15.37:0/298218643 >> 172.21.15.37:0/298218643 conn(0x7f0ff806bf60 msgr2=0x7f0ff80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.779+0000 7f1000000640 1 -- 172.21.15.37:0/298218643 shutdown_connections 2024-05-30T06:42:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.779+0000 7f1000000640 1 -- 172.21.15.37:0/298218643 wait complete. 2024-05-30T06:42:04.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f1000000640 1 Processor -- start 2024-05-30T06:42:04.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f1000000640 1 -- start start 2024-05-30T06:42:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f1000000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff806f770 0x7f0ff81f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f1000000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ff8155da0 0x7f0ff815e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f1000000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff81504a0 0x7f0ff806e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f1000000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff816a950 con 0x7f0ff81504a0 2024-05-30T06:42:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f1000000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff816a7d0 con 0x7f0ff806f770 2024-05-30T06:42:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f1000000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff816aad0 con 0x7f0ff8155da0 2024-05-30T06:42:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ffe000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff81504a0 0x7f0ff806e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ffe000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff81504a0 0x7f0ff806e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58642/0 (socket says 172.21.15.37:58642) 2024-05-30T06:42:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ffe000640 1 -- 172.21.15.37:0/585248082 learned_addr learned my addr 172.21.15.37:0/585248082 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ffd600640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff806f770 0x7f0ff81f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ffcc00640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ff8155da0 0x7f0ff815e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ffe000640 1 -- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ff8155da0 msgr2=0x7f0ff815e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ffe000640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ff8155da0 0x7f0ff815e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ffe000640 1 -- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff806f770 msgr2=0x7f0ff81f8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ffe000640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff806f770 0x7f0ff81f8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ffe000640 1 -- 172.21.15.37:0/585248082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff815da10 con 0x7f0ff81504a0 2024-05-30T06:42:04.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ffe000640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff81504a0 0x7f0ff806e8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000caf0 tx=0x7f0ff00020b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ff5600640 1 -- 172.21.15.37:0/585248082 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0018070 con 0x7f0ff81504a0 2024-05-30T06:42:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ff5600640 1 -- 172.21.15.37:0/585248082 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff000a700 con 0x7f0ff81504a0 2024-05-30T06:42:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f1000000640 1 -- 172.21.15.37:0/585248082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff8151ae0 con 0x7f0ff81504a0 2024-05-30T06:42:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f0ff5600640 1 -- 172.21.15.37:0/585248082 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff000aaf0 con 0x7f0ff81504a0 2024-05-30T06:42:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f1000000640 1 -- 172.21.15.37:0/585248082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff8150ed0 con 0x7f0ff81504a0 2024-05-30T06:42:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.783+0000 7f1000000640 1 -- 172.21.15.37:0/585248082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff8068bc0 con 0x7f0ff81504a0 2024-05-30T06:42:04.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.787+0000 7f0ff5600640 1 -- 172.21.15.37:0/585248082 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ff001b070 con 0x7f0ff81504a0 2024-05-30T06:42:04.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.787+0000 7f0ff5600640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0fd8068380 0x7f0fd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:04.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.787+0000 7f0ff5600640 1 -- 172.21.15.37:0/585248082 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f0ff0085d30 con 0x7f0ff81504a0 2024-05-30T06:42:04.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.787+0000 7f0ffd600640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0fd8068380 0x7f0fd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.787+0000 7f0ffd600640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0fd8068380 0x7f0fd806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0ae000 tx=0x7f0fec0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:04.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.791+0000 7f0ff5600640 1 -- 172.21.15.37:0/585248082 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0ff0055fe0 con 0x7f0ff81504a0 2024-05-30T06:42:04.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.955+0000 7f1000000640 1 -- 172.21.15.37:0/585248082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0ff80b6790 con 0x7f0ff81504a0 2024-05-30T06:42:04.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.955+0000 7f0ff5600640 1 -- 172.21.15.37:0/585248082 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f0ff005a2e0 con 0x7f0ff81504a0 2024-05-30T06:42:04.956 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.959+0000 7f1000000640 1 -- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0fd8068380 msgr2=0x7f0fd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.959+0000 7f1000000640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0fd8068380 0x7f0fd806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0ae000 tx=0x7f0fec0a6000 comp rx=0 tx=0).stop 2024-05-30T06:42:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.959+0000 7f1000000640 1 -- 172.21.15.37:0/585248082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff81504a0 msgr2=0x7f0ff806e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.959+0000 7f1000000640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff81504a0 0x7f0ff806e8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000caf0 tx=0x7f0ff00020b0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.959+0000 7f1000000640 1 -- 172.21.15.37:0/585248082 shutdown_connections 2024-05-30T06:42:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.959+0000 7f1000000640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff81504a0 0x7f0ff806e8f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.959+0000 7f1000000640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ff8155da0 0x7f0ff815e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.959+0000 7f1000000640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0fd8068380 0x7f0fd806a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.959+0000 7f1000000640 1 --2- 172.21.15.37:0/585248082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff806f770 0x7f0ff81f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.959+0000 7f1000000640 1 -- 172.21.15.37:0/585248082 >> 172.21.15.37:0/585248082 conn(0x7f0ff806bf60 msgr2=0x7f0ff8072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.959+0000 7f1000000640 1 -- 172.21.15.37:0/585248082 shutdown_connections 2024-05-30T06:42:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:04.959+0000 7f1000000640 1 -- 172.21.15.37:0/585248082 wait complete. 2024-05-30T06:42:04.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:42:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4712c00640 1 Processor -- start 2024-05-30T06:42:05.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4712c00640 1 -- start start 2024-05-30T06:42:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4712c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f470c09b9a0 0x7f470c1625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4712c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f470c162ae0 0x7f470c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4712c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f470c162f00 con 0x7f470c15e930 2024-05-30T06:42:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4712c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f470c09abe0 con 0x7f470c162ae0 2024-05-30T06:42:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4712c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f470c09aec0 con 0x7f470c09b9a0 2024-05-30T06:42:05.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4710c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f470c162ae0 0x7f470c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4710c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f470c162ae0 0x7f470c0ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58654/0 (socket says 172.21.15.37:58654) 2024-05-30T06:42:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4710c00640 1 -- 172.21.15.37:0/2342038067 learned_addr learned my addr 172.21.15.37:0/2342038067 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4703400640 1 --2- 172.21.15.37:0/2342038067 >> v2:172.21.15.105:3300/0 conn(0x7f470c09b9a0 0x7f470c1625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4710c00640 1 -- 172.21.15.37:0/2342038067 >> v2:172.21.15.105:3300/0 conn(0x7f470c09b9a0 msgr2=0x7f470c1625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4710c00640 1 --2- 172.21.15.37:0/2342038067 >> v2:172.21.15.105:3300/0 conn(0x7f470c09b9a0 0x7f470c1625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:05.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4710c00640 1 -- 172.21.15.37:0/2342038067 >> v1:172.21.15.105:6789/0 conn(0x7f470c15e930 legacy=0x7f470c0d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:05.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.119+0000 7f4710c00640 1 -- 172.21.15.37:0/2342038067 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470c09b1a0 con 0x7f470c162ae0 2024-05-30T06:42:05.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f4710c00640 1 --2- 172.21.15.37:0/2342038067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470c162ae0 0x7f470c0ccc60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f470c073320 tx=0x7f470401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e5944de3432fe6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:05.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f470b400640 1 -- 172.21.15.37:0/2342038067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47040a57a0 con 0x7f470c162ae0 2024-05-30T06:42:05.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f470b400640 1 -- 172.21.15.37:0/2342038067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47040a5940 con 0x7f470c162ae0 2024-05-30T06:42:05.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f470b400640 1 -- 172.21.15.37:0/2342038067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47040a5d10 con 0x7f470c162ae0 2024-05-30T06:42:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f4712c00640 1 -- 172.21.15.37:0/2342038067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470c162ae0 msgr2=0x7f470c0ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f4712c00640 1 --2- 172.21.15.37:0/2342038067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470c162ae0 0x7f470c0ccc60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f470c073320 tx=0x7f470401c9f0 comp rx=0 tx=0).stop 2024-05-30T06:42:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f4712c00640 1 -- 172.21.15.37:0/2342038067 shutdown_connections 2024-05-30T06:42:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f4712c00640 1 --2- 172.21.15.37:0/2342038067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470c162ae0 0x7f470c0ccc60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f4712c00640 1 --2- 172.21.15.37:0/2342038067 >> v2:172.21.15.105:3300/0 conn(0x7f470c09b9a0 0x7f470c1625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f4712c00640 1 -- 172.21.15.37:0/2342038067 >> 172.21.15.37:0/2342038067 conn(0x7f470c0b4100 msgr2=0x7f470c0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f4712c00640 1 -- 172.21.15.37:0/2342038067 shutdown_connections 2024-05-30T06:42:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f4712c00640 1 -- 172.21.15.37:0/2342038067 wait complete. 2024-05-30T06:42:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f4712c00640 1 Processor -- start 2024-05-30T06:42:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.123+0000 7f4712c00640 1 -- start start 2024-05-30T06:42:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4712c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470c09b9a0 0x7f470c151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4712c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f470c15e930 0x7f470c149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4712c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f470c162ae0 0x7f470c154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4712c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f470c06ddc0 con 0x7f470c09b9a0 2024-05-30T06:42:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4712c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f470c06dc40 con 0x7f470c162ae0 2024-05-30T06:42:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4712c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f470c15ed10 con 0x7f470c15e930 2024-05-30T06:42:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f470be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470c09b9a0 0x7f470c151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f470be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470c09b9a0 0x7f470c151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58660/0 (socket says 172.21.15.37:58660) 2024-05-30T06:42:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f470be00640 1 -- 172.21.15.37:0/301412705 learned_addr learned my addr 172.21.15.37:0/301412705 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4703400640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f470c15e930 0x7f470c149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4710c00640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f470c162ae0 0x7f470c154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f470be00640 1 -- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f470c15e930 msgr2=0x7f470c149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f470be00640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f470c15e930 0x7f470c149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f470be00640 1 -- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f470c162ae0 msgr2=0x7f470c154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f470be00640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f470c162ae0 0x7f470c154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f470be00640 1 -- 172.21.15.37:0/301412705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470c1521a0 con 0x7f470c09b9a0 2024-05-30T06:42:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f470be00640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470c09b9a0 0x7f470c151aa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c420 tx=0x7f46fc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:05.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4708c00640 1 -- 172.21.15.37:0/301412705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc0052d0 con 0x7f470c09b9a0 2024-05-30T06:42:05.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4708c00640 1 -- 172.21.15.37:0/301412705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46fc005470 con 0x7f470c09b9a0 2024-05-30T06:42:05.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4708c00640 1 -- 172.21.15.37:0/301412705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc007260 con 0x7f470c09b9a0 2024-05-30T06:42:05.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4712c00640 1 -- 172.21.15.37:0/301412705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470c0b21c0 con 0x7f470c09b9a0 2024-05-30T06:42:05.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4712c00640 1 -- 172.21.15.37:0/301412705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f470c14a0e0 con 0x7f470c09b9a0 2024-05-30T06:42:05.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4712c00640 1 -- 172.21.15.37:0/301412705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f470c068b20 con 0x7f470c09b9a0 2024-05-30T06:42:05.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.127+0000 7f4708c00640 1 -- 172.21.15.37:0/301412705 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f46fc007400 con 0x7f470c09b9a0 2024-05-30T06:42:05.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.131+0000 7f4708c00640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f46e8068380 0x7f46e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:05.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.131+0000 7f4708c00640 1 -- 172.21.15.37:0/301412705 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f46fc085ae0 con 0x7f470c09b9a0 2024-05-30T06:42:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.131+0000 7f4703400640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f46e8068380 0x7f46e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.131+0000 7f4703400640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f46e8068380 0x7f46e806a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f470c1fb1d0 tx=0x7f46f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.135+0000 7f4708c00640 1 -- 172.21.15.37:0/301412705 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f46fc055d80 con 0x7f470c09b9a0 2024-05-30T06:42:05.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.331+0000 7f4712c00640 1 -- 172.21.15.37:0/301412705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f470c06e350 con 0x7f470c09b9a0 2024-05-30T06:42:05.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.331+0000 7f4708c00640 1 -- 172.21.15.37:0/301412705 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f46fc05a080 con 0x7f470c09b9a0 2024-05-30T06:42:05.332 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:05.332 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4088854019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4088854019},{"type":"v1","addr":"172.21.15.37:6833","nonce":4088854019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-30T06:42:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 2 2024-05-30T06:42:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.335+0000 7f4712c00640 1 -- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f46e8068380 msgr2=0x7f46e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.335+0000 7f4712c00640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f46e8068380 0x7f46e806a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f470c1fb1d0 tx=0x7f46f4008040 comp rx=0 tx=0).stop 2024-05-30T06:42:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.335+0000 7f4712c00640 1 -- 172.21.15.37:0/301412705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470c09b9a0 msgr2=0x7f470c151aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.335+0000 7f4712c00640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470c09b9a0 0x7f470c151aa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c420 tx=0x7f46fc00c8e0 comp rx=0 tx=0).stop 2024-05-30T06:42:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.335+0000 7f4712c00640 1 -- 172.21.15.37:0/301412705 shutdown_connections 2024-05-30T06:42:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.335+0000 7f4712c00640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f46e8068380 0x7f46e806a840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.335+0000 7f4712c00640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f470c162ae0 0x7f470c154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.335+0000 7f4712c00640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f470c15e930 0x7f470c149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.335+0000 7f4712c00640 1 --2- 172.21.15.37:0/301412705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f470c09b9a0 0x7f470c151aa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.335+0000 7f4712c00640 1 -- 172.21.15.37:0/301412705 >> 172.21.15.37:0/301412705 conn(0x7f470c0b4100 msgr2=0x7f470c070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.335+0000 7f4712c00640 1 -- 172.21.15.37:0/301412705 shutdown_connections 2024-05-30T06:42:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:05.335+0000 7f4712c00640 1 -- 172.21.15.37:0/301412705 wait complete. 2024-05-30T06:42:07.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:42:07.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.503+0000 7f8039e00640 1 Processor -- start 2024-05-30T06:42:07.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f8039e00640 1 -- start start 2024-05-30T06:42:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f8039e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f803415ed50 0x7f80340c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f8039e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80340d02b0 0x7f80340d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f8039e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80340c7f20 con 0x7f80340d0c50 2024-05-30T06:42:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f8039e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f80340c9500 con 0x7f803415ed50 2024-05-30T06:42:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f8039e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f803415f130 con 0x7f80340d02b0 2024-05-30T06:42:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f8033400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f80340d0c50 0x7f80341627e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60644/0 (socket says 172.21.15.37:60644) 2024-05-30T06:42:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f8033400640 1 -- 172.21.15.37:0/4234214585 learned_addr learned my addr 172.21.15.37:0/4234214585 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f802a000640 1 --2- 172.21.15.37:0/4234214585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80340d02b0 0x7f80340d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f8032a00640 1 --2- 172.21.15.37:0/4234214585 >> v2:172.21.15.105:3300/0 conn(0x7f803415ed50 0x7f80340c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f8032000640 1 -- 172.21.15.37:0/4234214585 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042617169 0 0) 0x7f80340c7f20 con 0x7f80340d0c50 2024-05-30T06:42:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f8032000640 1 -- 172.21.15.37:0/4234214585 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8018003530 con 0x7f80340d0c50 2024-05-30T06:42:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f802a000640 1 -- 172.21.15.37:0/4234214585 >> v2:172.21.15.105:3300/0 conn(0x7f803415ed50 msgr2=0x7f80340c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f802a000640 1 --2- 172.21.15.37:0/4234214585 >> v2:172.21.15.105:3300/0 conn(0x7f803415ed50 0x7f80340c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f802a000640 1 -- 172.21.15.37:0/4234214585 >> v1:172.21.15.37:6789/0 conn(0x7f80340d0c50 legacy=0x7f80341627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.507+0000 7f802a000640 1 -- 172.21.15.37:0/4234214585 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80340c8200 con 0x7f80340d02b0 2024-05-30T06:42:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.511+0000 7f802a000640 1 --2- 172.21.15.37:0/4234214585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80340d02b0 0x7f80340d0710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f801c0097c0 tx=0x7f801c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dac6faf51018482 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.511+0000 7f8032000640 1 -- 172.21.15.37:0/4234214585 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c0a7070 con 0x7f80340d02b0 2024-05-30T06:42:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.511+0000 7f8032000640 1 -- 172.21.15.37:0/4234214585 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801c0b0070 con 0x7f80340d02b0 2024-05-30T06:42:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.511+0000 7f8032000640 1 -- 172.21.15.37:0/4234214585 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c0ab890 con 0x7f80340d02b0 2024-05-30T06:42:07.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.511+0000 7f8039e00640 1 -- 172.21.15.37:0/4234214585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80340d02b0 msgr2=0x7f80340d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:07.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.511+0000 7f8039e00640 1 --2- 172.21.15.37:0/4234214585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80340d02b0 0x7f80340d0710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f801c0097c0 tx=0x7f801c01c470 comp rx=0 tx=0).stop 2024-05-30T06:42:07.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.511+0000 7f8039e00640 1 -- 172.21.15.37:0/4234214585 shutdown_connections 2024-05-30T06:42:07.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.511+0000 7f8039e00640 1 --2- 172.21.15.37:0/4234214585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80340d02b0 0x7f80340d0710 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.511+0000 7f8039e00640 1 --2- 172.21.15.37:0/4234214585 >> v2:172.21.15.105:3300/0 conn(0x7f803415ed50 0x7f80340c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.511+0000 7f8039e00640 1 -- 172.21.15.37:0/4234214585 >> 172.21.15.37:0/4234214585 conn(0x7f80340d26e0 msgr2=0x7f80340d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:07.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.511+0000 7f8039e00640 1 -- 172.21.15.37:0/4234214585 shutdown_connections 2024-05-30T06:42:07.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.511+0000 7f8039e00640 1 -- 172.21.15.37:0/4234214585 wait complete. 2024-05-30T06:42:07.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.511+0000 7f8039e00640 1 Processor -- start 2024-05-30T06:42:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8039e00640 1 -- start start 2024-05-30T06:42:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8039e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80340d02b0 0x7f80341445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8039e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80340d0c50 0x7f8034070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8039e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f803415ed50 0x7f80340b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8039e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f80340c7c50 con 0x7f80340d02b0 2024-05-30T06:42:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8039e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f80340c7ad0 con 0x7f803415ed50 2024-05-30T06:42:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8039e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f803416bb20 con 0x7f80340d0c50 2024-05-30T06:42:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8032a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80340d02b0 0x7f80341445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8032a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80340d02b0 0x7f80341445d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60142/0 (socket says 172.21.15.37:60142) 2024-05-30T06:42:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8032a00640 1 -- 172.21.15.37:0/3596111782 learned_addr learned my addr 172.21.15.37:0/3596111782 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8033400640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f803415ed50 0x7f80340b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f802a000640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80340d0c50 0x7f8034070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8032a00640 1 -- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80340d0c50 msgr2=0x7f8034070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8032a00640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80340d0c50 0x7f8034070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8032a00640 1 -- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f803415ed50 msgr2=0x7f80340b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8032a00640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f803415ed50 0x7f80340b6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8032a00640 1 -- 172.21.15.37:0/3596111782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80340b7670 con 0x7f80340d02b0 2024-05-30T06:42:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f802a000640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80340d0c50 0x7f8034070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8032a00640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80340d02b0 0x7f80341445d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f802400e870 tx=0x7f802400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f802be00640 1 -- 172.21.15.37:0/3596111782 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024017070 con 0x7f80340d02b0 2024-05-30T06:42:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f802be00640 1 -- 172.21.15.37:0/3596111782 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f802400c940 con 0x7f80340d02b0 2024-05-30T06:42:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8039e00640 1 -- 172.21.15.37:0/3596111782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8034161e40 con 0x7f80340d02b0 2024-05-30T06:42:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f802be00640 1 -- 172.21.15.37:0/3596111782 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802400ccf0 con 0x7f80340d02b0 2024-05-30T06:42:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8039e00640 1 -- 172.21.15.37:0/3596111782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8034162120 con 0x7f80340d02b0 2024-05-30T06:42:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.515+0000 7f8039e00640 1 -- 172.21.15.37:0/3596111782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8034068b20 con 0x7f80340d02b0 2024-05-30T06:42:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.519+0000 7f802be00640 1 -- 172.21.15.37:0/3596111782 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f802401a070 con 0x7f80340d02b0 2024-05-30T06:42:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.519+0000 7f802be00640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8010068380 0x7f801006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.519+0000 7f802be00640 1 -- 172.21.15.37:0/3596111782 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f8024086820 con 0x7f80340d02b0 2024-05-30T06:42:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.519+0000 7f802a000640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8010068380 0x7f801006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:07.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.519+0000 7f802a000640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8010068380 0x7f801006a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f801c0af000 tx=0x7f801c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:07.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.523+0000 7f802be00640 1 -- 172.21.15.37:0/3596111782 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8024056ae0 con 0x7f80340d02b0 2024-05-30T06:42:07.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f8039e00640 1 -- 172.21.15.37:0/3596111782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80340d3420 con 0x7f80340d02b0 2024-05-30T06:42:07.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f802be00640 1 -- 172.21.15.37:0/3596111782 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f802405ade0 con 0x7f80340d02b0 2024-05-30T06:42:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:07.723 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2950341560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2950341560},{"type":"v1","addr":"172.21.15.37:6835","nonce":2950341560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/1458371524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1458371524},{"type":"v1","addr":"172.21.15.105:6836","nonce":1458371524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4088854019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4088854019},{"type":"v1","addr":"172.21.15.37:6833","nonce":4088854019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2952122373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2952122373},{"type":"v1","addr":"172.21.15.105:6837","nonce":2952122373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-30T06:42:07.723 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2024-05-30T06:42:07.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f8039e00640 1 -- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8010068380 msgr2=0x7f801006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:07.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f8039e00640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8010068380 0x7f801006a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f801c0af000 tx=0x7f801c0a7000 comp rx=0 tx=0).stop 2024-05-30T06:42:07.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f8039e00640 1 -- 172.21.15.37:0/3596111782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80340d02b0 msgr2=0x7f80341445d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:07.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f8039e00640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80340d02b0 0x7f80341445d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f802400e870 tx=0x7f802400ec70 comp rx=0 tx=0).stop 2024-05-30T06:42:07.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f8039e00640 1 -- 172.21.15.37:0/3596111782 shutdown_connections 2024-05-30T06:42:07.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f8039e00640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8010068380 0x7f801006a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f8039e00640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f803415ed50 0x7f80340b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f8039e00640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80340d0c50 0x7f8034070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f8039e00640 1 --2- 172.21.15.37:0/3596111782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80340d02b0 0x7f80341445d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f8039e00640 1 -- 172.21.15.37:0/3596111782 >> 172.21.15.37:0/3596111782 conn(0x7f80340d26e0 msgr2=0x7f8034154750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:07.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f8039e00640 1 -- 172.21.15.37:0/3596111782 shutdown_connections 2024-05-30T06:42:07.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.723+0000 7f8039e00640 1 -- 172.21.15.37:0/3596111782 wait complete. 2024-05-30T06:42:07.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd93400640 1 Processor -- start 2024-05-30T06:42:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd93400640 1 -- start start 2024-05-30T06:42:07.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd93400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efd8c09b9a0 0x7efd8c1625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:07.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd93400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efd8c162ae0 0x7efd8c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd93400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8c162f00 con 0x7efd8c15e930 2024-05-30T06:42:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd93400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efd8c09abe0 con 0x7efd8c162ae0 2024-05-30T06:42:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd93400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7efd8c09aec0 con 0x7efd8c09b9a0 2024-05-30T06:42:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd91400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efd8c162ae0 0x7efd8c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd90a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efd8c15e930 0x7efd8c0d1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60648/0 (socket says 172.21.15.37:60648) 2024-05-30T06:42:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd90a00640 1 -- 172.21.15.37:0/2912356221 learned_addr learned my addr 172.21.15.37:0/2912356221 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd8be00640 1 --2- 172.21.15.37:0/2912356221 >> v2:172.21.15.105:3300/0 conn(0x7efd8c09b9a0 0x7efd8c1625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd91400640 1 -- 172.21.15.37:0/2912356221 >> v2:172.21.15.105:3300/0 conn(0x7efd8c09b9a0 msgr2=0x7efd8c1625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd91400640 1 --2- 172.21.15.37:0/2912356221 >> v2:172.21.15.105:3300/0 conn(0x7efd8c09b9a0 0x7efd8c1625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd91400640 1 -- 172.21.15.37:0/2912356221 >> v1:172.21.15.37:6789/0 conn(0x7efd8c15e930 legacy=0x7efd8c0d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:07.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.883+0000 7efd91400640 1 -- 172.21.15.37:0/2912356221 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c09b1a0 con 0x7efd8c162ae0 2024-05-30T06:42:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.887+0000 7efd91400640 1 --2- 172.21.15.37:0/2912356221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd8c162ae0 0x7efd8c0ccc60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efd8c073320 tx=0x7efd8401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180506150390db5c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.887+0000 7efd8b400640 1 -- 172.21.15.37:0/2912356221 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840b2070 con 0x7efd8c162ae0 2024-05-30T06:42:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.887+0000 7efd8b400640 1 -- 172.21.15.37:0/2912356221 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd840a58e0 con 0x7efd8c162ae0 2024-05-30T06:42:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.887+0000 7efd8b400640 1 -- 172.21.15.37:0/2912356221 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840a5cb0 con 0x7efd8c162ae0 2024-05-30T06:42:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.887+0000 7efd93400640 1 -- 172.21.15.37:0/2912356221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd8c162ae0 msgr2=0x7efd8c0ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.887+0000 7efd93400640 1 --2- 172.21.15.37:0/2912356221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd8c162ae0 0x7efd8c0ccc60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efd8c073320 tx=0x7efd8401c930 comp rx=0 tx=0).stop 2024-05-30T06:42:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.887+0000 7efd93400640 1 -- 172.21.15.37:0/2912356221 shutdown_connections 2024-05-30T06:42:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.887+0000 7efd93400640 1 --2- 172.21.15.37:0/2912356221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd8c162ae0 0x7efd8c0ccc60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.887+0000 7efd93400640 1 --2- 172.21.15.37:0/2912356221 >> v2:172.21.15.105:3300/0 conn(0x7efd8c09b9a0 0x7efd8c1625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.887+0000 7efd93400640 1 -- 172.21.15.37:0/2912356221 >> 172.21.15.37:0/2912356221 conn(0x7efd8c0b4100 msgr2=0x7efd8c0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.887+0000 7efd93400640 1 -- 172.21.15.37:0/2912356221 shutdown_connections 2024-05-30T06:42:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.887+0000 7efd93400640 1 -- 172.21.15.37:0/2912356221 wait complete. 2024-05-30T06:42:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd93400640 1 Processor -- start 2024-05-30T06:42:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd93400640 1 -- start start 2024-05-30T06:42:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd93400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd8c09b9a0 0x7efd8c1500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd93400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd8c15e930 0x7efd8c151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd93400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd8c162ae0 0x7efd8c159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd93400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c06ddc0 con 0x7efd8c09b9a0 2024-05-30T06:42:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd93400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c06dc40 con 0x7efd8c15e930 2024-05-30T06:42:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd93400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efd8c15ed10 con 0x7efd8c162ae0 2024-05-30T06:42:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd90a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd8c09b9a0 0x7efd8c1500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd90a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd8c09b9a0 0x7efd8c1500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60170/0 (socket says 172.21.15.37:60170) 2024-05-30T06:42:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd90a00640 1 -- 172.21.15.37:0/777121425 learned_addr learned my addr 172.21.15.37:0/777121425 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd8be00640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd8c15e930 0x7efd8c151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd91400640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd8c162ae0 0x7efd8c159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd90a00640 1 -- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd8c162ae0 msgr2=0x7efd8c159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:07.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd90a00640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd8c162ae0 0x7efd8c159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd90a00640 1 -- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd8c15e930 msgr2=0x7efd8c151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd90a00640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd8c15e930 0x7efd8c151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd90a00640 1 -- 172.21.15.37:0/777121425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c150990 con 0x7efd8c09b9a0 2024-05-30T06:42:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd8be00640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd8c15e930 0x7efd8c151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd91400640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd8c162ae0 0x7efd8c159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd90a00640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd8c09b9a0 0x7efd8c1500f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efd8000c450 tx=0x7efd8000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd88c00640 1 -- 172.21.15.37:0/777121425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80017070 con 0x7efd8c09b9a0 2024-05-30T06:42:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd88c00640 1 -- 172.21.15.37:0/777121425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd80005cf0 con 0x7efd8c09b9a0 2024-05-30T06:42:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd88c00640 1 -- 172.21.15.37:0/777121425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80007290 con 0x7efd8c09b9a0 2024-05-30T06:42:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd93400640 1 -- 172.21.15.37:0/777121425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8c1525f0 con 0x7efd8c09b9a0 2024-05-30T06:42:07.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.891+0000 7efd93400640 1 -- 172.21.15.37:0/777121425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8c1595f0 con 0x7efd8c09b9a0 2024-05-30T06:42:07.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.895+0000 7efd93400640 1 -- 172.21.15.37:0/777121425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd8c068b20 con 0x7efd8c09b9a0 2024-05-30T06:42:07.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.895+0000 7efd88c00640 1 -- 172.21.15.37:0/777121425 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efd8001a070 con 0x7efd8c09b9a0 2024-05-30T06:42:07.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.895+0000 7efd88c00640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efd6c0683b0 0x7efd6c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.895+0000 7efd88c00640 1 -- 172.21.15.37:0/777121425 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7efd80085980 con 0x7efd8c09b9a0 2024-05-30T06:42:07.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.895+0000 7efd8be00640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efd6c0683b0 0x7efd6c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:07.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.899+0000 7efd8be00640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efd6c0683b0 0x7efd6c06a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0b3ec0 tx=0x7efd78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:07.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:07.899+0000 7efd88c00640 1 -- 172.21.15.37:0/777121425 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efd8c150990 con 0x7efd8c09b9a0 2024-05-30T06:42:08.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd93400640 1 -- 172.21.15.37:0/777121425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd8c15e160 con 0x7efd8c09b9a0 2024-05-30T06:42:08.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd88c00640 1 -- 172.21.15.37:0/777121425 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7efd80056280 con 0x7efd8c09b9a0 2024-05-30T06:42:08.070 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:08.070 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:00.997166+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:08.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd93400640 1 -- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efd6c0683b0 msgr2=0x7efd6c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd93400640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efd6c0683b0 0x7efd6c06a870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0b3ec0 tx=0x7efd78008040 comp rx=0 tx=0).stop 2024-05-30T06:42:08.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd93400640 1 -- 172.21.15.37:0/777121425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd8c09b9a0 msgr2=0x7efd8c1500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd93400640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd8c09b9a0 0x7efd8c1500f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efd8000c450 tx=0x7efd8000c910 comp rx=0 tx=0).stop 2024-05-30T06:42:08.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd93400640 1 -- 172.21.15.37:0/777121425 shutdown_connections 2024-05-30T06:42:08.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd93400640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd8c162ae0 0x7efd8c159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd93400640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efd6c0683b0 0x7efd6c06a870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd93400640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd8c15e930 0x7efd8c151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd93400640 1 --2- 172.21.15.37:0/777121425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd8c09b9a0 0x7efd8c1500f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd93400640 1 -- 172.21.15.37:0/777121425 >> 172.21.15.37:0/777121425 conn(0x7efd8c0b4100 msgr2=0x7efd8c070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:08.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd93400640 1 -- 172.21.15.37:0/777121425 shutdown_connections 2024-05-30T06:42:08.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.071+0000 7efd93400640 1 -- 172.21.15.37:0/777121425 wait complete. 2024-05-30T06:42:08.091 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:08.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:08.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81b4600640 1 Processor -- start 2024-05-30T06:42:08.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81b4600640 1 -- start start 2024-05-30T06:42:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81b4600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac0d1ad0 0x7f81ac169810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81b4600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81ac163350 con 0x7f81ac15e8b0 2024-05-30T06:42:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81b4600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81ac1627d0 con 0x7f81ac06d200 2024-05-30T06:42:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81b4600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f81ac162ab0 con 0x7f81ac0d1ad0 2024-05-30T06:42:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81b1c00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f81ac15e8b0 0x7f81ac0cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60664/0 (socket says 172.21.15.37:60664) 2024-05-30T06:42:08.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81b1c00640 1 -- 172.21.15.37:0/1369849826 learned_addr learned my addr 172.21.15.37:0/1369849826 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81b2600640 1 --2- 172.21.15.37:0/1369849826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac0d1ad0 0x7f81ac169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403147247 0 0) 0x7f81ac163350 con 0x7f81ac15e8b0 2024-05-30T06:42:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8194003530 con 0x7f81ac15e8b0 2024-05-30T06:42:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748135469 0 0) 0x7f81ac1627d0 con 0x7f81ac06d200 2024-05-30T06:42:08.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81ac163350 con 0x7f81ac06d200 2024-05-30T06:42:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4250081427 0 0) 0x7f8194003530 con 0x7f81ac15e8b0 2024-05-30T06:42:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac0d1ad0 msgr2=0x7f81ac169810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 --2- 172.21.15.37:0/1369849826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac0d1ad0 0x7f81ac169810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 >> v1:172.21.15.105:6789/0 conn(0x7f81ac06d200 legacy=0x7f81ac06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ac162d90 con 0x7f81ac15e8b0 2024-05-30T06:42:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f81a0001680 con 0x7f81ac15e8b0 2024-05-30T06:42:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 >> v1:172.21.15.37:6789/0 conn(0x7f81ac15e8b0 legacy=0x7f81ac0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 --2- 172.21.15.37:0/1369849826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8194003b80 0x7f8194003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 --2- 172.21.15.37:0/1369849826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8194004810 0x7f8194004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 --2- 172.21.15.37:0/1369849826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac0d1ad0 0x7f81940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac162ab0 con 0x7f8194003b80 2024-05-30T06:42:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f819400ba80 con 0x7f8194004810 2024-05-30T06:42:08.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f819400bc80 con 0x7f81ac0d1ad0 2024-05-30T06:42:08.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.235+0000 7f81b1c00640 1 --2- 172.21.15.37:0/1369849826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8194003b80 0x7f8194003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b1200640 1 --2- 172.21.15.37:0/1369849826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8194004810 0x7f8194004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b2600640 1 --2- 172.21.15.37:0/1369849826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac0d1ad0 0x7f81940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b1c00640 1 -- 172.21.15.37:0/1369849826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac0d1ad0 msgr2=0x7f81940051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:08.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b1c00640 1 --2- 172.21.15.37:0/1369849826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac0d1ad0 0x7f81940051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b1c00640 1 -- 172.21.15.37:0/1369849826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8194004810 msgr2=0x7f8194004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:08.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b1c00640 1 --2- 172.21.15.37:0/1369849826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8194004810 0x7f8194004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b1c00640 1 -- 172.21.15.37:0/1369849826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8194003530 con 0x7f8194003b80 2024-05-30T06:42:08.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b1200640 1 --2- 172.21.15.37:0/1369849826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8194004810 0x7f8194004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:08.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b1c00640 1 --2- 172.21.15.37:0/1369849826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8194003b80 0x7f8194003f80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f81a000c0e0 tx=0x7f81a001cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b935d4ba158a2f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:08.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0007c50 con 0x7f8194003b80 2024-05-30T06:42:08.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a00a9070 con 0x7f8194003b80 2024-05-30T06:42:08.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81abe00640 1 -- 172.21.15.37:0/1369849826 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0005d60 con 0x7f8194003b80 2024-05-30T06:42:08.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b4600640 1 -- 172.21.15.37:0/1369849826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8194003b80 msgr2=0x7f8194003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b4600640 1 --2- 172.21.15.37:0/1369849826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8194003b80 0x7f8194003f80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f81a000c0e0 tx=0x7f81a001cb60 comp rx=0 tx=0).stop 2024-05-30T06:42:08.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b2600640 1 -- 172.21.15.37:0/1369849826 reap_dead start 2024-05-30T06:42:08.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b4600640 1 -- 172.21.15.37:0/1369849826 shutdown_connections 2024-05-30T06:42:08.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b4600640 1 -- 172.21.15.37:0/1369849826 >> 172.21.15.37:0/1369849826 conn(0x7f81ac0b4130 msgr2=0x7f81ac0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:08.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b4600640 1 -- 172.21.15.37:0/1369849826 shutdown_connections 2024-05-30T06:42:08.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.239+0000 7f81b4600640 1 -- 172.21.15.37:0/1369849826 wait complete. 2024-05-30T06:42:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b4600640 1 Processor -- start 2024-05-30T06:42:08.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b4600640 1 -- start start 2024-05-30T06:42:08.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b4600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8194003b80 0x7f81ac1fa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b4600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac154770 0x7f81ac153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b4600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ac0d2620 0x7f81ac0d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b4600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac16a020 con 0x7f81ac0d2620 2024-05-30T06:42:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b4600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac0cf050 con 0x7f8194003b80 2024-05-30T06:42:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b4600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f81ac16a1a0 con 0x7f81ac154770 2024-05-30T06:42:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b2600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ac0d2620 0x7f81ac0d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b2600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ac0d2620 0x7f81ac0d2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60178/0 (socket says 172.21.15.37:60178) 2024-05-30T06:42:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b2600640 1 -- 172.21.15.37:0/3339478158 learned_addr learned my addr 172.21.15.37:0/3339478158 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b1c00640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8194003b80 0x7f81ac1fa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b1200640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac154770 0x7f81ac153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b2600640 1 -- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac154770 msgr2=0x7f81ac153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b2600640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac154770 0x7f81ac153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b2600640 1 -- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8194003b80 msgr2=0x7f81ac1fa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b2600640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8194003b80 0x7f81ac1fa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b2600640 1 -- 172.21.15.37:0/3339478158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ac1faf10 con 0x7f81ac0d2620 2024-05-30T06:42:08.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b1200640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac154770 0x7f81ac153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:08.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b2600640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ac0d2620 0x7f81ac0d2ad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0a0760 tx=0x7f81a40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:08.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81a9600640 1 -- 172.21.15.37:0/3339478158 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a40039a0 con 0x7f81ac0d2620 2024-05-30T06:42:08.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81a9600640 1 -- 172.21.15.37:0/3339478158 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a401b070 con 0x7f81ac0d2620 2024-05-30T06:42:08.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81a9600640 1 -- 172.21.15.37:0/3339478158 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4003b80 con 0x7f81ac0d2620 2024-05-30T06:42:08.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b4600640 1 -- 172.21.15.37:0/3339478158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ac1fb1f0 con 0x7f81ac0d2620 2024-05-30T06:42:08.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.243+0000 7f81b4600640 1 -- 172.21.15.37:0/3339478158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ac1fb7b0 con 0x7f81ac0d2620 2024-05-30T06:42:08.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.247+0000 7f81b4600640 1 -- 172.21.15.37:0/3339478158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ac068bc0 con 0x7f81ac0d2620 2024-05-30T06:42:08.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.247+0000 7f81a9600640 1 -- 172.21.15.37:0/3339478158 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f81a4004030 con 0x7f81ac0d2620 2024-05-30T06:42:08.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.247+0000 7f81a9600640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f818c068380 0x7f818c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.247+0000 7f81a9600640 1 -- 172.21.15.37:0/3339478158 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f81a4086ff0 con 0x7f81ac0d2620 2024-05-30T06:42:08.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.247+0000 7f81b1c00640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f818c068380 0x7f818c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.247+0000 7f81b1c00640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f818c068380 0x7f818c06a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f81a00ab000 tx=0x7f81a00b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:08.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.251+0000 7f81a9600640 1 -- 172.21.15.37:0/3339478158 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f81a4025020 con 0x7f81ac0d2620 2024-05-30T06:42:08.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.419+0000 7f81b4600640 1 -- 172.21.15.37:0/3339478158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f81ac0b1630 con 0x7f81ac0d2620 2024-05-30T06:42:08.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.423+0000 7f81a9600640 1 -- 172.21.15.37:0/3339478158 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f81a4057910 con 0x7f81ac0d2620 2024-05-30T06:42:08.421 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:08.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.423+0000 7f81b4600640 1 -- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f818c068380 msgr2=0x7f818c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.423+0000 7f81b4600640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f818c068380 0x7f818c06a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f81a00ab000 tx=0x7f81a00b1040 comp rx=0 tx=0).stop 2024-05-30T06:42:08.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.423+0000 7f81b4600640 1 -- 172.21.15.37:0/3339478158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ac0d2620 msgr2=0x7f81ac0d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.423+0000 7f81b4600640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ac0d2620 0x7f81ac0d2ad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0a0760 tx=0x7f81a40115a0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.423+0000 7f81b4600640 1 -- 172.21.15.37:0/3339478158 shutdown_connections 2024-05-30T06:42:08.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.423+0000 7f81b4600640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ac0d2620 0x7f81ac0d2ad0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.423+0000 7f81b4600640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ac154770 0x7f81ac153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.423+0000 7f81b4600640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f818c068380 0x7f818c06a840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.423+0000 7f81b4600640 1 --2- 172.21.15.37:0/3339478158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8194003b80 0x7f81ac1fa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.423+0000 7f81b4600640 1 -- 172.21.15.37:0/3339478158 >> 172.21.15.37:0/3339478158 conn(0x7f81ac0b4130 msgr2=0x7f81ac075440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:08.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.423+0000 7f81b4600640 1 -- 172.21.15.37:0/3339478158 shutdown_connections 2024-05-30T06:42:08.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.423+0000 7f81b4600640 1 -- 172.21.15.37:0/3339478158 wait complete. 2024-05-30T06:42:08.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T06:42:08.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.583+0000 7f2c0b000640 1 Processor -- start 2024-05-30T06:42:08.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.583+0000 7f2c0b000640 1 -- start start 2024-05-30T06:42:08.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2c0b000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2c0406e000 0x7f2c040ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2c0b000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c040cee10 0x7f2c0406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2c0b000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c040cd120 con 0x7f2c0415cd80 2024-05-30T06:42:08.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2c0b000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2c040a9530 con 0x7f2c0406e000 2024-05-30T06:42:08.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2c0b000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2c040cd400 con 0x7f2c040cee10 2024-05-30T06:42:08.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2bfbe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2c0415cd80 0x7f2c040ce700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60672/0 (socket says 172.21.15.37:60672) 2024-05-30T06:42:08.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2bfbe00640 1 -- 172.21.15.37:0/3176156821 learned_addr learned my addr 172.21.15.37:0/3176156821 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:08.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2c09000640 1 --2- 172.21.15.37:0/3176156821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c040cee10 0x7f2c0406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2c03e00640 1 --2- 172.21.15.37:0/3176156821 >> v2:172.21.15.105:3300/0 conn(0x7f2c0406e000 0x7f2c040ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2c03400640 1 -- 172.21.15.37:0/3176156821 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600439170 0 0) 0x7f2c040cd120 con 0x7f2c0415cd80 2024-05-30T06:42:08.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2c03400640 1 -- 172.21.15.37:0/3176156821 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2be8003530 con 0x7f2c0415cd80 2024-05-30T06:42:08.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2c09000640 1 -- 172.21.15.37:0/3176156821 >> v2:172.21.15.105:3300/0 conn(0x7f2c0406e000 msgr2=0x7f2c040ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:08.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2c09000640 1 --2- 172.21.15.37:0/3176156821 >> v2:172.21.15.105:3300/0 conn(0x7f2c0406e000 0x7f2c040ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2c09000640 1 -- 172.21.15.37:0/3176156821 >> v1:172.21.15.37:6789/0 conn(0x7f2c0415cd80 legacy=0x7f2c040ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.587+0000 7f2c09000640 1 -- 172.21.15.37:0/3176156821 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c040cd6e0 con 0x7f2c040cee10 2024-05-30T06:42:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c09000640 1 --2- 172.21.15.37:0/3176156821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c040cee10 0x7f2c0406f3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009d90 tx=0x7f2bfc01f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d813f6b6ad2208e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c03400640 1 -- 172.21.15.37:0/3176156821 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0b4070 con 0x7f2c040cee10 2024-05-30T06:42:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c03400640 1 -- 172.21.15.37:0/3176156821 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bfc0af600 con 0x7f2c040cee10 2024-05-30T06:42:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c03400640 1 -- 172.21.15.37:0/3176156821 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0af9d0 con 0x7f2c040cee10 2024-05-30T06:42:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 -- 172.21.15.37:0/3176156821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c040cee10 msgr2=0x7f2c0406f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 --2- 172.21.15.37:0/3176156821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c040cee10 0x7f2c0406f3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009d90 tx=0x7f2bfc01f150 comp rx=0 tx=0).stop 2024-05-30T06:42:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 -- 172.21.15.37:0/3176156821 shutdown_connections 2024-05-30T06:42:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 --2- 172.21.15.37:0/3176156821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c040cee10 0x7f2c0406f3f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 --2- 172.21.15.37:0/3176156821 >> v2:172.21.15.105:3300/0 conn(0x7f2c0406e000 0x7f2c040ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 -- 172.21.15.37:0/3176156821 >> 172.21.15.37:0/3176156821 conn(0x7f2c040b23a0 msgr2=0x7f2c040b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 -- 172.21.15.37:0/3176156821 shutdown_connections 2024-05-30T06:42:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 -- 172.21.15.37:0/3176156821 wait complete. 2024-05-30T06:42:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 Processor -- start 2024-05-30T06:42:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 -- start start 2024-05-30T06:42:08.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c0406e000 0x7f2c04153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c040cee10 0x7f2c04154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c0415cd80 0x7f2c041548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0406f930 con 0x7f2c040cee10 2024-05-30T06:42:08.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c040cdca0 con 0x7f2c0415cd80 2024-05-30T06:42:08.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2c0b000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2c0406fab0 con 0x7f2c0406e000 2024-05-30T06:42:08.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2bfbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c040cee10 0x7f2c04154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2bfbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c040cee10 0x7f2c04154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60180/0 (socket says 172.21.15.37:60180) 2024-05-30T06:42:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.591+0000 7f2bfbe00640 1 -- 172.21.15.37:0/1732678964 learned_addr learned my addr 172.21.15.37:0/1732678964 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2c03e00640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c0406e000 0x7f2c04153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2c09000640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c0415cd80 0x7f2c041548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2bfbe00640 1 -- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c0406e000 msgr2=0x7f2c04153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2bfbe00640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c0406e000 0x7f2c04153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2bfbe00640 1 -- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c0415cd80 msgr2=0x7f2c041548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2bfbe00640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c0415cd80 0x7f2c041548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2bfbe00640 1 -- 172.21.15.37:0/1732678964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c041578d0 con 0x7f2c040cee10 2024-05-30T06:42:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2c09000640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c0415cd80 0x7f2c041548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2c03e00640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c0406e000 0x7f2c04153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2bfbe00640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c040cee10 0x7f2c04154370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00c480 tx=0x7f2bec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2c00c00640 1 -- 172.21.15.37:0/1732678964 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec017070 con 0x7f2c040cee10 2024-05-30T06:42:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2c00c00640 1 -- 172.21.15.37:0/1732678964 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bec005cf0 con 0x7f2c040cee10 2024-05-30T06:42:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2c0b000640 1 -- 172.21.15.37:0/1732678964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c04156cc0 con 0x7f2c040cee10 2024-05-30T06:42:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2c00c00640 1 -- 172.21.15.37:0/1732678964 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec007290 con 0x7f2c040cee10 2024-05-30T06:42:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2c0b000640 1 -- 172.21.15.37:0/1732678964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c04157280 con 0x7f2c040cee10 2024-05-30T06:42:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2c0b000640 1 -- 172.21.15.37:0/1732678964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c04068b20 con 0x7f2c040cee10 2024-05-30T06:42:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2c00c00640 1 -- 172.21.15.37:0/1732678964 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2bec01a070 con 0x7f2c040cee10 2024-05-30T06:42:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2c00c00640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2be00683b0 0x7f2be006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.595+0000 7f2c00c00640 1 -- 172.21.15.37:0/1732678964 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2bec085af0 con 0x7f2c040cee10 2024-05-30T06:42:08.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.599+0000 7f2c03e00640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2be00683b0 0x7f2be006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.599+0000 7f2c03e00640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2be00683b0 0x7f2be006a870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009b10 tx=0x7f2bf4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.599+0000 7f2c00c00640 1 -- 172.21.15.37:0/1732678964 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2bec056370 con 0x7f2c040cee10 2024-05-30T06:42:08.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.767+0000 7f2c0b000640 1 -- 172.21.15.37:0/1732678964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2c04145310 con 0x7f2c040cee10 2024-05-30T06:42:08.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.771+0000 7f2c00c00640 1 -- 172.21.15.37:0/1732678964 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f2bec05c030 con 0x7f2c040cee10 2024-05-30T06:42:08.769 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:08.769 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:42:08.769 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:08.769 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-30T06:42:08.769 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-30T06:42:08.769 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:08.769 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:42:08.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.771+0000 7f2c0b000640 1 -- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2be00683b0 msgr2=0x7f2be006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.771+0000 7f2c0b000640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2be00683b0 0x7f2be006a870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009b10 tx=0x7f2bf4008040 comp rx=0 tx=0).stop 2024-05-30T06:42:08.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.771+0000 7f2c0b000640 1 -- 172.21.15.37:0/1732678964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c040cee10 msgr2=0x7f2c04154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.771+0000 7f2c0b000640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c040cee10 0x7f2c04154370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00c480 tx=0x7f2bec00c940 comp rx=0 tx=0).stop 2024-05-30T06:42:08.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.771+0000 7f2c0b000640 1 -- 172.21.15.37:0/1732678964 shutdown_connections 2024-05-30T06:42:08.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.771+0000 7f2c0b000640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2be00683b0 0x7f2be006a870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.771+0000 7f2c0b000640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c0415cd80 0x7f2c041548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.771+0000 7f2c0b000640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c040cee10 0x7f2c04154370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.771+0000 7f2c0b000640 1 --2- 172.21.15.37:0/1732678964 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c0406e000 0x7f2c04153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.771+0000 7f2c0b000640 1 -- 172.21.15.37:0/1732678964 >> 172.21.15.37:0/1732678964 conn(0x7f2c040b23a0 msgr2=0x7f2c0415c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:08.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.771+0000 7f2c0b000640 1 -- 172.21.15.37:0/1732678964 shutdown_connections 2024-05-30T06:42:08.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.771+0000 7f2c0b000640 1 -- 172.21.15.37:0/1732678964 wait complete. 2024-05-30T06:42:08.790 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T06:42:08.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T06:42:08.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.935+0000 7f016b600640 1 Processor -- start 2024-05-30T06:42:08.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.935+0000 7f016b600640 1 -- start start 2024-05-30T06:42:08.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.935+0000 7f016b600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0164073900 0x7f01641603b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.935+0000 7f016b600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01640d1410 con 0x7f016415c820 2024-05-30T06:42:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.935+0000 7f016b600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0164160ab0 con 0x7f01640b3390 2024-05-30T06:42:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.935+0000 7f016b600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0164160d90 con 0x7f0164073900 2024-05-30T06:42:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.935+0000 7f0163e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0164073900 0x7f01641603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.935+0000 7f0168c00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f016415c820 0x7f01640ce000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60682/0 (socket says 172.21.15.37:60682) 2024-05-30T06:42:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.935+0000 7f0163e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0164073900 0x7f01641603b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60196/0 (socket says 172.21.15.37:60196) 2024-05-30T06:42:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.935+0000 7f0168c00640 1 -- 172.21.15.37:0/2109231555 learned_addr learned my addr 172.21.15.37:0/2109231555 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:08.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.935+0000 7f0163e00640 1 -- 172.21.15.37:0/2109231555 >> v1:172.21.15.105:6789/0 conn(0x7f01640b3390 legacy=0x7f0164070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.935+0000 7f0163e00640 1 -- 172.21.15.37:0/2109231555 >> v1:172.21.15.37:6789/0 conn(0x7f016415c820 legacy=0x7f01640ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.935+0000 7f0163e00640 1 -- 172.21.15.37:0/2109231555 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0164161070 con 0x7f0164073900 2024-05-30T06:42:08.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.939+0000 7f0163e00640 1 --2- 172.21.15.37:0/2109231555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0164073900 0x7f01641603b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f01500097c0 tx=0x7f015001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8429f6edadaad48 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:08.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.939+0000 7f0163400640 1 -- 172.21.15.37:0/2109231555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01500b1070 con 0x7f0164073900 2024-05-30T06:42:08.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.939+0000 7f0163400640 1 -- 172.21.15.37:0/2109231555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01500ac410 con 0x7f0164073900 2024-05-30T06:42:08.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.939+0000 7f0163400640 1 -- 172.21.15.37:0/2109231555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01500ac7e0 con 0x7f0164073900 2024-05-30T06:42:08.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.939+0000 7f016b600640 1 -- 172.21.15.37:0/2109231555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0164073900 msgr2=0x7f01641603b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.939+0000 7f016b600640 1 --2- 172.21.15.37:0/2109231555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0164073900 0x7f01641603b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f01500097c0 tx=0x7f015001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.939+0000 7f016b600640 1 -- 172.21.15.37:0/2109231555 shutdown_connections 2024-05-30T06:42:08.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.939+0000 7f016b600640 1 --2- 172.21.15.37:0/2109231555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0164073900 0x7f01641603b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.939+0000 7f016b600640 1 -- 172.21.15.37:0/2109231555 >> 172.21.15.37:0/2109231555 conn(0x7f016406f110 msgr2=0x7f016406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:08.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.939+0000 7f016b600640 1 -- 172.21.15.37:0/2109231555 shutdown_connections 2024-05-30T06:42:08.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.939+0000 7f016b600640 1 -- 172.21.15.37:0/2109231555 wait complete. 2024-05-30T06:42:08.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f016b600640 1 Processor -- start 2024-05-30T06:42:08.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f016b600640 1 -- start start 2024-05-30T06:42:08.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f016b600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0164073900 0x7f01641486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f016b600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01640b3390 0x7f0164144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f016b600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016415c820 0x7f016414f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f016b600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f016416b0d0 con 0x7f016415c820 2024-05-30T06:42:08.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f016b600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f016416af50 con 0x7f01640b3390 2024-05-30T06:42:08.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f016b600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f016416b250 con 0x7f0164073900 2024-05-30T06:42:08.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0169600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016415c820 0x7f016414f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0169600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016415c820 0x7f016414f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60212/0 (socket says 172.21.15.37:60212) 2024-05-30T06:42:08.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0169600640 1 -- 172.21.15.37:0/404790582 learned_addr learned my addr 172.21.15.37:0/404790582 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:08.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0168c00640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0164073900 0x7f01641486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0163e00640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01640b3390 0x7f0164144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0169600640 1 -- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0164073900 msgr2=0x7f01641486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0169600640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0164073900 0x7f01641486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0169600640 1 -- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01640b3390 msgr2=0x7f0164144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0169600640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01640b3390 0x7f0164144730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0169600640 1 -- 172.21.15.37:0/404790582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0164148ef0 con 0x7f016415c820 2024-05-30T06:42:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0169600640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016415c820 0x7f016414f910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f015c00c7a0 tx=0x7f015c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0160c00640 1 -- 172.21.15.37:0/404790582 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c003b80 con 0x7f016415c820 2024-05-30T06:42:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0160c00640 1 -- 172.21.15.37:0/404790582 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f015c003d20 con 0x7f016415c820 2024-05-30T06:42:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f0160c00640 1 -- 172.21.15.37:0/404790582 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c00aa30 con 0x7f016415c820 2024-05-30T06:42:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f016b600640 1 -- 172.21.15.37:0/404790582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01641491d0 con 0x7f016415c820 2024-05-30T06:42:08.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.943+0000 7f016b600640 1 -- 172.21.15.37:0/404790582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01641494b0 con 0x7f016415c820 2024-05-30T06:42:08.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.947+0000 7f016b600640 1 -- 172.21.15.37:0/404790582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0164068d40 con 0x7f016415c820 2024-05-30T06:42:08.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.947+0000 7f0160c00640 1 -- 172.21.15.37:0/404790582 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f015c00abd0 con 0x7f016415c820 2024-05-30T06:42:08.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.947+0000 7f0160c00640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0144068380 0x7f014406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:08.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.947+0000 7f0160c00640 1 -- 172.21.15.37:0/404790582 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f015c086390 con 0x7f016415c820 2024-05-30T06:42:08.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.947+0000 7f0168c00640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0144068380 0x7f014406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:08.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.947+0000 7f0168c00640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0144068380 0x7f014406a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0158005890 tx=0x7f0158009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:08.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:08.951+0000 7f0160c00640 1 -- 172.21.15.37:0/404790582 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f015c056640 con 0x7f016415c820 2024-05-30T06:42:09.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.115+0000 7f016b600640 1 -- 172.21.15.37:0/404790582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f01640b05a0 con 0x7f016415c820 2024-05-30T06:42:09.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.387+0000 7f0160c00640 1 -- 172.21.15.37:0/404790582 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f015c05a940 con 0x7f016415c820 2024-05-30T06:42:09.387 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-30T06:42:09.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.387+0000 7f016b600640 1 -- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0144068380 msgr2=0x7f014406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:09.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.387+0000 7f016b600640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0144068380 0x7f014406a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0158005890 tx=0x7f0158009040 comp rx=0 tx=0).stop 2024-05-30T06:42:09.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.387+0000 7f016b600640 1 -- 172.21.15.37:0/404790582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016415c820 msgr2=0x7f016414f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:09.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.387+0000 7f016b600640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016415c820 0x7f016414f910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f015c00c7a0 tx=0x7f015c00cc60 comp rx=0 tx=0).stop 2024-05-30T06:42:09.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.387+0000 7f016b600640 1 -- 172.21.15.37:0/404790582 shutdown_connections 2024-05-30T06:42:09.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.387+0000 7f016b600640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f016415c820 0x7f016414f910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:09.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.387+0000 7f016b600640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0144068380 0x7f014406a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:09.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.387+0000 7f016b600640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01640b3390 0x7f0164144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:09.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.387+0000 7f016b600640 1 --2- 172.21.15.37:0/404790582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0164073900 0x7f01641486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:09.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.387+0000 7f016b600640 1 -- 172.21.15.37:0/404790582 >> 172.21.15.37:0/404790582 conn(0x7f016406f110 msgr2=0x7f016415b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:09.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.391+0000 7f016b600640 1 -- 172.21.15.37:0/404790582 shutdown_connections 2024-05-30T06:42:09.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.391+0000 7f016b600640 1 -- 172.21.15.37:0/404790582 wait complete. 2024-05-30T06:42:09.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T06:42:09.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa509000640 1 Processor -- start 2024-05-30T06:42:09.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa509000640 1 -- start start 2024-05-30T06:42:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa509000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa50406d200 0x7fa50406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa509000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040d0ac0 0x7fa5040d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa509000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa50406db60 con 0x7fa50415e8b0 2024-05-30T06:42:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa509000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa504163350 con 0x7fa50406d200 2024-05-30T06:42:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa509000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa5041627d0 con 0x7fa5040d0ac0 2024-05-30T06:42:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa501400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa50406d200 0x7fa50406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa501400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa50406d200 0x7fa50406d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60216/0 (socket says 172.21.15.37:60216) 2024-05-30T06:42:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa501400640 1 -- 172.21.15.37:0/2224551042 learned_addr learned my addr 172.21.15.37:0/2224551042 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa502800640 1 --2- 172.21.15.37:0/2224551042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040d0ac0 0x7fa5040d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa501400640 1 -- 172.21.15.37:0/2224551042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040d0ac0 msgr2=0x7fa5040d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa501400640 1 --2- 172.21.15.37:0/2224551042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040d0ac0 0x7fa5040d0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa501400640 1 -- 172.21.15.37:0/2224551042 >> v1:172.21.15.105:6789/0 conn(0x7fa50415e8b0 legacy=0x7fa5040cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.563+0000 7fa501400640 1 -- 172.21.15.37:0/2224551042 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa504162ab0 con 0x7fa50406d200 2024-05-30T06:42:09.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa501400640 1 --2- 172.21.15.37:0/2224551042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50406d200 0x7fa50406d620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009870 tx=0x7fa4f001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922bfeb6c411a761 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa500a00640 1 -- 172.21.15.37:0/2224551042 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00ab650 con 0x7fa50406d200 2024-05-30T06:42:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa500a00640 1 -- 172.21.15.37:0/2224551042 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f00b0070 con 0x7fa50406d200 2024-05-30T06:42:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa500a00640 1 -- 172.21.15.37:0/2224551042 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00aba10 con 0x7fa50406d200 2024-05-30T06:42:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa509000640 1 -- 172.21.15.37:0/2224551042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50406d200 msgr2=0x7fa50406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa509000640 1 --2- 172.21.15.37:0/2224551042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50406d200 0x7fa50406d620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009870 tx=0x7fa4f001c560 comp rx=0 tx=0).stop 2024-05-30T06:42:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa509000640 1 -- 172.21.15.37:0/2224551042 shutdown_connections 2024-05-30T06:42:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa509000640 1 --2- 172.21.15.37:0/2224551042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040d0ac0 0x7fa5040d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa509000640 1 --2- 172.21.15.37:0/2224551042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50406d200 0x7fa50406d620 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa509000640 1 -- 172.21.15.37:0/2224551042 >> 172.21.15.37:0/2224551042 conn(0x7fa5040b4130 msgr2=0x7fa5040b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa509000640 1 -- 172.21.15.37:0/2224551042 shutdown_connections 2024-05-30T06:42:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa509000640 1 -- 172.21.15.37:0/2224551042 wait complete. 2024-05-30T06:42:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa509000640 1 Processor -- start 2024-05-30T06:42:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.567+0000 7fa509000640 1 -- start start 2024-05-30T06:42:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa509000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa50406d200 0x7fa504154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa509000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5040d0ac0 0x7fa504071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa509000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50415e8b0 0x7fa504071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa509000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa5040cf050 con 0x7fa50415e8b0 2024-05-30T06:42:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa509000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa504162480 con 0x7fa5040d0ac0 2024-05-30T06:42:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa509000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa50416b820 con 0x7fa50406d200 2024-05-30T06:42:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa502800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50415e8b0 0x7fa504071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa502800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50415e8b0 0x7fa504071760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60230/0 (socket says 172.21.15.37:60230) 2024-05-30T06:42:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa502800640 1 -- 172.21.15.37:0/294621585 learned_addr learned my addr 172.21.15.37:0/294621585 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa501e00640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa50406d200 0x7fa504154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa501400640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5040d0ac0 0x7fa504071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa502800640 1 -- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa50406d200 msgr2=0x7fa504154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa502800640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa50406d200 0x7fa504154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa502800640 1 -- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5040d0ac0 msgr2=0x7fa504071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa502800640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5040d0ac0 0x7fa504071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa502800640 1 -- 172.21.15.37:0/294621585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5040b1c20 con 0x7fa50415e8b0 2024-05-30T06:42:09.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa502800640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50415e8b0 0x7fa504071760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00efc0 tx=0x7fa4fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:09.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa4fa000640 1 -- 172.21.15.37:0/294621585 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc018020 con 0x7fa50415e8b0 2024-05-30T06:42:09.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa4fa000640 1 -- 172.21.15.37:0/294621585 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4fc014480 con 0x7fa50415e8b0 2024-05-30T06:42:09.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa509000640 1 -- 172.21.15.37:0/294621585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5040b1ec0 con 0x7fa50415e8b0 2024-05-30T06:42:09.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa4fa000640 1 -- 172.21.15.37:0/294621585 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc014870 con 0x7fa50415e8b0 2024-05-30T06:42:09.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa509000640 1 -- 172.21.15.37:0/294621585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5040b2480 con 0x7fa50415e8b0 2024-05-30T06:42:09.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.571+0000 7fa509000640 1 -- 172.21.15.37:0/294621585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5040b26c0 con 0x7fa50415e8b0 2024-05-30T06:42:09.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.575+0000 7fa4fa000640 1 -- 172.21.15.37:0/294621585 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa4fc01b020 con 0x7fa50415e8b0 2024-05-30T06:42:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.575+0000 7fa4fa000640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4e4068380 0x7fa4e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.575+0000 7fa4fa000640 1 -- 172.21.15.37:0/294621585 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fa4fc087160 con 0x7fa50415e8b0 2024-05-30T06:42:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.575+0000 7fa501e00640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4e4068380 0x7fa4e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:09.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.575+0000 7fa501e00640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4e4068380 0x7fa4e406a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4001770 tx=0x7fa4f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:09.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.579+0000 7fa4fa000640 1 -- 172.21.15.37:0/294621585 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa4fc022070 con 0x7fa50415e8b0 2024-05-30T06:42:09.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:09.743+0000 7fa509000640 1 -- 172.21.15.37:0/294621585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa5040b85a0 con 0x7fa50415e8b0 2024-05-30T06:42:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.391+0000 7fa4fa000640 1 -- 172.21.15.37:0/294621585 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fa4fc010040 con 0x7fa50415e8b0 2024-05-30T06:42:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-30T06:42:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.391+0000 7fa509000640 1 -- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4e4068380 msgr2=0x7fa4e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.391+0000 7fa509000640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4e4068380 0x7fa4e406a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4001770 tx=0x7fa4f4009040 comp rx=0 tx=0).stop 2024-05-30T06:42:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.391+0000 7fa509000640 1 -- 172.21.15.37:0/294621585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50415e8b0 msgr2=0x7fa504071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.391+0000 7fa509000640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50415e8b0 0x7fa504071760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00efc0 tx=0x7fa4fc00c490 comp rx=0 tx=0).stop 2024-05-30T06:42:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.395+0000 7fa509000640 1 -- 172.21.15.37:0/294621585 shutdown_connections 2024-05-30T06:42:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.395+0000 7fa509000640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa50415e8b0 0x7fa504071760 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.395+0000 7fa509000640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4e4068380 0x7fa4e406a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.395+0000 7fa509000640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5040d0ac0 0x7fa504071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.395+0000 7fa509000640 1 --2- 172.21.15.37:0/294621585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa50406d200 0x7fa504154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.395+0000 7fa509000640 1 -- 172.21.15.37:0/294621585 >> 172.21.15.37:0/294621585 conn(0x7fa5040b4130 msgr2=0x7fa50409aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.395+0000 7fa509000640 1 -- 172.21.15.37:0/294621585 shutdown_connections 2024-05-30T06:42:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.395+0000 7fa509000640 1 -- 172.21.15.37:0/294621585 wait complete. 2024-05-30T06:42:10.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T06:42:10.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.583+0000 7f6e3ca00640 1 Processor -- start 2024-05-30T06:42:10.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.583+0000 7f6e3ca00640 1 -- start start 2024-05-30T06:42:10.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.583+0000 7f6e3ca00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e3806f770 0x7f6e38166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:10.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.583+0000 7f6e3ca00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3815f310 con 0x7f6e380cd440 2024-05-30T06:42:10.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.583+0000 7f6e3ca00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3815f5f0 con 0x7f6e38155da0 2024-05-30T06:42:10.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.583+0000 7f6e3ca00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6e380b4760 con 0x7f6e3806f770 2024-05-30T06:42:10.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.583+0000 7f6e36800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e3806f770 0x7f6e38166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:10.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.583+0000 7f6e36800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e3806f770 0x7f6e38166570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60234/0 (socket says 172.21.15.37:60234) 2024-05-30T06:42:10.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.583+0000 7f6e2fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6e380cd440 0x7f6e3806f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60684/0 (socket says 172.21.15.37:60684) 2024-05-30T06:42:10.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.583+0000 7f6e36800640 1 -- 172.21.15.37:0/2703998269 learned_addr learned my addr 172.21.15.37:0/2703998269 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:10.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e36800640 1 -- 172.21.15.37:0/2703998269 >> v1:172.21.15.105:6789/0 conn(0x7f6e38155da0 legacy=0x7f6e380cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:10.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e36800640 1 -- 172.21.15.37:0/2703998269 >> v1:172.21.15.37:6789/0 conn(0x7f6e380cd440 legacy=0x7f6e3806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:10.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e36800640 1 -- 172.21.15.37:0/2703998269 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3815f8d0 con 0x7f6e3806f770 2024-05-30T06:42:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e36800640 1 --2- 172.21.15.37:0/2703998269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3806f770 0x7f6e38166570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009e50 tx=0x7f6e3001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54436b42db8e47 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e35400640 1 -- 172.21.15.37:0/2703998269 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e300a55d0 con 0x7f6e3806f770 2024-05-30T06:42:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e35400640 1 -- 172.21.15.37:0/2703998269 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e300a5770 con 0x7f6e3806f770 2024-05-30T06:42:10.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e35400640 1 -- 172.21.15.37:0/2703998269 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e300a5b40 con 0x7f6e3806f770 2024-05-30T06:42:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e3ca00640 1 -- 172.21.15.37:0/2703998269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3806f770 msgr2=0x7f6e38166570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e3ca00640 1 --2- 172.21.15.37:0/2703998269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3806f770 0x7f6e38166570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009e50 tx=0x7f6e3001c910 comp rx=0 tx=0).stop 2024-05-30T06:42:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e3ca00640 1 -- 172.21.15.37:0/2703998269 shutdown_connections 2024-05-30T06:42:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e3ca00640 1 --2- 172.21.15.37:0/2703998269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3806f770 0x7f6e38166570 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e3ca00640 1 -- 172.21.15.37:0/2703998269 >> 172.21.15.37:0/2703998269 conn(0x7f6e3806bf60 msgr2=0x7f6e380b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e3ca00640 1 -- 172.21.15.37:0/2703998269 shutdown_connections 2024-05-30T06:42:10.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.587+0000 7f6e3ca00640 1 -- 172.21.15.37:0/2703998269 wait complete. 2024-05-30T06:42:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e3ca00640 1 Processor -- start 2024-05-30T06:42:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e3ca00640 1 -- start start 2024-05-30T06:42:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e3ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3806f770 0x7f6e380a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e3ca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e38155da0 0x7f6e3815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e3ca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e38155250 0x7f6e38141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e3ca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38169a70 con 0x7f6e3806f770 2024-05-30T06:42:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e3ca00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381698f0 con 0x7f6e38155250 2024-05-30T06:42:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e3ca00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6e38169bf0 con 0x7f6e38155da0 2024-05-30T06:42:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e35e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3806f770 0x7f6e380a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e35e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3806f770 0x7f6e380a94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60238/0 (socket says 172.21.15.37:60238) 2024-05-30T06:42:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e35e00640 1 -- 172.21.15.37:0/1517205592 learned_addr learned my addr 172.21.15.37:0/1517205592 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e36800640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e38155250 0x7f6e38141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e2fe00640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e38155da0 0x7f6e3815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e35e00640 1 -- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e38155da0 msgr2=0x7f6e3815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e35e00640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e38155da0 0x7f6e3815bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e35e00640 1 -- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e38155250 msgr2=0x7f6e38141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e35e00640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e38155250 0x7f6e38141210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e35e00640 1 -- 172.21.15.37:0/1517205592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e38141b90 con 0x7f6e3806f770 2024-05-30T06:42:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e35e00640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3806f770 0x7f6e380a94c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c370 tx=0x7f6e2800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e2e000640 1 -- 172.21.15.37:0/1517205592 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e280052d0 con 0x7f6e3806f770 2024-05-30T06:42:10.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e2e000640 1 -- 172.21.15.37:0/1517205592 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e28005470 con 0x7f6e3806f770 2024-05-30T06:42:10.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e2e000640 1 -- 172.21.15.37:0/1517205592 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28007260 con 0x7f6e3806f770 2024-05-30T06:42:10.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e3ca00640 1 -- 172.21.15.37:0/1517205592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e38141e30 con 0x7f6e3806f770 2024-05-30T06:42:10.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.591+0000 7f6e3ca00640 1 -- 172.21.15.37:0/1517205592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e381423f0 con 0x7f6e3806f770 2024-05-30T06:42:10.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.595+0000 7f6e3ca00640 1 -- 172.21.15.37:0/1517205592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e38068bc0 con 0x7f6e3806f770 2024-05-30T06:42:10.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.595+0000 7f6e2e000640 1 -- 172.21.15.37:0/1517205592 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6e28007400 con 0x7f6e3806f770 2024-05-30T06:42:10.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.595+0000 7f6e2e000640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6e140683b0 0x7f6e1406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:10.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.595+0000 7f6e2e000640 1 -- 172.21.15.37:0/1517205592 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f6e28085d80 con 0x7f6e3806f770 2024-05-30T06:42:10.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.595+0000 7f6e2fe00640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6e140683b0 0x7f6e1406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.599+0000 7f6e2fe00640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6e140683b0 0x7f6e1406a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e3806f320 tx=0x7f6e20007cb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:10.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.603+0000 7f6e2e000640 1 -- 172.21.15.37:0/1517205592 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6e28055cb0 con 0x7f6e3806f770 2024-05-30T06:42:10.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:10.803+0000 7f6e3ca00640 1 -- 172.21.15.37:0/1517205592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6e380b6790 con 0x7f6e3806f770 2024-05-30T06:42:11.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.435+0000 7f6e2e000640 1 -- 172.21.15.37:0/1517205592 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f6e28059fb0 con 0x7f6e3806f770 2024-05-30T06:42:11.436 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 2 and data pool 3 2024-05-30T06:42:11.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.443+0000 7f6e3ca00640 1 -- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6e140683b0 msgr2=0x7f6e1406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:11.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.443+0000 7f6e3ca00640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6e140683b0 0x7f6e1406a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e3806f320 tx=0x7f6e20007cb0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.443+0000 7f6e3ca00640 1 -- 172.21.15.37:0/1517205592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3806f770 msgr2=0x7f6e380a94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.443+0000 7f6e3ca00640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3806f770 0x7f6e380a94c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c370 tx=0x7f6e2800c830 comp rx=0 tx=0).stop 2024-05-30T06:42:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.443+0000 7f6e3ca00640 1 -- 172.21.15.37:0/1517205592 shutdown_connections 2024-05-30T06:42:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.443+0000 7f6e3ca00640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6e140683b0 0x7f6e1406a870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.443+0000 7f6e3ca00640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e38155250 0x7f6e38141210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.443+0000 7f6e3ca00640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e38155da0 0x7f6e3815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.443+0000 7f6e3ca00640 1 --2- 172.21.15.37:0/1517205592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3806f770 0x7f6e380a94c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.443+0000 7f6e3ca00640 1 -- 172.21.15.37:0/1517205592 >> 172.21.15.37:0/1517205592 conn(0x7f6e3806bf60 msgr2=0x7f6e3815a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:11.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.443+0000 7f6e3ca00640 1 -- 172.21.15.37:0/1517205592 shutdown_connections 2024-05-30T06:42:11.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.443+0000 7f6e3ca00640 1 -- 172.21.15.37:0/1517205592 wait complete. 2024-05-30T06:42:11.472 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:11.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.615+0000 7fa285600640 1 Processor -- start 2024-05-30T06:42:11.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.615+0000 7fa285600640 1 -- start start 2024-05-30T06:42:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.615+0000 7fa285600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015cb40 0x7fa2800d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.615+0000 7fa285600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2800d2130 0x7fa28009b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.615+0000 7fa285600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2800d0b50 con 0x7fa28015c760 2024-05-30T06:42:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.615+0000 7fa285600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa2800d1760 con 0x7fa2800d2130 2024-05-30T06:42:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.615+0000 7fa285600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa2800d0e30 con 0x7fa28015cb40 2024-05-30T06:42:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.615+0000 7fa27f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2800d2130 0x7fa28009b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.615+0000 7fa27f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2800d2130 0x7fa28009b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60248/0 (socket says 172.21.15.37:60248) 2024-05-30T06:42:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.615+0000 7fa277e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015cb40 0x7fa2800d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.615+0000 7fa27f400640 1 -- 172.21.15.37:0/1470538209 learned_addr learned my addr 172.21.15.37:0/1470538209 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.619+0000 7fa27f400640 1 -- 172.21.15.37:0/1470538209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015cb40 msgr2=0x7fa2800d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.619+0000 7fa27f400640 1 --2- 172.21.15.37:0/1470538209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015cb40 0x7fa2800d1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.619+0000 7fa27f400640 1 -- 172.21.15.37:0/1470538209 >> v1:172.21.15.105:6789/0 conn(0x7fa28015c760 legacy=0x7fa2800ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.619+0000 7fa27f400640 1 -- 172.21.15.37:0/1470538209 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2800d1110 con 0x7fa2800d2130 2024-05-30T06:42:11.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.619+0000 7fa27f400640 1 --2- 172.21.15.37:0/1470538209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2800d2130 0x7fa28009b850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa278009e50 tx=0x7fa27801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e823259e966cbb91 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:11.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.619+0000 7fa27e000640 1 -- 172.21.15.37:0/1470538209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2780b4070 con 0x7fa2800d2130 2024-05-30T06:42:11.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.619+0000 7fa27e000640 1 -- 172.21.15.37:0/1470538209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2780af400 con 0x7fa2800d2130 2024-05-30T06:42:11.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.619+0000 7fa27e000640 1 -- 172.21.15.37:0/1470538209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2780af7d0 con 0x7fa2800d2130 2024-05-30T06:42:11.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.619+0000 7fa285600640 1 -- 172.21.15.37:0/1470538209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2800d2130 msgr2=0x7fa28009b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:11.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.619+0000 7fa285600640 1 --2- 172.21.15.37:0/1470538209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2800d2130 0x7fa28009b850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa278009e50 tx=0x7fa27801f210 comp rx=0 tx=0).stop 2024-05-30T06:42:11.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.619+0000 7fa285600640 1 -- 172.21.15.37:0/1470538209 shutdown_connections 2024-05-30T06:42:11.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.619+0000 7fa285600640 1 --2- 172.21.15.37:0/1470538209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2800d2130 0x7fa28009b850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.619+0000 7fa285600640 1 --2- 172.21.15.37:0/1470538209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015cb40 0x7fa2800d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa285600640 1 -- 172.21.15.37:0/1470538209 >> 172.21.15.37:0/1470538209 conn(0x7fa2800d26e0 msgr2=0x7fa2800d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:11.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa285600640 1 -- 172.21.15.37:0/1470538209 shutdown_connections 2024-05-30T06:42:11.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa285600640 1 -- 172.21.15.37:0/1470538209 wait complete. 2024-05-30T06:42:11.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa285600640 1 Processor -- start 2024-05-30T06:42:11.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa285600640 1 -- start start 2024-05-30T06:42:11.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa285600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2800d2130 0x7fa28015db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:11.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa285600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015c760 0x7fa2801582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:11.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa285600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28015cb40 0x7fa28015eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:11.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa285600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2800cd440 con 0x7fa28015cb40 2024-05-30T06:42:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa285600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa2800d0800 con 0x7fa2800d2130 2024-05-30T06:42:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa285600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa28009bd90 con 0x7fa28015c760 2024-05-30T06:42:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa27f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28015cb40 0x7fa28015eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa27ea00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2800d2130 0x7fa28015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa27f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28015cb40 0x7fa28015eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60252/0 (socket says 172.21.15.37:60252) 2024-05-30T06:42:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa27f400640 1 -- 172.21.15.37:0/1884357370 learned_addr learned my addr 172.21.15.37:0/1884357370 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa277e00640 1 --2- 172.21.15.37:0/1884357370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015c760 0x7fa2801582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:11.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa27f400640 1 -- 172.21.15.37:0/1884357370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015c760 msgr2=0x7fa2801582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:11.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa27f400640 1 --2- 172.21.15.37:0/1884357370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015c760 0x7fa2801582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa27f400640 1 -- 172.21.15.37:0/1884357370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2800d2130 msgr2=0x7fa28015db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:11.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa27f400640 1 --2- 172.21.15.37:0/1884357370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2800d2130 0x7fa28015db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa27f400640 1 -- 172.21.15.37:0/1884357370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28015f260 con 0x7fa28015cb40 2024-05-30T06:42:11.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa27f400640 1 --2- 172.21.15.37:0/1884357370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28015cb40 0x7fa28015eac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2780b2040 tx=0x7fa27801bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:11.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa276a00640 1 -- 172.21.15.37:0/1884357370 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2780c0070 con 0x7fa28015cb40 2024-05-30T06:42:11.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa276a00640 1 -- 172.21.15.37:0/1884357370 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2780090d0 con 0x7fa28015cb40 2024-05-30T06:42:11.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa276a00640 1 -- 172.21.15.37:0/1884357370 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2780b4040 con 0x7fa28015cb40 2024-05-30T06:42:11.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.623+0000 7fa285600640 1 -- 172.21.15.37:0/1884357370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28015f540 con 0x7fa28015cb40 2024-05-30T06:42:11.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.627+0000 7fa285600640 1 -- 172.21.15.37:0/1884357370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28015fb00 con 0x7fa28015cb40 2024-05-30T06:42:11.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.627+0000 7fa285600640 1 -- 172.21.15.37:0/1884357370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa280068b20 con 0x7fa28015cb40 2024-05-30T06:42:11.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.627+0000 7fa276a00640 1 -- 172.21.15.37:0/1884357370 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa2780a8d10 con 0x7fa28015cb40 2024-05-30T06:42:11.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.627+0000 7fa276a00640 1 --2- 172.21.15.37:0/1884357370 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa25c068380 0x7fa25c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:11.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.627+0000 7fa276a00640 1 -- 172.21.15.37:0/1884357370 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fa278123c90 con 0x7fa28015cb40 2024-05-30T06:42:11.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.627+0000 7fa27ea00640 1 --2- 172.21.15.37:0/1884357370 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa25c068380 0x7fa25c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:11.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.627+0000 7fa27ea00640 1 --2- 172.21.15.37:0/1884357370 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa25c068380 0x7fa25c06a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa270001810 tx=0x7fa270009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:11.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.631+0000 7fa276a00640 1 -- 172.21.15.37:0/1884357370 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa278018d70 con 0x7fa28015cb40 2024-05-30T06:42:11.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.799+0000 7fa285600640 1 -- 172.21.15.37:0/1884357370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2800d1ef0 con 0x7fa28015cb40 2024-05-30T06:42:11.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.799+0000 7fa276a00640 1 -- 172.21.15.37:0/1884357370 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16606 (secure 0 0 0) 0x7fa2780f3cb0 con 0x7fa28015cb40 2024-05-30T06:42:11.799 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:11.800 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:10.805309+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:11.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.803+0000 7fa285600640 1 -- 172.21.15.37:0/1884357370 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa25c068380 msgr2=0x7fa25c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:11.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.803+0000 7fa285600640 1 --2- 172.21.15.37:0/1884357370 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa25c068380 0x7fa25c06a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa270001810 tx=0x7fa270009040 comp rx=0 tx=0).stop 2024-05-30T06:42:11.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.803+0000 7fa285600640 1 -- 172.21.15.37:0/1884357370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28015cb40 msgr2=0x7fa28015eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:11.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.803+0000 7fa285600640 1 --2- 172.21.15.37:0/1884357370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28015cb40 0x7fa28015eac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa2780b2040 tx=0x7fa27801bfb0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.803+0000 7fa285600640 1 -- 172.21.15.37:0/1884357370 shutdown_connections 2024-05-30T06:42:11.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.803+0000 7fa285600640 1 --2- 172.21.15.37:0/1884357370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28015cb40 0x7fa28015eac0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.803+0000 7fa285600640 1 --2- 172.21.15.37:0/1884357370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015c760 0x7fa2801582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.803+0000 7fa285600640 1 --2- 172.21.15.37:0/1884357370 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa25c068380 0x7fa25c06a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.803+0000 7fa285600640 1 --2- 172.21.15.37:0/1884357370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2800d2130 0x7fa28015db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.803+0000 7fa285600640 1 -- 172.21.15.37:0/1884357370 >> 172.21.15.37:0/1884357370 conn(0x7fa2800d26e0 msgr2=0x7fa2800cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:11.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.803+0000 7fa285600640 1 -- 172.21.15.37:0/1884357370 shutdown_connections 2024-05-30T06:42:11.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.803+0000 7fa285600640 1 -- 172.21.15.37:0/1884357370 wait complete. 2024-05-30T06:42:11.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.963+0000 7fd3fce00640 1 Processor -- start 2024-05-30T06:42:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.963+0000 7fd3fce00640 1 -- start start 2024-05-30T06:42:11.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.963+0000 7fd3fce00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3f80b2ec0 0x7fd3f80b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:11.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.963+0000 7fd3fce00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f815c8f0 con 0x7fd3f8155e60 2024-05-30T06:42:11.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.963+0000 7fd3fce00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f80ccc80 con 0x7fd3f806f9a0 2024-05-30T06:42:11.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.963+0000 7fd3fce00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd3f80ccff0 con 0x7fd3f80b2ec0 2024-05-30T06:42:11.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.963+0000 7fd3f6800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3f80b2ec0 0x7fd3f80b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:11.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.963+0000 7fd3f5e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd3f8155e60 0x7fd3f80cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60698/0 (socket says 172.21.15.37:60698) 2024-05-30T06:42:11.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.963+0000 7fd3f5e00640 1 -- 172.21.15.37:0/4032510471 learned_addr learned my addr 172.21.15.37:0/4032510471 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:11.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.963+0000 7fd3f6800640 1 -- 172.21.15.37:0/4032510471 >> v1:172.21.15.105:6789/0 conn(0x7fd3f806f9a0 legacy=0x7fd3f80cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:11.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.963+0000 7fd3f6800640 1 -- 172.21.15.37:0/4032510471 >> v1:172.21.15.37:6789/0 conn(0x7fd3f8155e60 legacy=0x7fd3f80cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:11.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.963+0000 7fd3f6800640 1 -- 172.21.15.37:0/4032510471 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f815cbd0 con 0x7fd3f80b2ec0 2024-05-30T06:42:11.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.967+0000 7fd3f6800640 1 --2- 172.21.15.37:0/4032510471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f80b2ec0 0x7fd3f80b36a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009d90 tx=0x7fd3f001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7d2153423b173e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:11.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.967+0000 7fd3f4a00640 1 -- 172.21.15.37:0/4032510471 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00b2070 con 0x7fd3f80b2ec0 2024-05-30T06:42:11.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.967+0000 7fd3f4a00640 1 -- 172.21.15.37:0/4032510471 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f00a5900 con 0x7fd3f80b2ec0 2024-05-30T06:42:11.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.967+0000 7fd3f4a00640 1 -- 172.21.15.37:0/4032510471 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00a5cd0 con 0x7fd3f80b2ec0 2024-05-30T06:42:11.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.967+0000 7fd3fce00640 1 -- 172.21.15.37:0/4032510471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f80b2ec0 msgr2=0x7fd3f80b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:11.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.967+0000 7fd3fce00640 1 --2- 172.21.15.37:0/4032510471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f80b2ec0 0x7fd3f80b36a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009d90 tx=0x7fd3f001c970 comp rx=0 tx=0).stop 2024-05-30T06:42:11.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.967+0000 7fd3fce00640 1 -- 172.21.15.37:0/4032510471 shutdown_connections 2024-05-30T06:42:11.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.967+0000 7fd3fce00640 1 --2- 172.21.15.37:0/4032510471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f80b2ec0 0x7fd3f80b36a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.967+0000 7fd3fce00640 1 -- 172.21.15.37:0/4032510471 >> 172.21.15.37:0/4032510471 conn(0x7fd3f80b23a0 msgr2=0x7fd3f80b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:11.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.967+0000 7fd3fce00640 1 -- 172.21.15.37:0/4032510471 shutdown_connections 2024-05-30T06:42:11.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.967+0000 7fd3fce00640 1 -- 172.21.15.37:0/4032510471 wait complete. 2024-05-30T06:42:11.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.967+0000 7fd3fce00640 1 Processor -- start 2024-05-30T06:42:11.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.967+0000 7fd3fce00640 1 -- start start 2024-05-30T06:42:11.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3fce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f806f9a0 0x7fd3f8149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:11.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3fce00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f80b2ec0 0x7fd3f80b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:11.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3fce00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f8155e60 0x7fd3f81383f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:11.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3fce00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f8169a00 con 0x7fd3f806f9a0 2024-05-30T06:42:11.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3fce00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f8169880 con 0x7fd3f8155e60 2024-05-30T06:42:11.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3fce00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f8169b80 con 0x7fd3f80b2ec0 2024-05-30T06:42:11.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3f5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f806f9a0 0x7fd3f8149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:11.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3f5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f806f9a0 0x7fd3f8149cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60276/0 (socket says 172.21.15.37:60276) 2024-05-30T06:42:11.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3f5e00640 1 -- 172.21.15.37:0/919089130 learned_addr learned my addr 172.21.15.37:0/919089130 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:11.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3f6800640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f8155e60 0x7fd3f81383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3f5400640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f80b2ec0 0x7fd3f80b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3f5e00640 1 -- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f80b2ec0 msgr2=0x7fd3f80b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3f5e00640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f80b2ec0 0x7fd3f80b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3f5e00640 1 -- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f8155e60 msgr2=0x7fd3f81383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3f5e00640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f8155e60 0x7fd3f81383f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3f5e00640 1 -- 172.21.15.37:0/919089130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f80b0be0 con 0x7fd3f806f9a0 2024-05-30T06:42:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3f5e00640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f806f9a0 0x7fd3f8149cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800c400 tx=0x7fd3e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3ee000640 1 -- 172.21.15.37:0/919089130 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8017070 con 0x7fd3f806f9a0 2024-05-30T06:42:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3ee000640 1 -- 172.21.15.37:0/919089130 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3e8005cf0 con 0x7fd3f806f9a0 2024-05-30T06:42:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3fce00640 1 -- 172.21.15.37:0/919089130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f8138cf0 con 0x7fd3f806f9a0 2024-05-30T06:42:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3ee000640 1 -- 172.21.15.37:0/919089130 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e80072d0 con 0x7fd3f806f9a0 2024-05-30T06:42:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3fce00640 1 -- 172.21.15.37:0/919089130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f8139270 con 0x7fd3f806f9a0 2024-05-30T06:42:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.971+0000 7fd3fce00640 1 -- 172.21.15.37:0/919089130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3f8068b20 con 0x7fd3f806f9a0 2024-05-30T06:42:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.975+0000 7fd3ee000640 1 -- 172.21.15.37:0/919089130 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd3e801a070 con 0x7fd3f806f9a0 2024-05-30T06:42:11.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.975+0000 7fd3ee000640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd3d8068380 0x7fd3d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.975+0000 7fd3ee000640 1 -- 172.21.15.37:0/919089130 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fd3e8085c40 con 0x7fd3f806f9a0 2024-05-30T06:42:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.975+0000 7fd3f5400640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd3d8068380 0x7fd3d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:11.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.975+0000 7fd3f5400640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd3d8068380 0x7fd3d806a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3f814aa00 tx=0x7fd3e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:11.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:11.979+0000 7fd3ee000640 1 -- 172.21.15.37:0/919089130 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd3f80b0be0 con 0x7fd3f806f9a0 2024-05-30T06:42:12.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.143+0000 7fd3fce00640 1 -- 172.21.15.37:0/919089130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3f806e340 con 0x7fd3f806f9a0 2024-05-30T06:42:12.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.143+0000 7fd3ee000640 1 -- 172.21.15.37:0/919089130 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16606 (secure 0 0 0) 0x7fd3e8055ba0 con 0x7fd3f806f9a0 2024-05-30T06:42:12.143 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:12.144 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:10.805309+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.147+0000 7fd3fce00640 1 -- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd3d8068380 msgr2=0x7fd3d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.147+0000 7fd3fce00640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd3d8068380 0x7fd3d806a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3f814aa00 tx=0x7fd3e4009040 comp rx=0 tx=0).stop 2024-05-30T06:42:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.147+0000 7fd3fce00640 1 -- 172.21.15.37:0/919089130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f806f9a0 msgr2=0x7fd3f8149cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.147+0000 7fd3fce00640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f806f9a0 0x7fd3f8149cc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800c400 tx=0x7fd3e800c8c0 comp rx=0 tx=0).stop 2024-05-30T06:42:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.147+0000 7fd3fce00640 1 -- 172.21.15.37:0/919089130 shutdown_connections 2024-05-30T06:42:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.147+0000 7fd3fce00640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd3d8068380 0x7fd3d806a840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.147+0000 7fd3fce00640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3f8155e60 0x7fd3f81383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.147+0000 7fd3fce00640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3f80b2ec0 0x7fd3f80b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.147+0000 7fd3fce00640 1 --2- 172.21.15.37:0/919089130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3f806f9a0 0x7fd3f8149cc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.147+0000 7fd3fce00640 1 -- 172.21.15.37:0/919089130 >> 172.21.15.37:0/919089130 conn(0x7fd3f80b23a0 msgr2=0x7fd3f80b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.147+0000 7fd3fce00640 1 -- 172.21.15.37:0/919089130 shutdown_connections 2024-05-30T06:42:12.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.147+0000 7fd3fce00640 1 -- 172.21.15.37:0/919089130 wait complete. 2024-05-30T06:42:12.165 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T06:42:12.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed31a00640 1 Processor -- start 2024-05-30T06:42:12.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed31a00640 1 -- start start 2024-05-30T06:42:12.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed31a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fed2c15e8b0 0x7fed2c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:12.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed31a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed2c0d1ad0 0x7fed2c06d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:12.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed31a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed2c163350 con 0x7fed2c06d200 2024-05-30T06:42:12.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed31a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fed2c06db80 con 0x7fed2c15e8b0 2024-05-30T06:42:12.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed31a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fed2c0cfb30 con 0x7fed2c0d1ad0 2024-05-30T06:42:12.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed22000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fed2c06d200 0x7fed2c09aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60708/0 (socket says 172.21.15.37:60708) 2024-05-30T06:42:12.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed22000640 1 -- 172.21.15.37:0/203549786 learned_addr learned my addr 172.21.15.37:0/203549786 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2b400640 1 --2- 172.21.15.37:0/203549786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed2c0d1ad0 0x7fed2c06d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2aa00640 1 --2- 172.21.15.37:0/203549786 >> v2:172.21.15.105:3300/0 conn(0x7fed2c15e8b0 0x7fed2c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260758139 0 0) 0x7fed2c163350 con 0x7fed2c06d200 2024-05-30T06:42:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed10003530 con 0x7fed2c06d200 2024-05-30T06:42:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3980363420 0 0) 0x7fed10003530 con 0x7fed2c06d200 2024-05-30T06:42:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed2c0d1ad0 msgr2=0x7fed2c06d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 --2- 172.21.15.37:0/203549786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed2c0d1ad0 0x7fed2c06d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 >> v2:172.21.15.105:3300/0 conn(0x7fed2c15e8b0 msgr2=0x7fed2c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 --2- 172.21.15.37:0/203549786 >> v2:172.21.15.105:3300/0 conn(0x7fed2c15e8b0 0x7fed2c0cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c1627d0 con 0x7fed2c06d200 2024-05-30T06:42:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fed14001680 con 0x7fed2c06d200 2024-05-30T06:42:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 >> v1:172.21.15.37:6789/0 conn(0x7fed2c06d200 legacy=0x7fed2c09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 --2- 172.21.15.37:0/203549786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed100039c0 0x7fed10003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 --2- 172.21.15.37:0/203549786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed10004810 0x7fed10004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 --2- 172.21.15.37:0/203549786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed2c0d1ad0 0x7fed100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c06db80 con 0x7fed100039c0 2024-05-30T06:42:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c0cfb30 con 0x7fed10004810 2024-05-30T06:42:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fed1000b9d0 con 0x7fed2c0d1ad0 2024-05-30T06:42:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2aa00640 1 --2- 172.21.15.37:0/203549786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed100039c0 0x7fed10003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2b400640 1 --2- 172.21.15.37:0/203549786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed2c0d1ad0 0x7fed100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed22000640 1 --2- 172.21.15.37:0/203549786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed10004810 0x7fed10004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2aa00640 1 -- 172.21.15.37:0/203549786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed2c0d1ad0 msgr2=0x7fed100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2aa00640 1 --2- 172.21.15.37:0/203549786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed2c0d1ad0 0x7fed100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2aa00640 1 -- 172.21.15.37:0/203549786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed10004810 msgr2=0x7fed10004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2aa00640 1 --2- 172.21.15.37:0/203549786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed10004810 0x7fed10004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:12.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.311+0000 7fed2aa00640 1 -- 172.21.15.37:0/203549786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed10003530 con 0x7fed100039c0 2024-05-30T06:42:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.315+0000 7fed2aa00640 1 --2- 172.21.15.37:0/203549786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed100039c0 0x7fed10003de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009ae0 tx=0x7fed1c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfe3b536fdaa811 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.315+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c0096b0 con 0x7fed100039c0 2024-05-30T06:42:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.315+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1c0a8410 con 0x7fed100039c0 2024-05-30T06:42:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.315+0000 7fed2a000640 1 -- 172.21.15.37:0/203549786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c0a8800 con 0x7fed100039c0 2024-05-30T06:42:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.315+0000 7fed31a00640 1 -- 172.21.15.37:0/203549786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed100039c0 msgr2=0x7fed10003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.315+0000 7fed31a00640 1 --2- 172.21.15.37:0/203549786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed100039c0 0x7fed10003de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009ae0 tx=0x7fed1c01cab0 comp rx=0 tx=0).stop 2024-05-30T06:42:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.315+0000 7fed2b400640 1 -- 172.21.15.37:0/203549786 reap_dead start 2024-05-30T06:42:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.315+0000 7fed31a00640 1 -- 172.21.15.37:0/203549786 shutdown_connections 2024-05-30T06:42:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.315+0000 7fed31a00640 1 -- 172.21.15.37:0/203549786 >> 172.21.15.37:0/203549786 conn(0x7fed2c0b4130 msgr2=0x7fed2c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.315+0000 7fed31a00640 1 -- 172.21.15.37:0/203549786 shutdown_connections 2024-05-30T06:42:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.315+0000 7fed31a00640 1 -- 172.21.15.37:0/203549786 wait complete. 2024-05-30T06:42:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed31a00640 1 Processor -- start 2024-05-30T06:42:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed31a00640 1 -- start start 2024-05-30T06:42:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed31a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed100039c0 0x7fed2c15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:12.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed31a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed2c15d630 0x7fed2c0b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:12.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed31a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed2c0b3320 0x7fed2c0b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:12.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed31a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c162480 con 0x7fed2c15d630 2024-05-30T06:42:12.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed31a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c15ec90 con 0x7fed100039c0 2024-05-30T06:42:12.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed31a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fed2c0cf050 con 0x7fed2c0b3320 2024-05-30T06:42:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed22000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed2c15d630 0x7fed2c0b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed2aa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed100039c0 0x7fed2c15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed22000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed2c15d630 0x7fed2c0b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60292/0 (socket says 172.21.15.37:60292) 2024-05-30T06:42:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed22000640 1 -- 172.21.15.37:0/738783356 learned_addr learned my addr 172.21.15.37:0/738783356 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed2b400640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed2c0b3320 0x7fed2c0b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed22000640 1 -- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed2c0b3320 msgr2=0x7fed2c0b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed22000640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed2c0b3320 0x7fed2c0b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed22000640 1 -- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed100039c0 msgr2=0x7fed2c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed22000640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed100039c0 0x7fed2c15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed22000640 1 -- 172.21.15.37:0/738783356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c15dab0 con 0x7fed2c15d630 2024-05-30T06:42:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed2aa00640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed100039c0 0x7fed2c15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed22000640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed2c15d630 0x7fed2c0b0f00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed14007fb0 tx=0x7fed140074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed23400640 1 -- 172.21.15.37:0/738783356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed14007740 con 0x7fed2c15d630 2024-05-30T06:42:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed23400640 1 -- 172.21.15.37:0/738783356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed14018070 con 0x7fed2c15d630 2024-05-30T06:42:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed23400640 1 -- 172.21.15.37:0/738783356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1400fc00 con 0x7fed2c15d630 2024-05-30T06:42:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed31a00640 1 -- 172.21.15.37:0/738783356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2c15c5b0 con 0x7fed2c15d630 2024-05-30T06:42:12.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.319+0000 7fed31a00640 1 -- 172.21.15.37:0/738783356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed2c15cb70 con 0x7fed2c15d630 2024-05-30T06:42:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.323+0000 7fed31a00640 1 -- 172.21.15.37:0/738783356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2c068bc0 con 0x7fed2c15d630 2024-05-30T06:42:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.323+0000 7fed23400640 1 -- 172.21.15.37:0/738783356 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fed1401d460 con 0x7fed2c15d630 2024-05-30T06:42:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.323+0000 7fed23400640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed08068380 0x7fed0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.323+0000 7fed23400640 1 -- 172.21.15.37:0/738783356 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fed14086950 con 0x7fed2c15d630 2024-05-30T06:42:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.323+0000 7fed2aa00640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed08068380 0x7fed0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.323+0000 7fed2aa00640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed08068380 0x7fed0806a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0af000 tx=0x7fed1c0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:12.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.327+0000 7fed23400640 1 -- 172.21.15.37:0/738783356 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed2c15dab0 con 0x7fed2c15d630 2024-05-30T06:42:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:12.531+0000 7fed31a00640 1 -- 172.21.15.37:0/738783356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fed2c160960 con 0x7fed2c15d630 2024-05-30T06:42:13.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.447+0000 7fed23400640 1 -- 172.21.15.37:0/738783356 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fed14056820 con 0x7fed2c15d630 2024-05-30T06:42:13.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.451+0000 7fed31a00640 1 -- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed08068380 msgr2=0x7fed0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:13.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.451+0000 7fed31a00640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed08068380 0x7fed0806a840 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0af000 tx=0x7fed1c0046d0 comp rx=0 tx=0).stop 2024-05-30T06:42:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.451+0000 7fed31a00640 1 -- 172.21.15.37:0/738783356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed2c15d630 msgr2=0x7fed2c0b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.451+0000 7fed31a00640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed2c15d630 0x7fed2c0b0f00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed14007fb0 tx=0x7fed140074f0 comp rx=0 tx=0).stop 2024-05-30T06:42:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.451+0000 7fed31a00640 1 -- 172.21.15.37:0/738783356 shutdown_connections 2024-05-30T06:42:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.451+0000 7fed31a00640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed2c0b3320 0x7fed2c0b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.451+0000 7fed31a00640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed2c15d630 0x7fed2c0b0f00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.451+0000 7fed31a00640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed08068380 0x7fed0806a840 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.451+0000 7fed31a00640 1 --2- 172.21.15.37:0/738783356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed100039c0 0x7fed2c15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.451+0000 7fed31a00640 1 -- 172.21.15.37:0/738783356 >> 172.21.15.37:0/738783356 conn(0x7fed2c0b4130 msgr2=0x7fed2c160fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.451+0000 7fed31a00640 1 -- 172.21.15.37:0/738783356 shutdown_connections 2024-05-30T06:42:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.451+0000 7fed31a00640 1 -- 172.21.15.37:0/738783356 wait complete. 2024-05-30T06:42:13.473 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T06:42:13.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T06:42:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.623+0000 7fd6d2600640 1 Processor -- start 2024-05-30T06:42:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.623+0000 7fd6d2600640 1 -- start start 2024-05-30T06:42:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.623+0000 7fd6d2600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6cc15e8b0 0x7fd6cc0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.623+0000 7fd6d2600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6cc163350 con 0x7fd6cc0d1ad0 2024-05-30T06:42:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.623+0000 7fd6d2600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6cc0cfb30 con 0x7fd6cc06d200 2024-05-30T06:42:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.623+0000 7fd6d2600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd6cc09b880 con 0x7fd6cc15e8b0 2024-05-30T06:42:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.623+0000 7fd6cb400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6cc15e8b0 0x7fd6cc0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.623+0000 7fd6cbe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd6cc0d1ad0 0x7fd6cc09b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60720/0 (socket says 172.21.15.37:60720) 2024-05-30T06:42:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.623+0000 7fd6cbe00640 1 -- 172.21.15.37:0/1401077680 learned_addr learned my addr 172.21.15.37:0/1401077680 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.623+0000 7fd6cb400640 1 -- 172.21.15.37:0/1401077680 >> v1:172.21.15.105:6789/0 conn(0x7fd6cc06d200 legacy=0x7fd6cc09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.623+0000 7fd6cb400640 1 -- 172.21.15.37:0/1401077680 >> v1:172.21.15.37:6789/0 conn(0x7fd6cc0d1ad0 legacy=0x7fd6cc09b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.623+0000 7fd6cb400640 1 -- 172.21.15.37:0/1401077680 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc1627d0 con 0x7fd6cc15e8b0 2024-05-30T06:42:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.623+0000 7fd6caa00640 1 -- 172.21.15.37:0/1401077680 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3509225481 0 0) 0x7fd6cc163350 con 0x7fd6cc0d1ad0 2024-05-30T06:42:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.627+0000 7fd6cb400640 1 --2- 172.21.15.37:0/1401077680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc15e8b0 0x7fd6cc0cf5f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0097c0 tx=0x7fd6bc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2690600e06e398e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.627+0000 7fd6caa00640 1 -- 172.21.15.37:0/1401077680 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0b0070 con 0x7fd6cc15e8b0 2024-05-30T06:42:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.627+0000 7fd6caa00640 1 -- 172.21.15.37:0/1401077680 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6bc004230 con 0x7fd6cc15e8b0 2024-05-30T06:42:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.627+0000 7fd6caa00640 1 -- 172.21.15.37:0/1401077680 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc003620 con 0x7fd6cc15e8b0 2024-05-30T06:42:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.627+0000 7fd6d2600640 1 -- 172.21.15.37:0/1401077680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc15e8b0 msgr2=0x7fd6cc0cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.627+0000 7fd6d2600640 1 --2- 172.21.15.37:0/1401077680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc15e8b0 0x7fd6cc0cf5f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0097c0 tx=0x7fd6bc01c460 comp rx=0 tx=0).stop 2024-05-30T06:42:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.627+0000 7fd6d2600640 1 -- 172.21.15.37:0/1401077680 shutdown_connections 2024-05-30T06:42:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.627+0000 7fd6d2600640 1 --2- 172.21.15.37:0/1401077680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc15e8b0 0x7fd6cc0cf5f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.627+0000 7fd6d2600640 1 -- 172.21.15.37:0/1401077680 >> 172.21.15.37:0/1401077680 conn(0x7fd6cc0b4130 msgr2=0x7fd6cc0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.627+0000 7fd6d2600640 1 -- 172.21.15.37:0/1401077680 shutdown_connections 2024-05-30T06:42:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.627+0000 7fd6d2600640 1 -- 172.21.15.37:0/1401077680 wait complete. 2024-05-30T06:42:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6d2600640 1 Processor -- start 2024-05-30T06:42:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6d2600640 1 -- start start 2024-05-30T06:42:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6d2600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6cc06d200 0x7fd6cc0c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6d2600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc0d1ad0 0x7fd6cc0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6d2600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6cc15e8b0 0x7fd6cc153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6d2600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc162480 con 0x7fd6cc0d1ad0 2024-05-30T06:42:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6d2600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc15ec90 con 0x7fd6cc15e8b0 2024-05-30T06:42:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6d2600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd6cc0cf050 con 0x7fd6cc06d200 2024-05-30T06:42:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6c2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc0d1ad0 0x7fd6cc0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6c2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc0d1ad0 0x7fd6cc0b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60316/0 (socket says 172.21.15.37:60316) 2024-05-30T06:42:13.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6c2a00640 1 -- 172.21.15.37:0/607818899 learned_addr learned my addr 172.21.15.37:0/607818899 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6cbe00640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6cc15e8b0 0x7fd6cc153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6cb400640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6cc06d200 0x7fd6cc0c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6c2a00640 1 -- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6cc06d200 msgr2=0x7fd6cc0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6c2a00640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6cc06d200 0x7fd6cc0c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6c2a00640 1 -- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6cc15e8b0 msgr2=0x7fd6cc153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6c2a00640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6cc15e8b0 0x7fd6cc153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6c2a00640 1 -- 172.21.15.37:0/607818899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc0b2f70 con 0x7fd6cc0d1ad0 2024-05-30T06:42:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6cb400640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6cc06d200 0x7fd6cc0c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6cbe00640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6cc15e8b0 0x7fd6cc153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:13.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6c2a00640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc0d1ad0 0x7fd6cc0b2520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400c450 tx=0x7fd6b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6c3e00640 1 -- 172.21.15.37:0/607818899 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4012830 con 0x7fd6cc0d1ad0 2024-05-30T06:42:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6c3e00640 1 -- 172.21.15.37:0/607818899 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b4017070 con 0x7fd6cc0d1ad0 2024-05-30T06:42:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6c3e00640 1 -- 172.21.15.37:0/607818899 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4012c30 con 0x7fd6cc0d1ad0 2024-05-30T06:42:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6d2600640 1 -- 172.21.15.37:0/607818899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6cc0b3250 con 0x7fd6cc0d1ad0 2024-05-30T06:42:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6d2600640 1 -- 172.21.15.37:0/607818899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6cc0b5ba0 con 0x7fd6cc0d1ad0 2024-05-30T06:42:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.631+0000 7fd6d2600640 1 -- 172.21.15.37:0/607818899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6cc068bc0 con 0x7fd6cc0d1ad0 2024-05-30T06:42:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.635+0000 7fd6c3e00640 1 -- 172.21.15.37:0/607818899 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd6b401c460 con 0x7fd6cc0d1ad0 2024-05-30T06:42:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.635+0000 7fd6c3e00640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd6a8068380 0x7fd6a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.635+0000 7fd6c3e00640 1 -- 172.21.15.37:0/607818899 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd6b4086890 con 0x7fd6cc0d1ad0 2024-05-30T06:42:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.635+0000 7fd6cb400640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd6a8068380 0x7fd6a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.635+0000 7fd6cb400640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd6a8068380 0x7fd6a806a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0ad000 tx=0x7fd6bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.639+0000 7fd6c3e00640 1 -- 172.21.15.37:0/607818899 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd6b4056db0 con 0x7fd6cc0d1ad0 2024-05-30T06:42:13.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:13.843+0000 7fd6d2600640 1 -- 172.21.15.37:0/607818899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd6cc0cca40 con 0x7fd6cc0d1ad0 2024-05-30T06:42:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.451+0000 7fd6c3e00640 1 -- 172.21.15.37:0/607818899 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fd6b40566b0 con 0x7fd6cc0d1ad0 2024-05-30T06:42:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.451+0000 7fd6d2600640 1 -- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd6a8068380 msgr2=0x7fd6a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.451+0000 7fd6d2600640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd6a8068380 0x7fd6a806a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0ad000 tx=0x7fd6bc008040 comp rx=0 tx=0).stop 2024-05-30T06:42:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.451+0000 7fd6d2600640 1 -- 172.21.15.37:0/607818899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc0d1ad0 msgr2=0x7fd6cc0b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.451+0000 7fd6d2600640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc0d1ad0 0x7fd6cc0b2520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400c450 tx=0x7fd6b400c910 comp rx=0 tx=0).stop 2024-05-30T06:42:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.451+0000 7fd6d2600640 1 -- 172.21.15.37:0/607818899 shutdown_connections 2024-05-30T06:42:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.451+0000 7fd6d2600640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd6a8068380 0x7fd6a806a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.451+0000 7fd6d2600640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6cc15e8b0 0x7fd6cc153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.451+0000 7fd6d2600640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6cc0d1ad0 0x7fd6cc0b2520 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.451+0000 7fd6d2600640 1 --2- 172.21.15.37:0/607818899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6cc06d200 0x7fd6cc0c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.451+0000 7fd6d2600640 1 -- 172.21.15.37:0/607818899 >> 172.21.15.37:0/607818899 conn(0x7fd6cc0b4130 msgr2=0x7fd6cc161760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.451+0000 7fd6d2600640 1 -- 172.21.15.37:0/607818899 shutdown_connections 2024-05-30T06:42:14.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.451+0000 7fd6d2600640 1 -- 172.21.15.37:0/607818899 wait complete. 2024-05-30T06:42:14.475 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T06:42:14.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:42:14.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.619+0000 7f18b8e00640 1 Processor -- start 2024-05-30T06:42:14.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.623+0000 7f18b8e00640 1 -- start start 2024-05-30T06:42:14.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.623+0000 7f18b8e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f18b4144f00 0x7f18b40b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:14.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.623+0000 7f18b8e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18b40cd790 0x7f18b406f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.623+0000 7f18b8e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18b4072e30 con 0x7f18b406ef30 2024-05-30T06:42:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.623+0000 7f18b8e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f18b406f8d0 con 0x7f18b40cd790 2024-05-30T06:42:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.623+0000 7f18b8e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f18b40cdc60 con 0x7f18b4144f00 2024-05-30T06:42:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.623+0000 7f18b3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18b40cd790 0x7f18b406f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.623+0000 7f18b3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18b40cd790 0x7f18b406f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60320/0 (socket says 172.21.15.37:60320) 2024-05-30T06:42:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.623+0000 7f18b3e00640 1 -- 172.21.15.37:0/4033938003 learned_addr learned my addr 172.21.15.37:0/4033938003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.623+0000 7f18b3e00640 1 -- 172.21.15.37:0/4033938003 >> v2:172.21.15.105:3300/0 conn(0x7f18b4144f00 msgr2=0x7f18b40b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.623+0000 7f18b3e00640 1 --2- 172.21.15.37:0/4033938003 >> v2:172.21.15.105:3300/0 conn(0x7f18b4144f00 0x7f18b40b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.623+0000 7f18b3e00640 1 -- 172.21.15.37:0/4033938003 >> v1:172.21.15.105:6789/0 conn(0x7f18b406ef30 legacy=0x7f18b40cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.623+0000 7f18b3e00640 1 -- 172.21.15.37:0/4033938003 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b40b3b50 con 0x7f18b40cd790 2024-05-30T06:42:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b3e00640 1 --2- 172.21.15.37:0/4033938003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b40cd790 0x7f18b406f390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f18b40b31e0 tx=0x7f18ac01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96628273613d35b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:14.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b2000640 1 -- 172.21.15.37:0/4033938003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0a55d0 con 0x7f18b40cd790 2024-05-30T06:42:14.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b2000640 1 -- 172.21.15.37:0/4033938003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac0a5770 con 0x7f18b40cd790 2024-05-30T06:42:14.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b2000640 1 -- 172.21.15.37:0/4033938003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0a5b40 con 0x7f18b40cd790 2024-05-30T06:42:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b8e00640 1 -- 172.21.15.37:0/4033938003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b40cd790 msgr2=0x7f18b406f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b8e00640 1 --2- 172.21.15.37:0/4033938003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b40cd790 0x7f18b406f390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f18b40b31e0 tx=0x7f18ac01c710 comp rx=0 tx=0).stop 2024-05-30T06:42:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b8e00640 1 -- 172.21.15.37:0/4033938003 shutdown_connections 2024-05-30T06:42:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b8e00640 1 --2- 172.21.15.37:0/4033938003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b40cd790 0x7f18b406f390 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b8e00640 1 --2- 172.21.15.37:0/4033938003 >> v2:172.21.15.105:3300/0 conn(0x7f18b4144f00 0x7f18b40b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b8e00640 1 -- 172.21.15.37:0/4033938003 >> 172.21.15.37:0/4033938003 conn(0x7f18b40b2120 msgr2=0x7f18b40b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b8e00640 1 -- 172.21.15.37:0/4033938003 shutdown_connections 2024-05-30T06:42:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b8e00640 1 -- 172.21.15.37:0/4033938003 wait complete. 2024-05-30T06:42:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b8e00640 1 Processor -- start 2024-05-30T06:42:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.627+0000 7f18b8e00640 1 -- start start 2024-05-30T06:42:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b8e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18b406ef30 0x7f18b413aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b8e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18b40cd790 0x7f18b413b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b4144f00 0x7f18b4139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b8e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18b415c290 con 0x7f18b4144f00 2024-05-30T06:42:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b8e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f18b40b4e50 con 0x7f18b406ef30 2024-05-30T06:42:14.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b8e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f18b415c410 con 0x7f18b40cd790 2024-05-30T06:42:14.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b4144f00 0x7f18b4139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:14.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b4144f00 0x7f18b4139490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60330/0 (socket says 172.21.15.37:60330) 2024-05-30T06:42:14.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b3e00640 1 -- 172.21.15.37:0/391629425 learned_addr learned my addr 172.21.15.37:0/391629425 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b3e00640 1 -- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18b40cd790 msgr2=0x7f18b413b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b3e00640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18b40cd790 0x7f18b413b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b3e00640 1 -- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18b406ef30 msgr2=0x7f18b413aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b3400640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18b406ef30 0x7f18b413aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b3e00640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18b406ef30 0x7f18b413aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b3e00640 1 -- 172.21.15.37:0/391629425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b413a150 con 0x7f18b4144f00 2024-05-30T06:42:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b3400640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18b406ef30 0x7f18b413aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b3e00640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b4144f00 0x7f18b4139490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f18ac01a340 tx=0x7f18ac0194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18ab400640 1 -- 172.21.15.37:0/391629425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0bc020 con 0x7f18b4144f00 2024-05-30T06:42:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18ab400640 1 -- 172.21.15.37:0/391629425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac0b8670 con 0x7f18b4144f00 2024-05-30T06:42:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18ab400640 1 -- 172.21.15.37:0/391629425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0b8a40 con 0x7f18b4144f00 2024-05-30T06:42:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b8e00640 1 -- 172.21.15.37:0/391629425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b413a430 con 0x7f18b4144f00 2024-05-30T06:42:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b8e00640 1 -- 172.21.15.37:0/391629425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b413ccf0 con 0x7f18b4144f00 2024-05-30T06:42:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18b8e00640 1 -- 172.21.15.37:0/391629425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b4068ab0 con 0x7f18b4144f00 2024-05-30T06:42:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.631+0000 7f18ab400640 1 -- 172.21.15.37:0/391629425 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18ac0bf020 con 0x7f18b4144f00 2024-05-30T06:42:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.635+0000 7f18ab400640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1894068380 0x7f189406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.635+0000 7f18ab400640 1 -- 172.21.15.37:0/391629425 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f18ac121a50 con 0x7f18b4144f00 2024-05-30T06:42:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.635+0000 7f18b3400640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1894068380 0x7f189406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.635+0000 7f18b3400640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1894068380 0x7f189406a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18b415cf10 tx=0x7f18a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.639+0000 7f18ab400640 1 -- 172.21.15.37:0/391629425 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f18ac0c6030 con 0x7f18b4144f00 2024-05-30T06:42:14.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.835+0000 7f18b8e00640 1 -- 172.21.15.37:0/391629425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18b415c980 con 0x7f18b4144f00 2024-05-30T06:42:14.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.835+0000 7f18ab400640 1 -- 172.21.15.37:0/391629425 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f18b4072e30 con 0x7f18b4144f00 2024-05-30T06:42:14.837 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:14.837 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2950341560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2950341560},{"type":"v1","addr":"172.21.15.37:6835","nonce":2950341560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/1458371524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1458371524},{"type":"v1","addr":"172.21.15.105:6836","nonce":1458371524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4088854019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4088854019},{"type":"v1","addr":"172.21.15.37:6833","nonce":4088854019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:42:10.805274+0000","modified":"2024-05-30T06:42:13.844990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2952122373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2952122373},{"type":"v1","addr":"172.21.15.105:6837","nonce":2952122373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-05-30T06:42:14.837 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-05-30T06:42:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.839+0000 7f18b8e00640 1 -- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1894068380 msgr2=0x7f189406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.839+0000 7f18b8e00640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1894068380 0x7f189406a840 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18b415cf10 tx=0x7f18a4008040 comp rx=0 tx=0).stop 2024-05-30T06:42:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.839+0000 7f18b8e00640 1 -- 172.21.15.37:0/391629425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b4144f00 msgr2=0x7f18b4139490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.839+0000 7f18b8e00640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b4144f00 0x7f18b4139490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f18ac01a340 tx=0x7f18ac0194b0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.839+0000 7f18b8e00640 1 -- 172.21.15.37:0/391629425 shutdown_connections 2024-05-30T06:42:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.839+0000 7f18b8e00640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18b4144f00 0x7f18b4139490 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.839+0000 7f18b8e00640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18b40cd790 0x7f18b413b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.839+0000 7f18b8e00640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1894068380 0x7f189406a840 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.839+0000 7f18b8e00640 1 --2- 172.21.15.37:0/391629425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18b406ef30 0x7f18b413aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.839+0000 7f18b8e00640 1 -- 172.21.15.37:0/391629425 >> 172.21.15.37:0/391629425 conn(0x7f18b40b2120 msgr2=0x7f18b41439a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.839+0000 7f18b8e00640 1 -- 172.21.15.37:0/391629425 shutdown_connections 2024-05-30T06:42:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.839+0000 7f18b8e00640 1 -- 172.21.15.37:0/391629425 wait complete. 2024-05-30T06:42:14.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98bd800640 1 Processor -- start 2024-05-30T06:42:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98bd800640 1 -- start start 2024-05-30T06:42:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98bd800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98b815e930 0x7f98b809b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98bd800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b8162cb0 0x7f98b80ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98bd800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b809abe0 con 0x7f98b80d1240 2024-05-30T06:42:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98bd800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f98b809bee0 con 0x7f98b815e930 2024-05-30T06:42:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98bd800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f98b809aec0 con 0x7f98b8162cb0 2024-05-30T06:42:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98ae000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f98b80d1240 0x7f98b81625a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60724/0 (socket says 172.21.15.37:60724) 2024-05-30T06:42:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98ae000640 1 -- 172.21.15.37:0/3922029827 learned_addr learned my addr 172.21.15.37:0/3922029827 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98b6a00640 1 --2- 172.21.15.37:0/3922029827 >> v2:172.21.15.37:3300/0 conn(0x7f98b815e930 0x7f98b809b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98b7400640 1 --2- 172.21.15.37:0/3922029827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b8162cb0 0x7f98b80ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98b6a00640 1 -- 172.21.15.37:0/3922029827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b8162cb0 msgr2=0x7f98b80ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98b6a00640 1 --2- 172.21.15.37:0/3922029827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b8162cb0 0x7f98b80ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98b6a00640 1 -- 172.21.15.37:0/3922029827 >> v1:172.21.15.37:6789/0 conn(0x7f98b80d1240 legacy=0x7f98b81625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98b6a00640 1 -- 172.21.15.37:0/3922029827 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b809b1a0 con 0x7f98b815e930 2024-05-30T06:42:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:14.999+0000 7f98b6000640 1 -- 172.21.15.37:0/3922029827 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184929277 0 0) 0x7f98b809abe0 con 0x7f98b80d1240 2024-05-30T06:42:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.003+0000 7f98b6a00640 1 --2- 172.21.15.37:0/3922029827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b815e930 0x7f98b809b9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f98a80097c0 tx=0x7f98a801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310e0985dcef085a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.003+0000 7f98b6000640 1 -- 172.21.15.37:0/3922029827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a80b0070 con 0x7f98b815e930 2024-05-30T06:42:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.003+0000 7f98b6000640 1 -- 172.21.15.37:0/3922029827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a80ab600 con 0x7f98b815e930 2024-05-30T06:42:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.003+0000 7f98b6000640 1 -- 172.21.15.37:0/3922029827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a80ab9d0 con 0x7f98b815e930 2024-05-30T06:42:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.003+0000 7f98bd800640 1 -- 172.21.15.37:0/3922029827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b815e930 msgr2=0x7f98b809b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.003+0000 7f98bd800640 1 --2- 172.21.15.37:0/3922029827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b815e930 0x7f98b809b9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f98a80097c0 tx=0x7f98a801c4a0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.003+0000 7f98bd800640 1 -- 172.21.15.37:0/3922029827 shutdown_connections 2024-05-30T06:42:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.003+0000 7f98bd800640 1 --2- 172.21.15.37:0/3922029827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b8162cb0 0x7f98b80ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.003+0000 7f98bd800640 1 --2- 172.21.15.37:0/3922029827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b815e930 0x7f98b809b9a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.003+0000 7f98bd800640 1 -- 172.21.15.37:0/3922029827 >> 172.21.15.37:0/3922029827 conn(0x7f98b80b4100 msgr2=0x7f98b80b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.003+0000 7f98bd800640 1 -- 172.21.15.37:0/3922029827 shutdown_connections 2024-05-30T06:42:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.003+0000 7f98bd800640 1 -- 172.21.15.37:0/3922029827 wait complete. 2024-05-30T06:42:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98bd800640 1 Processor -- start 2024-05-30T06:42:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98bd800640 1 -- start start 2024-05-30T06:42:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98bd800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b80d1240 0x7f98b80c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98bd800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815e930 0x7f98b80b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98bd800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b8162cb0 0x7f98b80b0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98bd800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f98b816bac0 con 0x7f98b80d1240 2024-05-30T06:42:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98bd800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f98b816b940 con 0x7f98b8162cb0 2024-05-30T06:42:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98bd800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f98b816bc40 con 0x7f98b815e930 2024-05-30T06:42:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98b6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b80d1240 0x7f98b80c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98b6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b80d1240 0x7f98b80c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60348/0 (socket says 172.21.15.37:60348) 2024-05-30T06:42:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98b6a00640 1 -- 172.21.15.37:0/2290171364 learned_addr learned my addr 172.21.15.37:0/2290171364 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98ae000640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815e930 0x7f98b80b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98b6a00640 1 -- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815e930 msgr2=0x7f98b80b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98b6a00640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815e930 0x7f98b80b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98b6a00640 1 -- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b8162cb0 msgr2=0x7f98b80b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98b7400640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b8162cb0 0x7f98b80b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98b6a00640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b8162cb0 0x7f98b80b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98b6a00640 1 -- 172.21.15.37:0/2290171364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b80ca6d0 con 0x7f98b80d1240 2024-05-30T06:42:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98ae000640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815e930 0x7f98b80b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98b7400640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b8162cb0 0x7f98b80b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:15.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98b6a00640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b80d1240 0x7f98b80c6140 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f98a80ae040 tx=0x7f98a8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:15.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98af400640 1 -- 172.21.15.37:0/2290171364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a80ba070 con 0x7f98b80d1240 2024-05-30T06:42:15.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98af400640 1 -- 172.21.15.37:0/2290171364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a80b43f0 con 0x7f98b80d1240 2024-05-30T06:42:15.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98af400640 1 -- 172.21.15.37:0/2290171364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a80b0040 con 0x7f98b80d1240 2024-05-30T06:42:15.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98bd800640 1 -- 172.21.15.37:0/2290171364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b80ca9b0 con 0x7f98b80d1240 2024-05-30T06:42:15.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.007+0000 7f98bd800640 1 -- 172.21.15.37:0/2290171364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b80b7340 con 0x7f98b80d1240 2024-05-30T06:42:15.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.011+0000 7f98bd800640 1 -- 172.21.15.37:0/2290171364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b8068b20 con 0x7f98b80d1240 2024-05-30T06:42:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.011+0000 7f98af400640 1 -- 172.21.15.37:0/2290171364 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98a80bd070 con 0x7f98b80d1240 2024-05-30T06:42:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.011+0000 7f98af400640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9894068380 0x7f989406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.011+0000 7f98af400640 1 -- 172.21.15.37:0/2290171364 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f98a811fa00 con 0x7f98b80d1240 2024-05-30T06:42:15.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.011+0000 7f98ae000640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9894068380 0x7f989406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.011+0000 7f98ae000640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9894068380 0x7f989406a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98a0007fd0 tx=0x7f98a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:15.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.015+0000 7f98af400640 1 -- 172.21.15.37:0/2290171364 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f98a8016090 con 0x7f98b80d1240 2024-05-30T06:42:15.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.179+0000 7f98bd800640 1 -- 172.21.15.37:0/2290171364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98b80b7510 con 0x7f98b80d1240 2024-05-30T06:42:15.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.179+0000 7f98af400640 1 -- 172.21.15.37:0/2290171364 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7f98a80effb0 con 0x7f98b80d1240 2024-05-30T06:42:15.180 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:15.180 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:15.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.183+0000 7f98bd800640 1 -- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9894068380 msgr2=0x7f989406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.183+0000 7f98bd800640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9894068380 0x7f989406a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98a0007fd0 tx=0x7f98a0009040 comp rx=0 tx=0).stop 2024-05-30T06:42:15.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.183+0000 7f98bd800640 1 -- 172.21.15.37:0/2290171364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b80d1240 msgr2=0x7f98b80c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.183+0000 7f98bd800640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b80d1240 0x7f98b80c6140 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f98a80ae040 tx=0x7f98a8019240 comp rx=0 tx=0).stop 2024-05-30T06:42:15.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.183+0000 7f98bd800640 1 -- 172.21.15.37:0/2290171364 shutdown_connections 2024-05-30T06:42:15.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.183+0000 7f98bd800640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9894068380 0x7f989406a840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.183+0000 7f98bd800640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b8162cb0 0x7f98b80b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.183+0000 7f98bd800640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815e930 0x7f98b80b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.183+0000 7f98bd800640 1 --2- 172.21.15.37:0/2290171364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98b80d1240 0x7f98b80c6140 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.183+0000 7f98bd800640 1 -- 172.21.15.37:0/2290171364 >> 172.21.15.37:0/2290171364 conn(0x7f98b80b4100 msgr2=0x7f98b8162260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:15.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.183+0000 7f98bd800640 1 -- 172.21.15.37:0/2290171364 shutdown_connections 2024-05-30T06:42:15.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.183+0000 7f98bd800640 1 -- 172.21.15.37:0/2290171364 wait complete. 2024-05-30T06:42:15.201 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-30T06:42:15.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:42:15.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.343+0000 7f4bd2000640 1 Processor -- start 2024-05-30T06:42:15.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.343+0000 7f4bd2000640 1 -- start start 2024-05-30T06:42:15.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.343+0000 7f4bd2000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bcc0b2ec0 0x7f4bcc0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.343+0000 7f4bd2000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bcc15c8f0 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.343+0000 7f4bd2000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bcc0ccc80 con 0x7f4bcc155e60 2024-05-30T06:42:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.343+0000 7f4bd2000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4bcc0ccff0 con 0x7f4bcc0b2ec0 2024-05-30T06:42:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.347+0000 7f4bc2a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4bcc06f9a0 0x7f4bcc0cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60726/0 (socket says 172.21.15.37:60726) 2024-05-30T06:42:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.347+0000 7f4bc2a00640 1 -- 172.21.15.37:0/3884762348 learned_addr learned my addr 172.21.15.37:0/3884762348 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.347+0000 7f4bcbe00640 1 --2- 172.21.15.37:0/3884762348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bcc0b2ec0 0x7f4bcc0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.347+0000 7f4bcaa00640 1 -- 172.21.15.37:0/3884762348 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 952151030 0 0) 0x7f4bcc15c8f0 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.347+0000 7f4bcaa00640 1 -- 172.21.15.37:0/3884762348 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bb0003530 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.347+0000 7f4bcaa00640 1 -- 172.21.15.37:0/3884762348 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2919598613 0 0) 0x7f4bcc0ccc80 con 0x7f4bcc155e60 2024-05-30T06:42:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.347+0000 7f4bcaa00640 1 -- 172.21.15.37:0/3884762348 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bcc15c8f0 con 0x7f4bcc155e60 2024-05-30T06:42:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.347+0000 7f4bcbe00640 1 -- 172.21.15.37:0/3884762348 >> v1:172.21.15.105:6789/0 conn(0x7f4bcc155e60 legacy=0x7f4bcc0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.347+0000 7f4bcbe00640 1 -- 172.21.15.37:0/3884762348 >> v1:172.21.15.37:6789/0 conn(0x7f4bcc06f9a0 legacy=0x7f4bcc0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.347+0000 7f4bcbe00640 1 -- 172.21.15.37:0/3884762348 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bcc15cbd0 con 0x7f4bcc0b2ec0 2024-05-30T06:42:15.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.347+0000 7f4bcbe00640 1 --2- 172.21.15.37:0/3884762348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bcc0b2ec0 0x7f4bcc0b36a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009dc0 tx=0x7f4bc401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59664fd832704062 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:15.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bcaa00640 1 -- 172.21.15.37:0/3884762348 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40b2070 con 0x7f4bcc0b2ec0 2024-05-30T06:42:15.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bcaa00640 1 -- 172.21.15.37:0/3884762348 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc40a5920 con 0x7f4bcc0b2ec0 2024-05-30T06:42:15.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bcaa00640 1 -- 172.21.15.37:0/3884762348 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40a5cf0 con 0x7f4bcc0b2ec0 2024-05-30T06:42:15.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 -- 172.21.15.37:0/3884762348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bcc0b2ec0 msgr2=0x7f4bcc0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 --2- 172.21.15.37:0/3884762348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bcc0b2ec0 0x7f4bcc0b36a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009dc0 tx=0x7f4bc401c990 comp rx=0 tx=0).stop 2024-05-30T06:42:15.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 -- 172.21.15.37:0/3884762348 shutdown_connections 2024-05-30T06:42:15.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 --2- 172.21.15.37:0/3884762348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bcc0b2ec0 0x7f4bcc0b36a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 -- 172.21.15.37:0/3884762348 >> 172.21.15.37:0/3884762348 conn(0x7f4bcc0b23a0 msgr2=0x7f4bcc0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:15.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 -- 172.21.15.37:0/3884762348 shutdown_connections 2024-05-30T06:42:15.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 -- 172.21.15.37:0/3884762348 wait complete. 2024-05-30T06:42:15.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 Processor -- start 2024-05-30T06:42:15.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 -- start start 2024-05-30T06:42:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bcc06f9a0 0x7f4bcc14ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bcc0b2ec0 0x7f4bcc14db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bcc155e60 0x7f4bcc14e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc169a00 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4bcc169880 con 0x7f4bcc155e60 2024-05-30T06:42:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bd2000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4bcc169b80 con 0x7f4bcc0b2ec0 2024-05-30T06:42:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bcb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bcc06f9a0 0x7f4bcc14ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bcb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bcc06f9a0 0x7f4bcc14ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60362/0 (socket says 172.21.15.37:60362) 2024-05-30T06:42:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bcb400640 1 -- 172.21.15.37:0/692427194 learned_addr learned my addr 172.21.15.37:0/692427194 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bc2a00640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bcc0b2ec0 0x7f4bcc14db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.351+0000 7f4bcbe00640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bcc155e60 0x7f4bcc14e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bcb400640 1 -- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bcc0b2ec0 msgr2=0x7f4bcc14db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bcb400640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bcc0b2ec0 0x7f4bcc14db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bcb400640 1 -- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bcc155e60 msgr2=0x7f4bcc14e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bcb400640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bcc155e60 0x7f4bcc14e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bcb400640 1 -- 172.21.15.37:0/692427194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bcc160190 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bcb400640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bcc06f9a0 0x7f4bcc14ca20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00c430 tx=0x7f4bbc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bc3e00640 1 -- 172.21.15.37:0/692427194 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc017070 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bc3e00640 1 -- 172.21.15.37:0/692427194 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bbc0052f0 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bc3e00640 1 -- 172.21.15.37:0/692427194 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc003840 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bd2000640 1 -- 172.21.15.37:0/692427194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bcc1563e0 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bd2000640 1 -- 172.21.15.37:0/692427194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bcc1569a0 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bd2000640 1 -- 172.21.15.37:0/692427194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bcc068b20 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bc3e00640 1 -- 172.21.15.37:0/692427194 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4bbc01a070 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bc3e00640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ba8068380 0x7f4ba806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.355+0000 7f4bc3e00640 1 -- 172.21.15.37:0/692427194 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4bbc085d40 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.359+0000 7f4bc2a00640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ba8068380 0x7f4ba806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.359+0000 7f4bc2a00640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ba8068380 0x7f4ba806a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc14f250 tx=0x7f4bb4007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:15.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.359+0000 7f4bc3e00640 1 -- 172.21.15.37:0/692427194 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4bbc055ca0 con 0x7f4bcc06f9a0 2024-05-30T06:42:15.377 INFO:tasks.ceph.mds.b.smithi105.stderr:2024-05-30T06:42:15.375+0000 7f8ed6800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T06:42:15.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.523+0000 7f4bd2000640 1 -- 172.21.15.37:0/692427194 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4bcc151cd0 con 0x7f4ba8068380 2024-05-30T06:42:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.531+0000 7f4bc3e00640 1 -- 172.21.15.37:0/692427194 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7f4bcc151cd0 con 0x7f4ba8068380 2024-05-30T06:42:15.533 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:15.536 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:42:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.535+0000 7f4bd2000640 1 -- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ba8068380 msgr2=0x7f4ba806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.535+0000 7f4bd2000640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ba8068380 0x7f4ba806a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc14f250 tx=0x7f4bb4007d40 comp rx=0 tx=0).stop 2024-05-30T06:42:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.535+0000 7f4bd2000640 1 -- 172.21.15.37:0/692427194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bcc06f9a0 msgr2=0x7f4bcc14ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.535+0000 7f4bd2000640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bcc06f9a0 0x7f4bcc14ca20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc00c430 tx=0x7f4bbc00c8f0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.535+0000 7f4bd2000640 1 -- 172.21.15.37:0/692427194 shutdown_connections 2024-05-30T06:42:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.535+0000 7f4bd2000640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ba8068380 0x7f4ba806a840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.535+0000 7f4bd2000640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bcc155e60 0x7f4bcc14e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.535+0000 7f4bd2000640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bcc0b2ec0 0x7f4bcc14db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.535+0000 7f4bd2000640 1 --2- 172.21.15.37:0/692427194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bcc06f9a0 0x7f4bcc14ca20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.535+0000 7f4bd2000640 1 -- 172.21.15.37:0/692427194 >> 172.21.15.37:0/692427194 conn(0x7f4bcc0b23a0 msgr2=0x7f4bcc0cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.535+0000 7f4bd2000640 1 -- 172.21.15.37:0/692427194 shutdown_connections 2024-05-30T06:42:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.535+0000 7f4bd2000640 1 -- 172.21.15.37:0/692427194 wait complete. 2024-05-30T06:42:15.555 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-30T06:42:14.640897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218972,"kb_used_data":2788,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755748,"statfs":{"total":773094113280,"available":772869885952,"internally_reserved":0,"allocated":2854912,"data_stored":1734128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.250688"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388642+0000","last_change":"2024-05-30T06:42:11.435488+0000","last_active":"2024-05-30T06:42:13.388642+0000","last_peered":"2024-05-30T06:42:13.388642+0000","last_clean":"2024-05-30T06:42:13.388642+0000","last_became_active":"2024-05-30T06:42:11.435224+0000","last_became_peered":"2024-05-30T06:42:11.435224+0000","last_unstale":"2024-05-30T06:42:13.388642+0000","last_undegraded":"2024-05-30T06:42:13.388642+0000","last_fullsized":"2024-05-30T06:42:13.388642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:02.703778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420451+0000","last_change":"2024-05-30T06:42:11.432162+0000","last_active":"2024-05-30T06:42:12.420451+0000","last_peered":"2024-05-30T06:42:12.420451+0000","last_clean":"2024-05-30T06:42:12.420451+0000","last_became_active":"2024-05-30T06:42:11.431837+0000","last_became_peered":"2024-05-30T06:42:11.431837+0000","last_unstale":"2024-05-30T06:42:12.420451+0000","last_undegraded":"2024-05-30T06:42:12.420451+0000","last_fullsized":"2024-05-30T06:42:12.420451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583246+0000","last_change":"2024-05-30T06:42:11.444273+0000","last_active":"2024-05-30T06:42:13.583246+0000","last_peered":"2024-05-30T06:42:13.583246+0000","last_clean":"2024-05-30T06:42:13.583246+0000","last_became_active":"2024-05-30T06:42:11.443918+0000","last_became_peered":"2024-05-30T06:42:11.443918+0000","last_unstale":"2024-05-30T06:42:13.583246+0000","last_undegraded":"2024-05-30T06:42:13.583246+0000","last_fullsized":"2024-05-30T06:42:13.583246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418697+0000","last_change":"2024-05-30T06:42:11.434052+0000","last_active":"2024-05-30T06:42:12.418697+0000","last_peered":"2024-05-30T06:42:12.418697+0000","last_clean":"2024-05-30T06:42:12.418697+0000","last_became_active":"2024-05-30T06:42:11.433700+0000","last_became_peered":"2024-05-30T06:42:11.433700+0000","last_unstale":"2024-05-30T06:42:12.418697+0000","last_undegraded":"2024-05-30T06:42:12.418697+0000","last_fullsized":"2024-05-30T06:42:12.418697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:04:58.409141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388154+0000","last_change":"2024-05-30T06:42:11.440147+0000","last_active":"2024-05-30T06:42:13.388154+0000","last_peered":"2024-05-30T06:42:13.388154+0000","last_clean":"2024-05-30T06:42:13.388154+0000","last_became_active":"2024-05-30T06:42:11.439811+0000","last_became_peered":"2024-05-30T06:42:11.439811+0000","last_unstale":"2024-05-30T06:42:13.388154+0000","last_undegraded":"2024-05-30T06:42:13.388154+0000","last_fullsized":"2024-05-30T06:42:13.388154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:05:31.913179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418707+0000","last_change":"2024-05-30T06:42:11.434320+0000","last_active":"2024-05-30T06:42:12.418707+0000","last_peered":"2024-05-30T06:42:12.418707+0000","last_clean":"2024-05-30T06:42:12.418707+0000","last_became_active":"2024-05-30T06:42:11.433756+0000","last_became_peered":"2024-05-30T06:42:11.433756+0000","last_unstale":"2024-05-30T06:42:12.418707+0000","last_undegraded":"2024-05-30T06:42:12.418707+0000","last_fullsized":"2024-05-30T06:42:12.418707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387999+0000","last_change":"2024-05-30T06:42:11.433123+0000","last_active":"2024-05-30T06:42:13.387999+0000","last_peered":"2024-05-30T06:42:13.387999+0000","last_clean":"2024-05-30T06:42:13.387999+0000","last_became_active":"2024-05-30T06:42:11.432861+0000","last_became_peered":"2024-05-30T06:42:11.432861+0000","last_unstale":"2024-05-30T06:42:13.387999+0000","last_undegraded":"2024-05-30T06:42:13.387999+0000","last_fullsized":"2024-05-30T06:42:13.387999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:12.472477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771210+0000","last_change":"2024-05-30T06:42:11.440463+0000","last_active":"2024-05-30T06:42:12.771210+0000","last_peered":"2024-05-30T06:42:12.771210+0000","last_clean":"2024-05-30T06:42:12.771210+0000","last_became_active":"2024-05-30T06:42:11.440179+0000","last_became_peered":"2024-05-30T06:42:11.440179+0000","last_unstale":"2024-05-30T06:42:12.771210+0000","last_undegraded":"2024-05-30T06:42:12.771210+0000","last_fullsized":"2024-05-30T06:42:12.771210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388697+0000","last_change":"2024-05-30T06:42:11.438364+0000","last_active":"2024-05-30T06:42:13.388697+0000","last_peered":"2024-05-30T06:42:13.388697+0000","last_clean":"2024-05-30T06:42:13.388697+0000","last_became_active":"2024-05-30T06:42:11.438010+0000","last_became_peered":"2024-05-30T06:42:11.438010+0000","last_unstale":"2024-05-30T06:42:13.388697+0000","last_undegraded":"2024-05-30T06:42:13.388697+0000","last_fullsized":"2024-05-30T06:42:13.388697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:44:42.856118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462336+0000","last_change":"2024-05-30T06:42:11.436077+0000","last_active":"2024-05-30T06:42:12.462336+0000","last_peered":"2024-05-30T06:42:12.462336+0000","last_clean":"2024-05-30T06:42:12.462336+0000","last_became_active":"2024-05-30T06:42:11.435686+0000","last_became_peered":"2024-05-30T06:42:11.435686+0000","last_unstale":"2024-05-30T06:42:12.462336+0000","last_undegraded":"2024-05-30T06:42:12.462336+0000","last_fullsized":"2024-05-30T06:42:12.462336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462200+0000","last_change":"2024-05-30T06:42:11.441401+0000","last_active":"2024-05-30T06:42:12.462200+0000","last_peered":"2024-05-30T06:42:12.462200+0000","last_clean":"2024-05-30T06:42:12.462200+0000","last_became_active":"2024-05-30T06:42:11.440895+0000","last_became_peered":"2024-05-30T06:42:11.440895+0000","last_unstale":"2024-05-30T06:42:12.462200+0000","last_undegraded":"2024-05-30T06:42:12.462200+0000","last_fullsized":"2024-05-30T06:42:12.462200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583872+0000","last_change":"2024-05-30T06:42:11.444435+0000","last_active":"2024-05-30T06:42:13.583872+0000","last_peered":"2024-05-30T06:42:13.583872+0000","last_clean":"2024-05-30T06:42:13.583872+0000","last_became_active":"2024-05-30T06:42:11.444162+0000","last_became_peered":"2024-05-30T06:42:11.444162+0000","last_unstale":"2024-05-30T06:42:13.583872+0000","last_undegraded":"2024-05-30T06:42:13.583872+0000","last_fullsized":"2024-05-30T06:42:13.583872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:18:26.795557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771470+0000","last_change":"2024-05-30T06:42:11.430118+0000","last_active":"2024-05-30T06:42:12.771470+0000","last_peered":"2024-05-30T06:42:12.771470+0000","last_clean":"2024-05-30T06:42:12.771470+0000","last_became_active":"2024-05-30T06:42:11.429821+0000","last_became_peered":"2024-05-30T06:42:11.429821+0000","last_unstale":"2024-05-30T06:42:12.771470+0000","last_undegraded":"2024-05-30T06:42:12.771470+0000","last_fullsized":"2024-05-30T06:42:12.771470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:16.106604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.582964+0000","last_change":"2024-05-30T06:42:11.426742+0000","last_active":"2024-05-30T06:42:13.582964+0000","last_peered":"2024-05-30T06:42:13.582964+0000","last_clean":"2024-05-30T06:42:13.582964+0000","last_became_active":"2024-05-30T06:42:11.426182+0000","last_became_peered":"2024-05-30T06:42:11.426182+0000","last_unstale":"2024-05-30T06:42:13.582964+0000","last_undegraded":"2024-05-30T06:42:13.582964+0000","last_fullsized":"2024-05-30T06:42:13.582964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:07:16.079488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420135+0000","last_change":"2024-05-30T06:42:11.452976+0000","last_active":"2024-05-30T06:42:12.420135+0000","last_peered":"2024-05-30T06:42:12.420135+0000","last_clean":"2024-05-30T06:42:12.420135+0000","last_became_active":"2024-05-30T06:42:11.452525+0000","last_became_peered":"2024-05-30T06:42:11.452525+0000","last_unstale":"2024-05-30T06:42:12.420135+0000","last_undegraded":"2024-05-30T06:42:12.420135+0000","last_fullsized":"2024-05-30T06:42:12.420135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418654+0000","last_change":"2024-05-30T06:42:11.437421+0000","last_active":"2024-05-30T06:42:12.418654+0000","last_peered":"2024-05-30T06:42:12.418654+0000","last_clean":"2024-05-30T06:42:12.418654+0000","last_became_active":"2024-05-30T06:42:11.432053+0000","last_became_peered":"2024-05-30T06:42:11.432053+0000","last_unstale":"2024-05-30T06:42:12.418654+0000","last_undegraded":"2024-05-30T06:42:12.418654+0000","last_fullsized":"2024-05-30T06:42:12.418654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:16.106604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419366+0000","last_change":"2024-05-30T06:42:11.443729+0000","last_active":"2024-05-30T06:42:12.419366+0000","last_peered":"2024-05-30T06:42:12.419366+0000","last_clean":"2024-05-30T06:42:12.419366+0000","last_became_active":"2024-05-30T06:42:11.443424+0000","last_became_peered":"2024-05-30T06:42:11.443424+0000","last_unstale":"2024-05-30T06:42:12.419366+0000","last_undegraded":"2024-05-30T06:42:12.419366+0000","last_fullsized":"2024-05-30T06:42:12.419366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:29:42.983707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419530+0000","last_change":"2024-05-30T06:42:11.443761+0000","last_active":"2024-05-30T06:42:12.419530+0000","last_peered":"2024-05-30T06:42:12.419530+0000","last_clean":"2024-05-30T06:42:12.419530+0000","last_became_active":"2024-05-30T06:42:11.443453+0000","last_became_peered":"2024-05-30T06:42:11.443453+0000","last_unstale":"2024-05-30T06:42:12.419530+0000","last_undegraded":"2024-05-30T06:42:12.419530+0000","last_fullsized":"2024-05-30T06:42:12.419530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:51:40.954821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388493+0000","last_change":"2024-05-30T06:42:11.445389+0000","last_active":"2024-05-30T06:42:13.388493+0000","last_peered":"2024-05-30T06:42:13.388493+0000","last_clean":"2024-05-30T06:42:13.388493+0000","last_became_active":"2024-05-30T06:42:11.444984+0000","last_became_peered":"2024-05-30T06:42:11.444984+0000","last_unstale":"2024-05-30T06:42:13.388493+0000","last_undegraded":"2024-05-30T06:42:13.388493+0000","last_fullsized":"2024-05-30T06:42:13.388493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:48:21.800907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462107+0000","last_change":"2024-05-30T06:42:11.453799+0000","last_active":"2024-05-30T06:42:12.462107+0000","last_peered":"2024-05-30T06:42:12.462107+0000","last_clean":"2024-05-30T06:42:12.462107+0000","last_became_active":"2024-05-30T06:42:11.453488+0000","last_became_peered":"2024-05-30T06:42:11.453488+0000","last_unstale":"2024-05-30T06:42:12.462107+0000","last_undegraded":"2024-05-30T06:42:12.462107+0000","last_fullsized":"2024-05-30T06:42:12.462107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583121+0000","last_change":"2024-05-30T06:42:11.428247+0000","last_active":"2024-05-30T06:42:13.583121+0000","last_peered":"2024-05-30T06:42:13.583121+0000","last_clean":"2024-05-30T06:42:13.583121+0000","last_became_active":"2024-05-30T06:42:11.427950+0000","last_became_peered":"2024-05-30T06:42:11.427950+0000","last_unstale":"2024-05-30T06:42:13.583121+0000","last_undegraded":"2024-05-30T06:42:13.583121+0000","last_fullsized":"2024-05-30T06:42:13.583121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:41.693793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418922+0000","last_change":"2024-05-30T06:42:11.434081+0000","last_active":"2024-05-30T06:42:12.418922+0000","last_peered":"2024-05-30T06:42:12.418922+0000","last_clean":"2024-05-30T06:42:12.418922+0000","last_became_active":"2024-05-30T06:42:11.433267+0000","last_became_peered":"2024-05-30T06:42:11.433267+0000","last_unstale":"2024-05-30T06:42:12.418922+0000","last_undegraded":"2024-05-30T06:42:12.418922+0000","last_fullsized":"2024-05-30T06:42:12.418922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:07.193945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771221+0000","last_change":"2024-05-30T06:42:11.445981+0000","last_active":"2024-05-30T06:42:12.771221+0000","last_peered":"2024-05-30T06:42:12.771221+0000","last_clean":"2024-05-30T06:42:12.771221+0000","last_became_active":"2024-05-30T06:42:11.445642+0000","last_became_peered":"2024-05-30T06:42:11.445642+0000","last_unstale":"2024-05-30T06:42:12.771221+0000","last_undegraded":"2024-05-30T06:42:12.771221+0000","last_fullsized":"2024-05-30T06:42:12.771221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418715+0000","last_change":"2024-05-30T06:42:11.434545+0000","last_active":"2024-05-30T06:42:12.418715+0000","last_peered":"2024-05-30T06:42:12.418715+0000","last_clean":"2024-05-30T06:42:12.418715+0000","last_became_active":"2024-05-30T06:42:11.431097+0000","last_became_peered":"2024-05-30T06:42:11.431097+0000","last_unstale":"2024-05-30T06:42:12.418715+0000","last_undegraded":"2024-05-30T06:42:12.418715+0000","last_fullsized":"2024-05-30T06:42:12.418715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:15.413953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771539+0000","last_change":"2024-05-30T06:42:11.454371+0000","last_active":"2024-05-30T06:42:12.771539+0000","last_peered":"2024-05-30T06:42:12.771539+0000","last_clean":"2024-05-30T06:42:12.771539+0000","last_became_active":"2024-05-30T06:42:11.454064+0000","last_became_peered":"2024-05-30T06:42:11.454064+0000","last_unstale":"2024-05-30T06:42:12.771539+0000","last_undegraded":"2024-05-30T06:42:12.771539+0000","last_fullsized":"2024-05-30T06:42:12.771539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:15.413953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462346+0000","last_change":"2024-05-30T06:42:11.439382+0000","last_active":"2024-05-30T06:42:12.462346+0000","last_peered":"2024-05-30T06:42:12.462346+0000","last_clean":"2024-05-30T06:42:12.462346+0000","last_became_active":"2024-05-30T06:42:11.439071+0000","last_became_peered":"2024-05-30T06:42:11.439071+0000","last_unstale":"2024-05-30T06:42:12.462346+0000","last_undegraded":"2024-05-30T06:42:12.462346+0000","last_fullsized":"2024-05-30T06:42:12.462346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420317+0000","last_change":"2024-05-30T06:42:11.436698+0000","last_active":"2024-05-30T06:42:12.420317+0000","last_peered":"2024-05-30T06:42:12.420317+0000","last_clean":"2024-05-30T06:42:12.420317+0000","last_became_active":"2024-05-30T06:42:11.436378+0000","last_became_peered":"2024-05-30T06:42:11.436378+0000","last_unstale":"2024-05-30T06:42:12.420317+0000","last_undegraded":"2024-05-30T06:42:12.420317+0000","last_fullsized":"2024-05-30T06:42:12.420317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771611+0000","last_change":"2024-05-30T06:42:11.454323+0000","last_active":"2024-05-30T06:42:12.771611+0000","last_peered":"2024-05-30T06:42:12.771611+0000","last_clean":"2024-05-30T06:42:12.771611+0000","last_became_active":"2024-05-30T06:42:11.454037+0000","last_became_peered":"2024-05-30T06:42:11.454037+0000","last_unstale":"2024-05-30T06:42:12.771611+0000","last_undegraded":"2024-05-30T06:42:12.771611+0000","last_fullsized":"2024-05-30T06:42:12.771611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:05.695381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583186+0000","last_change":"2024-05-30T06:42:11.432774+0000","last_active":"2024-05-30T06:42:13.583186+0000","last_peered":"2024-05-30T06:42:13.583186+0000","last_clean":"2024-05-30T06:42:13.583186+0000","last_became_active":"2024-05-30T06:42:11.432430+0000","last_became_peered":"2024-05-30T06:42:11.432430+0000","last_unstale":"2024-05-30T06:42:13.583186+0000","last_undegraded":"2024-05-30T06:42:13.583186+0000","last_fullsized":"2024-05-30T06:42:13.583186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418923+0000","last_change":"2024-05-30T06:42:11.435991+0000","last_active":"2024-05-30T06:42:12.418923+0000","last_peered":"2024-05-30T06:42:12.418923+0000","last_clean":"2024-05-30T06:42:12.418923+0000","last_became_active":"2024-05-30T06:42:11.435283+0000","last_became_peered":"2024-05-30T06:42:11.435283+0000","last_unstale":"2024-05-30T06:42:12.418923+0000","last_undegraded":"2024-05-30T06:42:12.418923+0000","last_fullsized":"2024-05-30T06:42:12.418923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:05:31.913179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419353+0000","last_change":"2024-05-30T06:42:11.445149+0000","last_active":"2024-05-30T06:42:12.419353+0000","last_peered":"2024-05-30T06:42:12.419353+0000","last_clean":"2024-05-30T06:42:12.419353+0000","last_became_active":"2024-05-30T06:42:11.444558+0000","last_became_peered":"2024-05-30T06:42:11.444558+0000","last_unstale":"2024-05-30T06:42:12.419353+0000","last_undegraded":"2024-05-30T06:42:12.419353+0000","last_fullsized":"2024-05-30T06:42:12.419353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:53.737991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461946+0000","last_change":"2024-05-30T06:42:11.432788+0000","last_active":"2024-05-30T06:42:12.461946+0000","last_peered":"2024-05-30T06:42:12.461946+0000","last_clean":"2024-05-30T06:42:12.461946+0000","last_became_active":"2024-05-30T06:42:11.432182+0000","last_became_peered":"2024-05-30T06:42:11.432182+0000","last_unstale":"2024-05-30T06:42:12.461946+0000","last_undegraded":"2024-05-30T06:42:12.461946+0000","last_fullsized":"2024-05-30T06:42:12.461946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:26:07.087132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583756+0000","last_change":"2024-05-30T06:42:11.445205+0000","last_active":"2024-05-30T06:42:13.583756+0000","last_peered":"2024-05-30T06:42:13.583756+0000","last_clean":"2024-05-30T06:42:13.583756+0000","last_became_active":"2024-05-30T06:42:11.444042+0000","last_became_peered":"2024-05-30T06:42:11.444042+0000","last_unstale":"2024-05-30T06:42:13.583756+0000","last_undegraded":"2024-05-30T06:42:13.583756+0000","last_fullsized":"2024-05-30T06:42:13.583756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:44.456016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771622+0000","last_change":"2024-05-30T06:42:10.424421+0000","last_active":"2024-05-30T06:42:12.771622+0000","last_peered":"2024-05-30T06:42:12.771622+0000","last_clean":"2024-05-30T06:42:12.771622+0000","last_became_active":"2024-05-30T06:42:10.423992+0000","last_became_peered":"2024-05-30T06:42:10.423992+0000","last_unstale":"2024-05-30T06:42:12.771622+0000","last_undegraded":"2024-05-30T06:42:12.771622+0000","last_fullsized":"2024-05-30T06:42:12.771622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:12:56.283917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583199+0000","last_change":"2024-05-30T06:42:11.452945+0000","last_active":"2024-05-30T06:42:13.583199+0000","last_peered":"2024-05-30T06:42:13.583199+0000","last_clean":"2024-05-30T06:42:13.583199+0000","last_became_active":"2024-05-30T06:42:11.452548+0000","last_became_peered":"2024-05-30T06:42:11.452548+0000","last_unstale":"2024-05-30T06:42:13.583199+0000","last_undegraded":"2024-05-30T06:42:13.583199+0000","last_fullsized":"2024-05-30T06:42:13.583199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461970+0000","last_change":"2024-05-30T06:42:10.423464+0000","last_active":"2024-05-30T06:42:12.461970+0000","last_peered":"2024-05-30T06:42:12.461970+0000","last_clean":"2024-05-30T06:42:12.461970+0000","last_became_active":"2024-05-30T06:42:10.423111+0000","last_became_peered":"2024-05-30T06:42:10.423111+0000","last_unstale":"2024-05-30T06:42:12.461970+0000","last_undegraded":"2024-05-30T06:42:12.461970+0000","last_fullsized":"2024-05-30T06:42:12.461970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771327+0000","last_change":"2024-05-30T06:42:10.417267+0000","last_active":"2024-05-30T06:42:12.771327+0000","last_peered":"2024-05-30T06:42:12.771327+0000","last_clean":"2024-05-30T06:42:12.771327+0000","last_became_active":"2024-05-30T06:42:10.416996+0000","last_became_peered":"2024-05-30T06:42:10.416996+0000","last_unstale":"2024-05-30T06:42:12.771327+0000","last_undegraded":"2024-05-30T06:42:12.771327+0000","last_fullsized":"2024-05-30T06:42:12.771327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:43:33.658279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771209+0000","last_change":"2024-05-30T06:42:11.431024+0000","last_active":"2024-05-30T06:42:12.771209+0000","last_peered":"2024-05-30T06:42:12.771209+0000","last_clean":"2024-05-30T06:42:12.771209+0000","last_became_active":"2024-05-30T06:42:11.430771+0000","last_became_peered":"2024-05-30T06:42:11.430771+0000","last_unstale":"2024-05-30T06:42:12.771209+0000","last_undegraded":"2024-05-30T06:42:12.771209+0000","last_fullsized":"2024-05-30T06:42:12.771209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418934+0000","last_change":"2024-05-30T06:42:10.421013+0000","last_active":"2024-05-30T06:42:12.418934+0000","last_peered":"2024-05-30T06:42:12.418934+0000","last_clean":"2024-05-30T06:42:12.418934+0000","last_became_active":"2024-05-30T06:42:10.420539+0000","last_became_peered":"2024-05-30T06:42:10.420539+0000","last_unstale":"2024-05-30T06:42:12.418934+0000","last_undegraded":"2024-05-30T06:42:12.418934+0000","last_fullsized":"2024-05-30T06:42:12.418934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:17.465458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420071+0000","last_change":"2024-05-30T06:42:11.434422+0000","last_active":"2024-05-30T06:42:12.420071+0000","last_peered":"2024-05-30T06:42:12.420071+0000","last_clean":"2024-05-30T06:42:12.420071+0000","last_became_active":"2024-05-30T06:42:11.434086+0000","last_became_peered":"2024-05-30T06:42:11.434086+0000","last_unstale":"2024-05-30T06:42:12.420071+0000","last_undegraded":"2024-05-30T06:42:12.420071+0000","last_fullsized":"2024-05-30T06:42:12.420071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:41.693793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462252+0000","last_change":"2024-05-30T06:42:10.425809+0000","last_active":"2024-05-30T06:42:12.462252+0000","last_peered":"2024-05-30T06:42:12.462252+0000","last_clean":"2024-05-30T06:42:12.462252+0000","last_became_active":"2024-05-30T06:42:10.425322+0000","last_became_peered":"2024-05-30T06:42:10.425322+0000","last_unstale":"2024-05-30T06:42:12.462252+0000","last_undegraded":"2024-05-30T06:42:12.462252+0000","last_fullsized":"2024-05-30T06:42:12.462252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419005+0000","last_change":"2024-05-30T06:42:11.440849+0000","last_active":"2024-05-30T06:42:12.419005+0000","last_peered":"2024-05-30T06:42:12.419005+0000","last_clean":"2024-05-30T06:42:12.419005+0000","last_became_active":"2024-05-30T06:42:11.439120+0000","last_became_peered":"2024-05-30T06:42:11.439120+0000","last_unstale":"2024-05-30T06:42:12.419005+0000","last_undegraded":"2024-05-30T06:42:12.419005+0000","last_fullsized":"2024-05-30T06:42:12.419005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:34.897332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419128+0000","last_change":"2024-05-30T06:42:10.416914+0000","last_active":"2024-05-30T06:42:12.419128+0000","last_peered":"2024-05-30T06:42:12.419128+0000","last_clean":"2024-05-30T06:42:12.419128+0000","last_became_active":"2024-05-30T06:42:10.416544+0000","last_became_peered":"2024-05-30T06:42:10.416544+0000","last_unstale":"2024-05-30T06:42:12.419128+0000","last_undegraded":"2024-05-30T06:42:12.419128+0000","last_fullsized":"2024-05-30T06:42:12.419128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583510+0000","last_change":"2024-05-30T06:42:11.432338+0000","last_active":"2024-05-30T06:42:13.583510+0000","last_peered":"2024-05-30T06:42:13.583510+0000","last_clean":"2024-05-30T06:42:13.583510+0000","last_became_active":"2024-05-30T06:42:11.431974+0000","last_became_peered":"2024-05-30T06:42:11.431974+0000","last_unstale":"2024-05-30T06:42:13.583510+0000","last_undegraded":"2024-05-30T06:42:13.583510+0000","last_fullsized":"2024-05-30T06:42:13.583510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:16.106604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420302+0000","last_change":"2024-05-30T06:42:10.422438+0000","last_active":"2024-05-30T06:42:12.420302+0000","last_peered":"2024-05-30T06:42:12.420302+0000","last_clean":"2024-05-30T06:42:12.420302+0000","last_became_active":"2024-05-30T06:42:10.422143+0000","last_became_peered":"2024-05-30T06:42:10.422143+0000","last_unstale":"2024-05-30T06:42:12.420302+0000","last_undegraded":"2024-05-30T06:42:12.420302+0000","last_fullsized":"2024-05-30T06:42:12.420302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583814+0000","last_change":"2024-05-30T06:42:11.450964+0000","last_active":"2024-05-30T06:42:13.583814+0000","last_peered":"2024-05-30T06:42:13.583814+0000","last_clean":"2024-05-30T06:42:13.583814+0000","last_became_active":"2024-05-30T06:42:11.450676+0000","last_became_peered":"2024-05-30T06:42:11.450676+0000","last_unstale":"2024-05-30T06:42:13.583814+0000","last_undegraded":"2024-05-30T06:42:13.583814+0000","last_fullsized":"2024-05-30T06:42:13.583814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:28.603237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462153+0000","last_change":"2024-05-30T06:42:10.420535+0000","last_active":"2024-05-30T06:42:12.462153+0000","last_peered":"2024-05-30T06:42:12.462153+0000","last_clean":"2024-05-30T06:42:12.462153+0000","last_became_active":"2024-05-30T06:42:10.420249+0000","last_became_peered":"2024-05-30T06:42:10.420249+0000","last_unstale":"2024-05-30T06:42:12.462153+0000","last_undegraded":"2024-05-30T06:42:12.462153+0000","last_fullsized":"2024-05-30T06:42:12.462153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:57:09.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388267+0000","last_change":"2024-05-30T06:42:11.434347+0000","last_active":"2024-05-30T06:42:13.388267+0000","last_peered":"2024-05-30T06:42:13.388267+0000","last_clean":"2024-05-30T06:42:13.388267+0000","last_became_active":"2024-05-30T06:42:11.434073+0000","last_became_peered":"2024-05-30T06:42:11.434073+0000","last_unstale":"2024-05-30T06:42:13.388267+0000","last_undegraded":"2024-05-30T06:42:13.388267+0000","last_fullsized":"2024-05-30T06:42:13.388267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:34.897332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583309+0000","last_change":"2024-05-30T06:42:10.430485+0000","last_active":"2024-05-30T06:42:13.583309+0000","last_peered":"2024-05-30T06:42:13.583309+0000","last_clean":"2024-05-30T06:42:13.583309+0000","last_became_active":"2024-05-30T06:42:10.430203+0000","last_became_peered":"2024-05-30T06:42:10.430203+0000","last_unstale":"2024-05-30T06:42:13.583309+0000","last_undegraded":"2024-05-30T06:42:13.583309+0000","last_fullsized":"2024-05-30T06:42:13.583309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:32.085884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583022+0000","last_change":"2024-05-30T06:42:11.429543+0000","last_active":"2024-05-30T06:42:13.583022+0000","last_peered":"2024-05-30T06:42:13.583022+0000","last_clean":"2024-05-30T06:42:13.583022+0000","last_became_active":"2024-05-30T06:42:11.429230+0000","last_became_peered":"2024-05-30T06:42:11.429230+0000","last_unstale":"2024-05-30T06:42:13.583022+0000","last_undegraded":"2024-05-30T06:42:13.583022+0000","last_fullsized":"2024-05-30T06:42:13.583022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:35:23.153911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419025+0000","last_change":"2024-05-30T06:42:10.404506+0000","last_active":"2024-05-30T06:42:12.419025+0000","last_peered":"2024-05-30T06:42:12.419025+0000","last_clean":"2024-05-30T06:42:12.419025+0000","last_became_active":"2024-05-30T06:42:10.404194+0000","last_became_peered":"2024-05-30T06:42:10.404194+0000","last_unstale":"2024-05-30T06:42:12.419025+0000","last_undegraded":"2024-05-30T06:42:12.419025+0000","last_fullsized":"2024-05-30T06:42:12.419025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:57:09.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388251+0000","last_change":"2024-05-30T06:42:11.447385+0000","last_active":"2024-05-30T06:42:13.388251+0000","last_peered":"2024-05-30T06:42:13.388251+0000","last_clean":"2024-05-30T06:42:13.388251+0000","last_became_active":"2024-05-30T06:42:11.446929+0000","last_became_peered":"2024-05-30T06:42:11.446929+0000","last_unstale":"2024-05-30T06:42:13.388251+0000","last_undegraded":"2024-05-30T06:42:13.388251+0000","last_fullsized":"2024-05-30T06:42:13.388251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:28:18.705789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461885+0000","last_change":"2024-05-30T06:42:10.423499+0000","last_active":"2024-05-30T06:42:12.461885+0000","last_peered":"2024-05-30T06:42:12.461885+0000","last_clean":"2024-05-30T06:42:12.461885+0000","last_became_active":"2024-05-30T06:42:10.423116+0000","last_became_peered":"2024-05-30T06:42:10.423116+0000","last_unstale":"2024-05-30T06:42:12.461885+0000","last_undegraded":"2024-05-30T06:42:12.461885+0000","last_fullsized":"2024-05-30T06:42:12.461885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:17.465458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462086+0000","last_change":"2024-05-30T06:42:11.432468+0000","last_active":"2024-05-30T06:42:12.462086+0000","last_peered":"2024-05-30T06:42:12.462086+0000","last_clean":"2024-05-30T06:42:12.462086+0000","last_became_active":"2024-05-30T06:42:11.431747+0000","last_became_peered":"2024-05-30T06:42:11.431747+0000","last_unstale":"2024-05-30T06:42:12.462086+0000","last_undegraded":"2024-05-30T06:42:12.462086+0000","last_fullsized":"2024-05-30T06:42:12.462086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419214+0000","last_change":"2024-05-30T06:42:10.410699+0000","last_active":"2024-05-30T06:42:12.419214+0000","last_peered":"2024-05-30T06:42:12.419214+0000","last_clean":"2024-05-30T06:42:12.419214+0000","last_became_active":"2024-05-30T06:42:10.410248+0000","last_became_peered":"2024-05-30T06:42:10.410248+0000","last_unstale":"2024-05-30T06:42:12.419214+0000","last_undegraded":"2024-05-30T06:42:12.419214+0000","last_fullsized":"2024-05-30T06:42:12.419214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388106+0000","last_change":"2024-05-30T06:42:11.448104+0000","last_active":"2024-05-30T06:42:13.388106+0000","last_peered":"2024-05-30T06:42:13.388106+0000","last_clean":"2024-05-30T06:42:13.388106+0000","last_became_active":"2024-05-30T06:42:11.446869+0000","last_became_peered":"2024-05-30T06:42:11.446869+0000","last_unstale":"2024-05-30T06:42:13.388106+0000","last_undegraded":"2024-05-30T06:42:13.388106+0000","last_fullsized":"2024-05-30T06:42:13.388106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:07.193945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583774+0000","last_change":"2024-05-30T06:42:10.428483+0000","last_active":"2024-05-30T06:42:13.583774+0000","last_peered":"2024-05-30T06:42:13.583774+0000","last_clean":"2024-05-30T06:42:13.583774+0000","last_became_active":"2024-05-30T06:42:10.428191+0000","last_became_peered":"2024-05-30T06:42:10.428191+0000","last_unstale":"2024-05-30T06:42:13.583774+0000","last_undegraded":"2024-05-30T06:42:13.583774+0000","last_fullsized":"2024-05-30T06:42:13.583774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:32.085884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388487+0000","last_change":"2024-05-30T06:42:11.446064+0000","last_active":"2024-05-30T06:42:13.388487+0000","last_peered":"2024-05-30T06:42:13.388487+0000","last_clean":"2024-05-30T06:42:13.388487+0000","last_became_active":"2024-05-30T06:42:11.445744+0000","last_became_peered":"2024-05-30T06:42:11.445744+0000","last_unstale":"2024-05-30T06:42:13.388487+0000","last_undegraded":"2024-05-30T06:42:13.388487+0000","last_fullsized":"2024-05-30T06:42:13.388487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:29:42.983707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419615+0000","last_change":"2024-05-30T06:42:10.406964+0000","last_active":"2024-05-30T06:42:12.419615+0000","last_peered":"2024-05-30T06:42:12.419615+0000","last_clean":"2024-05-30T06:42:12.419615+0000","last_became_active":"2024-05-30T06:42:10.406664+0000","last_became_peered":"2024-05-30T06:42:10.406664+0000","last_unstale":"2024-05-30T06:42:12.419615+0000","last_undegraded":"2024-05-30T06:42:12.419615+0000","last_fullsized":"2024-05-30T06:42:12.419615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:27.594625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388727+0000","last_change":"2024-05-30T06:42:11.454278+0000","last_active":"2024-05-30T06:42:13.388727+0000","last_peered":"2024-05-30T06:42:13.388727+0000","last_clean":"2024-05-30T06:42:13.388727+0000","last_became_active":"2024-05-30T06:42:11.453964+0000","last_became_peered":"2024-05-30T06:42:11.453964+0000","last_unstale":"2024-05-30T06:42:13.388727+0000","last_undegraded":"2024-05-30T06:42:13.388727+0000","last_fullsized":"2024-05-30T06:42:13.388727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:17:43.098464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420404+0000","last_change":"2024-05-30T06:42:10.423747+0000","last_active":"2024-05-30T06:42:12.420404+0000","last_peered":"2024-05-30T06:42:12.420404+0000","last_clean":"2024-05-30T06:42:12.420404+0000","last_became_active":"2024-05-30T06:42:10.423406+0000","last_became_peered":"2024-05-30T06:42:10.423406+0000","last_unstale":"2024-05-30T06:42:12.420404+0000","last_undegraded":"2024-05-30T06:42:12.420404+0000","last_fullsized":"2024-05-30T06:42:12.420404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419052+0000","last_change":"2024-05-30T06:42:11.433867+0000","last_active":"2024-05-30T06:42:12.419052+0000","last_peered":"2024-05-30T06:42:12.419052+0000","last_clean":"2024-05-30T06:42:12.419052+0000","last_became_active":"2024-05-30T06:42:11.433302+0000","last_became_peered":"2024-05-30T06:42:11.433302+0000","last_unstale":"2024-05-30T06:42:12.419052+0000","last_undegraded":"2024-05-30T06:42:12.419052+0000","last_fullsized":"2024-05-30T06:42:12.419052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:09:54.618681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419361+0000","last_change":"2024-05-30T06:42:10.411777+0000","last_active":"2024-05-30T06:42:12.419361+0000","last_peered":"2024-05-30T06:42:12.419361+0000","last_clean":"2024-05-30T06:42:12.419361+0000","last_became_active":"2024-05-30T06:42:10.409724+0000","last_became_peered":"2024-05-30T06:42:10.409724+0000","last_unstale":"2024-05-30T06:42:12.419361+0000","last_undegraded":"2024-05-30T06:42:12.419361+0000","last_fullsized":"2024-05-30T06:42:12.419361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388269+0000","last_change":"2024-05-30T06:42:11.439053+0000","last_active":"2024-05-30T06:42:13.388269+0000","last_peered":"2024-05-30T06:42:13.388269+0000","last_clean":"2024-05-30T06:42:13.388269+0000","last_became_active":"2024-05-30T06:42:11.438190+0000","last_became_peered":"2024-05-30T06:42:11.438190+0000","last_unstale":"2024-05-30T06:42:13.388269+0000","last_undegraded":"2024-05-30T06:42:13.388269+0000","last_fullsized":"2024-05-30T06:42:13.388269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:09:54.618681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387999+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:42:13.387999+0000","last_peered":"2024-05-30T06:42:13.387999+0000","last_clean":"2024-05-30T06:42:13.387999+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:42:13.387999+0000","last_undegraded":"2024-05-30T06:42:13.387999+0000","last_fullsized":"2024-05-30T06:42:13.387999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418494+0000","last_change":"2024-05-30T06:42:10.410644+0000","last_active":"2024-05-30T06:42:12.418494+0000","last_peered":"2024-05-30T06:42:12.418494+0000","last_clean":"2024-05-30T06:42:12.418494+0000","last_became_active":"2024-05-30T06:42:10.408941+0000","last_became_peered":"2024-05-30T06:42:10.408941+0000","last_unstale":"2024-05-30T06:42:12.418494+0000","last_undegraded":"2024-05-30T06:42:12.418494+0000","last_fullsized":"2024-05-30T06:42:12.418494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771269+0000","last_change":"2024-05-30T06:42:11.437096+0000","last_active":"2024-05-30T06:42:12.771269+0000","last_peered":"2024-05-30T06:42:12.771269+0000","last_clean":"2024-05-30T06:42:12.771269+0000","last_became_active":"2024-05-30T06:42:11.436706+0000","last_became_peered":"2024-05-30T06:42:11.436706+0000","last_unstale":"2024-05-30T06:42:12.771269+0000","last_undegraded":"2024-05-30T06:42:12.771269+0000","last_fullsized":"2024-05-30T06:42:12.771269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387891+0000","last_change":"2024-05-30T06:42:10.422330+0000","last_active":"2024-05-30T06:42:13.387891+0000","last_peered":"2024-05-30T06:42:13.387891+0000","last_clean":"2024-05-30T06:42:13.387891+0000","last_became_active":"2024-05-30T06:42:10.422034+0000","last_became_peered":"2024-05-30T06:42:10.422034+0000","last_unstale":"2024-05-30T06:42:13.387891+0000","last_undegraded":"2024-05-30T06:42:13.387891+0000","last_fullsized":"2024-05-30T06:42:13.387891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:18:25.786944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583063+0000","last_change":"2024-05-30T06:42:11.452846+0000","last_active":"2024-05-30T06:42:13.583063+0000","last_peered":"2024-05-30T06:42:13.583063+0000","last_clean":"2024-05-30T06:42:13.583063+0000","last_became_active":"2024-05-30T06:42:11.452493+0000","last_became_peered":"2024-05-30T06:42:11.452493+0000","last_unstale":"2024-05-30T06:42:13.583063+0000","last_undegraded":"2024-05-30T06:42:13.583063+0000","last_fullsized":"2024-05-30T06:42:13.583063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:26:07.087132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419326+0000","last_change":"2024-05-30T06:42:10.404739+0000","last_active":"2024-05-30T06:42:12.419326+0000","last_peered":"2024-05-30T06:42:12.419326+0000","last_clean":"2024-05-30T06:42:12.419326+0000","last_became_active":"2024-05-30T06:42:10.404322+0000","last_became_peered":"2024-05-30T06:42:10.404322+0000","last_unstale":"2024-05-30T06:42:12.419326+0000","last_undegraded":"2024-05-30T06:42:12.419326+0000","last_fullsized":"2024-05-30T06:42:12.419326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420083+0000","last_change":"2024-05-30T06:42:11.439108+0000","last_active":"2024-05-30T06:42:12.420083+0000","last_peered":"2024-05-30T06:42:12.420083+0000","last_clean":"2024-05-30T06:42:12.420083+0000","last_became_active":"2024-05-30T06:42:11.438818+0000","last_became_peered":"2024-05-30T06:42:11.438818+0000","last_unstale":"2024-05-30T06:42:12.420083+0000","last_undegraded":"2024-05-30T06:42:12.420083+0000","last_fullsized":"2024-05-30T06:42:12.420083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419032+0000","last_change":"2024-05-30T06:42:10.411897+0000","last_active":"2024-05-30T06:42:12.419032+0000","last_peered":"2024-05-30T06:42:12.419032+0000","last_clean":"2024-05-30T06:42:12.419032+0000","last_became_active":"2024-05-30T06:42:10.411626+0000","last_became_peered":"2024-05-30T06:42:10.411626+0000","last_unstale":"2024-05-30T06:42:12.419032+0000","last_undegraded":"2024-05-30T06:42:12.419032+0000","last_fullsized":"2024-05-30T06:42:12.419032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583703+0000","last_change":"2024-05-30T06:42:11.446187+0000","last_active":"2024-05-30T06:42:13.583703+0000","last_peered":"2024-05-30T06:42:13.583703+0000","last_clean":"2024-05-30T06:42:13.583703+0000","last_became_active":"2024-05-30T06:42:11.445840+0000","last_became_peered":"2024-05-30T06:42:11.445840+0000","last_unstale":"2024-05-30T06:42:13.583703+0000","last_undegraded":"2024-05-30T06:42:13.583703+0000","last_fullsized":"2024-05-30T06:42:13.583703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:34.809415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420422+0000","last_change":"2024-05-30T06:42:10.428270+0000","last_active":"2024-05-30T06:42:12.420422+0000","last_peered":"2024-05-30T06:42:12.420422+0000","last_clean":"2024-05-30T06:42:12.420422+0000","last_became_active":"2024-05-30T06:42:10.427910+0000","last_became_peered":"2024-05-30T06:42:10.427910+0000","last_unstale":"2024-05-30T06:42:12.420422+0000","last_undegraded":"2024-05-30T06:42:12.420422+0000","last_fullsized":"2024-05-30T06:42:12.420422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:27.594625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418876+0000","last_change":"2024-05-30T06:42:11.438157+0000","last_active":"2024-05-30T06:42:12.418876+0000","last_peered":"2024-05-30T06:42:12.418876+0000","last_clean":"2024-05-30T06:42:12.418876+0000","last_became_active":"2024-05-30T06:42:11.437756+0000","last_became_peered":"2024-05-30T06:42:11.437756+0000","last_unstale":"2024-05-30T06:42:12.418876+0000","last_undegraded":"2024-05-30T06:42:12.418876+0000","last_fullsized":"2024-05-30T06:42:12.418876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:12.472477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388512+0000","last_change":"2024-05-30T06:42:10.427812+0000","last_active":"2024-05-30T06:42:13.388512+0000","last_peered":"2024-05-30T06:42:13.388512+0000","last_clean":"2024-05-30T06:42:13.388512+0000","last_became_active":"2024-05-30T06:42:10.427455+0000","last_became_peered":"2024-05-30T06:42:10.427455+0000","last_unstale":"2024-05-30T06:42:13.388512+0000","last_undegraded":"2024-05-30T06:42:13.388512+0000","last_fullsized":"2024-05-30T06:42:13.388512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:07:15.070876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420523+0000","last_change":"2024-05-30T06:42:11.440605+0000","last_active":"2024-05-30T06:42:12.420523+0000","last_peered":"2024-05-30T06:42:12.420523+0000","last_clean":"2024-05-30T06:42:12.420523+0000","last_became_active":"2024-05-30T06:42:11.440283+0000","last_became_peered":"2024-05-30T06:42:11.440283+0000","last_unstale":"2024-05-30T06:42:12.420523+0000","last_undegraded":"2024-05-30T06:42:12.420523+0000","last_fullsized":"2024-05-30T06:42:12.420523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461531+0000","last_change":"2024-05-30T06:42:10.418655+0000","last_active":"2024-05-30T06:42:12.461531+0000","last_peered":"2024-05-30T06:42:12.461531+0000","last_clean":"2024-05-30T06:42:12.461531+0000","last_became_active":"2024-05-30T06:42:10.418341+0000","last_became_peered":"2024-05-30T06:42:10.418341+0000","last_unstale":"2024-05-30T06:42:12.461531+0000","last_undegraded":"2024-05-30T06:42:12.461531+0000","last_fullsized":"2024-05-30T06:42:12.461531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:18:25.786944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771711+0000","last_change":"2024-05-30T06:42:11.443605+0000","last_active":"2024-05-30T06:42:12.771711+0000","last_peered":"2024-05-30T06:42:12.771711+0000","last_clean":"2024-05-30T06:42:12.771711+0000","last_became_active":"2024-05-30T06:42:11.443352+0000","last_became_peered":"2024-05-30T06:42:11.443352+0000","last_unstale":"2024-05-30T06:42:12.771711+0000","last_undegraded":"2024-05-30T06:42:12.771711+0000","last_fullsized":"2024-05-30T06:42:12.771711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:07.193945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462314+0000","last_change":"2024-05-30T06:42:10.418571+0000","last_active":"2024-05-30T06:42:12.462314+0000","last_peered":"2024-05-30T06:42:12.462314+0000","last_clean":"2024-05-30T06:42:12.462314+0000","last_became_active":"2024-05-30T06:42:10.418264+0000","last_became_peered":"2024-05-30T06:42:10.418264+0000","last_unstale":"2024-05-30T06:42:12.462314+0000","last_undegraded":"2024-05-30T06:42:12.462314+0000","last_fullsized":"2024-05-30T06:42:12.462314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583371+0000","last_change":"2024-05-30T06:42:11.425449+0000","last_active":"2024-05-30T06:42:13.583371+0000","last_peered":"2024-05-30T06:42:13.583371+0000","last_clean":"2024-05-30T06:42:13.583371+0000","last_became_active":"2024-05-30T06:42:11.425140+0000","last_became_peered":"2024-05-30T06:42:11.425140+0000","last_unstale":"2024-05-30T06:42:13.583371+0000","last_undegraded":"2024-05-30T06:42:13.583371+0000","last_fullsized":"2024-05-30T06:42:13.583371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387867+0000","last_change":"2024-05-30T06:42:10.426724+0000","last_active":"2024-05-30T06:42:13.387867+0000","last_peered":"2024-05-30T06:42:13.387867+0000","last_clean":"2024-05-30T06:42:13.387867+0000","last_became_active":"2024-05-30T06:42:10.426443+0000","last_became_peered":"2024-05-30T06:42:10.426443+0000","last_unstale":"2024-05-30T06:42:13.387867+0000","last_undegraded":"2024-05-30T06:42:13.387867+0000","last_fullsized":"2024-05-30T06:42:13.387867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:27.594625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583558+0000","last_change":"2024-05-30T06:42:11.441051+0000","last_active":"2024-05-30T06:42:13.583558+0000","last_peered":"2024-05-30T06:42:13.583558+0000","last_clean":"2024-05-30T06:42:13.583558+0000","last_became_active":"2024-05-30T06:42:11.440776+0000","last_became_peered":"2024-05-30T06:42:11.440776+0000","last_unstale":"2024-05-30T06:42:13.583558+0000","last_undegraded":"2024-05-30T06:42:13.583558+0000","last_fullsized":"2024-05-30T06:42:13.583558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:31.686531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420193+0000","last_change":"2024-05-30T06:42:10.423040+0000","last_active":"2024-05-30T06:42:12.420193+0000","last_peered":"2024-05-30T06:42:12.420193+0000","last_clean":"2024-05-30T06:42:12.420193+0000","last_became_active":"2024-05-30T06:42:10.422580+0000","last_became_peered":"2024-05-30T06:42:10.422580+0000","last_unstale":"2024-05-30T06:42:12.420193+0000","last_undegraded":"2024-05-30T06:42:12.420193+0000","last_fullsized":"2024-05-30T06:42:12.420193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:57:09.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771674+0000","last_change":"2024-05-30T06:42:11.431142+0000","last_active":"2024-05-30T06:42:12.771674+0000","last_peered":"2024-05-30T06:42:12.771674+0000","last_clean":"2024-05-30T06:42:12.771674+0000","last_became_active":"2024-05-30T06:42:11.430833+0000","last_became_peered":"2024-05-30T06:42:11.430833+0000","last_unstale":"2024-05-30T06:42:12.771674+0000","last_undegraded":"2024-05-30T06:42:12.771674+0000","last_fullsized":"2024-05-30T06:42:12.771674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:12.472477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420260+0000","last_change":"2024-05-30T06:42:10.415437+0000","last_active":"2024-05-30T06:42:12.420260+0000","last_peered":"2024-05-30T06:42:12.420260+0000","last_clean":"2024-05-30T06:42:12.420260+0000","last_became_active":"2024-05-30T06:42:10.414954+0000","last_became_peered":"2024-05-30T06:42:10.414954+0000","last_unstale":"2024-05-30T06:42:12.420260+0000","last_undegraded":"2024-05-30T06:42:12.420260+0000","last_fullsized":"2024-05-30T06:42:12.420260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771534+0000","last_change":"2024-05-30T06:42:11.429843+0000","last_active":"2024-05-30T06:42:12.771534+0000","last_peered":"2024-05-30T06:42:12.771534+0000","last_clean":"2024-05-30T06:42:12.771534+0000","last_became_active":"2024-05-30T06:42:11.429428+0000","last_became_peered":"2024-05-30T06:42:11.429428+0000","last_unstale":"2024-05-30T06:42:12.771534+0000","last_undegraded":"2024-05-30T06:42:12.771534+0000","last_fullsized":"2024-05-30T06:42:12.771534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:04:58.409141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388321+0000","last_change":"2024-05-30T06:42:10.430372+0000","last_active":"2024-05-30T06:42:13.388321+0000","last_peered":"2024-05-30T06:42:13.388321+0000","last_clean":"2024-05-30T06:42:13.388321+0000","last_became_active":"2024-05-30T06:42:10.430029+0000","last_became_peered":"2024-05-30T06:42:10.430029+0000","last_unstale":"2024-05-30T06:42:13.388321+0000","last_undegraded":"2024-05-30T06:42:13.388321+0000","last_fullsized":"2024-05-30T06:42:13.388321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:51:39.946209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462037+0000","last_change":"2024-05-30T06:42:11.450489+0000","last_active":"2024-05-30T06:42:12.462037+0000","last_peered":"2024-05-30T06:42:12.462037+0000","last_clean":"2024-05-30T06:42:12.462037+0000","last_became_active":"2024-05-30T06:42:11.446807+0000","last_became_peered":"2024-05-30T06:42:11.446807+0000","last_unstale":"2024-05-30T06:42:12.462037+0000","last_undegraded":"2024-05-30T06:42:12.462037+0000","last_fullsized":"2024-05-30T06:42:12.462037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:41.693793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418833+0000","last_change":"2024-05-30T06:42:11.446469+0000","last_active":"2024-05-30T06:42:12.418833+0000","last_peered":"2024-05-30T06:42:12.418833+0000","last_clean":"2024-05-30T06:42:12.418833+0000","last_became_active":"2024-05-30T06:42:11.446178+0000","last_became_peered":"2024-05-30T06:42:11.446178+0000","last_unstale":"2024-05-30T06:42:12.418833+0000","last_undegraded":"2024-05-30T06:42:12.418833+0000","last_fullsized":"2024-05-30T06:42:12.418833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:05.695381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388169+0000","last_change":"2024-05-30T06:42:10.424259+0000","last_active":"2024-05-30T06:42:13.388169+0000","last_peered":"2024-05-30T06:42:13.388169+0000","last_clean":"2024-05-30T06:42:13.388169+0000","last_became_active":"2024-05-30T06:42:10.423972+0000","last_became_peered":"2024-05-30T06:42:10.423972+0000","last_unstale":"2024-05-30T06:42:13.388169+0000","last_undegraded":"2024-05-30T06:42:13.388169+0000","last_fullsized":"2024-05-30T06:42:13.388169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:06:59.985658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419003+0000","last_change":"2024-05-30T06:42:11.451914+0000","last_active":"2024-05-30T06:42:12.419003+0000","last_peered":"2024-05-30T06:42:12.419003+0000","last_clean":"2024-05-30T06:42:12.419003+0000","last_became_active":"2024-05-30T06:42:11.451633+0000","last_became_peered":"2024-05-30T06:42:11.451633+0000","last_unstale":"2024-05-30T06:42:12.419003+0000","last_undegraded":"2024-05-30T06:42:12.419003+0000","last_fullsized":"2024-05-30T06:42:12.419003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:28:18.705789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388431+0000","last_change":"2024-05-30T06:42:10.427805+0000","last_active":"2024-05-30T06:42:13.388431+0000","last_peered":"2024-05-30T06:42:13.388431+0000","last_clean":"2024-05-30T06:42:13.388431+0000","last_became_active":"2024-05-30T06:42:10.427452+0000","last_became_peered":"2024-05-30T06:42:10.427452+0000","last_unstale":"2024-05-30T06:42:13.388431+0000","last_undegraded":"2024-05-30T06:42:13.388431+0000","last_fullsized":"2024-05-30T06:42:13.388431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:52.729379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583434+0000","last_change":"2024-05-30T06:42:11.432129+0000","last_active":"2024-05-30T06:42:13.583434+0000","last_peered":"2024-05-30T06:42:13.583434+0000","last_clean":"2024-05-30T06:42:13.583434+0000","last_became_active":"2024-05-30T06:42:11.431823+0000","last_became_peered":"2024-05-30T06:42:11.431823+0000","last_unstale":"2024-05-30T06:42:13.583434+0000","last_undegraded":"2024-05-30T06:42:13.583434+0000","last_fullsized":"2024-05-30T06:42:13.583434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771534+0000","last_change":"2024-05-30T06:42:10.426946+0000","last_active":"2024-05-30T06:42:12.771534+0000","last_peered":"2024-05-30T06:42:12.771534+0000","last_clean":"2024-05-30T06:42:12.771534+0000","last_became_active":"2024-05-30T06:42:10.426667+0000","last_became_peered":"2024-05-30T06:42:10.426667+0000","last_unstale":"2024-05-30T06:42:12.771534+0000","last_undegraded":"2024-05-30T06:42:12.771534+0000","last_fullsized":"2024-05-30T06:42:12.771534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:17.465458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771418+0000","last_change":"2024-05-30T06:42:11.436144+0000","last_active":"2024-05-30T06:42:12.771418+0000","last_peered":"2024-05-30T06:42:12.771418+0000","last_clean":"2024-05-30T06:42:12.771418+0000","last_became_active":"2024-05-30T06:42:11.435885+0000","last_became_peered":"2024-05-30T06:42:11.435885+0000","last_unstale":"2024-05-30T06:42:12.771418+0000","last_undegraded":"2024-05-30T06:42:12.771418+0000","last_fullsized":"2024-05-30T06:42:12.771418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583529+0000","last_change":"2024-05-30T06:42:10.433516+0000","last_active":"2024-05-30T06:42:13.583529+0000","last_peered":"2024-05-30T06:42:13.583529+0000","last_clean":"2024-05-30T06:42:13.583529+0000","last_became_active":"2024-05-30T06:42:10.433200+0000","last_became_peered":"2024-05-30T06:42:10.433200+0000","last_unstale":"2024-05-30T06:42:13.583529+0000","last_undegraded":"2024-05-30T06:42:13.583529+0000","last_fullsized":"2024-05-30T06:42:13.583529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:43:33.658279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:42:15.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:42:15.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd1d200640 1 Processor -- start 2024-05-30T06:42:15.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd1d200640 1 -- start start 2024-05-30T06:42:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd1d200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd180b2ec0 0x7fbd180b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd1d200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd1815c8f0 con 0x7fbd1806f9a0 2024-05-30T06:42:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd1d200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd180ccc80 con 0x7fbd18155e60 2024-05-30T06:42:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd1d200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd180ccff0 con 0x7fbd180b2ec0 2024-05-30T06:42:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd0fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbd1806f9a0 0x7fbd180cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60728/0 (socket says 172.21.15.37:60728) 2024-05-30T06:42:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd0fe00640 1 -- 172.21.15.37:0/538548307 learned_addr learned my addr 172.21.15.37:0/538548307 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd16800640 1 --2- 172.21.15.37:0/538548307 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd180b2ec0 0x7fbd180b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd15400640 1 -- 172.21.15.37:0/538548307 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2698810890 0 0) 0x7fbd1815c8f0 con 0x7fbd1806f9a0 2024-05-30T06:42:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd15400640 1 -- 172.21.15.37:0/538548307 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcfc003530 con 0x7fbd1806f9a0 2024-05-30T06:42:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd15400640 1 -- 172.21.15.37:0/538548307 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1636390054 0 0) 0x7fbd180ccc80 con 0x7fbd18155e60 2024-05-30T06:42:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd15400640 1 -- 172.21.15.37:0/538548307 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd1815c8f0 con 0x7fbd18155e60 2024-05-30T06:42:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd16800640 1 -- 172.21.15.37:0/538548307 >> v1:172.21.15.105:6789/0 conn(0x7fbd18155e60 legacy=0x7fbd180cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd16800640 1 -- 172.21.15.37:0/538548307 >> v1:172.21.15.37:6789/0 conn(0x7fbd1806f9a0 legacy=0x7fbd180cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.739+0000 7fbd16800640 1 -- 172.21.15.37:0/538548307 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1815cbd0 con 0x7fbd180b2ec0 2024-05-30T06:42:15.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.743+0000 7fbd16800640 1 --2- 172.21.15.37:0/538548307 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd180b2ec0 0x7fbd180b36a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009dc0 tx=0x7fbd1001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=940d28bc87a89f65 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:15.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.743+0000 7fbd15400640 1 -- 172.21.15.37:0/538548307 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd100b2070 con 0x7fbd180b2ec0 2024-05-30T06:42:15.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.743+0000 7fbd15400640 1 -- 172.21.15.37:0/538548307 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd100a5920 con 0x7fbd180b2ec0 2024-05-30T06:42:15.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.743+0000 7fbd15400640 1 -- 172.21.15.37:0/538548307 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd100a5cd0 con 0x7fbd180b2ec0 2024-05-30T06:42:15.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.743+0000 7fbd1d200640 1 -- 172.21.15.37:0/538548307 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd180b2ec0 msgr2=0x7fbd180b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.743+0000 7fbd1d200640 1 --2- 172.21.15.37:0/538548307 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd180b2ec0 0x7fbd180b36a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009dc0 tx=0x7fbd1001c990 comp rx=0 tx=0).stop 2024-05-30T06:42:15.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.743+0000 7fbd1d200640 1 -- 172.21.15.37:0/538548307 shutdown_connections 2024-05-30T06:42:15.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.743+0000 7fbd1d200640 1 --2- 172.21.15.37:0/538548307 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd180b2ec0 0x7fbd180b36a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.743+0000 7fbd1d200640 1 -- 172.21.15.37:0/538548307 >> 172.21.15.37:0/538548307 conn(0x7fbd180b23a0 msgr2=0x7fbd180b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.743+0000 7fbd1d200640 1 -- 172.21.15.37:0/538548307 shutdown_connections 2024-05-30T06:42:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.743+0000 7fbd1d200640 1 -- 172.21.15.37:0/538548307 wait complete. 2024-05-30T06:42:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.743+0000 7fbd1d200640 1 Processor -- start 2024-05-30T06:42:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd1d200640 1 -- start start 2024-05-30T06:42:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd1d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd1806f9a0 0x7fbd18150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd1d200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd180b2ec0 0x7fbd18156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd1d200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd18155e60 0x7fbd18140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd1d200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1806ec20 con 0x7fbd1806f9a0 2024-05-30T06:42:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd1d200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1806eaa0 con 0x7fbd18155e60 2024-05-30T06:42:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd1d200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd1806eda0 con 0x7fbd180b2ec0 2024-05-30T06:42:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd15e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd1806f9a0 0x7fbd18150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd15e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd1806f9a0 0x7fbd18150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60372/0 (socket says 172.21.15.37:60372) 2024-05-30T06:42:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd15e00640 1 -- 172.21.15.37:0/1062344566 learned_addr learned my addr 172.21.15.37:0/1062344566 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd16800640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd18155e60 0x7fbd18140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd0fe00640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd180b2ec0 0x7fbd18156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd15e00640 1 -- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd180b2ec0 msgr2=0x7fbd18156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd15e00640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd180b2ec0 0x7fbd18156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd15e00640 1 -- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd18155e60 msgr2=0x7fbd18140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd15e00640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd18155e60 0x7fbd18140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd15e00640 1 -- 172.21.15.37:0/1062344566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd18140590 con 0x7fbd1806f9a0 2024-05-30T06:42:15.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd0fe00640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd180b2ec0 0x7fbd18156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:15.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd15e00640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd1806f9a0 0x7fbd18150590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800c430 tx=0x7fbd0800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:15.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd0e000640 1 -- 172.21.15.37:0/1062344566 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08017070 con 0x7fbd1806f9a0 2024-05-30T06:42:15.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd0e000640 1 -- 172.21.15.37:0/1062344566 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd080052f0 con 0x7fbd1806f9a0 2024-05-30T06:42:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd0e000640 1 -- 172.21.15.37:0/1062344566 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08003840 con 0x7fbd1806f9a0 2024-05-30T06:42:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd1d200640 1 -- 172.21.15.37:0/1062344566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd18152e90 con 0x7fbd1806f9a0 2024-05-30T06:42:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd1d200640 1 -- 172.21.15.37:0/1062344566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd18153450 con 0x7fbd1806f9a0 2024-05-30T06:42:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.747+0000 7fbd1d200640 1 -- 172.21.15.37:0/1062344566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd18068b20 con 0x7fbd1806f9a0 2024-05-30T06:42:15.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.751+0000 7fbd0e000640 1 -- 172.21.15.37:0/1062344566 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd0801a070 con 0x7fbd1806f9a0 2024-05-30T06:42:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.751+0000 7fbd0e000640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbcf4068380 0x7fbcf406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.751+0000 7fbd0e000640 1 -- 172.21.15.37:0/1062344566 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbd08085c90 con 0x7fbd1806f9a0 2024-05-30T06:42:15.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.751+0000 7fbd0fe00640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbcf4068380 0x7fbcf406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:15.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.751+0000 7fbd0fe00640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbcf4068380 0x7fbcf406a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbd18154430 tx=0x7fbd00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:15.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.755+0000 7fbd0e000640 1 -- 172.21.15.37:0/1062344566 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbd080562e0 con 0x7fbd1806f9a0 2024-05-30T06:42:15.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.915+0000 7fbd1d200640 1 -- 172.21.15.37:0/1062344566 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd18070180 con 0x7fbcf4068380 2024-05-30T06:42:15.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.923+0000 7fbd0e000640 1 -- 172.21.15.37:0/1062344566 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251946 (secure 0 0 0) 0x7fbd18070180 con 0x7fbcf4068380 2024-05-30T06:42:15.924 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:15.925 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:42:15.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.927+0000 7fbd1d200640 1 -- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbcf4068380 msgr2=0x7fbcf406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.927+0000 7fbd1d200640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbcf4068380 0x7fbcf406a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbd18154430 tx=0x7fbd00009040 comp rx=0 tx=0).stop 2024-05-30T06:42:15.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.927+0000 7fbd1d200640 1 -- 172.21.15.37:0/1062344566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd1806f9a0 msgr2=0x7fbd18150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:15.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.927+0000 7fbd1d200640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd1806f9a0 0x7fbd18150590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800c430 tx=0x7fbd0800c8f0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.927+0000 7fbd1d200640 1 -- 172.21.15.37:0/1062344566 shutdown_connections 2024-05-30T06:42:15.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.927+0000 7fbd1d200640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbcf4068380 0x7fbcf406a840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.927+0000 7fbd1d200640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd18155e60 0x7fbd18140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.927+0000 7fbd1d200640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd180b2ec0 0x7fbd18156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.927+0000 7fbd1d200640 1 --2- 172.21.15.37:0/1062344566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd1806f9a0 0x7fbd18150590 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:15.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.927+0000 7fbd1d200640 1 -- 172.21.15.37:0/1062344566 >> 172.21.15.37:0/1062344566 conn(0x7fbd180b23a0 msgr2=0x7fbd180b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:15.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.927+0000 7fbd1d200640 1 -- 172.21.15.37:0/1062344566 shutdown_connections 2024-05-30T06:42:15.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:15.927+0000 7fbd1d200640 1 -- 172.21.15.37:0/1062344566 wait complete. 2024-05-30T06:42:15.945 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-05-30T06:42:14.640897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218972,"kb_used_data":2788,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755748,"statfs":{"total":773094113280,"available":772869885952,"internally_reserved":0,"allocated":2854912,"data_stored":1734128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.250688"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388642+0000","last_change":"2024-05-30T06:42:11.435488+0000","last_active":"2024-05-30T06:42:13.388642+0000","last_peered":"2024-05-30T06:42:13.388642+0000","last_clean":"2024-05-30T06:42:13.388642+0000","last_became_active":"2024-05-30T06:42:11.435224+0000","last_became_peered":"2024-05-30T06:42:11.435224+0000","last_unstale":"2024-05-30T06:42:13.388642+0000","last_undegraded":"2024-05-30T06:42:13.388642+0000","last_fullsized":"2024-05-30T06:42:13.388642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:02.703778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420451+0000","last_change":"2024-05-30T06:42:11.432162+0000","last_active":"2024-05-30T06:42:12.420451+0000","last_peered":"2024-05-30T06:42:12.420451+0000","last_clean":"2024-05-30T06:42:12.420451+0000","last_became_active":"2024-05-30T06:42:11.431837+0000","last_became_peered":"2024-05-30T06:42:11.431837+0000","last_unstale":"2024-05-30T06:42:12.420451+0000","last_undegraded":"2024-05-30T06:42:12.420451+0000","last_fullsized":"2024-05-30T06:42:12.420451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583246+0000","last_change":"2024-05-30T06:42:11.444273+0000","last_active":"2024-05-30T06:42:13.583246+0000","last_peered":"2024-05-30T06:42:13.583246+0000","last_clean":"2024-05-30T06:42:13.583246+0000","last_became_active":"2024-05-30T06:42:11.443918+0000","last_became_peered":"2024-05-30T06:42:11.443918+0000","last_unstale":"2024-05-30T06:42:13.583246+0000","last_undegraded":"2024-05-30T06:42:13.583246+0000","last_fullsized":"2024-05-30T06:42:13.583246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418697+0000","last_change":"2024-05-30T06:42:11.434052+0000","last_active":"2024-05-30T06:42:12.418697+0000","last_peered":"2024-05-30T06:42:12.418697+0000","last_clean":"2024-05-30T06:42:12.418697+0000","last_became_active":"2024-05-30T06:42:11.433700+0000","last_became_peered":"2024-05-30T06:42:11.433700+0000","last_unstale":"2024-05-30T06:42:12.418697+0000","last_undegraded":"2024-05-30T06:42:12.418697+0000","last_fullsized":"2024-05-30T06:42:12.418697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:04:58.409141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388154+0000","last_change":"2024-05-30T06:42:11.440147+0000","last_active":"2024-05-30T06:42:13.388154+0000","last_peered":"2024-05-30T06:42:13.388154+0000","last_clean":"2024-05-30T06:42:13.388154+0000","last_became_active":"2024-05-30T06:42:11.439811+0000","last_became_peered":"2024-05-30T06:42:11.439811+0000","last_unstale":"2024-05-30T06:42:13.388154+0000","last_undegraded":"2024-05-30T06:42:13.388154+0000","last_fullsized":"2024-05-30T06:42:13.388154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:05:31.913179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418707+0000","last_change":"2024-05-30T06:42:11.434320+0000","last_active":"2024-05-30T06:42:12.418707+0000","last_peered":"2024-05-30T06:42:12.418707+0000","last_clean":"2024-05-30T06:42:12.418707+0000","last_became_active":"2024-05-30T06:42:11.433756+0000","last_became_peered":"2024-05-30T06:42:11.433756+0000","last_unstale":"2024-05-30T06:42:12.418707+0000","last_undegraded":"2024-05-30T06:42:12.418707+0000","last_fullsized":"2024-05-30T06:42:12.418707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387999+0000","last_change":"2024-05-30T06:42:11.433123+0000","last_active":"2024-05-30T06:42:13.387999+0000","last_peered":"2024-05-30T06:42:13.387999+0000","last_clean":"2024-05-30T06:42:13.387999+0000","last_became_active":"2024-05-30T06:42:11.432861+0000","last_became_peered":"2024-05-30T06:42:11.432861+0000","last_unstale":"2024-05-30T06:42:13.387999+0000","last_undegraded":"2024-05-30T06:42:13.387999+0000","last_fullsized":"2024-05-30T06:42:13.387999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:12.472477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771210+0000","last_change":"2024-05-30T06:42:11.440463+0000","last_active":"2024-05-30T06:42:12.771210+0000","last_peered":"2024-05-30T06:42:12.771210+0000","last_clean":"2024-05-30T06:42:12.771210+0000","last_became_active":"2024-05-30T06:42:11.440179+0000","last_became_peered":"2024-05-30T06:42:11.440179+0000","last_unstale":"2024-05-30T06:42:12.771210+0000","last_undegraded":"2024-05-30T06:42:12.771210+0000","last_fullsized":"2024-05-30T06:42:12.771210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388697+0000","last_change":"2024-05-30T06:42:11.438364+0000","last_active":"2024-05-30T06:42:13.388697+0000","last_peered":"2024-05-30T06:42:13.388697+0000","last_clean":"2024-05-30T06:42:13.388697+0000","last_became_active":"2024-05-30T06:42:11.438010+0000","last_became_peered":"2024-05-30T06:42:11.438010+0000","last_unstale":"2024-05-30T06:42:13.388697+0000","last_undegraded":"2024-05-30T06:42:13.388697+0000","last_fullsized":"2024-05-30T06:42:13.388697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:44:42.856118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462336+0000","last_change":"2024-05-30T06:42:11.436077+0000","last_active":"2024-05-30T06:42:12.462336+0000","last_peered":"2024-05-30T06:42:12.462336+0000","last_clean":"2024-05-30T06:42:12.462336+0000","last_became_active":"2024-05-30T06:42:11.435686+0000","last_became_peered":"2024-05-30T06:42:11.435686+0000","last_unstale":"2024-05-30T06:42:12.462336+0000","last_undegraded":"2024-05-30T06:42:12.462336+0000","last_fullsized":"2024-05-30T06:42:12.462336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462200+0000","last_change":"2024-05-30T06:42:11.441401+0000","last_active":"2024-05-30T06:42:12.462200+0000","last_peered":"2024-05-30T06:42:12.462200+0000","last_clean":"2024-05-30T06:42:12.462200+0000","last_became_active":"2024-05-30T06:42:11.440895+0000","last_became_peered":"2024-05-30T06:42:11.440895+0000","last_unstale":"2024-05-30T06:42:12.462200+0000","last_undegraded":"2024-05-30T06:42:12.462200+0000","last_fullsized":"2024-05-30T06:42:12.462200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583872+0000","last_change":"2024-05-30T06:42:11.444435+0000","last_active":"2024-05-30T06:42:13.583872+0000","last_peered":"2024-05-30T06:42:13.583872+0000","last_clean":"2024-05-30T06:42:13.583872+0000","last_became_active":"2024-05-30T06:42:11.444162+0000","last_became_peered":"2024-05-30T06:42:11.444162+0000","last_unstale":"2024-05-30T06:42:13.583872+0000","last_undegraded":"2024-05-30T06:42:13.583872+0000","last_fullsized":"2024-05-30T06:42:13.583872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:18:26.795557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771470+0000","last_change":"2024-05-30T06:42:11.430118+0000","last_active":"2024-05-30T06:42:12.771470+0000","last_peered":"2024-05-30T06:42:12.771470+0000","last_clean":"2024-05-30T06:42:12.771470+0000","last_became_active":"2024-05-30T06:42:11.429821+0000","last_became_peered":"2024-05-30T06:42:11.429821+0000","last_unstale":"2024-05-30T06:42:12.771470+0000","last_undegraded":"2024-05-30T06:42:12.771470+0000","last_fullsized":"2024-05-30T06:42:12.771470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:16.106604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.582964+0000","last_change":"2024-05-30T06:42:11.426742+0000","last_active":"2024-05-30T06:42:13.582964+0000","last_peered":"2024-05-30T06:42:13.582964+0000","last_clean":"2024-05-30T06:42:13.582964+0000","last_became_active":"2024-05-30T06:42:11.426182+0000","last_became_peered":"2024-05-30T06:42:11.426182+0000","last_unstale":"2024-05-30T06:42:13.582964+0000","last_undegraded":"2024-05-30T06:42:13.582964+0000","last_fullsized":"2024-05-30T06:42:13.582964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:07:16.079488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420135+0000","last_change":"2024-05-30T06:42:11.452976+0000","last_active":"2024-05-30T06:42:12.420135+0000","last_peered":"2024-05-30T06:42:12.420135+0000","last_clean":"2024-05-30T06:42:12.420135+0000","last_became_active":"2024-05-30T06:42:11.452525+0000","last_became_peered":"2024-05-30T06:42:11.452525+0000","last_unstale":"2024-05-30T06:42:12.420135+0000","last_undegraded":"2024-05-30T06:42:12.420135+0000","last_fullsized":"2024-05-30T06:42:12.420135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418654+0000","last_change":"2024-05-30T06:42:11.437421+0000","last_active":"2024-05-30T06:42:12.418654+0000","last_peered":"2024-05-30T06:42:12.418654+0000","last_clean":"2024-05-30T06:42:12.418654+0000","last_became_active":"2024-05-30T06:42:11.432053+0000","last_became_peered":"2024-05-30T06:42:11.432053+0000","last_unstale":"2024-05-30T06:42:12.418654+0000","last_undegraded":"2024-05-30T06:42:12.418654+0000","last_fullsized":"2024-05-30T06:42:12.418654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:16.106604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419366+0000","last_change":"2024-05-30T06:42:11.443729+0000","last_active":"2024-05-30T06:42:12.419366+0000","last_peered":"2024-05-30T06:42:12.419366+0000","last_clean":"2024-05-30T06:42:12.419366+0000","last_became_active":"2024-05-30T06:42:11.443424+0000","last_became_peered":"2024-05-30T06:42:11.443424+0000","last_unstale":"2024-05-30T06:42:12.419366+0000","last_undegraded":"2024-05-30T06:42:12.419366+0000","last_fullsized":"2024-05-30T06:42:12.419366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:29:42.983707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419530+0000","last_change":"2024-05-30T06:42:11.443761+0000","last_active":"2024-05-30T06:42:12.419530+0000","last_peered":"2024-05-30T06:42:12.419530+0000","last_clean":"2024-05-30T06:42:12.419530+0000","last_became_active":"2024-05-30T06:42:11.443453+0000","last_became_peered":"2024-05-30T06:42:11.443453+0000","last_unstale":"2024-05-30T06:42:12.419530+0000","last_undegraded":"2024-05-30T06:42:12.419530+0000","last_fullsized":"2024-05-30T06:42:12.419530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:51:40.954821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388493+0000","last_change":"2024-05-30T06:42:11.445389+0000","last_active":"2024-05-30T06:42:13.388493+0000","last_peered":"2024-05-30T06:42:13.388493+0000","last_clean":"2024-05-30T06:42:13.388493+0000","last_became_active":"2024-05-30T06:42:11.444984+0000","last_became_peered":"2024-05-30T06:42:11.444984+0000","last_unstale":"2024-05-30T06:42:13.388493+0000","last_undegraded":"2024-05-30T06:42:13.388493+0000","last_fullsized":"2024-05-30T06:42:13.388493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:48:21.800907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462107+0000","last_change":"2024-05-30T06:42:11.453799+0000","last_active":"2024-05-30T06:42:12.462107+0000","last_peered":"2024-05-30T06:42:12.462107+0000","last_clean":"2024-05-30T06:42:12.462107+0000","last_became_active":"2024-05-30T06:42:11.453488+0000","last_became_peered":"2024-05-30T06:42:11.453488+0000","last_unstale":"2024-05-30T06:42:12.462107+0000","last_undegraded":"2024-05-30T06:42:12.462107+0000","last_fullsized":"2024-05-30T06:42:12.462107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583121+0000","last_change":"2024-05-30T06:42:11.428247+0000","last_active":"2024-05-30T06:42:13.583121+0000","last_peered":"2024-05-30T06:42:13.583121+0000","last_clean":"2024-05-30T06:42:13.583121+0000","last_became_active":"2024-05-30T06:42:11.427950+0000","last_became_peered":"2024-05-30T06:42:11.427950+0000","last_unstale":"2024-05-30T06:42:13.583121+0000","last_undegraded":"2024-05-30T06:42:13.583121+0000","last_fullsized":"2024-05-30T06:42:13.583121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:41.693793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418922+0000","last_change":"2024-05-30T06:42:11.434081+0000","last_active":"2024-05-30T06:42:12.418922+0000","last_peered":"2024-05-30T06:42:12.418922+0000","last_clean":"2024-05-30T06:42:12.418922+0000","last_became_active":"2024-05-30T06:42:11.433267+0000","last_became_peered":"2024-05-30T06:42:11.433267+0000","last_unstale":"2024-05-30T06:42:12.418922+0000","last_undegraded":"2024-05-30T06:42:12.418922+0000","last_fullsized":"2024-05-30T06:42:12.418922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:07.193945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771221+0000","last_change":"2024-05-30T06:42:11.445981+0000","last_active":"2024-05-30T06:42:12.771221+0000","last_peered":"2024-05-30T06:42:12.771221+0000","last_clean":"2024-05-30T06:42:12.771221+0000","last_became_active":"2024-05-30T06:42:11.445642+0000","last_became_peered":"2024-05-30T06:42:11.445642+0000","last_unstale":"2024-05-30T06:42:12.771221+0000","last_undegraded":"2024-05-30T06:42:12.771221+0000","last_fullsized":"2024-05-30T06:42:12.771221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418715+0000","last_change":"2024-05-30T06:42:11.434545+0000","last_active":"2024-05-30T06:42:12.418715+0000","last_peered":"2024-05-30T06:42:12.418715+0000","last_clean":"2024-05-30T06:42:12.418715+0000","last_became_active":"2024-05-30T06:42:11.431097+0000","last_became_peered":"2024-05-30T06:42:11.431097+0000","last_unstale":"2024-05-30T06:42:12.418715+0000","last_undegraded":"2024-05-30T06:42:12.418715+0000","last_fullsized":"2024-05-30T06:42:12.418715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:15.413953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771539+0000","last_change":"2024-05-30T06:42:11.454371+0000","last_active":"2024-05-30T06:42:12.771539+0000","last_peered":"2024-05-30T06:42:12.771539+0000","last_clean":"2024-05-30T06:42:12.771539+0000","last_became_active":"2024-05-30T06:42:11.454064+0000","last_became_peered":"2024-05-30T06:42:11.454064+0000","last_unstale":"2024-05-30T06:42:12.771539+0000","last_undegraded":"2024-05-30T06:42:12.771539+0000","last_fullsized":"2024-05-30T06:42:12.771539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:15.413953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462346+0000","last_change":"2024-05-30T06:42:11.439382+0000","last_active":"2024-05-30T06:42:12.462346+0000","last_peered":"2024-05-30T06:42:12.462346+0000","last_clean":"2024-05-30T06:42:12.462346+0000","last_became_active":"2024-05-30T06:42:11.439071+0000","last_became_peered":"2024-05-30T06:42:11.439071+0000","last_unstale":"2024-05-30T06:42:12.462346+0000","last_undegraded":"2024-05-30T06:42:12.462346+0000","last_fullsized":"2024-05-30T06:42:12.462346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420317+0000","last_change":"2024-05-30T06:42:11.436698+0000","last_active":"2024-05-30T06:42:12.420317+0000","last_peered":"2024-05-30T06:42:12.420317+0000","last_clean":"2024-05-30T06:42:12.420317+0000","last_became_active":"2024-05-30T06:42:11.436378+0000","last_became_peered":"2024-05-30T06:42:11.436378+0000","last_unstale":"2024-05-30T06:42:12.420317+0000","last_undegraded":"2024-05-30T06:42:12.420317+0000","last_fullsized":"2024-05-30T06:42:12.420317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771611+0000","last_change":"2024-05-30T06:42:11.454323+0000","last_active":"2024-05-30T06:42:12.771611+0000","last_peered":"2024-05-30T06:42:12.771611+0000","last_clean":"2024-05-30T06:42:12.771611+0000","last_became_active":"2024-05-30T06:42:11.454037+0000","last_became_peered":"2024-05-30T06:42:11.454037+0000","last_unstale":"2024-05-30T06:42:12.771611+0000","last_undegraded":"2024-05-30T06:42:12.771611+0000","last_fullsized":"2024-05-30T06:42:12.771611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:05.695381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583186+0000","last_change":"2024-05-30T06:42:11.432774+0000","last_active":"2024-05-30T06:42:13.583186+0000","last_peered":"2024-05-30T06:42:13.583186+0000","last_clean":"2024-05-30T06:42:13.583186+0000","last_became_active":"2024-05-30T06:42:11.432430+0000","last_became_peered":"2024-05-30T06:42:11.432430+0000","last_unstale":"2024-05-30T06:42:13.583186+0000","last_undegraded":"2024-05-30T06:42:13.583186+0000","last_fullsized":"2024-05-30T06:42:13.583186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418923+0000","last_change":"2024-05-30T06:42:11.435991+0000","last_active":"2024-05-30T06:42:12.418923+0000","last_peered":"2024-05-30T06:42:12.418923+0000","last_clean":"2024-05-30T06:42:12.418923+0000","last_became_active":"2024-05-30T06:42:11.435283+0000","last_became_peered":"2024-05-30T06:42:11.435283+0000","last_unstale":"2024-05-30T06:42:12.418923+0000","last_undegraded":"2024-05-30T06:42:12.418923+0000","last_fullsized":"2024-05-30T06:42:12.418923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:05:31.913179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419353+0000","last_change":"2024-05-30T06:42:11.445149+0000","last_active":"2024-05-30T06:42:12.419353+0000","last_peered":"2024-05-30T06:42:12.419353+0000","last_clean":"2024-05-30T06:42:12.419353+0000","last_became_active":"2024-05-30T06:42:11.444558+0000","last_became_peered":"2024-05-30T06:42:11.444558+0000","last_unstale":"2024-05-30T06:42:12.419353+0000","last_undegraded":"2024-05-30T06:42:12.419353+0000","last_fullsized":"2024-05-30T06:42:12.419353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:53.737991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461946+0000","last_change":"2024-05-30T06:42:11.432788+0000","last_active":"2024-05-30T06:42:12.461946+0000","last_peered":"2024-05-30T06:42:12.461946+0000","last_clean":"2024-05-30T06:42:12.461946+0000","last_became_active":"2024-05-30T06:42:11.432182+0000","last_became_peered":"2024-05-30T06:42:11.432182+0000","last_unstale":"2024-05-30T06:42:12.461946+0000","last_undegraded":"2024-05-30T06:42:12.461946+0000","last_fullsized":"2024-05-30T06:42:12.461946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:26:07.087132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583756+0000","last_change":"2024-05-30T06:42:11.445205+0000","last_active":"2024-05-30T06:42:13.583756+0000","last_peered":"2024-05-30T06:42:13.583756+0000","last_clean":"2024-05-30T06:42:13.583756+0000","last_became_active":"2024-05-30T06:42:11.444042+0000","last_became_peered":"2024-05-30T06:42:11.444042+0000","last_unstale":"2024-05-30T06:42:13.583756+0000","last_undegraded":"2024-05-30T06:42:13.583756+0000","last_fullsized":"2024-05-30T06:42:13.583756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:44.456016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771622+0000","last_change":"2024-05-30T06:42:10.424421+0000","last_active":"2024-05-30T06:42:12.771622+0000","last_peered":"2024-05-30T06:42:12.771622+0000","last_clean":"2024-05-30T06:42:12.771622+0000","last_became_active":"2024-05-30T06:42:10.423992+0000","last_became_peered":"2024-05-30T06:42:10.423992+0000","last_unstale":"2024-05-30T06:42:12.771622+0000","last_undegraded":"2024-05-30T06:42:12.771622+0000","last_fullsized":"2024-05-30T06:42:12.771622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:12:56.283917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583199+0000","last_change":"2024-05-30T06:42:11.452945+0000","last_active":"2024-05-30T06:42:13.583199+0000","last_peered":"2024-05-30T06:42:13.583199+0000","last_clean":"2024-05-30T06:42:13.583199+0000","last_became_active":"2024-05-30T06:42:11.452548+0000","last_became_peered":"2024-05-30T06:42:11.452548+0000","last_unstale":"2024-05-30T06:42:13.583199+0000","last_undegraded":"2024-05-30T06:42:13.583199+0000","last_fullsized":"2024-05-30T06:42:13.583199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461970+0000","last_change":"2024-05-30T06:42:10.423464+0000","last_active":"2024-05-30T06:42:12.461970+0000","last_peered":"2024-05-30T06:42:12.461970+0000","last_clean":"2024-05-30T06:42:12.461970+0000","last_became_active":"2024-05-30T06:42:10.423111+0000","last_became_peered":"2024-05-30T06:42:10.423111+0000","last_unstale":"2024-05-30T06:42:12.461970+0000","last_undegraded":"2024-05-30T06:42:12.461970+0000","last_fullsized":"2024-05-30T06:42:12.461970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771327+0000","last_change":"2024-05-30T06:42:10.417267+0000","last_active":"2024-05-30T06:42:12.771327+0000","last_peered":"2024-05-30T06:42:12.771327+0000","last_clean":"2024-05-30T06:42:12.771327+0000","last_became_active":"2024-05-30T06:42:10.416996+0000","last_became_peered":"2024-05-30T06:42:10.416996+0000","last_unstale":"2024-05-30T06:42:12.771327+0000","last_undegraded":"2024-05-30T06:42:12.771327+0000","last_fullsized":"2024-05-30T06:42:12.771327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:43:33.658279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771209+0000","last_change":"2024-05-30T06:42:11.431024+0000","last_active":"2024-05-30T06:42:12.771209+0000","last_peered":"2024-05-30T06:42:12.771209+0000","last_clean":"2024-05-30T06:42:12.771209+0000","last_became_active":"2024-05-30T06:42:11.430771+0000","last_became_peered":"2024-05-30T06:42:11.430771+0000","last_unstale":"2024-05-30T06:42:12.771209+0000","last_undegraded":"2024-05-30T06:42:12.771209+0000","last_fullsized":"2024-05-30T06:42:12.771209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418934+0000","last_change":"2024-05-30T06:42:10.421013+0000","last_active":"2024-05-30T06:42:12.418934+0000","last_peered":"2024-05-30T06:42:12.418934+0000","last_clean":"2024-05-30T06:42:12.418934+0000","last_became_active":"2024-05-30T06:42:10.420539+0000","last_became_peered":"2024-05-30T06:42:10.420539+0000","last_unstale":"2024-05-30T06:42:12.418934+0000","last_undegraded":"2024-05-30T06:42:12.418934+0000","last_fullsized":"2024-05-30T06:42:12.418934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:17.465458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420071+0000","last_change":"2024-05-30T06:42:11.434422+0000","last_active":"2024-05-30T06:42:12.420071+0000","last_peered":"2024-05-30T06:42:12.420071+0000","last_clean":"2024-05-30T06:42:12.420071+0000","last_became_active":"2024-05-30T06:42:11.434086+0000","last_became_peered":"2024-05-30T06:42:11.434086+0000","last_unstale":"2024-05-30T06:42:12.420071+0000","last_undegraded":"2024-05-30T06:42:12.420071+0000","last_fullsized":"2024-05-30T06:42:12.420071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:41.693793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462252+0000","last_change":"2024-05-30T06:42:10.425809+0000","last_active":"2024-05-30T06:42:12.462252+0000","last_peered":"2024-05-30T06:42:12.462252+0000","last_clean":"2024-05-30T06:42:12.462252+0000","last_became_active":"2024-05-30T06:42:10.425322+0000","last_became_peered":"2024-05-30T06:42:10.425322+0000","last_unstale":"2024-05-30T06:42:12.462252+0000","last_undegraded":"2024-05-30T06:42:12.462252+0000","last_fullsized":"2024-05-30T06:42:12.462252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419005+0000","last_change":"2024-05-30T06:42:11.440849+0000","last_active":"2024-05-30T06:42:12.419005+0000","last_peered":"2024-05-30T06:42:12.419005+0000","last_clean":"2024-05-30T06:42:12.419005+0000","last_became_active":"2024-05-30T06:42:11.439120+0000","last_became_peered":"2024-05-30T06:42:11.439120+0000","last_unstale":"2024-05-30T06:42:12.419005+0000","last_undegraded":"2024-05-30T06:42:12.419005+0000","last_fullsized":"2024-05-30T06:42:12.419005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:34.897332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419128+0000","last_change":"2024-05-30T06:42:10.416914+0000","last_active":"2024-05-30T06:42:12.419128+0000","last_peered":"2024-05-30T06:42:12.419128+0000","last_clean":"2024-05-30T06:42:12.419128+0000","last_became_active":"2024-05-30T06:42:10.416544+0000","last_became_peered":"2024-05-30T06:42:10.416544+0000","last_unstale":"2024-05-30T06:42:12.419128+0000","last_undegraded":"2024-05-30T06:42:12.419128+0000","last_fullsized":"2024-05-30T06:42:12.419128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583510+0000","last_change":"2024-05-30T06:42:11.432338+0000","last_active":"2024-05-30T06:42:13.583510+0000","last_peered":"2024-05-30T06:42:13.583510+0000","last_clean":"2024-05-30T06:42:13.583510+0000","last_became_active":"2024-05-30T06:42:11.431974+0000","last_became_peered":"2024-05-30T06:42:11.431974+0000","last_unstale":"2024-05-30T06:42:13.583510+0000","last_undegraded":"2024-05-30T06:42:13.583510+0000","last_fullsized":"2024-05-30T06:42:13.583510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:16.106604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420302+0000","last_change":"2024-05-30T06:42:10.422438+0000","last_active":"2024-05-30T06:42:12.420302+0000","last_peered":"2024-05-30T06:42:12.420302+0000","last_clean":"2024-05-30T06:42:12.420302+0000","last_became_active":"2024-05-30T06:42:10.422143+0000","last_became_peered":"2024-05-30T06:42:10.422143+0000","last_unstale":"2024-05-30T06:42:12.420302+0000","last_undegraded":"2024-05-30T06:42:12.420302+0000","last_fullsized":"2024-05-30T06:42:12.420302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583814+0000","last_change":"2024-05-30T06:42:11.450964+0000","last_active":"2024-05-30T06:42:13.583814+0000","last_peered":"2024-05-30T06:42:13.583814+0000","last_clean":"2024-05-30T06:42:13.583814+0000","last_became_active":"2024-05-30T06:42:11.450676+0000","last_became_peered":"2024-05-30T06:42:11.450676+0000","last_unstale":"2024-05-30T06:42:13.583814+0000","last_undegraded":"2024-05-30T06:42:13.583814+0000","last_fullsized":"2024-05-30T06:42:13.583814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:28.603237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462153+0000","last_change":"2024-05-30T06:42:10.420535+0000","last_active":"2024-05-30T06:42:12.462153+0000","last_peered":"2024-05-30T06:42:12.462153+0000","last_clean":"2024-05-30T06:42:12.462153+0000","last_became_active":"2024-05-30T06:42:10.420249+0000","last_became_peered":"2024-05-30T06:42:10.420249+0000","last_unstale":"2024-05-30T06:42:12.462153+0000","last_undegraded":"2024-05-30T06:42:12.462153+0000","last_fullsized":"2024-05-30T06:42:12.462153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:57:09.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388267+0000","last_change":"2024-05-30T06:42:11.434347+0000","last_active":"2024-05-30T06:42:13.388267+0000","last_peered":"2024-05-30T06:42:13.388267+0000","last_clean":"2024-05-30T06:42:13.388267+0000","last_became_active":"2024-05-30T06:42:11.434073+0000","last_became_peered":"2024-05-30T06:42:11.434073+0000","last_unstale":"2024-05-30T06:42:13.388267+0000","last_undegraded":"2024-05-30T06:42:13.388267+0000","last_fullsized":"2024-05-30T06:42:13.388267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:34.897332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583309+0000","last_change":"2024-05-30T06:42:10.430485+0000","last_active":"2024-05-30T06:42:13.583309+0000","last_peered":"2024-05-30T06:42:13.583309+0000","last_clean":"2024-05-30T06:42:13.583309+0000","last_became_active":"2024-05-30T06:42:10.430203+0000","last_became_peered":"2024-05-30T06:42:10.430203+0000","last_unstale":"2024-05-30T06:42:13.583309+0000","last_undegraded":"2024-05-30T06:42:13.583309+0000","last_fullsized":"2024-05-30T06:42:13.583309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:32.085884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583022+0000","last_change":"2024-05-30T06:42:11.429543+0000","last_active":"2024-05-30T06:42:13.583022+0000","last_peered":"2024-05-30T06:42:13.583022+0000","last_clean":"2024-05-30T06:42:13.583022+0000","last_became_active":"2024-05-30T06:42:11.429230+0000","last_became_peered":"2024-05-30T06:42:11.429230+0000","last_unstale":"2024-05-30T06:42:13.583022+0000","last_undegraded":"2024-05-30T06:42:13.583022+0000","last_fullsized":"2024-05-30T06:42:13.583022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:35:23.153911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419025+0000","last_change":"2024-05-30T06:42:10.404506+0000","last_active":"2024-05-30T06:42:12.419025+0000","last_peered":"2024-05-30T06:42:12.419025+0000","last_clean":"2024-05-30T06:42:12.419025+0000","last_became_active":"2024-05-30T06:42:10.404194+0000","last_became_peered":"2024-05-30T06:42:10.404194+0000","last_unstale":"2024-05-30T06:42:12.419025+0000","last_undegraded":"2024-05-30T06:42:12.419025+0000","last_fullsized":"2024-05-30T06:42:12.419025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:57:09.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388251+0000","last_change":"2024-05-30T06:42:11.447385+0000","last_active":"2024-05-30T06:42:13.388251+0000","last_peered":"2024-05-30T06:42:13.388251+0000","last_clean":"2024-05-30T06:42:13.388251+0000","last_became_active":"2024-05-30T06:42:11.446929+0000","last_became_peered":"2024-05-30T06:42:11.446929+0000","last_unstale":"2024-05-30T06:42:13.388251+0000","last_undegraded":"2024-05-30T06:42:13.388251+0000","last_fullsized":"2024-05-30T06:42:13.388251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:28:18.705789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461885+0000","last_change":"2024-05-30T06:42:10.423499+0000","last_active":"2024-05-30T06:42:12.461885+0000","last_peered":"2024-05-30T06:42:12.461885+0000","last_clean":"2024-05-30T06:42:12.461885+0000","last_became_active":"2024-05-30T06:42:10.423116+0000","last_became_peered":"2024-05-30T06:42:10.423116+0000","last_unstale":"2024-05-30T06:42:12.461885+0000","last_undegraded":"2024-05-30T06:42:12.461885+0000","last_fullsized":"2024-05-30T06:42:12.461885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:17.465458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462086+0000","last_change":"2024-05-30T06:42:11.432468+0000","last_active":"2024-05-30T06:42:12.462086+0000","last_peered":"2024-05-30T06:42:12.462086+0000","last_clean":"2024-05-30T06:42:12.462086+0000","last_became_active":"2024-05-30T06:42:11.431747+0000","last_became_peered":"2024-05-30T06:42:11.431747+0000","last_unstale":"2024-05-30T06:42:12.462086+0000","last_undegraded":"2024-05-30T06:42:12.462086+0000","last_fullsized":"2024-05-30T06:42:12.462086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419214+0000","last_change":"2024-05-30T06:42:10.410699+0000","last_active":"2024-05-30T06:42:12.419214+0000","last_peered":"2024-05-30T06:42:12.419214+0000","last_clean":"2024-05-30T06:42:12.419214+0000","last_became_active":"2024-05-30T06:42:10.410248+0000","last_became_peered":"2024-05-30T06:42:10.410248+0000","last_unstale":"2024-05-30T06:42:12.419214+0000","last_undegraded":"2024-05-30T06:42:12.419214+0000","last_fullsized":"2024-05-30T06:42:12.419214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388106+0000","last_change":"2024-05-30T06:42:11.448104+0000","last_active":"2024-05-30T06:42:13.388106+0000","last_peered":"2024-05-30T06:42:13.388106+0000","last_clean":"2024-05-30T06:42:13.388106+0000","last_became_active":"2024-05-30T06:42:11.446869+0000","last_became_peered":"2024-05-30T06:42:11.446869+0000","last_unstale":"2024-05-30T06:42:13.388106+0000","last_undegraded":"2024-05-30T06:42:13.388106+0000","last_fullsized":"2024-05-30T06:42:13.388106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:07.193945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583774+0000","last_change":"2024-05-30T06:42:10.428483+0000","last_active":"2024-05-30T06:42:13.583774+0000","last_peered":"2024-05-30T06:42:13.583774+0000","last_clean":"2024-05-30T06:42:13.583774+0000","last_became_active":"2024-05-30T06:42:10.428191+0000","last_became_peered":"2024-05-30T06:42:10.428191+0000","last_unstale":"2024-05-30T06:42:13.583774+0000","last_undegraded":"2024-05-30T06:42:13.583774+0000","last_fullsized":"2024-05-30T06:42:13.583774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:32.085884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388487+0000","last_change":"2024-05-30T06:42:11.446064+0000","last_active":"2024-05-30T06:42:13.388487+0000","last_peered":"2024-05-30T06:42:13.388487+0000","last_clean":"2024-05-30T06:42:13.388487+0000","last_became_active":"2024-05-30T06:42:11.445744+0000","last_became_peered":"2024-05-30T06:42:11.445744+0000","last_unstale":"2024-05-30T06:42:13.388487+0000","last_undegraded":"2024-05-30T06:42:13.388487+0000","last_fullsized":"2024-05-30T06:42:13.388487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:29:42.983707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419615+0000","last_change":"2024-05-30T06:42:10.406964+0000","last_active":"2024-05-30T06:42:12.419615+0000","last_peered":"2024-05-30T06:42:12.419615+0000","last_clean":"2024-05-30T06:42:12.419615+0000","last_became_active":"2024-05-30T06:42:10.406664+0000","last_became_peered":"2024-05-30T06:42:10.406664+0000","last_unstale":"2024-05-30T06:42:12.419615+0000","last_undegraded":"2024-05-30T06:42:12.419615+0000","last_fullsized":"2024-05-30T06:42:12.419615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:27.594625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388727+0000","last_change":"2024-05-30T06:42:11.454278+0000","last_active":"2024-05-30T06:42:13.388727+0000","last_peered":"2024-05-30T06:42:13.388727+0000","last_clean":"2024-05-30T06:42:13.388727+0000","last_became_active":"2024-05-30T06:42:11.453964+0000","last_became_peered":"2024-05-30T06:42:11.453964+0000","last_unstale":"2024-05-30T06:42:13.388727+0000","last_undegraded":"2024-05-30T06:42:13.388727+0000","last_fullsized":"2024-05-30T06:42:13.388727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:17:43.098464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420404+0000","last_change":"2024-05-30T06:42:10.423747+0000","last_active":"2024-05-30T06:42:12.420404+0000","last_peered":"2024-05-30T06:42:12.420404+0000","last_clean":"2024-05-30T06:42:12.420404+0000","last_became_active":"2024-05-30T06:42:10.423406+0000","last_became_peered":"2024-05-30T06:42:10.423406+0000","last_unstale":"2024-05-30T06:42:12.420404+0000","last_undegraded":"2024-05-30T06:42:12.420404+0000","last_fullsized":"2024-05-30T06:42:12.420404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419052+0000","last_change":"2024-05-30T06:42:11.433867+0000","last_active":"2024-05-30T06:42:12.419052+0000","last_peered":"2024-05-30T06:42:12.419052+0000","last_clean":"2024-05-30T06:42:12.419052+0000","last_became_active":"2024-05-30T06:42:11.433302+0000","last_became_peered":"2024-05-30T06:42:11.433302+0000","last_unstale":"2024-05-30T06:42:12.419052+0000","last_undegraded":"2024-05-30T06:42:12.419052+0000","last_fullsized":"2024-05-30T06:42:12.419052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:09:54.618681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419361+0000","last_change":"2024-05-30T06:42:10.411777+0000","last_active":"2024-05-30T06:42:12.419361+0000","last_peered":"2024-05-30T06:42:12.419361+0000","last_clean":"2024-05-30T06:42:12.419361+0000","last_became_active":"2024-05-30T06:42:10.409724+0000","last_became_peered":"2024-05-30T06:42:10.409724+0000","last_unstale":"2024-05-30T06:42:12.419361+0000","last_undegraded":"2024-05-30T06:42:12.419361+0000","last_fullsized":"2024-05-30T06:42:12.419361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388269+0000","last_change":"2024-05-30T06:42:11.439053+0000","last_active":"2024-05-30T06:42:13.388269+0000","last_peered":"2024-05-30T06:42:13.388269+0000","last_clean":"2024-05-30T06:42:13.388269+0000","last_became_active":"2024-05-30T06:42:11.438190+0000","last_became_peered":"2024-05-30T06:42:11.438190+0000","last_unstale":"2024-05-30T06:42:13.388269+0000","last_undegraded":"2024-05-30T06:42:13.388269+0000","last_fullsized":"2024-05-30T06:42:13.388269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:09:54.618681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387999+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:42:13.387999+0000","last_peered":"2024-05-30T06:42:13.387999+0000","last_clean":"2024-05-30T06:42:13.387999+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:42:13.387999+0000","last_undegraded":"2024-05-30T06:42:13.387999+0000","last_fullsized":"2024-05-30T06:42:13.387999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418494+0000","last_change":"2024-05-30T06:42:10.410644+0000","last_active":"2024-05-30T06:42:12.418494+0000","last_peered":"2024-05-30T06:42:12.418494+0000","last_clean":"2024-05-30T06:42:12.418494+0000","last_became_active":"2024-05-30T06:42:10.408941+0000","last_became_peered":"2024-05-30T06:42:10.408941+0000","last_unstale":"2024-05-30T06:42:12.418494+0000","last_undegraded":"2024-05-30T06:42:12.418494+0000","last_fullsized":"2024-05-30T06:42:12.418494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771269+0000","last_change":"2024-05-30T06:42:11.437096+0000","last_active":"2024-05-30T06:42:12.771269+0000","last_peered":"2024-05-30T06:42:12.771269+0000","last_clean":"2024-05-30T06:42:12.771269+0000","last_became_active":"2024-05-30T06:42:11.436706+0000","last_became_peered":"2024-05-30T06:42:11.436706+0000","last_unstale":"2024-05-30T06:42:12.771269+0000","last_undegraded":"2024-05-30T06:42:12.771269+0000","last_fullsized":"2024-05-30T06:42:12.771269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387891+0000","last_change":"2024-05-30T06:42:10.422330+0000","last_active":"2024-05-30T06:42:13.387891+0000","last_peered":"2024-05-30T06:42:13.387891+0000","last_clean":"2024-05-30T06:42:13.387891+0000","last_became_active":"2024-05-30T06:42:10.422034+0000","last_became_peered":"2024-05-30T06:42:10.422034+0000","last_unstale":"2024-05-30T06:42:13.387891+0000","last_undegraded":"2024-05-30T06:42:13.387891+0000","last_fullsized":"2024-05-30T06:42:13.387891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:18:25.786944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583063+0000","last_change":"2024-05-30T06:42:11.452846+0000","last_active":"2024-05-30T06:42:13.583063+0000","last_peered":"2024-05-30T06:42:13.583063+0000","last_clean":"2024-05-30T06:42:13.583063+0000","last_became_active":"2024-05-30T06:42:11.452493+0000","last_became_peered":"2024-05-30T06:42:11.452493+0000","last_unstale":"2024-05-30T06:42:13.583063+0000","last_undegraded":"2024-05-30T06:42:13.583063+0000","last_fullsized":"2024-05-30T06:42:13.583063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:26:07.087132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419326+0000","last_change":"2024-05-30T06:42:10.404739+0000","last_active":"2024-05-30T06:42:12.419326+0000","last_peered":"2024-05-30T06:42:12.419326+0000","last_clean":"2024-05-30T06:42:12.419326+0000","last_became_active":"2024-05-30T06:42:10.404322+0000","last_became_peered":"2024-05-30T06:42:10.404322+0000","last_unstale":"2024-05-30T06:42:12.419326+0000","last_undegraded":"2024-05-30T06:42:12.419326+0000","last_fullsized":"2024-05-30T06:42:12.419326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420083+0000","last_change":"2024-05-30T06:42:11.439108+0000","last_active":"2024-05-30T06:42:12.420083+0000","last_peered":"2024-05-30T06:42:12.420083+0000","last_clean":"2024-05-30T06:42:12.420083+0000","last_became_active":"2024-05-30T06:42:11.438818+0000","last_became_peered":"2024-05-30T06:42:11.438818+0000","last_unstale":"2024-05-30T06:42:12.420083+0000","last_undegraded":"2024-05-30T06:42:12.420083+0000","last_fullsized":"2024-05-30T06:42:12.420083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419032+0000","last_change":"2024-05-30T06:42:10.411897+0000","last_active":"2024-05-30T06:42:12.419032+0000","last_peered":"2024-05-30T06:42:12.419032+0000","last_clean":"2024-05-30T06:42:12.419032+0000","last_became_active":"2024-05-30T06:42:10.411626+0000","last_became_peered":"2024-05-30T06:42:10.411626+0000","last_unstale":"2024-05-30T06:42:12.419032+0000","last_undegraded":"2024-05-30T06:42:12.419032+0000","last_fullsized":"2024-05-30T06:42:12.419032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583703+0000","last_change":"2024-05-30T06:42:11.446187+0000","last_active":"2024-05-30T06:42:13.583703+0000","last_peered":"2024-05-30T06:42:13.583703+0000","last_clean":"2024-05-30T06:42:13.583703+0000","last_became_active":"2024-05-30T06:42:11.445840+0000","last_became_peered":"2024-05-30T06:42:11.445840+0000","last_unstale":"2024-05-30T06:42:13.583703+0000","last_undegraded":"2024-05-30T06:42:13.583703+0000","last_fullsized":"2024-05-30T06:42:13.583703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:34.809415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420422+0000","last_change":"2024-05-30T06:42:10.428270+0000","last_active":"2024-05-30T06:42:12.420422+0000","last_peered":"2024-05-30T06:42:12.420422+0000","last_clean":"2024-05-30T06:42:12.420422+0000","last_became_active":"2024-05-30T06:42:10.427910+0000","last_became_peered":"2024-05-30T06:42:10.427910+0000","last_unstale":"2024-05-30T06:42:12.420422+0000","last_undegraded":"2024-05-30T06:42:12.420422+0000","last_fullsized":"2024-05-30T06:42:12.420422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:27.594625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418876+0000","last_change":"2024-05-30T06:42:11.438157+0000","last_active":"2024-05-30T06:42:12.418876+0000","last_peered":"2024-05-30T06:42:12.418876+0000","last_clean":"2024-05-30T06:42:12.418876+0000","last_became_active":"2024-05-30T06:42:11.437756+0000","last_became_peered":"2024-05-30T06:42:11.437756+0000","last_unstale":"2024-05-30T06:42:12.418876+0000","last_undegraded":"2024-05-30T06:42:12.418876+0000","last_fullsized":"2024-05-30T06:42:12.418876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:12.472477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388512+0000","last_change":"2024-05-30T06:42:10.427812+0000","last_active":"2024-05-30T06:42:13.388512+0000","last_peered":"2024-05-30T06:42:13.388512+0000","last_clean":"2024-05-30T06:42:13.388512+0000","last_became_active":"2024-05-30T06:42:10.427455+0000","last_became_peered":"2024-05-30T06:42:10.427455+0000","last_unstale":"2024-05-30T06:42:13.388512+0000","last_undegraded":"2024-05-30T06:42:13.388512+0000","last_fullsized":"2024-05-30T06:42:13.388512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:07:15.070876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420523+0000","last_change":"2024-05-30T06:42:11.440605+0000","last_active":"2024-05-30T06:42:12.420523+0000","last_peered":"2024-05-30T06:42:12.420523+0000","last_clean":"2024-05-30T06:42:12.420523+0000","last_became_active":"2024-05-30T06:42:11.440283+0000","last_became_peered":"2024-05-30T06:42:11.440283+0000","last_unstale":"2024-05-30T06:42:12.420523+0000","last_undegraded":"2024-05-30T06:42:12.420523+0000","last_fullsized":"2024-05-30T06:42:12.420523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461531+0000","last_change":"2024-05-30T06:42:10.418655+0000","last_active":"2024-05-30T06:42:12.461531+0000","last_peered":"2024-05-30T06:42:12.461531+0000","last_clean":"2024-05-30T06:42:12.461531+0000","last_became_active":"2024-05-30T06:42:10.418341+0000","last_became_peered":"2024-05-30T06:42:10.418341+0000","last_unstale":"2024-05-30T06:42:12.461531+0000","last_undegraded":"2024-05-30T06:42:12.461531+0000","last_fullsized":"2024-05-30T06:42:12.461531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:18:25.786944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771711+0000","last_change":"2024-05-30T06:42:11.443605+0000","last_active":"2024-05-30T06:42:12.771711+0000","last_peered":"2024-05-30T06:42:12.771711+0000","last_clean":"2024-05-30T06:42:12.771711+0000","last_became_active":"2024-05-30T06:42:11.443352+0000","last_became_peered":"2024-05-30T06:42:11.443352+0000","last_unstale":"2024-05-30T06:42:12.771711+0000","last_undegraded":"2024-05-30T06:42:12.771711+0000","last_fullsized":"2024-05-30T06:42:12.771711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:07.193945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462314+0000","last_change":"2024-05-30T06:42:10.418571+0000","last_active":"2024-05-30T06:42:12.462314+0000","last_peered":"2024-05-30T06:42:12.462314+0000","last_clean":"2024-05-30T06:42:12.462314+0000","last_became_active":"2024-05-30T06:42:10.418264+0000","last_became_peered":"2024-05-30T06:42:10.418264+0000","last_unstale":"2024-05-30T06:42:12.462314+0000","last_undegraded":"2024-05-30T06:42:12.462314+0000","last_fullsized":"2024-05-30T06:42:12.462314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583371+0000","last_change":"2024-05-30T06:42:11.425449+0000","last_active":"2024-05-30T06:42:13.583371+0000","last_peered":"2024-05-30T06:42:13.583371+0000","last_clean":"2024-05-30T06:42:13.583371+0000","last_became_active":"2024-05-30T06:42:11.425140+0000","last_became_peered":"2024-05-30T06:42:11.425140+0000","last_unstale":"2024-05-30T06:42:13.583371+0000","last_undegraded":"2024-05-30T06:42:13.583371+0000","last_fullsized":"2024-05-30T06:42:13.583371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387867+0000","last_change":"2024-05-30T06:42:10.426724+0000","last_active":"2024-05-30T06:42:13.387867+0000","last_peered":"2024-05-30T06:42:13.387867+0000","last_clean":"2024-05-30T06:42:13.387867+0000","last_became_active":"2024-05-30T06:42:10.426443+0000","last_became_peered":"2024-05-30T06:42:10.426443+0000","last_unstale":"2024-05-30T06:42:13.387867+0000","last_undegraded":"2024-05-30T06:42:13.387867+0000","last_fullsized":"2024-05-30T06:42:13.387867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:27.594625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583558+0000","last_change":"2024-05-30T06:42:11.441051+0000","last_active":"2024-05-30T06:42:13.583558+0000","last_peered":"2024-05-30T06:42:13.583558+0000","last_clean":"2024-05-30T06:42:13.583558+0000","last_became_active":"2024-05-30T06:42:11.440776+0000","last_became_peered":"2024-05-30T06:42:11.440776+0000","last_unstale":"2024-05-30T06:42:13.583558+0000","last_undegraded":"2024-05-30T06:42:13.583558+0000","last_fullsized":"2024-05-30T06:42:13.583558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:31.686531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420193+0000","last_change":"2024-05-30T06:42:10.423040+0000","last_active":"2024-05-30T06:42:12.420193+0000","last_peered":"2024-05-30T06:42:12.420193+0000","last_clean":"2024-05-30T06:42:12.420193+0000","last_became_active":"2024-05-30T06:42:10.422580+0000","last_became_peered":"2024-05-30T06:42:10.422580+0000","last_unstale":"2024-05-30T06:42:12.420193+0000","last_undegraded":"2024-05-30T06:42:12.420193+0000","last_fullsized":"2024-05-30T06:42:12.420193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:57:09.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771674+0000","last_change":"2024-05-30T06:42:11.431142+0000","last_active":"2024-05-30T06:42:12.771674+0000","last_peered":"2024-05-30T06:42:12.771674+0000","last_clean":"2024-05-30T06:42:12.771674+0000","last_became_active":"2024-05-30T06:42:11.430833+0000","last_became_peered":"2024-05-30T06:42:11.430833+0000","last_unstale":"2024-05-30T06:42:12.771674+0000","last_undegraded":"2024-05-30T06:42:12.771674+0000","last_fullsized":"2024-05-30T06:42:12.771674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:12.472477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420260+0000","last_change":"2024-05-30T06:42:10.415437+0000","last_active":"2024-05-30T06:42:12.420260+0000","last_peered":"2024-05-30T06:42:12.420260+0000","last_clean":"2024-05-30T06:42:12.420260+0000","last_became_active":"2024-05-30T06:42:10.414954+0000","last_became_peered":"2024-05-30T06:42:10.414954+0000","last_unstale":"2024-05-30T06:42:12.420260+0000","last_undegraded":"2024-05-30T06:42:12.420260+0000","last_fullsized":"2024-05-30T06:42:12.420260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771534+0000","last_change":"2024-05-30T06:42:11.429843+0000","last_active":"2024-05-30T06:42:12.771534+0000","last_peered":"2024-05-30T06:42:12.771534+0000","last_clean":"2024-05-30T06:42:12.771534+0000","last_became_active":"2024-05-30T06:42:11.429428+0000","last_became_peered":"2024-05-30T06:42:11.429428+0000","last_unstale":"2024-05-30T06:42:12.771534+0000","last_undegraded":"2024-05-30T06:42:12.771534+0000","last_fullsized":"2024-05-30T06:42:12.771534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:04:58.409141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388321+0000","last_change":"2024-05-30T06:42:10.430372+0000","last_active":"2024-05-30T06:42:13.388321+0000","last_peered":"2024-05-30T06:42:13.388321+0000","last_clean":"2024-05-30T06:42:13.388321+0000","last_became_active":"2024-05-30T06:42:10.430029+0000","last_became_peered":"2024-05-30T06:42:10.430029+0000","last_unstale":"2024-05-30T06:42:13.388321+0000","last_undegraded":"2024-05-30T06:42:13.388321+0000","last_fullsized":"2024-05-30T06:42:13.388321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:51:39.946209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462037+0000","last_change":"2024-05-30T06:42:11.450489+0000","last_active":"2024-05-30T06:42:12.462037+0000","last_peered":"2024-05-30T06:42:12.462037+0000","last_clean":"2024-05-30T06:42:12.462037+0000","last_became_active":"2024-05-30T06:42:11.446807+0000","last_became_peered":"2024-05-30T06:42:11.446807+0000","last_unstale":"2024-05-30T06:42:12.462037+0000","last_undegraded":"2024-05-30T06:42:12.462037+0000","last_fullsized":"2024-05-30T06:42:12.462037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:41.693793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418833+0000","last_change":"2024-05-30T06:42:11.446469+0000","last_active":"2024-05-30T06:42:12.418833+0000","last_peered":"2024-05-30T06:42:12.418833+0000","last_clean":"2024-05-30T06:42:12.418833+0000","last_became_active":"2024-05-30T06:42:11.446178+0000","last_became_peered":"2024-05-30T06:42:11.446178+0000","last_unstale":"2024-05-30T06:42:12.418833+0000","last_undegraded":"2024-05-30T06:42:12.418833+0000","last_fullsized":"2024-05-30T06:42:12.418833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:05.695381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388169+0000","last_change":"2024-05-30T06:42:10.424259+0000","last_active":"2024-05-30T06:42:13.388169+0000","last_peered":"2024-05-30T06:42:13.388169+0000","last_clean":"2024-05-30T06:42:13.388169+0000","last_became_active":"2024-05-30T06:42:10.423972+0000","last_became_peered":"2024-05-30T06:42:10.423972+0000","last_unstale":"2024-05-30T06:42:13.388169+0000","last_undegraded":"2024-05-30T06:42:13.388169+0000","last_fullsized":"2024-05-30T06:42:13.388169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:06:59.985658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419003+0000","last_change":"2024-05-30T06:42:11.451914+0000","last_active":"2024-05-30T06:42:12.419003+0000","last_peered":"2024-05-30T06:42:12.419003+0000","last_clean":"2024-05-30T06:42:12.419003+0000","last_became_active":"2024-05-30T06:42:11.451633+0000","last_became_peered":"2024-05-30T06:42:11.451633+0000","last_unstale":"2024-05-30T06:42:12.419003+0000","last_undegraded":"2024-05-30T06:42:12.419003+0000","last_fullsized":"2024-05-30T06:42:12.419003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:28:18.705789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388431+0000","last_change":"2024-05-30T06:42:10.427805+0000","last_active":"2024-05-30T06:42:13.388431+0000","last_peered":"2024-05-30T06:42:13.388431+0000","last_clean":"2024-05-30T06:42:13.388431+0000","last_became_active":"2024-05-30T06:42:10.427452+0000","last_became_peered":"2024-05-30T06:42:10.427452+0000","last_unstale":"2024-05-30T06:42:13.388431+0000","last_undegraded":"2024-05-30T06:42:13.388431+0000","last_fullsized":"2024-05-30T06:42:13.388431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:52.729379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583434+0000","last_change":"2024-05-30T06:42:11.432129+0000","last_active":"2024-05-30T06:42:13.583434+0000","last_peered":"2024-05-30T06:42:13.583434+0000","last_clean":"2024-05-30T06:42:13.583434+0000","last_became_active":"2024-05-30T06:42:11.431823+0000","last_became_peered":"2024-05-30T06:42:11.431823+0000","last_unstale":"2024-05-30T06:42:13.583434+0000","last_undegraded":"2024-05-30T06:42:13.583434+0000","last_fullsized":"2024-05-30T06:42:13.583434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771534+0000","last_change":"2024-05-30T06:42:10.426946+0000","last_active":"2024-05-30T06:42:12.771534+0000","last_peered":"2024-05-30T06:42:12.771534+0000","last_clean":"2024-05-30T06:42:12.771534+0000","last_became_active":"2024-05-30T06:42:10.426667+0000","last_became_peered":"2024-05-30T06:42:10.426667+0000","last_unstale":"2024-05-30T06:42:12.771534+0000","last_undegraded":"2024-05-30T06:42:12.771534+0000","last_fullsized":"2024-05-30T06:42:12.771534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:17.465458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771418+0000","last_change":"2024-05-30T06:42:11.436144+0000","last_active":"2024-05-30T06:42:12.771418+0000","last_peered":"2024-05-30T06:42:12.771418+0000","last_clean":"2024-05-30T06:42:12.771418+0000","last_became_active":"2024-05-30T06:42:11.435885+0000","last_became_peered":"2024-05-30T06:42:11.435885+0000","last_unstale":"2024-05-30T06:42:12.771418+0000","last_undegraded":"2024-05-30T06:42:12.771418+0000","last_fullsized":"2024-05-30T06:42:12.771418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583529+0000","last_change":"2024-05-30T06:42:10.433516+0000","last_active":"2024-05-30T06:42:13.583529+0000","last_peered":"2024-05-30T06:42:13.583529+0000","last_clean":"2024-05-30T06:42:13.583529+0000","last_became_active":"2024-05-30T06:42:10.433200+0000","last_became_peered":"2024-05-30T06:42:10.433200+0000","last_unstale":"2024-05-30T06:42:13.583529+0000","last_undegraded":"2024-05-30T06:42:13.583529+0000","last_fullsized":"2024-05-30T06:42:13.583529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:43:33.658279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:42:15.949 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-30T06:42:15.949 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-30T06:42:15.949 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-30T06:42:15.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-30T06:42:15.950 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-30T06:42:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.127+0000 7fb72f800640 1 Processor -- start 2024-05-30T06:42:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.127+0000 7fb72f800640 1 -- start start 2024-05-30T06:42:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72f800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb7280b2ec0 0x7fb7280b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72f800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72815c8f0 con 0x7fb728155e60 2024-05-30T06:42:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72f800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7280ccc80 con 0x7fb72806f9a0 2024-05-30T06:42:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72f800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb7280ccff0 con 0x7fb7280b2ec0 2024-05-30T06:42:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72ce00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb728155e60 0x7fb7280cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60738/0 (socket says 172.21.15.37:60738) 2024-05-30T06:42:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72ce00640 1 -- 172.21.15.37:0/1304994091 learned_addr learned my addr 172.21.15.37:0/1304994091 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72d800640 1 --2- 172.21.15.37:0/1304994091 >> v2:172.21.15.105:3300/0 conn(0x7fb7280b2ec0 0x7fb7280b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2265650408 0 0) 0x7fb72815c8f0 con 0x7fb728155e60 2024-05-30T06:42:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb710005740 con 0x7fb728155e60 2024-05-30T06:42:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3408621595 0 0) 0x7fb710005740 con 0x7fb728155e60 2024-05-30T06:42:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 >> v2:172.21.15.105:3300/0 conn(0x7fb7280b2ec0 msgr2=0x7fb7280b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 --2- 172.21.15.37:0/1304994091 >> v2:172.21.15.105:3300/0 conn(0x7fb7280b2ec0 0x7fb7280b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 >> v1:172.21.15.105:6789/0 conn(0x7fb72806f9a0 legacy=0x7fb7280cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72815cbd0 con 0x7fb728155e60 2024-05-30T06:42:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fb71c001680 con 0x7fb728155e60 2024-05-30T06:42:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 >> v1:172.21.15.37:6789/0 conn(0x7fb728155e60 legacy=0x7fb7280cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 --2- 172.21.15.37:0/1304994091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb710005bd0 0x7fb710005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 --2- 172.21.15.37:0/1304994091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb710006a20 0x7fb710006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 --2- 172.21.15.37:0/1304994091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100073e0 0x7fb71000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb7280ccff0 con 0x7fb7100073e0 2024-05-30T06:42:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb71000e280 con 0x7fb710005bd0 2024-05-30T06:42:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb71000e480 con 0x7fb710006a20 2024-05-30T06:42:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72d800640 1 --2- 172.21.15.37:0/1304994091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100073e0 0x7fb71000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72ce00640 1 --2- 172.21.15.37:0/1304994091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb710005bd0 0x7fb710005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb727e00640 1 --2- 172.21.15.37:0/1304994091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb710006a20 0x7fb710006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72d800640 1 -- 172.21.15.37:0/1304994091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb710006a20 msgr2=0x7fb710006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72d800640 1 --2- 172.21.15.37:0/1304994091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb710006a20 0x7fb710006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72d800640 1 -- 172.21.15.37:0/1304994091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb710005bd0 msgr2=0x7fb710005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72d800640 1 --2- 172.21.15.37:0/1304994091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb710005bd0 0x7fb710005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.131+0000 7fb72d800640 1 -- 172.21.15.37:0/1304994091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb710005740 con 0x7fb7100073e0 2024-05-30T06:42:16.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.135+0000 7fb72d800640 1 -- 172.21.15.37:0/1304994091 reap_dead start 2024-05-30T06:42:16.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.135+0000 7fb72d800640 1 --2- 172.21.15.37:0/1304994091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100073e0 0x7fb71000dbe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb720009fc0 tx=0x7fb72001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ead8a432becf052 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:16.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.135+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720009c10 con 0x7fb7100073e0 2024-05-30T06:42:16.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.135+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7200a5d10 con 0x7fb7100073e0 2024-05-30T06:42:16.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.135+0000 7fb727400640 1 -- 172.21.15.37:0/1304994091 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720003be0 con 0x7fb7100073e0 2024-05-30T06:42:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.135+0000 7fb72f800640 1 -- 172.21.15.37:0/1304994091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100073e0 msgr2=0x7fb71000dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.135+0000 7fb72f800640 1 --2- 172.21.15.37:0/1304994091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100073e0 0x7fb71000dbe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb720009fc0 tx=0x7fb72001ccc0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.135+0000 7fb72f800640 1 -- 172.21.15.37:0/1304994091 shutdown_connections 2024-05-30T06:42:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.135+0000 7fb72f800640 1 --2- 172.21.15.37:0/1304994091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100073e0 0x7fb71000dbe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.135+0000 7fb72f800640 1 -- 172.21.15.37:0/1304994091 >> 172.21.15.37:0/1304994091 conn(0x7fb7280b23a0 msgr2=0x7fb7280b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:16.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.135+0000 7fb72f800640 1 -- 172.21.15.37:0/1304994091 shutdown_connections 2024-05-30T06:42:16.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.135+0000 7fb72f800640 1 -- 172.21.15.37:0/1304994091 wait complete. 2024-05-30T06:42:16.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72f800640 1 Processor -- start 2024-05-30T06:42:16.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72f800640 1 -- start start 2024-05-30T06:42:16.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72f800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7100073e0 0x7fb7281539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72f800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb728159050 0x7fb7280b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72f800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb728152140 0x7fb72815df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72f800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb7280b36a0 con 0x7fb728152140 2024-05-30T06:42:16.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72f800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb72806fe50 con 0x7fb728159050 2024-05-30T06:42:16.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72f800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb7280b3820 con 0x7fb7100073e0 2024-05-30T06:42:16.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb728152140 0x7fb72815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb728152140 0x7fb72815df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60392/0 (socket says 172.21.15.37:60392) 2024-05-30T06:42:16.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72d800640 1 -- 172.21.15.37:0/651615821 learned_addr learned my addr 172.21.15.37:0/651615821 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72ce00640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7100073e0 0x7fb7281539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb727e00640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb728159050 0x7fb7280b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72d800640 1 -- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7100073e0 msgr2=0x7fb7281539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72d800640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7100073e0 0x7fb7281539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72d800640 1 -- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb728159050 msgr2=0x7fb7280b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72d800640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb728159050 0x7fb7280b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72d800640 1 -- 172.21.15.37:0/651615821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb728152920 con 0x7fb728152140 2024-05-30T06:42:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72d800640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb728152140 0x7fb72815df80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb7200987f0 tx=0x7fb720009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb724c00640 1 -- 172.21.15.37:0/651615821 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7200aed50 con 0x7fb728152140 2024-05-30T06:42:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb724c00640 1 -- 172.21.15.37:0/651615821 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7200bd070 con 0x7fb728152140 2024-05-30T06:42:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb724c00640 1 -- 172.21.15.37:0/651615821 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720003ba0 con 0x7fb728152140 2024-05-30T06:42:16.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72f800640 1 -- 172.21.15.37:0/651615821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb728152c00 con 0x7fb728152140 2024-05-30T06:42:16.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72f800640 1 -- 172.21.15.37:0/651615821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7281531c0 con 0x7fb728152140 2024-05-30T06:42:16.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.139+0000 7fb72f800640 1 -- 172.21.15.37:0/651615821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb728068b20 con 0x7fb728152140 2024-05-30T06:42:16.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.143+0000 7fb724c00640 1 -- 172.21.15.37:0/651615821 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb720004030 con 0x7fb728152140 2024-05-30T06:42:16.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.143+0000 7fb724c00640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb7080683b0 0x7fb70806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.143+0000 7fb724c00640 1 -- 172.21.15.37:0/651615821 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb720122530 con 0x7fb728152140 2024-05-30T06:42:16.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.143+0000 7fb72ce00640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb7080683b0 0x7fb70806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.143+0000 7fb72ce00640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb7080683b0 0x7fb70806a870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb72815b990 tx=0x7fb71c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:16.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.147+0000 7fb724c00640 1 -- 172.21.15.37:0/651615821 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb7200169d0 con 0x7fb728152140 2024-05-30T06:42:16.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.347+0000 7fb72f800640 1 -- 172.21.15.37:0/651615821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb728072fb0 con 0x7fb728152140 2024-05-30T06:42:16.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.351+0000 7fb724c00640 1 -- 172.21.15.37:0/651615821 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168089 (secure 0 0 0) 0x7fb7200f2a50 con 0x7fb728152140 2024-05-30T06:42:16.353 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:16.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.355+0000 7fb72f800640 1 -- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb7080683b0 msgr2=0x7fb70806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.355+0000 7fb72f800640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb7080683b0 0x7fb70806a870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb72815b990 tx=0x7fb71c009040 comp rx=0 tx=0).stop 2024-05-30T06:42:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.355+0000 7fb72f800640 1 -- 172.21.15.37:0/651615821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb728152140 msgr2=0x7fb72815df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.355+0000 7fb72f800640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb728152140 0x7fb72815df80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb7200987f0 tx=0x7fb720009750 comp rx=0 tx=0).stop 2024-05-30T06:42:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.355+0000 7fb72f800640 1 -- 172.21.15.37:0/651615821 shutdown_connections 2024-05-30T06:42:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.355+0000 7fb72f800640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb728152140 0x7fb72815df80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.355+0000 7fb72f800640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb7080683b0 0x7fb70806a870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.355+0000 7fb72f800640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb728159050 0x7fb7280b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.355+0000 7fb72f800640 1 --2- 172.21.15.37:0/651615821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7100073e0 0x7fb7281539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.355+0000 7fb72f800640 1 -- 172.21.15.37:0/651615821 >> 172.21.15.37:0/651615821 conn(0x7fb7280b23a0 msgr2=0x7fb72806e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.355+0000 7fb72f800640 1 -- 172.21.15.37:0/651615821 shutdown_connections 2024-05-30T06:42:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.355+0000 7fb72f800640 1 -- 172.21.15.37:0/651615821 wait complete. 2024-05-30T06:42:16.373 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":911132516},{"type":"v1","addr":"172.21.15.105:6833","nonce":911132516}]},"active_addr":"172.21.15.105:6833/911132516","active_change":"2024-05-30T06:41:50.626415+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":3744154331}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":3150927459}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":3754026287}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":1349203724}]}]} 2024-05-30T06:42:16.377 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-30T06:42:16.377 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-30T06:42:16.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf3c00640 1 Processor -- start 2024-05-30T06:42:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf3c00640 1 -- start start 2024-05-30T06:42:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf3c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fabec0cdeb0 0x7fabec0ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf3c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabec0d1b20 0x7fabec0d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf3c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabec15d440 con 0x7fabec15c950 2024-05-30T06:42:16.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf3c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fabec0d1530 con 0x7fabec0d1b20 2024-05-30T06:42:16.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf3c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fabec0d2440 con 0x7fabec0cdeb0 2024-05-30T06:42:16.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf1c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabec0d1b20 0x7fabec0d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf1c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabec0d1b20 0x7fabec0d1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60402/0 (socket says 172.21.15.37:60402) 2024-05-30T06:42:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf1c00640 1 -- 172.21.15.37:0/4016626692 learned_addr learned my addr 172.21.15.37:0/4016626692 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabe3e00640 1 --2- 172.21.15.37:0/4016626692 >> v2:172.21.15.105:3300/0 conn(0x7fabec0cdeb0 0x7fabec0ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf1c00640 1 -- 172.21.15.37:0/4016626692 >> v2:172.21.15.105:3300/0 conn(0x7fabec0cdeb0 msgr2=0x7fabec0ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf1c00640 1 --2- 172.21.15.37:0/4016626692 >> v2:172.21.15.105:3300/0 conn(0x7fabec0cdeb0 0x7fabec0ce320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf1c00640 1 -- 172.21.15.37:0/4016626692 >> v1:172.21.15.105:6789/0 conn(0x7fabec15c950 legacy=0x7fabec15cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.519+0000 7fabf1c00640 1 -- 172.21.15.37:0/4016626692 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec0d09b0 con 0x7fabec0d1b20 2024-05-30T06:42:16.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.523+0000 7fabf1c00640 1 --2- 172.21.15.37:0/4016626692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0d1b20 0x7fabec0d1f00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fabec0cdc50 tx=0x7fabe401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a670b54e495e0a76 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:16.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.523+0000 7fabebe00640 1 -- 172.21.15.37:0/4016626692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe40a57f0 con 0x7fabec0d1b20 2024-05-30T06:42:16.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.523+0000 7fabebe00640 1 -- 172.21.15.37:0/4016626692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe40a5990 con 0x7fabec0d1b20 2024-05-30T06:42:16.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.523+0000 7fabebe00640 1 -- 172.21.15.37:0/4016626692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe40a5d60 con 0x7fabec0d1b20 2024-05-30T06:42:16.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.523+0000 7fabf3c00640 1 -- 172.21.15.37:0/4016626692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0d1b20 msgr2=0x7fabec0d1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.523+0000 7fabf3c00640 1 --2- 172.21.15.37:0/4016626692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0d1b20 0x7fabec0d1f00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fabec0cdc50 tx=0x7fabe401c930 comp rx=0 tx=0).stop 2024-05-30T06:42:16.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.523+0000 7fabf3c00640 1 -- 172.21.15.37:0/4016626692 shutdown_connections 2024-05-30T06:42:16.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.523+0000 7fabf3c00640 1 --2- 172.21.15.37:0/4016626692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0d1b20 0x7fabec0d1f00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.523+0000 7fabf3c00640 1 --2- 172.21.15.37:0/4016626692 >> v2:172.21.15.105:3300/0 conn(0x7fabec0cdeb0 0x7fabec0ce320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.523+0000 7fabf3c00640 1 -- 172.21.15.37:0/4016626692 >> 172.21.15.37:0/4016626692 conn(0x7fabec067930 msgr2=0x7fabec06ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:16.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.523+0000 7fabf3c00640 1 -- 172.21.15.37:0/4016626692 shutdown_connections 2024-05-30T06:42:16.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.523+0000 7fabf3c00640 1 -- 172.21.15.37:0/4016626692 wait complete. 2024-05-30T06:42:16.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabf3c00640 1 Processor -- start 2024-05-30T06:42:16.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabf3c00640 1 -- start start 2024-05-30T06:42:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabf3c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabec0cdeb0 0x7fabec0b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabf3c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0d1b20 0x7fabec15e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabf3c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec15c950 0x7fabec159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabf3c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabec0d0790 con 0x7fabec0d1b20 2024-05-30T06:42:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabf3c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fabec0d0610 con 0x7fabec0cdeb0 2024-05-30T06:42:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabf3c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fabec073b90 con 0x7fabec15c950 2024-05-30T06:42:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabe3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0d1b20 0x7fabec15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabe3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0d1b20 0x7fabec15e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60408/0 (socket says 172.21.15.37:60408) 2024-05-30T06:42:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabe3e00640 1 -- 172.21.15.37:0/3176159506 learned_addr learned my addr 172.21.15.37:0/3176159506 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:16.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabf1c00640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec15c950 0x7fabec159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabf1200640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabec0cdeb0 0x7fabec0b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabe3e00640 1 -- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec15c950 msgr2=0x7fabec159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabe3e00640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec15c950 0x7fabec159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabe3e00640 1 -- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabec0cdeb0 msgr2=0x7fabec0b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabe3e00640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabec0cdeb0 0x7fabec0b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabe3e00640 1 -- 172.21.15.37:0/3176159506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec15ecf0 con 0x7fabec0d1b20 2024-05-30T06:42:16.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabe3e00640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0d1b20 0x7fabec15e480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fabd400d800 tx=0x7fabd400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:16.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabe9600640 1 -- 172.21.15.37:0/3176159506 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd400b6c0 con 0x7fabec0d1b20 2024-05-30T06:42:16.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabe9600640 1 -- 172.21.15.37:0/3176159506 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd4019070 con 0x7fabec0d1b20 2024-05-30T06:42:16.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabe9600640 1 -- 172.21.15.37:0/3176159506 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd400ba60 con 0x7fabec0d1b20 2024-05-30T06:42:16.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabf3c00640 1 -- 172.21.15.37:0/3176159506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabec15efd0 con 0x7fabec0d1b20 2024-05-30T06:42:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.527+0000 7fabf3c00640 1 -- 172.21.15.37:0/3176159506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabec15f590 con 0x7fabec0d1b20 2024-05-30T06:42:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.531+0000 7fabf3c00640 1 -- 172.21.15.37:0/3176159506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabec068b20 con 0x7fabec0d1b20 2024-05-30T06:42:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.531+0000 7fabe9600640 1 -- 172.21.15.37:0/3176159506 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fabd400bc00 con 0x7fabec0d1b20 2024-05-30T06:42:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.531+0000 7fabe9600640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabc8068380 0x7fabc806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.531+0000 7fabe9600640 1 -- 172.21.15.37:0/3176159506 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fabd4086d90 con 0x7fabec0d1b20 2024-05-30T06:42:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.531+0000 7fabf1200640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabc8068380 0x7fabc806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.531+0000 7fabf1200640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabc8068380 0x7fabc806a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fabdc007fd0 tx=0x7fabdc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.535+0000 7fabe9600640 1 -- 172.21.15.37:0/3176159506 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fabd4056c60 con 0x7fabec0d1b20 2024-05-30T06:42:16.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.699+0000 7fabf3c00640 1 -- 172.21.15.37:0/3176159506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fabec14f200 con 0x7fabec0d1b20 2024-05-30T06:42:16.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.703+0000 7fabe9600640 1 -- 172.21.15.37:0/3176159506 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7fabd405af60 con 0x7fabec0d1b20 2024-05-30T06:42:16.701 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:16.701 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:16.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.703+0000 7fabf3c00640 1 -- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabc8068380 msgr2=0x7fabc806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.703+0000 7fabf3c00640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabc8068380 0x7fabc806a840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fabdc007fd0 tx=0x7fabdc009040 comp rx=0 tx=0).stop 2024-05-30T06:42:16.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.703+0000 7fabf3c00640 1 -- 172.21.15.37:0/3176159506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0d1b20 msgr2=0x7fabec15e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.703+0000 7fabf3c00640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0d1b20 0x7fabec15e480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fabd400d800 tx=0x7fabd400dcc0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.703+0000 7fabf3c00640 1 -- 172.21.15.37:0/3176159506 shutdown_connections 2024-05-30T06:42:16.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.703+0000 7fabf3c00640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec15c950 0x7fabec159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.703+0000 7fabf3c00640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0d1b20 0x7fabec15e480 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.703+0000 7fabf3c00640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabc8068380 0x7fabc806a840 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.703+0000 7fabf3c00640 1 --2- 172.21.15.37:0/3176159506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabec0cdeb0 0x7fabec0b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.703+0000 7fabf3c00640 1 -- 172.21.15.37:0/3176159506 >> 172.21.15.37:0/3176159506 conn(0x7fabec067930 msgr2=0x7fabec154490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:16.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.703+0000 7fabf3c00640 1 -- 172.21.15.37:0/3176159506 shutdown_connections 2024-05-30T06:42:16.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.703+0000 7fabf3c00640 1 -- 172.21.15.37:0/3176159506 wait complete. 2024-05-30T06:42:16.723 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-30T06:42:16.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:16.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.863+0000 7f7bd1a00640 1 Processor -- start 2024-05-30T06:42:16.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.863+0000 7f7bd1a00640 1 -- start start 2024-05-30T06:42:16.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.863+0000 7f7bd1a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bcc06f9a0 0x7f7bcc0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.863+0000 7f7bd1a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7bcc0b2ec0 0x7f7bcc0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.863+0000 7f7bd1a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bcc15c8f0 con 0x7f7bcc155e60 2024-05-30T06:42:16.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.863+0000 7f7bd1a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7bcc0ccff0 con 0x7f7bcc0b2ec0 2024-05-30T06:42:16.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.863+0000 7f7bd1a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7bcc0ccc80 con 0x7f7bcc06f9a0 2024-05-30T06:42:16.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bcaa00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7bcc155e60 0x7f7bcc0cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60748/0 (socket says 172.21.15.37:60748) 2024-05-30T06:42:16.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bcaa00640 1 -- 172.21.15.37:0/2388279883 learned_addr learned my addr 172.21.15.37:0/2388279883 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:16.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bc3e00640 1 --2- 172.21.15.37:0/2388279883 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bcc06f9a0 0x7f7bcc0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bcb400640 1 --2- 172.21.15.37:0/2388279883 >> v2:172.21.15.105:3300/0 conn(0x7f7bcc0b2ec0 0x7f7bcc0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 23320066 0 0) 0x7f7bcc15c8f0 con 0x7f7bcc155e60 2024-05-30T06:42:16.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bb0003530 con 0x7f7bcc155e60 2024-05-30T06:42:16.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3870133258 0 0) 0x7f7bb0003530 con 0x7f7bcc155e60 2024-05-30T06:42:16.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bcc06f9a0 msgr2=0x7f7bcc0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:16.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 --2- 172.21.15.37:0/2388279883 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bcc06f9a0 0x7f7bcc0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 >> v2:172.21.15.105:3300/0 conn(0x7f7bcc0b2ec0 msgr2=0x7f7bcc0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:16.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 --2- 172.21.15.37:0/2388279883 >> v2:172.21.15.105:3300/0 conn(0x7f7bcc0b2ec0 0x7f7bcc0cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc15cbd0 con 0x7f7bcc155e60 2024-05-30T06:42:16.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f7bbc001680 con 0x7f7bcc155e60 2024-05-30T06:42:16.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 >> v1:172.21.15.37:6789/0 conn(0x7f7bcc155e60 legacy=0x7f7bcc0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 --2- 172.21.15.37:0/2388279883 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb00039c0 0x7f7bb0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 --2- 172.21.15.37:0/2388279883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bb00043b0 0x7f7bb0004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 --2- 172.21.15.37:0/2388279883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb0004f00 0x7f7bb000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc0ccff0 con 0x7f7bb00043b0 2024-05-30T06:42:16.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc0ccc80 con 0x7f7bb0004f00 2024-05-30T06:42:16.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7bb000bf10 con 0x7f7bb00039c0 2024-05-30T06:42:16.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bc3e00640 1 --2- 172.21.15.37:0/2388279883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bb00043b0 0x7f7bb0004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bcaa00640 1 --2- 172.21.15.37:0/2388279883 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb00039c0 0x7f7bb0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bcb400640 1 --2- 172.21.15.37:0/2388279883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb0004f00 0x7f7bb000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bc3e00640 1 -- 172.21.15.37:0/2388279883 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb00039c0 msgr2=0x7f7bb0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:16.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bc3e00640 1 --2- 172.21.15.37:0/2388279883 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bb00039c0 0x7f7bb0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bc3e00640 1 -- 172.21.15.37:0/2388279883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb0004f00 msgr2=0x7f7bb000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:16.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bc3e00640 1 --2- 172.21.15.37:0/2388279883 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb0004f00 0x7f7bb000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.867+0000 7f7bc3e00640 1 -- 172.21.15.37:0/2388279883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb0003530 con 0x7f7bb00043b0 2024-05-30T06:42:16.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.871+0000 7f7bc3e00640 1 --2- 172.21.15.37:0/2388279883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bb00043b0 0x7f7bb0004890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc06fe20 tx=0x7f7bb401c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cde149cbcbf0e1e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:16.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.871+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb40b1070 con 0x7f7bb00043b0 2024-05-30T06:42:16.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.871+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb40a4830 con 0x7f7bb00043b0 2024-05-30T06:42:16.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.871+0000 7f7bca000640 1 -- 172.21.15.37:0/2388279883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4009670 con 0x7f7bb00043b0 2024-05-30T06:42:16.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.871+0000 7f7bd1a00640 1 -- 172.21.15.37:0/2388279883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bb00043b0 msgr2=0x7f7bb0004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.871+0000 7f7bd1a00640 1 --2- 172.21.15.37:0/2388279883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bb00043b0 0x7f7bb0004890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc06fe20 tx=0x7f7bb401c5f0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.871+0000 7f7bcb400640 1 -- 172.21.15.37:0/2388279883 reap_dead start 2024-05-30T06:42:16.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.871+0000 7f7bd1a00640 1 -- 172.21.15.37:0/2388279883 shutdown_connections 2024-05-30T06:42:16.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.871+0000 7f7bd1a00640 1 -- 172.21.15.37:0/2388279883 >> 172.21.15.37:0/2388279883 conn(0x7f7bcc0b23a0 msgr2=0x7f7bcc0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:16.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.871+0000 7f7bd1a00640 1 -- 172.21.15.37:0/2388279883 shutdown_connections 2024-05-30T06:42:16.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.871+0000 7f7bd1a00640 1 -- 172.21.15.37:0/2388279883 wait complete. 2024-05-30T06:42:16.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.871+0000 7f7bd1a00640 1 Processor -- start 2024-05-30T06:42:16.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.871+0000 7f7bd1a00640 1 -- start start 2024-05-30T06:42:16.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bd1a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb00043b0 0x7f7bcc153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bd1a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bcc0abd20 0x7f7bcc1f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bd1a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bcc0ac1a0 0x7f7bcc1f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bd1a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc0cdd50 con 0x7f7bcc0ac1a0 2024-05-30T06:42:16.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bd1a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc0cdbd0 con 0x7f7bb00043b0 2024-05-30T06:42:16.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bd1a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7bcc0cded0 con 0x7f7bcc0abd20 2024-05-30T06:42:16.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bcb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bcc0ac1a0 0x7f7bcc1f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bcb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bcc0ac1a0 0x7f7bcc1f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60424/0 (socket says 172.21.15.37:60424) 2024-05-30T06:42:16.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bcb400640 1 -- 172.21.15.37:0/947660241 learned_addr learned my addr 172.21.15.37:0/947660241 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:16.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bcb400640 1 -- 172.21.15.37:0/947660241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bcc0abd20 msgr2=0x7f7bcc1f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bcb400640 1 --2- 172.21.15.37:0/947660241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bcc0abd20 0x7f7bcc1f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bcb400640 1 -- 172.21.15.37:0/947660241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb00043b0 msgr2=0x7f7bcc153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:16.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bcb400640 1 --2- 172.21.15.37:0/947660241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb00043b0 0x7f7bcc153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:16.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bcb400640 1 -- 172.21.15.37:0/947660241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc1f5d80 con 0x7f7bcc0ac1a0 2024-05-30T06:42:16.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bcb400640 1 --2- 172.21.15.37:0/947660241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bcc0ac1a0 0x7f7bcc1f5770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0d0490 tx=0x7f7bc400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:16.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bc2a00640 1 -- 172.21.15.37:0/947660241 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400fde0 con 0x7f7bcc0ac1a0 2024-05-30T06:42:16.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bc2a00640 1 -- 172.21.15.37:0/947660241 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc4015430 con 0x7f7bcc0ac1a0 2024-05-30T06:42:16.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bc2a00640 1 -- 172.21.15.37:0/947660241 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4015820 con 0x7f7bcc0ac1a0 2024-05-30T06:42:16.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bd1a00640 1 -- 172.21.15.37:0/947660241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bcc1f6060 con 0x7f7bcc0ac1a0 2024-05-30T06:42:16.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bd1a00640 1 -- 172.21.15.37:0/947660241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bcc0ab800 con 0x7f7bcc0ac1a0 2024-05-30T06:42:16.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bd1a00640 1 -- 172.21.15.37:0/947660241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bcc068b20 con 0x7f7bcc0ac1a0 2024-05-30T06:42:16.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.875+0000 7f7bc2a00640 1 -- 172.21.15.37:0/947660241 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7bc40159c0 con 0x7f7bcc0ac1a0 2024-05-30T06:42:16.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.879+0000 7f7bc2a00640 1 --2- 172.21.15.37:0/947660241 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ba8068380 0x7f7ba806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:16.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.879+0000 7f7bc2a00640 1 -- 172.21.15.37:0/947660241 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7bc4087900 con 0x7f7bcc0ac1a0 2024-05-30T06:42:16.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.879+0000 7f7bcaa00640 1 --2- 172.21.15.37:0/947660241 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ba8068380 0x7f7ba806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.879+0000 7f7bcaa00640 1 --2- 172.21.15.37:0/947660241 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ba8068380 0x7f7ba806a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc0016e0 tx=0x7f7bbc000bd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:16.883+0000 7f7bc2a00640 1 -- 172.21.15.37:0/947660241 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7bc4019030 con 0x7f7bcc0ac1a0 2024-05-30T06:42:17.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.047+0000 7f7bd1a00640 1 -- 172.21.15.37:0/947660241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bcc072fb0 con 0x7f7bcc0ac1a0 2024-05-30T06:42:17.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.051+0000 7f7bc2a00640 1 -- 172.21.15.37:0/947660241 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7f7bc4010040 con 0x7f7bcc0ac1a0 2024-05-30T06:42:17.049 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:17.050 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:17.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.051+0000 7f7bd1a00640 1 -- 172.21.15.37:0/947660241 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ba8068380 msgr2=0x7f7ba806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.051+0000 7f7bd1a00640 1 --2- 172.21.15.37:0/947660241 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ba8068380 0x7f7ba806a840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc0016e0 tx=0x7f7bbc000bd0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.051+0000 7f7bd1a00640 1 -- 172.21.15.37:0/947660241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bcc0ac1a0 msgr2=0x7f7bcc1f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.051+0000 7f7bd1a00640 1 --2- 172.21.15.37:0/947660241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bcc0ac1a0 0x7f7bcc1f5770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0d0490 tx=0x7f7bc400f580 comp rx=0 tx=0).stop 2024-05-30T06:42:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.051+0000 7f7bd1a00640 1 -- 172.21.15.37:0/947660241 shutdown_connections 2024-05-30T06:42:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.051+0000 7f7bd1a00640 1 --2- 172.21.15.37:0/947660241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bcc0ac1a0 0x7f7bcc1f5770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.051+0000 7f7bd1a00640 1 --2- 172.21.15.37:0/947660241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bcc0abd20 0x7f7bcc1f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.051+0000 7f7bd1a00640 1 --2- 172.21.15.37:0/947660241 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ba8068380 0x7f7ba806a840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.051+0000 7f7bd1a00640 1 --2- 172.21.15.37:0/947660241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bb00043b0 0x7f7bcc153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.051+0000 7f7bd1a00640 1 -- 172.21.15.37:0/947660241 >> 172.21.15.37:0/947660241 conn(0x7f7bcc0b23a0 msgr2=0x7f7bcc154f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.051+0000 7f7bd1a00640 1 -- 172.21.15.37:0/947660241 shutdown_connections 2024-05-30T06:42:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.051+0000 7f7bd1a00640 1 -- 172.21.15.37:0/947660241 wait complete. 2024-05-30T06:42:17.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-30T06:42:17.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-30T06:42:17.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-30T06:42:17.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-30T06:42:17.073 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-30T06:42:17.073 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-30T06:42:17.074 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-30T06:42:17.074 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-30T06:42:17.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.315+0000 7fc213400640 1 Processor -- start 2024-05-30T06:42:17.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.315+0000 7fc213400640 1 -- start start 2024-05-30T06:42:17.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7f08bea00640 1 Processor -- start 2024-05-30T06:42:17.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7fc213400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc20c1606a0 0x7fc20c163c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7f08bea00640 1 -- start start 2024-05-30T06:42:17.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7fc213400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc20c1641a0 con 0x7fc20c06c070 2024-05-30T06:42:17.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7fc213400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc20c0709a0 con 0x7fc20c0b42e0 2024-05-30T06:42:17.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7fc213400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc20c0b7260 con 0x7fc20c1606a0 2024-05-30T06:42:17.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7fc210a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc20c1606a0 0x7fc20c163c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7fc210a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc20c1606a0 0x7fc20c163c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:35320/0 (socket says 172.21.15.37:35320) 2024-05-30T06:42:17.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7fc210a00640 1 -- 172.21.15.37:0/3668390769 learned_addr learned my addr 172.21.15.37:0/3668390769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7f08bea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08b815e880 0x7f08b80d3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7f08bea00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f08b80d3d10 0x7f08b80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7f08bea00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b815ec60 con 0x7f08b80b61b0 2024-05-30T06:42:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7f08bea00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f08b80d41a0 con 0x7f08b815e880 2024-05-30T06:42:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7fc210a00640 1 -- 172.21.15.37:0/3668390769 >> v1:172.21.15.105:6789/0 conn(0x7fc20c0b42e0 legacy=0x7fc20c06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7fc210a00640 1 -- 172.21.15.37:0/3668390769 >> v1:172.21.15.37:6789/0 conn(0x7fc20c06c070 legacy=0x7fc20c0d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7fc210a00640 1 -- 172.21.15.37:0/3668390769 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c070f20 con 0x7fc20c1606a0 2024-05-30T06:42:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.319+0000 7f08bea00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f08b80cef20 con 0x7f08b80d3d10 2024-05-30T06:42:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.323+0000 7f08b7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08b815e880 0x7f08b80d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.323+0000 7f08b7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08b815e880 0x7f08b80d3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60440/0 (socket says 172.21.15.37:60440) 2024-05-30T06:42:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.323+0000 7f08b7e00640 1 -- 172.21.15.37:0/2215082148 learned_addr learned my addr 172.21.15.37:0/2215082148 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.323+0000 7f08b7400640 1 --2- 172.21.15.37:0/2215082148 >> v2:172.21.15.105:3300/0 conn(0x7f08b80d3d10 0x7f08b80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.323+0000 7f08b7400640 1 -- 172.21.15.37:0/2215082148 >> v2:172.21.15.37:3300/0 conn(0x7f08b815e880 msgr2=0x7f08b80d3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.323+0000 7f08b7400640 1 --2- 172.21.15.37:0/2215082148 >> v2:172.21.15.37:3300/0 conn(0x7f08b815e880 0x7f08b80d3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.323+0000 7f08b6a00640 1 -- 172.21.15.37:0/2215082148 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242820211 0 0) 0x7f08b815ec60 con 0x7f08b80b61b0 2024-05-30T06:42:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.323+0000 7f08b7400640 1 -- 172.21.15.37:0/2215082148 >> v1:172.21.15.105:6789/0 conn(0x7f08b80b61b0 legacy=0x7f08b80b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.323+0000 7f08b7400640 1 -- 172.21.15.37:0/2215082148 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b80cf200 con 0x7f08b80d3d10 2024-05-30T06:42:17.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7fc210a00640 1 --2- 172.21.15.37:0/3668390769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c1606a0 0x7fc20c163c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc200009870 tx=0x7fc20001c4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cae86d0c97004bbc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7ff5be200640 1 Processor -- start 2024-05-30T06:42:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7fc20b400640 1 -- 172.21.15.37:0/3668390769 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2000aa400 con 0x7fc20c1606a0 2024-05-30T06:42:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7fc20b400640 1 -- 172.21.15.37:0/3668390769 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2000af070 con 0x7fc20c1606a0 2024-05-30T06:42:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7fc20b400640 1 -- 172.21.15.37:0/3668390769 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2000aa7c0 con 0x7fc20c1606a0 2024-05-30T06:42:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7ff5be200640 1 -- start start 2024-05-30T06:42:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7fc213400640 1 -- 172.21.15.37:0/3668390769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c1606a0 msgr2=0x7fc20c163c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7fc213400640 1 --2- 172.21.15.37:0/3668390769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c1606a0 0x7fc20c163c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc200009870 tx=0x7fc20001c4c0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7fc213400640 1 -- 172.21.15.37:0/3668390769 shutdown_connections 2024-05-30T06:42:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7fc213400640 1 --2- 172.21.15.37:0/3668390769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c1606a0 0x7fc20c163c60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7fc213400640 1 -- 172.21.15.37:0/3668390769 >> 172.21.15.37:0/3668390769 conn(0x7fc20c09aa60 msgr2=0x7fc20c0b6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7f08b7400640 1 --2- 172.21.15.37:0/2215082148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08b80d3d10 0x7f08b80cf720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f08b80d0d80 tx=0x7f08a401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d304ef2885d38c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7fc213400640 1 -- 172.21.15.37:0/3668390769 shutdown_connections 2024-05-30T06:42:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7fc213400640 1 -- 172.21.15.37:0/3668390769 wait complete. 2024-05-30T06:42:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7ff5be200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff5b8072ed0 0x7ff5b80cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7ff5be200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5b806f2e0 0x7ff5b806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7ff5be200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5b80ce9b0 con 0x7ff5b806e490 2024-05-30T06:42:17.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7ff5be200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff5b806e900 con 0x7ff5b8072ed0 2024-05-30T06:42:17.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7ff5be200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b80b5370 con 0x7ff5b806f2e0 2024-05-30T06:42:17.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7ff5b7e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff5b806e490 0x7ff5b80b3c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:52198/0 (socket says 172.21.15.37:52198) 2024-05-30T06:42:17.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7ff5b7e00640 1 -- 172.21.15.37:0/1246749591 learned_addr learned my addr 172.21.15.37:0/1246749591 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:17.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7ff5b6a00640 1 --2- 172.21.15.37:0/1246749591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5b806f2e0 0x7ff5b806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7f08b6a00640 1 -- 172.21.15.37:0/2215082148 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a40b0070 con 0x7f08b80d3d10 2024-05-30T06:42:17.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7f08b6a00640 1 -- 172.21.15.37:0/2215082148 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a40ab600 con 0x7f08b80d3d10 2024-05-30T06:42:17.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.327+0000 7f08b6a00640 1 -- 172.21.15.37:0/2215082148 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a40ab9d0 con 0x7f08b80d3d10 2024-05-30T06:42:17.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7ff5b7400640 1 --2- 172.21.15.37:0/1246749591 >> v2:172.21.15.105:3300/0 conn(0x7ff5b8072ed0 0x7ff5b80cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7ff5b6a00640 1 -- 172.21.15.37:0/1246749591 >> v2:172.21.15.105:3300/0 conn(0x7ff5b8072ed0 msgr2=0x7ff5b80cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7ff5b6a00640 1 --2- 172.21.15.37:0/1246749591 >> v2:172.21.15.105:3300/0 conn(0x7ff5b8072ed0 0x7ff5b80cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7ff5b6a00640 1 -- 172.21.15.37:0/1246749591 >> v1:172.21.15.105:6789/0 conn(0x7ff5b806e490 legacy=0x7ff5b80b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7ff5b6a00640 1 -- 172.21.15.37:0/1246749591 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b80cec20 con 0x7ff5b806f2e0 2024-05-30T06:42:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7ff5b7400640 1 --2- 172.21.15.37:0/1246749591 >> v2:172.21.15.105:3300/0 conn(0x7ff5b8072ed0 0x7ff5b80cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7f08bea00640 1 -- 172.21.15.37:0/2215082148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08b80d3d10 msgr2=0x7f08b80cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7f08bea00640 1 --2- 172.21.15.37:0/2215082148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08b80d3d10 0x7f08b80cf720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f08b80d0d80 tx=0x7f08a401c480 comp rx=0 tx=0).stop 2024-05-30T06:42:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7f08bea00640 1 -- 172.21.15.37:0/2215082148 shutdown_connections 2024-05-30T06:42:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7f08bea00640 1 --2- 172.21.15.37:0/2215082148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08b80d3d10 0x7f08b80cf720 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7f08bea00640 1 --2- 172.21.15.37:0/2215082148 >> v2:172.21.15.37:3300/0 conn(0x7f08b815e880 0x7f08b80d3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7f08bea00640 1 -- 172.21.15.37:0/2215082148 >> 172.21.15.37:0/2215082148 conn(0x7f08b80d1380 msgr2=0x7f08b80d1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7fc213400640 1 Processor -- start 2024-05-30T06:42:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7fc213400640 1 -- start start 2024-05-30T06:42:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7f08bea00640 1 -- 172.21.15.37:0/2215082148 shutdown_connections 2024-05-30T06:42:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7f08bea00640 1 -- 172.21.15.37:0/2215082148 wait complete. 2024-05-30T06:42:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7f8848400640 1 Processor -- start 2024-05-30T06:42:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7fc03f200640 1 Processor -- start 2024-05-30T06:42:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.331+0000 7f8848400640 1 -- start start 2024-05-30T06:42:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc213400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c06c070 0x7fc20c166110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc213400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc20c0b42e0 0x7fc20c15a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc213400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c1606a0 0x7fc20c15ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc213400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c160c00 con 0x7fc20c0b42e0 2024-05-30T06:42:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc213400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c160a80 con 0x7fc20c06c070 2024-05-30T06:42:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc213400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc20c0b6400 con 0x7fc20c1606a0 2024-05-30T06:42:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc03f200640 1 -- start start 2024-05-30T06:42:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc210a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c06c070 0x7fc20c166110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc210a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c06c070 0x7fc20c166110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:35350/0 (socket says 172.21.15.37:35350) 2024-05-30T06:42:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc210a00640 1 -- 172.21.15.37:0/3609307439 learned_addr learned my addr 172.21.15.37:0/3609307439 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc211400640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c1606a0 0x7fc20c15ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f8848400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88400cfc00 0x7f88400d3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc20be00640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc20c0b42e0 0x7fc20c15a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc210a00640 1 -- 172.21.15.37:0/3609307439 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c1606a0 msgr2=0x7fc20c15ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc210a00640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc20c1606a0 0x7fc20c15ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc03f200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc038162e70 0x7fc0380cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc03f200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc038163250 0x7fc0381636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc03f200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc038164190 con 0x7fc0381668a0 2024-05-30T06:42:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc03f200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc03806f8e0 con 0x7fc038162e70 2024-05-30T06:42:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc03f200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc03806ecd0 con 0x7fc038163250 2024-05-30T06:42:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc210a00640 1 -- 172.21.15.37:0/3609307439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc20c0b42e0 msgr2=0x7fc20c15a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f8845a00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f8840162010 0x7f88400cf4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:52202/0 (socket says 172.21.15.37:52202) 2024-05-30T06:42:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc210a00640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc20c0b42e0 0x7fc20c15a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc210a00640 1 -- 172.21.15.37:0/3609307439 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc20c15a800 con 0x7fc20c06c070 2024-05-30T06:42:17.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc20be00640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc20c0b42e0 0x7fc20c15a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:17.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f08bea00640 1 Processor -- start 2024-05-30T06:42:17.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f08bea00640 1 -- start start 2024-05-30T06:42:17.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7ff5b6a00640 1 --2- 172.21.15.37:0/1246749591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5b806f2e0 0x7ff5b806df50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009d90 tx=0x7ff5a801c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9389633c738107de server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc03d200640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fc0381668a0 0x7fc038166cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:52204/0 (socket says 172.21.15.37:52204) 2024-05-30T06:42:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc03d200640 1 -- 172.21.15.37:0/552006362 learned_addr learned my addr 172.21.15.37:0/552006362 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc037400640 1 --2- 172.21.15.37:0/552006362 >> v2:172.21.15.105:3300/0 conn(0x7fc038163250 0x7fc0381636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc037e00640 1 --2- 172.21.15.37:0/552006362 >> v2:172.21.15.37:3300/0 conn(0x7fc038162e70 0x7fc0380cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f8845a00640 1 -- 172.21.15.37:0/1464918950 learned_addr learned my addr 172.21.15.37:0/1464918950 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f8848400640 1 -- 172.21.15.37:0/1464918950 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88400d1640 con 0x7f88400d10d0 2024-05-30T06:42:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f8848400640 1 -- 172.21.15.37:0/1464918950 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88400d1920 con 0x7f8840162010 2024-05-30T06:42:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f8848400640 1 -- 172.21.15.37:0/1464918950 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f88400d2bf0 con 0x7f88400cfc00 2024-05-30T06:42:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f8845000640 1 --2- 172.21.15.37:0/1464918950 >> v2:172.21.15.37:3300/0 conn(0x7f88400cfc00 0x7f88400d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc210a00640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c06c070 0x7fc20c166110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2000ac040 tx=0x7fc20001ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f883fe00640 1 -- 172.21.15.37:0/1464918950 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4008287046 0 0) 0x7f88400d1920 con 0x7f8840162010 2024-05-30T06:42:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f883fe00640 1 -- 172.21.15.37:0/1464918950 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8828003530 con 0x7f8840162010 2024-05-30T06:42:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7ff5b6000640 1 -- 172.21.15.37:0/1246749591 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a80b2070 con 0x7ff5b806f2e0 2024-05-30T06:42:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7ff5b6000640 1 -- 172.21.15.37:0/1246749591 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a80a5710 con 0x7ff5b806f2e0 2024-05-30T06:42:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7ff5b6000640 1 -- 172.21.15.37:0/1246749591 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a80a5ae0 con 0x7ff5b806f2e0 2024-05-30T06:42:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc037400640 1 -- 172.21.15.37:0/552006362 >> v2:172.21.15.37:3300/0 conn(0x7fc038162e70 msgr2=0x7fc0380cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc037400640 1 --2- 172.21.15.37:0/552006362 >> v2:172.21.15.37:3300/0 conn(0x7fc038162e70 0x7fc0380cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc037400640 1 -- 172.21.15.37:0/552006362 >> v1:172.21.15.105:6789/0 conn(0x7fc0381668a0 legacy=0x7fc038166cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc037400640 1 -- 172.21.15.37:0/552006362 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03806efb0 con 0x7fc038163250 2024-05-30T06:42:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7fc037e00640 1 --2- 172.21.15.37:0/552006362 >> v2:172.21.15.37:3300/0 conn(0x7fc038162e70 0x7fc0380cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7ff5be200640 1 -- 172.21.15.37:0/1246749591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5b806f2e0 msgr2=0x7ff5b806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7ff5be200640 1 --2- 172.21.15.37:0/1246749591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5b806f2e0 0x7ff5b806df50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009d90 tx=0x7ff5a801c820 comp rx=0 tx=0).stop 2024-05-30T06:42:17.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7fc208c00640 1 -- 172.21.15.37:0/3609307439 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2000bd5f0 con 0x7fc20c06c070 2024-05-30T06:42:17.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7fc208c00640 1 -- 172.21.15.37:0/3609307439 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2000bd7b0 con 0x7fc20c06c070 2024-05-30T06:42:17.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7ff5be200640 1 -- 172.21.15.37:0/1246749591 shutdown_connections 2024-05-30T06:42:17.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7f08bea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80b61b0 0x7f08b8159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7f08bea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08b815e880 0x7f08b815f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7f08bea00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08b815fc50 0x7f08b8153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7f08bea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f08b80cfde0 con 0x7f08b80b61b0 2024-05-30T06:42:17.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7f08bea00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f08b80cfc60 con 0x7f08b815fc50 2024-05-30T06:42:17.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7f08bea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f08b816bbf0 con 0x7f08b815e880 2024-05-30T06:42:17.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7ff5be200640 1 --2- 172.21.15.37:0/1246749591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5b806f2e0 0x7ff5b806df50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7ff5be200640 1 --2- 172.21.15.37:0/1246749591 >> v2:172.21.15.105:3300/0 conn(0x7ff5b8072ed0 0x7ff5b80cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7ff5be200640 1 -- 172.21.15.37:0/1246749591 >> 172.21.15.37:0/1246749591 conn(0x7ff5b80b23c0 msgr2=0x7ff5b80b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f8845000640 1 -- 172.21.15.37:0/1464918950 >> v1:172.21.15.105:6789/0 conn(0x7f8840162010 legacy=0x7f88400cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f8845000640 1 -- 172.21.15.37:0/1464918950 >> v1:172.21.15.37:6789/0 conn(0x7f88400d10d0 legacy=0x7f88400d35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.335+0000 7f8845000640 1 -- 172.21.15.37:0/1464918950 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88400d1c00 con 0x7f88400cfc00 2024-05-30T06:42:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7fc213400640 1 -- 172.21.15.37:0/3609307439 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc20c15aae0 con 0x7fc20c06c070 2024-05-30T06:42:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7fc213400640 1 -- 172.21.15.37:0/3609307439 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc20c15b0a0 con 0x7fc20c06c070 2024-05-30T06:42:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7fc208c00640 1 -- 172.21.15.37:0/3609307439 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2000bdba0 con 0x7fc20c06c070 2024-05-30T06:42:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7ff5be200640 1 -- 172.21.15.37:0/1246749591 shutdown_connections 2024-05-30T06:42:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7f08bca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08b815fc50 0x7f08b8153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7f08bca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08b815fc50 0x7f08b8153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:35370/0 (socket says 172.21.15.37:35370) 2024-05-30T06:42:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7f08b7400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08b815e880 0x7f08b815f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7f08b7400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08b815e880 0x7f08b815f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34298/0 (socket says 172.21.15.37:34298) 2024-05-30T06:42:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7f08bca00640 1 -- 172.21.15.37:0/3948726406 learned_addr learned my addr 172.21.15.37:0/3948726406 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7fc213400640 1 -- 172.21.15.37:0/3609307439 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc20c15a5a0 con 0x7fc20c06c070 2024-05-30T06:42:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f08b7e00640 1 --2- 172.21.15.37:0/3948726406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80b61b0 0x7f08b8159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.339+0000 7ff5be200640 1 -- 172.21.15.37:0/1246749591 wait complete. 2024-05-30T06:42:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5be200640 1 Processor -- start 2024-05-30T06:42:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5be200640 1 -- start start 2024-05-30T06:42:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f08b7400640 1 -- 172.21.15.37:0/3948726406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08b815fc50 msgr2=0x7f08b8153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f08b7400640 1 --2- 172.21.15.37:0/3948726406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08b815fc50 0x7f08b8153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f08b7400640 1 -- 172.21.15.37:0/3948726406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80b61b0 msgr2=0x7f08b8159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f08b7400640 1 --2- 172.21.15.37:0/3948726406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08b80b61b0 0x7f08b8159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f08b7400640 1 -- 172.21.15.37:0/3948726406 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b8159980 con 0x7f08b815e880 2024-05-30T06:42:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f8845000640 1 --2- 172.21.15.37:0/1464918950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88400cfc00 0x7f88400d3080 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f882c0097c0 tx=0x7f88400d44e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce200472f78b862a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc208c00640 1 -- 172.21.15.37:0/3609307439 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc2000a9070 con 0x7fc20c06c070 2024-05-30T06:42:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f08b7400640 1 --2- 172.21.15.37:0/3948726406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08b815e880 0x7f08b815f710 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f08b80cf0a0 tx=0x7f08a4019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc037400640 1 --2- 172.21.15.37:0/552006362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc038163250 0x7fc0381636d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc03806c5e0 tx=0x7fc02801c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=443d6b94a7cf6305 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff3ea400640 1 Processor -- start 2024-05-30T06:42:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f883fe00640 1 -- 172.21.15.37:0/1464918950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c0b0070 con 0x7f88400cfc00 2024-05-30T06:42:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f883fe00640 1 -- 172.21.15.37:0/1464918950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f882c0ab600 con 0x7f88400cfc00 2024-05-30T06:42:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f883fe00640 1 -- 172.21.15.37:0/1464918950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f882c0ab9d0 con 0x7f88400cfc00 2024-05-30T06:42:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc036a00640 1 -- 172.21.15.37:0/552006362 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0280b0070 con 0x7fc038163250 2024-05-30T06:42:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc036a00640 1 -- 172.21.15.37:0/552006362 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0280ab600 con 0x7fc038163250 2024-05-30T06:42:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc036a00640 1 -- 172.21.15.37:0/552006362 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0280ab9d0 con 0x7fc038163250 2024-05-30T06:42:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f08abe00640 1 -- 172.21.15.37:0/3948726406 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a40b8020 con 0x7f08b815e880 2024-05-30T06:42:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc208c00640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc1ec0683d0 0x7fc1ec06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f08abe00640 1 -- 172.21.15.37:0/3948726406 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a40b4410 con 0x7f08b815e880 2024-05-30T06:42:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f08abe00640 1 -- 172.21.15.37:0/3948726406 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a40b8020 con 0x7f08b815e880 2024-05-30T06:42:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f08bea00640 1 -- 172.21.15.37:0/3948726406 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b8159c60 con 0x7f08b815e880 2024-05-30T06:42:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5be200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5b806e490 0x7ff5b8157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5be200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5b806f2e0 0x7ff5b814be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5be200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b8072ed0 0x7ff5b815ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5be200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b80cf5a0 con 0x7ff5b8072ed0 2024-05-30T06:42:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5be200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b80cf420 con 0x7ff5b806f2e0 2024-05-30T06:42:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5be200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b80cf720 con 0x7ff5b806e490 2024-05-30T06:42:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc208c00640 1 -- 172.21.15.37:0/3609307439 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc200121230 con 0x7fc20c06c070 2024-05-30T06:42:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc208c00640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] conn(0x7fc1ec0705f0 0x7fc1ec072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc20be00640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc1ec0683d0 0x7fc1ec06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc208c00640 1 -- 172.21.15.37:0/3609307439 --> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2000bd7b0 con 0x7fc1ec0705f0 2024-05-30T06:42:17.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc208c00640 1 -- 172.21.15.37:0/3609307439 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc200128050 con 0x7fc20c06c070 2024-05-30T06:42:17.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f08bea00640 1 -- 172.21.15.37:0/3948726406 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b815a220 con 0x7f08b815e880 2024-05-30T06:42:17.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff3ea400640 1 -- start start 2024-05-30T06:42:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5b7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b8072ed0 0x7ff5b815ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5b7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b8072ed0 0x7ff5b815ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60488/0 (socket says 172.21.15.37:60488) 2024-05-30T06:42:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5b7e00640 1 -- 172.21.15.37:0/1821125577 learned_addr learned my addr 172.21.15.37:0/1821125577 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5b6a00640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5b806f2e0 0x7ff5b814be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc03f200640 1 -- 172.21.15.37:0/552006362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc038163250 msgr2=0x7fc0381636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc03f200640 1 --2- 172.21.15.37:0/552006362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc038163250 0x7fc0381636d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc03806c5e0 tx=0x7fc02801c280 comp rx=0 tx=0).stop 2024-05-30T06:42:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f08bea00640 1 -- 172.21.15.37:0/3948726406 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f08b815a600 con 0x7f08b815e880 2024-05-30T06:42:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5b7400640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5b806e490 0x7ff5b8157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f8848400640 1 -- 172.21.15.37:0/1464918950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88400cfc00 msgr2=0x7f88400d3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7f8848400640 1 --2- 172.21.15.37:0/1464918950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88400cfc00 0x7f88400d3080 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f882c0097c0 tx=0x7f88400d44e0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7fc211400640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] conn(0x7fc1ec0705f0 0x7fc1ec072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5b7400640 1 -- 172.21.15.37:0/1821125577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5b806f2e0 msgr2=0x7ff5b814be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5b7400640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5b806f2e0 0x7ff5b814be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5b7400640 1 -- 172.21.15.37:0/1821125577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b8072ed0 msgr2=0x7ff5b815ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5b7400640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b8072ed0 0x7ff5b815ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.343+0000 7ff5b7400640 1 -- 172.21.15.37:0/1821125577 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b815ccf0 con 0x7ff5b806e490 2024-05-30T06:42:17.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7fc20be00640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc1ec0683d0 0x7fc1ec06a890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc20c1600c0 tx=0x7fc1f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7fc03f200640 1 -- 172.21.15.37:0/552006362 shutdown_connections 2024-05-30T06:42:17.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7fc03f200640 1 --2- 172.21.15.37:0/552006362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc038163250 0x7fc0381636d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7fc03f200640 1 --2- 172.21.15.37:0/552006362 >> v2:172.21.15.37:3300/0 conn(0x7fc038162e70 0x7fc0380cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7fc03f200640 1 -- 172.21.15.37:0/552006362 >> 172.21.15.37:0/552006362 conn(0x7fc03806bf60 msgr2=0x7fc0380b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff5b7400640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5b806e490 0x7ff5b8157490 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400c7f0 tx=0x7ff5a400ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f8848400640 1 -- 172.21.15.37:0/1464918950 shutdown_connections 2024-05-30T06:42:17.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f8848400640 1 --2- 172.21.15.37:0/1464918950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88400cfc00 0x7f88400d3080 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f8848400640 1 -- 172.21.15.37:0/1464918950 >> 172.21.15.37:0/1464918950 conn(0x7f884006cc50 msgr2=0x7f884006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7fc211400640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] conn(0x7fc1ec0705f0 0x7fc1ec072a10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc208c00640 1 -- 172.21.15.37:0/3609307439 <== osd.0 v2:172.21.15.37:6800/1733943679 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2000bd7b0 con 0x7fc1ec0705f0 2024-05-30T06:42:17.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f08abe00640 1 -- 172.21.15.37:0/3948726406 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f08a40bb020 con 0x7f08b815e880 2024-05-30T06:42:17.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f08abe00640 1 --2- 172.21.15.37:0/3948726406 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f08980685b0 0x7f089806aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f08abe00640 1 -- 172.21.15.37:0/3948726406 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f08a411ffc0 con 0x7f08b815e880 2024-05-30T06:42:17.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f08abe00640 1 --2- 172.21.15.37:0/3948726406 >> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] conn(0x7f08980707d0 0x7f0898072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f08abe00640 1 -- 172.21.15.37:0/3948726406 --> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08980732a0 con 0x7f08980707d0 2024-05-30T06:42:17.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f08abe00640 1 -- 172.21.15.37:0/3948726406 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f08a41225c0 con 0x7f08b815e880 2024-05-30T06:42:17.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f08b7e00640 1 --2- 172.21.15.37:0/3948726406 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f08980685b0 0x7f089806aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7f08bca00640 1 --2- 172.21.15.37:0/3948726406 >> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] conn(0x7f08980707d0 0x7f0898072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff5af400640 1 -- 172.21.15.37:0/1821125577 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4015070 con 0x7ff5b806e490 2024-05-30T06:42:17.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff5be200640 1 -- 172.21.15.37:0/1821125577 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b815cf90 con 0x7ff5b806e490 2024-05-30T06:42:17.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff5be200640 1 -- 172.21.15.37:0/1821125577 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b814ca30 con 0x7ff5b806e490 2024-05-30T06:42:17.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff5af400640 1 -- 172.21.15.37:0/1821125577 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a4007820 con 0x7ff5b806e490 2024-05-30T06:42:17.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff5af400640 1 -- 172.21.15.37:0/1821125577 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4007bd0 con 0x7ff5b806e490 2024-05-30T06:42:17.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7fc03f200640 1 -- 172.21.15.37:0/552006362 shutdown_connections 2024-05-30T06:42:17.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7fc03f200640 1 -- 172.21.15.37:0/552006362 wait complete. 2024-05-30T06:42:17.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff3ea400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff3dc0532d0 0x7ff3dc03b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff3ea400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3dc0514d0 0x7ff3dc03b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff3ea400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3dc052490 con 0x7ff3dc0e3680 2024-05-30T06:42:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff3ea400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff3dc052770 con 0x7ff3dc0532d0 2024-05-30T06:42:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff3ea400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff3dc054bf0 con 0x7ff3dc0514d0 2024-05-30T06:42:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff3eba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3dc0514d0 0x7ff3dc03b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff3eba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3dc0514d0 0x7ff3dc03b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34324/0 (socket says 172.21.15.37:34324) 2024-05-30T06:42:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff3eba00640 1 -- 172.21.15.37:0/440233185 learned_addr learned my addr 172.21.15.37:0/440233185 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff3e3e00640 1 --2- 172.21.15.37:0/440233185 >> v2:172.21.15.105:3300/0 conn(0x7ff3dc0532d0 0x7ff3dc03b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff3eba00640 1 -- 172.21.15.37:0/440233185 >> v2:172.21.15.105:3300/0 conn(0x7ff3dc0532d0 msgr2=0x7ff3dc03b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff3eba00640 1 --2- 172.21.15.37:0/440233185 >> v2:172.21.15.105:3300/0 conn(0x7ff3dc0532d0 0x7ff3dc03b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff3eba00640 1 -- 172.21.15.37:0/440233185 >> v1:172.21.15.37:6789/0 conn(0x7ff3dc0e3680 legacy=0x7ff3dc052bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7ff3eba00640 1 -- 172.21.15.37:0/440233185 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc054ed0 con 0x7ff3dc0514d0 2024-05-30T06:42:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7ff3e3e00640 1 --2- 172.21.15.37:0/440233185 >> v2:172.21.15.105:3300/0 conn(0x7ff3dc0532d0 0x7ff3dc03b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:17.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7fc526800640 1 Processor -- start 2024-05-30T06:42:17.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f97fbe00640 1 Processor -- start 2024-05-30T06:42:17.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7f08bca00640 1 --2- 172.21.15.37:0/3948726406 >> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] conn(0x7f08980707d0 0x7f0898072bf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7fc03f200640 1 Processor -- start 2024-05-30T06:42:17.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7fc03f200640 1 -- start start 2024-05-30T06:42:17.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc03f200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc038162e70 0x7fc03815b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc03f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc038163250 0x7fc038154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc03f200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0381668a0 0x7fc03815d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc03f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc038163c10 con 0x7fc038163250 2024-05-30T06:42:17.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc03f200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc03806f570 con 0x7fc038162e70 2024-05-30T06:42:17.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc03f200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc03806e960 con 0x7fc0381668a0 2024-05-30T06:42:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f8848400640 1 -- 172.21.15.37:0/1464918950 shutdown_connections 2024-05-30T06:42:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f8848400640 1 -- 172.21.15.37:0/1464918950 wait complete. 2024-05-30T06:42:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f8848400640 1 Processor -- start 2024-05-30T06:42:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7fc526800640 1 -- start start 2024-05-30T06:42:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.347+0000 7f97fbe00640 1 -- start start 2024-05-30T06:42:17.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7f08b7e00640 1 --2- 172.21.15.37:0/3948726406 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f08980685b0 0x7f089806aa70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f08b0000bb0 tx=0x7f08b000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7ff5af400640 1 -- 172.21.15.37:0/1821125577 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff5a4018070 con 0x7ff5b806e490 2024-05-30T06:42:17.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc037400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc038163250 0x7fc038154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc037400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc038163250 0x7fc038154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60494/0 (socket says 172.21.15.37:60494) 2024-05-30T06:42:17.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc037400640 1 -- 172.21.15.37:0/1028829809 learned_addr learned my addr 172.21.15.37:0/1028829809 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc03d200640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0381668a0 0x7fc03815d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc526800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc520160860 0x7fc52006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc526800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc520072510 0x7fc5200b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc526800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc520163330 con 0x7fc5200cdfb0 2024-05-30T06:42:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc526800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc5201630e0 con 0x7fc520160860 2024-05-30T06:42:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc526800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc520163f40 con 0x7fc520072510 2024-05-30T06:42:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc525e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc520072510 0x7fc5200b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc525400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc520160860 0x7fc52006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc525e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc520072510 0x7fc5200b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34332/0 (socket says 172.21.15.37:34332) 2024-05-30T06:42:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7f97fbe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97f40c5d00 0x7f97f409bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7f97fbe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97f40ccc70 0x7f97f40b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7f97fbe00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f406cb10 con 0x7f97f40ce560 2024-05-30T06:42:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7f97fbe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f97f40b1e70 con 0x7f97f40ccc70 2024-05-30T06:42:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7f97fbe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f97f409b6d0 con 0x7f97f40c5d00 2024-05-30T06:42:17.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc037e00640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc038162e70 0x7fc03815b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc03d200640 1 -- 172.21.15.37:0/1028829809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc038162e70 msgr2=0x7fc03815b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc03d200640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc038162e70 0x7fc03815b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc525e00640 1 -- 172.21.15.37:0/956582575 learned_addr learned my addr 172.21.15.37:0/956582575 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc524a00640 1 --1- 172.21.15.37:0/956582575 >> v1:172.21.15.105:6789/0 conn(0x7fc5200cdfb0 0x7fc520071e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:52216/0 (socket says 172.21.15.37:52216) 2024-05-30T06:42:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc525e00640 1 -- 172.21.15.37:0/956582575 >> v2:172.21.15.105:3300/0 conn(0x7fc520160860 msgr2=0x7fc52006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc525e00640 1 --2- 172.21.15.37:0/956582575 >> v2:172.21.15.105:3300/0 conn(0x7fc520160860 0x7fc52006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc525e00640 1 -- 172.21.15.37:0/956582575 >> v1:172.21.15.105:6789/0 conn(0x7fc5200cdfb0 legacy=0x7fc520071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc525e00640 1 -- 172.21.15.37:0/956582575 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc520163610 con 0x7fc520072510 2024-05-30T06:42:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7ff5be200640 1 -- 172.21.15.37:0/1821125577 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5b8068bc0 con 0x7ff5b806e490 2024-05-30T06:42:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc03d200640 1 -- 172.21.15.37:0/1028829809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc038163250 msgr2=0x7fc038154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc03d200640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc038163250 0x7fc038154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7fc03d200640 1 -- 172.21.15.37:0/1028829809 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc038159ba0 con 0x7fc0381668a0 2024-05-30T06:42:17.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7f97f8a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97f40c5d00 0x7f97f409bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7f97f9400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f97f40ce560 0x7f97f40c55f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:52218/0 (socket says 172.21.15.37:52218) 2024-05-30T06:42:17.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.351+0000 7f97f9400640 1 -- 172.21.15.37:0/2115644135 learned_addr learned my addr 172.21.15.37:0/2115644135 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:17.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f8848400640 1 -- start start 2024-05-30T06:42:17.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f97f9e00640 1 --2- 172.21.15.37:0/2115644135 >> v2:172.21.15.37:3300/0 conn(0x7f97f40ccc70 0x7f97f40b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7fc03d200640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0381668a0 0x7fc03815d260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc02000ec90 tx=0x7fc02000c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f08abe00640 1 -- 172.21.15.37:0/3948726406 <== osd.1 v2:172.21.15.37:6808/2386979500 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f08980732a0 con 0x7f08980707d0 2024-05-30T06:42:17.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7ff5af400640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff598068380 0x7ff59806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7ff5af400640 1 -- 172.21.15.37:0/1821125577 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff5a4086930 con 0x7ff5b806e490 2024-05-30T06:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7ff5af400640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] conn(0x7ff598070520 0x7ff598072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7ff5af400640 1 -- 172.21.15.37:0/1821125577 --> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff598072ff0 con 0x7ff598070520 2024-05-30T06:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7ff5af400640 1 -- 172.21.15.37:0/1821125577 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff5a408b280 con 0x7ff5b806e490 2024-05-30T06:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7ff5b7e00640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] conn(0x7ff598070520 0x7ff598072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7ff5b6a00640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff598068380 0x7ff59806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7ff5b7e00640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] conn(0x7ff598070520 0x7ff598072940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7ff5b6a00640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff598068380 0x7ff59806a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80af000 tx=0x7ff5a80a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7fc02fe00640 1 -- 172.21.15.37:0/1028829809 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020019070 con 0x7fc0381668a0 2024-05-30T06:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7fc02fe00640 1 -- 172.21.15.37:0/1028829809 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0200078f0 con 0x7fc0381668a0 2024-05-30T06:42:17.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7fc02fe00640 1 -- 172.21.15.37:0/1028829809 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020019070 con 0x7fc0381668a0 2024-05-30T06:42:17.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7fc03f200640 1 -- 172.21.15.37:0/1028829809 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc038159e80 con 0x7fc0381668a0 2024-05-30T06:42:17.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7fc03f200640 1 -- 172.21.15.37:0/1028829809 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03815a4d0 con 0x7fc0381668a0 2024-05-30T06:42:17.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7fc03f200640 1 -- 172.21.15.37:0/1028829809 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc038159950 con 0x7fc0381668a0 2024-05-30T06:42:17.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f8848400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88400cfc00 0x7f88400cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f8848400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88400d10d0 0x7f88400cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f8845a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88400cfc00 0x7f88400cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f8845a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88400cfc00 0x7f88400cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34348/0 (socket says 172.21.15.37:34348) 2024-05-30T06:42:17.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f8845a00640 1 -- 172.21.15.37:0/3014877799 learned_addr learned my addr 172.21.15.37:0/3014877799 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f8848400640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8840162010 0x7f8840160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f884016cc70 con 0x7f88400d10d0 2024-05-30T06:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f884016caf0 con 0x7f8840162010 2024-05-30T06:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f8845000640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88400d10d0 0x7f88400cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f8846400640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8840162010 0x7f8840160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f884016cdf0 con 0x7f88400cfc00 2024-05-30T06:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f97f8a00640 1 -- 172.21.15.37:0/2115644135 >> v2:172.21.15.37:3300/0 conn(0x7f97f40ccc70 msgr2=0x7f97f40b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f97f8a00640 1 --2- 172.21.15.37:0/2115644135 >> v2:172.21.15.37:3300/0 conn(0x7f97f40ccc70 0x7f97f40b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f97f8a00640 1 -- 172.21.15.37:0/2115644135 >> v1:172.21.15.105:6789/0 conn(0x7f97f40ce560 legacy=0x7f97f40c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.355+0000 7f97f8a00640 1 -- 172.21.15.37:0/2115644135 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f406d060 con 0x7f97f40c5d00 2024-05-30T06:42:17.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f8846400640 1 -- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88400cfc00 msgr2=0x7f88400cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f8846400640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88400cfc00 0x7f88400cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f8846400640 1 -- 172.21.15.37:0/3014877799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88400d10d0 msgr2=0x7f88400cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7fc525e00640 1 --2- 172.21.15.37:0/956582575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc520072510 0x7fc5200b3520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc518009e50 tx=0x7fc51801ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e331cbbca7aa152b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f8846400640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88400d10d0 0x7f88400cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f8846400640 1 -- 172.21.15.37:0/3014877799 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88400cdd70 con 0x7f8840162010 2024-05-30T06:42:17.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7ff3eba00640 1 --2- 172.21.15.37:0/440233185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3dc0514d0 0x7ff3dc03b870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009870 tx=0x7ff3d801c580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5e7fdf5ac0a165 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7fc51fe00640 1 -- 172.21.15.37:0/956582575 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5180a5900 con 0x7fc520072510 2024-05-30T06:42:17.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7fc51fe00640 1 -- 172.21.15.37:0/956582575 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5180a5aa0 con 0x7fc520072510 2024-05-30T06:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7fc51fe00640 1 -- 172.21.15.37:0/956582575 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5180ad3f0 con 0x7fc520072510 2024-05-30T06:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7ff3e3400640 1 -- 172.21.15.37:0/440233185 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80b2070 con 0x7ff3dc0514d0 2024-05-30T06:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7ff3e3400640 1 -- 172.21.15.37:0/440233185 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d80a9070 con 0x7ff3dc0514d0 2024-05-30T06:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7ff3e3400640 1 -- 172.21.15.37:0/440233185 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80ad880 con 0x7ff3dc0514d0 2024-05-30T06:42:17.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7ff5af400640 1 -- 172.21.15.37:0/1821125577 <== osd.2 v2:172.21.15.37:6820/2792170181 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff598072ff0 con 0x7ff598070520 2024-05-30T06:42:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f8846400640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8840162010 0x7f8840160660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f883800c730 tx=0x7f883800cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7fc526800640 1 -- 172.21.15.37:0/956582575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc520072510 msgr2=0x7fc5200b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7fc526800640 1 --2- 172.21.15.37:0/956582575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc520072510 0x7fc5200b3520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc518009e50 tx=0x7fc51801ca30 comp rx=0 tx=0).stop 2024-05-30T06:42:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7fc526800640 1 -- 172.21.15.37:0/956582575 shutdown_connections 2024-05-30T06:42:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7fc526800640 1 --2- 172.21.15.37:0/956582575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc520072510 0x7fc5200b3520 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7fc526800640 1 --2- 172.21.15.37:0/956582575 >> v2:172.21.15.105:3300/0 conn(0x7fc520160860 0x7fc52006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7fc526800640 1 -- 172.21.15.37:0/956582575 >> 172.21.15.37:0/956582575 conn(0x7fc520067d60 msgr2=0x7fc52006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7ff3ea400640 1 -- 172.21.15.37:0/440233185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3dc0514d0 msgr2=0x7ff3dc03b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7ff3ea400640 1 --2- 172.21.15.37:0/440233185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3dc0514d0 0x7ff3dc03b870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009870 tx=0x7ff3d801c580 comp rx=0 tx=0).stop 2024-05-30T06:42:17.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f97f8a00640 1 --2- 172.21.15.37:0/2115644135 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97f40c5d00 0x7f97f409bac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f97e80097c0 tx=0x7f97e801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73f8500c96bf4850 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f883d600640 1 -- 172.21.15.37:0/3014877799 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838003b80 con 0x7f8840162010 2024-05-30T06:42:17.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f883d600640 1 -- 172.21.15.37:0/3014877799 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8838003d20 con 0x7f8840162010 2024-05-30T06:42:17.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f883d600640 1 -- 172.21.15.37:0/3014877799 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838005310 con 0x7f8840162010 2024-05-30T06:42:17.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88400cba20 con 0x7f8840162010 2024-05-30T06:42:17.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7ff3ea400640 1 -- 172.21.15.37:0/440233185 shutdown_connections 2024-05-30T06:42:17.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7ff3ea400640 1 --2- 172.21.15.37:0/440233185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3dc0514d0 0x7ff3dc03b870 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7ff3ea400640 1 --2- 172.21.15.37:0/440233185 >> v2:172.21.15.105:3300/0 conn(0x7ff3dc0532d0 0x7ff3dc03b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7ff3ea400640 1 -- 172.21.15.37:0/440233185 >> 172.21.15.37:0/440233185 conn(0x7ff3dc053990 msgr2=0x7ff3dc053da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7fc02fe00640 1 -- 172.21.15.37:0/1028829809 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc02001c070 con 0x7fc0381668a0 2024-05-30T06:42:17.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88400cbfe0 con 0x7f8840162010 2024-05-30T06:42:17.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7fc526800640 1 -- 172.21.15.37:0/956582575 shutdown_connections 2024-05-30T06:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f97f3e00640 1 -- 172.21.15.37:0/2115644135 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e80b1070 con 0x7f97f40c5d00 2024-05-30T06:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f97f3e00640 1 -- 172.21.15.37:0/2115644135 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e80ac410 con 0x7f97f40c5d00 2024-05-30T06:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8840068bc0 con 0x7f8840162010 2024-05-30T06:42:17.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.359+0000 7f97f3e00640 1 -- 172.21.15.37:0/2115644135 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e80ac7e0 con 0x7f97f40c5d00 2024-05-30T06:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc02fe00640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc014068780 0x7fc01406ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc526800640 1 -- 172.21.15.37:0/956582575 wait complete. 2024-05-30T06:42:17.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc02fe00640 1 -- 172.21.15.37:0/1028829809 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc02000cd50 con 0x7fc0381668a0 2024-05-30T06:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7f97fbe00640 1 -- 172.21.15.37:0/2115644135 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97f40c5d00 msgr2=0x7f97f409bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7f97fbe00640 1 --2- 172.21.15.37:0/2115644135 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97f40c5d00 0x7f97f409bac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f97e80097c0 tx=0x7f97e801c4a0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7f97fbe00640 1 -- 172.21.15.37:0/2115644135 shutdown_connections 2024-05-30T06:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7f97fbe00640 1 --2- 172.21.15.37:0/2115644135 >> v2:172.21.15.37:3300/0 conn(0x7f97f40ccc70 0x7f97f40b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc037e00640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc014068780 0x7fc01406ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc02fe00640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] conn(0x7fc014070920 0x7fc014072d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc02fe00640 1 -- 172.21.15.37:0/1028829809 --> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc020015e50 con 0x7fc014070920 2024-05-30T06:42:17.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc02fe00640 1 -- 172.21.15.37:0/1028829809 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc020054050 con 0x7fc0381668a0 2024-05-30T06:42:17.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc037400640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] conn(0x7fc014070920 0x7fc014072d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7f97fbe00640 1 --2- 172.21.15.37:0/2115644135 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97f40c5d00 0x7f97f409bac0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc037e00640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc014068780 0x7fc01406ac40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc030009b80 tx=0x7fc030009750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7f97fbe00640 1 -- 172.21.15.37:0/2115644135 >> 172.21.15.37:0/2115644135 conn(0x7f97f40b4130 msgr2=0x7f97f40b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7f97fbe00640 1 -- 172.21.15.37:0/2115644135 shutdown_connections 2024-05-30T06:42:17.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7f97fbe00640 1 -- 172.21.15.37:0/2115644135 wait complete. 2024-05-30T06:42:17.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc526800640 1 Processor -- start 2024-05-30T06:42:17.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc526800640 1 -- start start 2024-05-30T06:42:17.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc037400640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] conn(0x7fc014070920 0x7fc014072d40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc526800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc520072510 0x7fc520165130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc526800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5200cdfb0 0x7fc520162080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc526800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc520160860 0x7fc520151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc526800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc52006f300 con 0x7fc520160860 2024-05-30T06:42:17.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc526800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc52006f180 con 0x7fc5200cdfb0 2024-05-30T06:42:17.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.363+0000 7fc526800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc52016f780 con 0x7fc520072510 2024-05-30T06:42:17.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7f883d600640 1 -- 172.21.15.37:0/3014877799 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f88380056c0 con 0x7f8840162010 2024-05-30T06:42:17.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7fc525400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc520072510 0x7fc520165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7fc525400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc520072510 0x7fc520165130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34360/0 (socket says 172.21.15.37:34360) 2024-05-30T06:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7fc525400640 1 -- 172.21.15.37:0/817392080 learned_addr learned my addr 172.21.15.37:0/817392080 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7fc525e00640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc520160860 0x7fc520151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7fc524a00640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5200cdfb0 0x7fc520162080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7fc525400640 1 -- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5200cdfb0 msgr2=0x7fc520162080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7fc525400640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5200cdfb0 0x7fc520162080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7fc525400640 1 -- 172.21.15.37:0/817392080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc520160860 msgr2=0x7fc520151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7fc525400640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc520160860 0x7fc520151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7fc525400640 1 -- 172.21.15.37:0/817392080 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc520162c70 con 0x7fc520072510 2024-05-30T06:42:17.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7fc02fe00640 1 -- 172.21.15.37:0/1028829809 <== osd.3 v2:172.21.15.37:6816/409363430 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc020015e50 con 0x7fc014070920 2024-05-30T06:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7fc525400640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc520072510 0x7fc520165130 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00e870 tx=0x7fc50c00ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7f883d600640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8820068450 0x7f882006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7f883d600640 1 -- 172.21.15.37:0/3014877799 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8838086840 con 0x7f8840162010 2024-05-30T06:42:17.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7f97fbe00640 1 Processor -- start 2024-05-30T06:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7f8845a00640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8820068450 0x7f882006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7f883d600640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] conn(0x7f8820070670 0x7f8820072a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7f883d600640 1 -- 172.21.15.37:0/3014877799 --> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8838010e50 con 0x7f8820070670 2024-05-30T06:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7f883d600640 1 -- 172.21.15.37:0/3014877799 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f883808b2a0 con 0x7f8840162010 2024-05-30T06:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7f97fbe00640 1 -- start start 2024-05-30T06:42:17.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7ff3ea400640 1 -- 172.21.15.37:0/440233185 shutdown_connections 2024-05-30T06:42:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7f8845000640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] conn(0x7f8820070670 0x7f8820072a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7f8845a00640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8820068450 0x7f882006a910 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f88340011f0 tx=0x7f8834009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7ff3ea400640 1 -- 172.21.15.37:0/440233185 wait complete. 2024-05-30T06:42:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7ff3ea400640 1 Processor -- start 2024-05-30T06:42:17.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7ff3ea400640 1 -- start start 2024-05-30T06:42:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7fc51d600640 1 -- 172.21.15.37:0/817392080 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c017070 con 0x7fc520072510 2024-05-30T06:42:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7fc51d600640 1 -- 172.21.15.37:0/817392080 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50c00c940 con 0x7fc520072510 2024-05-30T06:42:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7fc51d600640 1 -- 172.21.15.37:0/817392080 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c00ccf0 con 0x7fc520072510 2024-05-30T06:42:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7fc526800640 1 -- 172.21.15.37:0/817392080 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5201629f0 con 0x7fc520072510 2024-05-30T06:42:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7fc526800640 1 -- 172.21.15.37:0/817392080 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc52014ee80 con 0x7fc520072510 2024-05-30T06:42:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7fc526800640 1 -- 172.21.15.37:0/817392080 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc520068ab0 con 0x7fc520072510 2024-05-30T06:42:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97fbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97f40c5d00 0x7f97f40caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97fbe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97f40ccc70 0x7f97f415cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97fbe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97f40ce560 0x7f97f40d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97f8a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97f40ccc70 0x7f97f415cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97fbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97f416fe80 con 0x7f97f40c5d00 2024-05-30T06:42:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97f8a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97f40ccc70 0x7f97f415cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:44992/0 (socket says 172.21.15.37:44992) 2024-05-30T06:42:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97f8a00640 1 -- 172.21.15.37:0/1547593015 learned_addr learned my addr 172.21.15.37:0/1547593015 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97fbe00640 1 -- 172.21.15.37:0/1547593015 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f97f416fd00 con 0x7f97f40ce560 2024-05-30T06:42:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97f9e00640 1 --2- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97f40ce560 0x7f97f40d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97fbe00640 1 -- 172.21.15.37:0/1547593015 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f97f4170000 con 0x7f97f40ccc70 2024-05-30T06:42:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97f8a00640 1 -- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97f40ce560 msgr2=0x7f97f40d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97f8a00640 1 --2- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97f40ce560 0x7f97f40d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97f8a00640 1 -- 172.21.15.37:0/1547593015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97f40c5d00 msgr2=0x7f97f40caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97f8a00640 1 --2- 172.21.15.37:0/1547593015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97f40c5d00 0x7f97f40caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97f8a00640 1 -- 172.21.15.37:0/1547593015 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f40cb8f0 con 0x7f97f40ccc70 2024-05-30T06:42:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97f8a00640 1 --2- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97f40ccc70 0x7f97f415cb50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f97e80097c0 tx=0x7f97e8019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97f1600640 1 -- 172.21.15.37:0/1547593015 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e80b1040 con 0x7f97f40ccc70 2024-05-30T06:42:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97f1600640 1 -- 172.21.15.37:0/1547593015 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e80bb070 con 0x7f97f40ccc70 2024-05-30T06:42:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97f1600640 1 -- 172.21.15.37:0/1547593015 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e80b5630 con 0x7f97f40ccc70 2024-05-30T06:42:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97fbe00640 1 -- 172.21.15.37:0/1547593015 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f40cbbd0 con 0x7f97f40ccc70 2024-05-30T06:42:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f97fbe00640 1 -- 172.21.15.37:0/1547593015 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f40cc190 con 0x7f97f40ccc70 2024-05-30T06:42:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.367+0000 7f8845000640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] conn(0x7f8820070670 0x7f8820072a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.371+0000 7f883d600640 1 -- 172.21.15.37:0/3014877799 <== osd.4 v2:172.21.15.105:6800/700801319 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8838010e50 con 0x7f8820070670 2024-05-30T06:42:17.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.375+0000 7f97f1600640 1 -- 172.21.15.37:0/1547593015 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f97e80b57d0 con 0x7f97f40ccc70 2024-05-30T06:42:17.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.375+0000 7fc51d600640 1 -- 172.21.15.37:0/817392080 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc50c01a070 con 0x7fc520072510 2024-05-30T06:42:17.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.375+0000 7fc51d600640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5000683d0 0x7fc50006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.375+0000 7fc51d600640 1 -- 172.21.15.37:0/817392080 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc50c0867b0 con 0x7fc520072510 2024-05-30T06:42:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.375+0000 7fc51d600640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] conn(0x7fc5000705f0 0x7fc500072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.375+0000 7fc51d600640 1 -- 172.21.15.37:0/817392080 --> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc50c00ae50 con 0x7fc5000705f0 2024-05-30T06:42:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.375+0000 7fc51d600640 1 -- 172.21.15.37:0/817392080 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc50c08d050 con 0x7fc520072510 2024-05-30T06:42:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.375+0000 7fc525e00640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] conn(0x7fc5000705f0 0x7fc500072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.375+0000 7fc524a00640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5000683d0 0x7fc50006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.375+0000 7f97f1600640 1 --2- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97d8068380 0x7f97d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.375+0000 7f97f1600640 1 -- 172.21.15.37:0/1547593015 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f97e8120430 con 0x7f97f40ccc70 2024-05-30T06:42:17.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.375+0000 7fc525e00640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] conn(0x7fc5000705f0 0x7fc500072a10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7f97e2a00640 1 --2- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] conn(0x7f97f40cc3d0 0x7f97f40c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3ea400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3dc0514d0 0x7ff3dc00a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3ea400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3dc0532d0 0x7ff3dc0d66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3ea400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3dc0e3680 0x7ff3dc0d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3ea400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc0f04b0 con 0x7ff3dc0532d0 2024-05-30T06:42:17.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3ea400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc0f0330 con 0x7ff3dc0514d0 2024-05-30T06:42:17.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3ea400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff3dc0f0630 con 0x7ff3dc0e3680 2024-05-30T06:42:17.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7f97e2a00640 1 -- 172.21.15.37:0/1547593015 --> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97f40b85a0 con 0x7f97f40cc3d0 2024-05-30T06:42:17.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7f97f9400640 1 --2- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97d8068380 0x7f97d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7f97f9e00640 1 --2- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] conn(0x7f97f40cc3d0 0x7f97f40c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7fc524a00640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5000683d0 0x7fc50006a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc52014b1c0 tx=0x7fc514007e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3eba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3dc0e3680 0x7ff3dc0d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3eba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3dc0e3680 0x7ff3dc0d1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:44996/0 (socket says 172.21.15.37:44996) 2024-05-30T06:42:17.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3eba00640 1 -- 172.21.15.37:0/3420956475 learned_addr learned my addr 172.21.15.37:0/3420956475 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7fc51d600640 1 -- 172.21.15.37:0/817392080 <== osd.6 v2:172.21.15.105:6816/2790478860 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc50c00ae50 con 0x7fc5000705f0 2024-05-30T06:42:17.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3eba00640 1 -- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3dc0514d0 msgr2=0x7ff3dc00a940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T06:42:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3eba00640 1 --2- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3dc0514d0 0x7ff3dc00a940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3eba00640 1 -- 172.21.15.37:0/3420956475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3dc0532d0 msgr2=0x7ff3dc0d66c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T06:42:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3eba00640 1 --2- 172.21.15.37:0/3420956475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3dc0532d0 0x7ff3dc0d66c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3eba00640 1 -- 172.21.15.37:0/3420956475 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc04e4c0 con 0x7ff3dc0e3680 2024-05-30T06:42:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7f97f9400640 1 --2- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97d8068380 0x7f97d806a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97e4001560 tx=0x7f97e4007a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7f97f9e00640 1 --2- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] conn(0x7f97f40cc3d0 0x7f97f40c96d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3eba00640 1 --2- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3dc0e3680 0x7ff3dc0d1fa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff3d801a1b0 tx=0x7ff3d8019320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7fc213400640 1 -- 172.21.15.37:0/3609307439 --> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc20c0ae460 con 0x7fc1ec0705f0 2024-05-30T06:42:17.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3e0c00640 1 -- 172.21.15.37:0/3420956475 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80b2040 con 0x7ff3dc0e3680 2024-05-30T06:42:17.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3e0c00640 1 -- 172.21.15.37:0/3420956475 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d80bb070 con 0x7ff3dc0e3680 2024-05-30T06:42:17.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3ea400640 1 -- 172.21.15.37:0/3420956475 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3dc04e7a0 con 0x7ff3dc0e3680 2024-05-30T06:42:17.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3e0c00640 1 -- 172.21.15.37:0/3420956475 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80b6830 con 0x7ff3dc0e3680 2024-05-30T06:42:17.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7ff3ea400640 1 -- 172.21.15.37:0/3420956475 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3dc04ed60 con 0x7ff3dc0e3680 2024-05-30T06:42:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.379+0000 7f97f1600640 1 -- 172.21.15.37:0/1547593015 <== osd.7 v2:172.21.15.105:6817/4038189667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97f40b85a0 con 0x7f97f40cc3d0 2024-05-30T06:42:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7fc208c00640 1 -- 172.21.15.37:0/3609307439 <== osd.0 v2:172.21.15.37:6800/1733943679 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc20c0ae460 con 0x7fc1ec0705f0 2024-05-30T06:42:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7ff3ea400640 1 -- 172.21.15.37:0/3420956475 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff3dc04f130 con 0x7ff3dc0e3680 2024-05-30T06:42:17.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7fc213400640 1 -- 172.21.15.37:0/3609307439 >> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] conn(0x7fc1ec0705f0 msgr2=0x7fc1ec072a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7fc213400640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] conn(0x7fc1ec0705f0 0x7fc1ec072a10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7fc213400640 1 -- 172.21.15.37:0/3609307439 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc1ec0683d0 msgr2=0x7fc1ec06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7fc213400640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc1ec0683d0 0x7fc1ec06a890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc20c1600c0 tx=0x7fc1f8009040 comp rx=0 tx=0).stop 2024-05-30T06:42:17.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7fc213400640 1 -- 172.21.15.37:0/3609307439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c06c070 msgr2=0x7fc20c166110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7fc213400640 1 --2- 172.21.15.37:0/3609307439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc20c06c070 0x7fc20c166110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2000ac040 tx=0x7fc20001ad00 comp rx=0 tx=0).stop 2024-05-30T06:42:17.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7fc211400640 1 -- 172.21.15.37:0/3609307439 reap_dead start 2024-05-30T06:42:17.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7fc213400640 1 -- 172.21.15.37:0/3609307439 shutdown_connections 2024-05-30T06:42:17.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7fc213400640 1 -- 172.21.15.37:0/3609307439 >> 172.21.15.37:0/3609307439 conn(0x7fc20c09aa60 msgr2=0x7fc20c0cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7ff3e0c00640 1 -- 172.21.15.37:0/3420956475 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff3d80ab070 con 0x7ff3dc0e3680 2024-05-30T06:42:17.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7ff3e0c00640 1 --2- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3c40683d0 0x7ff3c406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.383+0000 7ff3e0c00640 1 -- 172.21.15.37:0/3420956475 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff3d8120680 con 0x7ff3dc0e3680 2024-05-30T06:42:17.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.387+0000 7ff3e9000640 1 --2- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3c40683d0 0x7ff3c406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.387+0000 7ff3e0c00640 1 --2- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] conn(0x7ff3c4070570 0x7ff3c4072990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.387+0000 7ff3e0c00640 1 -- 172.21.15.37:0/3420956475 --> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3d80c1e50 con 0x7ff3c4070570 2024-05-30T06:42:17.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.387+0000 7ff3e0c00640 1 -- 172.21.15.37:0/3420956475 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff3d80ec950 con 0x7ff3dc0e3680 2024-05-30T06:42:17.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.387+0000 7fc213400640 1 -- 172.21.15.37:0/3609307439 shutdown_connections 2024-05-30T06:42:17.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.387+0000 7ff3e3e00640 1 --2- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] conn(0x7ff3c4070570 0x7ff3c4072990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.387+0000 7fc213400640 1 -- 172.21.15.37:0/3609307439 wait complete. 2024-05-30T06:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.387+0000 7ff3e9000640 1 --2- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3c40683d0 0x7ff3c406a890 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4065520 tx=0x7ff3e4076d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.387+0000 7ff3e3e00640 1 --2- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] conn(0x7ff3c4070570 0x7ff3c4072990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.387+0000 7ff3e0c00640 1 -- 172.21.15.37:0/3420956475 <== osd.5 v2:172.21.15.105:6808/2549616191 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff3d80c1e50 con 0x7ff3c4070570 2024-05-30T06:42:17.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.391+0000 7f08bea00640 1 -- 172.21.15.37:0/3948726406 --> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f08b8068ab0 con 0x7f08980707d0 2024-05-30T06:42:17.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.391+0000 7f08abe00640 1 -- 172.21.15.37:0/3948726406 <== osd.1 v2:172.21.15.37:6808/2386979500 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f08b8068ab0 con 0x7f08980707d0 2024-05-30T06:42:17.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.391+0000 7fc03f200640 1 -- 172.21.15.37:0/1028829809 --> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc038068bc0 con 0x7fc014070920 2024-05-30T06:42:17.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.395+0000 7f08bea00640 1 -- 172.21.15.37:0/3948726406 >> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] conn(0x7f08980707d0 msgr2=0x7f0898072bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.395+0000 7f08bea00640 1 --2- 172.21.15.37:0/3948726406 >> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] conn(0x7f08980707d0 0x7f0898072bf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.395+0000 7f08bea00640 1 -- 172.21.15.37:0/3948726406 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f08980685b0 msgr2=0x7f089806aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.395+0000 7f08bea00640 1 --2- 172.21.15.37:0/3948726406 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f08980685b0 0x7f089806aa70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f08b0000bb0 tx=0x7f08b000b040 comp rx=0 tx=0).stop 2024-05-30T06:42:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.395+0000 7f08bea00640 1 -- 172.21.15.37:0/3948726406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08b815e880 msgr2=0x7f08b815f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.395+0000 7f08bea00640 1 --2- 172.21.15.37:0/3948726406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08b815e880 0x7f08b815f710 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f08b80cf0a0 tx=0x7f08a4019220 comp rx=0 tx=0).stop 2024-05-30T06:42:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.395+0000 7f08bca00640 1 -- 172.21.15.37:0/3948726406 reap_dead start 2024-05-30T06:42:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.395+0000 7f08bea00640 1 -- 172.21.15.37:0/3948726406 shutdown_connections 2024-05-30T06:42:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.395+0000 7f08bea00640 1 -- 172.21.15.37:0/3948726406 >> 172.21.15.37:0/3948726406 conn(0x7f08b80d1380 msgr2=0x7f08b80d1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.395+0000 7f08bea00640 1 -- 172.21.15.37:0/3948726406 shutdown_connections 2024-05-30T06:42:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.395+0000 7f08bea00640 1 -- 172.21.15.37:0/3948726406 wait complete. 2024-05-30T06:42:17.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.399+0000 7ff5be200640 1 -- 172.21.15.37:0/1821125577 --> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff5b80b5d10 con 0x7ff598070520 2024-05-30T06:42:17.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.399+0000 7fc02fe00640 1 -- 172.21.15.37:0/1028829809 <== osd.3 v2:172.21.15.37:6816/409363430 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc038068bc0 con 0x7fc014070920 2024-05-30T06:42:17.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.399+0000 7ff5af400640 1 -- 172.21.15.37:0/1821125577 <== osd.2 v2:172.21.15.37:6820/2792170181 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff5b80b5d10 con 0x7ff598070520 2024-05-30T06:42:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.399+0000 7ff5be200640 1 -- 172.21.15.37:0/1821125577 >> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] conn(0x7ff598070520 msgr2=0x7ff598072940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.399+0000 7ff5be200640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] conn(0x7ff598070520 0x7ff598072940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.399+0000 7ff5be200640 1 -- 172.21.15.37:0/1821125577 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff598068380 msgr2=0x7ff59806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.399+0000 7ff5be200640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff598068380 0x7ff59806a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80af000 tx=0x7ff5a80a7070 comp rx=0 tx=0).stop 2024-05-30T06:42:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.399+0000 7ff5be200640 1 -- 172.21.15.37:0/1821125577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5b806e490 msgr2=0x7ff5b8157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.399+0000 7ff5be200640 1 --2- 172.21.15.37:0/1821125577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5b806e490 0x7ff5b8157490 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400c7f0 tx=0x7ff5a400ccb0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.399+0000 7ff5b7e00640 1 -- 172.21.15.37:0/1821125577 reap_dead start 2024-05-30T06:42:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7ff5be200640 1 -- 172.21.15.37:0/1821125577 shutdown_connections 2024-05-30T06:42:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7ff5be200640 1 -- 172.21.15.37:0/1821125577 >> 172.21.15.37:0/1821125577 conn(0x7ff5b80b23c0 msgr2=0x7ff5b8074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7ff5be200640 1 -- 172.21.15.37:0/1821125577 shutdown_connections 2024-05-30T06:42:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7f97e2a00640 1 -- 172.21.15.37:0/1547593015 --> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f97f40d3310 con 0x7f97f40cc3d0 2024-05-30T06:42:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7ff5be200640 1 -- 172.21.15.37:0/1821125577 wait complete. 2024-05-30T06:42:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7fc526800640 1 -- 172.21.15.37:0/817392080 --> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc5200b53b0 con 0x7fc5000705f0 2024-05-30T06:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7fc03f200640 1 -- 172.21.15.37:0/1028829809 >> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] conn(0x7fc014070920 msgr2=0x7fc014072d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7fc03f200640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] conn(0x7fc014070920 0x7fc014072d40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 --> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f88400d24c0 con 0x7f8820070670 2024-05-30T06:42:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7f97f1600640 1 -- 172.21.15.37:0/1547593015 <== osd.7 v2:172.21.15.105:6817/4038189667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f97f40d3310 con 0x7f97f40cc3d0 2024-05-30T06:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7fc03f200640 1 -- 172.21.15.37:0/1028829809 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc014068780 msgr2=0x7fc01406ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7fc03f200640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc014068780 0x7fc01406ac40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc030009b80 tx=0x7fc030009750 comp rx=0 tx=0).stop 2024-05-30T06:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7fc03f200640 1 -- 172.21.15.37:0/1028829809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0381668a0 msgr2=0x7fc03815d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7fc03f200640 1 --2- 172.21.15.37:0/1028829809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0381668a0 0x7fc03815d260 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc02000ec90 tx=0x7fc02000c430 comp rx=0 tx=0).stop 2024-05-30T06:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7fc03d200640 1 -- 172.21.15.37:0/1028829809 reap_dead start 2024-05-30T06:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7fc03f200640 1 -- 172.21.15.37:0/1028829809 shutdown_connections 2024-05-30T06:42:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7fc03f200640 1 -- 172.21.15.37:0/1028829809 >> 172.21.15.37:0/1028829809 conn(0x7fc03806bf60 msgr2=0x7fc0380cc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f883d600640 1 -- 172.21.15.37:0/3014877799 <== osd.4 v2:172.21.15.105:6800/700801319 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f88400d24c0 con 0x7f8820070670 2024-05-30T06:42:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.403+0000 7fc51d600640 1 -- 172.21.15.37:0/817392080 <== osd.6 v2:172.21.15.105:6816/2790478860 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc5200b53b0 con 0x7fc5000705f0 2024-05-30T06:42:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f97e2a00640 1 -- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] conn(0x7f97f40cc3d0 msgr2=0x7f97f40c96d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f97e2a00640 1 --2- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] conn(0x7f97f40cc3d0 0x7f97f40c96d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f97e2a00640 1 -- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97d8068380 msgr2=0x7f97d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f97e2a00640 1 --2- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97d8068380 0x7f97d806a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f97e4001560 tx=0x7f97e4007a50 comp rx=0 tx=0).stop 2024-05-30T06:42:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f97e2a00640 1 -- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97f40ccc70 msgr2=0x7f97f415cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f97e2a00640 1 --2- 172.21.15.37:0/1547593015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97f40ccc70 0x7f97f415cb50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f97e80097c0 tx=0x7f97e8019240 comp rx=0 tx=0).stop 2024-05-30T06:42:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f97f9e00640 1 -- 172.21.15.37:0/1547593015 reap_dead start 2024-05-30T06:42:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] conn(0x7f8820070670 msgr2=0x7f8820072a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f8848400640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] conn(0x7f8820070670 0x7f8820072a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f97e2a00640 1 -- 172.21.15.37:0/1547593015 shutdown_connections 2024-05-30T06:42:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f97e2a00640 1 -- 172.21.15.37:0/1547593015 >> 172.21.15.37:0/1547593015 conn(0x7f97f40b4130 msgr2=0x7f97f40b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7fc03f200640 1 -- 172.21.15.37:0/1028829809 shutdown_connections 2024-05-30T06:42:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7fc03f200640 1 -- 172.21.15.37:0/1028829809 wait complete. 2024-05-30T06:42:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8820068450 msgr2=0x7f882006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f8848400640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8820068450 0x7f882006a910 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f88340011f0 tx=0x7f8834009040 comp rx=0 tx=0).stop 2024-05-30T06:42:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8840162010 msgr2=0x7f8840160660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f8848400640 1 --2- 172.21.15.37:0/3014877799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8840162010 0x7f8840160660 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f883800c730 tx=0x7f883800cbf0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f8846400640 1 -- 172.21.15.37:0/3014877799 reap_dead start 2024-05-30T06:42:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7fc526800640 1 -- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] conn(0x7fc5000705f0 msgr2=0x7fc500072a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f97e2a00640 1 -- 172.21.15.37:0/1547593015 shutdown_connections 2024-05-30T06:42:17.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 shutdown_connections 2024-05-30T06:42:17.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 >> 172.21.15.37:0/3014877799 conn(0x7f884006cc50 msgr2=0x7f884006d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7fc526800640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] conn(0x7fc5000705f0 0x7fc500072a10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 shutdown_connections 2024-05-30T06:42:17.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f97e2a00640 1 -- 172.21.15.37:0/1547593015 wait complete. 2024-05-30T06:42:17.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7f8848400640 1 -- 172.21.15.37:0/3014877799 wait complete. 2024-05-30T06:42:17.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7fc526800640 1 -- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5000683d0 msgr2=0x7fc50006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7fc526800640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5000683d0 0x7fc50006a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc52014b1c0 tx=0x7fc514007e50 comp rx=0 tx=0).stop 2024-05-30T06:42:17.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7fc526800640 1 -- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc520072510 msgr2=0x7fc520165130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7fc526800640 1 --2- 172.21.15.37:0/817392080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc520072510 0x7fc520165130 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00e870 tx=0x7fc50c00ec70 comp rx=0 tx=0).stop 2024-05-30T06:42:17.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7fc525e00640 1 -- 172.21.15.37:0/817392080 reap_dead start 2024-05-30T06:42:17.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7fc526800640 1 -- 172.21.15.37:0/817392080 shutdown_connections 2024-05-30T06:42:17.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7fc526800640 1 -- 172.21.15.37:0/817392080 >> 172.21.15.37:0/817392080 conn(0x7fc520067d60 msgr2=0x7fc5200ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7fc526800640 1 -- 172.21.15.37:0/817392080 shutdown_connections 2024-05-30T06:42:17.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.407+0000 7fc526800640 1 -- 172.21.15.37:0/817392080 wait complete. 2024-05-30T06:42:17.423 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-05-30T06:42:17.423 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-30T06:42:17.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.423+0000 7ff3ea400640 1 -- 172.21.15.37:0/3420956475 --> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff3dc0059c0 con 0x7ff3c4070570 2024-05-30T06:42:17.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.423+0000 7ff3e0c00640 1 -- 172.21.15.37:0/3420956475 <== osd.5 v2:172.21.15.105:6808/2549616191 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff3dc0059c0 con 0x7ff3c4070570 2024-05-30T06:42:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.423+0000 7ff3ea400640 1 -- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] conn(0x7ff3c4070570 msgr2=0x7ff3c4072990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.423+0000 7ff3ea400640 1 --2- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] conn(0x7ff3c4070570 0x7ff3c4072990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.423+0000 7ff3ea400640 1 -- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3c40683d0 msgr2=0x7ff3c406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.423+0000 7ff3ea400640 1 --2- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3c40683d0 0x7ff3c406a890 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4065520 tx=0x7ff3e4076d10 comp rx=0 tx=0).stop 2024-05-30T06:42:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.423+0000 7ff3ea400640 1 -- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3dc0e3680 msgr2=0x7ff3dc0d1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.423+0000 7ff3ea400640 1 --2- 172.21.15.37:0/3420956475 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3dc0e3680 0x7ff3dc0d1fa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff3d801a1b0 tx=0x7ff3d8019320 comp rx=0 tx=0).stop 2024-05-30T06:42:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.423+0000 7ff3eba00640 1 -- 172.21.15.37:0/3420956475 reap_dead start 2024-05-30T06:42:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.427+0000 7ff3ea400640 1 -- 172.21.15.37:0/3420956475 shutdown_connections 2024-05-30T06:42:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.427+0000 7ff3ea400640 1 -- 172.21.15.37:0/3420956475 >> 172.21.15.37:0/3420956475 conn(0x7ff3dc053990 msgr2=0x7ff3dc052b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.427+0000 7ff3ea400640 1 -- 172.21.15.37:0/3420956475 shutdown_connections 2024-05-30T06:42:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.427+0000 7ff3ea400640 1 -- 172.21.15.37:0/3420956475 wait complete. 2024-05-30T06:42:17.432 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-05-30T06:42:17.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-30T06:42:17.445 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-05-30T06:42:17.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-30T06:42:17.446 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2024-05-30T06:42:17.447 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-30T06:42:17.450 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-05-30T06:42:17.450 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-05-30T06:42:17.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-30T06:42:17.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-30T06:42:17.452 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-05-30T06:42:17.452 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-30T06:42:17.461 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-05-30T06:42:17.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-30T06:42:17.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.667+0000 7fefdd200640 1 Processor -- start 2024-05-30T06:42:17.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.667+0000 7fefdd200640 1 -- start start 2024-05-30T06:42:17.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.671+0000 7fefdd200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefd815a960 0x7fefd806e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.671+0000 7fefdd200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fefd8071e30 0x7fefd80722e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.671+0000 7fefdd200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd80b5290 con 0x7fefd80afcc0 2024-05-30T06:42:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.671+0000 7fefd5e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefd815a960 0x7fefd806e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.671+0000 7fefd5400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fefd80afcc0 0x7fefd80ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47222/0 (socket says 172.21.15.37:47222) 2024-05-30T06:42:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.671+0000 7fefd5400640 1 -- 172.21.15.37:0/2212689108 learned_addr learned my addr 172.21.15.37:0/2212689108 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.671+0000 7fefd6800640 1 --2- 172.21.15.37:0/2212689108 >> v2:172.21.15.105:3300/0 conn(0x7fefd8071e30 0x7fefd80722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.671+0000 7fefdd200640 1 -- 172.21.15.37:0/2212689108 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fefd80b3780 con 0x7fefd8071e30 2024-05-30T06:42:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.671+0000 7fefdd200640 1 -- 172.21.15.37:0/2212689108 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fefd80b5570 con 0x7fefd815a960 2024-05-30T06:42:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.671+0000 7fefd4a00640 1 -- 172.21.15.37:0/2212689108 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2982396663 0 0) 0x7fefd80b5290 con 0x7fefd80afcc0 2024-05-30T06:42:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.671+0000 7fefd4a00640 1 -- 172.21.15.37:0/2212689108 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefbc003530 con 0x7fefd80afcc0 2024-05-30T06:42:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.671+0000 7fefd5e00640 1 -- 172.21.15.37:0/2212689108 >> v2:172.21.15.105:3300/0 conn(0x7fefd8071e30 msgr2=0x7fefd80722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.675+0000 7fefd5e00640 1 --2- 172.21.15.37:0/2212689108 >> v2:172.21.15.105:3300/0 conn(0x7fefd8071e30 0x7fefd80722e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.675+0000 7fefd5e00640 1 -- 172.21.15.37:0/2212689108 >> v1:172.21.15.105:6789/0 conn(0x7fefd80afcc0 legacy=0x7fefd80ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.675+0000 7fefd5e00640 1 -- 172.21.15.37:0/2212689108 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd80b5850 con 0x7fefd815a960 2024-05-30T06:42:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.679+0000 7fefd6800640 1 --2- 172.21.15.37:0/2212689108 >> v2:172.21.15.105:3300/0 conn(0x7fefd8071e30 0x7fefd80722e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.679+0000 7fefd5e00640 1 --2- 172.21.15.37:0/2212689108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefd815a960 0x7fefd806e5c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fefd000bfa0 tx=0x7fefd001eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6256e0eee23c54b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.679+0000 7fefd4a00640 1 -- 172.21.15.37:0/2212689108 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd000b2d0 con 0x7fefd815a960 2024-05-30T06:42:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.679+0000 7fefd4a00640 1 -- 172.21.15.37:0/2212689108 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd00a7840 con 0x7fefd815a960 2024-05-30T06:42:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.679+0000 7fefd4a00640 1 -- 172.21.15.37:0/2212689108 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd00a7c10 con 0x7fefd815a960 2024-05-30T06:42:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.679+0000 7fefdd200640 1 -- 172.21.15.37:0/2212689108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefd815a960 msgr2=0x7fefd806e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.679+0000 7fefdd200640 1 --2- 172.21.15.37:0/2212689108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefd815a960 0x7fefd806e5c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fefd000bfa0 tx=0x7fefd001eb90 comp rx=0 tx=0).stop 2024-05-30T06:42:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.679+0000 7fefdd200640 1 -- 172.21.15.37:0/2212689108 shutdown_connections 2024-05-30T06:42:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.679+0000 7fefdd200640 1 --2- 172.21.15.37:0/2212689108 >> v2:172.21.15.105:3300/0 conn(0x7fefd8071e30 0x7fefd80722e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.679+0000 7fefdd200640 1 --2- 172.21.15.37:0/2212689108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefd815a960 0x7fefd806e5c0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fefd000bfa0 tx=0x7fefd001eb90 comp rx=0 tx=0).stop 2024-05-30T06:42:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.683+0000 7fefdd200640 1 -- 172.21.15.37:0/2212689108 >> 172.21.15.37:0/2212689108 conn(0x7fefd8067b60 msgr2=0x7fefd806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.687+0000 7fefdd200640 1 -- 172.21.15.37:0/2212689108 shutdown_connections 2024-05-30T06:42:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.687+0000 7fefdd200640 1 -- 172.21.15.37:0/2212689108 wait complete. 2024-05-30T06:42:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.687+0000 7f4cfcc00640 1 Processor -- start 2024-05-30T06:42:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.687+0000 7fefdd200640 1 Processor -- start 2024-05-30T06:42:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.687+0000 7fefdd200640 1 -- start start 2024-05-30T06:42:17.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.687+0000 7f4cfcc00640 1 -- start start 2024-05-30T06:42:17.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7fefdd200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd8071e30 0x7fefd80af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7fefdd200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fefd80afcc0 0x7fefd81503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7fefd5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd8071e30 0x7fefd80af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7fefd5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd8071e30 0x7fefd80af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33860/0 (socket says 172.21.15.37:33860) 2024-05-30T06:42:17.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cfcc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf806c070 0x7f4cf815a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cfcc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4cf80b4fd0 0x7f4cf80b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7fefd5e00640 1 -- 172.21.15.37:0/120521360 learned_addr learned my addr 172.21.15.37:0/120521360 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cfcc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf8161420 con 0x7f4cf8071e00 2024-05-30T06:42:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cfcc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf80b5970 con 0x7f4cf80b4fd0 2024-05-30T06:42:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cfcc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf806de40 con 0x7f4cf806c070 2024-05-30T06:42:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf7e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4cf8071e00 0x7f4cf8072270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47676/0 (socket says 172.21.15.37:47676) 2024-05-30T06:42:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf7e00640 1 -- 172.21.15.37:0/2119101479 learned_addr learned my addr 172.21.15.37:0/2119101479 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:17.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7fefdd200640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefd8150c90 0x7fefd81f7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3182084687 0 0) 0x7f4cf8161420 con 0x7f4cf8071e00 2024-05-30T06:42:17.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cdc003530 con 0x7f4cf8071e00 2024-05-30T06:42:17.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf7400640 1 --2- 172.21.15.37:0/2119101479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf806c070 0x7f4cf815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7fe68e200640 1 Processor -- start 2024-05-30T06:42:17.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7fefd5400640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fefd80afcc0 0x7fefd81503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6a00640 1 --2- 172.21.15.37:0/2119101479 >> v2:172.21.15.105:3300/0 conn(0x7f4cf80b4fd0 0x7f4cf80b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 634949472 0 0) 0x7f4cdc003530 con 0x7f4cf8071e00 2024-05-30T06:42:17.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf806c070 msgr2=0x7f4cf815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7fefdd200640 1 -- 172.21.15.37:0/120521360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fefd80b47b0 con 0x7fefd8071e30 2024-05-30T06:42:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7fefdd200640 1 -- 172.21.15.37:0/120521360 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fefd80b4630 con 0x7fefd80afcc0 2024-05-30T06:42:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7fefdd200640 1 -- 172.21.15.37:0/120521360 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fefd8167750 con 0x7fefd8150c90 2024-05-30T06:42:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7fefd6800640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefd8150c90 0x7fefd81f7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fefd5e00640 1 -- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefd8150c90 msgr2=0x7fefd81f7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fefd5e00640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefd8150c90 0x7fefd81f7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fefd5e00640 1 -- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fefd80afcc0 msgr2=0x7fefd81503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fefd5e00640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fefd80afcc0 0x7fefd81503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fefd5e00640 1 -- 172.21.15.37:0/120521360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd80aa6b0 con 0x7fefd8071e30 2024-05-30T06:42:17.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fefd6800640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefd8150c90 0x7fefd81f7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fe68e200640 1 -- start start 2024-05-30T06:42:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 --2- 172.21.15.37:0/2119101479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf806c070 0x7f4cf815a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 >> v2:172.21.15.105:3300/0 conn(0x7f4cf80b4fd0 msgr2=0x7f4cf80b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 --2- 172.21.15.37:0/2119101479 >> v2:172.21.15.105:3300/0 conn(0x7f4cf80b4fd0 0x7f4cf80b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf806e090 con 0x7f4cf8071e00 2024-05-30T06:42:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f4ce80016a0 con 0x7f4cf8071e00 2024-05-30T06:42:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 >> v1:172.21.15.37:6789/0 conn(0x7f4cf8071e00 legacy=0x7f4cf8072270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 --2- 172.21.15.37:0/2119101479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cdc0039c0 0x7f4cdc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 --2- 172.21.15.37:0/2119101479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cdc004810 0x7f4cdc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 --2- 172.21.15.37:0/2119101479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf806c070 0x7f4cdc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf806de40 con 0x7f4cdc004810 2024-05-30T06:42:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc00b9d0 con 0x7f4cdc0039c0 2024-05-30T06:42:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.691+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4cdc00bbd0 con 0x7f4cf806c070 2024-05-30T06:42:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7f4cf7e00640 1 --2- 172.21.15.37:0/2119101479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf806c070 0x7f4cdc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7f4cf6a00640 1 --2- 172.21.15.37:0/2119101479 >> v2:172.21.15.105:3300/0 conn(0x7f4cf80b4fd0 0x7f4cf80b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7f4cf6a00640 1 --2- 172.21.15.37:0/2119101479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cdc004810 0x7f4cdc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7f4cf7e00640 1 -- 172.21.15.37:0/2119101479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cdc0039c0 msgr2=0x7f4cdc003e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T06:42:17.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7f4cf7e00640 1 --2- 172.21.15.37:0/2119101479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cdc0039c0 0x7f4cdc003e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7f4cf7e00640 1 -- 172.21.15.37:0/2119101479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cdc004810 msgr2=0x7f4cdc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7f4cf7e00640 1 --2- 172.21.15.37:0/2119101479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cdc004810 0x7f4cdc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7f4cf7e00640 1 -- 172.21.15.37:0/2119101479 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf806e090 con 0x7f4cf806c070 2024-05-30T06:42:17.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fefd5e00640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd8071e30 0x7fefd80af050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fefd00b1040 tx=0x7fefd001b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fe68e200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe68806e660 0x7fe688165510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fe68e200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6880ce9b0 con 0x7fe6880cfff0 2024-05-30T06:42:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fe68e200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6880cfb30 con 0x7fe68806f2e0 2024-05-30T06:42:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fe68e200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe6880b5370 con 0x7fe68806e660 2024-05-30T06:42:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fe686a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe6880cfff0 0x7fe68806df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47692/0 (socket says 172.21.15.37:47692) 2024-05-30T06:42:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fe686a00640 1 -- 172.21.15.37:0/440995658 learned_addr learned my addr 172.21.15.37:0/440995658 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fe687e00640 1 --2- 172.21.15.37:0/440995658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe68806e660 0x7fe688165510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fefce000640 1 -- 172.21.15.37:0/120521360 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd0009540 con 0x7fefd8071e30 2024-05-30T06:42:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fefdd200640 1 -- 172.21.15.37:0/120521360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd80aa970 con 0x7fefd8071e30 2024-05-30T06:42:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.699+0000 7fefdd200640 1 -- 172.21.15.37:0/120521360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd80aaf30 con 0x7fefd8071e30 2024-05-30T06:42:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fe686000640 1 -- 172.21.15.37:0/440995658 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270756301 0 0) 0x7fe6880ce9b0 con 0x7fe6880cfff0 2024-05-30T06:42:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fe687e00640 1 -- 172.21.15.37:0/440995658 >> v1:172.21.15.105:6789/0 conn(0x7fe68806f2e0 legacy=0x7fe6880cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.695+0000 7fe687e00640 1 -- 172.21.15.37:0/440995658 >> v1:172.21.15.37:6789/0 conn(0x7fe6880cfff0 legacy=0x7fe68806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.699+0000 7fe687e00640 1 -- 172.21.15.37:0/440995658 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6880cec20 con 0x7fe68806e660 2024-05-30T06:42:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.699+0000 7fefc3400640 1 -- 172.21.15.37:0/120521360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd8068ab0 con 0x7fefd8071e30 2024-05-30T06:42:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.699+0000 7f4cf7e00640 1 --2- 172.21.15.37:0/2119101479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf806c070 0x7f4cdc0051d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800c370 tx=0x7f4ce801f4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d9022604d41b15f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7fefce000640 1 -- 172.21.15.37:0/120521360 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd0009700 con 0x7fefd8071e30 2024-05-30T06:42:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7fefce000640 1 -- 172.21.15.37:0/120521360 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd0009af0 con 0x7fefd8071e30 2024-05-30T06:42:17.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8007e60 con 0x7f4cf806c070 2024-05-30T06:42:17.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce8005ae0 con 0x7f4cf806c070 2024-05-30T06:42:17.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7f4cf6000640 1 -- 172.21.15.37:0/2119101479 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8007070 con 0x7f4cf806c070 2024-05-30T06:42:17.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7fe687e00640 1 --2- 172.21.15.37:0/440995658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe68806e660 0x7fe688165510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe6780097f0 tx=0x7fe67801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8a683a9f585cdeb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7f4cfcc00640 1 -- 172.21.15.37:0/2119101479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf806c070 msgr2=0x7f4cdc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7f4cfcc00640 1 --2- 172.21.15.37:0/2119101479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf806c070 0x7f4cdc0051d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800c370 tx=0x7f4ce801f4f0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7f4cf7e00640 1 -- 172.21.15.37:0/2119101479 reap_dead start 2024-05-30T06:42:17.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7f4cfcc00640 1 -- 172.21.15.37:0/2119101479 shutdown_connections 2024-05-30T06:42:17.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7f4cfcc00640 1 -- 172.21.15.37:0/2119101479 >> 172.21.15.37:0/2119101479 conn(0x7f4cf8067b60 msgr2=0x7f4cf806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7fefce000640 1 -- 172.21.15.37:0/120521360 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fefd00c0020 con 0x7fefd8071e30 2024-05-30T06:42:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7fe686000640 1 -- 172.21.15.37:0/440995658 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6780b2070 con 0x7fe68806e660 2024-05-30T06:42:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7fe686000640 1 -- 172.21.15.37:0/440995658 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6780a9070 con 0x7fe68806e660 2024-05-30T06:42:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7fe686000640 1 -- 172.21.15.37:0/440995658 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6780b2070 con 0x7fe68806e660 2024-05-30T06:42:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7fefce000640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fefb8068450 0x7fefb806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7fefce000640 1 -- 172.21.15.37:0/120521360 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fefd0121310 con 0x7fefd8071e30 2024-05-30T06:42:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7f4cfcc00640 1 -- 172.21.15.37:0/2119101479 shutdown_connections 2024-05-30T06:42:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7fefd5400640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fefb8068450 0x7fefb806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7fe68e200640 1 -- 172.21.15.37:0/440995658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe68806e660 msgr2=0x7fe688165510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7fe68e200640 1 --2- 172.21.15.37:0/440995658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe68806e660 0x7fe688165510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe6780097f0 tx=0x7fe67801c490 comp rx=0 tx=0).stop 2024-05-30T06:42:17.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.707+0000 7fe68e200640 1 -- 172.21.15.37:0/440995658 shutdown_connections 2024-05-30T06:42:17.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.707+0000 7fe68e200640 1 --2- 172.21.15.37:0/440995658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe68806e660 0x7fe688165510 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.707+0000 7fe68e200640 1 -- 172.21.15.37:0/440995658 >> 172.21.15.37:0/440995658 conn(0x7fe6880b23c0 msgr2=0x7fe6880b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.707+0000 7fefd5400640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fefb8068450 0x7fefb806a910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fefc8007fd0 tx=0x7fefc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.707+0000 7fe68e200640 1 -- 172.21.15.37:0/440995658 shutdown_connections 2024-05-30T06:42:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.707+0000 7fe68e200640 1 -- 172.21.15.37:0/440995658 wait complete. 2024-05-30T06:42:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.703+0000 7f4cfcc00640 1 -- 172.21.15.37:0/2119101479 wait complete. 2024-05-30T06:42:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.707+0000 7f4cfcc00640 1 Processor -- start 2024-05-30T06:42:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.707+0000 7f4cfcc00640 1 -- start start 2024-05-30T06:42:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.707+0000 7fe68e200640 1 Processor -- start 2024-05-30T06:42:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.707+0000 7fe68e200640 1 -- start start 2024-05-30T06:42:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fa65b000640 1 Processor -- start 2024-05-30T06:42:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cfcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf8151190 0x7f4cf8201ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fa65b000640 1 -- start start 2024-05-30T06:42:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cf7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf8151190 0x7f4cf8201ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cf7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf8151190 0x7f4cf8201ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33888/0 (socket says 172.21.15.37:33888) 2024-05-30T06:42:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fe68e200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe68806e660 0x7fe688150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cfcc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cf814cda0 0x7f4cf80a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cfcc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf80aaa10 0x7f4cf80a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cfcc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf806e930 con 0x7f4cf8151190 2024-05-30T06:42:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cfcc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf806e650 con 0x7f4cf814cda0 2024-05-30T06:42:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cfcc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf815a510 con 0x7f4cf80aaa10 2024-05-30T06:42:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fe68e200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe68806f2e0 0x7fe68815ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fe68e200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6880cfff0 0x7fe68814d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fe687400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe68806e660 0x7fe688150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fe687400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe68806e660 0x7fe688150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59122/0 (socket says 172.21.15.37:59122) 2024-05-30T06:42:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fe687400640 1 -- 172.21.15.37:0/3208545368 learned_addr learned my addr 172.21.15.37:0/3208545368 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fe686a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe68806f2e0 0x7fe68815ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fe68e200640 1 -- 172.21.15.37:0/3208545368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe6881683f0 con 0x7fe6880cfff0 2024-05-30T06:42:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fe68e200640 1 -- 172.21.15.37:0/3208545368 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe688168270 con 0x7fe68806e660 2024-05-30T06:42:17.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cf7400640 1 -- 172.21.15.37:0/1104943011 learned_addr learned my addr 172.21.15.37:0/1104943011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cf7e00640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf80aaa10 0x7f4cf80a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cf6a00640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cf814cda0 0x7f4cf80a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fe68e200640 1 -- 172.21.15.37:0/3208545368 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe688168570 con 0x7fe68806f2e0 2024-05-30T06:42:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fa65b000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa65406f2e0 0x7fa6540cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fa65b000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 0x7fa65415e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fa65b000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6540ce9b0 con 0x7fa6540cf420 2024-05-30T06:42:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fa65b000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa6540b5370 con 0x7fa65406f2e0 2024-05-30T06:42:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fa65b000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa6540cec20 con 0x7fa65406e660 2024-05-30T06:42:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cf7e00640 1 -- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cf814cda0 msgr2=0x7f4cf80a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cf7e00640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cf814cda0 0x7f4cf80a94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cf7e00640 1 -- 172.21.15.37:0/1104943011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf8151190 msgr2=0x7f4cf8201ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cf7e00640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf8151190 0x7f4cf8201ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7f4cf7e00640 1 -- 172.21.15.37:0/1104943011 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf82025f0 con 0x7f4cf80aaa10 2024-05-30T06:42:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fa659000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 0x7fa65415e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fa653e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa65406f2e0 0x7fa6540cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fa659000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 0x7fa65415e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:45040/0 (socket says 172.21.15.37:45040) 2024-05-30T06:42:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.711+0000 7fa659000640 1 -- 172.21.15.37:0/483113470 learned_addr learned my addr 172.21.15.37:0/483113470 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fefce000640 1 -- 172.21.15.37:0/120521360 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fefd0018780 con 0x7fefd8071e30 2024-05-30T06:42:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fe687400640 1 -- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe68806f2e0 msgr2=0x7fe68815ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fe687400640 1 --2- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe68806f2e0 0x7fe68815ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fe687400640 1 -- 172.21.15.37:0/3208545368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6880cfff0 msgr2=0x7fe68814d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fe687400640 1 --2- 172.21.15.37:0/3208545368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6880cfff0 0x7fe68814d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fe687400640 1 -- 172.21.15.37:0/3208545368 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68815bf50 con 0x7fe68806e660 2024-05-30T06:42:17.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fe686a00640 1 --2- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe68806f2e0 0x7fe68815ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fa659000640 1 -- 172.21.15.37:0/483113470 >> v2:172.21.15.37:3300/0 conn(0x7fa65406f2e0 msgr2=0x7fa6540cfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f4cf7e00640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf80aaa10 0x7f4cf80a9a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009000 tx=0x7f4cdc005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f4cef400640 1 -- 172.21.15.37:0/1104943011 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8007e60 con 0x7f4cf80aaa10 2024-05-30T06:42:17.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fe687400640 1 --2- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe68806e660 0x7fe688150de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe68000c790 tx=0x7fe68000cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f4cfcc00640 1 -- 172.21.15.37:0/1104943011 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf82028d0 con 0x7f4cf80aaa10 2024-05-30T06:42:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f4cfcc00640 1 -- 172.21.15.37:0/1104943011 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf8202e90 con 0x7f4cf80aaa10 2024-05-30T06:42:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f4cef400640 1 -- 172.21.15.37:0/1104943011 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce80048b0 con 0x7f4cf80aaa10 2024-05-30T06:42:17.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f8c4fc00640 1 Processor -- start 2024-05-30T06:42:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fe67f400640 1 -- 172.21.15.37:0/3208545368 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680016020 con 0x7fe68806e660 2024-05-30T06:42:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f8c4fc00640 1 -- start start 2024-05-30T06:42:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fe68e200640 1 -- 172.21.15.37:0/3208545368 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6881513c0 con 0x7fe68806e660 2024-05-30T06:42:17.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fe67f400640 1 -- 172.21.15.37:0/3208545368 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe680006d60 con 0x7fe68806e660 2024-05-30T06:42:17.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fa659000640 1 --2- 172.21.15.37:0/483113470 >> v2:172.21.15.37:3300/0 conn(0x7fa65406f2e0 0x7fa6540cfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fa659000640 1 -- 172.21.15.37:0/483113470 >> v1:172.21.15.105:6789/0 conn(0x7fa6540cf420 legacy=0x7fa65406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fa659000640 1 -- 172.21.15.37:0/483113470 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6540cef00 con 0x7fa65406e660 2024-05-30T06:42:17.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fa653e00640 1 --2- 172.21.15.37:0/483113470 >> v2:172.21.15.37:3300/0 conn(0x7fa65406f2e0 0x7fa6540cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:17.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f4cef400640 1 -- 172.21.15.37:0/1104943011 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8004c60 con 0x7f4cf80aaa10 2024-05-30T06:42:17.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f4cfcc00640 1 -- 172.21.15.37:0/1104943011 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf8068ab0 con 0x7f4cf80aaa10 2024-05-30T06:42:17.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fe68e200640 1 -- 172.21.15.37:0/3208545368 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe688151980 con 0x7fe68806e660 2024-05-30T06:42:17.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f73ff200640 1 Processor -- start 2024-05-30T06:42:17.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7fe67f400640 1 -- 172.21.15.37:0/3208545368 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680003bc0 con 0x7fe68806e660 2024-05-30T06:42:17.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f73ff200640 1 -- start start 2024-05-30T06:42:17.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f8c4fc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8c480d1a00 0x7f8c480d3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f8c4fc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c480d0250 con 0x7f8c481620d0 2024-05-30T06:42:17.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f8c4fc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c480d2d90 con 0x7f8c480cf4e0 2024-05-30T06:42:17.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.715+0000 7f8c4fc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8c480d0010 con 0x7f8c480d1a00 2024-05-30T06:42:17.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f73ff200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f740015ea40 0x7f74000d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f73ff200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f74000b4df0 0x7f74000d2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f73ff200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74000b1320 con 0x7f74000b5ce0 2024-05-30T06:42:17.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f73ff200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f74000b15e0 con 0x7f74000b4df0 2024-05-30T06:42:17.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f73ff200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f74000b18c0 con 0x7f740015ea40 2024-05-30T06:42:17.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c4d200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8c481620d0 0x7f8c480d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47704/0 (socket says 172.21.15.37:47704) 2024-05-30T06:42:17.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8c480d1a00 0x7f8c480d3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c4d200640 1 -- 172.21.15.37:0/231690434 learned_addr learned my addr 172.21.15.37:0/231690434 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:17.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f4cef400640 1 -- 172.21.15.37:0/1104943011 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ce8007070 con 0x7f4cf80aaa10 2024-05-30T06:42:17.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f73fe800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f74000b4df0 0x7f74000d2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f73fe800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f74000b4df0 0x7f74000d2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59140/0 (socket says 172.21.15.37:59140) 2024-05-30T06:42:17.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f73fe800640 1 -- 172.21.15.37:0/2636805394 learned_addr learned my addr 172.21.15.37:0/2636805394 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f73fde00640 1 --2- 172.21.15.37:0/2636805394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f740015ea40 0x7f74000d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7fa659000640 1 --2- 172.21.15.37:0/483113470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 0x7fa65415e390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa6400090e0 tx=0x7fa64001e620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1194fd6b52bf9743 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7fea2d200640 1 Processor -- start 2024-05-30T06:42:17.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7fea2d200640 1 -- start start 2024-05-30T06:42:17.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7fe67f400640 1 -- 172.21.15.37:0/3208545368 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe68000a850 con 0x7fe68806e660 2024-05-30T06:42:17.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fe67cc00640 1 -- 172.21.15.37:0/3208545368 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6600052a0 con 0x7fe68806e660 2024-05-30T06:42:17.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fe67f400640 1 --2- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe668068380 0x7fe66806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fe67f400640 1 -- 172.21.15.37:0/3208545368 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe680085fd0 con 0x7fe68806e660 2024-05-30T06:42:17.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f73fe800640 1 -- 172.21.15.37:0/2636805394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f740015ea40 msgr2=0x7f74000d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f73fe800640 1 --2- 172.21.15.37:0/2636805394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f740015ea40 0x7f74000d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f73fe800640 1 -- 172.21.15.37:0/2636805394 >> v1:172.21.15.37:6789/0 conn(0x7f74000b5ce0 legacy=0x7f74000b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f73fe800640 1 -- 172.21.15.37:0/2636805394 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74000b1ba0 con 0x7f74000b4df0 2024-05-30T06:42:17.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3313596373 0 0) 0x7f8c480d0250 con 0x7f8c481620d0 2024-05-30T06:42:17.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c2c003530 con 0x7f8c481620d0 2024-05-30T06:42:17.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 616818724 0 0) 0x7f8c2c003530 con 0x7f8c481620d0 2024-05-30T06:42:17.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 >> v2:172.21.15.105:3300/0 conn(0x7f8c480d1a00 msgr2=0x7f8c480d3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 --2- 172.21.15.37:0/231690434 >> v2:172.21.15.105:3300/0 conn(0x7f8c480d1a00 0x7f8c480d3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 >> v1:172.21.15.105:6789/0 conn(0x7f8c480cf4e0 legacy=0x7f8c480cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c480d3070 con 0x7f8c481620d0 2024-05-30T06:42:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f8c40001a00 con 0x7f8c481620d0 2024-05-30T06:42:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 >> v1:172.21.15.37:6789/0 conn(0x7f8c481620d0 legacy=0x7f8c480d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 --2- 172.21.15.37:0/231690434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c2c0039c0 0x7f8c2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 --2- 172.21.15.37:0/231690434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c004810 0x7f8c2c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 --2- 172.21.15.37:0/231690434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c2c005240 0x7f8c2c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480d0010 con 0x7f8c2c0039c0 2024-05-30T06:42:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2c00c1a0 con 0x7f8c2c005240 2024-05-30T06:42:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8c2c00c3a0 con 0x7f8c2c004810 2024-05-30T06:42:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c47e00640 1 --2- 172.21.15.37:0/231690434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c004810 0x7f8c2c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f8c4dc00640 1 --2- 172.21.15.37:0/231690434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c2c005240 0x7f8c2c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7f8c4d200640 1 --2- 172.21.15.37:0/231690434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c2c0039c0 0x7f8c2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7f8c4dc00640 1 -- 172.21.15.37:0/231690434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c004810 msgr2=0x7f8c2c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7f8c4dc00640 1 --2- 172.21.15.37:0/231690434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c004810 0x7f8c2c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7f8c4dc00640 1 -- 172.21.15.37:0/231690434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c2c0039c0 msgr2=0x7f8c2c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7f8c4dc00640 1 --2- 172.21.15.37:0/231690434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c2c0039c0 0x7f8c2c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7f8c4dc00640 1 -- 172.21.15.37:0/231690434 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c480d3070 con 0x7f8c2c005240 2024-05-30T06:42:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fea2d200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fea28163250 0x7fea281636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fea25e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fea28162e70 0x7fea280cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47246/0 (socket says 172.21.15.37:47246) 2024-05-30T06:42:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fea25e00640 1 -- 172.21.15.37:0/891333282 learned_addr learned my addr 172.21.15.37:0/891333282 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:17.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fea25400640 1 --2- 172.21.15.37:0/891333282 >> v2:172.21.15.37:3300/0 conn(0x7fea28163250 0x7fea281636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f4cef400640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cd8068380 0x7f4cd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.719+0000 7f4cef400640 1 -- 172.21.15.37:0/1104943011 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4ce8123820 con 0x7f4cf80aaa10 2024-05-30T06:42:17.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7f4cf7400640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cd8068380 0x7f4cd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fe686a00640 1 --2- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe668068380 0x7fe66806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fea2d200640 1 -- 172.21.15.37:0/891333282 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea280ccfc0 con 0x7fea280ce7d0 2024-05-30T06:42:17.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fea2d200640 1 -- 172.21.15.37:0/891333282 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea28164190 con 0x7fea28162e70 2024-05-30T06:42:17.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fea2d200640 1 -- 172.21.15.37:0/891333282 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fea2806f8e0 con 0x7fea28163250 2024-05-30T06:42:17.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fea24a00640 1 -- 172.21.15.37:0/891333282 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1934632381 0 0) 0x7fea280ccfc0 con 0x7fea280ce7d0 2024-05-30T06:42:17.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fea24a00640 1 -- 172.21.15.37:0/891333282 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea0c003530 con 0x7fea280ce7d0 2024-05-30T06:42:17.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7f4cf7400640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cd8068380 0x7f4cd806a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009fc0 tx=0x7f4cf000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fe686a00640 1 --2- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe668068380 0x7fe66806a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe674007a90 tx=0x7fe6740079e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fea25400640 1 -- 172.21.15.37:0/891333282 >> v1:172.21.15.105:6789/0 conn(0x7fea28162e70 legacy=0x7fea280cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fea25400640 1 -- 172.21.15.37:0/891333282 >> v1:172.21.15.37:6789/0 conn(0x7fea280ce7d0 legacy=0x7fea280cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7fea25400640 1 -- 172.21.15.37:0/891333282 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2806ecd0 con 0x7fea28163250 2024-05-30T06:42:17.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.723+0000 7f73fe800640 1 --2- 172.21.15.37:0/2636805394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74000b4df0 0x7f74000d2fd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009870 tx=0x7f73ec01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad5e410158854df5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7f8c4dc00640 1 -- 172.21.15.37:0/231690434 reap_dead start 2024-05-30T06:42:17.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fa652a00640 1 -- 172.21.15.37:0/483113470 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6400aa630 con 0x7fa65406e660 2024-05-30T06:42:17.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fa652a00640 1 -- 172.21.15.37:0/483113470 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6400aa7d0 con 0x7fa65406e660 2024-05-30T06:42:17.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fa652a00640 1 -- 172.21.15.37:0/483113470 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6400aaba0 con 0x7fa65406e660 2024-05-30T06:42:17.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7f4cef400640 1 -- 172.21.15.37:0/1104943011 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ce80c0030 con 0x7f4cf80aaa10 2024-05-30T06:42:17.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7f8c4dc00640 1 --2- 172.21.15.37:0/231690434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c2c005240 0x7f8c2c00b9d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8c30003db0 tx=0x7f8c3001c320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6113c5452dab00c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fa65b000640 1 -- 172.21.15.37:0/483113470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 msgr2=0x7fa65415e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fa65b000640 1 --2- 172.21.15.37:0/483113470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 0x7fa65415e390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa6400090e0 tx=0x7fa64001e620 comp rx=0 tx=0).stop 2024-05-30T06:42:17.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fa65b000640 1 -- 172.21.15.37:0/483113470 shutdown_connections 2024-05-30T06:42:17.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fa65b000640 1 --2- 172.21.15.37:0/483113470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 0x7fa65415e390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fa65b000640 1 --2- 172.21.15.37:0/483113470 >> v2:172.21.15.37:3300/0 conn(0x7fa65406f2e0 0x7fa6540cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fa65b000640 1 -- 172.21.15.37:0/483113470 >> 172.21.15.37:0/483113470 conn(0x7fa6540b23c0 msgr2=0x7fa6540b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fa65b000640 1 -- 172.21.15.37:0/483113470 shutdown_connections 2024-05-30T06:42:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fa65b000640 1 -- 172.21.15.37:0/483113470 wait complete. 2024-05-30T06:42:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fa65b000640 1 Processor -- start 2024-05-30T06:42:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fa65b000640 1 -- start start 2024-05-30T06:42:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7fe67f400640 1 -- 172.21.15.37:0/3208545368 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe68815bf50 con 0x7fe68806e660 2024-05-30T06:42:17.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c300039b0 con 0x7f8c2c005240 2024-05-30T06:42:17.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c300ab660 con 0x7f8c2c005240 2024-05-30T06:42:17.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.727+0000 7f8c47400640 1 -- 172.21.15.37:0/231690434 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c300aba50 con 0x7f8c2c005240 2024-05-30T06:42:17.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa65b000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 0x7fa6540a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fea25400640 1 --2- 172.21.15.37:0/891333282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea28163250 0x7fea281636d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea180097c0 tx=0x7fea1801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65143f8b946070c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7f73fca00640 1 -- 172.21.15.37:0/2636805394 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec0b0070 con 0x7f74000b4df0 2024-05-30T06:42:17.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa65b000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa65406f2e0 0x7fa65415d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa65b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6540cf420 0x7fa6541446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa65b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa6541676a0 con 0x7fa6540cf420 2024-05-30T06:42:17.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa65b000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa654167520 con 0x7fa65406f2e0 2024-05-30T06:42:17.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa65b000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa654167820 con 0x7fa65406e660 2024-05-30T06:42:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7f73fca00640 1 -- 172.21.15.37:0/2636805394 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73ec0ab600 con 0x7f74000b4df0 2024-05-30T06:42:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7f73fca00640 1 -- 172.21.15.37:0/2636805394 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec0ab9d0 con 0x7f74000b4df0 2024-05-30T06:42:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7f8c4fc00640 1 -- 172.21.15.37:0/231690434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c2c005240 msgr2=0x7f8c2c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7f8c4fc00640 1 --2- 172.21.15.37:0/231690434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c2c005240 0x7f8c2c00b9d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8c30003db0 tx=0x7f8c3001c320 comp rx=0 tx=0).stop 2024-05-30T06:42:17.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa653e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 0x7fa6540a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa653e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 0x7fa6540a94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:45064/0 (socket says 172.21.15.37:45064) 2024-05-30T06:42:17.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa653e00640 1 -- 172.21.15.37:0/1336762586 learned_addr learned my addr 172.21.15.37:0/1336762586 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa659000640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6540cf420 0x7fa6541446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fea24a00640 1 -- 172.21.15.37:0/891333282 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea180b1070 con 0x7fea28163250 2024-05-30T06:42:17.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa653400640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa65406f2e0 0x7fa65415d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7f73ff200640 1 -- 172.21.15.37:0/2636805394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74000b4df0 msgr2=0x7f74000d2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7f73ff200640 1 --2- 172.21.15.37:0/2636805394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74000b4df0 0x7f74000d2fd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009870 tx=0x7f73ec01c4b0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7f73ff200640 1 -- 172.21.15.37:0/2636805394 shutdown_connections 2024-05-30T06:42:17.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7f73ff200640 1 --2- 172.21.15.37:0/2636805394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74000b4df0 0x7f74000d2fd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7f73ff200640 1 --2- 172.21.15.37:0/2636805394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f740015ea40 0x7f74000d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7f73ff200640 1 -- 172.21.15.37:0/2636805394 >> 172.21.15.37:0/2636805394 conn(0x7f740008bff0 msgr2=0x7f74000d46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7f73ff200640 1 -- 172.21.15.37:0/2636805394 shutdown_connections 2024-05-30T06:42:17.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7f73ff200640 1 -- 172.21.15.37:0/2636805394 wait complete. 2024-05-30T06:42:17.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7efccb200640 1 Processor -- start 2024-05-30T06:42:17.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fea24a00640 1 -- 172.21.15.37:0/891333282 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea180a8050 con 0x7fea28163250 2024-05-30T06:42:17.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fea24a00640 1 -- 172.21.15.37:0/891333282 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea280cfb00 con 0x7fea28163250 2024-05-30T06:42:17.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa653e00640 1 -- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa65406f2e0 msgr2=0x7fa65415d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa653e00640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa65406f2e0 0x7fa65415d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa653e00640 1 -- 172.21.15.37:0/1336762586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6540cf420 msgr2=0x7fa6541446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa653e00640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6540cf420 0x7fa6541446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa653e00640 1 -- 172.21.15.37:0/1336762586 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa654148a00 con 0x7fa65406e660 2024-05-30T06:42:17.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa653e00640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 0x7fa6540a94c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa64400ec10 tx=0x7fa64400c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa653400640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa65406f2e0 0x7fa65415d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:17.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa64be00640 1 -- 172.21.15.37:0/1336762586 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa644017070 con 0x7fa65406e660 2024-05-30T06:42:17.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa64be00640 1 -- 172.21.15.37:0/1336762586 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa64400cc30 con 0x7fa65406e660 2024-05-30T06:42:17.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa64be00640 1 -- 172.21.15.37:0/1336762586 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa644013470 con 0x7fa65406e660 2024-05-30T06:42:17.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fea2d200640 1 -- 172.21.15.37:0/891333282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea28163250 msgr2=0x7fea281636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fea2d200640 1 --2- 172.21.15.37:0/891333282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea28163250 0x7fea281636d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea180097c0 tx=0x7fea1801c3e0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa65b000640 1 -- 172.21.15.37:0/1336762586 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa654159d00 con 0x7fa65406e660 2024-05-30T06:42:17.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa65b000640 1 -- 172.21.15.37:0/1336762586 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa65415a2c0 con 0x7fa65406e660 2024-05-30T06:42:17.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fea2d200640 1 -- 172.21.15.37:0/891333282 shutdown_connections 2024-05-30T06:42:17.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fea2d200640 1 --2- 172.21.15.37:0/891333282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea28163250 0x7fea281636d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fea2d200640 1 -- 172.21.15.37:0/891333282 >> 172.21.15.37:0/891333282 conn(0x7fea2806bf60 msgr2=0x7fea280b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fea2d200640 1 -- 172.21.15.37:0/891333282 shutdown_connections 2024-05-30T06:42:17.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fa65b000640 1 -- 172.21.15.37:0/1336762586 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa654068bc0 con 0x7fa65406e660 2024-05-30T06:42:17.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7fea2d200640 1 -- 172.21.15.37:0/891333282 wait complete. 2024-05-30T06:42:17.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7f73ff200640 1 Processor -- start 2024-05-30T06:42:17.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7fea2d200640 1 Processor -- start 2024-05-30T06:42:17.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7f73ff200640 1 -- start start 2024-05-30T06:42:17.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7fea2d200640 1 -- start start 2024-05-30T06:42:17.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.731+0000 7efccb200640 1 -- start start 2024-05-30T06:42:17.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7efccb200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc4054b60 0x7efcc4055360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7efccb200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efcc40558a0 0x7efcc40366b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7efccb200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc40e5aa0 con 0x7efcc40e1320 2024-05-30T06:42:17.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7efccb200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efcc4051c30 con 0x7efcc40558a0 2024-05-30T06:42:17.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7efccb200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efcc4051f10 con 0x7efcc4054b60 2024-05-30T06:42:17.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7fa64be00640 1 -- 172.21.15.37:0/1336762586 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa64401a070 con 0x7fa65406e660 2024-05-30T06:42:17.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7efcc9e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7efcc40e1320 0x7efcc4052710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47260/0 (socket says 172.21.15.37:47260) 2024-05-30T06:42:17.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7efcc9e00640 1 -- 172.21.15.37:0/1449535207 learned_addr learned my addr 172.21.15.37:0/1449535207 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:17.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7efcc9400640 1 --2- 172.21.15.37:0/1449535207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc4054b60 0x7efcc4055360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7efcca800640 1 --2- 172.21.15.37:0/1449535207 >> v2:172.21.15.37:3300/0 conn(0x7efcc40558a0 0x7efcc40366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7f8c4fc00640 1 -- 172.21.15.37:0/231690434 shutdown_connections 2024-05-30T06:42:17.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7f8c4fc00640 1 --2- 172.21.15.37:0/231690434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c2c005240 0x7f8c2c00b9d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7f8c4fc00640 1 -- 172.21.15.37:0/231690434 >> 172.21.15.37:0/231690434 conn(0x7f8c4806cbd0 msgr2=0x7f8c4806cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7fea2d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea280ce7d0 0x7fea2815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7fea2d200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea28162e70 0x7fea282042a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7fea2d200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea28163250 0x7fea28158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7fa64be00640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa6340683b0 0x7fa63406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7fa64be00640 1 -- 172.21.15.37:0/1336762586 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa644086cb0 con 0x7fa65406e660 2024-05-30T06:42:17.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fa653400640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa6340683b0 0x7fa63406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fa653400640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa6340683b0 0x7fa63406a870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa64c007fd0 tx=0x7fa64c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7f73ff200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74000b4df0 0x7f74000ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7f73ff200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74000b5ce0 0x7f7400204d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7f73ff200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74000715a0 0x7f740006f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7f73ff200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74000b3930 con 0x7f74000715a0 2024-05-30T06:42:17.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7f73ff200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74000b37b0 con 0x7f74000b5ce0 2024-05-30T06:42:17.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7f73ff200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f740016b3f0 con 0x7f74000b4df0 2024-05-30T06:42:17.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73fde00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74000b4df0 0x7f74000ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73fde00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74000b4df0 0x7f74000ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:45086/0 (socket says 172.21.15.37:45086) 2024-05-30T06:42:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73fde00640 1 -- 172.21.15.37:0/1547255581 learned_addr learned my addr 172.21.15.37:0/1547255581 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73fd400640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74000b5ce0 0x7f7400204d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73fe800640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74000715a0 0x7f740006f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73fd400640 1 -- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74000b4df0 msgr2=0x7f74000ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73fd400640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74000b4df0 0x7f74000ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73fd400640 1 -- 172.21.15.37:0/1547255581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74000715a0 msgr2=0x7f740006f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73fd400640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74000715a0 0x7f740006f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73fd400640 1 -- 172.21.15.37:0/1547255581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74002052a0 con 0x7f74000b5ce0 2024-05-30T06:42:17.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73fd400640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74000b5ce0 0x7f7400204d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f73f000b440 tx=0x7f73f000b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73f6000640 1 -- 172.21.15.37:0/1547255581 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0011830 con 0x7f74000b5ce0 2024-05-30T06:42:17.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7efcca800640 1 -- 172.21.15.37:0/1449535207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc4054b60 msgr2=0x7efcc4055360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:17.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7efcca800640 1 --2- 172.21.15.37:0/1449535207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc4054b60 0x7efcc4055360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7efcca800640 1 -- 172.21.15.37:0/1449535207 >> v1:172.21.15.105:6789/0 conn(0x7efcc40e1320 legacy=0x7efcc4052710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7efcca800640 1 -- 172.21.15.37:0/1449535207 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc40521f0 con 0x7efcc40558a0 2024-05-30T06:42:17.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7efcc9400640 1 --2- 172.21.15.37:0/1449535207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc4054b60 0x7efcc4055360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:17.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7efcc8a00640 1 -- 172.21.15.37:0/1449535207 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1936710068 0 0) 0x7efcc40e5aa0 con 0x7efcc40e1320 2024-05-30T06:42:17.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7fea2d200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea2806e960 con 0x7fea280ce7d0 2024-05-30T06:42:17.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7fea2d200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fea28163c10 con 0x7fea28163250 2024-05-30T06:42:17.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7fea2d200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fea28170c50 con 0x7fea28162e70 2024-05-30T06:42:17.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea25e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea280ce7d0 0x7fea2815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea25e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea280ce7d0 0x7fea2815ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33932/0 (socket says 172.21.15.37:33932) 2024-05-30T06:42:17.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea25e00640 1 -- 172.21.15.37:0/895732335 learned_addr learned my addr 172.21.15.37:0/895732335 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea26800640 1 --2- 172.21.15.37:0/895732335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea28163250 0x7fea28158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea25e00640 1 -- 172.21.15.37:0/895732335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea28162e70 msgr2=0x7fea282042a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:42:17.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea25e00640 1 --2- 172.21.15.37:0/895732335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea28162e70 0x7fea282042a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea25e00640 1 -- 172.21.15.37:0/895732335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea28163250 msgr2=0x7fea28158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea25e00640 1 --2- 172.21.15.37:0/895732335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea28163250 0x7fea28158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea25e00640 1 -- 172.21.15.37:0/895732335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea28154d90 con 0x7fea280ce7d0 2024-05-30T06:42:17.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7f8c4fc00640 1 -- 172.21.15.37:0/231690434 shutdown_connections 2024-05-30T06:42:17.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.735+0000 7f8c4fc00640 1 -- 172.21.15.37:0/231690434 wait complete. 2024-05-30T06:42:17.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f8c4fc00640 1 Processor -- start 2024-05-30T06:42:17.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73f6000640 1 -- 172.21.15.37:0/1547255581 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f0016070 con 0x7f74000b5ce0 2024-05-30T06:42:17.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f73f6000640 1 -- 172.21.15.37:0/1547255581 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0011c10 con 0x7f74000b5ce0 2024-05-30T06:42:17.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7f8c4fc00640 1 -- start start 2024-05-30T06:42:17.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea25e00640 1 --2- 172.21.15.37:0/895732335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea280ce7d0 0x7fea2815ebc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fea1400c530 tx=0x7fea1400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea1e000640 1 -- 172.21.15.37:0/895732335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14017070 con 0x7fea280ce7d0 2024-05-30T06:42:17.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea2d200640 1 -- 172.21.15.37:0/895732335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea2815f100 con 0x7fea280ce7d0 2024-05-30T06:42:17.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f73ff200640 1 -- 172.21.15.37:0/1547255581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7400071b60 con 0x7f74000b5ce0 2024-05-30T06:42:17.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea2d200640 1 -- 172.21.15.37:0/895732335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea281555c0 con 0x7fea280ce7d0 2024-05-30T06:42:17.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea1e000640 1 -- 172.21.15.37:0/895732335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea14005cf0 con 0x7fea280ce7d0 2024-05-30T06:42:17.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.739+0000 7fea1e000640 1 -- 172.21.15.37:0/895732335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14017070 con 0x7fea280ce7d0 2024-05-30T06:42:17.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f73ff200640 1 -- 172.21.15.37:0/1547255581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7400072120 con 0x7f74000b5ce0 2024-05-30T06:42:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7efcca800640 1 --2- 172.21.15.37:0/1449535207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc40558a0 0x7efcc40366b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efccc06b440 tx=0x7efccc0980b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bf72139eb99e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4fc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c005240 0x7f8c48152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7fea2d200640 1 -- 172.21.15.37:0/895732335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea000052a0 con 0x7fea280ce7d0 2024-05-30T06:42:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4fc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c480cb920 0x7f8c481526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7fa64be00640 1 -- 172.21.15.37:0/1336762586 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa654148a00 con 0x7fa65406e660 2024-05-30T06:42:17.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4d200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c005240 0x7f8c48152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4d200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c005240 0x7f8c48152f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:45102/0 (socket says 172.21.15.37:45102) 2024-05-30T06:42:17.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4d200640 1 -- 172.21.15.37:0/497419893 learned_addr learned my addr 172.21.15.37:0/497419893 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4fc00640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c48160e90 0x7f8c48161310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c47e00640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c480cb920 0x7f8c481526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4fc00640 1 -- 172.21.15.37:0/497419893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480d3cd0 con 0x7f8c480cb920 2024-05-30T06:42:17.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4fc00640 1 -- 172.21.15.37:0/497419893 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480d3b50 con 0x7f8c48160e90 2024-05-30T06:42:17.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4fc00640 1 -- 172.21.15.37:0/497419893 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8c480d3e50 con 0x7f8c2c005240 2024-05-30T06:42:17.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4dc00640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c48160e90 0x7f8c48161310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f73ff200640 1 -- 172.21.15.37:0/1547255581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74000ba510 con 0x7f74000b5ce0 2024-05-30T06:42:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4dc00640 1 -- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c005240 msgr2=0x7f8c48152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4dc00640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c005240 0x7f8c48152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4dc00640 1 -- 172.21.15.37:0/497419893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c480cb920 msgr2=0x7f8c481526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4dc00640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c480cb920 0x7f8c481526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4dc00640 1 -- 172.21.15.37:0/497419893 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c48154660 con 0x7f8c48160e90 2024-05-30T06:42:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c4dc00640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c48160e90 0x7f8c48161310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8c480d4400 tx=0x7f8c2c005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7f8c44c00640 1 -- 172.21.15.37:0/497419893 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c300ba070 con 0x7f8c48160e90 2024-05-30T06:42:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.747+0000 7f8c4fc00640 1 -- 172.21.15.37:0/497419893 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c48154940 con 0x7f8c48160e90 2024-05-30T06:42:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.747+0000 7f8c4fc00640 1 -- 172.21.15.37:0/497419893 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c48154f00 con 0x7f8c48160e90 2024-05-30T06:42:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.747+0000 7f8c44c00640 1 -- 172.21.15.37:0/497419893 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c30003990 con 0x7f8c48160e90 2024-05-30T06:42:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.747+0000 7f8c44c00640 1 -- 172.21.15.37:0/497419893 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c30006a00 con 0x7f8c48160e90 2024-05-30T06:42:17.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.743+0000 7fea1e000640 1 -- 172.21.15.37:0/895732335 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fea1401a070 con 0x7fea280ce7d0 2024-05-30T06:42:17.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.747+0000 7fea1e000640 1 --2- 172.21.15.37:0/895732335 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fea08068580 0x7fea0806aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.747+0000 7f73f6000640 1 -- 172.21.15.37:0/1547255581 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f73f001b460 con 0x7f74000b5ce0 2024-05-30T06:42:17.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.747+0000 7f73f6000640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f73e00683d0 0x7f73e006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.747+0000 7fea25400640 1 --2- 172.21.15.37:0/895732335 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fea08068580 0x7fea0806aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.747+0000 7fea1e000640 1 -- 172.21.15.37:0/895732335 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fea14007700 con 0x7fea280ce7d0 2024-05-30T06:42:17.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.747+0000 7f73f6000640 1 -- 172.21.15.37:0/1547255581 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f73f00542a0 con 0x7f74000b5ce0 2024-05-30T06:42:17.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.747+0000 7fea25400640 1 --2- 172.21.15.37:0/895732335 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fea08068580 0x7fea0806aa40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fea180ae000 tx=0x7fea180a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.751+0000 7f8c4fc00640 1 -- 172.21.15.37:0/497419893 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c200052a0 con 0x7f8c48160e90 2024-05-30T06:42:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.751+0000 7f73fde00640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f73e00683d0 0x7f73e006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.751+0000 7efcc8a00640 1 -- 172.21.15.37:0/1449535207 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc12d070 con 0x7efcc40558a0 2024-05-30T06:42:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.751+0000 7f8c44c00640 1 -- 172.21.15.37:0/497419893 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8c300bd070 con 0x7f8c48160e90 2024-05-30T06:42:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.751+0000 7f73fde00640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f73e00683d0 0x7f73e006a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7400073020 tx=0x7f73f80098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.751+0000 7f8c44c00640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8c240683b0 0x7f8c2406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.751+0000 7f8c44c00640 1 -- 172.21.15.37:0/497419893 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8c3011fce0 con 0x7f8c48160e90 2024-05-30T06:42:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.751+0000 7f8c4d200640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8c240683b0 0x7f8c2406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.751+0000 7f8c4d200640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8c240683b0 0x7f8c2406a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8c40001340 tx=0x7f8c40006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.755+0000 7efcc8a00640 1 -- 172.21.15.37:0/1449535207 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efccc120d50 con 0x7efcc40558a0 2024-05-30T06:42:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.755+0000 7fea1e000640 1 -- 172.21.15.37:0/895732335 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fea14055c90 con 0x7fea280ce7d0 2024-05-30T06:42:17.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.755+0000 7f73f6000640 1 -- 172.21.15.37:0/1547255581 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f73f0020020 con 0x7f74000b5ce0 2024-05-30T06:42:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.755+0000 7efcc8a00640 1 -- 172.21.15.37:0/1449535207 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc128640 con 0x7efcc40558a0 2024-05-30T06:42:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.755+0000 7efccb200640 1 -- 172.21.15.37:0/1449535207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc40558a0 msgr2=0x7efcc40366b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.755+0000 7efccb200640 1 --2- 172.21.15.37:0/1449535207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc40558a0 0x7efcc40366b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efccc06b440 tx=0x7efccc0980b0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.755+0000 7efccb200640 1 -- 172.21.15.37:0/1449535207 shutdown_connections 2024-05-30T06:42:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.755+0000 7efccb200640 1 --2- 172.21.15.37:0/1449535207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc40558a0 0x7efcc40366b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.755+0000 7efccb200640 1 --2- 172.21.15.37:0/1449535207 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc4054b60 0x7efcc4055360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.755+0000 7efccb200640 1 -- 172.21.15.37:0/1449535207 >> 172.21.15.37:0/1449535207 conn(0x7efcc4020050 msgr2=0x7efcc4056d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.755+0000 7efccb200640 1 -- 172.21.15.37:0/1449535207 shutdown_connections 2024-05-30T06:42:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.755+0000 7efccb200640 1 -- 172.21.15.37:0/1449535207 wait complete. 2024-05-30T06:42:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.759+0000 7efccb200640 1 Processor -- start 2024-05-30T06:42:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.759+0000 7efccb200640 1 -- start start 2024-05-30T06:42:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.759+0000 7f8c44c00640 1 -- 172.21.15.37:0/497419893 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8c30016030 con 0x7f8c48160e90 2024-05-30T06:42:17.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.759+0000 7efccb200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc4054b60 0x7efcc40db450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.759+0000 7efccb200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc40558a0 0x7efcc40e40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.759+0000 7efccb200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc40e1320 0x7efcc404d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.759+0000 7efccb200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efcc40ee010 con 0x7efcc4054b60 2024-05-30T06:42:17.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.759+0000 7efccb200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efcc4035fb0 con 0x7efcc40e1320 2024-05-30T06:42:17.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.759+0000 7efccb200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efcc40ee190 con 0x7efcc40558a0 2024-05-30T06:42:17.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcca800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc40e1320 0x7efcc404d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcc9400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc40558a0 0x7efcc40e40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcc9400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc40558a0 0x7efcc40e40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:45116/0 (socket says 172.21.15.37:45116) 2024-05-30T06:42:17.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcca800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc40e1320 0x7efcc404d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59198/0 (socket says 172.21.15.37:59198) 2024-05-30T06:42:17.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcca800640 1 -- 172.21.15.37:0/682537490 learned_addr learned my addr 172.21.15.37:0/682537490 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcca800640 1 -- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc40558a0 msgr2=0x7efcc40e40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcca800640 1 --2- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc40558a0 0x7efcc40e40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcca800640 1 -- 172.21.15.37:0/682537490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc4054b60 msgr2=0x7efcc40db450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcca800640 1 --2- 172.21.15.37:0/682537490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc4054b60 0x7efcc40db450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcca800640 1 -- 172.21.15.37:0/682537490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc40da3b0 con 0x7efcc40e1320 2024-05-30T06:42:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcc9400640 1 --2- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc40558a0 0x7efcc40e40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcca800640 1 --2- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc40e1320 0x7efcc404d360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efccc074870 tx=0x7efccc096940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcc2000640 1 -- 172.21.15.37:0/682537490 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc137070 con 0x7efcc40e1320 2024-05-30T06:42:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcc2000640 1 -- 172.21.15.37:0/682537490 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efccc128d90 con 0x7efcc40e1320 2024-05-30T06:42:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.763+0000 7efcc2000640 1 -- 172.21.15.37:0/682537490 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efccc12d040 con 0x7efcc40e1320 2024-05-30T06:42:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.767+0000 7efccb200640 1 -- 172.21.15.37:0/682537490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc40da690 con 0x7efcc40e1320 2024-05-30T06:42:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.767+0000 7efccb200640 1 -- 172.21.15.37:0/682537490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc40dac50 con 0x7efcc40e1320 2024-05-30T06:42:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.767+0000 7efccb200640 1 -- 172.21.15.37:0/682537490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc40057f0 con 0x7efcc40e1320 2024-05-30T06:42:17.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.771+0000 7efcc2000640 1 -- 172.21.15.37:0/682537490 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efccc131640 con 0x7efcc40e1320 2024-05-30T06:42:17.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.771+0000 7efcc2000640 1 --2- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efcac068400 0x7efcac06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:17.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.771+0000 7efcc2000640 1 -- 172.21.15.37:0/682537490 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7efccc120cf0 con 0x7efcc40e1320 2024-05-30T06:42:17.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.771+0000 7efcc9e00640 1 --2- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efcac068400 0x7efcac06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:17.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.775+0000 7efcc9e00640 1 --2- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efcac068400 0x7efcac06a8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efcbc000c10 tx=0x7efcbc0079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:17.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:17.779+0000 7efcc2000640 1 -- 172.21.15.37:0/682537490 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efccc091e70 con 0x7efcc40e1320 2024-05-30T06:42:18.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.059+0000 7fefc3400640 1 -- 172.21.15.37:0/120521360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fefd806f210 con 0x7fefd8071e30 2024-05-30T06:42:18.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.059+0000 7fefce000640 1 -- 172.21.15.37:0/120521360 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fefd00f1320 con 0x7fefd8071e30 2024-05-30T06:42:18.062 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-05-30T06:42:18.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.063+0000 7fefdd200640 1 -- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fefb8068450 msgr2=0x7fefb806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.063+0000 7fefdd200640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fefb8068450 0x7fefb806a910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fefc8007fd0 tx=0x7fefc8009040 comp rx=0 tx=0).stop 2024-05-30T06:42:18.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.063+0000 7fefdd200640 1 -- 172.21.15.37:0/120521360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd8071e30 msgr2=0x7fefd80af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.063+0000 7fefdd200640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd8071e30 0x7fefd80af050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fefd00b1040 tx=0x7fefd001b930 comp rx=0 tx=0).stop 2024-05-30T06:42:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.063+0000 7fefdd200640 1 -- 172.21.15.37:0/120521360 shutdown_connections 2024-05-30T06:42:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.063+0000 7fefdd200640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefd8150c90 0x7fefd81f7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.063+0000 7fefdd200640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fefb8068450 0x7fefb806a910 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.063+0000 7fefdd200640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fefd80afcc0 0x7fefd81503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.063+0000 7fefdd200640 1 --2- 172.21.15.37:0/120521360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd8071e30 0x7fefd80af050 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fefd00b1040 tx=0x7fefd001b930 comp rx=0 tx=0).stop 2024-05-30T06:42:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.063+0000 7fefdd200640 1 -- 172.21.15.37:0/120521360 >> 172.21.15.37:0/120521360 conn(0x7fefd8067b60 msgr2=0x7fefd80cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.067+0000 7fefdd200640 1 -- 172.21.15.37:0/120521360 shutdown_connections 2024-05-30T06:42:18.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.067+0000 7fefdd200640 1 -- 172.21.15.37:0/120521360 wait complete. 2024-05-30T06:42:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.083+0000 7fe67cc00640 1 -- 172.21.15.37:0/3208545368 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe660005860 con 0x7fe68806e660 2024-05-30T06:42:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.083+0000 7fe67f400640 1 -- 172.21.15.37:0/3208545368 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe680056500 con 0x7fe68806e660 2024-05-30T06:42:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.083+0000 7f4cfcc00640 1 -- 172.21.15.37:0/1104943011 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4cf814dec0 con 0x7f4cf80aaa10 2024-05-30T06:42:18.083 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-05-30T06:42:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7f4cef400640 1 -- 172.21.15.37:0/1104943011 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4ce8019200 con 0x7f4cf80aaa10 2024-05-30T06:42:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fa65b000640 1 -- 172.21.15.37:0/1336762586 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa654145b20 con 0x7fa65406e660 2024-05-30T06:42:18.087 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-05-30T06:42:18.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fe67cc00640 1 -- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe668068380 msgr2=0x7fe66806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fe67cc00640 1 --2- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe668068380 0x7fe66806a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe674007a90 tx=0x7fe6740079e0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fe67cc00640 1 -- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe68806e660 msgr2=0x7fe688150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fe67cc00640 1 --2- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe68806e660 0x7fe688150de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe68000c790 tx=0x7fe68000cc50 comp rx=0 tx=0).stop 2024-05-30T06:42:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fe67cc00640 1 -- 172.21.15.37:0/3208545368 shutdown_connections 2024-05-30T06:42:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fe67cc00640 1 --2- 172.21.15.37:0/3208545368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6880cfff0 0x7fe68814d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fe67cc00640 1 --2- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe68806f2e0 0x7fe68815ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fe67cc00640 1 --2- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe668068380 0x7fe66806a840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fe67cc00640 1 --2- 172.21.15.37:0/3208545368 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe68806e660 0x7fe688150de0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fe67cc00640 1 -- 172.21.15.37:0/3208545368 >> 172.21.15.37:0/3208545368 conn(0x7fe6880b23c0 msgr2=0x7fe6880b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fe67cc00640 1 -- 172.21.15.37:0/3208545368 shutdown_connections 2024-05-30T06:42:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fe67cc00640 1 -- 172.21.15.37:0/3208545368 wait complete. 2024-05-30T06:42:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.087+0000 7fa64be00640 1 -- 172.21.15.37:0/1336762586 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa644056b80 con 0x7fa65406e660 2024-05-30T06:42:18.089 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2024-05-30T06:42:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7f4cfcc00640 1 -- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cd8068380 msgr2=0x7f4cd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7f4cfcc00640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cd8068380 0x7f4cd806a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009fc0 tx=0x7f4cf000b040 comp rx=0 tx=0).stop 2024-05-30T06:42:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7f4cfcc00640 1 -- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf80aaa10 msgr2=0x7f4cf80a9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7f4cfcc00640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf80aaa10 0x7f4cf80a9a00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009000 tx=0x7f4cdc005840 comp rx=0 tx=0).stop 2024-05-30T06:42:18.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7fa65b000640 1 -- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa6340683b0 msgr2=0x7fa63406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7fa65b000640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa6340683b0 0x7fa63406a870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa64c007fd0 tx=0x7fa64c009040 comp rx=0 tx=0).stop 2024-05-30T06:42:18.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7fa65b000640 1 -- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 msgr2=0x7fa6540a94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7fa65b000640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 0x7fa6540a94c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa64400ec10 tx=0x7fa64400c520 comp rx=0 tx=0).stop 2024-05-30T06:42:18.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7fa65b000640 1 -- 172.21.15.37:0/1336762586 shutdown_connections 2024-05-30T06:42:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7fa65b000640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6540cf420 0x7fa6541446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7fa65b000640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa6340683b0 0x7fa63406a870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7fa65b000640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa65406f2e0 0x7fa65415d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7fa65b000640 1 --2- 172.21.15.37:0/1336762586 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa65406e660 0x7fa6540a94c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.091+0000 7fa65b000640 1 -- 172.21.15.37:0/1336762586 >> 172.21.15.37:0/1336762586 conn(0x7fa6540b23c0 msgr2=0x7fa654074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.095+0000 7f4cfcc00640 1 -- 172.21.15.37:0/1104943011 shutdown_connections 2024-05-30T06:42:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.095+0000 7f4cfcc00640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cf80aaa10 0x7f4cf80a9a00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.095+0000 7f4cfcc00640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cd8068380 0x7f4cd806a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.095+0000 7f4cfcc00640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cf814cda0 0x7f4cf80a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.095+0000 7f4cfcc00640 1 --2- 172.21.15.37:0/1104943011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cf8151190 0x7f4cf8201ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.095+0000 7f4cfcc00640 1 -- 172.21.15.37:0/1104943011 >> 172.21.15.37:0/1104943011 conn(0x7f4cf8067b60 msgr2=0x7f4cf8074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:18.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.095+0000 7fa65b000640 1 -- 172.21.15.37:0/1336762586 shutdown_connections 2024-05-30T06:42:18.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.095+0000 7fa65b000640 1 -- 172.21.15.37:0/1336762586 wait complete. 2024-05-30T06:42:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.095+0000 7f4cfcc00640 1 -- 172.21.15.37:0/1104943011 shutdown_connections 2024-05-30T06:42:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.095+0000 7f4cfcc00640 1 -- 172.21.15.37:0/1104943011 wait complete. 2024-05-30T06:42:18.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2024-05-30T06:42:18.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.099+0000 7fea2d200640 1 -- 172.21.15.37:0/895732335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fea00005860 con 0x7fea280ce7d0 2024-05-30T06:42:18.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.103+0000 7fea1e000640 1 -- 172.21.15.37:0/895732335 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea14059f90 con 0x7fea280ce7d0 2024-05-30T06:42:18.101 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2024-05-30T06:42:18.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.103+0000 7f73ff200640 1 -- 172.21.15.37:0/1547255581 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7400075560 con 0x7f74000b5ce0 2024-05-30T06:42:18.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.103+0000 7f73f6000640 1 -- 172.21.15.37:0/1547255581 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f74002052a0 con 0x7f74000b5ce0 2024-05-30T06:42:18.104 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2024-05-30T06:42:18.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.103+0000 7fea2d200640 1 -- 172.21.15.37:0/895732335 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fea08068580 msgr2=0x7fea0806aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.103+0000 7fea2d200640 1 --2- 172.21.15.37:0/895732335 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fea08068580 0x7fea0806aa40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fea180ae000 tx=0x7fea180a7000 comp rx=0 tx=0).stop 2024-05-30T06:42:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.103+0000 7fea2d200640 1 -- 172.21.15.37:0/895732335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea280ce7d0 msgr2=0x7fea2815ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.103+0000 7fea2d200640 1 --2- 172.21.15.37:0/895732335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea280ce7d0 0x7fea2815ebc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fea1400c530 tx=0x7fea1400c9f0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.103+0000 7fea2d200640 1 -- 172.21.15.37:0/895732335 shutdown_connections 2024-05-30T06:42:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.107+0000 7fea2d200640 1 --2- 172.21.15.37:0/895732335 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fea08068580 0x7fea0806aa40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.107+0000 7fea2d200640 1 --2- 172.21.15.37:0/895732335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea28163250 0x7fea28158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.107+0000 7fea2d200640 1 --2- 172.21.15.37:0/895732335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea28162e70 0x7fea282042a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.107+0000 7fea2d200640 1 --2- 172.21.15.37:0/895732335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea280ce7d0 0x7fea2815ebc0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fea1400c530 tx=0x7fea1400c9f0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.107+0000 7fea2d200640 1 -- 172.21.15.37:0/895732335 >> 172.21.15.37:0/895732335 conn(0x7fea2806bf60 msgr2=0x7fea280b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:18.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.107+0000 7fea2d200640 1 -- 172.21.15.37:0/895732335 shutdown_connections 2024-05-30T06:42:18.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.107+0000 7fea2d200640 1 -- 172.21.15.37:0/895732335 wait complete. 2024-05-30T06:42:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.107+0000 7f73ff200640 1 -- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f73e00683d0 msgr2=0x7f73e006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.107+0000 7f73ff200640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f73e00683d0 0x7f73e006a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7400073020 tx=0x7f73f80098d0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.107+0000 7f73ff200640 1 -- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74000b5ce0 msgr2=0x7f7400204d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.107+0000 7f73ff200640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74000b5ce0 0x7f7400204d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f73f000b440 tx=0x7f73f000b900 comp rx=0 tx=0).stop 2024-05-30T06:42:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.111+0000 7f73ff200640 1 -- 172.21.15.37:0/1547255581 shutdown_connections 2024-05-30T06:42:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.111+0000 7f73ff200640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74000715a0 0x7f740006f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.111+0000 7f73ff200640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f73e00683d0 0x7f73e006a890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.111+0000 7f73ff200640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74000b5ce0 0x7f7400204d60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.111+0000 7f73ff200640 1 --2- 172.21.15.37:0/1547255581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74000b4df0 0x7f74000ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.111+0000 7f73ff200640 1 -- 172.21.15.37:0/1547255581 >> 172.21.15.37:0/1547255581 conn(0x7f740008bff0 msgr2=0x7f74000cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.111+0000 7f8c4fc00640 1 -- 172.21.15.37:0/497419893 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8c20005590 con 0x7f8c48160e90 2024-05-30T06:42:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.115+0000 7f73ff200640 1 -- 172.21.15.37:0/1547255581 shutdown_connections 2024-05-30T06:42:18.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.115+0000 7f73ff200640 1 -- 172.21.15.37:0/1547255581 wait complete. 2024-05-30T06:42:18.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.115+0000 7f8c44c00640 1 -- 172.21.15.37:0/497419893 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8c300efbd0 con 0x7f8c48160e90 2024-05-30T06:42:18.114 INFO:teuthology.orchestra.run.smithi037.stdout:55834574852 2024-05-30T06:42:18.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.119+0000 7f8c4fc00640 1 -- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8c240683b0 msgr2=0x7f8c2406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.119+0000 7f8c4fc00640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8c240683b0 0x7f8c2406a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8c40001340 tx=0x7f8c40006040 comp rx=0 tx=0).stop 2024-05-30T06:42:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.119+0000 7f8c4fc00640 1 -- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c48160e90 msgr2=0x7f8c48161310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.119+0000 7f8c4fc00640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c48160e90 0x7f8c48161310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8c480d4400 tx=0x7f8c2c005840 comp rx=0 tx=0).stop 2024-05-30T06:42:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.119+0000 7f8c4fc00640 1 -- 172.21.15.37:0/497419893 shutdown_connections 2024-05-30T06:42:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.119+0000 7f8c4fc00640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8c240683b0 0x7f8c2406a870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.119+0000 7f8c4fc00640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c48160e90 0x7f8c48161310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.119+0000 7f8c4fc00640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c480cb920 0x7f8c481526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.119+0000 7f8c4fc00640 1 --2- 172.21.15.37:0/497419893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c2c005240 0x7f8c48152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.119+0000 7f8c4fc00640 1 -- 172.21.15.37:0/497419893 >> 172.21.15.37:0/497419893 conn(0x7f8c4806cbd0 msgr2=0x7f8c4815d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.119+0000 7f8c4fc00640 1 -- 172.21.15.37:0/497419893 shutdown_connections 2024-05-30T06:42:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.119+0000 7f8c4fc00640 1 -- 172.21.15.37:0/497419893 wait complete. 2024-05-30T06:42:18.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-05-30T06:42:18.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.127+0000 7efccb200640 1 -- 172.21.15.37:0/682537490 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7efcc40ebde0 con 0x7efcc40e1320 2024-05-30T06:42:18.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.127+0000 7efcc2000640 1 -- 172.21.15.37:0/682537490 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efccc16bca0 con 0x7efcc40e1320 2024-05-30T06:42:18.126 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-05-30T06:42:18.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-05-30T06:42:18.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.131+0000 7efccb200640 1 -- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efcac068400 msgr2=0x7efcac06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.131+0000 7efccb200640 1 --2- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efcac068400 0x7efcac06a8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efcbc000c10 tx=0x7efcbc0079d0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.131+0000 7efccb200640 1 -- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc40e1320 msgr2=0x7efcc404d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.131+0000 7efccb200640 1 --2- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc40e1320 0x7efcc404d360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efccc074870 tx=0x7efccc096940 comp rx=0 tx=0).stop 2024-05-30T06:42:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.131+0000 7efccb200640 1 -- 172.21.15.37:0/682537490 shutdown_connections 2024-05-30T06:42:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.131+0000 7efccb200640 1 --2- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efcac068400 0x7efcac06a8c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.131+0000 7efccb200640 1 --2- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc40e1320 0x7efcc404d360 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.131+0000 7efccb200640 1 --2- 172.21.15.37:0/682537490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc40558a0 0x7efcc40e40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.131+0000 7efccb200640 1 --2- 172.21.15.37:0/682537490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcc4054b60 0x7efcc40db450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.131+0000 7efccb200640 1 -- 172.21.15.37:0/682537490 >> 172.21.15.37:0/682537490 conn(0x7efcc4020050 msgr2=0x7efcc4035070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.131+0000 7efccb200640 1 -- 172.21.15.37:0/682537490 shutdown_connections 2024-05-30T06:42:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:18.131+0000 7efccb200640 1 -- 172.21.15.37:0/682537490 wait complete. 2024-05-30T06:42:18.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-05-30T06:42:18.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-05-30T06:42:18.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-05-30T06:42:18.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-05-30T06:42:18.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-05-30T06:42:19.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-30T06:42:19.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-30T06:42:19.128 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-30T06:42:19.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-30T06:42:19.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-30T06:42:19.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-30T06:42:19.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-30T06:42:19.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-30T06:42:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.311+0000 7f732e600640 1 Processor -- start 2024-05-30T06:42:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.311+0000 7f732e600640 1 -- start start 2024-05-30T06:42:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.311+0000 7f732e600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f732815a770 0x7f73280b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.311+0000 7f732e600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f73280b5510 0x7f7328071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.311+0000 7f732e600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f732815ab50 con 0x7f732806c070 2024-05-30T06:42:19.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.311+0000 7f732e600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f732806de40 con 0x7f73280b5510 2024-05-30T06:42:19.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.311+0000 7f732e600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f732806e090 con 0x7f732815a770 2024-05-30T06:42:19.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.315+0000 7f732d200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f732815a770 0x7f73280b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.315+0000 7f732d200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f732815a770 0x7f73280b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59212/0 (socket says 172.21.15.37:59212) 2024-05-30T06:42:19.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.315+0000 7f732d200640 1 -- 172.21.15.37:0/3014614030 learned_addr learned my addr 172.21.15.37:0/3014614030 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.315+0000 7f7327e00640 1 --2- 172.21.15.37:0/3014614030 >> v2:172.21.15.37:3300/0 conn(0x7f73280b5510 0x7f7328071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.315+0000 7f732d200640 1 -- 172.21.15.37:0/3014614030 >> v2:172.21.15.37:3300/0 conn(0x7f73280b5510 msgr2=0x7f7328071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:19.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.315+0000 7f732d200640 1 --2- 172.21.15.37:0/3014614030 >> v2:172.21.15.37:3300/0 conn(0x7f73280b5510 0x7f7328071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.315+0000 7f732d200640 1 -- 172.21.15.37:0/3014614030 >> v1:172.21.15.37:6789/0 conn(0x7f732806c070 legacy=0x7f732815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.315+0000 7f732d200640 1 -- 172.21.15.37:0/3014614030 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732806e370 con 0x7f732815a770 2024-05-30T06:42:19.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.315+0000 7f7327e00640 1 --2- 172.21.15.37:0/3014614030 >> v2:172.21.15.37:3300/0 conn(0x7f73280b5510 0x7f7328071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.319+0000 7f732d200640 1 --2- 172.21.15.37:0/3014614030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f732815a770 0x7f73280b4fd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f732806c620 tx=0x7f732001c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=678334588fb81d81 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.319+0000 7f7327400640 1 -- 172.21.15.37:0/3014614030 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73200a56c0 con 0x7f732815a770 2024-05-30T06:42:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.319+0000 7f7327400640 1 -- 172.21.15.37:0/3014614030 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73200a5860 con 0x7f732815a770 2024-05-30T06:42:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.319+0000 7f7327400640 1 -- 172.21.15.37:0/3014614030 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73200a5c30 con 0x7f732815a770 2024-05-30T06:42:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.323+0000 7f732e600640 1 -- 172.21.15.37:0/3014614030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f732815a770 msgr2=0x7f73280b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.323+0000 7f732e600640 1 --2- 172.21.15.37:0/3014614030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f732815a770 0x7f73280b4fd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f732806c620 tx=0x7f732001c9f0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.323+0000 7f732e600640 1 -- 172.21.15.37:0/3014614030 shutdown_connections 2024-05-30T06:42:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.323+0000 7f732e600640 1 --2- 172.21.15.37:0/3014614030 >> v2:172.21.15.37:3300/0 conn(0x7f73280b5510 0x7f7328071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.323+0000 7f732e600640 1 --2- 172.21.15.37:0/3014614030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f732815a770 0x7f73280b4fd0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f732806c620 tx=0x7f732001c9f0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.323+0000 7f732e600640 1 -- 172.21.15.37:0/3014614030 >> 172.21.15.37:0/3014614030 conn(0x7f7328067b60 msgr2=0x7f732806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.327+0000 7f732e600640 1 -- 172.21.15.37:0/3014614030 shutdown_connections 2024-05-30T06:42:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.327+0000 7f732e600640 1 -- 172.21.15.37:0/3014614030 wait complete. 2024-05-30T06:42:19.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.327+0000 7f732e600640 1 Processor -- start 2024-05-30T06:42:19.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.327+0000 7f732e600640 1 -- start start 2024-05-30T06:42:19.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.331+0000 7f732e600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f732806c070 0x7f7328143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.331+0000 7f732e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73280b5510 0x7f732814a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.331+0000 7f732e600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7328145040 0x7f73280b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.331+0000 7f732e600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f73280b3420 con 0x7f73280b5510 2024-05-30T06:42:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.331+0000 7f732dc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7328145040 0x7f73280b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.331+0000 7f732dc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7328145040 0x7f73280b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:45122/0 (socket says 172.21.15.37:45122) 2024-05-30T06:42:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.331+0000 7f732dc00640 1 -- 172.21.15.37:0/3212629689 learned_addr learned my addr 172.21.15.37:0/3212629689 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.331+0000 7f732e600640 1 -- 172.21.15.37:0/3212629689 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7328072750 con 0x7f732806c070 2024-05-30T06:42:19.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.331+0000 7f732e600640 1 -- 172.21.15.37:0/3212629689 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f73280b35a0 con 0x7f7328145040 2024-05-30T06:42:19.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.331+0000 7f7327e00640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73280b5510 0x7f732814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.331+0000 7f732dc00640 1 -- 172.21.15.37:0/3212629689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f732806c070 msgr2=0x7f7328143900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:42:19.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.331+0000 7f732dc00640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f732806c070 0x7f7328143900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.335+0000 7f732dc00640 1 -- 172.21.15.37:0/3212629689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73280b5510 msgr2=0x7f732814a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.335+0000 7f732dc00640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73280b5510 0x7f732814a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.335+0000 7f732dc00640 1 -- 172.21.15.37:0/3212629689 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732814a890 con 0x7f7328145040 2024-05-30T06:42:19.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.335+0000 7f7327e00640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73280b5510 0x7f732814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:19.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.335+0000 7f732dc00640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7328145040 0x7f73280b1480 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f731400c390 tx=0x7f731400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.335+0000 7f7324c00640 1 -- 172.21.15.37:0/3212629689 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73140052d0 con 0x7f7328145040 2024-05-30T06:42:19.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.335+0000 7f7324c00640 1 -- 172.21.15.37:0/3212629689 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7314005470 con 0x7f7328145040 2024-05-30T06:42:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.335+0000 7f732e600640 1 -- 172.21.15.37:0/3212629689 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7328143fa0 con 0x7f7328145040 2024-05-30T06:42:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.335+0000 7f7324c00640 1 -- 172.21.15.37:0/3212629689 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314007240 con 0x7f7328145040 2024-05-30T06:42:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.335+0000 7f732e600640 1 -- 172.21.15.37:0/3212629689 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7328144560 con 0x7f7328145040 2024-05-30T06:42:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.339+0000 7f7324c00640 1 -- 172.21.15.37:0/3212629689 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f73140073e0 con 0x7f7328145040 2024-05-30T06:42:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.343+0000 7f732e600640 1 -- 172.21.15.37:0/3212629689 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7328068ab0 con 0x7f7328145040 2024-05-30T06:42:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.343+0000 7f7324c00640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7308068480 0x7f730806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.343+0000 7f7324c00640 1 -- 172.21.15.37:0/3212629689 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7314085df0 con 0x7f7328145040 2024-05-30T06:42:19.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.343+0000 7f732d200640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7308068480 0x7f730806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.343+0000 7f732d200640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7308068480 0x7f730806a940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73200ae000 tx=0x7f73200a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.347+0000 7f7324c00640 1 -- 172.21.15.37:0/3212629689 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7314056390 con 0x7f7328145040 2024-05-30T06:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.399+0000 7fc515e00640 1 Processor -- start 2024-05-30T06:42:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.399+0000 7fc515e00640 1 -- start start 2024-05-30T06:42:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.399+0000 7fc515e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc5100c8400 0x7fc51009aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.399+0000 7fc515e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc51009afa0 0x7fc5100ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.403+0000 7fc50fe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc5100c8400 0x7fc51009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.403+0000 7fc50fe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc5100c8400 0x7fc51009aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59228/0 (socket says 172.21.15.37:59228) 2024-05-30T06:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.403+0000 7fc50fe00640 1 -- 172.21.15.37:0/2915935955 learned_addr learned my addr 172.21.15.37:0/2915935955 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.403+0000 7fc515e00640 1 -- 172.21.15.37:0/2915935955 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5100ce8f0 con 0x7fc5100ce510 2024-05-30T06:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.403+0000 7fc515e00640 1 -- 172.21.15.37:0/2915935955 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc51015ef80 con 0x7fc51009afa0 2024-05-30T06:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.403+0000 7fc515e00640 1 -- 172.21.15.37:0/2915935955 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc5100c8890 con 0x7fc5100c8400 2024-05-30T06:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.403+0000 7fc50fe00640 1 -- 172.21.15.37:0/2915935955 >> v2:172.21.15.37:3300/0 conn(0x7fc51009afa0 msgr2=0x7fc5100ccac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T06:42:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.403+0000 7fc515400640 1 --2- 172.21.15.37:0/2915935955 >> v2:172.21.15.37:3300/0 conn(0x7fc51009afa0 0x7fc5100ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.403+0000 7fc50fe00640 1 --2- 172.21.15.37:0/2915935955 >> v2:172.21.15.37:3300/0 conn(0x7fc51009afa0 0x7fc5100ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.403+0000 7fc50fe00640 1 -- 172.21.15.37:0/2915935955 >> v1:172.21.15.105:6789/0 conn(0x7fc5100ce510 legacy=0x7fc51006d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:19.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.403+0000 7fc50fe00640 1 -- 172.21.15.37:0/2915935955 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51006ea70 con 0x7fc5100c8400 2024-05-30T06:42:19.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7fc515400640 1 --2- 172.21.15.37:0/2915935955 >> v2:172.21.15.37:3300/0 conn(0x7fc51009afa0 0x7fc5100ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:19.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7f427de00640 1 Processor -- start 2024-05-30T06:42:19.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7f427de00640 1 -- start start 2024-05-30T06:42:19.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7fc50fe00640 1 --2- 172.21.15.37:0/2915935955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5100c8400 0x7fc51009aa60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc510068ed0 tx=0x7fc50001c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db9dc896b944b269 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7f427de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f427806c070 0x7f427815a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7f427de00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42780b4fd0 0x7f42780b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7fc50f400640 1 -- 172.21.15.37:0/2915935955 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000b1070 con 0x7fc5100c8400 2024-05-30T06:42:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7fc50f400640 1 -- 172.21.15.37:0/2915935955 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5000ac630 con 0x7fc5100c8400 2024-05-30T06:42:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7fc50f400640 1 -- 172.21.15.37:0/2915935955 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000a8050 con 0x7fc5100c8400 2024-05-30T06:42:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7f427de00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f427806e090 con 0x7f4278071e00 2024-05-30T06:42:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7f427de00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f42780b5970 con 0x7f42780b4fd0 2024-05-30T06:42:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7f427de00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f427806de40 con 0x7f427806c070 2024-05-30T06:42:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7f427d400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f4278071e00 0x7f4278072270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47288/0 (socket says 172.21.15.37:47288) 2024-05-30T06:42:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7f427d400640 1 -- 172.21.15.37:0/798053090 learned_addr learned my addr 172.21.15.37:0/798053090 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.407+0000 7f427ca00640 1 --2- 172.21.15.37:0/798053090 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f427806c070 0x7f427815a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074896281 0 0) 0x7f427806e090 con 0x7f4278071e00 2024-05-30T06:42:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f425c003530 con 0x7f4278071e00 2024-05-30T06:42:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277e00640 1 --2- 172.21.15.37:0/798053090 >> v2:172.21.15.37:3300/0 conn(0x7f42780b4fd0 0x7f42780b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3343877866 0 0) 0x7f425c003530 con 0x7f4278071e00 2024-05-30T06:42:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f427806c070 msgr2=0x7f427815a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 --2- 172.21.15.37:0/798053090 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f427806c070 0x7f427815a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 >> v2:172.21.15.37:3300/0 conn(0x7f42780b4fd0 msgr2=0x7f42780b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7fc515e00640 1 -- 172.21.15.37:0/2915935955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5100c8400 msgr2=0x7fc51009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7fc515e00640 1 --2- 172.21.15.37:0/2915935955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5100c8400 0x7fc51009aa60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc510068ed0 tx=0x7fc50001c500 comp rx=0 tx=0).stop 2024-05-30T06:42:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7fc515e00640 1 -- 172.21.15.37:0/2915935955 shutdown_connections 2024-05-30T06:42:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 --2- 172.21.15.37:0/798053090 >> v2:172.21.15.37:3300/0 conn(0x7f42780b4fd0 0x7f42780b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427806e370 con 0x7f4278071e00 2024-05-30T06:42:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f42680016a0 con 0x7f4278071e00 2024-05-30T06:42:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 >> v1:172.21.15.105:6789/0 conn(0x7f4278071e00 legacy=0x7f4278072270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 --2- 172.21.15.37:0/798053090 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f425c0039c0 0x7f425c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 --2- 172.21.15.37:0/798053090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f425c0043b0 0x7f425c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 --2- 172.21.15.37:0/798053090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f425c005090 0x7f425c0141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f427806de40 con 0x7f425c0043b0 2024-05-30T06:42:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f425c0147b0 con 0x7f425c005090 2024-05-30T06:42:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f425c0149b0 con 0x7f425c0039c0 2024-05-30T06:42:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277e00640 1 --2- 172.21.15.37:0/798053090 >> v2:172.21.15.37:3300/0 conn(0x7f42780b4fd0 0x7f42780b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:19.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7fc515e00640 1 --2- 172.21.15.37:0/2915935955 >> v2:172.21.15.37:3300/0 conn(0x7fc51009afa0 0x7fc5100ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7fc515e00640 1 --2- 172.21.15.37:0/2915935955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5100c8400 0x7fc51009aa60 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc510068ed0 tx=0x7fc50001c500 comp rx=0 tx=0).stop 2024-05-30T06:42:19.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7fc515e00640 1 -- 172.21.15.37:0/2915935955 >> 172.21.15.37:0/2915935955 conn(0x7fc5100cef80 msgr2=0x7fc5100cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f427ca00640 1 --2- 172.21.15.37:0/798053090 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f425c0039c0 0x7f425c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277e00640 1 --2- 172.21.15.37:0/798053090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f425c0043b0 0x7f425c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7fe21ea00640 1 Processor -- start 2024-05-30T06:42:19.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7fe21ea00640 1 -- start start 2024-05-30T06:42:19.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f427ca00640 1 -- 172.21.15.37:0/798053090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f425c005090 msgr2=0x7f425c0141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:19.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f427ca00640 1 --2- 172.21.15.37:0/798053090 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f425c005090 0x7f425c0141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f427ca00640 1 -- 172.21.15.37:0/798053090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f425c0043b0 msgr2=0x7f425c004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:19.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f427ca00640 1 --2- 172.21.15.37:0/798053090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f425c0043b0 0x7f425c004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f427ca00640 1 -- 172.21.15.37:0/798053090 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427806e370 con 0x7f425c0039c0 2024-05-30T06:42:19.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7f4277e00640 1 --2- 172.21.15.37:0/798053090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f425c0043b0 0x7f425c004890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:19.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.411+0000 7fc515e00640 1 -- 172.21.15.37:0/2915935955 shutdown_connections 2024-05-30T06:42:19.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fc515e00640 1 -- 172.21.15.37:0/2915935955 wait complete. 2024-05-30T06:42:19.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fe21ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2180ceec0 0x7fe2180cf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fe21ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe21815e2b0 0x7fe21815e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fe21ea00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2180d1550 con 0x7fe2180ce820 2024-05-30T06:42:19.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fe21ea00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe2180d1b10 con 0x7fe21815e2b0 2024-05-30T06:42:19.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fe21ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2180cf860 con 0x7fe2180ceec0 2024-05-30T06:42:19.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fe21ca00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe21815e2b0 0x7fe21815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fe21ca00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe21815e2b0 0x7fe21815e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34000/0 (socket says 172.21.15.37:34000) 2024-05-30T06:42:19.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fe21ca00640 1 -- 172.21.15.37:0/3484484362 learned_addr learned my addr 172.21.15.37:0/3484484362 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7f4e46e00640 1 Processor -- start 2024-05-30T06:42:19.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fc515e00640 1 Processor -- start 2024-05-30T06:42:19.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fc515e00640 1 -- start start 2024-05-30T06:42:19.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7f4e46e00640 1 -- start start 2024-05-30T06:42:19.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7f4e46e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e4015c5a0 0x7f4e4006ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7f4e46e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e400d0980 0x7f4e400d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7f4e46e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4e40160210 0x7f4e40160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7f4e46e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4e400d1320 con 0x7f4e4015c5a0 2024-05-30T06:42:19.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7f4e46e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4e400cde30 con 0x7f4e40160210 2024-05-30T06:42:19.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7f4e46e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4e400ce110 con 0x7f4e400d0980 2024-05-30T06:42:19.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fe21ca00640 1 -- 172.21.15.37:0/3484484362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2180ceec0 msgr2=0x7fe2180cf320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T06:42:19.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f427ca00640 1 --2- 172.21.15.37:0/798053090 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f425c0039c0 0x7f425c003de0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f42640099a0 tx=0x7f426401c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b533fcfbfb8a247 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4e45a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e4015c5a0 0x7f4e4006ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4e45000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e400d0980 0x7f4e400d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fe21ca00640 1 --2- 172.21.15.37:0/3484484362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2180ceec0 0x7fe2180cf320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4e45a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e4015c5a0 0x7f4e4006ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34006/0 (socket says 172.21.15.37:34006) 2024-05-30T06:42:19.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4e45000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e400d0980 0x7f4e400d0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:45140/0 (socket says 172.21.15.37:45140) 2024-05-30T06:42:19.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4e45000640 1 -- 172.21.15.37:0/4166878414 learned_addr learned my addr 172.21.15.37:0/4166878414 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42640b2070 con 0x7f425c0039c0 2024-05-30T06:42:19.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42640a5520 con 0x7f425c0039c0 2024-05-30T06:42:19.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4277400640 1 -- 172.21.15.37:0/798053090 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264009670 con 0x7f425c0039c0 2024-05-30T06:42:19.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4e46400640 1 --2- 172.21.15.37:0/4166878414 >> v2:172.21.15.105:3300/0 conn(0x7f4e40160210 0x7f4e40160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4e45000640 1 -- 172.21.15.37:0/4166878414 >> v2:172.21.15.105:3300/0 conn(0x7f4e40160210 msgr2=0x7f4e40160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:19.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4e45000640 1 --2- 172.21.15.37:0/4166878414 >> v2:172.21.15.105:3300/0 conn(0x7f4e40160210 0x7f4e40160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4e45000640 1 -- 172.21.15.37:0/4166878414 >> v2:172.21.15.37:3300/0 conn(0x7f4e4015c5a0 msgr2=0x7f4e4006ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:19.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4e45000640 1 --2- 172.21.15.37:0/4166878414 >> v2:172.21.15.37:3300/0 conn(0x7f4e4015c5a0 0x7f4e4006ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f4e45000640 1 -- 172.21.15.37:0/4166878414 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e400d0180 con 0x7f4e400d0980 2024-05-30T06:42:19.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f427de00640 1 -- 172.21.15.37:0/798053090 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f425c0039c0 msgr2=0x7f425c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f427de00640 1 --2- 172.21.15.37:0/798053090 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f425c0039c0 0x7f425c003de0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f42640099a0 tx=0x7f426401c930 comp rx=0 tx=0).stop 2024-05-30T06:42:19.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f427d400640 1 -- 172.21.15.37:0/798053090 reap_dead start 2024-05-30T06:42:19.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fe21ca00640 1 -- 172.21.15.37:0/3484484362 >> v1:172.21.15.37:6789/0 conn(0x7fe2180ce820 legacy=0x7fe21806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.415+0000 7fe21ca00640 1 -- 172.21.15.37:0/3484484362 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2180d1830 con 0x7fe21815e2b0 2024-05-30T06:42:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7fc515e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51009afa0 0x7fc5101551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f427de00640 1 -- 172.21.15.37:0/798053090 shutdown_connections 2024-05-30T06:42:19.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f427de00640 1 -- 172.21.15.37:0/798053090 >> 172.21.15.37:0/798053090 conn(0x7f4278067b60 msgr2=0x7f427806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7fe21ca00640 1 --2- 172.21.15.37:0/3484484362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe21815e2b0 0x7fe21815e740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2080098a0 tx=0x7fe20801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9132ce6878518430 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7fc515e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5100ce510 0x7fc510156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7fc515e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51014e820 0x7fc510152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f427de00640 1 -- 172.21.15.37:0/798053090 shutdown_connections 2024-05-30T06:42:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7fe216a00640 1 -- 172.21.15.37:0/3484484362 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2080ab640 con 0x7fe21815e2b0 2024-05-30T06:42:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7fe216a00640 1 -- 172.21.15.37:0/3484484362 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2080b0070 con 0x7fe21815e2b0 2024-05-30T06:42:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7fc515e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc51006e550 con 0x7fc51009afa0 2024-05-30T06:42:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc515e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc51006e270 con 0x7fc51014e820 2024-05-30T06:42:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc515e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc5100cd810 con 0x7fc5100ce510 2024-05-30T06:42:19.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc514a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51009afa0 0x7fc5101551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fe21ea00640 1 -- 172.21.15.37:0/3484484362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe21815e2b0 msgr2=0x7fe21815e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fe216a00640 1 -- 172.21.15.37:0/3484484362 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2080ab640 con 0x7fe21815e2b0 2024-05-30T06:42:19.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc514a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51009afa0 0x7fc5101551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34020/0 (socket says 172.21.15.37:34020) 2024-05-30T06:42:19.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc514a00640 1 -- 172.21.15.37:0/3148637024 learned_addr learned my addr 172.21.15.37:0/3148637024 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fe21ea00640 1 --2- 172.21.15.37:0/3484484362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe21815e2b0 0x7fe21815e740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2080098a0 tx=0x7fe20801c530 comp rx=0 tx=0).stop 2024-05-30T06:42:19.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc50fe00640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5100ce510 0x7fc510156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.419+0000 7f427de00640 1 -- 172.21.15.37:0/798053090 wait complete. 2024-05-30T06:42:19.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc515400640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51014e820 0x7fc510152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7f427de00640 1 Processor -- start 2024-05-30T06:42:19.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fe21ea00640 1 -- 172.21.15.37:0/3484484362 shutdown_connections 2024-05-30T06:42:19.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fe21ea00640 1 --2- 172.21.15.37:0/3484484362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe21815e2b0 0x7fe21815e740 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fe21ea00640 1 --2- 172.21.15.37:0/3484484362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2180ceec0 0x7fe2180cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fe21ea00640 1 -- 172.21.15.37:0/3484484362 >> 172.21.15.37:0/3484484362 conn(0x7fe2180d2640 msgr2=0x7fe2180d2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fe21ea00640 1 -- 172.21.15.37:0/3484484362 shutdown_connections 2024-05-30T06:42:19.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7f4e45000640 1 --2- 172.21.15.37:0/4166878414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e400d0980 0x7f4e400d0de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4e400d2010 tx=0x7f4e2c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae06e0c6d3058e39 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fe21ea00640 1 -- 172.21.15.37:0/3484484362 wait complete. 2024-05-30T06:42:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc50fe00640 1 -- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51014e820 msgr2=0x7fc510152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc50fe00640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51014e820 0x7fc510152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc50fe00640 1 -- 172.21.15.37:0/3148637024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51009afa0 msgr2=0x7fc5101551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc50fe00640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51009afa0 0x7fc5101551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc50fe00640 1 -- 172.21.15.37:0/3148637024 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5101569d0 con 0x7fc5100ce510 2024-05-30T06:42:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7f4e3fe00640 1 -- 172.21.15.37:0/4166878414 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0aa660 con 0x7f4e400d0980 2024-05-30T06:42:19.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7f4e3fe00640 1 -- 172.21.15.37:0/4166878414 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c0af070 con 0x7f4e400d0980 2024-05-30T06:42:19.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7f4e3fe00640 1 -- 172.21.15.37:0/4166878414 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0aaa20 con 0x7f4e400d0980 2024-05-30T06:42:19.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f86e2a00640 1 Processor -- start 2024-05-30T06:42:19.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7fe21ea00640 1 Processor -- start 2024-05-30T06:42:19.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7fe21ea00640 1 -- start start 2024-05-30T06:42:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7f427de00640 1 -- start start 2024-05-30T06:42:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f427de00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f425c0039c0 0x7f4278152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f427de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f427815bf60 0x7f427815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f427de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4278154d90 0x7f4278155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f427ca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f425c0039c0 0x7f4278152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f4277e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f427815bf60 0x7f427815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f4277e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f427815bf60 0x7f427815c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:45154/0 (socket says 172.21.15.37:45154) 2024-05-30T06:42:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f427ca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f425c0039c0 0x7f4278152f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59260/0 (socket says 172.21.15.37:59260) 2024-05-30T06:42:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc50fe00640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5100ce510 0x7fc510156490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc510073000 tx=0x7fc5000192a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc50cc00640 1 -- 172.21.15.37:0/3148637024 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000a8050 con 0x7fc5100ce510 2024-05-30T06:42:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc50cc00640 1 -- 172.21.15.37:0/3148637024 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5000ace10 con 0x7fc5100ce510 2024-05-30T06:42:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc50cc00640 1 -- 172.21.15.37:0/3148637024 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000b1040 con 0x7fc5100ce510 2024-05-30T06:42:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.423+0000 7fc515e00640 1 -- 172.21.15.37:0/3148637024 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc510156c50 con 0x7fc5100ce510 2024-05-30T06:42:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7fc515e00640 1 -- 172.21.15.37:0/3148637024 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc510157210 con 0x7fc5100ce510 2024-05-30T06:42:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f86e2a00640 1 -- start start 2024-05-30T06:42:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f86e2a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86d4053f60 0x7f86d4006c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f86e2a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86d403eca0 0x7f86d40e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f86e2a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f86d4054340 0x7f86d40e7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f86e2a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f86d4007b90 con 0x7f86d403eca0 2024-05-30T06:42:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f86e2a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f86d40075d0 con 0x7f86d4054340 2024-05-30T06:42:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f86e2a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f86d40078b0 con 0x7f86d4053f60 2024-05-30T06:42:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f4e46e00640 1 -- 172.21.15.37:0/4166878414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e400d0980 msgr2=0x7f4e400d0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f4e46e00640 1 --2- 172.21.15.37:0/4166878414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e400d0980 0x7f4e400d0de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4e400d2010 tx=0x7f4e2c01c540 comp rx=0 tx=0).stop 2024-05-30T06:42:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f4e46e00640 1 -- 172.21.15.37:0/4166878414 shutdown_connections 2024-05-30T06:42:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f4e46e00640 1 --2- 172.21.15.37:0/4166878414 >> v2:172.21.15.105:3300/0 conn(0x7f4e40160210 0x7f4e40160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f4e46e00640 1 --2- 172.21.15.37:0/4166878414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e400d0980 0x7f4e400d0de0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f4e46e00640 1 --2- 172.21.15.37:0/4166878414 >> v2:172.21.15.37:3300/0 conn(0x7f4e4015c5a0 0x7f4e4006ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f4e46e00640 1 -- 172.21.15.37:0/4166878414 >> 172.21.15.37:0/4166878414 conn(0x7f4e400d2430 msgr2=0x7f4e400d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f427d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4278154d90 0x7f4278155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f427d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4278154d90 0x7f4278155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34022/0 (socket says 172.21.15.37:34022) 2024-05-30T06:42:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f86e1600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86d4053f60 0x7f86d4006c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f86e1600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86d4053f60 0x7f86d4006c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:45162/0 (socket says 172.21.15.37:45162) 2024-05-30T06:42:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f86e1600640 1 -- 172.21.15.37:0/585161915 learned_addr learned my addr 172.21.15.37:0/585161915 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f4e46e00640 1 -- 172.21.15.37:0/4166878414 shutdown_connections 2024-05-30T06:42:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f4e46e00640 1 -- 172.21.15.37:0/4166878414 wait complete. 2024-05-30T06:42:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f4277e00640 1 -- 172.21.15.37:0/1330832866 learned_addr learned my addr 172.21.15.37:0/1330832866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f427de00640 1 -- 172.21.15.37:0/1330832866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f427815bbe0 con 0x7f4278154d90 2024-05-30T06:42:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f427de00640 1 -- 172.21.15.37:0/1330832866 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f427806e930 con 0x7f425c0039c0 2024-05-30T06:42:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.427+0000 7f427de00640 1 -- 172.21.15.37:0/1330832866 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f427815a6e0 con 0x7f427815bf60 2024-05-30T06:42:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fc515e00640 1 -- 172.21.15.37:0/3148637024 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e80052a0 con 0x7fc5100ce510 2024-05-30T06:42:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f86e0c00640 1 --2- 172.21.15.37:0/585161915 >> v2:172.21.15.37:3300/0 conn(0x7f86d403eca0 0x7f86d40e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f86e1600640 1 -- 172.21.15.37:0/585161915 >> v2:172.21.15.105:3300/0 conn(0x7f86d4054340 msgr2=0x7f86d40e7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f86e2000640 1 --2- 172.21.15.37:0/585161915 >> v2:172.21.15.105:3300/0 conn(0x7f86d4054340 0x7f86d40e7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f86e1600640 1 --2- 172.21.15.37:0/585161915 >> v2:172.21.15.105:3300/0 conn(0x7f86d4054340 0x7f86d40e7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f86e1600640 1 -- 172.21.15.37:0/585161915 >> v2:172.21.15.37:3300/0 conn(0x7f86d403eca0 msgr2=0x7f86d40e6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f86e1600640 1 --2- 172.21.15.37:0/585161915 >> v2:172.21.15.37:3300/0 conn(0x7f86d403eca0 0x7f86d40e6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f86e1600640 1 -- 172.21.15.37:0/585161915 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d40571c0 con 0x7f86d4053f60 2024-05-30T06:42:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f4e46e00640 1 Processor -- start 2024-05-30T06:42:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f4e46e00640 1 -- start start 2024-05-30T06:42:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f86e0c00640 1 --2- 172.21.15.37:0/585161915 >> v2:172.21.15.37:3300/0 conn(0x7f86d403eca0 0x7f86d40e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f86e2000640 1 --2- 172.21.15.37:0/585161915 >> v2:172.21.15.105:3300/0 conn(0x7f86d4054340 0x7f86d40e7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe21ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2180ce820 0x7fe2180b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe21ea00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2180ceec0 0x7fe21815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe21ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe21815e2b0 0x7fe2181554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe21ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe21806dd10 con 0x7fe2180ce820 2024-05-30T06:42:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe21ea00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe21806db90 con 0x7fe2180ceec0 2024-05-30T06:42:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe21ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2180ccc90 con 0x7fe21815e2b0 2024-05-30T06:42:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe217400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2180ceec0 0x7fe21815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe217400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2180ceec0 0x7fe21815afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59276/0 (socket says 172.21.15.37:59276) 2024-05-30T06:42:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe217400640 1 -- 172.21.15.37:0/1548134393 learned_addr learned my addr 172.21.15.37:0/1548134393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe217400640 1 -- 172.21.15.37:0/1548134393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe21815e2b0 msgr2=0x7fe2181554f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:42:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe217400640 1 --2- 172.21.15.37:0/1548134393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe21815e2b0 0x7fe2181554f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe217400640 1 -- 172.21.15.37:0/1548134393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2180ce820 msgr2=0x7fe2180b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe217400640 1 --2- 172.21.15.37:0/1548134393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2180ce820 0x7fe2180b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe217400640 1 -- 172.21.15.37:0/1548134393 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21815b8a0 con 0x7fe2180ceec0 2024-05-30T06:42:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f427ca00640 1 -- 172.21.15.37:0/1330832866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f427815bf60 msgr2=0x7f427815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f427ca00640 1 --2- 172.21.15.37:0/1330832866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f427815bf60 0x7f427815c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f427ca00640 1 -- 172.21.15.37:0/1330832866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4278154d90 msgr2=0x7f4278155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f427ca00640 1 --2- 172.21.15.37:0/1330832866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4278154d90 0x7f4278155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7f427ca00640 1 -- 172.21.15.37:0/1330832866 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4278140940 con 0x7f425c0039c0 2024-05-30T06:42:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.431+0000 7fe217400640 1 --2- 172.21.15.37:0/1548134393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2180ceec0 0x7fe21815afa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe21000ba50 tx=0x7fe21000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7fe20fe00640 1 -- 172.21.15.37:0/1548134393 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210019070 con 0x7fe2180ceec0 2024-05-30T06:42:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7fe20fe00640 1 -- 172.21.15.37:0/1548134393 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21000cc00 con 0x7fe2180ceec0 2024-05-30T06:42:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7fe20fe00640 1 -- 172.21.15.37:0/1548134393 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210014440 con 0x7fe2180ceec0 2024-05-30T06:42:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7fe21ea00640 1 -- 172.21.15.37:0/1548134393 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21815bb80 con 0x7fe2180ceec0 2024-05-30T06:42:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e46e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e400d0980 0x7f4e4015a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e46e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e4015c5a0 0x7f4e400c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e46e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e40160210 0x7f4e401576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e46e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4e400cdbd0 con 0x7f4e400d0980 2024-05-30T06:42:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e46e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4e400cda50 con 0x7f4e4015c5a0 2024-05-30T06:42:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e46e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4015c980 con 0x7f4e40160210 2024-05-30T06:42:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7fe21ea00640 1 -- 172.21.15.37:0/1548134393 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21815c1e0 con 0x7fe2180ceec0 2024-05-30T06:42:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f427ca00640 1 --2- 172.21.15.37:0/1330832866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f425c0039c0 0x7f4278152f70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f42640ac000 tx=0x7f425c005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7fc50cc00640 1 -- 172.21.15.37:0/3148637024 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc5000ab3d0 con 0x7fc5100ce510 2024-05-30T06:42:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e45000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e4015c5a0 0x7f4e400c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e46400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e40160210 0x7f4e401576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e45000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e4015c5a0 0x7f4e400c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59280/0 (socket says 172.21.15.37:59280) 2024-05-30T06:42:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e45000640 1 -- 172.21.15.37:0/529012223 learned_addr learned my addr 172.21.15.37:0/529012223 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e45000640 1 -- 172.21.15.37:0/529012223 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e40160210 msgr2=0x7f4e401576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e45000640 1 --2- 172.21.15.37:0/529012223 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e40160210 0x7f4e401576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e45000640 1 -- 172.21.15.37:0/529012223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e400d0980 msgr2=0x7f4e4015a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e45000640 1 --2- 172.21.15.37:0/529012223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e400d0980 0x7f4e4015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e45000640 1 -- 172.21.15.37:0/529012223 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e401fbe20 con 0x7f4e4015c5a0 2024-05-30T06:42:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7fc50cc00640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc4ec068400 0x7fc4ec06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7fc50cc00640 1 -- 172.21.15.37:0/3148637024 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc50011fa60 con 0x7fc5100ce510 2024-05-30T06:42:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4274c00640 1 -- 172.21.15.37:0/1330832866 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42640b2070 con 0x7f425c0039c0 2024-05-30T06:42:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4274c00640 1 -- 172.21.15.37:0/1330832866 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42640bc070 con 0x7f425c0039c0 2024-05-30T06:42:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f427de00640 1 -- 172.21.15.37:0/1330832866 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4278140c20 con 0x7f425c0039c0 2024-05-30T06:42:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4e45000640 1 --2- 172.21.15.37:0/529012223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e4015c5a0 0x7f4e400c8660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c01abf0 tx=0x7f4e2c01ad80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f427de00640 1 -- 172.21.15.37:0/1330832866 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42781411e0 con 0x7f425c0039c0 2024-05-30T06:42:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f86e1600640 1 --2- 172.21.15.37:0/585161915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86d4053f60 0x7f86d4006c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f86d40536c0 tx=0x7f86d001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db85268597372666 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7f4274c00640 1 -- 172.21.15.37:0/1330832866 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42640a5d60 con 0x7f425c0039c0 2024-05-30T06:42:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.435+0000 7fc514a00640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc4ec068400 0x7fc4ec06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7fe20fe00640 1 -- 172.21.15.37:0/1548134393 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe21001c070 con 0x7fe2180ceec0 2024-05-30T06:42:19.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7fe21ea00640 1 -- 172.21.15.37:0/1548134393 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe218075580 con 0x7fe2180ceec0 2024-05-30T06:42:19.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7fe20fe00640 1 --2- 172.21.15.37:0/1548134393 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1f8068480 0x7fe1f806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7fe20fe00640 1 -- 172.21.15.37:0/1548134393 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe210086680 con 0x7fe2180ceec0 2024-05-30T06:42:19.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7f4e3d600640 1 -- 172.21.15.37:0/529012223 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0bd3f0 con 0x7f4e4015c5a0 2024-05-30T06:42:19.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7f4e3d600640 1 -- 172.21.15.37:0/529012223 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c0bd590 con 0x7f4e4015c5a0 2024-05-30T06:42:19.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7f4e3d600640 1 -- 172.21.15.37:0/529012223 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c0bd980 con 0x7f4e4015c5a0 2024-05-30T06:42:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7f4e46e00640 1 -- 172.21.15.37:0/529012223 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e401fc0d0 con 0x7f4e4015c5a0 2024-05-30T06:42:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7f427de00640 1 -- 172.21.15.37:0/1330832866 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42500052a0 con 0x7f425c0039c0 2024-05-30T06:42:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7fe217e00640 1 --2- 172.21.15.37:0/1548134393 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1f8068480 0x7fe1f806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7f4e46e00640 1 -- 172.21.15.37:0/529012223 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e401fc690 con 0x7f4e4015c5a0 2024-05-30T06:42:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7fc514a00640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc4ec068400 0x7fc4ec06a8c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc510169900 tx=0x7fc4f80090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f86dbe00640 1 -- 172.21.15.37:0/585161915 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d00b0070 con 0x7f86d4053f60 2024-05-30T06:42:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7fe217e00640 1 --2- 172.21.15.37:0/1548134393 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1f8068480 0x7fe1f806a940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe204000f70 tx=0x7fe2040079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.439+0000 7f4274c00640 1 -- 172.21.15.37:0/1330832866 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f42640059a0 con 0x7f425c0039c0 2024-05-30T06:42:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f86dbe00640 1 -- 172.21.15.37:0/585161915 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d00ab600 con 0x7f86d4053f60 2024-05-30T06:42:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f86dbe00640 1 -- 172.21.15.37:0/585161915 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d00b0070 con 0x7f86d4053f60 2024-05-30T06:42:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f4e46e00640 1 -- 172.21.15.37:0/529012223 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e40075580 con 0x7f4e4015c5a0 2024-05-30T06:42:19.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7fc50cc00640 1 -- 172.21.15.37:0/3148637024 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc5101569d0 con 0x7fc5100ce510 2024-05-30T06:42:19.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f4274c00640 1 --2- 172.21.15.37:0/1330832866 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4258068480 0x7f425806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f4274c00640 1 -- 172.21.15.37:0/1330832866 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4264120900 con 0x7f425c0039c0 2024-05-30T06:42:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f4277e00640 1 --2- 172.21.15.37:0/1330832866 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4258068480 0x7f425806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f86e2a00640 1 -- 172.21.15.37:0/585161915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86d4053f60 msgr2=0x7f86d4006c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f86e2a00640 1 --2- 172.21.15.37:0/585161915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86d4053f60 0x7f86d4006c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f86d40536c0 tx=0x7f86d001c560 comp rx=0 tx=0).stop 2024-05-30T06:42:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f86e2a00640 1 -- 172.21.15.37:0/585161915 shutdown_connections 2024-05-30T06:42:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f86e2a00640 1 --2- 172.21.15.37:0/585161915 >> v2:172.21.15.105:3300/0 conn(0x7f86d4054340 0x7f86d40e7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f86e2a00640 1 --2- 172.21.15.37:0/585161915 >> v2:172.21.15.37:3300/0 conn(0x7f86d403eca0 0x7f86d40e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f86e2a00640 1 --2- 172.21.15.37:0/585161915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86d4053f60 0x7f86d4006c60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f86e2a00640 1 -- 172.21.15.37:0/585161915 >> 172.21.15.37:0/585161915 conn(0x7f86d403aa40 msgr2=0x7f86d403ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f86e2a00640 1 -- 172.21.15.37:0/585161915 shutdown_connections 2024-05-30T06:42:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f86e2a00640 1 -- 172.21.15.37:0/585161915 wait complete. 2024-05-30T06:42:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.443+0000 7f4277e00640 1 --2- 172.21.15.37:0/1330832866 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4258068480 0x7f425806a940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42780af740 tx=0x7f4270010040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e2a00640 1 Processor -- start 2024-05-30T06:42:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e2a00640 1 -- start start 2024-05-30T06:42:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7fe20fe00640 1 -- 172.21.15.37:0/1548134393 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe210056660 con 0x7fe2180ceec0 2024-05-30T06:42:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e2a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86d403eca0 0x7f86d418a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e2a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86d4053f60 0x7f86d4052590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d4054340 0x7f86d4052ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e2a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f86d40073b0 con 0x7f86d4054340 2024-05-30T06:42:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e2a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86d40e7c50 con 0x7f86d403eca0 2024-05-30T06:42:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e2a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f86d40df580 con 0x7f86d4053f60 2024-05-30T06:42:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f4e3d600640 1 -- 172.21.15.37:0/529012223 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e2c0c7460 con 0x7f4e4015c5a0 2024-05-30T06:42:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e1600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86d403eca0 0x7f86d418a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e1600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86d403eca0 0x7f86d418a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59284/0 (socket says 172.21.15.37:59284) 2024-05-30T06:42:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e1600640 1 -- 172.21.15.37:0/3075714247 learned_addr learned my addr 172.21.15.37:0/3075714247 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e0c00640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86d4053f60 0x7f86d4052590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e2000640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d4054340 0x7f86d4052ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e1600640 1 -- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86d4053f60 msgr2=0x7f86d4052590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e1600640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86d4053f60 0x7f86d4052590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e1600640 1 -- 172.21.15.37:0/3075714247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d4054340 msgr2=0x7f86d4052ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e1600640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d4054340 0x7f86d4052ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e1600640 1 -- 172.21.15.37:0/3075714247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d40517d0 con 0x7f86d403eca0 2024-05-30T06:42:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e2000640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d4054340 0x7f86d4052ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.447+0000 7f86e1600640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86d403eca0 0x7f86d418a610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f86d00ae040 tx=0x7f86d0019300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.451+0000 7f4e3d600640 1 --2- 172.21.15.37:0/529012223 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e200683d0 0x7f4e2006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.451+0000 7f86d9600640 1 -- 172.21.15.37:0/3075714247 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d00b8070 con 0x7f86d403eca0 2024-05-30T06:42:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.451+0000 7f86e2a00640 1 -- 172.21.15.37:0/3075714247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d4051ab0 con 0x7f86d403eca0 2024-05-30T06:42:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.451+0000 7f86e2a00640 1 -- 172.21.15.37:0/3075714247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d4052070 con 0x7f86d403eca0 2024-05-30T06:42:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.451+0000 7f4e45a00640 1 --2- 172.21.15.37:0/529012223 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e200683d0 0x7f4e2006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.451+0000 7f4e3d600640 1 -- 172.21.15.37:0/529012223 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4e2c0c8e00 con 0x7f4e4015c5a0 2024-05-30T06:42:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.451+0000 7f4e45a00640 1 --2- 172.21.15.37:0/529012223 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e200683d0 0x7f4e2006a890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e401582f0 tx=0x7f4e34009520 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.451+0000 7f86e2a00640 1 -- 172.21.15.37:0/3075714247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d4052270 con 0x7f86d403eca0 2024-05-30T06:42:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.451+0000 7f4274c00640 1 -- 172.21.15.37:0/1330832866 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f42640166a0 con 0x7f425c0039c0 2024-05-30T06:42:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.455+0000 7f4e3d600640 1 -- 172.21.15.37:0/529012223 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4e2c0c3060 con 0x7f4e4015c5a0 2024-05-30T06:42:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.455+0000 7f86d9600640 1 -- 172.21.15.37:0/3075714247 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d00acb40 con 0x7f86d403eca0 2024-05-30T06:42:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.455+0000 7f86d9600640 1 -- 172.21.15.37:0/3075714247 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d00c2060 con 0x7f86d403eca0 2024-05-30T06:42:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.459+0000 7f86d9600640 1 -- 172.21.15.37:0/3075714247 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86d00bb070 con 0x7f86d403eca0 2024-05-30T06:42:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.459+0000 7f86d9600640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f86bc0683b0 0x7f86bc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.459+0000 7f86d9600640 1 -- 172.21.15.37:0/3075714247 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f86d0120b90 con 0x7f86d403eca0 2024-05-30T06:42:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.459+0000 7f86e0c00640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f86bc0683b0 0x7f86bc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.459+0000 7f86d9600640 1 -- 172.21.15.37:0/3075714247 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f86d4052270 con 0x7f86d403eca0 2024-05-30T06:42:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.463+0000 7f86e0c00640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f86bc0683b0 0x7f86bc06a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f86d4001030 tx=0x7f86c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.483+0000 7effae200640 1 Processor -- start 2024-05-30T06:42:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.483+0000 7f689ee00640 1 Processor -- start 2024-05-30T06:42:19.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.483+0000 7effae200640 1 -- start start 2024-05-30T06:42:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.483+0000 7f689ee00640 1 -- start start 2024-05-30T06:42:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.483+0000 7f689ee00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f689815a770 0x7f68980b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.483+0000 7f689da00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f689815a770 0x7f68980b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.483+0000 7f689da00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f689815a770 0x7f68980b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59300/0 (socket says 172.21.15.37:59300) 2024-05-30T06:42:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.483+0000 7f689da00640 1 -- 172.21.15.37:0/73175973 learned_addr learned my addr 172.21.15.37:0/73175973 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.487+0000 7f689ee00640 1 --2- 172.21.15.37:0/73175973 >> v2:172.21.15.37:3300/0 conn(0x7f6898072510 0x7f68980b3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.487+0000 7f689ee00640 1 -- 172.21.15.37:0/73175973 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f689815ab50 con 0x7f68980b5510 2024-05-30T06:42:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.487+0000 7f689ee00640 1 -- 172.21.15.37:0/73175973 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f689806de40 con 0x7f6898072510 2024-05-30T06:42:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.487+0000 7f689ee00640 1 -- 172.21.15.37:0/73175973 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f689806e090 con 0x7f689815a770 2024-05-30T06:42:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.487+0000 7f689da00640 1 -- 172.21.15.37:0/73175973 >> v2:172.21.15.37:3300/0 conn(0x7f6898072510 msgr2=0x7f68980b3420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T06:42:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.487+0000 7f689da00640 1 --2- 172.21.15.37:0/73175973 >> v2:172.21.15.37:3300/0 conn(0x7f6898072510 0x7f68980b3420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.487+0000 7f689da00640 1 -- 172.21.15.37:0/73175973 >> v1:172.21.15.37:6789/0 conn(0x7f68980b5510 legacy=0x7f6898071e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T06:42:19.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.487+0000 7f689da00640 1 -- 172.21.15.37:0/73175973 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689806e370 con 0x7f689815a770 2024-05-30T06:42:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.483+0000 7effae200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effa8072ed0 0x7effa80cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.483+0000 7effae200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7effa806df50 0x7effa806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.487+0000 7effa6a00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7effa806f2e0 0x7effa80cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47304/0 (socket says 172.21.15.37:47304) 2024-05-30T06:42:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.491+0000 7effa6a00640 1 -- 172.21.15.37:0/2531280286 learned_addr learned my addr 172.21.15.37:0/2531280286 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.491+0000 7effae200640 1 -- 172.21.15.37:0/2531280286 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa806e900 con 0x7effa806f2e0 2024-05-30T06:42:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.491+0000 7effae200640 1 -- 172.21.15.37:0/2531280286 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7effa80cfb30 con 0x7effa806df50 2024-05-30T06:42:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.491+0000 7effae200640 1 -- 172.21.15.37:0/2531280286 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7effa80b5370 con 0x7effa8072ed0 2024-05-30T06:42:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.491+0000 7effa7e00640 1 --2- 172.21.15.37:0/2531280286 >> v2:172.21.15.37:3300/0 conn(0x7effa806df50 0x7effa806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.491+0000 7effa6000640 1 -- 172.21.15.37:0/2531280286 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677220419 0 0) 0x7effa806e900 con 0x7effa806f2e0 2024-05-30T06:42:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.491+0000 7effa6000640 1 -- 172.21.15.37:0/2531280286 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff8c003530 con 0x7effa806f2e0 2024-05-30T06:42:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.491+0000 7effa7e00640 1 -- 172.21.15.37:0/2531280286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effa8072ed0 msgr2=0x7effa80cfff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T06:42:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.491+0000 7effa7e00640 1 --2- 172.21.15.37:0/2531280286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effa8072ed0 0x7effa80cfff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.491+0000 7effa7e00640 1 -- 172.21.15.37:0/2531280286 >> v1:172.21.15.105:6789/0 conn(0x7effa806f2e0 legacy=0x7effa80cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.491+0000 7effa7e00640 1 -- 172.21.15.37:0/2531280286 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa80cec20 con 0x7effa806df50 2024-05-30T06:42:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.491+0000 7f689da00640 1 --2- 172.21.15.37:0/73175973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f689815a770 0x7f68980b4fd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f689806c620 tx=0x7f688c01e820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71994af3c7ac434d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.491+0000 7f6897e00640 1 -- 172.21.15.37:0/73175973 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0a8700 con 0x7f689815a770 2024-05-30T06:42:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.495+0000 7f6897e00640 1 -- 172.21.15.37:0/73175973 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688c0a88a0 con 0x7f689815a770 2024-05-30T06:42:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.495+0000 7f689ee00640 1 -- 172.21.15.37:0/73175973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f689815a770 msgr2=0x7f68980b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.495+0000 7f6897e00640 1 -- 172.21.15.37:0/73175973 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0a8700 con 0x7f689815a770 2024-05-30T06:42:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.495+0000 7f689ee00640 1 --2- 172.21.15.37:0/73175973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f689815a770 0x7f68980b4fd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f689806c620 tx=0x7f688c01e820 comp rx=0 tx=0).stop 2024-05-30T06:42:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.495+0000 7f689ee00640 1 -- 172.21.15.37:0/73175973 shutdown_connections 2024-05-30T06:42:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.495+0000 7f689ee00640 1 --2- 172.21.15.37:0/73175973 >> v2:172.21.15.37:3300/0 conn(0x7f6898072510 0x7f68980b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.495+0000 7f689ee00640 1 --2- 172.21.15.37:0/73175973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f689815a770 0x7f68980b4fd0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f689806c620 tx=0x7f688c01e820 comp rx=0 tx=0).stop 2024-05-30T06:42:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.495+0000 7f689ee00640 1 -- 172.21.15.37:0/73175973 >> 172.21.15.37:0/73175973 conn(0x7f6898067b60 msgr2=0x7f689806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.495+0000 7f689ee00640 1 -- 172.21.15.37:0/73175973 shutdown_connections 2024-05-30T06:42:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.495+0000 7f689ee00640 1 -- 172.21.15.37:0/73175973 wait complete. 2024-05-30T06:42:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.499+0000 7f689ee00640 1 Processor -- start 2024-05-30T06:42:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.499+0000 7f689ee00640 1 -- start start 2024-05-30T06:42:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.499+0000 7effa7e00640 1 --2- 172.21.15.37:0/2531280286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa806df50 0x7effa806e3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7eff940097c0 tx=0x7eff9401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d452886f9bafe902 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7effa6000640 1 -- 172.21.15.37:0/2531280286 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff940b1070 con 0x7effa806df50 2024-05-30T06:42:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7effa6000640 1 -- 172.21.15.37:0/2531280286 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff940ac410 con 0x7effa806df50 2024-05-30T06:42:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7effa6000640 1 -- 172.21.15.37:0/2531280286 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff940ac820 con 0x7effa806df50 2024-05-30T06:42:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689ee00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6898072510 0x7f6898159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689da00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6898072510 0x7f6898159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689da00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6898072510 0x7f6898159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59312/0 (socket says 172.21.15.37:59312) 2024-05-30T06:42:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689ee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68980b5510 0x7f6898161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689da00640 1 -- 172.21.15.37:0/1788275918 learned_addr learned my addr 172.21.15.37:0/1788275918 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689d000640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68980b5510 0x7f6898161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689ee00640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6898151c60 0x7f68981623e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689ee00640 1 -- 172.21.15.37:0/1788275918 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68980b42f0 con 0x7f6898151c60 2024-05-30T06:42:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689ee00640 1 -- 172.21.15.37:0/1788275918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68980b4170 con 0x7f6898072510 2024-05-30T06:42:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689ee00640 1 -- 172.21.15.37:0/1788275918 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68980b4470 con 0x7f68980b5510 2024-05-30T06:42:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689da00640 1 -- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68980b5510 msgr2=0x7f6898161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689da00640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68980b5510 0x7f6898161ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689da00640 1 -- 172.21.15.37:0/1788275918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6898151c60 msgr2=0x7f68981623e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T06:42:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689e400640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6898151c60 0x7f68981623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689da00640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6898151c60 0x7f68981623e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689da00640 1 -- 172.21.15.37:0/1788275918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6898161400 con 0x7f6898072510 2024-05-30T06:42:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.503+0000 7f689da00640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6898072510 0x7f6898159000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f688c0b2040 tx=0x7f688c01b5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7f6895600640 1 -- 172.21.15.37:0/1788275918 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0bf070 con 0x7f6898072510 2024-05-30T06:42:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7f6895600640 1 -- 172.21.15.37:0/1788275918 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688c003620 con 0x7f6898072510 2024-05-30T06:42:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7f6895600640 1 -- 172.21.15.37:0/1788275918 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0039d0 con 0x7f6898072510 2024-05-30T06:42:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7f689ee00640 1 -- 172.21.15.37:0/1788275918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6898159e10 con 0x7f6898072510 2024-05-30T06:42:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7effae200640 1 -- 172.21.15.37:0/2531280286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa806df50 msgr2=0x7effa806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7effae200640 1 --2- 172.21.15.37:0/2531280286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa806df50 0x7effa806e3c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7eff940097c0 tx=0x7eff9401c420 comp rx=0 tx=0).stop 2024-05-30T06:42:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7effae200640 1 -- 172.21.15.37:0/2531280286 shutdown_connections 2024-05-30T06:42:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7f689ee00640 1 -- 172.21.15.37:0/1788275918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68981616a0 con 0x7f6898072510 2024-05-30T06:42:19.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7effae200640 1 --2- 172.21.15.37:0/2531280286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa806df50 0x7effa806e3c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7effae200640 1 --2- 172.21.15.37:0/2531280286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effa8072ed0 0x7effa80cfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7effae200640 1 -- 172.21.15.37:0/2531280286 >> 172.21.15.37:0/2531280286 conn(0x7effa80b23c0 msgr2=0x7effa80b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7effae200640 1 -- 172.21.15.37:0/2531280286 shutdown_connections 2024-05-30T06:42:19.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7effae200640 1 -- 172.21.15.37:0/2531280286 wait complete. 2024-05-30T06:42:19.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.511+0000 7effae200640 1 Processor -- start 2024-05-30T06:42:19.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.507+0000 7f6895600640 1 -- 172.21.15.37:0/1788275918 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f688c0c2070 con 0x7f6898072510 2024-05-30T06:42:19.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.511+0000 7f689ee00640 1 -- 172.21.15.37:0/1788275918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6898068700 con 0x7f6898072510 2024-05-30T06:42:19.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.511+0000 7f6895600640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68780683d0 0x7f687806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.511+0000 7f6895600640 1 -- 172.21.15.37:0/1788275918 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f688c0ef400 con 0x7f6898072510 2024-05-30T06:42:19.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.511+0000 7f689d000640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68780683d0 0x7f687806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.511+0000 7effae200640 1 -- start start 2024-05-30T06:42:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.511+0000 7f689d000640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68780683d0 0x7f687806a890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f68981f6710 tx=0x7f6884014040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.511+0000 7effae200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effa806df50 0x7effa81fb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.511+0000 7effae200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effa806f2e0 0x7effa815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.511+0000 7effae200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa8072ed0 0x7effa8144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effa6a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effa806f2e0 0x7effa815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effa7400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effa806df50 0x7effa81fb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effa6a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effa806f2e0 0x7effa815ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59318/0 (socket says 172.21.15.37:59318) 2024-05-30T06:42:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effa7400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effa806df50 0x7effa81fb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:45226/0 (socket says 172.21.15.37:45226) 2024-05-30T06:42:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effa6a00640 1 -- 172.21.15.37:0/3870087429 learned_addr learned my addr 172.21.15.37:0/3870087429 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effae200640 1 -- 172.21.15.37:0/3870087429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7effa806f8c0 con 0x7effa8072ed0 2024-05-30T06:42:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effae200640 1 -- 172.21.15.37:0/3870087429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7effa806f740 con 0x7effa806f2e0 2024-05-30T06:42:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effa7e00640 1 --2- 172.21.15.37:0/3870087429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa8072ed0 0x7effa8144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effae200640 1 -- 172.21.15.37:0/3870087429 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7effa815eba0 con 0x7effa806df50 2024-05-30T06:42:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effa6a00640 1 -- 172.21.15.37:0/3870087429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effa806df50 msgr2=0x7effa81fb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effa6a00640 1 --2- 172.21.15.37:0/3870087429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effa806df50 0x7effa81fb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effa6a00640 1 -- 172.21.15.37:0/3870087429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa8072ed0 msgr2=0x7effa8144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effa6a00640 1 --2- 172.21.15.37:0/3870087429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa8072ed0 0x7effa8144b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7effa6a00640 1 -- 172.21.15.37:0/3870087429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa815c150 con 0x7effa806f2e0 2024-05-30T06:42:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.515+0000 7f6895600640 1 -- 172.21.15.37:0/1788275918 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f688c018410 con 0x7f6898072510 2024-05-30T06:42:19.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.519+0000 7effa6a00640 1 --2- 172.21.15.37:0/3870087429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effa806f2e0 0x7effa815ba00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7effa000cb40 tx=0x7effa000a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.519+0000 7eff9f400640 1 -- 172.21.15.37:0/3870087429 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0017070 con 0x7effa806f2e0 2024-05-30T06:42:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.519+0000 7eff9f400640 1 -- 172.21.15.37:0/3870087429 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa000aca0 con 0x7effa806f2e0 2024-05-30T06:42:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.519+0000 7eff9f400640 1 -- 172.21.15.37:0/3870087429 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa0012620 con 0x7effa806f2e0 2024-05-30T06:42:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.519+0000 7effae200640 1 -- 172.21.15.37:0/3870087429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa815c430 con 0x7effa806f2e0 2024-05-30T06:42:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.519+0000 7effae200640 1 -- 172.21.15.37:0/3870087429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa815c9f0 con 0x7effa806f2e0 2024-05-30T06:42:19.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.523+0000 7effae200640 1 -- 172.21.15.37:0/3870087429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa8068bc0 con 0x7effa806f2e0 2024-05-30T06:42:19.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.523+0000 7eff9f400640 1 -- 172.21.15.37:0/3870087429 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7effa001a070 con 0x7effa806f2e0 2024-05-30T06:42:19.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.523+0000 7eff9f400640 1 --2- 172.21.15.37:0/3870087429 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff88068450 0x7eff8806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:19.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.523+0000 7eff9f400640 1 -- 172.21.15.37:0/3870087429 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7effa0086740 con 0x7effa806f2e0 2024-05-30T06:42:19.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.527+0000 7effa7400640 1 --2- 172.21.15.37:0/3870087429 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff88068450 0x7eff8806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:19.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.527+0000 7effa7400640 1 --2- 172.21.15.37:0/3870087429 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff88068450 0x7eff8806a910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7effa8155ee0 tx=0x7eff98009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:19.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.527+0000 7eff9f400640 1 -- 172.21.15.37:0/3870087429 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7effa0056720 con 0x7effa806f2e0 2024-05-30T06:42:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.699+0000 7f732e600640 1 -- 172.21.15.37:0/3212629689 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f732815b390 con 0x7f7328145040 2024-05-30T06:42:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.699+0000 7f7324c00640 1 -- 172.21.15.37:0/3212629689 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7314055c90 con 0x7f7328145040 2024-05-30T06:42:19.700 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-05-30T06:42:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.703+0000 7f732e600640 1 -- 172.21.15.37:0/3212629689 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7308068480 msgr2=0x7f730806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.703+0000 7f732e600640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7308068480 0x7f730806a940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73200ae000 tx=0x7f73200a7070 comp rx=0 tx=0).stop 2024-05-30T06:42:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.703+0000 7f732e600640 1 -- 172.21.15.37:0/3212629689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7328145040 msgr2=0x7f73280b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.703+0000 7f732e600640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7328145040 0x7f73280b1480 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f731400c390 tx=0x7f731400c850 comp rx=0 tx=0).stop 2024-05-30T06:42:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.703+0000 7f732e600640 1 -- 172.21.15.37:0/3212629689 shutdown_connections 2024-05-30T06:42:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.703+0000 7f732e600640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7328145040 0x7f73280b1480 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.703+0000 7f732e600640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73280b5510 0x7f732814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.703+0000 7f732e600640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7308068480 0x7f730806a940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.703+0000 7f732e600640 1 --2- 172.21.15.37:0/3212629689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f732806c070 0x7f7328143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.703+0000 7f732e600640 1 -- 172.21.15.37:0/3212629689 >> 172.21.15.37:0/3212629689 conn(0x7f7328067b60 msgr2=0x7f73281531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.703+0000 7f732e600640 1 -- 172.21.15.37:0/3212629689 shutdown_connections 2024-05-30T06:42:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.707+0000 7f732e600640 1 -- 172.21.15.37:0/3212629689 wait complete. 2024-05-30T06:42:19.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-05-30T06:42:19.738 DEBUG:teuthology.parallel:result is None 2024-05-30T06:42:19.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.771+0000 7f86e2a00640 1 -- 172.21.15.37:0/3075714247 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f86d40057f0 con 0x7f86d403eca0 2024-05-30T06:42:19.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.771+0000 7f86d9600640 1 -- 172.21.15.37:0/3075714247 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f86d0016150 con 0x7f86d403eca0 2024-05-30T06:42:19.772 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-05-30T06:42:19.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.775+0000 7f86e2a00640 1 -- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f86bc0683b0 msgr2=0x7f86bc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.775+0000 7f86e2a00640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f86bc0683b0 0x7f86bc06a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f86d4001030 tx=0x7f86c8008040 comp rx=0 tx=0).stop 2024-05-30T06:42:19.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.775+0000 7f86e2a00640 1 -- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86d403eca0 msgr2=0x7f86d418a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.775+0000 7f86e2a00640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86d403eca0 0x7f86d418a610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f86d00ae040 tx=0x7f86d0019300 comp rx=0 tx=0).stop 2024-05-30T06:42:19.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.775+0000 7f86e2a00640 1 -- 172.21.15.37:0/3075714247 shutdown_connections 2024-05-30T06:42:19.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.775+0000 7f86e2a00640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d4054340 0x7f86d4052ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.775+0000 7f86e2a00640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86d4053f60 0x7f86d4052590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.775+0000 7f86e2a00640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f86bc0683b0 0x7f86bc06a870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.775+0000 7f86e2a00640 1 --2- 172.21.15.37:0/3075714247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86d403eca0 0x7f86d418a610 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.775+0000 7f86e2a00640 1 -- 172.21.15.37:0/3075714247 >> 172.21.15.37:0/3075714247 conn(0x7f86d403aa40 msgr2=0x7f86d403cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.775+0000 7f86e2a00640 1 -- 172.21.15.37:0/3075714247 shutdown_connections 2024-05-30T06:42:19.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.775+0000 7f86e2a00640 1 -- 172.21.15.37:0/3075714247 wait complete. 2024-05-30T06:42:19.795 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-05-30T06:42:19.795 DEBUG:teuthology.parallel:result is None 2024-05-30T06:42:19.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.799+0000 7fc515e00640 1 -- 172.21.15.37:0/3148637024 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc4e8005860 con 0x7fc5100ce510 2024-05-30T06:42:19.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.799+0000 7fc50cc00640 1 -- 172.21.15.37:0/3148637024 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc5000160f0 con 0x7fc5100ce510 2024-05-30T06:42:19.800 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-05-30T06:42:19.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.799+0000 7fe21ea00640 1 -- 172.21.15.37:0/1548134393 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe21806d260 con 0x7fe2180ceec0 2024-05-30T06:42:19.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fe20fe00640 1 -- 172.21.15.37:0/1548134393 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe21005a960 con 0x7fe2180ceec0 2024-05-30T06:42:19.801 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-05-30T06:42:19.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fc515e00640 1 -- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc4ec068400 msgr2=0x7fc4ec06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fc515e00640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc4ec068400 0x7fc4ec06a8c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc510169900 tx=0x7fc4f80090e0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fc515e00640 1 -- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5100ce510 msgr2=0x7fc510156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fc515e00640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5100ce510 0x7fc510156490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc510073000 tx=0x7fc5000192a0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fc515e00640 1 -- 172.21.15.37:0/3148637024 shutdown_connections 2024-05-30T06:42:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fc515e00640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc4ec068400 0x7fc4ec06a8c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fc515e00640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51014e820 0x7fc510152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fc515e00640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5100ce510 0x7fc510156490 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fc515e00640 1 --2- 172.21.15.37:0/3148637024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51009afa0 0x7fc5101551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fc515e00640 1 -- 172.21.15.37:0/3148637024 >> 172.21.15.37:0/3148637024 conn(0x7fc5100cef80 msgr2=0x7fc510137730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fc515e00640 1 -- 172.21.15.37:0/3148637024 shutdown_connections 2024-05-30T06:42:19.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fc515e00640 1 -- 172.21.15.37:0/3148637024 wait complete. 2024-05-30T06:42:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fe21ea00640 1 -- 172.21.15.37:0/1548134393 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1f8068480 msgr2=0x7fe1f806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fe21ea00640 1 --2- 172.21.15.37:0/1548134393 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1f8068480 0x7fe1f806a940 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe204000f70 tx=0x7fe2040079c0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fe21ea00640 1 -- 172.21.15.37:0/1548134393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2180ceec0 msgr2=0x7fe21815afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fe21ea00640 1 --2- 172.21.15.37:0/1548134393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2180ceec0 0x7fe21815afa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe21000ba50 tx=0x7fe21000bf10 comp rx=0 tx=0).stop 2024-05-30T06:42:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fe21ea00640 1 -- 172.21.15.37:0/1548134393 shutdown_connections 2024-05-30T06:42:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fe21ea00640 1 --2- 172.21.15.37:0/1548134393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe21815e2b0 0x7fe2181554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fe21ea00640 1 --2- 172.21.15.37:0/1548134393 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1f8068480 0x7fe1f806a940 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fe21ea00640 1 --2- 172.21.15.37:0/1548134393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2180ceec0 0x7fe21815afa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fe21ea00640 1 --2- 172.21.15.37:0/1548134393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2180ce820 0x7fe2180b7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.803+0000 7fe21ea00640 1 -- 172.21.15.37:0/1548134393 >> 172.21.15.37:0/1548134393 conn(0x7fe2180d2640 msgr2=0x7fe2180d2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.807+0000 7fe21ea00640 1 -- 172.21.15.37:0/1548134393 shutdown_connections 2024-05-30T06:42:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.807+0000 7fe21ea00640 1 -- 172.21.15.37:0/1548134393 wait complete. 2024-05-30T06:42:19.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.811+0000 7f427de00640 1 -- 172.21.15.37:0/1330832866 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4250005590 con 0x7f425c0039c0 2024-05-30T06:42:19.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.811+0000 7f4274c00640 1 -- 172.21.15.37:0/1330832866 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4264120070 con 0x7f425c0039c0 2024-05-30T06:42:19.810 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-05-30T06:42:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.811+0000 7f4e46e00640 1 -- 172.21.15.37:0/529012223 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4e400c5ce0 con 0x7f4e4015c5a0 2024-05-30T06:42:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.811+0000 7f4e3d600640 1 -- 172.21.15.37:0/529012223 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e2c016130 con 0x7f4e4015c5a0 2024-05-30T06:42:19.812 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2024-05-30T06:42:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f427de00640 1 -- 172.21.15.37:0/1330832866 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4258068480 msgr2=0x7f425806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f427de00640 1 --2- 172.21.15.37:0/1330832866 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4258068480 0x7f425806a940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42780af740 tx=0x7f4270010040 comp rx=0 tx=0).stop 2024-05-30T06:42:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f427de00640 1 -- 172.21.15.37:0/1330832866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f425c0039c0 msgr2=0x7f4278152f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f427de00640 1 --2- 172.21.15.37:0/1330832866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f425c0039c0 0x7f4278152f70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f42640ac000 tx=0x7f425c005840 comp rx=0 tx=0).stop 2024-05-30T06:42:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f427de00640 1 -- 172.21.15.37:0/1330832866 shutdown_connections 2024-05-30T06:42:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f427de00640 1 --2- 172.21.15.37:0/1330832866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4278154d90 0x7f4278155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f427de00640 1 --2- 172.21.15.37:0/1330832866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f427815bf60 0x7f427815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f427de00640 1 --2- 172.21.15.37:0/1330832866 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4258068480 0x7f425806a940 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f427de00640 1 --2- 172.21.15.37:0/1330832866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f425c0039c0 0x7f4278152f70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f427de00640 1 -- 172.21.15.37:0/1330832866 >> 172.21.15.37:0/1330832866 conn(0x7f4278067b60 msgr2=0x7f42780b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f4e46e00640 1 -- 172.21.15.37:0/529012223 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e200683d0 msgr2=0x7f4e2006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f4e46e00640 1 --2- 172.21.15.37:0/529012223 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e200683d0 0x7f4e2006a890 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e401582f0 tx=0x7f4e34009520 comp rx=0 tx=0).stop 2024-05-30T06:42:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f4e46e00640 1 -- 172.21.15.37:0/529012223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e4015c5a0 msgr2=0x7f4e400c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f4e46e00640 1 --2- 172.21.15.37:0/529012223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e4015c5a0 0x7f4e400c8660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c01abf0 tx=0x7f4e2c01ad80 comp rx=0 tx=0).stop 2024-05-30T06:42:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f427de00640 1 -- 172.21.15.37:0/1330832866 shutdown_connections 2024-05-30T06:42:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f4e46e00640 1 -- 172.21.15.37:0/529012223 shutdown_connections 2024-05-30T06:42:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f4e46e00640 1 --2- 172.21.15.37:0/529012223 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e40160210 0x7f4e401576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f4e46e00640 1 --2- 172.21.15.37:0/529012223 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e200683d0 0x7f4e2006a890 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f4e46e00640 1 --2- 172.21.15.37:0/529012223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e4015c5a0 0x7f4e400c8660 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f4e46e00640 1 --2- 172.21.15.37:0/529012223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e400d0980 0x7f4e4015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f4e46e00640 1 -- 172.21.15.37:0/529012223 >> 172.21.15.37:0/529012223 conn(0x7f4e400d2430 msgr2=0x7f4e400b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f427de00640 1 -- 172.21.15.37:0/1330832866 wait complete. 2024-05-30T06:42:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f4e46e00640 1 -- 172.21.15.37:0/529012223 shutdown_connections 2024-05-30T06:42:19.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.815+0000 7f4e46e00640 1 -- 172.21.15.37:0/529012223 wait complete. 2024-05-30T06:42:19.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-05-30T06:42:19.842 DEBUG:teuthology.parallel:result is None 2024-05-30T06:42:19.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-05-30T06:42:19.843 DEBUG:teuthology.parallel:result is None 2024-05-30T06:42:19.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-05-30T06:42:19.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.843+0000 7effae200640 1 -- 172.21.15.37:0/3870087429 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7effa8074fd0 con 0x7effa806f2e0 2024-05-30T06:42:19.844 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2024-05-30T06:42:19.844 DEBUG:teuthology.parallel:result is None 2024-05-30T06:42:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.843+0000 7eff9f400640 1 -- 172.21.15.37:0/3870087429 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7effa005aa20 con 0x7effa806f2e0 2024-05-30T06:42:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.847+0000 7effae200640 1 -- 172.21.15.37:0/3870087429 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff88068450 msgr2=0x7eff8806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.847+0000 7effae200640 1 --2- 172.21.15.37:0/3870087429 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff88068450 0x7eff8806a910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7effa8155ee0 tx=0x7eff98009060 comp rx=0 tx=0).stop 2024-05-30T06:42:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.847+0000 7effae200640 1 -- 172.21.15.37:0/3870087429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effa806f2e0 msgr2=0x7effa815ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.847+0000 7effae200640 1 --2- 172.21.15.37:0/3870087429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effa806f2e0 0x7effa815ba00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7effa000cb40 tx=0x7effa000a060 comp rx=0 tx=0).stop 2024-05-30T06:42:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.847+0000 7effae200640 1 -- 172.21.15.37:0/3870087429 shutdown_connections 2024-05-30T06:42:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.847+0000 7effae200640 1 --2- 172.21.15.37:0/3870087429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa8072ed0 0x7effa8144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.847+0000 7effae200640 1 --2- 172.21.15.37:0/3870087429 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff88068450 0x7eff8806a910 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.847+0000 7effae200640 1 --2- 172.21.15.37:0/3870087429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effa806f2e0 0x7effa815ba00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.847+0000 7effae200640 1 --2- 172.21.15.37:0/3870087429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effa806df50 0x7effa81fb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.847+0000 7effae200640 1 -- 172.21.15.37:0/3870087429 >> 172.21.15.37:0/3870087429 conn(0x7effa80b23c0 msgr2=0x7effa80753b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.847+0000 7effae200640 1 -- 172.21.15.37:0/3870087429 shutdown_connections 2024-05-30T06:42:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.847+0000 7effae200640 1 -- 172.21.15.37:0/3870087429 wait complete. 2024-05-30T06:42:19.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-05-30T06:42:19.847 DEBUG:teuthology.parallel:result is None 2024-05-30T06:42:19.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.851+0000 7f689ee00640 1 -- 172.21.15.37:0/1788275918 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f689815a330 con 0x7f6898072510 2024-05-30T06:42:19.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.851+0000 7f6895600640 1 -- 172.21.15.37:0/1788275918 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f689815a330 con 0x7f6898072510 2024-05-30T06:42:19.851 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2024-05-30T06:42:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.855+0000 7f689ee00640 1 -- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68780683d0 msgr2=0x7f687806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.855+0000 7f689ee00640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68780683d0 0x7f687806a890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f68981f6710 tx=0x7f6884014040 comp rx=0 tx=0).stop 2024-05-30T06:42:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.855+0000 7f689ee00640 1 -- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6898072510 msgr2=0x7f6898159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.855+0000 7f689ee00640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6898072510 0x7f6898159000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f688c0b2040 tx=0x7f688c01b5c0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.855+0000 7f689ee00640 1 -- 172.21.15.37:0/1788275918 shutdown_connections 2024-05-30T06:42:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.855+0000 7f689ee00640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6898151c60 0x7f68981623e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.855+0000 7f689ee00640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68980b5510 0x7f6898161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.855+0000 7f689ee00640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68780683d0 0x7f687806a890 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.855+0000 7f689ee00640 1 --2- 172.21.15.37:0/1788275918 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6898072510 0x7f6898159000 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.855+0000 7f689ee00640 1 -- 172.21.15.37:0/1788275918 >> 172.21.15.37:0/1788275918 conn(0x7f6898067b60 msgr2=0x7f68981536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.855+0000 7f689ee00640 1 -- 172.21.15.37:0/1788275918 shutdown_connections 2024-05-30T06:42:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:19.855+0000 7f689ee00640 1 -- 172.21.15.37:0/1788275918 wait complete. 2024-05-30T06:42:19.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-05-30T06:42:19.868 DEBUG:teuthology.parallel:result is None 2024-05-30T06:42:19.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-05-30T06:42:19.874 DEBUG:teuthology.parallel:result is None 2024-05-30T06:42:19.874 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T06:42:19.875 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:42:20.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.059+0000 7fe8f5000640 1 Processor -- start 2024-05-30T06:42:20.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.059+0000 7fe8f5000640 1 -- start start 2024-05-30T06:42:20.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8f5000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe8f015e8d0 0x7fe8f00d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8f5000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8f00d16d0 0x7fe8f00b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8f5000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f00d24f0 con 0x7fe8f00cfea0 2024-05-30T06:42:20.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8f5000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f00d22a0 con 0x7fe8f015e8d0 2024-05-30T06:42:20.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8f5000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f00d27d0 con 0x7fe8f00d16d0 2024-05-30T06:42:20.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8e6a00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fe8f00cfea0 0x7fe8f00d0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47306/0 (socket says 172.21.15.37:47306) 2024-05-30T06:42:20.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8e6a00640 1 -- 172.21.15.37:0/1077155534 learned_addr learned my addr 172.21.15.37:0/1077155534 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:20.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8efe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8f00d16d0 0x7fe8f00b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8ef400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe8f015e8d0 0x7fe8f00d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8eea00640 1 -- 172.21.15.37:0/1077155534 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883750965 0 0) 0x7fe8f00d24f0 con 0x7fe8f00cfea0 2024-05-30T06:42:20.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8eea00640 1 -- 172.21.15.37:0/1077155534 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8d4003530 con 0x7fe8f00cfea0 2024-05-30T06:42:20.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8efe00640 1 -- 172.21.15.37:0/1077155534 >> v2:172.21.15.105:3300/0 conn(0x7fe8f015e8d0 msgr2=0x7fe8f00d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:20.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8efe00640 1 --2- 172.21.15.37:0/1077155534 >> v2:172.21.15.105:3300/0 conn(0x7fe8f015e8d0 0x7fe8f00d32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8efe00640 1 -- 172.21.15.37:0/1077155534 >> v1:172.21.15.105:6789/0 conn(0x7fe8f00cfea0 legacy=0x7fe8f00d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8efe00640 1 -- 172.21.15.37:0/1077155534 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f00d2ab0 con 0x7fe8f00d16d0 2024-05-30T06:42:20.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.063+0000 7fe8ef400640 1 --2- 172.21.15.37:0/1077155534 >> v2:172.21.15.105:3300/0 conn(0x7fe8f015e8d0 0x7fe8f00d32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8efe00640 1 --2- 172.21.15.37:0/1077155534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8f00d16d0 0x7fe8f00b7520 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80097c0 tx=0x7fe8e801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3682f450c50adc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8eea00640 1 -- 172.21.15.37:0/1077155534 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80b0070 con 0x7fe8f00d16d0 2024-05-30T06:42:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8eea00640 1 -- 172.21.15.37:0/1077155534 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e80ab600 con 0x7fe8f00d16d0 2024-05-30T06:42:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8eea00640 1 -- 172.21.15.37:0/1077155534 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80ab9d0 con 0x7fe8f00d16d0 2024-05-30T06:42:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8f5000640 1 -- 172.21.15.37:0/1077155534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8f00d16d0 msgr2=0x7fe8f00b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8f5000640 1 --2- 172.21.15.37:0/1077155534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8f00d16d0 0x7fe8f00b7520 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80097c0 tx=0x7fe8e801c3e0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8f5000640 1 -- 172.21.15.37:0/1077155534 shutdown_connections 2024-05-30T06:42:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8f5000640 1 --2- 172.21.15.37:0/1077155534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8f00d16d0 0x7fe8f00b7520 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8f5000640 1 --2- 172.21.15.37:0/1077155534 >> v2:172.21.15.105:3300/0 conn(0x7fe8f015e8d0 0x7fe8f00d32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8f5000640 1 -- 172.21.15.37:0/1077155534 >> 172.21.15.37:0/1077155534 conn(0x7fe8f008bff0 msgr2=0x7fe8f00d46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8f5000640 1 -- 172.21.15.37:0/1077155534 shutdown_connections 2024-05-30T06:42:20.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8f5000640 1 -- 172.21.15.37:0/1077155534 wait complete. 2024-05-30T06:42:20.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8f5000640 1 Processor -- start 2024-05-30T06:42:20.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.067+0000 7fe8f5000640 1 -- start start 2024-05-30T06:42:20.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8f5000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8f00cfea0 0x7fe8f00c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8f5000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8f00d16d0 0x7fe8f015f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8f5000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8f015e8d0 0x7fe8f015ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8f5000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f016b7f0 con 0x7fe8f00d16d0 2024-05-30T06:42:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8f5000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f00d55d0 con 0x7fe8f00cfea0 2024-05-30T06:42:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8f5000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f016b970 con 0x7fe8f015e8d0 2024-05-30T06:42:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8e6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8f00d16d0 0x7fe8f015f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8e6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8f00d16d0 0x7fe8f015f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34098/0 (socket says 172.21.15.37:34098) 2024-05-30T06:42:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8e6a00640 1 -- 172.21.15.37:0/3364307481 learned_addr learned my addr 172.21.15.37:0/3364307481 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:20.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8efe00640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8f015e8d0 0x7fe8f015ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8ef400640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8f00cfea0 0x7fe8f00c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8e6a00640 1 -- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8f015e8d0 msgr2=0x7fe8f015ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8e6a00640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8f015e8d0 0x7fe8f015ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8e6a00640 1 -- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8f00cfea0 msgr2=0x7fe8f00c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8e6a00640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8f00cfea0 0x7fe8f00c8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8e6a00640 1 -- 172.21.15.37:0/3364307481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f0161dd0 con 0x7fe8f00d16d0 2024-05-30T06:42:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8efe00640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8f015e8d0 0x7fe8f015ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8e6a00640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8f00d16d0 0x7fe8f015f9e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800cbb0 tx=0x7fe8d800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8e7e00640 1 -- 172.21.15.37:0/3364307481 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8017070 con 0x7fe8f00d16d0 2024-05-30T06:42:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8e7e00640 1 -- 172.21.15.37:0/3364307481 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d800ad60 con 0x7fe8f00d16d0 2024-05-30T06:42:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8e7e00640 1 -- 172.21.15.37:0/3364307481 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8012640 con 0x7fe8f00d16d0 2024-05-30T06:42:20.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8f5000640 1 -- 172.21.15.37:0/3364307481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f00cad40 con 0x7fe8f00d16d0 2024-05-30T06:42:20.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8f5000640 1 -- 172.21.15.37:0/3364307481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f00cb300 con 0x7fe8f00d16d0 2024-05-30T06:42:20.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8f5000640 1 -- 172.21.15.37:0/3364307481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f015f6c0 con 0x7fe8f00d16d0 2024-05-30T06:42:20.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.071+0000 7fe8e7e00640 1 -- 172.21.15.37:0/3364307481 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe8d801a070 con 0x7fe8f00d16d0 2024-05-30T06:42:20.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.075+0000 7fe8e7e00640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe8cc068380 0x7fe8cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.075+0000 7fe8e7e00640 1 -- 172.21.15.37:0/3364307481 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe8d8086880 con 0x7fe8f00d16d0 2024-05-30T06:42:20.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.075+0000 7fe8ef400640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe8cc068380 0x7fe8cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.075+0000 7fe8ef400640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe8cc068380 0x7fe8cc06a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe8f015a3b0 tx=0x7fe8e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:20.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.079+0000 7fe8e7e00640 1 -- 172.21.15.37:0/3364307481 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe8f015f6c0 con 0x7fe8f00d16d0 2024-05-30T06:42:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.239+0000 7fe8f5000640 1 -- 172.21.15.37:0/3364307481 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe8f0068ab0 con 0x7fe8cc068380 2024-05-30T06:42:20.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.247+0000 7fe8e7e00640 1 -- 172.21.15.37:0/3364307481 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fe8f0068ab0 con 0x7fe8cc068380 2024-05-30T06:42:20.249 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:20.250 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:42:20.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.251+0000 7fe8f5000640 1 -- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe8cc068380 msgr2=0x7fe8cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.251+0000 7fe8f5000640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe8cc068380 0x7fe8cc06a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe8f015a3b0 tx=0x7fe8e0008040 comp rx=0 tx=0).stop 2024-05-30T06:42:20.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.251+0000 7fe8f5000640 1 -- 172.21.15.37:0/3364307481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8f00d16d0 msgr2=0x7fe8f015f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.251+0000 7fe8f5000640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8f00d16d0 0x7fe8f015f9e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800cbb0 tx=0x7fe8d800a430 comp rx=0 tx=0).stop 2024-05-30T06:42:20.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.251+0000 7fe8f5000640 1 -- 172.21.15.37:0/3364307481 shutdown_connections 2024-05-30T06:42:20.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.251+0000 7fe8f5000640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8f015e8d0 0x7fe8f015ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.251+0000 7fe8f5000640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8f00d16d0 0x7fe8f015f9e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.251+0000 7fe8f5000640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe8cc068380 0x7fe8cc06a840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.251+0000 7fe8f5000640 1 --2- 172.21.15.37:0/3364307481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8f00cfea0 0x7fe8f00c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.251+0000 7fe8f5000640 1 -- 172.21.15.37:0/3364307481 >> 172.21.15.37:0/3364307481 conn(0x7fe8f008bff0 msgr2=0x7fe8f00b94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:20.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.251+0000 7fe8f5000640 1 -- 172.21.15.37:0/3364307481 shutdown_connections 2024-05-30T06:42:20.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.251+0000 7fe8f5000640 1 -- 172.21.15.37:0/3364307481 wait complete. 2024-05-30T06:42:20.270 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-30T06:42:18.641887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001738"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388642+0000","last_change":"2024-05-30T06:42:11.435488+0000","last_active":"2024-05-30T06:42:13.388642+0000","last_peered":"2024-05-30T06:42:13.388642+0000","last_clean":"2024-05-30T06:42:13.388642+0000","last_became_active":"2024-05-30T06:42:11.435224+0000","last_became_peered":"2024-05-30T06:42:11.435224+0000","last_unstale":"2024-05-30T06:42:13.388642+0000","last_undegraded":"2024-05-30T06:42:13.388642+0000","last_fullsized":"2024-05-30T06:42:13.388642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:02.703778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420451+0000","last_change":"2024-05-30T06:42:11.432162+0000","last_active":"2024-05-30T06:42:12.420451+0000","last_peered":"2024-05-30T06:42:12.420451+0000","last_clean":"2024-05-30T06:42:12.420451+0000","last_became_active":"2024-05-30T06:42:11.431837+0000","last_became_peered":"2024-05-30T06:42:11.431837+0000","last_unstale":"2024-05-30T06:42:12.420451+0000","last_undegraded":"2024-05-30T06:42:12.420451+0000","last_fullsized":"2024-05-30T06:42:12.420451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583246+0000","last_change":"2024-05-30T06:42:11.444273+0000","last_active":"2024-05-30T06:42:13.583246+0000","last_peered":"2024-05-30T06:42:13.583246+0000","last_clean":"2024-05-30T06:42:13.583246+0000","last_became_active":"2024-05-30T06:42:11.443918+0000","last_became_peered":"2024-05-30T06:42:11.443918+0000","last_unstale":"2024-05-30T06:42:13.583246+0000","last_undegraded":"2024-05-30T06:42:13.583246+0000","last_fullsized":"2024-05-30T06:42:13.583246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418697+0000","last_change":"2024-05-30T06:42:11.434052+0000","last_active":"2024-05-30T06:42:12.418697+0000","last_peered":"2024-05-30T06:42:12.418697+0000","last_clean":"2024-05-30T06:42:12.418697+0000","last_became_active":"2024-05-30T06:42:11.433700+0000","last_became_peered":"2024-05-30T06:42:11.433700+0000","last_unstale":"2024-05-30T06:42:12.418697+0000","last_undegraded":"2024-05-30T06:42:12.418697+0000","last_fullsized":"2024-05-30T06:42:12.418697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:04:58.409141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388154+0000","last_change":"2024-05-30T06:42:11.440147+0000","last_active":"2024-05-30T06:42:13.388154+0000","last_peered":"2024-05-30T06:42:13.388154+0000","last_clean":"2024-05-30T06:42:13.388154+0000","last_became_active":"2024-05-30T06:42:11.439811+0000","last_became_peered":"2024-05-30T06:42:11.439811+0000","last_unstale":"2024-05-30T06:42:13.388154+0000","last_undegraded":"2024-05-30T06:42:13.388154+0000","last_fullsized":"2024-05-30T06:42:13.388154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:05:31.913179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418707+0000","last_change":"2024-05-30T06:42:11.434320+0000","last_active":"2024-05-30T06:42:12.418707+0000","last_peered":"2024-05-30T06:42:12.418707+0000","last_clean":"2024-05-30T06:42:12.418707+0000","last_became_active":"2024-05-30T06:42:11.433756+0000","last_became_peered":"2024-05-30T06:42:11.433756+0000","last_unstale":"2024-05-30T06:42:12.418707+0000","last_undegraded":"2024-05-30T06:42:12.418707+0000","last_fullsized":"2024-05-30T06:42:12.418707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387999+0000","last_change":"2024-05-30T06:42:11.433123+0000","last_active":"2024-05-30T06:42:13.387999+0000","last_peered":"2024-05-30T06:42:13.387999+0000","last_clean":"2024-05-30T06:42:13.387999+0000","last_became_active":"2024-05-30T06:42:11.432861+0000","last_became_peered":"2024-05-30T06:42:11.432861+0000","last_unstale":"2024-05-30T06:42:13.387999+0000","last_undegraded":"2024-05-30T06:42:13.387999+0000","last_fullsized":"2024-05-30T06:42:13.387999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:12.472477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771210+0000","last_change":"2024-05-30T06:42:11.440463+0000","last_active":"2024-05-30T06:42:12.771210+0000","last_peered":"2024-05-30T06:42:12.771210+0000","last_clean":"2024-05-30T06:42:12.771210+0000","last_became_active":"2024-05-30T06:42:11.440179+0000","last_became_peered":"2024-05-30T06:42:11.440179+0000","last_unstale":"2024-05-30T06:42:12.771210+0000","last_undegraded":"2024-05-30T06:42:12.771210+0000","last_fullsized":"2024-05-30T06:42:12.771210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388697+0000","last_change":"2024-05-30T06:42:11.438364+0000","last_active":"2024-05-30T06:42:13.388697+0000","last_peered":"2024-05-30T06:42:13.388697+0000","last_clean":"2024-05-30T06:42:13.388697+0000","last_became_active":"2024-05-30T06:42:11.438010+0000","last_became_peered":"2024-05-30T06:42:11.438010+0000","last_unstale":"2024-05-30T06:42:13.388697+0000","last_undegraded":"2024-05-30T06:42:13.388697+0000","last_fullsized":"2024-05-30T06:42:13.388697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:44:42.856118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462336+0000","last_change":"2024-05-30T06:42:11.436077+0000","last_active":"2024-05-30T06:42:12.462336+0000","last_peered":"2024-05-30T06:42:12.462336+0000","last_clean":"2024-05-30T06:42:12.462336+0000","last_became_active":"2024-05-30T06:42:11.435686+0000","last_became_peered":"2024-05-30T06:42:11.435686+0000","last_unstale":"2024-05-30T06:42:12.462336+0000","last_undegraded":"2024-05-30T06:42:12.462336+0000","last_fullsized":"2024-05-30T06:42:12.462336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462200+0000","last_change":"2024-05-30T06:42:11.441401+0000","last_active":"2024-05-30T06:42:12.462200+0000","last_peered":"2024-05-30T06:42:12.462200+0000","last_clean":"2024-05-30T06:42:12.462200+0000","last_became_active":"2024-05-30T06:42:11.440895+0000","last_became_peered":"2024-05-30T06:42:11.440895+0000","last_unstale":"2024-05-30T06:42:12.462200+0000","last_undegraded":"2024-05-30T06:42:12.462200+0000","last_fullsized":"2024-05-30T06:42:12.462200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583872+0000","last_change":"2024-05-30T06:42:11.444435+0000","last_active":"2024-05-30T06:42:13.583872+0000","last_peered":"2024-05-30T06:42:13.583872+0000","last_clean":"2024-05-30T06:42:13.583872+0000","last_became_active":"2024-05-30T06:42:11.444162+0000","last_became_peered":"2024-05-30T06:42:11.444162+0000","last_unstale":"2024-05-30T06:42:13.583872+0000","last_undegraded":"2024-05-30T06:42:13.583872+0000","last_fullsized":"2024-05-30T06:42:13.583872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:18:26.795557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771470+0000","last_change":"2024-05-30T06:42:11.430118+0000","last_active":"2024-05-30T06:42:12.771470+0000","last_peered":"2024-05-30T06:42:12.771470+0000","last_clean":"2024-05-30T06:42:12.771470+0000","last_became_active":"2024-05-30T06:42:11.429821+0000","last_became_peered":"2024-05-30T06:42:11.429821+0000","last_unstale":"2024-05-30T06:42:12.771470+0000","last_undegraded":"2024-05-30T06:42:12.771470+0000","last_fullsized":"2024-05-30T06:42:12.771470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:16.106604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.582964+0000","last_change":"2024-05-30T06:42:11.426742+0000","last_active":"2024-05-30T06:42:13.582964+0000","last_peered":"2024-05-30T06:42:13.582964+0000","last_clean":"2024-05-30T06:42:13.582964+0000","last_became_active":"2024-05-30T06:42:11.426182+0000","last_became_peered":"2024-05-30T06:42:11.426182+0000","last_unstale":"2024-05-30T06:42:13.582964+0000","last_undegraded":"2024-05-30T06:42:13.582964+0000","last_fullsized":"2024-05-30T06:42:13.582964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:07:16.079488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420135+0000","last_change":"2024-05-30T06:42:11.452976+0000","last_active":"2024-05-30T06:42:12.420135+0000","last_peered":"2024-05-30T06:42:12.420135+0000","last_clean":"2024-05-30T06:42:12.420135+0000","last_became_active":"2024-05-30T06:42:11.452525+0000","last_became_peered":"2024-05-30T06:42:11.452525+0000","last_unstale":"2024-05-30T06:42:12.420135+0000","last_undegraded":"2024-05-30T06:42:12.420135+0000","last_fullsized":"2024-05-30T06:42:12.420135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418654+0000","last_change":"2024-05-30T06:42:11.437421+0000","last_active":"2024-05-30T06:42:12.418654+0000","last_peered":"2024-05-30T06:42:12.418654+0000","last_clean":"2024-05-30T06:42:12.418654+0000","last_became_active":"2024-05-30T06:42:11.432053+0000","last_became_peered":"2024-05-30T06:42:11.432053+0000","last_unstale":"2024-05-30T06:42:12.418654+0000","last_undegraded":"2024-05-30T06:42:12.418654+0000","last_fullsized":"2024-05-30T06:42:12.418654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:16.106604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419366+0000","last_change":"2024-05-30T06:42:11.443729+0000","last_active":"2024-05-30T06:42:12.419366+0000","last_peered":"2024-05-30T06:42:12.419366+0000","last_clean":"2024-05-30T06:42:12.419366+0000","last_became_active":"2024-05-30T06:42:11.443424+0000","last_became_peered":"2024-05-30T06:42:11.443424+0000","last_unstale":"2024-05-30T06:42:12.419366+0000","last_undegraded":"2024-05-30T06:42:12.419366+0000","last_fullsized":"2024-05-30T06:42:12.419366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:29:42.983707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419530+0000","last_change":"2024-05-30T06:42:11.443761+0000","last_active":"2024-05-30T06:42:12.419530+0000","last_peered":"2024-05-30T06:42:12.419530+0000","last_clean":"2024-05-30T06:42:12.419530+0000","last_became_active":"2024-05-30T06:42:11.443453+0000","last_became_peered":"2024-05-30T06:42:11.443453+0000","last_unstale":"2024-05-30T06:42:12.419530+0000","last_undegraded":"2024-05-30T06:42:12.419530+0000","last_fullsized":"2024-05-30T06:42:12.419530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:51:40.954821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388493+0000","last_change":"2024-05-30T06:42:11.445389+0000","last_active":"2024-05-30T06:42:13.388493+0000","last_peered":"2024-05-30T06:42:13.388493+0000","last_clean":"2024-05-30T06:42:13.388493+0000","last_became_active":"2024-05-30T06:42:11.444984+0000","last_became_peered":"2024-05-30T06:42:11.444984+0000","last_unstale":"2024-05-30T06:42:13.388493+0000","last_undegraded":"2024-05-30T06:42:13.388493+0000","last_fullsized":"2024-05-30T06:42:13.388493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:48:21.800907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462107+0000","last_change":"2024-05-30T06:42:11.453799+0000","last_active":"2024-05-30T06:42:12.462107+0000","last_peered":"2024-05-30T06:42:12.462107+0000","last_clean":"2024-05-30T06:42:12.462107+0000","last_became_active":"2024-05-30T06:42:11.453488+0000","last_became_peered":"2024-05-30T06:42:11.453488+0000","last_unstale":"2024-05-30T06:42:12.462107+0000","last_undegraded":"2024-05-30T06:42:12.462107+0000","last_fullsized":"2024-05-30T06:42:12.462107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583121+0000","last_change":"2024-05-30T06:42:11.428247+0000","last_active":"2024-05-30T06:42:13.583121+0000","last_peered":"2024-05-30T06:42:13.583121+0000","last_clean":"2024-05-30T06:42:13.583121+0000","last_became_active":"2024-05-30T06:42:11.427950+0000","last_became_peered":"2024-05-30T06:42:11.427950+0000","last_unstale":"2024-05-30T06:42:13.583121+0000","last_undegraded":"2024-05-30T06:42:13.583121+0000","last_fullsized":"2024-05-30T06:42:13.583121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:41.693793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418922+0000","last_change":"2024-05-30T06:42:11.434081+0000","last_active":"2024-05-30T06:42:12.418922+0000","last_peered":"2024-05-30T06:42:12.418922+0000","last_clean":"2024-05-30T06:42:12.418922+0000","last_became_active":"2024-05-30T06:42:11.433267+0000","last_became_peered":"2024-05-30T06:42:11.433267+0000","last_unstale":"2024-05-30T06:42:12.418922+0000","last_undegraded":"2024-05-30T06:42:12.418922+0000","last_fullsized":"2024-05-30T06:42:12.418922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:07.193945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771221+0000","last_change":"2024-05-30T06:42:11.445981+0000","last_active":"2024-05-30T06:42:12.771221+0000","last_peered":"2024-05-30T06:42:12.771221+0000","last_clean":"2024-05-30T06:42:12.771221+0000","last_became_active":"2024-05-30T06:42:11.445642+0000","last_became_peered":"2024-05-30T06:42:11.445642+0000","last_unstale":"2024-05-30T06:42:12.771221+0000","last_undegraded":"2024-05-30T06:42:12.771221+0000","last_fullsized":"2024-05-30T06:42:12.771221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418715+0000","last_change":"2024-05-30T06:42:11.434545+0000","last_active":"2024-05-30T06:42:12.418715+0000","last_peered":"2024-05-30T06:42:12.418715+0000","last_clean":"2024-05-30T06:42:12.418715+0000","last_became_active":"2024-05-30T06:42:11.431097+0000","last_became_peered":"2024-05-30T06:42:11.431097+0000","last_unstale":"2024-05-30T06:42:12.418715+0000","last_undegraded":"2024-05-30T06:42:12.418715+0000","last_fullsized":"2024-05-30T06:42:12.418715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:15.413953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771539+0000","last_change":"2024-05-30T06:42:11.454371+0000","last_active":"2024-05-30T06:42:12.771539+0000","last_peered":"2024-05-30T06:42:12.771539+0000","last_clean":"2024-05-30T06:42:12.771539+0000","last_became_active":"2024-05-30T06:42:11.454064+0000","last_became_peered":"2024-05-30T06:42:11.454064+0000","last_unstale":"2024-05-30T06:42:12.771539+0000","last_undegraded":"2024-05-30T06:42:12.771539+0000","last_fullsized":"2024-05-30T06:42:12.771539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:15.413953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462346+0000","last_change":"2024-05-30T06:42:11.439382+0000","last_active":"2024-05-30T06:42:12.462346+0000","last_peered":"2024-05-30T06:42:12.462346+0000","last_clean":"2024-05-30T06:42:12.462346+0000","last_became_active":"2024-05-30T06:42:11.439071+0000","last_became_peered":"2024-05-30T06:42:11.439071+0000","last_unstale":"2024-05-30T06:42:12.462346+0000","last_undegraded":"2024-05-30T06:42:12.462346+0000","last_fullsized":"2024-05-30T06:42:12.462346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420317+0000","last_change":"2024-05-30T06:42:11.436698+0000","last_active":"2024-05-30T06:42:12.420317+0000","last_peered":"2024-05-30T06:42:12.420317+0000","last_clean":"2024-05-30T06:42:12.420317+0000","last_became_active":"2024-05-30T06:42:11.436378+0000","last_became_peered":"2024-05-30T06:42:11.436378+0000","last_unstale":"2024-05-30T06:42:12.420317+0000","last_undegraded":"2024-05-30T06:42:12.420317+0000","last_fullsized":"2024-05-30T06:42:12.420317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771611+0000","last_change":"2024-05-30T06:42:11.454323+0000","last_active":"2024-05-30T06:42:12.771611+0000","last_peered":"2024-05-30T06:42:12.771611+0000","last_clean":"2024-05-30T06:42:12.771611+0000","last_became_active":"2024-05-30T06:42:11.454037+0000","last_became_peered":"2024-05-30T06:42:11.454037+0000","last_unstale":"2024-05-30T06:42:12.771611+0000","last_undegraded":"2024-05-30T06:42:12.771611+0000","last_fullsized":"2024-05-30T06:42:12.771611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:05.695381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583186+0000","last_change":"2024-05-30T06:42:11.432774+0000","last_active":"2024-05-30T06:42:13.583186+0000","last_peered":"2024-05-30T06:42:13.583186+0000","last_clean":"2024-05-30T06:42:13.583186+0000","last_became_active":"2024-05-30T06:42:11.432430+0000","last_became_peered":"2024-05-30T06:42:11.432430+0000","last_unstale":"2024-05-30T06:42:13.583186+0000","last_undegraded":"2024-05-30T06:42:13.583186+0000","last_fullsized":"2024-05-30T06:42:13.583186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418923+0000","last_change":"2024-05-30T06:42:11.435991+0000","last_active":"2024-05-30T06:42:12.418923+0000","last_peered":"2024-05-30T06:42:12.418923+0000","last_clean":"2024-05-30T06:42:12.418923+0000","last_became_active":"2024-05-30T06:42:11.435283+0000","last_became_peered":"2024-05-30T06:42:11.435283+0000","last_unstale":"2024-05-30T06:42:12.418923+0000","last_undegraded":"2024-05-30T06:42:12.418923+0000","last_fullsized":"2024-05-30T06:42:12.418923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:05:31.913179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419353+0000","last_change":"2024-05-30T06:42:11.445149+0000","last_active":"2024-05-30T06:42:12.419353+0000","last_peered":"2024-05-30T06:42:12.419353+0000","last_clean":"2024-05-30T06:42:12.419353+0000","last_became_active":"2024-05-30T06:42:11.444558+0000","last_became_peered":"2024-05-30T06:42:11.444558+0000","last_unstale":"2024-05-30T06:42:12.419353+0000","last_undegraded":"2024-05-30T06:42:12.419353+0000","last_fullsized":"2024-05-30T06:42:12.419353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:53.737991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461946+0000","last_change":"2024-05-30T06:42:11.432788+0000","last_active":"2024-05-30T06:42:12.461946+0000","last_peered":"2024-05-30T06:42:12.461946+0000","last_clean":"2024-05-30T06:42:12.461946+0000","last_became_active":"2024-05-30T06:42:11.432182+0000","last_became_peered":"2024-05-30T06:42:11.432182+0000","last_unstale":"2024-05-30T06:42:12.461946+0000","last_undegraded":"2024-05-30T06:42:12.461946+0000","last_fullsized":"2024-05-30T06:42:12.461946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:26:07.087132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583756+0000","last_change":"2024-05-30T06:42:11.445205+0000","last_active":"2024-05-30T06:42:13.583756+0000","last_peered":"2024-05-30T06:42:13.583756+0000","last_clean":"2024-05-30T06:42:13.583756+0000","last_became_active":"2024-05-30T06:42:11.444042+0000","last_became_peered":"2024-05-30T06:42:11.444042+0000","last_unstale":"2024-05-30T06:42:13.583756+0000","last_undegraded":"2024-05-30T06:42:13.583756+0000","last_fullsized":"2024-05-30T06:42:13.583756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:44.456016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771622+0000","last_change":"2024-05-30T06:42:10.424421+0000","last_active":"2024-05-30T06:42:12.771622+0000","last_peered":"2024-05-30T06:42:12.771622+0000","last_clean":"2024-05-30T06:42:12.771622+0000","last_became_active":"2024-05-30T06:42:10.423992+0000","last_became_peered":"2024-05-30T06:42:10.423992+0000","last_unstale":"2024-05-30T06:42:12.771622+0000","last_undegraded":"2024-05-30T06:42:12.771622+0000","last_fullsized":"2024-05-30T06:42:12.771622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:12:56.283917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583199+0000","last_change":"2024-05-30T06:42:11.452945+0000","last_active":"2024-05-30T06:42:13.583199+0000","last_peered":"2024-05-30T06:42:13.583199+0000","last_clean":"2024-05-30T06:42:13.583199+0000","last_became_active":"2024-05-30T06:42:11.452548+0000","last_became_peered":"2024-05-30T06:42:11.452548+0000","last_unstale":"2024-05-30T06:42:13.583199+0000","last_undegraded":"2024-05-30T06:42:13.583199+0000","last_fullsized":"2024-05-30T06:42:13.583199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461970+0000","last_change":"2024-05-30T06:42:10.423464+0000","last_active":"2024-05-30T06:42:12.461970+0000","last_peered":"2024-05-30T06:42:12.461970+0000","last_clean":"2024-05-30T06:42:12.461970+0000","last_became_active":"2024-05-30T06:42:10.423111+0000","last_became_peered":"2024-05-30T06:42:10.423111+0000","last_unstale":"2024-05-30T06:42:12.461970+0000","last_undegraded":"2024-05-30T06:42:12.461970+0000","last_fullsized":"2024-05-30T06:42:12.461970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771327+0000","last_change":"2024-05-30T06:42:10.417267+0000","last_active":"2024-05-30T06:42:12.771327+0000","last_peered":"2024-05-30T06:42:12.771327+0000","last_clean":"2024-05-30T06:42:12.771327+0000","last_became_active":"2024-05-30T06:42:10.416996+0000","last_became_peered":"2024-05-30T06:42:10.416996+0000","last_unstale":"2024-05-30T06:42:12.771327+0000","last_undegraded":"2024-05-30T06:42:12.771327+0000","last_fullsized":"2024-05-30T06:42:12.771327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:43:33.658279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771209+0000","last_change":"2024-05-30T06:42:11.431024+0000","last_active":"2024-05-30T06:42:12.771209+0000","last_peered":"2024-05-30T06:42:12.771209+0000","last_clean":"2024-05-30T06:42:12.771209+0000","last_became_active":"2024-05-30T06:42:11.430771+0000","last_became_peered":"2024-05-30T06:42:11.430771+0000","last_unstale":"2024-05-30T06:42:12.771209+0000","last_undegraded":"2024-05-30T06:42:12.771209+0000","last_fullsized":"2024-05-30T06:42:12.771209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418934+0000","last_change":"2024-05-30T06:42:10.421013+0000","last_active":"2024-05-30T06:42:12.418934+0000","last_peered":"2024-05-30T06:42:12.418934+0000","last_clean":"2024-05-30T06:42:12.418934+0000","last_became_active":"2024-05-30T06:42:10.420539+0000","last_became_peered":"2024-05-30T06:42:10.420539+0000","last_unstale":"2024-05-30T06:42:12.418934+0000","last_undegraded":"2024-05-30T06:42:12.418934+0000","last_fullsized":"2024-05-30T06:42:12.418934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:17.465458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420071+0000","last_change":"2024-05-30T06:42:11.434422+0000","last_active":"2024-05-30T06:42:12.420071+0000","last_peered":"2024-05-30T06:42:12.420071+0000","last_clean":"2024-05-30T06:42:12.420071+0000","last_became_active":"2024-05-30T06:42:11.434086+0000","last_became_peered":"2024-05-30T06:42:11.434086+0000","last_unstale":"2024-05-30T06:42:12.420071+0000","last_undegraded":"2024-05-30T06:42:12.420071+0000","last_fullsized":"2024-05-30T06:42:12.420071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:41.693793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462252+0000","last_change":"2024-05-30T06:42:10.425809+0000","last_active":"2024-05-30T06:42:12.462252+0000","last_peered":"2024-05-30T06:42:12.462252+0000","last_clean":"2024-05-30T06:42:12.462252+0000","last_became_active":"2024-05-30T06:42:10.425322+0000","last_became_peered":"2024-05-30T06:42:10.425322+0000","last_unstale":"2024-05-30T06:42:12.462252+0000","last_undegraded":"2024-05-30T06:42:12.462252+0000","last_fullsized":"2024-05-30T06:42:12.462252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419005+0000","last_change":"2024-05-30T06:42:11.440849+0000","last_active":"2024-05-30T06:42:12.419005+0000","last_peered":"2024-05-30T06:42:12.419005+0000","last_clean":"2024-05-30T06:42:12.419005+0000","last_became_active":"2024-05-30T06:42:11.439120+0000","last_became_peered":"2024-05-30T06:42:11.439120+0000","last_unstale":"2024-05-30T06:42:12.419005+0000","last_undegraded":"2024-05-30T06:42:12.419005+0000","last_fullsized":"2024-05-30T06:42:12.419005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:34.897332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419128+0000","last_change":"2024-05-30T06:42:10.416914+0000","last_active":"2024-05-30T06:42:12.419128+0000","last_peered":"2024-05-30T06:42:12.419128+0000","last_clean":"2024-05-30T06:42:12.419128+0000","last_became_active":"2024-05-30T06:42:10.416544+0000","last_became_peered":"2024-05-30T06:42:10.416544+0000","last_unstale":"2024-05-30T06:42:12.419128+0000","last_undegraded":"2024-05-30T06:42:12.419128+0000","last_fullsized":"2024-05-30T06:42:12.419128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583510+0000","last_change":"2024-05-30T06:42:11.432338+0000","last_active":"2024-05-30T06:42:13.583510+0000","last_peered":"2024-05-30T06:42:13.583510+0000","last_clean":"2024-05-30T06:42:13.583510+0000","last_became_active":"2024-05-30T06:42:11.431974+0000","last_became_peered":"2024-05-30T06:42:11.431974+0000","last_unstale":"2024-05-30T06:42:13.583510+0000","last_undegraded":"2024-05-30T06:42:13.583510+0000","last_fullsized":"2024-05-30T06:42:13.583510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:16.106604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420302+0000","last_change":"2024-05-30T06:42:10.422438+0000","last_active":"2024-05-30T06:42:12.420302+0000","last_peered":"2024-05-30T06:42:12.420302+0000","last_clean":"2024-05-30T06:42:12.420302+0000","last_became_active":"2024-05-30T06:42:10.422143+0000","last_became_peered":"2024-05-30T06:42:10.422143+0000","last_unstale":"2024-05-30T06:42:12.420302+0000","last_undegraded":"2024-05-30T06:42:12.420302+0000","last_fullsized":"2024-05-30T06:42:12.420302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583814+0000","last_change":"2024-05-30T06:42:11.450964+0000","last_active":"2024-05-30T06:42:13.583814+0000","last_peered":"2024-05-30T06:42:13.583814+0000","last_clean":"2024-05-30T06:42:13.583814+0000","last_became_active":"2024-05-30T06:42:11.450676+0000","last_became_peered":"2024-05-30T06:42:11.450676+0000","last_unstale":"2024-05-30T06:42:13.583814+0000","last_undegraded":"2024-05-30T06:42:13.583814+0000","last_fullsized":"2024-05-30T06:42:13.583814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:28.603237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462153+0000","last_change":"2024-05-30T06:42:10.420535+0000","last_active":"2024-05-30T06:42:12.462153+0000","last_peered":"2024-05-30T06:42:12.462153+0000","last_clean":"2024-05-30T06:42:12.462153+0000","last_became_active":"2024-05-30T06:42:10.420249+0000","last_became_peered":"2024-05-30T06:42:10.420249+0000","last_unstale":"2024-05-30T06:42:12.462153+0000","last_undegraded":"2024-05-30T06:42:12.462153+0000","last_fullsized":"2024-05-30T06:42:12.462153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:57:09.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388267+0000","last_change":"2024-05-30T06:42:11.434347+0000","last_active":"2024-05-30T06:42:13.388267+0000","last_peered":"2024-05-30T06:42:13.388267+0000","last_clean":"2024-05-30T06:42:13.388267+0000","last_became_active":"2024-05-30T06:42:11.434073+0000","last_became_peered":"2024-05-30T06:42:11.434073+0000","last_unstale":"2024-05-30T06:42:13.388267+0000","last_undegraded":"2024-05-30T06:42:13.388267+0000","last_fullsized":"2024-05-30T06:42:13.388267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:34.897332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583309+0000","last_change":"2024-05-30T06:42:10.430485+0000","last_active":"2024-05-30T06:42:13.583309+0000","last_peered":"2024-05-30T06:42:13.583309+0000","last_clean":"2024-05-30T06:42:13.583309+0000","last_became_active":"2024-05-30T06:42:10.430203+0000","last_became_peered":"2024-05-30T06:42:10.430203+0000","last_unstale":"2024-05-30T06:42:13.583309+0000","last_undegraded":"2024-05-30T06:42:13.583309+0000","last_fullsized":"2024-05-30T06:42:13.583309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:32.085884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583022+0000","last_change":"2024-05-30T06:42:11.429543+0000","last_active":"2024-05-30T06:42:13.583022+0000","last_peered":"2024-05-30T06:42:13.583022+0000","last_clean":"2024-05-30T06:42:13.583022+0000","last_became_active":"2024-05-30T06:42:11.429230+0000","last_became_peered":"2024-05-30T06:42:11.429230+0000","last_unstale":"2024-05-30T06:42:13.583022+0000","last_undegraded":"2024-05-30T06:42:13.583022+0000","last_fullsized":"2024-05-30T06:42:13.583022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:35:23.153911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419025+0000","last_change":"2024-05-30T06:42:10.404506+0000","last_active":"2024-05-30T06:42:12.419025+0000","last_peered":"2024-05-30T06:42:12.419025+0000","last_clean":"2024-05-30T06:42:12.419025+0000","last_became_active":"2024-05-30T06:42:10.404194+0000","last_became_peered":"2024-05-30T06:42:10.404194+0000","last_unstale":"2024-05-30T06:42:12.419025+0000","last_undegraded":"2024-05-30T06:42:12.419025+0000","last_fullsized":"2024-05-30T06:42:12.419025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:57:09.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388251+0000","last_change":"2024-05-30T06:42:11.447385+0000","last_active":"2024-05-30T06:42:13.388251+0000","last_peered":"2024-05-30T06:42:13.388251+0000","last_clean":"2024-05-30T06:42:13.388251+0000","last_became_active":"2024-05-30T06:42:11.446929+0000","last_became_peered":"2024-05-30T06:42:11.446929+0000","last_unstale":"2024-05-30T06:42:13.388251+0000","last_undegraded":"2024-05-30T06:42:13.388251+0000","last_fullsized":"2024-05-30T06:42:13.388251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:28:18.705789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461885+0000","last_change":"2024-05-30T06:42:10.423499+0000","last_active":"2024-05-30T06:42:12.461885+0000","last_peered":"2024-05-30T06:42:12.461885+0000","last_clean":"2024-05-30T06:42:12.461885+0000","last_became_active":"2024-05-30T06:42:10.423116+0000","last_became_peered":"2024-05-30T06:42:10.423116+0000","last_unstale":"2024-05-30T06:42:12.461885+0000","last_undegraded":"2024-05-30T06:42:12.461885+0000","last_fullsized":"2024-05-30T06:42:12.461885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:17.465458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462086+0000","last_change":"2024-05-30T06:42:11.432468+0000","last_active":"2024-05-30T06:42:12.462086+0000","last_peered":"2024-05-30T06:42:12.462086+0000","last_clean":"2024-05-30T06:42:12.462086+0000","last_became_active":"2024-05-30T06:42:11.431747+0000","last_became_peered":"2024-05-30T06:42:11.431747+0000","last_unstale":"2024-05-30T06:42:12.462086+0000","last_undegraded":"2024-05-30T06:42:12.462086+0000","last_fullsized":"2024-05-30T06:42:12.462086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419214+0000","last_change":"2024-05-30T06:42:10.410699+0000","last_active":"2024-05-30T06:42:12.419214+0000","last_peered":"2024-05-30T06:42:12.419214+0000","last_clean":"2024-05-30T06:42:12.419214+0000","last_became_active":"2024-05-30T06:42:10.410248+0000","last_became_peered":"2024-05-30T06:42:10.410248+0000","last_unstale":"2024-05-30T06:42:12.419214+0000","last_undegraded":"2024-05-30T06:42:12.419214+0000","last_fullsized":"2024-05-30T06:42:12.419214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388106+0000","last_change":"2024-05-30T06:42:11.448104+0000","last_active":"2024-05-30T06:42:13.388106+0000","last_peered":"2024-05-30T06:42:13.388106+0000","last_clean":"2024-05-30T06:42:13.388106+0000","last_became_active":"2024-05-30T06:42:11.446869+0000","last_became_peered":"2024-05-30T06:42:11.446869+0000","last_unstale":"2024-05-30T06:42:13.388106+0000","last_undegraded":"2024-05-30T06:42:13.388106+0000","last_fullsized":"2024-05-30T06:42:13.388106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:07.193945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583774+0000","last_change":"2024-05-30T06:42:10.428483+0000","last_active":"2024-05-30T06:42:13.583774+0000","last_peered":"2024-05-30T06:42:13.583774+0000","last_clean":"2024-05-30T06:42:13.583774+0000","last_became_active":"2024-05-30T06:42:10.428191+0000","last_became_peered":"2024-05-30T06:42:10.428191+0000","last_unstale":"2024-05-30T06:42:13.583774+0000","last_undegraded":"2024-05-30T06:42:13.583774+0000","last_fullsized":"2024-05-30T06:42:13.583774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:32.085884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388487+0000","last_change":"2024-05-30T06:42:11.446064+0000","last_active":"2024-05-30T06:42:13.388487+0000","last_peered":"2024-05-30T06:42:13.388487+0000","last_clean":"2024-05-30T06:42:13.388487+0000","last_became_active":"2024-05-30T06:42:11.445744+0000","last_became_peered":"2024-05-30T06:42:11.445744+0000","last_unstale":"2024-05-30T06:42:13.388487+0000","last_undegraded":"2024-05-30T06:42:13.388487+0000","last_fullsized":"2024-05-30T06:42:13.388487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:29:42.983707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419615+0000","last_change":"2024-05-30T06:42:10.406964+0000","last_active":"2024-05-30T06:42:12.419615+0000","last_peered":"2024-05-30T06:42:12.419615+0000","last_clean":"2024-05-30T06:42:12.419615+0000","last_became_active":"2024-05-30T06:42:10.406664+0000","last_became_peered":"2024-05-30T06:42:10.406664+0000","last_unstale":"2024-05-30T06:42:12.419615+0000","last_undegraded":"2024-05-30T06:42:12.419615+0000","last_fullsized":"2024-05-30T06:42:12.419615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:27.594625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388727+0000","last_change":"2024-05-30T06:42:11.454278+0000","last_active":"2024-05-30T06:42:13.388727+0000","last_peered":"2024-05-30T06:42:13.388727+0000","last_clean":"2024-05-30T06:42:13.388727+0000","last_became_active":"2024-05-30T06:42:11.453964+0000","last_became_peered":"2024-05-30T06:42:11.453964+0000","last_unstale":"2024-05-30T06:42:13.388727+0000","last_undegraded":"2024-05-30T06:42:13.388727+0000","last_fullsized":"2024-05-30T06:42:13.388727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:17:43.098464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420404+0000","last_change":"2024-05-30T06:42:10.423747+0000","last_active":"2024-05-30T06:42:12.420404+0000","last_peered":"2024-05-30T06:42:12.420404+0000","last_clean":"2024-05-30T06:42:12.420404+0000","last_became_active":"2024-05-30T06:42:10.423406+0000","last_became_peered":"2024-05-30T06:42:10.423406+0000","last_unstale":"2024-05-30T06:42:12.420404+0000","last_undegraded":"2024-05-30T06:42:12.420404+0000","last_fullsized":"2024-05-30T06:42:12.420404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419052+0000","last_change":"2024-05-30T06:42:11.433867+0000","last_active":"2024-05-30T06:42:12.419052+0000","last_peered":"2024-05-30T06:42:12.419052+0000","last_clean":"2024-05-30T06:42:12.419052+0000","last_became_active":"2024-05-30T06:42:11.433302+0000","last_became_peered":"2024-05-30T06:42:11.433302+0000","last_unstale":"2024-05-30T06:42:12.419052+0000","last_undegraded":"2024-05-30T06:42:12.419052+0000","last_fullsized":"2024-05-30T06:42:12.419052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:09:54.618681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419361+0000","last_change":"2024-05-30T06:42:10.411777+0000","last_active":"2024-05-30T06:42:12.419361+0000","last_peered":"2024-05-30T06:42:12.419361+0000","last_clean":"2024-05-30T06:42:12.419361+0000","last_became_active":"2024-05-30T06:42:10.409724+0000","last_became_peered":"2024-05-30T06:42:10.409724+0000","last_unstale":"2024-05-30T06:42:12.419361+0000","last_undegraded":"2024-05-30T06:42:12.419361+0000","last_fullsized":"2024-05-30T06:42:12.419361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388269+0000","last_change":"2024-05-30T06:42:11.439053+0000","last_active":"2024-05-30T06:42:13.388269+0000","last_peered":"2024-05-30T06:42:13.388269+0000","last_clean":"2024-05-30T06:42:13.388269+0000","last_became_active":"2024-05-30T06:42:11.438190+0000","last_became_peered":"2024-05-30T06:42:11.438190+0000","last_unstale":"2024-05-30T06:42:13.388269+0000","last_undegraded":"2024-05-30T06:42:13.388269+0000","last_fullsized":"2024-05-30T06:42:13.388269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:09:54.618681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387999+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:42:13.387999+0000","last_peered":"2024-05-30T06:42:13.387999+0000","last_clean":"2024-05-30T06:42:13.387999+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:42:13.387999+0000","last_undegraded":"2024-05-30T06:42:13.387999+0000","last_fullsized":"2024-05-30T06:42:13.387999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418494+0000","last_change":"2024-05-30T06:42:10.410644+0000","last_active":"2024-05-30T06:42:12.418494+0000","last_peered":"2024-05-30T06:42:12.418494+0000","last_clean":"2024-05-30T06:42:12.418494+0000","last_became_active":"2024-05-30T06:42:10.408941+0000","last_became_peered":"2024-05-30T06:42:10.408941+0000","last_unstale":"2024-05-30T06:42:12.418494+0000","last_undegraded":"2024-05-30T06:42:12.418494+0000","last_fullsized":"2024-05-30T06:42:12.418494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771269+0000","last_change":"2024-05-30T06:42:11.437096+0000","last_active":"2024-05-30T06:42:12.771269+0000","last_peered":"2024-05-30T06:42:12.771269+0000","last_clean":"2024-05-30T06:42:12.771269+0000","last_became_active":"2024-05-30T06:42:11.436706+0000","last_became_peered":"2024-05-30T06:42:11.436706+0000","last_unstale":"2024-05-30T06:42:12.771269+0000","last_undegraded":"2024-05-30T06:42:12.771269+0000","last_fullsized":"2024-05-30T06:42:12.771269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387891+0000","last_change":"2024-05-30T06:42:10.422330+0000","last_active":"2024-05-30T06:42:13.387891+0000","last_peered":"2024-05-30T06:42:13.387891+0000","last_clean":"2024-05-30T06:42:13.387891+0000","last_became_active":"2024-05-30T06:42:10.422034+0000","last_became_peered":"2024-05-30T06:42:10.422034+0000","last_unstale":"2024-05-30T06:42:13.387891+0000","last_undegraded":"2024-05-30T06:42:13.387891+0000","last_fullsized":"2024-05-30T06:42:13.387891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:18:25.786944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583063+0000","last_change":"2024-05-30T06:42:11.452846+0000","last_active":"2024-05-30T06:42:13.583063+0000","last_peered":"2024-05-30T06:42:13.583063+0000","last_clean":"2024-05-30T06:42:13.583063+0000","last_became_active":"2024-05-30T06:42:11.452493+0000","last_became_peered":"2024-05-30T06:42:11.452493+0000","last_unstale":"2024-05-30T06:42:13.583063+0000","last_undegraded":"2024-05-30T06:42:13.583063+0000","last_fullsized":"2024-05-30T06:42:13.583063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:26:07.087132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419326+0000","last_change":"2024-05-30T06:42:10.404739+0000","last_active":"2024-05-30T06:42:12.419326+0000","last_peered":"2024-05-30T06:42:12.419326+0000","last_clean":"2024-05-30T06:42:12.419326+0000","last_became_active":"2024-05-30T06:42:10.404322+0000","last_became_peered":"2024-05-30T06:42:10.404322+0000","last_unstale":"2024-05-30T06:42:12.419326+0000","last_undegraded":"2024-05-30T06:42:12.419326+0000","last_fullsized":"2024-05-30T06:42:12.419326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420083+0000","last_change":"2024-05-30T06:42:11.439108+0000","last_active":"2024-05-30T06:42:12.420083+0000","last_peered":"2024-05-30T06:42:12.420083+0000","last_clean":"2024-05-30T06:42:12.420083+0000","last_became_active":"2024-05-30T06:42:11.438818+0000","last_became_peered":"2024-05-30T06:42:11.438818+0000","last_unstale":"2024-05-30T06:42:12.420083+0000","last_undegraded":"2024-05-30T06:42:12.420083+0000","last_fullsized":"2024-05-30T06:42:12.420083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419032+0000","last_change":"2024-05-30T06:42:10.411897+0000","last_active":"2024-05-30T06:42:12.419032+0000","last_peered":"2024-05-30T06:42:12.419032+0000","last_clean":"2024-05-30T06:42:12.419032+0000","last_became_active":"2024-05-30T06:42:10.411626+0000","last_became_peered":"2024-05-30T06:42:10.411626+0000","last_unstale":"2024-05-30T06:42:12.419032+0000","last_undegraded":"2024-05-30T06:42:12.419032+0000","last_fullsized":"2024-05-30T06:42:12.419032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583703+0000","last_change":"2024-05-30T06:42:11.446187+0000","last_active":"2024-05-30T06:42:13.583703+0000","last_peered":"2024-05-30T06:42:13.583703+0000","last_clean":"2024-05-30T06:42:13.583703+0000","last_became_active":"2024-05-30T06:42:11.445840+0000","last_became_peered":"2024-05-30T06:42:11.445840+0000","last_unstale":"2024-05-30T06:42:13.583703+0000","last_undegraded":"2024-05-30T06:42:13.583703+0000","last_fullsized":"2024-05-30T06:42:13.583703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:34.809415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420422+0000","last_change":"2024-05-30T06:42:10.428270+0000","last_active":"2024-05-30T06:42:12.420422+0000","last_peered":"2024-05-30T06:42:12.420422+0000","last_clean":"2024-05-30T06:42:12.420422+0000","last_became_active":"2024-05-30T06:42:10.427910+0000","last_became_peered":"2024-05-30T06:42:10.427910+0000","last_unstale":"2024-05-30T06:42:12.420422+0000","last_undegraded":"2024-05-30T06:42:12.420422+0000","last_fullsized":"2024-05-30T06:42:12.420422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:27.594625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418876+0000","last_change":"2024-05-30T06:42:11.438157+0000","last_active":"2024-05-30T06:42:12.418876+0000","last_peered":"2024-05-30T06:42:12.418876+0000","last_clean":"2024-05-30T06:42:12.418876+0000","last_became_active":"2024-05-30T06:42:11.437756+0000","last_became_peered":"2024-05-30T06:42:11.437756+0000","last_unstale":"2024-05-30T06:42:12.418876+0000","last_undegraded":"2024-05-30T06:42:12.418876+0000","last_fullsized":"2024-05-30T06:42:12.418876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:12.472477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388512+0000","last_change":"2024-05-30T06:42:10.427812+0000","last_active":"2024-05-30T06:42:13.388512+0000","last_peered":"2024-05-30T06:42:13.388512+0000","last_clean":"2024-05-30T06:42:13.388512+0000","last_became_active":"2024-05-30T06:42:10.427455+0000","last_became_peered":"2024-05-30T06:42:10.427455+0000","last_unstale":"2024-05-30T06:42:13.388512+0000","last_undegraded":"2024-05-30T06:42:13.388512+0000","last_fullsized":"2024-05-30T06:42:13.388512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:07:15.070876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420523+0000","last_change":"2024-05-30T06:42:11.440605+0000","last_active":"2024-05-30T06:42:12.420523+0000","last_peered":"2024-05-30T06:42:12.420523+0000","last_clean":"2024-05-30T06:42:12.420523+0000","last_became_active":"2024-05-30T06:42:11.440283+0000","last_became_peered":"2024-05-30T06:42:11.440283+0000","last_unstale":"2024-05-30T06:42:12.420523+0000","last_undegraded":"2024-05-30T06:42:12.420523+0000","last_fullsized":"2024-05-30T06:42:12.420523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461531+0000","last_change":"2024-05-30T06:42:10.418655+0000","last_active":"2024-05-30T06:42:12.461531+0000","last_peered":"2024-05-30T06:42:12.461531+0000","last_clean":"2024-05-30T06:42:12.461531+0000","last_became_active":"2024-05-30T06:42:10.418341+0000","last_became_peered":"2024-05-30T06:42:10.418341+0000","last_unstale":"2024-05-30T06:42:12.461531+0000","last_undegraded":"2024-05-30T06:42:12.461531+0000","last_fullsized":"2024-05-30T06:42:12.461531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:18:25.786944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771711+0000","last_change":"2024-05-30T06:42:11.443605+0000","last_active":"2024-05-30T06:42:12.771711+0000","last_peered":"2024-05-30T06:42:12.771711+0000","last_clean":"2024-05-30T06:42:12.771711+0000","last_became_active":"2024-05-30T06:42:11.443352+0000","last_became_peered":"2024-05-30T06:42:11.443352+0000","last_unstale":"2024-05-30T06:42:12.771711+0000","last_undegraded":"2024-05-30T06:42:12.771711+0000","last_fullsized":"2024-05-30T06:42:12.771711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:07.193945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462314+0000","last_change":"2024-05-30T06:42:10.418571+0000","last_active":"2024-05-30T06:42:12.462314+0000","last_peered":"2024-05-30T06:42:12.462314+0000","last_clean":"2024-05-30T06:42:12.462314+0000","last_became_active":"2024-05-30T06:42:10.418264+0000","last_became_peered":"2024-05-30T06:42:10.418264+0000","last_unstale":"2024-05-30T06:42:12.462314+0000","last_undegraded":"2024-05-30T06:42:12.462314+0000","last_fullsized":"2024-05-30T06:42:12.462314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583371+0000","last_change":"2024-05-30T06:42:11.425449+0000","last_active":"2024-05-30T06:42:13.583371+0000","last_peered":"2024-05-30T06:42:13.583371+0000","last_clean":"2024-05-30T06:42:13.583371+0000","last_became_active":"2024-05-30T06:42:11.425140+0000","last_became_peered":"2024-05-30T06:42:11.425140+0000","last_unstale":"2024-05-30T06:42:13.583371+0000","last_undegraded":"2024-05-30T06:42:13.583371+0000","last_fullsized":"2024-05-30T06:42:13.583371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387867+0000","last_change":"2024-05-30T06:42:10.426724+0000","last_active":"2024-05-30T06:42:13.387867+0000","last_peered":"2024-05-30T06:42:13.387867+0000","last_clean":"2024-05-30T06:42:13.387867+0000","last_became_active":"2024-05-30T06:42:10.426443+0000","last_became_peered":"2024-05-30T06:42:10.426443+0000","last_unstale":"2024-05-30T06:42:13.387867+0000","last_undegraded":"2024-05-30T06:42:13.387867+0000","last_fullsized":"2024-05-30T06:42:13.387867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:27.594625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583558+0000","last_change":"2024-05-30T06:42:11.441051+0000","last_active":"2024-05-30T06:42:13.583558+0000","last_peered":"2024-05-30T06:42:13.583558+0000","last_clean":"2024-05-30T06:42:13.583558+0000","last_became_active":"2024-05-30T06:42:11.440776+0000","last_became_peered":"2024-05-30T06:42:11.440776+0000","last_unstale":"2024-05-30T06:42:13.583558+0000","last_undegraded":"2024-05-30T06:42:13.583558+0000","last_fullsized":"2024-05-30T06:42:13.583558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:31.686531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420193+0000","last_change":"2024-05-30T06:42:10.423040+0000","last_active":"2024-05-30T06:42:12.420193+0000","last_peered":"2024-05-30T06:42:12.420193+0000","last_clean":"2024-05-30T06:42:12.420193+0000","last_became_active":"2024-05-30T06:42:10.422580+0000","last_became_peered":"2024-05-30T06:42:10.422580+0000","last_unstale":"2024-05-30T06:42:12.420193+0000","last_undegraded":"2024-05-30T06:42:12.420193+0000","last_fullsized":"2024-05-30T06:42:12.420193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:57:09.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771674+0000","last_change":"2024-05-30T06:42:11.431142+0000","last_active":"2024-05-30T06:42:12.771674+0000","last_peered":"2024-05-30T06:42:12.771674+0000","last_clean":"2024-05-30T06:42:12.771674+0000","last_became_active":"2024-05-30T06:42:11.430833+0000","last_became_peered":"2024-05-30T06:42:11.430833+0000","last_unstale":"2024-05-30T06:42:12.771674+0000","last_undegraded":"2024-05-30T06:42:12.771674+0000","last_fullsized":"2024-05-30T06:42:12.771674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:12.472477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420260+0000","last_change":"2024-05-30T06:42:10.415437+0000","last_active":"2024-05-30T06:42:12.420260+0000","last_peered":"2024-05-30T06:42:12.420260+0000","last_clean":"2024-05-30T06:42:12.420260+0000","last_became_active":"2024-05-30T06:42:10.414954+0000","last_became_peered":"2024-05-30T06:42:10.414954+0000","last_unstale":"2024-05-30T06:42:12.420260+0000","last_undegraded":"2024-05-30T06:42:12.420260+0000","last_fullsized":"2024-05-30T06:42:12.420260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771534+0000","last_change":"2024-05-30T06:42:11.429843+0000","last_active":"2024-05-30T06:42:12.771534+0000","last_peered":"2024-05-30T06:42:12.771534+0000","last_clean":"2024-05-30T06:42:12.771534+0000","last_became_active":"2024-05-30T06:42:11.429428+0000","last_became_peered":"2024-05-30T06:42:11.429428+0000","last_unstale":"2024-05-30T06:42:12.771534+0000","last_undegraded":"2024-05-30T06:42:12.771534+0000","last_fullsized":"2024-05-30T06:42:12.771534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:04:58.409141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388321+0000","last_change":"2024-05-30T06:42:10.430372+0000","last_active":"2024-05-30T06:42:13.388321+0000","last_peered":"2024-05-30T06:42:13.388321+0000","last_clean":"2024-05-30T06:42:13.388321+0000","last_became_active":"2024-05-30T06:42:10.430029+0000","last_became_peered":"2024-05-30T06:42:10.430029+0000","last_unstale":"2024-05-30T06:42:13.388321+0000","last_undegraded":"2024-05-30T06:42:13.388321+0000","last_fullsized":"2024-05-30T06:42:13.388321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:51:39.946209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462037+0000","last_change":"2024-05-30T06:42:11.450489+0000","last_active":"2024-05-30T06:42:12.462037+0000","last_peered":"2024-05-30T06:42:12.462037+0000","last_clean":"2024-05-30T06:42:12.462037+0000","last_became_active":"2024-05-30T06:42:11.446807+0000","last_became_peered":"2024-05-30T06:42:11.446807+0000","last_unstale":"2024-05-30T06:42:12.462037+0000","last_undegraded":"2024-05-30T06:42:12.462037+0000","last_fullsized":"2024-05-30T06:42:12.462037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:41.693793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418833+0000","last_change":"2024-05-30T06:42:11.446469+0000","last_active":"2024-05-30T06:42:12.418833+0000","last_peered":"2024-05-30T06:42:12.418833+0000","last_clean":"2024-05-30T06:42:12.418833+0000","last_became_active":"2024-05-30T06:42:11.446178+0000","last_became_peered":"2024-05-30T06:42:11.446178+0000","last_unstale":"2024-05-30T06:42:12.418833+0000","last_undegraded":"2024-05-30T06:42:12.418833+0000","last_fullsized":"2024-05-30T06:42:12.418833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:05.695381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388169+0000","last_change":"2024-05-30T06:42:10.424259+0000","last_active":"2024-05-30T06:42:13.388169+0000","last_peered":"2024-05-30T06:42:13.388169+0000","last_clean":"2024-05-30T06:42:13.388169+0000","last_became_active":"2024-05-30T06:42:10.423972+0000","last_became_peered":"2024-05-30T06:42:10.423972+0000","last_unstale":"2024-05-30T06:42:13.388169+0000","last_undegraded":"2024-05-30T06:42:13.388169+0000","last_fullsized":"2024-05-30T06:42:13.388169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:06:59.985658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419003+0000","last_change":"2024-05-30T06:42:11.451914+0000","last_active":"2024-05-30T06:42:12.419003+0000","last_peered":"2024-05-30T06:42:12.419003+0000","last_clean":"2024-05-30T06:42:12.419003+0000","last_became_active":"2024-05-30T06:42:11.451633+0000","last_became_peered":"2024-05-30T06:42:11.451633+0000","last_unstale":"2024-05-30T06:42:12.419003+0000","last_undegraded":"2024-05-30T06:42:12.419003+0000","last_fullsized":"2024-05-30T06:42:12.419003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:28:18.705789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388431+0000","last_change":"2024-05-30T06:42:10.427805+0000","last_active":"2024-05-30T06:42:13.388431+0000","last_peered":"2024-05-30T06:42:13.388431+0000","last_clean":"2024-05-30T06:42:13.388431+0000","last_became_active":"2024-05-30T06:42:10.427452+0000","last_became_peered":"2024-05-30T06:42:10.427452+0000","last_unstale":"2024-05-30T06:42:13.388431+0000","last_undegraded":"2024-05-30T06:42:13.388431+0000","last_fullsized":"2024-05-30T06:42:13.388431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:52.729379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583434+0000","last_change":"2024-05-30T06:42:11.432129+0000","last_active":"2024-05-30T06:42:13.583434+0000","last_peered":"2024-05-30T06:42:13.583434+0000","last_clean":"2024-05-30T06:42:13.583434+0000","last_became_active":"2024-05-30T06:42:11.431823+0000","last_became_peered":"2024-05-30T06:42:11.431823+0000","last_unstale":"2024-05-30T06:42:13.583434+0000","last_undegraded":"2024-05-30T06:42:13.583434+0000","last_fullsized":"2024-05-30T06:42:13.583434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771534+0000","last_change":"2024-05-30T06:42:10.426946+0000","last_active":"2024-05-30T06:42:12.771534+0000","last_peered":"2024-05-30T06:42:12.771534+0000","last_clean":"2024-05-30T06:42:12.771534+0000","last_became_active":"2024-05-30T06:42:10.426667+0000","last_became_peered":"2024-05-30T06:42:10.426667+0000","last_unstale":"2024-05-30T06:42:12.771534+0000","last_undegraded":"2024-05-30T06:42:12.771534+0000","last_fullsized":"2024-05-30T06:42:12.771534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:17.465458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771418+0000","last_change":"2024-05-30T06:42:11.436144+0000","last_active":"2024-05-30T06:42:12.771418+0000","last_peered":"2024-05-30T06:42:12.771418+0000","last_clean":"2024-05-30T06:42:12.771418+0000","last_became_active":"2024-05-30T06:42:11.435885+0000","last_became_peered":"2024-05-30T06:42:11.435885+0000","last_unstale":"2024-05-30T06:42:12.771418+0000","last_undegraded":"2024-05-30T06:42:12.771418+0000","last_fullsized":"2024-05-30T06:42:12.771418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583529+0000","last_change":"2024-05-30T06:42:10.433516+0000","last_active":"2024-05-30T06:42:13.583529+0000","last_peered":"2024-05-30T06:42:13.583529+0000","last_clean":"2024-05-30T06:42:13.583529+0000","last_became_active":"2024-05-30T06:42:10.433200+0000","last_became_peered":"2024-05-30T06:42:10.433200+0000","last_unstale":"2024-05-30T06:42:13.583529+0000","last_undegraded":"2024-05-30T06:42:13.583529+0000","last_fullsized":"2024-05-30T06:42:13.583529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:43:33.658279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:42:20.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:42:20.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc32dc00640 1 Processor -- start 2024-05-30T06:42:20.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc32dc00640 1 -- start start 2024-05-30T06:42:20.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc32dc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc32809b9a0 0x7fc3281625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc32dc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32809abe0 con 0x7fc328162ae0 2024-05-30T06:42:20.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc32dc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32809aec0 con 0x7fc32815e930 2024-05-30T06:42:20.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc32dc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc328162f50 con 0x7fc32809b9a0 2024-05-30T06:42:20.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc327400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc328162ae0 0x7fc3280ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47764/0 (socket says 172.21.15.37:47764) 2024-05-30T06:42:20.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc327400640 1 -- 172.21.15.37:0/909732887 learned_addr learned my addr 172.21.15.37:0/909732887 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc31fe00640 1 --2- 172.21.15.37:0/909732887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc32809b9a0 0x7fc3281625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1877420469 0 0) 0x7fc32809abe0 con 0x7fc328162ae0 2024-05-30T06:42:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc30c003530 con 0x7fc328162ae0 2024-05-30T06:42:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1784846713 0 0) 0x7fc30c003530 con 0x7fc328162ae0 2024-05-30T06:42:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc32809b9a0 msgr2=0x7fc3281625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 --2- 172.21.15.37:0/909732887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc32809b9a0 0x7fc3281625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 >> v1:172.21.15.105:6789/0 conn(0x7fc32815e930 legacy=0x7fc3280d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32809b1a0 con 0x7fc328162ae0 2024-05-30T06:42:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fc320001a00 con 0x7fc328162ae0 2024-05-30T06:42:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 >> v1:172.21.15.37:6789/0 conn(0x7fc328162ae0 legacy=0x7fc3280ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 --2- 172.21.15.37:0/909732887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc32809b9a0 0x7fc30c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 --2- 172.21.15.37:0/909732887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c003f30 0x7fc30c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 --2- 172.21.15.37:0/909732887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30c004d50 0x7fc30c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc328162f50 con 0x7fc30c004d50 2024-05-30T06:42:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c00ba30 con 0x7fc30c003f30 2024-05-30T06:42:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc30c00bc30 con 0x7fc32809b9a0 2024-05-30T06:42:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc327400640 1 --2- 172.21.15.37:0/909732887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30c004d50 0x7fc30c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc326a00640 1 --2- 172.21.15.37:0/909732887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc32809b9a0 0x7fc30c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc31fe00640 1 --2- 172.21.15.37:0/909732887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c003f30 0x7fc30c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc327400640 1 -- 172.21.15.37:0/909732887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc32809b9a0 msgr2=0x7fc30c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc327400640 1 --2- 172.21.15.37:0/909732887 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc32809b9a0 0x7fc30c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc327400640 1 -- 172.21.15.37:0/909732887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c003f30 msgr2=0x7fc30c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.455+0000 7fc327400640 1 --2- 172.21.15.37:0/909732887 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc30c003f30 0x7fc30c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.459+0000 7fc327400640 1 -- 172.21.15.37:0/909732887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30c003530 con 0x7fc30c004d50 2024-05-30T06:42:20.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.459+0000 7fc327400640 1 --2- 172.21.15.37:0/909732887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30c004d50 0x7fc30c0051d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc32000a920 tx=0x7fc32001fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2281e8bef3a76942 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:20.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.459+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32000a4c0 con 0x7fc30c004d50 2024-05-30T06:42:20.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.459+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3200ad070 con 0x7fc30c004d50 2024-05-30T06:42:20.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.459+0000 7fc326000640 1 -- 172.21.15.37:0/909732887 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3200a99b0 con 0x7fc30c004d50 2024-05-30T06:42:20.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.459+0000 7fc32dc00640 1 -- 172.21.15.37:0/909732887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30c004d50 msgr2=0x7fc30c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.459+0000 7fc32dc00640 1 --2- 172.21.15.37:0/909732887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc30c004d50 0x7fc30c0051d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc32000a920 tx=0x7fc32001fb80 comp rx=0 tx=0).stop 2024-05-30T06:42:20.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.459+0000 7fc327400640 1 -- 172.21.15.37:0/909732887 reap_dead start 2024-05-30T06:42:20.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.459+0000 7fc32dc00640 1 -- 172.21.15.37:0/909732887 shutdown_connections 2024-05-30T06:42:20.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.459+0000 7fc32dc00640 1 -- 172.21.15.37:0/909732887 >> 172.21.15.37:0/909732887 conn(0x7fc3280b4100 msgr2=0x7fc3280b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:20.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.459+0000 7fc32dc00640 1 -- 172.21.15.37:0/909732887 shutdown_connections 2024-05-30T06:42:20.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.459+0000 7fc32dc00640 1 -- 172.21.15.37:0/909732887 wait complete. 2024-05-30T06:42:20.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc32dc00640 1 Processor -- start 2024-05-30T06:42:20.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc32dc00640 1 -- start start 2024-05-30T06:42:20.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc32dc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc30c004d50 0x7fc3281f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc32dc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc32815c630 0x7fc328070390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc32dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc32815cab0 0x7fc3280708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc32dc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc32809bdc0 con 0x7fc32815cab0 2024-05-30T06:42:20.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc32dc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc3280d1950 con 0x7fc32815c630 2024-05-30T06:42:20.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc32dc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc32806dc40 con 0x7fc30c004d50 2024-05-30T06:42:20.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc327400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc32815cab0 0x7fc3280708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc327400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc32815cab0 0x7fc3280708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34118/0 (socket says 172.21.15.37:34118) 2024-05-30T06:42:20.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc327400640 1 -- 172.21.15.37:0/2990596157 learned_addr learned my addr 172.21.15.37:0/2990596157 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:20.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc326a00640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc30c004d50 0x7fc3281f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc31fe00640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc32815c630 0x7fc328070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc327400640 1 -- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc30c004d50 msgr2=0x7fc3281f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc327400640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc30c004d50 0x7fc3281f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc327400640 1 -- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc32815c630 msgr2=0x7fc328070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc327400640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc32815c630 0x7fc328070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc327400640 1 -- 172.21.15.37:0/2990596157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3280b6140 con 0x7fc32815cab0 2024-05-30T06:42:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc327400640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc32815cab0 0x7fc3280708d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc320000f90 tx=0x7fc30c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc31ea00640 1 -- 172.21.15.37:0/2990596157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32000a4c0 con 0x7fc32815cab0 2024-05-30T06:42:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc31ea00640 1 -- 172.21.15.37:0/2990596157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc320004b70 con 0x7fc32815cab0 2024-05-30T06:42:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc31ea00640 1 -- 172.21.15.37:0/2990596157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc320001a00 con 0x7fc32815cab0 2024-05-30T06:42:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc32dc00640 1 -- 172.21.15.37:0/2990596157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3280b58a0 con 0x7fc32815cab0 2024-05-30T06:42:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.463+0000 7fc32dc00640 1 -- 172.21.15.37:0/2990596157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3280b5e60 con 0x7fc32815cab0 2024-05-30T06:42:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.467+0000 7fc32dc00640 1 -- 172.21.15.37:0/2990596157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc328068b20 con 0x7fc32815cab0 2024-05-30T06:42:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.467+0000 7fc31ea00640 1 -- 172.21.15.37:0/2990596157 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc3200a9a70 con 0x7fc32815cab0 2024-05-30T06:42:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.467+0000 7fc31ea00640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc304068380 0x7fc30406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.467+0000 7fc31ea00640 1 -- 172.21.15.37:0/2990596157 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc3201237c0 con 0x7fc32815cab0 2024-05-30T06:42:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.467+0000 7fc326a00640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc304068380 0x7fc30406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.467+0000 7fc326a00640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc304068380 0x7fc30406a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc318000c10 tx=0x7fc318009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:20.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.471+0000 7fc31ea00640 1 -- 172.21.15.37:0/2990596157 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc3280b6140 con 0x7fc32815cab0 2024-05-30T06:42:20.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.635+0000 7fc32dc00640 1 -- 172.21.15.37:0/2990596157 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3281f7f10 con 0x7fc304068380 2024-05-30T06:42:20.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.643+0000 7fc31ea00640 1 -- 172.21.15.37:0/2990596157 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fc318012890 con 0x7fc304068380 2024-05-30T06:42:20.646 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:20.648 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:42:20.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.647+0000 7fc32dc00640 1 -- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc304068380 msgr2=0x7fc30406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.647+0000 7fc32dc00640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc304068380 0x7fc30406a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc318000c10 tx=0x7fc318009040 comp rx=0 tx=0).stop 2024-05-30T06:42:20.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.647+0000 7fc32dc00640 1 -- 172.21.15.37:0/2990596157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc32815cab0 msgr2=0x7fc3280708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.647+0000 7fc32dc00640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc32815cab0 0x7fc3280708d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc320000f90 tx=0x7fc30c005840 comp rx=0 tx=0).stop 2024-05-30T06:42:20.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.647+0000 7fc32dc00640 1 -- 172.21.15.37:0/2990596157 shutdown_connections 2024-05-30T06:42:20.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.647+0000 7fc32dc00640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc32815cab0 0x7fc3280708d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.647+0000 7fc32dc00640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc304068380 0x7fc30406a840 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.647+0000 7fc32dc00640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc32815c630 0x7fc328070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.647+0000 7fc32dc00640 1 --2- 172.21.15.37:0/2990596157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc30c004d50 0x7fc3281f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.647+0000 7fc32dc00640 1 -- 172.21.15.37:0/2990596157 >> 172.21.15.37:0/2990596157 conn(0x7fc3280b4100 msgr2=0x7fc3280b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:20.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.647+0000 7fc32dc00640 1 -- 172.21.15.37:0/2990596157 shutdown_connections 2024-05-30T06:42:20.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.647+0000 7fc32dc00640 1 -- 172.21.15.37:0/2990596157 wait complete. 2024-05-30T06:42:20.666 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-30T06:42:18.641887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001738"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388642+0000","last_change":"2024-05-30T06:42:11.435488+0000","last_active":"2024-05-30T06:42:13.388642+0000","last_peered":"2024-05-30T06:42:13.388642+0000","last_clean":"2024-05-30T06:42:13.388642+0000","last_became_active":"2024-05-30T06:42:11.435224+0000","last_became_peered":"2024-05-30T06:42:11.435224+0000","last_unstale":"2024-05-30T06:42:13.388642+0000","last_undegraded":"2024-05-30T06:42:13.388642+0000","last_fullsized":"2024-05-30T06:42:13.388642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:02.703778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420451+0000","last_change":"2024-05-30T06:42:11.432162+0000","last_active":"2024-05-30T06:42:12.420451+0000","last_peered":"2024-05-30T06:42:12.420451+0000","last_clean":"2024-05-30T06:42:12.420451+0000","last_became_active":"2024-05-30T06:42:11.431837+0000","last_became_peered":"2024-05-30T06:42:11.431837+0000","last_unstale":"2024-05-30T06:42:12.420451+0000","last_undegraded":"2024-05-30T06:42:12.420451+0000","last_fullsized":"2024-05-30T06:42:12.420451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583246+0000","last_change":"2024-05-30T06:42:11.444273+0000","last_active":"2024-05-30T06:42:13.583246+0000","last_peered":"2024-05-30T06:42:13.583246+0000","last_clean":"2024-05-30T06:42:13.583246+0000","last_became_active":"2024-05-30T06:42:11.443918+0000","last_became_peered":"2024-05-30T06:42:11.443918+0000","last_unstale":"2024-05-30T06:42:13.583246+0000","last_undegraded":"2024-05-30T06:42:13.583246+0000","last_fullsized":"2024-05-30T06:42:13.583246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418697+0000","last_change":"2024-05-30T06:42:11.434052+0000","last_active":"2024-05-30T06:42:12.418697+0000","last_peered":"2024-05-30T06:42:12.418697+0000","last_clean":"2024-05-30T06:42:12.418697+0000","last_became_active":"2024-05-30T06:42:11.433700+0000","last_became_peered":"2024-05-30T06:42:11.433700+0000","last_unstale":"2024-05-30T06:42:12.418697+0000","last_undegraded":"2024-05-30T06:42:12.418697+0000","last_fullsized":"2024-05-30T06:42:12.418697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:04:58.409141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388154+0000","last_change":"2024-05-30T06:42:11.440147+0000","last_active":"2024-05-30T06:42:13.388154+0000","last_peered":"2024-05-30T06:42:13.388154+0000","last_clean":"2024-05-30T06:42:13.388154+0000","last_became_active":"2024-05-30T06:42:11.439811+0000","last_became_peered":"2024-05-30T06:42:11.439811+0000","last_unstale":"2024-05-30T06:42:13.388154+0000","last_undegraded":"2024-05-30T06:42:13.388154+0000","last_fullsized":"2024-05-30T06:42:13.388154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:05:31.913179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418707+0000","last_change":"2024-05-30T06:42:11.434320+0000","last_active":"2024-05-30T06:42:12.418707+0000","last_peered":"2024-05-30T06:42:12.418707+0000","last_clean":"2024-05-30T06:42:12.418707+0000","last_became_active":"2024-05-30T06:42:11.433756+0000","last_became_peered":"2024-05-30T06:42:11.433756+0000","last_unstale":"2024-05-30T06:42:12.418707+0000","last_undegraded":"2024-05-30T06:42:12.418707+0000","last_fullsized":"2024-05-30T06:42:12.418707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387999+0000","last_change":"2024-05-30T06:42:11.433123+0000","last_active":"2024-05-30T06:42:13.387999+0000","last_peered":"2024-05-30T06:42:13.387999+0000","last_clean":"2024-05-30T06:42:13.387999+0000","last_became_active":"2024-05-30T06:42:11.432861+0000","last_became_peered":"2024-05-30T06:42:11.432861+0000","last_unstale":"2024-05-30T06:42:13.387999+0000","last_undegraded":"2024-05-30T06:42:13.387999+0000","last_fullsized":"2024-05-30T06:42:13.387999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:12.472477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771210+0000","last_change":"2024-05-30T06:42:11.440463+0000","last_active":"2024-05-30T06:42:12.771210+0000","last_peered":"2024-05-30T06:42:12.771210+0000","last_clean":"2024-05-30T06:42:12.771210+0000","last_became_active":"2024-05-30T06:42:11.440179+0000","last_became_peered":"2024-05-30T06:42:11.440179+0000","last_unstale":"2024-05-30T06:42:12.771210+0000","last_undegraded":"2024-05-30T06:42:12.771210+0000","last_fullsized":"2024-05-30T06:42:12.771210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388697+0000","last_change":"2024-05-30T06:42:11.438364+0000","last_active":"2024-05-30T06:42:13.388697+0000","last_peered":"2024-05-30T06:42:13.388697+0000","last_clean":"2024-05-30T06:42:13.388697+0000","last_became_active":"2024-05-30T06:42:11.438010+0000","last_became_peered":"2024-05-30T06:42:11.438010+0000","last_unstale":"2024-05-30T06:42:13.388697+0000","last_undegraded":"2024-05-30T06:42:13.388697+0000","last_fullsized":"2024-05-30T06:42:13.388697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:44:42.856118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462336+0000","last_change":"2024-05-30T06:42:11.436077+0000","last_active":"2024-05-30T06:42:12.462336+0000","last_peered":"2024-05-30T06:42:12.462336+0000","last_clean":"2024-05-30T06:42:12.462336+0000","last_became_active":"2024-05-30T06:42:11.435686+0000","last_became_peered":"2024-05-30T06:42:11.435686+0000","last_unstale":"2024-05-30T06:42:12.462336+0000","last_undegraded":"2024-05-30T06:42:12.462336+0000","last_fullsized":"2024-05-30T06:42:12.462336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462200+0000","last_change":"2024-05-30T06:42:11.441401+0000","last_active":"2024-05-30T06:42:12.462200+0000","last_peered":"2024-05-30T06:42:12.462200+0000","last_clean":"2024-05-30T06:42:12.462200+0000","last_became_active":"2024-05-30T06:42:11.440895+0000","last_became_peered":"2024-05-30T06:42:11.440895+0000","last_unstale":"2024-05-30T06:42:12.462200+0000","last_undegraded":"2024-05-30T06:42:12.462200+0000","last_fullsized":"2024-05-30T06:42:12.462200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583872+0000","last_change":"2024-05-30T06:42:11.444435+0000","last_active":"2024-05-30T06:42:13.583872+0000","last_peered":"2024-05-30T06:42:13.583872+0000","last_clean":"2024-05-30T06:42:13.583872+0000","last_became_active":"2024-05-30T06:42:11.444162+0000","last_became_peered":"2024-05-30T06:42:11.444162+0000","last_unstale":"2024-05-30T06:42:13.583872+0000","last_undegraded":"2024-05-30T06:42:13.583872+0000","last_fullsized":"2024-05-30T06:42:13.583872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:18:26.795557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771470+0000","last_change":"2024-05-30T06:42:11.430118+0000","last_active":"2024-05-30T06:42:12.771470+0000","last_peered":"2024-05-30T06:42:12.771470+0000","last_clean":"2024-05-30T06:42:12.771470+0000","last_became_active":"2024-05-30T06:42:11.429821+0000","last_became_peered":"2024-05-30T06:42:11.429821+0000","last_unstale":"2024-05-30T06:42:12.771470+0000","last_undegraded":"2024-05-30T06:42:12.771470+0000","last_fullsized":"2024-05-30T06:42:12.771470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:16.106604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.582964+0000","last_change":"2024-05-30T06:42:11.426742+0000","last_active":"2024-05-30T06:42:13.582964+0000","last_peered":"2024-05-30T06:42:13.582964+0000","last_clean":"2024-05-30T06:42:13.582964+0000","last_became_active":"2024-05-30T06:42:11.426182+0000","last_became_peered":"2024-05-30T06:42:11.426182+0000","last_unstale":"2024-05-30T06:42:13.582964+0000","last_undegraded":"2024-05-30T06:42:13.582964+0000","last_fullsized":"2024-05-30T06:42:13.582964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:07:16.079488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420135+0000","last_change":"2024-05-30T06:42:11.452976+0000","last_active":"2024-05-30T06:42:12.420135+0000","last_peered":"2024-05-30T06:42:12.420135+0000","last_clean":"2024-05-30T06:42:12.420135+0000","last_became_active":"2024-05-30T06:42:11.452525+0000","last_became_peered":"2024-05-30T06:42:11.452525+0000","last_unstale":"2024-05-30T06:42:12.420135+0000","last_undegraded":"2024-05-30T06:42:12.420135+0000","last_fullsized":"2024-05-30T06:42:12.420135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418654+0000","last_change":"2024-05-30T06:42:11.437421+0000","last_active":"2024-05-30T06:42:12.418654+0000","last_peered":"2024-05-30T06:42:12.418654+0000","last_clean":"2024-05-30T06:42:12.418654+0000","last_became_active":"2024-05-30T06:42:11.432053+0000","last_became_peered":"2024-05-30T06:42:11.432053+0000","last_unstale":"2024-05-30T06:42:12.418654+0000","last_undegraded":"2024-05-30T06:42:12.418654+0000","last_fullsized":"2024-05-30T06:42:12.418654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:16.106604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419366+0000","last_change":"2024-05-30T06:42:11.443729+0000","last_active":"2024-05-30T06:42:12.419366+0000","last_peered":"2024-05-30T06:42:12.419366+0000","last_clean":"2024-05-30T06:42:12.419366+0000","last_became_active":"2024-05-30T06:42:11.443424+0000","last_became_peered":"2024-05-30T06:42:11.443424+0000","last_unstale":"2024-05-30T06:42:12.419366+0000","last_undegraded":"2024-05-30T06:42:12.419366+0000","last_fullsized":"2024-05-30T06:42:12.419366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:29:42.983707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419530+0000","last_change":"2024-05-30T06:42:11.443761+0000","last_active":"2024-05-30T06:42:12.419530+0000","last_peered":"2024-05-30T06:42:12.419530+0000","last_clean":"2024-05-30T06:42:12.419530+0000","last_became_active":"2024-05-30T06:42:11.443453+0000","last_became_peered":"2024-05-30T06:42:11.443453+0000","last_unstale":"2024-05-30T06:42:12.419530+0000","last_undegraded":"2024-05-30T06:42:12.419530+0000","last_fullsized":"2024-05-30T06:42:12.419530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:51:40.954821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388493+0000","last_change":"2024-05-30T06:42:11.445389+0000","last_active":"2024-05-30T06:42:13.388493+0000","last_peered":"2024-05-30T06:42:13.388493+0000","last_clean":"2024-05-30T06:42:13.388493+0000","last_became_active":"2024-05-30T06:42:11.444984+0000","last_became_peered":"2024-05-30T06:42:11.444984+0000","last_unstale":"2024-05-30T06:42:13.388493+0000","last_undegraded":"2024-05-30T06:42:13.388493+0000","last_fullsized":"2024-05-30T06:42:13.388493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:48:21.800907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462107+0000","last_change":"2024-05-30T06:42:11.453799+0000","last_active":"2024-05-30T06:42:12.462107+0000","last_peered":"2024-05-30T06:42:12.462107+0000","last_clean":"2024-05-30T06:42:12.462107+0000","last_became_active":"2024-05-30T06:42:11.453488+0000","last_became_peered":"2024-05-30T06:42:11.453488+0000","last_unstale":"2024-05-30T06:42:12.462107+0000","last_undegraded":"2024-05-30T06:42:12.462107+0000","last_fullsized":"2024-05-30T06:42:12.462107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583121+0000","last_change":"2024-05-30T06:42:11.428247+0000","last_active":"2024-05-30T06:42:13.583121+0000","last_peered":"2024-05-30T06:42:13.583121+0000","last_clean":"2024-05-30T06:42:13.583121+0000","last_became_active":"2024-05-30T06:42:11.427950+0000","last_became_peered":"2024-05-30T06:42:11.427950+0000","last_unstale":"2024-05-30T06:42:13.583121+0000","last_undegraded":"2024-05-30T06:42:13.583121+0000","last_fullsized":"2024-05-30T06:42:13.583121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:41.693793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418922+0000","last_change":"2024-05-30T06:42:11.434081+0000","last_active":"2024-05-30T06:42:12.418922+0000","last_peered":"2024-05-30T06:42:12.418922+0000","last_clean":"2024-05-30T06:42:12.418922+0000","last_became_active":"2024-05-30T06:42:11.433267+0000","last_became_peered":"2024-05-30T06:42:11.433267+0000","last_unstale":"2024-05-30T06:42:12.418922+0000","last_undegraded":"2024-05-30T06:42:12.418922+0000","last_fullsized":"2024-05-30T06:42:12.418922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:07.193945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771221+0000","last_change":"2024-05-30T06:42:11.445981+0000","last_active":"2024-05-30T06:42:12.771221+0000","last_peered":"2024-05-30T06:42:12.771221+0000","last_clean":"2024-05-30T06:42:12.771221+0000","last_became_active":"2024-05-30T06:42:11.445642+0000","last_became_peered":"2024-05-30T06:42:11.445642+0000","last_unstale":"2024-05-30T06:42:12.771221+0000","last_undegraded":"2024-05-30T06:42:12.771221+0000","last_fullsized":"2024-05-30T06:42:12.771221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418715+0000","last_change":"2024-05-30T06:42:11.434545+0000","last_active":"2024-05-30T06:42:12.418715+0000","last_peered":"2024-05-30T06:42:12.418715+0000","last_clean":"2024-05-30T06:42:12.418715+0000","last_became_active":"2024-05-30T06:42:11.431097+0000","last_became_peered":"2024-05-30T06:42:11.431097+0000","last_unstale":"2024-05-30T06:42:12.418715+0000","last_undegraded":"2024-05-30T06:42:12.418715+0000","last_fullsized":"2024-05-30T06:42:12.418715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:15.413953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771539+0000","last_change":"2024-05-30T06:42:11.454371+0000","last_active":"2024-05-30T06:42:12.771539+0000","last_peered":"2024-05-30T06:42:12.771539+0000","last_clean":"2024-05-30T06:42:12.771539+0000","last_became_active":"2024-05-30T06:42:11.454064+0000","last_became_peered":"2024-05-30T06:42:11.454064+0000","last_unstale":"2024-05-30T06:42:12.771539+0000","last_undegraded":"2024-05-30T06:42:12.771539+0000","last_fullsized":"2024-05-30T06:42:12.771539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:15.413953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462346+0000","last_change":"2024-05-30T06:42:11.439382+0000","last_active":"2024-05-30T06:42:12.462346+0000","last_peered":"2024-05-30T06:42:12.462346+0000","last_clean":"2024-05-30T06:42:12.462346+0000","last_became_active":"2024-05-30T06:42:11.439071+0000","last_became_peered":"2024-05-30T06:42:11.439071+0000","last_unstale":"2024-05-30T06:42:12.462346+0000","last_undegraded":"2024-05-30T06:42:12.462346+0000","last_fullsized":"2024-05-30T06:42:12.462346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420317+0000","last_change":"2024-05-30T06:42:11.436698+0000","last_active":"2024-05-30T06:42:12.420317+0000","last_peered":"2024-05-30T06:42:12.420317+0000","last_clean":"2024-05-30T06:42:12.420317+0000","last_became_active":"2024-05-30T06:42:11.436378+0000","last_became_peered":"2024-05-30T06:42:11.436378+0000","last_unstale":"2024-05-30T06:42:12.420317+0000","last_undegraded":"2024-05-30T06:42:12.420317+0000","last_fullsized":"2024-05-30T06:42:12.420317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:02:29.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771611+0000","last_change":"2024-05-30T06:42:11.454323+0000","last_active":"2024-05-30T06:42:12.771611+0000","last_peered":"2024-05-30T06:42:12.771611+0000","last_clean":"2024-05-30T06:42:12.771611+0000","last_became_active":"2024-05-30T06:42:11.454037+0000","last_became_peered":"2024-05-30T06:42:11.454037+0000","last_unstale":"2024-05-30T06:42:12.771611+0000","last_undegraded":"2024-05-30T06:42:12.771611+0000","last_fullsized":"2024-05-30T06:42:12.771611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:05.695381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583186+0000","last_change":"2024-05-30T06:42:11.432774+0000","last_active":"2024-05-30T06:42:13.583186+0000","last_peered":"2024-05-30T06:42:13.583186+0000","last_clean":"2024-05-30T06:42:13.583186+0000","last_became_active":"2024-05-30T06:42:11.432430+0000","last_became_peered":"2024-05-30T06:42:11.432430+0000","last_unstale":"2024-05-30T06:42:13.583186+0000","last_undegraded":"2024-05-30T06:42:13.583186+0000","last_fullsized":"2024-05-30T06:42:13.583186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418923+0000","last_change":"2024-05-30T06:42:11.435991+0000","last_active":"2024-05-30T06:42:12.418923+0000","last_peered":"2024-05-30T06:42:12.418923+0000","last_clean":"2024-05-30T06:42:12.418923+0000","last_became_active":"2024-05-30T06:42:11.435283+0000","last_became_peered":"2024-05-30T06:42:11.435283+0000","last_unstale":"2024-05-30T06:42:12.418923+0000","last_undegraded":"2024-05-30T06:42:12.418923+0000","last_fullsized":"2024-05-30T06:42:12.418923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:05:31.913179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419353+0000","last_change":"2024-05-30T06:42:11.445149+0000","last_active":"2024-05-30T06:42:12.419353+0000","last_peered":"2024-05-30T06:42:12.419353+0000","last_clean":"2024-05-30T06:42:12.419353+0000","last_became_active":"2024-05-30T06:42:11.444558+0000","last_became_peered":"2024-05-30T06:42:11.444558+0000","last_unstale":"2024-05-30T06:42:12.419353+0000","last_undegraded":"2024-05-30T06:42:12.419353+0000","last_fullsized":"2024-05-30T06:42:12.419353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:53.737991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461946+0000","last_change":"2024-05-30T06:42:11.432788+0000","last_active":"2024-05-30T06:42:12.461946+0000","last_peered":"2024-05-30T06:42:12.461946+0000","last_clean":"2024-05-30T06:42:12.461946+0000","last_became_active":"2024-05-30T06:42:11.432182+0000","last_became_peered":"2024-05-30T06:42:11.432182+0000","last_unstale":"2024-05-30T06:42:12.461946+0000","last_undegraded":"2024-05-30T06:42:12.461946+0000","last_fullsized":"2024-05-30T06:42:12.461946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:26:07.087132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583756+0000","last_change":"2024-05-30T06:42:11.445205+0000","last_active":"2024-05-30T06:42:13.583756+0000","last_peered":"2024-05-30T06:42:13.583756+0000","last_clean":"2024-05-30T06:42:13.583756+0000","last_became_active":"2024-05-30T06:42:11.444042+0000","last_became_peered":"2024-05-30T06:42:11.444042+0000","last_unstale":"2024-05-30T06:42:13.583756+0000","last_undegraded":"2024-05-30T06:42:13.583756+0000","last_fullsized":"2024-05-30T06:42:13.583756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:44.456016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771622+0000","last_change":"2024-05-30T06:42:10.424421+0000","last_active":"2024-05-30T06:42:12.771622+0000","last_peered":"2024-05-30T06:42:12.771622+0000","last_clean":"2024-05-30T06:42:12.771622+0000","last_became_active":"2024-05-30T06:42:10.423992+0000","last_became_peered":"2024-05-30T06:42:10.423992+0000","last_unstale":"2024-05-30T06:42:12.771622+0000","last_undegraded":"2024-05-30T06:42:12.771622+0000","last_fullsized":"2024-05-30T06:42:12.771622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:12:56.283917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583199+0000","last_change":"2024-05-30T06:42:11.452945+0000","last_active":"2024-05-30T06:42:13.583199+0000","last_peered":"2024-05-30T06:42:13.583199+0000","last_clean":"2024-05-30T06:42:13.583199+0000","last_became_active":"2024-05-30T06:42:11.452548+0000","last_became_peered":"2024-05-30T06:42:11.452548+0000","last_unstale":"2024-05-30T06:42:13.583199+0000","last_undegraded":"2024-05-30T06:42:13.583199+0000","last_fullsized":"2024-05-30T06:42:13.583199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:00.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461970+0000","last_change":"2024-05-30T06:42:10.423464+0000","last_active":"2024-05-30T06:42:12.461970+0000","last_peered":"2024-05-30T06:42:12.461970+0000","last_clean":"2024-05-30T06:42:12.461970+0000","last_became_active":"2024-05-30T06:42:10.423111+0000","last_became_peered":"2024-05-30T06:42:10.423111+0000","last_unstale":"2024-05-30T06:42:12.461970+0000","last_undegraded":"2024-05-30T06:42:12.461970+0000","last_fullsized":"2024-05-30T06:42:12.461970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771327+0000","last_change":"2024-05-30T06:42:10.417267+0000","last_active":"2024-05-30T06:42:12.771327+0000","last_peered":"2024-05-30T06:42:12.771327+0000","last_clean":"2024-05-30T06:42:12.771327+0000","last_became_active":"2024-05-30T06:42:10.416996+0000","last_became_peered":"2024-05-30T06:42:10.416996+0000","last_unstale":"2024-05-30T06:42:12.771327+0000","last_undegraded":"2024-05-30T06:42:12.771327+0000","last_fullsized":"2024-05-30T06:42:12.771327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:43:33.658279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771209+0000","last_change":"2024-05-30T06:42:11.431024+0000","last_active":"2024-05-30T06:42:12.771209+0000","last_peered":"2024-05-30T06:42:12.771209+0000","last_clean":"2024-05-30T06:42:12.771209+0000","last_became_active":"2024-05-30T06:42:11.430771+0000","last_became_peered":"2024-05-30T06:42:11.430771+0000","last_unstale":"2024-05-30T06:42:12.771209+0000","last_undegraded":"2024-05-30T06:42:12.771209+0000","last_fullsized":"2024-05-30T06:42:12.771209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418934+0000","last_change":"2024-05-30T06:42:10.421013+0000","last_active":"2024-05-30T06:42:12.418934+0000","last_peered":"2024-05-30T06:42:12.418934+0000","last_clean":"2024-05-30T06:42:12.418934+0000","last_became_active":"2024-05-30T06:42:10.420539+0000","last_became_peered":"2024-05-30T06:42:10.420539+0000","last_unstale":"2024-05-30T06:42:12.418934+0000","last_undegraded":"2024-05-30T06:42:12.418934+0000","last_fullsized":"2024-05-30T06:42:12.418934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:17.465458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420071+0000","last_change":"2024-05-30T06:42:11.434422+0000","last_active":"2024-05-30T06:42:12.420071+0000","last_peered":"2024-05-30T06:42:12.420071+0000","last_clean":"2024-05-30T06:42:12.420071+0000","last_became_active":"2024-05-30T06:42:11.434086+0000","last_became_peered":"2024-05-30T06:42:11.434086+0000","last_unstale":"2024-05-30T06:42:12.420071+0000","last_undegraded":"2024-05-30T06:42:12.420071+0000","last_fullsized":"2024-05-30T06:42:12.420071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:41.693793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462252+0000","last_change":"2024-05-30T06:42:10.425809+0000","last_active":"2024-05-30T06:42:12.462252+0000","last_peered":"2024-05-30T06:42:12.462252+0000","last_clean":"2024-05-30T06:42:12.462252+0000","last_became_active":"2024-05-30T06:42:10.425322+0000","last_became_peered":"2024-05-30T06:42:10.425322+0000","last_unstale":"2024-05-30T06:42:12.462252+0000","last_undegraded":"2024-05-30T06:42:12.462252+0000","last_fullsized":"2024-05-30T06:42:12.462252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419005+0000","last_change":"2024-05-30T06:42:11.440849+0000","last_active":"2024-05-30T06:42:12.419005+0000","last_peered":"2024-05-30T06:42:12.419005+0000","last_clean":"2024-05-30T06:42:12.419005+0000","last_became_active":"2024-05-30T06:42:11.439120+0000","last_became_peered":"2024-05-30T06:42:11.439120+0000","last_unstale":"2024-05-30T06:42:12.419005+0000","last_undegraded":"2024-05-30T06:42:12.419005+0000","last_fullsized":"2024-05-30T06:42:12.419005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:34.897332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419128+0000","last_change":"2024-05-30T06:42:10.416914+0000","last_active":"2024-05-30T06:42:12.419128+0000","last_peered":"2024-05-30T06:42:12.419128+0000","last_clean":"2024-05-30T06:42:12.419128+0000","last_became_active":"2024-05-30T06:42:10.416544+0000","last_became_peered":"2024-05-30T06:42:10.416544+0000","last_unstale":"2024-05-30T06:42:12.419128+0000","last_undegraded":"2024-05-30T06:42:12.419128+0000","last_fullsized":"2024-05-30T06:42:12.419128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583510+0000","last_change":"2024-05-30T06:42:11.432338+0000","last_active":"2024-05-30T06:42:13.583510+0000","last_peered":"2024-05-30T06:42:13.583510+0000","last_clean":"2024-05-30T06:42:13.583510+0000","last_became_active":"2024-05-30T06:42:11.431974+0000","last_became_peered":"2024-05-30T06:42:11.431974+0000","last_unstale":"2024-05-30T06:42:13.583510+0000","last_undegraded":"2024-05-30T06:42:13.583510+0000","last_fullsized":"2024-05-30T06:42:13.583510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:16.106604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420302+0000","last_change":"2024-05-30T06:42:10.422438+0000","last_active":"2024-05-30T06:42:12.420302+0000","last_peered":"2024-05-30T06:42:12.420302+0000","last_clean":"2024-05-30T06:42:12.420302+0000","last_became_active":"2024-05-30T06:42:10.422143+0000","last_became_peered":"2024-05-30T06:42:10.422143+0000","last_unstale":"2024-05-30T06:42:12.420302+0000","last_undegraded":"2024-05-30T06:42:12.420302+0000","last_fullsized":"2024-05-30T06:42:12.420302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583814+0000","last_change":"2024-05-30T06:42:11.450964+0000","last_active":"2024-05-30T06:42:13.583814+0000","last_peered":"2024-05-30T06:42:13.583814+0000","last_clean":"2024-05-30T06:42:13.583814+0000","last_became_active":"2024-05-30T06:42:11.450676+0000","last_became_peered":"2024-05-30T06:42:11.450676+0000","last_unstale":"2024-05-30T06:42:13.583814+0000","last_undegraded":"2024-05-30T06:42:13.583814+0000","last_fullsized":"2024-05-30T06:42:13.583814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:28.603237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462153+0000","last_change":"2024-05-30T06:42:10.420535+0000","last_active":"2024-05-30T06:42:12.462153+0000","last_peered":"2024-05-30T06:42:12.462153+0000","last_clean":"2024-05-30T06:42:12.462153+0000","last_became_active":"2024-05-30T06:42:10.420249+0000","last_became_peered":"2024-05-30T06:42:10.420249+0000","last_unstale":"2024-05-30T06:42:12.462153+0000","last_undegraded":"2024-05-30T06:42:12.462153+0000","last_fullsized":"2024-05-30T06:42:12.462153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:57:09.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388267+0000","last_change":"2024-05-30T06:42:11.434347+0000","last_active":"2024-05-30T06:42:13.388267+0000","last_peered":"2024-05-30T06:42:13.388267+0000","last_clean":"2024-05-30T06:42:13.388267+0000","last_became_active":"2024-05-30T06:42:11.434073+0000","last_became_peered":"2024-05-30T06:42:11.434073+0000","last_unstale":"2024-05-30T06:42:13.388267+0000","last_undegraded":"2024-05-30T06:42:13.388267+0000","last_fullsized":"2024-05-30T06:42:13.388267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:34.897332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583309+0000","last_change":"2024-05-30T06:42:10.430485+0000","last_active":"2024-05-30T06:42:13.583309+0000","last_peered":"2024-05-30T06:42:13.583309+0000","last_clean":"2024-05-30T06:42:13.583309+0000","last_became_active":"2024-05-30T06:42:10.430203+0000","last_became_peered":"2024-05-30T06:42:10.430203+0000","last_unstale":"2024-05-30T06:42:13.583309+0000","last_undegraded":"2024-05-30T06:42:13.583309+0000","last_fullsized":"2024-05-30T06:42:13.583309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:32.085884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583022+0000","last_change":"2024-05-30T06:42:11.429543+0000","last_active":"2024-05-30T06:42:13.583022+0000","last_peered":"2024-05-30T06:42:13.583022+0000","last_clean":"2024-05-30T06:42:13.583022+0000","last_became_active":"2024-05-30T06:42:11.429230+0000","last_became_peered":"2024-05-30T06:42:11.429230+0000","last_unstale":"2024-05-30T06:42:13.583022+0000","last_undegraded":"2024-05-30T06:42:13.583022+0000","last_fullsized":"2024-05-30T06:42:13.583022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:35:23.153911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419025+0000","last_change":"2024-05-30T06:42:10.404506+0000","last_active":"2024-05-30T06:42:12.419025+0000","last_peered":"2024-05-30T06:42:12.419025+0000","last_clean":"2024-05-30T06:42:12.419025+0000","last_became_active":"2024-05-30T06:42:10.404194+0000","last_became_peered":"2024-05-30T06:42:10.404194+0000","last_unstale":"2024-05-30T06:42:12.419025+0000","last_undegraded":"2024-05-30T06:42:12.419025+0000","last_fullsized":"2024-05-30T06:42:12.419025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:57:09.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388251+0000","last_change":"2024-05-30T06:42:11.447385+0000","last_active":"2024-05-30T06:42:13.388251+0000","last_peered":"2024-05-30T06:42:13.388251+0000","last_clean":"2024-05-30T06:42:13.388251+0000","last_became_active":"2024-05-30T06:42:11.446929+0000","last_became_peered":"2024-05-30T06:42:11.446929+0000","last_unstale":"2024-05-30T06:42:13.388251+0000","last_undegraded":"2024-05-30T06:42:13.388251+0000","last_fullsized":"2024-05-30T06:42:13.388251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:28:18.705789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461885+0000","last_change":"2024-05-30T06:42:10.423499+0000","last_active":"2024-05-30T06:42:12.461885+0000","last_peered":"2024-05-30T06:42:12.461885+0000","last_clean":"2024-05-30T06:42:12.461885+0000","last_became_active":"2024-05-30T06:42:10.423116+0000","last_became_peered":"2024-05-30T06:42:10.423116+0000","last_unstale":"2024-05-30T06:42:12.461885+0000","last_undegraded":"2024-05-30T06:42:12.461885+0000","last_fullsized":"2024-05-30T06:42:12.461885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:17.465458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462086+0000","last_change":"2024-05-30T06:42:11.432468+0000","last_active":"2024-05-30T06:42:12.462086+0000","last_peered":"2024-05-30T06:42:12.462086+0000","last_clean":"2024-05-30T06:42:12.462086+0000","last_became_active":"2024-05-30T06:42:11.431747+0000","last_became_peered":"2024-05-30T06:42:11.431747+0000","last_unstale":"2024-05-30T06:42:12.462086+0000","last_undegraded":"2024-05-30T06:42:12.462086+0000","last_fullsized":"2024-05-30T06:42:12.462086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419214+0000","last_change":"2024-05-30T06:42:10.410699+0000","last_active":"2024-05-30T06:42:12.419214+0000","last_peered":"2024-05-30T06:42:12.419214+0000","last_clean":"2024-05-30T06:42:12.419214+0000","last_became_active":"2024-05-30T06:42:10.410248+0000","last_became_peered":"2024-05-30T06:42:10.410248+0000","last_unstale":"2024-05-30T06:42:12.419214+0000","last_undegraded":"2024-05-30T06:42:12.419214+0000","last_fullsized":"2024-05-30T06:42:12.419214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388106+0000","last_change":"2024-05-30T06:42:11.448104+0000","last_active":"2024-05-30T06:42:13.388106+0000","last_peered":"2024-05-30T06:42:13.388106+0000","last_clean":"2024-05-30T06:42:13.388106+0000","last_became_active":"2024-05-30T06:42:11.446869+0000","last_became_peered":"2024-05-30T06:42:11.446869+0000","last_unstale":"2024-05-30T06:42:13.388106+0000","last_undegraded":"2024-05-30T06:42:13.388106+0000","last_fullsized":"2024-05-30T06:42:13.388106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:07.193945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583774+0000","last_change":"2024-05-30T06:42:10.428483+0000","last_active":"2024-05-30T06:42:13.583774+0000","last_peered":"2024-05-30T06:42:13.583774+0000","last_clean":"2024-05-30T06:42:13.583774+0000","last_became_active":"2024-05-30T06:42:10.428191+0000","last_became_peered":"2024-05-30T06:42:10.428191+0000","last_unstale":"2024-05-30T06:42:13.583774+0000","last_undegraded":"2024-05-30T06:42:13.583774+0000","last_fullsized":"2024-05-30T06:42:13.583774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:32.085884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388487+0000","last_change":"2024-05-30T06:42:11.446064+0000","last_active":"2024-05-30T06:42:13.388487+0000","last_peered":"2024-05-30T06:42:13.388487+0000","last_clean":"2024-05-30T06:42:13.388487+0000","last_became_active":"2024-05-30T06:42:11.445744+0000","last_became_peered":"2024-05-30T06:42:11.445744+0000","last_unstale":"2024-05-30T06:42:13.388487+0000","last_undegraded":"2024-05-30T06:42:13.388487+0000","last_fullsized":"2024-05-30T06:42:13.388487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:29:42.983707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419615+0000","last_change":"2024-05-30T06:42:10.406964+0000","last_active":"2024-05-30T06:42:12.419615+0000","last_peered":"2024-05-30T06:42:12.419615+0000","last_clean":"2024-05-30T06:42:12.419615+0000","last_became_active":"2024-05-30T06:42:10.406664+0000","last_became_peered":"2024-05-30T06:42:10.406664+0000","last_unstale":"2024-05-30T06:42:12.419615+0000","last_undegraded":"2024-05-30T06:42:12.419615+0000","last_fullsized":"2024-05-30T06:42:12.419615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:27.594625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388727+0000","last_change":"2024-05-30T06:42:11.454278+0000","last_active":"2024-05-30T06:42:13.388727+0000","last_peered":"2024-05-30T06:42:13.388727+0000","last_clean":"2024-05-30T06:42:13.388727+0000","last_became_active":"2024-05-30T06:42:11.453964+0000","last_became_peered":"2024-05-30T06:42:11.453964+0000","last_unstale":"2024-05-30T06:42:13.388727+0000","last_undegraded":"2024-05-30T06:42:13.388727+0000","last_fullsized":"2024-05-30T06:42:13.388727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:17:43.098464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420404+0000","last_change":"2024-05-30T06:42:10.423747+0000","last_active":"2024-05-30T06:42:12.420404+0000","last_peered":"2024-05-30T06:42:12.420404+0000","last_clean":"2024-05-30T06:42:12.420404+0000","last_became_active":"2024-05-30T06:42:10.423406+0000","last_became_peered":"2024-05-30T06:42:10.423406+0000","last_unstale":"2024-05-30T06:42:12.420404+0000","last_undegraded":"2024-05-30T06:42:12.420404+0000","last_fullsized":"2024-05-30T06:42:12.420404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419052+0000","last_change":"2024-05-30T06:42:11.433867+0000","last_active":"2024-05-30T06:42:12.419052+0000","last_peered":"2024-05-30T06:42:12.419052+0000","last_clean":"2024-05-30T06:42:12.419052+0000","last_became_active":"2024-05-30T06:42:11.433302+0000","last_became_peered":"2024-05-30T06:42:11.433302+0000","last_unstale":"2024-05-30T06:42:12.419052+0000","last_undegraded":"2024-05-30T06:42:12.419052+0000","last_fullsized":"2024-05-30T06:42:12.419052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:09:54.618681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419361+0000","last_change":"2024-05-30T06:42:10.411777+0000","last_active":"2024-05-30T06:42:12.419361+0000","last_peered":"2024-05-30T06:42:12.419361+0000","last_clean":"2024-05-30T06:42:12.419361+0000","last_became_active":"2024-05-30T06:42:10.409724+0000","last_became_peered":"2024-05-30T06:42:10.409724+0000","last_unstale":"2024-05-30T06:42:12.419361+0000","last_undegraded":"2024-05-30T06:42:12.419361+0000","last_fullsized":"2024-05-30T06:42:12.419361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388269+0000","last_change":"2024-05-30T06:42:11.439053+0000","last_active":"2024-05-30T06:42:13.388269+0000","last_peered":"2024-05-30T06:42:13.388269+0000","last_clean":"2024-05-30T06:42:13.388269+0000","last_became_active":"2024-05-30T06:42:11.438190+0000","last_became_peered":"2024-05-30T06:42:11.438190+0000","last_unstale":"2024-05-30T06:42:13.388269+0000","last_undegraded":"2024-05-30T06:42:13.388269+0000","last_fullsized":"2024-05-30T06:42:13.388269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:09:54.618681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387999+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:42:13.387999+0000","last_peered":"2024-05-30T06:42:13.387999+0000","last_clean":"2024-05-30T06:42:13.387999+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:42:13.387999+0000","last_undegraded":"2024-05-30T06:42:13.387999+0000","last_fullsized":"2024-05-30T06:42:13.387999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418494+0000","last_change":"2024-05-30T06:42:10.410644+0000","last_active":"2024-05-30T06:42:12.418494+0000","last_peered":"2024-05-30T06:42:12.418494+0000","last_clean":"2024-05-30T06:42:12.418494+0000","last_became_active":"2024-05-30T06:42:10.408941+0000","last_became_peered":"2024-05-30T06:42:10.408941+0000","last_unstale":"2024-05-30T06:42:12.418494+0000","last_undegraded":"2024-05-30T06:42:12.418494+0000","last_fullsized":"2024-05-30T06:42:12.418494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771269+0000","last_change":"2024-05-30T06:42:11.437096+0000","last_active":"2024-05-30T06:42:12.771269+0000","last_peered":"2024-05-30T06:42:12.771269+0000","last_clean":"2024-05-30T06:42:12.771269+0000","last_became_active":"2024-05-30T06:42:11.436706+0000","last_became_peered":"2024-05-30T06:42:11.436706+0000","last_unstale":"2024-05-30T06:42:12.771269+0000","last_undegraded":"2024-05-30T06:42:12.771269+0000","last_fullsized":"2024-05-30T06:42:12.771269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387891+0000","last_change":"2024-05-30T06:42:10.422330+0000","last_active":"2024-05-30T06:42:13.387891+0000","last_peered":"2024-05-30T06:42:13.387891+0000","last_clean":"2024-05-30T06:42:13.387891+0000","last_became_active":"2024-05-30T06:42:10.422034+0000","last_became_peered":"2024-05-30T06:42:10.422034+0000","last_unstale":"2024-05-30T06:42:13.387891+0000","last_undegraded":"2024-05-30T06:42:13.387891+0000","last_fullsized":"2024-05-30T06:42:13.387891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:18:25.786944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583063+0000","last_change":"2024-05-30T06:42:11.452846+0000","last_active":"2024-05-30T06:42:13.583063+0000","last_peered":"2024-05-30T06:42:13.583063+0000","last_clean":"2024-05-30T06:42:13.583063+0000","last_became_active":"2024-05-30T06:42:11.452493+0000","last_became_peered":"2024-05-30T06:42:11.452493+0000","last_unstale":"2024-05-30T06:42:13.583063+0000","last_undegraded":"2024-05-30T06:42:13.583063+0000","last_fullsized":"2024-05-30T06:42:13.583063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:26:07.087132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419326+0000","last_change":"2024-05-30T06:42:10.404739+0000","last_active":"2024-05-30T06:42:12.419326+0000","last_peered":"2024-05-30T06:42:12.419326+0000","last_clean":"2024-05-30T06:42:12.419326+0000","last_became_active":"2024-05-30T06:42:10.404322+0000","last_became_peered":"2024-05-30T06:42:10.404322+0000","last_unstale":"2024-05-30T06:42:12.419326+0000","last_undegraded":"2024-05-30T06:42:12.419326+0000","last_fullsized":"2024-05-30T06:42:12.419326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420083+0000","last_change":"2024-05-30T06:42:11.439108+0000","last_active":"2024-05-30T06:42:12.420083+0000","last_peered":"2024-05-30T06:42:12.420083+0000","last_clean":"2024-05-30T06:42:12.420083+0000","last_became_active":"2024-05-30T06:42:11.438818+0000","last_became_peered":"2024-05-30T06:42:11.438818+0000","last_unstale":"2024-05-30T06:42:12.420083+0000","last_undegraded":"2024-05-30T06:42:12.420083+0000","last_fullsized":"2024-05-30T06:42:12.420083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:06:05.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419032+0000","last_change":"2024-05-30T06:42:10.411897+0000","last_active":"2024-05-30T06:42:12.419032+0000","last_peered":"2024-05-30T06:42:12.419032+0000","last_clean":"2024-05-30T06:42:12.419032+0000","last_became_active":"2024-05-30T06:42:10.411626+0000","last_became_peered":"2024-05-30T06:42:10.411626+0000","last_unstale":"2024-05-30T06:42:12.419032+0000","last_undegraded":"2024-05-30T06:42:12.419032+0000","last_fullsized":"2024-05-30T06:42:12.419032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:30.677919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583703+0000","last_change":"2024-05-30T06:42:11.446187+0000","last_active":"2024-05-30T06:42:13.583703+0000","last_peered":"2024-05-30T06:42:13.583703+0000","last_clean":"2024-05-30T06:42:13.583703+0000","last_became_active":"2024-05-30T06:42:11.445840+0000","last_became_peered":"2024-05-30T06:42:11.445840+0000","last_unstale":"2024-05-30T06:42:13.583703+0000","last_undegraded":"2024-05-30T06:42:13.583703+0000","last_fullsized":"2024-05-30T06:42:13.583703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:34.809415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420422+0000","last_change":"2024-05-30T06:42:10.428270+0000","last_active":"2024-05-30T06:42:12.420422+0000","last_peered":"2024-05-30T06:42:12.420422+0000","last_clean":"2024-05-30T06:42:12.420422+0000","last_became_active":"2024-05-30T06:42:10.427910+0000","last_became_peered":"2024-05-30T06:42:10.427910+0000","last_unstale":"2024-05-30T06:42:12.420422+0000","last_undegraded":"2024-05-30T06:42:12.420422+0000","last_fullsized":"2024-05-30T06:42:12.420422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:27.594625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418876+0000","last_change":"2024-05-30T06:42:11.438157+0000","last_active":"2024-05-30T06:42:12.418876+0000","last_peered":"2024-05-30T06:42:12.418876+0000","last_clean":"2024-05-30T06:42:12.418876+0000","last_became_active":"2024-05-30T06:42:11.437756+0000","last_became_peered":"2024-05-30T06:42:11.437756+0000","last_unstale":"2024-05-30T06:42:12.418876+0000","last_undegraded":"2024-05-30T06:42:12.418876+0000","last_fullsized":"2024-05-30T06:42:12.418876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:12.472477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388512+0000","last_change":"2024-05-30T06:42:10.427812+0000","last_active":"2024-05-30T06:42:13.388512+0000","last_peered":"2024-05-30T06:42:13.388512+0000","last_clean":"2024-05-30T06:42:13.388512+0000","last_became_active":"2024-05-30T06:42:10.427455+0000","last_became_peered":"2024-05-30T06:42:10.427455+0000","last_unstale":"2024-05-30T06:42:13.388512+0000","last_undegraded":"2024-05-30T06:42:13.388512+0000","last_fullsized":"2024-05-30T06:42:13.388512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:07:15.070876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420523+0000","last_change":"2024-05-30T06:42:11.440605+0000","last_active":"2024-05-30T06:42:12.420523+0000","last_peered":"2024-05-30T06:42:12.420523+0000","last_clean":"2024-05-30T06:42:12.420523+0000","last_became_active":"2024-05-30T06:42:11.440283+0000","last_became_peered":"2024-05-30T06:42:11.440283+0000","last_unstale":"2024-05-30T06:42:12.420523+0000","last_undegraded":"2024-05-30T06:42:12.420523+0000","last_fullsized":"2024-05-30T06:42:12.420523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.461531+0000","last_change":"2024-05-30T06:42:10.418655+0000","last_active":"2024-05-30T06:42:12.461531+0000","last_peered":"2024-05-30T06:42:12.461531+0000","last_clean":"2024-05-30T06:42:12.461531+0000","last_became_active":"2024-05-30T06:42:10.418341+0000","last_became_peered":"2024-05-30T06:42:10.418341+0000","last_unstale":"2024-05-30T06:42:12.461531+0000","last_undegraded":"2024-05-30T06:42:12.461531+0000","last_fullsized":"2024-05-30T06:42:12.461531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:18:25.786944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771711+0000","last_change":"2024-05-30T06:42:11.443605+0000","last_active":"2024-05-30T06:42:12.771711+0000","last_peered":"2024-05-30T06:42:12.771711+0000","last_clean":"2024-05-30T06:42:12.771711+0000","last_became_active":"2024-05-30T06:42:11.443352+0000","last_became_peered":"2024-05-30T06:42:11.443352+0000","last_unstale":"2024-05-30T06:42:12.771711+0000","last_undegraded":"2024-05-30T06:42:12.771711+0000","last_fullsized":"2024-05-30T06:42:12.771711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:07.193945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462314+0000","last_change":"2024-05-30T06:42:10.418571+0000","last_active":"2024-05-30T06:42:12.462314+0000","last_peered":"2024-05-30T06:42:12.462314+0000","last_clean":"2024-05-30T06:42:12.462314+0000","last_became_active":"2024-05-30T06:42:10.418264+0000","last_became_peered":"2024-05-30T06:42:10.418264+0000","last_unstale":"2024-05-30T06:42:12.462314+0000","last_undegraded":"2024-05-30T06:42:12.462314+0000","last_fullsized":"2024-05-30T06:42:12.462314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:33.800803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583371+0000","last_change":"2024-05-30T06:42:11.425449+0000","last_active":"2024-05-30T06:42:13.583371+0000","last_peered":"2024-05-30T06:42:13.583371+0000","last_clean":"2024-05-30T06:42:13.583371+0000","last_became_active":"2024-05-30T06:42:11.425140+0000","last_became_peered":"2024-05-30T06:42:11.425140+0000","last_unstale":"2024-05-30T06:42:13.583371+0000","last_undegraded":"2024-05-30T06:42:13.583371+0000","last_fullsized":"2024-05-30T06:42:13.583371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:13.986498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.387867+0000","last_change":"2024-05-30T06:42:10.426724+0000","last_active":"2024-05-30T06:42:13.387867+0000","last_peered":"2024-05-30T06:42:13.387867+0000","last_clean":"2024-05-30T06:42:13.387867+0000","last_became_active":"2024-05-30T06:42:10.426443+0000","last_became_peered":"2024-05-30T06:42:10.426443+0000","last_unstale":"2024-05-30T06:42:13.387867+0000","last_undegraded":"2024-05-30T06:42:13.387867+0000","last_fullsized":"2024-05-30T06:42:13.387867+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:58:27.594625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583558+0000","last_change":"2024-05-30T06:42:11.441051+0000","last_active":"2024-05-30T06:42:13.583558+0000","last_peered":"2024-05-30T06:42:13.583558+0000","last_clean":"2024-05-30T06:42:13.583558+0000","last_became_active":"2024-05-30T06:42:11.440776+0000","last_became_peered":"2024-05-30T06:42:11.440776+0000","last_unstale":"2024-05-30T06:42:13.583558+0000","last_undegraded":"2024-05-30T06:42:13.583558+0000","last_fullsized":"2024-05-30T06:42:13.583558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:11:31.686531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420193+0000","last_change":"2024-05-30T06:42:10.423040+0000","last_active":"2024-05-30T06:42:12.420193+0000","last_peered":"2024-05-30T06:42:12.420193+0000","last_clean":"2024-05-30T06:42:12.420193+0000","last_became_active":"2024-05-30T06:42:10.422580+0000","last_became_peered":"2024-05-30T06:42:10.422580+0000","last_unstale":"2024-05-30T06:42:12.420193+0000","last_undegraded":"2024-05-30T06:42:12.420193+0000","last_fullsized":"2024-05-30T06:42:12.420193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:57:09.252773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771674+0000","last_change":"2024-05-30T06:42:11.431142+0000","last_active":"2024-05-30T06:42:12.771674+0000","last_peered":"2024-05-30T06:42:12.771674+0000","last_clean":"2024-05-30T06:42:12.771674+0000","last_became_active":"2024-05-30T06:42:11.430833+0000","last_became_peered":"2024-05-30T06:42:11.430833+0000","last_unstale":"2024-05-30T06:42:12.771674+0000","last_undegraded":"2024-05-30T06:42:12.771674+0000","last_fullsized":"2024-05-30T06:42:12.771674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:12.472477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.420260+0000","last_change":"2024-05-30T06:42:10.415437+0000","last_active":"2024-05-30T06:42:12.420260+0000","last_peered":"2024-05-30T06:42:12.420260+0000","last_clean":"2024-05-30T06:42:12.420260+0000","last_became_active":"2024-05-30T06:42:10.414954+0000","last_became_peered":"2024-05-30T06:42:10.414954+0000","last_unstale":"2024-05-30T06:42:12.420260+0000","last_undegraded":"2024-05-30T06:42:12.420260+0000","last_fullsized":"2024-05-30T06:42:12.420260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:23:43.447404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771534+0000","last_change":"2024-05-30T06:42:11.429843+0000","last_active":"2024-05-30T06:42:12.771534+0000","last_peered":"2024-05-30T06:42:12.771534+0000","last_clean":"2024-05-30T06:42:12.771534+0000","last_became_active":"2024-05-30T06:42:11.429428+0000","last_became_peered":"2024-05-30T06:42:11.429428+0000","last_unstale":"2024-05-30T06:42:12.771534+0000","last_undegraded":"2024-05-30T06:42:12.771534+0000","last_fullsized":"2024-05-30T06:42:12.771534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:04:58.409141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388321+0000","last_change":"2024-05-30T06:42:10.430372+0000","last_active":"2024-05-30T06:42:13.388321+0000","last_peered":"2024-05-30T06:42:13.388321+0000","last_clean":"2024-05-30T06:42:13.388321+0000","last_became_active":"2024-05-30T06:42:10.430029+0000","last_became_peered":"2024-05-30T06:42:10.430029+0000","last_unstale":"2024-05-30T06:42:13.388321+0000","last_undegraded":"2024-05-30T06:42:13.388321+0000","last_fullsized":"2024-05-30T06:42:13.388321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:51:39.946209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.462037+0000","last_change":"2024-05-30T06:42:11.450489+0000","last_active":"2024-05-30T06:42:12.462037+0000","last_peered":"2024-05-30T06:42:12.462037+0000","last_clean":"2024-05-30T06:42:12.462037+0000","last_became_active":"2024-05-30T06:42:11.446807+0000","last_became_peered":"2024-05-30T06:42:11.446807+0000","last_unstale":"2024-05-30T06:42:12.462037+0000","last_undegraded":"2024-05-30T06:42:12.462037+0000","last_fullsized":"2024-05-30T06:42:12.462037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:41.693793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.418833+0000","last_change":"2024-05-30T06:42:11.446469+0000","last_active":"2024-05-30T06:42:12.418833+0000","last_peered":"2024-05-30T06:42:12.418833+0000","last_clean":"2024-05-30T06:42:12.418833+0000","last_became_active":"2024-05-30T06:42:11.446178+0000","last_became_peered":"2024-05-30T06:42:11.446178+0000","last_unstale":"2024-05-30T06:42:12.418833+0000","last_undegraded":"2024-05-30T06:42:12.418833+0000","last_fullsized":"2024-05-30T06:42:12.418833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:05.695381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388169+0000","last_change":"2024-05-30T06:42:10.424259+0000","last_active":"2024-05-30T06:42:13.388169+0000","last_peered":"2024-05-30T06:42:13.388169+0000","last_clean":"2024-05-30T06:42:13.388169+0000","last_became_active":"2024-05-30T06:42:10.423972+0000","last_became_peered":"2024-05-30T06:42:10.423972+0000","last_unstale":"2024-05-30T06:42:13.388169+0000","last_undegraded":"2024-05-30T06:42:13.388169+0000","last_fullsized":"2024-05-30T06:42:13.388169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:06:59.985658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.419003+0000","last_change":"2024-05-30T06:42:11.451914+0000","last_active":"2024-05-30T06:42:12.419003+0000","last_peered":"2024-05-30T06:42:12.419003+0000","last_clean":"2024-05-30T06:42:12.419003+0000","last_became_active":"2024-05-30T06:42:11.451633+0000","last_became_peered":"2024-05-30T06:42:11.451633+0000","last_unstale":"2024-05-30T06:42:12.419003+0000","last_undegraded":"2024-05-30T06:42:12.419003+0000","last_fullsized":"2024-05-30T06:42:12.419003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:28:18.705789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.388431+0000","last_change":"2024-05-30T06:42:10.427805+0000","last_active":"2024-05-30T06:42:13.388431+0000","last_peered":"2024-05-30T06:42:13.388431+0000","last_clean":"2024-05-30T06:42:13.388431+0000","last_became_active":"2024-05-30T06:42:10.427452+0000","last_became_peered":"2024-05-30T06:42:10.427452+0000","last_unstale":"2024-05-30T06:42:13.388431+0000","last_undegraded":"2024-05-30T06:42:13.388431+0000","last_fullsized":"2024-05-30T06:42:13.388431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:52.729379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583434+0000","last_change":"2024-05-30T06:42:11.432129+0000","last_active":"2024-05-30T06:42:13.583434+0000","last_peered":"2024-05-30T06:42:13.583434+0000","last_clean":"2024-05-30T06:42:13.583434+0000","last_became_active":"2024-05-30T06:42:11.431823+0000","last_became_peered":"2024-05-30T06:42:11.431823+0000","last_unstale":"2024-05-30T06:42:13.583434+0000","last_undegraded":"2024-05-30T06:42:13.583434+0000","last_fullsized":"2024-05-30T06:42:13.583434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771534+0000","last_change":"2024-05-30T06:42:10.426946+0000","last_active":"2024-05-30T06:42:12.771534+0000","last_peered":"2024-05-30T06:42:12.771534+0000","last_clean":"2024-05-30T06:42:12.771534+0000","last_became_active":"2024-05-30T06:42:10.426667+0000","last_became_peered":"2024-05-30T06:42:10.426667+0000","last_unstale":"2024-05-30T06:42:12.771534+0000","last_undegraded":"2024-05-30T06:42:12.771534+0000","last_fullsized":"2024-05-30T06:42:12.771534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:17.465458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:12.771418+0000","last_change":"2024-05-30T06:42:11.436144+0000","last_active":"2024-05-30T06:42:12.771418+0000","last_peered":"2024-05-30T06:42:12.771418+0000","last_clean":"2024-05-30T06:42:12.771418+0000","last_became_active":"2024-05-30T06:42:11.435885+0000","last_became_peered":"2024-05-30T06:42:11.435885+0000","last_unstale":"2024-05-30T06:42:12.771418+0000","last_undegraded":"2024-05-30T06:42:12.771418+0000","last_fullsized":"2024-05-30T06:42:12.771418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:10.388974+0000","last_clean_scrub_stamp":"2024-05-30T06:42:10.388974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:28:43.725135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-30T06:42:13.583529+0000","last_change":"2024-05-30T06:42:10.433516+0000","last_active":"2024-05-30T06:42:13.583529+0000","last_peered":"2024-05-30T06:42:13.583529+0000","last_clean":"2024-05-30T06:42:13.583529+0000","last_became_active":"2024-05-30T06:42:10.433200+0000","last_became_peered":"2024-05-30T06:42:10.433200+0000","last_unstale":"2024-05-30T06:42:13.583529+0000","last_undegraded":"2024-05-30T06:42:13.583529+0000","last_fullsized":"2024-05-30T06:42:13.583529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:42:09.380362+0000","last_clean_scrub_stamp":"2024-05-30T06:42:09.380362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:43:33.658279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:42:20.670 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T06:42:20.670 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-30T06:42:20.670 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-30T06:42:20.670 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-30T06:42:20.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.851+0000 7fafbd800640 1 Processor -- start 2024-05-30T06:42:20.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.851+0000 7fafbd800640 1 -- start start 2024-05-30T06:42:20.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.851+0000 7fafbd800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafb815cd80 0x7fafb806f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.851+0000 7fafbd800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fafb80ce8d0 0x7fafb80ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.851+0000 7fafbd800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb80cd120 con 0x7fafb806e000 2024-05-30T06:42:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.851+0000 7fafbd800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fafb80a9530 con 0x7fafb815cd80 2024-05-30T06:42:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.851+0000 7fafbd800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fafb80cd400 con 0x7fafb80ce8d0 2024-05-30T06:42:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.851+0000 7fafafe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafb815cd80 0x7fafb806f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.855+0000 7fafafe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafb815cd80 0x7fafb806f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34134/0 (socket says 172.21.15.37:34134) 2024-05-30T06:42:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.855+0000 7fafafe00640 1 -- 172.21.15.37:0/333876949 learned_addr learned my addr 172.21.15.37:0/333876949 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.855+0000 7fafb7400640 1 --2- 172.21.15.37:0/333876949 >> v2:172.21.15.105:3300/0 conn(0x7fafb80ce8d0 0x7fafb80ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.855+0000 7fafafe00640 1 -- 172.21.15.37:0/333876949 >> v2:172.21.15.105:3300/0 conn(0x7fafb80ce8d0 msgr2=0x7fafb80ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:20.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.855+0000 7fafafe00640 1 --2- 172.21.15.37:0/333876949 >> v2:172.21.15.105:3300/0 conn(0x7fafb80ce8d0 0x7fafb80ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.855+0000 7fafafe00640 1 -- 172.21.15.37:0/333876949 >> v1:172.21.15.105:6789/0 conn(0x7fafb806e000 legacy=0x7fafb80ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:20.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.855+0000 7fafafe00640 1 -- 172.21.15.37:0/333876949 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb80cd6e0 con 0x7fafb815cd80 2024-05-30T06:42:20.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.855+0000 7fafafe00640 1 --2- 172.21.15.37:0/333876949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafb815cd80 0x7fafb806f3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fafb806c7b0 tx=0x7fafa001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6825739144f84dfc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:20.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.855+0000 7fafb6000640 1 -- 172.21.15.37:0/333876949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa00b5070 con 0x7fafb815cd80 2024-05-30T06:42:20.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.855+0000 7fafb6000640 1 -- 172.21.15.37:0/333876949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa00a89d0 con 0x7fafb815cd80 2024-05-30T06:42:20.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.855+0000 7fafb6000640 1 -- 172.21.15.37:0/333876949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa00a8da0 con 0x7fafb815cd80 2024-05-30T06:42:20.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 -- 172.21.15.37:0/333876949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafb815cd80 msgr2=0x7fafb806f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 --2- 172.21.15.37:0/333876949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafb815cd80 0x7fafb806f3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fafb806c7b0 tx=0x7fafa001ecd0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 -- 172.21.15.37:0/333876949 shutdown_connections 2024-05-30T06:42:20.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 --2- 172.21.15.37:0/333876949 >> v2:172.21.15.105:3300/0 conn(0x7fafb80ce8d0 0x7fafb80ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 --2- 172.21.15.37:0/333876949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafb815cd80 0x7fafb806f3f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 -- 172.21.15.37:0/333876949 >> 172.21.15.37:0/333876949 conn(0x7fafb80b23a0 msgr2=0x7fafb80b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:20.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 -- 172.21.15.37:0/333876949 shutdown_connections 2024-05-30T06:42:20.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 -- 172.21.15.37:0/333876949 wait complete. 2024-05-30T06:42:20.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 Processor -- start 2024-05-30T06:42:20.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 -- start start 2024-05-30T06:42:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafb806e000 0x7fafb80b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb80ce8d0 0x7fafb81f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafb815cd80 0x7fafb8132840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fafb806f930 con 0x7fafb815cd80 2024-05-30T06:42:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80cdca0 con 0x7fafb80ce8d0 2024-05-30T06:42:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fafb806fab0 con 0x7fafb806e000 2024-05-30T06:42:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafb7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafb815cd80 0x7fafb8132840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafb7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafb815cd80 0x7fafb8132840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34150/0 (socket says 172.21.15.37:34150) 2024-05-30T06:42:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafb7400640 1 -- 172.21.15.37:0/2290476984 learned_addr learned my addr 172.21.15.37:0/2290476984 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafb7400640 1 -- 172.21.15.37:0/2290476984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafb806e000 msgr2=0x7fafb80b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafb7400640 1 --2- 172.21.15.37:0/2290476984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafb806e000 0x7fafb80b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafb7400640 1 -- 172.21.15.37:0/2290476984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb80ce8d0 msgr2=0x7fafb81f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafb7400640 1 --2- 172.21.15.37:0/2290476984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb80ce8d0 0x7fafb81f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafb7400640 1 -- 172.21.15.37:0/2290476984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb815fc10 con 0x7fafb815cd80 2024-05-30T06:42:20.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafb7400640 1 --2- 172.21.15.37:0/2290476984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafb815cd80 0x7fafb8132840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fafb0007e70 tx=0x7fafb000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafaea00640 1 -- 172.21.15.37:0/2290476984 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0014620 con 0x7fafb815cd80 2024-05-30T06:42:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafaea00640 1 -- 172.21.15.37:0/2290476984 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0019070 con 0x7fafb815cd80 2024-05-30T06:42:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafaea00640 1 -- 172.21.15.37:0/2290476984 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0014a20 con 0x7fafb815cd80 2024-05-30T06:42:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.859+0000 7fafbd800640 1 -- 172.21.15.37:0/2290476984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb815fef0 con 0x7fafb815cd80 2024-05-30T06:42:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.863+0000 7fafbd800640 1 -- 172.21.15.37:0/2290476984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb80b4180 con 0x7fafb815cd80 2024-05-30T06:42:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.863+0000 7fafbd800640 1 -- 172.21.15.37:0/2290476984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb815f9a0 con 0x7fafb815cd80 2024-05-30T06:42:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.863+0000 7fafaea00640 1 -- 172.21.15.37:0/2290476984 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fafb0014bc0 con 0x7fafb815cd80 2024-05-30T06:42:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.863+0000 7fafaea00640 1 --2- 172.21.15.37:0/2290476984 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faf94068380 0x7faf9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.863+0000 7fafaea00640 1 -- 172.21.15.37:0/2290476984 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fafb0087370 con 0x7fafb815cd80 2024-05-30T06:42:20.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.863+0000 7fafb6a00640 1 --2- 172.21.15.37:0/2290476984 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faf94068380 0x7faf9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:20.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.867+0000 7fafb6a00640 1 --2- 172.21.15.37:0/2290476984 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faf94068380 0x7faf9406a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fafa8009670 tx=0x7fafa8006bd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:20.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:20.867+0000 7fafaea00640 1 -- 172.21.15.37:0/2290476984 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fafb0011260 con 0x7fafb815cd80 2024-05-30T06:42:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.067+0000 7fafbd800640 1 -- 172.21.15.37:0/2290476984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fafb8068b20 con 0x7fafb815cd80 2024-05-30T06:42:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.067+0000 7fafaea00640 1 -- 172.21.15.37:0/2290476984 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fafb0057890 con 0x7fafb815cd80 2024-05-30T06:42:21.067 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:21.067 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-30T06:42:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.071+0000 7fafbd800640 1 -- 172.21.15.37:0/2290476984 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faf94068380 msgr2=0x7faf9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.071+0000 7fafbd800640 1 --2- 172.21.15.37:0/2290476984 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faf94068380 0x7faf9406a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fafa8009670 tx=0x7fafa8006bd0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.071+0000 7fafbd800640 1 -- 172.21.15.37:0/2290476984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafb815cd80 msgr2=0x7fafb8132840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.071+0000 7fafbd800640 1 --2- 172.21.15.37:0/2290476984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafb815cd80 0x7fafb8132840 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fafb0007e70 tx=0x7fafb000e4b0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.071+0000 7fafbd800640 1 -- 172.21.15.37:0/2290476984 shutdown_connections 2024-05-30T06:42:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.071+0000 7fafbd800640 1 --2- 172.21.15.37:0/2290476984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafb815cd80 0x7fafb8132840 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.071+0000 7fafbd800640 1 --2- 172.21.15.37:0/2290476984 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faf94068380 0x7faf9406a840 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.071+0000 7fafbd800640 1 --2- 172.21.15.37:0/2290476984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafb80ce8d0 0x7fafb81f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.071+0000 7fafbd800640 1 --2- 172.21.15.37:0/2290476984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafb806e000 0x7fafb80b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.071+0000 7fafbd800640 1 -- 172.21.15.37:0/2290476984 >> 172.21.15.37:0/2290476984 conn(0x7fafb80b23a0 msgr2=0x7fafb806e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.071+0000 7fafbd800640 1 -- 172.21.15.37:0/2290476984 shutdown_connections 2024-05-30T06:42:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.071+0000 7fafbd800640 1 -- 172.21.15.37:0/2290476984 wait complete. 2024-05-30T06:42:21.088 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-30T06:42:21.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:21.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.227+0000 7ffbeb200640 1 Processor -- start 2024-05-30T06:42:21.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbeb200640 1 -- start start 2024-05-30T06:42:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbeb200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffbec06fc50 0x7ffbec06b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbeb200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbec0b6680 con 0x7ffbec147510 2024-05-30T06:42:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbeb200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbec0700e0 con 0x7ffbec06f870 2024-05-30T06:42:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbeb200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ffbec06f3e0 con 0x7ffbec06fc50 2024-05-30T06:42:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbe9e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffbec147510 0x7ffbec0708a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47766/0 (socket says 172.21.15.37:47766) 2024-05-30T06:42:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbe9e00640 1 -- 172.21.15.37:0/1176251901 learned_addr learned my addr 172.21.15.37:0/1176251901 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbea800640 1 --2- 172.21.15.37:0/1176251901 >> v2:172.21.15.105:3300/0 conn(0x7ffbec06fc50 0x7ffbec06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbe8a00640 1 -- 172.21.15.37:0/1176251901 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2265630187 0 0) 0x7ffbec0b6680 con 0x7ffbec147510 2024-05-30T06:42:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbe8a00640 1 -- 172.21.15.37:0/1176251901 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbd0003530 con 0x7ffbec147510 2024-05-30T06:42:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbe8a00640 1 -- 172.21.15.37:0/1176251901 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184367196 0 0) 0x7ffbd8001120 con 0x7ffbec06f870 2024-05-30T06:42:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbe8a00640 1 -- 172.21.15.37:0/1176251901 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbec0b6680 con 0x7ffbec06f870 2024-05-30T06:42:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbe8a00640 1 -- 172.21.15.37:0/1176251901 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3756332272 0 0) 0x7ffbd0003530 con 0x7ffbec147510 2024-05-30T06:42:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbea800640 1 -- 172.21.15.37:0/1176251901 >> v1:172.21.15.105:6789/0 conn(0x7ffbec06f870 legacy=0x7ffbec0ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbea800640 1 -- 172.21.15.37:0/1176251901 >> v1:172.21.15.37:6789/0 conn(0x7ffbec147510 legacy=0x7ffbec0708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.231+0000 7ffbea800640 1 -- 172.21.15.37:0/1176251901 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec1478f0 con 0x7ffbec06fc50 2024-05-30T06:42:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.235+0000 7ffbea800640 1 --2- 172.21.15.37:0/1176251901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbec06fc50 0x7ffbec06b960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009d90 tx=0x7ffbe401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ac98886bf4656a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.235+0000 7ffbe8a00640 1 -- 172.21.15.37:0/1176251901 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe40b2070 con 0x7ffbec06fc50 2024-05-30T06:42:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.235+0000 7ffbe8a00640 1 -- 172.21.15.37:0/1176251901 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe40a55e0 con 0x7ffbec06fc50 2024-05-30T06:42:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.235+0000 7ffbe8a00640 1 -- 172.21.15.37:0/1176251901 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc001680 con 0x7ffbec06fc50 2024-05-30T06:42:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.235+0000 7ffbeb200640 1 -- 172.21.15.37:0/1176251901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbec06fc50 msgr2=0x7ffbec06b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.235+0000 7ffbeb200640 1 --2- 172.21.15.37:0/1176251901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbec06fc50 0x7ffbec06b960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009d90 tx=0x7ffbe401c890 comp rx=0 tx=0).stop 2024-05-30T06:42:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.235+0000 7ffbeb200640 1 -- 172.21.15.37:0/1176251901 shutdown_connections 2024-05-30T06:42:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.235+0000 7ffbeb200640 1 --2- 172.21.15.37:0/1176251901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbec06fc50 0x7ffbec06b960 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.235+0000 7ffbeb200640 1 -- 172.21.15.37:0/1176251901 >> 172.21.15.37:0/1176251901 conn(0x7ffbec09aa60 msgr2=0x7ffbec0b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.235+0000 7ffbeb200640 1 -- 172.21.15.37:0/1176251901 shutdown_connections 2024-05-30T06:42:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.235+0000 7ffbeb200640 1 -- 172.21.15.37:0/1176251901 wait complete. 2024-05-30T06:42:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.235+0000 7ffbeb200640 1 Processor -- start 2024-05-30T06:42:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbeb200640 1 -- start start 2024-05-30T06:42:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbeb200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbec06f870 0x7ffbec0cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbeb200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbec06fc50 0x7ffbec141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbeb200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbec147510 0x7ffbec0b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbeb200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec0b45e0 con 0x7ffbec147510 2024-05-30T06:42:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbeb200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec06f070 con 0x7ffbec06fc50 2024-05-30T06:42:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbeb200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffbec0b5db0 con 0x7ffbec06f870 2024-05-30T06:42:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbea800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbec147510 0x7ffbec0b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbea800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbec147510 0x7ffbec0b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34158/0 (socket says 172.21.15.37:34158) 2024-05-30T06:42:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbea800640 1 -- 172.21.15.37:0/2370807764 learned_addr learned my addr 172.21.15.37:0/2370807764 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbe9e00640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbec06f870 0x7ffbec0cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbe9400640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbec06fc50 0x7ffbec141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbea800640 1 -- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbec06f870 msgr2=0x7ffbec0cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbea800640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbec06f870 0x7ffbec0cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbea800640 1 -- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbec06fc50 msgr2=0x7ffbec141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbea800640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbec06fc50 0x7ffbec141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbea800640 1 -- 172.21.15.37:0/2370807764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec142540 con 0x7ffbec147510 2024-05-30T06:42:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbe9400640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbec06fc50 0x7ffbec141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbea800640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbec147510 0x7ffbec0b1720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40b0040 tx=0x7ffbe4019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbe2000640 1 -- 172.21.15.37:0/2370807764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe40b2050 con 0x7ffbec147510 2024-05-30T06:42:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbe2000640 1 -- 172.21.15.37:0/2370807764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe40b3040 con 0x7ffbec147510 2024-05-30T06:42:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbe2000640 1 -- 172.21.15.37:0/2370807764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4009450 con 0x7ffbec147510 2024-05-30T06:42:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbeb200640 1 -- 172.21.15.37:0/2370807764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbec142820 con 0x7ffbec147510 2024-05-30T06:42:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbeb200640 1 -- 172.21.15.37:0/2370807764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbec142de0 con 0x7ffbec147510 2024-05-30T06:42:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.239+0000 7ffbeb200640 1 -- 172.21.15.37:0/2370807764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbec075580 con 0x7ffbec147510 2024-05-30T06:42:21.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.243+0000 7ffbe2000640 1 -- 172.21.15.37:0/2370807764 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffbe40c1060 con 0x7ffbec147510 2024-05-30T06:42:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.243+0000 7ffbe2000640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffbcc068380 0x7ffbcc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.243+0000 7ffbe2000640 1 -- 172.21.15.37:0/2370807764 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffbe4120e50 con 0x7ffbec147510 2024-05-30T06:42:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.243+0000 7ffbe9e00640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffbcc068380 0x7ffbcc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.243+0000 7ffbe9e00640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffbcc068380 0x7ffbcc06a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc000fe0 tx=0x7ffbdc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.247+0000 7ffbe2000640 1 -- 172.21.15.37:0/2370807764 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffbe4016480 con 0x7ffbec147510 2024-05-30T06:42:21.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbeb200640 1 -- 172.21.15.37:0/2370807764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffbec13f5f0 con 0x7ffbec147510 2024-05-30T06:42:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbe2000640 1 -- 172.21.15.37:0/2370807764 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7ffbe40f7030 con 0x7ffbec147510 2024-05-30T06:42:21.418 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:21.418 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:21.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbeb200640 1 -- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffbcc068380 msgr2=0x7ffbcc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbeb200640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffbcc068380 0x7ffbcc06a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc000fe0 tx=0x7ffbdc009040 comp rx=0 tx=0).stop 2024-05-30T06:42:21.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbeb200640 1 -- 172.21.15.37:0/2370807764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbec147510 msgr2=0x7ffbec0b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbeb200640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbec147510 0x7ffbec0b1720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40b0040 tx=0x7ffbe4019630 comp rx=0 tx=0).stop 2024-05-30T06:42:21.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbeb200640 1 -- 172.21.15.37:0/2370807764 shutdown_connections 2024-05-30T06:42:21.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbeb200640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbec147510 0x7ffbec0b1720 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbeb200640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffbcc068380 0x7ffbcc06a840 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbeb200640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbec06fc50 0x7ffbec141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbeb200640 1 --2- 172.21.15.37:0/2370807764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbec06f870 0x7ffbec0cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbeb200640 1 -- 172.21.15.37:0/2370807764 >> 172.21.15.37:0/2370807764 conn(0x7ffbec09aa60 msgr2=0x7ffbec145fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:21.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbeb200640 1 -- 172.21.15.37:0/2370807764 shutdown_connections 2024-05-30T06:42:21.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.419+0000 7ffbeb200640 1 -- 172.21.15.37:0/2370807764 wait complete. 2024-05-30T06:42:21.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:42:09.128133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:42:09.755772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:21.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:21.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad68400640 1 Processor -- start 2024-05-30T06:42:21.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad68400640 1 -- start start 2024-05-30T06:42:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad68400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad6015e8b0 0x7fad600cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad68400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad6006d200 0x7fad6006d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad68400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fad6009aa60 0x7fad6009aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad68400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fad6006db80 con 0x7fad6015e8b0 2024-05-30T06:42:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad68400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fad60163350 con 0x7fad6009aa60 2024-05-30T06:42:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad68400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad600cfb30 con 0x7fad6006d200 2024-05-30T06:42:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad65a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad6015e8b0 0x7fad600cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad65a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad6015e8b0 0x7fad600cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34166/0 (socket says 172.21.15.37:34166) 2024-05-30T06:42:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad65a00640 1 -- 172.21.15.37:0/1200347458 learned_addr learned my addr 172.21.15.37:0/1200347458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad65000640 1 --2- 172.21.15.37:0/1200347458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad6006d200 0x7fad6006d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad66400640 1 --2- 172.21.15.37:0/1200347458 >> v2:172.21.15.105:3300/0 conn(0x7fad6009aa60 0x7fad6009aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad65a00640 1 -- 172.21.15.37:0/1200347458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad6006d200 msgr2=0x7fad6006d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad65a00640 1 --2- 172.21.15.37:0/1200347458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad6006d200 0x7fad6006d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad65a00640 1 -- 172.21.15.37:0/1200347458 >> v2:172.21.15.105:3300/0 conn(0x7fad6009aa60 msgr2=0x7fad6009aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad65a00640 1 --2- 172.21.15.37:0/1200347458 >> v2:172.21.15.105:3300/0 conn(0x7fad6009aa60 0x7fad6009aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad65a00640 1 -- 172.21.15.37:0/1200347458 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad601627d0 con 0x7fad6015e8b0 2024-05-30T06:42:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.587+0000 7fad66400640 1 --2- 172.21.15.37:0/1200347458 >> v2:172.21.15.105:3300/0 conn(0x7fad6009aa60 0x7fad6009aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:21.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad65a00640 1 --2- 172.21.15.37:0/1200347458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6015e8b0 0x7fad600cf5f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad600b4ea0 tx=0x7fad5401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd05fca1b404bbe9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:21.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad5fe00640 1 -- 172.21.15.37:0/1200347458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad540b1070 con 0x7fad6015e8b0 2024-05-30T06:42:21.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad5fe00640 1 -- 172.21.15.37:0/1200347458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad540ac630 con 0x7fad6015e8b0 2024-05-30T06:42:21.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad5fe00640 1 -- 172.21.15.37:0/1200347458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad540a8050 con 0x7fad6015e8b0 2024-05-30T06:42:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad68400640 1 -- 172.21.15.37:0/1200347458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6015e8b0 msgr2=0x7fad600cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad68400640 1 --2- 172.21.15.37:0/1200347458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6015e8b0 0x7fad600cf5f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad600b4ea0 tx=0x7fad5401c520 comp rx=0 tx=0).stop 2024-05-30T06:42:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad68400640 1 -- 172.21.15.37:0/1200347458 shutdown_connections 2024-05-30T06:42:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad68400640 1 --2- 172.21.15.37:0/1200347458 >> v2:172.21.15.105:3300/0 conn(0x7fad6009aa60 0x7fad6009aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad68400640 1 --2- 172.21.15.37:0/1200347458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad6006d200 0x7fad6006d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad68400640 1 --2- 172.21.15.37:0/1200347458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6015e8b0 0x7fad600cf5f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad68400640 1 -- 172.21.15.37:0/1200347458 >> 172.21.15.37:0/1200347458 conn(0x7fad600b4130 msgr2=0x7fad600b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:21.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad68400640 1 -- 172.21.15.37:0/1200347458 shutdown_connections 2024-05-30T06:42:21.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad68400640 1 -- 172.21.15.37:0/1200347458 wait complete. 2024-05-30T06:42:21.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.591+0000 7fad68400640 1 Processor -- start 2024-05-30T06:42:21.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad68400640 1 -- start start 2024-05-30T06:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad68400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6006d200 0x7fad601531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad68400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6009aa60 0x7fad600b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad68400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad6015e8b0 0x7fad60150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad68400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad6015ec90 con 0x7fad6009aa60 2024-05-30T06:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad68400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad6009b820 con 0x7fad6006d200 2024-05-30T06:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad68400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad60162480 con 0x7fad6015e8b0 2024-05-30T06:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad65000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6009aa60 0x7fad600b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad65000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6009aa60 0x7fad600b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34168/0 (socket says 172.21.15.37:34168) 2024-05-30T06:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad65000640 1 -- 172.21.15.37:0/2733618290 learned_addr learned my addr 172.21.15.37:0/2733618290 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad65a00640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6006d200 0x7fad601531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad66400640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad6015e8b0 0x7fad60150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad65000640 1 -- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad6015e8b0 msgr2=0x7fad60150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad65000640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad6015e8b0 0x7fad60150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad65000640 1 -- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6006d200 msgr2=0x7fad601531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad65000640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6006d200 0x7fad601531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad65000640 1 -- 172.21.15.37:0/2733618290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad60150e10 con 0x7fad6009aa60 2024-05-30T06:42:21.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad65000640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6009aa60 0x7fad600b7250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00e870 tx=0x7fad4c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:21.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad5d600640 1 -- 172.21.15.37:0/2733618290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c017070 con 0x7fad6009aa60 2024-05-30T06:42:21.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad5d600640 1 -- 172.21.15.37:0/2733618290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4c00ee60 con 0x7fad6009aa60 2024-05-30T06:42:21.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad5d600640 1 -- 172.21.15.37:0/2733618290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00cb80 con 0x7fad6009aa60 2024-05-30T06:42:21.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad68400640 1 -- 172.21.15.37:0/2733618290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad600b6770 con 0x7fad6009aa60 2024-05-30T06:42:21.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad68400640 1 -- 172.21.15.37:0/2733618290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad600b7790 con 0x7fad6009aa60 2024-05-30T06:42:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.595+0000 7fad68400640 1 -- 172.21.15.37:0/2733618290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad60068bc0 con 0x7fad6009aa60 2024-05-30T06:42:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.599+0000 7fad5d600640 1 -- 172.21.15.37:0/2733618290 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fad4c01a070 con 0x7fad6009aa60 2024-05-30T06:42:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.599+0000 7fad5d600640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad40068380 0x7fad4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.599+0000 7fad5d600640 1 -- 172.21.15.37:0/2733618290 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fad4c086b70 con 0x7fad6009aa60 2024-05-30T06:42:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.599+0000 7fad65a00640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad40068380 0x7fad4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.599+0000 7fad65a00640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad40068380 0x7fad4006a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad540ae000 tx=0x7fad54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:21.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.603+0000 7fad5d600640 1 -- 172.21.15.37:0/2733618290 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fad4c056a40 con 0x7fad6009aa60 2024-05-30T06:42:21.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.767+0000 7fad68400640 1 -- 172.21.15.37:0/2733618290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fad60075920 con 0x7fad6009aa60 2024-05-30T06:42:21.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.767+0000 7fad5d600640 1 -- 172.21.15.37:0/2733618290 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fad4c05ad40 con 0x7fad6009aa60 2024-05-30T06:42:21.767 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.771+0000 7fad68400640 1 -- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad40068380 msgr2=0x7fad4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.771+0000 7fad68400640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad40068380 0x7fad4006a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad540ae000 tx=0x7fad54009040 comp rx=0 tx=0).stop 2024-05-30T06:42:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.771+0000 7fad68400640 1 -- 172.21.15.37:0/2733618290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6009aa60 msgr2=0x7fad600b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.771+0000 7fad68400640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6009aa60 0x7fad600b7250 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00e870 tx=0x7fad4c00ed30 comp rx=0 tx=0).stop 2024-05-30T06:42:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.771+0000 7fad68400640 1 -- 172.21.15.37:0/2733618290 shutdown_connections 2024-05-30T06:42:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.771+0000 7fad68400640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad6015e8b0 0x7fad60150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.771+0000 7fad68400640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad6009aa60 0x7fad600b7250 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.771+0000 7fad68400640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad40068380 0x7fad4006a840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.771+0000 7fad68400640 1 --2- 172.21.15.37:0/2733618290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad6006d200 0x7fad601531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.771+0000 7fad68400640 1 -- 172.21.15.37:0/2733618290 >> 172.21.15.37:0/2733618290 conn(0x7fad600b4130 msgr2=0x7fad6015ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:21.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.771+0000 7fad68400640 1 -- 172.21.15.37:0/2733618290 shutdown_connections 2024-05-30T06:42:21.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.771+0000 7fad68400640 1 -- 172.21.15.37:0/2733618290 wait complete. 2024-05-30T06:42:21.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:42:21.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.931+0000 7f6758a00640 1 Processor -- start 2024-05-30T06:42:21.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.931+0000 7f6758a00640 1 -- start start 2024-05-30T06:42:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.931+0000 7f6758a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f67540b59d0 0x7f67540b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6758a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67541610a0 con 0x7f675415d7e0 2024-05-30T06:42:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6758a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67540b62f0 con 0x7f675415d350 2024-05-30T06:42:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6758a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6754142030 con 0x7f67540b59d0 2024-05-30T06:42:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6752800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f675415d7e0 0x7f6754160990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47772/0 (socket says 172.21.15.37:47772) 2024-05-30T06:42:21.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6752800640 1 -- 172.21.15.37:0/1851617383 learned_addr learned my addr 172.21.15.37:0/1851617383 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751e00640 1 --2- 172.21.15.37:0/1851617383 >> v2:172.21.15.105:3300/0 conn(0x7f67540b59d0 0x7f67540b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1068945234 0 0) 0x7f67541610a0 con 0x7f675415d7e0 2024-05-30T06:42:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6738003530 con 0x7f675415d7e0 2024-05-30T06:42:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3493755211 0 0) 0x7f6738003530 con 0x7f675415d7e0 2024-05-30T06:42:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 >> v2:172.21.15.105:3300/0 conn(0x7f67540b59d0 msgr2=0x7f67540b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 --2- 172.21.15.37:0/1851617383 >> v2:172.21.15.105:3300/0 conn(0x7f67540b59d0 0x7f67540b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 >> v1:172.21.15.105:6789/0 conn(0x7f675415d350 legacy=0x7f6754160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6754142310 con 0x7f675415d7e0 2024-05-30T06:42:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f674c001a00 con 0x7f675415d7e0 2024-05-30T06:42:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 >> v1:172.21.15.37:6789/0 conn(0x7f675415d7e0 legacy=0x7f6754160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 --2- 172.21.15.37:0/1851617383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67380039c0 0x7f6738003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 --2- 172.21.15.37:0/1851617383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6738004810 0x7f6738004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 --2- 172.21.15.37:0/1851617383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67380051d0 0x7f673800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6754142030 con 0x7f67380051d0 2024-05-30T06:42:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f673800c080 con 0x7f6738004810 2024-05-30T06:42:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f673800c280 con 0x7f67380039c0 2024-05-30T06:42:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6752800640 1 --2- 172.21.15.37:0/1851617383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67380051d0 0x7f673800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6749400640 1 --2- 172.21.15.37:0/1851617383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6738004810 0x7f6738004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6751e00640 1 --2- 172.21.15.37:0/1851617383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67380039c0 0x7f6738003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6752800640 1 -- 172.21.15.37:0/1851617383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67380039c0 msgr2=0x7f6738003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6752800640 1 --2- 172.21.15.37:0/1851617383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67380039c0 0x7f6738003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6752800640 1 -- 172.21.15.37:0/1851617383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6738004810 msgr2=0x7f6738004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6752800640 1 --2- 172.21.15.37:0/1851617383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6738004810 0x7f6738004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.935+0000 7f6752800640 1 -- 172.21.15.37:0/1851617383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6738003530 con 0x7f67380051d0 2024-05-30T06:42:21.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6752800640 1 -- 172.21.15.37:0/1851617383 reap_dead start 2024-05-30T06:42:21.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6752800640 1 --2- 172.21.15.37:0/1851617383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67380051d0 0x7f673800b9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f674c00a850 tx=0x7f674c01d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f40af9c0291f594 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:21.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c00a4a0 con 0x7f67380051d0 2024-05-30T06:42:21.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f674c0ad650 con 0x7f67380051d0 2024-05-30T06:42:21.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6751400640 1 -- 172.21.15.37:0/1851617383 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c0ada40 con 0x7f67380051d0 2024-05-30T06:42:21.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6758a00640 1 -- 172.21.15.37:0/1851617383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67380051d0 msgr2=0x7f673800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6758a00640 1 --2- 172.21.15.37:0/1851617383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67380051d0 0x7f673800b9d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f674c00a850 tx=0x7f674c01d3a0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6758a00640 1 -- 172.21.15.37:0/1851617383 shutdown_connections 2024-05-30T06:42:21.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6758a00640 1 --2- 172.21.15.37:0/1851617383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67380051d0 0x7f673800b9d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6758a00640 1 -- 172.21.15.37:0/1851617383 >> 172.21.15.37:0/1851617383 conn(0x7f675406bf60 msgr2=0x7f67540b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:21.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6758a00640 1 -- 172.21.15.37:0/1851617383 shutdown_connections 2024-05-30T06:42:21.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6758a00640 1 -- 172.21.15.37:0/1851617383 wait complete. 2024-05-30T06:42:21.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6758a00640 1 Processor -- start 2024-05-30T06:42:21.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.939+0000 7f6758a00640 1 -- start start 2024-05-30T06:42:21.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6758a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67380051d0 0x7f6754152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6758a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67540b54f0 0x7f67540b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6758a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67540b3e20 0x7f6754157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6758a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f675413fce0 con 0x7f67540b54f0 2024-05-30T06:42:21.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6758a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f67541428d0 con 0x7f67380051d0 2024-05-30T06:42:21.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6758a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f675413fe60 con 0x7f67540b3e20 2024-05-30T06:42:21.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6749400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67540b54f0 0x7f67540b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6749400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67540b54f0 0x7f67540b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34192/0 (socket says 172.21.15.37:34192) 2024-05-30T06:42:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6749400640 1 -- 172.21.15.37:0/1615828114 learned_addr learned my addr 172.21.15.37:0/1615828114 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6751e00640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67380051d0 0x7f6754152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6752800640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67540b3e20 0x7f6754157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6749400640 1 -- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67540b3e20 msgr2=0x7f6754157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6749400640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67540b3e20 0x7f6754157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6749400640 1 -- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67380051d0 msgr2=0x7f6754152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6749400640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67380051d0 0x7f6754152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6749400640 1 -- 172.21.15.37:0/1615828114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67540b4450 con 0x7f67540b54f0 2024-05-30T06:42:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6749400640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67540b54f0 0x7f67540b38e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f673c00f620 tx=0x7f673c00fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f674aa00640 1 -- 172.21.15.37:0/1615828114 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c0052e0 con 0x7f67540b54f0 2024-05-30T06:42:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f674aa00640 1 -- 172.21.15.37:0/1615828114 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673c018070 con 0x7f67540b54f0 2024-05-30T06:42:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f674aa00640 1 -- 172.21.15.37:0/1615828114 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c003820 con 0x7f67540b54f0 2024-05-30T06:42:21.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6758a00640 1 -- 172.21.15.37:0/1615828114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67540b4730 con 0x7f67540b54f0 2024-05-30T06:42:21.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6758a00640 1 -- 172.21.15.37:0/1615828114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67540b4cf0 con 0x7f67540b54f0 2024-05-30T06:42:21.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f6758a00640 1 -- 172.21.15.37:0/1615828114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6754068bc0 con 0x7f67540b54f0 2024-05-30T06:42:21.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.943+0000 7f674aa00640 1 -- 172.21.15.37:0/1615828114 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f673c0039c0 con 0x7f67540b54f0 2024-05-30T06:42:21.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.947+0000 7f674aa00640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f67300683b0 0x7f673006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:21.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.947+0000 7f674aa00640 1 -- 172.21.15.37:0/1615828114 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f673c0865a0 con 0x7f67540b54f0 2024-05-30T06:42:21.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.947+0000 7f6751e00640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f67300683b0 0x7f673006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:21.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.947+0000 7f6751e00640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f67300683b0 0x7f673006a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6744009b60 tx=0x7f6744009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:21.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:21.951+0000 7f674aa00640 1 -- 172.21.15.37:0/1615828114 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f673c056b60 con 0x7f67540b54f0 2024-05-30T06:42:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.115+0000 7f6758a00640 1 -- 172.21.15.37:0/1615828114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f675406f0a0 con 0x7f67540b54f0 2024-05-30T06:42:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.115+0000 7f674aa00640 1 -- 172.21.15.37:0/1615828114 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f673c005480 con 0x7f67540b54f0 2024-05-30T06:42:22.116 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:42:22.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.119+0000 7f6758a00640 1 -- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f67300683b0 msgr2=0x7f673006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.119+0000 7f6758a00640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f67300683b0 0x7f673006a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6744009b60 tx=0x7f6744009190 comp rx=0 tx=0).stop 2024-05-30T06:42:22.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.119+0000 7f6758a00640 1 -- 172.21.15.37:0/1615828114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67540b54f0 msgr2=0x7f67540b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.119+0000 7f6758a00640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67540b54f0 0x7f67540b38e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f673c00f620 tx=0x7f673c00fa20 comp rx=0 tx=0).stop 2024-05-30T06:42:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.119+0000 7f6758a00640 1 -- 172.21.15.37:0/1615828114 shutdown_connections 2024-05-30T06:42:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.119+0000 7f6758a00640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67540b3e20 0x7f6754157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.119+0000 7f6758a00640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67540b54f0 0x7f67540b38e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.119+0000 7f6758a00640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f67300683b0 0x7f673006a870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.119+0000 7f6758a00640 1 --2- 172.21.15.37:0/1615828114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67380051d0 0x7f6754152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.119+0000 7f6758a00640 1 -- 172.21.15.37:0/1615828114 >> 172.21.15.37:0/1615828114 conn(0x7f675406bf60 msgr2=0x7f67540ae4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.119+0000 7f6758a00640 1 -- 172.21.15.37:0/1615828114 shutdown_connections 2024-05-30T06:42:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.119+0000 7f6758a00640 1 -- 172.21.15.37:0/1615828114 wait complete. 2024-05-30T06:42:22.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:42:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2c5800640 1 Processor -- start 2024-05-30T06:42:22.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2c5800640 1 -- start start 2024-05-30T06:42:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2c5800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2c0155da0 0x7fe2c00cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2c5800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe2c006f770 0x7fe2c00b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2c5800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2c015f310 con 0x7fe2c00cd440 2024-05-30T06:42:22.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2c5800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe2c015f5f0 con 0x7fe2c0155da0 2024-05-30T06:42:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2c5800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe2c015f8d0 con 0x7fe2c006f770 2024-05-30T06:42:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2bea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2c0155da0 0x7fe2c00cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2bea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2c0155da0 0x7fe2c00cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34204/0 (socket says 172.21.15.37:34204) 2024-05-30T06:42:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2bea00640 1 -- 172.21.15.37:0/1053391700 learned_addr learned my addr 172.21.15.37:0/1053391700 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2be000640 1 --1- 172.21.15.37:0/1053391700 >> v1:172.21.15.37:6789/0 conn(0x7fe2c00cd440 0x7fe2c006f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47788/0 (socket says 172.21.15.37:47788) 2024-05-30T06:42:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2bf400640 1 --2- 172.21.15.37:0/1053391700 >> v2:172.21.15.105:3300/0 conn(0x7fe2c006f770 0x7fe2c00b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2bea00640 1 -- 172.21.15.37:0/1053391700 >> v2:172.21.15.105:3300/0 conn(0x7fe2c006f770 msgr2=0x7fe2c00b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2bea00640 1 --2- 172.21.15.37:0/1053391700 >> v2:172.21.15.105:3300/0 conn(0x7fe2c006f770 0x7fe2c00b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2bea00640 1 -- 172.21.15.37:0/1053391700 >> v1:172.21.15.37:6789/0 conn(0x7fe2c00cd440 legacy=0x7fe2c006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.283+0000 7fe2bea00640 1 -- 172.21.15.37:0/1053391700 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c015fbb0 con 0x7fe2c0155da0 2024-05-30T06:42:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.287+0000 7fe2bea00640 1 --2- 172.21.15.37:0/1053391700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c0155da0 0x7fe2c00cd950 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00b6600 tx=0x7fe2b001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c757079c2810640e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.287+0000 7fe2bd600640 1 -- 172.21.15.37:0/1053391700 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00b0070 con 0x7fe2c0155da0 2024-05-30T06:42:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.287+0000 7fe2bd600640 1 -- 172.21.15.37:0/1053391700 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b00ab600 con 0x7fe2c0155da0 2024-05-30T06:42:22.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.287+0000 7fe2bd600640 1 -- 172.21.15.37:0/1053391700 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00ab9d0 con 0x7fe2c0155da0 2024-05-30T06:42:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.287+0000 7fe2c5800640 1 -- 172.21.15.37:0/1053391700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c0155da0 msgr2=0x7fe2c00cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.287+0000 7fe2c5800640 1 --2- 172.21.15.37:0/1053391700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c0155da0 0x7fe2c00cd950 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00b6600 tx=0x7fe2b001c400 comp rx=0 tx=0).stop 2024-05-30T06:42:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.287+0000 7fe2c5800640 1 -- 172.21.15.37:0/1053391700 shutdown_connections 2024-05-30T06:42:22.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.287+0000 7fe2c5800640 1 --2- 172.21.15.37:0/1053391700 >> v2:172.21.15.105:3300/0 conn(0x7fe2c006f770 0x7fe2c00b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.287+0000 7fe2c5800640 1 --2- 172.21.15.37:0/1053391700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c0155da0 0x7fe2c00cd950 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.287+0000 7fe2c5800640 1 -- 172.21.15.37:0/1053391700 >> 172.21.15.37:0/1053391700 conn(0x7fe2c006bf60 msgr2=0x7fe2c00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.287+0000 7fe2c5800640 1 -- 172.21.15.37:0/1053391700 shutdown_connections 2024-05-30T06:42:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.287+0000 7fe2c5800640 1 -- 172.21.15.37:0/1053391700 wait complete. 2024-05-30T06:42:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.287+0000 7fe2c5800640 1 Processor -- start 2024-05-30T06:42:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2c5800640 1 -- start start 2024-05-30T06:42:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2c5800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c006f770 0x7fe2c014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2c5800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2c0155da0 0x7fe2c0151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2c5800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2c0151d40 0x7fe2c015a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2c5800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c006df50 con 0x7fe2c006f770 2024-05-30T06:42:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2c5800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c00b46f0 con 0x7fe2c0151d40 2024-05-30T06:42:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2c5800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c006e0d0 con 0x7fe2c0155da0 2024-05-30T06:42:22.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2bea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c006f770 0x7fe2c014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2bea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c006f770 0x7fe2c014d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34206/0 (socket says 172.21.15.37:34206) 2024-05-30T06:42:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2bea00640 1 -- 172.21.15.37:0/639089572 learned_addr learned my addr 172.21.15.37:0/639089572 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2bea00640 1 -- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2c0155da0 msgr2=0x7fe2c0151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2bea00640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2c0155da0 0x7fe2c0151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2bea00640 1 -- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2c0151d40 msgr2=0x7fe2c015a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2bf400640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2c0151d40 0x7fe2c015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2bea00640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2c0151d40 0x7fe2c015a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2bea00640 1 -- 172.21.15.37:0/639089572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c01f75f0 con 0x7fe2c006f770 2024-05-30T06:42:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2bf400640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2c0151d40 0x7fe2c015a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2bea00640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c006f770 0x7fe2c014d0b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0019010 tx=0x7fe2b00191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2b6a00640 1 -- 172.21.15.37:0/639089572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00b0040 con 0x7fe2c006f770 2024-05-30T06:42:22.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2b6a00640 1 -- 172.21.15.37:0/639089572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b00b4620 con 0x7fe2c006f770 2024-05-30T06:42:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2b6a00640 1 -- 172.21.15.37:0/639089572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00b4a10 con 0x7fe2c006f770 2024-05-30T06:42:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2c5800640 1 -- 172.21.15.37:0/639089572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c0152230 con 0x7fe2c006f770 2024-05-30T06:42:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2c5800640 1 -- 172.21.15.37:0/639089572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c01527f0 con 0x7fe2c006f770 2024-05-30T06:42:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.291+0000 7fe2c5800640 1 -- 172.21.15.37:0/639089572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c0068bc0 con 0x7fe2c006f770 2024-05-30T06:42:22.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.295+0000 7fe2b6a00640 1 -- 172.21.15.37:0/639089572 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe2b00ab4c0 con 0x7fe2c006f770 2024-05-30T06:42:22.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.295+0000 7fe2b6a00640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2a0068380 0x7fe2a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:22.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.295+0000 7fe2b6a00640 1 -- 172.21.15.37:0/639089572 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe2b01206e0 con 0x7fe2c006f770 2024-05-30T06:42:22.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.295+0000 7fe2be000640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2a0068380 0x7fe2a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:22.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.295+0000 7fe2be000640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2a0068380 0x7fe2a006a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac000f70 tx=0x7fe2ac007a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.299+0000 7fe2b6a00640 1 -- 172.21.15.37:0/639089572 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe2b0016110 con 0x7fe2c006f770 2024-05-30T06:42:22.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2c5800640 1 -- 172.21.15.37:0/639089572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe2c00b37e0 con 0x7fe2c006f770 2024-05-30T06:42:22.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2b6a00640 1 -- 172.21.15.37:0/639089572 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fe2b00f0c00 con 0x7fe2c006f770 2024-05-30T06:42:22.466 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:42:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2c5800640 1 -- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2a0068380 msgr2=0x7fe2a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2c5800640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2a0068380 0x7fe2a006a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac000f70 tx=0x7fe2ac007a10 comp rx=0 tx=0).stop 2024-05-30T06:42:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2c5800640 1 -- 172.21.15.37:0/639089572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c006f770 msgr2=0x7fe2c014d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2c5800640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c006f770 0x7fe2c014d0b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0019010 tx=0x7fe2b00191a0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2c5800640 1 -- 172.21.15.37:0/639089572 shutdown_connections 2024-05-30T06:42:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2c5800640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2a0068380 0x7fe2a006a840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2c5800640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2c0151d40 0x7fe2c015a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2c5800640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2c0155da0 0x7fe2c0151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2c5800640 1 --2- 172.21.15.37:0/639089572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2c006f770 0x7fe2c014d0b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2c5800640 1 -- 172.21.15.37:0/639089572 >> 172.21.15.37:0/639089572 conn(0x7fe2c006bf60 msgr2=0x7fe2c0164f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2c5800640 1 -- 172.21.15.37:0/639089572 shutdown_connections 2024-05-30T06:42:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.467+0000 7fe2c5800640 1 -- 172.21.15.37:0/639089572 wait complete. 2024-05-30T06:42:22.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:42:22.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.627+0000 7f4ea4e00640 1 Processor -- start 2024-05-30T06:42:22.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.627+0000 7f4ea4e00640 1 -- start start 2024-05-30T06:42:22.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.627+0000 7f4ea4e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea006f9a0 0x7f4ea00b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:22.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.627+0000 7f4ea4e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4ea00b2ec0 0x7f4ea00cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:22.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.627+0000 7f4ea4e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea015c8f0 con 0x7f4ea0155e60 2024-05-30T06:42:22.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.627+0000 7f4ea4e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea00ccff0 con 0x7f4ea00b2ec0 2024-05-30T06:42:22.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.627+0000 7f4ea4e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea00ccc80 con 0x7f4ea006f9a0 2024-05-30T06:42:22.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e9de00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4ea0155e60 0x7f4ea00cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47804/0 (socket says 172.21.15.37:47804) 2024-05-30T06:42:22.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e9de00640 1 -- 172.21.15.37:0/2292199425 learned_addr learned my addr 172.21.15.37:0/2292199425 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:22.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e9e800640 1 --2- 172.21.15.37:0/2292199425 >> v2:172.21.15.37:3300/0 conn(0x7f4ea00b2ec0 0x7f4ea00cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:22.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e97e00640 1 --2- 172.21.15.37:0/2292199425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea006f9a0 0x7f4ea00b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:22.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e9d400640 1 -- 172.21.15.37:0/2292199425 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1202869853 0 0) 0x7f4ea015c8f0 con 0x7f4ea0155e60 2024-05-30T06:42:22.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e9e800640 1 -- 172.21.15.37:0/2292199425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea006f9a0 msgr2=0x7f4ea00b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e9e800640 1 --2- 172.21.15.37:0/2292199425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea006f9a0 0x7f4ea00b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e9e800640 1 -- 172.21.15.37:0/2292199425 >> v1:172.21.15.37:6789/0 conn(0x7f4ea0155e60 legacy=0x7f4ea00cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e9e800640 1 -- 172.21.15.37:0/2292199425 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea015cbd0 con 0x7f4ea00b2ec0 2024-05-30T06:42:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e97e00640 1 --2- 172.21.15.37:0/2292199425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea006f9a0 0x7f4ea00b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:22.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e9e800640 1 --2- 172.21.15.37:0/2292199425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea00b2ec0 0x7f4ea00cd480 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009d90 tx=0x7f4e9801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf3b933163c5685 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:22.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e9d400640 1 -- 172.21.15.37:0/2292199425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980b2070 con 0x7f4ea00b2ec0 2024-05-30T06:42:22.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e9d400640 1 -- 172.21.15.37:0/2292199425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e980a5940 con 0x7f4ea00b2ec0 2024-05-30T06:42:22.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.631+0000 7f4e9d400640 1 -- 172.21.15.37:0/2292199425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980a5d10 con 0x7f4ea00b2ec0 2024-05-30T06:42:22.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 -- 172.21.15.37:0/2292199425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea00b2ec0 msgr2=0x7f4ea00cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 --2- 172.21.15.37:0/2292199425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea00b2ec0 0x7f4ea00cd480 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009d90 tx=0x7f4e9801c970 comp rx=0 tx=0).stop 2024-05-30T06:42:22.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 -- 172.21.15.37:0/2292199425 shutdown_connections 2024-05-30T06:42:22.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 --2- 172.21.15.37:0/2292199425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea00b2ec0 0x7f4ea00cd480 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 --2- 172.21.15.37:0/2292199425 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea006f9a0 0x7f4ea00b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 -- 172.21.15.37:0/2292199425 >> 172.21.15.37:0/2292199425 conn(0x7f4ea00b23a0 msgr2=0x7f4ea00b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:22.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 -- 172.21.15.37:0/2292199425 shutdown_connections 2024-05-30T06:42:22.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 -- 172.21.15.37:0/2292199425 wait complete. 2024-05-30T06:42:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 Processor -- start 2024-05-30T06:42:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 -- start start 2024-05-30T06:42:22.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea006f9a0 0x7f4ea0157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:22.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea00b2ec0 0x7f4ea015a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:22.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea0155e60 0x7f4ea01f6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:22.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea006ea10 con 0x7f4ea0155e60 2024-05-30T06:42:22.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea006e890 con 0x7f4ea006f9a0 2024-05-30T06:42:22.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4ea4e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea006eb90 con 0x7f4ea00b2ec0 2024-05-30T06:42:22.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4e9e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea0155e60 0x7f4ea01f6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:22.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4e9e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea0155e60 0x7f4ea01f6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34218/0 (socket says 172.21.15.37:34218) 2024-05-30T06:42:22.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4e9e800640 1 -- 172.21.15.37:0/3331142832 learned_addr learned my addr 172.21.15.37:0/3331142832 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:22.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4e9de00640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea006f9a0 0x7f4ea0157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:22.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4e97e00640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea00b2ec0 0x7f4ea015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:22.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4e9e800640 1 -- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea00b2ec0 msgr2=0x7f4ea015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4e9e800640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea00b2ec0 0x7f4ea015a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4e9e800640 1 -- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea006f9a0 msgr2=0x7f4ea0157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4e9e800640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea006f9a0 0x7f4ea0157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4e9e800640 1 -- 172.21.15.37:0/3331142832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea0156cf0 con 0x7f4ea0155e60 2024-05-30T06:42:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4e9de00640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea006f9a0 0x7f4ea0157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.635+0000 7f4e9e800640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea0155e60 0x7f4ea01f6b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e9801b020 tx=0x7f4e98019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.639+0000 7f4e96000640 1 -- 172.21.15.37:0/3331142832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980b2050 con 0x7f4ea0155e60 2024-05-30T06:42:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.639+0000 7f4e96000640 1 -- 172.21.15.37:0/3331142832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e980be070 con 0x7f4ea0155e60 2024-05-30T06:42:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.639+0000 7f4ea4e00640 1 -- 172.21.15.37:0/3331142832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea0156fd0 con 0x7f4ea0155e60 2024-05-30T06:42:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.639+0000 7f4e96000640 1 -- 172.21.15.37:0/3331142832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e980adad0 con 0x7f4ea0155e60 2024-05-30T06:42:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.639+0000 7f4ea4e00640 1 -- 172.21.15.37:0/3331142832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea0157590 con 0x7f4ea0155e60 2024-05-30T06:42:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.639+0000 7f4ea4e00640 1 -- 172.21.15.37:0/3331142832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea0068b20 con 0x7f4ea0155e60 2024-05-30T06:42:22.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.639+0000 7f4e96000640 1 -- 172.21.15.37:0/3331142832 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e980adc70 con 0x7f4ea0155e60 2024-05-30T06:42:22.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.639+0000 7f4e96000640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e7c068380 0x7f4e7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:22.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.639+0000 7f4e96000640 1 -- 172.21.15.37:0/3331142832 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4e98121ce0 con 0x7f4ea0155e60 2024-05-30T06:42:22.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.643+0000 7f4e9de00640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e7c068380 0x7f4e7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:22.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.643+0000 7f4e9de00640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e7c068380 0x7f4e7c06a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4e90000f70 tx=0x7f4e90007cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:22.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.643+0000 7f4e96000640 1 -- 172.21.15.37:0/3331142832 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4e98016560 con 0x7f4ea0155e60 2024-05-30T06:42:22.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4ea4e00640 1 -- 172.21.15.37:0/3331142832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ea0072fb0 con 0x7f4ea0155e60 2024-05-30T06:42:22.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4e96000640 1 -- 172.21.15.37:0/3331142832 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f4e980ab340 con 0x7f4ea0155e60 2024-05-30T06:42:22.847 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:22.847 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2950341560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2950341560},{"type":"v1","addr":"172.21.15.37:6835","nonce":2950341560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/1458371524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1458371524},{"type":"v1","addr":"172.21.15.105:6836","nonce":1458371524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4088854019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4088854019},{"type":"v1","addr":"172.21.15.37:6833","nonce":4088854019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:42:10.805274+0000","modified":"2024-05-30T06:42:13.844990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2952122373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2952122373},{"type":"v1","addr":"172.21.15.105:6837","nonce":2952122373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-05-30T06:42:22.847 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-05-30T06:42:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4ea4e00640 1 -- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e7c068380 msgr2=0x7f4e7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4ea4e00640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e7c068380 0x7f4e7c06a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4e90000f70 tx=0x7f4e90007cd0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4ea4e00640 1 -- 172.21.15.37:0/3331142832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea0155e60 msgr2=0x7f4ea01f6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4ea4e00640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea0155e60 0x7f4ea01f6b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e9801b020 tx=0x7f4e98019710 comp rx=0 tx=0).stop 2024-05-30T06:42:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4ea4e00640 1 -- 172.21.15.37:0/3331142832 shutdown_connections 2024-05-30T06:42:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4ea4e00640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea0155e60 0x7f4ea01f6b50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4ea4e00640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea00b2ec0 0x7f4ea015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4ea4e00640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e7c068380 0x7f4e7c06a840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4ea4e00640 1 --2- 172.21.15.37:0/3331142832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea006f9a0 0x7f4ea0157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4ea4e00640 1 -- 172.21.15.37:0/3331142832 >> 172.21.15.37:0/3331142832 conn(0x7f4ea00b23a0 msgr2=0x7f4ea0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:22.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4ea4e00640 1 -- 172.21.15.37:0/3331142832 shutdown_connections 2024-05-30T06:42:22.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:22.847+0000 7f4ea4e00640 1 -- 172.21.15.37:0/3331142832 wait complete. 2024-05-30T06:42:22.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:23.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.007+0000 7f99c3800640 1 Processor -- start 2024-05-30T06:42:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.007+0000 7f99c3800640 1 -- start start 2024-05-30T06:42:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.011+0000 7f99c3800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99bc15cd80 0x7f99bc06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.011+0000 7f99c3800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f99bc0ce8d0 0x7f99bc0ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.011+0000 7f99c3800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99bc0cd120 con 0x7f99bc06e000 2024-05-30T06:42:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.011+0000 7f99c3800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f99bc0a9530 con 0x7f99bc15cd80 2024-05-30T06:42:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.011+0000 7f99c3800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f99bc0cd400 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.011+0000 7f99bbe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99bc15cd80 0x7f99bc06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.011+0000 7f99bbe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99bc15cd80 0x7f99bc06f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34230/0 (socket says 172.21.15.37:34230) 2024-05-30T06:42:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.011+0000 7f99bbe00640 1 -- 172.21.15.37:0/738424895 learned_addr learned my addr 172.21.15.37:0/738424895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:23.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.011+0000 7f99c1800640 1 --2- 172.21.15.37:0/738424895 >> v2:172.21.15.105:3300/0 conn(0x7f99bc0ce8d0 0x7f99bc0ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.011+0000 7f99bbe00640 1 -- 172.21.15.37:0/738424895 >> v2:172.21.15.105:3300/0 conn(0x7f99bc0ce8d0 msgr2=0x7f99bc0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:23.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.011+0000 7f99bbe00640 1 --2- 172.21.15.37:0/738424895 >> v2:172.21.15.105:3300/0 conn(0x7f99bc0ce8d0 0x7f99bc0ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.011+0000 7f99bbe00640 1 -- 172.21.15.37:0/738424895 >> v1:172.21.15.105:6789/0 conn(0x7f99bc06e000 legacy=0x7f99bc0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.011+0000 7f99bbe00640 1 -- 172.21.15.37:0/738424895 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99bc0cd6e0 con 0x7f99bc15cd80 2024-05-30T06:42:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99bbe00640 1 --2- 172.21.15.37:0/738424895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc15cd80 0x7f99bc06f3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f99bc06c7b0 tx=0x7f99a801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9392b481bac9167f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99bb400640 1 -- 172.21.15.37:0/738424895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a80b5070 con 0x7f99bc15cd80 2024-05-30T06:42:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99bb400640 1 -- 172.21.15.37:0/738424895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a80a8a10 con 0x7f99bc15cd80 2024-05-30T06:42:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99bb400640 1 -- 172.21.15.37:0/738424895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a80a8de0 con 0x7f99bc15cd80 2024-05-30T06:42:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99c3800640 1 -- 172.21.15.37:0/738424895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc15cd80 msgr2=0x7f99bc06f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99c3800640 1 --2- 172.21.15.37:0/738424895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc15cd80 0x7f99bc06f3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f99bc06c7b0 tx=0x7f99a801ed10 comp rx=0 tx=0).stop 2024-05-30T06:42:23.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99c3800640 1 -- 172.21.15.37:0/738424895 shutdown_connections 2024-05-30T06:42:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99c3800640 1 --2- 172.21.15.37:0/738424895 >> v2:172.21.15.105:3300/0 conn(0x7f99bc0ce8d0 0x7f99bc0ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99c3800640 1 --2- 172.21.15.37:0/738424895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc15cd80 0x7f99bc06f3f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99c3800640 1 -- 172.21.15.37:0/738424895 >> 172.21.15.37:0/738424895 conn(0x7f99bc0b23a0 msgr2=0x7f99bc0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99c3800640 1 -- 172.21.15.37:0/738424895 shutdown_connections 2024-05-30T06:42:23.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99c3800640 1 -- 172.21.15.37:0/738424895 wait complete. 2024-05-30T06:42:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99c3800640 1 Processor -- start 2024-05-30T06:42:23.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.015+0000 7f99c3800640 1 -- start start 2024-05-30T06:42:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99c3800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99bc06e000 0x7f99bc13bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99c3800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0ce8d0 0x7f99bc0c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99c3800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99bc15cd80 0x7f99bc0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99c3800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc06f930 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99c3800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc0cdca0 con 0x7f99bc06e000 2024-05-30T06:42:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99c3800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f99bc06fab0 con 0x7f99bc15cd80 2024-05-30T06:42:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99bbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0ce8d0 0x7f99bc0c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99bbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0ce8d0 0x7f99bc0c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34246/0 (socket says 172.21.15.37:34246) 2024-05-30T06:42:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99bbe00640 1 -- 172.21.15.37:0/4134511552 learned_addr learned my addr 172.21.15.37:0/4134511552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99c0e00640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99bc06e000 0x7f99bc13bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99c1800640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99bc15cd80 0x7f99bc0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99bbe00640 1 -- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99bc15cd80 msgr2=0x7f99bc0b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99bbe00640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99bc15cd80 0x7f99bc0b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99bbe00640 1 -- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99bc06e000 msgr2=0x7f99bc13bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99bbe00640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99bc06e000 0x7f99bc13bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99bbe00640 1 -- 172.21.15.37:0/4134511552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99bc13c430 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99c0e00640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99bc06e000 0x7f99bc13bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:23.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99bbe00640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0ce8d0 0x7f99bc0c9c30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f99a801c940 tx=0x7f99a801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:23.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99b8c00640 1 -- 172.21.15.37:0/4134511552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a80b5040 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99b8c00640 1 -- 172.21.15.37:0/4134511552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a80be070 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99b8c00640 1 -- 172.21.15.37:0/4134511552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a80b1a10 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99c3800640 1 -- 172.21.15.37:0/4134511552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99bc0b40c0 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99c3800640 1 -- 172.21.15.37:0/4134511552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99bc0b4680 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99c3800640 1 -- 172.21.15.37:0/4134511552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99bc068b20 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.019+0000 7f99b8c00640 1 -- 172.21.15.37:0/4134511552 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f99a80b1bb0 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.023+0000 7f99b8c00640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f999c068380 0x7f999c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.023+0000 7f99b8c00640 1 -- 172.21.15.37:0/4134511552 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f99a8123c30 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.023+0000 7f99c0e00640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f999c068380 0x7f999c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.023+0000 7f99c0e00640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f999c068380 0x7f999c06a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f99b0001670 tx=0x7f99b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:23.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.027+0000 7f99b8c00640 1 -- 172.21.15.37:0/4134511552 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f99a8018870 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99c3800640 1 -- 172.21.15.37:0/4134511552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99bc15c4e0 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99b8c00640 1 -- 172.21.15.37:0/4134511552 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7f99a80f41e0 con 0x7f99bc0ce8d0 2024-05-30T06:42:23.191 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:23.191 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:23.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99c3800640 1 -- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f999c068380 msgr2=0x7f999c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99c3800640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f999c068380 0x7f999c06a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f99b0001670 tx=0x7f99b0009040 comp rx=0 tx=0).stop 2024-05-30T06:42:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99c3800640 1 -- 172.21.15.37:0/4134511552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0ce8d0 msgr2=0x7f99bc0c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99c3800640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0ce8d0 0x7f99bc0c9c30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f99a801c940 tx=0x7f99a801bab0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99c3800640 1 -- 172.21.15.37:0/4134511552 shutdown_connections 2024-05-30T06:42:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99c3800640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99bc15cd80 0x7f99bc0b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99c3800640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0ce8d0 0x7f99bc0c9c30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99c3800640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f999c068380 0x7f999c06a840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99c3800640 1 --2- 172.21.15.37:0/4134511552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99bc06e000 0x7f99bc13bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99c3800640 1 -- 172.21.15.37:0/4134511552 >> 172.21.15.37:0/4134511552 conn(0x7f99bc0b23a0 msgr2=0x7f99bc144c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99c3800640 1 -- 172.21.15.37:0/4134511552 shutdown_connections 2024-05-30T06:42:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.191+0000 7f99c3800640 1 -- 172.21.15.37:0/4134511552 wait complete. 2024-05-30T06:42:23.214 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:42:09.128133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:42:09.755772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:23.214 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:23.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.359+0000 7fdf5fe00640 1 Processor -- start 2024-05-30T06:42:23.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.359+0000 7fdf5fe00640 1 -- start start 2024-05-30T06:42:23.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.359+0000 7fdf5fe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdf600d0600 0x7fdf600cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.359+0000 7fdf5fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf6015c9a0 0x7fdf600d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.359+0000 7fdf5fe00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf600af0d0 con 0x7fdf600cffd0 2024-05-30T06:42:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.359+0000 7fdf5fe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdf600d0f20 con 0x7fdf6015c9a0 2024-05-30T06:42:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.359+0000 7fdf5fe00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdf600ce000 con 0x7fdf600d0600 2024-05-30T06:42:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.359+0000 7fdf56000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf6015c9a0 0x7fdf600d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.363+0000 7fdf56000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf6015c9a0 0x7fdf600d09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34248/0 (socket says 172.21.15.37:34248) 2024-05-30T06:42:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.363+0000 7fdf56000640 1 -- 172.21.15.37:0/2650315470 learned_addr learned my addr 172.21.15.37:0/2650315470 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.363+0000 7fdf5f400640 1 --1- 172.21.15.37:0/2650315470 >> v1:172.21.15.37:6789/0 conn(0x7fdf600cffd0 0x7fdf6009aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47816/0 (socket says 172.21.15.37:47816) 2024-05-30T06:42:23.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.363+0000 7fdf5ea00640 1 --2- 172.21.15.37:0/2650315470 >> v2:172.21.15.105:3300/0 conn(0x7fdf600d0600 0x7fdf600cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.363+0000 7fdf56000640 1 -- 172.21.15.37:0/2650315470 >> v2:172.21.15.105:3300/0 conn(0x7fdf600d0600 msgr2=0x7fdf600cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:23.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.363+0000 7fdf56000640 1 --2- 172.21.15.37:0/2650315470 >> v2:172.21.15.105:3300/0 conn(0x7fdf600d0600 0x7fdf600cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.363+0000 7fdf56000640 1 -- 172.21.15.37:0/2650315470 >> v1:172.21.15.37:6789/0 conn(0x7fdf600cffd0 legacy=0x7fdf6009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.363+0000 7fdf56000640 1 -- 172.21.15.37:0/2650315470 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf600ce2e0 con 0x7fdf6015c9a0 2024-05-30T06:42:23.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.363+0000 7fdf56000640 1 --2- 172.21.15.37:0/2650315470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf6015c9a0 0x7fdf600d09e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdf600734e0 tx=0x7fdf4801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4196ff973a717086 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:23.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.363+0000 7fdf5e000640 1 -- 172.21.15.37:0/2650315470 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf480aa650 con 0x7fdf6015c9a0 2024-05-30T06:42:23.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.363+0000 7fdf5e000640 1 -- 172.21.15.37:0/2650315470 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf480af070 con 0x7fdf6015c9a0 2024-05-30T06:42:23.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.363+0000 7fdf5e000640 1 -- 172.21.15.37:0/2650315470 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf480aaa10 con 0x7fdf6015c9a0 2024-05-30T06:42:23.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2650315470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf6015c9a0 msgr2=0x7fdf600d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 --2- 172.21.15.37:0/2650315470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf6015c9a0 0x7fdf600d09e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdf600734e0 tx=0x7fdf4801c4f0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2650315470 shutdown_connections 2024-05-30T06:42:23.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 --2- 172.21.15.37:0/2650315470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf6015c9a0 0x7fdf600d09e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 --2- 172.21.15.37:0/2650315470 >> v2:172.21.15.105:3300/0 conn(0x7fdf600d0600 0x7fdf600cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2650315470 >> 172.21.15.37:0/2650315470 conn(0x7fdf600b3ef0 msgr2=0x7fdf600b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:23.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2650315470 shutdown_connections 2024-05-30T06:42:23.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2650315470 wait complete. 2024-05-30T06:42:23.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 Processor -- start 2024-05-30T06:42:23.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 -- start start 2024-05-30T06:42:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf600cffd0 0x7fdf6006ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf600d0600 0x7fdf6015b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf6015c9a0 0x7fdf6015b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdf601694b0 con 0x7fdf600cffd0 2024-05-30T06:42:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60169330 con 0x7fdf600d0600 2024-05-30T06:42:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5fe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdf60169630 con 0x7fdf6015c9a0 2024-05-30T06:42:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf600cffd0 0x7fdf6006ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf600cffd0 0x7fdf6006ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34250/0 (socket says 172.21.15.37:34250) 2024-05-30T06:42:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5ea00640 1 -- 172.21.15.37:0/2778309316 learned_addr learned my addr 172.21.15.37:0/2778309316 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5f400640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf6015c9a0 0x7fdf6015b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf56000640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf600d0600 0x7fdf6015b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5ea00640 1 -- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf6015c9a0 msgr2=0x7fdf6015b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5ea00640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf6015c9a0 0x7fdf6015b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5ea00640 1 -- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf600d0600 msgr2=0x7fdf6015b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5ea00640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf600d0600 0x7fdf6015b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5ea00640 1 -- 172.21.15.37:0/2778309316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6006cf70 con 0x7fdf600cffd0 2024-05-30T06:42:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5f400640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf6015c9a0 0x7fdf6015b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf56000640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf600d0600 0x7fdf6015b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf5ea00640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf600cffd0 0x7fdf6006ff20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000efc0 tx=0x7fdf5000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.367+0000 7fdf57400640 1 -- 172.21.15.37:0/2778309316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50018020 con 0x7fdf600cffd0 2024-05-30T06:42:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.371+0000 7fdf57400640 1 -- 172.21.15.37:0/2778309316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf50014480 con 0x7fdf600cffd0 2024-05-30T06:42:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.371+0000 7fdf57400640 1 -- 172.21.15.37:0/2778309316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf50014850 con 0x7fdf600cffd0 2024-05-30T06:42:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.371+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2778309316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6006d250 con 0x7fdf600cffd0 2024-05-30T06:42:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.371+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2778309316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf6006d810 con 0x7fdf600cffd0 2024-05-30T06:42:23.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.371+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2778309316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf60068ab0 con 0x7fdf600cffd0 2024-05-30T06:42:23.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.371+0000 7fdf57400640 1 -- 172.21.15.37:0/2778309316 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdf5001b020 con 0x7fdf600cffd0 2024-05-30T06:42:23.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.371+0000 7fdf57400640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdf3c068380 0x7fdf3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.371+0000 7fdf57400640 1 -- 172.21.15.37:0/2778309316 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdf500877c0 con 0x7fdf600cffd0 2024-05-30T06:42:23.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.371+0000 7fdf56000640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdf3c068380 0x7fdf3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.375+0000 7fdf56000640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdf3c068380 0x7fdf3c06a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdf480ae000 tx=0x7fdf48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:23.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.375+0000 7fdf57400640 1 -- 172.21.15.37:0/2778309316 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdf50022030 con 0x7fdf600cffd0 2024-05-30T06:42:23.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.539+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2778309316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdf600ce930 con 0x7fdf600cffd0 2024-05-30T06:42:23.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.543+0000 7fdf57400640 1 -- 172.21.15.37:0/2778309316 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fdf50010040 con 0x7fdf600cffd0 2024-05-30T06:42:23.541 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.543+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdf3c068380 msgr2=0x7fdf3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.543+0000 7fdf5fe00640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdf3c068380 0x7fdf3c06a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdf480ae000 tx=0x7fdf48008040 comp rx=0 tx=0).stop 2024-05-30T06:42:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.543+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2778309316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf600cffd0 msgr2=0x7fdf6006ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.543+0000 7fdf5fe00640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf600cffd0 0x7fdf6006ff20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000efc0 tx=0x7fdf5000c490 comp rx=0 tx=0).stop 2024-05-30T06:42:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.543+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2778309316 shutdown_connections 2024-05-30T06:42:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.543+0000 7fdf5fe00640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf6015c9a0 0x7fdf6015b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.543+0000 7fdf5fe00640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdf3c068380 0x7fdf3c06a840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.543+0000 7fdf5fe00640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf600d0600 0x7fdf6015b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.543+0000 7fdf5fe00640 1 --2- 172.21.15.37:0/2778309316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf600cffd0 0x7fdf6006ff20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.543+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2778309316 >> 172.21.15.37:0/2778309316 conn(0x7fdf600b3ef0 msgr2=0x7fdf600b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.543+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2778309316 shutdown_connections 2024-05-30T06:42:23.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.543+0000 7fdf5fe00640 1 -- 172.21.15.37:0/2778309316 wait complete. 2024-05-30T06:42:23.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:42:23.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.707+0000 7f95eb000640 1 Processor -- start 2024-05-30T06:42:23.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.707+0000 7f95eb000640 1 -- start start 2024-05-30T06:42:23.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.707+0000 7f95eb000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f95e415ebc0 0x7f95e40d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.707+0000 7f95eb000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e40d0840 con 0x7f95e409aa60 2024-05-30T06:42:23.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.707+0000 7f95eb000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e406dec0 con 0x7f95e409b800 2024-05-30T06:42:23.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.707+0000 7f95eb000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f95e409bce0 con 0x7f95e415ebc0 2024-05-30T06:42:23.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.707+0000 7f95e9000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f95e409aa60 0x7f95e409ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47824/0 (socket says 172.21.15.37:47824) 2024-05-30T06:42:23.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.707+0000 7f95e9000640 1 -- 172.21.15.37:0/1230308440 learned_addr learned my addr 172.21.15.37:0/1230308440 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:23.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.707+0000 7f95e3e00640 1 --2- 172.21.15.37:0/1230308440 >> v2:172.21.15.105:3300/0 conn(0x7f95e415ebc0 0x7f95e40d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.707+0000 7f95e2a00640 1 -- 172.21.15.37:0/1230308440 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617833301 0 0) 0x7f95e40d0840 con 0x7f95e409aa60 2024-05-30T06:42:23.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.711+0000 7f95e2a00640 1 -- 172.21.15.37:0/1230308440 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95c8003530 con 0x7f95e409aa60 2024-05-30T06:42:23.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.711+0000 7f95e2a00640 1 -- 172.21.15.37:0/1230308440 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2419917805 0 0) 0x7f95e406dec0 con 0x7f95e409b800 2024-05-30T06:42:23.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.711+0000 7f95e2a00640 1 -- 172.21.15.37:0/1230308440 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95e40d0840 con 0x7f95e409b800 2024-05-30T06:42:23.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.711+0000 7f95e3e00640 1 -- 172.21.15.37:0/1230308440 >> v1:172.21.15.105:6789/0 conn(0x7f95e409b800 legacy=0x7f95e406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.711+0000 7f95e3e00640 1 -- 172.21.15.37:0/1230308440 >> v1:172.21.15.37:6789/0 conn(0x7f95e409aa60 legacy=0x7f95e409ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.711+0000 7f95e2a00640 1 -- 172.21.15.37:0/1230308440 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2702305669 0 0) 0x7f95c8003530 con 0x7f95e409aa60 2024-05-30T06:42:23.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.711+0000 7f95e3e00640 1 -- 172.21.15.37:0/1230308440 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e40d0ae0 con 0x7f95e415ebc0 2024-05-30T06:42:23.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.711+0000 7f95e3e00640 1 --2- 172.21.15.37:0/1230308440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e415ebc0 0x7f95e40d15c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f95d40097c0 tx=0x7f95d401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52cba3d4a3b47473 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:23.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.711+0000 7f95e2a00640 1 -- 172.21.15.37:0/1230308440 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d40b0070 con 0x7f95e415ebc0 2024-05-30T06:42:23.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.711+0000 7f95e2a00640 1 -- 172.21.15.37:0/1230308440 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d40ab400 con 0x7f95e415ebc0 2024-05-30T06:42:23.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.711+0000 7f95e2a00640 1 -- 172.21.15.37:0/1230308440 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95dc001a00 con 0x7f95e415ebc0 2024-05-30T06:42:23.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.711+0000 7f95eb000640 1 -- 172.21.15.37:0/1230308440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e415ebc0 msgr2=0x7f95e40d15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.711+0000 7f95eb000640 1 --2- 172.21.15.37:0/1230308440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e415ebc0 0x7f95e40d15c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f95d40097c0 tx=0x7f95d401c3c0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95eb000640 1 -- 172.21.15.37:0/1230308440 shutdown_connections 2024-05-30T06:42:23.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95eb000640 1 --2- 172.21.15.37:0/1230308440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e415ebc0 0x7f95e40d15c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95eb000640 1 -- 172.21.15.37:0/1230308440 >> 172.21.15.37:0/1230308440 conn(0x7f95e40b4060 msgr2=0x7f95e40b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:23.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95eb000640 1 -- 172.21.15.37:0/1230308440 shutdown_connections 2024-05-30T06:42:23.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95eb000640 1 -- 172.21.15.37:0/1230308440 wait complete. 2024-05-30T06:42:23.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95eb000640 1 Processor -- start 2024-05-30T06:42:23.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95eb000640 1 -- start start 2024-05-30T06:42:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95eb000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95e409aa60 0x7f95e40b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95eb000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e409b800 0x7f95e40b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95eb000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e415ebc0 0x7f95e414cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95eb000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95e40d1b00 con 0x7f95e409b800 2024-05-30T06:42:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95eb000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95e40cd3d0 con 0x7f95e415ebc0 2024-05-30T06:42:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95eb000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f95e4154fe0 con 0x7f95e409aa60 2024-05-30T06:42:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95e3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e409b800 0x7f95e40b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95e3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e409b800 0x7f95e40b4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34254/0 (socket says 172.21.15.37:34254) 2024-05-30T06:42:23.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95e3400640 1 -- 172.21.15.37:0/4018777013 learned_addr learned my addr 172.21.15.37:0/4018777013 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:23.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95e3e00640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95e409aa60 0x7f95e40b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95e9000640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e415ebc0 0x7f95e414cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95e3400640 1 -- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95e409aa60 msgr2=0x7f95e40b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95e3400640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95e409aa60 0x7f95e40b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95e3400640 1 -- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e415ebc0 msgr2=0x7f95e414cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95e3400640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e415ebc0 0x7f95e414cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95e3400640 1 -- 172.21.15.37:0/4018777013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e4155230 con 0x7f95e409b800 2024-05-30T06:42:23.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95e3400640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e409b800 0x7f95e40b4f90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f95d000c500 tx=0x7f95d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:23.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.715+0000 7f95dbe00640 1 -- 172.21.15.37:0/4018777013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d00052d0 con 0x7f95e409b800 2024-05-30T06:42:23.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.719+0000 7f95dbe00640 1 -- 172.21.15.37:0/4018777013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d0005470 con 0x7f95e409b800 2024-05-30T06:42:23.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.719+0000 7f95dbe00640 1 -- 172.21.15.37:0/4018777013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0012870 con 0x7f95e409b800 2024-05-30T06:42:23.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.719+0000 7f95eb000640 1 -- 172.21.15.37:0/4018777013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e4155510 con 0x7f95e409b800 2024-05-30T06:42:23.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.719+0000 7f95eb000640 1 -- 172.21.15.37:0/4018777013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e40b08f0 con 0x7f95e409b800 2024-05-30T06:42:23.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.719+0000 7f95eb000640 1 -- 172.21.15.37:0/4018777013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e4068bc0 con 0x7f95e409b800 2024-05-30T06:42:23.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.719+0000 7f95dbe00640 1 -- 172.21.15.37:0/4018777013 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f95d0012a10 con 0x7f95e409b800 2024-05-30T06:42:23.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.719+0000 7f95dbe00640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95c4068380 0x7f95c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:23.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.719+0000 7f95dbe00640 1 -- 172.21.15.37:0/4018777013 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f95d00866e0 con 0x7f95e409b800 2024-05-30T06:42:23.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.719+0000 7f95e3e00640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95c4068380 0x7f95c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:23.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.723+0000 7f95e3e00640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95c4068380 0x7f95c406a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f95d40ad000 tx=0x7f95d40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:23.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.723+0000 7f95dbe00640 1 -- 172.21.15.37:0/4018777013 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f95d0056c10 con 0x7f95e409b800 2024-05-30T06:42:23.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.887+0000 7f95eb000640 1 -- 172.21.15.37:0/4018777013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f95e41568d0 con 0x7f95e409b800 2024-05-30T06:42:23.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.891+0000 7f95dbe00640 1 -- 172.21.15.37:0/4018777013 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f95d0056510 con 0x7f95e409b800 2024-05-30T06:42:23.889 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:42:23.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.891+0000 7f95eb000640 1 -- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95c4068380 msgr2=0x7f95c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.891+0000 7f95eb000640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95c4068380 0x7f95c406a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f95d40ad000 tx=0x7f95d40a6000 comp rx=0 tx=0).stop 2024-05-30T06:42:23.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.891+0000 7f95eb000640 1 -- 172.21.15.37:0/4018777013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e409b800 msgr2=0x7f95e40b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:23.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.891+0000 7f95eb000640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e409b800 0x7f95e40b4f90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f95d000c500 tx=0x7f95d000c9c0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.891+0000 7f95eb000640 1 -- 172.21.15.37:0/4018777013 shutdown_connections 2024-05-30T06:42:23.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.891+0000 7f95eb000640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95c4068380 0x7f95c406a840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.891+0000 7f95eb000640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95e415ebc0 0x7f95e414cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.891+0000 7f95eb000640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95e409b800 0x7f95e40b4f90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.891+0000 7f95eb000640 1 --2- 172.21.15.37:0/4018777013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95e409aa60 0x7f95e40b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:23.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.891+0000 7f95eb000640 1 -- 172.21.15.37:0/4018777013 >> 172.21.15.37:0/4018777013 conn(0x7f95e40b4060 msgr2=0x7f95e40b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:23.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.891+0000 7f95eb000640 1 -- 172.21.15.37:0/4018777013 shutdown_connections 2024-05-30T06:42:23.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:23.891+0000 7f95eb000640 1 -- 172.21.15.37:0/4018777013 wait complete. 2024-05-30T06:42:23.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:42:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.051+0000 7f3e63200640 1 Processor -- start 2024-05-30T06:42:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.051+0000 7f3e63200640 1 -- start start 2024-05-30T06:42:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e63200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e5c09bba0 0x7f3e5c06d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e63200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e5c06d9c0 0x7f3e5c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e63200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e5c09ab00 con 0x7f3e5c15ead0 2024-05-30T06:42:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e63200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3e5c09ade0 con 0x7f3e5c09bba0 2024-05-30T06:42:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e63200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5c09b0c0 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e53400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e5c09bba0 0x7f3e5c06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e53400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e5c09bba0 0x7f3e5c06d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34260/0 (socket says 172.21.15.37:34260) 2024-05-30T06:42:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e53400640 1 -- 172.21.15.37:0/143286386 learned_addr learned my addr 172.21.15.37:0/143286386 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e61200640 1 --2- 172.21.15.37:0/143286386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e5c06d9c0 0x7f3e5c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e53400640 1 -- 172.21.15.37:0/143286386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e5c06d9c0 msgr2=0x7f3e5c0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e53400640 1 --2- 172.21.15.37:0/143286386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e5c06d9c0 0x7f3e5c0ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e53400640 1 -- 172.21.15.37:0/143286386 >> v1:172.21.15.105:6789/0 conn(0x7f3e5c15ead0 legacy=0x7f3e5c0d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e53400640 1 -- 172.21.15.37:0/143286386 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c09b3a0 con 0x7f3e5c09bba0 2024-05-30T06:42:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.055+0000 7f3e61200640 1 --2- 172.21.15.37:0/143286386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e5c06d9c0 0x7f3e5c0ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e53400640 1 --2- 172.21.15.37:0/143286386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c09bba0 0x7f3e5c06d480 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009870 tx=0x7f3e4401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6761b1fbe052d77c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e5b400640 1 -- 172.21.15.37:0/143286386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e440ab430 con 0x7f3e5c09bba0 2024-05-30T06:42:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e5b400640 1 -- 172.21.15.37:0/143286386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e440b0070 con 0x7f3e5c09bba0 2024-05-30T06:42:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e5b400640 1 -- 172.21.15.37:0/143286386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e440ab7f0 con 0x7f3e5c09bba0 2024-05-30T06:42:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e63200640 1 -- 172.21.15.37:0/143286386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c09bba0 msgr2=0x7f3e5c06d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e63200640 1 --2- 172.21.15.37:0/143286386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c09bba0 0x7f3e5c06d480 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009870 tx=0x7f3e4401c560 comp rx=0 tx=0).stop 2024-05-30T06:42:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e63200640 1 -- 172.21.15.37:0/143286386 shutdown_connections 2024-05-30T06:42:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e63200640 1 --2- 172.21.15.37:0/143286386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e5c06d9c0 0x7f3e5c0ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e63200640 1 --2- 172.21.15.37:0/143286386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c09bba0 0x7f3e5c06d480 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e63200640 1 -- 172.21.15.37:0/143286386 >> 172.21.15.37:0/143286386 conn(0x7f3e5c0b4100 msgr2=0x7f3e5c0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e63200640 1 -- 172.21.15.37:0/143286386 shutdown_connections 2024-05-30T06:42:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e63200640 1 -- 172.21.15.37:0/143286386 wait complete. 2024-05-30T06:42:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e63200640 1 Processor -- start 2024-05-30T06:42:24.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.059+0000 7f3e63200640 1 -- start start 2024-05-30T06:42:24.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e63200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c06d9c0 0x7f3e5c1532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e63200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e5c09bba0 0x7f3e5c0afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e63200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e5c15ead0 0x7f3e5c0ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e63200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c0d1ad0 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e63200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c0d1950 con 0x7f3e5c15ead0 2024-05-30T06:42:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e63200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5c16ba20 con 0x7f3e5c09bba0 2024-05-30T06:42:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e5be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c06d9c0 0x7f3e5c1532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e5be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c06d9c0 0x7f3e5c1532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34276/0 (socket says 172.21.15.37:34276) 2024-05-30T06:42:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e5be00640 1 -- 172.21.15.37:0/748357800 learned_addr learned my addr 172.21.15.37:0/748357800 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e53400640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e5c09bba0 0x7f3e5c0afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e61200640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e5c15ead0 0x7f3e5c0ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e5be00640 1 -- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e5c09bba0 msgr2=0x7f3e5c0afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e5be00640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e5c09bba0 0x7f3e5c0afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e5be00640 1 -- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e5c15ead0 msgr2=0x7f3e5c0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e5be00640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e5c15ead0 0x7f3e5c0ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e5be00640 1 -- 172.21.15.37:0/748357800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c0b02f0 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e5be00640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c06d9c0 0x7f3e5c1532a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00c790 tx=0x7f3e4c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:24.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e58c00640 1 -- 172.21.15.37:0/748357800 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c016020 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e58c00640 1 -- 172.21.15.37:0/748357800 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e4c006d60 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e58c00640 1 -- 172.21.15.37:0/748357800 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c003bc0 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e63200640 1 -- 172.21.15.37:0/748357800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e5c0b0570 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e63200640 1 -- 172.21.15.37:0/748357800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e5c0b0b30 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e63200640 1 -- 172.21.15.37:0/748357800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e5c0b1810 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.063+0000 7f3e58c00640 1 -- 172.21.15.37:0/748357800 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e4c00a850 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.067+0000 7f3e58c00640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e38068380 0x7f3e3806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.067+0000 7f3e58c00640 1 -- 172.21.15.37:0/748357800 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3e4c086670 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.067+0000 7f3e53400640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e38068380 0x7f3e3806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.067+0000 7f3e53400640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e38068380 0x7f3e3806a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e440af000 tx=0x7f3e44008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.071+0000 7f3e58c00640 1 -- 172.21.15.37:0/748357800 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3e4c020020 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.231+0000 7f3e63200640 1 -- 172.21.15.37:0/748357800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3e5c0b4ee0 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.235+0000 7f3e58c00640 1 -- 172.21.15.37:0/748357800 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f3e5c0b02f0 con 0x7f3e5c06d9c0 2024-05-30T06:42:24.233 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:42:24.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.235+0000 7f3e63200640 1 -- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e38068380 msgr2=0x7f3e3806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.235+0000 7f3e63200640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e38068380 0x7f3e3806a840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e440af000 tx=0x7f3e44008040 comp rx=0 tx=0).stop 2024-05-30T06:42:24.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.235+0000 7f3e63200640 1 -- 172.21.15.37:0/748357800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c06d9c0 msgr2=0x7f3e5c1532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.235+0000 7f3e63200640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c06d9c0 0x7f3e5c1532a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00c790 tx=0x7f3e4c00cc50 comp rx=0 tx=0).stop 2024-05-30T06:42:24.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.235+0000 7f3e63200640 1 -- 172.21.15.37:0/748357800 shutdown_connections 2024-05-30T06:42:24.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.235+0000 7f3e63200640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e38068380 0x7f3e3806a840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.235+0000 7f3e63200640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e5c15ead0 0x7f3e5c0ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.235+0000 7f3e63200640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e5c09bba0 0x7f3e5c0afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.235+0000 7f3e63200640 1 --2- 172.21.15.37:0/748357800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c06d9c0 0x7f3e5c1532a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.235+0000 7f3e63200640 1 -- 172.21.15.37:0/748357800 >> 172.21.15.37:0/748357800 conn(0x7f3e5c0b4100 msgr2=0x7f3e5c162610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:24.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.235+0000 7f3e63200640 1 -- 172.21.15.37:0/748357800 shutdown_connections 2024-05-30T06:42:24.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.235+0000 7f3e63200640 1 -- 172.21.15.37:0/748357800 wait complete. 2024-05-30T06:42:24.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:42:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e9a00640 1 Processor -- start 2024-05-30T06:42:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e9a00640 1 -- start start 2024-05-30T06:42:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e9a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59e40b2e20 0x7f59e4160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e9a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f59e41609c0 0x7f59e4160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e9a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59e40cd280 0x7f59e40cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e9a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f59e40b3200 con 0x7f59e40cd280 2024-05-30T06:42:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e9a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f59e40d01e0 con 0x7f59e41609c0 2024-05-30T06:42:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e9a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f59e40b33a0 con 0x7f59e40b2e20 2024-05-30T06:42:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59e40cd280 0x7f59e40cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59e40cd280 0x7f59e40cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34290/0 (socket says 172.21.15.37:34290) 2024-05-30T06:42:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e3400640 1 -- 172.21.15.37:0/3168636796 learned_addr learned my addr 172.21.15.37:0/3168636796 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e2a00640 1 --2- 172.21.15.37:0/3168636796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59e40b2e20 0x7f59e4160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e2000640 1 --2- 172.21.15.37:0/3168636796 >> v2:172.21.15.105:3300/0 conn(0x7f59e41609c0 0x7f59e4160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e3400640 1 -- 172.21.15.37:0/3168636796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59e40b2e20 msgr2=0x7f59e4160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e3400640 1 --2- 172.21.15.37:0/3168636796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59e40b2e20 0x7f59e4160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e3400640 1 -- 172.21.15.37:0/3168636796 >> v2:172.21.15.105:3300/0 conn(0x7f59e41609c0 msgr2=0x7f59e4160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e3400640 1 --2- 172.21.15.37:0/3168636796 >> v2:172.21.15.105:3300/0 conn(0x7f59e41609c0 0x7f59e4160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.395+0000 7f59e3400640 1 -- 172.21.15.37:0/3168636796 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e40d0430 con 0x7f59e40cd280 2024-05-30T06:42:24.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.399+0000 7f59e3400640 1 --2- 172.21.15.37:0/3168636796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40cd280 0x7f59e40cd710 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f59dc009e50 tx=0x7f59dc01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5838c6c18e1fd986 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:24.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.399+0000 7f59e1600640 1 -- 172.21.15.37:0/3168636796 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0a5840 con 0x7f59e40cd280 2024-05-30T06:42:24.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.399+0000 7f59e1600640 1 -- 172.21.15.37:0/3168636796 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59dc0a59e0 con 0x7f59e40cd280 2024-05-30T06:42:24.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.399+0000 7f59e1600640 1 -- 172.21.15.37:0/3168636796 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0a5db0 con 0x7f59e40cd280 2024-05-30T06:42:24.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.399+0000 7f59e9a00640 1 -- 172.21.15.37:0/3168636796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40cd280 msgr2=0x7f59e40cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.399+0000 7f59e9a00640 1 --2- 172.21.15.37:0/3168636796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40cd280 0x7f59e40cd710 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f59dc009e50 tx=0x7f59dc01c9c0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.399+0000 7f59e9a00640 1 -- 172.21.15.37:0/3168636796 shutdown_connections 2024-05-30T06:42:24.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.399+0000 7f59e9a00640 1 --2- 172.21.15.37:0/3168636796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40cd280 0x7f59e40cd710 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.399+0000 7f59e9a00640 1 --2- 172.21.15.37:0/3168636796 >> v2:172.21.15.105:3300/0 conn(0x7f59e41609c0 0x7f59e4160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.399+0000 7f59e9a00640 1 --2- 172.21.15.37:0/3168636796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59e40b2e20 0x7f59e4160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.399+0000 7f59e9a00640 1 -- 172.21.15.37:0/3168636796 >> 172.21.15.37:0/3168636796 conn(0x7f59e40b4100 msgr2=0x7f59e40b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:24.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.399+0000 7f59e9a00640 1 -- 172.21.15.37:0/3168636796 shutdown_connections 2024-05-30T06:42:24.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.399+0000 7f59e9a00640 1 -- 172.21.15.37:0/3168636796 wait complete. 2024-05-30T06:42:24.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e9a00640 1 Processor -- start 2024-05-30T06:42:24.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e9a00640 1 -- start start 2024-05-30T06:42:24.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e9a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59e40b2e20 0x7f59e40b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e9a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40cd280 0x7f59e40b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e9a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59e41609c0 0x7f59e40c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e9a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59e409aa60 con 0x7f59e40cd280 2024-05-30T06:42:24.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e9a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f59e40cee40 con 0x7f59e40b2e20 2024-05-30T06:42:24.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e9a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f59e409abe0 con 0x7f59e41609c0 2024-05-30T06:42:24.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40cd280 0x7f59e40b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40cd280 0x7f59e40b1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34296/0 (socket says 172.21.15.37:34296) 2024-05-30T06:42:24.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e2000640 1 -- 172.21.15.37:0/2299810292 learned_addr learned my addr 172.21.15.37:0/2299810292 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:24.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e3400640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59e41609c0 0x7f59e40c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e2a00640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59e40b2e20 0x7f59e40b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e2000640 1 -- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59e41609c0 msgr2=0x7f59e40c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e2000640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59e41609c0 0x7f59e40c5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e2000640 1 -- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59e40b2e20 msgr2=0x7f59e40b7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e2000640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59e40b2e20 0x7f59e40b7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e2000640 1 -- 172.21.15.37:0/2299810292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e40b1b80 con 0x7f59e40cd280 2024-05-30T06:42:24.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e2000640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40cd280 0x7f59e40b1270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f59d000d5f0 tx=0x7f59d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:24.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59daa00640 1 -- 172.21.15.37:0/2299810292 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d00125f0 con 0x7f59e40cd280 2024-05-30T06:42:24.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59daa00640 1 -- 172.21.15.37:0/2299810292 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d0019070 con 0x7f59e40cd280 2024-05-30T06:42:24.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59daa00640 1 -- 172.21.15.37:0/2299810292 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d00129b0 con 0x7f59e40cd280 2024-05-30T06:42:24.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e9a00640 1 -- 172.21.15.37:0/2299810292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e40b1e60 con 0x7f59e40cd280 2024-05-30T06:42:24.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.403+0000 7f59e9a00640 1 -- 172.21.15.37:0/2299810292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e40b17b0 con 0x7f59e40cd280 2024-05-30T06:42:24.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.407+0000 7f59e9a00640 1 -- 172.21.15.37:0/2299810292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e4068b20 con 0x7f59e40cd280 2024-05-30T06:42:24.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.407+0000 7f59daa00640 1 -- 172.21.15.37:0/2299810292 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f59d0012b50 con 0x7f59e40cd280 2024-05-30T06:42:24.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.407+0000 7f59daa00640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f59c4068380 0x7f59c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.407+0000 7f59daa00640 1 -- 172.21.15.37:0/2299810292 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f59d0086c30 con 0x7f59e40cd280 2024-05-30T06:42:24.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.407+0000 7f59e2a00640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f59c4068380 0x7f59c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.407+0000 7f59e2a00640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f59c4068380 0x7f59c406a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f59d4007a60 tx=0x7f59d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:24.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.411+0000 7f59daa00640 1 -- 172.21.15.37:0/2299810292 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f59d0056ba0 con 0x7f59e40cd280 2024-05-30T06:42:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.607+0000 7f59e9a00640 1 -- 172.21.15.37:0/2299810292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59e40ce860 con 0x7f59e40cd280 2024-05-30T06:42:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.611+0000 7f59daa00640 1 -- 172.21.15.37:0/2299810292 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f59d0057e20 con 0x7f59e40cd280 2024-05-30T06:42:24.609 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:24.609 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2950341560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2950341560},{"type":"v1","addr":"172.21.15.37:6835","nonce":2950341560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/1458371524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1458371524},{"type":"v1","addr":"172.21.15.105:6836","nonce":1458371524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4088854019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4088854019},{"type":"v1","addr":"172.21.15.37:6833","nonce":4088854019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:42:10.805274+0000","modified":"2024-05-30T06:42:13.844990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2952122373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2952122373},{"type":"v1","addr":"172.21.15.105:6837","nonce":2952122373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-05-30T06:42:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-05-30T06:42:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.611+0000 7f59e9a00640 1 -- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f59c4068380 msgr2=0x7f59c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.611+0000 7f59e9a00640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f59c4068380 0x7f59c406a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f59d4007a60 tx=0x7f59d4008040 comp rx=0 tx=0).stop 2024-05-30T06:42:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.611+0000 7f59e9a00640 1 -- 172.21.15.37:0/2299810292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40cd280 msgr2=0x7f59e40b1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.611+0000 7f59e9a00640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40cd280 0x7f59e40b1270 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f59d000d5f0 tx=0x7f59d000dab0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.611+0000 7f59e9a00640 1 -- 172.21.15.37:0/2299810292 shutdown_connections 2024-05-30T06:42:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.611+0000 7f59e9a00640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59e41609c0 0x7f59e40c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.611+0000 7f59e9a00640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59e40cd280 0x7f59e40b1270 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.611+0000 7f59e9a00640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f59c4068380 0x7f59c406a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.611+0000 7f59e9a00640 1 --2- 172.21.15.37:0/2299810292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59e40b2e20 0x7f59e40b7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.611+0000 7f59e9a00640 1 -- 172.21.15.37:0/2299810292 >> 172.21.15.37:0/2299810292 conn(0x7f59e40b4100 msgr2=0x7f59e4071300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.611+0000 7f59e9a00640 1 -- 172.21.15.37:0/2299810292 shutdown_connections 2024-05-30T06:42:24.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.611+0000 7f59e9a00640 1 -- 172.21.15.37:0/2299810292 wait complete. 2024-05-30T06:42:24.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.771+0000 7fe594a00640 1 Processor -- start 2024-05-30T06:42:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.771+0000 7fe594a00640 1 -- start start 2024-05-30T06:42:24.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.771+0000 7fe594a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe5900b6e20 0x7fe590169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.775+0000 7fe594a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe59006d550 con 0x7fe59006cde0 2024-05-30T06:42:24.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.775+0000 7fe594a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe59006d830 con 0x7fe590161ff0 2024-05-30T06:42:24.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.775+0000 7fe594a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe59006db10 con 0x7fe5900b6e20 2024-05-30T06:42:24.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.775+0000 7fe587e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe59006cde0 0x7fe5900b6710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47828/0 (socket says 172.21.15.37:47828) 2024-05-30T06:42:24.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.775+0000 7fe587e00640 1 -- 172.21.15.37:0/3448214401 learned_addr learned my addr 172.21.15.37:0/3448214401 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:24.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.775+0000 7fe58e800640 1 --2- 172.21.15.37:0/3448214401 >> v2:172.21.15.105:3300/0 conn(0x7fe5900b6e20 0x7fe590169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.775+0000 7fe58d400640 1 -- 172.21.15.37:0/3448214401 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1075051522 0 0) 0x7fe59006d550 con 0x7fe59006cde0 2024-05-30T06:42:24.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.775+0000 7fe58d400640 1 -- 172.21.15.37:0/3448214401 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe574003530 con 0x7fe59006cde0 2024-05-30T06:42:24.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.775+0000 7fe58e800640 1 -- 172.21.15.37:0/3448214401 >> v1:172.21.15.105:6789/0 conn(0x7fe590161ff0 legacy=0x7fe5900cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.775+0000 7fe58e800640 1 -- 172.21.15.37:0/3448214401 >> v1:172.21.15.37:6789/0 conn(0x7fe59006cde0 legacy=0x7fe5900b6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.775+0000 7fe58e800640 1 -- 172.21.15.37:0/3448214401 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5900d2bc0 con 0x7fe5900b6e20 2024-05-30T06:42:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.775+0000 7fe58e800640 1 --2- 172.21.15.37:0/3448214401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5900b6e20 0x7fe590169aa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe588009d90 tx=0x7fe58801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cb0830b9e1771bd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:24.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe58d400640 1 -- 172.21.15.37:0/3448214401 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5880b2070 con 0x7fe5900b6e20 2024-05-30T06:42:24.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe58d400640 1 -- 172.21.15.37:0/3448214401 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5880a5940 con 0x7fe5900b6e20 2024-05-30T06:42:24.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe58d400640 1 -- 172.21.15.37:0/3448214401 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5880a5cf0 con 0x7fe5900b6e20 2024-05-30T06:42:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 -- 172.21.15.37:0/3448214401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5900b6e20 msgr2=0x7fe590169aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 --2- 172.21.15.37:0/3448214401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5900b6e20 0x7fe590169aa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe588009d90 tx=0x7fe58801c970 comp rx=0 tx=0).stop 2024-05-30T06:42:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 -- 172.21.15.37:0/3448214401 shutdown_connections 2024-05-30T06:42:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 --2- 172.21.15.37:0/3448214401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5900b6e20 0x7fe590169aa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 -- 172.21.15.37:0/3448214401 >> 172.21.15.37:0/3448214401 conn(0x7fe5900d1780 msgr2=0x7fe5900d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 -- 172.21.15.37:0/3448214401 shutdown_connections 2024-05-30T06:42:24.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 -- 172.21.15.37:0/3448214401 wait complete. 2024-05-30T06:42:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 Processor -- start 2024-05-30T06:42:24.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 -- start start 2024-05-30T06:42:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59006cde0 0x7fe590157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5900b6e20 0x7fe5900b8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe590161ff0 0x7fe5900b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe590162550 con 0x7fe59006cde0 2024-05-30T06:42:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe5901623d0 con 0x7fe5900b6e20 2024-05-30T06:42:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe594a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe59016c800 con 0x7fe590161ff0 2024-05-30T06:42:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe58de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59006cde0 0x7fe590157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe58de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59006cde0 0x7fe590157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34312/0 (socket says 172.21.15.37:34312) 2024-05-30T06:42:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe58de00640 1 -- 172.21.15.37:0/3098254593 learned_addr learned my addr 172.21.15.37:0/3098254593 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.779+0000 7fe587e00640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5900b6e20 0x7fe5900b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe58e800640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe590161ff0 0x7fe5900b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe58de00640 1 -- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe590161ff0 msgr2=0x7fe5900b8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe58de00640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe590161ff0 0x7fe5900b8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe58de00640 1 -- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5900b6e20 msgr2=0x7fe5900b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe58de00640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5900b6e20 0x7fe5900b8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe58de00640 1 -- 172.21.15.37:0/3098254593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5900cabe0 con 0x7fe59006cde0 2024-05-30T06:42:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe58e800640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe590161ff0 0x7fe5900b8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe58de00640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59006cde0 0x7fe590157300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe58000c3a0 tx=0x7fe58000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe586000640 1 -- 172.21.15.37:0/3098254593 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5800052d0 con 0x7fe59006cde0 2024-05-30T06:42:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe586000640 1 -- 172.21.15.37:0/3098254593 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe580005470 con 0x7fe59006cde0 2024-05-30T06:42:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe586000640 1 -- 172.21.15.37:0/3098254593 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580007260 con 0x7fe59006cde0 2024-05-30T06:42:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe594a00640 1 -- 172.21.15.37:0/3098254593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5900caec0 con 0x7fe59006cde0 2024-05-30T06:42:24.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe594a00640 1 -- 172.21.15.37:0/3098254593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5900cb9d0 con 0x7fe59006cde0 2024-05-30T06:42:24.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe594a00640 1 -- 172.21.15.37:0/3098254593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe590068b20 con 0x7fe59006cde0 2024-05-30T06:42:24.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe586000640 1 -- 172.21.15.37:0/3098254593 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe580007400 con 0x7fe59006cde0 2024-05-30T06:42:24.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe586000640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe56c0683d0 0x7fe56c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:24.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.783+0000 7fe586000640 1 -- 172.21.15.37:0/3098254593 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe580085d90 con 0x7fe59006cde0 2024-05-30T06:42:24.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.787+0000 7fe587e00640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe56c0683d0 0x7fe56c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:24.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.787+0000 7fe587e00640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe56c0683d0 0x7fe56c06a890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5900ce0c0 tx=0x7fe578007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.787+0000 7fe586000640 1 -- 172.21.15.37:0/3098254593 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe580055ce0 con 0x7fe59006cde0 2024-05-30T06:42:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.951+0000 7fe594a00640 1 -- 172.21.15.37:0/3098254593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5900d25d0 con 0x7fe59006cde0 2024-05-30T06:42:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.955+0000 7fe586000640 1 -- 172.21.15.37:0/3098254593 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7fe580059fe0 con 0x7fe59006cde0 2024-05-30T06:42:24.953 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:24.953 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.955+0000 7fe594a00640 1 -- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe56c0683d0 msgr2=0x7fe56c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.955+0000 7fe594a00640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe56c0683d0 0x7fe56c06a890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5900ce0c0 tx=0x7fe578007d40 comp rx=0 tx=0).stop 2024-05-30T06:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.955+0000 7fe594a00640 1 -- 172.21.15.37:0/3098254593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59006cde0 msgr2=0x7fe590157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.955+0000 7fe594a00640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59006cde0 0x7fe590157300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe58000c3a0 tx=0x7fe58000c860 comp rx=0 tx=0).stop 2024-05-30T06:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.955+0000 7fe594a00640 1 -- 172.21.15.37:0/3098254593 shutdown_connections 2024-05-30T06:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.955+0000 7fe594a00640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe590161ff0 0x7fe5900b8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.955+0000 7fe594a00640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe56c0683d0 0x7fe56c06a890 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.955+0000 7fe594a00640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5900b6e20 0x7fe5900b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.955+0000 7fe594a00640 1 --2- 172.21.15.37:0/3098254593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59006cde0 0x7fe590157300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.955+0000 7fe594a00640 1 -- 172.21.15.37:0/3098254593 >> 172.21.15.37:0/3098254593 conn(0x7fe5900d1780 msgr2=0x7fe5900d1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.955+0000 7fe594a00640 1 -- 172.21.15.37:0/3098254593 shutdown_connections 2024-05-30T06:42:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:24.955+0000 7fe594a00640 1 -- 172.21.15.37:0/3098254593 wait complete. 2024-05-30T06:42:24.975 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:42:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d4ce00640 1 Processor -- start 2024-05-30T06:42:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d4ce00640 1 -- start start 2024-05-30T06:42:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d4ce00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d4806e000 0x7f1d480ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d4ce00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1d4815cd80 0x7f1d480ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d4ce00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d480cec40 0x7f1d4806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d4ce00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1d480a9530 con 0x7f1d4806e000 2024-05-30T06:42:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d4ce00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1d480cd120 con 0x7f1d4815cd80 2024-05-30T06:42:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d4ce00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1d480cd400 con 0x7f1d480cec40 2024-05-30T06:42:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d45e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d4806e000 0x7f1d480ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d45e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d4806e000 0x7f1d480ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34324/0 (socket says 172.21.15.37:34324) 2024-05-30T06:42:25.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d45e00640 1 -- 172.21.15.37:0/245780714 learned_addr learned my addr 172.21.15.37:0/245780714 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:25.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d3fe00640 1 --2- 172.21.15.37:0/245780714 >> v2:172.21.15.105:3300/0 conn(0x7f1d4815cd80 0x7f1d480ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d46800640 1 --2- 172.21.15.37:0/245780714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d480cec40 0x7f1d4806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d45e00640 1 -- 172.21.15.37:0/245780714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d480cec40 msgr2=0x7f1d4806e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d45e00640 1 --2- 172.21.15.37:0/245780714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d480cec40 0x7f1d4806e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d45e00640 1 -- 172.21.15.37:0/245780714 >> v2:172.21.15.105:3300/0 conn(0x7f1d4815cd80 msgr2=0x7f1d480ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d45e00640 1 --2- 172.21.15.37:0/245780714 >> v2:172.21.15.105:3300/0 conn(0x7f1d4815cd80 0x7f1d480ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d45e00640 1 -- 172.21.15.37:0/245780714 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d480cd6e0 con 0x7f1d4806e000 2024-05-30T06:42:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d3fe00640 1 --2- 172.21.15.37:0/245780714 >> v2:172.21.15.105:3300/0 conn(0x7f1d4815cd80 0x7f1d480ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.115+0000 7f1d46800640 1 --2- 172.21.15.37:0/245780714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d480cec40 0x7f1d4806e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.119+0000 7f1d45e00640 1 --2- 172.21.15.37:0/245780714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d4806e000 0x7f1d480ce1c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1d480cfb50 tx=0x7f1d3801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f514a41367f135aa server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.119+0000 7f1d45400640 1 -- 172.21.15.37:0/245780714 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380b5070 con 0x7f1d4806e000 2024-05-30T06:42:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.119+0000 7f1d45400640 1 -- 172.21.15.37:0/245780714 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d380a89d0 con 0x7f1d4806e000 2024-05-30T06:42:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.119+0000 7f1d45400640 1 -- 172.21.15.37:0/245780714 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380a8da0 con 0x7f1d4806e000 2024-05-30T06:42:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.119+0000 7f1d4ce00640 1 -- 172.21.15.37:0/245780714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d4806e000 msgr2=0x7f1d480ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.119+0000 7f1d4ce00640 1 --2- 172.21.15.37:0/245780714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d4806e000 0x7f1d480ce1c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1d480cfb50 tx=0x7f1d3801ed10 comp rx=0 tx=0).stop 2024-05-30T06:42:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.119+0000 7f1d4ce00640 1 -- 172.21.15.37:0/245780714 shutdown_connections 2024-05-30T06:42:25.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.119+0000 7f1d4ce00640 1 --2- 172.21.15.37:0/245780714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d480cec40 0x7f1d4806e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.119+0000 7f1d4ce00640 1 --2- 172.21.15.37:0/245780714 >> v2:172.21.15.105:3300/0 conn(0x7f1d4815cd80 0x7f1d480ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.119+0000 7f1d4ce00640 1 --2- 172.21.15.37:0/245780714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d4806e000 0x7f1d480ce1c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.119+0000 7f1d4ce00640 1 -- 172.21.15.37:0/245780714 >> 172.21.15.37:0/245780714 conn(0x7f1d480b23a0 msgr2=0x7f1d480b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:25.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.119+0000 7f1d4ce00640 1 -- 172.21.15.37:0/245780714 shutdown_connections 2024-05-30T06:42:25.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.119+0000 7f1d4ce00640 1 -- 172.21.15.37:0/245780714 wait complete. 2024-05-30T06:42:25.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d4ce00640 1 Processor -- start 2024-05-30T06:42:25.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d4ce00640 1 -- start start 2024-05-30T06:42:25.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d4ce00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d4806e000 0x7f1d48155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d4ce00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d480cec40 0x7f1d48157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d4ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d4815cd80 0x7f1d4815e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d4ce00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1d480cf0d0 con 0x7f1d4815cd80 2024-05-30T06:42:25.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d4ce00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1d480cdca0 con 0x7f1d4806e000 2024-05-30T06:42:25.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d4ce00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4806e920 con 0x7f1d480cec40 2024-05-30T06:42:25.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d46800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d4815cd80 0x7f1d4815e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d46800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d4815cd80 0x7f1d4815e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34332/0 (socket says 172.21.15.37:34332) 2024-05-30T06:42:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d46800640 1 -- 172.21.15.37:0/1698331896 learned_addr learned my addr 172.21.15.37:0/1698331896 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d45e00640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d4806e000 0x7f1d48155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d3fe00640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d480cec40 0x7f1d48157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d46800640 1 -- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d480cec40 msgr2=0x7f1d48157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d46800640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d480cec40 0x7f1d48157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d46800640 1 -- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d4806e000 msgr2=0x7f1d48155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d46800640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d4806e000 0x7f1d48155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d46800640 1 -- 172.21.15.37:0/1698331896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4813c7e0 con 0x7f1d4815cd80 2024-05-30T06:42:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d46800640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d4815cd80 0x7f1d4815e0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000cf20 tx=0x7f1d4000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d3e000640 1 -- 172.21.15.37:0/1698331896 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4001a070 con 0x7f1d4815cd80 2024-05-30T06:42:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d3e000640 1 -- 172.21.15.37:0/1698331896 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4000d840 con 0x7f1d4815cd80 2024-05-30T06:42:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d3e000640 1 -- 172.21.15.37:0/1698331896 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4000dc30 con 0x7f1d4815cd80 2024-05-30T06:42:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d4ce00640 1 -- 172.21.15.37:0/1698331896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d48155ec0 con 0x7f1d4815cd80 2024-05-30T06:42:25.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.123+0000 7f1d4ce00640 1 -- 172.21.15.37:0/1698331896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d48158940 con 0x7f1d4815cd80 2024-05-30T06:42:25.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.127+0000 7f1d4ce00640 1 -- 172.21.15.37:0/1698331896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d48068b20 con 0x7f1d4815cd80 2024-05-30T06:42:25.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.127+0000 7f1d3e000640 1 -- 172.21.15.37:0/1698331896 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1d4001d070 con 0x7f1d4815cd80 2024-05-30T06:42:25.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.127+0000 7f1d3e000640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d24068380 0x7f1d2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.127+0000 7f1d3e000640 1 -- 172.21.15.37:0/1698331896 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1d40087210 con 0x7f1d4815cd80 2024-05-30T06:42:25.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.127+0000 7f1d45e00640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d24068380 0x7f1d2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.127+0000 7f1d45e00640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d24068380 0x7f1d2406a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1d380b2000 tx=0x7f1d38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:25.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.131+0000 7f1d3e000640 1 -- 172.21.15.37:0/1698331896 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1d400570e0 con 0x7f1d4815cd80 2024-05-30T06:42:25.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d4ce00640 1 -- 172.21.15.37:0/1698331896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d48158b80 con 0x7f1d4815cd80 2024-05-30T06:42:25.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d3e000640 1 -- 172.21.15.37:0/1698331896 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f1d4005b3e0 con 0x7f1d4815cd80 2024-05-30T06:42:25.334 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:25.334 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2950341560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2950341560},{"type":"v1","addr":"172.21.15.37:6835","nonce":2950341560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/1458371524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1458371524},{"type":"v1","addr":"172.21.15.105:6836","nonce":1458371524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4088854019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4088854019},{"type":"v1","addr":"172.21.15.37:6833","nonce":4088854019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:42:10.805274+0000","modified":"2024-05-30T06:42:13.844990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2952122373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2952122373},{"type":"v1","addr":"172.21.15.105:6837","nonce":2952122373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-05-30T06:42:25.334 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-05-30T06:42:25.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d4ce00640 1 -- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d24068380 msgr2=0x7f1d2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d4ce00640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d24068380 0x7f1d2406a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1d380b2000 tx=0x7f1d38009040 comp rx=0 tx=0).stop 2024-05-30T06:42:25.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d4ce00640 1 -- 172.21.15.37:0/1698331896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d4815cd80 msgr2=0x7f1d4815e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d4ce00640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d4815cd80 0x7f1d4815e0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000cf20 tx=0x7f1d4000a710 comp rx=0 tx=0).stop 2024-05-30T06:42:25.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d4ce00640 1 -- 172.21.15.37:0/1698331896 shutdown_connections 2024-05-30T06:42:25.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d4ce00640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d4815cd80 0x7f1d4815e0c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d4ce00640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d480cec40 0x7f1d48157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d4ce00640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d24068380 0x7f1d2406a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d4ce00640 1 --2- 172.21.15.37:0/1698331896 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d4806e000 0x7f1d48155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d4ce00640 1 -- 172.21.15.37:0/1698331896 >> 172.21.15.37:0/1698331896 conn(0x7f1d480b23a0 msgr2=0x7f1d48144ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:25.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d4ce00640 1 -- 172.21.15.37:0/1698331896 shutdown_connections 2024-05-30T06:42:25.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.335+0000 7f1d4ce00640 1 -- 172.21.15.37:0/1698331896 wait complete. 2024-05-30T06:42:25.758 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T06:42:10.805274+0000', 'modified': '2024-05-30T06:42:13.844990+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6837/2952122373', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6835', 'nonce': 2952122373}, {'type': 'v1', 'addr': '172.21.15.105:6837', 'nonce': 2952122373}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4300, 'qdb_cluster': [4300]} 2024-05-30T06:42:25.758 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T06:42:25.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-30T06:42:25.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.903+0000 7fca2b400640 1 Processor -- start 2024-05-30T06:42:25.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.903+0000 7fca2b400640 1 -- start start 2024-05-30T06:42:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.907+0000 7fca2b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fca24155da0 0x7fca240cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.907+0000 7fca2b400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca240cd440 0x7fca2406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.907+0000 7fca2b400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca2415f310 con 0x7fca2406f5a0 2024-05-30T06:42:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.907+0000 7fca2b400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fca2406fa10 con 0x7fca24155da0 2024-05-30T06:42:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.907+0000 7fca2b400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fca240b4760 con 0x7fca240cd440 2024-05-30T06:42:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.907+0000 7fca28a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fca24155da0 0x7fca240cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.907+0000 7fca28a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fca24155da0 0x7fca240cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34338/0 (socket says 172.21.15.37:34338) 2024-05-30T06:42:25.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.907+0000 7fca28a00640 1 -- 172.21.15.37:0/2067487779 learned_addr learned my addr 172.21.15.37:0/2067487779 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:25.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.907+0000 7fca23e00640 1 --2- 172.21.15.37:0/2067487779 >> v2:172.21.15.105:3300/0 conn(0x7fca240cd440 0x7fca2406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.907+0000 7fca28a00640 1 -- 172.21.15.37:0/2067487779 >> v2:172.21.15.105:3300/0 conn(0x7fca240cd440 msgr2=0x7fca2406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:25.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.907+0000 7fca28a00640 1 --2- 172.21.15.37:0/2067487779 >> v2:172.21.15.105:3300/0 conn(0x7fca240cd440 0x7fca2406f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.907+0000 7fca28a00640 1 -- 172.21.15.37:0/2067487779 >> v1:172.21.15.105:6789/0 conn(0x7fca2406f5a0 legacy=0x7fca240cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:25.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.907+0000 7fca28a00640 1 -- 172.21.15.37:0/2067487779 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2415f5f0 con 0x7fca24155da0 2024-05-30T06:42:25.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca28a00640 1 --2- 172.21.15.37:0/2067487779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca24155da0 0x7fca240cd950 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca240b2f00 tx=0x7fca1801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50495c25bf5d6df0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:25.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca23400640 1 -- 172.21.15.37:0/2067487779 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180b0070 con 0x7fca24155da0 2024-05-30T06:42:25.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca23400640 1 -- 172.21.15.37:0/2067487779 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca180ab600 con 0x7fca24155da0 2024-05-30T06:42:25.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca23400640 1 -- 172.21.15.37:0/2067487779 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180ab9d0 con 0x7fca24155da0 2024-05-30T06:42:25.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 -- 172.21.15.37:0/2067487779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca24155da0 msgr2=0x7fca240cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 --2- 172.21.15.37:0/2067487779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca24155da0 0x7fca240cd950 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca240b2f00 tx=0x7fca1801c400 comp rx=0 tx=0).stop 2024-05-30T06:42:25.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 -- 172.21.15.37:0/2067487779 shutdown_connections 2024-05-30T06:42:25.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 --2- 172.21.15.37:0/2067487779 >> v2:172.21.15.105:3300/0 conn(0x7fca240cd440 0x7fca2406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 --2- 172.21.15.37:0/2067487779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca24155da0 0x7fca240cd950 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 -- 172.21.15.37:0/2067487779 >> 172.21.15.37:0/2067487779 conn(0x7fca2406bf60 msgr2=0x7fca240b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:25.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 -- 172.21.15.37:0/2067487779 shutdown_connections 2024-05-30T06:42:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 -- 172.21.15.37:0/2067487779 wait complete. 2024-05-30T06:42:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 Processor -- start 2024-05-30T06:42:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 -- start start 2024-05-30T06:42:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2406f5a0 0x7fca241562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca24155da0 0x7fca2415e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca241f6af0 0x7fca241540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fca240b4e20 con 0x7fca2406f5a0 2024-05-30T06:42:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca240b4ca0 con 0x7fca241f6af0 2024-05-30T06:42:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.911+0000 7fca2b400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fca24168580 con 0x7fca24155da0 2024-05-30T06:42:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca28a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2406f5a0 0x7fca241562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca28a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2406f5a0 0x7fca241562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34348/0 (socket says 172.21.15.37:34348) 2024-05-30T06:42:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca28a00640 1 -- 172.21.15.37:0/3880748077 learned_addr learned my addr 172.21.15.37:0/3880748077 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca29400640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca241f6af0 0x7fca241540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca23e00640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca24155da0 0x7fca2415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca28a00640 1 -- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca24155da0 msgr2=0x7fca2415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca28a00640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca24155da0 0x7fca2415e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca28a00640 1 -- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca241f6af0 msgr2=0x7fca241540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca28a00640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca241f6af0 0x7fca241540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca28a00640 1 -- 172.21.15.37:0/3880748077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca24157900 con 0x7fca2406f5a0 2024-05-30T06:42:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca28a00640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2406f5a0 0x7fca241562b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca180ae040 tx=0x7fca1801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca20c00640 1 -- 172.21.15.37:0/3880748077 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180ba020 con 0x7fca2406f5a0 2024-05-30T06:42:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca20c00640 1 -- 172.21.15.37:0/3880748077 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca180b6640 con 0x7fca2406f5a0 2024-05-30T06:42:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca2b400640 1 -- 172.21.15.37:0/3880748077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca24156890 con 0x7fca2406f5a0 2024-05-30T06:42:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca20c00640 1 -- 172.21.15.37:0/3880748077 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180b0040 con 0x7fca2406f5a0 2024-05-30T06:42:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.915+0000 7fca2b400640 1 -- 172.21.15.37:0/3880748077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca24156e50 con 0x7fca2406f5a0 2024-05-30T06:42:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca20c00640 1 -- 172.21.15.37:0/3880748077 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fca180bd020 con 0x7fca2406f5a0 2024-05-30T06:42:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca20c00640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fca04068380 0x7fca0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca20c00640 1 -- 172.21.15.37:0/3880748077 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fca18120cb0 con 0x7fca2406f5a0 2024-05-30T06:42:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca2e93f000 1 Processor -- start 2024-05-30T06:42:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca23e00640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fca04068380 0x7fca0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca2e93f000 1 -- start start 2024-05-30T06:42:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca23e00640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fca04068380 0x7fca0406a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fca240cdc10 tx=0x7fca10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca2e93f000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42120 0x55a71ff42500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca2e93f000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42a40 0x55a71fef5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca2e93f000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71fef5650 0x55a71fef5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca2e93f000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a71fd46420 con 0x55a71ff42a40 2024-05-30T06:42:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca2e93f000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a71fce0bf0 con 0x55a71fef5650 2024-05-30T06:42:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca2e93f000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55a71fd423e0 con 0x55a71ff42120 2024-05-30T06:42:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca23e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42a40 0x55a71fef5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca23e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42a40 0x55a71fef5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34364/0 (socket says 172.21.15.37:34364) 2024-05-30T06:42:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca23e00640 1 -- 172.21.15.37:0/3713830926 learned_addr learned my addr 172.21.15.37:0/3713830926 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca23e00640 1 -- 172.21.15.37:0/3713830926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42120 msgr2=0x55a71ff42500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca23e00640 1 --2- 172.21.15.37:0/3713830926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42120 0x55a71ff42500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca23e00640 1 -- 172.21.15.37:0/3713830926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71fef5650 msgr2=0x55a71fef5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca23e00640 1 --2- 172.21.15.37:0/3713830926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71fef5650 0x55a71fef5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca23e00640 1 -- 172.21.15.37:0/3713830926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a71fdee450 con 0x55a71ff42a40 2024-05-30T06:42:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca23e00640 1 --2- 172.21.15.37:0/3713830926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42a40 0x55a71fef5110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fca1000f9f0 tx=0x7fca10012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d139a51c7a2ab6d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca15600640 1 -- 172.21.15.37:0/3713830926 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1001b050 con 0x55a71ff42a40 2024-05-30T06:42:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca15600640 1 -- 172.21.15.37:0/3713830926 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10025070 con 0x55a71ff42a40 2024-05-30T06:42:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.919+0000 7fca15600640 1 -- 172.21.15.37:0/3713830926 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10014de0 con 0x55a71ff42a40 2024-05-30T06:42:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 -- 172.21.15.37:0/3713830926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42a40 msgr2=0x55a71fef5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 --2- 172.21.15.37:0/3713830926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42a40 0x55a71fef5110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fca1000f9f0 tx=0x7fca10012000 comp rx=0 tx=0).stop 2024-05-30T06:42:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 -- 172.21.15.37:0/3713830926 shutdown_connections 2024-05-30T06:42:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 --2- 172.21.15.37:0/3713830926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71fef5650 0x55a71fef5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 --2- 172.21.15.37:0/3713830926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42a40 0x55a71fef5110 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 --2- 172.21.15.37:0/3713830926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42120 0x55a71ff42500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 -- 172.21.15.37:0/3713830926 >> 172.21.15.37:0/3713830926 conn(0x55a71ff22ec0 msgr2=0x55a71ff252b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 -- 172.21.15.37:0/3713830926 shutdown_connections 2024-05-30T06:42:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 -- 172.21.15.37:0/3713830926 wait complete. 2024-05-30T06:42:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 -- start start 2024-05-30T06:42:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 Processor -- start 2024-05-30T06:42:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 0x55a71fefab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42120 0x55a71fefb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42a40 0x55a71fefb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a71fce6ec0 con 0x55a71fef5650 2024-05-30T06:42:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a71fdc7120 con 0x55a71ff42a40 2024-05-30T06:42:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55a71fd51350 con 0x55a71ff42120 2024-05-30T06:42:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 10 client.0 _ll_register_callbacks cb 0x55a71fd234d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:42:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca28a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 0x55a71fefab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca28a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 0x55a71fefab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34374/0 (socket says 172.21.15.37:34374) 2024-05-30T06:42:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca28a00640 1 -- 172.21.15.37:0/1137799782 learned_addr learned my addr 172.21.15.37:0/1137799782 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca29400640 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42a40 0x55a71fefb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca23e00640 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42120 0x55a71fefb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca28a00640 1 -- 172.21.15.37:0/1137799782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42120 msgr2=0x55a71fefb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca28a00640 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42120 0x55a71fefb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca28a00640 1 -- 172.21.15.37:0/1137799782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42a40 msgr2=0x55a71fefb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca28a00640 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42a40 0x55a71fefb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca28a00640 1 -- 172.21.15.37:0/1137799782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a71fd8bf80 con 0x55a71fef5650 2024-05-30T06:42:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca29400640 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42a40 0x55a71fefb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca28a00640 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 0x55a71fefab40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca180ed060 tx=0x7fca180f1300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba0494a81d7b39e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca0a000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:42:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca0a000640 1 -- 172.21.15.37:0/1137799782 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18109020 con 0x55a71fef5650 2024-05-30T06:42:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca0a000640 1 -- 172.21.15.37:0/1137799782 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fca180f9350 con 0x55a71fef5650 2024-05-30T06:42:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 -- 172.21.15.37:0/1137799782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca10025070 con 0x55a71fef5650 2024-05-30T06:42:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca0a000640 1 -- 172.21.15.37:0/1137799782 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fca181091c0 con 0x55a71fef5650 2024-05-30T06:42:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 10 client.4623 fetch_fsmap learned FSMap version 8 2024-05-30T06:42:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 -- 172.21.15.37:0/1137799782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55a71fd1ff00 con 0x55a71fef5650 2024-05-30T06:42:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca0a000640 1 -- 172.21.15.37:0/1137799782 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10025070 con 0x55a71fef5650 2024-05-30T06:42:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca0a000640 1 -- 172.21.15.37:0/1137799782 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7fca180b3030 con 0x55a71fef5650 2024-05-30T06:42:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 10 client.4623 fetch_fsmap finished waiting for FSMap version 8 2024-05-30T06:42:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 10 client.4623 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-30T06:42:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 20 client.4623 populate_metadata read hostname 'smithi037' 2024-05-30T06:42:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.105:6835/2952122373,v1:172.21.15.105:6837/2952122373] conn(0x55a71ff513c0 0x55a71ff537b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 4 client.4623 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T06:42:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.923+0000 7fca2e93f000 1 -- 172.21.15.37:0/1137799782 --> [v2:172.21.15.105:6835/2952122373,v1:172.21.15.105:6837/2952122373] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a71fcdfbc0 con 0x55a71ff513c0 2024-05-30T06:42:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca23e00640 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.105:6835/2952122373,v1:172.21.15.105:6837/2952122373] conn(0x55a71ff513c0 0x55a71ff537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca23e00640 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.105:6835/2952122373,v1:172.21.15.105:6837/2952122373] conn(0x55a71ff513c0 0x55a71ff537b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd97231c64aa6aa server_cookie=50c7b54d0b8228b7 in_seq=0 out_seq=0 2024-05-30T06:42:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca0a000640 10 client.4623 ms_handle_connect on v2:172.21.15.105:6835/2952122373 2024-05-30T06:42:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca0a000640 1 -- 172.21.15.37:0/1137799782 <== mds.0 v2:172.21.15.105:6835/2952122373 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a71fcdfbc0 con 0x55a71ff513c0 2024-05-30T06:42:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca0a000640 10 client.4623 handle_command_reply: tid=0 2024-05-30T06:42:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca2e93f000 1 client.4623 shutdown 2024-05-30T06:42:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca2e93f000 1 -- 172.21.15.37:0/1137799782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 msgr2=0x55a71fefab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca2e93f000 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 0x55a71fefab40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca180ed060 tx=0x7fca180f1300 comp rx=0 tx=0).stop 2024-05-30T06:42:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca2e93f000 1 -- 172.21.15.37:0/1137799782 shutdown_connections 2024-05-30T06:42:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca2e93f000 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.105:6835/2952122373,v1:172.21.15.105:6837/2952122373] conn(0x55a71ff513c0 0x55a71ff537b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca2e93f000 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42a40 0x55a71fefb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca2e93f000 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42120 0x55a71fefb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca2e93f000 1 --2- 172.21.15.37:0/1137799782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 0x55a71fefab40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca0a000640 0 client.4623 ms_handle_reset on v2:172.21.15.105:6835/2952122373 2024-05-30T06:42:25.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca2e93f000 1 -- 172.21.15.37:0/1137799782 >> 172.21.15.37:0/1137799782 conn(0x55a71ff22ec0 msgr2=0x55a71ff252b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:25.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca2e93f000 1 -- 172.21.15.37:0/1137799782 shutdown_connections 2024-05-30T06:42:25.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca2e93f000 1 -- 172.21.15.37:0/1137799782 wait complete. 2024-05-30T06:42:25.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.927+0000 7fca2e93f000 20 client.4623 trim_cache size 0 max 16384 2024-05-30T06:42:25.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 Processor -- start 2024-05-30T06:42:25.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 -- start start 2024-05-30T06:42:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71fef5650 0x55a71fef4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42120 0x55a71fef4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42a40 0x55a71ff537b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fca24202d90 con 0x55a71ff42120 2024-05-30T06:42:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca241fb650 con 0x55a71ff42a40 2024-05-30T06:42:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fca24158a00 con 0x55a71fef5650 2024-05-30T06:42:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca23e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42120 0x55a71fef4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca23e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42120 0x55a71fef4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34382/0 (socket says 172.21.15.37:34382) 2024-05-30T06:42:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca23e00640 1 -- 172.21.15.37:0/2921303459 learned_addr learned my addr 172.21.15.37:0/2921303459 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca28a00640 1 --2- 172.21.15.37:0/2921303459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71fef5650 0x55a71fef4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca23e00640 1 -- 172.21.15.37:0/2921303459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71fef5650 msgr2=0x55a71fef4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca23e00640 1 --2- 172.21.15.37:0/2921303459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71fef5650 0x55a71fef4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca23e00640 1 -- 172.21.15.37:0/2921303459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42a40 msgr2=0x55a71ff537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca29400640 1 --2- 172.21.15.37:0/2921303459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42a40 0x55a71ff537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca23e00640 1 --2- 172.21.15.37:0/2921303459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42a40 0x55a71ff537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca23e00640 1 -- 172.21.15.37:0/2921303459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a71ff42870 con 0x55a71ff42120 2024-05-30T06:42:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca28a00640 1 --2- 172.21.15.37:0/2921303459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71fef5650 0x55a71fef4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca29400640 1 --2- 172.21.15.37:0/2921303459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42a40 0x55a71ff537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:25.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca23e00640 1 --2- 172.21.15.37:0/2921303459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42120 0x55a71fef4d50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fca10021000 tx=0x7fca1001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55419e353915b64 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca14c00640 1 -- 172.21.15.37:0/2921303459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1003a070 con 0x55a71ff42120 2024-05-30T06:42:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca14c00640 1 -- 172.21.15.37:0/2921303459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10025040 con 0x55a71ff42120 2024-05-30T06:42:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca14c00640 1 -- 172.21.15.37:0/2921303459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1001b050 con 0x55a71ff42120 2024-05-30T06:42:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 -- 172.21.15.37:0/2921303459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42120 msgr2=0x55a71fef4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 --2- 172.21.15.37:0/2921303459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42120 0x55a71fef4d50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fca10021000 tx=0x7fca1001e000 comp rx=0 tx=0).stop 2024-05-30T06:42:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 -- 172.21.15.37:0/2921303459 shutdown_connections 2024-05-30T06:42:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 --2- 172.21.15.37:0/2921303459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42a40 0x55a71ff537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 --2- 172.21.15.37:0/2921303459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71ff42120 0x55a71fef4d50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 --2- 172.21.15.37:0/2921303459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71fef5650 0x55a71fef4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 -- 172.21.15.37:0/2921303459 >> 172.21.15.37:0/2921303459 conn(0x55a71ff22ec0 msgr2=0x55a71fef4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 -- 172.21.15.37:0/2921303459 shutdown_connections 2024-05-30T06:42:25.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 -- 172.21.15.37:0/2921303459 wait complete. 2024-05-30T06:42:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.947+0000 7fca2e93f000 1 -- start start 2024-05-30T06:42:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 1 Processor -- start 2024-05-30T06:42:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 0x55a71ff56650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42120 0x55a71ff6d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42a40 0x55a71ff6d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a71fd45730 con 0x55a71fef5650 2024-05-30T06:42:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55a71fd129e0 con 0x55a71ff42120 2024-05-30T06:42:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55a71fd4aa50 con 0x55a71ff42a40 2024-05-30T06:42:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 10 client.0 _ll_register_callbacks cb 0x7fca180094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:42:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca28a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 0x55a71ff56650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca28a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 0x55a71ff56650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34386/0 (socket says 172.21.15.37:34386) 2024-05-30T06:42:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca28a00640 1 -- 172.21.15.37:0/71039216 learned_addr learned my addr 172.21.15.37:0/71039216 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca29400640 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42a40 0x55a71ff6d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca23e00640 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42120 0x55a71ff6d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca28a00640 1 -- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42a40 msgr2=0x55a71ff6d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca28a00640 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42a40 0x55a71ff6d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca28a00640 1 -- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42120 msgr2=0x55a71ff6d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca28a00640 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42120 0x55a71ff6d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca28a00640 1 -- 172.21.15.37:0/71039216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a71fccce80 con 0x55a71fef5650 2024-05-30T06:42:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca29400640 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42a40 0x55a71ff6d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:25.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca23e00640 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42120 0x55a71ff6d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca28a00640 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 0x55a71ff56650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca1801aab0 tx=0x7fca18009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7f60e6f56b0757 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca0a000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca0a000640 1 -- 172.21.15.37:0/71039216 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18109020 con 0x55a71fef5650 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca0a000640 1 -- 172.21.15.37:0/71039216 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fca180f0050 con 0x55a71fef5650 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 1 -- 172.21.15.37:0/71039216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca10025040 con 0x55a71fef5650 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca0a000640 1 -- 172.21.15.37:0/71039216 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fca180f0740 con 0x55a71fef5650 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 10 client.4629 fetch_fsmap learned FSMap version 8 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 1 -- 172.21.15.37:0/71039216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55a71fd0eb30 con 0x55a71fef5650 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca0a000640 1 -- 172.21.15.37:0/71039216 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca10025040 con 0x55a71fef5650 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca0a000640 1 -- 172.21.15.37:0/71039216 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7fca180f71b0 con 0x55a71fef5650 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 10 client.4629 fetch_fsmap finished waiting for FSMap version 8 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 10 client.4629 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 20 client.4629 populate_metadata read hostname 'smithi037' 2024-05-30T06:42:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:6835/2952122373,v1:172.21.15.105:6837/2952122373] conn(0x55a71ff6ddc0 0x55a71ffb0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 4 client.4629 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T06:42:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 1 -- 172.21.15.37:0/71039216 --> [v2:172.21.15.105:6835/2952122373,v1:172.21.15.105:6837/2952122373] -- command(tid 0: {"prefix": "status"}) -- 0x55a71fd53e40 con 0x55a71ff6ddc0 2024-05-30T06:42:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca23e00640 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:6835/2952122373,v1:172.21.15.105:6837/2952122373] conn(0x55a71ff6ddc0 0x55a71ffb0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca23e00640 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:6835/2952122373,v1:172.21.15.105:6837/2952122373] conn(0x55a71ff6ddc0 0x55a71ffb0fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86be79b6eb5a29a8 server_cookie=5f9c768a33e48c35 in_seq=0 out_seq=0 2024-05-30T06:42:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca0a000640 10 client.4629 ms_handle_connect on v2:172.21.15.105:6835/2952122373 2024-05-30T06:42:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca0a000640 1 -- 172.21.15.37:0/71039216 <== mds.0 v2:172.21.15.105:6835/2952122373 1 ==== command_reply(tid 0: 0 ) ==== 8+0+317 (crc 0 0 0) 0x55a71fd53e40 con 0x55a71ff6ddc0 2024-05-30T06:42:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca0a000640 10 client.4629 handle_command_reply: tid=0 2024-05-30T06:42:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.951+0000 7fca2e93f000 1 client.4629 shutdown 2024-05-30T06:42:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2e93f000 1 -- 172.21.15.37:0/71039216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 msgr2=0x55a71ff56650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2e93f000 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 0x55a71ff56650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca1801aab0 tx=0x7fca18009240 comp rx=0 tx=0).stop 2024-05-30T06:42:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2e93f000 1 -- 172.21.15.37:0/71039216 shutdown_connections 2024-05-30T06:42:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2e93f000 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:6835/2952122373,v1:172.21.15.105:6837/2952122373] conn(0x55a71ff6ddc0 0x55a71ffb0fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2e93f000 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55a71ff42a40 0x55a71ff6d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2e93f000 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55a71ff42120 0x55a71ff6d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2e93f000 1 --2- 172.21.15.37:0/71039216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a71fef5650 0x55a71ff56650 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca0a000640 0 client.4629 ms_handle_reset on v2:172.21.15.105:6835/2952122373 2024-05-30T06:42:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2e93f000 1 -- 172.21.15.37:0/71039216 >> 172.21.15.37:0/71039216 conn(0x55a71ff22ec0 msgr2=0x55a71fef4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2e93f000 1 -- 172.21.15.37:0/71039216 shutdown_connections 2024-05-30T06:42:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2e93f000 1 -- 172.21.15.37:0/71039216 wait complete. 2024-05-30T06:42:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2e93f000 20 client.4629 trim_cache size 0 max 16384 2024-05-30T06:42:25.959 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:42:25.960 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:42:25.960 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-30T06:42:25.960 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4300, 2024-05-30T06:42:25.960 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-30T06:42:25.960 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-30T06:42:25.960 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-30T06:42:25.960 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 14.50716025, 2024-05-30T06:42:25.960 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 8, 2024-05-30T06:42:25.960 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 20, 2024-05-30T06:42:25.960 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 20, 2024-05-30T06:42:25.960 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 21.572396026 2024-05-30T06:42:25.960 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:42:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2b400640 1 -- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fca04068380 msgr2=0x7fca0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2b400640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fca04068380 0x7fca0406a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fca240cdc10 tx=0x7fca10008040 comp rx=0 tx=0).stop 2024-05-30T06:42:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2b400640 1 -- 172.21.15.37:0/3880748077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2406f5a0 msgr2=0x7fca241562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2b400640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2406f5a0 0x7fca241562b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca180ae040 tx=0x7fca1801ac40 comp rx=0 tx=0).stop 2024-05-30T06:42:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2b400640 1 -- 172.21.15.37:0/3880748077 shutdown_connections 2024-05-30T06:42:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2b400640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fca04068380 0x7fca0406a840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2b400640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca241f6af0 0x7fca241540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2b400640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca24155da0 0x7fca2415e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2b400640 1 --2- 172.21.15.37:0/3880748077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca2406f5a0 0x7fca241562b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2b400640 1 -- 172.21.15.37:0/3880748077 >> 172.21.15.37:0/3880748077 conn(0x7fca2406bf60 msgr2=0x7fca240b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2b400640 1 -- 172.21.15.37:0/3880748077 shutdown_connections 2024-05-30T06:42:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:25.955+0000 7fca2b400640 1 -- 172.21.15.37:0/3880748077 wait complete. 2024-05-30T06:42:25.973 INFO:teuthology.run_tasks:Running task sequential... 2024-05-30T06:42:25.983 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-30T06:42:25.983 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-30T06:42:25.984 INFO:teuthology.task.print:Enabling mgr modules 2024-05-30T06:42:25.984 INFO:teuthology.run_tasks:Running task kclient... 2024-05-30T06:42:26.051 INFO:tasks.kclient:Mounting kernel clients... 2024-05-30T06:42:26.051 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-30T06:42:26.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:26.051 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T06:42:26.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:26.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-05-30T06:42:26.131 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2024-05-30T06:42:26.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:42:26.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:26.133 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T06:42:26.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:26.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-05-30T06:42:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2024-05-30T06:42:26.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:42:26.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:26.261 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-05-30T06:42:26.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:26.271 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-05-30T06:42:26.343 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2024-05-30T06:42:26.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:42:26.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:26.345 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-05-30T06:42:26.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:26.396 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-05-30T06:42:26.462 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2024-05-30T06:42:26.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T06:42:26.464 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-05-30T06:42:26.465 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-30T06:42:26.465 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T06:42:26.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T06:42:26.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea9200640 1 Processor -- start 2024-05-30T06:42:26.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea9200640 1 -- start start 2024-05-30T06:42:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea9200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4ea40b2e20 0x7f4ea4160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea9200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4ea41609c0 0x7f4ea4160e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea9200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea40d0430 con 0x7f4ea40cd280 2024-05-30T06:42:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea9200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea40b3200 con 0x7f4ea40b2e20 2024-05-30T06:42:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea9200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea40d01e0 con 0x7f4ea41609c0 2024-05-30T06:42:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea1e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4ea40b2e20 0x7f4ea4160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea1e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4ea40b2e20 0x7f4ea4160480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34402/0 (socket says 172.21.15.37:34402) 2024-05-30T06:42:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea1e00640 1 -- 172.21.15.37:0/4121431932 learned_addr learned my addr 172.21.15.37:0/4121431932 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4e99400640 1 --2- 172.21.15.37:0/4121431932 >> v2:172.21.15.105:3300/0 conn(0x7f4ea41609c0 0x7f4ea4160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea1e00640 1 -- 172.21.15.37:0/4121431932 >> v2:172.21.15.105:3300/0 conn(0x7f4ea41609c0 msgr2=0x7f4ea4160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea1e00640 1 --2- 172.21.15.37:0/4121431932 >> v2:172.21.15.105:3300/0 conn(0x7f4ea41609c0 0x7f4ea4160e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea1e00640 1 -- 172.21.15.37:0/4121431932 >> v1:172.21.15.105:6789/0 conn(0x7f4ea40cd280 legacy=0x7f4ea40cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.607+0000 7f4ea1e00640 1 -- 172.21.15.37:0/4121431932 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea40d0710 con 0x7f4ea40b2e20 2024-05-30T06:42:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.611+0000 7f4ea1e00640 1 --2- 172.21.15.37:0/4121431932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea40b2e20 0x7f4ea4160480 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40c5fe0 tx=0x7f4e9401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e90951152389ba server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.611+0000 7f4ea1400640 1 -- 172.21.15.37:0/4121431932 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e940b1070 con 0x7f4ea40b2e20 2024-05-30T06:42:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.611+0000 7f4ea1400640 1 -- 172.21.15.37:0/4121431932 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e940ac630 con 0x7f4ea40b2e20 2024-05-30T06:42:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.611+0000 7f4ea1400640 1 -- 172.21.15.37:0/4121431932 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e940a8050 con 0x7f4ea40b2e20 2024-05-30T06:42:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.611+0000 7f4ea9200640 1 -- 172.21.15.37:0/4121431932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea40b2e20 msgr2=0x7f4ea4160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.611+0000 7f4ea9200640 1 --2- 172.21.15.37:0/4121431932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea40b2e20 0x7f4ea4160480 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40c5fe0 tx=0x7f4e9401c520 comp rx=0 tx=0).stop 2024-05-30T06:42:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.611+0000 7f4ea9200640 1 -- 172.21.15.37:0/4121431932 shutdown_connections 2024-05-30T06:42:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.611+0000 7f4ea9200640 1 --2- 172.21.15.37:0/4121431932 >> v2:172.21.15.105:3300/0 conn(0x7f4ea41609c0 0x7f4ea4160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.611+0000 7f4ea9200640 1 --2- 172.21.15.37:0/4121431932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea40b2e20 0x7f4ea4160480 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.611+0000 7f4ea9200640 1 -- 172.21.15.37:0/4121431932 >> 172.21.15.37:0/4121431932 conn(0x7f4ea40b4100 msgr2=0x7f4ea40b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.611+0000 7f4ea9200640 1 -- 172.21.15.37:0/4121431932 shutdown_connections 2024-05-30T06:42:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.611+0000 7f4ea9200640 1 -- 172.21.15.37:0/4121431932 wait complete. 2024-05-30T06:42:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea9200640 1 Processor -- start 2024-05-30T06:42:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea9200640 1 -- start start 2024-05-30T06:42:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea9200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea40b2e20 0x7f4ea406e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea9200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea40cd280 0x7f4ea41568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea9200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea41609c0 0x7f4ea4157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea9200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea4169940 con 0x7f4ea40b2e20 2024-05-30T06:42:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea9200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea41697c0 con 0x7f4ea40cd280 2024-05-30T06:42:26.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea9200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea4169ac0 con 0x7f4ea41609c0 2024-05-30T06:42:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea40b2e20 0x7f4ea406e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea40b2e20 0x7f4ea406e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34418/0 (socket says 172.21.15.37:34418) 2024-05-30T06:42:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea1e00640 1 -- 172.21.15.37:0/3424207824 learned_addr learned my addr 172.21.15.37:0/3424207824 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4e99400640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea40cd280 0x7f4ea41568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:26.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea2800640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea41609c0 0x7f4ea4157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea1e00640 1 -- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea41609c0 msgr2=0x7f4ea4157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea1e00640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea41609c0 0x7f4ea4157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea1e00640 1 -- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea40cd280 msgr2=0x7f4ea41568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea1e00640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea40cd280 0x7f4ea41568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:26.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea1e00640 1 -- 172.21.15.37:0/3424207824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea406e1e0 con 0x7f4ea40b2e20 2024-05-30T06:42:26.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4e99400640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea40cd280 0x7f4ea41568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:26.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea1e00640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea40b2e20 0x7f4ea406e6c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4e940af040 tx=0x7f4e9401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:26.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4e9aa00640 1 -- 172.21.15.37:0/3424207824 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e940bb020 con 0x7f4ea40b2e20 2024-05-30T06:42:26.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4e9aa00640 1 -- 172.21.15.37:0/3424207824 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e940b7420 con 0x7f4ea40b2e20 2024-05-30T06:42:26.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea9200640 1 -- 172.21.15.37:0/3424207824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea41f91d0 con 0x7f4ea40b2e20 2024-05-30T06:42:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4e9aa00640 1 -- 172.21.15.37:0/3424207824 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e940b1040 con 0x7f4ea40b2e20 2024-05-30T06:42:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea9200640 1 -- 172.21.15.37:0/3424207824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea4167350 con 0x7f4ea40b2e20 2024-05-30T06:42:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.615+0000 7f4ea9200640 1 -- 172.21.15.37:0/3424207824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea4068b20 con 0x7f4ea40b2e20 2024-05-30T06:42:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.619+0000 7f4e9aa00640 1 -- 172.21.15.37:0/3424207824 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e940be020 con 0x7f4ea40b2e20 2024-05-30T06:42:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.619+0000 7f4e9aa00640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e80068380 0x7f4e8006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.619+0000 7f4e9aa00640 1 -- 172.21.15.37:0/3424207824 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4e94120650 con 0x7f4ea40b2e20 2024-05-30T06:42:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.619+0000 7f4e99400640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e80068380 0x7f4e8006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.619+0000 7f4e99400640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e80068380 0x7f4e8006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4159320 tx=0x7f4e8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.623+0000 7f4e9aa00640 1 -- 172.21.15.37:0/3424207824 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4e94016110 con 0x7f4ea40b2e20 2024-05-30T06:42:26.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.823+0000 7f4ea9200640 1 -- 172.21.15.37:0/3424207824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4ea40ce860 con 0x7f4ea40b2e20 2024-05-30T06:42:26.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.823+0000 7f4e9aa00640 1 -- 172.21.15.37:0/3424207824 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f4e940f0c80 con 0x7f4ea40b2e20 2024-05-30T06:42:26.824 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T06:42:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.827+0000 7f4ea9200640 1 -- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e80068380 msgr2=0x7f4e8006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.827+0000 7f4ea9200640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e80068380 0x7f4e8006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4159320 tx=0x7f4e8c008040 comp rx=0 tx=0).stop 2024-05-30T06:42:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.827+0000 7f4ea9200640 1 -- 172.21.15.37:0/3424207824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea40b2e20 msgr2=0x7f4ea406e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.827+0000 7f4ea9200640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea40b2e20 0x7f4ea406e6c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4e940af040 tx=0x7f4e9401ad60 comp rx=0 tx=0).stop 2024-05-30T06:42:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.827+0000 7f4ea9200640 1 -- 172.21.15.37:0/3424207824 shutdown_connections 2024-05-30T06:42:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.827+0000 7f4ea9200640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ea41609c0 0x7f4ea4157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.827+0000 7f4ea9200640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4e80068380 0x7f4e8006a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.827+0000 7f4ea9200640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ea40cd280 0x7f4ea41568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.827+0000 7f4ea9200640 1 --2- 172.21.15.37:0/3424207824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ea40b2e20 0x7f4ea406e6c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.827+0000 7f4ea9200640 1 -- 172.21.15.37:0/3424207824 >> 172.21.15.37:0/3424207824 conn(0x7f4ea40b4100 msgr2=0x7f4ea4070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.827+0000 7f4ea9200640 1 -- 172.21.15.37:0/3424207824 shutdown_connections 2024-05-30T06:42:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26.827+0000 7f4ea9200640 1 -- 172.21.15.37:0/3424207824 wait complete. 2024-05-30T06:42:26.845 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T06:42:26.845 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T06:42:26.845 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-30T06:42:26.845 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T06:42:26.845 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T06:42:26.845 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T06:42:26.845 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T06:42:26.845 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T06:42:26.846 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:42:26.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:26.846 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-30T06:42:26.855 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:42:26.855 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:42:26.855 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:42:26.855 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:26.855 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-30T06:42:26.855 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42457sec preferred_lft 42457sec 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-30T06:42:26.856 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:42:26.857 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:26.857 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-30T06:42:26.857 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T06:42:26.857 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:30:63:12:21 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:26.857 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T06:42:26.857 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:26.858 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-30T06:42:26.858 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:26.858 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:42:26.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-05-30T06:42:26.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-05-30T06:42:26.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-05-30T06:42:26.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-30T06:42:26.859 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:42:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:27.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:27.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:27.015 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T06:42:27.034 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-30T06:42:27.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:27.036 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-30T06:42:27.113 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-30T06:42:27.113 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T06:42:27.113 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T06:42:27.114 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T06:42:27.114 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T06:42:27.114 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T06:42:27.114 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:27.114 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:42:27.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T06:42:27.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T06:42:27.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T06:42:27.115 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:42:27.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:27.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:27.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:27.253 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T06:42:27.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:27.263 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-05-30T06:42:27.317 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:27.317 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:42:27.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T06:42:27.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-30T06:42:27.317 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:42:27.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:27.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:27.447 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-30T06:42:27.447 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:27.447 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:42:27.447 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-30T06:42:27.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-30T06:42:27.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-30T06:42:27.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-30T06:42:27.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-30T06:42:27.448 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:42:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:27.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:27.663 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:27.663 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:42:27.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-30T06:42:27.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-05-30T06:42:27.663 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:42:27.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:27.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:27.790 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:42:27.791 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T06:42:27.799 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:42:27.799 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:42:27.800 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:42:27.852 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T06:42:27.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:27.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:42:27.944 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:42:27.945 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:42:28.534 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:42:28.535 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:42:28.535 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-05-30T06:42:28.535 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@393250aa-2b42-4955-adf1-f790b8ba4d8c.cephfs=/ 2024-05-30T06:42:28.535 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-05-30T06:42:28.539 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T06:42:28.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:28.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:42:28.561 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:42:28.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:42:28.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:28.682 INFO:teuthology.orchestra.run.smithi037.stdout:client4666 2024-05-30T06:42:28.682 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:42:28.683 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:28.692 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:42:28.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:42:28.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:28.803 INFO:teuthology.orchestra.run.smithi037.stdout:client4666 2024-05-30T06:42:28.804 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:42:28.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:42:28.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:28.870 INFO:teuthology.orchestra.run.smithi037.stdout:client4666 2024-05-30T06:42:28.870 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/393250aa-2b42-4955-adf1-f790b8ba4d8c.client4666/status') 2024-05-30T06:42:28.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:28.938 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.4666 (3)172.21.15.37:0/913426858 2024-05-30T06:42:28.939 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2024-05-30T06:42:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2024-05-30T06:42:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2024-05-30T06:42:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:69 bytes copied, 5.1286e-05 s, 1.3 MB/s 2024-05-30T06:42:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:28.947 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-05-30T06:42:28.947 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-30T06:42:28.947 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-30T06:42:28.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T06:42:29.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.087+0000 7f3201c00640 1 Processor -- start 2024-05-30T06:42:29.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.087+0000 7f3201c00640 1 -- start start 2024-05-30T06:42:29.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f3201c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f31fc06f9a0 0x7f31fc0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:29.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f3201c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31fc0b2ec0 0x7f31fc0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:29.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f3201c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31fc15c8f0 con 0x7f31fc155e60 2024-05-30T06:42:29.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f3201c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f31fc0ccff0 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f3201c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f31fc0ccc80 con 0x7f31fc06f9a0 2024-05-30T06:42:29.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f31fb400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f31fc0b2ec0 0x7f31fc0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:29.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f31faa00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f31fc155e60 0x7f31fc0cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51570/0 (socket says 172.21.15.37:51570) 2024-05-30T06:42:29.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f31faa00640 1 -- 172.21.15.37:0/1315077053 learned_addr learned my addr 172.21.15.37:0/1315077053 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:29.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f31f3e00640 1 --2- 172.21.15.37:0/1315077053 >> v2:172.21.15.105:3300/0 conn(0x7f31fc06f9a0 0x7f31fc0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:29.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f31fb400640 1 -- 172.21.15.37:0/1315077053 >> v2:172.21.15.105:3300/0 conn(0x7f31fc06f9a0 msgr2=0x7f31fc0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:29.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f31fb400640 1 --2- 172.21.15.37:0/1315077053 >> v2:172.21.15.105:3300/0 conn(0x7f31fc06f9a0 0x7f31fc0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:29.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f31fb400640 1 -- 172.21.15.37:0/1315077053 >> v1:172.21.15.37:6789/0 conn(0x7f31fc155e60 legacy=0x7f31fc0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:29.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f31fb400640 1 -- 172.21.15.37:0/1315077053 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31fc15cbd0 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.091+0000 7f31f3e00640 1 --2- 172.21.15.37:0/1315077053 >> v2:172.21.15.105:3300/0 conn(0x7f31fc06f9a0 0x7f31fc0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:29.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f31fb400640 1 --2- 172.21.15.37:0/1315077053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31fc0b2ec0 0x7f31fc0cd480 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f31fc06e820 tx=0x7f31f401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98b3fddc3f189a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:29.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f31fa000640 1 -- 172.21.15.37:0/1315077053 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f40b2070 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f31fa000640 1 -- 172.21.15.37:0/1315077053 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f40a5900 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f31fa000640 1 -- 172.21.15.37:0/1315077053 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f40a5cd0 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 -- 172.21.15.37:0/1315077053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31fc0b2ec0 msgr2=0x7f31fc0cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 --2- 172.21.15.37:0/1315077053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31fc0b2ec0 0x7f31fc0cd480 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f31fc06e820 tx=0x7f31f401c930 comp rx=0 tx=0).stop 2024-05-30T06:42:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 -- 172.21.15.37:0/1315077053 shutdown_connections 2024-05-30T06:42:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 --2- 172.21.15.37:0/1315077053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31fc0b2ec0 0x7f31fc0cd480 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 --2- 172.21.15.37:0/1315077053 >> v2:172.21.15.105:3300/0 conn(0x7f31fc06f9a0 0x7f31fc0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 -- 172.21.15.37:0/1315077053 >> 172.21.15.37:0/1315077053 conn(0x7f31fc0b23a0 msgr2=0x7f31fc0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 -- 172.21.15.37:0/1315077053 shutdown_connections 2024-05-30T06:42:29.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 -- 172.21.15.37:0/1315077053 wait complete. 2024-05-30T06:42:29.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 Processor -- start 2024-05-30T06:42:29.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 -- start start 2024-05-30T06:42:29.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31fc06f9a0 0x7f31fc156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:29.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31fc0b2ec0 0x7f31fc143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:29.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31fc155e60 0x7f31fc15a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:29.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f31fc1669e0 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31fc166860 con 0x7f31fc155e60 2024-05-30T06:42:29.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.095+0000 7f3201c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31fc166b60 con 0x7f31fc06f9a0 2024-05-30T06:42:29.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31fc0b2ec0 0x7f31fc143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:29.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31fc0b2ec0 0x7f31fc143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45824/0 (socket says 172.21.15.37:45824) 2024-05-30T06:42:29.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f3e00640 1 -- 172.21.15.37:0/1256219439 learned_addr learned my addr 172.21.15.37:0/1256219439 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:29.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31faa00640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31fc06f9a0 0x7f31fc156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:29.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31fb400640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31fc155e60 0x7f31fc15a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:29.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f3e00640 1 -- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31fc06f9a0 msgr2=0x7f31fc156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:29.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f3e00640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31fc06f9a0 0x7f31fc156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:29.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f3e00640 1 -- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31fc155e60 msgr2=0x7f31fc15a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:29.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f3e00640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31fc155e60 0x7f31fc15a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:29.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f3e00640 1 -- 172.21.15.37:0/1256219439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31fc1677e0 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f3e00640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31fc0b2ec0 0x7f31fc143d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f31e400c7f0 tx=0x7f31e400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:29.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f2a00640 1 -- 172.21.15.37:0/1256219439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4007a30 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f2a00640 1 -- 172.21.15.37:0/1256219439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e4007bd0 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f3201c00640 1 -- 172.21.15.37:0/1256219439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31fc167ac0 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f2a00640 1 -- 172.21.15.37:0/1256219439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e40113f0 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f3201c00640 1 -- 172.21.15.37:0/1256219439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31fc168080 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f3201c00640 1 -- 172.21.15.37:0/1256219439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31fc068b20 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f2a00640 1 -- 172.21.15.37:0/1256219439 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31e4011590 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.099+0000 7f31f2a00640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f31d8068380 0x7f31d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:29.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.103+0000 7f31f2a00640 1 -- 172.21.15.37:0/1256219439 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f31e4086be0 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.103+0000 7f31faa00640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f31d8068380 0x7f31d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:29.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.103+0000 7f31faa00640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f31d8068380 0x7f31d806a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f31ec000f70 tx=0x7f31ec007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:29.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.107+0000 7f31f2a00640 1 -- 172.21.15.37:0/1256219439 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31e4015020 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.307+0000 7f3201c00640 1 -- 172.21.15.37:0/1256219439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f31fc072fb0 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.307+0000 7f31f2a00640 1 -- 172.21.15.37:0/1256219439 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f31e4056ab0 con 0x7f31fc0b2ec0 2024-05-30T06:42:29.309 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T06:42:29.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.311+0000 7f3201c00640 1 -- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f31d8068380 msgr2=0x7f31d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:29.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.311+0000 7f3201c00640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f31d8068380 0x7f31d806a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f31ec000f70 tx=0x7f31ec007e90 comp rx=0 tx=0).stop 2024-05-30T06:42:29.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.311+0000 7f3201c00640 1 -- 172.21.15.37:0/1256219439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31fc0b2ec0 msgr2=0x7f31fc143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:29.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.311+0000 7f3201c00640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31fc0b2ec0 0x7f31fc143d40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f31e400c7f0 tx=0x7f31e400ccb0 comp rx=0 tx=0).stop 2024-05-30T06:42:29.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.311+0000 7f3201c00640 1 -- 172.21.15.37:0/1256219439 shutdown_connections 2024-05-30T06:42:29.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.311+0000 7f3201c00640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f31d8068380 0x7f31d806a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:29.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.311+0000 7f3201c00640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31fc155e60 0x7f31fc15a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:29.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.311+0000 7f3201c00640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31fc0b2ec0 0x7f31fc143d40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:29.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.311+0000 7f3201c00640 1 --2- 172.21.15.37:0/1256219439 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31fc06f9a0 0x7f31fc156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:29.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.311+0000 7f3201c00640 1 -- 172.21.15.37:0/1256219439 >> 172.21.15.37:0/1256219439 conn(0x7f31fc0b23a0 msgr2=0x7f31fc0cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:29.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.311+0000 7f3201c00640 1 -- 172.21.15.37:0/1256219439 shutdown_connections 2024-05-30T06:42:29.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29.311+0000 7f3201c00640 1 -- 172.21.15.37:0/1256219439 wait complete. 2024-05-30T06:42:29.330 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T06:42:29.330 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T06:42:29.330 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-30T06:42:29.330 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-30T06:42:29.330 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-30T06:42:29.330 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T06:42:29.330 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T06:42:29.330 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T06:42:29.330 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-30T06:42:29.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:29.331 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-30T06:42:29.339 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:42:29.340 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:42:29.340 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:42:29.340 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.340 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-30T06:42:29.340 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.340 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:42:29.340 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:29.340 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-30T06:42:29.340 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T06:42:29.340 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:29.340 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-30T06:42:29.341 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T06:42:29.341 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42455sec preferred_lft 42455sec 2024-05-30T06:42:29.341 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-05-30T06:42:29.341 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.341 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:42:29.341 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:29.341 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-30T06:42:29.341 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:42:29.341 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:29.341 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-30T06:42:29.341 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T06:42:29.341 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:30:63:12:21 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:29.341 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T06:42:29.342 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.342 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:42:29.342 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:29.342 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T06:42:29.342 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.342 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T06:42:29.342 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.342 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:42:29.342 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T06:42:29.342 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-05-30T06:42:29.342 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:29.343 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T06:42:29.403 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-30T06:42:29.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:29.406 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-30T06:42:29.462 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-30T06:42:29.462 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T06:42:29.462 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T06:42:29.462 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T06:42:29.462 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T06:42:29.462 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T06:42:29.462 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:29.463 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:42:29.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T06:42:29.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T06:42:29.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T06:42:29.463 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:42:29.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:29.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:29.601 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T06:42:29.609 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T06:42:29.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:29.610 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-05-30T06:42:29.664 INFO:teuthology.orchestra.run.smithi037.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-30T06:42:29.665 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:29.665 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:42:29.665 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T06:42:29.665 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-30T06:42:29.665 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:42:29.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:29.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:29.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-30T06:42:29.815 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:42:29.815 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:42:29.815 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:42:29.815 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.815 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-30T06:42:29.815 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.816 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:42:29.816 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether f2:5d:e8:e3:db:02 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-30T06:42:29.816 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-30T06:42:29.816 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.816 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::f05d:e8ff:fee3:db02/64 scope link 2024-05-30T06:42:29.816 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:29.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-30T06:42:29.885 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:42:29.885 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:42:29.885 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:42:29.885 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.885 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-30T06:42:29.885 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.885 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:42:29.885 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether f2:5d:e8:e3:db:02 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-30T06:42:29.885 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-30T06:42:29.885 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.885 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::f05d:e8ff:fee3:db02/64 scope link 2024-05-30T06:42:29.886 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:29.887 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-30T06:42:29.887 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:29.887 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:42:29.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-30T06:42:29.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-30T06:42:29.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-30T06:42:29.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-30T06:42:29.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-30T06:42:29.888 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:42:29.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:30.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:30.068 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:30.068 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:42:30.068 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.1 up 2024-05-30T06:42:30.068 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.1 master ceph-brx 2024-05-30T06:42:30.068 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:42:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:30.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:30.154 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:42:30.154 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-30T06:42:30.210 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-30T06:42:30.211 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:42:30.211 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-30T06:42:30.260 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-05-30T06:42:30.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:30.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:42:30.350 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:42:30.350 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:42:30.363 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:42:30.363 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:42:30.363 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-05-30T06:42:30.363 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 2@393250aa-2b42-4955-adf1-f790b8ba4d8c.cephfs=/ 2024-05-30T06:42:30.364 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.37:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-05-30T06:42:30.367 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T06:42:30.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:30.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-30T06:42:30.387 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:42:30.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:42:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:30.487 INFO:teuthology.orchestra.run.smithi037.stdout:client4672 2024-05-30T06:42:30.487 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:42:30.487 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:30.497 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:42:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:42:30.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:30.598 INFO:teuthology.orchestra.run.smithi037.stdout:client4672 2024-05-30T06:42:30.598 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:42:30.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:42:30.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:30.656 INFO:teuthology.orchestra.run.smithi037.stdout:client4672 2024-05-30T06:42:30.656 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/393250aa-2b42-4955-adf1-f790b8ba4d8c.client4672/status') 2024-05-30T06:42:30.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:30.716 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.4672 (3)172.21.15.37:0/128296692 2024-05-30T06:42:30.716 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2024-05-30T06:42:30.716 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2024-05-30T06:42:30.716 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2024-05-30T06:42:30.716 INFO:teuthology.orchestra.run.smithi037.stderr:69 bytes copied, 5.1671e-05 s, 1.3 MB/s 2024-05-30T06:42:30.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:30.724 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-05-30T06:42:30.724 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-30T06:42:30.724 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-30T06:42:30.725 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T06:42:30.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bdd800640 1 Processor -- start 2024-05-30T06:42:30.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bdd800640 1 -- start start 2024-05-30T06:42:30.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bdd800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0bd80ce6c0 0x7f0bd80b3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:30.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bdd800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd809ab40 0x7f0bd809af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:30.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bdd800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bd80d2380 con 0x7f0bd809b4c0 2024-05-30T06:42:30.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bdd800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0bd80d2620 con 0x7f0bd80ce6c0 2024-05-30T06:42:30.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bdd800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0bd806dc00 con 0x7f0bd809ab40 2024-05-30T06:42:30.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd7400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0bd809b4c0 0x7f0bd8162880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51582/0 (socket says 172.21.15.37:51582) 2024-05-30T06:42:30.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd7400640 1 -- 172.21.15.37:0/1449525984 learned_addr learned my addr 172.21.15.37:0/1449525984 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:30.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6a00640 1 --2- 172.21.15.37:0/1449525984 >> v2:172.21.15.105:3300/0 conn(0x7f0bd80ce6c0 0x7f0bd80b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:30.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bcfe00640 1 --2- 172.21.15.37:0/1449525984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd809ab40 0x7f0bd809af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:30.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1499441558 0 0) 0x7f0bd80d2380 con 0x7f0bd809b4c0 2024-05-30T06:42:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bbc003530 con 0x7f0bd809b4c0 2024-05-30T06:42:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2810182039 0 0) 0x7f0bbc003530 con 0x7f0bd809b4c0 2024-05-30T06:42:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd809ab40 msgr2=0x7f0bd809af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 --2- 172.21.15.37:0/1449525984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd809ab40 0x7f0bd809af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 >> v2:172.21.15.105:3300/0 conn(0x7f0bd80ce6c0 msgr2=0x7f0bd80b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 --2- 172.21.15.37:0/1449525984 >> v2:172.21.15.105:3300/0 conn(0x7f0bd80ce6c0 0x7f0bd80b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd806d5b0 con 0x7f0bd809b4c0 2024-05-30T06:42:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f0bd0001a00 con 0x7f0bd809b4c0 2024-05-30T06:42:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 >> v1:172.21.15.37:6789/0 conn(0x7f0bd809b4c0 legacy=0x7f0bd8162880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 --2- 172.21.15.37:0/1449525984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bbc0039c0 0x7f0bbc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 --2- 172.21.15.37:0/1449525984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bbc004810 0x7f0bbc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 --2- 172.21.15.37:0/1449525984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd809ab40 0x7f0bbc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:30.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd80d2620 con 0x7f0bbc0039c0 2024-05-30T06:42:30.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd806dc00 con 0x7f0bbc004810 2024-05-30T06:42:30.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0bbc00b9d0 con 0x7f0bd809ab40 2024-05-30T06:42:30.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6a00640 1 --2- 172.21.15.37:0/1449525984 >> v2:172.21.15.105:3300/0 conn(0x7f0bd80ce6c0 0x7f0bd80b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:30.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd6a00640 1 --2- 172.21.15.37:0/1449525984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bbc0039c0 0x7f0bbc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:30.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bd7400640 1 --2- 172.21.15.37:0/1449525984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd809ab40 0x7f0bbc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:30.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.867+0000 7f0bcfe00640 1 --2- 172.21.15.37:0/1449525984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bbc004810 0x7f0bbc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:30.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bd6a00640 1 -- 172.21.15.37:0/1449525984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd809ab40 msgr2=0x7f0bbc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bd6a00640 1 --2- 172.21.15.37:0/1449525984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd809ab40 0x7f0bbc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bd6a00640 1 -- 172.21.15.37:0/1449525984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bbc004810 msgr2=0x7f0bbc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bd6a00640 1 --2- 172.21.15.37:0/1449525984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bbc004810 0x7f0bbc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bd6a00640 1 -- 172.21.15.37:0/1449525984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bbc003530 con 0x7f0bbc0039c0 2024-05-30T06:42:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bd6a00640 1 --2- 172.21.15.37:0/1449525984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bbc0039c0 0x7f0bbc003de0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009c90 tx=0x7f0bc801cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238aacaa3c741f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8009860 con 0x7f0bbc0039c0 2024-05-30T06:42:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc8004020 con 0x7f0bbc0039c0 2024-05-30T06:42:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bd6000640 1 -- 172.21.15.37:0/1449525984 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8004410 con 0x7f0bbc0039c0 2024-05-30T06:42:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bdd800640 1 -- 172.21.15.37:0/1449525984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bbc0039c0 msgr2=0x7f0bbc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bdd800640 1 --2- 172.21.15.37:0/1449525984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bbc0039c0 0x7f0bbc003de0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009c90 tx=0x7f0bc801cc70 comp rx=0 tx=0).stop 2024-05-30T06:42:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bd7400640 1 -- 172.21.15.37:0/1449525984 reap_dead start 2024-05-30T06:42:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bdd800640 1 -- 172.21.15.37:0/1449525984 shutdown_connections 2024-05-30T06:42:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bdd800640 1 -- 172.21.15.37:0/1449525984 >> 172.21.15.37:0/1449525984 conn(0x7f0bd80d27e0 msgr2=0x7f0bd80d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bdd800640 1 -- 172.21.15.37:0/1449525984 shutdown_connections 2024-05-30T06:42:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.871+0000 7f0bdd800640 1 -- 172.21.15.37:0/1449525984 wait complete. 2024-05-30T06:42:30.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bdd800640 1 Processor -- start 2024-05-30T06:42:30.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bdd800640 1 -- start start 2024-05-30T06:42:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bdd800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bbc0039c0 0x7f0bd8149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bdd800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd815fde0 0x7f0bd80c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bdd800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd80c6830 0x7f0bd8149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:30.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bdd800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd80cec20 con 0x7f0bd815fde0 2024-05-30T06:42:30.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bdd800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd80ceaa0 con 0x7f0bd80c6830 2024-05-30T06:42:30.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bdd800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0bd8169bb0 con 0x7f0bbc0039c0 2024-05-30T06:42:30.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bcfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd815fde0 0x7f0bd80c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:30.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bcfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd815fde0 0x7f0bd80c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45844/0 (socket says 172.21.15.37:45844) 2024-05-30T06:42:30.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bcfe00640 1 -- 172.21.15.37:0/3423292688 learned_addr learned my addr 172.21.15.37:0/3423292688 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:30.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bd6a00640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bbc0039c0 0x7f0bd8149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:30.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bd7400640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd80c6830 0x7f0bd8149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:30.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bcfe00640 1 -- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bbc0039c0 msgr2=0x7f0bd8149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:30.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bcfe00640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bbc0039c0 0x7f0bd8149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:30.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bcfe00640 1 -- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd80c6830 msgr2=0x7f0bd8149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:30.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bcfe00640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd80c6830 0x7f0bd8149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bcfe00640 1 -- 172.21.15.37:0/3423292688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd8149cd0 con 0x7f0bd815fde0 2024-05-30T06:42:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bcfe00640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd815fde0 0x7f0bd80c62f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0011990 tx=0x7f0bc0011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bcea00640 1 -- 172.21.15.37:0/3423292688 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc000fad0 con 0x7f0bd815fde0 2024-05-30T06:42:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bcea00640 1 -- 172.21.15.37:0/3423292688 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bc000fc70 con 0x7f0bd815fde0 2024-05-30T06:42:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.875+0000 7f0bdd800640 1 -- 172.21.15.37:0/3423292688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd815eaa0 con 0x7f0bd815fde0 2024-05-30T06:42:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.879+0000 7f0bcea00640 1 -- 172.21.15.37:0/3423292688 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0014440 con 0x7f0bd815fde0 2024-05-30T06:42:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.879+0000 7f0bdd800640 1 -- 172.21.15.37:0/3423292688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd815f020 con 0x7f0bd815fde0 2024-05-30T06:42:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.879+0000 7f0bdd800640 1 -- 172.21.15.37:0/3423292688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bd8068b20 con 0x7f0bd815fde0 2024-05-30T06:42:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.879+0000 7f0bcea00640 1 -- 172.21.15.37:0/3423292688 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0bc0012040 con 0x7f0bd815fde0 2024-05-30T06:42:30.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.879+0000 7f0bcea00640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bb40683b0 0x7f0bb406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:30.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.879+0000 7f0bcea00640 1 -- 172.21.15.37:0/3423292688 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0bc0086fa0 con 0x7f0bd815fde0 2024-05-30T06:42:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.879+0000 7f0bd6a00640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bb40683b0 0x7f0bb406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.879+0000 7f0bd6a00640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bb40683b0 0x7f0bb406a870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80ae000 tx=0x7f0bc80046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:30.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:30.883+0000 7f0bcea00640 1 -- 172.21.15.37:0/3423292688 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0bc0019030 con 0x7f0bd815fde0 2024-05-30T06:42:31.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bdd800640 1 -- 172.21.15.37:0/3423292688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0bd80c6c10 con 0x7f0bd815fde0 2024-05-30T06:42:31.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bcea00640 1 -- 172.21.15.37:0/3423292688 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f0bc0056e70 con 0x7f0bd815fde0 2024-05-30T06:42:31.086 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T06:42:31.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bdd800640 1 -- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bb40683b0 msgr2=0x7f0bb406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:31.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bdd800640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bb40683b0 0x7f0bb406a870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80ae000 tx=0x7f0bc80046d0 comp rx=0 tx=0).stop 2024-05-30T06:42:31.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bdd800640 1 -- 172.21.15.37:0/3423292688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd815fde0 msgr2=0x7f0bd80c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:31.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bdd800640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd815fde0 0x7f0bd80c62f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0011990 tx=0x7f0bc0011e50 comp rx=0 tx=0).stop 2024-05-30T06:42:31.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bdd800640 1 -- 172.21.15.37:0/3423292688 shutdown_connections 2024-05-30T06:42:31.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bdd800640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bb40683b0 0x7f0bb406a870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:31.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bdd800640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd80c6830 0x7f0bd8149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:31.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bdd800640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd815fde0 0x7f0bd80c62f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:31.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bdd800640 1 --2- 172.21.15.37:0/3423292688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bbc0039c0 0x7f0bd8149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:31.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bdd800640 1 -- 172.21.15.37:0/3423292688 >> 172.21.15.37:0/3423292688 conn(0x7f0bd80d27e0 msgr2=0x7f0bd80b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:31.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bdd800640 1 -- 172.21.15.37:0/3423292688 shutdown_connections 2024-05-30T06:42:31.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:31.087+0000 7f0bdd800640 1 -- 172.21.15.37:0/3423292688 wait complete. 2024-05-30T06:42:31.107 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T06:42:31.107 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T06:42:31.107 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-05-30T06:42:31.107 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-30T06:42:31.107 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-30T06:42:31.107 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T06:42:31.107 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T06:42:31.107 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T06:42:31.107 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-30T06:42:31.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:31.107 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-05-30T06:42:31.117 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:42:31.117 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:42:31.117 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:42:31.117 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:31.117 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-05-30T06:42:31.118 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:31.118 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:42:31.118 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:31.118 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-05-30T06:42:31.118 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:42:31.118 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:31.118 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-05-30T06:42:31.118 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:42:31.118 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:31.118 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T06:42:31.118 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:31.118 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-30T06:42:31.119 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42464sec preferred_lft 42464sec 2024-05-30T06:42:31.119 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link 2024-05-30T06:42:31.119 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:31.119 INFO:teuthology.orchestra.run.smithi105.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T06:42:31.119 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 02:42:4e:53:2d:36 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:31.119 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T06:42:31.119 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:31.120 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-30T06:42:31.120 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:31.120 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-05-30T06:42:31.120 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add name ceph-brx type bridge 2024-05-30T06:42:31.120 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip addr flush dev ceph-brx 2024-05-30T06:42:31.121 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set ceph-brx up 2024-05-30T06:42:31.121 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-30T06:42:31.121 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-05-30T06:42:31.216 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:31.280 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:31.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:31.287 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T06:42:31.305 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-05-30T06:42:31.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:31.308 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-05-30T06:42:31.614 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-05-30T06:42:31.615 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T06:42:31.615 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-30T06:42:31.615 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-30T06:42:31.615 INFO:teuthology.orchestra.run.smithi105.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-30T06:42:31.615 INFO:teuthology.orchestra.run.smithi105.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T06:42:31.615 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-30T06:42:31.615 INFO:teuthology.orchestra.run.smithi105.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-30T06:42:31.615 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-30T06:42:31.615 INFO:teuthology.orchestra.run.smithi105.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-30T06:42:31.615 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T06:42:31.616 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:31.616 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-05-30T06:42:31.616 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-30T06:42:31.616 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-30T06:42:31.616 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-30T06:42:31.616 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-05-30T06:42:31.665 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:31.706 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:31.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:31.713 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-05-30T06:42:31.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:31.722 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list-id 2024-05-30T06:42:31.772 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:31.772 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-05-30T06:42:31.772 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T06:42:31.772 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-30T06:42:31.773 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-05-30T06:42:31.864 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:31.895 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:31.902 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-30T06:42:31.902 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:31.902 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-05-30T06:42:31.903 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-30T06:42:31.903 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-30T06:42:31.903 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-30T06:42:31.903 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-30T06:42:31.903 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-30T06:42:31.903 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-05-30T06:42:31.949 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:32.059 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:32.065 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:32.065 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-05-30T06:42:32.065 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-05-30T06:42:32.066 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set dev brx.0 master ceph-brx 2024-05-30T06:42:32.066 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-05-30T06:42:32.112 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:32.143 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:32.150 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:42:32.150 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-30T06:42:32.158 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-30T06:42:32.159 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:42:32.159 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-30T06:42:32.207 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-30T06:42:32.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:32.207 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:42:32.298 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:42:32.299 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:42:32.901 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:42:32.901 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:42:32.901 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-05-30T06:42:32.901 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 1@393250aa-2b42-4955-adf1-f790b8ba4d8c.cephfs=/ 2024-05-30T06:42:32.901 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.37:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-05-30T06:42:32.905 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T06:42:32.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:32.905 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-30T06:42:32.925 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:42:33.015 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:42:33.034 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:33.040 INFO:teuthology.orchestra.run.smithi105.stdout:client4681 2024-05-30T06:42:33.040 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:42:33.040 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:33.049 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:42:33.141 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:42:33.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:33.150 INFO:teuthology.orchestra.run.smithi105.stdout:client4681 2024-05-30T06:42:33.151 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:42:33.196 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:42:33.200 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:33.206 INFO:teuthology.orchestra.run.smithi105.stdout:client4681 2024-05-30T06:42:33.206 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/393250aa-2b42-4955-adf1-f790b8ba4d8c.client4681/status') 2024-05-30T06:42:33.293 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:33.306 INFO:teuthology.orchestra.run.smithi105.stdout:instance: client.4681 (3)192.168.0.1:0/1634564358 2024-05-30T06:42:33.306 INFO:teuthology.orchestra.run.smithi105.stdout:blocklisted: false 2024-05-30T06:42:33.306 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2024-05-30T06:42:33.306 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2024-05-30T06:42:33.306 INFO:teuthology.orchestra.run.smithi105.stderr:69 bytes copied, 5.9606e-05 s, 1.2 MB/s 2024-05-30T06:42:33.307 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:33.314 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-05-30T06:42:33.314 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-30T06:42:33.314 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-30T06:42:33.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T06:42:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.463+0000 7f689a600640 1 Processor -- start 2024-05-30T06:42:33.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.463+0000 7f689a600640 1 -- start start 2024-05-30T06:42:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f689a600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68940b2ec0 0x7f68940b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f689a600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f689415c8f0 con 0x7f689406f9a0 2024-05-30T06:42:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f689a600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68940ccc80 con 0x7f6894155e60 2024-05-30T06:42:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f689a600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68940ccff0 con 0x7f68940b2ec0 2024-05-30T06:42:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f688aa00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f689406f9a0 0x7f68940cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51596/0 (socket says 172.21.15.37:51596) 2024-05-30T06:42:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f688aa00640 1 -- 172.21.15.37:0/4128939009 learned_addr learned my addr 172.21.15.37:0/4128939009 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f6893e00640 1 --2- 172.21.15.37:0/4128939009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68940b2ec0 0x7f68940b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f6892a00640 1 -- 172.21.15.37:0/4128939009 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 630811484 0 0) 0x7f68940ccc80 con 0x7f6894155e60 2024-05-30T06:42:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f6892a00640 1 -- 172.21.15.37:0/4128939009 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6878003530 con 0x7f6894155e60 2024-05-30T06:42:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f6892a00640 1 -- 172.21.15.37:0/4128939009 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3764441748 0 0) 0x7f689415c8f0 con 0x7f689406f9a0 2024-05-30T06:42:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f6892a00640 1 -- 172.21.15.37:0/4128939009 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68940ccc80 con 0x7f689406f9a0 2024-05-30T06:42:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f6893e00640 1 -- 172.21.15.37:0/4128939009 >> v1:172.21.15.105:6789/0 conn(0x7f6894155e60 legacy=0x7f68940cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f6893e00640 1 -- 172.21.15.37:0/4128939009 >> v1:172.21.15.37:6789/0 conn(0x7f689406f9a0 legacy=0x7f68940cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.467+0000 7f6893e00640 1 -- 172.21.15.37:0/4128939009 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689415cbd0 con 0x7f68940b2ec0 2024-05-30T06:42:33.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f6893e00640 1 --2- 172.21.15.37:0/4128939009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68940b2ec0 0x7f68940b36a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f688c0097f0 tx=0x7f688c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64162941c5862057 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f6892a00640 1 -- 172.21.15.37:0/4128939009 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0b1070 con 0x7f68940b2ec0 2024-05-30T06:42:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f6892a00640 1 -- 172.21.15.37:0/4128939009 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688c0ac410 con 0x7f68940b2ec0 2024-05-30T06:42:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f6892a00640 1 -- 172.21.15.37:0/4128939009 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0ac7e0 con 0x7f68940b2ec0 2024-05-30T06:42:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 -- 172.21.15.37:0/4128939009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68940b2ec0 msgr2=0x7f68940b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 --2- 172.21.15.37:0/4128939009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68940b2ec0 0x7f68940b36a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f688c0097f0 tx=0x7f688c01c4e0 comp rx=0 tx=0).stop 2024-05-30T06:42:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 -- 172.21.15.37:0/4128939009 shutdown_connections 2024-05-30T06:42:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 --2- 172.21.15.37:0/4128939009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68940b2ec0 0x7f68940b36a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 -- 172.21.15.37:0/4128939009 >> 172.21.15.37:0/4128939009 conn(0x7f68940b23a0 msgr2=0x7f68940b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 -- 172.21.15.37:0/4128939009 shutdown_connections 2024-05-30T06:42:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 -- 172.21.15.37:0/4128939009 wait complete. 2024-05-30T06:42:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 Processor -- start 2024-05-30T06:42:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 -- start start 2024-05-30T06:42:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f689406f9a0 0x7f6894158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b2ec0 0x7f68941f7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6894155e60 0x7f6894151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6894169a00 con 0x7f6894155e60 2024-05-30T06:42:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6894169880 con 0x7f68940b2ec0 2024-05-30T06:42:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f689a600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6894169b80 con 0x7f689406f9a0 2024-05-30T06:42:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f6893e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6894155e60 0x7f6894151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f6893e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6894155e60 0x7f6894151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45846/0 (socket says 172.21.15.37:45846) 2024-05-30T06:42:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.471+0000 7f6893e00640 1 -- 172.21.15.37:0/4026666839 learned_addr learned my addr 172.21.15.37:0/4026666839 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f688aa00640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b2ec0 0x7f68941f7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f6893400640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f689406f9a0 0x7f6894158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f6893e00640 1 -- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f689406f9a0 msgr2=0x7f6894158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f6893e00640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f689406f9a0 0x7f6894158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f6893e00640 1 -- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b2ec0 msgr2=0x7f68941f7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f6893e00640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b2ec0 0x7f68941f7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f6893e00640 1 -- 172.21.15.37:0/4026666839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6894150230 con 0x7f6894155e60 2024-05-30T06:42:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f6893e00640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6894155e60 0x7f6894151d40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f688c0af040 tx=0x7f688c019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f688be00640 1 -- 172.21.15.37:0/4026666839 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0b9020 con 0x7f6894155e60 2024-05-30T06:42:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f688be00640 1 -- 172.21.15.37:0/4026666839 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688c0b5410 con 0x7f6894155e60 2024-05-30T06:42:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f688be00640 1 -- 172.21.15.37:0/4026666839 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0b1040 con 0x7f6894155e60 2024-05-30T06:42:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f689a600640 1 -- 172.21.15.37:0/4026666839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6894150510 con 0x7f6894155e60 2024-05-30T06:42:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f689a600640 1 -- 172.21.15.37:0/4026666839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6894150db0 con 0x7f6894155e60 2024-05-30T06:42:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f689a600640 1 -- 172.21.15.37:0/4026666839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6894068b20 con 0x7f6894155e60 2024-05-30T06:42:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f688be00640 1 -- 172.21.15.37:0/4026666839 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f688c0bc020 con 0x7f6894155e60 2024-05-30T06:42:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f688be00640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6870068380 0x7f687006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.475+0000 7f688be00640 1 -- 172.21.15.37:0/4026666839 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f688c1203e0 con 0x7f6894155e60 2024-05-30T06:42:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.479+0000 7f6893400640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6870068380 0x7f687006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.479+0000 7f6893400640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6870068380 0x7f687006a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6884001570 tx=0x7f6884009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.479+0000 7f688be00640 1 -- 172.21.15.37:0/4026666839 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f688c0c3030 con 0x7f6894155e60 2024-05-30T06:42:33.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.683+0000 7f689a600640 1 -- 172.21.15.37:0/4026666839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6894072fb0 con 0x7f6894155e60 2024-05-30T06:42:33.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.683+0000 7f688be00640 1 -- 172.21.15.37:0/4026666839 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f688c0160d0 con 0x7f6894155e60 2024-05-30T06:42:33.684 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T06:42:33.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.687+0000 7f689a600640 1 -- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6870068380 msgr2=0x7f687006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:33.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.687+0000 7f689a600640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6870068380 0x7f687006a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6884001570 tx=0x7f6884009040 comp rx=0 tx=0).stop 2024-05-30T06:42:33.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.687+0000 7f689a600640 1 -- 172.21.15.37:0/4026666839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6894155e60 msgr2=0x7f6894151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:33.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.687+0000 7f689a600640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6894155e60 0x7f6894151d40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f688c0af040 tx=0x7f688c019280 comp rx=0 tx=0).stop 2024-05-30T06:42:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.687+0000 7f689a600640 1 -- 172.21.15.37:0/4026666839 shutdown_connections 2024-05-30T06:42:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.687+0000 7f689a600640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6894155e60 0x7f6894151d40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.687+0000 7f689a600640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6870068380 0x7f687006a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.687+0000 7f689a600640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b2ec0 0x7f68941f7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.687+0000 7f689a600640 1 --2- 172.21.15.37:0/4026666839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f689406f9a0 0x7f6894158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.687+0000 7f689a600640 1 -- 172.21.15.37:0/4026666839 >> 172.21.15.37:0/4026666839 conn(0x7f68940b23a0 msgr2=0x7f68940b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.687+0000 7f689a600640 1 -- 172.21.15.37:0/4026666839 shutdown_connections 2024-05-30T06:42:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:33.687+0000 7f689a600640 1 -- 172.21.15.37:0/4026666839 wait complete. 2024-05-30T06:42:33.706 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-30T06:42:33.706 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T06:42:33.706 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-05-30T06:42:33.706 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-30T06:42:33.706 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-30T06:42:33.706 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-30T06:42:33.707 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-30T06:42:33.707 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T06:42:33.707 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-30T06:42:33.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:33.707 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-05-30T06:42:33.716 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:42:33.716 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:42:33.716 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:42:33.716 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:33.717 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-05-30T06:42:33.717 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:33.717 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:42:33.717 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:33.717 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-05-30T06:42:33.717 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:42:33.717 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:33.717 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-05-30T06:42:33.717 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:42:33.717 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:33.718 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T06:42:33.718 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:33.718 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-30T06:42:33.718 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42461sec preferred_lft 42461sec 2024-05-30T06:42:33.718 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link 2024-05-30T06:42:33.718 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:33.718 INFO:teuthology.orchestra.run.smithi105.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T06:42:33.718 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 02:42:4e:53:2d:36 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:33.718 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T06:42:33.718 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:33.719 INFO:teuthology.orchestra.run.smithi105.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:42:33.719 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T06:42:33.719 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T06:42:33.719 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:33.719 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T06:42:33.719 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:33.719 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:42:33.719 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T06:42:33.719 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-05-30T06:42:33.719 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:33.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:33.720 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T06:42:33.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:42:33.726 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:42:33.786 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-05-30T06:42:33.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:33.788 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-05-30T06:42:33.866 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-05-30T06:42:33.866 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T06:42:33.866 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-30T06:42:33.866 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-30T06:42:33.866 INFO:teuthology.orchestra.run.smithi105.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-30T06:42:33.866 INFO:teuthology.orchestra.run.smithi105.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T06:42:33.867 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-30T06:42:33.867 INFO:teuthology.orchestra.run.smithi105.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-30T06:42:33.867 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-30T06:42:33.867 INFO:teuthology.orchestra.run.smithi105.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-30T06:42:33.867 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T06:42:33.867 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:33.867 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-05-30T06:42:33.867 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-30T06:42:33.868 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-30T06:42:33.868 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-30T06:42:33.868 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-05-30T06:42:33.954 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:33.995 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:34.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:34.002 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-05-30T06:42:34.052 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-30T06:42:34.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:34.052 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list-id 2024-05-30T06:42:34.103 INFO:teuthology.orchestra.run.smithi105.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-30T06:42:34.104 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:34.104 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-05-30T06:42:34.105 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-30T06:42:34.105 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-30T06:42:34.105 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-05-30T06:42:34.193 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:34.224 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:34.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:34.230 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-30T06:42:34.251 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:42:34.251 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:42:34.251 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:42:34.251 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:34.251 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-05-30T06:42:34.251 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:34.251 INFO:teuthology.orchestra.run.smithi105.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:42:34.252 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether da:b8:1c:10:b7:31 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-30T06:42:34.252 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-30T06:42:34.252 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:34.252 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::d8b8:1cff:fe10:b731/64 scope link 2024-05-30T06:42:34.252 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:34.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:34.253 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-30T06:42:34.314 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:42:34.315 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:42:34.315 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:42:34.315 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:34.315 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-05-30T06:42:34.315 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:34.315 INFO:teuthology.orchestra.run.smithi105.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:42:34.315 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether da:b8:1c:10:b7:31 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-30T06:42:34.315 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-30T06:42:34.315 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:34.315 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::d8b8:1cff:fe10:b731/64 scope link 2024-05-30T06:42:34.315 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:42:34.317 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-30T06:42:34.317 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:34.317 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-05-30T06:42:34.317 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-30T06:42:34.317 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-30T06:42:34.317 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-30T06:42:34.317 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-30T06:42:34.317 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-30T06:42:34.317 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-05-30T06:42:34.405 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:34.494 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:34.499 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:42:34.499 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-05-30T06:42:34.499 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.1 up 2024-05-30T06:42:34.499 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set dev brx.1 master ceph-brx 2024-05-30T06:42:34.499 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-05-30T06:42:34.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:34.575 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:34.582 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:42:34.582 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-30T06:42:34.635 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-30T06:42:34.636 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:42:34.636 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-30T06:42:34.687 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-05-30T06:42:34.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:34.687 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:42:34.775 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:42:34.776 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:42:34.790 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:42:34.790 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:42:34.790 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-05-30T06:42:34.790 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 3@393250aa-2b42-4955-adf1-f790b8ba4d8c.cephfs=/ 2024-05-30T06:42:34.790 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.37:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-05-30T06:42:34.794 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T06:42:34.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:34.794 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-30T06:42:34.813 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:42:34.906 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:42:34.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:34.916 INFO:teuthology.orchestra.run.smithi105.stdout:client4659 2024-05-30T06:42:34.917 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:42:34.917 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:34.972 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:42:35.061 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:42:35.064 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:35.070 INFO:teuthology.orchestra.run.smithi105.stdout:client4659 2024-05-30T06:42:35.070 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:42:35.116 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:42:35.119 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:35.125 INFO:teuthology.orchestra.run.smithi105.stdout:client4659 2024-05-30T06:42:35.125 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/393250aa-2b42-4955-adf1-f790b8ba4d8c.client4659/status') 2024-05-30T06:42:35.213 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:42:35.225 INFO:teuthology.orchestra.run.smithi105.stdout:instance: client.4659 (3)172.21.15.105:0/2564789441 2024-05-30T06:42:35.225 INFO:teuthology.orchestra.run.smithi105.stdout:blocklisted: false 2024-05-30T06:42:35.226 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2024-05-30T06:42:35.226 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2024-05-30T06:42:35.226 INFO:teuthology.orchestra.run.smithi105.stderr:71 bytes copied, 4.996e-05 s, 1.4 MB/s 2024-05-30T06:42:35.227 INFO:teuthology.orchestra.run.smithi105.stderr:2024-05-30T06:42:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:42:35.233 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-30T06:42:35.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:35.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.403+0000 7ffaf5c00640 1 Processor -- start 2024-05-30T06:42:35.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.403+0000 7ffaf5c00640 1 -- start start 2024-05-30T06:42:35.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.403+0000 7ffaf5c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaf0161fa0 0x7ffaf006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:35.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.403+0000 7ffaf5c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffaf0162380 0x7ffaf00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:35.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.403+0000 7ffaf5c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffaf00b3b50 0x7ffaf009aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:35.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.403+0000 7ffaf5c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ffaf00cdcb0 con 0x7ffaf00b3b50 2024-05-30T06:42:35.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.403+0000 7ffaf5c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ffaf00d1550 con 0x7ffaf0162380 2024-05-30T06:42:35.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.403+0000 7ffaf5c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf00cd660 con 0x7ffaf0161fa0 2024-05-30T06:42:35.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.403+0000 7ffaef400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffaf00b3b50 0x7ffaf009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:35.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.403+0000 7ffaef400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffaf00b3b50 0x7ffaf009aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45848/0 (socket says 172.21.15.37:45848) 2024-05-30T06:42:35.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.403+0000 7ffaef400640 1 -- 172.21.15.37:0/2881464830 learned_addr learned my addr 172.21.15.37:0/2881464830 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:35.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.403+0000 7ffaeea00640 1 --2- 172.21.15.37:0/2881464830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaf0161fa0 0x7ffaf006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:35.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.403+0000 7ffae7e00640 1 --2- 172.21.15.37:0/2881464830 >> v2:172.21.15.105:3300/0 conn(0x7ffaf0162380 0x7ffaf00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaef400640 1 -- 172.21.15.37:0/2881464830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaf0161fa0 msgr2=0x7ffaf006ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaef400640 1 --2- 172.21.15.37:0/2881464830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaf0161fa0 0x7ffaf006ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaef400640 1 -- 172.21.15.37:0/2881464830 >> v2:172.21.15.105:3300/0 conn(0x7ffaf0162380 msgr2=0x7ffaf00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaef400640 1 --2- 172.21.15.37:0/2881464830 >> v2:172.21.15.105:3300/0 conn(0x7ffaf0162380 0x7ffaf00d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaef400640 1 -- 172.21.15.37:0/2881464830 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf00cd940 con 0x7ffaf00b3b50 2024-05-30T06:42:35.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaef400640 1 --2- 172.21.15.37:0/2881464830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf00b3b50 0x7ffaf009aa60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00730f0 tx=0x7ffae801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bae2e04c224183 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:35.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaee000640 1 -- 172.21.15.37:0/2881464830 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae80b4070 con 0x7ffaf00b3b50 2024-05-30T06:42:35.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaee000640 1 -- 172.21.15.37:0/2881464830 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffae80af400 con 0x7ffaf00b3b50 2024-05-30T06:42:35.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaee000640 1 -- 172.21.15.37:0/2881464830 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae80af7d0 con 0x7ffaf00b3b50 2024-05-30T06:42:35.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaf5c00640 1 -- 172.21.15.37:0/2881464830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf00b3b50 msgr2=0x7ffaf009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:35.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaf5c00640 1 --2- 172.21.15.37:0/2881464830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf00b3b50 0x7ffaf009aa60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00730f0 tx=0x7ffae801f1e0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaf5c00640 1 -- 172.21.15.37:0/2881464830 shutdown_connections 2024-05-30T06:42:35.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaf5c00640 1 --2- 172.21.15.37:0/2881464830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf00b3b50 0x7ffaf009aa60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaf5c00640 1 --2- 172.21.15.37:0/2881464830 >> v2:172.21.15.105:3300/0 conn(0x7ffaf0162380 0x7ffaf00d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaf5c00640 1 --2- 172.21.15.37:0/2881464830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaf0161fa0 0x7ffaf006ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.407+0000 7ffaf5c00640 1 -- 172.21.15.37:0/2881464830 >> 172.21.15.37:0/2881464830 conn(0x7ffaf00b4160 msgr2=0x7ffaf00b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:35.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaf5c00640 1 -- 172.21.15.37:0/2881464830 shutdown_connections 2024-05-30T06:42:35.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaf5c00640 1 -- 172.21.15.37:0/2881464830 wait complete. 2024-05-30T06:42:35.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaf5c00640 1 Processor -- start 2024-05-30T06:42:35.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaf5c00640 1 -- start start 2024-05-30T06:42:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaf5c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffaf00b3b50 0x7ffaf0153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaf5c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaf0161fa0 0x7ffaf00b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaf5c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf0162380 0x7ffaf00cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaf5c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf00d1310 con 0x7ffaf0162380 2024-05-30T06:42:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaf5c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf00d1190 con 0x7ffaf00b3b50 2024-05-30T06:42:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaf5c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf00cd280 con 0x7ffaf0161fa0 2024-05-30T06:42:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf0162380 0x7ffaf00cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf0162380 0x7ffaf00cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45852/0 (socket says 172.21.15.37:45852) 2024-05-30T06:42:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffae7e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaf0161fa0 0x7ffaf00b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaef400640 1 -- 172.21.15.37:0/4292799799 learned_addr learned my addr 172.21.15.37:0/4292799799 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaeea00640 1 --2- 172.21.15.37:0/4292799799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffaf00b3b50 0x7ffaf0153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:35.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaef400640 1 -- 172.21.15.37:0/4292799799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaf0161fa0 msgr2=0x7ffaf00b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaef400640 1 --2- 172.21.15.37:0/4292799799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaf0161fa0 0x7ffaf00b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaef400640 1 -- 172.21.15.37:0/4292799799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffaf00b3b50 msgr2=0x7ffaf0153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaef400640 1 --2- 172.21.15.37:0/4292799799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffaf00b3b50 0x7ffaf0153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaef400640 1 -- 172.21.15.37:0/4292799799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf0159780 con 0x7ffaf0162380 2024-05-30T06:42:35.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaef400640 1 --2- 172.21.15.37:0/4292799799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf0162380 0x7ffaf00cb980 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffae80b2040 tx=0x7ffae801bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:35.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffae6a00640 1 -- 172.21.15.37:0/4292799799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae80c0070 con 0x7ffaf0162380 2024-05-30T06:42:35.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffae6a00640 1 -- 172.21.15.37:0/4292799799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffae80afbb0 con 0x7ffaf0162380 2024-05-30T06:42:35.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffae6a00640 1 -- 172.21.15.37:0/4292799799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae80b4040 con 0x7ffaf0162380 2024-05-30T06:42:35.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.411+0000 7ffaf5c00640 1 -- 172.21.15.37:0/4292799799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf0159a60 con 0x7ffaf0162380 2024-05-30T06:42:35.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.415+0000 7ffaf5c00640 1 -- 172.21.15.37:0/4292799799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf015a020 con 0x7ffaf0162380 2024-05-30T06:42:35.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.415+0000 7ffaf5c00640 1 -- 172.21.15.37:0/4292799799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf0069570 con 0x7ffaf0162380 2024-05-30T06:42:35.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.415+0000 7ffae6a00640 1 -- 172.21.15.37:0/4292799799 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffae80b8430 con 0x7ffaf0162380 2024-05-30T06:42:35.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.415+0000 7ffae6a00640 1 --2- 172.21.15.37:0/4292799799 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffacc068380 0x7ffacc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:35.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.415+0000 7ffae6a00640 1 -- 172.21.15.37:0/4292799799 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffae8123f20 con 0x7ffaf0162380 2024-05-30T06:42:35.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.415+0000 7ffaeea00640 1 --2- 172.21.15.37:0/4292799799 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffacc068380 0x7ffacc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:35.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.415+0000 7ffaeea00640 1 --2- 172.21.15.37:0/4292799799 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffacc068380 0x7ffacc06a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00b6a80 tx=0x7ffae0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:35.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.419+0000 7ffae6a00640 1 -- 172.21.15.37:0/4292799799 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffae8018d40 con 0x7ffaf0162380 2024-05-30T06:42:35.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.591+0000 7ffaf5c00640 1 -- 172.21.15.37:0/4292799799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffaf009be60 con 0x7ffaf0162380 2024-05-30T06:42:35.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.591+0000 7ffae6a00640 1 -- 172.21.15.37:0/4292799799 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7ffae80f3e80 con 0x7ffaf0162380 2024-05-30T06:42:35.591 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:35.591 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.591+0000 7ffaf5c00640 1 -- 172.21.15.37:0/4292799799 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffacc068380 msgr2=0x7ffacc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.591+0000 7ffaf5c00640 1 --2- 172.21.15.37:0/4292799799 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffacc068380 0x7ffacc06a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00b6a80 tx=0x7ffae0009190 comp rx=0 tx=0).stop 2024-05-30T06:42:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.591+0000 7ffaf5c00640 1 -- 172.21.15.37:0/4292799799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf0162380 msgr2=0x7ffaf00cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.591+0000 7ffaf5c00640 1 --2- 172.21.15.37:0/4292799799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf0162380 0x7ffaf00cb980 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffae80b2040 tx=0x7ffae801bf80 comp rx=0 tx=0).stop 2024-05-30T06:42:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.595+0000 7ffaf5c00640 1 -- 172.21.15.37:0/4292799799 shutdown_connections 2024-05-30T06:42:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.595+0000 7ffaf5c00640 1 --2- 172.21.15.37:0/4292799799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffaf0162380 0x7ffaf00cb980 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.595+0000 7ffaf5c00640 1 --2- 172.21.15.37:0/4292799799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaf0161fa0 0x7ffaf00b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.595+0000 7ffaf5c00640 1 --2- 172.21.15.37:0/4292799799 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffacc068380 0x7ffacc06a840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.595+0000 7ffaf5c00640 1 --2- 172.21.15.37:0/4292799799 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffaf00b3b50 0x7ffaf0153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.595+0000 7ffaf5c00640 1 -- 172.21.15.37:0/4292799799 >> 172.21.15.37:0/4292799799 conn(0x7ffaf00b4160 msgr2=0x7ffaf00d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:35.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.595+0000 7ffaf5c00640 1 -- 172.21.15.37:0/4292799799 shutdown_connections 2024-05-30T06:42:35.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.595+0000 7ffaf5c00640 1 -- 172.21.15.37:0/4292799799 wait complete. 2024-05-30T06:42:35.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:42:09.128133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:42:09.755772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:35.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:35.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.755+0000 7ff996a00640 1 Processor -- start 2024-05-30T06:42:35.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff996a00640 1 -- start start 2024-05-30T06:42:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff996a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff9900cd440 0x7ff99006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff996a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99006f5a0 0x7ff9900b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff996a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99015f310 con 0x7ff990155da0 2024-05-30T06:42:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff996a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff99015f5f0 con 0x7ff9900cd440 2024-05-30T06:42:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff996a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff99015f8d0 con 0x7ff99006f5a0 2024-05-30T06:42:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff98fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff990155da0 0x7ff9900cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51608/0 (socket says 172.21.15.37:51608) 2024-05-30T06:42:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff98fe00640 1 -- 172.21.15.37:0/2488626643 learned_addr learned my addr 172.21.15.37:0/2488626643 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff987400640 1 --2- 172.21.15.37:0/2488626643 >> v2:172.21.15.105:3300/0 conn(0x7ff9900cd440 0x7ff99006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff994a00640 1 --2- 172.21.15.37:0/2488626643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99006f5a0 0x7ff9900b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff98f400640 1 -- 172.21.15.37:0/2488626643 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152667983 0 0) 0x7ff99015f310 con 0x7ff990155da0 2024-05-30T06:42:35.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff98f400640 1 -- 172.21.15.37:0/2488626643 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff974003530 con 0x7ff990155da0 2024-05-30T06:42:35.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff994a00640 1 -- 172.21.15.37:0/2488626643 >> v2:172.21.15.105:3300/0 conn(0x7ff9900cd440 msgr2=0x7ff99006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:35.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff994a00640 1 --2- 172.21.15.37:0/2488626643 >> v2:172.21.15.105:3300/0 conn(0x7ff9900cd440 0x7ff99006f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff994a00640 1 -- 172.21.15.37:0/2488626643 >> v1:172.21.15.37:6789/0 conn(0x7ff990155da0 legacy=0x7ff9900cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:35.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff98f400640 1 -- 172.21.15.37:0/2488626643 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2618989496 0 0) 0x7ff974003530 con 0x7ff990155da0 2024-05-30T06:42:35.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.759+0000 7ff994a00640 1 -- 172.21.15.37:0/2488626643 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99015fbb0 con 0x7ff99006f5a0 2024-05-30T06:42:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff994a00640 1 --2- 172.21.15.37:0/2488626643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99006f5a0 0x7ff9900b3750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff988009d90 tx=0x7ff98801c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89809e0c90106db3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff98f400640 1 -- 172.21.15.37:0/2488626643 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9880ac070 con 0x7ff99006f5a0 2024-05-30T06:42:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff98f400640 1 -- 172.21.15.37:0/2488626643 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9880a6490 con 0x7ff99006f5a0 2024-05-30T06:42:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff98f400640 1 -- 172.21.15.37:0/2488626643 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980001680 con 0x7ff99006f5a0 2024-05-30T06:42:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff996a00640 1 -- 172.21.15.37:0/2488626643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99006f5a0 msgr2=0x7ff9900b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff996a00640 1 --2- 172.21.15.37:0/2488626643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99006f5a0 0x7ff9900b3750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff988009d90 tx=0x7ff98801c770 comp rx=0 tx=0).stop 2024-05-30T06:42:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff996a00640 1 -- 172.21.15.37:0/2488626643 shutdown_connections 2024-05-30T06:42:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff996a00640 1 --2- 172.21.15.37:0/2488626643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99006f5a0 0x7ff9900b3750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff996a00640 1 --2- 172.21.15.37:0/2488626643 >> v2:172.21.15.105:3300/0 conn(0x7ff9900cd440 0x7ff99006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff996a00640 1 -- 172.21.15.37:0/2488626643 >> 172.21.15.37:0/2488626643 conn(0x7ff99006bf60 msgr2=0x7ff9900b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff996a00640 1 -- 172.21.15.37:0/2488626643 shutdown_connections 2024-05-30T06:42:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff996a00640 1 -- 172.21.15.37:0/2488626643 wait complete. 2024-05-30T06:42:35.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff996a00640 1 Processor -- start 2024-05-30T06:42:35.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.763+0000 7ff996a00640 1 -- start start 2024-05-30T06:42:35.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff996a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99006f5a0 0x7ff99015d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:35.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff996a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff990155da0 0x7ff99015ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:35.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff996a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff99014f970 0x7ff9901586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:35.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff996a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff990166570 con 0x7ff990155da0 2024-05-30T06:42:35.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff996a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff9900b46b0 con 0x7ff99014f970 2024-05-30T06:42:35.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff996a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff9901666f0 con 0x7ff99006f5a0 2024-05-30T06:42:35.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff987400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff990155da0 0x7ff99015ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:35.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff987400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff990155da0 0x7ff99015ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45868/0 (socket says 172.21.15.37:45868) 2024-05-30T06:42:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff987400640 1 -- 172.21.15.37:0/826217798 learned_addr learned my addr 172.21.15.37:0/826217798 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff98fe00640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99006f5a0 0x7ff99015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff994a00640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff99014f970 0x7ff9901586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff987400640 1 -- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99006f5a0 msgr2=0x7ff99015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff987400640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99006f5a0 0x7ff99015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff987400640 1 -- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff99014f970 msgr2=0x7ff9901586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff987400640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff99014f970 0x7ff9901586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff987400640 1 -- 172.21.15.37:0/826217798 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9901595e0 con 0x7ff990155da0 2024-05-30T06:42:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff987400640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff990155da0 0x7ff99015ba70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff97800e960 tx=0x7ff97800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff98cc00640 1 -- 172.21.15.37:0/826217798 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978017070 con 0x7ff990155da0 2024-05-30T06:42:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff98cc00640 1 -- 172.21.15.37:0/826217798 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97800ca00 con 0x7ff990155da0 2024-05-30T06:42:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff98cc00640 1 -- 172.21.15.37:0/826217798 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97800cdb0 con 0x7ff990155da0 2024-05-30T06:42:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff996a00640 1 -- 172.21.15.37:0/826217798 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff990152b30 con 0x7ff990155da0 2024-05-30T06:42:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff996a00640 1 -- 172.21.15.37:0/826217798 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff990152da0 con 0x7ff990155da0 2024-05-30T06:42:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.767+0000 7ff996a00640 1 -- 172.21.15.37:0/826217798 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff990068bc0 con 0x7ff990155da0 2024-05-30T06:42:35.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.771+0000 7ff98cc00640 1 -- 172.21.15.37:0/826217798 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff97801a070 con 0x7ff990155da0 2024-05-30T06:42:35.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.771+0000 7ff98cc00640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff96c068380 0x7ff96c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:35.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.771+0000 7ff98cc00640 1 -- 172.21.15.37:0/826217798 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff978086920 con 0x7ff990155da0 2024-05-30T06:42:35.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.771+0000 7ff98fe00640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff96c068380 0x7ff96c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:35.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.771+0000 7ff98fe00640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff96c068380 0x7ff96c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff980001330 tx=0x7ff9800012c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:35.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.775+0000 7ff98cc00640 1 -- 172.21.15.37:0/826217798 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff978056880 con 0x7ff990155da0 2024-05-30T06:42:35.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff996a00640 1 -- 172.21.15.37:0/826217798 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff9900b6790 con 0x7ff990155da0 2024-05-30T06:42:35.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff98cc00640 1 -- 172.21.15.37:0/826217798 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7ff97805ab80 con 0x7ff990155da0 2024-05-30T06:42:35.942 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:35.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff996a00640 1 -- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff96c068380 msgr2=0x7ff96c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:35.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff996a00640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff96c068380 0x7ff96c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff980001330 tx=0x7ff9800012c0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff996a00640 1 -- 172.21.15.37:0/826217798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff990155da0 msgr2=0x7ff99015ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:35.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff996a00640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff990155da0 0x7ff99015ba70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff97800e960 tx=0x7ff97800ee20 comp rx=0 tx=0).stop 2024-05-30T06:42:35.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff996a00640 1 -- 172.21.15.37:0/826217798 shutdown_connections 2024-05-30T06:42:35.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff996a00640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff96c068380 0x7ff96c06a840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff996a00640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff99014f970 0x7ff9901586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff996a00640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff990155da0 0x7ff99015ba70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff996a00640 1 --2- 172.21.15.37:0/826217798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff99006f5a0 0x7ff99015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:35.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff996a00640 1 -- 172.21.15.37:0/826217798 >> 172.21.15.37:0/826217798 conn(0x7ff99006bf60 msgr2=0x7ff990159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:35.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff996a00640 1 -- 172.21.15.37:0/826217798 shutdown_connections 2024-05-30T06:42:35.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:35.943+0000 7ff996a00640 1 -- 172.21.15.37:0/826217798 wait complete. 2024-05-30T06:42:35.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:42:36.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f179d400640 1 Processor -- start 2024-05-30T06:42:36.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f179d400640 1 -- start start 2024-05-30T06:42:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f179d400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17980b59d0 0x7f17980b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f179d400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17981610a0 con 0x7f179815d350 2024-05-30T06:42:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f179d400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17980b62f0 con 0x7f179815d7b0 2024-05-30T06:42:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f179d400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1798142030 con 0x7f17980b59d0 2024-05-30T06:42:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f178de00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f179815d350 0x7f1798160280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51610/0 (socket says 172.21.15.37:51610) 2024-05-30T06:42:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f178de00640 1 -- 172.21.15.37:0/1140334437 learned_addr learned my addr 172.21.15.37:0/1140334437 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f1796800640 1 --2- 172.21.15.37:0/1140334437 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17980b59d0 0x7f17980b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f1795e00640 1 -- 172.21.15.37:0/1140334437 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2770788476 0 0) 0x7f17981610a0 con 0x7f179815d350 2024-05-30T06:42:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f1795e00640 1 -- 172.21.15.37:0/1140334437 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f177c003530 con 0x7f179815d350 2024-05-30T06:42:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f1796800640 1 -- 172.21.15.37:0/1140334437 >> v1:172.21.15.105:6789/0 conn(0x7f179815d7b0 legacy=0x7f1798160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f1795e00640 1 -- 172.21.15.37:0/1140334437 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288630487 0 0) 0x7f17980b62f0 con 0x7f179815d7b0 2024-05-30T06:42:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f1796800640 1 -- 172.21.15.37:0/1140334437 >> v1:172.21.15.37:6789/0 conn(0x7f179815d350 legacy=0x7f1798160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.107+0000 7f1796800640 1 -- 172.21.15.37:0/1140334437 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1798142310 con 0x7f17980b59d0 2024-05-30T06:42:36.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.111+0000 7f1796800640 1 --2- 172.21.15.37:0/1140334437 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17980b59d0 0x7f17980b5db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17880097f0 tx=0x7f178801ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4005adc56991d59 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:36.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.111+0000 7f1795e00640 1 -- 172.21.15.37:0/1140334437 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17880b5070 con 0x7f17980b59d0 2024-05-30T06:42:36.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.111+0000 7f1795e00640 1 -- 172.21.15.37:0/1140334437 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17880a89d0 con 0x7f17980b59d0 2024-05-30T06:42:36.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.111+0000 7f1795e00640 1 -- 172.21.15.37:0/1140334437 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17880a8da0 con 0x7f17980b59d0 2024-05-30T06:42:36.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.111+0000 7f179d400640 1 -- 172.21.15.37:0/1140334437 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17980b59d0 msgr2=0x7f17980b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.111+0000 7f179d400640 1 --2- 172.21.15.37:0/1140334437 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17980b59d0 0x7f17980b5db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f17880097f0 tx=0x7f178801ecd0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.111+0000 7f179d400640 1 -- 172.21.15.37:0/1140334437 shutdown_connections 2024-05-30T06:42:36.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.111+0000 7f179d400640 1 --2- 172.21.15.37:0/1140334437 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17980b59d0 0x7f17980b5db0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.111+0000 7f179d400640 1 -- 172.21.15.37:0/1140334437 >> 172.21.15.37:0/1140334437 conn(0x7f179806bf60 msgr2=0x7f17980b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:36.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.111+0000 7f179d400640 1 -- 172.21.15.37:0/1140334437 shutdown_connections 2024-05-30T06:42:36.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.111+0000 7f179d400640 1 -- 172.21.15.37:0/1140334437 wait complete. 2024-05-30T06:42:36.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f179d400640 1 Processor -- start 2024-05-30T06:42:36.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f179d400640 1 -- start start 2024-05-30T06:42:36.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f179d400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17980b59d0 0x7f17980b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f179d400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179815d350 0x7f17980b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f179d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179815d7b0 0x7f1798159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f179d400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f179813fce0 con 0x7f179815d7b0 2024-05-30T06:42:36.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f179d400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f17981428d0 con 0x7f179815d350 2024-05-30T06:42:36.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f179d400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f179813fe60 con 0x7f17980b59d0 2024-05-30T06:42:36.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f1797200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179815d7b0 0x7f1798159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f1797200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179815d7b0 0x7f1798159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45876/0 (socket says 172.21.15.37:45876) 2024-05-30T06:42:36.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f1797200640 1 -- 172.21.15.37:0/361348865 learned_addr learned my addr 172.21.15.37:0/361348865 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:36.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f178de00640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179815d350 0x7f17980b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f1796800640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17980b59d0 0x7f17980b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f1797200640 1 -- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17980b59d0 msgr2=0x7f17980b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f1797200640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17980b59d0 0x7f17980b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f1797200640 1 -- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179815d350 msgr2=0x7f17980b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f1797200640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179815d350 0x7f17980b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f1797200640 1 -- 172.21.15.37:0/361348865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17980b0490 con 0x7f179815d7b0 2024-05-30T06:42:36.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f1797200640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179815d7b0 0x7f1798159a60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f179000c7b0 tx=0x7f179000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:36.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f178f400640 1 -- 172.21.15.37:0/361348865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179000ce60 con 0x7f179815d7b0 2024-05-30T06:42:36.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f178f400640 1 -- 172.21.15.37:0/361348865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1790003db0 con 0x7f179815d7b0 2024-05-30T06:42:36.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f179d400640 1 -- 172.21.15.37:0/361348865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17980b0770 con 0x7f179815d7b0 2024-05-30T06:42:36.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f178f400640 1 -- 172.21.15.37:0/361348865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17900052b0 con 0x7f179815d7b0 2024-05-30T06:42:36.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f179d400640 1 -- 172.21.15.37:0/361348865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17980b1010 con 0x7f179815d7b0 2024-05-30T06:42:36.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.115+0000 7f179d400640 1 -- 172.21.15.37:0/361348865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1798068bc0 con 0x7f179815d7b0 2024-05-30T06:42:36.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.119+0000 7f178f400640 1 -- 172.21.15.37:0/361348865 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1790005450 con 0x7f179815d7b0 2024-05-30T06:42:36.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.119+0000 7f178f400640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1774068380 0x7f177406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.119+0000 7f178f400640 1 -- 172.21.15.37:0/361348865 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1790086800 con 0x7f179815d7b0 2024-05-30T06:42:36.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.119+0000 7f1796800640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1774068380 0x7f177406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.119+0000 7f1796800640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1774068380 0x7f177406a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f17880b2000 tx=0x7f1788008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:36.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.123+0000 7f178f400640 1 -- 172.21.15.37:0/361348865 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f17900566d0 con 0x7f179815d7b0 2024-05-30T06:42:36.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.287+0000 7f179d400640 1 -- 172.21.15.37:0/361348865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f179806f0a0 con 0x7f179815d7b0 2024-05-30T06:42:36.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.287+0000 7f178f400640 1 -- 172.21.15.37:0/361348865 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f179005a9d0 con 0x7f179815d7b0 2024-05-30T06:42:36.287 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:42:36.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.291+0000 7f179d400640 1 -- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1774068380 msgr2=0x7f177406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.291+0000 7f179d400640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1774068380 0x7f177406a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f17880b2000 tx=0x7f1788008040 comp rx=0 tx=0).stop 2024-05-30T06:42:36.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.291+0000 7f179d400640 1 -- 172.21.15.37:0/361348865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179815d7b0 msgr2=0x7f1798159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.291+0000 7f179d400640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179815d7b0 0x7f1798159a60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f179000c7b0 tx=0x7f179000cc70 comp rx=0 tx=0).stop 2024-05-30T06:42:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.291+0000 7f179d400640 1 -- 172.21.15.37:0/361348865 shutdown_connections 2024-05-30T06:42:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.291+0000 7f179d400640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179815d7b0 0x7f1798159a60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.291+0000 7f179d400640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1774068380 0x7f177406a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.291+0000 7f179d400640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f179815d350 0x7f17980b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.291+0000 7f179d400640 1 --2- 172.21.15.37:0/361348865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17980b59d0 0x7f17980b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.291+0000 7f179d400640 1 -- 172.21.15.37:0/361348865 >> 172.21.15.37:0/361348865 conn(0x7f179806bf60 msgr2=0x7f179813e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.291+0000 7f179d400640 1 -- 172.21.15.37:0/361348865 shutdown_connections 2024-05-30T06:42:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.291+0000 7f179d400640 1 -- 172.21.15.37:0/361348865 wait complete. 2024-05-30T06:42:36.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:42:36.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.451+0000 7fefa6e00640 1 Processor -- start 2024-05-30T06:42:36.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.451+0000 7fefa6e00640 1 -- start start 2024-05-30T06:42:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.451+0000 7fefa6e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fefa00b59d0 0x7fefa00b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.451+0000 7fefa6e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fefa015d350 0x7fefa0160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.451+0000 7fefa6e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa00b62f0 con 0x7fefa015d7e0 2024-05-30T06:42:36.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.451+0000 7fefa6e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fefa0142030 con 0x7fefa015d350 2024-05-30T06:42:36.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.451+0000 7fefa6e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fefa0142310 con 0x7fefa00b59d0 2024-05-30T06:42:36.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.451+0000 7fef97400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fefa015d350 0x7fefa0160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.455+0000 7fefa4e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fefa015d7e0 0x7fefa01607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51620/0 (socket says 172.21.15.37:51620) 2024-05-30T06:42:36.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.455+0000 7fefa4e00640 1 -- 172.21.15.37:0/1340906942 learned_addr learned my addr 172.21.15.37:0/1340906942 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:36.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.455+0000 7fef9fe00640 1 --2- 172.21.15.37:0/1340906942 >> v2:172.21.15.105:3300/0 conn(0x7fefa00b59d0 0x7fefa00b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.455+0000 7fef97400640 1 -- 172.21.15.37:0/1340906942 >> v2:172.21.15.105:3300/0 conn(0x7fefa00b59d0 msgr2=0x7fefa00b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:36.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.455+0000 7fef97400640 1 --2- 172.21.15.37:0/1340906942 >> v2:172.21.15.105:3300/0 conn(0x7fefa00b59d0 0x7fefa00b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.455+0000 7fef97400640 1 -- 172.21.15.37:0/1340906942 >> v1:172.21.15.37:6789/0 conn(0x7fefa015d7e0 legacy=0x7fefa01607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.455+0000 7fef97400640 1 -- 172.21.15.37:0/1340906942 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa01425f0 con 0x7fefa015d350 2024-05-30T06:42:36.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.455+0000 7fef9f400640 1 -- 172.21.15.37:0/1340906942 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051996350 0 0) 0x7fefa00b62f0 con 0x7fefa015d7e0 2024-05-30T06:42:36.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.455+0000 7fef97400640 1 --2- 172.21.15.37:0/1340906942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa015d350 0x7fefa0160280 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef880097c0 tx=0x7fef8801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33007572fa3c83db server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:36.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.455+0000 7fef9f400640 1 -- 172.21.15.37:0/1340906942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef880b5070 con 0x7fefa015d350 2024-05-30T06:42:36.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.455+0000 7fef9f400640 1 -- 172.21.15.37:0/1340906942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef880a8950 con 0x7fefa015d350 2024-05-30T06:42:36.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.455+0000 7fef9f400640 1 -- 172.21.15.37:0/1340906942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef880a8d20 con 0x7fefa015d350 2024-05-30T06:42:36.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 -- 172.21.15.37:0/1340906942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa015d350 msgr2=0x7fefa0160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 --2- 172.21.15.37:0/1340906942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa015d350 0x7fefa0160280 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef880097c0 tx=0x7fef8801ec50 comp rx=0 tx=0).stop 2024-05-30T06:42:36.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 -- 172.21.15.37:0/1340906942 shutdown_connections 2024-05-30T06:42:36.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 --2- 172.21.15.37:0/1340906942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa015d350 0x7fefa0160280 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 --2- 172.21.15.37:0/1340906942 >> v2:172.21.15.105:3300/0 conn(0x7fefa00b59d0 0x7fefa00b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 -- 172.21.15.37:0/1340906942 >> 172.21.15.37:0/1340906942 conn(0x7fefa006bf60 msgr2=0x7fefa00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:36.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 -- 172.21.15.37:0/1340906942 shutdown_connections 2024-05-30T06:42:36.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 -- 172.21.15.37:0/1340906942 wait complete. 2024-05-30T06:42:36.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 Processor -- start 2024-05-30T06:42:36.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 -- start start 2024-05-30T06:42:36.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefa00b59d0 0x7fefa0137f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa015d350 0x7fefa0158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fefa015d7e0 0x7fefa015ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fefa013fe60 con 0x7fefa015d350 2024-05-30T06:42:36.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fefa013fce0 con 0x7fefa015d7e0 2024-05-30T06:42:36.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa6e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fefa00aff20 con 0x7fefa00b59d0 2024-05-30T06:42:36.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fef97400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa015d350 0x7fefa0158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fef97400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa015d350 0x7fefa0158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45890/0 (socket says 172.21.15.37:45890) 2024-05-30T06:42:36.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fef97400640 1 -- 172.21.15.37:0/2454614258 learned_addr learned my addr 172.21.15.37:0/2454614258 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:36.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fef9fe00640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefa00b59d0 0x7fefa0137f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fefa4e00640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fefa015d7e0 0x7fefa015ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fef97400640 1 -- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefa00b59d0 msgr2=0x7fefa0137f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fef97400640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefa00b59d0 0x7fefa0137f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fef97400640 1 -- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fefa015d7e0 msgr2=0x7fefa015ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fef97400640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fefa015d7e0 0x7fefa015ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fef97400640 1 -- 172.21.15.37:0/2454614258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa01568b0 con 0x7fefa015d350 2024-05-30T06:42:36.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fef9fe00640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefa00b59d0 0x7fefa0137f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:36.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.459+0000 7fef97400640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa015d350 0x7fefa0158100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fef880097c0 tx=0x7fef8801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:36.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.463+0000 7fef9cc00640 1 -- 172.21.15.37:0/2454614258 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef880bf070 con 0x7fefa015d350 2024-05-30T06:42:36.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.463+0000 7fefa6e00640 1 -- 172.21.15.37:0/2454614258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa0153f00 con 0x7fefa015d350 2024-05-30T06:42:36.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.463+0000 7fefa6e00640 1 -- 172.21.15.37:0/2454614258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa01544c0 con 0x7fefa015d350 2024-05-30T06:42:36.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.463+0000 7fef9cc00640 1 -- 172.21.15.37:0/2454614258 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef880b0800 con 0x7fefa015d350 2024-05-30T06:42:36.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.463+0000 7fef9cc00640 1 -- 172.21.15.37:0/2454614258 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef880b5040 con 0x7fefa015d350 2024-05-30T06:42:36.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.463+0000 7fefa6e00640 1 -- 172.21.15.37:0/2454614258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa0068bc0 con 0x7fefa015d350 2024-05-30T06:42:36.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.463+0000 7fef9cc00640 1 -- 172.21.15.37:0/2454614258 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fef880c2070 con 0x7fefa015d350 2024-05-30T06:42:36.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.463+0000 7fef9cc00640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef7c068380 0x7fef7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.463+0000 7fef9cc00640 1 -- 172.21.15.37:0/2454614258 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fef88123390 con 0x7fefa015d350 2024-05-30T06:42:36.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.463+0000 7fef9fe00640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef7c068380 0x7fef7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.467+0000 7fef9fe00640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef7c068380 0x7fef7c06a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fef90007a70 tx=0x7fef90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:36.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.467+0000 7fef9cc00640 1 -- 172.21.15.37:0/2454614258 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fef880187b0 con 0x7fefa015d350 2024-05-30T06:42:36.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.631+0000 7fefa6e00640 1 -- 172.21.15.37:0/2454614258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fefa00b5eb0 con 0x7fefa015d350 2024-05-30T06:42:36.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.631+0000 7fef9cc00640 1 -- 172.21.15.37:0/2454614258 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fef880f3270 con 0x7fefa015d350 2024-05-30T06:42:36.633 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:42:36.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.635+0000 7fefa6e00640 1 -- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef7c068380 msgr2=0x7fef7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.635+0000 7fefa6e00640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef7c068380 0x7fef7c06a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fef90007a70 tx=0x7fef90008040 comp rx=0 tx=0).stop 2024-05-30T06:42:36.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.635+0000 7fefa6e00640 1 -- 172.21.15.37:0/2454614258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa015d350 msgr2=0x7fefa0158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.635+0000 7fefa6e00640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa015d350 0x7fefa0158100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fef880097c0 tx=0x7fef8801b9f0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.635+0000 7fefa6e00640 1 -- 172.21.15.37:0/2454614258 shutdown_connections 2024-05-30T06:42:36.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.635+0000 7fefa6e00640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef7c068380 0x7fef7c06a840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.635+0000 7fefa6e00640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fefa015d7e0 0x7fefa015ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.635+0000 7fefa6e00640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa015d350 0x7fefa0158100 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.635+0000 7fefa6e00640 1 --2- 172.21.15.37:0/2454614258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fefa00b59d0 0x7fefa0137f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.635+0000 7fefa6e00640 1 -- 172.21.15.37:0/2454614258 >> 172.21.15.37:0/2454614258 conn(0x7fefa006bf60 msgr2=0x7fefa006df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:36.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.635+0000 7fefa6e00640 1 -- 172.21.15.37:0/2454614258 shutdown_connections 2024-05-30T06:42:36.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.635+0000 7fefa6e00640 1 -- 172.21.15.37:0/2454614258 wait complete. 2024-05-30T06:42:36.655 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:36.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.795+0000 7fcb04c00640 1 Processor -- start 2024-05-30T06:42:36.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.795+0000 7fcb04c00640 1 -- start start 2024-05-30T06:42:36.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcb04c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb0015c9a0 0x7fcb0009b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcb04c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb000ce440 con 0x7fcb0009aa60 2024-05-30T06:42:36.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcb04c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb000d1400 con 0x7fcb000cdba0 2024-05-30T06:42:36.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcb04c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcb000ce160 con 0x7fcb0015c9a0 2024-05-30T06:42:36.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcafe800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcb0009aa60 0x7fcb000b1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51634/0 (socket says 172.21.15.37:51634) 2024-05-30T06:42:36.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcafde00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb0015c9a0 0x7fcb0009b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcafe800640 1 -- 172.21.15.37:0/2932691441 learned_addr learned my addr 172.21.15.37:0/2932691441 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:36.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcafd400640 1 -- 172.21.15.37:0/2932691441 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 552054688 0 0) 0x7fcb000ce440 con 0x7fcb0009aa60 2024-05-30T06:42:36.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcafd400640 1 -- 172.21.15.37:0/2932691441 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcae4003530 con 0x7fcb0009aa60 2024-05-30T06:42:36.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcafde00640 1 -- 172.21.15.37:0/2932691441 >> v1:172.21.15.105:6789/0 conn(0x7fcb000cdba0 legacy=0x7fcb000d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcafde00640 1 -- 172.21.15.37:0/2932691441 >> v1:172.21.15.37:6789/0 conn(0x7fcb0009aa60 legacy=0x7fcb000b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcafde00640 1 -- 172.21.15.37:0/2932691441 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb000d0210 con 0x7fcb0015c9a0 2024-05-30T06:42:36.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcafde00640 1 --2- 172.21.15.37:0/2932691441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb0015c9a0 0x7fcb0009b6d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00097f0 tx=0x7fcaf001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20938271e6646e05 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:36.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcafd400640 1 -- 172.21.15.37:0/2932691441 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00b0070 con 0x7fcb0015c9a0 2024-05-30T06:42:36.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcafd400640 1 -- 172.21.15.37:0/2932691441 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf00ab600 con 0x7fcb0015c9a0 2024-05-30T06:42:36.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.799+0000 7fcafd400640 1 -- 172.21.15.37:0/2932691441 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf00ab9d0 con 0x7fcb0015c9a0 2024-05-30T06:42:36.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 -- 172.21.15.37:0/2932691441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb0015c9a0 msgr2=0x7fcb0009b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 --2- 172.21.15.37:0/2932691441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb0015c9a0 0x7fcb0009b6d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00097f0 tx=0x7fcaf001c3e0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 -- 172.21.15.37:0/2932691441 shutdown_connections 2024-05-30T06:42:36.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 --2- 172.21.15.37:0/2932691441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb0015c9a0 0x7fcb0009b6d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 -- 172.21.15.37:0/2932691441 >> 172.21.15.37:0/2932691441 conn(0x7fcb000b4090 msgr2=0x7fcb000b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:36.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 -- 172.21.15.37:0/2932691441 shutdown_connections 2024-05-30T06:42:36.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 -- 172.21.15.37:0/2932691441 wait complete. 2024-05-30T06:42:36.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 Processor -- start 2024-05-30T06:42:36.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 -- start start 2024-05-30T06:42:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb0009aa60 0x7fcb00155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb000cdba0 0x7fcb0014d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb0015c9a0 0x7fcb000c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0009b280 con 0x7fcb0015c9a0 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0016aef0 con 0x7fcb0009aa60 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcb04c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcb000c6490 con 0x7fcb000cdba0 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcafe800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb0015c9a0 0x7fcb000c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcafe800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb0015c9a0 0x7fcb000c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45906/0 (socket says 172.21.15.37:45906) 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcafe800640 1 -- 172.21.15.37:0/1806767005 learned_addr learned my addr 172.21.15.37:0/1806767005 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcafde00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb0009aa60 0x7fcb00155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcaf7e00640 1 --2- 172.21.15.37:0/1806767005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb000cdba0 0x7fcb0014d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcafe800640 1 -- 172.21.15.37:0/1806767005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb000cdba0 msgr2=0x7fcb0014d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcafe800640 1 --2- 172.21.15.37:0/1806767005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb000cdba0 0x7fcb0014d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcafe800640 1 -- 172.21.15.37:0/1806767005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb0009aa60 msgr2=0x7fcb00155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcafe800640 1 --2- 172.21.15.37:0/1806767005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb0009aa60 0x7fcb00155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.803+0000 7fcafe800640 1 -- 172.21.15.37:0/1806767005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb000c6770 con 0x7fcb0015c9a0 2024-05-30T06:42:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.807+0000 7fcafe800640 1 --2- 172.21.15.37:0/1806767005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb0015c9a0 0x7fcb000c83a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800caa0 tx=0x7fcaf800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:36.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.807+0000 7fcaf6000640 1 -- 172.21.15.37:0/1806767005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8017070 con 0x7fcb0015c9a0 2024-05-30T06:42:36.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.807+0000 7fcaf6000640 1 -- 172.21.15.37:0/1806767005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf800ac00 con 0x7fcb0015c9a0 2024-05-30T06:42:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.807+0000 7fcaf6000640 1 -- 172.21.15.37:0/1806767005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8012400 con 0x7fcb0015c9a0 2024-05-30T06:42:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.807+0000 7fcb04c00640 1 -- 172.21.15.37:0/1806767005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb000c6a50 con 0x7fcb0015c9a0 2024-05-30T06:42:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.807+0000 7fcb04c00640 1 -- 172.21.15.37:0/1806767005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb000c60d0 con 0x7fcb0015c9a0 2024-05-30T06:42:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.807+0000 7fcb04c00640 1 -- 172.21.15.37:0/1806767005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb00068b20 con 0x7fcb0015c9a0 2024-05-30T06:42:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.807+0000 7fcaf6000640 1 -- 172.21.15.37:0/1806767005 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcaf801a070 con 0x7fcb0015c9a0 2024-05-30T06:42:36.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.807+0000 7fcaf6000640 1 --2- 172.21.15.37:0/1806767005 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcadc068380 0x7fcadc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:36.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.807+0000 7fcaf6000640 1 -- 172.21.15.37:0/1806767005 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcaf8086730 con 0x7fcb0015c9a0 2024-05-30T06:42:36.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.807+0000 7fcafde00640 1 --2- 172.21.15.37:0/1806767005 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcadc068380 0x7fcadc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:36.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.811+0000 7fcafde00640 1 --2- 172.21.15.37:0/1806767005 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcadc068380 0x7fcadc06a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00ad000 tx=0x7fcaf0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:36.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.811+0000 7fcaf6000640 1 -- 172.21.15.37:0/1806767005 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcaf8056600 con 0x7fcb0015c9a0 2024-05-30T06:42:36.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.975+0000 7fcb04c00640 1 -- 172.21.15.37:0/1806767005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb000c71e0 con 0x7fcb0015c9a0 2024-05-30T06:42:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.979+0000 7fcaf6000640 1 -- 172.21.15.37:0/1806767005 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7fcaf805a900 con 0x7fcb0015c9a0 2024-05-30T06:42:36.978 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:36.978 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.979+0000 7fcb04c00640 1 -- 172.21.15.37:0/1806767005 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcadc068380 msgr2=0x7fcadc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.979+0000 7fcb04c00640 1 --2- 172.21.15.37:0/1806767005 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcadc068380 0x7fcadc06a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00ad000 tx=0x7fcaf0008040 comp rx=0 tx=0).stop 2024-05-30T06:42:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.979+0000 7fcb04c00640 1 -- 172.21.15.37:0/1806767005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb0015c9a0 msgr2=0x7fcb000c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.979+0000 7fcb04c00640 1 --2- 172.21.15.37:0/1806767005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb0015c9a0 0x7fcb000c83a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800caa0 tx=0x7fcaf800cf60 comp rx=0 tx=0).stop 2024-05-30T06:42:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.979+0000 7fcb04c00640 1 -- 172.21.15.37:0/1806767005 shutdown_connections 2024-05-30T06:42:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.979+0000 7fcb04c00640 1 --2- 172.21.15.37:0/1806767005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb0015c9a0 0x7fcb000c83a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.979+0000 7fcb04c00640 1 --2- 172.21.15.37:0/1806767005 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb000cdba0 0x7fcb0014d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.979+0000 7fcb04c00640 1 --2- 172.21.15.37:0/1806767005 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcadc068380 0x7fcadc06a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.979+0000 7fcb04c00640 1 --2- 172.21.15.37:0/1806767005 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb0009aa60 0x7fcb00155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.979+0000 7fcb04c00640 1 -- 172.21.15.37:0/1806767005 >> 172.21.15.37:0/1806767005 conn(0x7fcb000b4090 msgr2=0x7fcb00074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.979+0000 7fcb04c00640 1 -- 172.21.15.37:0/1806767005 shutdown_connections 2024-05-30T06:42:36.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:36.979+0000 7fcb04c00640 1 -- 172.21.15.37:0/1806767005 wait complete. 2024-05-30T06:42:36.999 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:42:09.128133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:42:09.755772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:37.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:37.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.143+0000 7fc496600640 1 Processor -- start 2024-05-30T06:42:37.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.143+0000 7fc496600640 1 -- start start 2024-05-30T06:42:37.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc496600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4900cd440 0x7fc49006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc496600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc49006f5a0 0x7fc4900b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc496600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc49015f310 con 0x7fc490155da0 2024-05-30T06:42:37.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc496600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc49015f5f0 con 0x7fc49006f5a0 2024-05-30T06:42:37.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc496600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc49015f8d0 con 0x7fc4900cd440 2024-05-30T06:42:37.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc48f400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc490155da0 0x7fc4900cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51644/0 (socket says 172.21.15.37:51644) 2024-05-30T06:42:37.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc48f400640 1 -- 172.21.15.37:0/3429744831 learned_addr learned my addr 172.21.15.37:0/3429744831 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:37.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc48fe00640 1 --2- 172.21.15.37:0/3429744831 >> v2:172.21.15.37:3300/0 conn(0x7fc49006f5a0 0x7fc4900b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc486a00640 1 --2- 172.21.15.37:0/3429744831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4900cd440 0x7fc49006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc48fe00640 1 -- 172.21.15.37:0/3429744831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4900cd440 msgr2=0x7fc49006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:37.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc48fe00640 1 --2- 172.21.15.37:0/3429744831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4900cd440 0x7fc49006f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc48fe00640 1 -- 172.21.15.37:0/3429744831 >> v1:172.21.15.37:6789/0 conn(0x7fc490155da0 legacy=0x7fc4900cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc48ea00640 1 -- 172.21.15.37:0/3429744831 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962062242 0 0) 0x7fc49015f310 con 0x7fc490155da0 2024-05-30T06:42:37.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.147+0000 7fc48fe00640 1 -- 172.21.15.37:0/3429744831 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49015fbb0 con 0x7fc49006f5a0 2024-05-30T06:42:37.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc48fe00640 1 --2- 172.21.15.37:0/3429744831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49006f5a0 0x7fc4900b3750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc4880097c0 tx=0x7fc48801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9aaf69e87a22723 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:37.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc48ea00640 1 -- 172.21.15.37:0/3429744831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4880b0070 con 0x7fc49006f5a0 2024-05-30T06:42:37.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc48ea00640 1 -- 172.21.15.37:0/3429744831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4880ab600 con 0x7fc49006f5a0 2024-05-30T06:42:37.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc48ea00640 1 -- 172.21.15.37:0/3429744831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4880ab9d0 con 0x7fc49006f5a0 2024-05-30T06:42:37.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 -- 172.21.15.37:0/3429744831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49006f5a0 msgr2=0x7fc4900b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 --2- 172.21.15.37:0/3429744831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49006f5a0 0x7fc4900b3750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc4880097c0 tx=0x7fc48801c380 comp rx=0 tx=0).stop 2024-05-30T06:42:37.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 -- 172.21.15.37:0/3429744831 shutdown_connections 2024-05-30T06:42:37.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 --2- 172.21.15.37:0/3429744831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49006f5a0 0x7fc4900b3750 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 --2- 172.21.15.37:0/3429744831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4900cd440 0x7fc49006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 -- 172.21.15.37:0/3429744831 >> 172.21.15.37:0/3429744831 conn(0x7fc49006bf60 msgr2=0x7fc4900b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:37.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 -- 172.21.15.37:0/3429744831 shutdown_connections 2024-05-30T06:42:37.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 -- 172.21.15.37:0/3429744831 wait complete. 2024-05-30T06:42:37.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 Processor -- start 2024-05-30T06:42:37.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 -- start start 2024-05-30T06:42:37.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49006f5a0 0x7fc49014a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc490155da0 0x7fc490150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc49015ae60 0x7fc49015b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc490168580 con 0x7fc49006f5a0 2024-05-30T06:42:37.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc4900b46b0 con 0x7fc49015ae60 2024-05-30T06:42:37.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc496600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc490168700 con 0x7fc490155da0 2024-05-30T06:42:37.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc48f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49006f5a0 0x7fc49014a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc48f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49006f5a0 0x7fc49014a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45924/0 (socket says 172.21.15.37:45924) 2024-05-30T06:42:37.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.151+0000 7fc48f400640 1 -- 172.21.15.37:0/2960089965 learned_addr learned my addr 172.21.15.37:0/2960089965 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:37.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc486a00640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc490155da0 0x7fc490150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc48fe00640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc49015ae60 0x7fc49015b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc48f400640 1 -- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc490155da0 msgr2=0x7fc490150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc48f400640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc490155da0 0x7fc490150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc48f400640 1 -- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc49015ae60 msgr2=0x7fc49015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc48f400640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc49015ae60 0x7fc49015b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc48f400640 1 -- 172.21.15.37:0/2960089965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49014f290 con 0x7fc49006f5a0 2024-05-30T06:42:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc48f400640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49006f5a0 0x7fc49014a910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc48000c7c0 tx=0x7fc48000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc487e00640 1 -- 172.21.15.37:0/2960089965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc480018070 con 0x7fc49006f5a0 2024-05-30T06:42:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc487e00640 1 -- 172.21.15.37:0/2960089965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc48000a640 con 0x7fc49006f5a0 2024-05-30T06:42:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc496600640 1 -- 172.21.15.37:0/2960089965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc49014f570 con 0x7fc49006f5a0 2024-05-30T06:42:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc487e00640 1 -- 172.21.15.37:0/2960089965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48000aa30 con 0x7fc49006f5a0 2024-05-30T06:42:37.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc496600640 1 -- 172.21.15.37:0/2960089965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc49014fb30 con 0x7fc49006f5a0 2024-05-30T06:42:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc496600640 1 -- 172.21.15.37:0/2960089965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc490068bc0 con 0x7fc49006f5a0 2024-05-30T06:42:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc487e00640 1 -- 172.21.15.37:0/2960089965 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc48001b070 con 0x7fc49006f5a0 2024-05-30T06:42:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc487e00640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc46c068380 0x7fc46c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.155+0000 7fc487e00640 1 -- 172.21.15.37:0/2960089965 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc480085fb0 con 0x7fc49006f5a0 2024-05-30T06:42:37.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.159+0000 7fc486a00640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc46c068380 0x7fc46c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.159+0000 7fc486a00640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc46c068380 0x7fc46c06a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc49014b730 tx=0x7fc478008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:37.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.163+0000 7fc487e00640 1 -- 172.21.15.37:0/2960089965 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc480055e80 con 0x7fc49006f5a0 2024-05-30T06:42:37.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc496600640 1 -- 172.21.15.37:0/2960089965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc4900b6790 con 0x7fc49006f5a0 2024-05-30T06:42:37.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc487e00640 1 -- 172.21.15.37:0/2960089965 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fc48005a180 con 0x7fc49006f5a0 2024-05-30T06:42:37.327 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:37.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc496600640 1 -- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc46c068380 msgr2=0x7fc46c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc496600640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc46c068380 0x7fc46c06a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc49014b730 tx=0x7fc478008040 comp rx=0 tx=0).stop 2024-05-30T06:42:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc496600640 1 -- 172.21.15.37:0/2960089965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49006f5a0 msgr2=0x7fc49014a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc496600640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49006f5a0 0x7fc49014a910 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc48000c7c0 tx=0x7fc48000cc80 comp rx=0 tx=0).stop 2024-05-30T06:42:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc496600640 1 -- 172.21.15.37:0/2960089965 shutdown_connections 2024-05-30T06:42:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc496600640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc46c068380 0x7fc46c06a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc496600640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc49015ae60 0x7fc49015b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc496600640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc490155da0 0x7fc490150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc496600640 1 --2- 172.21.15.37:0/2960089965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49006f5a0 0x7fc49014a910 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc496600640 1 -- 172.21.15.37:0/2960089965 >> 172.21.15.37:0/2960089965 conn(0x7fc49006bf60 msgr2=0x7fc4901513b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc496600640 1 -- 172.21.15.37:0/2960089965 shutdown_connections 2024-05-30T06:42:37.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.327+0000 7fc496600640 1 -- 172.21.15.37:0/2960089965 wait complete. 2024-05-30T06:42:37.348 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:42:37.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.491+0000 7f057c800640 1 Processor -- start 2024-05-30T06:42:37.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.491+0000 7f057c800640 1 -- start start 2024-05-30T06:42:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f057c800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05740737a0 0x7f057415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f057c800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05740b5470 con 0x7f0574155c90 2024-05-30T06:42:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f057c800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05740b46b0 con 0x7f05740714e0 2024-05-30T06:42:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f057c800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0574073dc0 con 0x7f05740737a0 2024-05-30T06:42:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0579e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0574155c90 0x7f0574070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40816/0 (socket says 172.21.15.37:40816) 2024-05-30T06:42:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0579e00640 1 -- 172.21.15.37:0/3255631618 learned_addr learned my addr 172.21.15.37:0/3255631618 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:37.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f057a800640 1 --2- 172.21.15.37:0/3255631618 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05740737a0 0x7f057415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1568123649 0 0) 0x7f05740b5470 con 0x7f0574155c90 2024-05-30T06:42:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f055c003530 con 0x7f0574155c90 2024-05-30T06:42:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2878281528 0 0) 0x7f055c003530 con 0x7f0574155c90 2024-05-30T06:42:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05740737a0 msgr2=0x7f057415bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 --2- 172.21.15.37:0/3255631618 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05740737a0 0x7f057415bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 >> v1:172.21.15.105:6789/0 conn(0x7f05740714e0 legacy=0x7f0574073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05740b4990 con 0x7f0574155c90 2024-05-30T06:42:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f0568001680 con 0x7f0574155c90 2024-05-30T06:42:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 >> v1:172.21.15.37:6789/0 conn(0x7f0574155c90 legacy=0x7f0574070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 --2- 172.21.15.37:0/3255631618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f055c0039f0 0x7f055c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 --2- 172.21.15.37:0/3255631618 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05740737a0 0x7f055c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 --2- 172.21.15.37:0/3255631618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f055c004d50 0x7f055c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0574073dc0 con 0x7f055c0039f0 2024-05-30T06:42:37.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f055c00ba80 con 0x7f055c004d50 2024-05-30T06:42:37.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f055c00bc80 con 0x7f05740737a0 2024-05-30T06:42:37.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0579e00640 1 --2- 172.21.15.37:0/3255631618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f055c0039f0 0x7f055c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f057a800640 1 --2- 172.21.15.37:0/3255631618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f055c004d50 0x7f055c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0579400640 1 --2- 172.21.15.37:0/3255631618 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05740737a0 0x7f055c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0579e00640 1 -- 172.21.15.37:0/3255631618 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05740737a0 msgr2=0x7f055c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:37.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0579e00640 1 --2- 172.21.15.37:0/3255631618 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05740737a0 0x7f055c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0579e00640 1 -- 172.21.15.37:0/3255631618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f055c004d50 msgr2=0x7f055c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:37.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0579e00640 1 --2- 172.21.15.37:0/3255631618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f055c004d50 0x7f055c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f0579e00640 1 -- 172.21.15.37:0/3255631618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c003530 con 0x7f055c0039f0 2024-05-30T06:42:37.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.495+0000 7f057a800640 1 --2- 172.21.15.37:0/3255631618 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f055c004d50 0x7f055c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.499+0000 7f0579e00640 1 --2- 172.21.15.37:0/3255631618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f055c0039f0 0x7f055c003dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f056800c240 tx=0x7f056801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58cc7db24f71da6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.499+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568007d40 con 0x7f055c0039f0 2024-05-30T06:42:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.499+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05680a9070 con 0x7f055c0039f0 2024-05-30T06:42:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.499+0000 7f0578a00640 1 -- 172.21.15.37:0/3255631618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568005d40 con 0x7f055c0039f0 2024-05-30T06:42:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.499+0000 7f057c800640 1 -- 172.21.15.37:0/3255631618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f055c0039f0 msgr2=0x7f055c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.499+0000 7f057c800640 1 --2- 172.21.15.37:0/3255631618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f055c0039f0 0x7f055c003dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f056800c240 tx=0x7f056801cca0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.499+0000 7f057a800640 1 -- 172.21.15.37:0/3255631618 reap_dead start 2024-05-30T06:42:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.499+0000 7f057c800640 1 -- 172.21.15.37:0/3255631618 shutdown_connections 2024-05-30T06:42:37.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.499+0000 7f057c800640 1 -- 172.21.15.37:0/3255631618 >> 172.21.15.37:0/3255631618 conn(0x7f057406d360 msgr2=0x7f057406f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:37.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.499+0000 7f057c800640 1 -- 172.21.15.37:0/3255631618 shutdown_connections 2024-05-30T06:42:37.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.499+0000 7f057c800640 1 -- 172.21.15.37:0/3255631618 wait complete. 2024-05-30T06:42:37.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f057c800640 1 Processor -- start 2024-05-30T06:42:37.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f057c800640 1 -- start start 2024-05-30T06:42:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f057c800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f055c0039f0 0x7f0574154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f057c800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05741550b0 0x7f05740cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f057c800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0574144ee0 0x7f05740b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f057c800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f057415c710 con 0x7f055c0039f0 2024-05-30T06:42:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f057c800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f057415c590 con 0x7f05741550b0 2024-05-30T06:42:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f057c800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f057415c890 con 0x7f0574144ee0 2024-05-30T06:42:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f0579e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f055c0039f0 0x7f0574154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f0579e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f055c0039f0 0x7f0574154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37248/0 (socket says 172.21.15.37:37248) 2024-05-30T06:42:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f0579e00640 1 -- 172.21.15.37:0/1384710447 learned_addr learned my addr 172.21.15.37:0/1384710447 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f057a800640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0574144ee0 0x7f05740b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f0579400640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05741550b0 0x7f05740cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f0579e00640 1 -- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0574144ee0 msgr2=0x7f05740b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f0579e00640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0574144ee0 0x7f05740b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f0579e00640 1 -- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05741550b0 msgr2=0x7f05740cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f0579e00640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05741550b0 0x7f05740cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f0579e00640 1 -- 172.21.15.37:0/1384710447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0574141db0 con 0x7f055c0039f0 2024-05-30T06:42:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f0579e00640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f055c0039f0 0x7f0574154af0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f056800c240 tx=0x7f055c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f056e000640 1 -- 172.21.15.37:0/1384710447 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568001070 con 0x7f055c0039f0 2024-05-30T06:42:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f056e000640 1 -- 172.21.15.37:0/1384710447 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0568007140 con 0x7f055c0039f0 2024-05-30T06:42:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f057c800640 1 -- 172.21.15.37:0/1384710447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0574142090 con 0x7f055c0039f0 2024-05-30T06:42:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f056e000640 1 -- 172.21.15.37:0/1384710447 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05680074f0 con 0x7f055c0039f0 2024-05-30T06:42:37.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f057c800640 1 -- 172.21.15.37:0/1384710447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0574142650 con 0x7f055c0039f0 2024-05-30T06:42:37.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.503+0000 7f057c800640 1 -- 172.21.15.37:0/1384710447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0574068bc0 con 0x7f055c0039f0 2024-05-30T06:42:37.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.507+0000 7f056e000640 1 -- 172.21.15.37:0/1384710447 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f05680b6030 con 0x7f055c0039f0 2024-05-30T06:42:37.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.507+0000 7f056e000640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f05580683b0 0x7f055806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.507+0000 7f056e000640 1 -- 172.21.15.37:0/1384710447 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f056811f910 con 0x7f055c0039f0 2024-05-30T06:42:37.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.507+0000 7f0579400640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f05580683b0 0x7f055806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.507+0000 7f0579400640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f05580683b0 0x7f055806a870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f05740b1c20 tx=0x7f0564007c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:37.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.511+0000 7f056e000640 1 -- 172.21.15.37:0/1384710447 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f05680169b0 con 0x7f055c0039f0 2024-05-30T06:42:37.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.675+0000 7f057c800640 1 -- 172.21.15.37:0/1384710447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f057415de50 con 0x7f055c0039f0 2024-05-30T06:42:37.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.675+0000 7f056e000640 1 -- 172.21.15.37:0/1384710447 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f05680efe40 con 0x7f055c0039f0 2024-05-30T06:42:37.676 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:42:37.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.679+0000 7f057c800640 1 -- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f05580683b0 msgr2=0x7f055806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.679+0000 7f057c800640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f05580683b0 0x7f055806a870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f05740b1c20 tx=0x7f0564007c60 comp rx=0 tx=0).stop 2024-05-30T06:42:37.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.679+0000 7f057c800640 1 -- 172.21.15.37:0/1384710447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f055c0039f0 msgr2=0x7f0574154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.679+0000 7f057c800640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f055c0039f0 0x7f0574154af0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f056800c240 tx=0x7f055c005840 comp rx=0 tx=0).stop 2024-05-30T06:42:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.679+0000 7f057c800640 1 -- 172.21.15.37:0/1384710447 shutdown_connections 2024-05-30T06:42:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.679+0000 7f057c800640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0574144ee0 0x7f05740b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.679+0000 7f057c800640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f05580683b0 0x7f055806a870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.679+0000 7f057c800640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05741550b0 0x7f05740cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.679+0000 7f057c800640 1 --2- 172.21.15.37:0/1384710447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f055c0039f0 0x7f0574154af0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.679+0000 7f057c800640 1 -- 172.21.15.37:0/1384710447 >> 172.21.15.37:0/1384710447 conn(0x7f057406d360 msgr2=0x7f057406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.679+0000 7f057c800640 1 -- 172.21.15.37:0/1384710447 shutdown_connections 2024-05-30T06:42:37.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.679+0000 7f057c800640 1 -- 172.21.15.37:0/1384710447 wait complete. 2024-05-30T06:42:37.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:42:37.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.843+0000 7fadf7600640 1 Processor -- start 2024-05-30T06:42:37.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.843+0000 7fadf7600640 1 -- start start 2024-05-30T06:42:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.843+0000 7fadf7600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf00cd440 0x7fadf006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.843+0000 7fadf7600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fadf006f5a0 0x7fadf00b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.843+0000 7fadf7600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf015f310 con 0x7fadf0155da0 2024-05-30T06:42:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.843+0000 7fadf7600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fadf015f5f0 con 0x7fadf006f5a0 2024-05-30T06:42:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.843+0000 7fadf7600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fadf015f8d0 con 0x7fadf00cd440 2024-05-30T06:42:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.847+0000 7fadf5600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fadf006f5a0 0x7fadf00b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.847+0000 7fadf5600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fadf006f5a0 0x7fadf00b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37262/0 (socket says 172.21.15.37:37262) 2024-05-30T06:42:37.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.847+0000 7fadf5600640 1 -- 172.21.15.37:0/3631719351 learned_addr learned my addr 172.21.15.37:0/3631719351 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:37.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.847+0000 7fadefe00640 1 --2- 172.21.15.37:0/3631719351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf00cd440 0x7fadf006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.847+0000 7fadf5600640 1 -- 172.21.15.37:0/3631719351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf00cd440 msgr2=0x7fadf006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:37.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.847+0000 7fadf5600640 1 --2- 172.21.15.37:0/3631719351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf00cd440 0x7fadf006f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.847+0000 7fadf5600640 1 -- 172.21.15.37:0/3631719351 >> v1:172.21.15.105:6789/0 conn(0x7fadf0155da0 legacy=0x7fadf00cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.847+0000 7fadf5600640 1 -- 172.21.15.37:0/3631719351 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf015fbb0 con 0x7fadf006f5a0 2024-05-30T06:42:37.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.847+0000 7fadefe00640 1 --2- 172.21.15.37:0/3631719351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf00cd440 0x7fadf006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:37.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.847+0000 7fadf5600640 1 --2- 172.21.15.37:0/3631719351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf006f5a0 0x7fadf00b3750 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fade8009e50 tx=0x7fade801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcbc22bcd45102 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:37.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.847+0000 7fadef400640 1 -- 172.21.15.37:0/3631719351 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade80a56e0 con 0x7fadf006f5a0 2024-05-30T06:42:37.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.847+0000 7fadef400640 1 -- 172.21.15.37:0/3631719351 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade80a5880 con 0x7fadf006f5a0 2024-05-30T06:42:37.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.847+0000 7fadef400640 1 -- 172.21.15.37:0/3631719351 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade80a5c50 con 0x7fadf006f5a0 2024-05-30T06:42:37.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 -- 172.21.15.37:0/3631719351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf006f5a0 msgr2=0x7fadf00b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 --2- 172.21.15.37:0/3631719351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf006f5a0 0x7fadf00b3750 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fade8009e50 tx=0x7fade801c910 comp rx=0 tx=0).stop 2024-05-30T06:42:37.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 -- 172.21.15.37:0/3631719351 shutdown_connections 2024-05-30T06:42:37.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 --2- 172.21.15.37:0/3631719351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf006f5a0 0x7fadf00b3750 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 --2- 172.21.15.37:0/3631719351 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf00cd440 0x7fadf006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 -- 172.21.15.37:0/3631719351 >> 172.21.15.37:0/3631719351 conn(0x7fadf006bf60 msgr2=0x7fadf00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:37.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 -- 172.21.15.37:0/3631719351 shutdown_connections 2024-05-30T06:42:37.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 -- 172.21.15.37:0/3631719351 wait complete. 2024-05-30T06:42:37.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 Processor -- start 2024-05-30T06:42:37.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 -- start start 2024-05-30T06:42:37.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf006f5a0 0x7fadf0168de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf0155da0 0x7fadf00725a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf0150cb0 0x7fadf015d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fadf0166570 con 0x7fadf0150cb0 2024-05-30T06:42:37.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fadf00b46b0 con 0x7fadf0155da0 2024-05-30T06:42:37.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf7600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fadf01666f0 con 0x7fadf006f5a0 2024-05-30T06:42:37.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf0150cb0 0x7fadf015d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf0150cb0 0x7fadf015d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37278/0 (socket says 172.21.15.37:37278) 2024-05-30T06:42:37.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf5600640 1 -- 172.21.15.37:0/2196088567 learned_addr learned my addr 172.21.15.37:0/2196088567 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:37.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadefe00640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf0155da0 0x7fadf00725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf4c00640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf006f5a0 0x7fadf0168de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf5600640 1 -- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf006f5a0 msgr2=0x7fadf0168de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf5600640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf006f5a0 0x7fadf0168de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf5600640 1 -- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf0155da0 msgr2=0x7fadf00725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:37.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf5600640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf0155da0 0x7fadf00725a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:37.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf5600640 1 -- 172.21.15.37:0/2196088567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf0169320 con 0x7fadf0150cb0 2024-05-30T06:42:37.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf4c00640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf006f5a0 0x7fadf0168de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:37.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.851+0000 7fadf5600640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf0150cb0 0x7fadf015d0f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fade80af040 tx=0x7fade80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:37.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.855+0000 7fadecc00640 1 -- 172.21.15.37:0/2196088567 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade80bc020 con 0x7fadf0150cb0 2024-05-30T06:42:37.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.855+0000 7fadecc00640 1 -- 172.21.15.37:0/2196088567 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade80b8880 con 0x7fadf0150cb0 2024-05-30T06:42:37.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.855+0000 7fadf7600640 1 -- 172.21.15.37:0/2196088567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf0159c30 con 0x7fadf0150cb0 2024-05-30T06:42:37.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.855+0000 7fadecc00640 1 -- 172.21.15.37:0/2196088567 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8009510 con 0x7fadf0150cb0 2024-05-30T06:42:37.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.855+0000 7fadf7600640 1 -- 172.21.15.37:0/2196088567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf0159670 con 0x7fadf0150cb0 2024-05-30T06:42:37.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.855+0000 7fadf7600640 1 -- 172.21.15.37:0/2196088567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf0068bc0 con 0x7fadf0150cb0 2024-05-30T06:42:37.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.855+0000 7fadecc00640 1 -- 172.21.15.37:0/2196088567 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fade80bf020 con 0x7fadf0150cb0 2024-05-30T06:42:37.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.855+0000 7fadecc00640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fadd0068380 0x7fadd006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:37.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.855+0000 7fadecc00640 1 -- 172.21.15.37:0/2196088567 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fade8121a60 con 0x7fadf0150cb0 2024-05-30T06:42:37.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.855+0000 7fadf4c00640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fadd0068380 0x7fadd006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:37.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.859+0000 7fadf4c00640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fadd0068380 0x7fadd006a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fade4001670 tx=0x7fade4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:37.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:37.859+0000 7fadecc00640 1 -- 172.21.15.37:0/2196088567 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fade80c6030 con 0x7fadf0150cb0 2024-05-30T06:42:38.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.023+0000 7fadf7600640 1 -- 172.21.15.37:0/2196088567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fadf0167120 con 0x7fadf0150cb0 2024-05-30T06:42:38.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.027+0000 7fadecc00640 1 -- 172.21.15.37:0/2196088567 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fadf0169320 con 0x7fadf0150cb0 2024-05-30T06:42:38.025 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:42:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.027+0000 7fadf7600640 1 -- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fadd0068380 msgr2=0x7fadd006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.027+0000 7fadf7600640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fadd0068380 0x7fadd006a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fade4001670 tx=0x7fade4009040 comp rx=0 tx=0).stop 2024-05-30T06:42:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.027+0000 7fadf7600640 1 -- 172.21.15.37:0/2196088567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf0150cb0 msgr2=0x7fadf015d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.027+0000 7fadf7600640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf0150cb0 0x7fadf015d0f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fade80af040 tx=0x7fade80196b0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.027+0000 7fadf7600640 1 -- 172.21.15.37:0/2196088567 shutdown_connections 2024-05-30T06:42:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.027+0000 7fadf7600640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf0150cb0 0x7fadf015d0f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.027+0000 7fadf7600640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fadd0068380 0x7fadd006a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.027+0000 7fadf7600640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf0155da0 0x7fadf00725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.027+0000 7fadf7600640 1 --2- 172.21.15.37:0/2196088567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf006f5a0 0x7fadf0168de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.027+0000 7fadf7600640 1 -- 172.21.15.37:0/2196088567 >> 172.21.15.37:0/2196088567 conn(0x7fadf006bf60 msgr2=0x7fadf006ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.027+0000 7fadf7600640 1 -- 172.21.15.37:0/2196088567 shutdown_connections 2024-05-30T06:42:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.027+0000 7fadf7600640 1 -- 172.21.15.37:0/2196088567 wait complete. 2024-05-30T06:42:38.046 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:38.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.187+0000 7f7a94c00640 1 Processor -- start 2024-05-30T06:42:38.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.187+0000 7f7a94c00640 1 -- start start 2024-05-30T06:42:38.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.187+0000 7f7a94c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a9006e000 0x7f7a900ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.187+0000 7f7a94c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7a9015cd80 0x7f7a900ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.187+0000 7f7a94c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a900cd120 con 0x7f7a900cec40 2024-05-30T06:42:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.187+0000 7f7a94c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7a900a9530 con 0x7f7a9015cd80 2024-05-30T06:42:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.187+0000 7f7a94c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7a900cd400 con 0x7f7a9006e000 2024-05-30T06:42:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.191+0000 7f7a87e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7a9015cd80 0x7f7a900ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.191+0000 7f7a87e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7a9015cd80 0x7f7a900ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37290/0 (socket says 172.21.15.37:37290) 2024-05-30T06:42:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.191+0000 7f7a87e00640 1 -- 172.21.15.37:0/209589261 learned_addr learned my addr 172.21.15.37:0/209589261 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.191+0000 7f7a8de00640 1 --2- 172.21.15.37:0/209589261 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a9006e000 0x7f7a900ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.191+0000 7f7a87e00640 1 -- 172.21.15.37:0/209589261 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a9006e000 msgr2=0x7f7a900ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.191+0000 7f7a87e00640 1 --2- 172.21.15.37:0/209589261 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a9006e000 0x7f7a900ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.191+0000 7f7a87e00640 1 -- 172.21.15.37:0/209589261 >> v1:172.21.15.105:6789/0 conn(0x7f7a900cec40 legacy=0x7f7a9006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.191+0000 7f7a87e00640 1 -- 172.21.15.37:0/209589261 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a900cd6e0 con 0x7f7a9015cd80 2024-05-30T06:42:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.191+0000 7f7a8de00640 1 --2- 172.21.15.37:0/209589261 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a9006e000 0x7f7a900ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.191+0000 7f7a87e00640 1 --2- 172.21.15.37:0/209589261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a9015cd80 0x7f7a900ce700 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009870 tx=0x7f7a7801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5aa70753ad7012 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.191+0000 7f7a8d400640 1 -- 172.21.15.37:0/209589261 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a780b5070 con 0x7f7a9015cd80 2024-05-30T06:42:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.191+0000 7f7a8d400640 1 -- 172.21.15.37:0/209589261 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a780a89d0 con 0x7f7a9015cd80 2024-05-30T06:42:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.191+0000 7f7a8d400640 1 -- 172.21.15.37:0/209589261 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a780a8da0 con 0x7f7a9015cd80 2024-05-30T06:42:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 -- 172.21.15.37:0/209589261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a9015cd80 msgr2=0x7f7a900ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 --2- 172.21.15.37:0/209589261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a9015cd80 0x7f7a900ce700 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009870 tx=0x7f7a7801ed10 comp rx=0 tx=0).stop 2024-05-30T06:42:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 -- 172.21.15.37:0/209589261 shutdown_connections 2024-05-30T06:42:38.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 --2- 172.21.15.37:0/209589261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a9015cd80 0x7f7a900ce700 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 --2- 172.21.15.37:0/209589261 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a9006e000 0x7f7a900ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 -- 172.21.15.37:0/209589261 >> 172.21.15.37:0/209589261 conn(0x7f7a900b23a0 msgr2=0x7f7a900b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:38.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 -- 172.21.15.37:0/209589261 shutdown_connections 2024-05-30T06:42:38.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 -- 172.21.15.37:0/209589261 wait complete. 2024-05-30T06:42:38.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 Processor -- start 2024-05-30T06:42:38.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 -- start start 2024-05-30T06:42:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a9006e000 0x7f7a9015a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a900cec40 0x7f7a9013bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a9015cd80 0x7f7a900b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7a900cf0a0 con 0x7f7a900cec40 2024-05-30T06:42:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a900cdca0 con 0x7f7a9015cd80 2024-05-30T06:42:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a94c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7a901663c0 con 0x7f7a9006e000 2024-05-30T06:42:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a87e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a900cec40 0x7f7a9013bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a87e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a900cec40 0x7f7a9013bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37300/0 (socket says 172.21.15.37:37300) 2024-05-30T06:42:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a87e00640 1 -- 172.21.15.37:0/3239894890 learned_addr learned my addr 172.21.15.37:0/3239894890 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a8de00640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a9006e000 0x7f7a9015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.195+0000 7f7a8e800640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a9015cd80 0x7f7a900b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a87e00640 1 -- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a9006e000 msgr2=0x7f7a9015a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a87e00640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a9006e000 0x7f7a9015a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a87e00640 1 -- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a9015cd80 msgr2=0x7f7a900b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a87e00640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a9015cd80 0x7f7a900b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a87e00640 1 -- 172.21.15.37:0/3239894890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a900b1f90 con 0x7f7a900cec40 2024-05-30T06:42:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a8de00640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a9006e000 0x7f7a9015a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a8e800640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a9015cd80 0x7f7a900b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a87e00640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a900cec40 0x7f7a9013bb30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7a780b3040 tx=0x7f7a7801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a86000640 1 -- 172.21.15.37:0/3239894890 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a780c0070 con 0x7f7a900cec40 2024-05-30T06:42:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a86000640 1 -- 172.21.15.37:0/3239894890 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a780b0b40 con 0x7f7a900cec40 2024-05-30T06:42:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a94c00640 1 -- 172.21.15.37:0/3239894890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9013ad70 con 0x7f7a900cec40 2024-05-30T06:42:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a86000640 1 -- 172.21.15.37:0/3239894890 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a780b5070 con 0x7f7a900cec40 2024-05-30T06:42:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a94c00640 1 -- 172.21.15.37:0/3239894890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9013b330 con 0x7f7a900cec40 2024-05-30T06:42:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a94c00640 1 -- 172.21.15.37:0/3239894890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a90068b20 con 0x7f7a900cec40 2024-05-30T06:42:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a86000640 1 -- 172.21.15.37:0/3239894890 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7a780c3070 con 0x7f7a900cec40 2024-05-30T06:42:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a86000640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a6c068380 0x7f7a6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a86000640 1 -- 172.21.15.37:0/3239894890 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7a78123c60 con 0x7f7a900cec40 2024-05-30T06:42:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.199+0000 7f7a8de00640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a6c068380 0x7f7a6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.203+0000 7f7a8de00640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a6c068380 0x7f7a6c06a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000a9b0 tx=0x7f7a80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.203+0000 7f7a86000640 1 -- 172.21.15.37:0/3239894890 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7a900b1f90 con 0x7f7a900cec40 2024-05-30T06:42:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.371+0000 7f7a94c00640 1 -- 172.21.15.37:0/3239894890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a90140e30 con 0x7f7a900cec40 2024-05-30T06:42:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.371+0000 7f7a86000640 1 -- 172.21.15.37:0/3239894890 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7f7a78018870 con 0x7f7a900cec40 2024-05-30T06:42:38.371 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:38.371 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.375+0000 7f7a94c00640 1 -- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a6c068380 msgr2=0x7f7a6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.375+0000 7f7a94c00640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a6c068380 0x7f7a6c06a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000a9b0 tx=0x7f7a80008040 comp rx=0 tx=0).stop 2024-05-30T06:42:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.375+0000 7f7a94c00640 1 -- 172.21.15.37:0/3239894890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a900cec40 msgr2=0x7f7a9013bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.375+0000 7f7a94c00640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a900cec40 0x7f7a9013bb30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7a780b3040 tx=0x7f7a7801bab0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.375+0000 7f7a94c00640 1 -- 172.21.15.37:0/3239894890 shutdown_connections 2024-05-30T06:42:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.375+0000 7f7a94c00640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a6c068380 0x7f7a6c06a840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.375+0000 7f7a94c00640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a9015cd80 0x7f7a900b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.375+0000 7f7a94c00640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a900cec40 0x7f7a9013bb30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.375+0000 7f7a94c00640 1 --2- 172.21.15.37:0/3239894890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a9006e000 0x7f7a9015a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.375+0000 7f7a94c00640 1 -- 172.21.15.37:0/3239894890 >> 172.21.15.37:0/3239894890 conn(0x7f7a900b23a0 msgr2=0x7f7a90155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.375+0000 7f7a94c00640 1 -- 172.21.15.37:0/3239894890 shutdown_connections 2024-05-30T06:42:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.375+0000 7f7a94c00640 1 -- 172.21.15.37:0/3239894890 wait complete. 2024-05-30T06:42:38.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:42:09.128133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:42:09.755772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:38.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21db000640 1 Processor -- start 2024-05-30T06:42:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21db000640 1 -- start start 2024-05-30T06:42:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21db000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d415c650 0x7f21d40d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21db000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21d415ca30 0x7f21d40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21db000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d40b3f40 con 0x7f21d40b2180 2024-05-30T06:42:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21db000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f21d40cce80 con 0x7f21d415ca30 2024-05-30T06:42:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21db000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21d40b2ec0 con 0x7f21d415c650 2024-05-30T06:42:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21d3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21d415ca30 0x7f21d40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21d3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f21d415ca30 0x7f21d40d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37310/0 (socket says 172.21.15.37:37310) 2024-05-30T06:42:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21d3400640 1 -- 172.21.15.37:0/1311904892 learned_addr learned my addr 172.21.15.37:0/1311904892 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21d3e00640 1 --2- 172.21.15.37:0/1311904892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d415c650 0x7f21d40d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21d3400640 1 -- 172.21.15.37:0/1311904892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d415c650 msgr2=0x7f21d40d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21d3400640 1 --2- 172.21.15.37:0/1311904892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d415c650 0x7f21d40d09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21d3400640 1 -- 172.21.15.37:0/1311904892 >> v1:172.21.15.105:6789/0 conn(0x7f21d40b2180 legacy=0x7f21d40b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.539+0000 7f21d3400640 1 -- 172.21.15.37:0/1311904892 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d40b3180 con 0x7f21d415ca30 2024-05-30T06:42:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21d3400640 1 --2- 172.21.15.37:0/1311904892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d415ca30 0x7f21d40d0f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009870 tx=0x7f21c001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39365594d780ba0e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21d2a00640 1 -- 172.21.15.37:0/1311904892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c00b5070 con 0x7f21d415ca30 2024-05-30T06:42:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21d2a00640 1 -- 172.21.15.37:0/1311904892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c00a8a50 con 0x7f21d415ca30 2024-05-30T06:42:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21d2a00640 1 -- 172.21.15.37:0/1311904892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c00a8e20 con 0x7f21d415ca30 2024-05-30T06:42:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21db000640 1 -- 172.21.15.37:0/1311904892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d415ca30 msgr2=0x7f21d40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21db000640 1 --2- 172.21.15.37:0/1311904892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d415ca30 0x7f21d40d0f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009870 tx=0x7f21c001ed50 comp rx=0 tx=0).stop 2024-05-30T06:42:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21db000640 1 -- 172.21.15.37:0/1311904892 shutdown_connections 2024-05-30T06:42:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21db000640 1 --2- 172.21.15.37:0/1311904892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d415ca30 0x7f21d40d0f20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21db000640 1 --2- 172.21.15.37:0/1311904892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d415c650 0x7f21d40d09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21db000640 1 -- 172.21.15.37:0/1311904892 >> 172.21.15.37:0/1311904892 conn(0x7f21d40b4130 msgr2=0x7f21d40b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21db000640 1 -- 172.21.15.37:0/1311904892 shutdown_connections 2024-05-30T06:42:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21db000640 1 -- 172.21.15.37:0/1311904892 wait complete. 2024-05-30T06:42:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21db000640 1 Processor -- start 2024-05-30T06:42:38.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.543+0000 7f21db000640 1 -- start start 2024-05-30T06:42:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21db000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d40b2180 0x7f21d414c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21db000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d415c650 0x7f21d40b7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21db000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21d415ca30 0x7f21d4157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21db000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21d40b3a20 con 0x7f21d40b2180 2024-05-30T06:42:38.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21db000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21d40b3740 con 0x7f21d415ca30 2024-05-30T06:42:38.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21db000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21d40af410 con 0x7f21d415c650 2024-05-30T06:42:38.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d40b2180 0x7f21d414c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d40b2180 0x7f21d414c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37314/0 (socket says 172.21.15.37:37314) 2024-05-30T06:42:38.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21d3e00640 1 -- 172.21.15.37:0/113488174 learned_addr learned my addr 172.21.15.37:0/113488174 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:38.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21d3400640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d415c650 0x7f21d40b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21d9000640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21d415ca30 0x7f21d4157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21d3e00640 1 -- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d415c650 msgr2=0x7f21d40b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21d3e00640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d415c650 0x7f21d40b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21d3e00640 1 -- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21d415ca30 msgr2=0x7f21d4157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21d3e00640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21d415ca30 0x7f21d4157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21d3e00640 1 -- 172.21.15.37:0/113488174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d4155dc0 con 0x7f21d40b2180 2024-05-30T06:42:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21d3e00640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d40b2180 0x7f21d414c9e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f21c400d800 tx=0x7f21c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21cbe00640 1 -- 172.21.15.37:0/113488174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c400b6c0 con 0x7f21d40b2180 2024-05-30T06:42:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21cbe00640 1 -- 172.21.15.37:0/113488174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c4019070 con 0x7f21d40b2180 2024-05-30T06:42:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21db000640 1 -- 172.21.15.37:0/113488174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d415f5d0 con 0x7f21d40b2180 2024-05-30T06:42:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21cbe00640 1 -- 172.21.15.37:0/113488174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c400ba60 con 0x7f21d40b2180 2024-05-30T06:42:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21db000640 1 -- 172.21.15.37:0/113488174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d415fb90 con 0x7f21d40b2180 2024-05-30T06:42:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.547+0000 7f21db000640 1 -- 172.21.15.37:0/113488174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d4068bc0 con 0x7f21d40b2180 2024-05-30T06:42:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.551+0000 7f21cbe00640 1 -- 172.21.15.37:0/113488174 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f21c400bc00 con 0x7f21d40b2180 2024-05-30T06:42:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.551+0000 7f21cbe00640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f21b4068380 0x7f21b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.551+0000 7f21cbe00640 1 -- 172.21.15.37:0/113488174 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f21c4086db0 con 0x7f21d40b2180 2024-05-30T06:42:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.551+0000 7f21d3400640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f21b4068380 0x7f21b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.551+0000 7f21d3400640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f21b4068380 0x7f21b406a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f21c00b2000 tx=0x7f21c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:38.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.555+0000 7f21cbe00640 1 -- 172.21.15.37:0/113488174 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f21c408b070 con 0x7f21d40b2180 2024-05-30T06:42:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.719+0000 7f21db000640 1 -- 172.21.15.37:0/113488174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f21d40b85a0 con 0x7f21d40b2180 2024-05-30T06:42:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.719+0000 7f21cbe00640 1 -- 172.21.15.37:0/113488174 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f21d4155dc0 con 0x7f21d40b2180 2024-05-30T06:42:38.719 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.719+0000 7f21db000640 1 -- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f21b4068380 msgr2=0x7f21b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.719+0000 7f21db000640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f21b4068380 0x7f21b406a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f21c00b2000 tx=0x7f21c0009040 comp rx=0 tx=0).stop 2024-05-30T06:42:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.719+0000 7f21db000640 1 -- 172.21.15.37:0/113488174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d40b2180 msgr2=0x7f21d414c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.719+0000 7f21db000640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d40b2180 0x7f21d414c9e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f21c400d800 tx=0x7f21c400dcc0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.719+0000 7f21db000640 1 -- 172.21.15.37:0/113488174 shutdown_connections 2024-05-30T06:42:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.719+0000 7f21db000640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f21b4068380 0x7f21b406a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.719+0000 7f21db000640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21d415ca30 0x7f21d4157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.719+0000 7f21db000640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d415c650 0x7f21d40b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.719+0000 7f21db000640 1 --2- 172.21.15.37:0/113488174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d40b2180 0x7f21d414c9e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.719+0000 7f21db000640 1 -- 172.21.15.37:0/113488174 >> 172.21.15.37:0/113488174 conn(0x7f21d40b4130 msgr2=0x7f21d4159c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:38.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.723+0000 7f21db000640 1 -- 172.21.15.37:0/113488174 shutdown_connections 2024-05-30T06:42:38.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.723+0000 7f21db000640 1 -- 172.21.15.37:0/113488174 wait complete. 2024-05-30T06:42:38.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:42:38.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5463a00640 1 Processor -- start 2024-05-30T06:42:38.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5463a00640 1 -- start start 2024-05-30T06:42:38.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5463a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f545c15ebc0 0x7f545c0d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5463a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f545c09b800 0x7f545c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5463a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f545c0d0840 con 0x7f545c06dcf0 2024-05-30T06:42:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5463a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f545c09bce0 con 0x7f545c09b800 2024-05-30T06:42:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5463a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f545c0d0ae0 con 0x7f545c15ebc0 2024-05-30T06:42:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5453e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f545c09b800 0x7f545c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5461a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f545c06dcf0 0x7f545c09aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40828/0 (socket says 172.21.15.37:40828) 2024-05-30T06:42:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5461a00640 1 -- 172.21.15.37:0/764180737 learned_addr learned my addr 172.21.15.37:0/764180737 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5461000640 1 --2- 172.21.15.37:0/764180737 >> v2:172.21.15.105:3300/0 conn(0x7f545c15ebc0 0x7f545c0d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5453e00640 1 -- 172.21.15.37:0/764180737 >> v2:172.21.15.105:3300/0 conn(0x7f545c15ebc0 msgr2=0x7f545c0d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5453e00640 1 --2- 172.21.15.37:0/764180737 >> v2:172.21.15.105:3300/0 conn(0x7f545c15ebc0 0x7f545c0d15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5453e00640 1 -- 172.21.15.37:0/764180737 >> v1:172.21.15.37:6789/0 conn(0x7f545c06dcf0 legacy=0x7f545c09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f5453e00640 1 -- 172.21.15.37:0/764180737 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c0d0dc0 con 0x7f545c09b800 2024-05-30T06:42:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.887+0000 7f545be00640 1 -- 172.21.15.37:0/764180737 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632504485 0 0) 0x7f545c0d0840 con 0x7f545c06dcf0 2024-05-30T06:42:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.891+0000 7f5453e00640 1 --2- 172.21.15.37:0/764180737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c09b800 0x7f545c06d7b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f545c073610 tx=0x7f544401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d80abdfdf50c3a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.891+0000 7f545be00640 1 -- 172.21.15.37:0/764180737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54440b1070 con 0x7f545c09b800 2024-05-30T06:42:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.891+0000 7f545be00640 1 -- 172.21.15.37:0/764180737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54440ac640 con 0x7f545c09b800 2024-05-30T06:42:38.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.891+0000 7f545be00640 1 -- 172.21.15.37:0/764180737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54440aca10 con 0x7f545c09b800 2024-05-30T06:42:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.891+0000 7f5463a00640 1 -- 172.21.15.37:0/764180737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c09b800 msgr2=0x7f545c06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.891+0000 7f5463a00640 1 --2- 172.21.15.37:0/764180737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c09b800 0x7f545c06d7b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f545c073610 tx=0x7f544401c480 comp rx=0 tx=0).stop 2024-05-30T06:42:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.891+0000 7f5463a00640 1 -- 172.21.15.37:0/764180737 shutdown_connections 2024-05-30T06:42:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.891+0000 7f5463a00640 1 --2- 172.21.15.37:0/764180737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c09b800 0x7f545c06d7b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.891+0000 7f5463a00640 1 --2- 172.21.15.37:0/764180737 >> v2:172.21.15.105:3300/0 conn(0x7f545c15ebc0 0x7f545c0d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.891+0000 7f5463a00640 1 -- 172.21.15.37:0/764180737 >> 172.21.15.37:0/764180737 conn(0x7f545c0b4060 msgr2=0x7f545c0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.891+0000 7f5463a00640 1 -- 172.21.15.37:0/764180737 shutdown_connections 2024-05-30T06:42:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.891+0000 7f5463a00640 1 -- 172.21.15.37:0/764180737 wait complete. 2024-05-30T06:42:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5463a00640 1 Processor -- start 2024-05-30T06:42:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5463a00640 1 -- start start 2024-05-30T06:42:38.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5463a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f545c06dcf0 0x7f545c156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5463a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c09b800 0x7f545c1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5463a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c15ebc0 0x7f545c15c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5463a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f545c09b2f0 con 0x7f545c09b800 2024-05-30T06:42:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5463a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f545c09b170 con 0x7f545c06dcf0 2024-05-30T06:42:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5463a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f545c0cd3d0 con 0x7f545c15ebc0 2024-05-30T06:42:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5453e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c09b800 0x7f545c1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5453e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c09b800 0x7f545c1565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37334/0 (socket says 172.21.15.37:37334) 2024-05-30T06:42:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5453e00640 1 -- 172.21.15.37:0/945042546 learned_addr learned my addr 172.21.15.37:0/945042546 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5461000640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f545c06dcf0 0x7f545c156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5461a00640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c15ebc0 0x7f545c15c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5453e00640 1 -- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c15ebc0 msgr2=0x7f545c15c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5453e00640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c15ebc0 0x7f545c15c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5453e00640 1 -- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f545c06dcf0 msgr2=0x7f545c156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:38.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5453e00640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f545c06dcf0 0x7f545c156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:38.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5453e00640 1 -- 172.21.15.37:0/945042546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c0b5680 con 0x7f545c09b800 2024-05-30T06:42:38.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5453e00640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c09b800 0x7f545c1565c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f54440af040 tx=0x7f5444019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:38.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5459600640 1 -- 172.21.15.37:0/945042546 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54440b1040 con 0x7f545c09b800 2024-05-30T06:42:38.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5459600640 1 -- 172.21.15.37:0/945042546 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54440ac440 con 0x7f545c09b800 2024-05-30T06:42:38.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5459600640 1 -- 172.21.15.37:0/945042546 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54440b5670 con 0x7f545c09b800 2024-05-30T06:42:38.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5463a00640 1 -- 172.21.15.37:0/945042546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c15cfe0 con 0x7f545c09b800 2024-05-30T06:42:38.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.895+0000 7f5463a00640 1 -- 172.21.15.37:0/945042546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c15d5a0 con 0x7f545c09b800 2024-05-30T06:42:38.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.899+0000 7f5463a00640 1 -- 172.21.15.37:0/945042546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545c068bc0 con 0x7f545c09b800 2024-05-30T06:42:38.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.899+0000 7f5459600640 1 -- 172.21.15.37:0/945042546 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f54440bd020 con 0x7f545c09b800 2024-05-30T06:42:38.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.899+0000 7f5459600640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f54380683b0 0x7f543806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:38.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.899+0000 7f5459600640 1 -- 172.21.15.37:0/945042546 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5444120050 con 0x7f545c09b800 2024-05-30T06:42:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.899+0000 7f5461000640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f54380683b0 0x7f543806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.899+0000 7f5461000640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f54380683b0 0x7f543806a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f544c00b930 tx=0x7f544c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:38.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:38.903+0000 7f5459600640 1 -- 172.21.15.37:0/945042546 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f54440c4020 con 0x7f545c09b800 2024-05-30T06:42:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.067+0000 7f5463a00640 1 -- 172.21.15.37:0/945042546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f545c0b5450 con 0x7f545c09b800 2024-05-30T06:42:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.067+0000 7f5459600640 1 -- 172.21.15.37:0/945042546 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f5444016070 con 0x7f545c09b800 2024-05-30T06:42:39.068 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:42:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.071+0000 7f5463a00640 1 -- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f54380683b0 msgr2=0x7f543806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.071+0000 7f5463a00640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f54380683b0 0x7f543806a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f544c00b930 tx=0x7f544c008040 comp rx=0 tx=0).stop 2024-05-30T06:42:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.071+0000 7f5463a00640 1 -- 172.21.15.37:0/945042546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c09b800 msgr2=0x7f545c1565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.071+0000 7f5463a00640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c09b800 0x7f545c1565c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f54440af040 tx=0x7f5444019220 comp rx=0 tx=0).stop 2024-05-30T06:42:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.071+0000 7f5463a00640 1 -- 172.21.15.37:0/945042546 shutdown_connections 2024-05-30T06:42:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.071+0000 7f5463a00640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f545c15ebc0 0x7f545c15c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.071+0000 7f5463a00640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c09b800 0x7f545c1565c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.071+0000 7f5463a00640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f54380683b0 0x7f543806a870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.071+0000 7f5463a00640 1 --2- 172.21.15.37:0/945042546 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f545c06dcf0 0x7f545c156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.071+0000 7f5463a00640 1 -- 172.21.15.37:0/945042546 >> 172.21.15.37:0/945042546 conn(0x7f545c0b4060 msgr2=0x7f545c0cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.071+0000 7f5463a00640 1 -- 172.21.15.37:0/945042546 shutdown_connections 2024-05-30T06:42:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.071+0000 7f5463a00640 1 -- 172.21.15.37:0/945042546 wait complete. 2024-05-30T06:42:39.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:42:39.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.231+0000 7f72fba00640 1 Processor -- start 2024-05-30T06:42:39.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.231+0000 7f72fba00640 1 -- start start 2024-05-30T06:42:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.235+0000 7f72fba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72f4155da0 0x7f72f40cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.235+0000 7f72fba00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72f406f770 0x7f72f40b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.235+0000 7f72fba00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f415f310 con 0x7f72f40cd440 2024-05-30T06:42:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.235+0000 7f72fba00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f72f415f5f0 con 0x7f72f406f770 2024-05-30T06:42:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.235+0000 7f72fba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f72f415f8d0 con 0x7f72f4155da0 2024-05-30T06:42:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.235+0000 7f72f9a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72f406f770 0x7f72f40b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.235+0000 7f72ebe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f72f40cd440 0x7f72f406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40832/0 (socket says 172.21.15.37:40832) 2024-05-30T06:42:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.235+0000 7f72ebe00640 1 -- 172.21.15.37:0/3284911848 learned_addr learned my addr 172.21.15.37:0/3284911848 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.235+0000 7f72f9000640 1 --2- 172.21.15.37:0/3284911848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72f4155da0 0x7f72f40cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.235+0000 7f72f9a00640 1 -- 172.21.15.37:0/3284911848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72f4155da0 msgr2=0x7f72f40cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.235+0000 7f72f9a00640 1 --2- 172.21.15.37:0/3284911848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72f4155da0 0x7f72f40cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.235+0000 7f72f9a00640 1 -- 172.21.15.37:0/3284911848 >> v1:172.21.15.37:6789/0 conn(0x7f72f40cd440 legacy=0x7f72f406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.235+0000 7f72f9a00640 1 -- 172.21.15.37:0/3284911848 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f415fbb0 con 0x7f72f406f770 2024-05-30T06:42:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72f9a00640 1 --2- 172.21.15.37:0/3284911848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72f406f770 0x7f72f40b3750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009d90 tx=0x7f72ec01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb706fc957cf23f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72f3e00640 1 -- 172.21.15.37:0/3284911848 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0b2070 con 0x7f72f406f770 2024-05-30T06:42:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72f3e00640 1 -- 172.21.15.37:0/3284911848 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ec0a5710 con 0x7f72f406f770 2024-05-30T06:42:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72f3e00640 1 -- 172.21.15.37:0/3284911848 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0a5ae0 con 0x7f72f406f770 2024-05-30T06:42:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 -- 172.21.15.37:0/3284911848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72f406f770 msgr2=0x7f72f40b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 --2- 172.21.15.37:0/3284911848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72f406f770 0x7f72f40b3750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009d90 tx=0x7f72ec01c850 comp rx=0 tx=0).stop 2024-05-30T06:42:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 -- 172.21.15.37:0/3284911848 shutdown_connections 2024-05-30T06:42:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 --2- 172.21.15.37:0/3284911848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72f406f770 0x7f72f40b3750 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 --2- 172.21.15.37:0/3284911848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72f4155da0 0x7f72f40cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 -- 172.21.15.37:0/3284911848 >> 172.21.15.37:0/3284911848 conn(0x7f72f406bf60 msgr2=0x7f72f40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 -- 172.21.15.37:0/3284911848 shutdown_connections 2024-05-30T06:42:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 -- 172.21.15.37:0/3284911848 wait complete. 2024-05-30T06:42:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 Processor -- start 2024-05-30T06:42:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 -- start start 2024-05-30T06:42:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72f406f770 0x7f72f4163790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72f4155da0 0x7f72f406f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72f4072020 0x7f72f41572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f72f4168580 con 0x7f72f406f770 2024-05-30T06:42:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f72f40b46b0 con 0x7f72f4155da0 2024-05-30T06:42:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.239+0000 7f72fba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f72f4168700 con 0x7f72f4072020 2024-05-30T06:42:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f9000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72f406f770 0x7f72f4163790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f9000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72f406f770 0x7f72f4163790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37364/0 (socket says 172.21.15.37:37364) 2024-05-30T06:42:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f9000640 1 -- 172.21.15.37:0/1528680885 learned_addr learned my addr 172.21.15.37:0/1528680885 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f9000640 1 -- 172.21.15.37:0/1528680885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72f4072020 msgr2=0x7f72f41572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f9000640 1 --2- 172.21.15.37:0/1528680885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72f4072020 0x7f72f41572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f9000640 1 -- 172.21.15.37:0/1528680885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72f4155da0 msgr2=0x7f72f406f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f9000640 1 --2- 172.21.15.37:0/1528680885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72f4155da0 0x7f72f406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f9000640 1 -- 172.21.15.37:0/1528680885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f4158390 con 0x7f72f406f770 2024-05-30T06:42:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f9000640 1 --2- 172.21.15.37:0/1528680885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72f406f770 0x7f72f4163790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72e400d5f0 tx=0x7f72e400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f1600640 1 -- 172.21.15.37:0/1528680885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e40125f0 con 0x7f72f406f770 2024-05-30T06:42:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f1600640 1 -- 172.21.15.37:0/1528680885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e4019070 con 0x7f72f406f770 2024-05-30T06:42:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f1600640 1 -- 172.21.15.37:0/1528680885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e40129b0 con 0x7f72f406f770 2024-05-30T06:42:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72fba00640 1 -- 172.21.15.37:0/1528680885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f4158670 con 0x7f72f406f770 2024-05-30T06:42:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72fba00640 1 -- 172.21.15.37:0/1528680885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f4159010 con 0x7f72f406f770 2024-05-30T06:42:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72fba00640 1 -- 172.21.15.37:0/1528680885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f4158840 con 0x7f72f406f770 2024-05-30T06:42:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f1600640 1 -- 172.21.15.37:0/1528680885 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f72e4012b50 con 0x7f72f406f770 2024-05-30T06:42:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f1600640 1 --2- 172.21.15.37:0/1528680885 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f72d0068380 0x7f72d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.243+0000 7f72f1600640 1 -- 172.21.15.37:0/1528680885 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f72e4086e50 con 0x7f72f406f770 2024-05-30T06:42:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.247+0000 7f72ebe00640 1 --2- 172.21.15.37:0/1528680885 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f72d0068380 0x7f72d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.247+0000 7f72ebe00640 1 --2- 172.21.15.37:0/1528680885 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f72d0068380 0x7f72d006a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f72dc000f70 tx=0x7f72dc007a90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.247+0000 7f72f1600640 1 -- 172.21.15.37:0/1528680885 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f72f4158840 con 0x7f72f406f770 2024-05-30T06:42:39.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.411+0000 7f72fba00640 1 -- 172.21.15.37:0/1528680885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f72f40b6790 con 0x7f72f406f770 2024-05-30T06:42:39.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.415+0000 7f72f1600640 1 -- 172.21.15.37:0/1528680885 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f72e405d030 con 0x7f72f406f770 2024-05-30T06:42:39.413 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:42:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.415+0000 7f72fba00640 1 -- 172.21.15.37:0/1528680885 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f72d0068380 msgr2=0x7f72d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.415+0000 7f72fba00640 1 --2- 172.21.15.37:0/1528680885 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f72d0068380 0x7f72d006a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f72dc000f70 tx=0x7f72dc007a90 comp rx=0 tx=0).stop 2024-05-30T06:42:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.415+0000 7f72fba00640 1 -- 172.21.15.37:0/1528680885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72f406f770 msgr2=0x7f72f4163790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.415+0000 7f72fba00640 1 --2- 172.21.15.37:0/1528680885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72f406f770 0x7f72f4163790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72e400d5f0 tx=0x7f72e400dab0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.415+0000 7f72fba00640 1 -- 172.21.15.37:0/1528680885 shutdown_connections 2024-05-30T06:42:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.415+0000 7f72fba00640 1 --2- 172.21.15.37:0/1528680885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72f4072020 0x7f72f41572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.415+0000 7f72fba00640 1 --2- 172.21.15.37:0/1528680885 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f72d0068380 0x7f72d006a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.415+0000 7f72fba00640 1 --2- 172.21.15.37:0/1528680885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72f4155da0 0x7f72f406f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.415+0000 7f72fba00640 1 --2- 172.21.15.37:0/1528680885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72f406f770 0x7f72f4163790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.415+0000 7f72fba00640 1 -- 172.21.15.37:0/1528680885 >> 172.21.15.37:0/1528680885 conn(0x7f72f406bf60 msgr2=0x7f72f40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.415+0000 7f72fba00640 1 -- 172.21.15.37:0/1528680885 shutdown_connections 2024-05-30T06:42:39.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.415+0000 7f72fba00640 1 -- 172.21.15.37:0/1528680885 wait complete. 2024-05-30T06:42:39.435 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.575+0000 7f746a000640 1 Processor -- start 2024-05-30T06:42:39.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.575+0000 7f746a000640 1 -- start start 2024-05-30T06:42:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f746a000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f746406e000 0x7f74640ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f746a000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f746415cd80 0x7f74640ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f746a000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f74640cec40 0x7f746406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f746a000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f74640a9530 con 0x7f74640cec40 2024-05-30T06:42:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f746a000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f74640cd120 con 0x7f746415cd80 2024-05-30T06:42:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f746a000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f74640cd400 con 0x7f746406e000 2024-05-30T06:42:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f7463e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f74640cec40 0x7f746406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f7463e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f74640cec40 0x7f746406e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37372/0 (socket says 172.21.15.37:37372) 2024-05-30T06:42:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f7463e00640 1 -- 172.21.15.37:0/1070282794 learned_addr learned my addr 172.21.15.37:0/1070282794 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f745aa00640 1 --2- 172.21.15.37:0/1070282794 >> v2:172.21.15.105:3300/0 conn(0x7f746415cd80 0x7f74640ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f7463400640 1 --2- 172.21.15.37:0/1070282794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f746406e000 0x7f74640ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f7463e00640 1 -- 172.21.15.37:0/1070282794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f746406e000 msgr2=0x7f74640ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:39.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f7463e00640 1 --2- 172.21.15.37:0/1070282794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f746406e000 0x7f74640ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f7463e00640 1 -- 172.21.15.37:0/1070282794 >> v2:172.21.15.105:3300/0 conn(0x7f746415cd80 msgr2=0x7f74640ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:39.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f7463e00640 1 --2- 172.21.15.37:0/1070282794 >> v2:172.21.15.105:3300/0 conn(0x7f746415cd80 0x7f74640ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f7463e00640 1 -- 172.21.15.37:0/1070282794 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74640cd6e0 con 0x7f74640cec40 2024-05-30T06:42:39.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f7463400640 1 --2- 172.21.15.37:0/1070282794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f746406e000 0x7f74640ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.579+0000 7f7463e00640 1 --2- 172.21.15.37:0/1070282794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74640cec40 0x7f746406e3e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f74640b5b70 tx=0x7f745c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f89d260a4a9251 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f7462a00640 1 -- 172.21.15.37:0/1070282794 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c0b4070 con 0x7f74640cec40 2024-05-30T06:42:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f7462a00640 1 -- 172.21.15.37:0/1070282794 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745c0af400 con 0x7f74640cec40 2024-05-30T06:42:39.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f7462a00640 1 -- 172.21.15.37:0/1070282794 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c0af7d0 con 0x7f74640cec40 2024-05-30T06:42:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 -- 172.21.15.37:0/1070282794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74640cec40 msgr2=0x7f746406e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 --2- 172.21.15.37:0/1070282794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74640cec40 0x7f746406e3e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f74640b5b70 tx=0x7f745c01f1e0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 -- 172.21.15.37:0/1070282794 shutdown_connections 2024-05-30T06:42:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 --2- 172.21.15.37:0/1070282794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74640cec40 0x7f746406e3e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 --2- 172.21.15.37:0/1070282794 >> v2:172.21.15.105:3300/0 conn(0x7f746415cd80 0x7f74640ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 --2- 172.21.15.37:0/1070282794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f746406e000 0x7f74640ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 -- 172.21.15.37:0/1070282794 >> 172.21.15.37:0/1070282794 conn(0x7f74640b23a0 msgr2=0x7f74640b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 -- 172.21.15.37:0/1070282794 shutdown_connections 2024-05-30T06:42:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 -- 172.21.15.37:0/1070282794 wait complete. 2024-05-30T06:42:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 Processor -- start 2024-05-30T06:42:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 -- start start 2024-05-30T06:42:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f746406e000 0x7f746415b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74640cec40 0x7f746415e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746415cd80 0x7f746413d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74640cf0a0 con 0x7f746415cd80 2024-05-30T06:42:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74640cdca0 con 0x7f74640cec40 2024-05-30T06:42:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f746a000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f746406e920 con 0x7f746406e000 2024-05-30T06:42:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f7463e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746415cd80 0x7f746413d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f7463e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746415cd80 0x7f746413d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37378/0 (socket says 172.21.15.37:37378) 2024-05-30T06:42:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.583+0000 7f7463e00640 1 -- 172.21.15.37:0/456457065 learned_addr learned my addr 172.21.15.37:0/456457065 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f7463400640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f746406e000 0x7f746415b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f745aa00640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74640cec40 0x7f746415e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f7463e00640 1 -- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f746406e000 msgr2=0x7f746415b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f7463e00640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f746406e000 0x7f746415b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f7463e00640 1 -- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74640cec40 msgr2=0x7f746415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f7463e00640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74640cec40 0x7f746415e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f7463e00640 1 -- 172.21.15.37:0/456457065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746413c6e0 con 0x7f746415cd80 2024-05-30T06:42:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f7463e00640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746415cd80 0x7f746413d780 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f745c0b2040 tx=0x7f745c01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f745be00640 1 -- 172.21.15.37:0/456457065 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c0b4040 con 0x7f746415cd80 2024-05-30T06:42:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f745be00640 1 -- 172.21.15.37:0/456457065 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f745c0c0070 con 0x7f746415cd80 2024-05-30T06:42:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f745be00640 1 -- 172.21.15.37:0/456457065 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c009510 con 0x7f746415cd80 2024-05-30T06:42:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f746a000640 1 -- 172.21.15.37:0/456457065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746413c9c0 con 0x7f746415cd80 2024-05-30T06:42:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f746a000640 1 -- 172.21.15.37:0/456457065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746413d260 con 0x7f746415cd80 2024-05-30T06:42:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f746a000640 1 -- 172.21.15.37:0/456457065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7464068b20 con 0x7f746415cd80 2024-05-30T06:42:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f745be00640 1 -- 172.21.15.37:0/456457065 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f745c0c5460 con 0x7f746415cd80 2024-05-30T06:42:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f745be00640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74400683b0 0x7f744006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.587+0000 7f745be00640 1 -- 172.21.15.37:0/456457065 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f745c1248f0 con 0x7f746415cd80 2024-05-30T06:42:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.591+0000 7f7463400640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74400683b0 0x7f744006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.591+0000 7f7463400640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74400683b0 0x7f744006a870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f74540045f0 tx=0x7f7454008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.591+0000 7f745be00640 1 -- 172.21.15.37:0/456457065 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f745c0ca020 con 0x7f746415cd80 2024-05-30T06:42:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f746a000640 1 -- 172.21.15.37:0/456457065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f746413d430 con 0x7f746415cd80 2024-05-30T06:42:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f745be00640 1 -- 172.21.15.37:0/456457065 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7f745c018d40 con 0x7f746415cd80 2024-05-30T06:42:39.758 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:39.759 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f746a000640 1 -- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74400683b0 msgr2=0x7f744006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f746a000640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74400683b0 0x7f744006a870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f74540045f0 tx=0x7f7454008040 comp rx=0 tx=0).stop 2024-05-30T06:42:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f746a000640 1 -- 172.21.15.37:0/456457065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746415cd80 msgr2=0x7f746413d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f746a000640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746415cd80 0x7f746413d780 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f745c0b2040 tx=0x7f745c01bf80 comp rx=0 tx=0).stop 2024-05-30T06:42:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f746a000640 1 -- 172.21.15.37:0/456457065 shutdown_connections 2024-05-30T06:42:39.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f746a000640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f746415cd80 0x7f746413d780 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f746a000640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74400683b0 0x7f744006a870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f746a000640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74640cec40 0x7f746415e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f746a000640 1 --2- 172.21.15.37:0/456457065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f746406e000 0x7f746415b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f746a000640 1 -- 172.21.15.37:0/456457065 >> 172.21.15.37:0/456457065 conn(0x7f74640b23a0 msgr2=0x7f74640b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f746a000640 1 -- 172.21.15.37:0/456457065 shutdown_connections 2024-05-30T06:42:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.759+0000 7f746a000640 1 -- 172.21.15.37:0/456457065 wait complete. 2024-05-30T06:42:39.780 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:42:09.128133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:42:09.755772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:39.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:39.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.923+0000 7f951e800640 1 Processor -- start 2024-05-30T06:42:39.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.923+0000 7f951e800640 1 -- start start 2024-05-30T06:42:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.927+0000 7f951e800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9518155da0 0x7f95180cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.927+0000 7f951e800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951815f310 con 0x7f951806f770 2024-05-30T06:42:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.927+0000 7f951e800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951815f5f0 con 0x7f95180cd440 2024-05-30T06:42:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.927+0000 7f951e800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f951815f8d0 con 0x7f9518155da0 2024-05-30T06:42:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.927+0000 7f9517e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f951806f770 0x7f95180b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40834/0 (socket says 172.21.15.37:40834) 2024-05-30T06:42:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.927+0000 7f9517e00640 1 -- 172.21.15.37:0/2016709992 learned_addr learned my addr 172.21.15.37:0/2016709992 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.927+0000 7f9517400640 1 --2- 172.21.15.37:0/2016709992 >> v2:172.21.15.105:3300/0 conn(0x7f9518155da0 0x7f95180cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.927+0000 7f9516a00640 1 -- 172.21.15.37:0/2016709992 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2303976267 0 0) 0x7f951815f310 con 0x7f951806f770 2024-05-30T06:42:39.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.927+0000 7f9516a00640 1 -- 172.21.15.37:0/2016709992 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94fc003530 con 0x7f951806f770 2024-05-30T06:42:39.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.927+0000 7f9517400640 1 -- 172.21.15.37:0/2016709992 >> v1:172.21.15.105:6789/0 conn(0x7f95180cd440 legacy=0x7f951806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.927+0000 7f9516a00640 1 -- 172.21.15.37:0/2016709992 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818195790 0 0) 0x7f951815f5f0 con 0x7f95180cd440 2024-05-30T06:42:39.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.927+0000 7f9517400640 1 -- 172.21.15.37:0/2016709992 >> v1:172.21.15.37:6789/0 conn(0x7f951806f770 legacy=0x7f95180b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.927+0000 7f9517400640 1 -- 172.21.15.37:0/2016709992 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951815fbb0 con 0x7f9518155da0 2024-05-30T06:42:39.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.931+0000 7f9517400640 1 --2- 172.21.15.37:0/2016709992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9518155da0 0x7f95180cd950 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f95080097c0 tx=0x7f950801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d4139bed567cddf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:39.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.931+0000 7f9516a00640 1 -- 172.21.15.37:0/2016709992 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95080b0070 con 0x7f9518155da0 2024-05-30T06:42:39.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.931+0000 7f9516a00640 1 -- 172.21.15.37:0/2016709992 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95080ab600 con 0x7f9518155da0 2024-05-30T06:42:39.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.931+0000 7f9516a00640 1 -- 172.21.15.37:0/2016709992 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95080ab9d0 con 0x7f9518155da0 2024-05-30T06:42:39.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.931+0000 7f951e800640 1 -- 172.21.15.37:0/2016709992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9518155da0 msgr2=0x7f95180cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.931+0000 7f951e800640 1 --2- 172.21.15.37:0/2016709992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9518155da0 0x7f95180cd950 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f95080097c0 tx=0x7f950801c380 comp rx=0 tx=0).stop 2024-05-30T06:42:39.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.931+0000 7f951e800640 1 -- 172.21.15.37:0/2016709992 shutdown_connections 2024-05-30T06:42:39.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.931+0000 7f951e800640 1 --2- 172.21.15.37:0/2016709992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9518155da0 0x7f95180cd950 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.931+0000 7f951e800640 1 -- 172.21.15.37:0/2016709992 >> 172.21.15.37:0/2016709992 conn(0x7f951806bf60 msgr2=0x7f95180b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:39.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.931+0000 7f951e800640 1 -- 172.21.15.37:0/2016709992 shutdown_connections 2024-05-30T06:42:39.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.931+0000 7f951e800640 1 -- 172.21.15.37:0/2016709992 wait complete. 2024-05-30T06:42:39.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.931+0000 7f951e800640 1 Processor -- start 2024-05-30T06:42:39.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.931+0000 7f951e800640 1 -- start start 2024-05-30T06:42:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f951e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951806f770 0x7f951814ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f951e800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9518155da0 0x7f9518148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f951e800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9518153850 0x7f9518153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f951e800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9518169920 con 0x7f951806f770 2024-05-30T06:42:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f951e800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95181697a0 con 0x7f9518153850 2024-05-30T06:42:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f951e800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9518169aa0 con 0x7f9518155da0 2024-05-30T06:42:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f9517400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951806f770 0x7f951814ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f9517400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951806f770 0x7f951814ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37394/0 (socket says 172.21.15.37:37394) 2024-05-30T06:42:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f9517400640 1 -- 172.21.15.37:0/1076009949 learned_addr learned my addr 172.21.15.37:0/1076009949 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:39.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f9517400640 1 -- 172.21.15.37:0/1076009949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9518155da0 msgr2=0x7f9518148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f9517400640 1 --2- 172.21.15.37:0/1076009949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9518155da0 0x7f9518148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f9517400640 1 -- 172.21.15.37:0/1076009949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9518153850 msgr2=0x7f9518153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f9517400640 1 --2- 172.21.15.37:0/1076009949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9518153850 0x7f9518153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f9517400640 1 -- 172.21.15.37:0/1076009949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9518154660 con 0x7f951806f770 2024-05-30T06:42:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f9517400640 1 --2- 172.21.15.37:0/1076009949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951806f770 0x7f951814ab90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f95080097c0 tx=0x7f9508019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f950fe00640 1 -- 172.21.15.37:0/1076009949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95080b8070 con 0x7f951806f770 2024-05-30T06:42:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f950fe00640 1 -- 172.21.15.37:0/1076009949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9508004020 con 0x7f951806f770 2024-05-30T06:42:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f951e800640 1 -- 172.21.15.37:0/1076009949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95181522f0 con 0x7f951806f770 2024-05-30T06:42:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f950fe00640 1 -- 172.21.15.37:0/1076009949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95080b0040 con 0x7f951806f770 2024-05-30T06:42:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f951e800640 1 -- 172.21.15.37:0/1076009949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95181528b0 con 0x7f951806f770 2024-05-30T06:42:39.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f951e800640 1 -- 172.21.15.37:0/1076009949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9518068bc0 con 0x7f951806f770 2024-05-30T06:42:39.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.935+0000 7f950fe00640 1 -- 172.21.15.37:0/1076009949 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9508003620 con 0x7f951806f770 2024-05-30T06:42:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.939+0000 7f950fe00640 1 --2- 172.21.15.37:0/1076009949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f94f4068380 0x7f94f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.939+0000 7f950fe00640 1 -- 172.21.15.37:0/1076009949 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f95081205a0 con 0x7f951806f770 2024-05-30T06:42:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.939+0000 7f950ea00640 1 --2- 172.21.15.37:0/1076009949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f94f4068380 0x7f94f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:39.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.939+0000 7f950ea00640 1 --2- 172.21.15.37:0/1076009949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f94f4068380 0x7f94f406a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9500007fd0 tx=0x7f9500007920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:39.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:39.943+0000 7f950fe00640 1 -- 172.21.15.37:0/1076009949 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9508016090 con 0x7f951806f770 2024-05-30T06:42:40.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.107+0000 7f951e800640 1 -- 172.21.15.37:0/1076009949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f95180b3c10 con 0x7f951806f770 2024-05-30T06:42:40.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.107+0000 7f950fe00640 1 -- 172.21.15.37:0/1076009949 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f95080f0ac0 con 0x7f951806f770 2024-05-30T06:42:40.107 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:40.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.111+0000 7f951e800640 1 -- 172.21.15.37:0/1076009949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f94f4068380 msgr2=0x7f94f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.111+0000 7f951e800640 1 --2- 172.21.15.37:0/1076009949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f94f4068380 0x7f94f406a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9500007fd0 tx=0x7f9500007920 comp rx=0 tx=0).stop 2024-05-30T06:42:40.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.111+0000 7f951e800640 1 -- 172.21.15.37:0/1076009949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951806f770 msgr2=0x7f951814ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.111+0000 7f951e800640 1 --2- 172.21.15.37:0/1076009949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951806f770 0x7f951814ab90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f95080097c0 tx=0x7f9508019120 comp rx=0 tx=0).stop 2024-05-30T06:42:40.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.111+0000 7f951e800640 1 -- 172.21.15.37:0/1076009949 shutdown_connections 2024-05-30T06:42:40.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.111+0000 7f951e800640 1 --2- 172.21.15.37:0/1076009949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f94f4068380 0x7f94f406a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.111+0000 7f951e800640 1 --2- 172.21.15.37:0/1076009949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9518153850 0x7f9518153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.111+0000 7f951e800640 1 --2- 172.21.15.37:0/1076009949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9518155da0 0x7f9518148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.111+0000 7f951e800640 1 --2- 172.21.15.37:0/1076009949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f951806f770 0x7f951814ab90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.111+0000 7f951e800640 1 -- 172.21.15.37:0/1076009949 >> 172.21.15.37:0/1076009949 conn(0x7f951806bf60 msgr2=0x7f9518072800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:40.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.111+0000 7f951e800640 1 -- 172.21.15.37:0/1076009949 shutdown_connections 2024-05-30T06:42:40.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.111+0000 7f951e800640 1 -- 172.21.15.37:0/1076009949 wait complete. 2024-05-30T06:42:40.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:42:40.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.271+0000 7f1804000640 1 Processor -- start 2024-05-30T06:42:40.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1804000640 1 -- start start 2024-05-30T06:42:40.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1804000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f17fc0b59d0 0x7f17fc0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:40.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1804000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f17fc15d350 0x7f17fc160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:40.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1804000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17fc0b62f0 con 0x7f17fc15d7e0 2024-05-30T06:42:40.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1804000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f17fc142030 con 0x7f17fc15d350 2024-05-30T06:42:40.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1804000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f17fc142310 con 0x7f17fc0b59d0 2024-05-30T06:42:40.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1800c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f17fc15d350 0x7f17fc160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1800c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f17fc15d350 0x7f17fc160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37402/0 (socket says 172.21.15.37:37402) 2024-05-30T06:42:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1800c00640 1 -- 172.21.15.37:0/1363792410 learned_addr learned my addr 172.21.15.37:0/1363792410 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1801600640 1 --2- 172.21.15.37:0/1363792410 >> v2:172.21.15.105:3300/0 conn(0x7f17fc0b59d0 0x7f17fc0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1800c00640 1 -- 172.21.15.37:0/1363792410 >> v2:172.21.15.105:3300/0 conn(0x7f17fc0b59d0 msgr2=0x7f17fc0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:40.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1800c00640 1 --2- 172.21.15.37:0/1363792410 >> v2:172.21.15.105:3300/0 conn(0x7f17fc0b59d0 0x7f17fc0b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1800c00640 1 -- 172.21.15.37:0/1363792410 >> v1:172.21.15.37:6789/0 conn(0x7f17fc15d7e0 legacy=0x7f17fc1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1800c00640 1 -- 172.21.15.37:0/1363792410 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc1425f0 con 0x7f17fc15d350 2024-05-30T06:42:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f1801600640 1 --2- 172.21.15.37:0/1363792410 >> v2:172.21.15.105:3300/0 conn(0x7f17fc0b59d0 0x7f17fc0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.275+0000 7f17fbe00640 1 -- 172.21.15.37:0/1363792410 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 941144531 0 0) 0x7f17fc0b62f0 con 0x7f17fc15d7e0 2024-05-30T06:42:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f1800c00640 1 --2- 172.21.15.37:0/1363792410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17fc15d350 0x7f17fc160280 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009870 tx=0x7f17e801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6002162651f183b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f17fbe00640 1 -- 172.21.15.37:0/1363792410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e80b5070 con 0x7f17fc15d350 2024-05-30T06:42:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f17fbe00640 1 -- 172.21.15.37:0/1363792410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e80a8a10 con 0x7f17fc15d350 2024-05-30T06:42:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f17fbe00640 1 -- 172.21.15.37:0/1363792410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e80a8de0 con 0x7f17fc15d350 2024-05-30T06:42:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f1804000640 1 -- 172.21.15.37:0/1363792410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17fc15d350 msgr2=0x7f17fc160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f1804000640 1 --2- 172.21.15.37:0/1363792410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17fc15d350 0x7f17fc160280 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009870 tx=0x7f17e801ed10 comp rx=0 tx=0).stop 2024-05-30T06:42:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f1804000640 1 -- 172.21.15.37:0/1363792410 shutdown_connections 2024-05-30T06:42:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f1804000640 1 --2- 172.21.15.37:0/1363792410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17fc15d350 0x7f17fc160280 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f1804000640 1 --2- 172.21.15.37:0/1363792410 >> v2:172.21.15.105:3300/0 conn(0x7f17fc0b59d0 0x7f17fc0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f1804000640 1 -- 172.21.15.37:0/1363792410 >> 172.21.15.37:0/1363792410 conn(0x7f17fc06bf60 msgr2=0x7f17fc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f1804000640 1 -- 172.21.15.37:0/1363792410 shutdown_connections 2024-05-30T06:42:40.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f1804000640 1 -- 172.21.15.37:0/1363792410 wait complete. 2024-05-30T06:42:40.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f1804000640 1 Processor -- start 2024-05-30T06:42:40.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.279+0000 7f1804000640 1 -- start start 2024-05-30T06:42:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1804000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17fc0b59d0 0x7f17fc15ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1804000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17fc15d350 0x7f17fc137be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1804000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17fc15d7e0 0x7f17fc0b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1804000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc13fe60 con 0x7f17fc15d7e0 2024-05-30T06:42:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1804000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc13fce0 con 0x7f17fc0b59d0 2024-05-30T06:42:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1804000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f17fc0aff20 con 0x7f17fc15d350 2024-05-30T06:42:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1802000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17fc15d7e0 0x7f17fc0b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1802000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17fc15d7e0 0x7f17fc0b1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37404/0 (socket says 172.21.15.37:37404) 2024-05-30T06:42:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1802000640 1 -- 172.21.15.37:0/2262443420 learned_addr learned my addr 172.21.15.37:0/2262443420 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1800c00640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17fc15d350 0x7f17fc137be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1801600640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17fc0b59d0 0x7f17fc15ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1802000640 1 -- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17fc15d350 msgr2=0x7f17fc137be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1802000640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17fc15d350 0x7f17fc137be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1802000640 1 -- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17fc0b59d0 msgr2=0x7f17fc15ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1802000640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17fc0b59d0 0x7f17fc15ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1802000640 1 -- 172.21.15.37:0/2262443420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc156930 con 0x7f17fc15d7e0 2024-05-30T06:42:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1801600640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17fc0b59d0 0x7f17fc15ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1802000640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17fc15d7e0 0x7f17fc0b1270 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f17f400c780 tx=0x7f17f400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f17f9600640 1 -- 172.21.15.37:0/2262443420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f4003db0 con 0x7f17fc15d7e0 2024-05-30T06:42:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f17f9600640 1 -- 172.21.15.37:0/2262443420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f400ce30 con 0x7f17fc15d7e0 2024-05-30T06:42:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f17f9600640 1 -- 172.21.15.37:0/2262443420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f4005290 con 0x7f17fc15d7e0 2024-05-30T06:42:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1804000640 1 -- 172.21.15.37:0/2262443420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17fc15df20 con 0x7f17fc15d7e0 2024-05-30T06:42:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1804000640 1 -- 172.21.15.37:0/2262443420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17fc15e4e0 con 0x7f17fc15d7e0 2024-05-30T06:42:40.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f1804000640 1 -- 172.21.15.37:0/2262443420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17fc068bc0 con 0x7f17fc15d7e0 2024-05-30T06:42:40.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.283+0000 7f17f9600640 1 -- 172.21.15.37:0/2262443420 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f17f4005430 con 0x7f17fc15d7e0 2024-05-30T06:42:40.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.287+0000 7f17f9600640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f17dc068380 0x7f17dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:40.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.287+0000 7f17f9600640 1 -- 172.21.15.37:0/2262443420 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f17f4086760 con 0x7f17fc15d7e0 2024-05-30T06:42:40.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.287+0000 7f1801600640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f17dc068380 0x7f17dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:40.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.287+0000 7f1801600640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f17dc068380 0x7f17dc06a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f17f0006fd0 tx=0x7f17f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:40.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.291+0000 7f17f9600640 1 -- 172.21.15.37:0/2262443420 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f17f4056db0 con 0x7f17fc15d7e0 2024-05-30T06:42:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.455+0000 7f1804000640 1 -- 172.21.15.37:0/2262443420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f17fc156f60 con 0x7f17fc15d7e0 2024-05-30T06:42:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.455+0000 7f17f9600640 1 -- 172.21.15.37:0/2262443420 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f17f40566b0 con 0x7f17fc15d7e0 2024-05-30T06:42:40.455 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:42:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.455+0000 7f1804000640 1 -- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f17dc068380 msgr2=0x7f17dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.455+0000 7f1804000640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f17dc068380 0x7f17dc06a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f17f0006fd0 tx=0x7f17f0008040 comp rx=0 tx=0).stop 2024-05-30T06:42:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.455+0000 7f1804000640 1 -- 172.21.15.37:0/2262443420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17fc15d7e0 msgr2=0x7f17fc0b1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.455+0000 7f1804000640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17fc15d7e0 0x7f17fc0b1270 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f17f400c780 tx=0x7f17f400cc40 comp rx=0 tx=0).stop 2024-05-30T06:42:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.459+0000 7f1804000640 1 -- 172.21.15.37:0/2262443420 shutdown_connections 2024-05-30T06:42:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.459+0000 7f1804000640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17fc15d7e0 0x7f17fc0b1270 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.459+0000 7f1804000640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17fc15d350 0x7f17fc137be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.459+0000 7f1804000640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f17dc068380 0x7f17dc06a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.459+0000 7f1804000640 1 --2- 172.21.15.37:0/2262443420 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17fc0b59d0 0x7f17fc15ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.459+0000 7f1804000640 1 -- 172.21.15.37:0/2262443420 >> 172.21.15.37:0/2262443420 conn(0x7f17fc06bf60 msgr2=0x7f17fc140560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.459+0000 7f1804000640 1 -- 172.21.15.37:0/2262443420 shutdown_connections 2024-05-30T06:42:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.459+0000 7f1804000640 1 -- 172.21.15.37:0/2262443420 wait complete. 2024-05-30T06:42:40.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:42:40.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.619+0000 7fbe66800640 1 Processor -- start 2024-05-30T06:42:40.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.619+0000 7fbe66800640 1 -- start start 2024-05-30T06:42:40.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe66800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6006cbd0 0x7fbe600d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:40.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe66800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbe6006cfb0 0x7fbe6006e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:40.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe66800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe600cf670 con 0x7fbe6006ec40 2024-05-30T06:42:40.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe66800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbe600cf950 con 0x7fbe6006cfb0 2024-05-30T06:42:40.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe66800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbe600cfc30 con 0x7fbe6006cbd0 2024-05-30T06:42:40.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe64a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbe6006cfb0 0x7fbe6006e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:40.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe64a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbe6006cfb0 0x7fbe6006e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37418/0 (socket says 172.21.15.37:37418) 2024-05-30T06:42:40.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe64a00640 1 -- 172.21.15.37:0/331366748 learned_addr learned my addr 172.21.15.37:0/331366748 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:40.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe65e00640 1 --1- 172.21.15.37:0/331366748 >> v1:172.21.15.37:6789/0 conn(0x7fbe6006ec40 0x7fbe600adda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40844/0 (socket says 172.21.15.37:40844) 2024-05-30T06:42:40.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe65400640 1 --2- 172.21.15.37:0/331366748 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6006cbd0 0x7fbe600d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:40.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe64a00640 1 -- 172.21.15.37:0/331366748 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6006cbd0 msgr2=0x7fbe600d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:40.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe64a00640 1 --2- 172.21.15.37:0/331366748 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6006cbd0 0x7fbe600d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe64a00640 1 -- 172.21.15.37:0/331366748 >> v1:172.21.15.37:6789/0 conn(0x7fbe6006ec40 legacy=0x7fbe600adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe64a00640 1 -- 172.21.15.37:0/331366748 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe600cff10 con 0x7fbe6006cfb0 2024-05-30T06:42:40.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.623+0000 7fbe5fe00640 1 -- 172.21.15.37:0/331366748 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1568633327 0 0) 0x7fbe600cf670 con 0x7fbe6006ec40 2024-05-30T06:42:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe64a00640 1 --2- 172.21.15.37:0/331366748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6006cfb0 0x7fbe6006e700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009870 tx=0x7fbe4c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198923a70ee31f1e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe5fe00640 1 -- 172.21.15.37:0/331366748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c0ab620 con 0x7fbe6006cfb0 2024-05-30T06:42:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe5fe00640 1 -- 172.21.15.37:0/331366748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4c0b0070 con 0x7fbe6006cfb0 2024-05-30T06:42:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe5fe00640 1 -- 172.21.15.37:0/331366748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c0ab9e0 con 0x7fbe6006cfb0 2024-05-30T06:42:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 -- 172.21.15.37:0/331366748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6006cfb0 msgr2=0x7fbe6006e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 --2- 172.21.15.37:0/331366748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6006cfb0 0x7fbe6006e700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009870 tx=0x7fbe4c01c440 comp rx=0 tx=0).stop 2024-05-30T06:42:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 -- 172.21.15.37:0/331366748 shutdown_connections 2024-05-30T06:42:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 --2- 172.21.15.37:0/331366748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6006cfb0 0x7fbe6006e700 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 --2- 172.21.15.37:0/331366748 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6006cbd0 0x7fbe600d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 -- 172.21.15.37:0/331366748 >> 172.21.15.37:0/331366748 conn(0x7fbe600ce540 msgr2=0x7fbe60072680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 -- 172.21.15.37:0/331366748 shutdown_connections 2024-05-30T06:42:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 -- 172.21.15.37:0/331366748 wait complete. 2024-05-30T06:42:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 Processor -- start 2024-05-30T06:42:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 -- start start 2024-05-30T06:42:40.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6006cbd0 0x7fbe6009e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6006cfb0 0x7fbe60156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6006ec40 0x7fbe60152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbe60073970 con 0x7fbe6006ec40 2024-05-30T06:42:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbe600737f0 con 0x7fbe6006cbd0 2024-05-30T06:42:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe66800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbe60169760 con 0x7fbe6006cfb0 2024-05-30T06:42:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.627+0000 7fbe65e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6006ec40 0x7fbe60152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe65e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6006ec40 0x7fbe60152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37432/0 (socket says 172.21.15.37:37432) 2024-05-30T06:42:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe65e00640 1 -- 172.21.15.37:0/4028786140 learned_addr learned my addr 172.21.15.37:0/4028786140 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe64a00640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6006cfb0 0x7fbe60156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe65400640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6006cbd0 0x7fbe6009e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe65e00640 1 -- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6006cfb0 msgr2=0x7fbe60156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe65e00640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6006cfb0 0x7fbe60156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe65e00640 1 -- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6006cbd0 msgr2=0x7fbe6009e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe65e00640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6006cbd0 0x7fbe6009e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe65e00640 1 -- 172.21.15.37:0/4028786140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe60160650 con 0x7fbe6006ec40 2024-05-30T06:42:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe65e00640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6006ec40 0x7fbe60152030 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800c750 tx=0x7fbe5800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe5d600640 1 -- 172.21.15.37:0/4028786140 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58018070 con 0x7fbe6006ec40 2024-05-30T06:42:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe5d600640 1 -- 172.21.15.37:0/4028786140 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe5800a640 con 0x7fbe6006ec40 2024-05-30T06:42:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe5d600640 1 -- 172.21.15.37:0/4028786140 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800ce60 con 0x7fbe6006ec40 2024-05-30T06:42:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe66800640 1 -- 172.21.15.37:0/4028786140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe60157340 con 0x7fbe6006ec40 2024-05-30T06:42:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe66800640 1 -- 172.21.15.37:0/4028786140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe60157900 con 0x7fbe6006ec40 2024-05-30T06:42:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe66800640 1 -- 172.21.15.37:0/4028786140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe60157b40 con 0x7fbe6006ec40 2024-05-30T06:42:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.631+0000 7fbe5d600640 1 -- 172.21.15.37:0/4028786140 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe5800aa30 con 0x7fbe6006ec40 2024-05-30T06:42:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.635+0000 7fbe5d600640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbe40068380 0x7fbe4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.635+0000 7fbe5d600640 1 -- 172.21.15.37:0/4028786140 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fbe58085fb0 con 0x7fbe6006ec40 2024-05-30T06:42:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.635+0000 7fbe65400640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbe40068380 0x7fbe4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.635+0000 7fbe65400640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbe40068380 0x7fbe4006a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbe60157d40 tx=0x7fbe54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.639+0000 7fbe5d600640 1 -- 172.21.15.37:0/4028786140 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbe60157b40 con 0x7fbe6006ec40 2024-05-30T06:42:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe66800640 1 -- 172.21.15.37:0/4028786140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbe60075580 con 0x7fbe6006ec40 2024-05-30T06:42:40.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe5d600640 1 -- 172.21.15.37:0/4028786140 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fbe58055e80 con 0x7fbe6006ec40 2024-05-30T06:42:40.805 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:42:40.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe66800640 1 -- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbe40068380 msgr2=0x7fbe4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe66800640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbe40068380 0x7fbe4006a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbe60157d40 tx=0x7fbe54008040 comp rx=0 tx=0).stop 2024-05-30T06:42:40.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe66800640 1 -- 172.21.15.37:0/4028786140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6006ec40 msgr2=0x7fbe60152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:40.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe66800640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6006ec40 0x7fbe60152030 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800c750 tx=0x7fbe5800cc10 comp rx=0 tx=0).stop 2024-05-30T06:42:40.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe66800640 1 -- 172.21.15.37:0/4028786140 shutdown_connections 2024-05-30T06:42:40.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe66800640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe6006ec40 0x7fbe60152030 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe66800640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6006cfb0 0x7fbe60156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe66800640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbe40068380 0x7fbe4006a840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe66800640 1 --2- 172.21.15.37:0/4028786140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6006cbd0 0x7fbe6009e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:40.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe66800640 1 -- 172.21.15.37:0/4028786140 >> 172.21.15.37:0/4028786140 conn(0x7fbe600ce540 msgr2=0x7fbe600adda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:40.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe66800640 1 -- 172.21.15.37:0/4028786140 shutdown_connections 2024-05-30T06:42:40.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:40.807+0000 7fbe66800640 1 -- 172.21.15.37:0/4028786140 wait complete. 2024-05-30T06:42:40.904 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that when one clone is in progress, one progress bar is printed 2024-05-30T06:42:40.904 INFO:tasks.cephfs_test_runner:test_progress_bar_for_1_clone (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T06:42:40.905 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:41.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf9e00640 1 Processor -- start 2024-05-30T06:42:41.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf9e00640 1 -- start start 2024-05-30T06:42:41.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf9e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bf409b9a0 0x7f7bf41625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf9e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7bf4162ae0 0x7f7bf40ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf9e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf409abe0 con 0x7f7bf415e930 2024-05-30T06:42:41.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf9e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf4162f50 con 0x7f7bf4162ae0 2024-05-30T06:42:41.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf9e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf409aec0 con 0x7f7bf409b9a0 2024-05-30T06:42:41.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7bf4162ae0 0x7f7bf40ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7bf4162ae0 0x7f7bf40ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37440/0 (socket says 172.21.15.37:37440) 2024-05-30T06:42:41.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf3400640 1 -- 172.21.15.37:0/2568153844 learned_addr learned my addr 172.21.15.37:0/2568153844 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:41.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bebe00640 1 --2- 172.21.15.37:0/2568153844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bf409b9a0 0x7f7bf41625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf3400640 1 -- 172.21.15.37:0/2568153844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bf409b9a0 msgr2=0x7f7bf41625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:41.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf3400640 1 --2- 172.21.15.37:0/2568153844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bf409b9a0 0x7f7bf41625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf3400640 1 -- 172.21.15.37:0/2568153844 >> v1:172.21.15.105:6789/0 conn(0x7f7bf415e930 legacy=0x7f7bf40d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:41.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.047+0000 7f7bf3400640 1 -- 172.21.15.37:0/2568153844 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf409b1a0 con 0x7f7bf4162ae0 2024-05-30T06:42:41.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.051+0000 7f7bf3400640 1 --2- 172.21.15.37:0/2568153844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf4162ae0 0x7f7bf40ccc60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7bec009e50 tx=0x7f7bec01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f25d5b05d4a7eb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.051+0000 7f7bf2000640 1 -- 172.21.15.37:0/2568153844 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec0a57f0 con 0x7f7bf4162ae0 2024-05-30T06:42:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.051+0000 7f7bf2000640 1 -- 172.21.15.37:0/2568153844 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec0a5990 con 0x7f7bf4162ae0 2024-05-30T06:42:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.051+0000 7f7bf2000640 1 -- 172.21.15.37:0/2568153844 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec0a5d60 con 0x7f7bf4162ae0 2024-05-30T06:42:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.051+0000 7f7bf9e00640 1 -- 172.21.15.37:0/2568153844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf4162ae0 msgr2=0x7f7bf40ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.051+0000 7f7bf9e00640 1 --2- 172.21.15.37:0/2568153844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf4162ae0 0x7f7bf40ccc60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7bec009e50 tx=0x7f7bec01ca30 comp rx=0 tx=0).stop 2024-05-30T06:42:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.051+0000 7f7bf9e00640 1 -- 172.21.15.37:0/2568153844 shutdown_connections 2024-05-30T06:42:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.051+0000 7f7bf9e00640 1 --2- 172.21.15.37:0/2568153844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf4162ae0 0x7f7bf40ccc60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.051+0000 7f7bf9e00640 1 --2- 172.21.15.37:0/2568153844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bf409b9a0 0x7f7bf41625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.051+0000 7f7bf9e00640 1 -- 172.21.15.37:0/2568153844 >> 172.21.15.37:0/2568153844 conn(0x7f7bf40b4100 msgr2=0x7f7bf40b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:41.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.051+0000 7f7bf9e00640 1 -- 172.21.15.37:0/2568153844 shutdown_connections 2024-05-30T06:42:41.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.051+0000 7f7bf9e00640 1 -- 172.21.15.37:0/2568153844 wait complete. 2024-05-30T06:42:41.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf9e00640 1 Processor -- start 2024-05-30T06:42:41.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf9e00640 1 -- start start 2024-05-30T06:42:41.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf409b9a0 0x7f7bf415dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf9e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bf415e930 0x7f7bf415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf9e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bf4162ae0 0x7f7bf40b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf9e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf406ddc0 con 0x7f7bf409b9a0 2024-05-30T06:42:41.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf9e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf406dc40 con 0x7f7bf4162ae0 2024-05-30T06:42:41.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf9e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf415ed10 con 0x7f7bf415e930 2024-05-30T06:42:41.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf409b9a0 0x7f7bf415dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf409b9a0 0x7f7bf415dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37442/0 (socket says 172.21.15.37:37442) 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf2a00640 1 -- 172.21.15.37:0/3548390199 learned_addr learned my addr 172.21.15.37:0/3548390199 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bebe00640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bf415e930 0x7f7bf415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf3400640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bf4162ae0 0x7f7bf40b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf2a00640 1 -- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bf415e930 msgr2=0x7f7bf415c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf2a00640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bf415e930 0x7f7bf415c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf2a00640 1 -- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bf4162ae0 msgr2=0x7f7bf40b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf2a00640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bf4162ae0 0x7f7bf40b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf2a00640 1 -- 172.21.15.37:0/3548390199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf415cc60 con 0x7f7bf409b9a0 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf2a00640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf409b9a0 0x7f7bf415dd00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7be400c3c0 tx=0x7f7be400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7beb400640 1 -- 172.21.15.37:0/3548390199 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4017070 con 0x7f7bf409b9a0 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7beb400640 1 -- 172.21.15.37:0/3548390199 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be40052d0 con 0x7f7bf409b9a0 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7beb400640 1 -- 172.21.15.37:0/3548390199 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4003840 con 0x7f7bf409b9a0 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf9e00640 1 -- 172.21.15.37:0/3548390199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf415cf40 con 0x7f7bf409b9a0 2024-05-30T06:42:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf9e00640 1 -- 172.21.15.37:0/3548390199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf415d500 con 0x7f7bf409b9a0 2024-05-30T06:42:41.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.055+0000 7f7bf9e00640 1 -- 172.21.15.37:0/3548390199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf4068b20 con 0x7f7bf409b9a0 2024-05-30T06:42:41.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.059+0000 7f7beb400640 1 -- 172.21.15.37:0/3548390199 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7be401a070 con 0x7f7bf409b9a0 2024-05-30T06:42:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.059+0000 7f7beb400640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7bd0068380 0x7f7bd006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.059+0000 7f7beb400640 1 -- 172.21.15.37:0/3548390199 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7be4085cd0 con 0x7f7bf409b9a0 2024-05-30T06:42:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.059+0000 7f7bebe00640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7bd0068380 0x7f7bd006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.059+0000 7f7bebe00640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7bd0068380 0x7f7bd006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4075250 tx=0x7f7bdc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:41.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.063+0000 7f7beb400640 1 -- 172.21.15.37:0/3548390199 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7be4005480 con 0x7f7bf409b9a0 2024-05-30T06:42:41.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.227+0000 7f7bf9e00640 1 -- 172.21.15.37:0/3548390199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bf4162380 con 0x7f7bf409b9a0 2024-05-30T06:42:41.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.227+0000 7f7beb400640 1 -- 172.21.15.37:0/3548390199 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7f7be4056280 con 0x7f7bf409b9a0 2024-05-30T06:42:41.228 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:41.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.231+0000 7f7bf9e00640 1 -- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7bd0068380 msgr2=0x7f7bd006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.231+0000 7f7bf9e00640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7bd0068380 0x7f7bd006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4075250 tx=0x7f7bdc008040 comp rx=0 tx=0).stop 2024-05-30T06:42:41.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.231+0000 7f7bf9e00640 1 -- 172.21.15.37:0/3548390199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf409b9a0 msgr2=0x7f7bf415dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.231+0000 7f7bf9e00640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf409b9a0 0x7f7bf415dd00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7be400c3c0 tx=0x7f7be400c880 comp rx=0 tx=0).stop 2024-05-30T06:42:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.231+0000 7f7bf9e00640 1 -- 172.21.15.37:0/3548390199 shutdown_connections 2024-05-30T06:42:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.231+0000 7f7bf9e00640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7bd0068380 0x7f7bd006a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.231+0000 7f7bf9e00640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7bf4162ae0 0x7f7bf40b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.231+0000 7f7bf9e00640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bf415e930 0x7f7bf415c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.231+0000 7f7bf9e00640 1 --2- 172.21.15.37:0/3548390199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf409b9a0 0x7f7bf415dd00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.231+0000 7f7bf9e00640 1 -- 172.21.15.37:0/3548390199 >> 172.21.15.37:0/3548390199 conn(0x7f7bf40b4100 msgr2=0x7f7bf4157860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.231+0000 7f7bf9e00640 1 -- 172.21.15.37:0/3548390199 shutdown_connections 2024-05-30T06:42:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.231+0000 7f7bf9e00640 1 -- 172.21.15.37:0/3548390199 wait complete. 2024-05-30T06:42:41.250 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:42:09.128133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:42:09.755772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:41.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:41.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f9bc00640 1 Processor -- start 2024-05-30T06:42:41.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f9bc00640 1 -- start start 2024-05-30T06:42:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f9bc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f9415d350 0x7f4f9406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f9bc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4f9415d7b0 0x7f4f9406e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f9bc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f94142030 con 0x7f4f940b59d0 2024-05-30T06:42:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f9bc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4f94142310 con 0x7f4f9415d7b0 2024-05-30T06:42:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f9bc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4f941425f0 con 0x7f4f9415d350 2024-05-30T06:42:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f99200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4f940b59d0 0x7f4f940b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40848/0 (socket says 172.21.15.37:40848) 2024-05-30T06:42:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f99200640 1 -- 172.21.15.37:0/3915110862 learned_addr learned my addr 172.21.15.37:0/3915110862 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f99c00640 1 --2- 172.21.15.37:0/3915110862 >> v2:172.21.15.105:3300/0 conn(0x7f4f9415d7b0 0x7f4f9406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f8be00640 1 --2- 172.21.15.37:0/3915110862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f9415d350 0x7f4f9406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f93e00640 1 -- 172.21.15.37:0/3915110862 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2252082749 0 0) 0x7f4f94142030 con 0x7f4f940b59d0 2024-05-30T06:42:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f93e00640 1 -- 172.21.15.37:0/3915110862 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f78003530 con 0x7f4f940b59d0 2024-05-30T06:42:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f99c00640 1 -- 172.21.15.37:0/3915110862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f9415d350 msgr2=0x7f4f9406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f93e00640 1 -- 172.21.15.37:0/3915110862 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3827411284 0 0) 0x7f4f78003530 con 0x7f4f940b59d0 2024-05-30T06:42:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f99c00640 1 --2- 172.21.15.37:0/3915110862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f9415d350 0x7f4f9406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.395+0000 7f4f99c00640 1 -- 172.21.15.37:0/3915110862 >> v1:172.21.15.37:6789/0 conn(0x7f4f940b59d0 legacy=0x7f4f940b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.399+0000 7f4f99c00640 1 -- 172.21.15.37:0/3915110862 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f941428d0 con 0x7f4f9415d7b0 2024-05-30T06:42:41.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.399+0000 7f4f99c00640 1 --2- 172.21.15.37:0/3915110862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f9415d7b0 0x7f4f9406e490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009d90 tx=0x7f4f8c01f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8f1d7c937584e3d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:41.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.399+0000 7f4f93e00640 1 -- 172.21.15.37:0/3915110862 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0b5070 con 0x7f4f9415d7b0 2024-05-30T06:42:41.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.399+0000 7f4f93e00640 1 -- 172.21.15.37:0/3915110862 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c0a8bd0 con 0x7f4f9415d7b0 2024-05-30T06:42:41.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.399+0000 7f4f93e00640 1 -- 172.21.15.37:0/3915110862 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f84001680 con 0x7f4f9415d7b0 2024-05-30T06:42:41.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.399+0000 7f4f9bc00640 1 -- 172.21.15.37:0/3915110862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f9415d7b0 msgr2=0x7f4f9406e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.399+0000 7f4f9bc00640 1 --2- 172.21.15.37:0/3915110862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f9415d7b0 0x7f4f9406e490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009d90 tx=0x7f4f8c01f080 comp rx=0 tx=0).stop 2024-05-30T06:42:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.399+0000 7f4f9bc00640 1 -- 172.21.15.37:0/3915110862 shutdown_connections 2024-05-30T06:42:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.399+0000 7f4f9bc00640 1 --2- 172.21.15.37:0/3915110862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f9415d7b0 0x7f4f9406e490 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.399+0000 7f4f9bc00640 1 --2- 172.21.15.37:0/3915110862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f9415d350 0x7f4f9406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.399+0000 7f4f9bc00640 1 -- 172.21.15.37:0/3915110862 >> 172.21.15.37:0/3915110862 conn(0x7f4f9406bf60 msgr2=0x7f4f940b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.399+0000 7f4f9bc00640 1 -- 172.21.15.37:0/3915110862 shutdown_connections 2024-05-30T06:42:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.399+0000 7f4f9bc00640 1 -- 172.21.15.37:0/3915110862 wait complete. 2024-05-30T06:42:41.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f9bc00640 1 Processor -- start 2024-05-30T06:42:41.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f9bc00640 1 -- start start 2024-05-30T06:42:41.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f9bc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f940b59d0 0x7f4f94156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f9bc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f9415d350 0x7f4f9415f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f9bc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9415d7b0 0x7f4f941576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f9bc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f940b00a0 con 0x7f4f9415d7b0 2024-05-30T06:42:41.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f9bc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4f940aff20 con 0x7f4f940b59d0 2024-05-30T06:42:41.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f9bc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9413f860 con 0x7f4f9415d350 2024-05-30T06:42:41.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f99c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9415d7b0 0x7f4f941576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f99c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9415d7b0 0x7f4f941576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37456/0 (socket says 172.21.15.37:37456) 2024-05-30T06:42:41.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f99c00640 1 -- 172.21.15.37:0/94421226 learned_addr learned my addr 172.21.15.37:0/94421226 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f99200640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f940b59d0 0x7f4f94156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f8be00640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f9415d350 0x7f4f9415f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f99c00640 1 -- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f9415d350 msgr2=0x7f4f9415f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f99c00640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f9415d350 0x7f4f9415f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f99c00640 1 -- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f940b59d0 msgr2=0x7f4f94156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f99c00640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f940b59d0 0x7f4f94156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f99c00640 1 -- 172.21.15.37:0/94421226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f941e6660 con 0x7f4f9415d7b0 2024-05-30T06:42:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f99200640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f940b59d0 0x7f4f94156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f8be00640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f9415d350 0x7f4f9415f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f99c00640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9415d7b0 0x7f4f941576a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c01d730 tx=0x7f4f8c01be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f91600640 1 -- 172.21.15.37:0/94421226 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0b5040 con 0x7f4f9415d7b0 2024-05-30T06:42:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f91600640 1 -- 172.21.15.37:0/94421226 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c0c1070 con 0x7f4f9415d7b0 2024-05-30T06:42:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f9bc00640 1 -- 172.21.15.37:0/94421226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f941e6940 con 0x7f4f9415d7b0 2024-05-30T06:42:41.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f91600640 1 -- 172.21.15.37:0/94421226 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c004480 con 0x7f4f9415d7b0 2024-05-30T06:42:41.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.403+0000 7f4f9bc00640 1 -- 172.21.15.37:0/94421226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f941e6f00 con 0x7f4f9415d7b0 2024-05-30T06:42:41.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.407+0000 7f4f9bc00640 1 -- 172.21.15.37:0/94421226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f94068bc0 con 0x7f4f9415d7b0 2024-05-30T06:42:41.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.407+0000 7f4f91600640 1 -- 172.21.15.37:0/94421226 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f8c004620 con 0x7f4f9415d7b0 2024-05-30T06:42:41.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.407+0000 7f4f91600640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f700683b0 0x7f4f7006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.407+0000 7f4f91600640 1 -- 172.21.15.37:0/94421226 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4f8c124e70 con 0x7f4f9415d7b0 2024-05-30T06:42:41.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.407+0000 7f4f99200640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f700683b0 0x7f4f7006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.407+0000 7f4f99200640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f700683b0 0x7f4f7006a870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f84001ec0 tx=0x7f4f84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:41.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.411+0000 7f4f91600640 1 -- 172.21.15.37:0/94421226 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4f8c018be0 con 0x7f4f9415d7b0 2024-05-30T06:42:41.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.575+0000 7f4f9bc00640 1 -- 172.21.15.37:0/94421226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4f94141df0 con 0x7f4f9415d7b0 2024-05-30T06:42:41.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.579+0000 7f4f91600640 1 -- 172.21.15.37:0/94421226 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f4f8c0ae340 con 0x7f4f9415d7b0 2024-05-30T06:42:41.577 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:41.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.579+0000 7f4f9bc00640 1 -- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f700683b0 msgr2=0x7f4f7006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.579+0000 7f4f9bc00640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f700683b0 0x7f4f7006a870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f84001ec0 tx=0x7f4f84009040 comp rx=0 tx=0).stop 2024-05-30T06:42:41.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.579+0000 7f4f9bc00640 1 -- 172.21.15.37:0/94421226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9415d7b0 msgr2=0x7f4f941576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.579+0000 7f4f9bc00640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9415d7b0 0x7f4f941576a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c01d730 tx=0x7f4f8c01be20 comp rx=0 tx=0).stop 2024-05-30T06:42:41.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.579+0000 7f4f9bc00640 1 -- 172.21.15.37:0/94421226 shutdown_connections 2024-05-30T06:42:41.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.579+0000 7f4f9bc00640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f9415d7b0 0x7f4f941576a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.579+0000 7f4f9bc00640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f9415d350 0x7f4f9415f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.579+0000 7f4f9bc00640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f700683b0 0x7f4f7006a870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.579+0000 7f4f9bc00640 1 --2- 172.21.15.37:0/94421226 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f940b59d0 0x7f4f94156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.579+0000 7f4f9bc00640 1 -- 172.21.15.37:0/94421226 >> 172.21.15.37:0/94421226 conn(0x7f4f9406bf60 msgr2=0x7f4f940726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.579+0000 7f4f9bc00640 1 -- 172.21.15.37:0/94421226 shutdown_connections 2024-05-30T06:42:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.579+0000 7f4f9bc00640 1 -- 172.21.15.37:0/94421226 wait complete. 2024-05-30T06:42:41.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:42:41.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe325200640 1 Processor -- start 2024-05-30T06:42:41.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe325200640 1 -- start start 2024-05-30T06:42:41.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe325200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe32015c870 0x7fe3200cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe325200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe3200d03c0 0x7fe32009aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe325200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3200b14b0 0x7fe32009afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe325200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe3200cd110 con 0x7fe32015c870 2024-05-30T06:42:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe325200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe32009be60 con 0x7fe3200d03c0 2024-05-30T06:42:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe325200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe3200cd990 con 0x7fe3200b14b0 2024-05-30T06:42:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe31de00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe32015c870 0x7fe3200cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe31de00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe32015c870 0x7fe3200cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37466/0 (socket says 172.21.15.37:37466) 2024-05-30T06:42:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe31de00640 1 -- 172.21.15.37:0/3866181731 learned_addr learned my addr 172.21.15.37:0/3866181731 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe31de00640 1 -- 172.21.15.37:0/3866181731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3200b14b0 msgr2=0x7fe32009afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe31de00640 1 --2- 172.21.15.37:0/3866181731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3200b14b0 0x7fe32009afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe31de00640 1 -- 172.21.15.37:0/3866181731 >> v2:172.21.15.105:3300/0 conn(0x7fe3200d03c0 msgr2=0x7fe32009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:41.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe31de00640 1 --2- 172.21.15.37:0/3866181731 >> v2:172.21.15.105:3300/0 conn(0x7fe3200d03c0 0x7fe32009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.743+0000 7fe31de00640 1 -- 172.21.15.37:0/3866181731 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32009bb80 con 0x7fe32015c870 2024-05-30T06:42:41.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.747+0000 7fe31de00640 1 --2- 172.21.15.37:0/3866181731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32015c870 0x7fe3200cde20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe3200b8620 tx=0x7fe31001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf46b7307a3196e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:41.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.747+0000 7fe31d400640 1 -- 172.21.15.37:0/3866181731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100b1070 con 0x7fe32015c870 2024-05-30T06:42:41.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.747+0000 7fe31d400640 1 -- 172.21.15.37:0/3866181731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3100ac630 con 0x7fe32015c870 2024-05-30T06:42:41.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.747+0000 7fe31d400640 1 -- 172.21.15.37:0/3866181731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100a8050 con 0x7fe32015c870 2024-05-30T06:42:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.747+0000 7fe325200640 1 -- 172.21.15.37:0/3866181731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32015c870 msgr2=0x7fe3200cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.747+0000 7fe325200640 1 --2- 172.21.15.37:0/3866181731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32015c870 0x7fe3200cde20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe3200b8620 tx=0x7fe31001c520 comp rx=0 tx=0).stop 2024-05-30T06:42:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.747+0000 7fe325200640 1 -- 172.21.15.37:0/3866181731 shutdown_connections 2024-05-30T06:42:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.747+0000 7fe325200640 1 --2- 172.21.15.37:0/3866181731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3200b14b0 0x7fe32009afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.747+0000 7fe325200640 1 --2- 172.21.15.37:0/3866181731 >> v2:172.21.15.105:3300/0 conn(0x7fe3200d03c0 0x7fe32009aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.747+0000 7fe325200640 1 --2- 172.21.15.37:0/3866181731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32015c870 0x7fe3200cde20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.747+0000 7fe325200640 1 -- 172.21.15.37:0/3866181731 >> 172.21.15.37:0/3866181731 conn(0x7fe3200b4060 msgr2=0x7fe3200b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.747+0000 7fe325200640 1 -- 172.21.15.37:0/3866181731 shutdown_connections 2024-05-30T06:42:41.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.747+0000 7fe325200640 1 -- 172.21.15.37:0/3866181731 wait complete. 2024-05-30T06:42:41.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe325200640 1 Processor -- start 2024-05-30T06:42:41.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe325200640 1 -- start start 2024-05-30T06:42:41.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe325200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3200b14b0 0x7fe320158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe325200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3200d03c0 0x7fe3200c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe325200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32015c870 0x7fe3200c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe325200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe32015cdd0 con 0x7fe3200b14b0 2024-05-30T06:42:41.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe325200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe32015cc50 con 0x7fe3200d03c0 2024-05-30T06:42:41.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe325200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe3200ce360 con 0x7fe32015c870 2024-05-30T06:42:41.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe31de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3200b14b0 0x7fe320158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe31de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3200b14b0 0x7fe320158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37480/0 (socket says 172.21.15.37:37480) 2024-05-30T06:42:41.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe31de00640 1 -- 172.21.15.37:0/2505597598 learned_addr learned my addr 172.21.15.37:0/2505597598 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:41.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe31de00640 1 -- 172.21.15.37:0/2505597598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32015c870 msgr2=0x7fe3200c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe31de00640 1 --2- 172.21.15.37:0/2505597598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32015c870 0x7fe3200c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe31de00640 1 -- 172.21.15.37:0/2505597598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3200d03c0 msgr2=0x7fe3200c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe31de00640 1 --2- 172.21.15.37:0/2505597598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3200d03c0 0x7fe3200c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe31de00640 1 -- 172.21.15.37:0/2505597598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3200c6810 con 0x7fe3200b14b0 2024-05-30T06:42:41.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe31de00640 1 --2- 172.21.15.37:0/2505597598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3200b14b0 0x7fe320158c70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe3100af040 tx=0x7fe3100192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:41.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe316a00640 1 -- 172.21.15.37:0/2505597598 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100bc070 con 0x7fe3200b14b0 2024-05-30T06:42:41.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe316a00640 1 -- 172.21.15.37:0/2505597598 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3100b7650 con 0x7fe3200b14b0 2024-05-30T06:42:41.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe316a00640 1 -- 172.21.15.37:0/2505597598 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100b1040 con 0x7fe3200b14b0 2024-05-30T06:42:41.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe325200640 1 -- 172.21.15.37:0/2505597598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3200c6af0 con 0x7fe3200b14b0 2024-05-30T06:42:41.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.751+0000 7fe325200640 1 -- 172.21.15.37:0/2505597598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3200c70b0 con 0x7fe3200b14b0 2024-05-30T06:42:41.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.755+0000 7fe325200640 1 -- 172.21.15.37:0/2505597598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe320068bc0 con 0x7fe3200b14b0 2024-05-30T06:42:41.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.755+0000 7fe316a00640 1 -- 172.21.15.37:0/2505597598 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe3100bf070 con 0x7fe3200b14b0 2024-05-30T06:42:41.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.755+0000 7fe316a00640 1 --2- 172.21.15.37:0/2505597598 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2fc068380 0x7fe2fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:41.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.755+0000 7fe316a00640 1 -- 172.21.15.37:0/2505597598 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe3101202a0 con 0x7fe3200b14b0 2024-05-30T06:42:41.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.755+0000 7fe315400640 1 --2- 172.21.15.37:0/2505597598 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2fc068380 0x7fe2fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:41.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.755+0000 7fe315400640 1 --2- 172.21.15.37:0/2505597598 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2fc068380 0x7fe2fc06a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3200c7590 tx=0x7fe308006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:41.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.759+0000 7fe316a00640 1 -- 172.21.15.37:0/2505597598 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe310016110 con 0x7fe3200b14b0 2024-05-30T06:42:41.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.923+0000 7fe325200640 1 -- 172.21.15.37:0/2505597598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe32015c0a0 con 0x7fe3200b14b0 2024-05-30T06:42:41.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.923+0000 7fe316a00640 1 -- 172.21.15.37:0/2505597598 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fe3100f07c0 con 0x7fe3200b14b0 2024-05-30T06:42:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:42:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.927+0000 7fe325200640 1 -- 172.21.15.37:0/2505597598 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2fc068380 msgr2=0x7fe2fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.927+0000 7fe325200640 1 --2- 172.21.15.37:0/2505597598 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2fc068380 0x7fe2fc06a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3200c7590 tx=0x7fe308006ca0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.927+0000 7fe325200640 1 -- 172.21.15.37:0/2505597598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3200b14b0 msgr2=0x7fe320158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.927+0000 7fe325200640 1 --2- 172.21.15.37:0/2505597598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3200b14b0 0x7fe320158c70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe3100af040 tx=0x7fe3100192c0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.927+0000 7fe325200640 1 -- 172.21.15.37:0/2505597598 shutdown_connections 2024-05-30T06:42:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.927+0000 7fe325200640 1 --2- 172.21.15.37:0/2505597598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32015c870 0x7fe3200c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.927+0000 7fe325200640 1 --2- 172.21.15.37:0/2505597598 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2fc068380 0x7fe2fc06a840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.927+0000 7fe325200640 1 --2- 172.21.15.37:0/2505597598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3200d03c0 0x7fe3200c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.927+0000 7fe325200640 1 --2- 172.21.15.37:0/2505597598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3200b14b0 0x7fe320158c70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:41.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.927+0000 7fe325200640 1 -- 172.21.15.37:0/2505597598 >> 172.21.15.37:0/2505597598 conn(0x7fe3200b4060 msgr2=0x7fe3200cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:41.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.927+0000 7fe325200640 1 -- 172.21.15.37:0/2505597598 shutdown_connections 2024-05-30T06:42:41.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:41.927+0000 7fe325200640 1 -- 172.21.15.37:0/2505597598 wait complete. 2024-05-30T06:42:41.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:42:42.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9af000640 1 Processor -- start 2024-05-30T06:42:42.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9af000640 1 -- start start 2024-05-30T06:42:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9af000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a80d1ad0 0x7fb9a8169810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9af000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a8163350 con 0x7fb9a806d200 2024-05-30T06:42:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9af000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a81627d0 con 0x7fb9a815e8b0 2024-05-30T06:42:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9af000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a8162ab0 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb99f400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb9a806d200 0x7fb9a806d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40862/0 (socket says 172.21.15.37:40862) 2024-05-30T06:42:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb99f400640 1 -- 172.21.15.37:0/915616194 learned_addr learned my addr 172.21.15.37:0/915616194 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9ad000640 1 --2- 172.21.15.37:0/915616194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a80d1ad0 0x7fb9a8169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9a7400640 1 -- 172.21.15.37:0/915616194 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708820286 0 0) 0x7fb9a8163350 con 0x7fb9a806d200 2024-05-30T06:42:42.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9a7400640 1 -- 172.21.15.37:0/915616194 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb98c003530 con 0x7fb9a806d200 2024-05-30T06:42:42.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9a7400640 1 -- 172.21.15.37:0/915616194 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3566820995 0 0) 0x7fb9a81627d0 con 0x7fb9a815e8b0 2024-05-30T06:42:42.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9a7400640 1 -- 172.21.15.37:0/915616194 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9a8163350 con 0x7fb9a815e8b0 2024-05-30T06:42:42.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9ad000640 1 -- 172.21.15.37:0/915616194 >> v1:172.21.15.105:6789/0 conn(0x7fb9a815e8b0 legacy=0x7fb9a80cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9ad000640 1 -- 172.21.15.37:0/915616194 >> v1:172.21.15.37:6789/0 conn(0x7fb9a806d200 legacy=0x7fb9a806d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.091+0000 7fb9ad000640 1 -- 172.21.15.37:0/915616194 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a8162d90 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.095+0000 7fb9ad000640 1 --2- 172.21.15.37:0/915616194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a80d1ad0 0x7fb9a8169810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009dc0 tx=0x7fb9a001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed746a57361507da server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.095+0000 7fb9a7400640 1 -- 172.21.15.37:0/915616194 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00b2070 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.095+0000 7fb9a7400640 1 -- 172.21.15.37:0/915616194 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a00a58e0 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.095+0000 7fb9a7400640 1 -- 172.21.15.37:0/915616194 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00a5c90 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.095+0000 7fb9af000640 1 -- 172.21.15.37:0/915616194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a80d1ad0 msgr2=0x7fb9a8169810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.095+0000 7fb9af000640 1 --2- 172.21.15.37:0/915616194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a80d1ad0 0x7fb9a8169810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009dc0 tx=0x7fb9a001c990 comp rx=0 tx=0).stop 2024-05-30T06:42:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.095+0000 7fb9af000640 1 -- 172.21.15.37:0/915616194 shutdown_connections 2024-05-30T06:42:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.095+0000 7fb9af000640 1 --2- 172.21.15.37:0/915616194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a80d1ad0 0x7fb9a8169810 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.095+0000 7fb9af000640 1 -- 172.21.15.37:0/915616194 >> 172.21.15.37:0/915616194 conn(0x7fb9a80b4130 msgr2=0x7fb9a80b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.095+0000 7fb9af000640 1 -- 172.21.15.37:0/915616194 shutdown_connections 2024-05-30T06:42:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.095+0000 7fb9af000640 1 -- 172.21.15.37:0/915616194 wait complete. 2024-05-30T06:42:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9af000640 1 Processor -- start 2024-05-30T06:42:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9af000640 1 -- start start 2024-05-30T06:42:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9af000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a806d200 0x7fb9a81593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9af000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9a80d1ad0 0x7fb9a8151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9af000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a815e8b0 0x7fb9a815cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9af000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a816c570 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9af000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a80cf050 con 0x7fb9a815e8b0 2024-05-30T06:42:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9af000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a816c6f0 con 0x7fb9a806d200 2024-05-30T06:42:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb99f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9a80d1ad0 0x7fb9a8151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb99f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9a80d1ad0 0x7fb9a8151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37482/0 (socket says 172.21.15.37:37482) 2024-05-30T06:42:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb99f400640 1 -- 172.21.15.37:0/2163684447 learned_addr learned my addr 172.21.15.37:0/2163684447 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb99f400640 1 -- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a806d200 msgr2=0x7fb9a81593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9ad000640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a815e8b0 0x7fb9a815cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9a7e00640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a806d200 0x7fb9a81593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb99f400640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a806d200 0x7fb9a81593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb99f400640 1 -- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a815e8b0 msgr2=0x7fb9a815cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb99f400640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a815e8b0 0x7fb9a815cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb99f400640 1 -- 172.21.15.37:0/2163684447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a80b0c80 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9ad000640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a815e8b0 0x7fb9a815cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9a7e00640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a806d200 0x7fb9a81593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb99f400640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9a80d1ad0 0x7fb9a8151cc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb99000c520 tx=0x7fb99000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9a4c00640 1 -- 172.21.15.37:0/2163684447 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990017070 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9a4c00640 1 -- 172.21.15.37:0/2163684447 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb990005cf0 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9a4c00640 1 -- 172.21.15.37:0/2163684447 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990007270 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9af000640 1 -- 172.21.15.37:0/2163684447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a80b0f60 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9af000640 1 -- 172.21.15.37:0/2163684447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a8159930 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.099+0000 7fb9af000640 1 -- 172.21.15.37:0/2163684447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a8068bc0 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.103+0000 7fb9a4c00640 1 -- 172.21.15.37:0/2163684447 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb99001a070 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.103+0000 7fb9a4c00640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb984068380 0x7fb98406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.103+0000 7fb9a4c00640 1 -- 172.21.15.37:0/2163684447 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb990085c60 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.103+0000 7fb9a7e00640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb984068380 0x7fb98406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.103+0000 7fb9a7e00640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb984068380 0x7fb98406a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80721f0 tx=0x7fb998009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:42.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.107+0000 7fb9a4c00640 1 -- 172.21.15.37:0/2163684447 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb990055c60 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9af000640 1 -- 172.21.15.37:0/2163684447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb9a806f0f0 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9a4c00640 1 -- 172.21.15.37:0/2163684447 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fb990059f60 con 0x7fb9a80d1ad0 2024-05-30T06:42:42.270 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:42:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9af000640 1 -- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb984068380 msgr2=0x7fb98406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9af000640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb984068380 0x7fb98406a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80721f0 tx=0x7fb998009040 comp rx=0 tx=0).stop 2024-05-30T06:42:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9af000640 1 -- 172.21.15.37:0/2163684447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9a80d1ad0 msgr2=0x7fb9a8151cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9af000640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9a80d1ad0 0x7fb9a8151cc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb99000c520 tx=0x7fb99000c9e0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9af000640 1 -- 172.21.15.37:0/2163684447 shutdown_connections 2024-05-30T06:42:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9af000640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb984068380 0x7fb98406a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9af000640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a815e8b0 0x7fb9a815cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9af000640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9a80d1ad0 0x7fb9a8151cc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9af000640 1 --2- 172.21.15.37:0/2163684447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a806d200 0x7fb9a81593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9af000640 1 -- 172.21.15.37:0/2163684447 >> 172.21.15.37:0/2163684447 conn(0x7fb9a80b4130 msgr2=0x7fb9a8160050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:42.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9af000640 1 -- 172.21.15.37:0/2163684447 shutdown_connections 2024-05-30T06:42:42.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.271+0000 7fb9af000640 1 -- 172.21.15.37:0/2163684447 wait complete. 2024-05-30T06:42:42.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone' 2024-05-30T06:42:42.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff858a00640 1 Processor -- start 2024-05-30T06:42:42.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff858a00640 1 -- start start 2024-05-30T06:42:42.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff858a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff85409b9a0 0x7ff8541625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff858a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff854162ae0 0x7ff8540ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff858a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff854162f00 con 0x7ff85415e930 2024-05-30T06:42:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff858a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff85409abe0 con 0x7ff854162ae0 2024-05-30T06:42:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff858a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff85409aec0 con 0x7ff85409b9a0 2024-05-30T06:42:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff851e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff85415e930 0x7ff8540d1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40870/0 (socket says 172.21.15.37:40870) 2024-05-30T06:42:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff851e00640 1 -- 172.21.15.37:0/454029942 learned_addr learned my addr 172.21.15.37:0/454029942 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff852800640 1 --2- 172.21.15.37:0/454029942 >> v2:172.21.15.37:3300/0 conn(0x7ff854162ae0 0x7ff8540ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff84be00640 1 --2- 172.21.15.37:0/454029942 >> v2:172.21.15.105:3300/0 conn(0x7ff85409b9a0 0x7ff8541625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff852800640 1 -- 172.21.15.37:0/454029942 >> v2:172.21.15.105:3300/0 conn(0x7ff85409b9a0 msgr2=0x7ff8541625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff852800640 1 --2- 172.21.15.37:0/454029942 >> v2:172.21.15.105:3300/0 conn(0x7ff85409b9a0 0x7ff8541625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff852800640 1 -- 172.21.15.37:0/454029942 >> v1:172.21.15.37:6789/0 conn(0x7ff85415e930 legacy=0x7ff8540d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff852800640 1 -- 172.21.15.37:0/454029942 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85409b1a0 con 0x7ff854162ae0 2024-05-30T06:42:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff851400640 1 -- 172.21.15.37:0/454029942 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3453988454 0 0) 0x7ff854162f00 con 0x7ff85415e930 2024-05-30T06:42:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.435+0000 7ff84be00640 1 --2- 172.21.15.37:0/454029942 >> v2:172.21.15.105:3300/0 conn(0x7ff85409b9a0 0x7ff8541625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.439+0000 7ff852800640 1 --2- 172.21.15.37:0/454029942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff854162ae0 0x7ff8540ccc60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff854073320 tx=0x7ff84c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e570fe8524ef37b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.439+0000 7ff851400640 1 -- 172.21.15.37:0/454029942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0b2070 con 0x7ff854162ae0 2024-05-30T06:42:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.439+0000 7ff851400640 1 -- 172.21.15.37:0/454029942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84c0a58e0 con 0x7ff854162ae0 2024-05-30T06:42:42.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.439+0000 7ff851400640 1 -- 172.21.15.37:0/454029942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0a5cb0 con 0x7ff854162ae0 2024-05-30T06:42:42.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.439+0000 7ff858a00640 1 -- 172.21.15.37:0/454029942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff854162ae0 msgr2=0x7ff8540ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.439+0000 7ff858a00640 1 --2- 172.21.15.37:0/454029942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff854162ae0 0x7ff8540ccc60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff854073320 tx=0x7ff84c01c930 comp rx=0 tx=0).stop 2024-05-30T06:42:42.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.439+0000 7ff858a00640 1 -- 172.21.15.37:0/454029942 shutdown_connections 2024-05-30T06:42:42.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.439+0000 7ff858a00640 1 --2- 172.21.15.37:0/454029942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff854162ae0 0x7ff8540ccc60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.439+0000 7ff858a00640 1 --2- 172.21.15.37:0/454029942 >> v2:172.21.15.105:3300/0 conn(0x7ff85409b9a0 0x7ff8541625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.439+0000 7ff858a00640 1 -- 172.21.15.37:0/454029942 >> 172.21.15.37:0/454029942 conn(0x7ff8540b4100 msgr2=0x7ff8540b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:42.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.439+0000 7ff858a00640 1 -- 172.21.15.37:0/454029942 shutdown_connections 2024-05-30T06:42:42.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.439+0000 7ff858a00640 1 -- 172.21.15.37:0/454029942 wait complete. 2024-05-30T06:42:42.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff858a00640 1 Processor -- start 2024-05-30T06:42:42.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff858a00640 1 -- start start 2024-05-30T06:42:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff858a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85409b9a0 0x7ff8541547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff858a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff85415e930 0x7ff854154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff858a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff854162ae0 0x7ff854155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff858a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff85406ddc0 con 0x7ff85415e930 2024-05-30T06:42:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff858a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff85406dc40 con 0x7ff85409b9a0 2024-05-30T06:42:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff858a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff85415ed10 con 0x7ff854162ae0 2024-05-30T06:42:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff84be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff85415e930 0x7ff854154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff84be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff85415e930 0x7ff854154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37510/0 (socket says 172.21.15.37:37510) 2024-05-30T06:42:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff84be00640 1 -- 172.21.15.37:0/166366249 learned_addr learned my addr 172.21.15.37:0/166366249 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff851e00640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85409b9a0 0x7ff8541547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff852800640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff854162ae0 0x7ff854155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff84be00640 1 -- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff854162ae0 msgr2=0x7ff854155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff84be00640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff854162ae0 0x7ff854155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff84be00640 1 -- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85409b9a0 msgr2=0x7ff8541547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff84be00640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85409b9a0 0x7ff8541547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff84be00640 1 -- 172.21.15.37:0/166366249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85415bd90 con 0x7ff85415e930 2024-05-30T06:42:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff852800640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff854162ae0 0x7ff854155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff84be00640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff85415e930 0x7ff854154d00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00e840 tx=0x7ff83c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff84a000640 1 -- 172.21.15.37:0/166366249 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c017070 con 0x7ff85415e930 2024-05-30T06:42:42.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff84a000640 1 -- 172.21.15.37:0/166366249 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83c00c8d0 con 0x7ff85415e930 2024-05-30T06:42:42.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff84a000640 1 -- 172.21.15.37:0/166366249 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c00f040 con 0x7ff85415e930 2024-05-30T06:42:42.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff858a00640 1 -- 172.21.15.37:0/166366249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff85415c070 con 0x7ff85415e930 2024-05-30T06:42:42.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff858a00640 1 -- 172.21.15.37:0/166366249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff85415c630 con 0x7ff85415e930 2024-05-30T06:42:42.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.443+0000 7ff858a00640 1 -- 172.21.15.37:0/166366249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8540ccab0 con 0x7ff85415e930 2024-05-30T06:42:42.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.447+0000 7ff84a000640 1 -- 172.21.15.37:0/166366249 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff83c01a070 con 0x7ff85415e930 2024-05-30T06:42:42.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.447+0000 7ff84a000640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff8300683b0 0x7ff83006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.447+0000 7ff84a000640 1 -- 172.21.15.37:0/166366249 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff83c086710 con 0x7ff85415e930 2024-05-30T06:42:42.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.447+0000 7ff851e00640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff8300683b0 0x7ff83006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.447+0000 7ff851e00640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff8300683b0 0x7ff83006a870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff844000f70 tx=0x7ff844007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:42.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.451+0000 7ff84a000640 1 -- 172.21.15.37:0/166366249 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff8540ccab0 con 0x7ff85415e930 2024-05-30T06:42:42.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.675+0000 7ff858a00640 1 -- 172.21.15.37:0/166366249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]} v 0) -- 0x7ff854068b20 con 0x7ff85415e930 2024-05-30T06:42:42.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.803+0000 7ff84a000640 1 -- 172.21.15.37:0/166366249 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]}]=0 v57) ==== 163+0+0 (secure 0 0 0) 0x7ff83c056ba0 con 0x7ff85415e930 2024-05-30T06:42:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.803+0000 7ff858a00640 1 -- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff8300683b0 msgr2=0x7ff83006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.803+0000 7ff858a00640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff8300683b0 0x7ff83006a870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff844000f70 tx=0x7ff844007b60 comp rx=0 tx=0).stop 2024-05-30T06:42:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.803+0000 7ff858a00640 1 -- 172.21.15.37:0/166366249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff85415e930 msgr2=0x7ff854154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.803+0000 7ff858a00640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff85415e930 0x7ff854154d00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00e840 tx=0x7ff83c00ed00 comp rx=0 tx=0).stop 2024-05-30T06:42:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.803+0000 7ff858a00640 1 -- 172.21.15.37:0/166366249 shutdown_connections 2024-05-30T06:42:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.807+0000 7ff858a00640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff854162ae0 0x7ff854155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.807+0000 7ff858a00640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff85415e930 0x7ff854154d00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.807+0000 7ff858a00640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff8300683b0 0x7ff83006a870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.807+0000 7ff858a00640 1 --2- 172.21.15.37:0/166366249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff85409b9a0 0x7ff8541547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.807+0000 7ff858a00640 1 -- 172.21.15.37:0/166366249 >> 172.21.15.37:0/166366249 conn(0x7ff8540b4100 msgr2=0x7ff854070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.807+0000 7ff858a00640 1 -- 172.21.15.37:0/166366249 shutdown_connections 2024-05-30T06:42:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.807+0000 7ff858a00640 1 -- 172.21.15.37:0/166366249 wait complete. 2024-05-30T06:42:42.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:42:42.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.967+0000 7f4c18800640 1 Processor -- start 2024-05-30T06:42:42.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.967+0000 7f4c18800640 1 -- start start 2024-05-30T06:42:42.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c18800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c100b59d0 0x7f4c100b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c18800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4c1015d7b0 0x7f4c10160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c18800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c100b62f0 con 0x7f4c1015d350 2024-05-30T06:42:42.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c18800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4c10142030 con 0x7f4c1015d7b0 2024-05-30T06:42:42.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c18800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4c10142310 con 0x7f4c100b59d0 2024-05-30T06:42:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c15400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4c1015d350 0x7f4c10160280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40886/0 (socket says 172.21.15.37:40886) 2024-05-30T06:42:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c15400640 1 -- 172.21.15.37:0/2055664136 learned_addr learned my addr 172.21.15.37:0/2055664136 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c16800640 1 --2- 172.21.15.37:0/2055664136 >> v2:172.21.15.105:3300/0 conn(0x7f4c1015d7b0 0x7f4c10160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c15e00640 1 --2- 172.21.15.37:0/2055664136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c100b59d0 0x7f4c100b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c14a00640 1 -- 172.21.15.37:0/2055664136 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005421736 0 0) 0x7f4c100b62f0 con 0x7f4c1015d350 2024-05-30T06:42:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c14a00640 1 -- 172.21.15.37:0/2055664136 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bf8003530 con 0x7f4c1015d350 2024-05-30T06:42:42.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c15e00640 1 -- 172.21.15.37:0/2055664136 >> v2:172.21.15.105:3300/0 conn(0x7f4c1015d7b0 msgr2=0x7f4c10160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:42.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c15e00640 1 --2- 172.21.15.37:0/2055664136 >> v2:172.21.15.105:3300/0 conn(0x7f4c1015d7b0 0x7f4c10160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c15e00640 1 -- 172.21.15.37:0/2055664136 >> v1:172.21.15.37:6789/0 conn(0x7f4c1015d350 legacy=0x7f4c10160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c15e00640 1 -- 172.21.15.37:0/2055664136 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c101425f0 con 0x7f4c100b59d0 2024-05-30T06:42:42.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.971+0000 7f4c16800640 1 --2- 172.21.15.37:0/2055664136 >> v2:172.21.15.105:3300/0 conn(0x7f4c1015d7b0 0x7f4c10160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:42.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.975+0000 7f4c15e00640 1 --2- 172.21.15.37:0/2055664136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c100b59d0 0x7f4c100b5db0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c040097c0 tx=0x7f4c0401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43e22328576001a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:42.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.975+0000 7f4c14a00640 1 -- 172.21.15.37:0/2055664136 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c040b5070 con 0x7f4c100b59d0 2024-05-30T06:42:42.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.975+0000 7f4c14a00640 1 -- 172.21.15.37:0/2055664136 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c040a8990 con 0x7f4c100b59d0 2024-05-30T06:42:42.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.975+0000 7f4c14a00640 1 -- 172.21.15.37:0/2055664136 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c040a8d40 con 0x7f4c100b59d0 2024-05-30T06:42:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.975+0000 7f4c18800640 1 -- 172.21.15.37:0/2055664136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c100b59d0 msgr2=0x7f4c100b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.975+0000 7f4c18800640 1 --2- 172.21.15.37:0/2055664136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c100b59d0 0x7f4c100b5db0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c040097c0 tx=0x7f4c0401ec90 comp rx=0 tx=0).stop 2024-05-30T06:42:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.975+0000 7f4c18800640 1 -- 172.21.15.37:0/2055664136 shutdown_connections 2024-05-30T06:42:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.975+0000 7f4c18800640 1 --2- 172.21.15.37:0/2055664136 >> v2:172.21.15.105:3300/0 conn(0x7f4c1015d7b0 0x7f4c10160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.975+0000 7f4c18800640 1 --2- 172.21.15.37:0/2055664136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c100b59d0 0x7f4c100b5db0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.975+0000 7f4c18800640 1 -- 172.21.15.37:0/2055664136 >> 172.21.15.37:0/2055664136 conn(0x7f4c1006bf60 msgr2=0x7f4c100b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.975+0000 7f4c18800640 1 -- 172.21.15.37:0/2055664136 shutdown_connections 2024-05-30T06:42:42.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.975+0000 7f4c18800640 1 -- 172.21.15.37:0/2055664136 wait complete. 2024-05-30T06:42:42.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c18800640 1 Processor -- start 2024-05-30T06:42:42.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c18800640 1 -- start start 2024-05-30T06:42:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c18800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100b59d0 0x7f4c100b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c18800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c1015d350 0x7f4c10156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c18800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c1015d7b0 0x7f4c1013dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c18800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1013fe60 con 0x7f4c100b59d0 2024-05-30T06:42:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c18800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1013fce0 con 0x7f4c1015d7b0 2024-05-30T06:42:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c18800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4c100aff20 con 0x7f4c1015d350 2024-05-30T06:42:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c15e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100b59d0 0x7f4c100b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c15e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100b59d0 0x7f4c100b53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37516/0 (socket says 172.21.15.37:37516) 2024-05-30T06:42:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c15e00640 1 -- 172.21.15.37:0/490872022 learned_addr learned my addr 172.21.15.37:0/490872022 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c15e00640 1 -- 172.21.15.37:0/490872022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c1015d350 msgr2=0x7f4c10156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c15e00640 1 --2- 172.21.15.37:0/490872022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c1015d350 0x7f4c10156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c15e00640 1 -- 172.21.15.37:0/490872022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c1015d7b0 msgr2=0x7f4c1013dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c15e00640 1 --2- 172.21.15.37:0/490872022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c1015d7b0 0x7f4c1013dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c15e00640 1 -- 172.21.15.37:0/490872022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c100b3590 con 0x7f4c100b59d0 2024-05-30T06:42:42.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c15e00640 1 --2- 172.21.15.37:0/490872022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100b59d0 0x7f4c100b53a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4c040b3040 tx=0x7f4c0401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:42.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c0a000640 1 -- 172.21.15.37:0/490872022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c040b5040 con 0x7f4c100b59d0 2024-05-30T06:42:42.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c0a000640 1 -- 172.21.15.37:0/490872022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c040bf070 con 0x7f4c100b59d0 2024-05-30T06:42:42.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c18800640 1 -- 172.21.15.37:0/490872022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c100b3870 con 0x7f4c100b59d0 2024-05-30T06:42:42.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c0a000640 1 -- 172.21.15.37:0/490872022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c040b0840 con 0x7f4c100b59d0 2024-05-30T06:42:42.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c18800640 1 -- 172.21.15.37:0/490872022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c100b3e30 con 0x7f4c100b59d0 2024-05-30T06:42:42.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.979+0000 7f4c18800640 1 -- 172.21.15.37:0/490872022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c10068bc0 con 0x7f4c100b59d0 2024-05-30T06:42:42.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.983+0000 7f4c0a000640 1 -- 172.21.15.37:0/490872022 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4c040a8810 con 0x7f4c100b59d0 2024-05-30T06:42:42.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.983+0000 7f4c0a000640 1 --2- 172.21.15.37:0/490872022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bf4068380 0x7f4bf406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:42.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.983+0000 7f4c0a000640 1 -- 172.21.15.37:0/490872022 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4c04123ca0 con 0x7f4c100b59d0 2024-05-30T06:42:42.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.983+0000 7f4c15400640 1 --2- 172.21.15.37:0/490872022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bf4068380 0x7f4bf406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:42.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.983+0000 7f4c15400640 1 --2- 172.21.15.37:0/490872022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bf4068380 0x7f4bf406a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4c00007fd0 tx=0x7f4c00007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:42.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:42.987+0000 7f4c0a000640 1 -- 172.21.15.37:0/490872022 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4c040187f0 con 0x7f4c100b59d0 2024-05-30T06:42:43.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.151+0000 7f4c18800640 1 -- 172.21.15.37:0/490872022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f4c1006f0a0 con 0x7f4c100b59d0 2024-05-30T06:42:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.155+0000 7f4c0a000640 1 -- 172.21.15.37:0/490872022 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f4c040f4260 con 0x7f4c100b59d0 2024-05-30T06:42:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.155+0000 7f4c18800640 1 -- 172.21.15.37:0/490872022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bf4068380 msgr2=0x7f4bf406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.155+0000 7f4c18800640 1 --2- 172.21.15.37:0/490872022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bf4068380 0x7f4bf406a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4c00007fd0 tx=0x7f4c00007900 comp rx=0 tx=0).stop 2024-05-30T06:42:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.155+0000 7f4c18800640 1 -- 172.21.15.37:0/490872022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100b59d0 msgr2=0x7f4c100b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.155+0000 7f4c18800640 1 --2- 172.21.15.37:0/490872022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100b59d0 0x7f4c100b53a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4c040b3040 tx=0x7f4c0401ba30 comp rx=0 tx=0).stop 2024-05-30T06:42:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.159+0000 7f4c18800640 1 -- 172.21.15.37:0/490872022 shutdown_connections 2024-05-30T06:42:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.159+0000 7f4c18800640 1 --2- 172.21.15.37:0/490872022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bf4068380 0x7f4bf406a840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.159+0000 7f4c18800640 1 --2- 172.21.15.37:0/490872022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c1015d7b0 0x7f4c1013dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.159+0000 7f4c18800640 1 --2- 172.21.15.37:0/490872022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c1015d350 0x7f4c10156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.159+0000 7f4c18800640 1 --2- 172.21.15.37:0/490872022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100b59d0 0x7f4c100b53a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.159+0000 7f4c18800640 1 -- 172.21.15.37:0/490872022 >> 172.21.15.37:0/490872022 conn(0x7f4c1006bf60 msgr2=0x7f4c101408a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.159+0000 7f4c18800640 1 -- 172.21.15.37:0/490872022 shutdown_connections 2024-05-30T06:42:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.159+0000 7f4c18800640 1 -- 172.21.15.37:0/490872022 wait complete. 2024-05-30T06:42:43.175 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:42:43.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:42:43.247 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:42:43.339 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:42:43.339 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:42:43.339 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:43.348 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:42:43.348 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:43.400 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:42:43.400 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:43.453 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:43.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.639+0000 7fe027200640 1 Processor -- start 2024-05-30T06:42:43.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.639+0000 7fe027200640 1 -- start start 2024-05-30T06:42:43.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.639+0000 7fe027200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0200b03d0 0x7fe02006b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:43.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.639+0000 7fe027200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe02006c750 con 0x7fe02015cc70 2024-05-30T06:42:43.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.639+0000 7fe027200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0201464d0 con 0x7fe0201460f0 2024-05-30T06:42:43.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.639+0000 7fe027200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe0200b4540 con 0x7fe0200b03d0 2024-05-30T06:42:43.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.639+0000 7fe01f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0200b03d0 0x7fe02006b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:43.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.639+0000 7fe025200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe02015cc70 0x7fe0200b4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40890/0 (socket says 172.21.15.37:40890) 2024-05-30T06:42:43.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.639+0000 7fe025200640 1 -- 172.21.15.37:0/587533776 learned_addr learned my addr 172.21.15.37:0/587533776 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:43.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.639+0000 7fe01f400640 1 -- 172.21.15.37:0/587533776 >> v1:172.21.15.105:6789/0 conn(0x7fe0201460f0 legacy=0x7fe0200afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:43.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.639+0000 7fe01f400640 1 -- 172.21.15.37:0/587533776 >> v1:172.21.15.37:6789/0 conn(0x7fe02015cc70 legacy=0x7fe0200b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:43.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.639+0000 7fe01f400640 1 -- 172.21.15.37:0/587533776 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0200b0850 con 0x7fe0200b03d0 2024-05-30T06:42:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.643+0000 7fe01f400640 1 --2- 172.21.15.37:0/587533776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0200b03d0 0x7fe02006b960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0097c0 tx=0x7fe00c01c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34ec6cc04839644 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.643+0000 7fe01ea00640 1 -- 172.21.15.37:0/587533776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0b0070 con 0x7fe0200b03d0 2024-05-30T06:42:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.643+0000 7fe01ea00640 1 -- 172.21.15.37:0/587533776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00c0ab600 con 0x7fe0200b03d0 2024-05-30T06:42:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.643+0000 7fe01ea00640 1 -- 172.21.15.37:0/587533776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0ab9d0 con 0x7fe0200b03d0 2024-05-30T06:42:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.643+0000 7fe027200640 1 -- 172.21.15.37:0/587533776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0200b03d0 msgr2=0x7fe02006b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.643+0000 7fe027200640 1 --2- 172.21.15.37:0/587533776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0200b03d0 0x7fe02006b960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0097c0 tx=0x7fe00c01c250 comp rx=0 tx=0).stop 2024-05-30T06:42:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.643+0000 7fe027200640 1 -- 172.21.15.37:0/587533776 shutdown_connections 2024-05-30T06:42:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.643+0000 7fe027200640 1 --2- 172.21.15.37:0/587533776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0200b03d0 0x7fe02006b960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.643+0000 7fe027200640 1 -- 172.21.15.37:0/587533776 >> 172.21.15.37:0/587533776 conn(0x7fe0200b6a60 msgr2=0x7fe0200b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.643+0000 7fe027200640 1 -- 172.21.15.37:0/587533776 shutdown_connections 2024-05-30T06:42:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.643+0000 7fe027200640 1 -- 172.21.15.37:0/587533776 wait complete. 2024-05-30T06:42:43.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.643+0000 7fe027200640 1 Processor -- start 2024-05-30T06:42:43.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.643+0000 7fe027200640 1 -- start start 2024-05-30T06:42:43.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe027200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0200b03d0 0x7fe020138f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:43.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe027200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0201460f0 0x7fe020140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:43.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe027200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02015cc70 0x7fe0201406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:43.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe027200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe02016a560 con 0x7fe02015cc70 2024-05-30T06:42:43.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe027200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe02016a3e0 con 0x7fe0201460f0 2024-05-30T06:42:43.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe027200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe02016a6e0 con 0x7fe0200b03d0 2024-05-30T06:42:43.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe025200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02015cc70 0x7fe0201406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:43.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe025200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02015cc70 0x7fe0201406b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37532/0 (socket says 172.21.15.37:37532) 2024-05-30T06:42:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe025200640 1 -- 172.21.15.37:0/3347693487 learned_addr learned my addr 172.21.15.37:0/3347693487 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe01fe00640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0200b03d0 0x7fe020138f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe025200640 1 -- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0200b03d0 msgr2=0x7fe020138f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe01f400640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0201460f0 0x7fe020140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe025200640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0200b03d0 0x7fe020138f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe025200640 1 -- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0201460f0 msgr2=0x7fe020140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe025200640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0201460f0 0x7fe020140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe025200640 1 -- 172.21.15.37:0/3347693487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe020139460 con 0x7fe02015cc70 2024-05-30T06:42:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe01fe00640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0200b03d0 0x7fe020138f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe01f400640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0201460f0 0x7fe020140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe025200640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02015cc70 0x7fe0201406b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe01800cad0 tx=0x7fe01800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe017e00640 1 -- 172.21.15.37:0/3347693487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018017070 con 0x7fe02015cc70 2024-05-30T06:42:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe017e00640 1 -- 172.21.15.37:0/3347693487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe01800ac30 con 0x7fe02015cc70 2024-05-30T06:42:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe017e00640 1 -- 172.21.15.37:0/3347693487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018012400 con 0x7fe02015cc70 2024-05-30T06:42:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe027200640 1 -- 172.21.15.37:0/3347693487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02013fac0 con 0x7fe02015cc70 2024-05-30T06:42:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe027200640 1 -- 172.21.15.37:0/3347693487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02013efe0 con 0x7fe02015cc70 2024-05-30T06:42:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.647+0000 7fe027200640 1 -- 172.21.15.37:0/3347693487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe020068b20 con 0x7fe02015cc70 2024-05-30T06:42:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.651+0000 7fe017e00640 1 -- 172.21.15.37:0/3347693487 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe01801a070 con 0x7fe02015cc70 2024-05-30T06:42:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.651+0000 7fe017e00640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe000068380 0x7fe00006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.651+0000 7fe017e00640 1 -- 172.21.15.37:0/3347693487 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe018086570 con 0x7fe02015cc70 2024-05-30T06:42:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.651+0000 7fe01fe00640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe000068380 0x7fe00006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.651+0000 7fe01fe00640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe000068380 0x7fe00006a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe010003e40 tx=0x7fe010009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:43.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.655+0000 7fe017e00640 1 -- 172.21.15.37:0/3347693487 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe0180564d0 con 0x7fe02015cc70 2024-05-30T06:42:43.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.819+0000 7fe027200640 1 -- 172.21.15.37:0/3347693487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe020142e70 con 0x7fe02015cc70 2024-05-30T06:42:43.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.819+0000 7fe017e00640 1 -- 172.21.15.37:0/3347693487 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7fe018084e20 con 0x7fe02015cc70 2024-05-30T06:42:43.820 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:43.821 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.823+0000 7fe027200640 1 -- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe000068380 msgr2=0x7fe00006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.823+0000 7fe027200640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe000068380 0x7fe00006a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe010003e40 tx=0x7fe010009040 comp rx=0 tx=0).stop 2024-05-30T06:42:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.823+0000 7fe027200640 1 -- 172.21.15.37:0/3347693487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02015cc70 msgr2=0x7fe0201406b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.823+0000 7fe027200640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02015cc70 0x7fe0201406b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe01800cad0 tx=0x7fe01800cf90 comp rx=0 tx=0).stop 2024-05-30T06:42:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.823+0000 7fe027200640 1 -- 172.21.15.37:0/3347693487 shutdown_connections 2024-05-30T06:42:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.823+0000 7fe027200640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02015cc70 0x7fe0201406b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.823+0000 7fe027200640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe000068380 0x7fe00006a840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.823+0000 7fe027200640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0201460f0 0x7fe020140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.823+0000 7fe027200640 1 --2- 172.21.15.37:0/3347693487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0200b03d0 0x7fe020138f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.823+0000 7fe027200640 1 -- 172.21.15.37:0/3347693487 >> 172.21.15.37:0/3347693487 conn(0x7fe0200b6a60 msgr2=0x7fe020144070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:43.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.823+0000 7fe027200640 1 -- 172.21.15.37:0/3347693487 shutdown_connections 2024-05-30T06:42:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.823+0000 7fe027200640 1 -- 172.21.15.37:0/3347693487 wait complete. 2024-05-30T06:42:43.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:42:09.128133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:42:09.755772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:43.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d99000640 1 Processor -- start 2024-05-30T06:42:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d99000640 1 -- start start 2024-05-30T06:42:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d99000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2d94162ba0 0x7f2d940afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d99000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d940b36c0 0x7f2d94147680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d99000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d940b5f70 con 0x7f2d940cfeb0 2024-05-30T06:42:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d99000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2d940b67a0 con 0x7f2d94162ba0 2024-05-30T06:42:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d99000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2d940b3b20 con 0x7f2d940b36c0 2024-05-30T06:42:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d92800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d940b36c0 0x7f2d94147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d89400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2d94162ba0 0x7f2d940afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d92800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d940b36c0 0x7f2d94147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:42272/0 (socket says 172.21.15.37:42272) 2024-05-30T06:42:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d89400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2d94162ba0 0x7f2d940afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:34820/0 (socket says 172.21.15.37:34820) 2024-05-30T06:42:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d92800640 1 -- 172.21.15.37:0/2685239988 learned_addr learned my addr 172.21.15.37:0/2685239988 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d89400640 1 -- 172.21.15.37:0/2685239988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d940b36c0 msgr2=0x7f2d94147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d89400640 1 --2- 172.21.15.37:0/2685239988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d940b36c0 0x7f2d94147680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d89400640 1 -- 172.21.15.37:0/2685239988 >> v1:172.21.15.105:6789/0 conn(0x7f2d940cfeb0 legacy=0x7f2d94162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d89400640 1 -- 172.21.15.37:0/2685239988 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d940b61e0 con 0x7f2d94162ba0 2024-05-30T06:42:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d92800640 1 --2- 172.21.15.37:0/2685239988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d940b36c0 0x7f2d94147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.987+0000 7f2d91400640 1 -- 172.21.15.37:0/2685239988 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970718371 0 0) 0x7f2d940b5f70 con 0x7f2d940cfeb0 2024-05-30T06:42:43.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.991+0000 7f2d89400640 1 --2- 172.21.15.37:0/2685239988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d94162ba0 0x7f2d940afcf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0097c0 tx=0x7f2d7c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1f79c1d2678bb1f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:43.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.991+0000 7f2d91400640 1 -- 172.21.15.37:0/2685239988 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0b0070 con 0x7f2d94162ba0 2024-05-30T06:42:43.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.991+0000 7f2d91400640 1 -- 172.21.15.37:0/2685239988 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d7c0ab600 con 0x7f2d94162ba0 2024-05-30T06:42:43.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.991+0000 7f2d91400640 1 -- 172.21.15.37:0/2685239988 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0ab9d0 con 0x7f2d94162ba0 2024-05-30T06:42:43.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.991+0000 7f2d99000640 1 -- 172.21.15.37:0/2685239988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d94162ba0 msgr2=0x7f2d940afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:43.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.991+0000 7f2d99000640 1 --2- 172.21.15.37:0/2685239988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d94162ba0 0x7f2d940afcf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0097c0 tx=0x7f2d7c01c410 comp rx=0 tx=0).stop 2024-05-30T06:42:43.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.991+0000 7f2d99000640 1 -- 172.21.15.37:0/2685239988 shutdown_connections 2024-05-30T06:42:43.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.991+0000 7f2d99000640 1 --2- 172.21.15.37:0/2685239988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d940b36c0 0x7f2d94147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.991+0000 7f2d99000640 1 --2- 172.21.15.37:0/2685239988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d94162ba0 0x7f2d940afcf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.991+0000 7f2d99000640 1 -- 172.21.15.37:0/2685239988 >> 172.21.15.37:0/2685239988 conn(0x7f2d9406bf60 msgr2=0x7f2d940b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:43.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.991+0000 7f2d99000640 1 -- 172.21.15.37:0/2685239988 shutdown_connections 2024-05-30T06:42:43.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.991+0000 7f2d99000640 1 -- 172.21.15.37:0/2685239988 wait complete. 2024-05-30T06:42:43.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d99000640 1 Processor -- start 2024-05-30T06:42:43.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d99000640 1 -- start start 2024-05-30T06:42:43.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d99000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d940b36c0 0x7f2d9413b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:43.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d99000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d940cfeb0 0x7f2d9415d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d99000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d94162ba0 0x7f2d9415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d99000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d940ae4a0 con 0x7f2d940cfeb0 2024-05-30T06:42:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d99000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2d940ae320 con 0x7f2d94162ba0 2024-05-30T06:42:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d99000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2d940ae620 con 0x7f2d940b36c0 2024-05-30T06:42:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d89400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d940cfeb0 0x7f2d9415d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d89400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d940cfeb0 0x7f2d9415d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37546/0 (socket says 172.21.15.37:37546) 2024-05-30T06:42:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d89400640 1 -- 172.21.15.37:0/3849399908 learned_addr learned my addr 172.21.15.37:0/3849399908 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d91e00640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d940b36c0 0x7f2d9413b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d92800640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d94162ba0 0x7f2d9415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d89400640 1 -- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d940b36c0 msgr2=0x7f2d9413b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d89400640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d940b36c0 0x7f2d9413b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d89400640 1 -- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d94162ba0 msgr2=0x7f2d9415a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d89400640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d94162ba0 0x7f2d9415a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d89400640 1 -- 172.21.15.37:0/3849399908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d9415db80 con 0x7f2d940cfeb0 2024-05-30T06:42:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d89400640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d940cfeb0 0x7f2d9415d100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c01a040 tx=0x7f2d7c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d8aa00640 1 -- 172.21.15.37:0/3849399908 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0b0050 con 0x7f2d940cfeb0 2024-05-30T06:42:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d8aa00640 1 -- 172.21.15.37:0/3849399908 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d7c0b1040 con 0x7f2d940cfeb0 2024-05-30T06:42:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d8aa00640 1 -- 172.21.15.37:0/3849399908 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0b5610 con 0x7f2d940cfeb0 2024-05-30T06:42:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d99000640 1 -- 172.21.15.37:0/3849399908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d9415de60 con 0x7f2d940cfeb0 2024-05-30T06:42:43.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.995+0000 7f2d99000640 1 -- 172.21.15.37:0/3849399908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d9415e420 con 0x7f2d940cfeb0 2024-05-30T06:42:43.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.999+0000 7f2d99000640 1 -- 172.21.15.37:0/3849399908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d94068bc0 con 0x7f2d940cfeb0 2024-05-30T06:42:43.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.999+0000 7f2d8aa00640 1 -- 172.21.15.37:0/3849399908 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2d7c0be030 con 0x7f2d940cfeb0 2024-05-30T06:42:44.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.999+0000 7f2d8aa00640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d70068380 0x7f2d7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:44.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.999+0000 7f2d8aa00640 1 -- 172.21.15.37:0/3849399908 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2d7c120400 con 0x7f2d940cfeb0 2024-05-30T06:42:44.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.999+0000 7f2d91e00640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d70068380 0x7f2d7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:44.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:43.999+0000 7f2d91e00640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d70068380 0x7f2d7006a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2d840012f0 tx=0x7f2d84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:44.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.003+0000 7f2d8aa00640 1 -- 172.21.15.37:0/3849399908 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2d7c0c5060 con 0x7f2d940cfeb0 2024-05-30T06:42:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d99000640 1 -- 172.21.15.37:0/3849399908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2d940b30b0 con 0x7f2d940cfeb0 2024-05-30T06:42:44.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d8aa00640 1 -- 172.21.15.37:0/3849399908 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f2d7c016090 con 0x7f2d940cfeb0 2024-05-30T06:42:44.166 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d99000640 1 -- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d70068380 msgr2=0x7f2d7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d99000640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d70068380 0x7f2d7006a840 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2d840012f0 tx=0x7f2d84009040 comp rx=0 tx=0).stop 2024-05-30T06:42:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d99000640 1 -- 172.21.15.37:0/3849399908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d940cfeb0 msgr2=0x7f2d9415d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d99000640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d940cfeb0 0x7f2d9415d100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c01a040 tx=0x7f2d7c01ac50 comp rx=0 tx=0).stop 2024-05-30T06:42:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d99000640 1 -- 172.21.15.37:0/3849399908 shutdown_connections 2024-05-30T06:42:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d99000640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d70068380 0x7f2d7006a840 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d99000640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d94162ba0 0x7f2d9415a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d99000640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d940cfeb0 0x7f2d9415d100 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d99000640 1 --2- 172.21.15.37:0/3849399908 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d940b36c0 0x7f2d9413b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d99000640 1 -- 172.21.15.37:0/3849399908 >> 172.21.15.37:0/3849399908 conn(0x7f2d9406bf60 msgr2=0x7f2d94160110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d99000640 1 -- 172.21.15.37:0/3849399908 shutdown_connections 2024-05-30T06:42:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.167+0000 7f2d99000640 1 -- 172.21.15.37:0/3849399908 wait complete. 2024-05-30T06:42:44.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:42:44.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.331+0000 7fa627000640 1 Processor -- start 2024-05-30T06:42:44.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.331+0000 7fa627000640 1 -- start start 2024-05-30T06:42:44.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.331+0000 7fa627000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa62006e290 0x7fa6200d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:44.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.331+0000 7fa627000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6200cd980 con 0x7fa62009b0a0 2024-05-30T06:42:44.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.331+0000 7fa627000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6200cdc60 con 0x7fa62009acc0 2024-05-30T06:42:44.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.331+0000 7fa627000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa6200ce590 con 0x7fa62006e290 2024-05-30T06:42:44.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.331+0000 7fa625200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa62009b0a0 0x7fa62015e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40900/0 (socket says 172.21.15.37:40900) 2024-05-30T06:42:44.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.331+0000 7fa625200640 1 -- 172.21.15.37:0/2456625393 learned_addr learned my addr 172.21.15.37:0/2456625393 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:44.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.335+0000 7fa626600640 1 --2- 172.21.15.37:0/2456625393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa62006e290 0x7fa6200d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:44.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.335+0000 7fa61fe00640 1 -- 172.21.15.37:0/2456625393 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3241564513 0 0) 0x7fa6200cd980 con 0x7fa62009b0a0 2024-05-30T06:42:44.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.335+0000 7fa61fe00640 1 -- 172.21.15.37:0/2456625393 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa608003530 con 0x7fa62009b0a0 2024-05-30T06:42:44.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.335+0000 7fa61fe00640 1 -- 172.21.15.37:0/2456625393 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 115498621 0 0) 0x7fa6200cdc60 con 0x7fa62009acc0 2024-05-30T06:42:44.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.335+0000 7fa61fe00640 1 -- 172.21.15.37:0/2456625393 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6200cd980 con 0x7fa62009acc0 2024-05-30T06:42:44.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.335+0000 7fa626600640 1 -- 172.21.15.37:0/2456625393 >> v1:172.21.15.105:6789/0 conn(0x7fa62009acc0 legacy=0x7fa62006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.335+0000 7fa626600640 1 -- 172.21.15.37:0/2456625393 >> v1:172.21.15.37:6789/0 conn(0x7fa62009b0a0 legacy=0x7fa62015e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.335+0000 7fa626600640 1 -- 172.21.15.37:0/2456625393 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6200cdf40 con 0x7fa62006e290 2024-05-30T06:42:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.335+0000 7fa626600640 1 --2- 172.21.15.37:0/2456625393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa62006e290 0x7fa6200d1140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa618009dc0 tx=0x7fa61801f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f48f05356105aef5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.335+0000 7fa61fe00640 1 -- 172.21.15.37:0/2456625393 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6180b4070 con 0x7fa62006e290 2024-05-30T06:42:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.335+0000 7fa61fe00640 1 -- 172.21.15.37:0/2456625393 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6180af600 con 0x7fa62006e290 2024-05-30T06:42:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.335+0000 7fa61fe00640 1 -- 172.21.15.37:0/2456625393 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6180af9d0 con 0x7fa62006e290 2024-05-30T06:42:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 -- 172.21.15.37:0/2456625393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa62006e290 msgr2=0x7fa6200d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 --2- 172.21.15.37:0/2456625393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa62006e290 0x7fa6200d1140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa618009dc0 tx=0x7fa61801f170 comp rx=0 tx=0).stop 2024-05-30T06:42:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 -- 172.21.15.37:0/2456625393 shutdown_connections 2024-05-30T06:42:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 --2- 172.21.15.37:0/2456625393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa62006e290 0x7fa6200d1140 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 -- 172.21.15.37:0/2456625393 >> 172.21.15.37:0/2456625393 conn(0x7fa6200b3ef0 msgr2=0x7fa6200b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 -- 172.21.15.37:0/2456625393 shutdown_connections 2024-05-30T06:42:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 -- 172.21.15.37:0/2456625393 wait complete. 2024-05-30T06:42:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 Processor -- start 2024-05-30T06:42:44.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 -- start start 2024-05-30T06:42:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62006e290 0x7fa6200cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa62009acc0 0x7fa62014d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62009b0a0 0x7fa6200b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa6200cea20 con 0x7fa62009b0a0 2024-05-30T06:42:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa62006d7c0 con 0x7fa62006e290 2024-05-30T06:42:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa627000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa6200cc2c0 con 0x7fa62009acc0 2024-05-30T06:42:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa626600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62009b0a0 0x7fa6200b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa626600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62009b0a0 0x7fa6200b7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37556/0 (socket says 172.21.15.37:37556) 2024-05-30T06:42:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa626600640 1 -- 172.21.15.37:0/73469510 learned_addr learned my addr 172.21.15.37:0/73469510 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa625200640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa62009acc0 0x7fa62014d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa625c00640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62006e290 0x7fa6200cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa626600640 1 -- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa62009acc0 msgr2=0x7fa62014d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa626600640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa62009acc0 0x7fa62014d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa626600640 1 -- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62006e290 msgr2=0x7fa6200cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa626600640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62006e290 0x7fa6200cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.339+0000 7fa626600640 1 -- 172.21.15.37:0/73469510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6200cace0 con 0x7fa62009b0a0 2024-05-30T06:42:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.343+0000 7fa626600640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62009b0a0 0x7fa6200b7070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa61801bd80 tx=0x7fa61801bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.343+0000 7fa61d600640 1 -- 172.21.15.37:0/73469510 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6180b4040 con 0x7fa62009b0a0 2024-05-30T06:42:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.343+0000 7fa61d600640 1 -- 172.21.15.37:0/73469510 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6180c1070 con 0x7fa62009b0a0 2024-05-30T06:42:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.343+0000 7fa627000640 1 -- 172.21.15.37:0/73469510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6200cafc0 con 0x7fa62009b0a0 2024-05-30T06:42:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.343+0000 7fa61d600640 1 -- 172.21.15.37:0/73469510 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618009450 con 0x7fa62009b0a0 2024-05-30T06:42:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.343+0000 7fa627000640 1 -- 172.21.15.37:0/73469510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6200cb580 con 0x7fa62009b0a0 2024-05-30T06:42:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.343+0000 7fa627000640 1 -- 172.21.15.37:0/73469510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa620068ab0 con 0x7fa62009b0a0 2024-05-30T06:42:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.343+0000 7fa61d600640 1 -- 172.21.15.37:0/73469510 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6180ba6b0 con 0x7fa62009b0a0 2024-05-30T06:42:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.343+0000 7fa61d600640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa600068380 0x7fa60006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.343+0000 7fa61d600640 1 -- 172.21.15.37:0/73469510 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa6181250a0 con 0x7fa62009b0a0 2024-05-30T06:42:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.343+0000 7fa625c00640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa600068380 0x7fa60006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.347+0000 7fa625c00640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa600068380 0x7fa60006a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa614001720 tx=0x7fa614009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:44.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.347+0000 7fa61d600640 1 -- 172.21.15.37:0/73469510 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa618018cd0 con 0x7fa62009b0a0 2024-05-30T06:42:44.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.511+0000 7fa627000640 1 -- 172.21.15.37:0/73469510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa6200b4c50 con 0x7fa62009b0a0 2024-05-30T06:42:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.511+0000 7fa61d600640 1 -- 172.21.15.37:0/73469510 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fa6180f5030 con 0x7fa62009b0a0 2024-05-30T06:42:44.512 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:42:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.515+0000 7fa627000640 1 -- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa600068380 msgr2=0x7fa60006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.515+0000 7fa627000640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa600068380 0x7fa60006a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa614001720 tx=0x7fa614009040 comp rx=0 tx=0).stop 2024-05-30T06:42:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.515+0000 7fa627000640 1 -- 172.21.15.37:0/73469510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62009b0a0 msgr2=0x7fa6200b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.515+0000 7fa627000640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62009b0a0 0x7fa6200b7070 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa61801bd80 tx=0x7fa61801bf10 comp rx=0 tx=0).stop 2024-05-30T06:42:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.515+0000 7fa627000640 1 -- 172.21.15.37:0/73469510 shutdown_connections 2024-05-30T06:42:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.515+0000 7fa627000640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa62009b0a0 0x7fa6200b7070 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.515+0000 7fa627000640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa62009acc0 0x7fa62014d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.515+0000 7fa627000640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa600068380 0x7fa60006a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.515+0000 7fa627000640 1 --2- 172.21.15.37:0/73469510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa62006e290 0x7fa6200cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.515+0000 7fa627000640 1 -- 172.21.15.37:0/73469510 >> 172.21.15.37:0/73469510 conn(0x7fa6200b3ef0 msgr2=0x7fa6200b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:44.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.515+0000 7fa627000640 1 -- 172.21.15.37:0/73469510 shutdown_connections 2024-05-30T06:42:44.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.515+0000 7fa627000640 1 -- 172.21.15.37:0/73469510 wait complete. 2024-05-30T06:42:44.532 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:42:44.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.675+0000 7f1d8ee00640 1 Processor -- start 2024-05-30T06:42:44.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.675+0000 7f1d8ee00640 1 -- start start 2024-05-30T06:42:44.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d8ee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d880d1da0 0x7f1d880af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:44.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d8ee00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d880d2fa0 con 0x7f1d880d0380 2024-05-30T06:42:44.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d8ee00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d880d3280 con 0x7f1d880b18a0 2024-05-30T06:42:44.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d8ee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1d8809ba70 con 0x7f1d880d1da0 2024-05-30T06:42:44.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d8da00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1d880d0380 0x7f1d880d0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40904/0 (socket says 172.21.15.37:40904) 2024-05-30T06:42:44.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d8da00640 1 -- 172.21.15.37:0/3395565928 learned_addr learned my addr 172.21.15.37:0/3395565928 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d8e400640 1 --2- 172.21.15.37:0/3395565928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d880d1da0 0x7f1d880af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d87e00640 1 -- 172.21.15.37:0/3395565928 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785817111 0 0) 0x7f1d880d2fa0 con 0x7f1d880d0380 2024-05-30T06:42:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d87e00640 1 -- 172.21.15.37:0/3395565928 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d70003530 con 0x7f1d880d0380 2024-05-30T06:42:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d87e00640 1 -- 172.21.15.37:0/3395565928 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640335721 0 0) 0x7f1d880d3280 con 0x7f1d880b18a0 2024-05-30T06:42:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d87e00640 1 -- 172.21.15.37:0/3395565928 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d880d2fa0 con 0x7f1d880b18a0 2024-05-30T06:42:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d87e00640 1 -- 172.21.15.37:0/3395565928 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1187275370 0 0) 0x7f1d70003530 con 0x7f1d880d0380 2024-05-30T06:42:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d8e400640 1 -- 172.21.15.37:0/3395565928 >> v1:172.21.15.105:6789/0 conn(0x7f1d880b18a0 legacy=0x7f1d8806fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d8e400640 1 -- 172.21.15.37:0/3395565928 >> v1:172.21.15.37:6789/0 conn(0x7f1d880d0380 legacy=0x7f1d880d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.679+0000 7f1d8e400640 1 -- 172.21.15.37:0/3395565928 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d88071cb0 con 0x7f1d880d1da0 2024-05-30T06:42:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8e400640 1 --2- 172.21.15.37:0/3395565928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d880d1da0 0x7f1d880af350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009dc0 tx=0x7f1d8001c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fec52dde0b7bf549 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d87e00640 1 -- 172.21.15.37:0/3395565928 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d800b2070 con 0x7f1d880d1da0 2024-05-30T06:42:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d87e00640 1 -- 172.21.15.37:0/3395565928 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d800a56b0 con 0x7f1d880d1da0 2024-05-30T06:42:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d87e00640 1 -- 172.21.15.37:0/3395565928 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c001680 con 0x7f1d880d1da0 2024-05-30T06:42:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 -- 172.21.15.37:0/3395565928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d880d1da0 msgr2=0x7f1d880af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 --2- 172.21.15.37:0/3395565928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d880d1da0 0x7f1d880af350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009dc0 tx=0x7f1d8001c870 comp rx=0 tx=0).stop 2024-05-30T06:42:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 -- 172.21.15.37:0/3395565928 shutdown_connections 2024-05-30T06:42:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 --2- 172.21.15.37:0/3395565928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d880d1da0 0x7f1d880af350 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 -- 172.21.15.37:0/3395565928 >> 172.21.15.37:0/3395565928 conn(0x7f1d880d2480 msgr2=0x7f1d880d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 -- 172.21.15.37:0/3395565928 shutdown_connections 2024-05-30T06:42:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 -- 172.21.15.37:0/3395565928 wait complete. 2024-05-30T06:42:44.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 Processor -- start 2024-05-30T06:42:44.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 -- start start 2024-05-30T06:42:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d880b18a0 0x7f1d881508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d880d0380 0x7f1d8806e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d880d1da0 0x7f1d8814c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1d88071940 con 0x7f1d880d0380 2024-05-30T06:42:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1d880d1a70 con 0x7f1d880d1da0 2024-05-30T06:42:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8ee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1d8816ab00 con 0x7f1d880b18a0 2024-05-30T06:42:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.683+0000 7f1d8d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d880d0380 0x7f1d8806e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d880d0380 0x7f1d8806e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37568/0 (socket says 172.21.15.37:37568) 2024-05-30T06:42:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8d000640 1 -- 172.21.15.37:0/1705318979 learned_addr learned my addr 172.21.15.37:0/1705318979 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8e400640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d880d1da0 0x7f1d8814c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8da00640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d880b18a0 0x7f1d881508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8d000640 1 -- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d880b18a0 msgr2=0x7f1d881508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8d000640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d880b18a0 0x7f1d881508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8d000640 1 -- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d880d1da0 msgr2=0x7f1d8814c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8d000640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d880d1da0 0x7f1d8814c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8d000640 1 -- 172.21.15.37:0/1705318979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d880b5b80 con 0x7f1d880d0380 2024-05-30T06:42:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8da00640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d880b18a0 0x7f1d881508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8d000640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d880d0380 0x7f1d8806e400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400c460 tx=0x7f1d7400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d85600640 1 -- 172.21.15.37:0/1705318979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d740052d0 con 0x7f1d880d0380 2024-05-30T06:42:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d85600640 1 -- 172.21.15.37:0/1705318979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d74005490 con 0x7f1d880d0380 2024-05-30T06:42:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d85600640 1 -- 172.21.15.37:0/1705318979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d74012850 con 0x7f1d880d0380 2024-05-30T06:42:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8ee00640 1 -- 172.21.15.37:0/1705318979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d8806d730 con 0x7f1d880d0380 2024-05-30T06:42:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8ee00640 1 -- 172.21.15.37:0/1705318979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d88150df0 con 0x7f1d880d0380 2024-05-30T06:42:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d8ee00640 1 -- 172.21.15.37:0/1705318979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d88068ab0 con 0x7f1d880d0380 2024-05-30T06:42:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.687+0000 7f1d85600640 1 -- 172.21.15.37:0/1705318979 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1d740129f0 con 0x7f1d880d0380 2024-05-30T06:42:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.691+0000 7f1d85600640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d68068380 0x7f1d6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.691+0000 7f1d85600640 1 -- 172.21.15.37:0/1705318979 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1d740864f0 con 0x7f1d880d0380 2024-05-30T06:42:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.691+0000 7f1d8da00640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d68068380 0x7f1d6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:44.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.691+0000 7f1d8da00640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d68068380 0x7f1d6806a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0011f0 tx=0x7f1d7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:44.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.695+0000 7f1d85600640 1 -- 172.21.15.37:0/1705318979 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1d74056ab0 con 0x7f1d880d0380 2024-05-30T06:42:44.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.859+0000 7f1d8ee00640 1 -- 172.21.15.37:0/1705318979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1d8806fd70 con 0x7f1d880d0380 2024-05-30T06:42:44.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.859+0000 7f1d85600640 1 -- 172.21.15.37:0/1705318979 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f1d740563b0 con 0x7f1d880d0380 2024-05-30T06:42:44.859 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:42:44.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.863+0000 7f1d8ee00640 1 -- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d68068380 msgr2=0x7f1d6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.863+0000 7f1d8ee00640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d68068380 0x7f1d6806a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0011f0 tx=0x7f1d7c009040 comp rx=0 tx=0).stop 2024-05-30T06:42:44.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.863+0000 7f1d8ee00640 1 -- 172.21.15.37:0/1705318979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d880d0380 msgr2=0x7f1d8806e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:44.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.863+0000 7f1d8ee00640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d880d0380 0x7f1d8806e400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400c460 tx=0x7f1d7400c920 comp rx=0 tx=0).stop 2024-05-30T06:42:44.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.863+0000 7f1d8ee00640 1 -- 172.21.15.37:0/1705318979 shutdown_connections 2024-05-30T06:42:44.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.863+0000 7f1d8ee00640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d68068380 0x7f1d6806a840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.863+0000 7f1d8ee00640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d880d1da0 0x7f1d8814c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.863+0000 7f1d8ee00640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d880d0380 0x7f1d8806e400 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.863+0000 7f1d8ee00640 1 --2- 172.21.15.37:0/1705318979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d880b18a0 0x7f1d881508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:44.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.863+0000 7f1d8ee00640 1 -- 172.21.15.37:0/1705318979 >> 172.21.15.37:0/1705318979 conn(0x7f1d880d2480 msgr2=0x7f1d8815e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:44.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.863+0000 7f1d8ee00640 1 -- 172.21.15.37:0/1705318979 shutdown_connections 2024-05-30T06:42:44.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:44.863+0000 7f1d8ee00640 1 -- 172.21.15.37:0/1705318979 wait complete. 2024-05-30T06:42:44.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T06:42:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.023+0000 7fed00000640 1 Processor -- start 2024-05-30T06:42:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.023+0000 7fed00000640 1 -- start start 2024-05-30T06:42:45.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fed00000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecf815d350 0x7fecf806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fed00000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf8142030 con 0x7fecf80b59d0 2024-05-30T06:42:45.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fed00000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf8142310 con 0x7fecf815d7b0 2024-05-30T06:42:45.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fed00000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fecf81425f0 con 0x7fecf815d350 2024-05-30T06:42:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fecfd600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fecf80b59d0 0x7fecf80b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40910/0 (socket says 172.21.15.37:40910) 2024-05-30T06:42:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fecfd600640 1 -- 172.21.15.37:0/2281123852 learned_addr learned my addr 172.21.15.37:0/2281123852 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fecfcc00640 1 --2- 172.21.15.37:0/2281123852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecf815d350 0x7fecf806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fecf7e00640 1 -- 172.21.15.37:0/2281123852 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4213911252 0 0) 0x7fecf8142030 con 0x7fecf80b59d0 2024-05-30T06:42:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fecf7e00640 1 -- 172.21.15.37:0/2281123852 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fece0003530 con 0x7fecf80b59d0 2024-05-30T06:42:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fecf7e00640 1 -- 172.21.15.37:0/2281123852 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742855139 0 0) 0x7fecf8142310 con 0x7fecf815d7b0 2024-05-30T06:42:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fecf7e00640 1 -- 172.21.15.37:0/2281123852 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecf8142030 con 0x7fecf815d7b0 2024-05-30T06:42:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fecf7e00640 1 -- 172.21.15.37:0/2281123852 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1096738666 0 0) 0x7fece0003530 con 0x7fecf80b59d0 2024-05-30T06:42:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fecfcc00640 1 -- 172.21.15.37:0/2281123852 >> v1:172.21.15.105:6789/0 conn(0x7fecf815d7b0 legacy=0x7fecf806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fecfcc00640 1 -- 172.21.15.37:0/2281123852 >> v1:172.21.15.37:6789/0 conn(0x7fecf80b59d0 legacy=0x7fecf80b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.027+0000 7fecfcc00640 1 -- 172.21.15.37:0/2281123852 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf81428d0 con 0x7fecf815d350 2024-05-30T06:42:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.031+0000 7fecfcc00640 1 --2- 172.21.15.37:0/2281123852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecf815d350 0x7fecf806df50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fece40097f0 tx=0x7fece401ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c52f865d5181c8a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.031+0000 7fecf7e00640 1 -- 172.21.15.37:0/2281123852 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece40b5070 con 0x7fecf815d350 2024-05-30T06:42:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.031+0000 7fecf7e00640 1 -- 172.21.15.37:0/2281123852 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece40a8670 con 0x7fecf815d350 2024-05-30T06:42:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.031+0000 7fecf7e00640 1 -- 172.21.15.37:0/2281123852 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec001680 con 0x7fecf815d350 2024-05-30T06:42:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.031+0000 7fed00000640 1 -- 172.21.15.37:0/2281123852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecf815d350 msgr2=0x7fecf806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.031+0000 7fed00000640 1 --2- 172.21.15.37:0/2281123852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecf815d350 0x7fecf806df50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fece40097f0 tx=0x7fece401ebf0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.031+0000 7fed00000640 1 -- 172.21.15.37:0/2281123852 shutdown_connections 2024-05-30T06:42:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.031+0000 7fed00000640 1 --2- 172.21.15.37:0/2281123852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecf815d350 0x7fecf806df50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.031+0000 7fed00000640 1 -- 172.21.15.37:0/2281123852 >> 172.21.15.37:0/2281123852 conn(0x7fecf806bf60 msgr2=0x7fecf80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.031+0000 7fed00000640 1 -- 172.21.15.37:0/2281123852 shutdown_connections 2024-05-30T06:42:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.031+0000 7fed00000640 1 -- 172.21.15.37:0/2281123852 wait complete. 2024-05-30T06:42:45.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.031+0000 7fed00000640 1 Processor -- start 2024-05-30T06:42:45.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.031+0000 7fed00000640 1 -- start start 2024-05-30T06:42:45.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fed00000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecf80b59d0 0x7fecf80b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fed00000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf815d350 0x7fecf81f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fed00000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecf815d7b0 0x7fecf81f9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fed00000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fecf80b00a0 con 0x7fecf815d350 2024-05-30T06:42:45.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fed00000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fecf80aff20 con 0x7fecf80b59d0 2024-05-30T06:42:45.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fed00000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fecf813f860 con 0x7fecf815d7b0 2024-05-30T06:42:45.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecfcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf815d350 0x7fecf81f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecfcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf815d350 0x7fecf81f9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37574/0 (socket says 172.21.15.37:37574) 2024-05-30T06:42:45.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecfcc00640 1 -- 172.21.15.37:0/4011495244 learned_addr learned my addr 172.21.15.37:0/4011495244 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:45.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecfd600640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecf80b59d0 0x7fecf80b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecfe000640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecf815d7b0 0x7fecf81f9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecfcc00640 1 -- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecf815d7b0 msgr2=0x7fecf81f9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecfcc00640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecf815d7b0 0x7fecf81f9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecfcc00640 1 -- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecf80b59d0 msgr2=0x7fecf80b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecfcc00640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecf80b59d0 0x7fecf80b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecfcc00640 1 -- 172.21.15.37:0/4011495244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf80b0970 con 0x7fecf815d350 2024-05-30T06:42:45.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecfcc00640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf815d350 0x7fecf81f9970 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fece40b3040 tx=0x7fece401b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:45.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecf5600640 1 -- 172.21.15.37:0/4011495244 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece40b5040 con 0x7fecf815d350 2024-05-30T06:42:45.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecf5600640 1 -- 172.21.15.37:0/4011495244 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece4004220 con 0x7fecf815d350 2024-05-30T06:42:45.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecf5600640 1 -- 172.21.15.37:0/4011495244 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4006e20 con 0x7fecf815d350 2024-05-30T06:42:45.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fed00000640 1 -- 172.21.15.37:0/4011495244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf80b0c50 con 0x7fecf815d350 2024-05-30T06:42:45.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fed00000640 1 -- 172.21.15.37:0/4011495244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf80b1210 con 0x7fecf815d350 2024-05-30T06:42:45.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fed00000640 1 -- 172.21.15.37:0/4011495244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf80b15f0 con 0x7fecf815d350 2024-05-30T06:42:45.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.035+0000 7fecf5600640 1 -- 172.21.15.37:0/4011495244 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fece40c2060 con 0x7fecf815d350 2024-05-30T06:42:45.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.039+0000 7fecf5600640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fecd8068380 0x7fecd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.039+0000 7fecf5600640 1 -- 172.21.15.37:0/4011495244 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fece4122d50 con 0x7fecf815d350 2024-05-30T06:42:45.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.039+0000 7fecfd600640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fecd8068380 0x7fecd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.039+0000 7fecfd600640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fecd8068380 0x7fecd806a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fecec000fe0 tx=0x7fecec001160 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.043+0000 7fecf5600640 1 -- 172.21.15.37:0/4011495244 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fecf80b15f0 con 0x7fecf815d350 2024-05-30T06:42:45.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.219+0000 7fed00000640 1 -- 172.21.15.37:0/4011495244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fecf806f0a0 con 0x7fecf815d350 2024-05-30T06:42:45.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.219+0000 7fecf5600640 1 -- 172.21.15.37:0/4011495244 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fece4018750 con 0x7fecf815d350 2024-05-30T06:42:45.220 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-30T06:42:45.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.223+0000 7fed00000640 1 -- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fecd8068380 msgr2=0x7fecd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.223+0000 7fed00000640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fecd8068380 0x7fecd806a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fecec000fe0 tx=0x7fecec001160 comp rx=0 tx=0).stop 2024-05-30T06:42:45.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.223+0000 7fed00000640 1 -- 172.21.15.37:0/4011495244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf815d350 msgr2=0x7fecf81f9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.223+0000 7fed00000640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf815d350 0x7fecf81f9970 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fece40b3040 tx=0x7fece401b990 comp rx=0 tx=0).stop 2024-05-30T06:42:45.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.223+0000 7fed00000640 1 -- 172.21.15.37:0/4011495244 shutdown_connections 2024-05-30T06:42:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.223+0000 7fed00000640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecf815d7b0 0x7fecf81f9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.223+0000 7fed00000640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecf815d350 0x7fecf81f9970 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.223+0000 7fed00000640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fecd8068380 0x7fecd806a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.223+0000 7fed00000640 1 --2- 172.21.15.37:0/4011495244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecf80b59d0 0x7fecf80b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.223+0000 7fed00000640 1 -- 172.21.15.37:0/4011495244 >> 172.21.15.37:0/4011495244 conn(0x7fecf806bf60 msgr2=0x7fecf8136890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.223+0000 7fed00000640 1 -- 172.21.15.37:0/4011495244 shutdown_connections 2024-05-30T06:42:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.223+0000 7fed00000640 1 -- 172.21.15.37:0/4011495244 wait complete. 2024-05-30T06:42:45.241 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T06:42:45.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:45.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-30T06:42:45.276 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:42:45.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:45.277 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T06:42:45.343 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:42:45.343 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:45.352 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:42:45.353 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:45.404 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:42:45.405 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:45.456 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc247800640 1 Processor -- start 2024-05-30T06:42:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc247800640 1 -- start start 2024-05-30T06:42:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc247800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2401482d0 0x7fc2400b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc247800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc2400af690 0x7fc24015ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc247800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc240160440 con 0x7fc24015eed0 2024-05-30T06:42:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc247800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc24006e860 con 0x7fc2400af690 2024-05-30T06:42:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc247800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc2400afe30 con 0x7fc2401482d0 2024-05-30T06:42:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc245800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc24015eed0 0x7fc24015f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40922/0 (socket says 172.21.15.37:40922) 2024-05-30T06:42:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc245800640 1 -- 172.21.15.37:0/1923520177 learned_addr learned my addr 172.21.15.37:0/1923520177 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc244e00640 1 --2- 172.21.15.37:0/1923520177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2401482d0 0x7fc2400b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc23fe00640 1 --2- 172.21.15.37:0/1923520177 >> v2:172.21.15.105:3300/0 conn(0x7fc2400af690 0x7fc24015ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc23f400640 1 -- 172.21.15.37:0/1923520177 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3430359175 0 0) 0x7fc240160440 con 0x7fc24015eed0 2024-05-30T06:42:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc23f400640 1 -- 172.21.15.37:0/1923520177 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc228003530 con 0x7fc24015eed0 2024-05-30T06:42:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc244e00640 1 -- 172.21.15.37:0/1923520177 >> v2:172.21.15.105:3300/0 conn(0x7fc2400af690 msgr2=0x7fc24015ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc244e00640 1 --2- 172.21.15.37:0/1923520177 >> v2:172.21.15.105:3300/0 conn(0x7fc2400af690 0x7fc24015ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc244e00640 1 -- 172.21.15.37:0/1923520177 >> v1:172.21.15.37:6789/0 conn(0x7fc24015eed0 legacy=0x7fc24015f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.599+0000 7fc244e00640 1 -- 172.21.15.37:0/1923520177 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24006e210 con 0x7fc2401482d0 2024-05-30T06:42:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.603+0000 7fc244e00640 1 --2- 172.21.15.37:0/1923520177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2401482d0 0x7fc2400b2ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc2340097c0 tx=0x7fc23401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f678f99ea6b853eb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.603+0000 7fc23f400640 1 -- 172.21.15.37:0/1923520177 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2340b0070 con 0x7fc2401482d0 2024-05-30T06:42:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.603+0000 7fc23f400640 1 -- 172.21.15.37:0/1923520177 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2340ab600 con 0x7fc2401482d0 2024-05-30T06:42:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.603+0000 7fc23f400640 1 -- 172.21.15.37:0/1923520177 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2340ab9d0 con 0x7fc2401482d0 2024-05-30T06:42:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.603+0000 7fc247800640 1 -- 172.21.15.37:0/1923520177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2401482d0 msgr2=0x7fc2400b2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.603+0000 7fc247800640 1 --2- 172.21.15.37:0/1923520177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2401482d0 0x7fc2400b2ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc2340097c0 tx=0x7fc23401c410 comp rx=0 tx=0).stop 2024-05-30T06:42:45.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.603+0000 7fc247800640 1 -- 172.21.15.37:0/1923520177 shutdown_connections 2024-05-30T06:42:45.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.603+0000 7fc247800640 1 --2- 172.21.15.37:0/1923520177 >> v2:172.21.15.105:3300/0 conn(0x7fc2400af690 0x7fc24015ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.603+0000 7fc247800640 1 --2- 172.21.15.37:0/1923520177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2401482d0 0x7fc2400b2ec0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.603+0000 7fc247800640 1 -- 172.21.15.37:0/1923520177 >> 172.21.15.37:0/1923520177 conn(0x7fc2400b23a0 msgr2=0x7fc2400b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:45.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.603+0000 7fc247800640 1 -- 172.21.15.37:0/1923520177 shutdown_connections 2024-05-30T06:42:45.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.603+0000 7fc247800640 1 -- 172.21.15.37:0/1923520177 wait complete. 2024-05-30T06:42:45.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc247800640 1 Processor -- start 2024-05-30T06:42:45.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc247800640 1 -- start start 2024-05-30T06:42:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc247800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2400af690 0x7fc2400c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc247800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2401482d0 0x7fc24015e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc247800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc24015eed0 0x7fc2400ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc247800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc24006f890 con 0x7fc2400af690 2024-05-30T06:42:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc247800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc24006f710 con 0x7fc2401482d0 2024-05-30T06:42:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc247800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc24016b890 con 0x7fc24015eed0 2024-05-30T06:42:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc244e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2400af690 0x7fc2400c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc244e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2400af690 0x7fc2400c56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37586/0 (socket says 172.21.15.37:37586) 2024-05-30T06:42:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc244e00640 1 -- 172.21.15.37:0/1624898899 learned_addr learned my addr 172.21.15.37:0/1624898899 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc245800640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc24015eed0 0x7fc2400ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc23fe00640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2401482d0 0x7fc24015e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc244e00640 1 -- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc24015eed0 msgr2=0x7fc2400ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc244e00640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc24015eed0 0x7fc2400ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc244e00640 1 -- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2401482d0 msgr2=0x7fc24015e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc244e00640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2401482d0 0x7fc24015e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc244e00640 1 -- 172.21.15.37:0/1624898899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2400cf7a0 con 0x7fc2400af690 2024-05-30T06:42:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc244e00640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2400af690 0x7fc2400c56f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc2340ae040 tx=0x7fc23401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc23cc00640 1 -- 172.21.15.37:0/1624898899 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2340b0050 con 0x7fc2400af690 2024-05-30T06:42:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc23cc00640 1 -- 172.21.15.37:0/1624898899 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2340bc070 con 0x7fc2400af690 2024-05-30T06:42:45.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc247800640 1 -- 172.21.15.37:0/1624898899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2400cfa80 con 0x7fc2400af690 2024-05-30T06:42:45.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc23cc00640 1 -- 172.21.15.37:0/1624898899 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234006e20 con 0x7fc2400af690 2024-05-30T06:42:45.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc247800640 1 -- 172.21.15.37:0/1624898899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2400cec10 con 0x7fc2400af690 2024-05-30T06:42:45.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.607+0000 7fc247800640 1 -- 172.21.15.37:0/1624898899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc240068b20 con 0x7fc2400af690 2024-05-30T06:42:45.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.611+0000 7fc23cc00640 1 -- 172.21.15.37:0/1624898899 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc2340b5870 con 0x7fc2400af690 2024-05-30T06:42:45.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.611+0000 7fc23cc00640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc220068380 0x7fc22006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.611+0000 7fc23cc00640 1 -- 172.21.15.37:0/1624898899 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc234121100 con 0x7fc2400af690 2024-05-30T06:42:45.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.611+0000 7fc23fe00640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc220068380 0x7fc22006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.611+0000 7fc23fe00640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc220068380 0x7fc22006a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc2401469b0 tx=0x7fc22c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:45.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.615+0000 7fc23cc00640 1 -- 172.21.15.37:0/1624898899 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc234016090 con 0x7fc2400af690 2024-05-30T06:42:45.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.779+0000 7fc247800640 1 -- 172.21.15.37:0/1624898899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc240072fb0 con 0x7fc2400af690 2024-05-30T06:42:45.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.783+0000 7fc23cc00640 1 -- 172.21.15.37:0/1624898899 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7fc2340f17d0 con 0x7fc2400af690 2024-05-30T06:42:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:45.781 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:45.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.783+0000 7fc247800640 1 -- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc220068380 msgr2=0x7fc22006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.783+0000 7fc247800640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc220068380 0x7fc22006a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc2401469b0 tx=0x7fc22c008040 comp rx=0 tx=0).stop 2024-05-30T06:42:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.783+0000 7fc247800640 1 -- 172.21.15.37:0/1624898899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2400af690 msgr2=0x7fc2400c56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.783+0000 7fc247800640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2400af690 0x7fc2400c56f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc2340ae040 tx=0x7fc23401ac50 comp rx=0 tx=0).stop 2024-05-30T06:42:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.783+0000 7fc247800640 1 -- 172.21.15.37:0/1624898899 shutdown_connections 2024-05-30T06:42:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.783+0000 7fc247800640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc24015eed0 0x7fc2400ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.783+0000 7fc247800640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc220068380 0x7fc22006a840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.783+0000 7fc247800640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2401482d0 0x7fc24015e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.783+0000 7fc247800640 1 --2- 172.21.15.37:0/1624898899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2400af690 0x7fc2400c56f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.783+0000 7fc247800640 1 -- 172.21.15.37:0/1624898899 >> 172.21.15.37:0/1624898899 conn(0x7fc2400b23a0 msgr2=0x7fc2400b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.783+0000 7fc247800640 1 -- 172.21.15.37:0/1624898899 shutdown_connections 2024-05-30T06:42:45.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.783+0000 7fc247800640 1 -- 172.21.15.37:0/1624898899 wait complete. 2024-05-30T06:42:45.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:42:09.128133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:42:09.755772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:45.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.947+0000 7f415da00640 1 Processor -- start 2024-05-30T06:42:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.947+0000 7f415da00640 1 -- start start 2024-05-30T06:42:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.947+0000 7f415da00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f415806d200 0x7f415806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.947+0000 7f415da00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f41580d0ac0 0x7f41580d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.947+0000 7f415da00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f415806db60 con 0x7f415815e8b0 2024-05-30T06:42:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.947+0000 7f415da00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4158163350 con 0x7f41580d0ac0 2024-05-30T06:42:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.947+0000 7f415da00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f41581627d0 con 0x7f415806d200 2024-05-30T06:42:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.951+0000 7f414e000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f415806d200 0x7f415806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.951+0000 7f4157400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f41580d0ac0 0x7f41580d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.951+0000 7f4156a00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f415815e8b0 0x7f41580cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:44198/0 (socket says 172.21.15.37:44198) 2024-05-30T06:42:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.951+0000 7f414e000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f415806d200 0x7f415806d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:42354/0 (socket says 172.21.15.37:42354) 2024-05-30T06:42:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.951+0000 7f4156a00640 1 -- 172.21.15.37:0/2343921675 learned_addr learned my addr 172.21.15.37:0/2343921675 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.951+0000 7f414e000640 1 -- 172.21.15.37:0/2343921675 >> v2:172.21.15.105:3300/0 conn(0x7f41580d0ac0 msgr2=0x7f41580d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.951+0000 7f414e000640 1 --2- 172.21.15.37:0/2343921675 >> v2:172.21.15.105:3300/0 conn(0x7f41580d0ac0 0x7f41580d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.951+0000 7f414e000640 1 -- 172.21.15.37:0/2343921675 >> v1:172.21.15.105:6789/0 conn(0x7f415815e8b0 legacy=0x7f41580cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.951+0000 7f414e000640 1 -- 172.21.15.37:0/2343921675 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4158162ab0 con 0x7f415806d200 2024-05-30T06:42:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.951+0000 7f4156000640 1 -- 172.21.15.37:0/2343921675 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 284647738 0 0) 0x7f415806db60 con 0x7f415815e8b0 2024-05-30T06:42:45.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.951+0000 7f414e000640 1 --2- 172.21.15.37:0/2343921675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f415806d200 0x7f415806d620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41400097c0 tx=0x7f414001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47828dfc7a669070 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:45.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f4156000640 1 -- 172.21.15.37:0/2343921675 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41400b2070 con 0x7f415806d200 2024-05-30T06:42:45.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f4156000640 1 -- 172.21.15.37:0/2343921675 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41400ad640 con 0x7f415806d200 2024-05-30T06:42:45.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f4156000640 1 -- 172.21.15.37:0/2343921675 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41400ada10 con 0x7f415806d200 2024-05-30T06:42:45.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 -- 172.21.15.37:0/2343921675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f415806d200 msgr2=0x7f415806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 --2- 172.21.15.37:0/2343921675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f415806d200 0x7f415806d620 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f41400097c0 tx=0x7f414001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 -- 172.21.15.37:0/2343921675 shutdown_connections 2024-05-30T06:42:45.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 --2- 172.21.15.37:0/2343921675 >> v2:172.21.15.105:3300/0 conn(0x7f41580d0ac0 0x7f41580d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 --2- 172.21.15.37:0/2343921675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f415806d200 0x7f415806d620 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 -- 172.21.15.37:0/2343921675 >> 172.21.15.37:0/2343921675 conn(0x7f41580b4130 msgr2=0x7f41580b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 -- 172.21.15.37:0/2343921675 shutdown_connections 2024-05-30T06:42:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 -- 172.21.15.37:0/2343921675 wait complete. 2024-05-30T06:42:45.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 Processor -- start 2024-05-30T06:42:45.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 -- start start 2024-05-30T06:42:45.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f415806d200 0x7f415815da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41580d0ac0 0x7f4158156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f415815e8b0 0x7f4158155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41580cf050 con 0x7f415806d200 2024-05-30T06:42:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4158162480 con 0x7f41580d0ac0 2024-05-30T06:42:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f415da00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f415816b820 con 0x7f415815e8b0 2024-05-30T06:42:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f4156a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f415806d200 0x7f415815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f4156a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f415806d200 0x7f415815da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37592/0 (socket says 172.21.15.37:37592) 2024-05-30T06:42:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f4156a00640 1 -- 172.21.15.37:0/271953938 learned_addr learned my addr 172.21.15.37:0/271953938 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f414e000640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41580d0ac0 0x7f4158156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.955+0000 7f4157400640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f415815e8b0 0x7f4158155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f4156a00640 1 -- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f415815e8b0 msgr2=0x7f4158155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f4156a00640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f415815e8b0 0x7f4158155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f4156a00640 1 -- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41580d0ac0 msgr2=0x7f4158156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f4156a00640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41580d0ac0 0x7f4158156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f4156a00640 1 -- 172.21.15.37:0/271953938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4158157260 con 0x7f415806d200 2024-05-30T06:42:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f414e000640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41580d0ac0 0x7f4158156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f4156a00640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f415806d200 0x7f415815da20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f414800c410 tx=0x7f414800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f414f400640 1 -- 172.21.15.37:0/271953938 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41480074e0 con 0x7f415806d200 2024-05-30T06:42:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f414f400640 1 -- 172.21.15.37:0/271953938 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41480047f0 con 0x7f415806d200 2024-05-30T06:42:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f414f400640 1 -- 172.21.15.37:0/271953938 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4148007680 con 0x7f415806d200 2024-05-30T06:42:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f415da00640 1 -- 172.21.15.37:0/271953938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f415815cc60 con 0x7f415806d200 2024-05-30T06:42:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f415da00640 1 -- 172.21.15.37:0/271953938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f415815d500 con 0x7f415806d200 2024-05-30T06:42:45.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f415da00640 1 -- 172.21.15.37:0/271953938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f415815ce30 con 0x7f415806d200 2024-05-30T06:42:45.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f414f400640 1 -- 172.21.15.37:0/271953938 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4148011070 con 0x7f415806d200 2024-05-30T06:42:45.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f414f400640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4134068380 0x7f413406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:45.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f414f400640 1 -- 172.21.15.37:0/271953938 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4148086530 con 0x7f415806d200 2024-05-30T06:42:45.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.959+0000 7f414e000640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4134068380 0x7f413406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:45.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.963+0000 7f414e000640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4134068380 0x7f413406a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f41400af000 tx=0x7f4140008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:45.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:45.963+0000 7f414f400640 1 -- 172.21.15.37:0/271953938 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4148056400 con 0x7f415806d200 2024-05-30T06:42:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.127+0000 7f415da00640 1 -- 172.21.15.37:0/271953938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f41581586f0 con 0x7f415806d200 2024-05-30T06:42:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.131+0000 7f414f400640 1 -- 172.21.15.37:0/271953938 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f414805a700 con 0x7f415806d200 2024-05-30T06:42:46.129 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.131+0000 7f415da00640 1 -- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4134068380 msgr2=0x7f413406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.131+0000 7f415da00640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4134068380 0x7f413406a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f41400af000 tx=0x7f4140008040 comp rx=0 tx=0).stop 2024-05-30T06:42:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.131+0000 7f415da00640 1 -- 172.21.15.37:0/271953938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f415806d200 msgr2=0x7f415815da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.131+0000 7f415da00640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f415806d200 0x7f415815da20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f414800c410 tx=0x7f414800c8d0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.131+0000 7f415da00640 1 -- 172.21.15.37:0/271953938 shutdown_connections 2024-05-30T06:42:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.131+0000 7f415da00640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f415815e8b0 0x7f4158155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.131+0000 7f415da00640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4134068380 0x7f413406a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.131+0000 7f415da00640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41580d0ac0 0x7f4158156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.131+0000 7f415da00640 1 --2- 172.21.15.37:0/271953938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f415806d200 0x7f415815da20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.131+0000 7f415da00640 1 -- 172.21.15.37:0/271953938 >> 172.21.15.37:0/271953938 conn(0x7f41580b4130 msgr2=0x7f4158161180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:46.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.131+0000 7f415da00640 1 -- 172.21.15.37:0/271953938 shutdown_connections 2024-05-30T06:42:46.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.131+0000 7f415da00640 1 -- 172.21.15.37:0/271953938 wait complete. 2024-05-30T06:42:46.150 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:42:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff818a00640 1 Processor -- start 2024-05-30T06:42:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff818a00640 1 -- start start 2024-05-30T06:42:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff818a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff814140df0 0x7ff8140cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff818a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff8140cef50 0x7ff814141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff818a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff81415cde0 con 0x7ff8140b59d0 2024-05-30T06:42:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff818a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff81415d0c0 con 0x7ff8140cef50 2024-05-30T06:42:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff818a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff81415d3a0 con 0x7ff814140df0 2024-05-30T06:42:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff811e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff8140b59d0 0x7ff8140b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:44206/0 (socket says 172.21.15.37:44206) 2024-05-30T06:42:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff811e00640 1 -- 172.21.15.37:0/38978326 learned_addr learned my addr 172.21.15.37:0/38978326 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff80be00640 1 --2- 172.21.15.37:0/38978326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff814140df0 0x7ff8140cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff812800640 1 --2- 172.21.15.37:0/38978326 >> v2:172.21.15.105:3300/0 conn(0x7ff8140cef50 0x7ff814141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff811400640 1 -- 172.21.15.37:0/38978326 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997380914 0 0) 0x7ff81415cde0 con 0x7ff8140b59d0 2024-05-30T06:42:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff811400640 1 -- 172.21.15.37:0/38978326 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7f8003530 con 0x7ff8140b59d0 2024-05-30T06:42:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff80be00640 1 -- 172.21.15.37:0/38978326 >> v2:172.21.15.105:3300/0 conn(0x7ff8140cef50 msgr2=0x7ff814141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff80be00640 1 --2- 172.21.15.37:0/38978326 >> v2:172.21.15.105:3300/0 conn(0x7ff8140cef50 0x7ff814141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff80be00640 1 -- 172.21.15.37:0/38978326 >> v1:172.21.15.105:6789/0 conn(0x7ff8140b59d0 legacy=0x7ff8140b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff80be00640 1 -- 172.21.15.37:0/38978326 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81415d680 con 0x7ff814140df0 2024-05-30T06:42:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.295+0000 7ff812800640 1 --2- 172.21.15.37:0/38978326 >> v2:172.21.15.105:3300/0 conn(0x7ff8140cef50 0x7ff814141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.299+0000 7ff80be00640 1 --2- 172.21.15.37:0/38978326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff814140df0 0x7ff8140cea10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0097c0 tx=0x7ff7fc01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f2d9926988f04f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.299+0000 7ff811400640 1 -- 172.21.15.37:0/38978326 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc0b5070 con 0x7ff814140df0 2024-05-30T06:42:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.299+0000 7ff811400640 1 -- 172.21.15.37:0/38978326 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7fc0a8990 con 0x7ff814140df0 2024-05-30T06:42:46.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.299+0000 7ff811400640 1 -- 172.21.15.37:0/38978326 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc0a8d40 con 0x7ff814140df0 2024-05-30T06:42:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.299+0000 7ff818a00640 1 -- 172.21.15.37:0/38978326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff814140df0 msgr2=0x7ff8140cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.299+0000 7ff818a00640 1 --2- 172.21.15.37:0/38978326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff814140df0 0x7ff8140cea10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0097c0 tx=0x7ff7fc01ec90 comp rx=0 tx=0).stop 2024-05-30T06:42:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.299+0000 7ff818a00640 1 -- 172.21.15.37:0/38978326 shutdown_connections 2024-05-30T06:42:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.299+0000 7ff818a00640 1 --2- 172.21.15.37:0/38978326 >> v2:172.21.15.105:3300/0 conn(0x7ff8140cef50 0x7ff814141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.299+0000 7ff818a00640 1 --2- 172.21.15.37:0/38978326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff814140df0 0x7ff8140cea10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.299+0000 7ff818a00640 1 -- 172.21.15.37:0/38978326 >> 172.21.15.37:0/38978326 conn(0x7ff81406bf60 msgr2=0x7ff8140b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.299+0000 7ff818a00640 1 -- 172.21.15.37:0/38978326 shutdown_connections 2024-05-30T06:42:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.299+0000 7ff818a00640 1 -- 172.21.15.37:0/38978326 wait complete. 2024-05-30T06:42:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff818a00640 1 Processor -- start 2024-05-30T06:42:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff818a00640 1 -- start start 2024-05-30T06:42:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff818a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8140b59d0 0x7ff8141f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff818a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8140cef50 0x7ff8141f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff818a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff814140df0 0x7ff81406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff818a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff814141ab0 con 0x7ff8140cef50 2024-05-30T06:42:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff818a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff8140b0150 con 0x7ff814140df0 2024-05-30T06:42:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff818a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff814141c30 con 0x7ff8140b59d0 2024-05-30T06:42:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff80be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8140cef50 0x7ff8141f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff80be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8140cef50 0x7ff8141f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37600/0 (socket says 172.21.15.37:37600) 2024-05-30T06:42:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff80be00640 1 -- 172.21.15.37:0/1761468568 learned_addr learned my addr 172.21.15.37:0/1761468568 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff811e00640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8140b59d0 0x7ff8141f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff812800640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff814140df0 0x7ff81406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff80be00640 1 -- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8140b59d0 msgr2=0x7ff8141f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff80be00640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8140b59d0 0x7ff8141f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff80be00640 1 -- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff814140df0 msgr2=0x7ff81406ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff80be00640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff814140df0 0x7ff81406ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff80be00640 1 -- 172.21.15.37:0/1761468568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81415f240 con 0x7ff8140cef50 2024-05-30T06:42:46.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff80be00640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8140cef50 0x7ff8141f4a10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc01d340 tx=0x7ff7fc01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:46.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff80a000640 1 -- 172.21.15.37:0/1761468568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc0b5040 con 0x7ff8140cef50 2024-05-30T06:42:46.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff80a000640 1 -- 172.21.15.37:0/1761468568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7fc0b0640 con 0x7ff8140cef50 2024-05-30T06:42:46.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff818a00640 1 -- 172.21.15.37:0/1761468568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81415f520 con 0x7ff8140cef50 2024-05-30T06:42:46.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff80a000640 1 -- 172.21.15.37:0/1761468568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc0b09f0 con 0x7ff8140cef50 2024-05-30T06:42:46.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff818a00640 1 -- 172.21.15.37:0/1761468568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81415fae0 con 0x7ff8140cef50 2024-05-30T06:42:46.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.303+0000 7ff818a00640 1 -- 172.21.15.37:0/1761468568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff814068bc0 con 0x7ff8140cef50 2024-05-30T06:42:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.307+0000 7ff80a000640 1 -- 172.21.15.37:0/1761468568 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff7fc0b0b90 con 0x7ff8140cef50 2024-05-30T06:42:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.307+0000 7ff80a000640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7f0068380 0x7ff7f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.307+0000 7ff80a000640 1 -- 172.21.15.37:0/1761468568 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff7fc124060 con 0x7ff8140cef50 2024-05-30T06:42:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.307+0000 7ff811e00640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7f0068380 0x7ff7f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.307+0000 7ff811e00640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7f0068380 0x7ff7f006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff804007fd0 tx=0x7ff804009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:46.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.311+0000 7ff80a000640 1 -- 172.21.15.37:0/1761468568 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff7fc0187f0 con 0x7ff8140cef50 2024-05-30T06:42:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.475+0000 7ff818a00640 1 -- 172.21.15.37:0/1761468568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff814154390 con 0x7ff8140cef50 2024-05-30T06:42:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.475+0000 7ff80a000640 1 -- 172.21.15.37:0/1761468568 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7ff7fc0f47d0 con 0x7ff8140cef50 2024-05-30T06:42:46.475 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:42:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.479+0000 7ff818a00640 1 -- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7f0068380 msgr2=0x7ff7f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.479+0000 7ff818a00640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7f0068380 0x7ff7f006a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff804007fd0 tx=0x7ff804009040 comp rx=0 tx=0).stop 2024-05-30T06:42:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.479+0000 7ff818a00640 1 -- 172.21.15.37:0/1761468568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8140cef50 msgr2=0x7ff8141f4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.479+0000 7ff818a00640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8140cef50 0x7ff8141f4a10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc01d340 tx=0x7ff7fc01ba30 comp rx=0 tx=0).stop 2024-05-30T06:42:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.479+0000 7ff818a00640 1 -- 172.21.15.37:0/1761468568 shutdown_connections 2024-05-30T06:42:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.479+0000 7ff818a00640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7f0068380 0x7ff7f006a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.479+0000 7ff818a00640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff814140df0 0x7ff81406ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.479+0000 7ff818a00640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8140cef50 0x7ff8141f4a10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.479+0000 7ff818a00640 1 --2- 172.21.15.37:0/1761468568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8140b59d0 0x7ff8141f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.479+0000 7ff818a00640 1 -- 172.21.15.37:0/1761468568 >> 172.21.15.37:0/1761468568 conn(0x7ff81406bf60 msgr2=0x7ff8140b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.479+0000 7ff818a00640 1 -- 172.21.15.37:0/1761468568 shutdown_connections 2024-05-30T06:42:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.479+0000 7ff818a00640 1 -- 172.21.15.37:0/1761468568 wait complete. 2024-05-30T06:42:46.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:42:46.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.639+0000 7f379fa00640 1 Processor -- start 2024-05-30T06:42:46.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.639+0000 7f379fa00640 1 -- start start 2024-05-30T06:42:46.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f379fa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f379815c890 0x7f3798162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f379fa00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f379815f210 0x7f3798072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f379fa00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3798163020 con 0x7f37980cec10 2024-05-30T06:42:46.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f379fa00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3798163300 con 0x7f379815f210 2024-05-30T06:42:46.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f379fa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f37981635e0 con 0x7f379815c890 2024-05-30T06:42:46.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f379da00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f37980cec10 0x7f379806c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40926/0 (socket says 172.21.15.37:40926) 2024-05-30T06:42:46.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f379da00640 1 -- 172.21.15.37:0/2054950065 learned_addr learned my addr 172.21.15.37:0/2054950065 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:46.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f3797e00640 1 --2- 172.21.15.37:0/2054950065 >> v2:172.21.15.105:3300/0 conn(0x7f379815f210 0x7f3798072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f379d000640 1 --2- 172.21.15.37:0/2054950065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f379815c890 0x7f3798162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f3797400640 1 -- 172.21.15.37:0/2054950065 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1670796638 0 0) 0x7f3798163020 con 0x7f37980cec10 2024-05-30T06:42:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f3797e00640 1 -- 172.21.15.37:0/2054950065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f379815c890 msgr2=0x7f3798162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f3797e00640 1 --2- 172.21.15.37:0/2054950065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f379815c890 0x7f3798162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f3797e00640 1 -- 172.21.15.37:0/2054950065 >> v1:172.21.15.37:6789/0 conn(0x7f37980cec10 legacy=0x7f379806c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.643+0000 7f3797e00640 1 -- 172.21.15.37:0/2054950065 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379806ba00 con 0x7f379815f210 2024-05-30T06:42:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f3797e00640 1 --2- 172.21.15.37:0/2054950065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f379815f210 0x7f3798072750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f37840097c0 tx=0x7f378401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12f4bb0fb67797b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f3797400640 1 -- 172.21.15.37:0/2054950065 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37840b0070 con 0x7f379815f210 2024-05-30T06:42:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f3797400640 1 -- 172.21.15.37:0/2054950065 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37840ab600 con 0x7f379815f210 2024-05-30T06:42:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f3797400640 1 -- 172.21.15.37:0/2054950065 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37840ab9d0 con 0x7f379815f210 2024-05-30T06:42:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f379fa00640 1 -- 172.21.15.37:0/2054950065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f379815f210 msgr2=0x7f3798072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f379fa00640 1 --2- 172.21.15.37:0/2054950065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f379815f210 0x7f3798072750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f37840097c0 tx=0x7f378401c410 comp rx=0 tx=0).stop 2024-05-30T06:42:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f379fa00640 1 -- 172.21.15.37:0/2054950065 shutdown_connections 2024-05-30T06:42:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f379fa00640 1 --2- 172.21.15.37:0/2054950065 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f379815f210 0x7f3798072750 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f379fa00640 1 --2- 172.21.15.37:0/2054950065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f379815c890 0x7f3798162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f379fa00640 1 -- 172.21.15.37:0/2054950065 >> 172.21.15.37:0/2054950065 conn(0x7f37980b2ac0 msgr2=0x7f37980b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f379fa00640 1 -- 172.21.15.37:0/2054950065 shutdown_connections 2024-05-30T06:42:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f379fa00640 1 -- 172.21.15.37:0/2054950065 wait complete. 2024-05-30T06:42:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f379fa00640 1 Processor -- start 2024-05-30T06:42:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.647+0000 7f379fa00640 1 -- start start 2024-05-30T06:42:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f379fa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37980cec10 0x7f3798154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f379fa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379815c890 0x7f3798156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f379fa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f379815f210 0x7f3798155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f379fa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f379816bcd0 con 0x7f379815c890 2024-05-30T06:42:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f379fa00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f37980730a0 con 0x7f379815f210 2024-05-30T06:42:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f379fa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f379816be50 con 0x7f37980cec10 2024-05-30T06:42:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f3797e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379815c890 0x7f3798156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f3797e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379815c890 0x7f3798156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37610/0 (socket says 172.21.15.37:37610) 2024-05-30T06:42:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f3797e00640 1 -- 172.21.15.37:0/388700699 learned_addr learned my addr 172.21.15.37:0/388700699 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f379d000640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37980cec10 0x7f3798154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f379da00640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f379815f210 0x7f3798155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f3797e00640 1 -- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37980cec10 msgr2=0x7f3798154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f3797e00640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37980cec10 0x7f3798154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f3797e00640 1 -- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f379815f210 msgr2=0x7f3798155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f3797e00640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f379815f210 0x7f3798155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f3797e00640 1 -- 172.21.15.37:0/388700699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37980adf20 con 0x7f379815c890 2024-05-30T06:42:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f379da00640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f379815f210 0x7f3798155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f3797e00640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379815c890 0x7f3798156bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f378401a040 tx=0x7f378401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f3794c00640 1 -- 172.21.15.37:0/388700699 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37840b0050 con 0x7f379815c890 2024-05-30T06:42:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f3794c00640 1 -- 172.21.15.37:0/388700699 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37840bc070 con 0x7f379815c890 2024-05-30T06:42:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f3794c00640 1 -- 172.21.15.37:0/388700699 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37840b5a70 con 0x7f379815c890 2024-05-30T06:42:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f379fa00640 1 -- 172.21.15.37:0/388700699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37980ae1e0 con 0x7f379815c890 2024-05-30T06:42:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f379fa00640 1 -- 172.21.15.37:0/388700699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37980ae7a0 con 0x7f379815c890 2024-05-30T06:42:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f379fa00640 1 -- 172.21.15.37:0/388700699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3798068bc0 con 0x7f379815c890 2024-05-30T06:42:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.651+0000 7f3794c00640 1 -- 172.21.15.37:0/388700699 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f37840b5c10 con 0x7f379815c890 2024-05-30T06:42:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.655+0000 7f3794c00640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3778068380 0x7f377806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.655+0000 7f3794c00640 1 -- 172.21.15.37:0/388700699 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3784121320 con 0x7f379815c890 2024-05-30T06:42:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.655+0000 7f379d000640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3778068380 0x7f377806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.655+0000 7f379d000640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3778068380 0x7f377806a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f378c009b60 tx=0x7f378c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.659+0000 7f3794c00640 1 -- 172.21.15.37:0/388700699 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3784016090 con 0x7f379815c890 2024-05-30T06:42:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.823+0000 7f379fa00640 1 -- 172.21.15.37:0/388700699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f37980b4b70 con 0x7f379815c890 2024-05-30T06:42:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.823+0000 7f3794c00640 1 -- 172.21.15.37:0/388700699 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f37840f18d0 con 0x7f379815c890 2024-05-30T06:42:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:42:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.827+0000 7f379fa00640 1 -- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3778068380 msgr2=0x7f377806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.827+0000 7f379fa00640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3778068380 0x7f377806a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f378c009b60 tx=0x7f378c009190 comp rx=0 tx=0).stop 2024-05-30T06:42:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.827+0000 7f379fa00640 1 -- 172.21.15.37:0/388700699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379815c890 msgr2=0x7f3798156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.827+0000 7f379fa00640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379815c890 0x7f3798156bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f378401a040 tx=0x7f378401ac50 comp rx=0 tx=0).stop 2024-05-30T06:42:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.827+0000 7f379fa00640 1 -- 172.21.15.37:0/388700699 shutdown_connections 2024-05-30T06:42:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.827+0000 7f379fa00640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3778068380 0x7f377806a840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.827+0000 7f379fa00640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f379815f210 0x7f3798155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.827+0000 7f379fa00640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f379815c890 0x7f3798156bf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.827+0000 7f379fa00640 1 --2- 172.21.15.37:0/388700699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37980cec10 0x7f3798154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.827+0000 7f379fa00640 1 -- 172.21.15.37:0/388700699 >> 172.21.15.37:0/388700699 conn(0x7f37980b2ac0 msgr2=0x7f3798158bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.827+0000 7f379fa00640 1 -- 172.21.15.37:0/388700699 shutdown_connections 2024-05-30T06:42:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.827+0000 7f379fa00640 1 -- 172.21.15.37:0/388700699 wait complete. 2024-05-30T06:42:46.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T06:42:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.987+0000 7f560ea00640 1 Processor -- start 2024-05-30T06:42:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.987+0000 7f560ea00640 1 -- start start 2024-05-30T06:42:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.987+0000 7f560ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560806d200 0x7f560806d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.987+0000 7f560ea00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f56080d0ac0 0x7f56080d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.987+0000 7f560ea00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560806db60 con 0x7f560815e8b0 2024-05-30T06:42:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.987+0000 7f560ea00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5608163350 con 0x7f56080d0ac0 2024-05-30T06:42:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.987+0000 7f560ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f56081627d0 con 0x7f560806d200 2024-05-30T06:42:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.991+0000 7f5607e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f560815e8b0 0x7f56080cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40930/0 (socket says 172.21.15.37:40930) 2024-05-30T06:42:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.991+0000 7f5607e00640 1 -- 172.21.15.37:0/2936359516 learned_addr learned my addr 172.21.15.37:0/2936359516 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.991+0000 7f55ff400640 1 --2- 172.21.15.37:0/2936359516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560806d200 0x7f560806d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.991+0000 7f560ca00640 1 --2- 172.21.15.37:0/2936359516 >> v2:172.21.15.105:3300/0 conn(0x7f56080d0ac0 0x7f56080d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.991+0000 7f5607400640 1 -- 172.21.15.37:0/2936359516 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2584943113 0 0) 0x7f560806db60 con 0x7f560815e8b0 2024-05-30T06:42:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.991+0000 7f5607400640 1 -- 172.21.15.37:0/2936359516 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55ec003530 con 0x7f560815e8b0 2024-05-30T06:42:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.991+0000 7f55ff400640 1 -- 172.21.15.37:0/2936359516 >> v2:172.21.15.105:3300/0 conn(0x7f56080d0ac0 msgr2=0x7f56080d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.991+0000 7f55ff400640 1 --2- 172.21.15.37:0/2936359516 >> v2:172.21.15.105:3300/0 conn(0x7f56080d0ac0 0x7f56080d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.991+0000 7f55ff400640 1 -- 172.21.15.37:0/2936359516 >> v1:172.21.15.37:6789/0 conn(0x7f560815e8b0 legacy=0x7f56080cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.991+0000 7f55ff400640 1 -- 172.21.15.37:0/2936359516 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5608162ab0 con 0x7f560806d200 2024-05-30T06:42:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.991+0000 7f55ff400640 1 --2- 172.21.15.37:0/2936359516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560806d200 0x7f560806d620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f55f00097c0 tx=0x7f55f001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=547f3392842a3d1e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f5607400640 1 -- 172.21.15.37:0/2936359516 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f00b2070 con 0x7f560806d200 2024-05-30T06:42:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f5607400640 1 -- 172.21.15.37:0/2936359516 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f00ad640 con 0x7f560806d200 2024-05-30T06:42:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f5607400640 1 -- 172.21.15.37:0/2936359516 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f00ad9f0 con 0x7f560806d200 2024-05-30T06:42:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 -- 172.21.15.37:0/2936359516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560806d200 msgr2=0x7f560806d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 --2- 172.21.15.37:0/2936359516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560806d200 0x7f560806d620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f55f00097c0 tx=0x7f55f001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 -- 172.21.15.37:0/2936359516 shutdown_connections 2024-05-30T06:42:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 --2- 172.21.15.37:0/2936359516 >> v2:172.21.15.105:3300/0 conn(0x7f56080d0ac0 0x7f56080d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 --2- 172.21.15.37:0/2936359516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560806d200 0x7f560806d620 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 -- 172.21.15.37:0/2936359516 >> 172.21.15.37:0/2936359516 conn(0x7f56080b4130 msgr2=0x7f56080b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 -- 172.21.15.37:0/2936359516 shutdown_connections 2024-05-30T06:42:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 -- 172.21.15.37:0/2936359516 wait complete. 2024-05-30T06:42:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 Processor -- start 2024-05-30T06:42:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 -- start start 2024-05-30T06:42:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560806d200 0x7f56080b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56080d0ac0 0x7f560815c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560815e8b0 0x7f56080cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f56080cf050 con 0x7f560806d200 2024-05-30T06:42:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5608162480 con 0x7f56080d0ac0 2024-05-30T06:42:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f560816b820 con 0x7f560815e8b0 2024-05-30T06:42:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f5607e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560806d200 0x7f56080b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f5607e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560806d200 0x7f56080b7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37614/0 (socket says 172.21.15.37:37614) 2024-05-30T06:42:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f5607e00640 1 -- 172.21.15.37:0/3937522925 learned_addr learned my addr 172.21.15.37:0/3937522925 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f55ff400640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56080d0ac0 0x7f560815c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f560ca00640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560815e8b0 0x7f56080cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f5607e00640 1 -- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560815e8b0 msgr2=0x7f56080cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.995+0000 7f5607e00640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560815e8b0 0x7f56080cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f5607e00640 1 -- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56080d0ac0 msgr2=0x7f560815c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f5607e00640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56080d0ac0 0x7f560815c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f5607e00640 1 -- 172.21.15.37:0/3937522925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56081f7a30 con 0x7f560806d200 2024-05-30T06:42:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f560ca00640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560815e8b0 0x7f56080cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f5607e00640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560806d200 0x7f56080b7be0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f55f800c480 tx=0x7f55f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f5604c00640 1 -- 172.21.15.37:0/3937522925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8017070 con 0x7f560806d200 2024-05-30T06:42:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f5604c00640 1 -- 172.21.15.37:0/3937522925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f8005cf0 con 0x7f560806d200 2024-05-30T06:42:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f5604c00640 1 -- 172.21.15.37:0/3937522925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8007290 con 0x7f560806d200 2024-05-30T06:42:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f560ea00640 1 -- 172.21.15.37:0/3937522925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56081f7d10 con 0x7f560806d200 2024-05-30T06:42:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f560ea00640 1 -- 172.21.15.37:0/3937522925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56081f82d0 con 0x7f560806d200 2024-05-30T06:42:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f560ea00640 1 -- 172.21.15.37:0/3937522925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5608068bc0 con 0x7f560806d200 2024-05-30T06:42:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f5604c00640 1 -- 172.21.15.37:0/3937522925 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f55f801a070 con 0x7f560806d200 2024-05-30T06:42:47.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f5604c00640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f55e4068380 0x7f55e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:47.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f5604c00640 1 -- 172.21.15.37:0/3937522925 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f55f8085d60 con 0x7f560806d200 2024-05-30T06:42:47.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:46.999+0000 7f55ff400640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f55e4068380 0x7f55e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:47.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.003+0000 7f55ff400640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f55e4068380 0x7f55e406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f55f00af000 tx=0x7f55f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:47.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.003+0000 7f5604c00640 1 -- 172.21.15.37:0/3937522925 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f55f80563b0 con 0x7f560806d200 2024-05-30T06:42:47.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f560ea00640 1 -- 172.21.15.37:0/3937522925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f56080b85a0 con 0x7f560806d200 2024-05-30T06:42:47.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f5604c00640 1 -- 172.21.15.37:0/3937522925 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f55f8055cb0 con 0x7f560806d200 2024-05-30T06:42:47.181 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-30T06:42:47.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f560ea00640 1 -- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f55e4068380 msgr2=0x7f55e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:47.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f560ea00640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f55e4068380 0x7f55e406a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f55f00af000 tx=0x7f55f0008040 comp rx=0 tx=0).stop 2024-05-30T06:42:47.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f560ea00640 1 -- 172.21.15.37:0/3937522925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560806d200 msgr2=0x7f56080b7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:47.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f560ea00640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560806d200 0x7f56080b7be0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f55f800c480 tx=0x7f55f800c940 comp rx=0 tx=0).stop 2024-05-30T06:42:47.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f560ea00640 1 -- 172.21.15.37:0/3937522925 shutdown_connections 2024-05-30T06:42:47.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f560ea00640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560815e8b0 0x7f56080cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f560ea00640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f55e4068380 0x7f55e406a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f560ea00640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56080d0ac0 0x7f560815c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f560ea00640 1 --2- 172.21.15.37:0/3937522925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f560806d200 0x7f56080b7be0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f560ea00640 1 -- 172.21.15.37:0/3937522925 >> 172.21.15.37:0/3937522925 conn(0x7f56080b4130 msgr2=0x7f56081600c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:47.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f560ea00640 1 -- 172.21.15.37:0/3937522925 shutdown_connections 2024-05-30T06:42:47.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.183+0000 7f560ea00640 1 -- 172.21.15.37:0/3937522925 wait complete. 2024-05-30T06:42:47.203 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-30T06:42:47.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:47.203 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-30T06:42:47.249 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-05-30T06:42:47.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:47.249 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-30T06:42:47.264 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:42:47.264 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:47.275 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:42:47.275 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:47.324 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:42:47.324 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:47.381 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:47.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7087200640 1 Processor -- start 2024-05-30T06:42:47.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7087200640 1 -- start start 2024-05-30T06:42:47.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7087200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7088144f00 0x7f70880b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:47.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7087200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70880cd790 0x7f708806f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:47.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7087200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7088072e30 con 0x7f708806ef30 2024-05-30T06:42:47.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7087200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f708806f8d0 con 0x7f7088144f00 2024-05-30T06:42:47.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7087200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f70880cdc60 con 0x7f70880cd790 2024-05-30T06:42:47.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7086800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70880cd790 0x7f708806f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:47.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7085e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7088144f00 0x7f70880b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:47.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7086800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70880cd790 0x7f708806f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:51848/0 (socket says 172.21.15.37:51848) 2024-05-30T06:42:47.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7086800640 1 -- 172.21.15.37:0/2254870359 learned_addr learned my addr 172.21.15.37:0/2254870359 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:47.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7086800640 1 -- 172.21.15.37:0/2254870359 >> v2:172.21.15.105:3300/0 conn(0x7f7088144f00 msgr2=0x7f70880b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:47.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7086800640 1 --2- 172.21.15.37:0/2254870359 >> v2:172.21.15.105:3300/0 conn(0x7f7088144f00 0x7f70880b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7086800640 1 -- 172.21.15.37:0/2254870359 >> v1:172.21.15.105:6789/0 conn(0x7f708806ef30 legacy=0x7f70880cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:47.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.567+0000 7f7086800640 1 -- 172.21.15.37:0/2254870359 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70880b3b50 con 0x7f70880cd790 2024-05-30T06:42:47.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.571+0000 7f7086800640 1 --2- 172.21.15.37:0/2254870359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70880cd790 0x7f708806f390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7080009e50 tx=0x7f708001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1800653b23eb0ff9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:47.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.571+0000 7f7085400640 1 -- 172.21.15.37:0/2254870359 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70800a5830 con 0x7f70880cd790 2024-05-30T06:42:47.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.571+0000 7f7085400640 1 -- 172.21.15.37:0/2254870359 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70800a59d0 con 0x7f70880cd790 2024-05-30T06:42:47.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.571+0000 7f7085400640 1 -- 172.21.15.37:0/2254870359 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70800a5da0 con 0x7f70880cd790 2024-05-30T06:42:47.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.571+0000 7f7087200640 1 -- 172.21.15.37:0/2254870359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70880cd790 msgr2=0x7f708806f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:47.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.571+0000 7f7087200640 1 --2- 172.21.15.37:0/2254870359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70880cd790 0x7f708806f390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7080009e50 tx=0x7f708001c970 comp rx=0 tx=0).stop 2024-05-30T06:42:47.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.571+0000 7f7087200640 1 -- 172.21.15.37:0/2254870359 shutdown_connections 2024-05-30T06:42:47.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.571+0000 7f7087200640 1 --2- 172.21.15.37:0/2254870359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70880cd790 0x7f708806f390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.571+0000 7f7087200640 1 --2- 172.21.15.37:0/2254870359 >> v2:172.21.15.105:3300/0 conn(0x7f7088144f00 0x7f70880b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.571+0000 7f7087200640 1 -- 172.21.15.37:0/2254870359 >> 172.21.15.37:0/2254870359 conn(0x7f70880b2120 msgr2=0x7f70880b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:47.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.571+0000 7f7087200640 1 -- 172.21.15.37:0/2254870359 shutdown_connections 2024-05-30T06:42:47.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.571+0000 7f7087200640 1 -- 172.21.15.37:0/2254870359 wait complete. 2024-05-30T06:42:47.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f7087200640 1 Processor -- start 2024-05-30T06:42:47.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f7087200640 1 -- start start 2024-05-30T06:42:47.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f7087200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f708806ef30 0x7f7088159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:47.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f7087200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70880cd790 0x7f70881fa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f7087200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7088144f00 0x7f708815cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f7087200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f708815c290 con 0x7f70880cd790 2024-05-30T06:42:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f7087200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f70880b4e50 con 0x7f7088144f00 2024-05-30T06:42:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f7087200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f708815c410 con 0x7f708806ef30 2024-05-30T06:42:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f707fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70880cd790 0x7f70881fa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f707fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70880cd790 0x7f70881fa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34986/0 (socket says 172.21.15.37:34986) 2024-05-30T06:42:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f707fe00640 1 -- 172.21.15.37:0/1259699549 learned_addr learned my addr 172.21.15.37:0/1259699549 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f7086800640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7088144f00 0x7f708815cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f7085e00640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f708806ef30 0x7f7088159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f707fe00640 1 -- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f708806ef30 msgr2=0x7f7088159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:47.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f707fe00640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f708806ef30 0x7f7088159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f707fe00640 1 -- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7088144f00 msgr2=0x7f708815cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:47.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f707fe00640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7088144f00 0x7f708815cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f707fe00640 1 -- 172.21.15.37:0/1259699549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70881fb150 con 0x7f70880cd790 2024-05-30T06:42:47.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f707fe00640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70880cd790 0x7f70881fa900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f707000c3a0 tx=0x7f707000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:47.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f707e000640 1 -- 172.21.15.37:0/1259699549 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70700052d0 con 0x7f70880cd790 2024-05-30T06:42:47.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f707e000640 1 -- 172.21.15.37:0/1259699549 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7070005470 con 0x7f70880cd790 2024-05-30T06:42:47.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f707e000640 1 -- 172.21.15.37:0/1259699549 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070007260 con 0x7f70880cd790 2024-05-30T06:42:47.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f7087200640 1 -- 172.21.15.37:0/1259699549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70881fb490 con 0x7f70880cd790 2024-05-30T06:42:47.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f7087200640 1 -- 172.21.15.37:0/1259699549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70881fae40 con 0x7f70880cd790 2024-05-30T06:42:47.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.575+0000 7f7087200640 1 -- 172.21.15.37:0/1259699549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7088068ab0 con 0x7f70880cd790 2024-05-30T06:42:47.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.579+0000 7f707e000640 1 -- 172.21.15.37:0/1259699549 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7070007400 con 0x7f70880cd790 2024-05-30T06:42:47.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.579+0000 7f707e000640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7064068380 0x7f706406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:47.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.579+0000 7f707e000640 1 -- 172.21.15.37:0/1259699549 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7070085e60 con 0x7f70880cd790 2024-05-30T06:42:47.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.579+0000 7f7085e00640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7064068380 0x7f706406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:47.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.579+0000 7f7085e00640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7064068380 0x7f706406a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f708815ca80 tx=0x7f7078009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:47.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.583+0000 7f707e000640 1 -- 172.21.15.37:0/1259699549 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f70881fb490 con 0x7f70880cd790 2024-05-30T06:42:47.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.747+0000 7f7087200640 1 -- 172.21.15.37:0/1259699549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f708806e580 con 0x7f70880cd790 2024-05-30T06:42:47.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.747+0000 7f707e000640 1 -- 172.21.15.37:0/1259699549 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7f7088072e30 con 0x7f70880cd790 2024-05-30T06:42:47.747 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:47.748 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.751+0000 7f7087200640 1 -- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7064068380 msgr2=0x7f706406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.751+0000 7f7087200640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7064068380 0x7f706406a840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f708815ca80 tx=0x7f7078009190 comp rx=0 tx=0).stop 2024-05-30T06:42:47.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.751+0000 7f7087200640 1 -- 172.21.15.37:0/1259699549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70880cd790 msgr2=0x7f70881fa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.751+0000 7f7087200640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70880cd790 0x7f70881fa900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f707000c3a0 tx=0x7f707000c860 comp rx=0 tx=0).stop 2024-05-30T06:42:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.751+0000 7f7087200640 1 -- 172.21.15.37:0/1259699549 shutdown_connections 2024-05-30T06:42:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.751+0000 7f7087200640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7064068380 0x7f706406a840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.751+0000 7f7087200640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7088144f00 0x7f708815cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.751+0000 7f7087200640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70880cd790 0x7f70881fa900 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.751+0000 7f7087200640 1 --2- 172.21.15.37:0/1259699549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f708806ef30 0x7f7088159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.751+0000 7f7087200640 1 -- 172.21.15.37:0/1259699549 >> 172.21.15.37:0/1259699549 conn(0x7f70880b2120 msgr2=0x7f7088074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.751+0000 7f7087200640 1 -- 172.21.15.37:0/1259699549 shutdown_connections 2024-05-30T06:42:47.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.751+0000 7f7087200640 1 -- 172.21.15.37:0/1259699549 wait complete. 2024-05-30T06:42:47.769 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:42:09.128133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:42:09.755772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:47.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:47.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49bf200640 1 Processor -- start 2024-05-30T06:42:47.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49bf200640 1 -- start start 2024-05-30T06:42:47.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49bf200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49c00cffd0 0x7f49c00cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:47.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49bf200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c00af0d0 con 0x7f49c015c9a0 2024-05-30T06:42:47.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49bf200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c00ce000 con 0x7f49c00d0600 2024-05-30T06:42:47.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49bf200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f49c00ce2e0 con 0x7f49c00cffd0 2024-05-30T06:42:47.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49b5400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f49c015c9a0 0x7f49c00afb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53844/0 (socket says 172.21.15.37:53844) 2024-05-30T06:42:47.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49b5400640 1 -- 172.21.15.37:0/3072418721 learned_addr learned my addr 172.21.15.37:0/3072418721 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:47.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49be800640 1 --2- 172.21.15.37:0/3072418721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49c00cffd0 0x7f49c00cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:47.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49bd400640 1 -- 172.21.15.37:0/3072418721 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2118835558 0 0) 0x7f49c00af0d0 con 0x7f49c015c9a0 2024-05-30T06:42:47.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49bd400640 1 -- 172.21.15.37:0/3072418721 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49a4003530 con 0x7f49c015c9a0 2024-05-30T06:42:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49bd400640 1 -- 172.21.15.37:0/3072418721 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3283579929 0 0) 0x7f49c00ce000 con 0x7f49c00d0600 2024-05-30T06:42:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49bd400640 1 -- 172.21.15.37:0/3072418721 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49c00af0d0 con 0x7f49c00d0600 2024-05-30T06:42:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49be800640 1 -- 172.21.15.37:0/3072418721 >> v1:172.21.15.105:6789/0 conn(0x7f49c00d0600 legacy=0x7f49c00d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49be800640 1 -- 172.21.15.37:0/3072418721 >> v1:172.21.15.37:6789/0 conn(0x7f49c015c9a0 legacy=0x7f49c00afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.915+0000 7f49be800640 1 -- 172.21.15.37:0/3072418721 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c00af370 con 0x7f49c00cffd0 2024-05-30T06:42:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.919+0000 7f49be800640 1 --2- 172.21.15.37:0/3072418721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49c00cffd0 0x7f49c00cd9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009dc0 tx=0x7f49b801c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7dd4fe945e1d95 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:47.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.919+0000 7f49bd400640 1 -- 172.21.15.37:0/3072418721 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b80b2070 con 0x7f49c00cffd0 2024-05-30T06:42:47.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.919+0000 7f49bd400640 1 -- 172.21.15.37:0/3072418721 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b80a5950 con 0x7f49c00cffd0 2024-05-30T06:42:47.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.919+0000 7f49bd400640 1 -- 172.21.15.37:0/3072418721 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b80a5d00 con 0x7f49c00cffd0 2024-05-30T06:42:47.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.919+0000 7f49bf200640 1 -- 172.21.15.37:0/3072418721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49c00cffd0 msgr2=0x7f49c00cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:47.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.919+0000 7f49bf200640 1 --2- 172.21.15.37:0/3072418721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49c00cffd0 0x7f49c00cd9d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009dc0 tx=0x7f49b801c960 comp rx=0 tx=0).stop 2024-05-30T06:42:47.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.919+0000 7f49bf200640 1 -- 172.21.15.37:0/3072418721 shutdown_connections 2024-05-30T06:42:47.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.919+0000 7f49bf200640 1 --2- 172.21.15.37:0/3072418721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49c00cffd0 0x7f49c00cd9d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.919+0000 7f49bf200640 1 -- 172.21.15.37:0/3072418721 >> 172.21.15.37:0/3072418721 conn(0x7f49c00b3ef0 msgr2=0x7f49c00b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:47.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.919+0000 7f49bf200640 1 -- 172.21.15.37:0/3072418721 shutdown_connections 2024-05-30T06:42:47.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.919+0000 7f49bf200640 1 -- 172.21.15.37:0/3072418721 wait complete. 2024-05-30T06:42:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49bf200640 1 Processor -- start 2024-05-30T06:42:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49bf200640 1 -- start start 2024-05-30T06:42:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49bf200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49c00cffd0 0x7f49c0159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49bf200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49c00d0600 0x7f49c0070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49bf200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c015c9a0 0x7f49c0071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49bf200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f49c00b0e20 con 0x7f49c015c9a0 2024-05-30T06:42:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49bf200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f49c00b0ca0 con 0x7f49c00cffd0 2024-05-30T06:42:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49bf200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f49c016a340 con 0x7f49c00d0600 2024-05-30T06:42:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49be800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c015c9a0 0x7f49c0071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49be800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c015c9a0 0x7f49c0071470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34992/0 (socket says 172.21.15.37:34992) 2024-05-30T06:42:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49bde00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49c00cffd0 0x7f49c0159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49be800640 1 -- 172.21.15.37:0/92779198 learned_addr learned my addr 172.21.15.37:0/92779198 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49b5400640 1 --2- 172.21.15.37:0/92779198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49c00d0600 0x7f49c0070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49be800640 1 -- 172.21.15.37:0/92779198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49c00d0600 msgr2=0x7f49c0070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49be800640 1 --2- 172.21.15.37:0/92779198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49c00d0600 0x7f49c0070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49be800640 1 -- 172.21.15.37:0/92779198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49c00cffd0 msgr2=0x7f49c0159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49be800640 1 --2- 172.21.15.37:0/92779198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49c00cffd0 0x7f49c0159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49be800640 1 -- 172.21.15.37:0/92779198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c015fd00 con 0x7f49c015c9a0 2024-05-30T06:42:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49be800640 1 --2- 172.21.15.37:0/92779198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c015c9a0 0x7f49c0071470 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49b80b0040 tx=0x7f49b8019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49b6a00640 1 -- 172.21.15.37:0/92779198 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b80b2050 con 0x7f49c015c9a0 2024-05-30T06:42:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49b6a00640 1 -- 172.21.15.37:0/92779198 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b80be070 con 0x7f49c015c9a0 2024-05-30T06:42:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49bf200640 1 -- 172.21.15.37:0/92779198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c015a510 con 0x7f49c015c9a0 2024-05-30T06:42:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49b6a00640 1 -- 172.21.15.37:0/92779198 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b80ad870 con 0x7f49c015c9a0 2024-05-30T06:42:47.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.923+0000 7f49bf200640 1 -- 172.21.15.37:0/92779198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c00b7d40 con 0x7f49c015c9a0 2024-05-30T06:42:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.927+0000 7f49bf200640 1 -- 172.21.15.37:0/92779198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c0068ab0 con 0x7f49c015c9a0 2024-05-30T06:42:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.927+0000 7f49b6a00640 1 -- 172.21.15.37:0/92779198 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f49b80ada10 con 0x7f49c015c9a0 2024-05-30T06:42:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.927+0000 7f49b6a00640 1 --2- 172.21.15.37:0/92779198 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f499c068380 0x7f499c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.927+0000 7f49b6a00640 1 -- 172.21.15.37:0/92779198 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f49b81219d0 con 0x7f49c015c9a0 2024-05-30T06:42:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.927+0000 7f49bde00640 1 --2- 172.21.15.37:0/92779198 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f499c068380 0x7f499c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:47.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.927+0000 7f49bde00640 1 --2- 172.21.15.37:0/92779198 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f499c068380 0x7f499c06a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f49b00011f0 tx=0x7f49b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:47.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:47.931+0000 7f49b6a00640 1 -- 172.21.15.37:0/92779198 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f49b8016580 con 0x7f49c015c9a0 2024-05-30T06:42:48.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49bf200640 1 -- 172.21.15.37:0/92779198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f49c00ce930 con 0x7f49c015c9a0 2024-05-30T06:42:48.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49b6a00640 1 -- 172.21.15.37:0/92779198 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f49b80add00 con 0x7f49c015c9a0 2024-05-30T06:42:48.098 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49bf200640 1 -- 172.21.15.37:0/92779198 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f499c068380 msgr2=0x7f499c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49bf200640 1 --2- 172.21.15.37:0/92779198 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f499c068380 0x7f499c06a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f49b00011f0 tx=0x7f49b0009040 comp rx=0 tx=0).stop 2024-05-30T06:42:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49bf200640 1 -- 172.21.15.37:0/92779198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c015c9a0 msgr2=0x7f49c0071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49bf200640 1 --2- 172.21.15.37:0/92779198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c015c9a0 0x7f49c0071470 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f49b80b0040 tx=0x7f49b8019700 comp rx=0 tx=0).stop 2024-05-30T06:42:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49bf200640 1 -- 172.21.15.37:0/92779198 shutdown_connections 2024-05-30T06:42:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49bf200640 1 --2- 172.21.15.37:0/92779198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49c015c9a0 0x7f49c0071470 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49bf200640 1 --2- 172.21.15.37:0/92779198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49c00d0600 0x7f49c0070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49bf200640 1 --2- 172.21.15.37:0/92779198 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f499c068380 0x7f499c06a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49bf200640 1 --2- 172.21.15.37:0/92779198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49c00cffd0 0x7f49c0159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49bf200640 1 -- 172.21.15.37:0/92779198 >> 172.21.15.37:0/92779198 conn(0x7f49c00b3ef0 msgr2=0x7f49c015bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49bf200640 1 -- 172.21.15.37:0/92779198 shutdown_connections 2024-05-30T06:42:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.099+0000 7f49bf200640 1 -- 172.21.15.37:0/92779198 wait complete. 2024-05-30T06:42:48.120 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:42:48.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.263+0000 7f1c13600640 1 Processor -- start 2024-05-30T06:42:48.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.263+0000 7f1c13600640 1 -- start start 2024-05-30T06:42:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.267+0000 7f1c13600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c0c15e8b0 0x7f1c0c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.267+0000 7f1c13600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c0c0d1ad0 0x7f1c0c06d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.267+0000 7f1c13600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c0c163350 con 0x7f1c0c06d200 2024-05-30T06:42:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.267+0000 7f1c13600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1c0c06db80 con 0x7f1c0c0d1ad0 2024-05-30T06:42:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.267+0000 7f1c13600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1c0c0cfb30 con 0x7f1c0c15e8b0 2024-05-30T06:42:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.267+0000 7f1c11600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c0c0d1ad0 0x7f1c0c06d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.267+0000 7f1c11600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c0c0d1ad0 0x7f1c0c06d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35004/0 (socket says 172.21.15.37:35004) 2024-05-30T06:42:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.267+0000 7f1c11600640 1 -- 172.21.15.37:0/2817193629 learned_addr learned my addr 172.21.15.37:0/2817193629 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.267+0000 7f1c10c00640 1 --2- 172.21.15.37:0/2817193629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c0c15e8b0 0x7f1c0c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.267+0000 7f1c11600640 1 -- 172.21.15.37:0/2817193629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c0c15e8b0 msgr2=0x7f1c0c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.267+0000 7f1c11600640 1 --2- 172.21.15.37:0/2817193629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c0c15e8b0 0x7f1c0c0cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.267+0000 7f1c11600640 1 -- 172.21.15.37:0/2817193629 >> v1:172.21.15.105:6789/0 conn(0x7f1c0c06d200 legacy=0x7f1c0c09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.267+0000 7f1c11600640 1 -- 172.21.15.37:0/2817193629 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0c1627d0 con 0x7f1c0c0d1ad0 2024-05-30T06:42:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c11600640 1 --2- 172.21.15.37:0/2817193629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c0c0d1ad0 0x7f1c0c06d640 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009e50 tx=0x7f1c0401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e800ae8e698920ce server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c0be00640 1 -- 172.21.15.37:0/2817193629 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c040a5700 con 0x7f1c0c0d1ad0 2024-05-30T06:42:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c0be00640 1 -- 172.21.15.37:0/2817193629 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c040a58a0 con 0x7f1c0c0d1ad0 2024-05-30T06:42:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c0be00640 1 -- 172.21.15.37:0/2817193629 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c040a5c70 con 0x7f1c0c0d1ad0 2024-05-30T06:42:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c13600640 1 -- 172.21.15.37:0/2817193629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c0c0d1ad0 msgr2=0x7f1c0c06d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c13600640 1 --2- 172.21.15.37:0/2817193629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c0c0d1ad0 0x7f1c0c06d640 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009e50 tx=0x7f1c0401ca30 comp rx=0 tx=0).stop 2024-05-30T06:42:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c13600640 1 -- 172.21.15.37:0/2817193629 shutdown_connections 2024-05-30T06:42:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c13600640 1 --2- 172.21.15.37:0/2817193629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c0c0d1ad0 0x7f1c0c06d640 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c13600640 1 --2- 172.21.15.37:0/2817193629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c0c15e8b0 0x7f1c0c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c13600640 1 -- 172.21.15.37:0/2817193629 >> 172.21.15.37:0/2817193629 conn(0x7f1c0c0b4130 msgr2=0x7f1c0c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c13600640 1 -- 172.21.15.37:0/2817193629 shutdown_connections 2024-05-30T06:42:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c13600640 1 -- 172.21.15.37:0/2817193629 wait complete. 2024-05-30T06:42:48.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c13600640 1 Processor -- start 2024-05-30T06:42:48.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.271+0000 7f1c13600640 1 -- start start 2024-05-30T06:42:48.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c13600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c0c06d200 0x7f1c0c15d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c13600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c0c0d1ad0 0x7f1c0c0c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c13600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c0c15e8b0 0x7f1c0c1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c13600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c162480 con 0x7f1c0c06d200 2024-05-30T06:42:48.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c13600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c15ec90 con 0x7f1c0c15e8b0 2024-05-30T06:42:48.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c13600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1c0c0cf050 con 0x7f1c0c0d1ad0 2024-05-30T06:42:48.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c10c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c0c06d200 0x7f1c0c15d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c10c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c0c06d200 0x7f1c0c15d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35008/0 (socket says 172.21.15.37:35008) 2024-05-30T06:42:48.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c10c00640 1 -- 172.21.15.37:0/890521447 learned_addr learned my addr 172.21.15.37:0/890521447 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:48.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c11600640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c0c15e8b0 0x7f1c0c1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c03e00640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c0c0d1ad0 0x7f1c0c0c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c10c00640 1 -- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c0c0d1ad0 msgr2=0x7f1c0c0c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c10c00640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c0c0d1ad0 0x7f1c0c0c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c10c00640 1 -- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c0c15e8b0 msgr2=0x7f1c0c1544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c10c00640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c0c15e8b0 0x7f1c0c1544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c10c00640 1 -- 172.21.15.37:0/890521447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0c0c83f0 con 0x7f1c0c06d200 2024-05-30T06:42:48.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c10c00640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c0c06d200 0x7f1c0c15d980 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00d800 tx=0x7f1bfc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:48.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c09600640 1 -- 172.21.15.37:0/890521447 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00b6c0 con 0x7f1c0c06d200 2024-05-30T06:42:48.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c09600640 1 -- 172.21.15.37:0/890521447 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bfc019070 con 0x7f1c0c06d200 2024-05-30T06:42:48.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c09600640 1 -- 172.21.15.37:0/890521447 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00ba60 con 0x7f1c0c06d200 2024-05-30T06:42:48.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c13600640 1 -- 172.21.15.37:0/890521447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c0c0af4b0 con 0x7f1c0c06d200 2024-05-30T06:42:48.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c13600640 1 -- 172.21.15.37:0/890521447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c0c0afa30 con 0x7f1c0c06d200 2024-05-30T06:42:48.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c13600640 1 -- 172.21.15.37:0/890521447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c0c068bc0 con 0x7f1c0c06d200 2024-05-30T06:42:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.275+0000 7f1c09600640 1 -- 172.21.15.37:0/890521447 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1bfc00bc00 con 0x7f1c0c06d200 2024-05-30T06:42:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.279+0000 7f1c09600640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1be8068380 0x7f1be806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.279+0000 7f1c09600640 1 -- 172.21.15.37:0/890521447 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1bfc086d00 con 0x7f1c0c06d200 2024-05-30T06:42:48.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.279+0000 7f1c03e00640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1be8068380 0x7f1be806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.279+0000 7f1c03e00640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1be8068380 0x7f1be806a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0cebf0 tx=0x7f1bf4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.283+0000 7f1c09600640 1 -- 172.21.15.37:0/890521447 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1bfc056c60 con 0x7f1c0c06d200 2024-05-30T06:42:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.447+0000 7f1c13600640 1 -- 172.21.15.37:0/890521447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1c0c0b0910 con 0x7f1c0c06d200 2024-05-30T06:42:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.447+0000 7f1c09600640 1 -- 172.21.15.37:0/890521447 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f1bfc05af60 con 0x7f1c0c06d200 2024-05-30T06:42:48.447 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:42:48.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.451+0000 7f1c13600640 1 -- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1be8068380 msgr2=0x7f1be806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.451+0000 7f1c13600640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1be8068380 0x7f1be806a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0cebf0 tx=0x7f1bf4009040 comp rx=0 tx=0).stop 2024-05-30T06:42:48.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.451+0000 7f1c13600640 1 -- 172.21.15.37:0/890521447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c0c06d200 msgr2=0x7f1c0c15d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.451+0000 7f1c13600640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c0c06d200 0x7f1c0c15d980 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc00d800 tx=0x7f1bfc00dcc0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.451+0000 7f1c13600640 1 -- 172.21.15.37:0/890521447 shutdown_connections 2024-05-30T06:42:48.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.451+0000 7f1c13600640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1be8068380 0x7f1be806a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.451+0000 7f1c13600640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c0c15e8b0 0x7f1c0c1544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.451+0000 7f1c13600640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c0c0d1ad0 0x7f1c0c0c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.451+0000 7f1c13600640 1 --2- 172.21.15.37:0/890521447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c0c06d200 0x7f1c0c15d980 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.451+0000 7f1c13600640 1 -- 172.21.15.37:0/890521447 >> 172.21.15.37:0/890521447 conn(0x7f1c0c0b4130 msgr2=0x7f1c0c15f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:48.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.451+0000 7f1c13600640 1 -- 172.21.15.37:0/890521447 shutdown_connections 2024-05-30T06:42:48.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.451+0000 7f1c13600640 1 -- 172.21.15.37:0/890521447 wait complete. 2024-05-30T06:42:48.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:42:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.611+0000 7f4c02e00640 1 Processor -- start 2024-05-30T06:42:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.611+0000 7f4c02e00640 1 -- start start 2024-05-30T06:42:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.611+0000 7f4c02e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc15e8b0 0x7f4bfc0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.611+0000 7f4c02e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4bfc0d1ad0 0x7f4bfc06d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.611+0000 7f4c02e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bfc163350 con 0x7f4bfc06d200 2024-05-30T06:42:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.611+0000 7f4c02e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4bfc06db80 con 0x7f4bfc0d1ad0 2024-05-30T06:42:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.611+0000 7f4c02e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4bfc0cfb30 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.615+0000 7f4bfbe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc15e8b0 0x7f4bfc0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.615+0000 7f4c00e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4bfc0d1ad0 0x7f4bfc06d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.615+0000 7f4bfbe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc15e8b0 0x7f4bfc0cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:51894/0 (socket says 172.21.15.37:51894) 2024-05-30T06:42:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.615+0000 7f4bfbe00640 1 -- 172.21.15.37:0/2705650033 learned_addr learned my addr 172.21.15.37:0/2705650033 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.615+0000 7f4c00e00640 1 -- 172.21.15.37:0/2705650033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc15e8b0 msgr2=0x7f4bfc0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.615+0000 7f4c00e00640 1 --2- 172.21.15.37:0/2705650033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc15e8b0 0x7f4bfc0cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.615+0000 7f4c00e00640 1 -- 172.21.15.37:0/2705650033 >> v1:172.21.15.105:6789/0 conn(0x7f4bfc06d200 legacy=0x7f4bfc09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.615+0000 7f4c00e00640 1 -- 172.21.15.37:0/2705650033 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc1627d0 con 0x7f4bfc0d1ad0 2024-05-30T06:42:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.615+0000 7f4bfbe00640 1 --2- 172.21.15.37:0/2705650033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc15e8b0 0x7f4bfc0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.615+0000 7f4c00e00640 1 --2- 172.21.15.37:0/2705650033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc0d1ad0 0x7f4bfc06d640 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009d90 tx=0x7f4bf401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b12ac9e91bb35b45 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.615+0000 7f4bfb400640 1 -- 172.21.15.37:0/2705650033 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40b2070 con 0x7f4bfc0d1ad0 2024-05-30T06:42:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.615+0000 7f4bfb400640 1 -- 172.21.15.37:0/2705650033 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf40a5840 con 0x7f4bfc0d1ad0 2024-05-30T06:42:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.615+0000 7f4bfb400640 1 -- 172.21.15.37:0/2705650033 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40a5c10 con 0x7f4bfc0d1ad0 2024-05-30T06:42:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 -- 172.21.15.37:0/2705650033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc0d1ad0 msgr2=0x7f4bfc06d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 --2- 172.21.15.37:0/2705650033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc0d1ad0 0x7f4bfc06d640 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4009d90 tx=0x7f4bf401c970 comp rx=0 tx=0).stop 2024-05-30T06:42:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 -- 172.21.15.37:0/2705650033 shutdown_connections 2024-05-30T06:42:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 --2- 172.21.15.37:0/2705650033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc0d1ad0 0x7f4bfc06d640 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 --2- 172.21.15.37:0/2705650033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc15e8b0 0x7f4bfc0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 -- 172.21.15.37:0/2705650033 >> 172.21.15.37:0/2705650033 conn(0x7f4bfc0b4130 msgr2=0x7f4bfc0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 -- 172.21.15.37:0/2705650033 shutdown_connections 2024-05-30T06:42:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 -- 172.21.15.37:0/2705650033 wait complete. 2024-05-30T06:42:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 Processor -- start 2024-05-30T06:42:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 -- start start 2024-05-30T06:42:48.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc06d200 0x7f4bfc15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc0d1ad0 0x7f4bfc0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bfc15e8b0 0x7f4bfc0b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc162480 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc15ec90 con 0x7f4bfc06d200 2024-05-30T06:42:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c02e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4bfc0cf050 con 0x7f4bfc0d1ad0 2024-05-30T06:42:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c00e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bfc15e8b0 0x7f4bfc0b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4bfbe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc06d200 0x7f4bfc15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4bfbe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc06d200 0x7f4bfc15dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:35376/0 (socket says 172.21.15.37:35376) 2024-05-30T06:42:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4bfbe00640 1 -- 172.21.15.37:0/3489907634 learned_addr learned my addr 172.21.15.37:0/3489907634 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c00e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bfc15e8b0 0x7f4bfc0b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35014/0 (socket says 172.21.15.37:35014) 2024-05-30T06:42:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4bf3400640 1 --2- 172.21.15.37:0/3489907634 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc0d1ad0 0x7f4bfc0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c00e00640 1 -- 172.21.15.37:0/3489907634 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc0d1ad0 msgr2=0x7f4bfc0b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.619+0000 7f4c00e00640 1 --2- 172.21.15.37:0/3489907634 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc0d1ad0 0x7f4bfc0b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.623+0000 7f4c00e00640 1 -- 172.21.15.37:0/3489907634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc06d200 msgr2=0x7f4bfc15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.623+0000 7f4c00e00640 1 --2- 172.21.15.37:0/3489907634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc06d200 0x7f4bfc15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.623+0000 7f4c00e00640 1 -- 172.21.15.37:0/3489907634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc15e0f0 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.623+0000 7f4c00e00640 1 --2- 172.21.15.37:0/3489907634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bfc15e8b0 0x7f4bfc0b06c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40ac000 tx=0x7f4bf4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.623+0000 7f4bf8c00640 1 -- 172.21.15.37:0/3489907634 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40b2050 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.623+0000 7f4bf8c00640 1 -- 172.21.15.37:0/3489907634 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf40b3040 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.623+0000 7f4bf8c00640 1 -- 172.21.15.37:0/3489907634 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40ad650 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.623+0000 7f4c02e00640 1 -- 172.21.15.37:0/3489907634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bfc0b2690 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.623+0000 7f4c02e00640 1 -- 172.21.15.37:0/3489907634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bfc0b2c50 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.623+0000 7f4c02e00640 1 -- 172.21.15.37:0/3489907634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bfc068bc0 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.623+0000 7f4bf8c00640 1 -- 172.21.15.37:0/3489907634 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4bf40c0020 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.623+0000 7f4bf8c00640 1 --2- 172.21.15.37:0/3489907634 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bd8068380 0x7f4bd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.623+0000 7f4bf8c00640 1 -- 172.21.15.37:0/3489907634 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4bf41210c0 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.627+0000 7f4bfbe00640 1 --2- 172.21.15.37:0/3489907634 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bd8068380 0x7f4bd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.627+0000 7f4bfbe00640 1 --2- 172.21.15.37:0/3489907634 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bd8068380 0x7f4bd806a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009630 tx=0x7f4bec009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.631+0000 7f4bf8c00640 1 -- 172.21.15.37:0/3489907634 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4bf4016560 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.795+0000 7f4c02e00640 1 -- 172.21.15.37:0/3489907634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4bfc1695f0 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.795+0000 7f4bf8c00640 1 -- 172.21.15.37:0/3489907634 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f4bf40f1030 con 0x7f4bfc15e8b0 2024-05-30T06:42:48.795 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:42:48.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.795+0000 7f4c02e00640 1 -- 172.21.15.37:0/3489907634 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bd8068380 msgr2=0x7f4bd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.795+0000 7f4c02e00640 1 --2- 172.21.15.37:0/3489907634 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bd8068380 0x7f4bd806a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009630 tx=0x7f4bec009240 comp rx=0 tx=0).stop 2024-05-30T06:42:48.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.799+0000 7f4c02e00640 1 -- 172.21.15.37:0/3489907634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bfc15e8b0 msgr2=0x7f4bfc0b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.799+0000 7f4c02e00640 1 --2- 172.21.15.37:0/3489907634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bfc15e8b0 0x7f4bfc0b06c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4bf40ac000 tx=0x7f4bf4019710 comp rx=0 tx=0).stop 2024-05-30T06:42:48.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.799+0000 7f4c02e00640 1 -- 172.21.15.37:0/3489907634 shutdown_connections 2024-05-30T06:42:48.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.799+0000 7f4c02e00640 1 --2- 172.21.15.37:0/3489907634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bfc15e8b0 0x7f4bfc0b06c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.799+0000 7f4c02e00640 1 --2- 172.21.15.37:0/3489907634 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc0d1ad0 0x7f4bfc0b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.799+0000 7f4c02e00640 1 --2- 172.21.15.37:0/3489907634 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bd8068380 0x7f4bd806a840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.799+0000 7f4c02e00640 1 --2- 172.21.15.37:0/3489907634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc06d200 0x7f4bfc15dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.799+0000 7f4c02e00640 1 -- 172.21.15.37:0/3489907634 >> 172.21.15.37:0/3489907634 conn(0x7f4bfc0b4130 msgr2=0x7f4bfc075440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:48.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.799+0000 7f4c02e00640 1 -- 172.21.15.37:0/3489907634 shutdown_connections 2024-05-30T06:42:48.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.799+0000 7f4c02e00640 1 -- 172.21.15.37:0/3489907634 wait complete. 2024-05-30T06:42:48.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T06:42:48.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4dd000640 1 Processor -- start 2024-05-30T06:42:48.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4dd000640 1 -- start start 2024-05-30T06:42:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4dd000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff4d815c9c0 0x7ff4d80ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4dd000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4d80ce9e0 0x7ff4d806b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4dd000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4d80d1290 con 0x7ff4d80d1db0 2024-05-30T06:42:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4dd000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d80d09f0 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4dd000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d80d0cd0 con 0x7ff4d815c9c0 2024-05-30T06:42:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4d6800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4d80ce9e0 0x7ff4d806b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4cd400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff4d80d1db0 0x7ff4d8160400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53850/0 (socket says 172.21.15.37:53850) 2024-05-30T06:42:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4cd400640 1 -- 172.21.15.37:0/3197726755 learned_addr learned my addr 172.21.15.37:0/3197726755 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4d5e00640 1 --2- 172.21.15.37:0/3197726755 >> v2:172.21.15.105:3300/0 conn(0x7ff4d815c9c0 0x7ff4d80ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4d6800640 1 -- 172.21.15.37:0/3197726755 >> v2:172.21.15.105:3300/0 conn(0x7ff4d815c9c0 msgr2=0x7ff4d80ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4d6800640 1 --2- 172.21.15.37:0/3197726755 >> v2:172.21.15.105:3300/0 conn(0x7ff4d815c9c0 0x7ff4d80ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4d6800640 1 -- 172.21.15.37:0/3197726755 >> v1:172.21.15.37:6789/0 conn(0x7ff4d80d1db0 legacy=0x7ff4d8160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4d6800640 1 -- 172.21.15.37:0/3197726755 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d80d0fb0 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.959+0000 7ff4d5400640 1 -- 172.21.15.37:0/3197726755 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3085425755 0 0) 0x7ff4d80d1290 con 0x7ff4d80d1db0 2024-05-30T06:42:48.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.963+0000 7ff4d6800640 1 --2- 172.21.15.37:0/3197726755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80ce9e0 0x7ff4d806b960 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8071120 tx=0x7ff4d001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a8b88781336c1c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:48.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.963+0000 7ff4d5400640 1 -- 172.21.15.37:0/3197726755 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00b2070 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.963+0000 7ff4d5400640 1 -- 172.21.15.37:0/3197726755 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d00a5760 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.963+0000 7ff4d5400640 1 -- 172.21.15.37:0/3197726755 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00a5b30 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.963+0000 7ff4dd000640 1 -- 172.21.15.37:0/3197726755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80ce9e0 msgr2=0x7ff4d806b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.963+0000 7ff4dd000640 1 --2- 172.21.15.37:0/3197726755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80ce9e0 0x7ff4d806b960 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8071120 tx=0x7ff4d001c8a0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.963+0000 7ff4dd000640 1 -- 172.21.15.37:0/3197726755 shutdown_connections 2024-05-30T06:42:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.963+0000 7ff4dd000640 1 --2- 172.21.15.37:0/3197726755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80ce9e0 0x7ff4d806b960 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.963+0000 7ff4dd000640 1 --2- 172.21.15.37:0/3197726755 >> v2:172.21.15.105:3300/0 conn(0x7ff4d815c9c0 0x7ff4d80ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.963+0000 7ff4dd000640 1 -- 172.21.15.37:0/3197726755 >> 172.21.15.37:0/3197726755 conn(0x7ff4d809aa60 msgr2=0x7ff4d80d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.963+0000 7ff4dd000640 1 -- 172.21.15.37:0/3197726755 shutdown_connections 2024-05-30T06:42:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.963+0000 7ff4dd000640 1 -- 172.21.15.37:0/3197726755 wait complete. 2024-05-30T06:42:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4dd000640 1 Processor -- start 2024-05-30T06:42:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4dd000640 1 -- start start 2024-05-30T06:42:48.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4dd000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80ce9e0 0x7ff4d80b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4dd000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4d80d1db0 0x7ff4d80b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4dd000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4d815c9c0 0x7ff4d815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4dd000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d806c2b0 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4dd000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d8169fb0 con 0x7ff4d815c9c0 2024-05-30T06:42:48.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4dd000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d816a130 con 0x7ff4d80d1db0 2024-05-30T06:42:48.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4d5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80ce9e0 0x7ff4d80b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4d5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80ce9e0 0x7ff4d80b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35032/0 (socket says 172.21.15.37:35032) 2024-05-30T06:42:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4d5e00640 1 -- 172.21.15.37:0/1862133831 learned_addr learned my addr 172.21.15.37:0/1862133831 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4d6800640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4d815c9c0 0x7ff4d815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4cd400640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4d80d1db0 0x7ff4d80b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4d5e00640 1 -- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4d80d1db0 msgr2=0x7ff4d80b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4d5e00640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4d80d1db0 0x7ff4d80b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4d5e00640 1 -- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4d815c9c0 msgr2=0x7ff4d815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4d5e00640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4d815c9c0 0x7ff4d815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4d5e00640 1 -- 172.21.15.37:0/1862133831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d80b6280 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4d5e00640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80ce9e0 0x7ff4d80b4a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800d5f0 tx=0x7ff4c800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4cea00640 1 -- 172.21.15.37:0/1862133831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80125f0 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4cea00640 1 -- 172.21.15.37:0/1862133831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c8019070 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4dd000640 1 -- 172.21.15.37:0/1862133831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d80b6560 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4cea00640 1 -- 172.21.15.37:0/1862133831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80129b0 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.967+0000 7ff4dd000640 1 -- 172.21.15.37:0/1862133831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d80b4500 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.971+0000 7ff4dd000640 1 -- 172.21.15.37:0/1862133831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d80b4010 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.971+0000 7ff4cea00640 1 -- 172.21.15.37:0/1862133831 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff4c8012b50 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.971+0000 7ff4cea00640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff4b4068380 0x7ff4b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.971+0000 7ff4cea00640 1 -- 172.21.15.37:0/1862133831 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff4c8086dc0 con 0x7ff4d80ce9e0 2024-05-30T06:42:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.971+0000 7ff4cd400640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff4b4068380 0x7ff4b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.971+0000 7ff4cd400640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff4b4068380 0x7ff4b406a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0007fd0 tx=0x7ff4c0007ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:48.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:48.975+0000 7ff4cea00640 1 -- 172.21.15.37:0/1862133831 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff4c8057370 con 0x7ff4d80ce9e0 2024-05-30T06:42:49.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.151+0000 7ff4dd000640 1 -- 172.21.15.37:0/1862133831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff4d80c7f30 con 0x7ff4d80ce9e0 2024-05-30T06:42:49.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.151+0000 7ff4cea00640 1 -- 172.21.15.37:0/1862133831 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7ff4c805d030 con 0x7ff4d80ce9e0 2024-05-30T06:42:49.151 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-30T06:42:49.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.155+0000 7ff4dd000640 1 -- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff4b4068380 msgr2=0x7ff4b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:49.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.155+0000 7ff4dd000640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff4b4068380 0x7ff4b406a840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0007fd0 tx=0x7ff4c0007ba0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.155+0000 7ff4dd000640 1 -- 172.21.15.37:0/1862133831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80ce9e0 msgr2=0x7ff4d80b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.155+0000 7ff4dd000640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80ce9e0 0x7ff4d80b4a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff4c800d5f0 tx=0x7ff4c800dab0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.155+0000 7ff4dd000640 1 -- 172.21.15.37:0/1862133831 shutdown_connections 2024-05-30T06:42:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.155+0000 7ff4dd000640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff4b4068380 0x7ff4b406a840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.155+0000 7ff4dd000640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4d815c9c0 0x7ff4d815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.155+0000 7ff4dd000640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4d80d1db0 0x7ff4d80b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.155+0000 7ff4dd000640 1 --2- 172.21.15.37:0/1862133831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80ce9e0 0x7ff4d80b4a20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.155+0000 7ff4dd000640 1 -- 172.21.15.37:0/1862133831 >> 172.21.15.37:0/1862133831 conn(0x7ff4d809aa60 msgr2=0x7ff4d815dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.155+0000 7ff4dd000640 1 -- 172.21.15.37:0/1862133831 shutdown_connections 2024-05-30T06:42:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.155+0000 7ff4dd000640 1 -- 172.21.15.37:0/1862133831 wait complete. 2024-05-30T06:42:49.172 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-30T06:42:49.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:49.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-30T06:42:49.197 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:42:49.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:49.197 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-30T06:42:49.253 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:42:49.253 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:49.263 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:42:49.263 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:49.312 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:42:49.313 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:42:49.369 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.511+0000 7f84d5a00640 1 Processor -- start 2024-05-30T06:42:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.511+0000 7f84d5a00640 1 -- start start 2024-05-30T06:42:49.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.511+0000 7f84d5a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84d0162cb0 0x7f84d00ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:49.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.511+0000 7f84d5a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d009abe0 con 0x7f84d009b9a0 2024-05-30T06:42:49.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.511+0000 7f84d5a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84d009aec0 con 0x7f84d015e930 2024-05-30T06:42:49.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.511+0000 7f84d5a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f84d009b1a0 con 0x7f84d0162cb0 2024-05-30T06:42:49.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.511+0000 7f84cf400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84d0162cb0 0x7f84d00ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:49.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.511+0000 7f84c6000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f84d009b9a0 0x7f84d01625a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53862/0 (socket says 172.21.15.37:53862) 2024-05-30T06:42:49.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.511+0000 7f84c6000640 1 -- 172.21.15.37:0/1874354735 learned_addr learned my addr 172.21.15.37:0/1874354735 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:49.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.511+0000 7f84cf400640 1 -- 172.21.15.37:0/1874354735 >> v1:172.21.15.105:6789/0 conn(0x7f84d015e930 legacy=0x7f84d00d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:49.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.511+0000 7f84cf400640 1 -- 172.21.15.37:0/1874354735 >> v1:172.21.15.37:6789/0 conn(0x7f84d009b9a0 legacy=0x7f84d01625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:49.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.511+0000 7f84cf400640 1 -- 172.21.15.37:0/1874354735 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d009b480 con 0x7f84d0162cb0 2024-05-30T06:42:49.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.515+0000 7f84cf400640 1 --2- 172.21.15.37:0/1874354735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d0162cb0 0x7f84d00ccc60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009d90 tx=0x7f84c801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1e8fbf98659085 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.515+0000 7f84ce000640 1 -- 172.21.15.37:0/1874354735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c80b2070 con 0x7f84d0162cb0 2024-05-30T06:42:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.515+0000 7f84ce000640 1 -- 172.21.15.37:0/1874354735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c80a5880 con 0x7f84d0162cb0 2024-05-30T06:42:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.515+0000 7f84ce000640 1 -- 172.21.15.37:0/1874354735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c80a5c50 con 0x7f84d0162cb0 2024-05-30T06:42:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.515+0000 7f84d5a00640 1 -- 172.21.15.37:0/1874354735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d0162cb0 msgr2=0x7f84d00ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.515+0000 7f84d5a00640 1 --2- 172.21.15.37:0/1874354735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d0162cb0 0x7f84d00ccc60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009d90 tx=0x7f84c801c970 comp rx=0 tx=0).stop 2024-05-30T06:42:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.515+0000 7f84d5a00640 1 -- 172.21.15.37:0/1874354735 shutdown_connections 2024-05-30T06:42:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.515+0000 7f84d5a00640 1 --2- 172.21.15.37:0/1874354735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d0162cb0 0x7f84d00ccc60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.515+0000 7f84d5a00640 1 -- 172.21.15.37:0/1874354735 >> 172.21.15.37:0/1874354735 conn(0x7f84d00b4100 msgr2=0x7f84d00b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:49.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.515+0000 7f84d5a00640 1 -- 172.21.15.37:0/1874354735 shutdown_connections 2024-05-30T06:42:49.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.515+0000 7f84d5a00640 1 -- 172.21.15.37:0/1874354735 wait complete. 2024-05-30T06:42:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84d5a00640 1 Processor -- start 2024-05-30T06:42:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84d5a00640 1 -- start start 2024-05-30T06:42:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84d5a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d009b9a0 0x7f84d00b7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84d5a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84d015e930 0x7f84d00b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84d5a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84d0162cb0 0x7f84d015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84d5a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f84d015ee90 con 0x7f84d009b9a0 2024-05-30T06:42:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84d5a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f84d015ed10 con 0x7f84d015e930 2024-05-30T06:42:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84d5a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f84d016c950 con 0x7f84d0162cb0 2024-05-30T06:42:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84cea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d009b9a0 0x7f84d00b7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84cea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d009b9a0 0x7f84d00b7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35042/0 (socket says 172.21.15.37:35042) 2024-05-30T06:42:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84cea00640 1 -- 172.21.15.37:0/2213699276 learned_addr learned my addr 172.21.15.37:0/2213699276 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84cea00640 1 -- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84d0162cb0 msgr2=0x7f84d015cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84cf400640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84d0162cb0 0x7f84d015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84c6000640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84d015e930 0x7f84d00b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84cea00640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84d0162cb0 0x7f84d015cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84cea00640 1 -- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84d015e930 msgr2=0x7f84d00b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84cea00640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84d015e930 0x7f84d00b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84cea00640 1 -- 172.21.15.37:0/2213699276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d0151880 con 0x7f84d009b9a0 2024-05-30T06:42:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84cf400640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84d0162cb0 0x7f84d015cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84c6000640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84d015e930 0x7f84d00b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84cea00640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d009b9a0 0x7f84d00b7c70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f84c000c420 tx=0x7f84c000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84c7400640 1 -- 172.21.15.37:0/2213699276 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c00052d0 con 0x7f84d009b9a0 2024-05-30T06:42:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84c7400640 1 -- 172.21.15.37:0/2213699276 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c0005470 con 0x7f84d009b9a0 2024-05-30T06:42:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84d5a00640 1 -- 172.21.15.37:0/2213699276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d0151b60 con 0x7f84d009b9a0 2024-05-30T06:42:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84c7400640 1 -- 172.21.15.37:0/2213699276 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0007260 con 0x7f84d009b9a0 2024-05-30T06:42:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84d5a00640 1 -- 172.21.15.37:0/2213699276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d0152120 con 0x7f84d009b9a0 2024-05-30T06:42:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.519+0000 7f84d5a00640 1 -- 172.21.15.37:0/2213699276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84d0068b20 con 0x7f84d009b9a0 2024-05-30T06:42:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.523+0000 7f84c7400640 1 -- 172.21.15.37:0/2213699276 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f84c0007400 con 0x7f84d009b9a0 2024-05-30T06:42:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.523+0000 7f84c7400640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f84ac0683b0 0x7f84ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.523+0000 7f84c7400640 1 -- 172.21.15.37:0/2213699276 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f84c0085e90 con 0x7f84d009b9a0 2024-05-30T06:42:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.523+0000 7f84c6000640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f84ac0683b0 0x7f84ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.523+0000 7f84c6000640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f84ac0683b0 0x7f84ac06a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84d00cf4e0 tx=0x7f84b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:49.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.527+0000 7f84c7400640 1 -- 172.21.15.37:0/2213699276 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f84c0056440 con 0x7f84d009b9a0 2024-05-30T06:42:49.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.695+0000 7f84d5a00640 1 -- 172.21.15.37:0/2213699276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84d015e160 con 0x7f84d009b9a0 2024-05-30T06:42:49.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.695+0000 7f84c7400640 1 -- 172.21.15.37:0/2213699276 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16593 (secure 0 0 0) 0x7f84c0087090 con 0x7f84d009b9a0 2024-05-30T06:42:49.695 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:49.695 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:12.412344+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:49.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.699+0000 7f84d5a00640 1 -- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f84ac0683b0 msgr2=0x7f84ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:49.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.699+0000 7f84d5a00640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f84ac0683b0 0x7f84ac06a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f84d00cf4e0 tx=0x7f84b8009040 comp rx=0 tx=0).stop 2024-05-30T06:42:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.699+0000 7f84d5a00640 1 -- 172.21.15.37:0/2213699276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d009b9a0 msgr2=0x7f84d00b7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.699+0000 7f84d5a00640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d009b9a0 0x7f84d00b7c70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f84c000c420 tx=0x7f84c000c8e0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.699+0000 7f84d5a00640 1 -- 172.21.15.37:0/2213699276 shutdown_connections 2024-05-30T06:42:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.699+0000 7f84d5a00640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84d0162cb0 0x7f84d015cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.699+0000 7f84d5a00640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f84ac0683b0 0x7f84ac06a870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.699+0000 7f84d5a00640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84d015e930 0x7f84d00b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.699+0000 7f84d5a00640 1 --2- 172.21.15.37:0/2213699276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84d009b9a0 0x7f84d00b7c70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.699+0000 7f84d5a00640 1 -- 172.21.15.37:0/2213699276 >> 172.21.15.37:0/2213699276 conn(0x7f84d00b4100 msgr2=0x7f84d0070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.699+0000 7f84d5a00640 1 -- 172.21.15.37:0/2213699276 shutdown_connections 2024-05-30T06:42:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.699+0000 7f84d5a00640 1 -- 172.21.15.37:0/2213699276 wait complete. 2024-05-30T06:42:49.717 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:42:09.128133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:42:09.755772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:49.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:49.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7de2000640 1 Processor -- start 2024-05-30T06:42:49.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7de2000640 1 -- start start 2024-05-30T06:42:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7de2000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc0b59d0 0x7f7ddc0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7de2000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ddc15d350 0x7f7ddc160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7de2000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7ddc15d7b0 0x7f7ddc1607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7de2000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7ddc0b62f0 con 0x7f7ddc15d350 2024-05-30T06:42:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7de2000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7ddc142030 con 0x7f7ddc15d7b0 2024-05-30T06:42:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7de2000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7ddc142310 con 0x7f7ddc0b59d0 2024-05-30T06:42:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7dd3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ddc15d350 0x7f7ddc160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7dd3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ddc15d350 0x7f7ddc160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35046/0 (socket says 172.21.15.37:35046) 2024-05-30T06:42:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7dd3e00640 1 -- 172.21.15.37:0/4049056115 learned_addr learned my addr 172.21.15.37:0/4049056115 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7ddbe00640 1 --2- 172.21.15.37:0/4049056115 >> v2:172.21.15.105:3300/0 conn(0x7f7ddc15d7b0 0x7f7ddc1607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7ddb400640 1 --2- 172.21.15.37:0/4049056115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc0b59d0 0x7f7ddc0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7dd3e00640 1 -- 172.21.15.37:0/4049056115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc0b59d0 msgr2=0x7f7ddc0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7dd3e00640 1 --2- 172.21.15.37:0/4049056115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc0b59d0 0x7f7ddc0b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7dd3e00640 1 -- 172.21.15.37:0/4049056115 >> v2:172.21.15.105:3300/0 conn(0x7f7ddc15d7b0 msgr2=0x7f7ddc1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7dd3e00640 1 --2- 172.21.15.37:0/4049056115 >> v2:172.21.15.105:3300/0 conn(0x7f7ddc15d7b0 0x7f7ddc1607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.863+0000 7f7dd3e00640 1 -- 172.21.15.37:0/4049056115 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc1425f0 con 0x7f7ddc15d350 2024-05-30T06:42:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.867+0000 7f7dd3e00640 1 --2- 172.21.15.37:0/4049056115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc15d350 0x7f7ddc160280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc15a7d0 tx=0x7f7dc401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9161acdf81b4b7c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.867+0000 7f7ddaa00640 1 -- 172.21.15.37:0/4049056115 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40b5070 con 0x7f7ddc15d350 2024-05-30T06:42:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.867+0000 7f7ddaa00640 1 -- 172.21.15.37:0/4049056115 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc40a89d0 con 0x7f7ddc15d350 2024-05-30T06:42:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.867+0000 7f7ddaa00640 1 -- 172.21.15.37:0/4049056115 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40a8da0 con 0x7f7ddc15d350 2024-05-30T06:42:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.867+0000 7f7de2000640 1 -- 172.21.15.37:0/4049056115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc15d350 msgr2=0x7f7ddc160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.867+0000 7f7de2000640 1 --2- 172.21.15.37:0/4049056115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc15d350 0x7f7ddc160280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc15a7d0 tx=0x7f7dc401ed10 comp rx=0 tx=0).stop 2024-05-30T06:42:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.867+0000 7f7de2000640 1 -- 172.21.15.37:0/4049056115 shutdown_connections 2024-05-30T06:42:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.867+0000 7f7de2000640 1 --2- 172.21.15.37:0/4049056115 >> v2:172.21.15.105:3300/0 conn(0x7f7ddc15d7b0 0x7f7ddc1607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.867+0000 7f7de2000640 1 --2- 172.21.15.37:0/4049056115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc15d350 0x7f7ddc160280 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.867+0000 7f7de2000640 1 --2- 172.21.15.37:0/4049056115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc0b59d0 0x7f7ddc0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.867+0000 7f7de2000640 1 -- 172.21.15.37:0/4049056115 >> 172.21.15.37:0/4049056115 conn(0x7f7ddc06bf60 msgr2=0x7f7ddc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.867+0000 7f7de2000640 1 -- 172.21.15.37:0/4049056115 shutdown_connections 2024-05-30T06:42:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.867+0000 7f7de2000640 1 -- 172.21.15.37:0/4049056115 wait complete. 2024-05-30T06:42:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7de2000640 1 Processor -- start 2024-05-30T06:42:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7de2000640 1 -- start start 2024-05-30T06:42:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7de2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc0b59d0 0x7f7ddc072920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7de2000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ddc15d350 0x7f7ddc15c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7de2000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc15d7b0 0x7f7ddc155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7de2000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc13fe60 con 0x7f7ddc0b59d0 2024-05-30T06:42:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7de2000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc13fce0 con 0x7f7ddc15d350 2024-05-30T06:42:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7de2000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7ddc0aff20 con 0x7f7ddc15d7b0 2024-05-30T06:42:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7ddb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc0b59d0 0x7f7ddc072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7ddb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc0b59d0 0x7f7ddc072920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35054/0 (socket says 172.21.15.37:35054) 2024-05-30T06:42:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7ddb400640 1 -- 172.21.15.37:0/2252035971 learned_addr learned my addr 172.21.15.37:0/2252035971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7ddbe00640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc15d7b0 0x7f7ddc155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7dd3e00640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ddc15d350 0x7f7ddc15c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7ddb400640 1 -- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc15d7b0 msgr2=0x7f7ddc155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7ddb400640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc15d7b0 0x7f7ddc155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7ddb400640 1 -- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ddc15d350 msgr2=0x7f7ddc15c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7ddb400640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ddc15d350 0x7f7ddc15c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7ddb400640 1 -- 172.21.15.37:0/2252035971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc1579e0 con 0x7f7ddc0b59d0 2024-05-30T06:42:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7ddb400640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc0b59d0 0x7f7ddc072920 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00e870 tx=0x7f7dcc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7dd3400640 1 -- 172.21.15.37:0/2252035971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc017070 con 0x7f7ddc0b59d0 2024-05-30T06:42:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7dd3400640 1 -- 172.21.15.37:0/2252035971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc00ee60 con 0x7f7ddc0b59d0 2024-05-30T06:42:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7dd3400640 1 -- 172.21.15.37:0/2252035971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc00cb80 con 0x7f7ddc0b59d0 2024-05-30T06:42:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7de2000640 1 -- 172.21.15.37:0/2252035971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ddc157cc0 con 0x7f7ddc0b59d0 2024-05-30T06:42:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7de2000640 1 -- 172.21.15.37:0/2252035971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ddc158280 con 0x7f7ddc0b59d0 2024-05-30T06:42:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.871+0000 7f7de2000640 1 -- 172.21.15.37:0/2252035971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ddc068bc0 con 0x7f7ddc0b59d0 2024-05-30T06:42:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.875+0000 7f7dd3400640 1 -- 172.21.15.37:0/2252035971 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7dcc01a070 con 0x7f7ddc0b59d0 2024-05-30T06:42:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.875+0000 7f7dd3400640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7db8068380 0x7f7db806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.875+0000 7f7dd3400640 1 -- 172.21.15.37:0/2252035971 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7dcc086c00 con 0x7f7ddc0b59d0 2024-05-30T06:42:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.875+0000 7f7dd3e00640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7db8068380 0x7f7db806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:49.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.875+0000 7f7dd3e00640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7db8068380 0x7f7db806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40b2000 tx=0x7f7dc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:49.879+0000 7f7dd3400640 1 -- 172.21.15.37:0/2252035971 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7dcc08d080 con 0x7f7ddc0b59d0 2024-05-30T06:42:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.043+0000 7f7de2000640 1 -- 172.21.15.37:0/2252035971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7ddc0cf0d0 con 0x7f7ddc0b59d0 2024-05-30T06:42:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.043+0000 7f7dd3400640 1 -- 172.21.15.37:0/2252035971 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f7dcc0571c0 con 0x7f7ddc0b59d0 2024-05-30T06:42:50.044 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:50.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.047+0000 7f7de2000640 1 -- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7db8068380 msgr2=0x7f7db806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.047+0000 7f7de2000640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7db8068380 0x7f7db806a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40b2000 tx=0x7f7dc4008040 comp rx=0 tx=0).stop 2024-05-30T06:42:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.047+0000 7f7de2000640 1 -- 172.21.15.37:0/2252035971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc0b59d0 msgr2=0x7f7ddc072920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.047+0000 7f7de2000640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc0b59d0 0x7f7ddc072920 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00e870 tx=0x7f7dcc00ed30 comp rx=0 tx=0).stop 2024-05-30T06:42:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.047+0000 7f7de2000640 1 -- 172.21.15.37:0/2252035971 shutdown_connections 2024-05-30T06:42:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.047+0000 7f7de2000640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ddc15d7b0 0x7f7ddc155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.047+0000 7f7de2000640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7db8068380 0x7f7db806a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.047+0000 7f7de2000640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ddc15d350 0x7f7ddc15c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.047+0000 7f7de2000640 1 --2- 172.21.15.37:0/2252035971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ddc0b59d0 0x7f7ddc072920 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.047+0000 7f7de2000640 1 -- 172.21.15.37:0/2252035971 >> 172.21.15.37:0/2252035971 conn(0x7f7ddc06bf60 msgr2=0x7f7ddc1408a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.047+0000 7f7de2000640 1 -- 172.21.15.37:0/2252035971 shutdown_connections 2024-05-30T06:42:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.047+0000 7f7de2000640 1 -- 172.21.15.37:0/2252035971 wait complete. 2024-05-30T06:42:50.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:42:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.219+0000 7f06b9000640 1 Processor -- start 2024-05-30T06:42:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.219+0000 7f06b9000640 1 -- start start 2024-05-30T06:42:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.223+0000 7f06b9000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06b40ce510 0x7f06b40c8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.223+0000 7f06b9000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b40ce8f0 con 0x7f06b409b170 2024-05-30T06:42:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.223+0000 7f06b9000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b406ea70 con 0x7f06b406d160 2024-05-30T06:42:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.223+0000 7f06b9000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f06b415ef80 con 0x7f06b40ce510 2024-05-30T06:42:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.223+0000 7f06b3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06b40ce510 0x7f06b40c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.223+0000 7f06b3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06b40ce510 0x7f06b40c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35058/0 (socket says 172.21.15.37:35058) 2024-05-30T06:42:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.223+0000 7f06b3400640 1 -- 172.21.15.37:0/2115764638 learned_addr learned my addr 172.21.15.37:0/2115764638 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.223+0000 7f06b3e00640 1 --1- 172.21.15.37:0/2115764638 >> v1:172.21.15.37:6789/0 conn(0x7f06b409b170 0x7f06b40ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53878/0 (socket says 172.21.15.37:53878) 2024-05-30T06:42:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.223+0000 7f06b3400640 1 -- 172.21.15.37:0/2115764638 >> v1:172.21.15.105:6789/0 conn(0x7f06b406d160 legacy=0x7f06b409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.223+0000 7f06b3400640 1 -- 172.21.15.37:0/2115764638 >> v1:172.21.15.37:6789/0 conn(0x7f06b409b170 legacy=0x7f06b40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.223+0000 7f06b3400640 1 -- 172.21.15.37:0/2115764638 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b406d9d0 con 0x7f06b40ce510 2024-05-30T06:42:50.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.227+0000 7f06b3400640 1 --2- 172.21.15.37:0/2115764638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06b40ce510 0x7f06b40c8400 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009870 tx=0x7f06a401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb177007b340381 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:50.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.227+0000 7f06b2a00640 1 -- 172.21.15.37:0/2115764638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a40ab650 con 0x7f06b40ce510 2024-05-30T06:42:50.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.227+0000 7f06b2a00640 1 -- 172.21.15.37:0/2115764638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a40b0070 con 0x7f06b40ce510 2024-05-30T06:42:50.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.227+0000 7f06b2a00640 1 -- 172.21.15.37:0/2115764638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a40aba10 con 0x7f06b40ce510 2024-05-30T06:42:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.227+0000 7f06b9000640 1 -- 172.21.15.37:0/2115764638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06b40ce510 msgr2=0x7f06b40c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.227+0000 7f06b9000640 1 --2- 172.21.15.37:0/2115764638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06b40ce510 0x7f06b40c8400 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009870 tx=0x7f06a401c560 comp rx=0 tx=0).stop 2024-05-30T06:42:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.227+0000 7f06b9000640 1 -- 172.21.15.37:0/2115764638 shutdown_connections 2024-05-30T06:42:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.227+0000 7f06b9000640 1 --2- 172.21.15.37:0/2115764638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06b40ce510 0x7f06b40c8400 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.227+0000 7f06b9000640 1 -- 172.21.15.37:0/2115764638 >> 172.21.15.37:0/2115764638 conn(0x7f06b40cef80 msgr2=0x7f06b40cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:50.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.227+0000 7f06b9000640 1 -- 172.21.15.37:0/2115764638 shutdown_connections 2024-05-30T06:42:50.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.227+0000 7f06b9000640 1 -- 172.21.15.37:0/2115764638 wait complete. 2024-05-30T06:42:50.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06b9000640 1 Processor -- start 2024-05-30T06:42:50.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06b9000640 1 -- start start 2024-05-30T06:42:50.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06b9000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06b406d160 0x7f06b415e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06b9000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06b409b170 0x7f06b4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06b9000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06b40ce510 0x7f06b4156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06b9000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f06b406d570 con 0x7f06b409b170 2024-05-30T06:42:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06b9000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f06b406e550 con 0x7f06b40ce510 2024-05-30T06:42:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06b9000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f06b406d6f0 con 0x7f06b406d160 2024-05-30T06:42:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06aaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06b409b170 0x7f06b4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06aaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06b409b170 0x7f06b4155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35062/0 (socket says 172.21.15.37:35062) 2024-05-30T06:42:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06aaa00640 1 -- 172.21.15.37:0/3068313096 learned_addr learned my addr 172.21.15.37:0/3068313096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06b3400640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06b406d160 0x7f06b415e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06b3e00640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06b40ce510 0x7f06b4156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06aaa00640 1 -- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06b406d160 msgr2=0x7f06b415e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06aaa00640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06b406d160 0x7f06b415e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06aaa00640 1 -- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06b40ce510 msgr2=0x7f06b4156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06aaa00640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06b40ce510 0x7f06b4156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06aaa00640 1 -- 172.21.15.37:0/3068313096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b41fb270 con 0x7f06b409b170 2024-05-30T06:42:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06b3e00640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06b40ce510 0x7f06b4156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06aaa00640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06b409b170 0x7f06b4155d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f069c00c500 tx=0x7f069c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.231+0000 7f06abe00640 1 -- 172.21.15.37:0/3068313096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c016020 con 0x7f06b409b170 2024-05-30T06:42:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.235+0000 7f06abe00640 1 -- 172.21.15.37:0/3068313096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069c005220 con 0x7f06b409b170 2024-05-30T06:42:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.235+0000 7f06abe00640 1 -- 172.21.15.37:0/3068313096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c007030 con 0x7f06b409b170 2024-05-30T06:42:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.235+0000 7f06b9000640 1 -- 172.21.15.37:0/3068313096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b41fb550 con 0x7f06b409b170 2024-05-30T06:42:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.235+0000 7f06b9000640 1 -- 172.21.15.37:0/3068313096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b41fbb10 con 0x7f06b409b170 2024-05-30T06:42:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.235+0000 7f06b9000640 1 -- 172.21.15.37:0/3068313096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b4075580 con 0x7f06b409b170 2024-05-30T06:42:50.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.235+0000 7f06abe00640 1 -- 172.21.15.37:0/3068313096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f069c0071f0 con 0x7f06b409b170 2024-05-30T06:42:50.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.235+0000 7f06abe00640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0690068380 0x7f069006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.235+0000 7f06abe00640 1 -- 172.21.15.37:0/3068313096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f069c086300 con 0x7f06b409b170 2024-05-30T06:42:50.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.235+0000 7f06b3400640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0690068380 0x7f069006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.239+0000 7f06b3400640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0690068380 0x7f069006a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06a40af000 tx=0x7f06a40a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:50.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.239+0000 7f06abe00640 1 -- 172.21.15.37:0/3068313096 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f069c020020 con 0x7f06b409b170 2024-05-30T06:42:50.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.403+0000 7f06b9000640 1 -- 172.21.15.37:0/3068313096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f06b40c74c0 con 0x7f06b409b170 2024-05-30T06:42:50.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.407+0000 7f06abe00640 1 -- 172.21.15.37:0/3068313096 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f069c0568d0 con 0x7f06b409b170 2024-05-30T06:42:50.405 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:42:50.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.407+0000 7f06b9000640 1 -- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0690068380 msgr2=0x7f069006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.407+0000 7f06b9000640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0690068380 0x7f069006a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06a40af000 tx=0x7f06a40a7000 comp rx=0 tx=0).stop 2024-05-30T06:42:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.407+0000 7f06b9000640 1 -- 172.21.15.37:0/3068313096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06b409b170 msgr2=0x7f06b4155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.407+0000 7f06b9000640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06b409b170 0x7f06b4155d10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f069c00c500 tx=0x7f069c00c9c0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.407+0000 7f06b9000640 1 -- 172.21.15.37:0/3068313096 shutdown_connections 2024-05-30T06:42:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.407+0000 7f06b9000640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0690068380 0x7f069006a840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.407+0000 7f06b9000640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06b40ce510 0x7f06b4156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.407+0000 7f06b9000640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06b409b170 0x7f06b4155d10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.407+0000 7f06b9000640 1 --2- 172.21.15.37:0/3068313096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06b406d160 0x7f06b415e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.407+0000 7f06b9000640 1 -- 172.21.15.37:0/3068313096 >> 172.21.15.37:0/3068313096 conn(0x7f06b40cef80 msgr2=0x7f06b41577e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.407+0000 7f06b9000640 1 -- 172.21.15.37:0/3068313096 shutdown_connections 2024-05-30T06:42:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.407+0000 7f06b9000640 1 -- 172.21.15.37:0/3068313096 wait complete. 2024-05-30T06:42:50.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:42:50.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.571+0000 7f47f6000640 1 Processor -- start 2024-05-30T06:42:50.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.571+0000 7f47f6000640 1 -- start start 2024-05-30T06:42:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.571+0000 7f47f6000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47f00b59d0 0x7f47f00b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.571+0000 7f47f6000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47f015d350 0x7f47f0160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.571+0000 7f47f6000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47f015d7e0 0x7f47f01607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.571+0000 7f47f6000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f47f00b62f0 con 0x7f47f00b59d0 2024-05-30T06:42:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.571+0000 7f47f6000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f47f0142030 con 0x7f47f015d350 2024-05-30T06:42:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.571+0000 7f47f6000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47f0142310 con 0x7f47f015d7e0 2024-05-30T06:42:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47ef400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47f00b59d0 0x7f47f00b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47ef400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47f00b59d0 0x7f47f00b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35070/0 (socket says 172.21.15.37:35070) 2024-05-30T06:42:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47ef400640 1 -- 172.21.15.37:0/3083574115 learned_addr learned my addr 172.21.15.37:0/3083574115 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47e7e00640 1 --2- 172.21.15.37:0/3083574115 >> v2:172.21.15.105:3300/0 conn(0x7f47f015d350 0x7f47f0160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47efe00640 1 --2- 172.21.15.37:0/3083574115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47f015d7e0 0x7f47f01607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47ef400640 1 -- 172.21.15.37:0/3083574115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47f015d7e0 msgr2=0x7f47f01607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47ef400640 1 --2- 172.21.15.37:0/3083574115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47f015d7e0 0x7f47f01607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47ef400640 1 -- 172.21.15.37:0/3083574115 >> v2:172.21.15.105:3300/0 conn(0x7f47f015d350 msgr2=0x7f47f0160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47ef400640 1 --2- 172.21.15.37:0/3083574115 >> v2:172.21.15.105:3300/0 conn(0x7f47f015d350 0x7f47f0160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47ef400640 1 -- 172.21.15.37:0/3083574115 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f01425f0 con 0x7f47f00b59d0 2024-05-30T06:42:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47ef400640 1 --2- 172.21.15.37:0/3083574115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f00b59d0 0x7f47f00b5db0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009870 tx=0x7f47e001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ceedf427955dff server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47eea00640 1 -- 172.21.15.37:0/3083574115 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e00b5070 con 0x7f47f00b59d0 2024-05-30T06:42:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47eea00640 1 -- 172.21.15.37:0/3083574115 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e00a89d0 con 0x7f47f00b59d0 2024-05-30T06:42:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.575+0000 7f47eea00640 1 -- 172.21.15.37:0/3083574115 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e00a8da0 con 0x7f47f00b59d0 2024-05-30T06:42:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 -- 172.21.15.37:0/3083574115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f00b59d0 msgr2=0x7f47f00b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 --2- 172.21.15.37:0/3083574115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f00b59d0 0x7f47f00b5db0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009870 tx=0x7f47e001ed10 comp rx=0 tx=0).stop 2024-05-30T06:42:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 -- 172.21.15.37:0/3083574115 shutdown_connections 2024-05-30T06:42:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 --2- 172.21.15.37:0/3083574115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47f015d7e0 0x7f47f01607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 --2- 172.21.15.37:0/3083574115 >> v2:172.21.15.105:3300/0 conn(0x7f47f015d350 0x7f47f0160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 --2- 172.21.15.37:0/3083574115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f00b59d0 0x7f47f00b5db0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 -- 172.21.15.37:0/3083574115 >> 172.21.15.37:0/3083574115 conn(0x7f47f006bf60 msgr2=0x7f47f00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:50.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 -- 172.21.15.37:0/3083574115 shutdown_connections 2024-05-30T06:42:50.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 -- 172.21.15.37:0/3083574115 wait complete. 2024-05-30T06:42:50.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 Processor -- start 2024-05-30T06:42:50.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 -- start start 2024-05-30T06:42:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f00b59d0 0x7f47f0156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47f015d350 0x7f47f01528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47f015d7e0 0x7f47f013e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47f013fe60 con 0x7f47f00b59d0 2024-05-30T06:42:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47f013fce0 con 0x7f47f015d350 2024-05-30T06:42:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47f6000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47f00aff20 con 0x7f47f015d7e0 2024-05-30T06:42:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47ef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f00b59d0 0x7f47f0156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47ef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f00b59d0 0x7f47f0156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35084/0 (socket says 172.21.15.37:35084) 2024-05-30T06:42:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47ef400640 1 -- 172.21.15.37:0/2883554304 learned_addr learned my addr 172.21.15.37:0/2883554304 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47efe00640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47f015d7e0 0x7f47f013e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47e7e00640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47f015d350 0x7f47f01528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.579+0000 7f47ef400640 1 -- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47f015d7e0 msgr2=0x7f47f013e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47ef400640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47f015d7e0 0x7f47f013e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47ef400640 1 -- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47f015d350 msgr2=0x7f47f01528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47ef400640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47f015d350 0x7f47f01528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47ef400640 1 -- 172.21.15.37:0/2883554304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f01556d0 con 0x7f47f00b59d0 2024-05-30T06:42:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47efe00640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47f015d7e0 0x7f47f013e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47e7e00640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47f015d350 0x7f47f01528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47ef400640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f00b59d0 0x7f47f0156770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f47e00b3040 tx=0x7f47e001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47e7400640 1 -- 172.21.15.37:0/2883554304 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e00b5070 con 0x7f47f00b59d0 2024-05-30T06:42:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47e7400640 1 -- 172.21.15.37:0/2883554304 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47e00b0970 con 0x7f47f00b59d0 2024-05-30T06:42:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47f6000640 1 -- 172.21.15.37:0/2883554304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f01559b0 con 0x7f47f00b59d0 2024-05-30T06:42:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47e7400640 1 -- 172.21.15.37:0/2883554304 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e00b0d60 con 0x7f47f00b59d0 2024-05-30T06:42:50.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47f6000640 1 -- 172.21.15.37:0/2883554304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f0155f70 con 0x7f47f00b59d0 2024-05-30T06:42:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47f6000640 1 -- 172.21.15.37:0/2883554304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f0068bc0 con 0x7f47f00b59d0 2024-05-30T06:42:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47e7400640 1 -- 172.21.15.37:0/2883554304 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f47e00c2060 con 0x7f47f00b59d0 2024-05-30T06:42:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47e7400640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f47cc068380 0x7f47cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.583+0000 7f47e7400640 1 -- 172.21.15.37:0/2883554304 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f47e0123a80 con 0x7f47f00b59d0 2024-05-30T06:42:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.587+0000 7f47e7e00640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f47cc068380 0x7f47cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.587+0000 7f47e7e00640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f47cc068380 0x7f47cc06a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47f013dc20 tx=0x7f47d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:50.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.591+0000 7f47e7400640 1 -- 172.21.15.37:0/2883554304 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f47e0018870 con 0x7f47f00b59d0 2024-05-30T06:42:50.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.755+0000 7f47f6000640 1 -- 172.21.15.37:0/2883554304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f47f006f0a0 con 0x7f47f00b59d0 2024-05-30T06:42:50.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.755+0000 7f47e7400640 1 -- 172.21.15.37:0/2883554304 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f47e00f4040 con 0x7f47f00b59d0 2024-05-30T06:42:50.755 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:42:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.759+0000 7f47f6000640 1 -- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f47cc068380 msgr2=0x7f47cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.759+0000 7f47f6000640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f47cc068380 0x7f47cc06a840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47f013dc20 tx=0x7f47d8008040 comp rx=0 tx=0).stop 2024-05-30T06:42:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.759+0000 7f47f6000640 1 -- 172.21.15.37:0/2883554304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f00b59d0 msgr2=0x7f47f0156770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.759+0000 7f47f6000640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f00b59d0 0x7f47f0156770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f47e00b3040 tx=0x7f47e001bab0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.759+0000 7f47f6000640 1 -- 172.21.15.37:0/2883554304 shutdown_connections 2024-05-30T06:42:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.759+0000 7f47f6000640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47f015d7e0 0x7f47f013e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.759+0000 7f47f6000640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f47cc068380 0x7f47cc06a840 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.759+0000 7f47f6000640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47f015d350 0x7f47f01528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.759+0000 7f47f6000640 1 --2- 172.21.15.37:0/2883554304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f00b59d0 0x7f47f0156770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.759+0000 7f47f6000640 1 -- 172.21.15.37:0/2883554304 >> 172.21.15.37:0/2883554304 conn(0x7f47f006bf60 msgr2=0x7f47f0071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.759+0000 7f47f6000640 1 -- 172.21.15.37:0/2883554304 shutdown_connections 2024-05-30T06:42:50.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.759+0000 7f47f6000640 1 -- 172.21.15.37:0/2883554304 wait complete. 2024-05-30T06:42:50.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T06:42:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.923+0000 7fabf3800640 1 Processor -- start 2024-05-30T06:42:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.923+0000 7fabf3800640 1 -- start start 2024-05-30T06:42:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.923+0000 7fabf3800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabec155da0 0x7fabec0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.923+0000 7fabf3800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec0cd440 0x7fabec06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.923+0000 7fabf3800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabec15f310 con 0x7fabec06f5a0 2024-05-30T06:42:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.923+0000 7fabf3800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fabec0b4760 con 0x7fabec155da0 2024-05-30T06:42:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.923+0000 7fabf3800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fabec15f5f0 con 0x7fabec0cd440 2024-05-30T06:42:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.927+0000 7fabf0e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabec155da0 0x7fabec0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.927+0000 7fabf0e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabec155da0 0x7fabec0cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35086/0 (socket says 172.21.15.37:35086) 2024-05-30T06:42:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.927+0000 7fabf0e00640 1 -- 172.21.15.37:0/787161107 learned_addr learned my addr 172.21.15.37:0/787161107 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.927+0000 7fabebe00640 1 --2- 172.21.15.37:0/787161107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec0cd440 0x7fabec06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.927+0000 7fabf0e00640 1 -- 172.21.15.37:0/787161107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec0cd440 msgr2=0x7fabec06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.927+0000 7fabf0e00640 1 --2- 172.21.15.37:0/787161107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec0cd440 0x7fabec06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.927+0000 7fabf0e00640 1 -- 172.21.15.37:0/787161107 >> v1:172.21.15.105:6789/0 conn(0x7fabec06f5a0 legacy=0x7fabec0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.927+0000 7fabf0e00640 1 -- 172.21.15.37:0/787161107 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec15f8d0 con 0x7fabec155da0 2024-05-30T06:42:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.927+0000 7fabf0e00640 1 --2- 172.21.15.37:0/787161107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec155da0 0x7fabec0cd950 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009870 tx=0x7fabe001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6685a69f06e7385e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.927+0000 7fabeb400640 1 -- 172.21.15.37:0/787161107 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe00b0070 con 0x7fabec155da0 2024-05-30T06:42:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.927+0000 7fabeb400640 1 -- 172.21.15.37:0/787161107 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe00ab600 con 0x7fabec155da0 2024-05-30T06:42:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.927+0000 7fabeb400640 1 -- 172.21.15.37:0/787161107 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe00ab9d0 con 0x7fabec155da0 2024-05-30T06:42:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 -- 172.21.15.37:0/787161107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec155da0 msgr2=0x7fabec0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 --2- 172.21.15.37:0/787161107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec155da0 0x7fabec0cd950 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009870 tx=0x7fabe001c440 comp rx=0 tx=0).stop 2024-05-30T06:42:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 -- 172.21.15.37:0/787161107 shutdown_connections 2024-05-30T06:42:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 --2- 172.21.15.37:0/787161107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec0cd440 0x7fabec06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 --2- 172.21.15.37:0/787161107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec155da0 0x7fabec0cd950 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 -- 172.21.15.37:0/787161107 >> 172.21.15.37:0/787161107 conn(0x7fabec06bf60 msgr2=0x7fabec0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 -- 172.21.15.37:0/787161107 shutdown_connections 2024-05-30T06:42:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 -- 172.21.15.37:0/787161107 wait complete. 2024-05-30T06:42:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 Processor -- start 2024-05-30T06:42:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 -- start start 2024-05-30T06:42:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec06f5a0 0x7fabec15af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabec155da0 0x7fabec15b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec158eb0 0x7fabec1fae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabec168580 con 0x7fabec06f5a0 2024-05-30T06:42:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fabec06f9d0 con 0x7fabec155da0 2024-05-30T06:42:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf3800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fabec168700 con 0x7fabec158eb0 2024-05-30T06:42:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec06f5a0 0x7fabec15af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec06f5a0 0x7fabec15af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35100/0 (socket says 172.21.15.37:35100) 2024-05-30T06:42:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf0e00640 1 -- 172.21.15.37:0/2305723402 learned_addr learned my addr 172.21.15.37:0/2305723402 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabebe00640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabec155da0 0x7fabec15b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf1800640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec158eb0 0x7fabec1fae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf0e00640 1 -- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec158eb0 msgr2=0x7fabec1fae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf0e00640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec158eb0 0x7fabec1fae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf0e00640 1 -- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabec155da0 msgr2=0x7fabec15b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:50.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf0e00640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabec155da0 0x7fabec15b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:50.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf0e00640 1 -- 172.21.15.37:0/2305723402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec154ff0 con 0x7fabec06f5a0 2024-05-30T06:42:50.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.931+0000 7fabf1800640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec158eb0 0x7fabec1fae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:50.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.935+0000 7fabf0e00640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec06f5a0 0x7fabec15af70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fabe00ae040 tx=0x7fabe001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:50.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.935+0000 7fabe8c00640 1 -- 172.21.15.37:0/2305723402 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe00ba020 con 0x7fabec06f5a0 2024-05-30T06:42:50.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.935+0000 7fabe8c00640 1 -- 172.21.15.37:0/2305723402 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe00b6420 con 0x7fabec06f5a0 2024-05-30T06:42:50.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.935+0000 7fabe8c00640 1 -- 172.21.15.37:0/2305723402 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe00b0040 con 0x7fabec06f5a0 2024-05-30T06:42:50.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.935+0000 7fabf3800640 1 -- 172.21.15.37:0/2305723402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabec15d4b0 con 0x7fabec06f5a0 2024-05-30T06:42:50.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.935+0000 7fabf3800640 1 -- 172.21.15.37:0/2305723402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabec15da70 con 0x7fabec06f5a0 2024-05-30T06:42:50.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.935+0000 7fabf3800640 1 -- 172.21.15.37:0/2305723402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabec068bc0 con 0x7fabec06f5a0 2024-05-30T06:42:50.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.935+0000 7fabe8c00640 1 -- 172.21.15.37:0/2305723402 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fabe00bd020 con 0x7fabec06f5a0 2024-05-30T06:42:50.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.935+0000 7fabe8c00640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabcc068380 0x7fabcc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:50.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.935+0000 7fabe8c00640 1 -- 172.21.15.37:0/2305723402 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5854+0+0 (secure 0 0 0) 0x7fabe0120b30 con 0x7fabec06f5a0 2024-05-30T06:42:50.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.935+0000 7fabebe00640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabcc068380 0x7fabcc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:50.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.939+0000 7fabebe00640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabcc068380 0x7fabcc06a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fabec0afd00 tx=0x7fabd8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:50.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:50.943+0000 7fabe8c00640 1 -- 172.21.15.37:0/2305723402 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fabe00c4030 con 0x7fabec06f5a0 2024-05-30T06:42:51.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.119+0000 7fabf3800640 1 -- 172.21.15.37:0/2305723402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fabec15ad30 con 0x7fabec06f5a0 2024-05-30T06:42:51.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.123+0000 7fabe8c00640 1 -- 172.21.15.37:0/2305723402 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fabe0016150 con 0x7fabec06f5a0 2024-05-30T06:42:51.121 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-30T06:42:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.123+0000 7fabf3800640 1 -- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabcc068380 msgr2=0x7fabcc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.123+0000 7fabf3800640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabcc068380 0x7fabcc06a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fabec0afd00 tx=0x7fabd8009190 comp rx=0 tx=0).stop 2024-05-30T06:42:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.123+0000 7fabf3800640 1 -- 172.21.15.37:0/2305723402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec06f5a0 msgr2=0x7fabec15af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.123+0000 7fabf3800640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec06f5a0 0x7fabec15af70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fabe00ae040 tx=0x7fabe001ac80 comp rx=0 tx=0).stop 2024-05-30T06:42:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.123+0000 7fabf3800640 1 -- 172.21.15.37:0/2305723402 shutdown_connections 2024-05-30T06:42:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.123+0000 7fabf3800640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fabec158eb0 0x7fabec1fae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.123+0000 7fabf3800640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabcc068380 0x7fabcc06a840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.123+0000 7fabf3800640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fabec155da0 0x7fabec15b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.123+0000 7fabf3800640 1 --2- 172.21.15.37:0/2305723402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec06f5a0 0x7fabec15af70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.123+0000 7fabf3800640 1 -- 172.21.15.37:0/2305723402 >> 172.21.15.37:0/2305723402 conn(0x7fabec06bf60 msgr2=0x7fabec0cc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.123+0000 7fabf3800640 1 -- 172.21.15.37:0/2305723402 shutdown_connections 2024-05-30T06:42:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.123+0000 7fabf3800640 1 -- 172.21.15.37:0/2305723402 wait complete. 2024-05-30T06:42:51.143 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-30T06:42:51.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:51.143 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-30T06:42:51.169 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-05-30T06:42:51.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:42:51.169 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-30T06:42:51.221 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T06:42:51.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:42:51.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2f600640 1 Processor -- start 2024-05-30T06:42:51.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2f600640 1 -- start start 2024-05-30T06:42:51.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2f600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d28155e60 0x7f2d280b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:51.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2f600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d280b2ec0 0x7f2d280cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:51.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2f600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d2815c8f0 con 0x7f2d2806f9a0 2024-05-30T06:42:51.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2f600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2d280ccff0 con 0x7f2d280b2ec0 2024-05-30T06:42:51.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2f600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2d280ccc80 con 0x7f2d28155e60 2024-05-30T06:42:51.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2d600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d280b2ec0 0x7f2d280cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:51.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2d600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d280b2ec0 0x7f2d280cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35108/0 (socket says 172.21.15.37:35108) 2024-05-30T06:42:51.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2d600640 1 -- 172.21.15.37:0/479976737 learned_addr learned my addr 172.21.15.37:0/479976737 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:51.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2cc00640 1 --2- 172.21.15.37:0/479976737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d28155e60 0x7f2d280b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:51.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2d600640 1 -- 172.21.15.37:0/479976737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d28155e60 msgr2=0x7f2d280b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:51.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2d600640 1 --2- 172.21.15.37:0/479976737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d28155e60 0x7f2d280b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2d600640 1 -- 172.21.15.37:0/479976737 >> v1:172.21.15.105:6789/0 conn(0x7f2d2806f9a0 legacy=0x7f2d280cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.363+0000 7f2d2d600640 1 -- 172.21.15.37:0/479976737 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2815cbd0 con 0x7f2d280b2ec0 2024-05-30T06:42:51.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.367+0000 7f2d2d600640 1 --2- 172.21.15.37:0/479976737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d280b2ec0 0x7f2d280cd480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009e50 tx=0x7f2d2001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ac88ab01d25fbc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:51.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.367+0000 7f2d27e00640 1 -- 172.21.15.37:0/479976737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d200a5810 con 0x7f2d280b2ec0 2024-05-30T06:42:51.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.367+0000 7f2d27e00640 1 -- 172.21.15.37:0/479976737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d200a59b0 con 0x7f2d280b2ec0 2024-05-30T06:42:51.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.367+0000 7f2d27e00640 1 -- 172.21.15.37:0/479976737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d200a5d80 con 0x7f2d280b2ec0 2024-05-30T06:42:51.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.367+0000 7f2d2f600640 1 -- 172.21.15.37:0/479976737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d280b2ec0 msgr2=0x7f2d280cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.367+0000 7f2d2f600640 1 --2- 172.21.15.37:0/479976737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d280b2ec0 0x7f2d280cd480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2d20009e50 tx=0x7f2d2001ca30 comp rx=0 tx=0).stop 2024-05-30T06:42:51.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.367+0000 7f2d2f600640 1 -- 172.21.15.37:0/479976737 shutdown_connections 2024-05-30T06:42:51.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.367+0000 7f2d2f600640 1 --2- 172.21.15.37:0/479976737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d280b2ec0 0x7f2d280cd480 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.367+0000 7f2d2f600640 1 --2- 172.21.15.37:0/479976737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d28155e60 0x7f2d280b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.367+0000 7f2d2f600640 1 -- 172.21.15.37:0/479976737 >> 172.21.15.37:0/479976737 conn(0x7f2d280b23a0 msgr2=0x7f2d280b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:51.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.367+0000 7f2d2f600640 1 -- 172.21.15.37:0/479976737 shutdown_connections 2024-05-30T06:42:51.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.367+0000 7f2d2f600640 1 -- 172.21.15.37:0/479976737 wait complete. 2024-05-30T06:42:51.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2f600640 1 Processor -- start 2024-05-30T06:42:51.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2f600640 1 -- start start 2024-05-30T06:42:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2f600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d2806f9a0 0x7f2d28158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2f600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d280b2ec0 0x7f2d2813e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:51.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2f600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d28155e60 0x7f2d28152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2f600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281689f0 con 0x7f2d28155e60 2024-05-30T06:42:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2f600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2d28168870 con 0x7f2d280b2ec0 2024-05-30T06:42:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2f600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2d28168b70 con 0x7f2d2806f9a0 2024-05-30T06:42:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d28155e60 0x7f2d28152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2cc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d2806f9a0 0x7f2d28158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d28155e60 0x7f2d28152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35114/0 (socket says 172.21.15.37:35114) 2024-05-30T06:42:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2d600640 1 -- 172.21.15.37:0/539878265 learned_addr learned my addr 172.21.15.37:0/539878265 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d1fe00640 1 --2- 172.21.15.37:0/539878265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d280b2ec0 0x7f2d2813e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2d600640 1 -- 172.21.15.37:0/539878265 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d2806f9a0 msgr2=0x7f2d28158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2d600640 1 --2- 172.21.15.37:0/539878265 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d2806f9a0 0x7f2d28158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2d600640 1 -- 172.21.15.37:0/539878265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d280b2ec0 msgr2=0x7f2d2813e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2d600640 1 --2- 172.21.15.37:0/539878265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d280b2ec0 0x7f2d2813e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2d600640 1 -- 172.21.15.37:0/539878265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d281660c0 con 0x7f2d28155e60 2024-05-30T06:42:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2d600640 1 --2- 172.21.15.37:0/539878265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d28155e60 0x7f2d28152920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2d200af040 tx=0x7f2d200197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:51.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d25600640 1 -- 172.21.15.37:0/539878265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d200bc020 con 0x7f2d28155e60 2024-05-30T06:42:51.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d25600640 1 -- 172.21.15.37:0/539878265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d200b8670 con 0x7f2d28155e60 2024-05-30T06:42:51.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d25600640 1 -- 172.21.15.37:0/539878265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d200b8a40 con 0x7f2d28155e60 2024-05-30T06:42:51.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2f600640 1 -- 172.21.15.37:0/539878265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d281593b0 con 0x7f2d28155e60 2024-05-30T06:42:51.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.371+0000 7f2d2f600640 1 -- 172.21.15.37:0/539878265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d281658c0 con 0x7f2d28155e60 2024-05-30T06:42:51.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.375+0000 7f2d2f600640 1 -- 172.21.15.37:0/539878265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d28068b20 con 0x7f2d28155e60 2024-05-30T06:42:51.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.375+0000 7f2d25600640 1 -- 172.21.15.37:0/539878265 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2d200bf020 con 0x7f2d28155e60 2024-05-30T06:42:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.375+0000 7f2d25600640 1 --2- 172.21.15.37:0/539878265 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d04068380 0x7f2d0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:51.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.375+0000 7f2d25600640 1 -- 172.21.15.37:0/539878265 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5854+0+0 (secure 0 0 0) 0x7f2d20121950 con 0x7f2d28155e60 2024-05-30T06:42:51.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.375+0000 7f2d2cc00640 1 --2- 172.21.15.37:0/539878265 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d04068380 0x7f2d0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:51.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.379+0000 7f2d2cc00640 1 --2- 172.21.15.37:0/539878265 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d04068380 0x7f2d0406a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2d28142da0 tx=0x7f2d18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:51.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.379+0000 7f2d25600640 1 -- 172.21.15.37:0/539878265 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2d200c6030 con 0x7f2d28155e60 2024-05-30T06:42:51.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d2f600640 1 -- 172.21.15.37:0/539878265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d28072fb0 con 0x7f2d28155e60 2024-05-30T06:42:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d25600640 1 -- 172.21.15.37:0/539878265 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f2d20016620 con 0x7f2d28155e60 2024-05-30T06:42:51.582 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:51.583 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2950341560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2950341560},{"type":"v1","addr":"172.21.15.37:6835","nonce":2950341560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/1458371524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1458371524},{"type":"v1","addr":"172.21.15.105:6836","nonce":1458371524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4088854019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4088854019},{"type":"v1","addr":"172.21.15.37:6833","nonce":4088854019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:42:10.805274+0000","modified":"2024-05-30T06:42:13.844990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2952122373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2952122373},{"type":"v1","addr":"172.21.15.105:6837","nonce":2952122373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-05-30T06:42:51.583 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-05-30T06:42:51.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d2f600640 1 -- 172.21.15.37:0/539878265 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d04068380 msgr2=0x7f2d0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d2f600640 1 --2- 172.21.15.37:0/539878265 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d04068380 0x7f2d0406a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2d28142da0 tx=0x7f2d18008040 comp rx=0 tx=0).stop 2024-05-30T06:42:51.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d2f600640 1 -- 172.21.15.37:0/539878265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d28155e60 msgr2=0x7f2d28152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d2f600640 1 --2- 172.21.15.37:0/539878265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d28155e60 0x7f2d28152920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2d200af040 tx=0x7f2d200197d0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d2f600640 1 -- 172.21.15.37:0/539878265 shutdown_connections 2024-05-30T06:42:51.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d2f600640 1 --2- 172.21.15.37:0/539878265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d28155e60 0x7f2d28152920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d2f600640 1 --2- 172.21.15.37:0/539878265 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d04068380 0x7f2d0406a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d2f600640 1 --2- 172.21.15.37:0/539878265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d280b2ec0 0x7f2d2813e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d2f600640 1 --2- 172.21.15.37:0/539878265 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d2806f9a0 0x7f2d28158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d2f600640 1 -- 172.21.15.37:0/539878265 >> 172.21.15.37:0/539878265 conn(0x7f2d280b23a0 msgr2=0x7f2d280b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:51.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d2f600640 1 -- 172.21.15.37:0/539878265 shutdown_connections 2024-05-30T06:42:51.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.583+0000 7f2d2f600640 1 -- 172.21.15.37:0/539878265 wait complete. 2024-05-30T06:42:51.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:51.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f8d600640 1 Processor -- start 2024-05-30T06:42:51.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f8d600640 1 -- start start 2024-05-30T06:42:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f8d600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0f8806f9a0 0x7f0f880b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f8d600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f880b2ec0 0x7f0f880cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f8d600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f8815c8f0 con 0x7f0f88155e60 2024-05-30T06:42:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f8d600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0f880ccff0 con 0x7f0f8806f9a0 2024-05-30T06:42:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f8d600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0f880ccc80 con 0x7f0f880b2ec0 2024-05-30T06:42:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f87400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f880b2ec0 0x7f0f880cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f86a00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f0f88155e60 0x7f0f880cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:40266/0 (socket says 172.21.15.37:40266) 2024-05-30T06:42:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f86a00640 1 -- 172.21.15.37:0/4040553215 learned_addr learned my addr 172.21.15.37:0/4040553215 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f7fe00640 1 --2- 172.21.15.37:0/4040553215 >> v2:172.21.15.105:3300/0 conn(0x7f0f8806f9a0 0x7f0f880b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f86000640 1 -- 172.21.15.37:0/4040553215 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1946071307 0 0) 0x7f0f8815c8f0 con 0x7f0f88155e60 2024-05-30T06:42:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f86000640 1 -- 172.21.15.37:0/4040553215 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f6c005740 con 0x7f0f88155e60 2024-05-30T06:42:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f87400640 1 -- 172.21.15.37:0/4040553215 >> v2:172.21.15.105:3300/0 conn(0x7f0f8806f9a0 msgr2=0x7f0f880b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f87400640 1 --2- 172.21.15.37:0/4040553215 >> v2:172.21.15.105:3300/0 conn(0x7f0f8806f9a0 0x7f0f880b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f87400640 1 -- 172.21.15.37:0/4040553215 >> v1:172.21.15.105:6789/0 conn(0x7f0f88155e60 legacy=0x7f0f880cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f87400640 1 -- 172.21.15.37:0/4040553215 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8815cbd0 con 0x7f0f880b2ec0 2024-05-30T06:42:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.747+0000 7f0f7fe00640 1 --2- 172.21.15.37:0/4040553215 >> v2:172.21.15.105:3300/0 conn(0x7f0f8806f9a0 0x7f0f880b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.751+0000 7f0f87400640 1 --2- 172.21.15.37:0/4040553215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f880b2ec0 0x7f0f880cd480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009d90 tx=0x7f0f8001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2b5bb6f4775534c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.751+0000 7f0f86000640 1 -- 172.21.15.37:0/4040553215 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800b2070 con 0x7f0f880b2ec0 2024-05-30T06:42:51.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.751+0000 7f0f86000640 1 -- 172.21.15.37:0/4040553215 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f800a5940 con 0x7f0f880b2ec0 2024-05-30T06:42:51.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.751+0000 7f0f86000640 1 -- 172.21.15.37:0/4040553215 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800a5d10 con 0x7f0f880b2ec0 2024-05-30T06:42:51.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.751+0000 7f0f8d600640 1 -- 172.21.15.37:0/4040553215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f880b2ec0 msgr2=0x7f0f880cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.751+0000 7f0f8d600640 1 --2- 172.21.15.37:0/4040553215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f880b2ec0 0x7f0f880cd480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009d90 tx=0x7f0f8001c970 comp rx=0 tx=0).stop 2024-05-30T06:42:51.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.751+0000 7f0f8d600640 1 -- 172.21.15.37:0/4040553215 shutdown_connections 2024-05-30T06:42:51.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.751+0000 7f0f8d600640 1 --2- 172.21.15.37:0/4040553215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f880b2ec0 0x7f0f880cd480 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.751+0000 7f0f8d600640 1 --2- 172.21.15.37:0/4040553215 >> v2:172.21.15.105:3300/0 conn(0x7f0f8806f9a0 0x7f0f880b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.751+0000 7f0f8d600640 1 -- 172.21.15.37:0/4040553215 >> 172.21.15.37:0/4040553215 conn(0x7f0f880b23a0 msgr2=0x7f0f880b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:51.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.751+0000 7f0f8d600640 1 -- 172.21.15.37:0/4040553215 shutdown_connections 2024-05-30T06:42:51.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.751+0000 7f0f8d600640 1 -- 172.21.15.37:0/4040553215 wait complete. 2024-05-30T06:42:51.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f8d600640 1 Processor -- start 2024-05-30T06:42:51.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f8d600640 1 -- start start 2024-05-30T06:42:51.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f8d600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f8806f9a0 0x7f0f88158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:51.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f8d600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f880b2ec0 0x7f0f88152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:51.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f8d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f88155e60 0x7f0f88154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f8d600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8806ec20 con 0x7f0f88155e60 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f8d600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8806eaa0 con 0x7f0f8806f9a0 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f8d600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0f8806eda0 con 0x7f0f880b2ec0 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f87400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f88155e60 0x7f0f88154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f87400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f88155e60 0x7f0f88154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35124/0 (socket says 172.21.15.37:35124) 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f87400640 1 -- 172.21.15.37:0/1812113440 learned_addr learned my addr 172.21.15.37:0/1812113440 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f86a00640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f8806f9a0 0x7f0f88158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f7fe00640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f880b2ec0 0x7f0f88152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f87400640 1 -- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f880b2ec0 msgr2=0x7f0f88152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f87400640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f880b2ec0 0x7f0f88152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f87400640 1 -- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f8806f9a0 msgr2=0x7f0f88158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f87400640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f8806f9a0 0x7f0f88158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f87400640 1 -- 172.21.15.37:0/1812113440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f881576e0 con 0x7f0f88155e60 2024-05-30T06:42:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f7fe00640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f880b2ec0 0x7f0f88152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:51.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f87400640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f88155e60 0x7f0f88154e80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0f8001b020 tx=0x7f0f80019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:51.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f7ea00640 1 -- 172.21.15.37:0/1812113440 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800b2040 con 0x7f0f88155e60 2024-05-30T06:42:51.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f7ea00640 1 -- 172.21.15.37:0/1812113440 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f800bf070 con 0x7f0f88155e60 2024-05-30T06:42:51.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f7ea00640 1 -- 172.21.15.37:0/1812113440 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800b8890 con 0x7f0f88155e60 2024-05-30T06:42:51.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f8d600640 1 -- 172.21.15.37:0/1812113440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f881579c0 con 0x7f0f88155e60 2024-05-30T06:42:51.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.755+0000 7f0f8d600640 1 -- 172.21.15.37:0/1812113440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f88157f80 con 0x7f0f88155e60 2024-05-30T06:42:51.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.759+0000 7f0f8d600640 1 -- 172.21.15.37:0/1812113440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f88068b20 con 0x7f0f88155e60 2024-05-30T06:42:51.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.759+0000 7f0f7ea00640 1 -- 172.21.15.37:0/1812113440 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0f800a57c0 con 0x7f0f88155e60 2024-05-30T06:42:51.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.759+0000 7f0f7ea00640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0f64068380 0x7f0f6406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:51.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.759+0000 7f0f7ea00640 1 -- 172.21.15.37:0/1812113440 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5854+0+0 (secure 0 0 0) 0x7f0f801219c0 con 0x7f0f88155e60 2024-05-30T06:42:51.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.759+0000 7f0f86a00640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0f64068380 0x7f0f6406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:51.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.759+0000 7f0f86a00640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0f64068380 0x7f0f6406a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0f78007fd0 tx=0x7f0f78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:51.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.763+0000 7f0f7ea00640 1 -- 172.21.15.37:0/1812113440 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0f80016560 con 0x7f0f88155e60 2024-05-30T06:42:51.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.935+0000 7f0f8d600640 1 -- 172.21.15.37:0/1812113440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f880b3710 con 0x7f0f88155e60 2024-05-30T06:42:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.939+0000 7f0f7ea00640 1 -- 172.21.15.37:0/1812113440 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16890 (secure 0 0 0) 0x7f0f800f1e50 con 0x7f0f88155e60 2024-05-30T06:42:51.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:51.937 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:51.837050+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:51.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.939+0000 7f0f8d600640 1 -- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0f64068380 msgr2=0x7f0f6406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.939+0000 7f0f8d600640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0f64068380 0x7f0f6406a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0f78007fd0 tx=0x7f0f78009040 comp rx=0 tx=0).stop 2024-05-30T06:42:51.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.939+0000 7f0f8d600640 1 -- 172.21.15.37:0/1812113440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f88155e60 msgr2=0x7f0f88154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:51.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.939+0000 7f0f8d600640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f88155e60 0x7f0f88154e80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0f8001b020 tx=0x7f0f80019710 comp rx=0 tx=0).stop 2024-05-30T06:42:51.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.939+0000 7f0f8d600640 1 -- 172.21.15.37:0/1812113440 shutdown_connections 2024-05-30T06:42:51.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.939+0000 7f0f8d600640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f88155e60 0x7f0f88154e80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.939+0000 7f0f8d600640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f880b2ec0 0x7f0f88152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.939+0000 7f0f8d600640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0f64068380 0x7f0f6406a840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.939+0000 7f0f8d600640 1 --2- 172.21.15.37:0/1812113440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f8806f9a0 0x7f0f88158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:51.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.939+0000 7f0f8d600640 1 -- 172.21.15.37:0/1812113440 >> 172.21.15.37:0/1812113440 conn(0x7f0f880b23a0 msgr2=0x7f0f881515c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:51.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.939+0000 7f0f8d600640 1 -- 172.21.15.37:0/1812113440 shutdown_connections 2024-05-30T06:42:51.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:51.939+0000 7f0f8d600640 1 -- 172.21.15.37:0/1812113440 wait complete. 2024-05-30T06:42:51.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:42:09.128133+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:42:09.755772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:42:51.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:42:52.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.103+0000 7f73a5800640 1 Processor -- start 2024-05-30T06:42:52.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.103+0000 7f73a5800640 1 -- start start 2024-05-30T06:42:52.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.103+0000 7f73a5800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f73a015d350 0x7f73a006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.103+0000 7f73a5800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f73a015d7e0 0x7f73a006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.103+0000 7f73a5800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a0142030 con 0x7f73a00b59d0 2024-05-30T06:42:52.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f73a5800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f73a0142310 con 0x7f73a015d7e0 2024-05-30T06:42:52.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f73a5800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f73a01425f0 con 0x7f73a015d350 2024-05-30T06:42:52.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f739f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f73a015d7e0 0x7f73a006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f739f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f73a015d7e0 0x7f73a006e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35140/0 (socket says 172.21.15.37:35140) 2024-05-30T06:42:52.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f739f400640 1 -- 172.21.15.37:0/4152953852 learned_addr learned my addr 172.21.15.37:0/4152953852 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:52.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f7396000640 1 --2- 172.21.15.37:0/4152953852 >> v2:172.21.15.105:3300/0 conn(0x7f73a015d350 0x7f73a006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f739f400640 1 -- 172.21.15.37:0/4152953852 >> v2:172.21.15.105:3300/0 conn(0x7f73a015d350 msgr2=0x7f73a006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:52.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f739f400640 1 --2- 172.21.15.37:0/4152953852 >> v2:172.21.15.105:3300/0 conn(0x7f73a015d350 0x7f73a006df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f739f400640 1 -- 172.21.15.37:0/4152953852 >> v1:172.21.15.105:6789/0 conn(0x7f73a00b59d0 legacy=0x7f73a00b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f739f400640 1 -- 172.21.15.37:0/4152953852 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a01428d0 con 0x7f73a015d7e0 2024-05-30T06:42:52.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f739f400640 1 --2- 172.21.15.37:0/4152953852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a015d7e0 0x7f73a006e490 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7398009e50 tx=0x7f739801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19809e48302d3645 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:52.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f739e000640 1 -- 172.21.15.37:0/4152953852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73980a57d0 con 0x7f73a015d7e0 2024-05-30T06:42:52.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f739e000640 1 -- 172.21.15.37:0/4152953852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73980a5970 con 0x7f73a015d7e0 2024-05-30T06:42:52.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.107+0000 7f739e000640 1 -- 172.21.15.37:0/4152953852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73980a5d40 con 0x7f73a015d7e0 2024-05-30T06:42:52.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 -- 172.21.15.37:0/4152953852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a015d7e0 msgr2=0x7f73a006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 --2- 172.21.15.37:0/4152953852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a015d7e0 0x7f73a006e490 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7398009e50 tx=0x7f739801c9f0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 -- 172.21.15.37:0/4152953852 shutdown_connections 2024-05-30T06:42:52.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 --2- 172.21.15.37:0/4152953852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a015d7e0 0x7f73a006e490 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 --2- 172.21.15.37:0/4152953852 >> v2:172.21.15.105:3300/0 conn(0x7f73a015d350 0x7f73a006df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 -- 172.21.15.37:0/4152953852 >> 172.21.15.37:0/4152953852 conn(0x7f73a006bf60 msgr2=0x7f73a00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:52.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 -- 172.21.15.37:0/4152953852 shutdown_connections 2024-05-30T06:42:52.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 -- 172.21.15.37:0/4152953852 wait complete. 2024-05-30T06:42:52.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 Processor -- start 2024-05-30T06:42:52.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 -- start start 2024-05-30T06:42:52.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73a00b59d0 0x7f73a00b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73a015d350 0x7f73a0153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a015d7e0 0x7f73a0152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f73a013f9e0 con 0x7f73a015d7e0 2024-05-30T06:42:52.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73a013f860 con 0x7f73a015d350 2024-05-30T06:42:52.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.111+0000 7f73a5800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f73a0141bf0 con 0x7f73a00b59d0 2024-05-30T06:42:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f7396000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73a015d350 0x7f73a0153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f739ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73a00b59d0 0x7f73a00b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f7396000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73a015d350 0x7f73a0153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:35482/0 (socket says 172.21.15.37:35482) 2024-05-30T06:42:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f7396000640 1 -- 172.21.15.37:0/193071228 learned_addr learned my addr 172.21.15.37:0/193071228 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:52.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f7396000640 1 -- 172.21.15.37:0/193071228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73a00b59d0 msgr2=0x7f73a00b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f7396000640 1 --2- 172.21.15.37:0/193071228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73a00b59d0 0x7f73a00b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f7396000640 1 -- 172.21.15.37:0/193071228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a015d7e0 msgr2=0x7f73a0152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f7396000640 1 --2- 172.21.15.37:0/193071228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a015d7e0 0x7f73a0152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f7396000640 1 -- 172.21.15.37:0/193071228 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a00b2100 con 0x7f73a015d350 2024-05-30T06:42:52.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f7396000640 1 --2- 172.21.15.37:0/193071228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73a015d350 0x7f73a0153d00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f738800e870 tx=0x7f738800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:52.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f7397400640 1 -- 172.21.15.37:0/193071228 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388017070 con 0x7f73a015d350 2024-05-30T06:42:52.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f7397400640 1 -- 172.21.15.37:0/193071228 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738800c940 con 0x7f73a015d350 2024-05-30T06:42:52.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f7397400640 1 -- 172.21.15.37:0/193071228 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738800cd10 con 0x7f73a015d350 2024-05-30T06:42:52.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f73a5800640 1 -- 172.21.15.37:0/193071228 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a00b01d0 con 0x7f73a015d350 2024-05-30T06:42:52.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f73a5800640 1 -- 172.21.15.37:0/193071228 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a00b0790 con 0x7f73a015d350 2024-05-30T06:42:52.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.115+0000 7f73a5800640 1 -- 172.21.15.37:0/193071228 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a0068bc0 con 0x7f73a015d350 2024-05-30T06:42:52.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.119+0000 7f7397400640 1 -- 172.21.15.37:0/193071228 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f738801a070 con 0x7f73a015d350 2024-05-30T06:42:52.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.119+0000 7f7397400640 1 --2- 172.21.15.37:0/193071228 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f737c0683d0 0x7f737c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.119+0000 7f7397400640 1 -- 172.21.15.37:0/193071228 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f7388086b80 con 0x7f73a015d350 2024-05-30T06:42:52.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.119+0000 7f739ea00640 1 --2- 172.21.15.37:0/193071228 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f737c0683d0 0x7f737c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.119+0000 7f739ea00640 1 --2- 172.21.15.37:0/193071228 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f737c0683d0 0x7f737c06a890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f73900015b0 tx=0x7f7390009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:52.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.123+0000 7f7397400640 1 -- 172.21.15.37:0/193071228 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7388057220 con 0x7f73a015d350 2024-05-30T06:42:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f73a5800640 1 -- 172.21.15.37:0/193071228 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f73a006f0a0 con 0x7f73a015d350 2024-05-30T06:42:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f7397400640 1 -- 172.21.15.37:0/193071228 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f7388056b20 con 0x7f73a015d350 2024-05-30T06:42:52.293 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:42:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f73a5800640 1 -- 172.21.15.37:0/193071228 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f737c0683d0 msgr2=0x7f737c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f73a5800640 1 --2- 172.21.15.37:0/193071228 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f737c0683d0 0x7f737c06a890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f73900015b0 tx=0x7f7390009040 comp rx=0 tx=0).stop 2024-05-30T06:42:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f73a5800640 1 -- 172.21.15.37:0/193071228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73a015d350 msgr2=0x7f73a0153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f73a5800640 1 --2- 172.21.15.37:0/193071228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73a015d350 0x7f73a0153d00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f738800e870 tx=0x7f738800ed30 comp rx=0 tx=0).stop 2024-05-30T06:42:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f73a5800640 1 -- 172.21.15.37:0/193071228 shutdown_connections 2024-05-30T06:42:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f73a5800640 1 --2- 172.21.15.37:0/193071228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a015d7e0 0x7f73a0152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f73a5800640 1 --2- 172.21.15.37:0/193071228 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f737c0683d0 0x7f737c06a890 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f73a5800640 1 --2- 172.21.15.37:0/193071228 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73a015d350 0x7f73a0153d00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f73a5800640 1 --2- 172.21.15.37:0/193071228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73a00b59d0 0x7f73a00b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f73a5800640 1 -- 172.21.15.37:0/193071228 >> 172.21.15.37:0/193071228 conn(0x7f73a006bf60 msgr2=0x7f73a013eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f73a5800640 1 -- 172.21.15.37:0/193071228 shutdown_connections 2024-05-30T06:42:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.295+0000 7f73a5800640 1 -- 172.21.15.37:0/193071228 wait complete. 2024-05-30T06:42:52.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:42:52.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.459+0000 7f3e2ac00640 1 Processor -- start 2024-05-30T06:42:52.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.459+0000 7f3e2ac00640 1 -- start start 2024-05-30T06:42:52.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.459+0000 7f3e2ac00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e24155da0 0x7f3e240cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.459+0000 7f3e2ac00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cd440 0x7f3e2406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.459+0000 7f3e2ac00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e2415f310 con 0x7f3e2406f5a0 2024-05-30T06:42:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.459+0000 7f3e2ac00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3e240b4760 con 0x7f3e24155da0 2024-05-30T06:42:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.459+0000 7f3e2ac00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3e2415f5f0 con 0x7f3e240cd440 2024-05-30T06:42:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.463+0000 7f3e23e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e24155da0 0x7f3e240cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.463+0000 7f3e23e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e24155da0 0x7f3e240cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35154/0 (socket says 172.21.15.37:35154) 2024-05-30T06:42:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.463+0000 7f3e23e00640 1 -- 172.21.15.37:0/805441039 learned_addr learned my addr 172.21.15.37:0/805441039 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:52.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.463+0000 7f3e1b400640 1 --2- 172.21.15.37:0/805441039 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cd440 0x7f3e2406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.463+0000 7f3e23e00640 1 -- 172.21.15.37:0/805441039 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cd440 msgr2=0x7f3e2406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.463+0000 7f3e23e00640 1 --2- 172.21.15.37:0/805441039 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cd440 0x7f3e2406f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.463+0000 7f3e23e00640 1 -- 172.21.15.37:0/805441039 >> v1:172.21.15.105:6789/0 conn(0x7f3e2406f5a0 legacy=0x7f3e240cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.463+0000 7f3e23e00640 1 -- 172.21.15.37:0/805441039 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2415f8d0 con 0x7f3e24155da0 2024-05-30T06:42:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.463+0000 7f3e23e00640 1 --2- 172.21.15.37:0/805441039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e24155da0 0x7f3e240cd950 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009870 tx=0x7f3e1401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1ba25518128401 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.463+0000 7f3e23400640 1 -- 172.21.15.37:0/805441039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e140b0070 con 0x7f3e24155da0 2024-05-30T06:42:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.463+0000 7f3e23400640 1 -- 172.21.15.37:0/805441039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e140ab600 con 0x7f3e24155da0 2024-05-30T06:42:52.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.463+0000 7f3e23400640 1 -- 172.21.15.37:0/805441039 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e140ab9d0 con 0x7f3e24155da0 2024-05-30T06:42:52.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 -- 172.21.15.37:0/805441039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e24155da0 msgr2=0x7f3e240cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 --2- 172.21.15.37:0/805441039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e24155da0 0x7f3e240cd950 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009870 tx=0x7f3e1401c440 comp rx=0 tx=0).stop 2024-05-30T06:42:52.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 -- 172.21.15.37:0/805441039 shutdown_connections 2024-05-30T06:42:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 --2- 172.21.15.37:0/805441039 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cd440 0x7f3e2406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 --2- 172.21.15.37:0/805441039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e24155da0 0x7f3e240cd950 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 -- 172.21.15.37:0/805441039 >> 172.21.15.37:0/805441039 conn(0x7f3e2406bf60 msgr2=0x7f3e240b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 -- 172.21.15.37:0/805441039 shutdown_connections 2024-05-30T06:42:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 -- 172.21.15.37:0/805441039 wait complete. 2024-05-30T06:42:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 Processor -- start 2024-05-30T06:42:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 -- start start 2024-05-30T06:42:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e2406f5a0 0x7f3e24158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e24155da0 0x7f3e24157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e24152ba0 0x7f3e241594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e24168580 con 0x7f3e24152ba0 2024-05-30T06:42:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2406f9d0 con 0x7f3e2406f5a0 2024-05-30T06:42:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e2ac00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3e24168700 con 0x7f3e24155da0 2024-05-30T06:42:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e28c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e24152ba0 0x7f3e241594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e23e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e2406f5a0 0x7f3e24158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e23e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e2406f5a0 0x7f3e24158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:35484/0 (socket says 172.21.15.37:35484) 2024-05-30T06:42:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e28c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e24152ba0 0x7f3e241594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35168/0 (socket says 172.21.15.37:35168) 2024-05-30T06:42:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e23e00640 1 -- 172.21.15.37:0/534863853 learned_addr learned my addr 172.21.15.37:0/534863853 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e1b400640 1 --2- 172.21.15.37:0/534863853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e24155da0 0x7f3e24157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e28c00640 1 -- 172.21.15.37:0/534863853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e24155da0 msgr2=0x7f3e24157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e28c00640 1 --2- 172.21.15.37:0/534863853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e24155da0 0x7f3e24157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e28c00640 1 -- 172.21.15.37:0/534863853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e2406f5a0 msgr2=0x7f3e24158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.467+0000 7f3e28c00640 1 --2- 172.21.15.37:0/534863853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e2406f5a0 0x7f3e24158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.471+0000 7f3e28c00640 1 -- 172.21.15.37:0/534863853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e24158040 con 0x7f3e24152ba0 2024-05-30T06:42:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.471+0000 7f3e28c00640 1 --2- 172.21.15.37:0/534863853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e24152ba0 0x7f3e241594f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00c730 tx=0x7f3e1c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.471+0000 7f3e20c00640 1 -- 172.21.15.37:0/534863853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c003b80 con 0x7f3e24152ba0 2024-05-30T06:42:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.471+0000 7f3e20c00640 1 -- 172.21.15.37:0/534863853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c003d20 con 0x7f3e24152ba0 2024-05-30T06:42:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.471+0000 7f3e20c00640 1 -- 172.21.15.37:0/534863853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00aa30 con 0x7f3e24152ba0 2024-05-30T06:42:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.471+0000 7f3e2ac00640 1 -- 172.21.15.37:0/534863853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e241582e0 con 0x7f3e24152ba0 2024-05-30T06:42:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.471+0000 7f3e2ac00640 1 -- 172.21.15.37:0/534863853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2414df00 con 0x7f3e24152ba0 2024-05-30T06:42:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.471+0000 7f3e2ac00640 1 -- 172.21.15.37:0/534863853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e24068bc0 con 0x7f3e24152ba0 2024-05-30T06:42:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.471+0000 7f3e20c00640 1 -- 172.21.15.37:0/534863853 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e1c00abd0 con 0x7f3e24152ba0 2024-05-30T06:42:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.471+0000 7f3e20c00640 1 --2- 172.21.15.37:0/534863853 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e000683b0 0x7f3e0006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.471+0000 7f3e20c00640 1 -- 172.21.15.37:0/534863853 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f3e1c086760 con 0x7f3e24152ba0 2024-05-30T06:42:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.471+0000 7f3e23e00640 1 --2- 172.21.15.37:0/534863853 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e000683b0 0x7f3e0006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.475+0000 7f3e23e00640 1 --2- 172.21.15.37:0/534863853 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e000683b0 0x7f3e0006a870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009870 tx=0x7f3e140a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.475+0000 7f3e20c00640 1 -- 172.21.15.37:0/534863853 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3e1c056640 con 0x7f3e24152ba0 2024-05-30T06:42:52.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.639+0000 7f3e2ac00640 1 -- 172.21.15.37:0/534863853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3e240ccd30 con 0x7f3e24152ba0 2024-05-30T06:42:52.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.639+0000 7f3e20c00640 1 -- 172.21.15.37:0/534863853 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f3e1c05a940 con 0x7f3e24152ba0 2024-05-30T06:42:52.640 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:42:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.643+0000 7f3e2ac00640 1 -- 172.21.15.37:0/534863853 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e000683b0 msgr2=0x7f3e0006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.643+0000 7f3e2ac00640 1 --2- 172.21.15.37:0/534863853 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e000683b0 0x7f3e0006a870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009870 tx=0x7f3e140a6000 comp rx=0 tx=0).stop 2024-05-30T06:42:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.643+0000 7f3e2ac00640 1 -- 172.21.15.37:0/534863853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e24152ba0 msgr2=0x7f3e241594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.643+0000 7f3e2ac00640 1 --2- 172.21.15.37:0/534863853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e24152ba0 0x7f3e241594f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00c730 tx=0x7f3e1c00cbf0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.643+0000 7f3e2ac00640 1 -- 172.21.15.37:0/534863853 shutdown_connections 2024-05-30T06:42:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.643+0000 7f3e2ac00640 1 --2- 172.21.15.37:0/534863853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e24152ba0 0x7f3e241594f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.643+0000 7f3e2ac00640 1 --2- 172.21.15.37:0/534863853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e24155da0 0x7f3e24157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.643+0000 7f3e2ac00640 1 --2- 172.21.15.37:0/534863853 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e000683b0 0x7f3e0006a870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.643+0000 7f3e2ac00640 1 --2- 172.21.15.37:0/534863853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e2406f5a0 0x7f3e24158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.643+0000 7f3e2ac00640 1 -- 172.21.15.37:0/534863853 >> 172.21.15.37:0/534863853 conn(0x7f3e2406bf60 msgr2=0x7f3e24154d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.643+0000 7f3e2ac00640 1 -- 172.21.15.37:0/534863853 shutdown_connections 2024-05-30T06:42:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.643+0000 7f3e2ac00640 1 -- 172.21.15.37:0/534863853 wait complete. 2024-05-30T06:42:52.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:42:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5139c00640 1 Processor -- start 2024-05-30T06:42:52.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5139c00640 1 -- start start 2024-05-30T06:42:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5139c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51340cd440 0x7f513406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5139c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f513415f310 con 0x7f5134155da0 2024-05-30T06:42:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5139c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f513415f5f0 con 0x7f513406f5a0 2024-05-30T06:42:52.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5139c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f513415f8d0 con 0x7f51340cd440 2024-05-30T06:42:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5134155da0 0x7f51340cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53880/0 (socket says 172.21.15.37:53880) 2024-05-30T06:42:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132a00640 1 -- 172.21.15.37:0/2918576769 learned_addr learned my addr 172.21.15.37:0/2918576769 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f512be00640 1 --2- 172.21.15.37:0/2918576769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51340cd440 0x7f513406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154713492 0 0) 0x7f513415f310 con 0x7f5134155da0 2024-05-30T06:42:52.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5118005740 con 0x7f5134155da0 2024-05-30T06:42:52.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538059086 0 0) 0x7f513415f5f0 con 0x7f513406f5a0 2024-05-30T06:42:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f513415f310 con 0x7f513406f5a0 2024-05-30T06:42:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3261862150 0 0) 0x7f5118005740 con 0x7f5134155da0 2024-05-30T06:42:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51340cd440 msgr2=0x7f513406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 --2- 172.21.15.37:0/2918576769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f51340cd440 0x7f513406f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 >> v1:172.21.15.105:6789/0 conn(0x7f513406f5a0 legacy=0x7f51340b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513415fbb0 con 0x7f5134155da0 2024-05-30T06:42:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f5124001600 con 0x7f5134155da0 2024-05-30T06:42:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 >> v1:172.21.15.37:6789/0 conn(0x7f5134155da0 legacy=0x7f51340cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 --2- 172.21.15.37:0/2918576769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5118005d90 0x7f5118006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 --2- 172.21.15.37:0/2918576769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5118006a20 0x7f5118006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 --2- 172.21.15.37:0/2918576769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5118007480 0x7f511800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f513415f8d0 con 0x7f5118006a20 2024-05-30T06:42:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f511800e1d0 con 0x7f5118005d90 2024-05-30T06:42:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f511800e3d0 con 0x7f5118007480 2024-05-30T06:42:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f512be00640 1 --2- 172.21.15.37:0/2918576769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5118006a20 0x7f5118006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5133400640 1 --2- 172.21.15.37:0/2918576769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5118007480 0x7f511800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.807+0000 7f5132a00640 1 --2- 172.21.15.37:0/2918576769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5118005d90 0x7f5118006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f512be00640 1 -- 172.21.15.37:0/2918576769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5118007480 msgr2=0x7f511800dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f512be00640 1 --2- 172.21.15.37:0/2918576769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5118007480 0x7f511800dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f512be00640 1 -- 172.21.15.37:0/2918576769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5118005d90 msgr2=0x7f5118006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f512be00640 1 --2- 172.21.15.37:0/2918576769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5118005d90 0x7f5118006190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f512be00640 1 -- 172.21.15.37:0/2918576769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5118005740 con 0x7f5118006a20 2024-05-30T06:42:52.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f5132a00640 1 --2- 172.21.15.37:0/2918576769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5118005d90 0x7f5118006190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:52.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f512be00640 1 --2- 172.21.15.37:0/2918576769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5118006a20 0x7f5118006ea0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f511c009ae0 tx=0x7f511c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81600da70cc2b786 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c0b2070 con 0x7f5118006a20 2024-05-30T06:42:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f511c0a5550 con 0x7f5118006a20 2024-05-30T06:42:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f5132000640 1 -- 172.21.15.37:0/2918576769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c0096b0 con 0x7f5118006a20 2024-05-30T06:42:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f5139c00640 1 -- 172.21.15.37:0/2918576769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5118006a20 msgr2=0x7f5118006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f5139c00640 1 --2- 172.21.15.37:0/2918576769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5118006a20 0x7f5118006ea0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f511c009ae0 tx=0x7f511c01ca70 comp rx=0 tx=0).stop 2024-05-30T06:42:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f5133400640 1 -- 172.21.15.37:0/2918576769 reap_dead start 2024-05-30T06:42:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f5139c00640 1 -- 172.21.15.37:0/2918576769 shutdown_connections 2024-05-30T06:42:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.811+0000 7f5139c00640 1 -- 172.21.15.37:0/2918576769 >> 172.21.15.37:0/2918576769 conn(0x7f513406bf60 msgr2=0x7f51340b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5139c00640 1 -- 172.21.15.37:0/2918576769 shutdown_connections 2024-05-30T06:42:52.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5139c00640 1 -- 172.21.15.37:0/2918576769 wait complete. 2024-05-30T06:42:52.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5139c00640 1 Processor -- start 2024-05-30T06:42:52.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5139c00640 1 -- start start 2024-05-30T06:42:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5139c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5118006a20 0x7f5134158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5139c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f513414ac00 0x7f513414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5139c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513415bc60 0x7f513415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5139c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f513406eaf0 con 0x7f5118006a20 2024-05-30T06:42:52.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5139c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f513406e970 con 0x7f513414ac00 2024-05-30T06:42:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5139c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f513406ec70 con 0x7f513415bc60 2024-05-30T06:42:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5132a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5118006a20 0x7f5134158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5132a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5118006a20 0x7f5134158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35188/0 (socket says 172.21.15.37:35188) 2024-05-30T06:42:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5132a00640 1 -- 172.21.15.37:0/815986718 learned_addr learned my addr 172.21.15.37:0/815986718 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f512be00640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f513414ac00 0x7f513414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5133400640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513415bc60 0x7f513415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5132a00640 1 -- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513415bc60 msgr2=0x7f513415c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5132a00640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513415bc60 0x7f513415c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5132a00640 1 -- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f513414ac00 msgr2=0x7f513414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5132a00640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f513414ac00 0x7f513414b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5132a00640 1 -- 172.21.15.37:0/815986718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5134156330 con 0x7f5118006a20 2024-05-30T06:42:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.815+0000 7f5132a00640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5118006a20 0x7f5134158700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5124001000 tx=0x7f512400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.819+0000 7f512aa00640 1 -- 172.21.15.37:0/815986718 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512400c6c0 con 0x7f5118006a20 2024-05-30T06:42:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.819+0000 7f512aa00640 1 -- 172.21.15.37:0/815986718 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5124018070 con 0x7f5118006a20 2024-05-30T06:42:52.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.819+0000 7f5139c00640 1 -- 172.21.15.37:0/815986718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5134155380 con 0x7f5118006a20 2024-05-30T06:42:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.819+0000 7f512aa00640 1 -- 172.21.15.37:0/815986718 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512400ca60 con 0x7f5118006a20 2024-05-30T06:42:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.819+0000 7f5139c00640 1 -- 172.21.15.37:0/815986718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513415cb50 con 0x7f5118006a20 2024-05-30T06:42:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.819+0000 7f5139c00640 1 -- 172.21.15.37:0/815986718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5134068bc0 con 0x7f5118006a20 2024-05-30T06:42:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.819+0000 7f512aa00640 1 -- 172.21.15.37:0/815986718 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f512400cc00 con 0x7f5118006a20 2024-05-30T06:42:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.819+0000 7f512aa00640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f51100683b0 0x7f511006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.819+0000 7f512aa00640 1 -- 172.21.15.37:0/815986718 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f5124086620 con 0x7f5118006a20 2024-05-30T06:42:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.819+0000 7f512be00640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f51100683b0 0x7f511006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.823+0000 7f512be00640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f51100683b0 0x7f511006a870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f511c0af000 tx=0x7f511c0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.823+0000 7f512aa00640 1 -- 172.21.15.37:0/815986718 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5134155380 con 0x7f5118006a20 2024-05-30T06:42:52.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.987+0000 7f5139c00640 1 -- 172.21.15.37:0/815986718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5134162330 con 0x7f5118006a20 2024-05-30T06:42:52.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.987+0000 7f512aa00640 1 -- 172.21.15.37:0/815986718 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f5124056b40 con 0x7f5118006a20 2024-05-30T06:42:52.988 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:42:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.991+0000 7f5139c00640 1 -- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f51100683b0 msgr2=0x7f511006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.991+0000 7f5139c00640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f51100683b0 0x7f511006a870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f511c0af000 tx=0x7f511c0046d0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.991+0000 7f5139c00640 1 -- 172.21.15.37:0/815986718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5118006a20 msgr2=0x7f5134158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.991+0000 7f5139c00640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5118006a20 0x7f5134158700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5124001000 tx=0x7f512400eb50 comp rx=0 tx=0).stop 2024-05-30T06:42:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.991+0000 7f5139c00640 1 -- 172.21.15.37:0/815986718 shutdown_connections 2024-05-30T06:42:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.991+0000 7f5139c00640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513415bc60 0x7f513415c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.991+0000 7f5139c00640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f51100683b0 0x7f511006a870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.991+0000 7f5139c00640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f513414ac00 0x7f513414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.991+0000 7f5139c00640 1 --2- 172.21.15.37:0/815986718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5118006a20 0x7f5134158700 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.991+0000 7f5139c00640 1 -- 172.21.15.37:0/815986718 >> 172.21.15.37:0/815986718 conn(0x7f513406bf60 msgr2=0x7f5134160b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.991+0000 7f5139c00640 1 -- 172.21.15.37:0/815986718 shutdown_connections 2024-05-30T06:42:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:52.991+0000 7f5139c00640 1 -- 172.21.15.37:0/815986718 wait complete. 2024-05-30T06:42:53.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:42:53.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e36600640 1 Processor -- start 2024-05-30T06:42:53.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e36600640 1 -- start start 2024-05-30T06:42:53.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e36600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e300b2e20 0x7f0e30160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e36600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e3009ba70 0x7f0e30160e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e36600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e300d0430 con 0x7f0e301609c0 2024-05-30T06:42:53.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e36600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0e300b3200 con 0x7f0e300b2e20 2024-05-30T06:42:53.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e36600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e300d01e0 con 0x7f0e3009ba70 2024-05-30T06:42:53.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e2f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e300b2e20 0x7f0e30160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e2f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e300b2e20 0x7f0e30160480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35194/0 (socket says 172.21.15.37:35194) 2024-05-30T06:42:53.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e27e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0e301609c0 0x7f0e300cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53886/0 (socket says 172.21.15.37:53886) 2024-05-30T06:42:53.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e2f400640 1 -- 172.21.15.37:0/4085936571 learned_addr learned my addr 172.21.15.37:0/4085936571 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:53.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e2fe00640 1 --2- 172.21.15.37:0/4085936571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e3009ba70 0x7f0e30160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e2f400640 1 -- 172.21.15.37:0/4085936571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e3009ba70 msgr2=0x7f0e30160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e2f400640 1 --2- 172.21.15.37:0/4085936571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e3009ba70 0x7f0e30160e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e2f400640 1 -- 172.21.15.37:0/4085936571 >> v1:172.21.15.37:6789/0 conn(0x7f0e301609c0 legacy=0x7f0e300cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e2f400640 1 -- 172.21.15.37:0/4085936571 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e300d0710 con 0x7f0e300b2e20 2024-05-30T06:42:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.151+0000 7f0e2ea00640 1 -- 172.21.15.37:0/4085936571 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 455409495 0 0) 0x7f0e300d0430 con 0x7f0e301609c0 2024-05-30T06:42:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.155+0000 7f0e2f400640 1 --2- 172.21.15.37:0/4085936571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2e20 0x7f0e30160480 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009870 tx=0x7f0e2001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19287bbcfd333ae server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.155+0000 7f0e2ea00640 1 -- 172.21.15.37:0/4085936571 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e200ab650 con 0x7f0e300b2e20 2024-05-30T06:42:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.155+0000 7f0e2ea00640 1 -- 172.21.15.37:0/4085936571 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e200b0070 con 0x7f0e300b2e20 2024-05-30T06:42:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.155+0000 7f0e2ea00640 1 -- 172.21.15.37:0/4085936571 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e200aba10 con 0x7f0e300b2e20 2024-05-30T06:42:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.155+0000 7f0e36600640 1 -- 172.21.15.37:0/4085936571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2e20 msgr2=0x7f0e30160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.155+0000 7f0e36600640 1 --2- 172.21.15.37:0/4085936571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2e20 0x7f0e30160480 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009870 tx=0x7f0e2001c560 comp rx=0 tx=0).stop 2024-05-30T06:42:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.155+0000 7f0e36600640 1 -- 172.21.15.37:0/4085936571 shutdown_connections 2024-05-30T06:42:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.155+0000 7f0e36600640 1 --2- 172.21.15.37:0/4085936571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e3009ba70 0x7f0e30160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.155+0000 7f0e36600640 1 --2- 172.21.15.37:0/4085936571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2e20 0x7f0e30160480 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.155+0000 7f0e36600640 1 -- 172.21.15.37:0/4085936571 >> 172.21.15.37:0/4085936571 conn(0x7f0e300b4100 msgr2=0x7f0e300b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.155+0000 7f0e36600640 1 -- 172.21.15.37:0/4085936571 shutdown_connections 2024-05-30T06:42:53.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.155+0000 7f0e36600640 1 -- 172.21.15.37:0/4085936571 wait complete. 2024-05-30T06:42:53.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e36600640 1 Processor -- start 2024-05-30T06:42:53.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e36600640 1 -- start start 2024-05-30T06:42:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e36600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e3009ba70 0x7f0e301f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e36600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2e20 0x7f0e300b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e36600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e301609c0 0x7f0e300b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e36600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0e300ce320 con 0x7f0e300b2e20 2024-05-30T06:42:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e36600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e300ce1a0 con 0x7f0e301609c0 2024-05-30T06:42:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e36600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e3015e0d0 con 0x7f0e3009ba70 2024-05-30T06:42:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e27e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2e20 0x7f0e300b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e27e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2e20 0x7f0e300b63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35204/0 (socket says 172.21.15.37:35204) 2024-05-30T06:42:53.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e27e00640 1 -- 172.21.15.37:0/2765806575 learned_addr learned my addr 172.21.15.37:0/2765806575 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:53.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e2f400640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e3009ba70 0x7f0e301f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e2fe00640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e301609c0 0x7f0e300b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e27e00640 1 -- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e3009ba70 msgr2=0x7f0e301f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e27e00640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e3009ba70 0x7f0e301f79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e27e00640 1 -- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e301609c0 msgr2=0x7f0e300b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e27e00640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e301609c0 0x7f0e300b6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e27e00640 1 -- 172.21.15.37:0/2765806575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e301f8130 con 0x7f0e300b2e20 2024-05-30T06:42:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e27e00640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2e20 0x7f0e300b63c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e180011f0 tx=0x7f0e1800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e27400640 1 -- 172.21.15.37:0/2765806575 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18018070 con 0x7f0e300b2e20 2024-05-30T06:42:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e27400640 1 -- 172.21.15.37:0/2765806575 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e180074e0 con 0x7f0e300b2e20 2024-05-30T06:42:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e27400640 1 -- 172.21.15.37:0/2765806575 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18004a10 con 0x7f0e300b2e20 2024-05-30T06:42:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e36600640 1 -- 172.21.15.37:0/2765806575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e301f8410 con 0x7f0e300b2e20 2024-05-30T06:42:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.159+0000 7f0e36600640 1 -- 172.21.15.37:0/2765806575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3006d2e0 con 0x7f0e300b2e20 2024-05-30T06:42:53.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.163+0000 7f0e36600640 1 -- 172.21.15.37:0/2765806575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e30068b20 con 0x7f0e300b2e20 2024-05-30T06:42:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.163+0000 7f0e27400640 1 -- 172.21.15.37:0/2765806575 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0e1801b070 con 0x7f0e300b2e20 2024-05-30T06:42:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.163+0000 7f0e27400640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c068380 0x7f0e0c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.163+0000 7f0e27400640 1 -- 172.21.15.37:0/2765806575 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f0e18085cc0 con 0x7f0e300b2e20 2024-05-30T06:42:53.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.163+0000 7f0e2f400640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c068380 0x7f0e0c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.163+0000 7f0e2f400640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c068380 0x7f0e0c06a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e200af000 tx=0x7f0e200a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.167+0000 7f0e27400640 1 -- 172.21.15.37:0/2765806575 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e1808c080 con 0x7f0e300b2e20 2024-05-30T06:42:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.367+0000 7f0e36600640 1 -- 172.21.15.37:0/2765806575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e300ce860 con 0x7f0e300b2e20 2024-05-30T06:42:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.367+0000 7f0e27400640 1 -- 172.21.15.37:0/2765806575 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f0e18055b90 con 0x7f0e300b2e20 2024-05-30T06:42:53.368 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:53.368 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2950341560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2950341560},{"type":"v1","addr":"172.21.15.37:6835","nonce":2950341560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/1458371524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1458371524},{"type":"v1","addr":"172.21.15.105:6836","nonce":1458371524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4088854019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4088854019},{"type":"v1","addr":"172.21.15.37:6833","nonce":4088854019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:42:10.805274+0000","modified":"2024-05-30T06:42:13.844990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2952122373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2952122373},{"type":"v1","addr":"172.21.15.105:6837","nonce":2952122373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-05-30T06:42:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-05-30T06:42:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.371+0000 7f0e36600640 1 -- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c068380 msgr2=0x7f0e0c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.371+0000 7f0e36600640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c068380 0x7f0e0c06a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e200af000 tx=0x7f0e200a7000 comp rx=0 tx=0).stop 2024-05-30T06:42:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.371+0000 7f0e36600640 1 -- 172.21.15.37:0/2765806575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2e20 msgr2=0x7f0e300b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.371+0000 7f0e36600640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2e20 0x7f0e300b63c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e180011f0 tx=0x7f0e1800c9b0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.371+0000 7f0e36600640 1 -- 172.21.15.37:0/2765806575 shutdown_connections 2024-05-30T06:42:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.371+0000 7f0e36600640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c068380 0x7f0e0c06a840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.371+0000 7f0e36600640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e301609c0 0x7f0e300b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.371+0000 7f0e36600640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2e20 0x7f0e300b63c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.371+0000 7f0e36600640 1 --2- 172.21.15.37:0/2765806575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e3009ba70 0x7f0e301f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.371+0000 7f0e36600640 1 -- 172.21.15.37:0/2765806575 >> 172.21.15.37:0/2765806575 conn(0x7f0e300b4100 msgr2=0x7f0e3015f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.371+0000 7f0e36600640 1 -- 172.21.15.37:0/2765806575 shutdown_connections 2024-05-30T06:42:53.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.371+0000 7f0e36600640 1 -- 172.21.15.37:0/2765806575 wait complete. 2024-05-30T06:42:53.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.531+0000 7f4ce6000640 1 Processor -- start 2024-05-30T06:42:53.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.531+0000 7f4ce6000640 1 -- start start 2024-05-30T06:42:53.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.531+0000 7f4ce6000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4ce00b2ec0 0x7f4ce00b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.531+0000 7f4ce6000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ce015c8f0 con 0x7f4ce0155e60 2024-05-30T06:42:53.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.531+0000 7f4ce6000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ce00ccc80 con 0x7f4ce006f9a0 2024-05-30T06:42:53.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.531+0000 7f4ce6000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4ce00ccff0 con 0x7f4ce00b2ec0 2024-05-30T06:42:53.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.531+0000 7f4cdf400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4ce0155e60 0x7f4ce00cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53902/0 (socket says 172.21.15.37:53902) 2024-05-30T06:42:53.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.531+0000 7f4cdf400640 1 -- 172.21.15.37:0/2974344559 learned_addr learned my addr 172.21.15.37:0/2974344559 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:53.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.531+0000 7f4cdfe00640 1 --2- 172.21.15.37:0/2974344559 >> v2:172.21.15.105:3300/0 conn(0x7f4ce00b2ec0 0x7f4ce00b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.531+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 400526832 0 0) 0x7f4ce015c8f0 con 0x7f4ce0155e60 2024-05-30T06:42:53.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.531+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cc4003530 con 0x7f4ce0155e60 2024-05-30T06:42:53.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 257878444 0 0) 0x7f4cc4003530 con 0x7f4ce0155e60 2024-05-30T06:42:53.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 >> v2:172.21.15.105:3300/0 conn(0x7f4ce00b2ec0 msgr2=0x7f4ce00b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:53.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 --2- 172.21.15.37:0/2974344559 >> v2:172.21.15.105:3300/0 conn(0x7f4ce00b2ec0 0x7f4ce00b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 >> v1:172.21.15.105:6789/0 conn(0x7f4ce006f9a0 legacy=0x7f4ce00cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce015cbd0 con 0x7f4ce0155e60 2024-05-30T06:42:53.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f4cd0001680 con 0x7f4ce0155e60 2024-05-30T06:42:53.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 >> v1:172.21.15.37:6789/0 conn(0x7f4ce0155e60 legacy=0x7f4ce00cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 --2- 172.21.15.37:0/2974344559 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cc40039c0 0x7f4cc4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 --2- 172.21.15.37:0/2974344559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc4004810 0x7f4cc4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 --2- 172.21.15.37:0/2974344559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cc40051d0 0x7f4cc400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce00ccff0 con 0x7f4cc40051d0 2024-05-30T06:42:53.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc400c070 con 0x7f4cc4004810 2024-05-30T06:42:53.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc400c270 con 0x7f4cc40039c0 2024-05-30T06:42:53.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdfe00640 1 --2- 172.21.15.37:0/2974344559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cc40051d0 0x7f4cc400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdf400640 1 --2- 172.21.15.37:0/2974344559 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cc40039c0 0x7f4cc4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cd7e00640 1 --2- 172.21.15.37:0/2974344559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc4004810 0x7f4cc4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdfe00640 1 -- 172.21.15.37:0/2974344559 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cc40039c0 msgr2=0x7f4cc4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:53.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdfe00640 1 --2- 172.21.15.37:0/2974344559 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cc40039c0 0x7f4cc4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdfe00640 1 -- 172.21.15.37:0/2974344559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc4004810 msgr2=0x7f4cc4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:53.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdfe00640 1 --2- 172.21.15.37:0/2974344559 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc4004810 0x7f4cc4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdfe00640 1 -- 172.21.15.37:0/2974344559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc4003530 con 0x7f4cc40051d0 2024-05-30T06:42:53.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdfe00640 1 -- 172.21.15.37:0/2974344559 reap_dead start 2024-05-30T06:42:53.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdfe00640 1 --2- 172.21.15.37:0/2974344559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cc40051d0 0x7f4cc400b9d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009fc0 tx=0x7f4cd801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be20821c17fd01f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:53.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8009c10 con 0x7f4cc40051d0 2024-05-30T06:42:53.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd80a5d10 con 0x7f4cc40051d0 2024-05-30T06:42:53.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.535+0000 7f4cdea00640 1 -- 172.21.15.37:0/2974344559 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8003be0 con 0x7f4cc40051d0 2024-05-30T06:42:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 -- 172.21.15.37:0/2974344559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cc40051d0 msgr2=0x7f4cc400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 --2- 172.21.15.37:0/2974344559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cc40051d0 0x7f4cc400b9d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009fc0 tx=0x7f4cd801ccc0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 -- 172.21.15.37:0/2974344559 shutdown_connections 2024-05-30T06:42:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 --2- 172.21.15.37:0/2974344559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cc40051d0 0x7f4cc400b9d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 -- 172.21.15.37:0/2974344559 >> 172.21.15.37:0/2974344559 conn(0x7f4ce00b23a0 msgr2=0x7f4ce00b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 -- 172.21.15.37:0/2974344559 shutdown_connections 2024-05-30T06:42:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 -- 172.21.15.37:0/2974344559 wait complete. 2024-05-30T06:42:53.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 Processor -- start 2024-05-30T06:42:53.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 -- start start 2024-05-30T06:42:53.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40051d0 0x7f4ce0152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce00cb1c0 0x7f4ce0159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce015e0a0 0x7f4ce015e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce00b36a0 con 0x7f4ce00cb1c0 2024-05-30T06:42:53.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce006fe50 con 0x7f4cc40051d0 2024-05-30T06:42:53.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4ce6000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce00b3820 con 0x7f4ce015e0a0 2024-05-30T06:42:53.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4cd7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce00cb1c0 0x7f4ce0159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4cd7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce00cb1c0 0x7f4ce0159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35214/0 (socket says 172.21.15.37:35214) 2024-05-30T06:42:53.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4cd7e00640 1 -- 172.21.15.37:0/3292096215 learned_addr learned my addr 172.21.15.37:0/3292096215 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:53.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4cdf400640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40051d0 0x7f4ce0152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4cdfe00640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce015e0a0 0x7f4ce015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4cd7e00640 1 -- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce015e0a0 msgr2=0x7f4ce015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4cd7e00640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce015e0a0 0x7f4ce015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4cd7e00640 1 -- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40051d0 msgr2=0x7f4ce0152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4cd7e00640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40051d0 0x7f4ce0152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.539+0000 7f4cd7e00640 1 -- 172.21.15.37:0/3292096215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce015a6b0 con 0x7f4ce00cb1c0 2024-05-30T06:42:53.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.543+0000 7f4cdfe00640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce015e0a0 0x7f4ce015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:53.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.543+0000 7f4cd7e00640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce00cb1c0 0x7f4ce0159d60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800f540 tx=0x7f4cc800f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:53.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.543+0000 7f4cd7400640 1 -- 172.21.15.37:0/3292096215 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80052e0 con 0x7f4ce00cb1c0 2024-05-30T06:42:53.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.543+0000 7f4cd7400640 1 -- 172.21.15.37:0/3292096215 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc8018070 con 0x7f4ce00cb1c0 2024-05-30T06:42:53.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.543+0000 7f4cd7400640 1 -- 172.21.15.37:0/3292096215 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc8005480 con 0x7f4ce00cb1c0 2024-05-30T06:42:53.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.543+0000 7f4ce6000640 1 -- 172.21.15.37:0/3292096215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce015a990 con 0x7f4ce00cb1c0 2024-05-30T06:42:53.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.543+0000 7f4ce6000640 1 -- 172.21.15.37:0/3292096215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce015af50 con 0x7f4ce00cb1c0 2024-05-30T06:42:53.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.543+0000 7f4ce6000640 1 -- 172.21.15.37:0/3292096215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce0068b20 con 0x7f4ce00cb1c0 2024-05-30T06:42:53.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.543+0000 7f4cd7400640 1 -- 172.21.15.37:0/3292096215 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4cc8003800 con 0x7f4ce00cb1c0 2024-05-30T06:42:53.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.543+0000 7f4cd7400640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cbc068380 0x7f4cbc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.543+0000 7f4cd7400640 1 -- 172.21.15.37:0/3292096215 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f4cc8086760 con 0x7f4ce00cb1c0 2024-05-30T06:42:53.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.543+0000 7f4cdf400640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cbc068380 0x7f4cbc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.547+0000 7f4cdf400640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cbc068380 0x7f4cbc06a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0007da0 tx=0x7f4cd0000ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.547+0000 7f4cd7400640 1 -- 172.21.15.37:0/3292096215 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4cc8056c80 con 0x7f4ce00cb1c0 2024-05-30T06:42:53.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.715+0000 7f4ce6000640 1 -- 172.21.15.37:0/3292096215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ce0072fb0 con 0x7f4ce00cb1c0 2024-05-30T06:42:53.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.715+0000 7f4cd7400640 1 -- 172.21.15.37:0/3292096215 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16890 (secure 0 0 0) 0x7f4cc8056580 con 0x7f4ce00cb1c0 2024-05-30T06:42:53.715 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:53.715 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:51.837050+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.715+0000 7f4ce6000640 1 -- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cbc068380 msgr2=0x7f4cbc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.715+0000 7f4ce6000640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cbc068380 0x7f4cbc06a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0007da0 tx=0x7f4cd0000ee0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.715+0000 7f4ce6000640 1 -- 172.21.15.37:0/3292096215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce00cb1c0 msgr2=0x7f4ce0159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.715+0000 7f4ce6000640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce00cb1c0 0x7f4ce0159d60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800f540 tx=0x7f4cc800f940 comp rx=0 tx=0).stop 2024-05-30T06:42:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.719+0000 7f4ce6000640 1 -- 172.21.15.37:0/3292096215 shutdown_connections 2024-05-30T06:42:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.719+0000 7f4ce6000640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce015e0a0 0x7f4ce015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.719+0000 7f4ce6000640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce00cb1c0 0x7f4ce0159d60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.719+0000 7f4ce6000640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cbc068380 0x7f4cbc06a840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.719+0000 7f4ce6000640 1 --2- 172.21.15.37:0/3292096215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cc40051d0 0x7f4ce0152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.719+0000 7f4ce6000640 1 -- 172.21.15.37:0/3292096215 >> 172.21.15.37:0/3292096215 conn(0x7f4ce00b23a0 msgr2=0x7f4ce015ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.719+0000 7f4ce6000640 1 -- 172.21.15.37:0/3292096215 shutdown_connections 2024-05-30T06:42:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.719+0000 7f4ce6000640 1 -- 172.21.15.37:0/3292096215 wait complete. 2024-05-30T06:42:53.737 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T06:42:53.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:42:53.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.879+0000 7fc777a00640 1 Processor -- start 2024-05-30T06:42:53.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.879+0000 7fc777a00640 1 -- start start 2024-05-30T06:42:53.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.879+0000 7fc777a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc77015ed50 0x7fc7700c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.879+0000 7fc777a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7700d02b0 0x7fc7700d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.879+0000 7fc777a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7700c7f20 con 0x7fc7700d0c50 2024-05-30T06:42:53.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.879+0000 7fc777a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc7700c9500 con 0x7fc77015ed50 2024-05-30T06:42:53.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.879+0000 7fc777a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc77015f130 con 0x7fc7700d02b0 2024-05-30T06:42:53.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.879+0000 7fc775a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc7700d0c50 0x7fc7701627e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53912/0 (socket says 172.21.15.37:53912) 2024-05-30T06:42:53.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.879+0000 7fc775a00640 1 -- 172.21.15.37:0/1056296331 learned_addr learned my addr 172.21.15.37:0/1056296331 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:53.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.879+0000 7fc775000640 1 --2- 172.21.15.37:0/1056296331 >> v2:172.21.15.105:3300/0 conn(0x7fc77015ed50 0x7fc7700c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.879+0000 7fc767e00640 1 --2- 172.21.15.37:0/1056296331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7700d02b0 0x7fc7700d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.879+0000 7fc76fe00640 1 -- 172.21.15.37:0/1056296331 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2700656977 0 0) 0x7fc7700c7f20 con 0x7fc7700d0c50 2024-05-30T06:42:53.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc76fe00640 1 -- 172.21.15.37:0/1056296331 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc754003530 con 0x7fc7700d0c50 2024-05-30T06:42:53.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc775000640 1 -- 172.21.15.37:0/1056296331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7700d02b0 msgr2=0x7fc7700d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:53.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc775000640 1 --2- 172.21.15.37:0/1056296331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7700d02b0 0x7fc7700d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc775000640 1 -- 172.21.15.37:0/1056296331 >> v1:172.21.15.37:6789/0 conn(0x7fc7700d0c50 legacy=0x7fc7701627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc775000640 1 -- 172.21.15.37:0/1056296331 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7700c8200 con 0x7fc77015ed50 2024-05-30T06:42:53.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc775000640 1 --2- 172.21.15.37:0/1056296331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77015ed50 0x7fc7700c8fc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc7600097c0 tx=0x7fc76001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62b228343213e883 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc76fe00640 1 -- 172.21.15.37:0/1056296331 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7600a7070 con 0x7fc77015ed50 2024-05-30T06:42:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc76fe00640 1 -- 172.21.15.37:0/1056296331 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7600b0070 con 0x7fc77015ed50 2024-05-30T06:42:53.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc76fe00640 1 -- 172.21.15.37:0/1056296331 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7600ab890 con 0x7fc77015ed50 2024-05-30T06:42:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc777a00640 1 -- 172.21.15.37:0/1056296331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77015ed50 msgr2=0x7fc7700c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc777a00640 1 --2- 172.21.15.37:0/1056296331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77015ed50 0x7fc7700c8fc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc7600097c0 tx=0x7fc76001c470 comp rx=0 tx=0).stop 2024-05-30T06:42:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc777a00640 1 -- 172.21.15.37:0/1056296331 shutdown_connections 2024-05-30T06:42:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc777a00640 1 --2- 172.21.15.37:0/1056296331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7700d02b0 0x7fc7700d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc777a00640 1 --2- 172.21.15.37:0/1056296331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77015ed50 0x7fc7700c8fc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.883+0000 7fc777a00640 1 -- 172.21.15.37:0/1056296331 >> 172.21.15.37:0/1056296331 conn(0x7fc7700d26e0 msgr2=0x7fc7700d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc777a00640 1 -- 172.21.15.37:0/1056296331 shutdown_connections 2024-05-30T06:42:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc777a00640 1 -- 172.21.15.37:0/1056296331 wait complete. 2024-05-30T06:42:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc777a00640 1 Processor -- start 2024-05-30T06:42:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc777a00640 1 -- start start 2024-05-30T06:42:53.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc777a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7700d02b0 0x7fc770161df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc777a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7700d0c50 0x7fc77009e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc777a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77015ed50 0x7fc77009cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc777a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7700c7c50 con 0x7fc7700d02b0 2024-05-30T06:42:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc777a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc7700c7ad0 con 0x7fc77015ed50 2024-05-30T06:42:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc777a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc77016bb20 con 0x7fc7700d0c50 2024-05-30T06:42:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc775000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7700d02b0 0x7fc770161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc775000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7700d02b0 0x7fc770161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35218/0 (socket says 172.21.15.37:35218) 2024-05-30T06:42:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc775000640 1 -- 172.21.15.37:0/492738430 learned_addr learned my addr 172.21.15.37:0/492738430 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc767e00640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7700d0c50 0x7fc77009e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc775000640 1 -- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7700d0c50 msgr2=0x7fc77009e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc775000640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7700d0c50 0x7fc77009e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc775000640 1 -- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77015ed50 msgr2=0x7fc77009cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:53.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc775000640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77015ed50 0x7fc77009cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc775000640 1 -- 172.21.15.37:0/492738430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77009edc0 con 0x7fc7700d02b0 2024-05-30T06:42:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc767e00640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7700d0c50 0x7fc77009e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc775000640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7700d02b0 0x7fc770161df0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc7600ad040 tx=0x7fc76001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc76d600640 1 -- 172.21.15.37:0/492738430 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7600bf610 con 0x7fc7700d02b0 2024-05-30T06:42:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc76d600640 1 -- 172.21.15.37:0/492738430 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7600bf7f0 con 0x7fc7700d02b0 2024-05-30T06:42:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc777a00640 1 -- 172.21.15.37:0/492738430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77009f080 con 0x7fc7700d02b0 2024-05-30T06:42:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.887+0000 7fc76d600640 1 -- 172.21.15.37:0/492738430 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7600bfbe0 con 0x7fc7700d02b0 2024-05-30T06:42:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.891+0000 7fc777a00640 1 -- 172.21.15.37:0/492738430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc77009f640 con 0x7fc7700d02b0 2024-05-30T06:42:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.891+0000 7fc777a00640 1 -- 172.21.15.37:0/492738430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc770068b20 con 0x7fc7700d02b0 2024-05-30T06:42:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.891+0000 7fc76d600640 1 -- 172.21.15.37:0/492738430 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc7600bd020 con 0x7fc7700d02b0 2024-05-30T06:42:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.891+0000 7fc76d600640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc74c068380 0x7fc74c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.891+0000 7fc76d600640 1 -- 172.21.15.37:0/492738430 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fc7601210d0 con 0x7fc7700d02b0 2024-05-30T06:42:53.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.891+0000 7fc767e00640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc74c068380 0x7fc74c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.895+0000 7fc767e00640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc74c068380 0x7fc74c06a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc7700714a0 tx=0x7fc758008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:53.895+0000 7fc76d600640 1 -- 172.21.15.37:0/492738430 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc760016090 con 0x7fc7700d02b0 2024-05-30T06:42:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc777a00640 1 -- 172.21.15.37:0/492738430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7700d3420 con 0x7fc7700d02b0 2024-05-30T06:42:54.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc76d600640 1 -- 172.21.15.37:0/492738430 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fc7600f1560 con 0x7fc7700d02b0 2024-05-30T06:42:54.093 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:54.094 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2950341560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2950341560},{"type":"v1","addr":"172.21.15.37:6835","nonce":2950341560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/1458371524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1458371524},{"type":"v1","addr":"172.21.15.105:6836","nonce":1458371524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4088854019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4088854019},{"type":"v1","addr":"172.21.15.37:6833","nonce":4088854019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:42:10.805274+0000","modified":"2024-05-30T06:42:13.844990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2952122373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2952122373},{"type":"v1","addr":"172.21.15.105:6837","nonce":2952122373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-05-30T06:42:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-05-30T06:42:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc777a00640 1 -- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc74c068380 msgr2=0x7fc74c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc777a00640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc74c068380 0x7fc74c06a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc7700714a0 tx=0x7fc758008040 comp rx=0 tx=0).stop 2024-05-30T06:42:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc777a00640 1 -- 172.21.15.37:0/492738430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7700d02b0 msgr2=0x7fc770161df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc777a00640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7700d02b0 0x7fc770161df0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc7600ad040 tx=0x7fc76001acb0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc777a00640 1 -- 172.21.15.37:0/492738430 shutdown_connections 2024-05-30T06:42:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc777a00640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc74c068380 0x7fc74c06a840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc777a00640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77015ed50 0x7fc77009cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc777a00640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7700d0c50 0x7fc77009e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc777a00640 1 --2- 172.21.15.37:0/492738430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7700d02b0 0x7fc770161df0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc777a00640 1 -- 172.21.15.37:0/492738430 >> 172.21.15.37:0/492738430 conn(0x7fc7700d26e0 msgr2=0x7fc7700718b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:54.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc777a00640 1 -- 172.21.15.37:0/492738430 shutdown_connections 2024-05-30T06:42:54.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.095+0000 7fc777a00640 1 -- 172.21.15.37:0/492738430 wait complete. 2024-05-30T06:42:54.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:42:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdba4e00640 1 Processor -- start 2024-05-30T06:42:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdba4e00640 1 -- start start 2024-05-30T06:42:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdba4e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdba00b55a0 0x7fdba00b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdba4e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdba015fb30 0x7fdba00aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdba4e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba0162f70 con 0x7fdba006d080 2024-05-30T06:42:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdba4e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdba00b5ec0 con 0x7fdba015fb30 2024-05-30T06:42:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdba4e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdba0163210 con 0x7fdba00b55a0 2024-05-30T06:42:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdb9e800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdba015fb30 0x7fdba00aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdb9e800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdba015fb30 0x7fdba00aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35220/0 (socket says 172.21.15.37:35220) 2024-05-30T06:42:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdb9e800640 1 -- 172.21.15.37:0/3122907543 learned_addr learned my addr 172.21.15.37:0/3122907543 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdb9de00640 1 --2- 172.21.15.37:0/3122907543 >> v2:172.21.15.105:3300/0 conn(0x7fdba00b55a0 0x7fdba00b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdb9e800640 1 -- 172.21.15.37:0/3122907543 >> v2:172.21.15.105:3300/0 conn(0x7fdba00b55a0 msgr2=0x7fdba00b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdb9e800640 1 --2- 172.21.15.37:0/3122907543 >> v2:172.21.15.105:3300/0 conn(0x7fdba00b55a0 0x7fdba00b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdb9e800640 1 -- 172.21.15.37:0/3122907543 >> v1:172.21.15.105:6789/0 conn(0x7fdba006d080 legacy=0x7fdba00b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdb9e800640 1 -- 172.21.15.37:0/3122907543 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba00b4040 con 0x7fdba015fb30 2024-05-30T06:42:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.259+0000 7fdb9de00640 1 --2- 172.21.15.37:0/3122907543 >> v2:172.21.15.105:3300/0 conn(0x7fdba00b55a0 0x7fdba00b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.263+0000 7fdb9e800640 1 --2- 172.21.15.37:0/3122907543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba015fb30 0x7fdba00aedb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdba0050410 tx=0x7fdb9801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31bef3b518202bc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.263+0000 7fdb9ca00640 1 -- 172.21.15.37:0/3122907543 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb980a5700 con 0x7fdba015fb30 2024-05-30T06:42:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.263+0000 7fdb9ca00640 1 -- 172.21.15.37:0/3122907543 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb980a58a0 con 0x7fdba015fb30 2024-05-30T06:42:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.263+0000 7fdb9ca00640 1 -- 172.21.15.37:0/3122907543 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb980a5c70 con 0x7fdba015fb30 2024-05-30T06:42:54.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.263+0000 7fdba4e00640 1 -- 172.21.15.37:0/3122907543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba015fb30 msgr2=0x7fdba00aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.263+0000 7fdba4e00640 1 --2- 172.21.15.37:0/3122907543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba015fb30 0x7fdba00aedb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdba0050410 tx=0x7fdb9801c930 comp rx=0 tx=0).stop 2024-05-30T06:42:54.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.263+0000 7fdba4e00640 1 -- 172.21.15.37:0/3122907543 shutdown_connections 2024-05-30T06:42:54.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.263+0000 7fdba4e00640 1 --2- 172.21.15.37:0/3122907543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba015fb30 0x7fdba00aedb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.263+0000 7fdba4e00640 1 --2- 172.21.15.37:0/3122907543 >> v2:172.21.15.105:3300/0 conn(0x7fdba00b55a0 0x7fdba00b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.263+0000 7fdba4e00640 1 -- 172.21.15.37:0/3122907543 >> 172.21.15.37:0/3122907543 conn(0x7fdba0073680 msgr2=0x7fdba006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:54.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.263+0000 7fdba4e00640 1 -- 172.21.15.37:0/3122907543 shutdown_connections 2024-05-30T06:42:54.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.263+0000 7fdba4e00640 1 -- 172.21.15.37:0/3122907543 wait complete. 2024-05-30T06:42:54.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.263+0000 7fdba4e00640 1 Processor -- start 2024-05-30T06:42:54.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdba4e00640 1 -- start start 2024-05-30T06:42:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdba4e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdba006d080 0x7fdba01657f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdba4e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdba00b55a0 0x7fdba01fb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdba4e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba015fb30 0x7fdba01fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdba4e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdba00b07c0 con 0x7fdba015fb30 2024-05-30T06:42:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdba4e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdba00b0640 con 0x7fdba00b55a0 2024-05-30T06:42:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdba4e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdba016be60 con 0x7fdba006d080 2024-05-30T06:42:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb9e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba015fb30 0x7fdba01fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb9e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba015fb30 0x7fdba01fb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35234/0 (socket says 172.21.15.37:35234) 2024-05-30T06:42:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb9e800640 1 -- 172.21.15.37:0/4181147692 learned_addr learned my addr 172.21.15.37:0/4181147692 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb9d400640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdba00b55a0 0x7fdba01fb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb9de00640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdba006d080 0x7fdba01657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb9e800640 1 -- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdba006d080 msgr2=0x7fdba01657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb9e800640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdba006d080 0x7fdba01657f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb9e800640 1 -- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdba00b55a0 msgr2=0x7fdba01fb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb9e800640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdba00b55a0 0x7fdba01fb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb9e800640 1 -- 172.21.15.37:0/4181147692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba0163f90 con 0x7fdba015fb30 2024-05-30T06:42:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb9d400640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdba00b55a0 0x7fdba01fb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb9de00640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdba006d080 0x7fdba01657f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb9e800640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba015fb30 0x7fdba01fb6c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdb980af040 tx=0x7fdb980196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb96000640 1 -- 172.21.15.37:0/4181147692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb980bc020 con 0x7fdba015fb30 2024-05-30T06:42:54.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb96000640 1 -- 172.21.15.37:0/4181147692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb980b8690 con 0x7fdba015fb30 2024-05-30T06:42:54.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdb96000640 1 -- 172.21.15.37:0/4181147692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb980b8a80 con 0x7fdba015fb30 2024-05-30T06:42:54.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdba4e00640 1 -- 172.21.15.37:0/4181147692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba0164270 con 0x7fdba015fb30 2024-05-30T06:42:54.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdba4e00640 1 -- 172.21.15.37:0/4181147692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba0164830 con 0x7fdba015fb30 2024-05-30T06:42:54.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.267+0000 7fdba4e00640 1 -- 172.21.15.37:0/4181147692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba0068b20 con 0x7fdba015fb30 2024-05-30T06:42:54.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.271+0000 7fdb96000640 1 -- 172.21.15.37:0/4181147692 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdb980bf020 con 0x7fdba015fb30 2024-05-30T06:42:54.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.271+0000 7fdb96000640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb80068380 0x7fdb8006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.271+0000 7fdb96000640 1 -- 172.21.15.37:0/4181147692 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7fdb98121ab0 con 0x7fdba015fb30 2024-05-30T06:42:54.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.271+0000 7fdb9de00640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb80068380 0x7fdb8006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.271+0000 7fdb9de00640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb80068380 0x7fdb8006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdba0073ab0 tx=0x7fdb90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:54.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.275+0000 7fdb96000640 1 -- 172.21.15.37:0/4181147692 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdb980c6030 con 0x7fdba015fb30 2024-05-30T06:42:54.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.471+0000 7fdba4e00640 1 -- 172.21.15.37:0/4181147692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdba015e350 con 0x7fdba015fb30 2024-05-30T06:42:54.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.471+0000 7fdb96000640 1 -- 172.21.15.37:0/4181147692 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fdb980165e0 con 0x7fdba015fb30 2024-05-30T06:42:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:54.472 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2950341560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2950341560},{"type":"v1","addr":"172.21.15.37:6835","nonce":2950341560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/1458371524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1458371524},{"type":"v1","addr":"172.21.15.105:6836","nonce":1458371524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/4088854019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4088854019},{"type":"v1","addr":"172.21.15.37:6833","nonce":4088854019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:42:10.805274+0000","modified":"2024-05-30T06:42:13.844990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2952122373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2952122373},{"type":"v1","addr":"172.21.15.105:6837","nonce":2952122373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-05-30T06:42:54.473 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-05-30T06:42:54.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.475+0000 7fdba4e00640 1 -- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb80068380 msgr2=0x7fdb8006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.475+0000 7fdba4e00640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb80068380 0x7fdb8006a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdba0073ab0 tx=0x7fdb90008040 comp rx=0 tx=0).stop 2024-05-30T06:42:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.475+0000 7fdba4e00640 1 -- 172.21.15.37:0/4181147692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba015fb30 msgr2=0x7fdba01fb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.475+0000 7fdba4e00640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba015fb30 0x7fdba01fb6c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdb980af040 tx=0x7fdb980196d0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.475+0000 7fdba4e00640 1 -- 172.21.15.37:0/4181147692 shutdown_connections 2024-05-30T06:42:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.475+0000 7fdba4e00640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba015fb30 0x7fdba01fb6c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.475+0000 7fdba4e00640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb80068380 0x7fdb8006a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.475+0000 7fdba4e00640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdba00b55a0 0x7fdba01fb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.475+0000 7fdba4e00640 1 --2- 172.21.15.37:0/4181147692 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdba006d080 0x7fdba01657f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.475+0000 7fdba4e00640 1 -- 172.21.15.37:0/4181147692 >> 172.21.15.37:0/4181147692 conn(0x7fdba0073680 msgr2=0x7fdba0162080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.475+0000 7fdba4e00640 1 -- 172.21.15.37:0/4181147692 shutdown_connections 2024-05-30T06:42:54.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.475+0000 7fdba4e00640 1 -- 172.21.15.37:0/4181147692 wait complete. 2024-05-30T06:42:54.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:42:54.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.635+0000 7f6758200640 1 Processor -- start 2024-05-30T06:42:54.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.635+0000 7f6758200640 1 -- start start 2024-05-30T06:42:54.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.635+0000 7f6758200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67500ce8d0 0x7f67500ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.635+0000 7f6758200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67500cd120 con 0x7f675006e000 2024-05-30T06:42:54.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.635+0000 7f6758200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67500cd400 con 0x7f675015cd80 2024-05-30T06:42:54.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.635+0000 7f6758200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f67500a9530 con 0x7f67500ce8d0 2024-05-30T06:42:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.635+0000 7f6755800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f675006e000 0x7f67500ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53926/0 (socket says 172.21.15.37:53926) 2024-05-30T06:42:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.635+0000 7f6755800640 1 -- 172.21.15.37:0/2135112621 learned_addr learned my addr 172.21.15.37:0/2135112621 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.639+0000 7f6756200640 1 --2- 172.21.15.37:0/2135112621 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67500ce8d0 0x7f67500ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.639+0000 7f674fe00640 1 -- 172.21.15.37:0/2135112621 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505705039 0 0) 0x7f67500cd120 con 0x7f675006e000 2024-05-30T06:42:54.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.639+0000 7f674fe00640 1 -- 172.21.15.37:0/2135112621 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6738003530 con 0x7f675006e000 2024-05-30T06:42:54.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.639+0000 7f674fe00640 1 -- 172.21.15.37:0/2135112621 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333497590 0 0) 0x7f67500cd400 con 0x7f675015cd80 2024-05-30T06:42:54.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.639+0000 7f674fe00640 1 -- 172.21.15.37:0/2135112621 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67500cd120 con 0x7f675015cd80 2024-05-30T06:42:54.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.639+0000 7f6756200640 1 -- 172.21.15.37:0/2135112621 >> v1:172.21.15.105:6789/0 conn(0x7f675015cd80 legacy=0x7f675006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.639+0000 7f6756200640 1 -- 172.21.15.37:0/2135112621 >> v1:172.21.15.37:6789/0 conn(0x7f675006e000 legacy=0x7f67500ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.639+0000 7f6756200640 1 -- 172.21.15.37:0/2135112621 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67500cd6e0 con 0x7f67500ce8d0 2024-05-30T06:42:54.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.639+0000 7f6756200640 1 --2- 172.21.15.37:0/2135112621 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67500ce8d0 0x7f67500ced60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6748009dc0 tx=0x7f674801f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f633fba1c4ce7182 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:54.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.639+0000 7f674fe00640 1 -- 172.21.15.37:0/2135112621 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67480b4070 con 0x7f67500ce8d0 2024-05-30T06:42:54.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.639+0000 7f674fe00640 1 -- 172.21.15.37:0/2135112621 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67480af600 con 0x7f67500ce8d0 2024-05-30T06:42:54.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.639+0000 7f674fe00640 1 -- 172.21.15.37:0/2135112621 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67480af9b0 con 0x7f67500ce8d0 2024-05-30T06:42:54.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 -- 172.21.15.37:0/2135112621 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67500ce8d0 msgr2=0x7f67500ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 --2- 172.21.15.37:0/2135112621 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67500ce8d0 0x7f67500ced60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6748009dc0 tx=0x7f674801f170 comp rx=0 tx=0).stop 2024-05-30T06:42:54.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 -- 172.21.15.37:0/2135112621 shutdown_connections 2024-05-30T06:42:54.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 --2- 172.21.15.37:0/2135112621 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67500ce8d0 0x7f67500ced60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 -- 172.21.15.37:0/2135112621 >> 172.21.15.37:0/2135112621 conn(0x7f67500b23a0 msgr2=0x7f67500b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:54.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 -- 172.21.15.37:0/2135112621 shutdown_connections 2024-05-30T06:42:54.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 -- 172.21.15.37:0/2135112621 wait complete. 2024-05-30T06:42:54.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 Processor -- start 2024-05-30T06:42:54.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 -- start start 2024-05-30T06:42:54.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f675006e000 0x7f6750139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67500ce8d0 0x7f67501592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f675015cd80 0x7f6750159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f67501673d0 con 0x7f675006e000 2024-05-30T06:42:54.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f67500cdca0 con 0x7f675015cd80 2024-05-30T06:42:54.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6758200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6750167550 con 0x7f67500ce8d0 2024-05-30T06:42:54.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6755800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f675006e000 0x7f6750139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6755800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f675006e000 0x7f6750139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35242/0 (socket says 172.21.15.37:35242) 2024-05-30T06:42:54.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6755800640 1 -- 172.21.15.37:0/1340351099 learned_addr learned my addr 172.21.15.37:0/1340351099 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:54.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6755800640 1 -- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67500ce8d0 msgr2=0x7f67501592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6755800640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67500ce8d0 0x7f67501592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6755800640 1 -- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f675015cd80 msgr2=0x7f6750159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6756200640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f675015cd80 0x7f6750159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6755800640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f675015cd80 0x7f6750159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.643+0000 7f6755800640 1 -- 172.21.15.37:0/1340351099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675013f420 con 0x7f675006e000 2024-05-30T06:42:54.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.647+0000 7f6756200640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f675015cd80 0x7f6750159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:54.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.647+0000 7f6755800640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f675006e000 0x7f6750139330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f674400c4d0 tx=0x7f674400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:54.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.647+0000 7f674d600640 1 -- 172.21.15.37:0/1340351099 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6744017070 con 0x7f675006e000 2024-05-30T06:42:54.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.647+0000 7f674d600640 1 -- 172.21.15.37:0/1340351099 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6744005cf0 con 0x7f675006e000 2024-05-30T06:42:54.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.647+0000 7f674d600640 1 -- 172.21.15.37:0/1340351099 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6744007270 con 0x7f675006e000 2024-05-30T06:42:54.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.647+0000 7f6758200640 1 -- 172.21.15.37:0/1340351099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f675013f700 con 0x7f675006e000 2024-05-30T06:42:54.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.647+0000 7f6758200640 1 -- 172.21.15.37:0/1340351099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6750139d90 con 0x7f675006e000 2024-05-30T06:42:54.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.647+0000 7f6758200640 1 -- 172.21.15.37:0/1340351099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6750068b20 con 0x7f675006e000 2024-05-30T06:42:54.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.647+0000 7f674d600640 1 -- 172.21.15.37:0/1340351099 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f674401a070 con 0x7f675006e000 2024-05-30T06:42:54.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.647+0000 7f674d600640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f67300683b0 0x7f673006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.647+0000 7f674d600640 1 -- 172.21.15.37:0/1340351099 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f6744085cf0 con 0x7f675006e000 2024-05-30T06:42:54.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.651+0000 7f6754e00640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f67300683b0 0x7f673006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.651+0000 7f6754e00640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f67300683b0 0x7f673006a870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f673c007fd0 tx=0x7f673c007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:54.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.651+0000 7f674d600640 1 -- 172.21.15.37:0/1340351099 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6744055bc0 con 0x7f675006e000 2024-05-30T06:42:54.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.819+0000 7f6758200640 1 -- 172.21.15.37:0/1340351099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6750143450 con 0x7f675006e000 2024-05-30T06:42:54.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.819+0000 7f674d600640 1 -- 172.21.15.37:0/1340351099 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16890 (secure 0 0 0) 0x7f6744059ec0 con 0x7f675006e000 2024-05-30T06:42:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:54.819 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:51.837050+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:42:09.128133+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-30T06:42:09.755772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:42:54.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.823+0000 7f6758200640 1 -- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f67300683b0 msgr2=0x7f673006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.823+0000 7f6758200640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f67300683b0 0x7f673006a870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f673c007fd0 tx=0x7f673c007900 comp rx=0 tx=0).stop 2024-05-30T06:42:54.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.823+0000 7f6758200640 1 -- 172.21.15.37:0/1340351099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f675006e000 msgr2=0x7f6750139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.823+0000 7f6758200640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f675006e000 0x7f6750139330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f674400c4d0 tx=0x7f674400c990 comp rx=0 tx=0).stop 2024-05-30T06:42:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.823+0000 7f6758200640 1 -- 172.21.15.37:0/1340351099 shutdown_connections 2024-05-30T06:42:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.823+0000 7f6758200640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f67300683b0 0x7f673006a870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.823+0000 7f6758200640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f675015cd80 0x7f6750159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.823+0000 7f6758200640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f67500ce8d0 0x7f67501592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.823+0000 7f6758200640 1 --2- 172.21.15.37:0/1340351099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f675006e000 0x7f6750139330 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.823+0000 7f6758200640 1 -- 172.21.15.37:0/1340351099 >> 172.21.15.37:0/1340351099 conn(0x7f67500b23a0 msgr2=0x7f6750143880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.823+0000 7f6758200640 1 -- 172.21.15.37:0/1340351099 shutdown_connections 2024-05-30T06:42:54.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.823+0000 7f6758200640 1 -- 172.21.15.37:0/1340351099 wait complete. 2024-05-30T06:42:54.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T06:42:54.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.983+0000 7f2d04a00640 1 Processor -- start 2024-05-30T06:42:54.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.983+0000 7f2d04a00640 1 -- start start 2024-05-30T06:42:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2d04a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2d0015c890 0x7f2d00162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2d04a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d00163020 con 0x7f2d00072e60 2024-05-30T06:42:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2d04a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d00163300 con 0x7f2d0015f210 2024-05-30T06:42:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2d04a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2d001635e0 con 0x7f2d0015c890 2024-05-30T06:42:54.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfe800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2d00072e60 0x7f2d0006c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53930/0 (socket says 172.21.15.37:53930) 2024-05-30T06:42:54.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfe800640 1 -- 172.21.15.37:0/4174837612 learned_addr learned my addr 172.21.15.37:0/4174837612 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:54.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfde00640 1 --2- 172.21.15.37:0/4174837612 >> v2:172.21.15.105:3300/0 conn(0x7f2d0015c890 0x7f2d00162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512298538 0 0) 0x7f2d00163020 con 0x7f2d00072e60 2024-05-30T06:42:54.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ce4003530 con 0x7f2d00072e60 2024-05-30T06:42:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1991951414 0 0) 0x7f2d00163300 con 0x7f2d0015f210 2024-05-30T06:42:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d00163020 con 0x7f2d0015f210 2024-05-30T06:42:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2889045256 0 0) 0x7f2ce4003530 con 0x7f2d00072e60 2024-05-30T06:42:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 >> v2:172.21.15.105:3300/0 conn(0x7f2d0015c890 msgr2=0x7f2d00162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 --2- 172.21.15.37:0/4174837612 >> v2:172.21.15.105:3300/0 conn(0x7f2d0015c890 0x7f2d00162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 >> v1:172.21.15.105:6789/0 conn(0x7f2d0015f210 legacy=0x7f2d00072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0006ba00 con 0x7f2d00072e60 2024-05-30T06:42:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f2cf8001680 con 0x7f2d00072e60 2024-05-30T06:42:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 >> v1:172.21.15.37:6789/0 conn(0x7f2d00072e60 legacy=0x7f2d0006c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 --2- 172.21.15.37:0/4174837612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4003b50 0x7f2ce4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 --2- 172.21.15.37:0/4174837612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ce4004810 0x7f2ce4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 --2- 172.21.15.37:0/4174837612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ce40051d0 0x7f2ce400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d001635e0 con 0x7f2ce4003b50 2024-05-30T06:42:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce400c100 con 0x7f2ce4004810 2024-05-30T06:42:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce400c300 con 0x7f2ce40051d0 2024-05-30T06:42:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfde00640 1 --2- 172.21.15.37:0/4174837612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4003b50 0x7f2ce4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cf5400640 1 --2- 172.21.15.37:0/4174837612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ce4004810 0x7f2ce4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfe800640 1 --2- 172.21.15.37:0/4174837612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ce40051d0 0x7f2ce400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfde00640 1 -- 172.21.15.37:0/4174837612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ce40051d0 msgr2=0x7f2ce400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfde00640 1 --2- 172.21.15.37:0/4174837612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ce40051d0 0x7f2ce400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfde00640 1 -- 172.21.15.37:0/4174837612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ce4004810 msgr2=0x7f2ce4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfde00640 1 --2- 172.21.15.37:0/4174837612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ce4004810 0x7f2ce4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfde00640 1 -- 172.21.15.37:0/4174837612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce4003530 con 0x7f2ce4003b50 2024-05-30T06:42:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.987+0000 7f2cfe800640 1 -- 172.21.15.37:0/4174837612 reap_dead start 2024-05-30T06:42:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.991+0000 7f2cfde00640 1 --2- 172.21.15.37:0/4174837612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4003b50 0x7f2ce4003f50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0009fc0 tx=0x7f2cf001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbff5af88399b4a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.991+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00b2070 con 0x7f2ce4003b50 2024-05-30T06:42:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.991+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf00a5b80 con 0x7f2ce4003b50 2024-05-30T06:42:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.991+0000 7f2cfd400640 1 -- 172.21.15.37:0/4174837612 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0009c10 con 0x7f2ce4003b50 2024-05-30T06:42:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.991+0000 7f2d04a00640 1 -- 172.21.15.37:0/4174837612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4003b50 msgr2=0x7f2ce4003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.991+0000 7f2d04a00640 1 --2- 172.21.15.37:0/4174837612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4003b50 0x7f2ce4003f50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0009fc0 tx=0x7f2cf001cc80 comp rx=0 tx=0).stop 2024-05-30T06:42:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.991+0000 7f2d04a00640 1 -- 172.21.15.37:0/4174837612 shutdown_connections 2024-05-30T06:42:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.991+0000 7f2d04a00640 1 --2- 172.21.15.37:0/4174837612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce4003b50 0x7f2ce4003f50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.991+0000 7f2d04a00640 1 -- 172.21.15.37:0/4174837612 >> 172.21.15.37:0/4174837612 conn(0x7f2d000b2ac0 msgr2=0x7f2d000b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.991+0000 7f2d04a00640 1 -- 172.21.15.37:0/4174837612 shutdown_connections 2024-05-30T06:42:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.991+0000 7f2d04a00640 1 -- 172.21.15.37:0/4174837612 wait complete. 2024-05-30T06:42:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.991+0000 7f2d04a00640 1 Processor -- start 2024-05-30T06:42:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2d04a00640 1 -- start start 2024-05-30T06:42:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2d04a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ce4003b50 0x7f2d0014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2d04a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d001ed390 0x7f2d001ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2d04a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d00160050 0x7f2d001604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2d04a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0006c590 con 0x7f2d00160050 2024-05-30T06:42:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2d04a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0006c410 con 0x7f2d001ed390 2024-05-30T06:42:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2d04a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0006c710 con 0x7f2ce4003b50 2024-05-30T06:42:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cfe800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d00160050 0x7f2d001604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cfde00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ce4003b50 0x7f2d0014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cfe800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d00160050 0x7f2d001604d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35262/0 (socket says 172.21.15.37:35262) 2024-05-30T06:42:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cfe800640 1 -- 172.21.15.37:0/3643959702 learned_addr learned my addr 172.21.15.37:0/3643959702 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cf5400640 1 --2- 172.21.15.37:0/3643959702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d001ed390 0x7f2d001ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cfe800640 1 -- 172.21.15.37:0/3643959702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ce4003b50 msgr2=0x7f2d0014e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cfe800640 1 --2- 172.21.15.37:0/3643959702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ce4003b50 0x7f2d0014e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cfe800640 1 -- 172.21.15.37:0/3643959702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d001ed390 msgr2=0x7f2d001ed810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cfe800640 1 --2- 172.21.15.37:0/3643959702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d001ed390 0x7f2d001ed810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cfe800640 1 -- 172.21.15.37:0/3643959702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d00160d10 con 0x7f2d00160050 2024-05-30T06:42:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cfe800640 1 --2- 172.21.15.37:0/3643959702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d00160050 0x7f2d001604d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2d000b09e0 tx=0x7f2cf8007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cf6a00640 1 -- 172.21.15.37:0/3643959702 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf801a070 con 0x7f2d00160050 2024-05-30T06:42:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cf6a00640 1 -- 172.21.15.37:0/3643959702 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf800f700 con 0x7f2d00160050 2024-05-30T06:42:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2d04a00640 1 -- 172.21.15.37:0/3643959702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d001eae80 con 0x7f2d00160050 2024-05-30T06:42:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2cf6a00640 1 -- 172.21.15.37:0/3643959702 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800fad0 con 0x7f2d00160050 2024-05-30T06:42:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2d04a00640 1 -- 172.21.15.37:0/3643959702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d00160a10 con 0x7f2d00160050 2024-05-30T06:42:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.995+0000 7f2d04a00640 1 -- 172.21.15.37:0/3643959702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d00068bc0 con 0x7f2d00160050 2024-05-30T06:42:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.999+0000 7f2cf6a00640 1 -- 172.21.15.37:0/3643959702 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2cf801d070 con 0x7f2d00160050 2024-05-30T06:42:54.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.999+0000 7f2cf6a00640 1 --2- 172.21.15.37:0/3643959702 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2cdc068380 0x7f2cdc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:54.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.999+0000 7f2cf6a00640 1 -- 172.21.15.37:0/3643959702 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5854+0+0 (secure 0 0 0) 0x7f2cf8085f50 con 0x7f2d00160050 2024-05-30T06:42:54.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.999+0000 7f2cfde00640 1 --2- 172.21.15.37:0/3643959702 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2cdc068380 0x7f2cdc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:54.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:54.999+0000 7f2cfde00640 1 --2- 172.21.15.37:0/3643959702 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2cdc068380 0x7f2cdc06a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00af000 tx=0x7f2cf0004ac0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.003+0000 7f2cf6a00640 1 -- 172.21.15.37:0/3643959702 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2cf8055ec0 con 0x7f2d00160050 2024-05-30T06:42:55.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.207+0000 7f2d04a00640 1 -- 172.21.15.37:0/3643959702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2d000b5bc0 con 0x7f2d00160050 2024-05-30T06:42:55.207 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-30T06:42:55.207+0000 7fd1bb400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T06:42:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.211+0000 7f2cf6a00640 1 -- 172.21.15.37:0/3643959702 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f2cf805a1c0 con 0x7f2d00160050 2024-05-30T06:42:55.209 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T06:42:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.211+0000 7f2d04a00640 1 -- 172.21.15.37:0/3643959702 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2cdc068380 msgr2=0x7f2cdc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:55.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.211+0000 7f2d04a00640 1 --2- 172.21.15.37:0/3643959702 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2cdc068380 0x7f2cdc06a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00af000 tx=0x7f2cf0004ac0 comp rx=0 tx=0).stop 2024-05-30T06:42:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.211+0000 7f2d04a00640 1 -- 172.21.15.37:0/3643959702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d00160050 msgr2=0x7f2d001604d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.211+0000 7f2d04a00640 1 --2- 172.21.15.37:0/3643959702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d00160050 0x7f2d001604d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2d000b09e0 tx=0x7f2cf8007430 comp rx=0 tx=0).stop 2024-05-30T06:42:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.211+0000 7f2d04a00640 1 -- 172.21.15.37:0/3643959702 shutdown_connections 2024-05-30T06:42:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.211+0000 7f2d04a00640 1 --2- 172.21.15.37:0/3643959702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d00160050 0x7f2d001604d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.211+0000 7f2d04a00640 1 --2- 172.21.15.37:0/3643959702 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2cdc068380 0x7f2cdc06a840 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00af000 tx=0x7f2cf0004ac0 comp rx=0 tx=0).stop 2024-05-30T06:42:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.211+0000 7f2d04a00640 1 --2- 172.21.15.37:0/3643959702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d001ed390 0x7f2d001ed810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.211+0000 7f2d04a00640 1 --2- 172.21.15.37:0/3643959702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ce4003b50 0x7f2d0014e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:55.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.211+0000 7f2d04a00640 1 -- 172.21.15.37:0/3643959702 >> 172.21.15.37:0/3643959702 conn(0x7f2d000b2ac0 msgr2=0x7f2d000b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.211+0000 7f2d04a00640 1 -- 172.21.15.37:0/3643959702 shutdown_connections 2024-05-30T06:42:55.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.211+0000 7f2d04a00640 1 -- 172.21.15.37:0/3643959702 wait complete. 2024-05-30T06:42:55.225 INFO:tasks.ceph.mds.b.smithi105.stderr: -7617> 2024-05-30T06:42:15.375+0000 7f8ed6800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T06:42:55.233 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T06:42:55.278 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-05-30T06:42:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff73ec00640 1 Processor -- start 2024-05-30T06:42:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff73ec00640 1 -- start start 2024-05-30T06:42:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff73ec00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff7380d03c0 0x7ff73809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff73ec00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7380b14b0 0x7ff73809afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff73ec00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff73809bb80 con 0x7ff73815c870 2024-05-30T06:42:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff73ec00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff7380cd110 con 0x7ff7380b14b0 2024-05-30T06:42:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff73ec00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff73809be60 con 0x7ff7380d03c0 2024-05-30T06:42:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff737e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff73815c870 0x7ff7380cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53932/0 (socket says 172.21.15.37:53932) 2024-05-30T06:42:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff737e00640 1 -- 172.21.15.37:0/1400749512 learned_addr learned my addr 172.21.15.37:0/1400749512 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff73cc00640 1 --2- 172.21.15.37:0/1400749512 >> v2:172.21.15.37:3300/0 conn(0x7ff7380b14b0 0x7ff73809afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff72f400640 1 --2- 172.21.15.37:0/1400749512 >> v2:172.21.15.105:3300/0 conn(0x7ff7380d03c0 0x7ff73809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff73cc00640 1 -- 172.21.15.37:0/1400749512 >> v2:172.21.15.105:3300/0 conn(0x7ff7380d03c0 msgr2=0x7ff73809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:55.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff73cc00640 1 --2- 172.21.15.37:0/1400749512 >> v2:172.21.15.105:3300/0 conn(0x7ff7380d03c0 0x7ff73809aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:55.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff73cc00640 1 -- 172.21.15.37:0/1400749512 >> v1:172.21.15.37:6789/0 conn(0x7ff73815c870 legacy=0x7ff7380cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:55.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.379+0000 7ff73cc00640 1 -- 172.21.15.37:0/1400749512 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7380cd340 con 0x7ff7380b14b0 2024-05-30T06:42:55.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.383+0000 7ff73cc00640 1 --2- 172.21.15.37:0/1400749512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7380b14b0 0x7ff73809afa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff7380b8620 tx=0x7ff73001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bed5177e34f21f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:55.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.383+0000 7ff737400640 1 -- 172.21.15.37:0/1400749512 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7300b2070 con 0x7ff7380b14b0 2024-05-30T06:42:55.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.383+0000 7ff737400640 1 -- 172.21.15.37:0/1400749512 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7300a57f0 con 0x7ff7380b14b0 2024-05-30T06:42:55.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.383+0000 7ff737400640 1 -- 172.21.15.37:0/1400749512 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7300a5bc0 con 0x7ff7380b14b0 2024-05-30T06:42:55.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.383+0000 7ff73ec00640 1 -- 172.21.15.37:0/1400749512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7380b14b0 msgr2=0x7ff73809afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:55.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.383+0000 7ff73ec00640 1 --2- 172.21.15.37:0/1400749512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7380b14b0 0x7ff73809afa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff7380b8620 tx=0x7ff73001c930 comp rx=0 tx=0).stop 2024-05-30T06:42:55.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.383+0000 7ff73ec00640 1 -- 172.21.15.37:0/1400749512 shutdown_connections 2024-05-30T06:42:55.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.383+0000 7ff73ec00640 1 --2- 172.21.15.37:0/1400749512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7380b14b0 0x7ff73809afa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:55.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.383+0000 7ff73ec00640 1 --2- 172.21.15.37:0/1400749512 >> v2:172.21.15.105:3300/0 conn(0x7ff7380d03c0 0x7ff73809aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:55.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.383+0000 7ff73ec00640 1 -- 172.21.15.37:0/1400749512 >> 172.21.15.37:0/1400749512 conn(0x7ff7380b4060 msgr2=0x7ff7380b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:55.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.383+0000 7ff73ec00640 1 -- 172.21.15.37:0/1400749512 shutdown_connections 2024-05-30T06:42:55.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.383+0000 7ff73ec00640 1 -- 172.21.15.37:0/1400749512 wait complete. 2024-05-30T06:42:55.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff73ec00640 1 Processor -- start 2024-05-30T06:42:55.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff73ec00640 1 -- start start 2024-05-30T06:42:55.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff73ec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7380b14b0 0x7ff73815f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:55.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff73ec00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7380d03c0 0x7ff73815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:55.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff73ec00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff73815c870 0x7ff7380c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:55.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff73ec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff738169800 con 0x7ff7380b14b0 2024-05-30T06:42:55.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff73ec00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff7380ce530 con 0x7ff7380d03c0 2024-05-30T06:42:55.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff73ec00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff738169980 con 0x7ff73815c870 2024-05-30T06:42:55.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff737e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7380b14b0 0x7ff73815f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:55.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff737e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7380b14b0 0x7ff73815f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35274/0 (socket says 172.21.15.37:35274) 2024-05-30T06:42:55.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff737e00640 1 -- 172.21.15.37:0/134173923 learned_addr learned my addr 172.21.15.37:0/134173923 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:55.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff72f400640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7380d03c0 0x7ff73815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:55.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff73cc00640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff73815c870 0x7ff7380c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:55.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff737e00640 1 -- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff73815c870 msgr2=0x7ff7380c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:55.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff737e00640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff73815c870 0x7ff7380c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:55.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff737e00640 1 -- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7380d03c0 msgr2=0x7ff73815f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:55.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff737e00640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7380d03c0 0x7ff73815f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:55.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff737e00640 1 -- 172.21.15.37:0/134173923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73815ee90 con 0x7ff7380b14b0 2024-05-30T06:42:55.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff73cc00640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff73815c870 0x7ff7380c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:42:55.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff737e00640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7380b14b0 0x7ff73815f080 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff72800c420 tx=0x7ff72800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:55.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff734c00640 1 -- 172.21.15.37:0/134173923 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff728017070 con 0x7ff7380b14b0 2024-05-30T06:42:55.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff734c00640 1 -- 172.21.15.37:0/134173923 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff728005cf0 con 0x7ff7380b14b0 2024-05-30T06:42:55.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff734c00640 1 -- 172.21.15.37:0/134173923 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7280072f0 con 0x7ff7380b14b0 2024-05-30T06:42:55.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff73ec00640 1 -- 172.21.15.37:0/134173923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff73815d680 con 0x7ff7380b14b0 2024-05-30T06:42:55.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff73ec00640 1 -- 172.21.15.37:0/134173923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff73815dc40 con 0x7ff7380b14b0 2024-05-30T06:42:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.387+0000 7ff73ec00640 1 -- 172.21.15.37:0/134173923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff738068bc0 con 0x7ff7380b14b0 2024-05-30T06:42:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.391+0000 7ff734c00640 1 -- 172.21.15.37:0/134173923 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff72801a070 con 0x7ff7380b14b0 2024-05-30T06:42:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.391+0000 7ff734c00640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff714068380 0x7ff71406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.391+0000 7ff734c00640 1 -- 172.21.15.37:0/134173923 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5940+0+0 (secure 0 0 0) 0x7ff728085ee0 con 0x7ff7380b14b0 2024-05-30T06:42:55.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.391+0000 7ff72f400640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff714068380 0x7ff71406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:55.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.391+0000 7ff72f400640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff714068380 0x7ff71406a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff73809b450 tx=0x7ff720008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:55.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.395+0000 7ff734c00640 1 -- 172.21.15.37:0/134173923 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff728056310 con 0x7ff7380b14b0 2024-05-30T06:42:55.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:55.595+0000 7ff73ec00640 1 -- 172.21.15.37:0/134173923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff7380cedd0 con 0x7ff7380b14b0 2024-05-30T06:42:56.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.211+0000 7ff734c00640 1 -- 172.21.15.37:0/134173923 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7ff728055c10 con 0x7ff7380b14b0 2024-05-30T06:42:56.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.215+0000 7ff73ec00640 1 -- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff714068380 msgr2=0x7ff71406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:56.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.215+0000 7ff73ec00640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff714068380 0x7ff71406a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff73809b450 tx=0x7ff720008040 comp rx=0 tx=0).stop 2024-05-30T06:42:56.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.215+0000 7ff73ec00640 1 -- 172.21.15.37:0/134173923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7380b14b0 msgr2=0x7ff73815f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:56.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.215+0000 7ff73ec00640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7380b14b0 0x7ff73815f080 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff72800c420 tx=0x7ff72800c8e0 comp rx=0 tx=0).stop 2024-05-30T06:42:56.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.215+0000 7ff73ec00640 1 -- 172.21.15.37:0/134173923 shutdown_connections 2024-05-30T06:42:56.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.215+0000 7ff73ec00640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff73815c870 0x7ff7380c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:56.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.215+0000 7ff73ec00640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff714068380 0x7ff71406a840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:56.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.215+0000 7ff73ec00640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7380d03c0 0x7ff73815f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:56.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.215+0000 7ff73ec00640 1 --2- 172.21.15.37:0/134173923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7380b14b0 0x7ff73815f080 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:56.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.215+0000 7ff73ec00640 1 -- 172.21.15.37:0/134173923 >> 172.21.15.37:0/134173923 conn(0x7ff7380b4060 msgr2=0x7ff73815b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:56.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.215+0000 7ff73ec00640 1 -- 172.21.15.37:0/134173923 shutdown_connections 2024-05-30T06:42:56.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.215+0000 7ff73ec00640 1 -- 172.21.15.37:0/134173923 wait complete. 2024-05-30T06:42:56.236 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T06:42:56.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6637e00640 1 Processor -- start 2024-05-30T06:42:56.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6637e00640 1 -- start start 2024-05-30T06:42:56.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6637e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f663015c780 0x7f66300b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:56.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6637e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f663009aa60 0x7f663009ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:56.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6637e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f663009b3a0 0x7f6630160370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:56.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6637e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f66300b38c0 con 0x7f663009b3a0 2024-05-30T06:42:56.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6637e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f66300b2cb0 con 0x7f663015c780 2024-05-30T06:42:56.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6637e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f66300b2f90 con 0x7f663009aa60 2024-05-30T06:42:56.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6635e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f663009b3a0 0x7f6630160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:56.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6635e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f663009b3a0 0x7f6630160370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35284/0 (socket says 172.21.15.37:35284) 2024-05-30T06:42:56.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6635e00640 1 -- 172.21.15.37:0/996169767 learned_addr learned my addr 172.21.15.37:0/996169767 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:56.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6635400640 1 --2- 172.21.15.37:0/996169767 >> v2:172.21.15.105:3300/0 conn(0x7f663015c780 0x7f66300b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:56.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6634a00640 1 --2- 172.21.15.37:0/996169767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f663009aa60 0x7f663009ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:56.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6635e00640 1 -- 172.21.15.37:0/996169767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f663009aa60 msgr2=0x7f663009ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:56.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6635e00640 1 --2- 172.21.15.37:0/996169767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f663009aa60 0x7f663009ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:56.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6635e00640 1 -- 172.21.15.37:0/996169767 >> v2:172.21.15.105:3300/0 conn(0x7f663015c780 msgr2=0x7f66300b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:56.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6635e00640 1 --2- 172.21.15.37:0/996169767 >> v2:172.21.15.105:3300/0 conn(0x7f663015c780 0x7f66300b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:56.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.387+0000 7f6635e00640 1 -- 172.21.15.37:0/996169767 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66300b3270 con 0x7f663009b3a0 2024-05-30T06:42:56.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.391+0000 7f6635e00640 1 --2- 172.21.15.37:0/996169767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f663009b3a0 0x7f6630160370 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66300b51d0 tx=0x7f662801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04ef7b2ff97887e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:56.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.391+0000 7f662fe00640 1 -- 172.21.15.37:0/996169767 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66280a5840 con 0x7f663009b3a0 2024-05-30T06:42:56.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.391+0000 7f662fe00640 1 -- 172.21.15.37:0/996169767 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66280a59e0 con 0x7f663009b3a0 2024-05-30T06:42:56.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.391+0000 7f662fe00640 1 -- 172.21.15.37:0/996169767 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66280a5db0 con 0x7f663009b3a0 2024-05-30T06:42:56.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.391+0000 7f6637e00640 1 -- 172.21.15.37:0/996169767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f663009b3a0 msgr2=0x7f6630160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:56.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.391+0000 7f6637e00640 1 --2- 172.21.15.37:0/996169767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f663009b3a0 0x7f6630160370 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f66300b51d0 tx=0x7f662801c9c0 comp rx=0 tx=0).stop 2024-05-30T06:42:56.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.391+0000 7f6637e00640 1 -- 172.21.15.37:0/996169767 shutdown_connections 2024-05-30T06:42:56.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.391+0000 7f6637e00640 1 --2- 172.21.15.37:0/996169767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f663009b3a0 0x7f6630160370 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:56.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.391+0000 7f6637e00640 1 --2- 172.21.15.37:0/996169767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f663009aa60 0x7f663009ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:56.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.391+0000 7f6637e00640 1 --2- 172.21.15.37:0/996169767 >> v2:172.21.15.105:3300/0 conn(0x7f663015c780 0x7f66300b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:56.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.391+0000 7f6637e00640 1 -- 172.21.15.37:0/996169767 >> 172.21.15.37:0/996169767 conn(0x7f66300d26a0 msgr2=0x7f66300d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:56.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.391+0000 7f6637e00640 1 -- 172.21.15.37:0/996169767 shutdown_connections 2024-05-30T06:42:56.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.391+0000 7f6637e00640 1 -- 172.21.15.37:0/996169767 wait complete. 2024-05-30T06:42:56.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6637e00640 1 Processor -- start 2024-05-30T06:42:56.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6637e00640 1 -- start start 2024-05-30T06:42:56.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6637e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f663009aa60 0x7f663015b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:56.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6637e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f663009b3a0 0x7f66300b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:56.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6637e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f663015c780 0x7f66300ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:56.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6637e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f66300b3eb0 con 0x7f663015c780 2024-05-30T06:42:56.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6637e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66300b3d30 con 0x7f663009aa60 2024-05-30T06:42:56.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6637e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f66300af410 con 0x7f663009b3a0 2024-05-30T06:42:56.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6635e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f663015c780 0x7f66300ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:56.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6635e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f663015c780 0x7f66300ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35298/0 (socket says 172.21.15.37:35298) 2024-05-30T06:42:56.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6635e00640 1 -- 172.21.15.37:0/4245488345 learned_addr learned my addr 172.21.15.37:0/4245488345 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6634a00640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f663009b3a0 0x7f66300b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6635400640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f663009aa60 0x7f663015b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6635e00640 1 -- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f663009b3a0 msgr2=0x7f66300b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6635e00640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f663009b3a0 0x7f66300b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6635e00640 1 -- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f663009aa60 msgr2=0x7f663015b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6635e00640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f663009aa60 0x7f663015b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6635e00640 1 -- 172.21.15.37:0/4245488345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66300b6410 con 0x7f663015c780 2024-05-30T06:42:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6635e00640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f663015c780 0x7f66300ca940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f66280af040 tx=0x7f6628019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f662d600640 1 -- 172.21.15.37:0/4245488345 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66280bc020 con 0x7f663015c780 2024-05-30T06:42:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f662d600640 1 -- 172.21.15.37:0/4245488345 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66280b88c0 con 0x7f663015c780 2024-05-30T06:42:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f662d600640 1 -- 172.21.15.37:0/4245488345 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66280b8cb0 con 0x7f663015c780 2024-05-30T06:42:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6637e00640 1 -- 172.21.15.37:0/4245488345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66300c98a0 con 0x7f663015c780 2024-05-30T06:42:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6637e00640 1 -- 172.21.15.37:0/4245488345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66300ca140 con 0x7f663015c780 2024-05-30T06:42:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.395+0000 7f6637e00640 1 -- 172.21.15.37:0/4245488345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6630068d40 con 0x7f663015c780 2024-05-30T06:42:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.399+0000 7f662d600640 1 -- 172.21.15.37:0/4245488345 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f66280bf020 con 0x7f663015c780 2024-05-30T06:42:56.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.399+0000 7f662d600640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6610068380 0x7f661006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:56.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.399+0000 7f662d600640 1 -- 172.21.15.37:0/4245488345 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5940+0+0 (secure 0 0 0) 0x7f6628121ab0 con 0x7f663015c780 2024-05-30T06:42:56.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.399+0000 7f6635400640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6610068380 0x7f661006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:56.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.399+0000 7f6635400640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6610068380 0x7f661006a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f66300a0730 tx=0x7f6624008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:56.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.403+0000 7f662d600640 1 -- 172.21.15.37:0/4245488345 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f66280165e0 con 0x7f663015c780 2024-05-30T06:42:56.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:56.571+0000 7f6637e00640 1 -- 172.21.15.37:0/4245488345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f663015fc80 con 0x7f663015c780 2024-05-30T06:42:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.219+0000 7f662d600640 1 -- 172.21.15.37:0/4245488345 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7f66280c0e50 con 0x7f663015c780 2024-05-30T06:42:57.298 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-30T06:42:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.223+0000 7f6637e00640 1 -- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6610068380 msgr2=0x7f661006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.223+0000 7f6637e00640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6610068380 0x7f661006a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f66300a0730 tx=0x7f6624008040 comp rx=0 tx=0).stop 2024-05-30T06:42:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.223+0000 7f6637e00640 1 -- 172.21.15.37:0/4245488345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f663015c780 msgr2=0x7f66300ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.223+0000 7f6637e00640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f663015c780 0x7f66300ca940 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f66280af040 tx=0x7f6628019760 comp rx=0 tx=0).stop 2024-05-30T06:42:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.223+0000 7f6637e00640 1 -- 172.21.15.37:0/4245488345 shutdown_connections 2024-05-30T06:42:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.223+0000 7f6637e00640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f663015c780 0x7f66300ca940 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.223+0000 7f6637e00640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f663009b3a0 0x7f66300b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.223+0000 7f6637e00640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6610068380 0x7f661006a840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.223+0000 7f6637e00640 1 --2- 172.21.15.37:0/4245488345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f663009aa60 0x7f663015b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.223+0000 7f6637e00640 1 -- 172.21.15.37:0/4245488345 >> 172.21.15.37:0/4245488345 conn(0x7f66300d26a0 msgr2=0x7f66300cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.223+0000 7f6637e00640 1 -- 172.21.15.37:0/4245488345 shutdown_connections 2024-05-30T06:42:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.223+0000 7f6637e00640 1 -- 172.21.15.37:0/4245488345 wait complete. 2024-05-30T06:42:57.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T06:42:57.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d4400640 1 Processor -- start 2024-05-30T06:42:57.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d4400640 1 -- start start 2024-05-30T06:42:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d4400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70cc15eb60 0x7f70cc06d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d4400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0cf630 0x7f70cc0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d4400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70cc09bba0 con 0x7f70cc0b15c0 2024-05-30T06:42:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d4400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f70cc09ab00 con 0x7f70cc15eb60 2024-05-30T06:42:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d4400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f70cc09ade0 con 0x7f70cc0cf630 2024-05-30T06:42:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d1a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70cc15eb60 0x7f70cc06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d1a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70cc15eb60 0x7f70cc06d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57212/0 (socket says 172.21.15.37:57212) 2024-05-30T06:42:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d1a00640 1 -- 172.21.15.37:0/4250854958 learned_addr learned my addr 172.21.15.37:0/4250854958 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d2400640 1 --2- 172.21.15.37:0/4250854958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0cf630 0x7f70cc0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d1a00640 1 -- 172.21.15.37:0/4250854958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0cf630 msgr2=0x7f70cc0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d1a00640 1 --2- 172.21.15.37:0/4250854958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0cf630 0x7f70cc0d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d1a00640 1 -- 172.21.15.37:0/4250854958 >> v1:172.21.15.37:6789/0 conn(0x7f70cc0b15c0 legacy=0x7f70cc0cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.455+0000 7f70d1a00640 1 -- 172.21.15.37:0/4250854958 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc09b0c0 con 0x7f70cc15eb60 2024-05-30T06:42:57.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.459+0000 7f70d1a00640 1 --2- 172.21.15.37:0/4250854958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15eb60 0x7f70cc06d480 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009870 tx=0x7f70c001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6adf9eafd2d96319 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:57.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.459+0000 7f70cbe00640 1 -- 172.21.15.37:0/4250854958 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c00ab650 con 0x7f70cc15eb60 2024-05-30T06:42:57.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.459+0000 7f70cbe00640 1 -- 172.21.15.37:0/4250854958 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c00b0070 con 0x7f70cc15eb60 2024-05-30T06:42:57.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.459+0000 7f70cbe00640 1 -- 172.21.15.37:0/4250854958 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c00aba10 con 0x7f70cc15eb60 2024-05-30T06:42:57.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.459+0000 7f70d4400640 1 -- 172.21.15.37:0/4250854958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15eb60 msgr2=0x7f70cc06d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:57.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.459+0000 7f70d4400640 1 --2- 172.21.15.37:0/4250854958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15eb60 0x7f70cc06d480 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009870 tx=0x7f70c001c560 comp rx=0 tx=0).stop 2024-05-30T06:42:57.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.459+0000 7f70d4400640 1 -- 172.21.15.37:0/4250854958 shutdown_connections 2024-05-30T06:42:57.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.459+0000 7f70d4400640 1 --2- 172.21.15.37:0/4250854958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0cf630 0x7f70cc0d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:57.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.459+0000 7f70d4400640 1 --2- 172.21.15.37:0/4250854958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15eb60 0x7f70cc06d480 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:57.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.459+0000 7f70d4400640 1 -- 172.21.15.37:0/4250854958 >> 172.21.15.37:0/4250854958 conn(0x7f70cc0d26a0 msgr2=0x7f70cc0d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:57.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.459+0000 7f70d4400640 1 -- 172.21.15.37:0/4250854958 shutdown_connections 2024-05-30T06:42:57.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.459+0000 7f70d4400640 1 -- 172.21.15.37:0/4250854958 wait complete. 2024-05-30T06:42:57.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d4400640 1 Processor -- start 2024-05-30T06:42:57.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d4400640 1 -- start start 2024-05-30T06:42:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d4400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0b15c0 0x7f70cc0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d4400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70cc0cf630 0x7f70cc156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d4400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15eb60 0x7f70cc1575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d4400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc0d1540 con 0x7f70cc15eb60 2024-05-30T06:42:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d4400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc0d13c0 con 0x7f70cc0cf630 2024-05-30T06:42:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d4400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f70cc0d16c0 con 0x7f70cc0b15c0 2024-05-30T06:42:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d2400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15eb60 0x7f70cc1575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d2400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15eb60 0x7f70cc1575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57228/0 (socket says 172.21.15.37:57228) 2024-05-30T06:42:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d2400640 1 -- 172.21.15.37:0/2312153921 learned_addr learned my addr 172.21.15.37:0/2312153921 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d1a00640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0b15c0 0x7f70cc0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d1000640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70cc0cf630 0x7f70cc156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d2400640 1 -- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0b15c0 msgr2=0x7f70cc0cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d2400640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0b15c0 0x7f70cc0cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d2400640 1 -- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70cc0cf630 msgr2=0x7f70cc156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d2400640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70cc0cf630 0x7f70cc156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d2400640 1 -- 172.21.15.37:0/2312153921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc0b69f0 con 0x7f70cc15eb60 2024-05-30T06:42:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d2400640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15eb60 0x7f70cc1575d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f70c4007e40 tx=0x7f70c400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70c9600640 1 -- 172.21.15.37:0/2312153921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c4014620 con 0x7f70cc15eb60 2024-05-30T06:42:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70c9600640 1 -- 172.21.15.37:0/2312153921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c4019070 con 0x7f70cc15eb60 2024-05-30T06:42:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70c9600640 1 -- 172.21.15.37:0/2312153921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c4014a20 con 0x7f70cc15eb60 2024-05-30T06:42:57.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d4400640 1 -- 172.21.15.37:0/2312153921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70cc0cd210 con 0x7f70cc15eb60 2024-05-30T06:42:57.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d4400640 1 -- 172.21.15.37:0/2312153921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70cc0cd790 con 0x7f70cc15eb60 2024-05-30T06:42:57.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.463+0000 7f70d4400640 1 -- 172.21.15.37:0/2312153921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70cc068d40 con 0x7f70cc15eb60 2024-05-30T06:42:57.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.467+0000 7f70c9600640 1 -- 172.21.15.37:0/2312153921 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f70c4014bc0 con 0x7f70cc15eb60 2024-05-30T06:42:57.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.467+0000 7f70c9600640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac0683b0 0x7f70ac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:57.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.467+0000 7f70c9600640 1 -- 172.21.15.37:0/2312153921 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5502+0+0 (secure 0 0 0) 0x7f70c40871a0 con 0x7f70cc15eb60 2024-05-30T06:42:57.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.467+0000 7f70d1a00640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac0683b0 0x7f70ac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:57.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.467+0000 7f70d1a00640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac0683b0 0x7f70ac06a870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f70c00af000 tx=0x7f70c00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:57.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.471+0000 7f70c9600640 1 -- 172.21.15.37:0/2312153921 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f70c4057820 con 0x7f70cc15eb60 2024-05-30T06:42:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:57.635+0000 7f70d4400640 1 -- 172.21.15.37:0/2312153921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f70cc15b600 con 0x7f70cc15eb60 2024-05-30T06:42:58.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.231+0000 7f70c9600640 1 -- 172.21.15.37:0/2312153921 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7f70c4057120 con 0x7f70cc15eb60 2024-05-30T06:42:58.230 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-30T06:42:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.231+0000 7f70d4400640 1 -- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac0683b0 msgr2=0x7f70ac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.231+0000 7f70d4400640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac0683b0 0x7f70ac06a870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f70c00af000 tx=0x7f70c00a7000 comp rx=0 tx=0).stop 2024-05-30T06:42:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.231+0000 7f70d4400640 1 -- 172.21.15.37:0/2312153921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15eb60 msgr2=0x7f70cc1575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.231+0000 7f70d4400640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15eb60 0x7f70cc1575d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f70c4007e40 tx=0x7f70c400e4b0 comp rx=0 tx=0).stop 2024-05-30T06:42:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.231+0000 7f70d4400640 1 -- 172.21.15.37:0/2312153921 shutdown_connections 2024-05-30T06:42:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.231+0000 7f70d4400640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15eb60 0x7f70cc1575d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.231+0000 7f70d4400640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac0683b0 0x7f70ac06a870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.231+0000 7f70d4400640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70cc0cf630 0x7f70cc156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.231+0000 7f70d4400640 1 --2- 172.21.15.37:0/2312153921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0b15c0 0x7f70cc0cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:58.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.231+0000 7f70d4400640 1 -- 172.21.15.37:0/2312153921 >> 172.21.15.37:0/2312153921 conn(0x7f70cc0d26a0 msgr2=0x7f70cc0d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.231+0000 7f70d4400640 1 -- 172.21.15.37:0/2312153921 shutdown_connections 2024-05-30T06:42:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.231+0000 7f70d4400640 1 -- 172.21.15.37:0/2312153921 wait complete. 2024-05-30T06:42:58.257 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T06:42:58.257 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T06:42:58.257 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T06:42:58.257 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:42:58.257 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T06:42:58.257 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T06:42:58.258 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T06:42:58.258 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:42:58.258 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T06:42:58.258 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T06:42:58.258 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T06:42:58.258 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:42:58.259 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T06:42:58.259 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T06:42:58.259 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T06:42:58.259 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:42:58.270 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T06:42:58.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T06:42:58.271 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T06:42:58.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T06:42:58.274 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T06:42:58.274 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T06:42:58.275 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T06:42:58.275 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T06:42:58.315 INFO:tasks.ceph.mds.c:Started 2024-05-30T06:42:58.315 DEBUG:teuthology.parallel:result is None 2024-05-30T06:42:58.317 INFO:tasks.ceph.mds.a:Started 2024-05-30T06:42:58.317 DEBUG:teuthology.parallel:result is None 2024-05-30T06:42:58.319 INFO:tasks.ceph.mds.d:Started 2024-05-30T06:42:58.319 DEBUG:teuthology.parallel:result is None 2024-05-30T06:42:58.321 INFO:tasks.ceph.mds.b:Started 2024-05-30T06:42:58.321 DEBUG:teuthology.parallel:result is None 2024-05-30T06:42:58.321 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T06:42:58.402 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-30T06:42:58.404 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-30T06:42:58.410 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-05-30T06:42:58.410 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-05-30T06:42:58.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.471+0000 7f5381c00640 1 Processor -- start 2024-05-30T06:42:58.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.471+0000 7f5381c00640 1 -- start start 2024-05-30T06:42:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.475+0000 7f5381c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f537c0b59d0 0x7f537c0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.475+0000 7f5381c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f537c15d350 0x7f537c160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.475+0000 7f5381c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f537c0b62f0 con 0x7f537c15d7b0 2024-05-30T06:42:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.475+0000 7f5381c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f537c142030 con 0x7f537c0b59d0 2024-05-30T06:42:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.475+0000 7f5381c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f537c142310 con 0x7f537c15d350 2024-05-30T06:42:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.475+0000 7f537aa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f537c0b59d0 0x7f537c0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:58.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.475+0000 7f537aa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f537c0b59d0 0x7f537c0b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57286/0 (socket says 172.21.15.37:57286) 2024-05-30T06:42:58.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.475+0000 7f537aa00640 1 -- 172.21.15.37:0/1077545417 learned_addr learned my addr 172.21.15.37:0/1077545417 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:58.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.475+0000 7f5373e00640 1 --2- 172.21.15.37:0/1077545417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f537c15d350 0x7f537c160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:58.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.475+0000 7f537aa00640 1 -- 172.21.15.37:0/1077545417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f537c15d350 msgr2=0x7f537c160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:58.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.475+0000 7f537aa00640 1 --2- 172.21.15.37:0/1077545417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f537c15d350 0x7f537c160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:58.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.475+0000 7f537aa00640 1 -- 172.21.15.37:0/1077545417 >> v1:172.21.15.105:6789/0 conn(0x7f537c15d7b0 legacy=0x7f537c1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:58.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.475+0000 7f537aa00640 1 -- 172.21.15.37:0/1077545417 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c1425f0 con 0x7f537c0b59d0 2024-05-30T06:42:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f537aa00640 1 --2- 172.21.15.37:0/1077545417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0b59d0 0x7f537c0b5db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f536c009870 tx=0x7f536c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981070075e16a031 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:58.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f537a000640 1 -- 172.21.15.37:0/1077545417 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c0b5070 con 0x7f537c0b59d0 2024-05-30T06:42:58.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f537a000640 1 -- 172.21.15.37:0/1077545417 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536c0a8a50 con 0x7f537c0b59d0 2024-05-30T06:42:58.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f537a000640 1 -- 172.21.15.37:0/1077545417 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c0a8e20 con 0x7f537c0b59d0 2024-05-30T06:42:58.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f5381c00640 1 -- 172.21.15.37:0/1077545417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0b59d0 msgr2=0x7f537c0b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:58.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f5381c00640 1 --2- 172.21.15.37:0/1077545417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0b59d0 0x7f537c0b5db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f536c009870 tx=0x7f536c01ed50 comp rx=0 tx=0).stop 2024-05-30T06:42:58.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f5381c00640 1 -- 172.21.15.37:0/1077545417 shutdown_connections 2024-05-30T06:42:58.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f5381c00640 1 --2- 172.21.15.37:0/1077545417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f537c15d350 0x7f537c160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:58.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f5381c00640 1 --2- 172.21.15.37:0/1077545417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0b59d0 0x7f537c0b5db0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:58.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f5381c00640 1 -- 172.21.15.37:0/1077545417 >> 172.21.15.37:0/1077545417 conn(0x7f537c06bf60 msgr2=0x7f537c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:58.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f5381c00640 1 -- 172.21.15.37:0/1077545417 shutdown_connections 2024-05-30T06:42:58.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f5381c00640 1 -- 172.21.15.37:0/1077545417 wait complete. 2024-05-30T06:42:58.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f5381c00640 1 Processor -- start 2024-05-30T06:42:58.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.479+0000 7f5381c00640 1 -- start start 2024-05-30T06:42:58.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f5381c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0b59d0 0x7f537c149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:58.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f5381c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f537c15d350 0x7f537c13ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:58.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f5381c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f537c15d7b0 0x7f537c1604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:58.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f5381c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f537c13fe60 con 0x7f537c0b59d0 2024-05-30T06:42:58.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f5381c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f537c13fce0 con 0x7f537c15d350 2024-05-30T06:42:58.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f5381c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f537c0aff20 con 0x7f537c15d7b0 2024-05-30T06:42:58.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f537aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0b59d0 0x7f537c149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:58.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f537aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0b59d0 0x7f537c149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57294/0 (socket says 172.21.15.37:57294) 2024-05-30T06:42:58.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f537aa00640 1 -- 172.21.15.37:0/1446462328 learned_addr learned my addr 172.21.15.37:0/1446462328 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:58.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f537aa00640 1 -- 172.21.15.37:0/1446462328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f537c15d7b0 msgr2=0x7f537c1604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:58.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f537aa00640 1 --2- 172.21.15.37:0/1446462328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f537c15d7b0 0x7f537c1604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:58.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f537aa00640 1 -- 172.21.15.37:0/1446462328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f537c15d350 msgr2=0x7f537c13ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:58.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f537aa00640 1 --2- 172.21.15.37:0/1446462328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f537c15d350 0x7f537c13ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:58.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f537aa00640 1 -- 172.21.15.37:0/1446462328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c1496c0 con 0x7f537c0b59d0 2024-05-30T06:42:58.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f537aa00640 1 --2- 172.21.15.37:0/1446462328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0b59d0 0x7f537c149180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f536c01c980 tx=0x7f536c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:58.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f5372a00640 1 -- 172.21.15.37:0/1446462328 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c0b5040 con 0x7f537c0b59d0 2024-05-30T06:42:58.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f5372a00640 1 -- 172.21.15.37:0/1446462328 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536c0be070 con 0x7f537c0b59d0 2024-05-30T06:42:58.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f5372a00640 1 -- 172.21.15.37:0/1446462328 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c0b0db0 con 0x7f537c0b59d0 2024-05-30T06:42:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f5381c00640 1 -- 172.21.15.37:0/1446462328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537c13b3d0 con 0x7f537c0b59d0 2024-05-30T06:42:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f5381c00640 1 -- 172.21.15.37:0/1446462328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f537c1e64f0 con 0x7f537c0b59d0 2024-05-30T06:42:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f5381c00640 1 -- 172.21.15.37:0/1446462328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f537c068bc0 con 0x7f537c0b59d0 2024-05-30T06:42:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.483+0000 7f5372a00640 1 -- 172.21.15.37:0/1446462328 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f536c0c3460 con 0x7f537c0b59d0 2024-05-30T06:42:58.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.487+0000 7f5372a00640 1 --2- 172.21.15.37:0/1446462328 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5358068380 0x7f535806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:58.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.487+0000 7f5372a00640 1 -- 172.21.15.37:0/1446462328 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7f536c123fd0 con 0x7f537c0b59d0 2024-05-30T06:42:58.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.487+0000 7f5373e00640 1 --2- 172.21.15.37:0/1446462328 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5358068380 0x7f535806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.487+0000 7f5373e00640 1 --2- 172.21.15.37:0/1446462328 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5358068380 0x7f535806a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f537c13c3a0 tx=0x7f53640095c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:58.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.491+0000 7f5372a00640 1 -- 172.21.15.37:0/1446462328 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f537c1496c0 con 0x7f537c0b59d0 2024-05-30T06:42:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:58.667+0000 7f5381c00640 1 -- 172.21.15.37:0/1446462328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f537c06f0a0 con 0x7f537c0b59d0 2024-05-30T06:42:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.243+0000 7f5372a00640 1 -- 172.21.15.37:0/1446462328 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7f536c0188b0 con 0x7f537c0b59d0 2024-05-30T06:42:59.243 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-30T06:42:59.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.247+0000 7f5381c00640 1 -- 172.21.15.37:0/1446462328 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5358068380 msgr2=0x7f535806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:59.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.247+0000 7f5381c00640 1 --2- 172.21.15.37:0/1446462328 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5358068380 0x7f535806a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f537c13c3a0 tx=0x7f53640095c0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.247+0000 7f5381c00640 1 -- 172.21.15.37:0/1446462328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0b59d0 msgr2=0x7f537c149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:59.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.247+0000 7f5381c00640 1 --2- 172.21.15.37:0/1446462328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0b59d0 0x7f537c149180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f536c01c980 tx=0x7f536c01baf0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.247+0000 7f5381c00640 1 -- 172.21.15.37:0/1446462328 shutdown_connections 2024-05-30T06:42:59.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.247+0000 7f5381c00640 1 --2- 172.21.15.37:0/1446462328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f537c15d7b0 0x7f537c1604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.247+0000 7f5381c00640 1 --2- 172.21.15.37:0/1446462328 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5358068380 0x7f535806a840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.247+0000 7f5381c00640 1 --2- 172.21.15.37:0/1446462328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f537c15d350 0x7f537c13ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.247+0000 7f5381c00640 1 --2- 172.21.15.37:0/1446462328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537c0b59d0 0x7f537c149180 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.247+0000 7f5381c00640 1 -- 172.21.15.37:0/1446462328 >> 172.21.15.37:0/1446462328 conn(0x7f537c06bf60 msgr2=0x7f537c0727d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:59.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.247+0000 7f5381c00640 1 -- 172.21.15.37:0/1446462328 shutdown_connections 2024-05-30T06:42:59.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.247+0000 7f5381c00640 1 -- 172.21.15.37:0/1446462328 wait complete. 2024-05-30T06:42:59.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T06:42:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc6fc00640 1 Processor -- start 2024-05-30T06:42:59.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc6fc00640 1 -- start start 2024-05-30T06:42:59.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc6fc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc6815b820 0x7fcc6815fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc6fc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcc680cddd0 0x7fcc680ce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc6fc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc680b4010 con 0x7fcc680b0b90 2024-05-30T06:42:59.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc6fc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcc680ce780 con 0x7fcc680cddd0 2024-05-30T06:42:59.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc6fc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcc680b3800 con 0x7fcc6815b820 2024-05-30T06:42:59.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc5fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcc680b0b90 0x7fcc6806f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49770/0 (socket says 172.21.15.37:49770) 2024-05-30T06:42:59.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc5fe00640 1 -- 172.21.15.37:0/665042988 learned_addr learned my addr 172.21.15.37:0/665042988 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:59.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc6d200640 1 --2- 172.21.15.37:0/665042988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc6815b820 0x7fcc6815fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc6dc00640 1 --2- 172.21.15.37:0/665042988 >> v2:172.21.15.105:3300/0 conn(0x7fcc680cddd0 0x7fcc680ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3009896140 0 0) 0x7fcc680b4010 con 0x7fcc680b0b90 2024-05-30T06:42:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc4c003530 con 0x7fcc680b0b90 2024-05-30T06:42:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1000776521 0 0) 0x7fcc4c003530 con 0x7fcc680b0b90 2024-05-30T06:42:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc6815b820 msgr2=0x7fcc6815fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 --2- 172.21.15.37:0/665042988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc6815b820 0x7fcc6815fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 >> v2:172.21.15.105:3300/0 conn(0x7fcc680cddd0 msgr2=0x7fcc680ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 --2- 172.21.15.37:0/665042988 >> v2:172.21.15.105:3300/0 conn(0x7fcc680cddd0 0x7fcc680ce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc680b3a50 con 0x7fcc680b0b90 2024-05-30T06:42:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fcc50001680 con 0x7fcc680b0b90 2024-05-30T06:42:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 >> v1:172.21.15.37:6789/0 conn(0x7fcc680b0b90 legacy=0x7fcc6806f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 --2- 172.21.15.37:0/665042988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc6815b820 0x7fcc4c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 --2- 172.21.15.37:0/665042988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc4c003f40 0x7fcc4c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 --2- 172.21.15.37:0/665042988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c004d50 0x7fcc4c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc680ce780 con 0x7fcc4c004d50 2024-05-30T06:42:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc680b3800 con 0x7fcc4c003f40 2024-05-30T06:42:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.415+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcc4c00dbe0 con 0x7fcc6815b820 2024-05-30T06:42:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc6dc00640 1 --2- 172.21.15.37:0/665042988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c004d50 0x7fcc4c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc5fe00640 1 --2- 172.21.15.37:0/665042988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc4c003f40 0x7fcc4c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc6d200640 1 --2- 172.21.15.37:0/665042988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc6815b820 0x7fcc4c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc6dc00640 1 -- 172.21.15.37:0/665042988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc6815b820 msgr2=0x7fcc4c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc6dc00640 1 --2- 172.21.15.37:0/665042988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc6815b820 0x7fcc4c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc6dc00640 1 -- 172.21.15.37:0/665042988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc4c003f40 msgr2=0x7fcc4c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:42:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc6dc00640 1 --2- 172.21.15.37:0/665042988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc4c003f40 0x7fcc4c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc6dc00640 1 -- 172.21.15.37:0/665042988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4c003530 con 0x7fcc4c004d50 2024-05-30T06:42:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc5fe00640 1 --2- 172.21.15.37:0/665042988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc4c003f40 0x7fcc4c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:42:59.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc6dc00640 1 --2- 172.21.15.37:0/665042988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c004d50 0x7fcc4c0051d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009fc0 tx=0x7fcc6001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efd43ce8ee8e847 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:59.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc600b2070 con 0x7fcc4c004d50 2024-05-30T06:42:59.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc600a5cd0 con 0x7fcc4c004d50 2024-05-30T06:42:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc67e00640 1 -- 172.21.15.37:0/665042988 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60009c10 con 0x7fcc4c004d50 2024-05-30T06:42:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc6fc00640 1 -- 172.21.15.37:0/665042988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c004d50 msgr2=0x7fcc4c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.419+0000 7fcc6fc00640 1 --2- 172.21.15.37:0/665042988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c004d50 0x7fcc4c0051d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009fc0 tx=0x7fcc6001cc60 comp rx=0 tx=0).stop 2024-05-30T06:42:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6dc00640 1 -- 172.21.15.37:0/665042988 reap_dead start 2024-05-30T06:42:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6fc00640 1 -- 172.21.15.37:0/665042988 shutdown_connections 2024-05-30T06:42:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6fc00640 1 -- 172.21.15.37:0/665042988 >> 172.21.15.37:0/665042988 conn(0x7fcc6809aa60 msgr2=0x7fcc680b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6fc00640 1 -- 172.21.15.37:0/665042988 shutdown_connections 2024-05-30T06:42:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6fc00640 1 -- 172.21.15.37:0/665042988 wait complete. 2024-05-30T06:42:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6fc00640 1 Processor -- start 2024-05-30T06:42:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6fc00640 1 -- start start 2024-05-30T06:42:59.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6fc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c004d50 0x7fcc68155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6fc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc6815c610 0x7fcc680c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6fc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc680c6420 0x7fcc680c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6fc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc680cc620 con 0x7fcc4c004d50 2024-05-30T06:42:59.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6fc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc680cc340 con 0x7fcc680c6420 2024-05-30T06:42:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6fc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6806f750 con 0x7fcc6815c610 2024-05-30T06:42:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c004d50 0x7fcc68155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c004d50 0x7fcc68155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57314/0 (socket says 172.21.15.37:57314) 2024-05-30T06:42:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6d200640 1 -- 172.21.15.37:0/3893942385 learned_addr learned my addr 172.21.15.37:0/3893942385 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc5fe00640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc6815c610 0x7fcc680c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6dc00640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc680c6420 0x7fcc680c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6d200640 1 -- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc6815c610 msgr2=0x7fcc680c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:59.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6d200640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc6815c610 0x7fcc680c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6d200640 1 -- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc680c6420 msgr2=0x7fcc680c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:59.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6d200640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc680c6420 0x7fcc680c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6d200640 1 -- 172.21.15.37:0/3893942385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc680c8790 con 0x7fcc4c004d50 2024-05-30T06:42:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc6d200640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c004d50 0x7fcc68155250 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcc580119d0 tx=0x7fcc58011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.423+0000 7fcc65600640 1 -- 172.21.15.37:0/3893942385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5800faf0 con 0x7fcc4c004d50 2024-05-30T06:42:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.427+0000 7fcc65600640 1 -- 172.21.15.37:0/3893942385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5800fc90 con 0x7fcc4c004d50 2024-05-30T06:42:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.427+0000 7fcc65600640 1 -- 172.21.15.37:0/3893942385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc58014440 con 0x7fcc4c004d50 2024-05-30T06:42:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.427+0000 7fcc6fc00640 1 -- 172.21.15.37:0/3893942385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc680c8a70 con 0x7fcc4c004d50 2024-05-30T06:42:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.427+0000 7fcc6fc00640 1 -- 172.21.15.37:0/3893942385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc680c9030 con 0x7fcc4c004d50 2024-05-30T06:42:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.427+0000 7fcc6fc00640 1 -- 172.21.15.37:0/3893942385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc68068b20 con 0x7fcc4c004d50 2024-05-30T06:42:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.427+0000 7fcc65600640 1 -- 172.21.15.37:0/3893942385 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcc58012040 con 0x7fcc4c004d50 2024-05-30T06:42:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.427+0000 7fcc65600640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc44068380 0x7fcc4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.427+0000 7fcc65600640 1 -- 172.21.15.37:0/3893942385 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fcc58086c50 con 0x7fcc4c004d50 2024-05-30T06:42:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.427+0000 7fcc5fe00640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc44068380 0x7fcc4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.427+0000 7fcc5fe00640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc44068380 0x7fcc4406a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcc680cadd0 tx=0x7fcc50007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.431+0000 7fcc65600640 1 -- 172.21.15.37:0/3893942385 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcc58019030 con 0x7fcc4c004d50 2024-05-30T06:42:59.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.651+0000 7fcc6fc00640 1 -- 172.21.15.37:0/3893942385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fcc6815afe0 con 0x7fcc4c004d50 2024-05-30T06:42:59.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.651+0000 7fcc65600640 1 -- 172.21.15.37:0/3893942385 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7fcc5805aa10 con 0x7fcc4c004d50 2024-05-30T06:42:59.651 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:42:59.651 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:42:59.651 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-30T06:42:59.651 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.651 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmcRfnBBAAk60J/SRTolMhKoS8b8A9jQ==", 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmzScrERAAbIJ5somf+sguc6jEuR04zg==", 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:42:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:42:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:42:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-30T06:42:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm2jEhDBAAGKUYGtJznRYpt1LHlMOTrw==", 2024-05-30T06:42:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:42:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:42:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:42:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm95RdGBAAaaaNAKnr4Dtmu+L1NaMVbw==", 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-30T06:42:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCFH1hmygxjHhAA1ee1eBP6dvsC0K9w+6d0OQ==", 2024-05-30T06:42:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:42:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:42:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-30T06:42:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCIH1hmNJsBKRAAhns5CNodS7CKFU1Jg3PFCA==", 2024-05-30T06:42:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:42:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:42:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCLH1hmlx5FNBAAn2Iann8U/uTZy0tFcFx04w==", 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-30T06:42:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCPH1hmxJnxAhAAt5cEb3YVLDhkQD5WjLQuog==", 2024-05-30T06:42:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:42:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:42:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-30T06:42:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCUH1hmEn5cOBAAFzBuH8TO418e4obqTNeIXg==", 2024-05-30T06:42:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:42:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:42:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-30T06:42:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCYH1hmij3RCBAAHzQPoM1ClYGGEt6ly6ZrqQ==", 2024-05-30T06:42:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:42:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:42:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.659 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-30T06:42:59.659 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCbH1hmDqdpERAA46/Bs4B/xVjviQ1gNpNaaw==", 2024-05-30T06:42:59.659 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.659 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:42:59.659 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:42:59.659 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.659 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.659 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.659 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-30T06:42:59.659 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCeH1hmnrfVHRAAlqk48vSVw45YDCXWWb/MUA==", 2024-05-30T06:42:59.659 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.659 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A==", 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.660 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmf8sdJhAATAP7EzLJxXXnXeEQL9fdpw==", 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm1qB9IhAAszAwOgm2Igb1DM4diPC7ow==", 2024-05-30T06:42:59.661 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.662 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:42:59.662 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:42:59.662 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:42:59.662 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:42:59.662 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.662 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.662 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-30T06:42:59.662 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmY6AULBAAYNza0fpC3KO69ulNQaSldQ==", 2024-05-30T06:42:59.662 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.662 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:42:59.662 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:42:59.662 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmbSCrJBAAhn69RBUeyuaAMWiB3o7ByQ==", 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.663 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mds", 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCpH1hmbuNCJhAA9baRLMOMPUkt6xubMAkW/w==", 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mds" 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mgr", 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCpH1hmge1CJhAA2ZL5WHvFS29lkBXNURXatg==", 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.664 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-osd", 2024-05-30T06:42:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCpH1hmxPZCJhAA4wj+HwnrWRBuVaNPPtLfTg==", 2024-05-30T06:42:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-osd" 2024-05-30T06:42:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd", 2024-05-30T06:42:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCpH1hmqf9CJhAAOQ/591U2td/S0pEDgNwFwQ==", 2024-05-30T06:42:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-30T06:42:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCpH1hmDAlDJhAA94xs8euZkpHKjosVO0PAZg==", 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rgw", 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCpH1hmlRJDJhAA1sIreHxxy6UZOikV+CfyAQ==", 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.666 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmN/fjABAAdldbCncRiHy6RFEF9H7gnQ==", 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmNdeSOBAA3V4vK0bNlWFoosV41f/ASQ==", 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:42:59.667 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:42:59.668 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:42:59.668 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:42:59.668 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.668 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:42:59.668 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-30T06:42:59.668 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:42:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.655+0000 7fcc6fc00640 1 -- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc44068380 msgr2=0x7fcc4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.655+0000 7fcc6fc00640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc44068380 0x7fcc4406a840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcc680cadd0 tx=0x7fcc50007900 comp rx=0 tx=0).stop 2024-05-30T06:42:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.655+0000 7fcc6fc00640 1 -- 172.21.15.37:0/3893942385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c004d50 msgr2=0x7fcc68155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.655+0000 7fcc6fc00640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c004d50 0x7fcc68155250 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcc580119d0 tx=0x7fcc58011dd0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.655+0000 7fcc6fc00640 1 -- 172.21.15.37:0/3893942385 shutdown_connections 2024-05-30T06:42:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.655+0000 7fcc6fc00640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc44068380 0x7fcc4406a840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.655+0000 7fcc6fc00640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc680c6420 0x7fcc680c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.655+0000 7fcc6fc00640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc6815c610 0x7fcc680c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.655+0000 7fcc6fc00640 1 --2- 172.21.15.37:0/3893942385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc4c004d50 0x7fcc68155250 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.655+0000 7fcc6fc00640 1 -- 172.21.15.37:0/3893942385 >> 172.21.15.37:0/3893942385 conn(0x7fcc6809aa60 msgr2=0x7fcc680ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.655+0000 7fcc6fc00640 1 -- 172.21.15.37:0/3893942385 shutdown_connections 2024-05-30T06:42:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.655+0000 7fcc6fc00640 1 -- 172.21.15.37:0/3893942385 wait complete. 2024-05-30T06:42:59.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-30T06:42:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.815+0000 7eff3a600640 1 Processor -- start 2024-05-30T06:42:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.815+0000 7eff3a600640 1 -- start start 2024-05-30T06:42:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.815+0000 7eff3a600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7eff340cfeb0 0x7eff340afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.815+0000 7eff3a600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff340b5f70 con 0x7eff340b36c0 2024-05-30T06:42:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.815+0000 7eff3a600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff340b3b50 con 0x7eff34162ba0 2024-05-30T06:42:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.815+0000 7eff3a600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7eff340b67a0 con 0x7eff340cfeb0 2024-05-30T06:42:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.815+0000 7eff2be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7eff340b36c0 0x7eff34162490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49784/0 (socket says 172.21.15.37:49784) 2024-05-30T06:42:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.815+0000 7eff2be00640 1 -- 172.21.15.37:0/3025065186 learned_addr learned my addr 172.21.15.37:0/3025065186 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:42:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.815+0000 7eff33400640 1 --2- 172.21.15.37:0/3025065186 >> v2:172.21.15.105:3300/0 conn(0x7eff340cfeb0 0x7eff340afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.815+0000 7eff32a00640 1 -- 172.21.15.37:0/3025065186 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 804844221 0 0) 0x7eff340b5f70 con 0x7eff340b36c0 2024-05-30T06:42:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.819+0000 7eff32a00640 1 -- 172.21.15.37:0/3025065186 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff18003530 con 0x7eff340b36c0 2024-05-30T06:42:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.819+0000 7eff32a00640 1 -- 172.21.15.37:0/3025065186 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3500449399 0 0) 0x7eff340b3b50 con 0x7eff34162ba0 2024-05-30T06:42:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.819+0000 7eff32a00640 1 -- 172.21.15.37:0/3025065186 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff340b5f70 con 0x7eff34162ba0 2024-05-30T06:42:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.819+0000 7eff33400640 1 -- 172.21.15.37:0/3025065186 >> v1:172.21.15.105:6789/0 conn(0x7eff34162ba0 legacy=0x7eff34147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.819+0000 7eff33400640 1 -- 172.21.15.37:0/3025065186 >> v1:172.21.15.37:6789/0 conn(0x7eff340b36c0 legacy=0x7eff34162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.819+0000 7eff33400640 1 -- 172.21.15.37:0/3025065186 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff340b61e0 con 0x7eff340cfeb0 2024-05-30T06:42:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.819+0000 7eff33400640 1 --2- 172.21.15.37:0/3025065186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff340cfeb0 0x7eff340afcf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7eff240097c0 tx=0x7eff2401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9475f9d94930ddc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.819+0000 7eff32a00640 1 -- 172.21.15.37:0/3025065186 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff240b0070 con 0x7eff340cfeb0 2024-05-30T06:42:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.819+0000 7eff32a00640 1 -- 172.21.15.37:0/3025065186 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff240ab600 con 0x7eff340cfeb0 2024-05-30T06:42:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.819+0000 7eff32a00640 1 -- 172.21.15.37:0/3025065186 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff240ab9d0 con 0x7eff340cfeb0 2024-05-30T06:42:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.819+0000 7eff3a600640 1 -- 172.21.15.37:0/3025065186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff340cfeb0 msgr2=0x7eff340afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.819+0000 7eff3a600640 1 --2- 172.21.15.37:0/3025065186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff340cfeb0 0x7eff340afcf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7eff240097c0 tx=0x7eff2401c410 comp rx=0 tx=0).stop 2024-05-30T06:42:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff3a600640 1 -- 172.21.15.37:0/3025065186 shutdown_connections 2024-05-30T06:42:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff3a600640 1 --2- 172.21.15.37:0/3025065186 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff340cfeb0 0x7eff340afcf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff3a600640 1 -- 172.21.15.37:0/3025065186 >> 172.21.15.37:0/3025065186 conn(0x7eff3406bf60 msgr2=0x7eff340b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:42:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff3a600640 1 -- 172.21.15.37:0/3025065186 shutdown_connections 2024-05-30T06:42:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff3a600640 1 -- 172.21.15.37:0/3025065186 wait complete. 2024-05-30T06:42:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff3a600640 1 Processor -- start 2024-05-30T06:42:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff3a600640 1 -- start start 2024-05-30T06:42:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff3a600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff340b36c0 0x7eff3413f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff3a600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff340cfeb0 0x7eff34160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff3a600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff34162ba0 0x7eff34160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff3a600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff3416c9c0 con 0x7eff340cfeb0 2024-05-30T06:42:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff3a600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff3416c840 con 0x7eff340b36c0 2024-05-30T06:42:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff3a600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7eff3416cb40 con 0x7eff34162ba0 2024-05-30T06:42:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff2be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff340cfeb0 0x7eff34160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff2be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff340cfeb0 0x7eff34160040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57326/0 (socket says 172.21.15.37:57326) 2024-05-30T06:42:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff2be00640 1 -- 172.21.15.37:0/3304221707 learned_addr learned my addr 172.21.15.37:0/3304221707 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:42:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff33400640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff340b36c0 0x7eff3413f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff33e00640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff34162ba0 0x7eff34160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff2be00640 1 -- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff34162ba0 msgr2=0x7eff34160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff2be00640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff34162ba0 0x7eff34160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff2be00640 1 -- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff340b36c0 msgr2=0x7eff3413f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:42:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff2be00640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff340b36c0 0x7eff3413f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:42:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff2be00640 1 -- 172.21.15.37:0/3304221707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3415b700 con 0x7eff340cfeb0 2024-05-30T06:42:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff33e00640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff34162ba0 0x7eff34160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:42:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.823+0000 7eff2be00640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff340cfeb0 0x7eff34160040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00c420 tx=0x7eff1c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.827+0000 7eff2b400640 1 -- 172.21.15.37:0/3304221707 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c017070 con 0x7eff340cfeb0 2024-05-30T06:42:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.827+0000 7eff2b400640 1 -- 172.21.15.37:0/3304221707 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff1c005cf0 con 0x7eff340cfeb0 2024-05-30T06:42:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.827+0000 7eff3a600640 1 -- 172.21.15.37:0/3304221707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3415b9e0 con 0x7eff340cfeb0 2024-05-30T06:42:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.827+0000 7eff2b400640 1 -- 172.21.15.37:0/3304221707 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c007310 con 0x7eff340cfeb0 2024-05-30T06:42:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.827+0000 7eff3a600640 1 -- 172.21.15.37:0/3304221707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3415bfa0 con 0x7eff340cfeb0 2024-05-30T06:42:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.827+0000 7eff3a600640 1 -- 172.21.15.37:0/3304221707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff34068bc0 con 0x7eff340cfeb0 2024-05-30T06:42:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.827+0000 7eff2b400640 1 -- 172.21.15.37:0/3304221707 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff1c01a070 con 0x7eff340cfeb0 2024-05-30T06:42:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.827+0000 7eff2b400640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff10068380 0x7eff1006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:42:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.827+0000 7eff2b400640 1 -- 172.21.15.37:0/3304221707 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7eff1c085a70 con 0x7eff340cfeb0 2024-05-30T06:42:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.827+0000 7eff33400640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff10068380 0x7eff1006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:42:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.831+0000 7eff33400640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff10068380 0x7eff1006a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff240ad000 tx=0x7eff240a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:42:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:42:59.831+0000 7eff2b400640 1 -- 172.21.15.37:0/3304221707 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7eff1c055c90 con 0x7eff340cfeb0 2024-05-30T06:43:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.055+0000 7eff3a600640 1 -- 172.21.15.37:0/3304221707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7eff3413d650 con 0x7eff340cfeb0 2024-05-30T06:43:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.059+0000 7eff2b400640 1 -- 172.21.15.37:0/3304221707 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7eff1c059f90 con 0x7eff340cfeb0 2024-05-30T06:43:00.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.059+0000 7eff3a600640 1 -- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff10068380 msgr2=0x7eff1006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.059+0000 7eff3a600640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff10068380 0x7eff1006a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7eff240ad000 tx=0x7eff240a6000 comp rx=0 tx=0).stop 2024-05-30T06:43:00.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.059+0000 7eff3a600640 1 -- 172.21.15.37:0/3304221707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff340cfeb0 msgr2=0x7eff34160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.059+0000 7eff3a600640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff340cfeb0 0x7eff34160040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00c420 tx=0x7eff1c00c8e0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.059+0000 7eff3a600640 1 -- 172.21.15.37:0/3304221707 shutdown_connections 2024-05-30T06:43:00.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.059+0000 7eff3a600640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff34162ba0 0x7eff34160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.059+0000 7eff3a600640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff340cfeb0 0x7eff34160040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.059+0000 7eff3a600640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff10068380 0x7eff1006a840 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.059+0000 7eff3a600640 1 --2- 172.21.15.37:0/3304221707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff340b36c0 0x7eff3413f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.059+0000 7eff3a600640 1 -- 172.21.15.37:0/3304221707 >> 172.21.15.37:0/3304221707 conn(0x7eff3406bf60 msgr2=0x7eff34143840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:00.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.059+0000 7eff3a600640 1 -- 172.21.15.37:0/3304221707 shutdown_connections 2024-05-30T06:43:00.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.059+0000 7eff3a600640 1 -- 172.21.15.37:0/3304221707 wait complete. 2024-05-30T06:43:00.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-30T06:43:00.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa806200640 1 Processor -- start 2024-05-30T06:43:00.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa806200640 1 -- start start 2024-05-30T06:43:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa806200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa800156b50 0x7fa800160230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa806200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa800160770 0x7fa800072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa806200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa800072770 0x7fa80006e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa806200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa800072bb0 con 0x7fa800072770 2024-05-30T06:43:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa806200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa80015cf60 con 0x7fa800160770 2024-05-30T06:43:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa806200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa800160d60 con 0x7fa800156b50 2024-05-30T06:43:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa805800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa800072770 0x7fa80006e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa805800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa800072770 0x7fa80006e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57334/0 (socket says 172.21.15.37:57334) 2024-05-30T06:43:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa805800640 1 -- 172.21.15.37:0/451291832 learned_addr learned my addr 172.21.15.37:0/451291832 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa7ffe00640 1 --2- 172.21.15.37:0/451291832 >> v2:172.21.15.105:3300/0 conn(0x7fa800160770 0x7fa800072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa804e00640 1 --2- 172.21.15.37:0/451291832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa800156b50 0x7fa800160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa805800640 1 -- 172.21.15.37:0/451291832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa800156b50 msgr2=0x7fa800160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa805800640 1 --2- 172.21.15.37:0/451291832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa800156b50 0x7fa800160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa805800640 1 -- 172.21.15.37:0/451291832 >> v2:172.21.15.105:3300/0 conn(0x7fa800160770 msgr2=0x7fa800072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa805800640 1 --2- 172.21.15.37:0/451291832 >> v2:172.21.15.105:3300/0 conn(0x7fa800160770 0x7fa800072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.223+0000 7fa805800640 1 -- 172.21.15.37:0/451291832 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa800161040 con 0x7fa800072770 2024-05-30T06:43:00.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.227+0000 7fa805800640 1 --2- 172.21.15.37:0/451291832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa800072770 0x7fa80006e290 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa8000b5c30 tx=0x7fa7f801c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8095a2a1bd7bf69f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.227+0000 7fa7ff400640 1 -- 172.21.15.37:0/451291832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80ac070 con 0x7fa800072770 2024-05-30T06:43:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.227+0000 7fa7ff400640 1 -- 172.21.15.37:0/451291832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f80a8400 con 0x7fa800072770 2024-05-30T06:43:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.227+0000 7fa7ff400640 1 -- 172.21.15.37:0/451291832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80a87d0 con 0x7fa800072770 2024-05-30T06:43:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.227+0000 7fa806200640 1 -- 172.21.15.37:0/451291832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa800072770 msgr2=0x7fa80006e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.227+0000 7fa806200640 1 --2- 172.21.15.37:0/451291832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa800072770 0x7fa80006e290 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa8000b5c30 tx=0x7fa7f801c730 comp rx=0 tx=0).stop 2024-05-30T06:43:00.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.227+0000 7fa806200640 1 -- 172.21.15.37:0/451291832 shutdown_connections 2024-05-30T06:43:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.227+0000 7fa806200640 1 --2- 172.21.15.37:0/451291832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa800072770 0x7fa80006e290 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.227+0000 7fa806200640 1 --2- 172.21.15.37:0/451291832 >> v2:172.21.15.105:3300/0 conn(0x7fa800160770 0x7fa800072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.227+0000 7fa806200640 1 --2- 172.21.15.37:0/451291832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa800156b50 0x7fa800160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.227+0000 7fa806200640 1 -- 172.21.15.37:0/451291832 >> 172.21.15.37:0/451291832 conn(0x7fa8000b25f0 msgr2=0x7fa8000b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.227+0000 7fa806200640 1 -- 172.21.15.37:0/451291832 shutdown_connections 2024-05-30T06:43:00.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.227+0000 7fa806200640 1 -- 172.21.15.37:0/451291832 wait complete. 2024-05-30T06:43:00.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa806200640 1 Processor -- start 2024-05-30T06:43:00.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa806200640 1 -- start start 2024-05-30T06:43:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa806200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa800072770 0x7fa80013a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa806200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa800156b50 0x7fa800151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa806200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa800160770 0x7fa800157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa806200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8001570b0 con 0x7fa800160770 2024-05-30T06:43:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa806200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa800156f30 con 0x7fa800072770 2024-05-30T06:43:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa806200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8000cddb0 con 0x7fa800156b50 2024-05-30T06:43:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa805800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa800160770 0x7fa800157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa805800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa800160770 0x7fa800157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57344/0 (socket says 172.21.15.37:57344) 2024-05-30T06:43:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa805800640 1 -- 172.21.15.37:0/2960408699 learned_addr learned my addr 172.21.15.37:0/2960408699 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa7ffe00640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa800156b50 0x7fa800151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa804e00640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa800072770 0x7fa80013a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa805800640 1 -- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa800156b50 msgr2=0x7fa800151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa805800640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa800156b50 0x7fa800151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa805800640 1 -- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa800072770 msgr2=0x7fa80013a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa805800640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa800072770 0x7fa80013a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa805800640 1 -- 172.21.15.37:0/2960408699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa800150ee0 con 0x7fa800160770 2024-05-30T06:43:00.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa805800640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa800160770 0x7fa800157e40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa7f801ade0 tx=0x7fa7f80194d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa7fcc00640 1 -- 172.21.15.37:0/2960408699 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80ac040 con 0x7fa800160770 2024-05-30T06:43:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa7fcc00640 1 -- 172.21.15.37:0/2960408699 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f80a89c0 con 0x7fa800160770 2024-05-30T06:43:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa806200640 1 -- 172.21.15.37:0/2960408699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8001511c0 con 0x7fa800160770 2024-05-30T06:43:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa7fcc00640 1 -- 172.21.15.37:0/2960408699 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80a8d90 con 0x7fa800160770 2024-05-30T06:43:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa806200640 1 -- 172.21.15.37:0/2960408699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa800151780 con 0x7fa800160770 2024-05-30T06:43:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.231+0000 7fa806200640 1 -- 172.21.15.37:0/2960408699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8000731d0 con 0x7fa800160770 2024-05-30T06:43:00.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.235+0000 7fa7fcc00640 1 -- 172.21.15.37:0/2960408699 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa7f80af070 con 0x7fa800160770 2024-05-30T06:43:00.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.235+0000 7fa7fcc00640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7e0068380 0x7fa7e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.235+0000 7fa7fcc00640 1 -- 172.21.15.37:0/2960408699 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fa7f8120b70 con 0x7fa800160770 2024-05-30T06:43:00.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.235+0000 7fa804e00640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7e0068380 0x7fa7e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.235+0000 7fa804e00640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7e0068380 0x7fa7e006a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40045f0 tx=0x7fa7f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:00.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.239+0000 7fa7fcc00640 1 -- 172.21.15.37:0/2960408699 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa7f80165e0 con 0x7fa800160770 2024-05-30T06:43:00.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.463+0000 7fa806200640 1 -- 172.21.15.37:0/2960408699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fa800075560 con 0x7fa800160770 2024-05-30T06:43:00.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.463+0000 7fa7fcc00640 1 -- 172.21.15.37:0/2960408699 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fa7f80f0f70 con 0x7fa800160770 2024-05-30T06:43:00.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.467+0000 7fa806200640 1 -- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7e0068380 msgr2=0x7fa7e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.467+0000 7fa806200640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7e0068380 0x7fa7e006a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40045f0 tx=0x7fa7f4008040 comp rx=0 tx=0).stop 2024-05-30T06:43:00.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.467+0000 7fa806200640 1 -- 172.21.15.37:0/2960408699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa800160770 msgr2=0x7fa800157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.467+0000 7fa806200640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa800160770 0x7fa800157e40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa7f801ade0 tx=0x7fa7f80194d0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.467+0000 7fa806200640 1 -- 172.21.15.37:0/2960408699 shutdown_connections 2024-05-30T06:43:00.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.467+0000 7fa806200640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa800160770 0x7fa800157e40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.467+0000 7fa806200640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa800156b50 0x7fa800151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.467+0000 7fa806200640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7e0068380 0x7fa7e006a840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.467+0000 7fa806200640 1 --2- 172.21.15.37:0/2960408699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa800072770 0x7fa80013a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.467+0000 7fa806200640 1 -- 172.21.15.37:0/2960408699 >> 172.21.15.37:0/2960408699 conn(0x7fa8000b25f0 msgr2=0x7fa80015ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.467+0000 7fa806200640 1 -- 172.21.15.37:0/2960408699 shutdown_connections 2024-05-30T06:43:00.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.467+0000 7fa806200640 1 -- 172.21.15.37:0/2960408699 wait complete. 2024-05-30T06:43:00.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-30T06:43:00.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.627+0000 7f0715400640 1 Processor -- start 2024-05-30T06:43:00.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.627+0000 7f0715400640 1 -- start start 2024-05-30T06:43:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f0715400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f071015cfe0 0x7f071006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f0715400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f071006f750 con 0x7f071015f780 2024-05-30T06:43:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f0715400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f071006fa30 con 0x7f071006c560 2024-05-30T06:43:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f0715400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f071006fd10 con 0x7f071015cfe0 2024-05-30T06:43:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070f200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f071015f780 0x7f0710166330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49786/0 (socket says 172.21.15.37:49786) 2024-05-30T06:43:00.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070f200640 1 -- 172.21.15.37:0/2958968350 learned_addr learned my addr 172.21.15.37:0/2958968350 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:00.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2864167544 0 0) 0x7f071006f750 con 0x7f071015f780 2024-05-30T06:43:00.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070e800640 1 --2- 172.21.15.37:0/2958968350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f071015cfe0 0x7f071006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06f4003530 con 0x7f071015f780 2024-05-30T06:43:00.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2593027201 0 0) 0x7f06f4003530 con 0x7f071015f780 2024-05-30T06:43:00.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f071015cfe0 msgr2=0x7f071006ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:00.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 --2- 172.21.15.37:0/2958968350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f071015cfe0 0x7f071006ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 >> v1:172.21.15.105:6789/0 conn(0x7f071006c560 legacy=0x7f071015d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071015df70 con 0x7f071015f780 2024-05-30T06:43:00.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f0708001a00 con 0x7f071015f780 2024-05-30T06:43:00.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 >> v1:172.21.15.37:6789/0 conn(0x7f071015f780 legacy=0x7f0710166330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 --2- 172.21.15.37:0/2958968350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06f40039f0 0x7f06f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 --2- 172.21.15.37:0/2958968350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f40043a0 0x7f06f4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 --2- 172.21.15.37:0/2958968350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f071015cfe0 0x7f06f40050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f071006fd10 con 0x7f06f40043a0 2024-05-30T06:43:00.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f06f400b9d0 con 0x7f06f40039f0 2024-05-30T06:43:00.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f06f400bbd0 con 0x7f071015cfe0 2024-05-30T06:43:00.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f0707e00640 1 --2- 172.21.15.37:0/2958968350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f40043a0 0x7f06f4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070e800640 1 --2- 172.21.15.37:0/2958968350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06f40039f0 0x7f06f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f070f200640 1 --2- 172.21.15.37:0/2958968350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f071015cfe0 0x7f06f40050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f0707e00640 1 -- 172.21.15.37:0/2958968350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f071015cfe0 msgr2=0x7f06f40050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:00.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f0707e00640 1 --2- 172.21.15.37:0/2958968350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f071015cfe0 0x7f06f40050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f0707e00640 1 -- 172.21.15.37:0/2958968350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06f40039f0 msgr2=0x7f06f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:00.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f0707e00640 1 --2- 172.21.15.37:0/2958968350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06f40039f0 0x7f06f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.631+0000 7f0707e00640 1 -- 172.21.15.37:0/2958968350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f4003530 con 0x7f06f40043a0 2024-05-30T06:43:00.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.635+0000 7f0707e00640 1 --2- 172.21.15.37:0/2958968350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f40043a0 0x7f06f4004870 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f06f8001910 tx=0x7f06f801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dedf2b049fad5a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:00.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.635+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f80b1070 con 0x7f06f40043a0 2024-05-30T06:43:00.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.635+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f80ac410 con 0x7f06f40043a0 2024-05-30T06:43:00.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.635+0000 7f070de00640 1 -- 172.21.15.37:0/2958968350 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8001510 con 0x7f06f40043a0 2024-05-30T06:43:00.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.635+0000 7f0715400640 1 -- 172.21.15.37:0/2958968350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f40043a0 msgr2=0x7f06f4004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.635+0000 7f0715400640 1 --2- 172.21.15.37:0/2958968350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06f40043a0 0x7f06f4004870 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f06f8001910 tx=0x7f06f801c470 comp rx=0 tx=0).stop 2024-05-30T06:43:00.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.635+0000 7f070f200640 1 -- 172.21.15.37:0/2958968350 reap_dead start 2024-05-30T06:43:00.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.635+0000 7f0715400640 1 -- 172.21.15.37:0/2958968350 shutdown_connections 2024-05-30T06:43:00.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.635+0000 7f0715400640 1 -- 172.21.15.37:0/2958968350 >> 172.21.15.37:0/2958968350 conn(0x7f071006b960 msgr2=0x7f071006bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:00.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.635+0000 7f0715400640 1 -- 172.21.15.37:0/2958968350 shutdown_connections 2024-05-30T06:43:00.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.635+0000 7f0715400640 1 -- 172.21.15.37:0/2958968350 wait complete. 2024-05-30T06:43:00.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.635+0000 7f0715400640 1 Processor -- start 2024-05-30T06:43:00.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.635+0000 7f0715400640 1 -- start start 2024-05-30T06:43:00.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0715400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06f40043a0 0x7f0710155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0715400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0710152150 0x7f0710153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0715400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07101525d0 0x7f071014c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0715400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0710167de0 con 0x7f07101525d0 2024-05-30T06:43:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0715400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0710167c60 con 0x7f06f40043a0 2024-05-30T06:43:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0715400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0710167f60 con 0x7f0710152150 2024-05-30T06:43:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f070f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07101525d0 0x7f071014c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f070f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07101525d0 0x7f071014c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57360/0 (socket says 172.21.15.37:57360) 2024-05-30T06:43:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f070f200640 1 -- 172.21.15.37:0/3674112631 learned_addr learned my addr 172.21.15.37:0/3674112631 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f070e800640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06f40043a0 0x7f0710155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0707e00640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0710152150 0x7f0710153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f070f200640 1 -- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0710152150 msgr2=0x7f0710153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f070f200640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0710152150 0x7f0710153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f070f200640 1 -- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06f40043a0 msgr2=0x7f0710155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f070f200640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06f40043a0 0x7f0710155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f070f200640 1 -- 172.21.15.37:0/3674112631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0710153ff0 con 0x7f07101525d0 2024-05-30T06:43:00.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f070f200640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07101525d0 0x7f071014c8c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f071015fb60 tx=0x7f0708007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:00.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0706a00640 1 -- 172.21.15.37:0/3674112631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070800ab50 con 0x7f07101525d0 2024-05-30T06:43:00.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0706a00640 1 -- 172.21.15.37:0/3674112631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0708019070 con 0x7f07101525d0 2024-05-30T06:43:00.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0715400640 1 -- 172.21.15.37:0/3674112631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07101542d0 con 0x7f07101525d0 2024-05-30T06:43:00.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0706a00640 1 -- 172.21.15.37:0/3674112631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07080133f0 con 0x7f07101525d0 2024-05-30T06:43:00.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0715400640 1 -- 172.21.15.37:0/3674112631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0710154890 con 0x7f07101525d0 2024-05-30T06:43:00.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0715400640 1 -- 172.21.15.37:0/3674112631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0710068bc0 con 0x7f07101525d0 2024-05-30T06:43:00.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.639+0000 7f0706a00640 1 -- 172.21.15.37:0/3674112631 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0708013590 con 0x7f07101525d0 2024-05-30T06:43:00.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.643+0000 7f0706a00640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f06ec0683b0 0x7f06ec06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:00.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.643+0000 7f0706a00640 1 -- 172.21.15.37:0/3674112631 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f0708086be0 con 0x7f07101525d0 2024-05-30T06:43:00.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.643+0000 7f070e800640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f06ec0683b0 0x7f06ec06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:00.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.643+0000 7f070e800640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f06ec0683b0 0x7f06ec06a870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0700009b60 tx=0x7f0700009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:00.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.647+0000 7f0706a00640 1 -- 172.21.15.37:0/3674112631 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0708057450 con 0x7f07101525d0 2024-05-30T06:43:00.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.871+0000 7f0715400640 1 -- 172.21.15.37:0/3674112631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f0710167570 con 0x7f07101525d0 2024-05-30T06:43:00.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.875+0000 7f0706a00640 1 -- 172.21.15.37:0/3674112631 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f0708056d50 con 0x7f07101525d0 2024-05-30T06:43:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.875+0000 7f0715400640 1 -- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f06ec0683b0 msgr2=0x7f06ec06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.875+0000 7f0715400640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f06ec0683b0 0x7f06ec06a870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0700009b60 tx=0x7f0700009190 comp rx=0 tx=0).stop 2024-05-30T06:43:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.875+0000 7f0715400640 1 -- 172.21.15.37:0/3674112631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07101525d0 msgr2=0x7f071014c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.875+0000 7f0715400640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07101525d0 0x7f071014c8c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f071015fb60 tx=0x7f0708007b10 comp rx=0 tx=0).stop 2024-05-30T06:43:00.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.875+0000 7f0715400640 1 -- 172.21.15.37:0/3674112631 shutdown_connections 2024-05-30T06:43:00.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.875+0000 7f0715400640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07101525d0 0x7f071014c8c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.875+0000 7f0715400640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0710152150 0x7f0710153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.875+0000 7f0715400640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f06ec0683b0 0x7f06ec06a870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.875+0000 7f0715400640 1 --2- 172.21.15.37:0/3674112631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06f40043a0 0x7f0710155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:00.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.875+0000 7f0715400640 1 -- 172.21.15.37:0/3674112631 >> 172.21.15.37:0/3674112631 conn(0x7f071006b960 msgr2=0x7f071015b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:00.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.875+0000 7f0715400640 1 -- 172.21.15.37:0/3674112631 shutdown_connections 2024-05-30T06:43:00.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:00.875+0000 7f0715400640 1 -- 172.21.15.37:0/3674112631 wait complete. 2024-05-30T06:43:00.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-30T06:43:01.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.035+0000 7f8be0000640 1 Processor -- start 2024-05-30T06:43:01.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.035+0000 7f8be0000640 1 -- start start 2024-05-30T06:43:01.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.039+0000 7f8be0000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bd815d350 0x7f8bd806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.039+0000 7f8be0000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bd815d7e0 0x7f8bd806e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.039+0000 7f8be0000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bd8142030 con 0x7f8bd80b59d0 2024-05-30T06:43:01.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.039+0000 7f8be0000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8bd8142310 con 0x7f8bd815d350 2024-05-30T06:43:01.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.039+0000 7f8be0000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd81425f0 con 0x7f8bd815d7e0 2024-05-30T06:43:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.039+0000 7f8bdcc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bd815d350 0x7f8bd806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.039+0000 7f8bdcc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bd815d350 0x7f8bd806df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57362/0 (socket says 172.21.15.37:57362) 2024-05-30T06:43:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.039+0000 7f8bdcc00640 1 -- 172.21.15.37:0/1323446463 learned_addr learned my addr 172.21.15.37:0/1323446463 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.039+0000 7f8bde000640 1 --2- 172.21.15.37:0/1323446463 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bd815d7e0 0x7f8bd806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.039+0000 7f8bdcc00640 1 -- 172.21.15.37:0/1323446463 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bd815d7e0 msgr2=0x7f8bd806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.039+0000 7f8bdcc00640 1 --2- 172.21.15.37:0/1323446463 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bd815d7e0 0x7f8bd806e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.039+0000 7f8bdcc00640 1 -- 172.21.15.37:0/1323446463 >> v1:172.21.15.105:6789/0 conn(0x7f8bd80b59d0 legacy=0x7f8bd80b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.039+0000 7f8bdcc00640 1 -- 172.21.15.37:0/1323446463 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd81428d0 con 0x7f8bd815d350 2024-05-30T06:43:01.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8bdcc00640 1 --2- 172.21.15.37:0/1323446463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd815d350 0x7f8bd806df50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40098a0 tx=0x7f8bc401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef2fed70aa9c872 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:01.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8bd7e00640 1 -- 172.21.15.37:0/1323446463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40b5070 con 0x7f8bd815d350 2024-05-30T06:43:01.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8bd7e00640 1 -- 172.21.15.37:0/1323446463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc40a8a30 con 0x7f8bd815d350 2024-05-30T06:43:01.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8bd7e00640 1 -- 172.21.15.37:0/1323446463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40a8e00 con 0x7f8bd815d350 2024-05-30T06:43:01.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8be0000640 1 -- 172.21.15.37:0/1323446463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd815d350 msgr2=0x7f8bd806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8be0000640 1 --2- 172.21.15.37:0/1323446463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd815d350 0x7f8bd806df50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40098a0 tx=0x7f8bc401ed30 comp rx=0 tx=0).stop 2024-05-30T06:43:01.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8be0000640 1 -- 172.21.15.37:0/1323446463 shutdown_connections 2024-05-30T06:43:01.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8be0000640 1 --2- 172.21.15.37:0/1323446463 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bd815d7e0 0x7f8bd806e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8be0000640 1 --2- 172.21.15.37:0/1323446463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd815d350 0x7f8bd806df50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8be0000640 1 -- 172.21.15.37:0/1323446463 >> 172.21.15.37:0/1323446463 conn(0x7f8bd806bf60 msgr2=0x7f8bd80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:01.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8be0000640 1 -- 172.21.15.37:0/1323446463 shutdown_connections 2024-05-30T06:43:01.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8be0000640 1 -- 172.21.15.37:0/1323446463 wait complete. 2024-05-30T06:43:01.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8be0000640 1 Processor -- start 2024-05-30T06:43:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.043+0000 7f8be0000640 1 -- start start 2024-05-30T06:43:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8be0000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bd80b59d0 0x7f8bd8154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8be0000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd815d350 0x7f8bd813efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8be0000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bd815d7e0 0x7f8bd80b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8be0000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd80b00a0 con 0x7f8bd815d350 2024-05-30T06:43:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8be0000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd80aff20 con 0x7f8bd80b59d0 2024-05-30T06:43:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8be0000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd813f860 con 0x7f8bd815d7e0 2024-05-30T06:43:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bdcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd815d350 0x7f8bd813efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bdcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd815d350 0x7f8bd813efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57372/0 (socket says 172.21.15.37:57372) 2024-05-30T06:43:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bdcc00640 1 -- 172.21.15.37:0/2754242744 learned_addr learned my addr 172.21.15.37:0/2754242744 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bdd600640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bd80b59d0 0x7f8bd8154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bde000640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bd815d7e0 0x7f8bd80b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bdcc00640 1 -- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bd815d7e0 msgr2=0x7f8bd80b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bdcc00640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bd815d7e0 0x7f8bd80b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bdcc00640 1 -- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bd80b59d0 msgr2=0x7f8bd8154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bdcc00640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bd80b59d0 0x7f8bd8154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bdcc00640 1 -- 172.21.15.37:0/2754242744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd8153ea0 con 0x7f8bd815d350 2024-05-30T06:43:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bdd600640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bd80b59d0 0x7f8bd8154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bdcc00640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd815d350 0x7f8bd813efd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8bc401c960 tx=0x7f8bc401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bd5600640 1 -- 172.21.15.37:0/2754242744 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40b5070 con 0x7f8bd815d350 2024-05-30T06:43:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bd5600640 1 -- 172.21.15.37:0/2754242744 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc40b0b10 con 0x7f8bd815d350 2024-05-30T06:43:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bd5600640 1 -- 172.21.15.37:0/2754242744 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40bb410 con 0x7f8bd815d350 2024-05-30T06:43:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8be0000640 1 -- 172.21.15.37:0/2754242744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd8154180 con 0x7f8bd815d350 2024-05-30T06:43:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8be0000640 1 -- 172.21.15.37:0/2754242744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd80b5040 con 0x7f8bd815d350 2024-05-30T06:43:01.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8be0000640 1 -- 172.21.15.37:0/2754242744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd8068bc0 con 0x7f8bd815d350 2024-05-30T06:43:01.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.047+0000 7f8bd5600640 1 -- 172.21.15.37:0/2754242744 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8bc40c2060 con 0x7f8bd815d350 2024-05-30T06:43:01.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.051+0000 7f8bd5600640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8bb8068380 0x7f8bb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.051+0000 7f8bd5600640 1 -- 172.21.15.37:0/2754242744 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f8bc41236d0 con 0x7f8bd815d350 2024-05-30T06:43:01.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.051+0000 7f8bdd600640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8bb8068380 0x7f8bb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.051+0000 7f8bdd600640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8bb8068380 0x7f8bb806a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc001670 tx=0x7f8bcc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.055+0000 7f8bd5600640 1 -- 172.21.15.37:0/2754242744 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8bc4018890 con 0x7f8bd815d350 2024-05-30T06:43:01.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.275+0000 7f8be0000640 1 -- 172.21.15.37:0/2754242744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f8bd80b2130 con 0x7f8bd815d350 2024-05-30T06:43:01.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.279+0000 7f8bd5600640 1 -- 172.21.15.37:0/2754242744 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f8bc40f4050 con 0x7f8bd815d350 2024-05-30T06:43:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.279+0000 7f8be0000640 1 -- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8bb8068380 msgr2=0x7f8bb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.279+0000 7f8be0000640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8bb8068380 0x7f8bb806a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc001670 tx=0x7f8bcc009040 comp rx=0 tx=0).stop 2024-05-30T06:43:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.279+0000 7f8be0000640 1 -- 172.21.15.37:0/2754242744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd815d350 msgr2=0x7f8bd813efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.279+0000 7f8be0000640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd815d350 0x7f8bd813efd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8bc401c960 tx=0x7f8bc401bad0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.279+0000 7f8be0000640 1 -- 172.21.15.37:0/2754242744 shutdown_connections 2024-05-30T06:43:01.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.279+0000 7f8be0000640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bd815d7e0 0x7f8bd80b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.279+0000 7f8be0000640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd815d350 0x7f8bd813efd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.279+0000 7f8be0000640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8bb8068380 0x7f8bb806a840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.279+0000 7f8be0000640 1 --2- 172.21.15.37:0/2754242744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bd80b59d0 0x7f8bd8154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.279+0000 7f8be0000640 1 -- 172.21.15.37:0/2754242744 >> 172.21.15.37:0/2754242744 conn(0x7f8bd806bf60 msgr2=0x7f8bd80af030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:01.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.279+0000 7f8be0000640 1 -- 172.21.15.37:0/2754242744 shutdown_connections 2024-05-30T06:43:01.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.279+0000 7f8be0000640 1 -- 172.21.15.37:0/2754242744 wait complete. 2024-05-30T06:43:01.300 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-30T06:43:01.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.443+0000 7f8b86400640 1 Processor -- start 2024-05-30T06:43:01.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.443+0000 7f8b86400640 1 -- start start 2024-05-30T06:43:01.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.443+0000 7f8b86400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b8015d350 0x7f8b8006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.443+0000 7f8b86400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b8015d7e0 0x7f8b8006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.443+0000 7f8b86400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b80142030 con 0x7f8b800b59d0 2024-05-30T06:43:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.443+0000 7f8b86400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8b80142310 con 0x7f8b8015d350 2024-05-30T06:43:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.443+0000 7f8b86400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8b801425f0 con 0x7f8b8015d7e0 2024-05-30T06:43:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.443+0000 7f8b76a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b8015d350 0x7f8b8006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.443+0000 7f8b76a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b8015d350 0x7f8b8006df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57388/0 (socket says 172.21.15.37:57388) 2024-05-30T06:43:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.443+0000 7f8b76a00640 1 -- 172.21.15.37:0/2566018651 learned_addr learned my addr 172.21.15.37:0/2566018651 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.447+0000 7f8b7fe00640 1 --2- 172.21.15.37:0/2566018651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b8015d7e0 0x7f8b8006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.447+0000 7f8b76a00640 1 -- 172.21.15.37:0/2566018651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b8015d7e0 msgr2=0x7f8b8006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.447+0000 7f8b76a00640 1 --2- 172.21.15.37:0/2566018651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b8015d7e0 0x7f8b8006e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.447+0000 7f8b76a00640 1 -- 172.21.15.37:0/2566018651 >> v1:172.21.15.105:6789/0 conn(0x7f8b800b59d0 legacy=0x7f8b800b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.447+0000 7f8b76a00640 1 -- 172.21.15.37:0/2566018651 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b801428d0 con 0x7f8b8015d350 2024-05-30T06:43:01.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.447+0000 7f8b76a00640 1 --2- 172.21.15.37:0/2566018651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8015d350 0x7f8b8006df50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8b680098a0 tx=0x7f8b6801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc5c0348c8570fc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:01.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.447+0000 7f8b7ea00640 1 -- 172.21.15.37:0/2566018651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680b5070 con 0x7f8b8015d350 2024-05-30T06:43:01.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.447+0000 7f8b7ea00640 1 -- 172.21.15.37:0/2566018651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b680a8a30 con 0x7f8b8015d350 2024-05-30T06:43:01.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.447+0000 7f8b7ea00640 1 -- 172.21.15.37:0/2566018651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680a8e00 con 0x7f8b8015d350 2024-05-30T06:43:01.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.447+0000 7f8b86400640 1 -- 172.21.15.37:0/2566018651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8015d350 msgr2=0x7f8b8006df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.447+0000 7f8b86400640 1 --2- 172.21.15.37:0/2566018651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8015d350 0x7f8b8006df50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8b680098a0 tx=0x7f8b6801ed30 comp rx=0 tx=0).stop 2024-05-30T06:43:01.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 -- 172.21.15.37:0/2566018651 shutdown_connections 2024-05-30T06:43:01.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 --2- 172.21.15.37:0/2566018651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b8015d7e0 0x7f8b8006e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 --2- 172.21.15.37:0/2566018651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8015d350 0x7f8b8006df50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 -- 172.21.15.37:0/2566018651 >> 172.21.15.37:0/2566018651 conn(0x7f8b8006bf60 msgr2=0x7f8b800b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:01.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 -- 172.21.15.37:0/2566018651 shutdown_connections 2024-05-30T06:43:01.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 -- 172.21.15.37:0/2566018651 wait complete. 2024-05-30T06:43:01.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 Processor -- start 2024-05-30T06:43:01.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 -- start start 2024-05-30T06:43:01.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b800b59d0 0x7f8b801594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b8015d350 0x7f8b8015edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8015d7e0 0x7f8b8015f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b800b00a0 con 0x7f8b8015d7e0 2024-05-30T06:43:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b800aff20 con 0x7f8b8015d350 2024-05-30T06:43:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b86400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8b8013f860 con 0x7f8b800b59d0 2024-05-30T06:43:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b7fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8015d7e0 0x7f8b8015f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b7fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8015d7e0 0x7f8b8015f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57404/0 (socket says 172.21.15.37:57404) 2024-05-30T06:43:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b7fe00640 1 -- 172.21.15.37:0/77543230 learned_addr learned my addr 172.21.15.37:0/77543230 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b76a00640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b8015d350 0x7f8b8015edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b7f400640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b800b59d0 0x7f8b801594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b7fe00640 1 -- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b800b59d0 msgr2=0x7f8b801594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b7fe00640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b800b59d0 0x7f8b801594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b7fe00640 1 -- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b8015d350 msgr2=0x7f8b8015edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b7fe00640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b8015d350 0x7f8b8015edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b7fe00640 1 -- 172.21.15.37:0/77543230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b80153d20 con 0x7f8b8015d7e0 2024-05-30T06:43:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b76a00640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b8015d350 0x7f8b8015edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:43:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b7fe00640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8015d7e0 0x7f8b8015f330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8b78007e40 tx=0x7f8b7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b77e00640 1 -- 172.21.15.37:0/77543230 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78014620 con 0x7f8b8015d7e0 2024-05-30T06:43:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.451+0000 7f8b77e00640 1 -- 172.21.15.37:0/77543230 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b78019070 con 0x7f8b8015d7e0 2024-05-30T06:43:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.455+0000 7f8b77e00640 1 -- 172.21.15.37:0/77543230 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78014a20 con 0x7f8b8015d7e0 2024-05-30T06:43:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.455+0000 7f8b86400640 1 -- 172.21.15.37:0/77543230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b80154000 con 0x7f8b8015d7e0 2024-05-30T06:43:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.455+0000 7f8b86400640 1 -- 172.21.15.37:0/77543230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b801545c0 con 0x7f8b8015d7e0 2024-05-30T06:43:01.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.455+0000 7f8b86400640 1 -- 172.21.15.37:0/77543230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b80068bc0 con 0x7f8b8015d7e0 2024-05-30T06:43:01.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.455+0000 7f8b77e00640 1 -- 172.21.15.37:0/77543230 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8b78014bc0 con 0x7f8b8015d7e0 2024-05-30T06:43:01.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.455+0000 7f8b77e00640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b5c068380 0x7f8b5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.455+0000 7f8b77e00640 1 -- 172.21.15.37:0/77543230 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f8b78086ec0 con 0x7f8b8015d7e0 2024-05-30T06:43:01.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.455+0000 7f8b7f400640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b5c068380 0x7f8b5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.455+0000 7f8b7f400640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b5c068380 0x7f8b5c06a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8b80141390 tx=0x7f8b70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:01.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.459+0000 7f8b77e00640 1 -- 172.21.15.37:0/77543230 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8b780570e0 con 0x7f8b8015d7e0 2024-05-30T06:43:01.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.683+0000 7f8b86400640 1 -- 172.21.15.37:0/77543230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f8b800757c0 con 0x7f8b8015d7e0 2024-05-30T06:43:01.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.687+0000 7f8b77e00640 1 -- 172.21.15.37:0/77543230 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f8b7805b3e0 con 0x7f8b8015d7e0 2024-05-30T06:43:01.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.687+0000 7f8b86400640 1 -- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b5c068380 msgr2=0x7f8b5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.687+0000 7f8b86400640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b5c068380 0x7f8b5c06a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8b80141390 tx=0x7f8b70009040 comp rx=0 tx=0).stop 2024-05-30T06:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.687+0000 7f8b86400640 1 -- 172.21.15.37:0/77543230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8015d7e0 msgr2=0x7f8b8015f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.687+0000 7f8b86400640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8015d7e0 0x7f8b8015f330 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8b78007e40 tx=0x7f8b7800e4b0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.687+0000 7f8b86400640 1 -- 172.21.15.37:0/77543230 shutdown_connections 2024-05-30T06:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.687+0000 7f8b86400640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b8015d7e0 0x7f8b8015f330 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.687+0000 7f8b86400640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b5c068380 0x7f8b5c06a840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.687+0000 7f8b86400640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b8015d350 0x7f8b8015edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.687+0000 7f8b86400640 1 --2- 172.21.15.37:0/77543230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b800b59d0 0x7f8b801594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.687+0000 7f8b86400640 1 -- 172.21.15.37:0/77543230 >> 172.21.15.37:0/77543230 conn(0x7f8b8006bf60 msgr2=0x7f8b800b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.687+0000 7f8b86400640 1 -- 172.21.15.37:0/77543230 shutdown_connections 2024-05-30T06:43:01.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.687+0000 7f8b86400640 1 -- 172.21.15.37:0/77543230 wait complete. 2024-05-30T06:43:01.707 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-30T06:43:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.847+0000 7febc4a00640 1 Processor -- start 2024-05-30T06:43:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.847+0000 7febc4a00640 1 -- start start 2024-05-30T06:43:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.851+0000 7febc4a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7febc015e8b0 0x7febc00cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.851+0000 7febc4a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febc0163350 con 0x7febc00d1ad0 2024-05-30T06:43:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.851+0000 7febc4a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7febc00cfb30 con 0x7febc006d200 2024-05-30T06:43:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.851+0000 7febc4a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7febc009b880 con 0x7febc015e8b0 2024-05-30T06:43:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.851+0000 7febbe800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7febc00d1ad0 0x7febc009b170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49788/0 (socket says 172.21.15.37:49788) 2024-05-30T06:43:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.851+0000 7febbe800640 1 -- 172.21.15.37:0/3497935945 learned_addr learned my addr 172.21.15.37:0/3497935945 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.851+0000 7febbde00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7febc015e8b0 0x7febc00cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.851+0000 7febbde00640 1 -- 172.21.15.37:0/3497935945 >> v1:172.21.15.105:6789/0 conn(0x7febc006d200 legacy=0x7febc009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.851+0000 7febbde00640 1 -- 172.21.15.37:0/3497935945 >> v1:172.21.15.37:6789/0 conn(0x7febc00d1ad0 legacy=0x7febc009b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.851+0000 7febbde00640 1 -- 172.21.15.37:0/3497935945 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc01627d0 con 0x7febc015e8b0 2024-05-30T06:43:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.851+0000 7febbd400640 1 -- 172.21.15.37:0/3497935945 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 116605750 0 0) 0x7febc0163350 con 0x7febc00d1ad0 2024-05-30T06:43:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febbde00640 1 --2- 172.21.15.37:0/3497935945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febc015e8b0 0x7febc00cf5f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7febb00097c0 tx=0x7febb001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef62ae54b1d2e6f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febbd400640 1 -- 172.21.15.37:0/3497935945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb00b1070 con 0x7febc015e8b0 2024-05-30T06:43:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febbd400640 1 -- 172.21.15.37:0/3497935945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb00ac5f0 con 0x7febc015e8b0 2024-05-30T06:43:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febbd400640 1 -- 172.21.15.37:0/3497935945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb00ac9c0 con 0x7febc015e8b0 2024-05-30T06:43:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febc4a00640 1 -- 172.21.15.37:0/3497935945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febc015e8b0 msgr2=0x7febc00cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febc4a00640 1 --2- 172.21.15.37:0/3497935945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febc015e8b0 0x7febc00cf5f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7febb00097c0 tx=0x7febb001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febc4a00640 1 -- 172.21.15.37:0/3497935945 shutdown_connections 2024-05-30T06:43:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febc4a00640 1 --2- 172.21.15.37:0/3497935945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febc015e8b0 0x7febc00cf5f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febc4a00640 1 -- 172.21.15.37:0/3497935945 >> 172.21.15.37:0/3497935945 conn(0x7febc00b4130 msgr2=0x7febc00b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febc4a00640 1 -- 172.21.15.37:0/3497935945 shutdown_connections 2024-05-30T06:43:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febc4a00640 1 -- 172.21.15.37:0/3497935945 wait complete. 2024-05-30T06:43:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febc4a00640 1 Processor -- start 2024-05-30T06:43:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febc4a00640 1 -- start start 2024-05-30T06:43:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.855+0000 7febc4a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7febc006d200 0x7febc0151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febc4a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febc00d1ad0 0x7febc0151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febc4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febc015e8b0 0x7febc00b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febc4a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7febc0162480 con 0x7febc015e8b0 2024-05-30T06:43:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febc4a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7febc015ec90 con 0x7febc00d1ad0 2024-05-30T06:43:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febc4a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7febc00cf050 con 0x7febc006d200 2024-05-30T06:43:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febbe800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febc015e8b0 0x7febc00b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febbe800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febc015e8b0 0x7febc00b1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57430/0 (socket says 172.21.15.37:57430) 2024-05-30T06:43:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febbe800640 1 -- 172.21.15.37:0/1491363941 learned_addr learned my addr 172.21.15.37:0/1491363941 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febb7e00640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febc00d1ad0 0x7febc0151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febbde00640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7febc006d200 0x7febc0151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febbe800640 1 -- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7febc006d200 msgr2=0x7febc0151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febbe800640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7febc006d200 0x7febc0151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febbe800640 1 -- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febc00d1ad0 msgr2=0x7febc0151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febbe800640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febc00d1ad0 0x7febc0151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febbe800640 1 -- 172.21.15.37:0/1491363941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc01521d0 con 0x7febc015e8b0 2024-05-30T06:43:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febb7e00640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febc00d1ad0 0x7febc0151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febbe800640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febc015e8b0 0x7febc00b1980 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7febb800c7a0 tx=0x7febb800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febb6000640 1 -- 172.21.15.37:0/1491363941 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8018070 con 0x7febc015e8b0 2024-05-30T06:43:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febb6000640 1 -- 172.21.15.37:0/1491363941 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febb800a640 con 0x7febc015e8b0 2024-05-30T06:43:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febc4a00640 1 -- 172.21.15.37:0/1491363941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc00cc350 con 0x7febc015e8b0 2024-05-30T06:43:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febb6000640 1 -- 172.21.15.37:0/1491363941 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb800aab0 con 0x7febc015e8b0 2024-05-30T06:43:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febc4a00640 1 -- 172.21.15.37:0/1491363941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc00cc630 con 0x7febc015e8b0 2024-05-30T06:43:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febc4a00640 1 -- 172.21.15.37:0/1491363941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc0068bc0 con 0x7febc015e8b0 2024-05-30T06:43:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.859+0000 7febb6000640 1 -- 172.21.15.37:0/1491363941 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7febb801b070 con 0x7febc015e8b0 2024-05-30T06:43:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.863+0000 7febb6000640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feb9c068380 0x7feb9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.863+0000 7febb6000640 1 -- 172.21.15.37:0/1491363941 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7febb8085c00 con 0x7febc015e8b0 2024-05-30T06:43:01.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.863+0000 7febbde00640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feb9c068380 0x7feb9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:01.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.863+0000 7febbde00640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feb9c068380 0x7feb9c06a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7febb00ae000 tx=0x7febb00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:01.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:01.867+0000 7febb6000640 1 -- 172.21.15.37:0/1491363941 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7febb8055e20 con 0x7febc015e8b0 2024-05-30T06:43:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.087+0000 7febc4a00640 1 -- 172.21.15.37:0/1491363941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7febc009bba0 con 0x7febc015e8b0 2024-05-30T06:43:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.091+0000 7febb6000640 1 -- 172.21.15.37:0/1491363941 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7febb805a120 con 0x7febc015e8b0 2024-05-30T06:43:02.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.095+0000 7febc4a00640 1 -- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feb9c068380 msgr2=0x7feb9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.095+0000 7febc4a00640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feb9c068380 0x7feb9c06a840 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7febb00ae000 tx=0x7febb00a7000 comp rx=0 tx=0).stop 2024-05-30T06:43:02.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.095+0000 7febc4a00640 1 -- 172.21.15.37:0/1491363941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febc015e8b0 msgr2=0x7febc00b1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.095+0000 7febc4a00640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febc015e8b0 0x7febc00b1980 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7febb800c7a0 tx=0x7febb800cc60 comp rx=0 tx=0).stop 2024-05-30T06:43:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.095+0000 7febc4a00640 1 -- 172.21.15.37:0/1491363941 shutdown_connections 2024-05-30T06:43:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.095+0000 7febc4a00640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febc015e8b0 0x7febc00b1980 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.095+0000 7febc4a00640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feb9c068380 0x7feb9c06a840 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.095+0000 7febc4a00640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7febc00d1ad0 0x7febc0151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.095+0000 7febc4a00640 1 --2- 172.21.15.37:0/1491363941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7febc006d200 0x7febc0151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.095+0000 7febc4a00640 1 -- 172.21.15.37:0/1491363941 >> 172.21.15.37:0/1491363941 conn(0x7febc00b4130 msgr2=0x7febc0075440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.095+0000 7febc4a00640 1 -- 172.21.15.37:0/1491363941 shutdown_connections 2024-05-30T06:43:02.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.095+0000 7febc4a00640 1 -- 172.21.15.37:0/1491363941 wait complete. 2024-05-30T06:43:02.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:43:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.255+0000 7ff06d600640 1 Processor -- start 2024-05-30T06:43:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.255+0000 7ff06d600640 1 -- start start 2024-05-30T06:43:02.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.255+0000 7ff06d600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff06815cf00 0x7ff0680b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.255+0000 7ff06d600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff06806f2f0 con 0x7ff0680b5560 2024-05-30T06:43:02.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.255+0000 7ff06d600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff06806f5d0 con 0x7ff06815ed40 2024-05-30T06:43:02.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.255+0000 7ff06d600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff06815f120 con 0x7ff06815cf00 2024-05-30T06:43:02.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.255+0000 7ff05fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff06815cf00 0x7ff0680b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.255+0000 7ff067400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff0680b5560 0x7ff068165360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49790/0 (socket says 172.21.15.37:49790) 2024-05-30T06:43:02.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.255+0000 7ff067400640 1 -- 172.21.15.37:0/4150086330 learned_addr learned my addr 172.21.15.37:0/4150086330 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.255+0000 7ff05fe00640 1 -- 172.21.15.37:0/4150086330 >> v1:172.21.15.105:6789/0 conn(0x7ff06815ed40 legacy=0x7ff0680b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.255+0000 7ff05fe00640 1 -- 172.21.15.37:0/4150086330 >> v1:172.21.15.37:6789/0 conn(0x7ff0680b5560 legacy=0x7ff068165360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.255+0000 7ff05fe00640 1 -- 172.21.15.37:0/4150086330 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06806f8b0 con 0x7ff06815cf00 2024-05-30T06:43:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.255+0000 7ff066000640 1 -- 172.21.15.37:0/4150086330 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4161028925 0 0) 0x7ff06806f2f0 con 0x7ff0680b5560 2024-05-30T06:43:02.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.259+0000 7ff05fe00640 1 --2- 172.21.15.37:0/4150086330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff06815cf00 0x7ff0680b5020 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff0500097c0 tx=0x7ff05001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6b36b4e7ff3fd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:02.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.259+0000 7ff066000640 1 -- 172.21.15.37:0/4150086330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0500b1070 con 0x7ff06815cf00 2024-05-30T06:43:02.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.259+0000 7ff066000640 1 -- 172.21.15.37:0/4150086330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0500ac5f0 con 0x7ff06815cf00 2024-05-30T06:43:02.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.259+0000 7ff066000640 1 -- 172.21.15.37:0/4150086330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0500ac9c0 con 0x7ff06815cf00 2024-05-30T06:43:02.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.259+0000 7ff06d600640 1 -- 172.21.15.37:0/4150086330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff06815cf00 msgr2=0x7ff0680b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.259+0000 7ff06d600640 1 --2- 172.21.15.37:0/4150086330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff06815cf00 0x7ff0680b5020 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff0500097c0 tx=0x7ff05001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.259+0000 7ff06d600640 1 -- 172.21.15.37:0/4150086330 shutdown_connections 2024-05-30T06:43:02.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.259+0000 7ff06d600640 1 --2- 172.21.15.37:0/4150086330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff06815cf00 0x7ff0680b5020 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.259+0000 7ff06d600640 1 -- 172.21.15.37:0/4150086330 >> 172.21.15.37:0/4150086330 conn(0x7ff0680b6a60 msgr2=0x7ff0680b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:02.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.259+0000 7ff06d600640 1 -- 172.21.15.37:0/4150086330 shutdown_connections 2024-05-30T06:43:02.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.259+0000 7ff06d600640 1 -- 172.21.15.37:0/4150086330 wait complete. 2024-05-30T06:43:02.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff06d600640 1 Processor -- start 2024-05-30T06:43:02.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff06d600640 1 -- start start 2024-05-30T06:43:02.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff06d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0680b5560 0x7ff068144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff06d600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff06815cf00 0x7ff0680b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff06d600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff06815ed40 0x7ff0680b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff06d600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff0681696b0 con 0x7ff0680b5560 2024-05-30T06:43:02.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff06d600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff06815cc00 con 0x7ff06815cf00 2024-05-30T06:43:02.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff06d600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff068169830 con 0x7ff06815ed40 2024-05-30T06:43:02.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff066a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0680b5560 0x7ff068144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff066a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0680b5560 0x7ff068144f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57450/0 (socket says 172.21.15.37:57450) 2024-05-30T06:43:02.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff066a00640 1 -- 172.21.15.37:0/2636284726 learned_addr learned my addr 172.21.15.37:0/2636284726 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:02.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff05fe00640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff06815cf00 0x7ff0680b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff067400640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff06815ed40 0x7ff0680b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff066a00640 1 -- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff06815ed40 msgr2=0x7ff0680b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff066a00640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff06815ed40 0x7ff0680b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff066a00640 1 -- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff06815cf00 msgr2=0x7ff0680b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff066a00640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff06815cf00 0x7ff0680b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff066a00640 1 -- 172.21.15.37:0/2636284726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0681f7c30 con 0x7ff0680b5560 2024-05-30T06:43:02.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff05fe00640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff06815cf00 0x7ff0680b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:02.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff066a00640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0680b5560 0x7ff068144f50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff05800c3c0 tx=0x7ff05800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:02.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff05ea00640 1 -- 172.21.15.37:0/2636284726 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058017070 con 0x7ff0680b5560 2024-05-30T06:43:02.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff05ea00640 1 -- 172.21.15.37:0/2636284726 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0580052d0 con 0x7ff0680b5560 2024-05-30T06:43:02.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff05ea00640 1 -- 172.21.15.37:0/2636284726 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058003840 con 0x7ff0680b5560 2024-05-30T06:43:02.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff06d600640 1 -- 172.21.15.37:0/2636284726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff068153060 con 0x7ff0680b5560 2024-05-30T06:43:02.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff06d600640 1 -- 172.21.15.37:0/2636284726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff068153620 con 0x7ff0680b5560 2024-05-30T06:43:02.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.263+0000 7ff06d600640 1 -- 172.21.15.37:0/2636284726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff068068b20 con 0x7ff0680b5560 2024-05-30T06:43:02.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.267+0000 7ff05ea00640 1 -- 172.21.15.37:0/2636284726 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff05801a070 con 0x7ff0680b5560 2024-05-30T06:43:02.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.267+0000 7ff05ea00640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff044068380 0x7ff04406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.267+0000 7ff05ea00640 1 -- 172.21.15.37:0/2636284726 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7ff0580859e0 con 0x7ff0680b5560 2024-05-30T06:43:02.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.267+0000 7ff05fe00640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff044068380 0x7ff04406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.267+0000 7ff05fe00640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff044068380 0x7ff04406a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff0500ae000 tx=0x7ff050008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:02.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.271+0000 7ff05ea00640 1 -- 172.21.15.37:0/2636284726 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff058005480 con 0x7ff0680b5560 2024-05-30T06:43:02.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.435+0000 7ff06d600640 1 -- 172.21.15.37:0/2636284726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff068154fe0 con 0x7ff0680b5560 2024-05-30T06:43:02.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.435+0000 7ff05ea00640 1 -- 172.21.15.37:0/2636284726 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+12879 (secure 0 0 0) 0x7ff058056250 con 0x7ff0680b5560 2024-05-30T06:43:02.436 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:43:02.436 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:42:59.252846+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:43:02.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.439+0000 7ff06d600640 1 -- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff044068380 msgr2=0x7ff04406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.439+0000 7ff06d600640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff044068380 0x7ff04406a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff0500ae000 tx=0x7ff050008040 comp rx=0 tx=0).stop 2024-05-30T06:43:02.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.439+0000 7ff06d600640 1 -- 172.21.15.37:0/2636284726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0680b5560 msgr2=0x7ff068144f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.439+0000 7ff06d600640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0680b5560 0x7ff068144f50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff05800c3c0 tx=0x7ff05800c880 comp rx=0 tx=0).stop 2024-05-30T06:43:02.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.439+0000 7ff06d600640 1 -- 172.21.15.37:0/2636284726 shutdown_connections 2024-05-30T06:43:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.439+0000 7ff06d600640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff06815ed40 0x7ff0680b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.439+0000 7ff06d600640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff044068380 0x7ff04406a840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.439+0000 7ff06d600640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff06815cf00 0x7ff0680b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.439+0000 7ff06d600640 1 --2- 172.21.15.37:0/2636284726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0680b5560 0x7ff068144f50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.439+0000 7ff06d600640 1 -- 172.21.15.37:0/2636284726 >> 172.21.15.37:0/2636284726 conn(0x7ff0680b6a60 msgr2=0x7ff068075360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:02.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.439+0000 7ff06d600640 1 -- 172.21.15.37:0/2636284726 shutdown_connections 2024-05-30T06:43:02.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.439+0000 7ff06d600640 1 -- 172.21.15.37:0/2636284726 wait complete. 2024-05-30T06:43:02.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:43:02.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:43:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.599+0000 7f96b3200640 1 Processor -- start 2024-05-30T06:43:02.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96b3200640 1 -- start start 2024-05-30T06:43:02.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96b3200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96ac155da0 0x7f96ac0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96b3200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96ac06f770 0x7f96ac0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96b3200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96ac15f310 con 0x7f96ac0cd440 2024-05-30T06:43:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96b3200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f96ac15f5f0 con 0x7f96ac155da0 2024-05-30T06:43:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96b3200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f96ac15f8d0 con 0x7f96ac06f770 2024-05-30T06:43:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96abe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96ac155da0 0x7f96ac0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96a3400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f96ac0cd440 0x7f96ac06f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49796/0 (socket says 172.21.15.37:49796) 2024-05-30T06:43:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96a3400640 1 -- 172.21.15.37:0/2176860327 learned_addr learned my addr 172.21.15.37:0/2176860327 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96b1200640 1 --2- 172.21.15.37:0/2176860327 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96ac06f770 0x7f96ac0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96abe00640 1 -- 172.21.15.37:0/2176860327 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96ac06f770 msgr2=0x7f96ac0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96abe00640 1 --2- 172.21.15.37:0/2176860327 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96ac06f770 0x7f96ac0b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96abe00640 1 -- 172.21.15.37:0/2176860327 >> v1:172.21.15.37:6789/0 conn(0x7f96ac0cd440 legacy=0x7f96ac06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96abe00640 1 -- 172.21.15.37:0/2176860327 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ac15fbb0 con 0x7f96ac155da0 2024-05-30T06:43:02.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.603+0000 7f96ab400640 1 -- 172.21.15.37:0/2176860327 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1322803895 0 0) 0x7f96ac15f310 con 0x7f96ac0cd440 2024-05-30T06:43:02.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96abe00640 1 --2- 172.21.15.37:0/2176860327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96ac155da0 0x7f96ac0cd950 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f969c009d90 tx=0x7f969c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10395609879a0d8a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:02.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96ab400640 1 -- 172.21.15.37:0/2176860327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0b2070 con 0x7f96ac155da0 2024-05-30T06:43:02.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96ab400640 1 -- 172.21.15.37:0/2176860327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c0a5710 con 0x7f96ac155da0 2024-05-30T06:43:02.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96ab400640 1 -- 172.21.15.37:0/2176860327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0a5ae0 con 0x7f96ac155da0 2024-05-30T06:43:02.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96b3200640 1 -- 172.21.15.37:0/2176860327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96ac155da0 msgr2=0x7f96ac0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96b3200640 1 --2- 172.21.15.37:0/2176860327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96ac155da0 0x7f96ac0cd950 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f969c009d90 tx=0x7f969c01c850 comp rx=0 tx=0).stop 2024-05-30T06:43:02.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96b3200640 1 -- 172.21.15.37:0/2176860327 shutdown_connections 2024-05-30T06:43:02.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96b3200640 1 --2- 172.21.15.37:0/2176860327 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96ac06f770 0x7f96ac0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96b3200640 1 --2- 172.21.15.37:0/2176860327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96ac155da0 0x7f96ac0cd950 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96b3200640 1 -- 172.21.15.37:0/2176860327 >> 172.21.15.37:0/2176860327 conn(0x7f96ac06bf60 msgr2=0x7f96ac0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:02.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96b3200640 1 -- 172.21.15.37:0/2176860327 shutdown_connections 2024-05-30T06:43:02.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96b3200640 1 -- 172.21.15.37:0/2176860327 wait complete. 2024-05-30T06:43:02.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96b3200640 1 Processor -- start 2024-05-30T06:43:02.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.607+0000 7f96b3200640 1 -- start start 2024-05-30T06:43:02.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96b3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96ac06f770 0x7f96ac154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96b3200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96ac155da0 0x7f96ac1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96b3200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96ac071dc0 0x7f96ac072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96b3200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac06df50 con 0x7f96ac06f770 2024-05-30T06:43:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96b3200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f96ac0b46f0 con 0x7f96ac071dc0 2024-05-30T06:43:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96b3200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f96ac06e0d0 con 0x7f96ac155da0 2024-05-30T06:43:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96abe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96ac06f770 0x7f96ac154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96abe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96ac06f770 0x7f96ac154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57466/0 (socket says 172.21.15.37:57466) 2024-05-30T06:43:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96abe00640 1 -- 172.21.15.37:0/955118802 learned_addr learned my addr 172.21.15.37:0/955118802 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96b1200640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96ac071dc0 0x7f96ac072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96a3400640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96ac155da0 0x7f96ac1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96abe00640 1 -- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96ac155da0 msgr2=0x7f96ac1536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96abe00640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96ac155da0 0x7f96ac1536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96abe00640 1 -- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96ac071dc0 msgr2=0x7f96ac072270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96abe00640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96ac071dc0 0x7f96ac072270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96abe00640 1 -- 172.21.15.37:0/955118802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ac153ef0 con 0x7f96ac06f770 2024-05-30T06:43:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96b1200640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96ac071dc0 0x7f96ac072270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96a3400640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96ac155da0 0x7f96ac1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96abe00640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96ac06f770 0x7f96ac154f90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f969c0b0040 tx=0x7f969c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96a8c00640 1 -- 172.21.15.37:0/955118802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0b2050 con 0x7f96ac06f770 2024-05-30T06:43:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96a8c00640 1 -- 172.21.15.37:0/955118802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c0be070 con 0x7f96ac06f770 2024-05-30T06:43:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96a8c00640 1 -- 172.21.15.37:0/955118802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c0ad850 con 0x7f96ac06f770 2024-05-30T06:43:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96b3200640 1 -- 172.21.15.37:0/955118802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ac1541d0 con 0x7f96ac06f770 2024-05-30T06:43:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96b3200640 1 -- 172.21.15.37:0/955118802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ac154790 con 0x7f96ac06f770 2024-05-30T06:43:02.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96b3200640 1 -- 172.21.15.37:0/955118802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ac068bc0 con 0x7f96ac06f770 2024-05-30T06:43:02.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.611+0000 7f96a8c00640 1 -- 172.21.15.37:0/955118802 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f969c0ad9f0 con 0x7f96ac06f770 2024-05-30T06:43:02.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.615+0000 7f96a8c00640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9688068380 0x7f968806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.615+0000 7f96a8c00640 1 -- 172.21.15.37:0/955118802 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f969c1219a0 con 0x7f96ac06f770 2024-05-30T06:43:02.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.615+0000 7f96a3400640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9688068380 0x7f968806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.615+0000 7f96a3400640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9688068380 0x7f968806a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9694007fd0 tx=0x7f9694007c20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:02.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.619+0000 7f96a8c00640 1 -- 172.21.15.37:0/955118802 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f969c016560 con 0x7f96ac06f770 2024-05-30T06:43:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96b3200640 1 -- 172.21.15.37:0/955118802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f96ac0b6790 con 0x7f96ac06f770 2024-05-30T06:43:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96a8c00640 1 -- 172.21.15.37:0/955118802 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f969c0f2330 con 0x7f96ac06f770 2024-05-30T06:43:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:43:02.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96b3200640 1 -- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9688068380 msgr2=0x7f968806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96b3200640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9688068380 0x7f968806a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9694007fd0 tx=0x7f9694007c20 comp rx=0 tx=0).stop 2024-05-30T06:43:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96b3200640 1 -- 172.21.15.37:0/955118802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96ac06f770 msgr2=0x7f96ac154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96b3200640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96ac06f770 0x7f96ac154f90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f969c0b0040 tx=0x7f969c0195f0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96b3200640 1 -- 172.21.15.37:0/955118802 shutdown_connections 2024-05-30T06:43:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96b3200640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9688068380 0x7f968806a840 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96b3200640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96ac071dc0 0x7f96ac072270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96b3200640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96ac155da0 0x7f96ac1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96b3200640 1 --2- 172.21.15.37:0/955118802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96ac06f770 0x7f96ac154f90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96b3200640 1 -- 172.21.15.37:0/955118802 >> 172.21.15.37:0/955118802 conn(0x7f96ac06bf60 msgr2=0x7f96ac0b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96b3200640 1 -- 172.21.15.37:0/955118802 shutdown_connections 2024-05-30T06:43:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.783+0000 7f96b3200640 1 -- 172.21.15.37:0/955118802 wait complete. 2024-05-30T06:43:02.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T06:43:02.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.943+0000 7f086f000640 1 Processor -- start 2024-05-30T06:43:02.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.943+0000 7f086f000640 1 -- start start 2024-05-30T06:43:02.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f086f000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0868155e60 0x7f08680b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f086f000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08680b2ec0 0x7f08680cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f086f000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086815c8f0 con 0x7f086806f9a0 2024-05-30T06:43:02.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f086f000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f08680ccff0 con 0x7f0868155e60 2024-05-30T06:43:02.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f086f000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f08680ccc80 con 0x7f08680b2ec0 2024-05-30T06:43:02.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f0867e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0868155e60 0x7f08680b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f086d000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08680b2ec0 0x7f08680cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f085fe00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f086806f9a0 0x7f08680cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:53998/0 (socket says 172.21.15.37:53998) 2024-05-30T06:43:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f085fe00640 1 -- 172.21.15.37:0/159310852 learned_addr learned my addr 172.21.15.37:0/159310852 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f0867400640 1 -- 172.21.15.37:0/159310852 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 976410163 0 0) 0x7f086815c8f0 con 0x7f086806f9a0 2024-05-30T06:43:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f0867400640 1 -- 172.21.15.37:0/159310852 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f084c003530 con 0x7f086806f9a0 2024-05-30T06:43:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f0867e00640 1 -- 172.21.15.37:0/159310852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08680b2ec0 msgr2=0x7f08680cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f0867e00640 1 --2- 172.21.15.37:0/159310852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08680b2ec0 0x7f08680cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f0867e00640 1 -- 172.21.15.37:0/159310852 >> v1:172.21.15.105:6789/0 conn(0x7f086806f9a0 legacy=0x7f08680cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f0867e00640 1 -- 172.21.15.37:0/159310852 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086815cbd0 con 0x7f0868155e60 2024-05-30T06:43:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.947+0000 7f086d000640 1 --2- 172.21.15.37:0/159310852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08680b2ec0 0x7f08680cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:43:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f0867e00640 1 --2- 172.21.15.37:0/159310852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0868155e60 0x7f08680b36a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f08580097c0 tx=0x7f085801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0c711a8f797585f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f0867400640 1 -- 172.21.15.37:0/159310852 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08580b1070 con 0x7f0868155e60 2024-05-30T06:43:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f0867400640 1 -- 172.21.15.37:0/159310852 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08580ac410 con 0x7f0868155e60 2024-05-30T06:43:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f0867400640 1 -- 172.21.15.37:0/159310852 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08580ac7e0 con 0x7f0868155e60 2024-05-30T06:43:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f086f000640 1 -- 172.21.15.37:0/159310852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0868155e60 msgr2=0x7f08680b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f086f000640 1 --2- 172.21.15.37:0/159310852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0868155e60 0x7f08680b36a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f08580097c0 tx=0x7f085801c4a0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f086f000640 1 -- 172.21.15.37:0/159310852 shutdown_connections 2024-05-30T06:43:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f086f000640 1 --2- 172.21.15.37:0/159310852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08680b2ec0 0x7f08680cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f086f000640 1 --2- 172.21.15.37:0/159310852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0868155e60 0x7f08680b36a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f086f000640 1 -- 172.21.15.37:0/159310852 >> 172.21.15.37:0/159310852 conn(0x7f08680b23a0 msgr2=0x7f08680b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f086f000640 1 -- 172.21.15.37:0/159310852 shutdown_connections 2024-05-30T06:43:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f086f000640 1 -- 172.21.15.37:0/159310852 wait complete. 2024-05-30T06:43:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f086f000640 1 Processor -- start 2024-05-30T06:43:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.951+0000 7f086f000640 1 -- start start 2024-05-30T06:43:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086f000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f086806f9a0 0x7f086814a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086f000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08680b2ec0 0x7f0868154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086f000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0868155e60 0x7f086815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086f000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f086806ec20 con 0x7f0868155e60 2024-05-30T06:43:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086f000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f086806eaa0 con 0x7f086806f9a0 2024-05-30T06:43:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086f000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f086806eda0 con 0x7f08680b2ec0 2024-05-30T06:43:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0868155e60 0x7f086815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0868155e60 0x7f086815a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57480/0 (socket says 172.21.15.37:57480) 2024-05-30T06:43:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086d000640 1 -- 172.21.15.37:0/3933666199 learned_addr learned my addr 172.21.15.37:0/3933666199 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f0867e00640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f086806f9a0 0x7f086814a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f085fe00640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08680b2ec0 0x7f0868154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086d000640 1 -- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08680b2ec0 msgr2=0x7f0868154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086d000640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08680b2ec0 0x7f0868154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086d000640 1 -- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f086806f9a0 msgr2=0x7f086814a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086d000640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f086806f9a0 0x7f086814a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086d000640 1 -- 172.21.15.37:0/3933666199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0868153b00 con 0x7f0868155e60 2024-05-30T06:43:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086d000640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0868155e60 0x7f086815a650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f086000efc0 tx=0x7f0860009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f0864c00640 1 -- 172.21.15.37:0/3933666199 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860018030 con 0x7f0868155e60 2024-05-30T06:43:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f0864c00640 1 -- 172.21.15.37:0/3933666199 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f086000cde0 con 0x7f0868155e60 2024-05-30T06:43:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f0864c00640 1 -- 172.21.15.37:0/3933666199 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0860003bc0 con 0x7f0868155e60 2024-05-30T06:43:02.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086f000640 1 -- 172.21.15.37:0/3933666199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0868153de0 con 0x7f0868155e60 2024-05-30T06:43:02.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086f000640 1 -- 172.21.15.37:0/3933666199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08681543a0 con 0x7f0868155e60 2024-05-30T06:43:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.955+0000 7f086f000640 1 -- 172.21.15.37:0/3933666199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0868068b20 con 0x7f0868155e60 2024-05-30T06:43:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.959+0000 7f0864c00640 1 -- 172.21.15.37:0/3933666199 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f086001b070 con 0x7f0868155e60 2024-05-30T06:43:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.959+0000 7f0864c00640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0844068380 0x7f084406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.959+0000 7f0864c00640 1 -- 172.21.15.37:0/3933666199 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f0860086f80 con 0x7f0868155e60 2024-05-30T06:43:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.959+0000 7f0867e00640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0844068380 0x7f084406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.959+0000 7f0867e00640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0844068380 0x7f084406a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f08580ae000 tx=0x7f0858008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:02.963+0000 7f0864c00640 1 -- 172.21.15.37:0/3933666199 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0860010040 con 0x7f0868155e60 2024-05-30T06:43:03.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.127+0000 7f086f000640 1 -- 172.21.15.37:0/3933666199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0868072fb0 con 0x7f0868155e60 2024-05-30T06:43:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.127+0000 7f0864c00640 1 -- 172.21.15.37:0/3933666199 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7f0860057230 con 0x7f0868155e60 2024-05-30T06:43:03.128 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:43:03.128 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:43:03.128 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:43:03.129 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-30T06:43:03.129 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-30T06:43:03.129 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:43:03.129 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:43:03.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.131+0000 7f086f000640 1 -- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0844068380 msgr2=0x7f084406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:03.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.131+0000 7f086f000640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0844068380 0x7f084406a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f08580ae000 tx=0x7f0858008040 comp rx=0 tx=0).stop 2024-05-30T06:43:03.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.131+0000 7f086f000640 1 -- 172.21.15.37:0/3933666199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0868155e60 msgr2=0x7f086815a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:03.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.131+0000 7f086f000640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0868155e60 0x7f086815a650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f086000efc0 tx=0x7f0860009f90 comp rx=0 tx=0).stop 2024-05-30T06:43:03.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.131+0000 7f086f000640 1 -- 172.21.15.37:0/3933666199 shutdown_connections 2024-05-30T06:43:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.131+0000 7f086f000640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0868155e60 0x7f086815a650 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.131+0000 7f086f000640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08680b2ec0 0x7f0868154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.131+0000 7f086f000640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0844068380 0x7f084406a840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.131+0000 7f086f000640 1 --2- 172.21.15.37:0/3933666199 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f086806f9a0 0x7f086814a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.131+0000 7f086f000640 1 -- 172.21.15.37:0/3933666199 >> 172.21.15.37:0/3933666199 conn(0x7f08680b23a0 msgr2=0x7f086815d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.131+0000 7f086f000640 1 -- 172.21.15.37:0/3933666199 shutdown_connections 2024-05-30T06:43:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.131+0000 7f086f000640 1 -- 172.21.15.37:0/3933666199 wait complete. 2024-05-30T06:43:03.149 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T06:43:03.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T06:43:03.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.299+0000 7f6a65e00640 1 Processor -- start 2024-05-30T06:43:03.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.299+0000 7f6a65e00640 1 -- start start 2024-05-30T06:43:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.299+0000 7f6a65e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a601590c0 0x7f6a600cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.299+0000 7f6a65e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6015f230 con 0x7f6a600cde60 2024-05-30T06:43:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.299+0000 7f6a65e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a6015f510 con 0x7f6a600cd400 2024-05-30T06:43:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.299+0000 7f6a65e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6a6015f7f0 con 0x7f6a601590c0 2024-05-30T06:43:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.299+0000 7f6a5ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a601590c0 0x7f6a600cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.299+0000 7f6a5e000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6a600cde60 0x7f6a6006f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49798/0 (socket says 172.21.15.37:49798) 2024-05-30T06:43:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.299+0000 7f6a5e000640 1 -- 172.21.15.37:0/794850059 learned_addr learned my addr 172.21.15.37:0/794850059 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.299+0000 7f6a5ea00640 1 -- 172.21.15.37:0/794850059 >> v1:172.21.15.105:6789/0 conn(0x7f6a600cd400 legacy=0x7f6a600b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.299+0000 7f6a5ea00640 1 -- 172.21.15.37:0/794850059 >> v1:172.21.15.37:6789/0 conn(0x7f6a600cde60 legacy=0x7f6a6006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.299+0000 7f6a5ea00640 1 -- 172.21.15.37:0/794850059 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6015fad0 con 0x7f6a601590c0 2024-05-30T06:43:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.299+0000 7f6a5d600640 1 -- 172.21.15.37:0/794850059 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3534913673 0 0) 0x7f6a6015f230 con 0x7f6a600cde60 2024-05-30T06:43:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.303+0000 7f6a5ea00640 1 --2- 172.21.15.37:0/794850059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a601590c0 0x7f6a600cd920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6a580097c0 tx=0x7f6a5801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df111dbe3d41424 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.303+0000 7f6a5d600640 1 -- 172.21.15.37:0/794850059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a580b0070 con 0x7f6a601590c0 2024-05-30T06:43:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.303+0000 7f6a5d600640 1 -- 172.21.15.37:0/794850059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a580ab600 con 0x7f6a601590c0 2024-05-30T06:43:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.303+0000 7f6a5d600640 1 -- 172.21.15.37:0/794850059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a580ab9d0 con 0x7f6a601590c0 2024-05-30T06:43:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.303+0000 7f6a65e00640 1 -- 172.21.15.37:0/794850059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a601590c0 msgr2=0x7f6a600cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.303+0000 7f6a65e00640 1 --2- 172.21.15.37:0/794850059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a601590c0 0x7f6a600cd920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6a580097c0 tx=0x7f6a5801c340 comp rx=0 tx=0).stop 2024-05-30T06:43:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.303+0000 7f6a65e00640 1 -- 172.21.15.37:0/794850059 shutdown_connections 2024-05-30T06:43:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.303+0000 7f6a65e00640 1 --2- 172.21.15.37:0/794850059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a601590c0 0x7f6a600cd920 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.303+0000 7f6a65e00640 1 -- 172.21.15.37:0/794850059 >> 172.21.15.37:0/794850059 conn(0x7f6a6006bf60 msgr2=0x7f6a600b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.303+0000 7f6a65e00640 1 -- 172.21.15.37:0/794850059 shutdown_connections 2024-05-30T06:43:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.303+0000 7f6a65e00640 1 -- 172.21.15.37:0/794850059 wait complete. 2024-05-30T06:43:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.303+0000 7f6a65e00640 1 Processor -- start 2024-05-30T06:43:03.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.303+0000 7f6a65e00640 1 -- start start 2024-05-30T06:43:03.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a65e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a600cd400 0x7f6a6014d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a65e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a600cde60 0x7f6a60151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a65e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a601590c0 0x7f6a60152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a65e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6006df50 con 0x7f6a600cd400 2024-05-30T06:43:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a65e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a600b4670 con 0x7f6a600cde60 2024-05-30T06:43:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a65e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6006e0d0 con 0x7f6a601590c0 2024-05-30T06:43:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a5ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a600cd400 0x7f6a6014d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a5ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a600cd400 0x7f6a6014d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57496/0 (socket says 172.21.15.37:57496) 2024-05-30T06:43:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a5ea00640 1 -- 172.21.15.37:0/1418671086 learned_addr learned my addr 172.21.15.37:0/1418671086 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a5ea00640 1 -- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a601590c0 msgr2=0x7f6a60152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:03.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a5ea00640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a601590c0 0x7f6a60152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a5e000640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a600cde60 0x7f6a60151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a5ea00640 1 -- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a600cde60 msgr2=0x7f6a60151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a5ea00640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a600cde60 0x7f6a60151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a5ea00640 1 -- 172.21.15.37:0/1418671086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a60159840 con 0x7f6a600cd400 2024-05-30T06:43:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a5e000640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a600cde60 0x7f6a60151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:43:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a5ea00640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a600cd400 0x7f6a6014d3b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6a580ae040 tx=0x7f6a5801ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a57400640 1 -- 172.21.15.37:0/1418671086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a580b0050 con 0x7f6a600cd400 2024-05-30T06:43:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a57400640 1 -- 172.21.15.37:0/1418671086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a580bc070 con 0x7f6a600cd400 2024-05-30T06:43:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a65e00640 1 -- 172.21.15.37:0/1418671086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a60159b20 con 0x7f6a600cd400 2024-05-30T06:43:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a57400640 1 -- 172.21.15.37:0/1418671086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a580b5a70 con 0x7f6a600cd400 2024-05-30T06:43:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a65e00640 1 -- 172.21.15.37:0/1418671086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6014d8f0 con 0x7f6a600cd400 2024-05-30T06:43:03.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a65e00640 1 -- 172.21.15.37:0/1418671086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a60068d40 con 0x7f6a600cd400 2024-05-30T06:43:03.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.307+0000 7f6a57400640 1 -- 172.21.15.37:0/1418671086 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6a580ab4c0 con 0x7f6a600cd400 2024-05-30T06:43:03.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.311+0000 7f6a57400640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6a3c068380 0x7f6a3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:03.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.311+0000 7f6a57400640 1 -- 172.21.15.37:0/1418671086 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f6a58120f70 con 0x7f6a600cd400 2024-05-30T06:43:03.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.311+0000 7f6a5e000640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6a3c068380 0x7f6a3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:03.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.311+0000 7f6a5e000640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6a3c068380 0x7f6a3c06a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a601fab30 tx=0x7f6a48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:03.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.315+0000 7f6a57400640 1 -- 172.21.15.37:0/1418671086 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6a58016050 con 0x7f6a600cd400 2024-05-30T06:43:03.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:03.479+0000 7f6a65e00640 1 -- 172.21.15.37:0/1418671086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6a600b31b0 con 0x7f6a600cd400 2024-05-30T06:43:03.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:43:03.817 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:43:04.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.259+0000 7f6a57400640 1 -- 172.21.15.37:0/1418671086 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7f6a580f1870 con 0x7f6a600cd400 2024-05-30T06:43:04.261 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-30T06:43:04.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.267+0000 7f6a65e00640 1 -- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6a3c068380 msgr2=0x7f6a3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:04.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.267+0000 7f6a65e00640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6a3c068380 0x7f6a3c06a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a601fab30 tx=0x7f6a48009040 comp rx=0 tx=0).stop 2024-05-30T06:43:04.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.267+0000 7f6a65e00640 1 -- 172.21.15.37:0/1418671086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a600cd400 msgr2=0x7f6a6014d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:04.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.267+0000 7f6a65e00640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a600cd400 0x7f6a6014d3b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6a580ae040 tx=0x7f6a5801ab80 comp rx=0 tx=0).stop 2024-05-30T06:43:04.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.267+0000 7f6a65e00640 1 -- 172.21.15.37:0/1418671086 shutdown_connections 2024-05-30T06:43:04.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.267+0000 7f6a65e00640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a601590c0 0x7f6a60152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:04.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.267+0000 7f6a65e00640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6a3c068380 0x7f6a3c06a840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:04.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.267+0000 7f6a65e00640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a600cde60 0x7f6a60151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:04.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.267+0000 7f6a65e00640 1 --2- 172.21.15.37:0/1418671086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a600cd400 0x7f6a6014d3b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:04.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.267+0000 7f6a65e00640 1 -- 172.21.15.37:0/1418671086 >> 172.21.15.37:0/1418671086 conn(0x7f6a6006bf60 msgr2=0x7f6a600b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:04.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.267+0000 7f6a65e00640 1 -- 172.21.15.37:0/1418671086 shutdown_connections 2024-05-30T06:43:04.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.267+0000 7f6a65e00640 1 -- 172.21.15.37:0/1418671086 wait complete. 2024-05-30T06:43:04.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T06:43:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2e600640 1 Processor -- start 2024-05-30T06:43:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2e600640 1 -- start start 2024-05-30T06:43:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2e600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb2809acc0 0x7fbb280ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2e600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb2809b0a0 0x7fbb280b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2e600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb280d0f20 con 0x7fbb280b1d30 2024-05-30T06:43:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2e600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbb280b1b30 con 0x7fbb2809acc0 2024-05-30T06:43:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2e600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbb280d1200 con 0x7fbb2809b0a0 2024-05-30T06:43:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2d200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb2809acc0 0x7fbb280ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2d200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb2809acc0 0x7fbb280ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57504/0 (socket says 172.21.15.37:57504) 2024-05-30T06:43:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2d200640 1 -- 172.21.15.37:0/353605163 learned_addr learned my addr 172.21.15.37:0/353605163 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2dc00640 1 --2- 172.21.15.37:0/353605163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb2809b0a0 0x7fbb280b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2d200640 1 -- 172.21.15.37:0/353605163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb2809b0a0 msgr2=0x7fbb280b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2d200640 1 --2- 172.21.15.37:0/353605163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb2809b0a0 0x7fbb280b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2d200640 1 -- 172.21.15.37:0/353605163 >> v1:172.21.15.105:6789/0 conn(0x7fbb280b1d30 legacy=0x7fbb280cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2d200640 1 -- 172.21.15.37:0/353605163 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb280d14e0 con 0x7fbb2809acc0 2024-05-30T06:43:04.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.447+0000 7fbb2dc00640 1 --2- 172.21.15.37:0/353605163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb2809b0a0 0x7fbb280b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:04.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb2d200640 1 --2- 172.21.15.37:0/353605163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb2809acc0 0x7fbb280ce9d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009870 tx=0x7fbb1801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f208d7987ce525fc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb27e00640 1 -- 172.21.15.37:0/353605163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb180b0070 con 0x7fbb2809acc0 2024-05-30T06:43:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb27e00640 1 -- 172.21.15.37:0/353605163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb180ab600 con 0x7fbb2809acc0 2024-05-30T06:43:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb27e00640 1 -- 172.21.15.37:0/353605163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb180ab9d0 con 0x7fbb2809acc0 2024-05-30T06:43:04.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb2e600640 1 -- 172.21.15.37:0/353605163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb2809acc0 msgr2=0x7fbb280ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:04.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb2e600640 1 --2- 172.21.15.37:0/353605163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb2809acc0 0x7fbb280ce9d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009870 tx=0x7fbb1801c4d0 comp rx=0 tx=0).stop 2024-05-30T06:43:04.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb2e600640 1 -- 172.21.15.37:0/353605163 shutdown_connections 2024-05-30T06:43:04.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb2e600640 1 --2- 172.21.15.37:0/353605163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb2809b0a0 0x7fbb280b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:04.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb2e600640 1 --2- 172.21.15.37:0/353605163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb2809acc0 0x7fbb280ce9d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:04.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb2e600640 1 -- 172.21.15.37:0/353605163 >> 172.21.15.37:0/353605163 conn(0x7fbb280b3fd0 msgr2=0x7fbb280b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:04.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb2e600640 1 -- 172.21.15.37:0/353605163 shutdown_connections 2024-05-30T06:43:04.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb2e600640 1 -- 172.21.15.37:0/353605163 wait complete. 2024-05-30T06:43:04.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb2e600640 1 Processor -- start 2024-05-30T06:43:04.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.451+0000 7fbb2e600640 1 -- start start 2024-05-30T06:43:04.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb2809acc0 0x7fbb281478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:04.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2e600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb2809b0a0 0x7fbb2815dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:04.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2e600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb280b1d30 0x7fbb2815e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:04.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2e600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb28169b20 con 0x7fbb2809acc0 2024-05-30T06:43:04.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2e600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbb28161420 con 0x7fbb280b1d30 2024-05-30T06:43:04.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2e600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbb28169ca0 con 0x7fbb2809b0a0 2024-05-30T06:43:04.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb2809acc0 0x7fbb281478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:04.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb2809acc0 0x7fbb281478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57510/0 (socket says 172.21.15.37:57510) 2024-05-30T06:43:04.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2d200640 1 -- 172.21.15.37:0/1255870582 learned_addr learned my addr 172.21.15.37:0/1255870582 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:04.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2dc00640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb280b1d30 0x7fbb2815e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:04.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb1fe00640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb2809b0a0 0x7fbb2815dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:04.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2d200640 1 -- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb2809b0a0 msgr2=0x7fbb2815dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:04.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2d200640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb2809b0a0 0x7fbb2815dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:04.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2d200640 1 -- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb280b1d30 msgr2=0x7fbb2815e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:04.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2d200640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb280b1d30 0x7fbb2815e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:04.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2d200640 1 -- 172.21.15.37:0/1255870582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb28147e00 con 0x7fbb2809acc0 2024-05-30T06:43:04.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2d200640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb2809acc0 0x7fbb281478c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbb180ae040 tx=0x7fbb18019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:04.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb25600640 1 -- 172.21.15.37:0/1255870582 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb180b0040 con 0x7fbb2809acc0 2024-05-30T06:43:04.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb25600640 1 -- 172.21.15.37:0/1255870582 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb180b9070 con 0x7fbb2809acc0 2024-05-30T06:43:04.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2e600640 1 -- 172.21.15.37:0/1255870582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb280c60b0 con 0x7fbb2809acc0 2024-05-30T06:43:04.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb25600640 1 -- 172.21.15.37:0/1255870582 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb180aa970 con 0x7fbb2809acc0 2024-05-30T06:43:04.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2e600640 1 -- 172.21.15.37:0/1255870582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb280c6630 con 0x7fbb2809acc0 2024-05-30T06:43:04.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.455+0000 7fbb2e600640 1 -- 172.21.15.37:0/1255870582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb28068ab0 con 0x7fbb2809acc0 2024-05-30T06:43:04.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.459+0000 7fbb25600640 1 -- 172.21.15.37:0/1255870582 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbb180aab10 con 0x7fbb2809acc0 2024-05-30T06:43:04.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.459+0000 7fbb25600640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb04068380 0x7fbb0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:04.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.459+0000 7fbb25600640 1 -- 172.21.15.37:0/1255870582 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7fbb18121200 con 0x7fbb2809acc0 2024-05-30T06:43:04.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.459+0000 7fbb1fe00640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb04068380 0x7fbb0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:04.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.459+0000 7fbb1fe00640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb04068380 0x7fbb0406a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbb280b7950 tx=0x7fbb10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:04.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.463+0000 7fbb25600640 1 -- 172.21.15.37:0/1255870582 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbb18016150 con 0x7fbb2809acc0 2024-05-30T06:43:04.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:04.627+0000 7fbb2e600640 1 -- 172.21.15.37:0/1255870582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbb280b8460 con 0x7fbb2809acc0 2024-05-30T06:43:05.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.267+0000 7fbb25600640 1 -- 172.21.15.37:0/1255870582 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7fbb180f13c0 con 0x7fbb2809acc0 2024-05-30T06:43:05.267 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-30T06:43:05.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.271+0000 7fbb2e600640 1 -- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb04068380 msgr2=0x7fbb0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:05.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.271+0000 7fbb2e600640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb04068380 0x7fbb0406a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbb280b7950 tx=0x7fbb10009040 comp rx=0 tx=0).stop 2024-05-30T06:43:05.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.271+0000 7fbb2e600640 1 -- 172.21.15.37:0/1255870582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb2809acc0 msgr2=0x7fbb281478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:05.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.271+0000 7fbb2e600640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb2809acc0 0x7fbb281478c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbb180ae040 tx=0x7fbb18019270 comp rx=0 tx=0).stop 2024-05-30T06:43:05.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.271+0000 7fbb2e600640 1 -- 172.21.15.37:0/1255870582 shutdown_connections 2024-05-30T06:43:05.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.271+0000 7fbb2e600640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb04068380 0x7fbb0406a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:05.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.271+0000 7fbb2e600640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb280b1d30 0x7fbb2815e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:05.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.271+0000 7fbb2e600640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb2809b0a0 0x7fbb2815dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:05.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.271+0000 7fbb2e600640 1 --2- 172.21.15.37:0/1255870582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb2809acc0 0x7fbb281478c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:05.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.271+0000 7fbb2e600640 1 -- 172.21.15.37:0/1255870582 >> 172.21.15.37:0/1255870582 conn(0x7fbb280b3fd0 msgr2=0x7fbb280b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:05.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.271+0000 7fbb2e600640 1 -- 172.21.15.37:0/1255870582 shutdown_connections 2024-05-30T06:43:05.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.271+0000 7fbb2e600640 1 -- 172.21.15.37:0/1255870582 wait complete. 2024-05-30T06:43:05.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T06:43:05.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.455+0000 7f120e200640 1 Processor -- start 2024-05-30T06:43:05.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.455+0000 7f120e200640 1 -- start start 2024-05-30T06:43:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.455+0000 7f120e200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12080cd440 0x7f120806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.455+0000 7f120e200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f120806f5a0 0x7f12080b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.455+0000 7f120e200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f120815f310 con 0x7f1208155da0 2024-05-30T06:43:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.455+0000 7f120e200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f120806fa10 con 0x7f12080cd440 2024-05-30T06:43:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.455+0000 7f120e200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f120815f5f0 con 0x7f120806f5a0 2024-05-30T06:43:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.455+0000 7f11fea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12080cd440 0x7f120806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.455+0000 7f11fea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12080cd440 0x7f120806f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57524/0 (socket says 172.21.15.37:57524) 2024-05-30T06:43:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.455+0000 7f11fea00640 1 -- 172.21.15.37:0/428438525 learned_addr learned my addr 172.21.15.37:0/428438525 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:05.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.455+0000 7f1207e00640 1 --2- 172.21.15.37:0/428438525 >> v2:172.21.15.105:3300/0 conn(0x7f120806f5a0 0x7f12080b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:05.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f11fea00640 1 -- 172.21.15.37:0/428438525 >> v2:172.21.15.105:3300/0 conn(0x7f120806f5a0 msgr2=0x7f12080b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:05.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f11fea00640 1 --2- 172.21.15.37:0/428438525 >> v2:172.21.15.105:3300/0 conn(0x7f120806f5a0 0x7f12080b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:05.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f11fea00640 1 -- 172.21.15.37:0/428438525 >> v1:172.21.15.105:6789/0 conn(0x7f1208155da0 legacy=0x7f12080cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:05.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f11fea00640 1 -- 172.21.15.37:0/428438525 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120815f8d0 con 0x7f12080cd440 2024-05-30T06:43:05.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f11fea00640 1 --2- 172.21.15.37:0/428438525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12080cd440 0x7f120806f060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f12080b6600 tx=0x7f11f001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffe1b4fc7714b60 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:05.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f1206a00640 1 -- 172.21.15.37:0/428438525 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f00b0070 con 0x7f12080cd440 2024-05-30T06:43:05.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f1206a00640 1 -- 172.21.15.37:0/428438525 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f00ab600 con 0x7f12080cd440 2024-05-30T06:43:05.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f1206a00640 1 -- 172.21.15.37:0/428438525 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f00ab9d0 con 0x7f12080cd440 2024-05-30T06:43:05.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f120e200640 1 -- 172.21.15.37:0/428438525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12080cd440 msgr2=0x7f120806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:05.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f120e200640 1 --2- 172.21.15.37:0/428438525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12080cd440 0x7f120806f060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f12080b6600 tx=0x7f11f001c400 comp rx=0 tx=0).stop 2024-05-30T06:43:05.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f120e200640 1 -- 172.21.15.37:0/428438525 shutdown_connections 2024-05-30T06:43:05.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f120e200640 1 --2- 172.21.15.37:0/428438525 >> v2:172.21.15.105:3300/0 conn(0x7f120806f5a0 0x7f12080b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:05.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f120e200640 1 --2- 172.21.15.37:0/428438525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12080cd440 0x7f120806f060 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:05.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f120e200640 1 -- 172.21.15.37:0/428438525 >> 172.21.15.37:0/428438525 conn(0x7f120806bf60 msgr2=0x7f12080b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:05.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f120e200640 1 -- 172.21.15.37:0/428438525 shutdown_connections 2024-05-30T06:43:05.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.459+0000 7f120e200640 1 -- 172.21.15.37:0/428438525 wait complete. 2024-05-30T06:43:05.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f120e200640 1 Processor -- start 2024-05-30T06:43:05.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f120e200640 1 -- start start 2024-05-30T06:43:05.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f120e200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120806f5a0 0x7f1208149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:05.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f120e200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1208155da0 0x7f1208159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:05.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f120e200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120814bed0 0x7f1208159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:05.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f120e200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1208168580 con 0x7f120806f5a0 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f120e200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f12080b46f0 con 0x7f1208155da0 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f120e200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1208168700 con 0x7f120814bed0 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f1207400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120806f5a0 0x7f1208149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f1207400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120806f5a0 0x7f1208149070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57538/0 (socket says 172.21.15.37:57538) 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f1207400640 1 -- 172.21.15.37:0/362046795 learned_addr learned my addr 172.21.15.37:0/362046795 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f1207e00640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120814bed0 0x7f1208159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f11fea00640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1208155da0 0x7f1208159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f1207400640 1 -- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120814bed0 msgr2=0x7f1208159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f1207400640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120814bed0 0x7f1208159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f1207400640 1 -- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1208155da0 msgr2=0x7f1208159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f1207400640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1208155da0 0x7f1208159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f1207400640 1 -- 172.21.15.37:0/362046795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120814b7a0 con 0x7f120806f5a0 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f11fea00640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1208155da0 0x7f1208159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:05.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f1207e00640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120814bed0 0x7f1208159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f1207400640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120806f5a0 0x7f1208149070 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f11f800c530 tx=0x7f11f800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f11ffe00640 1 -- 172.21.15.37:0/362046795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8016020 con 0x7f120806f5a0 2024-05-30T06:43:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f11ffe00640 1 -- 172.21.15.37:0/362046795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f8005220 con 0x7f120806f5a0 2024-05-30T06:43:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f120e200640 1 -- 172.21.15.37:0/362046795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120814ba80 con 0x7f120806f5a0 2024-05-30T06:43:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f11ffe00640 1 -- 172.21.15.37:0/362046795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8007030 con 0x7f120806f5a0 2024-05-30T06:43:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.463+0000 7f120e200640 1 -- 172.21.15.37:0/362046795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1208164b90 con 0x7f120806f5a0 2024-05-30T06:43:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.467+0000 7f120e200640 1 -- 172.21.15.37:0/362046795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f120814bc50 con 0x7f120806f5a0 2024-05-30T06:43:05.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.467+0000 7f11ffe00640 1 -- 172.21.15.37:0/362046795 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f11f80071d0 con 0x7f120806f5a0 2024-05-30T06:43:05.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.467+0000 7f11ffe00640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f11e40683b0 0x7f11e406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:05.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.467+0000 7f11ffe00640 1 -- 172.21.15.37:0/362046795 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7f11f8086350 con 0x7f120806f5a0 2024-05-30T06:43:05.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.467+0000 7f11fea00640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f11e40683b0 0x7f11e406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:05.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.471+0000 7f11fea00640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f11e40683b0 0x7f11e406a870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f11f00ad000 tx=0x7f11f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.471+0000 7f11ffe00640 1 -- 172.21.15.37:0/362046795 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f11f8020020 con 0x7f120806f5a0 2024-05-30T06:43:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:05.675+0000 7f120e200640 1 -- 172.21.15.37:0/362046795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f12080b6790 con 0x7f120806f5a0 2024-05-30T06:43:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.271+0000 7f11ffe00640 1 -- 172.21.15.37:0/362046795 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f11f80074c0 con 0x7f120806f5a0 2024-05-30T06:43:06.270 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 4 and data pool 5 2024-05-30T06:43:06.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.275+0000 7f120e200640 1 -- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f11e40683b0 msgr2=0x7f11e406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:06.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.279+0000 7f120e200640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f11e40683b0 0x7f11e406a870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f11f00ad000 tx=0x7f11f0008040 comp rx=0 tx=0).stop 2024-05-30T06:43:06.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.279+0000 7f120e200640 1 -- 172.21.15.37:0/362046795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120806f5a0 msgr2=0x7f1208149070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:06.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.279+0000 7f120e200640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120806f5a0 0x7f1208149070 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f11f800c530 tx=0x7f11f800c9f0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.279+0000 7f120e200640 1 -- 172.21.15.37:0/362046795 shutdown_connections 2024-05-30T06:43:06.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.279+0000 7f120e200640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f120814bed0 0x7f1208159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.279+0000 7f120e200640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f11e40683b0 0x7f11e406a870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.279+0000 7f120e200640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1208155da0 0x7f1208159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.279+0000 7f120e200640 1 --2- 172.21.15.37:0/362046795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f120806f5a0 0x7f1208149070 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.279+0000 7f120e200640 1 -- 172.21.15.37:0/362046795 >> 172.21.15.37:0/362046795 conn(0x7f120806bf60 msgr2=0x7f1208071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:06.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.283+0000 7f120e200640 1 -- 172.21.15.37:0/362046795 shutdown_connections 2024-05-30T06:43:06.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.283+0000 7f120e200640 1 -- 172.21.15.37:0/362046795 wait complete. 2024-05-30T06:43:06.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:43:06.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe0a0a00640 1 Processor -- start 2024-05-30T06:43:06.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe0a0a00640 1 -- start start 2024-05-30T06:43:06.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe0a0a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe09c161fc0 0x7fe09c0d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:06.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe0a0a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe09c0cd1c0 0x7fe09c162570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:06.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe0a0a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe09c06dc60 con 0x7fe09c06d480 2024-05-30T06:43:06.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe0a0a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe09c0d10c0 con 0x7fe09c0cd1c0 2024-05-30T06:43:06.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe0a0a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe09c0d0790 con 0x7fe09c161fc0 2024-05-30T06:43:06.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe09be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe09c0cd1c0 0x7fe09c162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:06.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe09be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe09c0cd1c0 0x7fe09c162570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57550/0 (socket says 172.21.15.37:57550) 2024-05-30T06:43:06.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe09be00640 1 -- 172.21.15.37:0/2046283634 learned_addr learned my addr 172.21.15.37:0/2046283634 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:06.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe09be00640 1 -- 172.21.15.37:0/2046283634 >> v2:172.21.15.105:3300/0 conn(0x7fe09c161fc0 msgr2=0x7fe09c0d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:06.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe09b400640 1 --2- 172.21.15.37:0/2046283634 >> v2:172.21.15.105:3300/0 conn(0x7fe09c161fc0 0x7fe09c0d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:06.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe09be00640 1 --2- 172.21.15.37:0/2046283634 >> v2:172.21.15.105:3300/0 conn(0x7fe09c161fc0 0x7fe09c0d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe09be00640 1 -- 172.21.15.37:0/2046283634 >> v1:172.21.15.105:6789/0 conn(0x7fe09c06d480 legacy=0x7fe09c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:06.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe09be00640 1 -- 172.21.15.37:0/2046283634 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c0d0a70 con 0x7fe09c0cd1c0 2024-05-30T06:43:06.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.475+0000 7fe09b400640 1 --2- 172.21.15.37:0/2046283634 >> v2:172.21.15.105:3300/0 conn(0x7fe09c161fc0 0x7fe09c0d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:43:06.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe09be00640 1 --2- 172.21.15.37:0/2046283634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cd1c0 0x7fe09c162570 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe09c06c940 tx=0x7fe09401c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e40e0cab1c99ed6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:06.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe09aa00640 1 -- 172.21.15.37:0/2046283634 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0940ac070 con 0x7fe09c0cd1c0 2024-05-30T06:43:06.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe09aa00640 1 -- 172.21.15.37:0/2046283634 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0940a8420 con 0x7fe09c0cd1c0 2024-05-30T06:43:06.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe09aa00640 1 -- 172.21.15.37:0/2046283634 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0940a87f0 con 0x7fe09c0cd1c0 2024-05-30T06:43:06.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe0a0a00640 1 -- 172.21.15.37:0/2046283634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cd1c0 msgr2=0x7fe09c162570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:06.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe0a0a00640 1 --2- 172.21.15.37:0/2046283634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cd1c0 0x7fe09c162570 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe09c06c940 tx=0x7fe09401c6f0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe0a0a00640 1 -- 172.21.15.37:0/2046283634 shutdown_connections 2024-05-30T06:43:06.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe0a0a00640 1 --2- 172.21.15.37:0/2046283634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c0cd1c0 0x7fe09c162570 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe0a0a00640 1 --2- 172.21.15.37:0/2046283634 >> v2:172.21.15.105:3300/0 conn(0x7fe09c161fc0 0x7fe09c0d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe0a0a00640 1 -- 172.21.15.37:0/2046283634 >> 172.21.15.37:0/2046283634 conn(0x7fe09c0b3f50 msgr2=0x7fe09c0b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:06.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe0a0a00640 1 -- 172.21.15.37:0/2046283634 shutdown_connections 2024-05-30T06:43:06.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe0a0a00640 1 -- 172.21.15.37:0/2046283634 wait complete. 2024-05-30T06:43:06.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe0a0a00640 1 Processor -- start 2024-05-30T06:43:06.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.479+0000 7fe0a0a00640 1 -- start start 2024-05-30T06:43:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe0a0a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c06d480 0x7fe09c143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe0a0a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09c0cd1c0 0x7fe09c1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe0a0a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe09c161fc0 0x7fe09c071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe0a0a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c16ba30 con 0x7fe09c06d480 2024-05-30T06:43:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe0a0a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c16b8b0 con 0x7fe09c161fc0 2024-05-30T06:43:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe0a0a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe09c16bbb0 con 0x7fe09c0cd1c0 2024-05-30T06:43:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe09b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c06d480 0x7fe09c143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe09b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c06d480 0x7fe09c143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57552/0 (socket says 172.21.15.37:57552) 2024-05-30T06:43:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe09b400640 1 -- 172.21.15.37:0/556917472 learned_addr learned my addr 172.21.15.37:0/556917472 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:06.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe092a00640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09c0cd1c0 0x7fe09c1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:06.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe09be00640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe09c161fc0 0x7fe09c071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:06.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe09b400640 1 -- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09c0cd1c0 msgr2=0x7fe09c1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:06.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe09b400640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09c0cd1c0 0x7fe09c1553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe09b400640 1 -- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe09c161fc0 msgr2=0x7fe09c071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:06.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe09b400640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe09c161fc0 0x7fe09c071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe09b400640 1 -- 172.21.15.37:0/556917472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c155b50 con 0x7fe09c06d480 2024-05-30T06:43:06.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe09b400640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c06d480 0x7fe09c143eb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00c820 tx=0x7fe08c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:06.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe093e00640 1 -- 172.21.15.37:0/556917472 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c015070 con 0x7fe09c06d480 2024-05-30T06:43:06.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe093e00640 1 -- 172.21.15.37:0/556917472 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe08c007a30 con 0x7fe09c06d480 2024-05-30T06:43:06.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe093e00640 1 -- 172.21.15.37:0/556917472 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c007e40 con 0x7fe09c06d480 2024-05-30T06:43:06.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe0a0a00640 1 -- 172.21.15.37:0/556917472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09c155e30 con 0x7fe09c06d480 2024-05-30T06:43:06.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe0a0a00640 1 -- 172.21.15.37:0/556917472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09c1563f0 con 0x7fe09c06d480 2024-05-30T06:43:06.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe0a0a00640 1 -- 172.21.15.37:0/556917472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe09c068ab0 con 0x7fe09c06d480 2024-05-30T06:43:06.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.483+0000 7fe093e00640 1 -- 172.21.15.37:0/556917472 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe08c018070 con 0x7fe09c06d480 2024-05-30T06:43:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.487+0000 7fe093e00640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe078068380 0x7fe07806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.487+0000 7fe093e00640 1 -- 172.21.15.37:0/556917472 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe08c0867a0 con 0x7fe09c06d480 2024-05-30T06:43:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.487+0000 7fe092a00640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe078068380 0x7fe07806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.487+0000 7fe092a00640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe078068380 0x7fe07806a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0b7f30 tx=0x7fe084007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:06.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.491+0000 7fe093e00640 1 -- 172.21.15.37:0/556917472 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe08c0567a0 con 0x7fe09c06d480 2024-05-30T06:43:06.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.655+0000 7fe0a0a00640 1 -- 172.21.15.37:0/556917472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe09c0d1ef0 con 0x7fe09c06d480 2024-05-30T06:43:06.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.659+0000 7fe093e00640 1 -- 172.21.15.37:0/556917472 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16670 (secure 0 0 0) 0x7fe08c05aaa0 con 0x7fe09c06d480 2024-05-30T06:43:06.657 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:43:06.658 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:43:05.679996+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:43:03.490124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T06:43:04.639175+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:43:06.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.659+0000 7fe0a0a00640 1 -- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe078068380 msgr2=0x7fe07806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:06.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.659+0000 7fe0a0a00640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe078068380 0x7fe07806a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0b7f30 tx=0x7fe084007e40 comp rx=0 tx=0).stop 2024-05-30T06:43:06.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.659+0000 7fe0a0a00640 1 -- 172.21.15.37:0/556917472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c06d480 msgr2=0x7fe09c143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:06.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.659+0000 7fe0a0a00640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c06d480 0x7fe09c143eb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00c820 tx=0x7fe08c00cce0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.659+0000 7fe0a0a00640 1 -- 172.21.15.37:0/556917472 shutdown_connections 2024-05-30T06:43:06.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.659+0000 7fe0a0a00640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe078068380 0x7fe07806a840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.659+0000 7fe0a0a00640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe09c161fc0 0x7fe09c071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.659+0000 7fe0a0a00640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe09c0cd1c0 0x7fe09c1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.659+0000 7fe0a0a00640 1 --2- 172.21.15.37:0/556917472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c06d480 0x7fe09c143eb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.659+0000 7fe0a0a00640 1 -- 172.21.15.37:0/556917472 >> 172.21.15.37:0/556917472 conn(0x7fe09c0b3f50 msgr2=0x7fe09c1571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:06.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.659+0000 7fe0a0a00640 1 -- 172.21.15.37:0/556917472 shutdown_connections 2024-05-30T06:43:06.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.659+0000 7fe0a0a00640 1 -- 172.21.15.37:0/556917472 wait complete. 2024-05-30T06:43:06.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:43:06.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.819+0000 7f944da00640 1 Processor -- start 2024-05-30T06:43:06.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.819+0000 7f944da00640 1 -- start start 2024-05-30T06:43:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.823+0000 7f944da00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f94481605d0 0x7f94480b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.823+0000 7f944da00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f944815fee0 0x7f9448160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.823+0000 7f944da00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94480cdda0 con 0x7f94481609b0 2024-05-30T06:43:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.823+0000 7f944da00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f94480ce080 con 0x7f944815fee0 2024-05-30T06:43:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.823+0000 7f944da00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f944809ac00 con 0x7f94481605d0 2024-05-30T06:43:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.823+0000 7f944d000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f944815fee0 0x7f9448160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.823+0000 7f944d000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f944815fee0 0x7f9448160e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57562/0 (socket says 172.21.15.37:57562) 2024-05-30T06:43:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.823+0000 7f944d000640 1 -- 172.21.15.37:0/2175118061 learned_addr learned my addr 172.21.15.37:0/2175118061 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.823+0000 7f9447e00640 1 --2- 172.21.15.37:0/2175118061 >> v2:172.21.15.105:3300/0 conn(0x7f94481605d0 0x7f94480b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:06.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.823+0000 7f944d000640 1 -- 172.21.15.37:0/2175118061 >> v2:172.21.15.105:3300/0 conn(0x7f94481605d0 msgr2=0x7f94480b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:06.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.823+0000 7f944d000640 1 --2- 172.21.15.37:0/2175118061 >> v2:172.21.15.105:3300/0 conn(0x7f94481605d0 0x7f94480b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.823+0000 7f944d000640 1 -- 172.21.15.37:0/2175118061 >> v1:172.21.15.105:6789/0 conn(0x7f94481609b0 legacy=0x7f944815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:06.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.823+0000 7f944d000640 1 -- 172.21.15.37:0/2175118061 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944809aee0 con 0x7f944815fee0 2024-05-30T06:43:06.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f944d000640 1 --2- 172.21.15.37:0/2175118061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944815fee0 0x7f9448160e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f944806f780 tx=0x7f944001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf478a39869485c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:06.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f9447400640 1 -- 172.21.15.37:0/2175118061 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94400a5670 con 0x7f944815fee0 2024-05-30T06:43:06.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f9447400640 1 -- 172.21.15.37:0/2175118061 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94400a5810 con 0x7f944815fee0 2024-05-30T06:43:06.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f9447400640 1 -- 172.21.15.37:0/2175118061 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94400a5be0 con 0x7f944815fee0 2024-05-30T06:43:06.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f944da00640 1 -- 172.21.15.37:0/2175118061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944815fee0 msgr2=0x7f9448160e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:06.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f944da00640 1 --2- 172.21.15.37:0/2175118061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944815fee0 0x7f9448160e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f944806f780 tx=0x7f944001c9b0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f944da00640 1 -- 172.21.15.37:0/2175118061 shutdown_connections 2024-05-30T06:43:06.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f944da00640 1 --2- 172.21.15.37:0/2175118061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944815fee0 0x7f9448160e10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f944da00640 1 --2- 172.21.15.37:0/2175118061 >> v2:172.21.15.105:3300/0 conn(0x7f94481605d0 0x7f94480b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f944da00640 1 -- 172.21.15.37:0/2175118061 >> 172.21.15.37:0/2175118061 conn(0x7f94480b3f50 msgr2=0x7f94480b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:06.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f944da00640 1 -- 172.21.15.37:0/2175118061 shutdown_connections 2024-05-30T06:43:06.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f944da00640 1 -- 172.21.15.37:0/2175118061 wait complete. 2024-05-30T06:43:06.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f944da00640 1 Processor -- start 2024-05-30T06:43:06.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.827+0000 7f944da00640 1 -- start start 2024-05-30T06:43:06.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f944da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944815fee0 0x7f94480cff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:06.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f944da00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94481605d0 0x7f9448150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:06.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f944da00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94481609b0 0x7f9448159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:06.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f944da00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f94481696b0 con 0x7f944815fee0 2024-05-30T06:43:06.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f944da00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f944809bea0 con 0x7f94481605d0 2024-05-30T06:43:06.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f944da00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9448169830 con 0x7f94481609b0 2024-05-30T06:43:06.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f9447e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944815fee0 0x7f94480cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:06.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f9447e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944815fee0 0x7f94480cff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57570/0 (socket says 172.21.15.37:57570) 2024-05-30T06:43:06.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f9447e00640 1 -- 172.21.15.37:0/58679929 learned_addr learned my addr 172.21.15.37:0/58679929 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:06.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f943f400640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94481605d0 0x7f9448150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:06.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f944d000640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94481609b0 0x7f9448159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:06.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f9447e00640 1 -- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94481609b0 msgr2=0x7f9448159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:06.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f9447e00640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94481609b0 0x7f9448159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f9447e00640 1 -- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94481605d0 msgr2=0x7f9448150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:06.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f9447e00640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94481605d0 0x7f9448150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:06.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f9447e00640 1 -- 172.21.15.37:0/58679929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94480c5fd0 con 0x7f944815fee0 2024-05-30T06:43:06.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f9447e00640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944815fee0 0x7f94480cff30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f943800d800 tx=0x7f943800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:06.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f9444c00640 1 -- 172.21.15.37:0/58679929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943800b6c0 con 0x7f944815fee0 2024-05-30T06:43:06.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f9444c00640 1 -- 172.21.15.37:0/58679929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9438019070 con 0x7f944815fee0 2024-05-30T06:43:06.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f9444c00640 1 -- 172.21.15.37:0/58679929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943800ba60 con 0x7f944815fee0 2024-05-30T06:43:06.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f944da00640 1 -- 172.21.15.37:0/58679929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9448159ac0 con 0x7f944815fee0 2024-05-30T06:43:06.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f944da00640 1 -- 172.21.15.37:0/58679929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9448159790 con 0x7f944815fee0 2024-05-30T06:43:06.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f944da00640 1 -- 172.21.15.37:0/58679929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9448068ab0 con 0x7f944815fee0 2024-05-30T06:43:06.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.831+0000 7f9444c00640 1 -- 172.21.15.37:0/58679929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f943800bc00 con 0x7f944815fee0 2024-05-30T06:43:06.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.835+0000 7f9444c00640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9424068380 0x7f942406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:06.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.835+0000 7f9444c00640 1 -- 172.21.15.37:0/58679929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f9438086ef0 con 0x7f944815fee0 2024-05-30T06:43:06.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.835+0000 7f943f400640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9424068380 0x7f942406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:06.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.835+0000 7f943f400640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9424068380 0x7f942406a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f944815de40 tx=0x7f9430009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:06.839+0000 7f9444c00640 1 -- 172.21.15.37:0/58679929 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9438057380 con 0x7f944815fee0 2024-05-30T06:43:07.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.003+0000 7f944da00640 1 -- 172.21.15.37:0/58679929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f944815de70 con 0x7f944815fee0 2024-05-30T06:43:07.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.003+0000 7f9444c00640 1 -- 172.21.15.37:0/58679929 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16670 (secure 0 0 0) 0x7f9438056c80 con 0x7f944815fee0 2024-05-30T06:43:07.004 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:43:07.005 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:43:05.679996+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:43:03.490124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T06:43:04.639175+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:43:07.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.007+0000 7f944da00640 1 -- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9424068380 msgr2=0x7f942406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:07.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.007+0000 7f944da00640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9424068380 0x7f942406a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f944815de40 tx=0x7f9430009060 comp rx=0 tx=0).stop 2024-05-30T06:43:07.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.007+0000 7f944da00640 1 -- 172.21.15.37:0/58679929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944815fee0 msgr2=0x7f94480cff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:07.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.007+0000 7f944da00640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944815fee0 0x7f94480cff30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f943800d800 tx=0x7f943800dcc0 comp rx=0 tx=0).stop 2024-05-30T06:43:07.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.007+0000 7f944da00640 1 -- 172.21.15.37:0/58679929 shutdown_connections 2024-05-30T06:43:07.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.007+0000 7f944da00640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94481609b0 0x7f9448159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:07.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.007+0000 7f944da00640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9424068380 0x7f942406a840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:07.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.007+0000 7f944da00640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94481605d0 0x7f9448150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:07.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.007+0000 7f944da00640 1 --2- 172.21.15.37:0/58679929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f944815fee0 0x7f94480cff30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:07.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.007+0000 7f944da00640 1 -- 172.21.15.37:0/58679929 >> 172.21.15.37:0/58679929 conn(0x7f94480b3f50 msgr2=0x7f9448166a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:07.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.007+0000 7f944da00640 1 -- 172.21.15.37:0/58679929 shutdown_connections 2024-05-30T06:43:07.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.007+0000 7f944da00640 1 -- 172.21.15.37:0/58679929 wait complete. 2024-05-30T06:43:07.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T06:43:07.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb9e600640 1 Processor -- start 2024-05-30T06:43:07.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb9e600640 1 -- start start 2024-05-30T06:43:07.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb9e600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb980b59d0 0x7fdb980b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb9e600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb981610a0 con 0x7fdb9815d7e0 2024-05-30T06:43:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb9e600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb980b62f0 con 0x7fdb9815d350 2024-05-30T06:43:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb9e600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdb98142030 con 0x7fdb980b59d0 2024-05-30T06:43:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb97400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb980b59d0 0x7fdb980b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb97400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb980b59d0 0x7fdb980b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57576/0 (socket says 172.21.15.37:57576) 2024-05-30T06:43:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb97400640 1 -- 172.21.15.37:0/1899019403 learned_addr learned my addr 172.21.15.37:0/1899019403 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:07.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb97e00640 1 --1- 172.21.15.37:0/1899019403 >> v1:172.21.15.37:6789/0 conn(0x7fdb9815d7e0 0x7fdb98160990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49800/0 (socket says 172.21.15.37:49800) 2024-05-30T06:43:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb97400640 1 -- 172.21.15.37:0/1899019403 >> v1:172.21.15.105:6789/0 conn(0x7fdb9815d350 legacy=0x7fdb98160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb97400640 1 -- 172.21.15.37:0/1899019403 >> v1:172.21.15.37:6789/0 conn(0x7fdb9815d7e0 legacy=0x7fdb98160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb96a00640 1 -- 172.21.15.37:0/1899019403 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3568556816 0 0) 0x7fdb981610a0 con 0x7fdb9815d7e0 2024-05-30T06:43:07.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.171+0000 7fdb97400640 1 -- 172.21.15.37:0/1899019403 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb98142310 con 0x7fdb980b59d0 2024-05-30T06:43:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.175+0000 7fdb97400640 1 --2- 172.21.15.37:0/1899019403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b59d0 0x7fdb980b5db0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdb88009e80 tx=0x7fdb8801f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d52428c71d67806 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.175+0000 7fdb96a00640 1 -- 172.21.15.37:0/1899019403 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb880b4070 con 0x7fdb980b59d0 2024-05-30T06:43:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.175+0000 7fdb96a00640 1 -- 172.21.15.37:0/1899019403 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb880af400 con 0x7fdb980b59d0 2024-05-30T06:43:07.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.175+0000 7fdb96a00640 1 -- 172.21.15.37:0/1899019403 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb880af7d0 con 0x7fdb980b59d0 2024-05-30T06:43:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.175+0000 7fdb9e600640 1 -- 172.21.15.37:0/1899019403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b59d0 msgr2=0x7fdb980b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.175+0000 7fdb9e600640 1 --2- 172.21.15.37:0/1899019403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b59d0 0x7fdb980b5db0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdb88009e80 tx=0x7fdb8801f200 comp rx=0 tx=0).stop 2024-05-30T06:43:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.175+0000 7fdb9e600640 1 -- 172.21.15.37:0/1899019403 shutdown_connections 2024-05-30T06:43:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.175+0000 7fdb9e600640 1 --2- 172.21.15.37:0/1899019403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b59d0 0x7fdb980b5db0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:07.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.175+0000 7fdb9e600640 1 -- 172.21.15.37:0/1899019403 >> 172.21.15.37:0/1899019403 conn(0x7fdb9806bf60 msgr2=0x7fdb980b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.175+0000 7fdb9e600640 1 -- 172.21.15.37:0/1899019403 shutdown_connections 2024-05-30T06:43:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.175+0000 7fdb9e600640 1 -- 172.21.15.37:0/1899019403 wait complete. 2024-05-30T06:43:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb9e600640 1 Processor -- start 2024-05-30T06:43:07.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb9e600640 1 -- start start 2024-05-30T06:43:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb9e600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb980b59d0 0x7fdb98075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb9e600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb9815d350 0x7fdb98139140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb9e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb9815d7e0 0x7fdb98158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb9e600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb9813fce0 con 0x7fdb9815d7e0 2024-05-30T06:43:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb9e600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdb981428d0 con 0x7fdb9815d350 2024-05-30T06:43:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb9e600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb9813fe60 con 0x7fdb980b59d0 2024-05-30T06:43:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb97e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb9815d7e0 0x7fdb98158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:07.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb97e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb9815d7e0 0x7fdb98158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57588/0 (socket says 172.21.15.37:57588) 2024-05-30T06:43:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb97e00640 1 -- 172.21.15.37:0/2748693472 learned_addr learned my addr 172.21.15.37:0/2748693472 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb97400640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb980b59d0 0x7fdb98075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb8ea00640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb9815d350 0x7fdb98139140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb97e00640 1 -- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb980b59d0 msgr2=0x7fdb98075560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb97e00640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb980b59d0 0x7fdb98075560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb97e00640 1 -- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb9815d350 msgr2=0x7fdb98139140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb97e00640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb9815d350 0x7fdb98139140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb97e00640 1 -- 172.21.15.37:0/2748693472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb981572c0 con 0x7fdb9815d7e0 2024-05-30T06:43:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb97e00640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb9815d7e0 0x7fdb98158640 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000c3e0 tx=0x7fdb9000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb8fe00640 1 -- 172.21.15.37:0/2748693472 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb900074e0 con 0x7fdb9815d7e0 2024-05-30T06:43:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb8fe00640 1 -- 172.21.15.37:0/2748693472 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb900047f0 con 0x7fdb9815d7e0 2024-05-30T06:43:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb9e600640 1 -- 172.21.15.37:0/2748693472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb981575a0 con 0x7fdb9815d7e0 2024-05-30T06:43:07.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb8fe00640 1 -- 172.21.15.37:0/2748693472 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90004be0 con 0x7fdb9815d7e0 2024-05-30T06:43:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb9e600640 1 -- 172.21.15.37:0/2748693472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb98157b60 con 0x7fdb9815d7e0 2024-05-30T06:43:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.179+0000 7fdb9e600640 1 -- 172.21.15.37:0/2748693472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb98068bc0 con 0x7fdb9815d7e0 2024-05-30T06:43:07.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.183+0000 7fdb8fe00640 1 -- 172.21.15.37:0/2748693472 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdb90011070 con 0x7fdb9815d7e0 2024-05-30T06:43:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.183+0000 7fdb8fe00640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb740683b0 0x7fdb7406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.183+0000 7fdb8fe00640 1 -- 172.21.15.37:0/2748693472 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fdb90086470 con 0x7fdb9815d7e0 2024-05-30T06:43:07.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.183+0000 7fdb97400640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb740683b0 0x7fdb7406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:07.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.183+0000 7fdb97400640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb740683b0 0x7fdb7406a870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb880b1000 tx=0x7fdb880aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:07.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.187+0000 7fdb8fe00640 1 -- 172.21.15.37:0/2748693472 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdb90056340 con 0x7fdb9815d7e0 2024-05-30T06:43:07.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:07.391+0000 7fdb9e600640 1 -- 172.21.15.37:0/2748693472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdb98072340 con 0x7fdb9815d7e0 2024-05-30T06:43:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.295+0000 7fdb8fe00640 1 -- 172.21.15.37:0/2748693472 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7fdb9005a640 con 0x7fdb9815d7e0 2024-05-30T06:43:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.299+0000 7fdb9e600640 1 -- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb740683b0 msgr2=0x7fdb7406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.299+0000 7fdb9e600640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb740683b0 0x7fdb7406a870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb880b1000 tx=0x7fdb880aa000 comp rx=0 tx=0).stop 2024-05-30T06:43:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.299+0000 7fdb9e600640 1 -- 172.21.15.37:0/2748693472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb9815d7e0 msgr2=0x7fdb98158640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.299+0000 7fdb9e600640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb9815d7e0 0x7fdb98158640 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000c3e0 tx=0x7fdb9000c8a0 comp rx=0 tx=0).stop 2024-05-30T06:43:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.299+0000 7fdb9e600640 1 -- 172.21.15.37:0/2748693472 shutdown_connections 2024-05-30T06:43:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.299+0000 7fdb9e600640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb9815d7e0 0x7fdb98158640 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.299+0000 7fdb9e600640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb740683b0 0x7fdb7406a870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.299+0000 7fdb9e600640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb9815d350 0x7fdb98139140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.299+0000 7fdb9e600640 1 --2- 172.21.15.37:0/2748693472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb980b59d0 0x7fdb98075560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.299+0000 7fdb9e600640 1 -- 172.21.15.37:0/2748693472 >> 172.21.15.37:0/2748693472 conn(0x7fdb9806bf60 msgr2=0x7fdb98140b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.299+0000 7fdb9e600640 1 -- 172.21.15.37:0/2748693472 shutdown_connections 2024-05-30T06:43:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.299+0000 7fdb9e600640 1 -- 172.21.15.37:0/2748693472 wait complete. 2024-05-30T06:43:08.321 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T06:43:08.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T06:43:08.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.471+0000 7fe224000640 1 Processor -- start 2024-05-30T06:43:08.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.471+0000 7fe224000640 1 -- start start 2024-05-30T06:43:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.471+0000 7fe224000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe21c0cd440 0x7fe21c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.471+0000 7fe224000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c15f310 con 0x7fe21c155da0 2024-05-30T06:43:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.471+0000 7fe224000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe21c15f5f0 con 0x7fe21c06f5a0 2024-05-30T06:43:08.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.471+0000 7fe224000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe21c06fa10 con 0x7fe21c0cd440 2024-05-30T06:43:08.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.471+0000 7fe221600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe21c155da0 0x7fe21c0cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33298/0 (socket says 172.21.15.37:33298) 2024-05-30T06:43:08.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.471+0000 7fe221600640 1 -- 172.21.15.37:0/1697017506 learned_addr learned my addr 172.21.15.37:0/1697017506 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:08.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe220c00640 1 --2- 172.21.15.37:0/1697017506 >> v2:172.21.15.105:3300/0 conn(0x7fe21c0cd440 0x7fe21c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1269594073 0 0) 0x7fe21c15f310 con 0x7fe21c155da0 2024-05-30T06:43:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe204003530 con 0x7fe21c155da0 2024-05-30T06:43:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4141173658 0 0) 0x7fe204003530 con 0x7fe21c155da0 2024-05-30T06:43:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 >> v2:172.21.15.105:3300/0 conn(0x7fe21c0cd440 msgr2=0x7fe21c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 --2- 172.21.15.37:0/1697017506 >> v2:172.21.15.105:3300/0 conn(0x7fe21c0cd440 0x7fe21c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 >> v1:172.21.15.105:6789/0 conn(0x7fe21c06f5a0 legacy=0x7fe21c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c15f8d0 con 0x7fe21c155da0 2024-05-30T06:43:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fe210001680 con 0x7fe21c155da0 2024-05-30T06:43:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 >> v1:172.21.15.37:6789/0 conn(0x7fe21c155da0 legacy=0x7fe21c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 --2- 172.21.15.37:0/1697017506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040039c0 0x7fe204003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:08.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 --2- 172.21.15.37:0/1697017506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe204004810 0x7fe204004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 --2- 172.21.15.37:0/1697017506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2040051d0 0x7fe20400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c06fa10 con 0x7fe2040051d0 2024-05-30T06:43:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe20400c120 con 0x7fe2040039c0 2024-05-30T06:43:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe20400e530 con 0x7fe204004810 2024-05-30T06:43:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe222000640 1 --2- 172.21.15.37:0/1697017506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2040051d0 0x7fe20400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe221600640 1 --2- 172.21.15.37:0/1697017506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040039c0 0x7fe204003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe220c00640 1 --2- 172.21.15.37:0/1697017506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe204004810 0x7fe204004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe222000640 1 -- 172.21.15.37:0/1697017506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe204004810 msgr2=0x7fe204004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe222000640 1 --2- 172.21.15.37:0/1697017506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe204004810 0x7fe204004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe222000640 1 -- 172.21.15.37:0/1697017506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040039c0 msgr2=0x7fe204003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe222000640 1 --2- 172.21.15.37:0/1697017506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040039c0 0x7fe204003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe222000640 1 -- 172.21.15.37:0/1697017506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe204003530 con 0x7fe2040051d0 2024-05-30T06:43:08.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.475+0000 7fe220c00640 1 --2- 172.21.15.37:0/1697017506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe204004810 0x7fe204004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:08.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe222000640 1 -- 172.21.15.37:0/1697017506 reap_dead start 2024-05-30T06:43:08.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe222000640 1 --2- 172.21.15.37:0/1697017506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2040051d0 0x7fe20400b9d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe214002010 tx=0x7fe21401f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692031405c83f239 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:08.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214001c10 con 0x7fe2040051d0 2024-05-30T06:43:08.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2140a8c90 con 0x7fe2040051d0 2024-05-30T06:43:08.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe21be00640 1 -- 172.21.15.37:0/1697017506 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214003bc0 con 0x7fe2040051d0 2024-05-30T06:43:08.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe224000640 1 -- 172.21.15.37:0/1697017506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2040051d0 msgr2=0x7fe20400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:08.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe224000640 1 --2- 172.21.15.37:0/1697017506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2040051d0 0x7fe20400b9d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe214002010 tx=0x7fe21401f050 comp rx=0 tx=0).stop 2024-05-30T06:43:08.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe224000640 1 -- 172.21.15.37:0/1697017506 shutdown_connections 2024-05-30T06:43:08.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe224000640 1 --2- 172.21.15.37:0/1697017506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2040051d0 0x7fe20400b9d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:08.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe224000640 1 -- 172.21.15.37:0/1697017506 >> 172.21.15.37:0/1697017506 conn(0x7fe21c06bf60 msgr2=0x7fe21c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:08.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe224000640 1 -- 172.21.15.37:0/1697017506 shutdown_connections 2024-05-30T06:43:08.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe224000640 1 -- 172.21.15.37:0/1697017506 wait complete. 2024-05-30T06:43:08.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe224000640 1 Processor -- start 2024-05-30T06:43:08.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe224000640 1 -- start start 2024-05-30T06:43:08.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe224000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040051d0 0x7fe21c151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:08.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.479+0000 7fe224000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe21c156180 0x7fe21c157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:08.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe224000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe21c153a80 0x7fe21c0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:08.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe224000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0b4e20 con 0x7fe21c153a80 2024-05-30T06:43:08.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe224000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c0b4ca0 con 0x7fe2040051d0 2024-05-30T06:43:08.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe224000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe21c0cd950 con 0x7fe21c156180 2024-05-30T06:43:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe222000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe21c153a80 0x7fe21c0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe222000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe21c153a80 0x7fe21c0aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55782/0 (socket says 172.21.15.37:55782) 2024-05-30T06:43:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe222000640 1 -- 172.21.15.37:0/123827993 learned_addr learned my addr 172.21.15.37:0/123827993 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe220c00640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe21c156180 0x7fe21c157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe221600640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040051d0 0x7fe21c151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe222000640 1 -- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe21c156180 msgr2=0x7fe21c157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe222000640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe21c156180 0x7fe21c157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe222000640 1 -- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040051d0 msgr2=0x7fe21c151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe222000640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040051d0 0x7fe21c151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe222000640 1 -- 172.21.15.37:0/123827993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c152520 con 0x7fe21c153a80 2024-05-30T06:43:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe221600640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040051d0 0x7fe21c151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe220c00640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe21c156180 0x7fe21c157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:08.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe222000640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe21c153a80 0x7fe21c0aec60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe214002010 tx=0x7fe204005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:08.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe219600640 1 -- 172.21.15.37:0/123827993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2140ba070 con 0x7fe21c153a80 2024-05-30T06:43:08.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe219600640 1 -- 172.21.15.37:0/123827993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe214001bf0 con 0x7fe21c153a80 2024-05-30T06:43:08.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe224000640 1 -- 172.21.15.37:0/123827993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21c156660 con 0x7fe21c153a80 2024-05-30T06:43:08.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe219600640 1 -- 172.21.15.37:0/123827993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214006d60 con 0x7fe21c153a80 2024-05-30T06:43:08.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe224000640 1 -- 172.21.15.37:0/123827993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21c156c20 con 0x7fe21c153a80 2024-05-30T06:43:08.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe224000640 1 -- 172.21.15.37:0/123827993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe21c068bc0 con 0x7fe21c153a80 2024-05-30T06:43:08.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.483+0000 7fe219600640 1 -- 172.21.15.37:0/123827993 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe2140bd070 con 0x7fe21c153a80 2024-05-30T06:43:08.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.487+0000 7fe219600640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1fc0683b0 0x7fe1fc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:08.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.487+0000 7fe219600640 1 -- 172.21.15.37:0/123827993 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe214122b30 con 0x7fe21c153a80 2024-05-30T06:43:08.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.487+0000 7fe221600640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1fc0683b0 0x7fe1fc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:08.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.487+0000 7fe221600640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1fc0683b0 0x7fe1fc06a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe210000c10 tx=0x7fe210009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:08.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.491+0000 7fe219600640 1 -- 172.21.15.37:0/123827993 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe214018d60 con 0x7fe21c153a80 2024-05-30T06:43:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:08.687+0000 7fe224000640 1 -- 172.21.15.37:0/123827993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe21c0725d0 con 0x7fe21c153a80 2024-05-30T06:43:09.241 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-30T06:43:09.243+0000 7f1aeec00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T06:43:09.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.303+0000 7fe219600640 1 -- 172.21.15.37:0/123827993 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fe2140f3050 con 0x7fe21c153a80 2024-05-30T06:43:09.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.307+0000 7fe224000640 1 -- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1fc0683b0 msgr2=0x7fe1fc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:09.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.307+0000 7fe224000640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1fc0683b0 0x7fe1fc06a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe210000c10 tx=0x7fe210009040 comp rx=0 tx=0).stop 2024-05-30T06:43:09.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.307+0000 7fe224000640 1 -- 172.21.15.37:0/123827993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe21c153a80 msgr2=0x7fe21c0aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.307+0000 7fe224000640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe21c153a80 0x7fe21c0aec60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe214002010 tx=0x7fe204005840 comp rx=0 tx=0).stop 2024-05-30T06:43:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.307+0000 7fe224000640 1 -- 172.21.15.37:0/123827993 shutdown_connections 2024-05-30T06:43:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.307+0000 7fe224000640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe21c153a80 0x7fe21c0aec60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.307+0000 7fe224000640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe21c156180 0x7fe21c157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.307+0000 7fe224000640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1fc0683b0 0x7fe1fc06a870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.307+0000 7fe224000640 1 --2- 172.21.15.37:0/123827993 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040051d0 0x7fe21c151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.307+0000 7fe224000640 1 -- 172.21.15.37:0/123827993 >> 172.21.15.37:0/123827993 conn(0x7fe21c06bf60 msgr2=0x7fe21c074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.307+0000 7fe224000640 1 -- 172.21.15.37:0/123827993 shutdown_connections 2024-05-30T06:43:09.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.307+0000 7fe224000640 1 -- 172.21.15.37:0/123827993 wait complete. 2024-05-30T06:43:09.330 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T06:43:09.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:43:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.475+0000 7fa1ec200640 1 Processor -- start 2024-05-30T06:43:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.475+0000 7fa1ec200640 1 -- start start 2024-05-30T06:43:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1ec200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa1e415cd80 0x7fa1e406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1ec200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e40ce8d0 0x7fa1e40ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1ec200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e40cd120 con 0x7fa1e406e000 2024-05-30T06:43:09.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1ec200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e40a9530 con 0x7fa1e415cd80 2024-05-30T06:43:09.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1ec200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e40cd400 con 0x7fa1e40ce8d0 2024-05-30T06:43:09.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e9800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa1e406e000 0x7fa1e40ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33302/0 (socket says 172.21.15.37:33302) 2024-05-30T06:43:09.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e9800640 1 -- 172.21.15.37:0/3920992410 learned_addr learned my addr 172.21.15.37:0/3920992410 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:09.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1ea200640 1 --2- 172.21.15.37:0/3920992410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e40ce8d0 0x7fa1e40ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e8e00640 1 --2- 172.21.15.37:0/3920992410 >> v2:172.21.15.105:3300/0 conn(0x7fa1e415cd80 0x7fa1e406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435941979 0 0) 0x7fa1e40cd120 con 0x7fa1e406e000 2024-05-30T06:43:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1cc003530 con 0x7fa1e406e000 2024-05-30T06:43:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 90939396 0 0) 0x7fa1cc003530 con 0x7fa1e406e000 2024-05-30T06:43:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e40ce8d0 msgr2=0x7fa1e40ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 --2- 172.21.15.37:0/3920992410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e40ce8d0 0x7fa1e40ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 >> v2:172.21.15.105:3300/0 conn(0x7fa1e415cd80 msgr2=0x7fa1e406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 --2- 172.21.15.37:0/3920992410 >> v2:172.21.15.105:3300/0 conn(0x7fa1e415cd80 0x7fa1e406f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e40cd6e0 con 0x7fa1e406e000 2024-05-30T06:43:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fa1d8001680 con 0x7fa1e406e000 2024-05-30T06:43:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 >> v1:172.21.15.37:6789/0 conn(0x7fa1e406e000 legacy=0x7fa1e40ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 --2- 172.21.15.37:0/3920992410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1cc0039c0 0x7fa1cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 --2- 172.21.15.37:0/3920992410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1cc004810 0x7fa1cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 --2- 172.21.15.37:0/3920992410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e40ce8d0 0x7fa1cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e40cd400 con 0x7fa1cc0039c0 2024-05-30T06:43:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa1cc00b9d0 con 0x7fa1cc004810 2024-05-30T06:43:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa1cc00bb50 con 0x7fa1e40ce8d0 2024-05-30T06:43:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e9800640 1 --2- 172.21.15.37:0/3920992410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1cc0039c0 0x7fa1cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1ea200640 1 --2- 172.21.15.37:0/3920992410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e40ce8d0 0x7fa1cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e8e00640 1 --2- 172.21.15.37:0/3920992410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1cc004810 0x7fa1cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e9800640 1 -- 172.21.15.37:0/3920992410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e40ce8d0 msgr2=0x7fa1cc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e9800640 1 --2- 172.21.15.37:0/3920992410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e40ce8d0 0x7fa1cc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e9800640 1 -- 172.21.15.37:0/3920992410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1cc004810 msgr2=0x7fa1cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e9800640 1 --2- 172.21.15.37:0/3920992410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1cc004810 0x7fa1cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.479+0000 7fa1e9800640 1 -- 172.21.15.37:0/3920992410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1cc003530 con 0x7fa1cc0039c0 2024-05-30T06:43:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.483+0000 7fa1e9800640 1 --2- 172.21.15.37:0/3920992410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1cc0039c0 0x7fa1cc003de0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800c2c0 tx=0x7fa1d801f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865eab5c490ff1f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.483+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8007d60 con 0x7fa1cc0039c0 2024-05-30T06:43:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.483+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d8005b00 con 0x7fa1cc0039c0 2024-05-30T06:43:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.483+0000 7fa1e3e00640 1 -- 172.21.15.37:0/3920992410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8007070 con 0x7fa1cc0039c0 2024-05-30T06:43:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.483+0000 7fa1ec200640 1 -- 172.21.15.37:0/3920992410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1cc0039c0 msgr2=0x7fa1cc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.483+0000 7fa1ec200640 1 --2- 172.21.15.37:0/3920992410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1cc0039c0 0x7fa1cc003de0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800c2c0 tx=0x7fa1d801f4b0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.483+0000 7fa1ea200640 1 -- 172.21.15.37:0/3920992410 reap_dead start 2024-05-30T06:43:09.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.483+0000 7fa1ec200640 1 -- 172.21.15.37:0/3920992410 shutdown_connections 2024-05-30T06:43:09.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.483+0000 7fa1ec200640 1 -- 172.21.15.37:0/3920992410 >> 172.21.15.37:0/3920992410 conn(0x7fa1e40b23a0 msgr2=0x7fa1e40b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:09.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.483+0000 7fa1ec200640 1 -- 172.21.15.37:0/3920992410 shutdown_connections 2024-05-30T06:43:09.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.483+0000 7fa1ec200640 1 -- 172.21.15.37:0/3920992410 wait complete. 2024-05-30T06:43:09.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ec200640 1 Processor -- start 2024-05-30T06:43:09.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ec200640 1 -- start start 2024-05-30T06:43:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ec200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1cc0039c0 0x7fa1e41325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ec200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e4153210 0x7fa1e412e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ec200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e412c5b0 0x7fa1e4140a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ec200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e406f930 con 0x7fa1e412c5b0 2024-05-30T06:43:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ec200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e40cdca0 con 0x7fa1cc0039c0 2024-05-30T06:43:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ec200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e406fab0 con 0x7fa1e4153210 2024-05-30T06:43:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ea200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e412c5b0 0x7fa1e4140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ea200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e412c5b0 0x7fa1e4140a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55808/0 (socket says 172.21.15.37:55808) 2024-05-30T06:43:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ea200640 1 -- 172.21.15.37:0/1851369671 learned_addr learned my addr 172.21.15.37:0/1851369671 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1e8e00640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e4153210 0x7fa1e412e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1e9800640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1cc0039c0 0x7fa1e41325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ea200640 1 -- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e4153210 msgr2=0x7fa1e412e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ea200640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e4153210 0x7fa1e412e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ea200640 1 -- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1cc0039c0 msgr2=0x7fa1e41325c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ea200640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1cc0039c0 0x7fa1e41325c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ea200640 1 -- 172.21.15.37:0/1851369671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e412ee20 con 0x7fa1e412c5b0 2024-05-30T06:43:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1e9800640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1cc0039c0 0x7fa1e41325c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ea200640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e412c5b0 0x7fa1e4140a50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa1e406d940 tx=0x7fa1dc00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1e1600640 1 -- 172.21.15.37:0/1851369671 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc00fce0 con 0x7fa1e412c5b0 2024-05-30T06:43:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1e1600640 1 -- 172.21.15.37:0/1851369671 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1dc01d070 con 0x7fa1e412c5b0 2024-05-30T06:43:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1e1600640 1 -- 172.21.15.37:0/1851369671 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc015670 con 0x7fa1e412c5b0 2024-05-30T06:43:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ec200640 1 -- 172.21.15.37:0/1851369671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e412f100 con 0x7fa1e412c5b0 2024-05-30T06:43:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ec200640 1 -- 172.21.15.37:0/1851369671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e4154e80 con 0x7fa1e412c5b0 2024-05-30T06:43:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.487+0000 7fa1ec200640 1 -- 172.21.15.37:0/1851369671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e4068b20 con 0x7fa1e412c5b0 2024-05-30T06:43:09.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.491+0000 7fa1e1600640 1 -- 172.21.15.37:0/1851369671 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa1dc015810 con 0x7fa1e412c5b0 2024-05-30T06:43:09.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.491+0000 7fa1e1600640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1c4068380 0x7fa1c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.491+0000 7fa1e1600640 1 -- 172.21.15.37:0/1851369671 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa1dc087350 con 0x7fa1e412c5b0 2024-05-30T06:43:09.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.491+0000 7fa1e9800640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1c4068380 0x7fa1c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.491+0000 7fa1e9800640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1c4068380 0x7fa1c406a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80ae000 tx=0x7fa1d8001a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.495+0000 7fa1e1600640 1 -- 172.21.15.37:0/1851369671 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa1dc010040 con 0x7fa1e412c5b0 2024-05-30T06:43:09.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1ec200640 1 -- 172.21.15.37:0/1851369671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1e4155050 con 0x7fa1e412c5b0 2024-05-30T06:43:09.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1e1600640 1 -- 172.21.15.37:0/1851369671 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5178 (secure 0 0 0) 0x7fa1dc057870 con 0x7fa1e412c5b0 2024-05-30T06:43:09.698 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:43:09.698 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1355950100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1355950100},{"type":"v1","addr":"172.21.15.37:6835","nonce":1355950100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3139010455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3139010455},{"type":"v1","addr":"172.21.15.105:6836","nonce":3139010455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/189373657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":189373657},{"type":"v1","addr":"172.21.15.105:6837","nonce":189373657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:43:05.679965+0000","modified":"2024-05-30T06:43:08.691367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6833/12178000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":12178000},{"type":"v1","addr":"172.21.15.37:6833","nonce":12178000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5040,"qdb_cluster":[5040]},"id":2}]} 2024-05-30T06:43:09.698 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2024-05-30T06:43:09.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1ec200640 1 -- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1c4068380 msgr2=0x7fa1c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:09.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1ec200640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1c4068380 0x7fa1c406a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80ae000 tx=0x7fa1d8001a50 comp rx=0 tx=0).stop 2024-05-30T06:43:09.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1ec200640 1 -- 172.21.15.37:0/1851369671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e412c5b0 msgr2=0x7fa1e4140a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:09.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1ec200640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e412c5b0 0x7fa1e4140a50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa1e406d940 tx=0x7fa1dc00f1b0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1ec200640 1 -- 172.21.15.37:0/1851369671 shutdown_connections 2024-05-30T06:43:09.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1ec200640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e412c5b0 0x7fa1e4140a50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1ec200640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e4153210 0x7fa1e412e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1ec200640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1c4068380 0x7fa1c406a840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1ec200640 1 --2- 172.21.15.37:0/1851369671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1cc0039c0 0x7fa1e41325c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1ec200640 1 -- 172.21.15.37:0/1851369671 >> 172.21.15.37:0/1851369671 conn(0x7fa1e40b23a0 msgr2=0x7fa1e415d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:09.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1ec200640 1 -- 172.21.15.37:0/1851369671 shutdown_connections 2024-05-30T06:43:09.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.699+0000 7fa1ec200640 1 -- 172.21.15.37:0/1851369671 wait complete. 2024-05-30T06:43:09.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:43:09.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.859+0000 7f8d94400640 1 Processor -- start 2024-05-30T06:43:09.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.859+0000 7f8d94400640 1 -- start start 2024-05-30T06:43:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.859+0000 7f8d94400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d8c155e60 0x7f8d8c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.859+0000 7f8d94400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8d8c06f9a0 0x7f8d8c0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.859+0000 7f8d94400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d8c15c8f0 con 0x7f8d8c0b2ec0 2024-05-30T06:43:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.859+0000 7f8d94400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8d8c0ccff0 con 0x7f8d8c06f9a0 2024-05-30T06:43:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.859+0000 7f8d94400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8d8c0ccc80 con 0x7f8d8c155e60 2024-05-30T06:43:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.859+0000 7f8d92400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8d8c0b2ec0 0x7f8d8c0cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33312/0 (socket says 172.21.15.37:33312) 2024-05-30T06:43:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.859+0000 7f8d92400640 1 -- 172.21.15.37:0/2321156143 learned_addr learned my addr 172.21.15.37:0/2321156143 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:09.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.859+0000 7f8d91000640 1 --2- 172.21.15.37:0/2321156143 >> v2:172.21.15.105:3300/0 conn(0x7f8d8c06f9a0 0x7f8d8c0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.859+0000 7f8d91a00640 1 --2- 172.21.15.37:0/2321156143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d8c155e60 0x7f8d8c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.863+0000 7f8d8be00640 1 -- 172.21.15.37:0/2321156143 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2670249995 0 0) 0x7f8d8c15c8f0 con 0x7f8d8c0b2ec0 2024-05-30T06:43:09.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.863+0000 7f8d8be00640 1 -- 172.21.15.37:0/2321156143 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d74003530 con 0x7f8d8c0b2ec0 2024-05-30T06:43:09.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.863+0000 7f8d91a00640 1 -- 172.21.15.37:0/2321156143 >> v2:172.21.15.105:3300/0 conn(0x7f8d8c06f9a0 msgr2=0x7f8d8c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:09.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.863+0000 7f8d91a00640 1 --2- 172.21.15.37:0/2321156143 >> v2:172.21.15.105:3300/0 conn(0x7f8d8c06f9a0 0x7f8d8c0cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.863+0000 7f8d91a00640 1 -- 172.21.15.37:0/2321156143 >> v1:172.21.15.37:6789/0 conn(0x7f8d8c0b2ec0 legacy=0x7f8d8c0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:09.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.863+0000 7f8d91a00640 1 -- 172.21.15.37:0/2321156143 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8c15cbd0 con 0x7f8d8c155e60 2024-05-30T06:43:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.863+0000 7f8d91a00640 1 --2- 172.21.15.37:0/2321156143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d8c155e60 0x7f8d8c0b36a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d800097c0 tx=0x7f8d8001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff2c58ac7435bf3e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.863+0000 7f8d8be00640 1 -- 172.21.15.37:0/2321156143 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d800b0070 con 0x7f8d8c155e60 2024-05-30T06:43:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.863+0000 7f8d8be00640 1 -- 172.21.15.37:0/2321156143 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d800ab600 con 0x7f8d8c155e60 2024-05-30T06:43:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.863+0000 7f8d8be00640 1 -- 172.21.15.37:0/2321156143 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d800ab9b0 con 0x7f8d8c155e60 2024-05-30T06:43:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 -- 172.21.15.37:0/2321156143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d8c155e60 msgr2=0x7f8d8c0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 --2- 172.21.15.37:0/2321156143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d8c155e60 0x7f8d8c0b36a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d800097c0 tx=0x7f8d8001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 -- 172.21.15.37:0/2321156143 shutdown_connections 2024-05-30T06:43:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 --2- 172.21.15.37:0/2321156143 >> v2:172.21.15.105:3300/0 conn(0x7f8d8c06f9a0 0x7f8d8c0cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 --2- 172.21.15.37:0/2321156143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d8c155e60 0x7f8d8c0b36a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 -- 172.21.15.37:0/2321156143 >> 172.21.15.37:0/2321156143 conn(0x7f8d8c0b23a0 msgr2=0x7f8d8c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 -- 172.21.15.37:0/2321156143 shutdown_connections 2024-05-30T06:43:09.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 -- 172.21.15.37:0/2321156143 wait complete. 2024-05-30T06:43:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 Processor -- start 2024-05-30T06:43:09.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 -- start start 2024-05-30T06:43:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d8c06f9a0 0x7f8d8c14dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c0b2ec0 0x7f8d8c15a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d8c155e60 0x7f8d8c15ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c06ea10 con 0x7f8d8c0b2ec0 2024-05-30T06:43:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8c06e890 con 0x7f8d8c155e60 2024-05-30T06:43:09.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d94400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8d8c06eb90 con 0x7f8d8c06f9a0 2024-05-30T06:43:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d91000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c0b2ec0 0x7f8d8c15a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d91000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c0b2ec0 0x7f8d8c15a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55814/0 (socket says 172.21.15.37:55814) 2024-05-30T06:43:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d91000640 1 -- 172.21.15.37:0/3737571594 learned_addr learned my addr 172.21.15.37:0/3737571594 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d91a00640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d8c06f9a0 0x7f8d8c14dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d92400640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d8c155e60 0x7f8d8c15ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d91000640 1 -- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d8c06f9a0 msgr2=0x7f8d8c14dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d91000640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d8c06f9a0 0x7f8d8c14dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d91000640 1 -- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d8c155e60 msgr2=0x7f8d8c15ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d91000640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d8c155e60 0x7f8d8c15ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d91000640 1 -- 172.21.15.37:0/3737571594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8c153f50 con 0x7f8d8c0b2ec0 2024-05-30T06:43:09.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.867+0000 7f8d91a00640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d8c06f9a0 0x7f8d8c14dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:09.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.871+0000 7f8d91000640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c0b2ec0 0x7f8d8c15a650 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800e900 tx=0x7f8d7800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:09.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.871+0000 7f8d89600640 1 -- 172.21.15.37:0/3737571594 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78017070 con 0x7f8d8c0b2ec0 2024-05-30T06:43:09.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.871+0000 7f8d89600640 1 -- 172.21.15.37:0/3737571594 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d7800ca00 con 0x7f8d8c0b2ec0 2024-05-30T06:43:09.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.871+0000 7f8d89600640 1 -- 172.21.15.37:0/3737571594 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7800cdd0 con 0x7f8d8c0b2ec0 2024-05-30T06:43:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.871+0000 7f8d94400640 1 -- 172.21.15.37:0/3737571594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8c154230 con 0x7f8d8c0b2ec0 2024-05-30T06:43:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.871+0000 7f8d94400640 1 -- 172.21.15.37:0/3737571594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8c1547f0 con 0x7f8d8c0b2ec0 2024-05-30T06:43:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.871+0000 7f8d94400640 1 -- 172.21.15.37:0/3737571594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d8c1637d0 con 0x7f8d8c0b2ec0 2024-05-30T06:43:09.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.871+0000 7f8d89600640 1 -- 172.21.15.37:0/3737571594 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d7801a070 con 0x7f8d8c0b2ec0 2024-05-30T06:43:09.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.871+0000 7f8d89600640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8d6c068380 0x7f8d6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:09.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.871+0000 7f8d89600640 1 -- 172.21.15.37:0/3737571594 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8d78086cc0 con 0x7f8d8c0b2ec0 2024-05-30T06:43:09.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.871+0000 7f8d91a00640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8d6c068380 0x7f8d6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:09.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.875+0000 7f8d91a00640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8d6c068380 0x7f8d6c06a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d800ad000 tx=0x7f8d800a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:09.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:09.875+0000 7f8d89600640 1 -- 172.21.15.37:0/3737571594 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8d8c1637d0 con 0x7f8d8c0b2ec0 2024-05-30T06:43:10.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d94400640 1 -- 172.21.15.37:0/3737571594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d8c068b20 con 0x7f8d8c0b2ec0 2024-05-30T06:43:10.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d89600640 1 -- 172.21.15.37:0/3737571594 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16657 (secure 0 0 0) 0x7f8d7808d080 con 0x7f8d8c0b2ec0 2024-05-30T06:43:10.042 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:43:10.042 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:43:07.284887+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:43:03.490124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T06:43:04.639175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:43:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d94400640 1 -- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8d6c068380 msgr2=0x7f8d6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d94400640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8d6c068380 0x7f8d6c06a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d800ad000 tx=0x7f8d800a6000 comp rx=0 tx=0).stop 2024-05-30T06:43:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d94400640 1 -- 172.21.15.37:0/3737571594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c0b2ec0 msgr2=0x7f8d8c15a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d94400640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c0b2ec0 0x7f8d8c15a650 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800e900 tx=0x7f8d7800edc0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d94400640 1 -- 172.21.15.37:0/3737571594 shutdown_connections 2024-05-30T06:43:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d94400640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8d6c068380 0x7f8d6c06a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d94400640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d8c155e60 0x7f8d8c15ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d94400640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c0b2ec0 0x7f8d8c15a650 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d94400640 1 --2- 172.21.15.37:0/3737571594 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d8c06f9a0 0x7f8d8c14dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d94400640 1 -- 172.21.15.37:0/3737571594 >> 172.21.15.37:0/3737571594 conn(0x7f8d8c0b23a0 msgr2=0x7f8d8c151550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d94400640 1 -- 172.21.15.37:0/3737571594 shutdown_connections 2024-05-30T06:43:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.043+0000 7f8d94400640 1 -- 172.21.15.37:0/3737571594 wait complete. 2024-05-30T06:43:10.064 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-30T06:43:10.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:43:10.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.207+0000 7fb15aa00640 1 Processor -- start 2024-05-30T06:43:10.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.207+0000 7fb15aa00640 1 -- start start 2024-05-30T06:43:10.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.207+0000 7fb15aa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1540b2e20 0x7fb154160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:10.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.207+0000 7fb15aa00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1540d0430 con 0x7fb15409ba70 2024-05-30T06:43:10.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.207+0000 7fb15aa00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1540d0710 con 0x7fb1541609c0 2024-05-30T06:43:10.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.207+0000 7fb15aa00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb1540b3200 con 0x7fb1540b2e20 2024-05-30T06:43:10.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.207+0000 7fb153e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1540b2e20 0x7fb154160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:10.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.207+0000 7fb158a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb15409ba70 0x7fb1540cd990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33314/0 (socket says 172.21.15.37:33314) 2024-05-30T06:43:10.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.207+0000 7fb158a00640 1 -- 172.21.15.37:0/284193611 learned_addr learned my addr 172.21.15.37:0/284193611 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:10.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.207+0000 7fb153e00640 1 -- 172.21.15.37:0/284193611 >> v1:172.21.15.105:6789/0 conn(0x7fb1541609c0 legacy=0x7fb1540cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.207+0000 7fb153e00640 1 -- 172.21.15.37:0/284193611 >> v1:172.21.15.37:6789/0 conn(0x7fb15409ba70 legacy=0x7fb1540cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.207+0000 7fb153e00640 1 -- 172.21.15.37:0/284193611 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1540b35f0 con 0x7fb1540b2e20 2024-05-30T06:43:10.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.207+0000 7fb152a00640 1 -- 172.21.15.37:0/284193611 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4094302653 0 0) 0x7fb1540d0430 con 0x7fb15409ba70 2024-05-30T06:43:10.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.211+0000 7fb153e00640 1 --2- 172.21.15.37:0/284193611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1540b2e20 0x7fb154160480 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb1440097c0 tx=0x7fb14401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64a78632d242d61 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:10.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.211+0000 7fb152a00640 1 -- 172.21.15.37:0/284193611 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440b0070 con 0x7fb1540b2e20 2024-05-30T06:43:10.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.211+0000 7fb152a00640 1 -- 172.21.15.37:0/284193611 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1440ab600 con 0x7fb1540b2e20 2024-05-30T06:43:10.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.211+0000 7fb152a00640 1 -- 172.21.15.37:0/284193611 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440ab9d0 con 0x7fb1540b2e20 2024-05-30T06:43:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.211+0000 7fb15aa00640 1 -- 172.21.15.37:0/284193611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1540b2e20 msgr2=0x7fb154160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.211+0000 7fb15aa00640 1 --2- 172.21.15.37:0/284193611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1540b2e20 0x7fb154160480 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb1440097c0 tx=0x7fb14401c4a0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.211+0000 7fb15aa00640 1 -- 172.21.15.37:0/284193611 shutdown_connections 2024-05-30T06:43:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.211+0000 7fb15aa00640 1 --2- 172.21.15.37:0/284193611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1540b2e20 0x7fb154160480 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.211+0000 7fb15aa00640 1 -- 172.21.15.37:0/284193611 >> 172.21.15.37:0/284193611 conn(0x7fb1540b4100 msgr2=0x7fb1540b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.211+0000 7fb15aa00640 1 -- 172.21.15.37:0/284193611 shutdown_connections 2024-05-30T06:43:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.211+0000 7fb15aa00640 1 -- 172.21.15.37:0/284193611 wait complete. 2024-05-30T06:43:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.211+0000 7fb15aa00640 1 Processor -- start 2024-05-30T06:43:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.211+0000 7fb15aa00640 1 -- start start 2024-05-30T06:43:10.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb15aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15409ba70 0x7fb1540b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:10.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb15aa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1540b2e20 0x7fb154166f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:10.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb15aa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1541609c0 0x7fb1540b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb15aa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb15416afe0 con 0x7fb15409ba70 2024-05-30T06:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb15aa00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb1540b33a0 con 0x7fb1541609c0 2024-05-30T06:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb15aa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb15416b160 con 0x7fb1540b2e20 2024-05-30T06:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb153e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15409ba70 0x7fb1540b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb153e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15409ba70 0x7fb1540b74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55830/0 (socket says 172.21.15.37:55830) 2024-05-30T06:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb153e00640 1 -- 172.21.15.37:0/2587668489 learned_addr learned my addr 172.21.15.37:0/2587668489 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb153400640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1540b2e20 0x7fb154166f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb158a00640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1541609c0 0x7fb1540b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb153e00640 1 -- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1540b2e20 msgr2=0x7fb154166f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb153e00640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1540b2e20 0x7fb154166f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb153e00640 1 -- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1541609c0 msgr2=0x7fb1540b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb153e00640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1541609c0 0x7fb1540b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb153e00640 1 -- 172.21.15.37:0/2587668489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1540d17f0 con 0x7fb15409ba70 2024-05-30T06:43:10.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb153400640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1540b2e20 0x7fb154166f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:43:10.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb158a00640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1541609c0 0x7fb1540b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:43:10.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb153e00640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15409ba70 0x7fb1540b74c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb1440ae040 tx=0x7fb14401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:10.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb14be00640 1 -- 172.21.15.37:0/2587668489 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440b0050 con 0x7fb15409ba70 2024-05-30T06:43:10.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb14be00640 1 -- 172.21.15.37:0/2587668489 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1440bc070 con 0x7fb15409ba70 2024-05-30T06:43:10.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb14be00640 1 -- 172.21.15.37:0/2587668489 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440b5a70 con 0x7fb15409ba70 2024-05-30T06:43:10.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb15aa00640 1 -- 172.21.15.37:0/2587668489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1540b7ac0 con 0x7fb15409ba70 2024-05-30T06:43:10.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb15aa00640 1 -- 172.21.15.37:0/2587668489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1540b8080 con 0x7fb15409ba70 2024-05-30T06:43:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.215+0000 7fb15aa00640 1 -- 172.21.15.37:0/2587668489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb154068b20 con 0x7fb15409ba70 2024-05-30T06:43:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.219+0000 7fb14be00640 1 -- 172.21.15.37:0/2587668489 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb1440ab4c0 con 0x7fb15409ba70 2024-05-30T06:43:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.219+0000 7fb14be00640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb134068380 0x7fb13406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.219+0000 7fb14be00640 1 -- 172.21.15.37:0/2587668489 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb1441212c0 con 0x7fb15409ba70 2024-05-30T06:43:10.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.219+0000 7fb153400640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb134068380 0x7fb13406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:10.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.219+0000 7fb153400640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb134068380 0x7fb13406a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb1540720c0 tx=0x7fb140009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:10.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.223+0000 7fb14be00640 1 -- 172.21.15.37:0/2587668489 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb144016090 con 0x7fb15409ba70 2024-05-30T06:43:10.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.383+0000 7fb15aa00640 1 -- 172.21.15.37:0/2587668489 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1540ce860 con 0x7fb134068380 2024-05-30T06:43:10.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.391+0000 7fb14be00640 1 -- 172.21.15.37:0/2587668489 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237197 (secure 0 0 0) 0x7fb1540ce860 con 0x7fb134068380 2024-05-30T06:43:10.392 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:43:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:43:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.395+0000 7fb15aa00640 1 -- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb134068380 msgr2=0x7fb13406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.395+0000 7fb15aa00640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb134068380 0x7fb13406a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb1540720c0 tx=0x7fb140009040 comp rx=0 tx=0).stop 2024-05-30T06:43:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.395+0000 7fb15aa00640 1 -- 172.21.15.37:0/2587668489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15409ba70 msgr2=0x7fb1540b74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.395+0000 7fb15aa00640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15409ba70 0x7fb1540b74c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb1440ae040 tx=0x7fb14401ace0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.395+0000 7fb15aa00640 1 -- 172.21.15.37:0/2587668489 shutdown_connections 2024-05-30T06:43:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.395+0000 7fb15aa00640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb134068380 0x7fb13406a840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.395+0000 7fb15aa00640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1541609c0 0x7fb1540b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.395+0000 7fb15aa00640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1540b2e20 0x7fb154166f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.395+0000 7fb15aa00640 1 --2- 172.21.15.37:0/2587668489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15409ba70 0x7fb1540b74c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.395+0000 7fb15aa00640 1 -- 172.21.15.37:0/2587668489 >> 172.21.15.37:0/2587668489 conn(0x7fb1540b4100 msgr2=0x7fb154158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:10.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.395+0000 7fb15aa00640 1 -- 172.21.15.37:0/2587668489 shutdown_connections 2024-05-30T06:43:10.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.395+0000 7fb15aa00640 1 -- 172.21.15.37:0/2587668489 wait complete. 2024-05-30T06:43:10.412 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-05-30T06:43:08.656762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219904,"kb_used_data":3688,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754816,"statfs":{"total":773094113280,"available":772868931584,"internally_reserved":0,"allocated":3776512,"data_stored":2153688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.392510"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:05.264055+0000","last_change":"2024-05-30T06:43:05.264055+0000","last_active":"2024-05-30T06:43:05.264055+0000","last_peered":"2024-05-30T06:43:05.264055+0000","last_clean":"2024-05-30T06:43:05.264055+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:05.264055+0000","last_undegraded":"2024-05-30T06:43:05.264055+0000","last_fullsized":"2024-05-30T06:43:05.264055+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:43:04.256486+0000","last_change":"2024-05-30T06:43:04.256486+0000","last_active":"2024-05-30T06:43:04.256486+0000","last_peered":"2024-05-30T06:43:04.256486+0000","last_clean":"2024-05-30T06:43:04.256486+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:43:04.256486+0000","last_undegraded":"2024-05-30T06:43:04.256486+0000","last_fullsized":"2024-05-30T06:43:04.256486+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":186,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-30T06:42:59.877688+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:42:59.877688+0000","last_peered":"2024-05-30T06:42:59.877688+0000","last_clean":"2024-05-30T06:42:59.877688+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:42:59.877688+0000","last_undegraded":"2024-05-30T06:42:59.877688+0000","last_fullsized":"2024-05-30T06:42:59.877688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":917504,"data_stored":711987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":121619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":323584,"data_stored":121619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":121619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":917504,"data_stored":711987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:43:10.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:43:10.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.595+0000 7f8cd4c00640 1 Processor -- start 2024-05-30T06:43:10.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.595+0000 7f8cd4c00640 1 -- start start 2024-05-30T06:43:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8cd4c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8cd0155e60 0x7f8cd00b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8cd4c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cd006f9a0 0x7f8cd00cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8cd4c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8cd00b2ec0 0x7f8cd00cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8cd4c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd00ccff0 con 0x7f8cd0155e60 2024-05-30T06:43:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8cd4c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd00d00e0 con 0x7f8cd00b2ec0 2024-05-30T06:43:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8cd4c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd015c8f0 con 0x7f8cd006f9a0 2024-05-30T06:43:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8ccde00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8cd0155e60 0x7f8cd00b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8ccde00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8cd0155e60 0x7f8cd00b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55838/0 (socket says 172.21.15.37:55838) 2024-05-30T06:43:10.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8ccde00640 1 -- 172.21.15.37:0/2718900423 learned_addr learned my addr 172.21.15.37:0/2718900423 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:10.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8cce800640 1 --2- 172.21.15.37:0/2718900423 >> v2:172.21.15.105:3300/0 conn(0x7f8cd00b2ec0 0x7f8cd00cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:10.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8cc5400640 1 --2- 172.21.15.37:0/2718900423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cd006f9a0 0x7f8cd00cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:10.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8ccde00640 1 -- 172.21.15.37:0/2718900423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cd006f9a0 msgr2=0x7f8cd00cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:10.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8ccde00640 1 --2- 172.21.15.37:0/2718900423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cd006f9a0 0x7f8cd00cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8ccde00640 1 -- 172.21.15.37:0/2718900423 >> v2:172.21.15.105:3300/0 conn(0x7f8cd00b2ec0 msgr2=0x7f8cd00cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:10.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8ccde00640 1 --2- 172.21.15.37:0/2718900423 >> v2:172.21.15.105:3300/0 conn(0x7f8cd00b2ec0 0x7f8cd00cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.599+0000 7f8ccde00640 1 -- 172.21.15.37:0/2718900423 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd00ccc80 con 0x7f8cd0155e60 2024-05-30T06:43:10.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8ccde00640 1 --2- 172.21.15.37:0/2718900423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd0155e60 0x7f8cd00b36a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0070df0 tx=0x7f8cc001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848f9210c940fdc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8ccd400640 1 -- 172.21.15.37:0/2718900423 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00ab5f0 con 0x7f8cd0155e60 2024-05-30T06:43:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8ccd400640 1 -- 172.21.15.37:0/2718900423 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc00b0070 con 0x7f8cd0155e60 2024-05-30T06:43:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8ccd400640 1 -- 172.21.15.37:0/2718900423 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00ab9b0 con 0x7f8cd0155e60 2024-05-30T06:43:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8cd4c00640 1 -- 172.21.15.37:0/2718900423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd0155e60 msgr2=0x7f8cd00b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/2718900423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd0155e60 0x7f8cd00b36a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0070df0 tx=0x7f8cc001c520 comp rx=0 tx=0).stop 2024-05-30T06:43:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8cd4c00640 1 -- 172.21.15.37:0/2718900423 shutdown_connections 2024-05-30T06:43:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/2718900423 >> v2:172.21.15.105:3300/0 conn(0x7f8cd00b2ec0 0x7f8cd00cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/2718900423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cd006f9a0 0x7f8cd00cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/2718900423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd0155e60 0x7f8cd00b36a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8cd4c00640 1 -- 172.21.15.37:0/2718900423 >> 172.21.15.37:0/2718900423 conn(0x7f8cd00b23a0 msgr2=0x7f8cd00b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8cd4c00640 1 -- 172.21.15.37:0/2718900423 shutdown_connections 2024-05-30T06:43:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8cd4c00640 1 -- 172.21.15.37:0/2718900423 wait complete. 2024-05-30T06:43:10.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8cd4c00640 1 Processor -- start 2024-05-30T06:43:10.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.603+0000 7f8cd4c00640 1 -- start start 2024-05-30T06:43:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cd4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd006f9a0 0x7f8cd013cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cd4c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cd00b2ec0 0x7f8cd01628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cd4c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cd0155e60 0x7f8cd0162e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cd4c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd00ce020 con 0x7f8cd006f9a0 2024-05-30T06:43:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cd4c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd00cdea0 con 0x7f8cd0155e60 2024-05-30T06:43:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cd4c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd00ce1a0 con 0x7f8cd00b2ec0 2024-05-30T06:43:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8ccde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd006f9a0 0x7f8cd013cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8ccde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd006f9a0 0x7f8cd013cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55840/0 (socket says 172.21.15.37:55840) 2024-05-30T06:43:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8ccde00640 1 -- 172.21.15.37:0/3443479728 learned_addr learned my addr 172.21.15.37:0/3443479728 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cce800640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cd0155e60 0x7f8cd0162e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cc5400640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cd00b2ec0 0x7f8cd01628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8ccde00640 1 -- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cd00b2ec0 msgr2=0x7f8cd01628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8ccde00640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cd00b2ec0 0x7f8cd01628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8ccde00640 1 -- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cd0155e60 msgr2=0x7f8cd0162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8ccde00640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cd0155e60 0x7f8cd0162e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8ccde00640 1 -- 172.21.15.37:0/3443479728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd014f8f0 con 0x7f8cd006f9a0 2024-05-30T06:43:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8ccde00640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd006f9a0 0x7f8cd013cc90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00ad040 tx=0x7f8cc001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cc6a00640 1 -- 172.21.15.37:0/3443479728 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00be3f0 con 0x7f8cd006f9a0 2024-05-30T06:43:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cc6a00640 1 -- 172.21.15.37:0/3443479728 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc00be590 con 0x7f8cd006f9a0 2024-05-30T06:43:10.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cd4c00640 1 -- 172.21.15.37:0/3443479728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd014fbd0 con 0x7f8cd006f9a0 2024-05-30T06:43:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cc6a00640 1 -- 172.21.15.37:0/3443479728 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00be960 con 0x7f8cd006f9a0 2024-05-30T06:43:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cd4c00640 1 -- 172.21.15.37:0/3443479728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd0150190 con 0x7f8cd006f9a0 2024-05-30T06:43:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cd4c00640 1 -- 172.21.15.37:0/3443479728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd0068b20 con 0x7f8cd006f9a0 2024-05-30T06:43:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.607+0000 7f8cc6a00640 1 -- 172.21.15.37:0/3443479728 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8cc00b43f0 con 0x7f8cd006f9a0 2024-05-30T06:43:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.611+0000 7f8cc6a00640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8cac068380 0x7f8cac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.611+0000 7f8cc6a00640 1 -- 172.21.15.37:0/3443479728 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f8cc0120d40 con 0x7f8cd006f9a0 2024-05-30T06:43:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.611+0000 7f8cc5400640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8cac068380 0x7f8cac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.611+0000 7f8cc5400640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8cac068380 0x7f8cac06a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0143330 tx=0x7f8cb8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:10.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.615+0000 7f8cc6a00640 1 -- 172.21.15.37:0/3443479728 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8cc00c4060 con 0x7f8cd006f9a0 2024-05-30T06:43:10.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.779+0000 7f8cd4c00640 1 -- 172.21.15.37:0/3443479728 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8cd0072fb0 con 0x7f8cac068380 2024-05-30T06:43:10.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.783+0000 7f8cc6a00640 1 -- 172.21.15.37:0/3443479728 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251971 (secure 0 0 0) 0x7f8cd0072fb0 con 0x7f8cac068380 2024-05-30T06:43:10.787 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:43:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:43:10.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.787+0000 7f8cd4c00640 1 -- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8cac068380 msgr2=0x7f8cac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.787+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8cac068380 0x7f8cac06a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0143330 tx=0x7f8cb8008040 comp rx=0 tx=0).stop 2024-05-30T06:43:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.787+0000 7f8cd4c00640 1 -- 172.21.15.37:0/3443479728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd006f9a0 msgr2=0x7f8cd013cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.787+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd006f9a0 0x7f8cd013cc90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00ad040 tx=0x7f8cc001ad60 comp rx=0 tx=0).stop 2024-05-30T06:43:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.787+0000 7f8cd4c00640 1 -- 172.21.15.37:0/3443479728 shutdown_connections 2024-05-30T06:43:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.787+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8cac068380 0x7f8cac06a840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.787+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cd0155e60 0x7f8cd0162e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.787+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cd00b2ec0 0x7f8cd01628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.787+0000 7f8cd4c00640 1 --2- 172.21.15.37:0/3443479728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd006f9a0 0x7f8cd013cc90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.787+0000 7f8cd4c00640 1 -- 172.21.15.37:0/3443479728 >> 172.21.15.37:0/3443479728 conn(0x7f8cd00b23a0 msgr2=0x7f8cd00b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.787+0000 7f8cd4c00640 1 -- 172.21.15.37:0/3443479728 shutdown_connections 2024-05-30T06:43:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.787+0000 7f8cd4c00640 1 -- 172.21.15.37:0/3443479728 wait complete. 2024-05-30T06:43:10.807 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-05-30T06:43:10.657176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220328,"kb_used_data":4124,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754392,"statfs":{"total":773094113280,"available":772868497408,"internally_reserved":0,"allocated":4222976,"data_stored":2353480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001488"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.805412+0000","last_change":"2024-05-30T06:43:06.303757+0000","last_active":"2024-05-30T06:43:07.805412+0000","last_peered":"2024-05-30T06:43:07.805412+0000","last_clean":"2024-05-30T06:43:07.805412+0000","last_became_active":"2024-05-30T06:43:06.303411+0000","last_became_peered":"2024-05-30T06:43:06.303411+0000","last_unstale":"2024-05-30T06:43:07.805412+0000","last_undegraded":"2024-05-30T06:43:07.805412+0000","last_fullsized":"2024-05-30T06:43:07.805412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:09:51.187723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379706+0000","last_change":"2024-05-30T06:43:06.298292+0000","last_active":"2024-05-30T06:43:07.379706+0000","last_peered":"2024-05-30T06:43:07.379706+0000","last_clean":"2024-05-30T06:43:07.379706+0000","last_became_active":"2024-05-30T06:43:06.297504+0000","last_became_peered":"2024-05-30T06:43:06.297504+0000","last_unstale":"2024-05-30T06:43:07.379706+0000","last_undegraded":"2024-05-30T06:43:07.379706+0000","last_fullsized":"2024-05-30T06:43:07.379706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:45:51.392367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293442+0000","last_change":"2024-05-30T06:43:06.311432+0000","last_active":"2024-05-30T06:43:07.293442+0000","last_peered":"2024-05-30T06:43:07.293442+0000","last_clean":"2024-05-30T06:43:07.293442+0000","last_became_active":"2024-05-30T06:43:06.311168+0000","last_became_peered":"2024-05-30T06:43:06.311168+0000","last_unstale":"2024-05-30T06:43:07.293442+0000","last_undegraded":"2024-05-30T06:43:07.293442+0000","last_fullsized":"2024-05-30T06:43:07.293442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:15:47.278899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.303584+0000","last_change":"2024-05-30T06:43:06.312227+0000","last_active":"2024-05-30T06:43:07.303584+0000","last_peered":"2024-05-30T06:43:07.303584+0000","last_clean":"2024-05-30T06:43:07.303584+0000","last_became_active":"2024-05-30T06:43:06.311716+0000","last_became_peered":"2024-05-30T06:43:06.311716+0000","last_unstale":"2024-05-30T06:43:07.303584+0000","last_undegraded":"2024-05-30T06:43:07.303584+0000","last_fullsized":"2024-05-30T06:43:07.303584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:14:41.291373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293433+0000","last_change":"2024-05-30T06:43:06.322403+0000","last_active":"2024-05-30T06:43:07.293433+0000","last_peered":"2024-05-30T06:43:07.293433+0000","last_clean":"2024-05-30T06:43:07.293433+0000","last_became_active":"2024-05-30T06:43:06.322004+0000","last_became_peered":"2024-05-30T06:43:06.322004+0000","last_unstale":"2024-05-30T06:43:07.293433+0000","last_undegraded":"2024-05-30T06:43:07.293433+0000","last_fullsized":"2024-05-30T06:43:07.293433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:08.971730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379226+0000","last_change":"2024-05-30T06:43:06.284272+0000","last_active":"2024-05-30T06:43:07.379226+0000","last_peered":"2024-05-30T06:43:07.379226+0000","last_clean":"2024-05-30T06:43:07.379226+0000","last_became_active":"2024-05-30T06:43:06.283980+0000","last_became_peered":"2024-05-30T06:43:06.283980+0000","last_unstale":"2024-05-30T06:43:07.379226+0000","last_undegraded":"2024-05-30T06:43:07.379226+0000","last_fullsized":"2024-05-30T06:43:07.379226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:15:47.278899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.805284+0000","last_change":"2024-05-30T06:43:06.299422+0000","last_active":"2024-05-30T06:43:07.805284+0000","last_peered":"2024-05-30T06:43:07.805284+0000","last_clean":"2024-05-30T06:43:07.805284+0000","last_became_active":"2024-05-30T06:43:06.299125+0000","last_became_peered":"2024-05-30T06:43:06.299125+0000","last_unstale":"2024-05-30T06:43:07.805284+0000","last_undegraded":"2024-05-30T06:43:07.805284+0000","last_fullsized":"2024-05-30T06:43:07.805284+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:22:51.401354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804619+0000","last_change":"2024-05-30T06:43:06.305200+0000","last_active":"2024-05-30T06:43:07.804619+0000","last_peered":"2024-05-30T06:43:07.804619+0000","last_clean":"2024-05-30T06:43:07.804619+0000","last_became_active":"2024-05-30T06:43:06.304934+0000","last_became_peered":"2024-05-30T06:43:06.304934+0000","last_unstale":"2024-05-30T06:43:07.804619+0000","last_undegraded":"2024-05-30T06:43:07.804619+0000","last_fullsized":"2024-05-30T06:43:07.804619+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:04:39.167161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804947+0000","last_change":"2024-05-30T06:43:06.315448+0000","last_active":"2024-05-30T06:43:07.804947+0000","last_peered":"2024-05-30T06:43:07.804947+0000","last_clean":"2024-05-30T06:43:07.804947+0000","last_became_active":"2024-05-30T06:43:06.314983+0000","last_became_peered":"2024-05-30T06:43:06.314983+0000","last_unstale":"2024-05-30T06:43:07.804947+0000","last_undegraded":"2024-05-30T06:43:07.804947+0000","last_fullsized":"2024-05-30T06:43:07.804947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:47:30.537400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.303590+0000","last_change":"2024-05-30T06:43:06.319721+0000","last_active":"2024-05-30T06:43:07.303590+0000","last_peered":"2024-05-30T06:43:07.303590+0000","last_clean":"2024-05-30T06:43:07.303590+0000","last_became_active":"2024-05-30T06:43:06.319436+0000","last_became_peered":"2024-05-30T06:43:06.319436+0000","last_unstale":"2024-05-30T06:43:07.303590+0000","last_undegraded":"2024-05-30T06:43:07.303590+0000","last_fullsized":"2024-05-30T06:43:07.303590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:47:30.537400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804625+0000","last_change":"2024-05-30T06:43:06.309520+0000","last_active":"2024-05-30T06:43:07.804625+0000","last_peered":"2024-05-30T06:43:07.804625+0000","last_clean":"2024-05-30T06:43:07.804625+0000","last_became_active":"2024-05-30T06:43:06.308773+0000","last_became_peered":"2024-05-30T06:43:06.308773+0000","last_unstale":"2024-05-30T06:43:07.804625+0000","last_undegraded":"2024-05-30T06:43:07.804625+0000","last_fullsized":"2024-05-30T06:43:07.804625+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:01.204232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293699+0000","last_change":"2024-05-30T06:43:06.290941+0000","last_active":"2024-05-30T06:43:07.293699+0000","last_peered":"2024-05-30T06:43:07.293699+0000","last_clean":"2024-05-30T06:43:07.293699+0000","last_became_active":"2024-05-30T06:43:06.290214+0000","last_became_peered":"2024-05-30T06:43:06.290214+0000","last_unstale":"2024-05-30T06:43:07.293699+0000","last_undegraded":"2024-05-30T06:43:07.293699+0000","last_fullsized":"2024-05-30T06:43:07.293699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:38:50.986553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293446+0000","last_change":"2024-05-30T06:43:06.314185+0000","last_active":"2024-05-30T06:43:07.293446+0000","last_peered":"2024-05-30T06:43:07.293446+0000","last_clean":"2024-05-30T06:43:07.293446+0000","last_became_active":"2024-05-30T06:43:06.313902+0000","last_became_peered":"2024-05-30T06:43:06.313902+0000","last_unstale":"2024-05-30T06:43:07.293446+0000","last_undegraded":"2024-05-30T06:43:07.293446+0000","last_fullsized":"2024-05-30T06:43:07.293446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:17:08.094052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379255+0000","last_change":"2024-05-30T06:43:06.309073+0000","last_active":"2024-05-30T06:43:07.379255+0000","last_peered":"2024-05-30T06:43:07.379255+0000","last_clean":"2024-05-30T06:43:07.379255+0000","last_became_active":"2024-05-30T06:43:06.308803+0000","last_became_peered":"2024-05-30T06:43:06.308803+0000","last_unstale":"2024-05-30T06:43:07.379255+0000","last_undegraded":"2024-05-30T06:43:07.379255+0000","last_fullsized":"2024-05-30T06:43:07.379255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:43:58.343694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293200+0000","last_change":"2024-05-30T06:43:06.297220+0000","last_active":"2024-05-30T06:43:07.293200+0000","last_peered":"2024-05-30T06:43:07.293200+0000","last_clean":"2024-05-30T06:43:07.293200+0000","last_became_active":"2024-05-30T06:43:06.296861+0000","last_became_peered":"2024-05-30T06:43:06.296861+0000","last_unstale":"2024-05-30T06:43:07.293200+0000","last_undegraded":"2024-05-30T06:43:07.293200+0000","last_fullsized":"2024-05-30T06:43:07.293200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:35:01.204232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804854+0000","last_change":"2024-05-30T06:43:06.306185+0000","last_active":"2024-05-30T06:43:07.804854+0000","last_peered":"2024-05-30T06:43:07.804854+0000","last_clean":"2024-05-30T06:43:07.804854+0000","last_became_active":"2024-05-30T06:43:06.305565+0000","last_became_peered":"2024-05-30T06:43:06.305565+0000","last_unstale":"2024-05-30T06:43:07.804854+0000","last_undegraded":"2024-05-30T06:43:07.804854+0000","last_fullsized":"2024-05-30T06:43:07.804854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:15:47.278899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804913+0000","last_change":"2024-05-30T06:43:06.305328+0000","last_active":"2024-05-30T06:43:07.804913+0000","last_peered":"2024-05-30T06:43:07.804913+0000","last_clean":"2024-05-30T06:43:07.804913+0000","last_became_active":"2024-05-30T06:43:06.305139+0000","last_became_peered":"2024-05-30T06:43:06.305139+0000","last_unstale":"2024-05-30T06:43:07.804913+0000","last_undegraded":"2024-05-30T06:43:07.804913+0000","last_fullsized":"2024-05-30T06:43:07.804913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:13:04.363665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379868+0000","last_change":"2024-05-30T06:43:06.309894+0000","last_active":"2024-05-30T06:43:07.379868+0000","last_peered":"2024-05-30T06:43:07.379868+0000","last_clean":"2024-05-30T06:43:07.379868+0000","last_became_active":"2024-05-30T06:43:06.297847+0000","last_became_peered":"2024-05-30T06:43:06.297847+0000","last_unstale":"2024-05-30T06:43:07.379868+0000","last_undegraded":"2024-05-30T06:43:07.379868+0000","last_fullsized":"2024-05-30T06:43:07.379868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:43:35.308488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379566+0000","last_change":"2024-05-30T06:43:06.301100+0000","last_active":"2024-05-30T06:43:07.379566+0000","last_peered":"2024-05-30T06:43:07.379566+0000","last_clean":"2024-05-30T06:43:07.379566+0000","last_became_active":"2024-05-30T06:43:06.300784+0000","last_became_peered":"2024-05-30T06:43:06.300784+0000","last_unstale":"2024-05-30T06:43:07.379566+0000","last_undegraded":"2024-05-30T06:43:07.379566+0000","last_fullsized":"2024-05-30T06:43:07.379566+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:18:01.173671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293723+0000","last_change":"2024-05-30T06:43:06.314089+0000","last_active":"2024-05-30T06:43:07.293723+0000","last_peered":"2024-05-30T06:43:07.293723+0000","last_clean":"2024-05-30T06:43:07.293723+0000","last_became_active":"2024-05-30T06:43:06.309415+0000","last_became_peered":"2024-05-30T06:43:06.309415+0000","last_unstale":"2024-05-30T06:43:07.293723+0000","last_undegraded":"2024-05-30T06:43:07.293723+0000","last_fullsized":"2024-05-30T06:43:07.293723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:50:05.669869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803463+0000","last_change":"2024-05-30T06:43:06.296317+0000","last_active":"2024-05-30T06:43:07.803463+0000","last_peered":"2024-05-30T06:43:07.803463+0000","last_clean":"2024-05-30T06:43:07.803463+0000","last_became_active":"2024-05-30T06:43:06.296035+0000","last_became_peered":"2024-05-30T06:43:06.296035+0000","last_unstale":"2024-05-30T06:43:07.803463+0000","last_undegraded":"2024-05-30T06:43:07.803463+0000","last_fullsized":"2024-05-30T06:43:07.803463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:55:04.026783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803799+0000","last_change":"2024-05-30T06:43:06.292460+0000","last_active":"2024-05-30T06:43:07.803799+0000","last_peered":"2024-05-30T06:43:07.803799+0000","last_clean":"2024-05-30T06:43:07.803799+0000","last_became_active":"2024-05-30T06:43:06.291806+0000","last_became_peered":"2024-05-30T06:43:06.291806+0000","last_unstale":"2024-05-30T06:43:07.803799+0000","last_undegraded":"2024-05-30T06:43:07.803799+0000","last_fullsized":"2024-05-30T06:43:07.803799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:14:41.291373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293725+0000","last_change":"2024-05-30T06:43:06.302371+0000","last_active":"2024-05-30T06:43:07.293725+0000","last_peered":"2024-05-30T06:43:07.293725+0000","last_clean":"2024-05-30T06:43:07.293725+0000","last_became_active":"2024-05-30T06:43:06.302000+0000","last_became_peered":"2024-05-30T06:43:06.302000+0000","last_unstale":"2024-05-30T06:43:07.293725+0000","last_undegraded":"2024-05-30T06:43:07.293725+0000","last_fullsized":"2024-05-30T06:43:07.293725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:06:59.333190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.292976+0000","last_change":"2024-05-30T06:43:06.307483+0000","last_active":"2024-05-30T06:43:07.292976+0000","last_peered":"2024-05-30T06:43:07.292976+0000","last_clean":"2024-05-30T06:43:07.292976+0000","last_became_active":"2024-05-30T06:43:06.307224+0000","last_became_peered":"2024-05-30T06:43:06.307224+0000","last_unstale":"2024-05-30T06:43:07.292976+0000","last_undegraded":"2024-05-30T06:43:07.292976+0000","last_fullsized":"2024-05-30T06:43:07.292976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:02:14.137091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.303799+0000","last_change":"2024-05-30T06:43:06.310527+0000","last_active":"2024-05-30T06:43:07.303799+0000","last_peered":"2024-05-30T06:43:07.303799+0000","last_clean":"2024-05-30T06:43:07.303799+0000","last_became_active":"2024-05-30T06:43:06.310155+0000","last_became_peered":"2024-05-30T06:43:06.310155+0000","last_unstale":"2024-05-30T06:43:07.303799+0000","last_undegraded":"2024-05-30T06:43:07.303799+0000","last_fullsized":"2024-05-30T06:43:07.303799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:22:55.045778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.380001+0000","last_change":"2024-05-30T06:43:06.298019+0000","last_active":"2024-05-30T06:43:07.380001+0000","last_peered":"2024-05-30T06:43:07.380001+0000","last_clean":"2024-05-30T06:43:07.380001+0000","last_became_active":"2024-05-30T06:43:06.297047+0000","last_became_peered":"2024-05-30T06:43:06.297047+0000","last_unstale":"2024-05-30T06:43:07.380001+0000","last_undegraded":"2024-05-30T06:43:07.380001+0000","last_fullsized":"2024-05-30T06:43:07.380001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:56:33.727477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.303794+0000","last_change":"2024-05-30T06:43:06.312620+0000","last_active":"2024-05-30T06:43:07.303794+0000","last_peered":"2024-05-30T06:43:07.303794+0000","last_clean":"2024-05-30T06:43:07.303794+0000","last_became_active":"2024-05-30T06:43:06.311152+0000","last_became_peered":"2024-05-30T06:43:06.311152+0000","last_unstale":"2024-05-30T06:43:07.303794+0000","last_undegraded":"2024-05-30T06:43:07.303794+0000","last_fullsized":"2024-05-30T06:43:07.303794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:00:49.608169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293814+0000","last_change":"2024-05-30T06:43:06.294137+0000","last_active":"2024-05-30T06:43:07.293814+0000","last_peered":"2024-05-30T06:43:07.293814+0000","last_clean":"2024-05-30T06:43:07.293814+0000","last_became_active":"2024-05-30T06:43:06.293895+0000","last_became_peered":"2024-05-30T06:43:06.293895+0000","last_unstale":"2024-05-30T06:43:07.293814+0000","last_undegraded":"2024-05-30T06:43:07.293814+0000","last_fullsized":"2024-05-30T06:43:07.293814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:18:01.173671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803771+0000","last_change":"2024-05-30T06:43:06.292782+0000","last_active":"2024-05-30T06:43:07.803771+0000","last_peered":"2024-05-30T06:43:07.803771+0000","last_clean":"2024-05-30T06:43:07.803771+0000","last_became_active":"2024-05-30T06:43:06.288338+0000","last_became_peered":"2024-05-30T06:43:06.288338+0000","last_unstale":"2024-05-30T06:43:07.803771+0000","last_undegraded":"2024-05-30T06:43:07.803771+0000","last_fullsized":"2024-05-30T06:43:07.803771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:06:59.333190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.805006+0000","last_change":"2024-05-30T06:43:06.299252+0000","last_active":"2024-05-30T06:43:07.805006+0000","last_peered":"2024-05-30T06:43:07.805006+0000","last_clean":"2024-05-30T06:43:07.805006+0000","last_became_active":"2024-05-30T06:43:06.298976+0000","last_became_peered":"2024-05-30T06:43:06.298976+0000","last_unstale":"2024-05-30T06:43:07.805006+0000","last_undegraded":"2024-05-30T06:43:07.805006+0000","last_fullsized":"2024-05-30T06:43:07.805006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:38:50.986553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804448+0000","last_change":"2024-05-30T06:43:06.306232+0000","last_active":"2024-05-30T06:43:07.804448+0000","last_peered":"2024-05-30T06:43:07.804448+0000","last_clean":"2024-05-30T06:43:07.804448+0000","last_became_active":"2024-05-30T06:43:06.305798+0000","last_became_peered":"2024-05-30T06:43:06.305798+0000","last_unstale":"2024-05-30T06:43:07.804448+0000","last_undegraded":"2024-05-30T06:43:07.804448+0000","last_fullsized":"2024-05-30T06:43:07.804448+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:28:58.309174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804578+0000","last_change":"2024-05-30T06:43:06.303451+0000","last_active":"2024-05-30T06:43:07.804578+0000","last_peered":"2024-05-30T06:43:07.804578+0000","last_clean":"2024-05-30T06:43:07.804578+0000","last_became_active":"2024-05-30T06:43:06.302966+0000","last_became_peered":"2024-05-30T06:43:06.302966+0000","last_unstale":"2024-05-30T06:43:07.804578+0000","last_undegraded":"2024-05-30T06:43:07.804578+0000","last_fullsized":"2024-05-30T06:43:07.804578+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:50:54.670046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293235+0000","last_change":"2024-05-30T06:43:06.293872+0000","last_active":"2024-05-30T06:43:07.293235+0000","last_peered":"2024-05-30T06:43:07.293235+0000","last_clean":"2024-05-30T06:43:07.293235+0000","last_became_active":"2024-05-30T06:43:06.293586+0000","last_became_peered":"2024-05-30T06:43:06.293586+0000","last_unstale":"2024-05-30T06:43:07.293235+0000","last_undegraded":"2024-05-30T06:43:07.293235+0000","last_fullsized":"2024-05-30T06:43:07.293235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:55:04.026783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.805563+0000","last_change":"2024-05-30T06:43:05.298070+0000","last_active":"2024-05-30T06:43:07.805563+0000","last_peered":"2024-05-30T06:43:07.805563+0000","last_clean":"2024-05-30T06:43:07.805563+0000","last_became_active":"2024-05-30T06:43:05.297751+0000","last_became_peered":"2024-05-30T06:43:05.297751+0000","last_unstale":"2024-05-30T06:43:07.805563+0000","last_undegraded":"2024-05-30T06:43:07.805563+0000","last_fullsized":"2024-05-30T06:43:07.805563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:56:37.398294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.805501+0000","last_change":"2024-05-30T06:43:06.303713+0000","last_active":"2024-05-30T06:43:07.805501+0000","last_peered":"2024-05-30T06:43:07.805501+0000","last_clean":"2024-05-30T06:43:07.805501+0000","last_became_active":"2024-05-30T06:43:06.303389+0000","last_became_peered":"2024-05-30T06:43:06.303389+0000","last_unstale":"2024-05-30T06:43:07.805501+0000","last_undegraded":"2024-05-30T06:43:07.805501+0000","last_fullsized":"2024-05-30T06:43:07.805501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:03:28.707470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293398+0000","last_change":"2024-05-30T06:43:05.296168+0000","last_active":"2024-05-30T06:43:07.293398+0000","last_peered":"2024-05-30T06:43:07.293398+0000","last_clean":"2024-05-30T06:43:07.293398+0000","last_became_active":"2024-05-30T06:43:05.295636+0000","last_became_peered":"2024-05-30T06:43:05.295636+0000","last_unstale":"2024-05-30T06:43:07.293398+0000","last_undegraded":"2024-05-30T06:43:07.293398+0000","last_fullsized":"2024-05-30T06:43:07.293398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:17:07.086483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803813+0000","last_change":"2024-05-30T06:43:06.297014+0000","last_active":"2024-05-30T06:43:07.803813+0000","last_peered":"2024-05-30T06:43:07.803813+0000","last_clean":"2024-05-30T06:43:07.803813+0000","last_became_active":"2024-05-30T06:43:06.296757+0000","last_became_peered":"2024-05-30T06:43:06.296757+0000","last_unstale":"2024-05-30T06:43:07.803813+0000","last_undegraded":"2024-05-30T06:43:07.803813+0000","last_fullsized":"2024-05-30T06:43:07.803813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:11:33.732450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379525+0000","last_change":"2024-05-30T06:43:05.296999+0000","last_active":"2024-05-30T06:43:07.379525+0000","last_peered":"2024-05-30T06:43:07.379525+0000","last_clean":"2024-05-30T06:43:07.379525+0000","last_became_active":"2024-05-30T06:43:05.296104+0000","last_became_peered":"2024-05-30T06:43:05.296104+0000","last_unstale":"2024-05-30T06:43:07.379525+0000","last_undegraded":"2024-05-30T06:43:07.379525+0000","last_fullsized":"2024-05-30T06:43:07.379525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:14:40.283804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.303846+0000","last_change":"2024-05-30T06:43:06.319034+0000","last_active":"2024-05-30T06:43:07.303846+0000","last_peered":"2024-05-30T06:43:07.303846+0000","last_clean":"2024-05-30T06:43:07.303846+0000","last_became_active":"2024-05-30T06:43:06.315938+0000","last_became_peered":"2024-05-30T06:43:06.315938+0000","last_unstale":"2024-05-30T06:43:07.303846+0000","last_undegraded":"2024-05-30T06:43:07.303846+0000","last_fullsized":"2024-05-30T06:43:07.303846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:58:05.087082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293811+0000","last_change":"2024-05-30T06:43:05.300744+0000","last_active":"2024-05-30T06:43:07.293811+0000","last_peered":"2024-05-30T06:43:07.293811+0000","last_clean":"2024-05-30T06:43:07.293811+0000","last_became_active":"2024-05-30T06:43:05.300170+0000","last_became_peered":"2024-05-30T06:43:05.300170+0000","last_unstale":"2024-05-30T06:43:07.293811+0000","last_undegraded":"2024-05-30T06:43:07.293811+0000","last_fullsized":"2024-05-30T06:43:07.293811+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:30:36.851219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804887+0000","last_change":"2024-05-30T06:43:06.300689+0000","last_active":"2024-05-30T06:43:07.804887+0000","last_peered":"2024-05-30T06:43:07.804887+0000","last_clean":"2024-05-30T06:43:07.804887+0000","last_became_active":"2024-05-30T06:43:06.300465+0000","last_became_peered":"2024-05-30T06:43:06.300465+0000","last_unstale":"2024-05-30T06:43:07.804887+0000","last_undegraded":"2024-05-30T06:43:07.804887+0000","last_fullsized":"2024-05-30T06:43:07.804887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:43:58.343694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803710+0000","last_change":"2024-05-30T06:43:05.298831+0000","last_active":"2024-05-30T06:43:07.803710+0000","last_peered":"2024-05-30T06:43:07.803710+0000","last_clean":"2024-05-30T06:43:07.803710+0000","last_became_active":"2024-05-30T06:43:05.296518+0000","last_became_peered":"2024-05-30T06:43:05.296518+0000","last_unstale":"2024-05-30T06:43:07.803710+0000","last_undegraded":"2024-05-30T06:43:07.803710+0000","last_fullsized":"2024-05-30T06:43:07.803710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:45:36.723630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293344+0000","last_change":"2024-05-30T06:43:06.295767+0000","last_active":"2024-05-30T06:43:07.293344+0000","last_peered":"2024-05-30T06:43:07.293344+0000","last_clean":"2024-05-30T06:43:07.293344+0000","last_became_active":"2024-05-30T06:43:06.293627+0000","last_became_peered":"2024-05-30T06:43:06.293627+0000","last_unstale":"2024-05-30T06:43:07.293344+0000","last_undegraded":"2024-05-30T06:43:07.293344+0000","last_fullsized":"2024-05-30T06:43:07.293344+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:56:30.090915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803921+0000","last_change":"2024-05-30T06:43:05.293226+0000","last_active":"2024-05-30T06:43:07.803921+0000","last_peered":"2024-05-30T06:43:07.803921+0000","last_clean":"2024-05-30T06:43:07.803921+0000","last_became_active":"2024-05-30T06:43:05.292929+0000","last_became_peered":"2024-05-30T06:43:05.292929+0000","last_unstale":"2024-05-30T06:43:07.803921+0000","last_undegraded":"2024-05-30T06:43:07.803921+0000","last_fullsized":"2024-05-30T06:43:07.803921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:20:20.991711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803295+0000","last_change":"2024-05-30T06:43:06.295848+0000","last_active":"2024-05-30T06:43:07.803295+0000","last_peered":"2024-05-30T06:43:07.803295+0000","last_clean":"2024-05-30T06:43:07.803295+0000","last_became_active":"2024-05-30T06:43:06.295511+0000","last_became_peered":"2024-05-30T06:43:06.295511+0000","last_unstale":"2024-05-30T06:43:07.803295+0000","last_undegraded":"2024-05-30T06:43:07.803295+0000","last_fullsized":"2024-05-30T06:43:07.803295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:09:51.187723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379148+0000","last_change":"2024-05-30T06:43:05.300074+0000","last_active":"2024-05-30T06:43:07.379148+0000","last_peered":"2024-05-30T06:43:07.379148+0000","last_clean":"2024-05-30T06:43:07.379148+0000","last_became_active":"2024-05-30T06:43:05.299811+0000","last_became_peered":"2024-05-30T06:43:05.299811+0000","last_unstale":"2024-05-30T06:43:07.379148+0000","last_undegraded":"2024-05-30T06:43:07.379148+0000","last_fullsized":"2024-05-30T06:43:07.379148+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:55:03.019214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.303386+0000","last_change":"2024-05-30T06:43:06.299782+0000","last_active":"2024-05-30T06:43:07.303386+0000","last_peered":"2024-05-30T06:43:07.303386+0000","last_clean":"2024-05-30T06:43:07.303386+0000","last_became_active":"2024-05-30T06:43:06.299501+0000","last_became_peered":"2024-05-30T06:43:06.299501+0000","last_unstale":"2024-05-30T06:43:07.303386+0000","last_undegraded":"2024-05-30T06:43:07.303386+0000","last_fullsized":"2024-05-30T06:43:07.303386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:06:59.333190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803248+0000","last_change":"2024-05-30T06:43:05.296293+0000","last_active":"2024-05-30T06:43:07.803248+0000","last_peered":"2024-05-30T06:43:07.803248+0000","last_clean":"2024-05-30T06:43:07.803248+0000","last_became_active":"2024-05-30T06:43:05.295981+0000","last_became_peered":"2024-05-30T06:43:05.295981+0000","last_unstale":"2024-05-30T06:43:07.803248+0000","last_undegraded":"2024-05-30T06:43:07.803248+0000","last_fullsized":"2024-05-30T06:43:07.803248+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:09:56.571290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293702+0000","last_change":"2024-05-30T06:43:06.291198+0000","last_active":"2024-05-30T06:43:07.293702+0000","last_peered":"2024-05-30T06:43:07.293702+0000","last_clean":"2024-05-30T06:43:07.293702+0000","last_became_active":"2024-05-30T06:43:06.290889+0000","last_became_peered":"2024-05-30T06:43:06.290889+0000","last_unstale":"2024-05-30T06:43:07.293702+0000","last_undegraded":"2024-05-30T06:43:07.293702+0000","last_fullsized":"2024-05-30T06:43:07.293702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:13:04.363665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379654+0000","last_change":"2024-05-30T06:43:05.295938+0000","last_active":"2024-05-30T06:43:07.379654+0000","last_peered":"2024-05-30T06:43:07.379654+0000","last_clean":"2024-05-30T06:43:07.379654+0000","last_became_active":"2024-05-30T06:43:05.295511+0000","last_became_peered":"2024-05-30T06:43:05.295511+0000","last_unstale":"2024-05-30T06:43:07.379654+0000","last_undegraded":"2024-05-30T06:43:07.379654+0000","last_fullsized":"2024-05-30T06:43:07.379654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:47:29.529831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379603+0000","last_change":"2024-05-30T06:43:06.316429+0000","last_active":"2024-05-30T06:43:07.379603+0000","last_peered":"2024-05-30T06:43:07.379603+0000","last_clean":"2024-05-30T06:43:07.379603+0000","last_became_active":"2024-05-30T06:43:06.316076+0000","last_became_peered":"2024-05-30T06:43:06.316076+0000","last_unstale":"2024-05-30T06:43:07.379603+0000","last_undegraded":"2024-05-30T06:43:07.379603+0000","last_fullsized":"2024-05-30T06:43:07.379603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:22:51.401354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293487+0000","last_change":"2024-05-30T06:43:05.295895+0000","last_active":"2024-05-30T06:43:07.293487+0000","last_peered":"2024-05-30T06:43:07.293487+0000","last_clean":"2024-05-30T06:43:07.293487+0000","last_became_active":"2024-05-30T06:43:05.295262+0000","last_became_peered":"2024-05-30T06:43:05.295262+0000","last_unstale":"2024-05-30T06:43:07.293487+0000","last_undegraded":"2024-05-30T06:43:07.293487+0000","last_fullsized":"2024-05-30T06:43:07.293487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:52:51.294194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379517+0000","last_change":"2024-05-30T06:43:06.292100+0000","last_active":"2024-05-30T06:43:07.379517+0000","last_peered":"2024-05-30T06:43:07.379517+0000","last_clean":"2024-05-30T06:43:07.379517+0000","last_became_active":"2024-05-30T06:43:06.291796+0000","last_became_peered":"2024-05-30T06:43:06.291796+0000","last_unstale":"2024-05-30T06:43:07.379517+0000","last_undegraded":"2024-05-30T06:43:07.379517+0000","last_fullsized":"2024-05-30T06:43:07.379517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:38:50.986553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293598+0000","last_change":"2024-05-30T06:43:05.294561+0000","last_active":"2024-05-30T06:43:07.293598+0000","last_peered":"2024-05-30T06:43:07.293598+0000","last_clean":"2024-05-30T06:43:07.293598+0000","last_became_active":"2024-05-30T06:43:05.294239+0000","last_became_peered":"2024-05-30T06:43:05.294239+0000","last_unstale":"2024-05-30T06:43:07.293598+0000","last_undegraded":"2024-05-30T06:43:07.293598+0000","last_fullsized":"2024-05-30T06:43:07.293598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:06:58.325621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293440+0000","last_change":"2024-05-30T06:43:06.307511+0000","last_active":"2024-05-30T06:43:07.293440+0000","last_peered":"2024-05-30T06:43:07.293440+0000","last_clean":"2024-05-30T06:43:07.293440+0000","last_became_active":"2024-05-30T06:43:06.307199+0000","last_became_peered":"2024-05-30T06:43:06.307199+0000","last_unstale":"2024-05-30T06:43:07.293440+0000","last_undegraded":"2024-05-30T06:43:07.293440+0000","last_fullsized":"2024-05-30T06:43:07.293440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:43:58.343694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379468+0000","last_change":"2024-05-30T06:43:05.295843+0000","last_active":"2024-05-30T06:43:07.379468+0000","last_peered":"2024-05-30T06:43:07.379468+0000","last_clean":"2024-05-30T06:43:07.379468+0000","last_became_active":"2024-05-30T06:43:05.295554+0000","last_became_peered":"2024-05-30T06:43:05.295554+0000","last_unstale":"2024-05-30T06:43:07.379468+0000","last_undegraded":"2024-05-30T06:43:07.379468+0000","last_fullsized":"2024-05-30T06:43:07.379468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:06:58.325621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.303339+0000","last_change":"2024-05-30T06:43:06.297838+0000","last_active":"2024-05-30T06:43:07.303339+0000","last_peered":"2024-05-30T06:43:07.303339+0000","last_clean":"2024-05-30T06:43:07.303339+0000","last_became_active":"2024-05-30T06:43:06.297520+0000","last_became_peered":"2024-05-30T06:43:06.297520+0000","last_unstale":"2024-05-30T06:43:07.303339+0000","last_undegraded":"2024-05-30T06:43:07.303339+0000","last_fullsized":"2024-05-30T06:43:07.303339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:11:33.732450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803842+0000","last_change":"2024-05-30T06:43:05.300662+0000","last_active":"2024-05-30T06:43:07.803842+0000","last_peered":"2024-05-30T06:43:07.803842+0000","last_clean":"2024-05-30T06:43:07.803842+0000","last_became_active":"2024-05-30T06:43:05.300338+0000","last_became_peered":"2024-05-30T06:43:05.300338+0000","last_unstale":"2024-05-30T06:43:07.803842+0000","last_undegraded":"2024-05-30T06:43:07.803842+0000","last_fullsized":"2024-05-30T06:43:07.803842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:18:36.965976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379360+0000","last_change":"2024-05-30T06:43:06.296292+0000","last_active":"2024-05-30T06:43:07.379360+0000","last_peered":"2024-05-30T06:43:07.379360+0000","last_clean":"2024-05-30T06:43:07.379360+0000","last_became_active":"2024-05-30T06:43:06.296023+0000","last_became_peered":"2024-05-30T06:43:06.296023+0000","last_unstale":"2024-05-30T06:43:07.379360+0000","last_undegraded":"2024-05-30T06:43:07.379360+0000","last_fullsized":"2024-05-30T06:43:07.379360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:13:04.363665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.303333+0000","last_change":"2024-05-30T06:43:05.298907+0000","last_active":"2024-05-30T06:43:07.303333+0000","last_peered":"2024-05-30T06:43:07.303333+0000","last_clean":"2024-05-30T06:43:07.303333+0000","last_became_active":"2024-05-30T06:43:05.298556+0000","last_became_peered":"2024-05-30T06:43:05.298556+0000","last_unstale":"2024-05-30T06:43:07.303333+0000","last_undegraded":"2024-05-30T06:43:07.303333+0000","last_fullsized":"2024-05-30T06:43:07.303333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:01.395949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804808+0000","last_change":"2024-05-30T06:43:06.302681+0000","last_active":"2024-05-30T06:43:07.804808+0000","last_peered":"2024-05-30T06:43:07.804808+0000","last_clean":"2024-05-30T06:43:07.804808+0000","last_became_active":"2024-05-30T06:43:06.302398+0000","last_became_peered":"2024-05-30T06:43:06.302398+0000","last_unstale":"2024-05-30T06:43:07.804808+0000","last_undegraded":"2024-05-30T06:43:07.804808+0000","last_fullsized":"2024-05-30T06:43:07.804808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:56:30.090915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379042+0000","last_change":"2024-05-30T06:43:05.297608+0000","last_active":"2024-05-30T06:43:07.379042+0000","last_peered":"2024-05-30T06:43:07.379042+0000","last_clean":"2024-05-30T06:43:07.379042+0000","last_became_active":"2024-05-30T06:43:05.296354+0000","last_became_peered":"2024-05-30T06:43:05.296354+0000","last_unstale":"2024-05-30T06:43:07.379042+0000","last_undegraded":"2024-05-30T06:43:07.379042+0000","last_fullsized":"2024-05-30T06:43:07.379042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:03:27.699901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804333+0000","last_change":"2024-05-30T06:43:06.292455+0000","last_active":"2024-05-30T06:43:07.804333+0000","last_peered":"2024-05-30T06:43:07.804333+0000","last_clean":"2024-05-30T06:43:07.804333+0000","last_became_active":"2024-05-30T06:43:06.292178+0000","last_became_peered":"2024-05-30T06:43:06.292178+0000","last_unstale":"2024-05-30T06:43:07.804333+0000","last_undegraded":"2024-05-30T06:43:07.804333+0000","last_fullsized":"2024-05-30T06:43:07.804333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:16:47.590179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379206+0000","last_change":"2024-05-30T06:43:05.289751+0000","last_active":"2024-05-30T06:43:07.379206+0000","last_peered":"2024-05-30T06:43:07.379206+0000","last_clean":"2024-05-30T06:43:07.379206+0000","last_became_active":"2024-05-30T06:43:05.289445+0000","last_became_peered":"2024-05-30T06:43:05.289445+0000","last_unstale":"2024-05-30T06:43:07.379206+0000","last_undegraded":"2024-05-30T06:43:07.379206+0000","last_fullsized":"2024-05-30T06:43:07.379206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:11:32.724881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803592+0000","last_change":"2024-05-30T06:43:06.294871+0000","last_active":"2024-05-30T06:43:07.803592+0000","last_peered":"2024-05-30T06:43:07.803592+0000","last_clean":"2024-05-30T06:43:07.803592+0000","last_became_active":"2024-05-30T06:43:06.294584+0000","last_became_peered":"2024-05-30T06:43:06.294584+0000","last_unstale":"2024-05-30T06:43:07.803592+0000","last_undegraded":"2024-05-30T06:43:07.803592+0000","last_fullsized":"2024-05-30T06:43:07.803592+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:32:39.207870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.303870+0000","last_change":"2024-05-30T06:43:05.293312+0000","last_active":"2024-05-30T06:43:07.303870+0000","last_peered":"2024-05-30T06:43:07.303870+0000","last_clean":"2024-05-30T06:43:07.303870+0000","last_became_active":"2024-05-30T06:43:05.293022+0000","last_became_peered":"2024-05-30T06:43:05.293022+0000","last_unstale":"2024-05-30T06:43:07.303870+0000","last_undegraded":"2024-05-30T06:43:07.303870+0000","last_fullsized":"2024-05-30T06:43:07.303870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:17:07.086483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293877+0000","last_change":"2024-05-30T06:43:06.288671+0000","last_active":"2024-05-30T06:43:07.293877+0000","last_peered":"2024-05-30T06:43:07.293877+0000","last_clean":"2024-05-30T06:43:07.293877+0000","last_became_active":"2024-05-30T06:43:06.288267+0000","last_became_peered":"2024-05-30T06:43:06.288267+0000","last_unstale":"2024-05-30T06:43:07.293877+0000","last_undegraded":"2024-05-30T06:43:07.293877+0000","last_fullsized":"2024-05-30T06:43:07.293877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:22:51.401354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803735+0000","last_change":"2024-05-30T06:43:05.299096+0000","last_active":"2024-05-30T06:43:07.803735+0000","last_peered":"2024-05-30T06:43:07.803735+0000","last_clean":"2024-05-30T06:43:07.803735+0000","last_became_active":"2024-05-30T06:43:05.298809+0000","last_became_peered":"2024-05-30T06:43:05.298809+0000","last_unstale":"2024-05-30T06:43:07.803735+0000","last_undegraded":"2024-05-30T06:43:07.803735+0000","last_fullsized":"2024-05-30T06:43:07.803735+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:01.395949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.303755+0000","last_change":"2024-05-30T06:43:06.312061+0000","last_active":"2024-05-30T06:43:07.303755+0000","last_peered":"2024-05-30T06:43:07.303755+0000","last_clean":"2024-05-30T06:43:07.303755+0000","last_became_active":"2024-05-30T06:43:06.311473+0000","last_became_peered":"2024-05-30T06:43:06.311473+0000","last_unstale":"2024-05-30T06:43:07.303755+0000","last_undegraded":"2024-05-30T06:43:07.303755+0000","last_fullsized":"2024-05-30T06:43:07.303755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:30:20.857375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803957+0000","last_change":"2024-05-30T06:43:05.300113+0000","last_active":"2024-05-30T06:43:07.803957+0000","last_peered":"2024-05-30T06:43:07.803957+0000","last_clean":"2024-05-30T06:43:07.803957+0000","last_became_active":"2024-05-30T06:43:05.299797+0000","last_became_peered":"2024-05-30T06:43:05.299797+0000","last_unstale":"2024-05-30T06:43:07.803957+0000","last_undegraded":"2024-05-30T06:43:07.803957+0000","last_fullsized":"2024-05-30T06:43:07.803957+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:27:10.790672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.294211+0000","last_change":"2024-05-30T06:43:06.315381+0000","last_active":"2024-05-30T06:43:07.294211+0000","last_peered":"2024-05-30T06:43:07.294211+0000","last_clean":"2024-05-30T06:43:07.294211+0000","last_became_active":"2024-05-30T06:43:06.315147+0000","last_became_peered":"2024-05-30T06:43:06.315147+0000","last_unstale":"2024-05-30T06:43:07.294211+0000","last_undegraded":"2024-05-30T06:43:07.294211+0000","last_fullsized":"2024-05-30T06:43:07.294211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:16:47.590179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803790+0000","last_change":"2024-05-30T06:43:05.297646+0000","last_active":"2024-05-30T06:43:07.803790+0000","last_peered":"2024-05-30T06:43:07.803790+0000","last_clean":"2024-05-30T06:43:07.803790+0000","last_became_active":"2024-05-30T06:43:05.296897+0000","last_became_peered":"2024-05-30T06:43:05.296897+0000","last_unstale":"2024-05-30T06:43:07.803790+0000","last_undegraded":"2024-05-30T06:43:07.803790+0000","last_fullsized":"2024-05-30T06:43:07.803790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:38.529237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293251+0000","last_change":"2024-05-30T06:43:06.317342+0000","last_active":"2024-05-30T06:43:07.293251+0000","last_peered":"2024-05-30T06:43:07.293251+0000","last_clean":"2024-05-30T06:43:07.293251+0000","last_became_active":"2024-05-30T06:43:06.310452+0000","last_became_peered":"2024-05-30T06:43:06.310452+0000","last_unstale":"2024-05-30T06:43:07.293251+0000","last_undegraded":"2024-05-30T06:43:07.293251+0000","last_fullsized":"2024-05-30T06:43:07.293251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:02.403518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293414+0000","last_change":"2024-05-30T06:43:05.286888+0000","last_active":"2024-05-30T06:43:07.293414+0000","last_peered":"2024-05-30T06:43:07.293414+0000","last_clean":"2024-05-30T06:43:07.293414+0000","last_became_active":"2024-05-30T06:43:05.286557+0000","last_became_peered":"2024-05-30T06:43:05.286557+0000","last_unstale":"2024-05-30T06:43:07.293414+0000","last_undegraded":"2024-05-30T06:43:07.293414+0000","last_fullsized":"2024-05-30T06:43:07.293414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:08:38.391303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293568+0000","last_change":"2024-05-30T06:43:06.316743+0000","last_active":"2024-05-30T06:43:07.293568+0000","last_peered":"2024-05-30T06:43:07.293568+0000","last_clean":"2024-05-30T06:43:07.293568+0000","last_became_active":"2024-05-30T06:43:06.316314+0000","last_became_peered":"2024-05-30T06:43:06.316314+0000","last_unstale":"2024-05-30T06:43:07.293568+0000","last_undegraded":"2024-05-30T06:43:07.293568+0000","last_fullsized":"2024-05-30T06:43:07.293568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:52:52.301764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.805690+0000","last_change":"2024-05-30T06:43:05.299874+0000","last_active":"2024-05-30T06:43:07.805690+0000","last_peered":"2024-05-30T06:43:07.805690+0000","last_clean":"2024-05-30T06:43:07.805690+0000","last_became_active":"2024-05-30T06:43:05.298976+0000","last_became_peered":"2024-05-30T06:43:05.298976+0000","last_unstale":"2024-05-30T06:43:07.805690+0000","last_undegraded":"2024-05-30T06:43:07.805690+0000","last_fullsized":"2024-05-30T06:43:07.805690+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:52:01.395949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293300+0000","last_change":"2024-05-30T06:43:06.309732+0000","last_active":"2024-05-30T06:43:07.293300+0000","last_peered":"2024-05-30T06:43:07.293300+0000","last_clean":"2024-05-30T06:43:07.293300+0000","last_became_active":"2024-05-30T06:43:06.307545+0000","last_became_peered":"2024-05-30T06:43:06.307545+0000","last_unstale":"2024-05-30T06:43:07.293300+0000","last_undegraded":"2024-05-30T06:43:07.293300+0000","last_fullsized":"2024-05-30T06:43:07.293300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:39.536806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803316+0000","last_change":"2024-05-30T06:43:05.295571+0000","last_active":"2024-05-30T06:43:07.803316+0000","last_peered":"2024-05-30T06:43:07.803316+0000","last_clean":"2024-05-30T06:43:07.803316+0000","last_became_active":"2024-05-30T06:43:05.295258+0000","last_became_peered":"2024-05-30T06:43:05.295258+0000","last_unstale":"2024-05-30T06:43:07.803316+0000","last_undegraded":"2024-05-30T06:43:07.803316+0000","last_fullsized":"2024-05-30T06:43:07.803316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:34:55.180239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.805168+0000","last_change":"2024-05-30T06:43:06.294562+0000","last_active":"2024-05-30T06:43:07.805168+0000","last_peered":"2024-05-30T06:43:07.805168+0000","last_clean":"2024-05-30T06:43:07.805168+0000","last_became_active":"2024-05-30T06:43:06.293992+0000","last_became_peered":"2024-05-30T06:43:06.293992+0000","last_unstale":"2024-05-30T06:43:07.805168+0000","last_undegraded":"2024-05-30T06:43:07.805168+0000","last_fullsized":"2024-05-30T06:43:07.805168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:18:01.173671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.292901+0000","last_change":"2024-05-30T06:43:05.294939+0000","last_active":"2024-05-30T06:43:07.292901+0000","last_peered":"2024-05-30T06:43:07.292901+0000","last_clean":"2024-05-30T06:43:07.292901+0000","last_became_active":"2024-05-30T06:43:05.294660+0000","last_became_peered":"2024-05-30T06:43:05.294660+0000","last_unstale":"2024-05-30T06:43:07.292901+0000","last_undegraded":"2024-05-30T06:43:07.292901+0000","last_fullsized":"2024-05-30T06:43:07.292901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:11:32.724881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293996+0000","last_change":"2024-05-30T06:43:06.314608+0000","last_active":"2024-05-30T06:43:07.293996+0000","last_peered":"2024-05-30T06:43:07.293996+0000","last_clean":"2024-05-30T06:43:07.293996+0000","last_became_active":"2024-05-30T06:43:06.314304+0000","last_became_peered":"2024-05-30T06:43:06.314304+0000","last_unstale":"2024-05-30T06:43:07.293996+0000","last_undegraded":"2024-05-30T06:43:07.293996+0000","last_fullsized":"2024-05-30T06:43:07.293996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:08:39.398872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.303860+0000","last_change":"2024-05-30T06:43:05.298021+0000","last_active":"2024-05-30T06:43:07.303860+0000","last_peered":"2024-05-30T06:43:07.303860+0000","last_clean":"2024-05-30T06:43:07.303860+0000","last_became_active":"2024-05-30T06:43:05.297568+0000","last_became_peered":"2024-05-30T06:43:05.297568+0000","last_unstale":"2024-05-30T06:43:07.303860+0000","last_undegraded":"2024-05-30T06:43:07.303860+0000","last_fullsized":"2024-05-30T06:43:07.303860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:52:51.294194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293920+0000","last_change":"2024-05-30T06:43:06.311402+0000","last_active":"2024-05-30T06:43:07.293920+0000","last_peered":"2024-05-30T06:43:07.293920+0000","last_clean":"2024-05-30T06:43:07.293920+0000","last_became_active":"2024-05-30T06:43:06.311095+0000","last_became_peered":"2024-05-30T06:43:06.311095+0000","last_unstale":"2024-05-30T06:43:07.293920+0000","last_undegraded":"2024-05-30T06:43:07.293920+0000","last_fullsized":"2024-05-30T06:43:07.293920+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:45:51.392367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:08.284244+0000","last_change":"2024-05-30T06:43:05.294918+0000","last_active":"2024-05-30T06:43:08.284244+0000","last_peered":"2024-05-30T06:43:08.284244+0000","last_clean":"2024-05-30T06:43:08.284244+0000","last_became_active":"2024-05-30T06:43:05.291275+0000","last_became_peered":"2024-05-30T06:43:05.291275+0000","last_unstale":"2024-05-30T06:43:08.284244+0000","last_undegraded":"2024-05-30T06:43:08.284244+0000","last_fullsized":"2024-05-30T06:43:08.284244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:50:04.662300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293254+0000","last_change":"2024-05-30T06:43:06.308157+0000","last_active":"2024-05-30T06:43:07.293254+0000","last_peered":"2024-05-30T06:43:07.293254+0000","last_clean":"2024-05-30T06:43:07.293254+0000","last_became_active":"2024-05-30T06:43:06.307903+0000","last_became_peered":"2024-05-30T06:43:06.307903+0000","last_unstale":"2024-05-30T06:43:07.293254+0000","last_undegraded":"2024-05-30T06:43:07.293254+0000","last_fullsized":"2024-05-30T06:43:07.293254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:32:39.207870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.303860+0000","last_change":"2024-05-30T06:43:05.301839+0000","last_active":"2024-05-30T06:43:07.303860+0000","last_peered":"2024-05-30T06:43:07.303860+0000","last_clean":"2024-05-30T06:43:07.303860+0000","last_became_active":"2024-05-30T06:43:05.300589+0000","last_became_peered":"2024-05-30T06:43:05.300589+0000","last_unstale":"2024-05-30T06:43:07.303860+0000","last_undegraded":"2024-05-30T06:43:07.303860+0000","last_fullsized":"2024-05-30T06:43:07.303860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:06:07.964161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804358+0000","last_change":"2024-05-30T06:43:06.294881+0000","last_active":"2024-05-30T06:43:07.804358+0000","last_peered":"2024-05-30T06:43:07.804358+0000","last_clean":"2024-05-30T06:43:07.804358+0000","last_became_active":"2024-05-30T06:43:06.294611+0000","last_became_peered":"2024-05-30T06:43:06.294611+0000","last_unstale":"2024-05-30T06:43:07.804358+0000","last_undegraded":"2024-05-30T06:43:07.804358+0000","last_fullsized":"2024-05-30T06:43:07.804358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:16:55.371329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293554+0000","last_change":"2024-05-30T06:43:05.293428+0000","last_active":"2024-05-30T06:43:07.293554+0000","last_peered":"2024-05-30T06:43:07.293554+0000","last_clean":"2024-05-30T06:43:07.293554+0000","last_became_active":"2024-05-30T06:43:05.293174+0000","last_became_peered":"2024-05-30T06:43:05.293174+0000","last_unstale":"2024-05-30T06:43:07.293554+0000","last_undegraded":"2024-05-30T06:43:07.293554+0000","last_fullsized":"2024-05-30T06:43:07.293554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:16:46.582610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.293323+0000","last_change":"2024-05-30T06:43:06.299355+0000","last_active":"2024-05-30T06:43:07.293323+0000","last_peered":"2024-05-30T06:43:07.293323+0000","last_clean":"2024-05-30T06:43:07.293323+0000","last_became_active":"2024-05-30T06:43:06.298911+0000","last_became_peered":"2024-05-30T06:43:06.298911+0000","last_unstale":"2024-05-30T06:43:07.293323+0000","last_undegraded":"2024-05-30T06:43:07.293323+0000","last_fullsized":"2024-05-30T06:43:07.293323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:11:33.732450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.303473+0000","last_change":"2024-05-30T06:43:05.294846+0000","last_active":"2024-05-30T06:43:07.303473+0000","last_peered":"2024-05-30T06:43:07.303473+0000","last_clean":"2024-05-30T06:43:07.303473+0000","last_became_active":"2024-05-30T06:43:05.294322+0000","last_became_peered":"2024-05-30T06:43:05.294322+0000","last_unstale":"2024-05-30T06:43:07.303473+0000","last_undegraded":"2024-05-30T06:43:07.303473+0000","last_fullsized":"2024-05-30T06:43:07.303473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:38.529237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379067+0000","last_change":"2024-05-30T06:43:06.303182+0000","last_active":"2024-05-30T06:43:07.379067+0000","last_peered":"2024-05-30T06:43:07.379067+0000","last_clean":"2024-05-30T06:43:07.379067+0000","last_became_active":"2024-05-30T06:43:06.302496+0000","last_became_peered":"2024-05-30T06:43:06.302496+0000","last_unstale":"2024-05-30T06:43:07.379067+0000","last_undegraded":"2024-05-30T06:43:07.379067+0000","last_fullsized":"2024-05-30T06:43:07.379067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:56:30.090915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803433+0000","last_change":"2024-05-30T06:43:05.293651+0000","last_active":"2024-05-30T06:43:07.803433+0000","last_peered":"2024-05-30T06:43:07.803433+0000","last_clean":"2024-05-30T06:43:07.803433+0000","last_became_active":"2024-05-30T06:43:05.293201+0000","last_became_peered":"2024-05-30T06:43:05.293201+0000","last_unstale":"2024-05-30T06:43:07.803433+0000","last_undegraded":"2024-05-30T06:43:07.803433+0000","last_fullsized":"2024-05-30T06:43:07.803433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:56:37.398294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.803334+0000","last_change":"2024-05-30T06:43:06.288686+0000","last_active":"2024-05-30T06:43:07.803334+0000","last_peered":"2024-05-30T06:43:07.803334+0000","last_clean":"2024-05-30T06:43:07.803334+0000","last_became_active":"2024-05-30T06:43:06.288331+0000","last_became_peered":"2024-05-30T06:43:06.288331+0000","last_unstale":"2024-05-30T06:43:07.803334+0000","last_undegraded":"2024-05-30T06:43:07.803334+0000","last_fullsized":"2024-05-30T06:43:07.803334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:03:28.707470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.379069+0000","last_change":"2024-05-30T06:43:05.290478+0000","last_active":"2024-05-30T06:43:07.379069+0000","last_peered":"2024-05-30T06:43:07.379069+0000","last_clean":"2024-05-30T06:43:07.379069+0000","last_became_active":"2024-05-30T06:43:05.290185+0000","last_became_peered":"2024-05-30T06:43:05.290185+0000","last_unstale":"2024-05-30T06:43:07.379069+0000","last_undegraded":"2024-05-30T06:43:07.379069+0000","last_fullsized":"2024-05-30T06:43:07.379069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:32:38.200301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804636+0000","last_change":"2024-05-30T06:43:06.314463+0000","last_active":"2024-05-30T06:43:07.804636+0000","last_peered":"2024-05-30T06:43:07.804636+0000","last_clean":"2024-05-30T06:43:07.804636+0000","last_became_active":"2024-05-30T06:43:06.314213+0000","last_became_peered":"2024-05-30T06:43:06.314213+0000","last_unstale":"2024-05-30T06:43:07.804636+0000","last_undegraded":"2024-05-30T06:43:07.804636+0000","last_fullsized":"2024-05-30T06:43:07.804636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:05.264055+0000","last_clean_scrub_stamp":"2024-05-30T06:43:05.264055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:02:14.137091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804665+0000","last_change":"2024-05-30T06:43:05.297342+0000","last_active":"2024-05-30T06:43:07.804665+0000","last_peered":"2024-05-30T06:43:07.804665+0000","last_clean":"2024-05-30T06:43:07.804665+0000","last_became_active":"2024-05-30T06:43:05.297006+0000","last_became_peered":"2024-05-30T06:43:05.297006+0000","last_unstale":"2024-05-30T06:43:07.804665+0000","last_undegraded":"2024-05-30T06:43:07.804665+0000","last_fullsized":"2024-05-30T06:43:07.804665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:43:04.256486+0000","last_clean_scrub_stamp":"2024-05-30T06:43:04.256486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:38.529237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-05-30T06:43:07.804889+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:43:07.804889+0000","last_peered":"2024-05-30T06:43:07.804889+0000","last_clean":"2024-05-30T06:43:07.804889+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:43:07.804889+0000","last_undegraded":"2024-05-30T06:43:07.804889+0000","last_fullsized":"2024-05-30T06:43:07.804889+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":737236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":140582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":148412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":146848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":148412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":966656,"data_stored":737146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:43:10.811 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-30T06:43:10.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T06:43:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.995+0000 7fe20a000640 1 Processor -- start 2024-05-30T06:43:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.995+0000 7fe20a000640 1 -- start start 2024-05-30T06:43:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.995+0000 7fe20a000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe20415d350 0x7fe20406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.995+0000 7fe20a000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe204142030 con 0x7fe2040b59d0 2024-05-30T06:43:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.999+0000 7fe20a000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe204142310 con 0x7fe20415d7e0 2024-05-30T06:43:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.999+0000 7fe20a000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe2041425f0 con 0x7fe20415d350 2024-05-30T06:43:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.999+0000 7fe1fbe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe20415d350 0x7fe20406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.999+0000 7fe203400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe2040b59d0 0x7fe2040b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33316/0 (socket says 172.21.15.37:33316) 2024-05-30T06:43:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.999+0000 7fe203400640 1 -- 172.21.15.37:0/1847152491 learned_addr learned my addr 172.21.15.37:0/1847152491 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.999+0000 7fe1fbe00640 1 -- 172.21.15.37:0/1847152491 >> v1:172.21.15.105:6789/0 conn(0x7fe20415d7e0 legacy=0x7fe20406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.999+0000 7fe1fbe00640 1 -- 172.21.15.37:0/1847152491 >> v1:172.21.15.37:6789/0 conn(0x7fe2040b59d0 legacy=0x7fe2040b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.999+0000 7fe1fbe00640 1 -- 172.21.15.37:0/1847152491 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2041428d0 con 0x7fe20415d350 2024-05-30T06:43:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.999+0000 7fe1fbe00640 1 --2- 172.21.15.37:0/1847152491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe20415d350 0x7fe20406df50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0097f0 tx=0x7fe1ec01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad237e0735ec4ce server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.999+0000 7fe202a00640 1 -- 172.21.15.37:0/1847152491 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec0b1070 con 0x7fe20415d350 2024-05-30T06:43:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.999+0000 7fe202a00640 1 -- 172.21.15.37:0/1847152491 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ec0ac410 con 0x7fe20415d350 2024-05-30T06:43:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:10.999+0000 7fe202a00640 1 -- 172.21.15.37:0/1847152491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec0ac7e0 con 0x7fe20415d350 2024-05-30T06:43:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 -- 172.21.15.37:0/1847152491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe20415d350 msgr2=0x7fe20406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 --2- 172.21.15.37:0/1847152491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe20415d350 0x7fe20406df50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0097f0 tx=0x7fe1ec01c4a0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 -- 172.21.15.37:0/1847152491 shutdown_connections 2024-05-30T06:43:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 --2- 172.21.15.37:0/1847152491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe20415d350 0x7fe20406df50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 -- 172.21.15.37:0/1847152491 >> 172.21.15.37:0/1847152491 conn(0x7fe20406bf60 msgr2=0x7fe2040b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 -- 172.21.15.37:0/1847152491 shutdown_connections 2024-05-30T06:43:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 -- 172.21.15.37:0/1847152491 wait complete. 2024-05-30T06:43:11.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 Processor -- start 2024-05-30T06:43:11.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 -- start start 2024-05-30T06:43:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040b59d0 0x7fe20415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe20415d350 0x7fe20415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe20415d7e0 0x7fe204071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe204141d70 con 0x7fe20415d7e0 2024-05-30T06:43:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe204141bf0 con 0x7fe2040b59d0 2024-05-30T06:43:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe20a000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe20416ae40 con 0x7fe20415d350 2024-05-30T06:43:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe203e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe20415d7e0 0x7fe204071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe203e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe20415d7e0 0x7fe204071dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55860/0 (socket says 172.21.15.37:55860) 2024-05-30T06:43:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe203e00640 1 -- 172.21.15.37:0/3248011782 learned_addr learned my addr 172.21.15.37:0/3248011782 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe203400640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040b59d0 0x7fe20415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe1fbe00640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe20415d350 0x7fe20415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:11.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe203e00640 1 -- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe20415d350 msgr2=0x7fe20415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:11.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe203e00640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe20415d350 0x7fe20415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe203e00640 1 -- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040b59d0 msgr2=0x7fe20415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:11.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe203e00640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040b59d0 0x7fe20415b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe203e00640 1 -- 172.21.15.37:0/3248011782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe204136600 con 0x7fe20415d7e0 2024-05-30T06:43:11.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.003+0000 7fe203400640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040b59d0 0x7fe20415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:11.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.007+0000 7fe203e00640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe20415d7e0 0x7fe204071dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00c730 tx=0x7fe1fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:11.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.007+0000 7fe1fb400640 1 -- 172.21.15.37:0/3248011782 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc003b80 con 0x7fe20415d7e0 2024-05-30T06:43:11.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.007+0000 7fe1fb400640 1 -- 172.21.15.37:0/3248011782 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1fc003d20 con 0x7fe20415d7e0 2024-05-30T06:43:11.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.007+0000 7fe1fb400640 1 -- 172.21.15.37:0/3248011782 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc00aa30 con 0x7fe20415d7e0 2024-05-30T06:43:11.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.007+0000 7fe20a000640 1 -- 172.21.15.37:0/3248011782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2041368e0 con 0x7fe20415d7e0 2024-05-30T06:43:11.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.007+0000 7fe20a000640 1 -- 172.21.15.37:0/3248011782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe204136ea0 con 0x7fe20415d7e0 2024-05-30T06:43:11.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.007+0000 7fe20a000640 1 -- 172.21.15.37:0/3248011782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe204068bc0 con 0x7fe20415d7e0 2024-05-30T06:43:11.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.007+0000 7fe1fb400640 1 -- 172.21.15.37:0/3248011782 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe1fc00abd0 con 0x7fe20415d7e0 2024-05-30T06:43:11.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.007+0000 7fe1fb400640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1e0068380 0x7fe1e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:11.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.007+0000 7fe1fb400640 1 -- 172.21.15.37:0/3248011782 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe1fc0867d0 con 0x7fe20415d7e0 2024-05-30T06:43:11.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.007+0000 7fe203400640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1e0068380 0x7fe1e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:11.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.011+0000 7fe203400640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1e0068380 0x7fe1e006a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4007fd0 tx=0x7fe1f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.011+0000 7fe1fb400640 1 -- 172.21.15.37:0/3248011782 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe1fc056e20 con 0x7fe20415d7e0 2024-05-30T06:43:11.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.239+0000 7fe20a000640 1 -- 172.21.15.37:0/3248011782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe204168400 con 0x7fe20415d7e0 2024-05-30T06:43:11.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.243+0000 7fe1fb400640 1 -- 172.21.15.37:0/3248011782 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fe1fc056720 con 0x7fe20415d7e0 2024-05-30T06:43:11.241 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-30T06:43:11.241 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A== 2024-05-30T06:43:11.241 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-30T06:43:11.241 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-30T06:43:11.241 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T06:43:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-30T06:43:11.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.243+0000 7fe20a000640 1 -- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1e0068380 msgr2=0x7fe1e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:11.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.243+0000 7fe20a000640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1e0068380 0x7fe1e006a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4007fd0 tx=0x7fe1f4009040 comp rx=0 tx=0).stop 2024-05-30T06:43:11.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.243+0000 7fe20a000640 1 -- 172.21.15.37:0/3248011782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe20415d7e0 msgr2=0x7fe204071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:11.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.243+0000 7fe20a000640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe20415d7e0 0x7fe204071dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00c730 tx=0x7fe1fc00cbf0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.243+0000 7fe20a000640 1 -- 172.21.15.37:0/3248011782 shutdown_connections 2024-05-30T06:43:11.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.243+0000 7fe20a000640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe20415d7e0 0x7fe204071dc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.243+0000 7fe20a000640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe20415d350 0x7fe20415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.243+0000 7fe20a000640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe1e0068380 0x7fe1e006a840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.243+0000 7fe20a000640 1 --2- 172.21.15.37:0/3248011782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2040b59d0 0x7fe20415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.243+0000 7fe20a000640 1 -- 172.21.15.37:0/3248011782 >> 172.21.15.37:0/3248011782 conn(0x7fe20406bf60 msgr2=0x7fe20415dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:11.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.243+0000 7fe20a000640 1 -- 172.21.15.37:0/3248011782 shutdown_connections 2024-05-30T06:43:11.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.243+0000 7fe20a000640 1 -- 172.21.15.37:0/3248011782 wait complete. 2024-05-30T06:43:11.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:43:11.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72b5400640 1 Processor -- start 2024-05-30T06:43:11.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72b5400640 1 -- start start 2024-05-30T06:43:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72b5400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f72b00b2e20 0x7f72b0160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72b5400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72b01609c0 0x7f72b0160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72b5400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72b00cd280 0x7f72b00cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72b5400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f72b00b3200 con 0x7f72b00cd280 2024-05-30T06:43:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72b5400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f72b00d01e0 con 0x7f72b00b2e20 2024-05-30T06:43:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72b5400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f72b00b33a0 con 0x7f72b01609c0 2024-05-30T06:43:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72af200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72b00cd280 0x7f72b00cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72af200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72b00cd280 0x7f72b00cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55874/0 (socket says 172.21.15.37:55874) 2024-05-30T06:43:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72af200640 1 -- 172.21.15.37:0/2335463920 learned_addr learned my addr 172.21.15.37:0/2335463920 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72ae800640 1 --2- 172.21.15.37:0/2335463920 >> v2:172.21.15.105:3300/0 conn(0x7f72b00b2e20 0x7f72b0160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72ade00640 1 --2- 172.21.15.37:0/2335463920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72b01609c0 0x7f72b0160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72af200640 1 -- 172.21.15.37:0/2335463920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72b01609c0 msgr2=0x7f72b0160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72af200640 1 --2- 172.21.15.37:0/2335463920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72b01609c0 0x7f72b0160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72af200640 1 -- 172.21.15.37:0/2335463920 >> v2:172.21.15.105:3300/0 conn(0x7f72b00b2e20 msgr2=0x7f72b0160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72af200640 1 --2- 172.21.15.37:0/2335463920 >> v2:172.21.15.105:3300/0 conn(0x7f72b00b2e20 0x7f72b0160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.407+0000 7f72af200640 1 -- 172.21.15.37:0/2335463920 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b00d0430 con 0x7f72b00cd280 2024-05-30T06:43:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72af200640 1 --2- 172.21.15.37:0/2335463920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b00cd280 0x7f72b00cd710 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009e50 tx=0x7f72a801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3b75ec948adccc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72ad400640 1 -- 172.21.15.37:0/2335463920 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a80a5840 con 0x7f72b00cd280 2024-05-30T06:43:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72ad400640 1 -- 172.21.15.37:0/2335463920 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a80a59e0 con 0x7f72b00cd280 2024-05-30T06:43:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72ad400640 1 -- 172.21.15.37:0/2335463920 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a80a5db0 con 0x7f72b00cd280 2024-05-30T06:43:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72b5400640 1 -- 172.21.15.37:0/2335463920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b00cd280 msgr2=0x7f72b00cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72b5400640 1 --2- 172.21.15.37:0/2335463920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b00cd280 0x7f72b00cd710 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009e50 tx=0x7f72a801c9c0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72b5400640 1 -- 172.21.15.37:0/2335463920 shutdown_connections 2024-05-30T06:43:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72b5400640 1 --2- 172.21.15.37:0/2335463920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b00cd280 0x7f72b00cd710 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72b5400640 1 --2- 172.21.15.37:0/2335463920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72b01609c0 0x7f72b0160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72b5400640 1 --2- 172.21.15.37:0/2335463920 >> v2:172.21.15.105:3300/0 conn(0x7f72b00b2e20 0x7f72b0160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72b5400640 1 -- 172.21.15.37:0/2335463920 >> 172.21.15.37:0/2335463920 conn(0x7f72b00b4100 msgr2=0x7f72b00b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72b5400640 1 -- 172.21.15.37:0/2335463920 shutdown_connections 2024-05-30T06:43:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72b5400640 1 -- 172.21.15.37:0/2335463920 wait complete. 2024-05-30T06:43:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.411+0000 7f72b5400640 1 Processor -- start 2024-05-30T06:43:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72b5400640 1 -- start start 2024-05-30T06:43:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72b5400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72b00b2e20 0x7f72b0071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72b5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b00cd280 0x7f72b006dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72b5400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b01609c0 0x7f72b006e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72b5400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f72b009aa60 con 0x7f72b00cd280 2024-05-30T06:43:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72b5400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f72b00cee40 con 0x7f72b01609c0 2024-05-30T06:43:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72b5400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f72b009abe0 con 0x7f72b00b2e20 2024-05-30T06:43:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72ade00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b00cd280 0x7f72b006dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72ade00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b00cd280 0x7f72b006dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55886/0 (socket says 172.21.15.37:55886) 2024-05-30T06:43:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72ade00640 1 -- 172.21.15.37:0/933761890 learned_addr learned my addr 172.21.15.37:0/933761890 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72af200640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b01609c0 0x7f72b006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72ae800640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72b00b2e20 0x7f72b0071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72ade00640 1 -- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72b00b2e20 msgr2=0x7f72b0071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72ade00640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72b00b2e20 0x7f72b0071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72ade00640 1 -- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b01609c0 msgr2=0x7f72b006e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72ade00640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b01609c0 0x7f72b006e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72ade00640 1 -- 172.21.15.37:0/933761890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b0157180 con 0x7f72b00cd280 2024-05-30T06:43:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72ade00640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b00cd280 0x7f72b006dfd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f729c00d5f0 tx=0x7f729c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72a6a00640 1 -- 172.21.15.37:0/933761890 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c0125f0 con 0x7f72b00cd280 2024-05-30T06:43:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72a6a00640 1 -- 172.21.15.37:0/933761890 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f729c019070 con 0x7f72b00cd280 2024-05-30T06:43:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72b5400640 1 -- 172.21.15.37:0/933761890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b015f540 con 0x7f72b00cd280 2024-05-30T06:43:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72a6a00640 1 -- 172.21.15.37:0/933761890 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c0129b0 con 0x7f72b00cd280 2024-05-30T06:43:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72b5400640 1 -- 172.21.15.37:0/933761890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b015fb00 con 0x7f72b00cd280 2024-05-30T06:43:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.415+0000 7f72b5400640 1 -- 172.21.15.37:0/933761890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b0068b20 con 0x7f72b00cd280 2024-05-30T06:43:11.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.419+0000 7f72a6a00640 1 -- 172.21.15.37:0/933761890 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f729c012b50 con 0x7f72b00cd280 2024-05-30T06:43:11.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.419+0000 7f72a6a00640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7290068380 0x7f729006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:11.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.419+0000 7f72a6a00640 1 -- 172.21.15.37:0/933761890 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f729c086cd0 con 0x7f72b00cd280 2024-05-30T06:43:11.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.419+0000 7f72ae800640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7290068380 0x7f729006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:11.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.419+0000 7f72ae800640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7290068380 0x7f729006a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f72a000b9d0 tx=0x7f72a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:11.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.423+0000 7f72a6a00640 1 -- 172.21.15.37:0/933761890 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f729c057280 con 0x7f72b00cd280 2024-05-30T06:43:11.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.619+0000 7f72b5400640 1 -- 172.21.15.37:0/933761890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72b00d2290 con 0x7f72b00cd280 2024-05-30T06:43:11.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.623+0000 7f72a6a00640 1 -- 172.21.15.37:0/933761890 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5178 (secure 0 0 0) 0x7f729c056b80 con 0x7f72b00cd280 2024-05-30T06:43:11.621 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:43:11.621 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1355950100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1355950100},{"type":"v1","addr":"172.21.15.37:6835","nonce":1355950100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3139010455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3139010455},{"type":"v1","addr":"172.21.15.105:6836","nonce":3139010455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/189373657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":189373657},{"type":"v1","addr":"172.21.15.105:6837","nonce":189373657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:43:05.679965+0000","modified":"2024-05-30T06:43:08.691367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6833/12178000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":12178000},{"type":"v1","addr":"172.21.15.37:6833","nonce":12178000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5040,"qdb_cluster":[5040]},"id":2}]} 2024-05-30T06:43:11.621 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2024-05-30T06:43:11.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.623+0000 7f72b5400640 1 -- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7290068380 msgr2=0x7f729006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:11.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.623+0000 7f72b5400640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7290068380 0x7f729006a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f72a000b9d0 tx=0x7f72a0008040 comp rx=0 tx=0).stop 2024-05-30T06:43:11.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.623+0000 7f72b5400640 1 -- 172.21.15.37:0/933761890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b00cd280 msgr2=0x7f72b006dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:11.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.623+0000 7f72b5400640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b00cd280 0x7f72b006dfd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f729c00d5f0 tx=0x7f729c00dab0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.623+0000 7f72b5400640 1 -- 172.21.15.37:0/933761890 shutdown_connections 2024-05-30T06:43:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.623+0000 7f72b5400640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7290068380 0x7f729006a840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.623+0000 7f72b5400640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72b01609c0 0x7f72b006e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.623+0000 7f72b5400640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b00cd280 0x7f72b006dfd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.623+0000 7f72b5400640 1 --2- 172.21.15.37:0/933761890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72b00b2e20 0x7f72b0071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.623+0000 7f72b5400640 1 -- 172.21.15.37:0/933761890 >> 172.21.15.37:0/933761890 conn(0x7f72b00b4100 msgr2=0x7f72b009b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.623+0000 7f72b5400640 1 -- 172.21.15.37:0/933761890 shutdown_connections 2024-05-30T06:43:11.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:11.623+0000 7f72b5400640 1 -- 172.21.15.37:0/933761890 wait complete. 2024-05-30T06:43:12.046 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T06:43:05.679965+0000', 'modified': '2024-05-30T06:43:08.691367+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5040}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5040': {'gid': 5040, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6833/12178000', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 12178000}, {'type': 'v1', 'addr': '172.21.15.37:6833', 'nonce': 12178000}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5040, 'qdb_cluster': [5040]} 2024-05-30T06:43:12.046 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T06:43:12.046 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-30T06:43:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f0281600640 1 Processor -- start 2024-05-30T06:43:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f0281600640 1 -- start start 2024-05-30T06:43:12.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f0281600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027c165830 0x7f027c167c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f0281600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f027c15deb0 con 0x7f027c15da20 2024-05-30T06:43:12.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f0281600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f027c0cd350 con 0x7f027c0d0c60 2024-05-30T06:43:12.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f0281600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f027c0cd610 con 0x7f027c165830 2024-05-30T06:43:12.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f0272000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f027c15da20 0x7f027c0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33330/0 (socket says 172.21.15.37:33330) 2024-05-30T06:43:12.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f0272000640 1 -- 172.21.15.37:0/2435805182 learned_addr learned my addr 172.21.15.37:0/2435805182 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:12.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f027b400640 1 --2- 172.21.15.37:0/2435805182 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027c165830 0x7f027c167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f027a000640 1 -- 172.21.15.37:0/2435805182 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923209198 0 0) 0x7f027c15deb0 con 0x7f027c15da20 2024-05-30T06:43:12.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f027a000640 1 -- 172.21.15.37:0/2435805182 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0260003530 con 0x7f027c15da20 2024-05-30T06:43:12.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f027a000640 1 -- 172.21.15.37:0/2435805182 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976520981 0 0) 0x7f027c0cd350 con 0x7f027c0d0c60 2024-05-30T06:43:12.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f027a000640 1 -- 172.21.15.37:0/2435805182 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f027c15deb0 con 0x7f027c0d0c60 2024-05-30T06:43:12.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f027b400640 1 -- 172.21.15.37:0/2435805182 >> v1:172.21.15.105:6789/0 conn(0x7f027c0d0c60 legacy=0x7f027c0d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f027a000640 1 -- 172.21.15.37:0/2435805182 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2673148853 0 0) 0x7f0260003530 con 0x7f027c15da20 2024-05-30T06:43:12.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f027b400640 1 -- 172.21.15.37:0/2435805182 >> v1:172.21.15.37:6789/0 conn(0x7f027c15da20 legacy=0x7f027c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.191+0000 7f027b400640 1 -- 172.21.15.37:0/2435805182 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c0cd8f0 con 0x7f027c165830 2024-05-30T06:43:12.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.195+0000 7f027b400640 1 --2- 172.21.15.37:0/2435805182 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027c165830 0x7f027c167c20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0274009dc0 tx=0x7f027401c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffbd777ae0ec5304 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:12.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.195+0000 7f027a000640 1 -- 172.21.15.37:0/2435805182 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02740b2070 con 0x7f027c165830 2024-05-30T06:43:12.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.195+0000 7f027a000640 1 -- 172.21.15.37:0/2435805182 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02740a5550 con 0x7f027c165830 2024-05-30T06:43:12.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.195+0000 7f027a000640 1 -- 172.21.15.37:0/2435805182 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264001680 con 0x7f027c165830 2024-05-30T06:43:12.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.195+0000 7f0281600640 1 -- 172.21.15.37:0/2435805182 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027c165830 msgr2=0x7f027c167c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.195+0000 7f0281600640 1 --2- 172.21.15.37:0/2435805182 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027c165830 0x7f027c167c20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0274009dc0 tx=0x7f027401c820 comp rx=0 tx=0).stop 2024-05-30T06:43:12.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.195+0000 7f0281600640 1 -- 172.21.15.37:0/2435805182 shutdown_connections 2024-05-30T06:43:12.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.195+0000 7f0281600640 1 --2- 172.21.15.37:0/2435805182 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027c165830 0x7f027c167c20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.195+0000 7f0281600640 1 -- 172.21.15.37:0/2435805182 >> 172.21.15.37:0/2435805182 conn(0x7f027c0b4190 msgr2=0x7f027c0b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:12.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.195+0000 7f0281600640 1 -- 172.21.15.37:0/2435805182 shutdown_connections 2024-05-30T06:43:12.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.195+0000 7f0281600640 1 -- 172.21.15.37:0/2435805182 wait complete. 2024-05-30T06:43:12.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f0281600640 1 Processor -- start 2024-05-30T06:43:12.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f0281600640 1 -- start start 2024-05-30T06:43:12.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f0281600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f027c0d0c60 0x7f027c153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f0281600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027c15da20 0x7f027c159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f0281600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f027c165830 0x7f027c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f0281600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f027c0ce550 con 0x7f027c0d0c60 2024-05-30T06:43:12.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f0281600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f027c0ce3d0 con 0x7f027c165830 2024-05-30T06:43:12.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f0281600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f027c16a980 con 0x7f027c15da20 2024-05-30T06:43:12.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f027aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f027c0d0c60 0x7f027c153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f027aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f027c0d0c60 0x7f027c153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55902/0 (socket says 172.21.15.37:55902) 2024-05-30T06:43:12.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f027aa00640 1 -- 172.21.15.37:0/1759460585 learned_addr learned my addr 172.21.15.37:0/1759460585 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:12.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f0272000640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027c15da20 0x7f027c159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f027b400640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f027c165830 0x7f027c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f027aa00640 1 -- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027c15da20 msgr2=0x7f027c159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f027aa00640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027c15da20 0x7f027c159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f027aa00640 1 -- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f027c165830 msgr2=0x7f027c06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f027aa00640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f027c165830 0x7f027c06e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f027aa00640 1 -- 172.21.15.37:0/1759460585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c159930 con 0x7f027c0d0c60 2024-05-30T06:43:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f027aa00640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f027c0d0c60 0x7f027c153500 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f026c00c430 tx=0x7f026c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:12.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f0273400640 1 -- 172.21.15.37:0/1759460585 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c017070 con 0x7f027c0d0c60 2024-05-30T06:43:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f0273400640 1 -- 172.21.15.37:0/1759460585 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026c0052f0 con 0x7f027c0d0c60 2024-05-30T06:43:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f0273400640 1 -- 172.21.15.37:0/1759460585 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c003840 con 0x7f027c0d0c60 2024-05-30T06:43:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.199+0000 7f0281600640 1 -- 172.21.15.37:0/1759460585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027c159660 con 0x7f027c0d0c60 2024-05-30T06:43:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.203+0000 7f0281600640 1 -- 172.21.15.37:0/1759460585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f027c152a20 con 0x7f027c0d0c60 2024-05-30T06:43:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.203+0000 7f0273400640 1 -- 172.21.15.37:0/1759460585 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f026c01a070 con 0x7f027c0d0c60 2024-05-30T06:43:12.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.203+0000 7f0273400640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02580683b0 0x7f025806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.203+0000 7f0273400640 1 -- 172.21.15.37:0/1759460585 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f026c085d90 con 0x7f027c0d0c60 2024-05-30T06:43:12.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.203+0000 7f0284aae000 1 Processor -- start 2024-05-30T06:43:12.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.203+0000 7f0284aae000 1 -- start start 2024-05-30T06:43:12.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.203+0000 7f0272000640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02580683b0 0x7f025806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8120 0x558dba1b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 0x558dba16b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 0x558dba16ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558db9fbc420 con 0x558dba16b650 2024-05-30T06:43:12.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558db9f56bf0 con 0x558dba1b8a40 2024-05-30T06:43:12.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x558db9fb83e0 con 0x558dba1b8120 2024-05-30T06:43:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0272000640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02580683b0 0x7f025806a870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f027c160420 tx=0x7f0264001160 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f027b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 0x558dba16ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0272000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 0x558dba16b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f027aa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8120 0x558dba1b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f027b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 0x558dba16ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55906/0 (socket says 172.21.15.37:55906) 2024-05-30T06:43:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f027b400640 1 -- 172.21.15.37:0/3668573659 learned_addr learned my addr 172.21.15.37:0/3668573659 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:12.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f027aa00640 1 -- 172.21.15.37:0/3668573659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 msgr2=0x558dba16b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:12.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f027aa00640 1 --2- 172.21.15.37:0/3668573659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 0x558dba16b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f027aa00640 1 -- 172.21.15.37:0/3668573659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 msgr2=0x558dba16ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f027aa00640 1 --2- 172.21.15.37:0/3668573659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 0x558dba16ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f027aa00640 1 -- 172.21.15.37:0/3668573659 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dba064450 con 0x558dba1b8120 2024-05-30T06:43:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f027b400640 1 --2- 172.21.15.37:0/3668573659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 0x558dba16ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:43:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f027aa00640 1 --2- 172.21.15.37:0/3668573659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8120 0x558dba1b8500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f026c055960 tx=0x7f026c055d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a225381bea91d0b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f026b400640 1 -- 172.21.15.37:0/3668573659 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c06e170 con 0x558dba1b8120 2024-05-30T06:43:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f026b400640 1 -- 172.21.15.37:0/3668573659 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026c084330 con 0x558dba1b8120 2024-05-30T06:43:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f026b400640 1 -- 172.21.15.37:0/3668573659 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c07db80 con 0x558dba1b8120 2024-05-30T06:43:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 -- 172.21.15.37:0/3668573659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8120 msgr2=0x558dba1b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 --2- 172.21.15.37:0/3668573659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8120 0x558dba1b8500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f026c055960 tx=0x7f026c055d20 comp rx=0 tx=0).stop 2024-05-30T06:43:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 -- 172.21.15.37:0/3668573659 shutdown_connections 2024-05-30T06:43:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 --2- 172.21.15.37:0/3668573659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 0x558dba16ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 --2- 172.21.15.37:0/3668573659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 0x558dba16b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 --2- 172.21.15.37:0/3668573659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8120 0x558dba1b8500 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 -- 172.21.15.37:0/3668573659 >> 172.21.15.37:0/3668573659 conn(0x558dba198ec0 msgr2=0x558dba19b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:12.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 -- 172.21.15.37:0/3668573659 shutdown_connections 2024-05-30T06:43:12.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 -- 172.21.15.37:0/3668573659 wait complete. 2024-05-30T06:43:12.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 -- start start 2024-05-30T06:43:12.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.207+0000 7f0284aae000 1 Processor -- start 2024-05-30T06:43:12.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba16b650 0x558dba170b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 0x558dba171080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 0x558dba1715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558db9f5cec0 con 0x558dba1b8120 2024-05-30T06:43:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558dba03d120 con 0x558dba1b8a40 2024-05-30T06:43:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x558db9fc7350 con 0x558dba16b650 2024-05-30T06:43:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 10 client.0 _ll_register_callbacks cb 0x558db9f994d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:43:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0272000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 0x558dba171080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0272000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 0x558dba171080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55918/0 (socket says 172.21.15.37:55918) 2024-05-30T06:43:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0272000640 1 -- 172.21.15.37:0/104912604 learned_addr learned my addr 172.21.15.37:0/104912604 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f027aa00640 1 --2- 172.21.15.37:0/104912604 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba16b650 0x558dba170b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f027b400640 1 --2- 172.21.15.37:0/104912604 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 0x558dba1715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0272000640 1 -- 172.21.15.37:0/104912604 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba16b650 msgr2=0x558dba170b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0272000640 1 --2- 172.21.15.37:0/104912604 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba16b650 0x558dba170b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0272000640 1 -- 172.21.15.37:0/104912604 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 msgr2=0x558dba1715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0272000640 1 --2- 172.21.15.37:0/104912604 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 0x558dba1715c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0272000640 1 -- 172.21.15.37:0/104912604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dba001f80 con 0x558dba1b8120 2024-05-30T06:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0272000640 1 --2- 172.21.15.37:0/104912604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 0x558dba171080 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0264010010 tx=0x7f02640017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ca3e03fe33abdd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f025fe00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f025fe00640 1 -- 172.21.15.37:0/104912604 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264015e20 con 0x558dba1b8120 2024-05-30T06:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 1 -- 172.21.15.37:0/104912604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f026c084330 con 0x558dba1b8120 2024-05-30T06:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f025fe00640 1 -- 172.21.15.37:0/104912604 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f0264010040 con 0x558dba1b8120 2024-05-30T06:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f025fe00640 1 -- 172.21.15.37:0/104912604 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f026402e050 con 0x558dba1b8120 2024-05-30T06:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 10 client.5223 fetch_fsmap learned FSMap version 17 2024-05-30T06:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 1 -- 172.21.15.37:0/104912604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x558db9f95f00 con 0x558dba1b8120 2024-05-30T06:43:12.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f025fe00640 1 -- 172.21.15.37:0/104912604 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026c084330 con 0x558dba1b8120 2024-05-30T06:43:12.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f025fe00640 1 -- 172.21.15.37:0/104912604 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f0264031020 con 0x558dba1b8120 2024-05-30T06:43:12.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 10 client.5223 fetch_fsmap finished waiting for FSMap version 17 2024-05-30T06:43:12.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 10 client.5223 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T06:43:12.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 20 client.5223 populate_metadata read hostname 'smithi037' 2024-05-30T06:43:12.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 1 --2- 172.21.15.37:0/104912604 >> [v2:172.21.15.37:6832/12178000,v1:172.21.15.37:6833/12178000] conn(0x558dba1c73c0 0x558dba1c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 4 client.5223 mds_command: new command op to 5040 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T06:43:12.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f0284aae000 1 -- 172.21.15.37:0/104912604 --> [v2:172.21.15.37:6832/12178000,v1:172.21.15.37:6833/12178000] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558db9f55bc0 con 0x558dba1c73c0 2024-05-30T06:43:12.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f027aa00640 1 --2- 172.21.15.37:0/104912604 >> [v2:172.21.15.37:6832/12178000,v1:172.21.15.37:6833/12178000] conn(0x558dba1c73c0 0x558dba1c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f027aa00640 1 --2- 172.21.15.37:0/104912604 >> [v2:172.21.15.37:6832/12178000,v1:172.21.15.37:6833/12178000] conn(0x558dba1c73c0 0x558dba1c97b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=581f7ac514edacef server_cookie=c4ea72bde47f7dc0 in_seq=0 out_seq=0 2024-05-30T06:43:12.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.211+0000 7f025fe00640 10 client.5223 ms_handle_connect on v2:172.21.15.37:6832/12178000 2024-05-30T06:43:12.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f025fe00640 1 -- 172.21.15.37:0/104912604 <== mds.0 v2:172.21.15.37:6832/12178000 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558db9f55bc0 con 0x558dba1c73c0 2024-05-30T06:43:12.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f025fe00640 10 client.5223 handle_command_reply: tid=0 2024-05-30T06:43:12.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f0284aae000 1 client.5223 shutdown 2024-05-30T06:43:12.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f0284aae000 1 -- 172.21.15.37:0/104912604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 msgr2=0x558dba171080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f0284aae000 1 --2- 172.21.15.37:0/104912604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 0x558dba171080 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0264010010 tx=0x7f02640017b0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f0284aae000 1 -- 172.21.15.37:0/104912604 shutdown_connections 2024-05-30T06:43:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f0284aae000 1 --2- 172.21.15.37:0/104912604 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 0x558dba1715c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f0284aae000 1 --2- 172.21.15.37:0/104912604 >> [v2:172.21.15.37:6832/12178000,v1:172.21.15.37:6833/12178000] conn(0x558dba1c73c0 0x558dba1c97b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f0284aae000 1 --2- 172.21.15.37:0/104912604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 0x558dba171080 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f0284aae000 1 --2- 172.21.15.37:0/104912604 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba16b650 0x558dba170b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f025fe00640 0 client.5223 ms_handle_reset on v2:172.21.15.37:6832/12178000 2024-05-30T06:43:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f0284aae000 1 -- 172.21.15.37:0/104912604 >> 172.21.15.37:0/104912604 conn(0x558dba198ec0 msgr2=0x558dba19b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f0284aae000 1 -- 172.21.15.37:0/104912604 shutdown_connections 2024-05-30T06:43:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f0284aae000 1 -- 172.21.15.37:0/104912604 wait complete. 2024-05-30T06:43:12.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.215+0000 7f0284aae000 20 client.5223 trim_cache size 0 max 16384 2024-05-30T06:43:12.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0284aae000 1 Processor -- start 2024-05-30T06:43:12.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0284aae000 1 -- start start 2024-05-30T06:43:12.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0284aae000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba16b650 0x558dba16a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0284aae000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 0x558dba16ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0284aae000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8a40 0x558dba1c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0284aae000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f027c1580f0 con 0x558dba1b8120 2024-05-30T06:43:12.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0284aae000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f027c150c30 con 0x558dba16b650 2024-05-30T06:43:12.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0284aae000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f027c157aa0 con 0x558dba1b8a40 2024-05-30T06:43:12.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0272000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 0x558dba16ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0272000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 0x558dba16ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55920/0 (socket says 172.21.15.37:55920) 2024-05-30T06:43:12.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0272000640 1 -- 172.21.15.37:0/364456590 learned_addr learned my addr 172.21.15.37:0/364456590 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:12.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f027aa00640 1 --2- 172.21.15.37:0/364456590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba16b650 0x558dba16a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f027b400640 1 --2- 172.21.15.37:0/364456590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8a40 0x558dba1c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0272000640 1 -- 172.21.15.37:0/364456590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8a40 msgr2=0x558dba1c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:12.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0272000640 1 --2- 172.21.15.37:0/364456590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8a40 0x558dba1c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0272000640 1 -- 172.21.15.37:0/364456590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba16b650 msgr2=0x558dba16a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:12.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0272000640 1 --2- 172.21.15.37:0/364456590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba16b650 0x558dba16a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.231+0000 7f0272000640 1 -- 172.21.15.37:0/364456590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dba1b8870 con 0x558dba1b8120 2024-05-30T06:43:12.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f027aa00640 1 --2- 172.21.15.37:0/364456590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba16b650 0x558dba16a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:12.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0272000640 1 --2- 172.21.15.37:0/364456590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 0x558dba16ad50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f02640011f0 tx=0x7f0264020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb2ca848751b026 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:12.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f026aa00640 1 -- 172.21.15.37:0/364456590 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264015040 con 0x558dba1b8120 2024-05-30T06:43:12.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f026aa00640 1 -- 172.21.15.37:0/364456590 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0264026070 con 0x558dba1b8120 2024-05-30T06:43:12.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f026aa00640 1 -- 172.21.15.37:0/364456590 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02640047f0 con 0x558dba1b8120 2024-05-30T06:43:12.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 -- 172.21.15.37:0/364456590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 msgr2=0x558dba16ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 --2- 172.21.15.37:0/364456590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 0x558dba16ad50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f02640011f0 tx=0x7f0264020000 comp rx=0 tx=0).stop 2024-05-30T06:43:12.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 -- 172.21.15.37:0/364456590 shutdown_connections 2024-05-30T06:43:12.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 --2- 172.21.15.37:0/364456590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8a40 0x558dba1c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 --2- 172.21.15.37:0/364456590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba1b8120 0x558dba16ad50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 --2- 172.21.15.37:0/364456590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba16b650 0x558dba16a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 -- 172.21.15.37:0/364456590 >> 172.21.15.37:0/364456590 conn(0x558dba198ec0 msgr2=0x558dba16a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:12.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 -- 172.21.15.37:0/364456590 shutdown_connections 2024-05-30T06:43:12.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 -- 172.21.15.37:0/364456590 wait complete. 2024-05-30T06:43:12.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 -- start start 2024-05-30T06:43:12.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 Processor -- start 2024-05-30T06:43:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 0x558dba1cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8120 0x558dba1e3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 0x558dba1e3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558db9fbb730 con 0x558dba16b650 2024-05-30T06:43:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558db9f889e0 con 0x558dba1b8a40 2024-05-30T06:43:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x558db9fc0a50 con 0x558dba1b8120 2024-05-30T06:43:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0284aae000 10 client.0 _ll_register_callbacks cb 0x7f0264001520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:43:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f027aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 0x558dba1cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f027aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 0x558dba1cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55932/0 (socket says 172.21.15.37:55932) 2024-05-30T06:43:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f027aa00640 1 -- 172.21.15.37:0/1752463662 learned_addr learned my addr 172.21.15.37:0/1752463662 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f0272000640 1 --2- 172.21.15.37:0/1752463662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8120 0x558dba1e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f027b400640 1 --2- 172.21.15.37:0/1752463662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 0x558dba1e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f027aa00640 1 -- 172.21.15.37:0/1752463662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8120 msgr2=0x558dba1e3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f027aa00640 1 --2- 172.21.15.37:0/1752463662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8120 0x558dba1e3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f027aa00640 1 -- 172.21.15.37:0/1752463662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 msgr2=0x558dba1e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f027aa00640 1 --2- 172.21.15.37:0/1752463662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 0x558dba1e3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f027aa00640 1 -- 172.21.15.37:0/1752463662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558db9f42e80 con 0x558dba16b650 2024-05-30T06:43:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f027aa00640 1 --2- 172.21.15.37:0/1752463662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 0x558dba1cc650 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f026c055960 tx=0x7f026c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17642b69852be2a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.235+0000 7f025fe00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:43:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f025fe00640 1 -- 172.21.15.37:0/1752463662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c06e170 con 0x558dba16b650 2024-05-30T06:43:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f025fe00640 1 -- 172.21.15.37:0/1752463662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f026c0522d0 con 0x558dba16b650 2024-05-30T06:43:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 -- 172.21.15.37:0/1752463662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0264026070 con 0x558dba16b650 2024-05-30T06:43:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f025fe00640 1 -- 172.21.15.37:0/1752463662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f026c07db80 con 0x558dba16b650 2024-05-30T06:43:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 10 client.5229 fetch_fsmap learned FSMap version 17 2024-05-30T06:43:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 -- 172.21.15.37:0/1752463662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x558db9f84b30 con 0x558dba16b650 2024-05-30T06:43:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f025fe00640 1 -- 172.21.15.37:0/1752463662 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0264026070 con 0x558dba16b650 2024-05-30T06:43:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f025fe00640 1 -- 172.21.15.37:0/1752463662 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f026c0550b0 con 0x558dba16b650 2024-05-30T06:43:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 10 client.5229 fetch_fsmap finished waiting for FSMap version 17 2024-05-30T06:43:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 10 client.5229 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T06:43:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 20 client.5229 populate_metadata read hostname 'smithi037' 2024-05-30T06:43:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 --2- 172.21.15.37:0/1752463662 >> [v2:172.21.15.37:6832/12178000,v1:172.21.15.37:6833/12178000] conn(0x558dba1e3dc0 0x558dba226fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 4 client.5229 mds_command: new command op to 5040 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T06:43:12.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 -- 172.21.15.37:0/1752463662 --> [v2:172.21.15.37:6832/12178000,v1:172.21.15.37:6833/12178000] -- command(tid 0: {"prefix": "status"}) -- 0x558db9fc9e40 con 0x558dba1e3dc0 2024-05-30T06:43:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0272000640 1 --2- 172.21.15.37:0/1752463662 >> [v2:172.21.15.37:6832/12178000,v1:172.21.15.37:6833/12178000] conn(0x558dba1e3dc0 0x558dba226fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0272000640 1 --2- 172.21.15.37:0/1752463662 >> [v2:172.21.15.37:6832/12178000,v1:172.21.15.37:6833/12178000] conn(0x558dba1e3dc0 0x558dba226fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cabf22f56a271bec server_cookie=fda9dc02beb2f833 in_seq=0 out_seq=0 2024-05-30T06:43:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f025fe00640 10 client.5229 ms_handle_connect on v2:172.21.15.37:6832/12178000 2024-05-30T06:43:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f025fe00640 1 -- 172.21.15.37:0/1752463662 <== mds.0 v2:172.21.15.37:6832/12178000 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x558db9fc9e40 con 0x558dba1e3dc0 2024-05-30T06:43:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f025fe00640 10 client.5229 handle_command_reply: tid=0 2024-05-30T06:43:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 client.5229 shutdown 2024-05-30T06:43:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 -- 172.21.15.37:0/1752463662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 msgr2=0x558dba1cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 --2- 172.21.15.37:0/1752463662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 0x558dba1cc650 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f026c055960 tx=0x7f026c01d000 comp rx=0 tx=0).stop 2024-05-30T06:43:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 -- 172.21.15.37:0/1752463662 shutdown_connections 2024-05-30T06:43:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 --2- 172.21.15.37:0/1752463662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558dba1b8a40 0x558dba1e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 --2- 172.21.15.37:0/1752463662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558dba1b8120 0x558dba1e3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 --2- 172.21.15.37:0/1752463662 >> [v2:172.21.15.37:6832/12178000,v1:172.21.15.37:6833/12178000] conn(0x558dba1e3dc0 0x558dba226fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 --2- 172.21.15.37:0/1752463662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558dba16b650 0x558dba1cc650 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 -- 172.21.15.37:0/1752463662 >> 172.21.15.37:0/1752463662 conn(0x558dba198ec0 msgr2=0x558dba16a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f025fe00640 0 client.5229 ms_handle_reset on v2:172.21.15.37:6832/12178000 2024-05-30T06:43:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 -- 172.21.15.37:0/1752463662 shutdown_connections 2024-05-30T06:43:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 1 -- 172.21.15.37:0/1752463662 wait complete. 2024-05-30T06:43:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0284aae000 20 client.5229 trim_cache size 0 max 16384 2024-05-30T06:43:12.243 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:43:12.243 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:43:12.243 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-30T06:43:12.243 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5040, 2024-05-30T06:43:12.244 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-30T06:43:12.244 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-30T06:43:12.244 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-30T06:43:12.244 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 5.9678359719999996, 2024-05-30T06:43:12.244 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 17, 2024-05-30T06:43:12.244 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 33, 2024-05-30T06:43:12.244 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 33, 2024-05-30T06:43:12.244 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 13.832207821000001 2024-05-30T06:43:12.244 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:43:12.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0281600640 1 -- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02580683b0 msgr2=0x7f025806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0281600640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02580683b0 0x7f025806a870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f027c160420 tx=0x7f0264001160 comp rx=0 tx=0).stop 2024-05-30T06:43:12.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0281600640 1 -- 172.21.15.37:0/1759460585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f027c0d0c60 msgr2=0x7f027c153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0281600640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f027c0d0c60 0x7f027c153500 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f026c00c430 tx=0x7f026c00c8f0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0281600640 1 -- 172.21.15.37:0/1759460585 shutdown_connections 2024-05-30T06:43:12.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0281600640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02580683b0 0x7f025806a870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0281600640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f027c165830 0x7f027c06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0281600640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027c15da20 0x7f027c159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0281600640 1 --2- 172.21.15.37:0/1759460585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f027c0d0c60 0x7f027c153500 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0281600640 1 -- 172.21.15.37:0/1759460585 >> 172.21.15.37:0/1759460585 conn(0x7f027c0b4190 msgr2=0x7f027c0b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0281600640 1 -- 172.21.15.37:0/1759460585 shutdown_connections 2024-05-30T06:43:12.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.239+0000 7f0281600640 1 -- 172.21.15.37:0/1759460585 wait complete. 2024-05-30T06:43:12.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T06:43:12.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.399+0000 7f1cc6c00640 1 Processor -- start 2024-05-30T06:43:12.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.399+0000 7f1cc6c00640 1 -- start start 2024-05-30T06:43:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.403+0000 7f1cc6c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1cc015c5a0 0x7f1cc00cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.403+0000 7f1cc6c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1cc00ce510 0x7f1cc00ce960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.403+0000 7f1cc6c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cc00b3810 con 0x7f1cc0070440 2024-05-30T06:43:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.403+0000 7f1cc6c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1cc00ceea0 con 0x7f1cc015c5a0 2024-05-30T06:43:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.403+0000 7f1cc6c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1cc00b3af0 con 0x7f1cc00ce510 2024-05-30T06:43:12.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.403+0000 7f1cc5800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1cc015c5a0 0x7f1cc00cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.403+0000 7f1cc5800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1cc015c5a0 0x7f1cc00cda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55934/0 (socket says 172.21.15.37:55934) 2024-05-30T06:43:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.403+0000 7f1cc5800640 1 -- 172.21.15.37:0/1357355965 learned_addr learned my addr 172.21.15.37:0/1357355965 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.403+0000 7f1cc6200640 1 --2- 172.21.15.37:0/1357355965 >> v2:172.21.15.105:3300/0 conn(0x7f1cc00ce510 0x7f1cc00ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.403+0000 7f1cc5800640 1 -- 172.21.15.37:0/1357355965 >> v2:172.21.15.105:3300/0 conn(0x7f1cc00ce510 msgr2=0x7f1cc00ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.403+0000 7f1cc5800640 1 --2- 172.21.15.37:0/1357355965 >> v2:172.21.15.105:3300/0 conn(0x7f1cc00ce510 0x7f1cc00ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.403+0000 7f1cc5800640 1 -- 172.21.15.37:0/1357355965 >> v1:172.21.15.105:6789/0 conn(0x7f1cc0070440 legacy=0x7f1cc015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.403+0000 7f1cc5800640 1 -- 172.21.15.37:0/1357355965 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc00b3dd0 con 0x7f1cc015c5a0 2024-05-30T06:43:12.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc5800640 1 --2- 172.21.15.37:0/1357355965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc015c5a0 0x7f1cc00cda80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006c530 tx=0x7f1cb401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc97f652e718c16 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:12.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cbfe00640 1 -- 172.21.15.37:0/1357355965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40ab660 con 0x7f1cc015c5a0 2024-05-30T06:43:12.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cbfe00640 1 -- 172.21.15.37:0/1357355965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb40b0070 con 0x7f1cc015c5a0 2024-05-30T06:43:12.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cbfe00640 1 -- 172.21.15.37:0/1357355965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40aba20 con 0x7f1cc015c5a0 2024-05-30T06:43:12.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 -- 172.21.15.37:0/1357355965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc015c5a0 msgr2=0x7f1cc00cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 --2- 172.21.15.37:0/1357355965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc015c5a0 0x7f1cc00cda80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1cc006c530 tx=0x7f1cb401c460 comp rx=0 tx=0).stop 2024-05-30T06:43:12.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 -- 172.21.15.37:0/1357355965 shutdown_connections 2024-05-30T06:43:12.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 --2- 172.21.15.37:0/1357355965 >> v2:172.21.15.105:3300/0 conn(0x7f1cc00ce510 0x7f1cc00ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 --2- 172.21.15.37:0/1357355965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc015c5a0 0x7f1cc00cda80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 -- 172.21.15.37:0/1357355965 >> 172.21.15.37:0/1357355965 conn(0x7f1cc006b960 msgr2=0x7f1cc006bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:12.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 -- 172.21.15.37:0/1357355965 shutdown_connections 2024-05-30T06:43:12.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 -- 172.21.15.37:0/1357355965 wait complete. 2024-05-30T06:43:12.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 Processor -- start 2024-05-30T06:43:12.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 -- start start 2024-05-30T06:43:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc0070440 0x7f1cc0153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cc00ce510 0x7f1cc00c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cc015c5a0 0x7f1cc006f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc015d210 con 0x7f1cc0070440 2024-05-30T06:43:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc015d090 con 0x7f1cc00ce510 2024-05-30T06:43:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc6c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1cc00b50c0 con 0x7f1cc015c5a0 2024-05-30T06:43:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc5800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc0070440 0x7f1cc0153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc5800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc0070440 0x7f1cc0153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55948/0 (socket says 172.21.15.37:55948) 2024-05-30T06:43:12.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.407+0000 7f1cc5800640 1 -- 172.21.15.37:0/4199440147 learned_addr learned my addr 172.21.15.37:0/4199440147 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cc4e00640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cc00ce510 0x7f1cc00c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cc6200640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cc015c5a0 0x7f1cc006f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cc5800640 1 -- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cc015c5a0 msgr2=0x7f1cc006f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cc5800640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cc015c5a0 0x7f1cc006f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cc5800640 1 -- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cc00ce510 msgr2=0x7f1cc00c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cc5800640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cc00ce510 0x7f1cc00c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cc5800640 1 -- 172.21.15.37:0/4199440147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc00c7940 con 0x7f1cc0070440 2024-05-30T06:43:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cc6200640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cc015c5a0 0x7f1cc006f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:12.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cc5800640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc0070440 0x7f1cc0153240 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40ad040 tx=0x7f1cb401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:12.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cbd600640 1 -- 172.21.15.37:0/4199440147 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40be5f0 con 0x7f1cc0070440 2024-05-30T06:43:12.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cbd600640 1 -- 172.21.15.37:0/4199440147 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cb40be7b0 con 0x7f1cc0070440 2024-05-30T06:43:12.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cbd600640 1 -- 172.21.15.37:0/4199440147 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb40beba0 con 0x7f1cc0070440 2024-05-30T06:43:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cc6c00640 1 -- 172.21.15.37:0/4199440147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc00c6360 con 0x7f1cc0070440 2024-05-30T06:43:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cc6c00640 1 -- 172.21.15.37:0/4199440147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc00c6920 con 0x7f1cc0070440 2024-05-30T06:43:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cc6c00640 1 -- 172.21.15.37:0/4199440147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc0075580 con 0x7f1cc0070440 2024-05-30T06:43:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cbd600640 1 -- 172.21.15.37:0/4199440147 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1cb40b43f0 con 0x7f1cc0070440 2024-05-30T06:43:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cbd600640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1ca0068380 0x7f1ca006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:12.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.411+0000 7f1cbd600640 1 -- 172.21.15.37:0/4199440147 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1cb41214d0 con 0x7f1cc0070440 2024-05-30T06:43:12.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.415+0000 7f1cc4e00640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1ca0068380 0x7f1ca006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:12.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.415+0000 7f1cc4e00640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1ca0068380 0x7f1ca006a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1cc01fa150 tx=0x7f1cac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:12.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.415+0000 7f1cbd600640 1 -- 172.21.15.37:0/4199440147 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1cb4016110 con 0x7f1cc0070440 2024-05-30T06:43:12.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cc6c00640 1 -- 172.21.15.37:0/4199440147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1cc015cb00 con 0x7f1cc0070440 2024-05-30T06:43:12.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cbd600640 1 -- 172.21.15.37:0/4199440147 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f1cb40f1550 con 0x7f1cc0070440 2024-05-30T06:43:12.618 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T06:43:12.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cc6c00640 1 -- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1ca0068380 msgr2=0x7f1ca006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cc6c00640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1ca0068380 0x7f1ca006a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1cc01fa150 tx=0x7f1cac009040 comp rx=0 tx=0).stop 2024-05-30T06:43:12.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cc6c00640 1 -- 172.21.15.37:0/4199440147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc0070440 msgr2=0x7f1cc0153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:12.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cc6c00640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc0070440 0x7f1cc0153240 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1cb40ad040 tx=0x7f1cb401aca0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cc6c00640 1 -- 172.21.15.37:0/4199440147 shutdown_connections 2024-05-30T06:43:12.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cc6c00640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1cc015c5a0 0x7f1cc006f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cc6c00640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1ca0068380 0x7f1ca006a840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cc6c00640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1cc00ce510 0x7f1cc00c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cc6c00640 1 --2- 172.21.15.37:0/4199440147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1cc0070440 0x7f1cc0153240 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cc6c00640 1 -- 172.21.15.37:0/4199440147 >> 172.21.15.37:0/4199440147 conn(0x7f1cc006b960 msgr2=0x7f1cc00b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cc6c00640 1 -- 172.21.15.37:0/4199440147 shutdown_connections 2024-05-30T06:43:12.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12.619+0000 7f1cc6c00640 1 -- 172.21.15.37:0/4199440147 wait complete. 2024-05-30T06:43:12.639 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-30T06:43:12.639 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T06:43:12.639 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-30T06:43:12.640 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T06:43:12.640 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T06:43:12.640 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-30T06:43:12.640 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-30T06:43:12.640 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T06:43:12.640 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:43:12.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:43:12.640 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-30T06:43:12.650 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:43:12.650 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:43:12.650 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:43:12.650 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:43:12.650 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-30T06:43:12.650 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:43:12.650 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:43:12.650 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:43:12.650 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42411sec preferred_lft 42411sec 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-30T06:43:12.651 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T06:43:12.652 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:30:63:12:21 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:43:12.652 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T06:43:12.652 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:43:12.652 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:43:12.652 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T06:43:12.652 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T06:43:12.652 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:43:12.652 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T06:43:12.652 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:43:12.652 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:43:12.652 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T06:43:12.652 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T06:43:12.652 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:43:12.653 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:43:12.653 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T06:43:12.653 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T06:43:12.653 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:43:12.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:43:12.653 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T06:43:12.710 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-30T06:43:12.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:43:12.712 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-30T06:43:12.770 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-30T06:43:12.770 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T06:43:12.770 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T06:43:12.770 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T06:43:12.770 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T06:43:12.770 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T06:43:12.771 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:43:12.771 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:43:12.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T06:43:12.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T06:43:12.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T06:43:12.771 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:43:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:43:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:43:12.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:43:12.912 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T06:43:12.968 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T06:43:12.968 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T06:43:12.969 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:43:12.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:43:12.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-30T06:43:13.033 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:43:13.033 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T06:43:13.088 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:43:13.088 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:43:13.088 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:43:13.140 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T06:43:13.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:43:13.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:43:13.233 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:43:13.233 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:43:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:43:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:43:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-05-30T06:43:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@393250aa-2b42-4955-adf1-f790b8ba4d8c.cephfs=/ 2024-05-30T06:43:13.248 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-05-30T06:43:13.252 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T06:43:13.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:43:13.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:43:13.272 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:43:13.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:43:13.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:43:13.380 INFO:teuthology.orchestra.run.smithi037.stdout:client5179 2024-05-30T06:43:13.381 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:43:13.381 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:43:13.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T06:43:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.575+0000 7f9225800640 1 Processor -- start 2024-05-30T06:43:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.575+0000 7f9225800640 1 -- start start 2024-05-30T06:43:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.579+0000 7f9225800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92200ced10 0x7f922006ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.579+0000 7f9225800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015d4e0 0x7f92200b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.579+0000 7f9225800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f922015db00 con 0x7f92200b59d0 2024-05-30T06:43:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.579+0000 7f9225800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f922006df50 con 0x7f92200ced10 2024-05-30T06:43:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.579+0000 7f9225800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f922006e7d0 con 0x7f922015d4e0 2024-05-30T06:43:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.579+0000 7f921ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92200ced10 0x7f922006ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.579+0000 7f921ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92200ced10 0x7f922006ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55952/0 (socket says 172.21.15.37:55952) 2024-05-30T06:43:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.579+0000 7f921ea00640 1 -- 172.21.15.37:0/867504626 learned_addr learned my addr 172.21.15.37:0/867504626 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.579+0000 7f921f400640 1 --2- 172.21.15.37:0/867504626 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015d4e0 0x7f92200b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.579+0000 7f921ea00640 1 -- 172.21.15.37:0/867504626 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015d4e0 msgr2=0x7f92200b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.579+0000 7f921ea00640 1 --2- 172.21.15.37:0/867504626 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015d4e0 0x7f92200b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.579+0000 7f921ea00640 1 -- 172.21.15.37:0/867504626 >> v1:172.21.15.105:6789/0 conn(0x7f92200b59d0 legacy=0x7f922015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.579+0000 7f921ea00640 1 -- 172.21.15.37:0/867504626 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922006e180 con 0x7f92200ced10 2024-05-30T06:43:13.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f921ea00640 1 --2- 172.21.15.37:0/867504626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200ced10 0x7f922006ec60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9210009870 tx=0x7f921001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1ad82872629608 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:13.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f921e000640 1 -- 172.21.15.37:0/867504626 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92100b2070 con 0x7f92200ced10 2024-05-30T06:43:13.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f921e000640 1 -- 172.21.15.37:0/867504626 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92100a9070 con 0x7f92200ced10 2024-05-30T06:43:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f921e000640 1 -- 172.21.15.37:0/867504626 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92100ad880 con 0x7f92200ced10 2024-05-30T06:43:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f9225800640 1 -- 172.21.15.37:0/867504626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200ced10 msgr2=0x7f922006ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f9225800640 1 --2- 172.21.15.37:0/867504626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200ced10 0x7f922006ec60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9210009870 tx=0x7f921001c560 comp rx=0 tx=0).stop 2024-05-30T06:43:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f9225800640 1 -- 172.21.15.37:0/867504626 shutdown_connections 2024-05-30T06:43:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f9225800640 1 --2- 172.21.15.37:0/867504626 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015d4e0 0x7f92200b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f9225800640 1 --2- 172.21.15.37:0/867504626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200ced10 0x7f922006ec60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f9225800640 1 -- 172.21.15.37:0/867504626 >> 172.21.15.37:0/867504626 conn(0x7f922006bf60 msgr2=0x7f92200b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f9225800640 1 -- 172.21.15.37:0/867504626 shutdown_connections 2024-05-30T06:43:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f9225800640 1 -- 172.21.15.37:0/867504626 wait complete. 2024-05-30T06:43:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f9225800640 1 Processor -- start 2024-05-30T06:43:13.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f9225800640 1 -- start start 2024-05-30T06:43:13.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f9225800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92200b59d0 0x7f922014abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f9225800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200ced10 0x7f922014b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.583+0000 7f9225800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015d4e0 0x7f9220150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9225800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f922015ead0 con 0x7f92200ced10 2024-05-30T06:43:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9225800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f922015e950 con 0x7f92200b59d0 2024-05-30T06:43:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9225800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9220169450 con 0x7f922015d4e0 2024-05-30T06:43:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9216000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200ced10 0x7f922014b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9216000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200ced10 0x7f922014b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55956/0 (socket says 172.21.15.37:55956) 2024-05-30T06:43:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9216000640 1 -- 172.21.15.37:0/799853661 learned_addr learned my addr 172.21.15.37:0/799853661 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f921ea00640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92200b59d0 0x7f922014abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f921f400640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015d4e0 0x7f9220150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9216000640 1 -- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015d4e0 msgr2=0x7f9220150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9216000640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015d4e0 0x7f9220150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9216000640 1 -- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92200b59d0 msgr2=0x7f922014abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9216000640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92200b59d0 0x7f922014abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9216000640 1 -- 172.21.15.37:0/799853661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9220152720 con 0x7f92200ced10 2024-05-30T06:43:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f921ea00640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92200b59d0 0x7f922014abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:43:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f921f400640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015d4e0 0x7f9220150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:43:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9216000640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200ced10 0x7f922014b2d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f920800c3a0 tx=0x7f920800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9217400640 1 -- 172.21.15.37:0/799853661 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92080052d0 con 0x7f92200ced10 2024-05-30T06:43:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9217400640 1 -- 172.21.15.37:0/799853661 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9208005470 con 0x7f92200ced10 2024-05-30T06:43:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9225800640 1 -- 172.21.15.37:0/799853661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9220152a00 con 0x7f92200ced10 2024-05-30T06:43:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9217400640 1 -- 172.21.15.37:0/799853661 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9208007260 con 0x7f92200ced10 2024-05-30T06:43:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9225800640 1 -- 172.21.15.37:0/799853661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9220152fc0 con 0x7f92200ced10 2024-05-30T06:43:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9225800640 1 -- 172.21.15.37:0/799853661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9220068d40 con 0x7f92200ced10 2024-05-30T06:43:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9217400640 1 -- 172.21.15.37:0/799853661 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9208007400 con 0x7f92200ced10 2024-05-30T06:43:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.587+0000 7f9217400640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f91fc068380 0x7f91fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.591+0000 7f9217400640 1 -- 172.21.15.37:0/799853661 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9208085f10 con 0x7f92200ced10 2024-05-30T06:43:13.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.591+0000 7f921ea00640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f91fc068380 0x7f91fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:13.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.591+0000 7f921ea00640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f91fc068380 0x7f91fc06a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f92100af000 tx=0x7f9210008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:13.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.595+0000 7f9217400640 1 -- 172.21.15.37:0/799853661 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9208056430 con 0x7f92200ced10 2024-05-30T06:43:13.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:13.795+0000 7f9225800640 1 -- 172.21.15.37:0/799853661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f922015f0d0 con 0x7f92200ced10 2024-05-30T06:43:14.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.323+0000 7f9217400640 1 -- 172.21.15.37:0/799853661 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) ==== 136+0+0 (secure 0 0 0) 0x7f9208055d30 con 0x7f92200ced10 2024-05-30T06:43:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.323+0000 7f9225800640 1 -- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f91fc068380 msgr2=0x7f91fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.323+0000 7f9225800640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f91fc068380 0x7f91fc06a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f92100af000 tx=0x7f9210008040 comp rx=0 tx=0).stop 2024-05-30T06:43:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.323+0000 7f9225800640 1 -- 172.21.15.37:0/799853661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200ced10 msgr2=0x7f922014b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.323+0000 7f9225800640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200ced10 0x7f922014b2d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f920800c3a0 tx=0x7f920800c860 comp rx=0 tx=0).stop 2024-05-30T06:43:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.327+0000 7f9225800640 1 -- 172.21.15.37:0/799853661 shutdown_connections 2024-05-30T06:43:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.327+0000 7f9225800640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015d4e0 0x7f9220150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.327+0000 7f9225800640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92200ced10 0x7f922014b2d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.327+0000 7f9225800640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f91fc068380 0x7f91fc06a840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.327+0000 7f9225800640 1 --2- 172.21.15.37:0/799853661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92200b59d0 0x7f922014abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.327+0000 7f9225800640 1 -- 172.21.15.37:0/799853661 >> 172.21.15.37:0/799853661 conn(0x7f922006bf60 msgr2=0x7f922015f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:14.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.327+0000 7f9225800640 1 -- 172.21.15.37:0/799853661 shutdown_connections 2024-05-30T06:43:14.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.327+0000 7f9225800640 1 -- 172.21.15.37:0/799853661 wait complete. 2024-05-30T06:43:14.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:43:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f4607200640 1 Processor -- start 2024-05-30T06:43:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f4607200640 1 -- start start 2024-05-30T06:43:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f4607200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4600155da0 0x7f46000cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f4607200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46000cd440 0x7f460006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f4607200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f460015f310 con 0x7f460006f5a0 2024-05-30T06:43:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f4607200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f46000b4760 con 0x7f46000cd440 2024-05-30T06:43:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f4607200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f460015f5f0 con 0x7f4600155da0 2024-05-30T06:43:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f45ff400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46000cd440 0x7f460006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f4605200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f460006f5a0 0x7f46000cf4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33340/0 (socket says 172.21.15.37:33340) 2024-05-30T06:43:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f4605200640 1 -- 172.21.15.37:0/1323702530 learned_addr learned my addr 172.21.15.37:0/1323702530 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f45ffe00640 1 --2- 172.21.15.37:0/1323702530 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4600155da0 0x7f46000cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f45ff400640 1 -- 172.21.15.37:0/1323702530 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4600155da0 msgr2=0x7f46000cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f45ff400640 1 --2- 172.21.15.37:0/1323702530 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4600155da0 0x7f46000cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f45ff400640 1 -- 172.21.15.37:0/1323702530 >> v1:172.21.15.37:6789/0 conn(0x7f460006f5a0 legacy=0x7f46000cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f45ff400640 1 -- 172.21.15.37:0/1323702530 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460015f8d0 con 0x7f46000cd440 2024-05-30T06:43:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f45ffe00640 1 --2- 172.21.15.37:0/1323702530 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4600155da0 0x7f46000cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:43:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.491+0000 7f45fea00640 1 -- 172.21.15.37:0/1323702530 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747255007 0 0) 0x7f460015f310 con 0x7f460006f5a0 2024-05-30T06:43:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.495+0000 7f45ff400640 1 --2- 172.21.15.37:0/1323702530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46000cd440 0x7f460006f060 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0097c0 tx=0x7f45ec01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb0440811c46517 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.495+0000 7f45fea00640 1 -- 172.21.15.37:0/1323702530 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0b0070 con 0x7f46000cd440 2024-05-30T06:43:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.495+0000 7f45fea00640 1 -- 172.21.15.37:0/1323702530 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec0ab600 con 0x7f46000cd440 2024-05-30T06:43:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.495+0000 7f45fea00640 1 -- 172.21.15.37:0/1323702530 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec0ab9d0 con 0x7f46000cd440 2024-05-30T06:43:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.495+0000 7f4607200640 1 -- 172.21.15.37:0/1323702530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46000cd440 msgr2=0x7f460006f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.495+0000 7f4607200640 1 --2- 172.21.15.37:0/1323702530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46000cd440 0x7f460006f060 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f45ec0097c0 tx=0x7f45ec01c380 comp rx=0 tx=0).stop 2024-05-30T06:43:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.495+0000 7f4607200640 1 -- 172.21.15.37:0/1323702530 shutdown_connections 2024-05-30T06:43:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.495+0000 7f4607200640 1 --2- 172.21.15.37:0/1323702530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46000cd440 0x7f460006f060 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.495+0000 7f4607200640 1 --2- 172.21.15.37:0/1323702530 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4600155da0 0x7f46000cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.495+0000 7f4607200640 1 -- 172.21.15.37:0/1323702530 >> 172.21.15.37:0/1323702530 conn(0x7f460006bf60 msgr2=0x7f46000b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.495+0000 7f4607200640 1 -- 172.21.15.37:0/1323702530 shutdown_connections 2024-05-30T06:43:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.495+0000 7f4607200640 1 -- 172.21.15.37:0/1323702530 wait complete. 2024-05-30T06:43:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.495+0000 7f4607200640 1 Processor -- start 2024-05-30T06:43:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4607200640 1 -- start start 2024-05-30T06:43:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4607200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f460006f5a0 0x7f460014b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4607200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4600155da0 0x7f4600146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4607200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4600147880 0x7f4600071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4607200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4600168580 con 0x7f4600147880 2024-05-30T06:43:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4607200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f460006fa10 con 0x7f4600155da0 2024-05-30T06:43:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4607200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4600168700 con 0x7f460006f5a0 2024-05-30T06:43:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4605200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4600147880 0x7f4600071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4605200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4600147880 0x7f4600071dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55980/0 (socket says 172.21.15.37:55980) 2024-05-30T06:43:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4605200640 1 -- 172.21.15.37:0/1821412854 learned_addr learned my addr 172.21.15.37:0/1821412854 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f45ffe00640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f460006f5a0 0x7f460014b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f45ff400640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4600155da0 0x7f4600146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4605200640 1 -- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f460006f5a0 msgr2=0x7f460014b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4605200640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f460006f5a0 0x7f460014b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4605200640 1 -- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4600155da0 msgr2=0x7f4600146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4605200640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4600155da0 0x7f4600146fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4605200640 1 -- 172.21.15.37:0/1821412854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4600156290 con 0x7f4600147880 2024-05-30T06:43:14.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4605200640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4600147880 0x7f4600071dc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f45f800c7d0 tx=0x7f45f800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:14.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f45f7e00640 1 -- 172.21.15.37:0/1821412854 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8018070 con 0x7f4600147880 2024-05-30T06:43:14.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f45f7e00640 1 -- 172.21.15.37:0/1821412854 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f800a640 con 0x7f4600147880 2024-05-30T06:43:14.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f45f7e00640 1 -- 172.21.15.37:0/1821412854 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f800aa30 con 0x7f4600147880 2024-05-30T06:43:14.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4607200640 1 -- 172.21.15.37:0/1821412854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4600156570 con 0x7f4600147880 2024-05-30T06:43:14.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4607200640 1 -- 172.21.15.37:0/1821412854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4600156b30 con 0x7f4600147880 2024-05-30T06:43:14.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.499+0000 7f4607200640 1 -- 172.21.15.37:0/1821412854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46000b6790 con 0x7f4600147880 2024-05-30T06:43:14.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.503+0000 7f45f7e00640 1 -- 172.21.15.37:0/1821412854 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45f800abd0 con 0x7f4600147880 2024-05-30T06:43:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.503+0000 7f45f7e00640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f45e00683b0 0x7f45e006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.503+0000 7f45f7e00640 1 -- 172.21.15.37:0/1821412854 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f45f80860b0 con 0x7f4600147880 2024-05-30T06:43:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.503+0000 7f45ffe00640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f45e00683b0 0x7f45e006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.503+0000 7f45ffe00640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f45e00683b0 0x7f45e006a870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f45f0006fd0 tx=0x7f45f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.507+0000 7f45f7e00640 1 -- 172.21.15.37:0/1821412854 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f45f80565d0 con 0x7f4600147880 2024-05-30T06:43:14.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.695+0000 7f4607200640 1 -- 172.21.15.37:0/1821412854 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f460014e4b0 con 0x7f45e00683b0 2024-05-30T06:43:14.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.699+0000 7f45f7e00640 1 -- 172.21.15.37:0/1821412854 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f460014e4b0 con 0x7f45e00683b0 2024-05-30T06:43:14.697 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:43:14.697 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:43:14.697 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:43:14.698 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:43:14.698 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:43:14.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.699+0000 7f4607200640 1 -- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f45e00683b0 msgr2=0x7f45e006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:14.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.699+0000 7f4607200640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f45e00683b0 0x7f45e006a870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f45f0006fd0 tx=0x7f45f0008040 comp rx=0 tx=0).stop 2024-05-30T06:43:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.699+0000 7f4607200640 1 -- 172.21.15.37:0/1821412854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4600147880 msgr2=0x7f4600071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.699+0000 7f4607200640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4600147880 0x7f4600071dc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f45f800c7d0 tx=0x7f45f800cc90 comp rx=0 tx=0).stop 2024-05-30T06:43:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.699+0000 7f4607200640 1 -- 172.21.15.37:0/1821412854 shutdown_connections 2024-05-30T06:43:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.699+0000 7f4607200640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4600147880 0x7f4600071dc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.699+0000 7f4607200640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f45e00683b0 0x7f45e006a870 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.699+0000 7f4607200640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4600155da0 0x7f4600146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.699+0000 7f4607200640 1 --2- 172.21.15.37:0/1821412854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f460006f5a0 0x7f460014b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.699+0000 7f4607200640 1 -- 172.21.15.37:0/1821412854 >> 172.21.15.37:0/1821412854 conn(0x7f460006bf60 msgr2=0x7f460015cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.699+0000 7f4607200640 1 -- 172.21.15.37:0/1821412854 shutdown_connections 2024-05-30T06:43:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.699+0000 7f4607200640 1 -- 172.21.15.37:0/1821412854 wait complete. 2024-05-30T06:43:14.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:43:14.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.863+0000 7fcfe1200640 1 Processor -- start 2024-05-30T06:43:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.863+0000 7fcfe1200640 1 -- start start 2024-05-30T06:43:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfe1200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcfdc15c9a0 0x7fcfdc0cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfe1200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcfdc0cffd0 0x7fcfdc0afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfe1200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfdc0af0d0 con 0x7fcfdc0d0600 2024-05-30T06:43:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfe1200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcfdc0ce000 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfe1200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcfdc0ce2e0 con 0x7fcfdc15c9a0 2024-05-30T06:43:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfdbe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcfdc0cffd0 0x7fcfdc0afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfdb400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcfdc0d0600 0x7fcfdc0d09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33354/0 (socket says 172.21.15.37:33354) 2024-05-30T06:43:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfdb400640 1 -- 172.21.15.37:0/3203398391 learned_addr learned my addr 172.21.15.37:0/3203398391 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfd2a00640 1 --2- 172.21.15.37:0/3203398391 >> v2:172.21.15.105:3300/0 conn(0x7fcfdc15c9a0 0x7fcfdc0cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfdaa00640 1 -- 172.21.15.37:0/3203398391 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639110828 0 0) 0x7fcfdc0af0d0 con 0x7fcfdc0d0600 2024-05-30T06:43:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfdaa00640 1 -- 172.21.15.37:0/3203398391 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfc0003530 con 0x7fcfdc0d0600 2024-05-30T06:43:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfdbe00640 1 -- 172.21.15.37:0/3203398391 >> v2:172.21.15.105:3300/0 conn(0x7fcfdc15c9a0 msgr2=0x7fcfdc0cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfdbe00640 1 --2- 172.21.15.37:0/3203398391 >> v2:172.21.15.105:3300/0 conn(0x7fcfdc15c9a0 0x7fcfdc0cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfdbe00640 1 -- 172.21.15.37:0/3203398391 >> v1:172.21.15.37:6789/0 conn(0x7fcfdc0d0600 legacy=0x7fcfdc0d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.867+0000 7fcfdbe00640 1 -- 172.21.15.37:0/3203398391 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfdc0af370 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfdbe00640 1 --2- 172.21.15.37:0/3203398391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc0cffd0 0x7fcfdc0afb70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc073530 tx=0x7fcfd401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f40a62efdc00c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:14.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfdaa00640 1 -- 172.21.15.37:0/3203398391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd40b2070 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfdaa00640 1 -- 172.21.15.37:0/3203398391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd40a58f0 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfdaa00640 1 -- 172.21.15.37:0/3203398391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd40a5ca0 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 -- 172.21.15.37:0/3203398391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc0cffd0 msgr2=0x7fcfdc0afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:14.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 --2- 172.21.15.37:0/3203398391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc0cffd0 0x7fcfdc0afb70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc073530 tx=0x7fcfd401c900 comp rx=0 tx=0).stop 2024-05-30T06:43:14.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 -- 172.21.15.37:0/3203398391 shutdown_connections 2024-05-30T06:43:14.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 --2- 172.21.15.37:0/3203398391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc0cffd0 0x7fcfdc0afb70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 --2- 172.21.15.37:0/3203398391 >> v2:172.21.15.105:3300/0 conn(0x7fcfdc15c9a0 0x7fcfdc0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 -- 172.21.15.37:0/3203398391 >> 172.21.15.37:0/3203398391 conn(0x7fcfdc0b3ef0 msgr2=0x7fcfdc0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:14.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 -- 172.21.15.37:0/3203398391 shutdown_connections 2024-05-30T06:43:14.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 -- 172.21.15.37:0/3203398391 wait complete. 2024-05-30T06:43:14.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 Processor -- start 2024-05-30T06:43:14.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 -- start start 2024-05-30T06:43:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc0cffd0 0x7fcfdc0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc0d0600 0x7fcfdc15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15c9a0 0x7fcfdc0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc0b0c50 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc0b0ad0 con 0x7fcfdc15c9a0 2024-05-30T06:43:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfe1200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcfdc0b0dd0 con 0x7fcfdc0d0600 2024-05-30T06:43:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfdb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc0cffd0 0x7fcfdc0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfdb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc0cffd0 0x7fcfdc0c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56006/0 (socket says 172.21.15.37:56006) 2024-05-30T06:43:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.871+0000 7fcfdb400640 1 -- 172.21.15.37:0/179937789 learned_addr learned my addr 172.21.15.37:0/179937789 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfdbe00640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15c9a0 0x7fcfdc0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfd2a00640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc0d0600 0x7fcfdc15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfdb400640 1 -- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc0d0600 msgr2=0x7fcfdc15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfdb400640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc0d0600 0x7fcfdc15aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfdb400640 1 -- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15c9a0 msgr2=0x7fcfdc0caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfdb400640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15c9a0 0x7fcfdc0caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfdb400640 1 -- 172.21.15.37:0/179937789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfdc0b5020 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfdb400640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc0cffd0 0x7fcfdc0c9ee0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00c3c0 tx=0x7fcfcc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfd3e00640 1 -- 172.21.15.37:0/179937789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc017070 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfd3e00640 1 -- 172.21.15.37:0/179937789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfcc005cf0 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfd3e00640 1 -- 172.21.15.37:0/179937789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0072f0 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfe1200640 1 -- 172.21.15.37:0/179937789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfdc0ca4e0 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfe1200640 1 -- 172.21.15.37:0/179937789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfdc0b52e0 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfe1200640 1 -- 172.21.15.37:0/179937789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfdc068ab0 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfd3e00640 1 -- 172.21.15.37:0/179937789 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcfcc01a070 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfd3e00640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfb8068380 0x7fcfb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:14.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.875+0000 7fcfd3e00640 1 -- 172.21.15.37:0/179937789 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fcfcc085dc0 con 0x7fcfdc0cffd0 2024-05-30T06:43:14.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.879+0000 7fcfd2a00640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfb8068380 0x7fcfb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:14.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.879+0000 7fcfd2a00640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfb8068380 0x7fcfb806a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0a0420 tx=0x7fcfc4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:14.879+0000 7fcfd3e00640 1 -- 172.21.15.37:0/179937789 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcfcc055c90 con 0x7fcfdc0cffd0 2024-05-30T06:43:15.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.046+0000 7fcfe1200640 1 -- 172.21.15.37:0/179937789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fcfdc09aee0 con 0x7fcfdc0cffd0 2024-05-30T06:43:15.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.046+0000 7fcfd3e00640 1 -- 172.21.15.37:0/179937789 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fcfcc059f90 con 0x7fcfdc0cffd0 2024-05-30T06:43:15.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.050+0000 7fcfe1200640 1 -- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfb8068380 msgr2=0x7fcfb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.050+0000 7fcfe1200640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfb8068380 0x7fcfb806a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0a0420 tx=0x7fcfc4009190 comp rx=0 tx=0).stop 2024-05-30T06:43:15.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.050+0000 7fcfe1200640 1 -- 172.21.15.37:0/179937789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc0cffd0 msgr2=0x7fcfdc0c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.050+0000 7fcfe1200640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc0cffd0 0x7fcfdc0c9ee0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00c3c0 tx=0x7fcfcc00c880 comp rx=0 tx=0).stop 2024-05-30T06:43:15.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.050+0000 7fcfe1200640 1 -- 172.21.15.37:0/179937789 shutdown_connections 2024-05-30T06:43:15.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.050+0000 7fcfe1200640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfb8068380 0x7fcfb806a840 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.050+0000 7fcfe1200640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15c9a0 0x7fcfdc0caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.050+0000 7fcfe1200640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc0d0600 0x7fcfdc15aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.050+0000 7fcfe1200640 1 --2- 172.21.15.37:0/179937789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc0cffd0 0x7fcfdc0c9ee0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.050+0000 7fcfe1200640 1 -- 172.21.15.37:0/179937789 >> 172.21.15.37:0/179937789 conn(0x7fcfdc0b3ef0 msgr2=0x7fcfdc071690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:15.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.050+0000 7fcfe1200640 1 -- 172.21.15.37:0/179937789 shutdown_connections 2024-05-30T06:43:15.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.050+0000 7fcfe1200640 1 -- 172.21.15.37:0/179937789 wait complete. 2024-05-30T06:43:15.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T06:43:15.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.214+0000 7f70d4600640 1 Processor -- start 2024-05-30T06:43:15.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.214+0000 7f70d4600640 1 -- start start 2024-05-30T06:43:15.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.214+0000 7f70d4600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0ced10 0x7f70cc06ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:15.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.214+0000 7f70d4600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70cc15d4e0 0x7f70cc0b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:15.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.214+0000 7f70d4600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70cc15db00 con 0x7f70cc0b59d0 2024-05-30T06:43:15.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.214+0000 7f70d4600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f70cc06df50 con 0x7f70cc15d4e0 2024-05-30T06:43:15.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.214+0000 7f70d4600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f70cc0b6370 con 0x7f70cc0ced10 2024-05-30T06:43:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.214+0000 7f70d2600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70cc15d4e0 0x7f70cc0b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.214+0000 7f70d1200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f70cc0b59d0 0x7f70cc15cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33366/0 (socket says 172.21.15.37:33366) 2024-05-30T06:43:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.214+0000 7f70d2600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70cc15d4e0 0x7f70cc0b5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56008/0 (socket says 172.21.15.37:56008) 2024-05-30T06:43:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.214+0000 7f70d1200640 1 -- 172.21.15.37:0/3785483367 learned_addr learned my addr 172.21.15.37:0/3785483367 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:43:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.214+0000 7f70d1c00640 1 --2- 172.21.15.37:0/3785483367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0ced10 0x7f70cc06ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70d2600640 1 -- 172.21.15.37:0/3785483367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0ced10 msgr2=0x7f70cc06ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70d2600640 1 --2- 172.21.15.37:0/3785483367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0ced10 0x7f70cc06ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70d2600640 1 -- 172.21.15.37:0/3785483367 >> v1:172.21.15.37:6789/0 conn(0x7f70cc0b59d0 legacy=0x7f70cc15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70d2600640 1 -- 172.21.15.37:0/3785483367 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc06e180 con 0x7f70cc15d4e0 2024-05-30T06:43:15.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70cbe00640 1 -- 172.21.15.37:0/3785483367 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2580613828 0 0) 0x7f70cc15db00 con 0x7f70cc0b59d0 2024-05-30T06:43:15.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70d2600640 1 --2- 172.21.15.37:0/3785483367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15d4e0 0x7f70cc0b5e30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009d90 tx=0x7f70c401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec0e8f15af7adfa server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:15.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70cbe00640 1 -- 172.21.15.37:0/3785483367 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c40b2070 con 0x7f70cc15d4e0 2024-05-30T06:43:15.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70cbe00640 1 -- 172.21.15.37:0/3785483367 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c40a5940 con 0x7f70cc15d4e0 2024-05-30T06:43:15.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70cbe00640 1 -- 172.21.15.37:0/3785483367 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c40a5d10 con 0x7f70cc15d4e0 2024-05-30T06:43:15.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70d4600640 1 -- 172.21.15.37:0/3785483367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15d4e0 msgr2=0x7f70cc0b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70d4600640 1 --2- 172.21.15.37:0/3785483367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15d4e0 0x7f70cc0b5e30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009d90 tx=0x7f70c401c970 comp rx=0 tx=0).stop 2024-05-30T06:43:15.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70d4600640 1 -- 172.21.15.37:0/3785483367 shutdown_connections 2024-05-30T06:43:15.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70d4600640 1 --2- 172.21.15.37:0/3785483367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15d4e0 0x7f70cc0b5e30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70d4600640 1 --2- 172.21.15.37:0/3785483367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0ced10 0x7f70cc06ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.218+0000 7f70d4600640 1 -- 172.21.15.37:0/3785483367 >> 172.21.15.37:0/3785483367 conn(0x7f70cc06bf60 msgr2=0x7f70cc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:15.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d4600640 1 -- 172.21.15.37:0/3785483367 shutdown_connections 2024-05-30T06:43:15.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d4600640 1 -- 172.21.15.37:0/3785483367 wait complete. 2024-05-30T06:43:15.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d4600640 1 Processor -- start 2024-05-30T06:43:15.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d4600640 1 -- start start 2024-05-30T06:43:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d4600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70cc0b59d0 0x7f70cc1539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d4600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0ced10 0x7f70cc1631a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d4600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15d4e0 0x7f70cc0b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d4600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc15ea50 con 0x7f70cc15d4e0 2024-05-30T06:43:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d4600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc15e8d0 con 0x7f70cc0b59d0 2024-05-30T06:43:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d4600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f70cc163b30 con 0x7f70cc0ced10 2024-05-30T06:43:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d2600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15d4e0 0x7f70cc0b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d2600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15d4e0 0x7f70cc0b1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56018/0 (socket says 172.21.15.37:56018) 2024-05-30T06:43:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d2600640 1 -- 172.21.15.37:0/2498710877 learned_addr learned my addr 172.21.15.37:0/2498710877 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d1200640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0ced10 0x7f70cc1631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d1c00640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70cc0b59d0 0x7f70cc1539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d2600640 1 -- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0ced10 msgr2=0x7f70cc1631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d2600640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0ced10 0x7f70cc1631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d2600640 1 -- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70cc0b59d0 msgr2=0x7f70cc1539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d2600640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70cc0b59d0 0x7f70cc1539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d2600640 1 -- 172.21.15.37:0/2498710877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc163d80 con 0x7f70cc15d4e0 2024-05-30T06:43:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d1200640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0ced10 0x7f70cc1631a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:43:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70d2600640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15d4e0 0x7f70cc0b1450 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f70c40b0040 tx=0x7f70c4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.222+0000 7f70c9600640 1 -- 172.21.15.37:0/2498710877 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c40b2040 con 0x7f70cc15d4e0 2024-05-30T06:43:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.226+0000 7f70c9600640 1 -- 172.21.15.37:0/2498710877 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c40bf070 con 0x7f70cc15d4e0 2024-05-30T06:43:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.226+0000 7f70c9600640 1 -- 172.21.15.37:0/2498710877 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c40b88f0 con 0x7f70cc15d4e0 2024-05-30T06:43:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.226+0000 7f70d4600640 1 -- 172.21.15.37:0/2498710877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70cc164060 con 0x7f70cc15d4e0 2024-05-30T06:43:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.226+0000 7f70d4600640 1 -- 172.21.15.37:0/2498710877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70cc164620 con 0x7f70cc15d4e0 2024-05-30T06:43:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.226+0000 7f70d4600640 1 -- 172.21.15.37:0/2498710877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70cc068d40 con 0x7f70cc15d4e0 2024-05-30T06:43:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.226+0000 7f70c9600640 1 -- 172.21.15.37:0/2498710877 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f70c40b8a90 con 0x7f70cc15d4e0 2024-05-30T06:43:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.226+0000 7f70c9600640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac068380 0x7f70ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.226+0000 7f70c9600640 1 -- 172.21.15.37:0/2498710877 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f70c4121d10 con 0x7f70cc15d4e0 2024-05-30T06:43:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.226+0000 7f70d1c00640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac068380 0x7f70ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.226+0000 7f70d1c00640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac068380 0x7f70ac06a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0b2090 tx=0x7f70c0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.230+0000 7f70c9600640 1 -- 172.21.15.37:0/2498710877 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f70c4127020 con 0x7f70cc15d4e0 2024-05-30T06:43:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.422+0000 7f70d4600640 1 -- 172.21.15.37:0/2498710877 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f70cc153ee0 con 0x7f70ac068380 2024-05-30T06:43:15.428 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:43:15.430+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:43:15.428 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:43:15.430+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:43:15.428 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:43:15.430+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:43:15.429 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:43:15.430+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:43:15.429 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:43:15.430+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:43:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.590+0000 7f70c9600640 1 -- 172.21.15.37:0/2498710877 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f70cc153ee0 con 0x7f70ac068380 2024-05-30T06:43:15.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.594+0000 7f70d4600640 1 -- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac068380 msgr2=0x7f70ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.594+0000 7f70d4600640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac068380 0x7f70ac06a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0b2090 tx=0x7f70c0009190 comp rx=0 tx=0).stop 2024-05-30T06:43:15.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.594+0000 7f70d4600640 1 -- 172.21.15.37:0/2498710877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15d4e0 msgr2=0x7f70cc0b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.594+0000 7f70d4600640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15d4e0 0x7f70cc0b1450 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f70c40b0040 tx=0x7f70c4019710 comp rx=0 tx=0).stop 2024-05-30T06:43:15.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.594+0000 7f70d4600640 1 -- 172.21.15.37:0/2498710877 shutdown_connections 2024-05-30T06:43:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.594+0000 7f70d4600640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70cc15d4e0 0x7f70cc0b1450 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.594+0000 7f70d4600640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70cc0ced10 0x7f70cc1631a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.594+0000 7f70d4600640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac068380 0x7f70ac06a840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.594+0000 7f70d4600640 1 --2- 172.21.15.37:0/2498710877 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70cc0b59d0 0x7f70cc1539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.594+0000 7f70d4600640 1 -- 172.21.15.37:0/2498710877 >> 172.21.15.37:0/2498710877 conn(0x7f70cc06bf60 msgr2=0x7f70cc0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.594+0000 7f70d4600640 1 -- 172.21.15.37:0/2498710877 shutdown_connections 2024-05-30T06:43:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.594+0000 7f70d4600640 1 -- 172.21.15.37:0/2498710877 wait complete. 2024-05-30T06:43:15.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:43:15.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b82a00640 1 Processor -- start 2024-05-30T06:43:15.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b82a00640 1 -- start start 2024-05-30T06:43:15.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b82a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4b7c15e8b0 0x7f4b7c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:15.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b82a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4b7c06d200 0x7f4b7c06d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:15.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b82a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b7c163350 con 0x7f4b7c09aa60 2024-05-30T06:43:15.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b82a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4b7c06db80 con 0x7f4b7c15e8b0 2024-05-30T06:43:15.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b82a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4b7c0cfb30 con 0x7f4b7c06d200 2024-05-30T06:43:15.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b7be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4b7c15e8b0 0x7f4b7c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:15.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b7be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4b7c15e8b0 0x7f4b7c0cf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56026/0 (socket says 172.21.15.37:56026) 2024-05-30T06:43:15.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b7be00640 1 -- 172.21.15.37:0/3948979642 learned_addr learned my addr 172.21.15.37:0/3948979642 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:15.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b73e00640 1 --2- 172.21.15.37:0/3948979642 >> v2:172.21.15.105:3300/0 conn(0x7f4b7c06d200 0x7f4b7c06d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b7be00640 1 -- 172.21.15.37:0/3948979642 >> v2:172.21.15.105:3300/0 conn(0x7f4b7c06d200 msgr2=0x7f4b7c06d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:43:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b7be00640 1 --2- 172.21.15.37:0/3948979642 >> v2:172.21.15.105:3300/0 conn(0x7f4b7c06d200 0x7f4b7c06d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b7be00640 1 -- 172.21.15.37:0/3948979642 >> v1:172.21.15.37:6789/0 conn(0x7f4b7c09aa60 legacy=0x7f4b7c09ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b7b400640 1 -- 172.21.15.37:0/3948979642 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3712951357 0 0) 0x7f4b7c163350 con 0x7f4b7c09aa60 2024-05-30T06:43:15.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.758+0000 7f4b7be00640 1 -- 172.21.15.37:0/3948979642 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7c1627d0 con 0x7f4b7c15e8b0 2024-05-30T06:43:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.762+0000 7f4b7be00640 1 --2- 172.21.15.37:0/3948979642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b7c15e8b0 0x7f4b7c0cf5f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0d25b0 tx=0x7f4b6c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8613f41377acdd36 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.762+0000 7f4b7b400640 1 -- 172.21.15.37:0/3948979642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0ab610 con 0x7f4b7c15e8b0 2024-05-30T06:43:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.762+0000 7f4b7b400640 1 -- 172.21.15.37:0/3948979642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6c0b0070 con 0x7f4b7c15e8b0 2024-05-30T06:43:15.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.762+0000 7f4b7b400640 1 -- 172.21.15.37:0/3948979642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0ab9d0 con 0x7f4b7c15e8b0 2024-05-30T06:43:15.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.762+0000 7f4b82a00640 1 -- 172.21.15.37:0/3948979642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b7c15e8b0 msgr2=0x7f4b7c0cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.762+0000 7f4b82a00640 1 --2- 172.21.15.37:0/3948979642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b7c15e8b0 0x7f4b7c0cf5f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0d25b0 tx=0x7f4b6c01c520 comp rx=0 tx=0).stop 2024-05-30T06:43:15.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.762+0000 7f4b82a00640 1 -- 172.21.15.37:0/3948979642 shutdown_connections 2024-05-30T06:43:15.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.762+0000 7f4b82a00640 1 --2- 172.21.15.37:0/3948979642 >> v2:172.21.15.105:3300/0 conn(0x7f4b7c06d200 0x7f4b7c06d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.762+0000 7f4b82a00640 1 --2- 172.21.15.37:0/3948979642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b7c15e8b0 0x7f4b7c0cf5f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.762+0000 7f4b82a00640 1 -- 172.21.15.37:0/3948979642 >> 172.21.15.37:0/3948979642 conn(0x7f4b7c0b4130 msgr2=0x7f4b7c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:15.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.762+0000 7f4b82a00640 1 -- 172.21.15.37:0/3948979642 shutdown_connections 2024-05-30T06:43:15.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.762+0000 7f4b82a00640 1 -- 172.21.15.37:0/3948979642 wait complete. 2024-05-30T06:43:15.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b82a00640 1 Processor -- start 2024-05-30T06:43:15.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b82a00640 1 -- start start 2024-05-30T06:43:15.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b82a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b7c06d200 0x7f4b7c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:15.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b82a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b7c09aa60 0x7f4b7c0b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:15.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b82a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b7c15e8b0 0x7f4b7c14c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:15.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b82a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c162480 con 0x7f4b7c06d200 2024-05-30T06:43:15.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b82a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c15ec90 con 0x7f4b7c15e8b0 2024-05-30T06:43:15.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b82a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c0cf050 con 0x7f4b7c09aa60 2024-05-30T06:43:15.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b7be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b7c06d200 0x7f4b7c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:15.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b7be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b7c06d200 0x7f4b7c0b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56036/0 (socket says 172.21.15.37:56036) 2024-05-30T06:43:15.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b7be00640 1 -- 172.21.15.37:0/3727744614 learned_addr learned my addr 172.21.15.37:0/3727744614 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:43:15.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b7be00640 1 -- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b7c09aa60 msgr2=0x7f4b7c0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b7be00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b7c09aa60 0x7f4b7c0b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b7be00640 1 -- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b7c15e8b0 msgr2=0x7f4b7c14c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b80a00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b7c15e8b0 0x7f4b7c14c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:15.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b7be00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b7c15e8b0 0x7f4b7c14c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b7be00640 1 -- 172.21.15.37:0/3727744614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7c0b1e80 con 0x7f4b7c06d200 2024-05-30T06:43:15.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b80a00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b7c15e8b0 0x7f4b7c14c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:43:15.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b7be00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b7c06d200 0x7f4b7c0b3aa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0ad040 tx=0x7f4b6c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:15.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b78c00640 1 -- 172.21.15.37:0/3727744614 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0be5f0 con 0x7f4b7c06d200 2024-05-30T06:43:15.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b78c00640 1 -- 172.21.15.37:0/3727744614 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6c0be790 con 0x7f4b7c06d200 2024-05-30T06:43:15.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b78c00640 1 -- 172.21.15.37:0/3727744614 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0beb60 con 0x7f4b7c06d200 2024-05-30T06:43:15.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b82a00640 1 -- 172.21.15.37:0/3727744614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b7c0b2160 con 0x7f4b7c06d200 2024-05-30T06:43:15.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b82a00640 1 -- 172.21.15.37:0/3727744614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b7c14dc20 con 0x7f4b7c06d200 2024-05-30T06:43:15.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.766+0000 7f4b82a00640 1 -- 172.21.15.37:0/3727744614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b7c068bc0 con 0x7f4b7c06d200 2024-05-30T06:43:15.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.770+0000 7f4b78c00640 1 -- 172.21.15.37:0/3727744614 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4b6c0b43f0 con 0x7f4b7c06d200 2024-05-30T06:43:15.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.770+0000 7f4b78c00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b58068380 0x7f4b5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:43:15.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.770+0000 7f4b78c00640 1 -- 172.21.15.37:0/3727744614 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4b6c121360 con 0x7f4b7c06d200 2024-05-30T06:43:15.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.770+0000 7f4b73e00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b58068380 0x7f4b5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:43:15.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.770+0000 7f4b73e00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b58068380 0x7f4b5806a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c1526f0 tx=0x7f4b64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:43:15.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.774+0000 7f4b78c00640 1 -- 172.21.15.37:0/3727744614 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4b6c0a8050 con 0x7f4b7c06d200 2024-05-30T06:43:15.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.966+0000 7f4b82a00640 1 -- 172.21.15.37:0/3727744614 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f4b7c0b1c30 con 0x7f4b58068380 2024-05-30T06:43:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.974+0000 7f4b78c00640 1 -- 172.21.15.37:0/3727744614 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f4b7c0b1c30 con 0x7f4b58068380 2024-05-30T06:43:15.973 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb 2024-05-30T06:43:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.974+0000 7f4b82a00640 1 -- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b58068380 msgr2=0x7f4b5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.974+0000 7f4b82a00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b58068380 0x7f4b5806a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c1526f0 tx=0x7f4b64008040 comp rx=0 tx=0).stop 2024-05-30T06:43:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.974+0000 7f4b82a00640 1 -- 172.21.15.37:0/3727744614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b7c06d200 msgr2=0x7f4b7c0b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:43:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.974+0000 7f4b82a00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b7c06d200 0x7f4b7c0b3aa0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0ad040 tx=0x7f4b6c01ad60 comp rx=0 tx=0).stop 2024-05-30T06:43:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.974+0000 7f4b82a00640 1 -- 172.21.15.37:0/3727744614 shutdown_connections 2024-05-30T06:43:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.974+0000 7f4b82a00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b58068380 0x7f4b5806a840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.974+0000 7f4b82a00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b7c15e8b0 0x7f4b7c14c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.974+0000 7f4b82a00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b7c09aa60 0x7f4b7c0b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.974+0000 7f4b82a00640 1 --2- 172.21.15.37:0/3727744614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b7c06d200 0x7f4b7c0b3aa0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:43:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.974+0000 7f4b82a00640 1 -- 172.21.15.37:0/3727744614 >> 172.21.15.37:0/3727744614 conn(0x7f4b7c0b4130 msgr2=0x7f4b7c152be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:43:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.974+0000 7f4b82a00640 1 -- 172.21.15.37:0/3727744614 shutdown_connections 2024-05-30T06:43:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:43:15.974+0000 7f4b82a00640 1 -- 172.21.15.37:0/3727744614 wait complete. 2024-05-30T06:43:15.995 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 10 files each 1024MB size under directory volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb 2024-05-30T06:43:15.995 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:43:15.995 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:43:16.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:43:16.004 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:43:24.558 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:43:24.558 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:43:24.558 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.49372 s, 126 MB/s 2024-05-30T06:43:24.559 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:43:24.559 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:43:24.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:43:24.568 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:43:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:43:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:43:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.37136 s, 128 MB/s 2024-05-30T06:43:32.994 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:43:32.994 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:43:33.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:43:33.003 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:43:33.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:43:33.873 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:43:41.727 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:43:41.727 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:43:41.727 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.67407 s, 124 MB/s 2024-05-30T06:43:41.729 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:43:41.729 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:43:41.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:43:41.739 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb/subvolume_file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:43:50.283 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:43:50.283 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:43:50.283 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.49292 s, 126 MB/s 2024-05-30T06:43:50.284 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:43:50.284 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:43:50.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:43:50.293 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb/subvolume_file.4 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:43:58.815 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:43:58.816 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:43:58.816 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.46912 s, 127 MB/s 2024-05-30T06:43:58.818 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:43:58.818 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:43:58.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:43:58.832 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb/subvolume_file.5 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:44:03.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:44:03.930 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:44:07.622 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:44:07.623 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:44:07.623 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.73463 s, 123 MB/s 2024-05-30T06:44:07.623 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:44:07.623 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:44:07.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:44:07.632 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb/subvolume_file.6 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:44:16.483 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:44:16.483 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:44:16.483 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.79729 s, 122 MB/s 2024-05-30T06:44:16.484 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:44:16.484 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:44:16.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:44:16.494 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb/subvolume_file.7 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:44:25.052 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:44:25.052 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:44:25.052 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.50716 s, 126 MB/s 2024-05-30T06:44:25.053 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:44:25.054 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:44:25.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:44:25.063 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb/subvolume_file.8 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:44:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:44:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:44:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.76166 s, 123 MB/s 2024-05-30T06:44:33.876 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:44:33.876 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:44:33.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:44:33.886 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb/subvolume_file.9 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:44:33.982 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:44:33.985 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:44:42.265 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:44:42.265 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:44:42.265 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.32785 s, 129 MB/s 2024-05-30T06:44:42.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T06:44:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff622600640 1 Processor -- start 2024-05-30T06:44:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff622600640 1 -- start start 2024-05-30T06:44:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff622600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff61c15eac0 0x7ff61c15eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff622600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61c072a80 0x7ff61c06ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff622600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61c15f720 con 0x7ff61c0731d0 2024-05-30T06:44:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff622600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff61c15ffc0 con 0x7ff61c15eac0 2024-05-30T06:44:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff622600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff61c15fa00 con 0x7ff61c072a80 2024-05-30T06:44:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff613e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff61c0731d0 0x7ff61c072370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:56242/0 (socket says 172.21.15.37:56242) 2024-05-30T06:44:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff613e00640 1 -- 172.21.15.37:0/969519669 learned_addr learned my addr 172.21.15.37:0/969519669 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:44:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff61b400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff61c15eac0 0x7ff61c15eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff61be00640 1 --2- 172.21.15.37:0/969519669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61c072a80 0x7ff61c06ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff61aa00640 1 -- 172.21.15.37:0/969519669 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411747088 0 0) 0x7ff61c15f720 con 0x7ff61c0731d0 2024-05-30T06:44:42.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff61aa00640 1 -- 172.21.15.37:0/969519669 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff600003530 con 0x7ff61c0731d0 2024-05-30T06:44:42.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff61b400640 1 -- 172.21.15.37:0/969519669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61c072a80 msgr2=0x7ff61c06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:44:42.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff61b400640 1 --2- 172.21.15.37:0/969519669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61c072a80 0x7ff61c06ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:42.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff61b400640 1 -- 172.21.15.37:0/969519669 >> v1:172.21.15.105:6789/0 conn(0x7ff61c0731d0 legacy=0x7ff61c072370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:42.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff61b400640 1 -- 172.21.15.37:0/969519669 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c15fce0 con 0x7ff61c15eac0 2024-05-30T06:44:42.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.418+0000 7ff61be00640 1 --2- 172.21.15.37:0/969519669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61c072a80 0x7ff61c06ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:44:42.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.422+0000 7ff61b400640 1 --2- 172.21.15.37:0/969519669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff61c15eac0 0x7ff61c15eea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0097c0 tx=0x7ff60c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a62238e78905a105 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:42.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.422+0000 7ff61aa00640 1 -- 172.21.15.37:0/969519669 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0ab650 con 0x7ff61c15eac0 2024-05-30T06:44:42.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.422+0000 7ff61aa00640 1 -- 172.21.15.37:0/969519669 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c0b0070 con 0x7ff61c15eac0 2024-05-30T06:44:42.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.422+0000 7ff61aa00640 1 -- 172.21.15.37:0/969519669 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0ab9f0 con 0x7ff61c15eac0 2024-05-30T06:44:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.422+0000 7ff622600640 1 -- 172.21.15.37:0/969519669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff61c15eac0 msgr2=0x7ff61c15eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.422+0000 7ff622600640 1 --2- 172.21.15.37:0/969519669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff61c15eac0 0x7ff61c15eea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0097c0 tx=0x7ff60c01c470 comp rx=0 tx=0).stop 2024-05-30T06:44:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.422+0000 7ff622600640 1 -- 172.21.15.37:0/969519669 shutdown_connections 2024-05-30T06:44:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.422+0000 7ff622600640 1 --2- 172.21.15.37:0/969519669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61c072a80 0x7ff61c06ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.422+0000 7ff622600640 1 --2- 172.21.15.37:0/969519669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff61c15eac0 0x7ff61c15eea0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.422+0000 7ff622600640 1 -- 172.21.15.37:0/969519669 >> 172.21.15.37:0/969519669 conn(0x7ff61c0d09a0 msgr2=0x7ff61c0d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.422+0000 7ff622600640 1 -- 172.21.15.37:0/969519669 shutdown_connections 2024-05-30T06:44:42.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.422+0000 7ff622600640 1 -- 172.21.15.37:0/969519669 wait complete. 2024-05-30T06:44:42.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff622600640 1 Processor -- start 2024-05-30T06:44:42.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff622600640 1 -- start start 2024-05-30T06:44:42.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff622600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61c072a80 0x7ff61c0cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:42.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff622600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff61c0731d0 0x7ff61c14ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:42.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff622600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c15eac0 0x7ff61c156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:42.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff622600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c06f960 con 0x7ff61c15eac0 2024-05-30T06:44:42.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff622600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff61c06f7e0 con 0x7ff61c0731d0 2024-05-30T06:44:42.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff622600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff61c06fae0 con 0x7ff61c072a80 2024-05-30T06:44:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff61b400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61c072a80 0x7ff61c0cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff61be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c15eac0 0x7ff61c156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff61b400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61c072a80 0x7ff61c0cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:54164/0 (socket says 172.21.15.37:54164) 2024-05-30T06:44:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff61b400640 1 -- 172.21.15.37:0/2771740947 learned_addr learned my addr 172.21.15.37:0/2771740947 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff61be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c15eac0 0x7ff61c156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42326/0 (socket says 172.21.15.37:42326) 2024-05-30T06:44:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff613e00640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff61c0731d0 0x7ff61c14ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff61b400640 1 -- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff61c0731d0 msgr2=0x7ff61c14ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff61b400640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff61c0731d0 0x7ff61c14ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff61b400640 1 -- 172.21.15.37:0/2771740947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c15eac0 msgr2=0x7ff61c156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff61b400640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c15eac0 0x7ff61c156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff61b400640 1 -- 172.21.15.37:0/2771740947 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c156070 con 0x7ff61c072a80 2024-05-30T06:44:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff61be00640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c15eac0 0x7ff61c156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:44:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff61b400640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61c072a80 0x7ff61c0cfd10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0ad040 tx=0x7ff60c01acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff613400640 1 -- 172.21.15.37:0/2771740947 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c006e20 con 0x7ff61c072a80 2024-05-30T06:44:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff613400640 1 -- 172.21.15.37:0/2771740947 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c0bf610 con 0x7ff61c072a80 2024-05-30T06:44:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff622600640 1 -- 172.21.15.37:0/2771740947 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61c1554f0 con 0x7ff61c072a80 2024-05-30T06:44:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff613400640 1 -- 172.21.15.37:0/2771740947 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0bf9c0 con 0x7ff61c072a80 2024-05-30T06:44:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff622600640 1 -- 172.21.15.37:0/2771740947 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff61c155ab0 con 0x7ff61c072a80 2024-05-30T06:44:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.426+0000 7ff622600640 1 -- 172.21.15.37:0/2771740947 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61c068d40 con 0x7ff61c072a80 2024-05-30T06:44:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.430+0000 7ff613400640 1 -- 172.21.15.37:0/2771740947 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 7) ==== 87987+0+0 (secure 0 0 0) 0x7ff60c0bd020 con 0x7ff61c072a80 2024-05-30T06:44:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.430+0000 7ff613400640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff5f8068380 0x7ff5f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.430+0000 7ff613400640 1 -- 172.21.15.37:0/2771740947 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff60c1213e0 con 0x7ff61c072a80 2024-05-30T06:44:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.430+0000 7ff613e00640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff5f8068380 0x7ff5f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:42.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.430+0000 7ff613e00640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff5f8068380 0x7ff5f806a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff604007fd0 tx=0x7ff604009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:42.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.434+0000 7ff613400640 1 -- 172.21.15.37:0/2771740947 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff60c016090 con 0x7ff61c072a80 2024-05-30T06:44:42.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.630+0000 7ff622600640 1 -- 172.21.15.37:0/2771740947 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7ff61c0d1550 con 0x7ff5f8068380 2024-05-30T06:44:42.637 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:42.636+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:42.637 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:42.636+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:42.637 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:42.636+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:42.637 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:42.636+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:42.637 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:42.636+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.662+0000 7ff613400640 1 -- 172.21.15.37:0/2771740947 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff61c0d1550 con 0x7ff5f8068380 2024-05-30T06:44:42.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.662+0000 7ff622600640 1 -- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff5f8068380 msgr2=0x7ff5f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:42.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.662+0000 7ff622600640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff5f8068380 0x7ff5f806a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff604007fd0 tx=0x7ff604009040 comp rx=0 tx=0).stop 2024-05-30T06:44:42.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.666+0000 7ff622600640 1 -- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61c072a80 msgr2=0x7ff61c0cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:42.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.666+0000 7ff622600640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61c072a80 0x7ff61c0cfd10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0ad040 tx=0x7ff60c01acb0 comp rx=0 tx=0).stop 2024-05-30T06:44:42.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.666+0000 7ff622600640 1 -- 172.21.15.37:0/2771740947 shutdown_connections 2024-05-30T06:44:42.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.666+0000 7ff622600640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff61c15eac0 0x7ff61c156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:42.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.666+0000 7ff622600640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff5f8068380 0x7ff5f806a840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:42.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.666+0000 7ff622600640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff61c0731d0 0x7ff61c14ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:42.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.666+0000 7ff622600640 1 --2- 172.21.15.37:0/2771740947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61c072a80 0x7ff61c0cfd10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:42.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.666+0000 7ff622600640 1 -- 172.21.15.37:0/2771740947 >> 172.21.15.37:0/2771740947 conn(0x7ff61c0d09a0 msgr2=0x7ff61c0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:42.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.666+0000 7ff622600640 1 -- 172.21.15.37:0/2771740947 shutdown_connections 2024-05-30T06:44:42.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.666+0000 7ff622600640 1 -- 172.21.15.37:0/2771740947 wait complete. 2024-05-30T06:44:42.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:44:42.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.830+0000 7f4f85600640 1 Processor -- start 2024-05-30T06:44:42.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.830+0000 7f4f85600640 1 -- start start 2024-05-30T06:44:42.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.834+0000 7f4f85600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f800d2fa0 0x7f4f800d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:42.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.834+0000 7f4f85600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f800d14c0 con 0x7f4f8006e750 2024-05-30T06:44:42.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.834+0000 7f4f85600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f8006cba0 con 0x7f4f8009aa60 2024-05-30T06:44:42.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.834+0000 7f4f85600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4f800d21c0 con 0x7f4f800d2fa0 2024-05-30T06:44:42.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.834+0000 7f4f77400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f800d2fa0 0x7f4f800d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:42.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.834+0000 7f4f84c00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4f8006e750 0x7f4f800af350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43034/0 (socket says 172.21.15.37:43034) 2024-05-30T06:44:42.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.834+0000 7f4f84c00640 1 -- 172.21.15.37:0/293661954 learned_addr learned my addr 172.21.15.37:0/293661954 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:44:42.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.834+0000 7f4f77400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f800d2fa0 0x7f4f800d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42330/0 (socket says 172.21.15.37:42330) 2024-05-30T06:44:42.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.834+0000 7f4f77400640 1 -- 172.21.15.37:0/293661954 >> v1:172.21.15.105:6789/0 conn(0x7f4f8009aa60 legacy=0x7f4f8009ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:42.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.834+0000 7f4f77400640 1 -- 172.21.15.37:0/293661954 >> v1:172.21.15.37:6789/0 conn(0x7f4f8006e750 legacy=0x7f4f800af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:42.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.834+0000 7f4f77400640 1 -- 172.21.15.37:0/293661954 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f8006ce80 con 0x7f4f800d2fa0 2024-05-30T06:44:42.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.834+0000 7f4f77400640 1 --2- 172.21.15.37:0/293661954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f800d2fa0 0x7f4f800d1c80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4f680097c0 tx=0x7f4f6801c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8394e3313c45e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:42.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f7f400640 1 -- 172.21.15.37:0/293661954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f680b0070 con 0x7f4f800d2fa0 2024-05-30T06:44:42.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f7f400640 1 -- 172.21.15.37:0/293661954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f680ab600 con 0x7f4f800d2fa0 2024-05-30T06:44:42.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f7f400640 1 -- 172.21.15.37:0/293661954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f680ab9d0 con 0x7f4f800d2fa0 2024-05-30T06:44:42.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 -- 172.21.15.37:0/293661954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f800d2fa0 msgr2=0x7f4f800d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 --2- 172.21.15.37:0/293661954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f800d2fa0 0x7f4f800d1c80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4f680097c0 tx=0x7f4f6801c350 comp rx=0 tx=0).stop 2024-05-30T06:44:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 -- 172.21.15.37:0/293661954 shutdown_connections 2024-05-30T06:44:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 --2- 172.21.15.37:0/293661954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f800d2fa0 0x7f4f800d1c80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 -- 172.21.15.37:0/293661954 >> 172.21.15.37:0/293661954 conn(0x7f4f800d2480 msgr2=0x7f4f800d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 -- 172.21.15.37:0/293661954 shutdown_connections 2024-05-30T06:44:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 -- 172.21.15.37:0/293661954 wait complete. 2024-05-30T06:44:42.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 Processor -- start 2024-05-30T06:44:42.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 -- start start 2024-05-30T06:44:42.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f8006e750 0x7f4f8014efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:42.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f8009aa60 0x7f4f80155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f800d2fa0 0x7f4f8015c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8016c940 con 0x7f4f8009aa60 2024-05-30T06:44:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4f800afe70 con 0x7f4f8006e750 2024-05-30T06:44:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f85600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4f8016cac0 con 0x7f4f800d2fa0 2024-05-30T06:44:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f77400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f8009aa60 0x7f4f80155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f77400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f8009aa60 0x7f4f80155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42334/0 (socket says 172.21.15.37:42334) 2024-05-30T06:44:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f77400640 1 -- 172.21.15.37:0/3940548944 learned_addr learned my addr 172.21.15.37:0/3940548944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f7fe00640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f8006e750 0x7f4f8014efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.838+0000 7f4f84c00640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f800d2fa0 0x7f4f8015c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f77400640 1 -- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f800d2fa0 msgr2=0x7f4f8015c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f77400640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f800d2fa0 0x7f4f8015c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f77400640 1 -- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f8006e750 msgr2=0x7f4f8014efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:42.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f77400640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f8006e750 0x7f4f8014efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:42.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f77400640 1 -- 172.21.15.37:0/3940548944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f8014f500 con 0x7f4f8009aa60 2024-05-30T06:44:42.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f77400640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f8009aa60 0x7f4f80155880 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4f680097c0 tx=0x7f4f680190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:42.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f7cc00640 1 -- 172.21.15.37:0/3940548944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f680ba020 con 0x7f4f8009aa60 2024-05-30T06:44:42.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f7cc00640 1 -- 172.21.15.37:0/3940548944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f680b4620 con 0x7f4f8009aa60 2024-05-30T06:44:42.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f7cc00640 1 -- 172.21.15.37:0/3940548944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f680b0040 con 0x7f4f8009aa60 2024-05-30T06:44:42.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f85600640 1 -- 172.21.15.37:0/3940548944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f80152ad0 con 0x7f4f8009aa60 2024-05-30T06:44:42.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f85600640 1 -- 172.21.15.37:0/3940548944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f80153090 con 0x7f4f8009aa60 2024-05-30T06:44:42.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f85600640 1 -- 172.21.15.37:0/3940548944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f80068ab0 con 0x7f4f8009aa60 2024-05-30T06:44:42.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f7cc00640 1 -- 172.21.15.37:0/3940548944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 88038+0+0 (secure 0 0 0) 0x7f4f680bd020 con 0x7f4f8009aa60 2024-05-30T06:44:42.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.842+0000 7f4f7cc00640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f5c068410 0x7f4f5c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:42.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.846+0000 7f4f7cc00640 1 -- 172.21.15.37:0/3940548944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4f68120a80 con 0x7f4f8009aa60 2024-05-30T06:44:42.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.846+0000 7f4f7fe00640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f5c068410 0x7f4f5c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:42.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.846+0000 7f4f7fe00640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f5c068410 0x7f4f5c06a8d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4f80156260 tx=0x7f4f70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:42.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:42.850+0000 7f4f7cc00640 1 -- 172.21.15.37:0/3940548944 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4f68122e20 con 0x7f4f8009aa60 2024-05-30T06:44:43.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.038+0000 7f4f85600640 1 -- 172.21.15.37:0/3940548944 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f4f800b1730 con 0x7f4f5c068410 2024-05-30T06:44:43.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.046+0000 7f4f7cc00640 1 -- 172.21.15.37:0/3940548944 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f4f800b1730 con 0x7f4f5c068410 2024-05-30T06:44:43.046 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb 2024-05-30T06:44:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.046+0000 7f4f85600640 1 -- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f5c068410 msgr2=0x7f4f5c06a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.046+0000 7f4f85600640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f5c068410 0x7f4f5c06a8d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4f80156260 tx=0x7f4f70009040 comp rx=0 tx=0).stop 2024-05-30T06:44:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.046+0000 7f4f85600640 1 -- 172.21.15.37:0/3940548944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f8009aa60 msgr2=0x7f4f80155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.046+0000 7f4f85600640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f8009aa60 0x7f4f80155880 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4f680097c0 tx=0x7f4f680190f0 comp rx=0 tx=0).stop 2024-05-30T06:44:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.046+0000 7f4f85600640 1 -- 172.21.15.37:0/3940548944 shutdown_connections 2024-05-30T06:44:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.046+0000 7f4f85600640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f800d2fa0 0x7f4f8015c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.046+0000 7f4f85600640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f8009aa60 0x7f4f80155880 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.046+0000 7f4f85600640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f5c068410 0x7f4f5c06a8d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.046+0000 7f4f85600640 1 --2- 172.21.15.37:0/3940548944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f8006e750 0x7f4f8014efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.046+0000 7f4f85600640 1 -- 172.21.15.37:0/3940548944 >> 172.21.15.37:0/3940548944 conn(0x7f4f800d2480 msgr2=0x7f4f80070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.046+0000 7f4f85600640 1 -- 172.21.15.37:0/3940548944 shutdown_connections 2024-05-30T06:44:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:43.046+0000 7f4f85600640 1 -- 172.21.15.37:0/3940548944 wait complete. 2024-05-30T06:44:43.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:44:43.067 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb 2024-05-30T06:44:43.067 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:44:43.076 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb 2024-05-30T06:44:43.076 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="10488365056" 2024-05-30T06:44:43.076 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:44:43.077 INFO:tasks.cephfs.test_volumes:r_size = 10488365056 exp_size = 10737418240 2024-05-30T06:44:45.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:44:45.079 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb 2024-05-30T06:44:45.079 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:44:45.089 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/a3b2fcc8-4519-4200-be64-6ee3cdd25acb 2024-05-30T06:44:45.090 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="10737418240" 2024-05-30T06:44:45.090 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:44:45.090 INFO:tasks.cephfs.test_volumes:r_size = 10737418240 exp_size = 10737418240 2024-05-30T06:44:45.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-05-30T06:44:45.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94ca800640 1 Processor -- start 2024-05-30T06:44:45.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94ca800640 1 -- start start 2024-05-30T06:44:45.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94ca800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40cfeb0 0x7f94c40afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:45.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94ca800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f94c40b36c0 0x7f94c4162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:45.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94ca800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94c40b5f70 con 0x7f94c41629d0 2024-05-30T06:44:45.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94ca800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f94c4162de0 con 0x7f94c40b36c0 2024-05-30T06:44:45.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94ca800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f94c40b67a0 con 0x7f94c40cfeb0 2024-05-30T06:44:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94c3400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40cfeb0 0x7f94c40afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94baa00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f94c40b36c0 0x7f94c4162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94c3e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f94c41629d0 0x7f94c4147680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:56266/0 (socket says 172.21.15.37:56266) 2024-05-30T06:44:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94c3e00640 1 -- 172.21.15.37:0/610095580 learned_addr learned my addr 172.21.15.37:0/610095580 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:44:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94c3400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40cfeb0 0x7f94c40afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:54188/0 (socket says 172.21.15.37:54188) 2024-05-30T06:44:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94c2a00640 1 -- 172.21.15.37:0/610095580 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1161829302 0 0) 0x7f94c40b5f70 con 0x7f94c41629d0 2024-05-30T06:44:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94c2a00640 1 -- 172.21.15.37:0/610095580 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94a8003530 con 0x7f94c41629d0 2024-05-30T06:44:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94c3400640 1 -- 172.21.15.37:0/610095580 >> v2:172.21.15.105:3300/0 conn(0x7f94c40b36c0 msgr2=0x7f94c4162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:44:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94c3400640 1 --2- 172.21.15.37:0/610095580 >> v2:172.21.15.105:3300/0 conn(0x7f94c40b36c0 0x7f94c4162490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94c3400640 1 -- 172.21.15.37:0/610095580 >> v1:172.21.15.105:6789/0 conn(0x7f94c41629d0 legacy=0x7f94c4147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:45.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94c3400640 1 -- 172.21.15.37:0/610095580 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c40b3b20 con 0x7f94c40cfeb0 2024-05-30T06:44:45.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.289+0000 7f94baa00640 1 --2- 172.21.15.37:0/610095580 >> v2:172.21.15.105:3300/0 conn(0x7f94c40b36c0 0x7f94c4162490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:44:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.293+0000 7f94c3400640 1 --2- 172.21.15.37:0/610095580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40cfeb0 0x7f94c40afcf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94b40097c0 tx=0x7f94b401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3e0c45ba376ee5c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.293+0000 7f94c2a00640 1 -- 172.21.15.37:0/610095580 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b40b0070 con 0x7f94c40cfeb0 2024-05-30T06:44:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.293+0000 7f94c2a00640 1 -- 172.21.15.37:0/610095580 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b40ab600 con 0x7f94c40cfeb0 2024-05-30T06:44:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.293+0000 7f94c2a00640 1 -- 172.21.15.37:0/610095580 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b40ab9d0 con 0x7f94c40cfeb0 2024-05-30T06:44:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.293+0000 7f94ca800640 1 -- 172.21.15.37:0/610095580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40cfeb0 msgr2=0x7f94c40afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.293+0000 7f94ca800640 1 --2- 172.21.15.37:0/610095580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40cfeb0 0x7f94c40afcf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f94b40097c0 tx=0x7f94b401c410 comp rx=0 tx=0).stop 2024-05-30T06:44:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.293+0000 7f94ca800640 1 -- 172.21.15.37:0/610095580 shutdown_connections 2024-05-30T06:44:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.293+0000 7f94ca800640 1 --2- 172.21.15.37:0/610095580 >> v2:172.21.15.105:3300/0 conn(0x7f94c40b36c0 0x7f94c4162490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.293+0000 7f94ca800640 1 --2- 172.21.15.37:0/610095580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40cfeb0 0x7f94c40afcf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.293+0000 7f94ca800640 1 -- 172.21.15.37:0/610095580 >> 172.21.15.37:0/610095580 conn(0x7f94c406bf60 msgr2=0x7f94c40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.293+0000 7f94ca800640 1 -- 172.21.15.37:0/610095580 shutdown_connections 2024-05-30T06:44:45.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.293+0000 7f94ca800640 1 -- 172.21.15.37:0/610095580 wait complete. 2024-05-30T06:44:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94ca800640 1 Processor -- start 2024-05-30T06:44:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94ca800640 1 -- start start 2024-05-30T06:44:45.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94ca800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40b36c0 0x7f94c4142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:45.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94ca800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40cfeb0 0x7f94c40aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:45.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94ca800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c41629d0 0x7f94c4135c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:45.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94ca800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f94c40ae290 con 0x7f94c41629d0 2024-05-30T06:44:45.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94ca800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f94c40ae110 con 0x7f94c40b36c0 2024-05-30T06:44:45.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94ca800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f94c40ae410 con 0x7f94c40cfeb0 2024-05-30T06:44:45.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94c3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c41629d0 0x7f94c4135c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94c3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c41629d0 0x7f94c4135c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42336/0 (socket says 172.21.15.37:42336) 2024-05-30T06:44:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94c3e00640 1 -- 172.21.15.37:0/1063472064 learned_addr learned my addr 172.21.15.37:0/1063472064 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94baa00640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40cfeb0 0x7f94c40aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94c3400640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40b36c0 0x7f94c4142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94c3e00640 1 -- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40cfeb0 msgr2=0x7f94c40aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94c3e00640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40cfeb0 0x7f94c40aeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94c3e00640 1 -- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40b36c0 msgr2=0x7f94c4142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94c3e00640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40b36c0 0x7f94c4142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94c3e00640 1 -- 172.21.15.37:0/1063472064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94c413e450 con 0x7f94c41629d0 2024-05-30T06:44:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94c3400640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40b36c0 0x7f94c4142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:44:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94c3e00640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c41629d0 0x7f94c4135c50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00caa0 tx=0x7f94bc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94bbe00640 1 -- 172.21.15.37:0/1063472064 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc017070 con 0x7f94c41629d0 2024-05-30T06:44:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94bbe00640 1 -- 172.21.15.37:0/1063472064 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94bc00ac00 con 0x7f94c41629d0 2024-05-30T06:44:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94ca800640 1 -- 172.21.15.37:0/1063472064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c413e6f0 con 0x7f94c41629d0 2024-05-30T06:44:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94bbe00640 1 -- 172.21.15.37:0/1063472064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94bc012400 con 0x7f94c41629d0 2024-05-30T06:44:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.297+0000 7f94ca800640 1 -- 172.21.15.37:0/1063472064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c413ecb0 con 0x7f94c41629d0 2024-05-30T06:44:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.301+0000 7f94ca800640 1 -- 172.21.15.37:0/1063472064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94c4068bc0 con 0x7f94c41629d0 2024-05-30T06:44:45.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.301+0000 7f94bbe00640 1 -- 172.21.15.37:0/1063472064 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 88038+0+0 (secure 0 0 0) 0x7f94bc01a070 con 0x7f94c41629d0 2024-05-30T06:44:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.301+0000 7f94bbe00640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f94a0068440 0x7f94a006a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.301+0000 7f94bbe00640 1 -- 172.21.15.37:0/1063472064 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f94bc0868a0 con 0x7f94c41629d0 2024-05-30T06:44:45.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.301+0000 7f94c3400640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f94a0068440 0x7f94a006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:45.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.301+0000 7f94c3400640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f94a0068440 0x7f94a006a900 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f94b40ad000 tx=0x7f94b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:45.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.305+0000 7f94bbe00640 1 -- 172.21.15.37:0/1063472064 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f94bc056cf0 con 0x7f94c41629d0 2024-05-30T06:44:45.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.501+0000 7f94ca800640 1 -- 172.21.15.37:0/1063472064 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f94c40b30b0 con 0x7f94a0068440 2024-05-30T06:44:45.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.569+0000 7f94bbe00640 1 -- 172.21.15.37:0/1063472064 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f94c40b30b0 con 0x7f94a0068440 2024-05-30T06:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.569+0000 7f94ca800640 1 -- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f94a0068440 msgr2=0x7f94a006a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.569+0000 7f94ca800640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f94a0068440 0x7f94a006a900 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f94b40ad000 tx=0x7f94b4008040 comp rx=0 tx=0).stop 2024-05-30T06:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.569+0000 7f94ca800640 1 -- 172.21.15.37:0/1063472064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c41629d0 msgr2=0x7f94c4135c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.569+0000 7f94ca800640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c41629d0 0x7f94c4135c50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00caa0 tx=0x7f94bc00cf60 comp rx=0 tx=0).stop 2024-05-30T06:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.569+0000 7f94ca800640 1 -- 172.21.15.37:0/1063472064 shutdown_connections 2024-05-30T06:44:45.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.569+0000 7f94ca800640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94c41629d0 0x7f94c4135c50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.569+0000 7f94ca800640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94c40cfeb0 0x7f94c40aeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.569+0000 7f94ca800640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f94a0068440 0x7f94a006a900 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.569+0000 7f94ca800640 1 --2- 172.21.15.37:0/1063472064 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94c40b36c0 0x7f94c4142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.569+0000 7f94ca800640 1 -- 172.21.15.37:0/1063472064 >> 172.21.15.37:0/1063472064 conn(0x7f94c406bf60 msgr2=0x7f94c415d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.569+0000 7f94ca800640 1 -- 172.21.15.37:0/1063472064 shutdown_connections 2024-05-30T06:44:45.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.569+0000 7f94ca800640 1 -- 172.21.15.37:0/1063472064 wait complete. 2024-05-30T06:44:45.574 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:45.572+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:45.575 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:45.572+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:45.575 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:45.572+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:45.575 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:45.572+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:45.575 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:45.572+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:45.591 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:45.588+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:45.591 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:45.588+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:45.591 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:45.588+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:45.591 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:45.588+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:45.591 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:44:45.588+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:44:45.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:44:45.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.733+0000 7fd95ea00640 1 Processor -- start 2024-05-30T06:44:45.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.733+0000 7fd95ea00640 1 -- start start 2024-05-30T06:44:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd95806e000 0x7fd9580ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ea00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd95815cd80 0x7fd9580ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd9580cec40 0x7fd95806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ea00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd9580a9530 con 0x7fd9580cec40 2024-05-30T06:44:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ea00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd9580cd120 con 0x7fd95815cd80 2024-05-30T06:44:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9580cd400 con 0x7fd95806e000 2024-05-30T06:44:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ca00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd9580cec40 0x7fd95806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:45.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ca00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd9580cec40 0x7fd95806e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42352/0 (socket says 172.21.15.37:42352) 2024-05-30T06:44:45.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ca00640 1 -- 172.21.15.37:0/3640466961 learned_addr learned my addr 172.21.15.37:0/3640466961 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:45.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd94fe00640 1 --2- 172.21.15.37:0/3640466961 >> v2:172.21.15.105:3300/0 conn(0x7fd95815cd80 0x7fd9580ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:45.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd957e00640 1 --2- 172.21.15.37:0/3640466961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd95806e000 0x7fd9580ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:45.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ca00640 1 -- 172.21.15.37:0/3640466961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd95806e000 msgr2=0x7fd9580ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:44:45.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ca00640 1 --2- 172.21.15.37:0/3640466961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd95806e000 0x7fd9580ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ca00640 1 -- 172.21.15.37:0/3640466961 >> v2:172.21.15.105:3300/0 conn(0x7fd95815cd80 msgr2=0x7fd9580ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:44:45.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ca00640 1 --2- 172.21.15.37:0/3640466961 >> v2:172.21.15.105:3300/0 conn(0x7fd95815cd80 0x7fd9580ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.737+0000 7fd95ca00640 1 -- 172.21.15.37:0/3640466961 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9580cd6e0 con 0x7fd9580cec40 2024-05-30T06:44:45.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd95ca00640 1 --2- 172.21.15.37:0/3640466961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9580cec40 0x7fd95806e3e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd9580b5b70 tx=0x7fd95001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb4283cdcad3481 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd957400640 1 -- 172.21.15.37:0/3640466961 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9500b4070 con 0x7fd9580cec40 2024-05-30T06:44:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd957400640 1 -- 172.21.15.37:0/3640466961 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9500af400 con 0x7fd9580cec40 2024-05-30T06:44:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd957400640 1 -- 172.21.15.37:0/3640466961 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9500af7d0 con 0x7fd9580cec40 2024-05-30T06:44:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd95ea00640 1 -- 172.21.15.37:0/3640466961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9580cec40 msgr2=0x7fd95806e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd95ea00640 1 --2- 172.21.15.37:0/3640466961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9580cec40 0x7fd95806e3e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd9580b5b70 tx=0x7fd95001f1e0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd95ea00640 1 -- 172.21.15.37:0/3640466961 shutdown_connections 2024-05-30T06:44:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd95ea00640 1 --2- 172.21.15.37:0/3640466961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9580cec40 0x7fd95806e3e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd95ea00640 1 --2- 172.21.15.37:0/3640466961 >> v2:172.21.15.105:3300/0 conn(0x7fd95815cd80 0x7fd9580ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd95ea00640 1 --2- 172.21.15.37:0/3640466961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd95806e000 0x7fd9580ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd95ea00640 1 -- 172.21.15.37:0/3640466961 >> 172.21.15.37:0/3640466961 conn(0x7fd9580b23a0 msgr2=0x7fd9580b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd95ea00640 1 -- 172.21.15.37:0/3640466961 shutdown_connections 2024-05-30T06:44:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd95ea00640 1 -- 172.21.15.37:0/3640466961 wait complete. 2024-05-30T06:44:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd95ea00640 1 Processor -- start 2024-05-30T06:44:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.741+0000 7fd95ea00640 1 -- start start 2024-05-30T06:44:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd95ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd95806e000 0x7fd95813db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd95ea00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9580cec40 0x7fd95815e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd95ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd95815cd80 0x7fd95813bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd95ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd9580cf0a0 con 0x7fd95806e000 2024-05-30T06:44:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd95ea00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9580cdca0 con 0x7fd9580cec40 2024-05-30T06:44:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd95ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd95806e920 con 0x7fd95815cd80 2024-05-30T06:44:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd957e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd95806e000 0x7fd95813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd957e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd95806e000 0x7fd95813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42360/0 (socket says 172.21.15.37:42360) 2024-05-30T06:44:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd957e00640 1 -- 172.21.15.37:0/3067259388 learned_addr learned my addr 172.21.15.37:0/3067259388 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd94fe00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9580cec40 0x7fd95815e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd95ca00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd95815cd80 0x7fd95813bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd957e00640 1 -- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd95815cd80 msgr2=0x7fd95813bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd957e00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd95815cd80 0x7fd95813bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd957e00640 1 -- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9580cec40 msgr2=0x7fd95815e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd957e00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9580cec40 0x7fd95815e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd957e00640 1 -- 172.21.15.37:0/3067259388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95813e090 con 0x7fd95806e000 2024-05-30T06:44:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd94fe00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9580cec40 0x7fd95815e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:44:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd957e00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd95806e000 0x7fd95813db50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd94800d800 tx=0x7fd94800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd954c00640 1 -- 172.21.15.37:0/3067259388 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948018030 con 0x7fd95806e000 2024-05-30T06:44:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd954c00640 1 -- 172.21.15.37:0/3067259388 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9480096a0 con 0x7fd95806e000 2024-05-30T06:44:45.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd95ea00640 1 -- 172.21.15.37:0/3067259388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95813cab0 con 0x7fd95806e000 2024-05-30T06:44:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd954c00640 1 -- 172.21.15.37:0/3067259388 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948009870 con 0x7fd95806e000 2024-05-30T06:44:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd95ea00640 1 -- 172.21.15.37:0/3067259388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95813d070 con 0x7fd95806e000 2024-05-30T06:44:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd95ea00640 1 -- 172.21.15.37:0/3067259388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd958068b20 con 0x7fd95806e000 2024-05-30T06:44:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.745+0000 7fd954c00640 1 -- 172.21.15.37:0/3067259388 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) ==== 88038+0+0 (secure 0 0 0) 0x7fd94801b070 con 0x7fd95806e000 2024-05-30T06:44:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.749+0000 7fd954c00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd934068410 0x7fd93406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.749+0000 7fd954c00640 1 -- 172.21.15.37:0/3067259388 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fd948086d20 con 0x7fd95806e000 2024-05-30T06:44:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.749+0000 7fd94fe00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd934068410 0x7fd93406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:45.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.749+0000 7fd94fe00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd934068410 0x7fd93406a8d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd958150e00 tx=0x7fd940008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:45.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.753+0000 7fd954c00640 1 -- 172.21.15.37:0/3067259388 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd948057160 con 0x7fd95806e000 2024-05-30T06:44:45.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.973+0000 7fd95ea00640 1 -- 172.21.15.37:0/3067259388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd9580b0690 con 0x7fd95806e000 2024-05-30T06:44:45.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.977+0000 7fd954c00640 1 -- 172.21.15.37:0/3067259388 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1860 (secure 0 0 0) 0x7fd948056a60 con 0x7fd95806e000 2024-05-30T06:44:45.977 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:44:45.977 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:44:45.977 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:44:45.977 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:44:45.977 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:44:45.977 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:44:45.977 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:44:45.977 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:45.978 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:44:45.978 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:44:45.978 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:44:45.978 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:44:45.978 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:44:45.978 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:45.978 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:44:45.978 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:44:45.978 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:44:45.978 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:44:45.978 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:45.978 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 180, 2024-05-30T06:44:45.978 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:45.979 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 2585, 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 10738550134, 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 21735522304, 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 751358590976, 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 85, 2024-05-30T06:44:45.980 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 178920947, 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 44 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 2, 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 2, 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:44:45.981 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:44:45.982 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5040 2024-05-30T06:44:45.982 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:45.982 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:45.982 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:44:45.982 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:45.982 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:44:45.982 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:44:45.982 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:44:45.982 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:44:45.982 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:44:45.982 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:44:45.982 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:44:45.983 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:45.983 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:44:45.983 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:45.983 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:44:45.983 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 5, 2024-05-30T06:44:45.983 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:44:10.671476+0000", 2024-05-30T06:44:45.983 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:44:45.983 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:45.983 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": {} 2024-05-30T06:44:45.983 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:44:45.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.977+0000 7fd95ea00640 1 -- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd934068410 msgr2=0x7fd93406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:45.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.977+0000 7fd95ea00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd934068410 0x7fd93406a8d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd958150e00 tx=0x7fd940008040 comp rx=0 tx=0).stop 2024-05-30T06:44:45.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.977+0000 7fd95ea00640 1 -- 172.21.15.37:0/3067259388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd95806e000 msgr2=0x7fd95813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:45.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.977+0000 7fd95ea00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd95806e000 0x7fd95813db50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd94800d800 tx=0x7fd94800dcc0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.977+0000 7fd95ea00640 1 -- 172.21.15.37:0/3067259388 shutdown_connections 2024-05-30T06:44:45.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.977+0000 7fd95ea00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd95815cd80 0x7fd95813bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.977+0000 7fd95ea00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd934068410 0x7fd93406a8d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.977+0000 7fd95ea00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9580cec40 0x7fd95815e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.977+0000 7fd95ea00640 1 --2- 172.21.15.37:0/3067259388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd95806e000 0x7fd95813db50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:45.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.977+0000 7fd95ea00640 1 -- 172.21.15.37:0/3067259388 >> 172.21.15.37:0/3067259388 conn(0x7fd9580b23a0 msgr2=0x7fd9580b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:45.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.977+0000 7fd95ea00640 1 -- 172.21.15.37:0/3067259388 shutdown_connections 2024-05-30T06:44:45.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:45.977+0000 7fd95ea00640 1 -- 172.21.15.37:0/3067259388 wait complete. 2024-05-30T06:44:48.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:44:48.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.149+0000 7f9a9be00640 1 Processor -- start 2024-05-30T06:44:48.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.149+0000 7f9a9be00640 1 -- start start 2024-05-30T06:44:48.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.153+0000 7f9a9be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9a9c06ff20 0x7f9a9c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:48.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.153+0000 7f9a9be00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9a9c06d040 0x7f9a9c0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:48.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.153+0000 7f9a9be00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a9c0b5170 con 0x7f9a9c15b550 2024-05-30T06:44:48.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.153+0000 7f9a9be00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9a9c0b5410 con 0x7f9a9c06ff20 2024-05-30T06:44:48.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.153+0000 7f9a9be00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9a9c0b56f0 con 0x7f9a9c06d040 2024-05-30T06:44:48.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.153+0000 7f9a92000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9a9c06ff20 0x7f9a9c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:48.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.153+0000 7f9a92000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9a9c06ff20 0x7f9a9c0cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59254/0 (socket says 172.21.15.37:59254) 2024-05-30T06:44:48.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.153+0000 7f9a92000640 1 -- 172.21.15.37:0/3449282769 learned_addr learned my addr 172.21.15.37:0/3449282769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:48.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.153+0000 7f9a9b400640 1 --2- 172.21.15.37:0/3449282769 >> v2:172.21.15.105:3300/0 conn(0x7f9a9c06d040 0x7f9a9c0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:48.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.153+0000 7f9a92000640 1 -- 172.21.15.37:0/3449282769 >> v2:172.21.15.105:3300/0 conn(0x7f9a9c06d040 msgr2=0x7f9a9c0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:44:48.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.153+0000 7f9a92000640 1 --2- 172.21.15.37:0/3449282769 >> v2:172.21.15.105:3300/0 conn(0x7f9a9c06d040 0x7f9a9c0cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:48.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.153+0000 7f9a92000640 1 -- 172.21.15.37:0/3449282769 >> v1:172.21.15.105:6789/0 conn(0x7f9a9c15b550 legacy=0x7f9a9c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:48.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.153+0000 7f9a92000640 1 -- 172.21.15.37:0/3449282769 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c0b59d0 con 0x7f9a9c06ff20 2024-05-30T06:44:48.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a92000640 1 --2- 172.21.15.37:0/3449282769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a9c06ff20 0x7f9a9c0cec10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0b49d0 tx=0x7f9a8401eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aabcad59e758777 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:48.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9a000640 1 -- 172.21.15.37:0/3449282769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840b4070 con 0x7f9a9c06ff20 2024-05-30T06:44:48.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9a000640 1 -- 172.21.15.37:0/3449282769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a840a7c00 con 0x7f9a9c06ff20 2024-05-30T06:44:48.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9a000640 1 -- 172.21.15.37:0/3449282769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840af440 con 0x7f9a9c06ff20 2024-05-30T06:44:48.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9be00640 1 -- 172.21.15.37:0/3449282769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a9c06ff20 msgr2=0x7f9a9c0cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:48.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9be00640 1 --2- 172.21.15.37:0/3449282769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a9c06ff20 0x7f9a9c0cec10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0b49d0 tx=0x7f9a8401eb30 comp rx=0 tx=0).stop 2024-05-30T06:44:48.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9be00640 1 -- 172.21.15.37:0/3449282769 shutdown_connections 2024-05-30T06:44:48.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9be00640 1 --2- 172.21.15.37:0/3449282769 >> v2:172.21.15.105:3300/0 conn(0x7f9a9c06d040 0x7f9a9c0cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:48.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9be00640 1 --2- 172.21.15.37:0/3449282769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a9c06ff20 0x7f9a9c0cec10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:48.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9be00640 1 -- 172.21.15.37:0/3449282769 >> 172.21.15.37:0/3449282769 conn(0x7f9a9c0cd710 msgr2=0x7f9a9c0cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:48.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9be00640 1 -- 172.21.15.37:0/3449282769 shutdown_connections 2024-05-30T06:44:48.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9be00640 1 -- 172.21.15.37:0/3449282769 wait complete. 2024-05-30T06:44:48.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9be00640 1 Processor -- start 2024-05-30T06:44:48.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9be00640 1 -- start start 2024-05-30T06:44:48.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9be00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a9c06d040 0x7f9a9c1413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:48.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.157+0000 7f9a9be00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a9c06ff20 0x7f9a9c0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:48.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a9c15b550 0x7f9a9c0b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:48.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9be00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c15bab0 con 0x7f9a9c15b550 2024-05-30T06:44:48.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9be00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c15b930 con 0x7f9a9c06d040 2024-05-30T06:44:48.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9be00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9c06b960 con 0x7f9a9c06ff20 2024-05-30T06:44:48.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a9c15b550 0x7f9a9c0b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:48.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a9c15b550 0x7f9a9c0b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59266/0 (socket says 172.21.15.37:59266) 2024-05-30T06:44:48.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9b400640 1 -- 172.21.15.37:0/1600316419 learned_addr learned my addr 172.21.15.37:0/1600316419 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:48.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9aa00640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a9c06d040 0x7f9a9c1413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:48.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a92000640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a9c06ff20 0x7f9a9c0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:48.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9b400640 1 -- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a9c06ff20 msgr2=0x7f9a9c0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:48.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9b400640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a9c06ff20 0x7f9a9c0b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:48.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9b400640 1 -- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a9c06d040 msgr2=0x7f9a9c1413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:48.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9b400640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a9c06d040 0x7f9a9c1413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:48.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9b400640 1 -- 172.21.15.37:0/1600316419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c158e80 con 0x7f9a9c15b550 2024-05-30T06:44:48.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a92000640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a9c06ff20 0x7f9a9c0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:44:48.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9b400640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a9c15b550 0x7f9a9c0b0910 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9a94007e30 tx=0x7f9a9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:48.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a93400640 1 -- 172.21.15.37:0/1600316419 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94014620 con 0x7f9a9c15b550 2024-05-30T06:44:48.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a93400640 1 -- 172.21.15.37:0/1600316419 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a94019070 con 0x7f9a9c15b550 2024-05-30T06:44:48.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9be00640 1 -- 172.21.15.37:0/1600316419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9c1535c0 con 0x7f9a9c15b550 2024-05-30T06:44:48.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a93400640 1 -- 172.21.15.37:0/1600316419 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94014a00 con 0x7f9a9c15b550 2024-05-30T06:44:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9be00640 1 -- 172.21.15.37:0/1600316419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a9c159140 con 0x7f9a9c15b550 2024-05-30T06:44:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a9be00640 1 -- 172.21.15.37:0/1600316419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a9c075580 con 0x7f9a9c15b550 2024-05-30T06:44:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.161+0000 7f9a93400640 1 -- 172.21.15.37:0/1600316419 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f9a94014ba0 con 0x7f9a9c15b550 2024-05-30T06:44:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.165+0000 7f9a93400640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a78068530 0x7f9a7806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.165+0000 7f9a93400640 1 -- 172.21.15.37:0/1600316419 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9a940875c0 con 0x7f9a9c15b550 2024-05-30T06:44:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.165+0000 7f9a9aa00640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a78068530 0x7f9a7806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.165+0000 7f9a9aa00640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a78068530 0x7f9a7806a9f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0015b0 tx=0x7f9a8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:48.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.169+0000 7f9a93400640 1 -- 172.21.15.37:0/1600316419 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9a94057860 con 0x7f9a9c15b550 2024-05-30T06:44:48.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a9be00640 1 -- 172.21.15.37:0/1600316419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9a9c0677c0 con 0x7f9a9c15b550 2024-05-30T06:44:48.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a93400640 1 -- 172.21.15.37:0/1600316419 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1859 (secure 0 0 0) 0x7f9a94057160 con 0x7f9a9c15b550 2024-05-30T06:44:48.394 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:44:48.394 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:44:48.394 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:44:48.394 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:44:48.394 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:44:48.394 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:44:48.394 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:44:48.394 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:48.395 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:44:48.395 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:44:48.395 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:44:48.395 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:44:48.395 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:44:48.395 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:48.395 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:44:48.395 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:44:48.395 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:44:48.395 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:44:48.395 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:48.395 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 182, 2024-05-30T06:44:48.395 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:44:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:44:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:44:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:44:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:44:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-05-30T06:44:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:44:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:44:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:44:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:44:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:44:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:44:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 2585, 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 10738550134, 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 21735522304, 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 751358590976, 2024-05-30T06:44:48.397 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 85, 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 94703263, 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 24 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 2, 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:44:48.398 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 2, 2024-05-30T06:44:48.399 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:44:48.399 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:44:48.399 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:44:48.399 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5040 2024-05-30T06:44:48.399 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:48.399 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:48.399 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:44:48.399 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:48.399 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:44:48.399 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:44:48.399 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:44:48.399 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:44:48.399 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:44:48.400 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:44:48.400 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:44:48.400 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:48.400 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:44:48.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:48.400 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:44:48.400 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 5, 2024-05-30T06:44:48.400 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:44:10.671476+0000", 2024-05-30T06:44:48.400 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:44:48.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:48.400 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": {} 2024-05-30T06:44:48.400 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:44:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a9be00640 1 -- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a78068530 msgr2=0x7f9a7806a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a9be00640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a78068530 0x7f9a7806a9f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0015b0 tx=0x7f9a8c009040 comp rx=0 tx=0).stop 2024-05-30T06:44:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a9be00640 1 -- 172.21.15.37:0/1600316419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a9c15b550 msgr2=0x7f9a9c0b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a9be00640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a9c15b550 0x7f9a9c0b0910 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9a94007e30 tx=0x7f9a9400e4b0 comp rx=0 tx=0).stop 2024-05-30T06:44:48.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a9be00640 1 -- 172.21.15.37:0/1600316419 shutdown_connections 2024-05-30T06:44:48.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a9be00640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a9c15b550 0x7f9a9c0b0910 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:48.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a9be00640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a9c06ff20 0x7f9a9c0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:48.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a9be00640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a78068530 0x7f9a7806a9f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:48.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a9be00640 1 --2- 172.21.15.37:0/1600316419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a9c06d040 0x7f9a9c1413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:48.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a9be00640 1 -- 172.21.15.37:0/1600316419 >> 172.21.15.37:0/1600316419 conn(0x7f9a9c0cd710 msgr2=0x7f9a9c155630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:48.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a9be00640 1 -- 172.21.15.37:0/1600316419 shutdown_connections 2024-05-30T06:44:48.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:48.393+0000 7f9a9be00640 1 -- 172.21.15.37:0/1600316419 wait complete. 2024-05-30T06:44:50.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:44:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.625+0000 7f782ae00640 1 Processor -- start 2024-05-30T06:44:50.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.625+0000 7f782ae00640 1 -- start start 2024-05-30T06:44:50.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.629+0000 7f782ae00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78240b2ec0 0x7f78240af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:50.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.629+0000 7f782ae00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78240afe30 con 0x7f78241482d0 2024-05-30T06:44:50.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.629+0000 7f782ae00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f782406e210 con 0x7f782415eed0 2024-05-30T06:44:50.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.629+0000 7f782ae00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f782406e860 con 0x7f78240b2ec0 2024-05-30T06:44:50.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.629+0000 7f7823e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f78241482d0 0x7f782415ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36558/0 (socket says 172.21.15.37:36558) 2024-05-30T06:44:50.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.629+0000 7f7823e00640 1 -- 172.21.15.37:0/3024438341 learned_addr learned my addr 172.21.15.37:0/3024438341 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:44:50.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.629+0000 7f7823400640 1 --2- 172.21.15.37:0/3024438341 >> v2:172.21.15.37:3300/0 conn(0x7f78240b2ec0 0x7f78240af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.629+0000 7f7823400640 1 -- 172.21.15.37:0/3024438341 >> v1:172.21.15.105:6789/0 conn(0x7f782415eed0 legacy=0x7f782415f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:44:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.629+0000 7f7823400640 1 -- 172.21.15.37:0/3024438341 >> v1:172.21.15.37:6789/0 conn(0x7f78241482d0 legacy=0x7f782415ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:50.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.629+0000 7f7823400640 1 -- 172.21.15.37:0/3024438341 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782406e4f0 con 0x7f78240b2ec0 2024-05-30T06:44:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.633+0000 7f7823400640 1 --2- 172.21.15.37:0/3024438341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78240b2ec0 0x7f78240af690 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f78100097c0 tx=0x7f781001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9adcb0dfb279749 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.633+0000 7f7822a00640 1 -- 172.21.15.37:0/3024438341 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78100b0070 con 0x7f78240b2ec0 2024-05-30T06:44:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.633+0000 7f7822a00640 1 -- 172.21.15.37:0/3024438341 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78100ab600 con 0x7f78240b2ec0 2024-05-30T06:44:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.633+0000 7f7822a00640 1 -- 172.21.15.37:0/3024438341 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78100a4e60 con 0x7f78240b2ec0 2024-05-30T06:44:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.637+0000 7f782ae00640 1 -- 172.21.15.37:0/3024438341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78240b2ec0 msgr2=0x7f78240af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.637+0000 7f782ae00640 1 --2- 172.21.15.37:0/3024438341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78240b2ec0 0x7f78240af690 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f78100097c0 tx=0x7f781001c3d0 comp rx=0 tx=0).stop 2024-05-30T06:44:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.637+0000 7f782ae00640 1 -- 172.21.15.37:0/3024438341 shutdown_connections 2024-05-30T06:44:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.637+0000 7f782ae00640 1 --2- 172.21.15.37:0/3024438341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78240b2ec0 0x7f78240af690 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.637+0000 7f782ae00640 1 -- 172.21.15.37:0/3024438341 >> 172.21.15.37:0/3024438341 conn(0x7f78240b23a0 msgr2=0x7f78240b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.637+0000 7f782ae00640 1 -- 172.21.15.37:0/3024438341 shutdown_connections 2024-05-30T06:44:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.637+0000 7f782ae00640 1 -- 172.21.15.37:0/3024438341 wait complete. 2024-05-30T06:44:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.637+0000 7f782ae00640 1 Processor -- start 2024-05-30T06:44:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.637+0000 7f782ae00640 1 -- start start 2024-05-30T06:44:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f782ae00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78240b2ec0 0x7f7824140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f782ae00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78241482d0 0x7f782415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f782ae00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f782415eed0 0x7f78240cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f782ae00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f782406f8b0 con 0x7f78241482d0 2024-05-30T06:44:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f782ae00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f782406f730 con 0x7f782415eed0 2024-05-30T06:44:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f782ae00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f782416c8a0 con 0x7f78240b2ec0 2024-05-30T06:44:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f7823400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78241482d0 0x7f782415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f7828e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f782415eed0 0x7f78240cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f7823400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78241482d0 0x7f782415dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59276/0 (socket says 172.21.15.37:59276) 2024-05-30T06:44:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f7823400640 1 -- 172.21.15.37:0/1666956139 learned_addr learned my addr 172.21.15.37:0/1666956139 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f7823e00640 1 --2- 172.21.15.37:0/1666956139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78240b2ec0 0x7f7824140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f7823400640 1 -- 172.21.15.37:0/1666956139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78240b2ec0 msgr2=0x7f7824140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f7823400640 1 --2- 172.21.15.37:0/1666956139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78240b2ec0 0x7f7824140040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f7823400640 1 -- 172.21.15.37:0/1666956139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f782415eed0 msgr2=0x7f78240cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f7823400640 1 --2- 172.21.15.37:0/1666956139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f782415eed0 0x7f78240cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f7823400640 1 -- 172.21.15.37:0/1666956139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7824139980 con 0x7f78241482d0 2024-05-30T06:44:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f7823400640 1 --2- 172.21.15.37:0/1666956139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78241482d0 0x7f782415dbe0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7810018fe0 tx=0x7f7810019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f781be00640 1 -- 172.21.15.37:0/1666956139 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78100b9070 con 0x7f78241482d0 2024-05-30T06:44:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f781be00640 1 -- 172.21.15.37:0/1666956139 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78100b58b0 con 0x7f78241482d0 2024-05-30T06:44:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.641+0000 7f781be00640 1 -- 172.21.15.37:0/1666956139 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78100b0040 con 0x7f78241482d0 2024-05-30T06:44:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.645+0000 7f782ae00640 1 -- 172.21.15.37:0/1666956139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7824139c40 con 0x7f78241482d0 2024-05-30T06:44:50.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.645+0000 7f782ae00640 1 -- 172.21.15.37:0/1666956139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782413a200 con 0x7f78241482d0 2024-05-30T06:44:50.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.645+0000 7f7819600640 1 -- 172.21.15.37:0/1666956139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f80052a0 con 0x7f78241482d0 2024-05-30T06:44:50.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.653+0000 7f781be00640 1 -- 172.21.15.37:0/1666956139 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f78100bc070 con 0x7f78241482d0 2024-05-30T06:44:50.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.653+0000 7f781be00640 1 --2- 172.21.15.37:0/1666956139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7804068600 0x7f780406aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:50.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.653+0000 7f781be00640 1 -- 172.21.15.37:0/1666956139 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7810121790 con 0x7f78241482d0 2024-05-30T06:44:50.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.657+0000 7f7823e00640 1 --2- 172.21.15.37:0/1666956139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7804068600 0x7f780406aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:50.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.657+0000 7f781be00640 1 -- 172.21.15.37:0/1666956139 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f78100c3030 con 0x7f78241482d0 2024-05-30T06:44:50.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:50.657+0000 7f7823e00640 1 --2- 172.21.15.37:0/1666956139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7804068600 0x7f780406aac0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78240ad8a0 tx=0x7f7814007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:51.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.013+0000 7f7819600640 1 -- 172.21.15.37:0/1666956139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f77f8005860 con 0x7f78241482d0 2024-05-30T06:44:51.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.013+0000 7f781be00640 1 -- 172.21.15.37:0/1666956139 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2137 (secure 0 0 0) 0x7f7810016050 con 0x7f78241482d0 2024-05-30T06:44:51.016 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:44:51.016 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:44:51.016 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:44:51.016 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:44:51.016 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:44:51.016 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:44:51.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 185, 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:44:51.018 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:44:51.018 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:44:51.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:51.018 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:44:51.018 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-05-30T06:44:51.018 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:44:51.018 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:44:51.018 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:44:51.018 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:44:51.018 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:44:51.018 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:44:51.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:51.019 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:44:51.019 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:44:51.019 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:44:51.019 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:44:51.019 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:44:51.019 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:51.019 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:51.019 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:44:51.019 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:44:51.019 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 2605, 2024-05-30T06:44:51.019 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 10805742291, 2024-05-30T06:44:51.019 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 21752467456, 2024-05-30T06:44:51.020 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 751341645824, 2024-05-30T06:44:51.020 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:44:51.020 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 9784603, 2024-05-30T06:44:51.020 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 100301784, 2024-05-30T06:44:51.020 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 2, 2024-05-30T06:44:51.020 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 28 2024-05-30T06:44:51.020 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:51.020 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:44:51.020 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-05-30T06:44:51.020 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 2, 2024-05-30T06:44:51.020 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:44:51.020 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:44:51.021 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:44:51.021 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:44:51.021 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:44:51.021 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 2, 2024-05-30T06:44:51.021 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:44:51.021 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:44:51.021 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:44:51.021 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5040 2024-05-30T06:44:51.021 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:51.021 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:51.021 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:44:51.021 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:44:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:44:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:44:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:44:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:44:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:44:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:44:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:44:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:44:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 5, 2024-05-30T06:44:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:44:10.671476+0000", 2024-05-30T06:44:51.023 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:44:51.023 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:51.023 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:44:51.023 INFO:teuthology.orchestra.run.smithi037.stdout: "d638d813-2312-4b75-9860-666ea42605c1": { 2024-05-30T06:44:51.023 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "1 ongoing clones; Avg progress is 10.313% (2s)\n [==..........................] (remaining: 18s)", 2024-05-30T06:44:51.023 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.10312999784946442, 2024-05-30T06:44:51.023 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:44:51.023 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:51.023 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:51.023 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:44:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.017+0000 7f7819600640 1 -- 172.21.15.37:0/1666956139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7804068600 msgr2=0x7f780406aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.017+0000 7f7819600640 1 --2- 172.21.15.37:0/1666956139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7804068600 0x7f780406aac0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f78240ad8a0 tx=0x7f7814007e90 comp rx=0 tx=0).stop 2024-05-30T06:44:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.017+0000 7f7819600640 1 -- 172.21.15.37:0/1666956139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78241482d0 msgr2=0x7f782415dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.017+0000 7f7819600640 1 --2- 172.21.15.37:0/1666956139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78241482d0 0x7f782415dbe0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7810018fe0 tx=0x7f7810019170 comp rx=0 tx=0).stop 2024-05-30T06:44:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.017+0000 7f7819600640 1 -- 172.21.15.37:0/1666956139 shutdown_connections 2024-05-30T06:44:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.017+0000 7f7819600640 1 --2- 172.21.15.37:0/1666956139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7804068600 0x7f780406aac0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.017+0000 7f7819600640 1 --2- 172.21.15.37:0/1666956139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f782415eed0 0x7f78240cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.017+0000 7f7819600640 1 --2- 172.21.15.37:0/1666956139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78241482d0 0x7f782415dbe0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.017+0000 7f7819600640 1 --2- 172.21.15.37:0/1666956139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78240b2ec0 0x7f7824140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.017+0000 7f7819600640 1 -- 172.21.15.37:0/1666956139 >> 172.21.15.37:0/1666956139 conn(0x7f78240b23a0 msgr2=0x7f78240b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:51.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.017+0000 7f7819600640 1 -- 172.21.15.37:0/1666956139 shutdown_connections 2024-05-30T06:44:51.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.017+0000 7f7819600640 1 -- 172.21.15.37:0/1666956139 wait complete. 2024-05-30T06:44:51.049 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs ss1clone1 2024-05-30T06:44:51.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.253+0000 7f0075600640 1 Processor -- start 2024-05-30T06:44:51.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f0075600640 1 -- start start 2024-05-30T06:44:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f0075600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f00700d03c0 0x7f007009aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f0075600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00700b14b0 0x7f007009afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f0075600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f007009bb80 con 0x7f007015c870 2024-05-30T06:44:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f0075600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f00700cd110 con 0x7f00700d03c0 2024-05-30T06:44:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f0075600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f007009be60 con 0x7f00700b14b0 2024-05-30T06:44:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f0067e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f00700d03c0 0x7f007009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f0067e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f00700d03c0 0x7f007009aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59280/0 (socket says 172.21.15.37:59280) 2024-05-30T06:44:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f006ea00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f007015c870 0x7f00700cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36564/0 (socket says 172.21.15.37:36564) 2024-05-30T06:44:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f0067e00640 1 -- 172.21.15.37:0/1108632436 learned_addr learned my addr 172.21.15.37:0/1108632436 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:51.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f0067e00640 1 -- 172.21.15.37:0/1108632436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00700b14b0 msgr2=0x7f007009afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:44:51.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f0067e00640 1 --2- 172.21.15.37:0/1108632436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00700b14b0 0x7f007009afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f0067e00640 1 -- 172.21.15.37:0/1108632436 >> v1:172.21.15.37:6789/0 conn(0x7f007015c870 legacy=0x7f00700cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:51.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.257+0000 7f0067e00640 1 -- 172.21.15.37:0/1108632436 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00700cd340 con 0x7f00700d03c0 2024-05-30T06:44:51.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.261+0000 7f0067e00640 1 --2- 172.21.15.37:0/1108632436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00700d03c0 0x7f007009aa60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0058009870 tx=0x7f005801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11af1d71b8afeb19 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:51.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.261+0000 7f006e000640 1 -- 172.21.15.37:0/1108632436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00580b2070 con 0x7f00700d03c0 2024-05-30T06:44:51.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.261+0000 7f006e000640 1 -- 172.21.15.37:0/1108632436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00580a9070 con 0x7f00700d03c0 2024-05-30T06:44:51.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.261+0000 7f006e000640 1 -- 172.21.15.37:0/1108632436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00580ad880 con 0x7f00700d03c0 2024-05-30T06:44:51.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 -- 172.21.15.37:0/1108632436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00700d03c0 msgr2=0x7f007009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:51.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 --2- 172.21.15.37:0/1108632436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00700d03c0 0x7f007009aa60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0058009870 tx=0x7f005801c560 comp rx=0 tx=0).stop 2024-05-30T06:44:51.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 -- 172.21.15.37:0/1108632436 shutdown_connections 2024-05-30T06:44:51.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 --2- 172.21.15.37:0/1108632436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00700b14b0 0x7f007009afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 --2- 172.21.15.37:0/1108632436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00700d03c0 0x7f007009aa60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 -- 172.21.15.37:0/1108632436 >> 172.21.15.37:0/1108632436 conn(0x7f00700b4060 msgr2=0x7f00700b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:51.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 -- 172.21.15.37:0/1108632436 shutdown_connections 2024-05-30T06:44:51.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 -- 172.21.15.37:0/1108632436 wait complete. 2024-05-30T06:44:51.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 Processor -- start 2024-05-30T06:44:51.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 -- start start 2024-05-30T06:44:51.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00700b14b0 0x7f00700cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:51.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00700d03c0 0x7f007014aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:51.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f007015c870 0x7f00701589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:51.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0070169800 con 0x7f00700b14b0 2024-05-30T06:44:51.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f00700ce530 con 0x7f00700d03c0 2024-05-30T06:44:51.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f0075600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0070169980 con 0x7f007015c870 2024-05-30T06:44:51.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f006ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00700b14b0 0x7f00700cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:51.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f006ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00700b14b0 0x7f00700cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59292/0 (socket says 172.21.15.37:59292) 2024-05-30T06:44:51.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.265+0000 7f006ea00640 1 -- 172.21.15.37:0/379622216 learned_addr learned my addr 172.21.15.37:0/379622216 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:51.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.269+0000 7f0067e00640 1 --2- 172.21.15.37:0/379622216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00700d03c0 0x7f007014aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:51.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.269+0000 7f006ea00640 1 -- 172.21.15.37:0/379622216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f007015c870 msgr2=0x7f00701589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:51.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.269+0000 7f006ea00640 1 --2- 172.21.15.37:0/379622216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f007015c870 0x7f00701589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.269+0000 7f006ea00640 1 -- 172.21.15.37:0/379622216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00700d03c0 msgr2=0x7f007014aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:51.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.269+0000 7f006ea00640 1 --2- 172.21.15.37:0/379622216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00700d03c0 0x7f007014aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.269+0000 7f006ea00640 1 -- 172.21.15.37:0/379622216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00700cb030 con 0x7f00700b14b0 2024-05-30T06:44:51.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.269+0000 7f006ea00640 1 --2- 172.21.15.37:0/379622216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00700b14b0 0x7f00700cb380 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f006000c450 tx=0x7f006000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:51.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.269+0000 7f0066a00640 1 -- 172.21.15.37:0/379622216 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0060018070 con 0x7f00700b14b0 2024-05-30T06:44:51.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.269+0000 7f0066a00640 1 -- 172.21.15.37:0/379622216 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0060007480 con 0x7f00700b14b0 2024-05-30T06:44:51.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.269+0000 7f0066a00640 1 -- 172.21.15.37:0/379622216 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00600047f0 con 0x7f00700b14b0 2024-05-30T06:44:51.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.269+0000 7f0075600640 1 -- 172.21.15.37:0/379622216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00700cad50 con 0x7f00700b14b0 2024-05-30T06:44:51.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.269+0000 7f0075600640 1 -- 172.21.15.37:0/379622216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00700b5310 con 0x7f00700b14b0 2024-05-30T06:44:51.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.269+0000 7f0075600640 1 -- 172.21.15.37:0/379622216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00700cf590 con 0x7f00700b14b0 2024-05-30T06:44:51.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.277+0000 7f0066a00640 1 -- 172.21.15.37:0/379622216 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f006001b070 con 0x7f00700b14b0 2024-05-30T06:44:51.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.277+0000 7f0066a00640 1 --2- 172.21.15.37:0/379622216 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f004c068630 0x7f004c06aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:51.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.277+0000 7f0066a00640 1 -- 172.21.15.37:0/379622216 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f00600864e0 con 0x7f00700b14b0 2024-05-30T06:44:51.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.281+0000 7f0067e00640 1 --2- 172.21.15.37:0/379622216 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f004c068630 0x7f004c06aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:51.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.285+0000 7f0067e00640 1 --2- 172.21.15.37:0/379622216 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f004c068630 0x7f004c06aaf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f00580af000 tx=0x7f00580a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:51.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.285+0000 7f0066a00640 1 -- 172.21.15.37:0/379622216 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0060022020 con 0x7f00700b14b0 2024-05-30T06:44:51.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.589+0000 7f0075600640 1 -- 172.21.15.37:0/379622216 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f00700d0cf0 con 0x7f004c068630 2024-05-30T06:44:51.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.761+0000 7f0066a00640 1 -- 172.21.15.37:0/379622216 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f00700d0cf0 con 0x7f004c068630 2024-05-30T06:44:51.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.761+0000 7f0075600640 1 -- 172.21.15.37:0/379622216 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f004c068630 msgr2=0x7f004c06aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:51.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.761+0000 7f0075600640 1 --2- 172.21.15.37:0/379622216 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f004c068630 0x7f004c06aaf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f00580af000 tx=0x7f00580a7000 comp rx=0 tx=0).stop 2024-05-30T06:44:51.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.761+0000 7f0075600640 1 -- 172.21.15.37:0/379622216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00700b14b0 msgr2=0x7f00700cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.761+0000 7f0075600640 1 --2- 172.21.15.37:0/379622216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00700b14b0 0x7f00700cb380 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f006000c450 tx=0x7f006000c910 comp rx=0 tx=0).stop 2024-05-30T06:44:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.761+0000 7f0075600640 1 -- 172.21.15.37:0/379622216 shutdown_connections 2024-05-30T06:44:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.761+0000 7f0075600640 1 --2- 172.21.15.37:0/379622216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f007015c870 0x7f00701589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.761+0000 7f0075600640 1 --2- 172.21.15.37:0/379622216 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f004c068630 0x7f004c06aaf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.761+0000 7f0075600640 1 --2- 172.21.15.37:0/379622216 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00700d03c0 0x7f007014aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.761+0000 7f0075600640 1 --2- 172.21.15.37:0/379622216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00700b14b0 0x7f00700cb380 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.761+0000 7f0075600640 1 -- 172.21.15.37:0/379622216 >> 172.21.15.37:0/379622216 conn(0x7f00700b4060 msgr2=0x7f0070071800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.761+0000 7f0075600640 1 -- 172.21.15.37:0/379622216 shutdown_connections 2024-05-30T06:44:51.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.761+0000 7f0075600640 1 -- 172.21.15.37:0/379622216 wait complete. 2024-05-30T06:44:51.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:44:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.925+0000 7f671b200640 1 Processor -- start 2024-05-30T06:44:51.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.925+0000 7f671b200640 1 -- start start 2024-05-30T06:44:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.925+0000 7f671b200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f671409aa60 0x7f671409ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.925+0000 7f671b200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f671409b3b0 con 0x7f671409b800 2024-05-30T06:44:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.925+0000 7f671b200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67140d0840 con 0x7f671415ebc0 2024-05-30T06:44:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.925+0000 7f671b200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f671406dec0 con 0x7f671409aa60 2024-05-30T06:44:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.925+0000 7f6719200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f671409aa60 0x7f671409ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:51.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.925+0000 7f6713400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f671409b800 0x7f671406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36566/0 (socket says 172.21.15.37:36566) 2024-05-30T06:44:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.925+0000 7f6719200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f671409aa60 0x7f671409ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59300/0 (socket says 172.21.15.37:59300) 2024-05-30T06:44:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.925+0000 7f6713400640 1 -- 172.21.15.37:0/2560980246 learned_addr learned my addr 172.21.15.37:0/2560980246 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:44:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.925+0000 7f6719200640 1 -- 172.21.15.37:0/2560980246 >> v1:172.21.15.105:6789/0 conn(0x7f671415ebc0 legacy=0x7f67140d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.925+0000 7f6719200640 1 -- 172.21.15.37:0/2560980246 >> v1:172.21.15.37:6789/0 conn(0x7f671409b800 legacy=0x7f671406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:51.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.925+0000 7f6719200640 1 -- 172.21.15.37:0/2560980246 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671409bce0 con 0x7f671409aa60 2024-05-30T06:44:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.929+0000 7f6719200640 1 --2- 172.21.15.37:0/2560980246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f671409aa60 0x7f671409ae70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f670c009d90 tx=0x7f670c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f969c8053aa780 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.929+0000 7f6712a00640 1 -- 172.21.15.37:0/2560980246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c0b2070 con 0x7f671409aa60 2024-05-30T06:44:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.929+0000 7f6712a00640 1 -- 172.21.15.37:0/2560980246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f670c0a5830 con 0x7f671409aa60 2024-05-30T06:44:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.929+0000 7f6712a00640 1 -- 172.21.15.37:0/2560980246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c0a5c00 con 0x7f671409aa60 2024-05-30T06:44:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.929+0000 7f671b200640 1 -- 172.21.15.37:0/2560980246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f671409aa60 msgr2=0x7f671409ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.929+0000 7f671b200640 1 --2- 172.21.15.37:0/2560980246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f671409aa60 0x7f671409ae70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f670c009d90 tx=0x7f670c01c970 comp rx=0 tx=0).stop 2024-05-30T06:44:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.929+0000 7f671b200640 1 -- 172.21.15.37:0/2560980246 shutdown_connections 2024-05-30T06:44:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.929+0000 7f671b200640 1 --2- 172.21.15.37:0/2560980246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f671409aa60 0x7f671409ae70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.929+0000 7f671b200640 1 -- 172.21.15.37:0/2560980246 >> 172.21.15.37:0/2560980246 conn(0x7f67140b4060 msgr2=0x7f67140b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:51.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.929+0000 7f671b200640 1 -- 172.21.15.37:0/2560980246 shutdown_connections 2024-05-30T06:44:51.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.929+0000 7f671b200640 1 -- 172.21.15.37:0/2560980246 wait complete. 2024-05-30T06:44:51.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f671b200640 1 Processor -- start 2024-05-30T06:44:51.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f671b200640 1 -- start start 2024-05-30T06:44:51.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f671b200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f671409aa60 0x7f6714160c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:51.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f671b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f671409b800 0x7f6714151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:51.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f671b200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f671415ebc0 0x7f67140b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:51.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f671b200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f67140cd3d0 con 0x7f671409b800 2024-05-30T06:44:51.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f671b200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f671415efa0 con 0x7f671409aa60 2024-05-30T06:44:51.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f671b200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f67140cd550 con 0x7f671415ebc0 2024-05-30T06:44:51.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f6713400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f671409b800 0x7f6714151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f6713400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f671409b800 0x7f6714151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59304/0 (socket says 172.21.15.37:59304) 2024-05-30T06:44:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f6713400640 1 -- 172.21.15.37:0/2964200729 learned_addr learned my addr 172.21.15.37:0/2964200729 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f6713e00640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f671409aa60 0x7f6714160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f6719200640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f671415ebc0 0x7f67140b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f6713400640 1 -- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f671415ebc0 msgr2=0x7f67140b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f6713400640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f671415ebc0 0x7f67140b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f6713400640 1 -- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f671409aa60 msgr2=0x7f6714160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f6713400640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f671409aa60 0x7f6714160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f6713400640 1 -- 172.21.15.37:0/2964200729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671415fbd0 con 0x7f671409b800 2024-05-30T06:44:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f6713400640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f671409b800 0x7f6714151110 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6700001ec0 tx=0x7f670000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f670be00640 1 -- 172.21.15.37:0/2964200729 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6700017070 con 0x7f671409b800 2024-05-30T06:44:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f670be00640 1 -- 172.21.15.37:0/2964200729 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6700005cf0 con 0x7f671409b800 2024-05-30T06:44:51.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f671b200640 1 -- 172.21.15.37:0/2964200729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f671415feb0 con 0x7f671409b800 2024-05-30T06:44:51.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f670be00640 1 -- 172.21.15.37:0/2964200729 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67000072d0 con 0x7f671409b800 2024-05-30T06:44:51.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f671b200640 1 -- 172.21.15.37:0/2964200729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6714160750 con 0x7f671409b800 2024-05-30T06:44:51.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.933+0000 7f671b200640 1 -- 172.21.15.37:0/2964200729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6714160080 con 0x7f671409b800 2024-05-30T06:44:51.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.937+0000 7f670be00640 1 -- 172.21.15.37:0/2964200729 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f670001a070 con 0x7f671409b800 2024-05-30T06:44:51.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.937+0000 7f670be00640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f66f4068530 0x7f66f406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:51.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.937+0000 7f670be00640 1 -- 172.21.15.37:0/2964200729 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6700085e60 con 0x7f671409b800 2024-05-30T06:44:51.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.937+0000 7f6713e00640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f66f4068530 0x7f66f406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:51.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.937+0000 7f6713e00640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f66f4068530 0x7f66f406a9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6704007fd0 tx=0x7f6704009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:51.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:51.941+0000 7f670be00640 1 -- 172.21.15.37:0/2964200729 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f671409b3b0 con 0x7f671409b800 2024-05-30T06:44:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.129+0000 7f671b200640 1 -- 172.21.15.37:0/2964200729 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f67140cf270 con 0x7f66f4068530 2024-05-30T06:44:52.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.133+0000 7f670be00640 1 -- 172.21.15.37:0/2964200729 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f67140cf270 con 0x7f66f4068530 2024-05-30T06:44:52.132 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:44:52.133 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:44:52.133 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:44:52.133 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:52.133 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:44:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.133+0000 7f671b200640 1 -- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f66f4068530 msgr2=0x7f66f406a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.133+0000 7f671b200640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f66f4068530 0x7f66f406a9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6704007fd0 tx=0x7f6704009040 comp rx=0 tx=0).stop 2024-05-30T06:44:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.133+0000 7f671b200640 1 -- 172.21.15.37:0/2964200729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f671409b800 msgr2=0x7f6714151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.133+0000 7f671b200640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f671409b800 0x7f6714151110 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6700001ec0 tx=0x7f670000c890 comp rx=0 tx=0).stop 2024-05-30T06:44:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.133+0000 7f671b200640 1 -- 172.21.15.37:0/2964200729 shutdown_connections 2024-05-30T06:44:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.133+0000 7f671b200640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f671415ebc0 0x7f67140b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.133+0000 7f671b200640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f671409b800 0x7f6714151110 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.133+0000 7f671b200640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f66f4068530 0x7f66f406a9f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.133+0000 7f671b200640 1 --2- 172.21.15.37:0/2964200729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f671409aa60 0x7f6714160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.133+0000 7f671b200640 1 -- 172.21.15.37:0/2964200729 >> 172.21.15.37:0/2964200729 conn(0x7f67140b4060 msgr2=0x7f67140cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.133+0000 7f671b200640 1 -- 172.21.15.37:0/2964200729 shutdown_connections 2024-05-30T06:44:52.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.133+0000 7f671b200640 1 -- 172.21.15.37:0/2964200729 wait complete. 2024-05-30T06:44:52.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:44:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6086000640 1 Processor -- start 2024-05-30T06:44:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6086000640 1 -- start start 2024-05-30T06:44:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6086000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f608009b170 0x7f608006cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6086000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60800d10f0 0x7f60800d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6086000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f608015f970 con 0x7f60800b39f0 2024-05-30T06:44:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6086000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f60800d0c60 con 0x7f608009b170 2024-05-30T06:44:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6086000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f608015fc50 con 0x7f60800d10f0 2024-05-30T06:44:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6076a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f608009b170 0x7f608006cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6076a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f608009b170 0x7f608006cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59316/0 (socket says 172.21.15.37:59316) 2024-05-30T06:44:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6076a00640 1 -- 172.21.15.37:0/2121647960 learned_addr learned my addr 172.21.15.37:0/2121647960 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f607f400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f60800b39f0 0x7f608009aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36576/0 (socket says 172.21.15.37:36576) 2024-05-30T06:44:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f607fe00640 1 --2- 172.21.15.37:0/2121647960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60800d10f0 0x7f60800d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6076a00640 1 -- 172.21.15.37:0/2121647960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60800d10f0 msgr2=0x7f60800d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:44:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6076a00640 1 --2- 172.21.15.37:0/2121647960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60800d10f0 0x7f60800d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6076a00640 1 -- 172.21.15.37:0/2121647960 >> v1:172.21.15.37:6789/0 conn(0x7f60800b39f0 legacy=0x7f608009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.293+0000 7f6076a00640 1 -- 172.21.15.37:0/2121647960 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608015ff30 con 0x7f608009b170 2024-05-30T06:44:52.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.297+0000 7f6076a00640 1 --2- 172.21.15.37:0/2121647960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f608009b170 0x7f608006cea0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6068009870 tx=0x7f606801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fc904ba2db2136 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:52.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.297+0000 7f607ea00640 1 -- 172.21.15.37:0/2121647960 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60680a9610 con 0x7f608009b170 2024-05-30T06:44:52.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.297+0000 7f607ea00640 1 -- 172.21.15.37:0/2121647960 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60680a97b0 con 0x7f608009b170 2024-05-30T06:44:52.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.297+0000 7f607ea00640 1 -- 172.21.15.37:0/2121647960 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60680a9b80 con 0x7f608009b170 2024-05-30T06:44:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.297+0000 7f6086000640 1 -- 172.21.15.37:0/2121647960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f608009b170 msgr2=0x7f608006cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.297+0000 7f6086000640 1 --2- 172.21.15.37:0/2121647960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f608009b170 0x7f608006cea0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6068009870 tx=0x7f606801c530 comp rx=0 tx=0).stop 2024-05-30T06:44:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.297+0000 7f6086000640 1 -- 172.21.15.37:0/2121647960 shutdown_connections 2024-05-30T06:44:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.297+0000 7f6086000640 1 --2- 172.21.15.37:0/2121647960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60800d10f0 0x7f60800d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.297+0000 7f6086000640 1 --2- 172.21.15.37:0/2121647960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f608009b170 0x7f608006cea0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.297+0000 7f6086000640 1 -- 172.21.15.37:0/2121647960 >> 172.21.15.37:0/2121647960 conn(0x7f60800b4100 msgr2=0x7f60800b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.297+0000 7f6086000640 1 -- 172.21.15.37:0/2121647960 shutdown_connections 2024-05-30T06:44:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.297+0000 7f6086000640 1 -- 172.21.15.37:0/2121647960 wait complete. 2024-05-30T06:44:52.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6086000640 1 Processor -- start 2024-05-30T06:44:52.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6086000640 1 -- start start 2024-05-30T06:44:52.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6086000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f608009b170 0x7f6080152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:52.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6086000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60800b39f0 0x7f6080155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:52.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6086000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60800d10f0 0x7f6080152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:52.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6086000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f608015e400 con 0x7f608009b170 2024-05-30T06:44:52.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6086000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f608015e280 con 0x7f60800b39f0 2024-05-30T06:44:52.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6086000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f608015e580 con 0x7f60800d10f0 2024-05-30T06:44:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f607f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f608009b170 0x7f6080152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f607f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f608009b170 0x7f6080152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59330/0 (socket says 172.21.15.37:59330) 2024-05-30T06:44:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f607f400640 1 -- 172.21.15.37:0/4008499497 learned_addr learned my addr 172.21.15.37:0/4008499497 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6076a00640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60800b39f0 0x7f6080155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f607fe00640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60800d10f0 0x7f6080152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f607f400640 1 -- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60800d10f0 msgr2=0x7f6080152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f607f400640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60800d10f0 0x7f6080152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f607f400640 1 -- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60800b39f0 msgr2=0x7f6080155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f607f400640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60800b39f0 0x7f6080155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f607f400640 1 -- 172.21.15.37:0/4008499497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6080155e90 con 0x7f608009b170 2024-05-30T06:44:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f607f400640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f608009b170 0x7f6080152420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f607000c420 tx=0x7f607000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6077e00640 1 -- 172.21.15.37:0/4008499497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60700074e0 con 0x7f608009b170 2024-05-30T06:44:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6077e00640 1 -- 172.21.15.37:0/4008499497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6070007680 con 0x7f608009b170 2024-05-30T06:44:52.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6077e00640 1 -- 172.21.15.37:0/4008499497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6070004a30 con 0x7f608009b170 2024-05-30T06:44:52.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6086000640 1 -- 172.21.15.37:0/4008499497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6080156170 con 0x7f608009b170 2024-05-30T06:44:52.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.301+0000 7f6086000640 1 -- 172.21.15.37:0/4008499497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60801590f0 con 0x7f608009b170 2024-05-30T06:44:52.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.305+0000 7f6086000640 1 -- 172.21.15.37:0/4008499497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6080156340 con 0x7f608009b170 2024-05-30T06:44:52.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.305+0000 7f6077e00640 1 -- 172.21.15.37:0/4008499497 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f607001a020 con 0x7f608009b170 2024-05-30T06:44:52.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.305+0000 7f6077e00640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f605c068530 0x7f605c06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:52.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.305+0000 7f6077e00640 1 -- 172.21.15.37:0/4008499497 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6070086380 con 0x7f608009b170 2024-05-30T06:44:52.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.305+0000 7f6076a00640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f605c068530 0x7f605c06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:52.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.305+0000 7f6076a00640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f605c068530 0x7f605c06a9f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f60680ae000 tx=0x7f60680b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:52.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.309+0000 7f6077e00640 1 -- 172.21.15.37:0/4008499497 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6070056060 con 0x7f608009b170 2024-05-30T06:44:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.529+0000 7f6086000640 1 -- 172.21.15.37:0/4008499497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6080068b20 con 0x7f608009b170 2024-05-30T06:44:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.529+0000 7f6077e00640 1 -- 172.21.15.37:0/4008499497 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2137 (secure 0 0 0) 0x7f607005a360 con 0x7f608009b170 2024-05-30T06:44:52.531 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:44:52.531 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:44:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:44:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:44:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:44:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:44:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:44:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:44:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:44:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:44:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:44:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:44:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:52.532 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 186, 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:44:52.533 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:44:52.534 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 2605, 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 10805742291, 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 21752467456, 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 751341645824, 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 9784603, 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 100301784, 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 2, 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 28 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 2, 2024-05-30T06:44:52.535 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 2, 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5040 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:52.536 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 5, 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:44:10.671476+0000", 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:44:52.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:44:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "d638d813-2312-4b75-9860-666ea42605c1": { 2024-05-30T06:44:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "1 ongoing clones; Avg progress is 10.313% (2s)\n [==..........................] (remaining: 18s)", 2024-05-30T06:44:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.10312999784946442, 2024-05-30T06:44:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:44:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:52.538 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:52.538 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:44:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.533+0000 7f6086000640 1 -- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f605c068530 msgr2=0x7f605c06a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.533+0000 7f6086000640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f605c068530 0x7f605c06a9f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f60680ae000 tx=0x7f60680b3040 comp rx=0 tx=0).stop 2024-05-30T06:44:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.533+0000 7f6086000640 1 -- 172.21.15.37:0/4008499497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f608009b170 msgr2=0x7f6080152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.533+0000 7f6086000640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f608009b170 0x7f6080152420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f607000c420 tx=0x7f607000c8e0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.533+0000 7f6086000640 1 -- 172.21.15.37:0/4008499497 shutdown_connections 2024-05-30T06:44:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.533+0000 7f6086000640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60800d10f0 0x7f6080152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.533+0000 7f6086000640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f605c068530 0x7f605c06a9f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.533+0000 7f6086000640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60800b39f0 0x7f6080155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.533+0000 7f6086000640 1 --2- 172.21.15.37:0/4008499497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f608009b170 0x7f6080152420 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:52.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.533+0000 7f6086000640 1 -- 172.21.15.37:0/4008499497 >> 172.21.15.37:0/4008499497 conn(0x7f60800b4100 msgr2=0x7f608006e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:52.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.533+0000 7f6086000640 1 -- 172.21.15.37:0/4008499497 shutdown_connections 2024-05-30T06:44:52.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:52.533+0000 7f6086000640 1 -- 172.21.15.37:0/4008499497 wait complete. 2024-05-30T06:44:57.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:44:57.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f4272c00640 1 Processor -- start 2024-05-30T06:44:57.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f4272c00640 1 -- start start 2024-05-30T06:44:57.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f4272c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f426c06e000 0x7f426c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:57.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f4272c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f426c15cd80 0x7f426c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:57.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f4272c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f426c0cd120 con 0x7f426c0cec40 2024-05-30T06:44:57.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f4272c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f426c0a9530 con 0x7f426c06e000 2024-05-30T06:44:57.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f4272c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f426c0cd400 con 0x7f426c15cd80 2024-05-30T06:44:57.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f426be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f426c06e000 0x7f426c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:57.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f426be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f426c06e000 0x7f426c0ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40400/0 (socket says 172.21.15.37:40400) 2024-05-30T06:44:57.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f426be00640 1 -- 172.21.15.37:0/4071295609 learned_addr learned my addr 172.21.15.37:0/4071295609 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:57.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f4270c00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f426c0cec40 0x7f426c06e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59326/0 (socket says 172.21.15.37:59326) 2024-05-30T06:44:57.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f4263400640 1 --2- 172.21.15.37:0/4071295609 >> v2:172.21.15.105:3300/0 conn(0x7f426c15cd80 0x7f426c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:57.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f426be00640 1 -- 172.21.15.37:0/4071295609 >> v2:172.21.15.105:3300/0 conn(0x7f426c15cd80 msgr2=0x7f426c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:44:57.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f426be00640 1 --2- 172.21.15.37:0/4071295609 >> v2:172.21.15.105:3300/0 conn(0x7f426c15cd80 0x7f426c0ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:57.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f426be00640 1 -- 172.21.15.37:0/4071295609 >> v1:172.21.15.37:6789/0 conn(0x7f426c0cec40 legacy=0x7f426c06e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:57.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f426be00640 1 -- 172.21.15.37:0/4071295609 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426c0cd6e0 con 0x7f426c06e000 2024-05-30T06:44:57.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.705+0000 7f4263400640 1 --2- 172.21.15.37:0/4071295609 >> v2:172.21.15.105:3300/0 conn(0x7f426c15cd80 0x7f426c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:44:57.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.709+0000 7f426be00640 1 --2- 172.21.15.37:0/4071295609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f426c06e000 0x7f426c0ce1c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f426c0cfb50 tx=0x7f425c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d73fdeede7b2123 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:57.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.709+0000 7f426b400640 1 -- 172.21.15.37:0/4071295609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c0b5070 con 0x7f426c06e000 2024-05-30T06:44:57.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.709+0000 7f426b400640 1 -- 172.21.15.37:0/4071295609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c0a8a10 con 0x7f426c06e000 2024-05-30T06:44:57.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.709+0000 7f426b400640 1 -- 172.21.15.37:0/4071295609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c0a8de0 con 0x7f426c06e000 2024-05-30T06:44:57.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.709+0000 7f4272c00640 1 -- 172.21.15.37:0/4071295609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f426c06e000 msgr2=0x7f426c0ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:57.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.709+0000 7f4272c00640 1 --2- 172.21.15.37:0/4071295609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f426c06e000 0x7f426c0ce1c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f426c0cfb50 tx=0x7f425c01ed10 comp rx=0 tx=0).stop 2024-05-30T06:44:57.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.709+0000 7f4272c00640 1 -- 172.21.15.37:0/4071295609 shutdown_connections 2024-05-30T06:44:57.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.709+0000 7f4272c00640 1 --2- 172.21.15.37:0/4071295609 >> v2:172.21.15.105:3300/0 conn(0x7f426c15cd80 0x7f426c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:57.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.709+0000 7f4272c00640 1 --2- 172.21.15.37:0/4071295609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f426c06e000 0x7f426c0ce1c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:57.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.709+0000 7f4272c00640 1 -- 172.21.15.37:0/4071295609 >> 172.21.15.37:0/4071295609 conn(0x7f426c0b23a0 msgr2=0x7f426c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:57.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.709+0000 7f4272c00640 1 -- 172.21.15.37:0/4071295609 shutdown_connections 2024-05-30T06:44:57.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.709+0000 7f4272c00640 1 -- 172.21.15.37:0/4071295609 wait complete. 2024-05-30T06:44:57.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4272c00640 1 Processor -- start 2024-05-30T06:44:57.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4272c00640 1 -- start start 2024-05-30T06:44:57.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4272c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f426c06e000 0x7f426c13a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:57.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4272c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f426c0cec40 0x7f426c159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:57.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4272c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f426c15cd80 0x7f426c159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:57.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4272c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f426c0cf090 con 0x7f426c06e000 2024-05-30T06:44:57.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4272c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f426c0cdca0 con 0x7f426c15cd80 2024-05-30T06:44:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4272c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f426c1663c0 con 0x7f426c0cec40 2024-05-30T06:44:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f426be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f426c06e000 0x7f426c13a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f426be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f426c06e000 0x7f426c13a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40404/0 (socket says 172.21.15.37:40404) 2024-05-30T06:44:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f426be00640 1 -- 172.21.15.37:0/2218537822 learned_addr learned my addr 172.21.15.37:0/2218537822 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:44:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4263400640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f426c0cec40 0x7f426c159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4270c00640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f426c15cd80 0x7f426c159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f426be00640 1 -- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f426c0cec40 msgr2=0x7f426c159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f426be00640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f426c0cec40 0x7f426c159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f426be00640 1 -- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f426c15cd80 msgr2=0x7f426c159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f426be00640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f426c15cd80 0x7f426c159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f426be00640 1 -- 172.21.15.37:0/2218537822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426c13a8f0 con 0x7f426c06e000 2024-05-30T06:44:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4270c00640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f426c15cd80 0x7f426c159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:44:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f426be00640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f426c06e000 0x7f426c13a3b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f425c01b920 tx=0x7f425c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:57.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4268c00640 1 -- 172.21.15.37:0/2218537822 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c0b5070 con 0x7f426c06e000 2024-05-30T06:44:57.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4268c00640 1 -- 172.21.15.37:0/2218537822 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c0b0c20 con 0x7f426c06e000 2024-05-30T06:44:57.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4268c00640 1 -- 172.21.15.37:0/2218537822 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c0bb410 con 0x7f426c06e000 2024-05-30T06:44:57.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4272c00640 1 -- 172.21.15.37:0/2218537822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f426c157220 con 0x7f426c06e000 2024-05-30T06:44:57.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.713+0000 7f4272c00640 1 -- 172.21.15.37:0/2218537822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f426c1577e0 con 0x7f426c06e000 2024-05-30T06:44:57.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.717+0000 7f4272c00640 1 -- 172.21.15.37:0/2218537822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f426c068b20 con 0x7f426c06e000 2024-05-30T06:44:57.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.717+0000 7f4268c00640 1 -- 172.21.15.37:0/2218537822 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f425c0c2060 con 0x7f426c06e000 2024-05-30T06:44:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.717+0000 7f4268c00640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4248068530 0x7f424806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:44:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.717+0000 7f4268c00640 1 -- 172.21.15.37:0/2218537822 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f425c123eb0 con 0x7f426c06e000 2024-05-30T06:44:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.717+0000 7f4263400640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4248068530 0x7f424806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:44:57.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.721+0000 7f4263400640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4248068530 0x7f424806a9f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f426c0b1940 tx=0x7f4254007810 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:44:57.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.721+0000 7f4268c00640 1 -- 172.21.15.37:0/2218537822 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f425c018870 con 0x7f426c06e000 2024-05-30T06:44:57.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4272c00640 1 -- 172.21.15.37:0/2218537822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f426c06f600 con 0x7f426c06e000 2024-05-30T06:44:57.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4268c00640 1 -- 172.21.15.37:0/2218537822 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2122 (secure 0 0 0) 0x7f425c0f4150 con 0x7f426c06e000 2024-05-30T06:44:57.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:44:57.945 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:44:57.945 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:44:57.946 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:44:57.946 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:44:57.946 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:44:57.946 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:44:57.946 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:57.946 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:44:57.946 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:44:57.946 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:44:57.946 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:44:57.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:44:57.946 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:57.946 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 192, 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:44:57.947 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:44:57.948 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:44:57.948 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:44:57.948 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:44:57.948 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:44:57.948 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:57.948 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:44:57.948 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:44:57.948 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:44:57.948 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:44:57.948 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:44:57.948 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:57.948 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:57.948 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:44:57.949 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:44:57.949 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 3022, 2024-05-30T06:44:57.949 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 12542296194, 2024-05-30T06:44:57.949 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 25343041536, 2024-05-30T06:44:57.949 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 747751071744, 2024-05-30T06:44:57.949 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:44:57.949 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 152345056, 2024-05-30T06:44:57.949 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 150266914, 2024-05-30T06:44:57.949 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 36, 2024-05-30T06:44:57.949 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 41 2024-05-30T06:44:57.949 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:57.949 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:44:57.949 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 2, 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 2, 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5040 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:57.950 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 5, 2024-05-30T06:44:57.951 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:44:10.671476+0000", 2024-05-30T06:44:57.952 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:44:57.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:44:57.952 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:44:57.952 INFO:teuthology.orchestra.run.smithi037.stdout: "d638d813-2312-4b75-9860-666ea42605c1": { 2024-05-30T06:44:57.952 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 27.0 seconds before exiting (7s)\n [============================] ", 2024-05-30T06:44:57.952 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:44:57.952 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:44:57.952 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:57.952 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:44:57.952 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:44:57.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4272c00640 1 -- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4248068530 msgr2=0x7f424806a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:57.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4272c00640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4248068530 0x7f424806a9f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f426c0b1940 tx=0x7f4254007810 comp rx=0 tx=0).stop 2024-05-30T06:44:57.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4272c00640 1 -- 172.21.15.37:0/2218537822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f426c06e000 msgr2=0x7f426c13a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:44:57.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4272c00640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f426c06e000 0x7f426c13a3b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f425c01b920 tx=0x7f425c01bab0 comp rx=0 tx=0).stop 2024-05-30T06:44:57.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4272c00640 1 -- 172.21.15.37:0/2218537822 shutdown_connections 2024-05-30T06:44:57.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4272c00640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4248068530 0x7f424806a9f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:57.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4272c00640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f426c15cd80 0x7f426c159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:57.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4272c00640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f426c0cec40 0x7f426c159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:57.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4272c00640 1 --2- 172.21.15.37:0/2218537822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f426c06e000 0x7f426c13a3b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:44:57.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4272c00640 1 -- 172.21.15.37:0/2218537822 >> 172.21.15.37:0/2218537822 conn(0x7f426c0b23a0 msgr2=0x7f426c15fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:44:57.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4272c00640 1 -- 172.21.15.37:0/2218537822 shutdown_connections 2024-05-30T06:44:57.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:44:57.945+0000 7f4272c00640 1 -- 172.21.15.37:0/2218537822 wait complete. 2024-05-30T06:45:02.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:45:03.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7ede00640 1 Processor -- start 2024-05-30T06:45:03.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7ede00640 1 -- start start 2024-05-30T06:45:03.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7ede00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa7e80ae620 0x7fa7e80d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:03.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7ede00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80d1b00 0x7fa7e80b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:03.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7ede00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7e80b0150 con 0x7fa7e8146110 2024-05-30T06:45:03.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7ede00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa7e81464f0 con 0x7fa7e80ae620 2024-05-30T06:45:03.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7ede00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa7e80b0430 con 0x7fa7e80d1b00 2024-05-30T06:45:03.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7e7400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80d1b00 0x7fa7e80b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:03.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7e6000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa7e80ae620 0x7fa7e80d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:03.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7e6a00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa7e8146110 0x7fa7e8160e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47998/0 (socket says 172.21.15.37:47998) 2024-05-30T06:45:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7e7400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80d1b00 0x7fa7e80b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:42948/0 (socket says 172.21.15.37:42948) 2024-05-30T06:45:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7e6a00640 1 -- 172.21.15.37:0/826273456 learned_addr learned my addr 172.21.15.37:0/826273456 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7e5600640 1 -- 172.21.15.37:0/826273456 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1320249460 0 0) 0x7fa7e80b0150 con 0x7fa7e8146110 2024-05-30T06:45:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7e5600640 1 -- 172.21.15.37:0/826273456 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7cc003530 con 0x7fa7e8146110 2024-05-30T06:45:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7e7400640 1 -- 172.21.15.37:0/826273456 >> v2:172.21.15.105:3300/0 conn(0x7fa7e80ae620 msgr2=0x7fa7e80d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7e7400640 1 --2- 172.21.15.37:0/826273456 >> v2:172.21.15.105:3300/0 conn(0x7fa7e80ae620 0x7fa7e80d15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7e7400640 1 -- 172.21.15.37:0/826273456 >> v1:172.21.15.105:6789/0 conn(0x7fa7e8146110 legacy=0x7fa7e8160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7e7400640 1 -- 172.21.15.37:0/826273456 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e80b0710 con 0x7fa7e80d1b00 2024-05-30T06:45:03.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.121+0000 7fa7e6000640 1 --2- 172.21.15.37:0/826273456 >> v2:172.21.15.105:3300/0 conn(0x7fa7e80ae620 0x7fa7e80d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:03.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.125+0000 7fa7e7400640 1 --2- 172.21.15.37:0/826273456 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80d1b00 0x7fa7e80b45d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009d90 tx=0x7fa7e001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1961bf39db1c5074 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:03.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.125+0000 7fa7e5600640 1 -- 172.21.15.37:0/826273456 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00b2070 con 0x7fa7e80d1b00 2024-05-30T06:45:03.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.125+0000 7fa7e5600640 1 -- 172.21.15.37:0/826273456 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e00a5890 con 0x7fa7e80d1b00 2024-05-30T06:45:03.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.125+0000 7fa7e5600640 1 -- 172.21.15.37:0/826273456 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00a5c60 con 0x7fa7e80d1b00 2024-05-30T06:45:03.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.125+0000 7fa7ede00640 1 -- 172.21.15.37:0/826273456 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80d1b00 msgr2=0x7fa7e80b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:03.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.125+0000 7fa7ede00640 1 --2- 172.21.15.37:0/826273456 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80d1b00 0x7fa7e80b45d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009d90 tx=0x7fa7e001c8e0 comp rx=0 tx=0).stop 2024-05-30T06:45:03.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.125+0000 7fa7ede00640 1 -- 172.21.15.37:0/826273456 shutdown_connections 2024-05-30T06:45:03.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.125+0000 7fa7ede00640 1 --2- 172.21.15.37:0/826273456 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80d1b00 0x7fa7e80b45d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:03.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.125+0000 7fa7ede00640 1 --2- 172.21.15.37:0/826273456 >> v2:172.21.15.105:3300/0 conn(0x7fa7e80ae620 0x7fa7e80d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:03.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.125+0000 7fa7ede00640 1 -- 172.21.15.37:0/826273456 >> 172.21.15.37:0/826273456 conn(0x7fa7e80b6a60 msgr2=0x7fa7e80b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.125+0000 7fa7ede00640 1 -- 172.21.15.37:0/826273456 shutdown_connections 2024-05-30T06:45:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.125+0000 7fa7ede00640 1 -- 172.21.15.37:0/826273456 wait complete. 2024-05-30T06:45:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7ede00640 1 Processor -- start 2024-05-30T06:45:03.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7ede00640 1 -- start start 2024-05-30T06:45:03.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7ede00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e80ae620 0x7fa7e81f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7ede00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80d1b00 0x7fa7e815c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7ede00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e8146110 0x7fa7e813e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7ede00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e80b54a0 con 0x7fa7e8146110 2024-05-30T06:45:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7ede00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa7e80b5320 con 0x7fa7e80ae620 2024-05-30T06:45:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7ede00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa7e80b5620 con 0x7fa7e80d1b00 2024-05-30T06:45:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7e7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e8146110 0x7fa7e813e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7e6a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e80ae620 0x7fa7e81f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7e6a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e80ae620 0x7fa7e81f84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:39562/0 (socket says 172.21.15.37:39562) 2024-05-30T06:45:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7e7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e8146110 0x7fa7e813e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40418/0 (socket says 172.21.15.37:40418) 2024-05-30T06:45:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7e6a00640 1 -- 172.21.15.37:0/2499793378 learned_addr learned my addr 172.21.15.37:0/2499793378 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:03.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7e6000640 1 --2- 172.21.15.37:0/2499793378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80d1b00 0x7fa7e815c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:03.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7e7400640 1 -- 172.21.15.37:0/2499793378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80d1b00 msgr2=0x7fa7e815c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:03.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7e7400640 1 --2- 172.21.15.37:0/2499793378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80d1b00 0x7fa7e815c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:03.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7e7400640 1 -- 172.21.15.37:0/2499793378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e80ae620 msgr2=0x7fa7e81f84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:03.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7e7400640 1 --2- 172.21.15.37:0/2499793378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e80ae620 0x7fa7e81f84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:03.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7e7400640 1 -- 172.21.15.37:0/2499793378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7e81f89f0 con 0x7fa7e8146110 2024-05-30T06:45:03.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7e7400640 1 --2- 172.21.15.37:0/2499793378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e8146110 0x7fa7e813e680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00ac000 tx=0x7fa7e0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:03.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7df400640 1 -- 172.21.15.37:0/2499793378 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00b2050 con 0x7fa7e8146110 2024-05-30T06:45:03.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7df400640 1 -- 172.21.15.37:0/2499793378 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e00b3040 con 0x7fa7e8146110 2024-05-30T06:45:03.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7df400640 1 -- 172.21.15.37:0/2499793378 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00ad650 con 0x7fa7e8146110 2024-05-30T06:45:03.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7ede00640 1 -- 172.21.15.37:0/2499793378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7e813f0d0 con 0x7fa7e8146110 2024-05-30T06:45:03.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7ede00640 1 -- 172.21.15.37:0/2499793378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7e81f7cb0 con 0x7fa7e8146110 2024-05-30T06:45:03.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.129+0000 7fa7ede00640 1 -- 172.21.15.37:0/2499793378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7e8068b20 con 0x7fa7e8146110 2024-05-30T06:45:03.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.133+0000 7fa7df400640 1 -- 172.21.15.37:0/2499793378 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7fa7e00c0020 con 0x7fa7e8146110 2024-05-30T06:45:03.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.133+0000 7fa7df400640 1 --2- 172.21.15.37:0/2499793378 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7c8068530 0x7fa7c806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:03.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.133+0000 7fa7df400640 1 -- 172.21.15.37:0/2499793378 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fa7e0121270 con 0x7fa7e8146110 2024-05-30T06:45:03.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.133+0000 7fa7e6a00640 1 --2- 172.21.15.37:0/2499793378 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7c8068530 0x7fa7c806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:03.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.133+0000 7fa7e6a00640 1 --2- 172.21.15.37:0/2499793378 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7c8068530 0x7fa7c806a9f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8007fd0 tx=0x7fa7d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:03.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.137+0000 7fa7df400640 1 -- 172.21.15.37:0/2499793378 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa7e00c7020 con 0x7fa7e8146110 2024-05-30T06:45:03.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7ede00640 1 -- 172.21.15.37:0/2499793378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa7e80b3ff0 con 0x7fa7e8146110 2024-05-30T06:45:03.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7df400640 1 -- 172.21.15.37:0/2499793378 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2123 (secure 0 0 0) 0x7fa7e0016560 con 0x7fa7e8146110 2024-05-30T06:45:03.362 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:03.363 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:45:03.363 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:45:03.363 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:45:03.363 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:45:03.363 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:45:03.363 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:45:03.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:03.363 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:45:03.363 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:45:03.363 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:45:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:45:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:45:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:45:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:45:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:45:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:45:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 197, 2024-05-30T06:45:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:45:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:45:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:45:03.364 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:03.365 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:45:03.366 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:45:03.366 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:03.366 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:03.366 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:45:03.366 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:45:03.366 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 3019, 2024-05-30T06:45:03.366 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 12542322077, 2024-05-30T06:45:03.366 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 25343066112, 2024-05-30T06:45:03.366 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 747751047168, 2024-05-30T06:45:03.366 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:45:03.366 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 142565755, 2024-05-30T06:45:03.366 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 144675099, 2024-05-30T06:45:03.366 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 34, 2024-05-30T06:45:03.367 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 39 2024-05-30T06:45:03.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:03.367 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:45:03.367 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-05-30T06:45:03.367 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 2, 2024-05-30T06:45:03.367 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:45:03.367 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:45:03.367 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:45:03.367 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:45:03.367 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:03.367 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 2, 2024-05-30T06:45:03.367 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:45:03.368 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:45:03.368 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:45:03.368 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5040 2024-05-30T06:45:03.368 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:03.368 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:03.368 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:45:03.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 5, 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:44:10.671476+0000", 2024-05-30T06:45:03.369 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:45:03.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:03.370 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:45:03.370 INFO:teuthology.orchestra.run.smithi037.stdout: "d638d813-2312-4b75-9860-666ea42605c1": { 2024-05-30T06:45:03.370 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 21.0 seconds before exiting (13s)\n [============================] ", 2024-05-30T06:45:03.370 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:45:03.370 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:45:03.370 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:03.370 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:03.370 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:45:03.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7ede00640 1 -- 172.21.15.37:0/2499793378 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7c8068530 msgr2=0x7fa7c806a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:03.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7ede00640 1 --2- 172.21.15.37:0/2499793378 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7c8068530 0x7fa7c806a9f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8007fd0 tx=0x7fa7d8009040 comp rx=0 tx=0).stop 2024-05-30T06:45:03.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7ede00640 1 -- 172.21.15.37:0/2499793378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e8146110 msgr2=0x7fa7e813e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:03.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7ede00640 1 --2- 172.21.15.37:0/2499793378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e8146110 0x7fa7e813e680 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00ac000 tx=0x7fa7e0019680 comp rx=0 tx=0).stop 2024-05-30T06:45:03.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7ede00640 1 -- 172.21.15.37:0/2499793378 shutdown_connections 2024-05-30T06:45:03.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7ede00640 1 --2- 172.21.15.37:0/2499793378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e8146110 0x7fa7e813e680 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:03.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7ede00640 1 --2- 172.21.15.37:0/2499793378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7e80d1b00 0x7fa7e815c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:03.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7ede00640 1 --2- 172.21.15.37:0/2499793378 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7c8068530 0x7fa7c806a9f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:03.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7ede00640 1 --2- 172.21.15.37:0/2499793378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7e80ae620 0x7fa7e81f84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:03.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7ede00640 1 -- 172.21.15.37:0/2499793378 >> 172.21.15.37:0/2499793378 conn(0x7fa7e80b6a60 msgr2=0x7fa7e8141ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:03.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7ede00640 1 -- 172.21.15.37:0/2499793378 shutdown_connections 2024-05-30T06:45:03.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:03.361+0000 7fa7ede00640 1 -- 172.21.15.37:0/2499793378 wait complete. 2024-05-30T06:45:04.033 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:45:04.037 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:45:08.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:45:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.537+0000 7fd213000640 1 Processor -- start 2024-05-30T06:45:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.537+0000 7fd213000640 1 -- start start 2024-05-30T06:45:08.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.537+0000 7fd213000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd20c155e60 0x7fd20c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:08.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.537+0000 7fd213000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd20c06f9a0 0x7fd20c0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:08.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.537+0000 7fd213000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd20c15c8f0 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.537+0000 7fd213000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd20c0ccff0 con 0x7fd20c06f9a0 2024-05-30T06:45:08.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.537+0000 7fd213000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd20c0ccc80 con 0x7fd20c155e60 2024-05-30T06:45:08.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd203400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd20c06f9a0 0x7fd20c0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:08.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd203400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd20c06f9a0 0x7fd20c0cf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58970/0 (socket says 172.21.15.37:58970) 2024-05-30T06:45:08.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd203400640 1 -- 172.21.15.37:0/3186211942 learned_addr learned my addr 172.21.15.37:0/3186211942 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:08.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd211000640 1 --1- 172.21.15.37:0/3186211942 >> v1:172.21.15.37:6789/0 conn(0x7fd20c0b2ec0 0x7fd20c0cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51862/0 (socket says 172.21.15.37:51862) 2024-05-30T06:45:08.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd20be00640 1 --2- 172.21.15.37:0/3186211942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd20c155e60 0x7fd20c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:08.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd203400640 1 -- 172.21.15.37:0/3186211942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd20c155e60 msgr2=0x7fd20c0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:08.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd203400640 1 --2- 172.21.15.37:0/3186211942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd20c155e60 0x7fd20c0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:08.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd203400640 1 -- 172.21.15.37:0/3186211942 >> v1:172.21.15.37:6789/0 conn(0x7fd20c0b2ec0 legacy=0x7fd20c0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:08.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd203400640 1 -- 172.21.15.37:0/3186211942 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c15cbd0 con 0x7fd20c06f9a0 2024-05-30T06:45:08.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd20b400640 1 -- 172.21.15.37:0/3186211942 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807955805 0 0) 0x7fd20c15c8f0 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd203400640 1 --2- 172.21.15.37:0/3186211942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20c06f9a0 0x7fd20c0cf660 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009870 tx=0x7fd1f401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17efe8ffaf94b435 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:08.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd20b400640 1 -- 172.21.15.37:0/3186211942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40ab430 con 0x7fd20c06f9a0 2024-05-30T06:45:08.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd20b400640 1 -- 172.21.15.37:0/3186211942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f40b0070 con 0x7fd20c06f9a0 2024-05-30T06:45:08.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.541+0000 7fd20b400640 1 -- 172.21.15.37:0/3186211942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40ab7f0 con 0x7fd20c06f9a0 2024-05-30T06:45:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 -- 172.21.15.37:0/3186211942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20c06f9a0 msgr2=0x7fd20c0cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 --2- 172.21.15.37:0/3186211942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20c06f9a0 0x7fd20c0cf660 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009870 tx=0x7fd1f401c560 comp rx=0 tx=0).stop 2024-05-30T06:45:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 -- 172.21.15.37:0/3186211942 shutdown_connections 2024-05-30T06:45:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 --2- 172.21.15.37:0/3186211942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20c06f9a0 0x7fd20c0cf660 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 --2- 172.21.15.37:0/3186211942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd20c155e60 0x7fd20c0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 -- 172.21.15.37:0/3186211942 >> 172.21.15.37:0/3186211942 conn(0x7fd20c0b23a0 msgr2=0x7fd20c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 -- 172.21.15.37:0/3186211942 shutdown_connections 2024-05-30T06:45:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 -- 172.21.15.37:0/3186211942 wait complete. 2024-05-30T06:45:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 Processor -- start 2024-05-30T06:45:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 -- start start 2024-05-30T06:45:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd20c06f9a0 0x7fd20c1f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20c0b2ec0 0x7fd20c1faa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd20c155e60 0x7fd20c150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c06ea10 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c06e890 con 0x7fd20c155e60 2024-05-30T06:45:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd213000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd20c06eb90 con 0x7fd20c06f9a0 2024-05-30T06:45:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd203400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20c0b2ec0 0x7fd20c1faa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd203400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20c0b2ec0 0x7fd20c1faa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58978/0 (socket says 172.21.15.37:58978) 2024-05-30T06:45:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd203400640 1 -- 172.21.15.37:0/338216193 learned_addr learned my addr 172.21.15.37:0/338216193 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd20be00640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd20c06f9a0 0x7fd20c1f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd211000640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd20c155e60 0x7fd20c150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd203400640 1 -- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd20c06f9a0 msgr2=0x7fd20c1f7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd203400640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd20c06f9a0 0x7fd20c1f7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd203400640 1 -- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd20c155e60 msgr2=0x7fd20c150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd203400640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd20c155e60 0x7fd20c150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.545+0000 7fd203400640 1 -- 172.21.15.37:0/338216193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c1562e0 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.549+0000 7fd203400640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20c0b2ec0 0x7fd20c1faa30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd1f401a190 tx=0x7fd1f4019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:08.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.549+0000 7fd208c00640 1 -- 172.21.15.37:0/338216193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40abe20 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.549+0000 7fd208c00640 1 -- 172.21.15.37:0/338216193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f40b4420 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.549+0000 7fd208c00640 1 -- 172.21.15.37:0/338216193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40b4610 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.549+0000 7fd213000640 1 -- 172.21.15.37:0/338216193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20c156580 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.549+0000 7fd213000640 1 -- 172.21.15.37:0/338216193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20c156b40 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.549+0000 7fd213000640 1 -- 172.21.15.37:0/338216193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd20c068b20 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.549+0000 7fd208c00640 1 -- 172.21.15.37:0/338216193 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7fd1f40bd020 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.549+0000 7fd208c00640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1e8068530 0x7fd1e806a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:08.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.549+0000 7fd208c00640 1 -- 172.21.15.37:0/338216193 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fd1f4120120 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.549+0000 7fd20be00640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1e8068530 0x7fd1e806a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:08.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.553+0000 7fd20be00640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1e8068530 0x7fd1e806a9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009ac0 tx=0x7fd1fc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:08.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.553+0000 7fd208c00640 1 -- 172.21.15.37:0/338216193 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd1f40c4020 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.781+0000 7fd213000640 1 -- 172.21.15.37:0/338216193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd20c072fb0 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.785+0000 7fd208c00640 1 -- 172.21.15.37:0/338216193 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2110 (secure 0 0 0) 0x7fd1f4016150 con 0x7fd20c0b2ec0 2024-05-30T06:45:08.785 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:08.785 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:45:08.785 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:45:08.785 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:45:08.785 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:45:08.785 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:45:08.785 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:45:08.785 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:08.785 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:45:08.785 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:45:08.786 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:45:08.786 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:45:08.786 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:45:08.786 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:08.786 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:45:08.786 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:45:08.786 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:45:08.786 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:45:08.786 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:08.786 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 203, 2024-05-30T06:45:08.786 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:45:08.786 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:45:08.787 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:45:08.787 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:45:08.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:08.787 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:45:08.787 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-05-30T06:45:08.787 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:45:08.787 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:45:08.787 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:45:08.787 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:45:08.787 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:45:08.787 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:45:08.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:08.788 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:45:08.788 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:45:08.788 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:08.788 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:45:08.788 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:45:08.788 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:08.788 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:08.788 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:45:08.788 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:45:08.788 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 3019, 2024-05-30T06:45:08.789 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 12542330227, 2024-05-30T06:45:08.789 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 25343115264, 2024-05-30T06:45:08.789 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 747750998016, 2024-05-30T06:45:08.789 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:45:08.789 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 255, 2024-05-30T06:45:08.789 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 3497, 2024-05-30T06:45:08.789 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:45:08.789 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 1 2024-05-30T06:45:08.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:08.789 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:45:08.789 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-05-30T06:45:08.789 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 2, 2024-05-30T06:45:08.790 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:45:08.790 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:45:08.790 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:45:08.790 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:45:08.790 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:08.790 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 2, 2024-05-30T06:45:08.790 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:45:08.790 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:45:08.790 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:45:08.790 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5040 2024-05-30T06:45:08.790 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:08.790 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:08.790 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 5, 2024-05-30T06:45:08.791 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:44:10.671476+0000", 2024-05-30T06:45:08.792 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:45:08.792 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:08.792 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:45:08.792 INFO:teuthology.orchestra.run.smithi037.stdout: "d638d813-2312-4b75-9860-666ea42605c1": { 2024-05-30T06:45:08.792 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 15.0 seconds before exiting (19s)\n [============================] ", 2024-05-30T06:45:08.792 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:45:08.792 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:45:08.792 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:08.792 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:08.792 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:45:08.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.785+0000 7fd213000640 1 -- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1e8068530 msgr2=0x7fd1e806a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:08.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.785+0000 7fd213000640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1e8068530 0x7fd1e806a9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009ac0 tx=0x7fd1fc009190 comp rx=0 tx=0).stop 2024-05-30T06:45:08.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.785+0000 7fd213000640 1 -- 172.21.15.37:0/338216193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20c0b2ec0 msgr2=0x7fd20c1faa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:08.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.785+0000 7fd213000640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20c0b2ec0 0x7fd20c1faa30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd1f401a190 tx=0x7fd1f4019300 comp rx=0 tx=0).stop 2024-05-30T06:45:08.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.785+0000 7fd213000640 1 -- 172.21.15.37:0/338216193 shutdown_connections 2024-05-30T06:45:08.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.785+0000 7fd213000640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1e8068530 0x7fd1e806a9f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:08.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.785+0000 7fd213000640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd20c155e60 0x7fd20c150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:08.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.785+0000 7fd213000640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20c0b2ec0 0x7fd20c1faa30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:08.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.785+0000 7fd213000640 1 --2- 172.21.15.37:0/338216193 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd20c06f9a0 0x7fd20c1f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:08.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.785+0000 7fd213000640 1 -- 172.21.15.37:0/338216193 >> 172.21.15.37:0/338216193 conn(0x7fd20c0b23a0 msgr2=0x7fd20c074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:08.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.785+0000 7fd213000640 1 -- 172.21.15.37:0/338216193 shutdown_connections 2024-05-30T06:45:08.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:08.785+0000 7fd213000640 1 -- 172.21.15.37:0/338216193 wait complete. 2024-05-30T06:45:13.807 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:45:13.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.957+0000 7f2b5ae00640 1 Processor -- start 2024-05-30T06:45:13.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.957+0000 7f2b5ae00640 1 -- start start 2024-05-30T06:45:13.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b5ae00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2b540b2ec0 0x7f2b540b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:13.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b5ae00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5415c8f0 con 0x7f2b5406f9a0 2024-05-30T06:45:13.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b5ae00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b540ccc80 con 0x7f2b54155e60 2024-05-30T06:45:13.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b5ae00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2b540ccff0 con 0x7f2b540b2ec0 2024-05-30T06:45:13.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b4b400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2b5406f9a0 0x7f2b540cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51868/0 (socket says 172.21.15.37:51868) 2024-05-30T06:45:13.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b4b400640 1 -- 172.21.15.37:0/971031590 learned_addr learned my addr 172.21.15.37:0/971031590 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:13.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b58e00640 1 --2- 172.21.15.37:0/971031590 >> v2:172.21.15.105:3300/0 conn(0x7f2b540b2ec0 0x7f2b540b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:13.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301351402 0 0) 0x7f2b5415c8f0 con 0x7f2b5406f9a0 2024-05-30T06:45:13.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b38005740 con 0x7f2b5406f9a0 2024-05-30T06:45:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3665851663 0 0) 0x7f2b540ccc80 con 0x7f2b54155e60 2024-05-30T06:45:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b5415c8f0 con 0x7f2b54155e60 2024-05-30T06:45:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2216928046 0 0) 0x7f2b38005740 con 0x7f2b5406f9a0 2024-05-30T06:45:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 >> v2:172.21.15.105:3300/0 conn(0x7f2b540b2ec0 msgr2=0x7f2b540b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 --2- 172.21.15.37:0/971031590 >> v2:172.21.15.105:3300/0 conn(0x7f2b540b2ec0 0x7f2b540b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 >> v1:172.21.15.105:6789/0 conn(0x7f2b54155e60 legacy=0x7f2b540cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5415cbd0 con 0x7f2b5406f9a0 2024-05-30T06:45:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f2b3c001680 con 0x7f2b5406f9a0 2024-05-30T06:45:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 >> v1:172.21.15.37:6789/0 conn(0x7f2b5406f9a0 legacy=0x7f2b540cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 --2- 172.21.15.37:0/971031590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b38005d60 0x7f2b38006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 --2- 172.21.15.37:0/971031590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b38006a20 0x7f2b38006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 --2- 172.21.15.37:0/971031590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b380073e0 0x7f2b3800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:13.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b540ccff0 con 0x7f2b38005d60 2024-05-30T06:45:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3800e260 con 0x7f2b380073e0 2024-05-30T06:45:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2b3800e460 con 0x7f2b38006a20 2024-05-30T06:45:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b58e00640 1 --2- 172.21.15.37:0/971031590 >> v2:172.21.15.105:3300/0 conn(0x7f2b540b2ec0 0x7f2b540b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53e00640 1 --2- 172.21.15.37:0/971031590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b38005d60 0x7f2b38006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b4b400640 1 --2- 172.21.15.37:0/971031590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b38006a20 0x7f2b38006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b58e00640 1 --2- 172.21.15.37:0/971031590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b380073e0 0x7f2b3800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53e00640 1 -- 172.21.15.37:0/971031590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b38006a20 msgr2=0x7f2b38006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53e00640 1 --2- 172.21.15.37:0/971031590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b38006a20 0x7f2b38006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53e00640 1 -- 172.21.15.37:0/971031590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b380073e0 msgr2=0x7f2b3800dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53e00640 1 --2- 172.21.15.37:0/971031590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b380073e0 0x7f2b3800dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b53e00640 1 -- 172.21.15.37:0/971031590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b38005740 con 0x7f2b38005d60 2024-05-30T06:45:13.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.961+0000 7f2b58e00640 1 -- 172.21.15.37:0/971031590 reap_dead start 2024-05-30T06:45:13.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.965+0000 7f2b53e00640 1 --2- 172.21.15.37:0/971031590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b38005d60 0x7f2b38006160 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2b440018c0 tx=0x7f2b4401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917db948642a093d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:13.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.965+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44001510 con 0x7f2b38005d60 2024-05-30T06:45:13.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.965+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b440a8050 con 0x7f2b38005d60 2024-05-30T06:45:13.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.965+0000 7f2b53400640 1 -- 172.21.15.37:0/971031590 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44003600 con 0x7f2b38005d60 2024-05-30T06:45:13.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.965+0000 7f2b5ae00640 1 -- 172.21.15.37:0/971031590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b38005d60 msgr2=0x7f2b38006160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:13.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.965+0000 7f2b5ae00640 1 --2- 172.21.15.37:0/971031590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b38005d60 0x7f2b38006160 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2b440018c0 tx=0x7f2b4401c520 comp rx=0 tx=0).stop 2024-05-30T06:45:13.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.965+0000 7f2b5ae00640 1 -- 172.21.15.37:0/971031590 shutdown_connections 2024-05-30T06:45:13.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.965+0000 7f2b5ae00640 1 --2- 172.21.15.37:0/971031590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b38005d60 0x7f2b38006160 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:13.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.965+0000 7f2b5ae00640 1 -- 172.21.15.37:0/971031590 >> 172.21.15.37:0/971031590 conn(0x7f2b540b23a0 msgr2=0x7f2b540b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:13.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.965+0000 7f2b5ae00640 1 -- 172.21.15.37:0/971031590 shutdown_connections 2024-05-30T06:45:13.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.965+0000 7f2b5ae00640 1 -- 172.21.15.37:0/971031590 wait complete. 2024-05-30T06:45:13.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b5ae00640 1 Processor -- start 2024-05-30T06:45:13.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b5ae00640 1 -- start start 2024-05-30T06:45:13.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b5ae00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b38005d60 0x7f2b540b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:13.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b5ae00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b541f7530 0x7f2b54153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:13.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b5ae00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b54156240 0x7f2b540ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:13.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b5ae00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b540cff20 con 0x7f2b541f7530 2024-05-30T06:45:13.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b5ae00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2b540cfda0 con 0x7f2b54156240 2024-05-30T06:45:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b5ae00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2b540d00a0 con 0x7f2b38005d60 2024-05-30T06:45:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b4b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b541f7530 0x7f2b54153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b4b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b541f7530 0x7f2b54153ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58992/0 (socket says 172.21.15.37:58992) 2024-05-30T06:45:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b4b400640 1 -- 172.21.15.37:0/432555930 learned_addr learned my addr 172.21.15.37:0/432555930 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b53e00640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b38005d60 0x7f2b540b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b58e00640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b54156240 0x7f2b540ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b4b400640 1 -- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b38005d60 msgr2=0x7f2b540b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b4b400640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b38005d60 0x7f2b540b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b4b400640 1 -- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b54156240 msgr2=0x7f2b540ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b4b400640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b54156240 0x7f2b540ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b4b400640 1 -- 172.21.15.37:0/432555930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b54154410 con 0x7f2b541f7530 2024-05-30T06:45:13.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b58e00640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b54156240 0x7f2b540ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b4b400640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b541f7530 0x7f2b54153ed0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c000fc0 tx=0x7f2b3c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b50c00640 1 -- 172.21.15.37:0/432555930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00c660 con 0x7f2b541f7530 2024-05-30T06:45:13.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b50c00640 1 -- 172.21.15.37:0/432555930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b3c018070 con 0x7f2b541f7530 2024-05-30T06:45:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b50c00640 1 -- 172.21.15.37:0/432555930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00ca00 con 0x7f2b541f7530 2024-05-30T06:45:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b5ae00640 1 -- 172.21.15.37:0/432555930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b541f7ca0 con 0x7f2b541f7530 2024-05-30T06:45:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b5ae00640 1 -- 172.21.15.37:0/432555930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b541f8260 con 0x7f2b541f7530 2024-05-30T06:45:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.969+0000 7f2b5ae00640 1 -- 172.21.15.37:0/432555930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b541f8460 con 0x7f2b541f7530 2024-05-30T06:45:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.973+0000 7f2b50c00640 1 -- 172.21.15.37:0/432555930 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f2b3c00cba0 con 0x7f2b541f7530 2024-05-30T06:45:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.973+0000 7f2b50c00640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2b30068530 0x7f2b3006a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.973+0000 7f2b50c00640 1 -- 172.21.15.37:0/432555930 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f2b3c086980 con 0x7f2b541f7530 2024-05-30T06:45:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.973+0000 7f2b53e00640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2b30068530 0x7f2b3006a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:13.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.973+0000 7f2b53e00640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2b30068530 0x7f2b3006a9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2b440ad000 tx=0x7f2b44001350 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:13.977+0000 7f2b50c00640 1 -- 172.21.15.37:0/432555930 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2b3c056ca0 con 0x7f2b541f7530 2024-05-30T06:45:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.201+0000 7f2b5ae00640 1 -- 172.21.15.37:0/432555930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2b540afc90 con 0x7f2b541f7530 2024-05-30T06:45:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.201+0000 7f2b50c00640 1 -- 172.21.15.37:0/432555930 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2078 (secure 0 0 0) 0x7f2b3c0565a0 con 0x7f2b541f7530 2024-05-30T06:45:14.203 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:14.203 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:45:14.203 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:45:14.203 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:45:14.203 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:45:14.203 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:45:14.203 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:45:14.203 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:14.203 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:45:14.204 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:45:14.204 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:45:14.204 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:45:14.204 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:45:14.204 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:14.205 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:45:14.205 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:45:14.205 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:45:14.205 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:45:14.205 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:14.205 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 208, 2024-05-30T06:45:14.205 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:45:14.205 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:45:14.205 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:45:14.205 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:45:14.205 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:14.205 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:45:14.206 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-05-30T06:45:14.206 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:45:14.206 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:45:14.206 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:45:14.206 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:45:14.206 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:45:14.206 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:45:14.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:14.206 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:45:14.206 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:45:14.206 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:14.206 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:45:14.207 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:45:14.207 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:14.207 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:14.207 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:45:14.207 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:45:14.207 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 3019, 2024-05-30T06:45:14.207 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 12542331842, 2024-05-30T06:45:14.207 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 25343131648, 2024-05-30T06:45:14.207 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 747750981632, 2024-05-30T06:45:14.207 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:45:14.207 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 938, 2024-05-30T06:45:14.207 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:45:14.207 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:45:14.208 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:14.208 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:45:14.208 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-05-30T06:45:14.208 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 2, 2024-05-30T06:45:14.208 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:45:14.208 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:45:14.208 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:45:14.208 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:45:14.208 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:14.208 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 2, 2024-05-30T06:45:14.208 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:45:14.208 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:45:14.208 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:45:14.209 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5040 2024-05-30T06:45:14.209 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:14.209 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:14.209 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:45:14.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:14.209 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:45:14.209 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:45:14.209 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:45:14.209 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:45:14.209 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:45:14.209 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:45:14.209 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:45:14.209 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:14.210 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:45:14.210 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:14.210 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:45:14.210 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 5, 2024-05-30T06:45:14.210 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:44:10.671476+0000", 2024-05-30T06:45:14.210 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:45:14.210 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:14.210 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:45:14.210 INFO:teuthology.orchestra.run.smithi037.stdout: "d638d813-2312-4b75-9860-666ea42605c1": { 2024-05-30T06:45:14.210 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 11.0 seconds before exiting (23s)\n [============================] ", 2024-05-30T06:45:14.210 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:45:14.210 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:45:14.211 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:14.211 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:14.211 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:45:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.205+0000 7f2b5ae00640 1 -- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2b30068530 msgr2=0x7f2b3006a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.205+0000 7f2b5ae00640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2b30068530 0x7f2b3006a9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2b440ad000 tx=0x7f2b44001350 comp rx=0 tx=0).stop 2024-05-30T06:45:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.205+0000 7f2b5ae00640 1 -- 172.21.15.37:0/432555930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b541f7530 msgr2=0x7f2b54153ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.205+0000 7f2b5ae00640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b541f7530 0x7f2b54153ed0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c000fc0 tx=0x7f2b3c00eb90 comp rx=0 tx=0).stop 2024-05-30T06:45:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.205+0000 7f2b5ae00640 1 -- 172.21.15.37:0/432555930 shutdown_connections 2024-05-30T06:45:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.205+0000 7f2b5ae00640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2b30068530 0x7f2b3006a9f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.205+0000 7f2b5ae00640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b54156240 0x7f2b540ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.205+0000 7f2b5ae00640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b541f7530 0x7f2b54153ed0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.205+0000 7f2b5ae00640 1 --2- 172.21.15.37:0/432555930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b38005d60 0x7f2b540b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.205+0000 7f2b5ae00640 1 -- 172.21.15.37:0/432555930 >> 172.21.15.37:0/432555930 conn(0x7f2b540b23a0 msgr2=0x7f2b54071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.205+0000 7f2b5ae00640 1 -- 172.21.15.37:0/432555930 shutdown_connections 2024-05-30T06:45:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:14.205+0000 7f2b5ae00640 1 -- 172.21.15.37:0/432555930 wait complete. 2024-05-30T06:45:19.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:45:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.377+0000 7f3b77200640 1 Processor -- start 2024-05-30T06:45:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.377+0000 7f3b77200640 1 -- start start 2024-05-30T06:45:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.377+0000 7f3b77200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b70155e60 0x7f3b700b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.377+0000 7f3b77200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b7006f9a0 0x7f3b700cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.377+0000 7f3b77200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3b700b2ec0 0x7f3b700cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.377+0000 7f3b77200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3b700ccff0 con 0x7f3b70155e60 2024-05-30T06:45:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.377+0000 7f3b77200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3b700d00e0 con 0x7f3b700b2ec0 2024-05-30T06:45:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.377+0000 7f3b77200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7015c8f0 con 0x7f3b7006f9a0 2024-05-30T06:45:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.377+0000 7f3b6fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b70155e60 0x7f3b700b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.377+0000 7f3b6fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b70155e60 0x7f3b700b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42014/0 (socket says 172.21.15.37:42014) 2024-05-30T06:45:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.377+0000 7f3b6fe00640 1 -- 172.21.15.37:0/738766393 learned_addr learned my addr 172.21.15.37:0/738766393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.377+0000 7f3b75200640 1 --2- 172.21.15.37:0/738766393 >> v2:172.21.15.105:3300/0 conn(0x7f3b700b2ec0 0x7f3b700cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.377+0000 7f3b67400640 1 --2- 172.21.15.37:0/738766393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b7006f9a0 0x7f3b700cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b6fe00640 1 -- 172.21.15.37:0/738766393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b7006f9a0 msgr2=0x7f3b700cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b6fe00640 1 --2- 172.21.15.37:0/738766393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b7006f9a0 0x7f3b700cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b6fe00640 1 -- 172.21.15.37:0/738766393 >> v2:172.21.15.105:3300/0 conn(0x7f3b700b2ec0 msgr2=0x7f3b700cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b6fe00640 1 --2- 172.21.15.37:0/738766393 >> v2:172.21.15.105:3300/0 conn(0x7f3b700b2ec0 0x7f3b700cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b6fe00640 1 -- 172.21.15.37:0/738766393 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b700ccc80 con 0x7f3b70155e60 2024-05-30T06:45:19.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b6fe00640 1 --2- 172.21.15.37:0/738766393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b70155e60 0x7f3b700b36a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3b70070df0 tx=0x7f3b6001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7d90a0334f5457 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:19.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b6f400640 1 -- 172.21.15.37:0/738766393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b600ab5f0 con 0x7f3b70155e60 2024-05-30T06:45:19.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b6f400640 1 -- 172.21.15.37:0/738766393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b600b0070 con 0x7f3b70155e60 2024-05-30T06:45:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b6f400640 1 -- 172.21.15.37:0/738766393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b600ab9b0 con 0x7f3b70155e60 2024-05-30T06:45:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b77200640 1 -- 172.21.15.37:0/738766393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b70155e60 msgr2=0x7f3b700b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b77200640 1 --2- 172.21.15.37:0/738766393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b70155e60 0x7f3b700b36a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3b70070df0 tx=0x7f3b6001c520 comp rx=0 tx=0).stop 2024-05-30T06:45:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b77200640 1 -- 172.21.15.37:0/738766393 shutdown_connections 2024-05-30T06:45:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b77200640 1 --2- 172.21.15.37:0/738766393 >> v2:172.21.15.105:3300/0 conn(0x7f3b700b2ec0 0x7f3b700cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b77200640 1 --2- 172.21.15.37:0/738766393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b7006f9a0 0x7f3b700cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b77200640 1 --2- 172.21.15.37:0/738766393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b70155e60 0x7f3b700b36a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b77200640 1 -- 172.21.15.37:0/738766393 >> 172.21.15.37:0/738766393 conn(0x7f3b700b23a0 msgr2=0x7f3b700b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.381+0000 7f3b77200640 1 -- 172.21.15.37:0/738766393 shutdown_connections 2024-05-30T06:45:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b77200640 1 -- 172.21.15.37:0/738766393 wait complete. 2024-05-30T06:45:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b77200640 1 Processor -- start 2024-05-30T06:45:19.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b77200640 1 -- start start 2024-05-30T06:45:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b77200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7006f9a0 0x7f3b70131e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b77200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b700b2ec0 0x7f3b7015ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b77200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b70155e60 0x7f3b70146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b77200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b700ce020 con 0x7f3b7006f9a0 2024-05-30T06:45:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b77200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3b700cdea0 con 0x7f3b70155e60 2024-05-30T06:45:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b77200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3b700ce1a0 con 0x7f3b700b2ec0 2024-05-30T06:45:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b6fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7006f9a0 0x7f3b70131e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b6fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7006f9a0 0x7f3b70131e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42024/0 (socket says 172.21.15.37:42024) 2024-05-30T06:45:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b6fe00640 1 -- 172.21.15.37:0/3980520539 learned_addr learned my addr 172.21.15.37:0/3980520539 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b75200640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b70155e60 0x7f3b70146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b67400640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b700b2ec0 0x7f3b7015ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b6fe00640 1 -- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b700b2ec0 msgr2=0x7f3b7015ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b6fe00640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b700b2ec0 0x7f3b7015ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b6fe00640 1 -- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b70155e60 msgr2=0x7f3b70146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b6fe00640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b70155e60 0x7f3b70146ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b6fe00640 1 -- 172.21.15.37:0/3980520539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b700b2130 con 0x7f3b7006f9a0 2024-05-30T06:45:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b6fe00640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7006f9a0 0x7f3b70131e30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3b600ad040 tx=0x7f3b6001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b6cc00640 1 -- 172.21.15.37:0/3980520539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b600be3f0 con 0x7f3b7006f9a0 2024-05-30T06:45:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b6cc00640 1 -- 172.21.15.37:0/3980520539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b600be5b0 con 0x7f3b7006f9a0 2024-05-30T06:45:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b6cc00640 1 -- 172.21.15.37:0/3980520539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b600be9a0 con 0x7f3b7006f9a0 2024-05-30T06:45:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.385+0000 7f3b77200640 1 -- 172.21.15.37:0/3980520539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b70132480 con 0x7f3b7006f9a0 2024-05-30T06:45:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.389+0000 7f3b77200640 1 -- 172.21.15.37:0/3980520539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7015d9d0 con 0x7f3b7006f9a0 2024-05-30T06:45:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.389+0000 7f3b77200640 1 -- 172.21.15.37:0/3980520539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b70068b20 con 0x7f3b7006f9a0 2024-05-30T06:45:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.389+0000 7f3b6cc00640 1 -- 172.21.15.37:0/3980520539 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f3b600b43f0 con 0x7f3b7006f9a0 2024-05-30T06:45:19.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.389+0000 7f3b6cc00640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b4c068530 0x7f3b4c06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:19.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.389+0000 7f3b6cc00640 1 -- 172.21.15.37:0/3980520539 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f3b60120c50 con 0x7f3b7006f9a0 2024-05-30T06:45:19.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.389+0000 7f3b67400640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b4c068530 0x7f3b4c06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:19.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.389+0000 7f3b67400640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b4c068530 0x7f3b4c06a9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3b70138540 tx=0x7f3b58009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:19.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.393+0000 7f3b6cc00640 1 -- 172.21.15.37:0/3980520539 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3b60016110 con 0x7f3b7006f9a0 2024-05-30T06:45:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.617+0000 7f3b77200640 1 -- 172.21.15.37:0/3980520539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f3b70072fb0 con 0x7f3b7006f9a0 2024-05-30T06:45:19.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.617+0000 7f3b6cc00640 1 -- 172.21.15.37:0/3980520539 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2077 (secure 0 0 0) 0x7f3b600f08d0 con 0x7f3b7006f9a0 2024-05-30T06:45:19.619 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:19.619 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:45:19.619 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:45:19.619 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:45:19.619 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:45:19.619 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:45:19.619 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:45:19.619 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:19.619 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:45:19.619 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:45:19.620 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:45:19.620 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:45:19.620 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:45:19.620 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:19.620 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:45:19.620 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:45:19.620 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:45:19.620 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:45:19.620 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:19.620 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 213, 2024-05-30T06:45:19.620 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:45:19.620 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:45:19.620 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:45:19.621 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:45:19.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:19.621 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:45:19.621 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-05-30T06:45:19.621 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:45:19.621 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:45:19.621 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:45:19.621 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:45:19.621 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:45:19.621 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:45:19.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:19.621 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:45:19.621 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:45:19.622 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:19.622 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:45:19.622 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:45:19.622 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:19.622 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:19.622 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:45:19.622 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:45:19.622 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 3019, 2024-05-30T06:45:19.622 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 12542339992, 2024-05-30T06:45:19.622 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 25343148032, 2024-05-30T06:45:19.622 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 747750965248, 2024-05-30T06:45:19.622 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:45:19.623 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 938, 2024-05-30T06:45:19.623 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:45:19.623 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:45:19.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:19.623 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:45:19.623 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-05-30T06:45:19.623 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 2, 2024-05-30T06:45:19.623 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:45:19.623 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:45:19.623 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:45:19.623 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:45:19.623 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:19.623 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 2, 2024-05-30T06:45:19.624 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:45:19.624 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:45:19.624 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:45:19.624 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5040 2024-05-30T06:45:19.624 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:19.624 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:19.624 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:45:19.624 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:19.624 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:45:19.624 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:45:19.624 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:45:19.624 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:45:19.624 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 5, 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:44:10.671476+0000", 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: "d638d813-2312-4b75-9860-666ea42605c1": { 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 5.0 seconds before exiting (29s)\n [============================] ", 2024-05-30T06:45:19.625 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:45:19.626 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:45:19.626 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:19.626 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:19.626 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:45:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.621+0000 7f3b77200640 1 -- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b4c068530 msgr2=0x7f3b4c06a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.621+0000 7f3b77200640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b4c068530 0x7f3b4c06a9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3b70138540 tx=0x7f3b58009190 comp rx=0 tx=0).stop 2024-05-30T06:45:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.621+0000 7f3b77200640 1 -- 172.21.15.37:0/3980520539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7006f9a0 msgr2=0x7f3b70131e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.621+0000 7f3b77200640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7006f9a0 0x7f3b70131e30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3b600ad040 tx=0x7f3b6001ad60 comp rx=0 tx=0).stop 2024-05-30T06:45:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.621+0000 7f3b77200640 1 -- 172.21.15.37:0/3980520539 shutdown_connections 2024-05-30T06:45:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.621+0000 7f3b77200640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b4c068530 0x7f3b4c06a9f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.621+0000 7f3b77200640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b70155e60 0x7f3b70146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.621+0000 7f3b77200640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b700b2ec0 0x7f3b7015ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.621+0000 7f3b77200640 1 --2- 172.21.15.37:0/3980520539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7006f9a0 0x7f3b70131e30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.621+0000 7f3b77200640 1 -- 172.21.15.37:0/3980520539 >> 172.21.15.37:0/3980520539 conn(0x7f3b700b23a0 msgr2=0x7f3b700b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.621+0000 7f3b77200640 1 -- 172.21.15.37:0/3980520539 shutdown_connections 2024-05-30T06:45:19.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:19.621+0000 7f3b77200640 1 -- 172.21.15.37:0/3980520539 wait complete. 2024-05-30T06:45:24.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:45:24.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.793+0000 7f48c5e00640 1 Processor -- start 2024-05-30T06:45:24.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.793+0000 7f48c5e00640 1 -- start start 2024-05-30T06:45:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48c5e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f48c015e930 0x7f48c009b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48c5e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48c0162cb0 0x7f48c00ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48c5e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c009abe0 con 0x7f48c00d1240 2024-05-30T06:45:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48c5e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f48c009bee0 con 0x7f48c015e930 2024-05-30T06:45:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48c5e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f48c009aec0 con 0x7f48c0162cb0 2024-05-30T06:45:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48bf400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48c0162cb0 0x7f48c00ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48bea00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f48c015e930 0x7f48c009b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48b7e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f48c00d1240 0x7f48c01625a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:41664/0 (socket says 172.21.15.37:41664) 2024-05-30T06:45:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48b7e00640 1 -- 172.21.15.37:0/4005845691 learned_addr learned my addr 172.21.15.37:0/4005845691 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48bf400640 1 -- 172.21.15.37:0/4005845691 >> v2:172.21.15.105:3300/0 conn(0x7f48c015e930 msgr2=0x7f48c009b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48be000640 1 -- 172.21.15.37:0/4005845691 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1365044335 0 0) 0x7f48c009abe0 con 0x7f48c00d1240 2024-05-30T06:45:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48bf400640 1 --2- 172.21.15.37:0/4005845691 >> v2:172.21.15.105:3300/0 conn(0x7f48c015e930 0x7f48c009b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48bf400640 1 -- 172.21.15.37:0/4005845691 >> v1:172.21.15.105:6789/0 conn(0x7f48c00d1240 legacy=0x7f48c01625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.797+0000 7f48bf400640 1 -- 172.21.15.37:0/4005845691 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c009b1a0 con 0x7f48c0162cb0 2024-05-30T06:45:24.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48bf400640 1 --2- 172.21.15.37:0/4005845691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48c0162cb0 0x7f48c00ccc60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009d90 tx=0x7f48b801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19dd103319316592 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:24.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48be000640 1 -- 172.21.15.37:0/4005845691 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b80b2070 con 0x7f48c0162cb0 2024-05-30T06:45:24.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48be000640 1 -- 172.21.15.37:0/4005845691 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b80a5830 con 0x7f48c0162cb0 2024-05-30T06:45:24.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48be000640 1 -- 172.21.15.37:0/4005845691 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b80a5c00 con 0x7f48c0162cb0 2024-05-30T06:45:24.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48c5e00640 1 -- 172.21.15.37:0/4005845691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48c0162cb0 msgr2=0x7f48c00ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:24.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48c5e00640 1 --2- 172.21.15.37:0/4005845691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48c0162cb0 0x7f48c00ccc60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009d90 tx=0x7f48b801c970 comp rx=0 tx=0).stop 2024-05-30T06:45:24.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48c5e00640 1 -- 172.21.15.37:0/4005845691 shutdown_connections 2024-05-30T06:45:24.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48c5e00640 1 --2- 172.21.15.37:0/4005845691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48c0162cb0 0x7f48c00ccc60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:24.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48c5e00640 1 --2- 172.21.15.37:0/4005845691 >> v2:172.21.15.105:3300/0 conn(0x7f48c015e930 0x7f48c009b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:24.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48c5e00640 1 -- 172.21.15.37:0/4005845691 >> 172.21.15.37:0/4005845691 conn(0x7f48c00b4100 msgr2=0x7f48c00b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:24.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48c5e00640 1 -- 172.21.15.37:0/4005845691 shutdown_connections 2024-05-30T06:45:24.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48c5e00640 1 -- 172.21.15.37:0/4005845691 wait complete. 2024-05-30T06:45:24.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48c5e00640 1 Processor -- start 2024-05-30T06:45:24.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.801+0000 7f48c5e00640 1 -- start start 2024-05-30T06:45:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48c5e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48c00d1240 0x7f48c015b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48c5e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48c015e930 0x7f48c00b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48c5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0162cb0 0x7f48c00b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48c5e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f48c016bac0 con 0x7f48c0162cb0 2024-05-30T06:45:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48c5e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f48c016b940 con 0x7f48c00d1240 2024-05-30T06:45:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48c5e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f48c016bc40 con 0x7f48c015e930 2024-05-30T06:45:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48bf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0162cb0 0x7f48c00b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48bf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0162cb0 0x7f48c00b77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42026/0 (socket says 172.21.15.37:42026) 2024-05-30T06:45:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48bf400640 1 -- 172.21.15.37:0/3698832837 learned_addr learned my addr 172.21.15.37:0/3698832837 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48b7e00640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48c015e930 0x7f48c00b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48bea00640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48c00d1240 0x7f48c015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48bf400640 1 -- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48c015e930 msgr2=0x7f48c00b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48bf400640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48c015e930 0x7f48c00b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48bf400640 1 -- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48c00d1240 msgr2=0x7f48c015b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48bf400640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48c00d1240 0x7f48c015b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48bf400640 1 -- 172.21.15.37:0/3698832837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c015bd40 con 0x7f48c0162cb0 2024-05-30T06:45:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48b7e00640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48c015e930 0x7f48c00b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48bf400640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0162cb0 0x7f48c00b77e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f48b80b0040 tx=0x7f48b8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48b7400640 1 -- 172.21.15.37:0/3698832837 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b80b2050 con 0x7f48c0162cb0 2024-05-30T06:45:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48b7400640 1 -- 172.21.15.37:0/3698832837 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b80be070 con 0x7f48c0162cb0 2024-05-30T06:45:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48c5e00640 1 -- 172.21.15.37:0/3698832837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c00b5ee0 con 0x7f48c0162cb0 2024-05-30T06:45:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48b7400640 1 -- 172.21.15.37:0/3698832837 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b80ada90 con 0x7f48c0162cb0 2024-05-30T06:45:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48c5e00640 1 -- 172.21.15.37:0/3698832837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c00b64a0 con 0x7f48c0162cb0 2024-05-30T06:45:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.805+0000 7f48c5e00640 1 -- 172.21.15.37:0/3698832837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c0068b20 con 0x7f48c0162cb0 2024-05-30T06:45:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.809+0000 7f48b7400640 1 -- 172.21.15.37:0/3698832837 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f48b80a56b0 con 0x7f48c0162cb0 2024-05-30T06:45:24.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.809+0000 7f48b7400640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f489c068560 0x7f489c06aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:24.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.809+0000 7f48b7400640 1 -- 172.21.15.37:0/3698832837 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f48b81217d0 con 0x7f48c0162cb0 2024-05-30T06:45:24.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.809+0000 7f48bea00640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f489c068560 0x7f489c06aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.809+0000 7f48bea00640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f489c068560 0x7f489c06aa20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009ac0 tx=0x7f48b0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:24.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:24.813+0000 7f48b7400640 1 -- 172.21.15.37:0/3698832837 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f48b80c7020 con 0x7f48c0162cb0 2024-05-30T06:45:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.033+0000 7f48c5e00640 1 -- 172.21.15.37:0/3698832837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f48c0162a90 con 0x7f48c0162cb0 2024-05-30T06:45:25.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.033+0000 7f48b7400640 1 -- 172.21.15.37:0/3698832837 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1823 (secure 0 0 0) 0x7f48b8016560 con 0x7f48c0162cb0 2024-05-30T06:45:25.036 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:25.036 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:45:25.036 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:45:25.036 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:45:25.037 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:45:25.037 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:45:25.037 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:45:25.037 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:25.037 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:45:25.037 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:45:25.037 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:45:25.037 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:45:25.037 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:45:25.037 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:25.037 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:45:25.037 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:45:25.037 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:45:25.038 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:45:25.038 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:25.038 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 219, 2024-05-30T06:45:25.038 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:45:25.038 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:45:25.038 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:45:25.038 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:45:25.038 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:25.038 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:45:25.038 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-05-30T06:45:25.038 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:45:25.038 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:45:25.039 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 3019, 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 12542339992, 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 25343148032, 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 747750965248, 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 682, 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 2, 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:45:25.040 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:45:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:45:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 2, 2024-05-30T06:45:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:45:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:45:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:45:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5040 2024-05-30T06:45:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:45:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:45:25.041 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:45:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:45:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:45:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:45:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:45:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:45:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:45:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:45:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:45:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 5, 2024-05-30T06:45:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:44:10.671476+0000", 2024-05-30T06:45:25.042 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:45:25.043 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:25.043 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": {} 2024-05-30T06:45:25.043 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:45:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.037+0000 7f48c5e00640 1 -- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f489c068560 msgr2=0x7f489c06aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.037+0000 7f48c5e00640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f489c068560 0x7f489c06aa20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009ac0 tx=0x7f48b0009190 comp rx=0 tx=0).stop 2024-05-30T06:45:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.037+0000 7f48c5e00640 1 -- 172.21.15.37:0/3698832837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0162cb0 msgr2=0x7f48c00b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.037+0000 7f48c5e00640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0162cb0 0x7f48c00b77e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f48b80b0040 tx=0x7f48b8019710 comp rx=0 tx=0).stop 2024-05-30T06:45:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.037+0000 7f48c5e00640 1 -- 172.21.15.37:0/3698832837 shutdown_connections 2024-05-30T06:45:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.037+0000 7f48c5e00640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48c0162cb0 0x7f48c00b77e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.037+0000 7f48c5e00640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48c015e930 0x7f48c00b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.037+0000 7f48c5e00640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f489c068560 0x7f489c06aa20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.037+0000 7f48c5e00640 1 --2- 172.21.15.37:0/3698832837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48c00d1240 0x7f48c015b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.037+0000 7f48c5e00640 1 -- 172.21.15.37:0/3698832837 >> 172.21.15.37:0/3698832837 conn(0x7f48c00b4100 msgr2=0x7f48c0071040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.037+0000 7f48c5e00640 1 -- 172.21.15.37:0/3698832837 shutdown_connections 2024-05-30T06:45:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.037+0000 7f48c5e00640 1 -- 172.21.15.37:0/3698832837 wait complete. 2024-05-30T06:45:25.059 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T06:45:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b35600640 1 Processor -- start 2024-05-30T06:45:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b35600640 1 -- start start 2024-05-30T06:45:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b35600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b300b59d0 0x7f7b300b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b35600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b3015d350 0x7f7b30160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b35600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b300b62f0 con 0x7f7b3015d7b0 2024-05-30T06:45:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b35600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7b30142030 con 0x7f7b300b59d0 2024-05-30T06:45:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b35600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7b30142310 con 0x7f7b3015d350 2024-05-30T06:45:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b2ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b300b59d0 0x7f7b300b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b2ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b300b59d0 0x7f7b300b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42040/0 (socket says 172.21.15.37:42040) 2024-05-30T06:45:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b2ea00640 1 -- 172.21.15.37:0/2755882807 learned_addr learned my addr 172.21.15.37:0/2755882807 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b2e000640 1 --2- 172.21.15.37:0/2755882807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b3015d350 0x7f7b30160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b2ea00640 1 -- 172.21.15.37:0/2755882807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b3015d350 msgr2=0x7f7b30160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b2ea00640 1 --2- 172.21.15.37:0/2755882807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b3015d350 0x7f7b30160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b2ea00640 1 -- 172.21.15.37:0/2755882807 >> v1:172.21.15.105:6789/0 conn(0x7f7b3015d7b0 legacy=0x7f7b301607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.201+0000 7f7b2ea00640 1 -- 172.21.15.37:0/2755882807 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b301425f0 con 0x7f7b300b59d0 2024-05-30T06:45:25.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.205+0000 7f7b2ea00640 1 --2- 172.21.15.37:0/2755882807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b59d0 0x7f7b300b5db0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009e50 tx=0x7f7b2001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40984ed61c5f94b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.205+0000 7f7b2d600640 1 -- 172.21.15.37:0/2755882807 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200b4070 con 0x7f7b300b59d0 2024-05-30T06:45:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.205+0000 7f7b2d600640 1 -- 172.21.15.37:0/2755882807 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b200af400 con 0x7f7b300b59d0 2024-05-30T06:45:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.205+0000 7f7b2d600640 1 -- 172.21.15.37:0/2755882807 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200af7d0 con 0x7f7b300b59d0 2024-05-30T06:45:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.205+0000 7f7b35600640 1 -- 172.21.15.37:0/2755882807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b59d0 msgr2=0x7f7b300b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.205+0000 7f7b35600640 1 --2- 172.21.15.37:0/2755882807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b59d0 0x7f7b300b5db0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009e50 tx=0x7f7b2001f210 comp rx=0 tx=0).stop 2024-05-30T06:45:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.205+0000 7f7b35600640 1 -- 172.21.15.37:0/2755882807 shutdown_connections 2024-05-30T06:45:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.205+0000 7f7b35600640 1 --2- 172.21.15.37:0/2755882807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b3015d350 0x7f7b30160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.205+0000 7f7b35600640 1 --2- 172.21.15.37:0/2755882807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b59d0 0x7f7b300b5db0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.205+0000 7f7b35600640 1 -- 172.21.15.37:0/2755882807 >> 172.21.15.37:0/2755882807 conn(0x7f7b3006bf60 msgr2=0x7f7b300b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.205+0000 7f7b35600640 1 -- 172.21.15.37:0/2755882807 shutdown_connections 2024-05-30T06:45:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.205+0000 7f7b35600640 1 -- 172.21.15.37:0/2755882807 wait complete. 2024-05-30T06:45:25.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b35600640 1 Processor -- start 2024-05-30T06:45:25.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b35600640 1 -- start start 2024-05-30T06:45:25.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b35600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b59d0 0x7f7b30149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b35600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b3015d350 0x7f7b3013ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b35600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b3015d7b0 0x7f7b301604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b35600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3013fe60 con 0x7f7b300b59d0 2024-05-30T06:45:25.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b35600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3013fce0 con 0x7f7b3015d350 2024-05-30T06:45:25.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b35600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7b300aff20 con 0x7f7b3015d7b0 2024-05-30T06:45:25.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b2ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b59d0 0x7f7b30149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b2ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b59d0 0x7f7b30149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42054/0 (socket says 172.21.15.37:42054) 2024-05-30T06:45:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b2ea00640 1 -- 172.21.15.37:0/3777282759 learned_addr learned my addr 172.21.15.37:0/3777282759 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b2e000640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b3015d350 0x7f7b3013ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b2f400640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b3015d7b0 0x7f7b301604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b2ea00640 1 -- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b3015d7b0 msgr2=0x7f7b301604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b2ea00640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b3015d7b0 0x7f7b301604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b2ea00640 1 -- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b3015d350 msgr2=0x7f7b3013ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b2ea00640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b3015d350 0x7f7b3013ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b2ea00640 1 -- 172.21.15.37:0/3777282759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b301496c0 con 0x7f7b300b59d0 2024-05-30T06:45:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b2e000640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b3015d350 0x7f7b3013ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b2ea00640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b59d0 0x7f7b30149180 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7b2001ce40 tx=0x7f7b2001bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b26a00640 1 -- 172.21.15.37:0/3777282759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200be070 con 0x7f7b300b59d0 2024-05-30T06:45:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b26a00640 1 -- 172.21.15.37:0/3777282759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b200afe10 con 0x7f7b300b59d0 2024-05-30T06:45:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b35600640 1 -- 172.21.15.37:0/3777282759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b3013b3d0 con 0x7f7b300b59d0 2024-05-30T06:45:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b26a00640 1 -- 172.21.15.37:0/3777282759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200b4040 con 0x7f7b300b59d0 2024-05-30T06:45:25.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b35600640 1 -- 172.21.15.37:0/3777282759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b301e64f0 con 0x7f7b300b59d0 2024-05-30T06:45:25.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.209+0000 7f7b35600640 1 -- 172.21.15.37:0/3777282759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b30068bc0 con 0x7f7b300b59d0 2024-05-30T06:45:25.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.213+0000 7f7b26a00640 1 -- 172.21.15.37:0/3777282759 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f7b200c1070 con 0x7f7b300b59d0 2024-05-30T06:45:25.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.213+0000 7f7b26a00640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b0c068530 0x7f7b0c06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.213+0000 7f7b26a00640 1 -- 172.21.15.37:0/3777282759 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f7b201252a0 con 0x7f7b300b59d0 2024-05-30T06:45:25.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.213+0000 7f7b2e000640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b0c068530 0x7f7b0c06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.213+0000 7f7b2e000640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b0c068530 0x7f7b0c06a9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7b3013c3a0 tx=0x7f7b18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.217+0000 7f7b26a00640 1 -- 172.21.15.37:0/3777282759 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b301496c0 con 0x7f7b300b59d0 2024-05-30T06:45:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.405+0000 7f7b35600640 1 -- 172.21.15.37:0/3777282759 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b300b3440 con 0x7f7b0c068530 2024-05-30T06:45:25.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.413+0000 7f7b26a00640 1 -- 172.21.15.37:0/3777282759 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+79 (secure 0 0 0) 0x7f7b300b3440 con 0x7f7b0c068530 2024-05-30T06:45:25.415 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:25.415 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:45:25.415 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:25.415 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sv1" 2024-05-30T06:45:25.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:25.416 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:25.416 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ss1clone1" 2024-05-30T06:45:25.416 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:25.416 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:45:25.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.417+0000 7f7b35600640 1 -- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b0c068530 msgr2=0x7f7b0c06a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.417+0000 7f7b35600640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b0c068530 0x7f7b0c06a9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7b3013c3a0 tx=0x7f7b18008040 comp rx=0 tx=0).stop 2024-05-30T06:45:25.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.417+0000 7f7b35600640 1 -- 172.21.15.37:0/3777282759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b59d0 msgr2=0x7f7b30149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.417+0000 7f7b35600640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b59d0 0x7f7b30149180 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7b2001ce40 tx=0x7f7b2001bfb0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.417+0000 7f7b35600640 1 -- 172.21.15.37:0/3777282759 shutdown_connections 2024-05-30T06:45:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.417+0000 7f7b35600640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b3015d7b0 0x7f7b301604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.417+0000 7f7b35600640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b0c068530 0x7f7b0c06a9f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.417+0000 7f7b35600640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b3015d350 0x7f7b3013ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.417+0000 7f7b35600640 1 --2- 172.21.15.37:0/3777282759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b59d0 0x7f7b30149180 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.417+0000 7f7b35600640 1 -- 172.21.15.37:0/3777282759 >> 172.21.15.37:0/3777282759 conn(0x7f7b3006bf60 msgr2=0x7f7b300727d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.417+0000 7f7b35600640 1 -- 172.21.15.37:0/3777282759 shutdown_connections 2024-05-30T06:45:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.417+0000 7f7b35600640 1 -- 172.21.15.37:0/3777282759 wait complete. 2024-05-30T06:45:25.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T06:45:25.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b8a00640 1 Processor -- start 2024-05-30T06:45:25.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b8a00640 1 -- start start 2024-05-30T06:45:25.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b8a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46b415eb60 0x7f46b406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b8a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46b40b15c0 0x7f46b40cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b8a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b409bba0 con 0x7f46b40cf460 2024-05-30T06:45:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b8a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f46b409ab00 con 0x7f46b415eb60 2024-05-30T06:45:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b8a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46b409ade0 con 0x7f46b40b15c0 2024-05-30T06:45:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b1e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46b415eb60 0x7f46b406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b1e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46b415eb60 0x7f46b406d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42066/0 (socket says 172.21.15.37:42066) 2024-05-30T06:45:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b1e00640 1 -- 172.21.15.37:0/2326409043 learned_addr learned my addr 172.21.15.37:0/2326409043 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46a9400640 1 --2- 172.21.15.37:0/2326409043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46b40b15c0 0x7f46b40cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b1e00640 1 -- 172.21.15.37:0/2326409043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46b40b15c0 msgr2=0x7f46b40cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b1e00640 1 --2- 172.21.15.37:0/2326409043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46b40b15c0 0x7f46b40cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b1e00640 1 -- 172.21.15.37:0/2326409043 >> v1:172.21.15.105:6789/0 conn(0x7f46b40cf460 legacy=0x7f46b41625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46b1e00640 1 -- 172.21.15.37:0/2326409043 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b409b0c0 con 0x7f46b415eb60 2024-05-30T06:45:25.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.581+0000 7f46a9400640 1 --2- 172.21.15.37:0/2326409043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46b40b15c0 0x7f46b40cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:25.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.585+0000 7f46b1e00640 1 --2- 172.21.15.37:0/2326409043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b415eb60 0x7f46b406d480 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009870 tx=0x7f46a401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71f58aeb9749cbd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:25.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.585+0000 7f46b1400640 1 -- 172.21.15.37:0/2326409043 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a40b0070 con 0x7f46b415eb60 2024-05-30T06:45:25.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.585+0000 7f46b1400640 1 -- 172.21.15.37:0/2326409043 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a40ab600 con 0x7f46b415eb60 2024-05-30T06:45:25.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.585+0000 7f46b1400640 1 -- 172.21.15.37:0/2326409043 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a40ab9d0 con 0x7f46b415eb60 2024-05-30T06:45:25.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.585+0000 7f46b8a00640 1 -- 172.21.15.37:0/2326409043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b415eb60 msgr2=0x7f46b406d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.585+0000 7f46b8a00640 1 --2- 172.21.15.37:0/2326409043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b415eb60 0x7f46b406d480 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009870 tx=0x7f46a401c560 comp rx=0 tx=0).stop 2024-05-30T06:45:25.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.585+0000 7f46b8a00640 1 -- 172.21.15.37:0/2326409043 shutdown_connections 2024-05-30T06:45:25.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.585+0000 7f46b8a00640 1 --2- 172.21.15.37:0/2326409043 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46b40b15c0 0x7f46b40cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.585+0000 7f46b8a00640 1 --2- 172.21.15.37:0/2326409043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b415eb60 0x7f46b406d480 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.585+0000 7f46b8a00640 1 -- 172.21.15.37:0/2326409043 >> 172.21.15.37:0/2326409043 conn(0x7f46b40d26a0 msgr2=0x7f46b40d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:25.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.585+0000 7f46b8a00640 1 -- 172.21.15.37:0/2326409043 shutdown_connections 2024-05-30T06:45:25.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.585+0000 7f46b8a00640 1 -- 172.21.15.37:0/2326409043 wait complete. 2024-05-30T06:45:25.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b8a00640 1 Processor -- start 2024-05-30T06:45:25.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b8a00640 1 -- start start 2024-05-30T06:45:25.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b40b15c0 0x7f46b4147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b8a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46b40cf460 0x7f46b40b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b8a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46b415eb60 0x7f46b40b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b8a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f46b40d1800 con 0x7f46b40b15c0 2024-05-30T06:45:25.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b8a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f46b40d1680 con 0x7f46b415eb60 2024-05-30T06:45:25.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b8a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46b416b8e0 con 0x7f46b40cf460 2024-05-30T06:45:25.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b40b15c0 0x7f46b4147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b40b15c0 0x7f46b4147950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42072/0 (socket says 172.21.15.37:42072) 2024-05-30T06:45:25.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b1e00640 1 -- 172.21.15.37:0/4208685656 learned_addr learned my addr 172.21.15.37:0/4208685656 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:25.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46a9400640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46b40cf460 0x7f46b40b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b2800640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46b415eb60 0x7f46b40b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b1e00640 1 -- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46b40cf460 msgr2=0x7f46b40b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b1e00640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46b40cf460 0x7f46b40b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b1e00640 1 -- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46b415eb60 msgr2=0x7f46b40b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b1e00640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46b415eb60 0x7f46b40b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b1e00640 1 -- 172.21.15.37:0/4208685656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b415be20 con 0x7f46b40b15c0 2024-05-30T06:45:25.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b1e00640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b40b15c0 0x7f46b4147950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f46a40ae040 tx=0x7f46a401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:25.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46aaa00640 1 -- 172.21.15.37:0/4208685656 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a40b0040 con 0x7f46b40b15c0 2024-05-30T06:45:25.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46aaa00640 1 -- 172.21.15.37:0/4208685656 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a40bc070 con 0x7f46b40b15c0 2024-05-30T06:45:25.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46aaa00640 1 -- 172.21.15.37:0/4208685656 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a40b6840 con 0x7f46b40b15c0 2024-05-30T06:45:25.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b8a00640 1 -- 172.21.15.37:0/4208685656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b415c100 con 0x7f46b40b15c0 2024-05-30T06:45:25.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.589+0000 7f46b8a00640 1 -- 172.21.15.37:0/4208685656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b415cbe0 con 0x7f46b40b15c0 2024-05-30T06:45:25.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.593+0000 7f46b8a00640 1 -- 172.21.15.37:0/4208685656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b4068d40 con 0x7f46b40b15c0 2024-05-30T06:45:25.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.593+0000 7f46aaa00640 1 -- 172.21.15.37:0/4208685656 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f46a40ab4c0 con 0x7f46b40b15c0 2024-05-30T06:45:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.593+0000 7f46aaa00640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4690068530 0x7f469006a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.593+0000 7f46aaa00640 1 -- 172.21.15.37:0/4208685656 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f46a4120fa0 con 0x7f46b40b15c0 2024-05-30T06:45:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.593+0000 7f46a9400640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4690068530 0x7f469006a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.593+0000 7f46a9400640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4690068530 0x7f469006a9f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f46b40cdef0 tx=0x7f469c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:25.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.597+0000 7f46aaa00640 1 -- 172.21.15.37:0/4208685656 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f46a4016150 con 0x7f46b40b15c0 2024-05-30T06:45:25.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.809+0000 7f46b8a00640 1 -- 172.21.15.37:0/4208685656 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46b40d3040 con 0x7f4690068530 2024-05-30T06:45:25.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.825+0000 7f46aaa00640 1 -- 172.21.15.37:0/4208685656 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f46b40d3040 con 0x7f4690068530 2024-05-30T06:45:25.827 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:25.828 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:45:25.828 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:25.828 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ss1" 2024-05-30T06:45:25.828 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:25.828 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:45:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.829+0000 7f46b8a00640 1 -- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4690068530 msgr2=0x7f469006a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.829+0000 7f46b8a00640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4690068530 0x7f469006a9f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f46b40cdef0 tx=0x7f469c008040 comp rx=0 tx=0).stop 2024-05-30T06:45:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.829+0000 7f46b8a00640 1 -- 172.21.15.37:0/4208685656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b40b15c0 msgr2=0x7f46b4147950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.829+0000 7f46b8a00640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b40b15c0 0x7f46b4147950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f46a40ae040 tx=0x7f46a401ada0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.829+0000 7f46b8a00640 1 -- 172.21.15.37:0/4208685656 shutdown_connections 2024-05-30T06:45:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.829+0000 7f46b8a00640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4690068530 0x7f469006a9f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.829+0000 7f46b8a00640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46b415eb60 0x7f46b40b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.829+0000 7f46b8a00640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46b40cf460 0x7f46b40b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.829+0000 7f46b8a00640 1 --2- 172.21.15.37:0/4208685656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b40b15c0 0x7f46b4147950 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.829+0000 7f46b8a00640 1 -- 172.21.15.37:0/4208685656 >> 172.21.15.37:0/4208685656 conn(0x7f46b40d26a0 msgr2=0x7f46b40715d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:25.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.829+0000 7f46b8a00640 1 -- 172.21.15.37:0/4208685656 shutdown_connections 2024-05-30T06:45:25.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.829+0000 7f46b8a00640 1 -- 172.21.15.37:0/4208685656 wait complete. 2024-05-30T06:45:25.849 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T06:45:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.993+0000 7eff57200640 1 Processor -- start 2024-05-30T06:45:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.993+0000 7eff57200640 1 -- start start 2024-05-30T06:45:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff57200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff50155da0 0x7eff500cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff57200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff500cd440 0x7eff5006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff57200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff5015f310 con 0x7eff5006f5a0 2024-05-30T06:45:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff57200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7eff500b4760 con 0x7eff500cd440 2024-05-30T06:45:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff57200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7eff5015f5f0 con 0x7eff50155da0 2024-05-30T06:45:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff47400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff500cd440 0x7eff5006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff47400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff500cd440 0x7eff5006f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42076/0 (socket says 172.21.15.37:42076) 2024-05-30T06:45:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff55200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7eff5006f5a0 0x7eff500cf4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55842/0 (socket says 172.21.15.37:55842) 2024-05-30T06:45:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff47400640 1 -- 172.21.15.37:0/611564873 learned_addr learned my addr 172.21.15.37:0/611564873 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff4fe00640 1 --2- 172.21.15.37:0/611564873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff50155da0 0x7eff500cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:25.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff47400640 1 -- 172.21.15.37:0/611564873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff50155da0 msgr2=0x7eff500cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:25.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff47400640 1 --2- 172.21.15.37:0/611564873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff50155da0 0x7eff500cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:25.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff47400640 1 -- 172.21.15.37:0/611564873 >> v1:172.21.15.37:6789/0 conn(0x7eff5006f5a0 legacy=0x7eff500cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:25.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff4f400640 1 -- 172.21.15.37:0/611564873 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840584002 0 0) 0x7eff5015f310 con 0x7eff5006f5a0 2024-05-30T06:45:25.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:25.997+0000 7eff47400640 1 -- 172.21.15.37:0/611564873 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5015f8d0 con 0x7eff500cd440 2024-05-30T06:45:26.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff47400640 1 --2- 172.21.15.37:0/611564873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff500cd440 0x7eff5006f060 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7eff3800bb10 tx=0x7eff3801eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a4661fcdcb4ed5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:26.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff4f400640 1 -- 172.21.15.37:0/611564873 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff380b4070 con 0x7eff500cd440 2024-05-30T06:45:26.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff4f400640 1 -- 172.21.15.37:0/611564873 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff380a79e0 con 0x7eff500cd440 2024-05-30T06:45:26.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff4f400640 1 -- 172.21.15.37:0/611564873 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff380a7db0 con 0x7eff500cd440 2024-05-30T06:45:26.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff57200640 1 -- 172.21.15.37:0/611564873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff500cd440 msgr2=0x7eff5006f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff57200640 1 --2- 172.21.15.37:0/611564873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff500cd440 0x7eff5006f060 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7eff3800bb10 tx=0x7eff3801eb10 comp rx=0 tx=0).stop 2024-05-30T06:45:26.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff57200640 1 -- 172.21.15.37:0/611564873 shutdown_connections 2024-05-30T06:45:26.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff57200640 1 --2- 172.21.15.37:0/611564873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff500cd440 0x7eff5006f060 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff57200640 1 --2- 172.21.15.37:0/611564873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff50155da0 0x7eff500cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff57200640 1 -- 172.21.15.37:0/611564873 >> 172.21.15.37:0/611564873 conn(0x7eff5006bf60 msgr2=0x7eff500b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:26.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff57200640 1 -- 172.21.15.37:0/611564873 shutdown_connections 2024-05-30T06:45:26.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff57200640 1 -- 172.21.15.37:0/611564873 wait complete. 2024-05-30T06:45:26.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff57200640 1 Processor -- start 2024-05-30T06:45:26.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.001+0000 7eff57200640 1 -- start start 2024-05-30T06:45:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff57200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff5006f5a0 0x7eff5014ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff57200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50155da0 0x7eff50157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff57200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff501575a0 0x7eff50151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff57200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff5006df50 con 0x7eff50155da0 2024-05-30T06:45:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff57200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff5006fa10 con 0x7eff501575a0 2024-05-30T06:45:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff57200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7eff5006e0d0 con 0x7eff5006f5a0 2024-05-30T06:45:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff47400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50155da0 0x7eff50157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff47400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50155da0 0x7eff50157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42092/0 (socket says 172.21.15.37:42092) 2024-05-30T06:45:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff47400640 1 -- 172.21.15.37:0/704063399 learned_addr learned my addr 172.21.15.37:0/704063399 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff4fe00640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff5006f5a0 0x7eff5014ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff55200640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff501575a0 0x7eff50151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff47400640 1 -- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff5006f5a0 msgr2=0x7eff5014ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff47400640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff5006f5a0 0x7eff5014ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff47400640 1 -- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff501575a0 msgr2=0x7eff50151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff47400640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff501575a0 0x7eff50151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff47400640 1 -- 172.21.15.37:0/704063399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff50157b90 con 0x7eff50155da0 2024-05-30T06:45:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff4fe00640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff5006f5a0 0x7eff5014ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff55200640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff501575a0 0x7eff50151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:45:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff47400640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50155da0 0x7eff50157060 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7eff3800b2c0 tx=0x7eff3801d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff4cc00640 1 -- 172.21.15.37:0/704063399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff380bf070 con 0x7eff50155da0 2024-05-30T06:45:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff4cc00640 1 -- 172.21.15.37:0/704063399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff380afa70 con 0x7eff50155da0 2024-05-30T06:45:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff4cc00640 1 -- 172.21.15.37:0/704063399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff380b4070 con 0x7eff50155da0 2024-05-30T06:45:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff57200640 1 -- 172.21.15.37:0/704063399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff50157e70 con 0x7eff50155da0 2024-05-30T06:45:26.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff57200640 1 -- 172.21.15.37:0/704063399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff5015e180 con 0x7eff50155da0 2024-05-30T06:45:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff57200640 1 -- 172.21.15.37:0/704063399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff50068bc0 con 0x7eff50155da0 2024-05-30T06:45:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.005+0000 7eff4cc00640 1 -- 172.21.15.37:0/704063399 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7eff380b93e0 con 0x7eff50155da0 2024-05-30T06:45:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.009+0000 7eff4cc00640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff2c068530 0x7eff2c06a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.009+0000 7eff4cc00640 1 -- 172.21.15.37:0/704063399 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7eff38120fd0 con 0x7eff50155da0 2024-05-30T06:45:26.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.009+0000 7eff4fe00640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff2c068530 0x7eff2c06a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.009+0000 7eff4fe00640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff2c068530 0x7eff2c06a9f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7eff40009b10 tx=0x7eff40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:26.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.013+0000 7eff4cc00640 1 -- 172.21.15.37:0/704063399 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7eff38018820 con 0x7eff50155da0 2024-05-30T06:45:26.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.209+0000 7eff57200640 1 -- 172.21.15.37:0/704063399 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff500b6790 con 0x7eff2c068530 2024-05-30T06:45:26.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.245+0000 7eff4cc00640 1 -- 172.21.15.37:0/704063399 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7eff500b6790 con 0x7eff2c068530 2024-05-30T06:45:26.247 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:26.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.249+0000 7eff57200640 1 -- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff2c068530 msgr2=0x7eff2c06a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.249+0000 7eff57200640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff2c068530 0x7eff2c06a9f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7eff40009b10 tx=0x7eff40008040 comp rx=0 tx=0).stop 2024-05-30T06:45:26.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.249+0000 7eff57200640 1 -- 172.21.15.37:0/704063399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50155da0 msgr2=0x7eff50157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.249+0000 7eff57200640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50155da0 0x7eff50157060 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7eff3800b2c0 tx=0x7eff3801d350 comp rx=0 tx=0).stop 2024-05-30T06:45:26.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.249+0000 7eff57200640 1 -- 172.21.15.37:0/704063399 shutdown_connections 2024-05-30T06:45:26.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.249+0000 7eff57200640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff2c068530 0x7eff2c06a9f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.249+0000 7eff57200640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff501575a0 0x7eff50151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.249+0000 7eff57200640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff50155da0 0x7eff50157060 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.249+0000 7eff57200640 1 --2- 172.21.15.37:0/704063399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff5006f5a0 0x7eff5014ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.249+0000 7eff57200640 1 -- 172.21.15.37:0/704063399 >> 172.21.15.37:0/704063399 conn(0x7eff5006bf60 msgr2=0x7eff50164a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:26.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.249+0000 7eff57200640 1 -- 172.21.15.37:0/704063399 shutdown_connections 2024-05-30T06:45:26.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.249+0000 7eff57200640 1 -- 172.21.15.37:0/704063399 wait complete. 2024-05-30T06:45:26.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T06:45:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.409+0000 7f1099e00640 1 Processor -- start 2024-05-30T06:45:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f1099e00640 1 -- start start 2024-05-30T06:45:26.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f1099e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1094148520 0x7f109415fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f1099e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f10940b5b00 0x7f10940b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f1099e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10940af5d0 con 0x7f10940aeda0 2024-05-30T06:45:26.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f1099e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f10940af8b0 con 0x7f1094148520 2024-05-30T06:45:26.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f1099e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f10940afb90 con 0x7f10940b5b00 2024-05-30T06:45:26.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f1092a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1094148520 0x7f109415fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f108a000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f10940aeda0 0x7f10940b53f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55850/0 (socket says 172.21.15.37:55850) 2024-05-30T06:45:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f108a000640 1 -- 172.21.15.37:0/911115823 learned_addr learned my addr 172.21.15.37:0/911115823 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f1093400640 1 --2- 172.21.15.37:0/911115823 >> v2:172.21.15.105:3300/0 conn(0x7f10940b5b00 0x7f10940b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f1092a00640 1 -- 172.21.15.37:0/911115823 >> v2:172.21.15.105:3300/0 conn(0x7f10940b5b00 msgr2=0x7f10940b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f1092a00640 1 --2- 172.21.15.37:0/911115823 >> v2:172.21.15.105:3300/0 conn(0x7f10940b5b00 0x7f10940b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f1092a00640 1 -- 172.21.15.37:0/911115823 >> v1:172.21.15.37:6789/0 conn(0x7f10940aeda0 legacy=0x7f10940b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.413+0000 7f1092a00640 1 -- 172.21.15.37:0/911115823 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10940afe70 con 0x7f1094148520 2024-05-30T06:45:26.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1092a00640 1 --2- 172.21.15.37:0/911115823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094148520 0x7f109415fa30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1094073810 tx=0x7f108401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267519b68a027d00 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:26.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1092000640 1 -- 172.21.15.37:0/911115823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10840a7070 con 0x7f1094148520 2024-05-30T06:45:26.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1092000640 1 -- 172.21.15.37:0/911115823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10840b0070 con 0x7f1094148520 2024-05-30T06:45:26.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1092000640 1 -- 172.21.15.37:0/911115823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10840ab890 con 0x7f1094148520 2024-05-30T06:45:26.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1099e00640 1 -- 172.21.15.37:0/911115823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094148520 msgr2=0x7f109415fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1099e00640 1 --2- 172.21.15.37:0/911115823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094148520 0x7f109415fa30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1094073810 tx=0x7f108401c450 comp rx=0 tx=0).stop 2024-05-30T06:45:26.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1099e00640 1 -- 172.21.15.37:0/911115823 shutdown_connections 2024-05-30T06:45:26.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1099e00640 1 --2- 172.21.15.37:0/911115823 >> v2:172.21.15.105:3300/0 conn(0x7f10940b5b00 0x7f10940b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1099e00640 1 --2- 172.21.15.37:0/911115823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1094148520 0x7f109415fa30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1099e00640 1 -- 172.21.15.37:0/911115823 >> 172.21.15.37:0/911115823 conn(0x7f109406b960 msgr2=0x7f109406bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:26.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1099e00640 1 -- 172.21.15.37:0/911115823 shutdown_connections 2024-05-30T06:45:26.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1099e00640 1 -- 172.21.15.37:0/911115823 wait complete. 2024-05-30T06:45:26.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1099e00640 1 Processor -- start 2024-05-30T06:45:26.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.417+0000 7f1099e00640 1 -- start start 2024-05-30T06:45:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1099e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10940aeda0 0x7f109413db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1099e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10940b5b00 0x7f109415f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1099e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1094148520 0x7f109415f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1099e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10940b4b40 con 0x7f10940aeda0 2024-05-30T06:45:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1099e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f10940b49c0 con 0x7f10940b5b00 2024-05-30T06:45:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1099e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f10940b4cc0 con 0x7f1094148520 2024-05-30T06:45:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1092a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10940aeda0 0x7f109413db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1092a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10940aeda0 0x7f109413db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42116/0 (socket says 172.21.15.37:42116) 2024-05-30T06:45:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1092a00640 1 -- 172.21.15.37:0/4116061467 learned_addr learned my addr 172.21.15.37:0/4116061467 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1093400640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1094148520 0x7f109415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f108a000640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10940b5b00 0x7f109415f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1092a00640 1 -- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1094148520 msgr2=0x7f109415f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1092a00640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1094148520 0x7f109415f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1092a00640 1 -- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10940b5b00 msgr2=0x7f109415f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1092a00640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10940b5b00 0x7f109415f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1092a00640 1 -- 172.21.15.37:0/4116061467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10940ced20 con 0x7f10940aeda0 2024-05-30T06:45:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1092a00640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10940aeda0 0x7f109413db50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f108401a080 tx=0x7f108401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f108be00640 1 -- 172.21.15.37:0/4116061467 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10840bf610 con 0x7f10940aeda0 2024-05-30T06:45:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1099e00640 1 -- 172.21.15.37:0/4116061467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109413e090 con 0x7f10940aeda0 2024-05-30T06:45:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f108be00640 1 -- 172.21.15.37:0/4116061467 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10840bf7d0 con 0x7f10940aeda0 2024-05-30T06:45:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f108be00640 1 -- 172.21.15.37:0/4116061467 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10840bfbc0 con 0x7f10940aeda0 2024-05-30T06:45:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1099e00640 1 -- 172.21.15.37:0/4116061467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1094159710 con 0x7f10940aeda0 2024-05-30T06:45:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f1099e00640 1 -- 172.21.15.37:0/4116061467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1094068bc0 con 0x7f10940aeda0 2024-05-30T06:45:26.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.421+0000 7f108be00640 1 -- 172.21.15.37:0/4116061467 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) ==== 88140+0+0 (secure 0 0 0) 0x7f10840bd020 con 0x7f10940aeda0 2024-05-30T06:45:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.425+0000 7f108be00640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1070068560 0x7f107006aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.425+0000 7f108be00640 1 -- 172.21.15.37:0/4116061467 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f10841212d0 con 0x7f10940aeda0 2024-05-30T06:45:26.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.425+0000 7f108a000640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1070068560 0x7f107006aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.425+0000 7f108a000640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1070068560 0x7f107006aa20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f10941fada0 tx=0x7f107c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.429+0000 7f108be00640 1 -- 172.21.15.37:0/4116061467 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f10840c6070 con 0x7f10940aeda0 2024-05-30T06:45:26.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.621+0000 7f1099e00640 1 -- 172.21.15.37:0/4116061467 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f10940735c0 con 0x7f1070068560 2024-05-30T06:45:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.645+0000 7f108be00640 1 -- 172.21.15.37:0/4116061467 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f10940735c0 con 0x7f1070068560 2024-05-30T06:45:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.645+0000 7f1099e00640 1 -- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1070068560 msgr2=0x7f107006aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.645+0000 7f1099e00640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1070068560 0x7f107006aa20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f10941fada0 tx=0x7f107c009040 comp rx=0 tx=0).stop 2024-05-30T06:45:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.645+0000 7f1099e00640 1 -- 172.21.15.37:0/4116061467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10940aeda0 msgr2=0x7f109413db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.645+0000 7f1099e00640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10940aeda0 0x7f109413db50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f108401a080 tx=0x7f108401ac90 comp rx=0 tx=0).stop 2024-05-30T06:45:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.645+0000 7f1099e00640 1 -- 172.21.15.37:0/4116061467 shutdown_connections 2024-05-30T06:45:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.645+0000 7f1099e00640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1094148520 0x7f109415f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.645+0000 7f1099e00640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1070068560 0x7f107006aa20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.645+0000 7f1099e00640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10940b5b00 0x7f109415f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.645+0000 7f1099e00640 1 --2- 172.21.15.37:0/4116061467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10940aeda0 0x7f109413db50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.645+0000 7f1099e00640 1 -- 172.21.15.37:0/4116061467 >> 172.21.15.37:0/4116061467 conn(0x7f109406b960 msgr2=0x7f10940b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.645+0000 7f1099e00640 1 -- 172.21.15.37:0/4116061467 shutdown_connections 2024-05-30T06:45:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.645+0000 7f1099e00640 1 -- 172.21.15.37:0/4116061467 wait complete. 2024-05-30T06:45:26.650 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:26.647+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:26.650 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:26.647+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:26.650 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:26.647+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:26.650 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:26.647+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:26.651 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:26.647+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:26.668 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:26.663+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:26.668 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:26.663+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:26.668 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:26.663+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:26.668 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:26.663+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:26.668 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:26.663+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:26.670 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-05-30T06:45:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.825+0000 7fbd89000640 1 Processor -- start 2024-05-30T06:45:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.825+0000 7fbd89000640 1 -- start start 2024-05-30T06:45:26.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd89000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd8415c780 0x7fbd840b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd89000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbd8409aa60 0x7fbd8409ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd89000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd840b2cb0 con 0x7fbd8409b3a0 2024-05-30T06:45:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd89000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbd840b38c0 con 0x7fbd8409aa60 2024-05-30T06:45:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd89000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd840b2f90 con 0x7fbd8415c780 2024-05-30T06:45:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd82800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbd8409b3a0 0x7fbd84160370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55862/0 (socket says 172.21.15.37:55862) 2024-05-30T06:45:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd82800640 1 -- 172.21.15.37:0/3899207977 learned_addr learned my addr 172.21.15.37:0/3899207977 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd81e00640 1 --2- 172.21.15.37:0/3899207977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd8415c780 0x7fbd840b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd7be00640 1 --2- 172.21.15.37:0/3899207977 >> v2:172.21.15.105:3300/0 conn(0x7fbd8409aa60 0x7fbd8409ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd81400640 1 -- 172.21.15.37:0/3899207977 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79071165 0 0) 0x7fbd840b2cb0 con 0x7fbd8409b3a0 2024-05-30T06:45:26.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd81400640 1 -- 172.21.15.37:0/3899207977 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd68003530 con 0x7fbd8409b3a0 2024-05-30T06:45:26.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd81e00640 1 -- 172.21.15.37:0/3899207977 >> v2:172.21.15.105:3300/0 conn(0x7fbd8409aa60 msgr2=0x7fbd8409ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:26.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd81e00640 1 --2- 172.21.15.37:0/3899207977 >> v2:172.21.15.105:3300/0 conn(0x7fbd8409aa60 0x7fbd8409ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd81e00640 1 -- 172.21.15.37:0/3899207977 >> v1:172.21.15.37:6789/0 conn(0x7fbd8409b3a0 legacy=0x7fbd84160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd81e00640 1 -- 172.21.15.37:0/3899207977 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd840b3270 con 0x7fbd8415c780 2024-05-30T06:45:26.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.829+0000 7fbd7be00640 1 --2- 172.21.15.37:0/3899207977 >> v2:172.21.15.105:3300/0 conn(0x7fbd8409aa60 0x7fbd8409ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd81e00640 1 --2- 172.21.15.37:0/3899207977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd8415c780 0x7fbd840b25d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd740097c0 tx=0x7fbd7401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b70442679538f156 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd81400640 1 -- 172.21.15.37:0/3899207977 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd740b1070 con 0x7fbd8415c780 2024-05-30T06:45:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd81400640 1 -- 172.21.15.37:0/3899207977 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd740ac410 con 0x7fbd8415c780 2024-05-30T06:45:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd81400640 1 -- 172.21.15.37:0/3899207977 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd740ac7e0 con 0x7fbd8415c780 2024-05-30T06:45:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 -- 172.21.15.37:0/3899207977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd8415c780 msgr2=0x7fbd840b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 --2- 172.21.15.37:0/3899207977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd8415c780 0x7fbd840b25d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd740097c0 tx=0x7fbd7401c4a0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 -- 172.21.15.37:0/3899207977 shutdown_connections 2024-05-30T06:45:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 --2- 172.21.15.37:0/3899207977 >> v2:172.21.15.105:3300/0 conn(0x7fbd8409aa60 0x7fbd8409ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 --2- 172.21.15.37:0/3899207977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd8415c780 0x7fbd840b25d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 -- 172.21.15.37:0/3899207977 >> 172.21.15.37:0/3899207977 conn(0x7fbd840d26a0 msgr2=0x7fbd840d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 -- 172.21.15.37:0/3899207977 shutdown_connections 2024-05-30T06:45:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 -- 172.21.15.37:0/3899207977 wait complete. 2024-05-30T06:45:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 Processor -- start 2024-05-30T06:45:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 -- start start 2024-05-30T06:45:26.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd8409aa60 0x7fbd84151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd8409b3a0 0x7fbd841514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8415c780 0x7fbd84070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd840b3ed0 con 0x7fbd8415c780 2024-05-30T06:45:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd840b3d50 con 0x7fbd8409b3a0 2024-05-30T06:45:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd89000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd841696b0 con 0x7fbd8409aa60 2024-05-30T06:45:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.833+0000 7fbd82800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8415c780 0x7fbd84070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd82800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8415c780 0x7fbd84070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42124/0 (socket says 172.21.15.37:42124) 2024-05-30T06:45:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd82800640 1 -- 172.21.15.37:0/1073124952 learned_addr learned my addr 172.21.15.37:0/1073124952 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd81e00640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd8409aa60 0x7fbd84151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd7be00640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd8409b3a0 0x7fbd841514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd82800640 1 -- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd8409aa60 msgr2=0x7fbd84151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd82800640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd8409aa60 0x7fbd84151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd82800640 1 -- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd8409b3a0 msgr2=0x7fbd841514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:26.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd82800640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd8409b3a0 0x7fbd841514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:26.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd82800640 1 -- 172.21.15.37:0/1073124952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd84152390 con 0x7fbd8415c780 2024-05-30T06:45:26.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd82800640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8415c780 0x7fbd84070db0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00cb30 tx=0x7fbd7c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:26.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd7a000640 1 -- 172.21.15.37:0/1073124952 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c017070 con 0x7fbd8415c780 2024-05-30T06:45:26.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd7a000640 1 -- 172.21.15.37:0/1073124952 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c00ac40 con 0x7fbd8415c780 2024-05-30T06:45:26.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd7a000640 1 -- 172.21.15.37:0/1073124952 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c012600 con 0x7fbd8415c780 2024-05-30T06:45:26.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd89000640 1 -- 172.21.15.37:0/1073124952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd841590b0 con 0x7fbd8415c780 2024-05-30T06:45:26.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd89000640 1 -- 172.21.15.37:0/1073124952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd84159630 con 0x7fbd8415c780 2024-05-30T06:45:26.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd89000640 1 -- 172.21.15.37:0/1073124952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd84068d40 con 0x7fbd8415c780 2024-05-30T06:45:26.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.837+0000 7fbd7a000640 1 -- 172.21.15.37:0/1073124952 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fbd7c01a070 con 0x7fbd8415c780 2024-05-30T06:45:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.841+0000 7fbd7a000640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd60068680 0x7fbd6006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.841+0000 7fbd7a000640 1 -- 172.21.15.37:0/1073124952 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fbd7c086ab0 con 0x7fbd8415c780 2024-05-30T06:45:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.841+0000 7fbd81e00640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd60068680 0x7fbd6006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.841+0000 7fbd81e00640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd60068680 0x7fbd6006ab40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbd740ae000 tx=0x7fbd740a6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:26.845+0000 7fbd7a000640 1 -- 172.21.15.37:0/1073124952 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbd84152390 con 0x7fbd8415c780 2024-05-30T06:45:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.033+0000 7fbd89000640 1 -- 172.21.15.37:0/1073124952 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fbd8409c080 con 0x7fbd60068680 2024-05-30T06:45:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.057+0000 7fbd7a000640 1 -- 172.21.15.37:0/1073124952 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbd8409c080 con 0x7fbd60068680 2024-05-30T06:45:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.057+0000 7fbd89000640 1 -- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd60068680 msgr2=0x7fbd6006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.057+0000 7fbd89000640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd60068680 0x7fbd6006ab40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbd740ae000 tx=0x7fbd740a6040 comp rx=0 tx=0).stop 2024-05-30T06:45:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.057+0000 7fbd89000640 1 -- 172.21.15.37:0/1073124952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8415c780 msgr2=0x7fbd84070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.057+0000 7fbd89000640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8415c780 0x7fbd84070db0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00cb30 tx=0x7fbd7c00a060 comp rx=0 tx=0).stop 2024-05-30T06:45:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.057+0000 7fbd89000640 1 -- 172.21.15.37:0/1073124952 shutdown_connections 2024-05-30T06:45:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.057+0000 7fbd89000640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8415c780 0x7fbd84070db0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.057+0000 7fbd89000640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd60068680 0x7fbd6006ab40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.057+0000 7fbd89000640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd8409b3a0 0x7fbd841514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.057+0000 7fbd89000640 1 --2- 172.21.15.37:0/1073124952 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd8409aa60 0x7fbd84151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.057+0000 7fbd89000640 1 -- 172.21.15.37:0/1073124952 >> 172.21.15.37:0/1073124952 conn(0x7fbd840d26a0 msgr2=0x7fbd840d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.057+0000 7fbd89000640 1 -- 172.21.15.37:0/1073124952 shutdown_connections 2024-05-30T06:45:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.057+0000 7fbd89000640 1 -- 172.21.15.37:0/1073124952 wait complete. 2024-05-30T06:45:27.070 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:27.067+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:27.070 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:27.067+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:27.070 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:27.067+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:27.070 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:27.067+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:27.070 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:27.067+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:27.087 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T06:45:27.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:45:27.140 INFO:teuthology.orchestra.run.smithi037.stdout:2 2024-05-30T06:45:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:45:27.147 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:45:27.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:45:27.215 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:45:27.290 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:45:27.291 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:45:27.291 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:45:27.291 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:45:27.302 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:45:27.302 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:45:27.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:45:27.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.533+0000 7faf16200640 1 Processor -- start 2024-05-30T06:45:27.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.533+0000 7faf16200640 1 -- start start 2024-05-30T06:45:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf16200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf100b45d0 0x7faf10070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf16200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7faf1006b960 0x7faf1006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf16200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf100b6030 con 0x7faf10147790 2024-05-30T06:45:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf16200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7faf100b6890 con 0x7faf1006b960 2024-05-30T06:45:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf16200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faf100b62d0 con 0x7faf100b45d0 2024-05-30T06:45:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf0f400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faf10147790 0x7faf100ae520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53854/0 (socket says 172.21.15.37:53854) 2024-05-30T06:45:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf0f400640 1 -- 172.21.15.37:0/3534412429 learned_addr learned my addr 172.21.15.37:0/3534412429 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf0fe00640 1 --2- 172.21.15.37:0/3534412429 >> v2:172.21.15.105:3300/0 conn(0x7faf1006b960 0x7faf1006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf0ea00640 1 --2- 172.21.15.37:0/3534412429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf100b45d0 0x7faf10070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf0e000640 1 -- 172.21.15.37:0/3534412429 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732469413 0 0) 0x7faf100b6030 con 0x7faf10147790 2024-05-30T06:45:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf0e000640 1 -- 172.21.15.37:0/3534412429 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faef4003530 con 0x7faf10147790 2024-05-30T06:45:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf0ea00640 1 -- 172.21.15.37:0/3534412429 >> v2:172.21.15.105:3300/0 conn(0x7faf1006b960 msgr2=0x7faf1006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf0ea00640 1 --2- 172.21.15.37:0/3534412429 >> v2:172.21.15.105:3300/0 conn(0x7faf1006b960 0x7faf1006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf0ea00640 1 -- 172.21.15.37:0/3534412429 >> v1:172.21.15.37:6789/0 conn(0x7faf10147790 legacy=0x7faf100ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf0ea00640 1 -- 172.21.15.37:0/3534412429 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf100b65b0 con 0x7faf100b45d0 2024-05-30T06:45:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.537+0000 7faf0fe00640 1 --2- 172.21.15.37:0/3534412429 >> v2:172.21.15.105:3300/0 conn(0x7faf1006b960 0x7faf1006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:27.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf0ea00640 1 --2- 172.21.15.37:0/3534412429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf100b45d0 0x7faf10070a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faef80097c0 tx=0x7faef801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8f91fe5d358635a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:27.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf0e000640 1 -- 172.21.15.37:0/3534412429 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef80b0070 con 0x7faf100b45d0 2024-05-30T06:45:27.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf0e000640 1 -- 172.21.15.37:0/3534412429 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef80ab600 con 0x7faf100b45d0 2024-05-30T06:45:27.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf0e000640 1 -- 172.21.15.37:0/3534412429 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef80ab9d0 con 0x7faf100b45d0 2024-05-30T06:45:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf16200640 1 -- 172.21.15.37:0/3534412429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf100b45d0 msgr2=0x7faf10070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf16200640 1 --2- 172.21.15.37:0/3534412429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf100b45d0 0x7faf10070a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faef80097c0 tx=0x7faef801c410 comp rx=0 tx=0).stop 2024-05-30T06:45:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf16200640 1 -- 172.21.15.37:0/3534412429 shutdown_connections 2024-05-30T06:45:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf16200640 1 --2- 172.21.15.37:0/3534412429 >> v2:172.21.15.105:3300/0 conn(0x7faf1006b960 0x7faf1006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf16200640 1 --2- 172.21.15.37:0/3534412429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf100b45d0 0x7faf10070a70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf16200640 1 -- 172.21.15.37:0/3534412429 >> 172.21.15.37:0/3534412429 conn(0x7faf100b6a60 msgr2=0x7faf100b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf16200640 1 -- 172.21.15.37:0/3534412429 shutdown_connections 2024-05-30T06:45:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf16200640 1 -- 172.21.15.37:0/3534412429 wait complete. 2024-05-30T06:45:27.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf16200640 1 Processor -- start 2024-05-30T06:45:27.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.541+0000 7faf16200640 1 -- start start 2024-05-30T06:45:27.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf16200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf1006b960 0x7faf10168b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf16200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100b45d0 0x7faf10166d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf16200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf10147790 0x7faf100b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf16200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faf1016b5d0 con 0x7faf100b45d0 2024-05-30T06:45:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf16200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faf100701c0 con 0x7faf1006b960 2024-05-30T06:45:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf16200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faf1016b750 con 0x7faf10147790 2024-05-30T06:45:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf0ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100b45d0 0x7faf10166d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf0ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100b45d0 0x7faf10166d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41882/0 (socket says 172.21.15.37:41882) 2024-05-30T06:45:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf0ea00640 1 -- 172.21.15.37:0/2399622148 learned_addr learned my addr 172.21.15.37:0/2399622148 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf0f400640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf1006b960 0x7faf10168b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf0fe00640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf10147790 0x7faf100b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf0ea00640 1 -- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf10147790 msgr2=0x7faf100b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf0ea00640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf10147790 0x7faf100b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf0ea00640 1 -- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf1006b960 msgr2=0x7faf10168b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:27.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf0ea00640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf1006b960 0x7faf10168b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf0ea00640 1 -- 172.21.15.37:0/2399622148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf10169050 con 0x7faf100b45d0 2024-05-30T06:45:27.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf0ea00640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100b45d0 0x7faf10166d80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7faef801a040 tx=0x7faef80191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:27.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf07400640 1 -- 172.21.15.37:0/2399622148 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef80b8070 con 0x7faf100b45d0 2024-05-30T06:45:27.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf07400640 1 -- 172.21.15.37:0/2399622148 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef80b4410 con 0x7faf100b45d0 2024-05-30T06:45:27.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf16200640 1 -- 172.21.15.37:0/2399622148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf100b3950 con 0x7faf100b45d0 2024-05-30T06:45:27.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf07400640 1 -- 172.21.15.37:0/2399622148 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef80b0040 con 0x7faf100b45d0 2024-05-30T06:45:27.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf16200640 1 -- 172.21.15.37:0/2399622148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf100b3f10 con 0x7faf100b45d0 2024-05-30T06:45:27.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf16200640 1 -- 172.21.15.37:0/2399622148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf10068b20 con 0x7faf100b45d0 2024-05-30T06:45:27.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.545+0000 7faf07400640 1 -- 172.21.15.37:0/2399622148 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7faef80bb070 con 0x7faf100b45d0 2024-05-30T06:45:27.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.549+0000 7faf07400640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faeec068650 0x7faeec06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.549+0000 7faf07400640 1 -- 172.21.15.37:0/2399622148 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7faef81208e0 con 0x7faf100b45d0 2024-05-30T06:45:27.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.549+0000 7faf0f400640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faeec068650 0x7faeec06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.549+0000 7faf0f400640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faeec068650 0x7faeec06ab10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faf00005c10 tx=0x7faf00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:27.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.553+0000 7faf07400640 1 -- 172.21.15.37:0/2399622148 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faef8016090 con 0x7faf100b45d0 2024-05-30T06:45:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.717+0000 7faf16200640 1 -- 172.21.15.37:0/2399622148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf100755d0 con 0x7faf100b45d0 2024-05-30T06:45:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.721+0000 7faf07400640 1 -- 172.21.15.37:0/2399622148 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16657 (secure 0 0 0) 0x7faef80f0440 con 0x7faf100b45d0 2024-05-30T06:45:27.721 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:27.722 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:43:07.284887+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:43:03.490124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T06:43:04.639175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:45:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.721+0000 7faf16200640 1 -- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faeec068650 msgr2=0x7faeec06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.721+0000 7faf16200640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faeec068650 0x7faeec06ab10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faf00005c10 tx=0x7faf00009040 comp rx=0 tx=0).stop 2024-05-30T06:45:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.721+0000 7faf16200640 1 -- 172.21.15.37:0/2399622148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100b45d0 msgr2=0x7faf10166d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.721+0000 7faf16200640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100b45d0 0x7faf10166d80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7faef801a040 tx=0x7faef80191b0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.721+0000 7faf16200640 1 -- 172.21.15.37:0/2399622148 shutdown_connections 2024-05-30T06:45:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.721+0000 7faf16200640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf10147790 0x7faf100b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.721+0000 7faf16200640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf100b45d0 0x7faf10166d80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.721+0000 7faf16200640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faeec068650 0x7faeec06ab10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.721+0000 7faf16200640 1 --2- 172.21.15.37:0/2399622148 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf1006b960 0x7faf10168b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.721+0000 7faf16200640 1 -- 172.21.15.37:0/2399622148 >> 172.21.15.37:0/2399622148 conn(0x7faf100b6a60 msgr2=0x7faf10162f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.721+0000 7faf16200640 1 -- 172.21.15.37:0/2399622148 shutdown_connections 2024-05-30T06:45:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.721+0000 7faf16200640 1 -- 172.21.15.37:0/2399622148 wait complete. 2024-05-30T06:45:27.743 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:43:03.490124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:43:04.639175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:45:27.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:45:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.885+0000 7fe142200640 1 Processor -- start 2024-05-30T06:45:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.885+0000 7fe142200640 1 -- start start 2024-05-30T06:45:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe142200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe13c06e290 0x7fe13c0d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe142200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13c0cd980 con 0x7fe13c09b0a0 2024-05-30T06:45:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe142200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13c0cdc60 con 0x7fe13c09acc0 2024-05-30T06:45:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe142200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe13c0ce590 con 0x7fe13c06e290 2024-05-30T06:45:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe13c09b0a0 0x7fe13c15e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53856/0 (socket says 172.21.15.37:53856) 2024-05-30T06:45:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13be00640 1 -- 172.21.15.37:0/1917873631 learned_addr learned my addr 172.21.15.37:0/1917873631 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe141800640 1 --2- 172.21.15.37:0/1917873631 >> v2:172.21.15.105:3300/0 conn(0x7fe13c06e290 0x7fe13c0d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399985058 0 0) 0x7fe13c0cd980 con 0x7fe13c09b0a0 2024-05-30T06:45:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe124003530 con 0x7fe13c09b0a0 2024-05-30T06:45:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2085579755 0 0) 0x7fe124003530 con 0x7fe13c09b0a0 2024-05-30T06:45:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 >> v2:172.21.15.105:3300/0 conn(0x7fe13c06e290 msgr2=0x7fe13c0d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 --2- 172.21.15.37:0/1917873631 >> v2:172.21.15.105:3300/0 conn(0x7fe13c06e290 0x7fe13c0d1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 >> v1:172.21.15.105:6789/0 conn(0x7fe13c09acc0 legacy=0x7fe13c06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c0cdf40 con 0x7fe13c09b0a0 2024-05-30T06:45:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fe128001680 con 0x7fe13c09b0a0 2024-05-30T06:45:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 >> v1:172.21.15.37:6789/0 conn(0x7fe13c09b0a0 legacy=0x7fe13c15e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 --2- 172.21.15.37:0/1917873631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1240039c0 0x7fe124003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 --2- 172.21.15.37:0/1917873631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe124004810 0x7fe124004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 --2- 172.21.15.37:0/1917873631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1240051d0 0x7fe12400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c0ce590 con 0x7fe124004810 2024-05-30T06:45:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe12400c080 con 0x7fe1240039c0 2024-05-30T06:45:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe12400c280 con 0x7fe1240051d0 2024-05-30T06:45:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13be00640 1 --2- 172.21.15.37:0/1917873631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe124004810 0x7fe124004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe140e00640 1 --2- 172.21.15.37:0/1917873631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1240039c0 0x7fe124003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe141800640 1 --2- 172.21.15.37:0/1917873631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1240051d0 0x7fe12400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13be00640 1 -- 172.21.15.37:0/1917873631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1240051d0 msgr2=0x7fe12400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13be00640 1 --2- 172.21.15.37:0/1917873631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1240051d0 0x7fe12400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13be00640 1 -- 172.21.15.37:0/1917873631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1240039c0 msgr2=0x7fe124003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13be00640 1 --2- 172.21.15.37:0/1917873631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1240039c0 0x7fe124003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe13be00640 1 -- 172.21.15.37:0/1917873631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe124003530 con 0x7fe124004810 2024-05-30T06:45:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.889+0000 7fe141800640 1 -- 172.21.15.37:0/1917873631 reap_dead start 2024-05-30T06:45:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.893+0000 7fe13be00640 1 --2- 172.21.15.37:0/1917873631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe124004810 0x7fe124004c90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe12800c210 tx=0x7fe12801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c203735dd91dbf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:27.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.893+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe128007d40 con 0x7fe124004810 2024-05-30T06:45:27.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.893+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1280a9070 con 0x7fe124004810 2024-05-30T06:45:27.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.893+0000 7fe13b400640 1 -- 172.21.15.37:0/1917873631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1280a5dc0 con 0x7fe124004810 2024-05-30T06:45:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.893+0000 7fe142200640 1 -- 172.21.15.37:0/1917873631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe124004810 msgr2=0x7fe124004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.893+0000 7fe142200640 1 --2- 172.21.15.37:0/1917873631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe124004810 0x7fe124004c90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe12800c210 tx=0x7fe12801cc20 comp rx=0 tx=0).stop 2024-05-30T06:45:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.893+0000 7fe142200640 1 -- 172.21.15.37:0/1917873631 shutdown_connections 2024-05-30T06:45:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.893+0000 7fe142200640 1 --2- 172.21.15.37:0/1917873631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe124004810 0x7fe124004c90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.893+0000 7fe142200640 1 -- 172.21.15.37:0/1917873631 >> 172.21.15.37:0/1917873631 conn(0x7fe13c0b3ef0 msgr2=0x7fe13c0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.893+0000 7fe142200640 1 -- 172.21.15.37:0/1917873631 shutdown_connections 2024-05-30T06:45:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.893+0000 7fe142200640 1 -- 172.21.15.37:0/1917873631 wait complete. 2024-05-30T06:45:27.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.893+0000 7fe142200640 1 Processor -- start 2024-05-30T06:45:27.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.893+0000 7fe142200640 1 -- start start 2024-05-30T06:45:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe142200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe124004810 0x7fe13c14f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe142200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe13c159490 0x7fe13c159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe142200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c0c8440 0x7fe13c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe142200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c0cea20 con 0x7fe13c0c8440 2024-05-30T06:45:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe142200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c0d1140 con 0x7fe124004810 2024-05-30T06:45:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe142200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe13c14ff10 con 0x7fe13c159490 2024-05-30T06:45:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe141800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c0c8440 0x7fe13c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe141800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c0c8440 0x7fe13c0c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41906/0 (socket says 172.21.15.37:41906) 2024-05-30T06:45:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe141800640 1 -- 172.21.15.37:0/1319193405 learned_addr learned my addr 172.21.15.37:0/1319193405 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe13be00640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe13c159490 0x7fe13c159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe140e00640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe124004810 0x7fe13c14f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe141800640 1 -- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe13c159490 msgr2=0x7fe13c159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:27.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe141800640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe13c159490 0x7fe13c159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe141800640 1 -- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe124004810 msgr2=0x7fe13c14f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:27.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe141800640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe124004810 0x7fe13c14f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:27.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe141800640 1 -- 172.21.15.37:0/1319193405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c15d710 con 0x7fe13c0c8440 2024-05-30T06:45:27.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe140e00640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe124004810 0x7fe13c14f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:27.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe141800640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c0c8440 0x7fe13c0c88c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0b84b0 tx=0x7fe1340115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:27.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe138c00640 1 -- 172.21.15.37:0/1319193405 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134011de0 con 0x7fe13c0c8440 2024-05-30T06:45:27.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe138c00640 1 -- 172.21.15.37:0/1319193405 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe13401b070 con 0x7fe13c0c8440 2024-05-30T06:45:27.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe142200640 1 -- 172.21.15.37:0/1319193405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13c15d9f0 con 0x7fe13c0c8440 2024-05-30T06:45:27.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe138c00640 1 -- 172.21.15.37:0/1319193405 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1340039a0 con 0x7fe13c0c8440 2024-05-30T06:45:27.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe142200640 1 -- 172.21.15.37:0/1319193405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13c15dfb0 con 0x7fe13c0c8440 2024-05-30T06:45:27.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.897+0000 7fe142200640 1 -- 172.21.15.37:0/1319193405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe13c068ab0 con 0x7fe13c0c8440 2024-05-30T06:45:27.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.901+0000 7fe138c00640 1 -- 172.21.15.37:0/1319193405 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7fe134003b40 con 0x7fe13c0c8440 2024-05-30T06:45:27.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.901+0000 7fe138c00640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe11c068680 0x7fe11c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:27.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.901+0000 7fe138c00640 1 -- 172.21.15.37:0/1319193405 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe134087660 con 0x7fe13c0c8440 2024-05-30T06:45:27.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.901+0000 7fe140e00640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe11c068680 0x7fe11c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:27.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.901+0000 7fe140e00640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe11c068680 0x7fe11c06ab40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe130007fd0 tx=0x7fe130009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:27.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:27.905+0000 7fe138c00640 1 -- 172.21.15.37:0/1319193405 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe134057810 con 0x7fe13c0c8440 2024-05-30T06:45:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe142200640 1 -- 172.21.15.37:0/1319193405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe13c0b4c50 con 0x7fe13c0c8440 2024-05-30T06:45:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe138c00640 1 -- 172.21.15.37:0/1319193405 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) ==== 93+0+10 (secure 0 0 0) 0x7fe134057110 con 0x7fe13c0c8440 2024-05-30T06:45:28.070 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:45:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe142200640 1 -- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe11c068680 msgr2=0x7fe11c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe142200640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe11c068680 0x7fe11c06ab40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe130007fd0 tx=0x7fe130009040 comp rx=0 tx=0).stop 2024-05-30T06:45:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe142200640 1 -- 172.21.15.37:0/1319193405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c0c8440 msgr2=0x7fe13c0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe142200640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c0c8440 0x7fe13c0c88c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0b84b0 tx=0x7fe1340115a0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe142200640 1 -- 172.21.15.37:0/1319193405 shutdown_connections 2024-05-30T06:45:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe142200640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe13c0c8440 0x7fe13c0c88c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe142200640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe13c159490 0x7fe13c159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe142200640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe11c068680 0x7fe11c06ab40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe142200640 1 --2- 172.21.15.37:0/1319193405 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe124004810 0x7fe13c14f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe142200640 1 -- 172.21.15.37:0/1319193405 >> 172.21.15.37:0/1319193405 conn(0x7fe13c0b3ef0 msgr2=0x7fe13c0d0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:28.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe142200640 1 -- 172.21.15.37:0/1319193405 shutdown_connections 2024-05-30T06:45:28.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.069+0000 7fe142200640 1 -- 172.21.15.37:0/1319193405 wait complete. 2024-05-30T06:45:28.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:45:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.233+0000 7f1671800640 1 Processor -- start 2024-05-30T06:45:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.233+0000 7f1671800640 1 -- start start 2024-05-30T06:45:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f1671800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f166c15e8b0 0x7f166c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f1671800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c163350 con 0x7f166c06d200 2024-05-30T06:45:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f1671800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c0cfb30 con 0x7f166c0d1ad0 2024-05-30T06:45:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f1671800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f166c09b880 con 0x7f166c15e8b0 2024-05-30T06:45:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f1663e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f166c06d200 0x7f166c09aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53868/0 (socket says 172.21.15.37:53868) 2024-05-30T06:45:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f1663e00640 1 -- 172.21.15.37:0/1315408504 learned_addr learned my addr 172.21.15.37:0/1315408504 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166aa00640 1 --2- 172.21.15.37:0/1315408504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f166c15e8b0 0x7f166c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328161889 0 0) 0x7f166c163350 con 0x7f166c06d200 2024-05-30T06:45:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1650003530 con 0x7f166c06d200 2024-05-30T06:45:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 910545821 0 0) 0x7f1650003530 con 0x7f166c06d200 2024-05-30T06:45:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f166c15e8b0 msgr2=0x7f166c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 --2- 172.21.15.37:0/1315408504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f166c15e8b0 0x7f166c0cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 >> v1:172.21.15.105:6789/0 conn(0x7f166c0d1ad0 legacy=0x7f166c09b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c1627d0 con 0x7f166c06d200 2024-05-30T06:45:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f1654001680 con 0x7f166c06d200 2024-05-30T06:45:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 >> v1:172.21.15.37:6789/0 conn(0x7f166c06d200 legacy=0x7f166c09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 --2- 172.21.15.37:0/1315408504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16500039f0 0x7f1650003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 --2- 172.21.15.37:0/1315408504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f166c15e8b0 0x7f1650004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 --2- 172.21.15.37:0/1315408504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1650004d50 0x7f16500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f166c09b880 con 0x7f16500039f0 2024-05-30T06:45:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f165000b9d0 con 0x7f1650004d50 2024-05-30T06:45:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f165000bbd0 con 0x7f166c15e8b0 2024-05-30T06:45:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166aa00640 1 --2- 172.21.15.37:0/1315408504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16500039f0 0x7f1650003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f1663e00640 1 --2- 172.21.15.37:0/1315408504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f166c15e8b0 0x7f1650004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166b400640 1 --2- 172.21.15.37:0/1315408504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1650004d50 0x7f16500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166aa00640 1 -- 172.21.15.37:0/1315408504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f166c15e8b0 msgr2=0x7f1650004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166aa00640 1 --2- 172.21.15.37:0/1315408504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f166c15e8b0 0x7f1650004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166aa00640 1 -- 172.21.15.37:0/1315408504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1650004d50 msgr2=0x7f16500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:28.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166aa00640 1 --2- 172.21.15.37:0/1315408504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1650004d50 0x7f16500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166aa00640 1 -- 172.21.15.37:0/1315408504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1650003530 con 0x7f16500039f0 2024-05-30T06:45:28.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.237+0000 7f166b400640 1 --2- 172.21.15.37:0/1315408504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1650004d50 0x7f16500051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:28.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.241+0000 7f166aa00640 1 --2- 172.21.15.37:0/1315408504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16500039f0 0x7f1650003dd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f165c009ae0 tx=0x7f165c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39be3b6f0967b99d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:28.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.241+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c0b2070 con 0x7f16500039f0 2024-05-30T06:45:28.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.241+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165c0a55a0 con 0x7f16500039f0 2024-05-30T06:45:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.241+0000 7f166a000640 1 -- 172.21.15.37:0/1315408504 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c0096b0 con 0x7f16500039f0 2024-05-30T06:45:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.241+0000 7f1671800640 1 -- 172.21.15.37:0/1315408504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16500039f0 msgr2=0x7f1650003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.241+0000 7f1671800640 1 --2- 172.21.15.37:0/1315408504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16500039f0 0x7f1650003dd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f165c009ae0 tx=0x7f165c01c9b0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.241+0000 7f166b400640 1 -- 172.21.15.37:0/1315408504 reap_dead start 2024-05-30T06:45:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.241+0000 7f1671800640 1 -- 172.21.15.37:0/1315408504 shutdown_connections 2024-05-30T06:45:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.241+0000 7f1671800640 1 -- 172.21.15.37:0/1315408504 >> 172.21.15.37:0/1315408504 conn(0x7f166c0b4130 msgr2=0x7f166c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.241+0000 7f1671800640 1 -- 172.21.15.37:0/1315408504 shutdown_connections 2024-05-30T06:45:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.241+0000 7f1671800640 1 -- 172.21.15.37:0/1315408504 wait complete. 2024-05-30T06:45:28.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.241+0000 7f1671800640 1 Processor -- start 2024-05-30T06:45:28.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.241+0000 7f1671800640 1 -- start start 2024-05-30T06:45:28.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1671800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16500039f0 0x7f166c0b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1671800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f166c1f86e0 0x7f166c0b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1671800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f166c159790 0x7f166c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1671800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f166c163070 con 0x7f16500039f0 2024-05-30T06:45:28.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1671800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f166c162d90 con 0x7f166c1f86e0 2024-05-30T06:45:28.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1671800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f166c15ec90 con 0x7f166c159790 2024-05-30T06:45:28.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f166aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16500039f0 0x7f166c0b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f166aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16500039f0 0x7f166c0b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41922/0 (socket says 172.21.15.37:41922) 2024-05-30T06:45:28.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f166aa00640 1 -- 172.21.15.37:0/1942467995 learned_addr learned my addr 172.21.15.37:0/1942467995 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:28.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f166b400640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f166c159790 0x7f166c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1663e00640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f166c1f86e0 0x7f166c0b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f166aa00640 1 -- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f166c159790 msgr2=0x7f166c159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f166aa00640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f166c159790 0x7f166c159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f166aa00640 1 -- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f166c1f86e0 msgr2=0x7f166c0b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f166aa00640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f166c1f86e0 0x7f166c0b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f166aa00640 1 -- 172.21.15.37:0/1942467995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c0c7290 con 0x7f16500039f0 2024-05-30T06:45:28.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f166aa00640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16500039f0 0x7f166c0b1570 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f165c0b0040 tx=0x7f1650005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:28.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1662a00640 1 -- 172.21.15.37:0/1942467995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c0b2040 con 0x7f16500039f0 2024-05-30T06:45:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1662a00640 1 -- 172.21.15.37:0/1942467995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165c00f000 con 0x7f16500039f0 2024-05-30T06:45:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1662a00640 1 -- 172.21.15.37:0/1942467995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c0096b0 con 0x7f16500039f0 2024-05-30T06:45:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1671800640 1 -- 172.21.15.37:0/1942467995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f166c0c7570 con 0x7f16500039f0 2024-05-30T06:45:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1671800640 1 -- 172.21.15.37:0/1942467995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f166c0c7b30 con 0x7f16500039f0 2024-05-30T06:45:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1671800640 1 -- 172.21.15.37:0/1942467995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f166c068bc0 con 0x7f16500039f0 2024-05-30T06:45:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.245+0000 7f1662a00640 1 -- 172.21.15.37:0/1942467995 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f165c0c0030 con 0x7f16500039f0 2024-05-30T06:45:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.249+0000 7f1662a00640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1648068680 0x7f164806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.249+0000 7f1662a00640 1 -- 172.21.15.37:0/1942467995 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f165c120b70 con 0x7f16500039f0 2024-05-30T06:45:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.249+0000 7f1663e00640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1648068680 0x7f164806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.249+0000 7f1663e00640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1648068680 0x7f164806ab40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f166c0b10d0 tx=0x7f1654009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.253+0000 7f1662a00640 1 -- 172.21.15.37:0/1942467995 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f165c0c7060 con 0x7f16500039f0 2024-05-30T06:45:28.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.417+0000 7f1671800640 1 -- 172.21.15.37:0/1942467995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f166c0b85a0 con 0x7f16500039f0 2024-05-30T06:45:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.417+0000 7f1662a00640 1 -- 172.21.15.37:0/1942467995 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) ==== 104+0+11 (secure 0 0 0) 0x7f165c0166c0 con 0x7f16500039f0 2024-05-30T06:45:28.419 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:45:28.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.421+0000 7f1671800640 1 -- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1648068680 msgr2=0x7f164806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.421+0000 7f1671800640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1648068680 0x7f164806ab40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f166c0b10d0 tx=0x7f1654009040 comp rx=0 tx=0).stop 2024-05-30T06:45:28.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.421+0000 7f1671800640 1 -- 172.21.15.37:0/1942467995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16500039f0 msgr2=0x7f166c0b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.421+0000 7f1671800640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16500039f0 0x7f166c0b1570 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f165c0b0040 tx=0x7f1650005840 comp rx=0 tx=0).stop 2024-05-30T06:45:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.421+0000 7f1671800640 1 -- 172.21.15.37:0/1942467995 shutdown_connections 2024-05-30T06:45:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.421+0000 7f1671800640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f166c159790 0x7f166c159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.421+0000 7f1671800640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1648068680 0x7f164806ab40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.421+0000 7f1671800640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f166c1f86e0 0x7f166c0b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.421+0000 7f1671800640 1 --2- 172.21.15.37:0/1942467995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16500039f0 0x7f166c0b1570 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.421+0000 7f1671800640 1 -- 172.21.15.37:0/1942467995 >> 172.21.15.37:0/1942467995 conn(0x7f166c0b4130 msgr2=0x7f166c160ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.421+0000 7f1671800640 1 -- 172.21.15.37:0/1942467995 shutdown_connections 2024-05-30T06:45:28.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.421+0000 7f1671800640 1 -- 172.21.15.37:0/1942467995 wait complete. 2024-05-30T06:45:28.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:45:28.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.581+0000 7f4bb9000640 1 Processor -- start 2024-05-30T06:45:28.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4bb9000640 1 -- start start 2024-05-30T06:45:28.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4bb9000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4bb415e890 0x7f4bb415ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4bb9000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4bb40b63d0 0x7f4bb415f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4bb9000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bb40b4160 0x7f4bb40b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4bb9000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb406e080 con 0x7f4bb40b63d0 2024-05-30T06:45:28.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4bb9000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb415f6f0 con 0x7f4bb415e890 2024-05-30T06:45:28.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4bb9000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb40cf780 con 0x7f4bb40b4160 2024-05-30T06:45:28.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4ba9400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4bb40b63d0 0x7f4bb415f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4ba9400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4bb40b63d0 0x7f4bb415f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41932/0 (socket says 172.21.15.37:41932) 2024-05-30T06:45:28.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4ba9400640 1 -- 172.21.15.37:0/4223220482 learned_addr learned my addr 172.21.15.37:0/4223220482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4bb1e00640 1 --2- 172.21.15.37:0/4223220482 >> v2:172.21.15.105:3300/0 conn(0x7f4bb415e890 0x7f4bb415ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4bb2800640 1 --2- 172.21.15.37:0/4223220482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bb40b4160 0x7f4bb40b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4ba9400640 1 -- 172.21.15.37:0/4223220482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bb40b4160 msgr2=0x7f4bb40b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4ba9400640 1 --2- 172.21.15.37:0/4223220482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bb40b4160 0x7f4bb40b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4ba9400640 1 -- 172.21.15.37:0/4223220482 >> v2:172.21.15.105:3300/0 conn(0x7f4bb415e890 msgr2=0x7f4bb415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4ba9400640 1 --2- 172.21.15.37:0/4223220482 >> v2:172.21.15.105:3300/0 conn(0x7f4bb415e890 0x7f4bb415ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4ba9400640 1 -- 172.21.15.37:0/4223220482 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb40cfa40 con 0x7f4bb40b63d0 2024-05-30T06:45:28.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4bb1e00640 1 --2- 172.21.15.37:0/4223220482 >> v2:172.21.15.105:3300/0 conn(0x7f4bb415e890 0x7f4bb415ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:45:28.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.585+0000 7f4bb2800640 1 --2- 172.21.15.37:0/4223220482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bb40b4160 0x7f4bb40b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:45:28.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4ba9400640 1 --2- 172.21.15.37:0/4223220482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40b63d0 0x7f4bb415f1b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4bb406ff20 tx=0x7f4b9c01e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4165480dbe8f2d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:28.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb1400640 1 -- 172.21.15.37:0/4223220482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0ad070 con 0x7f4bb40b63d0 2024-05-30T06:45:28.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb1400640 1 -- 172.21.15.37:0/4223220482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9c004230 con 0x7f4bb40b63d0 2024-05-30T06:45:28.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb1400640 1 -- 172.21.15.37:0/4223220482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0a77b0 con 0x7f4bb40b63d0 2024-05-30T06:45:28.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb9000640 1 -- 172.21.15.37:0/4223220482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40b63d0 msgr2=0x7f4bb415f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb9000640 1 --2- 172.21.15.37:0/4223220482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40b63d0 0x7f4bb415f1b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4bb406ff20 tx=0x7f4b9c01e9a0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb9000640 1 -- 172.21.15.37:0/4223220482 shutdown_connections 2024-05-30T06:45:28.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb9000640 1 --2- 172.21.15.37:0/4223220482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bb40b4160 0x7f4bb40b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb9000640 1 --2- 172.21.15.37:0/4223220482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40b63d0 0x7f4bb415f1b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb9000640 1 --2- 172.21.15.37:0/4223220482 >> v2:172.21.15.105:3300/0 conn(0x7f4bb415e890 0x7f4bb415ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb9000640 1 -- 172.21.15.37:0/4223220482 >> 172.21.15.37:0/4223220482 conn(0x7f4bb406bf60 msgr2=0x7f4bb40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:28.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb9000640 1 -- 172.21.15.37:0/4223220482 shutdown_connections 2024-05-30T06:45:28.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb9000640 1 -- 172.21.15.37:0/4223220482 wait complete. 2024-05-30T06:45:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb9000640 1 Processor -- start 2024-05-30T06:45:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.589+0000 7f4bb9000640 1 -- start start 2024-05-30T06:45:28.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb9000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40b4160 0x7f4bb414a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb9000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bb40b63d0 0x7f4bb415d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb9000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bb415e890 0x7f4bb406e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb9000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb40b5c60 con 0x7f4bb40b4160 2024-05-30T06:45:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb9000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb415b070 con 0x7f4bb40b63d0 2024-05-30T06:45:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb9000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb406e4f0 con 0x7f4bb415e890 2024-05-30T06:45:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40b4160 0x7f4bb414a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40b4160 0x7f4bb414a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41944/0 (socket says 172.21.15.37:41944) 2024-05-30T06:45:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb1e00640 1 -- 172.21.15.37:0/2007917956 learned_addr learned my addr 172.21.15.37:0/2007917956 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4ba9400640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bb40b63d0 0x7f4bb415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb2800640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bb415e890 0x7f4bb406e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb1e00640 1 -- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bb415e890 msgr2=0x7f4bb406e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb1e00640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bb415e890 0x7f4bb406e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb1e00640 1 -- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bb40b63d0 msgr2=0x7f4bb415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb1e00640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bb40b63d0 0x7f4bb415d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb1e00640 1 -- 172.21.15.37:0/2007917956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb415b290 con 0x7f4bb40b4160 2024-05-30T06:45:28.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb1e00640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40b4160 0x7f4bb414a7f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400ce30 tx=0x7f4ba400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:28.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4baaa00640 1 -- 172.21.15.37:0/2007917956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400f890 con 0x7f4bb40b4160 2024-05-30T06:45:28.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4baaa00640 1 -- 172.21.15.37:0/2007917956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba400fa30 con 0x7f4bb40b4160 2024-05-30T06:45:28.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb9000640 1 -- 172.21.15.37:0/2007917956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb415dde0 con 0x7f4bb40b4160 2024-05-30T06:45:28.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4baaa00640 1 -- 172.21.15.37:0/2007917956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba400fe00 con 0x7f4bb40b4160 2024-05-30T06:45:28.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb9000640 1 -- 172.21.15.37:0/2007917956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb415e0c0 con 0x7f4bb40b4160 2024-05-30T06:45:28.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4bb9000640 1 -- 172.21.15.37:0/2007917956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb4068bc0 con 0x7f4bb40b4160 2024-05-30T06:45:28.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.593+0000 7f4baaa00640 1 -- 172.21.15.37:0/2007917956 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 10) ==== 88242+0+0 (secure 0 0 0) 0x7f4ba4018400 con 0x7f4bb40b4160 2024-05-30T06:45:28.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.597+0000 7f4baaa00640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b90068650 0x7f4b9006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.597+0000 7f4baaa00640 1 -- 172.21.15.37:0/2007917956 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f4ba4087bb0 con 0x7f4bb40b4160 2024-05-30T06:45:28.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.597+0000 7f4ba9400640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b90068650 0x7f4b9006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.597+0000 7f4ba9400640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b90068650 0x7f4b9006ab10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0b1000 tx=0x7f4b9c0a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:28.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.601+0000 7f4baaa00640 1 -- 172.21.15.37:0/2007917956 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ba4014030 con 0x7f4bb40b4160 2024-05-30T06:45:28.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.765+0000 7f4bb9000640 1 -- 172.21.15.37:0/2007917956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4bb415b460 con 0x7f4bb40b4160 2024-05-30T06:45:28.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.769+0000 7f4baaa00640 1 -- 172.21.15.37:0/2007917956 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) ==== 100+0+11 (secure 0 0 0) 0x7f4bb415b460 con 0x7f4bb40b4160 2024-05-30T06:45:28.769 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:45:28.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.769+0000 7f4bb9000640 1 -- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b90068650 msgr2=0x7f4b9006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.769+0000 7f4bb9000640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b90068650 0x7f4b9006ab10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0b1000 tx=0x7f4b9c0a9070 comp rx=0 tx=0).stop 2024-05-30T06:45:28.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.769+0000 7f4bb9000640 1 -- 172.21.15.37:0/2007917956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40b4160 msgr2=0x7f4bb414a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.769+0000 7f4bb9000640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40b4160 0x7f4bb414a7f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400ce30 tx=0x7f4ba400a650 comp rx=0 tx=0).stop 2024-05-30T06:45:28.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.769+0000 7f4bb9000640 1 -- 172.21.15.37:0/2007917956 shutdown_connections 2024-05-30T06:45:28.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.769+0000 7f4bb9000640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bb415e890 0x7f4bb406e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.769+0000 7f4bb9000640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b90068650 0x7f4b9006ab10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.769+0000 7f4bb9000640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bb40b63d0 0x7f4bb415d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.769+0000 7f4bb9000640 1 --2- 172.21.15.37:0/2007917956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40b4160 0x7f4bb414a7f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.769+0000 7f4bb9000640 1 -- 172.21.15.37:0/2007917956 >> 172.21.15.37:0/2007917956 conn(0x7f4bb406bf60 msgr2=0x7f4bb40b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:28.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.769+0000 7f4bb9000640 1 -- 172.21.15.37:0/2007917956 shutdown_connections 2024-05-30T06:45:28.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.769+0000 7f4bb9000640 1 -- 172.21.15.37:0/2007917956 wait complete. 2024-05-30T06:45:28.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T06:45:28.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c07400640 1 Processor -- start 2024-05-30T06:45:28.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c07400640 1 -- start start 2024-05-30T06:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c07400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c0015ebc0 0x7f0c000d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c07400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c0009b800 0x7f0c0006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c07400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c000d0840 con 0x7f0c0006dcf0 2024-05-30T06:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c07400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0c0009bce0 con 0x7f0c0015ebc0 2024-05-30T06:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c07400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c000d0ae0 con 0x7f0c0009b800 2024-05-30T06:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c04a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c0015ebc0 0x7f0c000d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c04a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c0015ebc0 0x7f0c000d15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41956/0 (socket says 172.21.15.37:41956) 2024-05-30T06:45:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c04a00640 1 -- 172.21.15.37:0/1173236966 learned_addr learned my addr 172.21.15.37:0/1173236966 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0bf7e00640 1 --2- 172.21.15.37:0/1173236966 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c0009b800 0x7f0c0006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c04a00640 1 -- 172.21.15.37:0/1173236966 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c0009b800 msgr2=0x7f0c0006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c04a00640 1 --2- 172.21.15.37:0/1173236966 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c0009b800 0x7f0c0006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c04a00640 1 -- 172.21.15.37:0/1173236966 >> v1:172.21.15.105:6789/0 conn(0x7f0c0006dcf0 legacy=0x7f0c0009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.937+0000 7f0c04a00640 1 -- 172.21.15.37:0/1173236966 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c000d0dc0 con 0x7f0c0015ebc0 2024-05-30T06:45:28.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.941+0000 7f0c04a00640 1 --2- 172.21.15.37:0/1173236966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0015ebc0 0x7f0c000d15c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009870 tx=0x7f0bf001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad52a3c263b29cb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:28.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.941+0000 7f0bffe00640 1 -- 172.21.15.37:0/1173236966 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf00ab5f0 con 0x7f0c0015ebc0 2024-05-30T06:45:28.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.941+0000 7f0bffe00640 1 -- 172.21.15.37:0/1173236966 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf00b0070 con 0x7f0c0015ebc0 2024-05-30T06:45:28.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.941+0000 7f0bffe00640 1 -- 172.21.15.37:0/1173236966 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf00ab9b0 con 0x7f0c0015ebc0 2024-05-30T06:45:28.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.941+0000 7f0c07400640 1 -- 172.21.15.37:0/1173236966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0015ebc0 msgr2=0x7f0c000d15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.941+0000 7f0c07400640 1 --2- 172.21.15.37:0/1173236966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0015ebc0 0x7f0c000d15c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009870 tx=0x7f0bf001c560 comp rx=0 tx=0).stop 2024-05-30T06:45:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.941+0000 7f0c07400640 1 -- 172.21.15.37:0/1173236966 shutdown_connections 2024-05-30T06:45:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.941+0000 7f0c07400640 1 --2- 172.21.15.37:0/1173236966 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c0009b800 0x7f0c0006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.941+0000 7f0c07400640 1 --2- 172.21.15.37:0/1173236966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0015ebc0 0x7f0c000d15c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.941+0000 7f0c07400640 1 -- 172.21.15.37:0/1173236966 >> 172.21.15.37:0/1173236966 conn(0x7f0c000b4060 msgr2=0x7f0c000b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.941+0000 7f0c07400640 1 -- 172.21.15.37:0/1173236966 shutdown_connections 2024-05-30T06:45:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.941+0000 7f0c07400640 1 -- 172.21.15.37:0/1173236966 wait complete. 2024-05-30T06:45:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c07400640 1 Processor -- start 2024-05-30T06:45:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c07400640 1 -- start start 2024-05-30T06:45:28.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c07400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c0006dcf0 0x7f0c00159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c07400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c0009b800 0x7f0c0015ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c07400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0015ebc0 0x7f0c000b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c07400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0009b2f0 con 0x7f0c0015ebc0 2024-05-30T06:45:28.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c07400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0009b170 con 0x7f0c0009b800 2024-05-30T06:45:28.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c07400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c000cd3d0 con 0x7f0c0006dcf0 2024-05-30T06:45:28.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c05400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0015ebc0 0x7f0c000b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c05400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0015ebc0 0x7f0c000b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41968/0 (socket says 172.21.15.37:41968) 2024-05-30T06:45:28.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c05400640 1 -- 172.21.15.37:0/2166922003 learned_addr learned my addr 172.21.15.37:0/2166922003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:28.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c04a00640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c0006dcf0 0x7f0c00159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0bf7e00640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c0009b800 0x7f0c0015ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c05400640 1 -- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c0006dcf0 msgr2=0x7f0c00159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c05400640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c0006dcf0 0x7f0c00159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c05400640 1 -- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c0009b800 msgr2=0x7f0c0015ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c05400640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c0009b800 0x7f0c0015ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c05400640 1 -- 172.21.15.37:0/2166922003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0015da10 con 0x7f0c0015ebc0 2024-05-30T06:45:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c05400640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0015ebc0 0x7f0c000b0480 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800c7a0 tx=0x7f0bf800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0bfd600640 1 -- 172.21.15.37:0/2166922003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8003b80 con 0x7f0c0015ebc0 2024-05-30T06:45:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0bfd600640 1 -- 172.21.15.37:0/2166922003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf8003d20 con 0x7f0c0015ebc0 2024-05-30T06:45:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0bfd600640 1 -- 172.21.15.37:0/2166922003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800aa30 con 0x7f0c0015ebc0 2024-05-30T06:45:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c07400640 1 -- 172.21.15.37:0/2166922003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c0015d170 con 0x7f0c0015ebc0 2024-05-30T06:45:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c07400640 1 -- 172.21.15.37:0/2166922003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c0015d730 con 0x7f0c0015ebc0 2024-05-30T06:45:28.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.945+0000 7f0c07400640 1 -- 172.21.15.37:0/2166922003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c00068bc0 con 0x7f0c0015ebc0 2024-05-30T06:45:28.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.949+0000 7f0bfd600640 1 -- 172.21.15.37:0/2166922003 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f0bf800abd0 con 0x7f0c0015ebc0 2024-05-30T06:45:28.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.949+0000 7f0bfd600640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bdc0686e0 0x7f0bdc06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:28.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.949+0000 7f0bfd600640 1 -- 172.21.15.37:0/2166922003 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5765+0+0 (secure 0 0 0) 0x7f0bf8086f00 con 0x7f0c0015ebc0 2024-05-30T06:45:28.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.949+0000 7f0c04a00640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bdc0686e0 0x7f0bdc06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:28.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.949+0000 7f0c04a00640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bdc0686e0 0x7f0bdc06aba0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00af000 tx=0x7f0bf00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:28.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:28.953+0000 7f0bfd600640 1 -- 172.21.15.37:0/2166922003 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0bf8056fc0 con 0x7f0c0015ebc0 2024-05-30T06:45:29.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0c07400640 1 -- 172.21.15.37:0/2166922003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0c001577c0 con 0x7f0c0015ebc0 2024-05-30T06:45:29.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0bfd600640 1 -- 172.21.15.37:0/2166922003 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f0bf80568c0 con 0x7f0c0015ebc0 2024-05-30T06:45:29.137 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-30T06:45:29.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0c07400640 1 -- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bdc0686e0 msgr2=0x7f0bdc06aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0c07400640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bdc0686e0 0x7f0bdc06aba0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00af000 tx=0x7f0bf00a7000 comp rx=0 tx=0).stop 2024-05-30T06:45:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0c07400640 1 -- 172.21.15.37:0/2166922003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0015ebc0 msgr2=0x7f0c000b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0c07400640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0015ebc0 0x7f0c000b0480 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800c7a0 tx=0x7f0bf800cc60 comp rx=0 tx=0).stop 2024-05-30T06:45:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0c07400640 1 -- 172.21.15.37:0/2166922003 shutdown_connections 2024-05-30T06:45:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0c07400640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c0015ebc0 0x7f0c000b0480 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0c07400640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bdc0686e0 0x7f0bdc06aba0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0c07400640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c0009b800 0x7f0c0015ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0c07400640 1 --2- 172.21.15.37:0/2166922003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c0006dcf0 0x7f0c00159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0c07400640 1 -- 172.21.15.37:0/2166922003 >> 172.21.15.37:0/2166922003 conn(0x7f0c000b4060 msgr2=0x7f0c000b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0c07400640 1 -- 172.21.15.37:0/2166922003 shutdown_connections 2024-05-30T06:45:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.137+0000 7f0c07400640 1 -- 172.21.15.37:0/2166922003 wait complete. 2024-05-30T06:45:29.158 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T06:45:29.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:45:29.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-30T06:45:29.223 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:45:29.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:45:29.223 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T06:45:29.248 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:45:29.248 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:45:29.248 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:45:29.257 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:45:29.257 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:45:29.257 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:45:29.257 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:45:29.301 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:45:29.301 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:45:29.301 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:45:29.301 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:45:29.311 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:45:29.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:45:29.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.541+0000 7f8734e00640 1 Processor -- start 2024-05-30T06:45:29.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.541+0000 7f8734e00640 1 -- start start 2024-05-30T06:45:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.541+0000 7f8734e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8730070430 0x7f873015f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.541+0000 7f8734e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8730070810 0x7f8730072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:29.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.541+0000 7f8734e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f87300733e0 0x7f873006f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:29.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.541+0000 7f8734e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f873015f590 con 0x7f8730070430 2024-05-30T06:45:29.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.541+0000 7f8734e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f873006e4f0 con 0x7f87300733e0 2024-05-30T06:45:29.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.541+0000 7f8734e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f873006e7d0 con 0x7f8730070810 2024-05-30T06:45:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.541+0000 7f872e800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f87300733e0 0x7f873006f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.545+0000 7f872e800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f87300733e0 0x7f873006f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:50676/0 (socket says 172.21.15.37:50676) 2024-05-30T06:45:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.545+0000 7f872e800640 1 -- 172.21.15.37:0/1265976496 learned_addr learned my addr 172.21.15.37:0/1265976496 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.545+0000 7f872de00640 1 --2- 172.21.15.37:0/1265976496 >> v2:172.21.15.37:3300/0 conn(0x7f8730070430 0x7f873015f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.545+0000 7f872d400640 1 --2- 172.21.15.37:0/1265976496 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8730070810 0x7f8730072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.545+0000 7f872e800640 1 -- 172.21.15.37:0/1265976496 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8730070810 msgr2=0x7f8730072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:29.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.545+0000 7f872e800640 1 --2- 172.21.15.37:0/1265976496 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8730070810 0x7f8730072ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.545+0000 7f872e800640 1 -- 172.21.15.37:0/1265976496 >> v2:172.21.15.37:3300/0 conn(0x7f8730070430 msgr2=0x7f873015f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:29.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.545+0000 7f872e800640 1 --2- 172.21.15.37:0/1265976496 >> v2:172.21.15.37:3300/0 conn(0x7f8730070430 0x7f873015f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.545+0000 7f872e800640 1 -- 172.21.15.37:0/1265976496 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873006eab0 con 0x7f87300733e0 2024-05-30T06:45:29.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.549+0000 7f872e800640 1 --2- 172.21.15.37:0/1265976496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87300733e0 0x7f873006f590 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f873006db90 tx=0x7f872801c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce072b213927be5c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:29.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.549+0000 7f872ca00640 1 -- 172.21.15.37:0/1265976496 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87280a5840 con 0x7f87300733e0 2024-05-30T06:45:29.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.549+0000 7f872ca00640 1 -- 172.21.15.37:0/1265976496 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87280a59e0 con 0x7f87300733e0 2024-05-30T06:45:29.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.549+0000 7f872ca00640 1 -- 172.21.15.37:0/1265976496 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87280a5db0 con 0x7f87300733e0 2024-05-30T06:45:29.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.553+0000 7f8734e00640 1 -- 172.21.15.37:0/1265976496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87300733e0 msgr2=0x7f873006f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:29.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.553+0000 7f8734e00640 1 --2- 172.21.15.37:0/1265976496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87300733e0 0x7f873006f590 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f873006db90 tx=0x7f872801c9c0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.553+0000 7f8734e00640 1 -- 172.21.15.37:0/1265976496 shutdown_connections 2024-05-30T06:45:29.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.553+0000 7f8734e00640 1 --2- 172.21.15.37:0/1265976496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87300733e0 0x7f873006f590 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.553+0000 7f8734e00640 1 --2- 172.21.15.37:0/1265976496 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8730070810 0x7f8730072ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.553+0000 7f8734e00640 1 --2- 172.21.15.37:0/1265976496 >> v2:172.21.15.37:3300/0 conn(0x7f8730070430 0x7f873015f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.553+0000 7f8734e00640 1 -- 172.21.15.37:0/1265976496 >> 172.21.15.37:0/1265976496 conn(0x7f8730072380 msgr2=0x7f8730072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:29.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.553+0000 7f8734e00640 1 -- 172.21.15.37:0/1265976496 shutdown_connections 2024-05-30T06:45:29.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.553+0000 7f8734e00640 1 -- 172.21.15.37:0/1265976496 wait complete. 2024-05-30T06:45:29.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.553+0000 7f8734e00640 1 Processor -- start 2024-05-30T06:45:29.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f8734e00640 1 -- start start 2024-05-30T06:45:29.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f8734e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8730070430 0x7f8730145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:29.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f8734e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8730070810 0x7f87301fb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:29.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f8734e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87300733e0 0x7f873013e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:29.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f8734e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8730070d70 con 0x7f8730070810 2024-05-30T06:45:29.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f8734e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8730070bf0 con 0x7f8730070430 2024-05-30T06:45:29.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f8734e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f87300aecf0 con 0x7f87300733e0 2024-05-30T06:45:29.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f872d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8730070810 0x7f87301fb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:29.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f872e800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87300733e0 0x7f873013e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:29.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f872d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8730070810 0x7f87301fb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41992/0 (socket says 172.21.15.37:41992) 2024-05-30T06:45:29.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f872d400640 1 -- 172.21.15.37:0/2997487470 learned_addr learned my addr 172.21.15.37:0/2997487470 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:29.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f872de00640 1 --2- 172.21.15.37:0/2997487470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8730070430 0x7f8730145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:29.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f872d400640 1 -- 172.21.15.37:0/2997487470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87300733e0 msgr2=0x7f873013e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:29.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f872d400640 1 --2- 172.21.15.37:0/2997487470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87300733e0 0x7f873013e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f872d400640 1 -- 172.21.15.37:0/2997487470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8730070430 msgr2=0x7f8730145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:29.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f872d400640 1 --2- 172.21.15.37:0/2997487470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8730070430 0x7f8730145a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f872d400640 1 -- 172.21.15.37:0/2997487470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873015d170 con 0x7f8730070810 2024-05-30T06:45:29.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f872d400640 1 --2- 172.21.15.37:0/2997487470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8730070810 0x7f87301fb6d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f871c00d800 tx=0x7f871c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:29.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.557+0000 7f8726000640 1 -- 172.21.15.37:0/2997487470 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c00b6c0 con 0x7f8730070810 2024-05-30T06:45:29.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.561+0000 7f8734e00640 1 -- 172.21.15.37:0/2997487470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873015d450 con 0x7f8730070810 2024-05-30T06:45:29.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.561+0000 7f8734e00640 1 -- 172.21.15.37:0/2997487470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f873015da10 con 0x7f8730070810 2024-05-30T06:45:29.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.561+0000 7f8726000640 1 -- 172.21.15.37:0/2997487470 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871c019070 con 0x7f8730070810 2024-05-30T06:45:29.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.561+0000 7f8726000640 1 -- 172.21.15.37:0/2997487470 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c00ba60 con 0x7f8730070810 2024-05-30T06:45:29.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.561+0000 7f8734e00640 1 -- 172.21.15.37:0/2997487470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87080052a0 con 0x7f8730070810 2024-05-30T06:45:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.561+0000 7f8726000640 1 -- 172.21.15.37:0/2997487470 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f871c00bc00 con 0x7f8730070810 2024-05-30T06:45:29.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.565+0000 7f8726000640 1 --2- 172.21.15.37:0/2997487470 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8710068710 0x7f871006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:29.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.565+0000 7f8726000640 1 -- 172.21.15.37:0/2997487470 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5765+0+0 (secure 0 0 0) 0x7f871c087310 con 0x7f8730070810 2024-05-30T06:45:29.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.565+0000 7f872de00640 1 --2- 172.21.15.37:0/2997487470 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8710068710 0x7f871006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:29.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.569+0000 7f872de00640 1 --2- 172.21.15.37:0/2997487470 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8710068710 0x7f871006abd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8730140450 tx=0x7f8720008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:29.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.573+0000 7f8726000640 1 -- 172.21.15.37:0/2997487470 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f871c057480 con 0x7f8730070810 2024-05-30T06:45:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.945+0000 7f8734e00640 1 -- 172.21.15.37:0/2997487470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8708005860 con 0x7f8730070810 2024-05-30T06:45:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.949+0000 7f8726000640 1 -- 172.21.15.37:0/2997487470 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5178 (secure 0 0 0) 0x7f871c056d80 con 0x7f8730070810 2024-05-30T06:45:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:29.949 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1355950100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1355950100},{"type":"v1","addr":"172.21.15.37:6835","nonce":1355950100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3139010455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3139010455},{"type":"v1","addr":"172.21.15.105:6836","nonce":3139010455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/189373657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":189373657},{"type":"v1","addr":"172.21.15.105:6837","nonce":189373657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:43:05.679965+0000","modified":"2024-05-30T06:43:08.691367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6833/12178000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":12178000},{"type":"v1","addr":"172.21.15.37:6833","nonce":12178000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5040,"qdb_cluster":[5040]},"id":2}]} 2024-05-30T06:45:29.949 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2024-05-30T06:45:29.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.949+0000 7f8734e00640 1 -- 172.21.15.37:0/2997487470 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8710068710 msgr2=0x7f871006abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:29.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.949+0000 7f8734e00640 1 --2- 172.21.15.37:0/2997487470 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8710068710 0x7f871006abd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8730140450 tx=0x7f8720008040 comp rx=0 tx=0).stop 2024-05-30T06:45:29.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.949+0000 7f8734e00640 1 -- 172.21.15.37:0/2997487470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8730070810 msgr2=0x7f87301fb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:29.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.949+0000 7f8734e00640 1 --2- 172.21.15.37:0/2997487470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8730070810 0x7f87301fb6d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f871c00d800 tx=0x7f871c00dcc0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.949+0000 7f8734e00640 1 -- 172.21.15.37:0/2997487470 shutdown_connections 2024-05-30T06:45:29.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.949+0000 7f8734e00640 1 --2- 172.21.15.37:0/2997487470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87300733e0 0x7f873013e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.949+0000 7f8734e00640 1 --2- 172.21.15.37:0/2997487470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8730070810 0x7f87301fb6d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.949+0000 7f8734e00640 1 --2- 172.21.15.37:0/2997487470 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8710068710 0x7f871006abd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.949+0000 7f8734e00640 1 --2- 172.21.15.37:0/2997487470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8730070430 0x7f8730145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:29.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.949+0000 7f8734e00640 1 -- 172.21.15.37:0/2997487470 >> 172.21.15.37:0/2997487470 conn(0x7f8730072380 msgr2=0x7f873015ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:29.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.949+0000 7f8734e00640 1 -- 172.21.15.37:0/2997487470 shutdown_connections 2024-05-30T06:45:29.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:29.949+0000 7f8734e00640 1 -- 172.21.15.37:0/2997487470 wait complete. 2024-05-30T06:45:29.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:45:30.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d42600640 1 Processor -- start 2024-05-30T06:45:30.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d42600640 1 -- start start 2024-05-30T06:45:30.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d42600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5d3c1482d0 0x7f5d3c0b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:30.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d42600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d3c15eed0 0x7f5d3c15f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:30.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d42600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d3c15f8a0 con 0x7f5d3c0af690 2024-05-30T06:45:30.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d42600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5d3c06e860 con 0x7f5d3c1482d0 2024-05-30T06:45:30.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d42600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3c0afe30 con 0x7f5d3c15eed0 2024-05-30T06:45:30.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d3aa00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5d3c0af690 0x7f5d3c15ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53872/0 (socket says 172.21.15.37:53872) 2024-05-30T06:45:30.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d3aa00640 1 -- 172.21.15.37:0/1009057250 learned_addr learned my addr 172.21.15.37:0/1009057250 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:30.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d3be00640 1 --2- 172.21.15.37:0/1009057250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d3c15eed0 0x7f5d3c15f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:30.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d3b400640 1 --2- 172.21.15.37:0/1009057250 >> v2:172.21.15.105:3300/0 conn(0x7f5d3c1482d0 0x7f5d3c0b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:30.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d3a000640 1 -- 172.21.15.37:0/1009057250 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935655812 0 0) 0x7f5d3c15f8a0 con 0x7f5d3c0af690 2024-05-30T06:45:30.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d3a000640 1 -- 172.21.15.37:0/1009057250 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d20003530 con 0x7f5d3c0af690 2024-05-30T06:45:30.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d3b400640 1 -- 172.21.15.37:0/1009057250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d3c15eed0 msgr2=0x7f5d3c15f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:30.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d3b400640 1 --2- 172.21.15.37:0/1009057250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d3c15eed0 0x7f5d3c15f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d3b400640 1 -- 172.21.15.37:0/1009057250 >> v1:172.21.15.37:6789/0 conn(0x7f5d3c0af690 legacy=0x7f5d3c15ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:30.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d3b400640 1 -- 172.21.15.37:0/1009057250 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c06e210 con 0x7f5d3c1482d0 2024-05-30T06:45:30.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.205+0000 7f5d3be00640 1 --2- 172.21.15.37:0/1009057250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d3c15eed0 0x7f5d3c15f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:30.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.209+0000 7f5d3b400640 1 --2- 172.21.15.37:0/1009057250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d3c1482d0 0x7f5d3c0b2ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c0097c0 tx=0x7f5d2c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f60e4b9070f2717 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:30.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.209+0000 7f5d3a000640 1 -- 172.21.15.37:0/1009057250 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0b0070 con 0x7f5d3c1482d0 2024-05-30T06:45:30.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.209+0000 7f5d3a000640 1 -- 172.21.15.37:0/1009057250 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d2c0ab600 con 0x7f5d3c1482d0 2024-05-30T06:45:30.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.209+0000 7f5d3a000640 1 -- 172.21.15.37:0/1009057250 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0ab9b0 con 0x7f5d3c1482d0 2024-05-30T06:45:30.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.209+0000 7f5d42600640 1 -- 172.21.15.37:0/1009057250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d3c1482d0 msgr2=0x7f5d3c0b2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:30.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.209+0000 7f5d42600640 1 --2- 172.21.15.37:0/1009057250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d3c1482d0 0x7f5d3c0b2ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c0097c0 tx=0x7f5d2c01c410 comp rx=0 tx=0).stop 2024-05-30T06:45:30.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.209+0000 7f5d42600640 1 -- 172.21.15.37:0/1009057250 shutdown_connections 2024-05-30T06:45:30.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.209+0000 7f5d42600640 1 --2- 172.21.15.37:0/1009057250 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d3c15eed0 0x7f5d3c15f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.209+0000 7f5d42600640 1 --2- 172.21.15.37:0/1009057250 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d3c1482d0 0x7f5d3c0b2ec0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.209+0000 7f5d42600640 1 -- 172.21.15.37:0/1009057250 >> 172.21.15.37:0/1009057250 conn(0x7f5d3c0b23a0 msgr2=0x7f5d3c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:30.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.209+0000 7f5d42600640 1 -- 172.21.15.37:0/1009057250 shutdown_connections 2024-05-30T06:45:30.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.209+0000 7f5d42600640 1 -- 172.21.15.37:0/1009057250 wait complete. 2024-05-30T06:45:30.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.213+0000 7f5d42600640 1 Processor -- start 2024-05-30T06:45:30.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.213+0000 7f5d42600640 1 -- start start 2024-05-30T06:45:30.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.213+0000 7f5d42600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d3c0af690 0x7f5d3c144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:30.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.213+0000 7f5d42600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d3c1482d0 0x7f5d3c13b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:30.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.213+0000 7f5d42600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d3c15eed0 0x7f5d3c0cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:30.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.213+0000 7f5d42600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c06f8d0 con 0x7f5d3c0af690 2024-05-30T06:45:30.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.213+0000 7f5d42600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c06f750 con 0x7f5d3c1482d0 2024-05-30T06:45:30.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.213+0000 7f5d42600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3c16b890 con 0x7f5d3c15eed0 2024-05-30T06:45:30.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.213+0000 7f5d3aa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d3c1482d0 0x7f5d3c13b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:30.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.213+0000 7f5d3be00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d3c15eed0 0x7f5d3c0cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:30.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.213+0000 7f5d3aa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d3c1482d0 0x7f5d3c13b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:50694/0 (socket says 172.21.15.37:50694) 2024-05-30T06:45:30.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.213+0000 7f5d3aa00640 1 -- 172.21.15.37:0/1738139785 learned_addr learned my addr 172.21.15.37:0/1738139785 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.217+0000 7f5d3b400640 1 --2- 172.21.15.37:0/1738139785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d3c0af690 0x7f5d3c144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.217+0000 7f5d3aa00640 1 -- 172.21.15.37:0/1738139785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d3c15eed0 msgr2=0x7f5d3c0cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.217+0000 7f5d3aa00640 1 --2- 172.21.15.37:0/1738139785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d3c15eed0 0x7f5d3c0cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.217+0000 7f5d3aa00640 1 -- 172.21.15.37:0/1738139785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d3c0af690 msgr2=0x7f5d3c144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.217+0000 7f5d3aa00640 1 --2- 172.21.15.37:0/1738139785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d3c0af690 0x7f5d3c144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.217+0000 7f5d3aa00640 1 -- 172.21.15.37:0/1738139785 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c0cfc40 con 0x7f5d3c1482d0 2024-05-30T06:45:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.217+0000 7f5d3aa00640 1 --2- 172.21.15.37:0/1738139785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d3c1482d0 0x7f5d3c13b960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c3c0 tx=0x7f5d2800c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.217+0000 7f5d33400640 1 -- 172.21.15.37:0/1738139785 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28017070 con 0x7f5d3c1482d0 2024-05-30T06:45:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.217+0000 7f5d33400640 1 -- 172.21.15.37:0/1738139785 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d28005db0 con 0x7f5d3c1482d0 2024-05-30T06:45:30.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.217+0000 7f5d33400640 1 -- 172.21.15.37:0/1738139785 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d280072f0 con 0x7f5d3c1482d0 2024-05-30T06:45:30.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.217+0000 7f5d42600640 1 -- 172.21.15.37:0/1738139785 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c1476d0 con 0x7f5d3c1482d0 2024-05-30T06:45:30.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.217+0000 7f5d42600640 1 -- 172.21.15.37:0/1738139785 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c1428e0 con 0x7f5d3c1482d0 2024-05-30T06:45:30.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.217+0000 7f5d42600640 1 -- 172.21.15.37:0/1738139785 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c068b20 con 0x7f5d3c1482d0 2024-05-30T06:45:30.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.221+0000 7f5d33400640 1 -- 172.21.15.37:0/1738139785 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f5d2801a070 con 0x7f5d3c1482d0 2024-05-30T06:45:30.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.221+0000 7f5d33400640 1 --2- 172.21.15.37:0/1738139785 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d1c068730 0x7f5d1c06abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:30.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.221+0000 7f5d33400640 1 -- 172.21.15.37:0/1738139785 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5765+0+0 (secure 0 0 0) 0x7f5d28086770 con 0x7f5d3c1482d0 2024-05-30T06:45:30.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.221+0000 7f5d3b400640 1 --2- 172.21.15.37:0/1738139785 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d1c068730 0x7f5d1c06abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:30.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.221+0000 7f5d3b400640 1 --2- 172.21.15.37:0/1738139785 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d1c068730 0x7f5d1c06abf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c0ad000 tx=0x7f5d2c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:30.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.229+0000 7f5d33400640 1 -- 172.21.15.37:0/1738139785 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5d28021020 con 0x7f5d3c1482d0 2024-05-30T06:45:30.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.541+0000 7f5d42600640 1 -- 172.21.15.37:0/1738139785 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d3c072fb0 con 0x7f5d3c1482d0 2024-05-30T06:45:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.541+0000 7f5d33400640 1 -- 172.21.15.37:0/1738139785 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16765 (secure 0 0 0) 0x7f5d280569e0 con 0x7f5d3c1482d0 2024-05-30T06:45:30.544 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:30.545 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:45:28.779169+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:43:03.490124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T06:43:04.639175+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:45:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.545+0000 7f5d42600640 1 -- 172.21.15.37:0/1738139785 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d1c068730 msgr2=0x7f5d1c06abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.545+0000 7f5d42600640 1 --2- 172.21.15.37:0/1738139785 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d1c068730 0x7f5d1c06abf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c0ad000 tx=0x7f5d2c0a6000 comp rx=0 tx=0).stop 2024-05-30T06:45:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.545+0000 7f5d42600640 1 -- 172.21.15.37:0/1738139785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d3c1482d0 msgr2=0x7f5d3c13b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:30.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.545+0000 7f5d42600640 1 --2- 172.21.15.37:0/1738139785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d3c1482d0 0x7f5d3c13b960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c3c0 tx=0x7f5d2800c7c0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.545+0000 7f5d42600640 1 -- 172.21.15.37:0/1738139785 shutdown_connections 2024-05-30T06:45:30.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.545+0000 7f5d42600640 1 --2- 172.21.15.37:0/1738139785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d3c15eed0 0x7f5d3c0cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.545+0000 7f5d42600640 1 --2- 172.21.15.37:0/1738139785 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d1c068730 0x7f5d1c06abf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.545+0000 7f5d42600640 1 --2- 172.21.15.37:0/1738139785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d3c1482d0 0x7f5d3c13b960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.545+0000 7f5d42600640 1 --2- 172.21.15.37:0/1738139785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d3c0af690 0x7f5d3c144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.545+0000 7f5d42600640 1 -- 172.21.15.37:0/1738139785 >> 172.21.15.37:0/1738139785 conn(0x7f5d3c0b23a0 msgr2=0x7f5d3c0b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.545+0000 7f5d42600640 1 -- 172.21.15.37:0/1738139785 shutdown_connections 2024-05-30T06:45:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.545+0000 7f5d42600640 1 -- 172.21.15.37:0/1738139785 wait complete. 2024-05-30T06:45:30.580 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:43:03.490124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:43:04.639175+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 34, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:45:30.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:45:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.813+0000 7f017f200640 1 Processor -- start 2024-05-30T06:45:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.813+0000 7f017f200640 1 -- start start 2024-05-30T06:45:30.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.813+0000 7f017f200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f018015c5c0 0x7f0180070840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:30.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.813+0000 7f017f200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f018015c9a0 0x7f01800d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:30.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.813+0000 7f017f200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01800d0960 con 0x7f018006c970 2024-05-30T06:45:30.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.813+0000 7f017f200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f01800b5a20 con 0x7f018015c5c0 2024-05-30T06:45:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.813+0000 7f017f200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0180070e90 con 0x7f018015c9a0 2024-05-30T06:45:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.817+0000 7f017e800640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f018006c970 0x7f01800cd570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:55874/0 (socket says 172.21.15.37:55874) 2024-05-30T06:45:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.817+0000 7f017e800640 1 -- 172.21.15.37:0/487177539 learned_addr learned my addr 172.21.15.37:0/487177539 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.817+0000 7f017de00640 1 --2- 172.21.15.37:0/487177539 >> v2:172.21.15.37:3300/0 conn(0x7f018015c5c0 0x7f0180070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.817+0000 7f017d400640 1 --2- 172.21.15.37:0/487177539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f018015c9a0 0x7f01800d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.817+0000 7f017d400640 1 -- 172.21.15.37:0/487177539 >> v2:172.21.15.37:3300/0 conn(0x7f018015c5c0 msgr2=0x7f0180070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.817+0000 7f017d400640 1 --2- 172.21.15.37:0/487177539 >> v2:172.21.15.37:3300/0 conn(0x7f018015c5c0 0x7f0180070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.817+0000 7f017d400640 1 -- 172.21.15.37:0/487177539 >> v1:172.21.15.105:6789/0 conn(0x7f018006c970 legacy=0x7f01800cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.817+0000 7f017d400640 1 -- 172.21.15.37:0/487177539 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01800b3c50 con 0x7f018015c9a0 2024-05-30T06:45:30.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.821+0000 7f017d400640 1 --2- 172.21.15.37:0/487177539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f018015c9a0 0x7f01800d0420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f016c0097c0 tx=0x7f016c01c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fc0e52983072ec7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.825+0000 7f017ca00640 1 -- 172.21.15.37:0/487177539 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c0b0070 con 0x7f018015c9a0 2024-05-30T06:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.825+0000 7f017ca00640 1 -- 172.21.15.37:0/487177539 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f016c0ab600 con 0x7f018015c9a0 2024-05-30T06:45:30.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.825+0000 7f017ca00640 1 -- 172.21.15.37:0/487177539 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016c0ab9d0 con 0x7f018015c9a0 2024-05-30T06:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.825+0000 7f017f200640 1 -- 172.21.15.37:0/487177539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f018015c9a0 msgr2=0x7f01800d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.825+0000 7f017f200640 1 --2- 172.21.15.37:0/487177539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f018015c9a0 0x7f01800d0420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f016c0097c0 tx=0x7f016c01c330 comp rx=0 tx=0).stop 2024-05-30T06:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.825+0000 7f017f200640 1 -- 172.21.15.37:0/487177539 shutdown_connections 2024-05-30T06:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.825+0000 7f017f200640 1 --2- 172.21.15.37:0/487177539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f018015c9a0 0x7f01800d0420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.825+0000 7f017f200640 1 --2- 172.21.15.37:0/487177539 >> v2:172.21.15.37:3300/0 conn(0x7f018015c5c0 0x7f0180070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.825+0000 7f017f200640 1 -- 172.21.15.37:0/487177539 >> 172.21.15.37:0/487177539 conn(0x7f0180072680 msgr2=0x7f0180072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:30.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.825+0000 7f017f200640 1 -- 172.21.15.37:0/487177539 shutdown_connections 2024-05-30T06:45:30.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.825+0000 7f017f200640 1 -- 172.21.15.37:0/487177539 wait complete. 2024-05-30T06:45:30.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017f200640 1 Processor -- start 2024-05-30T06:45:30.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017f200640 1 -- start start 2024-05-30T06:45:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017f200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f018006c970 0x7f018014a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:30.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017f200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f018015c5c0 0x7f01801f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:30.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018015c9a0 0x7f018014f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:30.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f01800b44f0 con 0x7f018015c9a0 2024-05-30T06:45:30.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017f200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f01800b4210 con 0x7f018006c970 2024-05-30T06:45:30.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017f200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f018006ce00 con 0x7f018015c5c0 2024-05-30T06:45:30.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018015c9a0 0x7f018014f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:30.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018015c9a0 0x7f018014f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42028/0 (socket says 172.21.15.37:42028) 2024-05-30T06:45:30.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017e800640 1 -- 172.21.15.37:0/1645455976 learned_addr learned my addr 172.21.15.37:0/1645455976 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:30.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017d400640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f018015c5c0 0x7f01801f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:30.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017de00640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f018006c970 0x7f018014a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:30.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017e800640 1 -- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f018015c5c0 msgr2=0x7f01801f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:30.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017e800640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f018015c5c0 0x7f01801f4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017e800640 1 -- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f018006c970 msgr2=0x7f018014a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:30.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017e800640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f018006c970 0x7f018014a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:30.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017e800640 1 -- 172.21.15.37:0/1645455976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018014fa10 con 0x7f018015c9a0 2024-05-30T06:45:30.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.829+0000 7f017e800640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018015c9a0 0x7f018014f4d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f017800d3f0 tx=0x7f017800d8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:30.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.833+0000 7f0176000640 1 -- 172.21.15.37:0/1645455976 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017801a070 con 0x7f018015c9a0 2024-05-30T06:45:30.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.833+0000 7f0176000640 1 -- 172.21.15.37:0/1645455976 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017800a580 con 0x7f018015c9a0 2024-05-30T06:45:30.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.833+0000 7f0176000640 1 -- 172.21.15.37:0/1645455976 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017800a970 con 0x7f018015c9a0 2024-05-30T06:45:30.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.833+0000 7f017f200640 1 -- 172.21.15.37:0/1645455976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01801f0e20 con 0x7f018015c9a0 2024-05-30T06:45:30.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.833+0000 7f017f200640 1 -- 172.21.15.37:0/1645455976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01801f13e0 con 0x7f018015c9a0 2024-05-30T06:45:30.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.833+0000 7f017f200640 1 -- 172.21.15.37:0/1645455976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0180075580 con 0x7f018015c9a0 2024-05-30T06:45:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.837+0000 7f0176000640 1 -- 172.21.15.37:0/1645455976 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f017801d070 con 0x7f018015c9a0 2024-05-30T06:45:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.837+0000 7f0176000640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0160068730 0x7f016006abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.837+0000 7f0176000640 1 -- 172.21.15.37:0/1645455976 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5765+0+0 (secure 0 0 0) 0x7f017808a560 con 0x7f018015c9a0 2024-05-30T06:45:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.837+0000 7f017de00640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0160068730 0x7f016006abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.841+0000 7f017de00640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0160068730 0x7f016006abf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0180152a00 tx=0x7f0170008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:30.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:30.853+0000 7f0176000640 1 -- 172.21.15.37:0/1645455976 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f01800d0960 con 0x7f018015c9a0 2024-05-30T06:45:31.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.177+0000 7f017f200640 1 -- 172.21.15.37:0/1645455976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0180073240 con 0x7f018015c9a0 2024-05-30T06:45:31.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.177+0000 7f0176000640 1 -- 172.21.15.37:0/1645455976 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7f017805a0c0 con 0x7f018015c9a0 2024-05-30T06:45:31.180 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:45:31.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.181+0000 7f017f200640 1 -- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0160068730 msgr2=0x7f016006abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.181+0000 7f017f200640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0160068730 0x7f016006abf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0180152a00 tx=0x7f0170008040 comp rx=0 tx=0).stop 2024-05-30T06:45:31.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.181+0000 7f017f200640 1 -- 172.21.15.37:0/1645455976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018015c9a0 msgr2=0x7f018014f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.181+0000 7f017f200640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018015c9a0 0x7f018014f4d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f017800d3f0 tx=0x7f017800d8b0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.181+0000 7f017f200640 1 -- 172.21.15.37:0/1645455976 shutdown_connections 2024-05-30T06:45:31.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.181+0000 7f017f200640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018015c9a0 0x7f018014f4d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.181+0000 7f017f200640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f018015c5c0 0x7f01801f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.181+0000 7f017f200640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0160068730 0x7f016006abf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.181+0000 7f017f200640 1 --2- 172.21.15.37:0/1645455976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f018006c970 0x7f018014a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.181+0000 7f017f200640 1 -- 172.21.15.37:0/1645455976 >> 172.21.15.37:0/1645455976 conn(0x7f0180072680 msgr2=0x7f01800af730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.181+0000 7f017f200640 1 -- 172.21.15.37:0/1645455976 shutdown_connections 2024-05-30T06:45:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.181+0000 7f017f200640 1 -- 172.21.15.37:0/1645455976 wait complete. 2024-05-30T06:45:31.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:45:31.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f1919000640 1 Processor -- start 2024-05-30T06:45:31.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f1919000640 1 -- start start 2024-05-30T06:45:31.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f1919000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19140cd440 0x7f191406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:31.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f1919000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f191406f5a0 0x7f19140b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f1919000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f191415f310 con 0x7f1914155da0 2024-05-30T06:45:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f1919000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f191406fa10 con 0x7f19140cd440 2024-05-30T06:45:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f1919000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f191415f5f0 con 0x7f191406f5a0 2024-05-30T06:45:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f190be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19140cd440 0x7f191406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f190be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19140cd440 0x7f191406f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42030/0 (socket says 172.21.15.37:42030) 2024-05-30T06:45:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f190be00640 1 -- 172.21.15.37:0/944992682 learned_addr learned my addr 172.21.15.37:0/944992682 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f1912800640 1 --2- 172.21.15.37:0/944992682 >> v2:172.21.15.105:3300/0 conn(0x7f191406f5a0 0x7f19140b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f190be00640 1 -- 172.21.15.37:0/944992682 >> v2:172.21.15.105:3300/0 conn(0x7f191406f5a0 msgr2=0x7f19140b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:31.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f190be00640 1 --2- 172.21.15.37:0/944992682 >> v2:172.21.15.105:3300/0 conn(0x7f191406f5a0 0x7f19140b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f190be00640 1 -- 172.21.15.37:0/944992682 >> v1:172.21.15.105:6789/0 conn(0x7f1914155da0 legacy=0x7f19140cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.349+0000 7f190be00640 1 -- 172.21.15.37:0/944992682 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191415f8d0 con 0x7f19140cd440 2024-05-30T06:45:31.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.353+0000 7f190be00640 1 --2- 172.21.15.37:0/944992682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19140cd440 0x7f191406f060 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f19140b6600 tx=0x7f18fc01ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2f6ac45f5a377f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:31.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.353+0000 7f1911400640 1 -- 172.21.15.37:0/944992682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0b4070 con 0x7f19140cd440 2024-05-30T06:45:31.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.353+0000 7f1911400640 1 -- 172.21.15.37:0/944992682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18fc0a79a0 con 0x7f19140cd440 2024-05-30T06:45:31.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.353+0000 7f1911400640 1 -- 172.21.15.37:0/944992682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0a7d70 con 0x7f19140cd440 2024-05-30T06:45:31.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.353+0000 7f1919000640 1 -- 172.21.15.37:0/944992682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19140cd440 msgr2=0x7f191406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.353+0000 7f1919000640 1 --2- 172.21.15.37:0/944992682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19140cd440 0x7f191406f060 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f19140b6600 tx=0x7f18fc01ead0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.353+0000 7f1919000640 1 -- 172.21.15.37:0/944992682 shutdown_connections 2024-05-30T06:45:31.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.353+0000 7f1919000640 1 --2- 172.21.15.37:0/944992682 >> v2:172.21.15.105:3300/0 conn(0x7f191406f5a0 0x7f19140b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.353+0000 7f1919000640 1 --2- 172.21.15.37:0/944992682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19140cd440 0x7f191406f060 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.353+0000 7f1919000640 1 -- 172.21.15.37:0/944992682 >> 172.21.15.37:0/944992682 conn(0x7f191406bf60 msgr2=0x7f19140b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:31.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.353+0000 7f1919000640 1 -- 172.21.15.37:0/944992682 shutdown_connections 2024-05-30T06:45:31.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.353+0000 7f1919000640 1 -- 172.21.15.37:0/944992682 wait complete. 2024-05-30T06:45:31.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f1919000640 1 Processor -- start 2024-05-30T06:45:31.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f1919000640 1 -- start start 2024-05-30T06:45:31.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f1919000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f191406f5a0 0x7f1914143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:31.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f1919000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1914155da0 0x7f1914165510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:31.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f1919000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19141583f0 0x7f191414dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:31.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f1919000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f191406df50 con 0x7f1914155da0 2024-05-30T06:45:31.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f1919000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f19140b46f0 con 0x7f191406f5a0 2024-05-30T06:45:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f1919000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f191406e0d0 con 0x7f19141583f0 2024-05-30T06:45:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f190be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1914155da0 0x7f1914165510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f1911e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f191406f5a0 0x7f1914143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f190be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1914155da0 0x7f1914165510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42042/0 (socket says 172.21.15.37:42042) 2024-05-30T06:45:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f190be00640 1 -- 172.21.15.37:0/2574732519 learned_addr learned my addr 172.21.15.37:0/2574732519 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f1911e00640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f191406f5a0 0x7f1914143bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:50716/0 (socket says 172.21.15.37:50716) 2024-05-30T06:45:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f1912800640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19141583f0 0x7f191414dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f190be00640 1 -- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19141583f0 msgr2=0x7f191414dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f190be00640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19141583f0 0x7f191414dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f190be00640 1 -- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f191406f5a0 msgr2=0x7f1914143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f190be00640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f191406f5a0 0x7f1914143bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f190be00640 1 -- 172.21.15.37:0/2574732519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1914158940 con 0x7f1914155da0 2024-05-30T06:45:31.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f190be00640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1914155da0 0x7f1914165510 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f18fc01b6e0 tx=0x7f18fc01b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:31.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f190a000640 1 -- 172.21.15.37:0/2574732519 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0b4070 con 0x7f1914155da0 2024-05-30T06:45:31.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f190a000640 1 -- 172.21.15.37:0/2574732519 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18fc0b6070 con 0x7f1914155da0 2024-05-30T06:45:31.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f1919000640 1 -- 172.21.15.37:0/2574732519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1914158c20 con 0x7f1914155da0 2024-05-30T06:45:31.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f190a000640 1 -- 172.21.15.37:0/2574732519 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0afbf0 con 0x7f1914155da0 2024-05-30T06:45:31.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.357+0000 7f1919000640 1 -- 172.21.15.37:0/2574732519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19140b00b0 con 0x7f1914155da0 2024-05-30T06:45:31.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.361+0000 7f1919000640 1 -- 172.21.15.37:0/2574732519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1914068bc0 con 0x7f1914155da0 2024-05-30T06:45:31.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.361+0000 7f190a000640 1 -- 172.21.15.37:0/2574732519 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f18fc0bb470 con 0x7f1914155da0 2024-05-30T06:45:31.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.361+0000 7f190a000640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18f0068710 0x7f18f006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:31.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.361+0000 7f190a000640 1 -- 172.21.15.37:0/2574732519 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5765+0+0 (secure 0 0 0) 0x7f18fc121180 con 0x7f1914155da0 2024-05-30T06:45:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.361+0000 7f1911e00640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18f0068710 0x7f18f006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.365+0000 7f1911e00640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18f0068710 0x7f18f006abd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1904001770 tx=0x7f1904009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:31.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.365+0000 7f190a000640 1 -- 172.21.15.37:0/2574732519 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f18fc0187e0 con 0x7f1914155da0 2024-05-30T06:45:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f1919000640 1 -- 172.21.15.37:0/2574732519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f19140b6790 con 0x7f1914155da0 2024-05-30T06:45:31.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f190a000640 1 -- 172.21.15.37:0/2574732519 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) ==== 104+0+11 (secure 0 0 0) 0x7f18fc0a7970 con 0x7f1914155da0 2024-05-30T06:45:31.534 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:45:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f1919000640 1 -- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18f0068710 msgr2=0x7f18f006abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f1919000640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18f0068710 0x7f18f006abd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1904001770 tx=0x7f1904009040 comp rx=0 tx=0).stop 2024-05-30T06:45:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f1919000640 1 -- 172.21.15.37:0/2574732519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1914155da0 msgr2=0x7f1914165510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f1919000640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1914155da0 0x7f1914165510 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f18fc01b6e0 tx=0x7f18fc01b870 comp rx=0 tx=0).stop 2024-05-30T06:45:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f1919000640 1 -- 172.21.15.37:0/2574732519 shutdown_connections 2024-05-30T06:45:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f1919000640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19141583f0 0x7f191414dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f1919000640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1914155da0 0x7f1914165510 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f1919000640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18f0068710 0x7f18f006abd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f1919000640 1 --2- 172.21.15.37:0/2574732519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f191406f5a0 0x7f1914143bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f1919000640 1 -- 172.21.15.37:0/2574732519 >> 172.21.15.37:0/2574732519 conn(0x7f191406bf60 msgr2=0x7f191415a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:31.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f1919000640 1 -- 172.21.15.37:0/2574732519 shutdown_connections 2024-05-30T06:45:31.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.533+0000 7f1919000640 1 -- 172.21.15.37:0/2574732519 wait complete. 2024-05-30T06:45:31.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:45:31.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.697+0000 7f212a400640 1 Processor -- start 2024-05-30T06:45:31.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.697+0000 7f212a400640 1 -- start start 2024-05-30T06:45:31.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.697+0000 7f212a400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f212406f770 0x7f2124166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.697+0000 7f212a400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212415f310 con 0x7f2124155da0 2024-05-30T06:45:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.697+0000 7f212a400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212415f5f0 con 0x7f21240cd440 2024-05-30T06:45:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.697+0000 7f212a400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f21240b4760 con 0x7f212406f770 2024-05-30T06:45:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.697+0000 7f2123400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2124155da0 0x7f21240cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53874/0 (socket says 172.21.15.37:53874) 2024-05-30T06:45:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.697+0000 7f2123400640 1 -- 172.21.15.37:0/3779482269 learned_addr learned my addr 172.21.15.37:0/3779482269 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.697+0000 7f2123e00640 1 --2- 172.21.15.37:0/3779482269 >> v2:172.21.15.37:3300/0 conn(0x7f212406f770 0x7f2124166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f2123e00640 1 -- 172.21.15.37:0/3779482269 >> v1:172.21.15.105:6789/0 conn(0x7f21240cd440 legacy=0x7f212406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:31.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f2123e00640 1 -- 172.21.15.37:0/3779482269 >> v1:172.21.15.37:6789/0 conn(0x7f2124155da0 legacy=0x7f21240cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f2123e00640 1 -- 172.21.15.37:0/3779482269 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212415f8d0 con 0x7f212406f770 2024-05-30T06:45:31.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f2122a00640 1 -- 172.21.15.37:0/3779482269 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8827603 0 0) 0x7f212415f310 con 0x7f2124155da0 2024-05-30T06:45:31.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f2123e00640 1 --2- 172.21.15.37:0/3779482269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f212406f770 0x7f2124166570 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f211c009d90 tx=0x7f211c01c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7c02c3ef457761 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:31.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f2122a00640 1 -- 172.21.15.37:0/3779482269 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c0a66e0 con 0x7f212406f770 2024-05-30T06:45:31.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f2122a00640 1 -- 172.21.15.37:0/3779482269 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f211c0a6880 con 0x7f212406f770 2024-05-30T06:45:31.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f2122a00640 1 -- 172.21.15.37:0/3779482269 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c0a6c50 con 0x7f212406f770 2024-05-30T06:45:31.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f212a400640 1 -- 172.21.15.37:0/3779482269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f212406f770 msgr2=0x7f2124166570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f212a400640 1 --2- 172.21.15.37:0/3779482269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f212406f770 0x7f2124166570 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f211c009d90 tx=0x7f211c01c810 comp rx=0 tx=0).stop 2024-05-30T06:45:31.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f212a400640 1 -- 172.21.15.37:0/3779482269 shutdown_connections 2024-05-30T06:45:31.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f212a400640 1 --2- 172.21.15.37:0/3779482269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f212406f770 0x7f2124166570 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f212a400640 1 -- 172.21.15.37:0/3779482269 >> 172.21.15.37:0/3779482269 conn(0x7f212406bf60 msgr2=0x7f21240b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:31.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f212a400640 1 -- 172.21.15.37:0/3779482269 shutdown_connections 2024-05-30T06:45:31.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.701+0000 7f212a400640 1 -- 172.21.15.37:0/3779482269 wait complete. 2024-05-30T06:45:31.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f212a400640 1 Processor -- start 2024-05-30T06:45:31.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f212a400640 1 -- start start 2024-05-30T06:45:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f212a400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f212406f770 0x7f21241f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f212a400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2124155da0 0x7f212414ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f212a400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2124154370 0x7f212406df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f212a400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2124169a70 con 0x7f212406f770 2024-05-30T06:45:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f212a400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21241698f0 con 0x7f2124155da0 2024-05-30T06:45:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f212a400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2124169bf0 con 0x7f2124154370 2024-05-30T06:45:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f2123400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f212406f770 0x7f21241f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f2123400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f212406f770 0x7f21241f80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42068/0 (socket says 172.21.15.37:42068) 2024-05-30T06:45:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f2123400640 1 -- 172.21.15.37:0/1236389992 learned_addr learned my addr 172.21.15.37:0/1236389992 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f211aa00640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2124155da0 0x7f212414ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:31.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f2123e00640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2124154370 0x7f212406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:31.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f2123400640 1 -- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2124154370 msgr2=0x7f212406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f2123400640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2124154370 0x7f212406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f2123400640 1 -- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2124155da0 msgr2=0x7f212414ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f2123400640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2124155da0 0x7f212414ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f2123400640 1 -- 172.21.15.37:0/1236389992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21241f85f0 con 0x7f212406f770 2024-05-30T06:45:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f2123400640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f212406f770 0x7f21241f80b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f211400c4b0 tx=0x7f211400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f211be00640 1 -- 172.21.15.37:0/1236389992 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114018070 con 0x7f212406f770 2024-05-30T06:45:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f211be00640 1 -- 172.21.15.37:0/1236389992 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2114007500 con 0x7f212406f770 2024-05-30T06:45:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f211be00640 1 -- 172.21.15.37:0/1236389992 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2114004a30 con 0x7f212406f770 2024-05-30T06:45:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.705+0000 7f212a400640 1 -- 172.21.15.37:0/1236389992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21241532d0 con 0x7f212406f770 2024-05-30T06:45:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.709+0000 7f212a400640 1 -- 172.21.15.37:0/1236389992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2124153890 con 0x7f212406f770 2024-05-30T06:45:31.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.709+0000 7f212a400640 1 -- 172.21.15.37:0/1236389992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2124068bc0 con 0x7f212406f770 2024-05-30T06:45:31.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.709+0000 7f211be00640 1 -- 172.21.15.37:0/1236389992 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f2114004bd0 con 0x7f212406f770 2024-05-30T06:45:31.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.709+0000 7f211be00640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f21000686e0 0x7f210006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:31.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.709+0000 7f211be00640 1 -- 172.21.15.37:0/1236389992 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5765+0+0 (secure 0 0 0) 0x7f2114086150 con 0x7f212406f770 2024-05-30T06:45:31.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.709+0000 7f211aa00640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f21000686e0 0x7f210006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:31.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.709+0000 7f211aa00640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f21000686e0 0x7f210006aba0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2124165fb0 tx=0x7f210c007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:31.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.713+0000 7f211be00640 1 -- 172.21.15.37:0/1236389992 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f21241f85f0 con 0x7f212406f770 2024-05-30T06:45:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.877+0000 7f212a400640 1 -- 172.21.15.37:0/1236389992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2124075550 con 0x7f212406f770 2024-05-30T06:45:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.881+0000 7f211be00640 1 -- 172.21.15.37:0/1236389992 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) ==== 100+0+11 (secure 0 0 0) 0x7f2114055b70 con 0x7f212406f770 2024-05-30T06:45:31.880 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:45:31.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.881+0000 7f212a400640 1 -- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f21000686e0 msgr2=0x7f210006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.881+0000 7f212a400640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f21000686e0 0x7f210006aba0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2124165fb0 tx=0x7f210c007e40 comp rx=0 tx=0).stop 2024-05-30T06:45:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.881+0000 7f212a400640 1 -- 172.21.15.37:0/1236389992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f212406f770 msgr2=0x7f21241f80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.881+0000 7f212a400640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f212406f770 0x7f21241f80b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f211400c4b0 tx=0x7f211400c970 comp rx=0 tx=0).stop 2024-05-30T06:45:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.881+0000 7f212a400640 1 -- 172.21.15.37:0/1236389992 shutdown_connections 2024-05-30T06:45:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.881+0000 7f212a400640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2124154370 0x7f212406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.881+0000 7f212a400640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f21000686e0 0x7f210006aba0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.881+0000 7f212a400640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2124155da0 0x7f212414ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.881+0000 7f212a400640 1 --2- 172.21.15.37:0/1236389992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f212406f770 0x7f21241f80b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.881+0000 7f212a400640 1 -- 172.21.15.37:0/1236389992 >> 172.21.15.37:0/1236389992 conn(0x7f212406bf60 msgr2=0x7f21240726f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.881+0000 7f212a400640 1 -- 172.21.15.37:0/1236389992 shutdown_connections 2024-05-30T06:45:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:31.881+0000 7f212a400640 1 -- 172.21.15.37:0/1236389992 wait complete. 2024-05-30T06:45:31.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:45:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.041+0000 7fa909e00640 1 Processor -- start 2024-05-30T06:45:32.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.041+0000 7fa909e00640 1 -- start start 2024-05-30T06:45:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.041+0000 7fa909e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa90406f8a0 0x7fa90415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.041+0000 7fa909e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9040adf40 con 0x7fa9040cd340 2024-05-30T06:45:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.041+0000 7fa909e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9040ae220 con 0x7fa9040af1e0 2024-05-30T06:45:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.041+0000 7fa909e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa9040ae500 con 0x7fa90406f8a0 2024-05-30T06:45:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.041+0000 7fa903400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa9040cd340 0x7fa9041662c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53886/0 (socket says 172.21.15.37:53886) 2024-05-30T06:45:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.041+0000 7fa903400640 1 -- 172.21.15.37:0/1387894484 learned_addr learned my addr 172.21.15.37:0/1387894484 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.041+0000 7fa8fa000640 1 --2- 172.21.15.37:0/1387894484 >> v2:172.21.15.105:3300/0 conn(0x7fa90406f8a0 0x7fa90415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.045+0000 7fa902000640 1 -- 172.21.15.37:0/1387894484 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4280505939 0 0) 0x7fa9040adf40 con 0x7fa9040cd340 2024-05-30T06:45:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.045+0000 7fa902000640 1 -- 172.21.15.37:0/1387894484 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8e8003530 con 0x7fa9040cd340 2024-05-30T06:45:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.045+0000 7fa902000640 1 -- 172.21.15.37:0/1387894484 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2992684506 0 0) 0x7fa9040ae220 con 0x7fa9040af1e0 2024-05-30T06:45:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.045+0000 7fa902000640 1 -- 172.21.15.37:0/1387894484 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9040adf40 con 0x7fa9040af1e0 2024-05-30T06:45:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.045+0000 7fa8fa000640 1 -- 172.21.15.37:0/1387894484 >> v1:172.21.15.105:6789/0 conn(0x7fa9040af1e0 legacy=0x7fa9040af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.045+0000 7fa8fa000640 1 -- 172.21.15.37:0/1387894484 >> v1:172.21.15.37:6789/0 conn(0x7fa9040cd340 legacy=0x7fa9041662c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.045+0000 7fa8fa000640 1 -- 172.21.15.37:0/1387894484 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9040ae7e0 con 0x7fa90406f8a0 2024-05-30T06:45:32.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.045+0000 7fa8fa000640 1 --2- 172.21.15.37:0/1387894484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa90406f8a0 0x7fa90415cc50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009d90 tx=0x7fa8ec01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e70c656da1801949 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.045+0000 7fa902000640 1 -- 172.21.15.37:0/1387894484 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0b1070 con 0x7fa90406f8a0 2024-05-30T06:45:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.045+0000 7fa902000640 1 -- 172.21.15.37:0/1387894484 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ec0a4ce0 con 0x7fa90406f8a0 2024-05-30T06:45:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.045+0000 7fa902000640 1 -- 172.21.15.37:0/1387894484 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0ac660 con 0x7fa90406f8a0 2024-05-30T06:45:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 -- 172.21.15.37:0/1387894484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa90406f8a0 msgr2=0x7fa90415cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 --2- 172.21.15.37:0/1387894484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa90406f8a0 0x7fa90415cc50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009d90 tx=0x7fa8ec01c530 comp rx=0 tx=0).stop 2024-05-30T06:45:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 -- 172.21.15.37:0/1387894484 shutdown_connections 2024-05-30T06:45:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 --2- 172.21.15.37:0/1387894484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa90406f8a0 0x7fa90415cc50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 -- 172.21.15.37:0/1387894484 >> 172.21.15.37:0/1387894484 conn(0x7fa904073680 msgr2=0x7fa90406b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 -- 172.21.15.37:0/1387894484 shutdown_connections 2024-05-30T06:45:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 -- 172.21.15.37:0/1387894484 wait complete. 2024-05-30T06:45:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 Processor -- start 2024-05-30T06:45:32.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 -- start start 2024-05-30T06:45:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa90406f8a0 0x7fa90414fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9040af1e0 0x7fa904153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9040cd340 0x7fa9041541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa90416b0d0 con 0x7fa90406f8a0 2024-05-30T06:45:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa90416af50 con 0x7fa9040cd340 2024-05-30T06:45:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa909e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa90416b250 con 0x7fa9040af1e0 2024-05-30T06:45:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa902a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa90406f8a0 0x7fa90414fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa902a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa90406f8a0 0x7fa90414fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42074/0 (socket says 172.21.15.37:42074) 2024-05-30T06:45:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa902a00640 1 -- 172.21.15.37:0/3196987738 learned_addr learned my addr 172.21.15.37:0/3196987738 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:32.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa8fa000640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9040af1e0 0x7fa904153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa903400640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9040cd340 0x7fa9041541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa902a00640 1 -- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9040af1e0 msgr2=0x7fa904153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa902a00640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9040af1e0 0x7fa904153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa902a00640 1 -- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9040cd340 msgr2=0x7fa9041541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa902a00640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9040cd340 0x7fa9041541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa902a00640 1 -- 172.21.15.37:0/3196987738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9042002f0 con 0x7fa90406f8a0 2024-05-30T06:45:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.049+0000 7fa902a00640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa90406f8a0 0x7fa90414fec0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400c430 tx=0x7fa8f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.053+0000 7fa8fbe00640 1 -- 172.21.15.37:0/3196987738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4017070 con 0x7fa90406f8a0 2024-05-30T06:45:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.053+0000 7fa8fbe00640 1 -- 172.21.15.37:0/3196987738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f40052f0 con 0x7fa90406f8a0 2024-05-30T06:45:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.053+0000 7fa8fbe00640 1 -- 172.21.15.37:0/3196987738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4003840 con 0x7fa90406f8a0 2024-05-30T06:45:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.053+0000 7fa909e00640 1 -- 172.21.15.37:0/3196987738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9042005d0 con 0x7fa90406f8a0 2024-05-30T06:45:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.053+0000 7fa909e00640 1 -- 172.21.15.37:0/3196987738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa904200b90 con 0x7fa90406f8a0 2024-05-30T06:45:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.053+0000 7fa909e00640 1 -- 172.21.15.37:0/3196987738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa904068b20 con 0x7fa90406f8a0 2024-05-30T06:45:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.053+0000 7fa8fbe00640 1 -- 172.21.15.37:0/3196987738 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fa8f401a070 con 0x7fa90406f8a0 2024-05-30T06:45:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.053+0000 7fa8fbe00640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8e00686e0 0x7fa8e006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.053+0000 7fa8fbe00640 1 -- 172.21.15.37:0/3196987738 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5765+0+0 (secure 0 0 0) 0x7fa8f4086250 con 0x7fa90406f8a0 2024-05-30T06:45:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.053+0000 7fa8fa000640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8e00686e0 0x7fa8e006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.057+0000 7fa8fa000640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8e00686e0 0x7fa8e006aba0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0ae000 tx=0x7fa8ec0a6070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.057+0000 7fa8fbe00640 1 -- 172.21.15.37:0/3196987738 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa8f4055dc0 con 0x7fa90406f8a0 2024-05-30T06:45:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa909e00640 1 -- 172.21.15.37:0/3196987738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9040b08f0 con 0x7fa90406f8a0 2024-05-30T06:45:32.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa8fbe00640 1 -- 172.21.15.37:0/3196987738 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5178 (secure 0 0 0) 0x7fa8f405a0c0 con 0x7fa90406f8a0 2024-05-30T06:45:32.262 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:32.262 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1355950100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1355950100},{"type":"v1","addr":"172.21.15.37:6835","nonce":1355950100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3139010455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3139010455},{"type":"v1","addr":"172.21.15.105:6836","nonce":3139010455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/189373657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":189373657},{"type":"v1","addr":"172.21.15.105:6837","nonce":189373657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:43:05.679965+0000","modified":"2024-05-30T06:43:08.691367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6833/12178000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":12178000},{"type":"v1","addr":"172.21.15.37:6833","nonce":12178000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5040,"qdb_cluster":[5040]},"id":2}]} 2024-05-30T06:45:32.262 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2024-05-30T06:45:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa909e00640 1 -- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8e00686e0 msgr2=0x7fa8e006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa909e00640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8e00686e0 0x7fa8e006aba0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0ae000 tx=0x7fa8ec0a6070 comp rx=0 tx=0).stop 2024-05-30T06:45:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa909e00640 1 -- 172.21.15.37:0/3196987738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa90406f8a0 msgr2=0x7fa90414fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa909e00640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa90406f8a0 0x7fa90414fec0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400c430 tx=0x7fa8f400c8f0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa909e00640 1 -- 172.21.15.37:0/3196987738 shutdown_connections 2024-05-30T06:45:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa909e00640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8e00686e0 0x7fa8e006aba0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa909e00640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa9040cd340 0x7fa9041541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa909e00640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9040af1e0 0x7fa904153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa909e00640 1 --2- 172.21.15.37:0/3196987738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa90406f8a0 0x7fa90414fec0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa909e00640 1 -- 172.21.15.37:0/3196987738 >> 172.21.15.37:0/3196987738 conn(0x7fa904073680 msgr2=0x7fa9040b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa909e00640 1 -- 172.21.15.37:0/3196987738 shutdown_connections 2024-05-30T06:45:32.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.261+0000 7fa909e00640 1 -- 172.21.15.37:0/3196987738 wait complete. 2024-05-30T06:45:32.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:45:32.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.421+0000 7fc743000640 1 Processor -- start 2024-05-30T06:45:32.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.421+0000 7fc743000640 1 -- start start 2024-05-30T06:45:32.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc743000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc73c06e000 0x7fc73c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc743000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc73c15cd80 0x7fc73c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc743000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc73c0cd120 con 0x7fc73c0cec40 2024-05-30T06:45:32.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc743000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc73c0a9530 con 0x7fc73c06e000 2024-05-30T06:45:32.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc743000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc73c0cd400 con 0x7fc73c15cd80 2024-05-30T06:45:32.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc73be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc73c06e000 0x7fc73c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc73be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc73c06e000 0x7fc73c0ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42086/0 (socket says 172.21.15.37:42086) 2024-05-30T06:45:32.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc73be00640 1 -- 172.21.15.37:0/2193224831 learned_addr learned my addr 172.21.15.37:0/2193224831 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:32.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc733400640 1 --2- 172.21.15.37:0/2193224831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc73c15cd80 0x7fc73c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc73be00640 1 -- 172.21.15.37:0/2193224831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc73c15cd80 msgr2=0x7fc73c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:32.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc73be00640 1 --2- 172.21.15.37:0/2193224831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc73c15cd80 0x7fc73c0ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc73be00640 1 -- 172.21.15.37:0/2193224831 >> v1:172.21.15.37:6789/0 conn(0x7fc73c0cec40 legacy=0x7fc73c06e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc73be00640 1 -- 172.21.15.37:0/2193224831 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73c0cd6e0 con 0x7fc73c06e000 2024-05-30T06:45:32.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.425+0000 7fc73be00640 1 --2- 172.21.15.37:0/2193224831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc73c06e000 0x7fc73c0ce1c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009870 tx=0x7fc72c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d076b19aff350e20 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:32.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc73b400640 1 -- 172.21.15.37:0/2193224831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0b5070 con 0x7fc73c06e000 2024-05-30T06:45:32.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc73b400640 1 -- 172.21.15.37:0/2193224831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc72c0a8a50 con 0x7fc73c06e000 2024-05-30T06:45:32.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc73b400640 1 -- 172.21.15.37:0/2193224831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0a8e20 con 0x7fc73c06e000 2024-05-30T06:45:32.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 -- 172.21.15.37:0/2193224831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc73c06e000 msgr2=0x7fc73c0ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 --2- 172.21.15.37:0/2193224831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc73c06e000 0x7fc73c0ce1c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009870 tx=0x7fc72c01ed50 comp rx=0 tx=0).stop 2024-05-30T06:45:32.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 -- 172.21.15.37:0/2193224831 shutdown_connections 2024-05-30T06:45:32.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 --2- 172.21.15.37:0/2193224831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc73c15cd80 0x7fc73c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 --2- 172.21.15.37:0/2193224831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc73c06e000 0x7fc73c0ce1c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 -- 172.21.15.37:0/2193224831 >> 172.21.15.37:0/2193224831 conn(0x7fc73c0b23a0 msgr2=0x7fc73c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:32.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 -- 172.21.15.37:0/2193224831 shutdown_connections 2024-05-30T06:45:32.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 -- 172.21.15.37:0/2193224831 wait complete. 2024-05-30T06:45:32.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 Processor -- start 2024-05-30T06:45:32.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 -- start start 2024-05-30T06:45:32.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc73c06e000 0x7fc73c13bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc73c0cec40 0x7fc73c1517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc73c15cd80 0x7fc73c151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c0cf0a0 con 0x7fc73c0cec40 2024-05-30T06:45:32.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c0cdca0 con 0x7fc73c15cd80 2024-05-30T06:45:32.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc743000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc73c1663c0 con 0x7fc73c06e000 2024-05-30T06:45:32.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc733400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc73c0cec40 0x7fc73c1517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc733400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc73c0cec40 0x7fc73c1517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42090/0 (socket says 172.21.15.37:42090) 2024-05-30T06:45:32.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc733400640 1 -- 172.21.15.37:0/1160221785 learned_addr learned my addr 172.21.15.37:0/1160221785 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:32.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc73be00640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc73c06e000 0x7fc73c13bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc741000640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc73c15cd80 0x7fc73c151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc733400640 1 -- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc73c06e000 msgr2=0x7fc73c13bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.429+0000 7fc733400640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc73c06e000 0x7fc73c13bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc733400640 1 -- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc73c15cd80 msgr2=0x7fc73c151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc733400640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc73c15cd80 0x7fc73c151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc733400640 1 -- 172.21.15.37:0/1160221785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73c13c450 con 0x7fc73c0cec40 2024-05-30T06:45:32.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc733400640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc73c0cec40 0x7fc73c1517f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc72400d800 tx=0x7fc72400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:32.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc738c00640 1 -- 172.21.15.37:0/1160221785 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72400b6c0 con 0x7fc73c0cec40 2024-05-30T06:45:32.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc738c00640 1 -- 172.21.15.37:0/1160221785 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc724019070 con 0x7fc73c0cec40 2024-05-30T06:45:32.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc738c00640 1 -- 172.21.15.37:0/1160221785 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72400ba60 con 0x7fc73c0cec40 2024-05-30T06:45:32.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc743000640 1 -- 172.21.15.37:0/1160221785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73c15e6c0 con 0x7fc73c0cec40 2024-05-30T06:45:32.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc743000640 1 -- 172.21.15.37:0/1160221785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc73c15ec80 con 0x7fc73c0cec40 2024-05-30T06:45:32.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc743000640 1 -- 172.21.15.37:0/1160221785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc73c068b20 con 0x7fc73c0cec40 2024-05-30T06:45:32.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc738c00640 1 -- 172.21.15.37:0/1160221785 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fc72400bc00 con 0x7fc73c0cec40 2024-05-30T06:45:32.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc738c00640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc7180686e0 0x7fc71806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc738c00640 1 -- 172.21.15.37:0/1160221785 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5765+0+0 (secure 0 0 0) 0x7fc724087490 con 0x7fc73c0cec40 2024-05-30T06:45:32.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.433+0000 7fc73be00640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc7180686e0 0x7fc71806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.437+0000 7fc73be00640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc7180686e0 0x7fc71806aba0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0b2000 tx=0x7fc72c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.437+0000 7fc738c00640 1 -- 172.21.15.37:0/1160221785 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc724057530 con 0x7fc73c0cec40 2024-05-30T06:45:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.605+0000 7fc743000640 1 -- 172.21.15.37:0/1160221785 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc73c0ccc60 con 0x7fc73c0cec40 2024-05-30T06:45:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.605+0000 7fc738c00640 1 -- 172.21.15.37:0/1160221785 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16765 (secure 0 0 0) 0x7fc724056e30 con 0x7fc73c0cec40 2024-05-30T06:45:32.608 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:32.608 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:45:28.779169+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:43:03.490124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T06:43:04.639175+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:45:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.609+0000 7fc743000640 1 -- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc7180686e0 msgr2=0x7fc71806aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.609+0000 7fc743000640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc7180686e0 0x7fc71806aba0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0b2000 tx=0x7fc72c008040 comp rx=0 tx=0).stop 2024-05-30T06:45:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.609+0000 7fc743000640 1 -- 172.21.15.37:0/1160221785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc73c0cec40 msgr2=0x7fc73c1517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.609+0000 7fc743000640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc73c0cec40 0x7fc73c1517f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc72400d800 tx=0x7fc72400dcc0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.609+0000 7fc743000640 1 -- 172.21.15.37:0/1160221785 shutdown_connections 2024-05-30T06:45:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.609+0000 7fc743000640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc7180686e0 0x7fc71806aba0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.609+0000 7fc743000640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc73c15cd80 0x7fc73c151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.609+0000 7fc743000640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc73c0cec40 0x7fc73c1517f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.609+0000 7fc743000640 1 --2- 172.21.15.37:0/1160221785 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc73c06e000 0x7fc73c13bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.609+0000 7fc743000640 1 -- 172.21.15.37:0/1160221785 >> 172.21.15.37:0/1160221785 conn(0x7fc73c0b23a0 msgr2=0x7fc73c15bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.609+0000 7fc743000640 1 -- 172.21.15.37:0/1160221785 shutdown_connections 2024-05-30T06:45:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.609+0000 7fc743000640 1 -- 172.21.15.37:0/1160221785 wait complete. 2024-05-30T06:45:32.630 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T06:45:32.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:45:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.769+0000 7ff244400640 1 Processor -- start 2024-05-30T06:45:32.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.769+0000 7ff244400640 1 -- start start 2024-05-30T06:45:32.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.769+0000 7ff244400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff23c15cd80 0x7ff23c06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.769+0000 7ff244400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff23c0ce8d0 0x7ff23c0ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.769+0000 7ff244400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff23c0cd120 con 0x7ff23c06e000 2024-05-30T06:45:32.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.769+0000 7ff244400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff23c0a9530 con 0x7ff23c0ce8d0 2024-05-30T06:45:32.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.769+0000 7ff244400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff23c0cd400 con 0x7ff23c15cd80 2024-05-30T06:45:32.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.769+0000 7ff242400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff23c0ce8d0 0x7ff23c0ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.769+0000 7ff241a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff23c06e000 0x7ff23c0ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53902/0 (socket says 172.21.15.37:53902) 2024-05-30T06:45:32.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.773+0000 7ff241a00640 1 -- 172.21.15.37:0/1301436466 learned_addr learned my addr 172.21.15.37:0/1301436466 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:32.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.773+0000 7ff241000640 1 --2- 172.21.15.37:0/1301436466 >> v2:172.21.15.105:3300/0 conn(0x7ff23c15cd80 0x7ff23c06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.773+0000 7ff242400640 1 -- 172.21.15.37:0/1301436466 >> v2:172.21.15.105:3300/0 conn(0x7ff23c15cd80 msgr2=0x7ff23c06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:32.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.773+0000 7ff242400640 1 --2- 172.21.15.37:0/1301436466 >> v2:172.21.15.105:3300/0 conn(0x7ff23c15cd80 0x7ff23c06f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.773+0000 7ff242400640 1 -- 172.21.15.37:0/1301436466 >> v1:172.21.15.37:6789/0 conn(0x7ff23c06e000 legacy=0x7ff23c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.773+0000 7ff242400640 1 -- 172.21.15.37:0/1301436466 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23c0cd6e0 con 0x7ff23c0ce8d0 2024-05-30T06:45:32.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.773+0000 7ff242400640 1 --2- 172.21.15.37:0/1301436466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff23c0ce8d0 0x7ff23c0ced20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0cfb50 tx=0x7ff23401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdb2cf3fd5fa2b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.773+0000 7ff23be00640 1 -- 172.21.15.37:0/1301436466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2340b4070 con 0x7ff23c0ce8d0 2024-05-30T06:45:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.773+0000 7ff23be00640 1 -- 172.21.15.37:0/1301436466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2340af600 con 0x7ff23c0ce8d0 2024-05-30T06:45:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.773+0000 7ff23be00640 1 -- 172.21.15.37:0/1301436466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2340af9d0 con 0x7ff23c0ce8d0 2024-05-30T06:45:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 -- 172.21.15.37:0/1301436466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff23c0ce8d0 msgr2=0x7ff23c0ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 --2- 172.21.15.37:0/1301436466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff23c0ce8d0 0x7ff23c0ced20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0cfb50 tx=0x7ff23401f110 comp rx=0 tx=0).stop 2024-05-30T06:45:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 -- 172.21.15.37:0/1301436466 shutdown_connections 2024-05-30T06:45:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 --2- 172.21.15.37:0/1301436466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff23c0ce8d0 0x7ff23c0ced20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 --2- 172.21.15.37:0/1301436466 >> v2:172.21.15.105:3300/0 conn(0x7ff23c15cd80 0x7ff23c06f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 -- 172.21.15.37:0/1301436466 >> 172.21.15.37:0/1301436466 conn(0x7ff23c0b23a0 msgr2=0x7ff23c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 -- 172.21.15.37:0/1301436466 shutdown_connections 2024-05-30T06:45:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 -- 172.21.15.37:0/1301436466 wait complete. 2024-05-30T06:45:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 Processor -- start 2024-05-30T06:45:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 -- start start 2024-05-30T06:45:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff23c06e000 0x7ff23c15d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff23c0ce8d0 0x7ff23c15f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff23c15cd80 0x7ff23c0b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c06f930 con 0x7ff23c15cd80 2024-05-30T06:45:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c0cdca0 con 0x7ff23c06e000 2024-05-30T06:45:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff244400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff23c06fab0 con 0x7ff23c0ce8d0 2024-05-30T06:45:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff242400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff23c15cd80 0x7ff23c0b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff242400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff23c15cd80 0x7ff23c0b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42106/0 (socket says 172.21.15.37:42106) 2024-05-30T06:45:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff242400640 1 -- 172.21.15.37:0/709966947 learned_addr learned my addr 172.21.15.37:0/709966947 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff241a00640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff23c06e000 0x7ff23c15d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff241000640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff23c0ce8d0 0x7ff23c15f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff242400640 1 -- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff23c0ce8d0 msgr2=0x7ff23c15f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff242400640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff23c0ce8d0 0x7ff23c15f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff242400640 1 -- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff23c06e000 msgr2=0x7ff23c15d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff242400640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff23c06e000 0x7ff23c15d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff242400640 1 -- 172.21.15.37:0/709966947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23c160130 con 0x7ff23c15cd80 2024-05-30T06:45:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff241000640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff23c0ce8d0 0x7ff23c15f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.777+0000 7ff242400640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff23c15cd80 0x7ff23c0b37a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff2340b2040 tx=0x7ff23401beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.781+0000 7ff239600640 1 -- 172.21.15.37:0/709966947 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2340b4040 con 0x7ff23c15cd80 2024-05-30T06:45:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.781+0000 7ff239600640 1 -- 172.21.15.37:0/709966947 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2340c1070 con 0x7ff23c15cd80 2024-05-30T06:45:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.781+0000 7ff239600640 1 -- 172.21.15.37:0/709966947 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234009450 con 0x7ff23c15cd80 2024-05-30T06:45:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.781+0000 7ff244400640 1 -- 172.21.15.37:0/709966947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff23c0c9b30 con 0x7ff23c15cd80 2024-05-30T06:45:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.781+0000 7ff244400640 1 -- 172.21.15.37:0/709966947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff23c0ca0f0 con 0x7ff23c15cd80 2024-05-30T06:45:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.781+0000 7ff244400640 1 -- 172.21.15.37:0/709966947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff23c068b20 con 0x7ff23c15cd80 2024-05-30T06:45:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.781+0000 7ff239600640 1 -- 172.21.15.37:0/709966947 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7ff2340ba6b0 con 0x7ff23c15cd80 2024-05-30T06:45:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.781+0000 7ff239600640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff21c068710 0x7ff21c06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.781+0000 7ff239600640 1 -- 172.21.15.37:0/709966947 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5765+0+0 (secure 0 0 0) 0x7ff234125ad0 con 0x7ff23c15cd80 2024-05-30T06:45:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.781+0000 7ff241a00640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff21c068710 0x7ff21c06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.785+0000 7ff241a00640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff21c068710 0x7ff21c06abd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0cb550 tx=0x7ff230007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:32.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.785+0000 7ff239600640 1 -- 172.21.15.37:0/709966947 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff234018c70 con 0x7ff23c15cd80 2024-05-30T06:45:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff244400640 1 -- 172.21.15.37:0/709966947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff23c15fe20 con 0x7ff23c15cd80 2024-05-30T06:45:32.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff239600640 1 -- 172.21.15.37:0/709966947 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5178 (secure 0 0 0) 0x7ff2340f5c10 con 0x7ff23c15cd80 2024-05-30T06:45:32.990 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:32.990 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1355950100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1355950100},{"type":"v1","addr":"172.21.15.37:6835","nonce":1355950100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3139010455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3139010455},{"type":"v1","addr":"172.21.15.105:6836","nonce":3139010455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/189373657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":189373657},{"type":"v1","addr":"172.21.15.105:6837","nonce":189373657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:43:05.679965+0000","modified":"2024-05-30T06:43:08.691367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6833/12178000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":12178000},{"type":"v1","addr":"172.21.15.37:6833","nonce":12178000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5040,"qdb_cluster":[5040]},"id":2}]} 2024-05-30T06:45:32.990 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2024-05-30T06:45:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff244400640 1 -- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff21c068710 msgr2=0x7ff21c06abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff244400640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff21c068710 0x7ff21c06abd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0cb550 tx=0x7ff230007e90 comp rx=0 tx=0).stop 2024-05-30T06:45:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff244400640 1 -- 172.21.15.37:0/709966947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff23c15cd80 msgr2=0x7ff23c0b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff244400640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff23c15cd80 0x7ff23c0b37a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ff2340b2040 tx=0x7ff23401beb0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff244400640 1 -- 172.21.15.37:0/709966947 shutdown_connections 2024-05-30T06:45:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff244400640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff23c15cd80 0x7ff23c0b37a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff244400640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff23c0ce8d0 0x7ff23c15f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff244400640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff21c068710 0x7ff21c06abd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff244400640 1 --2- 172.21.15.37:0/709966947 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff23c06e000 0x7ff23c15d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff244400640 1 -- 172.21.15.37:0/709966947 >> 172.21.15.37:0/709966947 conn(0x7ff23c0b23a0 msgr2=0x7ff23c141530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff244400640 1 -- 172.21.15.37:0/709966947 shutdown_connections 2024-05-30T06:45:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:32.989+0000 7ff244400640 1 -- 172.21.15.37:0/709966947 wait complete. 2024-05-30T06:45:33.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:45:33.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe11bc00640 1 Processor -- start 2024-05-30T06:45:33.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe11bc00640 1 -- start start 2024-05-30T06:45:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe11bc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1140b2e20 0x7fe114160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe11bc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe11409ba70 0x7fe114160e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe11bc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1140d0430 con 0x7fe1141609c0 2024-05-30T06:45:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe11bc00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe1140b3200 con 0x7fe1140b2e20 2024-05-30T06:45:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe11bc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe1140d01e0 con 0x7fe11409ba70 2024-05-30T06:45:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe119200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1140b2e20 0x7fe114160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe119200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1140b2e20 0x7fe114160480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42120/0 (socket says 172.21.15.37:42120) 2024-05-30T06:45:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe119200640 1 -- 172.21.15.37:0/3198511123 learned_addr learned my addr 172.21.15.37:0/3198511123 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe119c00640 1 --2- 172.21.15.37:0/3198511123 >> v2:172.21.15.105:3300/0 conn(0x7fe11409ba70 0x7fe114160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe119200640 1 -- 172.21.15.37:0/3198511123 >> v2:172.21.15.105:3300/0 conn(0x7fe11409ba70 msgr2=0x7fe114160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe119200640 1 --2- 172.21.15.37:0/3198511123 >> v2:172.21.15.105:3300/0 conn(0x7fe11409ba70 0x7fe114160e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe119200640 1 -- 172.21.15.37:0/3198511123 >> v1:172.21.15.105:6789/0 conn(0x7fe1141609c0 legacy=0x7fe1140cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe119200640 1 -- 172.21.15.37:0/3198511123 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1140d0710 con 0x7fe1140b2e20 2024-05-30T06:45:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.153+0000 7fe119c00640 1 --2- 172.21.15.37:0/3198511123 >> v2:172.21.15.105:3300/0 conn(0x7fe11409ba70 0x7fe114160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:45:33.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.157+0000 7fe119200640 1 --2- 172.21.15.37:0/3198511123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1140b2e20 0x7fe114160480 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe1140b3cb0 tx=0x7fe10401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776f1f31e3175d35 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.157+0000 7fe113e00640 1 -- 172.21.15.37:0/3198511123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1040b1070 con 0x7fe1140b2e20 2024-05-30T06:45:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.157+0000 7fe113e00640 1 -- 172.21.15.37:0/3198511123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1040ac630 con 0x7fe1140b2e20 2024-05-30T06:45:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.157+0000 7fe113e00640 1 -- 172.21.15.37:0/3198511123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1040a8050 con 0x7fe1140b2e20 2024-05-30T06:45:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.157+0000 7fe11bc00640 1 -- 172.21.15.37:0/3198511123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1140b2e20 msgr2=0x7fe114160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.157+0000 7fe11bc00640 1 --2- 172.21.15.37:0/3198511123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1140b2e20 0x7fe114160480 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe1140b3cb0 tx=0x7fe10401c4e0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.157+0000 7fe11bc00640 1 -- 172.21.15.37:0/3198511123 shutdown_connections 2024-05-30T06:45:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.157+0000 7fe11bc00640 1 --2- 172.21.15.37:0/3198511123 >> v2:172.21.15.105:3300/0 conn(0x7fe11409ba70 0x7fe114160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.157+0000 7fe11bc00640 1 --2- 172.21.15.37:0/3198511123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1140b2e20 0x7fe114160480 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.157+0000 7fe11bc00640 1 -- 172.21.15.37:0/3198511123 >> 172.21.15.37:0/3198511123 conn(0x7fe1140b4100 msgr2=0x7fe1140b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.157+0000 7fe11bc00640 1 -- 172.21.15.37:0/3198511123 shutdown_connections 2024-05-30T06:45:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.157+0000 7fe11bc00640 1 -- 172.21.15.37:0/3198511123 wait complete. 2024-05-30T06:45:33.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe11bc00640 1 Processor -- start 2024-05-30T06:45:33.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe11bc00640 1 -- start start 2024-05-30T06:45:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe11bc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe11409ba70 0x7fe11415f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe11bc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1140b2e20 0x7fe1140c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe11bc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1141609c0 0x7fe1140c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe11bc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe1140ce320 con 0x7fe1141609c0 2024-05-30T06:45:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe11bc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe1140ce1a0 con 0x7fe1140b2e20 2024-05-30T06:45:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe11bc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe1140c85e0 con 0x7fe11409ba70 2024-05-30T06:45:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe119c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1141609c0 0x7fe1140c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe119c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1141609c0 0x7fe1140c73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42132/0 (socket says 172.21.15.37:42132) 2024-05-30T06:45:33.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe119c00640 1 -- 172.21.15.37:0/177724318 learned_addr learned my addr 172.21.15.37:0/177724318 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:33.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe119200640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe11409ba70 0x7fe11415f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe10be00640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1140b2e20 0x7fe1140c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe119c00640 1 -- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe11409ba70 msgr2=0x7fe11415f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe119c00640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe11409ba70 0x7fe11415f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe119c00640 1 -- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1140b2e20 msgr2=0x7fe1140c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe119c00640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1140b2e20 0x7fe1140c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe119c00640 1 -- 172.21.15.37:0/177724318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1140c7ff0 con 0x7fe1141609c0 2024-05-30T06:45:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe119c00640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1141609c0 0x7fe1140c73e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00cd50 tx=0x7fe10c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe111600640 1 -- 172.21.15.37:0/177724318 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00f680 con 0x7fe1141609c0 2024-05-30T06:45:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe111600640 1 -- 172.21.15.37:0/177724318 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10c00f840 con 0x7fe1141609c0 2024-05-30T06:45:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe111600640 1 -- 172.21.15.37:0/177724318 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00fc30 con 0x7fe1141609c0 2024-05-30T06:45:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe11bc00640 1 -- 172.21.15.37:0/177724318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1140c82d0 con 0x7fe1141609c0 2024-05-30T06:45:33.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe11bc00640 1 -- 172.21.15.37:0/177724318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1140c7920 con 0x7fe1141609c0 2024-05-30T06:45:33.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.161+0000 7fe11bc00640 1 -- 172.21.15.37:0/177724318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe114068b20 con 0x7fe1141609c0 2024-05-30T06:45:33.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.165+0000 7fe111600640 1 -- 172.21.15.37:0/177724318 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fe10c00e3e0 con 0x7fe1141609c0 2024-05-30T06:45:33.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.165+0000 7fe111600640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe0f00686e0 0x7fe0f006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.165+0000 7fe111600640 1 -- 172.21.15.37:0/177724318 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5765+0+0 (secure 0 0 0) 0x7fe10c087c30 con 0x7fe1141609c0 2024-05-30T06:45:33.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.165+0000 7fe119200640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe0f00686e0 0x7fe0f006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.165+0000 7fe119200640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe0f00686e0 0x7fe0f006aba0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe1040ae000 tx=0x7fe104009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:33.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.169+0000 7fe111600640 1 -- 172.21.15.37:0/177724318 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe10c014030 con 0x7fe1141609c0 2024-05-30T06:45:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.369+0000 7fe11bc00640 1 -- 172.21.15.37:0/177724318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1140ce860 con 0x7fe1141609c0 2024-05-30T06:45:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.369+0000 7fe111600640 1 -- 172.21.15.37:0/177724318 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5178 (secure 0 0 0) 0x7fe10c0576d0 con 0x7fe1141609c0 2024-05-30T06:45:33.372 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:33.372 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1355950100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1355950100},{"type":"v1","addr":"172.21.15.37:6835","nonce":1355950100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3139010455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3139010455},{"type":"v1","addr":"172.21.15.105:6836","nonce":3139010455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/189373657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":189373657},{"type":"v1","addr":"172.21.15.105:6837","nonce":189373657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:43:05.679965+0000","modified":"2024-05-30T06:43:08.691367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5040},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5040":{"gid":5040,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6833/12178000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":12178000},{"type":"v1","addr":"172.21.15.37:6833","nonce":12178000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5040,"qdb_cluster":[5040]},"id":2}]} 2024-05-30T06:45:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2024-05-30T06:45:33.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.373+0000 7fe11bc00640 1 -- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe0f00686e0 msgr2=0x7fe0f006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.373+0000 7fe11bc00640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe0f00686e0 0x7fe0f006aba0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe1040ae000 tx=0x7fe104009040 comp rx=0 tx=0).stop 2024-05-30T06:45:33.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.373+0000 7fe11bc00640 1 -- 172.21.15.37:0/177724318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1141609c0 msgr2=0x7fe1140c73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.373+0000 7fe11bc00640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1141609c0 0x7fe1140c73e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00cd50 tx=0x7fe10c00a650 comp rx=0 tx=0).stop 2024-05-30T06:45:33.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.373+0000 7fe11bc00640 1 -- 172.21.15.37:0/177724318 shutdown_connections 2024-05-30T06:45:33.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.373+0000 7fe11bc00640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1141609c0 0x7fe1140c73e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.373+0000 7fe11bc00640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe0f00686e0 0x7fe0f006aba0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.373+0000 7fe11bc00640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1140b2e20 0x7fe1140c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.373+0000 7fe11bc00640 1 --2- 172.21.15.37:0/177724318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe11409ba70 0x7fe11415f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.373+0000 7fe11bc00640 1 -- 172.21.15.37:0/177724318 >> 172.21.15.37:0/177724318 conn(0x7fe1140b4100 msgr2=0x7fe114070370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:33.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.373+0000 7fe11bc00640 1 -- 172.21.15.37:0/177724318 shutdown_connections 2024-05-30T06:45:33.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.373+0000 7fe11bc00640 1 -- 172.21.15.37:0/177724318 wait complete. 2024-05-30T06:45:33.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:45:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.537+0000 7fa80ba00640 1 Processor -- start 2024-05-30T06:45:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.537+0000 7fa80ba00640 1 -- start start 2024-05-30T06:45:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.537+0000 7fa80ba00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa804158fd0 0x7fa8040aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.537+0000 7fa80ba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa80415f8d0 0x7fa8040b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa80ba00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa80415fd50 con 0x7fa8040b5910 2024-05-30T06:45:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa80ba00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa8040afee0 con 0x7fa804158fd0 2024-05-30T06:45:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa80ba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8040b5d40 con 0x7fa80415f8d0 2024-05-30T06:45:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa7fbe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa80415f8d0 0x7fa8040b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa809a00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa8040b5910 0x7fa804162440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:55916/0 (socket says 172.21.15.37:55916) 2024-05-30T06:45:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa7fbe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa80415f8d0 0x7fa8040b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:42730/0 (socket says 172.21.15.37:42730) 2024-05-30T06:45:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa809a00640 1 -- 172.21.15.37:0/459823969 learned_addr learned my addr 172.21.15.37:0/459823969 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa809000640 1 --2- 172.21.15.37:0/459823969 >> v2:172.21.15.105:3300/0 conn(0x7fa804158fd0 0x7fa8040aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa803e00640 1 -- 172.21.15.37:0/459823969 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129293504 0 0) 0x7fa80415fd50 con 0x7fa8040b5910 2024-05-30T06:45:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa803e00640 1 -- 172.21.15.37:0/459823969 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7e8003530 con 0x7fa8040b5910 2024-05-30T06:45:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa7fbe00640 1 -- 172.21.15.37:0/459823969 >> v2:172.21.15.105:3300/0 conn(0x7fa804158fd0 msgr2=0x7fa8040aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa7fbe00640 1 --2- 172.21.15.37:0/459823969 >> v2:172.21.15.105:3300/0 conn(0x7fa804158fd0 0x7fa8040aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa7fbe00640 1 -- 172.21.15.37:0/459823969 >> v1:172.21.15.105:6789/0 conn(0x7fa8040b5910 legacy=0x7fa804162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa7fbe00640 1 -- 172.21.15.37:0/459823969 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8040af2d0 con 0x7fa80415f8d0 2024-05-30T06:45:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.541+0000 7fa809000640 1 --2- 172.21.15.37:0/459823969 >> v2:172.21.15.105:3300/0 conn(0x7fa804158fd0 0x7fa8040aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa7fbe00640 1 --2- 172.21.15.37:0/459823969 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa80415f8d0 0x7fa8040b53d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0097c0 tx=0x7fa7ec01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47a283a45e58497b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa803e00640 1 -- 172.21.15.37:0/459823969 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0b0070 con 0x7fa80415f8d0 2024-05-30T06:45:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa803e00640 1 -- 172.21.15.37:0/459823969 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec0ab600 con 0x7fa80415f8d0 2024-05-30T06:45:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa803e00640 1 -- 172.21.15.37:0/459823969 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0ab9d0 con 0x7fa80415f8d0 2024-05-30T06:45:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 -- 172.21.15.37:0/459823969 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa80415f8d0 msgr2=0x7fa8040b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 --2- 172.21.15.37:0/459823969 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa80415f8d0 0x7fa8040b53d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0097c0 tx=0x7fa7ec01c410 comp rx=0 tx=0).stop 2024-05-30T06:45:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 -- 172.21.15.37:0/459823969 shutdown_connections 2024-05-30T06:45:33.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 --2- 172.21.15.37:0/459823969 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa80415f8d0 0x7fa8040b53d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 --2- 172.21.15.37:0/459823969 >> v2:172.21.15.105:3300/0 conn(0x7fa804158fd0 0x7fa8040aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 -- 172.21.15.37:0/459823969 >> 172.21.15.37:0/459823969 conn(0x7fa8040b27b0 msgr2=0x7fa8040b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:33.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 -- 172.21.15.37:0/459823969 shutdown_connections 2024-05-30T06:45:33.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 -- 172.21.15.37:0/459823969 wait complete. 2024-05-30T06:45:33.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 Processor -- start 2024-05-30T06:45:33.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 -- start start 2024-05-30T06:45:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8040b5910 0x7fa8041513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa804158fd0 0x7fa804148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa80415f8d0 0x7fa8040b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa80416b960 con 0x7fa80415f8d0 2024-05-30T06:45:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa80416b7e0 con 0x7fa8040b5910 2024-05-30T06:45:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa80ba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa80416bae0 con 0x7fa804158fd0 2024-05-30T06:45:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa809a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa80415f8d0 0x7fa8040b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa809a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa80415f8d0 0x7fa8040b1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42136/0 (socket says 172.21.15.37:42136) 2024-05-30T06:45:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.545+0000 7fa809a00640 1 -- 172.21.15.37:0/3063116534 learned_addr learned my addr 172.21.15.37:0/3063116534 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa7fbe00640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa804158fd0 0x7fa804148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa809000640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8040b5910 0x7fa8041513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa809a00640 1 -- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa804158fd0 msgr2=0x7fa804148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa809a00640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa804158fd0 0x7fa804148810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa809a00640 1 -- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8040b5910 msgr2=0x7fa8041513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa809a00640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8040b5910 0x7fa8041513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa809a00640 1 -- 172.21.15.37:0/3063116534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8041490d0 con 0x7fa80415f8d0 2024-05-30T06:45:33.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa7fbe00640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa804158fd0 0x7fa804148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:33.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa809a00640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa80415f8d0 0x7fa8040b1f00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00cb70 tx=0x7fa7fc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa801600640 1 -- 172.21.15.37:0/3063116534 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc017070 con 0x7fa80415f8d0 2024-05-30T06:45:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa801600640 1 -- 172.21.15.37:0/3063116534 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7fc00ad40 con 0x7fa80415f8d0 2024-05-30T06:45:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa80ba00640 1 -- 172.21.15.37:0/3063116534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8041493b0 con 0x7fa80415f8d0 2024-05-30T06:45:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa801600640 1 -- 172.21.15.37:0/3063116534 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc012620 con 0x7fa80415f8d0 2024-05-30T06:45:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa80ba00640 1 -- 172.21.15.37:0/3063116534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa804149e90 con 0x7fa80415f8d0 2024-05-30T06:45:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa80ba00640 1 -- 172.21.15.37:0/3063116534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa80414a180 con 0x7fa80415f8d0 2024-05-30T06:45:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa801600640 1 -- 172.21.15.37:0/3063116534 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fa7fc01a070 con 0x7fa80415f8d0 2024-05-30T06:45:33.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa801600640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7e00686e0 0x7fa7e006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.549+0000 7fa801600640 1 -- 172.21.15.37:0/3063116534 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5765+0+0 (secure 0 0 0) 0x7fa7fc086d30 con 0x7fa80415f8d0 2024-05-30T06:45:33.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.553+0000 7fa809000640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7e00686e0 0x7fa7e006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.553+0000 7fa809000640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7e00686e0 0x7fa7e006aba0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009580 tx=0x7fa7f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.553+0000 7fa801600640 1 -- 172.21.15.37:0/3063116534 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa7fc056ef0 con 0x7fa80415f8d0 2024-05-30T06:45:33.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.725+0000 7fa80ba00640 1 -- 172.21.15.37:0/3063116534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa804068b20 con 0x7fa80415f8d0 2024-05-30T06:45:33.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.725+0000 7fa801600640 1 -- 172.21.15.37:0/3063116534 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16765 (secure 0 0 0) 0x7fa7fc0567f0 con 0x7fa80415f8d0 2024-05-30T06:45:33.726 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:33.727 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:45:28.779169+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:43:03.490124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-30T06:43:04.639175+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:45:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.729+0000 7fa80ba00640 1 -- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7e00686e0 msgr2=0x7fa7e006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.729+0000 7fa80ba00640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7e00686e0 0x7fa7e006aba0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009580 tx=0x7fa7f4008040 comp rx=0 tx=0).stop 2024-05-30T06:45:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.729+0000 7fa80ba00640 1 -- 172.21.15.37:0/3063116534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa80415f8d0 msgr2=0x7fa8040b1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.729+0000 7fa80ba00640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa80415f8d0 0x7fa8040b1f00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00cb70 tx=0x7fa7fc00a430 comp rx=0 tx=0).stop 2024-05-30T06:45:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.729+0000 7fa80ba00640 1 -- 172.21.15.37:0/3063116534 shutdown_connections 2024-05-30T06:45:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.729+0000 7fa80ba00640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa80415f8d0 0x7fa8040b1f00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.729+0000 7fa80ba00640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa804158fd0 0x7fa804148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.729+0000 7fa80ba00640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7e00686e0 0x7fa7e006aba0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.729+0000 7fa80ba00640 1 --2- 172.21.15.37:0/3063116534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8040b5910 0x7fa8041513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.729+0000 7fa80ba00640 1 -- 172.21.15.37:0/3063116534 >> 172.21.15.37:0/3063116534 conn(0x7fa8040b27b0 msgr2=0x7fa80406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.729+0000 7fa80ba00640 1 -- 172.21.15.37:0/3063116534 shutdown_connections 2024-05-30T06:45:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.729+0000 7fa80ba00640 1 -- 172.21.15.37:0/3063116534 wait complete. 2024-05-30T06:45:33.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T06:45:33.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.889+0000 7fddb2600640 1 Processor -- start 2024-05-30T06:45:33.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.889+0000 7fddb2600640 1 -- start start 2024-05-30T06:45:33.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.889+0000 7fddb2600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fddac155da0 0x7fddac0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.889+0000 7fddb2600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddac15f310 con 0x7fddac0cd440 2024-05-30T06:45:33.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.889+0000 7fddb2600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddac15f5f0 con 0x7fddac06f770 2024-05-30T06:45:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.889+0000 7fddb2600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fddac15f8d0 con 0x7fddac155da0 2024-05-30T06:45:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.889+0000 7fdda2a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fddac0cd440 0x7fddac06f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53918/0 (socket says 172.21.15.37:53918) 2024-05-30T06:45:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.889+0000 7fdda2a00640 1 -- 172.21.15.37:0/2917986693 learned_addr learned my addr 172.21.15.37:0/2917986693 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:33.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.889+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4126381669 0 0) 0x7fddac15f310 con 0x7fddac0cd440 2024-05-30T06:45:33.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.889+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd90003530 con 0x7fddac0cd440 2024-05-30T06:45:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.889+0000 7fddab400640 1 --2- 172.21.15.37:0/2917986693 >> v2:172.21.15.105:3300/0 conn(0x7fddac155da0 0x7fddac0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3083673692 0 0) 0x7fdd90003530 con 0x7fddac0cd440 2024-05-30T06:45:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 >> v2:172.21.15.105:3300/0 conn(0x7fddac155da0 msgr2=0x7fddac0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddaaa00640 1 --2- 172.21.15.37:0/2917986693 >> v2:172.21.15.105:3300/0 conn(0x7fddac155da0 0x7fddac0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 >> v1:172.21.15.105:6789/0 conn(0x7fddac06f770 legacy=0x7fddac0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddac15fbb0 con 0x7fddac0cd440 2024-05-30T06:45:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fdd94001a00 con 0x7fddac0cd440 2024-05-30T06:45:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 >> v1:172.21.15.37:6789/0 conn(0x7fddac0cd440 legacy=0x7fddac06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddaaa00640 1 --2- 172.21.15.37:0/2917986693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd900039c0 0x7fdd90003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddaaa00640 1 --2- 172.21.15.37:0/2917986693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd90004810 0x7fdd90004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddaaa00640 1 --2- 172.21.15.37:0/2917986693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd900053d0 0x7fdd9000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fddac15f8d0 con 0x7fdd900053d0 2024-05-30T06:45:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9000c260 con 0x7fdd90004810 2024-05-30T06:45:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9000c460 con 0x7fdd900039c0 2024-05-30T06:45:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddabe00640 1 --2- 172.21.15.37:0/2917986693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd900053d0 0x7fdd9000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddab400640 1 --2- 172.21.15.37:0/2917986693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd900039c0 0x7fdd90003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fdda2a00640 1 --2- 172.21.15.37:0/2917986693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd90004810 0x7fdd90004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddabe00640 1 -- 172.21.15.37:0/2917986693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd900039c0 msgr2=0x7fdd90003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddabe00640 1 --2- 172.21.15.37:0/2917986693 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd900039c0 0x7fdd90003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddabe00640 1 -- 172.21.15.37:0/2917986693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd90004810 msgr2=0x7fdd90004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddabe00640 1 --2- 172.21.15.37:0/2917986693 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd90004810 0x7fdd90004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddabe00640 1 -- 172.21.15.37:0/2917986693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd90003530 con 0x7fdd900053d0 2024-05-30T06:45:33.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.893+0000 7fddabe00640 1 -- 172.21.15.37:0/2917986693 reap_dead start 2024-05-30T06:45:33.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddabe00640 1 --2- 172.21.15.37:0/2917986693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd900053d0 0x7fdd9000b9d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fddac0cd0e0 tx=0x7fdda401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b2d9f4033d6ed server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:33.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda40013a0 con 0x7fdd900053d0 2024-05-30T06:45:33.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda40052d0 con 0x7fdd900053d0 2024-05-30T06:45:33.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddaaa00640 1 -- 172.21.15.37:0/2917986693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda4003840 con 0x7fdd900053d0 2024-05-30T06:45:33.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 -- 172.21.15.37:0/2917986693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd900053d0 msgr2=0x7fdd9000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 --2- 172.21.15.37:0/2917986693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd900053d0 0x7fdd9000b9d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fddac0cd0e0 tx=0x7fdda401c3c0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 -- 172.21.15.37:0/2917986693 shutdown_connections 2024-05-30T06:45:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 --2- 172.21.15.37:0/2917986693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd900053d0 0x7fdd9000b9d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 -- 172.21.15.37:0/2917986693 >> 172.21.15.37:0/2917986693 conn(0x7fddac06bf60 msgr2=0x7fddac0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 -- 172.21.15.37:0/2917986693 shutdown_connections 2024-05-30T06:45:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 -- 172.21.15.37:0/2917986693 wait complete. 2024-05-30T06:45:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 Processor -- start 2024-05-30T06:45:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 -- start start 2024-05-30T06:45:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd900053d0 0x7fddac13ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddac15d880 0x7fddac15dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac15a000 0x7fddac15a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fddac0cdce0 con 0x7fdd900053d0 2024-05-30T06:45:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fddac0cdb60 con 0x7fddac15a000 2024-05-30T06:45:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddb2600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fddac0b3750 con 0x7fddac15d880 2024-05-30T06:45:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd900053d0 0x7fddac13ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd900053d0 0x7fddac13ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42150/0 (socket says 172.21.15.37:42150) 2024-05-30T06:45:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.897+0000 7fddab400640 1 -- 172.21.15.37:0/2128166343 learned_addr learned my addr 172.21.15.37:0/2128166343 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fddabe00640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac15a000 0x7fddac15a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fdda2a00640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddac15d880 0x7fddac15dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fddab400640 1 -- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddac15d880 msgr2=0x7fddac15dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fddab400640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddac15d880 0x7fddac15dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fddab400640 1 -- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac15a000 msgr2=0x7fddac15a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fddab400640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac15a000 0x7fddac15a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fddab400640 1 -- 172.21.15.37:0/2128166343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddac15b9b0 con 0x7fdd900053d0 2024-05-30T06:45:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fdda2a00640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddac15d880 0x7fddac15dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fddab400640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd900053d0 0x7fddac13ce20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00b7f0 tx=0x7fdd9c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fdda3e00640 1 -- 172.21.15.37:0/2128166343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c018070 con 0x7fdd900053d0 2024-05-30T06:45:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fdda3e00640 1 -- 172.21.15.37:0/2128166343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9c0107d0 con 0x7fdd900053d0 2024-05-30T06:45:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fdda3e00640 1 -- 172.21.15.37:0/2128166343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c010ba0 con 0x7fdd900053d0 2024-05-30T06:45:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fddb2600640 1 -- 172.21.15.37:0/2128166343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddac15ae30 con 0x7fdd900053d0 2024-05-30T06:45:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fddb2600640 1 -- 172.21.15.37:0/2128166343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddac15b3f0 con 0x7fdd900053d0 2024-05-30T06:45:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fddb2600640 1 -- 172.21.15.37:0/2128166343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddac068bc0 con 0x7fdd900053d0 2024-05-30T06:45:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fdda3e00640 1 -- 172.21.15.37:0/2128166343 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fdd9c01b070 con 0x7fdd900053d0 2024-05-30T06:45:33.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fdda3e00640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdd880686e0 0x7fdd8806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:33.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.901+0000 7fdda3e00640 1 -- 172.21.15.37:0/2128166343 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5765+0+0 (secure 0 0 0) 0x7fdd9c087520 con 0x7fdd900053d0 2024-05-30T06:45:33.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.905+0000 7fdda2a00640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdd880686e0 0x7fdd8806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:33.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.905+0000 7fdda2a00640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdd880686e0 0x7fdd8806aba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fddac0757f0 tx=0x7fdd94006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:33.909+0000 7fdda3e00640 1 -- 172.21.15.37:0/2128166343 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdd9c056f00 con 0x7fdd900053d0 2024-05-30T06:45:34.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:45:34.099 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:45:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.109+0000 7fddb2600640 1 -- 172.21.15.37:0/2128166343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fddac0b6790 con 0x7fdd900053d0 2024-05-30T06:45:34.111 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-30T06:45:34.109+0000 7fd1bb400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T06:45:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.113+0000 7fdda3e00640 1 -- 172.21.15.37:0/2128166343 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7fdd9c05b200 con 0x7fdd900053d0 2024-05-30T06:45:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T06:45:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.113+0000 7fddb2600640 1 -- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdd880686e0 msgr2=0x7fdd8806aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.113+0000 7fddb2600640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdd880686e0 0x7fdd8806aba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fddac0757f0 tx=0x7fdd94006040 comp rx=0 tx=0).stop 2024-05-30T06:45:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.117+0000 7fddb2600640 1 -- 172.21.15.37:0/2128166343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd900053d0 msgr2=0x7fddac13ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.117+0000 7fddb2600640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd900053d0 0x7fddac13ce20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00b7f0 tx=0x7fdd9c00bcb0 comp rx=0 tx=0).stop 2024-05-30T06:45:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.117+0000 7fddb2600640 1 -- 172.21.15.37:0/2128166343 shutdown_connections 2024-05-30T06:45:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.117+0000 7fddb2600640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdd880686e0 0x7fdd8806aba0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.117+0000 7fddb2600640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddac15a000 0x7fddac15a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.117+0000 7fddb2600640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddac15d880 0x7fddac15dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.117+0000 7fddb2600640 1 --2- 172.21.15.37:0/2128166343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd900053d0 0x7fddac13ce20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.117+0000 7fddb2600640 1 -- 172.21.15.37:0/2128166343 >> 172.21.15.37:0/2128166343 conn(0x7fddac06bf60 msgr2=0x7fddac154f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.117+0000 7fddb2600640 1 -- 172.21.15.37:0/2128166343 shutdown_connections 2024-05-30T06:45:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.117+0000 7fddb2600640 1 -- 172.21.15.37:0/2128166343 wait complete. 2024-05-30T06:45:34.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T06:45:34.185 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-30T06:45:34.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.325+0000 7f5d31200640 1 Processor -- start 2024-05-30T06:45:34.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.325+0000 7f5d31200640 1 -- start start 2024-05-30T06:45:34.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d31200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5d2c15c890 0x7f5d2c162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:34.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d31200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d2c072e60 0x7f5d2c06c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:34.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d31200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d2c163020 con 0x7f5d2c15f210 2024-05-30T06:45:34.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d31200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5d2c163300 con 0x7f5d2c15c890 2024-05-30T06:45:34.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d31200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2c1635e0 con 0x7f5d2c072e60 2024-05-30T06:45:34.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d29e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5d2c15c890 0x7f5d2c162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:34.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d29e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5d2c15c890 0x7f5d2c162720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42162/0 (socket says 172.21.15.37:42162) 2024-05-30T06:45:34.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d29e00640 1 -- 172.21.15.37:0/3927930121 learned_addr learned my addr 172.21.15.37:0/3927930121 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:34.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d2a800640 1 --2- 172.21.15.37:0/3927930121 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d2c072e60 0x7f5d2c06c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:34.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d29e00640 1 -- 172.21.15.37:0/3927930121 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d2c072e60 msgr2=0x7f5d2c06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:34.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d29e00640 1 --2- 172.21.15.37:0/3927930121 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d2c072e60 0x7f5d2c06c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:34.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d29e00640 1 -- 172.21.15.37:0/3927930121 >> v1:172.21.15.37:6789/0 conn(0x7f5d2c15f210 legacy=0x7f5d2c072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:34.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d29400640 1 -- 172.21.15.37:0/3927930121 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 378490562 0 0) 0x7f5d2c163020 con 0x7f5d2c15f210 2024-05-30T06:45:34.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.329+0000 7f5d29e00640 1 -- 172.21.15.37:0/3927930121 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c06ba00 con 0x7f5d2c15c890 2024-05-30T06:45:34.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d29e00640 1 --2- 172.21.15.37:0/3927930121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d2c15c890 0x7f5d2c162720 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009e50 tx=0x7f5d1c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc22a3401b900051 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:34.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d29400640 1 -- 172.21.15.37:0/3927930121 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0090d0 con 0x7f5d2c15c890 2024-05-30T06:45:34.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d29400640 1 -- 172.21.15.37:0/3927930121 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0a5660 con 0x7f5d2c15c890 2024-05-30T06:45:34.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d29400640 1 -- 172.21.15.37:0/3927930121 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c009270 con 0x7f5d2c15c890 2024-05-30T06:45:34.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d31200640 1 -- 172.21.15.37:0/3927930121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d2c15c890 msgr2=0x7f5d2c162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:34.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d31200640 1 --2- 172.21.15.37:0/3927930121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d2c15c890 0x7f5d2c162720 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009e50 tx=0x7f5d1c01c9a0 comp rx=0 tx=0).stop 2024-05-30T06:45:34.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d31200640 1 -- 172.21.15.37:0/3927930121 shutdown_connections 2024-05-30T06:45:34.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d31200640 1 --2- 172.21.15.37:0/3927930121 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d2c072e60 0x7f5d2c06c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:34.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d31200640 1 --2- 172.21.15.37:0/3927930121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d2c15c890 0x7f5d2c162720 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:34.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d31200640 1 -- 172.21.15.37:0/3927930121 >> 172.21.15.37:0/3927930121 conn(0x7f5d2c0b2ac0 msgr2=0x7f5d2c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:34.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d31200640 1 -- 172.21.15.37:0/3927930121 shutdown_connections 2024-05-30T06:45:34.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d31200640 1 -- 172.21.15.37:0/3927930121 wait complete. 2024-05-30T06:45:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d31200640 1 Processor -- start 2024-05-30T06:45:34.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d31200640 1 -- start start 2024-05-30T06:45:34.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d31200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d2c072e60 0x7f5d2c0b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:34.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.333+0000 7f5d31200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d2c15c890 0x7f5d2c155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d31200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d2c15f210 0x7f5d2c156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d31200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c16be50 con 0x7f5d2c072e60 2024-05-30T06:45:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d31200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2c16bcd0 con 0x7f5d2c15f210 2024-05-30T06:45:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d31200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2c16bfd0 con 0x7f5d2c15c890 2024-05-30T06:45:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d29e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d2c072e60 0x7f5d2c0b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d29e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d2c072e60 0x7f5d2c0b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42164/0 (socket says 172.21.15.37:42164) 2024-05-30T06:45:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d29e00640 1 -- 172.21.15.37:0/700342323 learned_addr learned my addr 172.21.15.37:0/700342323 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d2a800640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d2c15f210 0x7f5d2c156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d21400640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d2c15c890 0x7f5d2c155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d29e00640 1 -- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d2c15c890 msgr2=0x7f5d2c155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d29e00640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d2c15c890 0x7f5d2c155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:34.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d29e00640 1 -- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d2c15f210 msgr2=0x7f5d2c156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:34.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d29e00640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d2c15f210 0x7f5d2c156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:34.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d29e00640 1 -- 172.21.15.37:0/700342323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c0b1b30 con 0x7f5d2c072e60 2024-05-30T06:45:34.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d2a800640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d2c15f210 0x7f5d2c156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:34.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d29e00640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d2c072e60 0x7f5d2c0b12e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c01a5d0 tx=0x7f5d1c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:34.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d22a00640 1 -- 172.21.15.37:0/700342323 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0bc030 con 0x7f5d2c072e60 2024-05-30T06:45:34.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d22a00640 1 -- 172.21.15.37:0/700342323 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0b8680 con 0x7f5d2c072e60 2024-05-30T06:45:34.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d22a00640 1 -- 172.21.15.37:0/700342323 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c009510 con 0x7f5d2c072e60 2024-05-30T06:45:34.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d31200640 1 -- 172.21.15.37:0/700342323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2c0af0e0 con 0x7f5d2c072e60 2024-05-30T06:45:34.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d31200640 1 -- 172.21.15.37:0/700342323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d2c0b1820 con 0x7f5d2c072e60 2024-05-30T06:45:34.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d31200640 1 -- 172.21.15.37:0/700342323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d2c068bc0 con 0x7f5d2c072e60 2024-05-30T06:45:34.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.337+0000 7f5d22a00640 1 -- 172.21.15.37:0/700342323 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f5d1c0bf070 con 0x7f5d2c072e60 2024-05-30T06:45:34.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.341+0000 7f5d22a00640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d080686e0 0x7f5d0806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:34.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.341+0000 7f5d22a00640 1 -- 172.21.15.37:0/700342323 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5823+0+0 (secure 0 0 0) 0x7f5d1c121d70 con 0x7f5d2c072e60 2024-05-30T06:45:34.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.341+0000 7f5d21400640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d080686e0 0x7f5d0806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:34.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.341+0000 7f5d21400640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d080686e0 0x7f5d0806aba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c0b0b30 tx=0x7f5d14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:34.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.345+0000 7f5d22a00640 1 -- 172.21.15.37:0/700342323 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5d1c016620 con 0x7f5d2c072e60 2024-05-30T06:45:34.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:34.545+0000 7f5d31200640 1 -- 172.21.15.37:0/700342323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5d2c15cc70 con 0x7f5d2c072e60 2024-05-30T06:45:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.117+0000 7f5d22a00640 1 -- 172.21.15.37:0/700342323 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f5d1c0f1fa0 con 0x7f5d2c072e60 2024-05-30T06:45:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.121+0000 7f5d31200640 1 -- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d080686e0 msgr2=0x7f5d0806aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.121+0000 7f5d31200640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d080686e0 0x7f5d0806aba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c0b0b30 tx=0x7f5d14009040 comp rx=0 tx=0).stop 2024-05-30T06:45:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.121+0000 7f5d31200640 1 -- 172.21.15.37:0/700342323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d2c072e60 msgr2=0x7f5d2c0b12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.121+0000 7f5d31200640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d2c072e60 0x7f5d2c0b12e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c01a5d0 tx=0x7f5d1c019740 comp rx=0 tx=0).stop 2024-05-30T06:45:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.121+0000 7f5d31200640 1 -- 172.21.15.37:0/700342323 shutdown_connections 2024-05-30T06:45:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.121+0000 7f5d31200640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d080686e0 0x7f5d0806aba0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.121+0000 7f5d31200640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d2c15f210 0x7f5d2c156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.121+0000 7f5d31200640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d2c15c890 0x7f5d2c155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.121+0000 7f5d31200640 1 --2- 172.21.15.37:0/700342323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d2c072e60 0x7f5d2c0b12e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.121+0000 7f5d31200640 1 -- 172.21.15.37:0/700342323 >> 172.21.15.37:0/700342323 conn(0x7f5d2c0b2ac0 msgr2=0x7f5d2c0cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.121+0000 7f5d31200640 1 -- 172.21.15.37:0/700342323 shutdown_connections 2024-05-30T06:45:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.121+0000 7f5d31200640 1 -- 172.21.15.37:0/700342323 wait complete. 2024-05-30T06:45:35.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T06:45:35.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.289+0000 7fdb5ca00640 1 Processor -- start 2024-05-30T06:45:35.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.289+0000 7fdb5ca00640 1 -- start start 2024-05-30T06:45:35.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb5ca00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdb580cd400 0x7fdb5806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:35.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb5ca00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb580ce030 con 0x7fdb581590c0 2024-05-30T06:45:35.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb5ca00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb5815f230 con 0x7fdb5806f5a0 2024-05-30T06:45:35.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb5ca00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdb5815f510 con 0x7fdb580cd400 2024-05-30T06:45:35.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdb581590c0 0x7fdb580cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53952/0 (socket says 172.21.15.37:53952) 2024-05-30T06:45:35.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55e00640 1 -- 172.21.15.37:0/1374083608 learned_addr learned my addr 172.21.15.37:0/1374083608 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:35.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb4fe00640 1 --2- 172.21.15.37:0/1374083608 >> v2:172.21.15.105:3300/0 conn(0x7fdb580cd400 0x7fdb5806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:35.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258200375 0 0) 0x7fdb580ce030 con 0x7fdb581590c0 2024-05-30T06:45:35.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb3c005740 con 0x7fdb581590c0 2024-05-30T06:45:35.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036262511 0 0) 0x7fdb5815f230 con 0x7fdb5806f5a0 2024-05-30T06:45:35.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb580ce030 con 0x7fdb5806f5a0 2024-05-30T06:45:35.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1602669716 0 0) 0x7fdb3c005740 con 0x7fdb581590c0 2024-05-30T06:45:35.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 >> v2:172.21.15.105:3300/0 conn(0x7fdb580cd400 msgr2=0x7fdb5806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:35.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 --2- 172.21.15.37:0/1374083608 >> v2:172.21.15.105:3300/0 conn(0x7fdb580cd400 0x7fdb5806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:35.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 >> v1:172.21.15.105:6789/0 conn(0x7fdb5806f5a0 legacy=0x7fdb580b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:35.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5815f7f0 con 0x7fdb581590c0 2024-05-30T06:45:35.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fdb48001680 con 0x7fdb581590c0 2024-05-30T06:45:35.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 >> v1:172.21.15.37:6789/0 conn(0x7fdb581590c0 legacy=0x7fdb580cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:35.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 --2- 172.21.15.37:0/1374083608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb3c005d60 0x7fdb3c006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:35.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 --2- 172.21.15.37:0/1374083608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb3c006a20 0x7fdb3c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:35.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 --2- 172.21.15.37:0/1374083608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb3c007450 0x7fdb3c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:35.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5815f510 con 0x7fdb3c005d60 2024-05-30T06:45:35.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c00e3b0 con 0x7fdb3c007450 2024-05-30T06:45:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb3c00e5b0 con 0x7fdb3c006a20 2024-05-30T06:45:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55e00640 1 --2- 172.21.15.37:0/1374083608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb3c005d60 0x7fdb3c006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb4fe00640 1 --2- 172.21.15.37:0/1374083608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb3c006a20 0x7fdb3c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb56800640 1 --2- 172.21.15.37:0/1374083608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb3c007450 0x7fdb3c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55e00640 1 -- 172.21.15.37:0/1374083608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb3c006a20 msgr2=0x7fdb3c006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55e00640 1 --2- 172.21.15.37:0/1374083608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb3c006a20 0x7fdb3c006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55e00640 1 -- 172.21.15.37:0/1374083608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb3c007450 msgr2=0x7fdb3c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55e00640 1 --2- 172.21.15.37:0/1374083608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb3c007450 0x7fdb3c00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb55e00640 1 -- 172.21.15.37:0/1374083608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3c005740 con 0x7fdb3c005d60 2024-05-30T06:45:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb56800640 1 --2- 172.21.15.37:0/1374083608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb3c007450 0x7fdb3c00dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb56800640 1 -- 172.21.15.37:0/1374083608 reap_dead start 2024-05-30T06:45:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.293+0000 7fdb4fe00640 1 --2- 172.21.15.37:0/1374083608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb3c006a20 0x7fdb3c006ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.297+0000 7fdb55e00640 1 --2- 172.21.15.37:0/1374083608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb3c005d60 0x7fdb3c006160 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800c210 tx=0x7fdb4801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e97694ab2ae147 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.297+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48007cf0 con 0x7fdb3c005d60 2024-05-30T06:45:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.297+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb480a9020 con 0x7fdb3c005d60 2024-05-30T06:45:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.297+0000 7fdb55400640 1 -- 172.21.15.37:0/1374083608 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48005b00 con 0x7fdb3c005d60 2024-05-30T06:45:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.297+0000 7fdb5ca00640 1 -- 172.21.15.37:0/1374083608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb3c005d60 msgr2=0x7fdb3c006160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.297+0000 7fdb5ca00640 1 --2- 172.21.15.37:0/1374083608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb3c005d60 0x7fdb3c006160 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800c210 tx=0x7fdb4801cc20 comp rx=0 tx=0).stop 2024-05-30T06:45:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.297+0000 7fdb5ca00640 1 -- 172.21.15.37:0/1374083608 shutdown_connections 2024-05-30T06:45:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.297+0000 7fdb5ca00640 1 --2- 172.21.15.37:0/1374083608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb3c005d60 0x7fdb3c006160 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.297+0000 7fdb5ca00640 1 -- 172.21.15.37:0/1374083608 >> 172.21.15.37:0/1374083608 conn(0x7fdb5806bf60 msgr2=0x7fdb580b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.297+0000 7fdb5ca00640 1 -- 172.21.15.37:0/1374083608 shutdown_connections 2024-05-30T06:45:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.297+0000 7fdb5ca00640 1 -- 172.21.15.37:0/1374083608 wait complete. 2024-05-30T06:45:35.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb5ca00640 1 Processor -- start 2024-05-30T06:45:35.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb5ca00640 1 -- start start 2024-05-30T06:45:35.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb5ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb3c005d60 0x7fdb5814a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:35.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb5ca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb5815c310 0x7fdb5815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:35.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb5ca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb5815e7f0 0x7fdb581f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:35.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb5ca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb580cdeb0 con 0x7fdb3c005d60 2024-05-30T06:45:35.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb5ca00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdb580cdd30 con 0x7fdb5815e7f0 2024-05-30T06:45:35.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb5ca00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb580b4a70 con 0x7fdb5815c310 2024-05-30T06:45:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb55e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb3c005d60 0x7fdb5814a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb55e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb3c005d60 0x7fdb5814a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42190/0 (socket says 172.21.15.37:42190) 2024-05-30T06:45:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb55e00640 1 -- 172.21.15.37:0/3939651305 learned_addr learned my addr 172.21.15.37:0/3939651305 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb56800640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb5815e7f0 0x7fdb581f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb4fe00640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb5815c310 0x7fdb5815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb55e00640 1 -- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb5815c310 msgr2=0x7fdb5815e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb55e00640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb5815c310 0x7fdb5815e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb55e00640 1 -- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb5815e7f0 msgr2=0x7fdb581f73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb55e00640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb5815e7f0 0x7fdb581f73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb55e00640 1 -- 172.21.15.37:0/3939651305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb581f7fe0 con 0x7fdb3c005d60 2024-05-30T06:45:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb55e00640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb3c005d60 0x7fdb5814a010 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdb48001900 tx=0x7fdb3c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:35.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb4e000640 1 -- 172.21.15.37:0/3939651305 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb480b4070 con 0x7fdb3c005d60 2024-05-30T06:45:35.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb4e000640 1 -- 172.21.15.37:0/3939651305 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb48001030 con 0x7fdb3c005d60 2024-05-30T06:45:35.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb4e000640 1 -- 172.21.15.37:0/3939651305 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48007cf0 con 0x7fdb3c005d60 2024-05-30T06:45:35.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb5ca00640 1 -- 172.21.15.37:0/3939651305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5815b830 con 0x7fdb3c005d60 2024-05-30T06:45:35.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb5ca00640 1 -- 172.21.15.37:0/3939651305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb5814a550 con 0x7fdb3c005d60 2024-05-30T06:45:35.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.301+0000 7fdb5ca00640 1 -- 172.21.15.37:0/3939651305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5815ec00 con 0x7fdb3c005d60 2024-05-30T06:45:35.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.305+0000 7fdb4e000640 1 -- 172.21.15.37:0/3939651305 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fdb480bf060 con 0x7fdb3c005d60 2024-05-30T06:45:35.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.305+0000 7fdb4e000640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb34068710 0x7fdb3406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.305+0000 7fdb4e000640 1 -- 172.21.15.37:0/3939651305 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5823+0+0 (secure 0 0 0) 0x7fdb4811faa0 con 0x7fdb3c005d60 2024-05-30T06:45:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.305+0000 7fdb4fe00640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb34068710 0x7fdb3406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.305+0000 7fdb4fe00640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb34068710 0x7fdb3406abd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdb5814d4e0 tx=0x7fdb40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:35.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.309+0000 7fdb4e000640 1 -- 172.21.15.37:0/3939651305 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdb5815ec00 con 0x7fdb3c005d60 2024-05-30T06:45:35.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:35.477+0000 7fdb5ca00640 1 -- 172.21.15.37:0/3939651305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdb58068d40 con 0x7fdb3c005d60 2024-05-30T06:45:36.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.429+0000 7fdb4e000640 1 -- 172.21.15.37:0/3939651305 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) ==== 181+0+0 (secure 0 0 0) 0x7fdb48016930 con 0x7fdb3c005d60 2024-05-30T06:45:36.431 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-30T06:45:36.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.433+0000 7fdb5ca00640 1 -- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb34068710 msgr2=0x7fdb3406abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:36.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.433+0000 7fdb5ca00640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb34068710 0x7fdb3406abd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdb5814d4e0 tx=0x7fdb40008040 comp rx=0 tx=0).stop 2024-05-30T06:45:36.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.433+0000 7fdb5ca00640 1 -- 172.21.15.37:0/3939651305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb3c005d60 msgr2=0x7fdb5814a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:36.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.433+0000 7fdb5ca00640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb3c005d60 0x7fdb5814a010 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdb48001900 tx=0x7fdb3c007a50 comp rx=0 tx=0).stop 2024-05-30T06:45:36.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.433+0000 7fdb5ca00640 1 -- 172.21.15.37:0/3939651305 shutdown_connections 2024-05-30T06:45:36.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.433+0000 7fdb5ca00640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb34068710 0x7fdb3406abd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:36.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.433+0000 7fdb5ca00640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb5815e7f0 0x7fdb581f73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:36.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.433+0000 7fdb5ca00640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb5815c310 0x7fdb5815e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:36.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.433+0000 7fdb5ca00640 1 --2- 172.21.15.37:0/3939651305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb3c005d60 0x7fdb5814a010 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:36.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.433+0000 7fdb5ca00640 1 -- 172.21.15.37:0/3939651305 >> 172.21.15.37:0/3939651305 conn(0x7fdb5806bf60 msgr2=0x7fdb58071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:36.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.433+0000 7fdb5ca00640 1 -- 172.21.15.37:0/3939651305 shutdown_connections 2024-05-30T06:45:36.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.433+0000 7fdb5ca00640 1 -- 172.21.15.37:0/3939651305 wait complete. 2024-05-30T06:45:36.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T06:45:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.613+0000 7f76c2800640 1 Processor -- start 2024-05-30T06:45:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.613+0000 7f76c2800640 1 -- start start 2024-05-30T06:45:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76c2800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76bc0ced10 0x7f76bc06ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76c2800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc15db00 con 0x7f76bc0b59d0 2024-05-30T06:45:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76c2800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76bc06e180 con 0x7f76bc15d4e0 2024-05-30T06:45:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76c2800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f76bc06df50 con 0x7f76bc0ced10 2024-05-30T06:45:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76b2a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f76bc0b59d0 0x7f76bc15cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53964/0 (socket says 172.21.15.37:53964) 2024-05-30T06:45:36.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76b2a00640 1 -- 172.21.15.37:0/3047768269 learned_addr learned my addr 172.21.15.37:0/3047768269 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76bb400640 1 --2- 172.21.15.37:0/3047768269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76bc0ced10 0x7f76bc06ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355455082 0 0) 0x7f76bc15db00 con 0x7f76bc0b59d0 2024-05-30T06:45:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a0003530 con 0x7f76bc0b59d0 2024-05-30T06:45:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 49727927 0 0) 0x7f76bc06e180 con 0x7f76bc15d4e0 2024-05-30T06:45:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76bc15db00 con 0x7f76bc15d4e0 2024-05-30T06:45:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2388171806 0 0) 0x7f76a0003530 con 0x7f76bc0b59d0 2024-05-30T06:45:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76bc0ced10 msgr2=0x7f76bc06ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 --2- 172.21.15.37:0/3047768269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76bc0ced10 0x7f76bc06ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 >> v1:172.21.15.105:6789/0 conn(0x7f76bc15d4e0 legacy=0x7f76bc15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc06e460 con 0x7f76bc0b59d0 2024-05-30T06:45:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f76a4001680 con 0x7f76bc0b59d0 2024-05-30T06:45:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76bb400640 1 --2- 172.21.15.37:0/3047768269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76bc0ced10 0x7f76bc06ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 >> v1:172.21.15.37:6789/0 conn(0x7f76bc0b59d0 legacy=0x7f76bc15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 --2- 172.21.15.37:0/3047768269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a0003b80 0x7f76a0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 --2- 172.21.15.37:0/3047768269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76bc0ced10 0x7f76a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 --2- 172.21.15.37:0/3047768269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76a0004d50 0x7f76a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f76a000ba80 con 0x7f76a0003b80 2024-05-30T06:45:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f76a000bc00 con 0x7f76a0004d50 2024-05-30T06:45:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f76a000be00 con 0x7f76bc0ced10 2024-05-30T06:45:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76bb400640 1 --2- 172.21.15.37:0/3047768269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a0003b80 0x7f76a0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76b2a00640 1 --2- 172.21.15.37:0/3047768269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76bc0ced10 0x7f76a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76bbe00640 1 --2- 172.21.15.37:0/3047768269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76a0004d50 0x7f76a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76bb400640 1 -- 172.21.15.37:0/3047768269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76bc0ced10 msgr2=0x7f76a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76bb400640 1 --2- 172.21.15.37:0/3047768269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76bc0ced10 0x7f76a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76bb400640 1 -- 172.21.15.37:0/3047768269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76a0004d50 msgr2=0x7f76a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76bb400640 1 --2- 172.21.15.37:0/3047768269 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76a0004d50 0x7f76a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:36.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.617+0000 7f76bb400640 1 -- 172.21.15.37:0/3047768269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a0003530 con 0x7f76a0003b80 2024-05-30T06:45:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.621+0000 7f76bb400640 1 --2- 172.21.15.37:0/3047768269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a0003b80 0x7f76a0003f80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00e350 tx=0x7f76ac01ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6e9cefc649846d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.621+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac0b2070 con 0x7f76a0003b80 2024-05-30T06:45:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.621+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ac0a5bf0 con 0x7f76a0003b80 2024-05-30T06:45:36.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.621+0000 7f76baa00640 1 -- 172.21.15.37:0/3047768269 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac009de0 con 0x7f76a0003b80 2024-05-30T06:45:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.621+0000 7f76c2800640 1 -- 172.21.15.37:0/3047768269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a0003b80 msgr2=0x7f76a0003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.621+0000 7f76c2800640 1 --2- 172.21.15.37:0/3047768269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a0003b80 0x7f76a0003f80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00e350 tx=0x7f76ac01ce00 comp rx=0 tx=0).stop 2024-05-30T06:45:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.621+0000 7f76bbe00640 1 -- 172.21.15.37:0/3047768269 reap_dead start 2024-05-30T06:45:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.621+0000 7f76c2800640 1 -- 172.21.15.37:0/3047768269 shutdown_connections 2024-05-30T06:45:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.621+0000 7f76c2800640 1 -- 172.21.15.37:0/3047768269 >> 172.21.15.37:0/3047768269 conn(0x7f76bc06bf60 msgr2=0x7f76bc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.621+0000 7f76c2800640 1 -- 172.21.15.37:0/3047768269 shutdown_connections 2024-05-30T06:45:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.621+0000 7f76c2800640 1 -- 172.21.15.37:0/3047768269 wait complete. 2024-05-30T06:45:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.621+0000 7f76c2800640 1 Processor -- start 2024-05-30T06:45:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76c2800640 1 -- start start 2024-05-30T06:45:36.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76c2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a0003b80 0x7f76bc13b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:36.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76c2800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76bc13bb00 0x7f76bc1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:36.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76c2800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76bc1578f0 0x7f76bc152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76c2800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc15e740 con 0x7f76a0003b80 2024-05-30T06:45:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76c2800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc15e5c0 con 0x7f76bc13bb00 2024-05-30T06:45:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76c2800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f76bc15e8c0 con 0x7f76bc1578f0 2024-05-30T06:45:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76bb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a0003b80 0x7f76bc13b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76bb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a0003b80 0x7f76bc13b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42214/0 (socket says 172.21.15.37:42214) 2024-05-30T06:45:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76bb400640 1 -- 172.21.15.37:0/3367598754 learned_addr learned my addr 172.21.15.37:0/3367598754 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76bb400640 1 -- 172.21.15.37:0/3367598754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76bc1578f0 msgr2=0x7f76bc152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76bb400640 1 --2- 172.21.15.37:0/3367598754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76bc1578f0 0x7f76bc152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76bb400640 1 -- 172.21.15.37:0/3367598754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76bc13bb00 msgr2=0x7f76bc1573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76bb400640 1 --2- 172.21.15.37:0/3367598754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76bc13bb00 0x7f76bc1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76bb400640 1 -- 172.21.15.37:0/3367598754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc1539c0 con 0x7f76a0003b80 2024-05-30T06:45:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76bb400640 1 --2- 172.21.15.37:0/3367598754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a0003b80 0x7f76bc13b5c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f76ac01cc30 tx=0x7f76ac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76b3e00640 1 -- 172.21.15.37:0/3367598754 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac0bc070 con 0x7f76a0003b80 2024-05-30T06:45:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76b3e00640 1 -- 172.21.15.37:0/3367598754 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ac009a50 con 0x7f76a0003b80 2024-05-30T06:45:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76b3e00640 1 -- 172.21.15.37:0/3367598754 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac0b2040 con 0x7f76a0003b80 2024-05-30T06:45:36.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76c2800640 1 -- 172.21.15.37:0/3367598754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76bc13c090 con 0x7f76a0003b80 2024-05-30T06:45:36.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76c2800640 1 -- 172.21.15.37:0/3367598754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76bc13c650 con 0x7f76a0003b80 2024-05-30T06:45:36.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76c2800640 1 -- 172.21.15.37:0/3367598754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76bc068d40 con 0x7f76a0003b80 2024-05-30T06:45:36.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.625+0000 7f76b3e00640 1 -- 172.21.15.37:0/3367598754 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f76ac0adcc0 con 0x7f76a0003b80 2024-05-30T06:45:36.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.629+0000 7f76b3e00640 1 --2- 172.21.15.37:0/3367598754 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f76980686e0 0x7f769806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:36.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.629+0000 7f76b3e00640 1 -- 172.21.15.37:0/3367598754 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5357+0+0 (secure 0 0 0) 0x7f76ac120b70 con 0x7f76a0003b80 2024-05-30T06:45:36.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.629+0000 7f76b2a00640 1 --2- 172.21.15.37:0/3367598754 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f76980686e0 0x7f769806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:36.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.629+0000 7f76b2a00640 1 --2- 172.21.15.37:0/3367598754 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f76980686e0 0x7f769806aba0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f76a4001060 tx=0x7f76a4001160 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:36.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.633+0000 7f76b3e00640 1 -- 172.21.15.37:0/3367598754 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f76ac016b10 con 0x7f76a0003b80 2024-05-30T06:45:36.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:36.797+0000 7f76c2800640 1 -- 172.21.15.37:0/3367598754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f76bc0700c0 con 0x7f76a0003b80 2024-05-30T06:45:37.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.433+0000 7f76b3e00640 1 -- 172.21.15.37:0/3367598754 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) ==== 169+0+0 (secure 0 0 0) 0x7f76ac0f07a0 con 0x7f76a0003b80 2024-05-30T06:45:37.433 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-30T06:45:37.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.433+0000 7f76c2800640 1 -- 172.21.15.37:0/3367598754 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f76980686e0 msgr2=0x7f769806aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:37.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.433+0000 7f76c2800640 1 --2- 172.21.15.37:0/3367598754 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f76980686e0 0x7f769806aba0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f76a4001060 tx=0x7f76a4001160 comp rx=0 tx=0).stop 2024-05-30T06:45:37.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.433+0000 7f76c2800640 1 -- 172.21.15.37:0/3367598754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a0003b80 msgr2=0x7f76bc13b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:37.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.433+0000 7f76c2800640 1 --2- 172.21.15.37:0/3367598754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a0003b80 0x7f76bc13b5c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f76ac01cc30 tx=0x7f76ac009750 comp rx=0 tx=0).stop 2024-05-30T06:45:37.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.433+0000 7f76c2800640 1 -- 172.21.15.37:0/3367598754 shutdown_connections 2024-05-30T06:45:37.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.433+0000 7f76c2800640 1 --2- 172.21.15.37:0/3367598754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76bc1578f0 0x7f76bc152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.433+0000 7f76c2800640 1 --2- 172.21.15.37:0/3367598754 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f76980686e0 0x7f769806aba0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.433+0000 7f76c2800640 1 --2- 172.21.15.37:0/3367598754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76bc13bb00 0x7f76bc1573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.433+0000 7f76c2800640 1 --2- 172.21.15.37:0/3367598754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a0003b80 0x7f76bc13b5c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.433+0000 7f76c2800640 1 -- 172.21.15.37:0/3367598754 >> 172.21.15.37:0/3367598754 conn(0x7f76bc06bf60 msgr2=0x7f76bc156b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:37.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.433+0000 7f76c2800640 1 -- 172.21.15.37:0/3367598754 shutdown_connections 2024-05-30T06:45:37.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.433+0000 7f76c2800640 1 -- 172.21.15.37:0/3367598754 wait complete. 2024-05-30T06:45:37.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T06:45:37.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.613+0000 7fbccac00640 1 Processor -- start 2024-05-30T06:45:37.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.613+0000 7fbccac00640 1 -- start start 2024-05-30T06:45:37.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.613+0000 7fbccac00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbcc415d7e0 0x7fbcc406e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:37.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.613+0000 7fbccac00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc4142030 con 0x7fbcc40b59d0 2024-05-30T06:45:37.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.613+0000 7fbccac00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc4142310 con 0x7fbcc415d350 2024-05-30T06:45:37.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.613+0000 7fbccac00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbcc41425f0 con 0x7fbcc415d7e0 2024-05-30T06:45:37.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.613+0000 7fbcc3e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbcc40b59d0 0x7fbcc40b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33234/0 (socket says 172.21.15.37:33234) 2024-05-30T06:45:37.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.613+0000 7fbcc3e00640 1 -- 172.21.15.37:0/371020009 learned_addr learned my addr 172.21.15.37:0/371020009 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:37.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.617+0000 7fbcc8c00640 1 --2- 172.21.15.37:0/371020009 >> v2:172.21.15.105:3300/0 conn(0x7fbcc415d7e0 0x7fbcc406e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:37.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.617+0000 7fbcc3400640 1 -- 172.21.15.37:0/371020009 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2539369211 0 0) 0x7fbcc4142030 con 0x7fbcc40b59d0 2024-05-30T06:45:37.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.617+0000 7fbcc3400640 1 -- 172.21.15.37:0/371020009 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbca8003530 con 0x7fbcc40b59d0 2024-05-30T06:45:37.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.617+0000 7fbcc3400640 1 -- 172.21.15.37:0/371020009 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062645473 0 0) 0x7fbcc4142310 con 0x7fbcc415d350 2024-05-30T06:45:37.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.617+0000 7fbcc3400640 1 -- 172.21.15.37:0/371020009 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc4142030 con 0x7fbcc415d350 2024-05-30T06:45:37.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.617+0000 7fbcc8c00640 1 -- 172.21.15.37:0/371020009 >> v1:172.21.15.105:6789/0 conn(0x7fbcc415d350 legacy=0x7fbcc406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:37.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.617+0000 7fbcc8c00640 1 -- 172.21.15.37:0/371020009 >> v1:172.21.15.37:6789/0 conn(0x7fbcc40b59d0 legacy=0x7fbcc40b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:37.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.617+0000 7fbcc8c00640 1 -- 172.21.15.37:0/371020009 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc41428d0 con 0x7fbcc415d7e0 2024-05-30T06:45:37.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.621+0000 7fbcc8c00640 1 --2- 172.21.15.37:0/371020009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc415d7e0 0x7fbcc406e660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0097f0 tx=0x7fbcbc01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce83c42f1f7e26e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:37.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.621+0000 7fbcc3400640 1 -- 172.21.15.37:0/371020009 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0b0070 con 0x7fbcc415d7e0 2024-05-30T06:45:37.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.621+0000 7fbcc3400640 1 -- 172.21.15.37:0/371020009 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc0ab600 con 0x7fbcc415d7e0 2024-05-30T06:45:37.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.621+0000 7fbcc3400640 1 -- 172.21.15.37:0/371020009 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0ab9d0 con 0x7fbcc415d7e0 2024-05-30T06:45:37.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.625+0000 7fbccac00640 1 -- 172.21.15.37:0/371020009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc415d7e0 msgr2=0x7fbcc406e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:37.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.625+0000 7fbccac00640 1 --2- 172.21.15.37:0/371020009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc415d7e0 0x7fbcc406e660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0097f0 tx=0x7fbcbc01c460 comp rx=0 tx=0).stop 2024-05-30T06:45:37.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.625+0000 7fbccac00640 1 -- 172.21.15.37:0/371020009 shutdown_connections 2024-05-30T06:45:37.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.625+0000 7fbccac00640 1 --2- 172.21.15.37:0/371020009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc415d7e0 0x7fbcc406e660 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.625+0000 7fbccac00640 1 -- 172.21.15.37:0/371020009 >> 172.21.15.37:0/371020009 conn(0x7fbcc406bf60 msgr2=0x7fbcc40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:37.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.625+0000 7fbccac00640 1 -- 172.21.15.37:0/371020009 shutdown_connections 2024-05-30T06:45:37.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.625+0000 7fbccac00640 1 -- 172.21.15.37:0/371020009 wait complete. 2024-05-30T06:45:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.625+0000 7fbccac00640 1 Processor -- start 2024-05-30T06:45:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.625+0000 7fbccac00640 1 -- start start 2024-05-30T06:45:37.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbccac00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc40b59d0 0x7fbcc40af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:37.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbccac00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbcc415d350 0x7fbcc413eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:37.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbccac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc415d7e0 0x7fbcc41521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:37.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbccac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4141d70 con 0x7fbcc415d7e0 2024-05-30T06:45:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbccac00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4141bf0 con 0x7fbcc40b59d0 2024-05-30T06:45:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbccac00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc416ae40 con 0x7fbcc415d350 2024-05-30T06:45:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcc8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc415d7e0 0x7fbcc41521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:37.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcc8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc415d7e0 0x7fbcc41521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55592/0 (socket says 172.21.15.37:55592) 2024-05-30T06:45:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcc8c00640 1 -- 172.21.15.37:0/1472408867 learned_addr learned my addr 172.21.15.37:0/1472408867 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcc3e00640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc40b59d0 0x7fbcc40af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcbb400640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbcc415d350 0x7fbcc413eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcc8c00640 1 -- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbcc415d350 msgr2=0x7fbcc413eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcc8c00640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbcc415d350 0x7fbcc413eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcc8c00640 1 -- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc40b59d0 msgr2=0x7fbcc40af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcc8c00640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc40b59d0 0x7fbcc40af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcc8c00640 1 -- 172.21.15.37:0/1472408867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc40b3c50 con 0x7fbcc415d7e0 2024-05-30T06:45:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcc8c00640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc415d7e0 0x7fbcc41521c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc019070 tx=0x7fbcbc019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcc0c00640 1 -- 172.21.15.37:0/1472408867 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0b0040 con 0x7fbcc415d7e0 2024-05-30T06:45:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcc0c00640 1 -- 172.21.15.37:0/1472408867 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc0bc070 con 0x7fbcc415d7e0 2024-05-30T06:45:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbcc0c00640 1 -- 172.21.15.37:0/1472408867 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc0b56a0 con 0x7fbcc415d7e0 2024-05-30T06:45:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbccac00640 1 -- 172.21.15.37:0/1472408867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc40b3f30 con 0x7fbcc415d7e0 2024-05-30T06:45:37.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbccac00640 1 -- 172.21.15.37:0/1472408867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc40b44f0 con 0x7fbcc415d7e0 2024-05-30T06:45:37.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.629+0000 7fbccac00640 1 -- 172.21.15.37:0/1472408867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc4068bc0 con 0x7fbcc415d7e0 2024-05-30T06:45:37.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.633+0000 7fbcc0c00640 1 -- 172.21.15.37:0/1472408867 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fbcbc0b3070 con 0x7fbcc415d7e0 2024-05-30T06:45:37.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.633+0000 7fbcc0c00640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbca0068710 0x7fbca006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:37.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.633+0000 7fbcc0c00640 1 -- 172.21.15.37:0/1472408867 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fbcbc121e30 con 0x7fbcc415d7e0 2024-05-30T06:45:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.633+0000 7fbcc3e00640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbca0068710 0x7fbca006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:37.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.633+0000 7fbcc3e00640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbca0068710 0x7fbca006abd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4137620 tx=0x7fbcb4001690 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:37.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.641+0000 7fbcc0c00640 1 -- 172.21.15.37:0/1472408867 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbcbc016050 con 0x7fbcc415d7e0 2024-05-30T06:45:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.817+0000 7fbccac00640 1 -- 172.21.15.37:0/1472408867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fbcc4137370 con 0x7fbcc415d7e0 2024-05-30T06:45:37.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.821+0000 7fbcc0c00640 1 -- 172.21.15.37:0/1472408867 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fbcbc0ef9b0 con 0x7fbcc415d7e0 2024-05-30T06:45:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.825+0000 7fbccac00640 1 -- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbca0068710 msgr2=0x7fbca006abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.825+0000 7fbccac00640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbca0068710 0x7fbca006abd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4137620 tx=0x7fbcb4001690 comp rx=0 tx=0).stop 2024-05-30T06:45:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.825+0000 7fbccac00640 1 -- 172.21.15.37:0/1472408867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc415d7e0 msgr2=0x7fbcc41521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.825+0000 7fbccac00640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc415d7e0 0x7fbcc41521c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc019070 tx=0x7fbcbc019200 comp rx=0 tx=0).stop 2024-05-30T06:45:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.825+0000 7fbccac00640 1 -- 172.21.15.37:0/1472408867 shutdown_connections 2024-05-30T06:45:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.825+0000 7fbccac00640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcc415d7e0 0x7fbcc41521c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.825+0000 7fbccac00640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbcc415d350 0x7fbcc413eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.825+0000 7fbccac00640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbca0068710 0x7fbca006abd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.825+0000 7fbccac00640 1 --2- 172.21.15.37:0/1472408867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbcc40b59d0 0x7fbcc40af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.825+0000 7fbccac00640 1 -- 172.21.15.37:0/1472408867 >> 172.21.15.37:0/1472408867 conn(0x7fbcc406bf60 msgr2=0x7fbcc4074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.825+0000 7fbccac00640 1 -- 172.21.15.37:0/1472408867 shutdown_connections 2024-05-30T06:45:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.825+0000 7fbccac00640 1 -- 172.21.15.37:0/1472408867 wait complete. 2024-05-30T06:45:37.844 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone' 2024-05-30T06:45:37.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd975800640 1 Processor -- start 2024-05-30T06:45:37.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd975800640 1 -- start start 2024-05-30T06:45:37.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd975800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd97015ed50 0x7fd9700c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:37.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd975800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd97009aa60 0x7fd97009aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:37.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd975800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9700c7f20 con 0x7fd9700d02b0 2024-05-30T06:45:37.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd975800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd9700c9500 con 0x7fd97009aa60 2024-05-30T06:45:37.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd975800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd97015f130 con 0x7fd97015ed50 2024-05-30T06:45:37.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd96f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd97009aa60 0x7fd97009aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:37.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd966000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd9700d02b0 0x7fd9700d0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33248/0 (socket says 172.21.15.37:33248) 2024-05-30T06:45:37.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd966000640 1 -- 172.21.15.37:0/1000781796 learned_addr learned my addr 172.21.15.37:0/1000781796 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:37.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd96f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd97009aa60 0x7fd97009aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55596/0 (socket says 172.21.15.37:55596) 2024-05-30T06:45:37.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd96ea00640 1 --2- 172.21.15.37:0/1000781796 >> v2:172.21.15.105:3300/0 conn(0x7fd97015ed50 0x7fd9700c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:37.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd96f400640 1 -- 172.21.15.37:0/1000781796 >> v2:172.21.15.105:3300/0 conn(0x7fd97015ed50 msgr2=0x7fd9700c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:37.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd96f400640 1 --2- 172.21.15.37:0/1000781796 >> v2:172.21.15.105:3300/0 conn(0x7fd97015ed50 0x7fd9700c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd96f400640 1 -- 172.21.15.37:0/1000781796 >> v1:172.21.15.37:6789/0 conn(0x7fd9700d02b0 legacy=0x7fd9700d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:37.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd96f400640 1 -- 172.21.15.37:0/1000781796 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9700c8200 con 0x7fd97009aa60 2024-05-30T06:45:37.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd96e000640 1 -- 172.21.15.37:0/1000781796 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1983339411 0 0) 0x7fd9700c7f20 con 0x7fd9700d02b0 2024-05-30T06:45:37.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.985+0000 7fd96ea00640 1 --2- 172.21.15.37:0/1000781796 >> v2:172.21.15.105:3300/0 conn(0x7fd97015ed50 0x7fd9700c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:37.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.989+0000 7fd96f400640 1 --2- 172.21.15.37:0/1000781796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd97009aa60 0x7fd97009aed0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd970072b40 tx=0x7fd96801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2715cbc873952cd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:37.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.989+0000 7fd96e000640 1 -- 172.21.15.37:0/1000781796 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9680b2070 con 0x7fd97009aa60 2024-05-30T06:45:37.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.989+0000 7fd96e000640 1 -- 172.21.15.37:0/1000781796 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9680a59c0 con 0x7fd97009aa60 2024-05-30T06:45:37.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.989+0000 7fd96e000640 1 -- 172.21.15.37:0/1000781796 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9680a5d90 con 0x7fd97009aa60 2024-05-30T06:45:37.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.989+0000 7fd975800640 1 -- 172.21.15.37:0/1000781796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd97009aa60 msgr2=0x7fd97009aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:37.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.989+0000 7fd975800640 1 --2- 172.21.15.37:0/1000781796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd97009aa60 0x7fd97009aed0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd970072b40 tx=0x7fd96801c900 comp rx=0 tx=0).stop 2024-05-30T06:45:37.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.989+0000 7fd975800640 1 -- 172.21.15.37:0/1000781796 shutdown_connections 2024-05-30T06:45:37.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.989+0000 7fd975800640 1 --2- 172.21.15.37:0/1000781796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd97009aa60 0x7fd97009aed0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.989+0000 7fd975800640 1 --2- 172.21.15.37:0/1000781796 >> v2:172.21.15.105:3300/0 conn(0x7fd97015ed50 0x7fd9700c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.989+0000 7fd975800640 1 -- 172.21.15.37:0/1000781796 >> 172.21.15.37:0/1000781796 conn(0x7fd9700d26e0 msgr2=0x7fd9700d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:37.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.989+0000 7fd975800640 1 -- 172.21.15.37:0/1000781796 shutdown_connections 2024-05-30T06:45:37.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.989+0000 7fd975800640 1 -- 172.21.15.37:0/1000781796 wait complete. 2024-05-30T06:45:37.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd975800640 1 Processor -- start 2024-05-30T06:45:37.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd975800640 1 -- start start 2024-05-30T06:45:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd975800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd97009aa60 0x7fd970150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd975800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9700d02b0 0x7fd970154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd975800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd97015ed50 0x7fd970142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd975800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd9700c7ad0 con 0x7fd9700d02b0 2024-05-30T06:45:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd975800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9700d0e50 con 0x7fd97009aa60 2024-05-30T06:45:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd975800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9700c7c50 con 0x7fd97015ed50 2024-05-30T06:45:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd966000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9700d02b0 0x7fd970154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd966000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9700d02b0 0x7fd970154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55606/0 (socket says 172.21.15.37:55606) 2024-05-30T06:45:37.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd966000640 1 -- 172.21.15.37:0/533795254 learned_addr learned my addr 172.21.15.37:0/533795254 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:37.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd96ea00640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd97009aa60 0x7fd970150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:37.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd96f400640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd97015ed50 0x7fd970142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:37.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd966000640 1 -- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd97015ed50 msgr2=0x7fd970142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:37.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd966000640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd97015ed50 0x7fd970142310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd966000640 1 -- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd97009aa60 msgr2=0x7fd970150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:37.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd966000640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd97009aa60 0x7fd970150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:37.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd966000640 1 -- 172.21.15.37:0/533795254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9701553b0 con 0x7fd9700d02b0 2024-05-30T06:45:37.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd966000640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9700d02b0 0x7fd970154e70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd9580011f0 tx=0x7fd95800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd967400640 1 -- 172.21.15.37:0/533795254 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958018070 con 0x7fd9700d02b0 2024-05-30T06:45:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd967400640 1 -- 172.21.15.37:0/533795254 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9580074e0 con 0x7fd9700d02b0 2024-05-30T06:45:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd967400640 1 -- 172.21.15.37:0/533795254 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958004a10 con 0x7fd9700d02b0 2024-05-30T06:45:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd975800640 1 -- 172.21.15.37:0/533795254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd970150960 con 0x7fd9700d02b0 2024-05-30T06:45:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd975800640 1 -- 172.21.15.37:0/533795254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd970150f20 con 0x7fd9700d02b0 2024-05-30T06:45:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.993+0000 7fd975800640 1 -- 172.21.15.37:0/533795254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd970068b20 con 0x7fd9700d02b0 2024-05-30T06:45:37.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.997+0000 7fd967400640 1 -- 172.21.15.37:0/533795254 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fd958004bb0 con 0x7fd9700d02b0 2024-05-30T06:45:37.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.997+0000 7fd967400640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd94c0686e0 0x7fd94c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:37.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.997+0000 7fd967400640 1 -- 172.21.15.37:0/533795254 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fd9580860a0 con 0x7fd9700d02b0 2024-05-30T06:45:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.997+0000 7fd96ea00640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd94c0686e0 0x7fd94c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:37.997+0000 7fd96ea00640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd94c0686e0 0x7fd94c06aba0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd96000c900 tx=0x7fd960008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.001+0000 7fd967400640 1 -- 172.21.15.37:0/533795254 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd958056480 con 0x7fd9700d02b0 2024-05-30T06:45:38.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.225+0000 7fd975800640 1 -- 172.21.15.37:0/533795254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]} v 0) -- 0x7fd9700d3420 con 0x7fd9700d02b0 2024-05-30T06:45:38.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.445+0000 7fd967400640 1 -- 172.21.15.37:0/533795254 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bar_for_1_clone"]}]=0 v179) ==== 160+0+0 (secure 0 0 0) 0x7fd958055d80 con 0x7fd9700d02b0 2024-05-30T06:45:38.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.449+0000 7fd975800640 1 -- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd94c0686e0 msgr2=0x7fd94c06aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:38.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.449+0000 7fd975800640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd94c0686e0 0x7fd94c06aba0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd96000c900 tx=0x7fd960008040 comp rx=0 tx=0).stop 2024-05-30T06:45:38.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.449+0000 7fd975800640 1 -- 172.21.15.37:0/533795254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9700d02b0 msgr2=0x7fd970154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:38.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.449+0000 7fd975800640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9700d02b0 0x7fd970154e70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd9580011f0 tx=0x7fd95800c9b0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.449+0000 7fd975800640 1 -- 172.21.15.37:0/533795254 shutdown_connections 2024-05-30T06:45:38.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.449+0000 7fd975800640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd97015ed50 0x7fd970142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.449+0000 7fd975800640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9700d02b0 0x7fd970154e70 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.449+0000 7fd975800640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd94c0686e0 0x7fd94c06aba0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.449+0000 7fd975800640 1 --2- 172.21.15.37:0/533795254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd97009aa60 0x7fd970150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.449+0000 7fd975800640 1 -- 172.21.15.37:0/533795254 >> 172.21.15.37:0/533795254 conn(0x7fd9700d26e0 msgr2=0x7fd9700719e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:38.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.449+0000 7fd975800640 1 -- 172.21.15.37:0/533795254 shutdown_connections 2024-05-30T06:45:38.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.449+0000 7fd975800640 1 -- 172.21.15.37:0/533795254 wait complete. 2024-05-30T06:45:38.471 INFO:tasks.cephfs_test_runner:Test that when one clone is in progress, one progress bar is printed ... ok 2024-05-30T06:45:38.471 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bars_for_4_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that one progress bar is printed when number of clone jobs is 2024-05-30T06:45:38.471 INFO:tasks.cephfs_test_runner:test_progress_bars_for_4_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T06:45:38.472 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:45:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc868a00640 1 Processor -- start 2024-05-30T06:45:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc868a00640 1 -- start start 2024-05-30T06:45:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc868a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc86415ce90 0x7fc86406b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc868a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc86406bea0 0x7fc864166490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc868a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8640b07a0 con 0x7fc864146180 2024-05-30T06:45:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc868a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc8640ae850 con 0x7fc86415ce90 2024-05-30T06:45:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc868a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc8640b0a80 con 0x7fc86406bea0 2024-05-30T06:45:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc859400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc86415ce90 0x7fc86406b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc861e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc864146180 0x7fc8640b6030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33252/0 (socket says 172.21.15.37:33252) 2024-05-30T06:45:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc859400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc86415ce90 0x7fc86406b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55614/0 (socket says 172.21.15.37:55614) 2024-05-30T06:45:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc861e00640 1 -- 172.21.15.37:0/3823522669 learned_addr learned my addr 172.21.15.37:0/3823522669 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc862800640 1 --2- 172.21.15.37:0/3823522669 >> v2:172.21.15.105:3300/0 conn(0x7fc86406bea0 0x7fc864166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc859400640 1 -- 172.21.15.37:0/3823522669 >> v2:172.21.15.105:3300/0 conn(0x7fc86406bea0 msgr2=0x7fc864166490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc859400640 1 --2- 172.21.15.37:0/3823522669 >> v2:172.21.15.105:3300/0 conn(0x7fc86406bea0 0x7fc864166490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc859400640 1 -- 172.21.15.37:0/3823522669 >> v1:172.21.15.37:6789/0 conn(0x7fc864146180 legacy=0x7fc8640b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:38.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.613+0000 7fc859400640 1 -- 172.21.15.37:0/3823522669 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8640b0d60 con 0x7fc86415ce90 2024-05-30T06:45:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.617+0000 7fc859400640 1 --2- 172.21.15.37:0/3823522669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc86415ce90 0x7fc86406b960 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc86406ca40 tx=0x7fc84c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57a52af0dae3aed server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.617+0000 7fc861400640 1 -- 172.21.15.37:0/3823522669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0b0070 con 0x7fc86415ce90 2024-05-30T06:45:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.617+0000 7fc861400640 1 -- 172.21.15.37:0/3823522669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c0ab600 con 0x7fc86415ce90 2024-05-30T06:45:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.617+0000 7fc861400640 1 -- 172.21.15.37:0/3823522669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0ab9d0 con 0x7fc86415ce90 2024-05-30T06:45:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.617+0000 7fc868a00640 1 -- 172.21.15.37:0/3823522669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc86415ce90 msgr2=0x7fc86406b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.617+0000 7fc868a00640 1 --2- 172.21.15.37:0/3823522669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc86415ce90 0x7fc86406b960 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc86406ca40 tx=0x7fc84c01c3f0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.617+0000 7fc868a00640 1 -- 172.21.15.37:0/3823522669 shutdown_connections 2024-05-30T06:45:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.617+0000 7fc868a00640 1 --2- 172.21.15.37:0/3823522669 >> v2:172.21.15.105:3300/0 conn(0x7fc86406bea0 0x7fc864166490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.617+0000 7fc868a00640 1 --2- 172.21.15.37:0/3823522669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc86415ce90 0x7fc86406b960 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.617+0000 7fc868a00640 1 -- 172.21.15.37:0/3823522669 >> 172.21.15.37:0/3823522669 conn(0x7fc8640b6a60 msgr2=0x7fc8640b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.617+0000 7fc868a00640 1 -- 172.21.15.37:0/3823522669 shutdown_connections 2024-05-30T06:45:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.617+0000 7fc868a00640 1 -- 172.21.15.37:0/3823522669 wait complete. 2024-05-30T06:45:38.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.617+0000 7fc868a00640 1 Processor -- start 2024-05-30T06:45:38.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc868a00640 1 -- start start 2024-05-30T06:45:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc868a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc86406bea0 0x7fc864153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc868a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc864146180 0x7fc86413e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc868a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc86415ce90 0x7fc86413ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc868a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641691f0 con 0x7fc864146180 2024-05-30T06:45:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc868a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc86406c2b0 con 0x7fc86415ce90 2024-05-30T06:45:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc868a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc864169370 con 0x7fc86406bea0 2024-05-30T06:45:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc859400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc864146180 0x7fc86413e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc859400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc864146180 0x7fc86413e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55630/0 (socket says 172.21.15.37:55630) 2024-05-30T06:45:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc859400640 1 -- 172.21.15.37:0/1398621472 learned_addr learned my addr 172.21.15.37:0/1398621472 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc862800640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc86415ce90 0x7fc86413ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc861e00640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc86406bea0 0x7fc864153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc859400640 1 -- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc86406bea0 msgr2=0x7fc864153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc859400640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc86406bea0 0x7fc864153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc859400640 1 -- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc86415ce90 msgr2=0x7fc86413ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc859400640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc86415ce90 0x7fc86413ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc859400640 1 -- 172.21.15.37:0/1398621472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc864138490 con 0x7fc864146180 2024-05-30T06:45:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc859400640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc864146180 0x7fc86413e6a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0ae040 tx=0x7fc84c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc85aa00640 1 -- 172.21.15.37:0/1398621472 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0b8020 con 0x7fc864146180 2024-05-30T06:45:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc85aa00640 1 -- 172.21.15.37:0/1398621472 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c0b4410 con 0x7fc864146180 2024-05-30T06:45:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc868a00640 1 -- 172.21.15.37:0/1398621472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc864138730 con 0x7fc864146180 2024-05-30T06:45:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc85aa00640 1 -- 172.21.15.37:0/1398621472 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0b0040 con 0x7fc864146180 2024-05-30T06:45:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc868a00640 1 -- 172.21.15.37:0/1398621472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc864154450 con 0x7fc864146180 2024-05-30T06:45:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.621+0000 7fc868a00640 1 -- 172.21.15.37:0/1398621472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc864068b20 con 0x7fc864146180 2024-05-30T06:45:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.625+0000 7fc85aa00640 1 -- 172.21.15.37:0/1398621472 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fc84c0bb020 con 0x7fc864146180 2024-05-30T06:45:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.625+0000 7fc85aa00640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc8400686e0 0x7fc84006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.625+0000 7fc85aa00640 1 -- 172.21.15.37:0/1398621472 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fc84c120a60 con 0x7fc864146180 2024-05-30T06:45:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.625+0000 7fc861e00640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc8400686e0 0x7fc84006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.625+0000 7fc861e00640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc8400686e0 0x7fc84006aba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc854000f70 tx=0x7fc854009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:38.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.629+0000 7fc85aa00640 1 -- 172.21.15.37:0/1398621472 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc84c0c2030 con 0x7fc864146180 2024-05-30T06:45:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.797+0000 7fc868a00640 1 -- 172.21.15.37:0/1398621472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8641439d0 con 0x7fc864146180 2024-05-30T06:45:38.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.797+0000 7fc85aa00640 1 -- 172.21.15.37:0/1398621472 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+13004 (secure 0 0 0) 0x7fc84c016070 con 0x7fc864146180 2024-05-30T06:45:38.799 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:38.799 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:45:37.434243+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6833/12178000":"2024-05-31T06:45:34.114528+0000","172.21.15.37:6832/12178000":"2024-05-31T06:45:34.114528+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:45:38.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.801+0000 7fc868a00640 1 -- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc8400686e0 msgr2=0x7fc84006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:38.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.801+0000 7fc868a00640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc8400686e0 0x7fc84006aba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc854000f70 tx=0x7fc854009040 comp rx=0 tx=0).stop 2024-05-30T06:45:38.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.801+0000 7fc868a00640 1 -- 172.21.15.37:0/1398621472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc864146180 msgr2=0x7fc86413e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:38.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.801+0000 7fc868a00640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc864146180 0x7fc86413e6a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0ae040 tx=0x7fc84c019190 comp rx=0 tx=0).stop 2024-05-30T06:45:38.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.801+0000 7fc868a00640 1 -- 172.21.15.37:0/1398621472 shutdown_connections 2024-05-30T06:45:38.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.801+0000 7fc868a00640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc8400686e0 0x7fc84006aba0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.801+0000 7fc868a00640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc86415ce90 0x7fc86413ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.801+0000 7fc868a00640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc864146180 0x7fc86413e6a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.801+0000 7fc868a00640 1 --2- 172.21.15.37:0/1398621472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc86406bea0 0x7fc864153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.801+0000 7fc868a00640 1 -- 172.21.15.37:0/1398621472 >> 172.21.15.37:0/1398621472 conn(0x7fc8640b6a60 msgr2=0x7fc864140870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:38.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.801+0000 7fc868a00640 1 -- 172.21.15.37:0/1398621472 shutdown_connections 2024-05-30T06:45:38.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.801+0000 7fc868a00640 1 -- 172.21.15.37:0/1398621472 wait complete. 2024-05-30T06:45:38.820 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:45:38.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:45:38.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.961+0000 7f2045800640 1 Processor -- start 2024-05-30T06:45:38.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.961+0000 7f2045800640 1 -- start start 2024-05-30T06:45:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.965+0000 7f2045800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20401624a0 0x7f204006b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:38.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.965+0000 7f2045800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20400b6130 con 0x7f2040158e00 2024-05-30T06:45:38.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.965+0000 7f2045800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2040071410 con 0x7f204006bea0 2024-05-30T06:45:38.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.965+0000 7f2045800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f204006c310 con 0x7f20401624a0 2024-05-30T06:45:38.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.965+0000 7f2036000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20401624a0 0x7f204006b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:38.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.965+0000 7f2036000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20401624a0 0x7f204006b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55644/0 (socket says 172.21.15.37:55644) 2024-05-30T06:45:38.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.965+0000 7f2036000640 1 -- 172.21.15.37:0/3981204463 learned_addr learned my addr 172.21.15.37:0/3981204463 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:38.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.965+0000 7f203ea00640 1 --1- 172.21.15.37:0/3981204463 >> v1:172.21.15.37:6789/0 conn(0x7f2040158e00 0x7f20400b5a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33262/0 (socket says 172.21.15.37:33262) 2024-05-30T06:45:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.965+0000 7f2036000640 1 -- 172.21.15.37:0/3981204463 >> v1:172.21.15.105:6789/0 conn(0x7f204006bea0 legacy=0x7f20400b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.965+0000 7f2036000640 1 -- 172.21.15.37:0/3981204463 >> v1:172.21.15.37:6789/0 conn(0x7f2040158e00 legacy=0x7f20400b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.965+0000 7f2036000640 1 -- 172.21.15.37:0/3981204463 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2040162980 con 0x7f20401624a0 2024-05-30T06:45:38.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.965+0000 7f203e000640 1 -- 172.21.15.37:0/3981204463 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208986726 0 0) 0x7f20400b6130 con 0x7f2040158e00 2024-05-30T06:45:38.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.969+0000 7f2036000640 1 --2- 172.21.15.37:0/3981204463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20401624a0 0x7f204006b960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2028009870 tx=0x7f202801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d153ece7f4809a45 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:38.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.969+0000 7f203e000640 1 -- 172.21.15.37:0/3981204463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280b2070 con 0x7f20401624a0 2024-05-30T06:45:38.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.969+0000 7f203e000640 1 -- 172.21.15.37:0/3981204463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20280a9070 con 0x7f20401624a0 2024-05-30T06:45:38.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.969+0000 7f203e000640 1 -- 172.21.15.37:0/3981204463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280ad880 con 0x7f20401624a0 2024-05-30T06:45:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.969+0000 7f2045800640 1 -- 172.21.15.37:0/3981204463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20401624a0 msgr2=0x7f204006b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.969+0000 7f2045800640 1 --2- 172.21.15.37:0/3981204463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20401624a0 0x7f204006b960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2028009870 tx=0x7f202801c560 comp rx=0 tx=0).stop 2024-05-30T06:45:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.969+0000 7f2045800640 1 -- 172.21.15.37:0/3981204463 shutdown_connections 2024-05-30T06:45:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.969+0000 7f2045800640 1 --2- 172.21.15.37:0/3981204463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20401624a0 0x7f204006b960 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.969+0000 7f2045800640 1 -- 172.21.15.37:0/3981204463 >> 172.21.15.37:0/3981204463 conn(0x7f204006f110 msgr2=0x7f204006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.969+0000 7f2045800640 1 -- 172.21.15.37:0/3981204463 shutdown_connections 2024-05-30T06:45:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.969+0000 7f2045800640 1 -- 172.21.15.37:0/3981204463 wait complete. 2024-05-30T06:45:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.969+0000 7f2045800640 1 Processor -- start 2024-05-30T06:45:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.969+0000 7f2045800640 1 -- start start 2024-05-30T06:45:38.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2045800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f204006bea0 0x7f204014a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:38.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2045800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2040158e00 0x7f204014c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:38.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2045800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20401624a0 0x7f20400b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:38.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2045800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2040159360 con 0x7f2040158e00 2024-05-30T06:45:38.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2045800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20401591e0 con 0x7f204006bea0 2024-05-30T06:45:38.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2045800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f204016d060 con 0x7f20401624a0 2024-05-30T06:45:38.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2036000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2040158e00 0x7f204014c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:38.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2036000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2040158e00 0x7f204014c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55648/0 (socket says 172.21.15.37:55648) 2024-05-30T06:45:38.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2036000640 1 -- 172.21.15.37:0/3078130092 learned_addr learned my addr 172.21.15.37:0/3078130092 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:38.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f203ea00640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f204006bea0 0x7f204014a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:38.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f203f400640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20401624a0 0x7f20400b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2036000640 1 -- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20401624a0 msgr2=0x7f20400b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2036000640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20401624a0 0x7f20400b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2036000640 1 -- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f204006bea0 msgr2=0x7f204014a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2036000640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f204006bea0 0x7f204014a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2036000640 1 -- 172.21.15.37:0/3078130092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204014b170 con 0x7f2040158e00 2024-05-30T06:45:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f203f400640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20401624a0 0x7f20400b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f203ea00640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f204006bea0 0x7f204014a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2036000640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2040158e00 0x7f204014c210 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f20280b0040 tx=0x7f202801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2037400640 1 -- 172.21.15.37:0/3078130092 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280b2040 con 0x7f2040158e00 2024-05-30T06:45:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2037400640 1 -- 172.21.15.37:0/3078130092 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20280addb0 con 0x7f2040158e00 2024-05-30T06:45:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2037400640 1 -- 172.21.15.37:0/3078130092 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028004220 con 0x7f2040158e00 2024-05-30T06:45:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2045800640 1 -- 172.21.15.37:0/3078130092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204014b450 con 0x7f2040158e00 2024-05-30T06:45:38.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2045800640 1 -- 172.21.15.37:0/3078130092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f204014ba10 con 0x7f2040158e00 2024-05-30T06:45:38.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2045800640 1 -- 172.21.15.37:0/3078130092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2040068bc0 con 0x7f2040158e00 2024-05-30T06:45:38.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.973+0000 7f2037400640 1 -- 172.21.15.37:0/3078130092 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f20280c1060 con 0x7f2040158e00 2024-05-30T06:45:38.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.977+0000 7f2037400640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f201c0686e0 0x7f201c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:38.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.977+0000 7f2037400640 1 -- 172.21.15.37:0/3078130092 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f2028120590 con 0x7f2040158e00 2024-05-30T06:45:38.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.977+0000 7f203ea00640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f201c0686e0 0x7f201c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:38.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.977+0000 7f203ea00640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f201c0686e0 0x7f201c06aba0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2030000f70 tx=0x7f2030007c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:38.981+0000 7f2037400640 1 -- 172.21.15.37:0/3078130092 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2028016150 con 0x7f2040158e00 2024-05-30T06:45:39.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.141+0000 7f2045800640 1 -- 172.21.15.37:0/3078130092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f204016a620 con 0x7f2040158e00 2024-05-30T06:45:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.145+0000 7f2037400640 1 -- 172.21.15.37:0/3078130092 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) ==== 93+0+10 (secure 0 0 0) 0x7f20280f0860 con 0x7f2040158e00 2024-05-30T06:45:39.145 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:45:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.145+0000 7f2045800640 1 -- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f201c0686e0 msgr2=0x7f201c06aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.145+0000 7f2045800640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f201c0686e0 0x7f201c06aba0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2030000f70 tx=0x7f2030007c60 comp rx=0 tx=0).stop 2024-05-30T06:45:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.145+0000 7f2045800640 1 -- 172.21.15.37:0/3078130092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2040158e00 msgr2=0x7f204014c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.145+0000 7f2045800640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2040158e00 0x7f204014c210 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f20280b0040 tx=0x7f202801ada0 comp rx=0 tx=0).stop 2024-05-30T06:45:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.145+0000 7f2045800640 1 -- 172.21.15.37:0/3078130092 shutdown_connections 2024-05-30T06:45:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.145+0000 7f2045800640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20401624a0 0x7f20400b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.145+0000 7f2045800640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2040158e00 0x7f204014c210 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.145+0000 7f2045800640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f201c0686e0 0x7f201c06aba0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.145+0000 7f2045800640 1 --2- 172.21.15.37:0/3078130092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f204006bea0 0x7f204014a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:39.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.145+0000 7f2045800640 1 -- 172.21.15.37:0/3078130092 >> 172.21.15.37:0/3078130092 conn(0x7f204006f110 msgr2=0x7f20400b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:39.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.145+0000 7f2045800640 1 -- 172.21.15.37:0/3078130092 shutdown_connections 2024-05-30T06:45:39.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.145+0000 7f2045800640 1 -- 172.21.15.37:0/3078130092 wait complete. 2024-05-30T06:45:39.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones' 2024-05-30T06:45:39.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.305+0000 7fcbe4a00640 1 Processor -- start 2024-05-30T06:45:39.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.305+0000 7fcbe4a00640 1 -- start start 2024-05-30T06:45:39.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbe4a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe015ad40 0x7fcbe0071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:39.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbe4a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe015ead0 con 0x7fcbe0072340 2024-05-30T06:45:39.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbe4a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe015edb0 con 0x7fcbe00ce8d0 2024-05-30T06:45:39.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbe4a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe015b180 con 0x7fcbe015ad40 2024-05-30T06:45:39.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbdfe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcbe0072340 0x7fcbe00727b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33272/0 (socket says 172.21.15.37:33272) 2024-05-30T06:45:39.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbdfe00640 1 -- 172.21.15.37:0/2497400865 learned_addr learned my addr 172.21.15.37:0/2497400865 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:39.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbd6a00640 1 --2- 172.21.15.37:0/2497400865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe015ad40 0x7fcbe0071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:39.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbdea00640 1 -- 172.21.15.37:0/2497400865 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697710439 0 0) 0x7fcbe015ead0 con 0x7fcbe0072340 2024-05-30T06:45:39.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbdea00640 1 -- 172.21.15.37:0/2497400865 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbc4003530 con 0x7fcbe0072340 2024-05-30T06:45:39.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbdea00640 1 -- 172.21.15.37:0/2497400865 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489607518 0 0) 0x7fcbe015edb0 con 0x7fcbe00ce8d0 2024-05-30T06:45:39.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbdea00640 1 -- 172.21.15.37:0/2497400865 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbe015ead0 con 0x7fcbe00ce8d0 2024-05-30T06:45:39.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbd6a00640 1 -- 172.21.15.37:0/2497400865 >> v1:172.21.15.105:6789/0 conn(0x7fcbe00ce8d0 legacy=0x7fcbe00b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:39.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbd6a00640 1 -- 172.21.15.37:0/2497400865 >> v1:172.21.15.37:6789/0 conn(0x7fcbe0072340 legacy=0x7fcbe00727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:39.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.309+0000 7fcbd6a00640 1 -- 172.21.15.37:0/2497400865 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe015f090 con 0x7fcbe015ad40 2024-05-30T06:45:39.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.313+0000 7fcbd6a00640 1 --2- 172.21.15.37:0/2497400865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe015ad40 0x7fcbe0071e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009dc0 tx=0x7fcbc801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79160dc1c96c0487 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:39.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.313+0000 7fcbdea00640 1 -- 172.21.15.37:0/2497400865 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80b2070 con 0x7fcbe015ad40 2024-05-30T06:45:39.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.313+0000 7fcbdea00640 1 -- 172.21.15.37:0/2497400865 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc80a5850 con 0x7fcbe015ad40 2024-05-30T06:45:39.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.313+0000 7fcbdea00640 1 -- 172.21.15.37:0/2497400865 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc80a5c20 con 0x7fcbe015ad40 2024-05-30T06:45:39.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.313+0000 7fcbe4a00640 1 -- 172.21.15.37:0/2497400865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe015ad40 msgr2=0x7fcbe0071e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:39.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.313+0000 7fcbe4a00640 1 --2- 172.21.15.37:0/2497400865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe015ad40 0x7fcbe0071e00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009dc0 tx=0x7fcbc801c990 comp rx=0 tx=0).stop 2024-05-30T06:45:39.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.313+0000 7fcbe4a00640 1 -- 172.21.15.37:0/2497400865 shutdown_connections 2024-05-30T06:45:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.313+0000 7fcbe4a00640 1 --2- 172.21.15.37:0/2497400865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe015ad40 0x7fcbe0071e00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.313+0000 7fcbe4a00640 1 -- 172.21.15.37:0/2497400865 >> 172.21.15.37:0/2497400865 conn(0x7fcbe00b2120 msgr2=0x7fcbe00b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.313+0000 7fcbe4a00640 1 -- 172.21.15.37:0/2497400865 shutdown_connections 2024-05-30T06:45:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.313+0000 7fcbe4a00640 1 -- 172.21.15.37:0/2497400865 wait complete. 2024-05-30T06:45:39.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbe4a00640 1 Processor -- start 2024-05-30T06:45:39.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbe4a00640 1 -- start start 2024-05-30T06:45:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbe4a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe0072340 0x7fcbe0140d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbe4a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe00ce8d0 0x7fcbe014d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbe4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe015ad40 0x7fcbe00b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbe4a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe01695c0 con 0x7fcbe015ad40 2024-05-30T06:45:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbe4a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe0169440 con 0x7fcbe0072340 2024-05-30T06:45:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbe4a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe0169740 con 0x7fcbe00ce8d0 2024-05-30T06:45:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbdfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe015ad40 0x7fcbe00b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbdfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe015ad40 0x7fcbe00b0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55656/0 (socket says 172.21.15.37:55656) 2024-05-30T06:45:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbdfe00640 1 -- 172.21.15.37:0/492073122 learned_addr learned my addr 172.21.15.37:0/492073122 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbd6a00640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe00ce8d0 0x7fcbe014d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbdf400640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe0072340 0x7fcbe0140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbdfe00640 1 -- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe00ce8d0 msgr2=0x7fcbe014d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbdfe00640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe00ce8d0 0x7fcbe014d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbdfe00640 1 -- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe0072340 msgr2=0x7fcbe0140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbdfe00640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe0072340 0x7fcbe0140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbdfe00640 1 -- 172.21.15.37:0/492073122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe014ef90 con 0x7fcbe015ad40 2024-05-30T06:45:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbdfe00640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe015ad40 0x7fcbe00b0bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800c460 tx=0x7fcbd800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbd7e00640 1 -- 172.21.15.37:0/492073122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8017070 con 0x7fcbe015ad40 2024-05-30T06:45:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbd7e00640 1 -- 172.21.15.37:0/492073122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd8005cf0 con 0x7fcbe015ad40 2024-05-30T06:45:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbd7e00640 1 -- 172.21.15.37:0/492073122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8007310 con 0x7fcbe015ad40 2024-05-30T06:45:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbe4a00640 1 -- 172.21.15.37:0/492073122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe014f270 con 0x7fcbe015ad40 2024-05-30T06:45:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbe4a00640 1 -- 172.21.15.37:0/492073122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe014f830 con 0x7fcbe015ad40 2024-05-30T06:45:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.317+0000 7fcbe4a00640 1 -- 172.21.15.37:0/492073122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe0068ab0 con 0x7fcbe015ad40 2024-05-30T06:45:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.321+0000 7fcbd7e00640 1 -- 172.21.15.37:0/492073122 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fcbd801a070 con 0x7fcbe015ad40 2024-05-30T06:45:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.321+0000 7fcbd7e00640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcbbc0686e0 0x7fcbbc06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.321+0000 7fcbd7e00640 1 -- 172.21.15.37:0/492073122 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fcbd8085f80 con 0x7fcbe015ad40 2024-05-30T06:45:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.321+0000 7fcbdf400640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcbbc0686e0 0x7fcbbc06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.321+0000 7fcbdf400640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcbbc0686e0 0x7fcbbc06aba0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcbd00011f0 tx=0x7fcbd0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:39.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.325+0000 7fcbd7e00640 1 -- 172.21.15.37:0/492073122 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcbd8056480 con 0x7fcbe015ad40 2024-05-30T06:45:39.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:39.549+0000 7fcbe4a00640 1 -- 172.21.15.37:0/492073122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]} v 0) -- 0x7fcbe0166a00 con 0x7fcbe015ad40 2024-05-30T06:45:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.453+0000 7fcbd7e00640 1 -- 172.21.15.37:0/492073122 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]}]=0 v181) ==== 165+0+0 (secure 0 0 0) 0x7fcbd8055d80 con 0x7fcbe015ad40 2024-05-30T06:45:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.457+0000 7fcbe4a00640 1 -- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcbbc0686e0 msgr2=0x7fcbbc06aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.457+0000 7fcbe4a00640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcbbc0686e0 0x7fcbbc06aba0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcbd00011f0 tx=0x7fcbd0009040 comp rx=0 tx=0).stop 2024-05-30T06:45:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.457+0000 7fcbe4a00640 1 -- 172.21.15.37:0/492073122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe015ad40 msgr2=0x7fcbe00b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.457+0000 7fcbe4a00640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe015ad40 0x7fcbe00b0bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800c460 tx=0x7fcbd800c920 comp rx=0 tx=0).stop 2024-05-30T06:45:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.457+0000 7fcbe4a00640 1 -- 172.21.15.37:0/492073122 shutdown_connections 2024-05-30T06:45:40.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.457+0000 7fcbe4a00640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe015ad40 0x7fcbe00b0bf0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.457+0000 7fcbe4a00640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcbe00ce8d0 0x7fcbe014d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.457+0000 7fcbe4a00640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcbbc0686e0 0x7fcbbc06aba0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.457+0000 7fcbe4a00640 1 --2- 172.21.15.37:0/492073122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcbe0072340 0x7fcbe0140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.457+0000 7fcbe4a00640 1 -- 172.21.15.37:0/492073122 >> 172.21.15.37:0/492073122 conn(0x7fcbe00b2120 msgr2=0x7fcbe0074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:40.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.457+0000 7fcbe4a00640 1 -- 172.21.15.37:0/492073122 shutdown_connections 2024-05-30T06:45:40.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.457+0000 7fcbe4a00640 1 -- 172.21.15.37:0/492073122 wait complete. 2024-05-30T06:45:40.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:45:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.629+0000 7f513ee00640 1 Processor -- start 2024-05-30T06:45:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.629+0000 7f513ee00640 1 -- start start 2024-05-30T06:45:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.629+0000 7f513ee00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f513815e8b0 0x7f51380cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.629+0000 7f513ee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513806d200 0x7f513806d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.629+0000 7f513ee00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5138163350 con 0x7f513809aa60 2024-05-30T06:45:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.629+0000 7f513ee00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f513806db80 con 0x7f513815e8b0 2024-05-30T06:45:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.629+0000 7f513ee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f51380cfb30 con 0x7f513806d200 2024-05-30T06:45:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.629+0000 7f5137e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f513815e8b0 0x7f51380cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.629+0000 7f513ce00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f513809aa60 0x7f513809aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33276/0 (socket says 172.21.15.37:33276) 2024-05-30T06:45:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.629+0000 7f513ce00640 1 -- 172.21.15.37:0/3527015448 learned_addr learned my addr 172.21.15.37:0/3527015448 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.629+0000 7f512fe00640 1 --2- 172.21.15.37:0/3527015448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513806d200 0x7f513806d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f5137e00640 1 -- 172.21.15.37:0/3527015448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513806d200 msgr2=0x7f513806d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f5137e00640 1 --2- 172.21.15.37:0/3527015448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513806d200 0x7f513806d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f5137e00640 1 -- 172.21.15.37:0/3527015448 >> v1:172.21.15.37:6789/0 conn(0x7f513809aa60 legacy=0x7f513809aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f5137e00640 1 -- 172.21.15.37:0/3527015448 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51381627d0 con 0x7f513815e8b0 2024-05-30T06:45:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f5137400640 1 -- 172.21.15.37:0/3527015448 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174207818 0 0) 0x7f5138163350 con 0x7f513809aa60 2024-05-30T06:45:40.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f5137e00640 1 --2- 172.21.15.37:0/3527015448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f513815e8b0 0x7f51380cf5f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f51280097c0 tx=0x7f512801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60ed7d638bfef71 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:40.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f5137400640 1 -- 172.21.15.37:0/3527015448 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51280b2070 con 0x7f513815e8b0 2024-05-30T06:45:40.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f5137400640 1 -- 172.21.15.37:0/3527015448 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51280ad640 con 0x7f513815e8b0 2024-05-30T06:45:40.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f5137400640 1 -- 172.21.15.37:0/3527015448 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51280ada10 con 0x7f513815e8b0 2024-05-30T06:45:40.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f513ee00640 1 -- 172.21.15.37:0/3527015448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f513815e8b0 msgr2=0x7f51380cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f513ee00640 1 --2- 172.21.15.37:0/3527015448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f513815e8b0 0x7f51380cf5f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f51280097c0 tx=0x7f512801c4a0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f513ee00640 1 -- 172.21.15.37:0/3527015448 shutdown_connections 2024-05-30T06:45:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f513ee00640 1 --2- 172.21.15.37:0/3527015448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513806d200 0x7f513806d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f513ee00640 1 --2- 172.21.15.37:0/3527015448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f513815e8b0 0x7f51380cf5f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f513ee00640 1 -- 172.21.15.37:0/3527015448 >> 172.21.15.37:0/3527015448 conn(0x7f51380b4130 msgr2=0x7f51380b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f513ee00640 1 -- 172.21.15.37:0/3527015448 shutdown_connections 2024-05-30T06:45:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.633+0000 7f513ee00640 1 -- 172.21.15.37:0/3527015448 wait complete. 2024-05-30T06:45:40.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ee00640 1 Processor -- start 2024-05-30T06:45:40.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ee00640 1 -- start start 2024-05-30T06:45:40.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513806d200 0x7f513814e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:40.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ee00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f513809aa60 0x7f513814ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:40.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f513815e8b0 0x7f51380af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:40.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5138162480 con 0x7f513815e8b0 2024-05-30T06:45:40.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ee00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f513815ec90 con 0x7f513809aa60 2024-05-30T06:45:40.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f51380cf050 con 0x7f513806d200 2024-05-30T06:45:40.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f513815e8b0 0x7f51380af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:40.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f513815e8b0 0x7f51380af670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55664/0 (socket says 172.21.15.37:55664) 2024-05-30T06:45:40.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ce00640 1 -- 172.21.15.37:0/3615637068 learned_addr learned my addr 172.21.15.37:0/3615637068 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:40.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f5137e00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513806d200 0x7f513814e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:40.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f512fe00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f513809aa60 0x7f513814ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:40.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ce00640 1 -- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513806d200 msgr2=0x7f513814e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:40.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ce00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513806d200 0x7f513814e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ce00640 1 -- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f513809aa60 msgr2=0x7f513814ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:40.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ce00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f513809aa60 0x7f513814ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ce00640 1 -- 172.21.15.37:0/3615637068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51381f8490 con 0x7f513815e8b0 2024-05-30T06:45:40.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.637+0000 7f513ce00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f513815e8b0 0x7f51380af670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f513000c7a0 tx=0x7f513000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:40.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.641+0000 7f5134c00640 1 -- 172.21.15.37:0/3615637068 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130018070 con 0x7f513815e8b0 2024-05-30T06:45:40.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.641+0000 7f5134c00640 1 -- 172.21.15.37:0/3615637068 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513000a640 con 0x7f513815e8b0 2024-05-30T06:45:40.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.641+0000 7f5134c00640 1 -- 172.21.15.37:0/3615637068 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513000aab0 con 0x7f513815e8b0 2024-05-30T06:45:40.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.641+0000 7f513ee00640 1 -- 172.21.15.37:0/3615637068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513814ffc0 con 0x7f513815e8b0 2024-05-30T06:45:40.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.641+0000 7f513ee00640 1 -- 172.21.15.37:0/3615637068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51381f8a30 con 0x7f513815e8b0 2024-05-30T06:45:40.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.641+0000 7f513ee00640 1 -- 172.21.15.37:0/3615637068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5138068bc0 con 0x7f513815e8b0 2024-05-30T06:45:40.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.641+0000 7f5134c00640 1 -- 172.21.15.37:0/3615637068 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f513000ac50 con 0x7f513815e8b0 2024-05-30T06:45:40.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.641+0000 7f5134c00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f51140686e0 0x7f511406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:40.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.641+0000 7f5134c00640 1 -- 172.21.15.37:0/3615637068 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f5130086140 con 0x7f513815e8b0 2024-05-30T06:45:40.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.641+0000 7f5137e00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f51140686e0 0x7f511406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:40.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.645+0000 7f5137e00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f51140686e0 0x7f511406aba0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f51280af000 tx=0x7f5128008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:40.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.645+0000 7f5134c00640 1 -- 172.21.15.37:0/3615637068 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5130055ff0 con 0x7f513815e8b0 2024-05-30T06:45:40.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.809+0000 7f513ee00640 1 -- 172.21.15.37:0/3615637068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f51380b85a0 con 0x7f513815e8b0 2024-05-30T06:45:40.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.817+0000 7f5134c00640 1 -- 172.21.15.37:0/3615637068 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f513005a2f0 con 0x7f513815e8b0 2024-05-30T06:45:40.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.817+0000 7f513ee00640 1 -- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f51140686e0 msgr2=0x7f511406aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:40.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.817+0000 7f513ee00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f51140686e0 0x7f511406aba0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f51280af000 tx=0x7f5128008040 comp rx=0 tx=0).stop 2024-05-30T06:45:40.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.817+0000 7f513ee00640 1 -- 172.21.15.37:0/3615637068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f513815e8b0 msgr2=0x7f51380af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:40.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.817+0000 7f513ee00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f513815e8b0 0x7f51380af670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f513000c7a0 tx=0x7f513000cc60 comp rx=0 tx=0).stop 2024-05-30T06:45:40.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.817+0000 7f513ee00640 1 -- 172.21.15.37:0/3615637068 shutdown_connections 2024-05-30T06:45:40.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.817+0000 7f513ee00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f513815e8b0 0x7f51380af670 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.817+0000 7f513ee00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f51140686e0 0x7f511406aba0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.817+0000 7f513ee00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f513809aa60 0x7f513814ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.817+0000 7f513ee00640 1 --2- 172.21.15.37:0/3615637068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f513806d200 0x7f513814e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:40.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.817+0000 7f513ee00640 1 -- 172.21.15.37:0/3615637068 >> 172.21.15.37:0/3615637068 conn(0x7f51380b4130 msgr2=0x7f513809ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:40.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.817+0000 7f513ee00640 1 -- 172.21.15.37:0/3615637068 shutdown_connections 2024-05-30T06:45:40.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:40.817+0000 7f513ee00640 1 -- 172.21.15.37:0/3615637068 wait complete. 2024-05-30T06:45:40.839 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:45:40.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:45:40.951 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:45:41.057 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:45:41.058 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:45:41.058 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:45:41.067 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:45:41.067 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:45:41.067 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:45:41.076 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:45:41.076 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:45:41.076 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:45:41.116 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:45:41.116 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:45:41.116 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:45:41.128 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:45:41.128 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T06:45:41.128 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:45:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff7d400640 1 Processor -- start 2024-05-30T06:45:41.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff7d400640 1 -- start start 2024-05-30T06:45:41.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff7d400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7eff7815e930 0x7eff7809b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff7d400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff78162cb0 0x7eff780ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff7d400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7809abe0 con 0x7eff780d1240 2024-05-30T06:45:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff7d400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7eff7809bee0 con 0x7eff7815e930 2024-05-30T06:45:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff7d400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7eff7809aec0 con 0x7eff78162cb0 2024-05-30T06:45:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff77200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff78162cb0 0x7eff780ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff76800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7eff7815e930 0x7eff7809b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff6fe00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7eff780d1240 0x7eff781625a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:59764/0 (socket says 172.21.15.37:59764) 2024-05-30T06:45:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff6fe00640 1 -- 172.21.15.37:0/1040259510 learned_addr learned my addr 172.21.15.37:0/1040259510 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:41.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff77200640 1 -- 172.21.15.37:0/1040259510 >> v2:172.21.15.105:3300/0 conn(0x7eff7815e930 msgr2=0x7eff7809b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:41.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff77200640 1 --2- 172.21.15.37:0/1040259510 >> v2:172.21.15.105:3300/0 conn(0x7eff7815e930 0x7eff7809b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff77200640 1 -- 172.21.15.37:0/1040259510 >> v1:172.21.15.105:6789/0 conn(0x7eff780d1240 legacy=0x7eff781625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:41.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff77200640 1 -- 172.21.15.37:0/1040259510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7809b1a0 con 0x7eff78162cb0 2024-05-30T06:45:41.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.301+0000 7eff76800640 1 --2- 172.21.15.37:0/1040259510 >> v2:172.21.15.105:3300/0 conn(0x7eff7815e930 0x7eff7809b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:41.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.305+0000 7eff77200640 1 --2- 172.21.15.37:0/1040259510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff78162cb0 0x7eff780ccc60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7eff70009d90 tx=0x7eff7001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b95c5ff1d9e5ee6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:41.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.305+0000 7eff75e00640 1 -- 172.21.15.37:0/1040259510 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff700b2070 con 0x7eff78162cb0 2024-05-30T06:45:41.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.305+0000 7eff75e00640 1 -- 172.21.15.37:0/1040259510 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff700a5830 con 0x7eff78162cb0 2024-05-30T06:45:41.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.305+0000 7eff75e00640 1 -- 172.21.15.37:0/1040259510 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff700a5c00 con 0x7eff78162cb0 2024-05-30T06:45:41.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.305+0000 7eff7d400640 1 -- 172.21.15.37:0/1040259510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff78162cb0 msgr2=0x7eff780ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:41.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.305+0000 7eff7d400640 1 --2- 172.21.15.37:0/1040259510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff78162cb0 0x7eff780ccc60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7eff70009d90 tx=0x7eff7001c970 comp rx=0 tx=0).stop 2024-05-30T06:45:41.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.305+0000 7eff7d400640 1 -- 172.21.15.37:0/1040259510 shutdown_connections 2024-05-30T06:45:41.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.305+0000 7eff7d400640 1 --2- 172.21.15.37:0/1040259510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff78162cb0 0x7eff780ccc60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.305+0000 7eff7d400640 1 --2- 172.21.15.37:0/1040259510 >> v2:172.21.15.105:3300/0 conn(0x7eff7815e930 0x7eff7809b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.305+0000 7eff7d400640 1 -- 172.21.15.37:0/1040259510 >> 172.21.15.37:0/1040259510 conn(0x7eff780b4100 msgr2=0x7eff780b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:41.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.305+0000 7eff7d400640 1 -- 172.21.15.37:0/1040259510 shutdown_connections 2024-05-30T06:45:41.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.305+0000 7eff7d400640 1 -- 172.21.15.37:0/1040259510 wait complete. 2024-05-30T06:45:41.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff7d400640 1 Processor -- start 2024-05-30T06:45:41.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff7d400640 1 -- start start 2024-05-30T06:45:41.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff7d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780d1240 0x7eff78151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:41.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff7d400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff7815e930 0x7eff780b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:41.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff7d400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff78162cb0 0x7eff78151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:41.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff7d400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff7816bac0 con 0x7eff780d1240 2024-05-30T06:45:41.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff7d400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff7816b940 con 0x7eff78162cb0 2024-05-30T06:45:41.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff7d400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7eff7816bc40 con 0x7eff7815e930 2024-05-30T06:45:41.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff76800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780d1240 0x7eff78151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:41.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff76800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780d1240 0x7eff78151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55672/0 (socket says 172.21.15.37:55672) 2024-05-30T06:45:41.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff76800640 1 -- 172.21.15.37:0/3525143541 learned_addr learned my addr 172.21.15.37:0/3525143541 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:41.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff77200640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff78162cb0 0x7eff78151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:41.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff6fe00640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff7815e930 0x7eff780b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:41.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff76800640 1 -- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff7815e930 msgr2=0x7eff780b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:41.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff76800640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff7815e930 0x7eff780b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff76800640 1 -- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff78162cb0 msgr2=0x7eff78151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:41.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff76800640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff78162cb0 0x7eff78151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff76800640 1 -- 172.21.15.37:0/3525143541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff780b0200 con 0x7eff780d1240 2024-05-30T06:45:41.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff6fe00640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff7815e930 0x7eff780b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:45:41.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff76800640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780d1240 0x7eff78151640 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7eff6800e9b0 tx=0x7eff6800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:41.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff6ea00640 1 -- 172.21.15.37:0/3525143541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff68017070 con 0x7eff780d1240 2024-05-30T06:45:41.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff6ea00640 1 -- 172.21.15.37:0/3525143541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6800ca00 con 0x7eff780d1240 2024-05-30T06:45:41.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff6ea00640 1 -- 172.21.15.37:0/3525143541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6800cdd0 con 0x7eff780d1240 2024-05-30T06:45:41.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff7d400640 1 -- 172.21.15.37:0/3525143541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff780b04e0 con 0x7eff780d1240 2024-05-30T06:45:41.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.309+0000 7eff7d400640 1 -- 172.21.15.37:0/3525143541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff78151b80 con 0x7eff780d1240 2024-05-30T06:45:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.313+0000 7eff7d400640 1 -- 172.21.15.37:0/3525143541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff78068b20 con 0x7eff780d1240 2024-05-30T06:45:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.313+0000 7eff6ea00640 1 -- 172.21.15.37:0/3525143541 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7eff6801a070 con 0x7eff780d1240 2024-05-30T06:45:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.313+0000 7eff6ea00640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff54068710 0x7eff5406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.313+0000 7eff6ea00640 1 -- 172.21.15.37:0/3525143541 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7eff68086ea0 con 0x7eff780d1240 2024-05-30T06:45:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.313+0000 7eff6fe00640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff54068710 0x7eff5406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:41.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.313+0000 7eff6fe00640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff54068710 0x7eff5406abd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7eff60007fd0 tx=0x7eff60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:41.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.317+0000 7eff6ea00640 1 -- 172.21.15.37:0/3525143541 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7eff68057310 con 0x7eff780d1240 2024-05-30T06:45:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.521+0000 7eff7d400640 1 -- 172.21.15.37:0/3525143541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff780d0bc0 con 0x7eff780d1240 2024-05-30T06:45:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.521+0000 7eff6ea00640 1 -- 172.21.15.37:0/3525143541 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3869 (secure 0 0 0) 0x7eff68056c10 con 0x7eff780d1240 2024-05-30T06:45:41.524 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:41.524 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1355950100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1355950100},{"type":"v1","addr":"172.21.15.37:6835","nonce":1355950100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5014,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3139010455","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3139010455},{"type":"v1","addr":"172.21.15.105:6836","nonce":3139010455}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/189373657","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":189373657},{"type":"v1","addr":"172.21.15.105:6837","nonce":189373657}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5559,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/299385024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":299385024},{"type":"v1","addr":"172.21.15.37:6833","nonce":299385024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-05-30T06:45:41.524 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-05-30T06:45:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.525+0000 7eff7d400640 1 -- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff54068710 msgr2=0x7eff5406abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.525+0000 7eff7d400640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff54068710 0x7eff5406abd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7eff60007fd0 tx=0x7eff60009040 comp rx=0 tx=0).stop 2024-05-30T06:45:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.525+0000 7eff7d400640 1 -- 172.21.15.37:0/3525143541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780d1240 msgr2=0x7eff78151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.525+0000 7eff7d400640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780d1240 0x7eff78151640 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7eff6800e9b0 tx=0x7eff6800ee70 comp rx=0 tx=0).stop 2024-05-30T06:45:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.525+0000 7eff7d400640 1 -- 172.21.15.37:0/3525143541 shutdown_connections 2024-05-30T06:45:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.525+0000 7eff7d400640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7eff54068710 0x7eff5406abd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.525+0000 7eff7d400640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff78162cb0 0x7eff78151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.525+0000 7eff7d400640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff7815e930 0x7eff780b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.525+0000 7eff7d400640 1 --2- 172.21.15.37:0/3525143541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780d1240 0x7eff78151640 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.525+0000 7eff7d400640 1 -- 172.21.15.37:0/3525143541 >> 172.21.15.37:0/3525143541 conn(0x7eff780b4100 msgr2=0x7eff78158270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.525+0000 7eff7d400640 1 -- 172.21.15.37:0/3525143541 shutdown_connections 2024-05-30T06:45:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.525+0000 7eff7d400640 1 -- 172.21.15.37:0/3525143541 wait complete. 2024-05-30T06:45:41.545 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T06:45:41.545 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T06:45:41.546 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T06:45:41.546 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:45:41.546 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T06:45:41.546 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T06:45:41.546 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T06:45:41.547 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:45:41.547 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T06:45:41.547 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T06:45:41.547 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T06:45:41.547 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:45:41.547 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T06:45:41.547 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T06:45:41.547 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T06:45:41.548 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:45:41.557 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T06:45:41.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T06:45:41.559 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T06:45:41.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T06:45:41.562 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T06:45:41.563 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T06:45:41.563 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T06:45:41.564 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T06:45:41.602 INFO:tasks.ceph.mds.a:Started 2024-05-30T06:45:41.602 DEBUG:teuthology.parallel:result is None 2024-05-30T06:45:41.605 INFO:tasks.ceph.mds.c:Started 2024-05-30T06:45:41.605 DEBUG:teuthology.parallel:result is None 2024-05-30T06:45:41.606 INFO:tasks.ceph.mds.b:Started 2024-05-30T06:45:41.607 DEBUG:teuthology.parallel:result is None 2024-05-30T06:45:41.608 INFO:tasks.ceph.mds.d:Started 2024-05-30T06:45:41.608 DEBUG:teuthology.parallel:result is None 2024-05-30T06:45:41.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T06:45:41.689 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-30T06:45:41.692 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-30T06:45:41.699 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-05-30T06:45:41.700 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-05-30T06:45:41.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d8000640 1 Processor -- start 2024-05-30T06:45:41.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d8000640 1 -- start start 2024-05-30T06:45:41.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d8000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74d0155da0 0x7f74d00cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:41.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d8000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f74d006f770 0x7f74d00b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:41.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d8000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d015f310 con 0x7f74d00cd440 2024-05-30T06:45:41.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d8000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f74d015f5f0 con 0x7f74d006f770 2024-05-30T06:45:41.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d8000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f74d015f8d0 con 0x7f74d0155da0 2024-05-30T06:45:41.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d6000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f74d006f770 0x7f74d00b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:41.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d5600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74d0155da0 0x7f74d00cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:41.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d4c00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f74d00cd440 0x7f74d006f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:59786/0 (socket says 172.21.15.37:59786) 2024-05-30T06:45:41.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d6000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f74d006f770 0x7f74d00b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:53618/0 (socket says 172.21.15.37:53618) 2024-05-30T06:45:41.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d4c00640 1 -- 172.21.15.37:0/1416473545 learned_addr learned my addr 172.21.15.37:0/1416473545 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:41.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d6000640 1 -- 172.21.15.37:0/1416473545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74d0155da0 msgr2=0x7f74d00cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:41.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d6000640 1 --2- 172.21.15.37:0/1416473545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74d0155da0 0x7f74d00cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d6000640 1 -- 172.21.15.37:0/1416473545 >> v1:172.21.15.105:6789/0 conn(0x7f74d00cd440 legacy=0x7f74d006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:41.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d6000640 1 -- 172.21.15.37:0/1416473545 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d015fbb0 con 0x7f74d006f770 2024-05-30T06:45:41.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74cfe00640 1 -- 172.21.15.37:0/1416473545 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 679992722 0 0) 0x7f74d015f310 con 0x7f74d00cd440 2024-05-30T06:45:41.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.757+0000 7f74d5600640 1 --2- 172.21.15.37:0/1416473545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74d0155da0 0x7f74d00cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:41.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.761+0000 7f74d6000640 1 --2- 172.21.15.37:0/1416473545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d006f770 0x7f74d00b3750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009d90 tx=0x7f74c801c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3b4c4e87306aa3b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:41.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.761+0000 7f74cfe00640 1 -- 172.21.15.37:0/1416473545 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c80b2070 con 0x7f74d006f770 2024-05-30T06:45:41.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.761+0000 7f74cfe00640 1 -- 172.21.15.37:0/1416473545 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c80a5710 con 0x7f74d006f770 2024-05-30T06:45:41.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.761+0000 7f74cfe00640 1 -- 172.21.15.37:0/1416473545 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c80a5ae0 con 0x7f74d006f770 2024-05-30T06:45:41.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.761+0000 7f74d8000640 1 -- 172.21.15.37:0/1416473545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d006f770 msgr2=0x7f74d00b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:41.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.761+0000 7f74d8000640 1 --2- 172.21.15.37:0/1416473545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d006f770 0x7f74d00b3750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009d90 tx=0x7f74c801c850 comp rx=0 tx=0).stop 2024-05-30T06:45:41.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.761+0000 7f74d8000640 1 -- 172.21.15.37:0/1416473545 shutdown_connections 2024-05-30T06:45:41.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.761+0000 7f74d8000640 1 --2- 172.21.15.37:0/1416473545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d006f770 0x7f74d00b3750 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.761+0000 7f74d8000640 1 --2- 172.21.15.37:0/1416473545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74d0155da0 0x7f74d00cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.761+0000 7f74d8000640 1 -- 172.21.15.37:0/1416473545 >> 172.21.15.37:0/1416473545 conn(0x7f74d006bf60 msgr2=0x7f74d00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:41.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.761+0000 7f74d8000640 1 -- 172.21.15.37:0/1416473545 shutdown_connections 2024-05-30T06:45:41.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.761+0000 7f74d8000640 1 -- 172.21.15.37:0/1416473545 wait complete. 2024-05-30T06:45:41.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d8000640 1 Processor -- start 2024-05-30T06:45:41.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d8000640 1 -- start start 2024-05-30T06:45:41.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d8000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74d006f770 0x7f74d0158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:41.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d8000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d0155da0 0x7f74d01597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:41.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d8000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d0159d20 0x7f74d01f7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:41.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d8000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74d0168580 con 0x7f74d0159d20 2024-05-30T06:45:41.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d8000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74d00b46b0 con 0x7f74d0155da0 2024-05-30T06:45:41.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d8000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f74d0168700 con 0x7f74d006f770 2024-05-30T06:45:41.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d0159d20 0x7f74d01f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:41.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d0159d20 0x7f74d01f7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55710/0 (socket says 172.21.15.37:55710) 2024-05-30T06:45:41.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d6000640 1 -- 172.21.15.37:0/83338165 learned_addr learned my addr 172.21.15.37:0/83338165 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:41.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d5600640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74d006f770 0x7f74d0158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:41.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d4c00640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d0155da0 0x7f74d01597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:41.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d6000640 1 -- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74d006f770 msgr2=0x7f74d0158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:41.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d6000640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74d006f770 0x7f74d0158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d6000640 1 -- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d0155da0 msgr2=0x7f74d01597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:41.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d6000640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d0155da0 0x7f74d01597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:41.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d6000640 1 -- 172.21.15.37:0/83338165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d015a230 con 0x7f74d0159d20 2024-05-30T06:45:41.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d6000640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d0159d20 0x7f74d01f7150 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f74c80b0040 tx=0x7f74c80195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:41.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74cd600640 1 -- 172.21.15.37:0/83338165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c80bd020 con 0x7f74d0159d20 2024-05-30T06:45:41.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74cd600640 1 -- 172.21.15.37:0/83338165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c80b3040 con 0x7f74d0159d20 2024-05-30T06:45:41.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74cd600640 1 -- 172.21.15.37:0/83338165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c80b2050 con 0x7f74d0159d20 2024-05-30T06:45:41.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d8000640 1 -- 172.21.15.37:0/83338165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d015a510 con 0x7f74d0159d20 2024-05-30T06:45:41.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.765+0000 7f74d8000640 1 -- 172.21.15.37:0/83338165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d015b640 con 0x7f74d0159d20 2024-05-30T06:45:41.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.769+0000 7f74d8000640 1 -- 172.21.15.37:0/83338165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d0068bc0 con 0x7f74d0159d20 2024-05-30T06:45:41.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.769+0000 7f74cd600640 1 -- 172.21.15.37:0/83338165 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f74c8003bc0 con 0x7f74d0159d20 2024-05-30T06:45:41.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.769+0000 7f74cd600640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74b0068710 0x7f74b006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:41.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.769+0000 7f74cd600640 1 -- 172.21.15.37:0/83338165 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f74c81212b0 con 0x7f74d0159d20 2024-05-30T06:45:41.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.769+0000 7f74d5600640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74b0068710 0x7f74b006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:41.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.769+0000 7f74d5600640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74b0068710 0x7f74b006abd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009580 tx=0x7f74c4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:41.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.773+0000 7f74cd600640 1 -- 172.21.15.37:0/83338165 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f74c80c7060 con 0x7f74d0159d20 2024-05-30T06:45:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:41.949+0000 7f74d8000640 1 -- 172.21.15.37:0/83338165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f74d00b6790 con 0x7f74d0159d20 2024-05-30T06:45:42.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.469+0000 7f74cd600640 1 -- 172.21.15.37:0/83338165 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v40) ==== 97+0+0 (secure 0 0 0) 0x7f74c8016560 con 0x7f74d0159d20 2024-05-30T06:45:42.471 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-30T06:45:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.473+0000 7f74d8000640 1 -- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74b0068710 msgr2=0x7f74b006abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.473+0000 7f74d8000640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74b0068710 0x7f74b006abd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009580 tx=0x7f74c4009190 comp rx=0 tx=0).stop 2024-05-30T06:45:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.473+0000 7f74d8000640 1 -- 172.21.15.37:0/83338165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d0159d20 msgr2=0x7f74d01f7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.473+0000 7f74d8000640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d0159d20 0x7f74d01f7150 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f74c80b0040 tx=0x7f74c80195f0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.473+0000 7f74d8000640 1 -- 172.21.15.37:0/83338165 shutdown_connections 2024-05-30T06:45:42.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.473+0000 7f74d8000640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d0159d20 0x7f74d01f7150 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.473+0000 7f74d8000640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74b0068710 0x7f74b006abd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.473+0000 7f74d8000640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74d0155da0 0x7f74d01597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.473+0000 7f74d8000640 1 --2- 172.21.15.37:0/83338165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74d006f770 0x7f74d0158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.473+0000 7f74d8000640 1 -- 172.21.15.37:0/83338165 >> 172.21.15.37:0/83338165 conn(0x7f74d006bf60 msgr2=0x7f74d00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:42.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.473+0000 7f74d8000640 1 -- 172.21.15.37:0/83338165 shutdown_connections 2024-05-30T06:45:42.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.473+0000 7f74d8000640 1 -- 172.21.15.37:0/83338165 wait complete. 2024-05-30T06:45:42.498 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T06:45:42.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a59e00640 1 Processor -- start 2024-05-30T06:45:42.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a59e00640 1 -- start start 2024-05-30T06:45:42.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a59e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0a5415cd80 0x7f0a5406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:42.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a59e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a540ce8d0 0x7f0a540ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:42.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a59e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a540cd120 con 0x7f0a5406e000 2024-05-30T06:45:42.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a59e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0a540a9530 con 0x7f0a5415cd80 2024-05-30T06:45:42.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a59e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0a540cd400 con 0x7f0a540ce8d0 2024-05-30T06:45:42.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a53400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a540ce8d0 0x7f0a540ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:42.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a53400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a540ce8d0 0x7f0a540ced60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:38490/0 (socket says 172.21.15.37:38490) 2024-05-30T06:45:42.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a53400640 1 -- 172.21.15.37:0/3353239669 learned_addr learned my addr 172.21.15.37:0/3353239669 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:42.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a4be00640 1 --2- 172.21.15.37:0/3353239669 >> v2:172.21.15.105:3300/0 conn(0x7f0a5415cd80 0x7f0a5406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:42.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a53400640 1 -- 172.21.15.37:0/3353239669 >> v2:172.21.15.105:3300/0 conn(0x7f0a5415cd80 msgr2=0x7f0a5406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:42.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a53400640 1 --2- 172.21.15.37:0/3353239669 >> v2:172.21.15.105:3300/0 conn(0x7f0a5415cd80 0x7f0a5406f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a53400640 1 -- 172.21.15.37:0/3353239669 >> v1:172.21.15.105:6789/0 conn(0x7f0a5406e000 legacy=0x7f0a540ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:42.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.641+0000 7f0a53400640 1 -- 172.21.15.37:0/3353239669 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a540cd6e0 con 0x7f0a540ce8d0 2024-05-30T06:45:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.645+0000 7f0a53400640 1 --2- 172.21.15.37:0/3353239669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a540ce8d0 0x7f0a540ced60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009e50 tx=0x7f0a4c01f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae8d6a2ed2397ed3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:42.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.645+0000 7f0a52000640 1 -- 172.21.15.37:0/3353239669 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c0b4070 con 0x7f0a540ce8d0 2024-05-30T06:45:42.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.645+0000 7f0a52000640 1 -- 172.21.15.37:0/3353239669 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a4c0af400 con 0x7f0a540ce8d0 2024-05-30T06:45:42.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.645+0000 7f0a52000640 1 -- 172.21.15.37:0/3353239669 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c0af7d0 con 0x7f0a540ce8d0 2024-05-30T06:45:42.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.645+0000 7f0a59e00640 1 -- 172.21.15.37:0/3353239669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a540ce8d0 msgr2=0x7f0a540ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.645+0000 7f0a59e00640 1 --2- 172.21.15.37:0/3353239669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a540ce8d0 0x7f0a540ced60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009e50 tx=0x7f0a4c01f210 comp rx=0 tx=0).stop 2024-05-30T06:45:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.645+0000 7f0a59e00640 1 -- 172.21.15.37:0/3353239669 shutdown_connections 2024-05-30T06:45:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.645+0000 7f0a59e00640 1 --2- 172.21.15.37:0/3353239669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a540ce8d0 0x7f0a540ced60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.645+0000 7f0a59e00640 1 --2- 172.21.15.37:0/3353239669 >> v2:172.21.15.105:3300/0 conn(0x7f0a5415cd80 0x7f0a5406f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.645+0000 7f0a59e00640 1 -- 172.21.15.37:0/3353239669 >> 172.21.15.37:0/3353239669 conn(0x7f0a540b23a0 msgr2=0x7f0a540b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.645+0000 7f0a59e00640 1 -- 172.21.15.37:0/3353239669 shutdown_connections 2024-05-30T06:45:42.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.645+0000 7f0a59e00640 1 -- 172.21.15.37:0/3353239669 wait complete. 2024-05-30T06:45:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a59e00640 1 Processor -- start 2024-05-30T06:45:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a59e00640 1 -- start start 2024-05-30T06:45:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a59e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5406e000 0x7f0a54139170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a59e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a540ce8d0 0x7f0a5415b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a59e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5415cd80 0x7f0a54143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a59e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5406f930 con 0x7f0a540ce8d0 2024-05-30T06:45:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a59e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0a540cdca0 con 0x7f0a5406e000 2024-05-30T06:45:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a59e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0a5406fab0 con 0x7f0a5415cd80 2024-05-30T06:45:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a4be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a540ce8d0 0x7f0a5415b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a4be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a540ce8d0 0x7f0a5415b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55718/0 (socket says 172.21.15.37:55718) 2024-05-30T06:45:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a4be00640 1 -- 172.21.15.37:0/4157224153 learned_addr learned my addr 172.21.15.37:0/4157224153 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a53400640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5415cd80 0x7f0a54143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a52a00640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5406e000 0x7f0a54139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a4be00640 1 -- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5415cd80 msgr2=0x7f0a54143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a4be00640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5415cd80 0x7f0a54143fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a4be00640 1 -- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5406e000 msgr2=0x7f0a54139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a4be00640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5406e000 0x7f0a54139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a4be00640 1 -- 172.21.15.37:0/4157224153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5415c5a0 con 0x7f0a540ce8d0 2024-05-30T06:45:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a4be00640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a540ce8d0 0x7f0a5415b1a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00e930 tx=0x7f0a3c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a4b400640 1 -- 172.21.15.37:0/4157224153 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c017070 con 0x7f0a540ce8d0 2024-05-30T06:45:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a4b400640 1 -- 172.21.15.37:0/4157224153 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3c00ca00 con 0x7f0a540ce8d0 2024-05-30T06:45:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a4b400640 1 -- 172.21.15.37:0/4157224153 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c00cdb0 con 0x7f0a540ce8d0 2024-05-30T06:45:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a59e00640 1 -- 172.21.15.37:0/4157224153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5415a6c0 con 0x7f0a540ce8d0 2024-05-30T06:45:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.649+0000 7f0a59e00640 1 -- 172.21.15.37:0/4157224153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a5415ac80 con 0x7f0a540ce8d0 2024-05-30T06:45:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.653+0000 7f0a59e00640 1 -- 172.21.15.37:0/4157224153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a54068b20 con 0x7f0a540ce8d0 2024-05-30T06:45:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.653+0000 7f0a4b400640 1 -- 172.21.15.37:0/4157224153 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f0a3c01a070 con 0x7f0a540ce8d0 2024-05-30T06:45:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.653+0000 7f0a4b400640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a300686e0 0x7f0a3006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.653+0000 7f0a4b400640 1 -- 172.21.15.37:0/4157224153 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f0a3c086e80 con 0x7f0a540ce8d0 2024-05-30T06:45:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.653+0000 7f0a52a00640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a300686e0 0x7f0a3006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.653+0000 7f0a52a00640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a300686e0 0x7f0a3006aba0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0a44001770 tx=0x7f0a44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:42.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.657+0000 7f0a4b400640 1 -- 172.21.15.37:0/4157224153 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a3c056e40 con 0x7f0a540ce8d0 2024-05-30T06:45:42.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.877+0000 7f0a59e00640 1 -- 172.21.15.37:0/4157224153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f0a541561b0 con 0x7f0a540ce8d0 2024-05-30T06:45:42.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.877+0000 7f0a4b400640 1 -- 172.21.15.37:0/4157224153 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f0a3c05b140 con 0x7f0a540ce8d0 2024-05-30T06:45:42.879 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:42.880 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:45:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-30T06:45:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-30T06:45:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmcRfnBBAAk60J/SRTolMhKoS8b8A9jQ==", 2024-05-30T06:45:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:45:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:45:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:45:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmzScrERAAbIJ5somf+sguc6jEuR04zg==", 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm2jEhDBAAGKUYGtJznRYpt1LHlMOTrw==", 2024-05-30T06:45:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm95RdGBAAaaaNAKnr4Dtmu+L1NaMVbw==", 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:45:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCFH1hmygxjHhAA1ee1eBP6dvsC0K9w+6d0OQ==", 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCIH1hmNJsBKRAAhns5CNodS7CKFU1Jg3PFCA==", 2024-05-30T06:45:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCLH1hmlx5FNBAAn2Iann8U/uTZy0tFcFx04w==", 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCPH1hmxJnxAhAAt5cEb3YVLDhkQD5WjLQuog==", 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCUH1hmEn5cOBAAFzBuH8TO418e4obqTNeIXg==", 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:45:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCYH1hmij3RCBAAHzQPoM1ClYGGEt6ly6ZrqQ==", 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCbH1hmDqdpERAA46/Bs4B/xVjviQ1gNpNaaw==", 2024-05-30T06:45:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCeH1hmnrfVHRAAlqk48vSVw45YDCXWWb/MUA==", 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A==", 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmf8sdJhAATAP7EzLJxXXnXeEQL9fdpw==", 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:45:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm1qB9IhAAszAwOgm2Igb1DM4diPC7ow==", 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-30T06:45:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmY6AULBAAYNza0fpC3KO69ulNQaSldQ==", 2024-05-30T06:45:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:45:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:45:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:45:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:45:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmbSCrJBAAhn69RBUeyuaAMWiB3o7ByQ==", 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmN/fjABAAdldbCncRiHy6RFEF9H7gnQ==", 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:45:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:45:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-30T06:45:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmNdeSOBAA3V4vK0bNlWFoosV41f/ASQ==", 2024-05-30T06:45:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:45:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:45:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:45:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:45:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-30T06:45:42.892 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:45:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.881+0000 7f0a59e00640 1 -- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a300686e0 msgr2=0x7f0a3006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.881+0000 7f0a59e00640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a300686e0 0x7f0a3006aba0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0a44001770 tx=0x7f0a44009040 comp rx=0 tx=0).stop 2024-05-30T06:45:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.881+0000 7f0a59e00640 1 -- 172.21.15.37:0/4157224153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a540ce8d0 msgr2=0x7f0a5415b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.881+0000 7f0a59e00640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a540ce8d0 0x7f0a5415b1a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00e930 tx=0x7f0a3c00edf0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.881+0000 7f0a59e00640 1 -- 172.21.15.37:0/4157224153 shutdown_connections 2024-05-30T06:45:42.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.881+0000 7f0a59e00640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a5415cd80 0x7f0a54143fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.881+0000 7f0a59e00640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a540ce8d0 0x7f0a5415b1a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.881+0000 7f0a59e00640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a300686e0 0x7f0a3006aba0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.881+0000 7f0a59e00640 1 --2- 172.21.15.37:0/4157224153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a5406e000 0x7f0a54139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:42.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.881+0000 7f0a59e00640 1 -- 172.21.15.37:0/4157224153 >> 172.21.15.37:0/4157224153 conn(0x7f0a540b23a0 msgr2=0x7f0a54159690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:42.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.881+0000 7f0a59e00640 1 -- 172.21.15.37:0/4157224153 shutdown_connections 2024-05-30T06:45:42.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:42.881+0000 7f0a59e00640 1 -- 172.21.15.37:0/4157224153 wait complete. 2024-05-30T06:45:42.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:45:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08c800640 1 Processor -- start 2024-05-30T06:45:43.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08c800640 1 -- start start 2024-05-30T06:45:43.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08c800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0840ce410 0x7fa0840b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08c800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa0840b5490 0x7fa0840af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08c800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0840cea10 con 0x7fa08415d3d0 2024-05-30T06:45:43.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08c800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa08406fc40 con 0x7fa0840b5490 2024-05-30T06:45:43.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08c800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa0840b3270 con 0x7fa0840ce410 2024-05-30T06:45:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08a800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa0840b5490 0x7fa0840af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa089400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0840ce410 0x7fa0840b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08a800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa0840b5490 0x7fa0840af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:53656/0 (socket says 172.21.15.37:53656) 2024-05-30T06:45:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08a800640 1 -- 172.21.15.37:0/195158734 learned_addr learned my addr 172.21.15.37:0/195158734 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08a800640 1 -- 172.21.15.37:0/195158734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0840ce410 msgr2=0x7fa0840b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08a800640 1 --2- 172.21.15.37:0/195158734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0840ce410 0x7fa0840b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08a800640 1 -- 172.21.15.37:0/195158734 >> v1:172.21.15.105:6789/0 conn(0x7fa08415d3d0 legacy=0x7fa084163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.041+0000 7fa08a800640 1 -- 172.21.15.37:0/195158734 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0840cecf0 con 0x7fa0840b5490 2024-05-30T06:45:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.045+0000 7fa08a800640 1 --2- 172.21.15.37:0/195158734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0840b5490 0x7fa0840af520 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa080009e50 tx=0x7fa08001ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6303de6699ee6af0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.045+0000 7fa088a00640 1 -- 172.21.15.37:0/195158734 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0800a5700 con 0x7fa0840b5490 2024-05-30T06:45:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.045+0000 7fa088a00640 1 -- 172.21.15.37:0/195158734 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0800a58a0 con 0x7fa0840b5490 2024-05-30T06:45:43.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.045+0000 7fa088a00640 1 -- 172.21.15.37:0/195158734 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0800a5c70 con 0x7fa0840b5490 2024-05-30T06:45:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.045+0000 7fa08c800640 1 -- 172.21.15.37:0/195158734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0840b5490 msgr2=0x7fa0840af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.045+0000 7fa08c800640 1 --2- 172.21.15.37:0/195158734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0840b5490 0x7fa0840af520 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa080009e50 tx=0x7fa08001ca30 comp rx=0 tx=0).stop 2024-05-30T06:45:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.045+0000 7fa08c800640 1 -- 172.21.15.37:0/195158734 shutdown_connections 2024-05-30T06:45:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.045+0000 7fa08c800640 1 --2- 172.21.15.37:0/195158734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0840b5490 0x7fa0840af520 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.045+0000 7fa08c800640 1 --2- 172.21.15.37:0/195158734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0840ce410 0x7fa0840b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.045+0000 7fa08c800640 1 -- 172.21.15.37:0/195158734 >> 172.21.15.37:0/195158734 conn(0x7fa0840b23a0 msgr2=0x7fa0840b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.045+0000 7fa08c800640 1 -- 172.21.15.37:0/195158734 shutdown_connections 2024-05-30T06:45:43.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.045+0000 7fa08c800640 1 -- 172.21.15.37:0/195158734 wait complete. 2024-05-30T06:45:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa08c800640 1 Processor -- start 2024-05-30T06:45:43.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa08c800640 1 -- start start 2024-05-30T06:45:43.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa08c800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0840b5490 0x7fa084148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa08c800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0840ce410 0x7fa08414e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa08c800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa08415d3d0 0x7fa08414ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa08c800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa0840b3710 con 0x7fa0840ce410 2024-05-30T06:45:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa08c800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa0840cf620 con 0x7fa0840b5490 2024-05-30T06:45:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa08c800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa0840b3890 con 0x7fa08415d3d0 2024-05-30T06:45:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa089400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0840ce410 0x7fa08414e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa089400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0840ce410 0x7fa08414e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55730/0 (socket says 172.21.15.37:55730) 2024-05-30T06:45:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa089400640 1 -- 172.21.15.37:0/3375917619 learned_addr learned my addr 172.21.15.37:0/3375917619 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa08a800640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa08415d3d0 0x7fa08414ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa089e00640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0840b5490 0x7fa084148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa089400640 1 -- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa08415d3d0 msgr2=0x7fa08414ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa089400640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa08415d3d0 0x7fa08414ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa089400640 1 -- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0840b5490 msgr2=0x7fa084148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa089400640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0840b5490 0x7fa084148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa089400640 1 -- 172.21.15.37:0/3375917619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08414d720 con 0x7fa0840ce410 2024-05-30T06:45:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa089400640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0840ce410 0x7fa08414e720 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa07400e960 tx=0x7fa07400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa07e000640 1 -- 172.21.15.37:0/3375917619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa074017070 con 0x7fa0840ce410 2024-05-30T06:45:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa07e000640 1 -- 172.21.15.37:0/3375917619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07400ca00 con 0x7fa0840ce410 2024-05-30T06:45:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa07e000640 1 -- 172.21.15.37:0/3375917619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07400cdb0 con 0x7fa0840ce410 2024-05-30T06:45:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa08c800640 1 -- 172.21.15.37:0/3375917619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08414da00 con 0x7fa0840ce410 2024-05-30T06:45:43.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.049+0000 7fa08c800640 1 -- 172.21.15.37:0/3375917619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa084149b30 con 0x7fa0840ce410 2024-05-30T06:45:43.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.053+0000 7fa08c800640 1 -- 172.21.15.37:0/3375917619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa084068b20 con 0x7fa0840ce410 2024-05-30T06:45:43.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.053+0000 7fa07e000640 1 -- 172.21.15.37:0/3375917619 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fa07401a070 con 0x7fa0840ce410 2024-05-30T06:45:43.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.053+0000 7fa07e000640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa0680686e0 0x7fa06806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.053+0000 7fa07e000640 1 -- 172.21.15.37:0/3375917619 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7fa074086ea0 con 0x7fa0840ce410 2024-05-30T06:45:43.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.053+0000 7fa089e00640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa0680686e0 0x7fa06806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.053+0000 7fa089e00640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa0680686e0 0x7fa06806aba0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa0780015b0 tx=0x7fa078009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:43.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.057+0000 7fa07e000640 1 -- 172.21.15.37:0/3375917619 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa074056da0 con 0x7fa0840ce410 2024-05-30T06:45:43.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.221+0000 7fa08c800640 1 -- 172.21.15.37:0/3375917619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0840af7e0 con 0x7fa0840ce410 2024-05-30T06:45:43.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.221+0000 7fa07e000640 1 -- 172.21.15.37:0/3375917619 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+12879 (secure 0 0 0) 0x7fa07405b0a0 con 0x7fa0840ce410 2024-05-30T06:45:43.224 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:43.224 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":42,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:45:42.481957+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:45:43.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.225+0000 7fa08c800640 1 -- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa0680686e0 msgr2=0x7fa06806aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.225+0000 7fa08c800640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa0680686e0 0x7fa06806aba0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa0780015b0 tx=0x7fa078009040 comp rx=0 tx=0).stop 2024-05-30T06:45:43.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.225+0000 7fa08c800640 1 -- 172.21.15.37:0/3375917619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0840ce410 msgr2=0x7fa08414e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.225+0000 7fa08c800640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0840ce410 0x7fa08414e720 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa07400e960 tx=0x7fa07400ee20 comp rx=0 tx=0).stop 2024-05-30T06:45:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.225+0000 7fa08c800640 1 -- 172.21.15.37:0/3375917619 shutdown_connections 2024-05-30T06:45:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.225+0000 7fa08c800640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa08415d3d0 0x7fa08414ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.225+0000 7fa08c800640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0840ce410 0x7fa08414e720 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.225+0000 7fa08c800640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa0680686e0 0x7fa06806aba0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.225+0000 7fa08c800640 1 --2- 172.21.15.37:0/3375917619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0840b5490 0x7fa084148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.225+0000 7fa08c800640 1 -- 172.21.15.37:0/3375917619 >> 172.21.15.37:0/3375917619 conn(0x7fa0840b23a0 msgr2=0x7fa0840b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.225+0000 7fa08c800640 1 -- 172.21.15.37:0/3375917619 shutdown_connections 2024-05-30T06:45:43.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.225+0000 7fa08c800640 1 -- 172.21.15.37:0/3375917619 wait complete. 2024-05-30T06:45:43.246 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:45:43.246 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:45:43.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.389+0000 7f0ed2800640 1 Processor -- start 2024-05-30T06:45:43.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.389+0000 7f0ed2800640 1 -- start start 2024-05-30T06:45:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.389+0000 7f0ed2800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ecc15d350 0x7f0ecc06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.389+0000 7f0ed2800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ecc15d7e0 0x7f0ecc06e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.389+0000 7f0ed2800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ecc142030 con 0x7f0ecc0b59d0 2024-05-30T06:45:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.389+0000 7f0ed2800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0ecc142310 con 0x7f0ecc15d350 2024-05-30T06:45:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.389+0000 7f0ed2800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0ecc1425f0 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.393+0000 7f0ec3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ecc15d350 0x7f0ecc06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.393+0000 7f0ec3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ecc15d350 0x7f0ecc06df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55740/0 (socket says 172.21.15.37:55740) 2024-05-30T06:45:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.393+0000 7f0ec3e00640 1 -- 172.21.15.37:0/1143391450 learned_addr learned my addr 172.21.15.37:0/1143391450 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.393+0000 7f0ecbe00640 1 --2- 172.21.15.37:0/1143391450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ecc15d7e0 0x7f0ecc06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.393+0000 7f0ec3e00640 1 -- 172.21.15.37:0/1143391450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ecc15d7e0 msgr2=0x7f0ecc06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.393+0000 7f0ec3e00640 1 --2- 172.21.15.37:0/1143391450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ecc15d7e0 0x7f0ecc06e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.393+0000 7f0ec3e00640 1 -- 172.21.15.37:0/1143391450 >> v1:172.21.15.37:6789/0 conn(0x7f0ecc0b59d0 legacy=0x7f0ecc0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.393+0000 7f0ec3e00640 1 -- 172.21.15.37:0/1143391450 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc1428d0 con 0x7f0ecc15d350 2024-05-30T06:45:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.393+0000 7f0ec3e00640 1 --2- 172.21.15.37:0/1143391450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc15d350 0x7f0ecc06df50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40098a0 tx=0x7f0eb401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d74997dae727b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.393+0000 7f0ecaa00640 1 -- 172.21.15.37:0/1143391450 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40b5070 con 0x7f0ecc15d350 2024-05-30T06:45:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.393+0000 7f0ecaa00640 1 -- 172.21.15.37:0/1143391450 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb40a8a30 con 0x7f0ecc15d350 2024-05-30T06:45:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.393+0000 7f0ecaa00640 1 -- 172.21.15.37:0/1143391450 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40a8e00 con 0x7f0ecc15d350 2024-05-30T06:45:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 -- 172.21.15.37:0/1143391450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc15d350 msgr2=0x7f0ecc06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 --2- 172.21.15.37:0/1143391450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc15d350 0x7f0ecc06df50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40098a0 tx=0x7f0eb401ed30 comp rx=0 tx=0).stop 2024-05-30T06:45:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 -- 172.21.15.37:0/1143391450 shutdown_connections 2024-05-30T06:45:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 --2- 172.21.15.37:0/1143391450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ecc15d7e0 0x7f0ecc06e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 --2- 172.21.15.37:0/1143391450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc15d350 0x7f0ecc06df50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 -- 172.21.15.37:0/1143391450 >> 172.21.15.37:0/1143391450 conn(0x7f0ecc06bf60 msgr2=0x7f0ecc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 -- 172.21.15.37:0/1143391450 shutdown_connections 2024-05-30T06:45:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 -- 172.21.15.37:0/1143391450 wait complete. 2024-05-30T06:45:43.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 Processor -- start 2024-05-30T06:45:43.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 -- start start 2024-05-30T06:45:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ecc0b59d0 0x7f0ecc154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ecc15d350 0x7f0ecc13efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc15d7e0 0x7f0ecc0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc0b00a0 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ecc0aff20 con 0x7f0ecc15d350 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ed2800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0ecc13f860 con 0x7f0ecc0b59d0 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ecbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc15d7e0 0x7f0ecc0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ecbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc15d7e0 0x7f0ecc0b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55752/0 (socket says 172.21.15.37:55752) 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ecbe00640 1 -- 172.21.15.37:0/2564674476 learned_addr learned my addr 172.21.15.37:0/2564674476 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ec3e00640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ecc15d350 0x7f0ecc13efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ecb400640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ecc0b59d0 0x7f0ecc154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ecbe00640 1 -- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ecc0b59d0 msgr2=0x7f0ecc154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ecbe00640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ecc0b59d0 0x7f0ecc154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ecbe00640 1 -- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ecc15d350 msgr2=0x7f0ecc13efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ecbe00640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ecc15d350 0x7f0ecc13efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.397+0000 7f0ecbe00640 1 -- 172.21.15.37:0/2564674476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ecc153ea0 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.401+0000 7f0ecbe00640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc15d7e0 0x7f0ecc0b4570 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4007e40 tx=0x7f0ec400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.401+0000 7f0ec3400640 1 -- 172.21.15.37:0/2564674476 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4014620 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.401+0000 7f0ec3400640 1 -- 172.21.15.37:0/2564674476 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec4019070 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.401+0000 7f0ec3400640 1 -- 172.21.15.37:0/2564674476 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4014a20 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.401+0000 7f0ed2800640 1 -- 172.21.15.37:0/2564674476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ecc154180 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.401+0000 7f0ed2800640 1 -- 172.21.15.37:0/2564674476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ecc0b5040 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.401+0000 7f0ed2800640 1 -- 172.21.15.37:0/2564674476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ecc068bc0 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.401+0000 7f0ec3400640 1 -- 172.21.15.37:0/2564674476 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f0ec4014bc0 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.401+0000 7f0ec3400640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ea8068650 0x7f0ea806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.401+0000 7f0ec3400640 1 -- 172.21.15.37:0/2564674476 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f0ec40873a0 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.401+0000 7f0ecb400640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ea8068650 0x7f0ea806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.405+0000 7f0ecb400640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ea8068650 0x7f0ea806ab10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0015b0 tx=0x7f0ebc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:43.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.405+0000 7f0ec3400640 1 -- 172.21.15.37:0/2564674476 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0ec4057910 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.573+0000 7f0ed2800640 1 -- 172.21.15.37:0/2564674476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0ecc0b2130 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.573+0000 7f0ec3400640 1 -- 172.21.15.37:0/2564674476 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7f0ec4057210 con 0x7f0ecc15d7e0 2024-05-30T06:45:43.574 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:45:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.573+0000 7f0ed2800640 1 -- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ea8068650 msgr2=0x7f0ea806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.573+0000 7f0ed2800640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ea8068650 0x7f0ea806ab10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc0015b0 tx=0x7f0ebc009040 comp rx=0 tx=0).stop 2024-05-30T06:45:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.573+0000 7f0ed2800640 1 -- 172.21.15.37:0/2564674476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc15d7e0 msgr2=0x7f0ecc0b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.573+0000 7f0ed2800640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc15d7e0 0x7f0ecc0b4570 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4007e40 tx=0x7f0ec400e4b0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.573+0000 7f0ed2800640 1 -- 172.21.15.37:0/2564674476 shutdown_connections 2024-05-30T06:45:43.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.573+0000 7f0ed2800640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ecc15d7e0 0x7f0ecc0b4570 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.573+0000 7f0ed2800640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ea8068650 0x7f0ea806ab10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.573+0000 7f0ed2800640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ecc15d350 0x7f0ecc13efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.573+0000 7f0ed2800640 1 --2- 172.21.15.37:0/2564674476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ecc0b59d0 0x7f0ecc154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.573+0000 7f0ed2800640 1 -- 172.21.15.37:0/2564674476 >> 172.21.15.37:0/2564674476 conn(0x7f0ecc06bf60 msgr2=0x7f0ecc0af030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:43.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.573+0000 7f0ed2800640 1 -- 172.21.15.37:0/2564674476 shutdown_connections 2024-05-30T06:45:43.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.577+0000 7f0ed2800640 1 -- 172.21.15.37:0/2564674476 wait complete. 2024-05-30T06:45:43.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T06:45:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101f800640 1 Processor -- start 2024-05-30T06:45:43.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101f800640 1 -- start start 2024-05-30T06:45:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101f800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f101806e000 0x7f10180ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101f800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f10180cee10 0x7f101806f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101f800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10180cd120 con 0x7f101815cd80 2024-05-30T06:45:43.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101f800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f10180a9530 con 0x7f101806e000 2024-05-30T06:45:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101f800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f10180cd400 con 0x7f10180cee10 2024-05-30T06:45:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101ce00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f101806e000 0x7f10180ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101ce00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f101806e000 0x7f10180ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55754/0 (socket says 172.21.15.37:55754) 2024-05-30T06:45:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101ce00640 1 -- 172.21.15.37:0/3870435551 learned_addr learned my addr 172.21.15.37:0/3870435551 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101d800640 1 --2- 172.21.15.37:0/3870435551 >> v2:172.21.15.105:3300/0 conn(0x7f10180cee10 0x7f101806f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101ce00640 1 -- 172.21.15.37:0/3870435551 >> v2:172.21.15.105:3300/0 conn(0x7f10180cee10 msgr2=0x7f101806f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101ce00640 1 --2- 172.21.15.37:0/3870435551 >> v2:172.21.15.105:3300/0 conn(0x7f10180cee10 0x7f101806f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101ce00640 1 -- 172.21.15.37:0/3870435551 >> v1:172.21.15.105:6789/0 conn(0x7f101815cd80 legacy=0x7f10180ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:43.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.737+0000 7f101ce00640 1 -- 172.21.15.37:0/3870435551 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10180cd6e0 con 0x7f101806e000 2024-05-30T06:45:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.741+0000 7f101ce00640 1 --2- 172.21.15.37:0/3870435551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101806e000 0x7f10180ce1c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f101806c7b0 tx=0x7f100801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1746c5b3f1d9cb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.741+0000 7f1017e00640 1 -- 172.21.15.37:0/3870435551 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10080b5070 con 0x7f101806e000 2024-05-30T06:45:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.741+0000 7f1017e00640 1 -- 172.21.15.37:0/3870435551 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10080a89d0 con 0x7f101806e000 2024-05-30T06:45:43.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.741+0000 7f1017e00640 1 -- 172.21.15.37:0/3870435551 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10080a8da0 con 0x7f101806e000 2024-05-30T06:45:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.741+0000 7f101f800640 1 -- 172.21.15.37:0/3870435551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101806e000 msgr2=0x7f10180ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.741+0000 7f101f800640 1 --2- 172.21.15.37:0/3870435551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101806e000 0x7f10180ce1c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f101806c7b0 tx=0x7f100801ecd0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.741+0000 7f101f800640 1 -- 172.21.15.37:0/3870435551 shutdown_connections 2024-05-30T06:45:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.741+0000 7f101f800640 1 --2- 172.21.15.37:0/3870435551 >> v2:172.21.15.105:3300/0 conn(0x7f10180cee10 0x7f101806f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.741+0000 7f101f800640 1 --2- 172.21.15.37:0/3870435551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101806e000 0x7f10180ce1c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.741+0000 7f101f800640 1 -- 172.21.15.37:0/3870435551 >> 172.21.15.37:0/3870435551 conn(0x7f10180b23a0 msgr2=0x7f10180b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:43.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.741+0000 7f101f800640 1 -- 172.21.15.37:0/3870435551 shutdown_connections 2024-05-30T06:45:43.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.741+0000 7f101f800640 1 -- 172.21.15.37:0/3870435551 wait complete. 2024-05-30T06:45:43.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101f800640 1 Processor -- start 2024-05-30T06:45:43.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101f800640 1 -- start start 2024-05-30T06:45:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101f800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f101806e000 0x7f10180b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101f800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10180cee10 0x7f10181f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101f800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101815cd80 0x7f1018140a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101f800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f101806f930 con 0x7f101815cd80 2024-05-30T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101f800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f10180cdca0 con 0x7f10180cee10 2024-05-30T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101f800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f101806fab0 con 0x7f101806e000 2024-05-30T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101815cd80 0x7f1018140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101815cd80 0x7f1018140a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55760/0 (socket says 172.21.15.37:55760) 2024-05-30T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101d800640 1 -- 172.21.15.37:0/3132707930 learned_addr learned my addr 172.21.15.37:0/3132707930 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f100fe00640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10180cee10 0x7f10181f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101ce00640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f101806e000 0x7f10180b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101d800640 1 -- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f101806e000 msgr2=0x7f10180b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101d800640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f101806e000 0x7f10180b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101d800640 1 -- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10180cee10 msgr2=0x7f10181f7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101d800640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10180cee10 0x7f10181f7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101d800640 1 -- 172.21.15.37:0/3132707930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10180b46f0 con 0x7f101815cd80 2024-05-30T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101d800640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101815cd80 0x7f1018140a50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1010007e40 tx=0x7f101000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f1015600640 1 -- 172.21.15.37:0/3132707930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1010014620 con 0x7f101815cd80 2024-05-30T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f1015600640 1 -- 172.21.15.37:0/3132707930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1010019070 con 0x7f101815cd80 2024-05-30T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101f800640 1 -- 172.21.15.37:0/3132707930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1018157420 con 0x7f101815cd80 2024-05-30T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f1015600640 1 -- 172.21.15.37:0/3132707930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1010014a20 con 0x7f101815cd80 2024-05-30T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101f800640 1 -- 172.21.15.37:0/3132707930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10181579e0 con 0x7f101815cd80 2024-05-30T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.745+0000 7f101f800640 1 -- 172.21.15.37:0/3132707930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1018068b20 con 0x7f101815cd80 2024-05-30T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.749+0000 7f1015600640 1 -- 172.21.15.37:0/3132707930 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f1010014bc0 con 0x7f101815cd80 2024-05-30T06:45:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.749+0000 7f1015600640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ff4068710 0x7f0ff406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.749+0000 7f1015600640 1 -- 172.21.15.37:0/3132707930 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f1010087470 con 0x7f101815cd80 2024-05-30T06:45:43.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.749+0000 7f101ce00640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ff4068710 0x7f0ff406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:43.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.749+0000 7f101ce00640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ff4068710 0x7f0ff406abd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f10080b2000 tx=0x7f1008008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:43.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.753+0000 7f1015600640 1 -- 172.21.15.37:0/3132707930 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1010057950 con 0x7f101815cd80 2024-05-30T06:45:43.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f101f800640 1 -- 172.21.15.37:0/3132707930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1018142870 con 0x7f101815cd80 2024-05-30T06:45:43.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f1015600640 1 -- 172.21.15.37:0/3132707930 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) ==== 84+0+65 (secure 0 0 0) 0x7f1010057250 con 0x7f101815cd80 2024-05-30T06:45:43.921 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:43.922 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:45:43.922 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:43.922 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-30T06:45:43.922 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-30T06:45:43.922 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:43.922 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:45:43.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f101f800640 1 -- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ff4068710 msgr2=0x7f0ff406abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f101f800640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ff4068710 0x7f0ff406abd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f10080b2000 tx=0x7f1008008040 comp rx=0 tx=0).stop 2024-05-30T06:45:43.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f101f800640 1 -- 172.21.15.37:0/3132707930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101815cd80 msgr2=0x7f1018140a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:43.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f101f800640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101815cd80 0x7f1018140a50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1010007e40 tx=0x7f101000e4b0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f101f800640 1 -- 172.21.15.37:0/3132707930 shutdown_connections 2024-05-30T06:45:43.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f101f800640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f101815cd80 0x7f1018140a50 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f101f800640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ff4068710 0x7f0ff406abd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f101f800640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10180cee10 0x7f10181f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f101f800640 1 --2- 172.21.15.37:0/3132707930 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f101806e000 0x7f10180b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:43.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f101f800640 1 -- 172.21.15.37:0/3132707930 >> 172.21.15.37:0/3132707930 conn(0x7f10180b23a0 msgr2=0x7f1018141fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:43.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f101f800640 1 -- 172.21.15.37:0/3132707930 shutdown_connections 2024-05-30T06:45:43.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:43.921+0000 7f101f800640 1 -- 172.21.15.37:0/3132707930 wait complete. 2024-05-30T06:45:43.944 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T06:45:43.944 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T06:45:44.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e6c000640 1 Processor -- start 2024-05-30T06:45:44.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e6c000640 1 -- start start 2024-05-30T06:45:44.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e6c000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e640b60e0 0x7f7e6406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:44.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e6c000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7e6415cdd0 0x7f7e6415d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:44.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e6c000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e6415db00 con 0x7f7e640ced10 2024-05-30T06:45:44.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e6c000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7e6406df50 con 0x7f7e6415cdd0 2024-05-30T06:45:44.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e6c000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6406e7d0 con 0x7f7e640b60e0 2024-05-30T06:45:44.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e69600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7e640ced10 0x7f7e640b59d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33310/0 (socket says 172.21.15.37:33310) 2024-05-30T06:45:44.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e69600640 1 -- 172.21.15.37:0/2383506076 learned_addr learned my addr 172.21.15.37:0/2383506076 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:44.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e68c00640 1 --2- 172.21.15.37:0/2383506076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e640b60e0 0x7f7e6406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:44.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e6a000640 1 --2- 172.21.15.37:0/2383506076 >> v2:172.21.15.105:3300/0 conn(0x7f7e6415cdd0 0x7f7e6415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:44.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e63e00640 1 -- 172.21.15.37:0/2383506076 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1580960074 0 0) 0x7f7e6415db00 con 0x7f7e640ced10 2024-05-30T06:45:44.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e63e00640 1 -- 172.21.15.37:0/2383506076 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e4c003530 con 0x7f7e640ced10 2024-05-30T06:45:44.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e68c00640 1 -- 172.21.15.37:0/2383506076 >> v2:172.21.15.105:3300/0 conn(0x7f7e6415cdd0 msgr2=0x7f7e6415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e68c00640 1 --2- 172.21.15.37:0/2383506076 >> v2:172.21.15.105:3300/0 conn(0x7f7e6415cdd0 0x7f7e6415d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e68c00640 1 -- 172.21.15.37:0/2383506076 >> v1:172.21.15.37:6789/0 conn(0x7f7e640ced10 legacy=0x7f7e640b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e68c00640 1 -- 172.21.15.37:0/2383506076 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6406e180 con 0x7f7e640b60e0 2024-05-30T06:45:44.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.089+0000 7f7e6a000640 1 --2- 172.21.15.37:0/2383506076 >> v2:172.21.15.105:3300/0 conn(0x7f7e6415cdd0 0x7f7e6415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:44.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.093+0000 7f7e68c00640 1 --2- 172.21.15.37:0/2383506076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e640b60e0 0x7f7e6406ec60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7e500097c0 tx=0x7f7e5001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70949e899817ebf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:44.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.093+0000 7f7e63e00640 1 -- 172.21.15.37:0/2383506076 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e500aa5f0 con 0x7f7e640b60e0 2024-05-30T06:45:44.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.093+0000 7f7e63e00640 1 -- 172.21.15.37:0/2383506076 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e500af070 con 0x7f7e640b60e0 2024-05-30T06:45:44.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.093+0000 7f7e63e00640 1 -- 172.21.15.37:0/2383506076 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e500aa9b0 con 0x7f7e640b60e0 2024-05-30T06:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.093+0000 7f7e6c000640 1 -- 172.21.15.37:0/2383506076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e640b60e0 msgr2=0x7f7e6406ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.093+0000 7f7e6c000640 1 --2- 172.21.15.37:0/2383506076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e640b60e0 0x7f7e6406ec60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7e500097c0 tx=0x7f7e5001c470 comp rx=0 tx=0).stop 2024-05-30T06:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.093+0000 7f7e6c000640 1 -- 172.21.15.37:0/2383506076 shutdown_connections 2024-05-30T06:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.093+0000 7f7e6c000640 1 --2- 172.21.15.37:0/2383506076 >> v2:172.21.15.105:3300/0 conn(0x7f7e6415cdd0 0x7f7e6415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.093+0000 7f7e6c000640 1 --2- 172.21.15.37:0/2383506076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e640b60e0 0x7f7e6406ec60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.093+0000 7f7e6c000640 1 -- 172.21.15.37:0/2383506076 >> 172.21.15.37:0/2383506076 conn(0x7f7e6406bf60 msgr2=0x7f7e640b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.093+0000 7f7e6c000640 1 -- 172.21.15.37:0/2383506076 shutdown_connections 2024-05-30T06:45:44.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.093+0000 7f7e6c000640 1 -- 172.21.15.37:0/2383506076 wait complete. 2024-05-30T06:45:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6c000640 1 Processor -- start 2024-05-30T06:45:44.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6c000640 1 -- start start 2024-05-30T06:45:44.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6c000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e640b60e0 0x7f7e64144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:44.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6c000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e640ced10 0x7f7e64162f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:44.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6c000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e6415cdd0 0x7f7e641658d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:44.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6c000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6415e840 con 0x7f7e6415cdd0 2024-05-30T06:45:44.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6c000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e6415e6c0 con 0x7f7e640ced10 2024-05-30T06:45:44.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6c000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6415e9c0 con 0x7f7e640b60e0 2024-05-30T06:45:44.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e6415cdd0 0x7f7e641658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:44.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e6415cdd0 0x7f7e641658d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55770/0 (socket says 172.21.15.37:55770) 2024-05-30T06:45:44.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6a000640 1 -- 172.21.15.37:0/521802854 learned_addr learned my addr 172.21.15.37:0/521802854 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:44.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e69600640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e640b60e0 0x7f7e64144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:44.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e68c00640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e640ced10 0x7f7e64162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:44.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6a000640 1 -- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e640b60e0 msgr2=0x7f7e64144be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:44.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6a000640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e640b60e0 0x7f7e64144be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6a000640 1 -- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e640ced10 msgr2=0x7f7e64162f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:44.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6a000640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e640ced10 0x7f7e64162f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6a000640 1 -- 172.21.15.37:0/521802854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e641647c0 con 0x7f7e6415cdd0 2024-05-30T06:45:44.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6a000640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e6415cdd0 0x7f7e641658d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00efc0 tx=0x7f7e5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:44.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e61600640 1 -- 172.21.15.37:0/521802854 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c018030 con 0x7f7e6415cdd0 2024-05-30T06:45:44.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e61600640 1 -- 172.21.15.37:0/521802854 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e5c00cdf0 con 0x7f7e6415cdd0 2024-05-30T06:45:44.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e61600640 1 -- 172.21.15.37:0/521802854 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c003bc0 con 0x7f7e6415cdd0 2024-05-30T06:45:44.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6c000640 1 -- 172.21.15.37:0/521802854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e64164aa0 con 0x7f7e6415cdd0 2024-05-30T06:45:44.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.097+0000 7f7e6c000640 1 -- 172.21.15.37:0/521802854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e64165060 con 0x7f7e6415cdd0 2024-05-30T06:45:44.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.101+0000 7f7e6c000640 1 -- 172.21.15.37:0/521802854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e64068d40 con 0x7f7e6415cdd0 2024-05-30T06:45:44.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.101+0000 7f7e61600640 1 -- 172.21.15.37:0/521802854 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f7e5c01b070 con 0x7f7e6415cdd0 2024-05-30T06:45:44.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.101+0000 7f7e61600640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7e440686e0 0x7f7e4406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:44.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.101+0000 7f7e61600640 1 -- 172.21.15.37:0/521802854 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f7e5c0876a0 con 0x7f7e6415cdd0 2024-05-30T06:45:44.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.101+0000 7f7e69600640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7e440686e0 0x7f7e4406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:44.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.101+0000 7f7e69600640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7e440686e0 0x7f7e4406aba0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7e58005890 tx=0x7f7e58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:44.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.105+0000 7f7e61600640 1 -- 172.21.15.37:0/521802854 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7e5c010040 con 0x7f7e6415cdd0 2024-05-30T06:45:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.269+0000 7f7e6c000640 1 -- 172.21.15.37:0/521802854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7e6406cfa0 con 0x7f7e6415cdd0 2024-05-30T06:45:44.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.485+0000 7f7e61600640 1 -- 172.21.15.37:0/521802854 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) ==== 138+0+0 (secure 0 0 0) 0x7f7e5c057400 con 0x7f7e6415cdd0 2024-05-30T06:45:44.487 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-30T06:45:44.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.489+0000 7f7e6c000640 1 -- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7e440686e0 msgr2=0x7f7e4406aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:44.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.489+0000 7f7e6c000640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7e440686e0 0x7f7e4406aba0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7e58005890 tx=0x7f7e58009040 comp rx=0 tx=0).stop 2024-05-30T06:45:44.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.489+0000 7f7e6c000640 1 -- 172.21.15.37:0/521802854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e6415cdd0 msgr2=0x7f7e641658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:44.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.489+0000 7f7e6c000640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e6415cdd0 0x7f7e641658d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00efc0 tx=0x7f7e5c00c490 comp rx=0 tx=0).stop 2024-05-30T06:45:44.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.489+0000 7f7e6c000640 1 -- 172.21.15.37:0/521802854 shutdown_connections 2024-05-30T06:45:44.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.489+0000 7f7e6c000640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e6415cdd0 0x7f7e641658d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.489+0000 7f7e6c000640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7e440686e0 0x7f7e4406aba0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.489+0000 7f7e6c000640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e640ced10 0x7f7e64162f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.489+0000 7f7e6c000640 1 --2- 172.21.15.37:0/521802854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e640b60e0 0x7f7e64144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.489+0000 7f7e6c000640 1 -- 172.21.15.37:0/521802854 >> 172.21.15.37:0/521802854 conn(0x7f7e6406bf60 msgr2=0x7f7e6406eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:44.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.489+0000 7f7e6c000640 1 -- 172.21.15.37:0/521802854 shutdown_connections 2024-05-30T06:45:44.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.489+0000 7f7e6c000640 1 -- 172.21.15.37:0/521802854 wait complete. 2024-05-30T06:45:44.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T06:45:44.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1664200640 1 Processor -- start 2024-05-30T06:45:44.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1664200640 1 -- start start 2024-05-30T06:45:44.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1664200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f165c0b59d0 0x7f165c0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:44.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1664200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f165c15d350 0x7f165c160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:44.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1664200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165c0b62f0 con 0x7f165c15d7b0 2024-05-30T06:45:44.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1664200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f165c142030 con 0x7f165c15d350 2024-05-30T06:45:44.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1664200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f165c142310 con 0x7f165c0b59d0 2024-05-30T06:45:44.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1660e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f165c15d350 0x7f165c160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:44.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1661800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f165c0b59d0 0x7f165c0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:44.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1660e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f165c15d350 0x7f165c160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:53710/0 (socket says 172.21.15.37:53710) 2024-05-30T06:45:44.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1660e00640 1 -- 172.21.15.37:0/945961997 learned_addr learned my addr 172.21.15.37:0/945961997 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:44.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1662200640 1 --1- 172.21.15.37:0/945961997 >> v1:172.21.15.105:6789/0 conn(0x7f165c15d7b0 0x7f165c1607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:59816/0 (socket says 172.21.15.37:59816) 2024-05-30T06:45:44.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f165be00640 1 -- 172.21.15.37:0/945961997 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3309267961 0 0) 0x7f165c0b62f0 con 0x7f165c15d7b0 2024-05-30T06:45:44.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f165be00640 1 -- 172.21.15.37:0/945961997 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1644003530 con 0x7f165c15d7b0 2024-05-30T06:45:44.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1660e00640 1 -- 172.21.15.37:0/945961997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f165c0b59d0 msgr2=0x7f165c0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:44.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1660e00640 1 --2- 172.21.15.37:0/945961997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f165c0b59d0 0x7f165c0b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1660e00640 1 -- 172.21.15.37:0/945961997 >> v1:172.21.15.105:6789/0 conn(0x7f165c15d7b0 legacy=0x7f165c1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:44.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1660e00640 1 -- 172.21.15.37:0/945961997 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c1425f0 con 0x7f165c15d350 2024-05-30T06:45:44.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.661+0000 7f1661800640 1 --2- 172.21.15.37:0/945961997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f165c0b59d0 0x7f165c0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:44.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.665+0000 7f1660e00640 1 --2- 172.21.15.37:0/945961997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f165c15d350 0x7f165c160280 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1648009870 tx=0x7f164801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55cd421c562b1059 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:44.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.665+0000 7f165be00640 1 -- 172.21.15.37:0/945961997 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16480b5070 con 0x7f165c15d350 2024-05-30T06:45:44.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.665+0000 7f165be00640 1 -- 172.21.15.37:0/945961997 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16480a8a50 con 0x7f165c15d350 2024-05-30T06:45:44.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.665+0000 7f165be00640 1 -- 172.21.15.37:0/945961997 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16480a8e20 con 0x7f165c15d350 2024-05-30T06:45:44.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.665+0000 7f1664200640 1 -- 172.21.15.37:0/945961997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f165c15d350 msgr2=0x7f165c160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:44.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.665+0000 7f1664200640 1 --2- 172.21.15.37:0/945961997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f165c15d350 0x7f165c160280 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1648009870 tx=0x7f164801ed50 comp rx=0 tx=0).stop 2024-05-30T06:45:44.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.665+0000 7f1664200640 1 -- 172.21.15.37:0/945961997 shutdown_connections 2024-05-30T06:45:44.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.665+0000 7f1664200640 1 --2- 172.21.15.37:0/945961997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f165c15d350 0x7f165c160280 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.665+0000 7f1664200640 1 --2- 172.21.15.37:0/945961997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f165c0b59d0 0x7f165c0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.665+0000 7f1664200640 1 -- 172.21.15.37:0/945961997 >> 172.21.15.37:0/945961997 conn(0x7f165c06bf60 msgr2=0x7f165c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:44.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.665+0000 7f1664200640 1 -- 172.21.15.37:0/945961997 shutdown_connections 2024-05-30T06:45:44.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.665+0000 7f1664200640 1 -- 172.21.15.37:0/945961997 wait complete. 2024-05-30T06:45:44.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1664200640 1 Processor -- start 2024-05-30T06:45:44.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1664200640 1 -- start start 2024-05-30T06:45:44.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1664200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165c0b59d0 0x7f165c1f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:44.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1664200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f165c15d350 0x7f165c15f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:44.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1664200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f165c15d7b0 0x7f165c157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:44.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1664200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f165c13fe60 con 0x7f165c0b59d0 2024-05-30T06:45:44.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1664200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f165c13fce0 con 0x7f165c15d7b0 2024-05-30T06:45:44.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1664200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f165c0aff20 con 0x7f165c15d350 2024-05-30T06:45:44.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1661800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165c0b59d0 0x7f165c1f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:44.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1661800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165c0b59d0 0x7f165c1f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55780/0 (socket says 172.21.15.37:55780) 2024-05-30T06:45:44.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1661800640 1 -- 172.21.15.37:0/2037892285 learned_addr learned my addr 172.21.15.37:0/2037892285 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:44.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1662200640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f165c15d7b0 0x7f165c157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:44.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1660e00640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f165c15d350 0x7f165c15f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:44.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1661800640 1 -- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f165c15d350 msgr2=0x7f165c15f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:44.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1661800640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f165c15d350 0x7f165c15f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1661800640 1 -- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f165c15d7b0 msgr2=0x7f165c157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:44.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1661800640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f165c15d7b0 0x7f165c157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:44.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1661800640 1 -- 172.21.15.37:0/2037892285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c1f7f60 con 0x7f165c0b59d0 2024-05-30T06:45:44.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1662200640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f165c15d7b0 0x7f165c157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:44.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1661800640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165c0b59d0 0x7f165c1f7a20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f165000e980 tx=0x7f165000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:44.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1659600640 1 -- 172.21.15.37:0/2037892285 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1650017070 con 0x7f165c0b59d0 2024-05-30T06:45:44.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1659600640 1 -- 172.21.15.37:0/2037892285 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f165000ca00 con 0x7f165c0b59d0 2024-05-30T06:45:44.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1659600640 1 -- 172.21.15.37:0/2037892285 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165000cdd0 con 0x7f165c0b59d0 2024-05-30T06:45:44.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1664200640 1 -- 172.21.15.37:0/2037892285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f165c1f8210 con 0x7f165c0b59d0 2024-05-30T06:45:44.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.669+0000 7f1664200640 1 -- 172.21.15.37:0/2037892285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f165c1f87d0 con 0x7f165c0b59d0 2024-05-30T06:45:44.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.673+0000 7f1664200640 1 -- 172.21.15.37:0/2037892285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f165c068bc0 con 0x7f165c0b59d0 2024-05-30T06:45:44.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.673+0000 7f1659600640 1 -- 172.21.15.37:0/2037892285 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f165001a070 con 0x7f165c0b59d0 2024-05-30T06:45:44.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.673+0000 7f1659600640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f163c0686e0 0x7f163c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:44.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.673+0000 7f1659600640 1 -- 172.21.15.37:0/2037892285 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5227+0+0 (secure 0 0 0) 0x7f16500872b0 con 0x7f165c0b59d0 2024-05-30T06:45:44.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.673+0000 7f1660e00640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f163c0686e0 0x7f163c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:44.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.673+0000 7f1660e00640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f163c0686e0 0x7f163c06aba0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f16480b2000 tx=0x7f1648008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.677+0000 7f1659600640 1 -- 172.21.15.37:0/2037892285 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f16500570c0 con 0x7f165c0b59d0 2024-05-30T06:45:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:44.841+0000 7f1664200640 1 -- 172.21.15.37:0/2037892285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f165c06f0a0 con 0x7f165c0b59d0 2024-05-30T06:45:45.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.493+0000 7f1659600640 1 -- 172.21.15.37:0/2037892285 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) ==== 170+0+0 (secure 0 0 0) 0x7f165005b3c0 con 0x7f165c0b59d0 2024-05-30T06:45:45.494 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-30T06:45:45.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.497+0000 7f1664200640 1 -- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f163c0686e0 msgr2=0x7f163c06aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:45.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.497+0000 7f1664200640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f163c0686e0 0x7f163c06aba0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f16480b2000 tx=0x7f1648008040 comp rx=0 tx=0).stop 2024-05-30T06:45:45.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.497+0000 7f1664200640 1 -- 172.21.15.37:0/2037892285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165c0b59d0 msgr2=0x7f165c1f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:45.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.497+0000 7f1664200640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165c0b59d0 0x7f165c1f7a20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f165000e980 tx=0x7f165000ee40 comp rx=0 tx=0).stop 2024-05-30T06:45:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.497+0000 7f1664200640 1 -- 172.21.15.37:0/2037892285 shutdown_connections 2024-05-30T06:45:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.497+0000 7f1664200640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f163c0686e0 0x7f163c06aba0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.497+0000 7f1664200640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f165c15d7b0 0x7f165c157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.497+0000 7f1664200640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f165c15d350 0x7f165c15f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.497+0000 7f1664200640 1 --2- 172.21.15.37:0/2037892285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165c0b59d0 0x7f165c1f7a20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.497+0000 7f1664200640 1 -- 172.21.15.37:0/2037892285 >> 172.21.15.37:0/2037892285 conn(0x7f165c06bf60 msgr2=0x7f165c1409b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.497+0000 7f1664200640 1 -- 172.21.15.37:0/2037892285 shutdown_connections 2024-05-30T06:45:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.501+0000 7f1664200640 1 -- 172.21.15.37:0/2037892285 wait complete. 2024-05-30T06:45:45.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T06:45:45.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.685+0000 7f7fbde00640 1 Processor -- start 2024-05-30T06:45:45.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.685+0000 7f7fbde00640 1 -- start start 2024-05-30T06:45:45.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.689+0000 7f7fbde00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7fb80b59d0 0x7f7fb80b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:45.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.689+0000 7f7fbde00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb81610a0 con 0x7f7fb815d7e0 2024-05-30T06:45:45.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.689+0000 7f7fbde00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb80b62f0 con 0x7f7fb815d350 2024-05-30T06:45:45.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.689+0000 7f7fbde00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7fb8142030 con 0x7f7fb80b59d0 2024-05-30T06:45:45.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.689+0000 7f7fb6a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7fb80b59d0 0x7f7fb80b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:45.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.689+0000 7f7fb6a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7fb80b59d0 0x7f7fb80b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55786/0 (socket says 172.21.15.37:55786) 2024-05-30T06:45:45.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.689+0000 7f7fb6a00640 1 -- 172.21.15.37:0/2160047427 learned_addr learned my addr 172.21.15.37:0/2160047427 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:45.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.689+0000 7f7fb6a00640 1 -- 172.21.15.37:0/2160047427 >> v1:172.21.15.105:6789/0 conn(0x7f7fb815d350 legacy=0x7f7fb8160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:45.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.689+0000 7f7fb6a00640 1 -- 172.21.15.37:0/2160047427 >> v1:172.21.15.37:6789/0 conn(0x7f7fb815d7e0 legacy=0x7f7fb8160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:45.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.689+0000 7f7fb6a00640 1 -- 172.21.15.37:0/2160047427 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb8142310 con 0x7f7fb80b59d0 2024-05-30T06:45:45.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.693+0000 7f7fb6a00640 1 --2- 172.21.15.37:0/2160047427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb80b59d0 0x7f7fb80b5db0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80098a0 tx=0x7f7fa801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fee98a45316bca5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:45.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.693+0000 7f7fb6000640 1 -- 172.21.15.37:0/2160047427 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80b5070 con 0x7f7fb80b59d0 2024-05-30T06:45:45.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.693+0000 7f7fb6000640 1 -- 172.21.15.37:0/2160047427 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa80a8a30 con 0x7f7fb80b59d0 2024-05-30T06:45:45.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.693+0000 7f7fb6000640 1 -- 172.21.15.37:0/2160047427 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80a8e00 con 0x7f7fb80b59d0 2024-05-30T06:45:45.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.693+0000 7f7fbde00640 1 -- 172.21.15.37:0/2160047427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb80b59d0 msgr2=0x7f7fb80b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:45.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.693+0000 7f7fbde00640 1 --2- 172.21.15.37:0/2160047427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb80b59d0 0x7f7fb80b5db0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80098a0 tx=0x7f7fa801ed30 comp rx=0 tx=0).stop 2024-05-30T06:45:45.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.693+0000 7f7fbde00640 1 -- 172.21.15.37:0/2160047427 shutdown_connections 2024-05-30T06:45:45.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.693+0000 7f7fbde00640 1 --2- 172.21.15.37:0/2160047427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb80b59d0 0x7f7fb80b5db0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:45.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.693+0000 7f7fbde00640 1 -- 172.21.15.37:0/2160047427 >> 172.21.15.37:0/2160047427 conn(0x7f7fb806bf60 msgr2=0x7f7fb80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:45.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.693+0000 7f7fbde00640 1 -- 172.21.15.37:0/2160047427 shutdown_connections 2024-05-30T06:45:45.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.693+0000 7f7fbde00640 1 -- 172.21.15.37:0/2160047427 wait complete. 2024-05-30T06:45:45.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.693+0000 7f7fbde00640 1 Processor -- start 2024-05-30T06:45:45.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.693+0000 7f7fbde00640 1 -- start start 2024-05-30T06:45:45.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fbde00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fb80b59d0 0x7f7fb813d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:45.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fbde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb815d350 0x7f7fb80b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:45.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fbde00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fb815d7e0 0x7f7fb813df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:45.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fbde00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb813fce0 con 0x7f7fb815d350 2024-05-30T06:45:45.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fbde00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb81428d0 con 0x7f7fb80b59d0 2024-05-30T06:45:45.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fbde00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb813fe60 con 0x7f7fb815d7e0 2024-05-30T06:45:45.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fae000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb815d350 0x7f7fb80b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:45.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fb6a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fb80b59d0 0x7f7fb813d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:45.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fae000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb815d350 0x7f7fb80b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55790/0 (socket says 172.21.15.37:55790) 2024-05-30T06:45:45.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fae000640 1 -- 172.21.15.37:0/980139465 learned_addr learned my addr 172.21.15.37:0/980139465 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:45.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fb7400640 1 --2- 172.21.15.37:0/980139465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fb815d7e0 0x7f7fb813df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:45.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fae000640 1 -- 172.21.15.37:0/980139465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fb815d7e0 msgr2=0x7f7fb813df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:45.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fae000640 1 --2- 172.21.15.37:0/980139465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fb815d7e0 0x7f7fb813df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:45.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fae000640 1 -- 172.21.15.37:0/980139465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fb80b59d0 msgr2=0x7f7fb813d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:45.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fae000640 1 --2- 172.21.15.37:0/980139465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fb80b59d0 0x7f7fb813d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:45.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fae000640 1 -- 172.21.15.37:0/980139465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb80b4b50 con 0x7f7fb815d350 2024-05-30T06:45:45.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fae000640 1 --2- 172.21.15.37:0/980139465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb815d350 0x7f7fb80b1940 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000c450 tx=0x7f7fa000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:45.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fafe00640 1 -- 172.21.15.37:0/980139465 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0016020 con 0x7f7fb815d350 2024-05-30T06:45:45.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fafe00640 1 -- 172.21.15.37:0/980139465 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa00052d0 con 0x7f7fb815d350 2024-05-30T06:45:45.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fafe00640 1 -- 172.21.15.37:0/980139465 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0007260 con 0x7f7fb815d350 2024-05-30T06:45:45.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fbde00640 1 -- 172.21.15.37:0/980139465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb80b4e30 con 0x7f7fb815d350 2024-05-30T06:45:45.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fbde00640 1 -- 172.21.15.37:0/980139465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb80b53f0 con 0x7f7fb815d350 2024-05-30T06:45:45.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.697+0000 7f7fbde00640 1 -- 172.21.15.37:0/980139465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb81550b0 con 0x7f7fb815d350 2024-05-30T06:45:45.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.701+0000 7f7fafe00640 1 -- 172.21.15.37:0/980139465 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f7fa0007400 con 0x7f7fb815d350 2024-05-30T06:45:45.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.701+0000 7f7fafe00640 1 --2- 172.21.15.37:0/980139465 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7f940686e0 0x7f7f9406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:45.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.701+0000 7f7fafe00640 1 -- 172.21.15.37:0/980139465 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5609+0+0 (secure 0 0 0) 0x7f7fa0086750 con 0x7f7fb815d350 2024-05-30T06:45:45.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.701+0000 7f7fb6a00640 1 --2- 172.21.15.37:0/980139465 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7f940686e0 0x7f7f9406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:45.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.701+0000 7f7fb6a00640 1 --2- 172.21.15.37:0/980139465 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7f940686e0 0x7f7f9406aba0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80b2000 tx=0x7f7fa8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:45.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.705+0000 7f7fafe00640 1 -- 172.21.15.37:0/980139465 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7fb81550b0 con 0x7f7fb815d350 2024-05-30T06:45:45.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:45.905+0000 7f7fbde00640 1 -- 172.21.15.37:0/980139465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7fb806f0a0 con 0x7f7fb815d350 2024-05-30T06:45:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.497+0000 7f7fafe00640 1 -- 172.21.15.37:0/980139465 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v23) ==== 172+0+0 (secure 0 0 0) 0x7f7fa0020020 con 0x7f7fb815d350 2024-05-30T06:45:46.496 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 6 and data pool 7 2024-05-30T06:45:46.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.497+0000 7f7fbde00640 1 -- 172.21.15.37:0/980139465 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7f940686e0 msgr2=0x7f7f9406aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:46.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.497+0000 7f7fbde00640 1 --2- 172.21.15.37:0/980139465 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7f940686e0 0x7f7f9406aba0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80b2000 tx=0x7f7fa8009040 comp rx=0 tx=0).stop 2024-05-30T06:45:46.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.497+0000 7f7fbde00640 1 -- 172.21.15.37:0/980139465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb815d350 msgr2=0x7f7fb80b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:46.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.497+0000 7f7fbde00640 1 --2- 172.21.15.37:0/980139465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb815d350 0x7f7fb80b1940 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000c450 tx=0x7f7fa000c910 comp rx=0 tx=0).stop 2024-05-30T06:45:46.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.497+0000 7f7fbde00640 1 -- 172.21.15.37:0/980139465 shutdown_connections 2024-05-30T06:45:46.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.497+0000 7f7fbde00640 1 --2- 172.21.15.37:0/980139465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fb815d7e0 0x7f7fb813df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:46.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.497+0000 7f7fbde00640 1 --2- 172.21.15.37:0/980139465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb815d350 0x7f7fb80b1940 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:46.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.497+0000 7f7fbde00640 1 --2- 172.21.15.37:0/980139465 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7f940686e0 0x7f7f9406aba0 secure :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80b2000 tx=0x7f7fa8009040 comp rx=0 tx=0).stop 2024-05-30T06:45:46.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.497+0000 7f7fbde00640 1 --2- 172.21.15.37:0/980139465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fb80b59d0 0x7f7fb813d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:46.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.497+0000 7f7fbde00640 1 -- 172.21.15.37:0/980139465 >> 172.21.15.37:0/980139465 conn(0x7f7fb806bf60 msgr2=0x7f7fb80aec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:46.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.501+0000 7f7fbde00640 1 -- 172.21.15.37:0/980139465 shutdown_connections 2024-05-30T06:45:46.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.501+0000 7f7fbde00640 1 -- 172.21.15.37:0/980139465 wait complete. 2024-05-30T06:45:46.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:45:46.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd80fa00640 1 Processor -- start 2024-05-30T06:45:46.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd80fa00640 1 -- start start 2024-05-30T06:45:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd80fa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd80806b960 0x7fd80806be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd80fa00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8080b6030 con 0x7fd8080b45d0 2024-05-30T06:45:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd80fa00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8080b62d0 con 0x7fd808147790 2024-05-30T06:45:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd80fa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd808071180 con 0x7fd80806b960 2024-05-30T06:45:46.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd7ffe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd8080b45d0 0x7fd808070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33334/0 (socket says 172.21.15.37:33334) 2024-05-30T06:45:46.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd7ffe00640 1 -- 172.21.15.37:0/2099245803 learned_addr learned my addr 172.21.15.37:0/2099245803 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:46.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd80da00640 1 --2- 172.21.15.37:0/2099245803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd80806b960 0x7fd80806be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:46.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd807e00640 1 -- 172.21.15.37:0/2099245803 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029624226 0 0) 0x7fd8080b6030 con 0x7fd8080b45d0 2024-05-30T06:45:46.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd807e00640 1 -- 172.21.15.37:0/2099245803 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7ec003530 con 0x7fd8080b45d0 2024-05-30T06:45:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd807e00640 1 -- 172.21.15.37:0/2099245803 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1219774894 0 0) 0x7fd8080b62d0 con 0x7fd808147790 2024-05-30T06:45:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd807e00640 1 -- 172.21.15.37:0/2099245803 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8080b6030 con 0x7fd808147790 2024-05-30T06:45:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd80da00640 1 -- 172.21.15.37:0/2099245803 >> v1:172.21.15.105:6789/0 conn(0x7fd808147790 legacy=0x7fd8080ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd80da00640 1 -- 172.21.15.37:0/2099245803 >> v1:172.21.15.37:6789/0 conn(0x7fd8080b45d0 legacy=0x7fd808070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.701+0000 7fd80da00640 1 -- 172.21.15.37:0/2099245803 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8080b65b0 con 0x7fd80806b960 2024-05-30T06:45:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.705+0000 7fd80da00640 1 --2- 172.21.15.37:0/2099245803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd80806b960 0x7fd80806be10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd800009dc0 tx=0x7fd80001c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c9bb488726467f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.705+0000 7fd807e00640 1 -- 172.21.15.37:0/2099245803 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8000b2070 con 0x7fd80806b960 2024-05-30T06:45:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.705+0000 7fd807e00640 1 -- 172.21.15.37:0/2099245803 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8000a57c0 con 0x7fd80806b960 2024-05-30T06:45:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.705+0000 7fd807e00640 1 -- 172.21.15.37:0/2099245803 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8000a5b90 con 0x7fd80806b960 2024-05-30T06:45:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.705+0000 7fd80fa00640 1 -- 172.21.15.37:0/2099245803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd80806b960 msgr2=0x7fd80806be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.705+0000 7fd80fa00640 1 --2- 172.21.15.37:0/2099245803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd80806b960 0x7fd80806be10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd800009dc0 tx=0x7fd80001c900 comp rx=0 tx=0).stop 2024-05-30T06:45:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.705+0000 7fd80fa00640 1 -- 172.21.15.37:0/2099245803 shutdown_connections 2024-05-30T06:45:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.705+0000 7fd80fa00640 1 --2- 172.21.15.37:0/2099245803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd80806b960 0x7fd80806be10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.705+0000 7fd80fa00640 1 -- 172.21.15.37:0/2099245803 >> 172.21.15.37:0/2099245803 conn(0x7fd8080b6a60 msgr2=0x7fd8080b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.705+0000 7fd80fa00640 1 -- 172.21.15.37:0/2099245803 shutdown_connections 2024-05-30T06:45:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.705+0000 7fd80fa00640 1 -- 172.21.15.37:0/2099245803 wait complete. 2024-05-30T06:45:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd80fa00640 1 Processor -- start 2024-05-30T06:45:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd80fa00640 1 -- start start 2024-05-30T06:45:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd80fa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd80806b960 0x7fd808163650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd80fa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8080b45d0 0x7fd8080b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd80fa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd808147790 0x7fd80813d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd80fa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd80816c5e0 con 0x7fd8080b45d0 2024-05-30T06:45:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd80fa00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd8080701c0 con 0x7fd808147790 2024-05-30T06:45:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd80fa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd80816c760 con 0x7fd80806b960 2024-05-30T06:45:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd7ffe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8080b45d0 0x7fd8080b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd7ffe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8080b45d0 0x7fd8080b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55806/0 (socket says 172.21.15.37:55806) 2024-05-30T06:45:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd7ffe00640 1 -- 172.21.15.37:0/2165321547 learned_addr learned my addr 172.21.15.37:0/2165321547 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd80da00640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd808147790 0x7fd80813d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd80d000640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd80806b960 0x7fd808163650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd7ffe00640 1 -- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd80806b960 msgr2=0x7fd808163650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd7ffe00640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd80806b960 0x7fd808163650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd7ffe00640 1 -- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd808147790 msgr2=0x7fd80813d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd7ffe00640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd808147790 0x7fd80813d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:46.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd7ffe00640 1 -- 172.21.15.37:0/2165321547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80813dc90 con 0x7fd8080b45d0 2024-05-30T06:45:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd7ffe00640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8080b45d0 0x7fd8080b1c50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000c4d0 tx=0x7fd7f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd805600640 1 -- 172.21.15.37:0/2165321547 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0017070 con 0x7fd8080b45d0 2024-05-30T06:45:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd805600640 1 -- 172.21.15.37:0/2165321547 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f0005cf0 con 0x7fd8080b45d0 2024-05-30T06:45:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd805600640 1 -- 172.21.15.37:0/2165321547 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0007270 con 0x7fd8080b45d0 2024-05-30T06:45:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd80fa00640 1 -- 172.21.15.37:0/2165321547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8080b2790 con 0x7fd8080b45d0 2024-05-30T06:45:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.709+0000 7fd80fa00640 1 -- 172.21.15.37:0/2165321547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8080b2d50 con 0x7fd8080b45d0 2024-05-30T06:45:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.713+0000 7fd80fa00640 1 -- 172.21.15.37:0/2165321547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd80806da00 con 0x7fd8080b45d0 2024-05-30T06:45:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.713+0000 7fd805600640 1 -- 172.21.15.37:0/2165321547 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fd7f001a070 con 0x7fd8080b45d0 2024-05-30T06:45:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.713+0000 7fd805600640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd7e40686e0 0x7fd7e406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.713+0000 7fd805600640 1 -- 172.21.15.37:0/2165321547 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fd7f0086230 con 0x7fd8080b45d0 2024-05-30T06:45:46.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.713+0000 7fd80d000640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd7e40686e0 0x7fd7e406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.713+0000 7fd80d000640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd7e40686e0 0x7fd7e406aba0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80011f0 tx=0x7fd7f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:46.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.717+0000 7fd805600640 1 -- 172.21.15.37:0/2165321547 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd7f0055d20 con 0x7fd8080b45d0 2024-05-30T06:45:46.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.881+0000 7fd80fa00640 1 -- 172.21.15.37:0/2165321547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd808068b20 con 0x7fd8080b45d0 2024-05-30T06:45:46.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.885+0000 7fd805600640 1 -- 172.21.15.37:0/2165321547 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16614 (secure 0 0 0) 0x7fd7f005c030 con 0x7fd8080b45d0 2024-05-30T06:45:46.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:46.886 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":45,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:45:45.908212+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:45:44.283575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T06:45:44.856243+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:45:46.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.885+0000 7fd80fa00640 1 -- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd7e40686e0 msgr2=0x7fd7e406aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:46.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.885+0000 7fd80fa00640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd7e40686e0 0x7fd7e406aba0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80011f0 tx=0x7fd7f8009040 comp rx=0 tx=0).stop 2024-05-30T06:45:46.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.885+0000 7fd80fa00640 1 -- 172.21.15.37:0/2165321547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8080b45d0 msgr2=0x7fd8080b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:46.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.885+0000 7fd80fa00640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8080b45d0 0x7fd8080b1c50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd7f000c4d0 tx=0x7fd7f000c990 comp rx=0 tx=0).stop 2024-05-30T06:45:46.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.885+0000 7fd80fa00640 1 -- 172.21.15.37:0/2165321547 shutdown_connections 2024-05-30T06:45:46.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.885+0000 7fd80fa00640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd7e40686e0 0x7fd7e406aba0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:46.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.885+0000 7fd80fa00640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd808147790 0x7fd80813d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:46.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.885+0000 7fd80fa00640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8080b45d0 0x7fd8080b1c50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:46.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.885+0000 7fd80fa00640 1 --2- 172.21.15.37:0/2165321547 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd80806b960 0x7fd808163650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:46.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.885+0000 7fd80fa00640 1 -- 172.21.15.37:0/2165321547 >> 172.21.15.37:0/2165321547 conn(0x7fd8080b6a60 msgr2=0x7fd808139980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:46.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.885+0000 7fd80fa00640 1 -- 172.21.15.37:0/2165321547 shutdown_connections 2024-05-30T06:45:46.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:46.885+0000 7fd80fa00640 1 -- 172.21.15.37:0/2165321547 wait complete. 2024-05-30T06:45:46.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:45:47.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553e00640 1 Processor -- start 2024-05-30T06:45:47.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553e00640 1 -- start start 2024-05-30T06:45:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f255415fb40 0x7f255415ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f255406eac0 0x7f255406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25540cf0d0 con 0x7f25540ceb10 2024-05-30T06:45:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f25540cf3b0 con 0x7f255406eac0 2024-05-30T06:45:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f25540cf690 con 0x7f255415fb40 2024-05-30T06:45:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f255406eac0 0x7f255406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f255406eac0 0x7f255406ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55820/0 (socket says 172.21.15.37:55820) 2024-05-30T06:45:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553400640 1 -- 172.21.15.37:0/631624173 learned_addr learned my addr 172.21.15.37:0/631624173 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2552a00640 1 --2- 172.21.15.37:0/631624173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f255415fb40 0x7f255415ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:47.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553400640 1 -- 172.21.15.37:0/631624173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f255415fb40 msgr2=0x7f255415ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553400640 1 --2- 172.21.15.37:0/631624173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f255415fb40 0x7f255415ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553400640 1 -- 172.21.15.37:0/631624173 >> v1:172.21.15.37:6789/0 conn(0x7f25540ceb10 legacy=0x7f255406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:47.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.049+0000 7f2553400640 1 -- 172.21.15.37:0/631624173 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25540cf970 con 0x7f255406eac0 2024-05-30T06:45:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.053+0000 7f2553400640 1 --2- 172.21.15.37:0/631624173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255406eac0 0x7f255406ba40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f254c009e50 tx=0x7f254c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e40293153a0fff6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.053+0000 7f2552000640 1 -- 172.21.15.37:0/631624173 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c0a57e0 con 0x7f255406eac0 2024-05-30T06:45:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.053+0000 7f2552000640 1 -- 172.21.15.37:0/631624173 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f254c0a5980 con 0x7f255406eac0 2024-05-30T06:45:47.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.053+0000 7f2552000640 1 -- 172.21.15.37:0/631624173 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c0a5d50 con 0x7f255406eac0 2024-05-30T06:45:47.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.053+0000 7f2553e00640 1 -- 172.21.15.37:0/631624173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255406eac0 msgr2=0x7f255406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.053+0000 7f2553e00640 1 --2- 172.21.15.37:0/631624173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255406eac0 0x7f255406ba40 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f254c009e50 tx=0x7f254c01ca00 comp rx=0 tx=0).stop 2024-05-30T06:45:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.053+0000 7f2553e00640 1 -- 172.21.15.37:0/631624173 shutdown_connections 2024-05-30T06:45:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.053+0000 7f2553e00640 1 --2- 172.21.15.37:0/631624173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f255406eac0 0x7f255406ba40 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.053+0000 7f2553e00640 1 --2- 172.21.15.37:0/631624173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f255415fb40 0x7f255415ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.053+0000 7f2553e00640 1 -- 172.21.15.37:0/631624173 >> 172.21.15.37:0/631624173 conn(0x7f25540cd710 msgr2=0x7f25540cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:47.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.053+0000 7f2553e00640 1 -- 172.21.15.37:0/631624173 shutdown_connections 2024-05-30T06:45:47.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.053+0000 7f2553e00640 1 -- 172.21.15.37:0/631624173 wait complete. 2024-05-30T06:45:47.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f2553e00640 1 Processor -- start 2024-05-30T06:45:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f2553e00640 1 -- start start 2024-05-30T06:45:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f2553e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f255406eac0 0x7f25541618c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f2553e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25540ceb10 0x7f2554161e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f2553e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f255415fb40 0x7f255415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f2553e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f255406cb20 con 0x7f25540ceb10 2024-05-30T06:45:47.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f2553e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f255406c9a0 con 0x7f255415fb40 2024-05-30T06:45:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f2553e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f255406cca0 con 0x7f255406eac0 2024-05-30T06:45:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f254be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25540ceb10 0x7f2554161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f254be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25540ceb10 0x7f2554161e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55826/0 (socket says 172.21.15.37:55826) 2024-05-30T06:45:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f254be00640 1 -- 172.21.15.37:0/2575238355 learned_addr learned my addr 172.21.15.37:0/2575238355 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f2552a00640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f255406eac0 0x7f25541618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f2553400640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f255415fb40 0x7f255415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:47.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f254be00640 1 -- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f255406eac0 msgr2=0x7f25541618c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f254be00640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f255406eac0 0x7f25541618c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f254be00640 1 -- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f255415fb40 msgr2=0x7f255415afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f254be00640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f255415fb40 0x7f255415afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f254be00640 1 -- 172.21.15.37:0/2575238355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2554162340 con 0x7f25540ceb10 2024-05-30T06:45:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f254be00640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25540ceb10 0x7f2554161e00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f253c00c370 tx=0x7f253c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:47.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f254aa00640 1 -- 172.21.15.37:0/2575238355 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c0052d0 con 0x7f25540ceb10 2024-05-30T06:45:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f254aa00640 1 -- 172.21.15.37:0/2575238355 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253c005470 con 0x7f25540ceb10 2024-05-30T06:45:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f254aa00640 1 -- 172.21.15.37:0/2575238355 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c007260 con 0x7f25540ceb10 2024-05-30T06:45:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f2553e00640 1 -- 172.21.15.37:0/2575238355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25541625f0 con 0x7f25540ceb10 2024-05-30T06:45:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.057+0000 7f2553e00640 1 -- 172.21.15.37:0/2575238355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2554162bb0 con 0x7f25540ceb10 2024-05-30T06:45:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.061+0000 7f2553e00640 1 -- 172.21.15.37:0/2575238355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2554075580 con 0x7f25540ceb10 2024-05-30T06:45:47.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.061+0000 7f254aa00640 1 -- 172.21.15.37:0/2575238355 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f253c007400 con 0x7f25540ceb10 2024-05-30T06:45:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.061+0000 7f254aa00640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f25300686e0 0x7f253006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.061+0000 7f254aa00640 1 -- 172.21.15.37:0/2575238355 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f253c086330 con 0x7f25540ceb10 2024-05-30T06:45:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.061+0000 7f2552a00640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f25300686e0 0x7f253006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.061+0000 7f2552a00640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f25300686e0 0x7f253006aba0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2544009b60 tx=0x7f2544009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:47.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.065+0000 7f254aa00640 1 -- 172.21.15.37:0/2575238355 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f253c055e50 con 0x7f25540ceb10 2024-05-30T06:45:47.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.237+0000 7f2553e00640 1 -- 172.21.15.37:0/2575238355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25540b6180 con 0x7f25540ceb10 2024-05-30T06:45:47.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.237+0000 7f254aa00640 1 -- 172.21.15.37:0/2575238355 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16614 (secure 0 0 0) 0x7f253c05a150 con 0x7f25540ceb10 2024-05-30T06:45:47.238 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:47.239 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":45,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:45:45.908212+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:45:44.283575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T06:45:44.856243+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:45:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.237+0000 7f2553e00640 1 -- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f25300686e0 msgr2=0x7f253006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.237+0000 7f2553e00640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f25300686e0 0x7f253006aba0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2544009b60 tx=0x7f2544009190 comp rx=0 tx=0).stop 2024-05-30T06:45:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.237+0000 7f2553e00640 1 -- 172.21.15.37:0/2575238355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25540ceb10 msgr2=0x7f2554161e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.237+0000 7f2553e00640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25540ceb10 0x7f2554161e00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f253c00c370 tx=0x7f253c00c830 comp rx=0 tx=0).stop 2024-05-30T06:45:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.237+0000 7f2553e00640 1 -- 172.21.15.37:0/2575238355 shutdown_connections 2024-05-30T06:45:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.237+0000 7f2553e00640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f25300686e0 0x7f253006aba0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.237+0000 7f2553e00640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f255415fb40 0x7f255415afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.237+0000 7f2553e00640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25540ceb10 0x7f2554161e00 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.237+0000 7f2553e00640 1 --2- 172.21.15.37:0/2575238355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f255406eac0 0x7f25541618c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.237+0000 7f2553e00640 1 -- 172.21.15.37:0/2575238355 >> 172.21.15.37:0/2575238355 conn(0x7f25540cd710 msgr2=0x7f25540b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:47.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.241+0000 7f2553e00640 1 -- 172.21.15.37:0/2575238355 shutdown_connections 2024-05-30T06:45:47.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.241+0000 7f2553e00640 1 -- 172.21.15.37:0/2575238355 wait complete. 2024-05-30T06:45:47.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T06:45:47.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf9b200640 1 Processor -- start 2024-05-30T06:45:47.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf9b200640 1 -- start start 2024-05-30T06:45:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf9b200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7faf940cd440 0x7faf9406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:47.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf9b200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf9406f5a0 0x7faf940b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf9b200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9415f310 con 0x7faf94155da0 2024-05-30T06:45:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf9b200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7faf9415f5f0 con 0x7faf940cd440 2024-05-30T06:45:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf9b200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faf9415f8d0 con 0x7faf9406f5a0 2024-05-30T06:45:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf99200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf9406f5a0 0x7faf940b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf8b400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7faf940cd440 0x7faf9406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:47.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf99200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf9406f5a0 0x7faf940b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:35476/0 (socket says 172.21.15.37:35476) 2024-05-30T06:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf99200640 1 -- 172.21.15.37:0/2614755394 learned_addr learned my addr 172.21.15.37:0/2614755394 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf99200640 1 -- 172.21.15.37:0/2614755394 >> v2:172.21.15.105:3300/0 conn(0x7faf940cd440 msgr2=0x7faf9406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf99200640 1 --2- 172.21.15.37:0/2614755394 >> v2:172.21.15.105:3300/0 conn(0x7faf940cd440 0x7faf9406f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf99200640 1 -- 172.21.15.37:0/2614755394 >> v1:172.21.15.105:6789/0 conn(0x7faf94155da0 legacy=0x7faf940cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:47.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.405+0000 7faf99200640 1 -- 172.21.15.37:0/2614755394 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9415fbb0 con 0x7faf9406f5a0 2024-05-30T06:45:47.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.409+0000 7faf99200640 1 --2- 172.21.15.37:0/2614755394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf9406f5a0 0x7faf940b3750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009e50 tx=0x7faf8c01c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65dd038a0ab4549f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.409+0000 7faf93400640 1 -- 172.21.15.37:0/2614755394 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0a56e0 con 0x7faf9406f5a0 2024-05-30T06:45:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.409+0000 7faf93400640 1 -- 172.21.15.37:0/2614755394 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf8c0a5880 con 0x7faf9406f5a0 2024-05-30T06:45:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.409+0000 7faf93400640 1 -- 172.21.15.37:0/2614755394 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0a5c50 con 0x7faf9406f5a0 2024-05-30T06:45:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.409+0000 7faf9b200640 1 -- 172.21.15.37:0/2614755394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf9406f5a0 msgr2=0x7faf940b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:47.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.409+0000 7faf9b200640 1 --2- 172.21.15.37:0/2614755394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf9406f5a0 0x7faf940b3750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009e50 tx=0x7faf8c01c910 comp rx=0 tx=0).stop 2024-05-30T06:45:47.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.409+0000 7faf9b200640 1 -- 172.21.15.37:0/2614755394 shutdown_connections 2024-05-30T06:45:47.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.409+0000 7faf9b200640 1 --2- 172.21.15.37:0/2614755394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf9406f5a0 0x7faf940b3750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.409+0000 7faf9b200640 1 --2- 172.21.15.37:0/2614755394 >> v2:172.21.15.105:3300/0 conn(0x7faf940cd440 0x7faf9406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.409+0000 7faf9b200640 1 -- 172.21.15.37:0/2614755394 >> 172.21.15.37:0/2614755394 conn(0x7faf9406bf60 msgr2=0x7faf940b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:47.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.409+0000 7faf9b200640 1 -- 172.21.15.37:0/2614755394 shutdown_connections 2024-05-30T06:45:47.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.409+0000 7faf9b200640 1 -- 172.21.15.37:0/2614755394 wait complete. 2024-05-30T06:45:47.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf9b200640 1 Processor -- start 2024-05-30T06:45:47.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf9b200640 1 -- start start 2024-05-30T06:45:47.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf9b200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf9406f5a0 0x7faf94152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:47.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf9b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94155da0 0x7faf94159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:47.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf9b200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf94159f60 0x7faf941502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:47.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf9b200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faf94168580 con 0x7faf94155da0 2024-05-30T06:45:47.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf9b200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faf940b46b0 con 0x7faf94159f60 2024-05-30T06:45:47.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf9b200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faf94168700 con 0x7faf9406f5a0 2024-05-30T06:45:47.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf8b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94155da0 0x7faf94159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:47.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf8b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94155da0 0x7faf94159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48170/0 (socket says 172.21.15.37:48170) 2024-05-30T06:45:47.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf8b400640 1 -- 172.21.15.37:0/1407318623 learned_addr learned my addr 172.21.15.37:0/1407318623 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:47.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf99200640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf94159f60 0x7faf941502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:47.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf93e00640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf9406f5a0 0x7faf94152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:47.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf8b400640 1 -- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf9406f5a0 msgr2=0x7faf94152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:47.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf8b400640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf9406f5a0 0x7faf94152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf8b400640 1 -- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf94159f60 msgr2=0x7faf941502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:47.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf8b400640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf94159f60 0x7faf941502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:47.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf8b400640 1 -- 172.21.15.37:0/1407318623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf941f7310 con 0x7faf94155da0 2024-05-30T06:45:47.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf99200640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf94159f60 0x7faf941502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:45:47.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf93e00640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf9406f5a0 0x7faf94152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:45:47.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf8b400640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94155da0 0x7faf94159a20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00e930 tx=0x7faf7c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:47.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf90c00640 1 -- 172.21.15.37:0/1407318623 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c017070 con 0x7faf94155da0 2024-05-30T06:45:47.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf90c00640 1 -- 172.21.15.37:0/1407318623 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7c00ca00 con 0x7faf94155da0 2024-05-30T06:45:47.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf90c00640 1 -- 172.21.15.37:0/1407318623 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00cdb0 con 0x7faf94155da0 2024-05-30T06:45:47.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf9b200640 1 -- 172.21.15.37:0/1407318623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf9415a590 con 0x7faf94155da0 2024-05-30T06:45:47.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.413+0000 7faf9b200640 1 -- 172.21.15.37:0/1407318623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf94153b70 con 0x7faf94155da0 2024-05-30T06:45:47.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.417+0000 7faf9b200640 1 -- 172.21.15.37:0/1407318623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf94068bc0 con 0x7faf94155da0 2024-05-30T06:45:47.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.417+0000 7faf90c00640 1 -- 172.21.15.37:0/1407318623 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7faf7c01a070 con 0x7faf94155da0 2024-05-30T06:45:47.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.417+0000 7faf90c00640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faf700686e0 0x7faf7006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:47.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.417+0000 7faf90c00640 1 -- 172.21.15.37:0/1407318623 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7faf7c086ed0 con 0x7faf94155da0 2024-05-30T06:45:47.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.417+0000 7faf93e00640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faf700686e0 0x7faf7006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:47.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.417+0000 7faf93e00640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faf700686e0 0x7faf7006aba0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf84001650 tx=0x7faf84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:47.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.421+0000 7faf90c00640 1 -- 172.21.15.37:0/1407318623 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faf7c0571d0 con 0x7faf94155da0 2024-05-30T06:45:47.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:47.629+0000 7faf9b200640 1 -- 172.21.15.37:0/1407318623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7faf940ce440 con 0x7faf94155da0 2024-05-30T06:45:48.476 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-30T06:45:48.473+0000 7f8f25e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T06:45:48.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.529+0000 7faf90c00640 1 -- 172.21.15.37:0/1407318623 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7faf7c056ad0 con 0x7faf94155da0 2024-05-30T06:45:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.533+0000 7faf9b200640 1 -- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faf700686e0 msgr2=0x7faf7006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.533+0000 7faf9b200640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faf700686e0 0x7faf7006aba0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf84001650 tx=0x7faf84009040 comp rx=0 tx=0).stop 2024-05-30T06:45:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.533+0000 7faf9b200640 1 -- 172.21.15.37:0/1407318623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94155da0 msgr2=0x7faf94159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.533+0000 7faf9b200640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94155da0 0x7faf94159a20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00e930 tx=0x7faf7c00edf0 comp rx=0 tx=0).stop 2024-05-30T06:45:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.533+0000 7faf9b200640 1 -- 172.21.15.37:0/1407318623 shutdown_connections 2024-05-30T06:45:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.533+0000 7faf9b200640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faf700686e0 0x7faf7006aba0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.533+0000 7faf9b200640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faf94159f60 0x7faf941502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.533+0000 7faf9b200640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf94155da0 0x7faf94159a20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.533+0000 7faf9b200640 1 --2- 172.21.15.37:0/1407318623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faf9406f5a0 0x7faf94152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.533+0000 7faf9b200640 1 -- 172.21.15.37:0/1407318623 >> 172.21.15.37:0/1407318623 conn(0x7faf9406bf60 msgr2=0x7faf941582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.533+0000 7faf9b200640 1 -- 172.21.15.37:0/1407318623 shutdown_connections 2024-05-30T06:45:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.533+0000 7faf9b200640 1 -- 172.21.15.37:0/1407318623 wait complete. 2024-05-30T06:45:48.559 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T06:45:48.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T06:45:48.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.705+0000 7fe2f8000640 1 Processor -- start 2024-05-30T06:45:48.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.709+0000 7fe2f8000640 1 -- start start 2024-05-30T06:45:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.709+0000 7fe2f8000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2f00b59d0 0x7fe2f00b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.709+0000 7fe2f8000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f015d7e0 0x7fe2f0160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.709+0000 7fe2f8000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f00b62f0 con 0x7fe2f015d350 2024-05-30T06:45:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.709+0000 7fe2f8000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f0142030 con 0x7fe2f00b59d0 2024-05-30T06:45:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.709+0000 7fe2f8000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f0142310 con 0x7fe2f015d7e0 2024-05-30T06:45:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.709+0000 7fe2f5600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2f00b59d0 0x7fe2f00b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.709+0000 7fe2f5600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2f00b59d0 0x7fe2f00b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48172/0 (socket says 172.21.15.37:48172) 2024-05-30T06:45:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.709+0000 7fe2f5600640 1 -- 172.21.15.37:0/42212225 learned_addr learned my addr 172.21.15.37:0/42212225 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:48.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.709+0000 7fe2f5600640 1 -- 172.21.15.37:0/42212225 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f015d7e0 msgr2=0x7fe2f0160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:48.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.709+0000 7fe2f5600640 1 --2- 172.21.15.37:0/42212225 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f015d7e0 0x7fe2f0160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:48.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.709+0000 7fe2f5600640 1 -- 172.21.15.37:0/42212225 >> v1:172.21.15.105:6789/0 conn(0x7fe2f015d350 legacy=0x7fe2f0160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:48.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.709+0000 7fe2f5600640 1 -- 172.21.15.37:0/42212225 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f01425f0 con 0x7fe2f00b59d0 2024-05-30T06:45:48.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.713+0000 7fe2f5600640 1 --2- 172.21.15.37:0/42212225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f00b59d0 0x7fe2f00b5db0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40098a0 tx=0x7fe2e401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9badfbff0843922 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.713+0000 7fe2efe00640 1 -- 172.21.15.37:0/42212225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40b5070 con 0x7fe2f00b59d0 2024-05-30T06:45:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.713+0000 7fe2efe00640 1 -- 172.21.15.37:0/42212225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e40a89b0 con 0x7fe2f00b59d0 2024-05-30T06:45:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.713+0000 7fe2efe00640 1 -- 172.21.15.37:0/42212225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40a8d80 con 0x7fe2f00b59d0 2024-05-30T06:45:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.713+0000 7fe2f8000640 1 -- 172.21.15.37:0/42212225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f00b59d0 msgr2=0x7fe2f00b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.713+0000 7fe2f8000640 1 --2- 172.21.15.37:0/42212225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f00b59d0 0x7fe2f00b5db0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40098a0 tx=0x7fe2e401ecf0 comp rx=0 tx=0).stop 2024-05-30T06:45:48.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.713+0000 7fe2f8000640 1 -- 172.21.15.37:0/42212225 shutdown_connections 2024-05-30T06:45:48.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.713+0000 7fe2f8000640 1 --2- 172.21.15.37:0/42212225 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f015d7e0 0x7fe2f0160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:48.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.713+0000 7fe2f8000640 1 --2- 172.21.15.37:0/42212225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f00b59d0 0x7fe2f00b5db0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:48.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.713+0000 7fe2f8000640 1 -- 172.21.15.37:0/42212225 >> 172.21.15.37:0/42212225 conn(0x7fe2f006bf60 msgr2=0x7fe2f00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:48.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.713+0000 7fe2f8000640 1 -- 172.21.15.37:0/42212225 shutdown_connections 2024-05-30T06:45:48.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.713+0000 7fe2f8000640 1 -- 172.21.15.37:0/42212225 wait complete. 2024-05-30T06:45:48.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.713+0000 7fe2f8000640 1 Processor -- start 2024-05-30T06:45:48.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f8000640 1 -- start start 2024-05-30T06:45:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f8000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2f00b59d0 0x7fe2f013c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f8000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f015d350 0x7fe2f01e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f8000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f015d7e0 0x7fe2f015b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f8000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f013fe60 con 0x7fe2f015d7e0 2024-05-30T06:45:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f8000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f013fce0 con 0x7fe2f00b59d0 2024-05-30T06:45:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f8000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f00aff20 con 0x7fe2f015d350 2024-05-30T06:45:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f015d7e0 0x7fe2f015b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f015d7e0 0x7fe2f015b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48174/0 (socket says 172.21.15.37:48174) 2024-05-30T06:45:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f6000640 1 -- 172.21.15.37:0/2300483996 learned_addr learned my addr 172.21.15.37:0/2300483996 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f5600640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2f00b59d0 0x7fe2f013c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f4c00640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f015d350 0x7fe2f01e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f6000640 1 -- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f015d350 msgr2=0x7fe2f01e73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f6000640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f015d350 0x7fe2f01e73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f6000640 1 -- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2f00b59d0 msgr2=0x7fe2f013c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f6000640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2f00b59d0 0x7fe2f013c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f6000640 1 -- 172.21.15.37:0/2300483996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f01f52a0 con 0x7fe2f015d7e0 2024-05-30T06:45:48.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f6000640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f015d7e0 0x7fe2f015b870 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800b9a0 tx=0x7fe2e800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:48.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2ed600640 1 -- 172.21.15.37:0/2300483996 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8019070 con 0x7fe2f015d7e0 2024-05-30T06:45:48.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2ed600640 1 -- 172.21.15.37:0/2300483996 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e800cbc0 con 0x7fe2f015d7e0 2024-05-30T06:45:48.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2ed600640 1 -- 172.21.15.37:0/2300483996 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8014440 con 0x7fe2f015d7e0 2024-05-30T06:45:48.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f8000640 1 -- 172.21.15.37:0/2300483996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f01f5580 con 0x7fe2f015d7e0 2024-05-30T06:45:48.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f8000640 1 -- 172.21.15.37:0/2300483996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f01f5b40 con 0x7fe2f015d7e0 2024-05-30T06:45:48.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.717+0000 7fe2f8000640 1 -- 172.21.15.37:0/2300483996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f01f6030 con 0x7fe2f015d7e0 2024-05-30T06:45:48.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.721+0000 7fe2ed600640 1 -- 172.21.15.37:0/2300483996 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fe2e801c070 con 0x7fe2f015d7e0 2024-05-30T06:45:48.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.721+0000 7fe2ed600640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2d00686e0 0x7fe2d006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:48.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.721+0000 7fe2ed600640 1 -- 172.21.15.37:0/2300483996 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fe2e8086b30 con 0x7fe2f015d7e0 2024-05-30T06:45:48.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.721+0000 7fe2f5600640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2d00686e0 0x7fe2d006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.721+0000 7fe2f5600640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2d00686e0 0x7fe2d006aba0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40b2000 tx=0x7fe2e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:48.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.725+0000 7fe2ed600640 1 -- 172.21.15.37:0/2300483996 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe2e80566e0 con 0x7fe2f015d7e0 2024-05-30T06:45:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:48.925+0000 7fe2f8000640 1 -- 172.21.15.37:0/2300483996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe2f0153360 con 0x7fe2f015d7e0 2024-05-30T06:45:49.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.537+0000 7fe2ed600640 1 -- 172.21.15.37:0/2300483996 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7fe2e805a9e0 con 0x7fe2f015d7e0 2024-05-30T06:45:49.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.541+0000 7fe2f8000640 1 -- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2d00686e0 msgr2=0x7fe2d006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:49.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.541+0000 7fe2f8000640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2d00686e0 0x7fe2d006aba0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40b2000 tx=0x7fe2e4008040 comp rx=0 tx=0).stop 2024-05-30T06:45:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.541+0000 7fe2f8000640 1 -- 172.21.15.37:0/2300483996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f015d7e0 msgr2=0x7fe2f015b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.541+0000 7fe2f8000640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f015d7e0 0x7fe2f015b870 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe2e800b9a0 tx=0x7fe2e800be60 comp rx=0 tx=0).stop 2024-05-30T06:45:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.541+0000 7fe2f8000640 1 -- 172.21.15.37:0/2300483996 shutdown_connections 2024-05-30T06:45:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.541+0000 7fe2f8000640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f015d7e0 0x7fe2f015b870 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.541+0000 7fe2f8000640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2f015d350 0x7fe2f01e73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.541+0000 7fe2f8000640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2d00686e0 0x7fe2d006aba0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.541+0000 7fe2f8000640 1 --2- 172.21.15.37:0/2300483996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2f00b59d0 0x7fe2f013c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.541+0000 7fe2f8000640 1 -- 172.21.15.37:0/2300483996 >> 172.21.15.37:0/2300483996 conn(0x7fe2f006bf60 msgr2=0x7fe2f0160210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.541+0000 7fe2f8000640 1 -- 172.21.15.37:0/2300483996 shutdown_connections 2024-05-30T06:45:49.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.541+0000 7fe2f8000640 1 -- 172.21.15.37:0/2300483996 wait complete. 2024-05-30T06:45:49.563 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T06:45:49.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:45:49.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2c0a00640 1 Processor -- start 2024-05-30T06:45:49.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2c0a00640 1 -- start start 2024-05-30T06:45:49.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2c0a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2bc0b2e20 0x7fd2bc160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:49.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2c0a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd2bc1609c0 0x7fd2bc160e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:49.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2c0a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2bc0d0430 con 0x7fd2bc0cd280 2024-05-30T06:45:49.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2c0a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd2bc0b3200 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2c0a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd2bc0d01e0 con 0x7fd2bc1609c0 2024-05-30T06:45:49.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2b9e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2bc0b2e20 0x7fd2bc160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:49.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2b9e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2bc0b2e20 0x7fd2bc160480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48186/0 (socket says 172.21.15.37:48186) 2024-05-30T06:45:49.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2b9e00640 1 -- 172.21.15.37:0/2824353073 learned_addr learned my addr 172.21.15.37:0/2824353073 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:49.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2b1400640 1 --2- 172.21.15.37:0/2824353073 >> v2:172.21.15.105:3300/0 conn(0x7fd2bc1609c0 0x7fd2bc160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:49.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2b9e00640 1 -- 172.21.15.37:0/2824353073 >> v2:172.21.15.105:3300/0 conn(0x7fd2bc1609c0 msgr2=0x7fd2bc160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:49.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2b9e00640 1 --2- 172.21.15.37:0/2824353073 >> v2:172.21.15.105:3300/0 conn(0x7fd2bc1609c0 0x7fd2bc160e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2b9e00640 1 -- 172.21.15.37:0/2824353073 >> v1:172.21.15.37:6789/0 conn(0x7fd2bc0cd280 legacy=0x7fd2bc0cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:49.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.705+0000 7fd2b9e00640 1 -- 172.21.15.37:0/2824353073 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc0d0710 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.709+0000 7fd2b9e00640 1 --2- 172.21.15.37:0/2824353073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2bc0b2e20 0x7fd2bc160480 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0c5fe0 tx=0x7fd2ac01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1feeb9e1e420c3bc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:49.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.709+0000 7fd2b9400640 1 -- 172.21.15.37:0/2824353073 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac0a5760 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.709+0000 7fd2b9400640 1 -- 172.21.15.37:0/2824353073 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ac0a5900 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.709+0000 7fd2b9400640 1 -- 172.21.15.37:0/2824353073 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac0a5cd0 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.709+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2824353073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2bc0b2e20 msgr2=0x7fd2bc160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:49.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.709+0000 7fd2c0a00640 1 --2- 172.21.15.37:0/2824353073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2bc0b2e20 0x7fd2bc160480 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc0c5fe0 tx=0x7fd2ac01c9f0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.709+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2824353073 shutdown_connections 2024-05-30T06:45:49.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.709+0000 7fd2c0a00640 1 --2- 172.21.15.37:0/2824353073 >> v2:172.21.15.105:3300/0 conn(0x7fd2bc1609c0 0x7fd2bc160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.709+0000 7fd2c0a00640 1 --2- 172.21.15.37:0/2824353073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2bc0b2e20 0x7fd2bc160480 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.709+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2824353073 >> 172.21.15.37:0/2824353073 conn(0x7fd2bc0b4100 msgr2=0x7fd2bc0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:49.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.709+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2824353073 shutdown_connections 2024-05-30T06:45:49.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.709+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2824353073 wait complete. 2024-05-30T06:45:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2c0a00640 1 Processor -- start 2024-05-30T06:45:49.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2c0a00640 1 -- start start 2024-05-30T06:45:49.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2c0a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2bc0b2e20 0x7fd2bc15e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:49.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2c0a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2bc0cd280 0x7fd2bc157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:49.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2c0a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2bc1609c0 0x7fd2bc06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:49.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2c0a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc169940 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2c0a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc1697c0 con 0x7fd2bc1609c0 2024-05-30T06:45:49.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2c0a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd2bc169ac0 con 0x7fd2bc0cd280 2024-05-30T06:45:49.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2b9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2bc0b2e20 0x7fd2bc15e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:49.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2b9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2bc0b2e20 0x7fd2bc15e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48194/0 (socket says 172.21.15.37:48194) 2024-05-30T06:45:49.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2b9e00640 1 -- 172.21.15.37:0/2444314616 learned_addr learned my addr 172.21.15.37:0/2444314616 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:49.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2b1400640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2bc0cd280 0x7fd2bc157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:49.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2ba800640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2bc1609c0 0x7fd2bc06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:49.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2b9e00640 1 -- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2bc0cd280 msgr2=0x7fd2bc157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:49.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2b9e00640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2bc0cd280 0x7fd2bc157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2b9e00640 1 -- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2bc1609c0 msgr2=0x7fd2bc06dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:49.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2b9e00640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2bc1609c0 0x7fd2bc06dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2b9e00640 1 -- 172.21.15.37:0/2444314616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc15d550 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2b9e00640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2bc0b2e20 0x7fd2bc15e5f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac01a620 tx=0x7fd2ac019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2b2a00640 1 -- 172.21.15.37:0/2444314616 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac009510 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2b2a00640 1 -- 172.21.15.37:0/2444314616 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ac0be070 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2444314616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2bc15d830 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2b2a00640 1 -- 172.21.15.37:0/2444314616 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac0b88d0 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.713+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2444314616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2bc15ddf0 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.717+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2444314616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2bc068b20 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.717+0000 7fd2b2a00640 1 -- 172.21.15.37:0/2444314616 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fd2ac0b8a70 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.717+0000 7fd2b2a00640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2980686e0 0x7fd29806aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:49.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.717+0000 7fd2b2a00640 1 -- 172.21.15.37:0/2444314616 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fd2ac122000 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.717+0000 7fd2b1400640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2980686e0 0x7fd29806aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:49.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.717+0000 7fd2b1400640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2980686e0 0x7fd29806aba0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc06e610 tx=0x7fd2a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:49.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.721+0000 7fd2b2a00640 1 -- 172.21.15.37:0/2444314616 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd2ac0165e0 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.921+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2444314616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2bc0ce860 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.921+0000 7fd2b2a00640 1 -- 172.21.15.37:0/2444314616 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5184 (secure 0 0 0) 0x7fd2ac0f2290 con 0x7fd2bc0b2e20 2024-05-30T06:45:49.923 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:49.923 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/2692603987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2692603987},{"type":"v1","addr":"172.21.15.105:6836","nonce":2692603987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5539,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2559528007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2559528007},{"type":"v1","addr":"172.21.15.105:6837","nonce":2559528007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2198221961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2198221961},{"type":"v1","addr":"172.21.15.37:6833","nonce":2198221961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:45:45.908180+0000","modified":"2024-05-30T06:45:48.930208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5652":{"gid":5652,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/115371806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":115371806},{"type":"v1","addr":"172.21.15.37:6835","nonce":115371806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5652,"qdb_cluster":[5652]},"id":3}]} 2024-05-30T06:45:49.923 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 27 2024-05-30T06:45:49.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.921+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2980686e0 msgr2=0x7fd29806aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:49.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.921+0000 7fd2c0a00640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2980686e0 0x7fd29806aba0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc06e610 tx=0x7fd2a4008040 comp rx=0 tx=0).stop 2024-05-30T06:45:49.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.921+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2444314616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2bc0b2e20 msgr2=0x7fd2bc15e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:49.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.921+0000 7fd2c0a00640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2bc0b2e20 0x7fd2bc15e5f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac01a620 tx=0x7fd2ac019790 comp rx=0 tx=0).stop 2024-05-30T06:45:49.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.925+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2444314616 shutdown_connections 2024-05-30T06:45:49.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.925+0000 7fd2c0a00640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2980686e0 0x7fd29806aba0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.925+0000 7fd2c0a00640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2bc1609c0 0x7fd2bc06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.925+0000 7fd2c0a00640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2bc0cd280 0x7fd2bc157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.925+0000 7fd2c0a00640 1 --2- 172.21.15.37:0/2444314616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2bc0b2e20 0x7fd2bc15e5f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:49.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.925+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2444314616 >> 172.21.15.37:0/2444314616 conn(0x7fd2bc0b4100 msgr2=0x7fd2bc15f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:49.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.925+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2444314616 shutdown_connections 2024-05-30T06:45:49.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:49.925+0000 7fd2c0a00640 1 -- 172.21.15.37:0/2444314616 wait complete. 2024-05-30T06:45:49.944 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:45:50.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.085+0000 7f9ab4c00640 1 Processor -- start 2024-05-30T06:45:50.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.085+0000 7f9ab4c00640 1 -- start start 2024-05-30T06:45:50.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.085+0000 7f9ab4c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9ab0160b90 0x7f9ab009aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.085+0000 7f9ab4c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab00d0430 con 0x7f9ab00b2e20 2024-05-30T06:45:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.085+0000 7f9ab4c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab00d0710 con 0x7f9ab0161020 2024-05-30T06:45:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.085+0000 7f9ab4c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab00b3200 con 0x7f9ab0160b90 2024-05-30T06:45:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.085+0000 7f9aade00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9ab00b2e20 0x7f9ab0160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57292/0 (socket says 172.21.15.37:57292) 2024-05-30T06:45:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.085+0000 7f9aade00640 1 -- 172.21.15.37:0/3076690292 learned_addr learned my addr 172.21.15.37:0/3076690292 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:50.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.085+0000 7f9aa5400640 1 --2- 172.21.15.37:0/3076690292 >> v2:172.21.15.105:3300/0 conn(0x7f9ab0160b90 0x7f9ab009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.085+0000 7f9aad400640 1 -- 172.21.15.37:0/3076690292 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1989368390 0 0) 0x7f9ab00d0430 con 0x7f9ab00b2e20 2024-05-30T06:45:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.085+0000 7f9aad400640 1 -- 172.21.15.37:0/3076690292 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a94003530 con 0x7f9ab00b2e20 2024-05-30T06:45:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.089+0000 7f9aa5400640 1 -- 172.21.15.37:0/3076690292 >> v1:172.21.15.105:6789/0 conn(0x7f9ab0161020 legacy=0x7f9ab009afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.089+0000 7f9aa5400640 1 -- 172.21.15.37:0/3076690292 >> v1:172.21.15.37:6789/0 conn(0x7f9ab00b2e20 legacy=0x7f9ab0160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.089+0000 7f9aa5400640 1 -- 172.21.15.37:0/3076690292 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab00b35f0 con 0x7f9ab0160b90 2024-05-30T06:45:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.089+0000 7f9aa5400640 1 --2- 172.21.15.37:0/3076690292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab0160b90 0x7f9ab009aa60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9a980097c0 tx=0x7f9a9801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bf1b272c22ecc8f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.089+0000 7f9aad400640 1 -- 172.21.15.37:0/3076690292 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a980b0070 con 0x7f9ab0160b90 2024-05-30T06:45:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.089+0000 7f9aad400640 1 -- 172.21.15.37:0/3076690292 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a980ab600 con 0x7f9ab0160b90 2024-05-30T06:45:50.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.089+0000 7f9aad400640 1 -- 172.21.15.37:0/3076690292 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a980ab9d0 con 0x7f9ab0160b90 2024-05-30T06:45:50.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.089+0000 7f9ab4c00640 1 -- 172.21.15.37:0/3076690292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab0160b90 msgr2=0x7f9ab009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.089+0000 7f9ab4c00640 1 --2- 172.21.15.37:0/3076690292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab0160b90 0x7f9ab009aa60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9a980097c0 tx=0x7f9a9801c480 comp rx=0 tx=0).stop 2024-05-30T06:45:50.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.089+0000 7f9ab4c00640 1 -- 172.21.15.37:0/3076690292 shutdown_connections 2024-05-30T06:45:50.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.089+0000 7f9ab4c00640 1 --2- 172.21.15.37:0/3076690292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab0160b90 0x7f9ab009aa60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.089+0000 7f9ab4c00640 1 -- 172.21.15.37:0/3076690292 >> 172.21.15.37:0/3076690292 conn(0x7f9ab00b4100 msgr2=0x7f9ab00b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.089+0000 7f9ab4c00640 1 -- 172.21.15.37:0/3076690292 shutdown_connections 2024-05-30T06:45:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9ab4c00640 1 -- 172.21.15.37:0/3076690292 wait complete. 2024-05-30T06:45:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9ab4c00640 1 Processor -- start 2024-05-30T06:45:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9ab4c00640 1 -- start start 2024-05-30T06:45:50.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9ab4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab00b2e20 0x7f9ab00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9ab4c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab0160b90 0x7f9ab00af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9ab4c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab0161020 0x7f9ab00c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9ab4c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab016a950 con 0x7f9ab00b2e20 2024-05-30T06:45:50.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9ab4c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab016a7d0 con 0x7f9ab0161020 2024-05-30T06:45:50.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9ab4c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab016aad0 con 0x7f9ab0160b90 2024-05-30T06:45:50.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aade00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab00b2e20 0x7f9ab00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aade00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab00b2e20 0x7f9ab00b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48204/0 (socket says 172.21.15.37:48204) 2024-05-30T06:45:50.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aade00640 1 -- 172.21.15.37:0/2869356599 learned_addr learned my addr 172.21.15.37:0/2869356599 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:50.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aae800640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab0161020 0x7f9ab00c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aa5400640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab0160b90 0x7f9ab00af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aade00640 1 -- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab0160b90 msgr2=0x7f9ab00af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aade00640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab0160b90 0x7f9ab00af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aade00640 1 -- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab0161020 msgr2=0x7f9ab00c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aade00640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab0161020 0x7f9ab00c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aade00640 1 -- 172.21.15.37:0/2869356599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab00b2120 con 0x7f9ab00b2e20 2024-05-30T06:45:50.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aade00640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab00b2e20 0x7f9ab00b1b40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000c420 tx=0x7f9aa000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:50.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aa6a00640 1 -- 172.21.15.37:0/2869356599 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0017070 con 0x7f9ab00b2e20 2024-05-30T06:45:50.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aa6a00640 1 -- 172.21.15.37:0/2869356599 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa0005cf0 con 0x7f9ab00b2e20 2024-05-30T06:45:50.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9aa6a00640 1 -- 172.21.15.37:0/2869356599 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00072d0 con 0x7f9ab00b2e20 2024-05-30T06:45:50.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.093+0000 7f9ab4c00640 1 -- 172.21.15.37:0/2869356599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab00b6680 con 0x7f9ab00b2e20 2024-05-30T06:45:50.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.097+0000 7f9ab4c00640 1 -- 172.21.15.37:0/2869356599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab00b6c40 con 0x7f9ab00b2e20 2024-05-30T06:45:50.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.097+0000 7f9ab4c00640 1 -- 172.21.15.37:0/2869356599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab0068b20 con 0x7f9ab00b2e20 2024-05-30T06:45:50.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.097+0000 7f9aa6a00640 1 -- 172.21.15.37:0/2869356599 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f9aa001a070 con 0x7f9ab00b2e20 2024-05-30T06:45:50.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.097+0000 7f9aa6a00640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a8c0686e0 0x7f9a8c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.097+0000 7f9aa6a00640 1 -- 172.21.15.37:0/2869356599 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f9aa0086380 con 0x7f9ab00b2e20 2024-05-30T06:45:50.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.097+0000 7f9aa5400640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a8c0686e0 0x7f9a8c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.101+0000 7f9aa5400640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a8c0686e0 0x7f9a8c06aba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9a980ad000 tx=0x7f9a98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:50.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.101+0000 7f9aa6a00640 1 -- 172.21.15.37:0/2869356599 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9aa0055da0 con 0x7f9ab00b2e20 2024-05-30T06:45:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.353+0000 7f9ab4c00640 1 -- 172.21.15.37:0/2869356599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ab00ce860 con 0x7f9ab00b2e20 2024-05-30T06:45:50.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.353+0000 7f9aa6a00640 1 -- 172.21.15.37:0/2869356599 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16601 (secure 0 0 0) 0x7f9aa005a0a0 con 0x7f9ab00b2e20 2024-05-30T06:45:50.354 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:50.354 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":46,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:45:47.499631+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:45:44.283575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T06:45:44.856243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:45:50.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.353+0000 7f9ab4c00640 1 -- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a8c0686e0 msgr2=0x7f9a8c06aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.353+0000 7f9ab4c00640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a8c0686e0 0x7f9a8c06aba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9a980ad000 tx=0x7f9a98008040 comp rx=0 tx=0).stop 2024-05-30T06:45:50.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.353+0000 7f9ab4c00640 1 -- 172.21.15.37:0/2869356599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab00b2e20 msgr2=0x7f9ab00b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.353+0000 7f9ab4c00640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab00b2e20 0x7f9ab00b1b40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000c420 tx=0x7f9aa000c8e0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.353+0000 7f9ab4c00640 1 -- 172.21.15.37:0/2869356599 shutdown_connections 2024-05-30T06:45:50.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.353+0000 7f9ab4c00640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a8c0686e0 0x7f9a8c06aba0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.357+0000 7f9ab4c00640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ab0161020 0x7f9ab00c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.357+0000 7f9ab4c00640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ab0160b90 0x7f9ab00af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.357+0000 7f9ab4c00640 1 --2- 172.21.15.37:0/2869356599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ab00b2e20 0x7f9ab00b1b40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.357+0000 7f9ab4c00640 1 -- 172.21.15.37:0/2869356599 >> 172.21.15.37:0/2869356599 conn(0x7f9ab00b4100 msgr2=0x7f9ab009aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:50.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.357+0000 7f9ab4c00640 1 -- 172.21.15.37:0/2869356599 shutdown_connections 2024-05-30T06:45:50.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.357+0000 7f9ab4c00640 1 -- 172.21.15.37:0/2869356599 wait complete. 2024-05-30T06:45:50.378 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-30T06:45:50.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:45:50.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.517+0000 7f5e08e00640 1 Processor -- start 2024-05-30T06:45:50.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.517+0000 7f5e08e00640 1 -- start start 2024-05-30T06:45:50.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.521+0000 7f5e08e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e040b2e20 0x7f5e04160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.521+0000 7f5e08e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e0409ba70 0x7f5e04160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.521+0000 7f5e08e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e040d0430 con 0x7f5e041609c0 2024-05-30T06:45:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.521+0000 7f5e08e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5e040b3200 con 0x7f5e0409ba70 2024-05-30T06:45:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.521+0000 7f5e08e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5e040d01e0 con 0x7f5e040b2e20 2024-05-30T06:45:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.521+0000 7f5e02800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e0409ba70 0x7f5e04160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.521+0000 7f5e02800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e0409ba70 0x7f5e04160e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48212/0 (socket says 172.21.15.37:48212) 2024-05-30T06:45:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.521+0000 7f5e02800640 1 -- 172.21.15.37:0/2678933273 learned_addr learned my addr 172.21.15.37:0/2678933273 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.521+0000 7f5e01e00640 1 --2- 172.21.15.37:0/2678933273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e040b2e20 0x7f5e04160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.521+0000 7f5e02800640 1 -- 172.21.15.37:0/2678933273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e040b2e20 msgr2=0x7f5e04160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.521+0000 7f5e02800640 1 --2- 172.21.15.37:0/2678933273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e040b2e20 0x7f5e04160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.521+0000 7f5e02800640 1 -- 172.21.15.37:0/2678933273 >> v1:172.21.15.105:6789/0 conn(0x7f5e041609c0 legacy=0x7f5e040cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.521+0000 7f5e02800640 1 -- 172.21.15.37:0/2678933273 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e040d0710 con 0x7f5e0409ba70 2024-05-30T06:45:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e02800640 1 --2- 172.21.15.37:0/2678933273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e0409ba70 0x7f5e04160e20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009870 tx=0x7f5dfc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abeb30f90c17089 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e01400640 1 -- 172.21.15.37:0/2678933273 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc0ab650 con 0x7f5e0409ba70 2024-05-30T06:45:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e01400640 1 -- 172.21.15.37:0/2678933273 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dfc0b0070 con 0x7f5e0409ba70 2024-05-30T06:45:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e01400640 1 -- 172.21.15.37:0/2678933273 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc0aba10 con 0x7f5e0409ba70 2024-05-30T06:45:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 -- 172.21.15.37:0/2678933273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e0409ba70 msgr2=0x7f5e04160e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 --2- 172.21.15.37:0/2678933273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e0409ba70 0x7f5e04160e20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009870 tx=0x7f5dfc01c560 comp rx=0 tx=0).stop 2024-05-30T06:45:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 -- 172.21.15.37:0/2678933273 shutdown_connections 2024-05-30T06:45:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 --2- 172.21.15.37:0/2678933273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e0409ba70 0x7f5e04160e20 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 --2- 172.21.15.37:0/2678933273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e040b2e20 0x7f5e04160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 -- 172.21.15.37:0/2678933273 >> 172.21.15.37:0/2678933273 conn(0x7f5e040b4100 msgr2=0x7f5e040b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 -- 172.21.15.37:0/2678933273 shutdown_connections 2024-05-30T06:45:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 -- 172.21.15.37:0/2678933273 wait complete. 2024-05-30T06:45:50.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 Processor -- start 2024-05-30T06:45:50.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 -- start start 2024-05-30T06:45:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0409ba70 0x7f5e040b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e040b2e20 0x7f5e041551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e041609c0 0x7f5e041586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e040ce320 con 0x7f5e041609c0 2024-05-30T06:45:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5e040ce1a0 con 0x7f5e0409ba70 2024-05-30T06:45:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.525+0000 7f5e08e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5e040b64e0 con 0x7f5e040b2e20 2024-05-30T06:45:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e01e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0409ba70 0x7f5e040b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e01e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0409ba70 0x7f5e040b6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:42898/0 (socket says 172.21.15.37:42898) 2024-05-30T06:45:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e01e00640 1 -- 172.21.15.37:0/3473219675 learned_addr learned my addr 172.21.15.37:0/3473219675 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e02800640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e041609c0 0x7f5e041586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5df9400640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e040b2e20 0x7f5e041551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e01e00640 1 -- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e040b2e20 msgr2=0x7f5e041551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e01e00640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e040b2e20 0x7f5e041551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e01e00640 1 -- 172.21.15.37:0/3473219675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e041609c0 msgr2=0x7f5e041586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e01e00640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e041609c0 0x7f5e041586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e01e00640 1 -- 172.21.15.37:0/3473219675 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e041556e0 con 0x7f5e0409ba70 2024-05-30T06:45:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e02800640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e041609c0 0x7f5e041586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e01e00640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0409ba70 0x7f5e040b6970 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5df400e930 tx=0x7f5df400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5dfaa00640 1 -- 172.21.15.37:0/3473219675 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4017070 con 0x7f5e0409ba70 2024-05-30T06:45:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5dfaa00640 1 -- 172.21.15.37:0/3473219675 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df400ca00 con 0x7f5e0409ba70 2024-05-30T06:45:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e08e00640 1 -- 172.21.15.37:0/3473219675 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e040b58d0 con 0x7f5e0409ba70 2024-05-30T06:45:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5dfaa00640 1 -- 172.21.15.37:0/3473219675 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df400cdb0 con 0x7f5e0409ba70 2024-05-30T06:45:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e08e00640 1 -- 172.21.15.37:0/3473219675 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e040b5e90 con 0x7f5e0409ba70 2024-05-30T06:45:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5e08e00640 1 -- 172.21.15.37:0/3473219675 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e04068b20 con 0x7f5e0409ba70 2024-05-30T06:45:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.529+0000 7f5dfaa00640 1 -- 172.21.15.37:0/3473219675 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f5df401a070 con 0x7f5e0409ba70 2024-05-30T06:45:50.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.533+0000 7f5dfaa00640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5de00686e0 0x7f5de006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.533+0000 7f5dfaa00640 1 -- 172.21.15.37:0/3473219675 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f5df40875e0 con 0x7f5e0409ba70 2024-05-30T06:45:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.533+0000 7f5df9400640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5de00686e0 0x7f5de006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.533+0000 7f5df9400640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5de00686e0 0x7f5de006aba0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5e040b2410 tx=0x7f5dec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:50.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.537+0000 7f5dfaa00640 1 -- 172.21.15.37:0/3473219675 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5df40571c0 con 0x7f5e0409ba70 2024-05-30T06:45:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.701+0000 7f5e08e00640 1 -- 172.21.15.37:0/3473219675 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e040ce860 con 0x7f5de00686e0 2024-05-30T06:45:50.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.709+0000 7f5dfaa00640 1 -- 172.21.15.37:0/3473219675 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251957 (secure 0 0 0) 0x7f5e040ce860 con 0x7f5de00686e0 2024-05-30T06:45:50.712 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:50.713 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:45:50.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.713+0000 7f5e08e00640 1 -- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5de00686e0 msgr2=0x7f5de006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.713+0000 7f5e08e00640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5de00686e0 0x7f5de006aba0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5e040b2410 tx=0x7f5dec009040 comp rx=0 tx=0).stop 2024-05-30T06:45:50.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.713+0000 7f5e08e00640 1 -- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0409ba70 msgr2=0x7f5e040b6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.713+0000 7f5e08e00640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0409ba70 0x7f5e040b6970 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5df400e930 tx=0x7f5df400edf0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.713+0000 7f5e08e00640 1 -- 172.21.15.37:0/3473219675 shutdown_connections 2024-05-30T06:45:50.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.713+0000 7f5e08e00640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e041609c0 0x7f5e041586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.713+0000 7f5e08e00640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e040b2e20 0x7f5e041551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.713+0000 7f5e08e00640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5de00686e0 0x7f5de006aba0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.713+0000 7f5e08e00640 1 --2- 172.21.15.37:0/3473219675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0409ba70 0x7f5e040b6970 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.713+0000 7f5e08e00640 1 -- 172.21.15.37:0/3473219675 >> 172.21.15.37:0/3473219675 conn(0x7f5e040b4100 msgr2=0x7f5e04160e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:50.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.713+0000 7f5e08e00640 1 -- 172.21.15.37:0/3473219675 shutdown_connections 2024-05-30T06:45:50.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.713+0000 7f5e08e00640 1 -- 172.21.15.37:0/3473219675 wait complete. 2024-05-30T06:45:50.732 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-05-30T06:45:50.700267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279856,"kb_used_data":5424,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754694864,"statfs":{"total":773094113280,"available":772807540736,"internally_reserved":0,"allocated":5554176,"data_stored":2952420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001354"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922516+0000","last_change":"2024-05-30T06:45:46.515300+0000","last_active":"2024-05-30T06:45:47.922516+0000","last_peered":"2024-05-30T06:45:47.922516+0000","last_clean":"2024-05-30T06:45:47.922516+0000","last_became_active":"2024-05-30T06:45:46.515026+0000","last_became_peered":"2024-05-30T06:45:46.515026+0000","last_unstale":"2024-05-30T06:45:47.922516+0000","last_undegraded":"2024-05-30T06:45:47.922516+0000","last_fullsized":"2024-05-30T06:45:47.922516+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:13:34.267107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506898+0000","last_change":"2024-05-30T06:45:46.526353+0000","last_active":"2024-05-30T06:45:47.506898+0000","last_peered":"2024-05-30T06:45:47.506898+0000","last_clean":"2024-05-30T06:45:47.506898+0000","last_became_active":"2024-05-30T06:45:46.526056+0000","last_became_peered":"2024-05-30T06:45:46.526056+0000","last_unstale":"2024-05-30T06:45:47.506898+0000","last_undegraded":"2024-05-30T06:45:47.506898+0000","last_fullsized":"2024-05-30T06:45:47.506898+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:23:40.287149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.419833+0000","last_change":"2024-05-30T06:45:46.536697+0000","last_active":"2024-05-30T06:45:48.419833+0000","last_peered":"2024-05-30T06:45:48.419833+0000","last_clean":"2024-05-30T06:45:48.419833+0000","last_became_active":"2024-05-30T06:45:46.536400+0000","last_became_peered":"2024-05-30T06:45:46.536400+0000","last_unstale":"2024-05-30T06:45:48.419833+0000","last_undegraded":"2024-05-30T06:45:48.419833+0000","last_fullsized":"2024-05-30T06:45:48.419833+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:43.737263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421519+0000","last_change":"2024-05-30T06:45:46.528827+0000","last_active":"2024-05-30T06:45:48.421519+0000","last_peered":"2024-05-30T06:45:48.421519+0000","last_clean":"2024-05-30T06:45:48.421519+0000","last_became_active":"2024-05-30T06:45:46.528511+0000","last_became_peered":"2024-05-30T06:45:46.528511+0000","last_unstale":"2024-05-30T06:45:48.421519+0000","last_undegraded":"2024-05-30T06:45:48.421519+0000","last_fullsized":"2024-05-30T06:45:48.421519+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:15.085899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507000+0000","last_change":"2024-05-30T06:45:46.521030+0000","last_active":"2024-05-30T06:45:47.507000+0000","last_peered":"2024-05-30T06:45:47.507000+0000","last_clean":"2024-05-30T06:45:47.507000+0000","last_became_active":"2024-05-30T06:45:46.520749+0000","last_became_peered":"2024-05-30T06:45:46.520749+0000","last_unstale":"2024-05-30T06:45:47.507000+0000","last_undegraded":"2024-05-30T06:45:47.507000+0000","last_fullsized":"2024-05-30T06:45:47.507000+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:13:34.267107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420343+0000","last_change":"2024-05-30T06:45:46.520381+0000","last_active":"2024-05-30T06:45:48.420343+0000","last_peered":"2024-05-30T06:45:48.420343+0000","last_clean":"2024-05-30T06:45:48.420343+0000","last_became_active":"2024-05-30T06:45:46.519229+0000","last_became_peered":"2024-05-30T06:45:46.519229+0000","last_unstale":"2024-05-30T06:45:48.420343+0000","last_undegraded":"2024-05-30T06:45:48.420343+0000","last_fullsized":"2024-05-30T06:45:48.420343+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:36:25.701950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922692+0000","last_change":"2024-05-30T06:45:46.528145+0000","last_active":"2024-05-30T06:45:47.922692+0000","last_peered":"2024-05-30T06:45:47.922692+0000","last_clean":"2024-05-30T06:45:47.922692+0000","last_became_active":"2024-05-30T06:45:46.527863+0000","last_became_peered":"2024-05-30T06:45:46.527863+0000","last_unstale":"2024-05-30T06:45:47.922692+0000","last_undegraded":"2024-05-30T06:45:47.922692+0000","last_fullsized":"2024-05-30T06:45:47.922692+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:37:11.137947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420952+0000","last_change":"2024-05-30T06:45:46.531510+0000","last_active":"2024-05-30T06:45:48.420952+0000","last_peered":"2024-05-30T06:45:48.420952+0000","last_clean":"2024-05-30T06:45:48.420952+0000","last_became_active":"2024-05-30T06:45:46.531241+0000","last_became_peered":"2024-05-30T06:45:46.531241+0000","last_unstale":"2024-05-30T06:45:48.420952+0000","last_undegraded":"2024-05-30T06:45:48.420952+0000","last_fullsized":"2024-05-30T06:45:48.420952+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:16:56.786714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421725+0000","last_change":"2024-05-30T06:45:46.532613+0000","last_active":"2024-05-30T06:45:48.421725+0000","last_peered":"2024-05-30T06:45:48.421725+0000","last_clean":"2024-05-30T06:45:48.421725+0000","last_became_active":"2024-05-30T06:45:46.532340+0000","last_became_peered":"2024-05-30T06:45:46.532340+0000","last_unstale":"2024-05-30T06:45:48.421725+0000","last_undegraded":"2024-05-30T06:45:48.421725+0000","last_fullsized":"2024-05-30T06:45:48.421725+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:57:29.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421596+0000","last_change":"2024-05-30T06:45:46.526282+0000","last_active":"2024-05-30T06:45:48.421596+0000","last_peered":"2024-05-30T06:45:48.421596+0000","last_clean":"2024-05-30T06:45:48.421596+0000","last_became_active":"2024-05-30T06:45:46.525967+0000","last_became_peered":"2024-05-30T06:45:46.525967+0000","last_unstale":"2024-05-30T06:45:48.421596+0000","last_undegraded":"2024-05-30T06:45:48.421596+0000","last_fullsized":"2024-05-30T06:45:48.421596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:31:09.771704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421525+0000","last_change":"2024-05-30T06:45:46.532925+0000","last_active":"2024-05-30T06:45:48.421525+0000","last_peered":"2024-05-30T06:45:48.421525+0000","last_clean":"2024-05-30T06:45:48.421525+0000","last_became_active":"2024-05-30T06:45:46.532615+0000","last_became_peered":"2024-05-30T06:45:46.532615+0000","last_unstale":"2024-05-30T06:45:48.421525+0000","last_undegraded":"2024-05-30T06:45:48.421525+0000","last_fullsized":"2024-05-30T06:45:48.421525+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:59:15.051983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507050+0000","last_change":"2024-05-30T06:45:46.536210+0000","last_active":"2024-05-30T06:45:47.507050+0000","last_peered":"2024-05-30T06:45:47.507050+0000","last_clean":"2024-05-30T06:45:47.507050+0000","last_became_active":"2024-05-30T06:45:46.535800+0000","last_became_peered":"2024-05-30T06:45:46.535800+0000","last_unstale":"2024-05-30T06:45:47.507050+0000","last_undegraded":"2024-05-30T06:45:47.507050+0000","last_fullsized":"2024-05-30T06:45:47.507050+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:53:25.192521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507779+0000","last_change":"2024-05-30T06:45:46.536356+0000","last_active":"2024-05-30T06:45:47.507779+0000","last_peered":"2024-05-30T06:45:47.507779+0000","last_clean":"2024-05-30T06:45:47.507779+0000","last_became_active":"2024-05-30T06:45:46.536046+0000","last_became_peered":"2024-05-30T06:45:46.536046+0000","last_unstale":"2024-05-30T06:45:47.507779+0000","last_undegraded":"2024-05-30T06:45:47.507779+0000","last_fullsized":"2024-05-30T06:45:47.507779+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:46:15.512249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420413+0000","last_change":"2024-05-30T06:45:46.525471+0000","last_active":"2024-05-30T06:45:48.420413+0000","last_peered":"2024-05-30T06:45:48.420413+0000","last_clean":"2024-05-30T06:45:48.420413+0000","last_became_active":"2024-05-30T06:45:46.525152+0000","last_became_peered":"2024-05-30T06:45:46.525152+0000","last_unstale":"2024-05-30T06:45:48.420413+0000","last_undegraded":"2024-05-30T06:45:48.420413+0000","last_fullsized":"2024-05-30T06:45:48.420413+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:27:19.227867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421072+0000","last_change":"2024-05-30T06:45:46.509121+0000","last_active":"2024-05-30T06:45:48.421072+0000","last_peered":"2024-05-30T06:45:48.421072+0000","last_clean":"2024-05-30T06:45:48.421072+0000","last_became_active":"2024-05-30T06:45:46.508805+0000","last_became_peered":"2024-05-30T06:45:46.508805+0000","last_unstale":"2024-05-30T06:45:48.421072+0000","last_undegraded":"2024-05-30T06:45:48.421072+0000","last_fullsized":"2024-05-30T06:45:48.421072+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:53.636035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420179+0000","last_change":"2024-05-30T06:45:46.531235+0000","last_active":"2024-05-30T06:45:48.420179+0000","last_peered":"2024-05-30T06:45:48.420179+0000","last_clean":"2024-05-30T06:45:48.420179+0000","last_became_active":"2024-05-30T06:45:46.530437+0000","last_became_peered":"2024-05-30T06:45:46.530437+0000","last_unstale":"2024-05-30T06:45:48.420179+0000","last_undegraded":"2024-05-30T06:45:48.420179+0000","last_fullsized":"2024-05-30T06:45:48.420179+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:42.317647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420567+0000","last_change":"2024-05-30T06:45:46.507190+0000","last_active":"2024-05-30T06:45:48.420567+0000","last_peered":"2024-05-30T06:45:48.420567+0000","last_clean":"2024-05-30T06:45:48.420567+0000","last_became_active":"2024-05-30T06:45:46.506745+0000","last_became_peered":"2024-05-30T06:45:46.506745+0000","last_unstale":"2024-05-30T06:45:48.420567+0000","last_undegraded":"2024-05-30T06:45:48.420567+0000","last_fullsized":"2024-05-30T06:45:48.420567+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:15.085899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420020+0000","last_change":"2024-05-30T06:45:46.529140+0000","last_active":"2024-05-30T06:45:48.420020+0000","last_peered":"2024-05-30T06:45:48.420020+0000","last_clean":"2024-05-30T06:45:48.420020+0000","last_became_active":"2024-05-30T06:45:46.528643+0000","last_became_peered":"2024-05-30T06:45:46.528643+0000","last_unstale":"2024-05-30T06:45:48.420020+0000","last_undegraded":"2024-05-30T06:45:48.420020+0000","last_fullsized":"2024-05-30T06:45:48.420020+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:16:56.786714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420836+0000","last_change":"2024-05-30T06:45:46.529627+0000","last_active":"2024-05-30T06:45:48.420836+0000","last_peered":"2024-05-30T06:45:48.420836+0000","last_clean":"2024-05-30T06:45:48.420836+0000","last_became_active":"2024-05-30T06:45:46.529291+0000","last_became_peered":"2024-05-30T06:45:46.529291+0000","last_unstale":"2024-05-30T06:45:48.420836+0000","last_undegraded":"2024-05-30T06:45:48.420836+0000","last_fullsized":"2024-05-30T06:45:48.420836+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:11:29.188192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507962+0000","last_change":"2024-05-30T06:45:46.533168+0000","last_active":"2024-05-30T06:45:47.507962+0000","last_peered":"2024-05-30T06:45:47.507962+0000","last_clean":"2024-05-30T06:45:47.507962+0000","last_became_active":"2024-05-30T06:45:46.532824+0000","last_became_peered":"2024-05-30T06:45:46.532824+0000","last_unstale":"2024-05-30T06:45:47.507962+0000","last_undegraded":"2024-05-30T06:45:47.507962+0000","last_fullsized":"2024-05-30T06:45:47.507962+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:19:07.941057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421637+0000","last_change":"2024-05-30T06:45:46.525663+0000","last_active":"2024-05-30T06:45:48.421637+0000","last_peered":"2024-05-30T06:45:48.421637+0000","last_clean":"2024-05-30T06:45:48.421637+0000","last_became_active":"2024-05-30T06:45:46.525446+0000","last_became_peered":"2024-05-30T06:45:46.525446+0000","last_unstale":"2024-05-30T06:45:48.421637+0000","last_undegraded":"2024-05-30T06:45:48.421637+0000","last_fullsized":"2024-05-30T06:45:48.421637+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:04:45.382725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421182+0000","last_change":"2024-05-30T06:45:46.534217+0000","last_active":"2024-05-30T06:45:48.421182+0000","last_peered":"2024-05-30T06:45:48.421182+0000","last_clean":"2024-05-30T06:45:48.421182+0000","last_became_active":"2024-05-30T06:45:46.528651+0000","last_became_peered":"2024-05-30T06:45:46.528651+0000","last_unstale":"2024-05-30T06:45:48.421182+0000","last_undegraded":"2024-05-30T06:45:48.421182+0000","last_fullsized":"2024-05-30T06:45:48.421182+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:33:42.703397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420291+0000","last_change":"2024-05-30T06:45:46.518839+0000","last_active":"2024-05-30T06:45:48.420291+0000","last_peered":"2024-05-30T06:45:48.420291+0000","last_clean":"2024-05-30T06:45:48.420291+0000","last_became_active":"2024-05-30T06:45:46.518576+0000","last_became_peered":"2024-05-30T06:45:46.518576+0000","last_unstale":"2024-05-30T06:45:48.420291+0000","last_undegraded":"2024-05-30T06:45:48.420291+0000","last_fullsized":"2024-05-30T06:45:48.420291+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:19:07.941057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420333+0000","last_change":"2024-05-30T06:45:46.517741+0000","last_active":"2024-05-30T06:45:48.420333+0000","last_peered":"2024-05-30T06:45:48.420333+0000","last_clean":"2024-05-30T06:45:48.420333+0000","last_became_active":"2024-05-30T06:45:46.517443+0000","last_became_peered":"2024-05-30T06:45:46.517443+0000","last_unstale":"2024-05-30T06:45:48.420333+0000","last_undegraded":"2024-05-30T06:45:48.420333+0000","last_fullsized":"2024-05-30T06:45:48.420333+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:32:38.601800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420330+0000","last_change":"2024-05-30T06:45:46.531832+0000","last_active":"2024-05-30T06:45:48.420330+0000","last_peered":"2024-05-30T06:45:48.420330+0000","last_clean":"2024-05-30T06:45:48.420330+0000","last_became_active":"2024-05-30T06:45:46.531547+0000","last_became_peered":"2024-05-30T06:45:46.531547+0000","last_unstale":"2024-05-30T06:45:48.420330+0000","last_undegraded":"2024-05-30T06:45:48.420330+0000","last_fullsized":"2024-05-30T06:45:48.420330+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:19:56.704717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507896+0000","last_change":"2024-05-30T06:45:46.530085+0000","last_active":"2024-05-30T06:45:47.507896+0000","last_peered":"2024-05-30T06:45:47.507896+0000","last_clean":"2024-05-30T06:45:47.507896+0000","last_became_active":"2024-05-30T06:45:46.527488+0000","last_became_peered":"2024-05-30T06:45:46.527488+0000","last_unstale":"2024-05-30T06:45:47.507896+0000","last_undegraded":"2024-05-30T06:45:47.507896+0000","last_fullsized":"2024-05-30T06:45:47.507896+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:42.317647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420489+0000","last_change":"2024-05-30T06:45:46.507073+0000","last_active":"2024-05-30T06:45:48.420489+0000","last_peered":"2024-05-30T06:45:48.420489+0000","last_clean":"2024-05-30T06:45:48.420489+0000","last_became_active":"2024-05-30T06:45:46.506775+0000","last_became_peered":"2024-05-30T06:45:46.506775+0000","last_unstale":"2024-05-30T06:45:48.420489+0000","last_undegraded":"2024-05-30T06:45:48.420489+0000","last_fullsized":"2024-05-30T06:45:48.420489+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:58.784375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507156+0000","last_change":"2024-05-30T06:45:46.536235+0000","last_active":"2024-05-30T06:45:47.507156+0000","last_peered":"2024-05-30T06:45:47.507156+0000","last_clean":"2024-05-30T06:45:47.507156+0000","last_became_active":"2024-05-30T06:45:46.535795+0000","last_became_peered":"2024-05-30T06:45:46.535795+0000","last_unstale":"2024-05-30T06:45:47.507156+0000","last_undegraded":"2024-05-30T06:45:47.507156+0000","last_fullsized":"2024-05-30T06:45:47.507156+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:12.891977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420778+0000","last_change":"2024-05-30T06:45:46.524842+0000","last_active":"2024-05-30T06:45:48.420778+0000","last_peered":"2024-05-30T06:45:48.420778+0000","last_clean":"2024-05-30T06:45:48.420778+0000","last_became_active":"2024-05-30T06:45:46.524559+0000","last_became_peered":"2024-05-30T06:45:46.524559+0000","last_unstale":"2024-05-30T06:45:48.420778+0000","last_undegraded":"2024-05-30T06:45:48.420778+0000","last_fullsized":"2024-05-30T06:45:48.420778+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:51:09.393804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.419750+0000","last_change":"2024-05-30T06:45:46.510554+0000","last_active":"2024-05-30T06:45:48.419750+0000","last_peered":"2024-05-30T06:45:48.419750+0000","last_clean":"2024-05-30T06:45:48.419750+0000","last_became_active":"2024-05-30T06:45:46.510292+0000","last_became_peered":"2024-05-30T06:45:46.510292+0000","last_unstale":"2024-05-30T06:45:48.419750+0000","last_undegraded":"2024-05-30T06:45:48.419750+0000","last_fullsized":"2024-05-30T06:45:48.419750+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:21:12.390635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420347+0000","last_change":"2024-05-30T06:45:46.510157+0000","last_active":"2024-05-30T06:45:48.420347+0000","last_peered":"2024-05-30T06:45:48.420347+0000","last_clean":"2024-05-30T06:45:48.420347+0000","last_became_active":"2024-05-30T06:45:46.509860+0000","last_became_peered":"2024-05-30T06:45:46.509860+0000","last_unstale":"2024-05-30T06:45:48.420347+0000","last_undegraded":"2024-05-30T06:45:48.420347+0000","last_fullsized":"2024-05-30T06:45:48.420347+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:43:48.711481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507577+0000","last_change":"2024-05-30T06:45:46.540023+0000","last_active":"2024-05-30T06:45:47.507577+0000","last_peered":"2024-05-30T06:45:47.507577+0000","last_clean":"2024-05-30T06:45:47.507577+0000","last_became_active":"2024-05-30T06:45:46.539636+0000","last_became_peered":"2024-05-30T06:45:46.539636+0000","last_unstale":"2024-05-30T06:45:47.507577+0000","last_undegraded":"2024-05-30T06:45:47.507577+0000","last_fullsized":"2024-05-30T06:45:47.507577+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:13.854205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506460+0000","last_change":"2024-05-30T06:45:46.538788+0000","last_active":"2024-05-30T06:45:47.506460+0000","last_peered":"2024-05-30T06:45:47.506460+0000","last_clean":"2024-05-30T06:45:47.506460+0000","last_became_active":"2024-05-30T06:45:46.538521+0000","last_became_peered":"2024-05-30T06:45:46.538521+0000","last_unstale":"2024-05-30T06:45:47.506460+0000","last_undegraded":"2024-05-30T06:45:47.506460+0000","last_fullsized":"2024-05-30T06:45:47.506460+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:21:12.390635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421448+0000","last_change":"2024-05-30T06:45:45.511345+0000","last_active":"2024-05-30T06:45:48.421448+0000","last_peered":"2024-05-30T06:45:48.421448+0000","last_clean":"2024-05-30T06:45:48.421448+0000","last_became_active":"2024-05-30T06:45:45.511081+0000","last_became_peered":"2024-05-30T06:45:45.511081+0000","last_unstale":"2024-05-30T06:45:48.421448+0000","last_undegraded":"2024-05-30T06:45:48.421448+0000","last_fullsized":"2024-05-30T06:45:48.421448+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:36:21.790531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420567+0000","last_change":"2024-05-30T06:45:46.519498+0000","last_active":"2024-05-30T06:45:48.420567+0000","last_peered":"2024-05-30T06:45:48.420567+0000","last_clean":"2024-05-30T06:45:48.420567+0000","last_became_active":"2024-05-30T06:45:46.518943+0000","last_became_peered":"2024-05-30T06:45:46.518943+0000","last_unstale":"2024-05-30T06:45:48.420567+0000","last_undegraded":"2024-05-30T06:45:48.420567+0000","last_fullsized":"2024-05-30T06:45:48.420567+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:49:45.035621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420289+0000","last_change":"2024-05-30T06:45:45.511513+0000","last_active":"2024-05-30T06:45:48.420289+0000","last_peered":"2024-05-30T06:45:48.420289+0000","last_clean":"2024-05-30T06:45:48.420289+0000","last_became_active":"2024-05-30T06:45:45.511236+0000","last_became_peered":"2024-05-30T06:45:45.511236+0000","last_unstale":"2024-05-30T06:45:48.420289+0000","last_undegraded":"2024-05-30T06:45:48.420289+0000","last_fullsized":"2024-05-30T06:45:48.420289+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:32:37.598684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507248+0000","last_change":"2024-05-30T06:45:46.512931+0000","last_active":"2024-05-30T06:45:47.507248+0000","last_peered":"2024-05-30T06:45:47.507248+0000","last_clean":"2024-05-30T06:45:47.507248+0000","last_became_active":"2024-05-30T06:45:46.512580+0000","last_became_peered":"2024-05-30T06:45:46.512580+0000","last_unstale":"2024-05-30T06:45:47.507248+0000","last_undegraded":"2024-05-30T06:45:47.507248+0000","last_fullsized":"2024-05-30T06:45:47.507248+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:49:01.166450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506687+0000","last_change":"2024-05-30T06:45:45.523045+0000","last_active":"2024-05-30T06:45:47.506687+0000","last_peered":"2024-05-30T06:45:47.506687+0000","last_clean":"2024-05-30T06:45:47.506687+0000","last_became_active":"2024-05-30T06:45:45.521858+0000","last_became_peered":"2024-05-30T06:45:45.521858+0000","last_unstale":"2024-05-30T06:45:47.506687+0000","last_undegraded":"2024-05-30T06:45:47.506687+0000","last_fullsized":"2024-05-30T06:45:47.506687+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:51:08.390688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506661+0000","last_change":"2024-05-30T06:45:46.534929+0000","last_active":"2024-05-30T06:45:47.506661+0000","last_peered":"2024-05-30T06:45:47.506661+0000","last_clean":"2024-05-30T06:45:47.506661+0000","last_became_active":"2024-05-30T06:45:46.534483+0000","last_became_peered":"2024-05-30T06:45:46.534483+0000","last_unstale":"2024-05-30T06:45:47.506661+0000","last_undegraded":"2024-05-30T06:45:47.506661+0000","last_fullsized":"2024-05-30T06:45:47.506661+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:27:19.227867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922293+0000","last_change":"2024-05-30T06:45:45.521774+0000","last_active":"2024-05-30T06:45:47.922293+0000","last_peered":"2024-05-30T06:45:47.922293+0000","last_clean":"2024-05-30T06:45:47.922293+0000","last_became_active":"2024-05-30T06:45:45.521044+0000","last_became_peered":"2024-05-30T06:45:45.521044+0000","last_unstale":"2024-05-30T06:45:47.922293+0000","last_undegraded":"2024-05-30T06:45:47.922293+0000","last_fullsized":"2024-05-30T06:45:47.922293+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:14.712362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.419749+0000","last_change":"2024-05-30T06:45:46.519488+0000","last_active":"2024-05-30T06:45:48.419749+0000","last_peered":"2024-05-30T06:45:48.419749+0000","last_clean":"2024-05-30T06:45:48.419749+0000","last_became_active":"2024-05-30T06:45:46.519194+0000","last_became_peered":"2024-05-30T06:45:46.519194+0000","last_unstale":"2024-05-30T06:45:48.419749+0000","last_undegraded":"2024-05-30T06:45:48.419749+0000","last_fullsized":"2024-05-30T06:45:48.419749+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:27:19.227867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420866+0000","last_change":"2024-05-30T06:45:45.513554+0000","last_active":"2024-05-30T06:45:48.420866+0000","last_peered":"2024-05-30T06:45:48.420866+0000","last_clean":"2024-05-30T06:45:48.420866+0000","last_became_active":"2024-05-30T06:45:45.512964+0000","last_became_peered":"2024-05-30T06:45:45.512964+0000","last_unstale":"2024-05-30T06:45:48.420866+0000","last_undegraded":"2024-05-30T06:45:48.420866+0000","last_fullsized":"2024-05-30T06:45:48.420866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:14:15.837173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421656+0000","last_change":"2024-05-30T06:45:46.542304+0000","last_active":"2024-05-30T06:45:48.421656+0000","last_peered":"2024-05-30T06:45:48.421656+0000","last_clean":"2024-05-30T06:45:48.421656+0000","last_became_active":"2024-05-30T06:45:46.542026+0000","last_became_peered":"2024-05-30T06:45:46.542026+0000","last_unstale":"2024-05-30T06:45:48.421656+0000","last_undegraded":"2024-05-30T06:45:48.421656+0000","last_fullsized":"2024-05-30T06:45:48.421656+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:04:58.211923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420322+0000","last_change":"2024-05-30T06:45:45.519838+0000","last_active":"2024-05-30T06:45:48.420322+0000","last_peered":"2024-05-30T06:45:48.420322+0000","last_clean":"2024-05-30T06:45:48.420322+0000","last_became_active":"2024-05-30T06:45:45.519519+0000","last_became_peered":"2024-05-30T06:45:45.519519+0000","last_unstale":"2024-05-30T06:45:48.420322+0000","last_undegraded":"2024-05-30T06:45:48.420322+0000","last_fullsized":"2024-05-30T06:45:48.420322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:41.314531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420540+0000","last_change":"2024-05-30T06:45:46.528970+0000","last_active":"2024-05-30T06:45:48.420540+0000","last_peered":"2024-05-30T06:45:48.420540+0000","last_clean":"2024-05-30T06:45:48.420540+0000","last_became_active":"2024-05-30T06:45:46.528675+0000","last_became_peered":"2024-05-30T06:45:46.528675+0000","last_unstale":"2024-05-30T06:45:48.420540+0000","last_undegraded":"2024-05-30T06:45:48.420540+0000","last_fullsized":"2024-05-30T06:45:48.420540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:43.737263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506713+0000","last_change":"2024-05-30T06:45:45.523456+0000","last_active":"2024-05-30T06:45:47.506713+0000","last_peered":"2024-05-30T06:45:47.506713+0000","last_clean":"2024-05-30T06:45:47.506713+0000","last_became_active":"2024-05-30T06:45:45.523150+0000","last_became_peered":"2024-05-30T06:45:45.523150+0000","last_unstale":"2024-05-30T06:45:47.506713+0000","last_undegraded":"2024-05-30T06:45:47.506713+0000","last_fullsized":"2024-05-30T06:45:47.506713+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:56:42.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420483+0000","last_change":"2024-05-30T06:45:46.519676+0000","last_active":"2024-05-30T06:45:48.420483+0000","last_peered":"2024-05-30T06:45:48.420483+0000","last_clean":"2024-05-30T06:45:48.420483+0000","last_became_active":"2024-05-30T06:45:46.518204+0000","last_became_peered":"2024-05-30T06:45:46.518204+0000","last_unstale":"2024-05-30T06:45:48.420483+0000","last_undegraded":"2024-05-30T06:45:48.420483+0000","last_fullsized":"2024-05-30T06:45:48.420483+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:31:00.454059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420644+0000","last_change":"2024-05-30T06:45:45.519751+0000","last_active":"2024-05-30T06:45:48.420644+0000","last_peered":"2024-05-30T06:45:48.420644+0000","last_clean":"2024-05-30T06:45:48.420644+0000","last_became_active":"2024-05-30T06:45:45.519458+0000","last_became_peered":"2024-05-30T06:45:45.519458+0000","last_unstale":"2024-05-30T06:45:48.420644+0000","last_undegraded":"2024-05-30T06:45:48.420644+0000","last_fullsized":"2024-05-30T06:45:48.420644+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:10:48.555104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420173+0000","last_change":"2024-05-30T06:45:46.528913+0000","last_active":"2024-05-30T06:45:48.420173+0000","last_peered":"2024-05-30T06:45:48.420173+0000","last_clean":"2024-05-30T06:45:48.420173+0000","last_became_active":"2024-05-30T06:45:46.528045+0000","last_became_peered":"2024-05-30T06:45:46.528045+0000","last_unstale":"2024-05-30T06:45:48.420173+0000","last_undegraded":"2024-05-30T06:45:48.420173+0000","last_fullsized":"2024-05-30T06:45:48.420173+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:33:42.703397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420610+0000","last_change":"2024-05-30T06:45:45.525631+0000","last_active":"2024-05-30T06:45:48.420610+0000","last_peered":"2024-05-30T06:45:48.420610+0000","last_clean":"2024-05-30T06:45:48.420610+0000","last_became_active":"2024-05-30T06:45:45.525396+0000","last_became_peered":"2024-05-30T06:45:45.525396+0000","last_unstale":"2024-05-30T06:45:48.420610+0000","last_undegraded":"2024-05-30T06:45:48.420610+0000","last_fullsized":"2024-05-30T06:45:48.420610+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:46:14.509133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922608+0000","last_change":"2024-05-30T06:45:46.525622+0000","last_active":"2024-05-30T06:45:47.922608+0000","last_peered":"2024-05-30T06:45:47.922608+0000","last_clean":"2024-05-30T06:45:47.922608+0000","last_became_active":"2024-05-30T06:45:46.521223+0000","last_became_peered":"2024-05-30T06:45:46.521223+0000","last_unstale":"2024-05-30T06:45:47.922608+0000","last_undegraded":"2024-05-30T06:45:47.922608+0000","last_fullsized":"2024-05-30T06:45:47.922608+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:34:58.929115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421706+0000","last_change":"2024-05-30T06:45:45.515922+0000","last_active":"2024-05-30T06:45:48.421706+0000","last_peered":"2024-05-30T06:45:48.421706+0000","last_clean":"2024-05-30T06:45:48.421706+0000","last_became_active":"2024-05-30T06:45:45.515570+0000","last_became_peered":"2024-05-30T06:45:45.515570+0000","last_unstale":"2024-05-30T06:45:48.421706+0000","last_undegraded":"2024-05-30T06:45:48.421706+0000","last_fullsized":"2024-05-30T06:45:48.421706+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:12.851089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420729+0000","last_change":"2024-05-30T06:45:46.538379+0000","last_active":"2024-05-30T06:45:48.420729+0000","last_peered":"2024-05-30T06:45:48.420729+0000","last_clean":"2024-05-30T06:45:48.420729+0000","last_became_active":"2024-05-30T06:45:46.537580+0000","last_became_peered":"2024-05-30T06:45:46.537580+0000","last_unstale":"2024-05-30T06:45:48.420729+0000","last_undegraded":"2024-05-30T06:45:48.420729+0000","last_fullsized":"2024-05-30T06:45:48.420729+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:48:09.626049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922657+0000","last_change":"2024-05-30T06:45:45.516922+0000","last_active":"2024-05-30T06:45:47.922657+0000","last_peered":"2024-05-30T06:45:47.922657+0000","last_clean":"2024-05-30T06:45:47.922657+0000","last_became_active":"2024-05-30T06:45:45.516452+0000","last_became_peered":"2024-05-30T06:45:45.516452+0000","last_unstale":"2024-05-30T06:45:47.922657+0000","last_undegraded":"2024-05-30T06:45:47.922657+0000","last_fullsized":"2024-05-30T06:45:47.922657+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:40:04.623729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922530+0000","last_change":"2024-05-30T06:45:46.538549+0000","last_active":"2024-05-30T06:45:47.922530+0000","last_peered":"2024-05-30T06:45:47.922530+0000","last_clean":"2024-05-30T06:45:47.922530+0000","last_became_active":"2024-05-30T06:45:46.538228+0000","last_became_peered":"2024-05-30T06:45:46.538228+0000","last_unstale":"2024-05-30T06:45:47.922530+0000","last_undegraded":"2024-05-30T06:45:47.922530+0000","last_fullsized":"2024-05-30T06:45:47.922530+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:12.891977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507959+0000","last_change":"2024-05-30T06:45:45.525131+0000","last_active":"2024-05-30T06:45:47.507959+0000","last_peered":"2024-05-30T06:45:47.507959+0000","last_clean":"2024-05-30T06:45:47.507959+0000","last_became_active":"2024-05-30T06:45:45.524799+0000","last_became_peered":"2024-05-30T06:45:45.524799+0000","last_unstale":"2024-05-30T06:45:47.507959+0000","last_undegraded":"2024-05-30T06:45:47.507959+0000","last_fullsized":"2024-05-30T06:45:47.507959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:09:55.475465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420724+0000","last_change":"2024-05-30T06:45:46.530931+0000","last_active":"2024-05-30T06:45:48.420724+0000","last_peered":"2024-05-30T06:45:48.420724+0000","last_clean":"2024-05-30T06:45:48.420724+0000","last_became_active":"2024-05-30T06:45:46.530667+0000","last_became_peered":"2024-05-30T06:45:46.530667+0000","last_unstale":"2024-05-30T06:45:48.420724+0000","last_undegraded":"2024-05-30T06:45:48.420724+0000","last_fullsized":"2024-05-30T06:45:48.420724+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:41:35.767453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420983+0000","last_change":"2024-05-30T06:45:45.513280+0000","last_active":"2024-05-30T06:45:48.420983+0000","last_peered":"2024-05-30T06:45:48.420983+0000","last_clean":"2024-05-30T06:45:48.420983+0000","last_became_active":"2024-05-30T06:45:45.512582+0000","last_became_peered":"2024-05-30T06:45:45.512582+0000","last_unstale":"2024-05-30T06:45:48.420983+0000","last_undegraded":"2024-05-30T06:45:48.420983+0000","last_fullsized":"2024-05-30T06:45:48.420983+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:51:59.290891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421198+0000","last_change":"2024-05-30T06:45:46.519850+0000","last_active":"2024-05-30T06:45:48.421198+0000","last_peered":"2024-05-30T06:45:48.421198+0000","last_clean":"2024-05-30T06:45:48.421198+0000","last_became_active":"2024-05-30T06:45:46.519499+0000","last_became_peered":"2024-05-30T06:45:46.519499+0000","last_unstale":"2024-05-30T06:45:48.421198+0000","last_undegraded":"2024-05-30T06:45:48.421198+0000","last_fullsized":"2024-05-30T06:45:48.421198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:58.784375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922374+0000","last_change":"2024-05-30T06:45:45.524337+0000","last_active":"2024-05-30T06:45:47.922374+0000","last_peered":"2024-05-30T06:45:47.922374+0000","last_clean":"2024-05-30T06:45:47.922374+0000","last_became_active":"2024-05-30T06:45:45.523781+0000","last_became_peered":"2024-05-30T06:45:45.523781+0000","last_unstale":"2024-05-30T06:45:47.922374+0000","last_undegraded":"2024-05-30T06:45:47.922374+0000","last_fullsized":"2024-05-30T06:45:47.922374+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:56:42.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420238+0000","last_change":"2024-05-30T06:45:46.534419+0000","last_active":"2024-05-30T06:45:48.420238+0000","last_peered":"2024-05-30T06:45:48.420238+0000","last_clean":"2024-05-30T06:45:48.420238+0000","last_became_active":"2024-05-30T06:45:46.534149+0000","last_became_peered":"2024-05-30T06:45:46.534149+0000","last_unstale":"2024-05-30T06:45:48.420238+0000","last_undegraded":"2024-05-30T06:45:48.420238+0000","last_fullsized":"2024-05-30T06:45:48.420238+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:42.056498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420482+0000","last_change":"2024-05-30T06:45:45.523219+0000","last_active":"2024-05-30T06:45:48.420482+0000","last_peered":"2024-05-30T06:45:48.420482+0000","last_clean":"2024-05-30T06:45:48.420482+0000","last_became_active":"2024-05-30T06:45:45.522943+0000","last_became_peered":"2024-05-30T06:45:45.522943+0000","last_unstale":"2024-05-30T06:45:48.420482+0000","last_undegraded":"2024-05-30T06:45:48.420482+0000","last_fullsized":"2024-05-30T06:45:48.420482+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:23:39.284033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922523+0000","last_change":"2024-05-30T06:45:46.527541+0000","last_active":"2024-05-30T06:45:47.922523+0000","last_peered":"2024-05-30T06:45:47.922523+0000","last_clean":"2024-05-30T06:45:47.922523+0000","last_became_active":"2024-05-30T06:45:46.524174+0000","last_became_peered":"2024-05-30T06:45:46.524174+0000","last_unstale":"2024-05-30T06:45:47.922523+0000","last_undegraded":"2024-05-30T06:45:47.922523+0000","last_fullsized":"2024-05-30T06:45:47.922523+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:53:25.192521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420757+0000","last_change":"2024-05-30T06:45:45.522731+0000","last_active":"2024-05-30T06:45:48.420757+0000","last_peered":"2024-05-30T06:45:48.420757+0000","last_clean":"2024-05-30T06:45:48.420757+0000","last_became_active":"2024-05-30T06:45:45.522442+0000","last_became_peered":"2024-05-30T06:45:45.522442+0000","last_unstale":"2024-05-30T06:45:48.420757+0000","last_undegraded":"2024-05-30T06:45:48.420757+0000","last_fullsized":"2024-05-30T06:45:48.420757+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:46:26.713791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507992+0000","last_change":"2024-05-30T06:45:46.529820+0000","last_active":"2024-05-30T06:45:47.507992+0000","last_peered":"2024-05-30T06:45:47.507992+0000","last_clean":"2024-05-30T06:45:47.507992+0000","last_became_active":"2024-05-30T06:45:46.527253+0000","last_became_peered":"2024-05-30T06:45:46.527253+0000","last_unstale":"2024-05-30T06:45:47.507992+0000","last_undegraded":"2024-05-30T06:45:47.507992+0000","last_fullsized":"2024-05-30T06:45:47.507992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:32:38.601800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507949+0000","last_change":"2024-05-30T06:45:45.524146+0000","last_active":"2024-05-30T06:45:47.507949+0000","last_peered":"2024-05-30T06:45:47.507949+0000","last_clean":"2024-05-30T06:45:47.507949+0000","last_became_active":"2024-05-30T06:45:45.523866+0000","last_became_peered":"2024-05-30T06:45:45.523866+0000","last_unstale":"2024-05-30T06:45:47.507949+0000","last_undegraded":"2024-05-30T06:45:47.507949+0000","last_fullsized":"2024-05-30T06:45:47.507949+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:11:16.836722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421796+0000","last_change":"2024-05-30T06:45:46.522222+0000","last_active":"2024-05-30T06:45:48.421796+0000","last_peered":"2024-05-30T06:45:48.421796+0000","last_clean":"2024-05-30T06:45:48.421796+0000","last_became_active":"2024-05-30T06:45:46.521897+0000","last_became_peered":"2024-05-30T06:45:46.521897+0000","last_unstale":"2024-05-30T06:45:48.421796+0000","last_undegraded":"2024-05-30T06:45:48.421796+0000","last_fullsized":"2024-05-30T06:45:48.421796+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:56:13.838632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420341+0000","last_change":"2024-05-30T06:45:45.511016+0000","last_active":"2024-05-30T06:45:48.420341+0000","last_peered":"2024-05-30T06:45:48.420341+0000","last_clean":"2024-05-30T06:45:48.420341+0000","last_became_active":"2024-05-30T06:45:45.510739+0000","last_became_peered":"2024-05-30T06:45:45.510739+0000","last_unstale":"2024-05-30T06:45:48.420341+0000","last_undegraded":"2024-05-30T06:45:48.420341+0000","last_fullsized":"2024-05-30T06:45:48.420341+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:19:55.701600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420360+0000","last_change":"2024-05-30T06:45:46.524021+0000","last_active":"2024-05-30T06:45:48.420360+0000","last_peered":"2024-05-30T06:45:48.420360+0000","last_clean":"2024-05-30T06:45:48.420360+0000","last_became_active":"2024-05-30T06:45:46.523413+0000","last_became_peered":"2024-05-30T06:45:46.523413+0000","last_unstale":"2024-05-30T06:45:48.420360+0000","last_undegraded":"2024-05-30T06:45:48.420360+0000","last_fullsized":"2024-05-30T06:45:48.420360+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:07.620058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506961+0000","last_change":"2024-05-30T06:45:45.523140+0000","last_active":"2024-05-30T06:45:47.506961+0000","last_peered":"2024-05-30T06:45:47.506961+0000","last_clean":"2024-05-30T06:45:47.506961+0000","last_became_active":"2024-05-30T06:45:45.522890+0000","last_became_peered":"2024-05-30T06:45:45.522890+0000","last_unstale":"2024-05-30T06:45:47.506961+0000","last_undegraded":"2024-05-30T06:45:47.506961+0000","last_fullsized":"2024-05-30T06:45:47.506961+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:46:07.797374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420883+0000","last_change":"2024-05-30T06:45:46.532899+0000","last_active":"2024-05-30T06:45:48.420883+0000","last_peered":"2024-05-30T06:45:48.420883+0000","last_clean":"2024-05-30T06:45:48.420883+0000","last_became_active":"2024-05-30T06:45:46.531287+0000","last_became_peered":"2024-05-30T06:45:46.531287+0000","last_unstale":"2024-05-30T06:45:48.420883+0000","last_undegraded":"2024-05-30T06:45:48.420883+0000","last_fullsized":"2024-05-30T06:45:48.420883+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:02:47.890146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421556+0000","last_change":"2024-05-30T06:45:45.510614+0000","last_active":"2024-05-30T06:45:48.421556+0000","last_peered":"2024-05-30T06:45:48.421556+0000","last_clean":"2024-05-30T06:45:48.421556+0000","last_became_active":"2024-05-30T06:45:45.510200+0000","last_became_peered":"2024-05-30T06:45:45.510200+0000","last_unstale":"2024-05-30T06:45:48.421556+0000","last_undegraded":"2024-05-30T06:45:48.421556+0000","last_fullsized":"2024-05-30T06:45:48.421556+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:49.567091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420817+0000","last_change":"2024-05-30T06:45:46.538463+0000","last_active":"2024-05-30T06:45:48.420817+0000","last_peered":"2024-05-30T06:45:48.420817+0000","last_clean":"2024-05-30T06:45:48.420817+0000","last_became_active":"2024-05-30T06:45:46.538036+0000","last_became_peered":"2024-05-30T06:45:46.538036+0000","last_unstale":"2024-05-30T06:45:48.420817+0000","last_undegraded":"2024-05-30T06:45:48.420817+0000","last_fullsized":"2024-05-30T06:45:48.420817+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:54:17.058841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421183+0000","last_change":"2024-05-30T06:45:45.519078+0000","last_active":"2024-05-30T06:45:48.421183+0000","last_peered":"2024-05-30T06:45:48.421183+0000","last_clean":"2024-05-30T06:45:48.421183+0000","last_became_active":"2024-05-30T06:45:45.518561+0000","last_became_peered":"2024-05-30T06:45:45.518561+0000","last_unstale":"2024-05-30T06:45:48.421183+0000","last_undegraded":"2024-05-30T06:45:48.421183+0000","last_fullsized":"2024-05-30T06:45:48.421183+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:28:50.906371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506412+0000","last_change":"2024-05-30T06:45:46.529483+0000","last_active":"2024-05-30T06:45:47.506412+0000","last_peered":"2024-05-30T06:45:47.506412+0000","last_clean":"2024-05-30T06:45:47.506412+0000","last_became_active":"2024-05-30T06:45:46.529127+0000","last_became_peered":"2024-05-30T06:45:46.529127+0000","last_unstale":"2024-05-30T06:45:47.506412+0000","last_undegraded":"2024-05-30T06:45:47.506412+0000","last_fullsized":"2024-05-30T06:45:47.506412+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:10:18.096100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507053+0000","last_change":"2024-05-30T06:45:45.518867+0000","last_active":"2024-05-30T06:45:47.507053+0000","last_peered":"2024-05-30T06:45:47.507053+0000","last_clean":"2024-05-30T06:45:47.507053+0000","last_became_active":"2024-05-30T06:45:45.518576+0000","last_became_peered":"2024-05-30T06:45:45.518576+0000","last_unstale":"2024-05-30T06:45:47.507053+0000","last_undegraded":"2024-05-30T06:45:47.507053+0000","last_fullsized":"2024-05-30T06:45:47.507053+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:40:04.623729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507645+0000","last_change":"2024-05-30T06:45:46.528390+0000","last_active":"2024-05-30T06:45:47.507645+0000","last_peered":"2024-05-30T06:45:47.507645+0000","last_clean":"2024-05-30T06:45:47.507645+0000","last_became_active":"2024-05-30T06:45:46.528126+0000","last_became_peered":"2024-05-30T06:45:46.528126+0000","last_unstale":"2024-05-30T06:45:47.507645+0000","last_undegraded":"2024-05-30T06:45:47.507645+0000","last_fullsized":"2024-05-30T06:45:47.507645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:42:31.705492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420534+0000","last_change":"2024-05-30T06:45:45.514789+0000","last_active":"2024-05-30T06:45:48.420534+0000","last_peered":"2024-05-30T06:45:48.420534+0000","last_clean":"2024-05-30T06:45:48.420534+0000","last_became_active":"2024-05-30T06:45:45.514205+0000","last_became_peered":"2024-05-30T06:45:45.514205+0000","last_unstale":"2024-05-30T06:45:48.420534+0000","last_undegraded":"2024-05-30T06:45:48.420534+0000","last_fullsized":"2024-05-30T06:45:48.420534+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:44.464720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420331+0000","last_change":"2024-05-30T06:45:46.542727+0000","last_active":"2024-05-30T06:45:48.420331+0000","last_peered":"2024-05-30T06:45:48.420331+0000","last_clean":"2024-05-30T06:45:48.420331+0000","last_became_active":"2024-05-30T06:45:46.542476+0000","last_became_peered":"2024-05-30T06:45:46.542476+0000","last_unstale":"2024-05-30T06:45:48.420331+0000","last_undegraded":"2024-05-30T06:45:48.420331+0000","last_fullsized":"2024-05-30T06:45:48.420331+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:21:12.390635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922242+0000","last_change":"2024-05-30T06:45:45.524117+0000","last_active":"2024-05-30T06:45:47.922242+0000","last_peered":"2024-05-30T06:45:47.922242+0000","last_clean":"2024-05-30T06:45:47.922242+0000","last_became_active":"2024-05-30T06:45:45.523821+0000","last_became_peered":"2024-05-30T06:45:45.523821+0000","last_unstale":"2024-05-30T06:45:47.922242+0000","last_undegraded":"2024-05-30T06:45:47.922242+0000","last_fullsized":"2024-05-30T06:45:47.922242+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:43:35.943564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420751+0000","last_change":"2024-05-30T06:45:46.529852+0000","last_active":"2024-05-30T06:45:48.420751+0000","last_peered":"2024-05-30T06:45:48.420751+0000","last_clean":"2024-05-30T06:45:48.420751+0000","last_became_active":"2024-05-30T06:45:46.529548+0000","last_became_peered":"2024-05-30T06:45:46.529548+0000","last_unstale":"2024-05-30T06:45:48.420751+0000","last_undegraded":"2024-05-30T06:45:48.420751+0000","last_fullsized":"2024-05-30T06:45:48.420751+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:16.375453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"46'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.514028+0000","last_change":"2024-05-30T06:45:45.513207+0000","last_active":"2024-05-30T06:45:48.514028+0000","last_peered":"2024-05-30T06:45:48.514028+0000","last_clean":"2024-05-30T06:45:48.514028+0000","last_became_active":"2024-05-30T06:45:45.512865+0000","last_became_peered":"2024-05-30T06:45:45.512865+0000","last_unstale":"2024-05-30T06:45:48.514028+0000","last_undegraded":"2024-05-30T06:45:48.514028+0000","last_fullsized":"2024-05-30T06:45:48.514028+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:15.381522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421798+0000","last_change":"2024-05-30T06:45:46.516601+0000","last_active":"2024-05-30T06:45:48.421798+0000","last_peered":"2024-05-30T06:45:48.421798+0000","last_clean":"2024-05-30T06:45:48.421798+0000","last_became_active":"2024-05-30T06:45:46.516270+0000","last_became_peered":"2024-05-30T06:45:46.516270+0000","last_unstale":"2024-05-30T06:45:48.421798+0000","last_undegraded":"2024-05-30T06:45:48.421798+0000","last_fullsized":"2024-05-30T06:45:48.421798+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:51:29.501279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922699+0000","last_change":"2024-05-30T06:45:45.516945+0000","last_active":"2024-05-30T06:45:47.922699+0000","last_peered":"2024-05-30T06:45:47.922699+0000","last_clean":"2024-05-30T06:45:47.922699+0000","last_became_active":"2024-05-30T06:45:45.516589+0000","last_became_peered":"2024-05-30T06:45:45.516589+0000","last_unstale":"2024-05-30T06:45:47.922699+0000","last_undegraded":"2024-05-30T06:45:47.922699+0000","last_fullsized":"2024-05-30T06:45:47.922699+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:21:37.162126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922573+0000","last_change":"2024-05-30T06:45:46.533333+0000","last_active":"2024-05-30T06:45:47.922573+0000","last_peered":"2024-05-30T06:45:47.922573+0000","last_clean":"2024-05-30T06:45:47.922573+0000","last_became_active":"2024-05-30T06:45:46.532825+0000","last_became_peered":"2024-05-30T06:45:46.532825+0000","last_unstale":"2024-05-30T06:45:47.922573+0000","last_undegraded":"2024-05-30T06:45:47.922573+0000","last_fullsized":"2024-05-30T06:45:47.922573+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:49:01.166450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506425+0000","last_change":"2024-05-30T06:45:45.523016+0000","last_active":"2024-05-30T06:45:47.506425+0000","last_peered":"2024-05-30T06:45:47.506425+0000","last_clean":"2024-05-30T06:45:47.506425+0000","last_became_active":"2024-05-30T06:45:45.522740+0000","last_became_peered":"2024-05-30T06:45:45.522740+0000","last_unstale":"2024-05-30T06:45:47.506425+0000","last_undegraded":"2024-05-30T06:45:47.506425+0000","last_fullsized":"2024-05-30T06:45:47.506425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:15.372337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420869+0000","last_change":"2024-05-30T06:45:46.522992+0000","last_active":"2024-05-30T06:45:48.420869+0000","last_peered":"2024-05-30T06:45:48.420869+0000","last_clean":"2024-05-30T06:45:48.420869+0000","last_became_active":"2024-05-30T06:45:46.519951+0000","last_became_peered":"2024-05-30T06:45:46.519951+0000","last_unstale":"2024-05-30T06:45:48.420869+0000","last_undegraded":"2024-05-30T06:45:48.420869+0000","last_fullsized":"2024-05-30T06:45:48.420869+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:47:49.723434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922379+0000","last_change":"2024-05-30T06:45:45.517691+0000","last_active":"2024-05-30T06:45:47.922379+0000","last_peered":"2024-05-30T06:45:47.922379+0000","last_clean":"2024-05-30T06:45:47.922379+0000","last_became_active":"2024-05-30T06:45:45.517487+0000","last_became_peered":"2024-05-30T06:45:45.517487+0000","last_unstale":"2024-05-30T06:45:47.922379+0000","last_undegraded":"2024-05-30T06:45:47.922379+0000","last_fullsized":"2024-05-30T06:45:47.922379+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:46:07.797374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420714+0000","last_change":"2024-05-30T06:45:46.535589+0000","last_active":"2024-05-30T06:45:48.420714+0000","last_peered":"2024-05-30T06:45:48.420714+0000","last_clean":"2024-05-30T06:45:48.420714+0000","last_became_active":"2024-05-30T06:45:46.535330+0000","last_became_peered":"2024-05-30T06:45:46.535330+0000","last_unstale":"2024-05-30T06:45:48.420714+0000","last_undegraded":"2024-05-30T06:45:48.420714+0000","last_fullsized":"2024-05-30T06:45:48.420714+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:27:54.777149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.419892+0000","last_change":"2024-05-30T06:45:45.514290+0000","last_active":"2024-05-30T06:45:48.419892+0000","last_peered":"2024-05-30T06:45:48.419892+0000","last_clean":"2024-05-30T06:45:48.419892+0000","last_became_active":"2024-05-30T06:45:45.514015+0000","last_became_peered":"2024-05-30T06:45:45.514015+0000","last_unstale":"2024-05-30T06:45:48.419892+0000","last_undegraded":"2024-05-30T06:45:48.419892+0000","last_fullsized":"2024-05-30T06:45:48.419892+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:19:06.937941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506899+0000","last_change":"2024-05-30T06:45:46.527304+0000","last_active":"2024-05-30T06:45:47.506899+0000","last_peered":"2024-05-30T06:45:47.506899+0000","last_clean":"2024-05-30T06:45:47.506899+0000","last_became_active":"2024-05-30T06:45:46.526505+0000","last_became_peered":"2024-05-30T06:45:46.526505+0000","last_unstale":"2024-05-30T06:45:47.506899+0000","last_undegraded":"2024-05-30T06:45:47.506899+0000","last_fullsized":"2024-05-30T06:45:47.506899+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:36:22.793647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506334+0000","last_change":"2024-05-30T06:45:45.515475+0000","last_active":"2024-05-30T06:45:47.506334+0000","last_peered":"2024-05-30T06:45:47.506334+0000","last_clean":"2024-05-30T06:45:47.506334+0000","last_became_active":"2024-05-30T06:45:45.515218+0000","last_became_peered":"2024-05-30T06:45:45.515218+0000","last_unstale":"2024-05-30T06:45:47.506334+0000","last_undegraded":"2024-05-30T06:45:47.506334+0000","last_fullsized":"2024-05-30T06:45:47.506334+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:41:34.764336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.419739+0000","last_change":"2024-05-30T06:45:46.513214+0000","last_active":"2024-05-30T06:45:48.419739+0000","last_peered":"2024-05-30T06:45:48.419739+0000","last_clean":"2024-05-30T06:45:48.419739+0000","last_became_active":"2024-05-30T06:45:46.512935+0000","last_became_peered":"2024-05-30T06:45:46.512935+0000","last_unstale":"2024-05-30T06:45:48.419739+0000","last_undegraded":"2024-05-30T06:45:48.419739+0000","last_fullsized":"2024-05-30T06:45:48.419739+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:10:18.096100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420858+0000","last_change":"2024-05-30T06:45:45.513712+0000","last_active":"2024-05-30T06:45:48.420858+0000","last_peered":"2024-05-30T06:45:48.420858+0000","last_clean":"2024-05-30T06:45:48.420858+0000","last_became_active":"2024-05-30T06:45:45.513190+0000","last_became_peered":"2024-05-30T06:45:45.513190+0000","last_unstale":"2024-05-30T06:45:48.420858+0000","last_undegraded":"2024-05-30T06:45:48.420858+0000","last_fullsized":"2024-05-30T06:45:48.420858+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:39:44.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421792+0000","last_change":"2024-05-30T06:45:46.525511+0000","last_active":"2024-05-30T06:45:48.421792+0000","last_peered":"2024-05-30T06:45:48.421792+0000","last_clean":"2024-05-30T06:45:48.421792+0000","last_became_active":"2024-05-30T06:45:46.524983+0000","last_became_peered":"2024-05-30T06:45:46.524983+0000","last_unstale":"2024-05-30T06:45:48.421792+0000","last_undegraded":"2024-05-30T06:45:48.421792+0000","last_fullsized":"2024-05-30T06:45:48.421792+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:05:40.437558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507245+0000","last_change":"2024-05-30T06:45:45.518716+0000","last_active":"2024-05-30T06:45:47.507245+0000","last_peered":"2024-05-30T06:45:47.507245+0000","last_clean":"2024-05-30T06:45:47.507245+0000","last_became_active":"2024-05-30T06:45:45.518092+0000","last_became_peered":"2024-05-30T06:45:45.518092+0000","last_unstale":"2024-05-30T06:45:47.507245+0000","last_undegraded":"2024-05-30T06:45:47.507245+0000","last_fullsized":"2024-05-30T06:45:47.507245+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:14.712362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":219,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922419+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:45:47.922419+0000","last_peered":"2024-05-30T06:45:47.922419+0000","last_clean":"2024-05-30T06:45:47.922419+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:45:47.922419+0000","last_undegraded":"2024-05-30T06:45:47.922419+0000","last_fullsized":"2024-05-30T06:45:47.922419+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1138688,"data_stored":812891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":216805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35880,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":544768,"data_stored":222503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35880,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":552960,"data_stored":224045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35884,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335956,"statfs":{"total":96636764160,"available":96600018944,"internally_reserved":0,"allocated":552960,"data_stored":223071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":557056,"data_stored":224067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35876,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335964,"statfs":{"total":96636764160,"available":96600027136,"internally_reserved":0,"allocated":544768,"data_stored":222503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36444,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335396,"statfs":{"total":96636764160,"available":96599445504,"internally_reserved":0,"allocated":1126400,"data_stored":806535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:45:50.736 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:45:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.913+0000 7f2679400640 1 Processor -- start 2024-05-30T06:45:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.913+0000 7f2679400640 1 -- start start 2024-05-30T06:45:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2679400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f267406f9a0 0x7f26740b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2679400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f26740b2ec0 0x7f26740cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2679400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f267415c8f0 con 0x7f2674155e60 2024-05-30T06:45:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2679400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f26740ccff0 con 0x7f26740b2ec0 2024-05-30T06:45:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2679400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f26740ccc80 con 0x7f267406f9a0 2024-05-30T06:45:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2672800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2674155e60 0x7f26740cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57302/0 (socket says 172.21.15.37:57302) 2024-05-30T06:45:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2672800640 1 -- 172.21.15.37:0/3725414432 learned_addr learned my addr 172.21.15.37:0/3725414432 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2673200640 1 --2- 172.21.15.37:0/3725414432 >> v2:172.21.15.105:3300/0 conn(0x7f26740b2ec0 0x7f26740cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2669e00640 1 --2- 172.21.15.37:0/3725414432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f267406f9a0 0x7f26740b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1144820510 0 0) 0x7f267415c8f0 con 0x7f2674155e60 2024-05-30T06:45:50.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2658005740 con 0x7f2674155e60 2024-05-30T06:45:50.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2007714074 0 0) 0x7f2658005740 con 0x7f2674155e60 2024-05-30T06:45:50.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f267406f9a0 msgr2=0x7f26740b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:50.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 --2- 172.21.15.37:0/3725414432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f267406f9a0 0x7f26740b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 >> v2:172.21.15.105:3300/0 conn(0x7f26740b2ec0 msgr2=0x7f26740cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:50.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 --2- 172.21.15.37:0/3725414432 >> v2:172.21.15.105:3300/0 conn(0x7f26740b2ec0 0x7f26740cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267415cbd0 con 0x7f2674155e60 2024-05-30T06:45:50.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f2664001680 con 0x7f2674155e60 2024-05-30T06:45:50.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2673200640 1 --2- 172.21.15.37:0/3725414432 >> v2:172.21.15.105:3300/0 conn(0x7f26740b2ec0 0x7f26740cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:50.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 >> v1:172.21.15.37:6789/0 conn(0x7f2674155e60 legacy=0x7f26740cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 --2- 172.21.15.37:0/3725414432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2658005bd0 0x7f2658005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 --2- 172.21.15.37:0/3725414432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f267406f9a0 0x7f2658006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 --2- 172.21.15.37:0/3725414432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658006f60 0x7f26580073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26740ccff0 con 0x7f2658006f60 2024-05-30T06:45:50.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f26740ccc80 con 0x7f2658005bd0 2024-05-30T06:45:50.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f265800dbe0 con 0x7f267406f9a0 2024-05-30T06:45:50.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2673200640 1 --2- 172.21.15.37:0/3725414432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658006f60 0x7f26580073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2672800640 1 --2- 172.21.15.37:0/3725414432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2658005bd0 0x7f2658005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2669e00640 1 --2- 172.21.15.37:0/3725414432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f267406f9a0 0x7f2658006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2673200640 1 -- 172.21.15.37:0/3725414432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f267406f9a0 msgr2=0x7f2658006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2673200640 1 --2- 172.21.15.37:0/3725414432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f267406f9a0 0x7f2658006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2673200640 1 -- 172.21.15.37:0/3725414432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2658005bd0 msgr2=0x7f2658005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2673200640 1 --2- 172.21.15.37:0/3725414432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2658005bd0 0x7f2658005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.917+0000 7f2673200640 1 -- 172.21.15.37:0/3725414432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2658005740 con 0x7f2658006f60 2024-05-30T06:45:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.921+0000 7f2673200640 1 --2- 172.21.15.37:0/3725414432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658006f60 0x7f26580073e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f266c00e380 tx=0x7f266c01ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94ad110389f600f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.921+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c0b2070 con 0x7f2658006f60 2024-05-30T06:45:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.921+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c0ad440 con 0x7f2658006f60 2024-05-30T06:45:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.921+0000 7f2671e00640 1 -- 172.21.15.37:0/3725414432 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c009de0 con 0x7f2658006f60 2024-05-30T06:45:50.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.921+0000 7f2679400640 1 -- 172.21.15.37:0/3725414432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658006f60 msgr2=0x7f26580073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.921+0000 7f2679400640 1 --2- 172.21.15.37:0/3725414432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658006f60 0x7f26580073e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f266c00e380 tx=0x7f266c01ce60 comp rx=0 tx=0).stop 2024-05-30T06:45:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.921+0000 7f2673200640 1 -- 172.21.15.37:0/3725414432 reap_dead start 2024-05-30T06:45:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.921+0000 7f2679400640 1 -- 172.21.15.37:0/3725414432 shutdown_connections 2024-05-30T06:45:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.921+0000 7f2679400640 1 -- 172.21.15.37:0/3725414432 >> 172.21.15.37:0/3725414432 conn(0x7f26740b23a0 msgr2=0x7f26740b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.921+0000 7f2679400640 1 -- 172.21.15.37:0/3725414432 shutdown_connections 2024-05-30T06:45:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.921+0000 7f2679400640 1 -- 172.21.15.37:0/3725414432 wait complete. 2024-05-30T06:45:50.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2679400640 1 Processor -- start 2024-05-30T06:45:50.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2679400640 1 -- start start 2024-05-30T06:45:50.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2679400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658006f60 0x7f267414cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2679400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26741efe20 0x7f26741503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2679400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f267414e7d0 0x7f26741511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2679400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26740cfef0 con 0x7f2658006f60 2024-05-30T06:45:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2679400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f26740cfd70 con 0x7f267414e7d0 2024-05-30T06:45:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2679400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f26740d0070 con 0x7f26741efe20 2024-05-30T06:45:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2672800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658006f60 0x7f267414cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2672800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658006f60 0x7f267414cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48236/0 (socket says 172.21.15.37:48236) 2024-05-30T06:45:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2672800640 1 -- 172.21.15.37:0/4154459028 learned_addr learned my addr 172.21.15.37:0/4154459028 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2669e00640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26741efe20 0x7f26741503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2673200640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f267414e7d0 0x7f26741511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2672800640 1 -- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26741efe20 msgr2=0x7f26741503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2672800640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26741efe20 0x7f26741503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2672800640 1 -- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f267414e7d0 msgr2=0x7f26741511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:50.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2672800640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f267414e7d0 0x7f26741511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2672800640 1 -- 172.21.15.37:0/4154459028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267414ed20 con 0x7f2658006f60 2024-05-30T06:45:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2673200640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f267414e7d0 0x7f26741511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2672800640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658006f60 0x7f267414cb40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2664007310 tx=0x7f26640077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f266b400640 1 -- 172.21.15.37:0/4154459028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266400f940 con 0x7f2658006f60 2024-05-30T06:45:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f266b400640 1 -- 172.21.15.37:0/4154459028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2664018070 con 0x7f2658006f60 2024-05-30T06:45:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2679400640 1 -- 172.21.15.37:0/4154459028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f267414f000 con 0x7f2658006f60 2024-05-30T06:45:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f266b400640 1 -- 172.21.15.37:0/4154459028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266400fd40 con 0x7f2658006f60 2024-05-30T06:45:50.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2679400640 1 -- 172.21.15.37:0/4154459028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f267414f5c0 con 0x7f2658006f60 2024-05-30T06:45:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.925+0000 7f2679400640 1 -- 172.21.15.37:0/4154459028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2674068b20 con 0x7f2658006f60 2024-05-30T06:45:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.929+0000 7f266b400640 1 -- 172.21.15.37:0/4154459028 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f266401d460 con 0x7f2658006f60 2024-05-30T06:45:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.929+0000 7f266b400640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f26500686e0 0x7f265006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:50.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.929+0000 7f266b400640 1 -- 172.21.15.37:0/4154459028 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f26640870e0 con 0x7f2658006f60 2024-05-30T06:45:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.929+0000 7f2669e00640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f26500686e0 0x7f265006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.929+0000 7f2669e00640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f26500686e0 0x7f265006aba0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f26740cf360 tx=0x7f265c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:50.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:50.933+0000 7f266b400640 1 -- 172.21.15.37:0/4154459028 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2664057250 con 0x7f2658006f60 2024-05-30T06:45:51.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.093+0000 7f2679400640 1 -- 172.21.15.37:0/4154459028 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f267414d1e0 con 0x7f26500686e0 2024-05-30T06:45:51.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.101+0000 7f266b400640 1 -- 172.21.15.37:0/4154459028 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251957 (secure 0 0 0) 0x7f267414d1e0 con 0x7f26500686e0 2024-05-30T06:45:51.104 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:45:51.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.105+0000 7f2679400640 1 -- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f26500686e0 msgr2=0x7f265006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:51.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.105+0000 7f2679400640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f26500686e0 0x7f265006aba0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f26740cf360 tx=0x7f265c008040 comp rx=0 tx=0).stop 2024-05-30T06:45:51.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.105+0000 7f2679400640 1 -- 172.21.15.37:0/4154459028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658006f60 msgr2=0x7f267414cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:51.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.105+0000 7f2679400640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658006f60 0x7f267414cb40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2664007310 tx=0x7f26640077d0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.105+0000 7f2679400640 1 -- 172.21.15.37:0/4154459028 shutdown_connections 2024-05-30T06:45:51.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.105+0000 7f2679400640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f26500686e0 0x7f265006aba0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.105+0000 7f2679400640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f267414e7d0 0x7f26741511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.105+0000 7f2679400640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26741efe20 0x7f26741503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.105+0000 7f2679400640 1 --2- 172.21.15.37:0/4154459028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2658006f60 0x7f267414cb40 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.105+0000 7f2679400640 1 -- 172.21.15.37:0/4154459028 >> 172.21.15.37:0/4154459028 conn(0x7f26740b23a0 msgr2=0x7f267415f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:51.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.105+0000 7f2679400640 1 -- 172.21.15.37:0/4154459028 shutdown_connections 2024-05-30T06:45:51.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.105+0000 7f2679400640 1 -- 172.21.15.37:0/4154459028 wait complete. 2024-05-30T06:45:51.125 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-05-30T06:45:50.700267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279856,"kb_used_data":5424,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754694864,"statfs":{"total":773094113280,"available":772807540736,"internally_reserved":0,"allocated":5554176,"data_stored":2952420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001354"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922516+0000","last_change":"2024-05-30T06:45:46.515300+0000","last_active":"2024-05-30T06:45:47.922516+0000","last_peered":"2024-05-30T06:45:47.922516+0000","last_clean":"2024-05-30T06:45:47.922516+0000","last_became_active":"2024-05-30T06:45:46.515026+0000","last_became_peered":"2024-05-30T06:45:46.515026+0000","last_unstale":"2024-05-30T06:45:47.922516+0000","last_undegraded":"2024-05-30T06:45:47.922516+0000","last_fullsized":"2024-05-30T06:45:47.922516+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:13:34.267107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506898+0000","last_change":"2024-05-30T06:45:46.526353+0000","last_active":"2024-05-30T06:45:47.506898+0000","last_peered":"2024-05-30T06:45:47.506898+0000","last_clean":"2024-05-30T06:45:47.506898+0000","last_became_active":"2024-05-30T06:45:46.526056+0000","last_became_peered":"2024-05-30T06:45:46.526056+0000","last_unstale":"2024-05-30T06:45:47.506898+0000","last_undegraded":"2024-05-30T06:45:47.506898+0000","last_fullsized":"2024-05-30T06:45:47.506898+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:23:40.287149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.419833+0000","last_change":"2024-05-30T06:45:46.536697+0000","last_active":"2024-05-30T06:45:48.419833+0000","last_peered":"2024-05-30T06:45:48.419833+0000","last_clean":"2024-05-30T06:45:48.419833+0000","last_became_active":"2024-05-30T06:45:46.536400+0000","last_became_peered":"2024-05-30T06:45:46.536400+0000","last_unstale":"2024-05-30T06:45:48.419833+0000","last_undegraded":"2024-05-30T06:45:48.419833+0000","last_fullsized":"2024-05-30T06:45:48.419833+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:43.737263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421519+0000","last_change":"2024-05-30T06:45:46.528827+0000","last_active":"2024-05-30T06:45:48.421519+0000","last_peered":"2024-05-30T06:45:48.421519+0000","last_clean":"2024-05-30T06:45:48.421519+0000","last_became_active":"2024-05-30T06:45:46.528511+0000","last_became_peered":"2024-05-30T06:45:46.528511+0000","last_unstale":"2024-05-30T06:45:48.421519+0000","last_undegraded":"2024-05-30T06:45:48.421519+0000","last_fullsized":"2024-05-30T06:45:48.421519+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:15.085899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507000+0000","last_change":"2024-05-30T06:45:46.521030+0000","last_active":"2024-05-30T06:45:47.507000+0000","last_peered":"2024-05-30T06:45:47.507000+0000","last_clean":"2024-05-30T06:45:47.507000+0000","last_became_active":"2024-05-30T06:45:46.520749+0000","last_became_peered":"2024-05-30T06:45:46.520749+0000","last_unstale":"2024-05-30T06:45:47.507000+0000","last_undegraded":"2024-05-30T06:45:47.507000+0000","last_fullsized":"2024-05-30T06:45:47.507000+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:13:34.267107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420343+0000","last_change":"2024-05-30T06:45:46.520381+0000","last_active":"2024-05-30T06:45:48.420343+0000","last_peered":"2024-05-30T06:45:48.420343+0000","last_clean":"2024-05-30T06:45:48.420343+0000","last_became_active":"2024-05-30T06:45:46.519229+0000","last_became_peered":"2024-05-30T06:45:46.519229+0000","last_unstale":"2024-05-30T06:45:48.420343+0000","last_undegraded":"2024-05-30T06:45:48.420343+0000","last_fullsized":"2024-05-30T06:45:48.420343+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:36:25.701950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922692+0000","last_change":"2024-05-30T06:45:46.528145+0000","last_active":"2024-05-30T06:45:47.922692+0000","last_peered":"2024-05-30T06:45:47.922692+0000","last_clean":"2024-05-30T06:45:47.922692+0000","last_became_active":"2024-05-30T06:45:46.527863+0000","last_became_peered":"2024-05-30T06:45:46.527863+0000","last_unstale":"2024-05-30T06:45:47.922692+0000","last_undegraded":"2024-05-30T06:45:47.922692+0000","last_fullsized":"2024-05-30T06:45:47.922692+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:37:11.137947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420952+0000","last_change":"2024-05-30T06:45:46.531510+0000","last_active":"2024-05-30T06:45:48.420952+0000","last_peered":"2024-05-30T06:45:48.420952+0000","last_clean":"2024-05-30T06:45:48.420952+0000","last_became_active":"2024-05-30T06:45:46.531241+0000","last_became_peered":"2024-05-30T06:45:46.531241+0000","last_unstale":"2024-05-30T06:45:48.420952+0000","last_undegraded":"2024-05-30T06:45:48.420952+0000","last_fullsized":"2024-05-30T06:45:48.420952+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:16:56.786714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421725+0000","last_change":"2024-05-30T06:45:46.532613+0000","last_active":"2024-05-30T06:45:48.421725+0000","last_peered":"2024-05-30T06:45:48.421725+0000","last_clean":"2024-05-30T06:45:48.421725+0000","last_became_active":"2024-05-30T06:45:46.532340+0000","last_became_peered":"2024-05-30T06:45:46.532340+0000","last_unstale":"2024-05-30T06:45:48.421725+0000","last_undegraded":"2024-05-30T06:45:48.421725+0000","last_fullsized":"2024-05-30T06:45:48.421725+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:57:29.415372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421596+0000","last_change":"2024-05-30T06:45:46.526282+0000","last_active":"2024-05-30T06:45:48.421596+0000","last_peered":"2024-05-30T06:45:48.421596+0000","last_clean":"2024-05-30T06:45:48.421596+0000","last_became_active":"2024-05-30T06:45:46.525967+0000","last_became_peered":"2024-05-30T06:45:46.525967+0000","last_unstale":"2024-05-30T06:45:48.421596+0000","last_undegraded":"2024-05-30T06:45:48.421596+0000","last_fullsized":"2024-05-30T06:45:48.421596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:31:09.771704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421525+0000","last_change":"2024-05-30T06:45:46.532925+0000","last_active":"2024-05-30T06:45:48.421525+0000","last_peered":"2024-05-30T06:45:48.421525+0000","last_clean":"2024-05-30T06:45:48.421525+0000","last_became_active":"2024-05-30T06:45:46.532615+0000","last_became_peered":"2024-05-30T06:45:46.532615+0000","last_unstale":"2024-05-30T06:45:48.421525+0000","last_undegraded":"2024-05-30T06:45:48.421525+0000","last_fullsized":"2024-05-30T06:45:48.421525+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:59:15.051983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507050+0000","last_change":"2024-05-30T06:45:46.536210+0000","last_active":"2024-05-30T06:45:47.507050+0000","last_peered":"2024-05-30T06:45:47.507050+0000","last_clean":"2024-05-30T06:45:47.507050+0000","last_became_active":"2024-05-30T06:45:46.535800+0000","last_became_peered":"2024-05-30T06:45:46.535800+0000","last_unstale":"2024-05-30T06:45:47.507050+0000","last_undegraded":"2024-05-30T06:45:47.507050+0000","last_fullsized":"2024-05-30T06:45:47.507050+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:53:25.192521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507779+0000","last_change":"2024-05-30T06:45:46.536356+0000","last_active":"2024-05-30T06:45:47.507779+0000","last_peered":"2024-05-30T06:45:47.507779+0000","last_clean":"2024-05-30T06:45:47.507779+0000","last_became_active":"2024-05-30T06:45:46.536046+0000","last_became_peered":"2024-05-30T06:45:46.536046+0000","last_unstale":"2024-05-30T06:45:47.507779+0000","last_undegraded":"2024-05-30T06:45:47.507779+0000","last_fullsized":"2024-05-30T06:45:47.507779+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:46:15.512249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420413+0000","last_change":"2024-05-30T06:45:46.525471+0000","last_active":"2024-05-30T06:45:48.420413+0000","last_peered":"2024-05-30T06:45:48.420413+0000","last_clean":"2024-05-30T06:45:48.420413+0000","last_became_active":"2024-05-30T06:45:46.525152+0000","last_became_peered":"2024-05-30T06:45:46.525152+0000","last_unstale":"2024-05-30T06:45:48.420413+0000","last_undegraded":"2024-05-30T06:45:48.420413+0000","last_fullsized":"2024-05-30T06:45:48.420413+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:27:19.227867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421072+0000","last_change":"2024-05-30T06:45:46.509121+0000","last_active":"2024-05-30T06:45:48.421072+0000","last_peered":"2024-05-30T06:45:48.421072+0000","last_clean":"2024-05-30T06:45:48.421072+0000","last_became_active":"2024-05-30T06:45:46.508805+0000","last_became_peered":"2024-05-30T06:45:46.508805+0000","last_unstale":"2024-05-30T06:45:48.421072+0000","last_undegraded":"2024-05-30T06:45:48.421072+0000","last_fullsized":"2024-05-30T06:45:48.421072+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:53.636035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420179+0000","last_change":"2024-05-30T06:45:46.531235+0000","last_active":"2024-05-30T06:45:48.420179+0000","last_peered":"2024-05-30T06:45:48.420179+0000","last_clean":"2024-05-30T06:45:48.420179+0000","last_became_active":"2024-05-30T06:45:46.530437+0000","last_became_peered":"2024-05-30T06:45:46.530437+0000","last_unstale":"2024-05-30T06:45:48.420179+0000","last_undegraded":"2024-05-30T06:45:48.420179+0000","last_fullsized":"2024-05-30T06:45:48.420179+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:42.317647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420567+0000","last_change":"2024-05-30T06:45:46.507190+0000","last_active":"2024-05-30T06:45:48.420567+0000","last_peered":"2024-05-30T06:45:48.420567+0000","last_clean":"2024-05-30T06:45:48.420567+0000","last_became_active":"2024-05-30T06:45:46.506745+0000","last_became_peered":"2024-05-30T06:45:46.506745+0000","last_unstale":"2024-05-30T06:45:48.420567+0000","last_undegraded":"2024-05-30T06:45:48.420567+0000","last_fullsized":"2024-05-30T06:45:48.420567+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:15.085899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420020+0000","last_change":"2024-05-30T06:45:46.529140+0000","last_active":"2024-05-30T06:45:48.420020+0000","last_peered":"2024-05-30T06:45:48.420020+0000","last_clean":"2024-05-30T06:45:48.420020+0000","last_became_active":"2024-05-30T06:45:46.528643+0000","last_became_peered":"2024-05-30T06:45:46.528643+0000","last_unstale":"2024-05-30T06:45:48.420020+0000","last_undegraded":"2024-05-30T06:45:48.420020+0000","last_fullsized":"2024-05-30T06:45:48.420020+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:16:56.786714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420836+0000","last_change":"2024-05-30T06:45:46.529627+0000","last_active":"2024-05-30T06:45:48.420836+0000","last_peered":"2024-05-30T06:45:48.420836+0000","last_clean":"2024-05-30T06:45:48.420836+0000","last_became_active":"2024-05-30T06:45:46.529291+0000","last_became_peered":"2024-05-30T06:45:46.529291+0000","last_unstale":"2024-05-30T06:45:48.420836+0000","last_undegraded":"2024-05-30T06:45:48.420836+0000","last_fullsized":"2024-05-30T06:45:48.420836+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:11:29.188192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507962+0000","last_change":"2024-05-30T06:45:46.533168+0000","last_active":"2024-05-30T06:45:47.507962+0000","last_peered":"2024-05-30T06:45:47.507962+0000","last_clean":"2024-05-30T06:45:47.507962+0000","last_became_active":"2024-05-30T06:45:46.532824+0000","last_became_peered":"2024-05-30T06:45:46.532824+0000","last_unstale":"2024-05-30T06:45:47.507962+0000","last_undegraded":"2024-05-30T06:45:47.507962+0000","last_fullsized":"2024-05-30T06:45:47.507962+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:19:07.941057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421637+0000","last_change":"2024-05-30T06:45:46.525663+0000","last_active":"2024-05-30T06:45:48.421637+0000","last_peered":"2024-05-30T06:45:48.421637+0000","last_clean":"2024-05-30T06:45:48.421637+0000","last_became_active":"2024-05-30T06:45:46.525446+0000","last_became_peered":"2024-05-30T06:45:46.525446+0000","last_unstale":"2024-05-30T06:45:48.421637+0000","last_undegraded":"2024-05-30T06:45:48.421637+0000","last_fullsized":"2024-05-30T06:45:48.421637+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:04:45.382725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421182+0000","last_change":"2024-05-30T06:45:46.534217+0000","last_active":"2024-05-30T06:45:48.421182+0000","last_peered":"2024-05-30T06:45:48.421182+0000","last_clean":"2024-05-30T06:45:48.421182+0000","last_became_active":"2024-05-30T06:45:46.528651+0000","last_became_peered":"2024-05-30T06:45:46.528651+0000","last_unstale":"2024-05-30T06:45:48.421182+0000","last_undegraded":"2024-05-30T06:45:48.421182+0000","last_fullsized":"2024-05-30T06:45:48.421182+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:33:42.703397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420291+0000","last_change":"2024-05-30T06:45:46.518839+0000","last_active":"2024-05-30T06:45:48.420291+0000","last_peered":"2024-05-30T06:45:48.420291+0000","last_clean":"2024-05-30T06:45:48.420291+0000","last_became_active":"2024-05-30T06:45:46.518576+0000","last_became_peered":"2024-05-30T06:45:46.518576+0000","last_unstale":"2024-05-30T06:45:48.420291+0000","last_undegraded":"2024-05-30T06:45:48.420291+0000","last_fullsized":"2024-05-30T06:45:48.420291+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:19:07.941057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420333+0000","last_change":"2024-05-30T06:45:46.517741+0000","last_active":"2024-05-30T06:45:48.420333+0000","last_peered":"2024-05-30T06:45:48.420333+0000","last_clean":"2024-05-30T06:45:48.420333+0000","last_became_active":"2024-05-30T06:45:46.517443+0000","last_became_peered":"2024-05-30T06:45:46.517443+0000","last_unstale":"2024-05-30T06:45:48.420333+0000","last_undegraded":"2024-05-30T06:45:48.420333+0000","last_fullsized":"2024-05-30T06:45:48.420333+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:32:38.601800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420330+0000","last_change":"2024-05-30T06:45:46.531832+0000","last_active":"2024-05-30T06:45:48.420330+0000","last_peered":"2024-05-30T06:45:48.420330+0000","last_clean":"2024-05-30T06:45:48.420330+0000","last_became_active":"2024-05-30T06:45:46.531547+0000","last_became_peered":"2024-05-30T06:45:46.531547+0000","last_unstale":"2024-05-30T06:45:48.420330+0000","last_undegraded":"2024-05-30T06:45:48.420330+0000","last_fullsized":"2024-05-30T06:45:48.420330+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:19:56.704717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507896+0000","last_change":"2024-05-30T06:45:46.530085+0000","last_active":"2024-05-30T06:45:47.507896+0000","last_peered":"2024-05-30T06:45:47.507896+0000","last_clean":"2024-05-30T06:45:47.507896+0000","last_became_active":"2024-05-30T06:45:46.527488+0000","last_became_peered":"2024-05-30T06:45:46.527488+0000","last_unstale":"2024-05-30T06:45:47.507896+0000","last_undegraded":"2024-05-30T06:45:47.507896+0000","last_fullsized":"2024-05-30T06:45:47.507896+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:42.317647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420489+0000","last_change":"2024-05-30T06:45:46.507073+0000","last_active":"2024-05-30T06:45:48.420489+0000","last_peered":"2024-05-30T06:45:48.420489+0000","last_clean":"2024-05-30T06:45:48.420489+0000","last_became_active":"2024-05-30T06:45:46.506775+0000","last_became_peered":"2024-05-30T06:45:46.506775+0000","last_unstale":"2024-05-30T06:45:48.420489+0000","last_undegraded":"2024-05-30T06:45:48.420489+0000","last_fullsized":"2024-05-30T06:45:48.420489+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:58.784375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507156+0000","last_change":"2024-05-30T06:45:46.536235+0000","last_active":"2024-05-30T06:45:47.507156+0000","last_peered":"2024-05-30T06:45:47.507156+0000","last_clean":"2024-05-30T06:45:47.507156+0000","last_became_active":"2024-05-30T06:45:46.535795+0000","last_became_peered":"2024-05-30T06:45:46.535795+0000","last_unstale":"2024-05-30T06:45:47.507156+0000","last_undegraded":"2024-05-30T06:45:47.507156+0000","last_fullsized":"2024-05-30T06:45:47.507156+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:12.891977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420778+0000","last_change":"2024-05-30T06:45:46.524842+0000","last_active":"2024-05-30T06:45:48.420778+0000","last_peered":"2024-05-30T06:45:48.420778+0000","last_clean":"2024-05-30T06:45:48.420778+0000","last_became_active":"2024-05-30T06:45:46.524559+0000","last_became_peered":"2024-05-30T06:45:46.524559+0000","last_unstale":"2024-05-30T06:45:48.420778+0000","last_undegraded":"2024-05-30T06:45:48.420778+0000","last_fullsized":"2024-05-30T06:45:48.420778+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:51:09.393804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.419750+0000","last_change":"2024-05-30T06:45:46.510554+0000","last_active":"2024-05-30T06:45:48.419750+0000","last_peered":"2024-05-30T06:45:48.419750+0000","last_clean":"2024-05-30T06:45:48.419750+0000","last_became_active":"2024-05-30T06:45:46.510292+0000","last_became_peered":"2024-05-30T06:45:46.510292+0000","last_unstale":"2024-05-30T06:45:48.419750+0000","last_undegraded":"2024-05-30T06:45:48.419750+0000","last_fullsized":"2024-05-30T06:45:48.419750+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:21:12.390635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420347+0000","last_change":"2024-05-30T06:45:46.510157+0000","last_active":"2024-05-30T06:45:48.420347+0000","last_peered":"2024-05-30T06:45:48.420347+0000","last_clean":"2024-05-30T06:45:48.420347+0000","last_became_active":"2024-05-30T06:45:46.509860+0000","last_became_peered":"2024-05-30T06:45:46.509860+0000","last_unstale":"2024-05-30T06:45:48.420347+0000","last_undegraded":"2024-05-30T06:45:48.420347+0000","last_fullsized":"2024-05-30T06:45:48.420347+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:43:48.711481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507577+0000","last_change":"2024-05-30T06:45:46.540023+0000","last_active":"2024-05-30T06:45:47.507577+0000","last_peered":"2024-05-30T06:45:47.507577+0000","last_clean":"2024-05-30T06:45:47.507577+0000","last_became_active":"2024-05-30T06:45:46.539636+0000","last_became_peered":"2024-05-30T06:45:46.539636+0000","last_unstale":"2024-05-30T06:45:47.507577+0000","last_undegraded":"2024-05-30T06:45:47.507577+0000","last_fullsized":"2024-05-30T06:45:47.507577+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:13.854205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506460+0000","last_change":"2024-05-30T06:45:46.538788+0000","last_active":"2024-05-30T06:45:47.506460+0000","last_peered":"2024-05-30T06:45:47.506460+0000","last_clean":"2024-05-30T06:45:47.506460+0000","last_became_active":"2024-05-30T06:45:46.538521+0000","last_became_peered":"2024-05-30T06:45:46.538521+0000","last_unstale":"2024-05-30T06:45:47.506460+0000","last_undegraded":"2024-05-30T06:45:47.506460+0000","last_fullsized":"2024-05-30T06:45:47.506460+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:21:12.390635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421448+0000","last_change":"2024-05-30T06:45:45.511345+0000","last_active":"2024-05-30T06:45:48.421448+0000","last_peered":"2024-05-30T06:45:48.421448+0000","last_clean":"2024-05-30T06:45:48.421448+0000","last_became_active":"2024-05-30T06:45:45.511081+0000","last_became_peered":"2024-05-30T06:45:45.511081+0000","last_unstale":"2024-05-30T06:45:48.421448+0000","last_undegraded":"2024-05-30T06:45:48.421448+0000","last_fullsized":"2024-05-30T06:45:48.421448+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:36:21.790531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420567+0000","last_change":"2024-05-30T06:45:46.519498+0000","last_active":"2024-05-30T06:45:48.420567+0000","last_peered":"2024-05-30T06:45:48.420567+0000","last_clean":"2024-05-30T06:45:48.420567+0000","last_became_active":"2024-05-30T06:45:46.518943+0000","last_became_peered":"2024-05-30T06:45:46.518943+0000","last_unstale":"2024-05-30T06:45:48.420567+0000","last_undegraded":"2024-05-30T06:45:48.420567+0000","last_fullsized":"2024-05-30T06:45:48.420567+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:49:45.035621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420289+0000","last_change":"2024-05-30T06:45:45.511513+0000","last_active":"2024-05-30T06:45:48.420289+0000","last_peered":"2024-05-30T06:45:48.420289+0000","last_clean":"2024-05-30T06:45:48.420289+0000","last_became_active":"2024-05-30T06:45:45.511236+0000","last_became_peered":"2024-05-30T06:45:45.511236+0000","last_unstale":"2024-05-30T06:45:48.420289+0000","last_undegraded":"2024-05-30T06:45:48.420289+0000","last_fullsized":"2024-05-30T06:45:48.420289+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:32:37.598684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507248+0000","last_change":"2024-05-30T06:45:46.512931+0000","last_active":"2024-05-30T06:45:47.507248+0000","last_peered":"2024-05-30T06:45:47.507248+0000","last_clean":"2024-05-30T06:45:47.507248+0000","last_became_active":"2024-05-30T06:45:46.512580+0000","last_became_peered":"2024-05-30T06:45:46.512580+0000","last_unstale":"2024-05-30T06:45:47.507248+0000","last_undegraded":"2024-05-30T06:45:47.507248+0000","last_fullsized":"2024-05-30T06:45:47.507248+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:49:01.166450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506687+0000","last_change":"2024-05-30T06:45:45.523045+0000","last_active":"2024-05-30T06:45:47.506687+0000","last_peered":"2024-05-30T06:45:47.506687+0000","last_clean":"2024-05-30T06:45:47.506687+0000","last_became_active":"2024-05-30T06:45:45.521858+0000","last_became_peered":"2024-05-30T06:45:45.521858+0000","last_unstale":"2024-05-30T06:45:47.506687+0000","last_undegraded":"2024-05-30T06:45:47.506687+0000","last_fullsized":"2024-05-30T06:45:47.506687+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:51:08.390688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506661+0000","last_change":"2024-05-30T06:45:46.534929+0000","last_active":"2024-05-30T06:45:47.506661+0000","last_peered":"2024-05-30T06:45:47.506661+0000","last_clean":"2024-05-30T06:45:47.506661+0000","last_became_active":"2024-05-30T06:45:46.534483+0000","last_became_peered":"2024-05-30T06:45:46.534483+0000","last_unstale":"2024-05-30T06:45:47.506661+0000","last_undegraded":"2024-05-30T06:45:47.506661+0000","last_fullsized":"2024-05-30T06:45:47.506661+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:27:19.227867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922293+0000","last_change":"2024-05-30T06:45:45.521774+0000","last_active":"2024-05-30T06:45:47.922293+0000","last_peered":"2024-05-30T06:45:47.922293+0000","last_clean":"2024-05-30T06:45:47.922293+0000","last_became_active":"2024-05-30T06:45:45.521044+0000","last_became_peered":"2024-05-30T06:45:45.521044+0000","last_unstale":"2024-05-30T06:45:47.922293+0000","last_undegraded":"2024-05-30T06:45:47.922293+0000","last_fullsized":"2024-05-30T06:45:47.922293+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:14.712362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.419749+0000","last_change":"2024-05-30T06:45:46.519488+0000","last_active":"2024-05-30T06:45:48.419749+0000","last_peered":"2024-05-30T06:45:48.419749+0000","last_clean":"2024-05-30T06:45:48.419749+0000","last_became_active":"2024-05-30T06:45:46.519194+0000","last_became_peered":"2024-05-30T06:45:46.519194+0000","last_unstale":"2024-05-30T06:45:48.419749+0000","last_undegraded":"2024-05-30T06:45:48.419749+0000","last_fullsized":"2024-05-30T06:45:48.419749+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:27:19.227867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420866+0000","last_change":"2024-05-30T06:45:45.513554+0000","last_active":"2024-05-30T06:45:48.420866+0000","last_peered":"2024-05-30T06:45:48.420866+0000","last_clean":"2024-05-30T06:45:48.420866+0000","last_became_active":"2024-05-30T06:45:45.512964+0000","last_became_peered":"2024-05-30T06:45:45.512964+0000","last_unstale":"2024-05-30T06:45:48.420866+0000","last_undegraded":"2024-05-30T06:45:48.420866+0000","last_fullsized":"2024-05-30T06:45:48.420866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:14:15.837173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421656+0000","last_change":"2024-05-30T06:45:46.542304+0000","last_active":"2024-05-30T06:45:48.421656+0000","last_peered":"2024-05-30T06:45:48.421656+0000","last_clean":"2024-05-30T06:45:48.421656+0000","last_became_active":"2024-05-30T06:45:46.542026+0000","last_became_peered":"2024-05-30T06:45:46.542026+0000","last_unstale":"2024-05-30T06:45:48.421656+0000","last_undegraded":"2024-05-30T06:45:48.421656+0000","last_fullsized":"2024-05-30T06:45:48.421656+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:04:58.211923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420322+0000","last_change":"2024-05-30T06:45:45.519838+0000","last_active":"2024-05-30T06:45:48.420322+0000","last_peered":"2024-05-30T06:45:48.420322+0000","last_clean":"2024-05-30T06:45:48.420322+0000","last_became_active":"2024-05-30T06:45:45.519519+0000","last_became_peered":"2024-05-30T06:45:45.519519+0000","last_unstale":"2024-05-30T06:45:48.420322+0000","last_undegraded":"2024-05-30T06:45:48.420322+0000","last_fullsized":"2024-05-30T06:45:48.420322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:41.314531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420540+0000","last_change":"2024-05-30T06:45:46.528970+0000","last_active":"2024-05-30T06:45:48.420540+0000","last_peered":"2024-05-30T06:45:48.420540+0000","last_clean":"2024-05-30T06:45:48.420540+0000","last_became_active":"2024-05-30T06:45:46.528675+0000","last_became_peered":"2024-05-30T06:45:46.528675+0000","last_unstale":"2024-05-30T06:45:48.420540+0000","last_undegraded":"2024-05-30T06:45:48.420540+0000","last_fullsized":"2024-05-30T06:45:48.420540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:43.737263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506713+0000","last_change":"2024-05-30T06:45:45.523456+0000","last_active":"2024-05-30T06:45:47.506713+0000","last_peered":"2024-05-30T06:45:47.506713+0000","last_clean":"2024-05-30T06:45:47.506713+0000","last_became_active":"2024-05-30T06:45:45.523150+0000","last_became_peered":"2024-05-30T06:45:45.523150+0000","last_unstale":"2024-05-30T06:45:47.506713+0000","last_undegraded":"2024-05-30T06:45:47.506713+0000","last_fullsized":"2024-05-30T06:45:47.506713+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:56:42.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420483+0000","last_change":"2024-05-30T06:45:46.519676+0000","last_active":"2024-05-30T06:45:48.420483+0000","last_peered":"2024-05-30T06:45:48.420483+0000","last_clean":"2024-05-30T06:45:48.420483+0000","last_became_active":"2024-05-30T06:45:46.518204+0000","last_became_peered":"2024-05-30T06:45:46.518204+0000","last_unstale":"2024-05-30T06:45:48.420483+0000","last_undegraded":"2024-05-30T06:45:48.420483+0000","last_fullsized":"2024-05-30T06:45:48.420483+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:31:00.454059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420644+0000","last_change":"2024-05-30T06:45:45.519751+0000","last_active":"2024-05-30T06:45:48.420644+0000","last_peered":"2024-05-30T06:45:48.420644+0000","last_clean":"2024-05-30T06:45:48.420644+0000","last_became_active":"2024-05-30T06:45:45.519458+0000","last_became_peered":"2024-05-30T06:45:45.519458+0000","last_unstale":"2024-05-30T06:45:48.420644+0000","last_undegraded":"2024-05-30T06:45:48.420644+0000","last_fullsized":"2024-05-30T06:45:48.420644+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:10:48.555104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420173+0000","last_change":"2024-05-30T06:45:46.528913+0000","last_active":"2024-05-30T06:45:48.420173+0000","last_peered":"2024-05-30T06:45:48.420173+0000","last_clean":"2024-05-30T06:45:48.420173+0000","last_became_active":"2024-05-30T06:45:46.528045+0000","last_became_peered":"2024-05-30T06:45:46.528045+0000","last_unstale":"2024-05-30T06:45:48.420173+0000","last_undegraded":"2024-05-30T06:45:48.420173+0000","last_fullsized":"2024-05-30T06:45:48.420173+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:33:42.703397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420610+0000","last_change":"2024-05-30T06:45:45.525631+0000","last_active":"2024-05-30T06:45:48.420610+0000","last_peered":"2024-05-30T06:45:48.420610+0000","last_clean":"2024-05-30T06:45:48.420610+0000","last_became_active":"2024-05-30T06:45:45.525396+0000","last_became_peered":"2024-05-30T06:45:45.525396+0000","last_unstale":"2024-05-30T06:45:48.420610+0000","last_undegraded":"2024-05-30T06:45:48.420610+0000","last_fullsized":"2024-05-30T06:45:48.420610+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:46:14.509133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922608+0000","last_change":"2024-05-30T06:45:46.525622+0000","last_active":"2024-05-30T06:45:47.922608+0000","last_peered":"2024-05-30T06:45:47.922608+0000","last_clean":"2024-05-30T06:45:47.922608+0000","last_became_active":"2024-05-30T06:45:46.521223+0000","last_became_peered":"2024-05-30T06:45:46.521223+0000","last_unstale":"2024-05-30T06:45:47.922608+0000","last_undegraded":"2024-05-30T06:45:47.922608+0000","last_fullsized":"2024-05-30T06:45:47.922608+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:34:58.929115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421706+0000","last_change":"2024-05-30T06:45:45.515922+0000","last_active":"2024-05-30T06:45:48.421706+0000","last_peered":"2024-05-30T06:45:48.421706+0000","last_clean":"2024-05-30T06:45:48.421706+0000","last_became_active":"2024-05-30T06:45:45.515570+0000","last_became_peered":"2024-05-30T06:45:45.515570+0000","last_unstale":"2024-05-30T06:45:48.421706+0000","last_undegraded":"2024-05-30T06:45:48.421706+0000","last_fullsized":"2024-05-30T06:45:48.421706+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:12.851089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420729+0000","last_change":"2024-05-30T06:45:46.538379+0000","last_active":"2024-05-30T06:45:48.420729+0000","last_peered":"2024-05-30T06:45:48.420729+0000","last_clean":"2024-05-30T06:45:48.420729+0000","last_became_active":"2024-05-30T06:45:46.537580+0000","last_became_peered":"2024-05-30T06:45:46.537580+0000","last_unstale":"2024-05-30T06:45:48.420729+0000","last_undegraded":"2024-05-30T06:45:48.420729+0000","last_fullsized":"2024-05-30T06:45:48.420729+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:48:09.626049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922657+0000","last_change":"2024-05-30T06:45:45.516922+0000","last_active":"2024-05-30T06:45:47.922657+0000","last_peered":"2024-05-30T06:45:47.922657+0000","last_clean":"2024-05-30T06:45:47.922657+0000","last_became_active":"2024-05-30T06:45:45.516452+0000","last_became_peered":"2024-05-30T06:45:45.516452+0000","last_unstale":"2024-05-30T06:45:47.922657+0000","last_undegraded":"2024-05-30T06:45:47.922657+0000","last_fullsized":"2024-05-30T06:45:47.922657+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:40:04.623729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922530+0000","last_change":"2024-05-30T06:45:46.538549+0000","last_active":"2024-05-30T06:45:47.922530+0000","last_peered":"2024-05-30T06:45:47.922530+0000","last_clean":"2024-05-30T06:45:47.922530+0000","last_became_active":"2024-05-30T06:45:46.538228+0000","last_became_peered":"2024-05-30T06:45:46.538228+0000","last_unstale":"2024-05-30T06:45:47.922530+0000","last_undegraded":"2024-05-30T06:45:47.922530+0000","last_fullsized":"2024-05-30T06:45:47.922530+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:12.891977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507959+0000","last_change":"2024-05-30T06:45:45.525131+0000","last_active":"2024-05-30T06:45:47.507959+0000","last_peered":"2024-05-30T06:45:47.507959+0000","last_clean":"2024-05-30T06:45:47.507959+0000","last_became_active":"2024-05-30T06:45:45.524799+0000","last_became_peered":"2024-05-30T06:45:45.524799+0000","last_unstale":"2024-05-30T06:45:47.507959+0000","last_undegraded":"2024-05-30T06:45:47.507959+0000","last_fullsized":"2024-05-30T06:45:47.507959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:09:55.475465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420724+0000","last_change":"2024-05-30T06:45:46.530931+0000","last_active":"2024-05-30T06:45:48.420724+0000","last_peered":"2024-05-30T06:45:48.420724+0000","last_clean":"2024-05-30T06:45:48.420724+0000","last_became_active":"2024-05-30T06:45:46.530667+0000","last_became_peered":"2024-05-30T06:45:46.530667+0000","last_unstale":"2024-05-30T06:45:48.420724+0000","last_undegraded":"2024-05-30T06:45:48.420724+0000","last_fullsized":"2024-05-30T06:45:48.420724+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:41:35.767453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420983+0000","last_change":"2024-05-30T06:45:45.513280+0000","last_active":"2024-05-30T06:45:48.420983+0000","last_peered":"2024-05-30T06:45:48.420983+0000","last_clean":"2024-05-30T06:45:48.420983+0000","last_became_active":"2024-05-30T06:45:45.512582+0000","last_became_peered":"2024-05-30T06:45:45.512582+0000","last_unstale":"2024-05-30T06:45:48.420983+0000","last_undegraded":"2024-05-30T06:45:48.420983+0000","last_fullsized":"2024-05-30T06:45:48.420983+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:51:59.290891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421198+0000","last_change":"2024-05-30T06:45:46.519850+0000","last_active":"2024-05-30T06:45:48.421198+0000","last_peered":"2024-05-30T06:45:48.421198+0000","last_clean":"2024-05-30T06:45:48.421198+0000","last_became_active":"2024-05-30T06:45:46.519499+0000","last_became_peered":"2024-05-30T06:45:46.519499+0000","last_unstale":"2024-05-30T06:45:48.421198+0000","last_undegraded":"2024-05-30T06:45:48.421198+0000","last_fullsized":"2024-05-30T06:45:48.421198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:58.784375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922374+0000","last_change":"2024-05-30T06:45:45.524337+0000","last_active":"2024-05-30T06:45:47.922374+0000","last_peered":"2024-05-30T06:45:47.922374+0000","last_clean":"2024-05-30T06:45:47.922374+0000","last_became_active":"2024-05-30T06:45:45.523781+0000","last_became_peered":"2024-05-30T06:45:45.523781+0000","last_unstale":"2024-05-30T06:45:47.922374+0000","last_undegraded":"2024-05-30T06:45:47.922374+0000","last_fullsized":"2024-05-30T06:45:47.922374+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:56:42.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420238+0000","last_change":"2024-05-30T06:45:46.534419+0000","last_active":"2024-05-30T06:45:48.420238+0000","last_peered":"2024-05-30T06:45:48.420238+0000","last_clean":"2024-05-30T06:45:48.420238+0000","last_became_active":"2024-05-30T06:45:46.534149+0000","last_became_peered":"2024-05-30T06:45:46.534149+0000","last_unstale":"2024-05-30T06:45:48.420238+0000","last_undegraded":"2024-05-30T06:45:48.420238+0000","last_fullsized":"2024-05-30T06:45:48.420238+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:42.056498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420482+0000","last_change":"2024-05-30T06:45:45.523219+0000","last_active":"2024-05-30T06:45:48.420482+0000","last_peered":"2024-05-30T06:45:48.420482+0000","last_clean":"2024-05-30T06:45:48.420482+0000","last_became_active":"2024-05-30T06:45:45.522943+0000","last_became_peered":"2024-05-30T06:45:45.522943+0000","last_unstale":"2024-05-30T06:45:48.420482+0000","last_undegraded":"2024-05-30T06:45:48.420482+0000","last_fullsized":"2024-05-30T06:45:48.420482+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:23:39.284033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922523+0000","last_change":"2024-05-30T06:45:46.527541+0000","last_active":"2024-05-30T06:45:47.922523+0000","last_peered":"2024-05-30T06:45:47.922523+0000","last_clean":"2024-05-30T06:45:47.922523+0000","last_became_active":"2024-05-30T06:45:46.524174+0000","last_became_peered":"2024-05-30T06:45:46.524174+0000","last_unstale":"2024-05-30T06:45:47.922523+0000","last_undegraded":"2024-05-30T06:45:47.922523+0000","last_fullsized":"2024-05-30T06:45:47.922523+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:53:25.192521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420757+0000","last_change":"2024-05-30T06:45:45.522731+0000","last_active":"2024-05-30T06:45:48.420757+0000","last_peered":"2024-05-30T06:45:48.420757+0000","last_clean":"2024-05-30T06:45:48.420757+0000","last_became_active":"2024-05-30T06:45:45.522442+0000","last_became_peered":"2024-05-30T06:45:45.522442+0000","last_unstale":"2024-05-30T06:45:48.420757+0000","last_undegraded":"2024-05-30T06:45:48.420757+0000","last_fullsized":"2024-05-30T06:45:48.420757+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:46:26.713791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507992+0000","last_change":"2024-05-30T06:45:46.529820+0000","last_active":"2024-05-30T06:45:47.507992+0000","last_peered":"2024-05-30T06:45:47.507992+0000","last_clean":"2024-05-30T06:45:47.507992+0000","last_became_active":"2024-05-30T06:45:46.527253+0000","last_became_peered":"2024-05-30T06:45:46.527253+0000","last_unstale":"2024-05-30T06:45:47.507992+0000","last_undegraded":"2024-05-30T06:45:47.507992+0000","last_fullsized":"2024-05-30T06:45:47.507992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:32:38.601800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507949+0000","last_change":"2024-05-30T06:45:45.524146+0000","last_active":"2024-05-30T06:45:47.507949+0000","last_peered":"2024-05-30T06:45:47.507949+0000","last_clean":"2024-05-30T06:45:47.507949+0000","last_became_active":"2024-05-30T06:45:45.523866+0000","last_became_peered":"2024-05-30T06:45:45.523866+0000","last_unstale":"2024-05-30T06:45:47.507949+0000","last_undegraded":"2024-05-30T06:45:47.507949+0000","last_fullsized":"2024-05-30T06:45:47.507949+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:11:16.836722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421796+0000","last_change":"2024-05-30T06:45:46.522222+0000","last_active":"2024-05-30T06:45:48.421796+0000","last_peered":"2024-05-30T06:45:48.421796+0000","last_clean":"2024-05-30T06:45:48.421796+0000","last_became_active":"2024-05-30T06:45:46.521897+0000","last_became_peered":"2024-05-30T06:45:46.521897+0000","last_unstale":"2024-05-30T06:45:48.421796+0000","last_undegraded":"2024-05-30T06:45:48.421796+0000","last_fullsized":"2024-05-30T06:45:48.421796+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:56:13.838632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420341+0000","last_change":"2024-05-30T06:45:45.511016+0000","last_active":"2024-05-30T06:45:48.420341+0000","last_peered":"2024-05-30T06:45:48.420341+0000","last_clean":"2024-05-30T06:45:48.420341+0000","last_became_active":"2024-05-30T06:45:45.510739+0000","last_became_peered":"2024-05-30T06:45:45.510739+0000","last_unstale":"2024-05-30T06:45:48.420341+0000","last_undegraded":"2024-05-30T06:45:48.420341+0000","last_fullsized":"2024-05-30T06:45:48.420341+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:19:55.701600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420360+0000","last_change":"2024-05-30T06:45:46.524021+0000","last_active":"2024-05-30T06:45:48.420360+0000","last_peered":"2024-05-30T06:45:48.420360+0000","last_clean":"2024-05-30T06:45:48.420360+0000","last_became_active":"2024-05-30T06:45:46.523413+0000","last_became_peered":"2024-05-30T06:45:46.523413+0000","last_unstale":"2024-05-30T06:45:48.420360+0000","last_undegraded":"2024-05-30T06:45:48.420360+0000","last_fullsized":"2024-05-30T06:45:48.420360+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:07.620058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506961+0000","last_change":"2024-05-30T06:45:45.523140+0000","last_active":"2024-05-30T06:45:47.506961+0000","last_peered":"2024-05-30T06:45:47.506961+0000","last_clean":"2024-05-30T06:45:47.506961+0000","last_became_active":"2024-05-30T06:45:45.522890+0000","last_became_peered":"2024-05-30T06:45:45.522890+0000","last_unstale":"2024-05-30T06:45:47.506961+0000","last_undegraded":"2024-05-30T06:45:47.506961+0000","last_fullsized":"2024-05-30T06:45:47.506961+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:46:07.797374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420883+0000","last_change":"2024-05-30T06:45:46.532899+0000","last_active":"2024-05-30T06:45:48.420883+0000","last_peered":"2024-05-30T06:45:48.420883+0000","last_clean":"2024-05-30T06:45:48.420883+0000","last_became_active":"2024-05-30T06:45:46.531287+0000","last_became_peered":"2024-05-30T06:45:46.531287+0000","last_unstale":"2024-05-30T06:45:48.420883+0000","last_undegraded":"2024-05-30T06:45:48.420883+0000","last_fullsized":"2024-05-30T06:45:48.420883+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:02:47.890146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421556+0000","last_change":"2024-05-30T06:45:45.510614+0000","last_active":"2024-05-30T06:45:48.421556+0000","last_peered":"2024-05-30T06:45:48.421556+0000","last_clean":"2024-05-30T06:45:48.421556+0000","last_became_active":"2024-05-30T06:45:45.510200+0000","last_became_peered":"2024-05-30T06:45:45.510200+0000","last_unstale":"2024-05-30T06:45:48.421556+0000","last_undegraded":"2024-05-30T06:45:48.421556+0000","last_fullsized":"2024-05-30T06:45:48.421556+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:47:49.567091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420817+0000","last_change":"2024-05-30T06:45:46.538463+0000","last_active":"2024-05-30T06:45:48.420817+0000","last_peered":"2024-05-30T06:45:48.420817+0000","last_clean":"2024-05-30T06:45:48.420817+0000","last_became_active":"2024-05-30T06:45:46.538036+0000","last_became_peered":"2024-05-30T06:45:46.538036+0000","last_unstale":"2024-05-30T06:45:48.420817+0000","last_undegraded":"2024-05-30T06:45:48.420817+0000","last_fullsized":"2024-05-30T06:45:48.420817+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:54:17.058841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421183+0000","last_change":"2024-05-30T06:45:45.519078+0000","last_active":"2024-05-30T06:45:48.421183+0000","last_peered":"2024-05-30T06:45:48.421183+0000","last_clean":"2024-05-30T06:45:48.421183+0000","last_became_active":"2024-05-30T06:45:45.518561+0000","last_became_peered":"2024-05-30T06:45:45.518561+0000","last_unstale":"2024-05-30T06:45:48.421183+0000","last_undegraded":"2024-05-30T06:45:48.421183+0000","last_fullsized":"2024-05-30T06:45:48.421183+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:28:50.906371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506412+0000","last_change":"2024-05-30T06:45:46.529483+0000","last_active":"2024-05-30T06:45:47.506412+0000","last_peered":"2024-05-30T06:45:47.506412+0000","last_clean":"2024-05-30T06:45:47.506412+0000","last_became_active":"2024-05-30T06:45:46.529127+0000","last_became_peered":"2024-05-30T06:45:46.529127+0000","last_unstale":"2024-05-30T06:45:47.506412+0000","last_undegraded":"2024-05-30T06:45:47.506412+0000","last_fullsized":"2024-05-30T06:45:47.506412+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:10:18.096100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507053+0000","last_change":"2024-05-30T06:45:45.518867+0000","last_active":"2024-05-30T06:45:47.507053+0000","last_peered":"2024-05-30T06:45:47.507053+0000","last_clean":"2024-05-30T06:45:47.507053+0000","last_became_active":"2024-05-30T06:45:45.518576+0000","last_became_peered":"2024-05-30T06:45:45.518576+0000","last_unstale":"2024-05-30T06:45:47.507053+0000","last_undegraded":"2024-05-30T06:45:47.507053+0000","last_fullsized":"2024-05-30T06:45:47.507053+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:40:04.623729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507645+0000","last_change":"2024-05-30T06:45:46.528390+0000","last_active":"2024-05-30T06:45:47.507645+0000","last_peered":"2024-05-30T06:45:47.507645+0000","last_clean":"2024-05-30T06:45:47.507645+0000","last_became_active":"2024-05-30T06:45:46.528126+0000","last_became_peered":"2024-05-30T06:45:46.528126+0000","last_unstale":"2024-05-30T06:45:47.507645+0000","last_undegraded":"2024-05-30T06:45:47.507645+0000","last_fullsized":"2024-05-30T06:45:47.507645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:42:31.705492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420534+0000","last_change":"2024-05-30T06:45:45.514789+0000","last_active":"2024-05-30T06:45:48.420534+0000","last_peered":"2024-05-30T06:45:48.420534+0000","last_clean":"2024-05-30T06:45:48.420534+0000","last_became_active":"2024-05-30T06:45:45.514205+0000","last_became_peered":"2024-05-30T06:45:45.514205+0000","last_unstale":"2024-05-30T06:45:48.420534+0000","last_undegraded":"2024-05-30T06:45:48.420534+0000","last_fullsized":"2024-05-30T06:45:48.420534+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:44.464720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420331+0000","last_change":"2024-05-30T06:45:46.542727+0000","last_active":"2024-05-30T06:45:48.420331+0000","last_peered":"2024-05-30T06:45:48.420331+0000","last_clean":"2024-05-30T06:45:48.420331+0000","last_became_active":"2024-05-30T06:45:46.542476+0000","last_became_peered":"2024-05-30T06:45:46.542476+0000","last_unstale":"2024-05-30T06:45:48.420331+0000","last_undegraded":"2024-05-30T06:45:48.420331+0000","last_fullsized":"2024-05-30T06:45:48.420331+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:21:12.390635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922242+0000","last_change":"2024-05-30T06:45:45.524117+0000","last_active":"2024-05-30T06:45:47.922242+0000","last_peered":"2024-05-30T06:45:47.922242+0000","last_clean":"2024-05-30T06:45:47.922242+0000","last_became_active":"2024-05-30T06:45:45.523821+0000","last_became_peered":"2024-05-30T06:45:45.523821+0000","last_unstale":"2024-05-30T06:45:47.922242+0000","last_undegraded":"2024-05-30T06:45:47.922242+0000","last_fullsized":"2024-05-30T06:45:47.922242+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:43:35.943564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420751+0000","last_change":"2024-05-30T06:45:46.529852+0000","last_active":"2024-05-30T06:45:48.420751+0000","last_peered":"2024-05-30T06:45:48.420751+0000","last_clean":"2024-05-30T06:45:48.420751+0000","last_became_active":"2024-05-30T06:45:46.529548+0000","last_became_peered":"2024-05-30T06:45:46.529548+0000","last_unstale":"2024-05-30T06:45:48.420751+0000","last_undegraded":"2024-05-30T06:45:48.420751+0000","last_fullsized":"2024-05-30T06:45:48.420751+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:16.375453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"46'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.514028+0000","last_change":"2024-05-30T06:45:45.513207+0000","last_active":"2024-05-30T06:45:48.514028+0000","last_peered":"2024-05-30T06:45:48.514028+0000","last_clean":"2024-05-30T06:45:48.514028+0000","last_became_active":"2024-05-30T06:45:45.512865+0000","last_became_peered":"2024-05-30T06:45:45.512865+0000","last_unstale":"2024-05-30T06:45:48.514028+0000","last_undegraded":"2024-05-30T06:45:48.514028+0000","last_fullsized":"2024-05-30T06:45:48.514028+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:15.381522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421798+0000","last_change":"2024-05-30T06:45:46.516601+0000","last_active":"2024-05-30T06:45:48.421798+0000","last_peered":"2024-05-30T06:45:48.421798+0000","last_clean":"2024-05-30T06:45:48.421798+0000","last_became_active":"2024-05-30T06:45:46.516270+0000","last_became_peered":"2024-05-30T06:45:46.516270+0000","last_unstale":"2024-05-30T06:45:48.421798+0000","last_undegraded":"2024-05-30T06:45:48.421798+0000","last_fullsized":"2024-05-30T06:45:48.421798+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:51:29.501279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922699+0000","last_change":"2024-05-30T06:45:45.516945+0000","last_active":"2024-05-30T06:45:47.922699+0000","last_peered":"2024-05-30T06:45:47.922699+0000","last_clean":"2024-05-30T06:45:47.922699+0000","last_became_active":"2024-05-30T06:45:45.516589+0000","last_became_peered":"2024-05-30T06:45:45.516589+0000","last_unstale":"2024-05-30T06:45:47.922699+0000","last_undegraded":"2024-05-30T06:45:47.922699+0000","last_fullsized":"2024-05-30T06:45:47.922699+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:21:37.162126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922573+0000","last_change":"2024-05-30T06:45:46.533333+0000","last_active":"2024-05-30T06:45:47.922573+0000","last_peered":"2024-05-30T06:45:47.922573+0000","last_clean":"2024-05-30T06:45:47.922573+0000","last_became_active":"2024-05-30T06:45:46.532825+0000","last_became_peered":"2024-05-30T06:45:46.532825+0000","last_unstale":"2024-05-30T06:45:47.922573+0000","last_undegraded":"2024-05-30T06:45:47.922573+0000","last_fullsized":"2024-05-30T06:45:47.922573+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:49:01.166450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506425+0000","last_change":"2024-05-30T06:45:45.523016+0000","last_active":"2024-05-30T06:45:47.506425+0000","last_peered":"2024-05-30T06:45:47.506425+0000","last_clean":"2024-05-30T06:45:47.506425+0000","last_became_active":"2024-05-30T06:45:45.522740+0000","last_became_peered":"2024-05-30T06:45:45.522740+0000","last_unstale":"2024-05-30T06:45:47.506425+0000","last_undegraded":"2024-05-30T06:45:47.506425+0000","last_fullsized":"2024-05-30T06:45:47.506425+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:53:15.372337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420869+0000","last_change":"2024-05-30T06:45:46.522992+0000","last_active":"2024-05-30T06:45:48.420869+0000","last_peered":"2024-05-30T06:45:48.420869+0000","last_clean":"2024-05-30T06:45:48.420869+0000","last_became_active":"2024-05-30T06:45:46.519951+0000","last_became_peered":"2024-05-30T06:45:46.519951+0000","last_unstale":"2024-05-30T06:45:48.420869+0000","last_undegraded":"2024-05-30T06:45:48.420869+0000","last_fullsized":"2024-05-30T06:45:48.420869+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:47:49.723434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922379+0000","last_change":"2024-05-30T06:45:45.517691+0000","last_active":"2024-05-30T06:45:47.922379+0000","last_peered":"2024-05-30T06:45:47.922379+0000","last_clean":"2024-05-30T06:45:47.922379+0000","last_became_active":"2024-05-30T06:45:45.517487+0000","last_became_peered":"2024-05-30T06:45:45.517487+0000","last_unstale":"2024-05-30T06:45:47.922379+0000","last_undegraded":"2024-05-30T06:45:47.922379+0000","last_fullsized":"2024-05-30T06:45:47.922379+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:46:07.797374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420714+0000","last_change":"2024-05-30T06:45:46.535589+0000","last_active":"2024-05-30T06:45:48.420714+0000","last_peered":"2024-05-30T06:45:48.420714+0000","last_clean":"2024-05-30T06:45:48.420714+0000","last_became_active":"2024-05-30T06:45:46.535330+0000","last_became_peered":"2024-05-30T06:45:46.535330+0000","last_unstale":"2024-05-30T06:45:48.420714+0000","last_undegraded":"2024-05-30T06:45:48.420714+0000","last_fullsized":"2024-05-30T06:45:48.420714+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:27:54.777149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.419892+0000","last_change":"2024-05-30T06:45:45.514290+0000","last_active":"2024-05-30T06:45:48.419892+0000","last_peered":"2024-05-30T06:45:48.419892+0000","last_clean":"2024-05-30T06:45:48.419892+0000","last_became_active":"2024-05-30T06:45:45.514015+0000","last_became_peered":"2024-05-30T06:45:45.514015+0000","last_unstale":"2024-05-30T06:45:48.419892+0000","last_undegraded":"2024-05-30T06:45:48.419892+0000","last_fullsized":"2024-05-30T06:45:48.419892+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:19:06.937941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506899+0000","last_change":"2024-05-30T06:45:46.527304+0000","last_active":"2024-05-30T06:45:47.506899+0000","last_peered":"2024-05-30T06:45:47.506899+0000","last_clean":"2024-05-30T06:45:47.506899+0000","last_became_active":"2024-05-30T06:45:46.526505+0000","last_became_peered":"2024-05-30T06:45:46.526505+0000","last_unstale":"2024-05-30T06:45:47.506899+0000","last_undegraded":"2024-05-30T06:45:47.506899+0000","last_fullsized":"2024-05-30T06:45:47.506899+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:36:22.793647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.506334+0000","last_change":"2024-05-30T06:45:45.515475+0000","last_active":"2024-05-30T06:45:47.506334+0000","last_peered":"2024-05-30T06:45:47.506334+0000","last_clean":"2024-05-30T06:45:47.506334+0000","last_became_active":"2024-05-30T06:45:45.515218+0000","last_became_peered":"2024-05-30T06:45:45.515218+0000","last_unstale":"2024-05-30T06:45:47.506334+0000","last_undegraded":"2024-05-30T06:45:47.506334+0000","last_fullsized":"2024-05-30T06:45:47.506334+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:41:34.764336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.419739+0000","last_change":"2024-05-30T06:45:46.513214+0000","last_active":"2024-05-30T06:45:48.419739+0000","last_peered":"2024-05-30T06:45:48.419739+0000","last_clean":"2024-05-30T06:45:48.419739+0000","last_became_active":"2024-05-30T06:45:46.512935+0000","last_became_peered":"2024-05-30T06:45:46.512935+0000","last_unstale":"2024-05-30T06:45:48.419739+0000","last_undegraded":"2024-05-30T06:45:48.419739+0000","last_fullsized":"2024-05-30T06:45:48.419739+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:10:18.096100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.420858+0000","last_change":"2024-05-30T06:45:45.513712+0000","last_active":"2024-05-30T06:45:48.420858+0000","last_peered":"2024-05-30T06:45:48.420858+0000","last_clean":"2024-05-30T06:45:48.420858+0000","last_became_active":"2024-05-30T06:45:45.513190+0000","last_became_peered":"2024-05-30T06:45:45.513190+0000","last_unstale":"2024-05-30T06:45:48.420858+0000","last_undegraded":"2024-05-30T06:45:48.420858+0000","last_fullsized":"2024-05-30T06:45:48.420858+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:39:44.574043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:48.421792+0000","last_change":"2024-05-30T06:45:46.525511+0000","last_active":"2024-05-30T06:45:48.421792+0000","last_peered":"2024-05-30T06:45:48.421792+0000","last_clean":"2024-05-30T06:45:48.421792+0000","last_became_active":"2024-05-30T06:45:46.524983+0000","last_became_peered":"2024-05-30T06:45:46.524983+0000","last_unstale":"2024-05-30T06:45:48.421792+0000","last_undegraded":"2024-05-30T06:45:48.421792+0000","last_fullsized":"2024-05-30T06:45:48.421792+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:45.491273+0000","last_clean_scrub_stamp":"2024-05-30T06:45:45.491273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:05:40.437558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.507245+0000","last_change":"2024-05-30T06:45:45.518716+0000","last_active":"2024-05-30T06:45:47.507245+0000","last_peered":"2024-05-30T06:45:47.507245+0000","last_clean":"2024-05-30T06:45:47.507245+0000","last_became_active":"2024-05-30T06:45:45.518092+0000","last_became_peered":"2024-05-30T06:45:45.518092+0000","last_unstale":"2024-05-30T06:45:47.507245+0000","last_undegraded":"2024-05-30T06:45:47.507245+0000","last_fullsized":"2024-05-30T06:45:47.507245+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:45:44.488156+0000","last_clean_scrub_stamp":"2024-05-30T06:45:44.488156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:14.712362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":219,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-05-30T06:45:47.922419+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:45:47.922419+0000","last_peered":"2024-05-30T06:45:47.922419+0000","last_clean":"2024-05-30T06:45:47.922419+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:45:47.922419+0000","last_undegraded":"2024-05-30T06:45:47.922419+0000","last_fullsized":"2024-05-30T06:45:47.922419+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1138688,"data_stored":812891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31708,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340132,"statfs":{"total":96636764160,"available":96604295168,"internally_reserved":0,"allocated":536576,"data_stored":216805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35880,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":544768,"data_stored":222503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35880,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":552960,"data_stored":224045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35884,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335956,"statfs":{"total":96636764160,"available":96600018944,"internally_reserved":0,"allocated":552960,"data_stored":223071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":557056,"data_stored":224067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35876,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335964,"statfs":{"total":96636764160,"available":96600027136,"internally_reserved":0,"allocated":544768,"data_stored":222503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36444,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335396,"statfs":{"total":96636764160,"available":96599445504,"internally_reserved":0,"allocated":1126400,"data_stored":806535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:45:51.129 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-30T06:45:51.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T06:45:51.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.317+0000 7fa20ec00640 1 Processor -- start 2024-05-30T06:45:51.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa20ec00640 1 -- start start 2024-05-30T06:45:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa20ec00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa2080b59d0 0x7fa2080b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa20ec00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa20815d350 0x7fa208160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa20ec00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20815d7e0 0x7fa2081607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa20ec00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa2080b62f0 con 0x7fa20815d350 2024-05-30T06:45:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa20ec00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa208142030 con 0x7fa2080b59d0 2024-05-30T06:45:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa20ec00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa208142310 con 0x7fa20815d7e0 2024-05-30T06:45:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa1ff400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa20815d350 0x7fa208160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa1ff400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa20815d350 0x7fa208160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48248/0 (socket says 172.21.15.37:48248) 2024-05-30T06:45:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa1ff400640 1 -- 172.21.15.37:0/1320648818 learned_addr learned my addr 172.21.15.37:0/1320648818 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa207e00640 1 --2- 172.21.15.37:0/1320648818 >> v2:172.21.15.105:3300/0 conn(0x7fa2080b59d0 0x7fa2080b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa20cc00640 1 --2- 172.21.15.37:0/1320648818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20815d7e0 0x7fa2081607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa1ff400640 1 -- 172.21.15.37:0/1320648818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20815d7e0 msgr2=0x7fa2081607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa1ff400640 1 --2- 172.21.15.37:0/1320648818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20815d7e0 0x7fa2081607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa1ff400640 1 -- 172.21.15.37:0/1320648818 >> v2:172.21.15.105:3300/0 conn(0x7fa2080b59d0 msgr2=0x7fa2080b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa1ff400640 1 --2- 172.21.15.37:0/1320648818 >> v2:172.21.15.105:3300/0 conn(0x7fa2080b59d0 0x7fa2080b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa1ff400640 1 -- 172.21.15.37:0/1320648818 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2081425f0 con 0x7fa20815d350 2024-05-30T06:45:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.321+0000 7fa207e00640 1 --2- 172.21.15.37:0/1320648818 >> v2:172.21.15.105:3300/0 conn(0x7fa2080b59d0 0x7fa2080b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:51.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa1ff400640 1 --2- 172.21.15.37:0/1320648818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20815d350 0x7fa208160280 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009870 tx=0x7fa1f001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e158757d67b4a66a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:51.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa207400640 1 -- 172.21.15.37:0/1320648818 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00b5070 con 0x7fa20815d350 2024-05-30T06:45:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa207400640 1 -- 172.21.15.37:0/1320648818 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f00a89d0 con 0x7fa20815d350 2024-05-30T06:45:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa207400640 1 -- 172.21.15.37:0/1320648818 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f00a8da0 con 0x7fa20815d350 2024-05-30T06:45:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa20ec00640 1 -- 172.21.15.37:0/1320648818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20815d350 msgr2=0x7fa208160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:51.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa20ec00640 1 --2- 172.21.15.37:0/1320648818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20815d350 0x7fa208160280 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009870 tx=0x7fa1f001ed10 comp rx=0 tx=0).stop 2024-05-30T06:45:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa20ec00640 1 -- 172.21.15.37:0/1320648818 shutdown_connections 2024-05-30T06:45:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa20ec00640 1 --2- 172.21.15.37:0/1320648818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20815d7e0 0x7fa2081607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa20ec00640 1 --2- 172.21.15.37:0/1320648818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20815d350 0x7fa208160280 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa20ec00640 1 --2- 172.21.15.37:0/1320648818 >> v2:172.21.15.105:3300/0 conn(0x7fa2080b59d0 0x7fa2080b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa20ec00640 1 -- 172.21.15.37:0/1320648818 >> 172.21.15.37:0/1320648818 conn(0x7fa20806bf60 msgr2=0x7fa2080b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa20ec00640 1 -- 172.21.15.37:0/1320648818 shutdown_connections 2024-05-30T06:45:51.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa20ec00640 1 -- 172.21.15.37:0/1320648818 wait complete. 2024-05-30T06:45:51.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa20ec00640 1 Processor -- start 2024-05-30T06:45:51.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.325+0000 7fa20ec00640 1 -- start start 2024-05-30T06:45:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa20ec00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080b59d0 0x7fa2081373a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa20ec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20815d350 0x7fa2080b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa20ec00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20815d7e0 0x7fa208153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa20ec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa20813fe60 con 0x7fa20815d350 2024-05-30T06:45:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa20ec00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa20813fce0 con 0x7fa20815d7e0 2024-05-30T06:45:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa20ec00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa2080aff20 con 0x7fa2080b59d0 2024-05-30T06:45:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa1ff400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20815d350 0x7fa2080b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa1ff400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20815d350 0x7fa2080b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48252/0 (socket says 172.21.15.37:48252) 2024-05-30T06:45:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa1ff400640 1 -- 172.21.15.37:0/1832562026 learned_addr learned my addr 172.21.15.37:0/1832562026 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa207e00640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080b59d0 0x7fa2081373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa20cc00640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20815d7e0 0x7fa208153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa207e00640 1 -- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20815d7e0 msgr2=0x7fa208153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:51.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa207e00640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20815d7e0 0x7fa208153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa207e00640 1 -- 172.21.15.37:0/1832562026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20815d350 msgr2=0x7fa2080b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:51.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa207e00640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20815d350 0x7fa2080b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa207e00640 1 -- 172.21.15.37:0/1832562026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa208155090 con 0x7fa2080b59d0 2024-05-30T06:45:51.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa1ff400640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20815d350 0x7fa2080b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:51.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa207e00640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080b59d0 0x7fa2081373a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80093f0 tx=0x7fa1f800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:51.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa204c00640 1 -- 172.21.15.37:0/1832562026 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8004030 con 0x7fa2080b59d0 2024-05-30T06:45:51.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa204c00640 1 -- 172.21.15.37:0/1832562026 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f80041d0 con 0x7fa2080b59d0 2024-05-30T06:45:51.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa204c00640 1 -- 172.21.15.37:0/1832562026 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f800c940 con 0x7fa2080b59d0 2024-05-30T06:45:51.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa20ec00640 1 -- 172.21.15.37:0/1832562026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa208155370 con 0x7fa2080b59d0 2024-05-30T06:45:51.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa20ec00640 1 -- 172.21.15.37:0/1832562026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa208134880 con 0x7fa2080b59d0 2024-05-30T06:45:51.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.329+0000 7fa20ec00640 1 -- 172.21.15.37:0/1832562026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa208068bc0 con 0x7fa2080b59d0 2024-05-30T06:45:51.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.333+0000 7fa204c00640 1 -- 172.21.15.37:0/1832562026 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7fa1f800cae0 con 0x7fa2080b59d0 2024-05-30T06:45:51.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.333+0000 7fa204c00640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1e4068710 0x7fa1e406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.333+0000 7fa204c00640 1 -- 172.21.15.37:0/1832562026 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fa1f8087470 con 0x7fa2080b59d0 2024-05-30T06:45:51.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.333+0000 7fa1ff400640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1e4068710 0x7fa1e406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.333+0000 7fa1ff400640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1e4068710 0x7fa1e406abd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa1f001d3c0 tx=0x7fa1f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:51.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.337+0000 7fa204c00640 1 -- 172.21.15.37:0/1832562026 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa1f8017020 con 0x7fa2080b59d0 2024-05-30T06:45:51.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.569+0000 7fa20ec00640 1 -- 172.21.15.37:0/1832562026 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fa20815e060 con 0x7fa2080b59d0 2024-05-30T06:45:51.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.573+0000 7fa204c00640 1 -- 172.21.15.37:0/1832562026 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7fa1f80570d0 con 0x7fa2080b59d0 2024-05-30T06:45:51.574 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-30T06:45:51.574 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A== 2024-05-30T06:45:51.574 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-30T06:45:51.574 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-30T06:45:51.574 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T06:45:51.574 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-30T06:45:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.573+0000 7fa20ec00640 1 -- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1e4068710 msgr2=0x7fa1e406abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.573+0000 7fa20ec00640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1e4068710 0x7fa1e406abd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa1f001d3c0 tx=0x7fa1f0009040 comp rx=0 tx=0).stop 2024-05-30T06:45:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.573+0000 7fa20ec00640 1 -- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080b59d0 msgr2=0x7fa2081373a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.573+0000 7fa20ec00640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080b59d0 0x7fa2081373a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80093f0 tx=0x7fa1f800ed60 comp rx=0 tx=0).stop 2024-05-30T06:45:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.573+0000 7fa20ec00640 1 -- 172.21.15.37:0/1832562026 shutdown_connections 2024-05-30T06:45:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.573+0000 7fa20ec00640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1e4068710 0x7fa1e406abd0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.573+0000 7fa20ec00640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20815d7e0 0x7fa208153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.573+0000 7fa20ec00640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20815d350 0x7fa2080b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.573+0000 7fa20ec00640 1 --2- 172.21.15.37:0/1832562026 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080b59d0 0x7fa2081373a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.573+0000 7fa20ec00640 1 -- 172.21.15.37:0/1832562026 >> 172.21.15.37:0/1832562026 conn(0x7fa20806bf60 msgr2=0x7fa2080ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:51.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.573+0000 7fa20ec00640 1 -- 172.21.15.37:0/1832562026 shutdown_connections 2024-05-30T06:45:51.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.573+0000 7fa20ec00640 1 -- 172.21.15.37:0/1832562026 wait complete. 2024-05-30T06:45:51.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:45:51.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f811e000640 1 Processor -- start 2024-05-30T06:45:51.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f811e000640 1 -- start start 2024-05-30T06:45:51.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f811e000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f81181482d0 0x7f81180b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f811e000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81180af690 0x7f811815ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f811e000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f811815eed0 0x7f811815f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f811e000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f811806e860 con 0x7f811815eed0 2024-05-30T06:45:51.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f811e000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8118160440 con 0x7f81181482d0 2024-05-30T06:45:51.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f811e000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f811815f8a0 con 0x7f81180af690 2024-05-30T06:45:51.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f8117e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f811815eed0 0x7f811815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f8117e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f811815eed0 0x7f811815f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48258/0 (socket says 172.21.15.37:48258) 2024-05-30T06:45:51.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f8117e00640 1 -- 172.21.15.37:0/2009498208 learned_addr learned my addr 172.21.15.37:0/2009498208 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:51.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f8117400640 1 --2- 172.21.15.37:0/2009498208 >> v2:172.21.15.105:3300/0 conn(0x7f81181482d0 0x7f81180b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f810ea00640 1 --2- 172.21.15.37:0/2009498208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81180af690 0x7f811815ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f8117e00640 1 -- 172.21.15.37:0/2009498208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81180af690 msgr2=0x7f811815ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:51.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f8117e00640 1 --2- 172.21.15.37:0/2009498208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81180af690 0x7f811815ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f8117e00640 1 -- 172.21.15.37:0/2009498208 >> v2:172.21.15.105:3300/0 conn(0x7f81181482d0 msgr2=0x7f81180b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:51.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f8117e00640 1 --2- 172.21.15.37:0/2009498208 >> v2:172.21.15.105:3300/0 conn(0x7f81181482d0 0x7f81180b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.737+0000 7f8117e00640 1 -- 172.21.15.37:0/2009498208 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81180afe30 con 0x7f811815eed0 2024-05-30T06:45:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.741+0000 7f8117e00640 1 --2- 172.21.15.37:0/2009498208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f811815eed0 0x7f811815f360 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f81180b01e0 tx=0x7f811001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac88c6ec5d574408 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.741+0000 7f8116a00640 1 -- 172.21.15.37:0/2009498208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81100a56d0 con 0x7f811815eed0 2024-05-30T06:45:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.741+0000 7f8116a00640 1 -- 172.21.15.37:0/2009498208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81100a5870 con 0x7f811815eed0 2024-05-30T06:45:51.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.741+0000 7f8116a00640 1 -- 172.21.15.37:0/2009498208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81100a5c40 con 0x7f811815eed0 2024-05-30T06:45:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.741+0000 7f811e000640 1 -- 172.21.15.37:0/2009498208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f811815eed0 msgr2=0x7f811815f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.741+0000 7f811e000640 1 --2- 172.21.15.37:0/2009498208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f811815eed0 0x7f811815f360 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f81180b01e0 tx=0x7f811001c960 comp rx=0 tx=0).stop 2024-05-30T06:45:51.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.741+0000 7f811e000640 1 -- 172.21.15.37:0/2009498208 shutdown_connections 2024-05-30T06:45:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.741+0000 7f811e000640 1 --2- 172.21.15.37:0/2009498208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f811815eed0 0x7f811815f360 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.741+0000 7f811e000640 1 --2- 172.21.15.37:0/2009498208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81180af690 0x7f811815ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.741+0000 7f811e000640 1 --2- 172.21.15.37:0/2009498208 >> v2:172.21.15.105:3300/0 conn(0x7f81181482d0 0x7f81180b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.741+0000 7f811e000640 1 -- 172.21.15.37:0/2009498208 >> 172.21.15.37:0/2009498208 conn(0x7f81180b23a0 msgr2=0x7f81180b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.741+0000 7f811e000640 1 -- 172.21.15.37:0/2009498208 shutdown_connections 2024-05-30T06:45:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.741+0000 7f811e000640 1 -- 172.21.15.37:0/2009498208 wait complete. 2024-05-30T06:45:51.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f811e000640 1 Processor -- start 2024-05-30T06:45:51.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f811e000640 1 -- start start 2024-05-30T06:45:51.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f811e000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81180af690 0x7f811815e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f811e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81181482d0 0x7f81180b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f811e000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f811815eed0 0x7f81180b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f811e000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f811806f660 con 0x7f81181482d0 2024-05-30T06:45:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f811e000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f811806f4e0 con 0x7f81180af690 2024-05-30T06:45:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f811e000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f811806f7e0 con 0x7f811815eed0 2024-05-30T06:45:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f810ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81181482d0 0x7f81180b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f810ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81181482d0 0x7f81180b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48268/0 (socket says 172.21.15.37:48268) 2024-05-30T06:45:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f810ea00640 1 -- 172.21.15.37:0/3376063487 learned_addr learned my addr 172.21.15.37:0/3376063487 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f8117400640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81180af690 0x7f811815e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f8117e00640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f811815eed0 0x7f81180b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f810ea00640 1 -- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f811815eed0 msgr2=0x7f81180b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f810ea00640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f811815eed0 0x7f81180b3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f810ea00640 1 -- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81180af690 msgr2=0x7f811815e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f810ea00640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81180af690 0x7f811815e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f810ea00640 1 -- 172.21.15.37:0/3376063487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8118141930 con 0x7f81181482d0 2024-05-30T06:45:51.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f810ea00640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81181482d0 0x7f81180b4bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f810000e930 tx=0x7f810000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f810fe00640 1 -- 172.21.15.37:0/3376063487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8100017070 con 0x7f81181482d0 2024-05-30T06:45:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f810fe00640 1 -- 172.21.15.37:0/3376063487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f810000ca00 con 0x7f81181482d0 2024-05-30T06:45:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f810fe00640 1 -- 172.21.15.37:0/3376063487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810000cdb0 con 0x7f81181482d0 2024-05-30T06:45:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f811e000640 1 -- 172.21.15.37:0/3376063487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811813a4f0 con 0x7f81181482d0 2024-05-30T06:45:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.745+0000 7f811e000640 1 -- 172.21.15.37:0/3376063487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811813aab0 con 0x7f81181482d0 2024-05-30T06:45:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.749+0000 7f811e000640 1 -- 172.21.15.37:0/3376063487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8118068b20 con 0x7f81181482d0 2024-05-30T06:45:51.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.749+0000 7f810fe00640 1 -- 172.21.15.37:0/3376063487 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f810001a070 con 0x7f81181482d0 2024-05-30T06:45:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.749+0000 7f810fe00640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80f40686e0 0x7f80f406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.749+0000 7f810fe00640 1 -- 172.21.15.37:0/3376063487 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f8100086f30 con 0x7f81181482d0 2024-05-30T06:45:51.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.749+0000 7f8117400640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80f40686e0 0x7f80f406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:51.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.749+0000 7f8117400640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80f40686e0 0x7f80f406aba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8108009ae0 tx=0x7f8108009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:51.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.753+0000 7f810fe00640 1 -- 172.21.15.37:0/3376063487 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8100056ad0 con 0x7f81181482d0 2024-05-30T06:45:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f811e000640 1 -- 172.21.15.37:0/3376063487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8118072fb0 con 0x7f81181482d0 2024-05-30T06:45:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f810fe00640 1 -- 172.21.15.37:0/3376063487 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5184 (secure 0 0 0) 0x7f810005add0 con 0x7f81181482d0 2024-05-30T06:45:51.953 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:45:51.953 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/2692603987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2692603987},{"type":"v1","addr":"172.21.15.105:6836","nonce":2692603987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5539,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2559528007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2559528007},{"type":"v1","addr":"172.21.15.105:6837","nonce":2559528007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2198221961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2198221961},{"type":"v1","addr":"172.21.15.37:6833","nonce":2198221961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:45:45.908180+0000","modified":"2024-05-30T06:45:48.930208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5652":{"gid":5652,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/115371806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":115371806},{"type":"v1","addr":"172.21.15.37:6835","nonce":115371806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5652,"qdb_cluster":[5652]},"id":3}]} 2024-05-30T06:45:51.954 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 27 2024-05-30T06:45:51.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f811e000640 1 -- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80f40686e0 msgr2=0x7f80f406aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:51.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f811e000640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80f40686e0 0x7f80f406aba0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8108009ae0 tx=0x7f8108009190 comp rx=0 tx=0).stop 2024-05-30T06:45:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f811e000640 1 -- 172.21.15.37:0/3376063487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81181482d0 msgr2=0x7f81180b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f811e000640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81181482d0 0x7f81180b4bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f810000e930 tx=0x7f810000edf0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f811e000640 1 -- 172.21.15.37:0/3376063487 shutdown_connections 2024-05-30T06:45:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f811e000640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f811815eed0 0x7f81180b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f811e000640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81181482d0 0x7f81180b4bf0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f811e000640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80f40686e0 0x7f80f406aba0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f811e000640 1 --2- 172.21.15.37:0/3376063487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81180af690 0x7f811815e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f811e000640 1 -- 172.21.15.37:0/3376063487 >> 172.21.15.37:0/3376063487 conn(0x7f81180b23a0 msgr2=0x7f81180b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f811e000640 1 -- 172.21.15.37:0/3376063487 shutdown_connections 2024-05-30T06:45:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:51.953+0000 7f811e000640 1 -- 172.21.15.37:0/3376063487 wait complete. 2024-05-30T06:45:52.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T06:45:45.908180+0000', 'modified': '2024-05-30T06:45:48.930208+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5652}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5652': {'gid': 5652, 'name': 'c', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/115371806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 115371806}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 115371806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5652, 'qdb_cluster': [5652]} 2024-05-30T06:45:52.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T06:45:52.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-30T06:45:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7899e00640 1 Processor -- start 2024-05-30T06:45:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7899e00640 1 -- start start 2024-05-30T06:45:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7899e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f789415ead0 0x7f78940d1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7899e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f789409ab00 con 0x7f789406db90 2024-05-30T06:45:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7899e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f789409ade0 con 0x7f789409bba0 2024-05-30T06:45:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7899e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f789409b0c0 con 0x7f789415ead0 2024-05-30T06:45:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7893400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f789406db90 0x7f78940ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57314/0 (socket says 172.21.15.37:57314) 2024-05-30T06:45:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7893400640 1 -- 172.21.15.37:0/1425155425 learned_addr learned my addr 172.21.15.37:0/1425155425 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7892a00640 1 --2- 172.21.15.37:0/1425155425 >> v2:172.21.15.105:3300/0 conn(0x7f789415ead0 0x7f78940d1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7892000640 1 -- 172.21.15.37:0/1425155425 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268271695 0 0) 0x7f789409ab00 con 0x7f789406db90 2024-05-30T06:45:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7892000640 1 -- 172.21.15.37:0/1425155425 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7878003530 con 0x7f789406db90 2024-05-30T06:45:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7892000640 1 -- 172.21.15.37:0/1425155425 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1006473441 0 0) 0x7f7878003530 con 0x7f789406db90 2024-05-30T06:45:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7892a00640 1 -- 172.21.15.37:0/1425155425 >> v1:172.21.15.105:6789/0 conn(0x7f789409bba0 legacy=0x7f789406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7892a00640 1 -- 172.21.15.37:0/1425155425 >> v1:172.21.15.37:6789/0 conn(0x7f789406db90 legacy=0x7f78940ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.521+0000 7f7892a00640 1 -- 172.21.15.37:0/1425155425 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f789409b3a0 con 0x7f789415ead0 2024-05-30T06:45:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.525+0000 7f7892a00640 1 --2- 172.21.15.37:0/1425155425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f789415ead0 0x7f78940d1240 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f78840097c0 tx=0x7f78940cdb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c6693d4934dcde4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.525+0000 7f7892000640 1 -- 172.21.15.37:0/1425155425 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78840b0070 con 0x7f789415ead0 2024-05-30T06:45:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.525+0000 7f7892000640 1 -- 172.21.15.37:0/1425155425 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78840ab400 con 0x7f789415ead0 2024-05-30T06:45:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.525+0000 7f7892000640 1 -- 172.21.15.37:0/1425155425 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788c001a00 con 0x7f789415ead0 2024-05-30T06:45:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.525+0000 7f7899e00640 1 -- 172.21.15.37:0/1425155425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f789415ead0 msgr2=0x7f78940d1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.525+0000 7f7899e00640 1 --2- 172.21.15.37:0/1425155425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f789415ead0 0x7f78940d1240 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f78840097c0 tx=0x7f78940cdb80 comp rx=0 tx=0).stop 2024-05-30T06:45:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.525+0000 7f7899e00640 1 -- 172.21.15.37:0/1425155425 shutdown_connections 2024-05-30T06:45:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.525+0000 7f7899e00640 1 --2- 172.21.15.37:0/1425155425 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f789415ead0 0x7f78940d1240 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.525+0000 7f7899e00640 1 -- 172.21.15.37:0/1425155425 >> 172.21.15.37:0/1425155425 conn(0x7f78940b4100 msgr2=0x7f78940b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.525+0000 7f7899e00640 1 -- 172.21.15.37:0/1425155425 shutdown_connections 2024-05-30T06:45:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.525+0000 7f7899e00640 1 -- 172.21.15.37:0/1425155425 wait complete. 2024-05-30T06:45:52.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f7899e00640 1 Processor -- start 2024-05-30T06:45:52.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f7899e00640 1 -- start start 2024-05-30T06:45:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f7899e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f789406db90 0x7f78940b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f7899e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f789409bba0 0x7f7894155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f7899e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f789415ead0 0x7f78940ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f7899e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f789416cbb0 con 0x7f789409bba0 2024-05-30T06:45:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f7899e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f789416ca30 con 0x7f789415ead0 2024-05-30T06:45:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f7899e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f789416cd30 con 0x7f789406db90 2024-05-30T06:45:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f788be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f789409bba0 0x7f7894155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f788be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f789409bba0 0x7f7894155080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48282/0 (socket says 172.21.15.37:48282) 2024-05-30T06:45:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f788be00640 1 -- 172.21.15.37:0/1136171949 learned_addr learned my addr 172.21.15.37:0/1136171949 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f7892a00640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f789406db90 0x7f78940b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f7893400640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f789415ead0 0x7f78940ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f788be00640 1 -- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f789406db90 msgr2=0x7f78940b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f788be00640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f789406db90 0x7f78940b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f788be00640 1 -- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f789415ead0 msgr2=0x7f78940ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f788be00640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f789415ead0 0x7f78940ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f788be00640 1 -- 172.21.15.37:0/1136171949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78940cc630 con 0x7f789409bba0 2024-05-30T06:45:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.529+0000 7f788be00640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f789409bba0 0x7f7894155080 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c500 tx=0x7f787c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.533+0000 7f788b400640 1 -- 172.21.15.37:0/1136171949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c016020 con 0x7f789409bba0 2024-05-30T06:45:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.533+0000 7f788b400640 1 -- 172.21.15.37:0/1136171949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787c005220 con 0x7f789409bba0 2024-05-30T06:45:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.533+0000 7f788b400640 1 -- 172.21.15.37:0/1136171949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c007030 con 0x7f789409bba0 2024-05-30T06:45:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.533+0000 7f7899e00640 1 -- 172.21.15.37:0/1136171949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78940cb710 con 0x7f789409bba0 2024-05-30T06:45:52.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.533+0000 7f7899e00640 1 -- 172.21.15.37:0/1136171949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7894155b80 con 0x7f789409bba0 2024-05-30T06:45:52.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.533+0000 7f788b400640 1 -- 172.21.15.37:0/1136171949 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f787c0071d0 con 0x7f789409bba0 2024-05-30T06:45:52.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.533+0000 7f788b400640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f78700686e0 0x7f787006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f788b400640 1 -- 172.21.15.37:0/1136171949 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f787c086840 con 0x7f789409bba0 2024-05-30T06:45:52.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7892a00640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f78700686e0 0x7f787006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 Processor -- start 2024-05-30T06:45:52.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 -- start start 2024-05-30T06:45:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7892a00640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f78700686e0 0x7f787006aba0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f78840ad000 tx=0x7f7884004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bd120 0x559fa22bd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa22bda40 0x559fa2270110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 0x559fa2270a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559fa20c1420 con 0x559fa2270650 2024-05-30T06:45:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559fa205bbf0 con 0x559fa22bd120 2024-05-30T06:45:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x559fa20bd3e0 con 0x559fa22bda40 2024-05-30T06:45:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7893400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 0x559fa2270a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7892a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bd120 0x559fa22bd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7893400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 0x559fa2270a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48296/0 (socket says 172.21.15.37:48296) 2024-05-30T06:45:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7893400640 1 -- 172.21.15.37:0/2424882265 learned_addr learned my addr 172.21.15.37:0/2424882265 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7892a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bd120 0x559fa22bd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:42996/0 (socket says 172.21.15.37:42996) 2024-05-30T06:45:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f788be00640 1 --2- 172.21.15.37:0/2424882265 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa22bda40 0x559fa2270110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7893400640 1 -- 172.21.15.37:0/2424882265 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa22bda40 msgr2=0x559fa2270110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7893400640 1 --2- 172.21.15.37:0/2424882265 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa22bda40 0x559fa2270110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7893400640 1 -- 172.21.15.37:0/2424882265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bd120 msgr2=0x559fa22bd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:52.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7893400640 1 --2- 172.21.15.37:0/2424882265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bd120 0x559fa22bd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7893400640 1 -- 172.21.15.37:0/2424882265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa2169450 con 0x559fa2270650 2024-05-30T06:45:52.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7893400640 1 --2- 172.21.15.37:0/2424882265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 0x559fa2270a30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f788c00f4f0 tx=0x7f788c00f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2089bbac62d9e864 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:52.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7883e00640 1 -- 172.21.15.37:0/2424882265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788c0072e0 con 0x559fa2270650 2024-05-30T06:45:52.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7883e00640 1 -- 172.21.15.37:0/2424882265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788c018070 con 0x559fa2270650 2024-05-30T06:45:52.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f7883e00640 1 -- 172.21.15.37:0/2424882265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f788c007700 con 0x559fa2270650 2024-05-30T06:45:52.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 -- 172.21.15.37:0/2424882265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 msgr2=0x559fa2270a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 --2- 172.21.15.37:0/2424882265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 0x559fa2270a30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f788c00f4f0 tx=0x7f788c00f9b0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 -- 172.21.15.37:0/2424882265 shutdown_connections 2024-05-30T06:45:52.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 --2- 172.21.15.37:0/2424882265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 0x559fa2270a30 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 --2- 172.21.15.37:0/2424882265 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa22bda40 0x559fa2270110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 --2- 172.21.15.37:0/2424882265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bd120 0x559fa22bd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 -- 172.21.15.37:0/2424882265 >> 172.21.15.37:0/2424882265 conn(0x559fa229dec0 msgr2=0x559fa22a02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:52.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 -- 172.21.15.37:0/2424882265 shutdown_connections 2024-05-30T06:45:52.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.537+0000 7f789d2b2000 1 -- 172.21.15.37:0/2424882265 wait complete. 2024-05-30T06:45:52.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 1 -- start start 2024-05-30T06:45:52.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 1 Processor -- start 2024-05-30T06:45:52.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa2270650 0x559fa2275b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 0x559fa2276040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa2276580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559fa2061ec0 con 0x559fa22bd120 2024-05-30T06:45:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559fa2142120 con 0x559fa22bda40 2024-05-30T06:45:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x559fa20cc350 con 0x559fa2270650 2024-05-30T06:45:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 10 client.0 _ll_register_callbacks cb 0x559fa209e4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:45:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f788be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 0x559fa2276040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f788be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 0x559fa2276040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48308/0 (socket says 172.21.15.37:48308) 2024-05-30T06:45:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f788be00640 1 -- 172.21.15.37:0/3003211428 learned_addr learned my addr 172.21.15.37:0/3003211428 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f7892a00640 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa2270650 0x559fa2275b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f7893400640 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa2276580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f788be00640 1 -- 172.21.15.37:0/3003211428 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa2270650 msgr2=0x559fa2275b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f788be00640 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa2270650 0x559fa2275b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f788be00640 1 -- 172.21.15.37:0/3003211428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 msgr2=0x559fa2276580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f788be00640 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa2276580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f788be00640 1 -- 172.21.15.37:0/3003211428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fa2106f80 con 0x559fa22bd120 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f7893400640 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa2276580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f788be00640 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 0x559fa2276040 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c4d0 tx=0x7f787c007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103b8e332afdd4f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f7880c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f7880c00640 1 -- 172.21.15.37:0/3003211428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c073060 con 0x559fa22bd120 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f7880c00640 1 -- 172.21.15.37:0/3003211428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f787c055980 con 0x559fa22bd120 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 1 -- 172.21.15.37:0/3003211428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f788c018070 con 0x559fa22bd120 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f7880c00640 1 -- 172.21.15.37:0/3003211428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f787c084050 con 0x559fa22bd120 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 10 client.5769 fetch_fsmap learned FSMap version 27 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 1 -- 172.21.15.37:0/3003211428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x559fa209af00 con 0x559fa22bd120 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f7880c00640 1 -- 172.21.15.37:0/3003211428 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f788c018070 con 0x559fa22bd120 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f7880c00640 1 -- 172.21.15.37:0/3003211428 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7f787c05a0b0 con 0x559fa22bd120 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 10 client.5769 fetch_fsmap finished waiting for FSMap version 27 2024-05-30T06:45:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 10 client.5769 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T06:45:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 20 client.5769 populate_metadata read hostname 'smithi037' 2024-05-30T06:45:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.37:6834/115371806,v1:172.21.15.37:6835/115371806] conn(0x559fa22cc3c0 0x559fa22ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 4 client.5769 mds_command: new command op to 5652 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T06:45:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f789d2b2000 1 -- 172.21.15.37:0/3003211428 --> [v2:172.21.15.37:6834/115371806,v1:172.21.15.37:6835/115371806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fa205abc0 con 0x559fa22cc3c0 2024-05-30T06:45:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f7892a00640 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.37:6834/115371806,v1:172.21.15.37:6835/115371806] conn(0x559fa22cc3c0 0x559fa22ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f7892a00640 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.37:6834/115371806,v1:172.21.15.37:6835/115371806] conn(0x559fa22cc3c0 0x559fa22ce7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b94a67cfa2a43d61 server_cookie=2c636001aedb35c3 in_seq=0 out_seq=0 2024-05-30T06:45:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.541+0000 7f7880c00640 10 client.5769 ms_handle_connect on v2:172.21.15.37:6834/115371806 2024-05-30T06:45:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f7880c00640 1 -- 172.21.15.37:0/3003211428 <== mds.0 v2:172.21.15.37:6834/115371806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559fa205abc0 con 0x559fa22cc3c0 2024-05-30T06:45:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f7880c00640 10 client.5769 handle_command_reply: tid=0 2024-05-30T06:45:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f789d2b2000 1 client.5769 shutdown 2024-05-30T06:45:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f789d2b2000 1 -- 172.21.15.37:0/3003211428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 msgr2=0x559fa2276040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f789d2b2000 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 0x559fa2276040 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c4d0 tx=0x7f787c007600 comp rx=0 tx=0).stop 2024-05-30T06:45:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f789d2b2000 1 -- 172.21.15.37:0/3003211428 shutdown_connections 2024-05-30T06:45:52.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f789d2b2000 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.37:6834/115371806,v1:172.21.15.37:6835/115371806] conn(0x559fa22cc3c0 0x559fa22ce7b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f789d2b2000 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa2276580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f789d2b2000 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 0x559fa2276040 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f789d2b2000 1 --2- 172.21.15.37:0/3003211428 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa2270650 0x559fa2275b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f7880c00640 0 client.5769 ms_handle_reset on v2:172.21.15.37:6834/115371806 2024-05-30T06:45:52.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f789d2b2000 1 -- 172.21.15.37:0/3003211428 >> 172.21.15.37:0/3003211428 conn(0x559fa229dec0 msgr2=0x559fa22a02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:52.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f789d2b2000 1 -- 172.21.15.37:0/3003211428 shutdown_connections 2024-05-30T06:45:52.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f789d2b2000 1 -- 172.21.15.37:0/3003211428 wait complete. 2024-05-30T06:45:52.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.545+0000 7f789d2b2000 20 client.5769 trim_cache size 0 max 16384 2024-05-30T06:45:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f789d2b2000 1 Processor -- start 2024-05-30T06:45:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f789d2b2000 1 -- start start 2024-05-30T06:45:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f789d2b2000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 0x559fa226f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f789d2b2000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa22bd120 0x559fa226fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f789d2b2000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa22ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f789d2b2000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7894203190 con 0x559fa2270650 2024-05-30T06:45:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f789d2b2000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f78940b0120 con 0x559fa22bda40 2024-05-30T06:45:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f789d2b2000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f78940b6530 con 0x559fa22bd120 2024-05-30T06:45:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f7892a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 0x559fa226f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f7892a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 0x559fa226f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48320/0 (socket says 172.21.15.37:48320) 2024-05-30T06:45:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f7892a00640 1 -- 172.21.15.37:0/2767043366 learned_addr learned my addr 172.21.15.37:0/2767043366 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f788be00640 1 --2- 172.21.15.37:0/2767043366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa22bd120 0x559fa226fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f7893400640 1 --2- 172.21.15.37:0/2767043366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa22ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f7892a00640 1 -- 172.21.15.37:0/2767043366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa22bd120 msgr2=0x559fa226fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f7892a00640 1 --2- 172.21.15.37:0/2767043366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa22bd120 0x559fa226fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f7892a00640 1 -- 172.21.15.37:0/2767043366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 msgr2=0x559fa22ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f7892a00640 1 --2- 172.21.15.37:0/2767043366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa22ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f7892a00640 1 -- 172.21.15.37:0/2767043366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fa2047e80 con 0x559fa2270650 2024-05-30T06:45:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f7892a00640 1 --2- 172.21.15.37:0/2767043366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 0x559fa226f810 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7884018fa0 tx=0x7f78840a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a615d882b01e14c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f7883400640 1 -- 172.21.15.37:0/2767043366 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78840ba040 con 0x559fa2270650 2024-05-30T06:45:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f7883400640 1 -- 172.21.15.37:0/2767043366 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78840d2070 con 0x559fa2270650 2024-05-30T06:45:52.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.565+0000 7f7883400640 1 -- 172.21.15.37:0/2767043366 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78840b0040 con 0x559fa2270650 2024-05-30T06:45:52.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 -- 172.21.15.37:0/2767043366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 msgr2=0x559fa226f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 --2- 172.21.15.37:0/2767043366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 0x559fa226f810 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7884018fa0 tx=0x7f78840a6000 comp rx=0 tx=0).stop 2024-05-30T06:45:52.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 -- 172.21.15.37:0/2767043366 shutdown_connections 2024-05-30T06:45:52.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 --2- 172.21.15.37:0/2767043366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa22ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 --2- 172.21.15.37:0/2767043366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa22bd120 0x559fa226fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 --2- 172.21.15.37:0/2767043366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa2270650 0x559fa226f810 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 -- 172.21.15.37:0/2767043366 >> 172.21.15.37:0/2767043366 conn(0x559fa229dec0 msgr2=0x559fa226f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:52.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 -- 172.21.15.37:0/2767043366 shutdown_connections 2024-05-30T06:45:52.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 -- 172.21.15.37:0/2767043366 wait complete. 2024-05-30T06:45:52.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 -- start start 2024-05-30T06:45:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 Processor -- start 2024-05-30T06:45:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa2270650 0x559fa22d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 0x559fa22e8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa22e8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559fa20c0730 con 0x559fa22bd120 2024-05-30T06:45:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559fa208d9e0 con 0x559fa22bda40 2024-05-30T06:45:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x559fa20c5a50 con 0x559fa2270650 2024-05-30T06:45:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 10 client.0 _ll_register_callbacks cb 0x7f787c0011d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:45:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f788be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 0x559fa22e8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f788be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 0x559fa22e8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48336/0 (socket says 172.21.15.37:48336) 2024-05-30T06:45:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f788be00640 1 -- 172.21.15.37:0/3875825733 learned_addr learned my addr 172.21.15.37:0/3875825733 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f7892a00640 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa2270650 0x559fa22d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f7893400640 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa22e8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f788be00640 1 -- 172.21.15.37:0/3875825733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa2270650 msgr2=0x559fa22d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f788be00640 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa2270650 0x559fa22d13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f788be00640 1 -- 172.21.15.37:0/3875825733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 msgr2=0x559fa22e8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f788be00640 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa22e8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f788be00640 1 -- 172.21.15.37:0/3875825733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fa2089b30 con 0x559fa22bd120 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f7893400640 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa22e8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f788be00640 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 0x559fa22e8340 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f787c055fe0 tx=0x7f787c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46342296f8f22b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f7880c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f7880c00640 1 -- 172.21.15.37:0/3875825733 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f787c06e070 con 0x559fa22bd120 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f7880c00640 1 -- 172.21.15.37:0/3875825733 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f787c058ca0 con 0x559fa22bd120 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 -- 172.21.15.37:0/3875825733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78840d2070 con 0x559fa22bd120 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f7880c00640 1 -- 172.21.15.37:0/3875825733 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f787c058ea0 con 0x559fa22bd120 2024-05-30T06:45:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 10 client.5775 fetch_fsmap learned FSMap version 27 2024-05-30T06:45:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f789d2b2000 1 -- 172.21.15.37:0/3875825733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x559fa21425b0 con 0x559fa22bd120 2024-05-30T06:45:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f7880c00640 1 -- 172.21.15.37:0/3875825733 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78840d2070 con 0x559fa22bd120 2024-05-30T06:45:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.569+0000 7f7880c00640 1 -- 172.21.15.37:0/3875825733 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7f787c052080 con 0x559fa22bd120 2024-05-30T06:45:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 10 client.5775 fetch_fsmap finished waiting for FSMap version 27 2024-05-30T06:45:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 10 client.5775 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T06:45:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 20 client.5775 populate_metadata read hostname 'smithi037' 2024-05-30T06:45:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.37:6834/115371806,v1:172.21.15.37:6835/115371806] conn(0x559fa232bfb0 0x559fa232c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 4 client.5775 mds_command: new command op to 5652 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T06:45:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 1 -- 172.21.15.37:0/3875825733 --> [v2:172.21.15.37:6834/115371806,v1:172.21.15.37:6835/115371806] -- command(tid 0: {"prefix": "status"}) -- 0x559fa20cee40 con 0x559fa232bfb0 2024-05-30T06:45:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7892a00640 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.37:6834/115371806,v1:172.21.15.37:6835/115371806] conn(0x559fa232bfb0 0x559fa232c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7892a00640 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.37:6834/115371806,v1:172.21.15.37:6835/115371806] conn(0x559fa232bfb0 0x559fa232c390 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de59ed73ca847419 server_cookie=843d7b02afba2969 in_seq=0 out_seq=0 2024-05-30T06:45:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7880c00640 10 client.5775 ms_handle_connect on v2:172.21.15.37:6834/115371806 2024-05-30T06:45:52.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7880c00640 1 -- 172.21.15.37:0/3875825733 <== mds.0 v2:172.21.15.37:6834/115371806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x559fa20cee40 con 0x559fa232bfb0 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7880c00640 10 client.5775 handle_command_reply: tid=0 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 1 client.5775 shutdown 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 1 -- 172.21.15.37:0/3875825733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 msgr2=0x559fa22e8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 0x559fa22e8340 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f787c055fe0 tx=0x7f787c000ee0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 1 -- 172.21.15.37:0/3875825733 shutdown_connections 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.37:6834/115371806,v1:172.21.15.37:6835/115371806] conn(0x559fa232bfb0 0x559fa232c390 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x559fa22bda40 0x559fa22e8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fa22bd120 0x559fa22e8340 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 1 --2- 172.21.15.37:0/3875825733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559fa2270650 0x559fa22d13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7880c00640 0 client.5775 ms_handle_reset on v2:172.21.15.37:6834/115371806 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 1 -- 172.21.15.37:0/3875825733 >> 172.21.15.37:0/3875825733 conn(0x559fa229dec0 msgr2=0x559fa226f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 1 -- 172.21.15.37:0/3875825733 shutdown_connections 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 1 -- 172.21.15.37:0/3875825733 wait complete. 2024-05-30T06:45:52.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f789d2b2000 20 client.5775 trim_cache size 0 max 16384 2024-05-30T06:45:52.579 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:45:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:45:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-30T06:45:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5652, 2024-05-30T06:45:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-30T06:45:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-30T06:45:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-30T06:45:52.579 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 6.0761053570000003, 2024-05-30T06:45:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 27, 2024-05-30T06:45:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 48, 2024-05-30T06:45:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 46, 2024-05-30T06:45:52.580 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 10.876898884999999 2024-05-30T06:45:52.580 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:45:52.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7899e00640 1 -- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f78700686e0 msgr2=0x7f787006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7899e00640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f78700686e0 0x7f787006aba0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f78840ad000 tx=0x7f7884004740 comp rx=0 tx=0).stop 2024-05-30T06:45:52.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7899e00640 1 -- 172.21.15.37:0/1136171949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f789409bba0 msgr2=0x7f7894155080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7899e00640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f789409bba0 0x7f7894155080 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c500 tx=0x7f787c00c9c0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7899e00640 1 -- 172.21.15.37:0/1136171949 shutdown_connections 2024-05-30T06:45:52.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7899e00640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f78700686e0 0x7f787006aba0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7899e00640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f789415ead0 0x7f78940ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7899e00640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f789409bba0 0x7f7894155080 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7899e00640 1 --2- 172.21.15.37:0/1136171949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f789406db90 0x7f78940b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7899e00640 1 -- 172.21.15.37:0/1136171949 >> 172.21.15.37:0/1136171949 conn(0x7f78940b4100 msgr2=0x7f78940b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:52.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7899e00640 1 -- 172.21.15.37:0/1136171949 shutdown_connections 2024-05-30T06:45:52.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.573+0000 7f7899e00640 1 -- 172.21.15.37:0/1136171949 wait complete. 2024-05-30T06:45:52.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T06:45:52.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.733+0000 7f3b64600640 1 Processor -- start 2024-05-30T06:45:52.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.733+0000 7f3b64600640 1 -- start start 2024-05-30T06:45:52.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b64600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b5c155e60 0x7f3b5c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b64600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c06f9a0 0x7f3b5c0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b64600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3b5c0b2ec0 0x7f3b5c0cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b64600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5c0ccff0 con 0x7f3b5c155e60 2024-05-30T06:45:52.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b64600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5c0d00e0 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b64600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c15c8f0 con 0x7f3b5c06f9a0 2024-05-30T06:45:52.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b61c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b5c155e60 0x7f3b5c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b61c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b5c155e60 0x7f3b5c0b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48338/0 (socket says 172.21.15.37:48338) 2024-05-30T06:45:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b61c00640 1 -- 172.21.15.37:0/1644972672 learned_addr learned my addr 172.21.15.37:0/1644972672 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b62600640 1 --2- 172.21.15.37:0/1644972672 >> v2:172.21.15.105:3300/0 conn(0x7f3b5c0b2ec0 0x7f3b5c0cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b61200640 1 --2- 172.21.15.37:0/1644972672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c06f9a0 0x7f3b5c0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b61c00640 1 -- 172.21.15.37:0/1644972672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c06f9a0 msgr2=0x7f3b5c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b61c00640 1 --2- 172.21.15.37:0/1644972672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c06f9a0 0x7f3b5c0cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b61c00640 1 -- 172.21.15.37:0/1644972672 >> v2:172.21.15.105:3300/0 conn(0x7f3b5c0b2ec0 msgr2=0x7f3b5c0cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b61c00640 1 --2- 172.21.15.37:0/1644972672 >> v2:172.21.15.105:3300/0 conn(0x7f3b5c0b2ec0 0x7f3b5c0cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b61c00640 1 -- 172.21.15.37:0/1644972672 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c0ccc80 con 0x7f3b5c155e60 2024-05-30T06:45:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b62600640 1 --2- 172.21.15.37:0/1644972672 >> v2:172.21.15.105:3300/0 conn(0x7f3b5c0b2ec0 0x7f3b5c0cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:45:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.737+0000 7f3b61200640 1 --2- 172.21.15.37:0/1644972672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c06f9a0 0x7f3b5c0cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:45:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b61c00640 1 --2- 172.21.15.37:0/1644972672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c155e60 0x7f3b5c0b36a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c070df0 tx=0x7f3b5001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bd266fc759dd62 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b5be00640 1 -- 172.21.15.37:0/1644972672 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b500ab5f0 con 0x7f3b5c155e60 2024-05-30T06:45:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b5be00640 1 -- 172.21.15.37:0/1644972672 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b500b0070 con 0x7f3b5c155e60 2024-05-30T06:45:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b5be00640 1 -- 172.21.15.37:0/1644972672 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b500ab9b0 con 0x7f3b5c155e60 2024-05-30T06:45:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b64600640 1 -- 172.21.15.37:0/1644972672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c155e60 msgr2=0x7f3b5c0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b64600640 1 --2- 172.21.15.37:0/1644972672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c155e60 0x7f3b5c0b36a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c070df0 tx=0x7f3b5001c520 comp rx=0 tx=0).stop 2024-05-30T06:45:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b64600640 1 -- 172.21.15.37:0/1644972672 shutdown_connections 2024-05-30T06:45:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b64600640 1 --2- 172.21.15.37:0/1644972672 >> v2:172.21.15.105:3300/0 conn(0x7f3b5c0b2ec0 0x7f3b5c0cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b64600640 1 --2- 172.21.15.37:0/1644972672 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c06f9a0 0x7f3b5c0cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b64600640 1 --2- 172.21.15.37:0/1644972672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c155e60 0x7f3b5c0b36a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b64600640 1 -- 172.21.15.37:0/1644972672 >> 172.21.15.37:0/1644972672 conn(0x7f3b5c0b23a0 msgr2=0x7f3b5c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b64600640 1 -- 172.21.15.37:0/1644972672 shutdown_connections 2024-05-30T06:45:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b64600640 1 -- 172.21.15.37:0/1644972672 wait complete. 2024-05-30T06:45:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b64600640 1 Processor -- start 2024-05-30T06:45:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.741+0000 7f3b64600640 1 -- start start 2024-05-30T06:45:52.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b64600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c06f9a0 0x7f3b5c165ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b64600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c0b2ec0 0x7f3b5c074f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b64600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c155e60 0x7f3b5c151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b64600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0ce020 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b64600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0cdea0 con 0x7f3b5c155e60 2024-05-30T06:45:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b64600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c0ce1a0 con 0x7f3b5c06f9a0 2024-05-30T06:45:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b61200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c0b2ec0 0x7f3b5c074f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b61200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c0b2ec0 0x7f3b5c074f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48348/0 (socket says 172.21.15.37:48348) 2024-05-30T06:45:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b61200640 1 -- 172.21.15.37:0/2684591223 learned_addr learned my addr 172.21.15.37:0/2684591223 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b61c00640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c06f9a0 0x7f3b5c165ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b62600640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c155e60 0x7f3b5c151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b61200640 1 -- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c06f9a0 msgr2=0x7f3b5c165ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b61200640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c06f9a0 0x7f3b5c165ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b61200640 1 -- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c155e60 msgr2=0x7f3b5c151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b61200640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c155e60 0x7f3b5c151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b61200640 1 -- 172.21.15.37:0/2684591223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c1666f0 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b61200640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c0b2ec0 0x7f3b5c074f50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800c7f0 tx=0x7f3b4800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:52.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b59600640 1 -- 172.21.15.37:0/2684591223 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b48015070 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b59600640 1 -- 172.21.15.37:0/2684591223 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b48007820 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b59600640 1 -- 172.21.15.37:0/2684591223 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b48007c10 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b64600640 1 -- 172.21.15.37:0/2684591223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c15ad30 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b64600640 1 -- 172.21.15.37:0/2684591223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c15b010 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b64600640 1 -- 172.21.15.37:0/2684591223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c068b20 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.745+0000 7f3b59600640 1 -- 172.21.15.37:0/2684591223 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f3b48018070 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.749+0000 7f3b59600640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b3c0686e0 0x7f3b3c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:52.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.749+0000 7f3b59600640 1 -- 172.21.15.37:0/2684591223 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f3b48087030 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.749+0000 7f3b61c00640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b3c0686e0 0x7f3b3c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:52.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.749+0000 7f3b61c00640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b3c0686e0 0x7f3b3c06aba0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3b500af000 tx=0x7f3b500a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:52.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.753+0000 7f3b59600640 1 -- 172.21.15.37:0/2684591223 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3b48056a00 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b64600640 1 -- 172.21.15.37:0/2684591223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3b5c072fb0 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b59600640 1 -- 172.21.15.37:0/2684591223 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f3b4805ad00 con 0x7f3b5c0b2ec0 2024-05-30T06:45:52.953 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T06:45:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b64600640 1 -- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b3c0686e0 msgr2=0x7f3b3c06aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b64600640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b3c0686e0 0x7f3b3c06aba0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3b500af000 tx=0x7f3b500a7000 comp rx=0 tx=0).stop 2024-05-30T06:45:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b64600640 1 -- 172.21.15.37:0/2684591223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c0b2ec0 msgr2=0x7f3b5c074f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b64600640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c0b2ec0 0x7f3b5c074f50 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800c7f0 tx=0x7f3b4800ccb0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b64600640 1 -- 172.21.15.37:0/2684591223 shutdown_connections 2024-05-30T06:45:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b64600640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b3c0686e0 0x7f3b3c06aba0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b64600640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c155e60 0x7f3b5c151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b64600640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c0b2ec0 0x7f3b5c074f50 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b64600640 1 --2- 172.21.15.37:0/2684591223 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c06f9a0 0x7f3b5c165ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:52.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b64600640 1 -- 172.21.15.37:0/2684591223 >> 172.21.15.37:0/2684591223 conn(0x7f3b5c0b23a0 msgr2=0x7f3b5c0b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:52.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b64600640 1 -- 172.21.15.37:0/2684591223 shutdown_connections 2024-05-30T06:45:52.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:52.953+0000 7f3b64600640 1 -- 172.21.15.37:0/2684591223 wait complete. 2024-05-30T06:45:52.973 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-30T06:45:52.974 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T06:45:52.974 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-30T06:45:52.974 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T06:45:52.974 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T06:45:52.974 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-30T06:45:52.974 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-30T06:45:52.974 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T06:45:52.974 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:45:52.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:45:52.974 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-30T06:45:52.983 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:45:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:45:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:45:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:45:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-30T06:45:52.984 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:45:52.984 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:45:52.984 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:45:52.984 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-30T06:45:52.984 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T06:45:52.984 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:45:52.984 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-30T06:45:52.984 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T06:45:52.984 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42251sec preferred_lft 42251sec 2024-05-30T06:45:52.984 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-05-30T06:45:52.984 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:45:52.984 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:30:63:12:21 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:45:52.985 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T06:45:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:45:52.986 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:45:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T06:45:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T06:45:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:45:52.986 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:45:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T06:45:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T06:45:52.986 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:45:52.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:45:52.987 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T06:45:53.050 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-30T06:45:53.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:45:53.053 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-30T06:45:53.105 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-30T06:45:53.106 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T06:45:53.106 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T06:45:53.106 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T06:45:53.106 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T06:45:53.106 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T06:45:53.106 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:45:53.106 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:45:53.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T06:45:53.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T06:45:53.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T06:45:53.107 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:45:53.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:45:53.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:45:53.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:45:53.250 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T06:45:53.301 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T06:45:53.301 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T06:45:53.301 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:45:53.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:45:53.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-30T06:45:53.363 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:45:53.364 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T06:45:53.412 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:45:53.412 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:45:53.412 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:45:53.463 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T06:45:53.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:45:53.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:45:53.558 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:45:53.558 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:45:53.572 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:45:53.572 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:45:53.572 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-05-30T06:45:53.572 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@393250aa-2b42-4955-adf1-f790b8ba4d8c.cephfs=/ 2024-05-30T06:45:53.572 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-05-30T06:45:53.576 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T06:45:53.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:45:53.576 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:45:53.598 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:45:53.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:45:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:45:53.706 INFO:teuthology.orchestra.run.smithi037.stdout:client5784 2024-05-30T06:45:53.706 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:45:53.707 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:45:53.756 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T06:45:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.941+0000 7f2f47e00640 1 Processor -- start 2024-05-30T06:45:53.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.941+0000 7f2f47e00640 1 -- start start 2024-05-30T06:45:53.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f47e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f400ced10 0x7f2f4006ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:53.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f47e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2f400b59d0 0x7f2f400b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:53.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f47e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f4015db00 con 0x7f2f4015cdd0 2024-05-30T06:45:53.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f47e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2f4006df50 con 0x7f2f400b59d0 2024-05-30T06:45:53.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f47e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2f400b6370 con 0x7f2f400ced10 2024-05-30T06:45:53.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f45400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f400ced10 0x7f2f4006ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:53.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f44a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2f400b59d0 0x7f2f400b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:53.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f45400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f400ced10 0x7f2f4006ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:35694/0 (socket says 172.21.15.37:35694) 2024-05-30T06:45:53.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f44a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2f400b59d0 0x7f2f400b5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:43046/0 (socket says 172.21.15.37:43046) 2024-05-30T06:45:53.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f45400640 1 -- 172.21.15.37:0/3886780360 learned_addr learned my addr 172.21.15.37:0/3886780360 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:53.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f44a00640 1 -- 172.21.15.37:0/3886780360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f400ced10 msgr2=0x7f2f4006ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:53.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f44a00640 1 --2- 172.21.15.37:0/3886780360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f400ced10 0x7f2f4006ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:53.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f44a00640 1 -- 172.21.15.37:0/3886780360 >> v1:172.21.15.105:6789/0 conn(0x7f2f4015cdd0 legacy=0x7f2f4015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:53.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f44a00640 1 -- 172.21.15.37:0/3886780360 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4006e180 con 0x7f2f400b59d0 2024-05-30T06:45:53.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.945+0000 7f2f45400640 1 --2- 172.21.15.37:0/3886780360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f400ced10 0x7f2f4006ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:45:53.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.949+0000 7f2f44a00640 1 --2- 172.21.15.37:0/3886780360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f400b59d0 0x7f2f400b5e30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0097c0 tx=0x7f2f2c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b08bb0bd03d48fea server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.949+0000 7f2f3fe00640 1 -- 172.21.15.37:0/3886780360 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c0b1070 con 0x7f2f400b59d0 2024-05-30T06:45:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.949+0000 7f2f3fe00640 1 -- 172.21.15.37:0/3886780360 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2c0ac410 con 0x7f2f400b59d0 2024-05-30T06:45:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.949+0000 7f2f3fe00640 1 -- 172.21.15.37:0/3886780360 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c0ac7e0 con 0x7f2f400b59d0 2024-05-30T06:45:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.949+0000 7f2f47e00640 1 -- 172.21.15.37:0/3886780360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f400b59d0 msgr2=0x7f2f400b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:53.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.949+0000 7f2f47e00640 1 --2- 172.21.15.37:0/3886780360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f400b59d0 0x7f2f400b5e30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0097c0 tx=0x7f2f2c01c4a0 comp rx=0 tx=0).stop 2024-05-30T06:45:53.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.949+0000 7f2f47e00640 1 -- 172.21.15.37:0/3886780360 shutdown_connections 2024-05-30T06:45:53.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.949+0000 7f2f47e00640 1 --2- 172.21.15.37:0/3886780360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f400b59d0 0x7f2f400b5e30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:53.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.949+0000 7f2f47e00640 1 --2- 172.21.15.37:0/3886780360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f400ced10 0x7f2f4006ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:53.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.949+0000 7f2f47e00640 1 -- 172.21.15.37:0/3886780360 >> 172.21.15.37:0/3886780360 conn(0x7f2f4006bf60 msgr2=0x7f2f400b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:53.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.949+0000 7f2f47e00640 1 -- 172.21.15.37:0/3886780360 shutdown_connections 2024-05-30T06:45:53.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.949+0000 7f2f47e00640 1 -- 172.21.15.37:0/3886780360 wait complete. 2024-05-30T06:45:53.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f47e00640 1 Processor -- start 2024-05-30T06:45:53.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f47e00640 1 -- start start 2024-05-30T06:45:53.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f47e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f400b59d0 0x7f2f4014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:53.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f47e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f400ced10 0x7f2f4014bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:53.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f47e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f4015cdd0 0x7f2f401568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:53.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f47e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4015ea50 con 0x7f2f400b59d0 2024-05-30T06:45:53.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f47e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4015e8d0 con 0x7f2f400ced10 2024-05-30T06:45:53.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f47e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2f4014ccd0 con 0x7f2f4015cdd0 2024-05-30T06:45:53.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f45400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f400b59d0 0x7f2f4014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:53.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f45400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f400b59d0 0x7f2f4014eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48360/0 (socket says 172.21.15.37:48360) 2024-05-30T06:45:53.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f45400640 1 -- 172.21.15.37:0/4192556535 learned_addr learned my addr 172.21.15.37:0/4192556535 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:53.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f44a00640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f400ced10 0x7f2f4014bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f45e00640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f4015cdd0 0x7f2f401568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f45400640 1 -- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f4015cdd0 msgr2=0x7f2f401568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f45400640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f4015cdd0 0x7f2f401568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f45400640 1 -- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f400ced10 msgr2=0x7f2f4014bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f45400640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f400ced10 0x7f2f4014bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f45400640 1 -- 172.21.15.37:0/4192556535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4014c470 con 0x7f2f400b59d0 2024-05-30T06:45:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f45e00640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f4015cdd0 0x7f2f401568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:45:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f45400640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f400b59d0 0x7f2f4014eef0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400e9d0 tx=0x7f2f3400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f3d600640 1 -- 172.21.15.37:0/4192556535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f34017070 con 0x7f2f400b59d0 2024-05-30T06:45:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f3d600640 1 -- 172.21.15.37:0/4192556535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f3400ca60 con 0x7f2f400b59d0 2024-05-30T06:45:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f3d600640 1 -- 172.21.15.37:0/4192556535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3400ce10 con 0x7f2f400b59d0 2024-05-30T06:45:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f47e00640 1 -- 172.21.15.37:0/4192556535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4014c710 con 0x7f2f400b59d0 2024-05-30T06:45:53.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f47e00640 1 -- 172.21.15.37:0/4192556535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f4014f700 con 0x7f2f400b59d0 2024-05-30T06:45:53.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.953+0000 7f2f47e00640 1 -- 172.21.15.37:0/4192556535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f40068d40 con 0x7f2f400b59d0 2024-05-30T06:45:53.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.957+0000 7f2f3d600640 1 -- 172.21.15.37:0/4192556535 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f2f3401a070 con 0x7f2f400b59d0 2024-05-30T06:45:53.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.957+0000 7f2f3d600640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2f200686e0 0x7f2f2006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:53.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.957+0000 7f2f3d600640 1 -- 172.21.15.37:0/4192556535 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f2f34086db0 con 0x7f2f400b59d0 2024-05-30T06:45:53.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.957+0000 7f2f44a00640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2f200686e0 0x7f2f2006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:53.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.957+0000 7f2f44a00640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2f200686e0 0x7f2f2006aba0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0ae000 tx=0x7f2f2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:53.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:53.961+0000 7f2f3d600640 1 -- 172.21.15.37:0/4192556535 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2f3408b070 con 0x7f2f400b59d0 2024-05-30T06:45:54.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.161+0000 7f2f47e00640 1 -- 172.21.15.37:0/4192556535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f2f40157830 con 0x7f2f400b59d0 2024-05-30T06:45:54.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.565+0000 7f2f3d600640 1 -- 172.21.15.37:0/4192556535 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v28) ==== 136+0+0 (secure 0 0 0) 0x7f2f34056920 con 0x7f2f400b59d0 2024-05-30T06:45:54.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.569+0000 7f2f47e00640 1 -- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2f200686e0 msgr2=0x7f2f2006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:54.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.569+0000 7f2f47e00640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2f200686e0 0x7f2f2006aba0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0ae000 tx=0x7f2f2c008040 comp rx=0 tx=0).stop 2024-05-30T06:45:54.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.569+0000 7f2f47e00640 1 -- 172.21.15.37:0/4192556535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f400b59d0 msgr2=0x7f2f4014eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:54.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.569+0000 7f2f47e00640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f400b59d0 0x7f2f4014eef0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400e9d0 tx=0x7f2f3400ee90 comp rx=0 tx=0).stop 2024-05-30T06:45:54.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.569+0000 7f2f47e00640 1 -- 172.21.15.37:0/4192556535 shutdown_connections 2024-05-30T06:45:54.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.569+0000 7f2f47e00640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f4015cdd0 0x7f2f401568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:54.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.569+0000 7f2f47e00640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2f200686e0 0x7f2f2006aba0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:54.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.569+0000 7f2f47e00640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f400ced10 0x7f2f4014bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:54.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.569+0000 7f2f47e00640 1 --2- 172.21.15.37:0/4192556535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f400b59d0 0x7f2f4014eef0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:54.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.569+0000 7f2f47e00640 1 -- 172.21.15.37:0/4192556535 >> 172.21.15.37:0/4192556535 conn(0x7f2f4006bf60 msgr2=0x7f2f400b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:54.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.569+0000 7f2f47e00640 1 -- 172.21.15.37:0/4192556535 shutdown_connections 2024-05-30T06:45:54.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.569+0000 7f2f47e00640 1 -- 172.21.15.37:0/4192556535 wait complete. 2024-05-30T06:45:54.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:45:54.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.729+0000 7f7ccd400640 1 Processor -- start 2024-05-30T06:45:54.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.729+0000 7f7ccd400640 1 -- start start 2024-05-30T06:45:54.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7ccd400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7cc815d350 0x7f7cc806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:54.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7ccd400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7cc815d7b0 0x7f7cc806e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:54.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7ccd400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cc8142030 con 0x7f7cc80b59d0 2024-05-30T06:45:54.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7ccd400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7cc8142310 con 0x7f7cc815d7b0 2024-05-30T06:45:54.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7ccd400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc81425f0 con 0x7f7cc815d350 2024-05-30T06:45:54.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7cc6800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7cc80b59d0 0x7f7cc80b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57320/0 (socket says 172.21.15.37:57320) 2024-05-30T06:45:54.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7cc6800640 1 -- 172.21.15.37:0/2694867911 learned_addr learned my addr 172.21.15.37:0/2694867911 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:54.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7cc7200640 1 --2- 172.21.15.37:0/2694867911 >> v2:172.21.15.37:3300/0 conn(0x7f7cc815d7b0 0x7f7cc806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:54.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/2694867911 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7cc815d350 0x7f7cc806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:54.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7cc7200640 1 -- 172.21.15.37:0/2694867911 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7cc815d350 msgr2=0x7f7cc806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:54.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7cc7200640 1 --2- 172.21.15.37:0/2694867911 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7cc815d350 0x7f7cc806df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:54.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7cc7200640 1 -- 172.21.15.37:0/2694867911 >> v1:172.21.15.37:6789/0 conn(0x7f7cc80b59d0 legacy=0x7f7cc80b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:54.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7cc7200640 1 -- 172.21.15.37:0/2694867911 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc81428d0 con 0x7f7cc815d7b0 2024-05-30T06:45:54.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.733+0000 7f7cc7200640 1 --2- 172.21.15.37:0/2694867911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc815d7b0 0x7f7cc806e490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009d90 tx=0x7f7cc001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa85c8e6e07e1ae2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:54.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7cc5e00640 1 -- 172.21.15.37:0/2694867911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00b4070 con 0x7f7cc815d7b0 2024-05-30T06:45:54.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7cc5e00640 1 -- 172.21.15.37:0/2694867911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc00af600 con 0x7f7cc815d7b0 2024-05-30T06:45:54.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7cc5e00640 1 -- 172.21.15.37:0/2694867911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00af9d0 con 0x7f7cc815d7b0 2024-05-30T06:45:54.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 -- 172.21.15.37:0/2694867911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc815d7b0 msgr2=0x7f7cc806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:54.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 --2- 172.21.15.37:0/2694867911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc815d7b0 0x7f7cc806e490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0009d90 tx=0x7f7cc001f150 comp rx=0 tx=0).stop 2024-05-30T06:45:54.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 -- 172.21.15.37:0/2694867911 shutdown_connections 2024-05-30T06:45:54.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 --2- 172.21.15.37:0/2694867911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc815d7b0 0x7f7cc806e490 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:54.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 --2- 172.21.15.37:0/2694867911 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7cc815d350 0x7f7cc806df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:54.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 -- 172.21.15.37:0/2694867911 >> 172.21.15.37:0/2694867911 conn(0x7f7cc806bf60 msgr2=0x7f7cc80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:54.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 -- 172.21.15.37:0/2694867911 shutdown_connections 2024-05-30T06:45:54.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 -- 172.21.15.37:0/2694867911 wait complete. 2024-05-30T06:45:54.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 Processor -- start 2024-05-30T06:45:54.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 -- start start 2024-05-30T06:45:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc80b59d0 0x7f7cc8155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7cc815d350 0x7f7cc80b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cc815d7b0 0x7f7cc80b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc80b00a0 con 0x7f7cc80b59d0 2024-05-30T06:45:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc80aff20 con 0x7f7cc815d7b0 2024-05-30T06:45:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7ccd400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7cc813f860 con 0x7f7cc815d350 2024-05-30T06:45:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7cc6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc80b59d0 0x7f7cc8155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7cc6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc80b59d0 0x7f7cc8155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48384/0 (socket says 172.21.15.37:48384) 2024-05-30T06:45:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7cc6800640 1 -- 172.21.15.37:0/1306009166 learned_addr learned my addr 172.21.15.37:0/1306009166 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:54.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7cc815d350 0x7f7cc80b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:54.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.737+0000 7f7cc7200640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cc815d7b0 0x7f7cc80b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:54.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7cc6800640 1 -- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7cc815d350 msgr2=0x7f7cc80b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:54.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7cc6800640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7cc815d350 0x7f7cc80b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:54.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7cc6800640 1 -- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cc815d7b0 msgr2=0x7f7cc80b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:54.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7cc6800640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cc815d7b0 0x7f7cc80b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:54.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7cc6800640 1 -- 172.21.15.37:0/1306009166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc815e4d0 con 0x7f7cc80b59d0 2024-05-30T06:45:54.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7cc6800640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc80b59d0 0x7f7cc8155770 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800c370 tx=0x7f7cb800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:54.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7cbea00640 1 -- 172.21.15.37:0/1306009166 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8017070 con 0x7f7cc80b59d0 2024-05-30T06:45:54.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7cbea00640 1 -- 172.21.15.37:0/1306009166 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cb8005cf0 con 0x7f7cc80b59d0 2024-05-30T06:45:54.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7ccd400640 1 -- 172.21.15.37:0/1306009166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc80b4d40 con 0x7f7cc80b59d0 2024-05-30T06:45:54.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7cbea00640 1 -- 172.21.15.37:0/1306009166 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb80072f0 con 0x7f7cc80b59d0 2024-05-30T06:45:54.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7ccd400640 1 -- 172.21.15.37:0/1306009166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc80b5300 con 0x7f7cc80b59d0 2024-05-30T06:45:54.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7ccd400640 1 -- 172.21.15.37:0/1306009166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc8068bc0 con 0x7f7cc80b59d0 2024-05-30T06:45:54.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7cbea00640 1 -- 172.21.15.37:0/1306009166 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f7cb801a070 con 0x7f7cc80b59d0 2024-05-30T06:45:54.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7cbea00640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ca40686e0 0x7f7ca406aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:54.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.741+0000 7f7cbea00640 1 -- 172.21.15.37:0/1306009166 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f7cb8086260 con 0x7f7cc80b59d0 2024-05-30T06:45:54.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.745+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ca40686e0 0x7f7ca406aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:54.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.745+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ca40686e0 0x7f7ca406aba0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7cc81f7da0 tx=0x7f7cb0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:54.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.745+0000 7f7cbea00640 1 -- 172.21.15.37:0/1306009166 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7cb8055d40 con 0x7f7cc80b59d0 2024-05-30T06:45:54.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.933+0000 7f7ccd400640 1 -- 172.21.15.37:0/1306009166 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f7cc813e320 con 0x7f7ca40686e0 2024-05-30T06:45:54.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.937+0000 7f7cbea00640 1 -- 172.21.15.37:0/1306009166 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f7cb0004040 con 0x7f7ca40686e0 2024-05-30T06:45:54.937 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:45:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:45:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:45:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:45:54.938 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:45:54.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.937+0000 7f7ccd400640 1 -- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ca40686e0 msgr2=0x7f7ca406aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.937+0000 7f7ccd400640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ca40686e0 0x7f7ca406aba0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7cc81f7da0 tx=0x7f7cb0009190 comp rx=0 tx=0).stop 2024-05-30T06:45:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.937+0000 7f7ccd400640 1 -- 172.21.15.37:0/1306009166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc80b59d0 msgr2=0x7f7cc8155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.937+0000 7f7ccd400640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc80b59d0 0x7f7cc8155770 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800c370 tx=0x7f7cb800c830 comp rx=0 tx=0).stop 2024-05-30T06:45:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.937+0000 7f7ccd400640 1 -- 172.21.15.37:0/1306009166 shutdown_connections 2024-05-30T06:45:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.937+0000 7f7ccd400640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ca40686e0 0x7f7ca406aba0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.937+0000 7f7ccd400640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7cc815d7b0 0x7f7cc80b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.937+0000 7f7ccd400640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7cc815d350 0x7f7cc80b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.937+0000 7f7ccd400640 1 --2- 172.21.15.37:0/1306009166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc80b59d0 0x7f7cc8155770 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.937+0000 7f7ccd400640 1 -- 172.21.15.37:0/1306009166 >> 172.21.15.37:0/1306009166 conn(0x7f7cc806bf60 msgr2=0x7f7cc813dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.937+0000 7f7ccd400640 1 -- 172.21.15.37:0/1306009166 shutdown_connections 2024-05-30T06:45:54.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:54.937+0000 7f7ccd400640 1 -- 172.21.15.37:0/1306009166 wait complete. 2024-05-30T06:45:54.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:45:55.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02ca400640 1 Processor -- start 2024-05-30T06:45:55.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02ca400640 1 -- start start 2024-05-30T06:45:55.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02ca400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f02c40b59d0 0x7f02c40b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02ca400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c415d7e0 0x7f02c4160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02ca400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c40b62f0 con 0x7f02c415d350 2024-05-30T06:45:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02ca400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f02c4142030 con 0x7f02c40b59d0 2024-05-30T06:45:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02ca400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f02c4142310 con 0x7f02c415d7e0 2024-05-30T06:45:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02bbe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f02c415d350 0x7f02c4160280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57322/0 (socket says 172.21.15.37:57322) 2024-05-30T06:45:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02c3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f02c40b59d0 0x7f02c40b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02bbe00640 1 -- 172.21.15.37:0/1232867024 learned_addr learned my addr 172.21.15.37:0/1232867024 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:45:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02c3e00640 1 --2- 172.21.15.37:0/1232867024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c415d7e0 0x7f02c4160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02c3400640 1 -- 172.21.15.37:0/1232867024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c415d7e0 msgr2=0x7f02c4160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:55.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02c3400640 1 --2- 172.21.15.37:0/1232867024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c415d7e0 0x7f02c4160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02c3400640 1 -- 172.21.15.37:0/1232867024 >> v1:172.21.15.37:6789/0 conn(0x7f02c415d350 legacy=0x7f02c4160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.101+0000 7f02c3400640 1 -- 172.21.15.37:0/1232867024 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c41425f0 con 0x7f02c40b59d0 2024-05-30T06:45:55.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.105+0000 7f02c3400640 1 --2- 172.21.15.37:0/1232867024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c40b59d0 0x7f02c40b5db0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f02b40097f0 tx=0x7f02b401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72cc169d9ebefb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:55.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.105+0000 7f02c2a00640 1 -- 172.21.15.37:0/1232867024 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b40b5070 con 0x7f02c40b59d0 2024-05-30T06:45:55.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.105+0000 7f02c2a00640 1 -- 172.21.15.37:0/1232867024 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b40a8990 con 0x7f02c40b59d0 2024-05-30T06:45:55.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.105+0000 7f02c2a00640 1 -- 172.21.15.37:0/1232867024 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b40a8d60 con 0x7f02c40b59d0 2024-05-30T06:45:55.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.105+0000 7f02ca400640 1 -- 172.21.15.37:0/1232867024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c40b59d0 msgr2=0x7f02c40b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.105+0000 7f02ca400640 1 --2- 172.21.15.37:0/1232867024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c40b59d0 0x7f02c40b5db0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f02b40097f0 tx=0x7f02b401ec90 comp rx=0 tx=0).stop 2024-05-30T06:45:55.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.105+0000 7f02ca400640 1 -- 172.21.15.37:0/1232867024 shutdown_connections 2024-05-30T06:45:55.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.105+0000 7f02ca400640 1 --2- 172.21.15.37:0/1232867024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c415d7e0 0x7f02c4160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.105+0000 7f02ca400640 1 --2- 172.21.15.37:0/1232867024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c40b59d0 0x7f02c40b5db0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.105+0000 7f02ca400640 1 -- 172.21.15.37:0/1232867024 >> 172.21.15.37:0/1232867024 conn(0x7f02c406bf60 msgr2=0x7f02c40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:55.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.105+0000 7f02ca400640 1 -- 172.21.15.37:0/1232867024 shutdown_connections 2024-05-30T06:45:55.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.105+0000 7f02ca400640 1 -- 172.21.15.37:0/1232867024 wait complete. 2024-05-30T06:45:55.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02ca400640 1 Processor -- start 2024-05-30T06:45:55.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02ca400640 1 -- start start 2024-05-30T06:45:55.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02ca400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c40b59d0 0x7f02c41566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02ca400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c415d350 0x7f02c4152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02ca400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02c415d7e0 0x7f02c4128490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02ca400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02c413fe60 con 0x7f02c40b59d0 2024-05-30T06:45:55.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02ca400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02c413fce0 con 0x7f02c415d7e0 2024-05-30T06:45:55.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02ca400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f02c40aff20 con 0x7f02c415d350 2024-05-30T06:45:55.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02c3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c40b59d0 0x7f02c41566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02c3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c40b59d0 0x7f02c41566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48402/0 (socket says 172.21.15.37:48402) 2024-05-30T06:45:55.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02c3400640 1 -- 172.21.15.37:0/2919546615 learned_addr learned my addr 172.21.15.37:0/2919546615 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:55.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02bbe00640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c415d350 0x7f02c4152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02c3e00640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02c415d7e0 0x7f02c4128490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02c3400640 1 -- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c415d350 msgr2=0x7f02c4152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02c3400640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c415d350 0x7f02c4152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02c3400640 1 -- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02c415d7e0 msgr2=0x7f02c4128490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02c3400640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02c415d7e0 0x7f02c4128490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02c3400640 1 -- 172.21.15.37:0/2919546615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c4155600 con 0x7f02c40b59d0 2024-05-30T06:45:55.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02c3400640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c40b59d0 0x7f02c41566a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f02b401c8c0 tx=0x7f02b401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:55.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02bb400640 1 -- 172.21.15.37:0/2919546615 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b40bf070 con 0x7f02c40b59d0 2024-05-30T06:45:55.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02bb400640 1 -- 172.21.15.37:0/2919546615 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b40b0820 con 0x7f02c40b59d0 2024-05-30T06:45:55.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02bb400640 1 -- 172.21.15.37:0/2919546615 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b40b5040 con 0x7f02c40b59d0 2024-05-30T06:45:55.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02ca400640 1 -- 172.21.15.37:0/2919546615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c41558e0 con 0x7f02c40b59d0 2024-05-30T06:45:55.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.109+0000 7f02ca400640 1 -- 172.21.15.37:0/2919546615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c4155ea0 con 0x7f02c40b59d0 2024-05-30T06:45:55.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.113+0000 7f02ca400640 1 -- 172.21.15.37:0/2919546615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c4068bc0 con 0x7f02c40b59d0 2024-05-30T06:45:55.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.113+0000 7f02bb400640 1 -- 172.21.15.37:0/2919546615 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f02b40c2070 con 0x7f02c40b59d0 2024-05-30T06:45:55.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.113+0000 7f02bb400640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02a00686e0 0x7f02a006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.113+0000 7f02bb400640 1 -- 172.21.15.37:0/2919546615 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f02b41238c0 con 0x7f02c40b59d0 2024-05-30T06:45:55.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.113+0000 7f02bbe00640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02a00686e0 0x7f02a006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.113+0000 7f02bbe00640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02a00686e0 0x7f02a006aba0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f02c40cf800 tx=0x7f02ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:55.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.117+0000 7f02bb400640 1 -- 172.21.15.37:0/2919546615 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f02b40187f0 con 0x7f02c40b59d0 2024-05-30T06:45:55.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.281+0000 7f02ca400640 1 -- 172.21.15.37:0/2919546615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f02c4072a90 con 0x7f02c40b59d0 2024-05-30T06:45:55.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.281+0000 7f02bb400640 1 -- 172.21.15.37:0/2919546615 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f02b40f3900 con 0x7f02c40b59d0 2024-05-30T06:45:55.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.285+0000 7f02ca400640 1 -- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02a00686e0 msgr2=0x7f02a006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.285+0000 7f02ca400640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02a00686e0 0x7f02a006aba0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f02c40cf800 tx=0x7f02ac009040 comp rx=0 tx=0).stop 2024-05-30T06:45:55.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.285+0000 7f02ca400640 1 -- 172.21.15.37:0/2919546615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c40b59d0 msgr2=0x7f02c41566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.285+0000 7f02ca400640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c40b59d0 0x7f02c41566a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f02b401c8c0 tx=0x7f02b401ba30 comp rx=0 tx=0).stop 2024-05-30T06:45:55.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.285+0000 7f02ca400640 1 -- 172.21.15.37:0/2919546615 shutdown_connections 2024-05-30T06:45:55.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.285+0000 7f02ca400640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02a00686e0 0x7f02a006aba0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.285+0000 7f02ca400640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02c415d7e0 0x7f02c4128490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.285+0000 7f02ca400640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c415d350 0x7f02c4152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.285+0000 7f02ca400640 1 --2- 172.21.15.37:0/2919546615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c40b59d0 0x7f02c41566a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.285+0000 7f02ca400640 1 -- 172.21.15.37:0/2919546615 >> 172.21.15.37:0/2919546615 conn(0x7f02c406bf60 msgr2=0x7f02c406df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.285+0000 7f02ca400640 1 -- 172.21.15.37:0/2919546615 shutdown_connections 2024-05-30T06:45:55.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.285+0000 7f02ca400640 1 -- 172.21.15.37:0/2919546615 wait complete. 2024-05-30T06:45:55.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T06:45:55.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.449+0000 7f58eae00640 1 Processor -- start 2024-05-30T06:45:55.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.449+0000 7f58eae00640 1 -- start start 2024-05-30T06:45:55.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.449+0000 7f58eae00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f58e4159490 0x7f58e4072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.449+0000 7f58eae00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58e4072c90 0x7f58e40cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.449+0000 7f58eae00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e40d06e0 con 0x7f58e40702d0 2024-05-30T06:45:55.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.449+0000 7f58eae00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f58e4162800 con 0x7f58e4159490 2024-05-30T06:45:55.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.449+0000 7f58eae00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f58e40730c0 con 0x7f58e4072c90 2024-05-30T06:45:55.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.449+0000 7f58e8e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58e4072c90 0x7f58e40cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.449+0000 7f58e8e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58e4072c90 0x7f58e40cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:35742/0 (socket says 172.21.15.37:35742) 2024-05-30T06:45:55.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.449+0000 7f58e8e00640 1 -- 172.21.15.37:0/3398472443 learned_addr learned my addr 172.21.15.37:0/3398472443 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:55.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.449+0000 7f58e3e00640 1 --2- 172.21.15.37:0/3398472443 >> v2:172.21.15.105:3300/0 conn(0x7f58e4159490 0x7f58e4072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.453+0000 7f58e8e00640 1 -- 172.21.15.37:0/3398472443 >> v2:172.21.15.105:3300/0 conn(0x7f58e4159490 msgr2=0x7f58e4072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:55.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.453+0000 7f58e8e00640 1 --2- 172.21.15.37:0/3398472443 >> v2:172.21.15.105:3300/0 conn(0x7f58e4159490 0x7f58e4072750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.453+0000 7f58e8e00640 1 -- 172.21.15.37:0/3398472443 >> v1:172.21.15.105:6789/0 conn(0x7f58e40702d0 legacy=0x7f58e415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.453+0000 7f58e8e00640 1 -- 172.21.15.37:0/3398472443 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e4162a50 con 0x7f58e4072c90 2024-05-30T06:45:55.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.453+0000 7f58e8e00640 1 --2- 172.21.15.37:0/3398472443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58e4072c90 0x7f58e40cfc60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009870 tx=0x7f58dc01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f971cbc9d6311865 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:55.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.453+0000 7f58e3400640 1 -- 172.21.15.37:0/3398472443 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0b0070 con 0x7f58e4072c90 2024-05-30T06:45:55.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.453+0000 7f58e3400640 1 -- 172.21.15.37:0/3398472443 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58dc004230 con 0x7f58e4072c90 2024-05-30T06:45:55.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.453+0000 7f58e3400640 1 -- 172.21.15.37:0/3398472443 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc003620 con 0x7f58e4072c90 2024-05-30T06:45:55.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 -- 172.21.15.37:0/3398472443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58e4072c90 msgr2=0x7f58e40cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 --2- 172.21.15.37:0/3398472443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58e4072c90 0x7f58e40cfc60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009870 tx=0x7f58dc01c440 comp rx=0 tx=0).stop 2024-05-30T06:45:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 -- 172.21.15.37:0/3398472443 shutdown_connections 2024-05-30T06:45:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 --2- 172.21.15.37:0/3398472443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58e4072c90 0x7f58e40cfc60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 --2- 172.21.15.37:0/3398472443 >> v2:172.21.15.105:3300/0 conn(0x7f58e4159490 0x7f58e4072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 -- 172.21.15.37:0/3398472443 >> 172.21.15.37:0/3398472443 conn(0x7f58e40d0d50 msgr2=0x7f58e40d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 -- 172.21.15.37:0/3398472443 shutdown_connections 2024-05-30T06:45:55.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 -- 172.21.15.37:0/3398472443 wait complete. 2024-05-30T06:45:55.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 Processor -- start 2024-05-30T06:45:55.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 -- start start 2024-05-30T06:45:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58e40702d0 0x7f58e4142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e4072c90 0x7f58e4150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e4159490 0x7f58e4150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f58e416bf30 con 0x7f58e4159490 2024-05-30T06:45:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f58e416bdb0 con 0x7f58e4072c90 2024-05-30T06:45:55.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58eae00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f58e416c0b0 con 0x7f58e40702d0 2024-05-30T06:45:55.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58e8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e4159490 0x7f58e4150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58e8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e4159490 0x7f58e4150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48404/0 (socket says 172.21.15.37:48404) 2024-05-30T06:45:55.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58e8e00640 1 -- 172.21.15.37:0/1042149948 learned_addr learned my addr 172.21.15.37:0/1042149948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:55.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58e3e00640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58e40702d0 0x7f58e4142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58db400640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e4072c90 0x7f58e4150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58e8e00640 1 -- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58e40702d0 msgr2=0x7f58e4142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58e8e00640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58e40702d0 0x7f58e4142700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58e8e00640 1 -- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e4072c90 msgr2=0x7f58e4150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58e8e00640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e4072c90 0x7f58e4150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.457+0000 7f58e8e00640 1 -- 172.21.15.37:0/1042149948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e4154f30 con 0x7f58e4159490 2024-05-30T06:45:55.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.461+0000 7f58e8e00640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e4159490 0x7f58e4150fd0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009870 tx=0x7f58dc0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:55.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.461+0000 7f58e0c00640 1 -- 172.21.15.37:0/1042149948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0b9020 con 0x7f58e4159490 2024-05-30T06:45:55.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.461+0000 7f58e0c00640 1 -- 172.21.15.37:0/1042149948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58dc0b1040 con 0x7f58e4159490 2024-05-30T06:45:55.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.461+0000 7f58eae00640 1 -- 172.21.15.37:0/1042149948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e4154c50 con 0x7f58e4159490 2024-05-30T06:45:55.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.461+0000 7f58e0c00640 1 -- 172.21.15.37:0/1042149948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0b0050 con 0x7f58e4159490 2024-05-30T06:45:55.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.461+0000 7f58eae00640 1 -- 172.21.15.37:0/1042149948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e40ae120 con 0x7f58e4159490 2024-05-30T06:45:55.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.461+0000 7f58eae00640 1 -- 172.21.15.37:0/1042149948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e4068d40 con 0x7f58e4159490 2024-05-30T06:45:55.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.461+0000 7f58e0c00640 1 -- 172.21.15.37:0/1042149948 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f58dc0bc020 con 0x7f58e4159490 2024-05-30T06:45:55.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.461+0000 7f58e0c00640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f58c0068710 0x7f58c006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.461+0000 7f58e0c00640 1 -- 172.21.15.37:0/1042149948 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f58dc120c40 con 0x7f58e4159490 2024-05-30T06:45:55.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.461+0000 7f58e3e00640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f58c0068710 0x7f58c006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.465+0000 7f58e3e00640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f58c0068710 0x7f58c006abd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f58d40113e0 tx=0x7f58d400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.465+0000 7f58e0c00640 1 -- 172.21.15.37:0/1042149948 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f58dc0c3030 con 0x7f58e4159490 2024-05-30T06:45:55.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.661+0000 7f58eae00640 1 -- 172.21.15.37:0/1042149948 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f58e4067d20 con 0x7f58c0068710 2024-05-30T06:45:55.669 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:55.667+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:55.669 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:55.667+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:55.669 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:55.667+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:55.669 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:55.667+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:55.669 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:45:55.667+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:45:55.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.701+0000 7f58e0c00640 1 -- 172.21.15.37:0/1042149948 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f58e4067d20 con 0x7f58c0068710 2024-05-30T06:45:55.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.705+0000 7f58eae00640 1 -- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f58c0068710 msgr2=0x7f58c006abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.705+0000 7f58eae00640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f58c0068710 0x7f58c006abd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f58d40113e0 tx=0x7f58d400b040 comp rx=0 tx=0).stop 2024-05-30T06:45:55.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.705+0000 7f58eae00640 1 -- 172.21.15.37:0/1042149948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e4159490 msgr2=0x7f58e4150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.705+0000 7f58eae00640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e4159490 0x7f58e4150fd0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009870 tx=0x7f58dc0191e0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.705+0000 7f58eae00640 1 -- 172.21.15.37:0/1042149948 shutdown_connections 2024-05-30T06:45:55.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.705+0000 7f58eae00640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58e4159490 0x7f58e4150fd0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.705+0000 7f58eae00640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f58c0068710 0x7f58c006abd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.705+0000 7f58eae00640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58e4072c90 0x7f58e4150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.705+0000 7f58eae00640 1 --2- 172.21.15.37:0/1042149948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58e40702d0 0x7f58e4142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.705+0000 7f58eae00640 1 -- 172.21.15.37:0/1042149948 >> 172.21.15.37:0/1042149948 conn(0x7f58e40d0d50 msgr2=0x7f58e4161370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:55.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.705+0000 7f58eae00640 1 -- 172.21.15.37:0/1042149948 shutdown_connections 2024-05-30T06:45:55.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.705+0000 7f58eae00640 1 -- 172.21.15.37:0/1042149948 wait complete. 2024-05-30T06:45:55.724 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:45:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.865+0000 7f574b000640 1 Processor -- start 2024-05-30T06:45:55.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.865+0000 7f574b000640 1 -- start start 2024-05-30T06:45:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.865+0000 7f574b000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574415e8b0 0x7f57440cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.865+0000 7f574b000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f574406d200 0x7f574406d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.865+0000 7f574b000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5744163350 con 0x7f574409aa60 2024-05-30T06:45:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.865+0000 7f574b000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f574406db80 con 0x7f574406d200 2024-05-30T06:45:55.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.865+0000 7f574b000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f57440cfb30 con 0x7f574415e8b0 2024-05-30T06:45:55.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.869+0000 7f573be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f574406d200 0x7f574406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.869+0000 7f573be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f574406d200 0x7f574406d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48412/0 (socket says 172.21.15.37:48412) 2024-05-30T06:45:55.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.869+0000 7f573be00640 1 -- 172.21.15.37:0/3867993767 learned_addr learned my addr 172.21.15.37:0/3867993767 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:55.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.869+0000 7f5743e00640 1 --2- 172.21.15.37:0/3867993767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574415e8b0 0x7f57440cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.869+0000 7f573be00640 1 -- 172.21.15.37:0/3867993767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574415e8b0 msgr2=0x7f57440cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:45:55.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.869+0000 7f573be00640 1 --2- 172.21.15.37:0/3867993767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574415e8b0 0x7f57440cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.869+0000 7f573be00640 1 -- 172.21.15.37:0/3867993767 >> v1:172.21.15.105:6789/0 conn(0x7f574409aa60 legacy=0x7f574409aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.869+0000 7f573be00640 1 -- 172.21.15.37:0/3867993767 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57441627d0 con 0x7f574406d200 2024-05-30T06:45:55.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.869+0000 7f573be00640 1 --2- 172.21.15.37:0/3867993767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574406d200 0x7f574406d640 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f572c009870 tx=0x7f572c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b98626ef46ca5a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:55.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.869+0000 7f5743400640 1 -- 172.21.15.37:0/3867993767 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c0ab650 con 0x7f574406d200 2024-05-30T06:45:55.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.869+0000 7f5743400640 1 -- 172.21.15.37:0/3867993767 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f572c0b0070 con 0x7f574406d200 2024-05-30T06:45:55.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.869+0000 7f5743400640 1 -- 172.21.15.37:0/3867993767 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c0aba10 con 0x7f574406d200 2024-05-30T06:45:55.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 -- 172.21.15.37:0/3867993767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574406d200 msgr2=0x7f574406d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 --2- 172.21.15.37:0/3867993767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574406d200 0x7f574406d640 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f572c009870 tx=0x7f572c01c560 comp rx=0 tx=0).stop 2024-05-30T06:45:55.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 -- 172.21.15.37:0/3867993767 shutdown_connections 2024-05-30T06:45:55.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 --2- 172.21.15.37:0/3867993767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574406d200 0x7f574406d640 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 --2- 172.21.15.37:0/3867993767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574415e8b0 0x7f57440cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 -- 172.21.15.37:0/3867993767 >> 172.21.15.37:0/3867993767 conn(0x7f57440b4130 msgr2=0x7f57440b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:55.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 -- 172.21.15.37:0/3867993767 shutdown_connections 2024-05-30T06:45:55.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 -- 172.21.15.37:0/3867993767 wait complete. 2024-05-30T06:45:55.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 Processor -- start 2024-05-30T06:45:55.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 -- start start 2024-05-30T06:45:55.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574406d200 0x7f57440b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574409aa60 0x7f5744150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574415e8b0 0x7f5744151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5744162480 con 0x7f574415e8b0 2024-05-30T06:45:55.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f574415ec90 con 0x7f574406d200 2024-05-30T06:45:55.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f574b000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f57440cf050 con 0x7f574409aa60 2024-05-30T06:45:55.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f5749000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574415e8b0 0x7f5744151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f5749000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574415e8b0 0x7f5744151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48416/0 (socket says 172.21.15.37:48416) 2024-05-30T06:45:55.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f5749000640 1 -- 172.21.15.37:0/1159628282 learned_addr learned my addr 172.21.15.37:0/1159628282 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:45:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f5743e00640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574406d200 0x7f57440b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f573be00640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574409aa60 0x7f5744150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f5749000640 1 -- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574409aa60 msgr2=0x7f5744150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f5749000640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574409aa60 0x7f5744150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f5749000640 1 -- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574406d200 msgr2=0x7f57440b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f5749000640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574406d200 0x7f57440b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:55.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f5749000640 1 -- 172.21.15.37:0/1159628282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57440ce500 con 0x7f574415e8b0 2024-05-30T06:45:55.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f5743e00640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574406d200 0x7f57440b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:45:55.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f573be00640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574409aa60 0x7f5744150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:45:55.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.873+0000 7f5749000640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574415e8b0 0x7f5744151340 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f573c00c730 tx=0x7f573c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:55.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.877+0000 7f5740c00640 1 -- 172.21.15.37:0/1159628282 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c003b80 con 0x7f574415e8b0 2024-05-30T06:45:55.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.877+0000 7f5740c00640 1 -- 172.21.15.37:0/1159628282 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f573c003d20 con 0x7f574415e8b0 2024-05-30T06:45:55.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.877+0000 7f5740c00640 1 -- 172.21.15.37:0/1159628282 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c005310 con 0x7f574415e8b0 2024-05-30T06:45:55.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.877+0000 7f574b000640 1 -- 172.21.15.37:0/1159628282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57440ce7e0 con 0x7f574415e8b0 2024-05-30T06:45:55.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.877+0000 7f574b000640 1 -- 172.21.15.37:0/1159628282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57440b2dd0 con 0x7f574415e8b0 2024-05-30T06:45:55.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.877+0000 7f574b000640 1 -- 172.21.15.37:0/1159628282 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57440b2920 con 0x7f574415e8b0 2024-05-30T06:45:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.877+0000 7f5740c00640 1 -- 172.21.15.37:0/1159628282 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) ==== 88293+0+0 (secure 0 0 0) 0x7f573c0056c0 con 0x7f574415e8b0 2024-05-30T06:45:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.877+0000 7f5740c00640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f57200686e0 0x7f572006aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:45:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.877+0000 7f5740c00640 1 -- 172.21.15.37:0/1159628282 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f573c0870e0 con 0x7f574415e8b0 2024-05-30T06:45:55.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.877+0000 7f5743e00640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f57200686e0 0x7f572006aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:45:55.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.881+0000 7f5743e00640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f57200686e0 0x7f572006aba0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f57440b4a60 tx=0x7f5734008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:45:55.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:55.881+0000 7f5740c00640 1 -- 172.21.15.37:0/1159628282 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f573c057110 con 0x7f574415e8b0 2024-05-30T06:45:56.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.069+0000 7f574b000640 1 -- 172.21.15.37:0/1159628282 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f57440b1480 con 0x7f57200686e0 2024-05-30T06:45:56.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.077+0000 7f5740c00640 1 -- 172.21.15.37:0/1159628282 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f57440b1480 con 0x7f57200686e0 2024-05-30T06:45:56.076 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69 2024-05-30T06:45:56.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.077+0000 7f574b000640 1 -- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f57200686e0 msgr2=0x7f572006aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:56.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.077+0000 7f574b000640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f57200686e0 0x7f572006aba0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f57440b4a60 tx=0x7f5734008040 comp rx=0 tx=0).stop 2024-05-30T06:45:56.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.077+0000 7f574b000640 1 -- 172.21.15.37:0/1159628282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574415e8b0 msgr2=0x7f5744151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:45:56.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.077+0000 7f574b000640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574415e8b0 0x7f5744151340 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f573c00c730 tx=0x7f573c00cbf0 comp rx=0 tx=0).stop 2024-05-30T06:45:56.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.077+0000 7f574b000640 1 -- 172.21.15.37:0/1159628282 shutdown_connections 2024-05-30T06:45:56.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.077+0000 7f574b000640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f574415e8b0 0x7f5744151340 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:56.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.077+0000 7f574b000640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f574409aa60 0x7f5744150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:56.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.077+0000 7f574b000640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f57200686e0 0x7f572006aba0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:56.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.077+0000 7f574b000640 1 --2- 172.21.15.37:0/1159628282 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f574406d200 0x7f57440b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:45:56.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.077+0000 7f574b000640 1 -- 172.21.15.37:0/1159628282 >> 172.21.15.37:0/1159628282 conn(0x7f57440b4130 msgr2=0x7f5744154380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:45:56.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.077+0000 7f574b000640 1 -- 172.21.15.37:0/1159628282 shutdown_connections 2024-05-30T06:45:56.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:45:56.077+0000 7f574b000640 1 -- 172.21.15.37:0/1159628282 wait complete. 2024-05-30T06:45:56.097 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 10 files each 1024MB size under directory volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69 2024-05-30T06:45:56.098 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:45:56.098 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:45:56.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:45:56.107 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:46:04.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:46:04.155 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:46:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:46:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:46:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.59398 s, 125 MB/s 2024-05-30T06:46:04.758 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:46:04.758 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:46:04.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:46:04.767 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:46:13.239 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:46:13.239 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:46:13.239 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.42176 s, 127 MB/s 2024-05-30T06:46:13.241 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:46:13.241 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:46:13.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:46:13.250 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:46:21.783 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:46:21.783 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:46:21.783 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.48129 s, 127 MB/s 2024-05-30T06:46:21.784 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:46:21.784 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:46:21.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:46:21.793 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69/subvolume_file.3 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:46:30.211 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:46:30.211 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:46:30.211 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.36601 s, 128 MB/s 2024-05-30T06:46:30.212 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:46:30.213 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:46:30.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:46:30.222 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69/subvolume_file.4 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:46:34.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:46:34.241 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:46:38.660 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:46:38.660 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:46:38.660 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.38705 s, 128 MB/s 2024-05-30T06:46:38.661 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:46:38.661 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:46:38.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:46:38.670 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69/subvolume_file.5 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:46:47.333 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:46:47.334 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:46:47.334 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.61169 s, 125 MB/s 2024-05-30T06:46:47.335 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:46:47.335 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:46:47.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:46:47.344 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69/subvolume_file.6 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:46:55.754 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:46:55.755 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:46:55.755 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.35744 s, 128 MB/s 2024-05-30T06:46:55.756 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:46:55.756 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:46:55.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:46:55.765 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69/subvolume_file.7 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:47:04.190 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:47:04.191 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:47:04.191 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.36936 s, 128 MB/s 2024-05-30T06:47:04.192 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:47:04.192 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:47:04.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:47:04.201 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69/subvolume_file.8 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:47:04.298 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:47:04.302 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:47:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:47:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:47:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.5846 s, 125 MB/s 2024-05-30T06:47:12.839 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:47:12.840 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:47:12.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:47:12.849 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69/subvolume_file.9 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:47:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:47:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:47:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.42501 s, 127 MB/s 2024-05-30T06:47:21.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T06:47:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.476+0000 7f3945200640 1 Processor -- start 2024-05-30T06:47:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.476+0000 7f3945200640 1 -- start start 2024-05-30T06:47:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.476+0000 7f3945200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3940144f00 0x7f39400b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.476+0000 7f3945200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394006ef30 0x7f394006f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.476+0000 7f3945200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f39400cd080 0x7f39400cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.476+0000 7f3945200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f394006f8d0 con 0x7f3940144f00 2024-05-30T06:47:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.476+0000 7f3945200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3940072e30 con 0x7f39400cd080 2024-05-30T06:47:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.476+0000 7f3945200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39400cdc60 con 0x7f394006ef30 2024-05-30T06:47:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f393f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3940144f00 0x7f39400b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f393f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3940144f00 0x7f39400b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53540/0 (socket says 172.21.15.37:53540) 2024-05-30T06:47:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f393f400640 1 -- 172.21.15.37:0/3979685391 learned_addr learned my addr 172.21.15.37:0/3979685391 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f393fe00640 1 --2- 172.21.15.37:0/3979685391 >> v2:172.21.15.105:3300/0 conn(0x7f39400cd080 0x7f39400cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f3936a00640 1 --2- 172.21.15.37:0/3979685391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394006ef30 0x7f394006f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f393f400640 1 -- 172.21.15.37:0/3979685391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394006ef30 msgr2=0x7f394006f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f393f400640 1 --2- 172.21.15.37:0/3979685391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394006ef30 0x7f394006f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f393f400640 1 -- 172.21.15.37:0/3979685391 >> v2:172.21.15.105:3300/0 conn(0x7f39400cd080 msgr2=0x7f39400cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f393f400640 1 --2- 172.21.15.37:0/3979685391 >> v2:172.21.15.105:3300/0 conn(0x7f39400cd080 0x7f39400cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f393f400640 1 -- 172.21.15.37:0/3979685391 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39400b3b50 con 0x7f3940144f00 2024-05-30T06:47:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f393f400640 1 --2- 172.21.15.37:0/3979685391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3940144f00 0x7f39400b4910 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f394006fdc0 tx=0x7f393001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6daa8a41f8363bf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f393ea00640 1 -- 172.21.15.37:0/3979685391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39300b0070 con 0x7f3940144f00 2024-05-30T06:47:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f393ea00640 1 -- 172.21.15.37:0/3979685391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39300ab600 con 0x7f3940144f00 2024-05-30T06:47:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.480+0000 7f393ea00640 1 -- 172.21.15.37:0/3979685391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39300ab9d0 con 0x7f3940144f00 2024-05-30T06:47:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 -- 172.21.15.37:0/3979685391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3940144f00 msgr2=0x7f39400b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 --2- 172.21.15.37:0/3979685391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3940144f00 0x7f39400b4910 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f394006fdc0 tx=0x7f393001c490 comp rx=0 tx=0).stop 2024-05-30T06:47:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 -- 172.21.15.37:0/3979685391 shutdown_connections 2024-05-30T06:47:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 --2- 172.21.15.37:0/3979685391 >> v2:172.21.15.105:3300/0 conn(0x7f39400cd080 0x7f39400cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 --2- 172.21.15.37:0/3979685391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394006ef30 0x7f394006f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 --2- 172.21.15.37:0/3979685391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3940144f00 0x7f39400b4910 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 -- 172.21.15.37:0/3979685391 >> 172.21.15.37:0/3979685391 conn(0x7f39400b2120 msgr2=0x7f39400b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 -- 172.21.15.37:0/3979685391 shutdown_connections 2024-05-30T06:47:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 -- 172.21.15.37:0/3979685391 wait complete. 2024-05-30T06:47:21.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 Processor -- start 2024-05-30T06:47:21.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 -- start start 2024-05-30T06:47:21.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394006ef30 0x7f39401f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:21.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39400cd080 0x7f394015cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:21.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3940144f00 0x7f394015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:21.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f394015c290 con 0x7f394006ef30 2024-05-30T06:47:21.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39400b4e50 con 0x7f39400cd080 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3945200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f394015c410 con 0x7f3940144f00 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f393f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394006ef30 0x7f39401f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f393f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394006ef30 0x7f39401f5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53554/0 (socket says 172.21.15.37:53554) 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f393f400640 1 -- 172.21.15.37:0/1792302358 learned_addr learned my addr 172.21.15.37:0/1792302358 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f3936a00640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39400cd080 0x7f394015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f393fe00640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3940144f00 0x7f394015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f393f400640 1 -- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3940144f00 msgr2=0x7f394015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f393f400640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3940144f00 0x7f394015d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f393f400640 1 -- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39400cd080 msgr2=0x7f394015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f393f400640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39400cd080 0x7f394015cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f393f400640 1 -- 172.21.15.37:0/1792302358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394015dfe0 con 0x7f394006ef30 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f393fe00640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3940144f00 0x7f394015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.484+0000 7f393f400640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394006ef30 0x7f39401f5020 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f393001cd30 tx=0x7f3930019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.488+0000 7f3937e00640 1 -- 172.21.15.37:0/1792302358 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39300bb070 con 0x7f394006ef30 2024-05-30T06:47:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.488+0000 7f3937e00640 1 -- 172.21.15.37:0/1792302358 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39300b6440 con 0x7f394006ef30 2024-05-30T06:47:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.488+0000 7f3937e00640 1 -- 172.21.15.37:0/1792302358 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39300b0040 con 0x7f394006ef30 2024-05-30T06:47:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.488+0000 7f3945200640 1 -- 172.21.15.37:0/1792302358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f394013dc70 con 0x7f394006ef30 2024-05-30T06:47:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.488+0000 7f3945200640 1 -- 172.21.15.37:0/1792302358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f394013e230 con 0x7f394006ef30 2024-05-30T06:47:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.488+0000 7f3945200640 1 -- 172.21.15.37:0/1792302358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f394015e2c0 con 0x7f394006ef30 2024-05-30T06:47:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.488+0000 7f3937e00640 1 -- 172.21.15.37:0/1792302358 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) ==== 88344+0+0 (secure 0 0 0) 0x7f39300be070 con 0x7f394006ef30 2024-05-30T06:47:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.488+0000 7f3937e00640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f391c068770 0x7f391c06ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.488+0000 7f3937e00640 1 -- 172.21.15.37:0/1792302358 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f3930120b90 con 0x7f394006ef30 2024-05-30T06:47:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.488+0000 7f3936a00640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f391c068770 0x7f391c06ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.492+0000 7f3936a00640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f391c068770 0x7f391c06ac30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3940144680 tx=0x7f3928008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:21.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.496+0000 7f3937e00640 1 -- 172.21.15.37:0/1792302358 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3930016110 con 0x7f394006ef30 2024-05-30T06:47:21.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.696+0000 7f3945200640 1 -- 172.21.15.37:0/1792302358 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f3940068ab0 con 0x7f391c068770 2024-05-30T06:47:21.702 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:21.701+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:21.702 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:21.701+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:21.702 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:21.701+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:21.702 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:21.701+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:21.703 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:21.701+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:21.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.720+0000 7f3937e00640 1 -- 172.21.15.37:0/1792302358 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3940068ab0 con 0x7f391c068770 2024-05-30T06:47:21.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.724+0000 7f3945200640 1 -- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f391c068770 msgr2=0x7f391c06ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:21.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.724+0000 7f3945200640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f391c068770 0x7f391c06ac30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3940144680 tx=0x7f3928008040 comp rx=0 tx=0).stop 2024-05-30T06:47:21.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.724+0000 7f3945200640 1 -- 172.21.15.37:0/1792302358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394006ef30 msgr2=0x7f39401f5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:21.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.724+0000 7f3945200640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394006ef30 0x7f39401f5020 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f393001cd30 tx=0x7f3930019230 comp rx=0 tx=0).stop 2024-05-30T06:47:21.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.724+0000 7f3945200640 1 -- 172.21.15.37:0/1792302358 shutdown_connections 2024-05-30T06:47:21.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.724+0000 7f3945200640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3940144f00 0x7f394015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.724+0000 7f3945200640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f391c068770 0x7f391c06ac30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.724+0000 7f3945200640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39400cd080 0x7f394015cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.724+0000 7f3945200640 1 --2- 172.21.15.37:0/1792302358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394006ef30 0x7f39401f5020 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.724+0000 7f3945200640 1 -- 172.21.15.37:0/1792302358 >> 172.21.15.37:0/1792302358 conn(0x7f39400b2120 msgr2=0x7f394006de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:21.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.724+0000 7f3945200640 1 -- 172.21.15.37:0/1792302358 shutdown_connections 2024-05-30T06:47:21.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.724+0000 7f3945200640 1 -- 172.21.15.37:0/1792302358 wait complete. 2024-05-30T06:47:21.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:47:21.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd40000640 1 Processor -- start 2024-05-30T06:47:21.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd40000640 1 -- start start 2024-05-30T06:47:21.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd40000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd380d1dd0 0x7fdd3809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:21.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd40000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd380d0850 0x7fdd3809afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd40000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd380cea40 con 0x7fdd380ce660 2024-05-30T06:47:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd40000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdd380d0d30 con 0x7fdd380d0850 2024-05-30T06:47:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd40000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdd380d1010 con 0x7fdd380d1dd0 2024-05-30T06:47:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd3d600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdd380ce660 0x7fdd3806d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34878/0 (socket says 172.21.15.37:34878) 2024-05-30T06:47:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd3d600640 1 -- 172.21.15.37:0/357234462 learned_addr learned my addr 172.21.15.37:0/357234462 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:47:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd3e000640 1 --2- 172.21.15.37:0/357234462 >> v2:172.21.15.37:3300/0 conn(0x7fdd380d0850 0x7fdd3809afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd3cc00640 1 --2- 172.21.15.37:0/357234462 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd380d1dd0 0x7fdd3809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd37e00640 1 -- 172.21.15.37:0/357234462 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634973020 0 0) 0x7fdd380cea40 con 0x7fdd380ce660 2024-05-30T06:47:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd37e00640 1 -- 172.21.15.37:0/357234462 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd20003530 con 0x7fdd380ce660 2024-05-30T06:47:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd3e000640 1 -- 172.21.15.37:0/357234462 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd380d1dd0 msgr2=0x7fdd3809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd3e000640 1 --2- 172.21.15.37:0/357234462 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd380d1dd0 0x7fdd3809aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd3e000640 1 -- 172.21.15.37:0/357234462 >> v1:172.21.15.37:6789/0 conn(0x7fdd380ce660 legacy=0x7fdd3806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:21.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.888+0000 7fdd3e000640 1 -- 172.21.15.37:0/357234462 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd380d12f0 con 0x7fdd380d0850 2024-05-30T06:47:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.892+0000 7fdd3e000640 1 --2- 172.21.15.37:0/357234462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd380d0850 0x7fdd3809afa0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009d90 tx=0x7fdd3001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4da479e79eba46 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.892+0000 7fdd37e00640 1 -- 172.21.15.37:0/357234462 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd300b2070 con 0x7fdd380d0850 2024-05-30T06:47:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.892+0000 7fdd37e00640 1 -- 172.21.15.37:0/357234462 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd300a5a00 con 0x7fdd380d0850 2024-05-30T06:47:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.892+0000 7fdd37e00640 1 -- 172.21.15.37:0/357234462 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd300a5db0 con 0x7fdd380d0850 2024-05-30T06:47:21.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.892+0000 7fdd40000640 1 -- 172.21.15.37:0/357234462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd380d0850 msgr2=0x7fdd3809afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:21.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.892+0000 7fdd40000640 1 --2- 172.21.15.37:0/357234462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd380d0850 0x7fdd3809afa0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009d90 tx=0x7fdd3001c940 comp rx=0 tx=0).stop 2024-05-30T06:47:21.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.892+0000 7fdd40000640 1 -- 172.21.15.37:0/357234462 shutdown_connections 2024-05-30T06:47:21.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.892+0000 7fdd40000640 1 --2- 172.21.15.37:0/357234462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd380d0850 0x7fdd3809afa0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.892+0000 7fdd40000640 1 --2- 172.21.15.37:0/357234462 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd380d1dd0 0x7fdd3809aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.892+0000 7fdd40000640 1 -- 172.21.15.37:0/357234462 >> 172.21.15.37:0/357234462 conn(0x7fdd380b4100 msgr2=0x7fdd380b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:21.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.892+0000 7fdd40000640 1 -- 172.21.15.37:0/357234462 shutdown_connections 2024-05-30T06:47:21.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.892+0000 7fdd40000640 1 -- 172.21.15.37:0/357234462 wait complete. 2024-05-30T06:47:21.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd40000640 1 Processor -- start 2024-05-30T06:47:21.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd40000640 1 -- start start 2024-05-30T06:47:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd40000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd380ce660 0x7fdd38153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd40000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd380d0850 0x7fdd380c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd40000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd380d1dd0 0x7fdd38155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd40000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3815ec10 con 0x7fdd380ce660 2024-05-30T06:47:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd40000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3815ea90 con 0x7fdd380d1dd0 2024-05-30T06:47:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd40000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3815ed90 con 0x7fdd380d0850 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd3d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd380ce660 0x7fdd38153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd3d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd380ce660 0x7fdd38153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53570/0 (socket says 172.21.15.37:53570) 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd3d600640 1 -- 172.21.15.37:0/4205270032 learned_addr learned my addr 172.21.15.37:0/4205270032 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd3cc00640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd380d0850 0x7fdd380c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd3e000640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd380d1dd0 0x7fdd38155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd3d600640 1 -- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd380d0850 msgr2=0x7fdd380c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd3d600640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd380d0850 0x7fdd380c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd3d600640 1 -- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd380d1dd0 msgr2=0x7fdd38155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd3d600640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd380d1dd0 0x7fdd38155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd3d600640 1 -- 172.21.15.37:0/4205270032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd380b2890 con 0x7fdd380ce660 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd3d600640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd380ce660 0x7fdd38153750 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c3f0 tx=0x7fdd2c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd35600640 1 -- 172.21.15.37:0/4205270032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c017070 con 0x7fdd380ce660 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd35600640 1 -- 172.21.15.37:0/4205270032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd2c005cf0 con 0x7fdd380ce660 2024-05-30T06:47:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd35600640 1 -- 172.21.15.37:0/4205270032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c0072f0 con 0x7fdd380ce660 2024-05-30T06:47:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd40000640 1 -- 172.21.15.37:0/4205270032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd380b5600 con 0x7fdd380ce660 2024-05-30T06:47:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.896+0000 7fdd40000640 1 -- 172.21.15.37:0/4205270032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd380b5bc0 con 0x7fdd380ce660 2024-05-30T06:47:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.900+0000 7fdd40000640 1 -- 172.21.15.37:0/4205270032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd38068bc0 con 0x7fdd380ce660 2024-05-30T06:47:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.900+0000 7fdd35600640 1 -- 172.21.15.37:0/4205270032 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) ==== 88344+0+0 (secure 0 0 0) 0x7fdd2c01a070 con 0x7fdd380ce660 2024-05-30T06:47:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.900+0000 7fdd35600640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdd18068770 0x7fdd1806ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.900+0000 7fdd35600640 1 -- 172.21.15.37:0/4205270032 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fdd2c0864a0 con 0x7fdd380ce660 2024-05-30T06:47:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.900+0000 7fdd3cc00640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdd18068770 0x7fdd1806ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.900+0000 7fdd3cc00640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdd18068770 0x7fdd1806ac30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdd3815e250 tx=0x7fdd24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:21.904+0000 7fdd35600640 1 -- 172.21.15.37:0/4205270032 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdd2c055e40 con 0x7fdd380ce660 2024-05-30T06:47:22.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.100+0000 7fdd40000640 1 -- 172.21.15.37:0/4205270032 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fdd380b8490 con 0x7fdd18068770 2024-05-30T06:47:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.104+0000 7fdd35600640 1 -- 172.21.15.37:0/4205270032 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fdd380b8490 con 0x7fdd18068770 2024-05-30T06:47:22.108 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69 2024-05-30T06:47:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.108+0000 7fdd40000640 1 -- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdd18068770 msgr2=0x7fdd1806ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.108+0000 7fdd40000640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdd18068770 0x7fdd1806ac30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdd3815e250 tx=0x7fdd24008040 comp rx=0 tx=0).stop 2024-05-30T06:47:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.108+0000 7fdd40000640 1 -- 172.21.15.37:0/4205270032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd380ce660 msgr2=0x7fdd38153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.108+0000 7fdd40000640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd380ce660 0x7fdd38153750 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c3f0 tx=0x7fdd2c00c8b0 comp rx=0 tx=0).stop 2024-05-30T06:47:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.108+0000 7fdd40000640 1 -- 172.21.15.37:0/4205270032 shutdown_connections 2024-05-30T06:47:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.108+0000 7fdd40000640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdd18068770 0x7fdd1806ac30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.108+0000 7fdd40000640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd380d1dd0 0x7fdd38155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.108+0000 7fdd40000640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd380d0850 0x7fdd380c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.108+0000 7fdd40000640 1 --2- 172.21.15.37:0/4205270032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd380ce660 0x7fdd38153750 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.108+0000 7fdd40000640 1 -- 172.21.15.37:0/4205270032 >> 172.21.15.37:0/4205270032 conn(0x7fdd380b4100 msgr2=0x7fdd380b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.108+0000 7fdd40000640 1 -- 172.21.15.37:0/4205270032 shutdown_connections 2024-05-30T06:47:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:22.108+0000 7fdd40000640 1 -- 172.21.15.37:0/4205270032 wait complete. 2024-05-30T06:47:22.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:47:22.129 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69 2024-05-30T06:47:22.130 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:47:22.139 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69 2024-05-30T06:47:22.139 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="10488365056" 2024-05-30T06:47:22.139 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:47:22.140 INFO:tasks.cephfs.test_volumes:r_size = 10488365056 exp_size = 10737418240 2024-05-30T06:47:24.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:47:24.141 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69 2024-05-30T06:47:24.141 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:47:24.152 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69 2024-05-30T06:47:24.152 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="10488365056" 2024-05-30T06:47:24.152 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:47:24.153 INFO:tasks.cephfs.test_volumes:r_size = 10488365056 exp_size = 10737418240 2024-05-30T06:47:26.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:47:26.155 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69 2024-05-30T06:47:26.155 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:47:26.166 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69 2024-05-30T06:47:26.166 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="10488365056" 2024-05-30T06:47:26.166 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:47:26.167 INFO:tasks.cephfs.test_volumes:r_size = 10488365056 exp_size = 10737418240 2024-05-30T06:47:28.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:47:28.168 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69 2024-05-30T06:47:28.168 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:47:28.179 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/3a25eb3f-5a5c-4b1f-ab56-c553bc6cda69 2024-05-30T06:47:28.180 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="10737418240" 2024-05-30T06:47:28.180 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:47:28.180 INFO:tasks.cephfs.test_volumes:r_size = 10737418240 exp_size = 10737418240 2024-05-30T06:47:28.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone71651 2024-05-30T06:47:28.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f390d600640 1 Processor -- start 2024-05-30T06:47:28.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f390d600640 1 -- start start 2024-05-30T06:47:28.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f390d600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f390809acc0 0x7f39080d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:28.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f390d600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39080cd980 con 0x7f390809b0a0 2024-05-30T06:47:28.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f390d600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39080cdc60 con 0x7f390806e290 2024-05-30T06:47:28.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f390d600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39080ce590 con 0x7f390809acc0 2024-05-30T06:47:28.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f38ff400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f390809b0a0 0x7f390806db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44972/0 (socket says 172.21.15.37:44972) 2024-05-30T06:47:28.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f38ff400640 1 -- 172.21.15.37:0/2722577768 learned_addr learned my addr 172.21.15.37:0/2722577768 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:47:28.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f3907e00640 1 --2- 172.21.15.37:0/2722577768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f390809acc0 0x7f39080d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:28.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876181620 0 0) 0x7f39080cd980 con 0x7f390809b0a0 2024-05-30T06:47:28.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38ec003530 con 0x7f390809b0a0 2024-05-30T06:47:28.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 424095443 0 0) 0x7f38ec003530 con 0x7f390809b0a0 2024-05-30T06:47:28.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f390809acc0 msgr2=0x7f39080d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:28.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f3907400640 1 --2- 172.21.15.37:0/2722577768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f390809acc0 0x7f39080d1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 >> v1:172.21.15.105:6789/0 conn(0x7f390806e290 legacy=0x7f390815e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39080cdf40 con 0x7f390809b0a0 2024-05-30T06:47:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f38f0001680 con 0x7f390809b0a0 2024-05-30T06:47:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 >> v1:172.21.15.37:6789/0 conn(0x7f390809b0a0 legacy=0x7f390806db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.380+0000 7f3907400640 1 --2- 172.21.15.37:0/2722577768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0039f0 0x7f38ec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907400640 1 --2- 172.21.15.37:0/2722577768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f390809acc0 0x7f38ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907400640 1 --2- 172.21.15.37:0/2722577768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec004d50 0x7f38ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39080ce590 con 0x7f38ec0039f0 2024-05-30T06:47:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38ec00bb10 con 0x7f38ec004d50 2024-05-30T06:47:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f38ec00bd10 con 0x7f390809acc0 2024-05-30T06:47:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907e00640 1 --2- 172.21.15.37:0/2722577768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0039f0 0x7f38ec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f38ff400640 1 --2- 172.21.15.37:0/2722577768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f390809acc0 0x7f38ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f390cc00640 1 --2- 172.21.15.37:0/2722577768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec004d50 0x7f38ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:28.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907e00640 1 -- 172.21.15.37:0/2722577768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f390809acc0 msgr2=0x7f38ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:28.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907e00640 1 --2- 172.21.15.37:0/2722577768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f390809acc0 0x7f38ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:28.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907e00640 1 -- 172.21.15.37:0/2722577768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec004d50 msgr2=0x7f38ec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:28.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907e00640 1 --2- 172.21.15.37:0/2722577768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38ec004d50 0x7f38ec0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:28.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907e00640 1 -- 172.21.15.37:0/2722577768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec003530 con 0x7f38ec0039f0 2024-05-30T06:47:28.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907e00640 1 --2- 172.21.15.37:0/2722577768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0039f0 0x7f38ec003e10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009f90 tx=0x7f38f801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3311171981c3718d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:28.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80b2070 con 0x7f38ec0039f0 2024-05-30T06:47:28.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f80a5b40 con 0x7f38ec0039f0 2024-05-30T06:47:28.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.384+0000 7f3907400640 1 -- 172.21.15.37:0/2722577768 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8009c10 con 0x7f38ec0039f0 2024-05-30T06:47:28.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 -- 172.21.15.37:0/2722577768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0039f0 msgr2=0x7f38ec003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:28.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 --2- 172.21.15.37:0/2722577768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0039f0 0x7f38ec003e10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f38f8009f90 tx=0x7f38f801cc40 comp rx=0 tx=0).stop 2024-05-30T06:47:28.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390cc00640 1 -- 172.21.15.37:0/2722577768 reap_dead start 2024-05-30T06:47:28.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 -- 172.21.15.37:0/2722577768 shutdown_connections 2024-05-30T06:47:28.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 -- 172.21.15.37:0/2722577768 >> 172.21.15.37:0/2722577768 conn(0x7f39080b3ef0 msgr2=0x7f39080b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:28.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 -- 172.21.15.37:0/2722577768 shutdown_connections 2024-05-30T06:47:28.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 -- 172.21.15.37:0/2722577768 wait complete. 2024-05-30T06:47:28.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 Processor -- start 2024-05-30T06:47:28.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 -- start start 2024-05-30T06:47:28.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0039f0 0x7f390814d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:28.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39080b6e60 0x7f39080b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:28.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39080cb000 0x7f39080cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:28.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39080cea20 con 0x7f38ec0039f0 2024-05-30T06:47:28.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f390806d7c0 con 0x7f39080cb000 2024-05-30T06:47:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390d600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f390814dd80 con 0x7f39080b6e60 2024-05-30T06:47:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f3907e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0039f0 0x7f390814d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f3907e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0039f0 0x7f390814d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36826/0 (socket says 172.21.15.37:36826) 2024-05-30T06:47:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f3907e00640 1 -- 172.21.15.37:0/551032691 learned_addr learned my addr 172.21.15.37:0/551032691 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f38ff400640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39080b6e60 0x7f39080b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f390cc00640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39080cb000 0x7f39080cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f3907e00640 1 -- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39080b6e60 msgr2=0x7f39080b72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f3907e00640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39080b6e60 0x7f39080b72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f3907e00640 1 -- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39080cb000 msgr2=0x7f39080cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f3907e00640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39080cb000 0x7f39080cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f3907e00640 1 -- 172.21.15.37:0/551032691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39080c5fd0 con 0x7f38ec0039f0 2024-05-30T06:47:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.388+0000 7f3907e00640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0039f0 0x7f390814d840 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f38f80b0040 tx=0x7f38f8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.392+0000 7f3904c00640 1 -- 172.21.15.37:0/551032691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80b2040 con 0x7f38ec0039f0 2024-05-30T06:47:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.392+0000 7f3904c00640 1 -- 172.21.15.37:0/551032691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f80bb070 con 0x7f38ec0039f0 2024-05-30T06:47:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.392+0000 7f3904c00640 1 -- 172.21.15.37:0/551032691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f80b6670 con 0x7f38ec0039f0 2024-05-30T06:47:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.392+0000 7f390d600640 1 -- 172.21.15.37:0/551032691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39080cbd30 con 0x7f38ec0039f0 2024-05-30T06:47:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.392+0000 7f390d600640 1 -- 172.21.15.37:0/551032691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39080c6550 con 0x7f38ec0039f0 2024-05-30T06:47:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.392+0000 7f390d600640 1 -- 172.21.15.37:0/551032691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3908068ab0 con 0x7f38ec0039f0 2024-05-30T06:47:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.392+0000 7f3904c00640 1 -- 172.21.15.37:0/551032691 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 88344+0+0 (secure 0 0 0) 0x7f38f80b6810 con 0x7f38ec0039f0 2024-05-30T06:47:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.392+0000 7f3904c00640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f38e40687a0 0x7f38e406ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.392+0000 7f3904c00640 1 -- 172.21.15.37:0/551032691 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f38f81220c0 con 0x7f38ec0039f0 2024-05-30T06:47:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.392+0000 7f38ff400640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f38e40687a0 0x7f38e406ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.396+0000 7f38ff400640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f38e40687a0 0x7f38e406ac60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f38f0001ce0 tx=0x7f38f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:28.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.400+0000 7f3904c00640 1 -- 172.21.15.37:0/551032691 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f38f80c5020 con 0x7f38ec0039f0 2024-05-30T06:47:28.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.600+0000 7f390d600640 1 -- 172.21.15.37:0/551032691 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone71651", "target": ["mon-mgr", ""]}) -- 0x7f39080b35d0 con 0x7f38e40687a0 2024-05-30T06:47:28.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.672+0000 7f3904c00640 1 -- 172.21.15.37:0/551032691 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f39080b35d0 con 0x7f38e40687a0 2024-05-30T06:47:28.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.676+0000 7f390d600640 1 -- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f38e40687a0 msgr2=0x7f38e406ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:28.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.676+0000 7f390d600640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f38e40687a0 0x7f38e406ac60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f38f0001ce0 tx=0x7f38f0009040 comp rx=0 tx=0).stop 2024-05-30T06:47:28.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.676+0000 7f390d600640 1 -- 172.21.15.37:0/551032691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0039f0 msgr2=0x7f390814d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:28.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.676+0000 7f390d600640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0039f0 0x7f390814d840 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f38f80b0040 tx=0x7f38f8009750 comp rx=0 tx=0).stop 2024-05-30T06:47:28.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.676+0000 7f390d600640 1 -- 172.21.15.37:0/551032691 shutdown_connections 2024-05-30T06:47:28.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.676+0000 7f390d600640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f38e40687a0 0x7f38e406ac60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:28.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.676+0000 7f390d600640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39080cb000 0x7f39080cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:28.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.676+0000 7f390d600640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39080b6e60 0x7f39080b72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:28.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.676+0000 7f390d600640 1 --2- 172.21.15.37:0/551032691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38ec0039f0 0x7f390814d840 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:28.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.676+0000 7f390d600640 1 -- 172.21.15.37:0/551032691 >> 172.21.15.37:0/551032691 conn(0x7f39080b3ef0 msgr2=0x7f39080b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:28.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.676+0000 7f390d600640 1 -- 172.21.15.37:0/551032691 shutdown_connections 2024-05-30T06:47:28.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.676+0000 7f390d600640 1 -- 172.21.15.37:0/551032691 wait complete. 2024-05-30T06:47:28.679 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:28.677+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:28.679 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:28.677+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:28.679 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:28.677+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:28.679 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:28.677+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:28.679 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:28.677+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:28.696 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:28.697+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:28.696 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:28.697+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:28.696 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:28.697+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:28.696 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:28.697+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:28.696 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:28.697+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:28.699 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone71652 2024-05-30T06:47:28.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.856+0000 7fa47f200640 1 Processor -- start 2024-05-30T06:47:28.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.856+0000 7fa47f200640 1 -- start start 2024-05-30T06:47:28.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47f200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa48009acc0 0x7fa4800d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:28.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47f200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4800cd980 con 0x7fa48006e290 2024-05-30T06:47:28.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47f200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4800cdc60 con 0x7fa48009b0a0 2024-05-30T06:47:28.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47f200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa4800ce590 con 0x7fa48009acc0 2024-05-30T06:47:28.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47e800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa48006e290 0x7fa48015e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44980/0 (socket says 172.21.15.37:44980) 2024-05-30T06:47:28.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47e800640 1 -- 172.21.15.37:0/2219896974 learned_addr learned my addr 172.21.15.37:0/2219896974 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:47:28.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47de00640 1 --2- 172.21.15.37:0/2219896974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa48009acc0 0x7fa4800d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:28.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47d400640 1 -- 172.21.15.37:0/2219896974 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034727429 0 0) 0x7fa4800cd980 con 0x7fa48006e290 2024-05-30T06:47:28.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47d400640 1 -- 172.21.15.37:0/2219896974 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa464003530 con 0x7fa48006e290 2024-05-30T06:47:28.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47d400640 1 -- 172.21.15.37:0/2219896974 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3330019912 0 0) 0x7fa4800cdc60 con 0x7fa48009b0a0 2024-05-30T06:47:28.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47d400640 1 -- 172.21.15.37:0/2219896974 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4800cd980 con 0x7fa48009b0a0 2024-05-30T06:47:28.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47de00640 1 -- 172.21.15.37:0/2219896974 >> v1:172.21.15.105:6789/0 conn(0x7fa48009b0a0 legacy=0x7fa48006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:28.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47de00640 1 -- 172.21.15.37:0/2219896974 >> v1:172.21.15.37:6789/0 conn(0x7fa48006e290 legacy=0x7fa48015e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:28.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47de00640 1 -- 172.21.15.37:0/2219896974 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4800cdf40 con 0x7fa48009acc0 2024-05-30T06:47:28.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.860+0000 7fa47de00640 1 --2- 172.21.15.37:0/2219896974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa48009acc0 0x7fa4800d1140 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa4700097f0 tx=0x7fa47001ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=564bb8acb1654820 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:28.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47d400640 1 -- 172.21.15.37:0/2219896974 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4700b5070 con 0x7fa48009acc0 2024-05-30T06:47:28.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47d400640 1 -- 172.21.15.37:0/2219896974 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4700a89d0 con 0x7fa48009acc0 2024-05-30T06:47:28.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47d400640 1 -- 172.21.15.37:0/2219896974 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4700a8da0 con 0x7fa48009acc0 2024-05-30T06:47:28.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 -- 172.21.15.37:0/2219896974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa48009acc0 msgr2=0x7fa4800d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:28.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 --2- 172.21.15.37:0/2219896974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa48009acc0 0x7fa4800d1140 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa4700097f0 tx=0x7fa47001ecd0 comp rx=0 tx=0).stop 2024-05-30T06:47:28.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 -- 172.21.15.37:0/2219896974 shutdown_connections 2024-05-30T06:47:28.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 --2- 172.21.15.37:0/2219896974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa48009acc0 0x7fa4800d1140 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:28.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 -- 172.21.15.37:0/2219896974 >> 172.21.15.37:0/2219896974 conn(0x7fa4800b3ef0 msgr2=0x7fa4800b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:28.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 -- 172.21.15.37:0/2219896974 shutdown_connections 2024-05-30T06:47:28.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 -- 172.21.15.37:0/2219896974 wait complete. 2024-05-30T06:47:28.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 Processor -- start 2024-05-30T06:47:28.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 -- start start 2024-05-30T06:47:28.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48006e290 0x7fa48009c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:28.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa48009acc0 0x7fa48014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:28.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa48009b0a0 0x7fa4800c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:28.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa4800cea20 con 0x7fa48006e290 2024-05-30T06:47:28.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa48006d7c0 con 0x7fa48009acc0 2024-05-30T06:47:28.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47f200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa4801503b0 con 0x7fa48009b0a0 2024-05-30T06:47:28.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48006e290 0x7fa48009c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:28.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48006e290 0x7fa48009c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36828/0 (socket says 172.21.15.37:36828) 2024-05-30T06:47:28.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47de00640 1 -- 172.21.15.37:0/2225641835 learned_addr learned my addr 172.21.15.37:0/2225641835 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:28.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa47e800640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa48009b0a0 0x7fa4800c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:28.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.864+0000 7fa477e00640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa48009acc0 0x7fa48014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:28.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa47de00640 1 -- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa48009b0a0 msgr2=0x7fa4800c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:28.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa47de00640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa48009b0a0 0x7fa4800c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:28.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa47de00640 1 -- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa48009acc0 msgr2=0x7fa48014ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:28.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa47de00640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa48009acc0 0x7fa48014ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:28.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa47de00640 1 -- 172.21.15.37:0/2225641835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48015ed10 con 0x7fa48006e290 2024-05-30T06:47:28.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa47de00640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48006e290 0x7fa48009c250 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa47001b8e0 tx=0x7fa47001ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:28.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa476000640 1 -- 172.21.15.37:0/2225641835 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4700bf070 con 0x7fa48006e290 2024-05-30T06:47:28.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa476000640 1 -- 172.21.15.37:0/2225641835 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4700b0720 con 0x7fa48006e290 2024-05-30T06:47:28.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa476000640 1 -- 172.21.15.37:0/2225641835 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4700b5040 con 0x7fa48006e290 2024-05-30T06:47:28.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa47f200640 1 -- 172.21.15.37:0/2225641835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48014fac0 con 0x7fa48006e290 2024-05-30T06:47:28.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa47f200640 1 -- 172.21.15.37:0/2225641835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa48014fd60 con 0x7fa48006e290 2024-05-30T06:47:28.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa47f200640 1 -- 172.21.15.37:0/2225641835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa480068ab0 con 0x7fa48006e290 2024-05-30T06:47:28.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa476000640 1 -- 172.21.15.37:0/2225641835 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 14) ==== 88446+0+0 (secure 0 0 0) 0x7fa4700b0b10 con 0x7fa48006e290 2024-05-30T06:47:28.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.868+0000 7fa476000640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa45c068890 0x7fa45c06ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:28.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.872+0000 7fa476000640 1 -- 172.21.15.37:0/2225641835 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fa470123ae0 con 0x7fa48006e290 2024-05-30T06:47:28.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.872+0000 7fa477e00640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa45c068890 0x7fa45c06ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:28.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.872+0000 7fa477e00640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa45c068890 0x7fa45c06ad50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa48015e990 tx=0x7fa468009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:28.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:28.876+0000 7fa476000640 1 -- 172.21.15.37:0/2225641835 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa48015ed10 con 0x7fa48006e290 2024-05-30T06:47:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.072+0000 7fa47f200640 1 -- 172.21.15.37:0/2225641835 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone71652", "target": ["mon-mgr", ""]}) -- 0x7fa4800b4c50 con 0x7fa45c068890 2024-05-30T06:47:29.680 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:29.681+0000 7f002e600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:29.680 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:29.681+0000 7f002e600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:29.680 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:29.681+0000 7f002e600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:29.680 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:29.681+0000 7f002e600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:29.680 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:29.681+0000 7f002e600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:29.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.828+0000 7fa476000640 1 -- 172.21.15.37:0/2225641835 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa4800b4c50 con 0x7fa45c068890 2024-05-30T06:47:29.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.832+0000 7fa47f200640 1 -- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa45c068890 msgr2=0x7fa45c06ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:29.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.832+0000 7fa47f200640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa45c068890 0x7fa45c06ad50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa48015e990 tx=0x7fa468009040 comp rx=0 tx=0).stop 2024-05-30T06:47:29.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.832+0000 7fa47f200640 1 -- 172.21.15.37:0/2225641835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48006e290 msgr2=0x7fa48009c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:29.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.832+0000 7fa47f200640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48006e290 0x7fa48009c250 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa47001b8e0 tx=0x7fa47001ba70 comp rx=0 tx=0).stop 2024-05-30T06:47:29.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.832+0000 7fa47f200640 1 -- 172.21.15.37:0/2225641835 shutdown_connections 2024-05-30T06:47:29.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.832+0000 7fa47f200640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa48009b0a0 0x7fa4800c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:29.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.832+0000 7fa47f200640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa45c068890 0x7fa45c06ad50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:29.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.832+0000 7fa47f200640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa48009acc0 0x7fa48014ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:29.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.832+0000 7fa47f200640 1 --2- 172.21.15.37:0/2225641835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa48006e290 0x7fa48009c250 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:29.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.832+0000 7fa47f200640 1 -- 172.21.15.37:0/2225641835 >> 172.21.15.37:0/2225641835 conn(0x7fa4800b3ef0 msgr2=0x7fa4800b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:29.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.836+0000 7fa47f200640 1 -- 172.21.15.37:0/2225641835 shutdown_connections 2024-05-30T06:47:29.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:29.836+0000 7fa47f200640 1 -- 172.21.15.37:0/2225641835 wait complete. 2024-05-30T06:47:29.842 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:29.841+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:29.843 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:29.841+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:29.843 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:29.841+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:29.843 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:29.841+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:29.843 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:29.841+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:29.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone71653 2024-05-30T06:47:30.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2fb800640 1 Processor -- start 2024-05-30T06:47:30.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2fb800640 1 -- start start 2024-05-30T06:47:30.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2fb800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2f4162e70 0x7ff2f40cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:30.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2fb800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff2f40ce7d0 0x7ff2f40cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:30.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2fb800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f4164190 con 0x7ff2f4163250 2024-05-30T06:47:30.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2fb800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f406f8e0 con 0x7ff2f4162e70 2024-05-30T06:47:30.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2fb800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f406ecd0 con 0x7ff2f40ce7d0 2024-05-30T06:47:30.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2f8e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2f4162e70 0x7ff2f40cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:30.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2f3e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff2f4163250 0x7ff2f41636d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44990/0 (socket says 172.21.15.37:44990) 2024-05-30T06:47:30.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2f3e00640 1 -- 172.21.15.37:0/3991005780 learned_addr learned my addr 172.21.15.37:0/3991005780 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:47:30.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2f8e00640 1 -- 172.21.15.37:0/3991005780 >> v2:172.21.15.105:3300/0 conn(0x7ff2f40ce7d0 msgr2=0x7ff2f40cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:30.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2f8e00640 1 --2- 172.21.15.37:0/3991005780 >> v2:172.21.15.105:3300/0 conn(0x7ff2f40ce7d0 0x7ff2f40cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:30.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2f8e00640 1 -- 172.21.15.37:0/3991005780 >> v1:172.21.15.37:6789/0 conn(0x7ff2f4163250 legacy=0x7ff2f41636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:30.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2f8e00640 1 -- 172.21.15.37:0/3991005780 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f406efb0 con 0x7ff2f4162e70 2024-05-30T06:47:30.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.108+0000 7ff2f3400640 1 -- 172.21.15.37:0/3991005780 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3238827660 0 0) 0x7ff2f4164190 con 0x7ff2f4163250 2024-05-30T06:47:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.112+0000 7ff2f8e00640 1 --2- 172.21.15.37:0/3991005780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2f4162e70 0x7ff2f40cc8b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40b02e0 tx=0x7ff2e801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e905625b1da443 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.112+0000 7ff2f3400640 1 -- 172.21.15.37:0/3991005780 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e80b1070 con 0x7ff2f4162e70 2024-05-30T06:47:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.112+0000 7ff2f3400640 1 -- 172.21.15.37:0/3991005780 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e80ac620 con 0x7ff2f4162e70 2024-05-30T06:47:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.112+0000 7ff2f3400640 1 -- 172.21.15.37:0/3991005780 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e80ac9f0 con 0x7ff2f4162e70 2024-05-30T06:47:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.112+0000 7ff2fb800640 1 -- 172.21.15.37:0/3991005780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2f4162e70 msgr2=0x7ff2f40cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.112+0000 7ff2fb800640 1 --2- 172.21.15.37:0/3991005780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2f4162e70 0x7ff2f40cc8b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff2f40b02e0 tx=0x7ff2e801c3c0 comp rx=0 tx=0).stop 2024-05-30T06:47:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 -- 172.21.15.37:0/3991005780 shutdown_connections 2024-05-30T06:47:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 --2- 172.21.15.37:0/3991005780 >> v2:172.21.15.105:3300/0 conn(0x7ff2f40ce7d0 0x7ff2f40cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 --2- 172.21.15.37:0/3991005780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2f4162e70 0x7ff2f40cc8b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 -- 172.21.15.37:0/3991005780 >> 172.21.15.37:0/3991005780 conn(0x7ff2f406bf60 msgr2=0x7ff2f40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 -- 172.21.15.37:0/3991005780 shutdown_connections 2024-05-30T06:47:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 -- 172.21.15.37:0/3991005780 wait complete. 2024-05-30T06:47:30.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 Processor -- start 2024-05-30T06:47:30.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 -- start start 2024-05-30T06:47:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2f40ce7d0 0x7ff2f414e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2f4162e70 0x7ff2f4140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2f4163250 0x7ff2f4156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f40ccf70 con 0x7ff2f4163250 2024-05-30T06:47:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f40ccdf0 con 0x7ff2f4162e70 2024-05-30T06:47:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2fb800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f416fc40 con 0x7ff2f40ce7d0 2024-05-30T06:47:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2f9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2f4163250 0x7ff2f4156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2f9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2f4163250 0x7ff2f4156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36850/0 (socket says 172.21.15.37:36850) 2024-05-30T06:47:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2f9800640 1 -- 172.21.15.37:0/2077650399 learned_addr learned my addr 172.21.15.37:0/2077650399 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2f3e00640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2f4162e70 0x7ff2f4140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:30.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2f8e00640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2f40ce7d0 0x7ff2f414e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:30.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2f9800640 1 -- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2f40ce7d0 msgr2=0x7ff2f414e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:30.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2f9800640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2f40ce7d0 0x7ff2f414e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:30.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2f9800640 1 -- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2f4162e70 msgr2=0x7ff2f4140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:30.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2f9800640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2f4162e70 0x7ff2f4140800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:30.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2f9800640 1 -- 172.21.15.37:0/2077650399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f4140d40 con 0x7ff2f4163250 2024-05-30T06:47:30.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.116+0000 7ff2f3e00640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2f4162e70 0x7ff2f4140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:47:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.120+0000 7ff2f9800640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2f4163250 0x7ff2f4156d50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00b9a0 tx=0x7ff2ec00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.120+0000 7ff2f0c00640 1 -- 172.21.15.37:0/2077650399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec019070 con 0x7ff2f4163250 2024-05-30T06:47:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.120+0000 7ff2f0c00640 1 -- 172.21.15.37:0/2077650399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2ec00cbc0 con 0x7ff2f4163250 2024-05-30T06:47:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.120+0000 7ff2fb800640 1 -- 172.21.15.37:0/2077650399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f414f070 con 0x7ff2f4163250 2024-05-30T06:47:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.120+0000 7ff2f0c00640 1 -- 172.21.15.37:0/2077650399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec014440 con 0x7ff2f4163250 2024-05-30T06:47:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.120+0000 7ff2fb800640 1 -- 172.21.15.37:0/2077650399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f414f630 con 0x7ff2f4163250 2024-05-30T06:47:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.120+0000 7ff2fb800640 1 -- 172.21.15.37:0/2077650399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2f4068bc0 con 0x7ff2f4163250 2024-05-30T06:47:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.120+0000 7ff2f0c00640 1 -- 172.21.15.37:0/2077650399 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 14) ==== 88446+0+0 (secure 0 0 0) 0x7ff2ec01c070 con 0x7ff2f4163250 2024-05-30T06:47:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.120+0000 7ff2f0c00640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff2d4068890 0x7ff2d406ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:30.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.120+0000 7ff2f0c00640 1 -- 172.21.15.37:0/2077650399 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7ff2ec0870a0 con 0x7ff2f4163250 2024-05-30T06:47:30.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.128+0000 7ff2f0c00640 1 -- 172.21.15.37:0/2077650399 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff2ec056e50 con 0x7ff2f4163250 2024-05-30T06:47:30.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.128+0000 7ff2f8e00640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff2d4068890 0x7ff2d406ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:30.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.128+0000 7ff2f8e00640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff2d4068890 0x7ff2d406ad50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80ae000 tx=0x7ff2e80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:30.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.440+0000 7ff2fb800640 1 -- 172.21.15.37:0/2077650399 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone71653", "target": ["mon-mgr", ""]}) -- 0x7ff2f416da10 con 0x7ff2d4068890 2024-05-30T06:47:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:30.892+0000 7ff2f0c00640 1 -- 172.21.15.37:0/2077650399 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 15) ==== 88548+0+0 (secure 0 0 0) 0x7ff2ec052dc0 con 0x7ff2f4163250 2024-05-30T06:47:31.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.240+0000 7ff2f0c00640 1 -- 172.21.15.37:0/2077650399 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff2f416da10 con 0x7ff2d4068890 2024-05-30T06:47:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.244+0000 7ff2fb800640 1 -- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff2d4068890 msgr2=0x7ff2d406ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.244+0000 7ff2fb800640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff2d4068890 0x7ff2d406ad50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80ae000 tx=0x7ff2e80a7000 comp rx=0 tx=0).stop 2024-05-30T06:47:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.244+0000 7ff2fb800640 1 -- 172.21.15.37:0/2077650399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2f4163250 msgr2=0x7ff2f4156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.244+0000 7ff2fb800640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2f4163250 0x7ff2f4156d50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec00b9a0 tx=0x7ff2ec00be60 comp rx=0 tx=0).stop 2024-05-30T06:47:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.244+0000 7ff2fb800640 1 -- 172.21.15.37:0/2077650399 shutdown_connections 2024-05-30T06:47:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.244+0000 7ff2fb800640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2f4163250 0x7ff2f4156d50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.244+0000 7ff2fb800640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff2d4068890 0x7ff2d406ad50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.244+0000 7ff2fb800640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2f4162e70 0x7ff2f4140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.244+0000 7ff2fb800640 1 --2- 172.21.15.37:0/2077650399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2f40ce7d0 0x7ff2f414e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.244+0000 7ff2fb800640 1 -- 172.21.15.37:0/2077650399 >> 172.21.15.37:0/2077650399 conn(0x7ff2f406bf60 msgr2=0x7ff2f40b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.244+0000 7ff2fb800640 1 -- 172.21.15.37:0/2077650399 shutdown_connections 2024-05-30T06:47:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.244+0000 7ff2fb800640 1 -- 172.21.15.37:0/2077650399 wait complete. 2024-05-30T06:47:31.294 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:31.289+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:31.294 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:31.289+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:31.294 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:31.289+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:31.294 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:31.289+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:31.294 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:31.289+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:31.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone71654 2024-05-30T06:47:31.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.536+0000 7fcaab000640 1 Processor -- start 2024-05-30T06:47:31.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.536+0000 7fcaab000640 1 -- start start 2024-05-30T06:47:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.536+0000 7fcaab000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcaa4167150 0x7fcaa4169540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.536+0000 7fcaab000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa40b4c40 con 0x7fcaa4161e30 2024-05-30T06:47:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.536+0000 7fcaab000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa40b4f20 con 0x7fcaa4163640 2024-05-30T06:47:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.536+0000 7fcaab000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcaa40b58c0 con 0x7fcaa4167150 2024-05-30T06:47:31.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.536+0000 7fcaa9c00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcaa4161e30 0x7fcaa40d4dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45002/0 (socket says 172.21.15.37:45002) 2024-05-30T06:47:31.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.536+0000 7fcaa9c00640 1 -- 172.21.15.37:0/3235433320 learned_addr learned my addr 172.21.15.37:0/3235433320 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:47:31.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1476219997 0 0) 0x7fcaa40b4c40 con 0x7fcaa4161e30 2024-05-30T06:47:31.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca8c003530 con 0x7fcaa4161e30 2024-05-30T06:47:31.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1253767698 0 0) 0x7fca8c003530 con 0x7fcaa4161e30 2024-05-30T06:47:31.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 >> v2:172.21.15.105:3300/0 conn(0x7fcaa4167150 msgr2=0x7fcaa4169540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 --2- 172.21.15.37:0/3235433320 >> v2:172.21.15.105:3300/0 conn(0x7fcaa4167150 0x7fcaa4169540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 >> v1:172.21.15.105:6789/0 conn(0x7fcaa4163640 legacy=0x7fcaa4165a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa40b5200 con 0x7fcaa4161e30 2024-05-30T06:47:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fca98001680 con 0x7fcaa4161e30 2024-05-30T06:47:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 >> v1:172.21.15.37:6789/0 conn(0x7fcaa4161e30 legacy=0x7fcaa40d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 --2- 172.21.15.37:0/3235433320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca8c003a10 0x7fca8c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 --2- 172.21.15.37:0/3235433320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca8c004810 0x7fca8c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 --2- 172.21.15.37:0/3235433320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca8c0052f0 0x7fca8c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c00c210 con 0x7fca8c003a10 2024-05-30T06:47:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca8c00c3c0 con 0x7fca8c0052f0 2024-05-30T06:47:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fca8c00c5c0 con 0x7fca8c004810 2024-05-30T06:47:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa9c00640 1 --2- 172.21.15.37:0/3235433320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca8c003a10 0x7fca8c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaaa600640 1 --2- 172.21.15.37:0/3235433320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca8c0052f0 0x7fca8c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa9200640 1 --2- 172.21.15.37:0/3235433320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca8c004810 0x7fca8c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa9200640 1 -- 172.21.15.37:0/3235433320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca8c0052f0 msgr2=0x7fca8c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa9200640 1 --2- 172.21.15.37:0/3235433320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca8c0052f0 0x7fca8c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa9200640 1 -- 172.21.15.37:0/3235433320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca8c003a10 msgr2=0x7fca8c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa9200640 1 --2- 172.21.15.37:0/3235433320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca8c003a10 0x7fca8c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.540+0000 7fcaa9200640 1 -- 172.21.15.37:0/3235433320 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca8c003530 con 0x7fca8c004810 2024-05-30T06:47:31.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.544+0000 7fcaaa600640 1 -- 172.21.15.37:0/3235433320 reap_dead start 2024-05-30T06:47:31.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.552+0000 7fcaa9200640 1 --2- 172.21.15.37:0/3235433320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca8c004810 0x7fca8c004c90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca90007fd0 tx=0x7fca9001c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78d0492e01a97577 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.552+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90001250 con 0x7fca8c004810 2024-05-30T06:47:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.552+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca900a8020 con 0x7fca8c004810 2024-05-30T06:47:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.552+0000 7fcaa3e00640 1 -- 172.21.15.37:0/3235433320 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca900050d0 con 0x7fca8c004810 2024-05-30T06:47:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.552+0000 7fcaab000640 1 -- 172.21.15.37:0/3235433320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca8c004810 msgr2=0x7fca8c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.552+0000 7fcaab000640 1 --2- 172.21.15.37:0/3235433320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca8c004810 0x7fca8c004c90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca90007fd0 tx=0x7fca9001c2a0 comp rx=0 tx=0).stop 2024-05-30T06:47:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.552+0000 7fcaab000640 1 -- 172.21.15.37:0/3235433320 shutdown_connections 2024-05-30T06:47:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.552+0000 7fcaab000640 1 --2- 172.21.15.37:0/3235433320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca8c004810 0x7fca8c004c90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.552+0000 7fcaab000640 1 -- 172.21.15.37:0/3235433320 >> 172.21.15.37:0/3235433320 conn(0x7fcaa408bff0 msgr2=0x7fcaa40d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.556+0000 7fcaab000640 1 -- 172.21.15.37:0/3235433320 shutdown_connections 2024-05-30T06:47:31.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.556+0000 7fcaab000640 1 -- 172.21.15.37:0/3235433320 wait complete. 2024-05-30T06:47:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.556+0000 7fcaab000640 1 Processor -- start 2024-05-30T06:47:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.556+0000 7fcaab000640 1 -- start start 2024-05-30T06:47:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaab000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca8c004810 0x7fcaa415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:31.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaab000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaa4156fb0 0x7fcaa4156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaab000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa41556c0 0x7fcaa4155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaab000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa40b1690 con 0x7fcaa41556c0 2024-05-30T06:47:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaab000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa40b1510 con 0x7fca8c004810 2024-05-30T06:47:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaab000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa40b1810 con 0x7fcaa4156fb0 2024-05-30T06:47:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaa9c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca8c004810 0x7fcaa415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaa9c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca8c004810 0x7fcaa415b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:36178/0 (socket says 172.21.15.37:36178) 2024-05-30T06:47:31.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaa9c00640 1 -- 172.21.15.37:0/2526997166 learned_addr learned my addr 172.21.15.37:0/2526997166 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:31.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaaa600640 1 --2- 172.21.15.37:0/2526997166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa41556c0 0x7fcaa4155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:31.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaa9c00640 1 -- 172.21.15.37:0/2526997166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaa4156fb0 msgr2=0x7fcaa4156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:31.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaa9c00640 1 --2- 172.21.15.37:0/2526997166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaa4156fb0 0x7fcaa4156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:31.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaa9c00640 1 -- 172.21.15.37:0/2526997166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa41556c0 msgr2=0x7fcaa4155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:31.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaa9c00640 1 --2- 172.21.15.37:0/2526997166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa41556c0 0x7fcaa4155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:31.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.560+0000 7fcaa9c00640 1 -- 172.21.15.37:0/2526997166 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa4167e10 con 0x7fca8c004810 2024-05-30T06:47:31.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.564+0000 7fcaa9c00640 1 --2- 172.21.15.37:0/2526997166 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca8c004810 0x7fcaa415b9a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fca980072a0 tx=0x7fca98007760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:31.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.564+0000 7fcaa1600640 1 -- 172.21.15.37:0/2526997166 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98018070 con 0x7fca8c004810 2024-05-30T06:47:31.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.564+0000 7fcaa1600640 1 -- 172.21.15.37:0/2526997166 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca98006520 con 0x7fca8c004810 2024-05-30T06:47:31.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.564+0000 7fcaab000640 1 -- 172.21.15.37:0/2526997166 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa415c660 con 0x7fca8c004810 2024-05-30T06:47:31.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.564+0000 7fcaa1600640 1 -- 172.21.15.37:0/2526997166 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98001680 con 0x7fca8c004810 2024-05-30T06:47:31.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.564+0000 7fcaab000640 1 -- 172.21.15.37:0/2526997166 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa415c0a0 con 0x7fca8c004810 2024-05-30T06:47:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.564+0000 7fcaab000640 1 -- 172.21.15.37:0/2526997166 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa4068ab0 con 0x7fca8c004810 2024-05-30T06:47:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.568+0000 7fcaa1600640 1 -- 172.21.15.37:0/2526997166 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 15) ==== 88548+0+0 (secure 0 0 0) 0x7fca98011070 con 0x7fca8c004810 2024-05-30T06:47:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.568+0000 7fcaa1600640 1 --2- 172.21.15.37:0/2526997166 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fca84068a30 0x7fca8406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.572+0000 7fcaa1600640 1 -- 172.21.15.37:0/2526997166 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fca98087680 con 0x7fca8c004810 2024-05-30T06:47:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.572+0000 7fcaa9200640 1 --2- 172.21.15.37:0/2526997166 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fca84068a30 0x7fca8406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.572+0000 7fcaa9200640 1 --2- 172.21.15.37:0/2526997166 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fca84068a30 0x7fca8406aef0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fca900a9000 tx=0x7fca90000fc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.576+0000 7fcaa1600640 1 -- 172.21.15.37:0/2526997166 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fca98057450 con 0x7fca8c004810 2024-05-30T06:47:31.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:31.956+0000 7fcaab000640 1 -- 172.21.15.37:0/2526997166 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone71654", "target": ["mon-mgr", ""]}) -- 0x7fcaa4166f10 con 0x7fca84068a30 2024-05-30T06:47:32.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:32.960+0000 7fcaa1600640 1 -- 172.21.15.37:0/2526997166 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7fca980533c0 con 0x7fca8c004810 2024-05-30T06:47:33.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.036+0000 7fcaa1600640 1 -- 172.21.15.37:0/2526997166 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcaa4166f10 con 0x7fca84068a30 2024-05-30T06:47:33.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.044+0000 7fcaab000640 1 -- 172.21.15.37:0/2526997166 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fca84068a30 msgr2=0x7fca8406aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:33.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.044+0000 7fcaab000640 1 --2- 172.21.15.37:0/2526997166 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fca84068a30 0x7fca8406aef0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fca900a9000 tx=0x7fca90000fc0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.044+0000 7fcaab000640 1 -- 172.21.15.37:0/2526997166 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca8c004810 msgr2=0x7fcaa415b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:33.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.044+0000 7fcaab000640 1 --2- 172.21.15.37:0/2526997166 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca8c004810 0x7fcaa415b9a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fca980072a0 tx=0x7fca98007760 comp rx=0 tx=0).stop 2024-05-30T06:47:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.044+0000 7fcaab000640 1 -- 172.21.15.37:0/2526997166 shutdown_connections 2024-05-30T06:47:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.044+0000 7fcaab000640 1 --2- 172.21.15.37:0/2526997166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaa41556c0 0x7fcaa4155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.044+0000 7fcaab000640 1 --2- 172.21.15.37:0/2526997166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaa4156fb0 0x7fcaa4156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.044+0000 7fcaab000640 1 --2- 172.21.15.37:0/2526997166 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fca84068a30 0x7fca8406aef0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.044+0000 7fcaab000640 1 --2- 172.21.15.37:0/2526997166 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca8c004810 0x7fcaa415b9a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.044+0000 7fcaab000640 1 -- 172.21.15.37:0/2526997166 >> 172.21.15.37:0/2526997166 conn(0x7fcaa408bff0 msgr2=0x7fcaa40b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:33.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.052+0000 7fcaab000640 1 -- 172.21.15.37:0/2526997166 shutdown_connections 2024-05-30T06:47:33.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.052+0000 7fcaab000640 1 -- 172.21.15.37:0/2526997166 wait complete. 2024-05-30T06:47:33.107 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:47:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.388+0000 7f4b48a00640 1 Processor -- start 2024-05-30T06:47:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.388+0000 7f4b48a00640 1 -- start start 2024-05-30T06:47:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.392+0000 7f4b48a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44072510 0x7f4b4406deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.392+0000 7f4b48a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b4406ec50 con 0x7f4b4406e3f0 2024-05-30T06:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.392+0000 7f4b48a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b441635a0 con 0x7f4b44160860 2024-05-30T06:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.392+0000 7f4b48a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4b44163bf0 con 0x7f4b44072510 2024-05-30T06:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.392+0000 7f4b42a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44072510 0x7f4b4406deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.392+0000 7f4b42a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44072510 0x7f4b4406deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:38294/0 (socket says 172.21.15.37:38294) 2024-05-30T06:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.392+0000 7f4b42a00640 1 -- 172.21.15.37:0/1962164648 learned_addr learned my addr 172.21.15.37:0/1962164648 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.392+0000 7f4b42a00640 1 -- 172.21.15.37:0/1962164648 >> v1:172.21.15.105:6789/0 conn(0x7f4b44160860 legacy=0x7f4b44071e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T06:47:33.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.392+0000 7f4b42a00640 1 -- 172.21.15.37:0/1962164648 >> v1:172.21.15.37:6789/0 conn(0x7f4b4406e3f0 legacy=0x7f4b44166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:33.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.392+0000 7f4b42a00640 1 -- 172.21.15.37:0/1962164648 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b44163880 con 0x7f4b44072510 2024-05-30T06:47:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.400+0000 7f4b42a00640 1 --2- 172.21.15.37:0/1962164648 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44072510 0x7f4b4406deb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4b300098a0 tx=0x7f4b3001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eec0fbe744b3cccf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:33.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.400+0000 7f4b42000640 1 -- 172.21.15.37:0/1962164648 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b300ab660 con 0x7f4b44072510 2024-05-30T06:47:33.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.400+0000 7f4b42000640 1 -- 172.21.15.37:0/1962164648 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b300b0070 con 0x7f4b44072510 2024-05-30T06:47:33.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.400+0000 7f4b42000640 1 -- 172.21.15.37:0/1962164648 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b300aba20 con 0x7f4b44072510 2024-05-30T06:47:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.404+0000 7f4b48a00640 1 -- 172.21.15.37:0/1962164648 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44072510 msgr2=0x7f4b4406deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.404+0000 7f4b48a00640 1 --2- 172.21.15.37:0/1962164648 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44072510 0x7f4b4406deb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4b300098a0 tx=0x7f4b3001c4c0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.404+0000 7f4b48a00640 1 -- 172.21.15.37:0/1962164648 shutdown_connections 2024-05-30T06:47:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.404+0000 7f4b48a00640 1 --2- 172.21.15.37:0/1962164648 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44072510 0x7f4b4406deb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.404+0000 7f4b48a00640 1 -- 172.21.15.37:0/1962164648 >> 172.21.15.37:0/1962164648 conn(0x7f4b440b2120 msgr2=0x7f4b440b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.404+0000 7f4b48a00640 1 -- 172.21.15.37:0/1962164648 shutdown_connections 2024-05-30T06:47:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.404+0000 7f4b48a00640 1 -- 172.21.15.37:0/1962164648 wait complete. 2024-05-30T06:47:33.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.408+0000 7f4b48a00640 1 Processor -- start 2024-05-30T06:47:33.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.408+0000 7f4b48a00640 1 -- start start 2024-05-30T06:47:33.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.408+0000 7f4b48a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b4406e3f0 0x7f4b4414b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:33.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.408+0000 7f4b48a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b44072510 0x7f4b44161ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:33.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.408+0000 7f4b48a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44160860 0x7f4b44162420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:33.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.408+0000 7f4b48a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b44164200 con 0x7f4b44072510 2024-05-30T06:47:33.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.408+0000 7f4b48a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4b44164080 con 0x7f4b4406e3f0 2024-05-30T06:47:33.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.408+0000 7f4b48a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4b44170c10 con 0x7f4b44160860 2024-05-30T06:47:33.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b43e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44160860 0x7f4b44162420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:33.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b43e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44160860 0x7f4b44162420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:38306/0 (socket says 172.21.15.37:38306) 2024-05-30T06:47:33.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b43e00640 1 -- 172.21.15.37:0/3308270105 learned_addr learned my addr 172.21.15.37:0/3308270105 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:33.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b42a00640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b44072510 0x7f4b44161ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:33.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b43400640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b4406e3f0 0x7f4b4414b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:33.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b42a00640 1 -- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44160860 msgr2=0x7f4b44162420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:33.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b42a00640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44160860 0x7f4b44162420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b42a00640 1 -- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b4406e3f0 msgr2=0x7f4b4414b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:33.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b42a00640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b4406e3f0 0x7f4b4414b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b42a00640 1 -- 172.21.15.37:0/3308270105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b441fc0d0 con 0x7f4b44072510 2024-05-30T06:47:33.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b43e00640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44160860 0x7f4b44162420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:47:33.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b43400640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b4406e3f0 0x7f4b4414b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:47:33.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b42a00640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b44072510 0x7f4b44161ee0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4b44073530 tx=0x7f4b3001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:33.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b3b400640 1 -- 172.21.15.37:0/3308270105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b300b4800 con 0x7f4b44072510 2024-05-30T06:47:33.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b3b400640 1 -- 172.21.15.37:0/3308270105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b300b49a0 con 0x7f4b44072510 2024-05-30T06:47:33.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b3b400640 1 -- 172.21.15.37:0/3308270105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b300b4dd0 con 0x7f4b44072510 2024-05-30T06:47:33.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b48a00640 1 -- 172.21.15.37:0/3308270105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b44151ee0 con 0x7f4b44072510 2024-05-30T06:47:33.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.412+0000 7f4b48a00640 1 -- 172.21.15.37:0/3308270105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b441524a0 con 0x7f4b44072510 2024-05-30T06:47:33.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.416+0000 7f4b48a00640 1 -- 172.21.15.37:0/3308270105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b44068ab0 con 0x7f4b44072510 2024-05-30T06:47:33.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.416+0000 7f4b3b400640 1 -- 172.21.15.37:0/3308270105 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7f4b300c7430 con 0x7f4b44072510 2024-05-30T06:47:33.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.420+0000 7f4b3b400640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b24068a70 0x7f4b2406af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:33.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.420+0000 7f4b3b400640 1 -- 172.21.15.37:0/3308270105 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f4b30121fb0 con 0x7f4b44072510 2024-05-30T06:47:33.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.424+0000 7f4b43400640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b24068a70 0x7f4b2406af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:33.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.428+0000 7f4b3b400640 1 -- 172.21.15.37:0/3308270105 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4b3014ee70 con 0x7f4b44072510 2024-05-30T06:47:33.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.428+0000 7f4b43400640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b24068a70 0x7f4b2406af30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c007e90 tx=0x7f4b3c0073a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:33.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.824+0000 7f4b48a00640 1 -- 172.21.15.37:0/3308270105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4b44072ff0 con 0x7f4b44072510 2024-05-30T06:47:33.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.824+0000 7f4b3b400640 1 -- 172.21.15.37:0/3308270105 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2132 (secure 0 0 0) 0x7f4b44072ff0 con 0x7f4b44072510 2024-05-30T06:47:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:47:33.827 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:47:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:47:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:47:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:47:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:47:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:47:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:47:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:47:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:47:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:47:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:47:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:47:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:47:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:47:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:47:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 348, 2024-05-30T06:47:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:47:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:47:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:47:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:47:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:47:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 48, 2024-05-30T06:47:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:47:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:47:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:47:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:47:33.829 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:47:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:47:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:47:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:47:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:47:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:47:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:47:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:47:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:47:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 2588, 2024-05-30T06:47:33.830 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 10738602736, 2024-05-30T06:47:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 21788213248, 2024-05-30T06:47:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 751305900032, 2024-05-30T06:47:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:47:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 170, 2024-05-30T06:47:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 75827884, 2024-05-30T06:47:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:47:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 19 2024-05-30T06:47:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:47:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 28, 2024-05-30T06:47:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 3, 2024-05-30T06:47:33.831 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:47:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:47:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:47:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:47:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:47:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 3, 2024-05-30T06:47:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:47:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:47:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:47:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5652 2024-05-30T06:47:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:47:33.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:47:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:47:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:47:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:47:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:47:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:47:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:47:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:47:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:47:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-05-30T06:47:33.833 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:46:54.717237+0000", 2024-05-30T06:47:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:47:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:47:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: "3cf17b2a-061c-411c-9131-5456a47b7bcd": { 2024-05-30T06:47:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "3 ongoing clones; Avg progress is 2.943% (2s)\n [............................] (remaining: 89s)", 2024-05-30T06:47:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.029430000111460686, 2024-05-30T06:47:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:47:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:33.834 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:33.834 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:47:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.828+0000 7f4b48a00640 1 -- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b24068a70 msgr2=0x7f4b2406af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:33.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.828+0000 7f4b48a00640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b24068a70 0x7f4b2406af30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c007e90 tx=0x7f4b3c0073a0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.828+0000 7f4b48a00640 1 -- 172.21.15.37:0/3308270105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b44072510 msgr2=0x7f4b44161ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.828+0000 7f4b48a00640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b44072510 0x7f4b44161ee0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4b44073530 tx=0x7f4b3001ad00 comp rx=0 tx=0).stop 2024-05-30T06:47:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.828+0000 7f4b48a00640 1 -- 172.21.15.37:0/3308270105 shutdown_connections 2024-05-30T06:47:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.828+0000 7f4b48a00640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b44160860 0x7f4b44162420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.828+0000 7f4b48a00640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b44072510 0x7f4b44161ee0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.828+0000 7f4b48a00640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b24068a70 0x7f4b2406af30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.828+0000 7f4b48a00640 1 --2- 172.21.15.37:0/3308270105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b4406e3f0 0x7f4b4414b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.828+0000 7f4b48a00640 1 -- 172.21.15.37:0/3308270105 >> 172.21.15.37:0/3308270105 conn(0x7f4b440b2120 msgr2=0x7f4b441556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.828+0000 7f4b48a00640 1 -- 172.21.15.37:0/3308270105 shutdown_connections 2024-05-30T06:47:33.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:33.828+0000 7f4b48a00640 1 -- 172.21.15.37:0/3308270105 wait complete. 2024-05-30T06:47:33.866 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone71651 2024-05-30T06:47:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.180+0000 7fbbefe00640 1 Processor -- start 2024-05-30T06:47:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbefe00640 1 -- start start 2024-05-30T06:47:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbefe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe8155da0 0x7fbbe80cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbefe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbbe80cd440 0x7fbbe80cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbefe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbe80cfa20 0x7fbbe80cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbefe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbbe80d0410 con 0x7fbbe80cfa20 2024-05-30T06:47:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbefe00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbbe815f310 con 0x7fbbe80cd440 2024-05-30T06:47:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbefe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe815f5f0 con 0x7fbbe8155da0 2024-05-30T06:47:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbede00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbe80cfa20 0x7fbbe80cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbede00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbe80cfa20 0x7fbbe80cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36882/0 (socket says 172.21.15.37:36882) 2024-05-30T06:47:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbede00640 1 -- 172.21.15.37:0/815308126 learned_addr learned my addr 172.21.15.37:0/815308126 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbede00640 1 -- 172.21.15.37:0/815308126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe8155da0 msgr2=0x7fbbe80cd950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T06:47:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbede00640 1 --2- 172.21.15.37:0/815308126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe8155da0 0x7fbbe80cd950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbede00640 1 -- 172.21.15.37:0/815308126 >> v2:172.21.15.105:3300/0 conn(0x7fbbe80cd440 msgr2=0x7fbbe80cf4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T06:47:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbede00640 1 --2- 172.21.15.37:0/815308126 >> v2:172.21.15.105:3300/0 conn(0x7fbbe80cd440 0x7fbbe80cf4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.184+0000 7fbbede00640 1 -- 172.21.15.37:0/815308126 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe815f8d0 con 0x7fbbe80cfa20 2024-05-30T06:47:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.188+0000 7fbbede00640 1 --2- 172.21.15.37:0/815308126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe80cfa20 0x7fbbe80cfed0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbbe806c610 tx=0x7fbbe002d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b6a5b409984e16 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.192+0000 7fbbe7e00640 1 -- 172.21.15.37:0/815308126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00b65b0 con 0x7fbbe80cfa20 2024-05-30T06:47:34.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.192+0000 7fbbe7e00640 1 -- 172.21.15.37:0/815308126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe00b6750 con 0x7fbbe80cfa20 2024-05-30T06:47:34.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.192+0000 7fbbe7e00640 1 -- 172.21.15.37:0/815308126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00b6b20 con 0x7fbbe80cfa20 2024-05-30T06:47:34.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.192+0000 7fbbefe00640 1 -- 172.21.15.37:0/815308126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe80cfa20 msgr2=0x7fbbe80cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:34.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.192+0000 7fbbefe00640 1 --2- 172.21.15.37:0/815308126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe80cfa20 0x7fbbe80cfed0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fbbe806c610 tx=0x7fbbe002d920 comp rx=0 tx=0).stop 2024-05-30T06:47:34.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.192+0000 7fbbefe00640 1 -- 172.21.15.37:0/815308126 shutdown_connections 2024-05-30T06:47:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.192+0000 7fbbefe00640 1 --2- 172.21.15.37:0/815308126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe80cfa20 0x7fbbe80cfed0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.192+0000 7fbbefe00640 1 --2- 172.21.15.37:0/815308126 >> v2:172.21.15.105:3300/0 conn(0x7fbbe80cd440 0x7fbbe80cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.192+0000 7fbbefe00640 1 --2- 172.21.15.37:0/815308126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe8155da0 0x7fbbe80cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.192+0000 7fbbefe00640 1 -- 172.21.15.37:0/815308126 >> 172.21.15.37:0/815308126 conn(0x7fbbe806bf60 msgr2=0x7fbbe80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.192+0000 7fbbefe00640 1 -- 172.21.15.37:0/815308126 shutdown_connections 2024-05-30T06:47:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.192+0000 7fbbefe00640 1 -- 172.21.15.37:0/815308126 wait complete. 2024-05-30T06:47:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbefe00640 1 Processor -- start 2024-05-30T06:47:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbefe00640 1 -- start start 2024-05-30T06:47:34.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbefe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe80cfa20 0x7fbbe8158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:34.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbefe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbe8155da0 0x7fbbe8161c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:34.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbefe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe81f3660 0x7fbbe806e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:34.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbefe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe80b3f60 con 0x7fbbe81f3660 2024-05-30T06:47:34.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbefe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe8164560 con 0x7fbbe8155da0 2024-05-30T06:47:34.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbefe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe80b40e0 con 0x7fbbe80cfa20 2024-05-30T06:47:34.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbede00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe81f3660 0x7fbbe806e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:34.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbede00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe81f3660 0x7fbbe806e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36884/0 (socket says 172.21.15.37:36884) 2024-05-30T06:47:34.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbede00640 1 -- 172.21.15.37:0/3556199082 learned_addr learned my addr 172.21.15.37:0/3556199082 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:34.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbede00640 1 -- 172.21.15.37:0/3556199082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe80cfa20 msgr2=0x7fbbe8158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:34.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbede00640 1 --2- 172.21.15.37:0/3556199082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe80cfa20 0x7fbbe8158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbede00640 1 -- 172.21.15.37:0/3556199082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbe8155da0 msgr2=0x7fbbe8161c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbede00640 1 --2- 172.21.15.37:0/3556199082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbe8155da0 0x7fbbe8161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbede00640 1 -- 172.21.15.37:0/3556199082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe8162170 con 0x7fbbe81f3660 2024-05-30T06:47:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbede00640 1 --2- 172.21.15.37:0/3556199082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe81f3660 0x7fbbe806e630 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbbe002bfd0 tx=0x7fbbe002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbe5600640 1 -- 172.21.15.37:0/3556199082 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00cd020 con 0x7fbbe81f3660 2024-05-30T06:47:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbe5600640 1 -- 172.21.15.37:0/3556199082 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbe00c9690 con 0x7fbbe81f3660 2024-05-30T06:47:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbe5600640 1 -- 172.21.15.37:0/3556199082 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00c9a80 con 0x7fbbe81f3660 2024-05-30T06:47:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbefe00640 1 -- 172.21.15.37:0/3556199082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe8158770 con 0x7fbbe81f3660 2024-05-30T06:47:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.196+0000 7fbbefe00640 1 -- 172.21.15.37:0/3556199082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe8158d30 con 0x7fbbe81f3660 2024-05-30T06:47:34.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.200+0000 7fbbefe00640 1 -- 172.21.15.37:0/3556199082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe8068bc0 con 0x7fbbe81f3660 2024-05-30T06:47:34.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.200+0000 7fbbe5600640 1 -- 172.21.15.37:0/3556199082 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 88599+0+0 (secure 0 0 0) 0x7fbbe00d0020 con 0x7fbbe81f3660 2024-05-30T06:47:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.200+0000 7fbbe5600640 1 --2- 172.21.15.37:0/3556199082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbbc8068a70 0x7fbbc806af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.200+0000 7fbbe5600640 1 -- 172.21.15.37:0/3556199082 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fbbe0133570 con 0x7fbbe81f3660 2024-05-30T06:47:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.208+0000 7fbbe5600640 1 -- 172.21.15.37:0/3556199082 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbbe0027630 con 0x7fbbe81f3660 2024-05-30T06:47:34.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.212+0000 7fbbed400640 1 --2- 172.21.15.37:0/3556199082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbbc8068a70 0x7fbbc806af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:34.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.216+0000 7fbbed400640 1 --2- 172.21.15.37:0/3556199082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbbc8068a70 0x7fbbc806af30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbbe81516f0 tx=0x7fbbd4006bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:34.355 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:47:34.359 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:47:34.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:34.564+0000 7fbbefe00640 1 -- 172.21.15.37:0/3556199082 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone71651", "target": ["mon-mgr", ""]}) -- 0x7fbbe80b6790 con 0x7fbbc8068a70 2024-05-30T06:47:34.607 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:34.605+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:34.607 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:34.605+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:34.607 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:34.605+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:34.607 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:34.605+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:34.607 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:47:34.605+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:47:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:35.076+0000 7fbbe5600640 1 -- 172.21.15.37:0/3556199082 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7fbbe00ff2b0 con 0x7fbbe81f3660 2024-05-30T06:47:36.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.423+0000 7fbbe5600640 1 -- 172.21.15.37:0/3556199082 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbbe80b6790 con 0x7fbbc8068a70 2024-05-30T06:47:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.427+0000 7fbbefe00640 1 -- 172.21.15.37:0/3556199082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbbc8068a70 msgr2=0x7fbbc806af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.427+0000 7fbbefe00640 1 --2- 172.21.15.37:0/3556199082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbbc8068a70 0x7fbbc806af30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbbe81516f0 tx=0x7fbbd4006bb0 comp rx=0 tx=0).stop 2024-05-30T06:47:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.427+0000 7fbbefe00640 1 -- 172.21.15.37:0/3556199082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe81f3660 msgr2=0x7fbbe806e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.427+0000 7fbbefe00640 1 --2- 172.21.15.37:0/3556199082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe81f3660 0x7fbbe806e630 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fbbe002bfd0 tx=0x7fbbe002a6c0 comp rx=0 tx=0).stop 2024-05-30T06:47:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.427+0000 7fbbefe00640 1 -- 172.21.15.37:0/3556199082 shutdown_connections 2024-05-30T06:47:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.427+0000 7fbbefe00640 1 --2- 172.21.15.37:0/3556199082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe81f3660 0x7fbbe806e630 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.427+0000 7fbbefe00640 1 --2- 172.21.15.37:0/3556199082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbbc8068a70 0x7fbbc806af30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.427+0000 7fbbefe00640 1 --2- 172.21.15.37:0/3556199082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbe8155da0 0x7fbbe8161c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.427+0000 7fbbefe00640 1 --2- 172.21.15.37:0/3556199082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbe80cfa20 0x7fbbe8158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:36.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.427+0000 7fbbefe00640 1 -- 172.21.15.37:0/3556199082 >> 172.21.15.37:0/3556199082 conn(0x7fbbe806bf60 msgr2=0x7fbbe80b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:36.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.427+0000 7fbbefe00640 1 -- 172.21.15.37:0/3556199082 shutdown_connections 2024-05-30T06:47:36.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.427+0000 7fbbefe00640 1 -- 172.21.15.37:0/3556199082 wait complete. 2024-05-30T06:47:36.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone71652 2024-05-30T06:47:36.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.703+0000 7fee86200640 1 Processor -- start 2024-05-30T06:47:36.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.703+0000 7fee86200640 1 -- start start 2024-05-30T06:47:36.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.703+0000 7fee86200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fee80161e30 0x7fee800d4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.703+0000 7fee86200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee800d5300 0x7fee800b1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.703+0000 7fee86200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee800b4c40 con 0x7fee800b1840 2024-05-30T06:47:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.703+0000 7fee86200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fee800b58c0 con 0x7fee80161e30 2024-05-30T06:47:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.703+0000 7fee86200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fee800b4f20 con 0x7fee800d5300 2024-05-30T06:47:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.707+0000 7fee85800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fee800b1840 0x7fee800b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45018/0 (socket says 172.21.15.37:45018) 2024-05-30T06:47:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.707+0000 7fee85800640 1 -- 172.21.15.37:0/1141994997 learned_addr learned my addr 172.21.15.37:0/1141994997 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:47:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.707+0000 7fee84e00640 1 --2- 172.21.15.37:0/1141994997 >> v2:172.21.15.105:3300/0 conn(0x7fee80161e30 0x7fee800d4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.707+0000 7fee7fe00640 1 -- 172.21.15.37:0/1141994997 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441080496 0 0) 0x7fee800b4c40 con 0x7fee800b1840 2024-05-30T06:47:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.707+0000 7fee7fe00640 1 -- 172.21.15.37:0/1141994997 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee64003530 con 0x7fee800b1840 2024-05-30T06:47:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.711+0000 7fee84e00640 1 -- 172.21.15.37:0/1141994997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee800d5300 msgr2=0x7fee800b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.711+0000 7fee84e00640 1 --2- 172.21.15.37:0/1141994997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee800d5300 0x7fee800b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.711+0000 7fee7fe00640 1 -- 172.21.15.37:0/1141994997 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2852786744 0 0) 0x7fee64003530 con 0x7fee800b1840 2024-05-30T06:47:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.711+0000 7fee84e00640 1 -- 172.21.15.37:0/1141994997 >> v1:172.21.15.37:6789/0 conn(0x7fee800b1840 legacy=0x7fee800b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.711+0000 7fee84e00640 1 -- 172.21.15.37:0/1141994997 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee800b5200 con 0x7fee80161e30 2024-05-30T06:47:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.715+0000 7fee84e00640 1 --2- 172.21.15.37:0/1141994997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee80161e30 0x7fee800d4dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee700097c0 tx=0x7fee7001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9ca9d84a3300756 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.719+0000 7fee7fe00640 1 -- 172.21.15.37:0/1141994997 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee700b0070 con 0x7fee80161e30 2024-05-30T06:47:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.719+0000 7fee7fe00640 1 -- 172.21.15.37:0/1141994997 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee700ab400 con 0x7fee80161e30 2024-05-30T06:47:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.719+0000 7fee7fe00640 1 -- 172.21.15.37:0/1141994997 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78001a00 con 0x7fee80161e30 2024-05-30T06:47:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.719+0000 7fee86200640 1 -- 172.21.15.37:0/1141994997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee80161e30 msgr2=0x7fee800d4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.719+0000 7fee86200640 1 --2- 172.21.15.37:0/1141994997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee80161e30 0x7fee800d4dc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee700097c0 tx=0x7fee7001c3e0 comp rx=0 tx=0).stop 2024-05-30T06:47:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.719+0000 7fee86200640 1 -- 172.21.15.37:0/1141994997 shutdown_connections 2024-05-30T06:47:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.719+0000 7fee86200640 1 --2- 172.21.15.37:0/1141994997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee800d5300 0x7fee800b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.719+0000 7fee86200640 1 --2- 172.21.15.37:0/1141994997 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee80161e30 0x7fee800d4dc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.719+0000 7fee86200640 1 -- 172.21.15.37:0/1141994997 >> 172.21.15.37:0/1141994997 conn(0x7fee8008bff0 msgr2=0x7fee800d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.719+0000 7fee86200640 1 -- 172.21.15.37:0/1141994997 shutdown_connections 2024-05-30T06:47:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.719+0000 7fee86200640 1 -- 172.21.15.37:0/1141994997 wait complete. 2024-05-30T06:47:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.727+0000 7fee86200640 1 Processor -- start 2024-05-30T06:47:36.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.727+0000 7fee86200640 1 -- start start 2024-05-30T06:47:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.727+0000 7fee86200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee800b1840 0x7fee800c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.727+0000 7fee86200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800d5300 0x7fee80158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.727+0000 7fee86200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee80161e30 0x7fee801556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.727+0000 7fee86200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee8016b0a0 con 0x7fee800b1840 2024-05-30T06:47:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.727+0000 7fee86200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee80162420 con 0x7fee800d5300 2024-05-30T06:47:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.727+0000 7fee86200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fee8016b220 con 0x7fee80161e30 2024-05-30T06:47:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee85800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee80161e30 0x7fee801556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee85800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee80161e30 0x7fee801556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:38352/0 (socket says 172.21.15.37:38352) 2024-05-30T06:47:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee85800640 1 -- 172.21.15.37:0/1894686333 learned_addr learned my addr 172.21.15.37:0/1894686333 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee77e00640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800d5300 0x7fee80158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee84e00640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee800b1840 0x7fee800c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee85800640 1 -- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800d5300 msgr2=0x7fee80158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee85800640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800d5300 0x7fee80158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee85800640 1 -- 172.21.15.37:0/1894686333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee800b1840 msgr2=0x7fee800c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee85800640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee800b1840 0x7fee800c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee85800640 1 -- 172.21.15.37:0/1894686333 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee800b7c90 con 0x7fee80161e30 2024-05-30T06:47:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee77e00640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800d5300 0x7fee80158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:47:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee85800640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee80161e30 0x7fee801556b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fee7800cc90 tx=0x7fee7800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee7d600640 1 -- 172.21.15.37:0/1894686333 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78017070 con 0x7fee80161e30 2024-05-30T06:47:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee86200640 1 -- 172.21.15.37:0/1894686333 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee800c88a0 con 0x7fee80161e30 2024-05-30T06:47:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee86200640 1 -- 172.21.15.37:0/1894686333 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fee800c8e60 con 0x7fee80161e30 2024-05-30T06:47:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee7d600640 1 -- 172.21.15.37:0/1894686333 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee78012400 con 0x7fee80161e30 2024-05-30T06:47:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee7d600640 1 -- 172.21.15.37:0/1894686333 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee780127d0 con 0x7fee80161e30 2024-05-30T06:47:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.731+0000 7fee86200640 1 -- 172.21.15.37:0/1894686333 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee580052a0 con 0x7fee80161e30 2024-05-30T06:47:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.735+0000 7fee7d600640 1 -- 172.21.15.37:0/1894686333 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7fee7801a070 con 0x7fee80161e30 2024-05-30T06:47:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.739+0000 7fee7d600640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee5c068ad0 0x7fee5c06af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:36.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.739+0000 7fee7d600640 1 -- 172.21.15.37:0/1894686333 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fee78087dd0 con 0x7fee80161e30 2024-05-30T06:47:36.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.739+0000 7fee84e00640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee5c068ad0 0x7fee5c06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:36.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.743+0000 7fee84e00640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee5c068ad0 0x7fee5c06af90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fee700ad000 tx=0x7fee700a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:36.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:36.747+0000 7fee7d600640 1 -- 172.21.15.37:0/1894686333 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fee78021020 con 0x7fee80161e30 2024-05-30T06:47:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.047+0000 7fee86200640 1 -- 172.21.15.37:0/1894686333 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone71652", "target": ["mon-mgr", ""]}) -- 0x7fee58000bd0 con 0x7fee5c068ad0 2024-05-30T06:47:37.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.659+0000 7fee7d600640 1 -- 172.21.15.37:0/1894686333 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fee58000bd0 con 0x7fee5c068ad0 2024-05-30T06:47:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.663+0000 7fee86200640 1 -- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee5c068ad0 msgr2=0x7fee5c06af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.663+0000 7fee86200640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee5c068ad0 0x7fee5c06af90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fee700ad000 tx=0x7fee700a6000 comp rx=0 tx=0).stop 2024-05-30T06:47:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.663+0000 7fee86200640 1 -- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee80161e30 msgr2=0x7fee801556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.663+0000 7fee86200640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee80161e30 0x7fee801556b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fee7800cc90 tx=0x7fee7800a430 comp rx=0 tx=0).stop 2024-05-30T06:47:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.663+0000 7fee86200640 1 -- 172.21.15.37:0/1894686333 shutdown_connections 2024-05-30T06:47:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.663+0000 7fee86200640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee80161e30 0x7fee801556b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.663+0000 7fee86200640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee5c068ad0 0x7fee5c06af90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:37.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.663+0000 7fee86200640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800d5300 0x7fee80158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:37.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.663+0000 7fee86200640 1 --2- 172.21.15.37:0/1894686333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee800b1840 0x7fee800c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:37.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.663+0000 7fee86200640 1 -- 172.21.15.37:0/1894686333 >> 172.21.15.37:0/1894686333 conn(0x7fee8008bff0 msgr2=0x7fee800b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:37.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.663+0000 7fee86200640 1 -- 172.21.15.37:0/1894686333 shutdown_connections 2024-05-30T06:47:37.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.663+0000 7fee86200640 1 -- 172.21.15.37:0/1894686333 wait complete. 2024-05-30T06:47:37.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone71653 2024-05-30T06:47:37.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.987+0000 7fcc95c00640 1 Processor -- start 2024-05-30T06:47:37.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.987+0000 7fcc95c00640 1 -- start start 2024-05-30T06:47:37.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.991+0000 7fcc95c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc900b4150 0x7fcc90072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:37.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.991+0000 7fcc95c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc900b57e0 con 0x7fcc90072bd0 2024-05-30T06:47:37.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.991+0000 7fcc95c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc900b3670 con 0x7fcc901585c0 2024-05-30T06:47:37.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.991+0000 7fcc95c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcc900b3420 con 0x7fcc900b4150 2024-05-30T06:47:37.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.991+0000 7fcc95200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcc90072bd0 0x7fcc9006de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40772/0 (socket says 172.21.15.37:40772) 2024-05-30T06:47:37.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.991+0000 7fcc95200640 1 -- 172.21.15.37:0/755539751 learned_addr learned my addr 172.21.15.37:0/755539751 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:47:37.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.991+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3308599151 0 0) 0x7fcc900b57e0 con 0x7fcc90072bd0 2024-05-30T06:47:37.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.991+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc74003530 con 0x7fcc90072bd0 2024-05-30T06:47:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.991+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3309459666 0 0) 0x7fcc900b3670 con 0x7fcc901585c0 2024-05-30T06:47:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.991+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc900b57e0 con 0x7fcc901585c0 2024-05-30T06:47:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.991+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 971312480 0 0) 0x7fcc74003530 con 0x7fcc90072bd0 2024-05-30T06:47:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.991+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 >> v2:172.21.15.37:3300/0 conn(0x7fcc900b4150 msgr2=0x7fcc90072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.991+0000 7fcc87e00640 1 --2- 172.21.15.37:0/755539751 >> v2:172.21.15.37:3300/0 conn(0x7fcc900b4150 0x7fcc90072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.995+0000 7fcc8f400640 1 --2- 172.21.15.37:0/755539751 >> v2:172.21.15.37:3300/0 conn(0x7fcc900b4150 0x7fcc90072690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.995+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 >> v1:172.21.15.105:6789/0 conn(0x7fcc901585c0 legacy=0x7fcc900b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.995+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc900b3950 con 0x7fcc90072bd0 2024-05-30T06:47:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.995+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fcc88001a00 con 0x7fcc90072bd0 2024-05-30T06:47:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.995+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 >> v1:172.21.15.37:6789/0 conn(0x7fcc90072bd0 legacy=0x7fcc9006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.995+0000 7fcc8f400640 1 --2- 172.21.15.37:0/755539751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc74004be0 0x7fcc74004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.999+0000 7fcc8f400640 1 --2- 172.21.15.37:0/755539751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc740037b0 0x7fcc74003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.999+0000 7fcc8f400640 1 --2- 172.21.15.37:0/755539751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc74004170 0x7fcc7400dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.999+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc900b3420 con 0x7fcc74004170 2024-05-30T06:47:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.999+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7400e3c0 con 0x7fcc740037b0 2024-05-30T06:47:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.999+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcc7400e5c0 con 0x7fcc74004be0 2024-05-30T06:47:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.999+0000 7fcc87e00640 1 --2- 172.21.15.37:0/755539751 >> v2:172.21.15.37:3300/0 conn(0x7fcc900b4150 0x7fcc90072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:47:38.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.999+0000 7fcc8fe00640 1 --2- 172.21.15.37:0/755539751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc74004be0 0x7fcc74004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:38.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.999+0000 7fcc95200640 1 --2- 172.21.15.37:0/755539751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc74004170 0x7fcc7400dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:38.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:37.999+0000 7fcc87e00640 1 --2- 172.21.15.37:0/755539751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc740037b0 0x7fcc74003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.003+0000 7fcc8fe00640 1 -- 172.21.15.37:0/755539751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc740037b0 msgr2=0x7fcc74003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.003+0000 7fcc8fe00640 1 --2- 172.21.15.37:0/755539751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc740037b0 0x7fcc74003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.003+0000 7fcc8fe00640 1 -- 172.21.15.37:0/755539751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc74004170 msgr2=0x7fcc7400dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.003+0000 7fcc8fe00640 1 --2- 172.21.15.37:0/755539751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc74004170 0x7fcc7400dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.003+0000 7fcc8fe00640 1 -- 172.21.15.37:0/755539751 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc900b3950 con 0x7fcc74004be0 2024-05-30T06:47:38.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.007+0000 7fcc95200640 1 -- 172.21.15.37:0/755539751 reap_dead start 2024-05-30T06:47:38.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.011+0000 7fcc8fe00640 1 --2- 172.21.15.37:0/755539751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc74004be0 0x7fcc74004fc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcc78007e90 tx=0x7fcc7801ca20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c67a5c28fc8afaee server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.011+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc78007a60 con 0x7fcc74004be0 2024-05-30T06:47:38.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.011+0000 7fcc8f400640 1 -- 172.21.15.37:0/755539751 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc780a9070 con 0x7fcc74004be0 2024-05-30T06:47:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.011+0000 7fcc95c00640 1 -- 172.21.15.37:0/755539751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc74004be0 msgr2=0x7fcc74004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.011+0000 7fcc95c00640 1 --2- 172.21.15.37:0/755539751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc74004be0 0x7fcc74004fc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcc78007e90 tx=0x7fcc7801ca20 comp rx=0 tx=0).stop 2024-05-30T06:47:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.011+0000 7fcc95c00640 1 -- 172.21.15.37:0/755539751 shutdown_connections 2024-05-30T06:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.011+0000 7fcc95c00640 1 --2- 172.21.15.37:0/755539751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc74004be0 0x7fcc74004fc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.011+0000 7fcc95c00640 1 -- 172.21.15.37:0/755539751 >> 172.21.15.37:0/755539751 conn(0x7fcc90067d60 msgr2=0x7fcc9006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.011+0000 7fcc95c00640 1 -- 172.21.15.37:0/755539751 shutdown_connections 2024-05-30T06:47:38.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.011+0000 7fcc95c00640 1 -- 172.21.15.37:0/755539751 wait complete. 2024-05-30T06:47:38.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.015+0000 7fcc95c00640 1 Processor -- start 2024-05-30T06:47:38.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.015+0000 7fcc95c00640 1 -- start start 2024-05-30T06:47:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.019+0000 7fcc95c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc74004be0 0x7fcc90200c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.019+0000 7fcc95c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc901f3930 0x7fcc90151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.019+0000 7fcc95c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc90156e70 0x7fcc90203620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.019+0000 7fcc95c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc901589a0 con 0x7fcc90156e70 2024-05-30T06:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.019+0000 7fcc95c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9015bfc0 con 0x7fcc901f3930 2024-05-30T06:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.019+0000 7fcc95c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcc90158b20 con 0x7fcc74004be0 2024-05-30T06:47:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.019+0000 7fcc95200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc90156e70 0x7fcc90203620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.019+0000 7fcc95200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc90156e70 0x7fcc90203620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41372/0 (socket says 172.21.15.37:41372) 2024-05-30T06:47:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.019+0000 7fcc95200640 1 -- 172.21.15.37:0/3069735443 learned_addr learned my addr 172.21.15.37:0/3069735443 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.019+0000 7fcc8fe00640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc74004be0 0x7fcc90200c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.019+0000 7fcc87e00640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc901f3930 0x7fcc90151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:38.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.023+0000 7fcc95200640 1 -- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc74004be0 msgr2=0x7fcc90200c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:38.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.023+0000 7fcc95200640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc74004be0 0x7fcc90200c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:38.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.023+0000 7fcc95200640 1 -- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc901f3930 msgr2=0x7fcc90151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:38.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.023+0000 7fcc95200640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc901f3930 0x7fcc90151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:38.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.023+0000 7fcc95200640 1 -- 172.21.15.37:0/3069735443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc901539c0 con 0x7fcc90156e70 2024-05-30T06:47:38.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.023+0000 7fcc87e00640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc901f3930 0x7fcc90151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:47:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.023+0000 7fcc95200640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc90156e70 0x7fcc90203620 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcc900d0280 tx=0x7fcc88007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.027+0000 7fcc8cc00640 1 -- 172.21.15.37:0/3069735443 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88011a40 con 0x7fcc90156e70 2024-05-30T06:47:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.027+0000 7fcc8cc00640 1 -- 172.21.15.37:0/3069735443 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc8801a070 con 0x7fcc90156e70 2024-05-30T06:47:38.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.027+0000 7fcc8cc00640 1 -- 172.21.15.37:0/3069735443 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88011e20 con 0x7fcc90156e70 2024-05-30T06:47:38.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.027+0000 7fcc95c00640 1 -- 172.21.15.37:0/3069735443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc90153ca0 con 0x7fcc90156e70 2024-05-30T06:47:38.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.027+0000 7fcc95c00640 1 -- 172.21.15.37:0/3069735443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc90154260 con 0x7fcc90156e70 2024-05-30T06:47:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.027+0000 7fcc95c00640 1 -- 172.21.15.37:0/3069735443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc90068700 con 0x7fcc90156e70 2024-05-30T06:47:38.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.031+0000 7fcc8cc00640 1 -- 172.21.15.37:0/3069735443 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7fcc88014070 con 0x7fcc90156e70 2024-05-30T06:47:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.031+0000 7fcc8cc00640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc6c068b20 0x7fcc6c06afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.031+0000 7fcc8cc00640 1 -- 172.21.15.37:0/3069735443 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fcc8808a700 con 0x7fcc90156e70 2024-05-30T06:47:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.031+0000 7fcc8fe00640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc6c068b20 0x7fcc6c06afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.035+0000 7fcc8fe00640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc6c068b20 0x7fcc6c06afe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcc780ab000 tx=0x7fcc780a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:38.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.039+0000 7fcc8cc00640 1 -- 172.21.15.37:0/3069735443 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcc88059830 con 0x7fcc90156e70 2024-05-30T06:47:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.383+0000 7fcc95c00640 1 -- 172.21.15.37:0/3069735443 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone71653", "target": ["mon-mgr", ""]}) -- 0x7fcc9015b2e0 con 0x7fcc6c068b20 2024-05-30T06:47:38.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.803+0000 7fcc8cc00640 1 -- 172.21.15.37:0/3069735443 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcc9015b2e0 con 0x7fcc6c068b20 2024-05-30T06:47:38.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.807+0000 7fcc95c00640 1 -- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc6c068b20 msgr2=0x7fcc6c06afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:38.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.807+0000 7fcc95c00640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc6c068b20 0x7fcc6c06afe0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcc780ab000 tx=0x7fcc780a7070 comp rx=0 tx=0).stop 2024-05-30T06:47:38.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.807+0000 7fcc95c00640 1 -- 172.21.15.37:0/3069735443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc90156e70 msgr2=0x7fcc90203620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.807+0000 7fcc95c00640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc90156e70 0x7fcc90203620 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcc900d0280 tx=0x7fcc88007a90 comp rx=0 tx=0).stop 2024-05-30T06:47:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.807+0000 7fcc95c00640 1 -- 172.21.15.37:0/3069735443 shutdown_connections 2024-05-30T06:47:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.807+0000 7fcc95c00640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc90156e70 0x7fcc90203620 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.807+0000 7fcc95c00640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc6c068b20 0x7fcc6c06afe0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.807+0000 7fcc95c00640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc901f3930 0x7fcc90151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.807+0000 7fcc95c00640 1 --2- 172.21.15.37:0/3069735443 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc74004be0 0x7fcc90200c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.807+0000 7fcc95c00640 1 -- 172.21.15.37:0/3069735443 >> 172.21.15.37:0/3069735443 conn(0x7fcc90067d60 msgr2=0x7fcc900b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.807+0000 7fcc95c00640 1 -- 172.21.15.37:0/3069735443 shutdown_connections 2024-05-30T06:47:38.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:38.807+0000 7fcc95c00640 1 -- 172.21.15.37:0/3069735443 wait complete. 2024-05-30T06:47:38.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone71654 2024-05-30T06:47:39.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.071+0000 7fbc56a00640 1 Processor -- start 2024-05-30T06:47:39.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.075+0000 7fbc56a00640 1 -- start start 2024-05-30T06:47:39.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.075+0000 7fbc56a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc500afcf0 0x7fbc500b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:39.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.075+0000 7fbc56a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc500b5f70 con 0x7fbc500cfeb0 2024-05-30T06:47:39.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.075+0000 7fbc56a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc500b0150 con 0x7fbc50162ba0 2024-05-30T06:47:39.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.075+0000 7fbc56a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbc500b67a0 con 0x7fbc500afcf0 2024-05-30T06:47:39.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.075+0000 7fbc4fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbc500cfeb0 0x7fbc50162490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40782/0 (socket says 172.21.15.37:40782) 2024-05-30T06:47:39.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.075+0000 7fbc4fe00640 1 -- 172.21.15.37:0/3340410471 learned_addr learned my addr 172.21.15.37:0/3340410471 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:47:39.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.079+0000 7fbc54a00640 1 --2- 172.21.15.37:0/3340410471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc500afcf0 0x7fbc500b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.079+0000 7fbc4ea00640 1 -- 172.21.15.37:0/3340410471 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1195680502 0 0) 0x7fbc500b5f70 con 0x7fbc500cfeb0 2024-05-30T06:47:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.079+0000 7fbc4ea00640 1 -- 172.21.15.37:0/3340410471 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc34003530 con 0x7fbc500cfeb0 2024-05-30T06:47:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.079+0000 7fbc54a00640 1 -- 172.21.15.37:0/3340410471 >> v1:172.21.15.105:6789/0 conn(0x7fbc50162ba0 legacy=0x7fbc50147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.079+0000 7fbc54a00640 1 -- 172.21.15.37:0/3340410471 >> v1:172.21.15.37:6789/0 conn(0x7fbc500cfeb0 legacy=0x7fbc50162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.079+0000 7fbc54a00640 1 -- 172.21.15.37:0/3340410471 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc500b61e0 con 0x7fbc500afcf0 2024-05-30T06:47:39.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.083+0000 7fbc54a00640 1 --2- 172.21.15.37:0/3340410471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc500afcf0 0x7fbc500b36c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009dc0 tx=0x7fbc48025110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c26a0ed3f8421d31 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:39.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.083+0000 7fbc4ea00640 1 -- 172.21.15.37:0/3340410471 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc480b9070 con 0x7fbc500afcf0 2024-05-30T06:47:39.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.083+0000 7fbc4ea00640 1 -- 172.21.15.37:0/3340410471 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc480b4600 con 0x7fbc500afcf0 2024-05-30T06:47:39.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.083+0000 7fbc4ea00640 1 -- 172.21.15.37:0/3340410471 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc480b49d0 con 0x7fbc500afcf0 2024-05-30T06:47:39.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.083+0000 7fbc56a00640 1 -- 172.21.15.37:0/3340410471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc500afcf0 msgr2=0x7fbc500b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.083+0000 7fbc56a00640 1 --2- 172.21.15.37:0/3340410471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc500afcf0 0x7fbc500b36c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009dc0 tx=0x7fbc48025110 comp rx=0 tx=0).stop 2024-05-30T06:47:39.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.083+0000 7fbc56a00640 1 -- 172.21.15.37:0/3340410471 shutdown_connections 2024-05-30T06:47:39.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.083+0000 7fbc56a00640 1 --2- 172.21.15.37:0/3340410471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc500afcf0 0x7fbc500b36c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.083+0000 7fbc56a00640 1 -- 172.21.15.37:0/3340410471 >> 172.21.15.37:0/3340410471 conn(0x7fbc5006bf60 msgr2=0x7fbc500b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:39.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.087+0000 7fbc56a00640 1 -- 172.21.15.37:0/3340410471 shutdown_connections 2024-05-30T06:47:39.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.087+0000 7fbc56a00640 1 -- 172.21.15.37:0/3340410471 wait complete. 2024-05-30T06:47:39.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.087+0000 7fbc56a00640 1 Processor -- start 2024-05-30T06:47:39.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.087+0000 7fbc56a00640 1 -- start start 2024-05-30T06:47:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.087+0000 7fbc56a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc500afcf0 0x7fbc5015bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.087+0000 7fbc56a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc500cfeb0 0x7fbc50158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.087+0000 7fbc56a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc50162ba0 0x7fbc50159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.087+0000 7fbc56a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbc500ab650 con 0x7fbc50162ba0 2024-05-30T06:47:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.087+0000 7fbc56a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbc500ab4d0 con 0x7fbc500cfeb0 2024-05-30T06:47:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.087+0000 7fbc56a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbc500ab7d0 con 0x7fbc500afcf0 2024-05-30T06:47:39.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc4f400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc500cfeb0 0x7fbc50158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.087+0000 7fbc54a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc50162ba0 0x7fbc50159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc4fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc500afcf0 0x7fbc5015bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc4f400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc500cfeb0 0x7fbc50158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:33524/0 (socket says 172.21.15.37:33524) 2024-05-30T06:47:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc4f400640 1 -- 172.21.15.37:0/4111100706 learned_addr learned my addr 172.21.15.37:0/4111100706 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc54a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc50162ba0 0x7fbc50159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41380/0 (socket says 172.21.15.37:41380) 2024-05-30T06:47:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc4f400640 1 -- 172.21.15.37:0/4111100706 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc500afcf0 msgr2=0x7fbc5015bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc4f400640 1 --2- 172.21.15.37:0/4111100706 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc500afcf0 0x7fbc5015bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc4f400640 1 -- 172.21.15.37:0/4111100706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc50162ba0 msgr2=0x7fbc50159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc4f400640 1 --2- 172.21.15.37:0/4111100706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc50162ba0 0x7fbc50159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc4f400640 1 -- 172.21.15.37:0/4111100706 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc50146150 con 0x7fbc500cfeb0 2024-05-30T06:47:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc54a00640 1 --2- 172.21.15.37:0/4111100706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc50162ba0 0x7fbc50159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:47:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc4f400640 1 --2- 172.21.15.37:0/4111100706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc500cfeb0 0x7fbc50158230 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000c310 tx=0x7fbc4000c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc47e00640 1 -- 172.21.15.37:0/4111100706 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc400052d0 con 0x7fbc500cfeb0 2024-05-30T06:47:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc47e00640 1 -- 172.21.15.37:0/4111100706 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc40005470 con 0x7fbc500cfeb0 2024-05-30T06:47:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc47e00640 1 -- 172.21.15.37:0/4111100706 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40007260 con 0x7fbc500cfeb0 2024-05-30T06:47:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc56a00640 1 -- 172.21.15.37:0/4111100706 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc500b1da0 con 0x7fbc500cfeb0 2024-05-30T06:47:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc56a00640 1 -- 172.21.15.37:0/4111100706 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc50159aa0 con 0x7fbc500cfeb0 2024-05-30T06:47:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.091+0000 7fbc56a00640 1 -- 172.21.15.37:0/4111100706 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc50140770 con 0x7fbc500cfeb0 2024-05-30T06:47:39.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.095+0000 7fbc47e00640 1 -- 172.21.15.37:0/4111100706 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7fbc40007400 con 0x7fbc500cfeb0 2024-05-30T06:47:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.095+0000 7fbc47e00640 1 --2- 172.21.15.37:0/4111100706 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbc30068ad0 0x7fbc3006af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.099+0000 7fbc47e00640 1 -- 172.21.15.37:0/4111100706 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fbc40087190 con 0x7fbc500cfeb0 2024-05-30T06:47:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.099+0000 7fbc4fe00640 1 --2- 172.21.15.37:0/4111100706 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbc30068ad0 0x7fbc3006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:39.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.103+0000 7fbc47e00640 1 -- 172.21.15.37:0/4111100706 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbc500b0150 con 0x7fbc500cfeb0 2024-05-30T06:47:39.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.103+0000 7fbc4fe00640 1 --2- 172.21.15.37:0/4111100706 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbc30068ad0 0x7fbc3006af90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0011f0 tx=0x7fbc3c007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.427+0000 7fbc56a00640 1 -- 172.21.15.37:0/4111100706 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone71654", "target": ["mon-mgr", ""]}) -- 0x7fbc500adb80 con 0x7fbc30068ad0 2024-05-30T06:47:39.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.579+0000 7fbc47e00640 1 -- 172.21.15.37:0/4111100706 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbc500adb80 con 0x7fbc30068ad0 2024-05-30T06:47:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.579+0000 7fbc56a00640 1 -- 172.21.15.37:0/4111100706 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbc30068ad0 msgr2=0x7fbc3006af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.579+0000 7fbc56a00640 1 --2- 172.21.15.37:0/4111100706 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbc30068ad0 0x7fbc3006af90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0011f0 tx=0x7fbc3c007d40 comp rx=0 tx=0).stop 2024-05-30T06:47:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.579+0000 7fbc56a00640 1 -- 172.21.15.37:0/4111100706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc500cfeb0 msgr2=0x7fbc50158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.579+0000 7fbc56a00640 1 --2- 172.21.15.37:0/4111100706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc500cfeb0 0x7fbc50158230 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000c310 tx=0x7fbc4000c7d0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.579+0000 7fbc56a00640 1 -- 172.21.15.37:0/4111100706 shutdown_connections 2024-05-30T06:47:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.579+0000 7fbc56a00640 1 --2- 172.21.15.37:0/4111100706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc50162ba0 0x7fbc50159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.579+0000 7fbc56a00640 1 --2- 172.21.15.37:0/4111100706 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbc30068ad0 0x7fbc3006af90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.579+0000 7fbc56a00640 1 --2- 172.21.15.37:0/4111100706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc500cfeb0 0x7fbc50158230 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.579+0000 7fbc56a00640 1 --2- 172.21.15.37:0/4111100706 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc500afcf0 0x7fbc5015bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.579+0000 7fbc56a00640 1 -- 172.21.15.37:0/4111100706 >> 172.21.15.37:0/4111100706 conn(0x7fbc5006bf60 msgr2=0x7fbc500abbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.579+0000 7fbc56a00640 1 -- 172.21.15.37:0/4111100706 shutdown_connections 2024-05-30T06:47:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.579+0000 7fbc56a00640 1 -- 172.21.15.37:0/4111100706 wait complete. 2024-05-30T06:47:39.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:47:39.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a94a00640 1 Processor -- start 2024-05-30T06:47:39.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a94a00640 1 -- start start 2024-05-30T06:47:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a94a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9015ca30 0x7f5a900b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a94a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a900b3f40 con 0x7f5a900d10f0 2024-05-30T06:47:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a94a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a900b2ec0 con 0x7f5a9015c650 2024-05-30T06:47:39.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a94a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5a900cce80 con 0x7f5a9015ca30 2024-05-30T06:47:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a87e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5a900d10f0 0x7f5a900b2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40792/0 (socket says 172.21.15.37:40792) 2024-05-30T06:47:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a87e00640 1 -- 172.21.15.37:0/3920253585 learned_addr learned my addr 172.21.15.37:0/3920253585 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:47:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a8e800640 1 --2- 172.21.15.37:0/3920253585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9015ca30 0x7f5a900b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:39.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a8d400640 1 -- 172.21.15.37:0/3920253585 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2057083755 0 0) 0x7f5a900b3f40 con 0x7f5a900d10f0 2024-05-30T06:47:39.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a8d400640 1 -- 172.21.15.37:0/3920253585 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a74003530 con 0x7f5a900d10f0 2024-05-30T06:47:39.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a8d400640 1 -- 172.21.15.37:0/3920253585 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662831524 0 0) 0x7f5a900b2ec0 con 0x7f5a9015c650 2024-05-30T06:47:39.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a8e800640 1 -- 172.21.15.37:0/3920253585 >> v1:172.21.15.105:6789/0 conn(0x7f5a9015c650 legacy=0x7f5a900d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a8e800640 1 -- 172.21.15.37:0/3920253585 >> v1:172.21.15.37:6789/0 conn(0x7f5a900d10f0 legacy=0x7f5a900b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.743+0000 7f5a8e800640 1 -- 172.21.15.37:0/3920253585 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a900b3180 con 0x7f5a9015ca30 2024-05-30T06:47:39.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.747+0000 7f5a8e800640 1 --2- 172.21.15.37:0/3920253585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9015ca30 0x7f5a900b2890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009dc0 tx=0x7f5a8801f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=302ee066ea62477f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:39.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.747+0000 7f5a8d400640 1 -- 172.21.15.37:0/3920253585 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a880b4070 con 0x7f5a9015ca30 2024-05-30T06:47:39.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.747+0000 7f5a8d400640 1 -- 172.21.15.37:0/3920253585 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a880af600 con 0x7f5a9015ca30 2024-05-30T06:47:39.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.747+0000 7f5a8d400640 1 -- 172.21.15.37:0/3920253585 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a880af9b0 con 0x7f5a9015ca30 2024-05-30T06:47:39.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.747+0000 7f5a94a00640 1 -- 172.21.15.37:0/3920253585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9015ca30 msgr2=0x7f5a900b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.747+0000 7f5a94a00640 1 --2- 172.21.15.37:0/3920253585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9015ca30 0x7f5a900b2890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009dc0 tx=0x7f5a8801f170 comp rx=0 tx=0).stop 2024-05-30T06:47:39.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.747+0000 7f5a94a00640 1 -- 172.21.15.37:0/3920253585 shutdown_connections 2024-05-30T06:47:39.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.747+0000 7f5a94a00640 1 --2- 172.21.15.37:0/3920253585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9015ca30 0x7f5a900b2890 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.747+0000 7f5a94a00640 1 -- 172.21.15.37:0/3920253585 >> 172.21.15.37:0/3920253585 conn(0x7f5a900b4130 msgr2=0x7f5a900b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:39.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.747+0000 7f5a94a00640 1 -- 172.21.15.37:0/3920253585 shutdown_connections 2024-05-30T06:47:39.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.747+0000 7f5a94a00640 1 -- 172.21.15.37:0/3920253585 wait complete. 2024-05-30T06:47:39.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a94a00640 1 Processor -- start 2024-05-30T06:47:39.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a94a00640 1 -- start start 2024-05-30T06:47:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a94a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a900d10f0 0x7f5a900ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a94a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9015c650 0x7f5a90156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a94a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9015ca30 0x7f5a90156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a94a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a900b3a20 con 0x7f5a9015c650 2024-05-30T06:47:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a94a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5a900b3740 con 0x7f5a900d10f0 2024-05-30T06:47:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a94a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5a900b0420 con 0x7f5a9015ca30 2024-05-30T06:47:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a87e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9015c650 0x7f5a90156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a87e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9015c650 0x7f5a90156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41384/0 (socket says 172.21.15.37:41384) 2024-05-30T06:47:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a87e00640 1 -- 172.21.15.37:0/1516621355 learned_addr learned my addr 172.21.15.37:0/1516621355 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a8e800640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9015ca30 0x7f5a90156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a8de00640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a900d10f0 0x7f5a900ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a87e00640 1 -- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9015ca30 msgr2=0x7f5a90156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a87e00640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9015ca30 0x7f5a90156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a87e00640 1 -- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a900d10f0 msgr2=0x7f5a900ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a87e00640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a900d10f0 0x7f5a900ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a87e00640 1 -- 172.21.15.37:0/1516621355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9006e0f0 con 0x7f5a9015c650 2024-05-30T06:47:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a87e00640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9015c650 0x7f5a90156760 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800c450 tx=0x7f5a7800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a86000640 1 -- 172.21.15.37:0/1516621355 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78017070 con 0x7f5a9015c650 2024-05-30T06:47:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a86000640 1 -- 172.21.15.37:0/1516621355 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a78005cf0 con 0x7f5a9015c650 2024-05-30T06:47:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a86000640 1 -- 172.21.15.37:0/1516621355 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78007290 con 0x7f5a9015c650 2024-05-30T06:47:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a94a00640 1 -- 172.21.15.37:0/1516621355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a9006d850 con 0x7f5a9015c650 2024-05-30T06:47:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.751+0000 7f5a94a00640 1 -- 172.21.15.37:0/1516621355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a9006de10 con 0x7f5a9015c650 2024-05-30T06:47:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.755+0000 7f5a94a00640 1 -- 172.21.15.37:0/1516621355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a90068bc0 con 0x7f5a9015c650 2024-05-30T06:47:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.755+0000 7f5a86000640 1 -- 172.21.15.37:0/1516621355 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7f5a7801a070 con 0x7f5a9015c650 2024-05-30T06:47:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.755+0000 7f5a86000640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a6c068ad0 0x7f5a6c06af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.755+0000 7f5a86000640 1 -- 172.21.15.37:0/1516621355 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f5a78086ef0 con 0x7f5a9015c650 2024-05-30T06:47:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.755+0000 7f5a8de00640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a6c068ad0 0x7f5a6c06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:39.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.755+0000 7f5a8de00640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a6c068ad0 0x7f5a6c06af90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5a80000f70 tx=0x7f5a80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:39.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.759+0000 7f5a86000640 1 -- 172.21.15.37:0/1516621355 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5a78055ee0 con 0x7f5a9015c650 2024-05-30T06:47:39.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.947+0000 7f5a94a00640 1 -- 172.21.15.37:0/1516621355 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f5a900b85a0 con 0x7f5a6c068ad0 2024-05-30T06:47:39.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.951+0000 7f5a86000640 1 -- 172.21.15.37:0/1516621355 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f5a900b85a0 con 0x7f5a6c068ad0 2024-05-30T06:47:39.954 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:47:39.954 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:47:39.954 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:47:39.954 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:39.954 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:47:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.951+0000 7f5a94a00640 1 -- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a6c068ad0 msgr2=0x7f5a6c06af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.951+0000 7f5a94a00640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a6c068ad0 0x7f5a6c06af90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5a80000f70 tx=0x7f5a80009040 comp rx=0 tx=0).stop 2024-05-30T06:47:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.951+0000 7f5a94a00640 1 -- 172.21.15.37:0/1516621355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9015c650 msgr2=0x7f5a90156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.951+0000 7f5a94a00640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9015c650 0x7f5a90156760 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800c450 tx=0x7f5a7800c910 comp rx=0 tx=0).stop 2024-05-30T06:47:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.951+0000 7f5a94a00640 1 -- 172.21.15.37:0/1516621355 shutdown_connections 2024-05-30T06:47:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.951+0000 7f5a94a00640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a9015ca30 0x7f5a90156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.951+0000 7f5a94a00640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a9015c650 0x7f5a90156760 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.951+0000 7f5a94a00640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a6c068ad0 0x7f5a6c06af90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.951+0000 7f5a94a00640 1 --2- 172.21.15.37:0/1516621355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a900d10f0 0x7f5a900ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.951+0000 7f5a94a00640 1 -- 172.21.15.37:0/1516621355 >> 172.21.15.37:0/1516621355 conn(0x7f5a900b4130 msgr2=0x7f5a900b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:39.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.951+0000 7f5a94a00640 1 -- 172.21.15.37:0/1516621355 shutdown_connections 2024-05-30T06:47:39.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:39.951+0000 7f5a94a00640 1 -- 172.21.15.37:0/1516621355 wait complete. 2024-05-30T06:47:39.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:47:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.111+0000 7f7154800640 1 Processor -- start 2024-05-30T06:47:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.111+0000 7f7154800640 1 -- start start 2024-05-30T06:47:40.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.115+0000 7f7154800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f714c0b55a0 0x7f714c0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:40.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.115+0000 7f7154800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f714c162f70 con 0x7f714c15fb30 2024-05-30T06:47:40.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.115+0000 7f7154800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f714c0b5ec0 con 0x7f714c06d080 2024-05-30T06:47:40.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.115+0000 7f7154800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f714c163210 con 0x7f714c0b55a0 2024-05-30T06:47:40.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.115+0000 7f7151e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f714c0b55a0 0x7f714c0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:40.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.115+0000 7f7152800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f714c15fb30 0x7f714c0aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40800/0 (socket says 172.21.15.37:40800) 2024-05-30T06:47:40.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.115+0000 7f7152800640 1 -- 172.21.15.37:0/3837068778 learned_addr learned my addr 172.21.15.37:0/3837068778 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:47:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.115+0000 7f7151e00640 1 -- 172.21.15.37:0/3837068778 >> v1:172.21.15.105:6789/0 conn(0x7f714c06d080 legacy=0x7f714c0b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.115+0000 7f7151e00640 1 -- 172.21.15.37:0/3837068778 >> v1:172.21.15.37:6789/0 conn(0x7f714c15fb30 legacy=0x7f714c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.115+0000 7f7151e00640 1 -- 172.21.15.37:0/3837068778 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714c0b4040 con 0x7f714c0b55a0 2024-05-30T06:47:40.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.115+0000 7f7150a00640 1 -- 172.21.15.37:0/3837068778 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1407968999 0 0) 0x7f714c162f70 con 0x7f714c15fb30 2024-05-30T06:47:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7151e00640 1 --2- 172.21.15.37:0/3837068778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c0b55a0 0x7f714c0b5980 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f71400097c0 tx=0x7f714001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5d23737213796 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7150a00640 1 -- 172.21.15.37:0/3837068778 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71400b0070 con 0x7f714c0b55a0 2024-05-30T06:47:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7150a00640 1 -- 172.21.15.37:0/3837068778 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71400ab600 con 0x7f714c0b55a0 2024-05-30T06:47:40.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7150a00640 1 -- 172.21.15.37:0/3837068778 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71400ab9d0 con 0x7f714c0b55a0 2024-05-30T06:47:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7154800640 1 -- 172.21.15.37:0/3837068778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c0b55a0 msgr2=0x7f714c0b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7154800640 1 --2- 172.21.15.37:0/3837068778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c0b55a0 0x7f714c0b5980 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f71400097c0 tx=0x7f714001c3e0 comp rx=0 tx=0).stop 2024-05-30T06:47:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7154800640 1 -- 172.21.15.37:0/3837068778 shutdown_connections 2024-05-30T06:47:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7154800640 1 --2- 172.21.15.37:0/3837068778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c0b55a0 0x7f714c0b5980 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7154800640 1 -- 172.21.15.37:0/3837068778 >> 172.21.15.37:0/3837068778 conn(0x7f714c073680 msgr2=0x7f714c06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:40.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7154800640 1 -- 172.21.15.37:0/3837068778 shutdown_connections 2024-05-30T06:47:40.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7154800640 1 -- 172.21.15.37:0/3837068778 wait complete. 2024-05-30T06:47:40.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7154800640 1 Processor -- start 2024-05-30T06:47:40.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7154800640 1 -- start start 2024-05-30T06:47:40.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.119+0000 7f7154800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f714c06d080 0x7f714c156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:40.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7154800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c0b55a0 0x7f714c148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:40.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7154800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f714c15fb30 0x7f714c14af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:40.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7154800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f714c16cff0 con 0x7f714c0b55a0 2024-05-30T06:47:40.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7154800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f714c16ce70 con 0x7f714c15fb30 2024-05-30T06:47:40.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7154800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f714c16d170 con 0x7f714c06d080 2024-05-30T06:47:40.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7151400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c0b55a0 0x7f714c148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:40.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7151e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f714c06d080 0x7f714c156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:40.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7151400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c0b55a0 0x7f714c148c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41402/0 (socket says 172.21.15.37:41402) 2024-05-30T06:47:40.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7151400640 1 -- 172.21.15.37:0/2615481673 learned_addr learned my addr 172.21.15.37:0/2615481673 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:40.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7152800640 1 --2- 172.21.15.37:0/2615481673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f714c15fb30 0x7f714c14af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:40.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7151400640 1 -- 172.21.15.37:0/2615481673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f714c06d080 msgr2=0x7f714c156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:40.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7151400640 1 --2- 172.21.15.37:0/2615481673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f714c06d080 0x7f714c156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:40.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7151400640 1 -- 172.21.15.37:0/2615481673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f714c15fb30 msgr2=0x7f714c14af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:40.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7151400640 1 --2- 172.21.15.37:0/2615481673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f714c15fb30 0x7f714c14af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:40.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7151400640 1 -- 172.21.15.37:0/2615481673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714c154650 con 0x7f714c0b55a0 2024-05-30T06:47:40.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7151400640 1 --2- 172.21.15.37:0/2615481673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c0b55a0 0x7f714c148c10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f713c00c4d0 tx=0x7f713c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:40.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7146000640 1 -- 172.21.15.37:0/2615481673 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c0052d0 con 0x7f714c0b55a0 2024-05-30T06:47:40.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7146000640 1 -- 172.21.15.37:0/2615481673 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713c005470 con 0x7f714c0b55a0 2024-05-30T06:47:40.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7146000640 1 -- 172.21.15.37:0/2615481673 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c012830 con 0x7f714c0b55a0 2024-05-30T06:47:40.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7154800640 1 -- 172.21.15.37:0/2615481673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714c154930 con 0x7f714c0b55a0 2024-05-30T06:47:40.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7154800640 1 -- 172.21.15.37:0/2615481673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f714c154ef0 con 0x7f714c0b55a0 2024-05-30T06:47:40.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7154800640 1 -- 172.21.15.37:0/2615481673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f714c1550f0 con 0x7f714c0b55a0 2024-05-30T06:47:40.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.123+0000 7f7146000640 1 -- 172.21.15.37:0/2615481673 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7f713c0129d0 con 0x7f714c0b55a0 2024-05-30T06:47:40.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.127+0000 7f7146000640 1 --2- 172.21.15.37:0/2615481673 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7130068ad0 0x7f713006af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:40.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.127+0000 7f7146000640 1 -- 172.21.15.37:0/2615481673 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f713c087670 con 0x7f714c0b55a0 2024-05-30T06:47:40.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.127+0000 7f7151e00640 1 --2- 172.21.15.37:0/2615481673 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7130068ad0 0x7f713006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:40.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.127+0000 7f7151e00640 1 --2- 172.21.15.37:0/2615481673 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7130068ad0 0x7f713006af90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f71400ad000 tx=0x7f71400a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.131+0000 7f7146000640 1 -- 172.21.15.37:0/2615481673 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f714c1550f0 con 0x7f714c0b55a0 2024-05-30T06:47:40.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.351+0000 7f7154800640 1 -- 172.21.15.37:0/2615481673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f714c06ee50 con 0x7f714c0b55a0 2024-05-30T06:47:40.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.351+0000 7f7146000640 1 -- 172.21.15.37:0/2615481673 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2139 (secure 0 0 0) 0x7f713c056660 con 0x7f714c0b55a0 2024-05-30T06:47:40.356 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:47:40.356 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:47:40.357 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:47:40.357 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:47:40.357 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:47:40.357 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:47:40.357 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:47:40.357 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:40.357 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:47:40.357 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:47:40.357 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:47:40.357 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:47:40.357 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:47:40.357 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:40.358 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:47:40.358 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:47:40.358 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:47:40.358 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:47:40.358 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:40.358 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 354, 2024-05-30T06:47:40.358 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:47:40.358 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:47:40.358 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:47:40.358 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:47:40.358 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:40.358 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:47:40.359 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 48, 2024-05-30T06:47:40.359 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:47:40.359 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:47:40.359 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:47:40.359 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:47:40.359 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:47:40.359 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:47:40.359 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:40.359 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:47:40.359 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:47:40.359 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:47:40.359 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:47:40.359 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:47:40.360 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:40.360 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:40.360 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:47:40.360 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:47:40.360 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 3219, 2024-05-30T06:47:40.360 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 13356159208, 2024-05-30T06:47:40.360 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 26125807616, 2024-05-30T06:47:40.360 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 746968305664, 2024-05-30T06:47:40.360 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:47:40.360 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 231623305, 2024-05-30T06:47:40.360 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 218032707, 2024-05-30T06:47:40.360 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 56, 2024-05-30T06:47:40.360 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 62 2024-05-30T06:47:40.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:40.361 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:47:40.361 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 28, 2024-05-30T06:47:40.361 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 3, 2024-05-30T06:47:40.361 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:47:40.361 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:47:40.361 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:47:40.361 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:47:40.361 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:47:40.361 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 3, 2024-05-30T06:47:40.361 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:47:40.361 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:47:40.361 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:47:40.362 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5652 2024-05-30T06:47:40.362 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:40.362 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:40.362 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:47:40.362 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:40.362 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:47:40.362 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:47:40.362 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:47:40.362 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:47:40.362 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:47:40.362 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:47:40.362 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:47:40.362 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:46:54.717237+0000", 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: "3cf17b2a-061c-411c-9131-5456a47b7bcd": { 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "2 ongoing clones; Avg progress is 9.61% (8s)\n [==..........................] (remaining: 79s)", 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.096100002527236938, 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:40.363 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:40.364 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:47:40.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.355+0000 7f7154800640 1 -- 172.21.15.37:0/2615481673 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7130068ad0 msgr2=0x7f713006af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.355+0000 7f7154800640 1 --2- 172.21.15.37:0/2615481673 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7130068ad0 0x7f713006af90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f71400ad000 tx=0x7f71400a6000 comp rx=0 tx=0).stop 2024-05-30T06:47:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.355+0000 7f7154800640 1 -- 172.21.15.37:0/2615481673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c0b55a0 msgr2=0x7f714c148c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.355+0000 7f7154800640 1 --2- 172.21.15.37:0/2615481673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c0b55a0 0x7f714c148c10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f713c00c4d0 tx=0x7f713c00c990 comp rx=0 tx=0).stop 2024-05-30T06:47:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.355+0000 7f7154800640 1 -- 172.21.15.37:0/2615481673 shutdown_connections 2024-05-30T06:47:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.355+0000 7f7154800640 1 --2- 172.21.15.37:0/2615481673 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7130068ad0 0x7f713006af90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.355+0000 7f7154800640 1 --2- 172.21.15.37:0/2615481673 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f714c15fb30 0x7f714c14af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.355+0000 7f7154800640 1 --2- 172.21.15.37:0/2615481673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f714c0b55a0 0x7f714c148c10 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.355+0000 7f7154800640 1 --2- 172.21.15.37:0/2615481673 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f714c06d080 0x7f714c156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.355+0000 7f7154800640 1 -- 172.21.15.37:0/2615481673 >> 172.21.15.37:0/2615481673 conn(0x7f714c073680 msgr2=0x7f714c0b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.355+0000 7f7154800640 1 -- 172.21.15.37:0/2615481673 shutdown_connections 2024-05-30T06:47:40.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:40.355+0000 7f7154800640 1 -- 172.21.15.37:0/2615481673 wait complete. 2024-05-30T06:47:45.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:47:45.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99b4a00640 1 Processor -- start 2024-05-30T06:47:45.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99b4a00640 1 -- start start 2024-05-30T06:47:45.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99b4a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99b01605d0 0x7f99b00b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:45.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99b4a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f99b015fee0 0x7f99b0160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:45.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99b4a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b00cdda0 con 0x7f99b01609b0 2024-05-30T06:47:45.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99b4a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f99b00ce080 con 0x7f99b01605d0 2024-05-30T06:47:45.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99b4a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f99b009ac00 con 0x7f99b015fee0 2024-05-30T06:47:45.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99ae800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99b01605d0 0x7f99b00b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:45.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99a5e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f99b01609b0 0x7f99b015f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40812/0 (socket says 172.21.15.37:40812) 2024-05-30T06:47:45.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99a5e00640 1 -- 172.21.15.37:0/3576666970 learned_addr learned my addr 172.21.15.37:0/3576666970 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:47:45.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99ae800640 1 -- 172.21.15.37:0/3576666970 >> v2:172.21.15.105:3300/0 conn(0x7f99b015fee0 msgr2=0x7f99b0160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:45.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99af200640 1 --2- 172.21.15.37:0/3576666970 >> v2:172.21.15.105:3300/0 conn(0x7f99b015fee0 0x7f99b0160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:45.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99ae800640 1 --2- 172.21.15.37:0/3576666970 >> v2:172.21.15.105:3300/0 conn(0x7f99b015fee0 0x7f99b0160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:45.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99ade00640 1 -- 172.21.15.37:0/3576666970 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3026091467 0 0) 0x7f99b00cdda0 con 0x7f99b01609b0 2024-05-30T06:47:45.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99ae800640 1 -- 172.21.15.37:0/3576666970 >> v1:172.21.15.37:6789/0 conn(0x7f99b01609b0 legacy=0x7f99b015f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:45.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99ae800640 1 -- 172.21.15.37:0/3576666970 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b009aee0 con 0x7f99b01605d0 2024-05-30T06:47:45.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.531+0000 7f99af200640 1 --2- 172.21.15.37:0/3576666970 >> v2:172.21.15.105:3300/0 conn(0x7f99b015fee0 0x7f99b0160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:47:45.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.535+0000 7f99ae800640 1 --2- 172.21.15.37:0/3576666970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b01605d0 0x7f99b00b52b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f99b00730c0 tx=0x7f99a001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f384f0ab6b989cc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:45.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.535+0000 7f99ade00640 1 -- 172.21.15.37:0/3576666970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a00b0070 con 0x7f99b01605d0 2024-05-30T06:47:45.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.535+0000 7f99ade00640 1 -- 172.21.15.37:0/3576666970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a00ab600 con 0x7f99b01605d0 2024-05-30T06:47:45.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.535+0000 7f99ade00640 1 -- 172.21.15.37:0/3576666970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a00ab9d0 con 0x7f99b01605d0 2024-05-30T06:47:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.535+0000 7f99b4a00640 1 -- 172.21.15.37:0/3576666970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b01605d0 msgr2=0x7f99b00b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.535+0000 7f99b4a00640 1 --2- 172.21.15.37:0/3576666970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b01605d0 0x7f99b00b52b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f99b00730c0 tx=0x7f99a001c480 comp rx=0 tx=0).stop 2024-05-30T06:47:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.535+0000 7f99b4a00640 1 -- 172.21.15.37:0/3576666970 shutdown_connections 2024-05-30T06:47:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.535+0000 7f99b4a00640 1 --2- 172.21.15.37:0/3576666970 >> v2:172.21.15.105:3300/0 conn(0x7f99b015fee0 0x7f99b0160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.535+0000 7f99b4a00640 1 --2- 172.21.15.37:0/3576666970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b01605d0 0x7f99b00b52b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.535+0000 7f99b4a00640 1 -- 172.21.15.37:0/3576666970 >> 172.21.15.37:0/3576666970 conn(0x7f99b00b3f50 msgr2=0x7f99b00b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.535+0000 7f99b4a00640 1 -- 172.21.15.37:0/3576666970 shutdown_connections 2024-05-30T06:47:45.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.535+0000 7f99b4a00640 1 -- 172.21.15.37:0/3576666970 wait complete. 2024-05-30T06:47:45.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99b4a00640 1 Processor -- start 2024-05-30T06:47:45.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99b4a00640 1 -- start start 2024-05-30T06:47:45.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99b4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b015fee0 0x7f99b00c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:45.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99b4a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99b01605d0 0x7f99b00b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:45.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99b4a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99b01609b0 0x7f99b0154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:45.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99b4a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f99b01696b0 con 0x7f99b015fee0 2024-05-30T06:47:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99b4a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f99b009be20 con 0x7f99b01605d0 2024-05-30T06:47:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99b4a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f99b0169830 con 0x7f99b01609b0 2024-05-30T06:47:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99ae800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b015fee0 0x7f99b00c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99ae800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b015fee0 0x7f99b00c6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41410/0 (socket says 172.21.15.37:41410) 2024-05-30T06:47:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99ae800640 1 -- 172.21.15.37:0/346814506 learned_addr learned my addr 172.21.15.37:0/346814506 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99a5e00640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99b01605d0 0x7f99b00b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99af200640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99b01609b0 0x7f99b0154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99ae800640 1 -- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99b01609b0 msgr2=0x7f99b0154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99ae800640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99b01609b0 0x7f99b0154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99ae800640 1 -- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99b01605d0 msgr2=0x7f99b00b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99ae800640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99b01605d0 0x7f99b00b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99ae800640 1 -- 172.21.15.37:0/346814506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b00b6080 con 0x7f99b015fee0 2024-05-30T06:47:45.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99ae800640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b015fee0 0x7f99b00c6240 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f99a0019090 tx=0x7f99a001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99a7400640 1 -- 172.21.15.37:0/346814506 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a00b0050 con 0x7f99b015fee0 2024-05-30T06:47:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99a7400640 1 -- 172.21.15.37:0/346814506 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a00bc070 con 0x7f99b015fee0 2024-05-30T06:47:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99a7400640 1 -- 172.21.15.37:0/346814506 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a00b5a10 con 0x7f99b015fee0 2024-05-30T06:47:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99b4a00640 1 -- 172.21.15.37:0/346814506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b00b6320 con 0x7f99b015fee0 2024-05-30T06:47:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99b4a00640 1 -- 172.21.15.37:0/346814506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b00b68e0 con 0x7f99b015fee0 2024-05-30T06:47:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.539+0000 7f99b4a00640 1 -- 172.21.15.37:0/346814506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b0068ab0 con 0x7f99b015fee0 2024-05-30T06:47:45.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.543+0000 7f99a7400640 1 -- 172.21.15.37:0/346814506 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7f99a00ab4a0 con 0x7f99b015fee0 2024-05-30T06:47:45.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.543+0000 7f99a7400640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f998c068ad0 0x7f998c06af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:45.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.543+0000 7f99a7400640 1 -- 172.21.15.37:0/346814506 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f99a01221d0 con 0x7f99b015fee0 2024-05-30T06:47:45.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.543+0000 7f99a5e00640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f998c068ad0 0x7f998c06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:45.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.543+0000 7f99a5e00640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f998c068ad0 0x7f998c06af90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f99b0167520 tx=0x7f9998007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:45.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.547+0000 7f99a7400640 1 -- 172.21.15.37:0/346814506 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f99a0016070 con 0x7f99b015fee0 2024-05-30T06:47:45.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.771+0000 7f99b4a00640 1 -- 172.21.15.37:0/346814506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f99b015e110 con 0x7f99b015fee0 2024-05-30T06:47:45.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.775+0000 7f99a7400640 1 -- 172.21.15.37:0/346814506 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2125 (secure 0 0 0) 0x7f99a00f1ba0 con 0x7f99b015fee0 2024-05-30T06:47:45.776 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:47:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:47:45.777 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:47:45.777 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:47:45.777 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:47:45.777 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:47:45.777 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:47:45.777 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:45.777 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:47:45.777 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:47:45.777 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:47:45.778 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:47:45.778 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:47:45.778 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:45.778 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:47:45.778 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:47:45.778 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:47:45.778 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:47:45.778 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:45.778 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 360, 2024-05-30T06:47:45.778 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:47:45.778 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:47:45.778 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:47:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:47:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:47:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 48, 2024-05-30T06:47:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:47:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:47:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:47:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:47:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:47:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:47:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:47:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4189, 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 17433379213, 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 35250397184, 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 737843716096, 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 565926100, 2024-05-30T06:47:45.780 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 557603050, 2024-05-30T06:47:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 138, 2024-05-30T06:47:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 154 2024-05-30T06:47:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:47:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 28, 2024-05-30T06:47:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 3, 2024-05-30T06:47:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:47:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:47:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:47:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:47:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:47:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 3, 2024-05-30T06:47:45.781 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:47:45.782 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:47:45.782 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:47:45.782 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5652 2024-05-30T06:47:45.782 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:45.782 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:45.782 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:47:45.782 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:45.782 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:47:45.782 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:47:45.782 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:47:45.782 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:47:45.782 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:47:45.783 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:47:45.783 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:47:45.783 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:45.783 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:47:45.783 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:45.783 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:47:45.783 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-05-30T06:47:45.783 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:46:54.717237+0000", 2024-05-30T06:47:45.783 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:47:45.783 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:45.783 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:47:45.783 INFO:teuthology.orchestra.run.smithi037.stdout: "3cf17b2a-061c-411c-9131-5456a47b7bcd": { 2024-05-30T06:47:45.783 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 26.0 seconds before exiting (14s)\n [============================] ", 2024-05-30T06:47:45.784 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:47:45.784 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:47:45.784 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:45.784 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:45.784 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:47:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.775+0000 7f99b4a00640 1 -- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f998c068ad0 msgr2=0x7f998c06af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.775+0000 7f99b4a00640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f998c068ad0 0x7f998c06af90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f99b0167520 tx=0x7f9998007c10 comp rx=0 tx=0).stop 2024-05-30T06:47:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.775+0000 7f99b4a00640 1 -- 172.21.15.37:0/346814506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b015fee0 msgr2=0x7f99b00c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.775+0000 7f99b4a00640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b015fee0 0x7f99b00c6240 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f99a0019090 tx=0x7f99a001acc0 comp rx=0 tx=0).stop 2024-05-30T06:47:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.775+0000 7f99b4a00640 1 -- 172.21.15.37:0/346814506 shutdown_connections 2024-05-30T06:47:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.775+0000 7f99b4a00640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99b01609b0 0x7f99b0154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.775+0000 7f99b4a00640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f998c068ad0 0x7f998c06af90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.775+0000 7f99b4a00640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99b01605d0 0x7f99b00b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.775+0000 7f99b4a00640 1 --2- 172.21.15.37:0/346814506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b015fee0 0x7f99b00c6240 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:45.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.775+0000 7f99b4a00640 1 -- 172.21.15.37:0/346814506 >> 172.21.15.37:0/346814506 conn(0x7f99b00b3f50 msgr2=0x7f99b006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:45.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.775+0000 7f99b4a00640 1 -- 172.21.15.37:0/346814506 shutdown_connections 2024-05-30T06:47:45.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:45.775+0000 7f99b4a00640 1 -- 172.21.15.37:0/346814506 wait complete. 2024-05-30T06:47:50.799 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:47:50.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.943+0000 7f0e39800640 1 Processor -- start 2024-05-30T06:47:50.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.943+0000 7f0e39800640 1 -- start start 2024-05-30T06:47:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.943+0000 7f0e39800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e340707e0 0x7f0e3415f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.943+0000 7f0e39800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0e340cdb80 0x7f0e341650b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.943+0000 7f0e39800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e3415ba70 con 0x7f0e340b3bb0 2024-05-30T06:47:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.943+0000 7f0e39800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0e3415bd50 con 0x7f0e340707e0 2024-05-30T06:47:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.943+0000 7f0e39800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0e3415c030 con 0x7f0e340cdb80 2024-05-30T06:47:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.943+0000 7f0e33e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e340707e0 0x7f0e3415f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:50.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.947+0000 7f0e33e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e340707e0 0x7f0e3415f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32802/0 (socket says 172.21.15.37:32802) 2024-05-30T06:47:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.947+0000 7f0e33e00640 1 -- 172.21.15.37:0/3101149387 learned_addr learned my addr 172.21.15.37:0/3101149387 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.947+0000 7f0e33e00640 1 -- 172.21.15.37:0/3101149387 >> v2:172.21.15.105:3300/0 conn(0x7f0e340cdb80 msgr2=0x7f0e341650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.947+0000 7f0e33e00640 1 --2- 172.21.15.37:0/3101149387 >> v2:172.21.15.105:3300/0 conn(0x7f0e340cdb80 0x7f0e341650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.947+0000 7f0e33e00640 1 -- 172.21.15.37:0/3101149387 >> v1:172.21.15.105:6789/0 conn(0x7f0e340b3bb0 legacy=0x7f0e340cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:47:50.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.947+0000 7f0e33e00640 1 -- 172.21.15.37:0/3101149387 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3415c310 con 0x7f0e340707e0 2024-05-30T06:47:50.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.947+0000 7f0e33e00640 1 --2- 172.21.15.37:0/3101149387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e340707e0 0x7f0e3415f960 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0e3415b960 tx=0x7f0e2401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3138e56857d77f7f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.947+0000 7f0e33400640 1 -- 172.21.15.37:0/3101149387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e240aa5f0 con 0x7f0e340707e0 2024-05-30T06:47:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.947+0000 7f0e33400640 1 -- 172.21.15.37:0/3101149387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e240af070 con 0x7f0e340707e0 2024-05-30T06:47:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.947+0000 7f0e33400640 1 -- 172.21.15.37:0/3101149387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e240aa9b0 con 0x7f0e340707e0 2024-05-30T06:47:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.947+0000 7f0e39800640 1 -- 172.21.15.37:0/3101149387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e340707e0 msgr2=0x7f0e3415f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:50.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.947+0000 7f0e39800640 1 --2- 172.21.15.37:0/3101149387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e340707e0 0x7f0e3415f960 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0e3415b960 tx=0x7f0e2401c470 comp rx=0 tx=0).stop 2024-05-30T06:47:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 -- 172.21.15.37:0/3101149387 shutdown_connections 2024-05-30T06:47:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 --2- 172.21.15.37:0/3101149387 >> v2:172.21.15.105:3300/0 conn(0x7f0e340cdb80 0x7f0e341650b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 --2- 172.21.15.37:0/3101149387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e340707e0 0x7f0e3415f960 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 -- 172.21.15.37:0/3101149387 >> 172.21.15.37:0/3101149387 conn(0x7f0e3406b960 msgr2=0x7f0e3406bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 -- 172.21.15.37:0/3101149387 shutdown_connections 2024-05-30T06:47:50.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 -- 172.21.15.37:0/3101149387 wait complete. 2024-05-30T06:47:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 Processor -- start 2024-05-30T06:47:50.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 -- start start 2024-05-30T06:47:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e340707e0 0x7f0e341568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e340b3bb0 0x7f0e341540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e340cdb80 0x7f0e3413be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0e34168020 con 0x7f0e340b3bb0 2024-05-30T06:47:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3415ed20 con 0x7f0e340cdb80 2024-05-30T06:47:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e39800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e341681a0 con 0x7f0e340707e0 2024-05-30T06:47:50.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e2b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e340b3bb0 0x7f0e341540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e2b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e340b3bb0 0x7f0e341540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32804/0 (socket says 172.21.15.37:32804) 2024-05-30T06:47:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e2b400640 1 -- 172.21.15.37:0/3161630270 learned_addr learned my addr 172.21.15.37:0/3161630270 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e38e00640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e340cdb80 0x7f0e3413be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e33e00640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e340707e0 0x7f0e341568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e2b400640 1 -- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e340707e0 msgr2=0x7f0e341568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e2b400640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e340707e0 0x7f0e341568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e2b400640 1 -- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e340cdb80 msgr2=0x7f0e3413be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e2b400640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e340cdb80 0x7f0e3413be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e2b400640 1 -- 172.21.15.37:0/3161630270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3413c350 con 0x7f0e340b3bb0 2024-05-30T06:47:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e2b400640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e340b3bb0 0x7f0e341540e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00c7a0 tx=0x7f0e1c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.951+0000 7f0e30c00640 1 -- 172.21.15.37:0/3161630270 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c017070 con 0x7f0e340b3bb0 2024-05-30T06:47:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.955+0000 7f0e30c00640 1 -- 172.21.15.37:0/3161630270 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e1c003db0 con 0x7f0e340b3bb0 2024-05-30T06:47:50.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.955+0000 7f0e39800640 1 -- 172.21.15.37:0/3161630270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3413c620 con 0x7f0e340b3bb0 2024-05-30T06:47:50.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.955+0000 7f0e30c00640 1 -- 172.21.15.37:0/3161630270 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c0052b0 con 0x7f0e340b3bb0 2024-05-30T06:47:50.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.955+0000 7f0e39800640 1 -- 172.21.15.37:0/3161630270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3413cbe0 con 0x7f0e340b3bb0 2024-05-30T06:47:50.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.955+0000 7f0e39800640 1 -- 172.21.15.37:0/3161630270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e34075580 con 0x7f0e340b3bb0 2024-05-30T06:47:50.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.955+0000 7f0e30c00640 1 -- 172.21.15.37:0/3161630270 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7f0e1c01a070 con 0x7f0e340b3bb0 2024-05-30T06:47:50.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.955+0000 7f0e30c00640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e10068ad0 0x7f0e1006af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:50.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.955+0000 7f0e30c00640 1 -- 172.21.15.37:0/3161630270 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f0e1c087160 con 0x7f0e340b3bb0 2024-05-30T06:47:50.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.955+0000 7f0e33e00640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e10068ad0 0x7f0e1006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:50.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.955+0000 7f0e33e00640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e10068ad0 0x7f0e1006af90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0e240ae000 tx=0x7f0e240a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:50.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:50.959+0000 7f0e30c00640 1 -- 172.21.15.37:0/3161630270 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e1c0561e0 con 0x7f0e340b3bb0 2024-05-30T06:47:51.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.179+0000 7f0e39800640 1 -- 172.21.15.37:0/3161630270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0e3415cca0 con 0x7f0e340b3bb0 2024-05-30T06:47:51.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.179+0000 7f0e30c00640 1 -- 172.21.15.37:0/3161630270 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2123 (secure 0 0 0) 0x7f0e1c05a4e0 con 0x7f0e340b3bb0 2024-05-30T06:47:51.184 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:47:51.184 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:47:51.184 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:47:51.184 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:47:51.184 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:47:51.184 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:47:51.184 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 365, 2024-05-30T06:47:51.185 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:47:51.186 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:47:51.186 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:47:51.186 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:47:51.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:51.186 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:47:51.186 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 48, 2024-05-30T06:47:51.186 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:47:51.186 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:47:51.186 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:47:51.186 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:47:51.186 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:47:51.186 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:47:51.187 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:51.187 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:47:51.187 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:47:51.187 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:47:51.187 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:47:51.187 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:47:51.187 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:51.187 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:51.187 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:47:51.187 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:47:51.187 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4188, 2024-05-30T06:47:51.187 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 17433422553, 2024-05-30T06:47:51.187 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 35250479104, 2024-05-30T06:47:51.188 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 737843634176, 2024-05-30T06:47:51.188 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:47:51.188 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 334371475, 2024-05-30T06:47:51.188 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 339648620, 2024-05-30T06:47:51.188 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 82, 2024-05-30T06:47:51.188 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 93 2024-05-30T06:47:51.188 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:51.188 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:47:51.188 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 28, 2024-05-30T06:47:51.188 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 3, 2024-05-30T06:47:51.188 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:47:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:47:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:47:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:47:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:47:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 3, 2024-05-30T06:47:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:47:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:47:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:47:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5652 2024-05-30T06:47:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:47:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:51.190 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:47:51.190 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:47:51.190 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:47:51.190 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:47:51.190 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:47:51.190 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:47:51.190 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:47:51.190 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:51.190 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:47:51.190 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:51.190 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:47:51.190 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-05-30T06:47:51.190 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:46:54.717237+0000", 2024-05-30T06:47:51.191 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:47:51.191 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:51.191 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:47:51.191 INFO:teuthology.orchestra.run.smithi037.stdout: "3cf17b2a-061c-411c-9131-5456a47b7bcd": { 2024-05-30T06:47:51.191 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 20.0 seconds before exiting (20s)\n [============================] ", 2024-05-30T06:47:51.191 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:47:51.191 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:47:51.191 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:51.191 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:51.191 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:47:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.183+0000 7f0e39800640 1 -- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e10068ad0 msgr2=0x7f0e1006af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.183+0000 7f0e39800640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e10068ad0 0x7f0e1006af90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0e240ae000 tx=0x7f0e240a7000 comp rx=0 tx=0).stop 2024-05-30T06:47:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.183+0000 7f0e39800640 1 -- 172.21.15.37:0/3161630270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e340b3bb0 msgr2=0x7f0e341540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.183+0000 7f0e39800640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e340b3bb0 0x7f0e341540e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00c7a0 tx=0x7f0e1c00cc60 comp rx=0 tx=0).stop 2024-05-30T06:47:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.183+0000 7f0e39800640 1 -- 172.21.15.37:0/3161630270 shutdown_connections 2024-05-30T06:47:51.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.183+0000 7f0e39800640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e10068ad0 0x7f0e1006af90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.183+0000 7f0e39800640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e340cdb80 0x7f0e3413be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.183+0000 7f0e39800640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e340b3bb0 0x7f0e341540e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.183+0000 7f0e39800640 1 --2- 172.21.15.37:0/3161630270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e340707e0 0x7f0e341568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.183+0000 7f0e39800640 1 -- 172.21.15.37:0/3161630270 >> 172.21.15.37:0/3161630270 conn(0x7f0e3406b960 msgr2=0x7f0e34072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.183+0000 7f0e39800640 1 -- 172.21.15.37:0/3161630270 shutdown_connections 2024-05-30T06:47:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:51.183+0000 7f0e39800640 1 -- 172.21.15.37:0/3161630270 wait complete. 2024-05-30T06:47:56.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:47:56.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.347+0000 7f00d7200640 1 Processor -- start 2024-05-30T06:47:56.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.347+0000 7f00d7200640 1 -- start start 2024-05-30T06:47:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.351+0000 7f00d7200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f00d0162cb0 0x7f00d00ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.351+0000 7f00d7200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00d009abe0 con 0x7f00d009b9a0 2024-05-30T06:47:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.351+0000 7f00d7200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00d009aec0 con 0x7f00d015e930 2024-05-30T06:47:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.351+0000 7f00d7200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f00d009b1a0 con 0x7f00d0162cb0 2024-05-30T06:47:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.351+0000 7f00cf400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f00d009b9a0 0x7f00d01625a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51344/0 (socket says 172.21.15.37:51344) 2024-05-30T06:47:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.351+0000 7f00cf400640 1 -- 172.21.15.37:0/3777781337 learned_addr learned my addr 172.21.15.37:0/3777781337 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:47:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.351+0000 7f00d5200640 1 --2- 172.21.15.37:0/3777781337 >> v2:172.21.15.37:3300/0 conn(0x7f00d0162cb0 0x7f00d00ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.351+0000 7f00cea00640 1 -- 172.21.15.37:0/3777781337 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782338587 0 0) 0x7f00d009abe0 con 0x7f00d009b9a0 2024-05-30T06:47:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.351+0000 7f00cea00640 1 -- 172.21.15.37:0/3777781337 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00b4003530 con 0x7f00d009b9a0 2024-05-30T06:47:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.351+0000 7f00d5200640 1 -- 172.21.15.37:0/3777781337 >> v1:172.21.15.105:6789/0 conn(0x7f00d015e930 legacy=0x7f00d00d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.351+0000 7f00d5200640 1 -- 172.21.15.37:0/3777781337 >> v1:172.21.15.37:6789/0 conn(0x7f00d009b9a0 legacy=0x7f00d01625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.351+0000 7f00d5200640 1 -- 172.21.15.37:0/3777781337 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d009b480 con 0x7f00d0162cb0 2024-05-30T06:47:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.355+0000 7f00d5200640 1 --2- 172.21.15.37:0/3777781337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d0162cb0 0x7f00d00ccc60 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009d90 tx=0x7f00c801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8d428ebde7ef85 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.355+0000 7f00cea00640 1 -- 172.21.15.37:0/3777781337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c80b2070 con 0x7f00d0162cb0 2024-05-30T06:47:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.355+0000 7f00cea00640 1 -- 172.21.15.37:0/3777781337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c80a5880 con 0x7f00d0162cb0 2024-05-30T06:47:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.355+0000 7f00cea00640 1 -- 172.21.15.37:0/3777781337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c80a5c50 con 0x7f00d0162cb0 2024-05-30T06:47:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.355+0000 7f00d7200640 1 -- 172.21.15.37:0/3777781337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d0162cb0 msgr2=0x7f00d00ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.355+0000 7f00d7200640 1 --2- 172.21.15.37:0/3777781337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d0162cb0 0x7f00d00ccc60 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009d90 tx=0x7f00c801c970 comp rx=0 tx=0).stop 2024-05-30T06:47:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.355+0000 7f00d7200640 1 -- 172.21.15.37:0/3777781337 shutdown_connections 2024-05-30T06:47:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.355+0000 7f00d7200640 1 --2- 172.21.15.37:0/3777781337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d0162cb0 0x7f00d00ccc60 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.355+0000 7f00d7200640 1 -- 172.21.15.37:0/3777781337 >> 172.21.15.37:0/3777781337 conn(0x7f00d00b4100 msgr2=0x7f00d00b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.355+0000 7f00d7200640 1 -- 172.21.15.37:0/3777781337 shutdown_connections 2024-05-30T06:47:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.355+0000 7f00d7200640 1 -- 172.21.15.37:0/3777781337 wait complete. 2024-05-30T06:47:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.355+0000 7f00d7200640 1 Processor -- start 2024-05-30T06:47:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.355+0000 7f00d7200640 1 -- start start 2024-05-30T06:47:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d7200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d009b9a0 0x7f00d00b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d7200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00d015e930 0x7f00d0153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d7200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d0162cb0 0x7f00d00b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d7200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00d015ee90 con 0x7f00d0162cb0 2024-05-30T06:47:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d7200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f00d015ed10 con 0x7f00d015e930 2024-05-30T06:47:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d7200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f00d016c950 con 0x7f00d009b9a0 2024-05-30T06:47:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d0162cb0 0x7f00d00b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d0162cb0 0x7f00d00b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32826/0 (socket says 172.21.15.37:32826) 2024-05-30T06:47:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d5200640 1 -- 172.21.15.37:0/3849657500 learned_addr learned my addr 172.21.15.37:0/3849657500 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:47:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00cfe00640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d009b9a0 0x7f00d00b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00cf400640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00d015e930 0x7f00d0153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d5200640 1 -- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d009b9a0 msgr2=0x7f00d00b7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d5200640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d009b9a0 0x7f00d00b7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d5200640 1 -- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00d015e930 msgr2=0x7f00d0153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d5200640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00d015e930 0x7f00d0153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d5200640 1 -- 172.21.15.37:0/3849657500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d00d1750 con 0x7f00d0162cb0 2024-05-30T06:47:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00cfe00640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d009b9a0 0x7f00d00b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:47:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00cf400640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00d015e930 0x7f00d0153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:47:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d5200640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d0162cb0 0x7f00d00b7100 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009d90 tx=0x7f00c8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00c7e00640 1 -- 172.21.15.37:0/3849657500 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c80b2050 con 0x7f00d0162cb0 2024-05-30T06:47:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00c7e00640 1 -- 172.21.15.37:0/3849657500 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c80be070 con 0x7f00d0162cb0 2024-05-30T06:47:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00c7e00640 1 -- 172.21.15.37:0/3849657500 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c80ada90 con 0x7f00d0162cb0 2024-05-30T06:47:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d7200640 1 -- 172.21.15.37:0/3849657500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d00b5fc0 con 0x7f00d0162cb0 2024-05-30T06:47:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d7200640 1 -- 172.21.15.37:0/3849657500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d00b6540 con 0x7f00d0162cb0 2024-05-30T06:47:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00d7200640 1 -- 172.21.15.37:0/3849657500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d0068b20 con 0x7f00d0162cb0 2024-05-30T06:47:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.359+0000 7f00c7e00640 1 -- 172.21.15.37:0/3849657500 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7f00c80a5700 con 0x7f00d0162cb0 2024-05-30T06:47:56.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.363+0000 7f00c7e00640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f00b0068b00 0x7f00b006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:47:56.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.363+0000 7f00c7e00640 1 -- 172.21.15.37:0/3849657500 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f00c8122850 con 0x7f00d0162cb0 2024-05-30T06:47:56.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.363+0000 7f00cfe00640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f00b0068b00 0x7f00b006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:47:56.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.363+0000 7f00cfe00640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f00b0068b00 0x7f00b006afc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f00c00016f0 tx=0x7f00c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:47:56.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.367+0000 7f00c7e00640 1 -- 172.21.15.37:0/3849657500 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f00c8016560 con 0x7f00d0162cb0 2024-05-30T06:47:56.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.587+0000 7f00d7200640 1 -- 172.21.15.37:0/3849657500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f00d00b7ca0 con 0x7f00d0162cb0 2024-05-30T06:47:56.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.587+0000 7f00c7e00640 1 -- 172.21.15.37:0/3849657500 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2121 (secure 0 0 0) 0x7f00c80ab340 con 0x7f00d0162cb0 2024-05-30T06:47:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:47:56.588 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:47:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:47:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:47:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:47:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:47:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:47:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:47:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:47:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:47:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:47:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:47:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:47:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:47:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:47:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:47:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 370, 2024-05-30T06:47:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:47:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:47:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:47:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:47:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:47:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 48, 2024-05-30T06:47:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:47:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:47:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:47:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:47:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4188, 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 17433435283, 2024-05-30T06:47:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 35250503680, 2024-05-30T06:47:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 737843609600, 2024-05-30T06:47:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:47:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 39487210, 2024-05-30T06:47:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 44045500, 2024-05-30T06:47:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 10, 2024-05-30T06:47:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 16 2024-05-30T06:47:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:47:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 28, 2024-05-30T06:47:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 3, 2024-05-30T06:47:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:47:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:47:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:47:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:47:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:47:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 3, 2024-05-30T06:47:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:47:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:47:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:47:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5652 2024-05-30T06:47:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:47:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:47:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:47:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:47:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:47:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:47:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:47:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:47:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:47:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:47:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:47:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-05-30T06:47:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:46:54.717237+0000", 2024-05-30T06:47:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:47:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:47:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:47:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "3cf17b2a-061c-411c-9131-5456a47b7bcd": { 2024-05-30T06:47:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 16.0 seconds before exiting (24s)\n [============================] ", 2024-05-30T06:47:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:47:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:47:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:47:56.595 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:47:56.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.591+0000 7f00d7200640 1 -- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f00b0068b00 msgr2=0x7f00b006afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:56.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.591+0000 7f00d7200640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f00b0068b00 0x7f00b006afc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f00c00016f0 tx=0x7f00c0009040 comp rx=0 tx=0).stop 2024-05-30T06:47:56.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.591+0000 7f00d7200640 1 -- 172.21.15.37:0/3849657500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d0162cb0 msgr2=0x7f00d00b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:47:56.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.591+0000 7f00d7200640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d0162cb0 0x7f00d00b7100 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009d90 tx=0x7f00c8019710 comp rx=0 tx=0).stop 2024-05-30T06:47:56.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.591+0000 7f00d7200640 1 -- 172.21.15.37:0/3849657500 shutdown_connections 2024-05-30T06:47:56.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.591+0000 7f00d7200640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d0162cb0 0x7f00d00b7100 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:56.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.591+0000 7f00d7200640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f00b0068b00 0x7f00b006afc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:56.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.591+0000 7f00d7200640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00d015e930 0x7f00d0153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:56.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.591+0000 7f00d7200640 1 --2- 172.21.15.37:0/3849657500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00d009b9a0 0x7f00d00b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:47:56.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.591+0000 7f00d7200640 1 -- 172.21.15.37:0/3849657500 >> 172.21.15.37:0/3849657500 conn(0x7f00d00b4100 msgr2=0x7f00d00ceaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:47:56.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.591+0000 7f00d7200640 1 -- 172.21.15.37:0/3849657500 shutdown_connections 2024-05-30T06:47:56.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:47:56.591+0000 7f00d7200640 1 -- 172.21.15.37:0/3849657500 wait complete. 2024-05-30T06:48:01.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:48:01.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.763+0000 7f4114c00640 1 Processor -- start 2024-05-30T06:48:01.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f4114c00640 1 -- start start 2024-05-30T06:48:01.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f4114c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f411015e930 0x7f411009b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:01.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f4114c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4110162cb0 0x7f41100ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:01.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f4114c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f411009abe0 con 0x7f41100d1240 2024-05-30T06:48:01.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f4114c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f411009bee0 con 0x7f411015e930 2024-05-30T06:48:01.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f4114c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f411009aec0 con 0x7f4110162cb0 2024-05-30T06:48:01.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f4107e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f41100d1240 0x7f41101625a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57568/0 (socket says 172.21.15.37:57568) 2024-05-30T06:48:01.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f4107e00640 1 -- 172.21.15.37:0/2538851232 learned_addr learned my addr 172.21.15.37:0/2538851232 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:01.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f410e800640 1 --2- 172.21.15.37:0/2538851232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4110162cb0 0x7f41100ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:01.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f410de00640 1 --2- 172.21.15.37:0/2538851232 >> v2:172.21.15.105:3300/0 conn(0x7f411015e930 0x7f411009b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:01.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f410d400640 1 -- 172.21.15.37:0/2538851232 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3700386606 0 0) 0x7f411009abe0 con 0x7f41100d1240 2024-05-30T06:48:01.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f410d400640 1 -- 172.21.15.37:0/2538851232 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40f4003530 con 0x7f41100d1240 2024-05-30T06:48:01.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f410de00640 1 -- 172.21.15.37:0/2538851232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4110162cb0 msgr2=0x7f41100ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:01.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f410de00640 1 --2- 172.21.15.37:0/2538851232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4110162cb0 0x7f41100ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:01.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f410de00640 1 -- 172.21.15.37:0/2538851232 >> v1:172.21.15.37:6789/0 conn(0x7f41100d1240 legacy=0x7f41101625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:01.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f410de00640 1 -- 172.21.15.37:0/2538851232 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f411009b1a0 con 0x7f411015e930 2024-05-30T06:48:01.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.767+0000 7f410e800640 1 --2- 172.21.15.37:0/2538851232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4110162cb0 0x7f41100ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:01.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f410de00640 1 --2- 172.21.15.37:0/2538851232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f411015e930 0x7f411009b9a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f41000097c0 tx=0x7f410001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32203c957c52ba6e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f410d400640 1 -- 172.21.15.37:0/2538851232 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41000b0070 con 0x7f411015e930 2024-05-30T06:48:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f410d400640 1 -- 172.21.15.37:0/2538851232 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41000ab600 con 0x7f411015e930 2024-05-30T06:48:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f410d400640 1 -- 172.21.15.37:0/2538851232 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41000ab9d0 con 0x7f411015e930 2024-05-30T06:48:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f4114c00640 1 -- 172.21.15.37:0/2538851232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f411015e930 msgr2=0x7f411009b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f4114c00640 1 --2- 172.21.15.37:0/2538851232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f411015e930 0x7f411009b9a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f41000097c0 tx=0x7f410001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:48:01.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f4114c00640 1 -- 172.21.15.37:0/2538851232 shutdown_connections 2024-05-30T06:48:01.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f4114c00640 1 --2- 172.21.15.37:0/2538851232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4110162cb0 0x7f41100ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:01.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f4114c00640 1 --2- 172.21.15.37:0/2538851232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f411015e930 0x7f411009b9a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:01.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f4114c00640 1 -- 172.21.15.37:0/2538851232 >> 172.21.15.37:0/2538851232 conn(0x7f41100b4100 msgr2=0x7f41100b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:01.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f4114c00640 1 -- 172.21.15.37:0/2538851232 shutdown_connections 2024-05-30T06:48:01.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f4114c00640 1 -- 172.21.15.37:0/2538851232 wait complete. 2024-05-30T06:48:01.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f4114c00640 1 Processor -- start 2024-05-30T06:48:01.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.771+0000 7f4114c00640 1 -- start start 2024-05-30T06:48:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4114c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41100d1240 0x7f4110153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4114c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f411015e930 0x7f411015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4114c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4110162cb0 0x7f411015a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4114c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f411016bac0 con 0x7f4110162cb0 2024-05-30T06:48:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4114c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f411016b940 con 0x7f41100d1240 2024-05-30T06:48:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4114c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f411016bc40 con 0x7f411015e930 2024-05-30T06:48:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f410e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4110162cb0 0x7f411015a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f410e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4110162cb0 0x7f411015a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57356/0 (socket says 172.21.15.37:57356) 2024-05-30T06:48:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f410e800640 1 -- 172.21.15.37:0/4066906875 learned_addr learned my addr 172.21.15.37:0/4066906875 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4107e00640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f411015e930 0x7f411015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f410de00640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41100d1240 0x7f4110153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f410e800640 1 -- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f411015e930 msgr2=0x7f411015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f410e800640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f411015e930 0x7f411015a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f410e800640 1 -- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41100d1240 msgr2=0x7f4110153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f410e800640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41100d1240 0x7f4110153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f410e800640 1 -- 172.21.15.37:0/4066906875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41100b0d60 con 0x7f4110162cb0 2024-05-30T06:48:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4107e00640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f411015e930 0x7f411015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:01.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f410e800640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4110162cb0 0x7f411015a740 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f410800efb0 tx=0x7f410800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:01.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4106000640 1 -- 172.21.15.37:0/4066906875 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4108018020 con 0x7f4110162cb0 2024-05-30T06:48:01.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4106000640 1 -- 172.21.15.37:0/4066906875 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4108014480 con 0x7f4110162cb0 2024-05-30T06:48:01.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4114c00640 1 -- 172.21.15.37:0/4066906875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41100b1040 con 0x7f4110162cb0 2024-05-30T06:48:01.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4106000640 1 -- 172.21.15.37:0/4066906875 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4108014850 con 0x7f4110162cb0 2024-05-30T06:48:01.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4114c00640 1 -- 172.21.15.37:0/4066906875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41100b1600 con 0x7f4110162cb0 2024-05-30T06:48:01.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.775+0000 7f4114c00640 1 -- 172.21.15.37:0/4066906875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4110068b20 con 0x7f4110162cb0 2024-05-30T06:48:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.779+0000 7f4106000640 1 -- 172.21.15.37:0/4066906875 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7f410801b020 con 0x7f4110162cb0 2024-05-30T06:48:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.779+0000 7f4106000640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40ec068ad0 0x7f40ec06af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.779+0000 7f4106000640 1 -- 172.21.15.37:0/4066906875 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f4108088620 con 0x7f4110162cb0 2024-05-30T06:48:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.779+0000 7f410de00640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40ec068ad0 0x7f40ec06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:01.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.779+0000 7f410de00640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40ec068ad0 0x7f40ec06af90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f41000ad000 tx=0x7f4100008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:01.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:01.783+0000 7f4106000640 1 -- 172.21.15.37:0/4066906875 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4108022030 con 0x7f4110162cb0 2024-05-30T06:48:02.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.007+0000 7f4114c00640 1 -- 172.21.15.37:0/4066906875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f411015d710 con 0x7f4110162cb0 2024-05-30T06:48:02.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.007+0000 7f4106000640 1 -- 172.21.15.37:0/4066906875 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2109 (secure 0 0 0) 0x7f4108010040 con 0x7f4110162cb0 2024-05-30T06:48:02.008 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:02.008 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:48:02.008 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:48:02.008 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:48:02.008 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:48:02.008 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:48:02.008 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:02.009 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 376, 2024-05-30T06:48:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:48:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:48:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:48:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:48:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:48:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 48, 2024-05-30T06:48:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:48:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:48:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:48:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:48:02.010 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:48:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:48:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:48:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:48:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:48:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:48:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:48:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:48:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4188, 2024-05-30T06:48:02.011 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 17433438225, 2024-05-30T06:48:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 35250511872, 2024-05-30T06:48:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 737843601408, 2024-05-30T06:48:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:48:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 85, 2024-05-30T06:48:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 5459, 2024-05-30T06:48:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:48:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 1 2024-05-30T06:48:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:48:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 28, 2024-05-30T06:48:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 3, 2024-05-30T06:48:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:48:02.012 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 3, 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5652 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:48:02.013 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:48:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:48:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:48:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:48:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:48:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:48:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:48:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:48:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-05-30T06:48:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:46:54.717237+0000", 2024-05-30T06:48:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:48:02.014 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:48:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: "3cf17b2a-061c-411c-9131-5456a47b7bcd": { 2024-05-30T06:48:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 10.0 seconds before exiting (30s)\n [============================] ", 2024-05-30T06:48:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:48:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:48:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:02.015 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:02.015 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:48:02.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.011+0000 7f4114c00640 1 -- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40ec068ad0 msgr2=0x7f40ec06af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:02.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.011+0000 7f4114c00640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40ec068ad0 0x7f40ec06af90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f41000ad000 tx=0x7f4100008040 comp rx=0 tx=0).stop 2024-05-30T06:48:02.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.011+0000 7f4114c00640 1 -- 172.21.15.37:0/4066906875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4110162cb0 msgr2=0x7f411015a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:02.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.011+0000 7f4114c00640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4110162cb0 0x7f411015a740 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f410800efb0 tx=0x7f410800c490 comp rx=0 tx=0).stop 2024-05-30T06:48:02.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.011+0000 7f4114c00640 1 -- 172.21.15.37:0/4066906875 shutdown_connections 2024-05-30T06:48:02.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.011+0000 7f4114c00640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4110162cb0 0x7f411015a740 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:02.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.011+0000 7f4114c00640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f411015e930 0x7f411015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:02.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.011+0000 7f4114c00640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40ec068ad0 0x7f40ec06af90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:02.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.011+0000 7f4114c00640 1 --2- 172.21.15.37:0/4066906875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41100d1240 0x7f4110153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:02.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.011+0000 7f4114c00640 1 -- 172.21.15.37:0/4066906875 >> 172.21.15.37:0/4066906875 conn(0x7f41100b4100 msgr2=0x7f411006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:02.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.011+0000 7f4114c00640 1 -- 172.21.15.37:0/4066906875 shutdown_connections 2024-05-30T06:48:02.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:02.011+0000 7f4114c00640 1 -- 172.21.15.37:0/4066906875 wait complete. 2024-05-30T06:48:04.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:48:04.450 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:48:07.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:48:07.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.183+0000 7f8a81200640 1 Processor -- start 2024-05-30T06:48:07.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.183+0000 7f8a81200640 1 -- start start 2024-05-30T06:48:07.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.183+0000 7f8a81200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a7c06e000 0x7f8a7c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:07.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.183+0000 7f8a81200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a7c15cd80 0x7f8a7c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:07.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.183+0000 7f8a81200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a7c0cd120 con 0x7f8a7c0cec40 2024-05-30T06:48:07.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.183+0000 7f8a81200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8a7c0a9530 con 0x7f8a7c15cd80 2024-05-30T06:48:07.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.183+0000 7f8a81200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c0cd400 con 0x7f8a7c06e000 2024-05-30T06:48:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.183+0000 7f8a71400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a7c15cd80 0x7f8a7c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.183+0000 7f8a7a800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8a7c0cec40 0x7f8a7c06e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57582/0 (socket says 172.21.15.37:57582) 2024-05-30T06:48:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.183+0000 7f8a7a800640 1 -- 172.21.15.37:0/1108058523 learned_addr learned my addr 172.21.15.37:0/1108058523 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.187+0000 7f8a79e00640 1 --2- 172.21.15.37:0/1108058523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a7c06e000 0x7f8a7c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.187+0000 7f8a71400640 1 -- 172.21.15.37:0/1108058523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a7c06e000 msgr2=0x7f8a7c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.187+0000 7f8a71400640 1 --2- 172.21.15.37:0/1108058523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a7c06e000 0x7f8a7c0ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.187+0000 7f8a71400640 1 -- 172.21.15.37:0/1108058523 >> v1:172.21.15.37:6789/0 conn(0x7f8a7c0cec40 legacy=0x7f8a7c06e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.187+0000 7f8a71400640 1 -- 172.21.15.37:0/1108058523 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c0cd6e0 con 0x7f8a7c15cd80 2024-05-30T06:48:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.187+0000 7f8a79400640 1 -- 172.21.15.37:0/1108058523 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231745074 0 0) 0x7f8a7c0cd120 con 0x7f8a7c0cec40 2024-05-30T06:48:07.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.187+0000 7f8a71400640 1 --2- 172.21.15.37:0/1108058523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a7c15cd80 0x7f8a7c0ce700 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8a640097c0 tx=0x7f8a6401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669f7944c528cccf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.187+0000 7f8a79400640 1 -- 172.21.15.37:0/1108058523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640b5070 con 0x7f8a7c15cd80 2024-05-30T06:48:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.187+0000 7f8a79400640 1 -- 172.21.15.37:0/1108058523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a640a8990 con 0x7f8a7c15cd80 2024-05-30T06:48:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.187+0000 7f8a79400640 1 -- 172.21.15.37:0/1108058523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640a8d60 con 0x7f8a7c15cd80 2024-05-30T06:48:07.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.187+0000 7f8a81200640 1 -- 172.21.15.37:0/1108058523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a7c15cd80 msgr2=0x7f8a7c0ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 --2- 172.21.15.37:0/1108058523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a7c15cd80 0x7f8a7c0ce700 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8a640097c0 tx=0x7f8a6401ec90 comp rx=0 tx=0).stop 2024-05-30T06:48:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 -- 172.21.15.37:0/1108058523 shutdown_connections 2024-05-30T06:48:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 --2- 172.21.15.37:0/1108058523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a7c15cd80 0x7f8a7c0ce700 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 --2- 172.21.15.37:0/1108058523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a7c06e000 0x7f8a7c0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 -- 172.21.15.37:0/1108058523 >> 172.21.15.37:0/1108058523 conn(0x7f8a7c0b23a0 msgr2=0x7f8a7c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 -- 172.21.15.37:0/1108058523 shutdown_connections 2024-05-30T06:48:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 -- 172.21.15.37:0/1108058523 wait complete. 2024-05-30T06:48:07.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 Processor -- start 2024-05-30T06:48:07.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 -- start start 2024-05-30T06:48:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a7c06e000 0x7f8a7c15bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a7c0cec40 0x7f8a7c139560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a7c15cd80 0x7f8a7c157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c0cf0a0 con 0x7f8a7c06e000 2024-05-30T06:48:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c0cdca0 con 0x7f8a7c0cec40 2024-05-30T06:48:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a81200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c1663c0 con 0x7f8a7c15cd80 2024-05-30T06:48:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a79e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a7c06e000 0x7f8a7c15bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a79e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a7c06e000 0x7f8a7c15bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57366/0 (socket says 172.21.15.37:57366) 2024-05-30T06:48:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a79e00640 1 -- 172.21.15.37:0/1607897687 learned_addr learned my addr 172.21.15.37:0/1607897687 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:07.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a79e00640 1 -- 172.21.15.37:0/1607897687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a7c15cd80 msgr2=0x7f8a7c157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:07.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a79e00640 1 --2- 172.21.15.37:0/1607897687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a7c15cd80 0x7f8a7c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:07.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a79e00640 1 -- 172.21.15.37:0/1607897687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a7c0cec40 msgr2=0x7f8a7c139560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:07.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a79e00640 1 --2- 172.21.15.37:0/1607897687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a7c0cec40 0x7f8a7c139560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:07.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a79e00640 1 -- 172.21.15.37:0/1607897687 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c13c4a0 con 0x7f8a7c06e000 2024-05-30T06:48:07.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a79e00640 1 --2- 172.21.15.37:0/1607897687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a7c06e000 0x7f8a7c15bea0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c007e40 tx=0x7f8a6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:07.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a72a00640 1 -- 172.21.15.37:0/1607897687 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c014620 con 0x7f8a7c06e000 2024-05-30T06:48:07.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a72a00640 1 -- 172.21.15.37:0/1607897687 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a6c019070 con 0x7f8a7c06e000 2024-05-30T06:48:07.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.191+0000 7f8a72a00640 1 -- 172.21.15.37:0/1607897687 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c0149e0 con 0x7f8a7c06e000 2024-05-30T06:48:07.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.195+0000 7f8a81200640 1 -- 172.21.15.37:0/1607897687 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7c0693a0 con 0x7f8a7c06e000 2024-05-30T06:48:07.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.195+0000 7f8a81200640 1 -- 172.21.15.37:0/1607897687 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7c15b3c0 con 0x7f8a7c06e000 2024-05-30T06:48:07.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.195+0000 7f8a81200640 1 -- 172.21.15.37:0/1607897687 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a7c068b20 con 0x7f8a7c06e000 2024-05-30T06:48:07.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.195+0000 7f8a72a00640 1 -- 172.21.15.37:0/1607897687 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7f8a6c014b80 con 0x7f8a7c06e000 2024-05-30T06:48:07.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.195+0000 7f8a72a00640 1 --2- 172.21.15.37:0/1607897687 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8a58068b20 0x7f8a5806afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:07.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.195+0000 7f8a72a00640 1 -- 172.21.15.37:0/1607897687 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f8a6c088360 con 0x7f8a7c06e000 2024-05-30T06:48:07.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.195+0000 7f8a71400640 1 --2- 172.21.15.37:0/1607897687 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8a58068b20 0x7f8a5806afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:07.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.199+0000 7f8a71400640 1 --2- 172.21.15.37:0/1607897687 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8a58068b20 0x7f8a5806afe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8a640b2000 tx=0x7f8a64004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:07.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.199+0000 7f8a72a00640 1 -- 172.21.15.37:0/1607897687 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8a6c057ab0 con 0x7f8a7c06e000 2024-05-30T06:48:07.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.423+0000 7f8a81200640 1 -- 172.21.15.37:0/1607897687 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8a7c06e720 con 0x7f8a7c06e000 2024-05-30T06:48:07.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.423+0000 7f8a72a00640 1 -- 172.21.15.37:0/1607897687 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2077 (secure 0 0 0) 0x7f8a6c0573b0 con 0x7f8a7c06e000 2024-05-30T06:48:07.423 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:07.423 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:48:07.423 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:48:07.423 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:48:07.423 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:48:07.423 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:48:07.424 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:48:07.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:07.424 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:48:07.424 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:48:07.424 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:48:07.424 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:48:07.424 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:48:07.424 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:07.424 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:48:07.424 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:48:07.424 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:48:07.424 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:48:07.425 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:07.425 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 381, 2024-05-30T06:48:07.425 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:48:07.425 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:48:07.425 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:48:07.425 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:48:07.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:07.425 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:48:07.425 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 48, 2024-05-30T06:48:07.425 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:48:07.425 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:48:07.425 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:48:07.425 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4188, 2024-05-30T06:48:07.427 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 17433439840, 2024-05-30T06:48:07.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 35250511872, 2024-05-30T06:48:07.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 737843601408, 2024-05-30T06:48:07.427 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:48:07.427 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 426, 2024-05-30T06:48:07.427 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:48:07.427 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:48:07.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:07.427 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:48:07.427 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 28, 2024-05-30T06:48:07.427 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 3, 2024-05-30T06:48:07.427 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 3, 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5652 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:07.428 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:48:07.429 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:48:07.429 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:48:07.429 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:48:07.429 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:48:07.429 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:48:07.429 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:48:07.429 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:07.429 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:48:07.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:07.429 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:48:07.429 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-05-30T06:48:07.429 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:46:54.717237+0000", 2024-05-30T06:48:07.429 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:48:07.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:07.430 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:48:07.430 INFO:teuthology.orchestra.run.smithi037.stdout: "3cf17b2a-061c-411c-9131-5456a47b7bcd": { 2024-05-30T06:48:07.430 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 4.0 seconds before exiting (36s)\n [============================] ", 2024-05-30T06:48:07.430 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:48:07.430 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:48:07.430 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:07.430 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:07.430 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:48:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.427+0000 7f8a81200640 1 -- 172.21.15.37:0/1607897687 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8a58068b20 msgr2=0x7f8a5806afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.427+0000 7f8a81200640 1 --2- 172.21.15.37:0/1607897687 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8a58068b20 0x7f8a5806afe0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8a640b2000 tx=0x7f8a64004740 comp rx=0 tx=0).stop 2024-05-30T06:48:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.427+0000 7f8a81200640 1 -- 172.21.15.37:0/1607897687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a7c06e000 msgr2=0x7f8a7c15bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.427+0000 7f8a81200640 1 --2- 172.21.15.37:0/1607897687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a7c06e000 0x7f8a7c15bea0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c007e40 tx=0x7f8a6c00e4b0 comp rx=0 tx=0).stop 2024-05-30T06:48:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.427+0000 7f8a81200640 1 -- 172.21.15.37:0/1607897687 shutdown_connections 2024-05-30T06:48:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.427+0000 7f8a81200640 1 --2- 172.21.15.37:0/1607897687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8a7c15cd80 0x7f8a7c157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.427+0000 7f8a81200640 1 --2- 172.21.15.37:0/1607897687 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8a58068b20 0x7f8a5806afe0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.427+0000 7f8a81200640 1 --2- 172.21.15.37:0/1607897687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8a7c0cec40 0x7f8a7c139560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.427+0000 7f8a81200640 1 --2- 172.21.15.37:0/1607897687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a7c06e000 0x7f8a7c15bea0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.427+0000 7f8a81200640 1 -- 172.21.15.37:0/1607897687 >> 172.21.15.37:0/1607897687 conn(0x7f8a7c0b23a0 msgr2=0x7f8a7c13bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.427+0000 7f8a81200640 1 -- 172.21.15.37:0/1607897687 shutdown_connections 2024-05-30T06:48:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:07.427+0000 7f8a81200640 1 -- 172.21.15.37:0/1607897687 wait complete. 2024-05-30T06:48:12.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:48:12.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.599+0000 7f0a94600640 1 Processor -- start 2024-05-30T06:48:12.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.599+0000 7f0a94600640 1 -- start start 2024-05-30T06:48:12.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.599+0000 7f0a94600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a8c15cd80 0x7f0a8c06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:12.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.599+0000 7f0a94600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a8c0ce8d0 0x7f0a8c0ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:12.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.599+0000 7f0a94600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a8c0cd120 con 0x7f0a8c06e000 2024-05-30T06:48:12.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.599+0000 7f0a94600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0a8c0a9530 con 0x7f0a8c0ce8d0 2024-05-30T06:48:12.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.599+0000 7f0a94600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0a8c0cd400 con 0x7f0a8c15cd80 2024-05-30T06:48:12.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.599+0000 7f0a92600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a8c0ce8d0 0x7f0a8c0ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:12.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.599+0000 7f0a91c00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0a8c06e000 0x7f0a8c0ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35582/0 (socket says 172.21.15.37:35582) 2024-05-30T06:48:12.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.599+0000 7f0a91c00640 1 -- 172.21.15.37:0/1542239494 learned_addr learned my addr 172.21.15.37:0/1542239494 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:12.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.603+0000 7f0a91200640 1 --2- 172.21.15.37:0/1542239494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a8c15cd80 0x7f0a8c06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:12.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.603+0000 7f0a92600640 1 -- 172.21.15.37:0/1542239494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a8c15cd80 msgr2=0x7f0a8c06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:12.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.603+0000 7f0a92600640 1 --2- 172.21.15.37:0/1542239494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a8c15cd80 0x7f0a8c06f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:12.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.603+0000 7f0a92600640 1 -- 172.21.15.37:0/1542239494 >> v1:172.21.15.37:6789/0 conn(0x7f0a8c06e000 legacy=0x7f0a8c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:12.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.603+0000 7f0a8be00640 1 -- 172.21.15.37:0/1542239494 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1107711825 0 0) 0x7f0a8c0cd120 con 0x7f0a8c06e000 2024-05-30T06:48:12.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.603+0000 7f0a92600640 1 -- 172.21.15.37:0/1542239494 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8c0cd6e0 con 0x7f0a8c0ce8d0 2024-05-30T06:48:12.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.603+0000 7f0a92600640 1 --2- 172.21.15.37:0/1542239494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c0ce8d0 0x7f0a8c0ced30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009d90 tx=0x7f0a8401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b122fedc1ca1939 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:12.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.603+0000 7f0a8be00640 1 -- 172.21.15.37:0/1542239494 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a840b4070 con 0x7f0a8c0ce8d0 2024-05-30T06:48:12.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.603+0000 7f0a8be00640 1 -- 172.21.15.37:0/1542239494 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a840af600 con 0x7f0a8c0ce8d0 2024-05-30T06:48:12.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.603+0000 7f0a8be00640 1 -- 172.21.15.37:0/1542239494 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a840af9d0 con 0x7f0a8c0ce8d0 2024-05-30T06:48:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 -- 172.21.15.37:0/1542239494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c0ce8d0 msgr2=0x7f0a8c0ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 --2- 172.21.15.37:0/1542239494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c0ce8d0 0x7f0a8c0ced30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009d90 tx=0x7f0a8401f150 comp rx=0 tx=0).stop 2024-05-30T06:48:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 -- 172.21.15.37:0/1542239494 shutdown_connections 2024-05-30T06:48:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 --2- 172.21.15.37:0/1542239494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c0ce8d0 0x7f0a8c0ced30 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 --2- 172.21.15.37:0/1542239494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a8c15cd80 0x7f0a8c06f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 -- 172.21.15.37:0/1542239494 >> 172.21.15.37:0/1542239494 conn(0x7f0a8c0b23a0 msgr2=0x7f0a8c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 -- 172.21.15.37:0/1542239494 shutdown_connections 2024-05-30T06:48:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 -- 172.21.15.37:0/1542239494 wait complete. 2024-05-30T06:48:12.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 Processor -- start 2024-05-30T06:48:12.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 -- start start 2024-05-30T06:48:12.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c06e000 0x7f0a8c157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:12.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a8c0ce8d0 0x7f0a8c158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:12.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a8c15cd80 0x7f0a8c159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:12.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c06f930 con 0x7f0a8c06e000 2024-05-30T06:48:12.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c0cdca0 con 0x7f0a8c15cd80 2024-05-30T06:48:12.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a94600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0a8c06fab0 con 0x7f0a8c0ce8d0 2024-05-30T06:48:12.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a91c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c06e000 0x7f0a8c157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:12.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a91c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c06e000 0x7f0a8c157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51940/0 (socket says 172.21.15.37:51940) 2024-05-30T06:48:12.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a91c00640 1 -- 172.21.15.37:0/21839248 learned_addr learned my addr 172.21.15.37:0/21839248 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:12.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a91200640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a8c0ce8d0 0x7f0a8c158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:12.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a92600640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a8c15cd80 0x7f0a8c159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:12.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a91c00640 1 -- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a8c0ce8d0 msgr2=0x7f0a8c158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:12.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a91c00640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a8c0ce8d0 0x7f0a8c158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:12.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a91c00640 1 -- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a8c15cd80 msgr2=0x7f0a8c159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:12.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a91c00640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a8c15cd80 0x7f0a8c159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:12.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.607+0000 7f0a91c00640 1 -- 172.21.15.37:0/21839248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8c157dd0 con 0x7f0a8c06e000 2024-05-30T06:48:12.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.611+0000 7f0a91c00640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c06e000 0x7f0a8c157890 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000c4b0 tx=0x7f0a8000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.611+0000 7f0a89600640 1 -- 172.21.15.37:0/21839248 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80018070 con 0x7f0a8c06e000 2024-05-30T06:48:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.611+0000 7f0a89600640 1 -- 172.21.15.37:0/21839248 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a80007500 con 0x7f0a8c06e000 2024-05-30T06:48:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.611+0000 7f0a94600640 1 -- 172.21.15.37:0/21839248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8c1442f0 con 0x7f0a8c06e000 2024-05-30T06:48:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.611+0000 7f0a89600640 1 -- 172.21.15.37:0/21839248 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80004a30 con 0x7f0a8c06e000 2024-05-30T06:48:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.611+0000 7f0a94600640 1 -- 172.21.15.37:0/21839248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8c1448b0 con 0x7f0a8c06e000 2024-05-30T06:48:12.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.611+0000 7f0a94600640 1 -- 172.21.15.37:0/21839248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a8c068b20 con 0x7f0a8c06e000 2024-05-30T06:48:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.611+0000 7f0a89600640 1 -- 172.21.15.37:0/21839248 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7f0a8001b070 con 0x7f0a8c06e000 2024-05-30T06:48:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.611+0000 7f0a89600640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a6c068ad0 0x7f0a6c06af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:12.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.611+0000 7f0a89600640 1 -- 172.21.15.37:0/21839248 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f0a80086e60 con 0x7f0a8c06e000 2024-05-30T06:48:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.611+0000 7f0a91200640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a6c068ad0 0x7f0a6c06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:12.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.615+0000 7f0a91200640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a6c068ad0 0x7f0a6c06af90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c13c5f0 tx=0x7f0a78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:12.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.619+0000 7f0a89600640 1 -- 172.21.15.37:0/21839248 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a800564a0 con 0x7f0a8c06e000 2024-05-30T06:48:12.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.843+0000 7f0a94600640 1 -- 172.21.15.37:0/21839248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0a8c072dc0 con 0x7f0a8c06e000 2024-05-30T06:48:12.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.843+0000 7f0a89600640 1 -- 172.21.15.37:0/21839248 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1823 (secure 0 0 0) 0x7f0a80055da0 con 0x7f0a8c06e000 2024-05-30T06:48:12.843 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:12.843 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:48:12.843 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:48:12.843 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:48:12.844 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:48:12.844 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:48:12.844 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:48:12.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:12.844 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:48:12.844 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:48:12.844 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:48:12.844 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:48:12.844 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:48:12.844 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:12.845 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:48:12.845 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:48:12.845 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:48:12.845 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:48:12.845 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:12.845 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 387, 2024-05-30T06:48:12.845 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:48:12.845 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:48:12.845 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:48:12.845 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:48:12.845 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:12.845 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:48:12.845 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 48, 2024-05-30T06:48:12.846 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:48:12.846 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:48:12.846 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:48:12.846 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:48:12.846 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:48:12.846 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:48:12.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:12.846 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4188, 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 17433439840, 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 35250511872, 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 737843601408, 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:48:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 170, 2024-05-30T06:48:12.848 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:48:12.848 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:48:12.848 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:12.848 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:48:12.848 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 28, 2024-05-30T06:48:12.848 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 3, 2024-05-30T06:48:12.848 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:48:12.848 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:48:12.848 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:48:12.848 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:48:12.848 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:12.848 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 3, 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 5652 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:48:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:48:12.850 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:48:12.850 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:48:12.850 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:48:12.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:12.850 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:48:12.850 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-05-30T06:48:12.850 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:46:54.717237+0000", 2024-05-30T06:48:12.850 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:48:12.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:12.850 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": {} 2024-05-30T06:48:12.850 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:48:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.847+0000 7f0a94600640 1 -- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a6c068ad0 msgr2=0x7f0a6c06af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.847+0000 7f0a94600640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a6c068ad0 0x7f0a6c06af90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c13c5f0 tx=0x7f0a78008040 comp rx=0 tx=0).stop 2024-05-30T06:48:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.847+0000 7f0a94600640 1 -- 172.21.15.37:0/21839248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c06e000 msgr2=0x7f0a8c157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.847+0000 7f0a94600640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c06e000 0x7f0a8c157890 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000c4b0 tx=0x7f0a8000c970 comp rx=0 tx=0).stop 2024-05-30T06:48:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.847+0000 7f0a94600640 1 -- 172.21.15.37:0/21839248 shutdown_connections 2024-05-30T06:48:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.847+0000 7f0a94600640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a6c068ad0 0x7f0a6c06af90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.847+0000 7f0a94600640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a8c15cd80 0x7f0a8c159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.847+0000 7f0a94600640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a8c0ce8d0 0x7f0a8c158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.847+0000 7f0a94600640 1 --2- 172.21.15.37:0/21839248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a8c06e000 0x7f0a8c157890 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.847+0000 7f0a94600640 1 -- 172.21.15.37:0/21839248 >> 172.21.15.37:0/21839248 conn(0x7f0a8c0b23a0 msgr2=0x7f0a8c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.847+0000 7f0a94600640 1 -- 172.21.15.37:0/21839248 shutdown_connections 2024-05-30T06:48:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:12.847+0000 7f0a94600640 1 -- 172.21.15.37:0/21839248 wait complete. 2024-05-30T06:48:12.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T06:48:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.007+0000 7f528dc00640 1 Processor -- start 2024-05-30T06:48:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.007+0000 7f528dc00640 1 -- start start 2024-05-30T06:48:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.007+0000 7f528dc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f52880cd440 0x7f528806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.007+0000 7f528dc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528806f5a0 0x7f52880b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.007+0000 7f528dc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528815f310 con 0x7f5288155da0 2024-05-30T06:48:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f528dc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f528815f5f0 con 0x7f52880cd440 2024-05-30T06:48:13.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f528dc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f528815f8d0 con 0x7f528806f5a0 2024-05-30T06:48:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5288155da0 0x7f52880cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35598/0 (socket says 172.21.15.37:35598) 2024-05-30T06:48:13.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286a00640 1 -- 172.21.15.37:0/2253285941 learned_addr learned my addr 172.21.15.37:0/2253285941 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5287400640 1 --2- 172.21.15.37:0/2253285941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528806f5a0 0x7f52880b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f527e000640 1 --2- 172.21.15.37:0/2253285941 >> v2:172.21.15.105:3300/0 conn(0x7f52880cd440 0x7f528806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776886461 0 0) 0x7f528815f310 con 0x7f5288155da0 2024-05-30T06:48:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f526c003530 con 0x7f5288155da0 2024-05-30T06:48:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1428150157 0 0) 0x7f526c003530 con 0x7f5288155da0 2024-05-30T06:48:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528806f5a0 msgr2=0x7f52880b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 --2- 172.21.15.37:0/2253285941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528806f5a0 0x7f52880b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 >> v2:172.21.15.105:3300/0 conn(0x7f52880cd440 msgr2=0x7f528806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 --2- 172.21.15.37:0/2253285941 >> v2:172.21.15.105:3300/0 conn(0x7f52880cd440 0x7f528806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528815fbb0 con 0x7f5288155da0 2024-05-30T06:48:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f5278001680 con 0x7f5288155da0 2024-05-30T06:48:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 >> v1:172.21.15.37:6789/0 conn(0x7f5288155da0 legacy=0x7f52880cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 --2- 172.21.15.37:0/2253285941 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f526c0039c0 0x7f526c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 --2- 172.21.15.37:0/2253285941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528806f5a0 0x7f526c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 --2- 172.21.15.37:0/2253285941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f526c004d50 0x7f526c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f528815f5f0 con 0x7f526c004d50 2024-05-30T06:48:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f528815f8d0 con 0x7f526c0039c0 2024-05-30T06:48:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f526c00ba50 con 0x7f528806f5a0 2024-05-30T06:48:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5287400640 1 --2- 172.21.15.37:0/2253285941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f526c004d50 0x7f526c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f527e000640 1 --2- 172.21.15.37:0/2253285941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528806f5a0 0x7f526c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5286a00640 1 --2- 172.21.15.37:0/2253285941 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f526c0039c0 0x7f526c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5287400640 1 -- 172.21.15.37:0/2253285941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528806f5a0 msgr2=0x7f526c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:13.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5287400640 1 --2- 172.21.15.37:0/2253285941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528806f5a0 0x7f526c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5287400640 1 -- 172.21.15.37:0/2253285941 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f526c0039c0 msgr2=0x7f526c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:13.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5287400640 1 --2- 172.21.15.37:0/2253285941 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f526c0039c0 0x7f526c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.011+0000 7f5287400640 1 -- 172.21.15.37:0/2253285941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526c003530 con 0x7f526c004d50 2024-05-30T06:48:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.015+0000 7f5287400640 1 --2- 172.21.15.37:0/2253285941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f526c004d50 0x7f526c0051d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5280009fc0 tx=0x7f528001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad7c7ea2daf33a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.015+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52800b2070 con 0x7f526c004d50 2024-05-30T06:48:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.015+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52800a5a80 con 0x7f526c004d50 2024-05-30T06:48:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.015+0000 7f5286000640 1 -- 172.21.15.37:0/2253285941 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280009c10 con 0x7f526c004d50 2024-05-30T06:48:13.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.015+0000 7f528dc00640 1 -- 172.21.15.37:0/2253285941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f526c004d50 msgr2=0x7f526c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.015+0000 7f528dc00640 1 --2- 172.21.15.37:0/2253285941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f526c004d50 0x7f526c0051d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5280009fc0 tx=0x7f528001cc80 comp rx=0 tx=0).stop 2024-05-30T06:48:13.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.015+0000 7f5287400640 1 -- 172.21.15.37:0/2253285941 reap_dead start 2024-05-30T06:48:13.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.015+0000 7f528dc00640 1 -- 172.21.15.37:0/2253285941 shutdown_connections 2024-05-30T06:48:13.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.015+0000 7f528dc00640 1 -- 172.21.15.37:0/2253285941 >> 172.21.15.37:0/2253285941 conn(0x7f528806bf60 msgr2=0x7f52880b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:13.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.015+0000 7f528dc00640 1 -- 172.21.15.37:0/2253285941 shutdown_connections 2024-05-30T06:48:13.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.015+0000 7f528dc00640 1 -- 172.21.15.37:0/2253285941 wait complete. 2024-05-30T06:48:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.015+0000 7f528dc00640 1 Processor -- start 2024-05-30T06:48:13.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.015+0000 7f528dc00640 1 -- start start 2024-05-30T06:48:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f528dc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f526c004d50 0x7f5288145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f528dc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52881547d0 0x7f528814bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f528dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52881532b0 0x7f5288154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f528dc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f528806eaf0 con 0x7f52881532b0 2024-05-30T06:48:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f528dc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f528806e970 con 0x7f526c004d50 2024-05-30T06:48:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f528dc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f528806ec70 con 0x7f52881547d0 2024-05-30T06:48:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f5287400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52881532b0 0x7f5288154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f5287400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52881532b0 0x7f5288154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51960/0 (socket says 172.21.15.37:51960) 2024-05-30T06:48:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f5287400640 1 -- 172.21.15.37:0/242158413 learned_addr learned my addr 172.21.15.37:0/242158413 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f527e000640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52881547d0 0x7f528814bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f5286a00640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f526c004d50 0x7f5288145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f5287400640 1 -- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52881547d0 msgr2=0x7f528814bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f5287400640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52881547d0 0x7f528814bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f5287400640 1 -- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f526c004d50 msgr2=0x7f5288145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f5287400640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f526c004d50 0x7f5288145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f5287400640 1 -- 172.21.15.37:0/242158413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5288146130 con 0x7f52881532b0 2024-05-30T06:48:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f5287400640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52881532b0 0x7f5288154c40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5280002240 tx=0x7f5280009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f527f400640 1 -- 172.21.15.37:0/242158413 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52800bd070 con 0x7f52881532b0 2024-05-30T06:48:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f527f400640 1 -- 172.21.15.37:0/242158413 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52800a5880 con 0x7f52881532b0 2024-05-30T06:48:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f527f400640 1 -- 172.21.15.37:0/242158413 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52800b2040 con 0x7f52881532b0 2024-05-30T06:48:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f528dc00640 1 -- 172.21.15.37:0/242158413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52881576f0 con 0x7f52881532b0 2024-05-30T06:48:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f528dc00640 1 -- 172.21.15.37:0/242158413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5288153be0 con 0x7f52881532b0 2024-05-30T06:48:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f528dc00640 1 -- 172.21.15.37:0/242158413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5288068bc0 con 0x7f52881532b0 2024-05-30T06:48:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.019+0000 7f527f400640 1 -- 172.21.15.37:0/242158413 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7f5280003bc0 con 0x7f52881532b0 2024-05-30T06:48:13.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.023+0000 7f527f400640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5264068ad0 0x7f526406af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.023+0000 7f527f400640 1 -- 172.21.15.37:0/242158413 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f5280121370 con 0x7f52881532b0 2024-05-30T06:48:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.023+0000 7f5286a00640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5264068ad0 0x7f526406af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.023+0000 7f5286a00640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5264068ad0 0x7f526406af90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5278001130 tx=0x7f5278009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:13.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.027+0000 7f527f400640 1 -- 172.21.15.37:0/242158413 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f52881576f0 con 0x7f52881532b0 2024-05-30T06:48:13.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.219+0000 7f528dc00640 1 -- 172.21.15.37:0/242158413 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52880b6790 con 0x7f5264068ad0 2024-05-30T06:48:13.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.227+0000 7f527f400640 1 -- 172.21.15.37:0/242158413 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+234 (secure 0 0 0) 0x7f52880b6790 con 0x7f5264068ad0 2024-05-30T06:48:13.225 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:13.225 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:48:13.225 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:13.225 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone71654" 2024-05-30T06:48:13.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:13.225 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:13.226 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sv1" 2024-05-30T06:48:13.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:13.226 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:13.226 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone71652" 2024-05-30T06:48:13.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:13.226 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:13.226 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone71651" 2024-05-30T06:48:13.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:13.226 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:13.226 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone71653" 2024-05-30T06:48:13.226 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:13.226 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:48:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.227+0000 7f528dc00640 1 -- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5264068ad0 msgr2=0x7f526406af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.227+0000 7f528dc00640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5264068ad0 0x7f526406af90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5278001130 tx=0x7f5278009040 comp rx=0 tx=0).stop 2024-05-30T06:48:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.227+0000 7f528dc00640 1 -- 172.21.15.37:0/242158413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52881532b0 msgr2=0x7f5288154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.227+0000 7f528dc00640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52881532b0 0x7f5288154c40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5280002240 tx=0x7f5280009750 comp rx=0 tx=0).stop 2024-05-30T06:48:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.227+0000 7f528dc00640 1 -- 172.21.15.37:0/242158413 shutdown_connections 2024-05-30T06:48:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.227+0000 7f528dc00640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52881532b0 0x7f5288154c40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.227+0000 7f528dc00640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52881547d0 0x7f528814bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.227+0000 7f528dc00640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5264068ad0 0x7f526406af90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.227+0000 7f528dc00640 1 --2- 172.21.15.37:0/242158413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f526c004d50 0x7f5288145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.227+0000 7f528dc00640 1 -- 172.21.15.37:0/242158413 >> 172.21.15.37:0/242158413 conn(0x7f528806bf60 msgr2=0x7f5288159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.227+0000 7f528dc00640 1 -- 172.21.15.37:0/242158413 shutdown_connections 2024-05-30T06:48:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.227+0000 7f528dc00640 1 -- 172.21.15.37:0/242158413 wait complete. 2024-05-30T06:48:13.247 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone71654 2024-05-30T06:48:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.391+0000 7f225dc00640 1 Processor -- start 2024-05-30T06:48:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.391+0000 7f225dc00640 1 -- start start 2024-05-30T06:48:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f225dc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22580ced10 0x7f225806ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f225dc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f22580b59d0 0x7f22580b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f225dc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f225815cdd0 0x7f225815d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f225dc00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f225806df50 con 0x7f22580b59d0 2024-05-30T06:48:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f225dc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f22580b6370 con 0x7f225815cdd0 2024-05-30T06:48:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f225dc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f225806e7d0 con 0x7f22580ced10 2024-05-30T06:48:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f224e000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f22580b59d0 0x7f22580b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f224e000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f22580b59d0 0x7f22580b5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51976/0 (socket says 172.21.15.37:51976) 2024-05-30T06:48:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f224e000640 1 -- 172.21.15.37:0/2548919408 learned_addr learned my addr 172.21.15.37:0/2548919408 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f2256a00640 1 --2- 172.21.15.37:0/2548919408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22580ced10 0x7f225806ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f2257400640 1 --2- 172.21.15.37:0/2548919408 >> v2:172.21.15.105:3300/0 conn(0x7f225815cdd0 0x7f225815d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f224e000640 1 -- 172.21.15.37:0/2548919408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22580ced10 msgr2=0x7f225806ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f224e000640 1 --2- 172.21.15.37:0/2548919408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22580ced10 0x7f225806ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f224e000640 1 -- 172.21.15.37:0/2548919408 >> v2:172.21.15.105:3300/0 conn(0x7f225815cdd0 msgr2=0x7f225815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f224e000640 1 --2- 172.21.15.37:0/2548919408 >> v2:172.21.15.105:3300/0 conn(0x7f225815cdd0 0x7f225815d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f224e000640 1 -- 172.21.15.37:0/2548919408 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f225815db00 con 0x7f22580b59d0 2024-05-30T06:48:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f2256a00640 1 --2- 172.21.15.37:0/2548919408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22580ced10 0x7f225806ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.395+0000 7f2257400640 1 --2- 172.21.15.37:0/2548919408 >> v2:172.21.15.105:3300/0 conn(0x7f225815cdd0 0x7f225815d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:13.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f224e000640 1 --2- 172.21.15.37:0/2548919408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22580b59d0 0x7f22580b5e30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f22580b31d0 tx=0x7f224001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511e534e776699ff server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:13.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f2256000640 1 -- 172.21.15.37:0/2548919408 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22400aa610 con 0x7f22580b59d0 2024-05-30T06:48:13.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f2256000640 1 -- 172.21.15.37:0/2548919408 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22400af070 con 0x7f22580b59d0 2024-05-30T06:48:13.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f2256000640 1 -- 172.21.15.37:0/2548919408 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22400aa9d0 con 0x7f22580b59d0 2024-05-30T06:48:13.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 -- 172.21.15.37:0/2548919408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22580b59d0 msgr2=0x7f22580b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 --2- 172.21.15.37:0/2548919408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22580b59d0 0x7f22580b5e30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f22580b31d0 tx=0x7f224001c4f0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 -- 172.21.15.37:0/2548919408 shutdown_connections 2024-05-30T06:48:13.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 --2- 172.21.15.37:0/2548919408 >> v2:172.21.15.105:3300/0 conn(0x7f225815cdd0 0x7f225815d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 --2- 172.21.15.37:0/2548919408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22580b59d0 0x7f22580b5e30 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 --2- 172.21.15.37:0/2548919408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22580ced10 0x7f225806ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 -- 172.21.15.37:0/2548919408 >> 172.21.15.37:0/2548919408 conn(0x7f225806bf60 msgr2=0x7f22580b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:13.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 -- 172.21.15.37:0/2548919408 shutdown_connections 2024-05-30T06:48:13.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 -- 172.21.15.37:0/2548919408 wait complete. 2024-05-30T06:48:13.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 Processor -- start 2024-05-30T06:48:13.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 -- start start 2024-05-30T06:48:13.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22580b59d0 0x7f2258161c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22580ced10 0x7f2258140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225815cdd0 0x7f2258140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f225815e6c0 con 0x7f22580ced10 2024-05-30T06:48:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f225815d7a0 con 0x7f22580b59d0 2024-05-30T06:48:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.399+0000 7f225dc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f225815e840 con 0x7f225815cdd0 2024-05-30T06:48:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22580ced10 0x7f2258140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22580ced10 0x7f2258140840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51988/0 (socket says 172.21.15.37:51988) 2024-05-30T06:48:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224e000640 1 -- 172.21.15.37:0/2666693875 learned_addr learned my addr 172.21.15.37:0/2666693875 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224e000640 1 -- 172.21.15.37:0/2666693875 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225815cdd0 msgr2=0x7f2258140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224e000640 1 --2- 172.21.15.37:0/2666693875 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225815cdd0 0x7f2258140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224e000640 1 -- 172.21.15.37:0/2666693875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22580b59d0 msgr2=0x7f2258161c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224e000640 1 --2- 172.21.15.37:0/2666693875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22580b59d0 0x7f2258161c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224e000640 1 -- 172.21.15.37:0/2666693875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2258162400 con 0x7f22580ced10 2024-05-30T06:48:13.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224e000640 1 --2- 172.21.15.37:0/2666693875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22580ced10 0x7f2258140840 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f224001cd90 tx=0x7f224001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:13.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224f400640 1 -- 172.21.15.37:0/2666693875 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22400bd5f0 con 0x7f22580ced10 2024-05-30T06:48:13.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224f400640 1 -- 172.21.15.37:0/2666693875 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22400bd790 con 0x7f22580ced10 2024-05-30T06:48:13.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224f400640 1 -- 172.21.15.37:0/2666693875 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22400bdb60 con 0x7f22580ced10 2024-05-30T06:48:13.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f225dc00640 1 -- 172.21.15.37:0/2666693875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22581626e0 con 0x7f22580ced10 2024-05-30T06:48:13.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f225dc00640 1 -- 172.21.15.37:0/2666693875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2258162ca0 con 0x7f22580ced10 2024-05-30T06:48:13.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f225dc00640 1 -- 172.21.15.37:0/2666693875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2258068d40 con 0x7f22580ced10 2024-05-30T06:48:13.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224f400640 1 -- 172.21.15.37:0/2666693875 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7f22400b33f0 con 0x7f22580ced10 2024-05-30T06:48:13.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.403+0000 7f224f400640 1 --2- 172.21.15.37:0/2666693875 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2234068ad0 0x7f223406af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.407+0000 7f224f400640 1 -- 172.21.15.37:0/2666693875 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f2240122460 con 0x7f22580ced10 2024-05-30T06:48:13.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.407+0000 7f2256a00640 1 --2- 172.21.15.37:0/2666693875 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2234068ad0 0x7f223406af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.407+0000 7f2256a00640 1 --2- 172.21.15.37:0/2666693875 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2234068ad0 0x7f223406af90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2248009710 tx=0x7f2248008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:13.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.407+0000 7f224f400640 1 -- 172.21.15.37:0/2666693875 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f22400a7070 con 0x7f22580ced10 2024-05-30T06:48:13.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.599+0000 7f225dc00640 1 -- 172.21.15.37:0/2666693875 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone71654", "target": ["mon-mgr", ""]}) -- 0x7f22581621a0 con 0x7f2234068ad0 2024-05-30T06:48:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.627+0000 7f224f400640 1 -- 172.21.15.37:0/2666693875 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2248004030 con 0x7f2234068ad0 2024-05-30T06:48:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.627+0000 7f225dc00640 1 -- 172.21.15.37:0/2666693875 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2234068ad0 msgr2=0x7f223406af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.627+0000 7f225dc00640 1 --2- 172.21.15.37:0/2666693875 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2234068ad0 0x7f223406af90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2248009710 tx=0x7f2248008040 comp rx=0 tx=0).stop 2024-05-30T06:48:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.627+0000 7f225dc00640 1 -- 172.21.15.37:0/2666693875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22580ced10 msgr2=0x7f2258140840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.627+0000 7f225dc00640 1 --2- 172.21.15.37:0/2666693875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22580ced10 0x7f2258140840 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f224001cd90 tx=0x7f224001ad30 comp rx=0 tx=0).stop 2024-05-30T06:48:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.627+0000 7f225dc00640 1 -- 172.21.15.37:0/2666693875 shutdown_connections 2024-05-30T06:48:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.627+0000 7f225dc00640 1 --2- 172.21.15.37:0/2666693875 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f225815cdd0 0x7f2258140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.627+0000 7f225dc00640 1 --2- 172.21.15.37:0/2666693875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22580ced10 0x7f2258140840 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.627+0000 7f225dc00640 1 --2- 172.21.15.37:0/2666693875 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2234068ad0 0x7f223406af90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.627+0000 7f225dc00640 1 --2- 172.21.15.37:0/2666693875 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22580b59d0 0x7f2258161c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.627+0000 7f225dc00640 1 -- 172.21.15.37:0/2666693875 >> 172.21.15.37:0/2666693875 conn(0x7f225806bf60 msgr2=0x7f2258166cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.627+0000 7f225dc00640 1 -- 172.21.15.37:0/2666693875 shutdown_connections 2024-05-30T06:48:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.627+0000 7f225dc00640 1 -- 172.21.15.37:0/2666693875 wait complete. 2024-05-30T06:48:13.629 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:13.629+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:13.629 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:13.629+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:13.630 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:13.629+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:13.630 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:13.629+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:13.630 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:13.629+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:13.647 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:13.649+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:13.647 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:13.649+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:13.647 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:13.649+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:13.648 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:13.649+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:13.648 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:13.649+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:13.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T06:48:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd7c400640 1 Processor -- start 2024-05-30T06:48:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd7c400640 1 -- start start 2024-05-30T06:48:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd7c400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd7415eb60 0x7fcd7406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd7c400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcd740cf630 0x7fcd740d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd7c400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd7409bba0 con 0x7fcd740b15c0 2024-05-30T06:48:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd7c400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcd7409ab00 con 0x7fcd7415eb60 2024-05-30T06:48:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd7c400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcd7409ade0 con 0x7fcd740cf630 2024-05-30T06:48:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd79a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd7415eb60 0x7fcd7406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd79000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcd740b15c0 0x7fcd740cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35608/0 (socket says 172.21.15.37:35608) 2024-05-30T06:48:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd79000640 1 -- 172.21.15.37:0/2053760580 learned_addr learned my addr 172.21.15.37:0/2053760580 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd79a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd7415eb60 0x7fcd7406d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52002/0 (socket says 172.21.15.37:52002) 2024-05-30T06:48:13.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd7a400640 1 --2- 172.21.15.37:0/2053760580 >> v2:172.21.15.105:3300/0 conn(0x7fcd740cf630 0x7fcd740d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd79a00640 1 -- 172.21.15.37:0/2053760580 >> v2:172.21.15.105:3300/0 conn(0x7fcd740cf630 msgr2=0x7fcd740d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:13.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd79a00640 1 --2- 172.21.15.37:0/2053760580 >> v2:172.21.15.105:3300/0 conn(0x7fcd740cf630 0x7fcd740d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd79a00640 1 -- 172.21.15.37:0/2053760580 >> v1:172.21.15.37:6789/0 conn(0x7fcd740b15c0 legacy=0x7fcd740cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.803+0000 7fcd79a00640 1 -- 172.21.15.37:0/2053760580 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7409b0c0 con 0x7fcd7415eb60 2024-05-30T06:48:13.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd79a00640 1 --2- 172.21.15.37:0/2053760580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7415eb60 0x7fcd7406d480 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcd740d01f0 tx=0x7fcd6801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eeb74866cb0e3bf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:13.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd73e00640 1 -- 172.21.15.37:0/2053760580 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd680b0070 con 0x7fcd7415eb60 2024-05-30T06:48:13.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd73e00640 1 -- 172.21.15.37:0/2053760580 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd680ab600 con 0x7fcd7415eb60 2024-05-30T06:48:13.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd73e00640 1 -- 172.21.15.37:0/2053760580 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd680ab9d0 con 0x7fcd7415eb60 2024-05-30T06:48:13.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd7c400640 1 -- 172.21.15.37:0/2053760580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7415eb60 msgr2=0x7fcd7406d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd7c400640 1 --2- 172.21.15.37:0/2053760580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7415eb60 0x7fcd7406d480 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fcd740d01f0 tx=0x7fcd6801c480 comp rx=0 tx=0).stop 2024-05-30T06:48:13.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd7c400640 1 -- 172.21.15.37:0/2053760580 shutdown_connections 2024-05-30T06:48:13.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd7c400640 1 --2- 172.21.15.37:0/2053760580 >> v2:172.21.15.105:3300/0 conn(0x7fcd740cf630 0x7fcd740d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd7c400640 1 --2- 172.21.15.37:0/2053760580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7415eb60 0x7fcd7406d480 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd7c400640 1 -- 172.21.15.37:0/2053760580 >> 172.21.15.37:0/2053760580 conn(0x7fcd740d26a0 msgr2=0x7fcd740d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:13.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd7c400640 1 -- 172.21.15.37:0/2053760580 shutdown_connections 2024-05-30T06:48:13.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd7c400640 1 -- 172.21.15.37:0/2053760580 wait complete. 2024-05-30T06:48:13.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd7c400640 1 Processor -- start 2024-05-30T06:48:13.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.807+0000 7fcd7c400640 1 -- start start 2024-05-30T06:48:13.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7c400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd740b15c0 0x7fcd74154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7c400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd740cf630 0x7fcd740cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7c400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7415eb60 0x7fcd740ce390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7c400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd740d1540 con 0x7fcd7415eb60 2024-05-30T06:48:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7c400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcd740d13c0 con 0x7fcd740b15c0 2024-05-30T06:48:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7c400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcd740d16c0 con 0x7fcd740cf630 2024-05-30T06:48:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7a400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7415eb60 0x7fcd740ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7a400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7415eb60 0x7fcd740ce390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52006/0 (socket says 172.21.15.37:52006) 2024-05-30T06:48:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7a400640 1 -- 172.21.15.37:0/1963471464 learned_addr learned my addr 172.21.15.37:0/1963471464 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd79a00640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd740b15c0 0x7fcd74154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd79000640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd740cf630 0x7fcd740cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7a400640 1 -- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd740cf630 msgr2=0x7fcd740cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7a400640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd740cf630 0x7fcd740cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7a400640 1 -- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd740b15c0 msgr2=0x7fcd74154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7a400640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd740b15c0 0x7fcd74154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7a400640 1 -- 172.21.15.37:0/1963471464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7415d4e0 con 0x7fcd7415eb60 2024-05-30T06:48:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7a400640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7415eb60 0x7fcd740ce390 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00efc0 tx=0x7fcd6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd71600640 1 -- 172.21.15.37:0/1963471464 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c018020 con 0x7fcd7415eb60 2024-05-30T06:48:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd71600640 1 -- 172.21.15.37:0/1963471464 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6c014480 con 0x7fcd7415eb60 2024-05-30T06:48:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd71600640 1 -- 172.21.15.37:0/1963471464 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c014870 con 0x7fcd7415eb60 2024-05-30T06:48:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7c400640 1 -- 172.21.15.37:0/1963471464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd7415d7c0 con 0x7fcd7415eb60 2024-05-30T06:48:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7c400640 1 -- 172.21.15.37:0/1963471464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd7415dd80 con 0x7fcd7415eb60 2024-05-30T06:48:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd7c400640 1 -- 172.21.15.37:0/1963471464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd74068d40 con 0x7fcd7415eb60 2024-05-30T06:48:13.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.811+0000 7fcd71600640 1 -- 172.21.15.37:0/1963471464 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7fcd6c01b020 con 0x7fcd7415eb60 2024-05-30T06:48:13.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.815+0000 7fcd71600640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcd54068b00 0x7fcd5406afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:13.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.815+0000 7fcd71600640 1 -- 172.21.15.37:0/1963471464 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fcd6c088690 con 0x7fcd7415eb60 2024-05-30T06:48:13.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.815+0000 7fcd79a00640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcd54068b00 0x7fcd5406afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:13.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.815+0000 7fcd79a00640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcd54068b00 0x7fcd5406afc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcd680ad000 tx=0x7fcd680a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:13.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:13.819+0000 7fcd71600640 1 -- 172.21.15.37:0/1963471464 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd6c022030 con 0x7fcd7415eb60 2024-05-30T06:48:14.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.011+0000 7fcd7c400640 1 -- 172.21.15.37:0/1963471464 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd7406e1b0 con 0x7fcd54068b00 2024-05-30T06:48:14.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.031+0000 7fcd71600640 1 -- 172.21.15.37:0/1963471464 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fcd7406e1b0 con 0x7fcd54068b00 2024-05-30T06:48:14.029 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:14.029 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:48:14.029 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:14.029 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ss1" 2024-05-30T06:48:14.029 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:14.029 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:48:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.031+0000 7fcd7c400640 1 -- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcd54068b00 msgr2=0x7fcd5406afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.031+0000 7fcd7c400640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcd54068b00 0x7fcd5406afc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcd680ad000 tx=0x7fcd680a6000 comp rx=0 tx=0).stop 2024-05-30T06:48:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.031+0000 7fcd7c400640 1 -- 172.21.15.37:0/1963471464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7415eb60 msgr2=0x7fcd740ce390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.031+0000 7fcd7c400640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7415eb60 0x7fcd740ce390 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00efc0 tx=0x7fcd6c00c490 comp rx=0 tx=0).stop 2024-05-30T06:48:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.031+0000 7fcd7c400640 1 -- 172.21.15.37:0/1963471464 shutdown_connections 2024-05-30T06:48:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.031+0000 7fcd7c400640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7415eb60 0x7fcd740ce390 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.031+0000 7fcd7c400640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd740cf630 0x7fcd740cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.031+0000 7fcd7c400640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcd54068b00 0x7fcd5406afc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.031+0000 7fcd7c400640 1 --2- 172.21.15.37:0/1963471464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd740b15c0 0x7fcd74154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.031+0000 7fcd7c400640 1 -- 172.21.15.37:0/1963471464 >> 172.21.15.37:0/1963471464 conn(0x7fcd740d26a0 msgr2=0x7fcd74157c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.031+0000 7fcd7c400640 1 -- 172.21.15.37:0/1963471464 shutdown_connections 2024-05-30T06:48:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.031+0000 7fcd7c400640 1 -- 172.21.15.37:0/1963471464 wait complete. 2024-05-30T06:48:14.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T06:48:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a5cc00640 1 Processor -- start 2024-05-30T06:48:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a5cc00640 1 -- start start 2024-05-30T06:48:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a5cc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a5815d350 0x7f4a5806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a5cc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4a5815d7b0 0x7f4a5806e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a5cc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a58142030 con 0x7f4a580b59d0 2024-05-30T06:48:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a5cc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4a58142310 con 0x7f4a5815d7b0 2024-05-30T06:48:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a5cc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4a581425f0 con 0x7f4a5815d350 2024-05-30T06:48:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a55e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4a580b59d0 0x7f4a580b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35614/0 (socket says 172.21.15.37:35614) 2024-05-30T06:48:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a55e00640 1 -- 172.21.15.37:0/1582539196 learned_addr learned my addr 172.21.15.37:0/1582539196 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a56800640 1 --2- 172.21.15.37:0/1582539196 >> v2:172.21.15.105:3300/0 conn(0x7f4a5815d7b0 0x7f4a5806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a55400640 1 --2- 172.21.15.37:0/1582539196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a5815d350 0x7f4a5806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a54a00640 1 -- 172.21.15.37:0/1582539196 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521737800 0 0) 0x7f4a58142030 con 0x7f4a580b59d0 2024-05-30T06:48:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a54a00640 1 -- 172.21.15.37:0/1582539196 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a3c003530 con 0x7f4a580b59d0 2024-05-30T06:48:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a56800640 1 -- 172.21.15.37:0/1582539196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a5815d350 msgr2=0x7f4a5806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a56800640 1 --2- 172.21.15.37:0/1582539196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a5815d350 0x7f4a5806df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a56800640 1 -- 172.21.15.37:0/1582539196 >> v1:172.21.15.37:6789/0 conn(0x7f4a580b59d0 legacy=0x7f4a580b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a54a00640 1 -- 172.21.15.37:0/1582539196 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1685128711 0 0) 0x7f4a3c003530 con 0x7f4a580b59d0 2024-05-30T06:48:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a56800640 1 -- 172.21.15.37:0/1582539196 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a581428d0 con 0x7f4a5815d7b0 2024-05-30T06:48:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.199+0000 7f4a55400640 1 --2- 172.21.15.37:0/1582539196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a5815d350 0x7f4a5806df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.203+0000 7f4a56800640 1 --2- 172.21.15.37:0/1582539196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a5815d7b0 0x7f4a5806e490 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009d90 tx=0x7f4a5001f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccedbbd7e3db3722 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.203+0000 7f4a54a00640 1 -- 172.21.15.37:0/1582539196 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a500b5070 con 0x7f4a5815d7b0 2024-05-30T06:48:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.203+0000 7f4a54a00640 1 -- 172.21.15.37:0/1582539196 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a500a8bd0 con 0x7f4a5815d7b0 2024-05-30T06:48:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.203+0000 7f4a54a00640 1 -- 172.21.15.37:0/1582539196 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a48001680 con 0x7f4a5815d7b0 2024-05-30T06:48:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.203+0000 7f4a5cc00640 1 -- 172.21.15.37:0/1582539196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a5815d7b0 msgr2=0x7f4a5806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.203+0000 7f4a5cc00640 1 --2- 172.21.15.37:0/1582539196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a5815d7b0 0x7f4a5806e490 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009d90 tx=0x7f4a5001f080 comp rx=0 tx=0).stop 2024-05-30T06:48:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.203+0000 7f4a5cc00640 1 -- 172.21.15.37:0/1582539196 shutdown_connections 2024-05-30T06:48:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.203+0000 7f4a5cc00640 1 --2- 172.21.15.37:0/1582539196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a5815d7b0 0x7f4a5806e490 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.203+0000 7f4a5cc00640 1 --2- 172.21.15.37:0/1582539196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a5815d350 0x7f4a5806df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.203+0000 7f4a5cc00640 1 -- 172.21.15.37:0/1582539196 >> 172.21.15.37:0/1582539196 conn(0x7f4a5806bf60 msgr2=0x7f4a580b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.203+0000 7f4a5cc00640 1 -- 172.21.15.37:0/1582539196 shutdown_connections 2024-05-30T06:48:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.203+0000 7f4a5cc00640 1 -- 172.21.15.37:0/1582539196 wait complete. 2024-05-30T06:48:14.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a5cc00640 1 Processor -- start 2024-05-30T06:48:14.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a5cc00640 1 -- start start 2024-05-30T06:48:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a5cc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a580b59d0 0x7f4a58155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a5cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a5815d350 0x7f4a581572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a5cc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a5815d7b0 0x7f4a58157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a5cc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4a580b00a0 con 0x7f4a5815d350 2024-05-30T06:48:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a5cc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4a580aff20 con 0x7f4a580b59d0 2024-05-30T06:48:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a5cc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4a5813f860 con 0x7f4a5815d7b0 2024-05-30T06:48:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a55400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a5815d350 0x7f4a581572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a55400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a5815d350 0x7f4a581572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52010/0 (socket says 172.21.15.37:52010) 2024-05-30T06:48:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a55400640 1 -- 172.21.15.37:0/4189941801 learned_addr learned my addr 172.21.15.37:0/4189941801 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a55e00640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a580b59d0 0x7f4a58155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a55400640 1 -- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a5815d7b0 msgr2=0x7f4a58157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a56800640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a5815d7b0 0x7f4a58157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a55400640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a5815d7b0 0x7f4a58157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a55400640 1 -- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a580b59d0 msgr2=0x7f4a58155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a55400640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a580b59d0 0x7f4a58155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a55400640 1 -- 172.21.15.37:0/4189941801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a58157e30 con 0x7f4a5815d350 2024-05-30T06:48:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a55e00640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a580b59d0 0x7f4a58155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a56800640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a5815d7b0 0x7f4a58157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a55400640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a5815d350 0x7f4a581572c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400e980 tx=0x7f4a4400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a4e000640 1 -- 172.21.15.37:0/4189941801 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a44017070 con 0x7f4a5815d350 2024-05-30T06:48:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a4e000640 1 -- 172.21.15.37:0/4189941801 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4400ca00 con 0x7f4a5815d350 2024-05-30T06:48:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a5cc00640 1 -- 172.21.15.37:0/4189941801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a58158110 con 0x7f4a5815d350 2024-05-30T06:48:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a4e000640 1 -- 172.21.15.37:0/4189941801 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4400cdd0 con 0x7f4a5815d350 2024-05-30T06:48:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.207+0000 7f4a5cc00640 1 -- 172.21.15.37:0/4189941801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a581586d0 con 0x7f4a5815d350 2024-05-30T06:48:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.211+0000 7f4a5cc00640 1 -- 172.21.15.37:0/4189941801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a58068bc0 con 0x7f4a5815d350 2024-05-30T06:48:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.211+0000 7f4a4e000640 1 -- 172.21.15.37:0/4189941801 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7f4a4401a070 con 0x7f4a5815d350 2024-05-30T06:48:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.211+0000 7f4a4e000640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4a38068ad0 0x7f4a3806af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.211+0000 7f4a4e000640 1 -- 172.21.15.37:0/4189941801 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f4a44087db0 con 0x7f4a5815d350 2024-05-30T06:48:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.211+0000 7f4a55e00640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4a38068ad0 0x7f4a3806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.211+0000 7f4a55e00640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4a38068ad0 0x7f4a3806af90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4a48001ec0 tx=0x7f4a48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.215+0000 7f4a4e000640 1 -- 172.21.15.37:0/4189941801 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4a44057480 con 0x7f4a5815d350 2024-05-30T06:48:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.411+0000 7f4a5cc00640 1 -- 172.21.15.37:0/4189941801 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a5806e740 con 0x7f4a38068ad0 2024-05-30T06:48:14.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.443+0000 7f4a4e000640 1 -- 172.21.15.37:0/4189941801 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4a5806e740 con 0x7f4a38068ad0 2024-05-30T06:48:14.441 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.443+0000 7f4a5cc00640 1 -- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4a38068ad0 msgr2=0x7f4a3806af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.443+0000 7f4a5cc00640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4a38068ad0 0x7f4a3806af90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4a48001ec0 tx=0x7f4a48009040 comp rx=0 tx=0).stop 2024-05-30T06:48:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.443+0000 7f4a5cc00640 1 -- 172.21.15.37:0/4189941801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a5815d350 msgr2=0x7f4a581572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.443+0000 7f4a5cc00640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a5815d350 0x7f4a581572c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400e980 tx=0x7f4a4400ee40 comp rx=0 tx=0).stop 2024-05-30T06:48:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.443+0000 7f4a5cc00640 1 -- 172.21.15.37:0/4189941801 shutdown_connections 2024-05-30T06:48:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.443+0000 7f4a5cc00640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a5815d7b0 0x7f4a58157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.443+0000 7f4a5cc00640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a5815d350 0x7f4a581572c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.443+0000 7f4a5cc00640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4a38068ad0 0x7f4a3806af90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.443+0000 7f4a5cc00640 1 --2- 172.21.15.37:0/4189941801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a580b59d0 0x7f4a58155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.443+0000 7f4a5cc00640 1 -- 172.21.15.37:0/4189941801 >> 172.21.15.37:0/4189941801 conn(0x7f4a5806bf60 msgr2=0x7f4a58074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.443+0000 7f4a5cc00640 1 -- 172.21.15.37:0/4189941801 shutdown_connections 2024-05-30T06:48:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.443+0000 7f4a5cc00640 1 -- 172.21.15.37:0/4189941801 wait complete. 2024-05-30T06:48:14.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T06:48:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.607+0000 7f1268e00640 1 Processor -- start 2024-05-30T06:48:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.607+0000 7f1268e00640 1 -- start start 2024-05-30T06:48:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1268e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1264155da0 0x7f12640cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1268e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12640cd440 0x7f126406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1268e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126415f310 con 0x7f126406f5a0 2024-05-30T06:48:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1268e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f12640b4760 con 0x7f1264155da0 2024-05-30T06:48:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1268e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f126415f5f0 con 0x7f12640cd440 2024-05-30T06:48:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1261e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1264155da0 0x7f12640cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1261e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1264155da0 0x7f12640cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52012/0 (socket says 172.21.15.37:52012) 2024-05-30T06:48:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1261e00640 1 -- 172.21.15.37:0/4270293866 learned_addr learned my addr 172.21.15.37:0/4270293866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1259400640 1 --2- 172.21.15.37:0/4270293866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12640cd440 0x7f126406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1261e00640 1 -- 172.21.15.37:0/4270293866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12640cd440 msgr2=0x7f126406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1261e00640 1 --2- 172.21.15.37:0/4270293866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12640cd440 0x7f126406f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1261e00640 1 -- 172.21.15.37:0/4270293866 >> v1:172.21.15.37:6789/0 conn(0x7f126406f5a0 legacy=0x7f12640cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1261e00640 1 -- 172.21.15.37:0/4270293866 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126415f8d0 con 0x7f1264155da0 2024-05-30T06:48:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1259400640 1 --2- 172.21.15.37:0/4270293866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12640cd440 0x7f126406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1261e00640 1 --2- 172.21.15.37:0/4270293866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1264155da0 0x7f12640cd950 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1254009870 tx=0x7f125401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893ef6ede491831f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.611+0000 7f1261400640 1 -- 172.21.15.37:0/4270293866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540b0070 con 0x7f1264155da0 2024-05-30T06:48:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1261400640 1 -- 172.21.15.37:0/4270293866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12540ab600 con 0x7f1264155da0 2024-05-30T06:48:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1261400640 1 -- 172.21.15.37:0/4270293866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540ab9d0 con 0x7f1264155da0 2024-05-30T06:48:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 -- 172.21.15.37:0/4270293866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1264155da0 msgr2=0x7f12640cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 --2- 172.21.15.37:0/4270293866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1264155da0 0x7f12640cd950 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1254009870 tx=0x7f125401c440 comp rx=0 tx=0).stop 2024-05-30T06:48:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 -- 172.21.15.37:0/4270293866 shutdown_connections 2024-05-30T06:48:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 --2- 172.21.15.37:0/4270293866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12640cd440 0x7f126406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 --2- 172.21.15.37:0/4270293866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1264155da0 0x7f12640cd950 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 -- 172.21.15.37:0/4270293866 >> 172.21.15.37:0/4270293866 conn(0x7f126406bf60 msgr2=0x7f12640b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 -- 172.21.15.37:0/4270293866 shutdown_connections 2024-05-30T06:48:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 -- 172.21.15.37:0/4270293866 wait complete. 2024-05-30T06:48:14.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 Processor -- start 2024-05-30T06:48:14.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 -- start start 2024-05-30T06:48:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126406f5a0 0x7f1264152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1264155da0 0x7f1264160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1264153da0 0x7f12641572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1264168580 con 0x7f126406f5a0 2024-05-30T06:48:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f126406f9d0 con 0x7f1264155da0 2024-05-30T06:48:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1268e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1264168700 con 0x7f1264153da0 2024-05-30T06:48:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1261e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126406f5a0 0x7f1264152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1261e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126406f5a0 0x7f1264152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52028/0 (socket says 172.21.15.37:52028) 2024-05-30T06:48:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1261e00640 1 -- 172.21.15.37:0/424302562 learned_addr learned my addr 172.21.15.37:0/424302562 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1259400640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1264155da0 0x7f1264160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1262800640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1264153da0 0x7f12641572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1261e00640 1 -- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1264153da0 msgr2=0x7f12641572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1261e00640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1264153da0 0x7f12641572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1261e00640 1 -- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1264155da0 msgr2=0x7f1264160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1261e00640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1264155da0 0x7f1264160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.615+0000 7f1261e00640 1 -- 172.21.15.37:0/424302562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1264160870 con 0x7f126406f5a0 2024-05-30T06:48:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.619+0000 7f1261e00640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126406f5a0 0x7f1264152140 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f12540ae040 tx=0x7f125401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.619+0000 7f125aa00640 1 -- 172.21.15.37:0/424302562 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540b8070 con 0x7f126406f5a0 2024-05-30T06:48:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.619+0000 7f125aa00640 1 -- 172.21.15.37:0/424302562 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12540bc600 con 0x7f126406f5a0 2024-05-30T06:48:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.619+0000 7f1268e00640 1 -- 172.21.15.37:0/424302562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12641564e0 con 0x7f126406f5a0 2024-05-30T06:48:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.619+0000 7f125aa00640 1 -- 172.21.15.37:0/424302562 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540abe60 con 0x7f126406f5a0 2024-05-30T06:48:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.619+0000 7f1268e00640 1 -- 172.21.15.37:0/424302562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1264156aa0 con 0x7f126406f5a0 2024-05-30T06:48:14.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.619+0000 7f1268e00640 1 -- 172.21.15.37:0/424302562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1264068bc0 con 0x7f126406f5a0 2024-05-30T06:48:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.619+0000 7f125aa00640 1 -- 172.21.15.37:0/424302562 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 88650+0+0 (secure 0 0 0) 0x7f12540c3060 con 0x7f126406f5a0 2024-05-30T06:48:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.619+0000 7f125aa00640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1240068b00 0x7f124006afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.619+0000 7f125aa00640 1 -- 172.21.15.37:0/424302562 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f1254122f60 con 0x7f126406f5a0 2024-05-30T06:48:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.619+0000 7f1259400640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1240068b00 0x7f124006afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:14.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.623+0000 7f1259400640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1240068b00 0x7f124006afc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f12641629e0 tx=0x7f124c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:14.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.623+0000 7f125aa00640 1 -- 172.21.15.37:0/424302562 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1254016150 con 0x7f126406f5a0 2024-05-30T06:48:14.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.807+0000 7f125aa00640 1 -- 172.21.15.37:0/424302562 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f12540eead0 con 0x7f126406f5a0 2024-05-30T06:48:14.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.819+0000 7f1268e00640 1 -- 172.21.15.37:0/424302562 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f12640b6260 con 0x7f1240068b00 2024-05-30T06:48:14.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.835+0000 7f125aa00640 1 -- 172.21.15.37:0/424302562 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f12640b6260 con 0x7f1240068b00 2024-05-30T06:48:14.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.839+0000 7f1268e00640 1 -- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1240068b00 msgr2=0x7f124006afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.839+0000 7f1268e00640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1240068b00 0x7f124006afc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f12641629e0 tx=0x7f124c008040 comp rx=0 tx=0).stop 2024-05-30T06:48:14.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.839+0000 7f1268e00640 1 -- 172.21.15.37:0/424302562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126406f5a0 msgr2=0x7f1264152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:14.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.839+0000 7f1268e00640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126406f5a0 0x7f1264152140 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f12540ae040 tx=0x7f125401ac80 comp rx=0 tx=0).stop 2024-05-30T06:48:14.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.839+0000 7f1268e00640 1 -- 172.21.15.37:0/424302562 shutdown_connections 2024-05-30T06:48:14.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.839+0000 7f1268e00640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1264153da0 0x7f12641572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.839+0000 7f1268e00640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1240068b00 0x7f124006afc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.839+0000 7f1268e00640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1264155da0 0x7f1264160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.839+0000 7f1268e00640 1 --2- 172.21.15.37:0/424302562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f126406f5a0 0x7f1264152140 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.839+0000 7f1268e00640 1 -- 172.21.15.37:0/424302562 >> 172.21.15.37:0/424302562 conn(0x7f126406bf60 msgr2=0x7f1264071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.839+0000 7f1268e00640 1 -- 172.21.15.37:0/424302562 shutdown_connections 2024-05-30T06:48:14.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:14.839+0000 7f1268e00640 1 -- 172.21.15.37:0/424302562 wait complete. 2024-05-30T06:48:14.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone71652 2024-05-30T06:48:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1129400640 1 Processor -- start 2024-05-30T06:48:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1129400640 1 -- start start 2024-05-30T06:48:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1129400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11240b60e0 0x7f112406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1129400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f112415cdd0 0x7f112415d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1129400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f112415db00 con 0x7f11240ced10 2024-05-30T06:48:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1129400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f112406df50 con 0x7f112415cdd0 2024-05-30T06:48:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1129400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f112406e7d0 con 0x7f11240b60e0 2024-05-30T06:48:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1122800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f11240ced10 0x7f11240b59d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35644/0 (socket says 172.21.15.37:35644) 2024-05-30T06:48:15.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1122800640 1 -- 172.21.15.37:0/2149316035 learned_addr learned my addr 172.21.15.37:0/2149316035 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:15.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1121e00640 1 --2- 172.21.15.37:0/2149316035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11240b60e0 0x7f112406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1123200640 1 --2- 172.21.15.37:0/2149316035 >> v2:172.21.15.105:3300/0 conn(0x7f112415cdd0 0x7f112415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1121400640 1 -- 172.21.15.37:0/2149316035 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 817338526 0 0) 0x7f112415db00 con 0x7f11240ced10 2024-05-30T06:48:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1121400640 1 -- 172.21.15.37:0/2149316035 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1108003530 con 0x7f11240ced10 2024-05-30T06:48:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1121400640 1 -- 172.21.15.37:0/2149316035 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1161380778 0 0) 0x7f1108003530 con 0x7f11240ced10 2024-05-30T06:48:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1121e00640 1 -- 172.21.15.37:0/2149316035 >> v2:172.21.15.105:3300/0 conn(0x7f112415cdd0 msgr2=0x7f112415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1121e00640 1 --2- 172.21.15.37:0/2149316035 >> v2:172.21.15.105:3300/0 conn(0x7f112415cdd0 0x7f112415d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1121e00640 1 -- 172.21.15.37:0/2149316035 >> v1:172.21.15.37:6789/0 conn(0x7f11240ced10 legacy=0x7f11240b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1121e00640 1 -- 172.21.15.37:0/2149316035 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112406e180 con 0x7f11240b60e0 2024-05-30T06:48:15.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.011+0000 7f1123200640 1 --2- 172.21.15.37:0/2149316035 >> v2:172.21.15.105:3300/0 conn(0x7f112415cdd0 0x7f112415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:15.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.015+0000 7f1121e00640 1 --2- 172.21.15.37:0/2149316035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11240b60e0 0x7f112406ec60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f11100097c0 tx=0x7f111001c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94ee8226198d754b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:15.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.015+0000 7f1121400640 1 -- 172.21.15.37:0/2149316035 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11100b0070 con 0x7f11240b60e0 2024-05-30T06:48:15.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.015+0000 7f1121400640 1 -- 172.21.15.37:0/2149316035 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11100ab400 con 0x7f11240b60e0 2024-05-30T06:48:15.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.015+0000 7f1121400640 1 -- 172.21.15.37:0/2149316035 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114001680 con 0x7f11240b60e0 2024-05-30T06:48:15.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.015+0000 7f1129400640 1 -- 172.21.15.37:0/2149316035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11240b60e0 msgr2=0x7f112406ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.015+0000 7f1129400640 1 --2- 172.21.15.37:0/2149316035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11240b60e0 0x7f112406ec60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f11100097c0 tx=0x7f111001c390 comp rx=0 tx=0).stop 2024-05-30T06:48:15.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.015+0000 7f1129400640 1 -- 172.21.15.37:0/2149316035 shutdown_connections 2024-05-30T06:48:15.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.015+0000 7f1129400640 1 --2- 172.21.15.37:0/2149316035 >> v2:172.21.15.105:3300/0 conn(0x7f112415cdd0 0x7f112415d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.015+0000 7f1129400640 1 --2- 172.21.15.37:0/2149316035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11240b60e0 0x7f112406ec60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.015+0000 7f1129400640 1 -- 172.21.15.37:0/2149316035 >> 172.21.15.37:0/2149316035 conn(0x7f112406bf60 msgr2=0x7f11240b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:15.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.015+0000 7f1129400640 1 -- 172.21.15.37:0/2149316035 shutdown_connections 2024-05-30T06:48:15.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.015+0000 7f1129400640 1 -- 172.21.15.37:0/2149316035 wait complete. 2024-05-30T06:48:15.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1129400640 1 Processor -- start 2024-05-30T06:48:15.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1129400640 1 -- start start 2024-05-30T06:48:15.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1129400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11240b60e0 0x7f112413bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1129400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11240ced10 0x7f1124149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1129400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f112415cdd0 0x7f112414df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1129400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f112415e840 con 0x7f112415cdd0 2024-05-30T06:48:15.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1129400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f112415e6c0 con 0x7f11240b60e0 2024-05-30T06:48:15.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1129400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f112415e9c0 con 0x7f11240ced10 2024-05-30T06:48:15.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1123200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f112415cdd0 0x7f112414df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1123200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f112415cdd0 0x7f112414df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52040/0 (socket says 172.21.15.37:52040) 2024-05-30T06:48:15.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1123200640 1 -- 172.21.15.37:0/1222075170 learned_addr learned my addr 172.21.15.37:0/1222075170 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:15.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1121e00640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11240ced10 0x7f1124149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1122800640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11240b60e0 0x7f112413bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1123200640 1 -- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11240ced10 msgr2=0x7f1124149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1123200640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11240ced10 0x7f1124149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1123200640 1 -- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11240b60e0 msgr2=0x7f112413bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1123200640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11240b60e0 0x7f112413bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1123200640 1 -- 172.21.15.37:0/1222075170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112414b0d0 con 0x7f112415cdd0 2024-05-30T06:48:15.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1123200640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f112415cdd0 0x7f112414df90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f111c00efc0 tx=0x7f111c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:15.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f111aa00640 1 -- 172.21.15.37:0/1222075170 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c018030 con 0x7f112415cdd0 2024-05-30T06:48:15.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f111aa00640 1 -- 172.21.15.37:0/1222075170 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111c00cd80 con 0x7f112415cdd0 2024-05-30T06:48:15.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1129400640 1 -- 172.21.15.37:0/1222075170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f112414a830 con 0x7f112415cdd0 2024-05-30T06:48:15.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f111aa00640 1 -- 172.21.15.37:0/1222075170 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c003bc0 con 0x7f112415cdd0 2024-05-30T06:48:15.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.019+0000 7f1129400640 1 -- 172.21.15.37:0/1222075170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f112414adf0 con 0x7f112415cdd0 2024-05-30T06:48:15.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.023+0000 7f1129400640 1 -- 172.21.15.37:0/1222075170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1124068d40 con 0x7f112415cdd0 2024-05-30T06:48:15.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.023+0000 7f111aa00640 1 -- 172.21.15.37:0/1222075170 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f111c01b070 con 0x7f112415cdd0 2024-05-30T06:48:15.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.023+0000 7f111aa00640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1104068bf0 0x7f110406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.023+0000 7f111aa00640 1 -- 172.21.15.37:0/1222075170 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7f111c085a90 con 0x7f112415cdd0 2024-05-30T06:48:15.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.023+0000 7f1122800640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1104068bf0 0x7f110406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.023+0000 7f1122800640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1104068bf0 0x7f110406b0b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f11140013d0 tx=0x7f1114001360 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:15.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.027+0000 7f111aa00640 1 -- 172.21.15.37:0/1222075170 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f111c022070 con 0x7f112415cdd0 2024-05-30T06:48:15.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.215+0000 7f1129400640 1 -- 172.21.15.37:0/1222075170 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone71652", "target": ["mon-mgr", ""]}) -- 0x7f11240cf3c0 con 0x7f1104068bf0 2024-05-30T06:48:15.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.243+0000 7f111aa00640 1 -- 172.21.15.37:0/1222075170 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f11240cf3c0 con 0x7f1104068bf0 2024-05-30T06:48:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.243+0000 7f1129400640 1 -- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1104068bf0 msgr2=0x7f110406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.243+0000 7f1129400640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1104068bf0 0x7f110406b0b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f11140013d0 tx=0x7f1114001360 comp rx=0 tx=0).stop 2024-05-30T06:48:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.243+0000 7f1129400640 1 -- 172.21.15.37:0/1222075170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f112415cdd0 msgr2=0x7f112414df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.243+0000 7f1129400640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f112415cdd0 0x7f112414df90 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f111c00efc0 tx=0x7f111c009f90 comp rx=0 tx=0).stop 2024-05-30T06:48:15.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.243+0000 7f1129400640 1 -- 172.21.15.37:0/1222075170 shutdown_connections 2024-05-30T06:48:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.243+0000 7f1129400640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f112415cdd0 0x7f112414df90 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.243+0000 7f1129400640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11240ced10 0x7f1124149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.243+0000 7f1129400640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1104068bf0 0x7f110406b0b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.243+0000 7f1129400640 1 --2- 172.21.15.37:0/1222075170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11240b60e0 0x7f112413bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.243+0000 7f1129400640 1 -- 172.21.15.37:0/1222075170 >> 172.21.15.37:0/1222075170 conn(0x7f112406bf60 msgr2=0x7f11240b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.243+0000 7f1129400640 1 -- 172.21.15.37:0/1222075170 shutdown_connections 2024-05-30T06:48:15.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.243+0000 7f1129400640 1 -- 172.21.15.37:0/1222075170 wait complete. 2024-05-30T06:48:15.265 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone71651 2024-05-30T06:48:15.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.411+0000 7fb24ea00640 1 Processor -- start 2024-05-30T06:48:15.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.411+0000 7fb24ea00640 1 -- start start 2024-05-30T06:48:15.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb24ea00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb2480cd400 0x7fb24806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb24ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb24806f5a0 0x7fb2480b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb24ea00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2480ce030 con 0x7fb2481590c0 2024-05-30T06:48:15.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb24ea00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb24815f230 con 0x7fb2480cd400 2024-05-30T06:48:15.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb24ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb24815f510 con 0x7fb24806f5a0 2024-05-30T06:48:15.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb247e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fb2481590c0 0x7fb2480cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:42818/0 (socket says 172.21.15.37:42818) 2024-05-30T06:48:15.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb247e00640 1 -- 172.21.15.37:0/4217554999 learned_addr learned my addr 172.21.15.37:0/4217554999 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:15.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb247400640 1 --2- 172.21.15.37:0/4217554999 >> v2:172.21.15.105:3300/0 conn(0x7fb2480cd400 0x7fb24806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb24ca00640 1 --2- 172.21.15.37:0/4217554999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb24806f5a0 0x7fb2480b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb246a00640 1 -- 172.21.15.37:0/4217554999 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854976393 0 0) 0x7fb2480ce030 con 0x7fb2481590c0 2024-05-30T06:48:15.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb246a00640 1 -- 172.21.15.37:0/4217554999 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb22c003530 con 0x7fb2481590c0 2024-05-30T06:48:15.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb247400640 1 -- 172.21.15.37:0/4217554999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb24806f5a0 msgr2=0x7fb2480b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:15.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb247400640 1 --2- 172.21.15.37:0/4217554999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb24806f5a0 0x7fb2480b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb247400640 1 -- 172.21.15.37:0/4217554999 >> v1:172.21.15.105:6789/0 conn(0x7fb2481590c0 legacy=0x7fb2480cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb247400640 1 -- 172.21.15.37:0/4217554999 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24815f7f0 con 0x7fb2480cd400 2024-05-30T06:48:15.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.415+0000 7fb24ca00640 1 --2- 172.21.15.37:0/4217554999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb24806f5a0 0x7fb2480b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:15.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb247400640 1 --2- 172.21.15.37:0/4217554999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2480cd400 0x7fb24806f060 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb2340097c0 tx=0x7fb23401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2aef46c2da9b649 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:15.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb246a00640 1 -- 172.21.15.37:0/4217554999 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2340b0070 con 0x7fb2480cd400 2024-05-30T06:48:15.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb246a00640 1 -- 172.21.15.37:0/4217554999 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2340ab600 con 0x7fb2480cd400 2024-05-30T06:48:15.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb246a00640 1 -- 172.21.15.37:0/4217554999 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2340ab9d0 con 0x7fb2480cd400 2024-05-30T06:48:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb24ea00640 1 -- 172.21.15.37:0/4217554999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2480cd400 msgr2=0x7fb24806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb24ea00640 1 --2- 172.21.15.37:0/4217554999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2480cd400 0x7fb24806f060 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb2340097c0 tx=0x7fb23401c410 comp rx=0 tx=0).stop 2024-05-30T06:48:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb24ea00640 1 -- 172.21.15.37:0/4217554999 shutdown_connections 2024-05-30T06:48:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb24ea00640 1 --2- 172.21.15.37:0/4217554999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb24806f5a0 0x7fb2480b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb24ea00640 1 --2- 172.21.15.37:0/4217554999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2480cd400 0x7fb24806f060 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb24ea00640 1 -- 172.21.15.37:0/4217554999 >> 172.21.15.37:0/4217554999 conn(0x7fb24806bf60 msgr2=0x7fb2480b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:15.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb24ea00640 1 -- 172.21.15.37:0/4217554999 shutdown_connections 2024-05-30T06:48:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb24ea00640 1 -- 172.21.15.37:0/4217554999 wait complete. 2024-05-30T06:48:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb24ea00640 1 Processor -- start 2024-05-30T06:48:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.419+0000 7fb24ea00640 1 -- start start 2024-05-30T06:48:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ea00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24806f5a0 0x7fb2480b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480cd400 0x7fb24814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2481590c0 0x7fb24814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb248166490 con 0x7fb2481590c0 2024-05-30T06:48:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ea00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb24806f9b0 con 0x7fb24806f5a0 2024-05-30T06:48:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb248166610 con 0x7fb2480cd400 2024-05-30T06:48:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2481590c0 0x7fb24814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2481590c0 0x7fb24814cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52046/0 (socket says 172.21.15.37:52046) 2024-05-30T06:48:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ca00640 1 -- 172.21.15.37:0/3447636360 learned_addr learned my addr 172.21.15.37:0/3447636360 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb247400640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480cd400 0x7fb24814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb247e00640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24806f5a0 0x7fb2480b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ca00640 1 -- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480cd400 msgr2=0x7fb24814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ca00640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480cd400 0x7fb24814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ca00640 1 -- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24806f5a0 msgr2=0x7fb2480b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ca00640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24806f5a0 0x7fb2480b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ca00640 1 -- 172.21.15.37:0/3447636360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24815bad0 con 0x7fb2481590c0 2024-05-30T06:48:15.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ca00640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2481590c0 0x7fb24814cbf0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb240009f00 tx=0x7fb24000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:15.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb23fe00640 1 -- 172.21.15.37:0/3447636360 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240018030 con 0x7fb2481590c0 2024-05-30T06:48:15.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb23fe00640 1 -- 172.21.15.37:0/3447636360 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24000ce50 con 0x7fb2481590c0 2024-05-30T06:48:15.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb23fe00640 1 -- 172.21.15.37:0/3447636360 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240003bc0 con 0x7fb2481590c0 2024-05-30T06:48:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ea00640 1 -- 172.21.15.37:0/3447636360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24815bdb0 con 0x7fb2481590c0 2024-05-30T06:48:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ea00640 1 -- 172.21.15.37:0/3447636360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24815c370 con 0x7fb2481590c0 2024-05-30T06:48:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb24ea00640 1 -- 172.21.15.37:0/3447636360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb248068d40 con 0x7fb2481590c0 2024-05-30T06:48:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.423+0000 7fb23fe00640 1 -- 172.21.15.37:0/3447636360 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fb24001b070 con 0x7fb2481590c0 2024-05-30T06:48:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.427+0000 7fb23fe00640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb228068bf0 0x7fb22806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.427+0000 7fb23fe00640 1 -- 172.21.15.37:0/3447636360 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fb240088100 con 0x7fb2481590c0 2024-05-30T06:48:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.427+0000 7fb247e00640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb228068bf0 0x7fb22806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.427+0000 7fb247e00640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb228068bf0 0x7fb22806b0b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb238007fd0 tx=0x7fb238009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.431+0000 7fb23fe00640 1 -- 172.21.15.37:0/3447636360 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb240010040 con 0x7fb2481590c0 2024-05-30T06:48:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.619+0000 7fb24ea00640 1 -- 172.21.15.37:0/3447636360 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone71651", "target": ["mon-mgr", ""]}) -- 0x7fb24814fd60 con 0x7fb228068bf0 2024-05-30T06:48:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.639+0000 7fb23fe00640 1 -- 172.21.15.37:0/3447636360 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb24814fd60 con 0x7fb228068bf0 2024-05-30T06:48:15.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.639+0000 7fb24ea00640 1 -- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb228068bf0 msgr2=0x7fb22806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.639+0000 7fb24ea00640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb228068bf0 0x7fb22806b0b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb238007fd0 tx=0x7fb238009040 comp rx=0 tx=0).stop 2024-05-30T06:48:15.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.639+0000 7fb24ea00640 1 -- 172.21.15.37:0/3447636360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2481590c0 msgr2=0x7fb24814cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.639+0000 7fb24ea00640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2481590c0 0x7fb24814cbf0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb240009f00 tx=0x7fb24000c490 comp rx=0 tx=0).stop 2024-05-30T06:48:15.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.639+0000 7fb24ea00640 1 -- 172.21.15.37:0/3447636360 shutdown_connections 2024-05-30T06:48:15.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.639+0000 7fb24ea00640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2481590c0 0x7fb24814cbf0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.639+0000 7fb24ea00640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2480cd400 0x7fb24814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.639+0000 7fb24ea00640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb228068bf0 0x7fb22806b0b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.639+0000 7fb24ea00640 1 --2- 172.21.15.37:0/3447636360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb24806f5a0 0x7fb2480b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.639+0000 7fb24ea00640 1 -- 172.21.15.37:0/3447636360 >> 172.21.15.37:0/3447636360 conn(0x7fb24806bf60 msgr2=0x7fb248150560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:15.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.639+0000 7fb24ea00640 1 -- 172.21.15.37:0/3447636360 shutdown_connections 2024-05-30T06:48:15.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.643+0000 7fb24ea00640 1 -- 172.21.15.37:0/3447636360 wait complete. 2024-05-30T06:48:15.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone71653 2024-05-30T06:48:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.903+0000 7fad25a00640 1 Processor -- start 2024-05-30T06:48:15.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad25a00640 1 -- start start 2024-05-30T06:48:15.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad25a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fad200ced10 0x7fad2006ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad25a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2015db00 con 0x7fad2015d4e0 2024-05-30T06:48:15.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad25a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2006e180 con 0x7fad200b59d0 2024-05-30T06:48:15.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad25a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fad2006df50 con 0x7fad200ced10 2024-05-30T06:48:15.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1f400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fad2015d4e0 0x7fad2015deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35654/0 (socket says 172.21.15.37:35654) 2024-05-30T06:48:15.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1f400640 1 -- 172.21.15.37:0/4241429879 learned_addr learned my addr 172.21.15.37:0/4241429879 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1ea00640 1 --2- 172.21.15.37:0/4241429879 >> v2:172.21.15.105:3300/0 conn(0x7fad200ced10 0x7fad2006ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14642397 0 0) 0x7fad2015db00 con 0x7fad2015d4e0 2024-05-30T06:48:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad04003530 con 0x7fad2015d4e0 2024-05-30T06:48:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3148553703 0 0) 0x7fad2006e180 con 0x7fad200b59d0 2024-05-30T06:48:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad2015db00 con 0x7fad200b59d0 2024-05-30T06:48:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1088064748 0 0) 0x7fad04003530 con 0x7fad2015d4e0 2024-05-30T06:48:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 >> v2:172.21.15.105:3300/0 conn(0x7fad200ced10 msgr2=0x7fad2006ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 --2- 172.21.15.37:0/4241429879 >> v2:172.21.15.105:3300/0 conn(0x7fad200ced10 0x7fad2006ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 >> v1:172.21.15.105:6789/0 conn(0x7fad200b59d0 legacy=0x7fad2015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2006e460 con 0x7fad2015d4e0 2024-05-30T06:48:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fad18001980 con 0x7fad2015d4e0 2024-05-30T06:48:15.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 >> v1:172.21.15.37:6789/0 conn(0x7fad2015d4e0 legacy=0x7fad2015deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 --2- 172.21.15.37:0/4241429879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad04003ba0 0x7fad04003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 --2- 172.21.15.37:0/4241429879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad04004810 0x7fad04004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 --2- 172.21.15.37:0/4241429879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad040051d0 0x7fad0400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad0400c0a0 con 0x7fad040051d0 2024-05-30T06:48:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad0400c220 con 0x7fad04004810 2024-05-30T06:48:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad0400c420 con 0x7fad04003ba0 2024-05-30T06:48:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1f400640 1 --2- 172.21.15.37:0/4241429879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad040051d0 0x7fad0400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1ea00640 1 --2- 172.21.15.37:0/4241429879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad04003ba0 0x7fad04003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1e000640 1 --2- 172.21.15.37:0/4241429879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad04004810 0x7fad04004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1f400640 1 -- 172.21.15.37:0/4241429879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad04003ba0 msgr2=0x7fad04003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1f400640 1 --2- 172.21.15.37:0/4241429879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad04003ba0 0x7fad04003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1f400640 1 -- 172.21.15.37:0/4241429879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad04004810 msgr2=0x7fad04004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:15.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1f400640 1 --2- 172.21.15.37:0/4241429879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad04004810 0x7fad04004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1f400640 1 -- 172.21.15.37:0/4241429879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad04003530 con 0x7fad040051d0 2024-05-30T06:48:15.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.907+0000 7fad1ea00640 1 --2- 172.21.15.37:0/4241429879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad04003ba0 0x7fad04003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:15.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.911+0000 7fad1f400640 1 -- 172.21.15.37:0/4241429879 reap_dead start 2024-05-30T06:48:15.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.911+0000 7fad1f400640 1 --2- 172.21.15.37:0/4241429879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad040051d0 0x7fad0400b9d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fad1800a6b0 tx=0x7fad1801f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39af5492e4f669f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:15.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.911+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad100096b0 con 0x7fad040051d0 2024-05-30T06:48:15.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.911+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad18007130 con 0x7fad040051d0 2024-05-30T06:48:15.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.911+0000 7fad1d600640 1 -- 172.21.15.37:0/4241429879 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1800a2d0 con 0x7fad040051d0 2024-05-30T06:48:15.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.911+0000 7fad25a00640 1 -- 172.21.15.37:0/4241429879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad040051d0 msgr2=0x7fad0400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.911+0000 7fad25a00640 1 --2- 172.21.15.37:0/4241429879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad040051d0 0x7fad0400b9d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fad1800a6b0 tx=0x7fad1801f920 comp rx=0 tx=0).stop 2024-05-30T06:48:15.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.911+0000 7fad25a00640 1 -- 172.21.15.37:0/4241429879 shutdown_connections 2024-05-30T06:48:15.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.911+0000 7fad25a00640 1 --2- 172.21.15.37:0/4241429879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad040051d0 0x7fad0400b9d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.911+0000 7fad25a00640 1 -- 172.21.15.37:0/4241429879 >> 172.21.15.37:0/4241429879 conn(0x7fad2006bf60 msgr2=0x7fad200b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:15.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.911+0000 7fad25a00640 1 -- 172.21.15.37:0/4241429879 shutdown_connections 2024-05-30T06:48:15.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.911+0000 7fad25a00640 1 -- 172.21.15.37:0/4241429879 wait complete. 2024-05-30T06:48:15.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad25a00640 1 Processor -- start 2024-05-30T06:48:15.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad25a00640 1 -- start start 2024-05-30T06:48:15.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad25a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad040051d0 0x7fad2014af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad25a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad201f43a0 0x7fad201f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad25a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200accf0 0x7fad200ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad25a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad2006e7d0 con 0x7fad200accf0 2024-05-30T06:48:15.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad25a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad2006ec60 con 0x7fad040051d0 2024-05-30T06:48:15.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad25a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad2006ede0 con 0x7fad201f43a0 2024-05-30T06:48:15.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad1f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200accf0 0x7fad200ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad1f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200accf0 0x7fad200ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52074/0 (socket says 172.21.15.37:52074) 2024-05-30T06:48:15.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad1f400640 1 -- 172.21.15.37:0/4247244320 learned_addr learned my addr 172.21.15.37:0/4247244320 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:15.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad1e000640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad201f43a0 0x7fad201f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad1ea00640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad040051d0 0x7fad2014af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad1f400640 1 -- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad201f43a0 msgr2=0x7fad201f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad1f400640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad201f43a0 0x7fad201f4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad1f400640 1 -- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad040051d0 msgr2=0x7fad2014af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:15.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad1f400640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad040051d0 0x7fad2014af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:15.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad1f400640 1 -- 172.21.15.37:0/4247244320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad200aa450 con 0x7fad200accf0 2024-05-30T06:48:15.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad1f400640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200accf0 0x7fad200ad1a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fad180af040 tx=0x7fad04005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:15.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad16a00640 1 -- 172.21.15.37:0/4247244320 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1800a2d0 con 0x7fad200accf0 2024-05-30T06:48:15.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad16a00640 1 -- 172.21.15.37:0/4247244320 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad180bc070 con 0x7fad200accf0 2024-05-30T06:48:15.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.915+0000 7fad16a00640 1 -- 172.21.15.37:0/4247244320 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad180074e0 con 0x7fad200accf0 2024-05-30T06:48:15.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.919+0000 7fad25a00640 1 -- 172.21.15.37:0/4247244320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad200aa730 con 0x7fad200accf0 2024-05-30T06:48:15.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.919+0000 7fad25a00640 1 -- 172.21.15.37:0/4247244320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad200aacf0 con 0x7fad200accf0 2024-05-30T06:48:15.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.919+0000 7fad25a00640 1 -- 172.21.15.37:0/4247244320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad20068d40 con 0x7fad200accf0 2024-05-30T06:48:15.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.919+0000 7fad16a00640 1 -- 172.21.15.37:0/4247244320 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fad180b5040 con 0x7fad200accf0 2024-05-30T06:48:15.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.919+0000 7fad16a00640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad00068c20 0x7fad0006b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:15.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.919+0000 7fad16a00640 1 -- 172.21.15.37:0/4247244320 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fad18122b30 con 0x7fad200accf0 2024-05-30T06:48:15.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.919+0000 7fad1ea00640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad00068c20 0x7fad0006b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:15.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.923+0000 7fad1ea00640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad00068c20 0x7fad0006b0e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fad10009b60 tx=0x7fad10009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:15.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:15.923+0000 7fad16a00640 1 -- 172.21.15.37:0/4247244320 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fad18019630 con 0x7fad200accf0 2024-05-30T06:48:16.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.115+0000 7fad25a00640 1 -- 172.21.15.37:0/4247244320 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone71653", "target": ["mon-mgr", ""]}) -- 0x7fad20156f80 con 0x7fad00068c20 2024-05-30T06:48:16.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.135+0000 7fad16a00640 1 -- 172.21.15.37:0/4247244320 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fad20156f80 con 0x7fad00068c20 2024-05-30T06:48:16.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.139+0000 7fad25a00640 1 -- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad00068c20 msgr2=0x7fad0006b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:16.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.139+0000 7fad25a00640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad00068c20 0x7fad0006b0e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fad10009b60 tx=0x7fad10009190 comp rx=0 tx=0).stop 2024-05-30T06:48:16.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.139+0000 7fad25a00640 1 -- 172.21.15.37:0/4247244320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200accf0 msgr2=0x7fad200ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:16.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.139+0000 7fad25a00640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200accf0 0x7fad200ad1a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fad180af040 tx=0x7fad04005840 comp rx=0 tx=0).stop 2024-05-30T06:48:16.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.139+0000 7fad25a00640 1 -- 172.21.15.37:0/4247244320 shutdown_connections 2024-05-30T06:48:16.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.139+0000 7fad25a00640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200accf0 0x7fad200ad1a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:16.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.139+0000 7fad25a00640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad201f43a0 0x7fad201f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:16.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.139+0000 7fad25a00640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad00068c20 0x7fad0006b0e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:16.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.139+0000 7fad25a00640 1 --2- 172.21.15.37:0/4247244320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad040051d0 0x7fad2014af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:16.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.139+0000 7fad25a00640 1 -- 172.21.15.37:0/4247244320 >> 172.21.15.37:0/4247244320 conn(0x7fad2006bf60 msgr2=0x7fad2015b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:16.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.139+0000 7fad25a00640 1 -- 172.21.15.37:0/4247244320 shutdown_connections 2024-05-30T06:48:16.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.139+0000 7fad25a00640 1 -- 172.21.15.37:0/4247244320 wait complete. 2024-05-30T06:48:16.157 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T06:48:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:48:16.212 INFO:teuthology.orchestra.run.smithi037.stdout:2 2024-05-30T06:48:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:48:16.219 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:48:16.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:48:16.287 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:48:16.389 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:48:16.390 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:48:16.390 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:48:16.390 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:48:16.399 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:48:16.399 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:48:16.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:48:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.635+0000 7fe32ce00640 1 Processor -- start 2024-05-30T06:48:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.635+0000 7fe32ce00640 1 -- start start 2024-05-30T06:48:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe32ce00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3280c8fc0 0x7fe3280d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe32ce00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3280c7f20 con 0x7fe32809aa60 2024-05-30T06:48:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe32ce00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3280c8200 con 0x7fe32815ed50 2024-05-30T06:48:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe32ce00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe32815f130 con 0x7fe3280c8fc0 2024-05-30T06:48:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe326800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe32809aa60 0x7fe32809aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35658/0 (socket says 172.21.15.37:35658) 2024-05-30T06:48:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe326800640 1 -- 172.21.15.37:0/3853974027 learned_addr learned my addr 172.21.15.37:0/3853974027 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:16.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe31d400640 1 --2- 172.21.15.37:0/3853974027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3280c8fc0 0x7fe3280d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe325400640 1 -- 172.21.15.37:0/3853974027 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3741921217 0 0) 0x7fe3280c7f20 con 0x7fe32809aa60 2024-05-30T06:48:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe325400640 1 -- 172.21.15.37:0/3853974027 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe30c003530 con 0x7fe32809aa60 2024-05-30T06:48:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe325400640 1 -- 172.21.15.37:0/3853974027 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2314461923 0 0) 0x7fe3280c8200 con 0x7fe32815ed50 2024-05-30T06:48:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe325400640 1 -- 172.21.15.37:0/3853974027 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3280c7f20 con 0x7fe32815ed50 2024-05-30T06:48:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe31d400640 1 -- 172.21.15.37:0/3853974027 >> v1:172.21.15.105:6789/0 conn(0x7fe32815ed50 legacy=0x7fe3280d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe31d400640 1 -- 172.21.15.37:0/3853974027 >> v1:172.21.15.37:6789/0 conn(0x7fe32809aa60 legacy=0x7fe32809aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.639+0000 7fe31d400640 1 -- 172.21.15.37:0/3853974027 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3280c84e0 con 0x7fe3280c8fc0 2024-05-30T06:48:16.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.643+0000 7fe31d400640 1 --2- 172.21.15.37:0/3853974027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3280c8fc0 0x7fe3280d09c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe310009dc0 tx=0x7fe31001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22cc7abbb1ea13b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:16.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.643+0000 7fe325400640 1 -- 172.21.15.37:0/3853974027 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100b2070 con 0x7fe3280c8fc0 2024-05-30T06:48:16.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.643+0000 7fe325400640 1 -- 172.21.15.37:0/3853974027 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3100a5940 con 0x7fe3280c8fc0 2024-05-30T06:48:16.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.643+0000 7fe325400640 1 -- 172.21.15.37:0/3853974027 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100a5d10 con 0x7fe3280c8fc0 2024-05-30T06:48:16.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.643+0000 7fe32ce00640 1 -- 172.21.15.37:0/3853974027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3280c8fc0 msgr2=0x7fe3280d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:16.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.643+0000 7fe32ce00640 1 --2- 172.21.15.37:0/3853974027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3280c8fc0 0x7fe3280d09c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe310009dc0 tx=0x7fe31001c990 comp rx=0 tx=0).stop 2024-05-30T06:48:16.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.643+0000 7fe32ce00640 1 -- 172.21.15.37:0/3853974027 shutdown_connections 2024-05-30T06:48:16.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.643+0000 7fe32ce00640 1 --2- 172.21.15.37:0/3853974027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3280c8fc0 0x7fe3280d09c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:16.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.643+0000 7fe32ce00640 1 -- 172.21.15.37:0/3853974027 >> 172.21.15.37:0/3853974027 conn(0x7fe3280d26e0 msgr2=0x7fe3280d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:16.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.643+0000 7fe32ce00640 1 -- 172.21.15.37:0/3853974027 shutdown_connections 2024-05-30T06:48:16.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.643+0000 7fe32ce00640 1 -- 172.21.15.37:0/3853974027 wait complete. 2024-05-30T06:48:16.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.643+0000 7fe32ce00640 1 Processor -- start 2024-05-30T06:48:16.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe32ce00640 1 -- start start 2024-05-30T06:48:16.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe32ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32809aa60 0x7fe32814f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:16.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe32ce00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3280c8fc0 0x7fe32815fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:16.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe32ce00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32815ed50 0x7fe328153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:16.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe32ce00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3280c7c50 con 0x7fe32809aa60 2024-05-30T06:48:16.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe32ce00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe3280c7ad0 con 0x7fe3280c8fc0 2024-05-30T06:48:16.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe32ce00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe32816cb30 con 0x7fe32815ed50 2024-05-30T06:48:16.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe31d400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3280c8fc0 0x7fe32815fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:16.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe31d400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3280c8fc0 0x7fe32815fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59078/0 (socket says 172.21.15.37:59078) 2024-05-30T06:48:16.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe31d400640 1 -- 172.21.15.37:0/720181881 learned_addr learned my addr 172.21.15.37:0/720181881 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe325e00640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32809aa60 0x7fe32814f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe31d400640 1 -- 172.21.15.37:0/720181881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32815ed50 msgr2=0x7fe328153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe31d400640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32815ed50 0x7fe328153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe31d400640 1 -- 172.21.15.37:0/720181881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32809aa60 msgr2=0x7fe32814f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe31d400640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32809aa60 0x7fe32814f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe31d400640 1 -- 172.21.15.37:0/720181881 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe328160980 con 0x7fe3280c8fc0 2024-05-30T06:48:16.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.647+0000 7fe325e00640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32809aa60 0x7fe32814f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:16.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.651+0000 7fe31d400640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3280c8fc0 0x7fe32815fee0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe31001a5c0 tx=0x7fe310019730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:16.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.651+0000 7fe31ea00640 1 -- 172.21.15.37:0/720181881 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100b2040 con 0x7fe3280c8fc0 2024-05-30T06:48:16.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.651+0000 7fe31ea00640 1 -- 172.21.15.37:0/720181881 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3100bf070 con 0x7fe3280c8fc0 2024-05-30T06:48:16.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.651+0000 7fe32ce00640 1 -- 172.21.15.37:0/720181881 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe328160c60 con 0x7fe3280c8fc0 2024-05-30T06:48:16.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.651+0000 7fe31ea00640 1 -- 172.21.15.37:0/720181881 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100b8690 con 0x7fe3280c8fc0 2024-05-30T06:48:16.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.651+0000 7fe32ce00640 1 -- 172.21.15.37:0/720181881 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe328161220 con 0x7fe3280c8fc0 2024-05-30T06:48:16.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.651+0000 7fe32ce00640 1 -- 172.21.15.37:0/720181881 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe328068b20 con 0x7fe3280c8fc0 2024-05-30T06:48:16.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.655+0000 7fe31ea00640 1 -- 172.21.15.37:0/720181881 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fe3100b8830 con 0x7fe3280c8fc0 2024-05-30T06:48:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.655+0000 7fe31ea00640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe304068c40 0x7fe30406b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.655+0000 7fe31ea00640 1 -- 172.21.15.37:0/720181881 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5767+0+0 (secure 0 0 0) 0x7fe310123220 con 0x7fe3280c8fc0 2024-05-30T06:48:16.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.655+0000 7fe325e00640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe304068c40 0x7fe30406b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.659+0000 7fe325e00640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe304068c40 0x7fe30406b100 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe3180016e0 tx=0x7fe318009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.663+0000 7fe31ea00640 1 -- 172.21.15.37:0/720181881 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe310016580 con 0x7fe3280c8fc0 2024-05-30T06:48:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.979+0000 7fe32ce00640 1 -- 172.21.15.37:0/720181881 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3280d3420 con 0x7fe3280c8fc0 2024-05-30T06:48:16.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.983+0000 7fe31ea00640 1 -- 172.21.15.37:0/720181881 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16800 (secure 0 0 0) 0x7fe3100f2d10 con 0x7fe3280c8fc0 2024-05-30T06:48:16.981 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:16.981 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":49,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:48:16.811163+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:45:44.283575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T06:45:44.856243+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":4}]},{"pgid":"7.1b","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:48:16.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.983+0000 7fe32ce00640 1 -- 172.21.15.37:0/720181881 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe304068c40 msgr2=0x7fe30406b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:16.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.983+0000 7fe32ce00640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe304068c40 0x7fe30406b100 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe3180016e0 tx=0x7fe318009040 comp rx=0 tx=0).stop 2024-05-30T06:48:16.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.983+0000 7fe32ce00640 1 -- 172.21.15.37:0/720181881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3280c8fc0 msgr2=0x7fe32815fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:16.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.983+0000 7fe32ce00640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3280c8fc0 0x7fe32815fee0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe31001a5c0 tx=0x7fe310019730 comp rx=0 tx=0).stop 2024-05-30T06:48:16.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.983+0000 7fe32ce00640 1 -- 172.21.15.37:0/720181881 shutdown_connections 2024-05-30T06:48:16.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.983+0000 7fe32ce00640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32815ed50 0x7fe328153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:16.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.983+0000 7fe32ce00640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe304068c40 0x7fe30406b100 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:16.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.983+0000 7fe32ce00640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3280c8fc0 0x7fe32815fee0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:16.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.983+0000 7fe32ce00640 1 --2- 172.21.15.37:0/720181881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32809aa60 0x7fe32814f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:16.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.983+0000 7fe32ce00640 1 -- 172.21.15.37:0/720181881 >> 172.21.15.37:0/720181881 conn(0x7fe3280d26e0 msgr2=0x7fe328074ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:16.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.983+0000 7fe32ce00640 1 -- 172.21.15.37:0/720181881 shutdown_connections 2024-05-30T06:48:16.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:16.983+0000 7fe32ce00640 1 -- 172.21.15.37:0/720181881 wait complete. 2024-05-30T06:48:17.019 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:45:44.283575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:45:44.856243+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 49, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:48:17.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:48:17.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.267+0000 7f2467600640 1 Processor -- start 2024-05-30T06:48:17.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.267+0000 7f2467600640 1 -- start start 2024-05-30T06:48:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.267+0000 7f2467600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f24600c5540 0x7f246006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.267+0000 7f2467600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24600b1510 0x7f24600c5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.267+0000 7f2467600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24601633c0 con 0x7f2460166ad0 2024-05-30T06:48:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.267+0000 7f2467600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f246006d330 con 0x7f24600c5540 2024-05-30T06:48:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.267+0000 7f2467600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f24600c5e60 con 0x7f24600b1510 2024-05-30T06:48:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.267+0000 7f245fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24600b1510 0x7f24600c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.267+0000 7f2465600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2460166ad0 0x7f2460166f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35662/0 (socket says 172.21.15.37:35662) 2024-05-30T06:48:17.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.267+0000 7f2465600640 1 -- 172.21.15.37:0/1096632399 learned_addr learned my addr 172.21.15.37:0/1096632399 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:17.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3237347788 0 0) 0x7f24601633c0 con 0x7f2460166ad0 2024-05-30T06:48:17.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2448003530 con 0x7f2460166ad0 2024-05-30T06:48:17.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f2464c00640 1 --2- 172.21.15.37:0/1096632399 >> v2:172.21.15.105:3300/0 conn(0x7f24600c5540 0x7f246006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:17.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1635446896 0 0) 0x7f2448003530 con 0x7f2460166ad0 2024-05-30T06:48:17.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24600b1510 msgr2=0x7f24600c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:17.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 --2- 172.21.15.37:0/1096632399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24600b1510 0x7f24600c5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:17.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 >> v2:172.21.15.105:3300/0 conn(0x7f24600c5540 msgr2=0x7f246006ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:17.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 --2- 172.21.15.37:0/1096632399 >> v2:172.21.15.105:3300/0 conn(0x7f24600c5540 0x7f246006ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:17.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246006d050 con 0x7f2460166ad0 2024-05-30T06:48:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f24580019e0 con 0x7f2460166ad0 2024-05-30T06:48:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 >> v1:172.21.15.37:6789/0 conn(0x7f2460166ad0 legacy=0x7f2460166f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 --2- 172.21.15.37:0/1096632399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24480039e0 0x7f2448003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 --2- 172.21.15.37:0/1096632399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2448004810 0x7f2448004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 --2- 172.21.15.37:0/1096632399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24600b1510 0x7f24480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f246006d330 con 0x7f24480039e0 2024-05-30T06:48:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f24600c5e60 con 0x7f2448004810 2024-05-30T06:48:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f244800b9d0 con 0x7f24600b1510 2024-05-30T06:48:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245fe00640 1 --2- 172.21.15.37:0/1096632399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2448004810 0x7f2448004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:17.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245fe00640 1 -- 172.21.15.37:0/1096632399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24600b1510 msgr2=0x7f24480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:17.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245fe00640 1 --2- 172.21.15.37:0/1096632399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24600b1510 0x7f24480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:17.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245fe00640 1 -- 172.21.15.37:0/1096632399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24480039e0 msgr2=0x7f2448003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:17.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245fe00640 1 --2- 172.21.15.37:0/1096632399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24480039e0 0x7f2448003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:17.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.271+0000 7f245fe00640 1 -- 172.21.15.37:0/1096632399 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246006d050 con 0x7f2448004810 2024-05-30T06:48:17.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.275+0000 7f245fe00640 1 --2- 172.21.15.37:0/1096632399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2448004810 0x7f2448004c90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f244c009ae0 tx=0x7f244c01cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3576629c08af0f3b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:17.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.279+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c0096b0 con 0x7f2448004810 2024-05-30T06:48:17.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.279+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f244c0a8410 con 0x7f2448004810 2024-05-30T06:48:17.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.279+0000 7f245f400640 1 -- 172.21.15.37:0/1096632399 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c0a8800 con 0x7f2448004810 2024-05-30T06:48:17.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.279+0000 7f2467600640 1 -- 172.21.15.37:0/1096632399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2448004810 msgr2=0x7f2448004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:17.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.279+0000 7f2467600640 1 --2- 172.21.15.37:0/1096632399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2448004810 0x7f2448004c90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f244c009ae0 tx=0x7f244c01cab0 comp rx=0 tx=0).stop 2024-05-30T06:48:17.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.279+0000 7f2465600640 1 -- 172.21.15.37:0/1096632399 reap_dead start 2024-05-30T06:48:17.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.279+0000 7f2467600640 1 -- 172.21.15.37:0/1096632399 shutdown_connections 2024-05-30T06:48:17.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.279+0000 7f2467600640 1 -- 172.21.15.37:0/1096632399 >> 172.21.15.37:0/1096632399 conn(0x7f24600b4060 msgr2=0x7f24600b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:17.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.279+0000 7f2467600640 1 -- 172.21.15.37:0/1096632399 shutdown_connections 2024-05-30T06:48:17.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.279+0000 7f2467600640 1 -- 172.21.15.37:0/1096632399 wait complete. 2024-05-30T06:48:17.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2467600640 1 Processor -- start 2024-05-30T06:48:17.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2467600640 1 -- start start 2024-05-30T06:48:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2467600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24600ced80 0x7f24600d1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2467600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24600cf160 0x7f24600b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2467600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2460160300 0x7f246015beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2467600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f24600d1e60 con 0x7f24600ced80 2024-05-30T06:48:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2467600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f24600b18f0 con 0x7f24600cf160 2024-05-30T06:48:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2467600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f24600d1fe0 con 0x7f2460160300 2024-05-30T06:48:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2464c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24600ced80 0x7f24600d1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:17.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2464c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24600ced80 0x7f24600d1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52098/0 (socket says 172.21.15.37:52098) 2024-05-30T06:48:17.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2464c00640 1 -- 172.21.15.37:0/3526759360 learned_addr learned my addr 172.21.15.37:0/3526759360 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:17.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f245fe00640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24600cf160 0x7f24600b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:17.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2464c00640 1 -- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2460160300 msgr2=0x7f246015beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:17.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2464c00640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2460160300 0x7f246015beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:17.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2464c00640 1 -- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24600cf160 msgr2=0x7f24600b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:17.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2464c00640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24600cf160 0x7f24600b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:17.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f2464c00640 1 -- 172.21.15.37:0/3526759360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2460161190 con 0x7f24600ced80 2024-05-30T06:48:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.283+0000 7f245fe00640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24600cf160 0x7f24600b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.287+0000 7f2464c00640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24600ced80 0x7f24600d1610 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f245400e960 tx=0x7f245400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.287+0000 7f245cc00640 1 -- 172.21.15.37:0/3526759360 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454017070 con 0x7f24600ced80 2024-05-30T06:48:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.287+0000 7f245cc00640 1 -- 172.21.15.37:0/3526759360 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f245400c980 con 0x7f24600ced80 2024-05-30T06:48:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.287+0000 7f245cc00640 1 -- 172.21.15.37:0/3526759360 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245400cd50 con 0x7f24600ced80 2024-05-30T06:48:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.287+0000 7f2467600640 1 -- 172.21.15.37:0/3526759360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2460161470 con 0x7f24600ced80 2024-05-30T06:48:17.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.287+0000 7f2467600640 1 -- 172.21.15.37:0/3526759360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f246015de80 con 0x7f24600ced80 2024-05-30T06:48:17.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.287+0000 7f2467600640 1 -- 172.21.15.37:0/3526759360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2460068bc0 con 0x7f24600ced80 2024-05-30T06:48:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.291+0000 7f245cc00640 1 -- 172.21.15.37:0/3526759360 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f245401a070 con 0x7f24600ced80 2024-05-30T06:48:17.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.295+0000 7f245cc00640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2440068bf0 0x7f244006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.295+0000 7f245cc00640 1 -- 172.21.15.37:0/3526759360 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7f2454087ef0 con 0x7f24600ced80 2024-05-30T06:48:17.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.295+0000 7f245fe00640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2440068bf0 0x7f244006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:17.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.295+0000 7f245fe00640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2440068bf0 0x7f244006b0b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f244c0af000 tx=0x7f244c0b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:17.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.295+0000 7f245cc00640 1 -- 172.21.15.37:0/3526759360 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2454057360 con 0x7f24600ced80 2024-05-30T06:48:17.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.659+0000 7f2467600640 1 -- 172.21.15.37:0/3526759360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2460161970 con 0x7f24600ced80 2024-05-30T06:48:17.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.659+0000 7f245cc00640 1 -- 172.21.15.37:0/3526759360 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) ==== 93+0+10 (secure 0 0 0) 0x7f245405b660 con 0x7f24600ced80 2024-05-30T06:48:17.660 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:48:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.663+0000 7f2467600640 1 -- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2440068bf0 msgr2=0x7f244006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.663+0000 7f2467600640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2440068bf0 0x7f244006b0b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f244c0af000 tx=0x7f244c0b3040 comp rx=0 tx=0).stop 2024-05-30T06:48:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.663+0000 7f2467600640 1 -- 172.21.15.37:0/3526759360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24600ced80 msgr2=0x7f24600d1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.663+0000 7f2467600640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24600ced80 0x7f24600d1610 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f245400e960 tx=0x7f245400ee20 comp rx=0 tx=0).stop 2024-05-30T06:48:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.663+0000 7f2467600640 1 -- 172.21.15.37:0/3526759360 shutdown_connections 2024-05-30T06:48:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.663+0000 7f2467600640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2460160300 0x7f246015beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.663+0000 7f2467600640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2440068bf0 0x7f244006b0b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.663+0000 7f2467600640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24600cf160 0x7f24600b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.663+0000 7f2467600640 1 --2- 172.21.15.37:0/3526759360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24600ced80 0x7f24600d1610 secure :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f245400e960 tx=0x7f245400ee20 comp rx=0 tx=0).stop 2024-05-30T06:48:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.663+0000 7f2467600640 1 -- 172.21.15.37:0/3526759360 >> 172.21.15.37:0/3526759360 conn(0x7f24600b4060 msgr2=0x7f2460070270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.667+0000 7f2467600640 1 -- 172.21.15.37:0/3526759360 shutdown_connections 2024-05-30T06:48:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.667+0000 7f2467600640 1 -- 172.21.15.37:0/3526759360 wait complete. 2024-05-30T06:48:17.700 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:48:17.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.943+0000 7f59af200640 1 Processor -- start 2024-05-30T06:48:17.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.943+0000 7f59af200640 1 -- start start 2024-05-30T06:48:17.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.943+0000 7f59af200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a809b170 0x7f59a80af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.943+0000 7f59af200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a809bb80 con 0x7f59a815c870 2024-05-30T06:48:17.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.943+0000 7f59af200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a80cd340 con 0x7f59a80d03c0 2024-05-30T06:48:17.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.943+0000 7f59af200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f59a80cd110 con 0x7f59a809b170 2024-05-30T06:48:17.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.943+0000 7f59a7400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f59a80d03c0 0x7f59a809aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:34592/0 (socket says 172.21.15.37:34592) 2024-05-30T06:48:17.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.943+0000 7f59a7400640 1 -- 172.21.15.37:0/3357014481 learned_addr learned my addr 172.21.15.37:0/3357014481 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:17.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.943+0000 7f59ad200640 1 --2- 172.21.15.37:0/3357014481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a809b170 0x7f59a80af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:17.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.943+0000 7f59a6a00640 1 -- 172.21.15.37:0/3357014481 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883815794 0 0) 0x7f59a80cd340 con 0x7f59a80d03c0 2024-05-30T06:48:17.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.943+0000 7f59a6a00640 1 -- 172.21.15.37:0/3357014481 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f598c003530 con 0x7f59a80d03c0 2024-05-30T06:48:17.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.943+0000 7f59ad200640 1 -- 172.21.15.37:0/3357014481 >> v1:172.21.15.105:6789/0 conn(0x7f59a80d03c0 legacy=0x7f59a809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:17.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.947+0000 7f59ad200640 1 -- 172.21.15.37:0/3357014481 >> v1:172.21.15.37:6789/0 conn(0x7f59a815c870 legacy=0x7f59a80cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:17.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.947+0000 7f59ad200640 1 -- 172.21.15.37:0/3357014481 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a80cd620 con 0x7f59a809b170 2024-05-30T06:48:17.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.947+0000 7f59ad200640 1 --2- 172.21.15.37:0/3357014481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a809b170 0x7f59a80af1e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009dc0 tx=0x7f59a001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bde13f59a68a2dfa server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.951+0000 7f59a6a00640 1 -- 172.21.15.37:0/3357014481 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a00b2070 con 0x7f59a809b170 2024-05-30T06:48:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.951+0000 7f59a6a00640 1 -- 172.21.15.37:0/3357014481 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a00a5610 con 0x7f59a809b170 2024-05-30T06:48:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.951+0000 7f59a6a00640 1 -- 172.21.15.37:0/3357014481 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a00a59e0 con 0x7f59a809b170 2024-05-30T06:48:17.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.951+0000 7f59af200640 1 -- 172.21.15.37:0/3357014481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a809b170 msgr2=0x7f59a80af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:17.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.951+0000 7f59af200640 1 --2- 172.21.15.37:0/3357014481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a809b170 0x7f59a80af1e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009dc0 tx=0x7f59a001c950 comp rx=0 tx=0).stop 2024-05-30T06:48:17.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.951+0000 7f59af200640 1 -- 172.21.15.37:0/3357014481 shutdown_connections 2024-05-30T06:48:17.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.951+0000 7f59af200640 1 --2- 172.21.15.37:0/3357014481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a809b170 0x7f59a80af1e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:17.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.951+0000 7f59af200640 1 -- 172.21.15.37:0/3357014481 >> 172.21.15.37:0/3357014481 conn(0x7f59a80b4060 msgr2=0x7f59a80b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:17.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.951+0000 7f59af200640 1 -- 172.21.15.37:0/3357014481 shutdown_connections 2024-05-30T06:48:17.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.951+0000 7f59af200640 1 -- 172.21.15.37:0/3357014481 wait complete. 2024-05-30T06:48:17.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.951+0000 7f59af200640 1 Processor -- start 2024-05-30T06:48:17.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.951+0000 7f59af200640 1 -- start start 2024-05-30T06:48:17.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59af200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a809b170 0x7f59a80b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59af200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a80d03c0 0x7f59a80b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59af200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59a815c870 0x7f59a80cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59af200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59a80cd990 con 0x7f59a809b170 2024-05-30T06:48:17.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59af200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f59a809be60 con 0x7f59a815c870 2024-05-30T06:48:17.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59af200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f59a80ce530 con 0x7f59a80d03c0 2024-05-30T06:48:17.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59a7400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a80d03c0 0x7f59a80b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:17.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59a7400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a80d03c0 0x7f59a80b7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:37704/0 (socket says 172.21.15.37:37704) 2024-05-30T06:48:17.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59a7400640 1 -- 172.21.15.37:0/3188056898 learned_addr learned my addr 172.21.15.37:0/3188056898 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:17.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59a7e00640 1 --2- 172.21.15.37:0/3188056898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a809b170 0x7f59a80b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59a7e00640 1 -- 172.21.15.37:0/3188056898 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a80d03c0 msgr2=0x7f59a80b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59a7e00640 1 --2- 172.21.15.37:0/3188056898 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a80d03c0 0x7f59a80b7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59a7e00640 1 -- 172.21.15.37:0/3188056898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59a815c870 msgr2=0x7f59a80cba00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:48:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59a7e00640 1 --2- 172.21.15.37:0/3188056898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59a815c870 0x7f59a80cba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59a7e00640 1 -- 172.21.15.37:0/3188056898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a80b7b00 con 0x7f59a809b170 2024-05-30T06:48:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.955+0000 7f59a7e00640 1 --2- 172.21.15.37:0/3188056898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a809b170 0x7f59a80b4f90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f599800c3c0 tx=0x7f599800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:17.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.959+0000 7f599fe00640 1 -- 172.21.15.37:0/3188056898 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59980052d0 con 0x7f59a809b170 2024-05-30T06:48:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.959+0000 7f599fe00640 1 -- 172.21.15.37:0/3188056898 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5998005470 con 0x7f59a809b170 2024-05-30T06:48:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.959+0000 7f599fe00640 1 -- 172.21.15.37:0/3188056898 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5998007240 con 0x7f59a809b170 2024-05-30T06:48:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.959+0000 7f59af200640 1 -- 172.21.15.37:0/3188056898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a80b7de0 con 0x7f59a809b170 2024-05-30T06:48:17.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.959+0000 7f59af200640 1 -- 172.21.15.37:0/3188056898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a8151a70 con 0x7f59a809b170 2024-05-30T06:48:17.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.959+0000 7f59af200640 1 -- 172.21.15.37:0/3188056898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a8151c70 con 0x7f59a809b170 2024-05-30T06:48:17.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.963+0000 7f599fe00640 1 -- 172.21.15.37:0/3188056898 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f59980073e0 con 0x7f59a809b170 2024-05-30T06:48:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.963+0000 7f599fe00640 1 --2- 172.21.15.37:0/3188056898 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5988068c70 0x7f598806b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.963+0000 7f599fe00640 1 -- 172.21.15.37:0/3188056898 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7f59980876e0 con 0x7f59a809b170 2024-05-30T06:48:17.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.963+0000 7f59a7400640 1 --2- 172.21.15.37:0/3188056898 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5988068c70 0x7f598806b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:17.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.963+0000 7f59a7400640 1 --2- 172.21.15.37:0/3188056898 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5988068c70 0x7f598806b130 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f59a81f7450 tx=0x7f5994007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:17.967+0000 7f599fe00640 1 -- 172.21.15.37:0/3188056898 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f59a8151c70 con 0x7f59a809b170 2024-05-30T06:48:18.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.259+0000 7f59af200640 1 -- 172.21.15.37:0/3188056898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f59a81540b0 con 0x7f59a809b170 2024-05-30T06:48:18.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.263+0000 7f599fe00640 1 -- 172.21.15.37:0/3188056898 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) ==== 104+0+11 (secure 0 0 0) 0x7f5998056740 con 0x7f59a809b170 2024-05-30T06:48:18.263 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:48:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.267+0000 7f59af200640 1 -- 172.21.15.37:0/3188056898 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5988068c70 msgr2=0x7f598806b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.267+0000 7f59af200640 1 --2- 172.21.15.37:0/3188056898 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5988068c70 0x7f598806b130 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f59a81f7450 tx=0x7f5994007df0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.267+0000 7f59af200640 1 -- 172.21.15.37:0/3188056898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a809b170 msgr2=0x7f59a80b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.267+0000 7f59af200640 1 --2- 172.21.15.37:0/3188056898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a809b170 0x7f59a80b4f90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f599800c3c0 tx=0x7f599800c880 comp rx=0 tx=0).stop 2024-05-30T06:48:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.267+0000 7f59af200640 1 -- 172.21.15.37:0/3188056898 shutdown_connections 2024-05-30T06:48:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.267+0000 7f59af200640 1 --2- 172.21.15.37:0/3188056898 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5988068c70 0x7f598806b130 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.267+0000 7f59af200640 1 --2- 172.21.15.37:0/3188056898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59a815c870 0x7f59a80cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.267+0000 7f59af200640 1 --2- 172.21.15.37:0/3188056898 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a80d03c0 0x7f59a80b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.267+0000 7f59af200640 1 --2- 172.21.15.37:0/3188056898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a809b170 0x7f59a80b4f90 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.267+0000 7f59af200640 1 -- 172.21.15.37:0/3188056898 >> 172.21.15.37:0/3188056898 conn(0x7f59a80b4060 msgr2=0x7f59a80b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:18.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.267+0000 7f59af200640 1 -- 172.21.15.37:0/3188056898 shutdown_connections 2024-05-30T06:48:18.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.267+0000 7f59af200640 1 -- 172.21.15.37:0/3188056898 wait complete. 2024-05-30T06:48:18.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:48:18.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.539+0000 7f4e10000640 1 Processor -- start 2024-05-30T06:48:18.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.539+0000 7f4e10000640 1 -- start start 2024-05-30T06:48:18.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e10000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e080d1a00 0x7f4e080b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:18.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e10000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4e080b63a0 0x7f4e080b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:18.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e10000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e0806df50 con 0x7f4e0815ed00 2024-05-30T06:48:18.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e10000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4e080d34b0 con 0x7f4e080d1a00 2024-05-30T06:48:18.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e10000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4e08162c00 con 0x7f4e080b63a0 2024-05-30T06:48:18.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e0d600640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f4e0815ed00 0x7f4e080d12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:34604/0 (socket says 172.21.15.37:34604) 2024-05-30T06:48:18.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e0d600640 1 -- 172.21.15.37:0/1030062366 learned_addr learned my addr 172.21.15.37:0/1030062366 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:18.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e0e000640 1 --2- 172.21.15.37:0/1030062366 >> v2:172.21.15.105:3300/0 conn(0x7f4e080b63a0 0x7f4e080b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:18.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e0cc00640 1 --2- 172.21.15.37:0/1030062366 >> v2:172.21.15.37:3300/0 conn(0x7f4e080d1a00 0x7f4e080b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:18.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e07e00640 1 -- 172.21.15.37:0/1030062366 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709391639 0 0) 0x7f4e0806df50 con 0x7f4e0815ed00 2024-05-30T06:48:18.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e07e00640 1 -- 172.21.15.37:0/1030062366 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4df0003530 con 0x7f4e0815ed00 2024-05-30T06:48:18.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e0e000640 1 -- 172.21.15.37:0/1030062366 >> v2:172.21.15.37:3300/0 conn(0x7f4e080d1a00 msgr2=0x7f4e080b7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:18.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e0e000640 1 --2- 172.21.15.37:0/1030062366 >> v2:172.21.15.37:3300/0 conn(0x7f4e080d1a00 0x7f4e080b7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e0e000640 1 -- 172.21.15.37:0/1030062366 >> v1:172.21.15.105:6789/0 conn(0x7f4e0815ed00 legacy=0x7f4e080d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:18.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.543+0000 7f4e0e000640 1 -- 172.21.15.37:0/1030062366 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e080d2ea0 con 0x7f4e080b63a0 2024-05-30T06:48:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.547+0000 7f4e0e000640 1 --2- 172.21.15.37:0/1030062366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e080b63a0 0x7f4e080b6850 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e080ba3c0 tx=0x7f4e0001c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a39e4c62ccdb30fe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:18.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.547+0000 7f4e07e00640 1 -- 172.21.15.37:0/1030062366 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e000b2070 con 0x7f4e080b63a0 2024-05-30T06:48:18.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.547+0000 7f4e07e00640 1 -- 172.21.15.37:0/1030062366 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e000a57f0 con 0x7f4e080b63a0 2024-05-30T06:48:18.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.547+0000 7f4e07e00640 1 -- 172.21.15.37:0/1030062366 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e000a5bc0 con 0x7f4e080b63a0 2024-05-30T06:48:18.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.547+0000 7f4e10000640 1 -- 172.21.15.37:0/1030062366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e080b63a0 msgr2=0x7f4e080b6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:18.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.547+0000 7f4e10000640 1 --2- 172.21.15.37:0/1030062366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e080b63a0 0x7f4e080b6850 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4e080ba3c0 tx=0x7f4e0001c930 comp rx=0 tx=0).stop 2024-05-30T06:48:18.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.551+0000 7f4e10000640 1 -- 172.21.15.37:0/1030062366 shutdown_connections 2024-05-30T06:48:18.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.551+0000 7f4e10000640 1 --2- 172.21.15.37:0/1030062366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e080b63a0 0x7f4e080b6850 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.551+0000 7f4e10000640 1 --2- 172.21.15.37:0/1030062366 >> v2:172.21.15.37:3300/0 conn(0x7f4e080d1a00 0x7f4e080b7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.551+0000 7f4e10000640 1 -- 172.21.15.37:0/1030062366 >> 172.21.15.37:0/1030062366 conn(0x7f4e0806cde0 msgr2=0x7f4e0806d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:18.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.551+0000 7f4e10000640 1 -- 172.21.15.37:0/1030062366 shutdown_connections 2024-05-30T06:48:18.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.551+0000 7f4e10000640 1 -- 172.21.15.37:0/1030062366 wait complete. 2024-05-30T06:48:18.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.551+0000 7f4e10000640 1 Processor -- start 2024-05-30T06:48:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e10000640 1 -- start start 2024-05-30T06:48:18.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e10000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080b63a0 0x7f4e08161c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:18.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e10000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e080d1a00 0x7f4e080cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:18.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e10000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e0815ed00 0x7f4e08155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:18.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e10000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0815f260 con 0x7f4e080b63a0 2024-05-30T06:48:18.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e10000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0815f0e0 con 0x7f4e0815ed00 2024-05-30T06:48:18.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e10000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4e080d4130 con 0x7f4e080d1a00 2024-05-30T06:48:18.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e0e000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e0815ed00 0x7f4e08155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:18.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e0e000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e0815ed00 0x7f4e08155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:42542/0 (socket says 172.21.15.37:42542) 2024-05-30T06:48:18.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e0e000640 1 -- 172.21.15.37:0/3025324091 learned_addr learned my addr 172.21.15.37:0/3025324091 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:18.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e0d600640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080b63a0 0x7f4e08161c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:18.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e0cc00640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e080d1a00 0x7f4e080cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:18.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e0e000640 1 -- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e080d1a00 msgr2=0x7f4e080cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:18.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e0e000640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e080d1a00 0x7f4e080cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e0e000640 1 -- 172.21.15.37:0/3025324091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080b63a0 msgr2=0x7f4e08161c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:18.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e0e000640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080b63a0 0x7f4e08161c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e0e000640 1 -- 172.21.15.37:0/3025324091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e080cbd40 con 0x7f4e0815ed00 2024-05-30T06:48:18.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e0cc00640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e080d1a00 0x7f4e080cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:18.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.555+0000 7f4e0d600640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080b63a0 0x7f4e08161c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:18.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.559+0000 7f4e0e000640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e0815ed00 0x7f4e08155ff0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e00019540 tx=0x7f4e000196d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:18.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.559+0000 7f4e05600640 1 -- 172.21.15.37:0/3025324091 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e000bd020 con 0x7f4e0815ed00 2024-05-30T06:48:18.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.559+0000 7f4e05600640 1 -- 172.21.15.37:0/3025324091 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e000b3040 con 0x7f4e0815ed00 2024-05-30T06:48:18.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.559+0000 7f4e05600640 1 -- 172.21.15.37:0/3025324091 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e000b2070 con 0x7f4e0815ed00 2024-05-30T06:48:18.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.559+0000 7f4e10000640 1 -- 172.21.15.37:0/3025324091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e080cc020 con 0x7f4e0815ed00 2024-05-30T06:48:18.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.559+0000 7f4e10000640 1 -- 172.21.15.37:0/3025324091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e080cc5e0 con 0x7f4e0815ed00 2024-05-30T06:48:18.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.559+0000 7f4e10000640 1 -- 172.21.15.37:0/3025324091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e08068bc0 con 0x7f4e0815ed00 2024-05-30T06:48:18.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.559+0000 7f4e05600640 1 -- 172.21.15.37:0/3025324091 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f4e000c0020 con 0x7f4e0815ed00 2024-05-30T06:48:18.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.563+0000 7f4e05600640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4de8068bf0 0x7f4de806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:18.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.563+0000 7f4e05600640 1 -- 172.21.15.37:0/3025324091 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7f4e00122160 con 0x7f4e0815ed00 2024-05-30T06:48:18.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.563+0000 7f4e0d600640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4de8068bf0 0x7f4de806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:18.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.563+0000 7f4e0d600640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4de8068bf0 0x7f4de806b0b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc005890 tx=0x7f4dfc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:18.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.567+0000 7f4e05600640 1 -- 172.21.15.37:0/3025324091 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4e00016520 con 0x7f4e0815ed00 2024-05-30T06:48:18.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.871+0000 7f4e10000640 1 -- 172.21.15.37:0/3025324091 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4e08157360 con 0x7f4e0815ed00 2024-05-30T06:48:18.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.871+0000 7f4e05600640 1 -- 172.21.15.37:0/3025324091 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) ==== 100+0+11 (secure 0 0 0) 0x7f4e000f1700 con 0x7f4e0815ed00 2024-05-30T06:48:18.870 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:48:18.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.875+0000 7f4e10000640 1 -- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4de8068bf0 msgr2=0x7f4de806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:18.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.875+0000 7f4e10000640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4de8068bf0 0x7f4de806b0b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc005890 tx=0x7f4dfc009040 comp rx=0 tx=0).stop 2024-05-30T06:48:18.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.875+0000 7f4e10000640 1 -- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e0815ed00 msgr2=0x7f4e08155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:18.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.875+0000 7f4e10000640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e0815ed00 0x7f4e08155ff0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e00019540 tx=0x7f4e000196d0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.875+0000 7f4e10000640 1 -- 172.21.15.37:0/3025324091 shutdown_connections 2024-05-30T06:48:18.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.875+0000 7f4e10000640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4de8068bf0 0x7f4de806b0b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.875+0000 7f4e10000640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e0815ed00 0x7f4e08155ff0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.875+0000 7f4e10000640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e080d1a00 0x7f4e080cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.875+0000 7f4e10000640 1 --2- 172.21.15.37:0/3025324091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080b63a0 0x7f4e08161c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:18.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.875+0000 7f4e10000640 1 -- 172.21.15.37:0/3025324091 >> 172.21.15.37:0/3025324091 conn(0x7f4e0806cde0 msgr2=0x7f4e08074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:18.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.875+0000 7f4e10000640 1 -- 172.21.15.37:0/3025324091 shutdown_connections 2024-05-30T06:48:18.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:18.875+0000 7f4e10000640 1 -- 172.21.15.37:0/3025324091 wait complete. 2024-05-30T06:48:18.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T06:48:19.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.035+0000 7f7d8f200640 1 Processor -- start 2024-05-30T06:48:19.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.035+0000 7f7d8f200640 1 -- start start 2024-05-30T06:48:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.035+0000 7f7d8f200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d88148520 0x7f7d8815fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.035+0000 7f7d8f200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7d880b5b00 0x7f7d880b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.035+0000 7f7d8f200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d880af5d0 con 0x7f7d880aeda0 2024-05-30T06:48:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.035+0000 7f7d8f200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7d880af8b0 con 0x7f7d880b5b00 2024-05-30T06:48:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.035+0000 7f7d8f200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7d880afb90 con 0x7f7d88148520 2024-05-30T06:48:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.039+0000 7f7d87e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d88148520 0x7f7d8815fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.039+0000 7f7d87e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d88148520 0x7f7d8815fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:37724/0 (socket says 172.21.15.37:37724) 2024-05-30T06:48:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.039+0000 7f7d87e00640 1 -- 172.21.15.37:0/2165514216 learned_addr learned my addr 172.21.15.37:0/2165514216 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.039+0000 7f7d7fe00640 1 --1- 172.21.15.37:0/2165514216 >> v1:172.21.15.105:6789/0 conn(0x7f7d880aeda0 0x7f7d880b53f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:34608/0 (socket says 172.21.15.37:34608) 2024-05-30T06:48:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.039+0000 7f7d8d200640 1 --2- 172.21.15.37:0/2165514216 >> v2:172.21.15.105:3300/0 conn(0x7f7d880b5b00 0x7f7d880b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.039+0000 7f7d87e00640 1 -- 172.21.15.37:0/2165514216 >> v2:172.21.15.105:3300/0 conn(0x7f7d880b5b00 msgr2=0x7f7d880b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.039+0000 7f7d87e00640 1 --2- 172.21.15.37:0/2165514216 >> v2:172.21.15.105:3300/0 conn(0x7f7d880b5b00 0x7f7d880b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.039+0000 7f7d87e00640 1 -- 172.21.15.37:0/2165514216 >> v1:172.21.15.105:6789/0 conn(0x7f7d880aeda0 legacy=0x7f7d880b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.039+0000 7f7d87e00640 1 -- 172.21.15.37:0/2165514216 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d880afe70 con 0x7f7d88148520 2024-05-30T06:48:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.039+0000 7f7d87400640 1 -- 172.21.15.37:0/2165514216 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3815186903 0 0) 0x7f7d880af5d0 con 0x7f7d880aeda0 2024-05-30T06:48:19.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.039+0000 7f7d87e00640 1 --2- 172.21.15.37:0/2165514216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d88148520 0x7f7d8815fa30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009870 tx=0x7f7d7801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c9df364b935799d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:19.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d87400640 1 -- 172.21.15.37:0/2165514216 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d780a9610 con 0x7f7d88148520 2024-05-30T06:48:19.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d87400640 1 -- 172.21.15.37:0/2165514216 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d780a97b0 con 0x7f7d88148520 2024-05-30T06:48:19.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d87400640 1 -- 172.21.15.37:0/2165514216 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d780a9b80 con 0x7f7d88148520 2024-05-30T06:48:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 -- 172.21.15.37:0/2165514216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d88148520 msgr2=0x7f7d8815fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 --2- 172.21.15.37:0/2165514216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d88148520 0x7f7d8815fa30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009870 tx=0x7f7d7801c530 comp rx=0 tx=0).stop 2024-05-30T06:48:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 -- 172.21.15.37:0/2165514216 shutdown_connections 2024-05-30T06:48:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 --2- 172.21.15.37:0/2165514216 >> v2:172.21.15.105:3300/0 conn(0x7f7d880b5b00 0x7f7d880b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 --2- 172.21.15.37:0/2165514216 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d88148520 0x7f7d8815fa30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 -- 172.21.15.37:0/2165514216 >> 172.21.15.37:0/2165514216 conn(0x7f7d8806b960 msgr2=0x7f7d8806bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 -- 172.21.15.37:0/2165514216 shutdown_connections 2024-05-30T06:48:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 -- 172.21.15.37:0/2165514216 wait complete. 2024-05-30T06:48:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 Processor -- start 2024-05-30T06:48:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 -- start start 2024-05-30T06:48:19.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d880aeda0 0x7f7d8813ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d880b5b00 0x7f7d881588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d88148520 0x7f7d8813d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7d880b4b40 con 0x7f7d88148520 2024-05-30T06:48:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d880b49c0 con 0x7f7d880b5b00 2024-05-30T06:48:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8f200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7d880b4cc0 con 0x7f7d880aeda0 2024-05-30T06:48:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d88148520 0x7f7d8813d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d88148520 0x7f7d8813d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37486/0 (socket says 172.21.15.37:37486) 2024-05-30T06:48:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d8d200640 1 -- 172.21.15.37:0/3407941101 learned_addr learned my addr 172.21.15.37:0/3407941101 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d7fe00640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d880b5b00 0x7f7d881588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.043+0000 7f7d87e00640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d880aeda0 0x7f7d8813ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d8d200640 1 -- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d880aeda0 msgr2=0x7f7d8813ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d8d200640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d880aeda0 0x7f7d8813ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d8d200640 1 -- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d880b5b00 msgr2=0x7f7d881588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d8d200640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d880b5b00 0x7f7d881588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d8d200640 1 -- 172.21.15.37:0/3407941101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d88159600 con 0x7f7d88148520 2024-05-30T06:48:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d7fe00640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d880b5b00 0x7f7d881588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d8d200640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d88148520 0x7f7d8813d020 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009cb0 tx=0x7f7d8000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d84c00640 1 -- 172.21.15.37:0/3407941101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80018020 con 0x7f7d88148520 2024-05-30T06:48:19.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d84c00640 1 -- 172.21.15.37:0/3407941101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d80014480 con 0x7f7d88148520 2024-05-30T06:48:19.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d84c00640 1 -- 172.21.15.37:0/3407941101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80014870 con 0x7f7d88148520 2024-05-30T06:48:19.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d8f200640 1 -- 172.21.15.37:0/3407941101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d881598a0 con 0x7f7d88148520 2024-05-30T06:48:19.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d8f200640 1 -- 172.21.15.37:0/3407941101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d88159e60 con 0x7f7d88148520 2024-05-30T06:48:19.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d8f200640 1 -- 172.21.15.37:0/3407941101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d88068bc0 con 0x7f7d88148520 2024-05-30T06:48:19.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.047+0000 7f7d84c00640 1 -- 172.21.15.37:0/3407941101 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f7d8001b020 con 0x7f7d88148520 2024-05-30T06:48:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.051+0000 7f7d84c00640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7d64068c20 0x7f7d6406b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.051+0000 7f7d84c00640 1 -- 172.21.15.37:0/3407941101 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7f7d800884f0 con 0x7f7d88148520 2024-05-30T06:48:19.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.051+0000 7f7d87e00640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7d64068c20 0x7f7d6406b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.051+0000 7f7d87e00640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7d64068c20 0x7f7d6406b0e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7d780ae000 tx=0x7f7d780b4040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.055+0000 7f7d84c00640 1 -- 172.21.15.37:0/3407941101 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7d80022030 con 0x7f7d88148520 2024-05-30T06:48:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d8f200640 1 -- 172.21.15.37:0/3407941101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7d880735c0 con 0x7f7d88148520 2024-05-30T06:48:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d84c00640 1 -- 172.21.15.37:0/3407941101 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) ==== 80+0+0 (secure 0 0 0) 0x7f7d80010040 con 0x7f7d88148520 2024-05-30T06:48:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-30T06:48:19.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d8f200640 1 -- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7d64068c20 msgr2=0x7f7d6406b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d8f200640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7d64068c20 0x7f7d6406b0e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7d780ae000 tx=0x7f7d780b4040 comp rx=0 tx=0).stop 2024-05-30T06:48:19.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d8f200640 1 -- 172.21.15.37:0/3407941101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d88148520 msgr2=0x7f7d8813d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d8f200640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d88148520 0x7f7d8813d020 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009cb0 tx=0x7f7d8000c490 comp rx=0 tx=0).stop 2024-05-30T06:48:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d8f200640 1 -- 172.21.15.37:0/3407941101 shutdown_connections 2024-05-30T06:48:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d8f200640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d88148520 0x7f7d8813d020 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d8f200640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7d64068c20 0x7f7d6406b0e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d8f200640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d880b5b00 0x7f7d881588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d8f200640 1 --2- 172.21.15.37:0/3407941101 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d880aeda0 0x7f7d8813ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d8f200640 1 -- 172.21.15.37:0/3407941101 >> 172.21.15.37:0/3407941101 conn(0x7f7d8806b960 msgr2=0x7f7d88075440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d8f200640 1 -- 172.21.15.37:0/3407941101 shutdown_connections 2024-05-30T06:48:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.231+0000 7f7d8f200640 1 -- 172.21.15.37:0/3407941101 wait complete. 2024-05-30T06:48:19.250 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T06:48:19.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:48:19.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-30T06:48:19.295 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:48:19.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:48:19.296 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T06:48:19.349 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:48:19.349 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:48:19.349 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:48:19.358 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:48:19.358 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:48:19.358 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:48:19.358 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:48:19.404 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:48:19.404 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:48:19.404 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:48:19.405 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:48:19.413 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:48:19.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:48:19.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.587+0000 7f71f0e00640 1 Processor -- start 2024-05-30T06:48:19.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71f0e00640 1 -- start start 2024-05-30T06:48:19.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71f0e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71ec0cdb20 0x7f71ec15c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71f0e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ec0cc090 con 0x7f71ec0ceff0 2024-05-30T06:48:19.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71f0e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ec0cc370 con 0x7f71ec0cdf00 2024-05-30T06:48:19.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71f0e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f71ec0cc650 con 0x7f71ec0cdb20 2024-05-30T06:48:19.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71ebe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f71ec0ceff0 0x7f71ec0cf480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50606/0 (socket says 172.21.15.37:50606) 2024-05-30T06:48:19.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71ebe00640 1 -- 172.21.15.37:0/1176364660 learned_addr learned my addr 172.21.15.37:0/1176364660 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:19.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1542507695 0 0) 0x7f71ec0cc090 con 0x7f71ec0ceff0 2024-05-30T06:48:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eb400640 1 --2- 172.21.15.37:0/1176364660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71ec0cdb20 0x7f71ec15c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d0003530 con 0x7f71ec0ceff0 2024-05-30T06:48:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 467672534 0 0) 0x7f71d0003530 con 0x7f71ec0ceff0 2024-05-30T06:48:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71ec0cdb20 msgr2=0x7f71ec15c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 --2- 172.21.15.37:0/1176364660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71ec0cdb20 0x7f71ec15c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 >> v1:172.21.15.105:6789/0 conn(0x7f71ec0cdf00 legacy=0x7f71ec0b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ec0cc930 con 0x7f71ec0ceff0 2024-05-30T06:48:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f71e4001a00 con 0x7f71ec0ceff0 2024-05-30T06:48:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 >> v1:172.21.15.37:6789/0 conn(0x7f71ec0ceff0 legacy=0x7f71ec0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 --2- 172.21.15.37:0/1176364660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71d00039f0 0x7f71d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 --2- 172.21.15.37:0/1176364660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d00043a0 0x7f71d0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 --2- 172.21.15.37:0/1176364660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71ec0cdb20 0x7f71d0005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec0cc650 con 0x7f71d00043a0 2024-05-30T06:48:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f71d000ba80 con 0x7f71d00039f0 2024-05-30T06:48:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f71d000de90 con 0x7f71ec0cdb20 2024-05-30T06:48:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71e3e00640 1 --2- 172.21.15.37:0/1176364660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d00043a0 0x7f71d0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71eb400640 1 --2- 172.21.15.37:0/1176364660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71d00039f0 0x7f71d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71ebe00640 1 --2- 172.21.15.37:0/1176364660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71ec0cdb20 0x7f71d0005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71e3e00640 1 -- 172.21.15.37:0/1176364660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71ec0cdb20 msgr2=0x7f71d0005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71e3e00640 1 --2- 172.21.15.37:0/1176364660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71ec0cdb20 0x7f71d0005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71e3e00640 1 -- 172.21.15.37:0/1176364660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71d00039f0 msgr2=0x7f71d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71e3e00640 1 --2- 172.21.15.37:0/1176364660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71d00039f0 0x7f71d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.591+0000 7f71e3e00640 1 -- 172.21.15.37:0/1176364660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d0003530 con 0x7f71d00043a0 2024-05-30T06:48:19.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.595+0000 7f71e3e00640 1 --2- 172.21.15.37:0/1176364660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d00043a0 0x7f71d0004870 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f71d4001860 tx=0x7f71d401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c4b6ce8c6c4d52 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:19.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.595+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d40b5070 con 0x7f71d00043a0 2024-05-30T06:48:19.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.595+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d40a8890 con 0x7f71d00043a0 2024-05-30T06:48:19.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.595+0000 7f71eaa00640 1 -- 172.21.15.37:0/1176364660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4001460 con 0x7f71d00043a0 2024-05-30T06:48:19.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.595+0000 7f71f0e00640 1 -- 172.21.15.37:0/1176364660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d00043a0 msgr2=0x7f71d0004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.595+0000 7f71f0e00640 1 --2- 172.21.15.37:0/1176364660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d00043a0 0x7f71d0004870 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f71d4001860 tx=0x7f71d401ec70 comp rx=0 tx=0).stop 2024-05-30T06:48:19.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.595+0000 7f71ebe00640 1 -- 172.21.15.37:0/1176364660 reap_dead start 2024-05-30T06:48:19.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.595+0000 7f71f0e00640 1 -- 172.21.15.37:0/1176364660 shutdown_connections 2024-05-30T06:48:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.595+0000 7f71f0e00640 1 -- 172.21.15.37:0/1176364660 >> 172.21.15.37:0/1176364660 conn(0x7f71ec09aa60 msgr2=0x7f71ec0b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.595+0000 7f71f0e00640 1 -- 172.21.15.37:0/1176364660 shutdown_connections 2024-05-30T06:48:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.595+0000 7f71f0e00640 1 -- 172.21.15.37:0/1176364660 wait complete. 2024-05-30T06:48:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71f0e00640 1 Processor -- start 2024-05-30T06:48:19.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71f0e00640 1 -- start start 2024-05-30T06:48:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71f0e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71d00043a0 0x7f71ec158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71f0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71ec1f4d70 0x7f71ec0b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71f0e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71ec15a7f0 0x7f71ec15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71f0e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec0ce360 con 0x7f71ec1f4d70 2024-05-30T06:48:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71f0e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec0b3d90 con 0x7f71ec15a7f0 2024-05-30T06:48:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71f0e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f71ec0cd130 con 0x7f71d00043a0 2024-05-30T06:48:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71e3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71ec1f4d70 0x7f71ec0b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71e3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71ec1f4d70 0x7f71ec0b6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37504/0 (socket says 172.21.15.37:37504) 2024-05-30T06:48:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71e3e00640 1 -- 172.21.15.37:0/3064330476 learned_addr learned my addr 172.21.15.37:0/3064330476 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71eb400640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71d00043a0 0x7f71ec158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71ebe00640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71ec15a7f0 0x7f71ec15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71e3e00640 1 -- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71d00043a0 msgr2=0x7f71ec158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71e3e00640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71d00043a0 0x7f71ec158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71e3e00640 1 -- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71ec15a7f0 msgr2=0x7f71ec15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71e3e00640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71ec15a7f0 0x7f71ec15aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71e3e00640 1 -- 172.21.15.37:0/3064330476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ec1f51f0 con 0x7f71ec1f4d70 2024-05-30T06:48:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71e3e00640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71ec1f4d70 0x7f71ec0b6c70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f71d40b3040 tx=0x7f71d0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71e3400640 1 -- 172.21.15.37:0/3064330476 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d40b5040 con 0x7f71ec1f4d70 2024-05-30T06:48:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71e3400640 1 -- 172.21.15.37:0/3064330476 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d4005070 con 0x7f71ec1f4d70 2024-05-30T06:48:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71f0e00640 1 -- 172.21.15.37:0/3064330476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ec158f00 con 0x7f71ec1f4d70 2024-05-30T06:48:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71e3400640 1 -- 172.21.15.37:0/3064330476 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4005420 con 0x7f71ec1f4d70 2024-05-30T06:48:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.599+0000 7f71f0e00640 1 -- 172.21.15.37:0/3064330476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ec1594c0 con 0x7f71ec1f4d70 2024-05-30T06:48:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.603+0000 7f71f0e00640 1 -- 172.21.15.37:0/3064330476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ec068ab0 con 0x7f71ec1f4d70 2024-05-30T06:48:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.603+0000 7f71e3400640 1 -- 172.21.15.37:0/3064330476 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f71d40b8070 con 0x7f71ec1f4d70 2024-05-30T06:48:19.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.603+0000 7f71e3400640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f71c8068c20 0x7f71c806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.603+0000 7f71e3400640 1 -- 172.21.15.37:0/3064330476 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7f71d4124da0 con 0x7f71ec1f4d70 2024-05-30T06:48:19.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.603+0000 7f71eb400640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f71c8068c20 0x7f71c806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.603+0000 7f71eb400640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f71c8068c20 0x7f71c806b0e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009be0 tx=0x7f71dc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.607+0000 7f71e3400640 1 -- 172.21.15.37:0/3064330476 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f71d4018980 con 0x7f71ec1f4d70 2024-05-30T06:48:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.807+0000 7f71f0e00640 1 -- 172.21.15.37:0/3064330476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71ec0b2d50 con 0x7f71ec1f4d70 2024-05-30T06:48:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.807+0000 7f71e3400640 1 -- 172.21.15.37:0/3064330476 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5184 (secure 0 0 0) 0x7f71d40f4220 con 0x7f71ec1f4d70 2024-05-30T06:48:19.808 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:19.808 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/2692603987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2692603987},{"type":"v1","addr":"172.21.15.105:6836","nonce":2692603987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5539,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2559528007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2559528007},{"type":"v1","addr":"172.21.15.105:6837","nonce":2559528007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2198221961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2198221961},{"type":"v1","addr":"172.21.15.37:6833","nonce":2198221961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:45:45.908180+0000","modified":"2024-05-30T06:45:48.930208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5652":{"gid":5652,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/115371806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":115371806},{"type":"v1","addr":"172.21.15.37:6835","nonce":115371806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5652,"qdb_cluster":[5652]},"id":3}]} 2024-05-30T06:48:19.808 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-05-30T06:48:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.811+0000 7f71f0e00640 1 -- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f71c8068c20 msgr2=0x7f71c806b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.811+0000 7f71f0e00640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f71c8068c20 0x7f71c806b0e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009be0 tx=0x7f71dc009190 comp rx=0 tx=0).stop 2024-05-30T06:48:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.811+0000 7f71f0e00640 1 -- 172.21.15.37:0/3064330476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71ec1f4d70 msgr2=0x7f71ec0b6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.811+0000 7f71f0e00640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71ec1f4d70 0x7f71ec0b6c70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f71d40b3040 tx=0x7f71d0005840 comp rx=0 tx=0).stop 2024-05-30T06:48:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.811+0000 7f71f0e00640 1 -- 172.21.15.37:0/3064330476 shutdown_connections 2024-05-30T06:48:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.811+0000 7f71f0e00640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f71c8068c20 0x7f71c806b0e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.811+0000 7f71f0e00640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71ec15a7f0 0x7f71ec15aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.811+0000 7f71f0e00640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71ec1f4d70 0x7f71ec0b6c70 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.811+0000 7f71f0e00640 1 --2- 172.21.15.37:0/3064330476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71d00043a0 0x7f71ec158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.811+0000 7f71f0e00640 1 -- 172.21.15.37:0/3064330476 >> 172.21.15.37:0/3064330476 conn(0x7f71ec09aa60 msgr2=0x7f71ec06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.811+0000 7f71f0e00640 1 -- 172.21.15.37:0/3064330476 shutdown_connections 2024-05-30T06:48:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.811+0000 7f71f0e00640 1 -- 172.21.15.37:0/3064330476 wait complete. 2024-05-30T06:48:19.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:48:19.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f772e400640 1 Processor -- start 2024-05-30T06:48:19.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f772e400640 1 -- start start 2024-05-30T06:48:19.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f772e400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f77280b2ec0 0x7f77280af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f772e400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f772815eed0 0x7f772815f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f772e400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f772815f8a0 con 0x7f77281482d0 2024-05-30T06:48:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f772e400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f772806e860 con 0x7f77280b2ec0 2024-05-30T06:48:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f772e400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f77280afbd0 con 0x7f772815eed0 2024-05-30T06:48:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7727400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f77281482d0 0x7f772815ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50620/0 (socket says 172.21.15.37:50620) 2024-05-30T06:48:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7727400640 1 -- 172.21.15.37:0/3886810783 learned_addr learned my addr 172.21.15.37:0/3886810783 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2548646009 0 0) 0x7f772815f8a0 con 0x7f77281482d0 2024-05-30T06:48:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7727e00640 1 --2- 172.21.15.37:0/3886810783 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f772815eed0 0x7f772815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f771ea00640 1 --2- 172.21.15.37:0/3886810783 >> v2:172.21.15.105:3300/0 conn(0x7f77280b2ec0 0x7f77280af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f770c003530 con 0x7f77281482d0 2024-05-30T06:48:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2863667669 0 0) 0x7f770c003530 con 0x7f77281482d0 2024-05-30T06:48:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f772815eed0 msgr2=0x7f772815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 --2- 172.21.15.37:0/3886810783 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f772815eed0 0x7f772815f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 >> v2:172.21.15.105:3300/0 conn(0x7f77280b2ec0 msgr2=0x7f77280af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 --2- 172.21.15.37:0/3886810783 >> v2:172.21.15.105:3300/0 conn(0x7f77280b2ec0 0x7f77280af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77280afe30 con 0x7f77281482d0 2024-05-30T06:48:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f7718001680 con 0x7f77281482d0 2024-05-30T06:48:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 >> v1:172.21.15.37:6789/0 conn(0x7f77281482d0 legacy=0x7f772815ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 --2- 172.21.15.37:0/3886810783 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f772815eed0 0x7f770c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 --2- 172.21.15.37:0/3886810783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f770c003f40 0x7f770c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 --2- 172.21.15.37:0/3886810783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f770c004d50 0x7f770c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f772806e860 con 0x7f770c004d50 2024-05-30T06:48:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f77280afbd0 con 0x7f770c003f40 2024-05-30T06:48:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f770c00ba20 con 0x7f772815eed0 2024-05-30T06:48:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7727400640 1 --2- 172.21.15.37:0/3886810783 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f772815eed0 0x7f770c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f7727e00640 1 --2- 172.21.15.37:0/3886810783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f770c004d50 0x7f770c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.971+0000 7f771ea00640 1 --2- 172.21.15.37:0/3886810783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f770c003f40 0x7f770c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f7727400640 1 -- 172.21.15.37:0/3886810783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f770c003f40 msgr2=0x7f770c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f7727400640 1 --2- 172.21.15.37:0/3886810783 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f770c003f40 0x7f770c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f7727400640 1 -- 172.21.15.37:0/3886810783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f770c004d50 msgr2=0x7f770c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f7727400640 1 --2- 172.21.15.37:0/3886810783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f770c004d50 0x7f770c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f7727400640 1 -- 172.21.15.37:0/3886810783 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770c003530 con 0x7f772815eed0 2024-05-30T06:48:19.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f7727400640 1 --2- 172.21.15.37:0/3886810783 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f772815eed0 0x7f770c0039c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f771800c270 tx=0x7f771801f410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14a3923f2b1eda08 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:19.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718007d60 con 0x7f772815eed0 2024-05-30T06:48:19.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7718005b00 con 0x7f772815eed0 2024-05-30T06:48:19.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f7726a00640 1 -- 172.21.15.37:0/3886810783 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7718007070 con 0x7f772815eed0 2024-05-30T06:48:19.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f772e400640 1 -- 172.21.15.37:0/3886810783 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f772815eed0 msgr2=0x7f770c0039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f772e400640 1 --2- 172.21.15.37:0/3886810783 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f772815eed0 0x7f770c0039c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f771800c270 tx=0x7f771801f410 comp rx=0 tx=0).stop 2024-05-30T06:48:19.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f7727e00640 1 -- 172.21.15.37:0/3886810783 reap_dead start 2024-05-30T06:48:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f772e400640 1 -- 172.21.15.37:0/3886810783 shutdown_connections 2024-05-30T06:48:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f772e400640 1 -- 172.21.15.37:0/3886810783 >> 172.21.15.37:0/3886810783 conn(0x7f77280b23a0 msgr2=0x7f77280b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f772e400640 1 -- 172.21.15.37:0/3886810783 shutdown_connections 2024-05-30T06:48:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.975+0000 7f772e400640 1 -- 172.21.15.37:0/3886810783 wait complete. 2024-05-30T06:48:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f772e400640 1 Processor -- start 2024-05-30T06:48:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f772e400640 1 -- start start 2024-05-30T06:48:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f772e400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f772815eed0 0x7f772813eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f772e400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7728140dc0 0x7f772813dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f772e400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77280cf350 0x7f77280cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f772e400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f772815f360 con 0x7f7728140dc0 2024-05-30T06:48:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f772e400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f772806e4f0 con 0x7f772815eed0 2024-05-30T06:48:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f772e400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f772815f4e0 con 0x7f77280cf350 2024-05-30T06:48:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f771ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7728140dc0 0x7f772813dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f771ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7728140dc0 0x7f772813dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37520/0 (socket says 172.21.15.37:37520) 2024-05-30T06:48:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f771ea00640 1 -- 172.21.15.37:0/4150185046 learned_addr learned my addr 172.21.15.37:0/4150185046 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f7727400640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f772815eed0 0x7f772813eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f7727e00640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77280cf350 0x7f77280cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f771ea00640 1 -- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77280cf350 msgr2=0x7f77280cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f771ea00640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77280cf350 0x7f77280cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f771ea00640 1 -- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f772815eed0 msgr2=0x7f772813eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f771ea00640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f772815eed0 0x7f772813eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f771ea00640 1 -- 172.21.15.37:0/4150185046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7728141610 con 0x7f7728140dc0 2024-05-30T06:48:19.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f771ea00640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7728140dc0 0x7f772813dea0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7710011a00 tx=0x7f7710011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:19.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f771fe00640 1 -- 172.21.15.37:0/4150185046 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771000fb50 con 0x7f7728140dc0 2024-05-30T06:48:19.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f771fe00640 1 -- 172.21.15.37:0/4150185046 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f771000fcf0 con 0x7f7728140dc0 2024-05-30T06:48:19.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f772e400640 1 -- 172.21.15.37:0/4150185046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77281418f0 con 0x7f7728140dc0 2024-05-30T06:48:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f771fe00640 1 -- 172.21.15.37:0/4150185046 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771000fea0 con 0x7f7728140dc0 2024-05-30T06:48:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.979+0000 7f772e400640 1 -- 172.21.15.37:0/4150185046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77281426d0 con 0x7f7728140dc0 2024-05-30T06:48:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.983+0000 7f772e400640 1 -- 172.21.15.37:0/4150185046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7728068b20 con 0x7f7728140dc0 2024-05-30T06:48:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.983+0000 7f771fe00640 1 -- 172.21.15.37:0/4150185046 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f7710012040 con 0x7f7728140dc0 2024-05-30T06:48:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.983+0000 7f771fe00640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7704068bf0 0x7f770406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.983+0000 7f771fe00640 1 -- 172.21.15.37:0/4150185046 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7f77100880f0 con 0x7f7728140dc0 2024-05-30T06:48:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.983+0000 7f7727400640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7704068bf0 0x7f770406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.983+0000 7f7727400640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7704068bf0 0x7f770406b0b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f77180ae000 tx=0x7f77180b4040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:19.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:19.987+0000 7f771fe00640 1 -- 172.21.15.37:0/4150185046 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7710019030 con 0x7f7728140dc0 2024-05-30T06:48:20.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.151+0000 7f772e400640 1 -- 172.21.15.37:0/4150185046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7728072fb0 con 0x7f7728140dc0 2024-05-30T06:48:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.155+0000 7f771fe00640 1 -- 172.21.15.37:0/4150185046 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16800 (secure 0 0 0) 0x7f7710057100 con 0x7f7728140dc0 2024-05-30T06:48:20.153 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:20.153 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":49,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:48:16.811163+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:45:44.283575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T06:45:44.856243+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":4}]},{"pgid":"7.1b","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:48:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.155+0000 7f772e400640 1 -- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7704068bf0 msgr2=0x7f770406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.155+0000 7f772e400640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7704068bf0 0x7f770406b0b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f77180ae000 tx=0x7f77180b4040 comp rx=0 tx=0).stop 2024-05-30T06:48:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.155+0000 7f772e400640 1 -- 172.21.15.37:0/4150185046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7728140dc0 msgr2=0x7f772813dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.155+0000 7f772e400640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7728140dc0 0x7f772813dea0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7710011a00 tx=0x7f7710011ec0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.155+0000 7f772e400640 1 -- 172.21.15.37:0/4150185046 shutdown_connections 2024-05-30T06:48:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.155+0000 7f772e400640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77280cf350 0x7f77280cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.155+0000 7f772e400640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7728140dc0 0x7f772813dea0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.155+0000 7f772e400640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7704068bf0 0x7f770406b0b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.155+0000 7f772e400640 1 --2- 172.21.15.37:0/4150185046 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f772815eed0 0x7f772813eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.155+0000 7f772e400640 1 -- 172.21.15.37:0/4150185046 >> 172.21.15.37:0/4150185046 conn(0x7f77280b23a0 msgr2=0x7f77280aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.155+0000 7f772e400640 1 -- 172.21.15.37:0/4150185046 shutdown_connections 2024-05-30T06:48:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.155+0000 7f772e400640 1 -- 172.21.15.37:0/4150185046 wait complete. 2024-05-30T06:48:20.175 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:45:44.283575+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:45:44.856243+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 49, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:48:20.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:48:20.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.319+0000 7ff478e00640 1 Processor -- start 2024-05-30T06:48:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.319+0000 7ff478e00640 1 -- start start 2024-05-30T06:48:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.319+0000 7ff478e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff47406d200 0x7ff47406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.319+0000 7ff478e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff4740d0ac0 0x7ff4740d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.319+0000 7ff478e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff47406db60 con 0x7ff47415e8b0 2024-05-30T06:48:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.319+0000 7ff478e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff474163350 con 0x7ff4740d0ac0 2024-05-30T06:48:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.319+0000 7ff478e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff4741627d0 con 0x7ff47406d200 2024-05-30T06:48:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.319+0000 7ff46be00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff47406d200 0x7ff47406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.323+0000 7ff471e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff47415e8b0 0x7ff4740cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:34640/0 (socket says 172.21.15.37:34640) 2024-05-30T06:48:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.323+0000 7ff471e00640 1 -- 172.21.15.37:0/670813149 learned_addr learned my addr 172.21.15.37:0/670813149 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.323+0000 7ff46be00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff47406d200 0x7ff47406d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:37816/0 (socket says 172.21.15.37:37816) 2024-05-30T06:48:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.323+0000 7ff472800640 1 --2- 172.21.15.37:0/670813149 >> v2:172.21.15.105:3300/0 conn(0x7ff4740d0ac0 0x7ff4740d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.323+0000 7ff46be00640 1 -- 172.21.15.37:0/670813149 >> v2:172.21.15.105:3300/0 conn(0x7ff4740d0ac0 msgr2=0x7ff4740d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.323+0000 7ff46be00640 1 --2- 172.21.15.37:0/670813149 >> v2:172.21.15.105:3300/0 conn(0x7ff4740d0ac0 0x7ff4740d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.323+0000 7ff46be00640 1 -- 172.21.15.37:0/670813149 >> v1:172.21.15.105:6789/0 conn(0x7ff47415e8b0 legacy=0x7ff4740cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.323+0000 7ff471400640 1 -- 172.21.15.37:0/670813149 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3864584745 0 0) 0x7ff47406db60 con 0x7ff47415e8b0 2024-05-30T06:48:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.323+0000 7ff46be00640 1 -- 172.21.15.37:0/670813149 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff474162ab0 con 0x7ff47406d200 2024-05-30T06:48:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.323+0000 7ff46be00640 1 --2- 172.21.15.37:0/670813149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff47406d200 0x7ff47406d620 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0097c0 tx=0x7ff45c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=970393d47bb0df5f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.323+0000 7ff471400640 1 -- 172.21.15.37:0/670813149 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c0b2070 con 0x7ff47406d200 2024-05-30T06:48:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.323+0000 7ff471400640 1 -- 172.21.15.37:0/670813149 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff45c0ad640 con 0x7ff47406d200 2024-05-30T06:48:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.323+0000 7ff471400640 1 -- 172.21.15.37:0/670813149 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c0ada10 con 0x7ff47406d200 2024-05-30T06:48:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 -- 172.21.15.37:0/670813149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff47406d200 msgr2=0x7ff47406d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 --2- 172.21.15.37:0/670813149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff47406d200 0x7ff47406d620 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0097c0 tx=0x7ff45c01c4a0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 -- 172.21.15.37:0/670813149 shutdown_connections 2024-05-30T06:48:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 --2- 172.21.15.37:0/670813149 >> v2:172.21.15.105:3300/0 conn(0x7ff4740d0ac0 0x7ff4740d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 --2- 172.21.15.37:0/670813149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff47406d200 0x7ff47406d620 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 -- 172.21.15.37:0/670813149 >> 172.21.15.37:0/670813149 conn(0x7ff4740b4130 msgr2=0x7ff4740b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 -- 172.21.15.37:0/670813149 shutdown_connections 2024-05-30T06:48:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 -- 172.21.15.37:0/670813149 wait complete. 2024-05-30T06:48:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 Processor -- start 2024-05-30T06:48:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 -- start start 2024-05-30T06:48:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff47406d200 0x7ff474154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4740d0ac0 0x7ff4740af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff47415e8b0 0x7ff4740b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4740cf050 con 0x7ff47415e8b0 2024-05-30T06:48:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff474162480 con 0x7ff4740d0ac0 2024-05-30T06:48:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff478e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff47416b820 con 0x7ff47406d200 2024-05-30T06:48:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff46be00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4740d0ac0 0x7ff4740af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff471e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff47406d200 0x7ff474154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff46be00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4740d0ac0 0x7ff4740af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:42630/0 (socket says 172.21.15.37:42630) 2024-05-30T06:48:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff46be00640 1 -- 172.21.15.37:0/3779443761 learned_addr learned my addr 172.21.15.37:0/3779443761 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff472800640 1 --2- 172.21.15.37:0/3779443761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff47415e8b0 0x7ff4740b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff46be00640 1 -- 172.21.15.37:0/3779443761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff47406d200 msgr2=0x7ff474154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff46be00640 1 --2- 172.21.15.37:0/3779443761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff47406d200 0x7ff474154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff46be00640 1 -- 172.21.15.37:0/3779443761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff47415e8b0 msgr2=0x7ff4740b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff46be00640 1 --2- 172.21.15.37:0/3779443761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff47415e8b0 0x7ff4740b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff46be00640 1 -- 172.21.15.37:0/3779443761 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4740afd10 con 0x7ff4740d0ac0 2024-05-30T06:48:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.327+0000 7ff46be00640 1 --2- 172.21.15.37:0/3779443761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4740d0ac0 0x7ff4740af410 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0b0040 tx=0x7ff45c019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.331+0000 7ff46a000640 1 -- 172.21.15.37:0/3779443761 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c0bd070 con 0x7ff4740d0ac0 2024-05-30T06:48:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.331+0000 7ff46a000640 1 -- 172.21.15.37:0/3779443761 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff45c004030 con 0x7ff4740d0ac0 2024-05-30T06:48:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.331+0000 7ff46a000640 1 -- 172.21.15.37:0/3779443761 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c0b2040 con 0x7ff4740d0ac0 2024-05-30T06:48:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.331+0000 7ff478e00640 1 -- 172.21.15.37:0/3779443761 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4740afff0 con 0x7ff4740d0ac0 2024-05-30T06:48:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.331+0000 7ff478e00640 1 -- 172.21.15.37:0/3779443761 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4740b05b0 con 0x7ff4740d0ac0 2024-05-30T06:48:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.331+0000 7ff478e00640 1 -- 172.21.15.37:0/3779443761 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff474068bc0 con 0x7ff4740d0ac0 2024-05-30T06:48:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.331+0000 7ff46a000640 1 -- 172.21.15.37:0/3779443761 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7ff45c003620 con 0x7ff4740d0ac0 2024-05-30T06:48:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.331+0000 7ff46a000640 1 --2- 172.21.15.37:0/3779443761 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff450068c20 0x7ff45006b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.331+0000 7ff46a000640 1 -- 172.21.15.37:0/3779443761 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7ff45c120b00 con 0x7ff4740d0ac0 2024-05-30T06:48:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.331+0000 7ff471e00640 1 --2- 172.21.15.37:0/3779443761 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff450068c20 0x7ff45006b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.331+0000 7ff471e00640 1 --2- 172.21.15.37:0/3779443761 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff450068c20 0x7ff45006b0e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff464007fd0 tx=0x7ff464007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.335+0000 7ff46a000640 1 -- 172.21.15.37:0/3779443761 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff45c016090 con 0x7ff4740d0ac0 2024-05-30T06:48:20.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.503+0000 7ff478e00640 1 -- 172.21.15.37:0/3779443761 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff4741695f0 con 0x7ff4740d0ac0 2024-05-30T06:48:20.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.503+0000 7ff46a000640 1 -- 172.21.15.37:0/3779443761 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) ==== 93+0+10 (secure 0 0 0) 0x7ff45c0efef0 con 0x7ff4740d0ac0 2024-05-30T06:48:20.502 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:48:20.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.503+0000 7ff478e00640 1 -- 172.21.15.37:0/3779443761 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff450068c20 msgr2=0x7ff45006b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.503+0000 7ff478e00640 1 --2- 172.21.15.37:0/3779443761 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff450068c20 0x7ff45006b0e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff464007fd0 tx=0x7ff464007d60 comp rx=0 tx=0).stop 2024-05-30T06:48:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.503+0000 7ff478e00640 1 -- 172.21.15.37:0/3779443761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4740d0ac0 msgr2=0x7ff4740af410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.503+0000 7ff478e00640 1 --2- 172.21.15.37:0/3779443761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4740d0ac0 0x7ff4740af410 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0b0040 tx=0x7ff45c019240 comp rx=0 tx=0).stop 2024-05-30T06:48:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.507+0000 7ff478e00640 1 -- 172.21.15.37:0/3779443761 shutdown_connections 2024-05-30T06:48:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.507+0000 7ff478e00640 1 --2- 172.21.15.37:0/3779443761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff47415e8b0 0x7ff4740b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.507+0000 7ff478e00640 1 --2- 172.21.15.37:0/3779443761 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff450068c20 0x7ff45006b0e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.507+0000 7ff478e00640 1 --2- 172.21.15.37:0/3779443761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4740d0ac0 0x7ff4740af410 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.507+0000 7ff478e00640 1 --2- 172.21.15.37:0/3779443761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff47406d200 0x7ff474154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.507+0000 7ff478e00640 1 -- 172.21.15.37:0/3779443761 >> 172.21.15.37:0/3779443761 conn(0x7ff4740b4130 msgr2=0x7ff47415eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.507+0000 7ff478e00640 1 -- 172.21.15.37:0/3779443761 shutdown_connections 2024-05-30T06:48:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.507+0000 7ff478e00640 1 -- 172.21.15.37:0/3779443761 wait complete. 2024-05-30T06:48:20.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:48:20.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.667+0000 7fc77c800640 1 Processor -- start 2024-05-30T06:48:20.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc77c800640 1 -- start start 2024-05-30T06:48:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc77c800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc77415ebc0 0x7fc7740d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc77c800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc77409aa60 0x7fc77409aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc77c800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7740d0840 con 0x7fc77409b800 2024-05-30T06:48:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc77c800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc77409b410 con 0x7fc77409aa60 2024-05-30T06:48:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc77c800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc77406dec0 con 0x7fc77415ebc0 2024-05-30T06:48:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc779400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc77409b800 0x7fc77406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50632/0 (socket says 172.21.15.37:50632) 2024-05-30T06:48:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc779400640 1 -- 172.21.15.37:0/2381951988 learned_addr learned my addr 172.21.15.37:0/2381951988 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc779e00640 1 --2- 172.21.15.37:0/2381951988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc77415ebc0 0x7fc7740d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc77a800640 1 --2- 172.21.15.37:0/2381951988 >> v2:172.21.15.105:3300/0 conn(0x7fc77409aa60 0x7fc77409aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc778a00640 1 -- 172.21.15.37:0/2381951988 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2977677860 0 0) 0x7fc7740d0840 con 0x7fc77409b800 2024-05-30T06:48:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc778a00640 1 -- 172.21.15.37:0/2381951988 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc75c003530 con 0x7fc77409b800 2024-05-30T06:48:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc778a00640 1 -- 172.21.15.37:0/2381951988 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2124538059 0 0) 0x7fc75c003530 con 0x7fc77409b800 2024-05-30T06:48:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc77a800640 1 -- 172.21.15.37:0/2381951988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc77415ebc0 msgr2=0x7fc7740d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc77a800640 1 --2- 172.21.15.37:0/2381951988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc77415ebc0 0x7fc7740d15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc77a800640 1 -- 172.21.15.37:0/2381951988 >> v1:172.21.15.37:6789/0 conn(0x7fc77409b800 legacy=0x7fc77406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc77a800640 1 -- 172.21.15.37:0/2381951988 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77409bce0 con 0x7fc77409aa60 2024-05-30T06:48:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.671+0000 7fc779e00640 1 --2- 172.21.15.37:0/2381951988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc77415ebc0 0x7fc7740d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:20.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.675+0000 7fc77a800640 1 --2- 172.21.15.37:0/2381951988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77409aa60 0x7fc77409aed0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc770009d90 tx=0x7fc77001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6df6e93922f3017 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:20.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.675+0000 7fc778a00640 1 -- 172.21.15.37:0/2381951988 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7700b2070 con 0x7fc77409aa60 2024-05-30T06:48:20.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.675+0000 7fc778a00640 1 -- 172.21.15.37:0/2381951988 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7700a5580 con 0x7fc77409aa60 2024-05-30T06:48:20.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.675+0000 7fc778a00640 1 -- 172.21.15.37:0/2381951988 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc764001680 con 0x7fc77409aa60 2024-05-30T06:48:20.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.675+0000 7fc77c800640 1 -- 172.21.15.37:0/2381951988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77409aa60 msgr2=0x7fc77409aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.675+0000 7fc77c800640 1 --2- 172.21.15.37:0/2381951988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77409aa60 0x7fc77409aed0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc770009d90 tx=0x7fc77001c890 comp rx=0 tx=0).stop 2024-05-30T06:48:20.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.675+0000 7fc77c800640 1 -- 172.21.15.37:0/2381951988 shutdown_connections 2024-05-30T06:48:20.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.675+0000 7fc77c800640 1 --2- 172.21.15.37:0/2381951988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77409aa60 0x7fc77409aed0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.675+0000 7fc77c800640 1 --2- 172.21.15.37:0/2381951988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc77415ebc0 0x7fc7740d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.675+0000 7fc77c800640 1 -- 172.21.15.37:0/2381951988 >> 172.21.15.37:0/2381951988 conn(0x7fc7740b4060 msgr2=0x7fc7740b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:20.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.675+0000 7fc77c800640 1 -- 172.21.15.37:0/2381951988 shutdown_connections 2024-05-30T06:48:20.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.675+0000 7fc77c800640 1 -- 172.21.15.37:0/2381951988 wait complete. 2024-05-30T06:48:20.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.675+0000 7fc77c800640 1 Processor -- start 2024-05-30T06:48:20.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc77c800640 1 -- start start 2024-05-30T06:48:20.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc77c800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc77409aa60 0x7fc77415c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:20.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc77c800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77409b800 0x7fc77415dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:20.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc77c800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77415ebc0 0x7fc7741f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:20.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc77c800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7740d1b00 con 0x7fc77409b800 2024-05-30T06:48:20.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc77c800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc77415efa0 con 0x7fc77415ebc0 2024-05-30T06:48:20.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc77c800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc774150870 con 0x7fc77409aa60 2024-05-30T06:48:20.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc779400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77409b800 0x7fc77415dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:20.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc779400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77409b800 0x7fc77415dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37528/0 (socket says 172.21.15.37:37528) 2024-05-30T06:48:20.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc779400640 1 -- 172.21.15.37:0/1647904675 learned_addr learned my addr 172.21.15.37:0/1647904675 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:20.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc779e00640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc77409aa60 0x7fc77415c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc77a800640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77415ebc0 0x7fc7741f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc779400640 1 -- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc77409aa60 msgr2=0x7fc77415c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc779400640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc77409aa60 0x7fc77415c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc779400640 1 -- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77415ebc0 msgr2=0x7fc7741f92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc779400640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77415ebc0 0x7fc7741f92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc779400640 1 -- 172.21.15.37:0/1647904675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc774150b50 con 0x7fc77409b800 2024-05-30T06:48:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc77a800640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77415ebc0 0x7fc7741f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc779400640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77409b800 0x7fc77415dcf0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc76400c780 tx=0x7fc76400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc76e000640 1 -- 172.21.15.37:0/1647904675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc764005ae0 con 0x7fc77409b800 2024-05-30T06:48:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc76e000640 1 -- 172.21.15.37:0/1647904675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc764005ca0 con 0x7fc77409b800 2024-05-30T06:48:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc76e000640 1 -- 172.21.15.37:0/1647904675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7640072b0 con 0x7fc77409b800 2024-05-30T06:48:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc77c800640 1 -- 172.21.15.37:0/1647904675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc774150e30 con 0x7fc77409b800 2024-05-30T06:48:20.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc77c800640 1 -- 172.21.15.37:0/1647904675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc77415c590 con 0x7fc77409b800 2024-05-30T06:48:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.679+0000 7fc77c800640 1 -- 172.21.15.37:0/1647904675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc774068bc0 con 0x7fc77409b800 2024-05-30T06:48:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.683+0000 7fc76e000640 1 -- 172.21.15.37:0/1647904675 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fc764007450 con 0x7fc77409b800 2024-05-30T06:48:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.683+0000 7fc76e000640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc758068bf0 0x7fc75806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.683+0000 7fc76e000640 1 -- 172.21.15.37:0/1647904675 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7fc764087b40 con 0x7fc77409b800 2024-05-30T06:48:20.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.683+0000 7fc779e00640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc758068bf0 0x7fc75806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:20.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.683+0000 7fc779e00640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc758068bf0 0x7fc75806b0b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc768009580 tx=0x7fc768009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:20.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.687+0000 7fc76e000640 1 -- 172.21.15.37:0/1647904675 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc7640570e0 con 0x7fc77409b800 2024-05-30T06:48:20.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc77c800640 1 -- 172.21.15.37:0/1647904675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc7741582e0 con 0x7fc77409b800 2024-05-30T06:48:20.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc76e000640 1 -- 172.21.15.37:0/1647904675 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) ==== 104+0+11 (secure 0 0 0) 0x7fc7640569e0 con 0x7fc77409b800 2024-05-30T06:48:20.850 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:48:20.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc77c800640 1 -- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc758068bf0 msgr2=0x7fc75806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc77c800640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc758068bf0 0x7fc75806b0b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc768009580 tx=0x7fc768009190 comp rx=0 tx=0).stop 2024-05-30T06:48:20.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc77c800640 1 -- 172.21.15.37:0/1647904675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77409b800 msgr2=0x7fc77415dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:20.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc77c800640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77409b800 0x7fc77415dcf0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc76400c780 tx=0x7fc76400cc40 comp rx=0 tx=0).stop 2024-05-30T06:48:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc77c800640 1 -- 172.21.15.37:0/1647904675 shutdown_connections 2024-05-30T06:48:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc77c800640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc758068bf0 0x7fc75806b0b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc77c800640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc77415ebc0 0x7fc7741f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc77c800640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77409b800 0x7fc77415dcf0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc77c800640 1 --2- 172.21.15.37:0/1647904675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc77409aa60 0x7fc77415c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc77c800640 1 -- 172.21.15.37:0/1647904675 >> 172.21.15.37:0/1647904675 conn(0x7fc7740b4060 msgr2=0x7fc7740b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc77c800640 1 -- 172.21.15.37:0/1647904675 shutdown_connections 2024-05-30T06:48:20.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:20.851+0000 7fc77c800640 1 -- 172.21.15.37:0/1647904675 wait complete. 2024-05-30T06:48:20.872 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:48:21.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.015+0000 7f1d33000640 1 Processor -- start 2024-05-30T06:48:21.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.015+0000 7f1d33000640 1 -- start start 2024-05-30T06:48:21.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d33000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d2c0cff20 0x7f1d2c0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d33000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d2c0cf850 0x7f1d2c0b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d33000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d2c0cd1e0 con 0x7f1d2c15b780 2024-05-30T06:48:21.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d33000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1d2c0cfca0 con 0x7f1d2c0cf850 2024-05-30T06:48:21.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d33000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1d2c0b0bd0 con 0x7f1d2c0cff20 2024-05-30T06:48:21.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d32600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d2c0cf850 0x7f1d2c0b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d31c00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1d2c15b780 0x7f1d2c0cc940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50644/0 (socket says 172.21.15.37:50644) 2024-05-30T06:48:21.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d31c00640 1 -- 172.21.15.37:0/398151765 learned_addr learned my addr 172.21.15.37:0/398151765 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:21.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d31200640 1 --2- 172.21.15.37:0/398151765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d2c0cff20 0x7f1d2c0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d32600640 1 -- 172.21.15.37:0/398151765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d2c0cff20 msgr2=0x7f1d2c0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:21.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d32600640 1 --2- 172.21.15.37:0/398151765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d2c0cff20 0x7f1d2c0cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d32600640 1 -- 172.21.15.37:0/398151765 >> v1:172.21.15.37:6789/0 conn(0x7f1d2c15b780 legacy=0x7f1d2c0cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d2be00640 1 -- 172.21.15.37:0/398151765 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3750895106 0 0) 0x7f1d2c0cd1e0 con 0x7f1d2c15b780 2024-05-30T06:48:21.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d32600640 1 -- 172.21.15.37:0/398151765 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c0b0eb0 con 0x7f1d2c0cf850 2024-05-30T06:48:21.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d31200640 1 --2- 172.21.15.37:0/398151765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d2c0cff20 0x7f1d2c0cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:21.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.019+0000 7f1d32600640 1 --2- 172.21.15.37:0/398151765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cf850 0x7f1d2c0b16b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009d90 tx=0x7f1d2401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda219f304264d12 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:21.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d2be00640 1 -- 172.21.15.37:0/398151765 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d240b2070 con 0x7f1d2c0cf850 2024-05-30T06:48:21.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d2be00640 1 -- 172.21.15.37:0/398151765 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d240a5830 con 0x7f1d2c0cf850 2024-05-30T06:48:21.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d2be00640 1 -- 172.21.15.37:0/398151765 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d240a5c00 con 0x7f1d2c0cf850 2024-05-30T06:48:21.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 -- 172.21.15.37:0/398151765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cf850 msgr2=0x7f1d2c0b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 --2- 172.21.15.37:0/398151765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cf850 0x7f1d2c0b16b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009d90 tx=0x7f1d2401c970 comp rx=0 tx=0).stop 2024-05-30T06:48:21.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 -- 172.21.15.37:0/398151765 shutdown_connections 2024-05-30T06:48:21.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 --2- 172.21.15.37:0/398151765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cf850 0x7f1d2c0b16b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 --2- 172.21.15.37:0/398151765 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d2c0cff20 0x7f1d2c0cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 -- 172.21.15.37:0/398151765 >> 172.21.15.37:0/398151765 conn(0x7f1d2c09aa60 msgr2=0x7f1d2c0b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:21.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 -- 172.21.15.37:0/398151765 shutdown_connections 2024-05-30T06:48:21.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 -- 172.21.15.37:0/398151765 wait complete. 2024-05-30T06:48:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 Processor -- start 2024-05-30T06:48:21.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 -- start start 2024-05-30T06:48:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d2c0cf850 0x7f1d2c154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cff20 0x7f1d2c0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d2c15b780 0x7f1d2c0c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c0b27d0 con 0x7f1d2c0cff20 2024-05-30T06:48:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c0b2650 con 0x7f1d2c15b780 2024-05-30T06:48:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d33000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1d2c0b2950 con 0x7f1d2c0cf850 2024-05-30T06:48:21.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d31200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cff20 0x7f1d2c0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d31200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cff20 0x7f1d2c0c9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37544/0 (socket says 172.21.15.37:37544) 2024-05-30T06:48:21.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.023+0000 7f1d31200640 1 -- 172.21.15.37:0/3679124356 learned_addr learned my addr 172.21.15.37:0/3679124356 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:21.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d32600640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d2c15b780 0x7f1d2c0c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d31c00640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d2c0cf850 0x7f1d2c154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d31200640 1 -- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d2c0cf850 msgr2=0x7f1d2c154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d31200640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d2c0cf850 0x7f1d2c154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d31200640 1 -- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d2c15b780 msgr2=0x7f1d2c0c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d31200640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d2c15b780 0x7f1d2c0c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d31200640 1 -- 172.21.15.37:0/3679124356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c0c6310 con 0x7f1d2c0cff20 2024-05-30T06:48:21.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d31200640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cff20 0x7f1d2c0c9250 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800d800 tx=0x7f1d1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:21.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d29600640 1 -- 172.21.15.37:0/3679124356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d18018020 con 0x7f1d2c0cff20 2024-05-30T06:48:21.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d29600640 1 -- 172.21.15.37:0/3679124356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d180096c0 con 0x7f1d2c0cff20 2024-05-30T06:48:21.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d29600640 1 -- 172.21.15.37:0/3679124356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d18009ab0 con 0x7f1d2c0cff20 2024-05-30T06:48:21.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d33000640 1 -- 172.21.15.37:0/3679124356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2c0c65f0 con 0x7f1d2c0cff20 2024-05-30T06:48:21.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d33000640 1 -- 172.21.15.37:0/3679124356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2c0c6bb0 con 0x7f1d2c0cff20 2024-05-30T06:48:21.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d33000640 1 -- 172.21.15.37:0/3679124356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d2c068ab0 con 0x7f1d2c0cff20 2024-05-30T06:48:21.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.027+0000 7f1d29600640 1 -- 172.21.15.37:0/3679124356 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f1d1801b020 con 0x7f1d2c0cff20 2024-05-30T06:48:21.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.031+0000 7f1d29600640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d0c068bf0 0x7f1d0c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.031+0000 7f1d29600640 1 -- 172.21.15.37:0/3679124356 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7f1d18088160 con 0x7f1d2c0cff20 2024-05-30T06:48:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.031+0000 7f1d31c00640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d0c068bf0 0x7f1d0c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.031+0000 7f1d31c00640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d0c068bf0 0x7f1d0c06b0b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1d20000f70 tx=0x7f1d20007b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.035+0000 7f1d29600640 1 -- 172.21.15.37:0/3679124356 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1d18022020 con 0x7f1d2c0cff20 2024-05-30T06:48:21.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.195+0000 7f1d33000640 1 -- 172.21.15.37:0/3679124356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1d2c0b1750 con 0x7f1d2c0cff20 2024-05-30T06:48:21.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.199+0000 7f1d29600640 1 -- 172.21.15.37:0/3679124356 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) ==== 100+0+11 (secure 0 0 0) 0x7f1d18011340 con 0x7f1d2c0cff20 2024-05-30T06:48:21.197 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:48:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.199+0000 7f1d33000640 1 -- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d0c068bf0 msgr2=0x7f1d0c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.199+0000 7f1d33000640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d0c068bf0 0x7f1d0c06b0b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1d20000f70 tx=0x7f1d20007b80 comp rx=0 tx=0).stop 2024-05-30T06:48:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.199+0000 7f1d33000640 1 -- 172.21.15.37:0/3679124356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cff20 msgr2=0x7f1d2c0c9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.199+0000 7f1d33000640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cff20 0x7f1d2c0c9250 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800d800 tx=0x7f1d1800dcc0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.199+0000 7f1d33000640 1 -- 172.21.15.37:0/3679124356 shutdown_connections 2024-05-30T06:48:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.199+0000 7f1d33000640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1d0c068bf0 0x7f1d0c06b0b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.199+0000 7f1d33000640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1d2c15b780 0x7f1d2c0c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.199+0000 7f1d33000640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cff20 0x7f1d2c0c9250 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.199+0000 7f1d33000640 1 --2- 172.21.15.37:0/3679124356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1d2c0cf850 0x7f1d2c154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.199+0000 7f1d33000640 1 -- 172.21.15.37:0/3679124356 >> 172.21.15.37:0/3679124356 conn(0x7f1d2c09aa60 msgr2=0x7f1d2c156c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:21.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.199+0000 7f1d33000640 1 -- 172.21.15.37:0/3679124356 shutdown_connections 2024-05-30T06:48:21.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.199+0000 7f1d33000640 1 -- 172.21.15.37:0/3679124356 wait complete. 2024-05-30T06:48:21.219 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:48:21.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1aca00640 1 Processor -- start 2024-05-30T06:48:21.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1aca00640 1 -- start start 2024-05-30T06:48:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1aca00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1a80b55a0 0x7fb1a80b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1aca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1a806d080 0x7fb1a80b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1aca00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1a8162f70 con 0x7fb1a80b4d80 2024-05-30T06:48:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1aca00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb1a80b5ec0 con 0x7fb1a80b55a0 2024-05-30T06:48:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1aca00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a8163210 con 0x7fb1a806d080 2024-05-30T06:48:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1a5e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1a80b55a0 0x7fb1a80b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1a5e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1a80b55a0 0x7fb1a80b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37548/0 (socket says 172.21.15.37:37548) 2024-05-30T06:48:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1a5e00640 1 -- 172.21.15.37:0/2237701408 learned_addr learned my addr 172.21.15.37:0/2237701408 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb19fe00640 1 --2- 172.21.15.37:0/2237701408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1a806d080 0x7fb1a80b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1a5e00640 1 -- 172.21.15.37:0/2237701408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1a806d080 msgr2=0x7fb1a80b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1a5e00640 1 --2- 172.21.15.37:0/2237701408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1a806d080 0x7fb1a80b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1a5e00640 1 -- 172.21.15.37:0/2237701408 >> v1:172.21.15.105:6789/0 conn(0x7fb1a80b4d80 legacy=0x7fb1a80aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.371+0000 7fb1a5e00640 1 -- 172.21.15.37:0/2237701408 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a80b4040 con 0x7fb1a80b55a0 2024-05-30T06:48:21.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.375+0000 7fb1a5e00640 1 --2- 172.21.15.37:0/2237701408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a80b55a0 0x7fb1a80b5980 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb198009870 tx=0x7fb19801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf6594c58ebbbd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:21.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.375+0000 7fb1a5400640 1 -- 172.21.15.37:0/2237701408 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80b0850 con 0x7fb1a80b55a0 2024-05-30T06:48:21.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.375+0000 7fb1a5400640 1 -- 172.21.15.37:0/2237701408 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1980b0070 con 0x7fb1a80b55a0 2024-05-30T06:48:21.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.375+0000 7fb1a5400640 1 -- 172.21.15.37:0/2237701408 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1980ab860 con 0x7fb1a80b55a0 2024-05-30T06:48:21.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.375+0000 7fb1aca00640 1 -- 172.21.15.37:0/2237701408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a80b55a0 msgr2=0x7fb1a80b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.375+0000 7fb1aca00640 1 --2- 172.21.15.37:0/2237701408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a80b55a0 0x7fb1a80b5980 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb198009870 tx=0x7fb19801c460 comp rx=0 tx=0).stop 2024-05-30T06:48:21.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.375+0000 7fb1aca00640 1 -- 172.21.15.37:0/2237701408 shutdown_connections 2024-05-30T06:48:21.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.375+0000 7fb1aca00640 1 --2- 172.21.15.37:0/2237701408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1a806d080 0x7fb1a80b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.375+0000 7fb1aca00640 1 --2- 172.21.15.37:0/2237701408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a80b55a0 0x7fb1a80b5980 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.375+0000 7fb1aca00640 1 -- 172.21.15.37:0/2237701408 >> 172.21.15.37:0/2237701408 conn(0x7fb1a8073680 msgr2=0x7fb1a806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:21.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.375+0000 7fb1aca00640 1 -- 172.21.15.37:0/2237701408 shutdown_connections 2024-05-30T06:48:21.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.375+0000 7fb1aca00640 1 -- 172.21.15.37:0/2237701408 wait complete. 2024-05-30T06:48:21.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1aca00640 1 Processor -- start 2024-05-30T06:48:21.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1aca00640 1 -- start start 2024-05-30T06:48:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1aca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1a806d080 0x7fb1a81510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1aca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1a80b4d80 0x7fb1a8138480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1aca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a80b55a0 0x7fb1a8150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1aca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a8067af0 con 0x7fb1a80b55a0 2024-05-30T06:48:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1aca00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a8067970 con 0x7fb1a80b4d80 2024-05-30T06:48:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1aca00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a816be60 con 0x7fb1a806d080 2024-05-30T06:48:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1a6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a80b55a0 0x7fb1a8150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1a6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a80b55a0 0x7fb1a8150070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37564/0 (socket says 172.21.15.37:37564) 2024-05-30T06:48:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1a6800640 1 -- 172.21.15.37:0/2268732639 learned_addr learned my addr 172.21.15.37:0/2268732639 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1a5e00640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1a806d080 0x7fb1a81510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb19fe00640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1a80b4d80 0x7fb1a8138480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1a6800640 1 -- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1a806d080 msgr2=0x7fb1a81510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1a6800640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1a806d080 0x7fb1a81510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1a6800640 1 -- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1a80b4d80 msgr2=0x7fb1a8138480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1a6800640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1a80b4d80 0x7fb1a8138480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1a6800640 1 -- 172.21.15.37:0/2268732639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a8138ed0 con 0x7fb1a80b55a0 2024-05-30T06:48:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1a6800640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a80b55a0 0x7fb1a8150070 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000c780 tx=0x7fb1a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb19e000640 1 -- 172.21.15.37:0/2268732639 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0004b70 con 0x7fb1a80b55a0 2024-05-30T06:48:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb19e000640 1 -- 172.21.15.37:0/2268732639 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1a0004d10 con 0x7fb1a80b55a0 2024-05-30T06:48:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb19e000640 1 -- 172.21.15.37:0/2268732639 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a000aa90 con 0x7fb1a80b55a0 2024-05-30T06:48:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1aca00640 1 -- 172.21.15.37:0/2268732639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a81391b0 con 0x7fb1a80b55a0 2024-05-30T06:48:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.379+0000 7fb1aca00640 1 -- 172.21.15.37:0/2268732639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a814a960 con 0x7fb1a80b55a0 2024-05-30T06:48:21.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.383+0000 7fb1aca00640 1 -- 172.21.15.37:0/2268732639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a814ab60 con 0x7fb1a80b55a0 2024-05-30T06:48:21.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.383+0000 7fb19e000640 1 -- 172.21.15.37:0/2268732639 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fb1a000ac30 con 0x7fb1a80b55a0 2024-05-30T06:48:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.383+0000 7fb19e000640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb184068bf0 0x7fb18406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.383+0000 7fb19e000640 1 -- 172.21.15.37:0/2268732639 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7fb1a00854d0 con 0x7fb1a80b55a0 2024-05-30T06:48:21.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.383+0000 7fb1a5e00640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb184068bf0 0x7fb18406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.383+0000 7fb1a5e00640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb184068bf0 0x7fb18406b0b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb1980af000 tx=0x7fb1980a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:21.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.387+0000 7fb19e000640 1 -- 172.21.15.37:0/2268732639 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb1a814ab60 con 0x7fb1a80b55a0 2024-05-30T06:48:21.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.587+0000 7fb1aca00640 1 -- 172.21.15.37:0/2268732639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1a8068b20 con 0x7fb1a80b55a0 2024-05-30T06:48:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.587+0000 7fb19e000640 1 -- 172.21.15.37:0/2268732639 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5184 (secure 0 0 0) 0x7fb1a0020070 con 0x7fb1a80b55a0 2024-05-30T06:48:21.588 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:21.588 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/2692603987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2692603987},{"type":"v1","addr":"172.21.15.105:6836","nonce":2692603987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5539,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2559528007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2559528007},{"type":"v1","addr":"172.21.15.105:6837","nonce":2559528007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2198221961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2198221961},{"type":"v1","addr":"172.21.15.37:6833","nonce":2198221961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:45:45.908180+0000","modified":"2024-05-30T06:45:48.930208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5652":{"gid":5652,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/115371806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":115371806},{"type":"v1","addr":"172.21.15.37:6835","nonce":115371806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5652,"qdb_cluster":[5652]},"id":3}]} 2024-05-30T06:48:21.588 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-05-30T06:48:21.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.591+0000 7fb1aca00640 1 -- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb184068bf0 msgr2=0x7fb18406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.591+0000 7fb1aca00640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb184068bf0 0x7fb18406b0b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb1980af000 tx=0x7fb1980a7000 comp rx=0 tx=0).stop 2024-05-30T06:48:21.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.591+0000 7fb1aca00640 1 -- 172.21.15.37:0/2268732639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a80b55a0 msgr2=0x7fb1a8150070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.591+0000 7fb1aca00640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a80b55a0 0x7fb1a8150070 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000c780 tx=0x7fb1a000cc40 comp rx=0 tx=0).stop 2024-05-30T06:48:21.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.591+0000 7fb1aca00640 1 -- 172.21.15.37:0/2268732639 shutdown_connections 2024-05-30T06:48:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.591+0000 7fb1aca00640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1a80b55a0 0x7fb1a8150070 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.591+0000 7fb1aca00640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb184068bf0 0x7fb18406b0b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.591+0000 7fb1aca00640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1a80b4d80 0x7fb1a8138480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.591+0000 7fb1aca00640 1 --2- 172.21.15.37:0/2268732639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1a806d080 0x7fb1a81510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.591+0000 7fb1aca00640 1 -- 172.21.15.37:0/2268732639 >> 172.21.15.37:0/2268732639 conn(0x7fb1a8073680 msgr2=0x7fb1a8157b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.591+0000 7fb1aca00640 1 -- 172.21.15.37:0/2268732639 shutdown_connections 2024-05-30T06:48:21.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.591+0000 7fb1aca00640 1 -- 172.21.15.37:0/2268732639 wait complete. 2024-05-30T06:48:21.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:48:21.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.755+0000 7fd333e00640 1 Processor -- start 2024-05-30T06:48:21.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.755+0000 7fd333e00640 1 -- start start 2024-05-30T06:48:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.755+0000 7fd333e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd32c0c8fc0 0x7fd32c0d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.755+0000 7fd333e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd32c0c7f20 con 0x7fd32c15ed50 2024-05-30T06:48:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.755+0000 7fd333e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd32c0c8200 con 0x7fd32c09aa60 2024-05-30T06:48:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.755+0000 7fd333e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c15f130 con 0x7fd32c0c8fc0 2024-05-30T06:48:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.759+0000 7fd331400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd32c15ed50 0x7fd32c0d02b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50656/0 (socket says 172.21.15.37:50656) 2024-05-30T06:48:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.759+0000 7fd331400640 1 -- 172.21.15.37:0/64414145 learned_addr learned my addr 172.21.15.37:0/64414145 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.759+0000 7fd330a00640 1 --2- 172.21.15.37:0/64414145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd32c0c8fc0 0x7fd32c0d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.759+0000 7fd32be00640 1 -- 172.21.15.37:0/64414145 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475201032 0 0) 0x7fd32c0c7f20 con 0x7fd32c15ed50 2024-05-30T06:48:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.759+0000 7fd32be00640 1 -- 172.21.15.37:0/64414145 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd314003530 con 0x7fd32c15ed50 2024-05-30T06:48:21.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.759+0000 7fd32be00640 1 -- 172.21.15.37:0/64414145 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 531992398 0 0) 0x7fd32c0c8200 con 0x7fd32c09aa60 2024-05-30T06:48:21.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.759+0000 7fd32be00640 1 -- 172.21.15.37:0/64414145 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd32c0c7f20 con 0x7fd32c09aa60 2024-05-30T06:48:21.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.759+0000 7fd330a00640 1 -- 172.21.15.37:0/64414145 >> v1:172.21.15.105:6789/0 conn(0x7fd32c09aa60 legacy=0x7fd32c09aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.759+0000 7fd330a00640 1 -- 172.21.15.37:0/64414145 >> v1:172.21.15.37:6789/0 conn(0x7fd32c15ed50 legacy=0x7fd32c0d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.759+0000 7fd330a00640 1 -- 172.21.15.37:0/64414145 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c0c84e0 con 0x7fd32c0c8fc0 2024-05-30T06:48:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.759+0000 7fd330a00640 1 --2- 172.21.15.37:0/64414145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd32c0c8fc0 0x7fd32c0d09c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd3180097f0 tx=0x7fd31801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61ecb0136c864b2e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd32be00640 1 -- 172.21.15.37:0/64414145 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3180b1070 con 0x7fd32c0c8fc0 2024-05-30T06:48:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd32be00640 1 -- 172.21.15.37:0/64414145 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3180ac630 con 0x7fd32c0c8fc0 2024-05-30T06:48:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd32be00640 1 -- 172.21.15.37:0/64414145 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3180a8050 con 0x7fd32c0c8fc0 2024-05-30T06:48:21.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 -- 172.21.15.37:0/64414145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd32c0c8fc0 msgr2=0x7fd32c0d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 --2- 172.21.15.37:0/64414145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd32c0c8fc0 0x7fd32c0d09c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd3180097f0 tx=0x7fd31801c4e0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 -- 172.21.15.37:0/64414145 shutdown_connections 2024-05-30T06:48:21.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 --2- 172.21.15.37:0/64414145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd32c0c8fc0 0x7fd32c0d09c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 -- 172.21.15.37:0/64414145 >> 172.21.15.37:0/64414145 conn(0x7fd32c0d26e0 msgr2=0x7fd32c0d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:21.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 -- 172.21.15.37:0/64414145 shutdown_connections 2024-05-30T06:48:21.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 -- 172.21.15.37:0/64414145 wait complete. 2024-05-30T06:48:21.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 Processor -- start 2024-05-30T06:48:21.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 -- start start 2024-05-30T06:48:21.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd32c09aa60 0x7fd32c0a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd32c0c8fc0 0x7fd32c1616f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd32c15ed50 0x7fd32c14fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c0c7c50 con 0x7fd32c09aa60 2024-05-30T06:48:21.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c0c7ad0 con 0x7fd32c15ed50 2024-05-30T06:48:21.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd333e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd32c16cb30 con 0x7fd32c0c8fc0 2024-05-30T06:48:21.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd331400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd32c09aa60 0x7fd32c0a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd331400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd32c09aa60 0x7fd32c0a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37572/0 (socket says 172.21.15.37:37572) 2024-05-30T06:48:21.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd331400640 1 -- 172.21.15.37:0/2117836978 learned_addr learned my addr 172.21.15.37:0/2117836978 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.763+0000 7fd330a00640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd32c0c8fc0 0x7fd32c1616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd331e00640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd32c15ed50 0x7fd32c14fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd331400640 1 -- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd32c0c8fc0 msgr2=0x7fd32c1616f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd331400640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd32c0c8fc0 0x7fd32c1616f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd331400640 1 -- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd32c15ed50 msgr2=0x7fd32c14fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd331400640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd32c15ed50 0x7fd32c14fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd331400640 1 -- 172.21.15.37:0/2117836978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32c09c830 con 0x7fd32c09aa60 2024-05-30T06:48:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd331400640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd32c09aa60 0x7fd32c0a0170 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd32000c4d0 tx=0x7fd32000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd329600640 1 -- 172.21.15.37:0/2117836978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd320017070 con 0x7fd32c09aa60 2024-05-30T06:48:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd329600640 1 -- 172.21.15.37:0/2117836978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd320005cf0 con 0x7fd32c09aa60 2024-05-30T06:48:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd333e00640 1 -- 172.21.15.37:0/2117836978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd32c161c30 con 0x7fd32c09aa60 2024-05-30T06:48:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd329600640 1 -- 172.21.15.37:0/2117836978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3200072b0 con 0x7fd32c09aa60 2024-05-30T06:48:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd333e00640 1 -- 172.21.15.37:0/2117836978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd32c1621b0 con 0x7fd32c09aa60 2024-05-30T06:48:21.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd333e00640 1 -- 172.21.15.37:0/2117836978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd32c068b20 con 0x7fd32c09aa60 2024-05-30T06:48:21.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd329600640 1 -- 172.21.15.37:0/2117836978 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fd32001a070 con 0x7fd32c09aa60 2024-05-30T06:48:21.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd329600640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd30c068bf0 0x7fd30c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:21.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.767+0000 7fd329600640 1 -- 172.21.15.37:0/2117836978 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7fd320086fe0 con 0x7fd32c09aa60 2024-05-30T06:48:21.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.771+0000 7fd330a00640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd30c068bf0 0x7fd30c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:21.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.771+0000 7fd330a00640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd30c068bf0 0x7fd30c06b0b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd3180ae000 tx=0x7fd3180a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:21.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.771+0000 7fd329600640 1 -- 172.21.15.37:0/2117836978 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd320055f40 con 0x7fd32c09aa60 2024-05-30T06:48:21.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.939+0000 7fd333e00640 1 -- 172.21.15.37:0/2117836978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd32c0d3420 con 0x7fd32c09aa60 2024-05-30T06:48:21.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.939+0000 7fd329600640 1 -- 172.21.15.37:0/2117836978 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16800 (secure 0 0 0) 0x7fd32005a240 con 0x7fd32c09aa60 2024-05-30T06:48:21.940 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:21.940 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":49,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:48:16.811163+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:45:44.283575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T06:45:44.856243+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":4}]},{"pgid":"7.1b","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:48:21.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.943+0000 7fd333e00640 1 -- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd30c068bf0 msgr2=0x7fd30c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.943+0000 7fd333e00640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd30c068bf0 0x7fd30c06b0b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd3180ae000 tx=0x7fd3180a7000 comp rx=0 tx=0).stop 2024-05-30T06:48:21.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.943+0000 7fd333e00640 1 -- 172.21.15.37:0/2117836978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd32c09aa60 msgr2=0x7fd32c0a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:21.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.943+0000 7fd333e00640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd32c09aa60 0x7fd32c0a0170 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd32000c4d0 tx=0x7fd32000c990 comp rx=0 tx=0).stop 2024-05-30T06:48:21.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.943+0000 7fd333e00640 1 -- 172.21.15.37:0/2117836978 shutdown_connections 2024-05-30T06:48:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.943+0000 7fd333e00640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd30c068bf0 0x7fd30c06b0b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.943+0000 7fd333e00640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd32c15ed50 0x7fd32c14fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.943+0000 7fd333e00640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd32c0c8fc0 0x7fd32c1616f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.943+0000 7fd333e00640 1 --2- 172.21.15.37:0/2117836978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd32c09aa60 0x7fd32c0a0170 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.943+0000 7fd333e00640 1 -- 172.21.15.37:0/2117836978 >> 172.21.15.37:0/2117836978 conn(0x7fd32c0d26e0 msgr2=0x7fd32c156d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.943+0000 7fd333e00640 1 -- 172.21.15.37:0/2117836978 shutdown_connections 2024-05-30T06:48:21.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:21.943+0000 7fd333e00640 1 -- 172.21.15.37:0/2117836978 wait complete. 2024-05-30T06:48:21.961 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T06:48:21.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:48:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.103+0000 7f5ba2e00640 1 Processor -- start 2024-05-30T06:48:22.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.103+0000 7f5ba2e00640 1 -- start start 2024-05-30T06:48:22.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.107+0000 7f5ba2e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5b9c15ed50 0x7f5b9c0c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.107+0000 7f5ba2e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b9c0c7f20 con 0x7f5b9c09aa60 2024-05-30T06:48:22.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.107+0000 7f5ba2e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b9c0c8200 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.107+0000 7f5ba2e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5b9c0c9500 con 0x7f5b9c15ed50 2024-05-30T06:48:22.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.107+0000 7f5b9be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5b9c15ed50 0x7f5b9c0c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.107+0000 7f5ba0e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5b9c09aa60 0x7f5b9c09aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50662/0 (socket says 172.21.15.37:50662) 2024-05-30T06:48:22.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.107+0000 7f5ba0e00640 1 -- 172.21.15.37:0/913609774 learned_addr learned my addr 172.21.15.37:0/913609774 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:22.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.107+0000 7f5b9be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5b9c15ed50 0x7f5b9c0c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37578/0 (socket says 172.21.15.37:37578) 2024-05-30T06:48:22.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.107+0000 7f5b9be00640 1 -- 172.21.15.37:0/913609774 >> v1:172.21.15.105:6789/0 conn(0x7f5b9c0d02b0 legacy=0x7f5b9c0d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.107+0000 7f5b9be00640 1 -- 172.21.15.37:0/913609774 >> v1:172.21.15.37:6789/0 conn(0x7f5b9c09aa60 legacy=0x7f5b9c09aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.107+0000 7f5b9be00640 1 -- 172.21.15.37:0/913609774 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c0c84e0 con 0x7f5b9c15ed50 2024-05-30T06:48:22.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.107+0000 7f5b9b400640 1 -- 172.21.15.37:0/913609774 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 694843359 0 0) 0x7f5b9c0c7f20 con 0x7f5b9c09aa60 2024-05-30T06:48:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.107+0000 7f5b9be00640 1 --2- 172.21.15.37:0/913609774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9c15ed50 0x7f5b9c0c8fc0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0097c0 tx=0x7f5b8c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303b4debca04fefe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5b9b400640 1 -- 172.21.15.37:0/913609774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c0b1070 con 0x7f5b9c15ed50 2024-05-30T06:48:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5b9b400640 1 -- 172.21.15.37:0/913609774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b8c0ac5f0 con 0x7f5b9c15ed50 2024-05-30T06:48:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5b9b400640 1 -- 172.21.15.37:0/913609774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c0ac9c0 con 0x7f5b9c15ed50 2024-05-30T06:48:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 -- 172.21.15.37:0/913609774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9c15ed50 msgr2=0x7f5b9c0c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 --2- 172.21.15.37:0/913609774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9c15ed50 0x7f5b9c0c8fc0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0097c0 tx=0x7f5b8c01c4a0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 -- 172.21.15.37:0/913609774 shutdown_connections 2024-05-30T06:48:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 --2- 172.21.15.37:0/913609774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9c15ed50 0x7f5b9c0c8fc0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 -- 172.21.15.37:0/913609774 >> 172.21.15.37:0/913609774 conn(0x7f5b9c0d26e0 msgr2=0x7f5b9c0d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 -- 172.21.15.37:0/913609774 shutdown_connections 2024-05-30T06:48:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 -- 172.21.15.37:0/913609774 wait complete. 2024-05-30T06:48:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 Processor -- start 2024-05-30T06:48:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 -- start start 2024-05-30T06:48:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b9c09aa60 0x7f5b9c14fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9c0d02b0 0x7f5b9c155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b9c15ed50 0x7f5b9c09fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c0c7c50 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c0c7ad0 con 0x7f5b9c15ed50 2024-05-30T06:48:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba2e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5b9c16cb30 con 0x7f5b9c09aa60 2024-05-30T06:48:22.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5b93e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9c0d02b0 0x7f5b9c155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5b93e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9c0d02b0 0x7f5b9c155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37582/0 (socket says 172.21.15.37:37582) 2024-05-30T06:48:22.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5b93e00640 1 -- 172.21.15.37:0/1811088060 learned_addr learned my addr 172.21.15.37:0/1811088060 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:22.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5b9be00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b9c09aa60 0x7f5b9c14fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.111+0000 7f5ba0e00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b9c15ed50 0x7f5b9c09fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5b93e00640 1 -- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b9c09aa60 msgr2=0x7f5b9c14fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5b93e00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b9c09aa60 0x7f5b9c14fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5b93e00640 1 -- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b9c15ed50 msgr2=0x7f5b9c09fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5b93e00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b9c15ed50 0x7f5b9c09fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5b93e00640 1 -- 172.21.15.37:0/1811088060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c15f7e0 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5b9be00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b9c09aa60 0x7f5b9c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5b93e00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9c0d02b0 0x7f5b9c155cf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400c3f0 tx=0x7f5b8400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5b98c00640 1 -- 172.21.15.37:0/1811088060 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84017070 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5b98c00640 1 -- 172.21.15.37:0/1811088060 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b840052d0 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5b98c00640 1 -- 172.21.15.37:0/1811088060 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84003840 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5ba2e00640 1 -- 172.21.15.37:0/1811088060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9c15fac0 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5ba2e00640 1 -- 172.21.15.37:0/1811088060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9c160080 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5ba2e00640 1 -- 172.21.15.37:0/1811088060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b9c068b20 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5b98c00640 1 -- 172.21.15.37:0/1811088060 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f5b8401a070 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5b98c00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5b78068bf0 0x7f5b7806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.115+0000 7f5b98c00640 1 -- 172.21.15.37:0/1811088060 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7f5b84086ef0 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.119+0000 7f5b9be00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5b78068bf0 0x7f5b7806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.119+0000 7f5b9be00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5b78068bf0 0x7f5b7806b0b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0ae000 tx=0x7f5b8c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:22.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.119+0000 7f5b98c00640 1 -- 172.21.15.37:0/1811088060 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5b84005480 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.323+0000 7f5ba2e00640 1 -- 172.21.15.37:0/1811088060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b9c0d3420 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.323+0000 7f5b98c00640 1 -- 172.21.15.37:0/1811088060 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5184 (secure 0 0 0) 0x7f5b84055ed0 con 0x7f5b9c0d02b0 2024-05-30T06:48:22.323 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:22.323 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/2692603987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2692603987},{"type":"v1","addr":"172.21.15.105:6836","nonce":2692603987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5539,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2559528007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2559528007},{"type":"v1","addr":"172.21.15.105:6837","nonce":2559528007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2198221961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2198221961},{"type":"v1","addr":"172.21.15.37:6833","nonce":2198221961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:45:45.908180+0000","modified":"2024-05-30T06:45:48.930208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5652":{"gid":5652,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/115371806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":115371806},{"type":"v1","addr":"172.21.15.37:6835","nonce":115371806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5652,"qdb_cluster":[5652]},"id":3}]} 2024-05-30T06:48:22.324 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-05-30T06:48:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.327+0000 7f5ba2e00640 1 -- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5b78068bf0 msgr2=0x7f5b7806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.327+0000 7f5ba2e00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5b78068bf0 0x7f5b7806b0b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0ae000 tx=0x7f5b8c0a7000 comp rx=0 tx=0).stop 2024-05-30T06:48:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.327+0000 7f5ba2e00640 1 -- 172.21.15.37:0/1811088060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9c0d02b0 msgr2=0x7f5b9c155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.327+0000 7f5ba2e00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9c0d02b0 0x7f5b9c155cf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400c3f0 tx=0x7f5b8400c8b0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.327+0000 7f5ba2e00640 1 -- 172.21.15.37:0/1811088060 shutdown_connections 2024-05-30T06:48:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.327+0000 7f5ba2e00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5b78068bf0 0x7f5b7806b0b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.327+0000 7f5ba2e00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b9c15ed50 0x7f5b9c09fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.327+0000 7f5ba2e00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9c0d02b0 0x7f5b9c155cf0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.327+0000 7f5ba2e00640 1 --2- 172.21.15.37:0/1811088060 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b9c09aa60 0x7f5b9c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.327+0000 7f5ba2e00640 1 -- 172.21.15.37:0/1811088060 >> 172.21.15.37:0/1811088060 conn(0x7f5b9c0d26e0 msgr2=0x7f5b9c0d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.327+0000 7f5ba2e00640 1 -- 172.21.15.37:0/1811088060 shutdown_connections 2024-05-30T06:48:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.327+0000 7f5ba2e00640 1 -- 172.21.15.37:0/1811088060 wait complete. 2024-05-30T06:48:22.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:48:22.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.487+0000 7f0e2fe00640 1 Processor -- start 2024-05-30T06:48:22.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.487+0000 7f0e2fe00640 1 -- start start 2024-05-30T06:48:22.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e2fe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0e301415c0 0x7f0e300b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e300b48d0 0x7f0e30071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e2fe00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e30162560 con 0x7f0e300aea50 2024-05-30T06:48:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e2fe00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0e30163170 con 0x7f0e301415c0 2024-05-30T06:48:22.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e2fe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e30162840 con 0x7f0e300b48d0 2024-05-30T06:48:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e26000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e300b48d0 0x7f0e30071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e2f400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f0e300aea50 0x7f0e30143eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:34678/0 (socket says 172.21.15.37:34678) 2024-05-30T06:48:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e2ea00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0e301415c0 0x7f0e300b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e2f400640 1 -- 172.21.15.37:0/951602900 learned_addr learned my addr 172.21.15.37:0/951602900 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e26000640 1 -- 172.21.15.37:0/951602900 >> v2:172.21.15.105:3300/0 conn(0x7f0e301415c0 msgr2=0x7f0e300b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e26000640 1 --2- 172.21.15.37:0/951602900 >> v2:172.21.15.105:3300/0 conn(0x7f0e301415c0 0x7f0e300b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e26000640 1 -- 172.21.15.37:0/951602900 >> v1:172.21.15.105:6789/0 conn(0x7f0e300aea50 legacy=0x7f0e30143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e26000640 1 -- 172.21.15.37:0/951602900 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e30162b20 con 0x7f0e300b48d0 2024-05-30T06:48:22.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.491+0000 7f0e2e000640 1 -- 172.21.15.37:0/951602900 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 435670992 0 0) 0x7f0e30162560 con 0x7f0e300aea50 2024-05-30T06:48:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e26000640 1 --2- 172.21.15.37:0/951602900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e300b48d0 0x7f0e30071e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0e180097c0 tx=0x7f0e1801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ded00dccdf37594c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2e000640 1 -- 172.21.15.37:0/951602900 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e180b0070 con 0x7f0e300b48d0 2024-05-30T06:48:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2e000640 1 -- 172.21.15.37:0/951602900 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e180ab600 con 0x7f0e300b48d0 2024-05-30T06:48:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2e000640 1 -- 172.21.15.37:0/951602900 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e180ab9d0 con 0x7f0e300b48d0 2024-05-30T06:48:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 -- 172.21.15.37:0/951602900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e300b48d0 msgr2=0x7f0e30071e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 --2- 172.21.15.37:0/951602900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e300b48d0 0x7f0e30071e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0e180097c0 tx=0x7f0e1801c3e0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 -- 172.21.15.37:0/951602900 shutdown_connections 2024-05-30T06:48:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 --2- 172.21.15.37:0/951602900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e300b48d0 0x7f0e30071e00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 --2- 172.21.15.37:0/951602900 >> v2:172.21.15.105:3300/0 conn(0x7f0e301415c0 0x7f0e300b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 -- 172.21.15.37:0/951602900 >> 172.21.15.37:0/951602900 conn(0x7f0e300b2120 msgr2=0x7f0e300b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 -- 172.21.15.37:0/951602900 shutdown_connections 2024-05-30T06:48:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 -- 172.21.15.37:0/951602900 wait complete. 2024-05-30T06:48:22.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 Processor -- start 2024-05-30T06:48:22.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 -- start start 2024-05-30T06:48:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e300aea50 0x7f0e30161a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b48d0 0x7f0e30128400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e301415c0 0x7f0e3013a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3016b8e0 con 0x7f0e300b48d0 2024-05-30T06:48:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3016b760 con 0x7f0e301415c0 2024-05-30T06:48:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e2fe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e3016ba60 con 0x7f0e300aea50 2024-05-30T06:48:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.495+0000 7f0e26000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b48d0 0x7f0e30128400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e26000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b48d0 0x7f0e30128400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37598/0 (socket says 172.21.15.37:37598) 2024-05-30T06:48:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e26000640 1 -- 172.21.15.37:0/692769751 learned_addr learned my addr 172.21.15.37:0/692769751 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e2ea00640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e300aea50 0x7f0e30161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e2f400640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e301415c0 0x7f0e3013a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e26000640 1 -- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e300aea50 msgr2=0x7f0e30161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e26000640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e300aea50 0x7f0e30161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e26000640 1 -- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e301415c0 msgr2=0x7f0e3013a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e26000640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e301415c0 0x7f0e3013a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e26000640 1 -- 172.21.15.37:0/692769751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e30146610 con 0x7f0e300b48d0 2024-05-30T06:48:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e2ea00640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e300aea50 0x7f0e30161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e26000640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b48d0 0x7f0e30128400 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0e1801a010 tx=0x7f0e18019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e27400640 1 -- 172.21.15.37:0/692769751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e180b8020 con 0x7f0e300b48d0 2024-05-30T06:48:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e27400640 1 -- 172.21.15.37:0/692769751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e180b4410 con 0x7f0e300b48d0 2024-05-30T06:48:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e27400640 1 -- 172.21.15.37:0/692769751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e180b0040 con 0x7f0e300b48d0 2024-05-30T06:48:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e2fe00640 1 -- 172.21.15.37:0/692769751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e301468f0 con 0x7f0e300b48d0 2024-05-30T06:48:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e2fe00640 1 -- 172.21.15.37:0/692769751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e30146eb0 con 0x7f0e300b48d0 2024-05-30T06:48:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e2fe00640 1 -- 172.21.15.37:0/692769751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e30068ab0 con 0x7f0e300b48d0 2024-05-30T06:48:22.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.499+0000 7f0e27400640 1 -- 172.21.15.37:0/692769751 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f0e180bb020 con 0x7f0e300b48d0 2024-05-30T06:48:22.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.503+0000 7f0e27400640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c068bf0 0x7f0e0c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.503+0000 7f0e27400640 1 -- 172.21.15.37:0/692769751 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7f0e18121330 con 0x7f0e300b48d0 2024-05-30T06:48:22.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.503+0000 7f0e2ea00640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c068bf0 0x7f0e0c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.503+0000 7f0e2ea00640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c068bf0 0x7f0e0c06b0b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009fd0 tx=0x7f0e2000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:22.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.507+0000 7f0e27400640 1 -- 172.21.15.37:0/692769751 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e180c2030 con 0x7f0e300b48d0 2024-05-30T06:48:22.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.703+0000 7f0e2fe00640 1 -- 172.21.15.37:0/692769751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e300add70 con 0x7f0e300b48d0 2024-05-30T06:48:22.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.703+0000 7f0e27400640 1 -- 172.21.15.37:0/692769751 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5184 (secure 0 0 0) 0x7f0e18016090 con 0x7f0e300b48d0 2024-05-30T06:48:22.703 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:22.703 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/2692603987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2692603987},{"type":"v1","addr":"172.21.15.105:6836","nonce":2692603987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5539,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2559528007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2559528007},{"type":"v1","addr":"172.21.15.105:6837","nonce":2559528007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2198221961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2198221961},{"type":"v1","addr":"172.21.15.37:6833","nonce":2198221961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:45:45.908180+0000","modified":"2024-05-30T06:45:48.930208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5652},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5652":{"gid":5652,"name":"c","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/115371806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":115371806},{"type":"v1","addr":"172.21.15.37:6835","nonce":115371806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5652,"qdb_cluster":[5652]},"id":3}]} 2024-05-30T06:48:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-05-30T06:48:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.707+0000 7f0e2fe00640 1 -- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c068bf0 msgr2=0x7f0e0c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.707+0000 7f0e2fe00640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c068bf0 0x7f0e0c06b0b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009fd0 tx=0x7f0e2000b040 comp rx=0 tx=0).stop 2024-05-30T06:48:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.707+0000 7f0e2fe00640 1 -- 172.21.15.37:0/692769751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b48d0 msgr2=0x7f0e30128400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.707+0000 7f0e2fe00640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b48d0 0x7f0e30128400 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0e1801a010 tx=0x7f0e18019180 comp rx=0 tx=0).stop 2024-05-30T06:48:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.707+0000 7f0e2fe00640 1 -- 172.21.15.37:0/692769751 shutdown_connections 2024-05-30T06:48:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.707+0000 7f0e2fe00640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c068bf0 0x7f0e0c06b0b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.707+0000 7f0e2fe00640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e301415c0 0x7f0e3013a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.707+0000 7f0e2fe00640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b48d0 0x7f0e30128400 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.707+0000 7f0e2fe00640 1 --2- 172.21.15.37:0/692769751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e300aea50 0x7f0e30161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.707+0000 7f0e2fe00640 1 -- 172.21.15.37:0/692769751 >> 172.21.15.37:0/692769751 conn(0x7f0e300b2120 msgr2=0x7f0e30074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.707+0000 7f0e2fe00640 1 -- 172.21.15.37:0/692769751 shutdown_connections 2024-05-30T06:48:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.707+0000 7f0e2fe00640 1 -- 172.21.15.37:0/692769751 wait complete. 2024-05-30T06:48:22.725 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:48:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.867+0000 7f2875e00640 1 Processor -- start 2024-05-30T06:48:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.867+0000 7f2875e00640 1 -- start start 2024-05-30T06:48:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f2875e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f28700b45d0 0x7f2870070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f2875e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f287006b960 0x7f287006be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f2875e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28700b6030 con 0x7f2870147790 2024-05-30T06:48:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f2875e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f28700b6890 con 0x7f28700b45d0 2024-05-30T06:48:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f2875e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f28700b62d0 con 0x7f287006b960 2024-05-30T06:48:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286ea00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2870147790 0x7f28700ae520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50664/0 (socket says 172.21.15.37:50664) 2024-05-30T06:48:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286ea00640 1 -- 172.21.15.37:0/194564172 learned_addr learned my addr 172.21.15.37:0/194564172 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286f400640 1 --2- 172.21.15.37:0/194564172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f287006b960 0x7f287006be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f2867e00640 1 --2- 172.21.15.37:0/194564172 >> v2:172.21.15.105:3300/0 conn(0x7f28700b45d0 0x7f2870070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1947196645 0 0) 0x7f28700b6030 con 0x7f2870147790 2024-05-30T06:48:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2854003530 con 0x7f2870147790 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2919250545 0 0) 0x7f2854003530 con 0x7f2870147790 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f287006b960 msgr2=0x7f287006be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 --2- 172.21.15.37:0/194564172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f287006b960 0x7f287006be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 >> v2:172.21.15.105:3300/0 conn(0x7f28700b45d0 msgr2=0x7f2870070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 --2- 172.21.15.37:0/194564172 >> v2:172.21.15.105:3300/0 conn(0x7f28700b45d0 0x7f2870070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28700b65b0 con 0x7f2870147790 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f2860001680 con 0x7f2870147790 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 >> v1:172.21.15.37:6789/0 conn(0x7f2870147790 legacy=0x7f28700ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 --2- 172.21.15.37:0/194564172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28540039c0 0x7f2854003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 --2- 172.21.15.37:0/194564172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f287006b960 0x7f2854004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 --2- 172.21.15.37:0/194564172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2854004d50 0x7f28540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f28700b6890 con 0x7f28540039c0 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28700b62d0 con 0x7f2854004d50 2024-05-30T06:48:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f285400b9d0 con 0x7f287006b960 2024-05-30T06:48:22.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286ea00640 1 --2- 172.21.15.37:0/194564172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28540039c0 0x7f2854003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f2867e00640 1 --2- 172.21.15.37:0/194564172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f287006b960 0x7f2854004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286f400640 1 --2- 172.21.15.37:0/194564172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2854004d50 0x7f28540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286ea00640 1 -- 172.21.15.37:0/194564172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f287006b960 msgr2=0x7f2854004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:22.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286ea00640 1 --2- 172.21.15.37:0/194564172 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f287006b960 0x7f2854004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286ea00640 1 -- 172.21.15.37:0/194564172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2854004d50 msgr2=0x7f28540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:22.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286ea00640 1 --2- 172.21.15.37:0/194564172 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2854004d50 0x7f28540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.871+0000 7f286ea00640 1 -- 172.21.15.37:0/194564172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2854003530 con 0x7f28540039c0 2024-05-30T06:48:22.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.875+0000 7f286ea00640 1 --2- 172.21.15.37:0/194564172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28540039c0 0x7f2854003e00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f286000c2c0 tx=0x7f286001cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5ebe7f18e1d354 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:22.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.875+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860007d60 con 0x7f28540039c0 2024-05-30T06:48:22.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.875+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28600a9020 con 0x7f28540039c0 2024-05-30T06:48:22.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.875+0000 7f286e000640 1 -- 172.21.15.37:0/194564172 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860005ae0 con 0x7f28540039c0 2024-05-30T06:48:22.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.875+0000 7f2875e00640 1 -- 172.21.15.37:0/194564172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28540039c0 msgr2=0x7f2854003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.875+0000 7f2875e00640 1 --2- 172.21.15.37:0/194564172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28540039c0 0x7f2854003e00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f286000c2c0 tx=0x7f286001cd10 comp rx=0 tx=0).stop 2024-05-30T06:48:22.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.875+0000 7f286f400640 1 -- 172.21.15.37:0/194564172 reap_dead start 2024-05-30T06:48:22.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.875+0000 7f2875e00640 1 -- 172.21.15.37:0/194564172 shutdown_connections 2024-05-30T06:48:22.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.875+0000 7f2875e00640 1 -- 172.21.15.37:0/194564172 >> 172.21.15.37:0/194564172 conn(0x7f28700b6a60 msgr2=0x7f28700b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:22.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.875+0000 7f2875e00640 1 -- 172.21.15.37:0/194564172 shutdown_connections 2024-05-30T06:48:22.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.875+0000 7f2875e00640 1 -- 172.21.15.37:0/194564172 wait complete. 2024-05-30T06:48:22.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2875e00640 1 Processor -- start 2024-05-30T06:48:22.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2875e00640 1 -- start start 2024-05-30T06:48:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2875e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28540039c0 0x7f28701fa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2875e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28701f7c60 0x7f28700b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2875e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b39a0 0x7f287013e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2875e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2870070130 con 0x7f28700b39a0 2024-05-30T06:48:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2875e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f287006ffb0 con 0x7f28701f7c60 2024-05-30T06:48:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2875e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f28700702b0 con 0x7f28540039c0 2024-05-30T06:48:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f286f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b39a0 0x7f287013e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f286ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28540039c0 0x7f28701fa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f286f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b39a0 0x7f287013e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37610/0 (socket says 172.21.15.37:37610) 2024-05-30T06:48:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f286f400640 1 -- 172.21.15.37:0/249246712 learned_addr learned my addr 172.21.15.37:0/249246712 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:22.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2867e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28701f7c60 0x7f28700b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f286ea00640 1 -- 172.21.15.37:0/249246712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28701f7c60 msgr2=0x7f28700b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f286ea00640 1 --2- 172.21.15.37:0/249246712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28701f7c60 0x7f28700b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f286ea00640 1 -- 172.21.15.37:0/249246712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b39a0 msgr2=0x7f287013e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:22.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f286ea00640 1 --2- 172.21.15.37:0/249246712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b39a0 0x7f287013e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:22.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f286ea00640 1 -- 172.21.15.37:0/249246712 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2870167360 con 0x7f28540039c0 2024-05-30T06:48:22.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f286f400640 1 --2- 172.21.15.37:0/249246712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b39a0 0x7f287013e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:22.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f286ea00640 1 --2- 172.21.15.37:0/249246712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28540039c0 0x7f28701fa910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2860009000 tx=0x7f2854005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:22.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2867400640 1 -- 172.21.15.37:0/249246712 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2860001c90 con 0x7f28540039c0 2024-05-30T06:48:22.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2867400640 1 -- 172.21.15.37:0/249246712 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28600a5a80 con 0x7f28540039c0 2024-05-30T06:48:22.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2875e00640 1 -- 172.21.15.37:0/249246712 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28701fb3e0 con 0x7f28540039c0 2024-05-30T06:48:22.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2867400640 1 -- 172.21.15.37:0/249246712 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28600a5e30 con 0x7f28540039c0 2024-05-30T06:48:22.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2875e00640 1 -- 172.21.15.37:0/249246712 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f28701fb9a0 con 0x7f28540039c0 2024-05-30T06:48:22.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.879+0000 7f2875e00640 1 -- 172.21.15.37:0/249246712 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f287006da00 con 0x7f28540039c0 2024-05-30T06:48:22.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.883+0000 7f2867400640 1 -- 172.21.15.37:0/249246712 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f28600047f0 con 0x7f28540039c0 2024-05-30T06:48:22.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.883+0000 7f2867400640 1 --2- 172.21.15.37:0/249246712 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f284c068bf0 0x7f284c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:22.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.883+0000 7f2867400640 1 -- 172.21.15.37:0/249246712 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7f28601212c0 con 0x7f28540039c0 2024-05-30T06:48:22.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.883+0000 7f2867e00640 1 --2- 172.21.15.37:0/249246712 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f284c068bf0 0x7f284c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:22.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.883+0000 7f2867e00640 1 --2- 172.21.15.37:0/249246712 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f284c068bf0 0x7f284c06b0b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f287013d060 tx=0x7f2858009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:22.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:22.887+0000 7f2867400640 1 -- 172.21.15.37:0/249246712 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2860016a50 con 0x7f28540039c0 2024-05-30T06:48:23.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.051+0000 7f2875e00640 1 -- 172.21.15.37:0/249246712 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2870068b20 con 0x7f28540039c0 2024-05-30T06:48:23.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.055+0000 7f2867400640 1 -- 172.21.15.37:0/249246712 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16800 (secure 0 0 0) 0x7f28600f0d90 con 0x7f28540039c0 2024-05-30T06:48:23.053 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:23.053 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":49,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:48:16.811163+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:45:44.283575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-05-30T06:45:44.856243+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":4}]},{"pgid":"7.1b","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:48:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.055+0000 7f2875e00640 1 -- 172.21.15.37:0/249246712 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f284c068bf0 msgr2=0x7f284c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.055+0000 7f2875e00640 1 --2- 172.21.15.37:0/249246712 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f284c068bf0 0x7f284c06b0b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f287013d060 tx=0x7f2858009190 comp rx=0 tx=0).stop 2024-05-30T06:48:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.055+0000 7f2875e00640 1 -- 172.21.15.37:0/249246712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28540039c0 msgr2=0x7f28701fa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.055+0000 7f2875e00640 1 --2- 172.21.15.37:0/249246712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28540039c0 0x7f28701fa910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2860009000 tx=0x7f2854005840 comp rx=0 tx=0).stop 2024-05-30T06:48:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.055+0000 7f2875e00640 1 -- 172.21.15.37:0/249246712 shutdown_connections 2024-05-30T06:48:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.055+0000 7f2875e00640 1 --2- 172.21.15.37:0/249246712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b39a0 0x7f287013e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.055+0000 7f2875e00640 1 --2- 172.21.15.37:0/249246712 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f284c068bf0 0x7f284c06b0b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.055+0000 7f2875e00640 1 --2- 172.21.15.37:0/249246712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28701f7c60 0x7f28700b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.055+0000 7f2875e00640 1 --2- 172.21.15.37:0/249246712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28540039c0 0x7f28701fa910 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.055+0000 7f2875e00640 1 -- 172.21.15.37:0/249246712 >> 172.21.15.37:0/249246712 conn(0x7f28700b6a60 msgr2=0x7f28700aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.055+0000 7f2875e00640 1 -- 172.21.15.37:0/249246712 shutdown_connections 2024-05-30T06:48:23.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.055+0000 7f2875e00640 1 -- 172.21.15.37:0/249246712 wait complete. 2024-05-30T06:48:23.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T06:48:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.215+0000 7f2a11200640 1 Processor -- start 2024-05-30T06:48:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.215+0000 7f2a11200640 1 -- start start 2024-05-30T06:48:23.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.219+0000 7f2a11200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2a0c1624a0 0x7f2a0c06b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:23.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.219+0000 7f2a11200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a0c06bea0 0x7f2a0c0b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:23.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.219+0000 7f2a11200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a0c0b6130 con 0x7f2a0c158e00 2024-05-30T06:48:23.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.219+0000 7f2a11200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0c06c310 con 0x7f2a0c06bea0 2024-05-30T06:48:23.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.219+0000 7f2a11200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0c0b4790 con 0x7f2a0c1624a0 2024-05-30T06:48:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.219+0000 7f2a09e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2a0c158e00 0x7f2a0c0b5a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50678/0 (socket says 172.21.15.37:50678) 2024-05-30T06:48:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.219+0000 7f2a0a800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a0c06bea0 0x7f2a0c0b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:23.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.219+0000 7f2a09e00640 1 -- 172.21.15.37:0/2728148200 learned_addr learned my addr 172.21.15.37:0/2728148200 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:23.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.219+0000 7f2a03e00640 1 --2- 172.21.15.37:0/2728148200 >> v2:172.21.15.105:3300/0 conn(0x7f2a0c1624a0 0x7f2a0c06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:23.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.219+0000 7f2a0a800640 1 -- 172.21.15.37:0/2728148200 >> v2:172.21.15.105:3300/0 conn(0x7f2a0c1624a0 msgr2=0x7f2a0c06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:23.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.219+0000 7f2a0a800640 1 --2- 172.21.15.37:0/2728148200 >> v2:172.21.15.105:3300/0 conn(0x7f2a0c1624a0 0x7f2a0c06b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.219+0000 7f2a0a800640 1 -- 172.21.15.37:0/2728148200 >> v1:172.21.15.37:6789/0 conn(0x7f2a0c158e00 legacy=0x7f2a0c0b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:23.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.219+0000 7f2a0a800640 1 -- 172.21.15.37:0/2728148200 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c071410 con 0x7f2a0c06bea0 2024-05-30T06:48:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a0a800640 1 --2- 172.21.15.37:0/2728148200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a0c06bea0 0x7f2a0c0b4c20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c070150 tx=0x7f2a0401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99143cf49b0d24bd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:23.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a09400640 1 -- 172.21.15.37:0/2728148200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a040b2070 con 0x7f2a0c06bea0 2024-05-30T06:48:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a09400640 1 -- 172.21.15.37:0/2728148200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a040a58d0 con 0x7f2a0c06bea0 2024-05-30T06:48:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a09400640 1 -- 172.21.15.37:0/2728148200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a040a5ca0 con 0x7f2a0c06bea0 2024-05-30T06:48:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a11200640 1 -- 172.21.15.37:0/2728148200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a0c06bea0 msgr2=0x7f2a0c0b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a11200640 1 --2- 172.21.15.37:0/2728148200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a0c06bea0 0x7f2a0c0b4c20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c070150 tx=0x7f2a0401c900 comp rx=0 tx=0).stop 2024-05-30T06:48:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a11200640 1 -- 172.21.15.37:0/2728148200 shutdown_connections 2024-05-30T06:48:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a11200640 1 --2- 172.21.15.37:0/2728148200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a0c06bea0 0x7f2a0c0b4c20 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a11200640 1 --2- 172.21.15.37:0/2728148200 >> v2:172.21.15.105:3300/0 conn(0x7f2a0c1624a0 0x7f2a0c06b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a11200640 1 -- 172.21.15.37:0/2728148200 >> 172.21.15.37:0/2728148200 conn(0x7f2a0c06f110 msgr2=0x7f2a0c06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a11200640 1 -- 172.21.15.37:0/2728148200 shutdown_connections 2024-05-30T06:48:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a11200640 1 -- 172.21.15.37:0/2728148200 wait complete. 2024-05-30T06:48:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a11200640 1 Processor -- start 2024-05-30T06:48:23.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.223+0000 7f2a11200640 1 -- start start 2024-05-30T06:48:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a11200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a0c06bea0 0x7f2a0c161970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a11200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a0c158e00 0x7f2a0c159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a11200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a0c1624a0 0x7f2a0c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a11200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c0b5570 con 0x7f2a0c158e00 2024-05-30T06:48:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a11200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c163220 con 0x7f2a0c1624a0 2024-05-30T06:48:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a11200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0c1591e0 con 0x7f2a0c06bea0 2024-05-30T06:48:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a03e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a0c158e00 0x7f2a0c159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a03e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a0c158e00 0x7f2a0c159e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37632/0 (socket says 172.21.15.37:37632) 2024-05-30T06:48:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a03e00640 1 -- 172.21.15.37:0/3413502752 learned_addr learned my addr 172.21.15.37:0/3413502752 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a0a800640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a0c1624a0 0x7f2a0c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a09e00640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a0c06bea0 0x7f2a0c161970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a03e00640 1 -- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a0c06bea0 msgr2=0x7f2a0c161970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a03e00640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a0c06bea0 0x7f2a0c161970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a03e00640 1 -- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a0c1624a0 msgr2=0x7f2a0c15a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a03e00640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a0c1624a0 0x7f2a0c15a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a03e00640 1 -- 172.21.15.37:0/3413502752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c160a70 con 0x7f2a0c158e00 2024-05-30T06:48:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a03e00640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a0c158e00 0x7f2a0c159e60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f29f400d5f0 tx=0x7f29f400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a02000640 1 -- 172.21.15.37:0/3413502752 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f40125f0 con 0x7f2a0c158e00 2024-05-30T06:48:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a02000640 1 -- 172.21.15.37:0/3413502752 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f4019070 con 0x7f2a0c158e00 2024-05-30T06:48:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a02000640 1 -- 172.21.15.37:0/3413502752 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f40129b0 con 0x7f2a0c158e00 2024-05-30T06:48:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a11200640 1 -- 172.21.15.37:0/3413502752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0c160d50 con 0x7f2a0c158e00 2024-05-30T06:48:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a11200640 1 -- 172.21.15.37:0/3413502752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0c159660 con 0x7f2a0c158e00 2024-05-30T06:48:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a11200640 1 -- 172.21.15.37:0/3413502752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a0c068bc0 con 0x7f2a0c158e00 2024-05-30T06:48:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.227+0000 7f2a02000640 1 -- 172.21.15.37:0/3413502752 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f29f4012b50 con 0x7f2a0c158e00 2024-05-30T06:48:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.231+0000 7f2a02000640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29e8068bf0 0x7f29e806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.231+0000 7f2a02000640 1 -- 172.21.15.37:0/3413502752 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5823+0+0 (secure 0 0 0) 0x7f29f4087e50 con 0x7f2a0c158e00 2024-05-30T06:48:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.231+0000 7f2a09e00640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29e8068bf0 0x7f29e806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.231+0000 7f2a09e00640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29e8068bf0 0x7f29e806b0b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0cda60 tx=0x7f29fc007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.235+0000 7f2a02000640 1 -- 172.21.15.37:0/3413502752 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f29f4056ec0 con 0x7f2a0c158e00 2024-05-30T06:48:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.435+0000 7f2a11200640 1 -- 172.21.15.37:0/3413502752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2a0c161ee0 con 0x7f2a0c158e00 2024-05-30T06:48:23.434 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-30T06:48:23.435+0000 7fd1bb400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T06:48:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.435+0000 7f2a02000640 1 -- 172.21.15.37:0/3413502752 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f29f405b1c0 con 0x7f2a0c158e00 2024-05-30T06:48:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T06:48:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.439+0000 7f2a11200640 1 -- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29e8068bf0 msgr2=0x7f29e806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.439+0000 7f2a11200640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29e8068bf0 0x7f29e806b0b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0cda60 tx=0x7f29fc007e90 comp rx=0 tx=0).stop 2024-05-30T06:48:23.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.439+0000 7f2a11200640 1 -- 172.21.15.37:0/3413502752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a0c158e00 msgr2=0x7f2a0c159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:23.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.439+0000 7f2a11200640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a0c158e00 0x7f2a0c159e60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f29f400d5f0 tx=0x7f29f400dab0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.439+0000 7f2a11200640 1 -- 172.21.15.37:0/3413502752 shutdown_connections 2024-05-30T06:48:23.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.439+0000 7f2a11200640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29e8068bf0 0x7f29e806b0b0 secure :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0cda60 tx=0x7f29fc007e90 comp rx=0 tx=0).stop 2024-05-30T06:48:23.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.439+0000 7f2a11200640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a0c1624a0 0x7f2a0c15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.439+0000 7f2a11200640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a0c158e00 0x7f2a0c159e60 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.439+0000 7f2a11200640 1 --2- 172.21.15.37:0/3413502752 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a0c06bea0 0x7f2a0c161970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.439+0000 7f2a11200640 1 -- 172.21.15.37:0/3413502752 >> 172.21.15.37:0/3413502752 conn(0x7f2a0c06f110 msgr2=0x7f2a0c154a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:23.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.443+0000 7f2a11200640 1 -- 172.21.15.37:0/3413502752 shutdown_connections 2024-05-30T06:48:23.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.443+0000 7f2a11200640 1 -- 172.21.15.37:0/3413502752 wait complete. 2024-05-30T06:48:23.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T06:48:23.509 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-30T06:48:23.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.611+0000 7f27ffe00640 1 Processor -- start 2024-05-30T06:48:23.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.611+0000 7f27ffe00640 1 -- start start 2024-05-30T06:48:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.611+0000 7f27ffe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f815fa30 0x7f27f80b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.611+0000 7f27ffe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f27f80b5930 0x7f27f80b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.611+0000 7f27ffe00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27f80af5d0 con 0x7f27f8148520 2024-05-30T06:48:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.611+0000 7f27ffe00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f27f80b5da0 con 0x7f27f80b5930 2024-05-30T06:48:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.611+0000 7f27ffe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f27f815feb0 con 0x7f27f815fa30 2024-05-30T06:48:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.611+0000 7f27fd400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f27f8148520 0x7f27f80aeda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50684/0 (socket says 172.21.15.37:50684) 2024-05-30T06:48:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.611+0000 7f27fd400640 1 -- 172.21.15.37:0/4109641018 learned_addr learned my addr 172.21.15.37:0/4109641018 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.611+0000 7f27fca00640 1 --2- 172.21.15.37:0/4109641018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f815fa30 0x7f27f80b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.611+0000 7f27fde00640 1 --2- 172.21.15.37:0/4109641018 >> v2:172.21.15.105:3300/0 conn(0x7f27f80b5930 0x7f27f80b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.611+0000 7f27f7e00640 1 -- 172.21.15.37:0/4109641018 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3875881522 0 0) 0x7f27f80af5d0 con 0x7f27f8148520 2024-05-30T06:48:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.611+0000 7f27f7e00640 1 -- 172.21.15.37:0/4109641018 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e0003530 con 0x7f27f8148520 2024-05-30T06:48:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27fde00640 1 -- 172.21.15.37:0/4109641018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f815fa30 msgr2=0x7f27f80b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27fde00640 1 --2- 172.21.15.37:0/4109641018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f815fa30 0x7f27f80b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27fde00640 1 -- 172.21.15.37:0/4109641018 >> v1:172.21.15.37:6789/0 conn(0x7f27f8148520 legacy=0x7f27f80aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27fde00640 1 -- 172.21.15.37:0/4109641018 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f80af8b0 con 0x7f27f80b5930 2024-05-30T06:48:23.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27fde00640 1 --2- 172.21.15.37:0/4109641018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f80b5930 0x7f27f80b3a60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009dc0 tx=0x7f27f001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5bc53f347695b07 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27f7e00640 1 -- 172.21.15.37:0/4109641018 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00b2070 con 0x7f27f80b5930 2024-05-30T06:48:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27f7e00640 1 -- 172.21.15.37:0/4109641018 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f00a59e0 con 0x7f27f80b5930 2024-05-30T06:48:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27f7e00640 1 -- 172.21.15.37:0/4109641018 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00a5db0 con 0x7f27f80b5930 2024-05-30T06:48:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27ffe00640 1 -- 172.21.15.37:0/4109641018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f80b5930 msgr2=0x7f27f80b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27ffe00640 1 --2- 172.21.15.37:0/4109641018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f80b5930 0x7f27f80b3a60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009dc0 tx=0x7f27f001c920 comp rx=0 tx=0).stop 2024-05-30T06:48:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27ffe00640 1 -- 172.21.15.37:0/4109641018 shutdown_connections 2024-05-30T06:48:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27ffe00640 1 --2- 172.21.15.37:0/4109641018 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f80b5930 0x7f27f80b3a60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27ffe00640 1 --2- 172.21.15.37:0/4109641018 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f815fa30 0x7f27f80b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27ffe00640 1 -- 172.21.15.37:0/4109641018 >> 172.21.15.37:0/4109641018 conn(0x7f27f806b960 msgr2=0x7f27f806bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.615+0000 7f27ffe00640 1 -- 172.21.15.37:0/4109641018 shutdown_connections 2024-05-30T06:48:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27ffe00640 1 -- 172.21.15.37:0/4109641018 wait complete. 2024-05-30T06:48:23.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27ffe00640 1 Processor -- start 2024-05-30T06:48:23.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27ffe00640 1 -- start start 2024-05-30T06:48:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27ffe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f80b5930 0x7f27f8139b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27ffe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f8148520 0x7f27f80cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27ffe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f815fa30 0x7f27f813b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27ffe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27f80b4930 con 0x7f27f8148520 2024-05-30T06:48:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27ffe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27f80b47b0 con 0x7f27f815fa30 2024-05-30T06:48:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27ffe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f27f80b4ab0 con 0x7f27f80b5930 2024-05-30T06:48:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27fca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f8148520 0x7f27f80cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27fca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f8148520 0x7f27f80cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37654/0 (socket says 172.21.15.37:37654) 2024-05-30T06:48:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27fca00640 1 -- 172.21.15.37:0/2625464316 learned_addr learned my addr 172.21.15.37:0/2625464316 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27fd400640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f80b5930 0x7f27f8139b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27fde00640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f815fa30 0x7f27f813b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27fca00640 1 -- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f80b5930 msgr2=0x7f27f8139b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27fca00640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f80b5930 0x7f27f8139b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27fca00640 1 -- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f815fa30 msgr2=0x7f27f813b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27fca00640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f815fa30 0x7f27f813b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27fca00640 1 -- 172.21.15.37:0/2625464316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f80d0020 con 0x7f27f8148520 2024-05-30T06:48:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27fca00640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f8148520 0x7f27f80cf7d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f27e400e870 tx=0x7f27e400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27f5600640 1 -- 172.21.15.37:0/2625464316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4017070 con 0x7f27f8148520 2024-05-30T06:48:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27f5600640 1 -- 172.21.15.37:0/2625464316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e400c940 con 0x7f27f8148520 2024-05-30T06:48:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27f5600640 1 -- 172.21.15.37:0/2625464316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e400ccf0 con 0x7f27f8148520 2024-05-30T06:48:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27ffe00640 1 -- 172.21.15.37:0/2625464316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f813c620 con 0x7f27f8148520 2024-05-30T06:48:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.619+0000 7f27ffe00640 1 -- 172.21.15.37:0/2625464316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f813cbe0 con 0x7f27f8148520 2024-05-30T06:48:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.623+0000 7f27ffe00640 1 -- 172.21.15.37:0/2625464316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f80cfd70 con 0x7f27f8148520 2024-05-30T06:48:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.623+0000 7f27f5600640 1 -- 172.21.15.37:0/2625464316 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f27e401a070 con 0x7f27f8148520 2024-05-30T06:48:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.623+0000 7f27f5600640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f27d8068bf0 0x7f27d806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.623+0000 7f27f5600640 1 -- 172.21.15.37:0/2625464316 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5881+0+0 (secure 0 0 0) 0x7f27e4087ee0 con 0x7f27f8148520 2024-05-30T06:48:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.623+0000 7f27fd400640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f27d8068bf0 0x7f27d806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:23.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.623+0000 7f27fd400640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f27d8068bf0 0x7f27d806b0b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f27ec001210 tx=0x7f27ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.627+0000 7f27f5600640 1 -- 172.21.15.37:0/2625464316 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f27e40574d0 con 0x7f27f8148520 2024-05-30T06:48:23.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:23.827+0000 7f27ffe00640 1 -- 172.21.15.37:0/2625464316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f27f80cd190 con 0x7f27f8148520 2024-05-30T06:48:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.439+0000 7f27f5600640 1 -- 172.21.15.37:0/2625464316 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) ==== 104+0+0 (secure 0 0 0) 0x7f27e4056dd0 con 0x7f27f8148520 2024-05-30T06:48:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.443+0000 7f27ffe00640 1 -- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f27d8068bf0 msgr2=0x7f27d806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.443+0000 7f27ffe00640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f27d8068bf0 0x7f27d806b0b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f27ec001210 tx=0x7f27ec009040 comp rx=0 tx=0).stop 2024-05-30T06:48:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.443+0000 7f27ffe00640 1 -- 172.21.15.37:0/2625464316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f8148520 msgr2=0x7f27f80cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.443+0000 7f27ffe00640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f8148520 0x7f27f80cf7d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f27e400e870 tx=0x7f27e400ec70 comp rx=0 tx=0).stop 2024-05-30T06:48:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.443+0000 7f27ffe00640 1 -- 172.21.15.37:0/2625464316 shutdown_connections 2024-05-30T06:48:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.443+0000 7f27ffe00640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f27d8068bf0 0x7f27d806b0b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.443+0000 7f27ffe00640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27f815fa30 0x7f27f813b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.443+0000 7f27ffe00640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f8148520 0x7f27f80cf7d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.443+0000 7f27ffe00640 1 --2- 172.21.15.37:0/2625464316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27f80b5930 0x7f27f8139b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.443+0000 7f27ffe00640 1 -- 172.21.15.37:0/2625464316 >> 172.21.15.37:0/2625464316 conn(0x7f27f806b960 msgr2=0x7f27f813a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.443+0000 7f27ffe00640 1 -- 172.21.15.37:0/2625464316 shutdown_connections 2024-05-30T06:48:24.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.443+0000 7f27ffe00640 1 -- 172.21.15.37:0/2625464316 wait complete. 2024-05-30T06:48:24.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T06:48:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc795800640 1 Processor -- start 2024-05-30T06:48:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc795800640 1 -- start start 2024-05-30T06:48:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc795800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc79015fcd0 0x7fc7900d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc795800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7900d0560 0x7fc7900d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc795800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79009b5a0 con 0x7fc7900b2370 2024-05-30T06:48:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc795800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc79009b880 con 0x7fc79015fcd0 2024-05-30T06:48:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc795800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc79009bb60 con 0x7fc7900d0560 2024-05-30T06:48:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc794e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc7900b2370 0x7fc7900b2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50694/0 (socket says 172.21.15.37:50694) 2024-05-30T06:48:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc794e00640 1 -- 172.21.15.37:0/2232625852 learned_addr learned my addr 172.21.15.37:0/2232625852 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc787e00640 1 --2- 172.21.15.37:0/2232625852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7900d0560 0x7fc7900d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78fe00640 1 --2- 172.21.15.37:0/2232625852 >> v2:172.21.15.105:3300/0 conn(0x7fc79015fcd0 0x7fc7900d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3280146298 0 0) 0x7fc79009b5a0 con 0x7fc7900b2370 2024-05-30T06:48:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc774003530 con 0x7fc7900b2370 2024-05-30T06:48:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 238841578 0 0) 0x7fc774003530 con 0x7fc7900b2370 2024-05-30T06:48:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7900d0560 msgr2=0x7fc7900d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 --2- 172.21.15.37:0/2232625852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7900d0560 0x7fc7900d09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 >> v2:172.21.15.105:3300/0 conn(0x7fc79015fcd0 msgr2=0x7fc7900d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 --2- 172.21.15.37:0/2232625852 >> v2:172.21.15.105:3300/0 conn(0x7fc79015fcd0 0x7fc7900d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7900b1e50 con 0x7fc7900b2370 2024-05-30T06:48:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fc788001a00 con 0x7fc7900b2370 2024-05-30T06:48:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 >> v1:172.21.15.37:6789/0 conn(0x7fc7900b2370 legacy=0x7fc7900b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 --2- 172.21.15.37:0/2232625852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7900d0560 0x7fc7740039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 --2- 172.21.15.37:0/2232625852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc774003f40 0x7fc774004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 --2- 172.21.15.37:0/2232625852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc774004d50 0x7fc7740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc79009b880 con 0x7fc774004d50 2024-05-30T06:48:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc79009bb60 con 0x7fc774003f40 2024-05-30T06:48:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc77400ba20 con 0x7fc7900d0560 2024-05-30T06:48:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc794e00640 1 --2- 172.21.15.37:0/2232625852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc774004d50 0x7fc7740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc787e00640 1 --2- 172.21.15.37:0/2232625852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc774003f40 0x7fc774004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc78fe00640 1 --2- 172.21.15.37:0/2232625852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7900d0560 0x7fc7740039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc794e00640 1 -- 172.21.15.37:0/2232625852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7900d0560 msgr2=0x7fc7740039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc794e00640 1 --2- 172.21.15.37:0/2232625852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7900d0560 0x7fc7740039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc794e00640 1 -- 172.21.15.37:0/2232625852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc774003f40 msgr2=0x7fc774004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc794e00640 1 --2- 172.21.15.37:0/2232625852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc774003f40 0x7fc774004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc794e00640 1 -- 172.21.15.37:0/2232625852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc774003530 con 0x7fc774004d50 2024-05-30T06:48:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.667+0000 7fc787e00640 1 --2- 172.21.15.37:0/2232625852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc774003f40 0x7fc774004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:24.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.671+0000 7fc794e00640 1 --2- 172.21.15.37:0/2232625852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc774004d50 0x7fc7740051d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc78800a8d0 tx=0x7fc78801fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6925c2b8bb3868 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:24.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.671+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78800a4c0 con 0x7fc774004d50 2024-05-30T06:48:24.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.671+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7880ad020 con 0x7fc774004d50 2024-05-30T06:48:24.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.671+0000 7fc78f400640 1 -- 172.21.15.37:0/2232625852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7880a9740 con 0x7fc774004d50 2024-05-30T06:48:24.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.671+0000 7fc795800640 1 -- 172.21.15.37:0/2232625852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc774004d50 msgr2=0x7fc7740051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:24.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.671+0000 7fc795800640 1 --2- 172.21.15.37:0/2232625852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc774004d50 0x7fc7740051d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc78800a8d0 tx=0x7fc78801fb20 comp rx=0 tx=0).stop 2024-05-30T06:48:24.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.671+0000 7fc794e00640 1 -- 172.21.15.37:0/2232625852 reap_dead start 2024-05-30T06:48:24.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.671+0000 7fc795800640 1 -- 172.21.15.37:0/2232625852 shutdown_connections 2024-05-30T06:48:24.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.671+0000 7fc795800640 1 -- 172.21.15.37:0/2232625852 >> 172.21.15.37:0/2232625852 conn(0x7fc7900b3f40 msgr2=0x7fc7900b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:24.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.671+0000 7fc795800640 1 -- 172.21.15.37:0/2232625852 shutdown_connections 2024-05-30T06:48:24.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.671+0000 7fc795800640 1 -- 172.21.15.37:0/2232625852 wait complete. 2024-05-30T06:48:24.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc795800640 1 Processor -- start 2024-05-30T06:48:24.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc795800640 1 -- start start 2024-05-30T06:48:24.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc795800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774004d50 0x7fc7900c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:24.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc795800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7901547d0 0x7fc7900cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:24.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc795800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900cf9f0 0x7fc7900b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:24.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc795800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7900d1360 con 0x7fc7900cf9f0 2024-05-30T06:48:24.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc795800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc7900d11e0 con 0x7fc7901547d0 2024-05-30T06:48:24.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc795800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc7900cdf70 con 0x7fc774004d50 2024-05-30T06:48:24.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc794e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900cf9f0 0x7fc7900b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:24.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc794e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900cf9f0 0x7fc7900b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37662/0 (socket says 172.21.15.37:37662) 2024-05-30T06:48:24.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc787e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7901547d0 0x7fc7900cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:24.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc794e00640 1 -- 172.21.15.37:0/3188134838 learned_addr learned my addr 172.21.15.37:0/3188134838 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:24.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc78fe00640 1 --2- 172.21.15.37:0/3188134838 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774004d50 0x7fc7900c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:24.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc794e00640 1 -- 172.21.15.37:0/3188134838 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774004d50 msgr2=0x7fc7900c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:24.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc794e00640 1 --2- 172.21.15.37:0/3188134838 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774004d50 0x7fc7900c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:24.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc794e00640 1 -- 172.21.15.37:0/3188134838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7901547d0 msgr2=0x7fc7900cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:24.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc794e00640 1 --2- 172.21.15.37:0/3188134838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7901547d0 0x7fc7900cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:24.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc794e00640 1 -- 172.21.15.37:0/3188134838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7900b7d80 con 0x7fc7900cf9f0 2024-05-30T06:48:24.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc794e00640 1 --2- 172.21.15.37:0/3188134838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900cf9f0 0x7fc7900b5430 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc78800a8d0 tx=0x7fc774005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:24.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc78cc00640 1 -- 172.21.15.37:0/3188134838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7780096b0 con 0x7fc7900cf9f0 2024-05-30T06:48:24.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc78cc00640 1 -- 172.21.15.37:0/3188134838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc788004d70 con 0x7fc7900cf9f0 2024-05-30T06:48:24.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc795800640 1 -- 172.21.15.37:0/3188134838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7900c6470 con 0x7fc7900cf9f0 2024-05-30T06:48:24.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc78cc00640 1 -- 172.21.15.37:0/3188134838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78800a4c0 con 0x7fc7900cf9f0 2024-05-30T06:48:24.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.675+0000 7fc795800640 1 -- 172.21.15.37:0/3188134838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7900b8020 con 0x7fc7900cf9f0 2024-05-30T06:48:24.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.679+0000 7fc795800640 1 -- 172.21.15.37:0/3188134838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc790068ab0 con 0x7fc7900cf9f0 2024-05-30T06:48:24.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.679+0000 7fc78cc00640 1 -- 172.21.15.37:0/3188134838 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fc7880a9740 con 0x7fc7900cf9f0 2024-05-30T06:48:24.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.679+0000 7fc78cc00640 1 --2- 172.21.15.37:0/3188134838 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc76c068bf0 0x7fc76c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:24.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.679+0000 7fc78cc00640 1 -- 172.21.15.37:0/3188134838 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5881+0+0 (secure 0 0 0) 0x7fc788124970 con 0x7fc7900cf9f0 2024-05-30T06:48:24.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.679+0000 7fc78fe00640 1 --2- 172.21.15.37:0/3188134838 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc76c068bf0 0x7fc76c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:24.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.679+0000 7fc78fe00640 1 --2- 172.21.15.37:0/3188134838 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc76c068bf0 0x7fc76c06b0b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc780009c60 tx=0x7fc780009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:24.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.683+0000 7fc78cc00640 1 -- 172.21.15.37:0/3188134838 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc788019830 con 0x7fc7900cf9f0 2024-05-30T06:48:24.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:24.851+0000 7fc795800640 1 -- 172.21.15.37:0/3188134838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc790070e40 con 0x7fc7900cf9f0 2024-05-30T06:48:25.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.455+0000 7fc78cc00640 1 -- 172.21.15.37:0/3188134838 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) ==== 181+0+0 (secure 0 0 0) 0x7fc7880f43a0 con 0x7fc7900cf9f0 2024-05-30T06:48:25.455 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-30T06:48:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.459+0000 7fc795800640 1 -- 172.21.15.37:0/3188134838 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc76c068bf0 msgr2=0x7fc76c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.459+0000 7fc795800640 1 --2- 172.21.15.37:0/3188134838 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc76c068bf0 0x7fc76c06b0b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc780009c60 tx=0x7fc780009190 comp rx=0 tx=0).stop 2024-05-30T06:48:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.459+0000 7fc795800640 1 -- 172.21.15.37:0/3188134838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900cf9f0 msgr2=0x7fc7900b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.459+0000 7fc795800640 1 --2- 172.21.15.37:0/3188134838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900cf9f0 0x7fc7900b5430 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc78800a8d0 tx=0x7fc774005840 comp rx=0 tx=0).stop 2024-05-30T06:48:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.459+0000 7fc795800640 1 -- 172.21.15.37:0/3188134838 shutdown_connections 2024-05-30T06:48:25.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.459+0000 7fc795800640 1 --2- 172.21.15.37:0/3188134838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900cf9f0 0x7fc7900b5430 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:25.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.459+0000 7fc795800640 1 --2- 172.21.15.37:0/3188134838 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc76c068bf0 0x7fc76c06b0b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:25.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.459+0000 7fc795800640 1 --2- 172.21.15.37:0/3188134838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7901547d0 0x7fc7900cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:25.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.459+0000 7fc795800640 1 --2- 172.21.15.37:0/3188134838 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774004d50 0x7fc7900c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:25.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.459+0000 7fc795800640 1 -- 172.21.15.37:0/3188134838 >> 172.21.15.37:0/3188134838 conn(0x7fc7900b3f40 msgr2=0x7fc79006ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:25.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.459+0000 7fc795800640 1 -- 172.21.15.37:0/3188134838 shutdown_connections 2024-05-30T06:48:25.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.459+0000 7fc795800640 1 -- 172.21.15.37:0/3188134838 wait complete. 2024-05-30T06:48:25.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T06:48:25.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc80bc00640 1 Processor -- start 2024-05-30T06:48:25.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc80bc00640 1 -- start start 2024-05-30T06:48:25.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc80bc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8040b60e0 0x7fc80406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:25.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc80bc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc80415db00 con 0x7fc8040ced10 2024-05-30T06:48:25.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc80bc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc80406e180 con 0x7fc80415cdd0 2024-05-30T06:48:25.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc80bc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc80406df50 con 0x7fc8040b60e0 2024-05-30T06:48:25.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc809200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc8040ced10 0x7fc8040b59d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50704/0 (socket says 172.21.15.37:50704) 2024-05-30T06:48:25.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc809200640 1 -- 172.21.15.37:0/348248912 learned_addr learned my addr 172.21.15.37:0/348248912 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:25.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803e00640 1 --2- 172.21.15.37:0/348248912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8040b60e0 0x7fc80406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:25.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3836229856 0 0) 0x7fc80415db00 con 0x7fc8040ced10 2024-05-30T06:48:25.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7ec003530 con 0x7fc8040ced10 2024-05-30T06:48:25.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 63817660 0 0) 0x7fc80406e180 con 0x7fc80415cdd0 2024-05-30T06:48:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc80415db00 con 0x7fc80415cdd0 2024-05-30T06:48:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1105330607 0 0) 0x7fc7ec003530 con 0x7fc8040ced10 2024-05-30T06:48:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8040b60e0 msgr2=0x7fc80406ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 --2- 172.21.15.37:0/348248912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8040b60e0 0x7fc80406ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 >> v1:172.21.15.105:6789/0 conn(0x7fc80415cdd0 legacy=0x7fc80415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80406e460 con 0x7fc8040ced10 2024-05-30T06:48:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fc7f8001680 con 0x7fc8040ced10 2024-05-30T06:48:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 >> v1:172.21.15.37:6789/0 conn(0x7fc8040ced10 legacy=0x7fc8040b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 --2- 172.21.15.37:0/348248912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7ec003b80 0x7fc7ec003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 --2- 172.21.15.37:0/348248912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7ec004810 0x7fc7ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 --2- 172.21.15.37:0/348248912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8040b60e0 0x7fc7ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec00ba80 con 0x7fc7ec004810 2024-05-30T06:48:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec00bc00 con 0x7fc7ec003b80 2024-05-30T06:48:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ec00bdd0 con 0x7fc8040b60e0 2024-05-30T06:48:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803e00640 1 --2- 172.21.15.37:0/348248912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7ec004810 0x7fc7ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc809200640 1 --2- 172.21.15.37:0/348248912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7ec003b80 0x7fc7ec003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc809c00640 1 --2- 172.21.15.37:0/348248912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8040b60e0 0x7fc7ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803e00640 1 -- 172.21.15.37:0/348248912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8040b60e0 msgr2=0x7fc7ec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803e00640 1 --2- 172.21.15.37:0/348248912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8040b60e0 0x7fc7ec0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803e00640 1 -- 172.21.15.37:0/348248912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7ec003b80 msgr2=0x7fc7ec003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803e00640 1 --2- 172.21.15.37:0/348248912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7ec003b80 0x7fc7ec003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.631+0000 7fc803e00640 1 -- 172.21.15.37:0/348248912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ec003530 con 0x7fc7ec004810 2024-05-30T06:48:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.635+0000 7fc803e00640 1 --2- 172.21.15.37:0/348248912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7ec004810 0x7fc7ec004c90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009ae0 tx=0x7fc7f001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed146319f6d65e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.635+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00b2070 con 0x7fc7ec004810 2024-05-30T06:48:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.635+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f00a5600 con 0x7fc7ec004810 2024-05-30T06:48:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.635+0000 7fc803400640 1 -- 172.21.15.37:0/348248912 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00096b0 con 0x7fc7ec004810 2024-05-30T06:48:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.635+0000 7fc80bc00640 1 -- 172.21.15.37:0/348248912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7ec004810 msgr2=0x7fc7ec004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.635+0000 7fc80bc00640 1 --2- 172.21.15.37:0/348248912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7ec004810 0x7fc7ec004c90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009ae0 tx=0x7fc7f001ca10 comp rx=0 tx=0).stop 2024-05-30T06:48:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.635+0000 7fc809c00640 1 -- 172.21.15.37:0/348248912 reap_dead start 2024-05-30T06:48:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.635+0000 7fc80bc00640 1 -- 172.21.15.37:0/348248912 shutdown_connections 2024-05-30T06:48:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.635+0000 7fc80bc00640 1 -- 172.21.15.37:0/348248912 >> 172.21.15.37:0/348248912 conn(0x7fc80406bf60 msgr2=0x7fc8040b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.635+0000 7fc80bc00640 1 -- 172.21.15.37:0/348248912 shutdown_connections 2024-05-30T06:48:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.635+0000 7fc80bc00640 1 -- 172.21.15.37:0/348248912 wait complete. 2024-05-30T06:48:25.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc80bc00640 1 Processor -- start 2024-05-30T06:48:25.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc80bc00640 1 -- start start 2024-05-30T06:48:25.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc80bc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7ec004810 0x7fc804155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:25.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc80bc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8040ae5e0 0x7fc8040aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:25.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc80bc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8041f53b0 0x7fc8040b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:25.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc80bc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc80406ec60 con 0x7fc8040ae5e0 2024-05-30T06:48:25.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc80bc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc80406e7d0 con 0x7fc7ec004810 2024-05-30T06:48:25.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc80bc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc80406ede0 con 0x7fc8041f53b0 2024-05-30T06:48:25.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc803e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8040ae5e0 0x7fc8040aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:25.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc803e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8040ae5e0 0x7fc8040aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37674/0 (socket says 172.21.15.37:37674) 2024-05-30T06:48:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc803e00640 1 -- 172.21.15.37:0/3340157154 learned_addr learned my addr 172.21.15.37:0/3340157154 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc809200640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7ec004810 0x7fc804155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc809c00640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8041f53b0 0x7fc8040b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc803e00640 1 -- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8041f53b0 msgr2=0x7fc8040b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc803e00640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8041f53b0 0x7fc8040b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc803e00640 1 -- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7ec004810 msgr2=0x7fc804155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc803e00640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7ec004810 0x7fc804155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc803e00640 1 -- 172.21.15.37:0/3340157154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8040abd70 con 0x7fc8040ae5e0 2024-05-30T06:48:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc809200640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7ec004810 0x7fc804155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc809c00640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8041f53b0 0x7fc8040b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:25.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc803e00640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8040ae5e0 0x7fc8040aeaa0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00b0040 tx=0x7fc7ec005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:25.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc800c00640 1 -- 172.21.15.37:0/3340157154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00bd020 con 0x7fc8040ae5e0 2024-05-30T06:48:25.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc800c00640 1 -- 172.21.15.37:0/3340157154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7f0004020 con 0x7fc8040ae5e0 2024-05-30T06:48:25.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc80bc00640 1 -- 172.21.15.37:0/3340157154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8040ac050 con 0x7fc8040ae5e0 2024-05-30T06:48:25.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc800c00640 1 -- 172.21.15.37:0/3340157154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00b2040 con 0x7fc8040ae5e0 2024-05-30T06:48:25.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.639+0000 7fc80bc00640 1 -- 172.21.15.37:0/3340157154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8040ac610 con 0x7fc8040ae5e0 2024-05-30T06:48:25.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.643+0000 7fc80bc00640 1 -- 172.21.15.37:0/3340157154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc804068d40 con 0x7fc8040ae5e0 2024-05-30T06:48:25.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.643+0000 7fc800c00640 1 -- 172.21.15.37:0/3340157154 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fc7f0003620 con 0x7fc8040ae5e0 2024-05-30T06:48:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.643+0000 7fc800c00640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc7e4068c20 0x7fc7e406b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.643+0000 7fc800c00640 1 -- 172.21.15.37:0/3340157154 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5443+0+0 (secure 0 0 0) 0x7fc7f011ee90 con 0x7fc8040ae5e0 2024-05-30T06:48:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.643+0000 7fc809200640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc7e4068c20 0x7fc7e406b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:25.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.643+0000 7fc809200640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc7e4068c20 0x7fc7e406b0e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8000f70 tx=0x7fc7f8000ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:25.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.647+0000 7fc800c00640 1 -- 172.21.15.37:0/3340157154 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc7f0016760 con 0x7fc8040ae5e0 2024-05-30T06:48:25.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:25.819+0000 7fc80bc00640 1 -- 172.21.15.37:0/3340157154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc80415bc00 con 0x7fc8040ae5e0 2024-05-30T06:48:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.459+0000 7fc800c00640 1 -- 172.21.15.37:0/3340157154 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) ==== 169+0+0 (secure 0 0 0) 0x7fc7f00f0f00 con 0x7fc8040ae5e0 2024-05-30T06:48:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-30T06:48:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.463+0000 7fc80bc00640 1 -- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc7e4068c20 msgr2=0x7fc7e406b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.463+0000 7fc80bc00640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc7e4068c20 0x7fc7e406b0e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8000f70 tx=0x7fc7f8000ee0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.463+0000 7fc80bc00640 1 -- 172.21.15.37:0/3340157154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8040ae5e0 msgr2=0x7fc8040aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.463+0000 7fc80bc00640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8040ae5e0 0x7fc8040aeaa0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc7f00b0040 tx=0x7fc7ec005840 comp rx=0 tx=0).stop 2024-05-30T06:48:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.463+0000 7fc80bc00640 1 -- 172.21.15.37:0/3340157154 shutdown_connections 2024-05-30T06:48:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.463+0000 7fc80bc00640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8041f53b0 0x7fc8040b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.463+0000 7fc80bc00640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8040ae5e0 0x7fc8040aeaa0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.463+0000 7fc80bc00640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc7e4068c20 0x7fc7e406b0e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.463+0000 7fc80bc00640 1 --2- 172.21.15.37:0/3340157154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7ec004810 0x7fc804155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.463+0000 7fc80bc00640 1 -- 172.21.15.37:0/3340157154 >> 172.21.15.37:0/3340157154 conn(0x7fc80406bf60 msgr2=0x7fc8040b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.463+0000 7fc80bc00640 1 -- 172.21.15.37:0/3340157154 shutdown_connections 2024-05-30T06:48:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.463+0000 7fc80bc00640 1 -- 172.21.15.37:0/3340157154 wait complete. 2024-05-30T06:48:26.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T06:48:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.635+0000 7faa10000640 1 Processor -- start 2024-05-30T06:48:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.635+0000 7faa10000640 1 -- start start 2024-05-30T06:48:26.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.635+0000 7faa10000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa080cd440 0x7faa0806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:26.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.635+0000 7faa10000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa0806f5a0 0x7faa080b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:26.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.635+0000 7faa10000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0815f310 con 0x7faa08155da0 2024-05-30T06:48:26.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.635+0000 7faa10000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7faa0815f5f0 con 0x7faa0806f5a0 2024-05-30T06:48:26.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.635+0000 7faa10000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa0815f8d0 con 0x7faa080cd440 2024-05-30T06:48:26.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.639+0000 7faa0d600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faa08155da0 0x7faa080cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50706/0 (socket says 172.21.15.37:50706) 2024-05-30T06:48:26.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.639+0000 7faa0d600640 1 -- 172.21.15.37:0/3529243221 learned_addr learned my addr 172.21.15.37:0/3529243221 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:26.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.639+0000 7faa0e000640 1 --2- 172.21.15.37:0/3529243221 >> v2:172.21.15.37:3300/0 conn(0x7faa0806f5a0 0x7faa080b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:26.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.639+0000 7faa0cc00640 1 --2- 172.21.15.37:0/3529243221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa080cd440 0x7faa0806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.639+0000 7faa0e000640 1 -- 172.21.15.37:0/3529243221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa080cd440 msgr2=0x7faa0806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.639+0000 7faa0e000640 1 --2- 172.21.15.37:0/3529243221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa080cd440 0x7faa0806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.639+0000 7faa0e000640 1 -- 172.21.15.37:0/3529243221 >> v1:172.21.15.37:6789/0 conn(0x7faa08155da0 legacy=0x7faa080cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.639+0000 7faa0e000640 1 -- 172.21.15.37:0/3529243221 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0815fbb0 con 0x7faa0806f5a0 2024-05-30T06:48:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.639+0000 7faa07e00640 1 -- 172.21.15.37:0/3529243221 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942723338 0 0) 0x7faa0815f310 con 0x7faa08155da0 2024-05-30T06:48:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.639+0000 7faa0e000640 1 --2- 172.21.15.37:0/3529243221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0806f5a0 0x7faa080b3750 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7faa00009d90 tx=0x7faa0001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7f482132b7d55f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.639+0000 7faa07e00640 1 -- 172.21.15.37:0/3529243221 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa000b2070 con 0x7faa0806f5a0 2024-05-30T06:48:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.639+0000 7faa07e00640 1 -- 172.21.15.37:0/3529243221 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa000a5820 con 0x7faa0806f5a0 2024-05-30T06:48:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.639+0000 7faa07e00640 1 -- 172.21.15.37:0/3529243221 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa000a5bf0 con 0x7faa0806f5a0 2024-05-30T06:48:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 -- 172.21.15.37:0/3529243221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0806f5a0 msgr2=0x7faa080b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 --2- 172.21.15.37:0/3529243221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0806f5a0 0x7faa080b3750 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7faa00009d90 tx=0x7faa0001c850 comp rx=0 tx=0).stop 2024-05-30T06:48:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 -- 172.21.15.37:0/3529243221 shutdown_connections 2024-05-30T06:48:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 --2- 172.21.15.37:0/3529243221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0806f5a0 0x7faa080b3750 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 --2- 172.21.15.37:0/3529243221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa080cd440 0x7faa0806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 -- 172.21.15.37:0/3529243221 >> 172.21.15.37:0/3529243221 conn(0x7faa0806bf60 msgr2=0x7faa080b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 -- 172.21.15.37:0/3529243221 shutdown_connections 2024-05-30T06:48:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 -- 172.21.15.37:0/3529243221 wait complete. 2024-05-30T06:48:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 Processor -- start 2024-05-30T06:48:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 -- start start 2024-05-30T06:48:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0806f5a0 0x7faa081579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa08155da0 0x7faa08156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa08153e80 0x7faa08147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa08168580 con 0x7faa0806f5a0 2024-05-30T06:48:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa080b46b0 con 0x7faa08155da0 2024-05-30T06:48:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa10000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa08168700 con 0x7faa08153e80 2024-05-30T06:48:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa0d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0806f5a0 0x7faa081579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa0d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0806f5a0 0x7faa081579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37682/0 (socket says 172.21.15.37:37682) 2024-05-30T06:48:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa0d600640 1 -- 172.21.15.37:0/34976602 learned_addr learned my addr 172.21.15.37:0/34976602 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa0e000640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa08153e80 0x7faa08147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa0cc00640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa08155da0 0x7faa08156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa0d600640 1 -- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa08153e80 msgr2=0x7faa08147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa0d600640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa08153e80 0x7faa08147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa0d600640 1 -- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa08155da0 msgr2=0x7faa08156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa0d600640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa08155da0 0x7faa08156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa0d600640 1 -- 172.21.15.37:0/34976602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa08159070 con 0x7faa0806f5a0 2024-05-30T06:48:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.643+0000 7faa0e000640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa08153e80 0x7faa08147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.647+0000 7faa0d600640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0806f5a0 0x7faa081579c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c480 tx=0x7fa9fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.647+0000 7faa05600640 1 -- 172.21.15.37:0/34976602 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc018070 con 0x7faa0806f5a0 2024-05-30T06:48:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.647+0000 7faa05600640 1 -- 172.21.15.37:0/34976602 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc007500 con 0x7faa0806f5a0 2024-05-30T06:48:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.647+0000 7faa05600640 1 -- 172.21.15.37:0/34976602 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc004a30 con 0x7faa0806f5a0 2024-05-30T06:48:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.647+0000 7faa10000640 1 -- 172.21.15.37:0/34976602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa08156920 con 0x7faa0806f5a0 2024-05-30T06:48:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.647+0000 7faa10000640 1 -- 172.21.15.37:0/34976602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa08156ee0 con 0x7faa0806f5a0 2024-05-30T06:48:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.647+0000 7faa10000640 1 -- 172.21.15.37:0/34976602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa08068bc0 con 0x7faa0806f5a0 2024-05-30T06:48:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.647+0000 7faa05600640 1 -- 172.21.15.37:0/34976602 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fa9fc004bd0 con 0x7faa0806f5a0 2024-05-30T06:48:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.647+0000 7faa05600640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa9e8068c20 0x7fa9e806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.647+0000 7faa05600640 1 -- 172.21.15.37:0/34976602 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7fa9fc086a60 con 0x7faa0806f5a0 2024-05-30T06:48:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.647+0000 7faa0cc00640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa9e8068c20 0x7fa9e806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.651+0000 7faa0cc00640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa9e8068c20 0x7fa9e806b0e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7faa081554a0 tx=0x7fa9f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.651+0000 7faa05600640 1 -- 172.21.15.37:0/34976602 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa9fc056490 con 0x7faa0806f5a0 2024-05-30T06:48:26.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.819+0000 7faa10000640 1 -- 172.21.15.37:0/34976602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7faa0806f380 con 0x7faa0806f5a0 2024-05-30T06:48:26.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.823+0000 7faa05600640 1 -- 172.21.15.37:0/34976602 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fa9fc055d90 con 0x7faa0806f5a0 2024-05-30T06:48:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.827+0000 7faa10000640 1 -- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa9e8068c20 msgr2=0x7fa9e806b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.827+0000 7faa10000640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa9e8068c20 0x7fa9e806b0e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7faa081554a0 tx=0x7fa9f4008040 comp rx=0 tx=0).stop 2024-05-30T06:48:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.827+0000 7faa10000640 1 -- 172.21.15.37:0/34976602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0806f5a0 msgr2=0x7faa081579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.827+0000 7faa10000640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0806f5a0 0x7faa081579c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c480 tx=0x7fa9fc00c940 comp rx=0 tx=0).stop 2024-05-30T06:48:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.827+0000 7faa10000640 1 -- 172.21.15.37:0/34976602 shutdown_connections 2024-05-30T06:48:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.827+0000 7faa10000640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa08153e80 0x7faa08147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.827+0000 7faa10000640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa9e8068c20 0x7fa9e806b0e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.827+0000 7faa10000640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa08155da0 0x7faa08156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.827+0000 7faa10000640 1 --2- 172.21.15.37:0/34976602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0806f5a0 0x7faa081579c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.827+0000 7faa10000640 1 -- 172.21.15.37:0/34976602 >> 172.21.15.37:0/34976602 conn(0x7faa0806bf60 msgr2=0x7faa0815ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.827+0000 7faa10000640 1 -- 172.21.15.37:0/34976602 shutdown_connections 2024-05-30T06:48:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:26.827+0000 7faa10000640 1 -- 172.21.15.37:0/34976602 wait complete. 2024-05-30T06:48:26.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones' 2024-05-30T06:48:27.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.007+0000 7f436f800640 1 Processor -- start 2024-05-30T06:48:27.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.007+0000 7f436f800640 1 -- start start 2024-05-30T06:48:27.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.007+0000 7f436f800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f43680b2e20 0x7f4368160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.007+0000 7f436f800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436809ba70 0x7f4368160e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.007+0000 7f436f800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43680d0430 con 0x7f43681609c0 2024-05-30T06:48:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.007+0000 7f436f800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f43680b3200 con 0x7f43680b2e20 2024-05-30T06:48:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.007+0000 7f436f800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f43680d01e0 con 0x7f436809ba70 2024-05-30T06:48:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.007+0000 7f436ce00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f43680b2e20 0x7f4368160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.007+0000 7f436ce00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f43680b2e20 0x7f4368160480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37688/0 (socket says 172.21.15.37:37688) 2024-05-30T06:48:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.007+0000 7f4367e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f43681609c0 0x7f43680cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50708/0 (socket says 172.21.15.37:50708) 2024-05-30T06:48:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.007+0000 7f436ce00640 1 -- 172.21.15.37:0/4294641389 learned_addr learned my addr 172.21.15.37:0/4294641389 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.007+0000 7f436d800640 1 --2- 172.21.15.37:0/4294641389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436809ba70 0x7f4368160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.011+0000 7f436ce00640 1 -- 172.21.15.37:0/4294641389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436809ba70 msgr2=0x7f4368160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.011+0000 7f436ce00640 1 --2- 172.21.15.37:0/4294641389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436809ba70 0x7f4368160e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.011+0000 7f436ce00640 1 -- 172.21.15.37:0/4294641389 >> v1:172.21.15.37:6789/0 conn(0x7f43681609c0 legacy=0x7f43680cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.011+0000 7f436ce00640 1 -- 172.21.15.37:0/4294641389 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43680d0710 con 0x7f43680b2e20 2024-05-30T06:48:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.011+0000 7f4367400640 1 -- 172.21.15.37:0/4294641389 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1743829240 0 0) 0x7f43680d0430 con 0x7f43681609c0 2024-05-30T06:48:27.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.011+0000 7f436ce00640 1 --2- 172.21.15.37:0/4294641389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43680b2e20 0x7f4368160480 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f435c009870 tx=0x7f435c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3e02c97b5c451e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.011+0000 7f4367400640 1 -- 172.21.15.37:0/4294641389 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c0ab650 con 0x7f43680b2e20 2024-05-30T06:48:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.011+0000 7f4367400640 1 -- 172.21.15.37:0/4294641389 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f435c0b0070 con 0x7f43680b2e20 2024-05-30T06:48:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.011+0000 7f4367400640 1 -- 172.21.15.37:0/4294641389 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c0aba10 con 0x7f43680b2e20 2024-05-30T06:48:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 -- 172.21.15.37:0/4294641389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43680b2e20 msgr2=0x7f4368160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 --2- 172.21.15.37:0/4294641389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43680b2e20 0x7f4368160480 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f435c009870 tx=0x7f435c01c560 comp rx=0 tx=0).stop 2024-05-30T06:48:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 -- 172.21.15.37:0/4294641389 shutdown_connections 2024-05-30T06:48:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 --2- 172.21.15.37:0/4294641389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436809ba70 0x7f4368160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 --2- 172.21.15.37:0/4294641389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43680b2e20 0x7f4368160480 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 -- 172.21.15.37:0/4294641389 >> 172.21.15.37:0/4294641389 conn(0x7f43680b4100 msgr2=0x7f43680b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 -- 172.21.15.37:0/4294641389 shutdown_connections 2024-05-30T06:48:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 -- 172.21.15.37:0/4294641389 wait complete. 2024-05-30T06:48:27.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 Processor -- start 2024-05-30T06:48:27.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 -- start start 2024-05-30T06:48:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f436809ba70 0x7f43681657f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680b2e20 0x7f4368157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43681609c0 0x7f43680c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f43680ce320 con 0x7f43681609c0 2024-05-30T06:48:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f43680ce1a0 con 0x7f436809ba70 2024-05-30T06:48:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436f800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f43681669e0 con 0x7f43680b2e20 2024-05-30T06:48:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43681609c0 0x7f43680c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43681609c0 0x7f43680c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37694/0 (socket says 172.21.15.37:37694) 2024-05-30T06:48:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436d800640 1 -- 172.21.15.37:0/864635879 learned_addr learned my addr 172.21.15.37:0/864635879 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436ce00640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f436809ba70 0x7f43681657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f4367e00640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680b2e20 0x7f4368157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436d800640 1 -- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680b2e20 msgr2=0x7f4368157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436d800640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680b2e20 0x7f4368157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436d800640 1 -- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f436809ba70 msgr2=0x7f43681657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436d800640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f436809ba70 0x7f43681657f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436d800640 1 -- 172.21.15.37:0/864635879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4368165dd0 con 0x7f43681609c0 2024-05-30T06:48:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.015+0000 7f436d800640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43681609c0 0x7f43680c7270 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f436000efc0 tx=0x7f436000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.019+0000 7f4364c00640 1 -- 172.21.15.37:0/864635879 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4360018020 con 0x7f43681609c0 2024-05-30T06:48:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.019+0000 7f4364c00640 1 -- 172.21.15.37:0/864635879 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4360014480 con 0x7f43681609c0 2024-05-30T06:48:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.019+0000 7f436f800640 1 -- 172.21.15.37:0/864635879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43681660b0 con 0x7f43681609c0 2024-05-30T06:48:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.019+0000 7f4364c00640 1 -- 172.21.15.37:0/864635879 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4360014870 con 0x7f43681609c0 2024-05-30T06:48:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.019+0000 7f436f800640 1 -- 172.21.15.37:0/864635879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4368166670 con 0x7f43681609c0 2024-05-30T06:48:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.019+0000 7f436f800640 1 -- 172.21.15.37:0/864635879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4368068b20 con 0x7f43681609c0 2024-05-30T06:48:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.019+0000 7f4364c00640 1 -- 172.21.15.37:0/864635879 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f436001b020 con 0x7f43681609c0 2024-05-30T06:48:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.019+0000 7f4364c00640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4348068c20 0x7f434806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.019+0000 7f4364c00640 1 -- 172.21.15.37:0/864635879 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f4360087ed0 con 0x7f43681609c0 2024-05-30T06:48:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.019+0000 7f436ce00640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4348068c20 0x7f434806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.023+0000 7f436ce00640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4348068c20 0x7f434806b0e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f435c0af000 tx=0x7f435c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:27.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.023+0000 7f4364c00640 1 -- 172.21.15.37:0/864635879 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4360022070 con 0x7f43681609c0 2024-05-30T06:48:27.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.247+0000 7f436f800640 1 -- 172.21.15.37:0/864635879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]} v 0) -- 0x7f43680ce860 con 0x7f43681609c0 2024-05-30T06:48:27.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.463+0000 7f4364c00640 1 -- 172.21.15.37:0/864635879 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_4_clones"]}]=0 v294) ==== 162+0+0 (secure 0 0 0) 0x7f4360010040 con 0x7f43681609c0 2024-05-30T06:48:27.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.463+0000 7f436f800640 1 -- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4348068c20 msgr2=0x7f434806b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.463+0000 7f436f800640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4348068c20 0x7f434806b0e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f435c0af000 tx=0x7f435c0a7000 comp rx=0 tx=0).stop 2024-05-30T06:48:27.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.463+0000 7f436f800640 1 -- 172.21.15.37:0/864635879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43681609c0 msgr2=0x7f43680c7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.463+0000 7f436f800640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43681609c0 0x7f43680c7270 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f436000efc0 tx=0x7f436000c490 comp rx=0 tx=0).stop 2024-05-30T06:48:27.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.463+0000 7f436f800640 1 -- 172.21.15.37:0/864635879 shutdown_connections 2024-05-30T06:48:27.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.463+0000 7f436f800640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43681609c0 0x7f43680c7270 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.463+0000 7f436f800640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43680b2e20 0x7f4368157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.463+0000 7f436f800640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4348068c20 0x7f434806b0e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.463+0000 7f436f800640 1 --2- 172.21.15.37:0/864635879 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f436809ba70 0x7f43681657f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.463+0000 7f436f800640 1 -- 172.21.15.37:0/864635879 >> 172.21.15.37:0/864635879 conn(0x7f43680b4100 msgr2=0x7f4368074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:27.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.463+0000 7f436f800640 1 -- 172.21.15.37:0/864635879 shutdown_connections 2024-05-30T06:48:27.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.463+0000 7f436f800640 1 -- 172.21.15.37:0/864635879 wait complete. 2024-05-30T06:48:27.484 INFO:tasks.cephfs_test_runner:Test that one progress bar is printed when number of clone jobs is ... ok 2024-05-30T06:48:27.485 INFO:tasks.cephfs_test_runner:Starting test: test_progress_bars_for_7_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that 2 progress bars are printed when number of clone jobs is 2024-05-30T06:48:27.485 INFO:tasks.cephfs_test_runner:test_progress_bars_for_7_clones (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T06:48:27.485 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:48:27.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.627+0000 7f1f79600640 1 Processor -- start 2024-05-30T06:48:27.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.627+0000 7f1f79600640 1 -- start start 2024-05-30T06:48:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.627+0000 7f1f79600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1f7415cd80 0x7f1f7406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.627+0000 7f1f79600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f740cd120 con 0x7f1f740ce8d0 2024-05-30T06:48:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.627+0000 7f1f79600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f740cd400 con 0x7f1f7406e000 2024-05-30T06:48:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.627+0000 7f1f79600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1f740a9530 con 0x7f1f7415cd80 2024-05-30T06:48:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.627+0000 7f1f73400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1f740ce8d0 0x7f1f741663c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52134/0 (socket says 172.21.15.37:52134) 2024-05-30T06:48:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.627+0000 7f1f73400640 1 -- 172.21.15.37:0/1126781942 learned_addr learned my addr 172.21.15.37:0/1126781942 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.627+0000 7f1f6be00640 1 --2- 172.21.15.37:0/1126781942 >> v2:172.21.15.105:3300/0 conn(0x7f1f7415cd80 0x7f1f7406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.627+0000 7f1f72000640 1 -- 172.21.15.37:0/1126781942 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 912941484 0 0) 0x7f1f740cd120 con 0x7f1f740ce8d0 2024-05-30T06:48:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.627+0000 7f1f72000640 1 -- 172.21.15.37:0/1126781942 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f58003530 con 0x7f1f740ce8d0 2024-05-30T06:48:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.631+0000 7f1f6be00640 1 -- 172.21.15.37:0/1126781942 >> v1:172.21.15.105:6789/0 conn(0x7f1f7406e000 legacy=0x7f1f740ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.631+0000 7f1f6be00640 1 -- 172.21.15.37:0/1126781942 >> v1:172.21.15.37:6789/0 conn(0x7f1f740ce8d0 legacy=0x7f1f741663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.631+0000 7f1f72000640 1 -- 172.21.15.37:0/1126781942 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2842447448 0 0) 0x7f1f58003530 con 0x7f1f740ce8d0 2024-05-30T06:48:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.631+0000 7f1f6be00640 1 -- 172.21.15.37:0/1126781942 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f740cd6e0 con 0x7f1f7415cd80 2024-05-30T06:48:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.631+0000 7f1f6be00640 1 --2- 172.21.15.37:0/1126781942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7415cd80 0x7f1f7406f3f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0097c0 tx=0x7f1f5c01ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d142519f6cfc977 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.631+0000 7f1f72000640 1 -- 172.21.15.37:0/1126781942 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0b5070 con 0x7f1f7415cd80 2024-05-30T06:48:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.631+0000 7f1f72000640 1 -- 172.21.15.37:0/1126781942 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5c0a8630 con 0x7f1f7415cd80 2024-05-30T06:48:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.631+0000 7f1f72000640 1 -- 172.21.15.37:0/1126781942 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c001a00 con 0x7f1f7415cd80 2024-05-30T06:48:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.631+0000 7f1f79600640 1 -- 172.21.15.37:0/1126781942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7415cd80 msgr2=0x7f1f7406f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.631+0000 7f1f79600640 1 --2- 172.21.15.37:0/1126781942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7415cd80 0x7f1f7406f3f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0097c0 tx=0x7f1f5c01ebb0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.631+0000 7f1f79600640 1 -- 172.21.15.37:0/1126781942 shutdown_connections 2024-05-30T06:48:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.631+0000 7f1f79600640 1 --2- 172.21.15.37:0/1126781942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7415cd80 0x7f1f7406f3f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.631+0000 7f1f79600640 1 -- 172.21.15.37:0/1126781942 >> 172.21.15.37:0/1126781942 conn(0x7f1f740b23a0 msgr2=0x7f1f740b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f79600640 1 -- 172.21.15.37:0/1126781942 shutdown_connections 2024-05-30T06:48:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f79600640 1 -- 172.21.15.37:0/1126781942 wait complete. 2024-05-30T06:48:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f79600640 1 Processor -- start 2024-05-30T06:48:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f79600640 1 -- start start 2024-05-30T06:48:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f79600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7406e000 0x7f1f7413ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f79600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ce8d0 0x7f1f741e8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f79600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f7415cd80 0x7f1f7413b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f79600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7406f930 con 0x7f1f740ce8d0 2024-05-30T06:48:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f79600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1f740cdca0 con 0x7f1f7406e000 2024-05-30T06:48:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f79600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1f7406fab0 con 0x7f1f7415cd80 2024-05-30T06:48:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f6be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ce8d0 0x7f1f741e8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f6be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ce8d0 0x7f1f741e8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36276/0 (socket says 172.21.15.37:36276) 2024-05-30T06:48:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f6be00640 1 -- 172.21.15.37:0/1169990925 learned_addr learned my addr 172.21.15.37:0/1169990925 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f73400640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f7415cd80 0x7f1f7413b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f72a00640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7406e000 0x7f1f7413ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f6be00640 1 -- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f7415cd80 msgr2=0x7f1f7413b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f6be00640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f7415cd80 0x7f1f7413b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f6be00640 1 -- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7406e000 msgr2=0x7f1f7413ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f6be00640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7406e000 0x7f1f7413ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f6be00640 1 -- 172.21.15.37:0/1169990925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f741eaad0 con 0x7f1f740ce8d0 2024-05-30T06:48:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.635+0000 7f1f6be00640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ce8d0 0x7f1f741e8fe0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0098b0 tx=0x7f1f5c01b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.639+0000 7f1f6aa00640 1 -- 172.21.15.37:0/1169990925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0bf020 con 0x7f1f740ce8d0 2024-05-30T06:48:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.639+0000 7f1f6aa00640 1 -- 172.21.15.37:0/1169990925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5c004220 con 0x7f1f740ce8d0 2024-05-30T06:48:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.639+0000 7f1f79600640 1 -- 172.21.15.37:0/1169990925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f741e9a30 con 0x7f1f740ce8d0 2024-05-30T06:48:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.639+0000 7f1f6aa00640 1 -- 172.21.15.37:0/1169990925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0b5040 con 0x7f1f740ce8d0 2024-05-30T06:48:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.639+0000 7f1f79600640 1 -- 172.21.15.37:0/1169990925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f741e9ff0 con 0x7f1f740ce8d0 2024-05-30T06:48:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.639+0000 7f1f79600640 1 -- 172.21.15.37:0/1169990925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f74068b20 con 0x7f1f740ce8d0 2024-05-30T06:48:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.639+0000 7f1f6aa00640 1 -- 172.21.15.37:0/1169990925 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f1f5c0c2070 con 0x7f1f740ce8d0 2024-05-30T06:48:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.639+0000 7f1f6aa00640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1f50068c20 0x7f1f5006b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.639+0000 7f1f6aa00640 1 -- 172.21.15.37:0/1169990925 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f1f5c123890 con 0x7f1f740ce8d0 2024-05-30T06:48:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.639+0000 7f1f72a00640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1f50068c20 0x7f1f5006b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.643+0000 7f1f72a00640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1f50068c20 0x7f1f5006b0e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1f64000f70 tx=0x7f1f64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:27.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.643+0000 7f1f6aa00640 1 -- 172.21.15.37:0/1169990925 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f5c018710 con 0x7f1f740ce8d0 2024-05-30T06:48:27.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.811+0000 7f1f79600640 1 -- 172.21.15.37:0/1169990925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f741e8cc0 con 0x7f1f740ce8d0 2024-05-30T06:48:27.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.811+0000 7f1f6aa00640 1 -- 172.21.15.37:0/1169990925 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+13006 (secure 0 0 0) 0x7f1f5c0af3a0 con 0x7f1f740ce8d0 2024-05-30T06:48:27.812 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:27.812 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":52,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:48:26.457616+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/115371806":"2024-05-31T06:48:23.437165+0000","172.21.15.37:6834/115371806":"2024-05-31T06:48:23.437165+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:48:27.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.815+0000 7f1f79600640 1 -- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1f50068c20 msgr2=0x7f1f5006b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.815+0000 7f1f79600640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1f50068c20 0x7f1f5006b0e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1f64000f70 tx=0x7f1f64009040 comp rx=0 tx=0).stop 2024-05-30T06:48:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.815+0000 7f1f79600640 1 -- 172.21.15.37:0/1169990925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ce8d0 msgr2=0x7f1f741e8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.815+0000 7f1f79600640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ce8d0 0x7f1f741e8fe0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c0098b0 tx=0x7f1f5c01b950 comp rx=0 tx=0).stop 2024-05-30T06:48:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.815+0000 7f1f79600640 1 -- 172.21.15.37:0/1169990925 shutdown_connections 2024-05-30T06:48:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.815+0000 7f1f79600640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f7415cd80 0x7f1f7413b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.815+0000 7f1f79600640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ce8d0 0x7f1f741e8fe0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.815+0000 7f1f79600640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1f50068c20 0x7f1f5006b0e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.815+0000 7f1f79600640 1 --2- 172.21.15.37:0/1169990925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f7406e000 0x7f1f7413ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.815+0000 7f1f79600640 1 -- 172.21.15.37:0/1169990925 >> 172.21.15.37:0/1169990925 conn(0x7f1f740b23a0 msgr2=0x7f1f74071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.815+0000 7f1f79600640 1 -- 172.21.15.37:0/1169990925 shutdown_connections 2024-05-30T06:48:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.815+0000 7f1f79600640 1 -- 172.21.15.37:0/1169990925 wait complete. 2024-05-30T06:48:27.833 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:48:27.834 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:48:27.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.979+0000 7f4b98800640 1 Processor -- start 2024-05-30T06:48:27.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.979+0000 7f4b98800640 1 -- start start 2024-05-30T06:48:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.979+0000 7f4b98800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4b9009b800 0x7f4b9006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.979+0000 7f4b98800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b900d0840 con 0x7f4b9006dcf0 2024-05-30T06:48:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.979+0000 7f4b98800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9009bce0 con 0x7f4b9015ebc0 2024-05-30T06:48:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.979+0000 7f4b98800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4b900d0ae0 con 0x7f4b9009b800 2024-05-30T06:48:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.979+0000 7f4b96800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4b9006dcf0 0x7f4b9009aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52140/0 (socket says 172.21.15.37:52140) 2024-05-30T06:48:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.979+0000 7f4b96800640 1 -- 172.21.15.37:0/3272390128 learned_addr learned my addr 172.21.15.37:0/3272390128 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.979+0000 7f4b95400640 1 --2- 172.21.15.37:0/3272390128 >> v2:172.21.15.105:3300/0 conn(0x7f4b9009b800 0x7f4b9006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.979+0000 7f4b94a00640 1 -- 172.21.15.37:0/3272390128 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2111029390 0 0) 0x7f4b900d0840 con 0x7f4b9006dcf0 2024-05-30T06:48:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.979+0000 7f4b94a00640 1 -- 172.21.15.37:0/3272390128 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b78003530 con 0x7f4b9006dcf0 2024-05-30T06:48:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.979+0000 7f4b94a00640 1 -- 172.21.15.37:0/3272390128 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3430633308 0 0) 0x7f4b9009bce0 con 0x7f4b9015ebc0 2024-05-30T06:48:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b94a00640 1 -- 172.21.15.37:0/3272390128 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b900d0840 con 0x7f4b9015ebc0 2024-05-30T06:48:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b95400640 1 -- 172.21.15.37:0/3272390128 >> v1:172.21.15.105:6789/0 conn(0x7f4b9015ebc0 legacy=0x7f4b900d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b95400640 1 -- 172.21.15.37:0/3272390128 >> v1:172.21.15.37:6789/0 conn(0x7f4b9006dcf0 legacy=0x7f4b9009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b95400640 1 -- 172.21.15.37:0/3272390128 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b900d0dc0 con 0x7f4b9009b800 2024-05-30T06:48:27.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b95400640 1 --2- 172.21.15.37:0/3272390128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b9009b800 0x7f4b9006d7b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4b800097c0 tx=0x7f4b8001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fd0dc61732981b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:27.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b94a00640 1 -- 172.21.15.37:0/3272390128 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b800b0070 con 0x7f4b9009b800 2024-05-30T06:48:27.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b94a00640 1 -- 172.21.15.37:0/3272390128 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b800ab600 con 0x7f4b9009b800 2024-05-30T06:48:27.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b94a00640 1 -- 172.21.15.37:0/3272390128 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b800ab9d0 con 0x7f4b9009b800 2024-05-30T06:48:27.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b98800640 1 -- 172.21.15.37:0/3272390128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b9009b800 msgr2=0x7f4b9006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b98800640 1 --2- 172.21.15.37:0/3272390128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b9009b800 0x7f4b9006d7b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4b800097c0 tx=0x7f4b8001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b98800640 1 -- 172.21.15.37:0/3272390128 shutdown_connections 2024-05-30T06:48:27.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b98800640 1 --2- 172.21.15.37:0/3272390128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b9009b800 0x7f4b9006d7b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b98800640 1 -- 172.21.15.37:0/3272390128 >> 172.21.15.37:0/3272390128 conn(0x7f4b900b4060 msgr2=0x7f4b900b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:27.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.983+0000 7f4b98800640 1 -- 172.21.15.37:0/3272390128 shutdown_connections 2024-05-30T06:48:27.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b98800640 1 -- 172.21.15.37:0/3272390128 wait complete. 2024-05-30T06:48:27.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b98800640 1 Processor -- start 2024-05-30T06:48:27.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b98800640 1 -- start start 2024-05-30T06:48:27.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b98800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b9006dcf0 0x7f4b901539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b98800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b9009b800 0x7f4b90155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b98800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b9015ebc0 0x7f4b900b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b98800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b900cd3d0 con 0x7f4b9015ebc0 2024-05-30T06:48:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b98800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9009b3c0 con 0x7f4b9009b800 2024-05-30T06:48:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b98800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4b900cd550 con 0x7f4b9006dcf0 2024-05-30T06:48:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b96800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b9015ebc0 0x7f4b900b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b96800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b9015ebc0 0x7f4b900b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36280/0 (socket says 172.21.15.37:36280) 2024-05-30T06:48:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b95400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b9009b800 0x7f4b90155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b96800640 1 -- 172.21.15.37:0/1987712738 learned_addr learned my addr 172.21.15.37:0/1987712738 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b95e00640 1 --2- 172.21.15.37:0/1987712738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b9006dcf0 0x7f4b901539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b96800640 1 -- 172.21.15.37:0/1987712738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b9006dcf0 msgr2=0x7f4b901539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b96800640 1 --2- 172.21.15.37:0/1987712738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b9006dcf0 0x7f4b901539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b96800640 1 -- 172.21.15.37:0/1987712738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b9009b800 msgr2=0x7f4b90155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:27.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b96800640 1 --2- 172.21.15.37:0/1987712738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b9009b800 0x7f4b90155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:27.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b96800640 1 -- 172.21.15.37:0/1987712738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9015f520 con 0x7f4b9015ebc0 2024-05-30T06:48:27.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b96800640 1 --2- 172.21.15.37:0/1987712738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b9015ebc0 0x7f4b900b0360 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00caa0 tx=0x7f4b8c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:27.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b8a000640 1 -- 172.21.15.37:0/1987712738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c017070 con 0x7f4b9015ebc0 2024-05-30T06:48:27.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b8a000640 1 -- 172.21.15.37:0/1987712738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8c00ac00 con 0x7f4b9015ebc0 2024-05-30T06:48:27.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b8a000640 1 -- 172.21.15.37:0/1987712738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c012400 con 0x7f4b9015ebc0 2024-05-30T06:48:27.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.987+0000 7f4b98800640 1 -- 172.21.15.37:0/1987712738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9015f800 con 0x7f4b9015ebc0 2024-05-30T06:48:27.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.991+0000 7f4b98800640 1 -- 172.21.15.37:0/1987712738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b9015fdc0 con 0x7f4b9015ebc0 2024-05-30T06:48:27.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.991+0000 7f4b98800640 1 -- 172.21.15.37:0/1987712738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b90068bc0 con 0x7f4b9015ebc0 2024-05-30T06:48:27.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.991+0000 7f4b8a000640 1 -- 172.21.15.37:0/1987712738 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f4b8c01a070 con 0x7f4b9015ebc0 2024-05-30T06:48:27.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.991+0000 7f4b8a000640 1 --2- 172.21.15.37:0/1987712738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b74068bf0 0x7f4b7406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:27.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.991+0000 7f4b8a000640 1 -- 172.21.15.37:0/1987712738 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f4b8c0874f0 con 0x7f4b9015ebc0 2024-05-30T06:48:27.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.991+0000 7f4b95e00640 1 --2- 172.21.15.37:0/1987712738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b74068bf0 0x7f4b7406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:27.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.995+0000 7f4b95e00640 1 --2- 172.21.15.37:0/1987712738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b74068bf0 0x7f4b7406b0b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4b901faed0 tx=0x7f4b84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:27.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:27.995+0000 7f4b8a000640 1 -- 172.21.15.37:0/1987712738 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4b8c0568d0 con 0x7f4b9015ebc0 2024-05-30T06:48:28.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b98800640 1 -- 172.21.15.37:0/1987712738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4b9006eef0 con 0x7f4b9015ebc0 2024-05-30T06:48:28.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b8a000640 1 -- 172.21.15.37:0/1987712738 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) ==== 93+0+10 (secure 0 0 0) 0x7f4b8c05abd0 con 0x7f4b9015ebc0 2024-05-30T06:48:28.161 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:48:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b98800640 1 -- 172.21.15.37:0/1987712738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b74068bf0 msgr2=0x7f4b7406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b98800640 1 --2- 172.21.15.37:0/1987712738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b74068bf0 0x7f4b7406b0b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4b901faed0 tx=0x7f4b84009040 comp rx=0 tx=0).stop 2024-05-30T06:48:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b98800640 1 -- 172.21.15.37:0/1987712738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b9015ebc0 msgr2=0x7f4b900b0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b98800640 1 --2- 172.21.15.37:0/1987712738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b9015ebc0 0x7f4b900b0360 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00caa0 tx=0x7f4b8c00cf60 comp rx=0 tx=0).stop 2024-05-30T06:48:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b98800640 1 -- 172.21.15.37:0/1987712738 shutdown_connections 2024-05-30T06:48:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b98800640 1 --2- 172.21.15.37:0/1987712738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b9015ebc0 0x7f4b900b0360 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b98800640 1 --2- 172.21.15.37:0/1987712738 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4b74068bf0 0x7f4b7406b0b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b98800640 1 --2- 172.21.15.37:0/1987712738 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b9009b800 0x7f4b90155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b98800640 1 --2- 172.21.15.37:0/1987712738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b9006dcf0 0x7f4b901539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b98800640 1 -- 172.21.15.37:0/1987712738 >> 172.21.15.37:0/1987712738 conn(0x7f4b900b4060 msgr2=0x7f4b900b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b98800640 1 -- 172.21.15.37:0/1987712738 shutdown_connections 2024-05-30T06:48:28.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.163+0000 7f4b98800640 1 -- 172.21.15.37:0/1987712738 wait complete. 2024-05-30T06:48:28.184 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones' 2024-05-30T06:48:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe77ba00640 1 Processor -- start 2024-05-30T06:48:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe77ba00640 1 -- start start 2024-05-30T06:48:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe77ba00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe774160b90 0x7fe77409aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe77ba00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe774161020 0x7fe77409afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe77ba00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7740d0430 con 0x7fe7740b2e20 2024-05-30T06:48:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe77ba00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe7740b3200 con 0x7fe774161020 2024-05-30T06:48:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe77ba00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe7740d01e0 con 0x7fe774160b90 2024-05-30T06:48:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe779000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe7740b2e20 0x7fe774160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52148/0 (socket says 172.21.15.37:52148) 2024-05-30T06:48:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe779000640 1 -- 172.21.15.37:0/2220605587 learned_addr learned my addr 172.21.15.37:0/2220605587 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe779a00640 1 --2- 172.21.15.37:0/2220605587 >> v2:172.21.15.37:3300/0 conn(0x7fe774161020 0x7fe77409afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe773e00640 1 --2- 172.21.15.37:0/2220605587 >> v2:172.21.15.105:3300/0 conn(0x7fe774160b90 0x7fe77409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:28.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe779a00640 1 -- 172.21.15.37:0/2220605587 >> v2:172.21.15.105:3300/0 conn(0x7fe774160b90 msgr2=0x7fe77409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:28.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe779a00640 1 --2- 172.21.15.37:0/2220605587 >> v2:172.21.15.105:3300/0 conn(0x7fe774160b90 0x7fe77409aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:28.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe779a00640 1 -- 172.21.15.37:0/2220605587 >> v1:172.21.15.37:6789/0 conn(0x7fe7740b2e20 legacy=0x7fe774160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:28.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.327+0000 7fe779a00640 1 -- 172.21.15.37:0/2220605587 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7740d0710 con 0x7fe774161020 2024-05-30T06:48:28.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.331+0000 7fe779a00640 1 --2- 172.21.15.37:0/2220605587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe774161020 0x7fe77409afa0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe7740c5fe0 tx=0x7fe76c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21e52f5a13af312 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.331+0000 7fe773400640 1 -- 172.21.15.37:0/2220605587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0b2070 con 0x7fe774161020 2024-05-30T06:48:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.331+0000 7fe773400640 1 -- 172.21.15.37:0/2220605587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe76c0a58e0 con 0x7fe774161020 2024-05-30T06:48:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.331+0000 7fe773400640 1 -- 172.21.15.37:0/2220605587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0a5cb0 con 0x7fe774161020 2024-05-30T06:48:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.331+0000 7fe77ba00640 1 -- 172.21.15.37:0/2220605587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe774161020 msgr2=0x7fe77409afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.331+0000 7fe77ba00640 1 --2- 172.21.15.37:0/2220605587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe774161020 0x7fe77409afa0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe7740c5fe0 tx=0x7fe76c01c930 comp rx=0 tx=0).stop 2024-05-30T06:48:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.331+0000 7fe77ba00640 1 -- 172.21.15.37:0/2220605587 shutdown_connections 2024-05-30T06:48:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.331+0000 7fe77ba00640 1 --2- 172.21.15.37:0/2220605587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe774161020 0x7fe77409afa0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.331+0000 7fe77ba00640 1 --2- 172.21.15.37:0/2220605587 >> v2:172.21.15.105:3300/0 conn(0x7fe774160b90 0x7fe77409aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.331+0000 7fe77ba00640 1 -- 172.21.15.37:0/2220605587 >> 172.21.15.37:0/2220605587 conn(0x7fe7740b4100 msgr2=0x7fe7740b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.331+0000 7fe77ba00640 1 -- 172.21.15.37:0/2220605587 shutdown_connections 2024-05-30T06:48:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.331+0000 7fe77ba00640 1 -- 172.21.15.37:0/2220605587 wait complete. 2024-05-30T06:48:28.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe77ba00640 1 Processor -- start 2024-05-30T06:48:28.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe77ba00640 1 -- start start 2024-05-30T06:48:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe77ba00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7740b2e20 0x7fe774154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe77ba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe774160b90 0x7fe77415fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe77ba00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe774161020 0x7fe7740c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe77ba00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7740ce410 con 0x7fe774161020 2024-05-30T06:48:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe77ba00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe7740ce290 con 0x7fe7740b2e20 2024-05-30T06:48:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe77ba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe7741697c0 con 0x7fe774160b90 2024-05-30T06:48:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe779a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe774161020 0x7fe7740c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe779a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe774161020 0x7fe7740c5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36298/0 (socket says 172.21.15.37:36298) 2024-05-30T06:48:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe779a00640 1 -- 172.21.15.37:0/976571151 learned_addr learned my addr 172.21.15.37:0/976571151 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe779000640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7740b2e20 0x7fe774154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe773e00640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe774160b90 0x7fe77415fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe779a00640 1 -- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe774160b90 msgr2=0x7fe77415fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe779a00640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe774160b90 0x7fe77415fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe779a00640 1 -- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7740b2e20 msgr2=0x7fe774154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe779a00640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7740b2e20 0x7fe774154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe779a00640 1 -- 172.21.15.37:0/976571151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77415e5b0 con 0x7fe774161020 2024-05-30T06:48:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe779000640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7740b2e20 0x7fe774154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe779a00640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe774161020 0x7fe7740c5110 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe76c01a560 tx=0x7fe76c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe770c00640 1 -- 172.21.15.37:0/976571151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0b2050 con 0x7fe774161020 2024-05-30T06:48:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe770c00640 1 -- 172.21.15.37:0/976571151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe76c0be070 con 0x7fe774161020 2024-05-30T06:48:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe77ba00640 1 -- 172.21.15.37:0/976571151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77415e2d0 con 0x7fe774161020 2024-05-30T06:48:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe770c00640 1 -- 172.21.15.37:0/976571151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0ada90 con 0x7fe774161020 2024-05-30T06:48:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe77ba00640 1 -- 172.21.15.37:0/976571151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe774143ba0 con 0x7fe774161020 2024-05-30T06:48:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.335+0000 7fe77ba00640 1 -- 172.21.15.37:0/976571151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe774068b20 con 0x7fe774161020 2024-05-30T06:48:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.339+0000 7fe770c00640 1 -- 172.21.15.37:0/976571151 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fe76c0adc30 con 0x7fe774161020 2024-05-30T06:48:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.339+0000 7fe770c00640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe754068bf0 0x7fe75406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.339+0000 7fe770c00640 1 -- 172.21.15.37:0/976571151 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7fe76c1226c0 con 0x7fe774161020 2024-05-30T06:48:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.339+0000 7fe779000640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe754068bf0 0x7fe75406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:28.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.339+0000 7fe779000640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe754068bf0 0x7fe75406b0b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe7741554c0 tx=0x7fe768009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.343+0000 7fe770c00640 1 -- 172.21.15.37:0/976571151 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe77415e5b0 con 0x7fe774161020 2024-05-30T06:48:28.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:28.567+0000 7fe77ba00640 1 -- 172.21.15.37:0/976571151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]} v 0) -- 0x7fe7740c8e20 con 0x7fe774161020 2024-05-30T06:48:29.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.471+0000 7fe770c00640 1 -- 172.21.15.37:0/976571151 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]}]=0 v296) ==== 165+0+0 (secure 0 0 0) 0x7fe76c016520 con 0x7fe774161020 2024-05-30T06:48:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.475+0000 7fe77ba00640 1 -- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe754068bf0 msgr2=0x7fe75406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.475+0000 7fe77ba00640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe754068bf0 0x7fe75406b0b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe7741554c0 tx=0x7fe768009040 comp rx=0 tx=0).stop 2024-05-30T06:48:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.475+0000 7fe77ba00640 1 -- 172.21.15.37:0/976571151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe774161020 msgr2=0x7fe7740c5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.475+0000 7fe77ba00640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe774161020 0x7fe7740c5110 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe76c01a560 tx=0x7fe76c0196d0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.475+0000 7fe77ba00640 1 -- 172.21.15.37:0/976571151 shutdown_connections 2024-05-30T06:48:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.475+0000 7fe77ba00640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe774161020 0x7fe7740c5110 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.475+0000 7fe77ba00640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe774160b90 0x7fe77415fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.475+0000 7fe77ba00640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe754068bf0 0x7fe75406b0b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.475+0000 7fe77ba00640 1 --2- 172.21.15.37:0/976571151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7740b2e20 0x7fe774154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.475+0000 7fe77ba00640 1 -- 172.21.15.37:0/976571151 >> 172.21.15.37:0/976571151 conn(0x7fe7740b4100 msgr2=0x7fe774071800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:29.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.475+0000 7fe77ba00640 1 -- 172.21.15.37:0/976571151 shutdown_connections 2024-05-30T06:48:29.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.475+0000 7fe77ba00640 1 -- 172.21.15.37:0/976571151 wait complete. 2024-05-30T06:48:29.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:48:29.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a9de00640 1 Processor -- start 2024-05-30T06:48:29.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a9de00640 1 -- start start 2024-05-30T06:48:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a9de00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a98158e00 0x7f0a980b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a9de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a981624a0 0x7f0a9806b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a9de00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a98071410 con 0x7f0a9806bea0 2024-05-30T06:48:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a9de00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0a980b4790 con 0x7f0a98158e00 2024-05-30T06:48:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a9de00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0a98162980 con 0x7f0a981624a0 2024-05-30T06:48:29.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a96a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a98158e00 0x7f0a980b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:29.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a96a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a98158e00 0x7f0a980b5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36302/0 (socket says 172.21.15.37:36302) 2024-05-30T06:48:29.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a96a00640 1 -- 172.21.15.37:0/1153264657 learned_addr learned my addr 172.21.15.37:0/1153264657 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:29.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a96000640 1 --2- 172.21.15.37:0/1153264657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a981624a0 0x7f0a9806b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:29.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a96a00640 1 -- 172.21.15.37:0/1153264657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a981624a0 msgr2=0x7f0a9806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:29.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a96a00640 1 --2- 172.21.15.37:0/1153264657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a981624a0 0x7f0a9806b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a96a00640 1 -- 172.21.15.37:0/1153264657 >> v1:172.21.15.105:6789/0 conn(0x7f0a9806bea0 legacy=0x7f0a980b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:29.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.647+0000 7f0a96a00640 1 -- 172.21.15.37:0/1153264657 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a98162c60 con 0x7f0a98158e00 2024-05-30T06:48:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.651+0000 7f0a96a00640 1 --2- 172.21.15.37:0/1153264657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a98158e00 0x7f0a980b5a20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009870 tx=0x7f0a8801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d912b800d3952271 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:29.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.651+0000 7f0a95600640 1 -- 172.21.15.37:0/1153264657 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a880ab650 con 0x7f0a98158e00 2024-05-30T06:48:29.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.651+0000 7f0a95600640 1 -- 172.21.15.37:0/1153264657 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a880b0070 con 0x7f0a98158e00 2024-05-30T06:48:29.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.651+0000 7f0a95600640 1 -- 172.21.15.37:0/1153264657 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a880aba10 con 0x7f0a98158e00 2024-05-30T06:48:29.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.651+0000 7f0a9de00640 1 -- 172.21.15.37:0/1153264657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a98158e00 msgr2=0x7f0a980b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:29.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.651+0000 7f0a9de00640 1 --2- 172.21.15.37:0/1153264657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a98158e00 0x7f0a980b5a20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009870 tx=0x7f0a8801c560 comp rx=0 tx=0).stop 2024-05-30T06:48:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.651+0000 7f0a9de00640 1 -- 172.21.15.37:0/1153264657 shutdown_connections 2024-05-30T06:48:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.651+0000 7f0a9de00640 1 --2- 172.21.15.37:0/1153264657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a981624a0 0x7f0a9806b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.651+0000 7f0a9de00640 1 --2- 172.21.15.37:0/1153264657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a98158e00 0x7f0a980b5a20 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.651+0000 7f0a9de00640 1 -- 172.21.15.37:0/1153264657 >> 172.21.15.37:0/1153264657 conn(0x7f0a9806f110 msgr2=0x7f0a9806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.651+0000 7f0a9de00640 1 -- 172.21.15.37:0/1153264657 shutdown_connections 2024-05-30T06:48:29.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.651+0000 7f0a9de00640 1 -- 172.21.15.37:0/1153264657 wait complete. 2024-05-30T06:48:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a9de00640 1 Processor -- start 2024-05-30T06:48:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a9de00640 1 -- start start 2024-05-30T06:48:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a9de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a9806bea0 0x7f0a9814d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a9de00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a98158e00 0x7f0a98161210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a9de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a981624a0 0x7f0a980b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a9de00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a980b60e0 con 0x7f0a981624a0 2024-05-30T06:48:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a9de00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0a980b5f60 con 0x7f0a98158e00 2024-05-30T06:48:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a9de00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9815f290 con 0x7f0a9806bea0 2024-05-30T06:48:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a97400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a981624a0 0x7f0a980b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a97400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a981624a0 0x7f0a980b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36306/0 (socket says 172.21.15.37:36306) 2024-05-30T06:48:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a97400640 1 -- 172.21.15.37:0/466903399 learned_addr learned my addr 172.21.15.37:0/466903399 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a96a00640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a9806bea0 0x7f0a9814d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a96000640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a98158e00 0x7f0a98161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a97400640 1 -- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a9806bea0 msgr2=0x7f0a9814d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a97400640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a9806bea0 0x7f0a9814d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a97400640 1 -- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a98158e00 msgr2=0x7f0a98161210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:29.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a97400640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a98158e00 0x7f0a98161210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a97400640 1 -- 172.21.15.37:0/466903399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9815a530 con 0x7f0a981624a0 2024-05-30T06:48:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a97400640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a981624a0 0x7f0a980b2a80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000c740 tx=0x7f0a9000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a8f400640 1 -- 172.21.15.37:0/466903399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90016020 con 0x7f0a981624a0 2024-05-30T06:48:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a8f400640 1 -- 172.21.15.37:0/466903399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a9000ce50 con 0x7f0a981624a0 2024-05-30T06:48:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a8f400640 1 -- 172.21.15.37:0/466903399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90003980 con 0x7f0a981624a0 2024-05-30T06:48:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a9de00640 1 -- 172.21.15.37:0/466903399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9814e040 con 0x7f0a981624a0 2024-05-30T06:48:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.655+0000 7f0a9de00640 1 -- 172.21.15.37:0/466903399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9815aab0 con 0x7f0a981624a0 2024-05-30T06:48:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.659+0000 7f0a9de00640 1 -- 172.21.15.37:0/466903399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a98068bc0 con 0x7f0a981624a0 2024-05-30T06:48:29.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.659+0000 7f0a8f400640 1 -- 172.21.15.37:0/466903399 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f0a90003b20 con 0x7f0a981624a0 2024-05-30T06:48:29.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.659+0000 7f0a8f400640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a78068bf0 0x7f0a7806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:29.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.659+0000 7f0a8f400640 1 -- 172.21.15.37:0/466903399 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f0a90087350 con 0x7f0a981624a0 2024-05-30T06:48:29.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.659+0000 7f0a96a00640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a78068bf0 0x7f0a7806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.659+0000 7f0a96a00640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a78068bf0 0x7f0a7806b0b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0a880af000 tx=0x7f0a880a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:29.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.663+0000 7f0a8f400640 1 -- 172.21.15.37:0/466903399 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a90020020 con 0x7f0a981624a0 2024-05-30T06:48:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.831+0000 7f0a9de00640 1 -- 172.21.15.37:0/466903399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0a98070a20 con 0x7f0a981624a0 2024-05-30T06:48:29.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.835+0000 7f0a8f400640 1 -- 172.21.15.37:0/466903399 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f0a90056730 con 0x7f0a981624a0 2024-05-30T06:48:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.835+0000 7f0a9de00640 1 -- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a78068bf0 msgr2=0x7f0a7806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.835+0000 7f0a9de00640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a78068bf0 0x7f0a7806b0b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0a880af000 tx=0x7f0a880a7000 comp rx=0 tx=0).stop 2024-05-30T06:48:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.835+0000 7f0a9de00640 1 -- 172.21.15.37:0/466903399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a981624a0 msgr2=0x7f0a980b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.835+0000 7f0a9de00640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a981624a0 0x7f0a980b2a80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000c740 tx=0x7f0a9000cc00 comp rx=0 tx=0).stop 2024-05-30T06:48:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.835+0000 7f0a9de00640 1 -- 172.21.15.37:0/466903399 shutdown_connections 2024-05-30T06:48:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.835+0000 7f0a9de00640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a981624a0 0x7f0a980b2a80 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.835+0000 7f0a9de00640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a78068bf0 0x7f0a7806b0b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.835+0000 7f0a9de00640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a98158e00 0x7f0a98161210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.835+0000 7f0a9de00640 1 --2- 172.21.15.37:0/466903399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a9806bea0 0x7f0a9814d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.835+0000 7f0a9de00640 1 -- 172.21.15.37:0/466903399 >> 172.21.15.37:0/466903399 conn(0x7f0a9806f110 msgr2=0x7f0a98150c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.835+0000 7f0a9de00640 1 -- 172.21.15.37:0/466903399 shutdown_connections 2024-05-30T06:48:29.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:29.835+0000 7f0a9de00640 1 -- 172.21.15.37:0/466903399 wait complete. 2024-05-30T06:48:29.853 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:48:29.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:48:29.959 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:48:30.034 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:48:30.071 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:48:30.071 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:48:30.080 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:48:30.081 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:48:30.081 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:48:30.090 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:48:30.090 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:48:30.090 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:48:30.136 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:48:30.136 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:48:30.136 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:48:30.147 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:48:30.147 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T06:48:30.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:48:30.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.319+0000 7f447ce00640 1 Processor -- start 2024-05-30T06:48:30.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f447ce00640 1 -- start start 2024-05-30T06:48:30.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f447ce00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f44780b2e20 0x7f4478160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:30.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f447ce00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44781609c0 0x7f4478160e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:30.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f447ce00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44780d0430 con 0x7f44780cd280 2024-05-30T06:48:30.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f447ce00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f44780b3200 con 0x7f44781609c0 2024-05-30T06:48:30.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f447ce00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f44780d01e0 con 0x7f44780b2e20 2024-05-30T06:48:30.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f446d400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44781609c0 0x7f4478160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:30.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f446d400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44781609c0 0x7f4478160e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36312/0 (socket says 172.21.15.37:36312) 2024-05-30T06:48:30.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f446d400640 1 -- 172.21.15.37:0/3941003583 learned_addr learned my addr 172.21.15.37:0/3941003583 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:30.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f4475e00640 1 --2- 172.21.15.37:0/3941003583 >> v2:172.21.15.105:3300/0 conn(0x7f44780b2e20 0x7f4478160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:30.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f446d400640 1 -- 172.21.15.37:0/3941003583 >> v2:172.21.15.105:3300/0 conn(0x7f44780b2e20 msgr2=0x7f4478160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:30.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f446d400640 1 --2- 172.21.15.37:0/3941003583 >> v2:172.21.15.105:3300/0 conn(0x7f44780b2e20 0x7f4478160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f446d400640 1 -- 172.21.15.37:0/3941003583 >> v1:172.21.15.105:6789/0 conn(0x7f44780cd280 legacy=0x7f44780cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:30.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f446d400640 1 -- 172.21.15.37:0/3941003583 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44780d0710 con 0x7f44781609c0 2024-05-30T06:48:30.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.323+0000 7f4475e00640 1 --2- 172.21.15.37:0/3941003583 >> v2:172.21.15.105:3300/0 conn(0x7f44780b2e20 0x7f4478160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:30.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f446d400640 1 --2- 172.21.15.37:0/3941003583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44781609c0 0x7f4478160e50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f44780b5200 tx=0x7f446001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662188e8aec4ce4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f4475400640 1 -- 172.21.15.37:0/3941003583 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44600b2070 con 0x7f44781609c0 2024-05-30T06:48:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f4475400640 1 -- 172.21.15.37:0/3941003583 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44600ad640 con 0x7f44781609c0 2024-05-30T06:48:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f4475400640 1 -- 172.21.15.37:0/3941003583 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44600ada10 con 0x7f44781609c0 2024-05-30T06:48:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f447ce00640 1 -- 172.21.15.37:0/3941003583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44781609c0 msgr2=0x7f4478160e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f447ce00640 1 --2- 172.21.15.37:0/3941003583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44781609c0 0x7f4478160e50 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f44780b5200 tx=0x7f446001c4e0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f447ce00640 1 -- 172.21.15.37:0/3941003583 shutdown_connections 2024-05-30T06:48:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f447ce00640 1 --2- 172.21.15.37:0/3941003583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44781609c0 0x7f4478160e50 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f447ce00640 1 --2- 172.21.15.37:0/3941003583 >> v2:172.21.15.105:3300/0 conn(0x7f44780b2e20 0x7f4478160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f447ce00640 1 -- 172.21.15.37:0/3941003583 >> 172.21.15.37:0/3941003583 conn(0x7f44780b4100 msgr2=0x7f44780b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:30.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f447ce00640 1 -- 172.21.15.37:0/3941003583 shutdown_connections 2024-05-30T06:48:30.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f447ce00640 1 -- 172.21.15.37:0/3941003583 wait complete. 2024-05-30T06:48:30.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f447ce00640 1 Processor -- start 2024-05-30T06:48:30.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.327+0000 7f447ce00640 1 -- start start 2024-05-30T06:48:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f447ce00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44780b2e20 0x7f4478148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f447ce00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44780cd280 0x7f44780c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f447ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44781609c0 0x7f4478159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f447ce00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4478169940 con 0x7f44781609c0 2024-05-30T06:48:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f447ce00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f44781697c0 con 0x7f44780cd280 2024-05-30T06:48:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f447ce00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4478169ac0 con 0x7f44780b2e20 2024-05-30T06:48:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f4476800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44781609c0 0x7f4478159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f4475e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44780b2e20 0x7f4478148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f4476800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44781609c0 0x7f4478159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36316/0 (socket says 172.21.15.37:36316) 2024-05-30T06:48:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f4476800640 1 -- 172.21.15.37:0/2323736412 learned_addr learned my addr 172.21.15.37:0/2323736412 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f446d400640 1 --2- 172.21.15.37:0/2323736412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44780cd280 0x7f44780c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f4476800640 1 -- 172.21.15.37:0/2323736412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44780b2e20 msgr2=0x7f4478148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f4476800640 1 --2- 172.21.15.37:0/2323736412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44780b2e20 0x7f4478148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f4476800640 1 -- 172.21.15.37:0/2323736412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44780cd280 msgr2=0x7f44780c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f4476800640 1 --2- 172.21.15.37:0/2323736412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44780cd280 0x7f44780c6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f4476800640 1 -- 172.21.15.37:0/2323736412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44780c7430 con 0x7f44781609c0 2024-05-30T06:48:30.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f4476800640 1 --2- 172.21.15.37:0/2323736412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44781609c0 0x7f4478159550 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f447000b410 tx=0x7f447000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:30.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f446ea00640 1 -- 172.21.15.37:0/2323736412 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470015020 con 0x7f44781609c0 2024-05-30T06:48:30.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f446ea00640 1 -- 172.21.15.37:0/2323736412 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4470011870 con 0x7f44781609c0 2024-05-30T06:48:30.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f447ce00640 1 -- 172.21.15.37:0/2323736412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447815cad0 con 0x7f44781609c0 2024-05-30T06:48:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f446ea00640 1 -- 172.21.15.37:0/2323736412 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470011c60 con 0x7f44781609c0 2024-05-30T06:48:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f447ce00640 1 -- 172.21.15.37:0/2323736412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f447815d090 con 0x7f44781609c0 2024-05-30T06:48:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f447ce00640 1 -- 172.21.15.37:0/2323736412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4478068b20 con 0x7f44781609c0 2024-05-30T06:48:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.331+0000 7f446ea00640 1 -- 172.21.15.37:0/2323736412 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f4470018020 con 0x7f44781609c0 2024-05-30T06:48:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.335+0000 7f446ea00640 1 --2- 172.21.15.37:0/2323736412 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4454068bf0 0x7f445406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.335+0000 7f446ea00640 1 -- 172.21.15.37:0/2323736412 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f4470087670 con 0x7f44781609c0 2024-05-30T06:48:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.335+0000 7f4475e00640 1 --2- 172.21.15.37:0/2323736412 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4454068bf0 0x7f445406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.335+0000 7f4475e00640 1 --2- 172.21.15.37:0/2323736412 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4454068bf0 0x7f445406b0b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f446800f500 tx=0x7f4468007770 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.339+0000 7f446ea00640 1 -- 172.21.15.37:0/2323736412 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f447001f020 con 0x7f44781609c0 2024-05-30T06:48:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f447ce00640 1 -- 172.21.15.37:0/2323736412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44780ce860 con 0x7f44781609c0 2024-05-30T06:48:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f446ea00640 1 -- 172.21.15.37:0/2323736412 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+3875 (secure 0 0 0) 0x7f4470056a50 con 0x7f44781609c0 2024-05-30T06:48:30.538 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:30.538 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5183,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/2692603987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2692603987},{"type":"v1","addr":"172.21.15.105:6836","nonce":2692603987}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5539,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2559528007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2559528007},{"type":"v1","addr":"172.21.15.105:6837","nonce":2559528007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2198221961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2198221961},{"type":"v1","addr":"172.21.15.37:6833","nonce":2198221961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6156,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/4236797984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":4236797984},{"type":"v1","addr":"172.21.15.37:6835","nonce":4236797984}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[]} 2024-05-30T06:48:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 30 2024-05-30T06:48:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f447ce00640 1 -- 172.21.15.37:0/2323736412 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4454068bf0 msgr2=0x7f445406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f447ce00640 1 --2- 172.21.15.37:0/2323736412 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4454068bf0 0x7f445406b0b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f446800f500 tx=0x7f4468007770 comp rx=0 tx=0).stop 2024-05-30T06:48:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f447ce00640 1 -- 172.21.15.37:0/2323736412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44781609c0 msgr2=0x7f4478159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f447ce00640 1 --2- 172.21.15.37:0/2323736412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44781609c0 0x7f4478159550 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f447000b410 tx=0x7f447000b8d0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f447ce00640 1 -- 172.21.15.37:0/2323736412 shutdown_connections 2024-05-30T06:48:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f447ce00640 1 --2- 172.21.15.37:0/2323736412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44781609c0 0x7f4478159550 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f447ce00640 1 --2- 172.21.15.37:0/2323736412 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4454068bf0 0x7f445406b0b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f447ce00640 1 --2- 172.21.15.37:0/2323736412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44780cd280 0x7f44780c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f447ce00640 1 --2- 172.21.15.37:0/2323736412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44780b2e20 0x7f4478148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f447ce00640 1 -- 172.21.15.37:0/2323736412 >> 172.21.15.37:0/2323736412 conn(0x7f44780b4100 msgr2=0x7f4478074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f447ce00640 1 -- 172.21.15.37:0/2323736412 shutdown_connections 2024-05-30T06:48:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.539+0000 7f447ce00640 1 -- 172.21.15.37:0/2323736412 wait complete. 2024-05-30T06:48:30.560 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T06:48:30.560 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T06:48:30.561 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T06:48:30.561 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:48:30.561 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T06:48:30.561 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T06:48:30.561 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T06:48:30.561 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:48:30.561 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T06:48:30.562 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T06:48:30.562 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T06:48:30.562 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:48:30.562 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T06:48:30.562 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T06:48:30.562 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T06:48:30.562 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:48:30.572 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T06:48:30.572 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T06:48:30.573 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T06:48:30.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T06:48:30.576 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T06:48:30.577 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T06:48:30.578 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T06:48:30.578 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T06:48:30.618 INFO:tasks.ceph.mds.a:Started 2024-05-30T06:48:30.619 DEBUG:teuthology.parallel:result is None 2024-05-30T06:48:30.621 INFO:tasks.ceph.mds.c:Started 2024-05-30T06:48:30.621 INFO:tasks.ceph.mds.b:Started 2024-05-30T06:48:30.621 DEBUG:teuthology.parallel:result is None 2024-05-30T06:48:30.622 DEBUG:teuthology.parallel:result is None 2024-05-30T06:48:30.623 INFO:tasks.ceph.mds.d:Started 2024-05-30T06:48:30.624 DEBUG:teuthology.parallel:result is None 2024-05-30T06:48:30.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T06:48:30.706 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-30T06:48:30.707 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-30T06:48:30.712 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-05-30T06:48:30.715 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-05-30T06:48:30.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.771+0000 7f6bc4800640 1 Processor -- start 2024-05-30T06:48:30.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.771+0000 7f6bc4800640 1 -- start start 2024-05-30T06:48:30.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc4800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6bbc09aa60 0x7f6bbc09ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:30.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc4800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bbc09b3b0 con 0x7f6bbc09b800 2024-05-30T06:48:30.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc4800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bbc0d0840 con 0x7f6bbc15ebc0 2024-05-30T06:48:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc4800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6bbc06dec0 con 0x7f6bbc09aa60 2024-05-30T06:48:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc1400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6bbc09b800 0x7f6bbc06d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52160/0 (socket says 172.21.15.37:52160) 2024-05-30T06:48:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc1400640 1 -- 172.21.15.37:0/2348295763 learned_addr learned my addr 172.21.15.37:0/2348295763 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc2800640 1 --2- 172.21.15.37:0/2348295763 >> v2:172.21.15.105:3300/0 conn(0x7f6bbc09aa60 0x7f6bbc09ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc0a00640 1 -- 172.21.15.37:0/2348295763 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3811616389 0 0) 0x7f6bac001120 con 0x7f6bbc09b800 2024-05-30T06:48:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc0a00640 1 -- 172.21.15.37:0/2348295763 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ba4003530 con 0x7f6bbc09b800 2024-05-30T06:48:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc0a00640 1 -- 172.21.15.37:0/2348295763 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1625855080 0 0) 0x7f6bbc0d0840 con 0x7f6bbc15ebc0 2024-05-30T06:48:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc2800640 1 -- 172.21.15.37:0/2348295763 >> v1:172.21.15.105:6789/0 conn(0x7f6bbc15ebc0 legacy=0x7f6bbc0d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc2800640 1 -- 172.21.15.37:0/2348295763 >> v1:172.21.15.37:6789/0 conn(0x7f6bbc09b800 legacy=0x7f6bbc06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc2800640 1 -- 172.21.15.37:0/2348295763 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bbc09bce0 con 0x7f6bbc09aa60 2024-05-30T06:48:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.775+0000 7f6bc2800640 1 --2- 172.21.15.37:0/2348295763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bbc09aa60 0x7f6bbc09ae70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009d90 tx=0x7f6bb801c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f09064556d32b24 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc0a00640 1 -- 172.21.15.37:0/2348295763 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac001850 con 0x7f6bbc09aa60 2024-05-30T06:48:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc0a00640 1 -- 172.21.15.37:0/2348295763 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb80a6440 con 0x7f6bbc09aa60 2024-05-30T06:48:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc0a00640 1 -- 172.21.15.37:0/2348295763 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80a6810 con 0x7f6bbc09aa60 2024-05-30T06:48:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 -- 172.21.15.37:0/2348295763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bbc09aa60 msgr2=0x7f6bbc09ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:30.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 --2- 172.21.15.37:0/2348295763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bbc09aa60 0x7f6bbc09ae70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009d90 tx=0x7f6bb801c7b0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 -- 172.21.15.37:0/2348295763 shutdown_connections 2024-05-30T06:48:30.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 --2- 172.21.15.37:0/2348295763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bbc09aa60 0x7f6bbc09ae70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 -- 172.21.15.37:0/2348295763 >> 172.21.15.37:0/2348295763 conn(0x7f6bbc0b4060 msgr2=0x7f6bbc0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:30.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 -- 172.21.15.37:0/2348295763 shutdown_connections 2024-05-30T06:48:30.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 -- 172.21.15.37:0/2348295763 wait complete. 2024-05-30T06:48:30.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 Processor -- start 2024-05-30T06:48:30.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 -- start start 2024-05-30T06:48:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc09aa60 0x7f6bbc156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bbc09b800 0x7f6bbc0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bbc15ebc0 0x7f6bbc0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc0cd3d0 con 0x7f6bbc09aa60 2024-05-30T06:48:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc15efa0 con 0x7f6bbc09b800 2024-05-30T06:48:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc4800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6bbc0cd550 con 0x7f6bbc15ebc0 2024-05-30T06:48:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc09aa60 0x7f6bbc156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc09aa60 0x7f6bbc156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36376/0 (socket says 172.21.15.37:36376) 2024-05-30T06:48:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.779+0000 7f6bc1e00640 1 -- 172.21.15.37:0/2313300438 learned_addr learned my addr 172.21.15.37:0/2313300438 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bc2800640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bbc15ebc0 0x7f6bbc0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bc1400640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bbc09b800 0x7f6bbc0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bc1e00640 1 -- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bbc15ebc0 msgr2=0x7f6bbc0c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bc1e00640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bbc15ebc0 0x7f6bbc0c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bc1e00640 1 -- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bbc09b800 msgr2=0x7f6bbc0c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bc1e00640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bbc09b800 0x7f6bbc0c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bc1e00640 1 -- 172.21.15.37:0/2313300438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bbc0c9640 con 0x7f6bbc09aa60 2024-05-30T06:48:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bc1400640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bbc09b800 0x7f6bbc0c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bc1e00640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc09aa60 0x7f6bbc156160 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c480 tx=0x7f6bb000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bb6000640 1 -- 172.21.15.37:0/2313300438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0005480 con 0x7f6bbc09aa60 2024-05-30T06:48:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bb6000640 1 -- 172.21.15.37:0/2313300438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb0003600 con 0x7f6bbc09aa60 2024-05-30T06:48:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bb6000640 1 -- 172.21.15.37:0/2313300438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb00039f0 con 0x7f6bbc09aa60 2024-05-30T06:48:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bc4800640 1 -- 172.21.15.37:0/2313300438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bbc15f700 con 0x7f6bbc09aa60 2024-05-30T06:48:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bc4800640 1 -- 172.21.15.37:0/2313300438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bbc15fcc0 con 0x7f6bbc09aa60 2024-05-30T06:48:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bc4800640 1 -- 172.21.15.37:0/2313300438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bbc0c9810 con 0x7f6bbc09aa60 2024-05-30T06:48:30.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bb6000640 1 -- 172.21.15.37:0/2313300438 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f6bb0003b90 con 0x7f6bbc09aa60 2024-05-30T06:48:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bb6000640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ba0068bf0 0x7f6ba006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.783+0000 7f6bb6000640 1 -- 172.21.15.37:0/2313300438 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 4943+0+0 (secure 0 0 0) 0x7f6bb00873a0 con 0x7f6bbc09aa60 2024-05-30T06:48:30.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.787+0000 7f6bc1400640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ba0068bf0 0x7f6ba006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:30.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.787+0000 7f6bc1400640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ba0068bf0 0x7f6ba006b0b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0013c0 tx=0x7f6bac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:30.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.791+0000 7f6bb6000640 1 -- 172.21.15.37:0/2313300438 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6bb0056f10 con 0x7f6bbc09aa60 2024-05-30T06:48:30.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:30.963+0000 7f6bc4800640 1 -- 172.21.15.37:0/2313300438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6bbc070ac0 con 0x7f6bbc09aa60 2024-05-30T06:48:31.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.487+0000 7f6bb6000640 1 -- 172.21.15.37:0/2313300438 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v54) ==== 97+0+0 (secure 0 0 0) 0x7f6bb0056810 con 0x7f6bbc09aa60 2024-05-30T06:48:31.486 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-30T06:48:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.491+0000 7f6bc4800640 1 -- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ba0068bf0 msgr2=0x7f6ba006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.491+0000 7f6bc4800640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ba0068bf0 0x7f6ba006b0b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0013c0 tx=0x7f6bac009040 comp rx=0 tx=0).stop 2024-05-30T06:48:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.491+0000 7f6bc4800640 1 -- 172.21.15.37:0/2313300438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc09aa60 msgr2=0x7f6bbc156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.491+0000 7f6bc4800640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc09aa60 0x7f6bbc156160 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c480 tx=0x7f6bb000c940 comp rx=0 tx=0).stop 2024-05-30T06:48:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.491+0000 7f6bc4800640 1 -- 172.21.15.37:0/2313300438 shutdown_connections 2024-05-30T06:48:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.491+0000 7f6bc4800640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bbc15ebc0 0x7f6bbc0c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.491+0000 7f6bc4800640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ba0068bf0 0x7f6ba006b0b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.491+0000 7f6bc4800640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bbc09b800 0x7f6bbc0c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.491+0000 7f6bc4800640 1 --2- 172.21.15.37:0/2313300438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc09aa60 0x7f6bbc156160 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.491+0000 7f6bc4800640 1 -- 172.21.15.37:0/2313300438 >> 172.21.15.37:0/2313300438 conn(0x7f6bbc0b4060 msgr2=0x7f6bbc0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:31.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.491+0000 7f6bc4800640 1 -- 172.21.15.37:0/2313300438 shutdown_connections 2024-05-30T06:48:31.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.491+0000 7f6bc4800640 1 -- 172.21.15.37:0/2313300438 wait complete. 2024-05-30T06:48:31.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T06:48:31.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.655+0000 7f40fca00640 1 Processor -- start 2024-05-30T06:48:31.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40fca00640 1 -- start start 2024-05-30T06:48:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40fca00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f40f80b2e20 0x7f40f8160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40fca00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f40f81609c0 0x7f40f8160e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:31.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40fca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40f80cd280 0x7f40f80cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40fca00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f40f80b3200 con 0x7f40f81609c0 2024-05-30T06:48:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40fca00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f40f80d01e0 con 0x7f40f80b2e20 2024-05-30T06:48:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40fca00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f40f80b33a0 con 0x7f40f80cd280 2024-05-30T06:48:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40efe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f40f81609c0 0x7f40f8160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40efe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f40f81609c0 0x7f40f8160e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36392/0 (socket says 172.21.15.37:36392) 2024-05-30T06:48:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40efe00640 1 -- 172.21.15.37:0/4210682554 learned_addr learned my addr 172.21.15.37:0/4210682554 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40f5e00640 1 --2- 172.21.15.37:0/4210682554 >> v2:172.21.15.105:3300/0 conn(0x7f40f80b2e20 0x7f40f8160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40f6800640 1 --2- 172.21.15.37:0/4210682554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40f80cd280 0x7f40f80cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40efe00640 1 -- 172.21.15.37:0/4210682554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40f80cd280 msgr2=0x7f40f80cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40efe00640 1 --2- 172.21.15.37:0/4210682554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40f80cd280 0x7f40f80cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40efe00640 1 -- 172.21.15.37:0/4210682554 >> v2:172.21.15.105:3300/0 conn(0x7f40f80b2e20 msgr2=0x7f40f8160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:31.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40efe00640 1 --2- 172.21.15.37:0/4210682554 >> v2:172.21.15.105:3300/0 conn(0x7f40f80b2e20 0x7f40f8160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40efe00640 1 -- 172.21.15.37:0/4210682554 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f80d0430 con 0x7f40f81609c0 2024-05-30T06:48:31.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.659+0000 7f40f6800640 1 --2- 172.21.15.37:0/4210682554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40f80cd280 0x7f40f80cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40efe00640 1 --2- 172.21.15.37:0/4210682554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40f81609c0 0x7f40f8160e50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f40f80b5200 tx=0x7f40e001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad971a0400005068 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40f5400640 1 -- 172.21.15.37:0/4210682554 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e00aa610 con 0x7f40f81609c0 2024-05-30T06:48:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40f5400640 1 -- 172.21.15.37:0/4210682554 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e00af070 con 0x7f40f81609c0 2024-05-30T06:48:31.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40f5400640 1 -- 172.21.15.37:0/4210682554 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e00aa9d0 con 0x7f40f81609c0 2024-05-30T06:48:31.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40fca00640 1 -- 172.21.15.37:0/4210682554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40f81609c0 msgr2=0x7f40f8160e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40fca00640 1 --2- 172.21.15.37:0/4210682554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40f81609c0 0x7f40f8160e50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f40f80b5200 tx=0x7f40e001c4f0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40fca00640 1 -- 172.21.15.37:0/4210682554 shutdown_connections 2024-05-30T06:48:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40fca00640 1 --2- 172.21.15.37:0/4210682554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40f80cd280 0x7f40f80cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40fca00640 1 --2- 172.21.15.37:0/4210682554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40f81609c0 0x7f40f8160e50 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40fca00640 1 --2- 172.21.15.37:0/4210682554 >> v2:172.21.15.105:3300/0 conn(0x7f40f80b2e20 0x7f40f8160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40fca00640 1 -- 172.21.15.37:0/4210682554 >> 172.21.15.37:0/4210682554 conn(0x7f40f80b4100 msgr2=0x7f40f80b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40fca00640 1 -- 172.21.15.37:0/4210682554 shutdown_connections 2024-05-30T06:48:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40fca00640 1 -- 172.21.15.37:0/4210682554 wait complete. 2024-05-30T06:48:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40fca00640 1 Processor -- start 2024-05-30T06:48:31.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.663+0000 7f40fca00640 1 -- start start 2024-05-30T06:48:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40fca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40f80b2e20 0x7f40f815f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40fca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40f80cd280 0x7f40f8156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40fca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40f81609c0 0x7f40f8070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40fca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40f809aa60 con 0x7f40f80b2e20 2024-05-30T06:48:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40fca00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f40f80cee40 con 0x7f40f80cd280 2024-05-30T06:48:31.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40fca00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f40f809abe0 con 0x7f40f81609c0 2024-05-30T06:48:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40f5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40f80b2e20 0x7f40f815f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40f5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40f80b2e20 0x7f40f815f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36404/0 (socket says 172.21.15.37:36404) 2024-05-30T06:48:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40f5e00640 1 -- 172.21.15.37:0/3980906632 learned_addr learned my addr 172.21.15.37:0/3980906632 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40f6800640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40f81609c0 0x7f40f8070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40efe00640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40f80cd280 0x7f40f8156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40f5e00640 1 -- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40f81609c0 msgr2=0x7f40f8070a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40f5e00640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40f81609c0 0x7f40f8070a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40f5e00640 1 -- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40f80cd280 msgr2=0x7f40f8156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40f5e00640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40f80cd280 0x7f40f8156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40f5e00640 1 -- 172.21.15.37:0/3980906632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f815e510 con 0x7f40f80b2e20 2024-05-30T06:48:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40f5e00640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40f80b2e20 0x7f40f815f5b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f40e800d800 tx=0x7f40e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40ee000640 1 -- 172.21.15.37:0/3980906632 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e800b6c0 con 0x7f40f80b2e20 2024-05-30T06:48:31.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40ee000640 1 -- 172.21.15.37:0/3980906632 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40e8019070 con 0x7f40f80b2e20 2024-05-30T06:48:31.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40fca00640 1 -- 172.21.15.37:0/3980906632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f815e7f0 con 0x7f40f80b2e20 2024-05-30T06:48:31.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40ee000640 1 -- 172.21.15.37:0/3980906632 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e800ba60 con 0x7f40f80b2e20 2024-05-30T06:48:31.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40fca00640 1 -- 172.21.15.37:0/3980906632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f815edb0 con 0x7f40f80b2e20 2024-05-30T06:48:31.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40fca00640 1 -- 172.21.15.37:0/3980906632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f80d2290 con 0x7f40f80b2e20 2024-05-30T06:48:31.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.667+0000 7f40ee000640 1 -- 172.21.15.37:0/3980906632 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f40e800bc00 con 0x7f40f80b2e20 2024-05-30T06:48:31.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.671+0000 7f40ee000640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40d4068bf0 0x7f40d406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:31.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.671+0000 7f40ee000640 1 -- 172.21.15.37:0/3980906632 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f40e8087c20 con 0x7f40f80b2e20 2024-05-30T06:48:31.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.671+0000 7f40efe00640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40d4068bf0 0x7f40d406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:31.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.671+0000 7f40efe00640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40d4068bf0 0x7f40d406b0b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f40e00ae000 tx=0x7f40e00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:31.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.675+0000 7f40ee000640 1 -- 172.21.15.37:0/3980906632 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f40e8056fc0 con 0x7f40f80b2e20 2024-05-30T06:48:31.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.899+0000 7f40fca00640 1 -- 172.21.15.37:0/3980906632 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f40f80ce860 con 0x7f40f80b2e20 2024-05-30T06:48:31.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.899+0000 7f40ee000640 1 -- 172.21.15.37:0/3980906632 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f40e8087e20 con 0x7f40f80b2e20 2024-05-30T06:48:31.898 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:31.899 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:48:31.899 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-30T06:48:31.899 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.899 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-30T06:48:31.899 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmcRfnBBAAk60J/SRTolMhKoS8b8A9jQ==", 2024-05-30T06:48:31.899 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.899 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:48:31.899 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:48:31.899 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:48:31.899 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.899 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.899 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.899 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmzScrERAAbIJ5somf+sguc6jEuR04zg==", 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm2jEhDBAAGKUYGtJznRYpt1LHlMOTrw==", 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.900 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm95RdGBAAaaaNAKnr4Dtmu+L1NaMVbw==", 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.901 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.902 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.902 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.902 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-30T06:48:31.902 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCFH1hmygxjHhAA1ee1eBP6dvsC0K9w+6d0OQ==", 2024-05-30T06:48:31.902 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.902 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:48:31.902 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:48:31.902 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.902 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.902 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.902 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.902 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-30T06:48:31.902 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCIH1hmNJsBKRAAhns5CNodS7CKFU1Jg3PFCA==", 2024-05-30T06:48:31.903 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.903 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:48:31.903 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:48:31.903 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.903 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.903 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.903 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.903 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-30T06:48:31.903 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCLH1hmlx5FNBAAn2Iann8U/uTZy0tFcFx04w==", 2024-05-30T06:48:31.903 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.903 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:48:31.903 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:48:31.903 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCPH1hmxJnxAhAAt5cEb3YVLDhkQD5WjLQuog==", 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-30T06:48:31.904 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCUH1hmEn5cOBAAFzBuH8TO418e4obqTNeIXg==", 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCYH1hmij3RCBAAHzQPoM1ClYGGEt6ly6ZrqQ==", 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.905 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-30T06:48:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCbH1hmDqdpERAA46/Bs4B/xVjviQ1gNpNaaw==", 2024-05-30T06:48:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:48:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:48:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-30T06:48:31.906 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCeH1hmnrfVHRAAlqk48vSVw45YDCXWWb/MUA==", 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A==", 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T06:48:31.907 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-30T06:48:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmf8sdJhAATAP7EzLJxXXnXeEQL9fdpw==", 2024-05-30T06:48:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:48:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:48:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:48:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:48:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm1qB9IhAAszAwOgm2Igb1DM4diPC7ow==", 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmY6AULBAAYNza0fpC3KO69ulNQaSldQ==", 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:48:31.909 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:48:31.910 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:48:31.910 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:48:31.910 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.910 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.910 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.910 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-30T06:48:31.910 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmbSCrJBAAhn69RBUeyuaAMWiB3o7ByQ==", 2024-05-30T06:48:31.910 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.910 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:48:31.910 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:48:31.910 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:48:31.910 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.910 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.911 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.911 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-30T06:48:31.911 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmN/fjABAAdldbCncRiHy6RFEF9H7gnQ==", 2024-05-30T06:48:31.911 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.911 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:48:31.912 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:48:31.912 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.912 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.912 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:48:31.912 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:31.912 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-30T06:48:31.912 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmNdeSOBAA3V4vK0bNlWFoosV41f/ASQ==", 2024-05-30T06:48:31.913 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:48:31.913 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:48:31.913 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:48:31.913 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:48:31.913 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.913 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:31.913 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-30T06:48:31.913 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:48:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.899+0000 7f40fca00640 1 -- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40d4068bf0 msgr2=0x7f40d406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.899+0000 7f40fca00640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40d4068bf0 0x7f40d406b0b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f40e00ae000 tx=0x7f40e00a7000 comp rx=0 tx=0).stop 2024-05-30T06:48:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.899+0000 7f40fca00640 1 -- 172.21.15.37:0/3980906632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40f80b2e20 msgr2=0x7f40f815f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.899+0000 7f40fca00640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40f80b2e20 0x7f40f815f5b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f40e800d800 tx=0x7f40e800dcc0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.899+0000 7f40fca00640 1 -- 172.21.15.37:0/3980906632 shutdown_connections 2024-05-30T06:48:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.899+0000 7f40fca00640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40f81609c0 0x7f40f8070a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.899+0000 7f40fca00640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40d4068bf0 0x7f40d406b0b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.899+0000 7f40fca00640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40f80cd280 0x7f40f8156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.899+0000 7f40fca00640 1 --2- 172.21.15.37:0/3980906632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40f80b2e20 0x7f40f815f5b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.903+0000 7f40fca00640 1 -- 172.21.15.37:0/3980906632 >> 172.21.15.37:0/3980906632 conn(0x7f40f80b4100 msgr2=0x7f40f815c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.903+0000 7f40fca00640 1 -- 172.21.15.37:0/3980906632 shutdown_connections 2024-05-30T06:48:31.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:31.903+0000 7f40fca00640 1 -- 172.21.15.37:0/3980906632 wait complete. 2024-05-30T06:48:31.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:48:32.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f5a200640 1 Processor -- start 2024-05-30T06:48:32.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f5a200640 1 -- start start 2024-05-30T06:48:32.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f5a200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7f541605d0 0x7f7f540b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f5a200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f541609b0 0x7f7f54160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f5a200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f5415f7d0 0x7f7f5415fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f5a200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7f540cdda0 con 0x7f7f541609b0 2024-05-30T06:48:32.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f5a200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7f540ce080 con 0x7f7f541605d0 2024-05-30T06:48:32.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f5a200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5409ac00 con 0x7f7f5415f7d0 2024-05-30T06:48:32.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f53e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f541609b0 0x7f7f54160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f53e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f541609b0 0x7f7f54160e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36420/0 (socket says 172.21.15.37:36420) 2024-05-30T06:48:32.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f53e00640 1 -- 172.21.15.37:0/1782460821 learned_addr learned my addr 172.21.15.37:0/1782460821 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:32.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f58e00640 1 --2- 172.21.15.37:0/1782460821 >> v2:172.21.15.105:3300/0 conn(0x7f7f541605d0 0x7f7f540b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f59800640 1 --2- 172.21.15.37:0/1782460821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f5415f7d0 0x7f7f5415fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f53e00640 1 -- 172.21.15.37:0/1782460821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f5415f7d0 msgr2=0x7f7f5415fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:32.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f53e00640 1 --2- 172.21.15.37:0/1782460821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f5415f7d0 0x7f7f5415fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f53e00640 1 -- 172.21.15.37:0/1782460821 >> v2:172.21.15.105:3300/0 conn(0x7f7f541605d0 msgr2=0x7f7f540b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:32.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f53e00640 1 --2- 172.21.15.37:0/1782460821 >> v2:172.21.15.105:3300/0 conn(0x7f7f541605d0 0x7f7f540b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.063+0000 7f7f53e00640 1 -- 172.21.15.37:0/1782460821 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5409aee0 con 0x7f7f541609b0 2024-05-30T06:48:32.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f53e00640 1 --2- 172.21.15.37:0/1782460821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f541609b0 0x7f7f54160e10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7f5406f780 tx=0x7f7f4001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a3633632fff87d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:32.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f53400640 1 -- 172.21.15.37:0/1782460821 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400b0070 con 0x7f7f541609b0 2024-05-30T06:48:32.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f53400640 1 -- 172.21.15.37:0/1782460821 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f400ab600 con 0x7f7f541609b0 2024-05-30T06:48:32.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f53400640 1 -- 172.21.15.37:0/1782460821 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f400ab9d0 con 0x7f7f541609b0 2024-05-30T06:48:32.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f5a200640 1 -- 172.21.15.37:0/1782460821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f541609b0 msgr2=0x7f7f54160e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f5a200640 1 --2- 172.21.15.37:0/1782460821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f541609b0 0x7f7f54160e10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7f5406f780 tx=0x7f7f4001c520 comp rx=0 tx=0).stop 2024-05-30T06:48:32.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f5a200640 1 -- 172.21.15.37:0/1782460821 shutdown_connections 2024-05-30T06:48:32.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f5a200640 1 --2- 172.21.15.37:0/1782460821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f5415f7d0 0x7f7f5415fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f5a200640 1 --2- 172.21.15.37:0/1782460821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f541609b0 0x7f7f54160e10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f5a200640 1 --2- 172.21.15.37:0/1782460821 >> v2:172.21.15.105:3300/0 conn(0x7f7f541605d0 0x7f7f540b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f5a200640 1 -- 172.21.15.37:0/1782460821 >> 172.21.15.37:0/1782460821 conn(0x7f7f540b3f50 msgr2=0x7f7f540b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:32.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f5a200640 1 -- 172.21.15.37:0/1782460821 shutdown_connections 2024-05-30T06:48:32.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f5a200640 1 -- 172.21.15.37:0/1782460821 wait complete. 2024-05-30T06:48:32.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.067+0000 7f7f5a200640 1 Processor -- start 2024-05-30T06:48:32.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f5a200640 1 -- start start 2024-05-30T06:48:32.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f5a200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f5415f7d0 0x7f7f54158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f5a200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f541605d0 0x7f7f5415af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f5a200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f541609b0 0x7f7f54070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f5a200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7f540d0030 con 0x7f7f541609b0 2024-05-30T06:48:32.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f5a200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5409be60 con 0x7f7f541605d0 2024-05-30T06:48:32.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f5a200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7f540d01b0 con 0x7f7f5415f7d0 2024-05-30T06:48:32.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f59800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f541609b0 0x7f7f54070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f59800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f541609b0 0x7f7f54070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36422/0 (socket says 172.21.15.37:36422) 2024-05-30T06:48:32.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f59800640 1 -- 172.21.15.37:0/2301940745 learned_addr learned my addr 172.21.15.37:0/2301940745 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:32.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f58e00640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f5415f7d0 0x7f7f54158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f53e00640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f541605d0 0x7f7f5415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f59800640 1 -- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f5415f7d0 msgr2=0x7f7f54158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f59800640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f5415f7d0 0x7f7f54158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f59800640 1 -- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f541605d0 msgr2=0x7f7f5415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f59800640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f541605d0 0x7f7f5415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f59800640 1 -- 172.21.15.37:0/2301940745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5415b460 con 0x7f7f541609b0 2024-05-30T06:48:32.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f59800640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f541609b0 0x7f7f54070f70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c007e70 tx=0x7f7f4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:32.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f50c00640 1 -- 172.21.15.37:0/2301940745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c014620 con 0x7f7f541609b0 2024-05-30T06:48:32.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f50c00640 1 -- 172.21.15.37:0/2301940745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f4c019070 con 0x7f7f541609b0 2024-05-30T06:48:32.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f50c00640 1 -- 172.21.15.37:0/2301940745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c014a20 con 0x7f7f541609b0 2024-05-30T06:48:32.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f5a200640 1 -- 172.21.15.37:0/2301940745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f54159480 con 0x7f7f541609b0 2024-05-30T06:48:32.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f5a200640 1 -- 172.21.15.37:0/2301940745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f54159a40 con 0x7f7f541609b0 2024-05-30T06:48:32.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.071+0000 7f7f5a200640 1 -- 172.21.15.37:0/2301940745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f54068ab0 con 0x7f7f541609b0 2024-05-30T06:48:32.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.075+0000 7f7f50c00640 1 -- 172.21.15.37:0/2301940745 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f7f4c014bc0 con 0x7f7f541609b0 2024-05-30T06:48:32.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.075+0000 7f7f50c00640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7f34068bf0 0x7f7f3406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.075+0000 7f7f50c00640 1 -- 172.21.15.37:0/2301940745 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f7f4c087fa0 con 0x7f7f541609b0 2024-05-30T06:48:32.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.075+0000 7f7f58e00640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7f34068bf0 0x7f7f3406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.075+0000 7f7f58e00640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7f34068bf0 0x7f7f3406b0b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7f480079e0 tx=0x7f7f48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:32.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.079+0000 7f7f50c00640 1 -- 172.21.15.37:0/2301940745 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7f4c0573d0 con 0x7f7f541609b0 2024-05-30T06:48:32.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.243+0000 7f7f5a200640 1 -- 172.21.15.37:0/2301940745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f5415e9e0 con 0x7f7f541609b0 2024-05-30T06:48:32.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.243+0000 7f7f50c00640 1 -- 172.21.15.37:0/2301940745 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+12879 (secure 0 0 0) 0x7f7f4c05b6d0 con 0x7f7f541609b0 2024-05-30T06:48:32.244 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:32.244 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":56,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:48:31.501710+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:48:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.247+0000 7f7f5a200640 1 -- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7f34068bf0 msgr2=0x7f7f3406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.247+0000 7f7f5a200640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7f34068bf0 0x7f7f3406b0b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7f480079e0 tx=0x7f7f48008040 comp rx=0 tx=0).stop 2024-05-30T06:48:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.247+0000 7f7f5a200640 1 -- 172.21.15.37:0/2301940745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f541609b0 msgr2=0x7f7f54070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.247+0000 7f7f5a200640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f541609b0 0x7f7f54070f70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c007e70 tx=0x7f7f4c00e4b0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.247+0000 7f7f5a200640 1 -- 172.21.15.37:0/2301940745 shutdown_connections 2024-05-30T06:48:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.247+0000 7f7f5a200640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f541609b0 0x7f7f54070f70 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.247+0000 7f7f5a200640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7f34068bf0 0x7f7f3406b0b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.247+0000 7f7f5a200640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f541605d0 0x7f7f5415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.247+0000 7f7f5a200640 1 --2- 172.21.15.37:0/2301940745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f5415f7d0 0x7f7f54158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.247+0000 7f7f5a200640 1 -- 172.21.15.37:0/2301940745 >> 172.21.15.37:0/2301940745 conn(0x7f7f540b3f50 msgr2=0x7f7f5406d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.247+0000 7f7f5a200640 1 -- 172.21.15.37:0/2301940745 shutdown_connections 2024-05-30T06:48:32.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.247+0000 7f7f5a200640 1 -- 172.21.15.37:0/2301940745 wait complete. 2024-05-30T06:48:32.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:48:32.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:48:32.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f0690400640 1 Processor -- start 2024-05-30T06:48:32.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f0690400640 1 -- start start 2024-05-30T06:48:32.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f0690400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06880b59d0 0x7f06880b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f0690400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f068815d7e0 0x7f0688160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f0690400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06880b62f0 con 0x7f068815d350 2024-05-30T06:48:32.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f0690400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0688142030 con 0x7f06880b59d0 2024-05-30T06:48:32.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f0690400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0688142310 con 0x7f068815d7e0 2024-05-30T06:48:32.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f068da00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06880b59d0 0x7f06880b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f068da00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06880b59d0 0x7f06880b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36434/0 (socket says 172.21.15.37:36434) 2024-05-30T06:48:32.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f068da00640 1 -- 172.21.15.37:0/2355986895 learned_addr learned my addr 172.21.15.37:0/2355986895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:32.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f068e400640 1 --2- 172.21.15.37:0/2355986895 >> v2:172.21.15.105:3300/0 conn(0x7f068815d7e0 0x7f0688160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f068da00640 1 -- 172.21.15.37:0/2355986895 >> v2:172.21.15.105:3300/0 conn(0x7f068815d7e0 msgr2=0x7f0688160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f068da00640 1 --2- 172.21.15.37:0/2355986895 >> v2:172.21.15.105:3300/0 conn(0x7f068815d7e0 0x7f0688160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f068da00640 1 -- 172.21.15.37:0/2355986895 >> v1:172.21.15.105:6789/0 conn(0x7f068815d350 legacy=0x7f0688160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:32.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.411+0000 7f068da00640 1 -- 172.21.15.37:0/2355986895 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06881425f0 con 0x7f06880b59d0 2024-05-30T06:48:32.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.415+0000 7f068da00640 1 --2- 172.21.15.37:0/2355986895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06880b59d0 0x7f06880b5db0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f067c009870 tx=0x7f067c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998feb78891b2364 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:32.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.415+0000 7f0687e00640 1 -- 172.21.15.37:0/2355986895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c0b5070 con 0x7f06880b59d0 2024-05-30T06:48:32.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.415+0000 7f0687e00640 1 -- 172.21.15.37:0/2355986895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c0a89d0 con 0x7f06880b59d0 2024-05-30T06:48:32.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.415+0000 7f0687e00640 1 -- 172.21.15.37:0/2355986895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c0a8da0 con 0x7f06880b59d0 2024-05-30T06:48:32.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.415+0000 7f0690400640 1 -- 172.21.15.37:0/2355986895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06880b59d0 msgr2=0x7f06880b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.415+0000 7f0690400640 1 --2- 172.21.15.37:0/2355986895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06880b59d0 0x7f06880b5db0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f067c009870 tx=0x7f067c01ecd0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.415+0000 7f0690400640 1 -- 172.21.15.37:0/2355986895 shutdown_connections 2024-05-30T06:48:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.415+0000 7f0690400640 1 --2- 172.21.15.37:0/2355986895 >> v2:172.21.15.105:3300/0 conn(0x7f068815d7e0 0x7f0688160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.415+0000 7f0690400640 1 --2- 172.21.15.37:0/2355986895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06880b59d0 0x7f06880b5db0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.415+0000 7f0690400640 1 -- 172.21.15.37:0/2355986895 >> 172.21.15.37:0/2355986895 conn(0x7f068806bf60 msgr2=0x7f06880b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.415+0000 7f0690400640 1 -- 172.21.15.37:0/2355986895 shutdown_connections 2024-05-30T06:48:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.415+0000 7f0690400640 1 -- 172.21.15.37:0/2355986895 wait complete. 2024-05-30T06:48:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f0690400640 1 Processor -- start 2024-05-30T06:48:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f0690400640 1 -- start start 2024-05-30T06:48:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f0690400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06880b59d0 0x7f0688152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f0690400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f068815d350 0x7f068815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f0690400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f068815d7e0 0x7f068815b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f0690400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f068813fe60 con 0x7f06880b59d0 2024-05-30T06:48:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f0690400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f068813fce0 con 0x7f068815d350 2024-05-30T06:48:32.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f0690400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f06880aff20 con 0x7f068815d7e0 2024-05-30T06:48:32.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f068da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06880b59d0 0x7f0688152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f068da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06880b59d0 0x7f0688152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36442/0 (socket says 172.21.15.37:36442) 2024-05-30T06:48:32.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f068da00640 1 -- 172.21.15.37:0/2851209103 learned_addr learned my addr 172.21.15.37:0/2851209103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:32.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f068e400640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f068815d7e0 0x7f068815b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f068d000640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f068815d350 0x7f068815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f068da00640 1 -- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f068815d7e0 msgr2=0x7f068815b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f068da00640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f068815d7e0 0x7f068815b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f068da00640 1 -- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f068815d350 msgr2=0x7f068815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f068da00640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f068815d350 0x7f068815dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f068da00640 1 -- 172.21.15.37:0/2851209103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068815e6d0 con 0x7f06880b59d0 2024-05-30T06:48:32.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f068d000640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f068815d350 0x7f068815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:32.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f068da00640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06880b59d0 0x7f0688152870 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f067c0b3040 tx=0x7f067c01ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:32.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f0685600640 1 -- 172.21.15.37:0/2851209103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c0c0070 con 0x7f06880b59d0 2024-05-30T06:48:32.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f0685600640 1 -- 172.21.15.37:0/2851209103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c0b0a50 con 0x7f06880b59d0 2024-05-30T06:48:32.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f0685600640 1 -- 172.21.15.37:0/2851209103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c0b5070 con 0x7f06880b59d0 2024-05-30T06:48:32.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f0690400640 1 -- 172.21.15.37:0/2851209103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068815e9b0 con 0x7f06880b59d0 2024-05-30T06:48:32.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.419+0000 7f0690400640 1 -- 172.21.15.37:0/2851209103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068815ef70 con 0x7f06880b59d0 2024-05-30T06:48:32.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.423+0000 7f0690400640 1 -- 172.21.15.37:0/2851209103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0688068bc0 con 0x7f06880b59d0 2024-05-30T06:48:32.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.423+0000 7f0685600640 1 -- 172.21.15.37:0/2851209103 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f067c0ba3e0 con 0x7f06880b59d0 2024-05-30T06:48:32.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.423+0000 7f0685600640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0668068bf0 0x7f066806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.423+0000 7f0685600640 1 -- 172.21.15.37:0/2851209103 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f067c124620 con 0x7f06880b59d0 2024-05-30T06:48:32.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.423+0000 7f068d000640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0668068bf0 0x7f066806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.427+0000 7f068d000640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0668068bf0 0x7f066806b0b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0688154850 tx=0x7f0674009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:32.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.427+0000 7f0685600640 1 -- 172.21.15.37:0/2851209103 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f067c018830 con 0x7f06880b59d0 2024-05-30T06:48:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0690400640 1 -- 172.21.15.37:0/2851209103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f068806f0a0 con 0x7f06880b59d0 2024-05-30T06:48:32.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0685600640 1 -- 172.21.15.37:0/2851209103 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) ==== 93+0+10 (secure 0 0 0) 0x7f067c0f3dd0 con 0x7f06880b59d0 2024-05-30T06:48:32.593 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:48:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0690400640 1 -- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0668068bf0 msgr2=0x7f066806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0690400640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0668068bf0 0x7f066806b0b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0688154850 tx=0x7f0674009040 comp rx=0 tx=0).stop 2024-05-30T06:48:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0690400640 1 -- 172.21.15.37:0/2851209103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06880b59d0 msgr2=0x7f0688152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0690400640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06880b59d0 0x7f0688152870 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f067c0b3040 tx=0x7f067c01ba70 comp rx=0 tx=0).stop 2024-05-30T06:48:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0690400640 1 -- 172.21.15.37:0/2851209103 shutdown_connections 2024-05-30T06:48:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0690400640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f068815d7e0 0x7f068815b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0690400640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0668068bf0 0x7f066806b0b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0690400640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f068815d350 0x7f068815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0690400640 1 --2- 172.21.15.37:0/2851209103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06880b59d0 0x7f0688152870 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0690400640 1 -- 172.21.15.37:0/2851209103 >> 172.21.15.37:0/2851209103 conn(0x7f068806bf60 msgr2=0x7f0688140b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0690400640 1 -- 172.21.15.37:0/2851209103 shutdown_connections 2024-05-30T06:48:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.595+0000 7f0690400640 1 -- 172.21.15.37:0/2851209103 wait complete. 2024-05-30T06:48:32.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T06:48:32.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d43e00640 1 Processor -- start 2024-05-30T06:48:32.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d43e00640 1 -- start start 2024-05-30T06:48:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d43e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2d4415e8d0 0x7f2d440d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d43e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d440cfea0 0x7f2d440d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d43e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d440d24f0 con 0x7f2d440d0300 2024-05-30T06:48:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d43e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2d440d22a0 con 0x7f2d440cfea0 2024-05-30T06:48:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d43e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2d440d27d0 con 0x7f2d4415e8d0 2024-05-30T06:48:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d3be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d440cfea0 0x7f2d440d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d3be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d440cfea0 0x7f2d440d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36454/0 (socket says 172.21.15.37:36454) 2024-05-30T06:48:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d3be00640 1 -- 172.21.15.37:0/2765824472 learned_addr learned my addr 172.21.15.37:0/2765824472 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d42a00640 1 --2- 172.21.15.37:0/2765824472 >> v2:172.21.15.105:3300/0 conn(0x7f2d4415e8d0 0x7f2d440d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d3be00640 1 -- 172.21.15.37:0/2765824472 >> v2:172.21.15.105:3300/0 conn(0x7f2d4415e8d0 msgr2=0x7f2d440d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d3be00640 1 --2- 172.21.15.37:0/2765824472 >> v2:172.21.15.105:3300/0 conn(0x7f2d4415e8d0 0x7f2d440d32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d3be00640 1 -- 172.21.15.37:0/2765824472 >> v1:172.21.15.105:6789/0 conn(0x7f2d440d0300 legacy=0x7f2d440b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d3be00640 1 -- 172.21.15.37:0/2765824472 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d440d2ab0 con 0x7f2d440cfea0 2024-05-30T06:48:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.759+0000 7f2d42a00640 1 --2- 172.21.15.37:0/2765824472 >> v2:172.21.15.105:3300/0 conn(0x7f2d4415e8d0 0x7f2d440d32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:32.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d3be00640 1 --2- 172.21.15.37:0/2765824472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440cfea0 0x7f2d440d0fc0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2d440cf100 tx=0x7f2d2c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa951224b76400de server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:32.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d42000640 1 -- 172.21.15.37:0/2765824472 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c0b0070 con 0x7f2d440cfea0 2024-05-30T06:48:32.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d42000640 1 -- 172.21.15.37:0/2765824472 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d2c0ab600 con 0x7f2d440cfea0 2024-05-30T06:48:32.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d42000640 1 -- 172.21.15.37:0/2765824472 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c0ab9d0 con 0x7f2d440cfea0 2024-05-30T06:48:32.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d43e00640 1 -- 172.21.15.37:0/2765824472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440cfea0 msgr2=0x7f2d440d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d43e00640 1 --2- 172.21.15.37:0/2765824472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440cfea0 0x7f2d440d0fc0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2d440cf100 tx=0x7f2d2c01c420 comp rx=0 tx=0).stop 2024-05-30T06:48:32.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d43e00640 1 -- 172.21.15.37:0/2765824472 shutdown_connections 2024-05-30T06:48:32.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d43e00640 1 --2- 172.21.15.37:0/2765824472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440cfea0 0x7f2d440d0fc0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d43e00640 1 --2- 172.21.15.37:0/2765824472 >> v2:172.21.15.105:3300/0 conn(0x7f2d4415e8d0 0x7f2d440d32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d43e00640 1 -- 172.21.15.37:0/2765824472 >> 172.21.15.37:0/2765824472 conn(0x7f2d4408bff0 msgr2=0x7f2d440d46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:32.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d43e00640 1 -- 172.21.15.37:0/2765824472 shutdown_connections 2024-05-30T06:48:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d43e00640 1 -- 172.21.15.37:0/2765824472 wait complete. 2024-05-30T06:48:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d43e00640 1 Processor -- start 2024-05-30T06:48:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.763+0000 7f2d43e00640 1 -- start start 2024-05-30T06:48:32.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d440cfea0 0x7f2d440c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d440d0300 0x7f2d44155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d4415e8d0 0x7f2d44157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d440d5540 con 0x7f2d4415e8d0 2024-05-30T06:48:32.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2d440d53c0 con 0x7f2d440cfea0 2024-05-30T06:48:32.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2d4416c000 con 0x7f2d440d0300 2024-05-30T06:48:32.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d4415e8d0 0x7f2d44157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d4415e8d0 0x7f2d44157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36456/0 (socket says 172.21.15.37:36456) 2024-05-30T06:48:32.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43400640 1 -- 172.21.15.37:0/2075302059 learned_addr learned my addr 172.21.15.37:0/2075302059 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:32.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d3be00640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d440d0300 0x7f2d44155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d42a00640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d440cfea0 0x7f2d440c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43400640 1 -- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d440d0300 msgr2=0x7f2d44155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43400640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d440d0300 0x7f2d44155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43400640 1 -- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d440cfea0 msgr2=0x7f2d440c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43400640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d440cfea0 0x7f2d440c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43400640 1 -- 172.21.15.37:0/2075302059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d441564b0 con 0x7f2d4415e8d0 2024-05-30T06:48:32.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43400640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d4415e8d0 0x7f2d44157230 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c00c780 tx=0x7f2d3c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:32.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d3aa00640 1 -- 172.21.15.37:0/2075302059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c016020 con 0x7f2d4415e8d0 2024-05-30T06:48:32.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d3aa00640 1 -- 172.21.15.37:0/2075302059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d3c00a9f0 con 0x7f2d4415e8d0 2024-05-30T06:48:32.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d3aa00640 1 -- 172.21.15.37:0/2075302059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c00ade0 con 0x7f2d4415e8d0 2024-05-30T06:48:32.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43e00640 1 -- 172.21.15.37:0/2075302059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d44157770 con 0x7f2d4415e8d0 2024-05-30T06:48:32.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43e00640 1 -- 172.21.15.37:0/2075302059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d44156a30 con 0x7f2d4415e8d0 2024-05-30T06:48:32.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d43e00640 1 -- 172.21.15.37:0/2075302059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d44068ab0 con 0x7f2d4415e8d0 2024-05-30T06:48:32.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.767+0000 7f2d3aa00640 1 -- 172.21.15.37:0/2075302059 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f2d3c019020 con 0x7f2d4415e8d0 2024-05-30T06:48:32.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.771+0000 7f2d3aa00640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d20068bf0 0x7f2d2006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:32.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.771+0000 7f2d3aa00640 1 -- 172.21.15.37:0/2075302059 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f2d3c0875b0 con 0x7f2d4415e8d0 2024-05-30T06:48:32.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.771+0000 7f2d42a00640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d20068bf0 0x7f2d2006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.771+0000 7f2d42a00640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d20068bf0 0x7f2d2006b0b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2d4406dd90 tx=0x7f2d34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:32.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.775+0000 7f2d3aa00640 1 -- 172.21.15.37:0/2075302059 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2d3c020030 con 0x7f2d4415e8d0 2024-05-30T06:48:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.939+0000 7f2d43e00640 1 -- 172.21.15.37:0/2075302059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2d440b8250 con 0x7f2d4415e8d0 2024-05-30T06:48:32.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.939+0000 7f2d3aa00640 1 -- 172.21.15.37:0/2075302059 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) ==== 84+0+65 (secure 0 0 0) 0x7f2d3c0569e0 con 0x7f2d4415e8d0 2024-05-30T06:48:32.940 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:32.940 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:48:32.940 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:32.940 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-30T06:48:32.940 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-30T06:48:32.940 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:32.941 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:48:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.943+0000 7f2d43e00640 1 -- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d20068bf0 msgr2=0x7f2d2006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.943+0000 7f2d43e00640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d20068bf0 0x7f2d2006b0b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2d4406dd90 tx=0x7f2d34008040 comp rx=0 tx=0).stop 2024-05-30T06:48:32.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.943+0000 7f2d43e00640 1 -- 172.21.15.37:0/2075302059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d4415e8d0 msgr2=0x7f2d44157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:32.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.943+0000 7f2d43e00640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d4415e8d0 0x7f2d44157230 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c00c780 tx=0x7f2d3c00cc40 comp rx=0 tx=0).stop 2024-05-30T06:48:32.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.943+0000 7f2d43e00640 1 -- 172.21.15.37:0/2075302059 shutdown_connections 2024-05-30T06:48:32.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.943+0000 7f2d43e00640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d4415e8d0 0x7f2d44157230 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.943+0000 7f2d43e00640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d440d0300 0x7f2d44155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.943+0000 7f2d43e00640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2d20068bf0 0x7f2d2006b0b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.943+0000 7f2d43e00640 1 --2- 172.21.15.37:0/2075302059 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d440cfea0 0x7f2d440c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:32.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.943+0000 7f2d43e00640 1 -- 172.21.15.37:0/2075302059 >> 172.21.15.37:0/2075302059 conn(0x7f2d4408bff0 msgr2=0x7f2d4406e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:32.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.943+0000 7f2d43e00640 1 -- 172.21.15.37:0/2075302059 shutdown_connections 2024-05-30T06:48:32.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:32.943+0000 7f2d43e00640 1 -- 172.21.15.37:0/2075302059 wait complete. 2024-05-30T06:48:32.961 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T06:48:32.961 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T06:48:33.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c9e400640 1 Processor -- start 2024-05-30T06:48:33.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c9e400640 1 -- start start 2024-05-30T06:48:33.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c9e400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7c980b0570 0x7f7c9815d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:33.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c9e400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c980cec50 0x7f7c9806b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:33.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c9e400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c980b5620 con 0x7f7c980b50b0 2024-05-30T06:48:33.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c9e400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7c980b5900 con 0x7f7c980b0570 2024-05-30T06:48:33.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c9e400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7c980b5be0 con 0x7f7c980cec50 2024-05-30T06:48:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c8ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c980cec50 0x7f7c9806b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c97400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7c980b0570 0x7f7c9815d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c97e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f7c980b50b0 0x7f7c98160430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:38510/0 (socket says 172.21.15.37:38510) 2024-05-30T06:48:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c97e00640 1 -- 172.21.15.37:0/904719871 learned_addr learned my addr 172.21.15.37:0/904719871 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c97400640 1 -- 172.21.15.37:0/904719871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c980cec50 msgr2=0x7f7c9806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c97400640 1 --2- 172.21.15.37:0/904719871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c980cec50 0x7f7c9806b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c97400640 1 -- 172.21.15.37:0/904719871 >> v1:172.21.15.105:6789/0 conn(0x7f7c980b50b0 legacy=0x7f7c98160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:33.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.107+0000 7f7c97400640 1 -- 172.21.15.37:0/904719871 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c980b5ec0 con 0x7f7c980b0570 2024-05-30T06:48:33.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.111+0000 7f7c97400640 1 --2- 172.21.15.37:0/904719871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c980b0570 0x7f7c9815d8c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7c880097c0 tx=0x7f7c8801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82750fd51cf2e3ee server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:33.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.111+0000 7f7c96a00640 1 -- 172.21.15.37:0/904719871 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c880b0070 con 0x7f7c980b0570 2024-05-30T06:48:33.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.111+0000 7f7c96a00640 1 -- 172.21.15.37:0/904719871 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c880ab600 con 0x7f7c980b0570 2024-05-30T06:48:33.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.111+0000 7f7c96a00640 1 -- 172.21.15.37:0/904719871 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c880ab9d0 con 0x7f7c980b0570 2024-05-30T06:48:33.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.111+0000 7f7c9e400640 1 -- 172.21.15.37:0/904719871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c980b0570 msgr2=0x7f7c9815d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:33.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.111+0000 7f7c9e400640 1 --2- 172.21.15.37:0/904719871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c980b0570 0x7f7c9815d8c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7c880097c0 tx=0x7f7c8801c410 comp rx=0 tx=0).stop 2024-05-30T06:48:33.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.111+0000 7f7c9e400640 1 -- 172.21.15.37:0/904719871 shutdown_connections 2024-05-30T06:48:33.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.111+0000 7f7c9e400640 1 --2- 172.21.15.37:0/904719871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c980cec50 0x7f7c9806b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.111+0000 7f7c9e400640 1 --2- 172.21.15.37:0/904719871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c980b0570 0x7f7c9815d8c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.111+0000 7f7c9e400640 1 -- 172.21.15.37:0/904719871 >> 172.21.15.37:0/904719871 conn(0x7f7c980d0d50 msgr2=0x7f7c980d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:33.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.111+0000 7f7c9e400640 1 -- 172.21.15.37:0/904719871 shutdown_connections 2024-05-30T06:48:33.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.111+0000 7f7c9e400640 1 -- 172.21.15.37:0/904719871 wait complete. 2024-05-30T06:48:33.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c9e400640 1 Processor -- start 2024-05-30T06:48:33.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c9e400640 1 -- start start 2024-05-30T06:48:33.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c9e400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c980b0570 0x7f7c980b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:33.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c9e400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c980b50b0 0x7f7c98165bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:33.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c9e400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c980cec50 0x7f7c9806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:33.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c9e400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c981697b0 con 0x7f7c980b50b0 2024-05-30T06:48:33.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c9e400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9806c2b0 con 0x7f7c980b0570 2024-05-30T06:48:33.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c9e400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7c98169930 con 0x7f7c980cec50 2024-05-30T06:48:33.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c8ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c980b50b0 0x7f7c98165bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:33.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c8ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c980b50b0 0x7f7c98165bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36458/0 (socket says 172.21.15.37:36458) 2024-05-30T06:48:33.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c8ea00640 1 -- 172.21.15.37:0/96055641 learned_addr learned my addr 172.21.15.37:0/96055641 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:33.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c97400640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c980b0570 0x7f7c980b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:33.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c97e00640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c980cec50 0x7f7c9806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:33.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c8ea00640 1 -- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c980cec50 msgr2=0x7f7c9806ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:33.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c8ea00640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c980cec50 0x7f7c9806ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c8ea00640 1 -- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c980b0570 msgr2=0x7f7c980b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:33.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c8ea00640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c980b0570 0x7f7c980b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c8ea00640 1 -- 172.21.15.37:0/96055641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c980b1400 con 0x7f7c980b50b0 2024-05-30T06:48:33.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c97400640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c980b0570 0x7f7c980b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:33.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c8ea00640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c980b50b0 0x7f7c98165bb0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000e900 tx=0x7f7c8000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:33.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c8fe00640 1 -- 172.21.15.37:0/96055641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80017070 con 0x7f7c980b50b0 2024-05-30T06:48:33.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c8fe00640 1 -- 172.21.15.37:0/96055641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8000ca00 con 0x7f7c980b50b0 2024-05-30T06:48:33.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c8fe00640 1 -- 172.21.15.37:0/96055641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8000cdf0 con 0x7f7c980b50b0 2024-05-30T06:48:33.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c9e400640 1 -- 172.21.15.37:0/96055641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c980b16a0 con 0x7f7c980b50b0 2024-05-30T06:48:33.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.115+0000 7f7c9e400640 1 -- 172.21.15.37:0/96055641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c980b1c60 con 0x7f7c980b50b0 2024-05-30T06:48:33.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.119+0000 7f7c9e400640 1 -- 172.21.15.37:0/96055641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c98068d40 con 0x7f7c980b50b0 2024-05-30T06:48:33.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.119+0000 7f7c8fe00640 1 -- 172.21.15.37:0/96055641 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f7c8001a070 con 0x7f7c980b50b0 2024-05-30T06:48:33.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.119+0000 7f7c8fe00640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7c74068bf0 0x7f7c7406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:33.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.119+0000 7f7c8fe00640 1 -- 172.21.15.37:0/96055641 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 4857+0+0 (secure 0 0 0) 0x7f7c80087ba0 con 0x7f7c980b50b0 2024-05-30T06:48:33.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.119+0000 7f7c97400640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7c74068bf0 0x7f7c7406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:33.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.119+0000 7f7c97400640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7c74068bf0 0x7f7c7406b0b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7c880ad000 tx=0x7f7c880a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:33.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.123+0000 7f7c8fe00640 1 -- 172.21.15.37:0/96055641 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7c80057620 con 0x7f7c980b50b0 2024-05-30T06:48:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.287+0000 7f7c9e400640 1 -- 172.21.15.37:0/96055641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7c9815db90 con 0x7f7c980b50b0 2024-05-30T06:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.495+0000 7f7c8fe00640 1 -- 172.21.15.37:0/96055641 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v57) ==== 138+0+0 (secure 0 0 0) 0x7f7c80056f20 con 0x7f7c980b50b0 2024-05-30T06:48:33.495 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-30T06:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.499+0000 7f7c9e400640 1 -- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7c74068bf0 msgr2=0x7f7c7406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.499+0000 7f7c9e400640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7c74068bf0 0x7f7c7406b0b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7c880ad000 tx=0x7f7c880a6000 comp rx=0 tx=0).stop 2024-05-30T06:48:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.499+0000 7f7c9e400640 1 -- 172.21.15.37:0/96055641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c980b50b0 msgr2=0x7f7c98165bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.499+0000 7f7c9e400640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c980b50b0 0x7f7c98165bb0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000e900 tx=0x7f7c8000edc0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.499+0000 7f7c9e400640 1 -- 172.21.15.37:0/96055641 shutdown_connections 2024-05-30T06:48:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.499+0000 7f7c9e400640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c980cec50 0x7f7c9806ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.499+0000 7f7c9e400640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c980b50b0 0x7f7c98165bb0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.499+0000 7f7c9e400640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7c74068bf0 0x7f7c7406b0b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.499+0000 7f7c9e400640 1 --2- 172.21.15.37:0/96055641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c980b0570 0x7f7c980b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.499+0000 7f7c9e400640 1 -- 172.21.15.37:0/96055641 >> 172.21.15.37:0/96055641 conn(0x7f7c980d0d50 msgr2=0x7f7c980adea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.499+0000 7f7c9e400640 1 -- 172.21.15.37:0/96055641 shutdown_connections 2024-05-30T06:48:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.499+0000 7f7c9e400640 1 -- 172.21.15.37:0/96055641 wait complete. 2024-05-30T06:48:33.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T06:48:33.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.671+0000 7fcadaa00640 1 Processor -- start 2024-05-30T06:48:33.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.671+0000 7fcadaa00640 1 -- start start 2024-05-30T06:48:33.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcadaa00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcad40cd440 0x7fcad406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:33.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcadaa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcad406f5a0 0x7fcad40b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:33.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcadaa00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad415f310 con 0x7fcad4155da0 2024-05-30T06:48:33.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcadaa00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcad406fa10 con 0x7fcad406f5a0 2024-05-30T06:48:33.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcadaa00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcad415f5f0 con 0x7fcad40cd440 2024-05-30T06:48:33.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcad8a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcad406f5a0 0x7fcad40b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:33.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcad8a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcad406f5a0 0x7fcad40b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36470/0 (socket says 172.21.15.37:36470) 2024-05-30T06:48:33.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcad8a00640 1 -- 172.21.15.37:0/1866471320 learned_addr learned my addr 172.21.15.37:0/1866471320 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:33.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcacb400640 1 --2- 172.21.15.37:0/1866471320 >> v2:172.21.15.105:3300/0 conn(0x7fcad40cd440 0x7fcad406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:33.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcad8a00640 1 -- 172.21.15.37:0/1866471320 >> v2:172.21.15.105:3300/0 conn(0x7fcad40cd440 msgr2=0x7fcad406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:33.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcad8a00640 1 --2- 172.21.15.37:0/1866471320 >> v2:172.21.15.105:3300/0 conn(0x7fcad40cd440 0x7fcad406f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcad8a00640 1 -- 172.21.15.37:0/1866471320 >> v1:172.21.15.105:6789/0 conn(0x7fcad4155da0 legacy=0x7fcad40cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:33.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcad8a00640 1 -- 172.21.15.37:0/1866471320 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad415f8d0 con 0x7fcad406f5a0 2024-05-30T06:48:33.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcad8a00640 1 --2- 172.21.15.37:0/1866471320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad406f5a0 0x7fcad40b3750 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fcad40b2f00 tx=0x7fcacc01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8364e1219a5f8a81 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:33.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcad3400640 1 -- 172.21.15.37:0/1866471320 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0a5590 con 0x7fcad406f5a0 2024-05-30T06:48:33.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.675+0000 7fcad3400640 1 -- 172.21.15.37:0/1866471320 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcacc0a5730 con 0x7fcad406f5a0 2024-05-30T06:48:33.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcad3400640 1 -- 172.21.15.37:0/1866471320 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0a5b00 con 0x7fcad406f5a0 2024-05-30T06:48:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 -- 172.21.15.37:0/1866471320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad406f5a0 msgr2=0x7fcad40b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 --2- 172.21.15.37:0/1866471320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad406f5a0 0x7fcad40b3750 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fcad40b2f00 tx=0x7fcacc01c8d0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 -- 172.21.15.37:0/1866471320 shutdown_connections 2024-05-30T06:48:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 --2- 172.21.15.37:0/1866471320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad406f5a0 0x7fcad40b3750 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 --2- 172.21.15.37:0/1866471320 >> v2:172.21.15.105:3300/0 conn(0x7fcad40cd440 0x7fcad406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 -- 172.21.15.37:0/1866471320 >> 172.21.15.37:0/1866471320 conn(0x7fcad406bf60 msgr2=0x7fcad40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:33.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 -- 172.21.15.37:0/1866471320 shutdown_connections 2024-05-30T06:48:33.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 -- 172.21.15.37:0/1866471320 wait complete. 2024-05-30T06:48:33.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 Processor -- start 2024-05-30T06:48:33.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 -- start start 2024-05-30T06:48:33.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcad406f5a0 0x7fcad414d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:33.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcad4155da0 0x7fcad414dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:33.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad414e3e0 0x7fcad4071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:33.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcad406df50 con 0x7fcad414e3e0 2024-05-30T06:48:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcad40b46b0 con 0x7fcad406f5a0 2024-05-30T06:48:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcadaa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcad406e0d0 con 0x7fcad4155da0 2024-05-30T06:48:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcad8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad414e3e0 0x7fcad4071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcad8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad414e3e0 0x7fcad4071dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36480/0 (socket says 172.21.15.37:36480) 2024-05-30T06:48:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcad8a00640 1 -- 172.21.15.37:0/1824444124 learned_addr learned my addr 172.21.15.37:0/1824444124 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcad3e00640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcad406f5a0 0x7fcad414d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.679+0000 7fcacb400640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcad4155da0 0x7fcad414dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.683+0000 7fcad8a00640 1 -- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcad4155da0 msgr2=0x7fcad414dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.683+0000 7fcad8a00640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcad4155da0 0x7fcad414dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.683+0000 7fcad8a00640 1 -- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcad406f5a0 msgr2=0x7fcad414d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.683+0000 7fcad8a00640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcad406f5a0 0x7fcad414d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.683+0000 7fcad8a00640 1 -- 172.21.15.37:0/1824444124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad415d950 con 0x7fcad414e3e0 2024-05-30T06:48:33.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.683+0000 7fcad8a00640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad414e3e0 0x7fcad4071dc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0af040 tx=0x7fcacc019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:33.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.683+0000 7fcad0c00640 1 -- 172.21.15.37:0/1824444124 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0bc020 con 0x7fcad414e3e0 2024-05-30T06:48:33.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.683+0000 7fcad0c00640 1 -- 172.21.15.37:0/1824444124 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcacc0b8670 con 0x7fcad414e3e0 2024-05-30T06:48:33.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.683+0000 7fcad0c00640 1 -- 172.21.15.37:0/1824444124 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcacc009510 con 0x7fcad414e3e0 2024-05-30T06:48:33.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.683+0000 7fcadaa00640 1 -- 172.21.15.37:0/1824444124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad415dc30 con 0x7fcad414e3e0 2024-05-30T06:48:33.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.683+0000 7fcadaa00640 1 -- 172.21.15.37:0/1824444124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad4151da0 con 0x7fcad414e3e0 2024-05-30T06:48:33.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.683+0000 7fcadaa00640 1 -- 172.21.15.37:0/1824444124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad4068bc0 con 0x7fcad414e3e0 2024-05-30T06:48:33.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.683+0000 7fcad0c00640 1 -- 172.21.15.37:0/1824444124 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fcacc0bf020 con 0x7fcad414e3e0 2024-05-30T06:48:33.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.687+0000 7fcad0c00640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcab0068bf0 0x7fcab006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:33.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.687+0000 7fcad0c00640 1 -- 172.21.15.37:0/1824444124 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5227+0+0 (secure 0 0 0) 0x7fcacc122760 con 0x7fcad414e3e0 2024-05-30T06:48:33.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.687+0000 7fcad3e00640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcab0068bf0 0x7fcab006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:33.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.687+0000 7fcad3e00640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcab0068bf0 0x7fcab006b0b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcac4001770 tx=0x7fcac4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:33.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.691+0000 7fcad0c00640 1 -- 172.21.15.37:0/1824444124 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcacc0c6030 con 0x7fcad414e3e0 2024-05-30T06:48:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:33.855+0000 7fcadaa00640 1 -- 172.21.15.37:0/1824444124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcad40b6790 con 0x7fcad414e3e0 2024-05-30T06:48:34.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.499+0000 7fcad0c00640 1 -- 172.21.15.37:0/1824444124 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v58) ==== 170+0+0 (secure 0 0 0) 0x7fcacc0165e0 con 0x7fcad414e3e0 2024-05-30T06:48:34.499 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-30T06:48:34.502 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:48:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.503+0000 7fcadaa00640 1 -- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcab0068bf0 msgr2=0x7fcab006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.503+0000 7fcadaa00640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcab0068bf0 0x7fcab006b0b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcac4001770 tx=0x7fcac4009040 comp rx=0 tx=0).stop 2024-05-30T06:48:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.503+0000 7fcadaa00640 1 -- 172.21.15.37:0/1824444124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad414e3e0 msgr2=0x7fcad4071dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.503+0000 7fcadaa00640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad414e3e0 0x7fcad4071dc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0af040 tx=0x7fcacc019670 comp rx=0 tx=0).stop 2024-05-30T06:48:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.503+0000 7fcadaa00640 1 -- 172.21.15.37:0/1824444124 shutdown_connections 2024-05-30T06:48:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.503+0000 7fcadaa00640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad414e3e0 0x7fcad4071dc0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:34.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.503+0000 7fcadaa00640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcad4155da0 0x7fcad414dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:34.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.503+0000 7fcadaa00640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcab0068bf0 0x7fcab006b0b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:34.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.503+0000 7fcadaa00640 1 --2- 172.21.15.37:0/1824444124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcad406f5a0 0x7fcad414d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:34.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.503+0000 7fcadaa00640 1 -- 172.21.15.37:0/1824444124 >> 172.21.15.37:0/1824444124 conn(0x7fcad406bf60 msgr2=0x7fcad40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:34.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.503+0000 7fcadaa00640 1 -- 172.21.15.37:0/1824444124 shutdown_connections 2024-05-30T06:48:34.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.503+0000 7fcadaa00640 1 -- 172.21.15.37:0/1824444124 wait complete. 2024-05-30T06:48:34.508 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:48:34.543 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T06:48:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2f2400640 1 Processor -- start 2024-05-30T06:48:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2f2400640 1 -- start start 2024-05-30T06:48:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2f2400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2ec15c9a0 0x7fe2ec0cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2f2400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe2ec0cffd0 0x7fe2ec0afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2f2400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2ec0af0d0 con 0x7fe2ec0d0600 2024-05-30T06:48:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2f2400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe2ec0ce000 con 0x7fe2ec15c9a0 2024-05-30T06:48:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2f2400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe2ec0ce2e0 con 0x7fe2ec0cffd0 2024-05-30T06:48:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2ebe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2ec15c9a0 0x7fe2ec0cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2ebe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2ec15c9a0 0x7fe2ec0cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36496/0 (socket says 172.21.15.37:36496) 2024-05-30T06:48:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2ebe00640 1 -- 172.21.15.37:0/2214013143 learned_addr learned my addr 172.21.15.37:0/2214013143 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2f1a00640 1 --2- 172.21.15.37:0/2214013143 >> v2:172.21.15.105:3300/0 conn(0x7fe2ec0cffd0 0x7fe2ec0afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2ebe00640 1 -- 172.21.15.37:0/2214013143 >> v2:172.21.15.105:3300/0 conn(0x7fe2ec0cffd0 msgr2=0x7fe2ec0afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2ebe00640 1 --2- 172.21.15.37:0/2214013143 >> v2:172.21.15.105:3300/0 conn(0x7fe2ec0cffd0 0x7fe2ec0afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2ebe00640 1 -- 172.21.15.37:0/2214013143 >> v1:172.21.15.105:6789/0 conn(0x7fe2ec0d0600 legacy=0x7fe2ec0d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.755+0000 7fe2ebe00640 1 -- 172.21.15.37:0/2214013143 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ec0af370 con 0x7fe2ec15c9a0 2024-05-30T06:48:34.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.759+0000 7fe2ebe00640 1 --2- 172.21.15.37:0/2214013143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2ec15c9a0 0x7fe2ec0cd9d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0733a0 tx=0x7fe2d801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42962d7418acca6e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:34.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.759+0000 7fe2eb400640 1 -- 172.21.15.37:0/2214013143 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80ab620 con 0x7fe2ec15c9a0 2024-05-30T06:48:34.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.759+0000 7fe2eb400640 1 -- 172.21.15.37:0/2214013143 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d80b0070 con 0x7fe2ec15c9a0 2024-05-30T06:48:34.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.759+0000 7fe2eb400640 1 -- 172.21.15.37:0/2214013143 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80ab9e0 con 0x7fe2ec15c9a0 2024-05-30T06:48:34.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.759+0000 7fe2f2400640 1 -- 172.21.15.37:0/2214013143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2ec15c9a0 msgr2=0x7fe2ec0cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:34.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.759+0000 7fe2f2400640 1 --2- 172.21.15.37:0/2214013143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2ec15c9a0 0x7fe2ec0cd9d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0733a0 tx=0x7fe2d801c4f0 comp rx=0 tx=0).stop 2024-05-30T06:48:34.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.759+0000 7fe2f2400640 1 -- 172.21.15.37:0/2214013143 shutdown_connections 2024-05-30T06:48:34.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.759+0000 7fe2f2400640 1 --2- 172.21.15.37:0/2214013143 >> v2:172.21.15.105:3300/0 conn(0x7fe2ec0cffd0 0x7fe2ec0afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:34.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.759+0000 7fe2f2400640 1 --2- 172.21.15.37:0/2214013143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2ec15c9a0 0x7fe2ec0cd9d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:34.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.759+0000 7fe2f2400640 1 -- 172.21.15.37:0/2214013143 >> 172.21.15.37:0/2214013143 conn(0x7fe2ec0b3ef0 msgr2=0x7fe2ec0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:34.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.759+0000 7fe2f2400640 1 -- 172.21.15.37:0/2214013143 shutdown_connections 2024-05-30T06:48:34.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.759+0000 7fe2f2400640 1 -- 172.21.15.37:0/2214013143 wait complete. 2024-05-30T06:48:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f2400640 1 Processor -- start 2024-05-30T06:48:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f2400640 1 -- start start 2024-05-30T06:48:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f2400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2ec0cffd0 0x7fe2ec15f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f2400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ec0d0600 0x7fe2ec0b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f2400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ec15c9a0 0x7fe2ec0b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f2400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec0b0c50 con 0x7fe2ec0cffd0 2024-05-30T06:48:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f2400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec0b0ad0 con 0x7fe2ec0d0600 2024-05-30T06:48:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f2400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ec0b0dd0 con 0x7fe2ec15c9a0 2024-05-30T06:48:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f1000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2ec0cffd0 0x7fe2ec15f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f1000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2ec0cffd0 0x7fe2ec15f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36504/0 (socket says 172.21.15.37:36504) 2024-05-30T06:48:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f1000640 1 -- 172.21.15.37:0/1464752790 learned_addr learned my addr 172.21.15.37:0/1464752790 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2ebe00640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ec0d0600 0x7fe2ec0b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f1a00640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ec15c9a0 0x7fe2ec0b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f1000640 1 -- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ec15c9a0 msgr2=0x7fe2ec0b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f1000640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ec15c9a0 0x7fe2ec0b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f1000640 1 -- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ec0d0600 msgr2=0x7fe2ec0b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f1000640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ec0d0600 0x7fe2ec0b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f1000640 1 -- 172.21.15.37:0/1464752790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ec15b7f0 con 0x7fe2ec0cffd0 2024-05-30T06:48:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f1000640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2ec0cffd0 0x7fe2ec15f7c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000c3a0 tx=0x7fe2e000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2e8c00640 1 -- 172.21.15.37:0/1464752790 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e00052d0 con 0x7fe2ec0cffd0 2024-05-30T06:48:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2e8c00640 1 -- 172.21.15.37:0/1464752790 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e0005470 con 0x7fe2ec0cffd0 2024-05-30T06:48:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2e8c00640 1 -- 172.21.15.37:0/1464752790 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0007260 con 0x7fe2ec0cffd0 2024-05-30T06:48:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f2400640 1 -- 172.21.15.37:0/1464752790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2ec0cb4e0 con 0x7fe2ec0cffd0 2024-05-30T06:48:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.763+0000 7fe2f2400640 1 -- 172.21.15.37:0/1464752790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2ec0cbaa0 con 0x7fe2ec0cffd0 2024-05-30T06:48:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.767+0000 7fe2f2400640 1 -- 172.21.15.37:0/1464752790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2ec068ab0 con 0x7fe2ec0cffd0 2024-05-30T06:48:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.767+0000 7fe2e8c00640 1 -- 172.21.15.37:0/1464752790 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fe2e0007400 con 0x7fe2ec0cffd0 2024-05-30T06:48:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.767+0000 7fe2e8c00640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2cc068bf0 0x7fe2cc06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.767+0000 7fe2e8c00640 1 -- 172.21.15.37:0/1464752790 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5609+0+0 (secure 0 0 0) 0x7fe2e0087740 con 0x7fe2ec0cffd0 2024-05-30T06:48:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.767+0000 7fe2ebe00640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2cc068bf0 0x7fe2cc06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:34.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.771+0000 7fe2ebe00640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2cc068bf0 0x7fe2cc06b0b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80af000 tx=0x7fe2d80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:34.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.771+0000 7fe2e8c00640 1 -- 172.21.15.37:0/1464752790 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe2e0056870 con 0x7fe2ec0cffd0 2024-05-30T06:48:34.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:34.971+0000 7fe2f2400640 1 -- 172.21.15.37:0/1464752790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe2ec0ce930 con 0x7fe2ec0cffd0 2024-05-30T06:48:35.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.511+0000 7fe2e8c00640 1 -- 172.21.15.37:0/1464752790 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v33) ==== 172+0+0 (secure 0 0 0) 0x7fe2e005ab70 con 0x7fe2ec0cffd0 2024-05-30T06:48:35.512 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 8 and data pool 9 2024-05-30T06:48:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.515+0000 7fe2f2400640 1 -- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2cc068bf0 msgr2=0x7fe2cc06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.515+0000 7fe2f2400640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2cc068bf0 0x7fe2cc06b0b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80af000 tx=0x7fe2d80a7000 comp rx=0 tx=0).stop 2024-05-30T06:48:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.515+0000 7fe2f2400640 1 -- 172.21.15.37:0/1464752790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2ec0cffd0 msgr2=0x7fe2ec15f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.515+0000 7fe2f2400640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2ec0cffd0 0x7fe2ec15f7c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe2e000c3a0 tx=0x7fe2e000c860 comp rx=0 tx=0).stop 2024-05-30T06:48:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.515+0000 7fe2f2400640 1 -- 172.21.15.37:0/1464752790 shutdown_connections 2024-05-30T06:48:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.515+0000 7fe2f2400640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ec15c9a0 0x7fe2ec0b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.515+0000 7fe2f2400640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2cc068bf0 0x7fe2cc06b0b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.515+0000 7fe2f2400640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ec0d0600 0x7fe2ec0b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.515+0000 7fe2f2400640 1 --2- 172.21.15.37:0/1464752790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2ec0cffd0 0x7fe2ec15f7c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.515+0000 7fe2f2400640 1 -- 172.21.15.37:0/1464752790 >> 172.21.15.37:0/1464752790 conn(0x7fe2ec0b3ef0 msgr2=0x7fe2ec09aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.519+0000 7fe2f2400640 1 -- 172.21.15.37:0/1464752790 shutdown_connections 2024-05-30T06:48:35.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.519+0000 7fe2f2400640 1 -- 172.21.15.37:0/1464752790 wait complete. 2024-05-30T06:48:35.566 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:48:35.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65f200640 1 Processor -- start 2024-05-30T06:48:35.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65f200640 1 -- start start 2024-05-30T06:48:35.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65f200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa6601605d0 0x7fa6600b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:35.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65f200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6601609b0 0x7fa660160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65f200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa66015f7d0 0x7fa66015fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65f200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa6600cdda0 con 0x7fa6601605d0 2024-05-30T06:48:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65f200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa6600ce080 con 0x7fa66015f7d0 2024-05-30T06:48:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65f200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa66009ac00 con 0x7fa6601609b0 2024-05-30T06:48:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65de00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa6601605d0 0x7fa6600b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65de00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa6601605d0 0x7fa6600b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36518/0 (socket says 172.21.15.37:36518) 2024-05-30T06:48:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65de00640 1 -- 172.21.15.37:0/1107455711 learned_addr learned my addr 172.21.15.37:0/1107455711 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65e800640 1 --2- 172.21.15.37:0/1107455711 >> v2:172.21.15.105:3300/0 conn(0x7fa66015f7d0 0x7fa66015fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa657e00640 1 --2- 172.21.15.37:0/1107455711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6601609b0 0x7fa660160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65de00640 1 -- 172.21.15.37:0/1107455711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6601609b0 msgr2=0x7fa660160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65de00640 1 --2- 172.21.15.37:0/1107455711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6601609b0 0x7fa660160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65de00640 1 -- 172.21.15.37:0/1107455711 >> v2:172.21.15.105:3300/0 conn(0x7fa66015f7d0 msgr2=0x7fa66015fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:35.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65de00640 1 --2- 172.21.15.37:0/1107455711 >> v2:172.21.15.105:3300/0 conn(0x7fa66015f7d0 0x7fa66015fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.711+0000 7fa65de00640 1 -- 172.21.15.37:0/1107455711 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66009aee0 con 0x7fa6601605d0 2024-05-30T06:48:35.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.715+0000 7fa65de00640 1 --2- 172.21.15.37:0/1107455711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6601605d0 0x7fa6600b52b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa660073730 tx=0x7fa65001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790a9ad3ea4d01af server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:35.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.715+0000 7fa65d400640 1 -- 172.21.15.37:0/1107455711 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6500b0070 con 0x7fa6601605d0 2024-05-30T06:48:35.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.715+0000 7fa65d400640 1 -- 172.21.15.37:0/1107455711 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6500ab600 con 0x7fa6601605d0 2024-05-30T06:48:35.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.715+0000 7fa65d400640 1 -- 172.21.15.37:0/1107455711 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6500ab9d0 con 0x7fa6601605d0 2024-05-30T06:48:35.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.715+0000 7fa65f200640 1 -- 172.21.15.37:0/1107455711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6601605d0 msgr2=0x7fa6600b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:35.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.715+0000 7fa65f200640 1 --2- 172.21.15.37:0/1107455711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6601605d0 0x7fa6600b52b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fa660073730 tx=0x7fa65001c520 comp rx=0 tx=0).stop 2024-05-30T06:48:35.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.715+0000 7fa65f200640 1 -- 172.21.15.37:0/1107455711 shutdown_connections 2024-05-30T06:48:35.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.715+0000 7fa65f200640 1 --2- 172.21.15.37:0/1107455711 >> v2:172.21.15.105:3300/0 conn(0x7fa66015f7d0 0x7fa66015fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.715+0000 7fa65f200640 1 --2- 172.21.15.37:0/1107455711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6601609b0 0x7fa660160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.715+0000 7fa65f200640 1 --2- 172.21.15.37:0/1107455711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6601605d0 0x7fa6600b52b0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.715+0000 7fa65f200640 1 -- 172.21.15.37:0/1107455711 >> 172.21.15.37:0/1107455711 conn(0x7fa6600b3f50 msgr2=0x7fa6600b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:35.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.715+0000 7fa65f200640 1 -- 172.21.15.37:0/1107455711 shutdown_connections 2024-05-30T06:48:35.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.715+0000 7fa65f200640 1 -- 172.21.15.37:0/1107455711 wait complete. 2024-05-30T06:48:35.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65f200640 1 Processor -- start 2024-05-30T06:48:35.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65f200640 1 -- start start 2024-05-30T06:48:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65f200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa66015f7d0 0x7fa6600c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6601605d0 0x7fa66015eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65f200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6601609b0 0x7fa6600b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa6600d0030 con 0x7fa6601605d0 2024-05-30T06:48:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65f200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa66009be20 con 0x7fa6601609b0 2024-05-30T06:48:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65f200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa6600d01b0 con 0x7fa66015f7d0 2024-05-30T06:48:35.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa657e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6601605d0 0x7fa66015eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa657e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6601605d0 0x7fa66015eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36530/0 (socket says 172.21.15.37:36530) 2024-05-30T06:48:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa657e00640 1 -- 172.21.15.37:0/2180181367 learned_addr learned my addr 172.21.15.37:0/2180181367 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65e800640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6601609b0 0x7fa6600b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65de00640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa66015f7d0 0x7fa6600c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa657e00640 1 -- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa66015f7d0 msgr2=0x7fa6600c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa657e00640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa66015f7d0 0x7fa6600c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa657e00640 1 -- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6601609b0 msgr2=0x7fa6600b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa657e00640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6601609b0 0x7fa6600b73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa657e00640 1 -- 172.21.15.37:0/2180181367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66014e870 con 0x7fa6601605d0 2024-05-30T06:48:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65e800640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6601609b0 0x7fa6600b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa657e00640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6601605d0 0x7fa66015eaa0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa64800e870 tx=0x7fa64800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa656000640 1 -- 172.21.15.37:0/2180181367 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa648017070 con 0x7fa6601605d0 2024-05-30T06:48:35.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa656000640 1 -- 172.21.15.37:0/2180181367 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa64800c940 con 0x7fa6601605d0 2024-05-30T06:48:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa656000640 1 -- 172.21.15.37:0/2180181367 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64800cd10 con 0x7fa6601605d0 2024-05-30T06:48:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65f200640 1 -- 172.21.15.37:0/2180181367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6600c8950 con 0x7fa6601605d0 2024-05-30T06:48:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65f200640 1 -- 172.21.15.37:0/2180181367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66014cdc0 con 0x7fa6601605d0 2024-05-30T06:48:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.719+0000 7fa65f200640 1 -- 172.21.15.37:0/2180181367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa660068ab0 con 0x7fa6601605d0 2024-05-30T06:48:35.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.723+0000 7fa656000640 1 -- 172.21.15.37:0/2180181367 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fa64801a070 con 0x7fa6601605d0 2024-05-30T06:48:35.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.723+0000 7fa656000640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa63c068bf0 0x7fa63c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:35.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.723+0000 7fa656000640 1 -- 172.21.15.37:0/2180181367 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fa648087860 con 0x7fa6601605d0 2024-05-30T06:48:35.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.723+0000 7fa65de00640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa63c068bf0 0x7fa63c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:35.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.723+0000 7fa65de00640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa63c068bf0 0x7fa63c06b0b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa6500ad000 tx=0x7fa6500a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:35.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.727+0000 7fa656000640 1 -- 172.21.15.37:0/2180181367 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa648056940 con 0x7fa6601605d0 2024-05-30T06:48:35.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.895+0000 7fa65f200640 1 -- 172.21.15.37:0/2180181367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa66014cb70 con 0x7fa6601605d0 2024-05-30T06:48:35.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.895+0000 7fa656000640 1 -- 172.21.15.37:0/2180181367 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16666 (secure 0 0 0) 0x7fa64805ac40 con 0x7fa6601605d0 2024-05-30T06:48:35.894 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:35.894 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":59,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:48:34.974264+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:48:33.300340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T06:48:33.866916+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:48:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.899+0000 7fa65f200640 1 -- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa63c068bf0 msgr2=0x7fa63c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.899+0000 7fa65f200640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa63c068bf0 0x7fa63c06b0b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa6500ad000 tx=0x7fa6500a6000 comp rx=0 tx=0).stop 2024-05-30T06:48:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.899+0000 7fa65f200640 1 -- 172.21.15.37:0/2180181367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6601605d0 msgr2=0x7fa66015eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.899+0000 7fa65f200640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6601605d0 0x7fa66015eaa0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa64800e870 tx=0x7fa64800ec70 comp rx=0 tx=0).stop 2024-05-30T06:48:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.899+0000 7fa65f200640 1 -- 172.21.15.37:0/2180181367 shutdown_connections 2024-05-30T06:48:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.899+0000 7fa65f200640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa63c068bf0 0x7fa63c06b0b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.899+0000 7fa65f200640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6601609b0 0x7fa6600b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.899+0000 7fa65f200640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6601605d0 0x7fa66015eaa0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.899+0000 7fa65f200640 1 --2- 172.21.15.37:0/2180181367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa66015f7d0 0x7fa6600c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.899+0000 7fa65f200640 1 -- 172.21.15.37:0/2180181367 >> 172.21.15.37:0/2180181367 conn(0x7fa6600b3f50 msgr2=0x7fa6601581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.899+0000 7fa65f200640 1 -- 172.21.15.37:0/2180181367 shutdown_connections 2024-05-30T06:48:35.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:35.899+0000 7fa65f200640 1 -- 172.21.15.37:0/2180181367 wait complete. 2024-05-30T06:48:35.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:48:36.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3dba00640 1 Processor -- start 2024-05-30T06:48:36.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3dba00640 1 -- start start 2024-05-30T06:48:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3dba00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3d406e000 0x7fa3d40ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3dba00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa3d415cd80 0x7fa3d40ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3dba00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3d40cd120 con 0x7fa3d40cec40 2024-05-30T06:48:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3dba00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d40a9530 con 0x7fa3d406e000 2024-05-30T06:48:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3dba00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d40cd400 con 0x7fa3d415cd80 2024-05-30T06:48:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3d9000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3d406e000 0x7fa3d40ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3d9000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3d406e000 0x7fa3d40ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36538/0 (socket says 172.21.15.37:36538) 2024-05-30T06:48:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3d9000640 1 -- 172.21.15.37:0/4060310665 learned_addr learned my addr 172.21.15.37:0/4060310665 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3d9000640 1 -- 172.21.15.37:0/4060310665 >> v2:172.21.15.105:3300/0 conn(0x7fa3d415cd80 msgr2=0x7fa3d40ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3d9000640 1 --2- 172.21.15.37:0/4060310665 >> v2:172.21.15.105:3300/0 conn(0x7fa3d415cd80 0x7fa3d40ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3d9000640 1 -- 172.21.15.37:0/4060310665 >> v1:172.21.15.105:6789/0 conn(0x7fa3d40cec40 legacy=0x7fa3d406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.059+0000 7fa3d9000640 1 -- 172.21.15.37:0/4060310665 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d40cd6e0 con 0x7fa3d406e000 2024-05-30T06:48:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.063+0000 7fa3d9000640 1 --2- 172.21.15.37:0/4060310665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d406e000 0x7fa3d40ce1c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40cfb50 tx=0x7fa3c801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987a291716590d98 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.063+0000 7fa3d3400640 1 -- 172.21.15.37:0/4060310665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80b5070 con 0x7fa3d406e000 2024-05-30T06:48:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.063+0000 7fa3d3400640 1 -- 172.21.15.37:0/4060310665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3c80a89d0 con 0x7fa3d406e000 2024-05-30T06:48:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.063+0000 7fa3d3400640 1 -- 172.21.15.37:0/4060310665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80a8da0 con 0x7fa3d406e000 2024-05-30T06:48:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.063+0000 7fa3dba00640 1 -- 172.21.15.37:0/4060310665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d406e000 msgr2=0x7fa3d40ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.063+0000 7fa3dba00640 1 --2- 172.21.15.37:0/4060310665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d406e000 0x7fa3d40ce1c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40cfb50 tx=0x7fa3c801ecd0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.063+0000 7fa3dba00640 1 -- 172.21.15.37:0/4060310665 shutdown_connections 2024-05-30T06:48:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.063+0000 7fa3dba00640 1 --2- 172.21.15.37:0/4060310665 >> v2:172.21.15.105:3300/0 conn(0x7fa3d415cd80 0x7fa3d40ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.063+0000 7fa3dba00640 1 --2- 172.21.15.37:0/4060310665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d406e000 0x7fa3d40ce1c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.063+0000 7fa3dba00640 1 -- 172.21.15.37:0/4060310665 >> 172.21.15.37:0/4060310665 conn(0x7fa3d40b23a0 msgr2=0x7fa3d40b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.063+0000 7fa3dba00640 1 -- 172.21.15.37:0/4060310665 shutdown_connections 2024-05-30T06:48:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.063+0000 7fa3dba00640 1 -- 172.21.15.37:0/4060310665 wait complete. 2024-05-30T06:48:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3dba00640 1 Processor -- start 2024-05-30T06:48:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3dba00640 1 -- start start 2024-05-30T06:48:36.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3dba00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d406e000 0x7fa3d413bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:36.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3dba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3d40cec40 0x7fa3d4151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:36.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3dba00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d415cd80 0x7fa3d415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:36.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3dba00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d40cf090 con 0x7fa3d415cd80 2024-05-30T06:48:36.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3dba00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d40cdca0 con 0x7fa3d406e000 2024-05-30T06:48:36.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3dba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d41663c0 con 0x7fa3d40cec40 2024-05-30T06:48:36.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d9a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d415cd80 0x7fa3d415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d9a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d415cd80 0x7fa3d415b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36554/0 (socket says 172.21.15.37:36554) 2024-05-30T06:48:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d9a00640 1 -- 172.21.15.37:0/417496696 learned_addr learned my addr 172.21.15.37:0/417496696 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d9000640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d406e000 0x7fa3d413bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d3e00640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3d40cec40 0x7fa3d4151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d9a00640 1 -- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3d40cec40 msgr2=0x7fa3d4151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d9a00640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3d40cec40 0x7fa3d4151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d9a00640 1 -- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d406e000 msgr2=0x7fa3d413bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d9a00640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d406e000 0x7fa3d413bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d9a00640 1 -- 172.21.15.37:0/417496696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d413c120 con 0x7fa3d415cd80 2024-05-30T06:48:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d9a00640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d415cd80 0x7fa3d415b5b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00c7b0 tx=0x7fa3cc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d0c00640 1 -- 172.21.15.37:0/417496696 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc017070 con 0x7fa3d415cd80 2024-05-30T06:48:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d0c00640 1 -- 172.21.15.37:0/417496696 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3cc003db0 con 0x7fa3d415cd80 2024-05-30T06:48:36.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3d0c00640 1 -- 172.21.15.37:0/417496696 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0052b0 con 0x7fa3d415cd80 2024-05-30T06:48:36.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3dba00640 1 -- 172.21.15.37:0/417496696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d4151870 con 0x7fa3d415cd80 2024-05-30T06:48:36.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.067+0000 7fa3dba00640 1 -- 172.21.15.37:0/417496696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d4151df0 con 0x7fa3d415cd80 2024-05-30T06:48:36.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.071+0000 7fa3dba00640 1 -- 172.21.15.37:0/417496696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d4068b20 con 0x7fa3d415cd80 2024-05-30T06:48:36.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.071+0000 7fa3d0c00640 1 -- 172.21.15.37:0/417496696 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fa3cc005450 con 0x7fa3d415cd80 2024-05-30T06:48:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.071+0000 7fa3d0c00640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa3b4068bf0 0x7fa3b406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.071+0000 7fa3d0c00640 1 -- 172.21.15.37:0/417496696 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fa3cc0870c0 con 0x7fa3d415cd80 2024-05-30T06:48:36.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.071+0000 7fa3d9000640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa3b4068bf0 0x7fa3b406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:36.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.075+0000 7fa3d9000640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa3b4068bf0 0x7fa3b406b0b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80b2000 tx=0x7fa3c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:36.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.075+0000 7fa3d0c00640 1 -- 172.21.15.37:0/417496696 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa3cc056110 con 0x7fa3d415cd80 2024-05-30T06:48:36.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.243+0000 7fa3dba00640 1 -- 172.21.15.37:0/417496696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3d41570e0 con 0x7fa3d415cd80 2024-05-30T06:48:36.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.243+0000 7fa3d0c00640 1 -- 172.21.15.37:0/417496696 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16666 (secure 0 0 0) 0x7fa3cc05a410 con 0x7fa3d415cd80 2024-05-30T06:48:36.242 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:36.242 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":59,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:48:34.974264+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:48:33.300340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T06:48:33.866916+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:48:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.243+0000 7fa3dba00640 1 -- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa3b4068bf0 msgr2=0x7fa3b406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.243+0000 7fa3dba00640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa3b4068bf0 0x7fa3b406b0b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80b2000 tx=0x7fa3c8008040 comp rx=0 tx=0).stop 2024-05-30T06:48:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.243+0000 7fa3dba00640 1 -- 172.21.15.37:0/417496696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d415cd80 msgr2=0x7fa3d415b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.243+0000 7fa3dba00640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d415cd80 0x7fa3d415b5b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00c7b0 tx=0x7fa3cc00cc70 comp rx=0 tx=0).stop 2024-05-30T06:48:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.243+0000 7fa3dba00640 1 -- 172.21.15.37:0/417496696 shutdown_connections 2024-05-30T06:48:36.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.243+0000 7fa3dba00640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3d415cd80 0x7fa3d415b5b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.243+0000 7fa3dba00640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3d40cec40 0x7fa3d4151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.243+0000 7fa3dba00640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa3b4068bf0 0x7fa3b406b0b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.243+0000 7fa3dba00640 1 --2- 172.21.15.37:0/417496696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3d406e000 0x7fa3d413bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.243+0000 7fa3dba00640 1 -- 172.21.15.37:0/417496696 >> 172.21.15.37:0/417496696 conn(0x7fa3d40b23a0 msgr2=0x7fa3d4144620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:36.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.247+0000 7fa3dba00640 1 -- 172.21.15.37:0/417496696 shutdown_connections 2024-05-30T06:48:36.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.247+0000 7fa3dba00640 1 -- 172.21.15.37:0/417496696 wait complete. 2024-05-30T06:48:36.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T06:48:36.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.407+0000 7fc2b7200640 1 Processor -- start 2024-05-30T06:48:36.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2b7200640 1 -- start start 2024-05-30T06:48:36.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2b7200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc2b0155da0 0x7fc2b00cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:36.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2b7200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc2b006f770 0x7fc2b00b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:36.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2b7200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2b015f310 con 0x7fc2b00cd440 2024-05-30T06:48:36.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2b7200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b015f5f0 con 0x7fc2b0155da0 2024-05-30T06:48:36.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2b7200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b015f8d0 con 0x7fc2b006f770 2024-05-30T06:48:36.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2afe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc2b0155da0 0x7fc2b00cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:36.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2afe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc2b0155da0 0x7fc2b00cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36558/0 (socket says 172.21.15.37:36558) 2024-05-30T06:48:36.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2afe00640 1 -- 172.21.15.37:0/2449527597 learned_addr learned my addr 172.21.15.37:0/2449527597 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:36.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2a7400640 1 --1- 172.21.15.37:0/2449527597 >> v1:172.21.15.37:6789/0 conn(0x7fc2b00cd440 0x7fc2b006f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52168/0 (socket says 172.21.15.37:52168) 2024-05-30T06:48:36.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2b5200640 1 --2- 172.21.15.37:0/2449527597 >> v2:172.21.15.105:3300/0 conn(0x7fc2b006f770 0x7fc2b00b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:36.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2afe00640 1 -- 172.21.15.37:0/2449527597 >> v2:172.21.15.105:3300/0 conn(0x7fc2b006f770 msgr2=0x7fc2b00b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:36.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2afe00640 1 --2- 172.21.15.37:0/2449527597 >> v2:172.21.15.105:3300/0 conn(0x7fc2b006f770 0x7fc2b00b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2afe00640 1 -- 172.21.15.37:0/2449527597 >> v1:172.21.15.37:6789/0 conn(0x7fc2b00cd440 legacy=0x7fc2b006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:36.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2afe00640 1 -- 172.21.15.37:0/2449527597 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b015fbb0 con 0x7fc2b0155da0 2024-05-30T06:48:36.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.411+0000 7fc2af400640 1 -- 172.21.15.37:0/2449527597 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687173373 0 0) 0x7fc2b015f310 con 0x7fc2b00cd440 2024-05-30T06:48:36.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2afe00640 1 --2- 172.21.15.37:0/2449527597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b0155da0 0x7fc2b00cd950 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00b6600 tx=0x7fc2a001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fcfdbc28faedb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:36.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2af400640 1 -- 172.21.15.37:0/2449527597 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00b0070 con 0x7fc2b0155da0 2024-05-30T06:48:36.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2af400640 1 -- 172.21.15.37:0/2449527597 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2a00ab600 con 0x7fc2b0155da0 2024-05-30T06:48:36.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2af400640 1 -- 172.21.15.37:0/2449527597 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00ab9d0 con 0x7fc2b0155da0 2024-05-30T06:48:36.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2b7200640 1 -- 172.21.15.37:0/2449527597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b0155da0 msgr2=0x7fc2b00cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:36.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2b7200640 1 --2- 172.21.15.37:0/2449527597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b0155da0 0x7fc2b00cd950 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00b6600 tx=0x7fc2a001c400 comp rx=0 tx=0).stop 2024-05-30T06:48:36.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2b7200640 1 -- 172.21.15.37:0/2449527597 shutdown_connections 2024-05-30T06:48:36.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2b7200640 1 --2- 172.21.15.37:0/2449527597 >> v2:172.21.15.105:3300/0 conn(0x7fc2b006f770 0x7fc2b00b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2b7200640 1 --2- 172.21.15.37:0/2449527597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b0155da0 0x7fc2b00cd950 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2b7200640 1 -- 172.21.15.37:0/2449527597 >> 172.21.15.37:0/2449527597 conn(0x7fc2b006bf60 msgr2=0x7fc2b00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:36.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2b7200640 1 -- 172.21.15.37:0/2449527597 shutdown_connections 2024-05-30T06:48:36.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2b7200640 1 -- 172.21.15.37:0/2449527597 wait complete. 2024-05-30T06:48:36.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2b7200640 1 Processor -- start 2024-05-30T06:48:36.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.415+0000 7fc2b7200640 1 -- start start 2024-05-30T06:48:36.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2b7200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b006f770 0x7fc2b0144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:36.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2b7200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2b0155da0 0x7fc2b015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:36.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2b7200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2b015d7a0 0x7fc2b0153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:36.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2b7200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b006df50 con 0x7fc2b006f770 2024-05-30T06:48:36.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2b7200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b00b4730 con 0x7fc2b015d7a0 2024-05-30T06:48:36.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2b7200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b006e0d0 con 0x7fc2b0155da0 2024-05-30T06:48:36.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2afe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b006f770 0x7fc2b0144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:36.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2afe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b006f770 0x7fc2b0144f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36568/0 (socket says 172.21.15.37:36568) 2024-05-30T06:48:36.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2afe00640 1 -- 172.21.15.37:0/2920187023 learned_addr learned my addr 172.21.15.37:0/2920187023 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:36.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2a7400640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2b0155da0 0x7fc2b015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:36.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2b5200640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2b015d7a0 0x7fc2b0153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:36.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2afe00640 1 -- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2b0155da0 msgr2=0x7fc2b015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:36.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2afe00640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2b0155da0 0x7fc2b015bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2afe00640 1 -- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2b015d7a0 msgr2=0x7fc2b0153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:36.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2afe00640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2b015d7a0 0x7fc2b0153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:36.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2afe00640 1 -- 172.21.15.37:0/2920187023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b0145470 con 0x7fc2b006f770 2024-05-30T06:48:36.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2afe00640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b006f770 0x7fc2b0144f30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0019010 tx=0x7fc2a00191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:36.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2acc00640 1 -- 172.21.15.37:0/2920187023 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00b0040 con 0x7fc2b006f770 2024-05-30T06:48:36.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2acc00640 1 -- 172.21.15.37:0/2920187023 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2a00b4620 con 0x7fc2b006f770 2024-05-30T06:48:36.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2acc00640 1 -- 172.21.15.37:0/2920187023 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00b4a10 con 0x7fc2b006f770 2024-05-30T06:48:36.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2b7200640 1 -- 172.21.15.37:0/2920187023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b015c4b0 con 0x7fc2b006f770 2024-05-30T06:48:36.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2b7200640 1 -- 172.21.15.37:0/2920187023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b015ca70 con 0x7fc2b006f770 2024-05-30T06:48:36.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2b7200640 1 -- 172.21.15.37:0/2920187023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b0068bc0 con 0x7fc2b006f770 2024-05-30T06:48:36.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.419+0000 7fc2acc00640 1 -- 172.21.15.37:0/2920187023 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fc2a00ab4c0 con 0x7fc2b006f770 2024-05-30T06:48:36.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.423+0000 7fc2acc00640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc28c068bf0 0x7fc28c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:36.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.423+0000 7fc2acc00640 1 -- 172.21.15.37:0/2920187023 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5709+0+0 (secure 0 0 0) 0x7fc2a0121450 con 0x7fc2b006f770 2024-05-30T06:48:36.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.423+0000 7fc2a7400640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc28c068bf0 0x7fc28c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:36.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.423+0000 7fc2a7400640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc28c068bf0 0x7fc28c06b0b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc2b01662b0 tx=0x7fc298009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:36.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.427+0000 7fc2acc00640 1 -- 172.21.15.37:0/2920187023 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc2a0016110 con 0x7fc2b006f770 2024-05-30T06:48:36.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:36.631+0000 7fc2b7200640 1 -- 172.21.15.37:0/2920187023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc2b00ccea0 con 0x7fc2b006f770 2024-05-30T06:48:37.497 INFO:tasks.ceph.mds.b.smithi105.stderr:2024-05-30T06:48:37.497+0000 7fb85b600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T06:48:37.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.543+0000 7fc2acc00640 1 -- 172.21.15.37:0/2920187023 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) ==== 118+0+0 (secure 0 0 0) 0x7fc2a00f0e80 con 0x7fc2b006f770 2024-05-30T06:48:37.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.543+0000 7fc2b7200640 1 -- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc28c068bf0 msgr2=0x7fc28c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:37.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.543+0000 7fc2b7200640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc28c068bf0 0x7fc28c06b0b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc2b01662b0 tx=0x7fc298009040 comp rx=0 tx=0).stop 2024-05-30T06:48:37.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.543+0000 7fc2b7200640 1 -- 172.21.15.37:0/2920187023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b006f770 msgr2=0x7fc2b0144f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:37.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.543+0000 7fc2b7200640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b006f770 0x7fc2b0144f30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0019010 tx=0x7fc2a00191a0 comp rx=0 tx=0).stop 2024-05-30T06:48:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.547+0000 7fc2b7200640 1 -- 172.21.15.37:0/2920187023 shutdown_connections 2024-05-30T06:48:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.547+0000 7fc2b7200640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc28c068bf0 0x7fc28c06b0b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.547+0000 7fc2b7200640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2b015d7a0 0x7fc2b0153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.547+0000 7fc2b7200640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2b0155da0 0x7fc2b015bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.547+0000 7fc2b7200640 1 --2- 172.21.15.37:0/2920187023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b006f770 0x7fc2b0144f30 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.547+0000 7fc2b7200640 1 -- 172.21.15.37:0/2920187023 >> 172.21.15.37:0/2920187023 conn(0x7fc2b006bf60 msgr2=0x7fc2b01594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:37.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.547+0000 7fc2b7200640 1 -- 172.21.15.37:0/2920187023 shutdown_connections 2024-05-30T06:48:37.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.547+0000 7fc2b7200640 1 -- 172.21.15.37:0/2920187023 wait complete. 2024-05-30T06:48:37.569 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T06:48:37.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T06:48:37.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.719+0000 7f5013a00640 1 Processor -- start 2024-05-30T06:48:37.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.719+0000 7f5013a00640 1 -- start start 2024-05-30T06:48:37.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.719+0000 7f5013a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f500c155da0 0x7f500c0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:37.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.719+0000 7f5013a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f500c06f770 0x7f500c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:37.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.719+0000 7f5013a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f500c15f310 con 0x7f500c0cd440 2024-05-30T06:48:37.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.719+0000 7f5013a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f500c15f5f0 con 0x7f500c06f770 2024-05-30T06:48:37.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.719+0000 7f5013a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f500c15f8d0 con 0x7f500c155da0 2024-05-30T06:48:37.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.719+0000 7f5003e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f500c0cd440 0x7f500c06f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48044/0 (socket says 172.21.15.37:48044) 2024-05-30T06:48:37.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.719+0000 7f5003e00640 1 -- 172.21.15.37:0/2656806919 learned_addr learned my addr 172.21.15.37:0/2656806919 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.719+0000 7f5011a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f500c06f770 0x7f500c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.719+0000 7f5011000640 1 --2- 172.21.15.37:0/2656806919 >> v2:172.21.15.105:3300/0 conn(0x7f500c155da0 0x7f500c0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.723+0000 7f500be00640 1 -- 172.21.15.37:0/2656806919 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904922572 0 0) 0x7f500c15f310 con 0x7f500c0cd440 2024-05-30T06:48:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.723+0000 7f5011a00640 1 -- 172.21.15.37:0/2656806919 >> v2:172.21.15.105:3300/0 conn(0x7f500c155da0 msgr2=0x7f500c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.723+0000 7f5011a00640 1 --2- 172.21.15.37:0/2656806919 >> v2:172.21.15.105:3300/0 conn(0x7f500c155da0 0x7f500c0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:37.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.723+0000 7f5011a00640 1 -- 172.21.15.37:0/2656806919 >> v1:172.21.15.37:6789/0 conn(0x7f500c0cd440 legacy=0x7f500c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:37.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.723+0000 7f5011a00640 1 -- 172.21.15.37:0/2656806919 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c15fbb0 con 0x7f500c06f770 2024-05-30T06:48:37.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.723+0000 7f5011a00640 1 --2- 172.21.15.37:0/2656806919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c06f770 0x7f500c0b3750 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f500c06fec0 tx=0x7f500401eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caedc97156d4aff4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:37.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.723+0000 7f500be00640 1 -- 172.21.15.37:0/2656806919 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50040b4070 con 0x7f500c06f770 2024-05-30T06:48:37.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.723+0000 7f500be00640 1 -- 172.21.15.37:0/2656806919 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50040a7b70 con 0x7f500c06f770 2024-05-30T06:48:37.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.723+0000 7f500be00640 1 -- 172.21.15.37:0/2656806919 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50040af440 con 0x7f500c06f770 2024-05-30T06:48:37.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.723+0000 7f5013a00640 1 -- 172.21.15.37:0/2656806919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c06f770 msgr2=0x7f500c0b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.723+0000 7f5013a00640 1 --2- 172.21.15.37:0/2656806919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c06f770 0x7f500c0b3750 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f500c06fec0 tx=0x7f500401eca0 comp rx=0 tx=0).stop 2024-05-30T06:48:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 -- 172.21.15.37:0/2656806919 shutdown_connections 2024-05-30T06:48:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 --2- 172.21.15.37:0/2656806919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c06f770 0x7f500c0b3750 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 --2- 172.21.15.37:0/2656806919 >> v2:172.21.15.105:3300/0 conn(0x7f500c155da0 0x7f500c0cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 -- 172.21.15.37:0/2656806919 >> 172.21.15.37:0/2656806919 conn(0x7f500c06bf60 msgr2=0x7f500c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 -- 172.21.15.37:0/2656806919 shutdown_connections 2024-05-30T06:48:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 -- 172.21.15.37:0/2656806919 wait complete. 2024-05-30T06:48:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 Processor -- start 2024-05-30T06:48:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 -- start start 2024-05-30T06:48:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f500c06f770 0x7f500c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f500c155da0 0x7f500c150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c1519c0 0x7f500c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f500c06df50 con 0x7f500c1519c0 2024-05-30T06:48:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f500c0b4730 con 0x7f500c155da0 2024-05-30T06:48:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5013a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f500c06e0d0 con 0x7f500c06f770 2024-05-30T06:48:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5011a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c1519c0 0x7f500c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5011a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c1519c0 0x7f500c15a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39218/0 (socket says 172.21.15.37:39218) 2024-05-30T06:48:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5011a00640 1 -- 172.21.15.37:0/1662522960 learned_addr learned my addr 172.21.15.37:0/1662522960 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5011000640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f500c06f770 0x7f500c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5003e00640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f500c155da0 0x7f500c150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5011a00640 1 -- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f500c06f770 msgr2=0x7f500c15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5011a00640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f500c06f770 0x7f500c15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5011a00640 1 -- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f500c155da0 msgr2=0x7f500c150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5011a00640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f500c155da0 0x7f500c150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5011a00640 1 -- 172.21.15.37:0/1662522960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c15ee60 con 0x7f500c1519c0 2024-05-30T06:48:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.727+0000 7f5011a00640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c1519c0 0x7f500c15a540 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f500401b8b0 tx=0x7f500401ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.731+0000 7f5009600640 1 -- 172.21.15.37:0/1662522960 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50040bf070 con 0x7f500c1519c0 2024-05-30T06:48:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.731+0000 7f5009600640 1 -- 172.21.15.37:0/1662522960 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50040b0d10 con 0x7f500c1519c0 2024-05-30T06:48:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.731+0000 7f5013a00640 1 -- 172.21.15.37:0/1662522960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500c157510 con 0x7f500c1519c0 2024-05-30T06:48:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.731+0000 7f5009600640 1 -- 172.21.15.37:0/1662522960 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50040b4070 con 0x7f500c1519c0 2024-05-30T06:48:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.731+0000 7f5013a00640 1 -- 172.21.15.37:0/1662522960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f500c157ad0 con 0x7f500c1519c0 2024-05-30T06:48:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.731+0000 7f5013a00640 1 -- 172.21.15.37:0/1662522960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500c068bc0 con 0x7f500c1519c0 2024-05-30T06:48:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.731+0000 7f5009600640 1 -- 172.21.15.37:0/1662522960 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f50040c2070 con 0x7f500c1519c0 2024-05-30T06:48:37.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.731+0000 7f5009600640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4fe8068bf0 0x7f4fe806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:37.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.731+0000 7f5009600640 1 -- 172.21.15.37:0/1662522960 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f5004121ea0 con 0x7f500c1519c0 2024-05-30T06:48:37.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.731+0000 7f5011000640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4fe8068bf0 0x7f4fe806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:37.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.735+0000 7f5011000640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4fe8068bf0 0x7f4fe806b0b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009ac0 tx=0x7f4ffc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:37.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.735+0000 7f5009600640 1 -- 172.21.15.37:0/1662522960 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f50040189b0 con 0x7f500c1519c0 2024-05-30T06:48:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:37.935+0000 7f5013a00640 1 -- 172.21.15.37:0/1662522960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f500c0b6790 con 0x7f500c1519c0 2024-05-30T06:48:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.543+0000 7f5009600640 1 -- 172.21.15.37:0/1662522960 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v37) ==== 122+0+0 (secure 0 0 0) 0x7f50040f1390 con 0x7f500c1519c0 2024-05-30T06:48:38.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.547+0000 7f5013a00640 1 -- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4fe8068bf0 msgr2=0x7f4fe806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:38.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.547+0000 7f5013a00640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4fe8068bf0 0x7f4fe806b0b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009ac0 tx=0x7f4ffc009190 comp rx=0 tx=0).stop 2024-05-30T06:48:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.547+0000 7f5013a00640 1 -- 172.21.15.37:0/1662522960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c1519c0 msgr2=0x7f500c15a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.547+0000 7f5013a00640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c1519c0 0x7f500c15a540 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f500401b8b0 tx=0x7f500401ba40 comp rx=0 tx=0).stop 2024-05-30T06:48:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.547+0000 7f5013a00640 1 -- 172.21.15.37:0/1662522960 shutdown_connections 2024-05-30T06:48:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.547+0000 7f5013a00640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f500c1519c0 0x7f500c15a540 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.547+0000 7f5013a00640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4fe8068bf0 0x7f4fe806b0b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.547+0000 7f5013a00640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f500c155da0 0x7f500c150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.547+0000 7f5013a00640 1 --2- 172.21.15.37:0/1662522960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f500c06f770 0x7f500c15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.547+0000 7f5013a00640 1 -- 172.21.15.37:0/1662522960 >> 172.21.15.37:0/1662522960 conn(0x7f500c06bf60 msgr2=0x7f500c06e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.547+0000 7f5013a00640 1 -- 172.21.15.37:0/1662522960 shutdown_connections 2024-05-30T06:48:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.547+0000 7f5013a00640 1 -- 172.21.15.37:0/1662522960 wait complete. 2024-05-30T06:48:38.569 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T06:48:38.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:48:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c74800640 1 Processor -- start 2024-05-30T06:48:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c74800640 1 -- start start 2024-05-30T06:48:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c74800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6c0b2ec0 0x7f0c6c0af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c74800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c6c15eed0 0x7f0c6c15f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c74800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c6c15f8a0 con 0x7f0c6c1482d0 2024-05-30T06:48:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c74800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0c6c06e860 con 0x7f0c6c15eed0 2024-05-30T06:48:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c74800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c6c0afbd0 con 0x7f0c6c0b2ec0 2024-05-30T06:48:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c72800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c6c15eed0 0x7f0c6c15f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c72800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c6c15eed0 0x7f0c6c15f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39222/0 (socket says 172.21.15.37:39222) 2024-05-30T06:48:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c72800640 1 -- 172.21.15.37:0/4100866751 learned_addr learned my addr 172.21.15.37:0/4100866751 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c71400640 1 --2- 172.21.15.37:0/4100866751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6c0b2ec0 0x7f0c6c0af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c72800640 1 -- 172.21.15.37:0/4100866751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6c0b2ec0 msgr2=0x7f0c6c0af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c72800640 1 --2- 172.21.15.37:0/4100866751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6c0b2ec0 0x7f0c6c0af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c72800640 1 -- 172.21.15.37:0/4100866751 >> v1:172.21.15.105:6789/0 conn(0x7f0c6c1482d0 legacy=0x7f0c6c15ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.715+0000 7f0c72800640 1 -- 172.21.15.37:0/4100866751 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c0afe30 con 0x7f0c6c15eed0 2024-05-30T06:48:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.719+0000 7f0c72800640 1 --2- 172.21.15.37:0/4100866751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c15eed0 0x7f0c6c15f360 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009e50 tx=0x7f0c6801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37098a8fcaf2cb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.719+0000 7f0c70a00640 1 -- 172.21.15.37:0/4100866751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c680a5660 con 0x7f0c6c15eed0 2024-05-30T06:48:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.719+0000 7f0c70a00640 1 -- 172.21.15.37:0/4100866751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c680a5800 con 0x7f0c6c15eed0 2024-05-30T06:48:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.719+0000 7f0c70a00640 1 -- 172.21.15.37:0/4100866751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c680a5bd0 con 0x7f0c6c15eed0 2024-05-30T06:48:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.719+0000 7f0c74800640 1 -- 172.21.15.37:0/4100866751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c15eed0 msgr2=0x7f0c6c15f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.719+0000 7f0c74800640 1 --2- 172.21.15.37:0/4100866751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c15eed0 0x7f0c6c15f360 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009e50 tx=0x7f0c6801c9a0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.719+0000 7f0c74800640 1 -- 172.21.15.37:0/4100866751 shutdown_connections 2024-05-30T06:48:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.719+0000 7f0c74800640 1 --2- 172.21.15.37:0/4100866751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c15eed0 0x7f0c6c15f360 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.719+0000 7f0c74800640 1 --2- 172.21.15.37:0/4100866751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6c0b2ec0 0x7f0c6c0af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.719+0000 7f0c74800640 1 -- 172.21.15.37:0/4100866751 >> 172.21.15.37:0/4100866751 conn(0x7f0c6c0b23a0 msgr2=0x7f0c6c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.719+0000 7f0c74800640 1 -- 172.21.15.37:0/4100866751 shutdown_connections 2024-05-30T06:48:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.719+0000 7f0c74800640 1 -- 172.21.15.37:0/4100866751 wait complete. 2024-05-30T06:48:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c74800640 1 Processor -- start 2024-05-30T06:48:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c74800640 1 -- start start 2024-05-30T06:48:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c74800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6c0b2ec0 0x7f0c6c13d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c74800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c6c1482d0 0x7f0c6c0cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c74800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c15eed0 0x7f0c6c13bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c74800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c06f8b0 con 0x7f0c6c15eed0 2024-05-30T06:48:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c74800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c06f730 con 0x7f0c6c1482d0 2024-05-30T06:48:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c74800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c6c16b890 con 0x7f0c6c0b2ec0 2024-05-30T06:48:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c72800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c15eed0 0x7f0c6c13bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c72800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c15eed0 0x7f0c6c13bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39224/0 (socket says 172.21.15.37:39224) 2024-05-30T06:48:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c72800640 1 -- 172.21.15.37:0/3486249709 learned_addr learned my addr 172.21.15.37:0/3486249709 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c71400640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c6c1482d0 0x7f0c6c0cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c71e00640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6c0b2ec0 0x7f0c6c13d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c72800640 1 -- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6c0b2ec0 msgr2=0x7f0c6c13d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c72800640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6c0b2ec0 0x7f0c6c13d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c72800640 1 -- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c6c1482d0 msgr2=0x7f0c6c0cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c72800640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c6c1482d0 0x7f0c6c0cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c72800640 1 -- 172.21.15.37:0/3486249709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c0cf770 con 0x7f0c6c15eed0 2024-05-30T06:48:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c72800640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c15eed0 0x7f0c6c13bb20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0c6801a5d0 tx=0x7f0c68019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c66000640 1 -- 172.21.15.37:0/3486249709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c680bc070 con 0x7f0c6c15eed0 2024-05-30T06:48:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c66000640 1 -- 172.21.15.37:0/3486249709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c680b8640 con 0x7f0c6c15eed0 2024-05-30T06:48:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c66000640 1 -- 172.21.15.37:0/3486249709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68009510 con 0x7f0c6c15eed0 2024-05-30T06:48:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c74800640 1 -- 172.21.15.37:0/3486249709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6c15dd50 con 0x7f0c6c15eed0 2024-05-30T06:48:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.723+0000 7f0c74800640 1 -- 172.21.15.37:0/3486249709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6c147610 con 0x7f0c6c15eed0 2024-05-30T06:48:38.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.727+0000 7f0c74800640 1 -- 172.21.15.37:0/3486249709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c6c068b20 con 0x7f0c6c15eed0 2024-05-30T06:48:38.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.727+0000 7f0c66000640 1 -- 172.21.15.37:0/3486249709 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f0c680bf070 con 0x7f0c6c15eed0 2024-05-30T06:48:38.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.727+0000 7f0c66000640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0c50068c20 0x7f0c5006b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:38.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.727+0000 7f0c66000640 1 -- 172.21.15.37:0/3486249709 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f0c68121f80 con 0x7f0c6c15eed0 2024-05-30T06:48:38.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.727+0000 7f0c71e00640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0c50068c20 0x7f0c5006b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:38.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.727+0000 7f0c71e00640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0c50068c20 0x7f0c5006b0e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0c60001770 tx=0x7f0c60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.731+0000 7f0c66000640 1 -- 172.21.15.37:0/3486249709 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0c680c6070 con 0x7f0c6c15eed0 2024-05-30T06:48:38.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c74800640 1 -- 172.21.15.37:0/3486249709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c6c072fb0 con 0x7f0c6c15eed0 2024-05-30T06:48:38.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c66000640 1 -- 172.21.15.37:0/3486249709 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5181 (secure 0 0 0) 0x7f0c6c15dd50 con 0x7f0c6c15eed0 2024-05-30T06:48:38.929 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:38.929 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2689846178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2689846178},{"type":"v1","addr":"172.21.15.37:6834","nonce":2689846178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1799611833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1799611833},{"type":"v1","addr":"172.21.15.37:6835","nonce":1799611833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/35182660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":35182660},{"type":"v1","addr":"172.21.15.105:6837","nonce":35182660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:48:34.974228+0000","modified":"2024-05-30T06:48:37.938821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6055":{"gid":6055,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2127976173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2127976173},{"type":"v1","addr":"172.21.15.105:6835","nonce":2127976173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6055,"qdb_cluster":[6055]},"id":4}]} 2024-05-30T06:48:38.930 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 37 2024-05-30T06:48:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c74800640 1 -- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0c50068c20 msgr2=0x7f0c5006b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c74800640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0c50068c20 0x7f0c5006b0e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0c60001770 tx=0x7f0c60009040 comp rx=0 tx=0).stop 2024-05-30T06:48:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c74800640 1 -- 172.21.15.37:0/3486249709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c15eed0 msgr2=0x7f0c6c13bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c74800640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c15eed0 0x7f0c6c13bb20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0c6801a5d0 tx=0x7f0c68019740 comp rx=0 tx=0).stop 2024-05-30T06:48:38.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c74800640 1 -- 172.21.15.37:0/3486249709 shutdown_connections 2024-05-30T06:48:38.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c74800640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c6c15eed0 0x7f0c6c13bb20 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c74800640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0c50068c20 0x7f0c5006b0e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c74800640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c6c1482d0 0x7f0c6c0cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c74800640 1 --2- 172.21.15.37:0/3486249709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6c0b2ec0 0x7f0c6c13d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:38.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c74800640 1 -- 172.21.15.37:0/3486249709 >> 172.21.15.37:0/3486249709 conn(0x7f0c6c0b23a0 msgr2=0x7f0c6c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:38.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c74800640 1 -- 172.21.15.37:0/3486249709 shutdown_connections 2024-05-30T06:48:38.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:38.931+0000 7f0c74800640 1 -- 172.21.15.37:0/3486249709 wait complete. 2024-05-30T06:48:38.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:48:39.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.091+0000 7f68dec00640 1 Processor -- start 2024-05-30T06:48:39.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.091+0000 7f68dec00640 1 -- start start 2024-05-30T06:48:39.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68dec00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f68d8147790 0x7f68d80ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68dec00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f68d80b45d0 0x7f68d8070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68dec00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68d806b960 0x7f68d806be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68dec00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f68d80b6890 con 0x7f68d80b45d0 2024-05-30T06:48:39.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68dec00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f68d80b6030 con 0x7f68d8147790 2024-05-30T06:48:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68dec00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68d80b62d0 con 0x7f68d806b960 2024-05-30T06:48:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68cfe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f68d80b45d0 0x7f68d8070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68cfe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f68d80b45d0 0x7f68d8070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39240/0 (socket says 172.21.15.37:39240) 2024-05-30T06:48:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68cfe00640 1 -- 172.21.15.37:0/1493607411 learned_addr learned my addr 172.21.15.37:0/1493607411 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68d7e00640 1 --2- 172.21.15.37:0/1493607411 >> v2:172.21.15.105:3300/0 conn(0x7f68d8147790 0x7f68d80ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68dcc00640 1 --2- 172.21.15.37:0/1493607411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68d806b960 0x7f68d806be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68cfe00640 1 -- 172.21.15.37:0/1493607411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68d806b960 msgr2=0x7f68d806be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68cfe00640 1 --2- 172.21.15.37:0/1493607411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68d806b960 0x7f68d806be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68cfe00640 1 -- 172.21.15.37:0/1493607411 >> v2:172.21.15.105:3300/0 conn(0x7f68d8147790 msgr2=0x7f68d80ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68cfe00640 1 --2- 172.21.15.37:0/1493607411 >> v2:172.21.15.105:3300/0 conn(0x7f68d8147790 0x7f68d80ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68cfe00640 1 -- 172.21.15.37:0/1493607411 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d80b65b0 con 0x7f68d80b45d0 2024-05-30T06:48:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68d7e00640 1 --2- 172.21.15.37:0/1493607411 >> v2:172.21.15.105:3300/0 conn(0x7f68d8147790 0x7f68d80ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:39.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.095+0000 7f68cfe00640 1 --2- 172.21.15.37:0/1493607411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68d80b45d0 0x7f68d8070a70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f68d80b1080 tx=0x7f68c001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc27c5273d9ffd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:39.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68d7400640 1 -- 172.21.15.37:0/1493607411 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c00b2070 con 0x7f68d80b45d0 2024-05-30T06:48:39.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68d7400640 1 -- 172.21.15.37:0/1493607411 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c00a9070 con 0x7f68d80b45d0 2024-05-30T06:48:39.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68d7400640 1 -- 172.21.15.37:0/1493607411 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c00ad880 con 0x7f68d80b45d0 2024-05-30T06:48:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 -- 172.21.15.37:0/1493607411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68d80b45d0 msgr2=0x7f68d8070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 --2- 172.21.15.37:0/1493607411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68d80b45d0 0x7f68d8070a70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f68d80b1080 tx=0x7f68c001c490 comp rx=0 tx=0).stop 2024-05-30T06:48:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 -- 172.21.15.37:0/1493607411 shutdown_connections 2024-05-30T06:48:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 --2- 172.21.15.37:0/1493607411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68d806b960 0x7f68d806be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 --2- 172.21.15.37:0/1493607411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68d80b45d0 0x7f68d8070a70 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 --2- 172.21.15.37:0/1493607411 >> v2:172.21.15.105:3300/0 conn(0x7f68d8147790 0x7f68d80ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 -- 172.21.15.37:0/1493607411 >> 172.21.15.37:0/1493607411 conn(0x7f68d80b6a60 msgr2=0x7f68d80b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:39.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 -- 172.21.15.37:0/1493607411 shutdown_connections 2024-05-30T06:48:39.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 -- 172.21.15.37:0/1493607411 wait complete. 2024-05-30T06:48:39.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 Processor -- start 2024-05-30T06:48:39.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 -- start start 2024-05-30T06:48:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68d806b960 0x7f68d8153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68d80b45d0 0x7f68d80b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68d8147790 0x7f68d8162830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8070130 con 0x7f68d80b45d0 2024-05-30T06:48:39.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68d806ffb0 con 0x7f68d8147790 2024-05-30T06:48:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dec00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68d80702b0 con 0x7f68d806b960 2024-05-30T06:48:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68cfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68d80b45d0 0x7f68d80b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68cfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68d80b45d0 0x7f68d80b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39252/0 (socket says 172.21.15.37:39252) 2024-05-30T06:48:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68cfe00640 1 -- 172.21.15.37:0/999634727 learned_addr learned my addr 172.21.15.37:0/999634727 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68d7e00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68d806b960 0x7f68d8153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.099+0000 7f68dcc00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68d8147790 0x7f68d8162830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68cfe00640 1 -- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68d806b960 msgr2=0x7f68d8153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68cfe00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68d806b960 0x7f68d8153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68cfe00640 1 -- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68d8147790 msgr2=0x7f68d8162830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68cfe00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68d8147790 0x7f68d8162830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68cfe00640 1 -- 172.21.15.37:0/999634727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d8163b80 con 0x7f68d80b45d0 2024-05-30T06:48:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68cfe00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68d80b45d0 0x7f68d80b11b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f68c00b0040 tx=0x7f68c0019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68d4c00640 1 -- 172.21.15.37:0/999634727 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c00b2040 con 0x7f68d80b45d0 2024-05-30T06:48:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68d4c00640 1 -- 172.21.15.37:0/999634727 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c00bb070 con 0x7f68d80b45d0 2024-05-30T06:48:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68dec00640 1 -- 172.21.15.37:0/999634727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d8161d50 con 0x7f68d80b45d0 2024-05-30T06:48:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68d4c00640 1 -- 172.21.15.37:0/999634727 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c00b6440 con 0x7f68d80b45d0 2024-05-30T06:48:39.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68dec00640 1 -- 172.21.15.37:0/999634727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d8162310 con 0x7f68d80b45d0 2024-05-30T06:48:39.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68dec00640 1 -- 172.21.15.37:0/999634727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d806da00 con 0x7f68d80b45d0 2024-05-30T06:48:39.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68d4c00640 1 -- 172.21.15.37:0/999634727 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f68c00ab070 con 0x7f68d80b45d0 2024-05-30T06:48:39.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68d4c00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68b4068bf0 0x7f68b406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68d4c00640 1 -- 172.21.15.37:0/999634727 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f68c0121340 con 0x7f68d80b45d0 2024-05-30T06:48:39.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.103+0000 7f68d7e00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68b4068bf0 0x7f68b406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.107+0000 7f68d7e00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68b4068bf0 0x7f68b406b0b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f68c8006fd0 tx=0x7f68c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:39.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.107+0000 7f68d4c00640 1 -- 172.21.15.37:0/999634727 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f68c0016110 con 0x7f68d80b45d0 2024-05-30T06:48:39.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68dec00640 1 -- 172.21.15.37:0/999634727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68d8068b20 con 0x7f68d80b45d0 2024-05-30T06:48:39.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68d4c00640 1 -- 172.21.15.37:0/999634727 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16653 (secure 0 0 0) 0x7f68c00f0c50 con 0x7f68d80b45d0 2024-05-30T06:48:39.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:39.274 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":60,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:48:36.530256+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:48:33.300340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T06:48:33.866916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:48:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68dec00640 1 -- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68b4068bf0 msgr2=0x7f68b406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68dec00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68b4068bf0 0x7f68b406b0b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f68c8006fd0 tx=0x7f68c8008040 comp rx=0 tx=0).stop 2024-05-30T06:48:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68dec00640 1 -- 172.21.15.37:0/999634727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68d80b45d0 msgr2=0x7f68d80b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68dec00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68d80b45d0 0x7f68d80b11b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f68c00b0040 tx=0x7f68c0019230 comp rx=0 tx=0).stop 2024-05-30T06:48:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68dec00640 1 -- 172.21.15.37:0/999634727 shutdown_connections 2024-05-30T06:48:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68dec00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68b4068bf0 0x7f68b406b0b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68dec00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68d8147790 0x7f68d8162830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68dec00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68d80b45d0 0x7f68d80b11b0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68dec00640 1 --2- 172.21.15.37:0/999634727 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68d806b960 0x7f68d8153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68dec00640 1 -- 172.21.15.37:0/999634727 >> 172.21.15.37:0/999634727 conn(0x7f68d80b6a60 msgr2=0x7f68d81406a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68dec00640 1 -- 172.21.15.37:0/999634727 shutdown_connections 2024-05-30T06:48:39.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.275+0000 7f68dec00640 1 -- 172.21.15.37:0/999634727 wait complete. 2024-05-30T06:48:39.296 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-30T06:48:39.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:48:39.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f188b200640 1 Processor -- start 2024-05-30T06:48:39.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f188b200640 1 -- start start 2024-05-30T06:48:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f188b200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f188c146000 0x7f188c06b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f188b200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188c0d2160 con 0x7f188c0b7010 2024-05-30T06:48:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f188b200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188c0cec40 con 0x7f188c06bea0 2024-05-30T06:48:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f188b200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f188c06c2d0 con 0x7f188c146000 2024-05-30T06:48:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f1889e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f188c146000 0x7f188c06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f1889e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f188c146000 0x7f188c06b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39260/0 (socket says 172.21.15.37:39260) 2024-05-30T06:48:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f1883e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f188c0b7010 0x7f188c0d1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48046/0 (socket says 172.21.15.37:48046) 2024-05-30T06:48:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f1889e00640 1 -- 172.21.15.37:0/3243699805 learned_addr learned my addr 172.21.15.37:0/3243699805 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f1889e00640 1 -- 172.21.15.37:0/3243699805 >> v1:172.21.15.105:6789/0 conn(0x7f188c06bea0 legacy=0x7f188c0d1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f1889e00640 1 -- 172.21.15.37:0/3243699805 >> v1:172.21.15.37:6789/0 conn(0x7f188c0b7010 legacy=0x7f188c0d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f1889e00640 1 -- 172.21.15.37:0/3243699805 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c0cef20 con 0x7f188c146000 2024-05-30T06:48:39.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.439+0000 7f1889400640 1 -- 172.21.15.37:0/3243699805 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3376392893 0 0) 0x7f188c0d2160 con 0x7f188c0b7010 2024-05-30T06:48:39.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.443+0000 7f1889e00640 1 --2- 172.21.15.37:0/3243699805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188c146000 0x7f188c06b960 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f187c009870 tx=0x7f187c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b812db5c5bb6883e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:39.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.443+0000 7f1889400640 1 -- 172.21.15.37:0/3243699805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c0a95f0 con 0x7f188c146000 2024-05-30T06:48:39.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.443+0000 7f1889400640 1 -- 172.21.15.37:0/3243699805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c0a9790 con 0x7f188c146000 2024-05-30T06:48:39.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.443+0000 7f1889400640 1 -- 172.21.15.37:0/3243699805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c0a9b60 con 0x7f188c146000 2024-05-30T06:48:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.443+0000 7f188b200640 1 -- 172.21.15.37:0/3243699805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188c146000 msgr2=0x7f188c06b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.443+0000 7f188b200640 1 --2- 172.21.15.37:0/3243699805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188c146000 0x7f188c06b960 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f187c009870 tx=0x7f187c01c530 comp rx=0 tx=0).stop 2024-05-30T06:48:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.443+0000 7f188b200640 1 -- 172.21.15.37:0/3243699805 shutdown_connections 2024-05-30T06:48:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.443+0000 7f188b200640 1 --2- 172.21.15.37:0/3243699805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188c146000 0x7f188c06b960 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.443+0000 7f188b200640 1 -- 172.21.15.37:0/3243699805 >> 172.21.15.37:0/3243699805 conn(0x7f188c09aa60 msgr2=0x7f188c0b6900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.443+0000 7f188b200640 1 -- 172.21.15.37:0/3243699805 shutdown_connections 2024-05-30T06:48:39.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.443+0000 7f188b200640 1 -- 172.21.15.37:0/3243699805 wait complete. 2024-05-30T06:48:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.443+0000 7f188b200640 1 Processor -- start 2024-05-30T06:48:39.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.443+0000 7f188b200640 1 -- start start 2024-05-30T06:48:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188b200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f188c06bea0 0x7f188c157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188b200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f188c0b7010 0x7f188c139cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188c146000 0x7f188c1382b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188b200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f188c15cc90 con 0x7f188c146000 2024-05-30T06:48:39.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188b200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f188c0d0cf0 con 0x7f188c06bea0 2024-05-30T06:48:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188b200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f188c15ce10 con 0x7f188c0b7010 2024-05-30T06:48:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188c146000 0x7f188c1382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188c146000 0x7f188c1382b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39276/0 (socket says 172.21.15.37:39276) 2024-05-30T06:48:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188a800640 1 -- 172.21.15.37:0/2952513735 learned_addr learned my addr 172.21.15.37:0/2952513735 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f1883e00640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f188c0b7010 0x7f188c139cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f1889e00640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f188c06bea0 0x7f188c157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188a800640 1 -- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f188c0b7010 msgr2=0x7f188c139cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188a800640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f188c0b7010 0x7f188c139cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188a800640 1 -- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f188c06bea0 msgr2=0x7f188c157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188a800640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f188c06bea0 0x7f188c157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188a800640 1 -- 172.21.15.37:0/2952513735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c13bd30 con 0x7f188c146000 2024-05-30T06:48:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188a800640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188c146000 0x7f188c1382b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f188400c7a0 tx=0x7f188400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f1882000640 1 -- 172.21.15.37:0/2952513735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1884003b80 con 0x7f188c146000 2024-05-30T06:48:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f1882000640 1 -- 172.21.15.37:0/2952513735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1884003d20 con 0x7f188c146000 2024-05-30T06:48:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f1882000640 1 -- 172.21.15.37:0/2952513735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188400aa90 con 0x7f188c146000 2024-05-30T06:48:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188b200640 1 -- 172.21.15.37:0/2952513735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188c1368f0 con 0x7f188c146000 2024-05-30T06:48:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188b200640 1 -- 172.21.15.37:0/2952513735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f188c157e90 con 0x7f188c146000 2024-05-30T06:48:39.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.447+0000 7f188b200640 1 -- 172.21.15.37:0/2952513735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f188c075580 con 0x7f188c146000 2024-05-30T06:48:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.451+0000 7f1882000640 1 -- 172.21.15.37:0/2952513735 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f188400ac30 con 0x7f188c146000 2024-05-30T06:48:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.451+0000 7f1882000640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1868068c20 0x7f186806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.451+0000 7f1882000640 1 -- 172.21.15.37:0/2952513735 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f1884087930 con 0x7f188c146000 2024-05-30T06:48:39.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.451+0000 7f1889e00640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1868068c20 0x7f186806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.451+0000 7f1889e00640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1868068c20 0x7f186806b0e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f187c0ae000 tx=0x7f187c0b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:39.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.455+0000 7f1882000640 1 -- 172.21.15.37:0/2952513735 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1884056980 con 0x7f188c146000 2024-05-30T06:48:39.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.619+0000 7f188b200640 1 -- 172.21.15.37:0/2952513735 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f188c073ad0 con 0x7f1868068c20 2024-05-30T06:48:39.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.627+0000 7f1882000640 1 -- 172.21.15.37:0/2952513735 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244747 (secure 0 0 0) 0x7f188c073ad0 con 0x7f1868068c20 2024-05-30T06:48:39.631 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:39.633 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:48:39.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.631+0000 7f188b200640 1 -- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1868068c20 msgr2=0x7f186806b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.631+0000 7f188b200640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1868068c20 0x7f186806b0e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f187c0ae000 tx=0x7f187c0b3040 comp rx=0 tx=0).stop 2024-05-30T06:48:39.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.631+0000 7f188b200640 1 -- 172.21.15.37:0/2952513735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188c146000 msgr2=0x7f188c1382b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.631+0000 7f188b200640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188c146000 0x7f188c1382b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f188400c7a0 tx=0x7f188400cc60 comp rx=0 tx=0).stop 2024-05-30T06:48:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.631+0000 7f188b200640 1 -- 172.21.15.37:0/2952513735 shutdown_connections 2024-05-30T06:48:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.631+0000 7f188b200640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f188c146000 0x7f188c1382b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.631+0000 7f188b200640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f188c0b7010 0x7f188c139cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.631+0000 7f188b200640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1868068c20 0x7f186806b0e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.631+0000 7f188b200640 1 --2- 172.21.15.37:0/2952513735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f188c06bea0 0x7f188c157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.631+0000 7f188b200640 1 -- 172.21.15.37:0/2952513735 >> 172.21.15.37:0/2952513735 conn(0x7f188c09aa60 msgr2=0x7f188c13d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:39.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.631+0000 7f188b200640 1 -- 172.21.15.37:0/2952513735 shutdown_connections 2024-05-30T06:48:39.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.631+0000 7f188b200640 1 -- 172.21.15.37:0/2952513735 wait complete. 2024-05-30T06:48:39.648 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-05-30T06:48:38.748495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591040,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346296,"kb_used_data":6584,"kb_used_omap":12,"kb_used_meta":339571,"kb_avail":754628424,"statfs":{"total":773094113280,"available":772739506176,"internally_reserved":0,"allocated":6742016,"data_stored":3492583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":347721264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.245885"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543618+0000","last_change":"2024-05-30T06:48:35.544557+0000","last_active":"2024-05-30T06:48:36.543618+0000","last_peered":"2024-05-30T06:48:36.543618+0000","last_clean":"2024-05-30T06:48:36.543618+0000","last_became_active":"2024-05-30T06:48:35.544234+0000","last_became_peered":"2024-05-30T06:48:35.544234+0000","last_unstale":"2024-05-30T06:48:36.543618+0000","last_undegraded":"2024-05-30T06:48:36.543618+0000","last_fullsized":"2024-05-30T06:48:36.543618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:46.614302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549611+0000","last_change":"2024-05-30T06:48:35.548800+0000","last_active":"2024-05-30T06:48:37.549611+0000","last_peered":"2024-05-30T06:48:37.549611+0000","last_clean":"2024-05-30T06:48:37.549611+0000","last_became_active":"2024-05-30T06:48:35.548522+0000","last_became_peered":"2024-05-30T06:48:35.548522+0000","last_unstale":"2024-05-30T06:48:37.549611+0000","last_undegraded":"2024-05-30T06:48:37.549611+0000","last_fullsized":"2024-05-30T06:48:37.549611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:59.526146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543438+0000","last_change":"2024-05-30T06:48:35.528596+0000","last_active":"2024-05-30T06:48:36.543438+0000","last_peered":"2024-05-30T06:48:36.543438+0000","last_clean":"2024-05-30T06:48:36.543438+0000","last_became_active":"2024-05-30T06:48:35.528270+0000","last_became_peered":"2024-05-30T06:48:35.528270+0000","last_unstale":"2024-05-30T06:48:36.543438+0000","last_undegraded":"2024-05-30T06:48:36.543438+0000","last_fullsized":"2024-05-30T06:48:36.543438+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:24:19.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524493+0000","last_change":"2024-05-30T06:48:35.526635+0000","last_active":"2024-05-30T06:48:37.524493+0000","last_peered":"2024-05-30T06:48:37.524493+0000","last_clean":"2024-05-30T06:48:37.524493+0000","last_became_active":"2024-05-30T06:48:35.526369+0000","last_became_peered":"2024-05-30T06:48:35.526369+0000","last_unstale":"2024-05-30T06:48:37.524493+0000","last_undegraded":"2024-05-30T06:48:37.524493+0000","last_fullsized":"2024-05-30T06:48:37.524493+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:09:16.907885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524548+0000","last_change":"2024-05-30T06:48:35.531935+0000","last_active":"2024-05-30T06:48:37.524548+0000","last_peered":"2024-05-30T06:48:37.524548+0000","last_clean":"2024-05-30T06:48:37.524548+0000","last_became_active":"2024-05-30T06:48:35.531582+0000","last_became_peered":"2024-05-30T06:48:35.531582+0000","last_unstale":"2024-05-30T06:48:37.524548+0000","last_undegraded":"2024-05-30T06:48:37.524548+0000","last_fullsized":"2024-05-30T06:48:37.524548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:59:14.799560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549715+0000","last_change":"2024-05-30T06:48:35.542792+0000","last_active":"2024-05-30T06:48:37.549715+0000","last_peered":"2024-05-30T06:48:37.549715+0000","last_clean":"2024-05-30T06:48:37.549715+0000","last_became_active":"2024-05-30T06:48:35.542518+0000","last_became_peered":"2024-05-30T06:48:35.542518+0000","last_unstale":"2024-05-30T06:48:37.549715+0000","last_undegraded":"2024-05-30T06:48:37.549715+0000","last_fullsized":"2024-05-30T06:48:37.549715+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:07:00.306354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543515+0000","last_change":"2024-05-30T06:48:35.544959+0000","last_active":"2024-05-30T06:48:36.543515+0000","last_peered":"2024-05-30T06:48:36.543515+0000","last_clean":"2024-05-30T06:48:36.543515+0000","last_became_active":"2024-05-30T06:48:35.544728+0000","last_became_peered":"2024-05-30T06:48:35.544728+0000","last_unstale":"2024-05-30T06:48:36.543515+0000","last_undegraded":"2024-05-30T06:48:36.543515+0000","last_fullsized":"2024-05-30T06:48:36.543515+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:14.198830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549357+0000","last_change":"2024-05-30T06:48:35.547692+0000","last_active":"2024-05-30T06:48:37.549357+0000","last_peered":"2024-05-30T06:48:37.549357+0000","last_clean":"2024-05-30T06:48:37.549357+0000","last_became_active":"2024-05-30T06:48:35.547405+0000","last_became_peered":"2024-05-30T06:48:35.547405+0000","last_unstale":"2024-05-30T06:48:37.549357+0000","last_undegraded":"2024-05-30T06:48:37.549357+0000","last_fullsized":"2024-05-30T06:48:37.549357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:18.217900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549353+0000","last_change":"2024-05-30T06:48:35.546690+0000","last_active":"2024-05-30T06:48:37.549353+0000","last_peered":"2024-05-30T06:48:37.549353+0000","last_clean":"2024-05-30T06:48:37.549353+0000","last_became_active":"2024-05-30T06:48:35.546259+0000","last_became_peered":"2024-05-30T06:48:35.546259+0000","last_unstale":"2024-05-30T06:48:37.549353+0000","last_undegraded":"2024-05-30T06:48:37.549353+0000","last_fullsized":"2024-05-30T06:48:37.549353+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:29.528851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543690+0000","last_change":"2024-05-30T06:48:35.547279+0000","last_active":"2024-05-30T06:48:36.543690+0000","last_peered":"2024-05-30T06:48:36.543690+0000","last_clean":"2024-05-30T06:48:36.543690+0000","last_became_active":"2024-05-30T06:48:35.546955+0000","last_became_peered":"2024-05-30T06:48:35.546955+0000","last_unstale":"2024-05-30T06:48:36.543690+0000","last_undegraded":"2024-05-30T06:48:36.543690+0000","last_fullsized":"2024-05-30T06:48:36.543690+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:14:29.873987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524951+0000","last_change":"2024-05-30T06:48:35.530569+0000","last_active":"2024-05-30T06:48:37.524951+0000","last_peered":"2024-05-30T06:48:37.524951+0000","last_clean":"2024-05-30T06:48:37.524951+0000","last_became_active":"2024-05-30T06:48:35.530270+0000","last_became_peered":"2024-05-30T06:48:35.530270+0000","last_unstale":"2024-05-30T06:48:37.524951+0000","last_undegraded":"2024-05-30T06:48:37.524951+0000","last_fullsized":"2024-05-30T06:48:37.524951+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:24:21.624845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543559+0000","last_change":"2024-05-30T06:48:35.534365+0000","last_active":"2024-05-30T06:48:36.543559+0000","last_peered":"2024-05-30T06:48:36.543559+0000","last_clean":"2024-05-30T06:48:36.543559+0000","last_became_active":"2024-05-30T06:48:35.529711+0000","last_became_peered":"2024-05-30T06:48:35.529711+0000","last_unstale":"2024-05-30T06:48:36.543559+0000","last_undegraded":"2024-05-30T06:48:36.543559+0000","last_fullsized":"2024-05-30T06:48:36.543559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:57:47.611985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549324+0000","last_change":"2024-05-30T06:48:35.548726+0000","last_active":"2024-05-30T06:48:37.549324+0000","last_peered":"2024-05-30T06:48:37.549324+0000","last_clean":"2024-05-30T06:48:37.549324+0000","last_became_active":"2024-05-30T06:48:35.548446+0000","last_became_peered":"2024-05-30T06:48:35.548446+0000","last_unstale":"2024-05-30T06:48:37.549324+0000","last_undegraded":"2024-05-30T06:48:37.549324+0000","last_fullsized":"2024-05-30T06:48:37.549324+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:24:21.624845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543266+0000","last_change":"2024-05-30T06:48:35.532420+0000","last_active":"2024-05-30T06:48:36.543266+0000","last_peered":"2024-05-30T06:48:36.543266+0000","last_clean":"2024-05-30T06:48:36.543266+0000","last_became_active":"2024-05-30T06:48:35.532139+0000","last_became_peered":"2024-05-30T06:48:35.532139+0000","last_unstale":"2024-05-30T06:48:36.543266+0000","last_undegraded":"2024-05-30T06:48:36.543266+0000","last_fullsized":"2024-05-30T06:48:36.543266+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:50:07.910737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524577+0000","last_change":"2024-05-30T06:48:35.527918+0000","last_active":"2024-05-30T06:48:37.524577+0000","last_peered":"2024-05-30T06:48:37.524577+0000","last_clean":"2024-05-30T06:48:37.524577+0000","last_became_active":"2024-05-30T06:48:35.527120+0000","last_became_peered":"2024-05-30T06:48:35.527120+0000","last_unstale":"2024-05-30T06:48:37.524577+0000","last_undegraded":"2024-05-30T06:48:37.524577+0000","last_fullsized":"2024-05-30T06:48:37.524577+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:52:14.951102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525054+0000","last_change":"2024-05-30T06:48:35.544708+0000","last_active":"2024-05-30T06:48:37.525054+0000","last_peered":"2024-05-30T06:48:37.525054+0000","last_clean":"2024-05-30T06:48:37.525054+0000","last_became_active":"2024-05-30T06:48:35.544378+0000","last_became_peered":"2024-05-30T06:48:35.544378+0000","last_unstale":"2024-05-30T06:48:37.525054+0000","last_undegraded":"2024-05-30T06:48:37.525054+0000","last_fullsized":"2024-05-30T06:48:37.525054+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:29.528851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525103+0000","last_change":"2024-05-30T06:48:34.528291+0000","last_active":"2024-05-30T06:48:37.525103+0000","last_peered":"2024-05-30T06:48:37.525103+0000","last_clean":"2024-05-30T06:48:37.525103+0000","last_became_active":"2024-05-30T06:48:34.528020+0000","last_became_peered":"2024-05-30T06:48:34.528020+0000","last_unstale":"2024-05-30T06:48:37.525103+0000","last_undegraded":"2024-05-30T06:48:37.525103+0000","last_fullsized":"2024-05-30T06:48:37.525103+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:02:04.678244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.509852+0000","last_change":"2024-05-30T06:48:33.509852+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.509852+0000","last_undegraded":"2024-05-30T06:48:33.509852+0000","last_fullsized":"2024-05-30T06:48:33.509852+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524841+0000","last_change":"2024-05-30T06:48:35.533213+0000","last_active":"2024-05-30T06:48:37.524841+0000","last_peered":"2024-05-30T06:48:37.524841+0000","last_clean":"2024-05-30T06:48:37.524841+0000","last_became_active":"2024-05-30T06:48:35.531924+0000","last_became_peered":"2024-05-30T06:48:35.531924+0000","last_unstale":"2024-05-30T06:48:37.524841+0000","last_undegraded":"2024-05-30T06:48:37.524841+0000","last_fullsized":"2024-05-30T06:48:37.524841+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:04:54.109208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525062+0000","last_change":"2024-05-30T06:48:34.526188+0000","last_active":"2024-05-30T06:48:37.525062+0000","last_peered":"2024-05-30T06:48:37.525062+0000","last_clean":"2024-05-30T06:48:37.525062+0000","last_became_active":"2024-05-30T06:48:34.525779+0000","last_became_peered":"2024-05-30T06:48:34.525779+0000","last_unstale":"2024-05-30T06:48:37.525062+0000","last_undegraded":"2024-05-30T06:48:37.525062+0000","last_fullsized":"2024-05-30T06:48:37.525062+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:14:21.988526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524963+0000","last_change":"2024-05-30T06:48:35.533901+0000","last_active":"2024-05-30T06:48:37.524963+0000","last_peered":"2024-05-30T06:48:37.524963+0000","last_clean":"2024-05-30T06:48:37.524963+0000","last_became_active":"2024-05-30T06:48:35.533310+0000","last_became_peered":"2024-05-30T06:48:35.533310+0000","last_unstale":"2024-05-30T06:48:37.524963+0000","last_undegraded":"2024-05-30T06:48:37.524963+0000","last_fullsized":"2024-05-30T06:48:37.524963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:00.960494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.507406+0000","last_change":"2024-05-30T06:48:33.507406+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.507406+0000","last_undegraded":"2024-05-30T06:48:33.507406+0000","last_fullsized":"2024-05-30T06:48:33.507406+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506351+0000","last_change":"2024-05-30T06:48:33.506351+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506351+0000","last_undegraded":"2024-05-30T06:48:33.506351+0000","last_fullsized":"2024-05-30T06:48:33.506351+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524450+0000","last_change":"2024-05-30T06:48:34.520117+0000","last_active":"2024-05-30T06:48:37.524450+0000","last_peered":"2024-05-30T06:48:37.524450+0000","last_clean":"2024-05-30T06:48:37.524450+0000","last_became_active":"2024-05-30T06:48:34.519763+0000","last_became_peered":"2024-05-30T06:48:34.519763+0000","last_unstale":"2024-05-30T06:48:37.524450+0000","last_undegraded":"2024-05-30T06:48:37.524450+0000","last_fullsized":"2024-05-30T06:48:37.524450+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:55.437085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506817+0000","last_change":"2024-05-30T06:48:33.506817+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506817+0000","last_undegraded":"2024-05-30T06:48:33.506817+0000","last_fullsized":"2024-05-30T06:48:33.506817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505817+0000","last_change":"2024-05-30T06:48:33.505817+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505817+0000","last_undegraded":"2024-05-30T06:48:33.505817+0000","last_fullsized":"2024-05-30T06:48:33.505817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549808+0000","last_change":"2024-05-30T06:48:34.538260+0000","last_active":"2024-05-30T06:48:37.549808+0000","last_peered":"2024-05-30T06:48:37.549808+0000","last_clean":"2024-05-30T06:48:37.549808+0000","last_became_active":"2024-05-30T06:48:34.537965+0000","last_became_peered":"2024-05-30T06:48:34.537965+0000","last_unstale":"2024-05-30T06:48:37.549808+0000","last_undegraded":"2024-05-30T06:48:37.549808+0000","last_fullsized":"2024-05-30T06:48:37.549808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:16:16.602018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549901+0000","last_change":"2024-05-30T06:48:35.556813+0000","last_active":"2024-05-30T06:48:37.549901+0000","last_peered":"2024-05-30T06:48:37.549901+0000","last_clean":"2024-05-30T06:48:37.549901+0000","last_became_active":"2024-05-30T06:48:35.556531+0000","last_became_peered":"2024-05-30T06:48:35.556531+0000","last_unstale":"2024-05-30T06:48:37.549901+0000","last_undegraded":"2024-05-30T06:48:37.549901+0000","last_fullsized":"2024-05-30T06:48:37.549901+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:32:48.803325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.508808+0000","last_change":"2024-05-30T06:48:33.508808+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.508808+0000","last_undegraded":"2024-05-30T06:48:33.508808+0000","last_fullsized":"2024-05-30T06:48:33.508808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549866+0000","last_change":"2024-05-30T06:48:34.534475+0000","last_active":"2024-05-30T06:48:37.549866+0000","last_peered":"2024-05-30T06:48:37.549866+0000","last_clean":"2024-05-30T06:48:37.549866+0000","last_became_active":"2024-05-30T06:48:34.534154+0000","last_became_peered":"2024-05-30T06:48:34.534154+0000","last_unstale":"2024-05-30T06:48:37.549866+0000","last_undegraded":"2024-05-30T06:48:37.549866+0000","last_fullsized":"2024-05-30T06:48:37.549866+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:22:25.698890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549692+0000","last_change":"2024-05-30T06:48:35.556702+0000","last_active":"2024-05-30T06:48:37.549692+0000","last_peered":"2024-05-30T06:48:37.549692+0000","last_clean":"2024-05-30T06:48:37.549692+0000","last_became_active":"2024-05-30T06:48:35.556292+0000","last_became_peered":"2024-05-30T06:48:35.556292+0000","last_unstale":"2024-05-30T06:48:37.549692+0000","last_undegraded":"2024-05-30T06:48:37.549692+0000","last_fullsized":"2024-05-30T06:48:37.549692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:52.408293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506061+0000","last_change":"2024-05-30T06:48:33.506061+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506061+0000","last_undegraded":"2024-05-30T06:48:33.506061+0000","last_fullsized":"2024-05-30T06:48:33.506061+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.509881+0000","last_change":"2024-05-30T06:48:33.509881+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.509881+0000","last_undegraded":"2024-05-30T06:48:33.509881+0000","last_fullsized":"2024-05-30T06:48:33.509881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549360+0000","last_change":"2024-05-30T06:48:35.541178+0000","last_active":"2024-05-30T06:48:37.549360+0000","last_peered":"2024-05-30T06:48:37.549360+0000","last_clean":"2024-05-30T06:48:37.549360+0000","last_became_active":"2024-05-30T06:48:35.540874+0000","last_became_peered":"2024-05-30T06:48:35.540874+0000","last_unstale":"2024-05-30T06:48:37.549360+0000","last_undegraded":"2024-05-30T06:48:37.549360+0000","last_fullsized":"2024-05-30T06:48:37.549360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:00.960494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.512106+0000","last_change":"2024-05-30T06:48:33.512106+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.512106+0000","last_undegraded":"2024-05-30T06:48:33.512106+0000","last_fullsized":"2024-05-30T06:48:33.512106+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506331+0000","last_change":"2024-05-30T06:48:33.506331+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506331+0000","last_undegraded":"2024-05-30T06:48:33.506331+0000","last_fullsized":"2024-05-30T06:48:33.506331+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549386+0000","last_change":"2024-05-30T06:48:35.553758+0000","last_active":"2024-05-30T06:48:37.549386+0000","last_peered":"2024-05-30T06:48:37.549386+0000","last_clean":"2024-05-30T06:48:37.549386+0000","last_became_active":"2024-05-30T06:48:35.553533+0000","last_became_peered":"2024-05-30T06:48:35.553533+0000","last_unstale":"2024-05-30T06:48:37.549386+0000","last_undegraded":"2024-05-30T06:48:37.549386+0000","last_fullsized":"2024-05-30T06:48:37.549386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:36.834202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":22,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549129+0000","last_change":"2024-05-30T06:48:34.531403+0000","last_active":"2024-05-30T06:48:37.549129+0000","last_peered":"2024-05-30T06:48:37.549129+0000","last_clean":"2024-05-30T06:48:37.549129+0000","last_became_active":"2024-05-30T06:48:34.531122+0000","last_became_peered":"2024-05-30T06:48:34.531122+0000","last_unstale":"2024-05-30T06:48:37.549129+0000","last_undegraded":"2024-05-30T06:48:37.549129+0000","last_fullsized":"2024-05-30T06:48:37.549129+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:44:21.380589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549841+0000","last_change":"2024-05-30T06:48:35.549591+0000","last_active":"2024-05-30T06:48:37.549841+0000","last_peered":"2024-05-30T06:48:37.549841+0000","last_clean":"2024-05-30T06:48:37.549841+0000","last_became_active":"2024-05-30T06:48:35.549312+0000","last_became_peered":"2024-05-30T06:48:35.549312+0000","last_unstale":"2024-05-30T06:48:37.549841+0000","last_undegraded":"2024-05-30T06:48:37.549841+0000","last_fullsized":"2024-05-30T06:48:37.549841+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:52.950286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.508839+0000","last_change":"2024-05-30T06:48:33.508839+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.508839+0000","last_undegraded":"2024-05-30T06:48:33.508839+0000","last_fullsized":"2024-05-30T06:48:33.508839+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524998+0000","last_change":"2024-05-30T06:48:34.535017+0000","last_active":"2024-05-30T06:48:37.524998+0000","last_peered":"2024-05-30T06:48:37.524998+0000","last_clean":"2024-05-30T06:48:37.524998+0000","last_became_active":"2024-05-30T06:48:34.534737+0000","last_became_peered":"2024-05-30T06:48:34.534737+0000","last_unstale":"2024-05-30T06:48:37.524998+0000","last_undegraded":"2024-05-30T06:48:37.524998+0000","last_fullsized":"2024-05-30T06:48:37.524998+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:58:44.441246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.507240+0000","last_change":"2024-05-30T06:48:33.507240+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.507240+0000","last_undegraded":"2024-05-30T06:48:33.507240+0000","last_fullsized":"2024-05-30T06:48:33.507240+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549855+0000","last_change":"2024-05-30T06:48:35.557152+0000","last_active":"2024-05-30T06:48:37.549855+0000","last_peered":"2024-05-30T06:48:37.549855+0000","last_clean":"2024-05-30T06:48:37.549855+0000","last_became_active":"2024-05-30T06:48:35.556679+0000","last_became_peered":"2024-05-30T06:48:35.556679+0000","last_unstale":"2024-05-30T06:48:37.549855+0000","last_undegraded":"2024-05-30T06:48:37.549855+0000","last_fullsized":"2024-05-30T06:48:37.549855+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:26:03.358003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524757+0000","last_change":"2024-05-30T06:48:34.532737+0000","last_active":"2024-05-30T06:48:37.524757+0000","last_peered":"2024-05-30T06:48:37.524757+0000","last_clean":"2024-05-30T06:48:37.524757+0000","last_became_active":"2024-05-30T06:48:34.532439+0000","last_became_peered":"2024-05-30T06:48:34.532439+0000","last_unstale":"2024-05-30T06:48:37.524757+0000","last_undegraded":"2024-05-30T06:48:37.524757+0000","last_fullsized":"2024-05-30T06:48:37.524757+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:32:26.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.508602+0000","last_change":"2024-05-30T06:48:33.508602+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.508602+0000","last_undegraded":"2024-05-30T06:48:33.508602+0000","last_fullsized":"2024-05-30T06:48:33.508602+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524835+0000","last_change":"2024-05-30T06:48:35.533392+0000","last_active":"2024-05-30T06:48:37.524835+0000","last_peered":"2024-05-30T06:48:37.524835+0000","last_clean":"2024-05-30T06:48:37.524835+0000","last_became_active":"2024-05-30T06:48:35.533109+0000","last_became_peered":"2024-05-30T06:48:35.533109+0000","last_unstale":"2024-05-30T06:48:37.524835+0000","last_undegraded":"2024-05-30T06:48:37.524835+0000","last_fullsized":"2024-05-30T06:48:37.524835+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:43:16.011353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505083+0000","last_change":"2024-05-30T06:48:33.505083+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505083+0000","last_undegraded":"2024-05-30T06:48:33.505083+0000","last_fullsized":"2024-05-30T06:48:33.505083+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524475+0000","last_change":"2024-05-30T06:48:35.543686+0000","last_active":"2024-05-30T06:48:37.524475+0000","last_peered":"2024-05-30T06:48:37.524475+0000","last_clean":"2024-05-30T06:48:37.524475+0000","last_became_active":"2024-05-30T06:48:35.543395+0000","last_became_peered":"2024-05-30T06:48:35.543395+0000","last_unstale":"2024-05-30T06:48:37.524475+0000","last_undegraded":"2024-05-30T06:48:37.524475+0000","last_fullsized":"2024-05-30T06:48:37.524475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:45:27.303328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505580+0000","last_change":"2024-05-30T06:48:33.505580+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505580+0000","last_undegraded":"2024-05-30T06:48:33.505580+0000","last_fullsized":"2024-05-30T06:48:33.505580+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505018+0000","last_change":"2024-05-30T06:48:33.505018+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505018+0000","last_undegraded":"2024-05-30T06:48:33.505018+0000","last_fullsized":"2024-05-30T06:48:33.505018+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525179+0000","last_change":"2024-05-30T06:48:34.520993+0000","last_active":"2024-05-30T06:48:37.525179+0000","last_peered":"2024-05-30T06:48:37.525179+0000","last_clean":"2024-05-30T06:48:37.525179+0000","last_became_active":"2024-05-30T06:48:34.520714+0000","last_became_peered":"2024-05-30T06:48:34.520714+0000","last_unstale":"2024-05-30T06:48:37.525179+0000","last_undegraded":"2024-05-30T06:48:37.525179+0000","last_fullsized":"2024-05-30T06:48:37.525179+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:59:06.787445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.512527+0000","last_change":"2024-05-30T06:48:33.512527+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.512527+0000","last_undegraded":"2024-05-30T06:48:33.512527+0000","last_fullsized":"2024-05-30T06:48:33.512527+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525135+0000","last_change":"2024-05-30T06:48:35.533608+0000","last_active":"2024-05-30T06:48:37.525135+0000","last_peered":"2024-05-30T06:48:37.525135+0000","last_clean":"2024-05-30T06:48:37.525135+0000","last_became_active":"2024-05-30T06:48:35.531836+0000","last_became_peered":"2024-05-30T06:48:35.531836+0000","last_unstale":"2024-05-30T06:48:37.525135+0000","last_undegraded":"2024-05-30T06:48:37.525135+0000","last_fullsized":"2024-05-30T06:48:37.525135+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:18.217900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506954+0000","last_change":"2024-05-30T06:48:33.506954+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506954+0000","last_undegraded":"2024-05-30T06:48:33.506954+0000","last_fullsized":"2024-05-30T06:48:33.506954+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505091+0000","last_change":"2024-05-30T06:48:33.505091+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505091+0000","last_undegraded":"2024-05-30T06:48:33.505091+0000","last_fullsized":"2024-05-30T06:48:33.505091+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549541+0000","last_change":"2024-05-30T06:48:35.550619+0000","last_active":"2024-05-30T06:48:37.549541+0000","last_peered":"2024-05-30T06:48:37.549541+0000","last_clean":"2024-05-30T06:48:37.549541+0000","last_became_active":"2024-05-30T06:48:35.549371+0000","last_became_peered":"2024-05-30T06:48:35.549371+0000","last_unstale":"2024-05-30T06:48:37.549541+0000","last_undegraded":"2024-05-30T06:48:37.549541+0000","last_fullsized":"2024-05-30T06:48:37.549541+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:38.360823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505793+0000","last_change":"2024-05-30T06:48:33.505793+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505793+0000","last_undegraded":"2024-05-30T06:48:33.505793+0000","last_fullsized":"2024-05-30T06:48:33.505793+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505186+0000","last_change":"2024-05-30T06:48:33.505186+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505186+0000","last_undegraded":"2024-05-30T06:48:33.505186+0000","last_fullsized":"2024-05-30T06:48:33.505186+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.508603+0000","last_change":"2024-05-30T06:48:33.508603+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.508603+0000","last_undegraded":"2024-05-30T06:48:33.508603+0000","last_fullsized":"2024-05-30T06:48:33.508603+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.511570+0000","last_change":"2024-05-30T06:48:33.511570+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.511570+0000","last_undegraded":"2024-05-30T06:48:33.511570+0000","last_fullsized":"2024-05-30T06:48:33.511570+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":247,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549151+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:48:37.549151+0000","last_peered":"2024-05-30T06:48:37.549151+0000","last_clean":"2024-05-30T06:48:37.549151+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:48:37.549151+0000","last_undegraded":"2024-05-30T06:48:37.549151+0000","last_fullsized":"2024-05-30T06:48:37.549151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1323008,"data_stored":894837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45712,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326128,"statfs":{"total":96636764160,"available":96589955072,"internally_reserved":0,"allocated":659456,"data_stored":274093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44324,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327516,"statfs":{"total":96636764160,"available":96591376384,"internally_reserved":0,"allocated":671744,"data_stored":279150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45748,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326092,"statfs":{"total":96636764160,"available":96589918208,"internally_reserved":0,"allocated":684032,"data_stored":284967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45724,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326116,"statfs":{"total":96636764160,"available":96589942784,"internally_reserved":0,"allocated":671744,"data_stored":279150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44380,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327460,"statfs":{"total":96636764160,"available":96591319040,"internally_reserved":0,"allocated":729088,"data_stored":304365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45728,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326112,"statfs":{"total":96636764160,"available":96589938688,"internally_reserved":0,"allocated":671744,"data_stored":279150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46368,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325472,"statfs":{"total":96636764160,"available":96589283328,"internally_reserved":0,"allocated":1331200,"data_stored":896871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:48:39.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:48:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.835+0000 7f257d600640 1 Processor -- start 2024-05-30T06:48:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.835+0000 7f257d600640 1 -- start start 2024-05-30T06:48:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f257d600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257815ed50 0x7f25780c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f257d600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f25780d02b0 0x7f25780d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f257d600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25780c7f20 con 0x7f25780d0c50 2024-05-30T06:48:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f257d600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f25780c9500 con 0x7f25780d02b0 2024-05-30T06:48:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f257d600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f257815f130 con 0x7f257815ed50 2024-05-30T06:48:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f2576a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257815ed50 0x7f25780c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f2576a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257815ed50 0x7f25780c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:50958/0 (socket says 172.21.15.37:50958) 2024-05-30T06:48:39.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f2576a00640 1 -- 172.21.15.37:0/4054903453 learned_addr learned my addr 172.21.15.37:0/4054903453 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:39.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f256fe00640 1 --2- 172.21.15.37:0/4054903453 >> v2:172.21.15.105:3300/0 conn(0x7f25780d02b0 0x7f25780d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f2576a00640 1 -- 172.21.15.37:0/4054903453 >> v2:172.21.15.105:3300/0 conn(0x7f25780d02b0 msgr2=0x7f25780d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:39.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f2576a00640 1 --2- 172.21.15.37:0/4054903453 >> v2:172.21.15.105:3300/0 conn(0x7f25780d02b0 0x7f25780d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f2576a00640 1 -- 172.21.15.37:0/4054903453 >> v1:172.21.15.105:6789/0 conn(0x7f25780d0c50 legacy=0x7f25781627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f2576000640 1 -- 172.21.15.37:0/4054903453 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3754074322 0 0) 0x7f25780c7f20 con 0x7f25780d0c50 2024-05-30T06:48:39.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.839+0000 7f2576a00640 1 -- 172.21.15.37:0/4054903453 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25780c8200 con 0x7f257815ed50 2024-05-30T06:48:39.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f2576a00640 1 --2- 172.21.15.37:0/4054903453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257815ed50 0x7f25780c8fc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2568009870 tx=0x7f256801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=325e6bd4e079e189 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:39.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f2576000640 1 -- 172.21.15.37:0/4054903453 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25680a95f0 con 0x7f257815ed50 2024-05-30T06:48:39.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f2576000640 1 -- 172.21.15.37:0/4054903453 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25680a9790 con 0x7f257815ed50 2024-05-30T06:48:39.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f2576000640 1 -- 172.21.15.37:0/4054903453 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25680a9b60 con 0x7f257815ed50 2024-05-30T06:48:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f257d600640 1 -- 172.21.15.37:0/4054903453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257815ed50 msgr2=0x7f25780c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f257d600640 1 --2- 172.21.15.37:0/4054903453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257815ed50 0x7f25780c8fc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2568009870 tx=0x7f256801c530 comp rx=0 tx=0).stop 2024-05-30T06:48:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f257d600640 1 -- 172.21.15.37:0/4054903453 shutdown_connections 2024-05-30T06:48:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f257d600640 1 --2- 172.21.15.37:0/4054903453 >> v2:172.21.15.105:3300/0 conn(0x7f25780d02b0 0x7f25780d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f257d600640 1 --2- 172.21.15.37:0/4054903453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257815ed50 0x7f25780c8fc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f257d600640 1 -- 172.21.15.37:0/4054903453 >> 172.21.15.37:0/4054903453 conn(0x7f25780d26e0 msgr2=0x7f25780d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f257d600640 1 -- 172.21.15.37:0/4054903453 shutdown_connections 2024-05-30T06:48:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f257d600640 1 -- 172.21.15.37:0/4054903453 wait complete. 2024-05-30T06:48:39.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f257d600640 1 Processor -- start 2024-05-30T06:48:39.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.843+0000 7f257d600640 1 -- start start 2024-05-30T06:48:39.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f257d600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f25780d02b0 0x7f2578161d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f257d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25780d0c50 0x7f25780b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f257d600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f257815ed50 0x7f257815f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f257d600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f25780c7c50 con 0x7f25780d0c50 2024-05-30T06:48:39.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f257d600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f25780c7ad0 con 0x7f257815ed50 2024-05-30T06:48:39.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f257d600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f257816bb20 con 0x7f25780d02b0 2024-05-30T06:48:39.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f256fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25780d0c50 0x7f25780b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f256fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25780d0c50 0x7f25780b6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39284/0 (socket says 172.21.15.37:39284) 2024-05-30T06:48:39.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f256fe00640 1 -- 172.21.15.37:0/4260892353 learned_addr learned my addr 172.21.15.37:0/4260892353 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f2576a00640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f25780d02b0 0x7f2578161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f2577400640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f257815ed50 0x7f257815f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f256fe00640 1 -- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f25780d02b0 msgr2=0x7f2578161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f256fe00640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f25780d02b0 0x7f2578161d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f256fe00640 1 -- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f257815ed50 msgr2=0x7f257815f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:39.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f256fe00640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f257815ed50 0x7f257815f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:39.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f256fe00640 1 -- 172.21.15.37:0/4260892353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2578150cd0 con 0x7f25780d0c50 2024-05-30T06:48:39.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f256fe00640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25780d0c50 0x7f25780b6eb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f256000e870 tx=0x7f256000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:39.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f256ea00640 1 -- 172.21.15.37:0/4260892353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560017070 con 0x7f25780d0c50 2024-05-30T06:48:39.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f256ea00640 1 -- 172.21.15.37:0/4260892353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f256000c940 con 0x7f25780d0c50 2024-05-30T06:48:39.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f256ea00640 1 -- 172.21.15.37:0/4260892353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256000ccf0 con 0x7f25780d0c50 2024-05-30T06:48:39.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f257d600640 1 -- 172.21.15.37:0/4260892353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2578150fb0 con 0x7f25780d0c50 2024-05-30T06:48:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f257d600640 1 -- 172.21.15.37:0/4260892353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25780d2020 con 0x7f25780d0c50 2024-05-30T06:48:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.847+0000 7f257d600640 1 -- 172.21.15.37:0/4260892353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2578068b20 con 0x7f25780d0c50 2024-05-30T06:48:39.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.851+0000 7f256ea00640 1 -- 172.21.15.37:0/4260892353 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f256001a070 con 0x7f25780d0c50 2024-05-30T06:48:39.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.851+0000 7f256ea00640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2554068bf0 0x7f255406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:39.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.851+0000 7f256ea00640 1 -- 172.21.15.37:0/4260892353 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f2560087d80 con 0x7f25780d0c50 2024-05-30T06:48:39.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.851+0000 7f2576a00640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2554068bf0 0x7f255406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:39.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.851+0000 7f2576a00640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2554068bf0 0x7f255406b0b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f25680ae000 tx=0x7f25680b4040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:39.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:39.855+0000 7f256ea00640 1 -- 172.21.15.37:0/4260892353 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2560056dd0 con 0x7f25780d0c50 2024-05-30T06:48:40.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.015+0000 7f257d600640 1 -- 172.21.15.37:0/4260892353 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25780d3420 con 0x7f2554068bf0 2024-05-30T06:48:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.023+0000 7f256ea00640 1 -- 172.21.15.37:0/4260892353 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244747 (secure 0 0 0) 0x7f25780d3420 con 0x7f2554068bf0 2024-05-30T06:48:40.023 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:40.024 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:48:40.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.023+0000 7f257d600640 1 -- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2554068bf0 msgr2=0x7f255406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.023+0000 7f257d600640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2554068bf0 0x7f255406b0b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f25680ae000 tx=0x7f25680b4040 comp rx=0 tx=0).stop 2024-05-30T06:48:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.023+0000 7f257d600640 1 -- 172.21.15.37:0/4260892353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25780d0c50 msgr2=0x7f25780b6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.023+0000 7f257d600640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25780d0c50 0x7f25780b6eb0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f256000e870 tx=0x7f256000ec70 comp rx=0 tx=0).stop 2024-05-30T06:48:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.023+0000 7f257d600640 1 -- 172.21.15.37:0/4260892353 shutdown_connections 2024-05-30T06:48:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.023+0000 7f257d600640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2554068bf0 0x7f255406b0b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.023+0000 7f257d600640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f257815ed50 0x7f257815f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.023+0000 7f257d600640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25780d0c50 0x7f25780b6eb0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.023+0000 7f257d600640 1 --2- 172.21.15.37:0/4260892353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f25780d02b0 0x7f2578161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.023+0000 7f257d600640 1 -- 172.21.15.37:0/4260892353 >> 172.21.15.37:0/4260892353 conn(0x7f25780d26e0 msgr2=0x7f2578074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.023+0000 7f257d600640 1 -- 172.21.15.37:0/4260892353 shutdown_connections 2024-05-30T06:48:40.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.023+0000 7f257d600640 1 -- 172.21.15.37:0/4260892353 wait complete. 2024-05-30T06:48:40.043 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-05-30T06:48:38.748495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591040,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346296,"kb_used_data":6584,"kb_used_omap":12,"kb_used_meta":339571,"kb_avail":754628424,"statfs":{"total":773094113280,"available":772739506176,"internally_reserved":0,"allocated":6742016,"data_stored":3492583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":347721264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.245885"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543618+0000","last_change":"2024-05-30T06:48:35.544557+0000","last_active":"2024-05-30T06:48:36.543618+0000","last_peered":"2024-05-30T06:48:36.543618+0000","last_clean":"2024-05-30T06:48:36.543618+0000","last_became_active":"2024-05-30T06:48:35.544234+0000","last_became_peered":"2024-05-30T06:48:35.544234+0000","last_unstale":"2024-05-30T06:48:36.543618+0000","last_undegraded":"2024-05-30T06:48:36.543618+0000","last_fullsized":"2024-05-30T06:48:36.543618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:46.614302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549611+0000","last_change":"2024-05-30T06:48:35.548800+0000","last_active":"2024-05-30T06:48:37.549611+0000","last_peered":"2024-05-30T06:48:37.549611+0000","last_clean":"2024-05-30T06:48:37.549611+0000","last_became_active":"2024-05-30T06:48:35.548522+0000","last_became_peered":"2024-05-30T06:48:35.548522+0000","last_unstale":"2024-05-30T06:48:37.549611+0000","last_undegraded":"2024-05-30T06:48:37.549611+0000","last_fullsized":"2024-05-30T06:48:37.549611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:59.526146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543438+0000","last_change":"2024-05-30T06:48:35.528596+0000","last_active":"2024-05-30T06:48:36.543438+0000","last_peered":"2024-05-30T06:48:36.543438+0000","last_clean":"2024-05-30T06:48:36.543438+0000","last_became_active":"2024-05-30T06:48:35.528270+0000","last_became_peered":"2024-05-30T06:48:35.528270+0000","last_unstale":"2024-05-30T06:48:36.543438+0000","last_undegraded":"2024-05-30T06:48:36.543438+0000","last_fullsized":"2024-05-30T06:48:36.543438+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:24:19.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524493+0000","last_change":"2024-05-30T06:48:35.526635+0000","last_active":"2024-05-30T06:48:37.524493+0000","last_peered":"2024-05-30T06:48:37.524493+0000","last_clean":"2024-05-30T06:48:37.524493+0000","last_became_active":"2024-05-30T06:48:35.526369+0000","last_became_peered":"2024-05-30T06:48:35.526369+0000","last_unstale":"2024-05-30T06:48:37.524493+0000","last_undegraded":"2024-05-30T06:48:37.524493+0000","last_fullsized":"2024-05-30T06:48:37.524493+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:09:16.907885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524548+0000","last_change":"2024-05-30T06:48:35.531935+0000","last_active":"2024-05-30T06:48:37.524548+0000","last_peered":"2024-05-30T06:48:37.524548+0000","last_clean":"2024-05-30T06:48:37.524548+0000","last_became_active":"2024-05-30T06:48:35.531582+0000","last_became_peered":"2024-05-30T06:48:35.531582+0000","last_unstale":"2024-05-30T06:48:37.524548+0000","last_undegraded":"2024-05-30T06:48:37.524548+0000","last_fullsized":"2024-05-30T06:48:37.524548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:59:14.799560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549715+0000","last_change":"2024-05-30T06:48:35.542792+0000","last_active":"2024-05-30T06:48:37.549715+0000","last_peered":"2024-05-30T06:48:37.549715+0000","last_clean":"2024-05-30T06:48:37.549715+0000","last_became_active":"2024-05-30T06:48:35.542518+0000","last_became_peered":"2024-05-30T06:48:35.542518+0000","last_unstale":"2024-05-30T06:48:37.549715+0000","last_undegraded":"2024-05-30T06:48:37.549715+0000","last_fullsized":"2024-05-30T06:48:37.549715+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:07:00.306354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543515+0000","last_change":"2024-05-30T06:48:35.544959+0000","last_active":"2024-05-30T06:48:36.543515+0000","last_peered":"2024-05-30T06:48:36.543515+0000","last_clean":"2024-05-30T06:48:36.543515+0000","last_became_active":"2024-05-30T06:48:35.544728+0000","last_became_peered":"2024-05-30T06:48:35.544728+0000","last_unstale":"2024-05-30T06:48:36.543515+0000","last_undegraded":"2024-05-30T06:48:36.543515+0000","last_fullsized":"2024-05-30T06:48:36.543515+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:14.198830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549357+0000","last_change":"2024-05-30T06:48:35.547692+0000","last_active":"2024-05-30T06:48:37.549357+0000","last_peered":"2024-05-30T06:48:37.549357+0000","last_clean":"2024-05-30T06:48:37.549357+0000","last_became_active":"2024-05-30T06:48:35.547405+0000","last_became_peered":"2024-05-30T06:48:35.547405+0000","last_unstale":"2024-05-30T06:48:37.549357+0000","last_undegraded":"2024-05-30T06:48:37.549357+0000","last_fullsized":"2024-05-30T06:48:37.549357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:18.217900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549353+0000","last_change":"2024-05-30T06:48:35.546690+0000","last_active":"2024-05-30T06:48:37.549353+0000","last_peered":"2024-05-30T06:48:37.549353+0000","last_clean":"2024-05-30T06:48:37.549353+0000","last_became_active":"2024-05-30T06:48:35.546259+0000","last_became_peered":"2024-05-30T06:48:35.546259+0000","last_unstale":"2024-05-30T06:48:37.549353+0000","last_undegraded":"2024-05-30T06:48:37.549353+0000","last_fullsized":"2024-05-30T06:48:37.549353+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:29.528851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543690+0000","last_change":"2024-05-30T06:48:35.547279+0000","last_active":"2024-05-30T06:48:36.543690+0000","last_peered":"2024-05-30T06:48:36.543690+0000","last_clean":"2024-05-30T06:48:36.543690+0000","last_became_active":"2024-05-30T06:48:35.546955+0000","last_became_peered":"2024-05-30T06:48:35.546955+0000","last_unstale":"2024-05-30T06:48:36.543690+0000","last_undegraded":"2024-05-30T06:48:36.543690+0000","last_fullsized":"2024-05-30T06:48:36.543690+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:14:29.873987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524951+0000","last_change":"2024-05-30T06:48:35.530569+0000","last_active":"2024-05-30T06:48:37.524951+0000","last_peered":"2024-05-30T06:48:37.524951+0000","last_clean":"2024-05-30T06:48:37.524951+0000","last_became_active":"2024-05-30T06:48:35.530270+0000","last_became_peered":"2024-05-30T06:48:35.530270+0000","last_unstale":"2024-05-30T06:48:37.524951+0000","last_undegraded":"2024-05-30T06:48:37.524951+0000","last_fullsized":"2024-05-30T06:48:37.524951+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:24:21.624845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543559+0000","last_change":"2024-05-30T06:48:35.534365+0000","last_active":"2024-05-30T06:48:36.543559+0000","last_peered":"2024-05-30T06:48:36.543559+0000","last_clean":"2024-05-30T06:48:36.543559+0000","last_became_active":"2024-05-30T06:48:35.529711+0000","last_became_peered":"2024-05-30T06:48:35.529711+0000","last_unstale":"2024-05-30T06:48:36.543559+0000","last_undegraded":"2024-05-30T06:48:36.543559+0000","last_fullsized":"2024-05-30T06:48:36.543559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:57:47.611985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549324+0000","last_change":"2024-05-30T06:48:35.548726+0000","last_active":"2024-05-30T06:48:37.549324+0000","last_peered":"2024-05-30T06:48:37.549324+0000","last_clean":"2024-05-30T06:48:37.549324+0000","last_became_active":"2024-05-30T06:48:35.548446+0000","last_became_peered":"2024-05-30T06:48:35.548446+0000","last_unstale":"2024-05-30T06:48:37.549324+0000","last_undegraded":"2024-05-30T06:48:37.549324+0000","last_fullsized":"2024-05-30T06:48:37.549324+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:24:21.624845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543266+0000","last_change":"2024-05-30T06:48:35.532420+0000","last_active":"2024-05-30T06:48:36.543266+0000","last_peered":"2024-05-30T06:48:36.543266+0000","last_clean":"2024-05-30T06:48:36.543266+0000","last_became_active":"2024-05-30T06:48:35.532139+0000","last_became_peered":"2024-05-30T06:48:35.532139+0000","last_unstale":"2024-05-30T06:48:36.543266+0000","last_undegraded":"2024-05-30T06:48:36.543266+0000","last_fullsized":"2024-05-30T06:48:36.543266+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:50:07.910737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524577+0000","last_change":"2024-05-30T06:48:35.527918+0000","last_active":"2024-05-30T06:48:37.524577+0000","last_peered":"2024-05-30T06:48:37.524577+0000","last_clean":"2024-05-30T06:48:37.524577+0000","last_became_active":"2024-05-30T06:48:35.527120+0000","last_became_peered":"2024-05-30T06:48:35.527120+0000","last_unstale":"2024-05-30T06:48:37.524577+0000","last_undegraded":"2024-05-30T06:48:37.524577+0000","last_fullsized":"2024-05-30T06:48:37.524577+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:52:14.951102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525054+0000","last_change":"2024-05-30T06:48:35.544708+0000","last_active":"2024-05-30T06:48:37.525054+0000","last_peered":"2024-05-30T06:48:37.525054+0000","last_clean":"2024-05-30T06:48:37.525054+0000","last_became_active":"2024-05-30T06:48:35.544378+0000","last_became_peered":"2024-05-30T06:48:35.544378+0000","last_unstale":"2024-05-30T06:48:37.525054+0000","last_undegraded":"2024-05-30T06:48:37.525054+0000","last_fullsized":"2024-05-30T06:48:37.525054+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:29.528851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525103+0000","last_change":"2024-05-30T06:48:34.528291+0000","last_active":"2024-05-30T06:48:37.525103+0000","last_peered":"2024-05-30T06:48:37.525103+0000","last_clean":"2024-05-30T06:48:37.525103+0000","last_became_active":"2024-05-30T06:48:34.528020+0000","last_became_peered":"2024-05-30T06:48:34.528020+0000","last_unstale":"2024-05-30T06:48:37.525103+0000","last_undegraded":"2024-05-30T06:48:37.525103+0000","last_fullsized":"2024-05-30T06:48:37.525103+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:02:04.678244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.509852+0000","last_change":"2024-05-30T06:48:33.509852+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.509852+0000","last_undegraded":"2024-05-30T06:48:33.509852+0000","last_fullsized":"2024-05-30T06:48:33.509852+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524841+0000","last_change":"2024-05-30T06:48:35.533213+0000","last_active":"2024-05-30T06:48:37.524841+0000","last_peered":"2024-05-30T06:48:37.524841+0000","last_clean":"2024-05-30T06:48:37.524841+0000","last_became_active":"2024-05-30T06:48:35.531924+0000","last_became_peered":"2024-05-30T06:48:35.531924+0000","last_unstale":"2024-05-30T06:48:37.524841+0000","last_undegraded":"2024-05-30T06:48:37.524841+0000","last_fullsized":"2024-05-30T06:48:37.524841+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:04:54.109208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525062+0000","last_change":"2024-05-30T06:48:34.526188+0000","last_active":"2024-05-30T06:48:37.525062+0000","last_peered":"2024-05-30T06:48:37.525062+0000","last_clean":"2024-05-30T06:48:37.525062+0000","last_became_active":"2024-05-30T06:48:34.525779+0000","last_became_peered":"2024-05-30T06:48:34.525779+0000","last_unstale":"2024-05-30T06:48:37.525062+0000","last_undegraded":"2024-05-30T06:48:37.525062+0000","last_fullsized":"2024-05-30T06:48:37.525062+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:14:21.988526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524963+0000","last_change":"2024-05-30T06:48:35.533901+0000","last_active":"2024-05-30T06:48:37.524963+0000","last_peered":"2024-05-30T06:48:37.524963+0000","last_clean":"2024-05-30T06:48:37.524963+0000","last_became_active":"2024-05-30T06:48:35.533310+0000","last_became_peered":"2024-05-30T06:48:35.533310+0000","last_unstale":"2024-05-30T06:48:37.524963+0000","last_undegraded":"2024-05-30T06:48:37.524963+0000","last_fullsized":"2024-05-30T06:48:37.524963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:00.960494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.507406+0000","last_change":"2024-05-30T06:48:33.507406+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.507406+0000","last_undegraded":"2024-05-30T06:48:33.507406+0000","last_fullsized":"2024-05-30T06:48:33.507406+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506351+0000","last_change":"2024-05-30T06:48:33.506351+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506351+0000","last_undegraded":"2024-05-30T06:48:33.506351+0000","last_fullsized":"2024-05-30T06:48:33.506351+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524450+0000","last_change":"2024-05-30T06:48:34.520117+0000","last_active":"2024-05-30T06:48:37.524450+0000","last_peered":"2024-05-30T06:48:37.524450+0000","last_clean":"2024-05-30T06:48:37.524450+0000","last_became_active":"2024-05-30T06:48:34.519763+0000","last_became_peered":"2024-05-30T06:48:34.519763+0000","last_unstale":"2024-05-30T06:48:37.524450+0000","last_undegraded":"2024-05-30T06:48:37.524450+0000","last_fullsized":"2024-05-30T06:48:37.524450+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:55.437085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506817+0000","last_change":"2024-05-30T06:48:33.506817+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506817+0000","last_undegraded":"2024-05-30T06:48:33.506817+0000","last_fullsized":"2024-05-30T06:48:33.506817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505817+0000","last_change":"2024-05-30T06:48:33.505817+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505817+0000","last_undegraded":"2024-05-30T06:48:33.505817+0000","last_fullsized":"2024-05-30T06:48:33.505817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549808+0000","last_change":"2024-05-30T06:48:34.538260+0000","last_active":"2024-05-30T06:48:37.549808+0000","last_peered":"2024-05-30T06:48:37.549808+0000","last_clean":"2024-05-30T06:48:37.549808+0000","last_became_active":"2024-05-30T06:48:34.537965+0000","last_became_peered":"2024-05-30T06:48:34.537965+0000","last_unstale":"2024-05-30T06:48:37.549808+0000","last_undegraded":"2024-05-30T06:48:37.549808+0000","last_fullsized":"2024-05-30T06:48:37.549808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:16:16.602018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549901+0000","last_change":"2024-05-30T06:48:35.556813+0000","last_active":"2024-05-30T06:48:37.549901+0000","last_peered":"2024-05-30T06:48:37.549901+0000","last_clean":"2024-05-30T06:48:37.549901+0000","last_became_active":"2024-05-30T06:48:35.556531+0000","last_became_peered":"2024-05-30T06:48:35.556531+0000","last_unstale":"2024-05-30T06:48:37.549901+0000","last_undegraded":"2024-05-30T06:48:37.549901+0000","last_fullsized":"2024-05-30T06:48:37.549901+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:32:48.803325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.508808+0000","last_change":"2024-05-30T06:48:33.508808+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.508808+0000","last_undegraded":"2024-05-30T06:48:33.508808+0000","last_fullsized":"2024-05-30T06:48:33.508808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549866+0000","last_change":"2024-05-30T06:48:34.534475+0000","last_active":"2024-05-30T06:48:37.549866+0000","last_peered":"2024-05-30T06:48:37.549866+0000","last_clean":"2024-05-30T06:48:37.549866+0000","last_became_active":"2024-05-30T06:48:34.534154+0000","last_became_peered":"2024-05-30T06:48:34.534154+0000","last_unstale":"2024-05-30T06:48:37.549866+0000","last_undegraded":"2024-05-30T06:48:37.549866+0000","last_fullsized":"2024-05-30T06:48:37.549866+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:22:25.698890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549692+0000","last_change":"2024-05-30T06:48:35.556702+0000","last_active":"2024-05-30T06:48:37.549692+0000","last_peered":"2024-05-30T06:48:37.549692+0000","last_clean":"2024-05-30T06:48:37.549692+0000","last_became_active":"2024-05-30T06:48:35.556292+0000","last_became_peered":"2024-05-30T06:48:35.556292+0000","last_unstale":"2024-05-30T06:48:37.549692+0000","last_undegraded":"2024-05-30T06:48:37.549692+0000","last_fullsized":"2024-05-30T06:48:37.549692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:52.408293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506061+0000","last_change":"2024-05-30T06:48:33.506061+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506061+0000","last_undegraded":"2024-05-30T06:48:33.506061+0000","last_fullsized":"2024-05-30T06:48:33.506061+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.509881+0000","last_change":"2024-05-30T06:48:33.509881+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.509881+0000","last_undegraded":"2024-05-30T06:48:33.509881+0000","last_fullsized":"2024-05-30T06:48:33.509881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549360+0000","last_change":"2024-05-30T06:48:35.541178+0000","last_active":"2024-05-30T06:48:37.549360+0000","last_peered":"2024-05-30T06:48:37.549360+0000","last_clean":"2024-05-30T06:48:37.549360+0000","last_became_active":"2024-05-30T06:48:35.540874+0000","last_became_peered":"2024-05-30T06:48:35.540874+0000","last_unstale":"2024-05-30T06:48:37.549360+0000","last_undegraded":"2024-05-30T06:48:37.549360+0000","last_fullsized":"2024-05-30T06:48:37.549360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:00.960494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.512106+0000","last_change":"2024-05-30T06:48:33.512106+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.512106+0000","last_undegraded":"2024-05-30T06:48:33.512106+0000","last_fullsized":"2024-05-30T06:48:33.512106+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506331+0000","last_change":"2024-05-30T06:48:33.506331+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506331+0000","last_undegraded":"2024-05-30T06:48:33.506331+0000","last_fullsized":"2024-05-30T06:48:33.506331+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549386+0000","last_change":"2024-05-30T06:48:35.553758+0000","last_active":"2024-05-30T06:48:37.549386+0000","last_peered":"2024-05-30T06:48:37.549386+0000","last_clean":"2024-05-30T06:48:37.549386+0000","last_became_active":"2024-05-30T06:48:35.553533+0000","last_became_peered":"2024-05-30T06:48:35.553533+0000","last_unstale":"2024-05-30T06:48:37.549386+0000","last_undegraded":"2024-05-30T06:48:37.549386+0000","last_fullsized":"2024-05-30T06:48:37.549386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:36.834202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":22,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549129+0000","last_change":"2024-05-30T06:48:34.531403+0000","last_active":"2024-05-30T06:48:37.549129+0000","last_peered":"2024-05-30T06:48:37.549129+0000","last_clean":"2024-05-30T06:48:37.549129+0000","last_became_active":"2024-05-30T06:48:34.531122+0000","last_became_peered":"2024-05-30T06:48:34.531122+0000","last_unstale":"2024-05-30T06:48:37.549129+0000","last_undegraded":"2024-05-30T06:48:37.549129+0000","last_fullsized":"2024-05-30T06:48:37.549129+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:44:21.380589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549841+0000","last_change":"2024-05-30T06:48:35.549591+0000","last_active":"2024-05-30T06:48:37.549841+0000","last_peered":"2024-05-30T06:48:37.549841+0000","last_clean":"2024-05-30T06:48:37.549841+0000","last_became_active":"2024-05-30T06:48:35.549312+0000","last_became_peered":"2024-05-30T06:48:35.549312+0000","last_unstale":"2024-05-30T06:48:37.549841+0000","last_undegraded":"2024-05-30T06:48:37.549841+0000","last_fullsized":"2024-05-30T06:48:37.549841+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:52.950286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.508839+0000","last_change":"2024-05-30T06:48:33.508839+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.508839+0000","last_undegraded":"2024-05-30T06:48:33.508839+0000","last_fullsized":"2024-05-30T06:48:33.508839+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524998+0000","last_change":"2024-05-30T06:48:34.535017+0000","last_active":"2024-05-30T06:48:37.524998+0000","last_peered":"2024-05-30T06:48:37.524998+0000","last_clean":"2024-05-30T06:48:37.524998+0000","last_became_active":"2024-05-30T06:48:34.534737+0000","last_became_peered":"2024-05-30T06:48:34.534737+0000","last_unstale":"2024-05-30T06:48:37.524998+0000","last_undegraded":"2024-05-30T06:48:37.524998+0000","last_fullsized":"2024-05-30T06:48:37.524998+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:58:44.441246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.507240+0000","last_change":"2024-05-30T06:48:33.507240+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.507240+0000","last_undegraded":"2024-05-30T06:48:33.507240+0000","last_fullsized":"2024-05-30T06:48:33.507240+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549855+0000","last_change":"2024-05-30T06:48:35.557152+0000","last_active":"2024-05-30T06:48:37.549855+0000","last_peered":"2024-05-30T06:48:37.549855+0000","last_clean":"2024-05-30T06:48:37.549855+0000","last_became_active":"2024-05-30T06:48:35.556679+0000","last_became_peered":"2024-05-30T06:48:35.556679+0000","last_unstale":"2024-05-30T06:48:37.549855+0000","last_undegraded":"2024-05-30T06:48:37.549855+0000","last_fullsized":"2024-05-30T06:48:37.549855+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:26:03.358003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524757+0000","last_change":"2024-05-30T06:48:34.532737+0000","last_active":"2024-05-30T06:48:37.524757+0000","last_peered":"2024-05-30T06:48:37.524757+0000","last_clean":"2024-05-30T06:48:37.524757+0000","last_became_active":"2024-05-30T06:48:34.532439+0000","last_became_peered":"2024-05-30T06:48:34.532439+0000","last_unstale":"2024-05-30T06:48:37.524757+0000","last_undegraded":"2024-05-30T06:48:37.524757+0000","last_fullsized":"2024-05-30T06:48:37.524757+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:32:26.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.508602+0000","last_change":"2024-05-30T06:48:33.508602+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.508602+0000","last_undegraded":"2024-05-30T06:48:33.508602+0000","last_fullsized":"2024-05-30T06:48:33.508602+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524835+0000","last_change":"2024-05-30T06:48:35.533392+0000","last_active":"2024-05-30T06:48:37.524835+0000","last_peered":"2024-05-30T06:48:37.524835+0000","last_clean":"2024-05-30T06:48:37.524835+0000","last_became_active":"2024-05-30T06:48:35.533109+0000","last_became_peered":"2024-05-30T06:48:35.533109+0000","last_unstale":"2024-05-30T06:48:37.524835+0000","last_undegraded":"2024-05-30T06:48:37.524835+0000","last_fullsized":"2024-05-30T06:48:37.524835+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:43:16.011353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505083+0000","last_change":"2024-05-30T06:48:33.505083+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505083+0000","last_undegraded":"2024-05-30T06:48:33.505083+0000","last_fullsized":"2024-05-30T06:48:33.505083+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524475+0000","last_change":"2024-05-30T06:48:35.543686+0000","last_active":"2024-05-30T06:48:37.524475+0000","last_peered":"2024-05-30T06:48:37.524475+0000","last_clean":"2024-05-30T06:48:37.524475+0000","last_became_active":"2024-05-30T06:48:35.543395+0000","last_became_peered":"2024-05-30T06:48:35.543395+0000","last_unstale":"2024-05-30T06:48:37.524475+0000","last_undegraded":"2024-05-30T06:48:37.524475+0000","last_fullsized":"2024-05-30T06:48:37.524475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:45:27.303328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505580+0000","last_change":"2024-05-30T06:48:33.505580+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505580+0000","last_undegraded":"2024-05-30T06:48:33.505580+0000","last_fullsized":"2024-05-30T06:48:33.505580+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505018+0000","last_change":"2024-05-30T06:48:33.505018+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505018+0000","last_undegraded":"2024-05-30T06:48:33.505018+0000","last_fullsized":"2024-05-30T06:48:33.505018+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525179+0000","last_change":"2024-05-30T06:48:34.520993+0000","last_active":"2024-05-30T06:48:37.525179+0000","last_peered":"2024-05-30T06:48:37.525179+0000","last_clean":"2024-05-30T06:48:37.525179+0000","last_became_active":"2024-05-30T06:48:34.520714+0000","last_became_peered":"2024-05-30T06:48:34.520714+0000","last_unstale":"2024-05-30T06:48:37.525179+0000","last_undegraded":"2024-05-30T06:48:37.525179+0000","last_fullsized":"2024-05-30T06:48:37.525179+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:59:06.787445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.512527+0000","last_change":"2024-05-30T06:48:33.512527+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.512527+0000","last_undegraded":"2024-05-30T06:48:33.512527+0000","last_fullsized":"2024-05-30T06:48:33.512527+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525135+0000","last_change":"2024-05-30T06:48:35.533608+0000","last_active":"2024-05-30T06:48:37.525135+0000","last_peered":"2024-05-30T06:48:37.525135+0000","last_clean":"2024-05-30T06:48:37.525135+0000","last_became_active":"2024-05-30T06:48:35.531836+0000","last_became_peered":"2024-05-30T06:48:35.531836+0000","last_unstale":"2024-05-30T06:48:37.525135+0000","last_undegraded":"2024-05-30T06:48:37.525135+0000","last_fullsized":"2024-05-30T06:48:37.525135+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:18.217900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506954+0000","last_change":"2024-05-30T06:48:33.506954+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506954+0000","last_undegraded":"2024-05-30T06:48:33.506954+0000","last_fullsized":"2024-05-30T06:48:33.506954+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505091+0000","last_change":"2024-05-30T06:48:33.505091+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505091+0000","last_undegraded":"2024-05-30T06:48:33.505091+0000","last_fullsized":"2024-05-30T06:48:33.505091+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549541+0000","last_change":"2024-05-30T06:48:35.550619+0000","last_active":"2024-05-30T06:48:37.549541+0000","last_peered":"2024-05-30T06:48:37.549541+0000","last_clean":"2024-05-30T06:48:37.549541+0000","last_became_active":"2024-05-30T06:48:35.549371+0000","last_became_peered":"2024-05-30T06:48:35.549371+0000","last_unstale":"2024-05-30T06:48:37.549541+0000","last_undegraded":"2024-05-30T06:48:37.549541+0000","last_fullsized":"2024-05-30T06:48:37.549541+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:38.360823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505793+0000","last_change":"2024-05-30T06:48:33.505793+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505793+0000","last_undegraded":"2024-05-30T06:48:33.505793+0000","last_fullsized":"2024-05-30T06:48:33.505793+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505186+0000","last_change":"2024-05-30T06:48:33.505186+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505186+0000","last_undegraded":"2024-05-30T06:48:33.505186+0000","last_fullsized":"2024-05-30T06:48:33.505186+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.508603+0000","last_change":"2024-05-30T06:48:33.508603+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.508603+0000","last_undegraded":"2024-05-30T06:48:33.508603+0000","last_fullsized":"2024-05-30T06:48:33.508603+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.511570+0000","last_change":"2024-05-30T06:48:33.511570+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.511570+0000","last_undegraded":"2024-05-30T06:48:33.511570+0000","last_fullsized":"2024-05-30T06:48:33.511570+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":247,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549151+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:48:37.549151+0000","last_peered":"2024-05-30T06:48:37.549151+0000","last_clean":"2024-05-30T06:48:37.549151+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:48:37.549151+0000","last_undegraded":"2024-05-30T06:48:37.549151+0000","last_fullsized":"2024-05-30T06:48:37.549151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1323008,"data_stored":894837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45712,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326128,"statfs":{"total":96636764160,"available":96589955072,"internally_reserved":0,"allocated":659456,"data_stored":274093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44324,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327516,"statfs":{"total":96636764160,"available":96591376384,"internally_reserved":0,"allocated":671744,"data_stored":279150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45748,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326092,"statfs":{"total":96636764160,"available":96589918208,"internally_reserved":0,"allocated":684032,"data_stored":284967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45724,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326116,"statfs":{"total":96636764160,"available":96589942784,"internally_reserved":0,"allocated":671744,"data_stored":279150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44380,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327460,"statfs":{"total":96636764160,"available":96591319040,"internally_reserved":0,"allocated":729088,"data_stored":304365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45728,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326112,"statfs":{"total":96636764160,"available":96589938688,"internally_reserved":0,"allocated":671744,"data_stored":279150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46368,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325472,"statfs":{"total":96636764160,"available":96589283328,"internally_reserved":0,"allocated":1331200,"data_stored":896871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:48:40.047 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:48:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.231+0000 7f469f600640 1 Processor -- start 2024-05-30T06:48:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.231+0000 7f469f600640 1 -- start start 2024-05-30T06:48:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.231+0000 7f469f600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4698155e60 0x7f46980b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.231+0000 7f469f600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f469815c8f0 con 0x7f46980b2ec0 2024-05-30T06:48:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.231+0000 7f469f600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46980ccc80 con 0x7f469806f9a0 2024-05-30T06:48:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.231+0000 7f469f600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f46980ccff0 con 0x7f4698155e60 2024-05-30T06:48:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.231+0000 7f469cc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4698155e60 0x7f46980b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.231+0000 7f469cc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4698155e60 0x7f46980b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39294/0 (socket says 172.21.15.37:39294) 2024-05-30T06:48:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.231+0000 7f469cc00640 1 -- 172.21.15.37:0/483466348 learned_addr learned my addr 172.21.15.37:0/483466348 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.231+0000 7f469d600640 1 --1- 172.21.15.37:0/483466348 >> v1:172.21.15.37:6789/0 conn(0x7f46980b2ec0 0x7f46980cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48052/0 (socket says 172.21.15.37:48052) 2024-05-30T06:48:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.231+0000 7f469cc00640 1 -- 172.21.15.37:0/483466348 >> v1:172.21.15.105:6789/0 conn(0x7f469806f9a0 legacy=0x7f46980cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.231+0000 7f469cc00640 1 -- 172.21.15.37:0/483466348 >> v1:172.21.15.37:6789/0 conn(0x7f46980b2ec0 legacy=0x7f46980cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.231+0000 7f469cc00640 1 -- 172.21.15.37:0/483466348 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469815cbd0 con 0x7f4698155e60 2024-05-30T06:48:40.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.235+0000 7f469cc00640 1 --2- 172.21.15.37:0/483466348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4698155e60 0x7f46980b36a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f468c009870 tx=0x7f468c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df9621cc74c9a60 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:40.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.235+0000 7f4697400640 1 -- 172.21.15.37:0/483466348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c0ab5f0 con 0x7f4698155e60 2024-05-30T06:48:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.235+0000 7f4697400640 1 -- 172.21.15.37:0/483466348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468c0b0070 con 0x7f4698155e60 2024-05-30T06:48:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.235+0000 7f4697400640 1 -- 172.21.15.37:0/483466348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c0ab9b0 con 0x7f4698155e60 2024-05-30T06:48:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.235+0000 7f469f600640 1 -- 172.21.15.37:0/483466348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4698155e60 msgr2=0x7f46980b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.235+0000 7f469f600640 1 --2- 172.21.15.37:0/483466348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4698155e60 0x7f46980b36a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f468c009870 tx=0x7f468c01c520 comp rx=0 tx=0).stop 2024-05-30T06:48:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.235+0000 7f469f600640 1 -- 172.21.15.37:0/483466348 shutdown_connections 2024-05-30T06:48:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.235+0000 7f469f600640 1 --2- 172.21.15.37:0/483466348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4698155e60 0x7f46980b36a0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.235+0000 7f469f600640 1 -- 172.21.15.37:0/483466348 >> 172.21.15.37:0/483466348 conn(0x7f46980b23a0 msgr2=0x7f46980b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.235+0000 7f469f600640 1 -- 172.21.15.37:0/483466348 shutdown_connections 2024-05-30T06:48:40.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.235+0000 7f469f600640 1 -- 172.21.15.37:0/483466348 wait complete. 2024-05-30T06:48:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.235+0000 7f469f600640 1 Processor -- start 2024-05-30T06:48:40.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469f600640 1 -- start start 2024-05-30T06:48:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469f600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f469806f9a0 0x7f469814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469f600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46980b2ec0 0x7f4698149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469f600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4698155e60 0x7f4698147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469f600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4698169a00 con 0x7f4698155e60 2024-05-30T06:48:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469f600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4698169880 con 0x7f469806f9a0 2024-05-30T06:48:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469f600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4698169b80 con 0x7f46980b2ec0 2024-05-30T06:48:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4698155e60 0x7f4698147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4698155e60 0x7f4698147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39300/0 (socket says 172.21.15.37:39300) 2024-05-30T06:48:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469d600640 1 -- 172.21.15.37:0/2399521193 learned_addr learned my addr 172.21.15.37:0/2399521193 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f4697e00640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46980b2ec0 0x7f4698149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469cc00640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f469806f9a0 0x7f469814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469d600640 1 -- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46980b2ec0 msgr2=0x7f4698149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469d600640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46980b2ec0 0x7f4698149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469d600640 1 -- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f469806f9a0 msgr2=0x7f469814fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469d600640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f469806f9a0 0x7f469814fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469d600640 1 -- 172.21.15.37:0/2399521193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4698150580 con 0x7f4698155e60 2024-05-30T06:48:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469cc00640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f469806f9a0 0x7f469814fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469d600640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4698155e60 0x7f4698147610 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f469000c7a0 tx=0x7f469000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f4694c00640 1 -- 172.21.15.37:0/2399521193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690017070 con 0x7f4698155e60 2024-05-30T06:48:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f4694c00640 1 -- 172.21.15.37:0/2399521193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469000a5e0 con 0x7f4698155e60 2024-05-30T06:48:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469f600640 1 -- 172.21.15.37:0/2399521193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4698150860 con 0x7f4698155e60 2024-05-30T06:48:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f4694c00640 1 -- 172.21.15.37:0/2399521193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469000a990 con 0x7f4698155e60 2024-05-30T06:48:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469f600640 1 -- 172.21.15.37:0/2399521193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4698150e20 con 0x7f4698155e60 2024-05-30T06:48:40.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.239+0000 7f469f600640 1 -- 172.21.15.37:0/2399521193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4698068b20 con 0x7f4698155e60 2024-05-30T06:48:40.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.242+0000 7f4694c00640 1 -- 172.21.15.37:0/2399521193 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f469001a070 con 0x7f4698155e60 2024-05-30T06:48:40.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.242+0000 7f4694c00640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4678068bf0 0x7f467806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:40.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.242+0000 7f4694c00640 1 -- 172.21.15.37:0/2399521193 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f4690086ff0 con 0x7f4698155e60 2024-05-30T06:48:40.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.242+0000 7f469cc00640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4678068bf0 0x7f467806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:40.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.242+0000 7f469cc00640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4678068bf0 0x7f467806b0b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f468c0af000 tx=0x7f468c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:40.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.246+0000 7f4694c00640 1 -- 172.21.15.37:0/2399521193 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f46900560d0 con 0x7f4698155e60 2024-05-30T06:48:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.406+0000 7f469f600640 1 -- 172.21.15.37:0/2399521193 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4698072fb0 con 0x7f4678068bf0 2024-05-30T06:48:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.414+0000 7f4694c00640 1 -- 172.21.15.37:0/2399521193 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244747 (secure 0 0 0) 0x7f4698072fb0 con 0x7f4678068bf0 2024-05-30T06:48:40.417 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:40.419 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:48:40.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.418+0000 7f469f600640 1 -- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4678068bf0 msgr2=0x7f467806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.418+0000 7f469f600640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4678068bf0 0x7f467806b0b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f468c0af000 tx=0x7f468c0a7000 comp rx=0 tx=0).stop 2024-05-30T06:48:40.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.418+0000 7f469f600640 1 -- 172.21.15.37:0/2399521193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4698155e60 msgr2=0x7f4698147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.418+0000 7f469f600640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4698155e60 0x7f4698147610 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f469000c7a0 tx=0x7f469000cc60 comp rx=0 tx=0).stop 2024-05-30T06:48:40.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.418+0000 7f469f600640 1 -- 172.21.15.37:0/2399521193 shutdown_connections 2024-05-30T06:48:40.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.418+0000 7f469f600640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4698155e60 0x7f4698147610 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.418+0000 7f469f600640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46980b2ec0 0x7f4698149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.418+0000 7f469f600640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4678068bf0 0x7f467806b0b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.418+0000 7f469f600640 1 --2- 172.21.15.37:0/2399521193 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f469806f9a0 0x7f469814fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.418+0000 7f469f600640 1 -- 172.21.15.37:0/2399521193 >> 172.21.15.37:0/2399521193 conn(0x7f46980b23a0 msgr2=0x7f46980cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:40.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.418+0000 7f469f600640 1 -- 172.21.15.37:0/2399521193 shutdown_connections 2024-05-30T06:48:40.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.418+0000 7f469f600640 1 -- 172.21.15.37:0/2399521193 wait complete. 2024-05-30T06:48:40.438 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2024-05-30T06:48:38.748495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591040,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346296,"kb_used_data":6584,"kb_used_omap":12,"kb_used_meta":339571,"kb_avail":754628424,"statfs":{"total":773094113280,"available":772739506176,"internally_reserved":0,"allocated":6742016,"data_stored":3492583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":347721264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.245885"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543618+0000","last_change":"2024-05-30T06:48:35.544557+0000","last_active":"2024-05-30T06:48:36.543618+0000","last_peered":"2024-05-30T06:48:36.543618+0000","last_clean":"2024-05-30T06:48:36.543618+0000","last_became_active":"2024-05-30T06:48:35.544234+0000","last_became_peered":"2024-05-30T06:48:35.544234+0000","last_unstale":"2024-05-30T06:48:36.543618+0000","last_undegraded":"2024-05-30T06:48:36.543618+0000","last_fullsized":"2024-05-30T06:48:36.543618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:46.614302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549611+0000","last_change":"2024-05-30T06:48:35.548800+0000","last_active":"2024-05-30T06:48:37.549611+0000","last_peered":"2024-05-30T06:48:37.549611+0000","last_clean":"2024-05-30T06:48:37.549611+0000","last_became_active":"2024-05-30T06:48:35.548522+0000","last_became_peered":"2024-05-30T06:48:35.548522+0000","last_unstale":"2024-05-30T06:48:37.549611+0000","last_undegraded":"2024-05-30T06:48:37.549611+0000","last_fullsized":"2024-05-30T06:48:37.549611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:59.526146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543438+0000","last_change":"2024-05-30T06:48:35.528596+0000","last_active":"2024-05-30T06:48:36.543438+0000","last_peered":"2024-05-30T06:48:36.543438+0000","last_clean":"2024-05-30T06:48:36.543438+0000","last_became_active":"2024-05-30T06:48:35.528270+0000","last_became_peered":"2024-05-30T06:48:35.528270+0000","last_unstale":"2024-05-30T06:48:36.543438+0000","last_undegraded":"2024-05-30T06:48:36.543438+0000","last_fullsized":"2024-05-30T06:48:36.543438+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:24:19.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524493+0000","last_change":"2024-05-30T06:48:35.526635+0000","last_active":"2024-05-30T06:48:37.524493+0000","last_peered":"2024-05-30T06:48:37.524493+0000","last_clean":"2024-05-30T06:48:37.524493+0000","last_became_active":"2024-05-30T06:48:35.526369+0000","last_became_peered":"2024-05-30T06:48:35.526369+0000","last_unstale":"2024-05-30T06:48:37.524493+0000","last_undegraded":"2024-05-30T06:48:37.524493+0000","last_fullsized":"2024-05-30T06:48:37.524493+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:09:16.907885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524548+0000","last_change":"2024-05-30T06:48:35.531935+0000","last_active":"2024-05-30T06:48:37.524548+0000","last_peered":"2024-05-30T06:48:37.524548+0000","last_clean":"2024-05-30T06:48:37.524548+0000","last_became_active":"2024-05-30T06:48:35.531582+0000","last_became_peered":"2024-05-30T06:48:35.531582+0000","last_unstale":"2024-05-30T06:48:37.524548+0000","last_undegraded":"2024-05-30T06:48:37.524548+0000","last_fullsized":"2024-05-30T06:48:37.524548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:59:14.799560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549715+0000","last_change":"2024-05-30T06:48:35.542792+0000","last_active":"2024-05-30T06:48:37.549715+0000","last_peered":"2024-05-30T06:48:37.549715+0000","last_clean":"2024-05-30T06:48:37.549715+0000","last_became_active":"2024-05-30T06:48:35.542518+0000","last_became_peered":"2024-05-30T06:48:35.542518+0000","last_unstale":"2024-05-30T06:48:37.549715+0000","last_undegraded":"2024-05-30T06:48:37.549715+0000","last_fullsized":"2024-05-30T06:48:37.549715+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:07:00.306354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543515+0000","last_change":"2024-05-30T06:48:35.544959+0000","last_active":"2024-05-30T06:48:36.543515+0000","last_peered":"2024-05-30T06:48:36.543515+0000","last_clean":"2024-05-30T06:48:36.543515+0000","last_became_active":"2024-05-30T06:48:35.544728+0000","last_became_peered":"2024-05-30T06:48:35.544728+0000","last_unstale":"2024-05-30T06:48:36.543515+0000","last_undegraded":"2024-05-30T06:48:36.543515+0000","last_fullsized":"2024-05-30T06:48:36.543515+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:14.198830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549357+0000","last_change":"2024-05-30T06:48:35.547692+0000","last_active":"2024-05-30T06:48:37.549357+0000","last_peered":"2024-05-30T06:48:37.549357+0000","last_clean":"2024-05-30T06:48:37.549357+0000","last_became_active":"2024-05-30T06:48:35.547405+0000","last_became_peered":"2024-05-30T06:48:35.547405+0000","last_unstale":"2024-05-30T06:48:37.549357+0000","last_undegraded":"2024-05-30T06:48:37.549357+0000","last_fullsized":"2024-05-30T06:48:37.549357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:18.217900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549353+0000","last_change":"2024-05-30T06:48:35.546690+0000","last_active":"2024-05-30T06:48:37.549353+0000","last_peered":"2024-05-30T06:48:37.549353+0000","last_clean":"2024-05-30T06:48:37.549353+0000","last_became_active":"2024-05-30T06:48:35.546259+0000","last_became_peered":"2024-05-30T06:48:35.546259+0000","last_unstale":"2024-05-30T06:48:37.549353+0000","last_undegraded":"2024-05-30T06:48:37.549353+0000","last_fullsized":"2024-05-30T06:48:37.549353+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:29.528851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543690+0000","last_change":"2024-05-30T06:48:35.547279+0000","last_active":"2024-05-30T06:48:36.543690+0000","last_peered":"2024-05-30T06:48:36.543690+0000","last_clean":"2024-05-30T06:48:36.543690+0000","last_became_active":"2024-05-30T06:48:35.546955+0000","last_became_peered":"2024-05-30T06:48:35.546955+0000","last_unstale":"2024-05-30T06:48:36.543690+0000","last_undegraded":"2024-05-30T06:48:36.543690+0000","last_fullsized":"2024-05-30T06:48:36.543690+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:14:29.873987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524951+0000","last_change":"2024-05-30T06:48:35.530569+0000","last_active":"2024-05-30T06:48:37.524951+0000","last_peered":"2024-05-30T06:48:37.524951+0000","last_clean":"2024-05-30T06:48:37.524951+0000","last_became_active":"2024-05-30T06:48:35.530270+0000","last_became_peered":"2024-05-30T06:48:35.530270+0000","last_unstale":"2024-05-30T06:48:37.524951+0000","last_undegraded":"2024-05-30T06:48:37.524951+0000","last_fullsized":"2024-05-30T06:48:37.524951+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:24:21.624845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543559+0000","last_change":"2024-05-30T06:48:35.534365+0000","last_active":"2024-05-30T06:48:36.543559+0000","last_peered":"2024-05-30T06:48:36.543559+0000","last_clean":"2024-05-30T06:48:36.543559+0000","last_became_active":"2024-05-30T06:48:35.529711+0000","last_became_peered":"2024-05-30T06:48:35.529711+0000","last_unstale":"2024-05-30T06:48:36.543559+0000","last_undegraded":"2024-05-30T06:48:36.543559+0000","last_fullsized":"2024-05-30T06:48:36.543559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:57:47.611985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549324+0000","last_change":"2024-05-30T06:48:35.548726+0000","last_active":"2024-05-30T06:48:37.549324+0000","last_peered":"2024-05-30T06:48:37.549324+0000","last_clean":"2024-05-30T06:48:37.549324+0000","last_became_active":"2024-05-30T06:48:35.548446+0000","last_became_peered":"2024-05-30T06:48:35.548446+0000","last_unstale":"2024-05-30T06:48:37.549324+0000","last_undegraded":"2024-05-30T06:48:37.549324+0000","last_fullsized":"2024-05-30T06:48:37.549324+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:24:21.624845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543266+0000","last_change":"2024-05-30T06:48:35.532420+0000","last_active":"2024-05-30T06:48:36.543266+0000","last_peered":"2024-05-30T06:48:36.543266+0000","last_clean":"2024-05-30T06:48:36.543266+0000","last_became_active":"2024-05-30T06:48:35.532139+0000","last_became_peered":"2024-05-30T06:48:35.532139+0000","last_unstale":"2024-05-30T06:48:36.543266+0000","last_undegraded":"2024-05-30T06:48:36.543266+0000","last_fullsized":"2024-05-30T06:48:36.543266+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:50:07.910737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524577+0000","last_change":"2024-05-30T06:48:35.527918+0000","last_active":"2024-05-30T06:48:37.524577+0000","last_peered":"2024-05-30T06:48:37.524577+0000","last_clean":"2024-05-30T06:48:37.524577+0000","last_became_active":"2024-05-30T06:48:35.527120+0000","last_became_peered":"2024-05-30T06:48:35.527120+0000","last_unstale":"2024-05-30T06:48:37.524577+0000","last_undegraded":"2024-05-30T06:48:37.524577+0000","last_fullsized":"2024-05-30T06:48:37.524577+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:52:14.951102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525054+0000","last_change":"2024-05-30T06:48:35.544708+0000","last_active":"2024-05-30T06:48:37.525054+0000","last_peered":"2024-05-30T06:48:37.525054+0000","last_clean":"2024-05-30T06:48:37.525054+0000","last_became_active":"2024-05-30T06:48:35.544378+0000","last_became_peered":"2024-05-30T06:48:35.544378+0000","last_unstale":"2024-05-30T06:48:37.525054+0000","last_undegraded":"2024-05-30T06:48:37.525054+0000","last_fullsized":"2024-05-30T06:48:37.525054+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:29.528851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525103+0000","last_change":"2024-05-30T06:48:34.528291+0000","last_active":"2024-05-30T06:48:37.525103+0000","last_peered":"2024-05-30T06:48:37.525103+0000","last_clean":"2024-05-30T06:48:37.525103+0000","last_became_active":"2024-05-30T06:48:34.528020+0000","last_became_peered":"2024-05-30T06:48:34.528020+0000","last_unstale":"2024-05-30T06:48:37.525103+0000","last_undegraded":"2024-05-30T06:48:37.525103+0000","last_fullsized":"2024-05-30T06:48:37.525103+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:02:04.678244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.509852+0000","last_change":"2024-05-30T06:48:33.509852+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.509852+0000","last_undegraded":"2024-05-30T06:48:33.509852+0000","last_fullsized":"2024-05-30T06:48:33.509852+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524841+0000","last_change":"2024-05-30T06:48:35.533213+0000","last_active":"2024-05-30T06:48:37.524841+0000","last_peered":"2024-05-30T06:48:37.524841+0000","last_clean":"2024-05-30T06:48:37.524841+0000","last_became_active":"2024-05-30T06:48:35.531924+0000","last_became_peered":"2024-05-30T06:48:35.531924+0000","last_unstale":"2024-05-30T06:48:37.524841+0000","last_undegraded":"2024-05-30T06:48:37.524841+0000","last_fullsized":"2024-05-30T06:48:37.524841+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:04:54.109208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525062+0000","last_change":"2024-05-30T06:48:34.526188+0000","last_active":"2024-05-30T06:48:37.525062+0000","last_peered":"2024-05-30T06:48:37.525062+0000","last_clean":"2024-05-30T06:48:37.525062+0000","last_became_active":"2024-05-30T06:48:34.525779+0000","last_became_peered":"2024-05-30T06:48:34.525779+0000","last_unstale":"2024-05-30T06:48:37.525062+0000","last_undegraded":"2024-05-30T06:48:37.525062+0000","last_fullsized":"2024-05-30T06:48:37.525062+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:14:21.988526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524963+0000","last_change":"2024-05-30T06:48:35.533901+0000","last_active":"2024-05-30T06:48:37.524963+0000","last_peered":"2024-05-30T06:48:37.524963+0000","last_clean":"2024-05-30T06:48:37.524963+0000","last_became_active":"2024-05-30T06:48:35.533310+0000","last_became_peered":"2024-05-30T06:48:35.533310+0000","last_unstale":"2024-05-30T06:48:37.524963+0000","last_undegraded":"2024-05-30T06:48:37.524963+0000","last_fullsized":"2024-05-30T06:48:37.524963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:00.960494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.507406+0000","last_change":"2024-05-30T06:48:33.507406+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.507406+0000","last_undegraded":"2024-05-30T06:48:33.507406+0000","last_fullsized":"2024-05-30T06:48:33.507406+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506351+0000","last_change":"2024-05-30T06:48:33.506351+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506351+0000","last_undegraded":"2024-05-30T06:48:33.506351+0000","last_fullsized":"2024-05-30T06:48:33.506351+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524450+0000","last_change":"2024-05-30T06:48:34.520117+0000","last_active":"2024-05-30T06:48:37.524450+0000","last_peered":"2024-05-30T06:48:37.524450+0000","last_clean":"2024-05-30T06:48:37.524450+0000","last_became_active":"2024-05-30T06:48:34.519763+0000","last_became_peered":"2024-05-30T06:48:34.519763+0000","last_unstale":"2024-05-30T06:48:37.524450+0000","last_undegraded":"2024-05-30T06:48:37.524450+0000","last_fullsized":"2024-05-30T06:48:37.524450+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:55.437085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506817+0000","last_change":"2024-05-30T06:48:33.506817+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506817+0000","last_undegraded":"2024-05-30T06:48:33.506817+0000","last_fullsized":"2024-05-30T06:48:33.506817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505817+0000","last_change":"2024-05-30T06:48:33.505817+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505817+0000","last_undegraded":"2024-05-30T06:48:33.505817+0000","last_fullsized":"2024-05-30T06:48:33.505817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549808+0000","last_change":"2024-05-30T06:48:34.538260+0000","last_active":"2024-05-30T06:48:37.549808+0000","last_peered":"2024-05-30T06:48:37.549808+0000","last_clean":"2024-05-30T06:48:37.549808+0000","last_became_active":"2024-05-30T06:48:34.537965+0000","last_became_peered":"2024-05-30T06:48:34.537965+0000","last_unstale":"2024-05-30T06:48:37.549808+0000","last_undegraded":"2024-05-30T06:48:37.549808+0000","last_fullsized":"2024-05-30T06:48:37.549808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:16:16.602018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549901+0000","last_change":"2024-05-30T06:48:35.556813+0000","last_active":"2024-05-30T06:48:37.549901+0000","last_peered":"2024-05-30T06:48:37.549901+0000","last_clean":"2024-05-30T06:48:37.549901+0000","last_became_active":"2024-05-30T06:48:35.556531+0000","last_became_peered":"2024-05-30T06:48:35.556531+0000","last_unstale":"2024-05-30T06:48:37.549901+0000","last_undegraded":"2024-05-30T06:48:37.549901+0000","last_fullsized":"2024-05-30T06:48:37.549901+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:32:48.803325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.508808+0000","last_change":"2024-05-30T06:48:33.508808+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.508808+0000","last_undegraded":"2024-05-30T06:48:33.508808+0000","last_fullsized":"2024-05-30T06:48:33.508808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549866+0000","last_change":"2024-05-30T06:48:34.534475+0000","last_active":"2024-05-30T06:48:37.549866+0000","last_peered":"2024-05-30T06:48:37.549866+0000","last_clean":"2024-05-30T06:48:37.549866+0000","last_became_active":"2024-05-30T06:48:34.534154+0000","last_became_peered":"2024-05-30T06:48:34.534154+0000","last_unstale":"2024-05-30T06:48:37.549866+0000","last_undegraded":"2024-05-30T06:48:37.549866+0000","last_fullsized":"2024-05-30T06:48:37.549866+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:22:25.698890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549692+0000","last_change":"2024-05-30T06:48:35.556702+0000","last_active":"2024-05-30T06:48:37.549692+0000","last_peered":"2024-05-30T06:48:37.549692+0000","last_clean":"2024-05-30T06:48:37.549692+0000","last_became_active":"2024-05-30T06:48:35.556292+0000","last_became_peered":"2024-05-30T06:48:35.556292+0000","last_unstale":"2024-05-30T06:48:37.549692+0000","last_undegraded":"2024-05-30T06:48:37.549692+0000","last_fullsized":"2024-05-30T06:48:37.549692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:52.408293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506061+0000","last_change":"2024-05-30T06:48:33.506061+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506061+0000","last_undegraded":"2024-05-30T06:48:33.506061+0000","last_fullsized":"2024-05-30T06:48:33.506061+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.509881+0000","last_change":"2024-05-30T06:48:33.509881+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.509881+0000","last_undegraded":"2024-05-30T06:48:33.509881+0000","last_fullsized":"2024-05-30T06:48:33.509881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549360+0000","last_change":"2024-05-30T06:48:35.541178+0000","last_active":"2024-05-30T06:48:37.549360+0000","last_peered":"2024-05-30T06:48:37.549360+0000","last_clean":"2024-05-30T06:48:37.549360+0000","last_became_active":"2024-05-30T06:48:35.540874+0000","last_became_peered":"2024-05-30T06:48:35.540874+0000","last_unstale":"2024-05-30T06:48:37.549360+0000","last_undegraded":"2024-05-30T06:48:37.549360+0000","last_fullsized":"2024-05-30T06:48:37.549360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:00.960494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.512106+0000","last_change":"2024-05-30T06:48:33.512106+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.512106+0000","last_undegraded":"2024-05-30T06:48:33.512106+0000","last_fullsized":"2024-05-30T06:48:33.512106+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506331+0000","last_change":"2024-05-30T06:48:33.506331+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506331+0000","last_undegraded":"2024-05-30T06:48:33.506331+0000","last_fullsized":"2024-05-30T06:48:33.506331+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549386+0000","last_change":"2024-05-30T06:48:35.553758+0000","last_active":"2024-05-30T06:48:37.549386+0000","last_peered":"2024-05-30T06:48:37.549386+0000","last_clean":"2024-05-30T06:48:37.549386+0000","last_became_active":"2024-05-30T06:48:35.553533+0000","last_became_peered":"2024-05-30T06:48:35.553533+0000","last_unstale":"2024-05-30T06:48:37.549386+0000","last_undegraded":"2024-05-30T06:48:37.549386+0000","last_fullsized":"2024-05-30T06:48:37.549386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:36.834202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":22,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549129+0000","last_change":"2024-05-30T06:48:34.531403+0000","last_active":"2024-05-30T06:48:37.549129+0000","last_peered":"2024-05-30T06:48:37.549129+0000","last_clean":"2024-05-30T06:48:37.549129+0000","last_became_active":"2024-05-30T06:48:34.531122+0000","last_became_peered":"2024-05-30T06:48:34.531122+0000","last_unstale":"2024-05-30T06:48:37.549129+0000","last_undegraded":"2024-05-30T06:48:37.549129+0000","last_fullsized":"2024-05-30T06:48:37.549129+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:44:21.380589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549841+0000","last_change":"2024-05-30T06:48:35.549591+0000","last_active":"2024-05-30T06:48:37.549841+0000","last_peered":"2024-05-30T06:48:37.549841+0000","last_clean":"2024-05-30T06:48:37.549841+0000","last_became_active":"2024-05-30T06:48:35.549312+0000","last_became_peered":"2024-05-30T06:48:35.549312+0000","last_unstale":"2024-05-30T06:48:37.549841+0000","last_undegraded":"2024-05-30T06:48:37.549841+0000","last_fullsized":"2024-05-30T06:48:37.549841+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:52.950286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.508839+0000","last_change":"2024-05-30T06:48:33.508839+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.508839+0000","last_undegraded":"2024-05-30T06:48:33.508839+0000","last_fullsized":"2024-05-30T06:48:33.508839+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524998+0000","last_change":"2024-05-30T06:48:34.535017+0000","last_active":"2024-05-30T06:48:37.524998+0000","last_peered":"2024-05-30T06:48:37.524998+0000","last_clean":"2024-05-30T06:48:37.524998+0000","last_became_active":"2024-05-30T06:48:34.534737+0000","last_became_peered":"2024-05-30T06:48:34.534737+0000","last_unstale":"2024-05-30T06:48:37.524998+0000","last_undegraded":"2024-05-30T06:48:37.524998+0000","last_fullsized":"2024-05-30T06:48:37.524998+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:58:44.441246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.507240+0000","last_change":"2024-05-30T06:48:33.507240+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.507240+0000","last_undegraded":"2024-05-30T06:48:33.507240+0000","last_fullsized":"2024-05-30T06:48:33.507240+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549855+0000","last_change":"2024-05-30T06:48:35.557152+0000","last_active":"2024-05-30T06:48:37.549855+0000","last_peered":"2024-05-30T06:48:37.549855+0000","last_clean":"2024-05-30T06:48:37.549855+0000","last_became_active":"2024-05-30T06:48:35.556679+0000","last_became_peered":"2024-05-30T06:48:35.556679+0000","last_unstale":"2024-05-30T06:48:37.549855+0000","last_undegraded":"2024-05-30T06:48:37.549855+0000","last_fullsized":"2024-05-30T06:48:37.549855+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:26:03.358003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524757+0000","last_change":"2024-05-30T06:48:34.532737+0000","last_active":"2024-05-30T06:48:37.524757+0000","last_peered":"2024-05-30T06:48:37.524757+0000","last_clean":"2024-05-30T06:48:37.524757+0000","last_became_active":"2024-05-30T06:48:34.532439+0000","last_became_peered":"2024-05-30T06:48:34.532439+0000","last_unstale":"2024-05-30T06:48:37.524757+0000","last_undegraded":"2024-05-30T06:48:37.524757+0000","last_fullsized":"2024-05-30T06:48:37.524757+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:32:26.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.508602+0000","last_change":"2024-05-30T06:48:33.508602+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.508602+0000","last_undegraded":"2024-05-30T06:48:33.508602+0000","last_fullsized":"2024-05-30T06:48:33.508602+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524835+0000","last_change":"2024-05-30T06:48:35.533392+0000","last_active":"2024-05-30T06:48:37.524835+0000","last_peered":"2024-05-30T06:48:37.524835+0000","last_clean":"2024-05-30T06:48:37.524835+0000","last_became_active":"2024-05-30T06:48:35.533109+0000","last_became_peered":"2024-05-30T06:48:35.533109+0000","last_unstale":"2024-05-30T06:48:37.524835+0000","last_undegraded":"2024-05-30T06:48:37.524835+0000","last_fullsized":"2024-05-30T06:48:37.524835+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:43:16.011353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505083+0000","last_change":"2024-05-30T06:48:33.505083+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505083+0000","last_undegraded":"2024-05-30T06:48:33.505083+0000","last_fullsized":"2024-05-30T06:48:33.505083+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524475+0000","last_change":"2024-05-30T06:48:35.543686+0000","last_active":"2024-05-30T06:48:37.524475+0000","last_peered":"2024-05-30T06:48:37.524475+0000","last_clean":"2024-05-30T06:48:37.524475+0000","last_became_active":"2024-05-30T06:48:35.543395+0000","last_became_peered":"2024-05-30T06:48:35.543395+0000","last_unstale":"2024-05-30T06:48:37.524475+0000","last_undegraded":"2024-05-30T06:48:37.524475+0000","last_fullsized":"2024-05-30T06:48:37.524475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:45:27.303328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505580+0000","last_change":"2024-05-30T06:48:33.505580+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505580+0000","last_undegraded":"2024-05-30T06:48:33.505580+0000","last_fullsized":"2024-05-30T06:48:33.505580+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505018+0000","last_change":"2024-05-30T06:48:33.505018+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505018+0000","last_undegraded":"2024-05-30T06:48:33.505018+0000","last_fullsized":"2024-05-30T06:48:33.505018+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525179+0000","last_change":"2024-05-30T06:48:34.520993+0000","last_active":"2024-05-30T06:48:37.525179+0000","last_peered":"2024-05-30T06:48:37.525179+0000","last_clean":"2024-05-30T06:48:37.525179+0000","last_became_active":"2024-05-30T06:48:34.520714+0000","last_became_peered":"2024-05-30T06:48:34.520714+0000","last_unstale":"2024-05-30T06:48:37.525179+0000","last_undegraded":"2024-05-30T06:48:37.525179+0000","last_fullsized":"2024-05-30T06:48:37.525179+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:59:06.787445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.512527+0000","last_change":"2024-05-30T06:48:33.512527+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.512527+0000","last_undegraded":"2024-05-30T06:48:33.512527+0000","last_fullsized":"2024-05-30T06:48:33.512527+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525135+0000","last_change":"2024-05-30T06:48:35.533608+0000","last_active":"2024-05-30T06:48:37.525135+0000","last_peered":"2024-05-30T06:48:37.525135+0000","last_clean":"2024-05-30T06:48:37.525135+0000","last_became_active":"2024-05-30T06:48:35.531836+0000","last_became_peered":"2024-05-30T06:48:35.531836+0000","last_unstale":"2024-05-30T06:48:37.525135+0000","last_undegraded":"2024-05-30T06:48:37.525135+0000","last_fullsized":"2024-05-30T06:48:37.525135+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:18.217900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.506954+0000","last_change":"2024-05-30T06:48:33.506954+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.506954+0000","last_undegraded":"2024-05-30T06:48:33.506954+0000","last_fullsized":"2024-05-30T06:48:33.506954+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505091+0000","last_change":"2024-05-30T06:48:33.505091+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505091+0000","last_undegraded":"2024-05-30T06:48:33.505091+0000","last_fullsized":"2024-05-30T06:48:33.505091+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549541+0000","last_change":"2024-05-30T06:48:35.550619+0000","last_active":"2024-05-30T06:48:37.549541+0000","last_peered":"2024-05-30T06:48:37.549541+0000","last_clean":"2024-05-30T06:48:37.549541+0000","last_became_active":"2024-05-30T06:48:35.549371+0000","last_became_peered":"2024-05-30T06:48:35.549371+0000","last_unstale":"2024-05-30T06:48:37.549541+0000","last_undegraded":"2024-05-30T06:48:37.549541+0000","last_fullsized":"2024-05-30T06:48:37.549541+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:38.360823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505793+0000","last_change":"2024-05-30T06:48:33.505793+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505793+0000","last_undegraded":"2024-05-30T06:48:33.505793+0000","last_fullsized":"2024-05-30T06:48:33.505793+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.505186+0000","last_change":"2024-05-30T06:48:33.505186+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.505186+0000","last_undegraded":"2024-05-30T06:48:33.505186+0000","last_fullsized":"2024-05-30T06:48:33.505186+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.508603+0000","last_change":"2024-05-30T06:48:33.508603+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.508603+0000","last_undegraded":"2024-05-30T06:48:33.508603+0000","last_fullsized":"2024-05-30T06:48:33.508603+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:48:34.498407+0000","last_change":"2024-05-30T06:48:34.498407+0000","last_active":"2024-05-30T06:48:34.498407+0000","last_peered":"2024-05-30T06:48:34.498407+0000","last_clean":"2024-05-30T06:48:34.498407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:34.498407+0000","last_undegraded":"2024-05-30T06:48:34.498407+0000","last_fullsized":"2024-05-30T06:48:34.498407+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":57,"state":"creating+peering","last_fresh":"2024-05-30T06:48:33.511570+0000","last_change":"2024-05-30T06:48:33.511570+0000","last_active":"2024-05-30T06:48:33.491555+0000","last_peered":"2024-05-30T06:48:33.491555+0000","last_clean":"2024-05-30T06:48:33.491555+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:48:33.511570+0000","last_undegraded":"2024-05-30T06:48:33.511570+0000","last_fullsized":"2024-05-30T06:48:33.511570+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":247,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549151+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:48:37.549151+0000","last_peered":"2024-05-30T06:48:37.549151+0000","last_clean":"2024-05-30T06:48:37.549151+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:48:37.549151+0000","last_undegraded":"2024-05-30T06:48:37.549151+0000","last_fullsized":"2024-05-30T06:48:37.549151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1323008,"data_stored":894837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45712,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326128,"statfs":{"total":96636764160,"available":96589955072,"internally_reserved":0,"allocated":659456,"data_stored":274093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44324,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327516,"statfs":{"total":96636764160,"available":96591376384,"internally_reserved":0,"allocated":671744,"data_stored":279150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45748,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326092,"statfs":{"total":96636764160,"available":96589918208,"internally_reserved":0,"allocated":684032,"data_stored":284967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45724,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326116,"statfs":{"total":96636764160,"available":96589942784,"internally_reserved":0,"allocated":671744,"data_stored":279150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44380,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327460,"statfs":{"total":96636764160,"available":96591319040,"internally_reserved":0,"allocated":729088,"data_stored":304365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45728,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326112,"statfs":{"total":96636764160,"available":96589938688,"internally_reserved":0,"allocated":671744,"data_stored":279150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46368,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325472,"statfs":{"total":96636764160,"available":96589283328,"internally_reserved":0,"allocated":1331200,"data_stored":896871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:48:40.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2024-05-30T06:48:40.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2024-05-30T06:48:40.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2024-05-30T06:48:40.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2024-05-30T06:48:40.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2024-05-30T06:48:40.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2024-05-30T06:48:40.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2024-05-30T06:48:40.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2024-05-30T06:48:40.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2024-05-30T06:48:40.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2024-05-30T06:48:40.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2024-05-30T06:48:40.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2024-05-30T06:48:40.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2024-05-30T06:48:40.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2024-05-30T06:48:40.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2024-05-30T06:48:40.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2024-05-30T06:48:40.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2024-05-30T06:48:40.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2024-05-30T06:48:40.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2024-05-30T06:48:40.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.509852+0000', 'last_change': '2024-05-30T06:48:33.509852+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.509852+0000', 'last_undegraded': '2024-05-30T06:48:33.509852+0000', 'last_fullsized': '2024-05-30T06:48:33.509852+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:48:40.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2024-05-30T06:48:40.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.507406+0000', 'last_change': '2024-05-30T06:48:33.507406+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.507406+0000', 'last_undegraded': '2024-05-30T06:48:33.507406+0000', 'last_fullsized': '2024-05-30T06:48:33.507406+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:48:40.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2024-05-30T06:48:40.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2024-05-30T06:48:40.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.506351+0000', 'last_change': '2024-05-30T06:48:33.506351+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.506351+0000', 'last_undegraded': '2024-05-30T06:48:33.506351+0000', 'last_fullsized': '2024-05-30T06:48:33.506351+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:48:40.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2024-05-30T06:48:40.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2024-05-30T06:48:40.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2024-05-30T06:48:40.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.506817+0000', 'last_change': '2024-05-30T06:48:33.506817+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.506817+0000', 'last_undegraded': '2024-05-30T06:48:33.506817+0000', 'last_fullsized': '2024-05-30T06:48:33.506817+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:48:40.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2024-05-30T06:48:40.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2024-05-30T06:48:40.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.505817+0000', 'last_change': '2024-05-30T06:48:33.505817+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.505817+0000', 'last_undegraded': '2024-05-30T06:48:33.505817+0000', 'last_fullsized': '2024-05-30T06:48:33.505817+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:48:40.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2024-05-30T06:48:40.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2024-05-30T06:48:40.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.508808+0000', 'last_change': '2024-05-30T06:48:33.508808+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.508808+0000', 'last_undegraded': '2024-05-30T06:48:33.508808+0000', 'last_fullsized': '2024-05-30T06:48:33.508808+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:48:40.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2024-05-30T06:48:40.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2024-05-30T06:48:40.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.506061+0000', 'last_change': '2024-05-30T06:48:33.506061+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.506061+0000', 'last_undegraded': '2024-05-30T06:48:33.506061+0000', 'last_fullsized': '2024-05-30T06:48:33.506061+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:48:40.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2024-05-30T06:48:40.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2024-05-30T06:48:40.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.509881+0000', 'last_change': '2024-05-30T06:48:33.509881+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.509881+0000', 'last_undegraded': '2024-05-30T06:48:33.509881+0000', 'last_fullsized': '2024-05-30T06:48:33.509881+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:48:40.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-05-30T06:48:40.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.512106+0000', 'last_change': '2024-05-30T06:48:33.512106+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.512106+0000', 'last_undegraded': '2024-05-30T06:48:33.512106+0000', 'last_fullsized': '2024-05-30T06:48:33.512106+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:48:40.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2024-05-30T06:48:40.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2024-05-30T06:48:40.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.506331+0000', 'last_change': '2024-05-30T06:48:33.506331+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.506331+0000', 'last_undegraded': '2024-05-30T06:48:33.506331+0000', 'last_fullsized': '2024-05-30T06:48:33.506331+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:48:40.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2024-05-30T06:48:40.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.508839+0000', 'last_change': '2024-05-30T06:48:33.508839+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.508839+0000', 'last_undegraded': '2024-05-30T06:48:33.508839+0000', 'last_fullsized': '2024-05-30T06:48:33.508839+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:48:40.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2024-05-30T06:48:40.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2024-05-30T06:48:40.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2024-05-30T06:48:40.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.507240+0000', 'last_change': '2024-05-30T06:48:33.507240+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.507240+0000', 'last_undegraded': '2024-05-30T06:48:33.507240+0000', 'last_fullsized': '2024-05-30T06:48:33.507240+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:48:40.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2024-05-30T06:48:40.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2024-05-30T06:48:40.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.508602+0000', 'last_change': '2024-05-30T06:48:33.508602+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.508602+0000', 'last_undegraded': '2024-05-30T06:48:33.508602+0000', 'last_fullsized': '2024-05-30T06:48:33.508602+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:48:40.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-05-30T06:48:40.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.505083+0000', 'last_change': '2024-05-30T06:48:33.505083+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.505083+0000', 'last_undegraded': '2024-05-30T06:48:33.505083+0000', 'last_fullsized': '2024-05-30T06:48:33.505083+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:48:40.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2024-05-30T06:48:40.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.505580+0000', 'last_change': '2024-05-30T06:48:33.505580+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.505580+0000', 'last_undegraded': '2024-05-30T06:48:33.505580+0000', 'last_fullsized': '2024-05-30T06:48:33.505580+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:48:40.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2024-05-30T06:48:40.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-05-30T06:48:40.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.505018+0000', 'last_change': '2024-05-30T06:48:33.505018+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.505018+0000', 'last_undegraded': '2024-05-30T06:48:33.505018+0000', 'last_fullsized': '2024-05-30T06:48:33.505018+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:48:40.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2024-05-30T06:48:40.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2024-05-30T06:48:40.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-05-30T06:48:40.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.512527+0000', 'last_change': '2024-05-30T06:48:33.512527+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.512527+0000', 'last_undegraded': '2024-05-30T06:48:33.512527+0000', 'last_fullsized': '2024-05-30T06:48:33.512527+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:48:40.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2024-05-30T06:48:40.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.506954+0000', 'last_change': '2024-05-30T06:48:33.506954+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.506954+0000', 'last_undegraded': '2024-05-30T06:48:33.506954+0000', 'last_fullsized': '2024-05-30T06:48:33.506954+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:48:40.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2024-05-30T06:48:40.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-05-30T06:48:40.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.505091+0000', 'last_change': '2024-05-30T06:48:33.505091+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.505091+0000', 'last_undegraded': '2024-05-30T06:48:33.505091+0000', 'last_fullsized': '2024-05-30T06:48:33.505091+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:48:40.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2024-05-30T06:48:40.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.505793+0000', 'last_change': '2024-05-30T06:48:33.505793+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.505793+0000', 'last_undegraded': '2024-05-30T06:48:33.505793+0000', 'last_fullsized': '2024-05-30T06:48:33.505793+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:48:40.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2024-05-30T06:48:40.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-05-30T06:48:40.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.505186+0000', 'last_change': '2024-05-30T06:48:33.505186+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.505186+0000', 'last_undegraded': '2024-05-30T06:48:33.505186+0000', 'last_fullsized': '2024-05-30T06:48:33.505186+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:48:40.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2024-05-30T06:48:40.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2024-05-30T06:48:40.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.508603+0000', 'last_change': '2024-05-30T06:48:33.508603+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.508603+0000', 'last_undegraded': '2024-05-30T06:48:33.508603+0000', 'last_fullsized': '2024-05-30T06:48:33.508603+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:48:40.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2024-05-30T06:48:40.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:48:34.498407+0000', 'last_change': '2024-05-30T06:48:34.498407+0000', 'last_active': '2024-05-30T06:48:34.498407+0000', 'last_peered': '2024-05-30T06:48:34.498407+0000', 'last_clean': '2024-05-30T06:48:34.498407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:34.498407+0000', 'last_undegraded': '2024-05-30T06:48:34.498407+0000', 'last_fullsized': '2024-05-30T06:48:34.498407+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:34.498407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:48:40.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-05-30T06:48:40.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 57, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:48:33.511570+0000', 'last_change': '2024-05-30T06:48:33.511570+0000', 'last_active': '2024-05-30T06:48:33.491555+0000', 'last_peered': '2024-05-30T06:48:33.491555+0000', 'last_clean': '2024-05-30T06:48:33.491555+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:48:33.511570+0000', 'last_undegraded': '2024-05-30T06:48:33.511570+0000', 'last_fullsized': '2024-05-30T06:48:33.511570+0000', 'mapping_epoch': 57, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 57, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'last_clean_scrub_stamp': '2024-05-30T06:48:33.491555+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:48:40.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-30T06:48:40.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.622+0000 7f4201600640 1 Processor -- start 2024-05-30T06:48:40.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.622+0000 7f4201600640 1 -- start start 2024-05-30T06:48:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f4201600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41fc06e000 0x7f41fc0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:40.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f4201600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f41fc15cd80 0x7f41fc0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f4201600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41fc0cd120 con 0x7f41fc0cec40 2024-05-30T06:48:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f4201600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f41fc0a9530 con 0x7f41fc15cd80 2024-05-30T06:48:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f4201600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f41fc0cd400 con 0x7f41fc06e000 2024-05-30T06:48:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f41fb400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f41fc0cec40 0x7f41fc06e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48060/0 (socket says 172.21.15.37:48060) 2024-05-30T06:48:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f41fb400640 1 -- 172.21.15.37:0/254313144 learned_addr learned my addr 172.21.15.37:0/254313144 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f41f3e00640 1 --2- 172.21.15.37:0/254313144 >> v2:172.21.15.105:3300/0 conn(0x7f41fc15cd80 0x7f41fc0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f41faa00640 1 --2- 172.21.15.37:0/254313144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41fc06e000 0x7f41fc0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f41fa000640 1 -- 172.21.15.37:0/254313144 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1028115411 0 0) 0x7f41fc0cd120 con 0x7f41fc0cec40 2024-05-30T06:48:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f41fa000640 1 -- 172.21.15.37:0/254313144 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e0003530 con 0x7f41fc0cec40 2024-05-30T06:48:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f41f3e00640 1 -- 172.21.15.37:0/254313144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41fc06e000 msgr2=0x7f41fc0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f41f3e00640 1 --2- 172.21.15.37:0/254313144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41fc06e000 0x7f41fc0ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f41f3e00640 1 -- 172.21.15.37:0/254313144 >> v1:172.21.15.37:6789/0 conn(0x7f41fc0cec40 legacy=0x7f41fc06e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f41f3e00640 1 -- 172.21.15.37:0/254313144 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc0cd6e0 con 0x7f41fc15cd80 2024-05-30T06:48:40.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.626+0000 7f41faa00640 1 --2- 172.21.15.37:0/254313144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41fc06e000 0x7f41fc0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f41f3e00640 1 --2- 172.21.15.37:0/254313144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41fc15cd80 0x7f41fc0ce700 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f41e40097c0 tx=0x7f41e401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22ac758745feb4e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f41fa000640 1 -- 172.21.15.37:0/254313144 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e40b5070 con 0x7f41fc15cd80 2024-05-30T06:48:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f41fa000640 1 -- 172.21.15.37:0/254313144 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e40a8990 con 0x7f41fc15cd80 2024-05-30T06:48:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f41fa000640 1 -- 172.21.15.37:0/254313144 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e40a8d60 con 0x7f41fc15cd80 2024-05-30T06:48:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f4201600640 1 -- 172.21.15.37:0/254313144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41fc15cd80 msgr2=0x7f41fc0ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f4201600640 1 --2- 172.21.15.37:0/254313144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41fc15cd80 0x7f41fc0ce700 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f41e40097c0 tx=0x7f41e401ec90 comp rx=0 tx=0).stop 2024-05-30T06:48:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f4201600640 1 -- 172.21.15.37:0/254313144 shutdown_connections 2024-05-30T06:48:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f4201600640 1 --2- 172.21.15.37:0/254313144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41fc15cd80 0x7f41fc0ce700 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f4201600640 1 --2- 172.21.15.37:0/254313144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41fc06e000 0x7f41fc0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f4201600640 1 -- 172.21.15.37:0/254313144 >> 172.21.15.37:0/254313144 conn(0x7f41fc0b23a0 msgr2=0x7f41fc0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f4201600640 1 -- 172.21.15.37:0/254313144 shutdown_connections 2024-05-30T06:48:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f4201600640 1 -- 172.21.15.37:0/254313144 wait complete. 2024-05-30T06:48:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f4201600640 1 Processor -- start 2024-05-30T06:48:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.630+0000 7f4201600640 1 -- start start 2024-05-30T06:48:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f4201600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41fc06e000 0x7f41fc15e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f4201600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41fc0cec40 0x7f41fc143b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f4201600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41fc15cd80 0x7f41fc140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f4201600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc0cf0a0 con 0x7f41fc06e000 2024-05-30T06:48:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f4201600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc0cdca0 con 0x7f41fc15cd80 2024-05-30T06:48:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f4201600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f41fc1663c0 con 0x7f41fc0cec40 2024-05-30T06:48:40.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41faa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41fc06e000 0x7f41fc15e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:40.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41faa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41fc06e000 0x7f41fc15e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39312/0 (socket says 172.21.15.37:39312) 2024-05-30T06:48:40.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41faa00640 1 -- 172.21.15.37:0/665943235 learned_addr learned my addr 172.21.15.37:0/665943235 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:40.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41fb400640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41fc15cd80 0x7f41fc140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:40.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41f3e00640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41fc0cec40 0x7f41fc143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:40.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41faa00640 1 -- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41fc0cec40 msgr2=0x7f41fc143b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41faa00640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41fc0cec40 0x7f41fc143b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41faa00640 1 -- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41fc15cd80 msgr2=0x7f41fc140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41faa00640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41fc15cd80 0x7f41fc140e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41faa00640 1 -- 172.21.15.37:0/665943235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc15e960 con 0x7f41fc06e000 2024-05-30T06:48:40.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41faa00640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41fc06e000 0x7f41fc15e380 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f41ec00e980 tx=0x7f41ec00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:40.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41f2a00640 1 -- 172.21.15.37:0/665943235 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ec017070 con 0x7f41fc06e000 2024-05-30T06:48:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41f2a00640 1 -- 172.21.15.37:0/665943235 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ec00ca00 con 0x7f41fc06e000 2024-05-30T06:48:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f41f2a00640 1 -- 172.21.15.37:0/665943235 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ec00cdd0 con 0x7f41fc06e000 2024-05-30T06:48:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f4201600640 1 -- 172.21.15.37:0/665943235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41fc15ec40 con 0x7f41fc06e000 2024-05-30T06:48:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f4201600640 1 -- 172.21.15.37:0/665943235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41fc15f200 con 0x7f41fc06e000 2024-05-30T06:48:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.634+0000 7f4201600640 1 -- 172.21.15.37:0/665943235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41fc068b20 con 0x7f41fc06e000 2024-05-30T06:48:40.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.638+0000 7f41f2a00640 1 -- 172.21.15.37:0/665943235 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f41ec01a070 con 0x7f41fc06e000 2024-05-30T06:48:40.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.638+0000 7f41f2a00640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f41d8068bf0 0x7f41d806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:40.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.638+0000 7f41f2a00640 1 -- 172.21.15.37:0/665943235 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f41ec0879a0 con 0x7f41fc06e000 2024-05-30T06:48:40.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.638+0000 7f41f3e00640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f41d8068bf0 0x7f41d806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:40.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.638+0000 7f41f3e00640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f41d8068bf0 0x7f41d806b0b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f41e40b2000 tx=0x7f41e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:40.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.642+0000 7f41f2a00640 1 -- 172.21.15.37:0/665943235 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f41ec056a80 con 0x7f41fc06e000 2024-05-30T06:48:40.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.866+0000 7f4201600640 1 -- 172.21.15.37:0/665943235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f41fc164ee0 con 0x7f41fc06e000 2024-05-30T06:48:40.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.866+0000 7f41f2a00640 1 -- 172.21.15.37:0/665943235 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1174 (secure 0 0 0) 0x7f41ec05ad80 con 0x7f41fc06e000 2024-05-30T06:48:40.866 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:40.866 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":415,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":60,"num_osds":8,"num_up_osds":8,"osd_up_since":1717051317,"num_in_osds":8,"osd_in_since":1717051308,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":38},{"state_name":"unknown","count":36},{"state_name":"creating+peering","count":23}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":591040,"bytes_used":354607104,"bytes_avail":772739506176,"bytes_total":773094113280,"unknown_pgs_ratio":0.37113401293754578,"inactive_pgs_ratio":0.23711340129375458,"write_bytes_sec":390,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":37,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":6055}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-05-30T06:46:54.717237+0000","services":{}},"progress_events":{}} 2024-05-30T06:48:40.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.866+0000 7f4201600640 1 -- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f41d8068bf0 msgr2=0x7f41d806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.866+0000 7f4201600640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f41d8068bf0 0x7f41d806b0b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f41e40b2000 tx=0x7f41e4008040 comp rx=0 tx=0).stop 2024-05-30T06:48:40.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.866+0000 7f4201600640 1 -- 172.21.15.37:0/665943235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41fc06e000 msgr2=0x7f41fc15e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:40.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.866+0000 7f4201600640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41fc06e000 0x7f41fc15e380 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f41ec00e980 tx=0x7f41ec00ee40 comp rx=0 tx=0).stop 2024-05-30T06:48:40.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.866+0000 7f4201600640 1 -- 172.21.15.37:0/665943235 shutdown_connections 2024-05-30T06:48:40.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.866+0000 7f4201600640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f41d8068bf0 0x7f41d806b0b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.866+0000 7f4201600640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41fc15cd80 0x7f41fc140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.866+0000 7f4201600640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41fc0cec40 0x7f41fc143b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.866+0000 7f4201600640 1 --2- 172.21.15.37:0/665943235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41fc06e000 0x7f41fc15e380 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:40.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.866+0000 7f4201600640 1 -- 172.21.15.37:0/665943235 >> 172.21.15.37:0/665943235 conn(0x7f41fc0b23a0 msgr2=0x7f41fc165400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.870+0000 7f4201600640 1 -- 172.21.15.37:0/665943235 shutdown_connections 2024-05-30T06:48:40.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:40.870+0000 7f4201600640 1 -- 172.21.15.37:0/665943235 wait complete. 2024-05-30T06:48:40.888 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-30T06:48:40.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:48:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7b06400640 1 Processor -- start 2024-05-30T06:48:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7b06400640 1 -- start start 2024-05-30T06:48:41.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7b06400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b000b2e20 0x7f7b00160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:41.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7b06400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7b0009ba70 0x7f7b00160e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:41.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7b06400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b000d0430 con 0x7f7b001609c0 2024-05-30T06:48:41.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7b06400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7b000b3200 con 0x7f7b000b2e20 2024-05-30T06:48:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7b06400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7b000d01e0 con 0x7f7b0009ba70 2024-05-30T06:48:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7aff400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b000b2e20 0x7f7b00160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7af6a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7b001609c0 0x7f7b000cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48076/0 (socket says 172.21.15.37:48076) 2024-05-30T06:48:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7af6a00640 1 -- 172.21.15.37:0/930542419 learned_addr learned my addr 172.21.15.37:0/930542419 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7affe00640 1 --2- 172.21.15.37:0/930542419 >> v2:172.21.15.105:3300/0 conn(0x7f7b0009ba70 0x7f7b00160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:41.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7aff400640 1 -- 172.21.15.37:0/930542419 >> v2:172.21.15.105:3300/0 conn(0x7f7b0009ba70 msgr2=0x7f7b00160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:41.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7aff400640 1 --2- 172.21.15.37:0/930542419 >> v2:172.21.15.105:3300/0 conn(0x7f7b0009ba70 0x7f7b00160e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:41.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7aff400640 1 -- 172.21.15.37:0/930542419 >> v1:172.21.15.37:6789/0 conn(0x7f7b001609c0 legacy=0x7f7b000cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:41.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7aff400640 1 -- 172.21.15.37:0/930542419 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b000d0710 con 0x7f7b000b2e20 2024-05-30T06:48:41.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.030+0000 7f7afea00640 1 -- 172.21.15.37:0/930542419 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671508449 0 0) 0x7f7b000d0430 con 0x7f7b001609c0 2024-05-30T06:48:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.034+0000 7f7aff400640 1 --2- 172.21.15.37:0/930542419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b000b2e20 0x7f7b00160480 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7b000b3cb0 tx=0x7f7af001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbc44433b5b58a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.034+0000 7f7afea00640 1 -- 172.21.15.37:0/930542419 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af00b0070 con 0x7f7b000b2e20 2024-05-30T06:48:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.034+0000 7f7afea00640 1 -- 172.21.15.37:0/930542419 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7af00ab600 con 0x7f7b000b2e20 2024-05-30T06:48:41.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.034+0000 7f7afea00640 1 -- 172.21.15.37:0/930542419 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af00ab9d0 con 0x7f7b000b2e20 2024-05-30T06:48:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.034+0000 7f7b06400640 1 -- 172.21.15.37:0/930542419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b000b2e20 msgr2=0x7f7b00160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.034+0000 7f7b06400640 1 --2- 172.21.15.37:0/930542419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b000b2e20 0x7f7b00160480 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7b000b3cb0 tx=0x7f7af001c480 comp rx=0 tx=0).stop 2024-05-30T06:48:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.034+0000 7f7b06400640 1 -- 172.21.15.37:0/930542419 shutdown_connections 2024-05-30T06:48:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.034+0000 7f7b06400640 1 --2- 172.21.15.37:0/930542419 >> v2:172.21.15.105:3300/0 conn(0x7f7b0009ba70 0x7f7b00160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.034+0000 7f7b06400640 1 --2- 172.21.15.37:0/930542419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b000b2e20 0x7f7b00160480 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.034+0000 7f7b06400640 1 -- 172.21.15.37:0/930542419 >> 172.21.15.37:0/930542419 conn(0x7f7b000b4100 msgr2=0x7f7b000b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.034+0000 7f7b06400640 1 -- 172.21.15.37:0/930542419 shutdown_connections 2024-05-30T06:48:41.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.034+0000 7f7b06400640 1 -- 172.21.15.37:0/930542419 wait complete. 2024-05-30T06:48:41.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.034+0000 7f7b06400640 1 Processor -- start 2024-05-30T06:48:41.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7b06400640 1 -- start start 2024-05-30T06:48:41.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7b06400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b0009ba70 0x7f7b001586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:41.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7b06400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b000b2e20 0x7f7b000c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7b06400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b001609c0 0x7f7b000c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7b06400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7b000ce320 con 0x7f7b001609c0 2024-05-30T06:48:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7b06400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7b000ce1a0 con 0x7f7b000b2e20 2024-05-30T06:48:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7b06400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7b0015c500 con 0x7f7b0009ba70 2024-05-30T06:48:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7affe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b001609c0 0x7f7b000c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7affe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b001609c0 0x7f7b000c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39336/0 (socket says 172.21.15.37:39336) 2024-05-30T06:48:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7affe00640 1 -- 172.21.15.37:0/2822931509 learned_addr learned my addr 172.21.15.37:0/2822931509 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7af6a00640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b000b2e20 0x7f7b000c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7aff400640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b0009ba70 0x7f7b001586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7affe00640 1 -- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b0009ba70 msgr2=0x7f7b001586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7affe00640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b0009ba70 0x7f7b001586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7affe00640 1 -- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b000b2e20 msgr2=0x7f7b000c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:41.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7affe00640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b000b2e20 0x7f7b000c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:41.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7affe00640 1 -- 172.21.15.37:0/2822931509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b00158bf0 con 0x7f7b001609c0 2024-05-30T06:48:41.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7aff400640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b0009ba70 0x7f7b001586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:41.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7af6a00640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b000b2e20 0x7f7b000c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:41.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7affe00640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b001609c0 0x7f7b000c81e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7af8007e60 tx=0x7f7af800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:41.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7af7e00640 1 -- 172.21.15.37:0/2822931509 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af8014420 con 0x7f7b001609c0 2024-05-30T06:48:41.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7af7e00640 1 -- 172.21.15.37:0/2822931509 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7af8019070 con 0x7f7b001609c0 2024-05-30T06:48:41.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7b06400640 1 -- 172.21.15.37:0/2822931509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b0015b980 con 0x7f7b001609c0 2024-05-30T06:48:41.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7af7e00640 1 -- 172.21.15.37:0/2822931509 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af8014820 con 0x7f7b001609c0 2024-05-30T06:48:41.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7b06400640 1 -- 172.21.15.37:0/2822931509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b0015bf40 con 0x7f7b001609c0 2024-05-30T06:48:41.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.038+0000 7f7b06400640 1 -- 172.21.15.37:0/2822931509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b00068b20 con 0x7f7b001609c0 2024-05-30T06:48:41.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.042+0000 7f7af7e00640 1 -- 172.21.15.37:0/2822931509 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f7af80149c0 con 0x7f7b001609c0 2024-05-30T06:48:41.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.042+0000 7f7af7e00640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7adc068bf0 0x7f7adc06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:41.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.042+0000 7f7af7e00640 1 -- 172.21.15.37:0/2822931509 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f7af8085a00 con 0x7f7b001609c0 2024-05-30T06:48:41.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.042+0000 7f7aff400640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7adc068bf0 0x7f7adc06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:41.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.042+0000 7f7aff400640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7adc068bf0 0x7f7adc06b0b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7af00ad000 tx=0x7f7af0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:41.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.046+0000 7f7af7e00640 1 -- 172.21.15.37:0/2822931509 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7af8057a70 con 0x7f7b001609c0 2024-05-30T06:48:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.206+0000 7f7b06400640 1 -- 172.21.15.37:0/2822931509 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b000ce860 con 0x7f7adc068bf0 2024-05-30T06:48:41.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.214+0000 7f7af7e00640 1 -- 172.21.15.37:0/2822931509 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251975 (secure 0 0 0) 0x7f7b000ce860 con 0x7f7adc068bf0 2024-05-30T06:48:41.216 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:41.218 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:48:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.218+0000 7f7b06400640 1 -- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7adc068bf0 msgr2=0x7f7adc06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.218+0000 7f7b06400640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7adc068bf0 0x7f7adc06b0b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7af00ad000 tx=0x7f7af0008040 comp rx=0 tx=0).stop 2024-05-30T06:48:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.218+0000 7f7b06400640 1 -- 172.21.15.37:0/2822931509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b001609c0 msgr2=0x7f7b000c81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.218+0000 7f7b06400640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b001609c0 0x7f7b000c81e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7af8007e60 tx=0x7f7af800e4b0 comp rx=0 tx=0).stop 2024-05-30T06:48:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.218+0000 7f7b06400640 1 -- 172.21.15.37:0/2822931509 shutdown_connections 2024-05-30T06:48:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.218+0000 7f7b06400640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b001609c0 0x7f7b000c81e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.218+0000 7f7b06400640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7adc068bf0 0x7f7adc06b0b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:41.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.218+0000 7f7b06400640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b000b2e20 0x7f7b000c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.218+0000 7f7b06400640 1 --2- 172.21.15.37:0/2822931509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b0009ba70 0x7f7b001586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.218+0000 7f7b06400640 1 -- 172.21.15.37:0/2822931509 >> 172.21.15.37:0/2822931509 conn(0x7f7b000b4100 msgr2=0x7f7b00159830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.218+0000 7f7b06400640 1 -- 172.21.15.37:0/2822931509 shutdown_connections 2024-05-30T06:48:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:41.218+0000 7f7b06400640 1 -- 172.21.15.37:0/2822931509 wait complete. 2024-05-30T06:48:41.237 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-05-30T06:48:40.749047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346560,"kb_used_data":6856,"kb_used_omap":12,"kb_used_meta":339571,"kb_avail":754628160,"statfs":{"total":773094113280,"available":772739235840,"internally_reserved":0,"allocated":7020544,"data_stored":3620028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":347721264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.243169"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543618+0000","last_change":"2024-05-30T06:48:35.544557+0000","last_active":"2024-05-30T06:48:36.543618+0000","last_peered":"2024-05-30T06:48:36.543618+0000","last_clean":"2024-05-30T06:48:36.543618+0000","last_became_active":"2024-05-30T06:48:35.544234+0000","last_became_peered":"2024-05-30T06:48:35.544234+0000","last_unstale":"2024-05-30T06:48:36.543618+0000","last_undegraded":"2024-05-30T06:48:36.543618+0000","last_fullsized":"2024-05-30T06:48:36.543618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:46.614302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541472+0000","last_change":"2024-05-30T06:48:35.552734+0000","last_active":"2024-05-30T06:48:36.541472+0000","last_peered":"2024-05-30T06:48:36.541472+0000","last_clean":"2024-05-30T06:48:36.541472+0000","last_became_active":"2024-05-30T06:48:35.552362+0000","last_became_peered":"2024-05-30T06:48:35.552362+0000","last_unstale":"2024-05-30T06:48:36.541472+0000","last_undegraded":"2024-05-30T06:48:36.541472+0000","last_fullsized":"2024-05-30T06:48:36.541472+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:27:09.822472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549611+0000","last_change":"2024-05-30T06:48:35.548800+0000","last_active":"2024-05-30T06:48:37.549611+0000","last_peered":"2024-05-30T06:48:37.549611+0000","last_clean":"2024-05-30T06:48:37.549611+0000","last_became_active":"2024-05-30T06:48:35.548522+0000","last_became_peered":"2024-05-30T06:48:35.548522+0000","last_unstale":"2024-05-30T06:48:37.549611+0000","last_undegraded":"2024-05-30T06:48:37.549611+0000","last_fullsized":"2024-05-30T06:48:37.549611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:59.526146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543513+0000","last_change":"2024-05-30T06:48:35.529059+0000","last_active":"2024-05-30T06:48:36.543513+0000","last_peered":"2024-05-30T06:48:36.543513+0000","last_clean":"2024-05-30T06:48:36.543513+0000","last_became_active":"2024-05-30T06:48:35.528212+0000","last_became_peered":"2024-05-30T06:48:35.528212+0000","last_unstale":"2024-05-30T06:48:36.543513+0000","last_undegraded":"2024-05-30T06:48:36.543513+0000","last_fullsized":"2024-05-30T06:48:36.543513+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:52.408293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543438+0000","last_change":"2024-05-30T06:48:35.528596+0000","last_active":"2024-05-30T06:48:36.543438+0000","last_peered":"2024-05-30T06:48:36.543438+0000","last_clean":"2024-05-30T06:48:36.543438+0000","last_became_active":"2024-05-30T06:48:35.528270+0000","last_became_peered":"2024-05-30T06:48:35.528270+0000","last_unstale":"2024-05-30T06:48:36.543438+0000","last_undegraded":"2024-05-30T06:48:36.543438+0000","last_fullsized":"2024-05-30T06:48:36.543438+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:24:19.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524493+0000","last_change":"2024-05-30T06:48:35.526635+0000","last_active":"2024-05-30T06:48:37.524493+0000","last_peered":"2024-05-30T06:48:37.524493+0000","last_clean":"2024-05-30T06:48:37.524493+0000","last_became_active":"2024-05-30T06:48:35.526369+0000","last_became_peered":"2024-05-30T06:48:35.526369+0000","last_unstale":"2024-05-30T06:48:37.524493+0000","last_undegraded":"2024-05-30T06:48:37.524493+0000","last_fullsized":"2024-05-30T06:48:37.524493+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:09:16.907885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329455+0000","last_change":"2024-05-30T06:48:35.536677+0000","last_active":"2024-05-30T06:48:37.329455+0000","last_peered":"2024-05-30T06:48:37.329455+0000","last_clean":"2024-05-30T06:48:37.329455+0000","last_became_active":"2024-05-30T06:48:35.536332+0000","last_became_peered":"2024-05-30T06:48:35.536332+0000","last_unstale":"2024-05-30T06:48:37.329455+0000","last_undegraded":"2024-05-30T06:48:37.329455+0000","last_fullsized":"2024-05-30T06:48:37.329455+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:32:50.072518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541268+0000","last_change":"2024-05-30T06:48:35.538846+0000","last_active":"2024-05-30T06:48:36.541268+0000","last_peered":"2024-05-30T06:48:36.541268+0000","last_clean":"2024-05-30T06:48:36.541268+0000","last_became_active":"2024-05-30T06:48:35.538586+0000","last_became_peered":"2024-05-30T06:48:35.538586+0000","last_unstale":"2024-05-30T06:48:36.541268+0000","last_undegraded":"2024-05-30T06:48:36.541268+0000","last_fullsized":"2024-05-30T06:48:36.541268+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:36:42.099922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329914+0000","last_change":"2024-05-30T06:48:35.542255+0000","last_active":"2024-05-30T06:48:37.329914+0000","last_peered":"2024-05-30T06:48:37.329914+0000","last_clean":"2024-05-30T06:48:37.329914+0000","last_became_active":"2024-05-30T06:48:35.541940+0000","last_became_peered":"2024-05-30T06:48:35.541940+0000","last_unstale":"2024-05-30T06:48:37.329914+0000","last_undegraded":"2024-05-30T06:48:37.329914+0000","last_fullsized":"2024-05-30T06:48:37.329914+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:58:45.448098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549607+0000","last_change":"2024-05-30T06:48:35.548728+0000","last_active":"2024-05-30T06:48:37.549607+0000","last_peered":"2024-05-30T06:48:37.549607+0000","last_clean":"2024-05-30T06:48:37.549607+0000","last_became_active":"2024-05-30T06:48:35.538531+0000","last_became_peered":"2024-05-30T06:48:35.538531+0000","last_unstale":"2024-05-30T06:48:37.549607+0000","last_undegraded":"2024-05-30T06:48:37.549607+0000","last_fullsized":"2024-05-30T06:48:37.549607+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:41.172169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549554+0000","last_change":"2024-05-30T06:48:35.548904+0000","last_active":"2024-05-30T06:48:37.549554+0000","last_peered":"2024-05-30T06:48:37.549554+0000","last_clean":"2024-05-30T06:48:37.549554+0000","last_became_active":"2024-05-30T06:48:35.548646+0000","last_became_peered":"2024-05-30T06:48:35.548646+0000","last_unstale":"2024-05-30T06:48:37.549554+0000","last_undegraded":"2024-05-30T06:48:37.549554+0000","last_fullsized":"2024-05-30T06:48:37.549554+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:54:13.808075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543640+0000","last_change":"2024-05-30T06:48:35.543855+0000","last_active":"2024-05-30T06:48:36.543640+0000","last_peered":"2024-05-30T06:48:36.543640+0000","last_clean":"2024-05-30T06:48:36.543640+0000","last_became_active":"2024-05-30T06:48:35.543529+0000","last_became_peered":"2024-05-30T06:48:35.543529+0000","last_unstale":"2024-05-30T06:48:36.543640+0000","last_undegraded":"2024-05-30T06:48:36.543640+0000","last_fullsized":"2024-05-30T06:48:36.543640+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:26:03.358003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.528269+0000","last_change":"2024-05-30T06:48:35.539745+0000","last_active":"2024-05-30T06:48:37.528269+0000","last_peered":"2024-05-30T06:48:37.528269+0000","last_clean":"2024-05-30T06:48:37.528269+0000","last_became_active":"2024-05-30T06:48:35.538185+0000","last_became_peered":"2024-05-30T06:48:35.538185+0000","last_unstale":"2024-05-30T06:48:37.528269+0000","last_undegraded":"2024-05-30T06:48:37.528269+0000","last_fullsized":"2024-05-30T06:48:37.528269+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:22:33.601896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329720+0000","last_change":"2024-05-30T06:48:35.551358+0000","last_active":"2024-05-30T06:48:37.329720+0000","last_peered":"2024-05-30T06:48:37.329720+0000","last_clean":"2024-05-30T06:48:37.329720+0000","last_became_active":"2024-05-30T06:48:35.550793+0000","last_became_peered":"2024-05-30T06:48:35.550793+0000","last_unstale":"2024-05-30T06:48:37.329720+0000","last_undegraded":"2024-05-30T06:48:37.329720+0000","last_fullsized":"2024-05-30T06:48:37.329720+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:32:27.922527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329479+0000","last_change":"2024-05-30T06:48:35.552118+0000","last_active":"2024-05-30T06:48:37.329479+0000","last_peered":"2024-05-30T06:48:37.329479+0000","last_clean":"2024-05-30T06:48:37.329479+0000","last_became_active":"2024-05-30T06:48:35.551846+0000","last_became_peered":"2024-05-30T06:48:35.551846+0000","last_unstale":"2024-05-30T06:48:37.329479+0000","last_undegraded":"2024-05-30T06:48:37.329479+0000","last_fullsized":"2024-05-30T06:48:37.329479+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:56.443938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524548+0000","last_change":"2024-05-30T06:48:35.531935+0000","last_active":"2024-05-30T06:48:37.524548+0000","last_peered":"2024-05-30T06:48:37.524548+0000","last_clean":"2024-05-30T06:48:37.524548+0000","last_became_active":"2024-05-30T06:48:35.531582+0000","last_became_peered":"2024-05-30T06:48:35.531582+0000","last_unstale":"2024-05-30T06:48:37.524548+0000","last_undegraded":"2024-05-30T06:48:37.524548+0000","last_fullsized":"2024-05-30T06:48:37.524548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:59:14.799560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542377+0000","last_change":"2024-05-30T06:48:35.541264+0000","last_active":"2024-05-30T06:48:36.542377+0000","last_peered":"2024-05-30T06:48:36.542377+0000","last_clean":"2024-05-30T06:48:36.542377+0000","last_became_active":"2024-05-30T06:48:35.541001+0000","last_became_peered":"2024-05-30T06:48:35.541001+0000","last_unstale":"2024-05-30T06:48:36.542377+0000","last_undegraded":"2024-05-30T06:48:36.542377+0000","last_fullsized":"2024-05-30T06:48:36.542377+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:18:46.203429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549715+0000","last_change":"2024-05-30T06:48:35.542792+0000","last_active":"2024-05-30T06:48:37.549715+0000","last_peered":"2024-05-30T06:48:37.549715+0000","last_clean":"2024-05-30T06:48:37.549715+0000","last_became_active":"2024-05-30T06:48:35.542518+0000","last_became_peered":"2024-05-30T06:48:35.542518+0000","last_unstale":"2024-05-30T06:48:37.549715+0000","last_undegraded":"2024-05-30T06:48:37.549715+0000","last_fullsized":"2024-05-30T06:48:37.549715+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:07:00.306354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543515+0000","last_change":"2024-05-30T06:48:35.544959+0000","last_active":"2024-05-30T06:48:36.543515+0000","last_peered":"2024-05-30T06:48:36.543515+0000","last_clean":"2024-05-30T06:48:36.543515+0000","last_became_active":"2024-05-30T06:48:35.544728+0000","last_became_peered":"2024-05-30T06:48:35.544728+0000","last_unstale":"2024-05-30T06:48:36.543515+0000","last_undegraded":"2024-05-30T06:48:36.543515+0000","last_fullsized":"2024-05-30T06:48:36.543515+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:14.198830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541736+0000","last_change":"2024-05-30T06:48:35.539923+0000","last_active":"2024-05-30T06:48:36.541736+0000","last_peered":"2024-05-30T06:48:36.541736+0000","last_clean":"2024-05-30T06:48:36.541736+0000","last_became_active":"2024-05-30T06:48:35.539320+0000","last_became_peered":"2024-05-30T06:48:35.539320+0000","last_unstale":"2024-05-30T06:48:36.541736+0000","last_undegraded":"2024-05-30T06:48:36.541736+0000","last_fullsized":"2024-05-30T06:48:36.541736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:37:50.123604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549357+0000","last_change":"2024-05-30T06:48:35.547692+0000","last_active":"2024-05-30T06:48:37.549357+0000","last_peered":"2024-05-30T06:48:37.549357+0000","last_clean":"2024-05-30T06:48:37.549357+0000","last_became_active":"2024-05-30T06:48:35.547405+0000","last_became_peered":"2024-05-30T06:48:35.547405+0000","last_unstale":"2024-05-30T06:48:37.549357+0000","last_undegraded":"2024-05-30T06:48:37.549357+0000","last_fullsized":"2024-05-30T06:48:37.549357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:18.217900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541859+0000","last_change":"2024-05-30T06:48:35.540490+0000","last_active":"2024-05-30T06:48:36.541859+0000","last_peered":"2024-05-30T06:48:36.541859+0000","last_clean":"2024-05-30T06:48:36.541859+0000","last_became_active":"2024-05-30T06:48:35.540310+0000","last_became_peered":"2024-05-30T06:48:35.540310+0000","last_unstale":"2024-05-30T06:48:36.541859+0000","last_undegraded":"2024-05-30T06:48:36.541859+0000","last_fullsized":"2024-05-30T06:48:36.541859+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:47:00.540840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549353+0000","last_change":"2024-05-30T06:48:35.546690+0000","last_active":"2024-05-30T06:48:37.549353+0000","last_peered":"2024-05-30T06:48:37.549353+0000","last_clean":"2024-05-30T06:48:37.549353+0000","last_became_active":"2024-05-30T06:48:35.546259+0000","last_became_peered":"2024-05-30T06:48:35.546259+0000","last_unstale":"2024-05-30T06:48:37.549353+0000","last_undegraded":"2024-05-30T06:48:37.549353+0000","last_fullsized":"2024-05-30T06:48:37.549353+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:29.528851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.528183+0000","last_change":"2024-05-30T06:48:35.533558+0000","last_active":"2024-05-30T06:48:37.528183+0000","last_peered":"2024-05-30T06:48:37.528183+0000","last_clean":"2024-05-30T06:48:37.528183+0000","last_became_active":"2024-05-30T06:48:35.533317+0000","last_became_peered":"2024-05-30T06:48:35.533317+0000","last_unstale":"2024-05-30T06:48:37.528183+0000","last_undegraded":"2024-05-30T06:48:37.528183+0000","last_fullsized":"2024-05-30T06:48:37.528183+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:55:22.146201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543690+0000","last_change":"2024-05-30T06:48:35.547279+0000","last_active":"2024-05-30T06:48:36.543690+0000","last_peered":"2024-05-30T06:48:36.543690+0000","last_clean":"2024-05-30T06:48:36.543690+0000","last_became_active":"2024-05-30T06:48:35.546955+0000","last_became_peered":"2024-05-30T06:48:35.546955+0000","last_unstale":"2024-05-30T06:48:36.543690+0000","last_undegraded":"2024-05-30T06:48:36.543690+0000","last_fullsized":"2024-05-30T06:48:36.543690+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:14:29.873987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543352+0000","last_change":"2024-05-30T06:48:35.536796+0000","last_active":"2024-05-30T06:48:36.543352+0000","last_peered":"2024-05-30T06:48:36.543352+0000","last_clean":"2024-05-30T06:48:36.543352+0000","last_became_active":"2024-05-30T06:48:35.536495+0000","last_became_peered":"2024-05-30T06:48:35.536495+0000","last_unstale":"2024-05-30T06:48:36.543352+0000","last_undegraded":"2024-05-30T06:48:36.543352+0000","last_fullsized":"2024-05-30T06:48:36.543352+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:38.360823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524951+0000","last_change":"2024-05-30T06:48:35.530569+0000","last_active":"2024-05-30T06:48:37.524951+0000","last_peered":"2024-05-30T06:48:37.524951+0000","last_clean":"2024-05-30T06:48:37.524951+0000","last_became_active":"2024-05-30T06:48:35.530270+0000","last_became_peered":"2024-05-30T06:48:35.530270+0000","last_unstale":"2024-05-30T06:48:37.524951+0000","last_undegraded":"2024-05-30T06:48:37.524951+0000","last_fullsized":"2024-05-30T06:48:37.524951+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:24:21.624845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543559+0000","last_change":"2024-05-30T06:48:35.534365+0000","last_active":"2024-05-30T06:48:36.543559+0000","last_peered":"2024-05-30T06:48:36.543559+0000","last_clean":"2024-05-30T06:48:36.543559+0000","last_became_active":"2024-05-30T06:48:35.529711+0000","last_became_peered":"2024-05-30T06:48:35.529711+0000","last_unstale":"2024-05-30T06:48:36.543559+0000","last_undegraded":"2024-05-30T06:48:36.543559+0000","last_fullsized":"2024-05-30T06:48:36.543559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:57:47.611985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542049+0000","last_change":"2024-05-30T06:48:35.533256+0000","last_active":"2024-05-30T06:48:36.542049+0000","last_peered":"2024-05-30T06:48:36.542049+0000","last_clean":"2024-05-30T06:48:36.542049+0000","last_became_active":"2024-05-30T06:48:35.532979+0000","last_became_peered":"2024-05-30T06:48:35.532979+0000","last_unstale":"2024-05-30T06:48:36.542049+0000","last_undegraded":"2024-05-30T06:48:36.542049+0000","last_fullsized":"2024-05-30T06:48:36.542049+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:08:27.002906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549324+0000","last_change":"2024-05-30T06:48:35.548726+0000","last_active":"2024-05-30T06:48:37.549324+0000","last_peered":"2024-05-30T06:48:37.549324+0000","last_clean":"2024-05-30T06:48:37.549324+0000","last_became_active":"2024-05-30T06:48:35.548446+0000","last_became_peered":"2024-05-30T06:48:35.548446+0000","last_unstale":"2024-05-30T06:48:37.549324+0000","last_undegraded":"2024-05-30T06:48:37.549324+0000","last_fullsized":"2024-05-30T06:48:37.549324+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:24:21.624845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543266+0000","last_change":"2024-05-30T06:48:35.532420+0000","last_active":"2024-05-30T06:48:36.543266+0000","last_peered":"2024-05-30T06:48:36.543266+0000","last_clean":"2024-05-30T06:48:36.543266+0000","last_became_active":"2024-05-30T06:48:35.532139+0000","last_became_peered":"2024-05-30T06:48:35.532139+0000","last_unstale":"2024-05-30T06:48:36.543266+0000","last_undegraded":"2024-05-30T06:48:36.543266+0000","last_fullsized":"2024-05-30T06:48:36.543266+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:50:07.910737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524577+0000","last_change":"2024-05-30T06:48:35.527918+0000","last_active":"2024-05-30T06:48:37.524577+0000","last_peered":"2024-05-30T06:48:37.524577+0000","last_clean":"2024-05-30T06:48:37.524577+0000","last_became_active":"2024-05-30T06:48:35.527120+0000","last_became_peered":"2024-05-30T06:48:35.527120+0000","last_unstale":"2024-05-30T06:48:37.524577+0000","last_undegraded":"2024-05-30T06:48:37.524577+0000","last_fullsized":"2024-05-30T06:48:37.524577+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:52:14.951102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525054+0000","last_change":"2024-05-30T06:48:35.544708+0000","last_active":"2024-05-30T06:48:37.525054+0000","last_peered":"2024-05-30T06:48:37.525054+0000","last_clean":"2024-05-30T06:48:37.525054+0000","last_became_active":"2024-05-30T06:48:35.544378+0000","last_became_peered":"2024-05-30T06:48:35.544378+0000","last_unstale":"2024-05-30T06:48:37.525054+0000","last_undegraded":"2024-05-30T06:48:37.525054+0000","last_fullsized":"2024-05-30T06:48:37.525054+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:29.528851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525103+0000","last_change":"2024-05-30T06:48:34.528291+0000","last_active":"2024-05-30T06:48:37.525103+0000","last_peered":"2024-05-30T06:48:37.525103+0000","last_clean":"2024-05-30T06:48:37.525103+0000","last_became_active":"2024-05-30T06:48:34.528020+0000","last_became_peered":"2024-05-30T06:48:34.528020+0000","last_unstale":"2024-05-30T06:48:37.525103+0000","last_undegraded":"2024-05-30T06:48:37.525103+0000","last_fullsized":"2024-05-30T06:48:37.525103+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:02:04.678244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549728+0000","last_change":"2024-05-30T06:48:35.549457+0000","last_active":"2024-05-30T06:48:37.549728+0000","last_peered":"2024-05-30T06:48:37.549728+0000","last_clean":"2024-05-30T06:48:37.549728+0000","last_became_active":"2024-05-30T06:48:35.549088+0000","last_became_peered":"2024-05-30T06:48:35.549088+0000","last_unstale":"2024-05-30T06:48:37.549728+0000","last_undegraded":"2024-05-30T06:48:37.549728+0000","last_fullsized":"2024-05-30T06:48:37.549728+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:15:19.447548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541521+0000","last_change":"2024-05-30T06:48:34.529480+0000","last_active":"2024-05-30T06:48:36.541521+0000","last_peered":"2024-05-30T06:48:36.541521+0000","last_clean":"2024-05-30T06:48:36.541521+0000","last_became_active":"2024-05-30T06:48:34.529163+0000","last_became_peered":"2024-05-30T06:48:34.529163+0000","last_unstale":"2024-05-30T06:48:36.541521+0000","last_undegraded":"2024-05-30T06:48:36.541521+0000","last_fullsized":"2024-05-30T06:48:36.541521+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:37.353971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524841+0000","last_change":"2024-05-30T06:48:35.533213+0000","last_active":"2024-05-30T06:48:37.524841+0000","last_peered":"2024-05-30T06:48:37.524841+0000","last_clean":"2024-05-30T06:48:37.524841+0000","last_became_active":"2024-05-30T06:48:35.531924+0000","last_became_peered":"2024-05-30T06:48:35.531924+0000","last_unstale":"2024-05-30T06:48:37.524841+0000","last_undegraded":"2024-05-30T06:48:37.524841+0000","last_fullsized":"2024-05-30T06:48:37.524841+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:04:54.109208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525062+0000","last_change":"2024-05-30T06:48:34.526188+0000","last_active":"2024-05-30T06:48:37.525062+0000","last_peered":"2024-05-30T06:48:37.525062+0000","last_clean":"2024-05-30T06:48:37.525062+0000","last_became_active":"2024-05-30T06:48:34.525779+0000","last_became_peered":"2024-05-30T06:48:34.525779+0000","last_unstale":"2024-05-30T06:48:37.525062+0000","last_undegraded":"2024-05-30T06:48:37.525062+0000","last_fullsized":"2024-05-30T06:48:37.525062+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:14:21.988526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524963+0000","last_change":"2024-05-30T06:48:35.533901+0000","last_active":"2024-05-30T06:48:37.524963+0000","last_peered":"2024-05-30T06:48:37.524963+0000","last_clean":"2024-05-30T06:48:37.524963+0000","last_became_active":"2024-05-30T06:48:35.533310+0000","last_became_peered":"2024-05-30T06:48:35.533310+0000","last_unstale":"2024-05-30T06:48:37.524963+0000","last_undegraded":"2024-05-30T06:48:37.524963+0000","last_fullsized":"2024-05-30T06:48:37.524963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:00.960494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543599+0000","last_change":"2024-05-30T06:48:34.531117+0000","last_active":"2024-05-30T06:48:36.543599+0000","last_peered":"2024-05-30T06:48:36.543599+0000","last_clean":"2024-05-30T06:48:36.543599+0000","last_became_active":"2024-05-30T06:48:34.530864+0000","last_became_peered":"2024-05-30T06:48:34.530864+0000","last_unstale":"2024-05-30T06:48:36.543599+0000","last_undegraded":"2024-05-30T06:48:36.543599+0000","last_fullsized":"2024-05-30T06:48:36.543599+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:47.840482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542004+0000","last_change":"2024-05-30T06:48:35.540021+0000","last_active":"2024-05-30T06:48:36.542004+0000","last_peered":"2024-05-30T06:48:36.542004+0000","last_clean":"2024-05-30T06:48:36.542004+0000","last_became_active":"2024-05-30T06:48:35.539645+0000","last_became_peered":"2024-05-30T06:48:35.539645+0000","last_unstale":"2024-05-30T06:48:36.542004+0000","last_undegraded":"2024-05-30T06:48:36.542004+0000","last_fullsized":"2024-05-30T06:48:36.542004+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:13:02.483936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329729+0000","last_change":"2024-05-30T06:48:34.533616+0000","last_active":"2024-05-30T06:48:37.329729+0000","last_peered":"2024-05-30T06:48:37.329729+0000","last_clean":"2024-05-30T06:48:37.329729+0000","last_became_active":"2024-05-30T06:48:34.533300+0000","last_became_peered":"2024-05-30T06:48:34.533300+0000","last_unstale":"2024-05-30T06:48:37.329729+0000","last_undegraded":"2024-05-30T06:48:37.329729+0000","last_fullsized":"2024-05-30T06:48:37.329729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:36:01.552106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541831+0000","last_change":"2024-05-30T06:48:35.541228+0000","last_active":"2024-05-30T06:48:36.541831+0000","last_peered":"2024-05-30T06:48:36.541831+0000","last_clean":"2024-05-30T06:48:36.541831+0000","last_became_active":"2024-05-30T06:48:35.540894+0000","last_became_peered":"2024-05-30T06:48:35.540894+0000","last_unstale":"2024-05-30T06:48:36.541831+0000","last_undegraded":"2024-05-30T06:48:36.541831+0000","last_fullsized":"2024-05-30T06:48:36.541831+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:37:15.357519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524450+0000","last_change":"2024-05-30T06:48:34.520117+0000","last_active":"2024-05-30T06:48:37.524450+0000","last_peered":"2024-05-30T06:48:37.524450+0000","last_clean":"2024-05-30T06:48:37.524450+0000","last_became_active":"2024-05-30T06:48:34.519763+0000","last_became_peered":"2024-05-30T06:48:34.519763+0000","last_unstale":"2024-05-30T06:48:37.524450+0000","last_undegraded":"2024-05-30T06:48:37.524450+0000","last_fullsized":"2024-05-30T06:48:37.524450+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:55.437085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.528160+0000","last_change":"2024-05-30T06:48:35.545118+0000","last_active":"2024-05-30T06:48:37.528160+0000","last_peered":"2024-05-30T06:48:37.528160+0000","last_clean":"2024-05-30T06:48:37.528160+0000","last_became_active":"2024-05-30T06:48:35.544306+0000","last_became_peered":"2024-05-30T06:48:35.544306+0000","last_unstale":"2024-05-30T06:48:37.528160+0000","last_undegraded":"2024-05-30T06:48:37.528160+0000","last_fullsized":"2024-05-30T06:48:37.528160+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:24.116315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542874+0000","last_change":"2024-05-30T06:48:34.525107+0000","last_active":"2024-05-30T06:48:36.542874+0000","last_peered":"2024-05-30T06:48:36.542874+0000","last_clean":"2024-05-30T06:48:36.542874+0000","last_became_active":"2024-05-30T06:48:34.524451+0000","last_became_peered":"2024-05-30T06:48:34.524451+0000","last_unstale":"2024-05-30T06:48:36.542874+0000","last_undegraded":"2024-05-30T06:48:36.542874+0000","last_fullsized":"2024-05-30T06:48:36.542874+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:35:26.325634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541491+0000","last_change":"2024-05-30T06:48:35.537769+0000","last_active":"2024-05-30T06:48:36.541491+0000","last_peered":"2024-05-30T06:48:36.541491+0000","last_clean":"2024-05-30T06:48:36.541491+0000","last_became_active":"2024-05-30T06:48:35.537289+0000","last_became_peered":"2024-05-30T06:48:35.537289+0000","last_unstale":"2024-05-30T06:48:36.541491+0000","last_undegraded":"2024-05-30T06:48:36.541491+0000","last_fullsized":"2024-05-30T06:48:36.541491+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:34.904823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329390+0000","last_change":"2024-05-30T06:48:34.533134+0000","last_active":"2024-05-30T06:48:37.329390+0000","last_peered":"2024-05-30T06:48:37.329390+0000","last_clean":"2024-05-30T06:48:37.329390+0000","last_became_active":"2024-05-30T06:48:34.532532+0000","last_became_peered":"2024-05-30T06:48:34.532532+0000","last_unstale":"2024-05-30T06:48:37.329390+0000","last_undegraded":"2024-05-30T06:48:37.329390+0000","last_fullsized":"2024-05-30T06:48:37.329390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:55:21.139349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329914+0000","last_change":"2024-05-30T06:48:35.556990+0000","last_active":"2024-05-30T06:48:37.329914+0000","last_peered":"2024-05-30T06:48:37.329914+0000","last_clean":"2024-05-30T06:48:37.329914+0000","last_became_active":"2024-05-30T06:48:35.556714+0000","last_became_peered":"2024-05-30T06:48:35.556714+0000","last_unstale":"2024-05-30T06:48:37.329914+0000","last_undegraded":"2024-05-30T06:48:37.329914+0000","last_fullsized":"2024-05-30T06:48:37.329914+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:14:22.995378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549808+0000","last_change":"2024-05-30T06:48:34.538260+0000","last_active":"2024-05-30T06:48:37.549808+0000","last_peered":"2024-05-30T06:48:37.549808+0000","last_clean":"2024-05-30T06:48:37.549808+0000","last_became_active":"2024-05-30T06:48:34.537965+0000","last_became_peered":"2024-05-30T06:48:34.537965+0000","last_unstale":"2024-05-30T06:48:37.549808+0000","last_undegraded":"2024-05-30T06:48:37.549808+0000","last_fullsized":"2024-05-30T06:48:37.549808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:16:16.602018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549901+0000","last_change":"2024-05-30T06:48:35.556813+0000","last_active":"2024-05-30T06:48:37.549901+0000","last_peered":"2024-05-30T06:48:37.549901+0000","last_clean":"2024-05-30T06:48:37.549901+0000","last_became_active":"2024-05-30T06:48:35.556531+0000","last_became_peered":"2024-05-30T06:48:35.556531+0000","last_unstale":"2024-05-30T06:48:37.549901+0000","last_undegraded":"2024-05-30T06:48:37.549901+0000","last_fullsized":"2024-05-30T06:48:37.549901+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:32:48.803325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541627+0000","last_change":"2024-05-30T06:48:34.537040+0000","last_active":"2024-05-30T06:48:36.541627+0000","last_peered":"2024-05-30T06:48:36.541627+0000","last_clean":"2024-05-30T06:48:36.541627+0000","last_became_active":"2024-05-30T06:48:34.536761+0000","last_became_peered":"2024-05-30T06:48:34.536761+0000","last_unstale":"2024-05-30T06:48:36.541627+0000","last_undegraded":"2024-05-30T06:48:36.541627+0000","last_fullsized":"2024-05-30T06:48:36.541627+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:58.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549416+0000","last_change":"2024-05-30T06:48:35.549268+0000","last_active":"2024-05-30T06:48:37.549416+0000","last_peered":"2024-05-30T06:48:37.549416+0000","last_clean":"2024-05-30T06:48:37.549416+0000","last_became_active":"2024-05-30T06:48:35.548947+0000","last_became_peered":"2024-05-30T06:48:35.548947+0000","last_unstale":"2024-05-30T06:48:37.549416+0000","last_undegraded":"2024-05-30T06:48:37.549416+0000","last_fullsized":"2024-05-30T06:48:37.549416+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:55:22.146201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549866+0000","last_change":"2024-05-30T06:48:34.534475+0000","last_active":"2024-05-30T06:48:37.549866+0000","last_peered":"2024-05-30T06:48:37.549866+0000","last_clean":"2024-05-30T06:48:37.549866+0000","last_became_active":"2024-05-30T06:48:34.534154+0000","last_became_peered":"2024-05-30T06:48:34.534154+0000","last_unstale":"2024-05-30T06:48:37.549866+0000","last_undegraded":"2024-05-30T06:48:37.549866+0000","last_fullsized":"2024-05-30T06:48:37.549866+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:22:25.698890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549692+0000","last_change":"2024-05-30T06:48:35.556702+0000","last_active":"2024-05-30T06:48:37.549692+0000","last_peered":"2024-05-30T06:48:37.549692+0000","last_clean":"2024-05-30T06:48:37.549692+0000","last_became_active":"2024-05-30T06:48:35.556292+0000","last_became_peered":"2024-05-30T06:48:35.556292+0000","last_unstale":"2024-05-30T06:48:37.549692+0000","last_undegraded":"2024-05-30T06:48:37.549692+0000","last_fullsized":"2024-05-30T06:48:37.549692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:52.408293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":20,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329716+0000","last_change":"2024-05-30T06:48:34.522676+0000","last_active":"2024-05-30T06:48:37.329716+0000","last_peered":"2024-05-30T06:48:37.329716+0000","last_clean":"2024-05-30T06:48:37.329716+0000","last_became_active":"2024-05-30T06:48:34.522383+0000","last_became_peered":"2024-05-30T06:48:34.522383+0000","last_unstale":"2024-05-30T06:48:37.329716+0000","last_undegraded":"2024-05-30T06:48:37.329716+0000","last_fullsized":"2024-05-30T06:48:37.329716+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:58:33.462397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543178+0000","last_change":"2024-05-30T06:48:35.549255+0000","last_active":"2024-05-30T06:48:36.543178+0000","last_peered":"2024-05-30T06:48:36.543178+0000","last_clean":"2024-05-30T06:48:36.543178+0000","last_became_active":"2024-05-30T06:48:35.548976+0000","last_became_peered":"2024-05-30T06:48:35.548976+0000","last_unstale":"2024-05-30T06:48:36.543178+0000","last_undegraded":"2024-05-30T06:48:36.543178+0000","last_fullsized":"2024-05-30T06:48:36.543178+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:36.834202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541881+0000","last_change":"2024-05-30T06:48:34.536974+0000","last_active":"2024-05-30T06:48:36.541881+0000","last_peered":"2024-05-30T06:48:36.541881+0000","last_clean":"2024-05-30T06:48:36.541881+0000","last_became_active":"2024-05-30T06:48:34.536689+0000","last_became_peered":"2024-05-30T06:48:34.536689+0000","last_unstale":"2024-05-30T06:48:36.541881+0000","last_undegraded":"2024-05-30T06:48:36.541881+0000","last_fullsized":"2024-05-30T06:48:36.541881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:17.211048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549360+0000","last_change":"2024-05-30T06:48:35.541178+0000","last_active":"2024-05-30T06:48:37.549360+0000","last_peered":"2024-05-30T06:48:37.549360+0000","last_clean":"2024-05-30T06:48:37.549360+0000","last_became_active":"2024-05-30T06:48:35.540874+0000","last_became_peered":"2024-05-30T06:48:35.540874+0000","last_unstale":"2024-05-30T06:48:37.549360+0000","last_undegraded":"2024-05-30T06:48:37.549360+0000","last_fullsized":"2024-05-30T06:48:37.549360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:00.960494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.527964+0000","last_change":"2024-05-30T06:48:34.530757+0000","last_active":"2024-05-30T06:48:37.527964+0000","last_peered":"2024-05-30T06:48:37.527964+0000","last_clean":"2024-05-30T06:48:37.527964+0000","last_became_active":"2024-05-30T06:48:34.530326+0000","last_became_peered":"2024-05-30T06:48:34.530326+0000","last_unstale":"2024-05-30T06:48:37.527964+0000","last_undegraded":"2024-05-30T06:48:37.527964+0000","last_fullsized":"2024-05-30T06:48:37.527964+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:37:24.981657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329414+0000","last_change":"2024-05-30T06:48:35.545053+0000","last_active":"2024-05-30T06:48:37.329414+0000","last_peered":"2024-05-30T06:48:37.329414+0000","last_clean":"2024-05-30T06:48:37.329414+0000","last_became_active":"2024-05-30T06:48:35.544789+0000","last_became_peered":"2024-05-30T06:48:35.544789+0000","last_unstale":"2024-05-30T06:48:37.329414+0000","last_undegraded":"2024-05-30T06:48:37.329414+0000","last_fullsized":"2024-05-30T06:48:37.329414+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:54:15.806653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542896+0000","last_change":"2024-05-30T06:48:34.529856+0000","last_active":"2024-05-30T06:48:36.542896+0000","last_peered":"2024-05-30T06:48:36.542896+0000","last_clean":"2024-05-30T06:48:36.542896+0000","last_became_active":"2024-05-30T06:48:34.529362+0000","last_became_peered":"2024-05-30T06:48:34.529362+0000","last_unstale":"2024-05-30T06:48:36.542896+0000","last_undegraded":"2024-05-30T06:48:36.542896+0000","last_fullsized":"2024-05-30T06:48:36.542896+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:13:32.793225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549386+0000","last_change":"2024-05-30T06:48:35.553758+0000","last_active":"2024-05-30T06:48:37.549386+0000","last_peered":"2024-05-30T06:48:37.549386+0000","last_clean":"2024-05-30T06:48:37.549386+0000","last_became_active":"2024-05-30T06:48:35.553533+0000","last_became_peered":"2024-05-30T06:48:35.553533+0000","last_unstale":"2024-05-30T06:48:37.549386+0000","last_undegraded":"2024-05-30T06:48:37.549386+0000","last_fullsized":"2024-05-30T06:48:37.549386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:36.834202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":22,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549129+0000","last_change":"2024-05-30T06:48:34.531403+0000","last_active":"2024-05-30T06:48:37.549129+0000","last_peered":"2024-05-30T06:48:37.549129+0000","last_clean":"2024-05-30T06:48:37.549129+0000","last_became_active":"2024-05-30T06:48:34.531122+0000","last_became_peered":"2024-05-30T06:48:34.531122+0000","last_unstale":"2024-05-30T06:48:37.549129+0000","last_undegraded":"2024-05-30T06:48:37.549129+0000","last_fullsized":"2024-05-30T06:48:37.549129+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:44:21.380589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549841+0000","last_change":"2024-05-30T06:48:35.549591+0000","last_active":"2024-05-30T06:48:37.549841+0000","last_peered":"2024-05-30T06:48:37.549841+0000","last_clean":"2024-05-30T06:48:37.549841+0000","last_became_active":"2024-05-30T06:48:35.549312+0000","last_became_peered":"2024-05-30T06:48:35.549312+0000","last_unstale":"2024-05-30T06:48:37.549841+0000","last_undegraded":"2024-05-30T06:48:37.549841+0000","last_fullsized":"2024-05-30T06:48:37.549841+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:52.950286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542420+0000","last_change":"2024-05-30T06:48:34.537092+0000","last_active":"2024-05-30T06:48:36.542420+0000","last_peered":"2024-05-30T06:48:36.542420+0000","last_clean":"2024-05-30T06:48:36.542420+0000","last_became_active":"2024-05-30T06:48:34.536814+0000","last_became_peered":"2024-05-30T06:48:34.536814+0000","last_unstale":"2024-05-30T06:48:36.542420+0000","last_undegraded":"2024-05-30T06:48:36.542420+0000","last_fullsized":"2024-05-30T06:48:36.542420+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:51.401440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543417+0000","last_change":"2024-05-30T06:48:35.551091+0000","last_active":"2024-05-30T06:48:36.543417+0000","last_peered":"2024-05-30T06:48:36.543417+0000","last_clean":"2024-05-30T06:48:36.543417+0000","last_became_active":"2024-05-30T06:48:35.550839+0000","last_became_peered":"2024-05-30T06:48:35.550839+0000","last_unstale":"2024-05-30T06:48:36.543417+0000","last_undegraded":"2024-05-30T06:48:36.543417+0000","last_fullsized":"2024-05-30T06:48:36.543417+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:59.526146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524998+0000","last_change":"2024-05-30T06:48:34.535017+0000","last_active":"2024-05-30T06:48:37.524998+0000","last_peered":"2024-05-30T06:48:37.524998+0000","last_clean":"2024-05-30T06:48:37.524998+0000","last_became_active":"2024-05-30T06:48:34.534737+0000","last_became_peered":"2024-05-30T06:48:34.534737+0000","last_unstale":"2024-05-30T06:48:37.524998+0000","last_undegraded":"2024-05-30T06:48:37.524998+0000","last_fullsized":"2024-05-30T06:48:37.524998+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:58:44.441246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541887+0000","last_change":"2024-05-30T06:48:35.539578+0000","last_active":"2024-05-30T06:48:36.541887+0000","last_peered":"2024-05-30T06:48:36.541887+0000","last_clean":"2024-05-30T06:48:36.541887+0000","last_became_active":"2024-05-30T06:48:35.538947+0000","last_became_peered":"2024-05-30T06:48:35.538947+0000","last_unstale":"2024-05-30T06:48:36.541887+0000","last_undegraded":"2024-05-30T06:48:36.541887+0000","last_fullsized":"2024-05-30T06:48:36.541887+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:54:09.734425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543273+0000","last_change":"2024-05-30T06:48:34.529249+0000","last_active":"2024-05-30T06:48:36.543273+0000","last_peered":"2024-05-30T06:48:36.543273+0000","last_clean":"2024-05-30T06:48:36.543273+0000","last_became_active":"2024-05-30T06:48:34.528932+0000","last_became_peered":"2024-05-30T06:48:34.528932+0000","last_unstale":"2024-05-30T06:48:36.543273+0000","last_undegraded":"2024-05-30T06:48:36.543273+0000","last_fullsized":"2024-05-30T06:48:36.543273+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:44:58.148879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549855+0000","last_change":"2024-05-30T06:48:35.557152+0000","last_active":"2024-05-30T06:48:37.549855+0000","last_peered":"2024-05-30T06:48:37.549855+0000","last_clean":"2024-05-30T06:48:37.549855+0000","last_became_active":"2024-05-30T06:48:35.556679+0000","last_became_peered":"2024-05-30T06:48:35.556679+0000","last_unstale":"2024-05-30T06:48:37.549855+0000","last_undegraded":"2024-05-30T06:48:37.549855+0000","last_fullsized":"2024-05-30T06:48:37.549855+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:26:03.358003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524757+0000","last_change":"2024-05-30T06:48:34.532737+0000","last_active":"2024-05-30T06:48:37.524757+0000","last_peered":"2024-05-30T06:48:37.524757+0000","last_clean":"2024-05-30T06:48:37.524757+0000","last_became_active":"2024-05-30T06:48:34.532439+0000","last_became_peered":"2024-05-30T06:48:34.532439+0000","last_unstale":"2024-05-30T06:48:37.524757+0000","last_undegraded":"2024-05-30T06:48:37.524757+0000","last_fullsized":"2024-05-30T06:48:37.524757+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:32:26.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543100+0000","last_change":"2024-05-30T06:48:35.549138+0000","last_active":"2024-05-30T06:48:36.543100+0000","last_peered":"2024-05-30T06:48:36.543100+0000","last_clean":"2024-05-30T06:48:36.543100+0000","last_became_active":"2024-05-30T06:48:35.548886+0000","last_became_peered":"2024-05-30T06:48:35.548886+0000","last_unstale":"2024-05-30T06:48:36.543100+0000","last_undegraded":"2024-05-30T06:48:36.543100+0000","last_fullsized":"2024-05-30T06:48:36.543100+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:18.217900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542089+0000","last_change":"2024-05-30T06:48:34.513331+0000","last_active":"2024-05-30T06:48:36.542089+0000","last_peered":"2024-05-30T06:48:36.542089+0000","last_clean":"2024-05-30T06:48:36.542089+0000","last_became_active":"2024-05-30T06:48:34.513033+0000","last_became_peered":"2024-05-30T06:48:34.513033+0000","last_unstale":"2024-05-30T06:48:36.542089+0000","last_undegraded":"2024-05-30T06:48:36.542089+0000","last_fullsized":"2024-05-30T06:48:36.542089+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:35.827350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524835+0000","last_change":"2024-05-30T06:48:35.533392+0000","last_active":"2024-05-30T06:48:37.524835+0000","last_peered":"2024-05-30T06:48:37.524835+0000","last_clean":"2024-05-30T06:48:37.524835+0000","last_became_active":"2024-05-30T06:48:35.533109+0000","last_became_peered":"2024-05-30T06:48:35.533109+0000","last_unstale":"2024-05-30T06:48:37.524835+0000","last_undegraded":"2024-05-30T06:48:37.524835+0000","last_fullsized":"2024-05-30T06:48:37.524835+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:43:16.011353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549120+0000","last_change":"2024-05-30T06:48:34.535158+0000","last_active":"2024-05-30T06:48:37.549120+0000","last_peered":"2024-05-30T06:48:37.549120+0000","last_clean":"2024-05-30T06:48:37.549120+0000","last_became_active":"2024-05-30T06:48:34.534878+0000","last_became_peered":"2024-05-30T06:48:34.534878+0000","last_unstale":"2024-05-30T06:48:37.549120+0000","last_undegraded":"2024-05-30T06:48:37.549120+0000","last_fullsized":"2024-05-30T06:48:37.549120+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:28:53.414109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524475+0000","last_change":"2024-05-30T06:48:35.543686+0000","last_active":"2024-05-30T06:48:37.524475+0000","last_peered":"2024-05-30T06:48:37.524475+0000","last_clean":"2024-05-30T06:48:37.524475+0000","last_became_active":"2024-05-30T06:48:35.543395+0000","last_became_peered":"2024-05-30T06:48:35.543395+0000","last_unstale":"2024-05-30T06:48:37.524475+0000","last_undegraded":"2024-05-30T06:48:37.524475+0000","last_fullsized":"2024-05-30T06:48:37.524475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:45:27.303328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542814+0000","last_change":"2024-05-30T06:48:34.531958+0000","last_active":"2024-05-30T06:48:36.542814+0000","last_peered":"2024-05-30T06:48:36.542814+0000","last_clean":"2024-05-30T06:48:36.542814+0000","last_became_active":"2024-05-30T06:48:34.531647+0000","last_became_peered":"2024-05-30T06:48:34.531647+0000","last_unstale":"2024-05-30T06:48:36.542814+0000","last_undegraded":"2024-05-30T06:48:36.542814+0000","last_fullsized":"2024-05-30T06:48:36.542814+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:27:53.896171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543548+0000","last_change":"2024-05-30T06:48:35.526260+0000","last_active":"2024-05-30T06:48:36.543548+0000","last_peered":"2024-05-30T06:48:36.543548+0000","last_clean":"2024-05-30T06:48:36.543548+0000","last_became_active":"2024-05-30T06:48:35.525885+0000","last_became_peered":"2024-05-30T06:48:35.525885+0000","last_unstale":"2024-05-30T06:48:36.543548+0000","last_undegraded":"2024-05-30T06:48:36.543548+0000","last_fullsized":"2024-05-30T06:48:36.543548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:07:00.306354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549664+0000","last_change":"2024-05-30T06:48:34.530784+0000","last_active":"2024-05-30T06:48:37.549664+0000","last_peered":"2024-05-30T06:48:37.549664+0000","last_clean":"2024-05-30T06:48:37.549664+0000","last_became_active":"2024-05-30T06:48:34.530530+0000","last_became_peered":"2024-05-30T06:48:34.530530+0000","last_unstale":"2024-05-30T06:48:37.549664+0000","last_undegraded":"2024-05-30T06:48:37.549664+0000","last_fullsized":"2024-05-30T06:48:37.549664+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:01.688856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543611+0000","last_change":"2024-05-30T06:48:35.544596+0000","last_active":"2024-05-30T06:48:36.543611+0000","last_peered":"2024-05-30T06:48:36.543611+0000","last_clean":"2024-05-30T06:48:36.543611+0000","last_became_active":"2024-05-30T06:48:35.544332+0000","last_became_peered":"2024-05-30T06:48:35.544332+0000","last_unstale":"2024-05-30T06:48:36.543611+0000","last_undegraded":"2024-05-30T06:48:36.543611+0000","last_fullsized":"2024-05-30T06:48:36.543611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:52.950286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525179+0000","last_change":"2024-05-30T06:48:34.520993+0000","last_active":"2024-05-30T06:48:37.525179+0000","last_peered":"2024-05-30T06:48:37.525179+0000","last_clean":"2024-05-30T06:48:37.525179+0000","last_became_active":"2024-05-30T06:48:34.520714+0000","last_became_peered":"2024-05-30T06:48:34.520714+0000","last_unstale":"2024-05-30T06:48:37.525179+0000","last_undegraded":"2024-05-30T06:48:37.525179+0000","last_fullsized":"2024-05-30T06:48:37.525179+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:59:06.787445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549469+0000","last_change":"2024-05-30T06:48:35.543098+0000","last_active":"2024-05-30T06:48:37.549469+0000","last_peered":"2024-05-30T06:48:37.549469+0000","last_clean":"2024-05-30T06:48:37.549469+0000","last_became_active":"2024-05-30T06:48:35.539998+0000","last_became_peered":"2024-05-30T06:48:35.539998+0000","last_unstale":"2024-05-30T06:48:37.549469+0000","last_undegraded":"2024-05-30T06:48:37.549469+0000","last_fullsized":"2024-05-30T06:48:37.549469+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:22:33.601896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.528216+0000","last_change":"2024-05-30T06:48:34.521233+0000","last_active":"2024-05-30T06:48:37.528216+0000","last_peered":"2024-05-30T06:48:37.528216+0000","last_clean":"2024-05-30T06:48:37.528216+0000","last_became_active":"2024-05-30T06:48:34.520926+0000","last_became_peered":"2024-05-30T06:48:34.520926+0000","last_unstale":"2024-05-30T06:48:37.528216+0000","last_undegraded":"2024-05-30T06:48:37.528216+0000","last_fullsized":"2024-05-30T06:48:37.528216+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:56:05.921018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525135+0000","last_change":"2024-05-30T06:48:35.533608+0000","last_active":"2024-05-30T06:48:37.525135+0000","last_peered":"2024-05-30T06:48:37.525135+0000","last_clean":"2024-05-30T06:48:37.525135+0000","last_became_active":"2024-05-30T06:48:35.531836+0000","last_became_peered":"2024-05-30T06:48:35.531836+0000","last_unstale":"2024-05-30T06:48:37.525135+0000","last_undegraded":"2024-05-30T06:48:37.525135+0000","last_fullsized":"2024-05-30T06:48:37.525135+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:18.217900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543694+0000","last_change":"2024-05-30T06:48:34.523593+0000","last_active":"2024-05-30T06:48:36.543694+0000","last_peered":"2024-05-30T06:48:36.543694+0000","last_clean":"2024-05-30T06:48:36.543694+0000","last_became_active":"2024-05-30T06:48:34.523179+0000","last_became_peered":"2024-05-30T06:48:34.523179+0000","last_unstale":"2024-05-30T06:48:36.543694+0000","last_undegraded":"2024-05-30T06:48:36.543694+0000","last_fullsized":"2024-05-30T06:48:36.543694+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:21:24.174780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542135+0000","last_change":"2024-05-30T06:48:35.553884+0000","last_active":"2024-05-30T06:48:36.542135+0000","last_peered":"2024-05-30T06:48:36.542135+0000","last_clean":"2024-05-30T06:48:36.542135+0000","last_became_active":"2024-05-30T06:48:35.552445+0000","last_became_peered":"2024-05-30T06:48:35.552445+0000","last_unstale":"2024-05-30T06:48:36.542135+0000","last_undegraded":"2024-05-30T06:48:36.542135+0000","last_fullsized":"2024-05-30T06:48:36.542135+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:27:04.764869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549062+0000","last_change":"2024-05-30T06:48:34.520491+0000","last_active":"2024-05-30T06:48:37.549062+0000","last_peered":"2024-05-30T06:48:37.549062+0000","last_clean":"2024-05-30T06:48:37.549062+0000","last_became_active":"2024-05-30T06:48:34.519878+0000","last_became_peered":"2024-05-30T06:48:34.519878+0000","last_unstale":"2024-05-30T06:48:37.549062+0000","last_undegraded":"2024-05-30T06:48:37.549062+0000","last_fullsized":"2024-05-30T06:48:37.549062+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:14:50.903639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549541+0000","last_change":"2024-05-30T06:48:35.550619+0000","last_active":"2024-05-30T06:48:37.549541+0000","last_peered":"2024-05-30T06:48:37.549541+0000","last_clean":"2024-05-30T06:48:37.549541+0000","last_became_active":"2024-05-30T06:48:35.549371+0000","last_became_peered":"2024-05-30T06:48:35.549371+0000","last_unstale":"2024-05-30T06:48:37.549541+0000","last_undegraded":"2024-05-30T06:48:37.549541+0000","last_fullsized":"2024-05-30T06:48:37.549541+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:38.360823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329705+0000","last_change":"2024-05-30T06:48:34.522012+0000","last_active":"2024-05-30T06:48:37.329705+0000","last_peered":"2024-05-30T06:48:37.329705+0000","last_clean":"2024-05-30T06:48:37.329705+0000","last_became_active":"2024-05-30T06:48:34.521741+0000","last_became_peered":"2024-05-30T06:48:34.521741+0000","last_unstale":"2024-05-30T06:48:37.329705+0000","last_undegraded":"2024-05-30T06:48:37.329705+0000","last_fullsized":"2024-05-30T06:48:37.329705+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:23.109462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549099+0000","last_change":"2024-05-30T06:48:35.536669+0000","last_active":"2024-05-30T06:48:37.549099+0000","last_peered":"2024-05-30T06:48:37.549099+0000","last_clean":"2024-05-30T06:48:37.549099+0000","last_became_active":"2024-05-30T06:48:35.536368+0000","last_became_peered":"2024-05-30T06:48:35.536368+0000","last_unstale":"2024-05-30T06:48:37.549099+0000","last_undegraded":"2024-05-30T06:48:37.549099+0000","last_fullsized":"2024-05-30T06:48:37.549099+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:24.116315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549188+0000","last_change":"2024-05-30T06:48:34.526043+0000","last_active":"2024-05-30T06:48:37.549188+0000","last_peered":"2024-05-30T06:48:37.549188+0000","last_clean":"2024-05-30T06:48:37.549188+0000","last_became_active":"2024-05-30T06:48:34.525756+0000","last_became_peered":"2024-05-30T06:48:34.525756+0000","last_unstale":"2024-05-30T06:48:37.549188+0000","last_undegraded":"2024-05-30T06:48:37.549188+0000","last_fullsized":"2024-05-30T06:48:37.549188+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:11:52.402980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541627+0000","last_change":"2024-05-30T06:48:35.537546+0000","last_active":"2024-05-30T06:48:36.541627+0000","last_peered":"2024-05-30T06:48:36.541627+0000","last_clean":"2024-05-30T06:48:36.541627+0000","last_became_active":"2024-05-30T06:48:35.536944+0000","last_became_peered":"2024-05-30T06:48:35.536944+0000","last_unstale":"2024-05-30T06:48:36.541627+0000","last_undegraded":"2024-05-30T06:48:36.541627+0000","last_fullsized":"2024-05-30T06:48:36.541627+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:52:19.027874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541456+0000","last_change":"2024-05-30T06:48:34.530397+0000","last_active":"2024-05-30T06:48:36.541456+0000","last_peered":"2024-05-30T06:48:36.541456+0000","last_clean":"2024-05-30T06:48:36.541456+0000","last_became_active":"2024-05-30T06:48:34.527344+0000","last_became_peered":"2024-05-30T06:48:34.527344+0000","last_unstale":"2024-05-30T06:48:36.541456+0000","last_undegraded":"2024-05-30T06:48:36.541456+0000","last_fullsized":"2024-05-30T06:48:36.541456+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:28.521999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541409+0000","last_change":"2024-05-30T06:48:35.537092+0000","last_active":"2024-05-30T06:48:36.541409+0000","last_peered":"2024-05-30T06:48:36.541409+0000","last_clean":"2024-05-30T06:48:36.541409+0000","last_became_active":"2024-05-30T06:48:35.536770+0000","last_became_peered":"2024-05-30T06:48:35.536770+0000","last_unstale":"2024-05-30T06:48:36.541409+0000","last_undegraded":"2024-05-30T06:48:36.541409+0000","last_fullsized":"2024-05-30T06:48:36.541409+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:31:36.618397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.527991+0000","last_change":"2024-05-30T06:48:34.520800+0000","last_active":"2024-05-30T06:48:37.527991+0000","last_peered":"2024-05-30T06:48:37.527991+0000","last_clean":"2024-05-30T06:48:37.527991+0000","last_became_active":"2024-05-30T06:48:34.520551+0000","last_became_peered":"2024-05-30T06:48:34.520551+0000","last_unstale":"2024-05-30T06:48:37.527991+0000","last_undegraded":"2024-05-30T06:48:37.527991+0000","last_fullsized":"2024-05-30T06:48:37.527991+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:17:15.038416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":247,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549151+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:48:37.549151+0000","last_peered":"2024-05-30T06:48:37.549151+0000","last_clean":"2024-05-30T06:48:37.549151+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:48:37.549151+0000","last_undegraded":"2024-05-30T06:48:37.549151+0000","last_fullsized":"2024-05-30T06:48:37.549151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1323008,"data_stored":894837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574932,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45772,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326068,"statfs":{"total":96636764160,"available":96589893632,"internally_reserved":0,"allocated":720896,"data_stored":304309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574932,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44380,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327460,"statfs":{"total":96636764160,"available":96591319040,"internally_reserved":0,"allocated":729088,"data_stored":304961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45784,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326056,"statfs":{"total":96636764160,"available":96589881344,"internally_reserved":0,"allocated":733184,"data_stored":305921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45784,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326056,"statfs":{"total":96636764160,"available":96589881344,"internally_reserved":0,"allocated":729088,"data_stored":304365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44380,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327460,"statfs":{"total":96636764160,"available":96591319040,"internally_reserved":0,"allocated":729088,"data_stored":304365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45780,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326060,"statfs":{"total":96636764160,"available":96589885440,"internally_reserved":0,"allocated":724992,"data_stored":304399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46368,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325472,"statfs":{"total":96636764160,"available":96589283328,"internally_reserved":0,"allocated":1331200,"data_stored":896871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:48:44.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:48:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.394+0000 7f97e1c00640 1 Processor -- start 2024-05-30T06:48:44.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.394+0000 7f97e1c00640 1 -- start start 2024-05-30T06:48:44.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.398+0000 7f97e1c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f97dc06e000 0x7f97dc0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:44.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.398+0000 7f97e1c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97dc15cd80 0x7f97dc0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:44.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.398+0000 7f97e1c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97dc0cd120 con 0x7f97dc0cec40 2024-05-30T06:48:44.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.398+0000 7f97e1c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f97dc0a9530 con 0x7f97dc15cd80 2024-05-30T06:48:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.398+0000 7f97e1c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f97dc0cd400 con 0x7f97dc06e000 2024-05-30T06:48:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.398+0000 7f97d2000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97dc15cd80 0x7f97dc0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.398+0000 7f97d2000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97dc15cd80 0x7f97dc0ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39344/0 (socket says 172.21.15.37:39344) 2024-05-30T06:48:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.398+0000 7f97d2000640 1 -- 172.21.15.37:0/778254852 learned_addr learned my addr 172.21.15.37:0/778254852 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.398+0000 7f97daa00640 1 --2- 172.21.15.37:0/778254852 >> v2:172.21.15.105:3300/0 conn(0x7f97dc06e000 0x7f97dc0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.398+0000 7f97d2000640 1 -- 172.21.15.37:0/778254852 >> v2:172.21.15.105:3300/0 conn(0x7f97dc06e000 msgr2=0x7f97dc0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.398+0000 7f97d2000640 1 --2- 172.21.15.37:0/778254852 >> v2:172.21.15.105:3300/0 conn(0x7f97dc06e000 0x7f97dc0ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.398+0000 7f97d2000640 1 -- 172.21.15.37:0/778254852 >> v1:172.21.15.105:6789/0 conn(0x7f97dc0cec40 legacy=0x7f97dc06e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.398+0000 7f97d2000640 1 -- 172.21.15.37:0/778254852 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97dc0cd6e0 con 0x7f97dc15cd80 2024-05-30T06:48:44.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97d2000640 1 --2- 172.21.15.37:0/778254852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97dc15cd80 0x7f97dc0ce700 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0683c0 tx=0x7f97c401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415c9be8488e12b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:44.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97da000640 1 -- 172.21.15.37:0/778254852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c40b5070 con 0x7f97dc15cd80 2024-05-30T06:48:44.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97da000640 1 -- 172.21.15.37:0/778254852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c40a8a10 con 0x7f97dc15cd80 2024-05-30T06:48:44.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97da000640 1 -- 172.21.15.37:0/778254852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c40a8de0 con 0x7f97dc15cd80 2024-05-30T06:48:44.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 -- 172.21.15.37:0/778254852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97dc15cd80 msgr2=0x7f97dc0ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:44.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 --2- 172.21.15.37:0/778254852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97dc15cd80 0x7f97dc0ce700 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0683c0 tx=0x7f97c401ed10 comp rx=0 tx=0).stop 2024-05-30T06:48:44.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 -- 172.21.15.37:0/778254852 shutdown_connections 2024-05-30T06:48:44.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 --2- 172.21.15.37:0/778254852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97dc15cd80 0x7f97dc0ce700 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 --2- 172.21.15.37:0/778254852 >> v2:172.21.15.105:3300/0 conn(0x7f97dc06e000 0x7f97dc0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 -- 172.21.15.37:0/778254852 >> 172.21.15.37:0/778254852 conn(0x7f97dc0b23a0 msgr2=0x7f97dc0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:44.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 -- 172.21.15.37:0/778254852 shutdown_connections 2024-05-30T06:48:44.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 -- 172.21.15.37:0/778254852 wait complete. 2024-05-30T06:48:44.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 Processor -- start 2024-05-30T06:48:44.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 -- start start 2024-05-30T06:48:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97dc06e000 0x7f97dc15b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97dc0cec40 0x7f97dc13ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97dc15cd80 0x7f97dc15d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc0cf090 con 0x7f97dc0cec40 2024-05-30T06:48:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f97dc0cdca0 con 0x7f97dc06e000 2024-05-30T06:48:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.402+0000 7f97e1c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f97dc1663c0 con 0x7f97dc15cd80 2024-05-30T06:48:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97d2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97dc0cec40 0x7f97dc13ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97d2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97dc0cec40 0x7f97dc13ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39354/0 (socket says 172.21.15.37:39354) 2024-05-30T06:48:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97d2000640 1 -- 172.21.15.37:0/1420938331 learned_addr learned my addr 172.21.15.37:0/1420938331 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97daa00640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97dc06e000 0x7f97dc15b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97db400640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97dc15cd80 0x7f97dc15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97d2000640 1 -- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97dc15cd80 msgr2=0x7f97dc15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97d2000640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97dc15cd80 0x7f97dc15d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97d2000640 1 -- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97dc06e000 msgr2=0x7f97dc15b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97d2000640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97dc06e000 0x7f97dc15b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97d2000640 1 -- 172.21.15.37:0/1420938331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97dc15ba20 con 0x7f97dc0cec40 2024-05-30T06:48:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97d2000640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97dc0cec40 0x7f97dc13ee20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f97c40b3040 tx=0x7f97c401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97d3400640 1 -- 172.21.15.37:0/1420938331 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c40b5070 con 0x7f97dc0cec40 2024-05-30T06:48:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97d3400640 1 -- 172.21.15.37:0/1420938331 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c40b0b40 con 0x7f97dc0cec40 2024-05-30T06:48:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97d3400640 1 -- 172.21.15.37:0/1420938331 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c40bb410 con 0x7f97dc0cec40 2024-05-30T06:48:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97e1c00640 1 -- 172.21.15.37:0/1420938331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97dc164860 con 0x7f97dc0cec40 2024-05-30T06:48:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97e1c00640 1 -- 172.21.15.37:0/1420938331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97dc164e20 con 0x7f97dc0cec40 2024-05-30T06:48:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97e1c00640 1 -- 172.21.15.37:0/1420938331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97dc068b20 con 0x7f97dc0cec40 2024-05-30T06:48:44.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.406+0000 7f97d3400640 1 -- 172.21.15.37:0/1420938331 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f97c40c2060 con 0x7f97dc0cec40 2024-05-30T06:48:44.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.410+0000 7f97d3400640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97b8068bf0 0x7f97b806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:44.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.410+0000 7f97d3400640 1 -- 172.21.15.37:0/1420938331 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f97c4124820 con 0x7f97dc0cec40 2024-05-30T06:48:44.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.410+0000 7f97daa00640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97b8068bf0 0x7f97b806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:44.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.410+0000 7f97daa00640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97b8068bf0 0x7f97b806b0b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f97dc140d20 tx=0x7f97cc009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:44.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.414+0000 7f97d3400640 1 -- 172.21.15.37:0/1420938331 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f97c4018870 con 0x7f97dc0cec40 2024-05-30T06:48:44.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.574+0000 7f97e1c00640 1 -- 172.21.15.37:0/1420938331 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97dc141970 con 0x7f97b8068bf0 2024-05-30T06:48:44.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.582+0000 7f97d3400640 1 -- 172.21.15.37:0/1420938331 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251975 (secure 0 0 0) 0x7f97dc141970 con 0x7f97b8068bf0 2024-05-30T06:48:44.583 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:44.585 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:48:44.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.586+0000 7f97e1c00640 1 -- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97b8068bf0 msgr2=0x7f97b806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:44.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.586+0000 7f97e1c00640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97b8068bf0 0x7f97b806b0b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f97dc140d20 tx=0x7f97cc009830 comp rx=0 tx=0).stop 2024-05-30T06:48:44.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.586+0000 7f97e1c00640 1 -- 172.21.15.37:0/1420938331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97dc0cec40 msgr2=0x7f97dc13ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:44.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.586+0000 7f97e1c00640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97dc0cec40 0x7f97dc13ee20 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f97c40b3040 tx=0x7f97c401bab0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.586+0000 7f97e1c00640 1 -- 172.21.15.37:0/1420938331 shutdown_connections 2024-05-30T06:48:44.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.586+0000 7f97e1c00640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97dc15cd80 0x7f97dc15d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.586+0000 7f97e1c00640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97dc0cec40 0x7f97dc13ee20 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.586+0000 7f97e1c00640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97b8068bf0 0x7f97b806b0b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.586+0000 7f97e1c00640 1 --2- 172.21.15.37:0/1420938331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97dc06e000 0x7f97dc15b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.586+0000 7f97e1c00640 1 -- 172.21.15.37:0/1420938331 >> 172.21.15.37:0/1420938331 conn(0x7f97dc0b23a0 msgr2=0x7f97dc15bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:44.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.586+0000 7f97e1c00640 1 -- 172.21.15.37:0/1420938331 shutdown_connections 2024-05-30T06:48:44.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.586+0000 7f97e1c00640 1 -- 172.21.15.37:0/1420938331 wait complete. 2024-05-30T06:48:44.604 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-05-30T06:48:42.749706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346560,"kb_used_data":6856,"kb_used_omap":12,"kb_used_meta":339571,"kb_avail":754628160,"statfs":{"total":773094113280,"available":772739235840,"internally_reserved":0,"allocated":7020544,"data_stored":3620028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":347721264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002167"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543618+0000","last_change":"2024-05-30T06:48:35.544557+0000","last_active":"2024-05-30T06:48:36.543618+0000","last_peered":"2024-05-30T06:48:36.543618+0000","last_clean":"2024-05-30T06:48:36.543618+0000","last_became_active":"2024-05-30T06:48:35.544234+0000","last_became_peered":"2024-05-30T06:48:35.544234+0000","last_unstale":"2024-05-30T06:48:36.543618+0000","last_undegraded":"2024-05-30T06:48:36.543618+0000","last_fullsized":"2024-05-30T06:48:36.543618+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:46.614302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541472+0000","last_change":"2024-05-30T06:48:35.552734+0000","last_active":"2024-05-30T06:48:36.541472+0000","last_peered":"2024-05-30T06:48:36.541472+0000","last_clean":"2024-05-30T06:48:36.541472+0000","last_became_active":"2024-05-30T06:48:35.552362+0000","last_became_peered":"2024-05-30T06:48:35.552362+0000","last_unstale":"2024-05-30T06:48:36.541472+0000","last_undegraded":"2024-05-30T06:48:36.541472+0000","last_fullsized":"2024-05-30T06:48:36.541472+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:27:09.822472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549611+0000","last_change":"2024-05-30T06:48:35.548800+0000","last_active":"2024-05-30T06:48:37.549611+0000","last_peered":"2024-05-30T06:48:37.549611+0000","last_clean":"2024-05-30T06:48:37.549611+0000","last_became_active":"2024-05-30T06:48:35.548522+0000","last_became_peered":"2024-05-30T06:48:35.548522+0000","last_unstale":"2024-05-30T06:48:37.549611+0000","last_undegraded":"2024-05-30T06:48:37.549611+0000","last_fullsized":"2024-05-30T06:48:37.549611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:59.526146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543513+0000","last_change":"2024-05-30T06:48:35.529059+0000","last_active":"2024-05-30T06:48:36.543513+0000","last_peered":"2024-05-30T06:48:36.543513+0000","last_clean":"2024-05-30T06:48:36.543513+0000","last_became_active":"2024-05-30T06:48:35.528212+0000","last_became_peered":"2024-05-30T06:48:35.528212+0000","last_unstale":"2024-05-30T06:48:36.543513+0000","last_undegraded":"2024-05-30T06:48:36.543513+0000","last_fullsized":"2024-05-30T06:48:36.543513+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:52.408293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543438+0000","last_change":"2024-05-30T06:48:35.528596+0000","last_active":"2024-05-30T06:48:36.543438+0000","last_peered":"2024-05-30T06:48:36.543438+0000","last_clean":"2024-05-30T06:48:36.543438+0000","last_became_active":"2024-05-30T06:48:35.528270+0000","last_became_peered":"2024-05-30T06:48:35.528270+0000","last_unstale":"2024-05-30T06:48:36.543438+0000","last_undegraded":"2024-05-30T06:48:36.543438+0000","last_fullsized":"2024-05-30T06:48:36.543438+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:24:19.213597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524493+0000","last_change":"2024-05-30T06:48:35.526635+0000","last_active":"2024-05-30T06:48:37.524493+0000","last_peered":"2024-05-30T06:48:37.524493+0000","last_clean":"2024-05-30T06:48:37.524493+0000","last_became_active":"2024-05-30T06:48:35.526369+0000","last_became_peered":"2024-05-30T06:48:35.526369+0000","last_unstale":"2024-05-30T06:48:37.524493+0000","last_undegraded":"2024-05-30T06:48:37.524493+0000","last_fullsized":"2024-05-30T06:48:37.524493+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:09:16.907885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329455+0000","last_change":"2024-05-30T06:48:35.536677+0000","last_active":"2024-05-30T06:48:37.329455+0000","last_peered":"2024-05-30T06:48:37.329455+0000","last_clean":"2024-05-30T06:48:37.329455+0000","last_became_active":"2024-05-30T06:48:35.536332+0000","last_became_peered":"2024-05-30T06:48:35.536332+0000","last_unstale":"2024-05-30T06:48:37.329455+0000","last_undegraded":"2024-05-30T06:48:37.329455+0000","last_fullsized":"2024-05-30T06:48:37.329455+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:32:50.072518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541268+0000","last_change":"2024-05-30T06:48:35.538846+0000","last_active":"2024-05-30T06:48:36.541268+0000","last_peered":"2024-05-30T06:48:36.541268+0000","last_clean":"2024-05-30T06:48:36.541268+0000","last_became_active":"2024-05-30T06:48:35.538586+0000","last_became_peered":"2024-05-30T06:48:35.538586+0000","last_unstale":"2024-05-30T06:48:36.541268+0000","last_undegraded":"2024-05-30T06:48:36.541268+0000","last_fullsized":"2024-05-30T06:48:36.541268+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:36:42.099922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329914+0000","last_change":"2024-05-30T06:48:35.542255+0000","last_active":"2024-05-30T06:48:37.329914+0000","last_peered":"2024-05-30T06:48:37.329914+0000","last_clean":"2024-05-30T06:48:37.329914+0000","last_became_active":"2024-05-30T06:48:35.541940+0000","last_became_peered":"2024-05-30T06:48:35.541940+0000","last_unstale":"2024-05-30T06:48:37.329914+0000","last_undegraded":"2024-05-30T06:48:37.329914+0000","last_fullsized":"2024-05-30T06:48:37.329914+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:58:45.448098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549607+0000","last_change":"2024-05-30T06:48:35.548728+0000","last_active":"2024-05-30T06:48:37.549607+0000","last_peered":"2024-05-30T06:48:37.549607+0000","last_clean":"2024-05-30T06:48:37.549607+0000","last_became_active":"2024-05-30T06:48:35.538531+0000","last_became_peered":"2024-05-30T06:48:35.538531+0000","last_unstale":"2024-05-30T06:48:37.549607+0000","last_undegraded":"2024-05-30T06:48:37.549607+0000","last_fullsized":"2024-05-30T06:48:37.549607+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:41.172169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549554+0000","last_change":"2024-05-30T06:48:35.548904+0000","last_active":"2024-05-30T06:48:37.549554+0000","last_peered":"2024-05-30T06:48:37.549554+0000","last_clean":"2024-05-30T06:48:37.549554+0000","last_became_active":"2024-05-30T06:48:35.548646+0000","last_became_peered":"2024-05-30T06:48:35.548646+0000","last_unstale":"2024-05-30T06:48:37.549554+0000","last_undegraded":"2024-05-30T06:48:37.549554+0000","last_fullsized":"2024-05-30T06:48:37.549554+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:54:13.808075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543640+0000","last_change":"2024-05-30T06:48:35.543855+0000","last_active":"2024-05-30T06:48:36.543640+0000","last_peered":"2024-05-30T06:48:36.543640+0000","last_clean":"2024-05-30T06:48:36.543640+0000","last_became_active":"2024-05-30T06:48:35.543529+0000","last_became_peered":"2024-05-30T06:48:35.543529+0000","last_unstale":"2024-05-30T06:48:36.543640+0000","last_undegraded":"2024-05-30T06:48:36.543640+0000","last_fullsized":"2024-05-30T06:48:36.543640+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:26:03.358003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.528269+0000","last_change":"2024-05-30T06:48:35.539745+0000","last_active":"2024-05-30T06:48:37.528269+0000","last_peered":"2024-05-30T06:48:37.528269+0000","last_clean":"2024-05-30T06:48:37.528269+0000","last_became_active":"2024-05-30T06:48:35.538185+0000","last_became_peered":"2024-05-30T06:48:35.538185+0000","last_unstale":"2024-05-30T06:48:37.528269+0000","last_undegraded":"2024-05-30T06:48:37.528269+0000","last_fullsized":"2024-05-30T06:48:37.528269+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:22:33.601896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329720+0000","last_change":"2024-05-30T06:48:35.551358+0000","last_active":"2024-05-30T06:48:37.329720+0000","last_peered":"2024-05-30T06:48:37.329720+0000","last_clean":"2024-05-30T06:48:37.329720+0000","last_became_active":"2024-05-30T06:48:35.550793+0000","last_became_peered":"2024-05-30T06:48:35.550793+0000","last_unstale":"2024-05-30T06:48:37.329720+0000","last_undegraded":"2024-05-30T06:48:37.329720+0000","last_fullsized":"2024-05-30T06:48:37.329720+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:32:27.922527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329479+0000","last_change":"2024-05-30T06:48:35.552118+0000","last_active":"2024-05-30T06:48:37.329479+0000","last_peered":"2024-05-30T06:48:37.329479+0000","last_clean":"2024-05-30T06:48:37.329479+0000","last_became_active":"2024-05-30T06:48:35.551846+0000","last_became_peered":"2024-05-30T06:48:35.551846+0000","last_unstale":"2024-05-30T06:48:37.329479+0000","last_undegraded":"2024-05-30T06:48:37.329479+0000","last_fullsized":"2024-05-30T06:48:37.329479+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:56.443938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524548+0000","last_change":"2024-05-30T06:48:35.531935+0000","last_active":"2024-05-30T06:48:37.524548+0000","last_peered":"2024-05-30T06:48:37.524548+0000","last_clean":"2024-05-30T06:48:37.524548+0000","last_became_active":"2024-05-30T06:48:35.531582+0000","last_became_peered":"2024-05-30T06:48:35.531582+0000","last_unstale":"2024-05-30T06:48:37.524548+0000","last_undegraded":"2024-05-30T06:48:37.524548+0000","last_fullsized":"2024-05-30T06:48:37.524548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:59:14.799560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542377+0000","last_change":"2024-05-30T06:48:35.541264+0000","last_active":"2024-05-30T06:48:36.542377+0000","last_peered":"2024-05-30T06:48:36.542377+0000","last_clean":"2024-05-30T06:48:36.542377+0000","last_became_active":"2024-05-30T06:48:35.541001+0000","last_became_peered":"2024-05-30T06:48:35.541001+0000","last_unstale":"2024-05-30T06:48:36.542377+0000","last_undegraded":"2024-05-30T06:48:36.542377+0000","last_fullsized":"2024-05-30T06:48:36.542377+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:18:46.203429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549715+0000","last_change":"2024-05-30T06:48:35.542792+0000","last_active":"2024-05-30T06:48:37.549715+0000","last_peered":"2024-05-30T06:48:37.549715+0000","last_clean":"2024-05-30T06:48:37.549715+0000","last_became_active":"2024-05-30T06:48:35.542518+0000","last_became_peered":"2024-05-30T06:48:35.542518+0000","last_unstale":"2024-05-30T06:48:37.549715+0000","last_undegraded":"2024-05-30T06:48:37.549715+0000","last_fullsized":"2024-05-30T06:48:37.549715+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:07:00.306354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543515+0000","last_change":"2024-05-30T06:48:35.544959+0000","last_active":"2024-05-30T06:48:36.543515+0000","last_peered":"2024-05-30T06:48:36.543515+0000","last_clean":"2024-05-30T06:48:36.543515+0000","last_became_active":"2024-05-30T06:48:35.544728+0000","last_became_peered":"2024-05-30T06:48:35.544728+0000","last_unstale":"2024-05-30T06:48:36.543515+0000","last_undegraded":"2024-05-30T06:48:36.543515+0000","last_fullsized":"2024-05-30T06:48:36.543515+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:11:14.198830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541736+0000","last_change":"2024-05-30T06:48:35.539923+0000","last_active":"2024-05-30T06:48:36.541736+0000","last_peered":"2024-05-30T06:48:36.541736+0000","last_clean":"2024-05-30T06:48:36.541736+0000","last_became_active":"2024-05-30T06:48:35.539320+0000","last_became_peered":"2024-05-30T06:48:35.539320+0000","last_unstale":"2024-05-30T06:48:36.541736+0000","last_undegraded":"2024-05-30T06:48:36.541736+0000","last_fullsized":"2024-05-30T06:48:36.541736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:37:50.123604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549357+0000","last_change":"2024-05-30T06:48:35.547692+0000","last_active":"2024-05-30T06:48:37.549357+0000","last_peered":"2024-05-30T06:48:37.549357+0000","last_clean":"2024-05-30T06:48:37.549357+0000","last_became_active":"2024-05-30T06:48:35.547405+0000","last_became_peered":"2024-05-30T06:48:35.547405+0000","last_unstale":"2024-05-30T06:48:37.549357+0000","last_undegraded":"2024-05-30T06:48:37.549357+0000","last_fullsized":"2024-05-30T06:48:37.549357+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:18.217900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541859+0000","last_change":"2024-05-30T06:48:35.540490+0000","last_active":"2024-05-30T06:48:36.541859+0000","last_peered":"2024-05-30T06:48:36.541859+0000","last_clean":"2024-05-30T06:48:36.541859+0000","last_became_active":"2024-05-30T06:48:35.540310+0000","last_became_peered":"2024-05-30T06:48:35.540310+0000","last_unstale":"2024-05-30T06:48:36.541859+0000","last_undegraded":"2024-05-30T06:48:36.541859+0000","last_fullsized":"2024-05-30T06:48:36.541859+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:47:00.540840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549353+0000","last_change":"2024-05-30T06:48:35.546690+0000","last_active":"2024-05-30T06:48:37.549353+0000","last_peered":"2024-05-30T06:48:37.549353+0000","last_clean":"2024-05-30T06:48:37.549353+0000","last_became_active":"2024-05-30T06:48:35.546259+0000","last_became_peered":"2024-05-30T06:48:35.546259+0000","last_unstale":"2024-05-30T06:48:37.549353+0000","last_undegraded":"2024-05-30T06:48:37.549353+0000","last_fullsized":"2024-05-30T06:48:37.549353+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:29.528851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.528183+0000","last_change":"2024-05-30T06:48:35.533558+0000","last_active":"2024-05-30T06:48:37.528183+0000","last_peered":"2024-05-30T06:48:37.528183+0000","last_clean":"2024-05-30T06:48:37.528183+0000","last_became_active":"2024-05-30T06:48:35.533317+0000","last_became_peered":"2024-05-30T06:48:35.533317+0000","last_unstale":"2024-05-30T06:48:37.528183+0000","last_undegraded":"2024-05-30T06:48:37.528183+0000","last_fullsized":"2024-05-30T06:48:37.528183+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:55:22.146201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543690+0000","last_change":"2024-05-30T06:48:35.547279+0000","last_active":"2024-05-30T06:48:36.543690+0000","last_peered":"2024-05-30T06:48:36.543690+0000","last_clean":"2024-05-30T06:48:36.543690+0000","last_became_active":"2024-05-30T06:48:35.546955+0000","last_became_peered":"2024-05-30T06:48:35.546955+0000","last_unstale":"2024-05-30T06:48:36.543690+0000","last_undegraded":"2024-05-30T06:48:36.543690+0000","last_fullsized":"2024-05-30T06:48:36.543690+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:14:29.873987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543352+0000","last_change":"2024-05-30T06:48:35.536796+0000","last_active":"2024-05-30T06:48:36.543352+0000","last_peered":"2024-05-30T06:48:36.543352+0000","last_clean":"2024-05-30T06:48:36.543352+0000","last_became_active":"2024-05-30T06:48:35.536495+0000","last_became_peered":"2024-05-30T06:48:35.536495+0000","last_unstale":"2024-05-30T06:48:36.543352+0000","last_undegraded":"2024-05-30T06:48:36.543352+0000","last_fullsized":"2024-05-30T06:48:36.543352+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:38.360823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524951+0000","last_change":"2024-05-30T06:48:35.530569+0000","last_active":"2024-05-30T06:48:37.524951+0000","last_peered":"2024-05-30T06:48:37.524951+0000","last_clean":"2024-05-30T06:48:37.524951+0000","last_became_active":"2024-05-30T06:48:35.530270+0000","last_became_peered":"2024-05-30T06:48:35.530270+0000","last_unstale":"2024-05-30T06:48:37.524951+0000","last_undegraded":"2024-05-30T06:48:37.524951+0000","last_fullsized":"2024-05-30T06:48:37.524951+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:24:21.624845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543559+0000","last_change":"2024-05-30T06:48:35.534365+0000","last_active":"2024-05-30T06:48:36.543559+0000","last_peered":"2024-05-30T06:48:36.543559+0000","last_clean":"2024-05-30T06:48:36.543559+0000","last_became_active":"2024-05-30T06:48:35.529711+0000","last_became_peered":"2024-05-30T06:48:35.529711+0000","last_unstale":"2024-05-30T06:48:36.543559+0000","last_undegraded":"2024-05-30T06:48:36.543559+0000","last_fullsized":"2024-05-30T06:48:36.543559+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:57:47.611985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542049+0000","last_change":"2024-05-30T06:48:35.533256+0000","last_active":"2024-05-30T06:48:36.542049+0000","last_peered":"2024-05-30T06:48:36.542049+0000","last_clean":"2024-05-30T06:48:36.542049+0000","last_became_active":"2024-05-30T06:48:35.532979+0000","last_became_peered":"2024-05-30T06:48:35.532979+0000","last_unstale":"2024-05-30T06:48:36.542049+0000","last_undegraded":"2024-05-30T06:48:36.542049+0000","last_fullsized":"2024-05-30T06:48:36.542049+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:08:27.002906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549324+0000","last_change":"2024-05-30T06:48:35.548726+0000","last_active":"2024-05-30T06:48:37.549324+0000","last_peered":"2024-05-30T06:48:37.549324+0000","last_clean":"2024-05-30T06:48:37.549324+0000","last_became_active":"2024-05-30T06:48:35.548446+0000","last_became_peered":"2024-05-30T06:48:35.548446+0000","last_unstale":"2024-05-30T06:48:37.549324+0000","last_undegraded":"2024-05-30T06:48:37.549324+0000","last_fullsized":"2024-05-30T06:48:37.549324+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:24:21.624845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543266+0000","last_change":"2024-05-30T06:48:35.532420+0000","last_active":"2024-05-30T06:48:36.543266+0000","last_peered":"2024-05-30T06:48:36.543266+0000","last_clean":"2024-05-30T06:48:36.543266+0000","last_became_active":"2024-05-30T06:48:35.532139+0000","last_became_peered":"2024-05-30T06:48:35.532139+0000","last_unstale":"2024-05-30T06:48:36.543266+0000","last_undegraded":"2024-05-30T06:48:36.543266+0000","last_fullsized":"2024-05-30T06:48:36.543266+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:50:07.910737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524577+0000","last_change":"2024-05-30T06:48:35.527918+0000","last_active":"2024-05-30T06:48:37.524577+0000","last_peered":"2024-05-30T06:48:37.524577+0000","last_clean":"2024-05-30T06:48:37.524577+0000","last_became_active":"2024-05-30T06:48:35.527120+0000","last_became_peered":"2024-05-30T06:48:35.527120+0000","last_unstale":"2024-05-30T06:48:37.524577+0000","last_undegraded":"2024-05-30T06:48:37.524577+0000","last_fullsized":"2024-05-30T06:48:37.524577+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:52:14.951102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525054+0000","last_change":"2024-05-30T06:48:35.544708+0000","last_active":"2024-05-30T06:48:37.525054+0000","last_peered":"2024-05-30T06:48:37.525054+0000","last_clean":"2024-05-30T06:48:37.525054+0000","last_became_active":"2024-05-30T06:48:35.544378+0000","last_became_peered":"2024-05-30T06:48:35.544378+0000","last_unstale":"2024-05-30T06:48:37.525054+0000","last_undegraded":"2024-05-30T06:48:37.525054+0000","last_fullsized":"2024-05-30T06:48:37.525054+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:29.528851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525103+0000","last_change":"2024-05-30T06:48:34.528291+0000","last_active":"2024-05-30T06:48:37.525103+0000","last_peered":"2024-05-30T06:48:37.525103+0000","last_clean":"2024-05-30T06:48:37.525103+0000","last_became_active":"2024-05-30T06:48:34.528020+0000","last_became_peered":"2024-05-30T06:48:34.528020+0000","last_unstale":"2024-05-30T06:48:37.525103+0000","last_undegraded":"2024-05-30T06:48:37.525103+0000","last_fullsized":"2024-05-30T06:48:37.525103+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:02:04.678244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549728+0000","last_change":"2024-05-30T06:48:35.549457+0000","last_active":"2024-05-30T06:48:37.549728+0000","last_peered":"2024-05-30T06:48:37.549728+0000","last_clean":"2024-05-30T06:48:37.549728+0000","last_became_active":"2024-05-30T06:48:35.549088+0000","last_became_peered":"2024-05-30T06:48:35.549088+0000","last_unstale":"2024-05-30T06:48:37.549728+0000","last_undegraded":"2024-05-30T06:48:37.549728+0000","last_fullsized":"2024-05-30T06:48:37.549728+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:15:19.447548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541521+0000","last_change":"2024-05-30T06:48:34.529480+0000","last_active":"2024-05-30T06:48:36.541521+0000","last_peered":"2024-05-30T06:48:36.541521+0000","last_clean":"2024-05-30T06:48:36.541521+0000","last_became_active":"2024-05-30T06:48:34.529163+0000","last_became_peered":"2024-05-30T06:48:34.529163+0000","last_unstale":"2024-05-30T06:48:36.541521+0000","last_undegraded":"2024-05-30T06:48:36.541521+0000","last_fullsized":"2024-05-30T06:48:36.541521+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:37.353971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524841+0000","last_change":"2024-05-30T06:48:35.533213+0000","last_active":"2024-05-30T06:48:37.524841+0000","last_peered":"2024-05-30T06:48:37.524841+0000","last_clean":"2024-05-30T06:48:37.524841+0000","last_became_active":"2024-05-30T06:48:35.531924+0000","last_became_peered":"2024-05-30T06:48:35.531924+0000","last_unstale":"2024-05-30T06:48:37.524841+0000","last_undegraded":"2024-05-30T06:48:37.524841+0000","last_fullsized":"2024-05-30T06:48:37.524841+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:04:54.109208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525062+0000","last_change":"2024-05-30T06:48:34.526188+0000","last_active":"2024-05-30T06:48:37.525062+0000","last_peered":"2024-05-30T06:48:37.525062+0000","last_clean":"2024-05-30T06:48:37.525062+0000","last_became_active":"2024-05-30T06:48:34.525779+0000","last_became_peered":"2024-05-30T06:48:34.525779+0000","last_unstale":"2024-05-30T06:48:37.525062+0000","last_undegraded":"2024-05-30T06:48:37.525062+0000","last_fullsized":"2024-05-30T06:48:37.525062+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:14:21.988526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524963+0000","last_change":"2024-05-30T06:48:35.533901+0000","last_active":"2024-05-30T06:48:37.524963+0000","last_peered":"2024-05-30T06:48:37.524963+0000","last_clean":"2024-05-30T06:48:37.524963+0000","last_became_active":"2024-05-30T06:48:35.533310+0000","last_became_peered":"2024-05-30T06:48:35.533310+0000","last_unstale":"2024-05-30T06:48:37.524963+0000","last_undegraded":"2024-05-30T06:48:37.524963+0000","last_fullsized":"2024-05-30T06:48:37.524963+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:00.960494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543599+0000","last_change":"2024-05-30T06:48:34.531117+0000","last_active":"2024-05-30T06:48:36.543599+0000","last_peered":"2024-05-30T06:48:36.543599+0000","last_clean":"2024-05-30T06:48:36.543599+0000","last_became_active":"2024-05-30T06:48:34.530864+0000","last_became_peered":"2024-05-30T06:48:34.530864+0000","last_unstale":"2024-05-30T06:48:36.543599+0000","last_undegraded":"2024-05-30T06:48:36.543599+0000","last_fullsized":"2024-05-30T06:48:36.543599+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:47.840482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542004+0000","last_change":"2024-05-30T06:48:35.540021+0000","last_active":"2024-05-30T06:48:36.542004+0000","last_peered":"2024-05-30T06:48:36.542004+0000","last_clean":"2024-05-30T06:48:36.542004+0000","last_became_active":"2024-05-30T06:48:35.539645+0000","last_became_peered":"2024-05-30T06:48:35.539645+0000","last_unstale":"2024-05-30T06:48:36.542004+0000","last_undegraded":"2024-05-30T06:48:36.542004+0000","last_fullsized":"2024-05-30T06:48:36.542004+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:13:02.483936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329729+0000","last_change":"2024-05-30T06:48:34.533616+0000","last_active":"2024-05-30T06:48:37.329729+0000","last_peered":"2024-05-30T06:48:37.329729+0000","last_clean":"2024-05-30T06:48:37.329729+0000","last_became_active":"2024-05-30T06:48:34.533300+0000","last_became_peered":"2024-05-30T06:48:34.533300+0000","last_unstale":"2024-05-30T06:48:37.329729+0000","last_undegraded":"2024-05-30T06:48:37.329729+0000","last_fullsized":"2024-05-30T06:48:37.329729+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:36:01.552106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541831+0000","last_change":"2024-05-30T06:48:35.541228+0000","last_active":"2024-05-30T06:48:36.541831+0000","last_peered":"2024-05-30T06:48:36.541831+0000","last_clean":"2024-05-30T06:48:36.541831+0000","last_became_active":"2024-05-30T06:48:35.540894+0000","last_became_peered":"2024-05-30T06:48:35.540894+0000","last_unstale":"2024-05-30T06:48:36.541831+0000","last_undegraded":"2024-05-30T06:48:36.541831+0000","last_fullsized":"2024-05-30T06:48:36.541831+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:37:15.357519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524450+0000","last_change":"2024-05-30T06:48:34.520117+0000","last_active":"2024-05-30T06:48:37.524450+0000","last_peered":"2024-05-30T06:48:37.524450+0000","last_clean":"2024-05-30T06:48:37.524450+0000","last_became_active":"2024-05-30T06:48:34.519763+0000","last_became_peered":"2024-05-30T06:48:34.519763+0000","last_unstale":"2024-05-30T06:48:37.524450+0000","last_undegraded":"2024-05-30T06:48:37.524450+0000","last_fullsized":"2024-05-30T06:48:37.524450+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:55.437085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.528160+0000","last_change":"2024-05-30T06:48:35.545118+0000","last_active":"2024-05-30T06:48:37.528160+0000","last_peered":"2024-05-30T06:48:37.528160+0000","last_clean":"2024-05-30T06:48:37.528160+0000","last_became_active":"2024-05-30T06:48:35.544306+0000","last_became_peered":"2024-05-30T06:48:35.544306+0000","last_unstale":"2024-05-30T06:48:37.528160+0000","last_undegraded":"2024-05-30T06:48:37.528160+0000","last_fullsized":"2024-05-30T06:48:37.528160+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:24.116315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542874+0000","last_change":"2024-05-30T06:48:34.525107+0000","last_active":"2024-05-30T06:48:36.542874+0000","last_peered":"2024-05-30T06:48:36.542874+0000","last_clean":"2024-05-30T06:48:36.542874+0000","last_became_active":"2024-05-30T06:48:34.524451+0000","last_became_peered":"2024-05-30T06:48:34.524451+0000","last_unstale":"2024-05-30T06:48:36.542874+0000","last_undegraded":"2024-05-30T06:48:36.542874+0000","last_fullsized":"2024-05-30T06:48:36.542874+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:35:26.325634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541491+0000","last_change":"2024-05-30T06:48:35.537769+0000","last_active":"2024-05-30T06:48:36.541491+0000","last_peered":"2024-05-30T06:48:36.541491+0000","last_clean":"2024-05-30T06:48:36.541491+0000","last_became_active":"2024-05-30T06:48:35.537289+0000","last_became_peered":"2024-05-30T06:48:35.537289+0000","last_unstale":"2024-05-30T06:48:36.541491+0000","last_undegraded":"2024-05-30T06:48:36.541491+0000","last_fullsized":"2024-05-30T06:48:36.541491+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:33:34.904823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329390+0000","last_change":"2024-05-30T06:48:34.533134+0000","last_active":"2024-05-30T06:48:37.329390+0000","last_peered":"2024-05-30T06:48:37.329390+0000","last_clean":"2024-05-30T06:48:37.329390+0000","last_became_active":"2024-05-30T06:48:34.532532+0000","last_became_peered":"2024-05-30T06:48:34.532532+0000","last_unstale":"2024-05-30T06:48:37.329390+0000","last_undegraded":"2024-05-30T06:48:37.329390+0000","last_fullsized":"2024-05-30T06:48:37.329390+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:55:21.139349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329914+0000","last_change":"2024-05-30T06:48:35.556990+0000","last_active":"2024-05-30T06:48:37.329914+0000","last_peered":"2024-05-30T06:48:37.329914+0000","last_clean":"2024-05-30T06:48:37.329914+0000","last_became_active":"2024-05-30T06:48:35.556714+0000","last_became_peered":"2024-05-30T06:48:35.556714+0000","last_unstale":"2024-05-30T06:48:37.329914+0000","last_undegraded":"2024-05-30T06:48:37.329914+0000","last_fullsized":"2024-05-30T06:48:37.329914+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:14:22.995378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549808+0000","last_change":"2024-05-30T06:48:34.538260+0000","last_active":"2024-05-30T06:48:37.549808+0000","last_peered":"2024-05-30T06:48:37.549808+0000","last_clean":"2024-05-30T06:48:37.549808+0000","last_became_active":"2024-05-30T06:48:34.537965+0000","last_became_peered":"2024-05-30T06:48:34.537965+0000","last_unstale":"2024-05-30T06:48:37.549808+0000","last_undegraded":"2024-05-30T06:48:37.549808+0000","last_fullsized":"2024-05-30T06:48:37.549808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:16:16.602018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549901+0000","last_change":"2024-05-30T06:48:35.556813+0000","last_active":"2024-05-30T06:48:37.549901+0000","last_peered":"2024-05-30T06:48:37.549901+0000","last_clean":"2024-05-30T06:48:37.549901+0000","last_became_active":"2024-05-30T06:48:35.556531+0000","last_became_peered":"2024-05-30T06:48:35.556531+0000","last_unstale":"2024-05-30T06:48:37.549901+0000","last_undegraded":"2024-05-30T06:48:37.549901+0000","last_fullsized":"2024-05-30T06:48:37.549901+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:32:48.803325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541627+0000","last_change":"2024-05-30T06:48:34.537040+0000","last_active":"2024-05-30T06:48:36.541627+0000","last_peered":"2024-05-30T06:48:36.541627+0000","last_clean":"2024-05-30T06:48:36.541627+0000","last_became_active":"2024-05-30T06:48:34.536761+0000","last_became_peered":"2024-05-30T06:48:34.536761+0000","last_unstale":"2024-05-30T06:48:36.541627+0000","last_undegraded":"2024-05-30T06:48:36.541627+0000","last_fullsized":"2024-05-30T06:48:36.541627+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:58.519294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549416+0000","last_change":"2024-05-30T06:48:35.549268+0000","last_active":"2024-05-30T06:48:37.549416+0000","last_peered":"2024-05-30T06:48:37.549416+0000","last_clean":"2024-05-30T06:48:37.549416+0000","last_became_active":"2024-05-30T06:48:35.548947+0000","last_became_peered":"2024-05-30T06:48:35.548947+0000","last_unstale":"2024-05-30T06:48:37.549416+0000","last_undegraded":"2024-05-30T06:48:37.549416+0000","last_fullsized":"2024-05-30T06:48:37.549416+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:55:22.146201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549866+0000","last_change":"2024-05-30T06:48:34.534475+0000","last_active":"2024-05-30T06:48:37.549866+0000","last_peered":"2024-05-30T06:48:37.549866+0000","last_clean":"2024-05-30T06:48:37.549866+0000","last_became_active":"2024-05-30T06:48:34.534154+0000","last_became_peered":"2024-05-30T06:48:34.534154+0000","last_unstale":"2024-05-30T06:48:37.549866+0000","last_undegraded":"2024-05-30T06:48:37.549866+0000","last_fullsized":"2024-05-30T06:48:37.549866+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:22:25.698890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549692+0000","last_change":"2024-05-30T06:48:35.556702+0000","last_active":"2024-05-30T06:48:37.549692+0000","last_peered":"2024-05-30T06:48:37.549692+0000","last_clean":"2024-05-30T06:48:37.549692+0000","last_became_active":"2024-05-30T06:48:35.556292+0000","last_became_peered":"2024-05-30T06:48:35.556292+0000","last_unstale":"2024-05-30T06:48:37.549692+0000","last_undegraded":"2024-05-30T06:48:37.549692+0000","last_fullsized":"2024-05-30T06:48:37.549692+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:52.408293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":20,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329716+0000","last_change":"2024-05-30T06:48:34.522676+0000","last_active":"2024-05-30T06:48:37.329716+0000","last_peered":"2024-05-30T06:48:37.329716+0000","last_clean":"2024-05-30T06:48:37.329716+0000","last_became_active":"2024-05-30T06:48:34.522383+0000","last_became_peered":"2024-05-30T06:48:34.522383+0000","last_unstale":"2024-05-30T06:48:37.329716+0000","last_undegraded":"2024-05-30T06:48:37.329716+0000","last_fullsized":"2024-05-30T06:48:37.329716+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:58:33.462397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543178+0000","last_change":"2024-05-30T06:48:35.549255+0000","last_active":"2024-05-30T06:48:36.543178+0000","last_peered":"2024-05-30T06:48:36.543178+0000","last_clean":"2024-05-30T06:48:36.543178+0000","last_became_active":"2024-05-30T06:48:35.548976+0000","last_became_peered":"2024-05-30T06:48:35.548976+0000","last_unstale":"2024-05-30T06:48:36.543178+0000","last_undegraded":"2024-05-30T06:48:36.543178+0000","last_fullsized":"2024-05-30T06:48:36.543178+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:36.834202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541881+0000","last_change":"2024-05-30T06:48:34.536974+0000","last_active":"2024-05-30T06:48:36.541881+0000","last_peered":"2024-05-30T06:48:36.541881+0000","last_clean":"2024-05-30T06:48:36.541881+0000","last_became_active":"2024-05-30T06:48:34.536689+0000","last_became_peered":"2024-05-30T06:48:34.536689+0000","last_unstale":"2024-05-30T06:48:36.541881+0000","last_undegraded":"2024-05-30T06:48:36.541881+0000","last_fullsized":"2024-05-30T06:48:36.541881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:17.211048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549360+0000","last_change":"2024-05-30T06:48:35.541178+0000","last_active":"2024-05-30T06:48:37.549360+0000","last_peered":"2024-05-30T06:48:37.549360+0000","last_clean":"2024-05-30T06:48:37.549360+0000","last_became_active":"2024-05-30T06:48:35.540874+0000","last_became_peered":"2024-05-30T06:48:35.540874+0000","last_unstale":"2024-05-30T06:48:37.549360+0000","last_undegraded":"2024-05-30T06:48:37.549360+0000","last_fullsized":"2024-05-30T06:48:37.549360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:00.960494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.527964+0000","last_change":"2024-05-30T06:48:34.530757+0000","last_active":"2024-05-30T06:48:37.527964+0000","last_peered":"2024-05-30T06:48:37.527964+0000","last_clean":"2024-05-30T06:48:37.527964+0000","last_became_active":"2024-05-30T06:48:34.530326+0000","last_became_peered":"2024-05-30T06:48:34.530326+0000","last_unstale":"2024-05-30T06:48:37.527964+0000","last_undegraded":"2024-05-30T06:48:37.527964+0000","last_fullsized":"2024-05-30T06:48:37.527964+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:37:24.981657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329414+0000","last_change":"2024-05-30T06:48:35.545053+0000","last_active":"2024-05-30T06:48:37.329414+0000","last_peered":"2024-05-30T06:48:37.329414+0000","last_clean":"2024-05-30T06:48:37.329414+0000","last_became_active":"2024-05-30T06:48:35.544789+0000","last_became_peered":"2024-05-30T06:48:35.544789+0000","last_unstale":"2024-05-30T06:48:37.329414+0000","last_undegraded":"2024-05-30T06:48:37.329414+0000","last_fullsized":"2024-05-30T06:48:37.329414+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:54:15.806653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542896+0000","last_change":"2024-05-30T06:48:34.529856+0000","last_active":"2024-05-30T06:48:36.542896+0000","last_peered":"2024-05-30T06:48:36.542896+0000","last_clean":"2024-05-30T06:48:36.542896+0000","last_became_active":"2024-05-30T06:48:34.529362+0000","last_became_peered":"2024-05-30T06:48:34.529362+0000","last_unstale":"2024-05-30T06:48:36.542896+0000","last_undegraded":"2024-05-30T06:48:36.542896+0000","last_fullsized":"2024-05-30T06:48:36.542896+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:13:32.793225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549386+0000","last_change":"2024-05-30T06:48:35.553758+0000","last_active":"2024-05-30T06:48:37.549386+0000","last_peered":"2024-05-30T06:48:37.549386+0000","last_clean":"2024-05-30T06:48:37.549386+0000","last_became_active":"2024-05-30T06:48:35.553533+0000","last_became_peered":"2024-05-30T06:48:35.553533+0000","last_unstale":"2024-05-30T06:48:37.549386+0000","last_undegraded":"2024-05-30T06:48:37.549386+0000","last_fullsized":"2024-05-30T06:48:37.549386+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:36.834202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":22,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549129+0000","last_change":"2024-05-30T06:48:34.531403+0000","last_active":"2024-05-30T06:48:37.549129+0000","last_peered":"2024-05-30T06:48:37.549129+0000","last_clean":"2024-05-30T06:48:37.549129+0000","last_became_active":"2024-05-30T06:48:34.531122+0000","last_became_peered":"2024-05-30T06:48:34.531122+0000","last_unstale":"2024-05-30T06:48:37.549129+0000","last_undegraded":"2024-05-30T06:48:37.549129+0000","last_fullsized":"2024-05-30T06:48:37.549129+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:44:21.380589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549841+0000","last_change":"2024-05-30T06:48:35.549591+0000","last_active":"2024-05-30T06:48:37.549841+0000","last_peered":"2024-05-30T06:48:37.549841+0000","last_clean":"2024-05-30T06:48:37.549841+0000","last_became_active":"2024-05-30T06:48:35.549312+0000","last_became_peered":"2024-05-30T06:48:35.549312+0000","last_unstale":"2024-05-30T06:48:37.549841+0000","last_undegraded":"2024-05-30T06:48:37.549841+0000","last_fullsized":"2024-05-30T06:48:37.549841+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:52.950286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542420+0000","last_change":"2024-05-30T06:48:34.537092+0000","last_active":"2024-05-30T06:48:36.542420+0000","last_peered":"2024-05-30T06:48:36.542420+0000","last_clean":"2024-05-30T06:48:36.542420+0000","last_became_active":"2024-05-30T06:48:34.536814+0000","last_became_peered":"2024-05-30T06:48:34.536814+0000","last_unstale":"2024-05-30T06:48:36.542420+0000","last_undegraded":"2024-05-30T06:48:36.542420+0000","last_fullsized":"2024-05-30T06:48:36.542420+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:51.401440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543417+0000","last_change":"2024-05-30T06:48:35.551091+0000","last_active":"2024-05-30T06:48:36.543417+0000","last_peered":"2024-05-30T06:48:36.543417+0000","last_clean":"2024-05-30T06:48:36.543417+0000","last_became_active":"2024-05-30T06:48:35.550839+0000","last_became_peered":"2024-05-30T06:48:35.550839+0000","last_unstale":"2024-05-30T06:48:36.543417+0000","last_undegraded":"2024-05-30T06:48:36.543417+0000","last_fullsized":"2024-05-30T06:48:36.543417+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:59:59.526146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524998+0000","last_change":"2024-05-30T06:48:34.535017+0000","last_active":"2024-05-30T06:48:37.524998+0000","last_peered":"2024-05-30T06:48:37.524998+0000","last_clean":"2024-05-30T06:48:37.524998+0000","last_became_active":"2024-05-30T06:48:34.534737+0000","last_became_peered":"2024-05-30T06:48:34.534737+0000","last_unstale":"2024-05-30T06:48:37.524998+0000","last_undegraded":"2024-05-30T06:48:37.524998+0000","last_fullsized":"2024-05-30T06:48:37.524998+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:58:44.441246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541887+0000","last_change":"2024-05-30T06:48:35.539578+0000","last_active":"2024-05-30T06:48:36.541887+0000","last_peered":"2024-05-30T06:48:36.541887+0000","last_clean":"2024-05-30T06:48:36.541887+0000","last_became_active":"2024-05-30T06:48:35.538947+0000","last_became_peered":"2024-05-30T06:48:35.538947+0000","last_unstale":"2024-05-30T06:48:36.541887+0000","last_undegraded":"2024-05-30T06:48:36.541887+0000","last_fullsized":"2024-05-30T06:48:36.541887+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:54:09.734425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543273+0000","last_change":"2024-05-30T06:48:34.529249+0000","last_active":"2024-05-30T06:48:36.543273+0000","last_peered":"2024-05-30T06:48:36.543273+0000","last_clean":"2024-05-30T06:48:36.543273+0000","last_became_active":"2024-05-30T06:48:34.528932+0000","last_became_peered":"2024-05-30T06:48:34.528932+0000","last_unstale":"2024-05-30T06:48:36.543273+0000","last_undegraded":"2024-05-30T06:48:36.543273+0000","last_fullsized":"2024-05-30T06:48:36.543273+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:44:58.148879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549855+0000","last_change":"2024-05-30T06:48:35.557152+0000","last_active":"2024-05-30T06:48:37.549855+0000","last_peered":"2024-05-30T06:48:37.549855+0000","last_clean":"2024-05-30T06:48:37.549855+0000","last_became_active":"2024-05-30T06:48:35.556679+0000","last_became_peered":"2024-05-30T06:48:35.556679+0000","last_unstale":"2024-05-30T06:48:37.549855+0000","last_undegraded":"2024-05-30T06:48:37.549855+0000","last_fullsized":"2024-05-30T06:48:37.549855+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:26:03.358003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524757+0000","last_change":"2024-05-30T06:48:34.532737+0000","last_active":"2024-05-30T06:48:37.524757+0000","last_peered":"2024-05-30T06:48:37.524757+0000","last_clean":"2024-05-30T06:48:37.524757+0000","last_became_active":"2024-05-30T06:48:34.532439+0000","last_became_peered":"2024-05-30T06:48:34.532439+0000","last_unstale":"2024-05-30T06:48:37.524757+0000","last_undegraded":"2024-05-30T06:48:37.524757+0000","last_fullsized":"2024-05-30T06:48:37.524757+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:32:26.915675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543100+0000","last_change":"2024-05-30T06:48:35.549138+0000","last_active":"2024-05-30T06:48:36.543100+0000","last_peered":"2024-05-30T06:48:36.543100+0000","last_clean":"2024-05-30T06:48:36.543100+0000","last_became_active":"2024-05-30T06:48:35.548886+0000","last_became_peered":"2024-05-30T06:48:35.548886+0000","last_unstale":"2024-05-30T06:48:36.543100+0000","last_undegraded":"2024-05-30T06:48:36.543100+0000","last_fullsized":"2024-05-30T06:48:36.543100+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:18.217900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542089+0000","last_change":"2024-05-30T06:48:34.513331+0000","last_active":"2024-05-30T06:48:36.542089+0000","last_peered":"2024-05-30T06:48:36.542089+0000","last_clean":"2024-05-30T06:48:36.542089+0000","last_became_active":"2024-05-30T06:48:34.513033+0000","last_became_peered":"2024-05-30T06:48:34.513033+0000","last_unstale":"2024-05-30T06:48:36.542089+0000","last_undegraded":"2024-05-30T06:48:36.542089+0000","last_fullsized":"2024-05-30T06:48:36.542089+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:35.827350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524835+0000","last_change":"2024-05-30T06:48:35.533392+0000","last_active":"2024-05-30T06:48:37.524835+0000","last_peered":"2024-05-30T06:48:37.524835+0000","last_clean":"2024-05-30T06:48:37.524835+0000","last_became_active":"2024-05-30T06:48:35.533109+0000","last_became_peered":"2024-05-30T06:48:35.533109+0000","last_unstale":"2024-05-30T06:48:37.524835+0000","last_undegraded":"2024-05-30T06:48:37.524835+0000","last_fullsized":"2024-05-30T06:48:37.524835+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:43:16.011353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549120+0000","last_change":"2024-05-30T06:48:34.535158+0000","last_active":"2024-05-30T06:48:37.549120+0000","last_peered":"2024-05-30T06:48:37.549120+0000","last_clean":"2024-05-30T06:48:37.549120+0000","last_became_active":"2024-05-30T06:48:34.534878+0000","last_became_peered":"2024-05-30T06:48:34.534878+0000","last_unstale":"2024-05-30T06:48:37.549120+0000","last_undegraded":"2024-05-30T06:48:37.549120+0000","last_fullsized":"2024-05-30T06:48:37.549120+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:28:53.414109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.524475+0000","last_change":"2024-05-30T06:48:35.543686+0000","last_active":"2024-05-30T06:48:37.524475+0000","last_peered":"2024-05-30T06:48:37.524475+0000","last_clean":"2024-05-30T06:48:37.524475+0000","last_became_active":"2024-05-30T06:48:35.543395+0000","last_became_peered":"2024-05-30T06:48:35.543395+0000","last_unstale":"2024-05-30T06:48:37.524475+0000","last_undegraded":"2024-05-30T06:48:37.524475+0000","last_fullsized":"2024-05-30T06:48:37.524475+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:45:27.303328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542814+0000","last_change":"2024-05-30T06:48:34.531958+0000","last_active":"2024-05-30T06:48:36.542814+0000","last_peered":"2024-05-30T06:48:36.542814+0000","last_clean":"2024-05-30T06:48:36.542814+0000","last_became_active":"2024-05-30T06:48:34.531647+0000","last_became_peered":"2024-05-30T06:48:34.531647+0000","last_unstale":"2024-05-30T06:48:36.542814+0000","last_undegraded":"2024-05-30T06:48:36.542814+0000","last_fullsized":"2024-05-30T06:48:36.542814+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:27:53.896171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543548+0000","last_change":"2024-05-30T06:48:35.526260+0000","last_active":"2024-05-30T06:48:36.543548+0000","last_peered":"2024-05-30T06:48:36.543548+0000","last_clean":"2024-05-30T06:48:36.543548+0000","last_became_active":"2024-05-30T06:48:35.525885+0000","last_became_peered":"2024-05-30T06:48:35.525885+0000","last_unstale":"2024-05-30T06:48:36.543548+0000","last_undegraded":"2024-05-30T06:48:36.543548+0000","last_fullsized":"2024-05-30T06:48:36.543548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:07:00.306354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549664+0000","last_change":"2024-05-30T06:48:34.530784+0000","last_active":"2024-05-30T06:48:37.549664+0000","last_peered":"2024-05-30T06:48:37.549664+0000","last_clean":"2024-05-30T06:48:37.549664+0000","last_became_active":"2024-05-30T06:48:34.530530+0000","last_became_peered":"2024-05-30T06:48:34.530530+0000","last_unstale":"2024-05-30T06:48:37.549664+0000","last_undegraded":"2024-05-30T06:48:37.549664+0000","last_fullsized":"2024-05-30T06:48:37.549664+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:01.688856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543611+0000","last_change":"2024-05-30T06:48:35.544596+0000","last_active":"2024-05-30T06:48:36.543611+0000","last_peered":"2024-05-30T06:48:36.543611+0000","last_clean":"2024-05-30T06:48:36.543611+0000","last_became_active":"2024-05-30T06:48:35.544332+0000","last_became_peered":"2024-05-30T06:48:35.544332+0000","last_unstale":"2024-05-30T06:48:36.543611+0000","last_undegraded":"2024-05-30T06:48:36.543611+0000","last_fullsized":"2024-05-30T06:48:36.543611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:52.950286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525179+0000","last_change":"2024-05-30T06:48:34.520993+0000","last_active":"2024-05-30T06:48:37.525179+0000","last_peered":"2024-05-30T06:48:37.525179+0000","last_clean":"2024-05-30T06:48:37.525179+0000","last_became_active":"2024-05-30T06:48:34.520714+0000","last_became_peered":"2024-05-30T06:48:34.520714+0000","last_unstale":"2024-05-30T06:48:37.525179+0000","last_undegraded":"2024-05-30T06:48:37.525179+0000","last_fullsized":"2024-05-30T06:48:37.525179+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:59:06.787445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549469+0000","last_change":"2024-05-30T06:48:35.543098+0000","last_active":"2024-05-30T06:48:37.549469+0000","last_peered":"2024-05-30T06:48:37.549469+0000","last_clean":"2024-05-30T06:48:37.549469+0000","last_became_active":"2024-05-30T06:48:35.539998+0000","last_became_peered":"2024-05-30T06:48:35.539998+0000","last_unstale":"2024-05-30T06:48:37.549469+0000","last_undegraded":"2024-05-30T06:48:37.549469+0000","last_fullsized":"2024-05-30T06:48:37.549469+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:22:33.601896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.528216+0000","last_change":"2024-05-30T06:48:34.521233+0000","last_active":"2024-05-30T06:48:37.528216+0000","last_peered":"2024-05-30T06:48:37.528216+0000","last_clean":"2024-05-30T06:48:37.528216+0000","last_became_active":"2024-05-30T06:48:34.520926+0000","last_became_peered":"2024-05-30T06:48:34.520926+0000","last_unstale":"2024-05-30T06:48:37.528216+0000","last_undegraded":"2024-05-30T06:48:37.528216+0000","last_fullsized":"2024-05-30T06:48:37.528216+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:56:05.921018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.525135+0000","last_change":"2024-05-30T06:48:35.533608+0000","last_active":"2024-05-30T06:48:37.525135+0000","last_peered":"2024-05-30T06:48:37.525135+0000","last_clean":"2024-05-30T06:48:37.525135+0000","last_became_active":"2024-05-30T06:48:35.531836+0000","last_became_peered":"2024-05-30T06:48:35.531836+0000","last_unstale":"2024-05-30T06:48:37.525135+0000","last_undegraded":"2024-05-30T06:48:37.525135+0000","last_fullsized":"2024-05-30T06:48:37.525135+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:18.217900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.543694+0000","last_change":"2024-05-30T06:48:34.523593+0000","last_active":"2024-05-30T06:48:36.543694+0000","last_peered":"2024-05-30T06:48:36.543694+0000","last_clean":"2024-05-30T06:48:36.543694+0000","last_became_active":"2024-05-30T06:48:34.523179+0000","last_became_peered":"2024-05-30T06:48:34.523179+0000","last_unstale":"2024-05-30T06:48:36.543694+0000","last_undegraded":"2024-05-30T06:48:36.543694+0000","last_fullsized":"2024-05-30T06:48:36.543694+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:21:24.174780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.542135+0000","last_change":"2024-05-30T06:48:35.553884+0000","last_active":"2024-05-30T06:48:36.542135+0000","last_peered":"2024-05-30T06:48:36.542135+0000","last_clean":"2024-05-30T06:48:36.542135+0000","last_became_active":"2024-05-30T06:48:35.552445+0000","last_became_peered":"2024-05-30T06:48:35.552445+0000","last_unstale":"2024-05-30T06:48:36.542135+0000","last_undegraded":"2024-05-30T06:48:36.542135+0000","last_fullsized":"2024-05-30T06:48:36.542135+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:27:04.764869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549062+0000","last_change":"2024-05-30T06:48:34.520491+0000","last_active":"2024-05-30T06:48:37.549062+0000","last_peered":"2024-05-30T06:48:37.549062+0000","last_clean":"2024-05-30T06:48:37.549062+0000","last_became_active":"2024-05-30T06:48:34.519878+0000","last_became_peered":"2024-05-30T06:48:34.519878+0000","last_unstale":"2024-05-30T06:48:37.549062+0000","last_undegraded":"2024-05-30T06:48:37.549062+0000","last_fullsized":"2024-05-30T06:48:37.549062+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:14:50.903639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549541+0000","last_change":"2024-05-30T06:48:35.550619+0000","last_active":"2024-05-30T06:48:37.549541+0000","last_peered":"2024-05-30T06:48:37.549541+0000","last_clean":"2024-05-30T06:48:37.549541+0000","last_became_active":"2024-05-30T06:48:35.549371+0000","last_became_peered":"2024-05-30T06:48:35.549371+0000","last_unstale":"2024-05-30T06:48:37.549541+0000","last_undegraded":"2024-05-30T06:48:37.549541+0000","last_fullsized":"2024-05-30T06:48:37.549541+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:38.360823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.329705+0000","last_change":"2024-05-30T06:48:34.522012+0000","last_active":"2024-05-30T06:48:37.329705+0000","last_peered":"2024-05-30T06:48:37.329705+0000","last_clean":"2024-05-30T06:48:37.329705+0000","last_became_active":"2024-05-30T06:48:34.521741+0000","last_became_peered":"2024-05-30T06:48:34.521741+0000","last_unstale":"2024-05-30T06:48:37.329705+0000","last_undegraded":"2024-05-30T06:48:37.329705+0000","last_fullsized":"2024-05-30T06:48:37.329705+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:23.109462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549099+0000","last_change":"2024-05-30T06:48:35.536669+0000","last_active":"2024-05-30T06:48:37.549099+0000","last_peered":"2024-05-30T06:48:37.549099+0000","last_clean":"2024-05-30T06:48:37.549099+0000","last_became_active":"2024-05-30T06:48:35.536368+0000","last_became_peered":"2024-05-30T06:48:35.536368+0000","last_unstale":"2024-05-30T06:48:37.549099+0000","last_undegraded":"2024-05-30T06:48:37.549099+0000","last_fullsized":"2024-05-30T06:48:37.549099+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:24.116315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549188+0000","last_change":"2024-05-30T06:48:34.526043+0000","last_active":"2024-05-30T06:48:37.549188+0000","last_peered":"2024-05-30T06:48:37.549188+0000","last_clean":"2024-05-30T06:48:37.549188+0000","last_became_active":"2024-05-30T06:48:34.525756+0000","last_became_peered":"2024-05-30T06:48:34.525756+0000","last_unstale":"2024-05-30T06:48:37.549188+0000","last_undegraded":"2024-05-30T06:48:37.549188+0000","last_fullsized":"2024-05-30T06:48:37.549188+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:11:52.402980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541627+0000","last_change":"2024-05-30T06:48:35.537546+0000","last_active":"2024-05-30T06:48:36.541627+0000","last_peered":"2024-05-30T06:48:36.541627+0000","last_clean":"2024-05-30T06:48:36.541627+0000","last_became_active":"2024-05-30T06:48:35.536944+0000","last_became_peered":"2024-05-30T06:48:35.536944+0000","last_unstale":"2024-05-30T06:48:36.541627+0000","last_undegraded":"2024-05-30T06:48:36.541627+0000","last_fullsized":"2024-05-30T06:48:36.541627+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:52:19.027874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541456+0000","last_change":"2024-05-30T06:48:34.530397+0000","last_active":"2024-05-30T06:48:36.541456+0000","last_peered":"2024-05-30T06:48:36.541456+0000","last_clean":"2024-05-30T06:48:36.541456+0000","last_became_active":"2024-05-30T06:48:34.527344+0000","last_became_peered":"2024-05-30T06:48:34.527344+0000","last_unstale":"2024-05-30T06:48:36.541456+0000","last_undegraded":"2024-05-30T06:48:36.541456+0000","last_fullsized":"2024-05-30T06:48:36.541456+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:21:28.521999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:36.541409+0000","last_change":"2024-05-30T06:48:35.537092+0000","last_active":"2024-05-30T06:48:36.541409+0000","last_peered":"2024-05-30T06:48:36.541409+0000","last_clean":"2024-05-30T06:48:36.541409+0000","last_became_active":"2024-05-30T06:48:35.536770+0000","last_became_peered":"2024-05-30T06:48:35.536770+0000","last_unstale":"2024-05-30T06:48:36.541409+0000","last_undegraded":"2024-05-30T06:48:36.541409+0000","last_fullsized":"2024-05-30T06:48:36.541409+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:34.498407+0000","last_clean_scrub_stamp":"2024-05-30T06:48:34.498407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:31:36.618397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.527991+0000","last_change":"2024-05-30T06:48:34.520800+0000","last_active":"2024-05-30T06:48:37.527991+0000","last_peered":"2024-05-30T06:48:37.527991+0000","last_clean":"2024-05-30T06:48:37.527991+0000","last_became_active":"2024-05-30T06:48:34.520551+0000","last_became_peered":"2024-05-30T06:48:34.520551+0000","last_unstale":"2024-05-30T06:48:37.527991+0000","last_undegraded":"2024-05-30T06:48:37.527991+0000","last_fullsized":"2024-05-30T06:48:37.527991+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:48:33.491555+0000","last_clean_scrub_stamp":"2024-05-30T06:48:33.491555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:17:15.038416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":247,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-30T06:48:37.549151+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:48:37.549151+0000","last_peered":"2024-05-30T06:48:37.549151+0000","last_clean":"2024-05-30T06:48:37.549151+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:48:37.549151+0000","last_undegraded":"2024-05-30T06:48:37.549151+0000","last_fullsized":"2024-05-30T06:48:37.549151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1323008,"data_stored":894837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574932,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45772,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326068,"statfs":{"total":96636764160,"available":96589893632,"internally_reserved":0,"allocated":720896,"data_stored":304309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574932,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44380,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327460,"statfs":{"total":96636764160,"available":96591319040,"internally_reserved":0,"allocated":729088,"data_stored":304961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45784,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326056,"statfs":{"total":96636764160,"available":96589881344,"internally_reserved":0,"allocated":733184,"data_stored":305921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574931,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45784,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326056,"statfs":{"total":96636764160,"available":96589881344,"internally_reserved":0,"allocated":729088,"data_stored":304365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":46135751},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44380,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327460,"statfs":{"total":96636764160,"available":96591319040,"internally_reserved":0,"allocated":729088,"data_stored":304365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45780,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326060,"statfs":{"total":96636764160,"available":96589885440,"internally_reserved":0,"allocated":724992,"data_stored":304399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46368,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325472,"statfs":{"total":96636764160,"available":96589283328,"internally_reserved":0,"allocated":1331200,"data_stored":896871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:48:44.608 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-30T06:48:44.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T06:48:44.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.798+0000 7f96f4e00640 1 Processor -- start 2024-05-30T06:48:44.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.798+0000 7f96f4e00640 1 -- start start 2024-05-30T06:48:44.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.802+0000 7f96f4e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96f015d350 0x7f96f006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:44.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.802+0000 7f96f4e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f96f015d7b0 0x7f96f006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:44.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.802+0000 7f96f4e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96f0142030 con 0x7f96f00b59d0 2024-05-30T06:48:44.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.802+0000 7f96f4e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f96f0142310 con 0x7f96f015d7b0 2024-05-30T06:48:44.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.802+0000 7f96f4e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f96f01425f0 con 0x7f96f015d350 2024-05-30T06:48:44.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.802+0000 7f96ed400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96f015d350 0x7f96f006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.802+0000 7f96ed400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96f015d350 0x7f96f006df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:51018/0 (socket says 172.21.15.37:51018) 2024-05-30T06:48:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.802+0000 7f96ed400640 1 -- 172.21.15.37:0/1910242076 learned_addr learned my addr 172.21.15.37:0/1910242076 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.802+0000 7f96ee800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f96f015d7b0 0x7f96f006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.802+0000 7f96ed400640 1 -- 172.21.15.37:0/1910242076 >> v2:172.21.15.105:3300/0 conn(0x7f96f015d7b0 msgr2=0x7f96f006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.802+0000 7f96ed400640 1 --2- 172.21.15.37:0/1910242076 >> v2:172.21.15.105:3300/0 conn(0x7f96f015d7b0 0x7f96f006e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.802+0000 7f96ed400640 1 -- 172.21.15.37:0/1910242076 >> v1:172.21.15.105:6789/0 conn(0x7f96f00b59d0 legacy=0x7f96f00b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:44.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.802+0000 7f96ed400640 1 -- 172.21.15.37:0/1910242076 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f01428d0 con 0x7f96f015d350 2024-05-30T06:48:44.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.806+0000 7f96ed400640 1 --2- 172.21.15.37:0/1910242076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96f015d350 0x7f96f006df50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f96dc009870 tx=0x7f96dc01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3645d93eee5cc42e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:44.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.810+0000 7f96eca00640 1 -- 172.21.15.37:0/1910242076 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0b5070 con 0x7f96f015d350 2024-05-30T06:48:44.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.810+0000 7f96eca00640 1 -- 172.21.15.37:0/1910242076 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96dc0a8a50 con 0x7f96f015d350 2024-05-30T06:48:44.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.810+0000 7f96eca00640 1 -- 172.21.15.37:0/1910242076 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0a8e20 con 0x7f96f015d350 2024-05-30T06:48:44.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.810+0000 7f96f4e00640 1 -- 172.21.15.37:0/1910242076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96f015d350 msgr2=0x7f96f006df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.810+0000 7f96f4e00640 1 --2- 172.21.15.37:0/1910242076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96f015d350 0x7f96f006df50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f96dc009870 tx=0x7f96dc01ed50 comp rx=0 tx=0).stop 2024-05-30T06:48:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.810+0000 7f96f4e00640 1 -- 172.21.15.37:0/1910242076 shutdown_connections 2024-05-30T06:48:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.810+0000 7f96f4e00640 1 --2- 172.21.15.37:0/1910242076 >> v2:172.21.15.105:3300/0 conn(0x7f96f015d7b0 0x7f96f006e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.810+0000 7f96f4e00640 1 --2- 172.21.15.37:0/1910242076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96f015d350 0x7f96f006df50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.810+0000 7f96f4e00640 1 -- 172.21.15.37:0/1910242076 >> 172.21.15.37:0/1910242076 conn(0x7f96f006bf60 msgr2=0x7f96f00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.810+0000 7f96f4e00640 1 -- 172.21.15.37:0/1910242076 shutdown_connections 2024-05-30T06:48:44.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.810+0000 7f96f4e00640 1 -- 172.21.15.37:0/1910242076 wait complete. 2024-05-30T06:48:44.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.810+0000 7f96f4e00640 1 Processor -- start 2024-05-30T06:48:44.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.810+0000 7f96f4e00640 1 -- start start 2024-05-30T06:48:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96f4e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00b59d0 0x7f96f0149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96f4e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96f015d350 0x7f96f00b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96f4e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96f015d7b0 0x7f96f0157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96f4e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96f00b00a0 con 0x7f96f00b59d0 2024-05-30T06:48:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96f4e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f96f00aff20 con 0x7f96f015d350 2024-05-30T06:48:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96f4e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f96f013f860 con 0x7f96f015d7b0 2024-05-30T06:48:44.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96ede00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00b59d0 0x7f96f0149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96ede00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00b59d0 0x7f96f0149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39370/0 (socket says 172.21.15.37:39370) 2024-05-30T06:48:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96ede00640 1 -- 172.21.15.37:0/2175123755 learned_addr learned my addr 172.21.15.37:0/2175123755 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96ed400640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96f015d350 0x7f96f00b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96ee800640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96f015d7b0 0x7f96f0157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96ede00640 1 -- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96f015d7b0 msgr2=0x7f96f0157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96ede00640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96f015d7b0 0x7f96f0157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96ede00640 1 -- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96f015d350 msgr2=0x7f96f00b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96ede00640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96f015d350 0x7f96f00b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96ede00640 1 -- 172.21.15.37:0/2175123755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f01597b0 con 0x7f96f00b59d0 2024-05-30T06:48:44.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96ede00640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00b59d0 0x7f96f0149230 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f96e000c370 tx=0x7f96e000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:44.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96e6000640 1 -- 172.21.15.37:0/2175123755 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e00052d0 con 0x7f96f00b59d0 2024-05-30T06:48:44.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96e6000640 1 -- 172.21.15.37:0/2175123755 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96e0005470 con 0x7f96f00b59d0 2024-05-30T06:48:44.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96e6000640 1 -- 172.21.15.37:0/2175123755 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0007260 con 0x7f96f00b59d0 2024-05-30T06:48:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96f4e00640 1 -- 172.21.15.37:0/2175123755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f0159a90 con 0x7f96f00b59d0 2024-05-30T06:48:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96f4e00640 1 -- 172.21.15.37:0/2175123755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f015a050 con 0x7f96f00b59d0 2024-05-30T06:48:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96f4e00640 1 -- 172.21.15.37:0/2175123755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f0068bc0 con 0x7f96f00b59d0 2024-05-30T06:48:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.814+0000 7f96e6000640 1 -- 172.21.15.37:0/2175123755 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f96e0007400 con 0x7f96f00b59d0 2024-05-30T06:48:44.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.818+0000 7f96e6000640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f96d0068bf0 0x7f96d006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:44.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.818+0000 7f96e6000640 1 -- 172.21.15.37:0/2175123755 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f96e0086ef0 con 0x7f96f00b59d0 2024-05-30T06:48:44.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.818+0000 7f96ed400640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f96d0068bf0 0x7f96d006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:44.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.818+0000 7f96ed400640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f96d0068bf0 0x7f96d006b0b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0b2000 tx=0x7f96dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:44.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:44.822+0000 7f96e6000640 1 -- 172.21.15.37:0/2175123755 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f96e0055fd0 con 0x7f96f00b59d0 2024-05-30T06:48:45.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.042+0000 7f96f4e00640 1 -- 172.21.15.37:0/2175123755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f96f015ca70 con 0x7f96f00b59d0 2024-05-30T06:48:45.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.046+0000 7f96e6000640 1 -- 172.21.15.37:0/2175123755 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f96e005a2d0 con 0x7f96f00b59d0 2024-05-30T06:48:45.047 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-30T06:48:45.047 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A== 2024-05-30T06:48:45.047 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-30T06:48:45.047 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-30T06:48:45.047 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T06:48:45.048 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-30T06:48:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.050+0000 7f96f4e00640 1 -- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f96d0068bf0 msgr2=0x7f96d006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.050+0000 7f96f4e00640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f96d0068bf0 0x7f96d006b0b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0b2000 tx=0x7f96dc008040 comp rx=0 tx=0).stop 2024-05-30T06:48:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.050+0000 7f96f4e00640 1 -- 172.21.15.37:0/2175123755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00b59d0 msgr2=0x7f96f0149230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:45.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.050+0000 7f96f4e00640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00b59d0 0x7f96f0149230 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f96e000c370 tx=0x7f96e000c830 comp rx=0 tx=0).stop 2024-05-30T06:48:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.050+0000 7f96f4e00640 1 -- 172.21.15.37:0/2175123755 shutdown_connections 2024-05-30T06:48:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.050+0000 7f96f4e00640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96f015d7b0 0x7f96f0157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.050+0000 7f96f4e00640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f96d0068bf0 0x7f96d006b0b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.050+0000 7f96f4e00640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96f015d350 0x7f96f00b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.050+0000 7f96f4e00640 1 --2- 172.21.15.37:0/2175123755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96f00b59d0 0x7f96f0149230 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.050+0000 7f96f4e00640 1 -- 172.21.15.37:0/2175123755 >> 172.21.15.37:0/2175123755 conn(0x7f96f006bf60 msgr2=0x7f96f013d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.050+0000 7f96f4e00640 1 -- 172.21.15.37:0/2175123755 shutdown_connections 2024-05-30T06:48:45.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.050+0000 7f96f4e00640 1 -- 172.21.15.37:0/2175123755 wait complete. 2024-05-30T06:48:45.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:48:45.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.210+0000 7f6298800640 1 Processor -- start 2024-05-30T06:48:45.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.210+0000 7f6298800640 1 -- start start 2024-05-30T06:48:45.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.210+0000 7f6298800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6290155e60 0x7f62900b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:45.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.210+0000 7f6298800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629006f9a0 0x7f62900cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:45.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.210+0000 7f6298800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f629015c8f0 con 0x7f62900b2ec0 2024-05-30T06:48:45.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.210+0000 7f6298800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f62900ccff0 con 0x7f6290155e60 2024-05-30T06:48:45.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.210+0000 7f6298800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f62900ccc80 con 0x7f629006f9a0 2024-05-30T06:48:45.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.210+0000 7f6295e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6290155e60 0x7f62900b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:45.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.210+0000 7f6295e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6290155e60 0x7f62900b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39382/0 (socket says 172.21.15.37:39382) 2024-05-30T06:48:45.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.210+0000 7f6295e00640 1 -- 172.21.15.37:0/2548864653 learned_addr learned my addr 172.21.15.37:0/2548864653 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:45.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.210+0000 7f6296800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f62900b2ec0 0x7f62900cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48086/0 (socket says 172.21.15.37:48086) 2024-05-30T06:48:45.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6295400640 1 --2- 172.21.15.37:0/2548864653 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629006f9a0 0x7f62900cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:45.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6295e00640 1 -- 172.21.15.37:0/2548864653 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629006f9a0 msgr2=0x7f62900cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:45.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6295e00640 1 --2- 172.21.15.37:0/2548864653 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629006f9a0 0x7f62900cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:45.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6295e00640 1 -- 172.21.15.37:0/2548864653 >> v1:172.21.15.37:6789/0 conn(0x7f62900b2ec0 legacy=0x7f62900cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:45.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6295e00640 1 -- 172.21.15.37:0/2548864653 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629015cbd0 con 0x7f6290155e60 2024-05-30T06:48:45.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6294a00640 1 -- 172.21.15.37:0/2548864653 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4084175443 0 0) 0x7f629015c8f0 con 0x7f62900b2ec0 2024-05-30T06:48:45.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6295400640 1 --2- 172.21.15.37:0/2548864653 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629006f9a0 0x7f62900cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:48:45.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6295e00640 1 --2- 172.21.15.37:0/2548864653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6290155e60 0x7f62900b36a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6284009870 tx=0x7f628401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3befc2f9041487c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6294a00640 1 -- 172.21.15.37:0/2548864653 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62840ab430 con 0x7f6290155e60 2024-05-30T06:48:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6294a00640 1 -- 172.21.15.37:0/2548864653 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62840b0070 con 0x7f6290155e60 2024-05-30T06:48:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6294a00640 1 -- 172.21.15.37:0/2548864653 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62840ab7f0 con 0x7f6290155e60 2024-05-30T06:48:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6298800640 1 -- 172.21.15.37:0/2548864653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6290155e60 msgr2=0x7f62900b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:45.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6298800640 1 --2- 172.21.15.37:0/2548864653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6290155e60 0x7f62900b36a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6284009870 tx=0x7f628401c560 comp rx=0 tx=0).stop 2024-05-30T06:48:45.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6298800640 1 -- 172.21.15.37:0/2548864653 shutdown_connections 2024-05-30T06:48:45.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6298800640 1 --2- 172.21.15.37:0/2548864653 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f629006f9a0 0x7f62900cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:45.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6298800640 1 --2- 172.21.15.37:0/2548864653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6290155e60 0x7f62900b36a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:45.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.214+0000 7f6298800640 1 -- 172.21.15.37:0/2548864653 >> 172.21.15.37:0/2548864653 conn(0x7f62900b23a0 msgr2=0x7f62900b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:45.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6298800640 1 -- 172.21.15.37:0/2548864653 shutdown_connections 2024-05-30T06:48:45.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6298800640 1 -- 172.21.15.37:0/2548864653 wait complete. 2024-05-30T06:48:45.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6298800640 1 Processor -- start 2024-05-30T06:48:45.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6298800640 1 -- start start 2024-05-30T06:48:45.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6298800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629006f9a0 0x7f6290147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:45.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6298800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62900b2ec0 0x7f629014ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:45.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6298800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6290155e60 0x7f6290149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:45.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6298800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f629006ec20 con 0x7f6290155e60 2024-05-30T06:48:45.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6298800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f629006eaa0 con 0x7f629006f9a0 2024-05-30T06:48:45.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6298800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f629006eda0 con 0x7f62900b2ec0 2024-05-30T06:48:45.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6296800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6290155e60 0x7f6290149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:45.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6296800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6290155e60 0x7f6290149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39394/0 (socket says 172.21.15.37:39394) 2024-05-30T06:48:45.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6296800640 1 -- 172.21.15.37:0/1681741808 learned_addr learned my addr 172.21.15.37:0/1681741808 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:45.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6295e00640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629006f9a0 0x7f6290147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:45.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6295400640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62900b2ec0 0x7f629014ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:45.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6296800640 1 -- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62900b2ec0 msgr2=0x7f629014ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:45.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6296800640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62900b2ec0 0x7f629014ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:45.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6296800640 1 -- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629006f9a0 msgr2=0x7f6290147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:45.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6296800640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629006f9a0 0x7f6290147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:45.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6296800640 1 -- 172.21.15.37:0/1681741808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629015e0f0 con 0x7f6290155e60 2024-05-30T06:48:45.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.218+0000 7f6296800640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6290155e60 0x7f6290149640 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c7a0 tx=0x7f628c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:45.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.222+0000 7f628a000640 1 -- 172.21.15.37:0/1681741808 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c018070 con 0x7f6290155e60 2024-05-30T06:48:45.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.222+0000 7f628a000640 1 -- 172.21.15.37:0/1681741808 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f628c00a640 con 0x7f6290155e60 2024-05-30T06:48:45.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.222+0000 7f6298800640 1 -- 172.21.15.37:0/1681741808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f629015e3d0 con 0x7f6290155e60 2024-05-30T06:48:45.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.222+0000 7f628a000640 1 -- 172.21.15.37:0/1681741808 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c00aab0 con 0x7f6290155e60 2024-05-30T06:48:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.222+0000 7f6298800640 1 -- 172.21.15.37:0/1681741808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62900afd60 con 0x7f6290155e60 2024-05-30T06:48:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.222+0000 7f6298800640 1 -- 172.21.15.37:0/1681741808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6290068b20 con 0x7f6290155e60 2024-05-30T06:48:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.222+0000 7f628a000640 1 -- 172.21.15.37:0/1681741808 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f628c01b070 con 0x7f6290155e60 2024-05-30T06:48:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.222+0000 7f628a000640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6274068bf0 0x7f627406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:45.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.222+0000 7f628a000640 1 -- 172.21.15.37:0/1681741808 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f628c0871d0 con 0x7f6290155e60 2024-05-30T06:48:45.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.222+0000 7f6295e00640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6274068bf0 0x7f627406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:45.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.226+0000 7f6295e00640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6274068bf0 0x7f627406b0b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f62840af000 tx=0x7f6284008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:45.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.226+0000 7f628a000640 1 -- 172.21.15.37:0/1681741808 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f628c056870 con 0x7f6290155e60 2024-05-30T06:48:45.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.426+0000 7f6298800640 1 -- 172.21.15.37:0/1681741808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6290072fb0 con 0x7f6290155e60 2024-05-30T06:48:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.426+0000 7f628a000640 1 -- 172.21.15.37:0/1681741808 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5181 (secure 0 0 0) 0x7f628c056170 con 0x7f6290155e60 2024-05-30T06:48:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:48:45.428 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2689846178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2689846178},{"type":"v1","addr":"172.21.15.37:6834","nonce":2689846178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1799611833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1799611833},{"type":"v1","addr":"172.21.15.37:6835","nonce":1799611833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/35182660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":35182660},{"type":"v1","addr":"172.21.15.105:6837","nonce":35182660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:48:34.974228+0000","modified":"2024-05-30T06:48:37.938821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6055":{"gid":6055,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2127976173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2127976173},{"type":"v1","addr":"172.21.15.105:6835","nonce":2127976173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6055,"qdb_cluster":[6055]},"id":4}]} 2024-05-30T06:48:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 37 2024-05-30T06:48:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.430+0000 7f6298800640 1 -- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6274068bf0 msgr2=0x7f627406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.430+0000 7f6298800640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6274068bf0 0x7f627406b0b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f62840af000 tx=0x7f6284008040 comp rx=0 tx=0).stop 2024-05-30T06:48:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.430+0000 7f6298800640 1 -- 172.21.15.37:0/1681741808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6290155e60 msgr2=0x7f6290149640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:45.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.430+0000 7f6298800640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6290155e60 0x7f6290149640 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c7a0 tx=0x7f628c00cc60 comp rx=0 tx=0).stop 2024-05-30T06:48:45.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.430+0000 7f6298800640 1 -- 172.21.15.37:0/1681741808 shutdown_connections 2024-05-30T06:48:45.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.430+0000 7f6298800640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6290155e60 0x7f6290149640 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:45.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.430+0000 7f6298800640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62900b2ec0 0x7f629014ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:45.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.430+0000 7f6298800640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6274068bf0 0x7f627406b0b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:45.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.430+0000 7f6298800640 1 --2- 172.21.15.37:0/1681741808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629006f9a0 0x7f6290147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:45.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.430+0000 7f6298800640 1 -- 172.21.15.37:0/1681741808 >> 172.21.15.37:0/1681741808 conn(0x7f62900b23a0 msgr2=0x7f62900b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:45.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.430+0000 7f6298800640 1 -- 172.21.15.37:0/1681741808 shutdown_connections 2024-05-30T06:48:45.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.430+0000 7f6298800640 1 -- 172.21.15.37:0/1681741808 wait complete. 2024-05-30T06:48:45.853 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T06:48:34.974228+0000', 'modified': '2024-05-30T06:48:37.938821+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6055}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6055': {'gid': 6055, 'name': 'b', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/2127976173', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6834', 'nonce': 2127976173}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 2127976173}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6055, 'qdb_cluster': [6055]} 2024-05-30T06:48:45.853 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T06:48:45.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-30T06:48:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2e1a00640 1 Processor -- start 2024-05-30T06:48:45.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2e1a00640 1 -- start start 2024-05-30T06:48:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2e1a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2dc15c870 0x7ff2dc0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2e1a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2dc09b170 0x7ff2dc0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2e1a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2dc09bb80 con 0x7ff2dc0d03c0 2024-05-30T06:48:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2e1a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff2dc0cd110 con 0x7ff2dc09b170 2024-05-30T06:48:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2e1a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff2dc09be60 con 0x7ff2dc15c870 2024-05-30T06:48:45.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2db400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2dc09b170 0x7ff2dc0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2d2000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff2dc0d03c0 0x7ff2dc09aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48088/0 (socket says 172.21.15.37:48088) 2024-05-30T06:48:46.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2d2000640 1 -- 172.21.15.37:0/3160916871 learned_addr learned my addr 172.21.15.37:0/3160916871 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:46.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2daa00640 1 --2- 172.21.15.37:0/3160916871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2dc15c870 0x7ff2dc0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2db400640 1 -- 172.21.15.37:0/3160916871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2dc15c870 msgr2=0x7ff2dc0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:46.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2db400640 1 --2- 172.21.15.37:0/3160916871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2dc15c870 0x7ff2dc0cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2db400640 1 -- 172.21.15.37:0/3160916871 >> v1:172.21.15.37:6789/0 conn(0x7ff2dc0d03c0 legacy=0x7ff2dc09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2db400640 1 -- 172.21.15.37:0/3160916871 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2dc0cd340 con 0x7ff2dc09b170 2024-05-30T06:48:46.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:45.998+0000 7ff2da000640 1 -- 172.21.15.37:0/3160916871 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3088827211 0 0) 0x7ff2dc09bb80 con 0x7ff2dc0d03c0 2024-05-30T06:48:46.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.002+0000 7ff2db400640 1 --2- 172.21.15.37:0/3160916871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc09b170 0x7ff2dc0af1e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40097c0 tx=0x7ff2d401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cf004f2901da19 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:46.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.002+0000 7ff2da000640 1 -- 172.21.15.37:0/3160916871 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40b0070 con 0x7ff2dc09b170 2024-05-30T06:48:46.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.002+0000 7ff2da000640 1 -- 172.21.15.37:0/3160916871 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d40ab600 con 0x7ff2dc09b170 2024-05-30T06:48:46.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.002+0000 7ff2da000640 1 -- 172.21.15.37:0/3160916871 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40ab9d0 con 0x7ff2dc09b170 2024-05-30T06:48:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.002+0000 7ff2e1a00640 1 -- 172.21.15.37:0/3160916871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc09b170 msgr2=0x7ff2dc0af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.002+0000 7ff2e1a00640 1 --2- 172.21.15.37:0/3160916871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc09b170 0x7ff2dc0af1e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40097c0 tx=0x7ff2d401c4a0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.002+0000 7ff2e1a00640 1 -- 172.21.15.37:0/3160916871 shutdown_connections 2024-05-30T06:48:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.002+0000 7ff2e1a00640 1 --2- 172.21.15.37:0/3160916871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc09b170 0x7ff2dc0af1e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.002+0000 7ff2e1a00640 1 --2- 172.21.15.37:0/3160916871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2dc15c870 0x7ff2dc0cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.002+0000 7ff2e1a00640 1 -- 172.21.15.37:0/3160916871 >> 172.21.15.37:0/3160916871 conn(0x7ff2dc0b4060 msgr2=0x7ff2dc0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.002+0000 7ff2e1a00640 1 -- 172.21.15.37:0/3160916871 shutdown_connections 2024-05-30T06:48:46.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.002+0000 7ff2e1a00640 1 -- 172.21.15.37:0/3160916871 wait complete. 2024-05-30T06:48:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2e1a00640 1 Processor -- start 2024-05-30T06:48:46.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2e1a00640 1 -- start start 2024-05-30T06:48:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2e1a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2dc09b170 0x7ff2dc15ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2e1a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0d03c0 0x7ff2dc14a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2e1a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2dc15c870 0x7ff2dc15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2e1a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc15cdd0 con 0x7ff2dc0d03c0 2024-05-30T06:48:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2e1a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc15cc50 con 0x7ff2dc15c870 2024-05-30T06:48:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2e1a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff2dc0ce360 con 0x7ff2dc09b170 2024-05-30T06:48:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2d2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0d03c0 0x7ff2dc14a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2d2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0d03c0 0x7ff2dc14a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39412/0 (socket says 172.21.15.37:39412) 2024-05-30T06:48:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2d2000640 1 -- 172.21.15.37:0/2502241019 learned_addr learned my addr 172.21.15.37:0/2502241019 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2daa00640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2dc09b170 0x7ff2dc15ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2db400640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2dc15c870 0x7ff2dc15cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2d2000640 1 -- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2dc09b170 msgr2=0x7ff2dc15ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2d2000640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2dc09b170 0x7ff2dc15ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2d2000640 1 -- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2dc15c870 msgr2=0x7ff2dc15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2d2000640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2dc15c870 0x7ff2dc15cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2d2000640 1 -- 172.21.15.37:0/2502241019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2dc15d9a0 con 0x7ff2dc0d03c0 2024-05-30T06:48:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2db400640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2dc15c870 0x7ff2dc15cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2d2000640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0d03c0 0x7ff2dc14a910 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4002240 tx=0x7ff2c400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2d3400640 1 -- 172.21.15.37:0/2502241019 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4018070 con 0x7ff2dc0d03c0 2024-05-30T06:48:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2d3400640 1 -- 172.21.15.37:0/2502241019 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c400a640 con 0x7ff2dc0d03c0 2024-05-30T06:48:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2e1a00640 1 -- 172.21.15.37:0/2502241019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2dc15dc80 con 0x7ff2dc0d03c0 2024-05-30T06:48:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2d3400640 1 -- 172.21.15.37:0/2502241019 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c400a9f0 con 0x7ff2dc0d03c0 2024-05-30T06:48:46.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.006+0000 7ff2e1a00640 1 -- 172.21.15.37:0/2502241019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2dc15e240 con 0x7ff2dc0d03c0 2024-05-30T06:48:46.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.010+0000 7ff2d3400640 1 -- 172.21.15.37:0/2502241019 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7ff2c401b070 con 0x7ff2dc0d03c0 2024-05-30T06:48:46.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.010+0000 7ff2d3400640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff2b8068bf0 0x7ff2b806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.010+0000 7ff2d3400640 1 -- 172.21.15.37:0/2502241019 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7ff2c4087220 con 0x7ff2dc0d03c0 2024-05-30T06:48:46.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.010+0000 7ff2e4f00000 1 Processor -- start 2024-05-30T06:48:46.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.010+0000 7ff2e4f00000 1 -- start start 2024-05-30T06:48:46.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.010+0000 7ff2daa00640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff2b8068bf0 0x7ff2b806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c35424120 0x560c35424500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424a40 0x560c353d7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c353d7650 0x560c353d7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560c35228420 con 0x560c353d7650 2024-05-30T06:48:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560c351c2bf0 con 0x560c35424a40 2024-05-30T06:48:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x560c352243e0 con 0x560c35424120 2024-05-30T06:48:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2daa00640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff2b8068bf0 0x7ff2b806b0b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0b7d90 tx=0x7ff2cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2db400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c353d7650 0x560c353d7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2db400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c353d7650 0x560c353d7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39420/0 (socket says 172.21.15.37:39420) 2024-05-30T06:48:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2db400640 1 -- 172.21.15.37:0/1530600943 learned_addr learned my addr 172.21.15.37:0/1530600943 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2d2000640 1 --2- 172.21.15.37:0/1530600943 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424a40 0x560c353d7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2daa00640 1 --2- 172.21.15.37:0/1530600943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c35424120 0x560c35424500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2db400640 1 -- 172.21.15.37:0/1530600943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c35424120 msgr2=0x560c35424500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2db400640 1 --2- 172.21.15.37:0/1530600943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c35424120 0x560c35424500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2db400640 1 -- 172.21.15.37:0/1530600943 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424a40 msgr2=0x560c353d7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2db400640 1 --2- 172.21.15.37:0/1530600943 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424a40 0x560c353d7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2db400640 1 -- 172.21.15.37:0/1530600943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c352d0450 con 0x560c353d7650 2024-05-30T06:48:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2db400640 1 --2- 172.21.15.37:0/1530600943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c353d7650 0x560c353d7a30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40ae040 tx=0x7ff2d40a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42f64edf65c5086 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2cb400640 1 -- 172.21.15.37:0/1530600943 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40b0050 con 0x560c353d7650 2024-05-30T06:48:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2cb400640 1 -- 172.21.15.37:0/1530600943 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d40b1040 con 0x560c353d7650 2024-05-30T06:48:46.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2cb400640 1 -- 172.21.15.37:0/1530600943 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40ab6c0 con 0x560c353d7650 2024-05-30T06:48:46.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 -- 172.21.15.37:0/1530600943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c353d7650 msgr2=0x560c353d7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/1530600943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c353d7650 0x560c353d7a30 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40ae040 tx=0x7ff2d40a6000 comp rx=0 tx=0).stop 2024-05-30T06:48:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 -- 172.21.15.37:0/1530600943 shutdown_connections 2024-05-30T06:48:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/1530600943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c353d7650 0x560c353d7a30 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/1530600943 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424a40 0x560c353d7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/1530600943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c35424120 0x560c35424500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 -- 172.21.15.37:0/1530600943 >> 172.21.15.37:0/1530600943 conn(0x560c35404ec0 msgr2=0x560c354072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 -- 172.21.15.37:0/1530600943 shutdown_connections 2024-05-30T06:48:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 -- 172.21.15.37:0/1530600943 wait complete. 2024-05-30T06:48:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 -- start start 2024-05-30T06:48:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.014+0000 7ff2e4f00000 1 Processor -- start 2024-05-30T06:48:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c353d7650 0x560c354238b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424120 0x560c353dcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 0x560c353dd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560c351c8ec0 con 0x560c35424a40 2024-05-30T06:48:46.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560c352a9120 con 0x560c35424120 2024-05-30T06:48:46.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x560c35233350 con 0x560c353d7650 2024-05-30T06:48:46.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 10 client.0 _ll_register_callbacks cb 0x560c352054d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:48:46.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2db400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 0x560c353dd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2db400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 0x560c353dd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39436/0 (socket says 172.21.15.37:39436) 2024-05-30T06:48:46.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2db400640 1 -- 172.21.15.37:0/4148791025 learned_addr learned my addr 172.21.15.37:0/4148791025 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:46.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2daa00640 1 --2- 172.21.15.37:0/4148791025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c353d7650 0x560c354238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2d2000640 1 --2- 172.21.15.37:0/4148791025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424120 0x560c353dcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2db400640 1 -- 172.21.15.37:0/4148791025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c353d7650 msgr2=0x560c354238b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:46.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2db400640 1 --2- 172.21.15.37:0/4148791025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c353d7650 0x560c354238b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2db400640 1 -- 172.21.15.37:0/4148791025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424120 msgr2=0x560c353dcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:46.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2db400640 1 --2- 172.21.15.37:0/4148791025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424120 0x560c353dcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2db400640 1 -- 172.21.15.37:0/4148791025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c3526df80 con 0x560c35424a40 2024-05-30T06:48:46.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2db400640 1 --2- 172.21.15.37:0/4148791025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 0x560c353dd0c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4008010 tx=0x7ff2d401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da4ab779558bb38 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:46.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:48:46.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2bfe00640 1 -- 172.21.15.37:0/4148791025 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40b0040 con 0x560c35424a40 2024-05-30T06:48:46.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2bfe00640 1 -- 172.21.15.37:0/4148791025 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7ff2d40043b0 con 0x560c35424a40 2024-05-30T06:48:46.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 1 -- 172.21.15.37:0/4148791025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2d40b1040 con 0x560c35424a40 2024-05-30T06:48:46.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2bfe00640 1 -- 172.21.15.37:0/4148791025 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff2d4003620 con 0x560c35424a40 2024-05-30T06:48:46.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 10 client.6411 fetch_fsmap learned FSMap version 37 2024-05-30T06:48:46.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 1 -- 172.21.15.37:0/4148791025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x560c35201f00 con 0x560c35424a40 2024-05-30T06:48:46.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2bfe00640 1 -- 172.21.15.37:0/4148791025 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d40b1040 con 0x560c35424a40 2024-05-30T06:48:46.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2bfe00640 1 -- 172.21.15.37:0/4148791025 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 37) ==== 3494+0+0 (secure 0 0 0) 0x7ff2d40c0070 con 0x560c35424a40 2024-05-30T06:48:46.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 10 client.6411 fetch_fsmap finished waiting for FSMap version 37 2024-05-30T06:48:46.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 10 client.6411 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-30T06:48:46.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 20 client.6411 populate_metadata read hostname 'smithi037' 2024-05-30T06:48:46.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/4148791025 >> [v2:172.21.15.105:6834/2127976173,v1:172.21.15.105:6835/2127976173] conn(0x560c35433890 0x560c35435c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 4 client.6411 mds_command: new command op to 6055 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T06:48:46.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2e4f00000 1 -- 172.21.15.37:0/4148791025 --> [v2:172.21.15.105:6834/2127976173,v1:172.21.15.105:6835/2127976173] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c351c1bc0 con 0x560c35433890 2024-05-30T06:48:46.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2daa00640 1 --2- 172.21.15.37:0/4148791025 >> [v2:172.21.15.105:6834/2127976173,v1:172.21.15.105:6835/2127976173] conn(0x560c35433890 0x560c35435c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2daa00640 1 --2- 172.21.15.37:0/4148791025 >> [v2:172.21.15.105:6834/2127976173,v1:172.21.15.105:6835/2127976173] conn(0x560c35433890 0x560c35435c80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb0d34b653ce73e8 server_cookie=43fce94b927e5ea9 in_seq=0 out_seq=0 2024-05-30T06:48:46.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.018+0000 7ff2bfe00640 10 client.6411 ms_handle_connect on v2:172.21.15.105:6834/2127976173 2024-05-30T06:48:46.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2bfe00640 1 -- 172.21.15.37:0/4148791025 <== mds.0 v2:172.21.15.105:6834/2127976173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560c351c1bc0 con 0x560c35433890 2024-05-30T06:48:46.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2bfe00640 10 client.6411 handle_command_reply: tid=0 2024-05-30T06:48:46.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2e4f00000 1 client.6411 shutdown 2024-05-30T06:48:46.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2e4f00000 1 -- 172.21.15.37:0/4148791025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 msgr2=0x560c353dd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/4148791025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 0x560c353dd0c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4008010 tx=0x7ff2d401ace0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2e4f00000 1 -- 172.21.15.37:0/4148791025 shutdown_connections 2024-05-30T06:48:46.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/4148791025 >> [v2:172.21.15.105:6834/2127976173,v1:172.21.15.105:6835/2127976173] conn(0x560c35433890 0x560c35435c80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/4148791025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 0x560c353dd0c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/4148791025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424120 0x560c353dcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2bfe00640 0 client.6411 ms_handle_reset on v2:172.21.15.105:6834/2127976173 2024-05-30T06:48:46.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/4148791025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c353d7650 0x560c354238b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2e4f00000 1 -- 172.21.15.37:0/4148791025 >> 172.21.15.37:0/4148791025 conn(0x560c35404ec0 msgr2=0x560c354072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:46.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2e4f00000 1 -- 172.21.15.37:0/4148791025 shutdown_connections 2024-05-30T06:48:46.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2e4f00000 1 -- 172.21.15.37:0/4148791025 wait complete. 2024-05-30T06:48:46.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.022+0000 7ff2e4f00000 20 client.6411 trim_cache size 0 max 16384 2024-05-30T06:48:46.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.038+0000 7ff2e4f00000 1 Processor -- start 2024-05-30T06:48:46.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.038+0000 7ff2e4f00000 1 -- start start 2024-05-30T06:48:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.038+0000 7ff2e4f00000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c353d7650 0x560c353d6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424120 0x560c353d6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 0x560c35435c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc0b6630 con 0x560c35424a40 2024-05-30T06:48:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc15ba70 con 0x560c35424120 2024-05-30T06:48:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff2dc0b5fe0 con 0x560c353d7650 2024-05-30T06:48:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2db400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 0x560c35435c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2db400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 0x560c35435c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39438/0 (socket says 172.21.15.37:39438) 2024-05-30T06:48:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2db400640 1 -- 172.21.15.37:0/3979992891 learned_addr learned my addr 172.21.15.37:0/3979992891 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2daa00640 1 --2- 172.21.15.37:0/3979992891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c353d7650 0x560c353d6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2d2000640 1 --2- 172.21.15.37:0/3979992891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424120 0x560c353d6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2db400640 1 -- 172.21.15.37:0/3979992891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c353d7650 msgr2=0x560c353d6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:46.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2db400640 1 --2- 172.21.15.37:0/3979992891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c353d7650 0x560c353d6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2db400640 1 -- 172.21.15.37:0/3979992891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424120 msgr2=0x560c353d6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:46.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2db400640 1 --2- 172.21.15.37:0/3979992891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424120 0x560c353d6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2db400640 1 -- 172.21.15.37:0/3979992891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c351aee80 con 0x560c35424a40 2024-05-30T06:48:46.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2db400640 1 --2- 172.21.15.37:0/3979992891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 0x560c35435c80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4097d70 tx=0x7ff2d40ad050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1005319d4a11644 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:46.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2caa00640 1 -- 172.21.15.37:0/3979992891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4004350 con 0x560c35424a40 2024-05-30T06:48:46.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2caa00640 1 -- 172.21.15.37:0/3979992891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d4003950 con 0x560c35424a40 2024-05-30T06:48:46.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2caa00640 1 -- 172.21.15.37:0/3979992891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40044f0 con 0x560c35424a40 2024-05-30T06:48:46.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 -- 172.21.15.37:0/3979992891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 msgr2=0x560c35435c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/3979992891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 0x560c35435c80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4097d70 tx=0x7ff2d40ad050 comp rx=0 tx=0).stop 2024-05-30T06:48:46.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 -- 172.21.15.37:0/3979992891 shutdown_connections 2024-05-30T06:48:46.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/3979992891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424a40 0x560c35435c80 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/3979992891 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c35424120 0x560c353d6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/3979992891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c353d7650 0x560c353d6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 -- 172.21.15.37:0/3979992891 >> 172.21.15.37:0/3979992891 conn(0x560c35404ec0 msgr2=0x560c35422a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:46.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 -- 172.21.15.37:0/3979992891 shutdown_connections 2024-05-30T06:48:46.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 -- 172.21.15.37:0/3979992891 wait complete. 2024-05-30T06:48:46.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 -- start start 2024-05-30T06:48:46.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 Processor -- start 2024-05-30T06:48:46.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c353d7650 0x560c35438850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424120 0x560c3544f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c35424a40 0x560c3544fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560c35227730 con 0x560c35424120 2024-05-30T06:48:46.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560c351f49e0 con 0x560c353d7650 2024-05-30T06:48:46.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x560c3522ca50 con 0x560c35424a40 2024-05-30T06:48:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2e4f00000 10 client.0 _ll_register_callbacks cb 0x7ff2c400cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:48:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.042+0000 7ff2d2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424120 0x560c3544f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2d2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424120 0x560c3544f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39440/0 (socket says 172.21.15.37:39440) 2024-05-30T06:48:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2d2000640 1 -- 172.21.15.37:0/3587871570 learned_addr learned my addr 172.21.15.37:0/3587871570 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2daa00640 1 --2- 172.21.15.37:0/3587871570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c353d7650 0x560c35438850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2db400640 1 --2- 172.21.15.37:0/3587871570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c35424a40 0x560c3544fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2d2000640 1 -- 172.21.15.37:0/3587871570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c35424a40 msgr2=0x560c3544fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2d2000640 1 --2- 172.21.15.37:0/3587871570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c35424a40 0x560c3544fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2d2000640 1 -- 172.21.15.37:0/3587871570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c353d7650 msgr2=0x560c35438850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2d2000640 1 --2- 172.21.15.37:0/3587871570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c353d7650 0x560c35438850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2d2000640 1 -- 172.21.15.37:0/3587871570 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c351f0b30 con 0x560c35424120 2024-05-30T06:48:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2d2000640 1 --2- 172.21.15.37:0/3587871570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424120 0x560c3544f810 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4055f50 tx=0x7ff2c4056a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3fe3f37c21435b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:46.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:48:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2bfe00640 1 -- 172.21.15.37:0/3587871570 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c405ee30 con 0x560c35424120 2024-05-30T06:48:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2bfe00640 1 -- 172.21.15.37:0/3587871570 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7ff2c4085b30 con 0x560c35424120 2024-05-30T06:48:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 -- 172.21.15.37:0/3587871570 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2d4003950 con 0x560c35424120 2024-05-30T06:48:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2bfe00640 1 -- 172.21.15.37:0/3587871570 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff2c4085d30 con 0x560c35424120 2024-05-30T06:48:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 10 client.6417 fetch_fsmap learned FSMap version 37 2024-05-30T06:48:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 -- 172.21.15.37:0/3587871570 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) -- 0x560c352a95b0 con 0x560c35424120 2024-05-30T06:48:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2bfe00640 1 -- 172.21.15.37:0/3587871570 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d4003950 con 0x560c35424120 2024-05-30T06:48:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2bfe00640 1 -- 172.21.15.37:0/3587871570 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 37) ==== 3494+0+0 (secure 0 0 0) 0x7ff2c40556a0 con 0x560c35424120 2024-05-30T06:48:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 10 client.6417 fetch_fsmap finished waiting for FSMap version 37 2024-05-30T06:48:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 10 client.6417 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-30T06:48:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 20 client.6417 populate_metadata read hostname 'smithi037' 2024-05-30T06:48:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/3587871570 >> [v2:172.21.15.105:6834/2127976173,v1:172.21.15.105:6835/2127976173] conn(0x560c35493480 0x560c35493860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 4 client.6417 mds_command: new command op to 6055 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T06:48:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 -- 172.21.15.37:0/3587871570 --> [v2:172.21.15.105:6834/2127976173,v1:172.21.15.105:6835/2127976173] -- command(tid 0: {"prefix": "status"}) -- 0x560c35235e40 con 0x560c35493480 2024-05-30T06:48:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2daa00640 1 --2- 172.21.15.37:0/3587871570 >> [v2:172.21.15.105:6834/2127976173,v1:172.21.15.105:6835/2127976173] conn(0x560c35493480 0x560c35493860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2daa00640 1 --2- 172.21.15.37:0/3587871570 >> [v2:172.21.15.105:6834/2127976173,v1:172.21.15.105:6835/2127976173] conn(0x560c35493480 0x560c35493860 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c8f072c52063416 server_cookie=b34324112cdfe4fb in_seq=0 out_seq=0 2024-05-30T06:48:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2bfe00640 10 client.6417 ms_handle_connect on v2:172.21.15.105:6834/2127976173 2024-05-30T06:48:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2bfe00640 1 -- 172.21.15.37:0/3587871570 <== mds.0 v2:172.21.15.105:6834/2127976173 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x560c35235e40 con 0x560c35493480 2024-05-30T06:48:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2bfe00640 10 client.6417 handle_command_reply: tid=0 2024-05-30T06:48:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 client.6417 shutdown 2024-05-30T06:48:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 -- 172.21.15.37:0/3587871570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424120 msgr2=0x560c3544f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/3587871570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424120 0x560c3544f810 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4055f50 tx=0x7ff2c4056a10 comp rx=0 tx=0).stop 2024-05-30T06:48:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 -- 172.21.15.37:0/3587871570 shutdown_connections 2024-05-30T06:48:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/3587871570 >> [v2:172.21.15.105:6834/2127976173,v1:172.21.15.105:6835/2127976173] conn(0x560c35493480 0x560c35493860 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/3587871570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560c35424a40 0x560c3544fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/3587871570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c35424120 0x560c3544f810 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 --2- 172.21.15.37:0/3587871570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560c353d7650 0x560c35438850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2bfe00640 0 client.6417 ms_handle_reset on v2:172.21.15.105:6834/2127976173 2024-05-30T06:48:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 -- 172.21.15.37:0/3587871570 >> 172.21.15.37:0/3587871570 conn(0x560c35404ec0 msgr2=0x560c353d6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 -- 172.21.15.37:0/3587871570 shutdown_connections 2024-05-30T06:48:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 1 -- 172.21.15.37:0/3587871570 wait complete. 2024-05-30T06:48:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e4f00000 20 client.6417 trim_cache size 0 max 16384 2024-05-30T06:48:46.052 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:48:46.052 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:48:46.053 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-30T06:48:46.053 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6055, 2024-05-30T06:48:46.053 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-30T06:48:46.053 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-30T06:48:46.053 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-30T06:48:46.053 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.533984576, 2024-05-30T06:48:46.053 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 37, 2024-05-30T06:48:46.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 60, 2024-05-30T06:48:46.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 60, 2024-05-30T06:48:46.053 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 15.330741098000001 2024-05-30T06:48:46.053 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:48:46.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e1a00640 1 -- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff2b8068bf0 msgr2=0x7ff2b806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e1a00640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff2b8068bf0 0x7ff2b806b0b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc0b7d90 tx=0x7ff2cc008040 comp rx=0 tx=0).stop 2024-05-30T06:48:46.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e1a00640 1 -- 172.21.15.37:0/2502241019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0d03c0 msgr2=0x7ff2dc14a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.046+0000 7ff2e1a00640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0d03c0 0x7ff2dc14a910 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4002240 tx=0x7ff2c400cc50 comp rx=0 tx=0).stop 2024-05-30T06:48:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.050+0000 7ff2e1a00640 1 -- 172.21.15.37:0/2502241019 shutdown_connections 2024-05-30T06:48:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.050+0000 7ff2e1a00640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff2b8068bf0 0x7ff2b806b0b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.050+0000 7ff2e1a00640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2dc15c870 0x7ff2dc15cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.050+0000 7ff2e1a00640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0d03c0 0x7ff2dc14a910 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.050+0000 7ff2e1a00640 1 --2- 172.21.15.37:0/2502241019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2dc09b170 0x7ff2dc15ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.050+0000 7ff2e1a00640 1 -- 172.21.15.37:0/2502241019 >> 172.21.15.37:0/2502241019 conn(0x7ff2dc0b4060 msgr2=0x7ff2dc166d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.050+0000 7ff2e1a00640 1 -- 172.21.15.37:0/2502241019 shutdown_connections 2024-05-30T06:48:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.050+0000 7ff2e1a00640 1 -- 172.21.15.37:0/2502241019 wait complete. 2024-05-30T06:48:46.068 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T06:48:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.210+0000 7fd039000640 1 Processor -- start 2024-05-30T06:48:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.210+0000 7fd039000640 1 -- start start 2024-05-30T06:48:46.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.210+0000 7fd039000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd03415fb30 0x7fd0340b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd039000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd034162f70 con 0x7fd0340b55a0 2024-05-30T06:48:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd039000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd034163210 con 0x7fd03406d080 2024-05-30T06:48:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd039000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd0340b4040 con 0x7fd03415fb30 2024-05-30T06:48:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd0340b55a0 0x7fd0340b5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48104/0 (socket says 172.21.15.37:48104) 2024-05-30T06:48:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031e00640 1 -- 172.21.15.37:0/3870827925 learned_addr learned my addr 172.21.15.37:0/3870827925 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437538486 0 0) 0x7fd034162f70 con 0x7fd0340b55a0 2024-05-30T06:48:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd018003530 con 0x7fd0340b55a0 2024-05-30T06:48:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd02be00640 1 --2- 172.21.15.37:0/3870827925 >> v2:172.21.15.105:3300/0 conn(0x7fd03415fb30 0x7fd0340b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2335673951 0 0) 0x7fd018003530 con 0x7fd0340b55a0 2024-05-30T06:48:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 >> v2:172.21.15.105:3300/0 conn(0x7fd03415fb30 msgr2=0x7fd0340b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 --2- 172.21.15.37:0/3870827925 >> v2:172.21.15.105:3300/0 conn(0x7fd03415fb30 0x7fd0340b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 >> v1:172.21.15.105:6789/0 conn(0x7fd03406d080 legacy=0x7fd0340aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0340b4320 con 0x7fd0340b55a0 2024-05-30T06:48:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fd024001680 con 0x7fd0340b55a0 2024-05-30T06:48:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 >> v1:172.21.15.37:6789/0 conn(0x7fd0340b55a0 legacy=0x7fd0340b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 --2- 172.21.15.37:0/3870827925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0180039c0 0x7fd018003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 --2- 172.21.15.37:0/3870827925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd018004810 0x7fd018004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 --2- 172.21.15.37:0/3870827925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0180052f0 0x7fd01800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0340b4040 con 0x7fd018004810 2024-05-30T06:48:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd01800c1c0 con 0x7fd0180039c0 2024-05-30T06:48:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd01800c3c0 con 0x7fd0180052f0 2024-05-30T06:48:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd02be00640 1 --2- 172.21.15.37:0/3870827925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd018004810 0x7fd018004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd031e00640 1 --2- 172.21.15.37:0/3870827925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0180039c0 0x7fd018003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd032800640 1 --2- 172.21.15.37:0/3870827925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0180052f0 0x7fd01800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd02be00640 1 -- 172.21.15.37:0/3870827925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0180052f0 msgr2=0x7fd01800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd02be00640 1 --2- 172.21.15.37:0/3870827925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd0180052f0 0x7fd01800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd02be00640 1 -- 172.21.15.37:0/3870827925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0180039c0 msgr2=0x7fd018003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd02be00640 1 --2- 172.21.15.37:0/3870827925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd0180039c0 0x7fd018003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd02be00640 1 -- 172.21.15.37:0/3870827925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd018003530 con 0x7fd018004810 2024-05-30T06:48:46.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.214+0000 7fd032800640 1 -- 172.21.15.37:0/3870827925 reap_dead start 2024-05-30T06:48:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.218+0000 7fd02be00640 1 --2- 172.21.15.37:0/3870827925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd018004810 0x7fd018004c90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00ba00 tx=0x7fd01c01c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a1aa3dc2dc700f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.218+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c00b600 con 0x7fd018004810 2024-05-30T06:48:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.218+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd01c0aa660 con 0x7fd018004810 2024-05-30T06:48:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.218+0000 7fd031400640 1 -- 172.21.15.37:0/3870827925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0340b0850 con 0x7fd018004810 2024-05-30T06:48:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.218+0000 7fd039000640 1 -- 172.21.15.37:0/3870827925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd018004810 msgr2=0x7fd018004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.218+0000 7fd039000640 1 --2- 172.21.15.37:0/3870827925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd018004810 0x7fd018004c90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00ba00 tx=0x7fd01c01c660 comp rx=0 tx=0).stop 2024-05-30T06:48:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.218+0000 7fd039000640 1 -- 172.21.15.37:0/3870827925 shutdown_connections 2024-05-30T06:48:46.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.218+0000 7fd039000640 1 --2- 172.21.15.37:0/3870827925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd018004810 0x7fd018004c90 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.218+0000 7fd039000640 1 -- 172.21.15.37:0/3870827925 >> 172.21.15.37:0/3870827925 conn(0x7fd034073680 msgr2=0x7fd03406b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:46.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.218+0000 7fd039000640 1 -- 172.21.15.37:0/3870827925 shutdown_connections 2024-05-30T06:48:46.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.218+0000 7fd039000640 1 -- 172.21.15.37:0/3870827925 wait complete. 2024-05-30T06:48:46.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.218+0000 7fd039000640 1 Processor -- start 2024-05-30T06:48:46.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.218+0000 7fd039000640 1 -- start start 2024-05-30T06:48:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd039000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd018004810 0x7fd034149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd039000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03415ce10 0x7fd03415d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd039000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03415dcd0 0x7fd034158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd039000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0340b5980 con 0x7fd03415ce10 2024-05-30T06:48:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd039000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd0340af700 con 0x7fd03415dcd0 2024-05-30T06:48:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd039000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd0340b5b00 con 0x7fd018004810 2024-05-30T06:48:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd02be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03415ce10 0x7fd03415d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd02be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03415ce10 0x7fd03415d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39458/0 (socket says 172.21.15.37:39458) 2024-05-30T06:48:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd02be00640 1 -- 172.21.15.37:0/2452253800 learned_addr learned my addr 172.21.15.37:0/2452253800 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:46.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd02be00640 1 -- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd018004810 msgr2=0x7fd034149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd031e00640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd018004810 0x7fd034149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd032800640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03415dcd0 0x7fd034158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd02be00640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd018004810 0x7fd034149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd02be00640 1 -- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03415dcd0 msgr2=0x7fd034158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd02be00640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03415dcd0 0x7fd034158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd02be00640 1 -- 172.21.15.37:0/2452253800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03415e1e0 con 0x7fd03415ce10 2024-05-30T06:48:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd031e00640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd018004810 0x7fd034149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd032800640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03415dcd0 0x7fd034158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:48:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd02be00640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03415ce10 0x7fd03415d790 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd01c01cb40 tx=0x7fd01c019400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd02a000640 1 -- 172.21.15.37:0/2452253800 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c004020 con 0x7fd03415ce10 2024-05-30T06:48:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd02a000640 1 -- 172.21.15.37:0/2452253800 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd01c0041c0 con 0x7fd03415ce10 2024-05-30T06:48:46.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd02a000640 1 -- 172.21.15.37:0/2452253800 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd01c003620 con 0x7fd03415ce10 2024-05-30T06:48:46.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd039000640 1 -- 172.21.15.37:0/2452253800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03415c330 con 0x7fd03415ce10 2024-05-30T06:48:46.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd039000640 1 -- 172.21.15.37:0/2452253800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03414a4b0 con 0x7fd03415ce10 2024-05-30T06:48:46.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd039000640 1 -- 172.21.15.37:0/2452253800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03415c120 con 0x7fd03415ce10 2024-05-30T06:48:46.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.222+0000 7fd02a000640 1 -- 172.21.15.37:0/2452253800 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fd01c0a6040 con 0x7fd03415ce10 2024-05-30T06:48:46.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.226+0000 7fd02a000640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd010068bf0 0x7fd01006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:46.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.226+0000 7fd02a000640 1 -- 172.21.15.37:0/2452253800 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fd01c121fa0 con 0x7fd03415ce10 2024-05-30T06:48:46.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.226+0000 7fd031e00640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd010068bf0 0x7fd01006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:46.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.226+0000 7fd031e00640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd010068bf0 0x7fd01006b0b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd024007cc0 tx=0x7fd024009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:46.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.226+0000 7fd02a000640 1 -- 172.21.15.37:0/2452253800 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd01c0c2070 con 0x7fd03415ce10 2024-05-30T06:48:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd039000640 1 -- 172.21.15.37:0/2452253800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd0340b3d20 con 0x7fd03415ce10 2024-05-30T06:48:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd02a000640 1 -- 172.21.15.37:0/2452253800 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) ==== 53+0+73 (secure 0 0 0) 0x7fd01c0ae020 con 0x7fd03415ce10 2024-05-30T06:48:46.429 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T06:48:46.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd039000640 1 -- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd010068bf0 msgr2=0x7fd01006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd039000640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd010068bf0 0x7fd01006b0b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd024007cc0 tx=0x7fd024009040 comp rx=0 tx=0).stop 2024-05-30T06:48:46.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd039000640 1 -- 172.21.15.37:0/2452253800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03415ce10 msgr2=0x7fd03415d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:46.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd039000640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03415ce10 0x7fd03415d790 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd01c01cb40 tx=0x7fd01c019400 comp rx=0 tx=0).stop 2024-05-30T06:48:46.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd039000640 1 -- 172.21.15.37:0/2452253800 shutdown_connections 2024-05-30T06:48:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd039000640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd010068bf0 0x7fd01006b0b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd039000640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03415dcd0 0x7fd034158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd039000640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03415ce10 0x7fd03415d790 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd039000640 1 --2- 172.21.15.37:0/2452253800 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd018004810 0x7fd034149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd039000640 1 -- 172.21.15.37:0/2452253800 >> 172.21.15.37:0/2452253800 conn(0x7fd034073680 msgr2=0x7fd03406c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd039000640 1 -- 172.21.15.37:0/2452253800 shutdown_connections 2024-05-30T06:48:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46.430+0000 7fd039000640 1 -- 172.21.15.37:0/2452253800 wait complete. 2024-05-30T06:48:46.451 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-30T06:48:46.451 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T06:48:46.451 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-30T06:48:46.451 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T06:48:46.451 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T06:48:46.451 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-30T06:48:46.451 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-30T06:48:46.451 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T06:48:46.451 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:48:46.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:48:46.452 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-30T06:48:46.462 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:48:46.462 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:48:46.462 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:48:46.462 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:48:46.462 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-30T06:48:46.462 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:48:46.462 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:48:46.462 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:48:46.462 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-30T06:48:46.462 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42078sec preferred_lft 42078sec 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T06:48:46.463 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:30:63:12:21 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:48:46.464 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T06:48:46.464 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:48:46.464 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:48:46.464 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T06:48:46.464 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T06:48:46.464 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:48:46.464 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T06:48:46.464 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:48:46.464 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:48:46.464 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T06:48:46.464 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T06:48:46.464 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:48:46.465 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:48:46.465 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T06:48:46.465 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T06:48:46.465 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:48:46.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:48:46.465 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T06:48:46.522 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-30T06:48:46.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:48:46.525 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-30T06:48:46.581 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-30T06:48:46.581 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T06:48:46.581 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T06:48:46.581 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T06:48:46.581 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T06:48:46.582 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T06:48:46.582 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:48:46.582 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:48:46.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T06:48:46.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T06:48:46.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T06:48:46.582 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:48:46.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:48:46.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:48:46.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:48:46.726 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T06:48:46.734 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T06:48:46.735 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T06:48:46.736 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:48:46.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:48:46.736 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-30T06:48:46.804 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:48:46.804 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T06:48:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:48:46.856 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:48:46.857 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:48:46.912 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T06:48:46.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:48:46.912 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:48:47.005 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:48:47.005 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:48:47.018 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:48:47.019 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:48:47.019 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-05-30T06:48:47.019 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@393250aa-2b42-4955-adf1-f790b8ba4d8c.cephfs=/ 2024-05-30T06:48:47.019 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-05-30T06:48:47.023 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T06:48:47.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:48:47.023 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:48:47.043 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:48:47.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:48:47.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:48:47.151 INFO:teuthology.orchestra.run.smithi037.stdout:client5744 2024-05-30T06:48:47.151 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:48:47.151 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:48:47.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T06:48:47.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c28c00640 1 Processor -- start 2024-05-30T06:48:47.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c28c00640 1 -- start start 2024-05-30T06:48:47.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c28c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0c240b60e0 0x7f0c2406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:47.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c28c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c2415cdd0 0x7f0c2415d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:47.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c28c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2415db00 con 0x7f0c240ced10 2024-05-30T06:48:47.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c28c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2406df50 con 0x7f0c240b60e0 2024-05-30T06:48:47.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c28c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2406e7d0 con 0x7f0c2415cdd0 2024-05-30T06:48:47.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c22800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c2415cdd0 0x7f0c2415d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:47.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c22800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c2415cdd0 0x7f0c2415d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:51098/0 (socket says 172.21.15.37:51098) 2024-05-30T06:48:47.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c22800640 1 -- 172.21.15.37:0/1347034511 learned_addr learned my addr 172.21.15.37:0/1347034511 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:47.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c19400640 1 --2- 172.21.15.37:0/1347034511 >> v2:172.21.15.105:3300/0 conn(0x7f0c240b60e0 0x7f0c2406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:47.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c22800640 1 -- 172.21.15.37:0/1347034511 >> v2:172.21.15.105:3300/0 conn(0x7f0c240b60e0 msgr2=0x7f0c2406ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:47.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c22800640 1 --2- 172.21.15.37:0/1347034511 >> v2:172.21.15.105:3300/0 conn(0x7f0c240b60e0 0x7f0c2406ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c22800640 1 -- 172.21.15.37:0/1347034511 >> v1:172.21.15.105:6789/0 conn(0x7f0c240ced10 legacy=0x7f0c240b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:47.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c22800640 1 -- 172.21.15.37:0/1347034511 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2406e180 con 0x7f0c2415cdd0 2024-05-30T06:48:47.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.354+0000 7f0c21400640 1 -- 172.21.15.37:0/1347034511 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319085584 0 0) 0x7f0c2415db00 con 0x7f0c240ced10 2024-05-30T06:48:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.358+0000 7f0c22800640 1 --2- 172.21.15.37:0/1347034511 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c2415cdd0 0x7f0c2415d260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009e50 tx=0x7f0c1c01ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cc8c7db304f878a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.358+0000 7f0c21400640 1 -- 172.21.15.37:0/1347034511 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0a58f0 con 0x7f0c2415cdd0 2024-05-30T06:48:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.358+0000 7f0c21400640 1 -- 172.21.15.37:0/1347034511 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c0a5a90 con 0x7f0c2415cdd0 2024-05-30T06:48:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.358+0000 7f0c21400640 1 -- 172.21.15.37:0/1347034511 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0a5e60 con 0x7f0c2415cdd0 2024-05-30T06:48:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.358+0000 7f0c28c00640 1 -- 172.21.15.37:0/1347034511 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c2415cdd0 msgr2=0x7f0c2415d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.358+0000 7f0c28c00640 1 --2- 172.21.15.37:0/1347034511 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c2415cdd0 0x7f0c2415d260 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009e50 tx=0x7f0c1c01ca00 comp rx=0 tx=0).stop 2024-05-30T06:48:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.358+0000 7f0c28c00640 1 -- 172.21.15.37:0/1347034511 shutdown_connections 2024-05-30T06:48:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.358+0000 7f0c28c00640 1 --2- 172.21.15.37:0/1347034511 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c2415cdd0 0x7f0c2415d260 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.358+0000 7f0c28c00640 1 --2- 172.21.15.37:0/1347034511 >> v2:172.21.15.105:3300/0 conn(0x7f0c240b60e0 0x7f0c2406ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.358+0000 7f0c28c00640 1 -- 172.21.15.37:0/1347034511 >> 172.21.15.37:0/1347034511 conn(0x7f0c2406bf60 msgr2=0x7f0c240b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.358+0000 7f0c28c00640 1 -- 172.21.15.37:0/1347034511 shutdown_connections 2024-05-30T06:48:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.358+0000 7f0c28c00640 1 -- 172.21.15.37:0/1347034511 wait complete. 2024-05-30T06:48:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c28c00640 1 Processor -- start 2024-05-30T06:48:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c28c00640 1 -- start start 2024-05-30T06:48:47.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c28c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c240b60e0 0x7f0c24153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:47.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c28c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240ced10 0x7f0c240b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c28c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c2415cdd0 0x7f0c240b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c28c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2415e840 con 0x7f0c240ced10 2024-05-30T06:48:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c28c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2415e6c0 con 0x7f0c2415cdd0 2024-05-30T06:48:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c28c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2415e9c0 con 0x7f0c240b60e0 2024-05-30T06:48:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c19400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240ced10 0x7f0c240b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c19400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240ced10 0x7f0c240b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39462/0 (socket says 172.21.15.37:39462) 2024-05-30T06:48:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c19400640 1 -- 172.21.15.37:0/291909197 learned_addr learned my addr 172.21.15.37:0/291909197 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c21e00640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c240b60e0 0x7f0c24153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c22800640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c2415cdd0 0x7f0c240b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c19400640 1 -- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c240b60e0 msgr2=0x7f0c24153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c19400640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c240b60e0 0x7f0c24153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c19400640 1 -- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c2415cdd0 msgr2=0x7f0c240b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c19400640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c2415cdd0 0x7f0c240b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c19400640 1 -- 172.21.15.37:0/291909197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c240b4dc0 con 0x7f0c240ced10 2024-05-30T06:48:47.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c19400640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240ced10 0x7f0c240b4880 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00e870 tx=0x7f0c0c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:47.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c1aa00640 1 -- 172.21.15.37:0/291909197 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c017070 con 0x7f0c240ced10 2024-05-30T06:48:47.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c1aa00640 1 -- 172.21.15.37:0/291909197 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c0c00c940 con 0x7f0c240ced10 2024-05-30T06:48:47.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c28c00640 1 -- 172.21.15.37:0/291909197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c240b5060 con 0x7f0c240ced10 2024-05-30T06:48:47.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c1aa00640 1 -- 172.21.15.37:0/291909197 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c00ccf0 con 0x7f0c240ced10 2024-05-30T06:48:47.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.362+0000 7f0c28c00640 1 -- 172.21.15.37:0/291909197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c240b3860 con 0x7f0c240ced10 2024-05-30T06:48:47.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.366+0000 7f0c28c00640 1 -- 172.21.15.37:0/291909197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c240b3ca0 con 0x7f0c240ced10 2024-05-30T06:48:47.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.366+0000 7f0c1aa00640 1 -- 172.21.15.37:0/291909197 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f0c0c01a070 con 0x7f0c240ced10 2024-05-30T06:48:47.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.366+0000 7f0c1aa00640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0c00068bf0 0x7f0c0006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:47.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.366+0000 7f0c1aa00640 1 -- 172.21.15.37:0/291909197 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f0c0c087cf0 con 0x7f0c240ced10 2024-05-30T06:48:47.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.366+0000 7f0c21e00640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0c00068bf0 0x7f0c0006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:47.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.366+0000 7f0c21e00640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0c00068bf0 0x7f0c0006b0b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0c14000f70 tx=0x7f0c14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:47.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.370+0000 7f0c1aa00640 1 -- 172.21.15.37:0/291909197 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0c0c056dd0 con 0x7f0c240ced10 2024-05-30T06:48:47.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.574+0000 7f0c28c00640 1 -- 172.21.15.37:0/291909197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f0c240b5ec0 con 0x7f0c240ced10 2024-05-30T06:48:47.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.818+0000 7f0c1aa00640 1 -- 172.21.15.37:0/291909197 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v38) ==== 136+0+0 (secure 0 0 0) 0x7f0c0c05b0d0 con 0x7f0c240ced10 2024-05-30T06:48:47.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.822+0000 7f0c28c00640 1 -- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0c00068bf0 msgr2=0x7f0c0006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:47.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.822+0000 7f0c28c00640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0c00068bf0 0x7f0c0006b0b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0c14000f70 tx=0x7f0c14009040 comp rx=0 tx=0).stop 2024-05-30T06:48:47.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.822+0000 7f0c28c00640 1 -- 172.21.15.37:0/291909197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240ced10 msgr2=0x7f0c240b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:47.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.822+0000 7f0c28c00640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240ced10 0x7f0c240b4880 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00e870 tx=0x7f0c0c00ec70 comp rx=0 tx=0).stop 2024-05-30T06:48:47.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.822+0000 7f0c28c00640 1 -- 172.21.15.37:0/291909197 shutdown_connections 2024-05-30T06:48:47.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.822+0000 7f0c28c00640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0c00068bf0 0x7f0c0006b0b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.822+0000 7f0c28c00640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c2415cdd0 0x7f0c240b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.822+0000 7f0c28c00640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240ced10 0x7f0c240b4880 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.822+0000 7f0c28c00640 1 --2- 172.21.15.37:0/291909197 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c240b60e0 0x7f0c24153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.822+0000 7f0c28c00640 1 -- 172.21.15.37:0/291909197 >> 172.21.15.37:0/291909197 conn(0x7f0c2406bf60 msgr2=0x7f0c240b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:47.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.822+0000 7f0c28c00640 1 -- 172.21.15.37:0/291909197 shutdown_connections 2024-05-30T06:48:47.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.822+0000 7f0c28c00640 1 -- 172.21.15.37:0/291909197 wait complete. 2024-05-30T06:48:47.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:48:47.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.982+0000 7fbd81400640 1 Processor -- start 2024-05-30T06:48:47.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd81400640 1 -- start start 2024-05-30T06:48:47.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd81400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbd7c15fa30 0x7fbd7c0b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:47.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd81400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd7c0b5930 0x7fbd7c0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:47.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd81400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd7c0af5d0 con 0x7fbd7c148520 2024-05-30T06:48:47.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd81400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbd7c15fee0 con 0x7fbd7c15fa30 2024-05-30T06:48:47.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd81400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd7c0b5d80 con 0x7fbd7c0b5930 2024-05-30T06:48:47.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd7a800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbd7c148520 0x7fbd7c0aeda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50272/0 (socket says 172.21.15.37:50272) 2024-05-30T06:48:47.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd7a800640 1 -- 172.21.15.37:0/3716360380 learned_addr learned my addr 172.21.15.37:0/3716360380 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:47.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd71e00640 1 --2- 172.21.15.37:0/3716360380 >> v2:172.21.15.37:3300/0 conn(0x7fbd7c15fa30 0x7fbd7c0b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd7b200640 1 --2- 172.21.15.37:0/3716360380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd7c0b5930 0x7fbd7c0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd79e00640 1 -- 172.21.15.37:0/3716360380 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306406466 0 0) 0x7fbd7c0af5d0 con 0x7fbd7c148520 2024-05-30T06:48:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd79e00640 1 -- 172.21.15.37:0/3716360380 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd60003530 con 0x7fbd7c148520 2024-05-30T06:48:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd71e00640 1 -- 172.21.15.37:0/3716360380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd7c0b5930 msgr2=0x7fbd7c0b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd71e00640 1 --2- 172.21.15.37:0/3716360380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd7c0b5930 0x7fbd7c0b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd71e00640 1 -- 172.21.15.37:0/3716360380 >> v1:172.21.15.37:6789/0 conn(0x7fbd7c148520 legacy=0x7fbd7c0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:47.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.986+0000 7fbd71e00640 1 -- 172.21.15.37:0/3716360380 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7c0af8b0 con 0x7fbd7c15fa30 2024-05-30T06:48:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd71e00640 1 --2- 172.21.15.37:0/3716360380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd7c15fa30 0x7fbd7c0b53f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbd640097f0 tx=0x7fbd6401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd310f608b1046c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd79e00640 1 -- 172.21.15.37:0/3716360380 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd640a7070 con 0x7fbd7c15fa30 2024-05-30T06:48:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd79e00640 1 -- 172.21.15.37:0/3716360380 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd640b0070 con 0x7fbd7c15fa30 2024-05-30T06:48:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd79e00640 1 -- 172.21.15.37:0/3716360380 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd640ab890 con 0x7fbd7c15fa30 2024-05-30T06:48:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd81400640 1 -- 172.21.15.37:0/3716360380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd7c15fa30 msgr2=0x7fbd7c0b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd81400640 1 --2- 172.21.15.37:0/3716360380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd7c15fa30 0x7fbd7c0b53f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbd640097f0 tx=0x7fbd6401c470 comp rx=0 tx=0).stop 2024-05-30T06:48:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd81400640 1 -- 172.21.15.37:0/3716360380 shutdown_connections 2024-05-30T06:48:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd81400640 1 --2- 172.21.15.37:0/3716360380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd7c0b5930 0x7fbd7c0b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd81400640 1 --2- 172.21.15.37:0/3716360380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd7c15fa30 0x7fbd7c0b53f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd81400640 1 -- 172.21.15.37:0/3716360380 >> 172.21.15.37:0/3716360380 conn(0x7fbd7c06b960 msgr2=0x7fbd7c06bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd81400640 1 -- 172.21.15.37:0/3716360380 shutdown_connections 2024-05-30T06:48:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd81400640 1 -- 172.21.15.37:0/3716360380 wait complete. 2024-05-30T06:48:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd81400640 1 Processor -- start 2024-05-30T06:48:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.990+0000 7fbd81400640 1 -- start start 2024-05-30T06:48:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd81400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd7c0b5930 0x7fbd7c15de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd81400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd7c148520 0x7fbd7c13fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd81400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd7c15fa30 0x7fbd7c140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd81400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c0b4930 con 0x7fbd7c0b5930 2024-05-30T06:48:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd81400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7c0b47b0 con 0x7fbd7c148520 2024-05-30T06:48:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd81400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd7c0b4ab0 con 0x7fbd7c15fa30 2024-05-30T06:48:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd7a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd7c0b5930 0x7fbd7c15de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd7a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd7c0b5930 0x7fbd7c15de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59024/0 (socket says 172.21.15.37:59024) 2024-05-30T06:48:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd7a800640 1 -- 172.21.15.37:0/2123166165 learned_addr learned my addr 172.21.15.37:0/2123166165 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd71e00640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd7c148520 0x7fbd7c13fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd7b200640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd7c15fa30 0x7fbd7c140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd7a800640 1 -- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd7c15fa30 msgr2=0x7fbd7c140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd7a800640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd7c15fa30 0x7fbd7c140380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd7a800640 1 -- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd7c148520 msgr2=0x7fbd7c13fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd7a800640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd7c148520 0x7fbd7c13fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd7a800640 1 -- 172.21.15.37:0/2123166165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7c145b20 con 0x7fbd7c0b5930 2024-05-30T06:48:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd7a800640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd7c0b5930 0x7fbd7c15de10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c001470 tx=0x7fbd6c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd73400640 1 -- 172.21.15.37:0/2123166165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c017070 con 0x7fbd7c0b5930 2024-05-30T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd73400640 1 -- 172.21.15.37:0/2123166165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6c00ad00 con 0x7fbd7c0b5930 2024-05-30T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd73400640 1 -- 172.21.15.37:0/2123166165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c012640 con 0x7fbd7c0b5930 2024-05-30T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd81400640 1 -- 172.21.15.37:0/2123166165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7c145e00 con 0x7fbd7c0b5930 2024-05-30T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd81400640 1 -- 172.21.15.37:0/2123166165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd7c1463c0 con 0x7fbd7c0b5930 2024-05-30T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.994+0000 7fbd81400640 1 -- 172.21.15.37:0/2123166165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd7c068bc0 con 0x7fbd7c0b5930 2024-05-30T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.998+0000 7fbd73400640 1 -- 172.21.15.37:0/2123166165 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fbd6c01a070 con 0x7fbd7c0b5930 2024-05-30T06:48:47.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.998+0000 7fbd73400640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd58068bf0 0x7fbd5806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:47.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.998+0000 7fbd73400640 1 -- 172.21.15.37:0/2123166165 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fbd6c0878a0 con 0x7fbd7c0b5930 2024-05-30T06:48:47.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.998+0000 7fbd71e00640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd58068bf0 0x7fbd5806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:47.998+0000 7fbd71e00640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd58068bf0 0x7fbd5806b0b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbd640af000 tx=0x7fbd640b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:48.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.002+0000 7fbd73400640 1 -- 172.21.15.37:0/2123166165 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbd6c056980 con 0x7fbd7c0b5930 2024-05-30T06:48:48.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.190+0000 7fbd81400640 1 -- 172.21.15.37:0/2123166165 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fbd7c0735c0 con 0x7fbd58068bf0 2024-05-30T06:48:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.190+0000 7fbd73400640 1 -- 172.21.15.37:0/2123166165 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fbd7c0735c0 con 0x7fbd58068bf0 2024-05-30T06:48:48.191 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:48:48.191 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:48:48.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:48:48.191 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:48:48.191 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:48:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.194+0000 7fbd81400640 1 -- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd58068bf0 msgr2=0x7fbd5806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.194+0000 7fbd81400640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd58068bf0 0x7fbd5806b0b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbd640af000 tx=0x7fbd640b6040 comp rx=0 tx=0).stop 2024-05-30T06:48:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.194+0000 7fbd81400640 1 -- 172.21.15.37:0/2123166165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd7c0b5930 msgr2=0x7fbd7c15de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.194+0000 7fbd81400640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd7c0b5930 0x7fbd7c15de10 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c001470 tx=0x7fbd6c00a430 comp rx=0 tx=0).stop 2024-05-30T06:48:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.194+0000 7fbd81400640 1 -- 172.21.15.37:0/2123166165 shutdown_connections 2024-05-30T06:48:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.194+0000 7fbd81400640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd7c15fa30 0x7fbd7c140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.194+0000 7fbd81400640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd58068bf0 0x7fbd5806b0b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.194+0000 7fbd81400640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd7c148520 0x7fbd7c13fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.194+0000 7fbd81400640 1 --2- 172.21.15.37:0/2123166165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd7c0b5930 0x7fbd7c15de10 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.194+0000 7fbd81400640 1 -- 172.21.15.37:0/2123166165 >> 172.21.15.37:0/2123166165 conn(0x7fbd7c06b960 msgr2=0x7fbd7c06e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.194+0000 7fbd81400640 1 -- 172.21.15.37:0/2123166165 shutdown_connections 2024-05-30T06:48:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.194+0000 7fbd81400640 1 -- 172.21.15.37:0/2123166165 wait complete. 2024-05-30T06:48:48.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:48:48.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.354+0000 7fe489e00640 1 Processor -- start 2024-05-30T06:48:48.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.354+0000 7fe489e00640 1 -- start start 2024-05-30T06:48:48.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.358+0000 7fe489e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe4840cffd0 0x7fe4840cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:48.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.358+0000 7fe489e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4840af0d0 con 0x7fe4840d0600 2024-05-30T06:48:48.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.358+0000 7fe489e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4840ce000 con 0x7fe48415c9a0 2024-05-30T06:48:48.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.358+0000 7fe489e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe4840ce2e0 con 0x7fe4840cffd0 2024-05-30T06:48:48.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.358+0000 7fe488a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe4840d0600 0x7fe4840d09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50280/0 (socket says 172.21.15.37:50280) 2024-05-30T06:48:48.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.358+0000 7fe488a00640 1 -- 172.21.15.37:0/3459303870 learned_addr learned my addr 172.21.15.37:0/3459303870 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:48.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.358+0000 7fe489400640 1 --2- 172.21.15.37:0/3459303870 >> v2:172.21.15.37:3300/0 conn(0x7fe4840cffd0 0x7fe4840cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:48.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.358+0000 7fe489400640 1 -- 172.21.15.37:0/3459303870 >> v1:172.21.15.105:6789/0 conn(0x7fe48415c9a0 legacy=0x7fe4840afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.358+0000 7fe489400640 1 -- 172.21.15.37:0/3459303870 >> v1:172.21.15.37:6789/0 conn(0x7fe4840d0600 legacy=0x7fe4840d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.358+0000 7fe489400640 1 -- 172.21.15.37:0/3459303870 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4840af370 con 0x7fe4840cffd0 2024-05-30T06:48:48.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.358+0000 7fe483400640 1 -- 172.21.15.37:0/3459303870 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1381264171 0 0) 0x7fe4840af0d0 con 0x7fe4840d0600 2024-05-30T06:48:48.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489400640 1 --2- 172.21.15.37:0/3459303870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4840cffd0 0x7fe4840cd9d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009d90 tx=0x7fe47c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab00c4fdd309665f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:48.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe483400640 1 -- 172.21.15.37:0/3459303870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0b2070 con 0x7fe4840cffd0 2024-05-30T06:48:48.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe483400640 1 -- 172.21.15.37:0/3459303870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47c0a5930 con 0x7fe4840cffd0 2024-05-30T06:48:48.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe483400640 1 -- 172.21.15.37:0/3459303870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0a5d00 con 0x7fe4840cffd0 2024-05-30T06:48:48.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 -- 172.21.15.37:0/3459303870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4840cffd0 msgr2=0x7fe4840cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 --2- 172.21.15.37:0/3459303870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4840cffd0 0x7fe4840cd9d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009d90 tx=0x7fe47c01c940 comp rx=0 tx=0).stop 2024-05-30T06:48:48.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 -- 172.21.15.37:0/3459303870 shutdown_connections 2024-05-30T06:48:48.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 --2- 172.21.15.37:0/3459303870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4840cffd0 0x7fe4840cd9d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 -- 172.21.15.37:0/3459303870 >> 172.21.15.37:0/3459303870 conn(0x7fe4840b3ef0 msgr2=0x7fe4840b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:48.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 -- 172.21.15.37:0/3459303870 shutdown_connections 2024-05-30T06:48:48.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 -- 172.21.15.37:0/3459303870 wait complete. 2024-05-30T06:48:48.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 Processor -- start 2024-05-30T06:48:48.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 -- start start 2024-05-30T06:48:48.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4840cffd0 0x7fe4840cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:48.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4840d0600 0x7fe4840c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:48.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe48415c9a0 0x7fe4840c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:48.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe4840b0e20 con 0x7fe4840cffd0 2024-05-30T06:48:48.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4840b0ca0 con 0x7fe48415c9a0 2024-05-30T06:48:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe48416a340 con 0x7fe4840d0600 2024-05-30T06:48:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe488a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4840cffd0 0x7fe4840cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe488a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4840cffd0 0x7fe4840cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59046/0 (socket says 172.21.15.37:59046) 2024-05-30T06:48:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe488a00640 1 -- 172.21.15.37:0/1467592113 learned_addr learned my addr 172.21.15.37:0/1467592113 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe489400640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe48415c9a0 0x7fe4840c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.362+0000 7fe483e00640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4840d0600 0x7fe4840c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:48.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.366+0000 7fe488a00640 1 -- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4840d0600 msgr2=0x7fe4840c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.366+0000 7fe488a00640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4840d0600 0x7fe4840c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.366+0000 7fe488a00640 1 -- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe48415c9a0 msgr2=0x7fe4840c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.366+0000 7fe488a00640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe48415c9a0 0x7fe4840c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.366+0000 7fe488a00640 1 -- 172.21.15.37:0/1467592113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4841539e0 con 0x7fe4840cffd0 2024-05-30T06:48:48.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.366+0000 7fe488a00640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4840cffd0 0x7fe4840cbe00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c410 tx=0x7fe47800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:48.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.366+0000 7fe480c00640 1 -- 172.21.15.37:0/1467592113 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4780074e0 con 0x7fe4840cffd0 2024-05-30T06:48:48.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.366+0000 7fe480c00640 1 -- 172.21.15.37:0/1467592113 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4780047f0 con 0x7fe4840cffd0 2024-05-30T06:48:48.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.366+0000 7fe480c00640 1 -- 172.21.15.37:0/1467592113 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe478007680 con 0x7fe4840cffd0 2024-05-30T06:48:48.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.366+0000 7fe489e00640 1 -- 172.21.15.37:0/1467592113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe484153140 con 0x7fe4840cffd0 2024-05-30T06:48:48.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.366+0000 7fe489e00640 1 -- 172.21.15.37:0/1467592113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe484153700 con 0x7fe4840cffd0 2024-05-30T06:48:48.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.366+0000 7fe489e00640 1 -- 172.21.15.37:0/1467592113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe484068ab0 con 0x7fe4840cffd0 2024-05-30T06:48:48.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.366+0000 7fe480c00640 1 -- 172.21.15.37:0/1467592113 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fe478011070 con 0x7fe4840cffd0 2024-05-30T06:48:48.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.370+0000 7fe480c00640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe464068bf0 0x7fe46406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:48.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.370+0000 7fe480c00640 1 -- 172.21.15.37:0/1467592113 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fe478084c30 con 0x7fe4840cffd0 2024-05-30T06:48:48.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.370+0000 7fe483e00640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe464068bf0 0x7fe46406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:48.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.370+0000 7fe483e00640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe464068bf0 0x7fe46406b0b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe4840a0420 tx=0x7fe470009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.374+0000 7fe480c00640 1 -- 172.21.15.37:0/1467592113 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe478056650 con 0x7fe4840cffd0 2024-05-30T06:48:48.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe489e00640 1 -- 172.21.15.37:0/1467592113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe4840ce930 con 0x7fe4840cffd0 2024-05-30T06:48:48.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe480c00640 1 -- 172.21.15.37:0/1467592113 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fe47805a950 con 0x7fe4840cffd0 2024-05-30T06:48:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe489e00640 1 -- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe464068bf0 msgr2=0x7fe46406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe489e00640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe464068bf0 0x7fe46406b0b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe4840a0420 tx=0x7fe470009040 comp rx=0 tx=0).stop 2024-05-30T06:48:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe489e00640 1 -- 172.21.15.37:0/1467592113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4840cffd0 msgr2=0x7fe4840cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe489e00640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4840cffd0 0x7fe4840cbe00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c410 tx=0x7fe47800c8d0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe489e00640 1 -- 172.21.15.37:0/1467592113 shutdown_connections 2024-05-30T06:48:48.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe489e00640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe464068bf0 0x7fe46406b0b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe489e00640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe48415c9a0 0x7fe4840c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe489e00640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4840d0600 0x7fe4840c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe489e00640 1 --2- 172.21.15.37:0/1467592113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4840cffd0 0x7fe4840cbe00 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe489e00640 1 -- 172.21.15.37:0/1467592113 >> 172.21.15.37:0/1467592113 conn(0x7fe4840b3ef0 msgr2=0x7fe484157980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:48.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe489e00640 1 -- 172.21.15.37:0/1467592113 shutdown_connections 2024-05-30T06:48:48.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.542+0000 7fe489e00640 1 -- 172.21.15.37:0/1467592113 wait complete. 2024-05-30T06:48:48.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_no_wait false 2024-05-30T06:48:48.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.706+0000 7fd278400640 1 Processor -- start 2024-05-30T06:48:48.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.706+0000 7fd278400640 1 -- start start 2024-05-30T06:48:48.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.706+0000 7fd278400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd2700b59d0 0x7fd2700b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:48.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.706+0000 7fd278400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd27015d7e0 0x7fd270160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:48.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.706+0000 7fd278400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2700b62f0 con 0x7fd27015d350 2024-05-30T06:48:48.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.706+0000 7fd278400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd270142030 con 0x7fd2700b59d0 2024-05-30T06:48:48.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.706+0000 7fd278400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd270142310 con 0x7fd27015d7e0 2024-05-30T06:48:48.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.706+0000 7fd275000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd27015d350 0x7fd270160280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50292/0 (socket says 172.21.15.37:50292) 2024-05-30T06:48:48.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.706+0000 7fd275000640 1 -- 172.21.15.37:0/1349752230 learned_addr learned my addr 172.21.15.37:0/1349752230 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:48.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.710+0000 7fd276400640 1 --2- 172.21.15.37:0/1349752230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd27015d7e0 0x7fd270160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:48.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.710+0000 7fd275a00640 1 --2- 172.21.15.37:0/1349752230 >> v2:172.21.15.105:3300/0 conn(0x7fd2700b59d0 0x7fd2700b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.710+0000 7fd26fe00640 1 -- 172.21.15.37:0/1349752230 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200230192 0 0) 0x7fd2700b62f0 con 0x7fd27015d350 2024-05-30T06:48:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.710+0000 7fd26fe00640 1 -- 172.21.15.37:0/1349752230 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd258003530 con 0x7fd27015d350 2024-05-30T06:48:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.710+0000 7fd275a00640 1 -- 172.21.15.37:0/1349752230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd27015d7e0 msgr2=0x7fd270160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.710+0000 7fd275a00640 1 --2- 172.21.15.37:0/1349752230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd27015d7e0 0x7fd270160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.710+0000 7fd275a00640 1 -- 172.21.15.37:0/1349752230 >> v1:172.21.15.37:6789/0 conn(0x7fd27015d350 legacy=0x7fd270160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.710+0000 7fd275a00640 1 -- 172.21.15.37:0/1349752230 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2701425f0 con 0x7fd2700b59d0 2024-05-30T06:48:48.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.710+0000 7fd275a00640 1 --2- 172.21.15.37:0/1349752230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2700b59d0 0x7fd2700b5db0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd2640097f0 tx=0x7fd26401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c6598ccd28fc319 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:48.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.710+0000 7fd26fe00640 1 -- 172.21.15.37:0/1349752230 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2640b5070 con 0x7fd2700b59d0 2024-05-30T06:48:48.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.710+0000 7fd26fe00640 1 -- 172.21.15.37:0/1349752230 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2640a8990 con 0x7fd2700b59d0 2024-05-30T06:48:48.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.710+0000 7fd26fe00640 1 -- 172.21.15.37:0/1349752230 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2640a8d60 con 0x7fd2700b59d0 2024-05-30T06:48:48.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 -- 172.21.15.37:0/1349752230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2700b59d0 msgr2=0x7fd2700b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 --2- 172.21.15.37:0/1349752230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2700b59d0 0x7fd2700b5db0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd2640097f0 tx=0x7fd26401ec90 comp rx=0 tx=0).stop 2024-05-30T06:48:48.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 -- 172.21.15.37:0/1349752230 shutdown_connections 2024-05-30T06:48:48.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 --2- 172.21.15.37:0/1349752230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd27015d7e0 0x7fd270160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 --2- 172.21.15.37:0/1349752230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2700b59d0 0x7fd2700b5db0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 -- 172.21.15.37:0/1349752230 >> 172.21.15.37:0/1349752230 conn(0x7fd27006bf60 msgr2=0x7fd2700b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 -- 172.21.15.37:0/1349752230 shutdown_connections 2024-05-30T06:48:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 -- 172.21.15.37:0/1349752230 wait complete. 2024-05-30T06:48:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 Processor -- start 2024-05-30T06:48:48.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 -- start start 2024-05-30T06:48:48.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2700b59d0 0x7fd270136cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:48.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27015d350 0x7fd27015b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:48.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd27015d7e0 0x7fd27015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:48.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd27013fe60 con 0x7fd27015d350 2024-05-30T06:48:48.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd27013fce0 con 0x7fd27015d7e0 2024-05-30T06:48:48.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd278400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd2700aff20 con 0x7fd2700b59d0 2024-05-30T06:48:48.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd275000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27015d350 0x7fd27015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:48.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd275000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27015d350 0x7fd27015b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59050/0 (socket says 172.21.15.37:59050) 2024-05-30T06:48:48.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd275000640 1 -- 172.21.15.37:0/1738915017 learned_addr learned my addr 172.21.15.37:0/1738915017 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:48.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd276400640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd27015d7e0 0x7fd27015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:48.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.714+0000 7fd275a00640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2700b59d0 0x7fd270136cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd275000640 1 -- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2700b59d0 msgr2=0x7fd270136cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd275000640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2700b59d0 0x7fd270136cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd275000640 1 -- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd27015d7e0 msgr2=0x7fd27015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd275000640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd27015d7e0 0x7fd27015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd275000640 1 -- 172.21.15.37:0/1738915017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27015be40 con 0x7fd27015d350 2024-05-30T06:48:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd275a00640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2700b59d0 0x7fd270136cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:48:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd275000640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27015d350 0x7fd27015b230 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00c450 tx=0x7fd25c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd26d600640 1 -- 172.21.15.37:0/1738915017 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c017070 con 0x7fd27015d350 2024-05-30T06:48:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd26d600640 1 -- 172.21.15.37:0/1738915017 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd25c005cf0 con 0x7fd27015d350 2024-05-30T06:48:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd26d600640 1 -- 172.21.15.37:0/1738915017 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c007290 con 0x7fd27015d350 2024-05-30T06:48:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd278400640 1 -- 172.21.15.37:0/1738915017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd27015c120 con 0x7fd27015d350 2024-05-30T06:48:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd278400640 1 -- 172.21.15.37:0/1738915017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2700b3880 con 0x7fd27015d350 2024-05-30T06:48:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd278400640 1 -- 172.21.15.37:0/1738915017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd270068bc0 con 0x7fd27015d350 2024-05-30T06:48:48.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd26d600640 1 -- 172.21.15.37:0/1738915017 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7fd25c01a070 con 0x7fd27015d350 2024-05-30T06:48:48.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd26d600640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd250068bf0 0x7fd25006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:48.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd26d600640 1 -- 172.21.15.37:0/1738915017 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fd25c086ec0 con 0x7fd27015d350 2024-05-30T06:48:48.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.718+0000 7fd275a00640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd250068bf0 0x7fd25006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:48.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.722+0000 7fd275a00640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd250068bf0 0x7fd25006b0b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd2640b2000 tx=0x7fd264008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.722+0000 7fd26d600640 1 -- 172.21.15.37:0/1738915017 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd25c055f10 con 0x7fd27015d350 2024-05-30T06:48:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.890+0000 7fd278400640 1 -- 172.21.15.37:0/1738915017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}] v 0) -- 0x7fd27006f0a0 con 0x7fd27015d350 2024-05-30T06:48:48.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.894+0000 7fd26d600640 1 -- 172.21.15.37:0/1738915017 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}]=0 v15)=0 v15) ==== 136+0+0 (secure 0 0 0) 0x7fd25c05a210 con 0x7fd27015d350 2024-05-30T06:48:48.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.894+0000 7fd278400640 1 -- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd250068bf0 msgr2=0x7fd25006b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.894+0000 7fd278400640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd250068bf0 0x7fd25006b0b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd2640b2000 tx=0x7fd264008040 comp rx=0 tx=0).stop 2024-05-30T06:48:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.894+0000 7fd278400640 1 -- 172.21.15.37:0/1738915017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27015d350 msgr2=0x7fd27015b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.894+0000 7fd278400640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27015d350 0x7fd27015b230 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00c450 tx=0x7fd25c00c910 comp rx=0 tx=0).stop 2024-05-30T06:48:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.894+0000 7fd278400640 1 -- 172.21.15.37:0/1738915017 shutdown_connections 2024-05-30T06:48:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.894+0000 7fd278400640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd250068bf0 0x7fd25006b0b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.894+0000 7fd278400640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd27015d7e0 0x7fd27015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.894+0000 7fd278400640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd27015d350 0x7fd27015b230 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.894+0000 7fd278400640 1 --2- 172.21.15.37:0/1738915017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2700b59d0 0x7fd270136cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.894+0000 7fd278400640 1 -- 172.21.15.37:0/1738915017 >> 172.21.15.37:0/1738915017 conn(0x7fd27006bf60 msgr2=0x7fd2700aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.894+0000 7fd278400640 1 -- 172.21.15.37:0/1738915017 shutdown_connections 2024-05-30T06:48:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:48.898+0000 7fd278400640 1 -- 172.21.15.37:0/1738915017 wait complete. 2024-05-30T06:48:48.915 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:48.917+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:48.915 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:48.917+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:48.915 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:48.917+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:48.915 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:48.917+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:48.915 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:48.917+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:48.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T06:48:49.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f325ca00640 1 Processor -- start 2024-05-30T06:48:49.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f325ca00640 1 -- start start 2024-05-30T06:48:49.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f325ca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f325806df50 0x7f32580afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f325ca00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32580b3f60 con 0x7f32580ae740 2024-05-30T06:48:49.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f325ca00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32580b36c0 con 0x7f32581623f0 2024-05-30T06:48:49.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f325ca00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3258163270 con 0x7f325806df50 2024-05-30T06:48:49.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3256800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f32580ae740 0x7f32580aebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50294/0 (socket says 172.21.15.37:50294) 2024-05-30T06:48:49.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3256800640 1 -- 172.21.15.37:0/2290232487 learned_addr learned my addr 172.21.15.37:0/2290232487 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:48:49.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f324fe00640 1 --2- 172.21.15.37:0/2290232487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f325806df50 0x7f32580afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:49.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2104374379 0 0) 0x7f32500014a0 con 0x7f32580ae740 2024-05-30T06:48:49.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f323c003530 con 0x7f32580ae740 2024-05-30T06:48:49.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 597833276 0 0) 0x7f323c003530 con 0x7f32580ae740 2024-05-30T06:48:49.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f325806df50 msgr2=0x7f32580afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:49.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 --2- 172.21.15.37:0/2290232487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f325806df50 0x7f32580afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 >> v1:172.21.15.105:6789/0 conn(0x7f32581623f0 legacy=0x7f32581627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:49.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32580b39a0 con 0x7f32580ae740 2024-05-30T06:48:49.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f3250001bd0 con 0x7f32580ae740 2024-05-30T06:48:49.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 >> v1:172.21.15.37:6789/0 conn(0x7f32580ae740 legacy=0x7f32580aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:49.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 --2- 172.21.15.37:0/2290232487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f325806df50 0x7f323c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 --2- 172.21.15.37:0/2290232487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c003f30 0x7f323c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 --2- 172.21.15.37:0/2290232487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f323c004d50 0x7f323c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f323c00ba00 con 0x7f323c003f30 2024-05-30T06:48:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f323c00bbb0 con 0x7f323c004d50 2024-05-30T06:48:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f323c00bdb0 con 0x7f325806df50 2024-05-30T06:48:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f324fe00640 1 --2- 172.21.15.37:0/2290232487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c003f30 0x7f323c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3255e00640 1 --2- 172.21.15.37:0/2290232487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f325806df50 0x7f323c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f3256800640 1 --2- 172.21.15.37:0/2290232487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f323c004d50 0x7f323c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f324fe00640 1 -- 172.21.15.37:0/2290232487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f325806df50 msgr2=0x7f323c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.062+0000 7f324fe00640 1 --2- 172.21.15.37:0/2290232487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f325806df50 0x7f323c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f324fe00640 1 -- 172.21.15.37:0/2290232487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f323c004d50 msgr2=0x7f323c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f324fe00640 1 --2- 172.21.15.37:0/2290232487 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f323c004d50 0x7f323c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f324fe00640 1 -- 172.21.15.37:0/2290232487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c003530 con 0x7f323c003f30 2024-05-30T06:48:49.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f324fe00640 1 --2- 172.21.15.37:0/2290232487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c003f30 0x7f323c004810 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3240009ae0 tx=0x7f324001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febdf5b457a83b1d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32400b2070 con 0x7f323c003f30 2024-05-30T06:48:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32400a55a0 con 0x7f323c003f30 2024-05-30T06:48:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f3255400640 1 -- 172.21.15.37:0/2290232487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32400096b0 con 0x7f323c003f30 2024-05-30T06:48:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f325ca00640 1 -- 172.21.15.37:0/2290232487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c003f30 msgr2=0x7f323c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f325ca00640 1 --2- 172.21.15.37:0/2290232487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c003f30 0x7f323c004810 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f3240009ae0 tx=0x7f324001c9b0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f3256800640 1 -- 172.21.15.37:0/2290232487 reap_dead start 2024-05-30T06:48:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f325ca00640 1 -- 172.21.15.37:0/2290232487 shutdown_connections 2024-05-30T06:48:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f325ca00640 1 -- 172.21.15.37:0/2290232487 >> 172.21.15.37:0/2290232487 conn(0x7f325806bf60 msgr2=0x7f32580b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f325ca00640 1 -- 172.21.15.37:0/2290232487 shutdown_connections 2024-05-30T06:48:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.066+0000 7f325ca00640 1 -- 172.21.15.37:0/2290232487 wait complete. 2024-05-30T06:48:49.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f325ca00640 1 Processor -- start 2024-05-30T06:48:49.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f325ca00640 1 -- start start 2024-05-30T06:48:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f325ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c003f30 0x7f32580cece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f325ca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f325813c660 0x7f3258144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f325ca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f325813db90 0x7f325815fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f325ca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f32580af2e0 con 0x7f323c003f30 2024-05-30T06:48:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f325ca00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f32580ae2b0 con 0x7f325813c660 2024-05-30T06:48:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f325ca00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f32580adf40 con 0x7f325813db90 2024-05-30T06:48:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f3255e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c003f30 0x7f32580cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f3255e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c003f30 0x7f32580cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59078/0 (socket says 172.21.15.37:59078) 2024-05-30T06:48:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f3255e00640 1 -- 172.21.15.37:0/1947955391 learned_addr learned my addr 172.21.15.37:0/1947955391 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f3255e00640 1 -- 172.21.15.37:0/1947955391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f325813db90 msgr2=0x7f325815fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f3255e00640 1 --2- 172.21.15.37:0/1947955391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f325813db90 0x7f325815fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f3255e00640 1 -- 172.21.15.37:0/1947955391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f325813c660 msgr2=0x7f3258144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f3255e00640 1 --2- 172.21.15.37:0/1947955391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f325813c660 0x7f3258144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f3255e00640 1 -- 172.21.15.37:0/1947955391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32580b2180 con 0x7f323c003f30 2024-05-30T06:48:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f3255e00640 1 --2- 172.21.15.37:0/1947955391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c003f30 0x7f32580cece0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3248011bb0 tx=0x7f324800f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f324e000640 1 -- 172.21.15.37:0/1947955391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3248019020 con 0x7f323c003f30 2024-05-30T06:48:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f324e000640 1 -- 172.21.15.37:0/1947955391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324800fbd0 con 0x7f323c003f30 2024-05-30T06:48:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f324e000640 1 -- 172.21.15.37:0/1947955391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32480050d0 con 0x7f323c003f30 2024-05-30T06:48:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f325ca00640 1 -- 172.21.15.37:0/1947955391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32580cf220 con 0x7f323c003f30 2024-05-30T06:48:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.070+0000 7f325ca00640 1 -- 172.21.15.37:0/1947955391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f325813cdd0 con 0x7f323c003f30 2024-05-30T06:48:49.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.074+0000 7f325ca00640 1 -- 172.21.15.37:0/1947955391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3258068d40 con 0x7f323c003f30 2024-05-30T06:48:49.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.074+0000 7f324e000640 1 -- 172.21.15.37:0/1947955391 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f324801c020 con 0x7f323c003f30 2024-05-30T06:48:49.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.074+0000 7f324e000640 1 --2- 172.21.15.37:0/1947955391 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3234068bf0 0x7f323406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.074+0000 7f324e000640 1 -- 172.21.15.37:0/1947955391 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f324808b320 con 0x7f323c003f30 2024-05-30T06:48:49.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.074+0000 7f324fe00640 1 --2- 172.21.15.37:0/1947955391 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3234068bf0 0x7f323406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:49.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.074+0000 7f324fe00640 1 --2- 172.21.15.37:0/1947955391 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3234068bf0 0x7f323406b0b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f32400af000 tx=0x7f3240004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:49.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.078+0000 7f324e000640 1 -- 172.21.15.37:0/1947955391 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3248023020 con 0x7f323c003f30 2024-05-30T06:48:49.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.270+0000 7f325ca00640 1 -- 172.21.15.37:0/1947955391 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f32580adb80 con 0x7f3234068bf0 2024-05-30T06:48:49.278 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:49.277+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:49.279 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:49.281+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:49.279 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:49.281+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:49.279 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:49.281+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:49.279 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:48:49.281+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:48:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.310+0000 7f324e000640 1 -- 172.21.15.37:0/1947955391 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f32580adb80 con 0x7f3234068bf0 2024-05-30T06:48:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.314+0000 7f325ca00640 1 -- 172.21.15.37:0/1947955391 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3234068bf0 msgr2=0x7f323406b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.314+0000 7f325ca00640 1 --2- 172.21.15.37:0/1947955391 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3234068bf0 0x7f323406b0b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f32400af000 tx=0x7f3240004740 comp rx=0 tx=0).stop 2024-05-30T06:48:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.314+0000 7f325ca00640 1 -- 172.21.15.37:0/1947955391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c003f30 msgr2=0x7f32580cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.314+0000 7f325ca00640 1 --2- 172.21.15.37:0/1947955391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c003f30 0x7f32580cece0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3248011bb0 tx=0x7f324800f5a0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.314+0000 7f325ca00640 1 -- 172.21.15.37:0/1947955391 shutdown_connections 2024-05-30T06:48:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.314+0000 7f325ca00640 1 --2- 172.21.15.37:0/1947955391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f325813db90 0x7f325815fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.314+0000 7f325ca00640 1 --2- 172.21.15.37:0/1947955391 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3234068bf0 0x7f323406b0b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.314+0000 7f325ca00640 1 --2- 172.21.15.37:0/1947955391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f325813c660 0x7f3258144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.314+0000 7f325ca00640 1 --2- 172.21.15.37:0/1947955391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f323c003f30 0x7f32580cece0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.314+0000 7f325ca00640 1 -- 172.21.15.37:0/1947955391 >> 172.21.15.37:0/1947955391 conn(0x7f325806bf60 msgr2=0x7f325806e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.314+0000 7f325ca00640 1 -- 172.21.15.37:0/1947955391 shutdown_connections 2024-05-30T06:48:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.314+0000 7f325ca00640 1 -- 172.21.15.37:0/1947955391 wait complete. 2024-05-30T06:48:49.334 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:48:49.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3634600640 1 Processor -- start 2024-05-30T06:48:49.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3634600640 1 -- start start 2024-05-30T06:48:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3634600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f362c0b59d0 0x7f362c0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3634600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f362c15d7e0 0x7f362c160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3634600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362c0b62f0 con 0x7f362c15d350 2024-05-30T06:48:49.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3634600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f362c142030 con 0x7f362c0b59d0 2024-05-30T06:48:49.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3634600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f362c142310 con 0x7f362c15d7e0 2024-05-30T06:48:49.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3631c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f362c0b59d0 0x7f362c0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:49.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3631c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f362c0b59d0 0x7f362c0b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59090/0 (socket says 172.21.15.37:59090) 2024-05-30T06:48:49.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3631c00640 1 -- 172.21.15.37:0/4010831205 learned_addr learned my addr 172.21.15.37:0/4010831205 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3632600640 1 --2- 172.21.15.37:0/4010831205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f362c15d7e0 0x7f362c160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3631c00640 1 -- 172.21.15.37:0/4010831205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f362c15d7e0 msgr2=0x7f362c160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:48:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3631c00640 1 --2- 172.21.15.37:0/4010831205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f362c15d7e0 0x7f362c160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3631c00640 1 -- 172.21.15.37:0/4010831205 >> v1:172.21.15.105:6789/0 conn(0x7f362c15d350 legacy=0x7f362c160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.478+0000 7f3631c00640 1 -- 172.21.15.37:0/4010831205 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c1425f0 con 0x7f362c0b59d0 2024-05-30T06:48:49.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.482+0000 7f3631c00640 1 --2- 172.21.15.37:0/4010831205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362c0b59d0 0x7f362c0b5db0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f36200098a0 tx=0x7f362001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad993ced9896d18 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:49.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.482+0000 7f362be00640 1 -- 172.21.15.37:0/4010831205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36200b5070 con 0x7f362c0b59d0 2024-05-30T06:48:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.482+0000 7f362be00640 1 -- 172.21.15.37:0/4010831205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36200a8a30 con 0x7f362c0b59d0 2024-05-30T06:48:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.482+0000 7f362be00640 1 -- 172.21.15.37:0/4010831205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36200a8e00 con 0x7f362c0b59d0 2024-05-30T06:48:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.482+0000 7f3634600640 1 -- 172.21.15.37:0/4010831205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362c0b59d0 msgr2=0x7f362c0b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.482+0000 7f3634600640 1 --2- 172.21.15.37:0/4010831205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362c0b59d0 0x7f362c0b5db0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f36200098a0 tx=0x7f362001ed30 comp rx=0 tx=0).stop 2024-05-30T06:48:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.482+0000 7f3634600640 1 -- 172.21.15.37:0/4010831205 shutdown_connections 2024-05-30T06:48:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.482+0000 7f3634600640 1 --2- 172.21.15.37:0/4010831205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f362c15d7e0 0x7f362c160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.482+0000 7f3634600640 1 --2- 172.21.15.37:0/4010831205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362c0b59d0 0x7f362c0b5db0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.482+0000 7f3634600640 1 -- 172.21.15.37:0/4010831205 >> 172.21.15.37:0/4010831205 conn(0x7f362c06bf60 msgr2=0x7f362c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.482+0000 7f3634600640 1 -- 172.21.15.37:0/4010831205 shutdown_connections 2024-05-30T06:48:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.482+0000 7f3634600640 1 -- 172.21.15.37:0/4010831205 wait complete. 2024-05-30T06:48:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3634600640 1 Processor -- start 2024-05-30T06:48:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3634600640 1 -- start start 2024-05-30T06:48:49.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3634600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f362c0b59d0 0x7f362c154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3634600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362c15d350 0x7f362c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3634600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f362c15d7e0 0x7f362c13e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3634600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f362c13fe60 con 0x7f362c15d350 2024-05-30T06:48:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3634600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f362c13fce0 con 0x7f362c15d7e0 2024-05-30T06:48:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3634600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f362c0aff20 con 0x7f362c0b59d0 2024-05-30T06:48:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3631200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362c15d350 0x7f362c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3631200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362c15d350 0x7f362c153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59100/0 (socket says 172.21.15.37:59100) 2024-05-30T06:48:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3631200640 1 -- 172.21.15.37:0/3987135178 learned_addr learned my addr 172.21.15.37:0/3987135178 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:48:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3632600640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f362c15d7e0 0x7f362c13e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3631c00640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f362c0b59d0 0x7f362c154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3631200640 1 -- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f362c0b59d0 msgr2=0x7f362c154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3631200640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f362c0b59d0 0x7f362c154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3631200640 1 -- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f362c15d7e0 msgr2=0x7f362c13e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3631200640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f362c15d7e0 0x7f362c13e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3631200640 1 -- 172.21.15.37:0/3987135178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c15abc0 con 0x7f362c15d350 2024-05-30T06:48:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3631200640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362c15d350 0x7f362c153e90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f361800c450 tx=0x7f361800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3629600640 1 -- 172.21.15.37:0/3987135178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3618016020 con 0x7f362c15d350 2024-05-30T06:48:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3629600640 1 -- 172.21.15.37:0/3987135178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36180052d0 con 0x7f362c15d350 2024-05-30T06:48:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3629600640 1 -- 172.21.15.37:0/3987135178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3618007260 con 0x7f362c15d350 2024-05-30T06:48:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.486+0000 7f3634600640 1 -- 172.21.15.37:0/3987135178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f362c154d90 con 0x7f362c15d350 2024-05-30T06:48:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.490+0000 7f3634600640 1 -- 172.21.15.37:0/3987135178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f362c15ae80 con 0x7f362c15d350 2024-05-30T06:48:49.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.490+0000 7f3634600640 1 -- 172.21.15.37:0/3987135178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f362c068bc0 con 0x7f362c15d350 2024-05-30T06:48:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.490+0000 7f3629600640 1 -- 172.21.15.37:0/3987135178 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 88752+0+0 (secure 0 0 0) 0x7f3618007400 con 0x7f362c15d350 2024-05-30T06:48:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.490+0000 7f3629600640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f360c068bf0 0x7f360c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:48:49.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.490+0000 7f3629600640 1 -- 172.21.15.37:0/3987135178 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f36180873d0 con 0x7f362c15d350 2024-05-30T06:48:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.490+0000 7f3631c00640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f360c068bf0 0x7f360c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:48:49.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.494+0000 7f3631c00640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f360c068bf0 0x7f360c06b0b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f36200b2000 tx=0x7f3620009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:48:49.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.494+0000 7f3629600640 1 -- 172.21.15.37:0/3987135178 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3618020020 con 0x7f362c15d350 2024-05-30T06:48:49.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.690+0000 7f3634600640 1 -- 172.21.15.37:0/3987135178 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f362c06ebb0 con 0x7f360c068bf0 2024-05-30T06:48:49.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.694+0000 7f3629600640 1 -- 172.21.15.37:0/3987135178 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f362c06ebb0 con 0x7f360c068bf0 2024-05-30T06:48:49.695 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/a4540fde-885b-48e7-abfe-fa7259ba5347 2024-05-30T06:48:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.698+0000 7f3634600640 1 -- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f360c068bf0 msgr2=0x7f360c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.698+0000 7f3634600640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f360c068bf0 0x7f360c06b0b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f36200b2000 tx=0x7f3620009040 comp rx=0 tx=0).stop 2024-05-30T06:48:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.698+0000 7f3634600640 1 -- 172.21.15.37:0/3987135178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362c15d350 msgr2=0x7f362c153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:48:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.698+0000 7f3634600640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362c15d350 0x7f362c153e90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f361800c450 tx=0x7f361800c910 comp rx=0 tx=0).stop 2024-05-30T06:48:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.698+0000 7f3634600640 1 -- 172.21.15.37:0/3987135178 shutdown_connections 2024-05-30T06:48:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.698+0000 7f3634600640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f360c068bf0 0x7f360c06b0b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.698+0000 7f3634600640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f362c15d7e0 0x7f362c13e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.698+0000 7f3634600640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f362c15d350 0x7f362c153e90 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.698+0000 7f3634600640 1 --2- 172.21.15.37:0/3987135178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f362c0b59d0 0x7f362c154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:48:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.698+0000 7f3634600640 1 -- 172.21.15.37:0/3987135178 >> 172.21.15.37:0/3987135178 conn(0x7f362c06bf60 msgr2=0x7f362c06df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:48:49.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.698+0000 7f3634600640 1 -- 172.21.15.37:0/3987135178 shutdown_connections 2024-05-30T06:48:49.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:48:49.698+0000 7f3634600640 1 -- 172.21.15.37:0/3987135178 wait complete. 2024-05-30T06:48:49.718 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/a4540fde-885b-48e7-abfe-fa7259ba5347 2024-05-30T06:48:49.718 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:48:49.718 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:48:49.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:48:49.727 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a4540fde-885b-48e7-abfe-fa7259ba5347/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:48:58.245 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:48:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:48:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.45989 s, 127 MB/s 2024-05-30T06:48:58.247 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:48:58.247 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:48:58.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:48:58.256 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a4540fde-885b-48e7-abfe-fa7259ba5347/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:49:04.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:49:04.577 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:49:06.827 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:49:06.828 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:49:06.828 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.5176 s, 126 MB/s 2024-05-30T06:49:06.829 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:49:06.829 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:49:06.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:49:06.838 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/a4540fde-885b-48e7-abfe-fa7259ba5347/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:49:15.247 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:49:15.247 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:49:15.247 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.35334 s, 129 MB/s 2024-05-30T06:49:15.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T06:49:15.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.394+0000 7f39cd000640 1 Processor -- start 2024-05-30T06:49:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.394+0000 7f39cd000640 1 -- start start 2024-05-30T06:49:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39cd000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f39c80cd400 0x7f39c806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39cd000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c80ce030 con 0x7f39c81590c0 2024-05-30T06:49:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39cd000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c815f230 con 0x7f39c806f5a0 2024-05-30T06:49:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39cd000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f39c815f510 con 0x7f39c80cd400 2024-05-30T06:49:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39c5e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f39c81590c0 0x7f39c80cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40220/0 (socket says 172.21.15.37:40220) 2024-05-30T06:49:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39c5e00640 1 -- 172.21.15.37:0/1486606362 learned_addr learned my addr 172.21.15.37:0/1486606362 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39bfe00640 1 --2- 172.21.15.37:0/1486606362 >> v2:172.21.15.105:3300/0 conn(0x7f39c80cd400 0x7f39c806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39c5400640 1 -- 172.21.15.37:0/1486606362 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1737124729 0 0) 0x7f39c80ce030 con 0x7f39c81590c0 2024-05-30T06:49:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39c5400640 1 -- 172.21.15.37:0/1486606362 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39ac003530 con 0x7f39c81590c0 2024-05-30T06:49:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39c5400640 1 -- 172.21.15.37:0/1486606362 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659189356 0 0) 0x7f39c815f230 con 0x7f39c806f5a0 2024-05-30T06:49:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39c5400640 1 -- 172.21.15.37:0/1486606362 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39c80ce030 con 0x7f39c806f5a0 2024-05-30T06:49:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39bfe00640 1 -- 172.21.15.37:0/1486606362 >> v1:172.21.15.105:6789/0 conn(0x7f39c806f5a0 legacy=0x7f39c80b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39bfe00640 1 -- 172.21.15.37:0/1486606362 >> v1:172.21.15.37:6789/0 conn(0x7f39c81590c0 legacy=0x7f39c80cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.398+0000 7f39bfe00640 1 -- 172.21.15.37:0/1486606362 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c815f7f0 con 0x7f39c80cd400 2024-05-30T06:49:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39bfe00640 1 --2- 172.21.15.37:0/1486606362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c80cd400 0x7f39c806f060 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f39b00097c0 tx=0x7f39b001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c347dadeb7c8789d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39c5400640 1 -- 172.21.15.37:0/1486606362 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b00b0070 con 0x7f39c80cd400 2024-05-30T06:49:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39c5400640 1 -- 172.21.15.37:0/1486606362 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b00ab600 con 0x7f39c80cd400 2024-05-30T06:49:15.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39c5400640 1 -- 172.21.15.37:0/1486606362 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b00ab9d0 con 0x7f39c80cd400 2024-05-30T06:49:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 -- 172.21.15.37:0/1486606362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c80cd400 msgr2=0x7f39c806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 --2- 172.21.15.37:0/1486606362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c80cd400 0x7f39c806f060 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f39b00097c0 tx=0x7f39b001c380 comp rx=0 tx=0).stop 2024-05-30T06:49:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 -- 172.21.15.37:0/1486606362 shutdown_connections 2024-05-30T06:49:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 --2- 172.21.15.37:0/1486606362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c80cd400 0x7f39c806f060 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 -- 172.21.15.37:0/1486606362 >> 172.21.15.37:0/1486606362 conn(0x7f39c806bf60 msgr2=0x7f39c80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 -- 172.21.15.37:0/1486606362 shutdown_connections 2024-05-30T06:49:15.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 -- 172.21.15.37:0/1486606362 wait complete. 2024-05-30T06:49:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 Processor -- start 2024-05-30T06:49:15.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 -- start start 2024-05-30T06:49:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c806f5a0 0x7f39c814b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39c80cd400 0x7f39c815b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c81590c0 0x7f39c815b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:15.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39c81694b0 con 0x7f39c81590c0 2024-05-30T06:49:15.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39c806f9b0 con 0x7f39c806f5a0 2024-05-30T06:49:15.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.402+0000 7f39cd000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39c8169630 con 0x7f39c80cd400 2024-05-30T06:49:15.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39c6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c81590c0 0x7f39c815b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:15.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39c6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c81590c0 0x7f39c815b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45008/0 (socket says 172.21.15.37:45008) 2024-05-30T06:49:15.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39c6800640 1 -- 172.21.15.37:0/3489629919 learned_addr learned my addr 172.21.15.37:0/3489629919 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:15.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39c5e00640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c806f5a0 0x7f39c814b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:15.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39bfe00640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39c80cd400 0x7f39c815b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:15.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39c6800640 1 -- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39c80cd400 msgr2=0x7f39c815b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:15.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39c6800640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39c80cd400 0x7f39c815b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:15.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39c6800640 1 -- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c806f5a0 msgr2=0x7f39c814b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:15.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39c6800640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c806f5a0 0x7f39c814b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:15.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39c6800640 1 -- 172.21.15.37:0/3489629919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c8146e00 con 0x7f39c81590c0 2024-05-30T06:49:15.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39c6800640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c81590c0 0x7f39c815b6f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f39c000c790 tx=0x7f39c000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:15.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39be000640 1 -- 172.21.15.37:0/3489629919 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c0003b80 con 0x7f39c81590c0 2024-05-30T06:49:15.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39be000640 1 -- 172.21.15.37:0/3489629919 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c0003d20 con 0x7f39c81590c0 2024-05-30T06:49:15.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39cd000640 1 -- 172.21.15.37:0/3489629919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c81470e0 con 0x7f39c81590c0 2024-05-30T06:49:15.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39be000640 1 -- 172.21.15.37:0/3489629919 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c000aa50 con 0x7f39c81590c0 2024-05-30T06:49:15.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39cd000640 1 -- 172.21.15.37:0/3489629919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c8147bc0 con 0x7f39c81590c0 2024-05-30T06:49:15.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39cd000640 1 -- 172.21.15.37:0/3489629919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c8147eb0 con 0x7f39c81590c0 2024-05-30T06:49:15.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.406+0000 7f39be000640 1 -- 172.21.15.37:0/3489629919 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 88854+0+0 (secure 0 0 0) 0x7f39c000abf0 con 0x7f39c81590c0 2024-05-30T06:49:15.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.410+0000 7f39be000640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f39a4068d10 0x7f39a406b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:15.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.410+0000 7f39be000640 1 -- 172.21.15.37:0/3489629919 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f39c0084f70 con 0x7f39c81590c0 2024-05-30T06:49:15.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.410+0000 7f39c5e00640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f39a4068d10 0x7f39a406b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:15.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.410+0000 7f39c5e00640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f39a4068d10 0x7f39a406b1d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f39b80011f0 tx=0x7f39b8007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:15.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.414+0000 7f39be000640 1 -- 172.21.15.37:0/3489629919 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39c0056ae0 con 0x7f39c81590c0 2024-05-30T06:49:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.610+0000 7f39cd000640 1 -- 172.21.15.37:0/3489629919 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f39c814be00 con 0x7f39a4068d10 2024-05-30T06:49:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.622+0000 7f39be000640 1 -- 172.21.15.37:0/3489629919 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f39c814be00 con 0x7f39a4068d10 2024-05-30T06:49:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.622+0000 7f39cd000640 1 -- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f39a4068d10 msgr2=0x7f39a406b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.622+0000 7f39cd000640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f39a4068d10 0x7f39a406b1d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f39b80011f0 tx=0x7f39b8007d40 comp rx=0 tx=0).stop 2024-05-30T06:49:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.622+0000 7f39cd000640 1 -- 172.21.15.37:0/3489629919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c81590c0 msgr2=0x7f39c815b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.622+0000 7f39cd000640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c81590c0 0x7f39c815b6f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f39c000c790 tx=0x7f39c000cc50 comp rx=0 tx=0).stop 2024-05-30T06:49:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.622+0000 7f39cd000640 1 -- 172.21.15.37:0/3489629919 shutdown_connections 2024-05-30T06:49:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.622+0000 7f39cd000640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c81590c0 0x7f39c815b6f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.622+0000 7f39cd000640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39c80cd400 0x7f39c815b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.622+0000 7f39cd000640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f39a4068d10 0x7f39a406b1d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.622+0000 7f39cd000640 1 --2- 172.21.15.37:0/3489629919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39c806f5a0 0x7f39c814b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.622+0000 7f39cd000640 1 -- 172.21.15.37:0/3489629919 >> 172.21.15.37:0/3489629919 conn(0x7f39c806bf60 msgr2=0x7f39c814e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.622+0000 7f39cd000640 1 -- 172.21.15.37:0/3489629919 shutdown_connections 2024-05-30T06:49:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.622+0000 7f39cd000640 1 -- 172.21.15.37:0/3489629919 wait complete. 2024-05-30T06:49:15.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:49:15.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.786+0000 7f36bf200640 1 Processor -- start 2024-05-30T06:49:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.786+0000 7f36bf200640 1 -- start start 2024-05-30T06:49:15.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bf200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b809aa60 0x7f36b80d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bf200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f36b80d2fa0 0x7f36b809ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bf200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36b80d14c0 con 0x7f36b806e750 2024-05-30T06:49:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bf200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f36b80d21c0 con 0x7f36b80d2fa0 2024-05-30T06:49:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bf200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f36b809b380 con 0x7f36b809aa60 2024-05-30T06:49:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36be800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f36b806e750 0x7f36b80af350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40226/0 (socket says 172.21.15.37:40226) 2024-05-30T06:49:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36be800640 1 -- 172.21.15.37:0/2997243926 learned_addr learned my addr 172.21.15.37:0/2997243926 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bd400640 1 --2- 172.21.15.37:0/2997243926 >> v2:172.21.15.105:3300/0 conn(0x7f36b80d2fa0 0x7f36b809ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bde00640 1 --2- 172.21.15.37:0/2997243926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b809aa60 0x7f36b80d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bca00640 1 -- 172.21.15.37:0/2997243926 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354839598 0 0) 0x7f36b80d14c0 con 0x7f36b806e750 2024-05-30T06:49:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bca00640 1 -- 172.21.15.37:0/2997243926 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36a0003530 con 0x7f36b806e750 2024-05-30T06:49:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bd400640 1 -- 172.21.15.37:0/2997243926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b809aa60 msgr2=0x7f36b80d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bd400640 1 --2- 172.21.15.37:0/2997243926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b809aa60 0x7f36b80d1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:15.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bd400640 1 -- 172.21.15.37:0/2997243926 >> v1:172.21.15.37:6789/0 conn(0x7f36b806e750 legacy=0x7f36b80af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:15.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bd400640 1 -- 172.21.15.37:0/2997243926 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b806cba0 con 0x7f36b80d2fa0 2024-05-30T06:49:15.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.790+0000 7f36bde00640 1 --2- 172.21.15.37:0/2997243926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b809aa60 0x7f36b80d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:49:15.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bd400640 1 --2- 172.21.15.37:0/2997243926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b80d2fa0 0x7f36b809ae40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f36a80097c0 tx=0x7f36a801c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd4a8a921c787954 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:15.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bca00640 1 -- 172.21.15.37:0/2997243926 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a80b0070 con 0x7f36b80d2fa0 2024-05-30T06:49:15.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bca00640 1 -- 172.21.15.37:0/2997243926 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a8004230 con 0x7f36b80d2fa0 2024-05-30T06:49:15.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bca00640 1 -- 172.21.15.37:0/2997243926 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a8003620 con 0x7f36b80d2fa0 2024-05-30T06:49:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 -- 172.21.15.37:0/2997243926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b80d2fa0 msgr2=0x7f36b809ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 --2- 172.21.15.37:0/2997243926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b80d2fa0 0x7f36b809ae40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f36a80097c0 tx=0x7f36a801c350 comp rx=0 tx=0).stop 2024-05-30T06:49:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 -- 172.21.15.37:0/2997243926 shutdown_connections 2024-05-30T06:49:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 --2- 172.21.15.37:0/2997243926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b80d2fa0 0x7f36b809ae40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 --2- 172.21.15.37:0/2997243926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b809aa60 0x7f36b80d1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 -- 172.21.15.37:0/2997243926 >> 172.21.15.37:0/2997243926 conn(0x7f36b80d2480 msgr2=0x7f36b80d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 -- 172.21.15.37:0/2997243926 shutdown_connections 2024-05-30T06:49:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 -- 172.21.15.37:0/2997243926 wait complete. 2024-05-30T06:49:15.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 Processor -- start 2024-05-30T06:49:15.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 -- start start 2024-05-30T06:49:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b806e750 0x7f36b815af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b809aa60 0x7f36b8159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b80d2fa0 0x7f36b8157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f36b80afe70 con 0x7f36b80d2fa0 2024-05-30T06:49:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f36b80b1cb0 con 0x7f36b806e750 2024-05-30T06:49:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.794+0000 7f36bf200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f36b816b930 con 0x7f36b809aa60 2024-05-30T06:49:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36be800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b80d2fa0 0x7f36b8157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36bde00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b806e750 0x7f36b815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36bd400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b809aa60 0x7f36b8159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36bde00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b806e750 0x7f36b815af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:55758/0 (socket says 172.21.15.37:55758) 2024-05-30T06:49:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36be800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b80d2fa0 0x7f36b8157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45024/0 (socket says 172.21.15.37:45024) 2024-05-30T06:49:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36bde00640 1 -- 172.21.15.37:0/2294063359 learned_addr learned my addr 172.21.15.37:0/2294063359 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36bde00640 1 -- 172.21.15.37:0/2294063359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b809aa60 msgr2=0x7f36b8159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36bde00640 1 --2- 172.21.15.37:0/2294063359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b809aa60 0x7f36b8159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36bde00640 1 -- 172.21.15.37:0/2294063359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b80d2fa0 msgr2=0x7f36b8157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36bde00640 1 --2- 172.21.15.37:0/2294063359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b80d2fa0 0x7f36b8157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36bde00640 1 -- 172.21.15.37:0/2294063359 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b8158880 con 0x7f36b806e750 2024-05-30T06:49:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36be800640 1 --2- 172.21.15.37:0/2294063359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b80d2fa0 0x7f36b8157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:49:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36bde00640 1 --2- 172.21.15.37:0/2294063359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b806e750 0x7f36b815af70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00e980 tx=0x7f36ac00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36b2000640 1 -- 172.21.15.37:0/2294063359 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac017070 con 0x7f36b806e750 2024-05-30T06:49:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36b2000640 1 -- 172.21.15.37:0/2294063359 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ac00ca00 con 0x7f36b806e750 2024-05-30T06:49:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36b2000640 1 -- 172.21.15.37:0/2294063359 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00cdd0 con 0x7f36b806e750 2024-05-30T06:49:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36bf200640 1 -- 172.21.15.37:0/2294063359 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b8158b20 con 0x7f36b806e750 2024-05-30T06:49:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36bf200640 1 -- 172.21.15.37:0/2294063359 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b81590e0 con 0x7f36b806e750 2024-05-30T06:49:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36bf200640 1 -- 172.21.15.37:0/2294063359 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36b8068ab0 con 0x7f36b806e750 2024-05-30T06:49:15.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.798+0000 7f36b2000640 1 -- 172.21.15.37:0/2294063359 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 19) ==== 88854+0+0 (secure 0 0 0) 0x7f36ac01a070 con 0x7f36b806e750 2024-05-30T06:49:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.802+0000 7f36b2000640 1 --2- 172.21.15.37:0/2294063359 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f369c068d10 0x7f369c06b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.802+0000 7f36b2000640 1 -- 172.21.15.37:0/2294063359 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f36ac0850e0 con 0x7f36b806e750 2024-05-30T06:49:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.802+0000 7f36bd400640 1 --2- 172.21.15.37:0/2294063359 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f369c068d10 0x7f369c06b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:15.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.802+0000 7f36bd400640 1 --2- 172.21.15.37:0/2294063359 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f369c068d10 0x7f369c06b1d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f36a80ad000 tx=0x7f36a80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:15.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.806+0000 7f36b2000640 1 -- 172.21.15.37:0/2294063359 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f36ac056c50 con 0x7f36b806e750 2024-05-30T06:49:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:15.998+0000 7f36bf200640 1 -- 172.21.15.37:0/2294063359 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f36b80b1730 con 0x7f369c068d10 2024-05-30T06:49:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.006+0000 7f36b2000640 1 -- 172.21.15.37:0/2294063359 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f36b80b1730 con 0x7f369c068d10 2024-05-30T06:49:16.005 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/a4540fde-885b-48e7-abfe-fa7259ba5347 2024-05-30T06:49:16.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.006+0000 7f36bf200640 1 -- 172.21.15.37:0/2294063359 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f369c068d10 msgr2=0x7f369c06b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:16.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.006+0000 7f36bf200640 1 --2- 172.21.15.37:0/2294063359 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f369c068d10 0x7f369c06b1d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f36a80ad000 tx=0x7f36a80a6000 comp rx=0 tx=0).stop 2024-05-30T06:49:16.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.006+0000 7f36bf200640 1 -- 172.21.15.37:0/2294063359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b806e750 msgr2=0x7f36b815af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:16.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.006+0000 7f36bf200640 1 --2- 172.21.15.37:0/2294063359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b806e750 0x7f36b815af70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00e980 tx=0x7f36ac00ee40 comp rx=0 tx=0).stop 2024-05-30T06:49:16.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.006+0000 7f36bf200640 1 -- 172.21.15.37:0/2294063359 shutdown_connections 2024-05-30T06:49:16.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.006+0000 7f36bf200640 1 --2- 172.21.15.37:0/2294063359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b80d2fa0 0x7f36b8157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.006+0000 7f36bf200640 1 --2- 172.21.15.37:0/2294063359 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36b809aa60 0x7f36b8159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.006+0000 7f36bf200640 1 --2- 172.21.15.37:0/2294063359 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f369c068d10 0x7f369c06b1d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.006+0000 7f36bf200640 1 --2- 172.21.15.37:0/2294063359 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36b806e750 0x7f36b815af70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.006+0000 7f36bf200640 1 -- 172.21.15.37:0/2294063359 >> 172.21.15.37:0/2294063359 conn(0x7f36b80d2480 msgr2=0x7f36b8150700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:16.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.006+0000 7f36bf200640 1 -- 172.21.15.37:0/2294063359 shutdown_connections 2024-05-30T06:49:16.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.006+0000 7f36bf200640 1 -- 172.21.15.37:0/2294063359 wait complete. 2024-05-30T06:49:16.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:49:16.025 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/a4540fde-885b-48e7-abfe-fa7259ba5347 2024-05-30T06:49:16.025 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:49:16.035 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/a4540fde-885b-48e7-abfe-fa7259ba5347 2024-05-30T06:49:16.035 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T06:49:16.035 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:49:16.036 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T06:49:16.036 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone18541 2024-05-30T06:49:16.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2148000640 1 Processor -- start 2024-05-30T06:49:16.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2148000640 1 -- start start 2024-05-30T06:49:16.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2148000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f214015f210 0x7f2140072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:16.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2148000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f21400cec10 0x7f2140072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:16.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2148000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2140163020 con 0x7f214015c890 2024-05-30T06:49:16.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2148000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2140163300 con 0x7f21400cec10 2024-05-30T06:49:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2148000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21401635e0 con 0x7f214015f210 2024-05-30T06:49:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2145600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f214015c890 0x7f2140162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40240/0 (socket says 172.21.15.37:40240) 2024-05-30T06:49:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2145600640 1 -- 172.21.15.37:0/2022748958 learned_addr learned my addr 172.21.15.37:0/2022748958 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2146000640 1 --2- 172.21.15.37:0/2022748958 >> v2:172.21.15.105:3300/0 conn(0x7f21400cec10 0x7f2140072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2144c00640 1 --2- 172.21.15.37:0/2022748958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f214015f210 0x7f2140072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f213fe00640 1 -- 172.21.15.37:0/2022748958 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973416847 0 0) 0x7f2140163020 con 0x7f214015c890 2024-05-30T06:49:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f213fe00640 1 -- 172.21.15.37:0/2022748958 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2128003530 con 0x7f214015c890 2024-05-30T06:49:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f213fe00640 1 -- 172.21.15.37:0/2022748958 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2456785655 0 0) 0x7f2128003530 con 0x7f214015c890 2024-05-30T06:49:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2146000640 1 -- 172.21.15.37:0/2022748958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f214015f210 msgr2=0x7f2140072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2146000640 1 --2- 172.21.15.37:0/2022748958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f214015f210 0x7f2140072750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2146000640 1 -- 172.21.15.37:0/2022748958 >> v1:172.21.15.37:6789/0 conn(0x7f214015c890 legacy=0x7f2140162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2146000640 1 -- 172.21.15.37:0/2022748958 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f214006ba00 con 0x7f21400cec10 2024-05-30T06:49:16.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.222+0000 7f2144c00640 1 --2- 172.21.15.37:0/2022748958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f214015f210 0x7f2140072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:49:16.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.226+0000 7f2146000640 1 --2- 172.21.15.37:0/2022748958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400cec10 0x7f2140072c90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2138009d90 tx=0x7f213801c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83b05033ca03dc02 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:16.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.226+0000 7f213fe00640 1 -- 172.21.15.37:0/2022748958 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21380ac070 con 0x7f21400cec10 2024-05-30T06:49:16.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.226+0000 7f213fe00640 1 -- 172.21.15.37:0/2022748958 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21380a6410 con 0x7f21400cec10 2024-05-30T06:49:16.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.226+0000 7f213fe00640 1 -- 172.21.15.37:0/2022748958 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2134001680 con 0x7f21400cec10 2024-05-30T06:49:16.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.226+0000 7f2148000640 1 -- 172.21.15.37:0/2022748958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400cec10 msgr2=0x7f2140072c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:16.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.226+0000 7f2148000640 1 --2- 172.21.15.37:0/2022748958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400cec10 0x7f2140072c90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2138009d90 tx=0x7f213801c800 comp rx=0 tx=0).stop 2024-05-30T06:49:16.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.226+0000 7f2148000640 1 -- 172.21.15.37:0/2022748958 shutdown_connections 2024-05-30T06:49:16.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.226+0000 7f2148000640 1 --2- 172.21.15.37:0/2022748958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21400cec10 0x7f2140072c90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.226+0000 7f2148000640 1 --2- 172.21.15.37:0/2022748958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f214015f210 0x7f2140072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.226+0000 7f2148000640 1 -- 172.21.15.37:0/2022748958 >> 172.21.15.37:0/2022748958 conn(0x7f21400b2ac0 msgr2=0x7f21400b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:16.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.226+0000 7f2148000640 1 -- 172.21.15.37:0/2022748958 shutdown_connections 2024-05-30T06:49:16.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.226+0000 7f2148000640 1 -- 172.21.15.37:0/2022748958 wait complete. 2024-05-30T06:49:16.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2148000640 1 Processor -- start 2024-05-30T06:49:16.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2148000640 1 -- start start 2024-05-30T06:49:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2148000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21400cec10 0x7f2140156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2148000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214015c890 0x7f2140159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2148000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214015f210 0x7f21401545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2148000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f214006cda0 con 0x7f214015f210 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2148000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f214006cc20 con 0x7f214015c890 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2148000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f214006cf20 con 0x7f21400cec10 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2146000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214015f210 0x7f21401545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2146000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214015f210 0x7f21401545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45040/0 (socket says 172.21.15.37:45040) 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2146000640 1 -- 172.21.15.37:0/706113753 learned_addr learned my addr 172.21.15.37:0/706113753 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2145600640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21400cec10 0x7f2140156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2144c00640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214015c890 0x7f2140159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2146000640 1 -- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21400cec10 msgr2=0x7f2140156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2146000640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21400cec10 0x7f2140156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2146000640 1 -- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214015c890 msgr2=0x7f2140159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2146000640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214015c890 0x7f2140159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2146000640 1 -- 172.21.15.37:0/706113753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21400b3dc0 con 0x7f214015f210 2024-05-30T06:49:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2146000640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214015f210 0x7f21401545c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2138009d90 tx=0x7f21380195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f213d600640 1 -- 172.21.15.37:0/706113753 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21380ac070 con 0x7f214015f210 2024-05-30T06:49:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f213d600640 1 -- 172.21.15.37:0/706113753 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21380b1860 con 0x7f214015f210 2024-05-30T06:49:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f213d600640 1 -- 172.21.15.37:0/706113753 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21380b1c50 con 0x7f214015f210 2024-05-30T06:49:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2148000640 1 -- 172.21.15.37:0/706113753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21400b40a0 con 0x7f214015f210 2024-05-30T06:49:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.230+0000 7f2148000640 1 -- 172.21.15.37:0/706113753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21401553d0 con 0x7f214015f210 2024-05-30T06:49:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.234+0000 7f2148000640 1 -- 172.21.15.37:0/706113753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2140068bc0 con 0x7f214015f210 2024-05-30T06:49:16.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.234+0000 7f213d600640 1 -- 172.21.15.37:0/706113753 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 88854+0+0 (secure 0 0 0) 0x7f21380af070 con 0x7f214015f210 2024-05-30T06:49:16.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.234+0000 7f213d600640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2120068d10 0x7f212006b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:16.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.234+0000 7f213d600640 1 -- 172.21.15.37:0/706113753 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f213811f6f0 con 0x7f214015f210 2024-05-30T06:49:16.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.234+0000 7f2145600640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2120068d10 0x7f212006b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.234+0000 7f2145600640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2120068d10 0x7f212006b1d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f21340017f0 tx=0x7f2134001580 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.238+0000 7f213d600640 1 -- 172.21.15.37:0/706113753 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2138016480 con 0x7f214015f210 2024-05-30T06:49:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.434+0000 7f2148000640 1 -- 172.21.15.37:0/706113753 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone18541", "target": ["mon-mgr", ""]}) -- 0x7f2140067d90 con 0x7f2120068d10 2024-05-30T06:49:16.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.482+0000 7f213d600640 1 -- 172.21.15.37:0/706113753 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2140067d90 con 0x7f2120068d10 2024-05-30T06:49:16.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.482+0000 7f2148000640 1 -- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2120068d10 msgr2=0x7f212006b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:16.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.482+0000 7f2148000640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2120068d10 0x7f212006b1d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f21340017f0 tx=0x7f2134001580 comp rx=0 tx=0).stop 2024-05-30T06:49:16.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.482+0000 7f2148000640 1 -- 172.21.15.37:0/706113753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214015f210 msgr2=0x7f21401545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:16.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.482+0000 7f2148000640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214015f210 0x7f21401545c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2138009d90 tx=0x7f21380195a0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.482+0000 7f2148000640 1 -- 172.21.15.37:0/706113753 shutdown_connections 2024-05-30T06:49:16.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.482+0000 7f2148000640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214015f210 0x7f21401545c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.482+0000 7f2148000640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2120068d10 0x7f212006b1d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.482+0000 7f2148000640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214015c890 0x7f2140159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.482+0000 7f2148000640 1 --2- 172.21.15.37:0/706113753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21400cec10 0x7f2140156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.482+0000 7f2148000640 1 -- 172.21.15.37:0/706113753 >> 172.21.15.37:0/706113753 conn(0x7f21400b2ac0 msgr2=0x7f214015e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.482+0000 7f2148000640 1 -- 172.21.15.37:0/706113753 shutdown_connections 2024-05-30T06:49:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.486+0000 7f2148000640 1 -- 172.21.15.37:0/706113753 wait complete. 2024-05-30T06:49:16.487 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:16.484+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:16.487 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:16.484+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:16.487 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:16.484+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:16.487 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:16.484+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:16.487 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:16.484+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:16.501 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:16.500+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:16.501 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:16.500+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:16.501 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:16.500+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:16.501 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:16.500+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:16.501 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:16.500+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:16.505 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone18542 2024-05-30T06:49:16.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.650+0000 7fdef1800640 1 Processor -- start 2024-05-30T06:49:16.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.650+0000 7fdef1800640 1 -- start start 2024-05-30T06:49:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.654+0000 7fdef1800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdeec0cfeb0 0x7fdeec0afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.654+0000 7fdef1800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeec0b36c0 0x7fdeec162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.654+0000 7fdef1800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeec0b5f70 con 0x7fdeec1629d0 2024-05-30T06:49:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.654+0000 7fdef1800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdeec162e00 con 0x7fdeec0cfeb0 2024-05-30T06:49:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.654+0000 7fdef1800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdeec0b3b50 con 0x7fdeec0b36c0 2024-05-30T06:49:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.654+0000 7fdeeaa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdeec0cfeb0 0x7fdeec0afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.654+0000 7fdeeaa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdeec0cfeb0 0x7fdeec0afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45054/0 (socket says 172.21.15.37:45054) 2024-05-30T06:49:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.654+0000 7fdeeaa00640 1 -- 172.21.15.37:0/2183256174 learned_addr learned my addr 172.21.15.37:0/2183256174 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.654+0000 7fdee2000640 1 --2- 172.21.15.37:0/2183256174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeec0b36c0 0x7fdeec162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.654+0000 7fdeeaa00640 1 -- 172.21.15.37:0/2183256174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeec0b36c0 msgr2=0x7fdeec162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.654+0000 7fdeeaa00640 1 --2- 172.21.15.37:0/2183256174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeec0b36c0 0x7fdeec162490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.654+0000 7fdeeaa00640 1 -- 172.21.15.37:0/2183256174 >> v1:172.21.15.105:6789/0 conn(0x7fdeec1629d0 legacy=0x7fdeec147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.654+0000 7fdeeaa00640 1 -- 172.21.15.37:0/2183256174 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeec0b67a0 con 0x7fdeec0cfeb0 2024-05-30T06:49:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdeeaa00640 1 --2- 172.21.15.37:0/2183256174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeec0cfeb0 0x7fdeec0afcf0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009870 tx=0x7fdedc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6baf5587dbda2e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdeea000640 1 -- 172.21.15.37:0/2183256174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0b1070 con 0x7fdeec0cfeb0 2024-05-30T06:49:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdeea000640 1 -- 172.21.15.37:0/2183256174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdedc0ac620 con 0x7fdeec0cfeb0 2024-05-30T06:49:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdeea000640 1 -- 172.21.15.37:0/2183256174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0ac9f0 con 0x7fdeec0cfeb0 2024-05-30T06:49:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 -- 172.21.15.37:0/2183256174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeec0cfeb0 msgr2=0x7fdeec0afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 --2- 172.21.15.37:0/2183256174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeec0cfeb0 0x7fdeec0afcf0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009870 tx=0x7fdedc01c4d0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 -- 172.21.15.37:0/2183256174 shutdown_connections 2024-05-30T06:49:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 --2- 172.21.15.37:0/2183256174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeec0b36c0 0x7fdeec162490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 --2- 172.21.15.37:0/2183256174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeec0cfeb0 0x7fdeec0afcf0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 -- 172.21.15.37:0/2183256174 >> 172.21.15.37:0/2183256174 conn(0x7fdeec06bf60 msgr2=0x7fdeec0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 -- 172.21.15.37:0/2183256174 shutdown_connections 2024-05-30T06:49:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 -- 172.21.15.37:0/2183256174 wait complete. 2024-05-30T06:49:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 Processor -- start 2024-05-30T06:49:16.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 -- start start 2024-05-30T06:49:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeec0b36c0 0x7fdeec160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeec0cfeb0 0x7fdeec1434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeec1629d0 0x7fdeec1439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec0ae290 con 0x7fdeec0b36c0 2024-05-30T06:49:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec0ae110 con 0x7fdeec1629d0 2024-05-30T06:49:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdef1800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdeec0ae410 con 0x7fdeec0cfeb0 2024-05-30T06:49:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdeeaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeec0b36c0 0x7fdeec160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdeeaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeec0b36c0 0x7fdeec160d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45056/0 (socket says 172.21.15.37:45056) 2024-05-30T06:49:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.658+0000 7fdeeaa00640 1 -- 172.21.15.37:0/1026297437 learned_addr learned my addr 172.21.15.37:0/1026297437 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdeeb400640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeec1629d0 0x7fdeec1439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdee2000640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeec0cfeb0 0x7fdeec1434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdeeaa00640 1 -- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeec0cfeb0 msgr2=0x7fdeec1434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdeeaa00640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeec0cfeb0 0x7fdeec1434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdeeaa00640 1 -- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeec1629d0 msgr2=0x7fdeec1439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdeeaa00640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeec1629d0 0x7fdeec1439e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdeeaa00640 1 -- 172.21.15.37:0/1026297437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeec142290 con 0x7fdeec0b36c0 2024-05-30T06:49:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdeeaa00640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeec0b36c0 0x7fdeec160d50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fdedc01ab80 tx=0x7fdedc019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:16.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdee3400640 1 -- 172.21.15.37:0/1026297437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0ba070 con 0x7fdeec0b36c0 2024-05-30T06:49:16.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdee3400640 1 -- 172.21.15.37:0/1026297437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdedc0b5400 con 0x7fdeec0b36c0 2024-05-30T06:49:16.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdee3400640 1 -- 172.21.15.37:0/1026297437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0b1040 con 0x7fdeec0b36c0 2024-05-30T06:49:16.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdef1800640 1 -- 172.21.15.37:0/1026297437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeec142570 con 0x7fdeec0b36c0 2024-05-30T06:49:16.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdef1800640 1 -- 172.21.15.37:0/1026297437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeec142b30 con 0x7fdeec0b36c0 2024-05-30T06:49:16.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdef1800640 1 -- 172.21.15.37:0/1026297437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeec068bc0 con 0x7fdeec0b36c0 2024-05-30T06:49:16.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.662+0000 7fdee3400640 1 -- 172.21.15.37:0/1026297437 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 88854+0+0 (secure 0 0 0) 0x7fdedc0ab3c0 con 0x7fdeec0b36c0 2024-05-30T06:49:16.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.666+0000 7fdee3400640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdec8068d10 0x7fdec806b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:16.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.666+0000 7fdee3400640 1 -- 172.21.15.37:0/1026297437 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fdedc11e3b0 con 0x7fdeec0b36c0 2024-05-30T06:49:16.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.666+0000 7fdee2000640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdec8068d10 0x7fdec806b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:16.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.666+0000 7fdee2000640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdec8068d10 0x7fdec806b1d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdeec136eb0 tx=0x7fded4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:16.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.670+0000 7fdee3400640 1 -- 172.21.15.37:0/1026297437 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdedc016150 con 0x7fdeec0b36c0 2024-05-30T06:49:16.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.862+0000 7fdee3400640 1 -- 172.21.15.37:0/1026297437 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 20) ==== 88956+0+0 (secure 0 0 0) 0x7fdedc0ec500 con 0x7fdeec0b36c0 2024-05-30T06:49:16.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:16.866+0000 7fdef1800640 1 -- 172.21.15.37:0/1026297437 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone18542", "target": ["mon-mgr", ""]}) -- 0x7fdeec0adb80 con 0x7fdec8068d10 2024-05-30T06:49:17.486 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:17.484+0000 7f0017400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:17.486 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:17.484+0000 7f0017400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:17.486 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:17.484+0000 7f0017400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:17.487 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:17.484+0000 7f0017400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:17.487 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:17.484+0000 7f0017400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.578+0000 7fdee3400640 1 -- 172.21.15.37:0/1026297437 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdeec0adb80 con 0x7fdec8068d10 2024-05-30T06:49:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.578+0000 7fdef1800640 1 -- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdec8068d10 msgr2=0x7fdec806b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.578+0000 7fdef1800640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdec8068d10 0x7fdec806b1d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdeec136eb0 tx=0x7fded4008040 comp rx=0 tx=0).stop 2024-05-30T06:49:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.578+0000 7fdef1800640 1 -- 172.21.15.37:0/1026297437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeec0b36c0 msgr2=0x7fdeec160d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.578+0000 7fdef1800640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeec0b36c0 0x7fdeec160d50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fdedc01ab80 tx=0x7fdedc019270 comp rx=0 tx=0).stop 2024-05-30T06:49:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.578+0000 7fdef1800640 1 -- 172.21.15.37:0/1026297437 shutdown_connections 2024-05-30T06:49:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.578+0000 7fdef1800640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdec8068d10 0x7fdec806b1d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.578+0000 7fdef1800640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeec1629d0 0x7fdeec1439e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.578+0000 7fdef1800640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeec0cfeb0 0x7fdeec1434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.578+0000 7fdef1800640 1 --2- 172.21.15.37:0/1026297437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeec0b36c0 0x7fdeec160d50 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.578+0000 7fdef1800640 1 -- 172.21.15.37:0/1026297437 >> 172.21.15.37:0/1026297437 conn(0x7fdeec06bf60 msgr2=0x7fdeec0af420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.578+0000 7fdef1800640 1 -- 172.21.15.37:0/1026297437 shutdown_connections 2024-05-30T06:49:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.582+0000 7fdef1800640 1 -- 172.21.15.37:0/1026297437 wait complete. 2024-05-30T06:49:17.597 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:17.596+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:17.597 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:17.596+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:17.597 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:17.596+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:17.597 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:17.596+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:17.597 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:17.596+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:17.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone18543 2024-05-30T06:49:17.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.846+0000 7f87af400640 1 Processor -- start 2024-05-30T06:49:17.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.846+0000 7f87af400640 1 -- start start 2024-05-30T06:49:17.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.846+0000 7f87af400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87a80b59d0 0x7f87a80b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:17.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.846+0000 7f87af400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87a815d350 0x7f87a8160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:17.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.846+0000 7f87af400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87a80b62f0 con 0x7f87a815d7b0 2024-05-30T06:49:17.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.846+0000 7f87af400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f87a8142030 con 0x7f87a815d350 2024-05-30T06:49:17.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.846+0000 7f87af400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f87a8142310 con 0x7f87a80b59d0 2024-05-30T06:49:17.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.846+0000 7f87a7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87a815d350 0x7f87a8160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:17.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.850+0000 7f87a7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87a815d350 0x7f87a8160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60334/0 (socket says 172.21.15.37:60334) 2024-05-30T06:49:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.850+0000 7f87a7e00640 1 -- 172.21.15.37:0/543206032 learned_addr learned my addr 172.21.15.37:0/543206032 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.850+0000 7f87a7e00640 1 -- 172.21.15.37:0/543206032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87a80b59d0 msgr2=0x7f87a80b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.850+0000 7f87a7e00640 1 --2- 172.21.15.37:0/543206032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87a80b59d0 0x7f87a80b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.850+0000 7f87a7e00640 1 -- 172.21.15.37:0/543206032 >> v1:172.21.15.105:6789/0 conn(0x7f87a815d7b0 legacy=0x7f87a81607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.850+0000 7f87a7e00640 1 -- 172.21.15.37:0/543206032 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a81425f0 con 0x7f87a815d350 2024-05-30T06:49:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.850+0000 7f87a7e00640 1 --2- 172.21.15.37:0/543206032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a815d350 0x7f87a8160280 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8794009870 tx=0x7f879401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f42281323b9aa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.850+0000 7f87a7400640 1 -- 172.21.15.37:0/543206032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87940b5070 con 0x7f87a815d350 2024-05-30T06:49:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.850+0000 7f87a7400640 1 -- 172.21.15.37:0/543206032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87940a89d0 con 0x7f87a815d350 2024-05-30T06:49:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.850+0000 7f87a7400640 1 -- 172.21.15.37:0/543206032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87940a8da0 con 0x7f87a815d350 2024-05-30T06:49:17.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.854+0000 7f87af400640 1 -- 172.21.15.37:0/543206032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a815d350 msgr2=0x7f87a8160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:17.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.854+0000 7f87af400640 1 --2- 172.21.15.37:0/543206032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a815d350 0x7f87a8160280 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8794009870 tx=0x7f879401ed10 comp rx=0 tx=0).stop 2024-05-30T06:49:17.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.854+0000 7f87af400640 1 -- 172.21.15.37:0/543206032 shutdown_connections 2024-05-30T06:49:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.854+0000 7f87af400640 1 --2- 172.21.15.37:0/543206032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a815d350 0x7f87a8160280 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.854+0000 7f87af400640 1 --2- 172.21.15.37:0/543206032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87a80b59d0 0x7f87a80b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.854+0000 7f87af400640 1 -- 172.21.15.37:0/543206032 >> 172.21.15.37:0/543206032 conn(0x7f87a806bf60 msgr2=0x7f87a80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.854+0000 7f87af400640 1 -- 172.21.15.37:0/543206032 shutdown_connections 2024-05-30T06:49:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.854+0000 7f87af400640 1 -- 172.21.15.37:0/543206032 wait complete. 2024-05-30T06:49:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.854+0000 7f87af400640 1 Processor -- start 2024-05-30T06:49:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.854+0000 7f87af400640 1 -- start start 2024-05-30T06:49:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.854+0000 7f87af400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a80b59d0 0x7f87a81e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87af400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87a815d350 0x7f87a8155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87af400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87a815d7b0 0x7f87a8159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87af400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f87a813fe60 con 0x7f87a80b59d0 2024-05-30T06:49:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87af400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f87a813fce0 con 0x7f87a815d7b0 2024-05-30T06:49:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87af400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f87a80aff20 con 0x7f87a815d350 2024-05-30T06:49:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87aca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a80b59d0 0x7f87a81e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87aca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a80b59d0 0x7f87a81e60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60336/0 (socket says 172.21.15.37:60336) 2024-05-30T06:49:17.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87aca00640 1 -- 172.21.15.37:0/106555818 learned_addr learned my addr 172.21.15.37:0/106555818 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:17.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87ad400640 1 --2- 172.21.15.37:0/106555818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87a815d7b0 0x7f87a8159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:17.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87aca00640 1 -- 172.21.15.37:0/106555818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87a815d350 msgr2=0x7f87a8155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:17.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87aca00640 1 --2- 172.21.15.37:0/106555818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87a815d350 0x7f87a8155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87aca00640 1 -- 172.21.15.37:0/106555818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87a815d7b0 msgr2=0x7f87a8159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87aca00640 1 --2- 172.21.15.37:0/106555818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87a815d7b0 0x7f87a8159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87aca00640 1 -- 172.21.15.37:0/106555818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a81e65e0 con 0x7f87a80b59d0 2024-05-30T06:49:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87aca00640 1 --2- 172.21.15.37:0/106555818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a80b59d0 0x7f87a81e60a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f879c00b410 tx=0x7f879c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87a4c00640 1 -- 172.21.15.37:0/106555818 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c015020 con 0x7f87a80b59d0 2024-05-30T06:49:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87a4c00640 1 -- 172.21.15.37:0/106555818 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f879c011830 con 0x7f87a80b59d0 2024-05-30T06:49:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87af400640 1 -- 172.21.15.37:0/106555818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a8158a60 con 0x7f87a80b59d0 2024-05-30T06:49:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87a4c00640 1 -- 172.21.15.37:0/106555818 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c011c20 con 0x7f87a80b59d0 2024-05-30T06:49:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.858+0000 7f87af400640 1 -- 172.21.15.37:0/106555818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a8159020 con 0x7f87a80b59d0 2024-05-30T06:49:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.862+0000 7f87af400640 1 -- 172.21.15.37:0/106555818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a8068bc0 con 0x7f87a80b59d0 2024-05-30T06:49:17.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.862+0000 7f87a4c00640 1 -- 172.21.15.37:0/106555818 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 88956+0+0 (secure 0 0 0) 0x7f879c018020 con 0x7f87a80b59d0 2024-05-30T06:49:17.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.862+0000 7f87a4c00640 1 --2- 172.21.15.37:0/106555818 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8788068e30 0x7f878806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:17.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.866+0000 7f87a4c00640 1 -- 172.21.15.37:0/106555818 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f879c0857a0 con 0x7f87a80b59d0 2024-05-30T06:49:17.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.870+0000 7f87a7e00640 1 --2- 172.21.15.37:0/106555818 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8788068e30 0x7f878806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.870+0000 7f87a4c00640 1 -- 172.21.15.37:0/106555818 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f879c01f020 con 0x7f87a80b59d0 2024-05-30T06:49:17.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:17.874+0000 7f87a7e00640 1 --2- 172.21.15.37:0/106555818 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8788068e30 0x7f878806b2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f87940b2000 tx=0x7f8794004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.238+0000 7f87af400640 1 -- 172.21.15.37:0/106555818 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone18543", "target": ["mon-mgr", ""]}) -- 0x7f87a80b33e0 con 0x7f8788068e30 2024-05-30T06:49:18.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.734+0000 7f87a4c00640 1 -- 172.21.15.37:0/106555818 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f87a80b33e0 con 0x7f8788068e30 2024-05-30T06:49:18.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.738+0000 7f87af400640 1 -- 172.21.15.37:0/106555818 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8788068e30 msgr2=0x7f878806b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:18.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.738+0000 7f87af400640 1 --2- 172.21.15.37:0/106555818 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8788068e30 0x7f878806b2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f87940b2000 tx=0x7f8794004740 comp rx=0 tx=0).stop 2024-05-30T06:49:18.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.738+0000 7f87af400640 1 -- 172.21.15.37:0/106555818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a80b59d0 msgr2=0x7f87a81e60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:18.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.738+0000 7f87af400640 1 --2- 172.21.15.37:0/106555818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a80b59d0 0x7f87a81e60a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f879c00b410 tx=0x7f879c00b8d0 comp rx=0 tx=0).stop 2024-05-30T06:49:18.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.738+0000 7f87af400640 1 -- 172.21.15.37:0/106555818 shutdown_connections 2024-05-30T06:49:18.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.738+0000 7f87af400640 1 --2- 172.21.15.37:0/106555818 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8788068e30 0x7f878806b2f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:18.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.738+0000 7f87af400640 1 --2- 172.21.15.37:0/106555818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87a815d7b0 0x7f87a8159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:18.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.738+0000 7f87af400640 1 --2- 172.21.15.37:0/106555818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87a815d350 0x7f87a8155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:18.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.738+0000 7f87af400640 1 --2- 172.21.15.37:0/106555818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87a80b59d0 0x7f87a81e60a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:18.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.738+0000 7f87af400640 1 -- 172.21.15.37:0/106555818 >> 172.21.15.37:0/106555818 conn(0x7f87a806bf60 msgr2=0x7f87a8071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:18.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.738+0000 7f87af400640 1 -- 172.21.15.37:0/106555818 shutdown_connections 2024-05-30T06:49:18.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:18.738+0000 7f87af400640 1 -- 172.21.15.37:0/106555818 wait complete. 2024-05-30T06:49:18.787 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone18544 2024-05-30T06:49:18.808 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:18.804+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:18.809 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:18.804+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:18.809 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:18.804+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:18.809 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:18.804+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:18.809 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:18.804+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.062+0000 7f1385a00640 1 Processor -- start 2024-05-30T06:49:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.062+0000 7f1385a00640 1 -- start start 2024-05-30T06:49:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.062+0000 7f1385a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f138015d7e0 0x7f138006e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.062+0000 7f1385a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1380142030 con 0x7f138015d350 2024-05-30T06:49:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.062+0000 7f137e000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f138015d350 0x7f138006df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47364/0 (socket says 172.21.15.37:47364) 2024-05-30T06:49:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.062+0000 7f137e000640 1 -- 172.21.15.37:0/2232073518 learned_addr learned my addr 172.21.15.37:0/2232073518 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.062+0000 7f1385a00640 1 -- 172.21.15.37:0/2232073518 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1380142310 con 0x7f13800b59d0 2024-05-30T06:49:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.062+0000 7f1385a00640 1 -- 172.21.15.37:0/2232073518 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f13801425f0 con 0x7f138015d7e0 2024-05-30T06:49:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.066+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530785637 0 0) 0x7f1380142030 con 0x7f138015d350 2024-05-30T06:49:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.066+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1364003530 con 0x7f138015d350 2024-05-30T06:49:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.066+0000 7f137f400640 1 --2- 172.21.15.37:0/2232073518 >> v2:172.21.15.105:3300/0 conn(0x7f138015d7e0 0x7f138006e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.066+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047877539 0 0) 0x7f1380142310 con 0x7f13800b59d0 2024-05-30T06:49:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.066+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1380142030 con 0x7f13800b59d0 2024-05-30T06:49:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.066+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2665056174 0 0) 0x7f1364003530 con 0x7f138015d350 2024-05-30T06:49:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.066+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 >> v2:172.21.15.105:3300/0 conn(0x7f138015d7e0 msgr2=0x7f138006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.066+0000 7f137d600640 1 --2- 172.21.15.37:0/2232073518 >> v2:172.21.15.105:3300/0 conn(0x7f138015d7e0 0x7f138006e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.066+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 >> v1:172.21.15.105:6789/0 conn(0x7f13800b59d0 legacy=0x7f13800b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.066+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13801428d0 con 0x7f138015d350 2024-05-30T06:49:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.066+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f1368001680 con 0x7f138015d350 2024-05-30T06:49:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.066+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 >> v1:172.21.15.37:6789/0 conn(0x7f138015d350 legacy=0x7f138006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137d600640 1 --2- 172.21.15.37:0/2232073518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1364003b50 0x7f1364003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137d600640 1 --2- 172.21.15.37:0/2232073518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1364004810 0x7f1364004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137d600640 1 --2- 172.21.15.37:0/2232073518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13640051d0 0x7f136400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13801425f0 con 0x7f1364004810 2024-05-30T06:49:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f136400c100 con 0x7f13640051d0 2024-05-30T06:49:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f136400c300 con 0x7f1364003b50 2024-05-30T06:49:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137e000640 1 --2- 172.21.15.37:0/2232073518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1364004810 0x7f1364004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137ea00640 1 --2- 172.21.15.37:0/2232073518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1364003b50 0x7f1364003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137f400640 1 --2- 172.21.15.37:0/2232073518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13640051d0 0x7f136400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137e000640 1 -- 172.21.15.37:0/2232073518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1364003b50 msgr2=0x7f1364003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137e000640 1 --2- 172.21.15.37:0/2232073518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1364003b50 0x7f1364003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137e000640 1 -- 172.21.15.37:0/2232073518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13640051d0 msgr2=0x7f136400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137e000640 1 --2- 172.21.15.37:0/2232073518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13640051d0 0x7f136400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137e000640 1 -- 172.21.15.37:0/2232073518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1364003530 con 0x7f1364004810 2024-05-30T06:49:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.070+0000 7f137f400640 1 -- 172.21.15.37:0/2232073518 reap_dead start 2024-05-30T06:49:19.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.074+0000 7f137e000640 1 --2- 172.21.15.37:0/2232073518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1364004810 0x7f1364004c90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f136800c190 tx=0x7f136801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c38d6d49e6f189 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:19.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.074+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368007cf0 con 0x7f1364004810 2024-05-30T06:49:19.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.074+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13680a9020 con 0x7f1364004810 2024-05-30T06:49:19.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.074+0000 7f137d600640 1 -- 172.21.15.37:0/2232073518 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368005ae0 con 0x7f1364004810 2024-05-30T06:49:19.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.074+0000 7f1385a00640 1 -- 172.21.15.37:0/2232073518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1364004810 msgr2=0x7f1364004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:19.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.074+0000 7f1385a00640 1 --2- 172.21.15.37:0/2232073518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1364004810 0x7f1364004c90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f136800c190 tx=0x7f136801cbe0 comp rx=0 tx=0).stop 2024-05-30T06:49:19.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.074+0000 7f1385a00640 1 -- 172.21.15.37:0/2232073518 shutdown_connections 2024-05-30T06:49:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.074+0000 7f1385a00640 1 --2- 172.21.15.37:0/2232073518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1364004810 0x7f1364004c90 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.074+0000 7f1385a00640 1 -- 172.21.15.37:0/2232073518 >> 172.21.15.37:0/2232073518 conn(0x7f138006bf60 msgr2=0x7f13800b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.074+0000 7f1385a00640 1 -- 172.21.15.37:0/2232073518 shutdown_connections 2024-05-30T06:49:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.074+0000 7f1385a00640 1 -- 172.21.15.37:0/2232073518 wait complete. 2024-05-30T06:49:19.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f1385a00640 1 Processor -- start 2024-05-30T06:49:19.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f1385a00640 1 -- start start 2024-05-30T06:49:19.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f1385a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1364004810 0x7f138013ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:19.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f1385a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13800b3af0 0x7f13800b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:19.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f1385a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1380152a00 0x7f138006df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:19.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f1385a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13800b00a0 con 0x7f1364004810 2024-05-30T06:49:19.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f1385a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f13800aff20 con 0x7f13800b3af0 2024-05-30T06:49:19.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f1385a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f138013f860 con 0x7f1380152a00 2024-05-30T06:49:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f137ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1364004810 0x7f138013ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:19.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f137ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1364004810 0x7f138013ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60356/0 (socket says 172.21.15.37:60356) 2024-05-30T06:49:19.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f137ea00640 1 -- 172.21.15.37:0/916933523 learned_addr learned my addr 172.21.15.37:0/916933523 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f137e000640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13800b3af0 0x7f13800b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f137ea00640 1 -- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1380152a00 msgr2=0x7f138006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f137ea00640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1380152a00 0x7f138006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f137ea00640 1 -- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13800b3af0 msgr2=0x7f13800b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:19.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f137ea00640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13800b3af0 0x7f13800b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:19.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f137ea00640 1 -- 172.21.15.37:0/916933523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1380152e80 con 0x7f1364004810 2024-05-30T06:49:19.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.078+0000 7f137e000640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13800b3af0 0x7f13800b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:49:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.082+0000 7f137ea00640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1364004810 0x7f138013ad80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1370007b70 tx=0x7f1370007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.082+0000 7f1376a00640 1 -- 172.21.15.37:0/916933523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1370010040 con 0x7f1364004810 2024-05-30T06:49:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.082+0000 7f1376a00640 1 -- 172.21.15.37:0/916933523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f137001a070 con 0x7f1364004810 2024-05-30T06:49:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.082+0000 7f1376a00640 1 -- 172.21.15.37:0/916933523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1370015850 con 0x7f1364004810 2024-05-30T06:49:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.082+0000 7f1385a00640 1 -- 172.21.15.37:0/916933523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13800b4060 con 0x7f1364004810 2024-05-30T06:49:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.082+0000 7f1385a00640 1 -- 172.21.15.37:0/916933523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13800b4620 con 0x7f1364004810 2024-05-30T06:49:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.082+0000 7f1385a00640 1 -- 172.21.15.37:0/916933523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1380068bc0 con 0x7f1364004810 2024-05-30T06:49:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.082+0000 7f1376a00640 1 -- 172.21.15.37:0/916933523 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 89058+0+0 (secure 0 0 0) 0x7f13700159f0 con 0x7f1364004810 2024-05-30T06:49:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.086+0000 7f1376a00640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f135c068f80 0x7f135c06b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.086+0000 7f1376a00640 1 -- 172.21.15.37:0/916933523 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f1370088dd0 con 0x7f1364004810 2024-05-30T06:49:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.086+0000 7f137e000640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f135c068f80 0x7f135c06b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.086+0000 7f137e000640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f135c068f80 0x7f135c06b440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f13680aa000 tx=0x7f1368001a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.090+0000 7f1376a00640 1 -- 172.21.15.37:0/916933523 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f137005ab80 con 0x7f1364004810 2024-05-30T06:49:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:19.466+0000 7f1385a00640 1 -- 172.21.15.37:0/916933523 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone18544", "target": ["mon-mgr", ""]}) -- 0x7f138013efc0 con 0x7f135c068f80 2024-05-30T06:49:20.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.026+0000 7f1376a00640 1 -- 172.21.15.37:0/916933523 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f138013efc0 con 0x7f135c068f80 2024-05-30T06:49:20.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.030+0000 7f1385a00640 1 -- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f135c068f80 msgr2=0x7f135c06b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:20.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.030+0000 7f1385a00640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f135c068f80 0x7f135c06b440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f13680aa000 tx=0x7f1368001a40 comp rx=0 tx=0).stop 2024-05-30T06:49:20.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.030+0000 7f1385a00640 1 -- 172.21.15.37:0/916933523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1364004810 msgr2=0x7f138013ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:20.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.030+0000 7f1385a00640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1364004810 0x7f138013ad80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1370007b70 tx=0x7f1370007ba0 comp rx=0 tx=0).stop 2024-05-30T06:49:20.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.030+0000 7f1385a00640 1 -- 172.21.15.37:0/916933523 shutdown_connections 2024-05-30T06:49:20.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.030+0000 7f1385a00640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1380152a00 0x7f138006df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:20.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.030+0000 7f1385a00640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f135c068f80 0x7f135c06b440 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:20.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.030+0000 7f1385a00640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13800b3af0 0x7f13800b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:20.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.030+0000 7f1385a00640 1 --2- 172.21.15.37:0/916933523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1364004810 0x7f138013ad80 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:20.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.030+0000 7f1385a00640 1 -- 172.21.15.37:0/916933523 >> 172.21.15.37:0/916933523 conn(0x7f138006bf60 msgr2=0x7f138013b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:20.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.034+0000 7f1385a00640 1 -- 172.21.15.37:0/916933523 shutdown_connections 2024-05-30T06:49:20.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.034+0000 7f1385a00640 1 -- 172.21.15.37:0/916933523 wait complete. 2024-05-30T06:49:20.077 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone18545 2024-05-30T06:49:20.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.338+0000 7f6d9e000640 1 Processor -- start 2024-05-30T06:49:20.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.338+0000 7f6d9e000640 1 -- start start 2024-05-30T06:49:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.342+0000 7f6d9e000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d9815cb10 0x7f6d980b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.342+0000 7f6d9e000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d980702f0 0x7f6d98070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.342+0000 7f6d9e000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d9806efb0 con 0x7f6d980b4e60 2024-05-30T06:49:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.342+0000 7f6d9e000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6d9815cf90 con 0x7f6d9815cb10 2024-05-30T06:49:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.342+0000 7f6d9e000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6d9806f250 con 0x7f6d980702f0 2024-05-30T06:49:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.342+0000 7f6d9cc00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6d980b4e60 0x7f6d980b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47376/0 (socket says 172.21.15.37:47376) 2024-05-30T06:49:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.342+0000 7f6d9cc00640 1 -- 172.21.15.37:0/1558906863 learned_addr learned my addr 172.21.15.37:0/1558906863 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.342+0000 7f6d97e00640 1 --2- 172.21.15.37:0/1558906863 >> v2:172.21.15.37:3300/0 conn(0x7f6d9815cb10 0x7f6d980b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.342+0000 7f6d97400640 1 -- 172.21.15.37:0/1558906863 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4143809816 0 0) 0x7f6d9806efb0 con 0x7f6d980b4e60 2024-05-30T06:49:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.342+0000 7f6d97e00640 1 -- 172.21.15.37:0/1558906863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d980702f0 msgr2=0x7f6d98070780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T06:49:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.342+0000 7f6d97e00640 1 --2- 172.21.15.37:0/1558906863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d980702f0 0x7f6d98070780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.342+0000 7f6d97e00640 1 -- 172.21.15.37:0/1558906863 >> v1:172.21.15.37:6789/0 conn(0x7f6d980b4e60 legacy=0x7f6d980b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.342+0000 7f6d97e00640 1 -- 172.21.15.37:0/1558906863 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9806f530 con 0x7f6d9815cb10 2024-05-30T06:49:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.346+0000 7f6d97e00640 1 --2- 172.21.15.37:0/1558906863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d9815cb10 0x7f6d980b4580 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6d840097c0 tx=0x7f6d8401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff161a3a0bd35c34 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.346+0000 7f6d97400640 1 -- 172.21.15.37:0/1558906863 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d840b1070 con 0x7f6d9815cb10 2024-05-30T06:49:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.346+0000 7f6d97400640 1 -- 172.21.15.37:0/1558906863 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d840ac600 con 0x7f6d9815cb10 2024-05-30T06:49:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.346+0000 7f6d97400640 1 -- 172.21.15.37:0/1558906863 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d840b1070 con 0x7f6d9815cb10 2024-05-30T06:49:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.350+0000 7f6d9e000640 1 -- 172.21.15.37:0/1558906863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d9815cb10 msgr2=0x7f6d980b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.350+0000 7f6d9e000640 1 --2- 172.21.15.37:0/1558906863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d9815cb10 0x7f6d980b4580 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6d840097c0 tx=0x7f6d8401c490 comp rx=0 tx=0).stop 2024-05-30T06:49:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.350+0000 7f6d9e000640 1 -- 172.21.15.37:0/1558906863 shutdown_connections 2024-05-30T06:49:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.350+0000 7f6d9e000640 1 --2- 172.21.15.37:0/1558906863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d980702f0 0x7f6d98070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.350+0000 7f6d9e000640 1 --2- 172.21.15.37:0/1558906863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d9815cb10 0x7f6d980b4580 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.350+0000 7f6d9e000640 1 -- 172.21.15.37:0/1558906863 >> 172.21.15.37:0/1558906863 conn(0x7f6d9809aa60 msgr2=0x7f6d980b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.350+0000 7f6d9e000640 1 -- 172.21.15.37:0/1558906863 shutdown_connections 2024-05-30T06:49:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.350+0000 7f6d9e000640 1 -- 172.21.15.37:0/1558906863 wait complete. 2024-05-30T06:49:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9e000640 1 Processor -- start 2024-05-30T06:49:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9e000640 1 -- start start 2024-05-30T06:49:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9e000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d980702f0 0x7f6d9813eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9e000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d980b4e60 0x7f6d9809c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d9815cb10 0x7f6d9809b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9e000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6d98145240 con 0x7f6d9815cb10 2024-05-30T06:49:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9e000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6d980b4ac0 con 0x7f6d980702f0 2024-05-30T06:49:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9e000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6d98140330 con 0x7f6d980b4e60 2024-05-30T06:49:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d9815cb10 0x7f6d9809b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d9815cb10 0x7f6d9809b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60376/0 (socket says 172.21.15.37:60376) 2024-05-30T06:49:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9d600640 1 -- 172.21.15.37:0/3722787893 learned_addr learned my addr 172.21.15.37:0/3722787893 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9cc00640 1 --2- 172.21.15.37:0/3722787893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d980702f0 0x7f6d9813eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9d600640 1 -- 172.21.15.37:0/3722787893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d980b4e60 msgr2=0x7f6d9809c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9d600640 1 --2- 172.21.15.37:0/3722787893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d980b4e60 0x7f6d9809c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9d600640 1 -- 172.21.15.37:0/3722787893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d980702f0 msgr2=0x7f6d9813eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9d600640 1 --2- 172.21.15.37:0/3722787893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d980702f0 0x7f6d9813eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9d600640 1 -- 172.21.15.37:0/3722787893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d981f7640 con 0x7f6d9815cb10 2024-05-30T06:49:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.354+0000 7f6d9d600640 1 --2- 172.21.15.37:0/3722787893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d9815cb10 0x7f6d9809b440 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800b440 tx=0x7f6d8800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.358+0000 7f6d94c00640 1 -- 172.21.15.37:0/3722787893 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d88015020 con 0x7f6d9815cb10 2024-05-30T06:49:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.358+0000 7f6d94c00640 1 -- 172.21.15.37:0/3722787893 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d88011850 con 0x7f6d9815cb10 2024-05-30T06:49:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.358+0000 7f6d94c00640 1 -- 172.21.15.37:0/3722787893 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d88011c40 con 0x7f6d9815cb10 2024-05-30T06:49:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.358+0000 7f6d9e000640 1 -- 172.21.15.37:0/3722787893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d981f7920 con 0x7f6d9815cb10 2024-05-30T06:49:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.358+0000 7f6d9e000640 1 -- 172.21.15.37:0/3722787893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d981f7ee0 con 0x7f6d9815cb10 2024-05-30T06:49:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.358+0000 7f6d9e000640 1 -- 172.21.15.37:0/3722787893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d98068700 con 0x7f6d9815cb10 2024-05-30T06:49:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.358+0000 7f6d94c00640 1 -- 172.21.15.37:0/3722787893 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 89058+0+0 (secure 0 0 0) 0x7f6d88018020 con 0x7f6d9815cb10 2024-05-30T06:49:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.362+0000 7f6d94c00640 1 --2- 172.21.15.37:0/3722787893 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d78068fd0 0x7f6d7806b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.362+0000 7f6d94c00640 1 -- 172.21.15.37:0/3722787893 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f6d88084fb0 con 0x7f6d9815cb10 2024-05-30T06:49:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.370+0000 7f6d94c00640 1 -- 172.21.15.37:0/3722787893 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6d8801f070 con 0x7f6d9815cb10 2024-05-30T06:49:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.378+0000 7f6d9cc00640 1 --2- 172.21.15.37:0/3722787893 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d78068fd0 0x7f6d7806b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:20.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.398+0000 7f6d9cc00640 1 --2- 172.21.15.37:0/3722787893 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d78068fd0 0x7f6d7806b490 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6d90007fd0 tx=0x7f6d90007ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:20.746+0000 7f6d9e000640 1 -- 172.21.15.37:0/3722787893 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone18545", "target": ["mon-mgr", ""]}) -- 0x7f6d981f8120 con 0x7f6d78068fd0 2024-05-30T06:49:21.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.014+0000 7f6d94c00640 1 -- 172.21.15.37:0/3722787893 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 22) ==== 89109+0+0 (secure 0 0 0) 0x7f6d88052cd0 con 0x7f6d9815cb10 2024-05-30T06:49:21.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.726+0000 7f6d94c00640 1 -- 172.21.15.37:0/3722787893 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6d981f8120 con 0x7f6d78068fd0 2024-05-30T06:49:21.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.734+0000 7f6d9e000640 1 -- 172.21.15.37:0/3722787893 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d78068fd0 msgr2=0x7f6d7806b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:21.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.734+0000 7f6d9e000640 1 --2- 172.21.15.37:0/3722787893 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d78068fd0 0x7f6d7806b490 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6d90007fd0 tx=0x7f6d90007ee0 comp rx=0 tx=0).stop 2024-05-30T06:49:21.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.734+0000 7f6d9e000640 1 -- 172.21.15.37:0/3722787893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d9815cb10 msgr2=0x7f6d9809b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:21.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.734+0000 7f6d9e000640 1 --2- 172.21.15.37:0/3722787893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d9815cb10 0x7f6d9809b440 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800b440 tx=0x7f6d8800b900 comp rx=0 tx=0).stop 2024-05-30T06:49:21.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.734+0000 7f6d9e000640 1 -- 172.21.15.37:0/3722787893 shutdown_connections 2024-05-30T06:49:21.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.734+0000 7f6d9e000640 1 --2- 172.21.15.37:0/3722787893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d9815cb10 0x7f6d9809b440 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:21.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.734+0000 7f6d9e000640 1 --2- 172.21.15.37:0/3722787893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d980b4e60 0x7f6d9809c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:21.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.734+0000 7f6d9e000640 1 --2- 172.21.15.37:0/3722787893 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d78068fd0 0x7f6d7806b490 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:21.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.734+0000 7f6d9e000640 1 --2- 172.21.15.37:0/3722787893 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d980702f0 0x7f6d9813eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:21.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.734+0000 7f6d9e000640 1 -- 172.21.15.37:0/3722787893 >> 172.21.15.37:0/3722787893 conn(0x7f6d9809aa60 msgr2=0x7f6d9806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:21.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.734+0000 7f6d9e000640 1 -- 172.21.15.37:0/3722787893 shutdown_connections 2024-05-30T06:49:21.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:21.734+0000 7f6d9e000640 1 -- 172.21.15.37:0/3722787893 wait complete. 2024-05-30T06:49:21.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone18546 2024-05-30T06:49:22.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.034+0000 7f80cb400640 1 Processor -- start 2024-05-30T06:49:22.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.034+0000 7f80cb400640 1 -- start start 2024-05-30T06:49:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.038+0000 7f80cb400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80c4155da0 0x7f80c40cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.038+0000 7f80cb400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f80c406f770 0x7f80c40b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.038+0000 7f80cb400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80c415f310 con 0x7f80c40cd440 2024-05-30T06:49:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.038+0000 7f80cb400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f80c415f5f0 con 0x7f80c4155da0 2024-05-30T06:49:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.038+0000 7f80cb400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f80c415f8d0 con 0x7f80c406f770 2024-05-30T06:49:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.038+0000 7f80c3e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f80c40cd440 0x7f80c406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47382/0 (socket says 172.21.15.37:47382) 2024-05-30T06:49:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.038+0000 7f80c3e00640 1 -- 172.21.15.37:0/1929874940 learned_addr learned my addr 172.21.15.37:0/1929874940 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.038+0000 7f80c8a00640 1 --2- 172.21.15.37:0/1929874940 >> v2:172.21.15.37:3300/0 conn(0x7f80c4155da0 0x7f80c40cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.038+0000 7f80c8a00640 1 -- 172.21.15.37:0/1929874940 >> v2:172.21.15.105:3300/0 conn(0x7f80c406f770 msgr2=0x7f80c40b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:22.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.038+0000 7f80c8a00640 1 --2- 172.21.15.37:0/1929874940 >> v2:172.21.15.105:3300/0 conn(0x7f80c406f770 0x7f80c40b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:22.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.038+0000 7f80c8a00640 1 -- 172.21.15.37:0/1929874940 >> v1:172.21.15.37:6789/0 conn(0x7f80c40cd440 legacy=0x7f80c406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:22.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.038+0000 7f80c8a00640 1 -- 172.21.15.37:0/1929874940 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c415fbb0 con 0x7f80c4155da0 2024-05-30T06:49:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.042+0000 7f80c8a00640 1 --2- 172.21.15.37:0/1929874940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c4155da0 0x7f80c40cd950 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f80c40b6600 tx=0x7f80bc01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad611447cb7373d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.054+0000 7f80c3400640 1 -- 172.21.15.37:0/1929874940 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0b0070 con 0x7f80c4155da0 2024-05-30T06:49:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.054+0000 7f80c3400640 1 -- 172.21.15.37:0/1929874940 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80bc0ab600 con 0x7f80c4155da0 2024-05-30T06:49:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.054+0000 7f80c3400640 1 -- 172.21.15.37:0/1929874940 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0ab9d0 con 0x7f80c4155da0 2024-05-30T06:49:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.058+0000 7f80cb400640 1 -- 172.21.15.37:0/1929874940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c4155da0 msgr2=0x7f80c40cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.058+0000 7f80cb400640 1 --2- 172.21.15.37:0/1929874940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c4155da0 0x7f80c40cd950 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f80c40b6600 tx=0x7f80bc01c380 comp rx=0 tx=0).stop 2024-05-30T06:49:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.058+0000 7f80cb400640 1 -- 172.21.15.37:0/1929874940 shutdown_connections 2024-05-30T06:49:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.058+0000 7f80cb400640 1 --2- 172.21.15.37:0/1929874940 >> v2:172.21.15.105:3300/0 conn(0x7f80c406f770 0x7f80c40b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.058+0000 7f80cb400640 1 --2- 172.21.15.37:0/1929874940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c4155da0 0x7f80c40cd950 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.058+0000 7f80cb400640 1 -- 172.21.15.37:0/1929874940 >> 172.21.15.37:0/1929874940 conn(0x7f80c406bf60 msgr2=0x7f80c40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:22.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.058+0000 7f80cb400640 1 -- 172.21.15.37:0/1929874940 shutdown_connections 2024-05-30T06:49:22.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.058+0000 7f80cb400640 1 -- 172.21.15.37:0/1929874940 wait complete. 2024-05-30T06:49:22.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.058+0000 7f80cb400640 1 Processor -- start 2024-05-30T06:49:22.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.058+0000 7f80cb400640 1 -- start start 2024-05-30T06:49:22.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80cb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c406f770 0x7f80c4144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:22.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80cb400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80c4155da0 0x7f80c414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:22.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80cb400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80c414e2c0 0x7f80c4164610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:22.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80cb400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4166570 con 0x7f80c406f770 2024-05-30T06:49:22.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80cb400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f80c40b46f0 con 0x7f80c414e2c0 2024-05-30T06:49:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80cb400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f80c41666f0 con 0x7f80c4155da0 2024-05-30T06:49:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80c8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c406f770 0x7f80c4144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80c8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c406f770 0x7f80c4144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60394/0 (socket says 172.21.15.37:60394) 2024-05-30T06:49:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80c8a00640 1 -- 172.21.15.37:0/3319114569 learned_addr learned my addr 172.21.15.37:0/3319114569 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80c8a00640 1 -- 172.21.15.37:0/3319114569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80c4155da0 msgr2=0x7f80c414dd80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:49:22.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80c8a00640 1 --2- 172.21.15.37:0/3319114569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80c4155da0 0x7f80c414dd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:22.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80c8a00640 1 -- 172.21.15.37:0/3319114569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80c414e2c0 msgr2=0x7f80c4164610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:49:22.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80c8a00640 1 --2- 172.21.15.37:0/3319114569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80c414e2c0 0x7f80c4164610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:22.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80c8a00640 1 -- 172.21.15.37:0/3319114569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c4165300 con 0x7f80c406f770 2024-05-30T06:49:22.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80c8a00640 1 --2- 172.21.15.37:0/3319114569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c406f770 0x7f80c4144650 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0ae040 tx=0x7f80bc01abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:22.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80c0c00640 1 -- 172.21.15.37:0/3319114569 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0b0050 con 0x7f80c406f770 2024-05-30T06:49:22.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80c0c00640 1 -- 172.21.15.37:0/3319114569 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80bc0b1040 con 0x7f80c406f770 2024-05-30T06:49:22.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.062+0000 7f80c0c00640 1 -- 172.21.15.37:0/3319114569 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0b5610 con 0x7f80c406f770 2024-05-30T06:49:22.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.066+0000 7f80cb400640 1 -- 172.21.15.37:0/3319114569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c41655e0 con 0x7f80c406f770 2024-05-30T06:49:22.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.066+0000 7f80cb400640 1 -- 172.21.15.37:0/3319114569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c4165ba0 con 0x7f80c406f770 2024-05-30T06:49:22.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.066+0000 7f80cb400640 1 -- 172.21.15.37:0/3319114569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c4068bc0 con 0x7f80c406f770 2024-05-30T06:49:22.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.070+0000 7f80c0c00640 1 -- 172.21.15.37:0/3319114569 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 89109+0+0 (secure 0 0 0) 0x7f80bc0be030 con 0x7f80c406f770 2024-05-30T06:49:22.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.070+0000 7f80c0c00640 1 --2- 172.21.15.37:0/3319114569 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80a40690b0 0x7f80a406b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:22.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.070+0000 7f80c0c00640 1 -- 172.21.15.37:0/3319114569 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f80bc120440 con 0x7f80c406f770 2024-05-30T06:49:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.074+0000 7f80c0c00640 1 -- 172.21.15.37:0/3319114569 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f80bc0c5020 con 0x7f80c406f770 2024-05-30T06:49:22.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.082+0000 7f80c3e00640 1 --2- 172.21.15.37:0/3319114569 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80a40690b0 0x7f80a406b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:22.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.126+0000 7f80c3e00640 1 --2- 172.21.15.37:0/3319114569 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80a40690b0 0x7f80a406b570 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f80b0000f70 tx=0x7f80b0007a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:22.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:22.454+0000 7f80cb400640 1 -- 172.21.15.37:0/3319114569 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone18546", "target": ["mon-mgr", ""]}) -- 0x7f80c415ec90 con 0x7f80a40690b0 2024-05-30T06:49:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:23.922+0000 7f80c0c00640 1 -- 172.21.15.37:0/3319114569 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f80c415ec90 con 0x7f80a40690b0 2024-05-30T06:49:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:23.926+0000 7f80cb400640 1 -- 172.21.15.37:0/3319114569 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80a40690b0 msgr2=0x7f80a406b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:23.926+0000 7f80cb400640 1 --2- 172.21.15.37:0/3319114569 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80a40690b0 0x7f80a406b570 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f80b0000f70 tx=0x7f80b0007a10 comp rx=0 tx=0).stop 2024-05-30T06:49:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:23.926+0000 7f80cb400640 1 -- 172.21.15.37:0/3319114569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c406f770 msgr2=0x7f80c4144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:23.926+0000 7f80cb400640 1 --2- 172.21.15.37:0/3319114569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c406f770 0x7f80c4144650 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0ae040 tx=0x7f80bc01abc0 comp rx=0 tx=0).stop 2024-05-30T06:49:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:23.926+0000 7f80cb400640 1 -- 172.21.15.37:0/3319114569 shutdown_connections 2024-05-30T06:49:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:23.926+0000 7f80cb400640 1 --2- 172.21.15.37:0/3319114569 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80a40690b0 0x7f80a406b570 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:23.926+0000 7f80cb400640 1 --2- 172.21.15.37:0/3319114569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80c414e2c0 0x7f80c4164610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:23.926+0000 7f80cb400640 1 --2- 172.21.15.37:0/3319114569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80c4155da0 0x7f80c414dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:23.926+0000 7f80cb400640 1 --2- 172.21.15.37:0/3319114569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c406f770 0x7f80c4144650 secure :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0ae040 tx=0x7f80bc01abc0 comp rx=0 tx=0).stop 2024-05-30T06:49:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:23.926+0000 7f80cb400640 1 -- 172.21.15.37:0/3319114569 >> 172.21.15.37:0/3319114569 conn(0x7f80c406bf60 msgr2=0x7f80c406ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:23.926+0000 7f80cb400640 1 -- 172.21.15.37:0/3319114569 shutdown_connections 2024-05-30T06:49:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:23.926+0000 7f80cb400640 1 -- 172.21.15.37:0/3319114569 wait complete. 2024-05-30T06:49:23.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone18547 2024-05-30T06:49:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.306+0000 7fe776800640 1 Processor -- start 2024-05-30T06:49:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.306+0000 7fe776800640 1 -- start start 2024-05-30T06:49:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.306+0000 7fe776800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7700cca80 0x7fe770165db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.306+0000 7fe776800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe77015b380 con 0x7fe77015f690 2024-05-30T06:49:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.306+0000 7fe776800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7700cfd00 con 0x7fe77015afa0 2024-05-30T06:49:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.306+0000 7fe776800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe7700cffe0 con 0x7fe7700cca80 2024-05-30T06:49:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.306+0000 7fe76ea00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe77015f690 0x7fe7700cb360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47394/0 (socket says 172.21.15.37:47394) 2024-05-30T06:49:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.306+0000 7fe76ea00640 1 -- 172.21.15.37:0/1494470654 learned_addr learned my addr 172.21.15.37:0/1494470654 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.306+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1912113768 0 0) 0x7fe77015b380 con 0x7fe77015f690 2024-05-30T06:49:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.306+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe754003530 con 0x7fe77015f690 2024-05-30T06:49:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76fe00640 1 --2- 172.21.15.37:0/1494470654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7700cca80 0x7fe770165db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2132086817 0 0) 0x7fe754003530 con 0x7fe77015f690 2024-05-30T06:49:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7700cca80 msgr2=0x7fe770165db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76e000640 1 --2- 172.21.15.37:0/1494470654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7700cca80 0x7fe770165db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 >> v1:172.21.15.105:6789/0 conn(0x7fe77015afa0 legacy=0x7fe770070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77006ba00 con 0x7fe77015f690 2024-05-30T06:49:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fe75c001680 con 0x7fe77015f690 2024-05-30T06:49:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 >> v1:172.21.15.37:6789/0 conn(0x7fe77015f690 legacy=0x7fe7700cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76e000640 1 --2- 172.21.15.37:0/1494470654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7540039f0 0x7fe754003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76e000640 1 --2- 172.21.15.37:0/1494470654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7700cca80 0x7fe754004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76e000640 1 --2- 172.21.15.37:0/1494470654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe754004dc0 0x7fe754005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7700cffe0 con 0x7fe754004dc0 2024-05-30T06:49:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe75400cd80 con 0x7fe7540039f0 2024-05-30T06:49:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe75400bcc0 con 0x7fe7700cca80 2024-05-30T06:49:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76fe00640 1 --2- 172.21.15.37:0/1494470654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe754004dc0 0x7fe754005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76fe00640 1 -- 172.21.15.37:0/1494470654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7700cca80 msgr2=0x7fe754004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76fe00640 1 --2- 172.21.15.37:0/1494470654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7700cca80 0x7fe754004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76fe00640 1 -- 172.21.15.37:0/1494470654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7540039f0 msgr2=0x7fe754003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76fe00640 1 --2- 172.21.15.37:0/1494470654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7540039f0 0x7fe754003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.310+0000 7fe76fe00640 1 -- 172.21.15.37:0/1494470654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe754003530 con 0x7fe754004dc0 2024-05-30T06:49:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.314+0000 7fe76fe00640 1 --2- 172.21.15.37:0/1494470654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe754004dc0 0x7fe754005240 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe768007f30 tx=0x7fe76801cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa86fef3ff8061a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.314+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7680b2070 con 0x7fe754004dc0 2024-05-30T06:49:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.314+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7680a5dc0 con 0x7fe754004dc0 2024-05-30T06:49:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.314+0000 7fe76e000640 1 -- 172.21.15.37:0/1494470654 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768007b30 con 0x7fe754004dc0 2024-05-30T06:49:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.314+0000 7fe776800640 1 -- 172.21.15.37:0/1494470654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe754004dc0 msgr2=0x7fe754005240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.314+0000 7fe776800640 1 --2- 172.21.15.37:0/1494470654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe754004dc0 0x7fe754005240 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe768007f30 tx=0x7fe76801cdb0 comp rx=0 tx=0).stop 2024-05-30T06:49:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.314+0000 7fe76fe00640 1 -- 172.21.15.37:0/1494470654 reap_dead start 2024-05-30T06:49:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.314+0000 7fe776800640 1 -- 172.21.15.37:0/1494470654 shutdown_connections 2024-05-30T06:49:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.314+0000 7fe776800640 1 -- 172.21.15.37:0/1494470654 >> 172.21.15.37:0/1494470654 conn(0x7fe7700cd790 msgr2=0x7fe7700cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.314+0000 7fe776800640 1 -- 172.21.15.37:0/1494470654 shutdown_connections 2024-05-30T06:49:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.314+0000 7fe776800640 1 -- 172.21.15.37:0/1494470654 wait complete. 2024-05-30T06:49:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe776800640 1 Processor -- start 2024-05-30T06:49:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe776800640 1 -- start start 2024-05-30T06:49:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe776800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7701594b0 0x7fe7700b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe776800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7700c6f60 0x7fe770159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe776800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7700c73c0 0x7fe77015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe776800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7700d02c0 con 0x7fe7700c73c0 2024-05-30T06:49:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe776800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe7700aeb50 con 0x7fe7701594b0 2024-05-30T06:49:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe776800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe77006d210 con 0x7fe7700c6f60 2024-05-30T06:49:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe76fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7700c73c0 0x7fe77015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe76fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7700c73c0 0x7fe77015a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60422/0 (socket says 172.21.15.37:60422) 2024-05-30T06:49:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe76fe00640 1 -- 172.21.15.37:0/3001034157 learned_addr learned my addr 172.21.15.37:0/3001034157 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe76fe00640 1 -- 172.21.15.37:0/3001034157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7700c6f60 msgr2=0x7fe770159ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:49:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe76fe00640 1 --2- 172.21.15.37:0/3001034157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7700c6f60 0x7fe770159ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe76fe00640 1 -- 172.21.15.37:0/3001034157 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7701594b0 msgr2=0x7fe7700b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe76fe00640 1 --2- 172.21.15.37:0/3001034157 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7701594b0 0x7fe7700b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.318+0000 7fe76fe00640 1 -- 172.21.15.37:0/3001034157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77015c210 con 0x7fe7700c73c0 2024-05-30T06:49:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.322+0000 7fe76fe00640 1 --2- 172.21.15.37:0/3001034157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7700c73c0 0x7fe77015a1e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe768002240 tx=0x7fe754005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.322+0000 7fe767400640 1 -- 172.21.15.37:0/3001034157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7680bd070 con 0x7fe7700c73c0 2024-05-30T06:49:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.322+0000 7fe767400640 1 -- 172.21.15.37:0/3001034157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7680b3040 con 0x7fe7700c73c0 2024-05-30T06:49:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.322+0000 7fe767400640 1 -- 172.21.15.37:0/3001034157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7680b2070 con 0x7fe7700c73c0 2024-05-30T06:49:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.322+0000 7fe776800640 1 -- 172.21.15.37:0/3001034157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77015b690 con 0x7fe7700c73c0 2024-05-30T06:49:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.322+0000 7fe776800640 1 -- 172.21.15.37:0/3001034157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe77015bc50 con 0x7fe7700c73c0 2024-05-30T06:49:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.322+0000 7fe776800640 1 -- 172.21.15.37:0/3001034157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe770075580 con 0x7fe7700c73c0 2024-05-30T06:49:24.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.326+0000 7fe767400640 1 -- 172.21.15.37:0/3001034157 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 89109+0+0 (secure 0 0 0) 0x7fe7680adbf0 con 0x7fe7700c73c0 2024-05-30T06:49:24.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.330+0000 7fe767400640 1 --2- 172.21.15.37:0/3001034157 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe750068fe0 0x7fe75006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:24.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.330+0000 7fe767400640 1 -- 172.21.15.37:0/3001034157 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fe76811f550 con 0x7fe7700c73c0 2024-05-30T06:49:24.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.342+0000 7fe767400640 1 -- 172.21.15.37:0/3001034157 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe7680c7080 con 0x7fe7700c73c0 2024-05-30T06:49:24.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.358+0000 7fe76f400640 1 --2- 172.21.15.37:0/3001034157 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe750068fe0 0x7fe75006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:24.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.402+0000 7fe76f400640 1 --2- 172.21.15.37:0/3001034157 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe750068fe0 0x7fe75006b4a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe760007fd0 tx=0x7fe7600079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:24.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:24.666+0000 7fe776800640 1 -- 172.21.15.37:0/3001034157 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone18547", "target": ["mon-mgr", ""]}) -- 0x7fe7700cf530 con 0x7fe750068fe0 2024-05-30T06:49:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.130+0000 7fe767400640 1 -- 172.21.15.37:0/3001034157 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe7700cf530 con 0x7fe750068fe0 2024-05-30T06:49:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.134+0000 7fe776800640 1 -- 172.21.15.37:0/3001034157 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe750068fe0 msgr2=0x7fe75006b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.134+0000 7fe776800640 1 --2- 172.21.15.37:0/3001034157 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe750068fe0 0x7fe75006b4a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe760007fd0 tx=0x7fe7600079c0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.134+0000 7fe776800640 1 -- 172.21.15.37:0/3001034157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7700c73c0 msgr2=0x7fe77015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.134+0000 7fe776800640 1 --2- 172.21.15.37:0/3001034157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7700c73c0 0x7fe77015a1e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe768002240 tx=0x7fe754005840 comp rx=0 tx=0).stop 2024-05-30T06:49:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.134+0000 7fe776800640 1 -- 172.21.15.37:0/3001034157 shutdown_connections 2024-05-30T06:49:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.134+0000 7fe776800640 1 --2- 172.21.15.37:0/3001034157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7700c73c0 0x7fe77015a1e0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.134+0000 7fe776800640 1 --2- 172.21.15.37:0/3001034157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe7700c6f60 0x7fe770159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.134+0000 7fe776800640 1 --2- 172.21.15.37:0/3001034157 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe750068fe0 0x7fe75006b4a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.134+0000 7fe776800640 1 --2- 172.21.15.37:0/3001034157 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe7701594b0 0x7fe7700b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.134+0000 7fe776800640 1 -- 172.21.15.37:0/3001034157 >> 172.21.15.37:0/3001034157 conn(0x7fe7700cd790 msgr2=0x7fe7700706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.134+0000 7fe776800640 1 -- 172.21.15.37:0/3001034157 shutdown_connections 2024-05-30T06:49:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.138+0000 7fe776800640 1 -- 172.21.15.37:0/3001034157 wait complete. 2024-05-30T06:49:26.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:49:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.442+0000 7f0bf3c00640 1 Processor -- start 2024-05-30T06:49:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.442+0000 7f0bf3c00640 1 -- start start 2024-05-30T06:49:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.442+0000 7f0bf3c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0bec15ec60 0x7f0bec0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0bf3c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bec15f040 0x7f0bec15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0bf3c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bec0cd170 con 0x7f0bec0ced60 2024-05-30T06:49:26.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0bf3c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0bec06fb40 con 0x7f0bec15ec60 2024-05-30T06:49:26.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0bf3c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0bec06f6b0 con 0x7f0bec15f040 2024-05-30T06:49:26.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0bf1200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0bec15ec60 0x7f0bec0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:26.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0bf1c00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0bec0ced60 0x7f0bec0cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47404/0 (socket says 172.21.15.37:47404) 2024-05-30T06:49:26.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0bf1200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0bec15ec60 0x7f0bec0afbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:56890/0 (socket says 172.21.15.37:56890) 2024-05-30T06:49:26.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0bf1c00640 1 -- 172.21.15.37:0/3491547928 learned_addr learned my addr 172.21.15.37:0/3491547928 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:26.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0bebe00640 1 --2- 172.21.15.37:0/3491547928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bec15f040 0x7f0bec15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:26.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0beb400640 1 -- 172.21.15.37:0/3491547928 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793376617 0 0) 0x7f0bec0cd170 con 0x7f0bec0ced60 2024-05-30T06:49:26.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0beb400640 1 -- 172.21.15.37:0/3491547928 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bd4005740 con 0x7f0bec0ced60 2024-05-30T06:49:26.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0bf1200640 1 -- 172.21.15.37:0/3491547928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bec15f040 msgr2=0x7f0bec15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:26.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0bf1200640 1 --2- 172.21.15.37:0/3491547928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bec15f040 0x7f0bec15f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0bf1200640 1 -- 172.21.15.37:0/3491547928 >> v1:172.21.15.37:6789/0 conn(0x7f0bec0ced60 legacy=0x7f0bec0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:26.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.446+0000 7f0bf1200640 1 -- 172.21.15.37:0/3491547928 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bec0cd450 con 0x7f0bec15ec60 2024-05-30T06:49:26.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.450+0000 7f0bf1200640 1 --2- 172.21.15.37:0/3491547928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bec15ec60 0x7f0bec0afbf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80097c0 tx=0x7f0bd801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5a0ee595a7f79de server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:26.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.454+0000 7f0beb400640 1 -- 172.21.15.37:0/3491547928 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80b1070 con 0x7f0bec15ec60 2024-05-30T06:49:26.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.454+0000 7f0beb400640 1 -- 172.21.15.37:0/3491547928 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd80ac410 con 0x7f0bec15ec60 2024-05-30T06:49:26.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.454+0000 7f0beb400640 1 -- 172.21.15.37:0/3491547928 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd80ac7e0 con 0x7f0bec15ec60 2024-05-30T06:49:26.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.454+0000 7f0bf3c00640 1 -- 172.21.15.37:0/3491547928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bec15ec60 msgr2=0x7f0bec0afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:26.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.454+0000 7f0bf3c00640 1 --2- 172.21.15.37:0/3491547928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bec15ec60 0x7f0bec0afbf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80097c0 tx=0x7f0bd801c4a0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.454+0000 7f0bf3c00640 1 -- 172.21.15.37:0/3491547928 shutdown_connections 2024-05-30T06:49:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.454+0000 7f0bf3c00640 1 --2- 172.21.15.37:0/3491547928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bec15f040 0x7f0bec15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.454+0000 7f0bf3c00640 1 --2- 172.21.15.37:0/3491547928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bec15ec60 0x7f0bec0afbf0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.454+0000 7f0bf3c00640 1 -- 172.21.15.37:0/3491547928 >> 172.21.15.37:0/3491547928 conn(0x7f0bec0b23a0 msgr2=0x7f0bec0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.454+0000 7f0bf3c00640 1 -- 172.21.15.37:0/3491547928 shutdown_connections 2024-05-30T06:49:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.454+0000 7f0bf3c00640 1 -- 172.21.15.37:0/3491547928 wait complete. 2024-05-30T06:49:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf3c00640 1 Processor -- start 2024-05-30T06:49:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf3c00640 1 -- start start 2024-05-30T06:49:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf3c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bec0ced60 0x7f0bec1f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:26.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf3c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bec15ec60 0x7f0bec15cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:26.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf3c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bec15f040 0x7f0bec147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:26.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf3c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0bec06e390 con 0x7f0bec15f040 2024-05-30T06:49:26.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf3c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0bec06e210 con 0x7f0bec0ced60 2024-05-30T06:49:26.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf3c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0bec06e510 con 0x7f0bec15ec60 2024-05-30T06:49:26.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf1c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bec15f040 0x7f0bec147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:26.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf1c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bec15f040 0x7f0bec147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60436/0 (socket says 172.21.15.37:60436) 2024-05-30T06:49:26.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf1c00640 1 -- 172.21.15.37:0/61368238 learned_addr learned my addr 172.21.15.37:0/61368238 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf1c00640 1 -- 172.21.15.37:0/61368238 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bec15ec60 msgr2=0x7f0bec15cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf1c00640 1 --2- 172.21.15.37:0/61368238 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bec15ec60 0x7f0bec15cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf1c00640 1 -- 172.21.15.37:0/61368238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bec0ced60 msgr2=0x7f0bec1f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf1c00640 1 --2- 172.21.15.37:0/61368238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bec0ced60 0x7f0bec1f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf1c00640 1 -- 172.21.15.37:0/61368238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bec1f3fd0 con 0x7f0bec15f040 2024-05-30T06:49:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0bf1c00640 1 --2- 172.21.15.37:0/61368238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bec15f040 0x7f0bec147ac0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0be400ca20 tx=0x7f0be400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.458+0000 7f0be8c00640 1 -- 172.21.15.37:0/61368238 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4017070 con 0x7f0bec15f040 2024-05-30T06:49:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.462+0000 7f0be8c00640 1 -- 172.21.15.37:0/61368238 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be400abd0 con 0x7f0bec15f040 2024-05-30T06:49:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.462+0000 7f0be8c00640 1 -- 172.21.15.37:0/61368238 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4012400 con 0x7f0bec15f040 2024-05-30T06:49:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.462+0000 7f0bf3c00640 1 -- 172.21.15.37:0/61368238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bec1f4270 con 0x7f0bec15f040 2024-05-30T06:49:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.462+0000 7f0bf3c00640 1 -- 172.21.15.37:0/61368238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bec14d4a0 con 0x7f0bec15f040 2024-05-30T06:49:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.462+0000 7f0bf3c00640 1 -- 172.21.15.37:0/61368238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bec068b20 con 0x7f0bec15f040 2024-05-30T06:49:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.462+0000 7f0be8c00640 1 -- 172.21.15.37:0/61368238 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 89109+0+0 (secure 0 0 0) 0x7f0be401a070 con 0x7f0bec15f040 2024-05-30T06:49:26.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.466+0000 7f0be8c00640 1 --2- 172.21.15.37:0/61368238 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bcc069010 0x7f0bcc06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:26.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.466+0000 7f0be8c00640 1 -- 172.21.15.37:0/61368238 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f0be4085760 con 0x7f0bec15f040 2024-05-30T06:49:26.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.470+0000 7f0be8c00640 1 -- 172.21.15.37:0/61368238 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0be4021020 con 0x7f0bec15f040 2024-05-30T06:49:26.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.498+0000 7f0bf1200640 1 --2- 172.21.15.37:0/61368238 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bcc069010 0x7f0bcc06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:26.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.558+0000 7f0bf1200640 1 --2- 172.21.15.37:0/61368238 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bcc069010 0x7f0bcc06b4d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80ae000 tx=0x7f0bd8004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.882+0000 7f0bf3c00640 1 -- 172.21.15.37:0/61368238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0bec0b50a0 con 0x7f0bec15f040 2024-05-30T06:49:26.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.898+0000 7f0be8c00640 1 -- 172.21.15.37:0/61368238 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2413 (secure 0 0 0) 0x7f0be4057530 con 0x7f0bec15f040 2024-05-30T06:49:26.904 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:49:26.904 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:49:26.904 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:49:26.904 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:49:26.904 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:49:26.904 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:49:26.904 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:49:26.905 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:26.905 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:49:26.905 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:49:26.905 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:49:26.905 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:49:26.905 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:49:26.905 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:26.905 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:49:26.905 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:49:26.905 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:49:26.905 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:49:26.905 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:26.905 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 461, 2024-05-30T06:49:26.906 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:49:26.906 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:49:26.906 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:49:26.906 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:49:26.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:26.906 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:49:26.906 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 60, 2024-05-30T06:49:26.906 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:49:26.906 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:49:26.906 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:49:26.906 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:49:26.906 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1910, 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 7869767733, 2024-05-30T06:49:26.907 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 15619911680, 2024-05-30T06:49:26.908 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 757474201600, 2024-05-30T06:49:26.908 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:49:26.908 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 402781830, 2024-05-30T06:49:26.908 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 431821057, 2024-05-30T06:49:26.908 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 98, 2024-05-30T06:49:26.908 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 118 2024-05-30T06:49:26.908 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:26.908 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:49:26.908 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 38, 2024-05-30T06:49:26.908 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4, 2024-05-30T06:49:26.908 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 4, 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6055 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:49:26.910 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:49:26.910 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:49:26.910 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:49:26.910 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:49:26.910 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:49:26.910 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:49:26.910 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:26.910 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:49:26.910 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:26.910 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:49:26.911 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 8, 2024-05-30T06:49:26.911 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:46:54.717237+0000", 2024-05-30T06:49:26.911 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:49:26.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:26.911 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:49:26.911 INFO:teuthology.orchestra.run.smithi037.stdout: "0c673918-505c-43b2-ac62-86da33d8d10b": { 2024-05-30T06:49:26.911 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "6 ongoing+pending clones; Avg progress is 28.95% (2s)\n [========....................] (remaining: 5s)", 2024-05-30T06:49:26.911 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.28949999809265137, 2024-05-30T06:49:26.911 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:49:26.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:26.911 INFO:teuthology.orchestra.run.smithi037.stdout: "8c2a545f-d3da-46a4-bf90-e6e248c7dcb3": { 2024-05-30T06:49:26.911 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "4 ongoing clones; Avg progress is 35.091% (7s)\n [=========...................] (remaining: 14s)", 2024-05-30T06:49:26.912 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.3509100079536438, 2024-05-30T06:49:26.912 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:49:26.912 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:26.912 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:26.912 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:49:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.906+0000 7f0bf3c00640 1 -- 172.21.15.37:0/61368238 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bcc069010 msgr2=0x7f0bcc06b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.906+0000 7f0bf3c00640 1 --2- 172.21.15.37:0/61368238 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bcc069010 0x7f0bcc06b4d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80ae000 tx=0x7f0bd8004740 comp rx=0 tx=0).stop 2024-05-30T06:49:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.906+0000 7f0bf3c00640 1 -- 172.21.15.37:0/61368238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bec15f040 msgr2=0x7f0bec147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.906+0000 7f0bf3c00640 1 --2- 172.21.15.37:0/61368238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bec15f040 0x7f0bec147ac0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0be400ca20 tx=0x7f0be400cee0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.906+0000 7f0bf3c00640 1 -- 172.21.15.37:0/61368238 shutdown_connections 2024-05-30T06:49:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.906+0000 7f0bf3c00640 1 --2- 172.21.15.37:0/61368238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bec15f040 0x7f0bec147ac0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.906+0000 7f0bf3c00640 1 --2- 172.21.15.37:0/61368238 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bec15ec60 0x7f0bec15cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.906+0000 7f0bf3c00640 1 --2- 172.21.15.37:0/61368238 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bcc069010 0x7f0bcc06b4d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.906+0000 7f0bf3c00640 1 --2- 172.21.15.37:0/61368238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bec0ced60 0x7f0bec1f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.906+0000 7f0bf3c00640 1 -- 172.21.15.37:0/61368238 >> 172.21.15.37:0/61368238 conn(0x7f0bec0b23a0 msgr2=0x7f0bec0cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:26.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.906+0000 7f0bf3c00640 1 -- 172.21.15.37:0/61368238 shutdown_connections 2024-05-30T06:49:26.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:26.906+0000 7f0bf3c00640 1 -- 172.21.15.37:0/61368238 wait complete. 2024-05-30T06:49:26.961 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone18541 2024-05-30T06:49:27.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.214+0000 7f6fb0000640 1 Processor -- start 2024-05-30T06:49:27.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.214+0000 7f6fb0000640 1 -- start start 2024-05-30T06:49:27.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.218+0000 7f6fb0000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fa815ac70 0x7f6fa8072be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:27.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.218+0000 7f6fb0000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6fa80af8c0 0x7f6fa8073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:27.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.218+0000 7f6fb0000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fa8070490 con 0x7f6fa80b4750 2024-05-30T06:49:27.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.218+0000 7f6fb0000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa80b42c0 con 0x7f6fa80af8c0 2024-05-30T06:49:27.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.218+0000 7f6fb0000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa80b0280 con 0x7f6fa815ac70 2024-05-30T06:49:27.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.218+0000 7f6fae000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6fa80af8c0 0x7f6fa8073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:27.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.218+0000 7f6fae000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6fa80af8c0 0x7f6fa8073120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60438/0 (socket says 172.21.15.37:60438) 2024-05-30T06:49:27.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.218+0000 7f6fae000640 1 -- 172.21.15.37:0/3533538184 learned_addr learned my addr 172.21.15.37:0/3533538184 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:27.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.218+0000 7f6fae000640 1 -- 172.21.15.37:0/3533538184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fa815ac70 msgr2=0x7f6fa8072be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:27.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.218+0000 7f6fae000640 1 --2- 172.21.15.37:0/3533538184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fa815ac70 0x7f6fa8072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:27.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.218+0000 7f6fae000640 1 -- 172.21.15.37:0/3533538184 >> v1:172.21.15.105:6789/0 conn(0x7f6fa80b4750 legacy=0x7f6fa815e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:27.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.218+0000 7f6fae000640 1 -- 172.21.15.37:0/3533538184 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa80affa0 con 0x7f6fa80af8c0 2024-05-30T06:49:27.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.222+0000 7f6fae000640 1 --2- 172.21.15.37:0/3533538184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80af8c0 0x7f6fa8073120 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000af60 tx=0x7f6fa001ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656c8c9cdd566b04 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.222+0000 7f6fa7e00640 1 -- 172.21.15.37:0/3533538184 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000a2d0 con 0x7f6fa80af8c0 2024-05-30T06:49:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.222+0000 7f6fa7e00640 1 -- 172.21.15.37:0/3533538184 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa00a7a60 con 0x7f6fa80af8c0 2024-05-30T06:49:27.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.222+0000 7f6fa7e00640 1 -- 172.21.15.37:0/3533538184 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa00a7e30 con 0x7f6fa80af8c0 2024-05-30T06:49:27.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.226+0000 7f6fb0000640 1 -- 172.21.15.37:0/3533538184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80af8c0 msgr2=0x7f6fa8073120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:27.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.226+0000 7f6fb0000640 1 --2- 172.21.15.37:0/3533538184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80af8c0 0x7f6fa8073120 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000af60 tx=0x7f6fa001ec10 comp rx=0 tx=0).stop 2024-05-30T06:49:27.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.226+0000 7f6fb0000640 1 -- 172.21.15.37:0/3533538184 shutdown_connections 2024-05-30T06:49:27.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.226+0000 7f6fb0000640 1 --2- 172.21.15.37:0/3533538184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80af8c0 0x7f6fa8073120 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:27.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.226+0000 7f6fb0000640 1 --2- 172.21.15.37:0/3533538184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fa815ac70 0x7f6fa8072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:27.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.226+0000 7f6fb0000640 1 -- 172.21.15.37:0/3533538184 >> 172.21.15.37:0/3533538184 conn(0x7f6fa80d0860 msgr2=0x7f6fa80d0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:27.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.226+0000 7f6fb0000640 1 -- 172.21.15.37:0/3533538184 shutdown_connections 2024-05-30T06:49:27.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.226+0000 7f6fb0000640 1 -- 172.21.15.37:0/3533538184 wait complete. 2024-05-30T06:49:27.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.230+0000 7f6fb0000640 1 Processor -- start 2024-05-30T06:49:27.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.230+0000 7f6fb0000640 1 -- start start 2024-05-30T06:49:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.230+0000 7f6fb0000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fa80af8c0 0x7f6fa8158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.230+0000 7f6fb0000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80b4750 0x7f6fa806e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.230+0000 7f6fb0000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fa815ac70 0x7f6fa8145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.230+0000 7f6fb0000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa815b1d0 con 0x7f6fa80b4750 2024-05-30T06:49:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.230+0000 7f6fb0000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa815b050 con 0x7f6fa80af8c0 2024-05-30T06:49:27.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.230+0000 7f6fb0000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa815f000 con 0x7f6fa815ac70 2024-05-30T06:49:27.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6fad600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fa80af8c0 0x7f6fa8158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:27.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6fad600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fa80af8c0 0x7f6fa8158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:56908/0 (socket says 172.21.15.37:56908) 2024-05-30T06:49:27.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6fad600640 1 -- 172.21.15.37:0/3121838605 learned_addr learned my addr 172.21.15.37:0/3121838605 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:27.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6fae000640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fa815ac70 0x7f6fa8145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:27.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6facc00640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80b4750 0x7f6fa806e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:27.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6facc00640 1 -- 172.21.15.37:0/3121838605 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fa815ac70 msgr2=0x7f6fa8145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:27.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6facc00640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fa815ac70 0x7f6fa8145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:27.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6facc00640 1 -- 172.21.15.37:0/3121838605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fa80af8c0 msgr2=0x7f6fa8158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:27.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6facc00640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fa80af8c0 0x7f6fa8158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:27.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6facc00640 1 -- 172.21.15.37:0/3121838605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa815d860 con 0x7f6fa80b4750 2024-05-30T06:49:27.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6facc00640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80b4750 0x7f6fa806e5b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6f94001a70 tx=0x7f6f94014420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:27.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6fa5600640 1 -- 172.21.15.37:0/3121838605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94014ab0 con 0x7f6fa80b4750 2024-05-30T06:49:27.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6fa5600640 1 -- 172.21.15.37:0/3121838605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f94014c70 con 0x7f6fa80b4750 2024-05-30T06:49:27.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6fb0000640 1 -- 172.21.15.37:0/3121838605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa815db40 con 0x7f6fa80b4750 2024-05-30T06:49:27.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.234+0000 7f6fa5600640 1 -- 172.21.15.37:0/3121838605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94014e60 con 0x7f6fa80b4750 2024-05-30T06:49:27.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.238+0000 7f6fb0000640 1 -- 172.21.15.37:0/3121838605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa815e100 con 0x7f6fa80b4750 2024-05-30T06:49:27.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.238+0000 7f6fb0000640 1 -- 172.21.15.37:0/3121838605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f840052a0 con 0x7f6fa80b4750 2024-05-30T06:49:27.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.242+0000 7f6fa5600640 1 -- 172.21.15.37:0/3121838605 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 89109+0+0 (secure 0 0 0) 0x7f6f94005310 con 0x7f6fa80b4750 2024-05-30T06:49:27.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.242+0000 7f6fa5600640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6f88069010 0x7f6f8806b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:27.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.242+0000 7f6fa5600640 1 -- 172.21.15.37:0/3121838605 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f6f9408d0d0 con 0x7f6fa80b4750 2024-05-30T06:49:27.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.246+0000 7f6fad600640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6f88069010 0x7f6f8806b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:27.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.250+0000 7f6fad600640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6f88069010 0x7f6f8806b4d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0099b0 tx=0x7f6f9c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.266+0000 7f6fa5600640 1 -- 172.21.15.37:0/3121838605 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6f9405eac0 con 0x7f6fa80b4750 2024-05-30T06:49:27.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:27.674+0000 7f6fb0000640 1 -- 172.21.15.37:0/3121838605 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone18541", "target": ["mon-mgr", ""]}) -- 0x7f6f84000bd0 con 0x7f6f88069010 2024-05-30T06:49:27.780 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:27.776+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:27.780 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:27.776+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:27.780 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:27.776+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:27.780 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:27.776+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:27.780 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:49:27.776+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:49:29.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.126+0000 7f6fa5600640 1 -- 172.21.15.37:0/3121838605 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6f84000bd0 con 0x7f6f88069010 2024-05-30T06:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.126+0000 7f6fb0000640 1 -- 172.21.15.37:0/3121838605 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6f88069010 msgr2=0x7f6f8806b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.126+0000 7f6fb0000640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6f88069010 0x7f6f8806b4d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0099b0 tx=0x7f6f9c009190 comp rx=0 tx=0).stop 2024-05-30T06:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.126+0000 7f6fb0000640 1 -- 172.21.15.37:0/3121838605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80b4750 msgr2=0x7f6fa806e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.126+0000 7f6fb0000640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80b4750 0x7f6fa806e5b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6f94001a70 tx=0x7f6f94014420 comp rx=0 tx=0).stop 2024-05-30T06:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.126+0000 7f6fb0000640 1 -- 172.21.15.37:0/3121838605 shutdown_connections 2024-05-30T06:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.126+0000 7f6fb0000640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fa815ac70 0x7f6fa8145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.126+0000 7f6fb0000640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80b4750 0x7f6fa806e5b0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.126+0000 7f6fb0000640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6f88069010 0x7f6f8806b4d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.126+0000 7f6fb0000640 1 --2- 172.21.15.37:0/3121838605 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fa80af8c0 0x7f6fa8158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.126+0000 7f6fb0000640 1 -- 172.21.15.37:0/3121838605 >> 172.21.15.37:0/3121838605 conn(0x7f6fa80d0860 msgr2=0x7f6fa8165370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.126+0000 7f6fb0000640 1 -- 172.21.15.37:0/3121838605 shutdown_connections 2024-05-30T06:49:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.126+0000 7f6fb0000640 1 -- 172.21.15.37:0/3121838605 wait complete. 2024-05-30T06:49:29.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone18542 2024-05-30T06:49:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.482+0000 7fd0aa000640 1 Processor -- start 2024-05-30T06:49:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.482+0000 7fd0aa000640 1 -- start start 2024-05-30T06:49:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.486+0000 7fd0aa000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd09c033e40 0x7fd09c0eb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.486+0000 7fd0aa000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd09c047c20 0x7fd09c0eb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.486+0000 7fd0aa000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd09c0ebc00 0x7fd09c052f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.486+0000 7fd0aa000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd09c050210 con 0x7fd09c047c20 2024-05-30T06:49:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.486+0000 7fd0aa000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd09c037bc0 con 0x7fd09c033e40 2024-05-30T06:49:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.486+0000 7fd0aa000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd09c04f090 con 0x7fd09c0ebc00 2024-05-30T06:49:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.486+0000 7fd0a9600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd09c0ebc00 0x7fd09c052f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.486+0000 7fd0a9600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd09c0ebc00 0x7fd09c052f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:51048/0 (socket says 172.21.15.37:51048) 2024-05-30T06:49:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.486+0000 7fd0a9600640 1 -- 172.21.15.37:0/167789890 learned_addr learned my addr 172.21.15.37:0/167789890 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.486+0000 7fd0a8c00640 1 --2- 172.21.15.37:0/167789890 >> v2:172.21.15.105:3300/0 conn(0x7fd09c033e40 0x7fd09c0eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.490+0000 7fd0a8c00640 1 -- 172.21.15.37:0/167789890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd09c0ebc00 msgr2=0x7fd09c052f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.490+0000 7fd0a8c00640 1 --2- 172.21.15.37:0/167789890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd09c0ebc00 0x7fd09c052f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.490+0000 7fd0a8c00640 1 -- 172.21.15.37:0/167789890 >> v2:172.21.15.37:3300/0 conn(0x7fd09c047c20 msgr2=0x7fd09c0eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:29.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.490+0000 7fd0a8c00640 1 --2- 172.21.15.37:0/167789890 >> v2:172.21.15.37:3300/0 conn(0x7fd09c047c20 0x7fd09c0eb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:29.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.490+0000 7fd0a8c00640 1 -- 172.21.15.37:0/167789890 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c034220 con 0x7fd09c033e40 2024-05-30T06:49:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.506+0000 7fd0a8c00640 1 --2- 172.21.15.37:0/167789890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd09c033e40 0x7fd09c0eb180 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd09c054a30 tx=0x7fd09801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34fad6f5ac82bec1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.506+0000 7fd0a3400640 1 -- 172.21.15.37:0/167789890 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0980b5070 con 0x7fd09c033e40 2024-05-30T06:49:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.506+0000 7fd0a3400640 1 -- 172.21.15.37:0/167789890 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0980a8830 con 0x7fd09c033e40 2024-05-30T06:49:29.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.506+0000 7fd0a3400640 1 -- 172.21.15.37:0/167789890 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0980a8c00 con 0x7fd09c033e40 2024-05-30T06:49:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.510+0000 7fd0aa000640 1 -- 172.21.15.37:0/167789890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd09c033e40 msgr2=0x7fd09c0eb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.510+0000 7fd0aa000640 1 --2- 172.21.15.37:0/167789890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd09c033e40 0x7fd09c0eb180 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd09c054a30 tx=0x7fd09801ec70 comp rx=0 tx=0).stop 2024-05-30T06:49:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.510+0000 7fd0aa000640 1 -- 172.21.15.37:0/167789890 shutdown_connections 2024-05-30T06:49:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.510+0000 7fd0aa000640 1 --2- 172.21.15.37:0/167789890 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd09c0ebc00 0x7fd09c052f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.510+0000 7fd0aa000640 1 --2- 172.21.15.37:0/167789890 >> v2:172.21.15.37:3300/0 conn(0x7fd09c047c20 0x7fd09c0eb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.510+0000 7fd0aa000640 1 --2- 172.21.15.37:0/167789890 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd09c033e40 0x7fd09c0eb180 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.510+0000 7fd0aa000640 1 -- 172.21.15.37:0/167789890 >> 172.21.15.37:0/167789890 conn(0x7fd09c009fc0 msgr2=0x7fd09c00a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:29.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.510+0000 7fd0aa000640 1 -- 172.21.15.37:0/167789890 shutdown_connections 2024-05-30T06:49:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.510+0000 7fd0aa000640 1 -- 172.21.15.37:0/167789890 wait complete. 2024-05-30T06:49:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0aa000640 1 Processor -- start 2024-05-30T06:49:29.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0aa000640 1 -- start start 2024-05-30T06:49:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0aa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c033e40 0x7fd09c04bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:29.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0aa000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd09c047c20 0x7fd09c036eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:29.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0aa000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd09c0ebc00 0x7fd09c0dbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:29.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0a8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c033e40 0x7fd09c04bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:29.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0a8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c033e40 0x7fd09c04bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48518/0 (socket says 172.21.15.37:48518) 2024-05-30T06:49:29.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0aa000640 1 -- 172.21.15.37:0/3495466047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c04f2e0 con 0x7fd09c033e40 2024-05-30T06:49:29.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0aa000640 1 -- 172.21.15.37:0/3495466047 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd09c04fd80 con 0x7fd09c0ebc00 2024-05-30T06:49:29.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0aa000640 1 -- 172.21.15.37:0/3495466047 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd09c04f5c0 con 0x7fd09c047c20 2024-05-30T06:49:29.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0a8c00640 1 -- 172.21.15.37:0/3495466047 learned_addr learned my addr 172.21.15.37:0/3495466047 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:29.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0a8c00640 1 -- 172.21.15.37:0/3495466047 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd09c047c20 msgr2=0x7fd09c036eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:29.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0a8c00640 1 --2- 172.21.15.37:0/3495466047 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd09c047c20 0x7fd09c036eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:29.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0a8c00640 1 -- 172.21.15.37:0/3495466047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd09c0ebc00 msgr2=0x7fd09c0dbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:29.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0a8c00640 1 --2- 172.21.15.37:0/3495466047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd09c0ebc00 0x7fd09c0dbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:29.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0a8c00640 1 -- 172.21.15.37:0/3495466047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09c04c2d0 con 0x7fd09c033e40 2024-05-30T06:49:29.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.514+0000 7fd0a8c00640 1 --2- 172.21.15.37:0/3495466047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c033e40 0x7fd09c04bba0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd0980b3040 tx=0x7fd09801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:29.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.518+0000 7fd0a0c00640 1 -- 172.21.15.37:0/3495466047 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0980bf070 con 0x7fd09c033e40 2024-05-30T06:49:29.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.518+0000 7fd0aa000640 1 -- 172.21.15.37:0/3495466047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09c04c5b0 con 0x7fd09c033e40 2024-05-30T06:49:29.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.518+0000 7fd0aa000640 1 -- 172.21.15.37:0/3495466047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd09c04cb70 con 0x7fd09c033e40 2024-05-30T06:49:29.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.518+0000 7fd0a0c00640 1 -- 172.21.15.37:0/3495466047 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0980a87d0 con 0x7fd09c033e40 2024-05-30T06:49:29.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.518+0000 7fd0a0c00640 1 -- 172.21.15.37:0/3495466047 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0980b5040 con 0x7fd09c033e40 2024-05-30T06:49:29.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.518+0000 7fd0aa000640 1 -- 172.21.15.37:0/3495466047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0800052a0 con 0x7fd09c033e40 2024-05-30T06:49:29.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.518+0000 7fd0a0c00640 1 -- 172.21.15.37:0/3495466047 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 89160+0+0 (secure 0 0 0) 0x7fd0980c2070 con 0x7fd09c033e40 2024-05-30T06:49:29.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.522+0000 7fd0a0c00640 1 --2- 172.21.15.37:0/3495466047 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd0840690a0 0x7fd08406b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:29.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.522+0000 7fd0a0c00640 1 -- 172.21.15.37:0/3495466047 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fd098121e70 con 0x7fd09c033e40 2024-05-30T06:49:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.526+0000 7fd0a0c00640 1 -- 172.21.15.37:0/3495466047 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd0980187d0 con 0x7fd09c033e40 2024-05-30T06:49:29.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.530+0000 7fd0a3e00640 1 --2- 172.21.15.37:0/3495466047 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd0840690a0 0x7fd08406b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:29.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.566+0000 7fd0a3e00640 1 --2- 172.21.15.37:0/3495466047 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd0840690a0 0x7fd08406b560 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd09c036190 tx=0x7fd090006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:29.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:29.922+0000 7fd0aa000640 1 -- 172.21.15.37:0/3495466047 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone18542", "target": ["mon-mgr", ""]}) -- 0x7fd080000bd0 con 0x7fd0840690a0 2024-05-30T06:49:30.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:30.946+0000 7fd0a0c00640 1 -- 172.21.15.37:0/3495466047 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd080000bd0 con 0x7fd0840690a0 2024-05-30T06:49:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:30.950+0000 7fd0aa000640 1 -- 172.21.15.37:0/3495466047 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd0840690a0 msgr2=0x7fd08406b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:30.950+0000 7fd0aa000640 1 --2- 172.21.15.37:0/3495466047 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd0840690a0 0x7fd08406b560 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd09c036190 tx=0x7fd090006ca0 comp rx=0 tx=0).stop 2024-05-30T06:49:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:30.950+0000 7fd0aa000640 1 -- 172.21.15.37:0/3495466047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c033e40 msgr2=0x7fd09c04bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:30.950+0000 7fd0aa000640 1 --2- 172.21.15.37:0/3495466047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c033e40 0x7fd09c04bba0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd0980b3040 tx=0x7fd09801ba10 comp rx=0 tx=0).stop 2024-05-30T06:49:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:30.950+0000 7fd0aa000640 1 -- 172.21.15.37:0/3495466047 shutdown_connections 2024-05-30T06:49:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:30.950+0000 7fd0aa000640 1 --2- 172.21.15.37:0/3495466047 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd0840690a0 0x7fd08406b560 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:30.950+0000 7fd0aa000640 1 --2- 172.21.15.37:0/3495466047 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd09c0ebc00 0x7fd09c0dbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:30.950+0000 7fd0aa000640 1 --2- 172.21.15.37:0/3495466047 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd09c047c20 0x7fd09c036eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:30.950+0000 7fd0aa000640 1 --2- 172.21.15.37:0/3495466047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd09c033e40 0x7fd09c04bba0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:30.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:30.950+0000 7fd0aa000640 1 -- 172.21.15.37:0/3495466047 >> 172.21.15.37:0/3495466047 conn(0x7fd09c009fc0 msgr2=0x7fd09c005de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:30.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:30.950+0000 7fd0aa000640 1 -- 172.21.15.37:0/3495466047 shutdown_connections 2024-05-30T06:49:30.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:30.950+0000 7fd0aa000640 1 -- 172.21.15.37:0/3495466047 wait complete. 2024-05-30T06:49:30.989 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone18543 2024-05-30T06:49:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.222+0000 7f312e000640 1 Processor -- start 2024-05-30T06:49:31.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.226+0000 7f312e000640 1 -- start start 2024-05-30T06:49:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.226+0000 7f312e000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f31280cd440 0x7f31280cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.226+0000 7f312e000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3128155da0 0x7f31280cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.226+0000 7f312e000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31280cfa20 0x7f31280cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.226+0000 7f312e000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3128162550 con 0x7f3128155da0 2024-05-30T06:49:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.226+0000 7f312e000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f31280d03f0 con 0x7f31280cd440 2024-05-30T06:49:31.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.226+0000 7f312e000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f312815f310 con 0x7f31280cfa20 2024-05-30T06:49:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.226+0000 7f3127400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f31280cd440 0x7f31280cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.230+0000 7f3127400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f31280cd440 0x7f31280cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:40940/0 (socket says 172.21.15.37:40940) 2024-05-30T06:49:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.230+0000 7f3127400640 1 -- 172.21.15.37:0/1742599322 learned_addr learned my addr 172.21.15.37:0/1742599322 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.230+0000 7f3126a00640 1 --2- 172.21.15.37:0/1742599322 >> v2:172.21.15.37:3300/0 conn(0x7f3128155da0 0x7f31280cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:31.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.230+0000 7f3127400640 1 -- 172.21.15.37:0/1742599322 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31280cfa20 msgr2=0x7f31280cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:31.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.230+0000 7f3127400640 1 --2- 172.21.15.37:0/1742599322 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31280cfa20 0x7f31280cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:31.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.230+0000 7f3127400640 1 -- 172.21.15.37:0/1742599322 >> v2:172.21.15.37:3300/0 conn(0x7f3128155da0 msgr2=0x7f31280cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:31.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.230+0000 7f3127400640 1 --2- 172.21.15.37:0/1742599322 >> v2:172.21.15.37:3300/0 conn(0x7f3128155da0 0x7f31280cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:31.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.230+0000 7f3127400640 1 -- 172.21.15.37:0/1742599322 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312815f5f0 con 0x7f31280cd440 2024-05-30T06:49:31.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.234+0000 7f3127400640 1 --2- 172.21.15.37:0/1742599322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31280cd440 0x7f31280cd950 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f312806fec0 tx=0x7f311801c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3934b92e84328f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:31.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.234+0000 7f3126000640 1 -- 172.21.15.37:0/1742599322 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31180b0070 con 0x7f31280cd440 2024-05-30T06:49:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.234+0000 7f3126000640 1 -- 172.21.15.37:0/1742599322 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31180a4e50 con 0x7f31280cd440 2024-05-30T06:49:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.234+0000 7f3126000640 1 -- 172.21.15.37:0/1742599322 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31180ab820 con 0x7f31280cd440 2024-05-30T06:49:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.238+0000 7f312e000640 1 -- 172.21.15.37:0/1742599322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31280cd440 msgr2=0x7f31280cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:31.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.238+0000 7f312e000640 1 --2- 172.21.15.37:0/1742599322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31280cd440 0x7f31280cd950 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f312806fec0 tx=0x7f311801c400 comp rx=0 tx=0).stop 2024-05-30T06:49:31.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.238+0000 7f312e000640 1 -- 172.21.15.37:0/1742599322 shutdown_connections 2024-05-30T06:49:31.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.238+0000 7f312e000640 1 --2- 172.21.15.37:0/1742599322 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31280cfa20 0x7f31280cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:31.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.238+0000 7f312e000640 1 --2- 172.21.15.37:0/1742599322 >> v2:172.21.15.37:3300/0 conn(0x7f3128155da0 0x7f31280cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:31.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.238+0000 7f312e000640 1 --2- 172.21.15.37:0/1742599322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31280cd440 0x7f31280cd950 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:31.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.238+0000 7f312e000640 1 -- 172.21.15.37:0/1742599322 >> 172.21.15.37:0/1742599322 conn(0x7f312806bf60 msgr2=0x7f31280b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:31.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.238+0000 7f312e000640 1 -- 172.21.15.37:0/1742599322 shutdown_connections 2024-05-30T06:49:31.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.238+0000 7f312e000640 1 -- 172.21.15.37:0/1742599322 wait complete. 2024-05-30T06:49:31.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.238+0000 7f312e000640 1 Processor -- start 2024-05-30T06:49:31.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.238+0000 7f312e000640 1 -- start start 2024-05-30T06:49:31.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f312e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31280cfa20 0x7f312815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:31.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f312e000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3128155da0 0x7f3128158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:31.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f312e000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31280b1390 0x7f31280b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:31.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f312e000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f31280b4e20 con 0x7f31280cfa20 2024-05-30T06:49:31.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f312e000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31280b4ca0 con 0x7f31280b1390 2024-05-30T06:49:31.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f312e000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31280b3f60 con 0x7f3128155da0 2024-05-30T06:49:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f3127400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31280cfa20 0x7f312815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f3127400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31280cfa20 0x7f312815b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48538/0 (socket says 172.21.15.37:48538) 2024-05-30T06:49:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f3127400640 1 -- 172.21.15.37:0/1289785625 learned_addr learned my addr 172.21.15.37:0/1289785625 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f3127400640 1 -- 172.21.15.37:0/1289785625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3128155da0 msgr2=0x7f3128158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f3127400640 1 --2- 172.21.15.37:0/1289785625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3128155da0 0x7f3128158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f3127400640 1 -- 172.21.15.37:0/1289785625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31280b1390 msgr2=0x7f31280b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f3127400640 1 --2- 172.21.15.37:0/1289785625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31280b1390 0x7f31280b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f3127400640 1 -- 172.21.15.37:0/1289785625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312815a090 con 0x7f31280cfa20 2024-05-30T06:49:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f3127400640 1 --2- 172.21.15.37:0/1289785625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31280cfa20 0x7f312815b4f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f311801cca0 tx=0x7f31180191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f311f400640 1 -- 172.21.15.37:0/1289785625 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31180b9070 con 0x7f31280cfa20 2024-05-30T06:49:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f311f400640 1 -- 172.21.15.37:0/1289785625 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31180abde0 con 0x7f31280cfa20 2024-05-30T06:49:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f312e000640 1 -- 172.21.15.37:0/1289785625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3128159810 con 0x7f31280cfa20 2024-05-30T06:49:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f311f400640 1 -- 172.21.15.37:0/1289785625 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31180b0040 con 0x7f31280cfa20 2024-05-30T06:49:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f312e000640 1 -- 172.21.15.37:0/1289785625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3128159db0 con 0x7f31280cfa20 2024-05-30T06:49:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.242+0000 7f312e000640 1 -- 172.21.15.37:0/1289785625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3128068bc0 con 0x7f31280cfa20 2024-05-30T06:49:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.246+0000 7f311f400640 1 -- 172.21.15.37:0/1289785625 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 89160+0+0 (secure 0 0 0) 0x7f31180bc070 con 0x7f31280cfa20 2024-05-30T06:49:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.246+0000 7f311f400640 1 --2- 172.21.15.37:0/1289785625 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3108069070 0x7f310806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.246+0000 7f311f400640 1 -- 172.21.15.37:0/1289785625 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f311811e4e0 con 0x7f31280cfa20 2024-05-30T06:49:31.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.250+0000 7f311f400640 1 -- 172.21.15.37:0/1289785625 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f312815a090 con 0x7f31280cfa20 2024-05-30T06:49:31.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.254+0000 7f3126a00640 1 --2- 172.21.15.37:0/1289785625 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3108069070 0x7f310806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:31.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.258+0000 7f3126a00640 1 --2- 172.21.15.37:0/1289785625 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3108069070 0x7f310806b530 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f312814c3a0 tx=0x7f3114008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:31.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:31.634+0000 7f312e000640 1 -- 172.21.15.37:0/1289785625 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone18543", "target": ["mon-mgr", ""]}) -- 0x7f31280b6790 con 0x7f3108069070 2024-05-30T06:49:32.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.362+0000 7f311f400640 1 -- 172.21.15.37:0/1289785625 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f31280b6790 con 0x7f3108069070 2024-05-30T06:49:32.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.366+0000 7f312e000640 1 -- 172.21.15.37:0/1289785625 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3108069070 msgr2=0x7f310806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.366+0000 7f312e000640 1 --2- 172.21.15.37:0/1289785625 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3108069070 0x7f310806b530 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f312814c3a0 tx=0x7f3114008040 comp rx=0 tx=0).stop 2024-05-30T06:49:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.366+0000 7f312e000640 1 -- 172.21.15.37:0/1289785625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31280cfa20 msgr2=0x7f312815b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.366+0000 7f312e000640 1 --2- 172.21.15.37:0/1289785625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31280cfa20 0x7f312815b4f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f311801cca0 tx=0x7f31180191a0 comp rx=0 tx=0).stop 2024-05-30T06:49:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.366+0000 7f312e000640 1 -- 172.21.15.37:0/1289785625 shutdown_connections 2024-05-30T06:49:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.366+0000 7f312e000640 1 --2- 172.21.15.37:0/1289785625 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3108069070 0x7f310806b530 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.366+0000 7f312e000640 1 --2- 172.21.15.37:0/1289785625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31280b1390 0x7f31280b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.366+0000 7f312e000640 1 --2- 172.21.15.37:0/1289785625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3128155da0 0x7f3128158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.366+0000 7f312e000640 1 --2- 172.21.15.37:0/1289785625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31280cfa20 0x7f312815b4f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.366+0000 7f312e000640 1 -- 172.21.15.37:0/1289785625 >> 172.21.15.37:0/1289785625 conn(0x7f312806bf60 msgr2=0x7f3128074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.366+0000 7f312e000640 1 -- 172.21.15.37:0/1289785625 shutdown_connections 2024-05-30T06:49:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.366+0000 7f312e000640 1 -- 172.21.15.37:0/1289785625 wait complete. 2024-05-30T06:49:32.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone18544 2024-05-30T06:49:32.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8bbe00640 1 Processor -- start 2024-05-30T06:49:32.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8bbe00640 1 -- start start 2024-05-30T06:49:32.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8bbe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8bc15d390 0x7fb8bc071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:32.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8bbe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8bc15d770 0x7fb8bc072340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:32.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8bbe00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8bc142900 con 0x7fb8bc141be0 2024-05-30T06:49:32.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8bbe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb8bc06de40 con 0x7fb8bc15d770 2024-05-30T06:49:32.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8bbe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb8bc13fd50 con 0x7fb8bc15d390 2024-05-30T06:49:32.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8ba000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8bc15d770 0x7fb8bc072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:32.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8bb400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb8bc141be0 0x7fb8bc142070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52154/0 (socket says 172.21.15.37:52154) 2024-05-30T06:49:32.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8bb400640 1 -- 172.21.15.37:0/3608848528 learned_addr learned my addr 172.21.15.37:0/3608848528 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8ba000640 1 -- 172.21.15.37:0/3608848528 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8bc15d390 msgr2=0x7fb8bc071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8ba000640 1 --2- 172.21.15.37:0/3608848528 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8bc15d390 0x7fb8bc071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8ba000640 1 -- 172.21.15.37:0/3608848528 >> v1:172.21.15.37:6789/0 conn(0x7fb8bc141be0 legacy=0x7fb8bc142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8b9600640 1 -- 172.21.15.37:0/3608848528 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552094566 0 0) 0x7fb8bc142900 con 0x7fb8bc141be0 2024-05-30T06:49:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.674+0000 7fb8ba000640 1 -- 172.21.15.37:0/3608848528 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc140030 con 0x7fb8bc15d770 2024-05-30T06:49:32.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.682+0000 7fb8ba000640 1 --2- 172.21.15.37:0/3608848528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc15d770 0x7fb8bc072340 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0097c0 tx=0x7fb8ac01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6271738282e8d872 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.682+0000 7fb8b9600640 1 -- 172.21.15.37:0/3608848528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0b0070 con 0x7fb8bc15d770 2024-05-30T06:49:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.682+0000 7fb8b9600640 1 -- 172.21.15.37:0/3608848528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ac0ab600 con 0x7fb8bc15d770 2024-05-30T06:49:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.682+0000 7fb8b9600640 1 -- 172.21.15.37:0/3608848528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0ab9d0 con 0x7fb8bc15d770 2024-05-30T06:49:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.682+0000 7fb8bbe00640 1 -- 172.21.15.37:0/3608848528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc15d770 msgr2=0x7fb8bc072340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.682+0000 7fb8bbe00640 1 --2- 172.21.15.37:0/3608848528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc15d770 0x7fb8bc072340 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0097c0 tx=0x7fb8ac01c430 comp rx=0 tx=0).stop 2024-05-30T06:49:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.682+0000 7fb8bbe00640 1 -- 172.21.15.37:0/3608848528 shutdown_connections 2024-05-30T06:49:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.682+0000 7fb8bbe00640 1 --2- 172.21.15.37:0/3608848528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc15d770 0x7fb8bc072340 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.682+0000 7fb8bbe00640 1 --2- 172.21.15.37:0/3608848528 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8bc15d390 0x7fb8bc071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.682+0000 7fb8bbe00640 1 -- 172.21.15.37:0/3608848528 >> 172.21.15.37:0/3608848528 conn(0x7fb8bc067d60 msgr2=0x7fb8bc06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.682+0000 7fb8bbe00640 1 -- 172.21.15.37:0/3608848528 shutdown_connections 2024-05-30T06:49:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.682+0000 7fb8bbe00640 1 -- 172.21.15.37:0/3608848528 wait complete. 2024-05-30T06:49:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.686+0000 7fb8bbe00640 1 Processor -- start 2024-05-30T06:49:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.686+0000 7fb8bbe00640 1 -- start start 2024-05-30T06:49:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.686+0000 7fb8bbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc141be0 0x7fb8bc159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.686+0000 7fb8bbe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8bc15d390 0x7fb8bc13c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.686+0000 7fb8bbe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8bc15d770 0x7fb8bc157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.686+0000 7fb8bbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc06fb80 con 0x7fb8bc141be0 2024-05-30T06:49:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.686+0000 7fb8bbe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc06fa00 con 0x7fb8bc15d770 2024-05-30T06:49:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.686+0000 7fb8bbe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb8bc06fd00 con 0x7fb8bc15d390 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.686+0000 7fb8baa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc141be0 0x7fb8bc159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.686+0000 7fb8baa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc141be0 0x7fb8bc159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48552/0 (socket says 172.21.15.37:48552) 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.686+0000 7fb8baa00640 1 -- 172.21.15.37:0/1519707206 learned_addr learned my addr 172.21.15.37:0/1519707206 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8ba000640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8bc15d390 0x7fb8bc13c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8baa00640 1 -- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8bc15d390 msgr2=0x7fb8bc13c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8baa00640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8bc15d390 0x7fb8bc13c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8baa00640 1 -- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8bc15d770 msgr2=0x7fb8bc157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8baa00640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8bc15d770 0x7fb8bc157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8baa00640 1 -- 172.21.15.37:0/1519707206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc142500 con 0x7fb8bc141be0 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8ba000640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8bc15d390 0x7fb8bc13c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8baa00640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc141be0 0x7fb8bc159f60 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800b440 tx=0x7fb8a800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8b2a00640 1 -- 172.21.15.37:0/1519707206 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8015020 con 0x7fb8bc141be0 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8b2a00640 1 -- 172.21.15.37:0/1519707206 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a80118b0 con 0x7fb8bc141be0 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8bbe00640 1 -- 172.21.15.37:0/1519707206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8bc0cfac0 con 0x7fb8bc141be0 2024-05-30T06:49:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8b2a00640 1 -- 172.21.15.37:0/1519707206 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8011ca0 con 0x7fb8bc141be0 2024-05-30T06:49:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8bbe00640 1 -- 172.21.15.37:0/1519707206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8bc139680 con 0x7fb8bc141be0 2024-05-30T06:49:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.690+0000 7fb8bbe00640 1 -- 172.21.15.37:0/1519707206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8bc068700 con 0x7fb8bc141be0 2024-05-30T06:49:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.694+0000 7fb8b2a00640 1 -- 172.21.15.37:0/1519707206 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 89160+0+0 (secure 0 0 0) 0x7fb8a8018020 con 0x7fb8bc141be0 2024-05-30T06:49:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.694+0000 7fb8b2a00640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb89c069070 0x7fb89c06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.698+0000 7fb8b2a00640 1 -- 172.21.15.37:0/1519707206 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fb8a8085520 con 0x7fb8bc141be0 2024-05-30T06:49:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.702+0000 7fb8b2a00640 1 -- 172.21.15.37:0/1519707206 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb8a801f020 con 0x7fb8bc141be0 2024-05-30T06:49:32.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.702+0000 7fb8ba000640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb89c069070 0x7fb89c06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:32.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:32.726+0000 7fb8ba000640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb89c069070 0x7fb89c06b530 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0ad000 tx=0x7fb8ac0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.078+0000 7fb8bbe00640 1 -- 172.21.15.37:0/1519707206 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone18544", "target": ["mon-mgr", ""]}) -- 0x7fb8bc1531b0 con 0x7fb89c069070 2024-05-30T06:49:33.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.662+0000 7fb8b2a00640 1 -- 172.21.15.37:0/1519707206 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb8ac0ab7a0 con 0x7fb89c069070 2024-05-30T06:49:33.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.666+0000 7fb8bbe00640 1 -- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb89c069070 msgr2=0x7fb89c06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:33.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.666+0000 7fb8bbe00640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb89c069070 0x7fb89c06b530 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac0ad000 tx=0x7fb8ac0a6000 comp rx=0 tx=0).stop 2024-05-30T06:49:33.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.666+0000 7fb8bbe00640 1 -- 172.21.15.37:0/1519707206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc141be0 msgr2=0x7fb8bc159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:33.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.666+0000 7fb8bbe00640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc141be0 0x7fb8bc159f60 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800b440 tx=0x7fb8a800b900 comp rx=0 tx=0).stop 2024-05-30T06:49:33.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.666+0000 7fb8bbe00640 1 -- 172.21.15.37:0/1519707206 shutdown_connections 2024-05-30T06:49:33.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.666+0000 7fb8bbe00640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb89c069070 0x7fb89c06b530 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:33.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.666+0000 7fb8bbe00640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8bc15d770 0x7fb8bc157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:33.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.666+0000 7fb8bbe00640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8bc15d390 0x7fb8bc13c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:33.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.666+0000 7fb8bbe00640 1 --2- 172.21.15.37:0/1519707206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc141be0 0x7fb8bc159f60 secure :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800b440 tx=0x7fb8a800b900 comp rx=0 tx=0).stop 2024-05-30T06:49:33.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.666+0000 7fb8bbe00640 1 -- 172.21.15.37:0/1519707206 >> 172.21.15.37:0/1519707206 conn(0x7fb8bc067d60 msgr2=0x7fb8bc06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:33.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.666+0000 7fb8bbe00640 1 -- 172.21.15.37:0/1519707206 shutdown_connections 2024-05-30T06:49:33.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.666+0000 7fb8bbe00640 1 -- 172.21.15.37:0/1519707206 wait complete. 2024-05-30T06:49:33.716 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone18545 2024-05-30T06:49:33.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.990+0000 7f1b7a800640 1 Processor -- start 2024-05-30T06:49:33.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.994+0000 7f1b7a800640 1 -- start start 2024-05-30T06:49:33.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.994+0000 7f1b7a800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b740cfff0 0x7f1b7406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:33.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.994+0000 7f1b7a800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b7406e490 0x7f1b7415e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:33.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.994+0000 7f1b7a800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b740ce9b0 con 0x7f1b7406f2e0 2024-05-30T06:49:33.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.994+0000 7f1b7a800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7406e900 con 0x7f1b7406e490 2024-05-30T06:49:33.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.994+0000 7f1b7a800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1b740cfb30 con 0x7f1b740cfff0 2024-05-30T06:49:33.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.994+0000 7f1b73e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b7406e490 0x7f1b7415e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:33.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.994+0000 7f1b73e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b7406e490 0x7f1b7415e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48554/0 (socket says 172.21.15.37:48554) 2024-05-30T06:49:33.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.994+0000 7f1b73e00640 1 -- 172.21.15.37:0/4219543580 learned_addr learned my addr 172.21.15.37:0/4219543580 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:33.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.994+0000 7f1b72a00640 1 --2- 172.21.15.37:0/4219543580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b740cfff0 0x7f1b7406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:33.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.998+0000 7f1b72000640 1 -- 172.21.15.37:0/4219543580 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1391675709 0 0) 0x7f1b740ce9b0 con 0x7f1b7406f2e0 2024-05-30T06:49:33.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.998+0000 7f1b72000640 1 -- 172.21.15.37:0/4219543580 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b58003530 con 0x7f1b7406f2e0 2024-05-30T06:49:33.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.998+0000 7f1b73e00640 1 -- 172.21.15.37:0/4219543580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b740cfff0 msgr2=0x7f1b7406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:33.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.998+0000 7f1b73e00640 1 --2- 172.21.15.37:0/4219543580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b740cfff0 0x7f1b7406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.998+0000 7f1b73e00640 1 -- 172.21.15.37:0/4219543580 >> v1:172.21.15.105:6789/0 conn(0x7f1b7406f2e0 legacy=0x7f1b740cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:34.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:33.998+0000 7f1b73e00640 1 -- 172.21.15.37:0/4219543580 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b740b5370 con 0x7f1b7406e490 2024-05-30T06:49:34.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.006+0000 7f1b73e00640 1 --2- 172.21.15.37:0/4219543580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7406e490 0x7f1b7415e390 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009870 tx=0x7f1b6401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8269d7a3dbf35113 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:34.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.006+0000 7f1b72000640 1 -- 172.21.15.37:0/4219543580 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b640b1070 con 0x7f1b7406e490 2024-05-30T06:49:34.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.010+0000 7f1b72000640 1 -- 172.21.15.37:0/4219543580 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b640ac620 con 0x7f1b7406e490 2024-05-30T06:49:34.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.010+0000 7f1b72000640 1 -- 172.21.15.37:0/4219543580 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b640ac9d0 con 0x7f1b7406e490 2024-05-30T06:49:34.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.010+0000 7f1b7a800640 1 -- 172.21.15.37:0/4219543580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7406e490 msgr2=0x7f1b7415e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:34.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.010+0000 7f1b7a800640 1 --2- 172.21.15.37:0/4219543580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7406e490 0x7f1b7415e390 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009870 tx=0x7f1b6401c4f0 comp rx=0 tx=0).stop 2024-05-30T06:49:34.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.010+0000 7f1b7a800640 1 -- 172.21.15.37:0/4219543580 shutdown_connections 2024-05-30T06:49:34.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.010+0000 7f1b7a800640 1 --2- 172.21.15.37:0/4219543580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b7406e490 0x7f1b7415e390 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:34.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.010+0000 7f1b7a800640 1 --2- 172.21.15.37:0/4219543580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b740cfff0 0x7f1b7406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:34.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.010+0000 7f1b7a800640 1 -- 172.21.15.37:0/4219543580 >> 172.21.15.37:0/4219543580 conn(0x7f1b740b23c0 msgr2=0x7f1b740b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:34.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.010+0000 7f1b7a800640 1 -- 172.21.15.37:0/4219543580 shutdown_connections 2024-05-30T06:49:34.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.010+0000 7f1b7a800640 1 -- 172.21.15.37:0/4219543580 wait complete. 2024-05-30T06:49:34.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.010+0000 7f1b7a800640 1 Processor -- start 2024-05-30T06:49:34.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.010+0000 7f1b7a800640 1 -- start start 2024-05-30T06:49:34.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b7a800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b7406e490 0x7f1b74140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:34.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b7a800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b7406f2e0 0x7f1b741577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:34.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b7a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740cfff0 0x7f1b74157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:34.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b7a800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7406f840 con 0x7f1b740cfff0 2024-05-30T06:49:34.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b7a800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7406f6c0 con 0x7f1b7406e490 2024-05-30T06:49:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b7a800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7415e8d0 con 0x7f1b7406f2e0 2024-05-30T06:49:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b73e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740cfff0 0x7f1b74157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b73e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740cfff0 0x7f1b74157d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48560/0 (socket says 172.21.15.37:48560) 2024-05-30T06:49:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b73e00640 1 -- 172.21.15.37:0/4182877518 learned_addr learned my addr 172.21.15.37:0/4182877518 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b73e00640 1 -- 172.21.15.37:0/4182877518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b7406f2e0 msgr2=0x7f1b741577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b73e00640 1 --2- 172.21.15.37:0/4182877518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b7406f2e0 0x7f1b741577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b73e00640 1 -- 172.21.15.37:0/4182877518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b7406e490 msgr2=0x7f1b74140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b73e00640 1 --2- 172.21.15.37:0/4182877518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b7406e490 0x7f1b74140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:34.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b73e00640 1 -- 172.21.15.37:0/4182877518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b741535f0 con 0x7f1b740cfff0 2024-05-30T06:49:34.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.014+0000 7f1b73e00640 1 --2- 172.21.15.37:0/4182877518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740cfff0 0x7f1b74157d00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1b6401c530 tx=0x7f1b64019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:34.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.018+0000 7f1b6b400640 1 -- 172.21.15.37:0/4182877518 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b640b1040 con 0x7f1b740cfff0 2024-05-30T06:49:34.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.018+0000 7f1b6b400640 1 -- 172.21.15.37:0/4182877518 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b640ac9d0 con 0x7f1b740cfff0 2024-05-30T06:49:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.018+0000 7f1b6b400640 1 -- 172.21.15.37:0/4182877518 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b640acd80 con 0x7f1b740cfff0 2024-05-30T06:49:34.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.018+0000 7f1b7a800640 1 -- 172.21.15.37:0/4182877518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b74153870 con 0x7f1b740cfff0 2024-05-30T06:49:34.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.022+0000 7f1b7a800640 1 -- 172.21.15.37:0/4182877518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b74153e30 con 0x7f1b740cfff0 2024-05-30T06:49:34.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.022+0000 7f1b7a800640 1 -- 172.21.15.37:0/4182877518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b74068bc0 con 0x7f1b740cfff0 2024-05-30T06:49:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.026+0000 7f1b6b400640 1 -- 172.21.15.37:0/4182877518 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 89160+0+0 (secure 0 0 0) 0x7f1b640ac4e0 con 0x7f1b740cfff0 2024-05-30T06:49:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.026+0000 7f1b6b400640 1 --2- 172.21.15.37:0/4182877518 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1b50069070 0x7f1b5006b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.026+0000 7f1b6b400640 1 -- 172.21.15.37:0/4182877518 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f1b6411f0e0 con 0x7f1b740cfff0 2024-05-30T06:49:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.038+0000 7f1b6b400640 1 -- 172.21.15.37:0/4182877518 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1b741535f0 con 0x7f1b740cfff0 2024-05-30T06:49:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.038+0000 7f1b73400640 1 --2- 172.21.15.37:0/4182877518 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1b50069070 0x7f1b5006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.042+0000 7f1b73400640 1 --2- 172.21.15.37:0/4182877518 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1b50069070 0x7f1b5006b530 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c007fd0 tx=0x7f1b5c007960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:34.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:34.478+0000 7f1b7a800640 1 -- 172.21.15.37:0/4182877518 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone18545", "target": ["mon-mgr", ""]}) -- 0x7f1b7415f160 con 0x7f1b50069070 2024-05-30T06:49:34.639 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:49:34.644 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:49:35.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.338+0000 7f1b6b400640 1 -- 172.21.15.37:0/4182877518 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1b7415f160 con 0x7f1b50069070 2024-05-30T06:49:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.342+0000 7f1b7a800640 1 -- 172.21.15.37:0/4182877518 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1b50069070 msgr2=0x7f1b5006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.342+0000 7f1b7a800640 1 --2- 172.21.15.37:0/4182877518 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1b50069070 0x7f1b5006b530 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c007fd0 tx=0x7f1b5c007960 comp rx=0 tx=0).stop 2024-05-30T06:49:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.342+0000 7f1b7a800640 1 -- 172.21.15.37:0/4182877518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740cfff0 msgr2=0x7f1b74157d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.342+0000 7f1b7a800640 1 --2- 172.21.15.37:0/4182877518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740cfff0 0x7f1b74157d00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1b6401c530 tx=0x7f1b64019290 comp rx=0 tx=0).stop 2024-05-30T06:49:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.342+0000 7f1b7a800640 1 -- 172.21.15.37:0/4182877518 shutdown_connections 2024-05-30T06:49:35.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.342+0000 7f1b7a800640 1 --2- 172.21.15.37:0/4182877518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b740cfff0 0x7f1b74157d00 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:35.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.342+0000 7f1b7a800640 1 --2- 172.21.15.37:0/4182877518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1b7406f2e0 0x7f1b741577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:35.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.342+0000 7f1b7a800640 1 --2- 172.21.15.37:0/4182877518 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1b50069070 0x7f1b5006b530 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:35.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.342+0000 7f1b7a800640 1 --2- 172.21.15.37:0/4182877518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1b7406e490 0x7f1b74140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:35.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.342+0000 7f1b7a800640 1 -- 172.21.15.37:0/4182877518 >> 172.21.15.37:0/4182877518 conn(0x7f1b740b23c0 msgr2=0x7f1b740b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:35.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.342+0000 7f1b7a800640 1 -- 172.21.15.37:0/4182877518 shutdown_connections 2024-05-30T06:49:35.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.342+0000 7f1b7a800640 1 -- 172.21.15.37:0/4182877518 wait complete. 2024-05-30T06:49:35.381 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone18546 2024-05-30T06:49:35.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.622+0000 7f24f4a00640 1 Processor -- start 2024-05-30T06:49:35.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.622+0000 7f24f4a00640 1 -- start start 2024-05-30T06:49:35.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.622+0000 7f24f4a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24f0163250 0x7f24f01636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.622+0000 7f24f4a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f24f00ce7d0 0x7f24f00cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.622+0000 7f24f4a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f00ccfc0 con 0x7f24f0162e70 2024-05-30T06:49:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.622+0000 7f24f4a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f24f006f8e0 con 0x7f24f00ce7d0 2024-05-30T06:49:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.622+0000 7f24f4a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f24f0164190 con 0x7f24f0163250 2024-05-30T06:49:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.622+0000 7f24ede00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f24f0162e70 0x7f24f00cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52160/0 (socket says 172.21.15.37:52160) 2024-05-30T06:49:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.622+0000 7f24ede00640 1 -- 172.21.15.37:0/2907888918 learned_addr learned my addr 172.21.15.37:0/2907888918 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.626+0000 7f24ee800640 1 --2- 172.21.15.37:0/2907888918 >> v2:172.21.15.37:3300/0 conn(0x7f24f00ce7d0 0x7f24f00cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.626+0000 7f24ed400640 1 --2- 172.21.15.37:0/2907888918 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24f0163250 0x7f24f01636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.626+0000 7f24ee800640 1 -- 172.21.15.37:0/2907888918 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24f0163250 msgr2=0x7f24f01636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.626+0000 7f24ee800640 1 --2- 172.21.15.37:0/2907888918 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24f0163250 0x7f24f01636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.626+0000 7f24ee800640 1 -- 172.21.15.37:0/2907888918 >> v1:172.21.15.37:6789/0 conn(0x7f24f0162e70 legacy=0x7f24f00cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:35.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.626+0000 7f24ee800640 1 -- 172.21.15.37:0/2907888918 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f006ecd0 con 0x7f24f00ce7d0 2024-05-30T06:49:35.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.634+0000 7f24ee800640 1 --2- 172.21.15.37:0/2907888918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f00ce7d0 0x7f24f00cec40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009d90 tx=0x7f24e801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de469d5062ffd7a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:35.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.634+0000 7f24eca00640 1 -- 172.21.15.37:0/2907888918 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e80b2070 con 0x7f24f00ce7d0 2024-05-30T06:49:35.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.634+0000 7f24eca00640 1 -- 172.21.15.37:0/2907888918 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e80a5970 con 0x7f24f00ce7d0 2024-05-30T06:49:35.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.634+0000 7f24eca00640 1 -- 172.21.15.37:0/2907888918 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e80a5d40 con 0x7f24f00ce7d0 2024-05-30T06:49:35.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.638+0000 7f24f4a00640 1 -- 172.21.15.37:0/2907888918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f00ce7d0 msgr2=0x7f24f00cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:35.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.638+0000 7f24f4a00640 1 --2- 172.21.15.37:0/2907888918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f00ce7d0 0x7f24f00cec40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009d90 tx=0x7f24e801c8b0 comp rx=0 tx=0).stop 2024-05-30T06:49:35.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.638+0000 7f24f4a00640 1 -- 172.21.15.37:0/2907888918 shutdown_connections 2024-05-30T06:49:35.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.638+0000 7f24f4a00640 1 --2- 172.21.15.37:0/2907888918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f00ce7d0 0x7f24f00cec40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:35.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.638+0000 7f24f4a00640 1 --2- 172.21.15.37:0/2907888918 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24f0163250 0x7f24f01636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:35.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.638+0000 7f24f4a00640 1 -- 172.21.15.37:0/2907888918 >> 172.21.15.37:0/2907888918 conn(0x7f24f006bf60 msgr2=0x7f24f00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:35.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.638+0000 7f24f4a00640 1 -- 172.21.15.37:0/2907888918 shutdown_connections 2024-05-30T06:49:35.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.638+0000 7f24f4a00640 1 -- 172.21.15.37:0/2907888918 wait complete. 2024-05-30T06:49:35.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24f4a00640 1 Processor -- start 2024-05-30T06:49:35.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24f4a00640 1 -- start start 2024-05-30T06:49:35.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24f4a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24f00ce7d0 0x7f24f01441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:35.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24f4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f0162e70 0x7f24f0144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:35.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24f4a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24f0163250 0x7f24f0145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:35.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24f4a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f24f006e960 con 0x7f24f0162e70 2024-05-30T06:49:35.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24f4a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f24f0163c10 con 0x7f24f00ce7d0 2024-05-30T06:49:35.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24f4a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f24f016dc30 con 0x7f24f0163250 2024-05-30T06:49:35.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24ed400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f0162e70 0x7f24f0144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:35.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24ed400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f0162e70 0x7f24f0144f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48580/0 (socket says 172.21.15.37:48580) 2024-05-30T06:49:35.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24ed400640 1 -- 172.21.15.37:0/1081299469 learned_addr learned my addr 172.21.15.37:0/1081299469 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24ede00640 1 --2- 172.21.15.37:0/1081299469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24f00ce7d0 0x7f24f01441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24ed400640 1 -- 172.21.15.37:0/1081299469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24f0163250 msgr2=0x7f24f0145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24ed400640 1 --2- 172.21.15.37:0/1081299469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24f0163250 0x7f24f0145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24ed400640 1 -- 172.21.15.37:0/1081299469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24f00ce7d0 msgr2=0x7f24f01441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24ed400640 1 --2- 172.21.15.37:0/1081299469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24f00ce7d0 0x7f24f01441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:35.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.642+0000 7f24ed400640 1 -- 172.21.15.37:0/1081299469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f0140950 con 0x7f24f0162e70 2024-05-30T06:49:35.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.646+0000 7f24ed400640 1 --2- 172.21.15.37:0/1081299469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f0162e70 0x7f24f0144f30 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f24e000d620 tx=0x7f24e000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:35.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.646+0000 7f24e6000640 1 -- 172.21.15.37:0/1081299469 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e000b620 con 0x7f24f0162e70 2024-05-30T06:49:35.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.646+0000 7f24e6000640 1 -- 172.21.15.37:0/1081299469 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e0019070 con 0x7f24f0162e70 2024-05-30T06:49:35.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.646+0000 7f24e6000640 1 -- 172.21.15.37:0/1081299469 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e000ba20 con 0x7f24f0162e70 2024-05-30T06:49:35.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.646+0000 7f24f4a00640 1 -- 172.21.15.37:0/1081299469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f0142600 con 0x7f24f0162e70 2024-05-30T06:49:35.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.646+0000 7f24f4a00640 1 -- 172.21.15.37:0/1081299469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f0142bc0 con 0x7f24f0162e70 2024-05-30T06:49:35.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.646+0000 7f24f4a00640 1 -- 172.21.15.37:0/1081299469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f0068bc0 con 0x7f24f0162e70 2024-05-30T06:49:35.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.646+0000 7f24e6000640 1 -- 172.21.15.37:0/1081299469 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 89160+0+0 (secure 0 0 0) 0x7f24e000bbc0 con 0x7f24f0162e70 2024-05-30T06:49:35.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.650+0000 7f24e6000640 1 --2- 172.21.15.37:0/1081299469 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f24d0069070 0x7f24d006b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:35.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.650+0000 7f24e6000640 1 -- 172.21.15.37:0/1081299469 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f24e0085b00 con 0x7f24f0162e70 2024-05-30T06:49:35.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.650+0000 7f24ede00640 1 --2- 172.21.15.37:0/1081299469 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f24d0069070 0x7f24d006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:35.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.650+0000 7f24ede00640 1 --2- 172.21.15.37:0/1081299469 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f24d0069070 0x7f24d006b530 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f24f0072ee0 tx=0x7f24dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:35.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.654+0000 7f24e6000640 1 -- 172.21.15.37:0/1081299469 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f24e0057880 con 0x7f24f0162e70 2024-05-30T06:49:35.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:35.962+0000 7f24f4a00640 1 -- 172.21.15.37:0/1081299469 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone18546", "target": ["mon-mgr", ""]}) -- 0x7f24f00b30b0 con 0x7f24d0069070 2024-05-30T06:49:36.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.518+0000 7f24e6000640 1 -- 172.21.15.37:0/1081299469 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f24f00b30b0 con 0x7f24d0069070 2024-05-30T06:49:36.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.522+0000 7f24f4a00640 1 -- 172.21.15.37:0/1081299469 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f24d0069070 msgr2=0x7f24d006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:36.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.522+0000 7f24f4a00640 1 --2- 172.21.15.37:0/1081299469 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f24d0069070 0x7f24d006b530 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f24f0072ee0 tx=0x7f24dc009040 comp rx=0 tx=0).stop 2024-05-30T06:49:36.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.522+0000 7f24f4a00640 1 -- 172.21.15.37:0/1081299469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f0162e70 msgr2=0x7f24f0144f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:36.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.522+0000 7f24f4a00640 1 --2- 172.21.15.37:0/1081299469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f0162e70 0x7f24f0144f30 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f24e000d620 tx=0x7f24e000dae0 comp rx=0 tx=0).stop 2024-05-30T06:49:36.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.522+0000 7f24f4a00640 1 -- 172.21.15.37:0/1081299469 shutdown_connections 2024-05-30T06:49:36.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.522+0000 7f24f4a00640 1 --2- 172.21.15.37:0/1081299469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24f0163250 0x7f24f0145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:36.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.522+0000 7f24f4a00640 1 --2- 172.21.15.37:0/1081299469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f0162e70 0x7f24f0144f30 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:36.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.522+0000 7f24f4a00640 1 --2- 172.21.15.37:0/1081299469 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f24d0069070 0x7f24d006b530 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:36.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.522+0000 7f24f4a00640 1 --2- 172.21.15.37:0/1081299469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24f00ce7d0 0x7f24f01441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:36.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.522+0000 7f24f4a00640 1 -- 172.21.15.37:0/1081299469 >> 172.21.15.37:0/1081299469 conn(0x7f24f006bf60 msgr2=0x7f24f0165ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:36.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.522+0000 7f24f4a00640 1 -- 172.21.15.37:0/1081299469 shutdown_connections 2024-05-30T06:49:36.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.522+0000 7f24f4a00640 1 -- 172.21.15.37:0/1081299469 wait complete. 2024-05-30T06:49:36.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone18547 2024-05-30T06:49:36.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.762+0000 7f7736200640 1 Processor -- start 2024-05-30T06:49:36.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.762+0000 7f7736200640 1 -- start start 2024-05-30T06:49:36.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.762+0000 7f7736200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77300cedc0 0x7f773006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:36.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.762+0000 7f7736200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f773006bbb0 con 0x7f77300ae690 2024-05-30T06:49:36.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.762+0000 7f7736200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f773006be90 con 0x7f773006ef50 2024-05-30T06:49:36.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.762+0000 7f7736200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f773006b960 con 0x7f77300cedc0 2024-05-30T06:49:36.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.762+0000 7f772f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77300cedc0 0x7f773006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:36.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.762+0000 7f772ea00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f77300ae690 0x7f773006e840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52174/0 (socket says 172.21.15.37:52174) 2024-05-30T06:49:36.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.762+0000 7f772ea00640 1 -- 172.21.15.37:0/4274468566 learned_addr learned my addr 172.21.15.37:0/4274468566 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:36.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.766+0000 7f772f400640 1 -- 172.21.15.37:0/4274468566 >> v1:172.21.15.105:6789/0 conn(0x7f773006ef50 legacy=0x7f77300cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:36.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.766+0000 7f772f400640 1 -- 172.21.15.37:0/4274468566 >> v1:172.21.15.37:6789/0 conn(0x7f77300ae690 legacy=0x7f773006e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:36.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.766+0000 7f772f400640 1 -- 172.21.15.37:0/4274468566 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773006c170 con 0x7f77300cedc0 2024-05-30T06:49:36.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.770+0000 7f772f400640 1 --2- 172.21.15.37:0/4274468566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77300cedc0 0x7f773006cc50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f77200097c0 tx=0x7f772001c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22b067ac4c438a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:36.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.774+0000 7f772e000640 1 -- 172.21.15.37:0/4274468566 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77200b0070 con 0x7f77300cedc0 2024-05-30T06:49:36.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.774+0000 7f772e000640 1 -- 172.21.15.37:0/4274468566 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77200ab600 con 0x7f77300cedc0 2024-05-30T06:49:36.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.774+0000 7f772e000640 1 -- 172.21.15.37:0/4274468566 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77200ab9d0 con 0x7f77300cedc0 2024-05-30T06:49:36.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.774+0000 7f7736200640 1 -- 172.21.15.37:0/4274468566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77300cedc0 msgr2=0x7f773006cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:36.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.774+0000 7f7736200640 1 --2- 172.21.15.37:0/4274468566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77300cedc0 0x7f773006cc50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f77200097c0 tx=0x7f772001c2f0 comp rx=0 tx=0).stop 2024-05-30T06:49:36.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.774+0000 7f7736200640 1 -- 172.21.15.37:0/4274468566 shutdown_connections 2024-05-30T06:49:36.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.774+0000 7f7736200640 1 --2- 172.21.15.37:0/4274468566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77300cedc0 0x7f773006cc50 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:36.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.774+0000 7f7736200640 1 -- 172.21.15.37:0/4274468566 >> 172.21.15.37:0/4274468566 conn(0x7f77300cd730 msgr2=0x7f77300cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:36.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.774+0000 7f7736200640 1 -- 172.21.15.37:0/4274468566 shutdown_connections 2024-05-30T06:49:36.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.774+0000 7f7736200640 1 -- 172.21.15.37:0/4274468566 wait complete. 2024-05-30T06:49:36.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.778+0000 7f7736200640 1 Processor -- start 2024-05-30T06:49:36.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f7736200640 1 -- start start 2024-05-30T06:49:36.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f7736200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f773006ef50 0x7f7730149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:36.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f7736200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77300ae690 0x7f77301e7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:36.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f7736200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77300cedc0 0x7f77301488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:36.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f7736200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f773015ebb0 con 0x7f77300cedc0 2024-05-30T06:49:36.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f7736200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f773006c7c0 con 0x7f773006ef50 2024-05-30T06:49:36.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f7736200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f773006d190 con 0x7f77300ae690 2024-05-30T06:49:36.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f772fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77300cedc0 0x7f77301488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:36.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f772fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77300cedc0 0x7f77301488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48602/0 (socket says 172.21.15.37:48602) 2024-05-30T06:49:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f772fe00640 1 -- 172.21.15.37:0/3631162530 learned_addr learned my addr 172.21.15.37:0/3631162530 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f772ea00640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77300ae690 0x7f77301e7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f772f400640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f773006ef50 0x7f7730149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f772fe00640 1 -- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77300ae690 msgr2=0x7f77301e7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f772fe00640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77300ae690 0x7f77301e7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f772fe00640 1 -- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f773006ef50 msgr2=0x7f7730149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f772fe00640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f773006ef50 0x7f7730149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f772fe00640 1 -- 172.21.15.37:0/3631162530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77301e71e0 con 0x7f77300cedc0 2024-05-30T06:49:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f772fe00640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77300cedc0 0x7f77301488c0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f772800c780 tx=0x7f772800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f7727400640 1 -- 172.21.15.37:0/3631162530 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7728017070 con 0x7f77300cedc0 2024-05-30T06:49:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f7736200640 1 -- 172.21.15.37:0/3631162530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77301e74c0 con 0x7f77300cedc0 2024-05-30T06:49:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.782+0000 7f7727400640 1 -- 172.21.15.37:0/3631162530 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7728003db0 con 0x7f77300cedc0 2024-05-30T06:49:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.786+0000 7f7727400640 1 -- 172.21.15.37:0/3631162530 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77280052b0 con 0x7f77300cedc0 2024-05-30T06:49:36.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.786+0000 7f7736200640 1 -- 172.21.15.37:0/3631162530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7730149580 con 0x7f77300cedc0 2024-05-30T06:49:36.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.786+0000 7f7736200640 1 -- 172.21.15.37:0/3631162530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77080052a0 con 0x7f77300cedc0 2024-05-30T06:49:36.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.786+0000 7f7727400640 1 -- 172.21.15.37:0/3631162530 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 89160+0+0 (secure 0 0 0) 0x7f772801a070 con 0x7f77300cedc0 2024-05-30T06:49:36.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.790+0000 7f7727400640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7710069070 0x7f771006b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:36.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.790+0000 7f7727400640 1 -- 172.21.15.37:0/3631162530 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f7728087640 con 0x7f77300cedc0 2024-05-30T06:49:36.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.790+0000 7f772f400640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7710069070 0x7f771006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:36.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.790+0000 7f772f400640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7710069070 0x7f771006b530 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f77200ad000 tx=0x7f7720008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:36.802+0000 7f7727400640 1 -- 172.21.15.37:0/3631162530 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f77280567b0 con 0x7f77300cedc0 2024-05-30T06:49:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.050+0000 7f7736200640 1 -- 172.21.15.37:0/3631162530 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone18547", "target": ["mon-mgr", ""]}) -- 0x7f7708000bd0 con 0x7f7710069070 2024-05-30T06:49:37.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.190+0000 7f7727400640 1 -- 172.21.15.37:0/3631162530 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7708000bd0 con 0x7f7710069070 2024-05-30T06:49:37.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.194+0000 7f7736200640 1 -- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7710069070 msgr2=0x7f771006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.194+0000 7f7736200640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7710069070 0x7f771006b530 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f77200ad000 tx=0x7f7720008040 comp rx=0 tx=0).stop 2024-05-30T06:49:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.194+0000 7f7736200640 1 -- 172.21.15.37:0/3631162530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77300cedc0 msgr2=0x7f77301488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.194+0000 7f7736200640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77300cedc0 0x7f77301488c0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f772800c780 tx=0x7f772800cc40 comp rx=0 tx=0).stop 2024-05-30T06:49:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.194+0000 7f7736200640 1 -- 172.21.15.37:0/3631162530 shutdown_connections 2024-05-30T06:49:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.194+0000 7f7736200640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77300cedc0 0x7f77301488c0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.194+0000 7f7736200640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77300ae690 0x7f77301e7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.194+0000 7f7736200640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7710069070 0x7f771006b530 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.194+0000 7f7736200640 1 --2- 172.21.15.37:0/3631162530 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f773006ef50 0x7f7730149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.194+0000 7f7736200640 1 -- 172.21.15.37:0/3631162530 >> 172.21.15.37:0/3631162530 conn(0x7f77300cd730 msgr2=0x7f77300cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.194+0000 7f7736200640 1 -- 172.21.15.37:0/3631162530 shutdown_connections 2024-05-30T06:49:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.194+0000 7f7736200640 1 -- 172.21.15.37:0/3631162530 wait complete. 2024-05-30T06:49:37.214 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:49:37.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2fa00640 1 Processor -- start 2024-05-30T06:49:37.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2fa00640 1 -- start start 2024-05-30T06:49:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2fa00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d280cd440 0x7f0d2806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2fa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d2806f5a0 0x7f0d280b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2fa00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d2815f310 con 0x7f0d28155da0 2024-05-30T06:49:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2fa00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0d2806fa10 con 0x7f0d2806f5a0 2024-05-30T06:49:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2fa00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0d2815f5f0 con 0x7f0d280cd440 2024-05-30T06:49:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2d000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0d28155da0 0x7f0d280cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52190/0 (socket says 172.21.15.37:52190) 2024-05-30T06:49:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2d000640 1 -- 172.21.15.37:0/2771960862 learned_addr learned my addr 172.21.15.37:0/2771960862 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2da00640 1 --2- 172.21.15.37:0/2771960862 >> v2:172.21.15.37:3300/0 conn(0x7f0d2806f5a0 0x7f0d280b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:37.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d1fe00640 1 --2- 172.21.15.37:0/2771960862 >> v2:172.21.15.105:3300/0 conn(0x7f0d280cd440 0x7f0d2806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:37.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2da00640 1 -- 172.21.15.37:0/2771960862 >> v2:172.21.15.105:3300/0 conn(0x7f0d280cd440 msgr2=0x7f0d2806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:37.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2da00640 1 --2- 172.21.15.37:0/2771960862 >> v2:172.21.15.105:3300/0 conn(0x7f0d280cd440 0x7f0d2806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2da00640 1 -- 172.21.15.37:0/2771960862 >> v1:172.21.15.37:6789/0 conn(0x7f0d28155da0 legacy=0x7f0d280cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d27e00640 1 -- 172.21.15.37:0/2771960862 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237312065 0 0) 0x7f0d2815f310 con 0x7f0d28155da0 2024-05-30T06:49:37.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d2da00640 1 -- 172.21.15.37:0/2771960862 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2815f8d0 con 0x7f0d2806f5a0 2024-05-30T06:49:37.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.362+0000 7f0d1fe00640 1 --2- 172.21.15.37:0/2771960862 >> v2:172.21.15.105:3300/0 conn(0x7f0d280cd440 0x7f0d2806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:49:37.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d2da00640 1 --2- 172.21.15.37:0/2771960862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d2806f5a0 0x7f0d280b3750 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0d280b2f00 tx=0x7f0d2001c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c518d8beb4459 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:37.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d27e00640 1 -- 172.21.15.37:0/2771960862 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200a66e0 con 0x7f0d2806f5a0 2024-05-30T06:49:37.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d27e00640 1 -- 172.21.15.37:0/2771960862 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d200a6880 con 0x7f0d2806f5a0 2024-05-30T06:49:37.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d27e00640 1 -- 172.21.15.37:0/2771960862 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200a6c50 con 0x7f0d2806f5a0 2024-05-30T06:49:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d2fa00640 1 -- 172.21.15.37:0/2771960862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d2806f5a0 msgr2=0x7f0d280b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d2fa00640 1 --2- 172.21.15.37:0/2771960862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d2806f5a0 0x7f0d280b3750 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0d280b2f00 tx=0x7f0d2001c810 comp rx=0 tx=0).stop 2024-05-30T06:49:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d2fa00640 1 -- 172.21.15.37:0/2771960862 shutdown_connections 2024-05-30T06:49:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d2fa00640 1 --2- 172.21.15.37:0/2771960862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d2806f5a0 0x7f0d280b3750 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d2fa00640 1 --2- 172.21.15.37:0/2771960862 >> v2:172.21.15.105:3300/0 conn(0x7f0d280cd440 0x7f0d2806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d2fa00640 1 -- 172.21.15.37:0/2771960862 >> 172.21.15.37:0/2771960862 conn(0x7f0d2806bf60 msgr2=0x7f0d280b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d2fa00640 1 -- 172.21.15.37:0/2771960862 shutdown_connections 2024-05-30T06:49:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d2fa00640 1 -- 172.21.15.37:0/2771960862 wait complete. 2024-05-30T06:49:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d2fa00640 1 Processor -- start 2024-05-30T06:49:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.366+0000 7f0d2fa00640 1 -- start start 2024-05-30T06:49:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2fa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d2806f5a0 0x7f0d28152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2fa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d28155da0 0x7f0d28148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2fa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d28151ff0 0x7f0d2814ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2fa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d28166570 con 0x7f0d28151ff0 2024-05-30T06:49:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2fa00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0d280b46b0 con 0x7f0d2806f5a0 2024-05-30T06:49:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2fa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0d281666f0 con 0x7f0d28155da0 2024-05-30T06:49:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d28151ff0 0x7f0d2814ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d28151ff0 0x7f0d2814ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45110/0 (socket says 172.21.15.37:45110) 2024-05-30T06:49:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2da00640 1 -- 172.21.15.37:0/578077682 learned_addr learned my addr 172.21.15.37:0/578077682 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2d000640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d2806f5a0 0x7f0d28152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d1fe00640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d28155da0 0x7f0d28148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2da00640 1 -- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d28155da0 msgr2=0x7f0d28148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2da00640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d28155da0 0x7f0d28148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2da00640 1 -- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d2806f5a0 msgr2=0x7f0d28152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2da00640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d2806f5a0 0x7f0d28152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2da00640 1 -- 172.21.15.37:0/578077682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d281563e0 con 0x7f0d28151ff0 2024-05-30T06:49:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2d000640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d2806f5a0 0x7f0d28152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:49:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2da00640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d28151ff0 0x7f0d2814ca90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0d2001a440 tx=0x7f0d200195b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d25600640 1 -- 172.21.15.37:0/578077682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200be070 con 0x7f0d28151ff0 2024-05-30T06:49:37.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d25600640 1 -- 172.21.15.37:0/578077682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d200b8840 con 0x7f0d28151ff0 2024-05-30T06:49:37.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d25600640 1 -- 172.21.15.37:0/578077682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200b8c30 con 0x7f0d28151ff0 2024-05-30T06:49:37.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2fa00640 1 -- 172.21.15.37:0/578077682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d281566c0 con 0x7f0d28151ff0 2024-05-30T06:49:37.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2fa00640 1 -- 172.21.15.37:0/578077682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d28156c80 con 0x7f0d28151ff0 2024-05-30T06:49:37.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.370+0000 7f0d2fa00640 1 -- 172.21.15.37:0/578077682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d28068bc0 con 0x7f0d28151ff0 2024-05-30T06:49:37.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.374+0000 7f0d25600640 1 -- 172.21.15.37:0/578077682 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 89160+0+0 (secure 0 0 0) 0x7f0d200c1070 con 0x7f0d28151ff0 2024-05-30T06:49:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.374+0000 7f0d25600640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0d040690a0 0x7f0d0406b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.374+0000 7f0d25600640 1 -- 172.21.15.37:0/578077682 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f0d20120340 con 0x7f0d28151ff0 2024-05-30T06:49:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.374+0000 7f0d2d000640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0d040690a0 0x7f0d0406b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.374+0000 7f0d2d000640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0d040690a0 0x7f0d0406b560 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0d18000f70 tx=0x7f0d18007cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.378+0000 7f0d25600640 1 -- 172.21.15.37:0/578077682 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0d200c8070 con 0x7f0d28151ff0 2024-05-30T06:49:37.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.566+0000 7f0d2fa00640 1 -- 172.21.15.37:0/578077682 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f0d280b6790 con 0x7f0d040690a0 2024-05-30T06:49:37.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.570+0000 7f0d25600640 1 -- 172.21.15.37:0/578077682 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f0d280b6790 con 0x7f0d040690a0 2024-05-30T06:49:37.569 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:49:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:49:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:49:37.570 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:37.570 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:49:37.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.570+0000 7f0d2fa00640 1 -- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0d040690a0 msgr2=0x7f0d0406b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.570+0000 7f0d2fa00640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0d040690a0 0x7f0d0406b560 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0d18000f70 tx=0x7f0d18007cd0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.570+0000 7f0d2fa00640 1 -- 172.21.15.37:0/578077682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d28151ff0 msgr2=0x7f0d2814ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.570+0000 7f0d2fa00640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d28151ff0 0x7f0d2814ca90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0d2001a440 tx=0x7f0d200195b0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.570+0000 7f0d2fa00640 1 -- 172.21.15.37:0/578077682 shutdown_connections 2024-05-30T06:49:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.570+0000 7f0d2fa00640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d28151ff0 0x7f0d2814ca90 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.570+0000 7f0d2fa00640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d28155da0 0x7f0d28148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.570+0000 7f0d2fa00640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0d040690a0 0x7f0d0406b560 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.570+0000 7f0d2fa00640 1 --2- 172.21.15.37:0/578077682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d2806f5a0 0x7f0d28152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.570+0000 7f0d2fa00640 1 -- 172.21.15.37:0/578077682 >> 172.21.15.37:0/578077682 conn(0x7f0d2806bf60 msgr2=0x7f0d28150180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.570+0000 7f0d2fa00640 1 -- 172.21.15.37:0/578077682 shutdown_connections 2024-05-30T06:49:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.570+0000 7f0d2fa00640 1 -- 172.21.15.37:0/578077682 wait complete. 2024-05-30T06:49:37.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:49:37.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa4a1000640 1 Processor -- start 2024-05-30T06:49:37.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa4a1000640 1 -- start start 2024-05-30T06:49:37.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa4a1000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa49c06f9a0 0x7fa49c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:37.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa4a1000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c0b2ec0 0x7fa49c0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa4a1000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa49c15c8f0 con 0x7fa49c155e60 2024-05-30T06:49:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa4a1000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa49c0ccff0 con 0x7fa49c06f9a0 2024-05-30T06:49:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa4a1000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c0ccc80 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa491400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa49c06f9a0 0x7fa49c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa499e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa49c155e60 0x7fa49c0cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37762/0 (socket says 172.21.15.37:37762) 2024-05-30T06:49:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa499e00640 1 -- 172.21.15.37:0/1404891922 learned_addr learned my addr 172.21.15.37:0/1404891922 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa49a800640 1 --2- 172.21.15.37:0/1404891922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c0b2ec0 0x7fa49c0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa491400640 1 -- 172.21.15.37:0/1404891922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c0b2ec0 msgr2=0x7fa49c0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa491400640 1 --2- 172.21.15.37:0/1404891922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c0b2ec0 0x7fa49c0cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa491400640 1 -- 172.21.15.37:0/1404891922 >> v1:172.21.15.37:6789/0 conn(0x7fa49c155e60 legacy=0x7fa49c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa491400640 1 -- 172.21.15.37:0/1404891922 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c15cbd0 con 0x7fa49c06f9a0 2024-05-30T06:49:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.734+0000 7fa49a800640 1 --2- 172.21.15.37:0/1404891922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c0b2ec0 0x7fa49c0cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:49:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.738+0000 7fa491400640 1 --2- 172.21.15.37:0/1404891922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa49c06f9a0 0x7fa49c0b36a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa4840097c0 tx=0x7fa48401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f541e3ff9cbcfe0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.738+0000 7fa499400640 1 -- 172.21.15.37:0/1404891922 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840b1070 con 0x7fa49c06f9a0 2024-05-30T06:49:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.738+0000 7fa499400640 1 -- 172.21.15.37:0/1404891922 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4840ac410 con 0x7fa49c06f9a0 2024-05-30T06:49:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.738+0000 7fa499400640 1 -- 172.21.15.37:0/1404891922 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840ac7e0 con 0x7fa49c06f9a0 2024-05-30T06:49:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.738+0000 7fa4a1000640 1 -- 172.21.15.37:0/1404891922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa49c06f9a0 msgr2=0x7fa49c0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.738+0000 7fa4a1000640 1 --2- 172.21.15.37:0/1404891922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa49c06f9a0 0x7fa49c0b36a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa4840097c0 tx=0x7fa48401c4a0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.738+0000 7fa4a1000640 1 -- 172.21.15.37:0/1404891922 shutdown_connections 2024-05-30T06:49:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.738+0000 7fa4a1000640 1 --2- 172.21.15.37:0/1404891922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c0b2ec0 0x7fa49c0cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.738+0000 7fa4a1000640 1 --2- 172.21.15.37:0/1404891922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa49c06f9a0 0x7fa49c0b36a0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.738+0000 7fa4a1000640 1 -- 172.21.15.37:0/1404891922 >> 172.21.15.37:0/1404891922 conn(0x7fa49c0b23a0 msgr2=0x7fa49c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.738+0000 7fa4a1000640 1 -- 172.21.15.37:0/1404891922 shutdown_connections 2024-05-30T06:49:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.738+0000 7fa4a1000640 1 -- 172.21.15.37:0/1404891922 wait complete. 2024-05-30T06:49:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa4a1000640 1 Processor -- start 2024-05-30T06:49:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa4a1000640 1 -- start start 2024-05-30T06:49:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa4a1000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c06f9a0 0x7fa49c1fbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa4a1000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa49c0b2ec0 0x7fa49c151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa4a1000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa49c155e60 0x7fa49c15d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa4a1000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c1689f0 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa4a1000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa49c168870 con 0x7fa49c155e60 2024-05-30T06:49:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa4a1000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa49c168b70 con 0x7fa49c06f9a0 2024-05-30T06:49:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa491400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa49c0b2ec0 0x7fa49c151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa491400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa49c0b2ec0 0x7fa49c151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45120/0 (socket says 172.21.15.37:45120) 2024-05-30T06:49:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa491400640 1 -- 172.21.15.37:0/3326753466 learned_addr learned my addr 172.21.15.37:0/3326753466 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa499e00640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c06f9a0 0x7fa49c1fbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa49a800640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa49c155e60 0x7fa49c15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa491400640 1 -- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c06f9a0 msgr2=0x7fa49c1fbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa491400640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c06f9a0 0x7fa49c1fbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa491400640 1 -- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa49c155e60 msgr2=0x7fa49c15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa491400640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa49c155e60 0x7fa49c15d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa491400640 1 -- 172.21.15.37:0/3326753466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49c15e730 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa491400640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa49c0b2ec0 0x7fa49c151b00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa4840af040 tx=0x7fa484019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa492a00640 1 -- 172.21.15.37:0/3326753466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840b9020 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa492a00640 1 -- 172.21.15.37:0/3326753466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4840acd90 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa492a00640 1 -- 172.21.15.37:0/3326753466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4840b1040 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa4a1000640 1 -- 172.21.15.37:0/3326753466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49c1fb2c0 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.742+0000 7fa4a1000640 1 -- 172.21.15.37:0/3326753466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49c15ea10 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.746+0000 7fa4a1000640 1 -- 172.21.15.37:0/3326753466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa49c068b20 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.746+0000 7fa492a00640 1 -- 172.21.15.37:0/3326753466 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 89160+0+0 (secure 0 0 0) 0x7fa4840bc020 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.746+0000 7fa492a00640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4780690a0 0x7fa47806b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:37.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.746+0000 7fa492a00640 1 -- 172.21.15.37:0/3326753466 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fa48411ee10 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.746+0000 7fa499e00640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4780690a0 0x7fa47806b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:37.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.746+0000 7fa499e00640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4780690a0 0x7fa47806b560 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa49c154ad0 tx=0x7fa48c007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:37.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.750+0000 7fa492a00640 1 -- 172.21.15.37:0/3326753466 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa4840c3030 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa4a1000640 1 -- 172.21.15.37:0/3326753466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa49c072fb0 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa492a00640 1 -- 172.21.15.37:0/3326753466 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2873 (secure 0 0 0) 0x7fa484016090 con 0x7fa49c0b2ec0 2024-05-30T06:49:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:49:37.974 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:49:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:49:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:49:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:49:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:49:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:49:37.974 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:49:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:49:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:49:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:49:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:49:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:49:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:49:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:49:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:49:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:37.975 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 472, 2024-05-30T06:49:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:49:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:49:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:49:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:49:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:49:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 60, 2024-05-30T06:49:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:49:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:49:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:49:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:49:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:49:37.976 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:49:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:49:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:49:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:49:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:49:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:49:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:49:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:49:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 3719, 2024-05-30T06:49:37.977 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 15424306082, 2024-05-30T06:49:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 30695526400, 2024-05-30T06:49:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 742398586880, 2024-05-30T06:49:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:49:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 632729058, 2024-05-30T06:49:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 628941800, 2024-05-30T06:49:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 153, 2024-05-30T06:49:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 167 2024-05-30T06:49:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:49:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 38, 2024-05-30T06:49:37.978 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4, 2024-05-30T06:49:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:49:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:49:37.979 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:49:37.982 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:49:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:49:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 4, 2024-05-30T06:49:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:49:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:49:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:49:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6055 2024-05-30T06:49:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:37.983 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:49:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:49:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:49:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:49:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:49:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:49:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:49:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:49:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:49:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:49:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 9, 2024-05-30T06:49:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:49:32.771841+0000", 2024-05-30T06:49:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-05-30T06:49:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-05-30T06:49:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "daemons": { 2024-05-30T06:49:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "summary": "", 2024-05-30T06:49:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "b": { 2024-05-30T06:49:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "start_epoch": 0, 2024-05-30T06:49:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "start_stamp": "0.000000", 2024-05-30T06:49:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 0, 2024-05-30T06:49:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T06:49:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": {}, 2024-05-30T06:49:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "task_status": {} 2024-05-30T06:49:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:49:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "0c673918-505c-43b2-ac62-86da33d8d10b": { 2024-05-30T06:49:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "1 ongoing+pending clones; Avg progress is 27.865% (13s)\n [=======.....................] (remaining: 34s)", 2024-05-30T06:49:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.27864998579025269, 2024-05-30T06:49:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:49:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "8c2a545f-d3da-46a4-bf90-e6e248c7dcb3": { 2024-05-30T06:49:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "1 ongoing clones; Avg progress is 27.865% (19s)\n [=======.....................] (remaining: 49s)", 2024-05-30T06:49:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.27864998579025269, 2024-05-30T06:49:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:49:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:37.987 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:37.987 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:49:37.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa4a1000640 1 -- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4780690a0 msgr2=0x7fa47806b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa4a1000640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4780690a0 0x7fa47806b560 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa49c154ad0 tx=0x7fa48c007e90 comp rx=0 tx=0).stop 2024-05-30T06:49:37.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa4a1000640 1 -- 172.21.15.37:0/3326753466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa49c0b2ec0 msgr2=0x7fa49c151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:37.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa4a1000640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa49c0b2ec0 0x7fa49c151b00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa4840af040 tx=0x7fa484019240 comp rx=0 tx=0).stop 2024-05-30T06:49:37.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa4a1000640 1 -- 172.21.15.37:0/3326753466 shutdown_connections 2024-05-30T06:49:37.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa4a1000640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4780690a0 0x7fa47806b560 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa4a1000640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa49c155e60 0x7fa49c15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa4a1000640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa49c0b2ec0 0x7fa49c151b00 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa4a1000640 1 --2- 172.21.15.37:0/3326753466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa49c06f9a0 0x7fa49c1fbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:37.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa4a1000640 1 -- 172.21.15.37:0/3326753466 >> 172.21.15.37:0/3326753466 conn(0x7fa49c0b23a0 msgr2=0x7fa49c0b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:37.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa4a1000640 1 -- 172.21.15.37:0/3326753466 shutdown_connections 2024-05-30T06:49:37.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:37.974+0000 7fa4a1000640 1 -- 172.21.15.37:0/3326753466 wait complete. 2024-05-30T06:49:42.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:49:43.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.146+0000 7fcfe2c00640 1 Processor -- start 2024-05-30T06:49:43.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.146+0000 7fcfe2c00640 1 -- start start 2024-05-30T06:49:43.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.150+0000 7fcfe2c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcfdc15ec60 0x7fcfdc0afbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:43.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.150+0000 7fcfe2c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc15f040 0x7fcfdc15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:43.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.150+0000 7fcfe2c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfdc0cd170 con 0x7fcfdc0ced60 2024-05-30T06:49:43.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.150+0000 7fcfe2c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcfdc06fb40 con 0x7fcfdc15ec60 2024-05-30T06:49:43.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.150+0000 7fcfe2c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcfdc06f6b0 con 0x7fcfdc15f040 2024-05-30T06:49:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.150+0000 7fcfdbe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcfdc15ec60 0x7fcfdc0afbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.150+0000 7fcfd3400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc15f040 0x7fcfdc15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.150+0000 7fcfe0c00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fcfdc0ced60 0x7fcfdc0cf1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:37282/0 (socket says 172.21.15.37:37282) 2024-05-30T06:49:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.150+0000 7fcfe0c00640 1 -- 172.21.15.37:0/575105184 learned_addr learned my addr 172.21.15.37:0/575105184 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.150+0000 7fcfdbe00640 1 -- 172.21.15.37:0/575105184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc15f040 msgr2=0x7fcfdc15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.150+0000 7fcfdbe00640 1 --2- 172.21.15.37:0/575105184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc15f040 0x7fcfdc15f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.150+0000 7fcfdbe00640 1 -- 172.21.15.37:0/575105184 >> v1:172.21.15.105:6789/0 conn(0x7fcfdc0ced60 legacy=0x7fcfdc0cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.150+0000 7fcfdbe00640 1 -- 172.21.15.37:0/575105184 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfdc0cd450 con 0x7fcfdc15ec60 2024-05-30T06:49:43.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfdbe00640 1 --2- 172.21.15.37:0/575105184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15ec60 0x7fcfdc0afbf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00aea0 tx=0x7fcfcc01da70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53711e5281385789 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:43.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfdb400640 1 -- 172.21.15.37:0/575105184 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0a6860 con 0x7fcfdc15ec60 2024-05-30T06:49:43.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfdb400640 1 -- 172.21.15.37:0/575105184 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfcc0a6a00 con 0x7fcfdc15ec60 2024-05-30T06:49:43.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfdb400640 1 -- 172.21.15.37:0/575105184 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0a6dd0 con 0x7fcfdc15ec60 2024-05-30T06:49:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 -- 172.21.15.37:0/575105184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15ec60 msgr2=0x7fcfdc0afbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 --2- 172.21.15.37:0/575105184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15ec60 0x7fcfdc0afbf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00aea0 tx=0x7fcfcc01da70 comp rx=0 tx=0).stop 2024-05-30T06:49:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 -- 172.21.15.37:0/575105184 shutdown_connections 2024-05-30T06:49:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 --2- 172.21.15.37:0/575105184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc15f040 0x7fcfdc15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 --2- 172.21.15.37:0/575105184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15ec60 0x7fcfdc0afbf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 -- 172.21.15.37:0/575105184 >> 172.21.15.37:0/575105184 conn(0x7fcfdc0b23a0 msgr2=0x7fcfdc0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 -- 172.21.15.37:0/575105184 shutdown_connections 2024-05-30T06:49:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 -- 172.21.15.37:0/575105184 wait complete. 2024-05-30T06:49:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 Processor -- start 2024-05-30T06:49:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 -- start start 2024-05-30T06:49:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc0ced60 0x7fcfdc142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15ec60 0x7fcfdc13ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc15f040 0x7fcfdc074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc06e390 con 0x7fcfdc15f040 2024-05-30T06:49:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcfdc06e210 con 0x7fcfdc15ec60 2024-05-30T06:49:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.154+0000 7fcfe2c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcfdc06e510 con 0x7fcfdc0ced60 2024-05-30T06:49:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfe0c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc15f040 0x7fcfdc074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfd3400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15ec60 0x7fcfdc13ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfdbe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc0ced60 0x7fcfdc142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfd3400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15ec60 0x7fcfdc13ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:50022/0 (socket says 172.21.15.37:50022) 2024-05-30T06:49:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfd3400640 1 -- 172.21.15.37:0/684450144 learned_addr learned my addr 172.21.15.37:0/684450144 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfd3400640 1 -- 172.21.15.37:0/684450144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc0ced60 msgr2=0x7fcfdc142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfd3400640 1 --2- 172.21.15.37:0/684450144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc0ced60 0x7fcfdc142210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfd3400640 1 -- 172.21.15.37:0/684450144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc15f040 msgr2=0x7fcfdc074cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfd3400640 1 --2- 172.21.15.37:0/684450144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc15f040 0x7fcfdc074cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfd3400640 1 -- 172.21.15.37:0/684450144 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfdc1faf00 con 0x7fcfdc15ec60 2024-05-30T06:49:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfd3400640 1 --2- 172.21.15.37:0/684450144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15ec60 0x7fcfdc13ee40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400e930 tx=0x7fcfc400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfd8c00640 1 -- 172.21.15.37:0/684450144 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4017070 con 0x7fcfdc15ec60 2024-05-30T06:49:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfd8c00640 1 -- 172.21.15.37:0/684450144 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc400ca00 con 0x7fcfdc15ec60 2024-05-30T06:49:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfd8c00640 1 -- 172.21.15.37:0/684450144 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc400cdb0 con 0x7fcfdc15ec60 2024-05-30T06:49:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfe2c00640 1 -- 172.21.15.37:0/684450144 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfdc1fb1e0 con 0x7fcfdc15ec60 2024-05-30T06:49:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfe2c00640 1 -- 172.21.15.37:0/684450144 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfdc1fb7a0 con 0x7fcfdc15ec60 2024-05-30T06:49:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.158+0000 7fcfe2c00640 1 -- 172.21.15.37:0/684450144 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfdc068b20 con 0x7fcfdc15ec60 2024-05-30T06:49:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.162+0000 7fcfd8c00640 1 -- 172.21.15.37:0/684450144 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 23) ==== 89160+0+0 (secure 0 0 0) 0x7fcfc401a070 con 0x7fcfdc15ec60 2024-05-30T06:49:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.162+0000 7fcfd8c00640 1 --2- 172.21.15.37:0/684450144 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfb8069070 0x7fcfb806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.162+0000 7fcfd8c00640 1 -- 172.21.15.37:0/684450144 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fcfc4085bc0 con 0x7fcfdc15ec60 2024-05-30T06:49:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.162+0000 7fcfdbe00640 1 --2- 172.21.15.37:0/684450144 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfb8069070 0x7fcfb806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.162+0000 7fcfdbe00640 1 --2- 172.21.15.37:0/684450144 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfb8069070 0x7fcfb806b530 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0af000 tx=0x7fcfcc0a8070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:43.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.166+0000 7fcfd8c00640 1 -- 172.21.15.37:0/684450144 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcfc4057640 con 0x7fcfdc15ec60 2024-05-30T06:49:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.390+0000 7fcfe2c00640 1 -- 172.21.15.37:0/684450144 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fcfdc072fb0 con 0x7fcfdc15ec60 2024-05-30T06:49:43.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.390+0000 7fcfd8c00640 1 -- 172.21.15.37:0/684450144 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2831 (secure 0 0 0) 0x7fcfc405b940 con 0x7fcfdc15ec60 2024-05-30T06:49:43.391 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:49:43.392 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:49:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:49:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:49:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:49:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:49:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:49:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:49:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:49:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:49:43.392 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:49:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:49:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:49:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:49:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:49:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:49:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 477, 2024-05-30T06:49:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:49:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:49:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:49:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:49:43.393 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 60, 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:49:43.394 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4265, 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 17735588588, 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 35876102144, 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 737218011136, 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 771908835, 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 770236122, 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 188, 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 208 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:43.395 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 38, 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4, 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 4, 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6055 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:43.396 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 9, 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:49:32.771841+0000", 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-05-30T06:49:43.397 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "daemons": { 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "summary": "", 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "b": { 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "start_epoch": 0, 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "start_stamp": "0.000000", 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 0, 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": {}, 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: "task_status": {} 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:43.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:49:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "0c673918-505c-43b2-ac62-86da33d8d10b": { 2024-05-30T06:49:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 27.0 seconds before exiting (17s)\n [============================] ", 2024-05-30T06:49:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:49:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:49:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "8c2a545f-d3da-46a4-bf90-e6e248c7dcb3": { 2024-05-30T06:49:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 27.0 seconds before exiting (23s)\n [============================] ", 2024-05-30T06:49:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:49:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:49:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:43.399 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:43.399 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:49:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.394+0000 7fcfe2c00640 1 -- 172.21.15.37:0/684450144 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfb8069070 msgr2=0x7fcfb806b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.394+0000 7fcfe2c00640 1 --2- 172.21.15.37:0/684450144 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfb8069070 0x7fcfb806b530 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0af000 tx=0x7fcfcc0a8070 comp rx=0 tx=0).stop 2024-05-30T06:49:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.394+0000 7fcfe2c00640 1 -- 172.21.15.37:0/684450144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15ec60 msgr2=0x7fcfdc13ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.394+0000 7fcfe2c00640 1 --2- 172.21.15.37:0/684450144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15ec60 0x7fcfdc13ee40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400e930 tx=0x7fcfc400edf0 comp rx=0 tx=0).stop 2024-05-30T06:49:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.394+0000 7fcfe2c00640 1 -- 172.21.15.37:0/684450144 shutdown_connections 2024-05-30T06:49:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.394+0000 7fcfe2c00640 1 --2- 172.21.15.37:0/684450144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfdc15f040 0x7fcfdc074cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:43.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.394+0000 7fcfe2c00640 1 --2- 172.21.15.37:0/684450144 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfb8069070 0x7fcfb806b530 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.394+0000 7fcfe2c00640 1 --2- 172.21.15.37:0/684450144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcfdc15ec60 0x7fcfdc13ee40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.394+0000 7fcfe2c00640 1 --2- 172.21.15.37:0/684450144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcfdc0ced60 0x7fcfdc142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.394+0000 7fcfe2c00640 1 -- 172.21.15.37:0/684450144 >> 172.21.15.37:0/684450144 conn(0x7fcfdc0b23a0 msgr2=0x7fcfdc0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.394+0000 7fcfe2c00640 1 -- 172.21.15.37:0/684450144 shutdown_connections 2024-05-30T06:49:43.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:43.394+0000 7fcfe2c00640 1 -- 172.21.15.37:0/684450144 wait complete. 2024-05-30T06:49:48.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:49:48.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.566+0000 7fad2bc00640 1 Processor -- start 2024-05-30T06:49:48.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.566+0000 7fad2bc00640 1 -- start start 2024-05-30T06:49:48.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.566+0000 7fad2bc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad2406f9a0 0x7fad240b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:48.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.566+0000 7fad2bc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad240b2ec0 0x7fad240cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:48.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.566+0000 7fad2bc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2415c8f0 con 0x7fad24155e60 2024-05-30T06:49:48.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.570+0000 7fad2bc00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fad240ccff0 con 0x7fad240b2ec0 2024-05-30T06:49:48.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.570+0000 7fad2bc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad240ccc80 con 0x7fad2406f9a0 2024-05-30T06:49:48.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.570+0000 7fad29200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fad24155e60 0x7fad240cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38414/0 (socket says 172.21.15.37:38414) 2024-05-30T06:49:48.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.570+0000 7fad29200640 1 -- 172.21.15.37:0/3365517212 learned_addr learned my addr 172.21.15.37:0/3365517212 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:48.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.570+0000 7fad29c00640 1 --2- 172.21.15.37:0/3365517212 >> v2:172.21.15.37:3300/0 conn(0x7fad240b2ec0 0x7fad240cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:48.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.570+0000 7fad1be00640 1 --2- 172.21.15.37:0/3365517212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad2406f9a0 0x7fad240b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:48.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.570+0000 7fad29c00640 1 -- 172.21.15.37:0/3365517212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad2406f9a0 msgr2=0x7fad240b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:48.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.570+0000 7fad29c00640 1 --2- 172.21.15.37:0/3365517212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad2406f9a0 0x7fad240b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:48.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.570+0000 7fad29c00640 1 -- 172.21.15.37:0/3365517212 >> v1:172.21.15.37:6789/0 conn(0x7fad24155e60 legacy=0x7fad240cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:48.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.570+0000 7fad23e00640 1 -- 172.21.15.37:0/3365517212 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976981999 0 0) 0x7fad2415c8f0 con 0x7fad24155e60 2024-05-30T06:49:48.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.570+0000 7fad29c00640 1 -- 172.21.15.37:0/3365517212 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2415cbd0 con 0x7fad240b2ec0 2024-05-30T06:49:48.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.570+0000 7fad29c00640 1 --2- 172.21.15.37:0/3365517212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad240b2ec0 0x7fad240cd480 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009d90 tx=0x7fad1c01eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec264f89ddf6bd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:48.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.570+0000 7fad23e00640 1 -- 172.21.15.37:0/3365517212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c0b4070 con 0x7fad240b2ec0 2024-05-30T06:49:48.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad23e00640 1 -- 172.21.15.37:0/3365517212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1c0a7b60 con 0x7fad240b2ec0 2024-05-30T06:49:48.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad23e00640 1 -- 172.21.15.37:0/3365517212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c0af440 con 0x7fad240b2ec0 2024-05-30T06:49:48.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 -- 172.21.15.37:0/3365517212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad240b2ec0 msgr2=0x7fad240cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:48.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 --2- 172.21.15.37:0/3365517212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad240b2ec0 0x7fad240cd480 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009d90 tx=0x7fad1c01eb80 comp rx=0 tx=0).stop 2024-05-30T06:49:48.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 -- 172.21.15.37:0/3365517212 shutdown_connections 2024-05-30T06:49:48.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 --2- 172.21.15.37:0/3365517212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad240b2ec0 0x7fad240cd480 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:48.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 --2- 172.21.15.37:0/3365517212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad2406f9a0 0x7fad240b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:48.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 -- 172.21.15.37:0/3365517212 >> 172.21.15.37:0/3365517212 conn(0x7fad240b23a0 msgr2=0x7fad240b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 -- 172.21.15.37:0/3365517212 shutdown_connections 2024-05-30T06:49:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 -- 172.21.15.37:0/3365517212 wait complete. 2024-05-30T06:49:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 Processor -- start 2024-05-30T06:49:48.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 -- start start 2024-05-30T06:49:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad2406f9a0 0x7fad241522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad240b2ec0 0x7fad24142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad24155e60 0x7fad24071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad2406ec20 con 0x7fad240b2ec0 2024-05-30T06:49:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad2406eaa0 con 0x7fad24155e60 2024-05-30T06:49:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad2bc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad2406eda0 con 0x7fad2406f9a0 2024-05-30T06:49:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad1be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad240b2ec0 0x7fad24142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad1be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad240b2ec0 0x7fad24142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55258/0 (socket says 172.21.15.37:55258) 2024-05-30T06:49:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.574+0000 7fad1be00640 1 -- 172.21.15.37:0/79355311 learned_addr learned my addr 172.21.15.37:0/79355311 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad29200640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad2406f9a0 0x7fad241522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad29c00640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad24155e60 0x7fad24071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad1be00640 1 -- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad2406f9a0 msgr2=0x7fad241522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad1be00640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad2406f9a0 0x7fad241522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad1be00640 1 -- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad24155e60 msgr2=0x7fad24071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad1be00640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad24155e60 0x7fad24071fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad1be00640 1 -- 172.21.15.37:0/79355311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad24143430 con 0x7fad240b2ec0 2024-05-30T06:49:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad29200640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad2406f9a0 0x7fad241522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:49:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad1be00640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad240b2ec0 0x7fad24142ef0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00e930 tx=0x7fad0c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad21600640 1 -- 172.21.15.37:0/79355311 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c017070 con 0x7fad240b2ec0 2024-05-30T06:49:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad21600640 1 -- 172.21.15.37:0/79355311 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad0c00ca00 con 0x7fad240b2ec0 2024-05-30T06:49:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad2bc00640 1 -- 172.21.15.37:0/79355311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad24159120 con 0x7fad240b2ec0 2024-05-30T06:49:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad21600640 1 -- 172.21.15.37:0/79355311 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c00cdd0 con 0x7fad240b2ec0 2024-05-30T06:49:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad2bc00640 1 -- 172.21.15.37:0/79355311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad24153b60 con 0x7fad240b2ec0 2024-05-30T06:49:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad2bc00640 1 -- 172.21.15.37:0/79355311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad24068b20 con 0x7fad240b2ec0 2024-05-30T06:49:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad21600640 1 -- 172.21.15.37:0/79355311 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 89160+0+0 (secure 0 0 0) 0x7fad0c01a070 con 0x7fad240b2ec0 2024-05-30T06:49:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad21600640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad00069070 0x7fad0006b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.578+0000 7fad21600640 1 -- 172.21.15.37:0/79355311 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fad0c085420 con 0x7fad240b2ec0 2024-05-30T06:49:48.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.582+0000 7fad29200640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad00069070 0x7fad0006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:48.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.582+0000 7fad29200640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad00069070 0x7fad0006b530 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fad14007fd0 tx=0x7fad14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.586+0000 7fad21600640 1 -- 172.21.15.37:0/79355311 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fad0c0574f0 con 0x7fad240b2ec0 2024-05-30T06:49:48.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.814+0000 7fad2bc00640 1 -- 172.21.15.37:0/79355311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fad24072fb0 con 0x7fad240b2ec0 2024-05-30T06:49:48.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.814+0000 7fad21600640 1 -- 172.21.15.37:0/79355311 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2377 (secure 0 0 0) 0x7fad0c056df0 con 0x7fad240b2ec0 2024-05-30T06:49:48.816 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:49:48.816 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:49:48.816 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:49:48.816 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:49:48.816 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:49:48.816 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:49:48.816 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:49:48.816 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:48.816 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:49:48.816 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:49:48.816 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:49:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:49:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:49:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:49:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:49:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:49:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:49:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 483, 2024-05-30T06:49:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:49:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:49:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:49:48.817 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 60, 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:49:48.818 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:49:48.819 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:49:48.819 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:48.819 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:48.819 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:49:48.819 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:49:48.819 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4263, 2024-05-30T06:49:48.819 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 17735638857, 2024-05-30T06:49:48.819 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 35876167680, 2024-05-30T06:49:48.819 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 737217945600, 2024-05-30T06:49:48.819 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:49:48.819 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 185536861, 2024-05-30T06:49:48.819 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 192549981, 2024-05-30T06:49:48.819 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 46, 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 56 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 38, 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4, 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 4, 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:49:48.820 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6055 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:49:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:49:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 10, 2024-05-30T06:49:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:49:42.776273+0000", 2024-05-30T06:49:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:49:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:49:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: "0c673918-505c-43b2-ac62-86da33d8d10b": { 2024-05-30T06:49:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 21.0 seconds before exiting (23s)\n [============================] ", 2024-05-30T06:49:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:49:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:49:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:48.822 INFO:teuthology.orchestra.run.smithi037.stdout: "8c2a545f-d3da-46a4-bf90-e6e248c7dcb3": { 2024-05-30T06:49:48.823 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 21.0 seconds before exiting (29s)\n [============================] ", 2024-05-30T06:49:48.823 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:49:48.823 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:49:48.823 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:48.823 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:48.823 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:49:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.818+0000 7fad2bc00640 1 -- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad00069070 msgr2=0x7fad0006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.818+0000 7fad2bc00640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad00069070 0x7fad0006b530 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fad14007fd0 tx=0x7fad14009040 comp rx=0 tx=0).stop 2024-05-30T06:49:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.818+0000 7fad2bc00640 1 -- 172.21.15.37:0/79355311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad240b2ec0 msgr2=0x7fad24142ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.818+0000 7fad2bc00640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad240b2ec0 0x7fad24142ef0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00e930 tx=0x7fad0c00edf0 comp rx=0 tx=0).stop 2024-05-30T06:49:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.818+0000 7fad2bc00640 1 -- 172.21.15.37:0/79355311 shutdown_connections 2024-05-30T06:49:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.818+0000 7fad2bc00640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad00069070 0x7fad0006b530 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.818+0000 7fad2bc00640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad24155e60 0x7fad24071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.818+0000 7fad2bc00640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad240b2ec0 0x7fad24142ef0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.818+0000 7fad2bc00640 1 --2- 172.21.15.37:0/79355311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad2406f9a0 0x7fad241522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.818+0000 7fad2bc00640 1 -- 172.21.15.37:0/79355311 >> 172.21.15.37:0/79355311 conn(0x7fad240b23a0 msgr2=0x7fad240b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:48.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.818+0000 7fad2bc00640 1 -- 172.21.15.37:0/79355311 shutdown_connections 2024-05-30T06:49:48.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:48.818+0000 7fad2bc00640 1 -- 172.21.15.37:0/79355311 wait complete. 2024-05-30T06:49:53.838 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:49:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad22e00640 1 Processor -- start 2024-05-30T06:49:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad22e00640 1 -- start start 2024-05-30T06:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad22e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad1c15e930 0x7fad1c09b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad22e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad1c162cb0 0x7fad1c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad22e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad1c09abe0 con 0x7fad1c0d1240 2024-05-30T06:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad22e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fad1c09bee0 con 0x7fad1c162cb0 2024-05-30T06:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad22e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c09aec0 con 0x7fad1c15e930 2024-05-30T06:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad20e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad1c162cb0 0x7fad1c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad20e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad1c162cb0 0x7fad1c0ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55262/0 (socket says 172.21.15.37:55262) 2024-05-30T06:49:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad20e00640 1 -- 172.21.15.37:0/2557925601 learned_addr learned my addr 172.21.15.37:0/2557925601 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad1be00640 1 --2- 172.21.15.37:0/2557925601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad1c15e930 0x7fad1c09b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad20e00640 1 -- 172.21.15.37:0/2557925601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad1c15e930 msgr2=0x7fad1c09b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad20e00640 1 --2- 172.21.15.37:0/2557925601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad1c15e930 0x7fad1c09b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad20e00640 1 -- 172.21.15.37:0/2557925601 >> v1:172.21.15.105:6789/0 conn(0x7fad1c0d1240 legacy=0x7fad1c1625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.989+0000 7fad20e00640 1 -- 172.21.15.37:0/2557925601 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c09b1a0 con 0x7fad1c162cb0 2024-05-30T06:49:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.993+0000 7fad20e00640 1 --2- 172.21.15.37:0/2557925601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad1c162cb0 0x7fad1c0ccc60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fad14009e50 tx=0x7fad1401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c230578ae414e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.993+0000 7fad1b400640 1 -- 172.21.15.37:0/2557925601 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad140a5700 con 0x7fad1c162cb0 2024-05-30T06:49:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.993+0000 7fad1b400640 1 -- 172.21.15.37:0/2557925601 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad140a58a0 con 0x7fad1c162cb0 2024-05-30T06:49:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.993+0000 7fad1b400640 1 -- 172.21.15.37:0/2557925601 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad140a5c70 con 0x7fad1c162cb0 2024-05-30T06:49:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.993+0000 7fad22e00640 1 -- 172.21.15.37:0/2557925601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad1c162cb0 msgr2=0x7fad1c0ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.993+0000 7fad22e00640 1 --2- 172.21.15.37:0/2557925601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad1c162cb0 0x7fad1c0ccc60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fad14009e50 tx=0x7fad1401ca30 comp rx=0 tx=0).stop 2024-05-30T06:49:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.993+0000 7fad22e00640 1 -- 172.21.15.37:0/2557925601 shutdown_connections 2024-05-30T06:49:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.993+0000 7fad22e00640 1 --2- 172.21.15.37:0/2557925601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad1c162cb0 0x7fad1c0ccc60 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.993+0000 7fad22e00640 1 --2- 172.21.15.37:0/2557925601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad1c15e930 0x7fad1c09b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.993+0000 7fad22e00640 1 -- 172.21.15.37:0/2557925601 >> 172.21.15.37:0/2557925601 conn(0x7fad1c0b4100 msgr2=0x7fad1c0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.993+0000 7fad22e00640 1 -- 172.21.15.37:0/2557925601 shutdown_connections 2024-05-30T06:49:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.993+0000 7fad22e00640 1 -- 172.21.15.37:0/2557925601 wait complete. 2024-05-30T06:49:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad22e00640 1 Processor -- start 2024-05-30T06:49:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad22e00640 1 -- start start 2024-05-30T06:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad22e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad1c0d1240 0x7fad1c0b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad22e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad1c15e930 0x7fad1c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad22e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad1c162cb0 0x7fad1c0afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad22e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c16bac0 con 0x7fad1c162cb0 2024-05-30T06:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad22e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c16b940 con 0x7fad1c15e930 2024-05-30T06:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad22e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad1c16bc40 con 0x7fad1c0d1240 2024-05-30T06:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad20e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad1c162cb0 0x7fad1c0afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad20e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad1c162cb0 0x7fad1c0afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55270/0 (socket says 172.21.15.37:55270) 2024-05-30T06:49:53.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad20e00640 1 -- 172.21.15.37:0/1251704789 learned_addr learned my addr 172.21.15.37:0/1251704789 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad13400640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad1c15e930 0x7fad1c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad1be00640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad1c0d1240 0x7fad1c0b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad20e00640 1 -- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad1c0d1240 msgr2=0x7fad1c0b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad20e00640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad1c0d1240 0x7fad1c0b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad20e00640 1 -- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad1c15e930 msgr2=0x7fad1c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad20e00640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad1c15e930 0x7fad1c0b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:54.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad20e00640 1 -- 172.21.15.37:0/1251704789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c0b3110 con 0x7fad1c162cb0 2024-05-30T06:49:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad20e00640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad1c162cb0 0x7fad1c0afc60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fad140af040 tx=0x7fad140197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad18c00640 1 -- 172.21.15.37:0/1251704789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad140b8440 con 0x7fad1c162cb0 2024-05-30T06:49:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad18c00640 1 -- 172.21.15.37:0/1251704789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad140b8600 con 0x7fad1c162cb0 2024-05-30T06:49:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad18c00640 1 -- 172.21.15.37:0/1251704789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad140b89f0 con 0x7fad1c162cb0 2024-05-30T06:49:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad22e00640 1 -- 172.21.15.37:0/1251704789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1c0b33f0 con 0x7fad1c162cb0 2024-05-30T06:49:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:53.997+0000 7fad22e00640 1 -- 172.21.15.37:0/1251704789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1c15c820 con 0x7fad1c162cb0 2024-05-30T06:49:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.001+0000 7fad22e00640 1 -- 172.21.15.37:0/1251704789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad1c0b3910 con 0x7fad1c162cb0 2024-05-30T06:49:54.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.001+0000 7fad18c00640 1 -- 172.21.15.37:0/1251704789 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 89109+0+0 (secure 0 0 0) 0x7fad140c1020 con 0x7fad1c162cb0 2024-05-30T06:49:54.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.001+0000 7fad18c00640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7facf8068fe0 0x7facf806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.001+0000 7fad18c00640 1 -- 172.21.15.37:0/1251704789 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fad1411fad0 con 0x7fad1c162cb0 2024-05-30T06:49:54.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.001+0000 7fad1be00640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7facf8068fe0 0x7facf806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:54.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.001+0000 7fad1be00640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7facf8068fe0 0x7facf806b4a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0b3d40 tx=0x7fad0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:54.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.005+0000 7fad18c00640 1 -- 172.21.15.37:0/1251704789 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fad1c0b3910 con 0x7fad1c162cb0 2024-05-30T06:49:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.225+0000 7fad22e00640 1 -- 172.21.15.37:0/1251704789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fad1c068b20 con 0x7fad1c162cb0 2024-05-30T06:49:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.225+0000 7fad18c00640 1 -- 172.21.15.37:0/1251704789 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2364 (secure 0 0 0) 0x7fad140c8020 con 0x7fad1c162cb0 2024-05-30T06:49:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:49:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:49:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:49:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:49:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 488, 2024-05-30T06:49:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:49:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:49:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:49:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:49:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:49:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 60, 2024-05-30T06:49:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:49:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:49:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:49:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:49:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:49:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:49:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:49:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:49:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:49:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:49:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:49:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4263, 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 17735668545, 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 35876233216, 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 737217880064, 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 255, 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 7763, 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 2 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:49:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 38, 2024-05-30T06:49:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4, 2024-05-30T06:49:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:49:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:49:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:49:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:49:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:49:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 4, 2024-05-30T06:49:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:49:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:49:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:49:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6055 2024-05-30T06:49:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:49:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:49:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:49:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:49:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:49:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:49:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:49:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:49:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:49:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:49:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 10, 2024-05-30T06:49:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:49:42.776273+0000", 2024-05-30T06:49:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:49:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:49:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "0c673918-505c-43b2-ac62-86da33d8d10b": { 2024-05-30T06:49:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 15.0 seconds before exiting (29s)\n [============================] ", 2024-05-30T06:49:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:49:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:49:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "8c2a545f-d3da-46a4-bf90-e6e248c7dcb3": { 2024-05-30T06:49:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 15.0 seconds before exiting (35s)\n [============================] ", 2024-05-30T06:49:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:49:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:49:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:54.236 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:49:54.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.229+0000 7fad22e00640 1 -- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7facf8068fe0 msgr2=0x7facf806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:54.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.229+0000 7fad22e00640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7facf8068fe0 0x7facf806b4a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0b3d40 tx=0x7fad0c008040 comp rx=0 tx=0).stop 2024-05-30T06:49:54.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.229+0000 7fad22e00640 1 -- 172.21.15.37:0/1251704789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad1c162cb0 msgr2=0x7fad1c0afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:54.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.229+0000 7fad22e00640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad1c162cb0 0x7fad1c0afc60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fad140af040 tx=0x7fad140197d0 comp rx=0 tx=0).stop 2024-05-30T06:49:54.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.229+0000 7fad22e00640 1 -- 172.21.15.37:0/1251704789 shutdown_connections 2024-05-30T06:49:54.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.229+0000 7fad22e00640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad1c162cb0 0x7fad1c0afc60 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:54.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.229+0000 7fad22e00640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7facf8068fe0 0x7facf806b4a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:54.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.229+0000 7fad22e00640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad1c15e930 0x7fad1c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:54.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.229+0000 7fad22e00640 1 --2- 172.21.15.37:0/1251704789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad1c0d1240 0x7fad1c0b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:54.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.229+0000 7fad22e00640 1 -- 172.21.15.37:0/1251704789 >> 172.21.15.37:0/1251704789 conn(0x7fad1c0b4100 msgr2=0x7fad1c1549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:54.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.229+0000 7fad22e00640 1 -- 172.21.15.37:0/1251704789 shutdown_connections 2024-05-30T06:49:54.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:54.229+0000 7fad22e00640 1 -- 172.21.15.37:0/1251704789 wait complete. 2024-05-30T06:49:59.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:49:59.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.401+0000 7f570b600640 1 Processor -- start 2024-05-30T06:49:59.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.401+0000 7f570b600640 1 -- start start 2024-05-30T06:49:59.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f570b600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f570415f5e0 0x7f57040af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:59.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f570b600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57040afe30 con 0x7f57040b2ec0 2024-05-30T06:49:59.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f570b600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f570406e210 con 0x7f57041482d0 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f570b600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f570406e860 con 0x7f570415f5e0 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f56fbe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f57040b2ec0 0x7f570415eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52928/0 (socket says 172.21.15.37:52928) 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f56fbe00640 1 -- 172.21.15.37:0/346493508 learned_addr learned my addr 172.21.15.37:0/346493508 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5709600640 1 --2- 172.21.15.37:0/346493508 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f570415f5e0 0x7f57040af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3431375697 0 0) 0x7f57040afe30 con 0x7f57040b2ec0 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56e8003530 con 0x7f57040b2ec0 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903581812 0 0) 0x7f570406e210 con 0x7f57041482d0 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57040afe30 con 0x7f57041482d0 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2852907470 0 0) 0x7f56e8003530 con 0x7f57040b2ec0 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f570415f5e0 msgr2=0x7f57040af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 --2- 172.21.15.37:0/346493508 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f570415f5e0 0x7f57040af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 >> v1:172.21.15.105:6789/0 conn(0x7f57041482d0 legacy=0x7f570415ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570406e4f0 con 0x7f57040b2ec0 2024-05-30T06:49:59.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f56ec001680 con 0x7f57040b2ec0 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 >> v1:172.21.15.37:6789/0 conn(0x7f57040b2ec0 legacy=0x7f570415eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 --2- 172.21.15.37:0/346493508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56e8003b80 0x7f56e8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 --2- 172.21.15.37:0/346493508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56e8004810 0x7f56e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 --2- 172.21.15.37:0/346493508 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f570415f5e0 0x7f56e80051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f570406e860 con 0x7f56e8003b80 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f56e800bb10 con 0x7f56e8004810 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f56e800bd10 con 0x7f570415f5e0 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5708c00640 1 --2- 172.21.15.37:0/346493508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56e8003b80 0x7f56e8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f56fbe00640 1 --2- 172.21.15.37:0/346493508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56e8004810 0x7f56e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5709600640 1 --2- 172.21.15.37:0/346493508 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f570415f5e0 0x7f56e80051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5708c00640 1 -- 172.21.15.37:0/346493508 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f570415f5e0 msgr2=0x7f56e80051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5708c00640 1 --2- 172.21.15.37:0/346493508 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f570415f5e0 0x7f56e80051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5708c00640 1 -- 172.21.15.37:0/346493508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56e8004810 msgr2=0x7f56e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5708c00640 1 --2- 172.21.15.37:0/346493508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56e8004810 0x7f56e8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:59.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f5708c00640 1 -- 172.21.15.37:0/346493508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e8003530 con 0x7f56e8003b80 2024-05-30T06:49:59.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.405+0000 7f56fbe00640 1 --2- 172.21.15.37:0/346493508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56e8004810 0x7f56e8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:49:59.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.409+0000 7f5708c00640 1 --2- 172.21.15.37:0/346493508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56e8003b80 0x7f56e8003f80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f56f40018d0 tx=0x7f56f401c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192fe907cc18cfcd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:59.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.409+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f4001520 con 0x7f56e8003b80 2024-05-30T06:49:59.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.409+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f40052f0 con 0x7f56e8003b80 2024-05-30T06:49:59.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.409+0000 7f5703e00640 1 -- 172.21.15.37:0/346493508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f4003840 con 0x7f56e8003b80 2024-05-30T06:49:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.409+0000 7f570b600640 1 -- 172.21.15.37:0/346493508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56e8003b80 msgr2=0x7f56e8003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.409+0000 7f570b600640 1 --2- 172.21.15.37:0/346493508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56e8003b80 0x7f56e8003f80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f56f40018d0 tx=0x7f56f401c580 comp rx=0 tx=0).stop 2024-05-30T06:49:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.409+0000 7f5709600640 1 -- 172.21.15.37:0/346493508 reap_dead start 2024-05-30T06:49:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.409+0000 7f570b600640 1 -- 172.21.15.37:0/346493508 shutdown_connections 2024-05-30T06:49:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.409+0000 7f570b600640 1 -- 172.21.15.37:0/346493508 >> 172.21.15.37:0/346493508 conn(0x7f57040b23a0 msgr2=0x7f57040b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:59.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.409+0000 7f570b600640 1 -- 172.21.15.37:0/346493508 shutdown_connections 2024-05-30T06:49:59.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.409+0000 7f570b600640 1 -- 172.21.15.37:0/346493508 wait complete. 2024-05-30T06:49:59.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.409+0000 7f570b600640 1 Processor -- start 2024-05-30T06:49:59.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.409+0000 7f570b600640 1 -- start start 2024-05-30T06:49:59.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f570b600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56e8003b80 0x7f570415e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:59.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f570b600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704144bf0 0x7f57041faca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f570b600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5704145070 0x7f57041fb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f570b600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f570406f8b0 con 0x7f5704144bf0 2024-05-30T06:49:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f570b600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f570406f730 con 0x7f56e8003b80 2024-05-30T06:49:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f570b600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f570416a890 con 0x7f5704145070 2024-05-30T06:49:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f56fbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704144bf0 0x7f57041faca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f56fbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704144bf0 0x7f57041faca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50026/0 (socket says 172.21.15.37:50026) 2024-05-30T06:49:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f56fbe00640 1 -- 172.21.15.37:0/4284706623 learned_addr learned my addr 172.21.15.37:0/4284706623 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:49:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f5708c00640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56e8003b80 0x7f570415e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f5709600640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5704145070 0x7f57041fb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f56fbe00640 1 -- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5704145070 msgr2=0x7f57041fb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f56fbe00640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5704145070 0x7f57041fb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f56fbe00640 1 -- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56e8003b80 msgr2=0x7f570415e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:59.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f56fbe00640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56e8003b80 0x7f570415e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:59.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f56fbe00640 1 -- 172.21.15.37:0/4284706623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f570415e810 con 0x7f5704144bf0 2024-05-30T06:49:59.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f56fbe00640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704144bf0 0x7f57041faca0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00e7b0 tx=0x7f56ec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:59.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f5701600640 1 -- 172.21.15.37:0/4284706623 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00ee60 con 0x7f5704144bf0 2024-05-30T06:49:59.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f5701600640 1 -- 172.21.15.37:0/4284706623 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ec018070 con 0x7f5704144bf0 2024-05-30T06:49:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f5701600640 1 -- 172.21.15.37:0/4284706623 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00ca70 con 0x7f5704144bf0 2024-05-30T06:49:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f570b600640 1 -- 172.21.15.37:0/4284706623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5704143b50 con 0x7f5704144bf0 2024-05-30T06:49:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f570b600640 1 -- 172.21.15.37:0/4284706623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5704144110 con 0x7f5704144bf0 2024-05-30T06:49:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f570b600640 1 -- 172.21.15.37:0/4284706623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5704068b20 con 0x7f5704144bf0 2024-05-30T06:49:59.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.413+0000 7f5701600640 1 -- 172.21.15.37:0/4284706623 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 89109+0+0 (secure 0 0 0) 0x7f56ec00cc10 con 0x7f5704144bf0 2024-05-30T06:49:59.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.417+0000 7f5701600640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f56e0069010 0x7f56e006b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:49:59.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.417+0000 7f5701600640 1 -- 172.21.15.37:0/4284706623 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f56ec084d40 con 0x7f5704144bf0 2024-05-30T06:49:59.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.417+0000 7f5708c00640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f56e0069010 0x7f56e006b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:49:59.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.417+0000 7f5708c00640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f56e0069010 0x7f56e006b4d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f56f40ac000 tx=0x7f56f40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:49:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.421+0000 7f5701600640 1 -- 172.21.15.37:0/4284706623 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f56ec056d90 con 0x7f5704144bf0 2024-05-30T06:49:59.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.649+0000 7f570b600640 1 -- 172.21.15.37:0/4284706623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f57041413f0 con 0x7f5704144bf0 2024-05-30T06:49:59.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.649+0000 7f5701600640 1 -- 172.21.15.37:0/4284706623 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2331 (secure 0 0 0) 0x7f56ec056690 con 0x7f5704144bf0 2024-05-30T06:49:59.651 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:49:59.651 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:49:59.651 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:49:59.651 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:49:59.651 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:49:59.651 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:49:59.651 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:49:59.651 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:59.651 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:49:59.651 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:49:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:49:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:49:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:49:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:49:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:49:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:49:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:49:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 494, 2024-05-30T06:49:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:49:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:49:59.652 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:49:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:49:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:49:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 60, 2024-05-30T06:49:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:49:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:49:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:49:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:49:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:49:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:49:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:49:59.653 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:49:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:49:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:49:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:49:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:49:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:49:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4263, 2024-05-30T06:49:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 17735686624, 2024-05-30T06:49:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 35876265984, 2024-05-30T06:49:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 737217847296, 2024-05-30T06:49:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:49:59.654 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 4606, 2024-05-30T06:49:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:49:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 1 2024-05-30T06:49:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:49:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 38, 2024-05-30T06:49:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4, 2024-05-30T06:49:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:49:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:49:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:49:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:49:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:49:59.655 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 4, 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6055 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:49:59.656 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:49:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:49:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:49:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:49:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:49:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 10, 2024-05-30T06:49:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:49:42.776273+0000", 2024-05-30T06:49:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:49:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:49:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "0c673918-505c-43b2-ac62-86da33d8d10b": { 2024-05-30T06:49:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 9.0 seconds before exiting (35s)\n [============================] ", 2024-05-30T06:49:59.657 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:49:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:49:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:49:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: "8c2a545f-d3da-46a4-bf90-e6e248c7dcb3": { 2024-05-30T06:49:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 9.0 seconds before exiting (41s)\n [============================] ", 2024-05-30T06:49:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:49:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:49:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:59.658 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:49:59.658 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:49:59.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.653+0000 7f570b600640 1 -- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f56e0069010 msgr2=0x7f56e006b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:59.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.653+0000 7f570b600640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f56e0069010 0x7f56e006b4d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f56f40ac000 tx=0x7f56f40a6000 comp rx=0 tx=0).stop 2024-05-30T06:49:59.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.653+0000 7f570b600640 1 -- 172.21.15.37:0/4284706623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704144bf0 msgr2=0x7f57041faca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:49:59.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.653+0000 7f570b600640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704144bf0 0x7f57041faca0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00e7b0 tx=0x7f56ec00ec70 comp rx=0 tx=0).stop 2024-05-30T06:49:59.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.653+0000 7f570b600640 1 -- 172.21.15.37:0/4284706623 shutdown_connections 2024-05-30T06:49:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.653+0000 7f570b600640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5704145070 0x7f57041fb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.653+0000 7f570b600640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704144bf0 0x7f57041faca0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.653+0000 7f570b600640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f56e0069010 0x7f56e006b4d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.653+0000 7f570b600640 1 --2- 172.21.15.37:0/4284706623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56e8003b80 0x7f570415e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:49:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.653+0000 7f570b600640 1 -- 172.21.15.37:0/4284706623 >> 172.21.15.37:0/4284706623 conn(0x7f57040b23a0 msgr2=0x7f57040b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:49:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.653+0000 7f570b600640 1 -- 172.21.15.37:0/4284706623 shutdown_connections 2024-05-30T06:49:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:49:59.653+0000 7f570b600640 1 -- 172.21.15.37:0/4284706623 wait complete. 2024-05-30T06:50:04.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:50:04.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:50:04.723 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:50:04.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.825+0000 7f9c44400640 1 Processor -- start 2024-05-30T06:50:04.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.825+0000 7f9c44400640 1 -- start start 2024-05-30T06:50:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.825+0000 7f9c44400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c3c06e000 0x7f9c3c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.825+0000 7f9c44400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9c3c15cd80 0x7f9c3c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.825+0000 7f9c44400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9c3c0cec40 0x7f9c3c06e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.825+0000 7f9c44400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9c3c0a9530 con 0x7f9c3c0cec40 2024-05-30T06:50:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.825+0000 7f9c44400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9c3c0cd120 con 0x7f9c3c15cd80 2024-05-30T06:50:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.825+0000 7f9c44400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3c0cd400 con 0x7f9c3c06e000 2024-05-30T06:50:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.825+0000 7f9c42400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9c3c0cec40 0x7f9c3c06e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.825+0000 7f9c42400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9c3c0cec40 0x7f9c3c06e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50032/0 (socket says 172.21.15.37:50032) 2024-05-30T06:50:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.825+0000 7f9c42400640 1 -- 172.21.15.37:0/3501812009 learned_addr learned my addr 172.21.15.37:0/3501812009 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.829+0000 7f9c41a00640 1 --2- 172.21.15.37:0/3501812009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c3c06e000 0x7f9c3c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.829+0000 7f9c42400640 1 -- 172.21.15.37:0/3501812009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c3c06e000 msgr2=0x7f9c3c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.829+0000 7f9c41000640 1 --2- 172.21.15.37:0/3501812009 >> v2:172.21.15.105:3300/0 conn(0x7f9c3c15cd80 0x7f9c3c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.829+0000 7f9c42400640 1 --2- 172.21.15.37:0/3501812009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c3c06e000 0x7f9c3c0ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.829+0000 7f9c42400640 1 -- 172.21.15.37:0/3501812009 >> v2:172.21.15.105:3300/0 conn(0x7f9c3c15cd80 msgr2=0x7f9c3c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.829+0000 7f9c42400640 1 --2- 172.21.15.37:0/3501812009 >> v2:172.21.15.105:3300/0 conn(0x7f9c3c15cd80 0x7f9c3c0ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.829+0000 7f9c42400640 1 -- 172.21.15.37:0/3501812009 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3c0cd6e0 con 0x7f9c3c0cec40 2024-05-30T06:50:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.829+0000 7f9c41a00640 1 --2- 172.21.15.37:0/3501812009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c3c06e000 0x7f9c3c0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.829+0000 7f9c41000640 1 --2- 172.21.15.37:0/3501812009 >> v2:172.21.15.105:3300/0 conn(0x7f9c3c15cd80 0x7f9c3c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.829+0000 7f9c42400640 1 --2- 172.21.15.37:0/3501812009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c3c0cec40 0x7f9c3c06e3e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0b5b70 tx=0x7f9c3401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3803be141b91d1f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:04.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.829+0000 7f9c3be00640 1 -- 172.21.15.37:0/3501812009 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c340b5070 con 0x7f9c3c0cec40 2024-05-30T06:50:04.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.829+0000 7f9c3be00640 1 -- 172.21.15.37:0/3501812009 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c340a89d0 con 0x7f9c3c0cec40 2024-05-30T06:50:04.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.829+0000 7f9c3be00640 1 -- 172.21.15.37:0/3501812009 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c340a8da0 con 0x7f9c3c0cec40 2024-05-30T06:50:04.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 -- 172.21.15.37:0/3501812009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c3c0cec40 msgr2=0x7f9c3c06e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:04.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 --2- 172.21.15.37:0/3501812009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c3c0cec40 0x7f9c3c06e3e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c0b5b70 tx=0x7f9c3401ed10 comp rx=0 tx=0).stop 2024-05-30T06:50:04.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 -- 172.21.15.37:0/3501812009 shutdown_connections 2024-05-30T06:50:04.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 --2- 172.21.15.37:0/3501812009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c3c0cec40 0x7f9c3c06e3e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:04.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 --2- 172.21.15.37:0/3501812009 >> v2:172.21.15.105:3300/0 conn(0x7f9c3c15cd80 0x7f9c3c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:04.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 --2- 172.21.15.37:0/3501812009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c3c06e000 0x7f9c3c0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:04.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 -- 172.21.15.37:0/3501812009 >> 172.21.15.37:0/3501812009 conn(0x7f9c3c0b23a0 msgr2=0x7f9c3c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:04.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 -- 172.21.15.37:0/3501812009 shutdown_connections 2024-05-30T06:50:04.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 -- 172.21.15.37:0/3501812009 wait complete. 2024-05-30T06:50:04.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 Processor -- start 2024-05-30T06:50:04.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 -- start start 2024-05-30T06:50:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c3c06e000 0x7f9c3c1f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c3c0cec40 0x7f9c3c13be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c3c15cd80 0x7f9c3c15d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3c0cf0a0 con 0x7f9c3c06e000 2024-05-30T06:50:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3c0cdca0 con 0x7f9c3c15cd80 2024-05-30T06:50:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c44400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3c06e920 con 0x7f9c3c0cec40 2024-05-30T06:50:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c41a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c3c06e000 0x7f9c3c1f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c41a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c3c06e000 0x7f9c3c1f56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50042/0 (socket says 172.21.15.37:50042) 2024-05-30T06:50:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c41a00640 1 -- 172.21.15.37:0/557524837 learned_addr learned my addr 172.21.15.37:0/557524837 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c41000640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c3c0cec40 0x7f9c3c13be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c42400640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c3c15cd80 0x7f9c3c15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c41a00640 1 -- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c3c0cec40 msgr2=0x7f9c3c13be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c41a00640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c3c0cec40 0x7f9c3c13be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c41a00640 1 -- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c3c15cd80 msgr2=0x7f9c3c15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c41a00640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c3c15cd80 0x7f9c3c15d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.833+0000 7f9c41a00640 1 -- 172.21.15.37:0/557524837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3c1f5340 con 0x7f9c3c06e000 2024-05-30T06:50:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.837+0000 7f9c41a00640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c3c06e000 0x7f9c3c1f56b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000ce60 tx=0x7f9c3000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.837+0000 7f9c39600640 1 -- 172.21.15.37:0/557524837 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3000f890 con 0x7f9c3c06e000 2024-05-30T06:50:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.837+0000 7f9c39600640 1 -- 172.21.15.37:0/557524837 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3000fa30 con 0x7f9c3c06e000 2024-05-30T06:50:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.837+0000 7f9c39600640 1 -- 172.21.15.37:0/557524837 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3000fe20 con 0x7f9c3c06e000 2024-05-30T06:50:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.837+0000 7f9c44400640 1 -- 172.21.15.37:0/557524837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3c159a10 con 0x7f9c3c06e000 2024-05-30T06:50:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.837+0000 7f9c44400640 1 -- 172.21.15.37:0/557524837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c3c13c370 con 0x7f9c3c06e000 2024-05-30T06:50:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.837+0000 7f9c44400640 1 -- 172.21.15.37:0/557524837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c3c068b20 con 0x7f9c3c06e000 2024-05-30T06:50:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.837+0000 7f9c39600640 1 -- 172.21.15.37:0/557524837 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 89109+0+0 (secure 0 0 0) 0x7f9c30018400 con 0x7f9c3c06e000 2024-05-30T06:50:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.837+0000 7f9c39600640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9c1c068fe0 0x7f9c1c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.837+0000 7f9c39600640 1 -- 172.21.15.37:0/557524837 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f9c30086340 con 0x7f9c3c06e000 2024-05-30T06:50:04.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.837+0000 7f9c41000640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9c1c068fe0 0x7f9c1c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:04.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.841+0000 7f9c41000640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9c1c068fe0 0x7f9c1c06b4a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c1f20e0 tx=0x7f9c28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:04.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:04.841+0000 7f9c39600640 1 -- 172.21.15.37:0/557524837 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c30014030 con 0x7f9c3c06e000 2024-05-30T06:50:05.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c44400640 1 -- 172.21.15.37:0/557524837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f9c3c0b32a0 con 0x7f9c3c06e000 2024-05-30T06:50:05.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c39600640 1 -- 172.21.15.37:0/557524837 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2331 (secure 0 0 0) 0x7f9c3000ae20 con 0x7f9c3c06e000 2024-05-30T06:50:05.065 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:05.065 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:50:05.066 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:50:05.066 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:50:05.066 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:50:05.066 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:50:05.066 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:50:05.066 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:05.066 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:50:05.066 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:50:05.066 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:50:05.066 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:50:05.066 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:50:05.066 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:50:05.066 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:50:05.067 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:50:05.067 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:50:05.067 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:50:05.067 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:50:05.067 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 499, 2024-05-30T06:50:05.067 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:50:05.067 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:50:05.067 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:50:05.067 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:50:05.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:05.067 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:50:05.067 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 60, 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:05.068 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:50:05.069 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:50:05.069 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:50:05.069 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4263, 2024-05-30T06:50:05.069 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 17735686624, 2024-05-30T06:50:05.069 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 35876265984, 2024-05-30T06:50:05.069 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 737217847296, 2024-05-30T06:50:05.069 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:50:05.069 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 1876, 2024-05-30T06:50:05.069 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:50:05.069 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:50:05.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:05.069 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:50:05.069 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 38, 2024-05-30T06:50:05.070 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4, 2024-05-30T06:50:05.070 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:50:05.070 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:50:05.070 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:50:05.070 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:50:05.070 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:05.070 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 4, 2024-05-30T06:50:05.070 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:50:05.070 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:50:05.070 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:50:05.070 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6055 2024-05-30T06:50:05.070 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:05.071 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:50:05.071 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:50:05.071 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:05.071 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:50:05.071 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:50:05.071 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:50:05.071 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:50:05.071 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:50:05.071 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:50:05.071 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:50:05.071 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 10, 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:49:42.776273+0000", 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: "0c673918-505c-43b2-ac62-86da33d8d10b": { 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 5.0 seconds before exiting (39s)\n [============================] ", 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:05.072 INFO:teuthology.orchestra.run.smithi037.stdout: "8c2a545f-d3da-46a4-bf90-e6e248c7dcb3": { 2024-05-30T06:50:05.073 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 5.0 seconds before exiting (45s)\n [============================] ", 2024-05-30T06:50:05.073 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:50:05.073 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:50:05.073 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:05.073 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:05.073 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:50:05.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c44400640 1 -- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9c1c068fe0 msgr2=0x7f9c1c06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:05.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c44400640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9c1c068fe0 0x7f9c1c06b4a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c1f20e0 tx=0x7f9c28008040 comp rx=0 tx=0).stop 2024-05-30T06:50:05.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c44400640 1 -- 172.21.15.37:0/557524837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c3c06e000 msgr2=0x7f9c3c1f56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:05.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c44400640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c3c06e000 0x7f9c3c1f56b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000ce60 tx=0x7f9c3000a650 comp rx=0 tx=0).stop 2024-05-30T06:50:05.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c44400640 1 -- 172.21.15.37:0/557524837 shutdown_connections 2024-05-30T06:50:05.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c44400640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9c1c068fe0 0x7f9c1c06b4a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:05.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c44400640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c3c15cd80 0x7f9c3c15d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:05.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c44400640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c3c0cec40 0x7f9c3c13be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:05.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c44400640 1 --2- 172.21.15.37:0/557524837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c3c06e000 0x7f9c3c1f56b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:05.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c44400640 1 -- 172.21.15.37:0/557524837 >> 172.21.15.37:0/557524837 conn(0x7f9c3c0b23a0 msgr2=0x7f9c3c0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:05.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c44400640 1 -- 172.21.15.37:0/557524837 shutdown_connections 2024-05-30T06:50:05.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:05.065+0000 7f9c44400640 1 -- 172.21.15.37:0/557524837 wait complete. 2024-05-30T06:50:10.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:50:10.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.241+0000 7f09f9000640 1 Processor -- start 2024-05-30T06:50:10.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.241+0000 7f09f9000640 1 -- start start 2024-05-30T06:50:10.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.241+0000 7f09f9000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f09f406ef30 0x7f09f406f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:10.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.241+0000 7f09f9000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f4072e30 con 0x7f09f4144f00 2024-05-30T06:50:10.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.241+0000 7f09f9000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09f40cdc60 con 0x7f09f40cd080 2024-05-30T06:50:10.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.241+0000 7f09f9000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f09f406f8d0 con 0x7f09f406ef30 2024-05-30T06:50:10.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.241+0000 7f09f3400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f09f4144f00 0x7f09f40b4910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38734/0 (socket says 172.21.15.37:38734) 2024-05-30T06:50:10.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.241+0000 7f09f3400640 1 -- 172.21.15.37:0/140520198 learned_addr learned my addr 172.21.15.37:0/140520198 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.245+0000 7f09ebe00640 1 --2- 172.21.15.37:0/140520198 >> v2:172.21.15.105:3300/0 conn(0x7f09f406ef30 0x7f09f406f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.245+0000 7f09f2a00640 1 -- 172.21.15.37:0/140520198 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588134626 0 0) 0x7f09e4001120 con 0x7f09f4144f00 2024-05-30T06:50:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.245+0000 7f09f2a00640 1 -- 172.21.15.37:0/140520198 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09d8005740 con 0x7f09f4144f00 2024-05-30T06:50:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.245+0000 7f09ebe00640 1 -- 172.21.15.37:0/140520198 >> v1:172.21.15.105:6789/0 conn(0x7f09f40cd080 legacy=0x7f09f415ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.245+0000 7f09ebe00640 1 -- 172.21.15.37:0/140520198 >> v1:172.21.15.37:6789/0 conn(0x7f09f4144f00 legacy=0x7f09f40b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:10.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.245+0000 7f09ebe00640 1 -- 172.21.15.37:0/140520198 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f40b3b50 con 0x7f09f406ef30 2024-05-30T06:50:10.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.245+0000 7f09ebe00640 1 --2- 172.21.15.37:0/140520198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09f406ef30 0x7f09f406f390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f09dc0097c0 tx=0x7f09dc01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15cdc8d51b416496 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:10.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.245+0000 7f09f2a00640 1 -- 172.21.15.37:0/140520198 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0b0070 con 0x7f09f406ef30 2024-05-30T06:50:10.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.245+0000 7f09f2a00640 1 -- 172.21.15.37:0/140520198 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09dc0ab600 con 0x7f09f406ef30 2024-05-30T06:50:10.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.245+0000 7f09f2a00640 1 -- 172.21.15.37:0/140520198 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0ab9b0 con 0x7f09f406ef30 2024-05-30T06:50:10.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 -- 172.21.15.37:0/140520198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09f406ef30 msgr2=0x7f09f406f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:10.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 --2- 172.21.15.37:0/140520198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09f406ef30 0x7f09f406f390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f09dc0097c0 tx=0x7f09dc01c3e0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 -- 172.21.15.37:0/140520198 shutdown_connections 2024-05-30T06:50:10.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 --2- 172.21.15.37:0/140520198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09f406ef30 0x7f09f406f390 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 -- 172.21.15.37:0/140520198 >> 172.21.15.37:0/140520198 conn(0x7f09f40b2120 msgr2=0x7f09f40b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 -- 172.21.15.37:0/140520198 shutdown_connections 2024-05-30T06:50:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 -- 172.21.15.37:0/140520198 wait complete. 2024-05-30T06:50:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 Processor -- start 2024-05-30T06:50:10.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 -- start start 2024-05-30T06:50:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09f406ef30 0x7f09f40b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09f40cd080 0x7f09f415acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f4144f00 0x7f09f41fafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40cd8a0 con 0x7f09f4144f00 2024-05-30T06:50:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f09f415c5a0 con 0x7f09f40cd080 2024-05-30T06:50:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f9000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f09f40cda20 con 0x7f09f406ef30 2024-05-30T06:50:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f4144f00 0x7f09f41fafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f4144f00 0x7f09f41fafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40722/0 (socket says 172.21.15.37:40722) 2024-05-30T06:50:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f3e00640 1 -- 172.21.15.37:0/4141737127 learned_addr learned my addr 172.21.15.37:0/4141737127 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09ebe00640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09f40cd080 0x7f09f415acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f3400640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09f406ef30 0x7f09f40b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f3e00640 1 -- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09f406ef30 msgr2=0x7f09f40b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f3e00640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09f406ef30 0x7f09f40b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f3e00640 1 -- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09f40cd080 msgr2=0x7f09f415acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f3e00640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09f40cd080 0x7f09f415acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.249+0000 7f09f3e00640 1 -- 172.21.15.37:0/4141737127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f4159c10 con 0x7f09f4144f00 2024-05-30T06:50:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.253+0000 7f09f3e00640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f4144f00 0x7f09f41fafc0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c770 tx=0x7f09ec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.253+0000 7f09eb400640 1 -- 172.21.15.37:0/4141737127 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec003b80 con 0x7f09f4144f00 2024-05-30T06:50:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.253+0000 7f09eb400640 1 -- 172.21.15.37:0/4141737127 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09ec003d20 con 0x7f09f4144f00 2024-05-30T06:50:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.253+0000 7f09eb400640 1 -- 172.21.15.37:0/4141737127 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00aa90 con 0x7f09f4144f00 2024-05-30T06:50:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.253+0000 7f09f9000640 1 -- 172.21.15.37:0/4141737127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f4159ef0 con 0x7f09f4144f00 2024-05-30T06:50:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.253+0000 7f09f9000640 1 -- 172.21.15.37:0/4141737127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f415a4b0 con 0x7f09f4144f00 2024-05-30T06:50:10.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.253+0000 7f09f9000640 1 -- 172.21.15.37:0/4141737127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f4068ab0 con 0x7f09f4144f00 2024-05-30T06:50:10.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.253+0000 7f09eb400640 1 -- 172.21.15.37:0/4141737127 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 89109+0+0 (secure 0 0 0) 0x7f09ec00ac30 con 0x7f09f4144f00 2024-05-30T06:50:10.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.253+0000 7f09eb400640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f09d0068fe0 0x7f09d006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:10.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.253+0000 7f09eb400640 1 -- 172.21.15.37:0/4141737127 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f09ec085210 con 0x7f09f4144f00 2024-05-30T06:50:10.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.253+0000 7f09f3400640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f09d0068fe0 0x7f09d006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:10.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.257+0000 7f09f3400640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f09d0068fe0 0x7f09d006b4a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f09e40012c0 tx=0x7f09e4007b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:10.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.257+0000 7f09eb400640 1 -- 172.21.15.37:0/4141737127 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f09ec056b50 con 0x7f09f4144f00 2024-05-30T06:50:10.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09f9000640 1 -- 172.21.15.37:0/4141737127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f09f40b10b0 con 0x7f09f4144f00 2024-05-30T06:50:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09eb400640 1 -- 172.21.15.37:0/4141737127 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1824 (secure 0 0 0) 0x7f09ec05ae50 con 0x7f09f4144f00 2024-05-30T06:50:10.482 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:10.482 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:50:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:50:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:50:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:50:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:50:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:50:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:50:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:50:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:50:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:50:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:50:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:50:10.484 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:50:10.484 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:50:10.484 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:50:10.484 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:50:10.484 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:50:10.484 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 504, 2024-05-30T06:50:10.484 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:50:10.484 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:50:10.484 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:50:10.485 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:50:10.485 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.485 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:50:10.485 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 60, 2024-05-30T06:50:10.485 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:50:10.485 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:50:10.485 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:50:10.485 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:50:10.485 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:50:10.485 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:50:10.485 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.485 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:50:10.485 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:50:10.486 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:10.486 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:50:10.486 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:50:10.486 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:10.486 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:50:10.486 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:50:10.486 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:50:10.486 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4263, 2024-05-30T06:50:10.487 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 17735688239, 2024-05-30T06:50:10.487 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 35876265984, 2024-05-30T06:50:10.487 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 737217847296, 2024-05-30T06:50:10.487 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:50:10.487 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 255, 2024-05-30T06:50:10.487 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:50:10.487 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:50:10.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.487 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:50:10.487 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 38, 2024-05-30T06:50:10.488 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4, 2024-05-30T06:50:10.488 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:50:10.488 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:50:10.488 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:50:10.488 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:50:10.488 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:10.488 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 4, 2024-05-30T06:50:10.488 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:50:10.488 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:50:10.488 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:50:10.488 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6055 2024-05-30T06:50:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:50:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:50:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:50:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:50:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:50:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:50:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:50:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:50:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:50:10.489 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:50:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:50:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:50:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 10, 2024-05-30T06:50:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:49:42.776273+0000", 2024-05-30T06:50:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:50:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.490 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": {} 2024-05-30T06:50:10.490 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:50:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09f9000640 1 -- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f09d0068fe0 msgr2=0x7f09d006b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09f9000640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f09d0068fe0 0x7f09d006b4a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f09e40012c0 tx=0x7f09e4007b80 comp rx=0 tx=0).stop 2024-05-30T06:50:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09f9000640 1 -- 172.21.15.37:0/4141737127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f4144f00 msgr2=0x7f09f41fafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09f9000640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f4144f00 0x7f09f41fafc0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c770 tx=0x7f09ec00cc30 comp rx=0 tx=0).stop 2024-05-30T06:50:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09f9000640 1 -- 172.21.15.37:0/4141737127 shutdown_connections 2024-05-30T06:50:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09f9000640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f4144f00 0x7f09f41fafc0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09f9000640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f09d0068fe0 0x7f09d006b4a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09f9000640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09f40cd080 0x7f09f415acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09f9000640 1 --2- 172.21.15.37:0/4141737127 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09f406ef30 0x7f09f40b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09f9000640 1 -- 172.21.15.37:0/4141737127 >> 172.21.15.37:0/4141737127 conn(0x7f09f40b2120 msgr2=0x7f09f40cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:10.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09f9000640 1 -- 172.21.15.37:0/4141737127 shutdown_connections 2024-05-30T06:50:10.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.481+0000 7f09f9000640 1 -- 172.21.15.37:0/4141737127 wait complete. 2024-05-30T06:50:10.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T06:50:10.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.649+0000 7f20eb200640 1 Processor -- start 2024-05-30T06:50:10.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.649+0000 7f20eb200640 1 -- start start 2024-05-30T06:50:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.649+0000 7f20eb200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20e40cd440 0x7f20e406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.649+0000 7f20eb200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20e415f310 con 0x7f20e4155da0 2024-05-30T06:50:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.649+0000 7f20eb200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20e415f5f0 con 0x7f20e406f5a0 2024-05-30T06:50:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.649+0000 7f20eb200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f20e406fa10 con 0x7f20e40cd440 2024-05-30T06:50:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.649+0000 7f20db400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20e40cd440 0x7f20e406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.649+0000 7f20e3e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f20e4155da0 0x7f20e40cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38736/0 (socket says 172.21.15.37:38736) 2024-05-30T06:50:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.649+0000 7f20e3e00640 1 -- 172.21.15.37:0/1046250135 learned_addr learned my addr 172.21.15.37:0/1046250135 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:10.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.649+0000 7f20db400640 1 -- 172.21.15.37:0/1046250135 >> v1:172.21.15.105:6789/0 conn(0x7f20e406f5a0 legacy=0x7f20e40b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:10.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.649+0000 7f20db400640 1 -- 172.21.15.37:0/1046250135 >> v1:172.21.15.37:6789/0 conn(0x7f20e4155da0 legacy=0x7f20e40cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:10.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.649+0000 7f20db400640 1 -- 172.21.15.37:0/1046250135 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e415f8d0 con 0x7f20e40cd440 2024-05-30T06:50:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.653+0000 7f20db400640 1 --2- 172.21.15.37:0/1046250135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e40cd440 0x7f20e406f060 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0097c0 tx=0x7f20cc01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a254ac5a410ae6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.653+0000 7f20e3400640 1 -- 172.21.15.37:0/1046250135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0b0070 con 0x7f20e40cd440 2024-05-30T06:50:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.653+0000 7f20e3400640 1 -- 172.21.15.37:0/1046250135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20cc0ab600 con 0x7f20e40cd440 2024-05-30T06:50:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.653+0000 7f20e3400640 1 -- 172.21.15.37:0/1046250135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0ab9d0 con 0x7f20e40cd440 2024-05-30T06:50:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.653+0000 7f20eb200640 1 -- 172.21.15.37:0/1046250135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e40cd440 msgr2=0x7f20e406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.653+0000 7f20eb200640 1 --2- 172.21.15.37:0/1046250135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e40cd440 0x7f20e406f060 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0097c0 tx=0x7f20cc01c340 comp rx=0 tx=0).stop 2024-05-30T06:50:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.653+0000 7f20eb200640 1 -- 172.21.15.37:0/1046250135 shutdown_connections 2024-05-30T06:50:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.653+0000 7f20eb200640 1 --2- 172.21.15.37:0/1046250135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e40cd440 0x7f20e406f060 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.653+0000 7f20eb200640 1 -- 172.21.15.37:0/1046250135 >> 172.21.15.37:0/1046250135 conn(0x7f20e406bf60 msgr2=0x7f20e40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.653+0000 7f20eb200640 1 -- 172.21.15.37:0/1046250135 shutdown_connections 2024-05-30T06:50:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.653+0000 7f20eb200640 1 -- 172.21.15.37:0/1046250135 wait complete. 2024-05-30T06:50:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20eb200640 1 Processor -- start 2024-05-30T06:50:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20eb200640 1 -- start start 2024-05-30T06:50:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20eb200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20e406f5a0 0x7f20e4143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20eb200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e4155da0 0x7f20e40cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20eb200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20e41438f0 0x7f20e4071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20eb200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20e4169920 con 0x7f20e4155da0 2024-05-30T06:50:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20eb200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20e41697a0 con 0x7f20e406f5a0 2024-05-30T06:50:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20eb200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f20e4169aa0 con 0x7f20e41438f0 2024-05-30T06:50:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20db400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e4155da0 0x7f20e40cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20db400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e4155da0 0x7f20e40cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40754/0 (socket says 172.21.15.37:40754) 2024-05-30T06:50:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20db400640 1 -- 172.21.15.37:0/3955796676 learned_addr learned my addr 172.21.15.37:0/3955796676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20e3e00640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20e406f5a0 0x7f20e4143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20e9200640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20e41438f0 0x7f20e4071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20db400640 1 -- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20e41438f0 msgr2=0x7f20e4071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20db400640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20e41438f0 0x7f20e4071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20db400640 1 -- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20e406f5a0 msgr2=0x7f20e4143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20db400640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20e406f5a0 0x7f20e4143230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20db400640 1 -- 172.21.15.37:0/3955796676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e4143d80 con 0x7f20e4155da0 2024-05-30T06:50:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20e3e00640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20e406f5a0 0x7f20e4143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20db400640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e4155da0 0x7f20e40cc8b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f20cc018f50 tx=0x7f20cc0190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20e0c00640 1 -- 172.21.15.37:0/3955796676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0b8030 con 0x7f20e4155da0 2024-05-30T06:50:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20e0c00640 1 -- 172.21.15.37:0/3955796676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20cc0b4410 con 0x7f20e4155da0 2024-05-30T06:50:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20eb200640 1 -- 172.21.15.37:0/3955796676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e4144060 con 0x7f20e4155da0 2024-05-30T06:50:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20e0c00640 1 -- 172.21.15.37:0/3955796676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0b0040 con 0x7f20e4155da0 2024-05-30T06:50:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20eb200640 1 -- 172.21.15.37:0/3955796676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e4144620 con 0x7f20e4155da0 2024-05-30T06:50:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.657+0000 7f20eb200640 1 -- 172.21.15.37:0/3955796676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e4068bc0 con 0x7f20e4155da0 2024-05-30T06:50:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.661+0000 7f20e0c00640 1 -- 172.21.15.37:0/3955796676 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 89109+0+0 (secure 0 0 0) 0x7f20cc0bb070 con 0x7f20e4155da0 2024-05-30T06:50:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.661+0000 7f20e0c00640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20c0069010 0x7f20c006b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.661+0000 7f20e0c00640 1 -- 172.21.15.37:0/3955796676 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f20cc11ece0 con 0x7f20e4155da0 2024-05-30T06:50:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.661+0000 7f20e3e00640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20c0069010 0x7f20c006b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.661+0000 7f20e3e00640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20c0069010 0x7f20c006b4d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f20d4000f70 tx=0x7f20d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:10.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.665+0000 7f20e0c00640 1 -- 172.21.15.37:0/3955796676 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f20cc0c2070 con 0x7f20e4155da0 2024-05-30T06:50:10.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.857+0000 7f20eb200640 1 -- 172.21.15.37:0/3955796676 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20e40b6790 con 0x7f20c0069010 2024-05-30T06:50:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.865+0000 7f20e0c00640 1 -- 172.21.15.37:0/3955796676 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+381 (secure 0 0 0) 0x7f20e40b6790 con 0x7f20c0069010 2024-05-30T06:50:10.866 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:10.866 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:50:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sv1" 2024-05-30T06:50:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone18544" 2024-05-30T06:50:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone18546" 2024-05-30T06:50:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone18547" 2024-05-30T06:50:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:10.868 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone18542" 2024-05-30T06:50:10.868 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.868 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:10.869 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone18545" 2024-05-30T06:50:10.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.869 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:10.869 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone18541" 2024-05-30T06:50:10.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:10.869 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:10.869 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone18543" 2024-05-30T06:50:10.869 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:10.869 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:50:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.865+0000 7f20eb200640 1 -- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20c0069010 msgr2=0x7f20c006b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.865+0000 7f20eb200640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20c0069010 0x7f20c006b4d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f20d4000f70 tx=0x7f20d4009040 comp rx=0 tx=0).stop 2024-05-30T06:50:10.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.865+0000 7f20eb200640 1 -- 172.21.15.37:0/3955796676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e4155da0 msgr2=0x7f20e40cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.865+0000 7f20eb200640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e4155da0 0x7f20e40cc8b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f20cc018f50 tx=0x7f20cc0190e0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.865+0000 7f20eb200640 1 -- 172.21.15.37:0/3955796676 shutdown_connections 2024-05-30T06:50:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.865+0000 7f20eb200640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20e41438f0 0x7f20e4071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.865+0000 7f20eb200640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e4155da0 0x7f20e40cc8b0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.865+0000 7f20eb200640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20c0069010 0x7f20c006b4d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.865+0000 7f20eb200640 1 --2- 172.21.15.37:0/3955796676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20e406f5a0 0x7f20e4143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.865+0000 7f20eb200640 1 -- 172.21.15.37:0/3955796676 >> 172.21.15.37:0/3955796676 conn(0x7f20e406bf60 msgr2=0x7f20e4151dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.865+0000 7f20eb200640 1 -- 172.21.15.37:0/3955796676 shutdown_connections 2024-05-30T06:50:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:10.865+0000 7f20eb200640 1 -- 172.21.15.37:0/3955796676 wait complete. 2024-05-30T06:50:10.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T06:50:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.033+0000 7f9cf0a00640 1 Processor -- start 2024-05-30T06:50:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.033+0000 7f9cf0a00640 1 -- start start 2024-05-30T06:50:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.033+0000 7f9cf0a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9cec0ced10 0x7f9cec06ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.033+0000 7f9cf0a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cec15db00 con 0x7f9cec0b59d0 2024-05-30T06:50:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.033+0000 7f9cf0a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cec06e180 con 0x7f9cec15d4e0 2024-05-30T06:50:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.033+0000 7f9cf0a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9cec06df50 con 0x7f9cec0ced10 2024-05-30T06:50:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.033+0000 7f9ce9e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9cec0ced10 0x7f9cec06ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.033+0000 7f9ce3e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9cec0b59d0 0x7f9cec15cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38752/0 (socket says 172.21.15.37:38752) 2024-05-30T06:50:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.033+0000 7f9ce3e00640 1 -- 172.21.15.37:0/2020671773 learned_addr learned my addr 172.21.15.37:0/2020671773 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.033+0000 7f9ce9e00640 1 -- 172.21.15.37:0/2020671773 >> v1:172.21.15.105:6789/0 conn(0x7f9cec15d4e0 legacy=0x7f9cec15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.033+0000 7f9ce9e00640 1 -- 172.21.15.37:0/2020671773 >> v1:172.21.15.37:6789/0 conn(0x7f9cec0b59d0 legacy=0x7f9cec15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.033+0000 7f9ce9e00640 1 -- 172.21.15.37:0/2020671773 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cec06e460 con 0x7f9cec0ced10 2024-05-30T06:50:11.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.037+0000 7f9ce9e00640 1 --2- 172.21.15.37:0/2020671773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cec0ced10 0x7f9cec06ec60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0097c0 tx=0x7f9cdc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49ec6ba559955d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:11.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.037+0000 7f9ce9400640 1 -- 172.21.15.37:0/2020671773 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0b0070 con 0x7f9cec0ced10 2024-05-30T06:50:11.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.037+0000 7f9ce9400640 1 -- 172.21.15.37:0/2020671773 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cdc0ab600 con 0x7f9cec0ced10 2024-05-30T06:50:11.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.037+0000 7f9ce9400640 1 -- 172.21.15.37:0/2020671773 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0ab9d0 con 0x7f9cec0ced10 2024-05-30T06:50:11.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.037+0000 7f9cf0a00640 1 -- 172.21.15.37:0/2020671773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cec0ced10 msgr2=0x7f9cec06ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.037+0000 7f9cf0a00640 1 --2- 172.21.15.37:0/2020671773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cec0ced10 0x7f9cec06ec60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0097c0 tx=0x7f9cdc01c4a0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.037+0000 7f9cf0a00640 1 -- 172.21.15.37:0/2020671773 shutdown_connections 2024-05-30T06:50:11.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.037+0000 7f9cf0a00640 1 --2- 172.21.15.37:0/2020671773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cec0ced10 0x7f9cec06ec60 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.037+0000 7f9cf0a00640 1 -- 172.21.15.37:0/2020671773 >> 172.21.15.37:0/2020671773 conn(0x7f9cec06bf60 msgr2=0x7f9cec0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:11.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.037+0000 7f9cf0a00640 1 -- 172.21.15.37:0/2020671773 shutdown_connections 2024-05-30T06:50:11.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.037+0000 7f9cf0a00640 1 -- 172.21.15.37:0/2020671773 wait complete. 2024-05-30T06:50:11.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.037+0000 7f9cf0a00640 1 Processor -- start 2024-05-30T06:50:11.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.037+0000 7f9cf0a00640 1 -- start start 2024-05-30T06:50:11.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cf0a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9cec0b59d0 0x7f9cec155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cf0a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9cec0ced10 0x7f9cec1429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cf0a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cec15d4e0 0x7f9cec1676f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cf0a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec16adf0 con 0x7f9cec15d4e0 2024-05-30T06:50:11.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cf0a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec16ac70 con 0x7f9cec0ced10 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cf0a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9cec16af70 con 0x7f9cec0b59d0 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cea800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cec15d4e0 0x7f9cec1676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cea800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cec15d4e0 0x7f9cec1676f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40762/0 (socket says 172.21.15.37:40762) 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cea800640 1 -- 172.21.15.37:0/3289989667 learned_addr learned my addr 172.21.15.37:0/3289989667 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9ce3e00640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9cec0ced10 0x7f9cec1429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9ce9e00640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9cec0b59d0 0x7f9cec155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cea800640 1 -- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9cec0b59d0 msgr2=0x7f9cec155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cea800640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9cec0b59d0 0x7f9cec155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cea800640 1 -- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9cec0ced10 msgr2=0x7f9cec1429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cea800640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9cec0ced10 0x7f9cec1429d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cea800640 1 -- 172.21.15.37:0/3289989667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cec143420 con 0x7f9cec15d4e0 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cea800640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cec15d4e0 0x7f9cec1676f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c730 tx=0x7f9ce400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9ce2000640 1 -- 172.21.15.37:0/3289989667 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4003b80 con 0x7f9cec15d4e0 2024-05-30T06:50:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9ce2000640 1 -- 172.21.15.37:0/3289989667 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce4003d20 con 0x7f9cec15d4e0 2024-05-30T06:50:11.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9ce2000640 1 -- 172.21.15.37:0/3289989667 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce400aa30 con 0x7f9cec15d4e0 2024-05-30T06:50:11.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cf0a00640 1 -- 172.21.15.37:0/3289989667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cec143700 con 0x7f9cec15d4e0 2024-05-30T06:50:11.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cf0a00640 1 -- 172.21.15.37:0/3289989667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cec155180 con 0x7f9cec15d4e0 2024-05-30T06:50:11.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9cf0a00640 1 -- 172.21.15.37:0/3289989667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cec068d40 con 0x7f9cec15d4e0 2024-05-30T06:50:11.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.041+0000 7f9ce2000640 1 -- 172.21.15.37:0/3289989667 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 89109+0+0 (secure 0 0 0) 0x7f9ce400abd0 con 0x7f9cec15d4e0 2024-05-30T06:50:11.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.045+0000 7f9ce2000640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9cc8068fe0 0x7f9cc806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.045+0000 7f9ce2000640 1 -- 172.21.15.37:0/3289989667 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f9ce4085250 con 0x7f9cec15d4e0 2024-05-30T06:50:11.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.045+0000 7f9ce9e00640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9cc8068fe0 0x7f9cc806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.045+0000 7f9ce9e00640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9cc8068fe0 0x7f9cc806b4a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0ad000 tx=0x7f9cdc0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:11.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.049+0000 7f9ce2000640 1 -- 172.21.15.37:0/3289989667 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9ce4057260 con 0x7f9cec15d4e0 2024-05-30T06:50:11.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.241+0000 7f9cf0a00640 1 -- 172.21.15.37:0/3289989667 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9cec074f40 con 0x7f9cc8068fe0 2024-05-30T06:50:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.253+0000 7f9ce2000640 1 -- 172.21.15.37:0/3289989667 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9cec074f40 con 0x7f9cc8068fe0 2024-05-30T06:50:11.255 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:11.256 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:50:11.256 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:11.256 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ss1" 2024-05-30T06:50:11.256 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:11.256 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:50:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.257+0000 7f9cf0a00640 1 -- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9cc8068fe0 msgr2=0x7f9cc806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.257+0000 7f9cf0a00640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9cc8068fe0 0x7f9cc806b4a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0ad000 tx=0x7f9cdc0a6000 comp rx=0 tx=0).stop 2024-05-30T06:50:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.257+0000 7f9cf0a00640 1 -- 172.21.15.37:0/3289989667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cec15d4e0 msgr2=0x7f9cec1676f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.257+0000 7f9cf0a00640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cec15d4e0 0x7f9cec1676f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f9ce400c730 tx=0x7f9ce400cbf0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.257+0000 7f9cf0a00640 1 -- 172.21.15.37:0/3289989667 shutdown_connections 2024-05-30T06:50:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.257+0000 7f9cf0a00640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cec15d4e0 0x7f9cec1676f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.257+0000 7f9cf0a00640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9cc8068fe0 0x7f9cc806b4a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.257+0000 7f9cf0a00640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9cec0ced10 0x7f9cec1429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.257+0000 7f9cf0a00640 1 --2- 172.21.15.37:0/3289989667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9cec0b59d0 0x7f9cec155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.257+0000 7f9cf0a00640 1 -- 172.21.15.37:0/3289989667 >> 172.21.15.37:0/3289989667 conn(0x7f9cec06bf60 msgr2=0x7f9cec15ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.257+0000 7f9cf0a00640 1 -- 172.21.15.37:0/3289989667 shutdown_connections 2024-05-30T06:50:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.257+0000 7f9cf0a00640 1 -- 172.21.15.37:0/3289989667 wait complete. 2024-05-30T06:50:11.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T06:50:11.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.421+0000 7f95fe000640 1 Processor -- start 2024-05-30T06:50:11.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.421+0000 7f95fe000640 1 -- start start 2024-05-30T06:50:11.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95fe000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95f80b59d0 0x7f95f80b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95fe000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f95f815d350 0x7f95f8160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95fe000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95f815d7e0 0x7f95f81607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95fe000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f95f80b62f0 con 0x7f95f80b59d0 2024-05-30T06:50:11.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95fe000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f95f8142030 con 0x7f95f815d350 2024-05-30T06:50:11.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95fe000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f95f8142310 con 0x7f95f815d7e0 2024-05-30T06:50:11.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95f7400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95f80b59d0 0x7f95f80b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95f7400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95f80b59d0 0x7f95f80b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40776/0 (socket says 172.21.15.37:40776) 2024-05-30T06:50:11.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95f7400640 1 -- 172.21.15.37:0/1148663499 learned_addr learned my addr 172.21.15.37:0/1148663499 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:11.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95efe00640 1 --2- 172.21.15.37:0/1148663499 >> v2:172.21.15.105:3300/0 conn(0x7f95f815d350 0x7f95f8160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95f7e00640 1 --2- 172.21.15.37:0/1148663499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95f815d7e0 0x7f95f81607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95f7400640 1 -- 172.21.15.37:0/1148663499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95f815d7e0 msgr2=0x7f95f81607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:11.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95f7400640 1 --2- 172.21.15.37:0/1148663499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95f815d7e0 0x7f95f81607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95f7400640 1 -- 172.21.15.37:0/1148663499 >> v2:172.21.15.105:3300/0 conn(0x7f95f815d350 msgr2=0x7f95f8160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:11.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95f7400640 1 --2- 172.21.15.37:0/1148663499 >> v2:172.21.15.105:3300/0 conn(0x7f95f815d350 0x7f95f8160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.425+0000 7f95f7400640 1 -- 172.21.15.37:0/1148663499 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f81425f0 con 0x7f95f80b59d0 2024-05-30T06:50:11.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95f7400640 1 --2- 172.21.15.37:0/1148663499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f80b59d0 0x7f95f80b5db0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009870 tx=0x7f95e801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2103c7647c9cf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:11.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95f6a00640 1 -- 172.21.15.37:0/1148663499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e80b5070 con 0x7f95f80b59d0 2024-05-30T06:50:11.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95f6a00640 1 -- 172.21.15.37:0/1148663499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e80a89d0 con 0x7f95f80b59d0 2024-05-30T06:50:11.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95f6a00640 1 -- 172.21.15.37:0/1148663499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e80a8da0 con 0x7f95f80b59d0 2024-05-30T06:50:11.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 -- 172.21.15.37:0/1148663499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f80b59d0 msgr2=0x7f95f80b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 --2- 172.21.15.37:0/1148663499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f80b59d0 0x7f95f80b5db0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009870 tx=0x7f95e801ed10 comp rx=0 tx=0).stop 2024-05-30T06:50:11.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 -- 172.21.15.37:0/1148663499 shutdown_connections 2024-05-30T06:50:11.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 --2- 172.21.15.37:0/1148663499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95f815d7e0 0x7f95f81607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 --2- 172.21.15.37:0/1148663499 >> v2:172.21.15.105:3300/0 conn(0x7f95f815d350 0x7f95f8160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 --2- 172.21.15.37:0/1148663499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f80b59d0 0x7f95f80b5db0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 -- 172.21.15.37:0/1148663499 >> 172.21.15.37:0/1148663499 conn(0x7f95f806bf60 msgr2=0x7f95f80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:11.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 -- 172.21.15.37:0/1148663499 shutdown_connections 2024-05-30T06:50:11.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 -- 172.21.15.37:0/1148663499 wait complete. 2024-05-30T06:50:11.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 Processor -- start 2024-05-30T06:50:11.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 -- start start 2024-05-30T06:50:11.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f80b59d0 0x7f95f80b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95f815d350 0x7f95f813e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.429+0000 7f95fe000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95f815d7e0 0x7f95f813d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95fe000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95f813fe60 con 0x7f95f80b59d0 2024-05-30T06:50:11.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95fe000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95f813fce0 con 0x7f95f815d350 2024-05-30T06:50:11.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95fe000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f95f80aff20 con 0x7f95f815d7e0 2024-05-30T06:50:11.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95f7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f80b59d0 0x7f95f80b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95f7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f80b59d0 0x7f95f80b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40784/0 (socket says 172.21.15.37:40784) 2024-05-30T06:50:11.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95f7400640 1 -- 172.21.15.37:0/1073664320 learned_addr learned my addr 172.21.15.37:0/1073664320 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:11.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95f7e00640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95f815d7e0 0x7f95f813d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95efe00640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95f815d350 0x7f95f813e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95f7400640 1 -- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95f815d7e0 msgr2=0x7f95f813d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95f7400640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95f815d7e0 0x7f95f813d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95f7400640 1 -- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95f815d350 msgr2=0x7f95f813e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95f7400640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95f815d350 0x7f95f813e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95f7400640 1 -- 172.21.15.37:0/1073664320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f8155990 con 0x7f95f80b59d0 2024-05-30T06:50:11.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95f7e00640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95f815d7e0 0x7f95f813d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:11.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95efe00640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95f815d350 0x7f95f813e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:11.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95f7400640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f80b59d0 0x7f95f80b4e00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f95e801d3c0 tx=0x7f95e801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:11.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95ef400640 1 -- 172.21.15.37:0/1073664320 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e80b5040 con 0x7f95f80b59d0 2024-05-30T06:50:11.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95ef400640 1 -- 172.21.15.37:0/1073664320 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e80be070 con 0x7f95f80b59d0 2024-05-30T06:50:11.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95ef400640 1 -- 172.21.15.37:0/1073664320 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e80b0a00 con 0x7f95f80b59d0 2024-05-30T06:50:11.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95fe000640 1 -- 172.21.15.37:0/1073664320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f813e8e0 con 0x7f95f80b59d0 2024-05-30T06:50:11.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95fe000640 1 -- 172.21.15.37:0/1073664320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f813eea0 con 0x7f95f80b59d0 2024-05-30T06:50:11.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95fe000640 1 -- 172.21.15.37:0/1073664320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f8068bc0 con 0x7f95f80b59d0 2024-05-30T06:50:11.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.433+0000 7f95ef400640 1 -- 172.21.15.37:0/1073664320 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 89109+0+0 (secure 0 0 0) 0x7f95e80b0ba0 con 0x7f95f80b59d0 2024-05-30T06:50:11.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.437+0000 7f95ef400640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95d4068fe0 0x7f95d406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.437+0000 7f95ef400640 1 -- 172.21.15.37:0/1073664320 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f95e8122980 con 0x7f95f80b59d0 2024-05-30T06:50:11.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.437+0000 7f95efe00640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95d4068fe0 0x7f95d406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.437+0000 7f95efe00640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95d4068fe0 0x7f95d406b4a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f95e0004660 tx=0x7f95e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:11.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.441+0000 7f95ef400640 1 -- 172.21.15.37:0/1073664320 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f95f8155990 con 0x7f95f80b59d0 2024-05-30T06:50:11.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.645+0000 7f95fe000640 1 -- 172.21.15.37:0/1073664320 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f95f80757c0 con 0x7f95d4068fe0 2024-05-30T06:50:11.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.673+0000 7f95ef400640 1 -- 172.21.15.37:0/1073664320 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f95f80757c0 con 0x7f95d4068fe0 2024-05-30T06:50:11.675 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:11.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.677+0000 7f95fe000640 1 -- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95d4068fe0 msgr2=0x7f95d406b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.677+0000 7f95fe000640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95d4068fe0 0x7f95d406b4a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f95e0004660 tx=0x7f95e0008040 comp rx=0 tx=0).stop 2024-05-30T06:50:11.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.677+0000 7f95fe000640 1 -- 172.21.15.37:0/1073664320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f80b59d0 msgr2=0x7f95f80b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.677+0000 7f95fe000640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f80b59d0 0x7f95f80b4e00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f95e801d3c0 tx=0x7f95e801bab0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.677+0000 7f95fe000640 1 -- 172.21.15.37:0/1073664320 shutdown_connections 2024-05-30T06:50:11.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.677+0000 7f95fe000640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95f815d7e0 0x7f95f813d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.677+0000 7f95fe000640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95d4068fe0 0x7f95d406b4a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.677+0000 7f95fe000640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95f815d350 0x7f95f813e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.677+0000 7f95fe000640 1 --2- 172.21.15.37:0/1073664320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95f80b59d0 0x7f95f80b4e00 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.677+0000 7f95fe000640 1 -- 172.21.15.37:0/1073664320 >> 172.21.15.37:0/1073664320 conn(0x7f95f806bf60 msgr2=0x7f95f80726f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:11.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.677+0000 7f95fe000640 1 -- 172.21.15.37:0/1073664320 shutdown_connections 2024-05-30T06:50:11.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.677+0000 7f95fe000640 1 -- 172.21.15.37:0/1073664320 wait complete. 2024-05-30T06:50:11.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T06:50:11.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74e9e00640 1 Processor -- start 2024-05-30T06:50:11.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74e9e00640 1 -- start start 2024-05-30T06:50:11.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74e9e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f74e415d350 0x7f74e406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74e9e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e4142030 con 0x7f74e40b59d0 2024-05-30T06:50:11.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74e9e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e4142310 con 0x7f74e415d7e0 2024-05-30T06:50:11.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74e9e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f74e41425f0 con 0x7f74e415d350 2024-05-30T06:50:11.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74e2a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f74e40b59d0 0x7f74e40b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38764/0 (socket says 172.21.15.37:38764) 2024-05-30T06:50:11.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74e2a00640 1 -- 172.21.15.37:0/3598952685 learned_addr learned my addr 172.21.15.37:0/3598952685 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:11.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74da000640 1 --2- 172.21.15.37:0/3598952685 >> v2:172.21.15.105:3300/0 conn(0x7f74e415d350 0x7f74e406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74e2000640 1 -- 172.21.15.37:0/3598952685 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3689828130 0 0) 0x7f74e4142030 con 0x7f74e40b59d0 2024-05-30T06:50:11.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74e2000640 1 -- 172.21.15.37:0/3598952685 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74c8003530 con 0x7f74e40b59d0 2024-05-30T06:50:11.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74e2000640 1 -- 172.21.15.37:0/3598952685 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 799077227 0 0) 0x7f74e4142310 con 0x7f74e415d7e0 2024-05-30T06:50:11.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74e2000640 1 -- 172.21.15.37:0/3598952685 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74e4142030 con 0x7f74e415d7e0 2024-05-30T06:50:11.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74e2000640 1 -- 172.21.15.37:0/3598952685 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2580267259 0 0) 0x7f74c8003530 con 0x7f74e40b59d0 2024-05-30T06:50:11.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74da000640 1 -- 172.21.15.37:0/3598952685 >> v1:172.21.15.105:6789/0 conn(0x7f74e415d7e0 legacy=0x7f74e406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74da000640 1 -- 172.21.15.37:0/3598952685 >> v1:172.21.15.37:6789/0 conn(0x7f74e40b59d0 legacy=0x7f74e40b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.841+0000 7f74da000640 1 -- 172.21.15.37:0/3598952685 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e41428d0 con 0x7f74e415d350 2024-05-30T06:50:11.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.845+0000 7f74da000640 1 --2- 172.21.15.37:0/3598952685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e415d350 0x7f74e406df50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0097f0 tx=0x7f74cc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1bca1b6e74b2dff server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:11.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.845+0000 7f74e2000640 1 -- 172.21.15.37:0/3598952685 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0b0070 con 0x7f74e415d350 2024-05-30T06:50:11.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.845+0000 7f74e2000640 1 -- 172.21.15.37:0/3598952685 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74cc0ab400 con 0x7f74e415d350 2024-05-30T06:50:11.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.845+0000 7f74e2000640 1 -- 172.21.15.37:0/3598952685 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4001680 con 0x7f74e415d350 2024-05-30T06:50:11.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.845+0000 7f74e9e00640 1 -- 172.21.15.37:0/3598952685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e415d350 msgr2=0x7f74e406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.845+0000 7f74e9e00640 1 --2- 172.21.15.37:0/3598952685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e415d350 0x7f74e406df50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0097f0 tx=0x7f74cc01c3c0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.845+0000 7f74e9e00640 1 -- 172.21.15.37:0/3598952685 shutdown_connections 2024-05-30T06:50:11.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.845+0000 7f74e9e00640 1 --2- 172.21.15.37:0/3598952685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e415d350 0x7f74e406df50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.845+0000 7f74e9e00640 1 -- 172.21.15.37:0/3598952685 >> 172.21.15.37:0/3598952685 conn(0x7f74e406bf60 msgr2=0x7f74e40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:11.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.845+0000 7f74e9e00640 1 -- 172.21.15.37:0/3598952685 shutdown_connections 2024-05-30T06:50:11.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.845+0000 7f74e9e00640 1 -- 172.21.15.37:0/3598952685 wait complete. 2024-05-30T06:50:11.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e9e00640 1 Processor -- start 2024-05-30T06:50:11.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e9e00640 1 -- start start 2024-05-30T06:50:11.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74e40b59d0 0x7f74e4154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e9e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e415d350 0x7f74e415a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e9e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e415d7e0 0x7f74e4139860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e9e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74e4141d70 con 0x7f74e40b59d0 2024-05-30T06:50:11.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e9e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74e4141bf0 con 0x7f74e415d7e0 2024-05-30T06:50:11.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e9e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f74e416ae40 con 0x7f74e415d350 2024-05-30T06:50:11.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74e40b59d0 0x7f74e4154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74e40b59d0 0x7f74e4154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40794/0 (socket says 172.21.15.37:40794) 2024-05-30T06:50:11.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e2a00640 1 -- 172.21.15.37:0/3870724139 learned_addr learned my addr 172.21.15.37:0/3870724139 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:11.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74da000640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e415d350 0x7f74e415a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e3400640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e415d7e0 0x7f74e4139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e2a00640 1 -- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e415d350 msgr2=0x7f74e415a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e2a00640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e415d350 0x7f74e415a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e2a00640 1 -- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e415d7e0 msgr2=0x7f74e4139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e2a00640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e415d7e0 0x7f74e4139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e2a00640 1 -- 172.21.15.37:0/3870724139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e415b270 con 0x7f74e40b59d0 2024-05-30T06:50:11.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e3400640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e415d7e0 0x7f74e4139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:11.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e2a00640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74e40b59d0 0x7f74e4154170 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f74d400c730 tx=0x7f74d400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:11.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74dbe00640 1 -- 172.21.15.37:0/3870724139 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4017070 con 0x7f74e40b59d0 2024-05-30T06:50:11.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74dbe00640 1 -- 172.21.15.37:0/3870724139 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d4005ae0 con 0x7f74e40b59d0 2024-05-30T06:50:11.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74dbe00640 1 -- 172.21.15.37:0/3870724139 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4007070 con 0x7f74e40b59d0 2024-05-30T06:50:11.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e9e00640 1 -- 172.21.15.37:0/3870724139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e415b550 con 0x7f74e40b59d0 2024-05-30T06:50:11.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.849+0000 7f74e9e00640 1 -- 172.21.15.37:0/3870724139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e415bb10 con 0x7f74e40b59d0 2024-05-30T06:50:11.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.853+0000 7f74e9e00640 1 -- 172.21.15.37:0/3870724139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e4068bc0 con 0x7f74e40b59d0 2024-05-30T06:50:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.853+0000 7f74dbe00640 1 -- 172.21.15.37:0/3870724139 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 89109+0+0 (secure 0 0 0) 0x7f74d401a070 con 0x7f74e40b59d0 2024-05-30T06:50:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.853+0000 7f74dbe00640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74c0069010 0x7f74c006b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:11.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.853+0000 7f74dbe00640 1 -- 172.21.15.37:0/3870724139 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f74d4084b10 con 0x7f74e40b59d0 2024-05-30T06:50:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.853+0000 7f74da000640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74c0069010 0x7f74c006b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:11.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.853+0000 7f74da000640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74c0069010 0x7f74c006b4d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0ad000 tx=0x7f74cc0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:11.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:11.857+0000 7f74dbe00640 1 -- 172.21.15.37:0/3870724139 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f74d40568a0 con 0x7f74e40b59d0 2024-05-30T06:50:12.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.049+0000 7f74e9e00640 1 -- 172.21.15.37:0/3870724139 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f74e4156f60 con 0x7f74c0069010 2024-05-30T06:50:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.069+0000 7f74dbe00640 1 -- 172.21.15.37:0/3870724139 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f74e4156f60 con 0x7f74c0069010 2024-05-30T06:50:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.069+0000 7f74e9e00640 1 -- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74c0069010 msgr2=0x7f74c006b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.069+0000 7f74e9e00640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74c0069010 0x7f74c006b4d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0ad000 tx=0x7f74cc0a6000 comp rx=0 tx=0).stop 2024-05-30T06:50:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.069+0000 7f74e9e00640 1 -- 172.21.15.37:0/3870724139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74e40b59d0 msgr2=0x7f74e4154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.069+0000 7f74e9e00640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74e40b59d0 0x7f74e4154170 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f74d400c730 tx=0x7f74d400cbf0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.073+0000 7f74e9e00640 1 -- 172.21.15.37:0/3870724139 shutdown_connections 2024-05-30T06:50:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.073+0000 7f74e9e00640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74c0069010 0x7f74c006b4d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.073+0000 7f74e9e00640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74e415d7e0 0x7f74e4139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.073+0000 7f74e9e00640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74e415d350 0x7f74e415a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.073+0000 7f74e9e00640 1 --2- 172.21.15.37:0/3870724139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74e40b59d0 0x7f74e4154170 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.073+0000 7f74e9e00640 1 -- 172.21.15.37:0/3870724139 >> 172.21.15.37:0/3870724139 conn(0x7f74e406bf60 msgr2=0x7f74e41408f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.073+0000 7f74e9e00640 1 -- 172.21.15.37:0/3870724139 shutdown_connections 2024-05-30T06:50:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.073+0000 7f74e9e00640 1 -- 172.21.15.37:0/3870724139 wait complete. 2024-05-30T06:50:12.075 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:12.076+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:12.075 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:12.076+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:12.075 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:12.076+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:12.076 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:12.076+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:12.076 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:12.076+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:12.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone18544 2024-05-30T06:50:12.094 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:12.096+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:12.094 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:12.096+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:12.094 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:12.096+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:12.094 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:12.096+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:12.094 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:12.096+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:12.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f636f400640 1 Processor -- start 2024-05-30T06:50:12.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f636f400640 1 -- start start 2024-05-30T06:50:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f636f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f63680702d0 0x7f6368169b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f636f400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63681601a0 con 0x7f6368159490 2024-05-30T06:50:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f636f400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63680d06e0 con 0x7f6368072e60 2024-05-30T06:50:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f636f400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6368162800 con 0x7f63680702d0 2024-05-30T06:50:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f636ca00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6368159490 0x7f6368072750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38772/0 (socket says 172.21.15.37:38772) 2024-05-30T06:50:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f636ca00640 1 -- 172.21.15.37:0/4033709439 learned_addr learned my addr 172.21.15.37:0/4033709439 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:12.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f636d400640 1 --2- 172.21.15.37:0/4033709439 >> v2:172.21.15.37:3300/0 conn(0x7f63680702d0 0x7f6368169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f6367e00640 1 -- 172.21.15.37:0/4033709439 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 855795930 0 0) 0x7f63681601a0 con 0x7f6368159490 2024-05-30T06:50:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f6367e00640 1 -- 172.21.15.37:0/4033709439 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f634c003530 con 0x7f6368159490 2024-05-30T06:50:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f636d400640 1 -- 172.21.15.37:0/4033709439 >> v1:172.21.15.105:6789/0 conn(0x7f6368072e60 legacy=0x7f63680cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f636d400640 1 -- 172.21.15.37:0/4033709439 >> v1:172.21.15.37:6789/0 conn(0x7f6368159490 legacy=0x7f6368072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.237+0000 7f636d400640 1 -- 172.21.15.37:0/4033709439 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6368162a50 con 0x7f63680702d0 2024-05-30T06:50:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.241+0000 7f636d400640 1 --2- 172.21.15.37:0/4033709439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63680702d0 0x7f6368169b90 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6360009d90 tx=0x7f636001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d687580145328e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.241+0000 7f6367e00640 1 -- 172.21.15.37:0/4033709439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63600b2070 con 0x7f63680702d0 2024-05-30T06:50:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.241+0000 7f6367e00640 1 -- 172.21.15.37:0/4033709439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63600a5760 con 0x7f63680702d0 2024-05-30T06:50:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.241+0000 7f6367e00640 1 -- 172.21.15.37:0/4033709439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63600a5b30 con 0x7f63680702d0 2024-05-30T06:50:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.241+0000 7f636f400640 1 -- 172.21.15.37:0/4033709439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63680702d0 msgr2=0x7f6368169b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.241+0000 7f636f400640 1 --2- 172.21.15.37:0/4033709439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63680702d0 0x7f6368169b90 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6360009d90 tx=0x7f636001c850 comp rx=0 tx=0).stop 2024-05-30T06:50:12.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.241+0000 7f636f400640 1 -- 172.21.15.37:0/4033709439 shutdown_connections 2024-05-30T06:50:12.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.241+0000 7f636f400640 1 --2- 172.21.15.37:0/4033709439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63680702d0 0x7f6368169b90 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.241+0000 7f636f400640 1 -- 172.21.15.37:0/4033709439 >> 172.21.15.37:0/4033709439 conn(0x7f63680d0d50 msgr2=0x7f63680d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:12.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.241+0000 7f636f400640 1 -- 172.21.15.37:0/4033709439 shutdown_connections 2024-05-30T06:50:12.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.241+0000 7f636f400640 1 -- 172.21.15.37:0/4033709439 wait complete. 2024-05-30T06:50:12.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636f400640 1 Processor -- start 2024-05-30T06:50:12.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636f400640 1 -- start start 2024-05-30T06:50:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636f400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63680702d0 0x7f636814fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636f400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6368072e60 0x7f63680b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6368159490 0x7f63681569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636f400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f636816c8f0 con 0x7f6368159490 2024-05-30T06:50:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636f400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6368163760 con 0x7f63680702d0 2024-05-30T06:50:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636f400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f636816ca70 con 0x7f6368072e60 2024-05-30T06:50:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6368159490 0x7f63681569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636ca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63680702d0 0x7f636814fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636ca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63680702d0 0x7f636814fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:36816/0 (socket says 172.21.15.37:36816) 2024-05-30T06:50:12.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636ca00640 1 -- 172.21.15.37:0/623471786 learned_addr learned my addr 172.21.15.37:0/623471786 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:12.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f635fe00640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6368072e60 0x7f63680b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:12.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636d400640 1 -- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6368072e60 msgr2=0x7f63680b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636d400640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6368072e60 0x7f63680b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636d400640 1 -- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63680702d0 msgr2=0x7f636814fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636d400640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63680702d0 0x7f636814fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636d400640 1 -- 172.21.15.37:0/623471786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63680b43b0 con 0x7f6368159490 2024-05-30T06:50:12.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636ca00640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63680702d0 0x7f636814fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:12.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636d400640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6368159490 0x7f63681569a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f63600ac000 tx=0x7f63600195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f6365600640 1 -- 172.21.15.37:0/623471786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63600bd020 con 0x7f6368159490 2024-05-30T06:50:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f6365600640 1 -- 172.21.15.37:0/623471786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63600b8470 con 0x7f6368159490 2024-05-30T06:50:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636f400640 1 -- 172.21.15.37:0/623471786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63680b4690 con 0x7f6368159490 2024-05-30T06:50:12.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f6365600640 1 -- 172.21.15.37:0/623471786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63600b2040 con 0x7f6368159490 2024-05-30T06:50:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636f400640 1 -- 172.21.15.37:0/623471786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63680b4c50 con 0x7f6368159490 2024-05-30T06:50:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.245+0000 7f636f400640 1 -- 172.21.15.37:0/623471786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6368068d40 con 0x7f6368159490 2024-05-30T06:50:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.249+0000 7f6365600640 1 -- 172.21.15.37:0/623471786 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 89109+0+0 (secure 0 0 0) 0x7f63600c0020 con 0x7f6368159490 2024-05-30T06:50:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.249+0000 7f6365600640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6344068fe0 0x7f634406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.249+0000 7f6365600640 1 -- 172.21.15.37:0/623471786 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f63601201f0 con 0x7f6368159490 2024-05-30T06:50:12.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.249+0000 7f636ca00640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6344068fe0 0x7f634406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:12.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.249+0000 7f636ca00640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6344068fe0 0x7f634406b4a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f63580011f0 tx=0x7f6358009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:12.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.253+0000 7f6365600640 1 -- 172.21.15.37:0/623471786 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f63600c7030 con 0x7f6368159490 2024-05-30T06:50:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.441+0000 7f636f400640 1 -- 172.21.15.37:0/623471786 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone18544", "target": ["mon-mgr", ""]}) -- 0x7f63680cefd0 con 0x7f6344068fe0 2024-05-30T06:50:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.465+0000 7f6365600640 1 -- 172.21.15.37:0/623471786 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f63680cefd0 con 0x7f6344068fe0 2024-05-30T06:50:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.469+0000 7f636f400640 1 -- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6344068fe0 msgr2=0x7f634406b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.469+0000 7f636f400640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6344068fe0 0x7f634406b4a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f63580011f0 tx=0x7f6358009040 comp rx=0 tx=0).stop 2024-05-30T06:50:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.469+0000 7f636f400640 1 -- 172.21.15.37:0/623471786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6368159490 msgr2=0x7f63681569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.469+0000 7f636f400640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6368159490 0x7f63681569a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f63600ac000 tx=0x7f63600195f0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.469+0000 7f636f400640 1 -- 172.21.15.37:0/623471786 shutdown_connections 2024-05-30T06:50:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.469+0000 7f636f400640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6368159490 0x7f63681569a0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.469+0000 7f636f400640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6368072e60 0x7f63680b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.469+0000 7f636f400640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6344068fe0 0x7f634406b4a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.469+0000 7f636f400640 1 --2- 172.21.15.37:0/623471786 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63680702d0 0x7f636814fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.469+0000 7f636f400640 1 -- 172.21.15.37:0/623471786 >> 172.21.15.37:0/623471786 conn(0x7f63680d0d50 msgr2=0x7f63681513b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.469+0000 7f636f400640 1 -- 172.21.15.37:0/623471786 shutdown_connections 2024-05-30T06:50:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.469+0000 7f636f400640 1 -- 172.21.15.37:0/623471786 wait complete. 2024-05-30T06:50:12.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone18546 2024-05-30T06:50:12.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83b1200640 1 Processor -- start 2024-05-30T06:50:12.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83b1200640 1 -- start start 2024-05-30T06:50:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83b1200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f83ac161ee0 0x7f83ac0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83b1200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ac0b3aa0 0x7f83ac0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83b1200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83ac0ce470 con 0x7f83ac0716b0 2024-05-30T06:50:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83b1200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f83ac1622c0 con 0x7f83ac161ee0 2024-05-30T06:50:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83b1200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f83ac0b4f30 con 0x7f83ac0b3aa0 2024-05-30T06:50:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83a3e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f83ac0716b0 0x7f83ac0b3390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38788/0 (socket says 172.21.15.37:38788) 2024-05-30T06:50:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83a3e00640 1 -- 172.21.15.37:0/1235489478 learned_addr learned my addr 172.21.15.37:0/1235489478 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83a9e00640 1 --2- 172.21.15.37:0/1235489478 >> v2:172.21.15.105:3300/0 conn(0x7f83ac161ee0 0x7f83ac0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83aa800640 1 --2- 172.21.15.37:0/1235489478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ac0b3aa0 0x7f83ac0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:12.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83a9400640 1 -- 172.21.15.37:0/1235489478 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264243330 0 0) 0x7f83ac0ce470 con 0x7f83ac0716b0 2024-05-30T06:50:12.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83a9400640 1 -- 172.21.15.37:0/1235489478 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8390003530 con 0x7f83ac0716b0 2024-05-30T06:50:12.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83aa800640 1 -- 172.21.15.37:0/1235489478 >> v2:172.21.15.105:3300/0 conn(0x7f83ac161ee0 msgr2=0x7f83ac0b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:12.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83aa800640 1 --2- 172.21.15.37:0/1235489478 >> v2:172.21.15.105:3300/0 conn(0x7f83ac161ee0 0x7f83ac0b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83aa800640 1 -- 172.21.15.37:0/1235489478 >> v1:172.21.15.37:6789/0 conn(0x7f83ac0716b0 legacy=0x7f83ac0b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83aa800640 1 -- 172.21.15.37:0/1235489478 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac0b5210 con 0x7f83ac0b3aa0 2024-05-30T06:50:12.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.633+0000 7f83a9e00640 1 --2- 172.21.15.37:0/1235489478 >> v2:172.21.15.105:3300/0 conn(0x7f83ac161ee0 0x7f83ac0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.637+0000 7f83aa800640 1 --2- 172.21.15.37:0/1235489478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ac0b3aa0 0x7f83ac0ce970 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009d90 tx=0x7f83a401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d004f93cacfd66da server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.637+0000 7f83a9400640 1 -- 172.21.15.37:0/1235489478 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a40b2070 con 0x7f83ac0b3aa0 2024-05-30T06:50:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.637+0000 7f83a9400640 1 -- 172.21.15.37:0/1235489478 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a40a5940 con 0x7f83ac0b3aa0 2024-05-30T06:50:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.637+0000 7f83a9400640 1 -- 172.21.15.37:0/1235489478 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a40a5cf0 con 0x7f83ac0b3aa0 2024-05-30T06:50:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.637+0000 7f83b1200640 1 -- 172.21.15.37:0/1235489478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ac0b3aa0 msgr2=0x7f83ac0ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.637+0000 7f83b1200640 1 --2- 172.21.15.37:0/1235489478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ac0b3aa0 0x7f83ac0ce970 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009d90 tx=0x7f83a401c970 comp rx=0 tx=0).stop 2024-05-30T06:50:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.637+0000 7f83b1200640 1 -- 172.21.15.37:0/1235489478 shutdown_connections 2024-05-30T06:50:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.637+0000 7f83b1200640 1 --2- 172.21.15.37:0/1235489478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ac0b3aa0 0x7f83ac0ce970 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.637+0000 7f83b1200640 1 --2- 172.21.15.37:0/1235489478 >> v2:172.21.15.105:3300/0 conn(0x7f83ac161ee0 0x7f83ac0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.637+0000 7f83b1200640 1 -- 172.21.15.37:0/1235489478 >> 172.21.15.37:0/1235489478 conn(0x7f83ac06f110 msgr2=0x7f83ac06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.637+0000 7f83b1200640 1 -- 172.21.15.37:0/1235489478 shutdown_connections 2024-05-30T06:50:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.637+0000 7f83b1200640 1 -- 172.21.15.37:0/1235489478 wait complete. 2024-05-30T06:50:12.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83b1200640 1 Processor -- start 2024-05-30T06:50:12.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83b1200640 1 -- start start 2024-05-30T06:50:12.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83b1200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ac0716b0 0x7f83ac153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:12.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83b1200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83ac0b3aa0 0x7f83ac160c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:12.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83b1200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83ac161ee0 0x7f83ac156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:12.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83b1200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac0cf840 con 0x7f83ac161ee0 2024-05-30T06:50:12.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83b1200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac0cf6c0 con 0x7f83ac0b3aa0 2024-05-30T06:50:12.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83b1200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f83ac0cf9c0 con 0x7f83ac0716b0 2024-05-30T06:50:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83a9e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ac0716b0 0x7f83ac153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83aa800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83ac161ee0 0x7f83ac156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83a9e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ac0716b0 0x7f83ac153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:54430/0 (socket says 172.21.15.37:54430) 2024-05-30T06:50:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83a9e00640 1 -- 172.21.15.37:0/1677409940 learned_addr learned my addr 172.21.15.37:0/1677409940 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:12.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83a3e00640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83ac0b3aa0 0x7f83ac160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:12.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83aa800640 1 -- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ac0716b0 msgr2=0x7f83ac153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83aa800640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ac0716b0 0x7f83ac153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83aa800640 1 -- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83ac0b3aa0 msgr2=0x7f83ac160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83aa800640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83ac0b3aa0 0x7f83ac160c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83aa800640 1 -- 172.21.15.37:0/1677409940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac0cc540 con 0x7f83ac161ee0 2024-05-30T06:50:12.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83a9e00640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ac0716b0 0x7f83ac153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:12.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83aa800640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83ac161ee0 0x7f83ac156d30 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f83a40ac000 tx=0x7f83a4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:12.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83a2000640 1 -- 172.21.15.37:0/1677409940 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a40b2050 con 0x7f83ac161ee0 2024-05-30T06:50:12.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83a2000640 1 -- 172.21.15.37:0/1677409940 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83a40be070 con 0x7f83ac161ee0 2024-05-30T06:50:12.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83a2000640 1 -- 172.21.15.37:0/1677409940 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4004040 con 0x7f83ac161ee0 2024-05-30T06:50:12.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83b1200640 1 -- 172.21.15.37:0/1677409940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ac0cc820 con 0x7f83ac161ee0 2024-05-30T06:50:12.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.641+0000 7f83b1200640 1 -- 172.21.15.37:0/1677409940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ac0ccde0 con 0x7f83ac161ee0 2024-05-30T06:50:12.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.645+0000 7f83b1200640 1 -- 172.21.15.37:0/1677409940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ac068d40 con 0x7f83ac161ee0 2024-05-30T06:50:12.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.645+0000 7f83a2000640 1 -- 172.21.15.37:0/1677409940 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 89109+0+0 (secure 0 0 0) 0x7f83a40041e0 con 0x7f83ac161ee0 2024-05-30T06:50:12.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.645+0000 7f83a2000640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8388068fe0 0x7f838806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:12.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.645+0000 7f83a2000640 1 -- 172.21.15.37:0/1677409940 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f83a4120160 con 0x7f83ac161ee0 2024-05-30T06:50:12.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.645+0000 7f83a9e00640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8388068fe0 0x7f838806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:12.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.645+0000 7f83a9e00640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8388068fe0 0x7f838806b4a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f839c009600 tx=0x7f839c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:12.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.649+0000 7f83a2000640 1 -- 172.21.15.37:0/1677409940 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f83a4016560 con 0x7f83ac161ee0 2024-05-30T06:50:12.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.837+0000 7f83b1200640 1 -- 172.21.15.37:0/1677409940 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone18546", "target": ["mon-mgr", ""]}) -- 0x7f83ac15fe70 con 0x7f8388068fe0 2024-05-30T06:50:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.861+0000 7f83a2000640 1 -- 172.21.15.37:0/1677409940 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f83ac15fe70 con 0x7f8388068fe0 2024-05-30T06:50:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.861+0000 7f83b1200640 1 -- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8388068fe0 msgr2=0x7f838806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.861+0000 7f83b1200640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8388068fe0 0x7f838806b4a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f839c009600 tx=0x7f839c009190 comp rx=0 tx=0).stop 2024-05-30T06:50:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.861+0000 7f83b1200640 1 -- 172.21.15.37:0/1677409940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83ac161ee0 msgr2=0x7f83ac156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.861+0000 7f83b1200640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83ac161ee0 0x7f83ac156d30 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f83a40ac000 tx=0x7f83a4019710 comp rx=0 tx=0).stop 2024-05-30T06:50:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.861+0000 7f83b1200640 1 -- 172.21.15.37:0/1677409940 shutdown_connections 2024-05-30T06:50:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.861+0000 7f83b1200640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83ac161ee0 0x7f83ac156d30 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.861+0000 7f83b1200640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8388068fe0 0x7f838806b4a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.861+0000 7f83b1200640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83ac0b3aa0 0x7f83ac160c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.861+0000 7f83b1200640 1 --2- 172.21.15.37:0/1677409940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ac0716b0 0x7f83ac153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.861+0000 7f83b1200640 1 -- 172.21.15.37:0/1677409940 >> 172.21.15.37:0/1677409940 conn(0x7f83ac06f110 msgr2=0x7f83ac0b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.861+0000 7f83b1200640 1 -- 172.21.15.37:0/1677409940 shutdown_connections 2024-05-30T06:50:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:12.861+0000 7f83b1200640 1 -- 172.21.15.37:0/1677409940 wait complete. 2024-05-30T06:50:12.884 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone18547 2024-05-30T06:50:13.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6adc000640 1 Processor -- start 2024-05-30T06:50:13.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6adc000640 1 -- start start 2024-05-30T06:50:13.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6adc000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad41590c0 0x7f6ad40cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6adc000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6ad40cde60 0x7f6ad406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6adc000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ad40cd400 0x7f6ad406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6adc000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad415f230 con 0x7f6ad40cd400 2024-05-30T06:50:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6adc000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6ad415f510 con 0x7f6ad40cde60 2024-05-30T06:50:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6adc000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad415f7f0 con 0x7f6ad41590c0 2024-05-30T06:50:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6ada000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ad40cd400 0x7f6ad406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6ada000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ad40cd400 0x7f6ad406f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40824/0 (socket says 172.21.15.37:40824) 2024-05-30T06:50:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6ada000640 1 -- 172.21.15.37:0/106225979 learned_addr learned my addr 172.21.15.37:0/106225979 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6ad8c00640 1 --2- 172.21.15.37:0/106225979 >> v2:172.21.15.105:3300/0 conn(0x7f6ad40cde60 0x7f6ad406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6ada000640 1 -- 172.21.15.37:0/106225979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad41590c0 msgr2=0x7f6ad40cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6ad9600640 1 --2- 172.21.15.37:0/106225979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad41590c0 0x7f6ad40cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6ada000640 1 --2- 172.21.15.37:0/106225979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad41590c0 0x7f6ad40cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6ada000640 1 -- 172.21.15.37:0/106225979 >> v2:172.21.15.105:3300/0 conn(0x7f6ad40cde60 msgr2=0x7f6ad406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6ada000640 1 --2- 172.21.15.37:0/106225979 >> v2:172.21.15.105:3300/0 conn(0x7f6ad40cde60 0x7f6ad406f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.029+0000 7f6ada000640 1 -- 172.21.15.37:0/106225979 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad415fad0 con 0x7f6ad40cd400 2024-05-30T06:50:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6ad9600640 1 --2- 172.21.15.37:0/106225979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad41590c0 0x7f6ad40cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6ad8c00640 1 --2- 172.21.15.37:0/106225979 >> v2:172.21.15.105:3300/0 conn(0x7f6ad40cde60 0x7f6ad406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:13.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6ada000640 1 --2- 172.21.15.37:0/106225979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad40cd400 0x7f6ad406f5a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6ad406c630 tx=0x7f6acc01ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3022fd25d54b34 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:13.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6ad3e00640 1 -- 172.21.15.37:0/106225979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc00b2d0 con 0x7f6ad40cd400 2024-05-30T06:50:13.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6ad3e00640 1 -- 172.21.15.37:0/106225979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6acc00b470 con 0x7f6ad40cd400 2024-05-30T06:50:13.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6ad3e00640 1 -- 172.21.15.37:0/106225979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0a7880 con 0x7f6ad40cd400 2024-05-30T06:50:13.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6adc000640 1 -- 172.21.15.37:0/106225979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad40cd400 msgr2=0x7f6ad406f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6adc000640 1 --2- 172.21.15.37:0/106225979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad40cd400 0x7f6ad406f5a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6ad406c630 tx=0x7f6acc01ead0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6adc000640 1 -- 172.21.15.37:0/106225979 shutdown_connections 2024-05-30T06:50:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6adc000640 1 --2- 172.21.15.37:0/106225979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad40cd400 0x7f6ad406f5a0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6adc000640 1 --2- 172.21.15.37:0/106225979 >> v2:172.21.15.105:3300/0 conn(0x7f6ad40cde60 0x7f6ad406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6adc000640 1 --2- 172.21.15.37:0/106225979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad41590c0 0x7f6ad40cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6adc000640 1 -- 172.21.15.37:0/106225979 >> 172.21.15.37:0/106225979 conn(0x7f6ad406bf60 msgr2=0x7f6ad40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6adc000640 1 -- 172.21.15.37:0/106225979 shutdown_connections 2024-05-30T06:50:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.033+0000 7f6adc000640 1 -- 172.21.15.37:0/106225979 wait complete. 2024-05-30T06:50:13.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6adc000640 1 Processor -- start 2024-05-30T06:50:13.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6adc000640 1 -- start start 2024-05-30T06:50:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6adc000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad40cd400 0x7f6ad4158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6adc000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40cde60 0x7f6ad4151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6adc000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad41590c0 0x7f6ad406df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6adc000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad40d0080 con 0x7f6ad41590c0 2024-05-30T06:50:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6adc000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad40cff00 con 0x7f6ad40cd400 2024-05-30T06:50:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6adc000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad40d0200 con 0x7f6ad40cde60 2024-05-30T06:50:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ada000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad41590c0 0x7f6ad406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ada000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad41590c0 0x7f6ad406df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40840/0 (socket says 172.21.15.37:40840) 2024-05-30T06:50:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ada000640 1 -- 172.21.15.37:0/2812669335 learned_addr learned my addr 172.21.15.37:0/2812669335 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ad9600640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad40cd400 0x7f6ad4158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ad8c00640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40cde60 0x7f6ad4151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ada000640 1 -- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40cde60 msgr2=0x7f6ad4151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ada000640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40cde60 0x7f6ad4151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ada000640 1 -- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad40cd400 msgr2=0x7f6ad4158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ada000640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad40cd400 0x7f6ad4158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ada000640 1 -- 172.21.15.37:0/2812669335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad413ab20 con 0x7f6ad41590c0 2024-05-30T06:50:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ada000640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad41590c0 0x7f6ad406df50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6acc01f370 tx=0x7f6acc01b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ad1600640 1 -- 172.21.15.37:0/2812669335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0be020 con 0x7f6ad41590c0 2024-05-30T06:50:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ad1600640 1 -- 172.21.15.37:0/2812669335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6acc009820 con 0x7f6ad41590c0 2024-05-30T06:50:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6ad1600640 1 -- 172.21.15.37:0/2812669335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc00b720 con 0x7f6ad41590c0 2024-05-30T06:50:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.037+0000 7f6adc000640 1 -- 172.21.15.37:0/2812669335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad413ae00 con 0x7f6ad41590c0 2024-05-30T06:50:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.041+0000 7f6adc000640 1 -- 172.21.15.37:0/2812669335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad413b3c0 con 0x7f6ad41590c0 2024-05-30T06:50:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.041+0000 7f6adc000640 1 -- 172.21.15.37:0/2812669335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad4068d40 con 0x7f6ad41590c0 2024-05-30T06:50:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.041+0000 7f6ad1600640 1 -- 172.21.15.37:0/2812669335 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 89109+0+0 (secure 0 0 0) 0x7f6acc0c1020 con 0x7f6ad41590c0 2024-05-30T06:50:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.041+0000 7f6ad1600640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ab4069010 0x7f6ab406b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.041+0000 7f6ad1600640 1 -- 172.21.15.37:0/2812669335 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f6acc122890 con 0x7f6ad41590c0 2024-05-30T06:50:13.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.041+0000 7f6ad9600640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ab4069010 0x7f6ab406b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.041+0000 7f6ad9600640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ab4069010 0x7f6ab406b4d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8006fd0 tx=0x7f6ac8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:13.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.045+0000 7f6ad1600640 1 -- 172.21.15.37:0/2812669335 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6acc0c8030 con 0x7f6ad41590c0 2024-05-30T06:50:13.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.237+0000 7f6adc000640 1 -- 172.21.15.37:0/2812669335 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone18547", "target": ["mon-mgr", ""]}) -- 0x7f6ad40b31b0 con 0x7f6ab4069010 2024-05-30T06:50:13.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.257+0000 7f6ad1600640 1 -- 172.21.15.37:0/2812669335 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6ad40b31b0 con 0x7f6ab4069010 2024-05-30T06:50:13.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.261+0000 7f6adc000640 1 -- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ab4069010 msgr2=0x7f6ab406b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.261+0000 7f6adc000640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ab4069010 0x7f6ab406b4d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8006fd0 tx=0x7f6ac8008040 comp rx=0 tx=0).stop 2024-05-30T06:50:13.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.261+0000 7f6adc000640 1 -- 172.21.15.37:0/2812669335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad41590c0 msgr2=0x7f6ad406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.261+0000 7f6adc000640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad41590c0 0x7f6ad406df50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6acc01f370 tx=0x7f6acc01b870 comp rx=0 tx=0).stop 2024-05-30T06:50:13.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.261+0000 7f6adc000640 1 -- 172.21.15.37:0/2812669335 shutdown_connections 2024-05-30T06:50:13.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.261+0000 7f6adc000640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad41590c0 0x7f6ad406df50 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.261+0000 7f6adc000640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ad40cde60 0x7f6ad4151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.261+0000 7f6adc000640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ab4069010 0x7f6ab406b4d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.261+0000 7f6adc000640 1 --2- 172.21.15.37:0/2812669335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad40cd400 0x7f6ad4158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.261+0000 7f6adc000640 1 -- 172.21.15.37:0/2812669335 >> 172.21.15.37:0/2812669335 conn(0x7f6ad406bf60 msgr2=0x7f6ad406f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:13.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.261+0000 7f6adc000640 1 -- 172.21.15.37:0/2812669335 shutdown_connections 2024-05-30T06:50:13.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.261+0000 7f6adc000640 1 -- 172.21.15.37:0/2812669335 wait complete. 2024-05-30T06:50:13.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone18542 2024-05-30T06:50:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.425+0000 7f755c600640 1 Processor -- start 2024-05-30T06:50:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.425+0000 7f755c600640 1 -- start start 2024-05-30T06:50:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.425+0000 7f755c600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7554161ee0 0x7f75540b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.425+0000 7f755c600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75540716b0 0x7f75540b3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.425+0000 7f755c600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75540b38d0 0x7f755406b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.425+0000 7f755c600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f75540ce470 con 0x7f75540b38d0 2024-05-30T06:50:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.425+0000 7f755c600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f75541622c0 con 0x7f7554161ee0 2024-05-30T06:50:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.425+0000 7f755c600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f75540b4f30 con 0x7f75540716b0 2024-05-30T06:50:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.425+0000 7f755a600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75540b38d0 0x7f755406b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.425+0000 7f755a600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75540b38d0 0x7f755406b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40846/0 (socket says 172.21.15.37:40846) 2024-05-30T06:50:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.425+0000 7f755a600640 1 -- 172.21.15.37:0/655503710 learned_addr learned my addr 172.21.15.37:0/655503710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.425+0000 7f7559200640 1 --2- 172.21.15.37:0/655503710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75540716b0 0x7f75540b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.425+0000 7f7559c00640 1 --2- 172.21.15.37:0/655503710 >> v2:172.21.15.105:3300/0 conn(0x7f7554161ee0 0x7f75540b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.429+0000 7f755a600640 1 -- 172.21.15.37:0/655503710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75540716b0 msgr2=0x7f75540b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.429+0000 7f755a600640 1 --2- 172.21.15.37:0/655503710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75540716b0 0x7f75540b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.429+0000 7f755a600640 1 -- 172.21.15.37:0/655503710 >> v2:172.21.15.105:3300/0 conn(0x7f7554161ee0 msgr2=0x7f75540b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.429+0000 7f755a600640 1 --2- 172.21.15.37:0/655503710 >> v2:172.21.15.105:3300/0 conn(0x7f7554161ee0 0x7f75540b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.429+0000 7f755a600640 1 -- 172.21.15.37:0/655503710 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75540b5210 con 0x7f75540b38d0 2024-05-30T06:50:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.429+0000 7f7559200640 1 --2- 172.21.15.37:0/655503710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75540716b0 0x7f75540b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.429+0000 7f7559c00640 1 --2- 172.21.15.37:0/655503710 >> v2:172.21.15.105:3300/0 conn(0x7f7554161ee0 0x7f75540b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.429+0000 7f755a600640 1 --2- 172.21.15.37:0/655503710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75540b38d0 0x7f755406b960 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f75540b44c0 tx=0x7f754c01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c704abbe6b3f7d33 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.429+0000 7f7553e00640 1 -- 172.21.15.37:0/655503710 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c0a64d0 con 0x7f75540b38d0 2024-05-30T06:50:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.429+0000 7f7553e00640 1 -- 172.21.15.37:0/655503710 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f754c0a6670 con 0x7f75540b38d0 2024-05-30T06:50:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.429+0000 7f7553e00640 1 -- 172.21.15.37:0/655503710 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754c0a6a40 con 0x7f75540b38d0 2024-05-30T06:50:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.429+0000 7f755c600640 1 -- 172.21.15.37:0/655503710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75540b38d0 msgr2=0x7f755406b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.429+0000 7f755c600640 1 --2- 172.21.15.37:0/655503710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75540b38d0 0x7f755406b960 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f75540b44c0 tx=0x7f754c01c730 comp rx=0 tx=0).stop 2024-05-30T06:50:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 -- 172.21.15.37:0/655503710 shutdown_connections 2024-05-30T06:50:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 --2- 172.21.15.37:0/655503710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75540b38d0 0x7f755406b960 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 --2- 172.21.15.37:0/655503710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75540716b0 0x7f75540b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 --2- 172.21.15.37:0/655503710 >> v2:172.21.15.105:3300/0 conn(0x7f7554161ee0 0x7f75540b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 -- 172.21.15.37:0/655503710 >> 172.21.15.37:0/655503710 conn(0x7f755406f110 msgr2=0x7f755406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 -- 172.21.15.37:0/655503710 shutdown_connections 2024-05-30T06:50:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 -- 172.21.15.37:0/655503710 wait complete. 2024-05-30T06:50:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 Processor -- start 2024-05-30T06:50:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 -- start start 2024-05-30T06:50:13.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75540716b0 0x7f755413dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75540b38d0 0x7f755414f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7554161ee0 0x7f755414f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75540cead0 con 0x7f75540b38d0 2024-05-30T06:50:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f75540ce950 con 0x7f7554161ee0 2024-05-30T06:50:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755c600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f75540cec50 con 0x7f75540716b0 2024-05-30T06:50:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f7559200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75540b38d0 0x7f755414f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f7559200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75540b38d0 0x7f755414f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40858/0 (socket says 172.21.15.37:40858) 2024-05-30T06:50:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f7559200640 1 -- 172.21.15.37:0/1418433989 learned_addr learned my addr 172.21.15.37:0/1418433989 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f7559c00640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75540716b0 0x7f755413dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f755a600640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7554161ee0 0x7f755414f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f7559200640 1 -- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75540716b0 msgr2=0x7f755413dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f7559200640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75540716b0 0x7f755413dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f7559200640 1 -- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7554161ee0 msgr2=0x7f755414f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f7559200640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7554161ee0 0x7f755414f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f7559200640 1 -- 172.21.15.37:0/1418433989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7554150000 con 0x7f75540b38d0 2024-05-30T06:50:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.433+0000 7f7559200640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75540b38d0 0x7f755414f440 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f754000e810 tx=0x7f754000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.437+0000 7f7551600640 1 -- 172.21.15.37:0/1418433989 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754000f040 con 0x7f75540b38d0 2024-05-30T06:50:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.437+0000 7f7551600640 1 -- 172.21.15.37:0/1418433989 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7540004030 con 0x7f75540b38d0 2024-05-30T06:50:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.437+0000 7f7551600640 1 -- 172.21.15.37:0/1418433989 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540004400 con 0x7f75540b38d0 2024-05-30T06:50:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.437+0000 7f755c600640 1 -- 172.21.15.37:0/1418433989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75541502e0 con 0x7f75540b38d0 2024-05-30T06:50:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.437+0000 7f755c600640 1 -- 172.21.15.37:0/1418433989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f755415d540 con 0x7f75540b38d0 2024-05-30T06:50:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.437+0000 7f755c600640 1 -- 172.21.15.37:0/1418433989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7554068d40 con 0x7f75540b38d0 2024-05-30T06:50:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.437+0000 7f7551600640 1 -- 172.21.15.37:0/1418433989 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 89109+0+0 (secure 0 0 0) 0x7f754000c6d0 con 0x7f75540b38d0 2024-05-30T06:50:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.437+0000 7f7551600640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7534069010 0x7f753406b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.437+0000 7f7551600640 1 -- 172.21.15.37:0/1418433989 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f7540084fa0 con 0x7f75540b38d0 2024-05-30T06:50:13.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.437+0000 7f7559c00640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7534069010 0x7f753406b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.441+0000 7f7559c00640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7534069010 0x7f753406b4d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f75480045f0 tx=0x7f7548008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:13.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.441+0000 7f7551600640 1 -- 172.21.15.37:0/1418433989 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7540017020 con 0x7f75540b38d0 2024-05-30T06:50:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.633+0000 7f755c600640 1 -- 172.21.15.37:0/1418433989 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone18542", "target": ["mon-mgr", ""]}) -- 0x7f75540d2070 con 0x7f7534069010 2024-05-30T06:50:13.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.649+0000 7f7551600640 1 -- 172.21.15.37:0/1418433989 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f75540d2070 con 0x7f7534069010 2024-05-30T06:50:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.649+0000 7f755c600640 1 -- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7534069010 msgr2=0x7f753406b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.649+0000 7f755c600640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7534069010 0x7f753406b4d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f75480045f0 tx=0x7f7548008040 comp rx=0 tx=0).stop 2024-05-30T06:50:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.649+0000 7f755c600640 1 -- 172.21.15.37:0/1418433989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75540b38d0 msgr2=0x7f755414f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.649+0000 7f755c600640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75540b38d0 0x7f755414f440 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f754000e810 tx=0x7f754000ecd0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.649+0000 7f755c600640 1 -- 172.21.15.37:0/1418433989 shutdown_connections 2024-05-30T06:50:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.649+0000 7f755c600640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7534069010 0x7f753406b4d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.649+0000 7f755c600640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7554161ee0 0x7f755414f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.649+0000 7f755c600640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75540b38d0 0x7f755414f440 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.649+0000 7f755c600640 1 --2- 172.21.15.37:0/1418433989 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75540716b0 0x7f755413dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.649+0000 7f755c600640 1 -- 172.21.15.37:0/1418433989 >> 172.21.15.37:0/1418433989 conn(0x7f755406f110 msgr2=0x7f755406f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.653+0000 7f755c600640 1 -- 172.21.15.37:0/1418433989 shutdown_connections 2024-05-30T06:50:13.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.653+0000 7f755c600640 1 -- 172.21.15.37:0/1418433989 wait complete. 2024-05-30T06:50:13.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone18545 2024-05-30T06:50:13.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.817+0000 7f9593400640 1 Processor -- start 2024-05-30T06:50:13.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.817+0000 7f9593400640 1 -- start start 2024-05-30T06:50:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.817+0000 7f9593400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f958c0cd400 0x7f958c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.817+0000 7f9593400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f958c06f5a0 0x7f958c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.817+0000 7f9593400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f958c0ce030 con 0x7f958c1590c0 2024-05-30T06:50:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.817+0000 7f9593400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f958c15f230 con 0x7f958c0cd400 2024-05-30T06:50:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.817+0000 7f9593400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f958c15f510 con 0x7f958c06f5a0 2024-05-30T06:50:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.817+0000 7f9583e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f958c0cd400 0x7f958c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.817+0000 7f9583e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f958c0cd400 0x7f958c06f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40872/0 (socket says 172.21.15.37:40872) 2024-05-30T06:50:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.817+0000 7f9583e00640 1 -- 172.21.15.37:0/641063178 learned_addr learned my addr 172.21.15.37:0/641063178 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.821+0000 7f9591400640 1 --2- 172.21.15.37:0/641063178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f958c06f5a0 0x7f958c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.821+0000 7f9583e00640 1 -- 172.21.15.37:0/641063178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f958c06f5a0 msgr2=0x7f958c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.821+0000 7f9583e00640 1 --2- 172.21.15.37:0/641063178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f958c06f5a0 0x7f958c0b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.821+0000 7f9583e00640 1 -- 172.21.15.37:0/641063178 >> v1:172.21.15.105:6789/0 conn(0x7f958c1590c0 legacy=0x7f958c0cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.821+0000 7f9583e00640 1 -- 172.21.15.37:0/641063178 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c15f7f0 con 0x7f958c0cd400 2024-05-30T06:50:13.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.821+0000 7f9583e00640 1 --2- 172.21.15.37:0/641063178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f958c0cd400 0x7f958c06f060 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9574009870 tx=0x7f957401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3e03e243ec75dc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.821+0000 7f958be00640 1 -- 172.21.15.37:0/641063178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95740b0070 con 0x7f958c0cd400 2024-05-30T06:50:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.821+0000 7f958be00640 1 -- 172.21.15.37:0/641063178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95740ab600 con 0x7f958c0cd400 2024-05-30T06:50:13.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.821+0000 7f958be00640 1 -- 172.21.15.37:0/641063178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95740ab9d0 con 0x7f958c0cd400 2024-05-30T06:50:13.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.821+0000 7f9593400640 1 -- 172.21.15.37:0/641063178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f958c0cd400 msgr2=0x7f958c06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.821+0000 7f9593400640 1 --2- 172.21.15.37:0/641063178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f958c0cd400 0x7f958c06f060 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f9574009870 tx=0x7f957401c4d0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 -- 172.21.15.37:0/641063178 shutdown_connections 2024-05-30T06:50:13.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 --2- 172.21.15.37:0/641063178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f958c06f5a0 0x7f958c0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 --2- 172.21.15.37:0/641063178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f958c0cd400 0x7f958c06f060 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 -- 172.21.15.37:0/641063178 >> 172.21.15.37:0/641063178 conn(0x7f958c06bf60 msgr2=0x7f958c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:13.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 -- 172.21.15.37:0/641063178 shutdown_connections 2024-05-30T06:50:13.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 -- 172.21.15.37:0/641063178 wait complete. 2024-05-30T06:50:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 Processor -- start 2024-05-30T06:50:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 -- start start 2024-05-30T06:50:13.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f958c06f5a0 0x7f958c142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f958c0cd400 0x7f958c1565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f958c1590c0 0x7f958c156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f958c1684a0 con 0x7f958c06f5a0 2024-05-30T06:50:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f958c06f9b0 con 0x7f958c1590c0 2024-05-30T06:50:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f958c168620 con 0x7f958c0cd400 2024-05-30T06:50:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9590a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f958c06f5a0 0x7f958c142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9590a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f958c06f5a0 0x7f958c142f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40880/0 (socket says 172.21.15.37:40880) 2024-05-30T06:50:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9590a00640 1 -- 172.21.15.37:0/1472936516 learned_addr learned my addr 172.21.15.37:0/1472936516 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9591400640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f958c1590c0 0x7f958c156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9583e00640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f958c0cd400 0x7f958c1565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9590a00640 1 -- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f958c0cd400 msgr2=0x7f958c1565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9590a00640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f958c0cd400 0x7f958c1565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9590a00640 1 -- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f958c1590c0 msgr2=0x7f958c156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9590a00640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f958c1590c0 0x7f958c156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:13.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9590a00640 1 -- 172.21.15.37:0/1472936516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c1573a0 con 0x7f958c06f5a0 2024-05-30T06:50:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9590a00640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f958c06f5a0 0x7f958c142f10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f957c00c370 tx=0x7f957c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9589600640 1 -- 172.21.15.37:0/1472936516 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0052d0 con 0x7f958c06f5a0 2024-05-30T06:50:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9589600640 1 -- 172.21.15.37:0/1472936516 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957c005470 con 0x7f958c06f5a0 2024-05-30T06:50:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9589600640 1 -- 172.21.15.37:0/1472936516 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c007260 con 0x7f958c06f5a0 2024-05-30T06:50:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.825+0000 7f9593400640 1 -- 172.21.15.37:0/1472936516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958c157680 con 0x7f958c06f5a0 2024-05-30T06:50:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.829+0000 7f9593400640 1 -- 172.21.15.37:0/1472936516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958c157c40 con 0x7f958c06f5a0 2024-05-30T06:50:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.829+0000 7f9593400640 1 -- 172.21.15.37:0/1472936516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958c068d40 con 0x7f958c06f5a0 2024-05-30T06:50:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.829+0000 7f9589600640 1 -- 172.21.15.37:0/1472936516 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f957c007400 con 0x7f958c06f5a0 2024-05-30T06:50:13.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.829+0000 7f9589600640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9568069100 0x7f956806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:13.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.829+0000 7f9589600640 1 -- 172.21.15.37:0/1472936516 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f957c084ad0 con 0x7f958c06f5a0 2024-05-30T06:50:13.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.829+0000 7f9583e00640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9568069100 0x7f956806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:13.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.833+0000 7f9583e00640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9568069100 0x7f956806b5c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f95740ad000 tx=0x7f9574008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:13.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:13.833+0000 7f9589600640 1 -- 172.21.15.37:0/1472936516 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f957c0561e0 con 0x7f958c06f5a0 2024-05-30T06:50:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.025+0000 7f9593400640 1 -- 172.21.15.37:0/1472936516 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone18545", "target": ["mon-mgr", ""]}) -- 0x7f958c072bb0 con 0x7f9568069100 2024-05-30T06:50:14.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.041+0000 7f9589600640 1 -- 172.21.15.37:0/1472936516 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f958c072bb0 con 0x7f9568069100 2024-05-30T06:50:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.045+0000 7f9593400640 1 -- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9568069100 msgr2=0x7f956806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.045+0000 7f9593400640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9568069100 0x7f956806b5c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f95740ad000 tx=0x7f9574008040 comp rx=0 tx=0).stop 2024-05-30T06:50:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.045+0000 7f9593400640 1 -- 172.21.15.37:0/1472936516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f958c06f5a0 msgr2=0x7f958c142f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.045+0000 7f9593400640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f958c06f5a0 0x7f958c142f10 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f957c00c370 tx=0x7f957c00c830 comp rx=0 tx=0).stop 2024-05-30T06:50:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.045+0000 7f9593400640 1 -- 172.21.15.37:0/1472936516 shutdown_connections 2024-05-30T06:50:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.045+0000 7f9593400640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9568069100 0x7f956806b5c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.045+0000 7f9593400640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f958c1590c0 0x7f958c156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.045+0000 7f9593400640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f958c0cd400 0x7f958c1565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.045+0000 7f9593400640 1 --2- 172.21.15.37:0/1472936516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f958c06f5a0 0x7f958c142f10 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.045+0000 7f9593400640 1 -- 172.21.15.37:0/1472936516 >> 172.21.15.37:0/1472936516 conn(0x7f958c06bf60 msgr2=0x7f958c071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.045+0000 7f9593400640 1 -- 172.21.15.37:0/1472936516 shutdown_connections 2024-05-30T06:50:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.045+0000 7f9593400640 1 -- 172.21.15.37:0/1472936516 wait complete. 2024-05-30T06:50:14.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone18541 2024-05-30T06:50:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10e3400640 1 Processor -- start 2024-05-30T06:50:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10e3400640 1 -- start start 2024-05-30T06:50:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10e3400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10dc1590c0 0x7f10dc0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10e3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10dc0cde60 0x7f10dc06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10e3400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f10dc0cd400 0x7f10dc06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10e3400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f10dc15f230 con 0x7f10dc0cde60 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10e3400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f10dc15f510 con 0x7f10dc0cd400 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10e3400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f10dc15f7f0 con 0x7f10dc1590c0 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10d3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10dc0cde60 0x7f10dc06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10d3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10dc0cde60 0x7f10dc06f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40882/0 (socket says 172.21.15.37:40882) 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10d3e00640 1 -- 172.21.15.37:0/801319587 learned_addr learned my addr 172.21.15.37:0/801319587 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10e1400640 1 --2- 172.21.15.37:0/801319587 >> v2:172.21.15.105:3300/0 conn(0x7f10dc0cd400 0x7f10dc06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10e0a00640 1 --2- 172.21.15.37:0/801319587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10dc1590c0 0x7f10dc0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10d3e00640 1 -- 172.21.15.37:0/801319587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10dc1590c0 msgr2=0x7f10dc0cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10d3e00640 1 --2- 172.21.15.37:0/801319587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10dc1590c0 0x7f10dc0cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10d3e00640 1 -- 172.21.15.37:0/801319587 >> v2:172.21.15.105:3300/0 conn(0x7f10dc0cd400 msgr2=0x7f10dc06f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10d3e00640 1 --2- 172.21.15.37:0/801319587 >> v2:172.21.15.105:3300/0 conn(0x7f10dc0cd400 0x7f10dc06f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.209+0000 7f10d3e00640 1 -- 172.21.15.37:0/801319587 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10dc15fad0 con 0x7f10dc0cde60 2024-05-30T06:50:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.213+0000 7f10d3e00640 1 --2- 172.21.15.37:0/801319587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10dc0cde60 0x7f10dc06f060 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f10dc15fdb0 tx=0x7f10c401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa079866295b5b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.213+0000 7f10dbe00640 1 -- 172.21.15.37:0/801319587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c40b0070 con 0x7f10dc0cde60 2024-05-30T06:50:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.213+0000 7f10dbe00640 1 -- 172.21.15.37:0/801319587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c40ab600 con 0x7f10dc0cde60 2024-05-30T06:50:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.213+0000 7f10dbe00640 1 -- 172.21.15.37:0/801319587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c40ab9d0 con 0x7f10dc0cde60 2024-05-30T06:50:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.213+0000 7f10e3400640 1 -- 172.21.15.37:0/801319587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10dc0cde60 msgr2=0x7f10dc06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.213+0000 7f10e3400640 1 --2- 172.21.15.37:0/801319587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10dc0cde60 0x7f10dc06f060 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f10dc15fdb0 tx=0x7f10c401c400 comp rx=0 tx=0).stop 2024-05-30T06:50:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.213+0000 7f10e3400640 1 -- 172.21.15.37:0/801319587 shutdown_connections 2024-05-30T06:50:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.213+0000 7f10e3400640 1 --2- 172.21.15.37:0/801319587 >> v2:172.21.15.105:3300/0 conn(0x7f10dc0cd400 0x7f10dc06f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.213+0000 7f10e3400640 1 --2- 172.21.15.37:0/801319587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10dc0cde60 0x7f10dc06f060 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.213+0000 7f10e3400640 1 --2- 172.21.15.37:0/801319587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10dc1590c0 0x7f10dc0cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.213+0000 7f10e3400640 1 -- 172.21.15.37:0/801319587 >> 172.21.15.37:0/801319587 conn(0x7f10dc06bf60 msgr2=0x7f10dc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.213+0000 7f10e3400640 1 -- 172.21.15.37:0/801319587 shutdown_connections 2024-05-30T06:50:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.213+0000 7f10e3400640 1 -- 172.21.15.37:0/801319587 wait complete. 2024-05-30T06:50:14.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e3400640 1 Processor -- start 2024-05-30T06:50:14.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e3400640 1 -- start start 2024-05-30T06:50:14.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e3400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10dc0cd400 0x7f10dc14c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10dc0cde60 0x7f10dc141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e3400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10dc1590c0 0x7f10dc1470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e3400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10dc0d0080 con 0x7f10dc0cde60 2024-05-30T06:50:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e3400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f10dc0cff00 con 0x7f10dc1590c0 2024-05-30T06:50:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e3400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f10dc0d0200 con 0x7f10dc0cd400 2024-05-30T06:50:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10d3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10dc0cde60 0x7f10dc141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10d3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10dc0cde60 0x7f10dc141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40890/0 (socket says 172.21.15.37:40890) 2024-05-30T06:50:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10d3e00640 1 -- 172.21.15.37:0/4210615512 learned_addr learned my addr 172.21.15.37:0/4210615512 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e0a00640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10dc0cd400 0x7f10dc14c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10d3e00640 1 -- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10dc0cd400 msgr2=0x7f10dc14c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e1400640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10dc1590c0 0x7f10dc1470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10d3e00640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10dc0cd400 0x7f10dc14c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10d3e00640 1 -- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10dc1590c0 msgr2=0x7f10dc1470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10d3e00640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10dc1590c0 0x7f10dc1470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10d3e00640 1 -- 172.21.15.37:0/4210615512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10dc14b4f0 con 0x7f10dc0cde60 2024-05-30T06:50:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e0a00640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10dc0cd400 0x7f10dc14c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e1400640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10dc1590c0 0x7f10dc1470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10d3e00640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10dc0cde60 0x7f10dc141620 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f10c401aab0 tx=0x7f10c40191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10d9600640 1 -- 172.21.15.37:0/4210615512 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c40b0040 con 0x7f10dc0cde60 2024-05-30T06:50:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10d9600640 1 -- 172.21.15.37:0/4210615512 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10c40b4420 con 0x7f10dc0cde60 2024-05-30T06:50:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10d9600640 1 -- 172.21.15.37:0/4210615512 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c40b47f0 con 0x7f10dc0cde60 2024-05-30T06:50:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e3400640 1 -- 172.21.15.37:0/4210615512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10dc14b7d0 con 0x7f10dc0cde60 2024-05-30T06:50:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.217+0000 7f10e3400640 1 -- 172.21.15.37:0/4210615512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10dc14bd90 con 0x7f10dc0cde60 2024-05-30T06:50:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.221+0000 7f10e3400640 1 -- 172.21.15.37:0/4210615512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10dc068d40 con 0x7f10dc0cde60 2024-05-30T06:50:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.221+0000 7f10d9600640 1 -- 172.21.15.37:0/4210615512 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f10c40b4990 con 0x7f10dc0cde60 2024-05-30T06:50:14.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.221+0000 7f10d9600640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f10b8069100 0x7f10b806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:14.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.221+0000 7f10d9600640 1 -- 172.21.15.37:0/4210615512 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f10c411f120 con 0x7f10dc0cde60 2024-05-30T06:50:14.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.221+0000 7f10e0a00640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f10b8069100 0x7f10b806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:14.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.221+0000 7f10e0a00640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f10b8069100 0x7f10b806b5c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0cea30 tx=0x7f10cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:14.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.225+0000 7f10d9600640 1 -- 172.21.15.37:0/4210615512 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f10c4016110 con 0x7f10dc0cde60 2024-05-30T06:50:14.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.413+0000 7f10e3400640 1 -- 172.21.15.37:0/4210615512 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone18541", "target": ["mon-mgr", ""]}) -- 0x7f10dc0b31b0 con 0x7f10b8069100 2024-05-30T06:50:14.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.429+0000 7f10d9600640 1 -- 172.21.15.37:0/4210615512 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f10dc0b31b0 con 0x7f10b8069100 2024-05-30T06:50:14.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.433+0000 7f10e3400640 1 -- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f10b8069100 msgr2=0x7f10b806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.433+0000 7f10e3400640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f10b8069100 0x7f10b806b5c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0cea30 tx=0x7f10cc008040 comp rx=0 tx=0).stop 2024-05-30T06:50:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.433+0000 7f10e3400640 1 -- 172.21.15.37:0/4210615512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10dc0cde60 msgr2=0x7f10dc141620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.433+0000 7f10e3400640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10dc0cde60 0x7f10dc141620 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f10c401aab0 tx=0x7f10c40191a0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.433+0000 7f10e3400640 1 -- 172.21.15.37:0/4210615512 shutdown_connections 2024-05-30T06:50:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.433+0000 7f10e3400640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f10b8069100 0x7f10b806b5c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.433+0000 7f10e3400640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10dc1590c0 0x7f10dc1470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.433+0000 7f10e3400640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10dc0cde60 0x7f10dc141620 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.433+0000 7f10e3400640 1 --2- 172.21.15.37:0/4210615512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10dc0cd400 0x7f10dc14c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.433+0000 7f10e3400640 1 -- 172.21.15.37:0/4210615512 >> 172.21.15.37:0/4210615512 conn(0x7f10dc06bf60 msgr2=0x7f10dc15bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.433+0000 7f10e3400640 1 -- 172.21.15.37:0/4210615512 shutdown_connections 2024-05-30T06:50:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.433+0000 7f10e3400640 1 -- 172.21.15.37:0/4210615512 wait complete. 2024-05-30T06:50:14.454 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone18543 2024-05-30T06:50:14.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4659400640 1 Processor -- start 2024-05-30T06:50:14.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4659400640 1 -- start start 2024-05-30T06:50:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4659400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46541590c0 0x7f46540cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4659400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f46540cd400 0x7f46540b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4659400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f465415f230 con 0x7f46540cde60 2024-05-30T06:50:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4659400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f465415f510 con 0x7f46541590c0 2024-05-30T06:50:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4659400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f465415f7f0 con 0x7f46540cd400 2024-05-30T06:50:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4652800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46541590c0 0x7f46540cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4652800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46541590c0 0x7f46540cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40898/0 (socket says 172.21.15.37:40898) 2024-05-30T06:50:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4652800640 1 -- 172.21.15.37:0/1108303782 learned_addr learned my addr 172.21.15.37:0/1108303782 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4653200640 1 --2- 172.21.15.37:0/1108303782 >> v2:172.21.15.105:3300/0 conn(0x7f46540cd400 0x7f46540b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:14.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4652800640 1 -- 172.21.15.37:0/1108303782 >> v2:172.21.15.105:3300/0 conn(0x7f46540cd400 msgr2=0x7f46540b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:14.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4652800640 1 --2- 172.21.15.37:0/1108303782 >> v2:172.21.15.105:3300/0 conn(0x7f46540cd400 0x7f46540b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4652800640 1 -- 172.21.15.37:0/1108303782 >> v1:172.21.15.105:6789/0 conn(0x7f46540cde60 legacy=0x7f465406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:14.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.597+0000 7f4652800640 1 -- 172.21.15.37:0/1108303782 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465415fad0 con 0x7f46541590c0 2024-05-30T06:50:14.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.601+0000 7f4652800640 1 --2- 172.21.15.37:0/1108303782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46541590c0 0x7f46540cd920 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f46540b2d30 tx=0x7f464401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96ee80c1ad0e8a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:14.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.601+0000 7f4651e00640 1 -- 172.21.15.37:0/1108303782 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46440a5590 con 0x7f46541590c0 2024-05-30T06:50:14.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.601+0000 7f4651e00640 1 -- 172.21.15.37:0/1108303782 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46440a5730 con 0x7f46541590c0 2024-05-30T06:50:14.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.601+0000 7f4651e00640 1 -- 172.21.15.37:0/1108303782 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46440a5b00 con 0x7f46541590c0 2024-05-30T06:50:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.601+0000 7f4659400640 1 -- 172.21.15.37:0/1108303782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46541590c0 msgr2=0x7f46540cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.601+0000 7f4659400640 1 --2- 172.21.15.37:0/1108303782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46541590c0 0x7f46540cd920 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f46540b2d30 tx=0x7f464401c8d0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.601+0000 7f4659400640 1 -- 172.21.15.37:0/1108303782 shutdown_connections 2024-05-30T06:50:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.601+0000 7f4659400640 1 --2- 172.21.15.37:0/1108303782 >> v2:172.21.15.105:3300/0 conn(0x7f46540cd400 0x7f46540b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.601+0000 7f4659400640 1 --2- 172.21.15.37:0/1108303782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46541590c0 0x7f46540cd920 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.601+0000 7f4659400640 1 -- 172.21.15.37:0/1108303782 >> 172.21.15.37:0/1108303782 conn(0x7f465406bf60 msgr2=0x7f46540b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.601+0000 7f4659400640 1 -- 172.21.15.37:0/1108303782 shutdown_connections 2024-05-30T06:50:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.601+0000 7f4659400640 1 -- 172.21.15.37:0/1108303782 wait complete. 2024-05-30T06:50:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4659400640 1 Processor -- start 2024-05-30T06:50:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4659400640 1 -- start start 2024-05-30T06:50:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4659400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46540cd400 0x7f4654160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4659400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46540cde60 0x7f4654163fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4659400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46541590c0 0x7f4654143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4659400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f465406f8f0 con 0x7f46540cd400 2024-05-30T06:50:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4659400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f465406f770 con 0x7f46540cde60 2024-05-30T06:50:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4659400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46541684a0 con 0x7f46541590c0 2024-05-30T06:50:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4652800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46540cd400 0x7f4654160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4652800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46540cd400 0x7f4654160fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40908/0 (socket says 172.21.15.37:40908) 2024-05-30T06:50:14.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4652800640 1 -- 172.21.15.37:0/45672471 learned_addr learned my addr 172.21.15.37:0/45672471 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:14.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4653200640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46541590c0 0x7f4654143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:14.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4649e00640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46540cde60 0x7f4654163fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4652800640 1 -- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46541590c0 msgr2=0x7f4654143e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4652800640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46541590c0 0x7f4654143e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4652800640 1 -- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46540cde60 msgr2=0x7f4654163fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4652800640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46540cde60 0x7f4654163fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4652800640 1 -- 172.21.15.37:0/45672471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46541615f0 con 0x7f46540cd400 2024-05-30T06:50:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4652800640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46540cd400 0x7f4654160fa0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f464401a500 tx=0x7f4644019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f464b400640 1 -- 172.21.15.37:0/45672471 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46440bc020 con 0x7f46540cd400 2024-05-30T06:50:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f464b400640 1 -- 172.21.15.37:0/45672471 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46440b8690 con 0x7f46540cd400 2024-05-30T06:50:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4659400640 1 -- 172.21.15.37:0/45672471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46541618d0 con 0x7f46540cd400 2024-05-30T06:50:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f464b400640 1 -- 172.21.15.37:0/45672471 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4644009510 con 0x7f46540cd400 2024-05-30T06:50:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.605+0000 7f4659400640 1 -- 172.21.15.37:0/45672471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4654161e90 con 0x7f46540cd400 2024-05-30T06:50:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.609+0000 7f4659400640 1 -- 172.21.15.37:0/45672471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4654068d40 con 0x7f46540cd400 2024-05-30T06:50:14.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.609+0000 7f464b400640 1 -- 172.21.15.37:0/45672471 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f46440bf020 con 0x7f46540cd400 2024-05-30T06:50:14.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.609+0000 7f464b400640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4630069130 0x7f463006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:14.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.609+0000 7f464b400640 1 -- 172.21.15.37:0/45672471 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f464411fd70 con 0x7f46540cd400 2024-05-30T06:50:14.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.609+0000 7f4649e00640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4630069130 0x7f463006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.609+0000 7f4649e00640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4630069130 0x7f463006b5f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f46541f8dc0 tx=0x7f463c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:14.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.613+0000 7f464b400640 1 -- 172.21.15.37:0/45672471 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f46440c7020 con 0x7f46540cd400 2024-05-30T06:50:14.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:14.973+0000 7f4659400640 1 -- 172.21.15.37:0/45672471 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone18543", "target": ["mon-mgr", ""]}) -- 0x7f4654164500 con 0x7f4630069130 2024-05-30T06:50:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.001+0000 7f464b400640 1 -- 172.21.15.37:0/45672471 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f463c001450 con 0x7f4630069130 2024-05-30T06:50:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.005+0000 7f4659400640 1 -- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4630069130 msgr2=0x7f463006b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.005+0000 7f4659400640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4630069130 0x7f463006b5f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f46541f8dc0 tx=0x7f463c009040 comp rx=0 tx=0).stop 2024-05-30T06:50:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.005+0000 7f4659400640 1 -- 172.21.15.37:0/45672471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46540cd400 msgr2=0x7f4654160fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.005+0000 7f4659400640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46540cd400 0x7f4654160fa0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f464401a500 tx=0x7f4644019670 comp rx=0 tx=0).stop 2024-05-30T06:50:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.005+0000 7f4659400640 1 -- 172.21.15.37:0/45672471 shutdown_connections 2024-05-30T06:50:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.005+0000 7f4659400640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46541590c0 0x7f4654143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.005+0000 7f4659400640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4630069130 0x7f463006b5f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.005+0000 7f4659400640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46540cde60 0x7f4654163fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.005+0000 7f4659400640 1 --2- 172.21.15.37:0/45672471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46540cd400 0x7f4654160fa0 secure :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f464401a500 tx=0x7f4644019670 comp rx=0 tx=0).stop 2024-05-30T06:50:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.005+0000 7f4659400640 1 -- 172.21.15.37:0/45672471 >> 172.21.15.37:0/45672471 conn(0x7f465406bf60 msgr2=0x7f465406ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.005+0000 7f4659400640 1 -- 172.21.15.37:0/45672471 shutdown_connections 2024-05-30T06:50:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.005+0000 7f4659400640 1 -- 172.21.15.37:0/45672471 wait complete. 2024-05-30T06:50:15.050 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T06:50:15.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:50:15.130 INFO:teuthology.orchestra.run.smithi037.stdout:2 2024-05-30T06:50:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:50:15.140 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:50:15.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:50:15.252 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:50:15.319 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:50:15.319 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:50:15.319 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:50:15.319 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:50:15.334 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:50:15.334 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:50:15.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:50:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cfe00640 1 Processor -- start 2024-05-30T06:50:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cfe00640 1 -- start start 2024-05-30T06:50:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cfe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1d00b4df0 0x7fd1d00b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cfe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd1d006fba0 0x7fd1d0070030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cfe00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d00aea90 con 0x7fd1d015ba90 2024-05-30T06:50:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cfe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd1d00b5710 con 0x7fd1d00b4df0 2024-05-30T06:50:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cfe00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd1d006f0e0 con 0x7fd1d006fba0 2024-05-30T06:50:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1d00b4df0 0x7fd1d00b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1d00b4df0 0x7fd1d00b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40916/0 (socket says 172.21.15.37:40916) 2024-05-30T06:50:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cea00640 1 -- 172.21.15.37:0/3435181152 learned_addr learned my addr 172.21.15.37:0/3435181152 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cf400640 1 --2- 172.21.15.37:0/3435181152 >> v2:172.21.15.105:3300/0 conn(0x7fd1d006fba0 0x7fd1d0070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cea00640 1 -- 172.21.15.37:0/3435181152 >> v2:172.21.15.105:3300/0 conn(0x7fd1d006fba0 msgr2=0x7fd1d0070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cea00640 1 --2- 172.21.15.37:0/3435181152 >> v2:172.21.15.105:3300/0 conn(0x7fd1d006fba0 0x7fd1d0070030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cea00640 1 -- 172.21.15.37:0/3435181152 >> v1:172.21.15.105:6789/0 conn(0x7fd1d015ba90 legacy=0x7fd1d015bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cea00640 1 -- 172.21.15.37:0/3435181152 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d015c830 con 0x7fd1d00b4df0 2024-05-30T06:50:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.609+0000 7fd1cf400640 1 --2- 172.21.15.37:0/3435181152 >> v2:172.21.15.105:3300/0 conn(0x7fd1d006fba0 0x7fd1d0070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:15.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.613+0000 7fd1cea00640 1 --2- 172.21.15.37:0/3435181152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d00b4df0 0x7fd1d00b51d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd1d006ece0 tx=0x7fd1c001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d682b6c9e555a0ea server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:15.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.613+0000 7fd1ce000640 1 -- 172.21.15.37:0/3435181152 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c00ab430 con 0x7fd1d00b4df0 2024-05-30T06:50:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.613+0000 7fd1ce000640 1 -- 172.21.15.37:0/3435181152 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c00b0070 con 0x7fd1d00b4df0 2024-05-30T06:50:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.613+0000 7fd1ce000640 1 -- 172.21.15.37:0/3435181152 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c00ab5f0 con 0x7fd1d00b4df0 2024-05-30T06:50:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.613+0000 7fd1cfe00640 1 -- 172.21.15.37:0/3435181152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d00b4df0 msgr2=0x7fd1d00b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.613+0000 7fd1cfe00640 1 --2- 172.21.15.37:0/3435181152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d00b4df0 0x7fd1d00b51d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd1d006ece0 tx=0x7fd1c001c520 comp rx=0 tx=0).stop 2024-05-30T06:50:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.613+0000 7fd1cfe00640 1 -- 172.21.15.37:0/3435181152 shutdown_connections 2024-05-30T06:50:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.613+0000 7fd1cfe00640 1 --2- 172.21.15.37:0/3435181152 >> v2:172.21.15.105:3300/0 conn(0x7fd1d006fba0 0x7fd1d0070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.613+0000 7fd1cfe00640 1 --2- 172.21.15.37:0/3435181152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d00b4df0 0x7fd1d00b51d0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.613+0000 7fd1cfe00640 1 -- 172.21.15.37:0/3435181152 >> 172.21.15.37:0/3435181152 conn(0x7fd1d009aa60 msgr2=0x7fd1d00b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.613+0000 7fd1cfe00640 1 -- 172.21.15.37:0/3435181152 shutdown_connections 2024-05-30T06:50:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.613+0000 7fd1cfe00640 1 -- 172.21.15.37:0/3435181152 wait complete. 2024-05-30T06:50:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cfe00640 1 Processor -- start 2024-05-30T06:50:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cfe00640 1 -- start start 2024-05-30T06:50:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cfe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1d006fba0 0x7fd1d0142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cfe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1d00b4df0 0x7fd1d01f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015ba90 0x7fd1d0148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cfe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d01661e0 con 0x7fd1d015ba90 2024-05-30T06:50:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cfe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d01594f0 con 0x7fd1d00b4df0 2024-05-30T06:50:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cfe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d0166360 con 0x7fd1d006fba0 2024-05-30T06:50:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015ba90 0x7fd1d0148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015ba90 0x7fd1d0148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40928/0 (socket says 172.21.15.37:40928) 2024-05-30T06:50:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cf400640 1 -- 172.21.15.37:0/769960801 learned_addr learned my addr 172.21.15.37:0/769960801 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cea00640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1d006fba0 0x7fd1d0142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1c6000640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1d00b4df0 0x7fd1d01f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cf400640 1 -- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1d006fba0 msgr2=0x7fd1d0142a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cf400640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1d006fba0 0x7fd1d0142a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cf400640 1 -- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1d00b4df0 msgr2=0x7fd1d01f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cf400640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1d00b4df0 0x7fd1d01f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cf400640 1 -- 172.21.15.37:0/769960801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d015b520 con 0x7fd1d015ba90 2024-05-30T06:50:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cf400640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015ba90 0x7fd1d0148bd0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800c7f0 tx=0x7fd1c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1c7400640 1 -- 172.21.15.37:0/769960801 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8015070 con 0x7fd1d015ba90 2024-05-30T06:50:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1c7400640 1 -- 172.21.15.37:0/769960801 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c8007860 con 0x7fd1d015ba90 2024-05-30T06:50:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1c7400640 1 -- 172.21.15.37:0/769960801 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8007c50 con 0x7fd1d015ba90 2024-05-30T06:50:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cfe00640 1 -- 172.21.15.37:0/769960801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d0146930 con 0x7fd1d015ba90 2024-05-30T06:50:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.617+0000 7fd1cfe00640 1 -- 172.21.15.37:0/769960801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d0157110 con 0x7fd1d015ba90 2024-05-30T06:50:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.621+0000 7fd1cfe00640 1 -- 172.21.15.37:0/769960801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d0075580 con 0x7fd1d015ba90 2024-05-30T06:50:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.621+0000 7fd1c7400640 1 -- 172.21.15.37:0/769960801 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fd1c8018070 con 0x7fd1d015ba90 2024-05-30T06:50:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.621+0000 7fd1c7400640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1ac069100 0x7fd1ac06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.621+0000 7fd1c7400640 1 -- 172.21.15.37:0/769960801 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7fd1c80857b0 con 0x7fd1d015ba90 2024-05-30T06:50:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.621+0000 7fd1cea00640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1ac069100 0x7fd1ac06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.621+0000 7fd1cea00640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1ac069100 0x7fd1ac06b5c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00af000 tx=0x7fd1c00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.625+0000 7fd1c7400640 1 -- 172.21.15.37:0/769960801 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd1c8056ec0 con 0x7fd1d015ba90 2024-05-30T06:50:15.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.929+0000 7fd1cfe00640 1 -- 172.21.15.37:0/769960801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1d0147950 con 0x7fd1d015ba90 2024-05-30T06:50:15.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.933+0000 7fd1c7400640 1 -- 172.21.15.37:0/769960801 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+16653 (secure 0 0 0) 0x7fd1c805b1c0 con 0x7fd1d015ba90 2024-05-30T06:50:15.936 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:15.937 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":60,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:48:36.530256+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:48:33.300340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T06:48:33.866916+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:50:15.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.937+0000 7fd1cfe00640 1 -- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1ac069100 msgr2=0x7fd1ac06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:15.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.937+0000 7fd1cfe00640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1ac069100 0x7fd1ac06b5c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd1c00af000 tx=0x7fd1c00a7000 comp rx=0 tx=0).stop 2024-05-30T06:50:15.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.937+0000 7fd1cfe00640 1 -- 172.21.15.37:0/769960801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015ba90 msgr2=0x7fd1d0148bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:15.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.937+0000 7fd1cfe00640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015ba90 0x7fd1d0148bd0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd1c800c7f0 tx=0x7fd1c800ccb0 comp rx=0 tx=0).stop 2024-05-30T06:50:15.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.937+0000 7fd1cfe00640 1 -- 172.21.15.37:0/769960801 shutdown_connections 2024-05-30T06:50:15.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.937+0000 7fd1cfe00640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015ba90 0x7fd1d0148bd0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:15.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.937+0000 7fd1cfe00640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1ac069100 0x7fd1ac06b5c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:15.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.937+0000 7fd1cfe00640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1d00b4df0 0x7fd1d01f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:15.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.937+0000 7fd1cfe00640 1 --2- 172.21.15.37:0/769960801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1d006fba0 0x7fd1d0142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:15.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.937+0000 7fd1cfe00640 1 -- 172.21.15.37:0/769960801 >> 172.21.15.37:0/769960801 conn(0x7fd1d009aa60 msgr2=0x7fd1d015a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:15.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.937+0000 7fd1cfe00640 1 -- 172.21.15.37:0/769960801 shutdown_connections 2024-05-30T06:50:15.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:15.937+0000 7fd1cfe00640 1 -- 172.21.15.37:0/769960801 wait complete. 2024-05-30T06:50:15.970 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:48:33.300340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:48:33.866916+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:50:15.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:50:16.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.201+0000 7efc3f800640 1 Processor -- start 2024-05-30T06:50:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.201+0000 7efc3f800640 1 -- start start 2024-05-30T06:50:16.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.201+0000 7efc3f800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efc38162e70 0x7efc380cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.201+0000 7efc3f800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc380ce7d0 0x7efc380cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.201+0000 7efc3f800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc38164190 con 0x7efc38163250 2024-05-30T06:50:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.205+0000 7efc3f800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efc3806f8e0 con 0x7efc380ce7d0 2024-05-30T06:50:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.205+0000 7efc3f800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7efc3806ecd0 con 0x7efc38162e70 2024-05-30T06:50:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.205+0000 7efc37e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efc38163250 0x7efc381636d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38796/0 (socket says 172.21.15.37:38796) 2024-05-30T06:50:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.205+0000 7efc37e00640 1 -- 172.21.15.37:0/1300070627 learned_addr learned my addr 172.21.15.37:0/1300070627 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.205+0000 7efc3d800640 1 --2- 172.21.15.37:0/1300070627 >> v2:172.21.15.37:3300/0 conn(0x7efc380ce7d0 0x7efc380cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.205+0000 7efc3ce00640 1 --2- 172.21.15.37:0/1300070627 >> v2:172.21.15.105:3300/0 conn(0x7efc38162e70 0x7efc380cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.205+0000 7efc37400640 1 -- 172.21.15.37:0/1300070627 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960602535 0 0) 0x7efc38164190 con 0x7efc38163250 2024-05-30T06:50:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.205+0000 7efc37400640 1 -- 172.21.15.37:0/1300070627 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc20003530 con 0x7efc38163250 2024-05-30T06:50:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.205+0000 7efc3ce00640 1 -- 172.21.15.37:0/1300070627 >> v2:172.21.15.37:3300/0 conn(0x7efc380ce7d0 msgr2=0x7efc380cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.205+0000 7efc3ce00640 1 --2- 172.21.15.37:0/1300070627 >> v2:172.21.15.37:3300/0 conn(0x7efc380ce7d0 0x7efc380cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.205+0000 7efc3ce00640 1 -- 172.21.15.37:0/1300070627 >> v1:172.21.15.37:6789/0 conn(0x7efc38163250 legacy=0x7efc381636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.205+0000 7efc3ce00640 1 -- 172.21.15.37:0/1300070627 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3806efb0 con 0x7efc38162e70 2024-05-30T06:50:16.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.205+0000 7efc3ce00640 1 --2- 172.21.15.37:0/1300070627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc38162e70 0x7efc380cc8b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efc38073360 tx=0x7efc2c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e77dce6e4b1d9be server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:16.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc37400640 1 -- 172.21.15.37:0/1300070627 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0b1070 con 0x7efc38162e70 2024-05-30T06:50:16.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc37400640 1 -- 172.21.15.37:0/1300070627 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2c0ac620 con 0x7efc38162e70 2024-05-30T06:50:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc37400640 1 -- 172.21.15.37:0/1300070627 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0ac9f0 con 0x7efc38162e70 2024-05-30T06:50:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 -- 172.21.15.37:0/1300070627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc38162e70 msgr2=0x7efc380cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 --2- 172.21.15.37:0/1300070627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc38162e70 0x7efc380cc8b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efc38073360 tx=0x7efc2c01c3c0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 -- 172.21.15.37:0/1300070627 shutdown_connections 2024-05-30T06:50:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 --2- 172.21.15.37:0/1300070627 >> v2:172.21.15.37:3300/0 conn(0x7efc380ce7d0 0x7efc380cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 --2- 172.21.15.37:0/1300070627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc38162e70 0x7efc380cc8b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 -- 172.21.15.37:0/1300070627 >> 172.21.15.37:0/1300070627 conn(0x7efc3806bf60 msgr2=0x7efc380b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 -- 172.21.15.37:0/1300070627 shutdown_connections 2024-05-30T06:50:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 -- 172.21.15.37:0/1300070627 wait complete. 2024-05-30T06:50:16.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 Processor -- start 2024-05-30T06:50:16.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 -- start start 2024-05-30T06:50:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc380ce7d0 0x7efc3815c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc38162e70 0x7efc3814c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc38163250 0x7efc3814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efc380ccf70 con 0x7efc38163250 2024-05-30T06:50:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efc380ccdf0 con 0x7efc380ce7d0 2024-05-30T06:50:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3f800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efc3816fc40 con 0x7efc38162e70 2024-05-30T06:50:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc38163250 0x7efc3814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3ce00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc380ce7d0 0x7efc3815c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3ce00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc380ce7d0 0x7efc3815c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:36938/0 (socket says 172.21.15.37:36938) 2024-05-30T06:50:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3ce00640 1 -- 172.21.15.37:0/3842266972 learned_addr learned my addr 172.21.15.37:0/3842266972 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc37e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc38162e70 0x7efc3814c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.209+0000 7efc3d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc38163250 0x7efc3814cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40950/0 (socket says 172.21.15.37:40950) 2024-05-30T06:50:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc3ce00640 1 -- 172.21.15.37:0/3842266972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc38162e70 msgr2=0x7efc3814c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc3ce00640 1 --2- 172.21.15.37:0/3842266972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc38162e70 0x7efc3814c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc3ce00640 1 -- 172.21.15.37:0/3842266972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc38163250 msgr2=0x7efc3814cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc3ce00640 1 --2- 172.21.15.37:0/3842266972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc38163250 0x7efc3814cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc3ce00640 1 -- 172.21.15.37:0/3842266972 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3815cbb0 con 0x7efc380ce7d0 2024-05-30T06:50:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc3d800640 1 --2- 172.21.15.37:0/3842266972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc38163250 0x7efc3814cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc3ce00640 1 --2- 172.21.15.37:0/3842266972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc380ce7d0 0x7efc3815c060 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0af040 tx=0x7efc2c019160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:16.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc34c00640 1 -- 172.21.15.37:0/3842266972 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0b9020 con 0x7efc380ce7d0 2024-05-30T06:50:16.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc34c00640 1 -- 172.21.15.37:0/3842266972 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2c0b5410 con 0x7efc380ce7d0 2024-05-30T06:50:16.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc34c00640 1 -- 172.21.15.37:0/3842266972 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0b1040 con 0x7efc380ce7d0 2024-05-30T06:50:16.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc3f800640 1 -- 172.21.15.37:0/3842266972 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3815ce90 con 0x7efc380ce7d0 2024-05-30T06:50:16.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc3f800640 1 -- 172.21.15.37:0/3842266972 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3815d450 con 0x7efc380ce7d0 2024-05-30T06:50:16.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc3f800640 1 -- 172.21.15.37:0/3842266972 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc38068bc0 con 0x7efc380ce7d0 2024-05-30T06:50:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc34c00640 1 -- 172.21.15.37:0/3842266972 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7efc2c0bc020 con 0x7efc380ce7d0 2024-05-30T06:50:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.213+0000 7efc34c00640 1 --2- 172.21.15.37:0/3842266972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efc18069130 0x7efc1806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.217+0000 7efc34c00640 1 -- 172.21.15.37:0/3842266972 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7efc2c11f1f0 con 0x7efc380ce7d0 2024-05-30T06:50:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.217+0000 7efc37e00640 1 --2- 172.21.15.37:0/3842266972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efc18069130 0x7efc1806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.217+0000 7efc37e00640 1 --2- 172.21.15.37:0/3842266972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efc18069130 0x7efc1806b5f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efc24007fd0 tx=0x7efc24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:16.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.217+0000 7efc34c00640 1 -- 172.21.15.37:0/3842266972 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efc2c0c3030 con 0x7efc380ce7d0 2024-05-30T06:50:16.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.385+0000 7efc3f800640 1 -- 172.21.15.37:0/3842266972 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efc380b30b0 con 0x7efc380ce7d0 2024-05-30T06:50:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.385+0000 7efc34c00640 1 -- 172.21.15.37:0/3842266972 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7efc2c016070 con 0x7efc380ce7d0 2024-05-30T06:50:16.387 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:50:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.389+0000 7efc3f800640 1 -- 172.21.15.37:0/3842266972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efc18069130 msgr2=0x7efc1806b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.389+0000 7efc3f800640 1 --2- 172.21.15.37:0/3842266972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efc18069130 0x7efc1806b5f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efc24007fd0 tx=0x7efc24009040 comp rx=0 tx=0).stop 2024-05-30T06:50:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.389+0000 7efc3f800640 1 -- 172.21.15.37:0/3842266972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc380ce7d0 msgr2=0x7efc3815c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.389+0000 7efc3f800640 1 --2- 172.21.15.37:0/3842266972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc380ce7d0 0x7efc3815c060 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0af040 tx=0x7efc2c019160 comp rx=0 tx=0).stop 2024-05-30T06:50:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.389+0000 7efc3f800640 1 -- 172.21.15.37:0/3842266972 shutdown_connections 2024-05-30T06:50:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.389+0000 7efc3f800640 1 --2- 172.21.15.37:0/3842266972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc38163250 0x7efc3814cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.389+0000 7efc3f800640 1 --2- 172.21.15.37:0/3842266972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc38162e70 0x7efc3814c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.389+0000 7efc3f800640 1 --2- 172.21.15.37:0/3842266972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efc18069130 0x7efc1806b5f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.389+0000 7efc3f800640 1 --2- 172.21.15.37:0/3842266972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc380ce7d0 0x7efc3815c060 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.389+0000 7efc3f800640 1 -- 172.21.15.37:0/3842266972 >> 172.21.15.37:0/3842266972 conn(0x7efc3806bf60 msgr2=0x7efc380b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.389+0000 7efc3f800640 1 -- 172.21.15.37:0/3842266972 shutdown_connections 2024-05-30T06:50:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.389+0000 7efc3f800640 1 -- 172.21.15.37:0/3842266972 wait complete. 2024-05-30T06:50:16.409 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:50:16.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74b2800640 1 Processor -- start 2024-05-30T06:50:16.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74b2800640 1 -- start start 2024-05-30T06:50:16.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74b2800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f74ac15d350 0x7f74ac06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74b2800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74ac142030 con 0x7f74ac0b59d0 2024-05-30T06:50:16.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74b2800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74ac142310 con 0x7f74ac15d7e0 2024-05-30T06:50:16.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74b2800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f74ac1425f0 con 0x7f74ac15d350 2024-05-30T06:50:16.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74ab400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f74ac0b59d0 0x7f74ac0b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38802/0 (socket says 172.21.15.37:38802) 2024-05-30T06:50:16.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74ab400640 1 -- 172.21.15.37:0/4205477382 learned_addr learned my addr 172.21.15.37:0/4205477382 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:16.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74a2a00640 1 --2- 172.21.15.37:0/4205477382 >> v2:172.21.15.105:3300/0 conn(0x7f74ac15d350 0x7f74ac06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3754850400 0 0) 0x7f74ac142030 con 0x7f74ac0b59d0 2024-05-30T06:50:16.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7490003530 con 0x7f74ac0b59d0 2024-05-30T06:50:16.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1498658563 0 0) 0x7f7490003530 con 0x7f74ac0b59d0 2024-05-30T06:50:16.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 >> v2:172.21.15.105:3300/0 conn(0x7f74ac15d350 msgr2=0x7f74ac06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:16.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 --2- 172.21.15.37:0/4205477382 >> v2:172.21.15.105:3300/0 conn(0x7f74ac15d350 0x7f74ac06df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 >> v1:172.21.15.105:6789/0 conn(0x7f74ac15d7e0 legacy=0x7f74ac06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:16.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ac1428d0 con 0x7f74ac0b59d0 2024-05-30T06:50:16.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f749c001680 con 0x7f74ac0b59d0 2024-05-30T06:50:16.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 >> v1:172.21.15.37:6789/0 conn(0x7f74ac0b59d0 legacy=0x7f74ac0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:16.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 --2- 172.21.15.37:0/4205477382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74900039f0 0x7f7490003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 --2- 172.21.15.37:0/4205477382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7490004810 0x7f7490004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 --2- 172.21.15.37:0/4205477382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74900051d0 0x7f749000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74ac1425f0 con 0x7f74900051d0 2024-05-30T06:50:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f749000c0a0 con 0x7f7490004810 2024-05-30T06:50:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f749000c2a0 con 0x7f74900039f0 2024-05-30T06:50:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74ab400640 1 --2- 172.21.15.37:0/4205477382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74900039f0 0x7f7490003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.553+0000 7f74abe00640 1 --2- 172.21.15.37:0/4205477382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74900051d0 0x7f749000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.557+0000 7f74a2a00640 1 --2- 172.21.15.37:0/4205477382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7490004810 0x7f7490004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.557+0000 7f74ab400640 1 -- 172.21.15.37:0/4205477382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7490004810 msgr2=0x7f7490004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.557+0000 7f74ab400640 1 --2- 172.21.15.37:0/4205477382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7490004810 0x7f7490004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.557+0000 7f74ab400640 1 -- 172.21.15.37:0/4205477382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74900051d0 msgr2=0x7f749000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.557+0000 7f74ab400640 1 --2- 172.21.15.37:0/4205477382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74900051d0 0x7f749000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.557+0000 7f74ab400640 1 -- 172.21.15.37:0/4205477382 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7490003530 con 0x7f74900039f0 2024-05-30T06:50:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.557+0000 7f74abe00640 1 -- 172.21.15.37:0/4205477382 reap_dead start 2024-05-30T06:50:16.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.557+0000 7f74a2a00640 1 --2- 172.21.15.37:0/4205477382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7490004810 0x7f7490004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:16.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.557+0000 7f74ab400640 1 --2- 172.21.15.37:0/4205477382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74900039f0 0x7f7490003e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f749c00c210 tx=0x7f749c01cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cf3ba0436a48290 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:16.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.557+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c007d40 con 0x7f74900039f0 2024-05-30T06:50:16.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.557+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f749c0a9070 con 0x7f74900039f0 2024-05-30T06:50:16.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.557+0000 7f74aaa00640 1 -- 172.21.15.37:0/4205477382 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c0a5e40 con 0x7f74900039f0 2024-05-30T06:50:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 -- 172.21.15.37:0/4205477382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74900039f0 msgr2=0x7f7490003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 --2- 172.21.15.37:0/4205477382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74900039f0 0x7f7490003e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f749c00c210 tx=0x7f749c01cca0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 -- 172.21.15.37:0/4205477382 shutdown_connections 2024-05-30T06:50:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 --2- 172.21.15.37:0/4205477382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74900039f0 0x7f7490003e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 -- 172.21.15.37:0/4205477382 >> 172.21.15.37:0/4205477382 conn(0x7f74ac06bf60 msgr2=0x7f74ac0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 -- 172.21.15.37:0/4205477382 shutdown_connections 2024-05-30T06:50:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 -- 172.21.15.37:0/4205477382 wait complete. 2024-05-30T06:50:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 Processor -- start 2024-05-30T06:50:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 -- start start 2024-05-30T06:50:16.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74900039f0 0x7f74ac15dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ac13cdf0 0x7f74ac152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74ac1f7d60 0x7f74ac1f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74ac0b00a0 con 0x7f74ac1f7d60 2024-05-30T06:50:16.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74ac0aff20 con 0x7f74ac13cdf0 2024-05-30T06:50:16.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74b2800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f74ac13f860 con 0x7f74900039f0 2024-05-30T06:50:16.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74abe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74ac1f7d60 0x7f74ac1f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74ab400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74900039f0 0x7f74ac15dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74a2a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ac13cdf0 0x7f74ac152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74ab400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74900039f0 0x7f74ac15dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:54552/0 (socket says 172.21.15.37:54552) 2024-05-30T06:50:16.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.561+0000 7f74ab400640 1 -- 172.21.15.37:0/354747663 learned_addr learned my addr 172.21.15.37:0/354747663 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74ab400640 1 -- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ac13cdf0 msgr2=0x7f74ac152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74ab400640 1 --2- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ac13cdf0 0x7f74ac152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74ab400640 1 -- 172.21.15.37:0/354747663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74ac1f7d60 msgr2=0x7f74ac1f81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74ab400640 1 --2- 172.21.15.37:0/354747663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74ac1f7d60 0x7f74ac1f81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74ab400640 1 -- 172.21.15.37:0/354747663 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ac153390 con 0x7f74900039f0 2024-05-30T06:50:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74a2a00640 1 --2- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ac13cdf0 0x7f74ac152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74ab400640 1 --2- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74900039f0 0x7f74ac15dd80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f749c01cad0 tx=0x7f7490005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74a3e00640 1 -- 172.21.15.37:0/354747663 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c0a5bb0 con 0x7f74900039f0 2024-05-30T06:50:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74a3e00640 1 -- 172.21.15.37:0/354747663 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f749c0a5d50 con 0x7f74900039f0 2024-05-30T06:50:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74a3e00640 1 -- 172.21.15.37:0/354747663 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c0073a0 con 0x7f74900039f0 2024-05-30T06:50:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74b2800640 1 -- 172.21.15.37:0/354747663 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74ac15bd00 con 0x7f74900039f0 2024-05-30T06:50:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74b2800640 1 -- 172.21.15.37:0/354747663 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74ac15c2c0 con 0x7f74900039f0 2024-05-30T06:50:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74b2800640 1 -- 172.21.15.37:0/354747663 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74ac068bc0 con 0x7f74900039f0 2024-05-30T06:50:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74a3e00640 1 -- 172.21.15.37:0/354747663 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f749c007540 con 0x7f74900039f0 2024-05-30T06:50:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74a3e00640 1 --2- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7488069130 0x7f748806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74a3e00640 1 -- 172.21.15.37:0/354747663 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(60..60 src has 1..60) ==== 5709+0+0 (secure 0 0 0) 0x7f749c11f050 con 0x7f74900039f0 2024-05-30T06:50:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.565+0000 7f74a2a00640 1 --2- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7488069130 0x7f748806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.569+0000 7f74a2a00640 1 --2- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7488069130 0x7f748806b5f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f74ac15e5a0 tx=0x7f7494009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:16.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.573+0000 7f74a3e00640 1 -- 172.21.15.37:0/354747663 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f749c0169b0 con 0x7f74900039f0 2024-05-30T06:50:16.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.821+0000 7f74b2800640 1 -- 172.21.15.37:0/354747663 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f74ac15cf40 con 0x7f74900039f0 2024-05-30T06:50:16.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.825+0000 7f74a3e00640 1 -- 172.21.15.37:0/354747663 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) ==== 104+0+11 (secure 0 0 0) 0x7f749c0f0db0 con 0x7f74900039f0 2024-05-30T06:50:16.826 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:50:16.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.829+0000 7f74b2800640 1 -- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7488069130 msgr2=0x7f748806b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:16.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.829+0000 7f74b2800640 1 --2- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7488069130 0x7f748806b5f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f74ac15e5a0 tx=0x7f7494009190 comp rx=0 tx=0).stop 2024-05-30T06:50:16.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.829+0000 7f74b2800640 1 -- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74900039f0 msgr2=0x7f74ac15dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:16.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.829+0000 7f74b2800640 1 --2- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74900039f0 0x7f74ac15dd80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f749c01cad0 tx=0x7f7490005840 comp rx=0 tx=0).stop 2024-05-30T06:50:16.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.829+0000 7f74b2800640 1 -- 172.21.15.37:0/354747663 shutdown_connections 2024-05-30T06:50:16.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.829+0000 7f74b2800640 1 --2- 172.21.15.37:0/354747663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74ac1f7d60 0x7f74ac1f81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.829+0000 7f74b2800640 1 --2- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7488069130 0x7f748806b5f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.829+0000 7f74b2800640 1 --2- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74ac13cdf0 0x7f74ac152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.829+0000 7f74b2800640 1 --2- 172.21.15.37:0/354747663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f74900039f0 0x7f74ac15dd80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:16.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.829+0000 7f74b2800640 1 -- 172.21.15.37:0/354747663 >> 172.21.15.37:0/354747663 conn(0x7f74ac06bf60 msgr2=0x7f74ac140480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:16.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.829+0000 7f74b2800640 1 -- 172.21.15.37:0/354747663 shutdown_connections 2024-05-30T06:50:16.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:16.829+0000 7f74b2800640 1 -- 172.21.15.37:0/354747663 wait complete. 2024-05-30T06:50:16.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:50:17.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.109+0000 7f4000800640 1 Processor -- start 2024-05-30T06:50:17.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.109+0000 7f4000800640 1 -- start start 2024-05-30T06:50:17.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f4000800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3ff8163250 0x7f3ff81636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f4000800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ff80ccfc0 con 0x7f3ff80ce7d0 2024-05-30T06:50:17.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f4000800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ff8164190 con 0x7f3ff8162e70 2024-05-30T06:50:17.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f4000800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3ff806f8e0 con 0x7f3ff8163250 2024-05-30T06:50:17.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffde00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3ff8162e70 0x7f3ff80cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:37360/0 (socket says 172.21.15.37:37360) 2024-05-30T06:50:17.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffde00640 1 -- 172.21.15.37:0/1019102789 learned_addr learned my addr 172.21.15.37:0/1019102789 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:17.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffd400640 1 --2- 172.21.15.37:0/1019102789 >> v2:172.21.15.37:3300/0 conn(0x7f3ff8163250 0x7f3ff81636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:17.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1067889275 0 0) 0x7f3ff8164190 con 0x7f3ff8162e70 2024-05-30T06:50:17.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fe0003530 con 0x7f3ff8162e70 2024-05-30T06:50:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1423538240 0 0) 0x7f3fe0003530 con 0x7f3ff8162e70 2024-05-30T06:50:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 >> v2:172.21.15.37:3300/0 conn(0x7f3ff8163250 msgr2=0x7f3ff81636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 --2- 172.21.15.37:0/1019102789 >> v2:172.21.15.37:3300/0 conn(0x7f3ff8163250 0x7f3ff81636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 >> v1:172.21.15.37:6789/0 conn(0x7f3ff80ce7d0 legacy=0x7f3ff80cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff806ecd0 con 0x7f3ff8162e70 2024-05-30T06:50:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f3fec001680 con 0x7f3ff8162e70 2024-05-30T06:50:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 >> v1:172.21.15.105:6789/0 conn(0x7f3ff8162e70 legacy=0x7f3ff80cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 --2- 172.21.15.37:0/1019102789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe00039c0 0x7f3fe0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 --2- 172.21.15.37:0/1019102789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fe0004810 0x7f3fe0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 --2- 172.21.15.37:0/1019102789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fe00051d0 0x7f3fe000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff806f8e0 con 0x7f3fe00039c0 2024-05-30T06:50:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe000c170 con 0x7f3fe00051d0 2024-05-30T06:50:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe000c370 con 0x7f3fe0004810 2024-05-30T06:50:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffde00640 1 --2- 172.21.15.37:0/1019102789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe00039c0 0x7f3fe0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffd400640 1 --2- 172.21.15.37:0/1019102789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fe0004810 0x7f3fe0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffde00640 1 -- 172.21.15.37:0/1019102789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fe0004810 msgr2=0x7f3fe0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffde00640 1 --2- 172.21.15.37:0/1019102789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fe0004810 0x7f3fe0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffde00640 1 -- 172.21.15.37:0/1019102789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fe00051d0 msgr2=0x7f3fe000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffde00640 1 --2- 172.21.15.37:0/1019102789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fe00051d0 0x7f3fe000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffde00640 1 -- 172.21.15.37:0/1019102789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe0003530 con 0x7f3fe00039c0 2024-05-30T06:50:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.113+0000 7f3ffe800640 1 -- 172.21.15.37:0/1019102789 reap_dead start 2024-05-30T06:50:17.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.117+0000 7f3ffd400640 1 --2- 172.21.15.37:0/1019102789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fe0004810 0x7f3fe0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.117+0000 7f3ffde00640 1 --2- 172.21.15.37:0/1019102789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe00039c0 0x7f3fe0003de0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00c240 tx=0x7f3fec01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff91ccaefbe68fdf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:17.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.121+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec007d20 con 0x7f3fe00039c0 2024-05-30T06:50:17.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.121+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fec0a9070 con 0x7f3fe00039c0 2024-05-30T06:50:17.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.121+0000 7f3ffca00640 1 -- 172.21.15.37:0/1019102789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec0a5e10 con 0x7f3fe00039c0 2024-05-30T06:50:17.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.121+0000 7f4000800640 1 -- 172.21.15.37:0/1019102789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe00039c0 msgr2=0x7f3fe0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:17.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.121+0000 7f4000800640 1 --2- 172.21.15.37:0/1019102789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe00039c0 0x7f3fe0003de0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00c240 tx=0x7f3fec01cc50 comp rx=0 tx=0).stop 2024-05-30T06:50:17.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.121+0000 7f4000800640 1 -- 172.21.15.37:0/1019102789 shutdown_connections 2024-05-30T06:50:17.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.121+0000 7f4000800640 1 --2- 172.21.15.37:0/1019102789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe00039c0 0x7f3fe0003de0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.121+0000 7f4000800640 1 -- 172.21.15.37:0/1019102789 >> 172.21.15.37:0/1019102789 conn(0x7f3ff806bf60 msgr2=0x7f3ff80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:17.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.121+0000 7f4000800640 1 -- 172.21.15.37:0/1019102789 shutdown_connections 2024-05-30T06:50:17.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.121+0000 7f4000800640 1 -- 172.21.15.37:0/1019102789 wait complete. 2024-05-30T06:50:17.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.121+0000 7f4000800640 1 Processor -- start 2024-05-30T06:50:17.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f4000800640 1 -- start start 2024-05-30T06:50:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f4000800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fe00039c0 0x7f3ff8146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f4000800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ff81fbe90 0x7f3ff815a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f4000800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ff80b4f30 0x7f3ff80b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f4000800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff80cccc0 con 0x7f3ff80b4f30 2024-05-30T06:50:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f4000800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff806e960 con 0x7f3fe00039c0 2024-05-30T06:50:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f4000800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff80cce40 con 0x7f3ff81fbe90 2024-05-30T06:50:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f3ffe800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ff80b4f30 0x7f3ff80b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f3ffde00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fe00039c0 0x7f3ff8146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f3ffe800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ff80b4f30 0x7f3ff80b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40990/0 (socket says 172.21.15.37:40990) 2024-05-30T06:50:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f3ffd400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ff81fbe90 0x7f3ff815a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:17.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f3ffe800640 1 -- 172.21.15.37:0/3647651371 learned_addr learned my addr 172.21.15.37:0/3647651371 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f3ffe800640 1 -- 172.21.15.37:0/3647651371 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ff81fbe90 msgr2=0x7f3ff815a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f3ffe800640 1 --2- 172.21.15.37:0/3647651371 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ff81fbe90 0x7f3ff815a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f3ffe800640 1 -- 172.21.15.37:0/3647651371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fe00039c0 msgr2=0x7f3ff8146eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f3ffe800640 1 --2- 172.21.15.37:0/3647651371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fe00039c0 0x7f3ff8146eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.125+0000 7f3ffe800640 1 -- 172.21.15.37:0/3647651371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff815be60 con 0x7f3ff80b4f30 2024-05-30T06:50:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.129+0000 7f3ffe800640 1 --2- 172.21.15.37:0/3647651371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ff80b4f30 0x7f3ff80b53c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80ce160 tx=0x7f3ff400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.129+0000 7f3ff2000640 1 -- 172.21.15.37:0/3647651371 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4017070 con 0x7f3ff80b4f30 2024-05-30T06:50:17.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.129+0000 7f3ff2000640 1 -- 172.21.15.37:0/3647651371 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff40070d0 con 0x7f3ff80b4f30 2024-05-30T06:50:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.129+0000 7f3ff2000640 1 -- 172.21.15.37:0/3647651371 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff40074c0 con 0x7f3ff80b4f30 2024-05-30T06:50:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.129+0000 7f4000800640 1 -- 172.21.15.37:0/3647651371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff815b020 con 0x7f3ff80b4f30 2024-05-30T06:50:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.129+0000 7f4000800640 1 -- 172.21.15.37:0/3647651371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff815b2e0 con 0x7f3ff80b4f30 2024-05-30T06:50:17.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.129+0000 7f4000800640 1 -- 172.21.15.37:0/3647651371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff8068bc0 con 0x7f3ff80b4f30 2024-05-30T06:50:17.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.133+0000 7f3ff2000640 1 -- 172.21.15.37:0/3647651371 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f3ff401a070 con 0x7f3ff80b4f30 2024-05-30T06:50:17.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.137+0000 7f3ff2000640 1 --2- 172.21.15.37:0/3647651371 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3fdc0691d0 0x7f3fdc06b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.137+0000 7f3ff2000640 1 -- 172.21.15.37:0/3647651371 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7f3ff4084d40 con 0x7f3ff80b4f30 2024-05-30T06:50:17.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.137+0000 7f3ffde00640 1 --2- 172.21.15.37:0/3647651371 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3fdc0691d0 0x7f3fdc06b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:17.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.137+0000 7f3ffde00640 1 --2- 172.21.15.37:0/3647651371 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3fdc0691d0 0x7f3fdc06b690 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0ab000 tx=0x7f3fec0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:17.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.145+0000 7f3ff2000640 1 -- 172.21.15.37:0/3647651371 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3ff4021020 con 0x7f3ff80b4f30 2024-05-30T06:50:17.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.473+0000 7f4000800640 1 -- 172.21.15.37:0/3647651371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3ff815ae00 con 0x7f3ff80b4f30 2024-05-30T06:50:17.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.473+0000 7f3ff2000640 1 -- 172.21.15.37:0/3647651371 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) ==== 100+0+11 (secure 0 0 0) 0x7f3ff4056450 con 0x7f3ff80b4f30 2024-05-30T06:50:17.476 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:50:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.477+0000 7f4000800640 1 -- 172.21.15.37:0/3647651371 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3fdc0691d0 msgr2=0x7f3fdc06b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.477+0000 7f4000800640 1 --2- 172.21.15.37:0/3647651371 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3fdc0691d0 0x7f3fdc06b690 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0ab000 tx=0x7f3fec0a7070 comp rx=0 tx=0).stop 2024-05-30T06:50:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.477+0000 7f4000800640 1 -- 172.21.15.37:0/3647651371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ff80b4f30 msgr2=0x7f3ff80b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.477+0000 7f4000800640 1 --2- 172.21.15.37:0/3647651371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ff80b4f30 0x7f3ff80b53c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80ce160 tx=0x7f3ff400c980 comp rx=0 tx=0).stop 2024-05-30T06:50:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.477+0000 7f4000800640 1 -- 172.21.15.37:0/3647651371 shutdown_connections 2024-05-30T06:50:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.477+0000 7f4000800640 1 --2- 172.21.15.37:0/3647651371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ff80b4f30 0x7f3ff80b53c0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.477+0000 7f4000800640 1 --2- 172.21.15.37:0/3647651371 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ff81fbe90 0x7f3ff815a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.477+0000 7f4000800640 1 --2- 172.21.15.37:0/3647651371 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3fdc0691d0 0x7f3fdc06b690 secure :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3fec0ab000 tx=0x7f3fec0a7070 comp rx=0 tx=0).stop 2024-05-30T06:50:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.477+0000 7f4000800640 1 --2- 172.21.15.37:0/3647651371 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fe00039c0 0x7f3ff8146eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.477+0000 7f4000800640 1 -- 172.21.15.37:0/3647651371 >> 172.21.15.37:0/3647651371 conn(0x7f3ff806bf60 msgr2=0x7f3ff80b0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:17.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.481+0000 7f4000800640 1 -- 172.21.15.37:0/3647651371 shutdown_connections 2024-05-30T06:50:17.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.481+0000 7f4000800640 1 -- 172.21.15.37:0/3647651371 wait complete. 2024-05-30T06:50:17.511 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T06:50:17.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fcef2600640 1 Processor -- start 2024-05-30T06:50:17.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fcef2600640 1 -- start start 2024-05-30T06:50:17.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fcef2600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fceec0b59d0 0x7fceec0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fcef2600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fceec15d350 0x7fceec160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fcef2600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceec0b62f0 con 0x7fceec15d7b0 2024-05-30T06:50:17.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fcef2600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fceec142030 con 0x7fceec0b59d0 2024-05-30T06:50:17.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fcef2600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fceec142310 con 0x7fceec15d350 2024-05-30T06:50:17.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fceebe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fceec15d7b0 0x7fceec1607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48204/0 (socket says 172.21.15.37:48204) 2024-05-30T06:50:17.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fceeb400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fceec0b59d0 0x7fceec0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:17.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fceebe00640 1 -- 172.21.15.37:0/2512475689 learned_addr learned my addr 172.21.15.37:0/2512475689 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:17.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fcee2a00640 1 --2- 172.21.15.37:0/2512475689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fceec15d350 0x7fceec160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:17.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fceeb400640 1 -- 172.21.15.37:0/2512475689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fceec15d350 msgr2=0x7fceec160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:17.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fceeb400640 1 --2- 172.21.15.37:0/2512475689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fceec15d350 0x7fceec160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fceeb400640 1 -- 172.21.15.37:0/2512475689 >> v1:172.21.15.37:6789/0 conn(0x7fceec15d7b0 legacy=0x7fceec1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:17.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fceeaa00640 1 -- 172.21.15.37:0/2512475689 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2847572014 0 0) 0x7fceec0b62f0 con 0x7fceec15d7b0 2024-05-30T06:50:17.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.653+0000 7fceeb400640 1 -- 172.21.15.37:0/2512475689 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceec1425f0 con 0x7fceec0b59d0 2024-05-30T06:50:17.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.657+0000 7fceeb400640 1 --2- 172.21.15.37:0/2512475689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0b59d0 0x7fceec0b5db0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0097c0 tx=0x7fcedc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3f6917271d3003 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.657+0000 7fceeaa00640 1 -- 172.21.15.37:0/2512475689 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0b5070 con 0x7fceec0b59d0 2024-05-30T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.657+0000 7fceeaa00640 1 -- 172.21.15.37:0/2512475689 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcedc0a8990 con 0x7fceec0b59d0 2024-05-30T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.657+0000 7fceeaa00640 1 -- 172.21.15.37:0/2512475689 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0a8d60 con 0x7fceec0b59d0 2024-05-30T06:50:17.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.657+0000 7fcef2600640 1 -- 172.21.15.37:0/2512475689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0b59d0 msgr2=0x7fceec0b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.657+0000 7fcef2600640 1 --2- 172.21.15.37:0/2512475689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0b59d0 0x7fceec0b5db0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0097c0 tx=0x7fcedc01ec90 comp rx=0 tx=0).stop 2024-05-30T06:50:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.657+0000 7fcef2600640 1 -- 172.21.15.37:0/2512475689 shutdown_connections 2024-05-30T06:50:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.657+0000 7fcef2600640 1 --2- 172.21.15.37:0/2512475689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fceec15d350 0x7fceec160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.657+0000 7fcef2600640 1 --2- 172.21.15.37:0/2512475689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec0b59d0 0x7fceec0b5db0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.657+0000 7fcef2600640 1 -- 172.21.15.37:0/2512475689 >> 172.21.15.37:0/2512475689 conn(0x7fceec06bf60 msgr2=0x7fceec0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.657+0000 7fcef2600640 1 -- 172.21.15.37:0/2512475689 shutdown_connections 2024-05-30T06:50:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.657+0000 7fcef2600640 1 -- 172.21.15.37:0/2512475689 wait complete. 2024-05-30T06:50:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcef2600640 1 Processor -- start 2024-05-30T06:50:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcef2600640 1 -- start start 2024-05-30T06:50:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcef2600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fceec0b59d0 0x7fceec1572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcef2600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fceec15d350 0x7fceec0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcef2600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec15d7b0 0x7fceec0b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcef2600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fceec13fe60 con 0x7fceec15d7b0 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcef2600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fceec13fce0 con 0x7fceec0b59d0 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcef2600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fceec0aff20 con 0x7fceec15d350 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fceebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec15d7b0 0x7fceec0b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fceebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec15d7b0 0x7fceec0b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56678/0 (socket says 172.21.15.37:56678) 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fceebe00640 1 -- 172.21.15.37:0/2110595154 learned_addr learned my addr 172.21.15.37:0/2110595154 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcee2a00640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fceec15d350 0x7fceec0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fceeb400640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fceec0b59d0 0x7fceec1572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fceebe00640 1 -- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fceec15d350 msgr2=0x7fceec0b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fceebe00640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fceec15d350 0x7fceec0b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fceebe00640 1 -- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fceec0b59d0 msgr2=0x7fceec1572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fceebe00640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fceec0b59d0 0x7fceec1572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fceebe00640 1 -- 172.21.15.37:0/2110595154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceec0b4e40 con 0x7fceec15d7b0 2024-05-30T06:50:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fceebe00640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec15d7b0 0x7fceec0b3640 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcee400c7d0 tx=0x7fcee400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcee3e00640 1 -- 172.21.15.37:0/2110595154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4018070 con 0x7fceec15d7b0 2024-05-30T06:50:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcee3e00640 1 -- 172.21.15.37:0/2110595154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee400a640 con 0x7fceec15d7b0 2024-05-30T06:50:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcee3e00640 1 -- 172.21.15.37:0/2110595154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee400aa70 con 0x7fceec15d7b0 2024-05-30T06:50:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcef2600640 1 -- 172.21.15.37:0/2110595154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceec15ca70 con 0x7fceec15d7b0 2024-05-30T06:50:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcef2600640 1 -- 172.21.15.37:0/2110595154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceec15b1c0 con 0x7fceec15d7b0 2024-05-30T06:50:17.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.661+0000 7fcef2600640 1 -- 172.21.15.37:0/2110595154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceec068bc0 con 0x7fceec15d7b0 2024-05-30T06:50:17.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.665+0000 7fcee3e00640 1 -- 172.21.15.37:0/2110595154 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fcee401b070 con 0x7fceec15d7b0 2024-05-30T06:50:17.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.665+0000 7fcee3e00640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcec8069100 0x7fcec806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:17.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.665+0000 7fcee3e00640 1 -- 172.21.15.37:0/2110595154 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7fcee4084bd0 con 0x7fceec15d7b0 2024-05-30T06:50:17.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.665+0000 7fceeb400640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcec8069100 0x7fcec806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:17.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.665+0000 7fceeb400640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcec8069100 0x7fcec806b5c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0b2000 tx=0x7fcedc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:17.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.669+0000 7fcee3e00640 1 -- 172.21.15.37:0/2110595154 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcee40562e0 con 0x7fceec15d7b0 2024-05-30T06:50:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.849+0000 7fcef2600640 1 -- 172.21.15.37:0/2110595154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fceec06f0a0 con 0x7fceec15d7b0 2024-05-30T06:50:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.849+0000 7fcee3e00640 1 -- 172.21.15.37:0/2110595154 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) ==== 80+0+0 (secure 0 0 0) 0x7fcee405a5e0 con 0x7fceec15d7b0 2024-05-30T06:50:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-30T06:50:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.853+0000 7fcef2600640 1 -- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcec8069100 msgr2=0x7fcec806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.853+0000 7fcef2600640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcec8069100 0x7fcec806b5c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0b2000 tx=0x7fcedc008040 comp rx=0 tx=0).stop 2024-05-30T06:50:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.853+0000 7fcef2600640 1 -- 172.21.15.37:0/2110595154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec15d7b0 msgr2=0x7fceec0b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.853+0000 7fcef2600640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec15d7b0 0x7fceec0b3640 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcee400c7d0 tx=0x7fcee400cc90 comp rx=0 tx=0).stop 2024-05-30T06:50:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.853+0000 7fcef2600640 1 -- 172.21.15.37:0/2110595154 shutdown_connections 2024-05-30T06:50:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.853+0000 7fcef2600640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceec15d7b0 0x7fceec0b3640 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.853+0000 7fcef2600640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fceec15d350 0x7fceec0b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.853+0000 7fcef2600640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcec8069100 0x7fcec806b5c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.853+0000 7fcef2600640 1 --2- 172.21.15.37:0/2110595154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fceec0b59d0 0x7fceec1572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.853+0000 7fcef2600640 1 -- 172.21.15.37:0/2110595154 >> 172.21.15.37:0/2110595154 conn(0x7fceec06bf60 msgr2=0x7fceec0ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.853+0000 7fcef2600640 1 -- 172.21.15.37:0/2110595154 shutdown_connections 2024-05-30T06:50:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:17.853+0000 7fcef2600640 1 -- 172.21.15.37:0/2110595154 wait complete. 2024-05-30T06:50:17.874 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T06:50:17.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:50:17.874 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-30T06:50:17.939 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:50:17.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:50:17.939 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T06:50:17.955 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:50:17.955 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:50:17.955 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:50:17.964 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:50:17.964 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:50:17.964 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:50:17.964 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:50:18.008 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:50:18.008 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:50:18.009 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:50:18.009 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:50:18.016 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:50:18.017 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:50:18.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f882de00640 1 Processor -- start 2024-05-30T06:50:18.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f882de00640 1 -- start start 2024-05-30T06:50:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f882de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f882806e000 0x7f88280ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f882de00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f88280cee10 0x7f882806f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f882de00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88280cd120 con 0x7f882815cd80 2024-05-30T06:50:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f882de00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f88280a9530 con 0x7f88280cee10 2024-05-30T06:50:18.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f882de00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f88280cd400 con 0x7f882806e000 2024-05-30T06:50:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8826000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f882815cd80 0x7f88280ce700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48218/0 (socket says 172.21.15.37:48218) 2024-05-30T06:50:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8826000640 1 -- 172.21.15.37:0/3323449567 learned_addr learned my addr 172.21.15.37:0/3323449567 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4113563405 0 0) 0x7f88280cd120 con 0x7f882815cd80 2024-05-30T06:50:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8827400640 1 --2- 172.21.15.37:0/3323449567 >> v2:172.21.15.105:3300/0 conn(0x7f88280cee10 0x7f882806f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f880c003530 con 0x7f882815cd80 2024-05-30T06:50:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8826a00640 1 --2- 172.21.15.37:0/3323449567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f882806e000 0x7f88280ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4160827717 0 0) 0x7f880c003530 con 0x7f882815cd80 2024-05-30T06:50:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f882806e000 msgr2=0x7f88280ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 --2- 172.21.15.37:0/3323449567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f882806e000 0x7f88280ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 >> v2:172.21.15.105:3300/0 conn(0x7f88280cee10 msgr2=0x7f882806f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 --2- 172.21.15.37:0/3323449567 >> v2:172.21.15.105:3300/0 conn(0x7f88280cee10 0x7f882806f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88280cd6e0 con 0x7f882815cd80 2024-05-30T06:50:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f8814001680 con 0x7f882815cd80 2024-05-30T06:50:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 >> v1:172.21.15.37:6789/0 conn(0x7f882815cd80 legacy=0x7f88280ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 --2- 172.21.15.37:0/3323449567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f882806e000 0x7f880c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 --2- 172.21.15.37:0/3323449567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f880c003f40 0x7f880c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 --2- 172.21.15.37:0/3323449567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f880c004d50 0x7f880c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f88280cd400 con 0x7f880c003f40 2024-05-30T06:50:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f880c00b9d0 con 0x7f880c004d50 2024-05-30T06:50:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f880c00bb80 con 0x7f882806e000 2024-05-30T06:50:18.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8826000640 1 --2- 172.21.15.37:0/3323449567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f880c003f40 0x7f880c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8827400640 1 --2- 172.21.15.37:0/3323449567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f880c004d50 0x7f880c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8826a00640 1 --2- 172.21.15.37:0/3323449567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f882806e000 0x7f880c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8826000640 1 -- 172.21.15.37:0/3323449567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f882806e000 msgr2=0x7f880c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8826000640 1 --2- 172.21.15.37:0/3323449567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f882806e000 0x7f880c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8826000640 1 -- 172.21.15.37:0/3323449567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f880c004d50 msgr2=0x7f880c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8826000640 1 --2- 172.21.15.37:0/3323449567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f880c004d50 0x7f880c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.193+0000 7f8826000640 1 -- 172.21.15.37:0/3323449567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880c003530 con 0x7f880c003f40 2024-05-30T06:50:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.197+0000 7f8826000640 1 --2- 172.21.15.37:0/3323449567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f880c003f40 0x7f880c004810 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f881400c2c0 tx=0x7f881401cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a79506d9b7240e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:18.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.197+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814007d60 con 0x7f880c003f40 2024-05-30T06:50:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.197+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88140a9020 con 0x7f880c003f40 2024-05-30T06:50:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.197+0000 7f8825600640 1 -- 172.21.15.37:0/3323449567 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88140a5bb0 con 0x7f880c003f40 2024-05-30T06:50:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.197+0000 7f882de00640 1 -- 172.21.15.37:0/3323449567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f880c003f40 msgr2=0x7f880c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.197+0000 7f882de00640 1 --2- 172.21.15.37:0/3323449567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f880c003f40 0x7f880c004810 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f881400c2c0 tx=0x7f881401cd40 comp rx=0 tx=0).stop 2024-05-30T06:50:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.197+0000 7f8827400640 1 -- 172.21.15.37:0/3323449567 reap_dead start 2024-05-30T06:50:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.197+0000 7f882de00640 1 -- 172.21.15.37:0/3323449567 shutdown_connections 2024-05-30T06:50:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.197+0000 7f882de00640 1 -- 172.21.15.37:0/3323449567 >> 172.21.15.37:0/3323449567 conn(0x7f88280b23a0 msgr2=0x7f88280b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.197+0000 7f882de00640 1 -- 172.21.15.37:0/3323449567 shutdown_connections 2024-05-30T06:50:18.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.197+0000 7f882de00640 1 -- 172.21.15.37:0/3323449567 wait complete. 2024-05-30T06:50:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f882de00640 1 Processor -- start 2024-05-30T06:50:18.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f882de00640 1 -- start start 2024-05-30T06:50:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f882de00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f880c003f40 0x7f88281f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f882de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88281f6d40 0x7f88280ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f882de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88281f71c0 0x7f88280abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f882de00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f882806f930 con 0x7f88281f71c0 2024-05-30T06:50:18.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f882de00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88280cdca0 con 0x7f880c003f40 2024-05-30T06:50:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f882de00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f882806fab0 con 0x7f88281f6d40 2024-05-30T06:50:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f8826a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f880c003f40 0x7f88281f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f8826000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88281f6d40 0x7f88280ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f8827400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88281f71c0 0x7f88280abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f8826a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f880c003f40 0x7f88281f5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:49584/0 (socket says 172.21.15.37:49584) 2024-05-30T06:50:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f8826000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88281f6d40 0x7f88280ab820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34488/0 (socket says 172.21.15.37:34488) 2024-05-30T06:50:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f8826a00640 1 -- 172.21.15.37:0/3447060667 learned_addr learned my addr 172.21.15.37:0/3447060667 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f8826a00640 1 -- 172.21.15.37:0/3447060667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88281f6d40 msgr2=0x7f88280ab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f8826a00640 1 --2- 172.21.15.37:0/3447060667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88281f6d40 0x7f88280ab820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f8826a00640 1 -- 172.21.15.37:0/3447060667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88281f71c0 msgr2=0x7f88280abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f8826a00640 1 --2- 172.21.15.37:0/3447060667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88281f71c0 0x7f88280abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f8826a00640 1 -- 172.21.15.37:0/3447060667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8828142af0 con 0x7f880c003f40 2024-05-30T06:50:18.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f8827400640 1 --2- 172.21.15.37:0/3447060667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88281f71c0 0x7f88280abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:18.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f8826a00640 1 --2- 172.21.15.37:0/3447060667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f880c003f40 0x7f88281f5270 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8818011990 tx=0x7f8818011e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f881f400640 1 -- 172.21.15.37:0/3447060667 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881800fad0 con 0x7f880c003f40 2024-05-30T06:50:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f881f400640 1 -- 172.21.15.37:0/3447060667 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f881800fc70 con 0x7f880c003f40 2024-05-30T06:50:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f882de00640 1 -- 172.21.15.37:0/3447060667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8828142dd0 con 0x7f880c003f40 2024-05-30T06:50:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f881f400640 1 -- 172.21.15.37:0/3447060667 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818014440 con 0x7f880c003f40 2024-05-30T06:50:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.201+0000 7f882de00640 1 -- 172.21.15.37:0/3447060667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8828143390 con 0x7f880c003f40 2024-05-30T06:50:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.205+0000 7f882de00640 1 -- 172.21.15.37:0/3447060667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8828068b20 con 0x7f880c003f40 2024-05-30T06:50:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.205+0000 7f881f400640 1 -- 172.21.15.37:0/3447060667 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f8818012040 con 0x7f880c003f40 2024-05-30T06:50:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.205+0000 7f881f400640 1 --2- 172.21.15.37:0/3447060667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8808069100 0x7f880806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.205+0000 7f881f400640 1 -- 172.21.15.37:0/3447060667 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7f8818085fd0 con 0x7f880c003f40 2024-05-30T06:50:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.205+0000 7f8826000640 1 --2- 172.21.15.37:0/3447060667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8808069100 0x7f880806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.205+0000 7f8826000640 1 --2- 172.21.15.37:0/3447060667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8808069100 0x7f880806b5c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f88140aa000 tx=0x7f8814001a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:18.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.209+0000 7f881f400640 1 -- 172.21.15.37:0/3447060667 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8818019030 con 0x7f880c003f40 2024-05-30T06:50:18.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f882de00640 1 -- 172.21.15.37:0/3447060667 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88280c9ce0 con 0x7f880c003f40 2024-05-30T06:50:18.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f881f400640 1 -- 172.21.15.37:0/3447060667 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5181 (secure 0 0 0) 0x7f88180576e0 con 0x7f880c003f40 2024-05-30T06:50:18.414 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:18.414 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2689846178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2689846178},{"type":"v1","addr":"172.21.15.37:6834","nonce":2689846178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1799611833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1799611833},{"type":"v1","addr":"172.21.15.37:6835","nonce":1799611833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/35182660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":35182660},{"type":"v1","addr":"172.21.15.105:6837","nonce":35182660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:48:34.974228+0000","modified":"2024-05-30T06:48:37.938821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6055":{"gid":6055,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2127976173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2127976173},{"type":"v1","addr":"172.21.15.105:6835","nonce":2127976173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6055,"qdb_cluster":[6055]},"id":4}]} 2024-05-30T06:50:18.415 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 38 2024-05-30T06:50:18.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f882de00640 1 -- 172.21.15.37:0/3447060667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8808069100 msgr2=0x7f880806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f882de00640 1 --2- 172.21.15.37:0/3447060667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8808069100 0x7f880806b5c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f88140aa000 tx=0x7f8814001a50 comp rx=0 tx=0).stop 2024-05-30T06:50:18.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f882de00640 1 -- 172.21.15.37:0/3447060667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f880c003f40 msgr2=0x7f88281f5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f882de00640 1 --2- 172.21.15.37:0/3447060667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f880c003f40 0x7f88281f5270 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8818011990 tx=0x7f8818011e50 comp rx=0 tx=0).stop 2024-05-30T06:50:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f882de00640 1 -- 172.21.15.37:0/3447060667 shutdown_connections 2024-05-30T06:50:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f882de00640 1 --2- 172.21.15.37:0/3447060667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88281f71c0 0x7f88280abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f882de00640 1 --2- 172.21.15.37:0/3447060667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88281f6d40 0x7f88280ab820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f882de00640 1 --2- 172.21.15.37:0/3447060667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8808069100 0x7f880806b5c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f882de00640 1 --2- 172.21.15.37:0/3447060667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f880c003f40 0x7f88281f5270 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f882de00640 1 -- 172.21.15.37:0/3447060667 >> 172.21.15.37:0/3447060667 conn(0x7f88280b23a0 msgr2=0x7f88280ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f882de00640 1 -- 172.21.15.37:0/3447060667 shutdown_connections 2024-05-30T06:50:18.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.413+0000 7f882de00640 1 -- 172.21.15.37:0/3447060667 wait complete. 2024-05-30T06:50:18.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:50:18.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.577+0000 7fad59800640 1 Processor -- start 2024-05-30T06:50:18.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.577+0000 7fad59800640 1 -- start start 2024-05-30T06:50:18.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.581+0000 7fad59800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fad5409b9a0 0x7fad541625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.581+0000 7fad59800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad54162ae0 0x7fad540ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.581+0000 7fad59800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad5409abe0 con 0x7fad5415e930 2024-05-30T06:50:18.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.581+0000 7fad59800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fad54162f50 con 0x7fad5409b9a0 2024-05-30T06:50:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.581+0000 7fad59800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad5409aec0 con 0x7fad54162ae0 2024-05-30T06:50:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.581+0000 7fad53400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad54162ae0 0x7fad540ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.581+0000 7fad4a000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fad5409b9a0 0x7fad541625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.581+0000 7fad52a00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fad5415e930 0x7fad540d1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47432/0 (socket says 172.21.15.37:47432) 2024-05-30T06:50:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.581+0000 7fad52a00640 1 -- 172.21.15.37:0/3182117681 learned_addr learned my addr 172.21.15.37:0/3182117681 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.581+0000 7fad4a000640 1 -- 172.21.15.37:0/3182117681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad54162ae0 msgr2=0x7fad540ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.581+0000 7fad4a000640 1 --2- 172.21.15.37:0/3182117681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad54162ae0 0x7fad540ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.581+0000 7fad4a000640 1 -- 172.21.15.37:0/3182117681 >> v1:172.21.15.105:6789/0 conn(0x7fad5415e930 legacy=0x7fad540d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.581+0000 7fad4a000640 1 -- 172.21.15.37:0/3182117681 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5409b1a0 con 0x7fad5409b9a0 2024-05-30T06:50:18.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad4a000640 1 --2- 172.21.15.37:0/3182117681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5409b9a0 0x7fad541625a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0097c0 tx=0x7fad3c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f90bb39b7a4e4f0b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:18.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad52000640 1 -- 172.21.15.37:0/3182117681 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0b2070 con 0x7fad5409b9a0 2024-05-30T06:50:18.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad52000640 1 -- 172.21.15.37:0/3182117681 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad3c0ad640 con 0x7fad5409b9a0 2024-05-30T06:50:18.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad52000640 1 -- 172.21.15.37:0/3182117681 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0ada10 con 0x7fad5409b9a0 2024-05-30T06:50:18.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 -- 172.21.15.37:0/3182117681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5409b9a0 msgr2=0x7fad541625a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 --2- 172.21.15.37:0/3182117681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5409b9a0 0x7fad541625a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0097c0 tx=0x7fad3c01c4a0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 -- 172.21.15.37:0/3182117681 shutdown_connections 2024-05-30T06:50:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 --2- 172.21.15.37:0/3182117681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad54162ae0 0x7fad540ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 --2- 172.21.15.37:0/3182117681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5409b9a0 0x7fad541625a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 -- 172.21.15.37:0/3182117681 >> 172.21.15.37:0/3182117681 conn(0x7fad540b4100 msgr2=0x7fad540b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 -- 172.21.15.37:0/3182117681 shutdown_connections 2024-05-30T06:50:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 -- 172.21.15.37:0/3182117681 wait complete. 2024-05-30T06:50:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 Processor -- start 2024-05-30T06:50:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 -- start start 2024-05-30T06:50:18.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad5409b9a0 0x7fad5414f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5415e930 0x7fad541514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad54162ae0 0x7fad5414e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad5406ddc0 con 0x7fad54162ae0 2024-05-30T06:50:18.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad5406dc40 con 0x7fad5415e930 2024-05-30T06:50:18.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad59800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad5415ed10 con 0x7fad5409b9a0 2024-05-30T06:50:18.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad53400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad54162ae0 0x7fad5414e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad53400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad54162ae0 0x7fad5414e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56726/0 (socket says 172.21.15.37:56726) 2024-05-30T06:50:18.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.585+0000 7fad53400640 1 -- 172.21.15.37:0/746682217 learned_addr learned my addr 172.21.15.37:0/746682217 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:18.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad4a000640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5415e930 0x7fad541514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad52a00640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad5409b9a0 0x7fad5414f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad53400640 1 -- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad5409b9a0 msgr2=0x7fad5414f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad53400640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad5409b9a0 0x7fad5414f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad53400640 1 -- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5415e930 msgr2=0x7fad541514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad53400640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5415e930 0x7fad541514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad53400640 1 -- 172.21.15.37:0/746682217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad54152fc0 con 0x7fad54162ae0 2024-05-30T06:50:18.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad4a000640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5415e930 0x7fad541514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:18.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad53400640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad54162ae0 0x7fad5414e9b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00efc0 tx=0x7fad4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:18.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad4b400640 1 -- 172.21.15.37:0/746682217 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c018020 con 0x7fad54162ae0 2024-05-30T06:50:18.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad4b400640 1 -- 172.21.15.37:0/746682217 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad4c014480 con 0x7fad54162ae0 2024-05-30T06:50:18.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad4b400640 1 -- 172.21.15.37:0/746682217 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c014870 con 0x7fad54162ae0 2024-05-30T06:50:18.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad59800640 1 -- 172.21.15.37:0/746682217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad54151b60 con 0x7fad54162ae0 2024-05-30T06:50:18.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad59800640 1 -- 172.21.15.37:0/746682217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad54153240 con 0x7fad54162ae0 2024-05-30T06:50:18.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad59800640 1 -- 172.21.15.37:0/746682217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad54068b20 con 0x7fad54162ae0 2024-05-30T06:50:18.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.589+0000 7fad4b400640 1 -- 172.21.15.37:0/746682217 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fad4c01b020 con 0x7fad54162ae0 2024-05-30T06:50:18.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.593+0000 7fad4b400640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad30069130 0x7fad3006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.593+0000 7fad4b400640 1 -- 172.21.15.37:0/746682217 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7fad4c0861e0 con 0x7fad54162ae0 2024-05-30T06:50:18.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.593+0000 7fad52a00640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad30069130 0x7fad3006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.593+0000 7fad52a00640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad30069130 0x7fad3006b5f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fad44000f70 tx=0x7fad44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:18.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.597+0000 7fad4b400640 1 -- 172.21.15.37:0/746682217 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fad4c022070 con 0x7fad54162ae0 2024-05-30T06:50:18.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.761+0000 7fad59800640 1 -- 172.21.15.37:0/746682217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad5406e350 con 0x7fad54162ae0 2024-05-30T06:50:18.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.765+0000 7fad4b400640 1 -- 172.21.15.37:0/746682217 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16761 (secure 0 0 0) 0x7fad54151b60 con 0x7fad54162ae0 2024-05-30T06:50:18.765 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:18.765 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":61,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:50:16.734887+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:48:33.300340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T06:48:33.866916+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":61,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:50:18.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.765+0000 7fad59800640 1 -- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad30069130 msgr2=0x7fad3006b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.765+0000 7fad59800640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad30069130 0x7fad3006b5f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fad44000f70 tx=0x7fad44009040 comp rx=0 tx=0).stop 2024-05-30T06:50:18.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.765+0000 7fad59800640 1 -- 172.21.15.37:0/746682217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad54162ae0 msgr2=0x7fad5414e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.765+0000 7fad59800640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad54162ae0 0x7fad5414e9b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00efc0 tx=0x7fad4c00c490 comp rx=0 tx=0).stop 2024-05-30T06:50:18.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.765+0000 7fad59800640 1 -- 172.21.15.37:0/746682217 shutdown_connections 2024-05-30T06:50:18.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.765+0000 7fad59800640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad54162ae0 0x7fad5414e9b0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.765+0000 7fad59800640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad30069130 0x7fad3006b5f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.765+0000 7fad59800640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad5415e930 0x7fad541514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.765+0000 7fad59800640 1 --2- 172.21.15.37:0/746682217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad5409b9a0 0x7fad5414f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.765+0000 7fad59800640 1 -- 172.21.15.37:0/746682217 >> 172.21.15.37:0/746682217 conn(0x7fad540b4100 msgr2=0x7fad5406d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:18.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.765+0000 7fad59800640 1 -- 172.21.15.37:0/746682217 shutdown_connections 2024-05-30T06:50:18.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.765+0000 7fad59800640 1 -- 172.21.15.37:0/746682217 wait complete. 2024-05-30T06:50:18.786 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:48:33.300340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:48:33.866916+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 61, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:50:18.787 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:50:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.929+0000 7f3e0f600640 1 Processor -- start 2024-05-30T06:50:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.929+0000 7f3e0f600640 1 -- start start 2024-05-30T06:50:18.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.929+0000 7f3e0f600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3e081624a0 0x7f3e0806b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.929+0000 7f3e0f600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e0806bea0 0x7f3e080b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.929+0000 7f3e0f600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e080b6130 con 0x7f3e08158e00 2024-05-30T06:50:18.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.929+0000 7f3e0f600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3e080b4790 con 0x7f3e081624a0 2024-05-30T06:50:18.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.929+0000 7f3e0f600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3e08071410 con 0x7f3e0806bea0 2024-05-30T06:50:18.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.933+0000 7f3dffe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3e081624a0 0x7f3e0806b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.933+0000 7f3e0cc00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3e08158e00 0x7f3e080b5a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47438/0 (socket says 172.21.15.37:47438) 2024-05-30T06:50:18.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.933+0000 7f3e0cc00640 1 -- 172.21.15.37:0/4073334603 learned_addr learned my addr 172.21.15.37:0/4073334603 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:18.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.933+0000 7f3e0d600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e0806bea0 0x7f3e080b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.933+0000 7f3dffe00640 1 -- 172.21.15.37:0/4073334603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e0806bea0 msgr2=0x7f3e080b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.933+0000 7f3dffe00640 1 --2- 172.21.15.37:0/4073334603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e0806bea0 0x7f3e080b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.933+0000 7f3dffe00640 1 -- 172.21.15.37:0/4073334603 >> v1:172.21.15.105:6789/0 conn(0x7f3e08158e00 legacy=0x7f3e080b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.933+0000 7f3dffe00640 1 -- 172.21.15.37:0/4073334603 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e08162980 con 0x7f3e081624a0 2024-05-30T06:50:18.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.933+0000 7f3dffe00640 1 --2- 172.21.15.37:0/4073334603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e081624a0 0x7f3e0806b960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3df00097c0 tx=0x7f3df001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54e64c8fe3c12f4f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:18.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.933+0000 7f3e07e00640 1 -- 172.21.15.37:0/4073334603 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df00b0070 con 0x7f3e081624a0 2024-05-30T06:50:18.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.933+0000 7f3e07e00640 1 -- 172.21.15.37:0/4073334603 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df00ab600 con 0x7f3e081624a0 2024-05-30T06:50:18.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.933+0000 7f3e07e00640 1 -- 172.21.15.37:0/4073334603 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df00ab9d0 con 0x7f3e081624a0 2024-05-30T06:50:18.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 -- 172.21.15.37:0/4073334603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e081624a0 msgr2=0x7f3e0806b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 --2- 172.21.15.37:0/4073334603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e081624a0 0x7f3e0806b960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3df00097c0 tx=0x7f3df001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 -- 172.21.15.37:0/4073334603 shutdown_connections 2024-05-30T06:50:18.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 --2- 172.21.15.37:0/4073334603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e0806bea0 0x7f3e080b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 --2- 172.21.15.37:0/4073334603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e081624a0 0x7f3e0806b960 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 -- 172.21.15.37:0/4073334603 >> 172.21.15.37:0/4073334603 conn(0x7f3e0806f110 msgr2=0x7f3e0806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:18.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 -- 172.21.15.37:0/4073334603 shutdown_connections 2024-05-30T06:50:18.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 -- 172.21.15.37:0/4073334603 wait complete. 2024-05-30T06:50:18.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 Processor -- start 2024-05-30T06:50:18.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 -- start start 2024-05-30T06:50:18.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0806bea0 0x7f3e080b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e08158e00 0x7f3e081501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e081624a0 0x7f3e0814b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e081591e0 con 0x7f3e0806bea0 2024-05-30T06:50:18.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e080b5570 con 0x7f3e081624a0 2024-05-30T06:50:18.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0f600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3e08159360 con 0x7f3e08158e00 2024-05-30T06:50:18.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0806bea0 0x7f3e080b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0806bea0 0x7f3e080b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56742/0 (socket says 172.21.15.37:56742) 2024-05-30T06:50:18.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0cc00640 1 -- 172.21.15.37:0/2649065310 learned_addr learned my addr 172.21.15.37:0/2649065310 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:18.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3dffe00640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e08158e00 0x7f3e081501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0d600640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e081624a0 0x7f3e0814b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0cc00640 1 -- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e08158e00 msgr2=0x7f3e081501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0cc00640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e08158e00 0x7f3e081501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0cc00640 1 -- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e081624a0 msgr2=0x7f3e0814b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:18.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0cc00640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e081624a0 0x7f3e0814b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:18.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3e0cc00640 1 -- 172.21.15.37:0/2649065310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0814f3f0 con 0x7f3e0806bea0 2024-05-30T06:50:18.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.937+0000 7f3dffe00640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e08158e00 0x7f3e081501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:18.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.941+0000 7f3e0cc00640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0806bea0 0x7f3e080b1fa0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3df800c420 tx=0x7f3df800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:18.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.941+0000 7f3e05600640 1 -- 172.21.15.37:0/2649065310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df8017070 con 0x7f3e0806bea0 2024-05-30T06:50:18.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.941+0000 7f3e05600640 1 -- 172.21.15.37:0/2649065310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df8005cf0 con 0x7f3e0806bea0 2024-05-30T06:50:18.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.941+0000 7f3e05600640 1 -- 172.21.15.37:0/2649065310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df80072f0 con 0x7f3e0806bea0 2024-05-30T06:50:18.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.941+0000 7f3e0f600640 1 -- 172.21.15.37:0/2649065310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0814f6d0 con 0x7f3e0806bea0 2024-05-30T06:50:18.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.941+0000 7f3e0f600640 1 -- 172.21.15.37:0/2649065310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e080b24e0 con 0x7f3e0806bea0 2024-05-30T06:50:18.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.941+0000 7f3e0f600640 1 -- 172.21.15.37:0/2649065310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e08068bc0 con 0x7f3e0806bea0 2024-05-30T06:50:18.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.941+0000 7f3e05600640 1 -- 172.21.15.37:0/2649065310 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f3df801a070 con 0x7f3e0806bea0 2024-05-30T06:50:18.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.941+0000 7f3e05600640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3de4069100 0x7f3de406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:18.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.941+0000 7f3e05600640 1 -- 172.21.15.37:0/2649065310 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7f3df8084a40 con 0x7f3e0806bea0 2024-05-30T06:50:18.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.941+0000 7f3dffe00640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3de4069100 0x7f3de406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:18.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.945+0000 7f3dffe00640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3de4069100 0x7f3de406b5c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3df00ad000 tx=0x7f3df0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:18.945+0000 7f3e05600640 1 -- 172.21.15.37:0/2649065310 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3df8056150 con 0x7f3e0806bea0 2024-05-30T06:50:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.113+0000 7f3e0f600640 1 -- 172.21.15.37:0/2649065310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3e08070a20 con 0x7f3e0806bea0 2024-05-30T06:50:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.113+0000 7f3e05600640 1 -- 172.21.15.37:0/2649065310 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) ==== 93+0+10 (secure 0 0 0) 0x7f3df805a450 con 0x7f3e0806bea0 2024-05-30T06:50:19.116 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:50:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.117+0000 7f3e0f600640 1 -- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3de4069100 msgr2=0x7f3de406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.117+0000 7f3e0f600640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3de4069100 0x7f3de406b5c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3df00ad000 tx=0x7f3df0008040 comp rx=0 tx=0).stop 2024-05-30T06:50:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.117+0000 7f3e0f600640 1 -- 172.21.15.37:0/2649065310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0806bea0 msgr2=0x7f3e080b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.117+0000 7f3e0f600640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0806bea0 0x7f3e080b1fa0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3df800c420 tx=0x7f3df800c8e0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.117+0000 7f3e0f600640 1 -- 172.21.15.37:0/2649065310 shutdown_connections 2024-05-30T06:50:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.117+0000 7f3e0f600640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3de4069100 0x7f3de406b5c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.117+0000 7f3e0f600640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e081624a0 0x7f3e0814b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.117+0000 7f3e0f600640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e08158e00 0x7f3e081501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.117+0000 7f3e0f600640 1 --2- 172.21.15.37:0/2649065310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e0806bea0 0x7f3e080b1fa0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.117+0000 7f3e0f600640 1 -- 172.21.15.37:0/2649065310 >> 172.21.15.37:0/2649065310 conn(0x7f3e0806f110 msgr2=0x7f3e08161340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:19.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.117+0000 7f3e0f600640 1 -- 172.21.15.37:0/2649065310 shutdown_connections 2024-05-30T06:50:19.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.117+0000 7f3e0f600640 1 -- 172.21.15.37:0/2649065310 wait complete. 2024-05-30T06:50:19.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:50:19.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.281+0000 7f8868a00640 1 Processor -- start 2024-05-30T06:50:19.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.281+0000 7f8868a00640 1 -- start start 2024-05-30T06:50:19.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.281+0000 7f8868a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88641624a0 0x7f886406b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.281+0000 7f8868a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f886406bea0 0x7f88640b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.281+0000 7f8868a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88640b6130 con 0x7f8864158e00 2024-05-30T06:50:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.281+0000 7f8868a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f886406c310 con 0x7f88641624a0 2024-05-30T06:50:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.281+0000 7f8868a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f88640b4790 con 0x7f886406bea0 2024-05-30T06:50:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.281+0000 7f8859400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88641624a0 0x7f886406b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.281+0000 7f8859400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88641624a0 0x7f886406b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56744/0 (socket says 172.21.15.37:56744) 2024-05-30T06:50:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.281+0000 7f8859400640 1 -- 172.21.15.37:0/3446115425 learned_addr learned my addr 172.21.15.37:0/3446115425 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.285+0000 7f8862800640 1 --2- 172.21.15.37:0/3446115425 >> v2:172.21.15.105:3300/0 conn(0x7f886406bea0 0x7f88640b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.285+0000 7f8859400640 1 -- 172.21.15.37:0/3446115425 >> v2:172.21.15.105:3300/0 conn(0x7f886406bea0 msgr2=0x7f88640b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.285+0000 7f8859400640 1 --2- 172.21.15.37:0/3446115425 >> v2:172.21.15.105:3300/0 conn(0x7f886406bea0 0x7f88640b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.285+0000 7f8859400640 1 -- 172.21.15.37:0/3446115425 >> v1:172.21.15.105:6789/0 conn(0x7f8864158e00 legacy=0x7f88640b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.285+0000 7f8859400640 1 -- 172.21.15.37:0/3446115425 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8864071410 con 0x7f88641624a0 2024-05-30T06:50:19.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.285+0000 7f8859400640 1 --2- 172.21.15.37:0/3446115425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88641624a0 0x7f886406b960 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f8864072c60 tx=0x7f884c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516885a5849bac71 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:19.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.285+0000 7f8861400640 1 -- 172.21.15.37:0/3446115425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0ab600 con 0x7f88641624a0 2024-05-30T06:50:19.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.285+0000 7f8861400640 1 -- 172.21.15.37:0/3446115425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f884c0b0070 con 0x7f88641624a0 2024-05-30T06:50:19.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.285+0000 7f8861400640 1 -- 172.21.15.37:0/3446115425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0ab9c0 con 0x7f88641624a0 2024-05-30T06:50:19.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.285+0000 7f8868a00640 1 -- 172.21.15.37:0/3446115425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88641624a0 msgr2=0x7f886406b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.285+0000 7f8868a00640 1 --2- 172.21.15.37:0/3446115425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88641624a0 0x7f886406b960 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f8864072c60 tx=0x7f884c01c4f0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 -- 172.21.15.37:0/3446115425 shutdown_connections 2024-05-30T06:50:19.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 --2- 172.21.15.37:0/3446115425 >> v2:172.21.15.105:3300/0 conn(0x7f886406bea0 0x7f88640b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 --2- 172.21.15.37:0/3446115425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88641624a0 0x7f886406b960 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 -- 172.21.15.37:0/3446115425 >> 172.21.15.37:0/3446115425 conn(0x7f886406f110 msgr2=0x7f886406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:19.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 -- 172.21.15.37:0/3446115425 shutdown_connections 2024-05-30T06:50:19.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 -- 172.21.15.37:0/3446115425 wait complete. 2024-05-30T06:50:19.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 Processor -- start 2024-05-30T06:50:19.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 -- start start 2024-05-30T06:50:19.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886406bea0 0x7f88640b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8864158e00 0x7f88641602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88641624a0 0x7f8864160820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f88640b5570 con 0x7f8864158e00 2024-05-30T06:50:19.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8864163220 con 0x7f88641624a0 2024-05-30T06:50:19.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8868a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f88641591e0 con 0x7f886406bea0 2024-05-30T06:50:19.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8859400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8864158e00 0x7f88641602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8859400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8864158e00 0x7f88641602e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56752/0 (socket says 172.21.15.37:56752) 2024-05-30T06:50:19.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8859400640 1 -- 172.21.15.37:0/1535835126 learned_addr learned my addr 172.21.15.37:0/1535835126 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:19.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8862800640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88641624a0 0x7f8864160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8861e00640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886406bea0 0x7f88640b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8859400640 1 -- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886406bea0 msgr2=0x7f88640b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8859400640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886406bea0 0x7f88640b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8859400640 1 -- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88641624a0 msgr2=0x7f8864160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8859400640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88641624a0 0x7f8864160820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8859400640 1 -- 172.21.15.37:0/1535835126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88640b2b90 con 0x7f8864158e00 2024-05-30T06:50:19.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8862800640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88641624a0 0x7f8864160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:19.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f8859400640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8864158e00 0x7f88641602e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f884c0ad040 tx=0x7f884c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:19.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f885aa00640 1 -- 172.21.15.37:0/1535835126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0be5f0 con 0x7f8864158e00 2024-05-30T06:50:19.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f885aa00640 1 -- 172.21.15.37:0/1535835126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f884c0be7b0 con 0x7f8864158e00 2024-05-30T06:50:19.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.289+0000 7f885aa00640 1 -- 172.21.15.37:0/1535835126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0beba0 con 0x7f8864158e00 2024-05-30T06:50:19.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.293+0000 7f8868a00640 1 -- 172.21.15.37:0/1535835126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88641596d0 con 0x7f8864158e00 2024-05-30T06:50:19.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.293+0000 7f8868a00640 1 -- 172.21.15.37:0/1535835126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8864159c90 con 0x7f8864158e00 2024-05-30T06:50:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.293+0000 7f8868a00640 1 -- 172.21.15.37:0/1535835126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8864068bc0 con 0x7f8864158e00 2024-05-30T06:50:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.293+0000 7f885aa00640 1 -- 172.21.15.37:0/1535835126 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f884c0aa070 con 0x7f8864158e00 2024-05-30T06:50:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.293+0000 7f885aa00640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8840069100 0x7f884006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.293+0000 7f885aa00640 1 -- 172.21.15.37:0/1535835126 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7f884c11ff60 con 0x7f8864158e00 2024-05-30T06:50:19.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.293+0000 7f8861e00640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8840069100 0x7f884006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.297+0000 7f8861e00640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8840069100 0x7f884006b5c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8854001650 tx=0x7f8854009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:19.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.297+0000 7f885aa00640 1 -- 172.21.15.37:0/1535835126 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f884c0c4060 con 0x7f8864158e00 2024-05-30T06:50:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f8868a00640 1 -- 172.21.15.37:0/1535835126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f88640b2fe0 con 0x7f8864158e00 2024-05-30T06:50:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f885aa00640 1 -- 172.21.15.37:0/1535835126 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) ==== 104+0+11 (secure 0 0 0) 0x7f884c016110 con 0x7f8864158e00 2024-05-30T06:50:19.466 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:50:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f8868a00640 1 -- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8840069100 msgr2=0x7f884006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f8868a00640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8840069100 0x7f884006b5c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8854001650 tx=0x7f8854009040 comp rx=0 tx=0).stop 2024-05-30T06:50:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f8868a00640 1 -- 172.21.15.37:0/1535835126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8864158e00 msgr2=0x7f88641602e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f8868a00640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8864158e00 0x7f88641602e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f884c0ad040 tx=0x7f884c01ad30 comp rx=0 tx=0).stop 2024-05-30T06:50:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f8868a00640 1 -- 172.21.15.37:0/1535835126 shutdown_connections 2024-05-30T06:50:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f8868a00640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8840069100 0x7f884006b5c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f8868a00640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88641624a0 0x7f8864160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f8868a00640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8864158e00 0x7f88641602e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f8868a00640 1 --2- 172.21.15.37:0/1535835126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886406bea0 0x7f88640b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f8868a00640 1 -- 172.21.15.37:0/1535835126 >> 172.21.15.37:0/1535835126 conn(0x7f886406f110 msgr2=0x7f886415ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f8868a00640 1 -- 172.21.15.37:0/1535835126 shutdown_connections 2024-05-30T06:50:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.465+0000 7f8868a00640 1 -- 172.21.15.37:0/1535835126 wait complete. 2024-05-30T06:50:19.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:50:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea71200640 1 Processor -- start 2024-05-30T06:50:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea71200640 1 -- start start 2024-05-30T06:50:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea71200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fea6c15f210 0x7fea6c072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea71200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fea6c0cec10 0x7fea6c072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea71200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea6c163020 con 0x7fea6c15c890 2024-05-30T06:50:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea71200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fea6c163300 con 0x7fea6c15f210 2024-05-30T06:50:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea71200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fea6c1635e0 con 0x7fea6c0cec10 2024-05-30T06:50:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea61400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fea6c15f210 0x7fea6c072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea61400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fea6c15f210 0x7fea6c072750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56760/0 (socket says 172.21.15.37:56760) 2024-05-30T06:50:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea61400640 1 -- 172.21.15.37:0/2489000104 learned_addr learned my addr 172.21.15.37:0/2489000104 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea6a800640 1 --2- 172.21.15.37:0/2489000104 >> v2:172.21.15.105:3300/0 conn(0x7fea6c0cec10 0x7fea6c072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea61400640 1 -- 172.21.15.37:0/2489000104 >> v2:172.21.15.105:3300/0 conn(0x7fea6c0cec10 msgr2=0x7fea6c072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea61400640 1 --2- 172.21.15.37:0/2489000104 >> v2:172.21.15.105:3300/0 conn(0x7fea6c0cec10 0x7fea6c072c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea61400640 1 -- 172.21.15.37:0/2489000104 >> v1:172.21.15.105:6789/0 conn(0x7fea6c15c890 legacy=0x7fea6c162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.633+0000 7fea61400640 1 -- 172.21.15.37:0/2489000104 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6c06ba00 con 0x7fea6c15f210 2024-05-30T06:50:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.637+0000 7fea61400640 1 --2- 172.21.15.37:0/2489000104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6c15f210 0x7fea6c072750 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fea6c09eee0 tx=0x7fea5401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4507b290e4cff1f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.637+0000 7fea69400640 1 -- 172.21.15.37:0/2489000104 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea540b0070 con 0x7fea6c15f210 2024-05-30T06:50:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.637+0000 7fea69400640 1 -- 172.21.15.37:0/2489000104 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea540ab600 con 0x7fea6c15f210 2024-05-30T06:50:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.637+0000 7fea69400640 1 -- 172.21.15.37:0/2489000104 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea540ab9d0 con 0x7fea6c15f210 2024-05-30T06:50:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.637+0000 7fea71200640 1 -- 172.21.15.37:0/2489000104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6c15f210 msgr2=0x7fea6c072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.637+0000 7fea71200640 1 --2- 172.21.15.37:0/2489000104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6c15f210 0x7fea6c072750 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fea6c09eee0 tx=0x7fea5401c450 comp rx=0 tx=0).stop 2024-05-30T06:50:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.637+0000 7fea71200640 1 -- 172.21.15.37:0/2489000104 shutdown_connections 2024-05-30T06:50:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.637+0000 7fea71200640 1 --2- 172.21.15.37:0/2489000104 >> v2:172.21.15.105:3300/0 conn(0x7fea6c0cec10 0x7fea6c072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.637+0000 7fea71200640 1 --2- 172.21.15.37:0/2489000104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6c15f210 0x7fea6c072750 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.637+0000 7fea71200640 1 -- 172.21.15.37:0/2489000104 >> 172.21.15.37:0/2489000104 conn(0x7fea6c0b2ac0 msgr2=0x7fea6c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.637+0000 7fea71200640 1 -- 172.21.15.37:0/2489000104 shutdown_connections 2024-05-30T06:50:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.637+0000 7fea71200640 1 -- 172.21.15.37:0/2489000104 wait complete. 2024-05-30T06:50:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.637+0000 7fea71200640 1 Processor -- start 2024-05-30T06:50:19.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea71200640 1 -- start start 2024-05-30T06:50:19.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea71200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6c0cec10 0x7fea6c0ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea71200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea6c15c890 0x7fea6c154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea71200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea6c15f210 0x7fea6c0adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea71200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c06cda0 con 0x7fea6c0cec10 2024-05-30T06:50:19.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea71200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c06cc20 con 0x7fea6c15c890 2024-05-30T06:50:19.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea71200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fea6c06cf20 con 0x7fea6c15f210 2024-05-30T06:50:19.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea69e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6c0cec10 0x7fea6c0ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea69e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6c0cec10 0x7fea6c0ae5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56762/0 (socket says 172.21.15.37:56762) 2024-05-30T06:50:19.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea69e00640 1 -- 172.21.15.37:0/2837220479 learned_addr learned my addr 172.21.15.37:0/2837220479 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea61400640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea6c15c890 0x7fea6c154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea6a800640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea6c15f210 0x7fea6c0adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea69e00640 1 -- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea6c15f210 msgr2=0x7fea6c0adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea69e00640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea6c15f210 0x7fea6c0adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea69e00640 1 -- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea6c15c890 msgr2=0x7fea6c154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea69e00640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea6c15c890 0x7fea6c154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea69e00640 1 -- 172.21.15.37:0/2837220479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6c154dc0 con 0x7fea6c0cec10 2024-05-30T06:50:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea69e00640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6c0cec10 0x7fea6c0ae5b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c450 tx=0x7fea5c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea62a00640 1 -- 172.21.15.37:0/2837220479 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c012830 con 0x7fea6c0cec10 2024-05-30T06:50:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea62a00640 1 -- 172.21.15.37:0/2837220479 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea5c017070 con 0x7fea6c0cec10 2024-05-30T06:50:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea71200640 1 -- 172.21.15.37:0/2837220479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6c15a560 con 0x7fea6c0cec10 2024-05-30T06:50:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea62a00640 1 -- 172.21.15.37:0/2837220479 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c012c30 con 0x7fea6c0cec10 2024-05-30T06:50:19.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea71200640 1 -- 172.21.15.37:0/2837220479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea6c15a820 con 0x7fea6c0cec10 2024-05-30T06:50:19.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.641+0000 7fea71200640 1 -- 172.21.15.37:0/2837220479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea6c067d90 con 0x7fea6c0cec10 2024-05-30T06:50:19.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.645+0000 7fea62a00640 1 -- 172.21.15.37:0/2837220479 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fea5c01c460 con 0x7fea6c0cec10 2024-05-30T06:50:19.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.645+0000 7fea62a00640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fea48069100 0x7fea4806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.645+0000 7fea62a00640 1 -- 172.21.15.37:0/2837220479 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7fea5c085480 con 0x7fea6c0cec10 2024-05-30T06:50:19.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.645+0000 7fea61400640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fea48069100 0x7fea4806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.645+0000 7fea61400640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fea48069100 0x7fea4806b5c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fea540ad000 tx=0x7fea540a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:19.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.649+0000 7fea62a00640 1 -- 172.21.15.37:0/2837220479 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fea5c0571e0 con 0x7fea6c0cec10 2024-05-30T06:50:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.813+0000 7fea71200640 1 -- 172.21.15.37:0/2837220479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fea6c155dd0 con 0x7fea6c0cec10 2024-05-30T06:50:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.813+0000 7fea62a00640 1 -- 172.21.15.37:0/2837220479 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) ==== 100+0+11 (secure 0 0 0) 0x7fea5c056ae0 con 0x7fea6c0cec10 2024-05-30T06:50:19.816 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:50:19.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.817+0000 7fea71200640 1 -- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fea48069100 msgr2=0x7fea4806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.817+0000 7fea71200640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fea48069100 0x7fea4806b5c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fea540ad000 tx=0x7fea540a6000 comp rx=0 tx=0).stop 2024-05-30T06:50:19.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.817+0000 7fea71200640 1 -- 172.21.15.37:0/2837220479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6c0cec10 msgr2=0x7fea6c0ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.817+0000 7fea71200640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6c0cec10 0x7fea6c0ae5b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c450 tx=0x7fea5c00c910 comp rx=0 tx=0).stop 2024-05-30T06:50:19.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.817+0000 7fea71200640 1 -- 172.21.15.37:0/2837220479 shutdown_connections 2024-05-30T06:50:19.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.817+0000 7fea71200640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea6c15f210 0x7fea6c0adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.817+0000 7fea71200640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fea48069100 0x7fea4806b5c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.817+0000 7fea71200640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea6c15c890 0x7fea6c154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.817+0000 7fea71200640 1 --2- 172.21.15.37:0/2837220479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea6c0cec10 0x7fea6c0ae5b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.817+0000 7fea71200640 1 -- 172.21.15.37:0/2837220479 >> 172.21.15.37:0/2837220479 conn(0x7fea6c0b2ac0 msgr2=0x7fea6c15e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:19.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.817+0000 7fea71200640 1 -- 172.21.15.37:0/2837220479 shutdown_connections 2024-05-30T06:50:19.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.817+0000 7fea71200640 1 -- 172.21.15.37:0/2837220479 wait complete. 2024-05-30T06:50:19.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:50:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe65cc00640 1 Processor -- start 2024-05-30T06:50:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe65cc00640 1 -- start start 2024-05-30T06:50:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe65cc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe65815b050 0x7fe6580af900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe65cc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6580d06c0 0x7fe65806f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe65cc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6580b5e80 con 0x7fe6580cffe0 2024-05-30T06:50:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe65cc00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe6580b5730 con 0x7fe6580d06c0 2024-05-30T06:50:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe65cc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe6580cd880 con 0x7fe65815b050 2024-05-30T06:50:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe656800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6580d06c0 0x7fe65806f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe656800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6580d06c0 0x7fe65806f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56766/0 (socket says 172.21.15.37:56766) 2024-05-30T06:50:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe656800640 1 -- 172.21.15.37:0/3418449129 learned_addr learned my addr 172.21.15.37:0/3418449129 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe655e00640 1 --2- 172.21.15.37:0/3418449129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe65815b050 0x7fe6580af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe656800640 1 -- 172.21.15.37:0/3418449129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe65815b050 msgr2=0x7fe6580af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:19.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe656800640 1 --2- 172.21.15.37:0/3418449129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe65815b050 0x7fe6580af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe656800640 1 -- 172.21.15.37:0/3418449129 >> v1:172.21.15.105:6789/0 conn(0x7fe6580cffe0 legacy=0x7fe6580afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.977+0000 7fe656800640 1 -- 172.21.15.37:0/3418449129 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6580b0550 con 0x7fe6580d06c0 2024-05-30T06:50:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.981+0000 7fe656800640 1 --2- 172.21.15.37:0/3418449129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6580d06c0 0x7fe65806f2a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe650009e80 tx=0x7fe65001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09995b12402a118 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.981+0000 7fe655400640 1 -- 172.21.15.37:0/3418449129 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6500a5550 con 0x7fe6580d06c0 2024-05-30T06:50:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.981+0000 7fe655400640 1 -- 172.21.15.37:0/3418449129 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6500a56f0 con 0x7fe6580d06c0 2024-05-30T06:50:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.981+0000 7fe655400640 1 -- 172.21.15.37:0/3418449129 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6500a5ac0 con 0x7fe6580d06c0 2024-05-30T06:50:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.981+0000 7fe65cc00640 1 -- 172.21.15.37:0/3418449129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6580d06c0 msgr2=0x7fe65806f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.981+0000 7fe65cc00640 1 --2- 172.21.15.37:0/3418449129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6580d06c0 0x7fe65806f2a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe650009e80 tx=0x7fe65001ca10 comp rx=0 tx=0).stop 2024-05-30T06:50:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.981+0000 7fe65cc00640 1 -- 172.21.15.37:0/3418449129 shutdown_connections 2024-05-30T06:50:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.981+0000 7fe65cc00640 1 --2- 172.21.15.37:0/3418449129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6580d06c0 0x7fe65806f2a0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.981+0000 7fe65cc00640 1 --2- 172.21.15.37:0/3418449129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe65815b050 0x7fe6580af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.981+0000 7fe65cc00640 1 -- 172.21.15.37:0/3418449129 >> 172.21.15.37:0/3418449129 conn(0x7fe658073680 msgr2=0x7fe65806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.981+0000 7fe65cc00640 1 -- 172.21.15.37:0/3418449129 shutdown_connections 2024-05-30T06:50:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.981+0000 7fe65cc00640 1 -- 172.21.15.37:0/3418449129 wait complete. 2024-05-30T06:50:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe65cc00640 1 Processor -- start 2024-05-30T06:50:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe65cc00640 1 -- start start 2024-05-30T06:50:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe65cc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6580cffe0 0x7fe6581f7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe65cc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6580d06c0 0x7fe65813d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe65cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe65815b050 0x7fe6581597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe65cc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe65806fbb0 con 0x7fe65815b050 2024-05-30T06:50:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe65cc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe65806fa30 con 0x7fe6580cffe0 2024-05-30T06:50:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe65cc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe65806fd30 con 0x7fe6580d06c0 2024-05-30T06:50:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe656800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe65815b050 0x7fe6581597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe656800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe65815b050 0x7fe6581597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56776/0 (socket says 172.21.15.37:56776) 2024-05-30T06:50:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe656800640 1 -- 172.21.15.37:0/2702736458 learned_addr learned my addr 172.21.15.37:0/2702736458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe655e00640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6580cffe0 0x7fe6581f7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe64fe00640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6580d06c0 0x7fe65813d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe656800640 1 -- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6580d06c0 msgr2=0x7fe65813d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe656800640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6580d06c0 0x7fe65813d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe656800640 1 -- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6580cffe0 msgr2=0x7fe6581f7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe656800640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6580cffe0 0x7fe6581f7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe656800640 1 -- 172.21.15.37:0/2702736458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65815e440 con 0x7fe65815b050 2024-05-30T06:50:19.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe64fe00640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6580d06c0 0x7fe65813d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:19.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe656800640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe65815b050 0x7fe6581597f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe6500af040 tx=0x7fe6500197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:19.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe64e000640 1 -- 172.21.15.37:0/2702736458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650009510 con 0x7fe65815b050 2024-05-30T06:50:19.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe64e000640 1 -- 172.21.15.37:0/2702736458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6500be070 con 0x7fe65815b050 2024-05-30T06:50:19.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe64e000640 1 -- 172.21.15.37:0/2702736458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6500b88d0 con 0x7fe65815b050 2024-05-30T06:50:19.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe65cc00640 1 -- 172.21.15.37:0/2702736458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe658167cc0 con 0x7fe65815b050 2024-05-30T06:50:19.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.985+0000 7fe65cc00640 1 -- 172.21.15.37:0/2702736458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe658168280 con 0x7fe65815b050 2024-05-30T06:50:19.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.989+0000 7fe65cc00640 1 -- 172.21.15.37:0/2702736458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe658068b20 con 0x7fe65815b050 2024-05-30T06:50:19.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.989+0000 7fe64e000640 1 -- 172.21.15.37:0/2702736458 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fe6500b8a70 con 0x7fe65815b050 2024-05-30T06:50:19.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.989+0000 7fe64e000640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe634069100 0x7fe63406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:19.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.989+0000 7fe64e000640 1 -- 172.21.15.37:0/2702736458 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7fe650120670 con 0x7fe65815b050 2024-05-30T06:50:19.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.989+0000 7fe655e00640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe634069100 0x7fe63406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:19.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.989+0000 7fe655e00640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe634069100 0x7fe63406b5c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe6480079c0 tx=0x7fe648008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:19.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:19.993+0000 7fe64e000640 1 -- 172.21.15.37:0/2702736458 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe650016600 con 0x7fe65815b050 2024-05-30T06:50:20.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.193+0000 7fe65cc00640 1 -- 172.21.15.37:0/2702736458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6580d04a0 con 0x7fe65815b050 2024-05-30T06:50:20.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.197+0000 7fe64e000640 1 -- 172.21.15.37:0/2702736458 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5181 (secure 0 0 0) 0x7fe6500f24f0 con 0x7fe65815b050 2024-05-30T06:50:20.197 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:20.197 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2689846178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2689846178},{"type":"v1","addr":"172.21.15.37:6834","nonce":2689846178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1799611833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1799611833},{"type":"v1","addr":"172.21.15.37:6835","nonce":1799611833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/35182660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":35182660},{"type":"v1","addr":"172.21.15.105:6837","nonce":35182660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:48:34.974228+0000","modified":"2024-05-30T06:48:37.938821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6055":{"gid":6055,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2127976173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2127976173},{"type":"v1","addr":"172.21.15.105:6835","nonce":2127976173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6055,"qdb_cluster":[6055]},"id":4}]} 2024-05-30T06:50:20.198 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 38 2024-05-30T06:50:20.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.197+0000 7fe65cc00640 1 -- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe634069100 msgr2=0x7fe63406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.197+0000 7fe65cc00640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe634069100 0x7fe63406b5c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe6480079c0 tx=0x7fe648008040 comp rx=0 tx=0).stop 2024-05-30T06:50:20.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.197+0000 7fe65cc00640 1 -- 172.21.15.37:0/2702736458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe65815b050 msgr2=0x7fe6581597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.197+0000 7fe65cc00640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe65815b050 0x7fe6581597f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe6500af040 tx=0x7fe6500197b0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.197+0000 7fe65cc00640 1 -- 172.21.15.37:0/2702736458 shutdown_connections 2024-05-30T06:50:20.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.197+0000 7fe65cc00640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe65815b050 0x7fe6581597f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.197+0000 7fe65cc00640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6580d06c0 0x7fe65813d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.197+0000 7fe65cc00640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe634069100 0x7fe63406b5c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.197+0000 7fe65cc00640 1 --2- 172.21.15.37:0/2702736458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6580cffe0 0x7fe6581f7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.197+0000 7fe65cc00640 1 -- 172.21.15.37:0/2702736458 >> 172.21.15.37:0/2702736458 conn(0x7fe658073680 msgr2=0x7fe658154990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:20.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.197+0000 7fe65cc00640 1 -- 172.21.15.37:0/2702736458 shutdown_connections 2024-05-30T06:50:20.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.197+0000 7fe65cc00640 1 -- 172.21.15.37:0/2702736458 wait complete. 2024-05-30T06:50:20.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:50:20.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.357+0000 7f6842000640 1 Processor -- start 2024-05-30T06:50:20.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.357+0000 7f6842000640 1 -- start start 2024-05-30T06:50:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f6842000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f683c09b9a0 0x7f683c1625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f6842000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f683c162ae0 0x7f683c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f6842000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f683c09abe0 con 0x7f683c15e930 2024-05-30T06:50:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f6842000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f683c162f50 con 0x7f683c09b9a0 2024-05-30T06:50:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f6842000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f683c09aec0 con 0x7f683c162ae0 2024-05-30T06:50:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683b400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f683c15e930 0x7f683c0d1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48220/0 (socket says 172.21.15.37:48220) 2024-05-30T06:50:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683b400640 1 -- 172.21.15.37:0/659214544 learned_addr learned my addr 172.21.15.37:0/659214544 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f6832a00640 1 --2- 172.21.15.37:0/659214544 >> v2:172.21.15.105:3300/0 conn(0x7f683c09b9a0 0x7f683c1625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683be00640 1 --2- 172.21.15.37:0/659214544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f683c162ae0 0x7f683c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4038215844 0 0) 0x7f683c09abe0 con 0x7f683c15e930 2024-05-30T06:50:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6820003530 con 0x7f683c15e930 2024-05-30T06:50:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4251882760 0 0) 0x7f6820003530 con 0x7f683c15e930 2024-05-30T06:50:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f683c162ae0 msgr2=0x7f683c0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 --2- 172.21.15.37:0/659214544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f683c162ae0 0x7f683c0ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 >> v2:172.21.15.105:3300/0 conn(0x7f683c09b9a0 msgr2=0x7f683c1625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 --2- 172.21.15.37:0/659214544 >> v2:172.21.15.105:3300/0 conn(0x7f683c09b9a0 0x7f683c1625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683c09b1a0 con 0x7f683c15e930 2024-05-30T06:50:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f682c0016a0 con 0x7f683c15e930 2024-05-30T06:50:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 >> v1:172.21.15.37:6789/0 conn(0x7f683c15e930 legacy=0x7f683c0d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 --2- 172.21.15.37:0/659214544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f683c162ae0 0x7f68200039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 --2- 172.21.15.37:0/659214544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6820003f40 0x7f6820004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 --2- 172.21.15.37:0/659214544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6820004d50 0x7f68200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f683c162f50 con 0x7f6820004d50 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f683c09aec0 con 0x7f6820003f40 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f682000b9d0 con 0x7f683c162ae0 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683be00640 1 --2- 172.21.15.37:0/659214544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6820004d50 0x7f68200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683b400640 1 --2- 172.21.15.37:0/659214544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f683c162ae0 0x7f68200039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f6832a00640 1 --2- 172.21.15.37:0/659214544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6820003f40 0x7f6820004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683be00640 1 -- 172.21.15.37:0/659214544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f683c162ae0 msgr2=0x7f68200039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683be00640 1 --2- 172.21.15.37:0/659214544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f683c162ae0 0x7f68200039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683be00640 1 -- 172.21.15.37:0/659214544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6820003f40 msgr2=0x7f6820004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683be00640 1 --2- 172.21.15.37:0/659214544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6820003f40 0x7f6820004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f683be00640 1 -- 172.21.15.37:0/659214544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6820003530 con 0x7f6820004d50 2024-05-30T06:50:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.361+0000 7f6832a00640 1 --2- 172.21.15.37:0/659214544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6820003f40 0x7f6820004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.365+0000 7f683be00640 1 --2- 172.21.15.37:0/659214544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6820004d50 0x7f68200051d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6834009fc0 tx=0x7f683401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e136088fc3b8f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.365+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68340b2070 con 0x7f6820004d50 2024-05-30T06:50:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.365+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68340a5c90 con 0x7f6820004d50 2024-05-30T06:50:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.365+0000 7f683aa00640 1 -- 172.21.15.37:0/659214544 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834009c10 con 0x7f6820004d50 2024-05-30T06:50:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.365+0000 7f6842000640 1 -- 172.21.15.37:0/659214544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6820004d50 msgr2=0x7f68200051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.365+0000 7f6842000640 1 --2- 172.21.15.37:0/659214544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6820004d50 0x7f68200051d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6834009fc0 tx=0x7f683401cc20 comp rx=0 tx=0).stop 2024-05-30T06:50:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.365+0000 7f683be00640 1 -- 172.21.15.37:0/659214544 reap_dead start 2024-05-30T06:50:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.365+0000 7f6842000640 1 -- 172.21.15.37:0/659214544 shutdown_connections 2024-05-30T06:50:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.365+0000 7f6842000640 1 -- 172.21.15.37:0/659214544 >> 172.21.15.37:0/659214544 conn(0x7f683c0b4100 msgr2=0x7f683c0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.365+0000 7f6842000640 1 -- 172.21.15.37:0/659214544 shutdown_connections 2024-05-30T06:50:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.365+0000 7f6842000640 1 -- 172.21.15.37:0/659214544 wait complete. 2024-05-30T06:50:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6842000640 1 Processor -- start 2024-05-30T06:50:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6842000640 1 -- start start 2024-05-30T06:50:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6842000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6820004d50 0x7f683c152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6842000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f683c0b6930 0x7f683c15b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6842000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f683c153ce0 0x7f683c15ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6842000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f683c09bdf0 con 0x7f683c0b6930 2024-05-30T06:50:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6842000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f683c0d1950 con 0x7f6820004d50 2024-05-30T06:50:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6842000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f683c06dc40 con 0x7f683c153ce0 2024-05-30T06:50:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6832a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f683c0b6930 0x7f683c15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6832a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f683c0b6930 0x7f683c15b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56788/0 (socket says 172.21.15.37:56788) 2024-05-30T06:50:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6832a00640 1 -- 172.21.15.37:0/2869676811 learned_addr learned my addr 172.21.15.37:0/2869676811 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f683b400640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6820004d50 0x7f683c152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f683be00640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f683c153ce0 0x7f683c15ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6832a00640 1 -- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f683c153ce0 msgr2=0x7f683c15ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6832a00640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f683c153ce0 0x7f683c15ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6832a00640 1 -- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6820004d50 msgr2=0x7f683c152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6832a00640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6820004d50 0x7f683c152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6832a00640 1 -- 172.21.15.37:0/2869676811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683c0b6e10 con 0x7f683c0b6930 2024-05-30T06:50:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f683b400640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6820004d50 0x7f683c152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6832a00640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f683c0b6930 0x7f683c15b550 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6824011590 tx=0x7f6824011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6833e00640 1 -- 172.21.15.37:0/2869676811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824004220 con 0x7f683c0b6930 2024-05-30T06:50:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6833e00640 1 -- 172.21.15.37:0/2869676811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68240043c0 con 0x7f683c0b6930 2024-05-30T06:50:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6833e00640 1 -- 172.21.15.37:0/2869676811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824015870 con 0x7f683c0b6930 2024-05-30T06:50:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6842000640 1 -- 172.21.15.37:0/2869676811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683c0b70f0 con 0x7f683c0b6930 2024-05-30T06:50:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6842000640 1 -- 172.21.15.37:0/2869676811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f683c0b76b0 con 0x7f683c0b6930 2024-05-30T06:50:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.369+0000 7f6842000640 1 -- 172.21.15.37:0/2869676811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f683c068b20 con 0x7f683c0b6930 2024-05-30T06:50:20.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.373+0000 7f6833e00640 1 -- 172.21.15.37:0/2869676811 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f6824015a10 con 0x7f683c0b6930 2024-05-30T06:50:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.373+0000 7f6833e00640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6818069100 0x7f681806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.373+0000 7f6833e00640 1 -- 172.21.15.37:0/2869676811 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7f6824085d00 con 0x7f683c0b6930 2024-05-30T06:50:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.373+0000 7f683b400640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6818069100 0x7f681806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.373+0000 7f683b400640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6818069100 0x7f681806b5c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f683c1636c0 tx=0x7f682c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:20.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.377+0000 7f6833e00640 1 -- 172.21.15.37:0/2869676811 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6824019030 con 0x7f683c0b6930 2024-05-30T06:50:20.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.545+0000 7f6842000640 1 -- 172.21.15.37:0/2869676811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f683c0b8490 con 0x7f683c0b6930 2024-05-30T06:50:20.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.549+0000 7f6833e00640 1 -- 172.21.15.37:0/2869676811 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16761 (secure 0 0 0) 0x7f6824057a60 con 0x7f683c0b6930 2024-05-30T06:50:20.549 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:20.549 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":61,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:50:16.734887+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:48:33.300340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T06:48:33.866916+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":61,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:50:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.549+0000 7f6842000640 1 -- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6818069100 msgr2=0x7f681806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.549+0000 7f6842000640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6818069100 0x7f681806b5c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f683c1636c0 tx=0x7f682c009040 comp rx=0 tx=0).stop 2024-05-30T06:50:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.549+0000 7f6842000640 1 -- 172.21.15.37:0/2869676811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f683c0b6930 msgr2=0x7f683c15b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.549+0000 7f6842000640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f683c0b6930 0x7f683c15b550 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6824011590 tx=0x7f6824011a50 comp rx=0 tx=0).stop 2024-05-30T06:50:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.549+0000 7f6842000640 1 -- 172.21.15.37:0/2869676811 shutdown_connections 2024-05-30T06:50:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.549+0000 7f6842000640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f683c153ce0 0x7f683c15ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.549+0000 7f6842000640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f683c0b6930 0x7f683c15b550 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.549+0000 7f6842000640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6818069100 0x7f681806b5c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.549+0000 7f6842000640 1 --2- 172.21.15.37:0/2869676811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6820004d50 0x7f683c152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.549+0000 7f6842000640 1 -- 172.21.15.37:0/2869676811 >> 172.21.15.37:0/2869676811 conn(0x7f683c0b4100 msgr2=0x7f683c0708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:20.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.549+0000 7f6842000640 1 -- 172.21.15.37:0/2869676811 shutdown_connections 2024-05-30T06:50:20.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.549+0000 7f6842000640 1 -- 172.21.15.37:0/2869676811 wait complete. 2024-05-30T06:50:20.570 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T06:50:20.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:50:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.709+0000 7f5eba800640 1 Processor -- start 2024-05-30T06:50:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.709+0000 7f5eba800640 1 -- start start 2024-05-30T06:50:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.709+0000 7f5eba800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5eb40ce8d0 0x7f5eb40ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.709+0000 7f5eba800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb40cd120 con 0x7f5eb415cd80 2024-05-30T06:50:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.709+0000 7f5eba800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb40cd400 con 0x7f5eb406e000 2024-05-30T06:50:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.709+0000 7f5eba800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5eb40a9530 con 0x7f5eb40ce8d0 2024-05-30T06:50:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.709+0000 7f5eabe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5eb415cd80 0x7f5eb406f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48224/0 (socket says 172.21.15.37:48224) 2024-05-30T06:50:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.709+0000 7f5eabe00640 1 -- 172.21.15.37:0/3357608388 learned_addr learned my addr 172.21.15.37:0/3357608388 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.709+0000 7f5eb3e00640 1 --2- 172.21.15.37:0/3357608388 >> v2:172.21.15.105:3300/0 conn(0x7f5eb40ce8d0 0x7f5eb40ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.713+0000 7f5eb2a00640 1 -- 172.21.15.37:0/3357608388 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2067870335 0 0) 0x7f5eb40cd120 con 0x7f5eb415cd80 2024-05-30T06:50:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.713+0000 7f5eb2a00640 1 -- 172.21.15.37:0/3357608388 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e98003530 con 0x7f5eb415cd80 2024-05-30T06:50:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.713+0000 7f5eb2a00640 1 -- 172.21.15.37:0/3357608388 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128794497 0 0) 0x7f5eb40cd400 con 0x7f5eb406e000 2024-05-30T06:50:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.713+0000 7f5eb2a00640 1 -- 172.21.15.37:0/3357608388 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eb40cd120 con 0x7f5eb406e000 2024-05-30T06:50:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.713+0000 7f5eb3e00640 1 -- 172.21.15.37:0/3357608388 >> v1:172.21.15.105:6789/0 conn(0x7f5eb406e000 legacy=0x7f5eb40ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.713+0000 7f5eb3e00640 1 -- 172.21.15.37:0/3357608388 >> v1:172.21.15.37:6789/0 conn(0x7f5eb415cd80 legacy=0x7f5eb406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.713+0000 7f5eb3e00640 1 -- 172.21.15.37:0/3357608388 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb40cd6e0 con 0x7f5eb40ce8d0 2024-05-30T06:50:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.713+0000 7f5eb3e00640 1 --2- 172.21.15.37:0/3357608388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5eb40ce8d0 0x7f5eb40ced20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009d90 tx=0x7f5eac01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87b256b87befd191 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.713+0000 7f5eb2a00640 1 -- 172.21.15.37:0/3357608388 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0b4070 con 0x7f5eb40ce8d0 2024-05-30T06:50:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.713+0000 7f5eb2a00640 1 -- 172.21.15.37:0/3357608388 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eac0af600 con 0x7f5eb40ce8d0 2024-05-30T06:50:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.713+0000 7f5eb2a00640 1 -- 172.21.15.37:0/3357608388 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0af9d0 con 0x7f5eb40ce8d0 2024-05-30T06:50:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 -- 172.21.15.37:0/3357608388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5eb40ce8d0 msgr2=0x7f5eb40ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 --2- 172.21.15.37:0/3357608388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5eb40ce8d0 0x7f5eb40ced20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009d90 tx=0x7f5eac01f150 comp rx=0 tx=0).stop 2024-05-30T06:50:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 -- 172.21.15.37:0/3357608388 shutdown_connections 2024-05-30T06:50:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 --2- 172.21.15.37:0/3357608388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5eb40ce8d0 0x7f5eb40ced20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 -- 172.21.15.37:0/3357608388 >> 172.21.15.37:0/3357608388 conn(0x7f5eb40b23a0 msgr2=0x7f5eb40b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 -- 172.21.15.37:0/3357608388 shutdown_connections 2024-05-30T06:50:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 -- 172.21.15.37:0/3357608388 wait complete. 2024-05-30T06:50:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 Processor -- start 2024-05-30T06:50:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 -- start start 2024-05-30T06:50:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5eb406e000 0x7f5eb4157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5eb40ce8d0 0x7f5eb4141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb415cd80 0x7f5eb4138ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb41673d0 con 0x7f5eb415cd80 2024-05-30T06:50:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb40cdca0 con 0x7f5eb406e000 2024-05-30T06:50:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eba800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb4167550 con 0x7f5eb40ce8d0 2024-05-30T06:50:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eb3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb415cd80 0x7f5eb4138ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eb3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb415cd80 0x7f5eb4138ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56792/0 (socket says 172.21.15.37:56792) 2024-05-30T06:50:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eb3e00640 1 -- 172.21.15.37:0/565717888 learned_addr learned my addr 172.21.15.37:0/565717888 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eabe00640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5eb40ce8d0 0x7f5eb4141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.717+0000 7f5eb3400640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5eb406e000 0x7f5eb4157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eb3e00640 1 -- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5eb40ce8d0 msgr2=0x7f5eb4141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eb3e00640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5eb40ce8d0 0x7f5eb4141300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eb3e00640 1 -- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5eb406e000 msgr2=0x7f5eb4157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eb3e00640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5eb406e000 0x7f5eb4157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eb3e00640 1 -- 172.21.15.37:0/565717888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb4155980 con 0x7f5eb415cd80 2024-05-30T06:50:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eb3e00640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb415cd80 0x7f5eb4138ef0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0b2040 tx=0x7f5eac01bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eab400640 1 -- 172.21.15.37:0/565717888 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0b4040 con 0x7f5eb415cd80 2024-05-30T06:50:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eab400640 1 -- 172.21.15.37:0/565717888 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eac0c1070 con 0x7f5eb415cd80 2024-05-30T06:50:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eab400640 1 -- 172.21.15.37:0/565717888 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac009450 con 0x7f5eb415cd80 2024-05-30T06:50:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eba800640 1 -- 172.21.15.37:0/565717888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb4155c60 con 0x7f5eb415cd80 2024-05-30T06:50:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eba800640 1 -- 172.21.15.37:0/565717888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb4156220 con 0x7f5eb415cd80 2024-05-30T06:50:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eba800640 1 -- 172.21.15.37:0/565717888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb4068b20 con 0x7f5eb415cd80 2024-05-30T06:50:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eab400640 1 -- 172.21.15.37:0/565717888 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f5eac0ba6b0 con 0x7f5eb415cd80 2024-05-30T06:50:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eab400640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e90069100 0x7f5e9006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eab400640 1 -- 172.21.15.37:0/565717888 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7f5eac123e30 con 0x7f5eb415cd80 2024-05-30T06:50:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.721+0000 7f5eb3400640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e90069100 0x7f5e9006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:20.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.725+0000 7f5eb3400640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e90069100 0x7f5e9006b5c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4001720 tx=0x7f5ea4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:20.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.729+0000 7f5eab400640 1 -- 172.21.15.37:0/565717888 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5eac018cb0 con 0x7f5eb415cd80 2024-05-30T06:50:20.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.929+0000 7f5eba800640 1 -- 172.21.15.37:0/565717888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5eb4144ed0 con 0x7f5eb415cd80 2024-05-30T06:50:20.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.929+0000 7f5eab400640 1 -- 172.21.15.37:0/565717888 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5181 (secure 0 0 0) 0x7f5eac0f5540 con 0x7f5eb415cd80 2024-05-30T06:50:20.932 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:20.932 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2689846178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2689846178},{"type":"v1","addr":"172.21.15.37:6834","nonce":2689846178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1799611833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1799611833},{"type":"v1","addr":"172.21.15.37:6835","nonce":1799611833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/35182660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":35182660},{"type":"v1","addr":"172.21.15.105:6837","nonce":35182660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:48:34.974228+0000","modified":"2024-05-30T06:48:37.938821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6055":{"gid":6055,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2127976173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2127976173},{"type":"v1","addr":"172.21.15.105:6835","nonce":2127976173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6055,"qdb_cluster":[6055]},"id":4}]} 2024-05-30T06:50:20.932 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 38 2024-05-30T06:50:20.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.933+0000 7f5eba800640 1 -- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e90069100 msgr2=0x7f5e9006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.933+0000 7f5eba800640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e90069100 0x7f5e9006b5c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4001720 tx=0x7f5ea4009040 comp rx=0 tx=0).stop 2024-05-30T06:50:20.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.933+0000 7f5eba800640 1 -- 172.21.15.37:0/565717888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb415cd80 msgr2=0x7f5eb4138ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:20.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.933+0000 7f5eba800640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb415cd80 0x7f5eb4138ef0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0b2040 tx=0x7f5eac01bef0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.933+0000 7f5eba800640 1 -- 172.21.15.37:0/565717888 shutdown_connections 2024-05-30T06:50:20.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.933+0000 7f5eba800640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5eb415cd80 0x7f5eb4138ef0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.933+0000 7f5eba800640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5eb40ce8d0 0x7f5eb4141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.933+0000 7f5eba800640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e90069100 0x7f5e9006b5c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.933+0000 7f5eba800640 1 --2- 172.21.15.37:0/565717888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5eb406e000 0x7f5eb4157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.933+0000 7f5eba800640 1 -- 172.21.15.37:0/565717888 >> 172.21.15.37:0/565717888 conn(0x7f5eb40b23a0 msgr2=0x7f5eb4154850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.933+0000 7f5eba800640 1 -- 172.21.15.37:0/565717888 shutdown_connections 2024-05-30T06:50:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:20.933+0000 7f5eba800640 1 -- 172.21.15.37:0/565717888 wait complete. 2024-05-30T06:50:20.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:50:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.093+0000 7fc16c800640 1 Processor -- start 2024-05-30T06:50:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.093+0000 7fc16c800640 1 -- start start 2024-05-30T06:50:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.093+0000 7fc16c800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc16406e000 0x7fc1640ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.093+0000 7fc16c800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc16415cd80 0x7fc1640ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.093+0000 7fc16c800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1640cd120 con 0x7fc1640cec40 2024-05-30T06:50:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.093+0000 7fc16c800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc1640a9530 con 0x7fc16415cd80 2024-05-30T06:50:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.093+0000 7fc16c800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc1640cd400 con 0x7fc16406e000 2024-05-30T06:50:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.093+0000 7fc169400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc16415cd80 0x7fc1640ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.093+0000 7fc16a800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc1640cec40 0x7fc16406e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48236/0 (socket says 172.21.15.37:48236) 2024-05-30T06:50:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.093+0000 7fc16a800640 1 -- 172.21.15.37:0/2963214386 learned_addr learned my addr 172.21.15.37:0/2963214386 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.093+0000 7fc169e00640 1 --2- 172.21.15.37:0/2963214386 >> v2:172.21.15.105:3300/0 conn(0x7fc16406e000 0x7fc1640ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc169400640 1 -- 172.21.15.37:0/2963214386 >> v2:172.21.15.105:3300/0 conn(0x7fc16406e000 msgr2=0x7fc1640ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc169400640 1 --2- 172.21.15.37:0/2963214386 >> v2:172.21.15.105:3300/0 conn(0x7fc16406e000 0x7fc1640ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc169400640 1 -- 172.21.15.37:0/2963214386 >> v1:172.21.15.37:6789/0 conn(0x7fc1640cec40 legacy=0x7fc16406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc169400640 1 -- 172.21.15.37:0/2963214386 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1640cd6e0 con 0x7fc16415cd80 2024-05-30T06:50:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc168a00640 1 -- 172.21.15.37:0/2963214386 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513177145 0 0) 0x7fc1640cd120 con 0x7fc1640cec40 2024-05-30T06:50:21.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc169400640 1 --2- 172.21.15.37:0/2963214386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc16415cd80 0x7fc1640ce700 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc1640683c0 tx=0x7fc15401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d13856a04f3384 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:21.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc168a00640 1 -- 172.21.15.37:0/2963214386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1540b5070 con 0x7fc16415cd80 2024-05-30T06:50:21.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc168a00640 1 -- 172.21.15.37:0/2963214386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1540a8970 con 0x7fc16415cd80 2024-05-30T06:50:21.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc168a00640 1 -- 172.21.15.37:0/2963214386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1540a8d40 con 0x7fc16415cd80 2024-05-30T06:50:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc16c800640 1 -- 172.21.15.37:0/2963214386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc16415cd80 msgr2=0x7fc1640ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc16c800640 1 --2- 172.21.15.37:0/2963214386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc16415cd80 0x7fc1640ce700 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc1640683c0 tx=0x7fc15401ec70 comp rx=0 tx=0).stop 2024-05-30T06:50:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc16c800640 1 -- 172.21.15.37:0/2963214386 shutdown_connections 2024-05-30T06:50:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc16c800640 1 --2- 172.21.15.37:0/2963214386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc16415cd80 0x7fc1640ce700 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc16c800640 1 --2- 172.21.15.37:0/2963214386 >> v2:172.21.15.105:3300/0 conn(0x7fc16406e000 0x7fc1640ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc16c800640 1 -- 172.21.15.37:0/2963214386 >> 172.21.15.37:0/2963214386 conn(0x7fc1640b23a0 msgr2=0x7fc1640b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc16c800640 1 -- 172.21.15.37:0/2963214386 shutdown_connections 2024-05-30T06:50:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.097+0000 7fc16c800640 1 -- 172.21.15.37:0/2963214386 wait complete. 2024-05-30T06:50:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc16c800640 1 Processor -- start 2024-05-30T06:50:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc16c800640 1 -- start start 2024-05-30T06:50:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc16c800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc16406e000 0x7fc1640b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc16c800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1640cec40 0x7fc1640b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc16c800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc16415cd80 0x7fc16415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc16c800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1640cf090 con 0x7fc16406e000 2024-05-30T06:50:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc16c800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc1640cdca0 con 0x7fc1640cec40 2024-05-30T06:50:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc16c800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc1641663c0 con 0x7fc16415cd80 2024-05-30T06:50:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc169e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc16406e000 0x7fc1640b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc169e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc16406e000 0x7fc1640b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56806/0 (socket says 172.21.15.37:56806) 2024-05-30T06:50:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc169e00640 1 -- 172.21.15.37:0/3435268591 learned_addr learned my addr 172.21.15.37:0/3435268591 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc169400640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1640cec40 0x7fc1640b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc16a800640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc16415cd80 0x7fc16415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc169e00640 1 -- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc16415cd80 msgr2=0x7fc16415ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc169e00640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc16415cd80 0x7fc16415ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc169e00640 1 -- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1640cec40 msgr2=0x7fc1640b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc169e00640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1640cec40 0x7fc1640b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc169e00640 1 -- 172.21.15.37:0/3435268591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc164166080 con 0x7fc16406e000 2024-05-30T06:50:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc16a800640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc16415cd80 0x7fc16415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc169e00640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc16406e000 0x7fc1640b1ac0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc15800e870 tx=0x7fc15800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc15e000640 1 -- 172.21.15.37:0/3435268591 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158017070 con 0x7fc16406e000 2024-05-30T06:50:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc15e000640 1 -- 172.21.15.37:0/3435268591 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15800c940 con 0x7fc16406e000 2024-05-30T06:50:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc15e000640 1 -- 172.21.15.37:0/3435268591 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15800ccf0 con 0x7fc16406e000 2024-05-30T06:50:21.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc16c800640 1 -- 172.21.15.37:0/3435268591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1640b0170 con 0x7fc16406e000 2024-05-30T06:50:21.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.101+0000 7fc16c800640 1 -- 172.21.15.37:0/3435268591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16415b060 con 0x7fc16406e000 2024-05-30T06:50:21.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.105+0000 7fc16c800640 1 -- 172.21.15.37:0/3435268591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc164068b20 con 0x7fc16406e000 2024-05-30T06:50:21.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.105+0000 7fc15e000640 1 -- 172.21.15.37:0/3435268591 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fc15801a070 con 0x7fc16406e000 2024-05-30T06:50:21.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.105+0000 7fc15e000640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc148069130 0x7fc14806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.105+0000 7fc15e000640 1 -- 172.21.15.37:0/3435268591 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7fc158085960 con 0x7fc16406e000 2024-05-30T06:50:21.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.105+0000 7fc169400640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc148069130 0x7fc14806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.105+0000 7fc169400640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc148069130 0x7fc14806b5f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc1540b2000 tx=0x7fc154008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:21.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.109+0000 7fc15e000640 1 -- 172.21.15.37:0/3435268591 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc1580576c0 con 0x7fc16406e000 2024-05-30T06:50:21.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc16c800640 1 -- 172.21.15.37:0/3435268591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1641398e0 con 0x7fc16406e000 2024-05-30T06:50:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc15e000640 1 -- 172.21.15.37:0/3435268591 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5181 (secure 0 0 0) 0x7fc158056fc0 con 0x7fc16406e000 2024-05-30T06:50:21.309 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:21.310 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2689846178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2689846178},{"type":"v1","addr":"172.21.15.37:6834","nonce":2689846178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1799611833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1799611833},{"type":"v1","addr":"172.21.15.37:6835","nonce":1799611833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/35182660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":35182660},{"type":"v1","addr":"172.21.15.105:6837","nonce":35182660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:48:34.974228+0000","modified":"2024-05-30T06:48:37.938821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6055":{"gid":6055,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/2127976173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":2127976173},{"type":"v1","addr":"172.21.15.105:6835","nonce":2127976173}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6055,"qdb_cluster":[6055]},"id":4}]} 2024-05-30T06:50:21.310 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 38 2024-05-30T06:50:21.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc16c800640 1 -- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc148069130 msgr2=0x7fc14806b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc16c800640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc148069130 0x7fc14806b5f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc1540b2000 tx=0x7fc154008040 comp rx=0 tx=0).stop 2024-05-30T06:50:21.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc16c800640 1 -- 172.21.15.37:0/3435268591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc16406e000 msgr2=0x7fc1640b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc16c800640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc16406e000 0x7fc1640b1ac0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc15800e870 tx=0x7fc15800ec70 comp rx=0 tx=0).stop 2024-05-30T06:50:21.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc16c800640 1 -- 172.21.15.37:0/3435268591 shutdown_connections 2024-05-30T06:50:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc16c800640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc16415cd80 0x7fc16415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc16c800640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc148069130 0x7fc14806b5f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc16c800640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1640cec40 0x7fc1640b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc16c800640 1 --2- 172.21.15.37:0/3435268591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc16406e000 0x7fc1640b1ac0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc16c800640 1 -- 172.21.15.37:0/3435268591 >> 172.21.15.37:0/3435268591 conn(0x7fc1640b23a0 msgr2=0x7fc164143140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc16c800640 1 -- 172.21.15.37:0/3435268591 shutdown_connections 2024-05-30T06:50:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.309+0000 7fc16c800640 1 -- 172.21.15.37:0/3435268591 wait complete. 2024-05-30T06:50:21.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:50:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.469+0000 7fe44c200640 1 Processor -- start 2024-05-30T06:50:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.469+0000 7fe44c200640 1 -- start start 2024-05-30T06:50:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe44c200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe4441482d0 0x7fe4440b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe44c200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe44415eed0 0x7fe44415f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe44c200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe44415f8a0 con 0x7fe4440af690 2024-05-30T06:50:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe44c200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe44406e860 con 0x7fe4441482d0 2024-05-30T06:50:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe44c200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe4440afe30 con 0x7fe44415eed0 2024-05-30T06:50:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe448e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe4440af690 0x7fe44415ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48242/0 (socket says 172.21.15.37:48242) 2024-05-30T06:50:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe448e00640 1 -- 172.21.15.37:0/1845210662 learned_addr learned my addr 172.21.15.37:0/1845210662 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe44a200640 1 --2- 172.21.15.37:0/1845210662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe44415eed0 0x7fe44415f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe449800640 1 --2- 172.21.15.37:0/1845210662 >> v2:172.21.15.105:3300/0 conn(0x7fe4441482d0 0x7fe4440b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe443e00640 1 -- 172.21.15.37:0/1845210662 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3312356772 0 0) 0x7fe44415f8a0 con 0x7fe4440af690 2024-05-30T06:50:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe443e00640 1 -- 172.21.15.37:0/1845210662 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe42c003530 con 0x7fe4440af690 2024-05-30T06:50:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe449800640 1 -- 172.21.15.37:0/1845210662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe44415eed0 msgr2=0x7fe44415f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe449800640 1 --2- 172.21.15.37:0/1845210662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe44415eed0 0x7fe44415f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe449800640 1 -- 172.21.15.37:0/1845210662 >> v1:172.21.15.37:6789/0 conn(0x7fe4440af690 legacy=0x7fe44415ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe449800640 1 -- 172.21.15.37:0/1845210662 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44406e210 con 0x7fe4441482d0 2024-05-30T06:50:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.473+0000 7fe44a200640 1 --2- 172.21.15.37:0/1845210662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe44415eed0 0x7fe44415f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe449800640 1 --2- 172.21.15.37:0/1845210662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4441482d0 0x7fe4440b2ec0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe4380097c0 tx=0x7fe43801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da11b2aa978e54f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe443e00640 1 -- 172.21.15.37:0/1845210662 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4380b0070 con 0x7fe4441482d0 2024-05-30T06:50:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe443e00640 1 -- 172.21.15.37:0/1845210662 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4380ab600 con 0x7fe4441482d0 2024-05-30T06:50:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe443e00640 1 -- 172.21.15.37:0/1845210662 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4380ab9d0 con 0x7fe4441482d0 2024-05-30T06:50:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe44c200640 1 -- 172.21.15.37:0/1845210662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4441482d0 msgr2=0x7fe4440b2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe44c200640 1 --2- 172.21.15.37:0/1845210662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4441482d0 0x7fe4440b2ec0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe4380097c0 tx=0x7fe43801c410 comp rx=0 tx=0).stop 2024-05-30T06:50:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe44c200640 1 -- 172.21.15.37:0/1845210662 shutdown_connections 2024-05-30T06:50:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe44c200640 1 --2- 172.21.15.37:0/1845210662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe44415eed0 0x7fe44415f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe44c200640 1 --2- 172.21.15.37:0/1845210662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4441482d0 0x7fe4440b2ec0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe44c200640 1 -- 172.21.15.37:0/1845210662 >> 172.21.15.37:0/1845210662 conn(0x7fe4440b23a0 msgr2=0x7fe4440b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe44c200640 1 -- 172.21.15.37:0/1845210662 shutdown_connections 2024-05-30T06:50:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe44c200640 1 -- 172.21.15.37:0/1845210662 wait complete. 2024-05-30T06:50:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe44c200640 1 Processor -- start 2024-05-30T06:50:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.477+0000 7fe44c200640 1 -- start start 2024-05-30T06:50:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44c200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4440af690 0x7fe44415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44c200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4441482d0 0x7fe4440cf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44c200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44415eed0 0x7fe444143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44c200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe44406f8d0 con 0x7fe44415eed0 2024-05-30T06:50:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44c200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe44406f750 con 0x7fe4441482d0 2024-05-30T06:50:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44c200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe44416b890 con 0x7fe4440af690 2024-05-30T06:50:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44a200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44415eed0 0x7fe444143f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44a200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44415eed0 0x7fe444143f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56814/0 (socket says 172.21.15.37:56814) 2024-05-30T06:50:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe449800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4440af690 0x7fe44415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44a200640 1 -- 172.21.15.37:0/1375713493 learned_addr learned my addr 172.21.15.37:0/1375713493 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe448e00640 1 --2- 172.21.15.37:0/1375713493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4441482d0 0x7fe4440cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44a200640 1 -- 172.21.15.37:0/1375713493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4440af690 msgr2=0x7fe44415bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44a200640 1 --2- 172.21.15.37:0/1375713493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4440af690 0x7fe44415bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44a200640 1 -- 172.21.15.37:0/1375713493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4441482d0 msgr2=0x7fe4440cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44a200640 1 --2- 172.21.15.37:0/1375713493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4441482d0 0x7fe4440cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44a200640 1 -- 172.21.15.37:0/1375713493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44413cf40 con 0x7fe44415eed0 2024-05-30T06:50:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44a200640 1 --2- 172.21.15.37:0/1375713493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44415eed0 0x7fe444143f50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00efc0 tx=0x7fe43c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe441600640 1 -- 172.21.15.37:0/1375713493 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c018030 con 0x7fe44415eed0 2024-05-30T06:50:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe441600640 1 -- 172.21.15.37:0/1375713493 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43c00cdf0 con 0x7fe44415eed0 2024-05-30T06:50:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe441600640 1 -- 172.21.15.37:0/1375713493 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c003bc0 con 0x7fe44415eed0 2024-05-30T06:50:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44c200640 1 -- 172.21.15.37:0/1375713493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44413d220 con 0x7fe44415eed0 2024-05-30T06:50:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44c200640 1 -- 172.21.15.37:0/1375713493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe44413d7e0 con 0x7fe44415eed0 2024-05-30T06:50:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe44c200640 1 -- 172.21.15.37:0/1375713493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe444068b20 con 0x7fe44415eed0 2024-05-30T06:50:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.481+0000 7fe441600640 1 -- 172.21.15.37:0/1375713493 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fe43c01b070 con 0x7fe44415eed0 2024-05-30T06:50:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.485+0000 7fe441600640 1 --2- 172.21.15.37:0/1375713493 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe424069100 0x7fe42406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.485+0000 7fe441600640 1 -- 172.21.15.37:0/1375713493 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7fe43c085f60 con 0x7fe44415eed0 2024-05-30T06:50:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.485+0000 7fe449800640 1 --2- 172.21.15.37:0/1375713493 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe424069100 0x7fe42406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.485+0000 7fe449800640 1 --2- 172.21.15.37:0/1375713493 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe424069100 0x7fe42406b5c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe4380ad000 tx=0x7fe4380a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.489+0000 7fe441600640 1 -- 172.21.15.37:0/1375713493 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe43c010040 con 0x7fe44415eed0 2024-05-30T06:50:21.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.657+0000 7fe44c200640 1 -- 172.21.15.37:0/1375713493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe444072fb0 con 0x7fe44415eed0 2024-05-30T06:50:21.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.657+0000 7fe441600640 1 -- 172.21.15.37:0/1375713493 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+16761 (secure 0 0 0) 0x7fe43c057670 con 0x7fe44415eed0 2024-05-30T06:50:21.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:21.659 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":61,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:50:16.734887+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:48:33.300340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-05-30T06:48:33.866916+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":61,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:50:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.657+0000 7fe44c200640 1 -- 172.21.15.37:0/1375713493 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe424069100 msgr2=0x7fe42406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.657+0000 7fe44c200640 1 --2- 172.21.15.37:0/1375713493 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe424069100 0x7fe42406b5c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe4380ad000 tx=0x7fe4380a6000 comp rx=0 tx=0).stop 2024-05-30T06:50:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.657+0000 7fe44c200640 1 -- 172.21.15.37:0/1375713493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44415eed0 msgr2=0x7fe444143f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.661+0000 7fe44c200640 1 --2- 172.21.15.37:0/1375713493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44415eed0 0x7fe444143f50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00efc0 tx=0x7fe43c00c490 comp rx=0 tx=0).stop 2024-05-30T06:50:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.661+0000 7fe44c200640 1 -- 172.21.15.37:0/1375713493 shutdown_connections 2024-05-30T06:50:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.661+0000 7fe44c200640 1 --2- 172.21.15.37:0/1375713493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44415eed0 0x7fe444143f50 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.661+0000 7fe44c200640 1 --2- 172.21.15.37:0/1375713493 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe424069100 0x7fe42406b5c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.661+0000 7fe44c200640 1 --2- 172.21.15.37:0/1375713493 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4441482d0 0x7fe4440cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.661+0000 7fe44c200640 1 --2- 172.21.15.37:0/1375713493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4440af690 0x7fe44415bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.661+0000 7fe44c200640 1 -- 172.21.15.37:0/1375713493 >> 172.21.15.37:0/1375713493 conn(0x7fe4440b23a0 msgr2=0x7fe4440b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.661+0000 7fe44c200640 1 -- 172.21.15.37:0/1375713493 shutdown_connections 2024-05-30T06:50:21.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.661+0000 7fe44c200640 1 -- 172.21.15.37:0/1375713493 wait complete. 2024-05-30T06:50:21.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T06:50:21.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.821+0000 7f62ed000640 1 Processor -- start 2024-05-30T06:50:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.821+0000 7f62ed000640 1 -- start start 2024-05-30T06:50:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.821+0000 7f62ed000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f62e8155da0 0x7f62e80cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.821+0000 7f62ed000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62e806f770 0x7f62e80b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.821+0000 7f62ed000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e815f310 con 0x7f62e80cd440 2024-05-30T06:50:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.821+0000 7f62ed000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f62e815f5f0 con 0x7f62e8155da0 2024-05-30T06:50:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.821+0000 7f62ed000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f62e815f8d0 con 0x7f62e806f770 2024-05-30T06:50:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62e6800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62e806f770 0x7f62e80b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62dd400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f62e80cd440 0x7f62e806f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47510/0 (socket says 172.21.15.37:47510) 2024-05-30T06:50:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62e5e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f62e8155da0 0x7f62e80cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62dd400640 1 -- 172.21.15.37:0/4215235114 learned_addr learned my addr 172.21.15.37:0/4215235114 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62e5400640 1 -- 172.21.15.37:0/4215235114 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051921827 0 0) 0x7f62e815f310 con 0x7f62e80cd440 2024-05-30T06:50:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62e5400640 1 -- 172.21.15.37:0/4215235114 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62cc005740 con 0x7f62e80cd440 2024-05-30T06:50:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62e6800640 1 -- 172.21.15.37:0/4215235114 >> v2:172.21.15.105:3300/0 conn(0x7f62e8155da0 msgr2=0x7f62e80cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62e6800640 1 --2- 172.21.15.37:0/4215235114 >> v2:172.21.15.105:3300/0 conn(0x7f62e8155da0 0x7f62e80cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62e6800640 1 -- 172.21.15.37:0/4215235114 >> v1:172.21.15.105:6789/0 conn(0x7f62e80cd440 legacy=0x7f62e806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62e6800640 1 -- 172.21.15.37:0/4215235114 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e815fbb0 con 0x7f62e806f770 2024-05-30T06:50:21.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62e6800640 1 --2- 172.21.15.37:0/4215235114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62e806f770 0x7f62e80b3750 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009d90 tx=0x7f62e001c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b25b7d205f7c9109 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:21.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62e5400640 1 -- 172.21.15.37:0/4215235114 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e00b2070 con 0x7f62e806f770 2024-05-30T06:50:21.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62e5400640 1 -- 172.21.15.37:0/4215235114 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e00a5710 con 0x7f62e806f770 2024-05-30T06:50:21.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.825+0000 7f62e5400640 1 -- 172.21.15.37:0/4215235114 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e00a5ae0 con 0x7f62e806f770 2024-05-30T06:50:21.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 -- 172.21.15.37:0/4215235114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62e806f770 msgr2=0x7f62e80b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 --2- 172.21.15.37:0/4215235114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62e806f770 0x7f62e80b3750 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009d90 tx=0x7f62e001c850 comp rx=0 tx=0).stop 2024-05-30T06:50:21.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 -- 172.21.15.37:0/4215235114 shutdown_connections 2024-05-30T06:50:21.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 --2- 172.21.15.37:0/4215235114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62e806f770 0x7f62e80b3750 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 --2- 172.21.15.37:0/4215235114 >> v2:172.21.15.105:3300/0 conn(0x7f62e8155da0 0x7f62e80cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 -- 172.21.15.37:0/4215235114 >> 172.21.15.37:0/4215235114 conn(0x7f62e806bf60 msgr2=0x7f62e80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:21.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 -- 172.21.15.37:0/4215235114 shutdown_connections 2024-05-30T06:50:21.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 -- 172.21.15.37:0/4215235114 wait complete. 2024-05-30T06:50:21.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 Processor -- start 2024-05-30T06:50:21.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 -- start start 2024-05-30T06:50:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62e806f770 0x7f62e80aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8155da0 0x7f62e80a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62e8154cd0 0x7f62e8154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f62e806df50 con 0x7f62e8154cd0 2024-05-30T06:50:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62e80b46b0 con 0x7f62e8155da0 2024-05-30T06:50:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62ed000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f62e806e0d0 con 0x7f62e806f770 2024-05-30T06:50:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62e6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62e8154cd0 0x7f62e8154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62e6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62e8154cd0 0x7f62e8154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56822/0 (socket says 172.21.15.37:56822) 2024-05-30T06:50:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62e6800640 1 -- 172.21.15.37:0/1001612776 learned_addr learned my addr 172.21.15.37:0/1001612776 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62dd400640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8155da0 0x7f62e80a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62e5e00640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62e806f770 0x7f62e80aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62e6800640 1 -- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62e806f770 msgr2=0x7f62e80aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62e6800640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62e806f770 0x7f62e80aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62e6800640 1 -- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8155da0 msgr2=0x7f62e80a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:21.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62e6800640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8155da0 0x7f62e80a94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:21.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.829+0000 7f62e6800640 1 -- 172.21.15.37:0/1001612776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e80cefb0 con 0x7f62e8154cd0 2024-05-30T06:50:21.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.833+0000 7f62e6800640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62e8154cd0 0x7f62e8154500 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009d90 tx=0x7f62e00195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:21.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.833+0000 7f62dea00640 1 -- 172.21.15.37:0/1001612776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e00b2050 con 0x7f62e8154cd0 2024-05-30T06:50:21.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.833+0000 7f62dea00640 1 -- 172.21.15.37:0/1001612776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e00be070 con 0x7f62e8154cd0 2024-05-30T06:50:21.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.833+0000 7f62dea00640 1 -- 172.21.15.37:0/1001612776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0009450 con 0x7f62e8154cd0 2024-05-30T06:50:21.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.833+0000 7f62ed000640 1 -- 172.21.15.37:0/1001612776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e80a9a00 con 0x7f62e8154cd0 2024-05-30T06:50:21.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.833+0000 7f62ed000640 1 -- 172.21.15.37:0/1001612776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e80a9f60 con 0x7f62e8154cd0 2024-05-30T06:50:21.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.833+0000 7f62ed000640 1 -- 172.21.15.37:0/1001612776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e8068bc0 con 0x7f62e8154cd0 2024-05-30T06:50:21.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.833+0000 7f62dea00640 1 -- 172.21.15.37:0/1001612776 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f62e00ad890 con 0x7f62e8154cd0 2024-05-30T06:50:21.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.837+0000 7f62dea00640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f62c4069130 0x7f62c406b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:21.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.837+0000 7f62dea00640 1 -- 172.21.15.37:0/1001612776 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5765+0+0 (secure 0 0 0) 0x7f62e0120230 con 0x7f62e8154cd0 2024-05-30T06:50:21.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.837+0000 7f62e5e00640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f62c4069130 0x7f62c406b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:21.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.837+0000 7f62e5e00640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f62c4069130 0x7f62c406b5f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009ac0 tx=0x7f62d8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:21.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:21.841+0000 7f62dea00640 1 -- 172.21.15.37:0/1001612776 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f62e80a9a00 con 0x7f62e8154cd0 2024-05-30T06:50:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.037+0000 7f62ed000640 1 -- 172.21.15.37:0/1001612776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f62e80b6790 con 0x7f62e8154cd0 2024-05-30T06:50:22.040 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-30T06:50:22.041+0000 7fd1bb400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T06:50:22.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.041+0000 7f62dea00640 1 -- 172.21.15.37:0/1001612776 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) ==== 161+0+0 (secure 0 0 0) 0x7f62e0016560 con 0x7f62e8154cd0 2024-05-30T06:50:22.043 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T06:50:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.045+0000 7f62ed000640 1 -- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f62c4069130 msgr2=0x7f62c406b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:22.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.045+0000 7f62ed000640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f62c4069130 0x7f62c406b5f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009ac0 tx=0x7f62d8009190 comp rx=0 tx=0).stop 2024-05-30T06:50:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.045+0000 7f62ed000640 1 -- 172.21.15.37:0/1001612776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62e8154cd0 msgr2=0x7f62e8154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.045+0000 7f62ed000640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62e8154cd0 0x7f62e8154500 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009d90 tx=0x7f62e00195f0 comp rx=0 tx=0).stop 2024-05-30T06:50:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.045+0000 7f62ed000640 1 -- 172.21.15.37:0/1001612776 shutdown_connections 2024-05-30T06:50:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.045+0000 7f62ed000640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62e8154cd0 0x7f62e8154500 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.045+0000 7f62ed000640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f62c4069130 0x7f62c406b5f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.045+0000 7f62ed000640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62e8155da0 0x7f62e80a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.045+0000 7f62ed000640 1 --2- 172.21.15.37:0/1001612776 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62e806f770 0x7f62e80aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.045+0000 7f62ed000640 1 -- 172.21.15.37:0/1001612776 >> 172.21.15.37:0/1001612776 conn(0x7f62e806bf60 msgr2=0x7f62e806e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.045+0000 7f62ed000640 1 -- 172.21.15.37:0/1001612776 shutdown_connections 2024-05-30T06:50:22.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.045+0000 7f62ed000640 1 -- 172.21.15.37:0/1001612776 wait complete. 2024-05-30T06:50:22.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T06:50:22.117 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-05-30T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.209+0000 7fa285600640 1 Processor -- start 2024-05-30T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.209+0000 7fa285600640 1 -- start start 2024-05-30T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.209+0000 7fa285600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa28015d350 0x7fa28006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.209+0000 7fa285600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015d7e0 0x7fa28006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.209+0000 7fa285600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa280142030 con 0x7fa2800b59d0 2024-05-30T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.209+0000 7fa285600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa280142310 con 0x7fa28015d350 2024-05-30T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.209+0000 7fa285600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa2801425f0 con 0x7fa28015d7e0 2024-05-30T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.213+0000 7fa27f400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015d7e0 0x7fa28006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.213+0000 7fa27ea00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa2800b59d0 0x7fa2800b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47524/0 (socket says 172.21.15.37:47524) 2024-05-30T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.213+0000 7fa27ea00640 1 -- 172.21.15.37:0/672543951 learned_addr learned my addr 172.21.15.37:0/672543951 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.213+0000 7fa276000640 1 --2- 172.21.15.37:0/672543951 >> v2:172.21.15.105:3300/0 conn(0x7fa28015d350 0x7fa28006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.213+0000 7fa27f400640 1 -- 172.21.15.37:0/672543951 >> v2:172.21.15.105:3300/0 conn(0x7fa28015d350 msgr2=0x7fa28006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.213+0000 7fa27f400640 1 --2- 172.21.15.37:0/672543951 >> v2:172.21.15.105:3300/0 conn(0x7fa28015d350 0x7fa28006df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.213+0000 7fa27f400640 1 -- 172.21.15.37:0/672543951 >> v1:172.21.15.105:6789/0 conn(0x7fa2800b59d0 legacy=0x7fa2800b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.213+0000 7fa27f400640 1 -- 172.21.15.37:0/672543951 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2801428d0 con 0x7fa28015d7e0 2024-05-30T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.213+0000 7fa27e000640 1 -- 172.21.15.37:0/672543951 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911266938 0 0) 0x7fa280142030 con 0x7fa2800b59d0 2024-05-30T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.213+0000 7fa27f400640 1 --2- 172.21.15.37:0/672543951 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015d7e0 0x7fa28006e490 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa2780097f0 tx=0x7fa27801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66d839555fd8c34e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.213+0000 7fa27e000640 1 -- 172.21.15.37:0/672543951 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2780b5070 con 0x7fa28015d7e0 2024-05-30T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.213+0000 7fa27e000640 1 -- 172.21.15.37:0/672543951 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2780a8990 con 0x7fa28015d7e0 2024-05-30T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.213+0000 7fa27e000640 1 -- 172.21.15.37:0/672543951 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2780a8d60 con 0x7fa28015d7e0 2024-05-30T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 -- 172.21.15.37:0/672543951 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015d7e0 msgr2=0x7fa28006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 --2- 172.21.15.37:0/672543951 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015d7e0 0x7fa28006e490 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa2780097f0 tx=0x7fa27801ec90 comp rx=0 tx=0).stop 2024-05-30T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 -- 172.21.15.37:0/672543951 shutdown_connections 2024-05-30T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 --2- 172.21.15.37:0/672543951 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa28015d7e0 0x7fa28006e490 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 --2- 172.21.15.37:0/672543951 >> v2:172.21.15.105:3300/0 conn(0x7fa28015d350 0x7fa28006df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:22.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 -- 172.21.15.37:0/672543951 >> 172.21.15.37:0/672543951 conn(0x7fa28006bf60 msgr2=0x7fa2800b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:22.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 -- 172.21.15.37:0/672543951 shutdown_connections 2024-05-30T06:50:22.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 -- 172.21.15.37:0/672543951 wait complete. 2024-05-30T06:50:22.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 Processor -- start 2024-05-30T06:50:22.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 -- start start 2024-05-30T06:50:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2800b59d0 0x7fa280158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28015d350 0x7fa2800b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa28015d7e0 0x7fa2800b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2800b00a0 con 0x7fa28015d350 2024-05-30T06:50:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa2800aff20 con 0x7fa28015d7e0 2024-05-30T06:50:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa285600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa28013f860 con 0x7fa2800b59d0 2024-05-30T06:50:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa276000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28015d350 0x7fa2800b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa27ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2800b59d0 0x7fa280158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa27f400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa28015d7e0 0x7fa2800b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:22.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa27ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2800b59d0 0x7fa280158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34662/0 (socket says 172.21.15.37:34662) 2024-05-30T06:50:22.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.217+0000 7fa27ea00640 1 -- 172.21.15.37:0/541259743 learned_addr learned my addr 172.21.15.37:0/541259743 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa27f400640 1 -- 172.21.15.37:0/541259743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2800b59d0 msgr2=0x7fa280158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa27f400640 1 --2- 172.21.15.37:0/541259743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2800b59d0 0x7fa280158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa27f400640 1 -- 172.21.15.37:0/541259743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28015d350 msgr2=0x7fa2800b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa27f400640 1 --2- 172.21.15.37:0/541259743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28015d350 0x7fa2800b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa27f400640 1 -- 172.21.15.37:0/541259743 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa280158f60 con 0x7fa28015d7e0 2024-05-30T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa276000640 1 --2- 172.21.15.37:0/541259743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28015d350 0x7fa2800b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa27f400640 1 --2- 172.21.15.37:0/541259743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa28015d7e0 0x7fa2800b12c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa2780af000 tx=0x7fa27801ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa277400640 1 -- 172.21.15.37:0/541259743 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2780c1070 con 0x7fa28015d7e0 2024-05-30T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa277400640 1 -- 172.21.15.37:0/541259743 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2780b0720 con 0x7fa28015d7e0 2024-05-30T06:50:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa285600640 1 -- 172.21.15.37:0/541259743 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa280159240 con 0x7fa28015d7e0 2024-05-30T06:50:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa277400640 1 -- 172.21.15.37:0/541259743 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2780b5040 con 0x7fa28015d7e0 2024-05-30T06:50:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa285600640 1 -- 172.21.15.37:0/541259743 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa280159800 con 0x7fa28015d7e0 2024-05-30T06:50:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa285600640 1 -- 172.21.15.37:0/541259743 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa280068bc0 con 0x7fa28015d7e0 2024-05-30T06:50:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa277400640 1 -- 172.21.15.37:0/541259743 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fa2780c4070 con 0x7fa28015d7e0 2024-05-30T06:50:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa277400640 1 --2- 172.21.15.37:0/541259743 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa25c069130 0x7fa25c06b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa277400640 1 -- 172.21.15.37:0/541259743 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5823+0+0 (secure 0 0 0) 0x7fa2781222a0 con 0x7fa28015d7e0 2024-05-30T06:50:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.221+0000 7fa27ea00640 1 --2- 172.21.15.37:0/541259743 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa25c069130 0x7fa25c06b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:22.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.225+0000 7fa27ea00640 1 --2- 172.21.15.37:0/541259743 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa25c069130 0x7fa25c06b5f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa2700012f0 tx=0x7fa270001710 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.229+0000 7fa277400640 1 -- 172.21.15.37:0/541259743 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa2780187f0 con 0x7fa28015d7e0 2024-05-30T06:50:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:22.429+0000 7fa285600640 1 -- 172.21.15.37:0/541259743 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa280140a80 con 0x7fa28015d7e0 2024-05-30T06:50:23.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.045+0000 7fa277400640 1 -- 172.21.15.37:0/541259743 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) ==== 104+0+0 (secure 0 0 0) 0x7fa2780f39b0 con 0x7fa28015d7e0 2024-05-30T06:50:23.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.049+0000 7fa285600640 1 -- 172.21.15.37:0/541259743 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa25c069130 msgr2=0x7fa25c06b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:23.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.049+0000 7fa285600640 1 --2- 172.21.15.37:0/541259743 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa25c069130 0x7fa25c06b5f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa2700012f0 tx=0x7fa270001710 comp rx=0 tx=0).stop 2024-05-30T06:50:23.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.049+0000 7fa285600640 1 -- 172.21.15.37:0/541259743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa28015d7e0 msgr2=0x7fa2800b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:23.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.049+0000 7fa285600640 1 --2- 172.21.15.37:0/541259743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa28015d7e0 0x7fa2800b12c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa2780af000 tx=0x7fa27801ba30 comp rx=0 tx=0).stop 2024-05-30T06:50:23.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.049+0000 7fa285600640 1 -- 172.21.15.37:0/541259743 shutdown_connections 2024-05-30T06:50:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.049+0000 7fa285600640 1 --2- 172.21.15.37:0/541259743 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa25c069130 0x7fa25c06b5f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.049+0000 7fa285600640 1 --2- 172.21.15.37:0/541259743 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa28015d7e0 0x7fa2800b12c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.049+0000 7fa285600640 1 --2- 172.21.15.37:0/541259743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa28015d350 0x7fa2800b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.049+0000 7fa285600640 1 --2- 172.21.15.37:0/541259743 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2800b59d0 0x7fa280158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.049+0000 7fa285600640 1 -- 172.21.15.37:0/541259743 >> 172.21.15.37:0/541259743 conn(0x7fa28006bf60 msgr2=0x7fa2801419c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.049+0000 7fa285600640 1 -- 172.21.15.37:0/541259743 shutdown_connections 2024-05-30T06:50:23.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.049+0000 7fa285600640 1 -- 172.21.15.37:0/541259743 wait complete. 2024-05-30T06:50:23.074 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T06:50:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f24a3200640 1 Processor -- start 2024-05-30T06:50:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f24a3200640 1 -- start start 2024-05-30T06:50:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f24a3200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f249c1590c0 0x7f249c0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f24a3200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c0cd400 0x7f249c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f24a3200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249c15f230 con 0x7f249c0cde60 2024-05-30T06:50:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f24a3200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f249c15f510 con 0x7f249c1590c0 2024-05-30T06:50:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f24a3200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f249c15f7f0 con 0x7f249c0cd400 2024-05-30T06:50:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f249be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f249c1590c0 0x7f249c0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f249b400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f249c0cde60 0x7f249c06f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47536/0 (socket says 172.21.15.37:47536) 2024-05-30T06:50:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f249b400640 1 -- 172.21.15.37:0/2601696063 learned_addr learned my addr 172.21.15.37:0/2601696063 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f249be00640 1 --2- 172.21.15.37:0/2601696063 >> v2:172.21.15.37:3300/0 conn(0x7f249c1590c0 0x7f249c0cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56840/0 (socket says 172.21.15.37:56840) 2024-05-30T06:50:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f24a1200640 1 --2- 172.21.15.37:0/2601696063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c0cd400 0x7f249c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f249be00640 1 -- 172.21.15.37:0/2601696063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c0cd400 msgr2=0x7f249c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f249be00640 1 --2- 172.21.15.37:0/2601696063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c0cd400 0x7f249c0b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f249be00640 1 -- 172.21.15.37:0/2601696063 >> v1:172.21.15.105:6789/0 conn(0x7f249c0cde60 legacy=0x7f249c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.221+0000 7f249be00640 1 -- 172.21.15.37:0/2601696063 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c15fad0 con 0x7f249c1590c0 2024-05-30T06:50:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.225+0000 7f249be00640 1 --2- 172.21.15.37:0/2601696063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c1590c0 0x7f249c0cd920 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f248c009d90 tx=0x7f248c01eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b34fec55bbd51e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.225+0000 7f249aa00640 1 -- 172.21.15.37:0/2601696063 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c0b4070 con 0x7f249c1590c0 2024-05-30T06:50:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.225+0000 7f249aa00640 1 -- 172.21.15.37:0/2601696063 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248c0a79c0 con 0x7f249c1590c0 2024-05-30T06:50:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.225+0000 7f249aa00640 1 -- 172.21.15.37:0/2601696063 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c0a7d90 con 0x7f249c1590c0 2024-05-30T06:50:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.225+0000 7f24a3200640 1 -- 172.21.15.37:0/2601696063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c1590c0 msgr2=0x7f249c0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.225+0000 7f24a3200640 1 --2- 172.21.15.37:0/2601696063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c1590c0 0x7f249c0cd920 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f248c009d90 tx=0x7f248c01eaf0 comp rx=0 tx=0).stop 2024-05-30T06:50:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.225+0000 7f24a3200640 1 -- 172.21.15.37:0/2601696063 shutdown_connections 2024-05-30T06:50:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.225+0000 7f24a3200640 1 --2- 172.21.15.37:0/2601696063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c0cd400 0x7f249c0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.225+0000 7f24a3200640 1 --2- 172.21.15.37:0/2601696063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c1590c0 0x7f249c0cd920 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.225+0000 7f24a3200640 1 -- 172.21.15.37:0/2601696063 >> 172.21.15.37:0/2601696063 conn(0x7f249c06bf60 msgr2=0x7f249c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.225+0000 7f24a3200640 1 -- 172.21.15.37:0/2601696063 shutdown_connections 2024-05-30T06:50:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.225+0000 7f24a3200640 1 -- 172.21.15.37:0/2601696063 wait complete. 2024-05-30T06:50:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f24a3200640 1 Processor -- start 2024-05-30T06:50:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f24a3200640 1 -- start start 2024-05-30T06:50:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f24a3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cd400 0x7f249c144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f24a3200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f249c0cde60 0x7f249c15a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f24a3200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c1590c0 0x7f249c164ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f24a3200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f249c06f8f0 con 0x7f249c0cd400 2024-05-30T06:50:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f24a3200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f249c06f770 con 0x7f249c0cde60 2024-05-30T06:50:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f24a3200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f249c06df50 con 0x7f249c1590c0 2024-05-30T06:50:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f249be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cd400 0x7f249c144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f249be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cd400 0x7f249c144fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56854/0 (socket says 172.21.15.37:56854) 2024-05-30T06:50:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f249be00640 1 -- 172.21.15.37:0/1963322273 learned_addr learned my addr 172.21.15.37:0/1963322273 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f249b400640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f249c0cde60 0x7f249c15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f24a1200640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c1590c0 0x7f249c164ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f249be00640 1 -- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c1590c0 msgr2=0x7f249c164ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f249be00640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c1590c0 0x7f249c164ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f249be00640 1 -- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f249c0cde60 msgr2=0x7f249c15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f249be00640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f249c0cde60 0x7f249c15a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f249be00640 1 -- 172.21.15.37:0/1963322273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c15a950 con 0x7f249c0cd400 2024-05-30T06:50:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f24a1200640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c1590c0 0x7f249c164ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f249be00640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cd400 0x7f249c144fa0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f248c009d90 tx=0x7f248c01b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f2493e00640 1 -- 172.21.15.37:0/1963322273 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c0b4040 con 0x7f249c0cd400 2024-05-30T06:50:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f2493e00640 1 -- 172.21.15.37:0/1963322273 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248c0bd070 con 0x7f249c0cd400 2024-05-30T06:50:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f2493e00640 1 -- 172.21.15.37:0/1963322273 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c0b8660 con 0x7f249c0cd400 2024-05-30T06:50:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f24a3200640 1 -- 172.21.15.37:0/1963322273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249c15ac30 con 0x7f249c0cd400 2024-05-30T06:50:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.229+0000 7f24a3200640 1 -- 172.21.15.37:0/1963322273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f249c15b1f0 con 0x7f249c0cd400 2024-05-30T06:50:23.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.233+0000 7f24a3200640 1 -- 172.21.15.37:0/1963322273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249c068d40 con 0x7f249c0cd400 2024-05-30T06:50:23.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.233+0000 7f2493e00640 1 -- 172.21.15.37:0/1963322273 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f248c0b8800 con 0x7f249c0cd400 2024-05-30T06:50:23.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.233+0000 7f2493e00640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f247c069100 0x7f247c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:23.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.233+0000 7f2493e00640 1 -- 172.21.15.37:0/1963322273 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5823+0+0 (secure 0 0 0) 0x7f248c11fa60 con 0x7f249c0cd400 2024-05-30T06:50:23.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.233+0000 7f249b400640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f247c069100 0x7f247c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:23.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.233+0000 7f249b400640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f247c069100 0x7f247c06b5c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f249c1457c0 tx=0x7f2488009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:23.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.237+0000 7f2493e00640 1 -- 172.21.15.37:0/1963322273 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f248c018770 con 0x7f249c0cd400 2024-05-30T06:50:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:23.405+0000 7f24a3200640 1 -- 172.21.15.37:0/1963322273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f249c0b31b0 con 0x7f249c0cd400 2024-05-30T06:50:24.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.045+0000 7f2493e00640 1 -- 172.21.15.37:0/1963322273 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) ==== 181+0+0 (secure 0 0 0) 0x7f248c0f19e0 con 0x7f249c0cd400 2024-05-30T06:50:24.048 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-30T06:50:24.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.049+0000 7f24a3200640 1 -- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f247c069100 msgr2=0x7f247c06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:24.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.049+0000 7f24a3200640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f247c069100 0x7f247c06b5c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f249c1457c0 tx=0x7f2488009040 comp rx=0 tx=0).stop 2024-05-30T06:50:24.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.049+0000 7f24a3200640 1 -- 172.21.15.37:0/1963322273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cd400 msgr2=0x7f249c144fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:24.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.049+0000 7f24a3200640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cd400 0x7f249c144fa0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f248c009d90 tx=0x7f248c01b890 comp rx=0 tx=0).stop 2024-05-30T06:50:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.049+0000 7f24a3200640 1 -- 172.21.15.37:0/1963322273 shutdown_connections 2024-05-30T06:50:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.049+0000 7f24a3200640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f249c1590c0 0x7f249c164ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.049+0000 7f24a3200640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f247c069100 0x7f247c06b5c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.049+0000 7f24a3200640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f249c0cde60 0x7f249c15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.049+0000 7f24a3200640 1 --2- 172.21.15.37:0/1963322273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f249c0cd400 0x7f249c144fa0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.049+0000 7f24a3200640 1 -- 172.21.15.37:0/1963322273 >> 172.21.15.37:0/1963322273 conn(0x7f249c06bf60 msgr2=0x7f249c0b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.049+0000 7f24a3200640 1 -- 172.21.15.37:0/1963322273 shutdown_connections 2024-05-30T06:50:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.053+0000 7f24a3200640 1 -- 172.21.15.37:0/1963322273 wait complete. 2024-05-30T06:50:24.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T06:50:24.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2383200640 1 Processor -- start 2024-05-30T06:50:24.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2383200640 1 -- start start 2024-05-30T06:50:24.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2383200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f238415c7a0 0x7f23840b3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:24.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2383200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f23840b3bc0 0x7f23840ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:24.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2383200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23840cc090 con 0x7f23840cdb20 2024-05-30T06:50:24.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2383200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f238415cc00 con 0x7f238415c7a0 2024-05-30T06:50:24.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2383200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f23840cc370 con 0x7f23840b3bc0 2024-05-30T06:50:24.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2379400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f238415c7a0 0x7f23840b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:24.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2381e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f23840cdb20 0x7f23840cdf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48244/0 (socket says 172.21.15.37:48244) 2024-05-30T06:50:24.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2381e00640 1 -- 172.21.15.37:0/736067506 learned_addr learned my addr 172.21.15.37:0/736067506 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:24.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2382800640 1 --2- 172.21.15.37:0/736067506 >> v2:172.21.15.105:3300/0 conn(0x7f23840b3bc0 0x7f23840ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:24.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2379400640 1 -- 172.21.15.37:0/736067506 >> v2:172.21.15.105:3300/0 conn(0x7f23840b3bc0 msgr2=0x7f23840ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:24.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2379400640 1 --2- 172.21.15.37:0/736067506 >> v2:172.21.15.105:3300/0 conn(0x7f23840b3bc0 0x7f23840ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:24.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2379400640 1 -- 172.21.15.37:0/736067506 >> v1:172.21.15.37:6789/0 conn(0x7f23840cdb20 legacy=0x7f23840cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:24.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2379400640 1 -- 172.21.15.37:0/736067506 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23840cc650 con 0x7f238415c7a0 2024-05-30T06:50:24.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.237+0000 7f2381400640 1 -- 172.21.15.37:0/736067506 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1665978378 0 0) 0x7f23840cc090 con 0x7f23840cdb20 2024-05-30T06:50:24.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2379400640 1 --2- 172.21.15.37:0/736067506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238415c7a0 0x7f23840b3680 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f23840b7350 tx=0x7f237401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82543853452d1238 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:24.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2381400640 1 -- 172.21.15.37:0/736067506 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23740b1070 con 0x7f238415c7a0 2024-05-30T06:50:24.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2381400640 1 -- 172.21.15.37:0/736067506 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23740ac620 con 0x7f238415c7a0 2024-05-30T06:50:24.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2381400640 1 -- 172.21.15.37:0/736067506 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23740ac9f0 con 0x7f238415c7a0 2024-05-30T06:50:24.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2383200640 1 -- 172.21.15.37:0/736067506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238415c7a0 msgr2=0x7f23840b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:24.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2383200640 1 --2- 172.21.15.37:0/736067506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238415c7a0 0x7f23840b3680 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f23840b7350 tx=0x7f237401c3c0 comp rx=0 tx=0).stop 2024-05-30T06:50:24.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2383200640 1 -- 172.21.15.37:0/736067506 shutdown_connections 2024-05-30T06:50:24.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2383200640 1 --2- 172.21.15.37:0/736067506 >> v2:172.21.15.105:3300/0 conn(0x7f23840b3bc0 0x7f23840ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:24.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2383200640 1 --2- 172.21.15.37:0/736067506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238415c7a0 0x7f23840b3680 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:24.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2383200640 1 -- 172.21.15.37:0/736067506 >> 172.21.15.37:0/736067506 conn(0x7f238409aa60 msgr2=0x7f23840b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:24.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2383200640 1 -- 172.21.15.37:0/736067506 shutdown_connections 2024-05-30T06:50:24.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2383200640 1 -- 172.21.15.37:0/736067506 wait complete. 2024-05-30T06:50:24.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2383200640 1 Processor -- start 2024-05-30T06:50:24.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.241+0000 7f2383200640 1 -- start start 2024-05-30T06:50:24.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2383200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23840b3bc0 0x7f23841527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:24.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2383200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23840cdb20 0x7f23840c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:24.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2383200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238415c7a0 0x7f23840c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:24.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2383200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f23840cfec0 con 0x7f238415c7a0 2024-05-30T06:50:24.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2383200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f23840cfd40 con 0x7f23840b3bc0 2024-05-30T06:50:24.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2383200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2384168540 con 0x7f23840cdb20 2024-05-30T06:50:24.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2382800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238415c7a0 0x7f23840c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:24.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2382800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238415c7a0 0x7f23840c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56866/0 (socket says 172.21.15.37:56866) 2024-05-30T06:50:24.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2382800640 1 -- 172.21.15.37:0/262387241 learned_addr learned my addr 172.21.15.37:0/262387241 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:24.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2381e00640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23840b3bc0 0x7f23841527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:24.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2379400640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23840cdb20 0x7f23840c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2382800640 1 -- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23840cdb20 msgr2=0x7f23840c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2382800640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23840cdb20 0x7f23840c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2382800640 1 -- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23840b3bc0 msgr2=0x7f23841527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2382800640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23840b3bc0 0x7f23841527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2382800640 1 -- 172.21.15.37:0/262387241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23840c7a10 con 0x7f238415c7a0 2024-05-30T06:50:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2382800640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238415c7a0 0x7f23840c6ca0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f237c007ca0 tx=0x7f237c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f237aa00640 1 -- 172.21.15.37:0/262387241 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c014420 con 0x7f238415c7a0 2024-05-30T06:50:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f237aa00640 1 -- 172.21.15.37:0/262387241 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f237c019070 con 0x7f238415c7a0 2024-05-30T06:50:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2383200640 1 -- 172.21.15.37:0/262387241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238415ce60 con 0x7f238415c7a0 2024-05-30T06:50:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f237aa00640 1 -- 172.21.15.37:0/262387241 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c014800 con 0x7f238415c7a0 2024-05-30T06:50:24.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2383200640 1 -- 172.21.15.37:0/262387241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23840c8270 con 0x7f238415c7a0 2024-05-30T06:50:24.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f2383200640 1 -- 172.21.15.37:0/262387241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f238415d030 con 0x7f238415c7a0 2024-05-30T06:50:24.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.245+0000 7f237aa00640 1 -- 172.21.15.37:0/262387241 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f237c0149a0 con 0x7f238415c7a0 2024-05-30T06:50:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.249+0000 7f237aa00640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2360069100 0x7f236006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.249+0000 7f237aa00640 1 -- 172.21.15.37:0/262387241 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5385+0+0 (secure 0 0 0) 0x7f237c085e80 con 0x7f238415c7a0 2024-05-30T06:50:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.249+0000 7f2381e00640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2360069100 0x7f236006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.249+0000 7f2381e00640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2360069100 0x7f236006b5c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f236c000f70 tx=0x7f236c007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:24.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.253+0000 7f237aa00640 1 -- 172.21.15.37:0/262387241 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f237c057590 con 0x7f238415c7a0 2024-05-30T06:50:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:24.417+0000 7f2383200640 1 -- 172.21.15.37:0/262387241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2384068ab0 con 0x7f238415c7a0 2024-05-30T06:50:25.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.049+0000 7f237aa00640 1 -- 172.21.15.37:0/262387241 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) ==== 169+0+0 (secure 0 0 0) 0x7f237c05b890 con 0x7f238415c7a0 2024-05-30T06:50:25.050 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-30T06:50:25.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.057+0000 7f2383200640 1 -- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2360069100 msgr2=0x7f236006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.057+0000 7f2383200640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2360069100 0x7f236006b5c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f236c000f70 tx=0x7f236c007b60 comp rx=0 tx=0).stop 2024-05-30T06:50:25.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.057+0000 7f2383200640 1 -- 172.21.15.37:0/262387241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238415c7a0 msgr2=0x7f23840c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.057+0000 7f2383200640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238415c7a0 0x7f23840c6ca0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f237c007ca0 tx=0x7f237c00e4b0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.057+0000 7f2383200640 1 -- 172.21.15.37:0/262387241 shutdown_connections 2024-05-30T06:50:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.057+0000 7f2383200640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f238415c7a0 0x7f23840c6ca0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.057+0000 7f2383200640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23840cdb20 0x7f23840c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.057+0000 7f2383200640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2360069100 0x7f236006b5c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.057+0000 7f2383200640 1 --2- 172.21.15.37:0/262387241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23840b3bc0 0x7f23841527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.057+0000 7f2383200640 1 -- 172.21.15.37:0/262387241 >> 172.21.15.37:0/262387241 conn(0x7f238409aa60 msgr2=0x7f2384159da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.057+0000 7f2383200640 1 -- 172.21.15.37:0/262387241 shutdown_connections 2024-05-30T06:50:25.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.057+0000 7f2383200640 1 -- 172.21.15.37:0/262387241 wait complete. 2024-05-30T06:50:25.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_no_wait 2024-05-30T06:50:25.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.253+0000 7f3fa5a00640 1 Processor -- start 2024-05-30T06:50:25.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.253+0000 7f3fa5a00640 1 -- start start 2024-05-30T06:50:25.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3fa5a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3fa015d7e0 0x7f3fa006e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3fa5a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa0142030 con 0x7f3fa015d350 2024-05-30T06:50:25.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3fa5a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa0142310 con 0x7f3fa00b59d0 2024-05-30T06:50:25.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3fa5a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa01425f0 con 0x7f3fa015d7e0 2024-05-30T06:50:25.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3f97e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3fa015d350 0x7f3fa006df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48248/0 (socket says 172.21.15.37:48248) 2024-05-30T06:50:25.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3f9f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3fa015d7e0 0x7f3fa006e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3f97e00640 1 -- 172.21.15.37:0/2916361377 learned_addr learned my addr 172.21.15.37:0/2916361377 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3f9e000640 1 -- 172.21.15.37:0/2916361377 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2463838087 0 0) 0x7f3fa0142030 con 0x7f3fa015d350 2024-05-30T06:50:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3f9e000640 1 -- 172.21.15.37:0/2916361377 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f84003530 con 0x7f3fa015d350 2024-05-30T06:50:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3f9e000640 1 -- 172.21.15.37:0/2916361377 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2070096355 0 0) 0x7f3fa0142310 con 0x7f3fa00b59d0 2024-05-30T06:50:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3f9e000640 1 -- 172.21.15.37:0/2916361377 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fa0142030 con 0x7f3fa00b59d0 2024-05-30T06:50:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3f9f400640 1 -- 172.21.15.37:0/2916361377 >> v1:172.21.15.105:6789/0 conn(0x7f3fa00b59d0 legacy=0x7f3fa00b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3f9f400640 1 -- 172.21.15.37:0/2916361377 >> v1:172.21.15.37:6789/0 conn(0x7f3fa015d350 legacy=0x7f3fa006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.257+0000 7f3f9f400640 1 -- 172.21.15.37:0/2916361377 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa01428d0 con 0x7f3fa015d7e0 2024-05-30T06:50:25.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.261+0000 7f3f9f400640 1 --2- 172.21.15.37:0/2916361377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa015d7e0 0x7f3fa006e660 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009dc0 tx=0x7f3f9801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d626088d5d86f95 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:25.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.261+0000 7f3f9e000640 1 -- 172.21.15.37:0/2916361377 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f980b2070 con 0x7f3fa015d7e0 2024-05-30T06:50:25.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.261+0000 7f3f9e000640 1 -- 172.21.15.37:0/2916361377 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f980a5920 con 0x7f3fa015d7e0 2024-05-30T06:50:25.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.261+0000 7f3f9e000640 1 -- 172.21.15.37:0/2916361377 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f980a5cf0 con 0x7f3fa015d7e0 2024-05-30T06:50:25.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.261+0000 7f3fa5a00640 1 -- 172.21.15.37:0/2916361377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa015d7e0 msgr2=0x7f3fa006e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.261+0000 7f3fa5a00640 1 --2- 172.21.15.37:0/2916361377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa015d7e0 0x7f3fa006e660 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009dc0 tx=0x7f3f9801c950 comp rx=0 tx=0).stop 2024-05-30T06:50:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.261+0000 7f3fa5a00640 1 -- 172.21.15.37:0/2916361377 shutdown_connections 2024-05-30T06:50:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.261+0000 7f3fa5a00640 1 --2- 172.21.15.37:0/2916361377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa015d7e0 0x7f3fa006e660 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.261+0000 7f3fa5a00640 1 -- 172.21.15.37:0/2916361377 >> 172.21.15.37:0/2916361377 conn(0x7f3fa006bf60 msgr2=0x7f3fa00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.261+0000 7f3fa5a00640 1 -- 172.21.15.37:0/2916361377 shutdown_connections 2024-05-30T06:50:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.261+0000 7f3fa5a00640 1 -- 172.21.15.37:0/2916361377 wait complete. 2024-05-30T06:50:25.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.261+0000 7f3fa5a00640 1 Processor -- start 2024-05-30T06:50:25.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.261+0000 7f3fa5a00640 1 -- start start 2024-05-30T06:50:25.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3fa5a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa00b59d0 0x7f3fa00b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3fa5a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fa015d350 0x7f3fa01526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3fa5a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fa015d7e0 0x7f3fa015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3fa5a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa0141d70 con 0x7f3fa00b59d0 2024-05-30T06:50:25.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3fa5a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa0141bf0 con 0x7f3fa015d350 2024-05-30T06:50:25.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3fa5a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa016ae40 con 0x7f3fa015d7e0 2024-05-30T06:50:25.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f9ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa00b59d0 0x7f3fa00b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f9ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa00b59d0 0x7f3fa00b1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56874/0 (socket says 172.21.15.37:56874) 2024-05-30T06:50:25.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f9ea00640 1 -- 172.21.15.37:0/1226548038 learned_addr learned my addr 172.21.15.37:0/1226548038 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:25.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f97e00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fa015d350 0x7f3fa01526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f9ea00640 1 -- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fa015d7e0 msgr2=0x7f3fa015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f9ea00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fa015d7e0 0x7f3fa015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f9ea00640 1 -- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fa015d350 msgr2=0x7f3fa01526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f9ea00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fa015d350 0x7f3fa01526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f9ea00640 1 -- 172.21.15.37:0/1226548038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa013ed60 con 0x7f3fa00b59d0 2024-05-30T06:50:25.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f97e00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fa015d350 0x7f3fa01526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:25.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f9ea00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa00b59d0 0x7f3fa00b1a90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000c430 tx=0x7f3f9000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:25.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f96a00640 1 -- 172.21.15.37:0/1226548038 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90017070 con 0x7f3fa00b59d0 2024-05-30T06:50:25.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f96a00640 1 -- 172.21.15.37:0/1226548038 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f900052f0 con 0x7f3fa00b59d0 2024-05-30T06:50:25.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f96a00640 1 -- 172.21.15.37:0/1226548038 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90003840 con 0x7f3fa00b59d0 2024-05-30T06:50:25.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3fa5a00640 1 -- 172.21.15.37:0/1226548038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa013f040 con 0x7f3fa00b59d0 2024-05-30T06:50:25.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3fa5a00640 1 -- 172.21.15.37:0/1226548038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa015a820 con 0x7f3fa00b59d0 2024-05-30T06:50:25.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3fa5a00640 1 -- 172.21.15.37:0/1226548038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa015aa20 con 0x7f3fa00b59d0 2024-05-30T06:50:25.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.265+0000 7f3f96a00640 1 -- 172.21.15.37:0/1226548038 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f3f9001a070 con 0x7f3fa00b59d0 2024-05-30T06:50:25.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.269+0000 7f3f96a00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f7c069100 0x7f3f7c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.269+0000 7f3f96a00640 1 -- 172.21.15.37:0/1226548038 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7f3f90084a40 con 0x7f3fa00b59d0 2024-05-30T06:50:25.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.269+0000 7f3f97e00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f7c069100 0x7f3f7c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.269+0000 7f3f97e00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f7c069100 0x7f3f7c06b5c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3fa015f590 tx=0x7f3f88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:25.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.273+0000 7f3f96a00640 1 -- 172.21.15.37:0/1226548038 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3fa015aa20 con 0x7f3fa00b59d0 2024-05-30T06:50:25.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.433+0000 7f3fa5a00640 1 -- 172.21.15.37:0/1226548038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_no_wait"} v 0) -- 0x7f3fa006f0a0 con 0x7f3fa00b59d0 2024-05-30T06:50:25.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.437+0000 7f3f96a00640 1 -- 172.21.15.37:0/1226548038 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_no_wait"}]=0 v16) ==== 117+0+0 (secure 0 0 0) 0x7f3f900567a0 con 0x7f3fa00b59d0 2024-05-30T06:50:25.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.441+0000 7f3fa5a00640 1 -- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f7c069100 msgr2=0x7f3f7c06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.441+0000 7f3fa5a00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f7c069100 0x7f3f7c06b5c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3fa015f590 tx=0x7f3f88009040 comp rx=0 tx=0).stop 2024-05-30T06:50:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.441+0000 7f3fa5a00640 1 -- 172.21.15.37:0/1226548038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa00b59d0 msgr2=0x7f3fa00b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.441+0000 7f3fa5a00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa00b59d0 0x7f3fa00b1a90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000c430 tx=0x7f3f9000c8f0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.441+0000 7f3fa5a00640 1 -- 172.21.15.37:0/1226548038 shutdown_connections 2024-05-30T06:50:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.441+0000 7f3fa5a00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3fa015d7e0 0x7f3fa015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.441+0000 7f3fa5a00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f7c069100 0x7f3f7c06b5c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.441+0000 7f3fa5a00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3fa015d350 0x7f3fa01526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.441+0000 7f3fa5a00640 1 --2- 172.21.15.37:0/1226548038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fa00b59d0 0x7f3fa00b1a90 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.441+0000 7f3fa5a00640 1 -- 172.21.15.37:0/1226548038 >> 172.21.15.37:0/1226548038 conn(0x7f3fa006bf60 msgr2=0x7f3fa015dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:25.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.441+0000 7f3fa5a00640 1 -- 172.21.15.37:0/1226548038 shutdown_connections 2024-05-30T06:50:25.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.441+0000 7f3fa5a00640 1 -- 172.21.15.37:0/1226548038 wait complete. 2024-05-30T06:50:25.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T06:50:25.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.601+0000 7fb067200640 1 Processor -- start 2024-05-30T06:50:25.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.601+0000 7fb067200640 1 -- start start 2024-05-30T06:50:25.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.601+0000 7fb067200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb060144c00 0x7fb06006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.601+0000 7fb067200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0600cf430 con 0x7fb060144fe0 2024-05-30T06:50:25.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.601+0000 7fb067200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0600cf6f0 con 0x7fb06015f9c0 2024-05-30T06:50:25.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.601+0000 7fb067200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb0600b3bf0 con 0x7fb060144c00 2024-05-30T06:50:25.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.601+0000 7fb065400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb060144fe0 0x7fb06015f2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48254/0 (socket says 172.21.15.37:48254) 2024-05-30T06:50:25.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.601+0000 7fb065400640 1 -- 172.21.15.37:0/1809561433 learned_addr learned my addr 172.21.15.37:0/1809561433 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:25.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb065e00640 1 --2- 172.21.15.37:0/1809561433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb060144c00 0x7fb06006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 854065943 0 0) 0x7fb0600cf430 con 0x7fb060144fe0 2024-05-30T06:50:25.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb048003530 con 0x7fb060144fe0 2024-05-30T06:50:25.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 996856073 0 0) 0x7fb048003530 con 0x7fb060144fe0 2024-05-30T06:50:25.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb060144c00 msgr2=0x7fb06006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 --2- 172.21.15.37:0/1809561433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb060144c00 0x7fb06006ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 >> v1:172.21.15.105:6789/0 conn(0x7fb06015f9c0 legacy=0x7fb060071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0600cf9d0 con 0x7fb060144fe0 2024-05-30T06:50:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fb050001680 con 0x7fb060144fe0 2024-05-30T06:50:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 >> v1:172.21.15.37:6789/0 conn(0x7fb060144fe0 legacy=0x7fb06015f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 --2- 172.21.15.37:0/1809561433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb060144c00 0x7fb0480039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 --2- 172.21.15.37:0/1809561433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb048003f30 0x7fb048004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 --2- 172.21.15.37:0/1809561433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb048004d50 0x7fb0480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb04800ba00 con 0x7fb048003f30 2024-05-30T06:50:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb04800bbb0 con 0x7fb048004d50 2024-05-30T06:50:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb04800dfc0 con 0x7fb060144c00 2024-05-30T06:50:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb065400640 1 --2- 172.21.15.37:0/1809561433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb048003f30 0x7fb048004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb065e00640 1 --2- 172.21.15.37:0/1809561433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb060144c00 0x7fb0480039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb066800640 1 --2- 172.21.15.37:0/1809561433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb048004d50 0x7fb0480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb065400640 1 -- 172.21.15.37:0/1809561433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb060144c00 msgr2=0x7fb0480039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb065400640 1 --2- 172.21.15.37:0/1809561433 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb060144c00 0x7fb0480039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb065400640 1 -- 172.21.15.37:0/1809561433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb048004d50 msgr2=0x7fb0480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb065400640 1 --2- 172.21.15.37:0/1809561433 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb048004d50 0x7fb0480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.605+0000 7fb065400640 1 -- 172.21.15.37:0/1809561433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb048003530 con 0x7fb048003f30 2024-05-30T06:50:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.609+0000 7fb065400640 1 --2- 172.21.15.37:0/1809561433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb048003f30 0x7fb048004810 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb05000c240 tx=0x7fb05001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb9a4d82305e52e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.609+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb050007d40 con 0x7fb048003f30 2024-05-30T06:50:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.609+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0500a9070 con 0x7fb048003f30 2024-05-30T06:50:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.609+0000 7fb064a00640 1 -- 172.21.15.37:0/1809561433 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb050005d80 con 0x7fb048003f30 2024-05-30T06:50:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.609+0000 7fb067200640 1 -- 172.21.15.37:0/1809561433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb048003f30 msgr2=0x7fb048004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.609+0000 7fb067200640 1 --2- 172.21.15.37:0/1809561433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb048003f30 0x7fb048004810 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb05000c240 tx=0x7fb05001cbc0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.609+0000 7fb066800640 1 -- 172.21.15.37:0/1809561433 reap_dead start 2024-05-30T06:50:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.609+0000 7fb067200640 1 -- 172.21.15.37:0/1809561433 shutdown_connections 2024-05-30T06:50:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.609+0000 7fb067200640 1 -- 172.21.15.37:0/1809561433 >> 172.21.15.37:0/1809561433 conn(0x7fb060067d60 msgr2=0x7fb06006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.609+0000 7fb067200640 1 -- 172.21.15.37:0/1809561433 shutdown_connections 2024-05-30T06:50:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.609+0000 7fb067200640 1 -- 172.21.15.37:0/1809561433 wait complete. 2024-05-30T06:50:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.609+0000 7fb067200640 1 Processor -- start 2024-05-30T06:50:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.609+0000 7fb067200640 1 -- start start 2024-05-30T06:50:25.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb067200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb048003f30 0x7fb06015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb067200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0600c9960 0x7fb0600c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb067200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600b0b30 0x7fb0600b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb067200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb06006e9e0 con 0x7fb0600b0b30 2024-05-30T06:50:25.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb067200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb06006e860 con 0x7fb0600c9960 2024-05-30T06:50:25.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb067200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb06006eb60 con 0x7fb048003f30 2024-05-30T06:50:25.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb065e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb048003f30 0x7fb06015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb066800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600b0b30 0x7fb0600b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb065e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb048003f30 0x7fb06015ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34716/0 (socket says 172.21.15.37:34716) 2024-05-30T06:50:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb066800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600b0b30 0x7fb0600b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56894/0 (socket says 172.21.15.37:56894) 2024-05-30T06:50:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb065e00640 1 -- 172.21.15.37:0/2892349240 learned_addr learned my addr 172.21.15.37:0/2892349240 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb065400640 1 --2- 172.21.15.37:0/2892349240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0600c9960 0x7fb0600c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb066800640 1 -- 172.21.15.37:0/2892349240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb048003f30 msgr2=0x7fb06015ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb066800640 1 --2- 172.21.15.37:0/2892349240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb048003f30 0x7fb06015ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb066800640 1 -- 172.21.15.37:0/2892349240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0600c9960 msgr2=0x7fb0600c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb066800640 1 --2- 172.21.15.37:0/2892349240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0600c9960 0x7fb0600c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb066800640 1 -- 172.21.15.37:0/2892349240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0600c57c0 con 0x7fb0600b0b30 2024-05-30T06:50:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb066800640 1 --2- 172.21.15.37:0/2892349240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600b0b30 0x7fb0600b0fb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb060070310 tx=0x7fb05c00eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb05a000640 1 -- 172.21.15.37:0/2892349240 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c003980 con 0x7fb0600b0b30 2024-05-30T06:50:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb05a000640 1 -- 172.21.15.37:0/2892349240 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05c018070 con 0x7fb0600b0b30 2024-05-30T06:50:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb05a000640 1 -- 172.21.15.37:0/2892349240 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c003d60 con 0x7fb0600b0b30 2024-05-30T06:50:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb067200640 1 -- 172.21.15.37:0/2892349240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0600c5aa0 con 0x7fb0600b0b30 2024-05-30T06:50:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb067200640 1 -- 172.21.15.37:0/2892349240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0600c6060 con 0x7fb0600b0b30 2024-05-30T06:50:25.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb067200640 1 -- 172.21.15.37:0/2892349240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0600b14f0 con 0x7fb0600b0b30 2024-05-30T06:50:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.613+0000 7fb05a000640 1 -- 172.21.15.37:0/2892349240 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fb05c0050d0 con 0x7fb0600b0b30 2024-05-30T06:50:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.617+0000 7fb05a000640 1 --2- 172.21.15.37:0/2892349240 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb044069130 0x7fb04406b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.617+0000 7fb05a000640 1 -- 172.21.15.37:0/2892349240 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7fb05c0853d0 con 0x7fb0600b0b30 2024-05-30T06:50:25.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.617+0000 7fb065e00640 1 --2- 172.21.15.37:0/2892349240 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb044069130 0x7fb04406b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.617+0000 7fb065e00640 1 --2- 172.21.15.37:0/2892349240 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb044069130 0x7fb04406b5f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb054009be0 tx=0x7fb054008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:25.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.621+0000 7fb05a000640 1 -- 172.21.15.37:0/2892349240 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb05c08d020 con 0x7fb0600b0b30 2024-05-30T06:50:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.785+0000 7fb067200640 1 -- 172.21.15.37:0/2892349240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fb060068700 con 0x7fb0600b0b30 2024-05-30T06:50:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.789+0000 7fb05a000640 1 -- 172.21.15.37:0/2892349240 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7fb05c056ae0 con 0x7fb0600b0b30 2024-05-30T06:50:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.789+0000 7fb067200640 1 -- 172.21.15.37:0/2892349240 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb044069130 msgr2=0x7fb04406b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.789+0000 7fb067200640 1 --2- 172.21.15.37:0/2892349240 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb044069130 0x7fb04406b5f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb054009be0 tx=0x7fb054008040 comp rx=0 tx=0).stop 2024-05-30T06:50:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.789+0000 7fb067200640 1 -- 172.21.15.37:0/2892349240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600b0b30 msgr2=0x7fb0600b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.789+0000 7fb067200640 1 --2- 172.21.15.37:0/2892349240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600b0b30 0x7fb0600b0fb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb060070310 tx=0x7fb05c00eb70 comp rx=0 tx=0).stop 2024-05-30T06:50:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.789+0000 7fb067200640 1 -- 172.21.15.37:0/2892349240 shutdown_connections 2024-05-30T06:50:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.789+0000 7fb067200640 1 --2- 172.21.15.37:0/2892349240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600b0b30 0x7fb0600b0fb0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.789+0000 7fb067200640 1 --2- 172.21.15.37:0/2892349240 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb044069130 0x7fb04406b5f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.789+0000 7fb067200640 1 --2- 172.21.15.37:0/2892349240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0600c9960 0x7fb0600c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.789+0000 7fb067200640 1 --2- 172.21.15.37:0/2892349240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb048003f30 0x7fb06015ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.789+0000 7fb067200640 1 -- 172.21.15.37:0/2892349240 >> 172.21.15.37:0/2892349240 conn(0x7fb060067d60 msgr2=0x7fb0600b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.789+0000 7fb067200640 1 -- 172.21.15.37:0/2892349240 shutdown_connections 2024-05-30T06:50:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.789+0000 7fb067200640 1 -- 172.21.15.37:0/2892349240 wait complete. 2024-05-30T06:50:25.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones' 2024-05-30T06:50:25.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.949+0000 7f37abc00640 1 Processor -- start 2024-05-30T06:50:25.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.949+0000 7f37abc00640 1 -- start start 2024-05-30T06:50:25.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.953+0000 7f37abc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f37a40aec60 0x7f37a415f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.953+0000 7f37abc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37a40af2d0 con 0x7f37a40b5ae0 2024-05-30T06:50:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.953+0000 7f37abc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37a40af5b0 con 0x7f37a4158fd0 2024-05-30T06:50:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.953+0000 7f37abc00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f37a40af090 con 0x7f37a40aec60 2024-05-30T06:50:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.953+0000 7f379be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f37a40b5ae0 0x7f37a40b3ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48260/0 (socket says 172.21.15.37:48260) 2024-05-30T06:50:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.953+0000 7f37a9c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f37a40aec60 0x7f37a415f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.953+0000 7f379be00640 1 -- 172.21.15.37:0/3290924351 learned_addr learned my addr 172.21.15.37:0/3290924351 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.953+0000 7f37a9c00640 1 -- 172.21.15.37:0/3290924351 >> v1:172.21.15.105:6789/0 conn(0x7f37a4158fd0 legacy=0x7f37a40b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.953+0000 7f37a9c00640 1 -- 172.21.15.37:0/3290924351 >> v1:172.21.15.37:6789/0 conn(0x7f37a40b5ae0 legacy=0x7f37a40b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.953+0000 7f37a9c00640 1 -- 172.21.15.37:0/3290924351 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a40af890 con 0x7f37a40aec60 2024-05-30T06:50:25.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.953+0000 7f37a3e00640 1 -- 172.21.15.37:0/3290924351 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361714305 0 0) 0x7f37a40af2d0 con 0x7f37a40b5ae0 2024-05-30T06:50:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.957+0000 7f37a9c00640 1 --2- 172.21.15.37:0/3290924351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a40aec60 0x7f37a415f8d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f379c009dc0 tx=0x7f379c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad77a5005e0a84f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.957+0000 7f37a3e00640 1 -- 172.21.15.37:0/3290924351 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c0b2070 con 0x7f37a40aec60 2024-05-30T06:50:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.957+0000 7f37a3e00640 1 -- 172.21.15.37:0/3290924351 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f379c0a57d0 con 0x7f37a40aec60 2024-05-30T06:50:25.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.957+0000 7f37a3e00640 1 -- 172.21.15.37:0/3290924351 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379c0a5ba0 con 0x7f37a40aec60 2024-05-30T06:50:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.957+0000 7f37abc00640 1 -- 172.21.15.37:0/3290924351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a40aec60 msgr2=0x7f37a415f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.957+0000 7f37abc00640 1 --2- 172.21.15.37:0/3290924351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a40aec60 0x7f37a415f8d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f379c009dc0 tx=0x7f379c01c910 comp rx=0 tx=0).stop 2024-05-30T06:50:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.957+0000 7f37abc00640 1 -- 172.21.15.37:0/3290924351 shutdown_connections 2024-05-30T06:50:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.957+0000 7f37abc00640 1 --2- 172.21.15.37:0/3290924351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a40aec60 0x7f37a415f8d0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.957+0000 7f37abc00640 1 -- 172.21.15.37:0/3290924351 >> 172.21.15.37:0/3290924351 conn(0x7f37a40b27b0 msgr2=0x7f37a40b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.957+0000 7f37abc00640 1 -- 172.21.15.37:0/3290924351 shutdown_connections 2024-05-30T06:50:25.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.957+0000 7f37abc00640 1 -- 172.21.15.37:0/3290924351 wait complete. 2024-05-30T06:50:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.957+0000 7f37abc00640 1 Processor -- start 2024-05-30T06:50:25.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.957+0000 7f37abc00640 1 -- start start 2024-05-30T06:50:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37abc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a40aec60 0x7f37a40ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37abc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37a40b5ae0 0x7f37a414b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37abc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a4158fd0 0x7f37a4144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37abc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f37a40b4d60 con 0x7f37a40aec60 2024-05-30T06:50:25.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37abc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f37a40b4be0 con 0x7f37a4158fd0 2024-05-30T06:50:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37abc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f37a40afee0 con 0x7f37a40b5ae0 2024-05-30T06:50:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a9200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a40aec60 0x7f37a40ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a9200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a40aec60 0x7f37a40ceed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56912/0 (socket says 172.21.15.37:56912) 2024-05-30T06:50:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a9200640 1 -- 172.21.15.37:0/526513763 learned_addr learned my addr 172.21.15.37:0/526513763 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a9c00640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a4158fd0 0x7f37a4144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f379be00640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37a40b5ae0 0x7f37a414b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a9200640 1 -- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37a40b5ae0 msgr2=0x7f37a414b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a9200640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37a40b5ae0 0x7f37a414b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a9200640 1 -- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a4158fd0 msgr2=0x7f37a4144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:25.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a9200640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a4158fd0 0x7f37a4144ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:25.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a9200640 1 -- 172.21.15.37:0/526513763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a414be80 con 0x7f37a40aec60 2024-05-30T06:50:25.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a9c00640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a4158fd0 0x7f37a4144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:25.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f379be00640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37a40b5ae0 0x7f37a414b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:25.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a9200640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a40aec60 0x7f37a40ceed0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f379400b410 tx=0x7f379400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:25.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a1600640 1 -- 172.21.15.37:0/526513763 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3794015030 con 0x7f37a40aec60 2024-05-30T06:50:25.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a1600640 1 -- 172.21.15.37:0/526513763 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3794004020 con 0x7f37a40aec60 2024-05-30T06:50:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37a1600640 1 -- 172.21.15.37:0/526513763 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3794004450 con 0x7f37a40aec60 2024-05-30T06:50:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37abc00640 1 -- 172.21.15.37:0/526513763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a40cf5b0 con 0x7f37a40aec60 2024-05-30T06:50:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37abc00640 1 -- 172.21.15.37:0/526513763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a40cfb70 con 0x7f37a40aec60 2024-05-30T06:50:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.961+0000 7f37abc00640 1 -- 172.21.15.37:0/526513763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a4068b20 con 0x7f37a40aec60 2024-05-30T06:50:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.965+0000 7f37a1600640 1 -- 172.21.15.37:0/526513763 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f3794018070 con 0x7f37a40aec60 2024-05-30T06:50:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.965+0000 7f37a1600640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3780069100 0x7f378006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.965+0000 7f37a1600640 1 -- 172.21.15.37:0/526513763 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7f3794085290 con 0x7f37a40aec60 2024-05-30T06:50:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.965+0000 7f379be00640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3780069100 0x7f378006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.965+0000 7f379be00640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3780069100 0x7f378006b5c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f37a414b5a0 tx=0x7f378c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:25.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:25.969+0000 7f37a1600640 1 -- 172.21.15.37:0/526513763 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3794056ff0 con 0x7f37a40aec60 2024-05-30T06:50:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:26.193+0000 7f37abc00640 1 -- 172.21.15.37:0/526513763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]} v 0) -- 0x7f37a406f2c0 con 0x7f37a40aec60 2024-05-30T06:50:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.057+0000 7f37a1600640 1 -- 172.21.15.37:0/526513763 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_bars_for_7_clones"]}]=0 v383) ==== 162+0+0 (secure 0 0 0) 0x7f37940568f0 con 0x7f37a40aec60 2024-05-30T06:50:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.061+0000 7f37abc00640 1 -- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3780069100 msgr2=0x7f378006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.061+0000 7f37abc00640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3780069100 0x7f378006b5c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f37a414b5a0 tx=0x7f378c009040 comp rx=0 tx=0).stop 2024-05-30T06:50:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.061+0000 7f37abc00640 1 -- 172.21.15.37:0/526513763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a40aec60 msgr2=0x7f37a40ceed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.061+0000 7f37abc00640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a40aec60 0x7f37a40ceed0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f379400b410 tx=0x7f379400b8d0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.061+0000 7f37abc00640 1 -- 172.21.15.37:0/526513763 shutdown_connections 2024-05-30T06:50:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.061+0000 7f37abc00640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3780069100 0x7f378006b5c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.061+0000 7f37abc00640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37a4158fd0 0x7f37a4144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.061+0000 7f37abc00640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37a40b5ae0 0x7f37a414b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.061+0000 7f37abc00640 1 --2- 172.21.15.37:0/526513763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a40aec60 0x7f37a40ceed0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.061+0000 7f37abc00640 1 -- 172.21.15.37:0/526513763 >> 172.21.15.37:0/526513763 conn(0x7f37a40b27b0 msgr2=0x7f37a415f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.061+0000 7f37abc00640 1 -- 172.21.15.37:0/526513763 shutdown_connections 2024-05-30T06:50:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.061+0000 7f37abc00640 1 -- 172.21.15.37:0/526513763 wait complete. 2024-05-30T06:50:27.090 INFO:tasks.cephfs_test_runner:Test that 2 progress bars are printed when number of clone jobs is ... ok 2024-05-30T06:50:27.090 INFO:tasks.cephfs_test_runner:Starting test: test_progress_drops_when_new_jobs_are_added (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that progress indicated by progress bar for ongoing+pending clones 2024-05-30T06:50:27.090 INFO:tasks.cephfs_test_runner:test_progress_drops_when_new_jobs_are_added (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T06:50:27.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:50:27.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.233+0000 7fa76c800640 1 Processor -- start 2024-05-30T06:50:27.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.233+0000 7fa76c800640 1 -- start start 2024-05-30T06:50:27.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa76c800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa76406e000 0x7fa7640ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa76c800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7640cee10 0x7fa76406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa76c800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7640cd120 con 0x7fa76415cd80 2024-05-30T06:50:27.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa76c800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa7640a9530 con 0x7fa7640cee10 2024-05-30T06:50:27.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa76c800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa7640cd400 con 0x7fa76406e000 2024-05-30T06:50:27.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa76a800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7640cee10 0x7fa76406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa76a800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7640cee10 0x7fa76406f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56920/0 (socket says 172.21.15.37:56920) 2024-05-30T06:50:27.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa76a800640 1 -- 172.21.15.37:0/3493379025 learned_addr learned my addr 172.21.15.37:0/3493379025 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:27.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa769e00640 1 --2- 172.21.15.37:0/3493379025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa76406e000 0x7fa7640ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa76a800640 1 -- 172.21.15.37:0/3493379025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa76406e000 msgr2=0x7fa7640ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:27.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa76a800640 1 --2- 172.21.15.37:0/3493379025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa76406e000 0x7fa7640ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa76a800640 1 -- 172.21.15.37:0/3493379025 >> v1:172.21.15.105:6789/0 conn(0x7fa76415cd80 legacy=0x7fa7640ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa76a800640 1 -- 172.21.15.37:0/3493379025 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7640cd6e0 con 0x7fa7640cee10 2024-05-30T06:50:27.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa76a800640 1 --2- 172.21.15.37:0/3493379025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cee10 0x7fa76406f3f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa760009e50 tx=0x7fa76001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a34494c14a0d990 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:27.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.237+0000 7fa768a00640 1 -- 172.21.15.37:0/3493379025 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7600b4070 con 0x7fa7640cee10 2024-05-30T06:50:27.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa768a00640 1 -- 172.21.15.37:0/3493379025 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7600af400 con 0x7fa7640cee10 2024-05-30T06:50:27.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa768a00640 1 -- 172.21.15.37:0/3493379025 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7600af7d0 con 0x7fa7640cee10 2024-05-30T06:50:27.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 -- 172.21.15.37:0/3493379025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cee10 msgr2=0x7fa76406f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 --2- 172.21.15.37:0/3493379025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cee10 0x7fa76406f3f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa760009e50 tx=0x7fa76001f210 comp rx=0 tx=0).stop 2024-05-30T06:50:27.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 -- 172.21.15.37:0/3493379025 shutdown_connections 2024-05-30T06:50:27.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 --2- 172.21.15.37:0/3493379025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cee10 0x7fa76406f3f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 --2- 172.21.15.37:0/3493379025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa76406e000 0x7fa7640ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 -- 172.21.15.37:0/3493379025 >> 172.21.15.37:0/3493379025 conn(0x7fa7640b23a0 msgr2=0x7fa7640b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:27.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 -- 172.21.15.37:0/3493379025 shutdown_connections 2024-05-30T06:50:27.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 -- 172.21.15.37:0/3493379025 wait complete. 2024-05-30T06:50:27.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 Processor -- start 2024-05-30T06:50:27.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 -- start start 2024-05-30T06:50:27.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa76406e000 0x7fa76415ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7640cee10 0x7fa76415d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa76415cd80 0x7fa76413e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa76406f930 con 0x7fa76415cd80 2024-05-30T06:50:27.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa7640cdca0 con 0x7fa76406e000 2024-05-30T06:50:27.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76c800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa76406fab0 con 0x7fa7640cee10 2024-05-30T06:50:27.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa76415cd80 0x7fa76413e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa76415cd80 0x7fa76413e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56932/0 (socket says 172.21.15.37:56932) 2024-05-30T06:50:27.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa76a800640 1 -- 172.21.15.37:0/3628503184 learned_addr learned my addr 172.21.15.37:0/3628503184 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:27.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa769400640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7640cee10 0x7fa76415d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.241+0000 7fa769e00640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa76406e000 0x7fa76415ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa76a800640 1 -- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7640cee10 msgr2=0x7fa76415d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa76a800640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7640cee10 0x7fa76415d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa76a800640 1 -- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa76406e000 msgr2=0x7fa76415ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa76a800640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa76406e000 0x7fa76415ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa76a800640 1 -- 172.21.15.37:0/3628503184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76415b060 con 0x7fa76415cd80 2024-05-30T06:50:27.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa76a800640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa76415cd80 0x7fa76413e150 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa76001d8c0 tx=0x7fa76001bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:27.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa75e000640 1 -- 172.21.15.37:0/3628503184 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7600b4040 con 0x7fa76415cd80 2024-05-30T06:50:27.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa75e000640 1 -- 172.21.15.37:0/3628503184 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7600c0070 con 0x7fa76415cd80 2024-05-30T06:50:27.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa75e000640 1 -- 172.21.15.37:0/3628503184 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760009510 con 0x7fa76415cd80 2024-05-30T06:50:27.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa76c800640 1 -- 172.21.15.37:0/3628503184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7640b0550 con 0x7fa76415cd80 2024-05-30T06:50:27.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa76c800640 1 -- 172.21.15.37:0/3628503184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7640b0b10 con 0x7fa76415cd80 2024-05-30T06:50:27.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa76c800640 1 -- 172.21.15.37:0/3628503184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa764068b20 con 0x7fa76415cd80 2024-05-30T06:50:27.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa75e000640 1 -- 172.21.15.37:0/3628503184 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fa7600a8d10 con 0x7fa76415cd80 2024-05-30T06:50:27.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa75e000640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa748069130 0x7fa74806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.245+0000 7fa75e000640 1 -- 172.21.15.37:0/3628503184 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7fa760123450 con 0x7fa76415cd80 2024-05-30T06:50:27.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.249+0000 7fa769e00640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa748069130 0x7fa74806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.249+0000 7fa769e00640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa748069130 0x7fa74806b5f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa758009ac0 tx=0x7fa758009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:27.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.249+0000 7fa75e000640 1 -- 172.21.15.37:0/3628503184 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa760018d70 con 0x7fa76415cd80 2024-05-30T06:50:27.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa76c800640 1 -- 172.21.15.37:0/3628503184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa76406ea40 con 0x7fa76415cd80 2024-05-30T06:50:27.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa75e000640 1 -- 172.21.15.37:0/3628503184 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+13053 (secure 0 0 0) 0x7fa7600f4bc0 con 0x7fa76415cd80 2024-05-30T06:50:27.418 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:27.418 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":64,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:50:25.051207+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/2127976173":"2024-05-31T06:50:22.043685+0000","172.21.15.105:6834/2127976173":"2024-05-31T06:50:22.043685+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:50:27.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa76c800640 1 -- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa748069130 msgr2=0x7fa74806b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa76c800640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa748069130 0x7fa74806b5f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa758009ac0 tx=0x7fa758009190 comp rx=0 tx=0).stop 2024-05-30T06:50:27.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa76c800640 1 -- 172.21.15.37:0/3628503184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa76415cd80 msgr2=0x7fa76413e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa76c800640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa76415cd80 0x7fa76413e150 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa76001d8c0 tx=0x7fa76001bfb0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa76c800640 1 -- 172.21.15.37:0/3628503184 shutdown_connections 2024-05-30T06:50:27.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa76c800640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa76415cd80 0x7fa76413e150 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa76c800640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7640cee10 0x7fa76415d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa76c800640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa748069130 0x7fa74806b5f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa76c800640 1 --2- 172.21.15.37:0/3628503184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa76406e000 0x7fa76415ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa76c800640 1 -- 172.21.15.37:0/3628503184 >> 172.21.15.37:0/3628503184 conn(0x7fa7640b23a0 msgr2=0x7fa764141420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:27.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa76c800640 1 -- 172.21.15.37:0/3628503184 shutdown_connections 2024-05-30T06:50:27.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.417+0000 7fa76c800640 1 -- 172.21.15.37:0/3628503184 wait complete. 2024-05-30T06:50:27.440 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:50:27.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:50:27.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.581+0000 7f59b0800640 1 Processor -- start 2024-05-30T06:50:27.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.581+0000 7f59b0800640 1 -- start start 2024-05-30T06:50:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59b0800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a80cd440 0x7f59a806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59b0800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f59a806f5a0 0x7f59a80b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59b0800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a815f310 con 0x7f59a8155da0 2024-05-30T06:50:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59b0800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f59a815f5f0 con 0x7f59a806f5a0 2024-05-30T06:50:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59b0800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f59a815f8d0 con 0x7f59a80cd440 2024-05-30T06:50:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59ade00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f59a8155da0 0x7f59a80cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57486/0 (socket says 172.21.15.37:57486) 2024-05-30T06:50:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59ade00640 1 -- 172.21.15.37:0/4107097012 learned_addr learned my addr 172.21.15.37:0/4107097012 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59ad400640 1 --2- 172.21.15.37:0/4107097012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a80cd440 0x7f59a806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59ae800640 1 --2- 172.21.15.37:0/4107097012 >> v2:172.21.15.105:3300/0 conn(0x7f59a806f5a0 0x7f59a80b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59aca00640 1 -- 172.21.15.37:0/4107097012 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195568016 0 0) 0x7f59a815f310 con 0x7f59a8155da0 2024-05-30T06:50:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59aca00640 1 -- 172.21.15.37:0/4107097012 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5990003530 con 0x7f59a8155da0 2024-05-30T06:50:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59ad400640 1 -- 172.21.15.37:0/4107097012 >> v2:172.21.15.105:3300/0 conn(0x7f59a806f5a0 msgr2=0x7f59a80b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59ad400640 1 --2- 172.21.15.37:0/4107097012 >> v2:172.21.15.105:3300/0 conn(0x7f59a806f5a0 0x7f59a80b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59ad400640 1 -- 172.21.15.37:0/4107097012 >> v1:172.21.15.37:6789/0 conn(0x7f59a8155da0 legacy=0x7f59a80cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.585+0000 7f59ad400640 1 -- 172.21.15.37:0/4107097012 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a815fbb0 con 0x7f59a80cd440 2024-05-30T06:50:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.589+0000 7f59ad400640 1 --2- 172.21.15.37:0/4107097012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a80cd440 0x7f59a806f060 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f59980097c0 tx=0x7f599801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71759e907c2583e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.589+0000 7f59aca00640 1 -- 172.21.15.37:0/4107097012 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59980b0070 con 0x7f59a80cd440 2024-05-30T06:50:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.589+0000 7f59aca00640 1 -- 172.21.15.37:0/4107097012 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59980ab600 con 0x7f59a80cd440 2024-05-30T06:50:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.589+0000 7f59aca00640 1 -- 172.21.15.37:0/4107097012 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59980ab9d0 con 0x7f59a80cd440 2024-05-30T06:50:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.589+0000 7f59b0800640 1 -- 172.21.15.37:0/4107097012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a80cd440 msgr2=0x7f59a806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.589+0000 7f59b0800640 1 --2- 172.21.15.37:0/4107097012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a80cd440 0x7f59a806f060 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f59980097c0 tx=0x7f599801c380 comp rx=0 tx=0).stop 2024-05-30T06:50:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.589+0000 7f59b0800640 1 -- 172.21.15.37:0/4107097012 shutdown_connections 2024-05-30T06:50:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.589+0000 7f59b0800640 1 --2- 172.21.15.37:0/4107097012 >> v2:172.21.15.105:3300/0 conn(0x7f59a806f5a0 0x7f59a80b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.589+0000 7f59b0800640 1 --2- 172.21.15.37:0/4107097012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a80cd440 0x7f59a806f060 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.589+0000 7f59b0800640 1 -- 172.21.15.37:0/4107097012 >> 172.21.15.37:0/4107097012 conn(0x7f59a806bf60 msgr2=0x7f59a80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.589+0000 7f59b0800640 1 -- 172.21.15.37:0/4107097012 shutdown_connections 2024-05-30T06:50:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.589+0000 7f59b0800640 1 -- 172.21.15.37:0/4107097012 wait complete. 2024-05-30T06:50:27.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59b0800640 1 Processor -- start 2024-05-30T06:50:27.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59b0800640 1 -- start start 2024-05-30T06:50:27.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59b0800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59a806f5a0 0x7f59a8152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59b0800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a8155da0 0x7f59a815e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59b0800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a81548b0 0x7f59a8152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59b0800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59a806f9b0 con 0x7f59a81548b0 2024-05-30T06:50:27.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59b0800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f59a80b46b0 con 0x7f59a806f5a0 2024-05-30T06:50:27.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59b0800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f59a8166570 con 0x7f59a8155da0 2024-05-30T06:50:27.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59ae800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a81548b0 0x7f59a8152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59ae800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a81548b0 0x7f59a8152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54520/0 (socket says 172.21.15.37:54520) 2024-05-30T06:50:27.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59ae800640 1 -- 172.21.15.37:0/2810724944 learned_addr learned my addr 172.21.15.37:0/2810724944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:27.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59ade00640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59a806f5a0 0x7f59a8152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59ad400640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a8155da0 0x7f59a815e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59ae800640 1 -- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a8155da0 msgr2=0x7f59a815e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59ae800640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a8155da0 0x7f59a815e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59ae800640 1 -- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59a806f5a0 msgr2=0x7f59a8152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59ae800640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59a806f5a0 0x7f59a8152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59ae800640 1 -- 172.21.15.37:0/2810724944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a8166af0 con 0x7f59a81548b0 2024-05-30T06:50:27.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59ade00640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59a806f5a0 0x7f59a8152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:27.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59ae800640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a81548b0 0x7f59a8152b80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f59a400efc0 tx=0x7f59a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:27.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59a2000640 1 -- 172.21.15.37:0/2810724944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a4018020 con 0x7f59a81548b0 2024-05-30T06:50:27.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59a2000640 1 -- 172.21.15.37:0/2810724944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a4014480 con 0x7f59a81548b0 2024-05-30T06:50:27.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59b0800640 1 -- 172.21.15.37:0/2810724944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a8168430 con 0x7f59a81548b0 2024-05-30T06:50:27.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59a2000640 1 -- 172.21.15.37:0/2810724944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a4014870 con 0x7f59a81548b0 2024-05-30T06:50:27.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59b0800640 1 -- 172.21.15.37:0/2810724944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a8152540 con 0x7f59a81548b0 2024-05-30T06:50:27.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.593+0000 7f59b0800640 1 -- 172.21.15.37:0/2810724944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a8166cc0 con 0x7f59a81548b0 2024-05-30T06:50:27.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.597+0000 7f59a2000640 1 -- 172.21.15.37:0/2810724944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f59a401b020 con 0x7f59a81548b0 2024-05-30T06:50:27.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.597+0000 7f59a2000640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f598c069100 0x7f598c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.597+0000 7f59a2000640 1 -- 172.21.15.37:0/2810724944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7f59a40864b0 con 0x7f59a81548b0 2024-05-30T06:50:27.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.597+0000 7f59ade00640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f598c069100 0x7f598c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.597+0000 7f59ade00640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f598c069100 0x7f598c06b5c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f599c005890 tx=0x7f599c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:27.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.601+0000 7f59a2000640 1 -- 172.21.15.37:0/2810724944 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f59a4022030 con 0x7f59a81548b0 2024-05-30T06:50:27.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.765+0000 7f59b0800640 1 -- 172.21.15.37:0/2810724944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f59a80b6790 con 0x7f59a81548b0 2024-05-30T06:50:27.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.765+0000 7f59a2000640 1 -- 172.21.15.37:0/2810724944 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) ==== 93+0+10 (secure 0 0 0) 0x7f59a4010040 con 0x7f59a81548b0 2024-05-30T06:50:27.768 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:50:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.769+0000 7f59b0800640 1 -- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f598c069100 msgr2=0x7f598c06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.769+0000 7f59b0800640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f598c069100 0x7f598c06b5c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f599c005890 tx=0x7f599c009040 comp rx=0 tx=0).stop 2024-05-30T06:50:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.769+0000 7f59b0800640 1 -- 172.21.15.37:0/2810724944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a81548b0 msgr2=0x7f59a8152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.769+0000 7f59b0800640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a81548b0 0x7f59a8152b80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f59a400efc0 tx=0x7f59a400c490 comp rx=0 tx=0).stop 2024-05-30T06:50:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.769+0000 7f59b0800640 1 -- 172.21.15.37:0/2810724944 shutdown_connections 2024-05-30T06:50:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.769+0000 7f59b0800640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59a81548b0 0x7f59a8152b80 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.769+0000 7f59b0800640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59a8155da0 0x7f59a815e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.769+0000 7f59b0800640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f598c069100 0x7f598c06b5c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.769+0000 7f59b0800640 1 --2- 172.21.15.37:0/2810724944 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59a806f5a0 0x7f59a8152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.769+0000 7f59b0800640 1 -- 172.21.15.37:0/2810724944 >> 172.21.15.37:0/2810724944 conn(0x7f59a806bf60 msgr2=0x7f59a8074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.769+0000 7f59b0800640 1 -- 172.21.15.37:0/2810724944 shutdown_connections 2024-05-30T06:50:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.769+0000 7f59b0800640 1 -- 172.21.15.37:0/2810724944 wait complete. 2024-05-30T06:50:27.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added' 2024-05-30T06:50:27.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.929+0000 7ff407e00640 1 Processor -- start 2024-05-30T06:50:27.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.929+0000 7ff407e00640 1 -- start start 2024-05-30T06:50:27.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.929+0000 7ff407e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff400155e60 0x7ff4000b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.929+0000 7ff407e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b2ec0 0x7ff4000cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.929+0000 7ff407e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff40015c8f0 con 0x7ff40006f9a0 2024-05-30T06:50:27.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.929+0000 7ff407e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff4000ccff0 con 0x7ff400155e60 2024-05-30T06:50:27.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.929+0000 7ff407e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff4000ccc80 con 0x7ff4000b2ec0 2024-05-30T06:50:27.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.929+0000 7ff404a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff40006f9a0 0x7ff4000cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57500/0 (socket says 172.21.15.37:57500) 2024-05-30T06:50:27.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.929+0000 7ff404a00640 1 -- 172.21.15.37:0/62803745 learned_addr learned my addr 172.21.15.37:0/62803745 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:27.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff405e00640 1 --2- 172.21.15.37:0/62803745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b2ec0 0x7ff4000cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178531772 0 0) 0x7ff40015c8f0 con 0x7ff40006f9a0 2024-05-30T06:50:27.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff405400640 1 --2- 172.21.15.37:0/62803745 >> v2:172.21.15.105:3300/0 conn(0x7ff400155e60 0x7ff4000b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3e8003530 con 0x7ff40006f9a0 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3572717446 0 0) 0x7ff3e8003530 con 0x7ff40006f9a0 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b2ec0 msgr2=0x7ff4000cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 --2- 172.21.15.37:0/62803745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b2ec0 0x7ff4000cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 >> v2:172.21.15.105:3300/0 conn(0x7ff400155e60 msgr2=0x7ff4000b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 --2- 172.21.15.37:0/62803745 >> v2:172.21.15.105:3300/0 conn(0x7ff400155e60 0x7ff4000b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40015cbd0 con 0x7ff40006f9a0 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7ff3ec001680 con 0x7ff40006f9a0 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 >> v1:172.21.15.37:6789/0 conn(0x7ff40006f9a0 legacy=0x7ff4000cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 --2- 172.21.15.37:0/62803745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80039c0 0x7ff3e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 --2- 172.21.15.37:0/62803745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3e8004810 0x7ff3e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 --2- 172.21.15.37:0/62803745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b2ec0 0x7ff3e80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4000ccff0 con 0x7ff3e8004810 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff4000ccc80 con 0x7ff3e80039c0 2024-05-30T06:50:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e800b9d0 con 0x7ff4000b2ec0 2024-05-30T06:50:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff404a00640 1 --2- 172.21.15.37:0/62803745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3e8004810 0x7ff3e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff405400640 1 --2- 172.21.15.37:0/62803745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80039c0 0x7ff3e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff405e00640 1 --2- 172.21.15.37:0/62803745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b2ec0 0x7ff3e80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff404a00640 1 -- 172.21.15.37:0/62803745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b2ec0 msgr2=0x7ff3e80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff404a00640 1 --2- 172.21.15.37:0/62803745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b2ec0 0x7ff3e80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff404a00640 1 -- 172.21.15.37:0/62803745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80039c0 msgr2=0x7ff3e8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff404a00640 1 --2- 172.21.15.37:0/62803745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80039c0 0x7ff3e8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff404a00640 1 -- 172.21.15.37:0/62803745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e8003530 con 0x7ff3e8004810 2024-05-30T06:50:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.933+0000 7ff405e00640 1 --2- 172.21.15.37:0/62803745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b2ec0 0x7ff3e80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff404a00640 1 --2- 172.21.15.37:0/62803745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3e8004810 0x7ff3e8004c90 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00c2c0 tx=0x7ff3ec01f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1f52d6b4726402 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec007d60 con 0x7ff3e8004810 2024-05-30T06:50:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ec005b00 con 0x7ff3e8004810 2024-05-30T06:50:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff3ffe00640 1 -- 172.21.15.37:0/62803745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec007070 con 0x7ff3e8004810 2024-05-30T06:50:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 -- 172.21.15.37:0/62803745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3e8004810 msgr2=0x7ff3e8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 --2- 172.21.15.37:0/62803745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3e8004810 0x7ff3e8004c90 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00c2c0 tx=0x7ff3ec01f4b0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff405e00640 1 -- 172.21.15.37:0/62803745 reap_dead start 2024-05-30T06:50:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 -- 172.21.15.37:0/62803745 shutdown_connections 2024-05-30T06:50:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 -- 172.21.15.37:0/62803745 >> 172.21.15.37:0/62803745 conn(0x7ff4000b23a0 msgr2=0x7ff4000b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 -- 172.21.15.37:0/62803745 shutdown_connections 2024-05-30T06:50:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 -- 172.21.15.37:0/62803745 wait complete. 2024-05-30T06:50:27.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 Processor -- start 2024-05-30T06:50:27.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 -- start start 2024-05-30T06:50:27.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e8004810 0x7ff400146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4000b0a70 0x7ff40015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b0ef0 0x7ff40015d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4000cfef0 con 0x7ff4000b0a70 2024-05-30T06:50:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff4000cfd70 con 0x7ff3e8004810 2024-05-30T06:50:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff407e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff4000d0070 con 0x7ff4000b0ef0 2024-05-30T06:50:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.937+0000 7ff404a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4000b0a70 0x7ff40015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff404a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4000b0a70 0x7ff40015d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54534/0 (socket says 172.21.15.37:54534) 2024-05-30T06:50:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff404a00640 1 -- 172.21.15.37:0/424671541 learned_addr learned my addr 172.21.15.37:0/424671541 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff405400640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e8004810 0x7ff400146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff405e00640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b0ef0 0x7ff40015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff404a00640 1 -- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b0ef0 msgr2=0x7ff40015d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff404a00640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b0ef0 0x7ff40015d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff404a00640 1 -- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e8004810 msgr2=0x7ff400146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff404a00640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e8004810 0x7ff400146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff404a00640 1 -- 172.21.15.37:0/424671541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4000b14c0 con 0x7ff4000b0a70 2024-05-30T06:50:27.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff404a00640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4000b0a70 0x7ff40015d3e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00c2c0 tx=0x7ff3e8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:27.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff3fd600640 1 -- 172.21.15.37:0/424671541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec001c90 con 0x7ff4000b0a70 2024-05-30T06:50:27.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff3fd600640 1 -- 172.21.15.37:0/424671541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ec005cb0 con 0x7ff4000b0a70 2024-05-30T06:50:27.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff3fd600640 1 -- 172.21.15.37:0/424671541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec005e60 con 0x7ff4000b0a70 2024-05-30T06:50:27.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff407e00640 1 -- 172.21.15.37:0/424671541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4001584a0 con 0x7ff4000b0a70 2024-05-30T06:50:27.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff407e00640 1 -- 172.21.15.37:0/424671541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff400158a60 con 0x7ff4000b0a70 2024-05-30T06:50:27.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff407e00640 1 -- 172.21.15.37:0/424671541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff400068b20 con 0x7ff4000b0a70 2024-05-30T06:50:27.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff3fd600640 1 -- 172.21.15.37:0/424671541 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7ff3ec007040 con 0x7ff4000b0a70 2024-05-30T06:50:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff3fd600640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3e0069130 0x7ff3e006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.941+0000 7ff3fd600640 1 -- 172.21.15.37:0/424671541 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7ff3ec121d60 con 0x7ff4000b0a70 2024-05-30T06:50:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.945+0000 7ff405400640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3e0069130 0x7ff3e006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.945+0000 7ff405400640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3e0069130 0x7ff3e006b5f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009be0 tx=0x7ff3f4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:27.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:27.949+0000 7ff3fd600640 1 -- 172.21.15.37:0/424671541 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff3ec0c3070 con 0x7ff4000b0a70 2024-05-30T06:50:28.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:28.173+0000 7ff407e00640 1 -- 172.21.15.37:0/424671541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]} v 0) -- 0x7ff4000b2b30 con 0x7ff4000b0a70 2024-05-30T06:50:29.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.069+0000 7ff3fd600640 1 -- 172.21.15.37:0/424671541 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]}]=0 v385) ==== 177+0+0 (secure 0 0 0) 0x7ff3ec0191c0 con 0x7ff4000b0a70 2024-05-30T06:50:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.069+0000 7ff407e00640 1 -- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3e0069130 msgr2=0x7ff3e006b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.069+0000 7ff407e00640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3e0069130 0x7ff3e006b5f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009be0 tx=0x7ff3f4009190 comp rx=0 tx=0).stop 2024-05-30T06:50:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.069+0000 7ff407e00640 1 -- 172.21.15.37:0/424671541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4000b0a70 msgr2=0x7ff40015d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.069+0000 7ff407e00640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4000b0a70 0x7ff40015d3e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00c2c0 tx=0x7ff3e8005840 comp rx=0 tx=0).stop 2024-05-30T06:50:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.069+0000 7ff407e00640 1 -- 172.21.15.37:0/424671541 shutdown_connections 2024-05-30T06:50:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.069+0000 7ff407e00640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4000b0ef0 0x7ff40015d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.069+0000 7ff407e00640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4000b0a70 0x7ff40015d3e0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.069+0000 7ff407e00640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3e0069130 0x7ff3e006b5f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.069+0000 7ff407e00640 1 --2- 172.21.15.37:0/424671541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e8004810 0x7ff400146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.069+0000 7ff407e00640 1 -- 172.21.15.37:0/424671541 >> 172.21.15.37:0/424671541 conn(0x7ff4000b23a0 msgr2=0x7ff4000af7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.069+0000 7ff407e00640 1 -- 172.21.15.37:0/424671541 shutdown_connections 2024-05-30T06:50:29.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.069+0000 7ff407e00640 1 -- 172.21.15.37:0/424671541 wait complete. 2024-05-30T06:50:29.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:50:29.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c30400640 1 Processor -- start 2024-05-30T06:50:29.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c30400640 1 -- start start 2024-05-30T06:50:29.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c30400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3c28162ba0 0x7f3c280afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:29.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c30400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c280b5f70 con 0x7f3c280cfeb0 2024-05-30T06:50:29.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c30400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c280b3b50 con 0x7f3c280b36c0 2024-05-30T06:50:29.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c30400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3c280b67a0 con 0x7f3c28162ba0 2024-05-30T06:50:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c2da00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3c280cfeb0 0x7f3c28162490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57506/0 (socket says 172.21.15.37:57506) 2024-05-30T06:50:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c2da00640 1 -- 172.21.15.37:0/2430715470 learned_addr learned my addr 172.21.15.37:0/2430715470 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c2d000640 1 --2- 172.21.15.37:0/2430715470 >> v2:172.21.15.105:3300/0 conn(0x7f3c28162ba0 0x7f3c280afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c27e00640 1 -- 172.21.15.37:0/2430715470 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7659427 0 0) 0x7f3c280b5f70 con 0x7f3c280cfeb0 2024-05-30T06:50:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c27e00640 1 -- 172.21.15.37:0/2430715470 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c10003530 con 0x7f3c280cfeb0 2024-05-30T06:50:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c27e00640 1 -- 172.21.15.37:0/2430715470 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013246052 0 0) 0x7f3c280b3b50 con 0x7f3c280b36c0 2024-05-30T06:50:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c27e00640 1 -- 172.21.15.37:0/2430715470 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c280b5f70 con 0x7f3c280b36c0 2024-05-30T06:50:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c2d000640 1 -- 172.21.15.37:0/2430715470 >> v1:172.21.15.105:6789/0 conn(0x7f3c280b36c0 legacy=0x7f3c28147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c2d000640 1 -- 172.21.15.37:0/2430715470 >> v1:172.21.15.37:6789/0 conn(0x7f3c280cfeb0 legacy=0x7f3c28162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.245+0000 7f3c2d000640 1 -- 172.21.15.37:0/2430715470 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c280b61e0 con 0x7f3c28162ba0 2024-05-30T06:50:29.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.249+0000 7f3c2d000640 1 --2- 172.21.15.37:0/2430715470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c28162ba0 0x7f3c280afcf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3c140097c0 tx=0x7f3c1401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c998e76f84ac472 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.249+0000 7f3c27e00640 1 -- 172.21.15.37:0/2430715470 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140b0070 con 0x7f3c28162ba0 2024-05-30T06:50:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.249+0000 7f3c27e00640 1 -- 172.21.15.37:0/2430715470 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c140ab600 con 0x7f3c28162ba0 2024-05-30T06:50:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.249+0000 7f3c27e00640 1 -- 172.21.15.37:0/2430715470 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140ab9b0 con 0x7f3c28162ba0 2024-05-30T06:50:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.249+0000 7f3c30400640 1 -- 172.21.15.37:0/2430715470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c28162ba0 msgr2=0x7f3c280afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.249+0000 7f3c30400640 1 --2- 172.21.15.37:0/2430715470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c28162ba0 0x7f3c280afcf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3c140097c0 tx=0x7f3c1401c410 comp rx=0 tx=0).stop 2024-05-30T06:50:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.249+0000 7f3c30400640 1 -- 172.21.15.37:0/2430715470 shutdown_connections 2024-05-30T06:50:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.249+0000 7f3c30400640 1 --2- 172.21.15.37:0/2430715470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c28162ba0 0x7f3c280afcf0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.249+0000 7f3c30400640 1 -- 172.21.15.37:0/2430715470 >> 172.21.15.37:0/2430715470 conn(0x7f3c2806bf60 msgr2=0x7f3c280b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.249+0000 7f3c30400640 1 -- 172.21.15.37:0/2430715470 shutdown_connections 2024-05-30T06:50:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.249+0000 7f3c30400640 1 -- 172.21.15.37:0/2430715470 wait complete. 2024-05-30T06:50:29.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c30400640 1 Processor -- start 2024-05-30T06:50:29.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c30400640 1 -- start start 2024-05-30T06:50:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c30400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c280b36c0 0x7f3c281594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:29.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c30400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c280cfeb0 0x7f3c2813ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c30400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c28162ba0 0x7f3c2813cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c30400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2816c9c0 con 0x7f3c280cfeb0 2024-05-30T06:50:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c30400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2816c840 con 0x7f3c280b36c0 2024-05-30T06:50:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c30400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3c2816cb40 con 0x7f3c28162ba0 2024-05-30T06:50:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c2d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c280cfeb0 0x7f3c2813ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c2d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c280cfeb0 0x7f3c2813ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54548/0 (socket says 172.21.15.37:54548) 2024-05-30T06:50:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c2d000640 1 -- 172.21.15.37:0/634210158 learned_addr learned my addr 172.21.15.37:0/634210158 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c2da00640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c280b36c0 0x7f3c281594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c2e400640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c28162ba0 0x7f3c2813cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c2d000640 1 -- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c28162ba0 msgr2=0x7f3c2813cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c2d000640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c28162ba0 0x7f3c2813cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c2d000640 1 -- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c280b36c0 msgr2=0x7f3c281594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c2d000640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c280b36c0 0x7f3c281594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c2d000640 1 -- 172.21.15.37:0/634210158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c28159c20 con 0x7f3c280cfeb0 2024-05-30T06:50:29.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c2d000640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c280cfeb0 0x7f3c2813ca40 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3c1401a040 tx=0x7f3c140191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:29.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c25600640 1 -- 172.21.15.37:0/634210158 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140b0040 con 0x7f3c280cfeb0 2024-05-30T06:50:29.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c25600640 1 -- 172.21.15.37:0/634210158 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c140ab400 con 0x7f3c280cfeb0 2024-05-30T06:50:29.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c25600640 1 -- 172.21.15.37:0/634210158 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14006e20 con 0x7f3c280cfeb0 2024-05-30T06:50:29.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c30400640 1 -- 172.21.15.37:0/634210158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c28159f00 con 0x7f3c280cfeb0 2024-05-30T06:50:29.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.253+0000 7f3c30400640 1 -- 172.21.15.37:0/634210158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c2815a4c0 con 0x7f3c280cfeb0 2024-05-30T06:50:29.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.257+0000 7f3c30400640 1 -- 172.21.15.37:0/634210158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c28068bc0 con 0x7f3c280cfeb0 2024-05-30T06:50:29.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.257+0000 7f3c25600640 1 -- 172.21.15.37:0/634210158 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f3c140bc030 con 0x7f3c280cfeb0 2024-05-30T06:50:29.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.257+0000 7f3c25600640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3c08069130 0x7f3c0806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:29.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.257+0000 7f3c25600640 1 -- 172.21.15.37:0/634210158 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7f3c1411e8a0 con 0x7f3c280cfeb0 2024-05-30T06:50:29.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.257+0000 7f3c2da00640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3c08069130 0x7f3c0806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:29.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.257+0000 7f3c2da00640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3c08069130 0x7f3c0806b5f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c000f70 tx=0x7f3c1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:29.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.261+0000 7f3c25600640 1 -- 172.21.15.37:0/634210158 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3c140c3060 con 0x7f3c280cfeb0 2024-05-30T06:50:29.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.425+0000 7f3c30400640 1 -- 172.21.15.37:0/634210158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3c280adb80 con 0x7f3c280cfeb0 2024-05-30T06:50:29.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.429+0000 7f3c25600640 1 -- 172.21.15.37:0/634210158 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f3c14016090 con 0x7f3c280cfeb0 2024-05-30T06:50:29.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.433+0000 7f3c30400640 1 -- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3c08069130 msgr2=0x7f3c0806b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.433+0000 7f3c30400640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3c08069130 0x7f3c0806b5f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c000f70 tx=0x7f3c1c009040 comp rx=0 tx=0).stop 2024-05-30T06:50:29.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.433+0000 7f3c30400640 1 -- 172.21.15.37:0/634210158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c280cfeb0 msgr2=0x7f3c2813ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.433+0000 7f3c30400640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c280cfeb0 0x7f3c2813ca40 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3c1401a040 tx=0x7f3c140191b0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.433+0000 7f3c30400640 1 -- 172.21.15.37:0/634210158 shutdown_connections 2024-05-30T06:50:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.433+0000 7f3c30400640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c28162ba0 0x7f3c2813cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.433+0000 7f3c30400640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c280cfeb0 0x7f3c2813ca40 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.433+0000 7f3c30400640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3c08069130 0x7f3c0806b5f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.433+0000 7f3c30400640 1 --2- 172.21.15.37:0/634210158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c280b36c0 0x7f3c281594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.433+0000 7f3c30400640 1 -- 172.21.15.37:0/634210158 >> 172.21.15.37:0/634210158 conn(0x7f3c2806bf60 msgr2=0x7f3c2806ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.433+0000 7f3c30400640 1 -- 172.21.15.37:0/634210158 shutdown_connections 2024-05-30T06:50:29.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.433+0000 7f3c30400640 1 -- 172.21.15.37:0/634210158 wait complete. 2024-05-30T06:50:29.453 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:50:29.453 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:50:29.559 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:50:29.621 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:50:29.621 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:50:29.621 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:50:29.630 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:50:29.630 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:50:29.630 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:50:29.639 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:50:29.639 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:50:29.639 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:50:29.680 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:50:29.680 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:50:29.680 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:50:29.690 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:50:29.690 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T06:50:29.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:50:29.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.865+0000 7fd1d4a00640 1 Processor -- start 2024-05-30T06:50:29.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.865+0000 7fd1d4a00640 1 -- start start 2024-05-30T06:50:29.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1d4a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd1d00b2ec0 0x7fd1d00b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:29.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1d4a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d015c8f0 con 0x7fd1d0155e60 2024-05-30T06:50:29.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1d4a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d00ccc80 con 0x7fd1d006f9a0 2024-05-30T06:50:29.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1d4a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd1d00ccff0 con 0x7fd1d00b2ec0 2024-05-30T06:50:29.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cde00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd1d0155e60 0x7fd1d00cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57522/0 (socket says 172.21.15.37:57522) 2024-05-30T06:50:29.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cde00640 1 -- 172.21.15.37:0/475212133 learned_addr learned my addr 172.21.15.37:0/475212133 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:29.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 324760658 0 0) 0x7fd1d015c8f0 con 0x7fd1d0155e60 2024-05-30T06:50:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1b4003530 con 0x7fd1d0155e60 2024-05-30T06:50:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1ce800640 1 --2- 172.21.15.37:0/475212133 >> v2:172.21.15.105:3300/0 conn(0x7fd1d00b2ec0 0x7fd1d00b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4099856927 0 0) 0x7fd1b4003530 con 0x7fd1d0155e60 2024-05-30T06:50:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 >> v2:172.21.15.105:3300/0 conn(0x7fd1d00b2ec0 msgr2=0x7fd1d00b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 --2- 172.21.15.37:0/475212133 >> v2:172.21.15.105:3300/0 conn(0x7fd1d00b2ec0 0x7fd1d00b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 >> v1:172.21.15.105:6789/0 conn(0x7fd1d006f9a0 legacy=0x7fd1d00cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d015cbd0 con 0x7fd1d0155e60 2024-05-30T06:50:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fd1c0001a00 con 0x7fd1d0155e60 2024-05-30T06:50:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 >> v1:172.21.15.37:6789/0 conn(0x7fd1d0155e60 legacy=0x7fd1d00cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 --2- 172.21.15.37:0/475212133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1b40039c0 0x7fd1b4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 --2- 172.21.15.37:0/475212133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b4004810 0x7fd1b4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 --2- 172.21.15.37:0/475212133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b40051d0 0x7fd1b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d00ccff0 con 0x7fd1b4004810 2024-05-30T06:50:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b400c070 con 0x7fd1b40051d0 2024-05-30T06:50:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b400c270 con 0x7fd1b40039c0 2024-05-30T06:50:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1c5400640 1 --2- 172.21.15.37:0/475212133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b4004810 0x7fd1b4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1ce800640 1 --2- 172.21.15.37:0/475212133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b40051d0 0x7fd1b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1cde00640 1 --2- 172.21.15.37:0/475212133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1b40039c0 0x7fd1b4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1c5400640 1 -- 172.21.15.37:0/475212133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1b40039c0 msgr2=0x7fd1b4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1c5400640 1 --2- 172.21.15.37:0/475212133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1b40039c0 0x7fd1b4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1c5400640 1 -- 172.21.15.37:0/475212133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b40051d0 msgr2=0x7fd1b400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1c5400640 1 --2- 172.21.15.37:0/475212133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b40051d0 0x7fd1b400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1ce800640 1 -- 172.21.15.37:0/475212133 reap_dead start 2024-05-30T06:50:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.869+0000 7fd1c5400640 1 -- 172.21.15.37:0/475212133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b4003530 con 0x7fd1b4004810 2024-05-30T06:50:29.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.873+0000 7fd1c5400640 1 --2- 172.21.15.37:0/475212133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b4004810 0x7fd1b4004c90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8001780 tx=0x7fd1b801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4ec8f6e99e34c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:29.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.873+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80013a0 con 0x7fd1b4004810 2024-05-30T06:50:29.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.873+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b80052f0 con 0x7fd1b4004810 2024-05-30T06:50:29.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.873+0000 7fd1cd400640 1 -- 172.21.15.37:0/475212133 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8003840 con 0x7fd1b4004810 2024-05-30T06:50:29.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.873+0000 7fd1d4a00640 1 -- 172.21.15.37:0/475212133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b4004810 msgr2=0x7fd1b4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.873+0000 7fd1d4a00640 1 --2- 172.21.15.37:0/475212133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b4004810 0x7fd1b4004c90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8001780 tx=0x7fd1b801c400 comp rx=0 tx=0).stop 2024-05-30T06:50:29.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.873+0000 7fd1d4a00640 1 -- 172.21.15.37:0/475212133 shutdown_connections 2024-05-30T06:50:29.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.873+0000 7fd1d4a00640 1 --2- 172.21.15.37:0/475212133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b4004810 0x7fd1b4004c90 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.873+0000 7fd1d4a00640 1 -- 172.21.15.37:0/475212133 >> 172.21.15.37:0/475212133 conn(0x7fd1d00b23a0 msgr2=0x7fd1d00b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:29.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.873+0000 7fd1d4a00640 1 -- 172.21.15.37:0/475212133 shutdown_connections 2024-05-30T06:50:29.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.873+0000 7fd1d4a00640 1 -- 172.21.15.37:0/475212133 wait complete. 2024-05-30T06:50:29.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1d4a00640 1 Processor -- start 2024-05-30T06:50:29.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1d4a00640 1 -- start start 2024-05-30T06:50:29.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1d4a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b4004810 0x7fd1d0145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:29.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1d4a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1d00b1f90 0x7fd1d015df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:29.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1d4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015e4c0 0x7fd1d0156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:29.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1d4a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d00b3820 con 0x7fd1d015e4c0 2024-05-30T06:50:29.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1d4a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d00b36a0 con 0x7fd1b4004810 2024-05-30T06:50:29.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1d4a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d00b39a0 con 0x7fd1d00b1f90 2024-05-30T06:50:29.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1ce800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015e4c0 0x7fd1d0156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:29.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1c5400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1d00b1f90 0x7fd1d015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:29.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1ce800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015e4c0 0x7fd1d0156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54564/0 (socket says 172.21.15.37:54564) 2024-05-30T06:50:29.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1ce800640 1 -- 172.21.15.37:0/2051881901 learned_addr learned my addr 172.21.15.37:0/2051881901 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:29.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1cde00640 1 --2- 172.21.15.37:0/2051881901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b4004810 0x7fd1d0145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:29.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1ce800640 1 -- 172.21.15.37:0/2051881901 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1d00b1f90 msgr2=0x7fd1d015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1ce800640 1 --2- 172.21.15.37:0/2051881901 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1d00b1f90 0x7fd1d015df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1ce800640 1 -- 172.21.15.37:0/2051881901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b4004810 msgr2=0x7fd1d0145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:29.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1ce800640 1 --2- 172.21.15.37:0/2051881901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b4004810 0x7fd1d0145d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:29.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1ce800640 1 -- 172.21.15.37:0/2051881901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d00b0f10 con 0x7fd1d015e4c0 2024-05-30T06:50:29.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1ce800640 1 --2- 172.21.15.37:0/2051881901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015e4c0 0x7fd1d0156d50 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00ccf60 tx=0x7fd1c8011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:29.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1c6a00640 1 -- 172.21.15.37:0/2051881901 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8019020 con 0x7fd1d015e4c0 2024-05-30T06:50:29.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1c6a00640 1 -- 172.21.15.37:0/2051881901 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c8004030 con 0x7fd1d015e4c0 2024-05-30T06:50:29.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1c6a00640 1 -- 172.21.15.37:0/2051881901 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8004400 con 0x7fd1d015e4c0 2024-05-30T06:50:29.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1d4a00640 1 -- 172.21.15.37:0/2051881901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d00b11d0 con 0x7fd1d015e4c0 2024-05-30T06:50:29.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1d4a00640 1 -- 172.21.15.37:0/2051881901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d00b1790 con 0x7fd1d015e4c0 2024-05-30T06:50:29.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.877+0000 7fd1d4a00640 1 -- 172.21.15.37:0/2051881901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d0068b20 con 0x7fd1d015e4c0 2024-05-30T06:50:29.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.881+0000 7fd1c6a00640 1 -- 172.21.15.37:0/2051881901 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fd1c801c020 con 0x7fd1d015e4c0 2024-05-30T06:50:29.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.881+0000 7fd1c6a00640 1 --2- 172.21.15.37:0/2051881901 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1ac069100 0x7fd1ac06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:29.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.881+0000 7fd1c6a00640 1 -- 172.21.15.37:0/2051881901 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7fd1c8085b40 con 0x7fd1d015e4c0 2024-05-30T06:50:29.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.881+0000 7fd1cde00640 1 --2- 172.21.15.37:0/2051881901 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1ac069100 0x7fd1ac06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:29.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.881+0000 7fd1cde00640 1 --2- 172.21.15.37:0/2051881901 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1ac069100 0x7fd1ac06b5c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0001570 tx=0x7fd1c0001500 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:29.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:29.885+0000 7fd1c6a00640 1 -- 172.21.15.37:0/2051881901 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd1c8023020 con 0x7fd1d015e4c0 2024-05-30T06:50:30.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.081+0000 7fd1d4a00640 1 -- 172.21.15.37:0/2051881901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1d0072fb0 con 0x7fd1d015e4c0 2024-05-30T06:50:30.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.085+0000 7fd1c6a00640 1 -- 172.21.15.37:0/2051881901 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+3866 (secure 0 0 0) 0x7fd1c8057250 con 0x7fd1d015e4c0 2024-05-30T06:50:30.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:30.085 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2689846178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2689846178},{"type":"v1","addr":"172.21.15.37:6834","nonce":2689846178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5624,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1799611833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1799611833},{"type":"v1","addr":"172.21.15.37:6835","nonce":1799611833}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5630,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/35182660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6836","nonce":35182660},{"type":"v1","addr":"172.21.15.105:6837","nonce":35182660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/683766728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":683766728},{"type":"v1","addr":"172.21.15.105:6835","nonce":683766728}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[]} 2024-05-30T06:50:30.085 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 40 2024-05-30T06:50:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.085+0000 7fd1d4a00640 1 -- 172.21.15.37:0/2051881901 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1ac069100 msgr2=0x7fd1ac06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.085+0000 7fd1d4a00640 1 --2- 172.21.15.37:0/2051881901 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1ac069100 0x7fd1ac06b5c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0001570 tx=0x7fd1c0001500 comp rx=0 tx=0).stop 2024-05-30T06:50:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.085+0000 7fd1d4a00640 1 -- 172.21.15.37:0/2051881901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015e4c0 msgr2=0x7fd1d0156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.085+0000 7fd1d4a00640 1 --2- 172.21.15.37:0/2051881901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015e4c0 0x7fd1d0156d50 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00ccf60 tx=0x7fd1c8011cf0 comp rx=0 tx=0).stop 2024-05-30T06:50:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.085+0000 7fd1d4a00640 1 -- 172.21.15.37:0/2051881901 shutdown_connections 2024-05-30T06:50:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.085+0000 7fd1d4a00640 1 --2- 172.21.15.37:0/2051881901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1d015e4c0 0x7fd1d0156d50 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.085+0000 7fd1d4a00640 1 --2- 172.21.15.37:0/2051881901 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1d00b1f90 0x7fd1d015df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.085+0000 7fd1d4a00640 1 --2- 172.21.15.37:0/2051881901 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1ac069100 0x7fd1ac06b5c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.085+0000 7fd1d4a00640 1 --2- 172.21.15.37:0/2051881901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b4004810 0x7fd1d0145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.085+0000 7fd1d4a00640 1 -- 172.21.15.37:0/2051881901 >> 172.21.15.37:0/2051881901 conn(0x7fd1d00b23a0 msgr2=0x7fd1d00cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.085+0000 7fd1d4a00640 1 -- 172.21.15.37:0/2051881901 shutdown_connections 2024-05-30T06:50:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.085+0000 7fd1d4a00640 1 -- 172.21.15.37:0/2051881901 wait complete. 2024-05-30T06:50:30.107 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T06:50:30.107 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T06:50:30.107 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T06:50:30.107 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:50:30.108 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T06:50:30.108 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T06:50:30.108 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T06:50:30.108 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:50:30.108 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T06:50:30.108 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T06:50:30.109 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T06:50:30.109 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:50:30.109 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T06:50:30.109 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T06:50:30.109 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T06:50:30.109 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:50:30.121 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T06:50:30.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T06:50:30.122 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T06:50:30.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T06:50:30.123 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T06:50:30.123 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T06:50:30.125 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T06:50:30.126 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T06:50:30.171 INFO:tasks.ceph.mds.c:Started 2024-05-30T06:50:30.171 DEBUG:teuthology.parallel:result is None 2024-05-30T06:50:30.172 INFO:tasks.ceph.mds.a:Started 2024-05-30T06:50:30.173 DEBUG:teuthology.parallel:result is None 2024-05-30T06:50:30.175 INFO:tasks.ceph.mds.b:Started 2024-05-30T06:50:30.176 DEBUG:teuthology.parallel:result is None 2024-05-30T06:50:30.178 INFO:tasks.ceph.mds.d:Started 2024-05-30T06:50:30.178 DEBUG:teuthology.parallel:result is None 2024-05-30T06:50:30.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T06:50:30.257 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-30T06:50:30.258 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-30T06:50:30.270 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-05-30T06:50:30.270 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-05-30T06:50:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.325+0000 7f6914c00640 1 Processor -- start 2024-05-30T06:50:30.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.325+0000 7f6914c00640 1 -- start start 2024-05-30T06:50:30.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.325+0000 7f6914c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6910155da0 0x7f69100cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:30.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.325+0000 7f6914c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69100cd440 0x7f691006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:30.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.325+0000 7f6914c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f691006f5a0 0x7f69100cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:30.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.325+0000 7f6914c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f691015f310 con 0x7f6910155da0 2024-05-30T06:50:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.325+0000 7f6914c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f691015f5f0 con 0x7f691006f5a0 2024-05-30T06:50:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.325+0000 7f6914c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f691015f8d0 con 0x7f69100cd440 2024-05-30T06:50:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.325+0000 7f690de00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6910155da0 0x7f69100cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.325+0000 7f690de00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6910155da0 0x7f69100cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54608/0 (socket says 172.21.15.37:54608) 2024-05-30T06:50:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.325+0000 7f690de00640 1 -- 172.21.15.37:0/1464238176 learned_addr learned my addr 172.21.15.37:0/1464238176 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.325+0000 7f690e800640 1 --2- 172.21.15.37:0/1464238176 >> v2:172.21.15.105:3300/0 conn(0x7f691006f5a0 0x7f69100cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.325+0000 7f6905400640 1 --2- 172.21.15.37:0/1464238176 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69100cd440 0x7f691006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f690de00640 1 -- 172.21.15.37:0/1464238176 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69100cd440 msgr2=0x7f691006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f690de00640 1 --2- 172.21.15.37:0/1464238176 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69100cd440 0x7f691006f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f690de00640 1 -- 172.21.15.37:0/1464238176 >> v2:172.21.15.105:3300/0 conn(0x7f691006f5a0 msgr2=0x7f69100cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f690de00640 1 --2- 172.21.15.37:0/1464238176 >> v2:172.21.15.105:3300/0 conn(0x7f691006f5a0 0x7f69100cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:30.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f690de00640 1 -- 172.21.15.37:0/1464238176 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691015fbb0 con 0x7f6910155da0 2024-05-30T06:50:30.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f690e800640 1 --2- 172.21.15.37:0/1464238176 >> v2:172.21.15.105:3300/0 conn(0x7f691006f5a0 0x7f69100cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:30.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f690de00640 1 --2- 172.21.15.37:0/1464238176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6910155da0 0x7f69100cd950 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f69100cd0c0 tx=0x7f690001e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f574857b975ebd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f690d400640 1 -- 172.21.15.37:0/1464238176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69000b3070 con 0x7f6910155da0 2024-05-30T06:50:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f690d400640 1 -- 172.21.15.37:0/1464238176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69000aa050 con 0x7f6910155da0 2024-05-30T06:50:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f690d400640 1 -- 172.21.15.37:0/1464238176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69000ae860 con 0x7f6910155da0 2024-05-30T06:50:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f6914c00640 1 -- 172.21.15.37:0/1464238176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6910155da0 msgr2=0x7f69100cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f6914c00640 1 --2- 172.21.15.37:0/1464238176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6910155da0 0x7f69100cd950 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f69100cd0c0 tx=0x7f690001e610 comp rx=0 tx=0).stop 2024-05-30T06:50:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f6914c00640 1 -- 172.21.15.37:0/1464238176 shutdown_connections 2024-05-30T06:50:30.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f6914c00640 1 --2- 172.21.15.37:0/1464238176 >> v2:172.21.15.105:3300/0 conn(0x7f691006f5a0 0x7f69100cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f6914c00640 1 --2- 172.21.15.37:0/1464238176 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69100cd440 0x7f691006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f6914c00640 1 --2- 172.21.15.37:0/1464238176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6910155da0 0x7f69100cd950 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f6914c00640 1 -- 172.21.15.37:0/1464238176 >> 172.21.15.37:0/1464238176 conn(0x7f691006bf60 msgr2=0x7f69100b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f6914c00640 1 -- 172.21.15.37:0/1464238176 shutdown_connections 2024-05-30T06:50:30.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.329+0000 7f6914c00640 1 -- 172.21.15.37:0/1464238176 wait complete. 2024-05-30T06:50:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6914c00640 1 Processor -- start 2024-05-30T06:50:30.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6914c00640 1 -- start start 2024-05-30T06:50:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6914c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691006f5a0 0x7f691014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:30.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6914c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6910155da0 0x7f691015b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6914c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6910154b80 0x7f6910155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6914c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f691006e2e0 con 0x7f691006f5a0 2024-05-30T06:50:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6914c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f691006e160 con 0x7f6910154b80 2024-05-30T06:50:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6914c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f691006e460 con 0x7f6910155da0 2024-05-30T06:50:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f690de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691006f5a0 0x7f691014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f690de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691006f5a0 0x7f691014ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54622/0 (socket says 172.21.15.37:54622) 2024-05-30T06:50:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f690de00640 1 -- 172.21.15.37:0/4131497801 learned_addr learned my addr 172.21.15.37:0/4131497801 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6905400640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6910155da0 0x7f691015b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f690e800640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6910154b80 0x7f6910155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f690de00640 1 -- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6910155da0 msgr2=0x7f691015b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f690de00640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6910155da0 0x7f691015b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f690de00640 1 -- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6910154b80 msgr2=0x7f6910155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:30.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f690de00640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6910154b80 0x7f6910155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f690de00640 1 -- 172.21.15.37:0/4131497801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69101590e0 con 0x7f691006f5a0 2024-05-30T06:50:30.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f690de00640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691006f5a0 0x7f691014ccf0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f690001ccc0 tx=0x7f690001ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6906a00640 1 -- 172.21.15.37:0/4131497801 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69000be070 con 0x7f691006f5a0 2024-05-30T06:50:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6906a00640 1 -- 172.21.15.37:0/4131497801 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69000b9640 con 0x7f691006f5a0 2024-05-30T06:50:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6914c00640 1 -- 172.21.15.37:0/4131497801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f691015ab60 con 0x7f691006f5a0 2024-05-30T06:50:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6906a00640 1 -- 172.21.15.37:0/4131497801 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69000b3070 con 0x7f691006f5a0 2024-05-30T06:50:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.333+0000 7f6914c00640 1 -- 172.21.15.37:0/4131497801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69101588e0 con 0x7f691006f5a0 2024-05-30T06:50:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.337+0000 7f6914c00640 1 -- 172.21.15.37:0/4131497801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6910068bc0 con 0x7f691006f5a0 2024-05-30T06:50:30.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.337+0000 7f6906a00640 1 -- 172.21.15.37:0/4131497801 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f69000c1070 con 0x7f691006f5a0 2024-05-30T06:50:30.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.337+0000 7f6906a00640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68ec069100 0x7f68ec06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:30.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.337+0000 7f6906a00640 1 -- 172.21.15.37:0/4131497801 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4971+0+0 (secure 0 0 0) 0x7f690011f270 con 0x7f691006f5a0 2024-05-30T06:50:30.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.337+0000 7f6905400640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68ec069100 0x7f68ec06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:30.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.337+0000 7f6905400640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68ec069100 0x7f68ec06b5c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f69100b28a0 tx=0x7f68f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:30.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.341+0000 7f6906a00640 1 -- 172.21.15.37:0/4131497801 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6900018320 con 0x7f691006f5a0 2024-05-30T06:50:30.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:30.521+0000 7f6914c00640 1 -- 172.21.15.37:0/4131497801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f69100b6790 con 0x7f691006f5a0 2024-05-30T06:50:31.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.521+0000 7f6906a00640 1 -- 172.21.15.37:0/4131497801 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v69) ==== 97+0+0 (secure 0 0 0) 0x7f69000f0980 con 0x7f691006f5a0 2024-05-30T06:50:31.521 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-30T06:50:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.521+0000 7f6914c00640 1 -- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68ec069100 msgr2=0x7f68ec06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.521+0000 7f6914c00640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68ec069100 0x7f68ec06b5c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f69100b28a0 tx=0x7f68f8008040 comp rx=0 tx=0).stop 2024-05-30T06:50:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.521+0000 7f6914c00640 1 -- 172.21.15.37:0/4131497801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691006f5a0 msgr2=0x7f691014ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.521+0000 7f6914c00640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691006f5a0 0x7f691014ccf0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f690001ccc0 tx=0x7f690001ce50 comp rx=0 tx=0).stop 2024-05-30T06:50:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.521+0000 7f6914c00640 1 -- 172.21.15.37:0/4131497801 shutdown_connections 2024-05-30T06:50:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.521+0000 7f6914c00640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68ec069100 0x7f68ec06b5c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.521+0000 7f6914c00640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6910154b80 0x7f6910155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.521+0000 7f6914c00640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6910155da0 0x7f691015b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.521+0000 7f6914c00640 1 --2- 172.21.15.37:0/4131497801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691006f5a0 0x7f691014ccf0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.521+0000 7f6914c00640 1 -- 172.21.15.37:0/4131497801 >> 172.21.15.37:0/4131497801 conn(0x7f691006bf60 msgr2=0x7f69100b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:31.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.521+0000 7f6914c00640 1 -- 172.21.15.37:0/4131497801 shutdown_connections 2024-05-30T06:50:31.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.521+0000 7f6914c00640 1 -- 172.21.15.37:0/4131497801 wait complete. 2024-05-30T06:50:31.549 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T06:50:31.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.693+0000 7f8f71a00640 1 Processor -- start 2024-05-30T06:50:31.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.693+0000 7f8f71a00640 1 -- start start 2024-05-30T06:50:31.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.693+0000 7f8f71a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8f6c0ce8d0 0x7f8f6c0ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:31.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.693+0000 7f8f71a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f6c0cd120 con 0x7f8f6c06e000 2024-05-30T06:50:31.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.693+0000 7f8f71a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f6c0cd400 con 0x7f8f6c15cd80 2024-05-30T06:50:31.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.693+0000 7f8f71a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8f6c0a9530 con 0x7f8f6c0ce8d0 2024-05-30T06:50:31.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.693+0000 7f8f6aa00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8f6c06e000 0x7f8f6c0ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57540/0 (socket says 172.21.15.37:57540) 2024-05-30T06:50:31.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.693+0000 7f8f6aa00640 1 -- 172.21.15.37:0/4091007576 learned_addr learned my addr 172.21.15.37:0/4091007576 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:31.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.693+0000 7f8f6b400640 1 --2- 172.21.15.37:0/4091007576 >> v2:172.21.15.105:3300/0 conn(0x7f8f6c0ce8d0 0x7f8f6c0ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:31.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.693+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1051842147 0 0) 0x7f8f6c0cd120 con 0x7f8f6c06e000 2024-05-30T06:50:31.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f50003530 con 0x7f8f6c06e000 2024-05-30T06:50:31.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 135113029 0 0) 0x7f8f50003530 con 0x7f8f6c06e000 2024-05-30T06:50:31.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 >> v2:172.21.15.105:3300/0 conn(0x7f8f6c0ce8d0 msgr2=0x7f8f6c0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:31.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 --2- 172.21.15.37:0/4091007576 >> v2:172.21.15.105:3300/0 conn(0x7f8f6c0ce8d0 0x7f8f6c0ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 >> v1:172.21.15.105:6789/0 conn(0x7f8f6c15cd80 legacy=0x7f8f6c06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:31.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f6c0cd6e0 con 0x7f8f6c06e000 2024-05-30T06:50:31.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f8f5c001680 con 0x7f8f6c06e000 2024-05-30T06:50:31.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 >> v1:172.21.15.37:6789/0 conn(0x7f8f6c06e000 legacy=0x7f8f6c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:31.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 --2- 172.21.15.37:0/4091007576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f500039c0 0x7f8f50003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:31.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 --2- 172.21.15.37:0/4091007576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f50004810 0x7f8f50004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:31.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 --2- 172.21.15.37:0/4091007576 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f500051d0 0x7f8f5000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:31.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5000c050 con 0x7f8f50004810 2024-05-30T06:50:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5000c200 con 0x7f8f500039c0 2024-05-30T06:50:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8f5000c400 con 0x7f8f500051d0 2024-05-30T06:50:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f62000640 1 --2- 172.21.15.37:0/4091007576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f50004810 0x7f8f50004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6aa00640 1 --2- 172.21.15.37:0/4091007576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f500039c0 0x7f8f50003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6b400640 1 --2- 172.21.15.37:0/4091007576 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f500051d0 0x7f8f5000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f62000640 1 -- 172.21.15.37:0/4091007576 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f500051d0 msgr2=0x7f8f5000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f62000640 1 --2- 172.21.15.37:0/4091007576 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f500051d0 0x7f8f5000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f62000640 1 -- 172.21.15.37:0/4091007576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f500039c0 msgr2=0x7f8f50003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f62000640 1 --2- 172.21.15.37:0/4091007576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f500039c0 0x7f8f50003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f62000640 1 -- 172.21.15.37:0/4091007576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f50003530 con 0x7f8f50004810 2024-05-30T06:50:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6aa00640 1 --2- 172.21.15.37:0/4091007576 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f500039c0 0x7f8f50003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:31.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.697+0000 7f8f6b400640 1 -- 172.21.15.37:0/4091007576 reap_dead start 2024-05-30T06:50:31.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f62000640 1 --2- 172.21.15.37:0/4091007576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f50004810 0x7f8f50004c90 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8f54001e70 tx=0x7f8f5401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50a8561174de785 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:31.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54001a90 con 0x7f8f50004810 2024-05-30T06:50:31.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f54003b80 con 0x7f8f50004810 2024-05-30T06:50:31.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f6a000640 1 -- 172.21.15.37:0/4091007576 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54005080 con 0x7f8f50004810 2024-05-30T06:50:31.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 -- 172.21.15.37:0/4091007576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f50004810 msgr2=0x7f8f50004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:31.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 --2- 172.21.15.37:0/4091007576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f50004810 0x7f8f50004c90 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f8f54001e70 tx=0x7f8f5401c780 comp rx=0 tx=0).stop 2024-05-30T06:50:31.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 -- 172.21.15.37:0/4091007576 shutdown_connections 2024-05-30T06:50:31.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 --2- 172.21.15.37:0/4091007576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f50004810 0x7f8f50004c90 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 -- 172.21.15.37:0/4091007576 >> 172.21.15.37:0/4091007576 conn(0x7f8f6c0b23a0 msgr2=0x7f8f6c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:31.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 -- 172.21.15.37:0/4091007576 shutdown_connections 2024-05-30T06:50:31.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 -- 172.21.15.37:0/4091007576 wait complete. 2024-05-30T06:50:31.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 Processor -- start 2024-05-30T06:50:31.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 -- start start 2024-05-30T06:50:31.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f50004810 0x7f8f6c15fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:31.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f6c15ab00 0x7f8f6c0aa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:31.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f6c0aad70 0x7f8f6c0b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c0ced20 con 0x7f8f6c15ab00 2024-05-30T06:50:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c0cdca0 con 0x7f8f6c0aad70 2024-05-30T06:50:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.701+0000 7f8f71a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8f6c0ceea0 con 0x7f8f50004810 2024-05-30T06:50:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f62000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f6c15ab00 0x7f8f6c0aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f62000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f6c15ab00 0x7f8f6c0aa830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54642/0 (socket says 172.21.15.37:54642) 2024-05-30T06:50:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f6aa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f50004810 0x7f8f6c15fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f62000640 1 -- 172.21.15.37:0/1166900948 learned_addr learned my addr 172.21.15.37:0/1166900948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f6b400640 1 --2- 172.21.15.37:0/1166900948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f6c0aad70 0x7f8f6c0b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f62000640 1 -- 172.21.15.37:0/1166900948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f50004810 msgr2=0x7f8f6c15fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f62000640 1 --2- 172.21.15.37:0/1166900948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f50004810 0x7f8f6c15fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f62000640 1 -- 172.21.15.37:0/1166900948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f6c0aad70 msgr2=0x7f8f6c0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:31.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f62000640 1 --2- 172.21.15.37:0/1166900948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f6c0aad70 0x7f8f6c0b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f62000640 1 -- 172.21.15.37:0/1166900948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f6c15af80 con 0x7f8f6c15ab00 2024-05-30T06:50:31.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f62000640 1 --2- 172.21.15.37:0/1166900948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f6c15ab00 0x7f8f6c0aa830 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8f54000f90 tx=0x7f8f50005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:31.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f63400640 1 -- 172.21.15.37:0/1166900948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54007dc0 con 0x7f8f6c15ab00 2024-05-30T06:50:31.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f63400640 1 -- 172.21.15.37:0/1166900948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f540ba070 con 0x7f8f6c15ab00 2024-05-30T06:50:31.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f63400640 1 -- 172.21.15.37:0/1166900948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54001a90 con 0x7f8f6c15ab00 2024-05-30T06:50:31.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f71a00640 1 -- 172.21.15.37:0/1166900948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f6c15ebf0 con 0x7f8f6c15ab00 2024-05-30T06:50:31.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f71a00640 1 -- 172.21.15.37:0/1166900948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f6c15f1b0 con 0x7f8f6c15ab00 2024-05-30T06:50:31.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f71a00640 1 -- 172.21.15.37:0/1166900948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f6c068b20 con 0x7f8f6c15ab00 2024-05-30T06:50:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f63400640 1 -- 172.21.15.37:0/1166900948 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f8f540a6480 con 0x7f8f6c15ab00 2024-05-30T06:50:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.705+0000 7f8f63400640 1 --2- 172.21.15.37:0/1166900948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8f48069130 0x7f8f4806b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.709+0000 7f8f63400640 1 -- 172.21.15.37:0/1166900948 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 4885+0+0 (secure 0 0 0) 0x7f8f5411f620 con 0x7f8f6c15ab00 2024-05-30T06:50:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.709+0000 7f8f6aa00640 1 --2- 172.21.15.37:0/1166900948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8f48069130 0x7f8f4806b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:31.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.709+0000 7f8f6aa00640 1 --2- 172.21.15.37:0/1166900948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8f48069130 0x7f8f4806b5f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c15c9f0 tx=0x7f8f5c007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:31.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.713+0000 7f8f63400640 1 -- 172.21.15.37:0/1166900948 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f540ac020 con 0x7f8f6c15ab00 2024-05-30T06:50:31.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.929+0000 7f8f71a00640 1 -- 172.21.15.37:0/1166900948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8f6c0b3060 con 0x7f8f6c15ab00 2024-05-30T06:50:31.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.933+0000 7f8f63400640 1 -- 172.21.15.37:0/1166900948 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f8f54016490 con 0x7f8f6c15ab00 2024-05-30T06:50:31.933 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:31.933 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:50:31.933 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-30T06:50:31.933 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.933 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-30T06:50:31.933 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmcRfnBBAAk60J/SRTolMhKoS8b8A9jQ==", 2024-05-30T06:50:31.933 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.933 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:50:31.933 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:50:31.933 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:50:31.933 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.934 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.934 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.934 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.934 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-30T06:50:31.934 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmzScrERAAbIJ5somf+sguc6jEuR04zg==", 2024-05-30T06:50:31.934 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.934 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:50:31.934 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:50:31.934 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:50:31.934 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.934 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.934 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.934 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm2jEhDBAAGKUYGtJznRYpt1LHlMOTrw==", 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm95RdGBAAaaaNAKnr4Dtmu+L1NaMVbw==", 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.935 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCFH1hmygxjHhAA1ee1eBP6dvsC0K9w+6d0OQ==", 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.936 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCIH1hmNJsBKRAAhns5CNodS7CKFU1Jg3PFCA==", 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCLH1hmlx5FNBAAn2Iann8U/uTZy0tFcFx04w==", 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.937 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCPH1hmxJnxAhAAt5cEb3YVLDhkQD5WjLQuog==", 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.938 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-30T06:50:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCUH1hmEn5cOBAAFzBuH8TO418e4obqTNeIXg==", 2024-05-30T06:50:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:50:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:50:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-30T06:50:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCYH1hmij3RCBAAHzQPoM1ClYGGEt6ly6ZrqQ==", 2024-05-30T06:50:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.939 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCbH1hmDqdpERAA46/Bs4B/xVjviQ1gNpNaaw==", 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.940 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.941 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-30T06:50:31.941 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCeH1hmnrfVHRAAlqk48vSVw45YDCXWWb/MUA==", 2024-05-30T06:50:31.941 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.941 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:50:31.941 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:50:31.941 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.941 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.941 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.941 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.941 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-30T06:50:31.941 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A==", 2024-05-30T06:50:31.941 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.941 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:50:31.942 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2024-05-30T06:50:31.942 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T06:50:31.942 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.942 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.942 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.942 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-30T06:50:31.942 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmf8sdJhAATAP7EzLJxXXnXeEQL9fdpw==", 2024-05-30T06:50:31.942 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.942 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:50:31.942 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:50:31.942 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:50:31.942 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:50:31.942 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm1qB9IhAAszAwOgm2Igb1DM4diPC7ow==", 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-30T06:50:31.943 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmY6AULBAAYNza0fpC3KO69ulNQaSldQ==", 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmbSCrJBAAhn69RBUeyuaAMWiB3o7ByQ==", 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:50:31.944 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:50:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-30T06:50:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmN/fjABAAdldbCncRiHy6RFEF9H7gnQ==", 2024-05-30T06:50:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:50:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:50:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:50:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:31.946 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-30T06:50:31.946 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmNdeSOBAA3V4vK0bNlWFoosV41f/ASQ==", 2024-05-30T06:50:31.946 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:50:31.946 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:50:31.946 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:50:31.946 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:50:31.946 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.946 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:31.946 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-30T06:50:31.946 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:50:31.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.933+0000 7f8f71a00640 1 -- 172.21.15.37:0/1166900948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8f48069130 msgr2=0x7f8f4806b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:31.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.933+0000 7f8f71a00640 1 --2- 172.21.15.37:0/1166900948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8f48069130 0x7f8f4806b5f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c15c9f0 tx=0x7f8f5c007040 comp rx=0 tx=0).stop 2024-05-30T06:50:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.933+0000 7f8f71a00640 1 -- 172.21.15.37:0/1166900948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f6c15ab00 msgr2=0x7f8f6c0aa830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.933+0000 7f8f71a00640 1 --2- 172.21.15.37:0/1166900948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f6c15ab00 0x7f8f6c0aa830 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8f54000f90 tx=0x7f8f50005840 comp rx=0 tx=0).stop 2024-05-30T06:50:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.933+0000 7f8f71a00640 1 -- 172.21.15.37:0/1166900948 shutdown_connections 2024-05-30T06:50:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.933+0000 7f8f71a00640 1 --2- 172.21.15.37:0/1166900948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8f48069130 0x7f8f4806b5f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.933+0000 7f8f71a00640 1 --2- 172.21.15.37:0/1166900948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f6c0aad70 0x7f8f6c0b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.933+0000 7f8f71a00640 1 --2- 172.21.15.37:0/1166900948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f6c15ab00 0x7f8f6c0aa830 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.933+0000 7f8f71a00640 1 --2- 172.21.15.37:0/1166900948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f50004810 0x7f8f6c15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.933+0000 7f8f71a00640 1 -- 172.21.15.37:0/1166900948 >> 172.21.15.37:0/1166900948 conn(0x7f8f6c0b23a0 msgr2=0x7f8f6c06f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.933+0000 7f8f71a00640 1 -- 172.21.15.37:0/1166900948 shutdown_connections 2024-05-30T06:50:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:31.933+0000 7f8f71a00640 1 -- 172.21.15.37:0/1166900948 wait complete. 2024-05-30T06:50:31.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:50:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb703c00640 1 Processor -- start 2024-05-30T06:50:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb703c00640 1 -- start start 2024-05-30T06:50:32.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb703c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6fc0b2e20 0x7fb6fc160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb703c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6fc1609c0 0x7fb6fc160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb703c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb6fc0cd280 0x7fb6fc0cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb703c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb6fc0b3200 con 0x7fb6fc1609c0 2024-05-30T06:50:32.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb703c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb6fc0d01e0 con 0x7fb6fc0cd280 2024-05-30T06:50:32.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb703c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb6fc0b33a0 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb6fbe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6fc1609c0 0x7fb6fc160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb6fbe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6fc1609c0 0x7fb6fc160e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54656/0 (socket says 172.21.15.37:54656) 2024-05-30T06:50:32.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb6fbe00640 1 -- 172.21.15.37:0/944679215 learned_addr learned my addr 172.21.15.37:0/944679215 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:32.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb701200640 1 --2- 172.21.15.37:0/944679215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6fc0b2e20 0x7fb6fc160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb701c00640 1 --2- 172.21.15.37:0/944679215 >> v2:172.21.15.105:3300/0 conn(0x7fb6fc0cd280 0x7fb6fc0cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb6fbe00640 1 -- 172.21.15.37:0/944679215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6fc0b2e20 msgr2=0x7fb6fc160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:32.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb6fbe00640 1 --2- 172.21.15.37:0/944679215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6fc0b2e20 0x7fb6fc160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb6fbe00640 1 -- 172.21.15.37:0/944679215 >> v2:172.21.15.105:3300/0 conn(0x7fb6fc0cd280 msgr2=0x7fb6fc0cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:32.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb6fbe00640 1 --2- 172.21.15.37:0/944679215 >> v2:172.21.15.105:3300/0 conn(0x7fb6fc0cd280 0x7fb6fc0cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb6fbe00640 1 -- 172.21.15.37:0/944679215 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc0d0430 con 0x7fb6fc1609c0 2024-05-30T06:50:32.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.097+0000 7fb701c00640 1 --2- 172.21.15.37:0/944679215 >> v2:172.21.15.105:3300/0 conn(0x7fb6fc0cd280 0x7fb6fc0cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb6fbe00640 1 --2- 172.21.15.37:0/944679215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6fc1609c0 0x7fb6fc160e20 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009870 tx=0x7fb6e801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4cfd073fbdc05d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb6fb400640 1 -- 172.21.15.37:0/944679215 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80aa610 con 0x7fb6fc1609c0 2024-05-30T06:50:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb6fb400640 1 -- 172.21.15.37:0/944679215 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e80af070 con 0x7fb6fc1609c0 2024-05-30T06:50:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb6fb400640 1 -- 172.21.15.37:0/944679215 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80aa9d0 con 0x7fb6fc1609c0 2024-05-30T06:50:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb703c00640 1 -- 172.21.15.37:0/944679215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6fc1609c0 msgr2=0x7fb6fc160e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb703c00640 1 --2- 172.21.15.37:0/944679215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6fc1609c0 0x7fb6fc160e20 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8009870 tx=0x7fb6e801c4f0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb703c00640 1 -- 172.21.15.37:0/944679215 shutdown_connections 2024-05-30T06:50:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb703c00640 1 --2- 172.21.15.37:0/944679215 >> v2:172.21.15.105:3300/0 conn(0x7fb6fc0cd280 0x7fb6fc0cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb703c00640 1 --2- 172.21.15.37:0/944679215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6fc1609c0 0x7fb6fc160e20 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb703c00640 1 --2- 172.21.15.37:0/944679215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6fc0b2e20 0x7fb6fc160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb703c00640 1 -- 172.21.15.37:0/944679215 >> 172.21.15.37:0/944679215 conn(0x7fb6fc0b4100 msgr2=0x7fb6fc0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:32.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb703c00640 1 -- 172.21.15.37:0/944679215 shutdown_connections 2024-05-30T06:50:32.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb703c00640 1 -- 172.21.15.37:0/944679215 wait complete. 2024-05-30T06:50:32.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.101+0000 7fb703c00640 1 Processor -- start 2024-05-30T06:50:32.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb703c00640 1 -- start start 2024-05-30T06:50:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb703c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6fc0b2e20 0x7fb6fc151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb703c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6fc0cd280 0x7fb6fc0ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb703c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6fc1609c0 0x7fb6fc1fb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb703c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc09aa60 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb703c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc0cee40 con 0x7fb6fc1609c0 2024-05-30T06:50:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb703c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb6fc09abe0 con 0x7fb6fc0cd280 2024-05-30T06:50:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb701200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6fc0b2e20 0x7fb6fc151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb701200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6fc0b2e20 0x7fb6fc151410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54664/0 (socket says 172.21.15.37:54664) 2024-05-30T06:50:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb701200640 1 -- 172.21.15.37:0/2287011769 learned_addr learned my addr 172.21.15.37:0/2287011769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb6fbe00640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6fc0cd280 0x7fb6fc0ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb701c00640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6fc1609c0 0x7fb6fc1fb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb701200640 1 -- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6fc0cd280 msgr2=0x7fb6fc0ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb701200640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6fc0cd280 0x7fb6fc0ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb701200640 1 -- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6fc1609c0 msgr2=0x7fb6fc1fb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb701200640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6fc1609c0 0x7fb6fc1fb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb701200640 1 -- 172.21.15.37:0/2287011769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc151d80 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb701200640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6fc0b2e20 0x7fb6fc151410 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000d800 tx=0x7fb6f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb6f8c00640 1 -- 172.21.15.37:0/2287011769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f000b6c0 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb6f8c00640 1 -- 172.21.15.37:0/2287011769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f0019070 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb6f8c00640 1 -- 172.21.15.37:0/2287011769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f000ba60 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb703c00640 1 -- 172.21.15.37:0/2287011769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6fc0c6140 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb703c00640 1 -- 172.21.15.37:0/2287011769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6fc0cac70 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.105+0000 7fb703c00640 1 -- 172.21.15.37:0/2287011769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6fc068b20 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.109+0000 7fb6f8c00640 1 -- 172.21.15.37:0/2287011769 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fb6f000bc00 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.109+0000 7fb6f8c00640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb6dc069100 0x7fb6dc06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.109+0000 7fb6f8c00640 1 -- 172.21.15.37:0/2287011769 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 4885+0+0 (secure 0 0 0) 0x7fb6f0085a60 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.109+0000 7fb6fbe00640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb6dc069100 0x7fb6dc06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.109+0000 7fb6fbe00640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb6dc069100 0x7fb6dc06b5c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80ae000 tx=0x7fb6e80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:32.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.113+0000 7fb6f8c00640 1 -- 172.21.15.37:0/2287011769 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6fc151d80 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.277+0000 7fb703c00640 1 -- 172.21.15.37:0/2287011769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6fc0ce860 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.281+0000 7fb6f8c00640 1 -- 172.21.15.37:0/2287011769 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+12922 (secure 0 0 0) 0x7fb6f0057170 con 0x7fb6fc0b2e20 2024-05-30T06:50:32.281 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:32.281 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":69,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:50:31.517920+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:50:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.281+0000 7fb703c00640 1 -- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb6dc069100 msgr2=0x7fb6dc06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.281+0000 7fb703c00640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb6dc069100 0x7fb6dc06b5c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80ae000 tx=0x7fb6e80a7000 comp rx=0 tx=0).stop 2024-05-30T06:50:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.281+0000 7fb703c00640 1 -- 172.21.15.37:0/2287011769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6fc0b2e20 msgr2=0x7fb6fc151410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.281+0000 7fb703c00640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6fc0b2e20 0x7fb6fc151410 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000d800 tx=0x7fb6f000dcc0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.281+0000 7fb703c00640 1 -- 172.21.15.37:0/2287011769 shutdown_connections 2024-05-30T06:50:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.281+0000 7fb703c00640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb6dc069100 0x7fb6dc06b5c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.281+0000 7fb703c00640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6fc1609c0 0x7fb6fc1fb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.281+0000 7fb703c00640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6fc0cd280 0x7fb6fc0ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.281+0000 7fb703c00640 1 --2- 172.21.15.37:0/2287011769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6fc0b2e20 0x7fb6fc151410 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.281+0000 7fb703c00640 1 -- 172.21.15.37:0/2287011769 >> 172.21.15.37:0/2287011769 conn(0x7fb6fc0b4100 msgr2=0x7fb6fc152250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.281+0000 7fb703c00640 1 -- 172.21.15.37:0/2287011769 shutdown_connections 2024-05-30T06:50:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.281+0000 7fb703c00640 1 -- 172.21.15.37:0/2287011769 wait complete. 2024-05-30T06:50:32.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:50:32.303 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:50:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.445+0000 7f889dc00640 1 Processor -- start 2024-05-30T06:50:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.445+0000 7f889dc00640 1 -- start start 2024-05-30T06:50:32.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.445+0000 7f889dc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88980b59d0 0x7f88980b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.445+0000 7f889dc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f889815d350 0x7f8898160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.445+0000 7f889dc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88980b62f0 con 0x7f889815d7b0 2024-05-30T06:50:32.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.445+0000 7f889dc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8898142030 con 0x7f889815d350 2024-05-30T06:50:32.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.445+0000 7f889dc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8898142310 con 0x7f88980b59d0 2024-05-30T06:50:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.445+0000 7f888e000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f889815d350 0x7f8898160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.445+0000 7f8896a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88980b59d0 0x7f88980b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.445+0000 7f888e000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f889815d350 0x7f8898160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:54178/0 (socket says 172.21.15.37:54178) 2024-05-30T06:50:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.445+0000 7f888e000640 1 -- 172.21.15.37:0/2890989995 learned_addr learned my addr 172.21.15.37:0/2890989995 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.449+0000 7f888e000640 1 -- 172.21.15.37:0/2890989995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88980b59d0 msgr2=0x7f88980b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.449+0000 7f888e000640 1 --2- 172.21.15.37:0/2890989995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88980b59d0 0x7f88980b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.449+0000 7f888e000640 1 -- 172.21.15.37:0/2890989995 >> v1:172.21.15.105:6789/0 conn(0x7f889815d7b0 legacy=0x7f88981607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.449+0000 7f888e000640 1 -- 172.21.15.37:0/2890989995 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88981425f0 con 0x7f889815d350 2024-05-30T06:50:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.449+0000 7f888e000640 1 --2- 172.21.15.37:0/2890989995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f889815d350 0x7f8898160280 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8880009e50 tx=0x7f888001f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60f52bd97c50a512 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.449+0000 7f8896000640 1 -- 172.21.15.37:0/2890989995 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88800b4070 con 0x7f889815d350 2024-05-30T06:50:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.449+0000 7f8896000640 1 -- 172.21.15.37:0/2890989995 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88800af400 con 0x7f889815d350 2024-05-30T06:50:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.449+0000 7f8896000640 1 -- 172.21.15.37:0/2890989995 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88800af7d0 con 0x7f889815d350 2024-05-30T06:50:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 -- 172.21.15.37:0/2890989995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f889815d350 msgr2=0x7f8898160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 --2- 172.21.15.37:0/2890989995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f889815d350 0x7f8898160280 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8880009e50 tx=0x7f888001f210 comp rx=0 tx=0).stop 2024-05-30T06:50:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 -- 172.21.15.37:0/2890989995 shutdown_connections 2024-05-30T06:50:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 --2- 172.21.15.37:0/2890989995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f889815d350 0x7f8898160280 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 --2- 172.21.15.37:0/2890989995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88980b59d0 0x7f88980b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 -- 172.21.15.37:0/2890989995 >> 172.21.15.37:0/2890989995 conn(0x7f889806bf60 msgr2=0x7f88980b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 -- 172.21.15.37:0/2890989995 shutdown_connections 2024-05-30T06:50:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 -- 172.21.15.37:0/2890989995 wait complete. 2024-05-30T06:50:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 Processor -- start 2024-05-30T06:50:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 -- start start 2024-05-30T06:50:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88980b59d0 0x7f8898072950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f889815d350 0x7f88981572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f889815d7b0 0x7f889813b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f889813fe60 con 0x7f889815d350 2024-05-30T06:50:32.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f889813fce0 con 0x7f88980b59d0 2024-05-30T06:50:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f889dc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f88980aff20 con 0x7f889815d7b0 2024-05-30T06:50:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f888e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f889815d350 0x7f88981572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f888e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f889815d350 0x7f88981572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54674/0 (socket says 172.21.15.37:54674) 2024-05-30T06:50:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f888e000640 1 -- 172.21.15.37:0/2267996122 learned_addr learned my addr 172.21.15.37:0/2267996122 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f8896a00640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88980b59d0 0x7f8898072950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f8897400640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f889815d7b0 0x7f889813b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f888e000640 1 -- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f889815d7b0 msgr2=0x7f889813b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f888e000640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f889815d7b0 0x7f889813b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f888e000640 1 -- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88980b59d0 msgr2=0x7f8898072950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f888e000640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88980b59d0 0x7f8898072950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f888e000640 1 -- 172.21.15.37:0/2267996122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8898157800 con 0x7f889815d350 2024-05-30T06:50:32.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.453+0000 7f8896a00640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88980b59d0 0x7f8898072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.457+0000 7f888e000640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f889815d350 0x7f88981572c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f88800b2040 tx=0x7f888001bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.457+0000 7f888f400640 1 -- 172.21.15.37:0/2267996122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88800b4040 con 0x7f889815d350 2024-05-30T06:50:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.457+0000 7f888f400640 1 -- 172.21.15.37:0/2267996122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88800afd60 con 0x7f889815d350 2024-05-30T06:50:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.457+0000 7f889dc00640 1 -- 172.21.15.37:0/2267996122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8898157aa0 con 0x7f889815d350 2024-05-30T06:50:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.457+0000 7f888f400640 1 -- 172.21.15.37:0/2267996122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8880009510 con 0x7f889815d350 2024-05-30T06:50:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.457+0000 7f889dc00640 1 -- 172.21.15.37:0/2267996122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8898158060 con 0x7f889815d350 2024-05-30T06:50:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.457+0000 7f889dc00640 1 -- 172.21.15.37:0/2267996122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8898068bc0 con 0x7f889815d350 2024-05-30T06:50:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.457+0000 7f888f400640 1 -- 172.21.15.37:0/2267996122 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f88800c3020 con 0x7f889815d350 2024-05-30T06:50:32.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.457+0000 7f888f400640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8874069100 0x7f887406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.457+0000 7f888f400640 1 -- 172.21.15.37:0/2267996122 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 4885+0+0 (secure 0 0 0) 0x7f8880123030 con 0x7f889815d350 2024-05-30T06:50:32.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.457+0000 7f8896a00640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8874069100 0x7f887406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.461+0000 7f8896a00640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8874069100 0x7f887406b5c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8888009eb0 tx=0x7f8888009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.461+0000 7f888f400640 1 -- 172.21.15.37:0/2267996122 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f88800ca020 con 0x7f889815d350 2024-05-30T06:50:32.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f889dc00640 1 -- 172.21.15.37:0/2267996122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f88980b0b10 con 0x7f889815d350 2024-05-30T06:50:32.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f888f400640 1 -- 172.21.15.37:0/2267996122 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7f8880018d70 con 0x7f889815d350 2024-05-30T06:50:32.630 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:50:32.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f889dc00640 1 -- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8874069100 msgr2=0x7f887406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f889dc00640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8874069100 0x7f887406b5c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8888009eb0 tx=0x7f8888009190 comp rx=0 tx=0).stop 2024-05-30T06:50:32.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f889dc00640 1 -- 172.21.15.37:0/2267996122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f889815d350 msgr2=0x7f88981572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f889dc00640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f889815d350 0x7f88981572c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f88800b2040 tx=0x7f888001bfb0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f889dc00640 1 -- 172.21.15.37:0/2267996122 shutdown_connections 2024-05-30T06:50:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f889dc00640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f889815d7b0 0x7f889813b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f889dc00640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f889815d350 0x7f88981572c0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f889dc00640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8874069100 0x7f887406b5c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f889dc00640 1 --2- 172.21.15.37:0/2267996122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88980b59d0 0x7f8898072950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f889dc00640 1 -- 172.21.15.37:0/2267996122 >> 172.21.15.37:0/2267996122 conn(0x7f889806bf60 msgr2=0x7f88980b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f889dc00640 1 -- 172.21.15.37:0/2267996122 shutdown_connections 2024-05-30T06:50:32.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.629+0000 7f889dc00640 1 -- 172.21.15.37:0/2267996122 wait complete. 2024-05-30T06:50:32.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T06:50:32.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b33c00640 1 Processor -- start 2024-05-30T06:50:32.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b33c00640 1 -- start start 2024-05-30T06:50:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b33c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b2c06e000 0x7f7b2c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b33c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b2c0cee10 0x7f7b2c06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b33c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b2c0cd120 con 0x7f7b2c15cd80 2024-05-30T06:50:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b33c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7b2c0a9530 con 0x7f7b2c06e000 2024-05-30T06:50:32.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b33c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c0cd400 con 0x7f7b2c0cee10 2024-05-30T06:50:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b31200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b2c06e000 0x7f7b2c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b31200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b2c06e000 0x7f7b2c0ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54678/0 (socket says 172.21.15.37:54678) 2024-05-30T06:50:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b31200640 1 -- 172.21.15.37:0/1010812168 learned_addr learned my addr 172.21.15.37:0/1010812168 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b31c00640 1 --2- 172.21.15.37:0/1010812168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b2c0cee10 0x7f7b2c06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b31200640 1 -- 172.21.15.37:0/1010812168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b2c0cee10 msgr2=0x7f7b2c06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b31200640 1 --2- 172.21.15.37:0/1010812168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b2c0cee10 0x7f7b2c06f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b31200640 1 -- 172.21.15.37:0/1010812168 >> v1:172.21.15.105:6789/0 conn(0x7f7b2c15cd80 legacy=0x7f7b2c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b31200640 1 -- 172.21.15.37:0/1010812168 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c0cd6e0 con 0x7f7b2c06e000 2024-05-30T06:50:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.793+0000 7f7b31c00640 1 --2- 172.21.15.37:0/1010812168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b2c0cee10 0x7f7b2c06f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.797+0000 7f7b31200640 1 --2- 172.21.15.37:0/1010812168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b2c06e000 0x7f7b2c0ce1c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009870 tx=0x7f7b1c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec1da66f6cd2e28 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.797+0000 7f7b2be00640 1 -- 172.21.15.37:0/1010812168 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0b5070 con 0x7f7b2c06e000 2024-05-30T06:50:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.797+0000 7f7b2be00640 1 -- 172.21.15.37:0/1010812168 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c0a8a50 con 0x7f7b2c06e000 2024-05-30T06:50:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.797+0000 7f7b2be00640 1 -- 172.21.15.37:0/1010812168 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0a8e20 con 0x7f7b2c06e000 2024-05-30T06:50:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.797+0000 7f7b33c00640 1 -- 172.21.15.37:0/1010812168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b2c06e000 msgr2=0x7f7b2c0ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.797+0000 7f7b33c00640 1 --2- 172.21.15.37:0/1010812168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b2c06e000 0x7f7b2c0ce1c0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009870 tx=0x7f7b1c01ed50 comp rx=0 tx=0).stop 2024-05-30T06:50:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.797+0000 7f7b33c00640 1 -- 172.21.15.37:0/1010812168 shutdown_connections 2024-05-30T06:50:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.797+0000 7f7b33c00640 1 --2- 172.21.15.37:0/1010812168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b2c0cee10 0x7f7b2c06f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.797+0000 7f7b33c00640 1 --2- 172.21.15.37:0/1010812168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b2c06e000 0x7f7b2c0ce1c0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.797+0000 7f7b33c00640 1 -- 172.21.15.37:0/1010812168 >> 172.21.15.37:0/1010812168 conn(0x7f7b2c0b23a0 msgr2=0x7f7b2c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.797+0000 7f7b33c00640 1 -- 172.21.15.37:0/1010812168 shutdown_connections 2024-05-30T06:50:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.797+0000 7f7b33c00640 1 -- 172.21.15.37:0/1010812168 wait complete. 2024-05-30T06:50:32.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b33c00640 1 Processor -- start 2024-05-30T06:50:32.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b33c00640 1 -- start start 2024-05-30T06:50:32.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b33c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b2c06e000 0x7f7b2c15f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b33c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b2c0cee10 0x7f7b2c12cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b33c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c15cd80 0x7f7b2c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b33c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c06f930 con 0x7f7b2c06e000 2024-05-30T06:50:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b33c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c0cdca0 con 0x7f7b2c15cd80 2024-05-30T06:50:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b33c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7b2c06fab0 con 0x7f7b2c0cee10 2024-05-30T06:50:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b31200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b2c06e000 0x7f7b2c15f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b31200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b2c06e000 0x7f7b2c15f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54680/0 (socket says 172.21.15.37:54680) 2024-05-30T06:50:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b31200640 1 -- 172.21.15.37:0/3769259524 learned_addr learned my addr 172.21.15.37:0/3769259524 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b23e00640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b2c0cee10 0x7f7b2c12cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b31c00640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c15cd80 0x7f7b2c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b31200640 1 -- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b2c0cee10 msgr2=0x7f7b2c12cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b31200640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b2c0cee10 0x7f7b2c12cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b31200640 1 -- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c15cd80 msgr2=0x7f7b2c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b31200640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c15cd80 0x7f7b2c154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b31200640 1 -- 172.21.15.37:0/3769259524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c13b3e0 con 0x7f7b2c06e000 2024-05-30T06:50:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b31200640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b2c06e000 0x7f7b2c15f7b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0b3040 tx=0x7f7b1c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b29600640 1 -- 172.21.15.37:0/3769259524 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0c0070 con 0x7f7b2c06e000 2024-05-30T06:50:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b29600640 1 -- 172.21.15.37:0/3769259524 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c0ae790 con 0x7f7b2c06e000 2024-05-30T06:50:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b33c00640 1 -- 172.21.15.37:0/3769259524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2c13b6c0 con 0x7f7b2c06e000 2024-05-30T06:50:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b29600640 1 -- 172.21.15.37:0/3769259524 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0b5070 con 0x7f7b2c06e000 2024-05-30T06:50:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.801+0000 7f7b33c00640 1 -- 172.21.15.37:0/3769259524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b2c13bc80 con 0x7f7b2c06e000 2024-05-30T06:50:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.805+0000 7f7b33c00640 1 -- 172.21.15.37:0/3769259524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2c068b20 con 0x7f7b2c06e000 2024-05-30T06:50:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.805+0000 7f7b29600640 1 -- 172.21.15.37:0/3769259524 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f7b1c0c3070 con 0x7f7b2c06e000 2024-05-30T06:50:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.805+0000 7f7b29600640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b08069100 0x7f7b0806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.805+0000 7f7b29600640 1 -- 172.21.15.37:0/3769259524 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 4885+0+0 (secure 0 0 0) 0x7f7b1c123270 con 0x7f7b2c06e000 2024-05-30T06:50:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.805+0000 7f7b23e00640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b08069100 0x7f7b0806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:32.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.805+0000 7f7b23e00640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b08069100 0x7f7b0806b5c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0b36a0 tx=0x7f7b14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:32.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.809+0000 7f7b29600640 1 -- 172.21.15.37:0/3769259524 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b1c0188b0 con 0x7f7b2c06e000 2024-05-30T06:50:32.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.977+0000 7f7b33c00640 1 -- 172.21.15.37:0/3769259524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7b2c157400 con 0x7f7b2c06e000 2024-05-30T06:50:32.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.977+0000 7f7b29600640 1 -- 172.21.15.37:0/3769259524 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7f7b1c0f4fd0 con 0x7f7b2c06e000 2024-05-30T06:50:32.978 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:32.979 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:50:32.979 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:32.979 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-30T06:50:32.979 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-30T06:50:32.979 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:32.979 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:50:32.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.977+0000 7f7b33c00640 1 -- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b08069100 msgr2=0x7f7b0806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.977+0000 7f7b33c00640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b08069100 0x7f7b0806b5c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c0b36a0 tx=0x7f7b14009040 comp rx=0 tx=0).stop 2024-05-30T06:50:32.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.977+0000 7f7b33c00640 1 -- 172.21.15.37:0/3769259524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b2c06e000 msgr2=0x7f7b2c15f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:32.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.977+0000 7f7b33c00640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b2c06e000 0x7f7b2c15f7b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0b3040 tx=0x7f7b1c01baf0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.981+0000 7f7b33c00640 1 -- 172.21.15.37:0/3769259524 shutdown_connections 2024-05-30T06:50:32.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.981+0000 7f7b33c00640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b08069100 0x7f7b0806b5c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.981+0000 7f7b33c00640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b2c15cd80 0x7f7b2c154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.981+0000 7f7b33c00640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b2c0cee10 0x7f7b2c12cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.981+0000 7f7b33c00640 1 --2- 172.21.15.37:0/3769259524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b2c06e000 0x7f7b2c15f7b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:32.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.981+0000 7f7b33c00640 1 -- 172.21.15.37:0/3769259524 >> 172.21.15.37:0/3769259524 conn(0x7f7b2c0b23a0 msgr2=0x7f7b2c142180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:32.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.981+0000 7f7b33c00640 1 -- 172.21.15.37:0/3769259524 shutdown_connections 2024-05-30T06:50:32.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:32.981+0000 7f7b33c00640 1 -- 172.21.15.37:0/3769259524 wait complete. 2024-05-30T06:50:33.000 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T06:50:33.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T06:50:33.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.149+0000 7ff4b8a00640 1 Processor -- start 2024-05-30T06:50:33.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.149+0000 7ff4b8a00640 1 -- start start 2024-05-30T06:50:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.149+0000 7ff4b8a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4b409b7b0 0x7ff4b4070df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.149+0000 7ff4b8a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b406e690 con 0x7ff4b40d2fa0 2024-05-30T06:50:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.149+0000 7ff4b8a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4b406e970 con 0x7ff4b409aa60 2024-05-30T06:50:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.149+0000 7ff4b8a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff4b406d0c0 con 0x7ff4b409b7b0 2024-05-30T06:50:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.149+0000 7ff4b3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4b409b7b0 0x7ff4b4070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:33.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.149+0000 7ff4aaa00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff4b40d2fa0 0x7ff4b40706e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57546/0 (socket says 172.21.15.37:57546) 2024-05-30T06:50:33.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.149+0000 7ff4aaa00640 1 -- 172.21.15.37:0/3125477595 learned_addr learned my addr 172.21.15.37:0/3125477595 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:33.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.149+0000 7ff4b3e00640 1 -- 172.21.15.37:0/3125477595 >> v1:172.21.15.105:6789/0 conn(0x7ff4b409aa60 legacy=0x7ff4b409ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:33.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.149+0000 7ff4b3e00640 1 -- 172.21.15.37:0/3125477595 >> v1:172.21.15.37:6789/0 conn(0x7ff4b40d2fa0 legacy=0x7ff4b40706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:33.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.149+0000 7ff4b3e00640 1 -- 172.21.15.37:0/3125477595 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b406ca70 con 0x7ff4b409b7b0 2024-05-30T06:50:33.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.153+0000 7ff4b3e00640 1 --2- 172.21.15.37:0/3125477595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b409b7b0 0x7ff4b4070df0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009d90 tx=0x7ff4ac01f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137bc07e7546b5b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:33.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.153+0000 7ff4b2a00640 1 -- 172.21.15.37:0/3125477595 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0b4070 con 0x7ff4b409b7b0 2024-05-30T06:50:33.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.153+0000 7ff4b2a00640 1 -- 172.21.15.37:0/3125477595 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0af600 con 0x7ff4b409b7b0 2024-05-30T06:50:33.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.153+0000 7ff4b2a00640 1 -- 172.21.15.37:0/3125477595 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0af9d0 con 0x7ff4b409b7b0 2024-05-30T06:50:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.153+0000 7ff4b8a00640 1 -- 172.21.15.37:0/3125477595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b409b7b0 msgr2=0x7ff4b4070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.153+0000 7ff4b8a00640 1 --2- 172.21.15.37:0/3125477595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b409b7b0 0x7ff4b4070df0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009d90 tx=0x7ff4ac01f120 comp rx=0 tx=0).stop 2024-05-30T06:50:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.153+0000 7ff4b8a00640 1 -- 172.21.15.37:0/3125477595 shutdown_connections 2024-05-30T06:50:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.153+0000 7ff4b8a00640 1 --2- 172.21.15.37:0/3125477595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b409b7b0 0x7ff4b4070df0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.153+0000 7ff4b8a00640 1 -- 172.21.15.37:0/3125477595 >> 172.21.15.37:0/3125477595 conn(0x7ff4b40d2480 msgr2=0x7ff4b40d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.153+0000 7ff4b8a00640 1 -- 172.21.15.37:0/3125477595 shutdown_connections 2024-05-30T06:50:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.153+0000 7ff4b8a00640 1 -- 172.21.15.37:0/3125477595 wait complete. 2024-05-30T06:50:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.153+0000 7ff4b8a00640 1 Processor -- start 2024-05-30T06:50:33.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.153+0000 7ff4b8a00640 1 -- start start 2024-05-30T06:50:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b8a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4b409aa60 0x7ff4b414bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b8a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4b409b7b0 0x7ff4b41f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40d2fa0 0x7ff4b40afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b8a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b40714b0 con 0x7ff4b40d2fa0 2024-05-30T06:50:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b8a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b4071330 con 0x7ff4b409b7b0 2024-05-30T06:50:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b8a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff4b415ed90 con 0x7ff4b409aa60 2024-05-30T06:50:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40d2fa0 0x7ff4b40afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40d2fa0 0x7ff4b40afe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54704/0 (socket says 172.21.15.37:54704) 2024-05-30T06:50:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b3e00640 1 -- 172.21.15.37:0/2193313243 learned_addr learned my addr 172.21.15.37:0/2193313243 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b3400640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4b409aa60 0x7ff4b414bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:33.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4aaa00640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4b409b7b0 0x7ff4b41f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b3e00640 1 -- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4b409aa60 msgr2=0x7ff4b414bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b3e00640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4b409aa60 0x7ff4b414bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b3e00640 1 -- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4b409b7b0 msgr2=0x7ff4b41f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b3e00640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4b409b7b0 0x7ff4b41f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:33.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b3e00640 1 -- 172.21.15.37:0/2193313243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b41f89d0 con 0x7ff4b40d2fa0 2024-05-30T06:50:33.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b3e00640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40d2fa0 0x7ff4b40afe30 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac01cd50 tx=0x7ff4ac01bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:33.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4abe00640 1 -- 172.21.15.37:0/2193313243 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0b4040 con 0x7ff4b40d2fa0 2024-05-30T06:50:33.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4abe00640 1 -- 172.21.15.37:0/2193313243 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0c1070 con 0x7ff4b40d2fa0 2024-05-30T06:50:33.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b8a00640 1 -- 172.21.15.37:0/2193313243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b41f8cb0 con 0x7ff4b40d2fa0 2024-05-30T06:50:33.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4abe00640 1 -- 172.21.15.37:0/2193313243 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0ba690 con 0x7ff4b40d2fa0 2024-05-30T06:50:33.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b8a00640 1 -- 172.21.15.37:0/2193313243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b40cbbe0 con 0x7ff4b40d2fa0 2024-05-30T06:50:33.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.157+0000 7ff4b8a00640 1 -- 172.21.15.37:0/2193313243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b40cb6f0 con 0x7ff4b40d2fa0 2024-05-30T06:50:33.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.161+0000 7ff4abe00640 1 -- 172.21.15.37:0/2193313243 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7ff4ac0ba830 con 0x7ff4b40d2fa0 2024-05-30T06:50:33.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.161+0000 7ff4abe00640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff490069100 0x7ff49006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:33.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.161+0000 7ff4abe00640 1 -- 172.21.15.37:0/2193313243 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 4885+0+0 (secure 0 0 0) 0x7ff4ac1240b0 con 0x7ff4b40d2fa0 2024-05-30T06:50:33.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.161+0000 7ff4b3400640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff490069100 0x7ff49006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:33.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.161+0000 7ff4b3400640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff490069100 0x7ff49006b5c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4007fd0 tx=0x7ff4a4007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:33.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.165+0000 7ff4abe00640 1 -- 172.21.15.37:0/2193313243 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff4ac018c80 con 0x7ff4b40d2fa0 2024-05-30T06:50:33.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:33.333+0000 7ff4b8a00640 1 -- 172.21.15.37:0/2193313243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff4b4068ab0 con 0x7ff4b40d2fa0 2024-05-30T06:50:34.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.093+0000 7ff4abe00640 1 -- 172.21.15.37:0/2193313243 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7ff4ac0f5880 con 0x7ff4b40d2fa0 2024-05-30T06:50:34.093 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-30T06:50:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.097+0000 7ff4b8a00640 1 -- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff490069100 msgr2=0x7ff49006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.097+0000 7ff4b8a00640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff490069100 0x7ff49006b5c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4007fd0 tx=0x7ff4a4007e40 comp rx=0 tx=0).stop 2024-05-30T06:50:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.097+0000 7ff4b8a00640 1 -- 172.21.15.37:0/2193313243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40d2fa0 msgr2=0x7ff4b40afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.097+0000 7ff4b8a00640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40d2fa0 0x7ff4b40afe30 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac01cd50 tx=0x7ff4ac01bec0 comp rx=0 tx=0).stop 2024-05-30T06:50:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.097+0000 7ff4b8a00640 1 -- 172.21.15.37:0/2193313243 shutdown_connections 2024-05-30T06:50:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.097+0000 7ff4b8a00640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40d2fa0 0x7ff4b40afe30 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.097+0000 7ff4b8a00640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff490069100 0x7ff49006b5c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.097+0000 7ff4b8a00640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4b409b7b0 0x7ff4b41f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.097+0000 7ff4b8a00640 1 --2- 172.21.15.37:0/2193313243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4b409aa60 0x7ff4b414bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:34.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.097+0000 7ff4b8a00640 1 -- 172.21.15.37:0/2193313243 >> 172.21.15.37:0/2193313243 conn(0x7ff4b40d2480 msgr2=0x7ff4b40d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:34.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.097+0000 7ff4b8a00640 1 -- 172.21.15.37:0/2193313243 shutdown_connections 2024-05-30T06:50:34.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.097+0000 7ff4b8a00640 1 -- 172.21.15.37:0/2193313243 wait complete. 2024-05-30T06:50:34.126 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T06:50:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.277+0000 7f0be8c00640 1 Processor -- start 2024-05-30T06:50:34.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.277+0000 7f0be8c00640 1 -- start start 2024-05-30T06:50:34.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.277+0000 7f0be8c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0be415e870 0x7f0be40b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:34.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.277+0000 7f0be8c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0be40b3ff0 0x7f0be40cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:34.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.277+0000 7f0be8c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0be4073280 con 0x7f0be415ec50 2024-05-30T06:50:34.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.277+0000 7f0be8c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0be406ba00 con 0x7f0be415e870 2024-05-30T06:50:34.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.277+0000 7f0be8c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0be406bce0 con 0x7f0be40b3ff0 2024-05-30T06:50:34.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.277+0000 7f0be3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0be415e870 0x7f0be40b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:34.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.277+0000 7f0be3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0be415e870 0x7f0be40b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54710/0 (socket says 172.21.15.37:54710) 2024-05-30T06:50:34.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.277+0000 7f0be3400640 1 -- 172.21.15.37:0/1218071753 learned_addr learned my addr 172.21.15.37:0/1218071753 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:34.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.277+0000 7f0be3e00640 1 --2- 172.21.15.37:0/1218071753 >> v2:172.21.15.105:3300/0 conn(0x7f0be40b3ff0 0x7f0be40cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:34.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be3400640 1 -- 172.21.15.37:0/1218071753 >> v2:172.21.15.105:3300/0 conn(0x7f0be40b3ff0 msgr2=0x7f0be40cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:34.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be3400640 1 --2- 172.21.15.37:0/1218071753 >> v2:172.21.15.105:3300/0 conn(0x7f0be40b3ff0 0x7f0be40cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:34.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be3400640 1 -- 172.21.15.37:0/1218071753 >> v1:172.21.15.105:6789/0 conn(0x7f0be415ec50 legacy=0x7f0be406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:34.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be3400640 1 -- 172.21.15.37:0/1218071753 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be406bfc0 con 0x7f0be415e870 2024-05-30T06:50:34.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be3400640 1 --2- 172.21.15.37:0/1218071753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be415e870 0x7f0be40b3ab0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0be40b06d0 tx=0x7f0bd401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87724f82a60a09 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:34.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be2a00640 1 -- 172.21.15.37:0/1218071753 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40b0070 con 0x7f0be415e870 2024-05-30T06:50:34.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be2a00640 1 -- 172.21.15.37:0/1218071753 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd40ab600 con 0x7f0be415e870 2024-05-30T06:50:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be2a00640 1 -- 172.21.15.37:0/1218071753 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40ab9d0 con 0x7f0be415e870 2024-05-30T06:50:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be8c00640 1 -- 172.21.15.37:0/1218071753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be415e870 msgr2=0x7f0be40b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be8c00640 1 --2- 172.21.15.37:0/1218071753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be415e870 0x7f0be40b3ab0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f0be40b06d0 tx=0x7f0bd401c490 comp rx=0 tx=0).stop 2024-05-30T06:50:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be8c00640 1 -- 172.21.15.37:0/1218071753 shutdown_connections 2024-05-30T06:50:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be8c00640 1 --2- 172.21.15.37:0/1218071753 >> v2:172.21.15.105:3300/0 conn(0x7f0be40b3ff0 0x7f0be40cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be8c00640 1 --2- 172.21.15.37:0/1218071753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be415e870 0x7f0be40b3ab0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be8c00640 1 -- 172.21.15.37:0/1218071753 >> 172.21.15.37:0/1218071753 conn(0x7f0be40d0ba0 msgr2=0x7f0be40d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be8c00640 1 -- 172.21.15.37:0/1218071753 shutdown_connections 2024-05-30T06:50:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.281+0000 7f0be8c00640 1 -- 172.21.15.37:0/1218071753 wait complete. 2024-05-30T06:50:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0be8c00640 1 Processor -- start 2024-05-30T06:50:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0be8c00640 1 -- start start 2024-05-30T06:50:34.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0be8c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0be40b3ff0 0x7f0be413e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:34.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0be8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be415e870 0x7f0be40afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:34.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0be8c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0be415ec50 0x7f0be40b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0be8c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0be416b5f0 con 0x7f0be415e870 2024-05-30T06:50:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0be8c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0be4072fb0 con 0x7f0be40b3ff0 2024-05-30T06:50:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0be8c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0be416b770 con 0x7f0be415ec50 2024-05-30T06:50:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0bdaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be415e870 0x7f0be40afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0bdaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be415e870 0x7f0be40afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54718/0 (socket says 172.21.15.37:54718) 2024-05-30T06:50:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0bdaa00640 1 -- 172.21.15.37:0/1870508271 learned_addr learned my addr 172.21.15.37:0/1870508271 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0be3400640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0be40b3ff0 0x7f0be413e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0be3e00640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0be415ec50 0x7f0be40b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0bdaa00640 1 -- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0be415ec50 msgr2=0x7f0be40b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0bdaa00640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0be415ec50 0x7f0be40b00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0bdaa00640 1 -- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0be40b3ff0 msgr2=0x7f0be413e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0bdaa00640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0be40b3ff0 0x7f0be413e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:34.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0bdaa00640 1 -- 172.21.15.37:0/1870508271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be4158320 con 0x7f0be415e870 2024-05-30T06:50:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0be3e00640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0be415ec50 0x7f0be40b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0bdaa00640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be415e870 0x7f0be40afb70 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00c370 tx=0x7f0bcc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0bdbe00640 1 -- 172.21.15.37:0/1870508271 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0052d0 con 0x7f0be415e870 2024-05-30T06:50:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0bdbe00640 1 -- 172.21.15.37:0/1870508271 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bcc005470 con 0x7f0be415e870 2024-05-30T06:50:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0bdbe00640 1 -- 172.21.15.37:0/1870508271 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc007260 con 0x7f0be415e870 2024-05-30T06:50:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0be8c00640 1 -- 172.21.15.37:0/1870508271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be40ae5c0 con 0x7f0be415e870 2024-05-30T06:50:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.285+0000 7f0be8c00640 1 -- 172.21.15.37:0/1870508271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be40aeb80 con 0x7f0be415e870 2024-05-30T06:50:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.289+0000 7f0be8c00640 1 -- 172.21.15.37:0/1870508271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be4158df0 con 0x7f0be415e870 2024-05-30T06:50:34.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.289+0000 7f0bdbe00640 1 -- 172.21.15.37:0/1870508271 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f0bcc007400 con 0x7f0be415e870 2024-05-30T06:50:34.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.289+0000 7f0bdbe00640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bc0069100 0x7f0bc006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:34.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.289+0000 7f0bdbe00640 1 -- 172.21.15.37:0/1870508271 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5255+0+0 (secure 0 0 0) 0x7f0bcc084ad0 con 0x7f0be415e870 2024-05-30T06:50:34.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.289+0000 7f0be3400640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bc0069100 0x7f0bc006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:34.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.289+0000 7f0be3400640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bc0069100 0x7f0bc006b5c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40ad000 tx=0x7f0bd4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:34.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.293+0000 7f0bdbe00640 1 -- 172.21.15.37:0/1870508271 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0bcc0561e0 con 0x7f0be415e870 2024-05-30T06:50:34.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:34.461+0000 7f0be8c00640 1 -- 172.21.15.37:0/1870508271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0be4068ab0 con 0x7f0be415e870 2024-05-30T06:50:34.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:50:34.779 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:50:35.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.101+0000 7f0bdbe00640 1 -- 172.21.15.37:0/1870508271 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v71) ==== 170+0+0 (secure 0 0 0) 0x7f0bcc05a4e0 con 0x7f0be415e870 2024-05-30T06:50:35.102 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-30T06:50:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.105+0000 7f0be8c00640 1 -- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bc0069100 msgr2=0x7f0bc006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.105+0000 7f0be8c00640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bc0069100 0x7f0bc006b5c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40ad000 tx=0x7f0bd4008040 comp rx=0 tx=0).stop 2024-05-30T06:50:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.105+0000 7f0be8c00640 1 -- 172.21.15.37:0/1870508271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be415e870 msgr2=0x7f0be40afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.105+0000 7f0be8c00640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be415e870 0x7f0be40afb70 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00c370 tx=0x7f0bcc00c830 comp rx=0 tx=0).stop 2024-05-30T06:50:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.105+0000 7f0be8c00640 1 -- 172.21.15.37:0/1870508271 shutdown_connections 2024-05-30T06:50:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.105+0000 7f0be8c00640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0be415ec50 0x7f0be40b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.105+0000 7f0be8c00640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be415e870 0x7f0be40afb70 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.105+0000 7f0be8c00640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0bc0069100 0x7f0bc006b5c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.105+0000 7f0be8c00640 1 --2- 172.21.15.37:0/1870508271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0be40b3ff0 0x7f0be413e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.105+0000 7f0be8c00640 1 -- 172.21.15.37:0/1870508271 >> 172.21.15.37:0/1870508271 conn(0x7f0be40d0ba0 msgr2=0x7f0be4157c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:35.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.105+0000 7f0be8c00640 1 -- 172.21.15.37:0/1870508271 shutdown_connections 2024-05-30T06:50:35.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.105+0000 7f0be8c00640 1 -- 172.21.15.37:0/1870508271 wait complete. 2024-05-30T06:50:35.146 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T06:50:35.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.289+0000 7f62a9000640 1 Processor -- start 2024-05-30T06:50:35.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.289+0000 7f62a9000640 1 -- start start 2024-05-30T06:50:35.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a9000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f62a40b59d0 0x7f62a40b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:35.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a9000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62a41610a0 con 0x7f62a415d7e0 2024-05-30T06:50:35.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a9000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62a40b62f0 con 0x7f62a415d350 2024-05-30T06:50:35.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a9000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f62a4142030 con 0x7f62a40b59d0 2024-05-30T06:50:35.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a2800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f62a415d7e0 0x7f62a4160990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57552/0 (socket says 172.21.15.37:57552) 2024-05-30T06:50:35.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a2800640 1 -- 172.21.15.37:0/2611761273 learned_addr learned my addr 172.21.15.37:0/2611761273 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:35.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a1e00640 1 --2- 172.21.15.37:0/2611761273 >> v2:172.21.15.105:3300/0 conn(0x7f62a40b59d0 0x7f62a40b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:35.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a1400640 1 -- 172.21.15.37:0/2611761273 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045856530 0 0) 0x7f62a41610a0 con 0x7f62a415d7e0 2024-05-30T06:50:35.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a1400640 1 -- 172.21.15.37:0/2611761273 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6288003530 con 0x7f62a415d7e0 2024-05-30T06:50:35.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a1400640 1 -- 172.21.15.37:0/2611761273 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572522533 0 0) 0x7f62a40b62f0 con 0x7f62a415d350 2024-05-30T06:50:35.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a1400640 1 -- 172.21.15.37:0/2611761273 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62a41610a0 con 0x7f62a415d350 2024-05-30T06:50:35.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a1e00640 1 -- 172.21.15.37:0/2611761273 >> v1:172.21.15.105:6789/0 conn(0x7f62a415d350 legacy=0x7f62a4160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:35.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a1e00640 1 -- 172.21.15.37:0/2611761273 >> v1:172.21.15.37:6789/0 conn(0x7f62a415d7e0 legacy=0x7f62a4160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:35.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.293+0000 7f62a1e00640 1 -- 172.21.15.37:0/2611761273 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a4142310 con 0x7f62a40b59d0 2024-05-30T06:50:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.297+0000 7f62a1e00640 1 --2- 172.21.15.37:0/2611761273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a40b59d0 0x7f62a40b5db0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f62940097f0 tx=0x7f629401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4bae17ddf6b6eff server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.297+0000 7f62a1400640 1 -- 172.21.15.37:0/2611761273 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940b5070 con 0x7f62a40b59d0 2024-05-30T06:50:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.297+0000 7f62a1400640 1 -- 172.21.15.37:0/2611761273 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62940a8990 con 0x7f62a40b59d0 2024-05-30T06:50:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.297+0000 7f62a1400640 1 -- 172.21.15.37:0/2611761273 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940a8d60 con 0x7f62a40b59d0 2024-05-30T06:50:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.297+0000 7f62a9000640 1 -- 172.21.15.37:0/2611761273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a40b59d0 msgr2=0x7f62a40b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.297+0000 7f62a9000640 1 --2- 172.21.15.37:0/2611761273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a40b59d0 0x7f62a40b5db0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f62940097f0 tx=0x7f629401ec90 comp rx=0 tx=0).stop 2024-05-30T06:50:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.297+0000 7f62a9000640 1 -- 172.21.15.37:0/2611761273 shutdown_connections 2024-05-30T06:50:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.297+0000 7f62a9000640 1 --2- 172.21.15.37:0/2611761273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a40b59d0 0x7f62a40b5db0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.297+0000 7f62a9000640 1 -- 172.21.15.37:0/2611761273 >> 172.21.15.37:0/2611761273 conn(0x7f62a406bf60 msgr2=0x7f62a40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.297+0000 7f62a9000640 1 -- 172.21.15.37:0/2611761273 shutdown_connections 2024-05-30T06:50:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.297+0000 7f62a9000640 1 -- 172.21.15.37:0/2611761273 wait complete. 2024-05-30T06:50:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.297+0000 7f62a9000640 1 Processor -- start 2024-05-30T06:50:35.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.297+0000 7f62a9000640 1 -- start start 2024-05-30T06:50:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a9000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a40b59d0 0x7f62a4159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a9000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62a415d350 0x7f62a40b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a9000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a415d7e0 0x7f62a415c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a9000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f62a413fce0 con 0x7f62a40b59d0 2024-05-30T06:50:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a9000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62a41428d0 con 0x7f62a415d7e0 2024-05-30T06:50:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a9000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f62a413fe60 con 0x7f62a415d350 2024-05-30T06:50:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a40b59d0 0x7f62a4159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a40b59d0 0x7f62a4159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54722/0 (socket says 172.21.15.37:54722) 2024-05-30T06:50:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a1e00640 1 -- 172.21.15.37:0/3539145830 learned_addr learned my addr 172.21.15.37:0/3539145830 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a2800640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a415d7e0 0x7f62a415c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:35.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f6299400640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62a415d350 0x7f62a40b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a1e00640 1 -- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62a415d350 msgr2=0x7f62a40b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a1e00640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62a415d350 0x7f62a40b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a1e00640 1 -- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a415d7e0 msgr2=0x7f62a415c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a1e00640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a415d7e0 0x7f62a415c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a1e00640 1 -- 172.21.15.37:0/3539145830 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a415b310 con 0x7f62a40b59d0 2024-05-30T06:50:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a1e00640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a40b59d0 0x7f62a4159e10 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f629401c8c0 tx=0x7f629401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f629aa00640 1 -- 172.21.15.37:0/3539145830 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940bf070 con 0x7f62a40b59d0 2024-05-30T06:50:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f629aa00640 1 -- 172.21.15.37:0/3539145830 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62940b0700 con 0x7f62a40b59d0 2024-05-30T06:50:35.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f629aa00640 1 -- 172.21.15.37:0/3539145830 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940b5040 con 0x7f62a40b59d0 2024-05-30T06:50:35.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a9000640 1 -- 172.21.15.37:0/3539145830 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a415b5f0 con 0x7f62a40b59d0 2024-05-30T06:50:35.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a9000640 1 -- 172.21.15.37:0/3539145830 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a415bbb0 con 0x7f62a40b59d0 2024-05-30T06:50:35.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f62a9000640 1 -- 172.21.15.37:0/3539145830 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a4068bc0 con 0x7f62a40b59d0 2024-05-30T06:50:35.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.301+0000 7f629aa00640 1 -- 172.21.15.37:0/3539145830 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f62940c2070 con 0x7f62a40b59d0 2024-05-30T06:50:35.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.305+0000 7f629aa00640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6280069100 0x7f628006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:35.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.305+0000 7f629aa00640 1 -- 172.21.15.37:0/3539145830 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5637+0+0 (secure 0 0 0) 0x7f6294121ed0 con 0x7f62a40b59d0 2024-05-30T06:50:35.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.305+0000 7f6299400640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6280069100 0x7f628006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:35.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.305+0000 7f6299400640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6280069100 0x7f628006b5c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f62a406ea10 tx=0x7f628c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:35.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.309+0000 7f629aa00640 1 -- 172.21.15.37:0/3539145830 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f62940187f0 con 0x7f62a40b59d0 2024-05-30T06:50:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:35.509+0000 7f62a9000640 1 -- 172.21.15.37:0/3539145830 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f62a406f0a0 con 0x7f62a40b59d0 2024-05-30T06:50:36.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.101+0000 7f629aa00640 1 -- 172.21.15.37:0/3539145830 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v42) ==== 174+0+0 (secure 0 0 0) 0x7f62940f35e0 con 0x7f62a40b59d0 2024-05-30T06:50:36.104 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 10 and data pool 11 2024-05-30T06:50:36.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.105+0000 7f62a9000640 1 -- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6280069100 msgr2=0x7f628006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:36.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.105+0000 7f62a9000640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6280069100 0x7f628006b5c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f62a406ea10 tx=0x7f628c009040 comp rx=0 tx=0).stop 2024-05-30T06:50:36.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.105+0000 7f62a9000640 1 -- 172.21.15.37:0/3539145830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a40b59d0 msgr2=0x7f62a4159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.105+0000 7f62a9000640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a40b59d0 0x7f62a4159e10 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f629401c8c0 tx=0x7f629401ba30 comp rx=0 tx=0).stop 2024-05-30T06:50:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.105+0000 7f62a9000640 1 -- 172.21.15.37:0/3539145830 shutdown_connections 2024-05-30T06:50:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.105+0000 7f62a9000640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6280069100 0x7f628006b5c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.105+0000 7f62a9000640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a415d7e0 0x7f62a415c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.105+0000 7f62a9000640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62a415d350 0x7f62a40b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.105+0000 7f62a9000640 1 --2- 172.21.15.37:0/3539145830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a40b59d0 0x7f62a4159e10 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.105+0000 7f62a9000640 1 -- 172.21.15.37:0/3539145830 >> 172.21.15.37:0/3539145830 conn(0x7f62a406bf60 msgr2=0x7f62a40adb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.105+0000 7f62a9000640 1 -- 172.21.15.37:0/3539145830 shutdown_connections 2024-05-30T06:50:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.105+0000 7f62a9000640 1 -- 172.21.15.37:0/3539145830 wait complete. 2024-05-30T06:50:36.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:50:36.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.293+0000 7f6242e00640 1 Processor -- start 2024-05-30T06:50:36.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.293+0000 7f6242e00640 1 -- start start 2024-05-30T06:50:36.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.293+0000 7f6242e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f623c155e60 0x7f623c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.293+0000 7f6242e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f623c0b2ec0 0x7f623c0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.293+0000 7f6242e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623c15c8f0 con 0x7f623c06f9a0 2024-05-30T06:50:36.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.293+0000 7f6242e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f623c0ccff0 con 0x7f623c155e60 2024-05-30T06:50:36.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.293+0000 7f6242e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f623c0ccc80 con 0x7f623c0b2ec0 2024-05-30T06:50:36.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f623be00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f623c155e60 0x7f623c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:36.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f6240e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f623c0b2ec0 0x7f623c0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:36.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f623be00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f623c155e60 0x7f623c0b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:54268/0 (socket says 172.21.15.37:54268) 2024-05-30T06:50:36.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f6240e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f623c0b2ec0 0x7f623c0cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:33998/0 (socket says 172.21.15.37:33998) 2024-05-30T06:50:36.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f623be00640 1 -- 172.21.15.37:0/326660467 learned_addr learned my addr 172.21.15.37:0/326660467 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:36.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f623be00640 1 -- 172.21.15.37:0/326660467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f623c0b2ec0 msgr2=0x7f623c0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:36.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f623be00640 1 --2- 172.21.15.37:0/326660467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f623c0b2ec0 0x7f623c0cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f623be00640 1 -- 172.21.15.37:0/326660467 >> v1:172.21.15.105:6789/0 conn(0x7f623c06f9a0 legacy=0x7f623c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:36.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f623be00640 1 -- 172.21.15.37:0/326660467 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c15cbd0 con 0x7f623c155e60 2024-05-30T06:50:36.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f6240e00640 1 --2- 172.21.15.37:0/326660467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f623c0b2ec0 0x7f623c0cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:36.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f623be00640 1 --2- 172.21.15.37:0/326660467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f623c155e60 0x7f623c0b36a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f622c009870 tx=0x7f622c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1ef974409ad4ff5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:36.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f623b400640 1 -- 172.21.15.37:0/326660467 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c0a7070 con 0x7f623c155e60 2024-05-30T06:50:36.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f623b400640 1 -- 172.21.15.37:0/326660467 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622c0b0070 con 0x7f623c155e60 2024-05-30T06:50:36.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.297+0000 7f623b400640 1 -- 172.21.15.37:0/326660467 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c0ab890 con 0x7f623c155e60 2024-05-30T06:50:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 -- 172.21.15.37:0/326660467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f623c155e60 msgr2=0x7f623c0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 --2- 172.21.15.37:0/326660467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f623c155e60 0x7f623c0b36a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f622c009870 tx=0x7f622c01c560 comp rx=0 tx=0).stop 2024-05-30T06:50:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 -- 172.21.15.37:0/326660467 shutdown_connections 2024-05-30T06:50:36.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 --2- 172.21.15.37:0/326660467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f623c0b2ec0 0x7f623c0cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 --2- 172.21.15.37:0/326660467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f623c155e60 0x7f623c0b36a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 -- 172.21.15.37:0/326660467 >> 172.21.15.37:0/326660467 conn(0x7f623c0b23a0 msgr2=0x7f623c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:36.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 -- 172.21.15.37:0/326660467 shutdown_connections 2024-05-30T06:50:36.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 -- 172.21.15.37:0/326660467 wait complete. 2024-05-30T06:50:36.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 Processor -- start 2024-05-30T06:50:36.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 -- start start 2024-05-30T06:50:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f623c06f9a0 0x7f623c14d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f623c0b2ec0 0x7f623c14f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623c155e60 0x7f623c14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f623c06ec20 con 0x7f623c155e60 2024-05-30T06:50:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f623c06eaa0 con 0x7f623c06f9a0 2024-05-30T06:50:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6242e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f623c06eda0 con 0x7f623c0b2ec0 2024-05-30T06:50:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6240e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623c155e60 0x7f623c14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6240e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623c155e60 0x7f623c14e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54732/0 (socket says 172.21.15.37:54732) 2024-05-30T06:50:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6240e00640 1 -- 172.21.15.37:0/91465275 learned_addr learned my addr 172.21.15.37:0/91465275 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6233400640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f623c0b2ec0 0x7f623c14f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f623be00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f623c06f9a0 0x7f623c14d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6240e00640 1 -- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f623c0b2ec0 msgr2=0x7f623c14f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6240e00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f623c0b2ec0 0x7f623c14f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6240e00640 1 -- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f623c06f9a0 msgr2=0x7f623c14d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6240e00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f623c06f9a0 0x7f623c14d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f6240e00640 1 -- 172.21.15.37:0/91465275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c14f960 con 0x7f623c155e60 2024-05-30T06:50:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.301+0000 7f623be00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f623c06f9a0 0x7f623c14d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.305+0000 7f6240e00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623c155e60 0x7f623c14e4b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6234007fc0 tx=0x7f623400e550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.305+0000 7f6238c00640 1 -- 172.21.15.37:0/91465275 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623400b2d0 con 0x7f623c155e60 2024-05-30T06:50:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.305+0000 7f6238c00640 1 -- 172.21.15.37:0/91465275 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62340039a0 con 0x7f623c155e60 2024-05-30T06:50:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.305+0000 7f6238c00640 1 -- 172.21.15.37:0/91465275 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234003d50 con 0x7f623c155e60 2024-05-30T06:50:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.305+0000 7f6242e00640 1 -- 172.21.15.37:0/91465275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623c14fc40 con 0x7f623c155e60 2024-05-30T06:50:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.305+0000 7f6242e00640 1 -- 172.21.15.37:0/91465275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f623c14e9f0 con 0x7f623c155e60 2024-05-30T06:50:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.305+0000 7f6242e00640 1 -- 172.21.15.37:0/91465275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f623c068b20 con 0x7f623c155e60 2024-05-30T06:50:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.305+0000 7f6238c00640 1 -- 172.21.15.37:0/91465275 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f6234009540 con 0x7f623c155e60 2024-05-30T06:50:36.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.305+0000 7f6238c00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6218069100 0x7f621806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.305+0000 7f6238c00640 1 -- 172.21.15.37:0/91465275 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7f6234085c80 con 0x7f623c155e60 2024-05-30T06:50:36.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.305+0000 7f623be00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6218069100 0x7f621806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:36.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.309+0000 7f623be00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6218069100 0x7f621806b5c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f622c0af000 tx=0x7f622c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:36.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.309+0000 7f6238c00640 1 -- 172.21.15.37:0/91465275 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f62340579e0 con 0x7f623c155e60 2024-05-30T06:50:36.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.477+0000 7f6242e00640 1 -- 172.21.15.37:0/91465275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f623c072fb0 con 0x7f623c155e60 2024-05-30T06:50:36.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.477+0000 7f6238c00640 1 -- 172.21.15.37:0/91465275 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16712 (secure 0 0 0) 0x7f62340572e0 con 0x7f623c155e60 2024-05-30T06:50:36.479 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:36.479 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":72,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:50:35.512381+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:50:33.347094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T06:50:34.475297+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:50:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.477+0000 7f6242e00640 1 -- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6218069100 msgr2=0x7f621806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.477+0000 7f6242e00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6218069100 0x7f621806b5c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f622c0af000 tx=0x7f622c0a7000 comp rx=0 tx=0).stop 2024-05-30T06:50:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.481+0000 7f6242e00640 1 -- 172.21.15.37:0/91465275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623c155e60 msgr2=0x7f623c14e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.481+0000 7f6242e00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623c155e60 0x7f623c14e4b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6234007fc0 tx=0x7f623400e550 comp rx=0 tx=0).stop 2024-05-30T06:50:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.481+0000 7f6242e00640 1 -- 172.21.15.37:0/91465275 shutdown_connections 2024-05-30T06:50:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.481+0000 7f6242e00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623c155e60 0x7f623c14e4b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.481+0000 7f6242e00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f623c0b2ec0 0x7f623c14f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.481+0000 7f6242e00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6218069100 0x7f621806b5c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.481+0000 7f6242e00640 1 --2- 172.21.15.37:0/91465275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f623c06f9a0 0x7f623c14d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.481+0000 7f6242e00640 1 -- 172.21.15.37:0/91465275 >> 172.21.15.37:0/91465275 conn(0x7f623c0b23a0 msgr2=0x7f623c0b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.481+0000 7f6242e00640 1 -- 172.21.15.37:0/91465275 shutdown_connections 2024-05-30T06:50:36.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.481+0000 7f6242e00640 1 -- 172.21.15.37:0/91465275 wait complete. 2024-05-30T06:50:36.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:50:36.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.641+0000 7f39b8200640 1 Processor -- start 2024-05-30T06:50:36.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.641+0000 7f39b8200640 1 -- start start 2024-05-30T06:50:36.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.641+0000 7f39b8200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f39b00af1e0 0x7f39b015cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.641+0000 7f39b8200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b00cd340 0x7f39b00af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.641+0000 7f39b8200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39b006e890 0x7f39b006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.641+0000 7f39b8200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f39b00afb00 con 0x7f39b006e890 2024-05-30T06:50:36.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.641+0000 7f39b8200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f39b00adf40 con 0x7f39b00af1e0 2024-05-30T06:50:36.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.641+0000 7f39b8200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39b00ae220 con 0x7f39b00cd340 2024-05-30T06:50:36.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.641+0000 7f39b6200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39b006e890 0x7f39b006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:36.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.641+0000 7f39b6200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39b006e890 0x7f39b006ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54742/0 (socket says 172.21.15.37:54742) 2024-05-30T06:50:36.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.641+0000 7f39b6200640 1 -- 172.21.15.37:0/2069147240 learned_addr learned my addr 172.21.15.37:0/2069147240 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:36.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.645+0000 7f39b4e00640 1 --2- 172.21.15.37:0/2069147240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b00cd340 0x7f39b00af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:36.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.645+0000 7f39b5800640 1 --2- 172.21.15.37:0/2069147240 >> v2:172.21.15.105:3300/0 conn(0x7f39b00af1e0 0x7f39b015cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:36.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.645+0000 7f39b6200640 1 -- 172.21.15.37:0/2069147240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b00cd340 msgr2=0x7f39b00af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.645+0000 7f39b6200640 1 --2- 172.21.15.37:0/2069147240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b00cd340 0x7f39b00af5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.645+0000 7f39b6200640 1 -- 172.21.15.37:0/2069147240 >> v2:172.21.15.105:3300/0 conn(0x7f39b00af1e0 msgr2=0x7f39b015cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.645+0000 7f39b6200640 1 --2- 172.21.15.37:0/2069147240 >> v2:172.21.15.105:3300/0 conn(0x7f39b00af1e0 0x7f39b015cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.645+0000 7f39b6200640 1 -- 172.21.15.37:0/2069147240 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b00ae500 con 0x7f39b006e890 2024-05-30T06:50:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.645+0000 7f39b6200640 1 --2- 172.21.15.37:0/2069147240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39b006e890 0x7f39b006ed10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f39b00687c0 tx=0x7f39a801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15546ddedea136fe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.645+0000 7f39afe00640 1 -- 172.21.15.37:0/2069147240 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a80a56b0 con 0x7f39b006e890 2024-05-30T06:50:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.645+0000 7f39afe00640 1 -- 172.21.15.37:0/2069147240 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a80a5850 con 0x7f39b006e890 2024-05-30T06:50:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.645+0000 7f39afe00640 1 -- 172.21.15.37:0/2069147240 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a80a5c20 con 0x7f39b006e890 2024-05-30T06:50:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.645+0000 7f39b8200640 1 -- 172.21.15.37:0/2069147240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39b006e890 msgr2=0x7f39b006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.645+0000 7f39b8200640 1 --2- 172.21.15.37:0/2069147240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39b006e890 0x7f39b006ed10 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f39b00687c0 tx=0x7f39a801c8a0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 -- 172.21.15.37:0/2069147240 shutdown_connections 2024-05-30T06:50:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 --2- 172.21.15.37:0/2069147240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39b006e890 0x7f39b006ed10 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 --2- 172.21.15.37:0/2069147240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b00cd340 0x7f39b00af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 --2- 172.21.15.37:0/2069147240 >> v2:172.21.15.105:3300/0 conn(0x7f39b00af1e0 0x7f39b015cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 -- 172.21.15.37:0/2069147240 >> 172.21.15.37:0/2069147240 conn(0x7f39b0073680 msgr2=0x7f39b006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:36.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 -- 172.21.15.37:0/2069147240 shutdown_connections 2024-05-30T06:50:36.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 -- 172.21.15.37:0/2069147240 wait complete. 2024-05-30T06:50:36.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 Processor -- start 2024-05-30T06:50:36.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 -- start start 2024-05-30T06:50:36.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b006e890 0x7f39b01408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b00af1e0 0x7f39b01540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39b00cd340 0x7f39b0154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39b0168450 con 0x7f39b00cd340 2024-05-30T06:50:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39b01682d0 con 0x7f39b00af1e0 2024-05-30T06:50:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b8200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39b01685d0 con 0x7f39b006e890 2024-05-30T06:50:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b6200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39b00cd340 0x7f39b0154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b6200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39b00cd340 0x7f39b0154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54746/0 (socket says 172.21.15.37:54746) 2024-05-30T06:50:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b6200640 1 -- 172.21.15.37:0/297294619 learned_addr learned my addr 172.21.15.37:0/297294619 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b4e00640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b00af1e0 0x7f39b01540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b5800640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b006e890 0x7f39b01408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b6200640 1 -- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b006e890 msgr2=0x7f39b01408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:36.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b6200640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b006e890 0x7f39b01408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b6200640 1 -- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b00af1e0 msgr2=0x7f39b01540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b6200640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b00af1e0 0x7f39b01540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b6200640 1 -- 172.21.15.37:0/297294619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b0140e10 con 0x7f39b00cd340 2024-05-30T06:50:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.649+0000 7f39b6200640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39b00cd340 0x7f39b0154600 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f39a801af50 tx=0x7f39a8019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.653+0000 7f39ad600640 1 -- 172.21.15.37:0/297294619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a80bc020 con 0x7f39b00cd340 2024-05-30T06:50:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.653+0000 7f39ad600640 1 -- 172.21.15.37:0/297294619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a80b8670 con 0x7f39b00cd340 2024-05-30T06:50:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.653+0000 7f39b8200640 1 -- 172.21.15.37:0/297294619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b00cf820 con 0x7f39b00cd340 2024-05-30T06:50:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.653+0000 7f39ad600640 1 -- 172.21.15.37:0/297294619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8009510 con 0x7f39b00cd340 2024-05-30T06:50:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.653+0000 7f39b8200640 1 -- 172.21.15.37:0/297294619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b00b43b0 con 0x7f39b00cd340 2024-05-30T06:50:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.653+0000 7f39b8200640 1 -- 172.21.15.37:0/297294619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b0068b20 con 0x7f39b00cd340 2024-05-30T06:50:36.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.653+0000 7f39ad600640 1 -- 172.21.15.37:0/297294619 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f39a80bf020 con 0x7f39b00cd340 2024-05-30T06:50:36.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.653+0000 7f39ad600640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3990069100 0x7f399006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.653+0000 7f39ad600640 1 -- 172.21.15.37:0/297294619 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7f39a8120790 con 0x7f39b00cd340 2024-05-30T06:50:36.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.653+0000 7f39b5800640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3990069100 0x7f399006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:36.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.657+0000 7f39b5800640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3990069100 0x7f399006b5c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f39a400ba30 tx=0x7f39a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:36.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.657+0000 7f39ad600640 1 -- 172.21.15.37:0/297294619 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39a80c6030 con 0x7f39b00cd340 2024-05-30T06:50:36.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39b8200640 1 -- 172.21.15.37:0/297294619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39b00b08f0 con 0x7f39b00cd340 2024-05-30T06:50:36.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39ad600640 1 -- 172.21.15.37:0/297294619 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+16712 (secure 0 0 0) 0x7f39a80165e0 con 0x7f39b00cd340 2024-05-30T06:50:36.830 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:36.830 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":72,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:50:35.512381+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:50:33.347094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T06:50:34.475297+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:50:36.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39b8200640 1 -- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3990069100 msgr2=0x7f399006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:36.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39b8200640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3990069100 0x7f399006b5c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f39a400ba30 tx=0x7f39a4008040 comp rx=0 tx=0).stop 2024-05-30T06:50:36.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39b8200640 1 -- 172.21.15.37:0/297294619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39b00cd340 msgr2=0x7f39b0154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:36.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39b8200640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39b00cd340 0x7f39b0154600 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f39a801af50 tx=0x7f39a8019640 comp rx=0 tx=0).stop 2024-05-30T06:50:36.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39b8200640 1 -- 172.21.15.37:0/297294619 shutdown_connections 2024-05-30T06:50:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39b8200640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39b00cd340 0x7f39b0154600 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39b8200640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3990069100 0x7f399006b5c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39b8200640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39b00af1e0 0x7f39b01540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39b8200640 1 --2- 172.21.15.37:0/297294619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39b006e890 0x7f39b01408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39b8200640 1 -- 172.21.15.37:0/297294619 >> 172.21.15.37:0/297294619 conn(0x7f39b0073680 msgr2=0x7f39b00b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39b8200640 1 -- 172.21.15.37:0/297294619 shutdown_connections 2024-05-30T06:50:36.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.829+0000 7f39b8200640 1 -- 172.21.15.37:0/297294619 wait complete. 2024-05-30T06:50:36.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T06:50:36.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b8c00640 1 Processor -- start 2024-05-30T06:50:36.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b8c00640 1 -- start start 2024-05-30T06:50:36.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b8c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd1b40b59d0 0x7fd1b40b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b8c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1b415d350 0x7fd1b4160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b8c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1b415d7b0 0x7fd1b41607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:36.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b8c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd1b40b62f0 con 0x7fd1b415d7b0 2024-05-30T06:50:36.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b8c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd1b4142030 con 0x7fd1b40b59d0 2024-05-30T06:50:37.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b8c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b4142310 con 0x7fd1b415d350 2024-05-30T06:50:37.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b2800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1b415d7b0 0x7fd1b41607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:37.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b2800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1b415d7b0 0x7fd1b41607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54754/0 (socket says 172.21.15.37:54754) 2024-05-30T06:50:37.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b2800640 1 -- 172.21.15.37:0/562852334 learned_addr learned my addr 172.21.15.37:0/562852334 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:37.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b2800640 1 -- 172.21.15.37:0/562852334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1b415d350 msgr2=0x7fd1b4160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:37.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b2800640 1 --2- 172.21.15.37:0/562852334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1b415d350 0x7fd1b4160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:37.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b2800640 1 -- 172.21.15.37:0/562852334 >> v2:172.21.15.105:3300/0 conn(0x7fd1b40b59d0 msgr2=0x7fd1b40b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:37.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b2800640 1 --2- 172.21.15.37:0/562852334 >> v2:172.21.15.105:3300/0 conn(0x7fd1b40b59d0 0x7fd1b40b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:37.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:36.997+0000 7fd1b2800640 1 -- 172.21.15.37:0/562852334 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b41425f0 con 0x7fd1b415d7b0 2024-05-30T06:50:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b2800640 1 --2- 172.21.15.37:0/562852334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b415d7b0 0x7fd1b41607c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4073360 tx=0x7fd1ac01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf1cc15f95595f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b1400640 1 -- 172.21.15.37:0/562852334 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0b5070 con 0x7fd1b415d7b0 2024-05-30T06:50:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b1400640 1 -- 172.21.15.37:0/562852334 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1ac0a89d0 con 0x7fd1b415d7b0 2024-05-30T06:50:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b1400640 1 -- 172.21.15.37:0/562852334 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0a8da0 con 0x7fd1b415d7b0 2024-05-30T06:50:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b8c00640 1 -- 172.21.15.37:0/562852334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b415d7b0 msgr2=0x7fd1b41607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b8c00640 1 --2- 172.21.15.37:0/562852334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b415d7b0 0x7fd1b41607c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4073360 tx=0x7fd1ac01ed10 comp rx=0 tx=0).stop 2024-05-30T06:50:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b8c00640 1 -- 172.21.15.37:0/562852334 shutdown_connections 2024-05-30T06:50:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b8c00640 1 --2- 172.21.15.37:0/562852334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b415d7b0 0x7fd1b41607c0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b8c00640 1 --2- 172.21.15.37:0/562852334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1b415d350 0x7fd1b4160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b8c00640 1 --2- 172.21.15.37:0/562852334 >> v2:172.21.15.105:3300/0 conn(0x7fd1b40b59d0 0x7fd1b40b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b8c00640 1 -- 172.21.15.37:0/562852334 >> 172.21.15.37:0/562852334 conn(0x7fd1b406bf60 msgr2=0x7fd1b40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b8c00640 1 -- 172.21.15.37:0/562852334 shutdown_connections 2024-05-30T06:50:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b8c00640 1 -- 172.21.15.37:0/562852334 wait complete. 2024-05-30T06:50:37.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b8c00640 1 Processor -- start 2024-05-30T06:50:37.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.001+0000 7fd1b8c00640 1 -- start start 2024-05-30T06:50:37.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b8c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1b40b59d0 0x7fd1b413b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:37.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b8c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b415d350 0x7fd1b415f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:37.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b415d7b0 0x7fd1b40b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:37.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b8c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b413fe60 con 0x7fd1b415d7b0 2024-05-30T06:50:37.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b8c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b413fce0 con 0x7fd1b415d350 2024-05-30T06:50:37.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b8c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b40aff20 con 0x7fd1b40b59d0 2024-05-30T06:50:37.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b415d7b0 0x7fd1b40b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:37.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b415d7b0 0x7fd1b40b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54764/0 (socket says 172.21.15.37:54764) 2024-05-30T06:50:37.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b2800640 1 -- 172.21.15.37:0/1340552141 learned_addr learned my addr 172.21.15.37:0/1340552141 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:37.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b1e00640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1b40b59d0 0x7fd1b413b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1a9400640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b415d350 0x7fd1b415f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b2800640 1 -- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1b40b59d0 msgr2=0x7fd1b413b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b2800640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1b40b59d0 0x7fd1b413b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b2800640 1 -- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b415d350 msgr2=0x7fd1b415f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b2800640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b415d350 0x7fd1b415f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b2800640 1 -- 172.21.15.37:0/1340552141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b415f940 con 0x7fd1b415d7b0 2024-05-30T06:50:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b2800640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b415d7b0 0x7fd1b40b5090 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0b3040 tx=0x7fd1ac01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1aaa00640 1 -- 172.21.15.37:0/1340552141 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0c0070 con 0x7fd1b415d7b0 2024-05-30T06:50:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1aaa00640 1 -- 172.21.15.37:0/1340552141 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1ac0b0840 con 0x7fd1b415d7b0 2024-05-30T06:50:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b8c00640 1 -- 172.21.15.37:0/1340552141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b40ad970 con 0x7fd1b415d7b0 2024-05-30T06:50:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1aaa00640 1 -- 172.21.15.37:0/1340552141 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac0b5040 con 0x7fd1b415d7b0 2024-05-30T06:50:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b8c00640 1 -- 172.21.15.37:0/1340552141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b40adf30 con 0x7fd1b415d7b0 2024-05-30T06:50:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1b8c00640 1 -- 172.21.15.37:0/1340552141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1b4068bc0 con 0x7fd1b415d7b0 2024-05-30T06:50:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.005+0000 7fd1aaa00640 1 -- 172.21.15.37:0/1340552141 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fd1ac0c3070 con 0x7fd1b415d7b0 2024-05-30T06:50:37.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.009+0000 7fd1aaa00640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd190069100 0x7fd19006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:37.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.009+0000 7fd1aaa00640 1 -- 172.21.15.37:0/1340552141 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5737+0+0 (secure 0 0 0) 0x7fd1ac122490 con 0x7fd1b415d7b0 2024-05-30T06:50:37.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.009+0000 7fd1b1e00640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd190069100 0x7fd19006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:37.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.009+0000 7fd1b1e00640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd190069100 0x7fd19006b5c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400a400 tx=0x7fd1a400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.013+0000 7fd1aaa00640 1 -- 172.21.15.37:0/1340552141 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd1ac018870 con 0x7fd1b415d7b0 2024-05-30T06:50:37.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:37.221+0000 7fd1b8c00640 1 -- 172.21.15.37:0/1340552141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd1b406f0a0 con 0x7fd1b415d7b0 2024-05-30T06:50:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.133+0000 7fd1aaa00640 1 -- 172.21.15.37:0/1340552141 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) ==== 118+0+0 (secure 0 0 0) 0x7fd1ac0f3e50 con 0x7fd1b415d7b0 2024-05-30T06:50:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.137+0000 7fd1b8c00640 1 -- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd190069100 msgr2=0x7fd19006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.137+0000 7fd1b8c00640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd190069100 0x7fd19006b5c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400a400 tx=0x7fd1a400d040 comp rx=0 tx=0).stop 2024-05-30T06:50:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.137+0000 7fd1b8c00640 1 -- 172.21.15.37:0/1340552141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b415d7b0 msgr2=0x7fd1b40b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.137+0000 7fd1b8c00640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b415d7b0 0x7fd1b40b5090 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0b3040 tx=0x7fd1ac01bab0 comp rx=0 tx=0).stop 2024-05-30T06:50:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.137+0000 7fd1b8c00640 1 -- 172.21.15.37:0/1340552141 shutdown_connections 2024-05-30T06:50:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.137+0000 7fd1b8c00640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1b415d7b0 0x7fd1b40b5090 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.137+0000 7fd1b8c00640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd190069100 0x7fd19006b5c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.137+0000 7fd1b8c00640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1b415d350 0x7fd1b415f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.137+0000 7fd1b8c00640 1 --2- 172.21.15.37:0/1340552141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1b40b59d0 0x7fd1b413b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.137+0000 7fd1b8c00640 1 -- 172.21.15.37:0/1340552141 >> 172.21.15.37:0/1340552141 conn(0x7fd1b406bf60 msgr2=0x7fd1b4071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.137+0000 7fd1b8c00640 1 -- 172.21.15.37:0/1340552141 shutdown_connections 2024-05-30T06:50:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.137+0000 7fd1b8c00640 1 -- 172.21.15.37:0/1340552141 wait complete. 2024-05-30T06:50:38.166 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T06:50:38.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T06:50:38.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe983200640 1 Processor -- start 2024-05-30T06:50:38.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe983200640 1 -- start start 2024-05-30T06:50:38.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe983200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe97c072e60 0x7fe97c06c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:38.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe983200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe97c163020 con 0x7fe97c15f210 2024-05-30T06:50:38.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe983200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe97c163300 con 0x7fe97c15c890 2024-05-30T06:50:38.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe983200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe97c1635e0 con 0x7fe97c072e60 2024-05-30T06:50:38.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe973400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe97c15f210 0x7fe97c072750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59630/0 (socket says 172.21.15.37:59630) 2024-05-30T06:50:38.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe973400640 1 -- 172.21.15.37:0/2585416050 learned_addr learned my addr 172.21.15.37:0/2585416050 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:38.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe981200640 1 --2- 172.21.15.37:0/2585416050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe97c072e60 0x7fe97c06c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:38.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2778193307 0 0) 0x7fe97c163020 con 0x7fe97c15f210 2024-05-30T06:50:38.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe960003530 con 0x7fe97c15f210 2024-05-30T06:50:38.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351229234 0 0) 0x7fe97c163300 con 0x7fe97c15c890 2024-05-30T06:50:38.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe97c163020 con 0x7fe97c15c890 2024-05-30T06:50:38.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3652179651 0 0) 0x7fe960003530 con 0x7fe97c15f210 2024-05-30T06:50:38.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe97c072e60 msgr2=0x7fe97c06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:38.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 --2- 172.21.15.37:0/2585416050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe97c072e60 0x7fe97c06c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:38.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 >> v1:172.21.15.105:6789/0 conn(0x7fe97c15c890 legacy=0x7fe97c162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:38.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c06ba00 con 0x7fe97c15f210 2024-05-30T06:50:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fe964001a00 con 0x7fe97c15f210 2024-05-30T06:50:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 >> v1:172.21.15.37:6789/0 conn(0x7fe97c15f210 legacy=0x7fe97c072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 --2- 172.21.15.37:0/2585416050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe960003b80 0x7fe960003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 --2- 172.21.15.37:0/2585416050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe960004810 0x7fe960004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 --2- 172.21.15.37:0/2585416050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9600051d0 0x7fe96000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c1635e0 con 0x7fe960004810 2024-05-30T06:50:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe96000c0a0 con 0x7fe9600051d0 2024-05-30T06:50:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe96000c2a0 con 0x7fe960003b80 2024-05-30T06:50:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe973400640 1 --2- 172.21.15.37:0/2585416050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe960004810 0x7fe960004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe981200640 1 --2- 172.21.15.37:0/2585416050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9600051d0 0x7fe96000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe97be00640 1 --2- 172.21.15.37:0/2585416050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe960003b80 0x7fe960003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe973400640 1 -- 172.21.15.37:0/2585416050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe960003b80 msgr2=0x7fe960003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:38.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe973400640 1 --2- 172.21.15.37:0/2585416050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe960003b80 0x7fe960003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe973400640 1 -- 172.21.15.37:0/2585416050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9600051d0 msgr2=0x7fe96000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe973400640 1 --2- 172.21.15.37:0/2585416050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9600051d0 0x7fe96000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe973400640 1 -- 172.21.15.37:0/2585416050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe960003530 con 0x7fe960004810 2024-05-30T06:50:38.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.317+0000 7fe981200640 1 --2- 172.21.15.37:0/2585416050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9600051d0 0x7fe96000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.321+0000 7fe973400640 1 --2- 172.21.15.37:0/2585416050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe960004810 0x7fe960004c90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe96400a730 tx=0x7fe96401d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16aa320ba4ceb2b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.321+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96400a350 con 0x7fe960004810 2024-05-30T06:50:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.321+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9640a9020 con 0x7fe960004810 2024-05-30T06:50:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.321+0000 7fe97b400640 1 -- 172.21.15.37:0/2585416050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9640070d0 con 0x7fe960004810 2024-05-30T06:50:38.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.321+0000 7fe983200640 1 -- 172.21.15.37:0/2585416050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe960004810 msgr2=0x7fe960004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.321+0000 7fe983200640 1 --2- 172.21.15.37:0/2585416050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe960004810 0x7fe960004c90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe96400a730 tx=0x7fe96401d220 comp rx=0 tx=0).stop 2024-05-30T06:50:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.321+0000 7fe981200640 1 -- 172.21.15.37:0/2585416050 reap_dead start 2024-05-30T06:50:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.321+0000 7fe983200640 1 -- 172.21.15.37:0/2585416050 shutdown_connections 2024-05-30T06:50:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.321+0000 7fe983200640 1 -- 172.21.15.37:0/2585416050 >> 172.21.15.37:0/2585416050 conn(0x7fe97c0b2ac0 msgr2=0x7fe97c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.321+0000 7fe983200640 1 -- 172.21.15.37:0/2585416050 shutdown_connections 2024-05-30T06:50:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.321+0000 7fe983200640 1 -- 172.21.15.37:0/2585416050 wait complete. 2024-05-30T06:50:38.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe983200640 1 Processor -- start 2024-05-30T06:50:38.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe983200640 1 -- start start 2024-05-30T06:50:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe983200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe960004810 0x7fe97c154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe983200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe97c168090 0x7fe97c168510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe983200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c15faa0 0x7fe97c15ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe983200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c06cda0 con 0x7fe97c15faa0 2024-05-30T06:50:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe983200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c06cc20 con 0x7fe960004810 2024-05-30T06:50:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe983200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe97c06cf20 con 0x7fe97c168090 2024-05-30T06:50:38.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe981200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c15faa0 0x7fe97c15ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe981200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c15faa0 0x7fe97c15ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43918/0 (socket says 172.21.15.37:43918) 2024-05-30T06:50:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe981200640 1 -- 172.21.15.37:0/1911229583 learned_addr learned my addr 172.21.15.37:0/1911229583 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe97be00640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe960004810 0x7fe97c154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe973400640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe97c168090 0x7fe97c168510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe981200640 1 -- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe97c168090 msgr2=0x7fe97c168510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe981200640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe97c168090 0x7fe97c168510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe981200640 1 -- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe960004810 msgr2=0x7fe97c154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe981200640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe960004810 0x7fe97c154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe981200640 1 -- 172.21.15.37:0/1911229583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c0b2840 con 0x7fe97c15faa0 2024-05-30T06:50:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe981200640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c15faa0 0x7fe97c15ff30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0b09c0 tx=0x7fe974011990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe978c00640 1 -- 172.21.15.37:0/1911229583 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974004440 con 0x7fe97c15faa0 2024-05-30T06:50:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe978c00640 1 -- 172.21.15.37:0/1911229583 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97401b070 con 0x7fe97c15faa0 2024-05-30T06:50:38.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe978c00640 1 -- 172.21.15.37:0/1911229583 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974003860 con 0x7fe97c15faa0 2024-05-30T06:50:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe983200640 1 -- 172.21.15.37:0/1911229583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97c0b4690 con 0x7fe97c15faa0 2024-05-30T06:50:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.325+0000 7fe983200640 1 -- 172.21.15.37:0/1911229583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97c0b4c50 con 0x7fe97c15faa0 2024-05-30T06:50:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.329+0000 7fe983200640 1 -- 172.21.15.37:0/1911229583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe97c068bc0 con 0x7fe97c15faa0 2024-05-30T06:50:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.329+0000 7fe978c00640 1 -- 172.21.15.37:0/1911229583 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fe974003a00 con 0x7fe97c15faa0 2024-05-30T06:50:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.329+0000 7fe978c00640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe958069100 0x7fe95806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.329+0000 7fe978c00640 1 -- 172.21.15.37:0/1911229583 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7fe974085be0 con 0x7fe97c15faa0 2024-05-30T06:50:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.329+0000 7fe97be00640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe958069100 0x7fe95806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:38.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.329+0000 7fe97be00640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe958069100 0x7fe95806b5c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0d09a0 tx=0x7fe96c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.333+0000 7fe978c00640 1 -- 172.21.15.37:0/1911229583 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe974057880 con 0x7fe97c15faa0 2024-05-30T06:50:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:38.533+0000 7fe983200640 1 -- 172.21.15.37:0/1911229583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe97c067d90 con 0x7fe97c15faa0 2024-05-30T06:50:39.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.141+0000 7fe978c00640 1 -- 172.21.15.37:0/1911229583 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7fe974057180 con 0x7fe97c15faa0 2024-05-30T06:50:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.141+0000 7fe983200640 1 -- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe958069100 msgr2=0x7fe95806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.141+0000 7fe983200640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe958069100 0x7fe95806b5c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0d09a0 tx=0x7fe96c009040 comp rx=0 tx=0).stop 2024-05-30T06:50:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.141+0000 7fe983200640 1 -- 172.21.15.37:0/1911229583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c15faa0 msgr2=0x7fe97c15ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.141+0000 7fe983200640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c15faa0 0x7fe97c15ff30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0b09c0 tx=0x7fe974011990 comp rx=0 tx=0).stop 2024-05-30T06:50:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.145+0000 7fe983200640 1 -- 172.21.15.37:0/1911229583 shutdown_connections 2024-05-30T06:50:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.145+0000 7fe983200640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c15faa0 0x7fe97c15ff30 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.145+0000 7fe983200640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe97c168090 0x7fe97c168510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.145+0000 7fe983200640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe958069100 0x7fe95806b5c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.145+0000 7fe983200640 1 --2- 172.21.15.37:0/1911229583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe960004810 0x7fe97c154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.145+0000 7fe983200640 1 -- 172.21.15.37:0/1911229583 >> 172.21.15.37:0/1911229583 conn(0x7fe97c0b2ac0 msgr2=0x7fe97c0b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:39.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.145+0000 7fe983200640 1 -- 172.21.15.37:0/1911229583 shutdown_connections 2024-05-30T06:50:39.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.145+0000 7fe983200640 1 -- 172.21.15.37:0/1911229583 wait complete. 2024-05-30T06:50:39.169 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T06:50:39.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:50:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.313+0000 7f5df9a00640 1 Processor -- start 2024-05-30T06:50:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.313+0000 7f5df9a00640 1 -- start start 2024-05-30T06:50:39.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.317+0000 7f5df9a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5df415cd80 0x7f5df406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:39.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.317+0000 7f5df9a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df40cd120 con 0x7f5df40ce8d0 2024-05-30T06:50:39.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.317+0000 7f5df9a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df40cd400 con 0x7f5df406e000 2024-05-30T06:50:39.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.317+0000 7f5df9a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5df40a9530 con 0x7f5df415cd80 2024-05-30T06:50:39.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.317+0000 7f5df3400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5df40ce8d0 0x7f5df41663c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59634/0 (socket says 172.21.15.37:59634) 2024-05-30T06:50:39.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.317+0000 7f5df3400640 1 -- 172.21.15.37:0/592295699 learned_addr learned my addr 172.21.15.37:0/592295699 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.317+0000 7f5dea000640 1 --2- 172.21.15.37:0/592295699 >> v2:172.21.15.105:3300/0 conn(0x7f5df415cd80 0x7f5df406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.317+0000 7f5df2000640 1 -- 172.21.15.37:0/592295699 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1487711377 0 0) 0x7f5df40cd120 con 0x7f5df40ce8d0 2024-05-30T06:50:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.317+0000 7f5df2000640 1 -- 172.21.15.37:0/592295699 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dd8003530 con 0x7f5df40ce8d0 2024-05-30T06:50:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.317+0000 7f5dea000640 1 -- 172.21.15.37:0/592295699 >> v1:172.21.15.105:6789/0 conn(0x7f5df406e000 legacy=0x7f5df40ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.317+0000 7f5dea000640 1 -- 172.21.15.37:0/592295699 >> v1:172.21.15.37:6789/0 conn(0x7f5df40ce8d0 legacy=0x7f5df41663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.317+0000 7f5dea000640 1 -- 172.21.15.37:0/592295699 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df40cd6e0 con 0x7f5df415cd80 2024-05-30T06:50:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5dea000640 1 --2- 172.21.15.37:0/592295699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5df415cd80 0x7f5df406f3f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0097c0 tx=0x7f5ddc01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caa980e551f7d190 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df2000640 1 -- 172.21.15.37:0/592295699 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0b5070 con 0x7f5df415cd80 2024-05-30T06:50:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df2000640 1 -- 172.21.15.37:0/592295699 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ddc0a8990 con 0x7f5df415cd80 2024-05-30T06:50:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df2000640 1 -- 172.21.15.37:0/592295699 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0a8d40 con 0x7f5df415cd80 2024-05-30T06:50:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 -- 172.21.15.37:0/592295699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5df415cd80 msgr2=0x7f5df406f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 --2- 172.21.15.37:0/592295699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5df415cd80 0x7f5df406f3f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0097c0 tx=0x7f5ddc01ec90 comp rx=0 tx=0).stop 2024-05-30T06:50:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 -- 172.21.15.37:0/592295699 shutdown_connections 2024-05-30T06:50:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 --2- 172.21.15.37:0/592295699 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5df415cd80 0x7f5df406f3f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 -- 172.21.15.37:0/592295699 >> 172.21.15.37:0/592295699 conn(0x7f5df40b23a0 msgr2=0x7f5df40b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 -- 172.21.15.37:0/592295699 shutdown_connections 2024-05-30T06:50:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 -- 172.21.15.37:0/592295699 wait complete. 2024-05-30T06:50:39.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 Processor -- start 2024-05-30T06:50:39.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 -- start start 2024-05-30T06:50:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df406e000 0x7f5df413eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5df40ce8d0 0x7f5df413b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5df415cd80 0x7f5df415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5df406f930 con 0x7f5df406e000 2024-05-30T06:50:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5df40cdca0 con 0x7f5df40ce8d0 2024-05-30T06:50:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.321+0000 7f5df9a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5df406fab0 con 0x7f5df415cd80 2024-05-30T06:50:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5df2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df406e000 0x7f5df413eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5df2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df406e000 0x7f5df413eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43926/0 (socket says 172.21.15.37:43926) 2024-05-30T06:50:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5df2a00640 1 -- 172.21.15.37:0/2552048454 learned_addr learned my addr 172.21.15.37:0/2552048454 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5df3400640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5df415cd80 0x7f5df415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5dea000640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5df40ce8d0 0x7f5df413b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5df2a00640 1 -- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5df415cd80 msgr2=0x7f5df415aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5df2a00640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5df415cd80 0x7f5df415aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5df2a00640 1 -- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5df40ce8d0 msgr2=0x7f5df413b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5df2a00640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5df40ce8d0 0x7f5df413b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5df2a00640 1 -- 172.21.15.37:0/2552048454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df40adb70 con 0x7f5df406e000 2024-05-30T06:50:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5df2a00640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df406e000 0x7f5df413eaf0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5de400c370 tx=0x7f5de400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5deb400640 1 -- 172.21.15.37:0/2552048454 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de40052d0 con 0x7f5df406e000 2024-05-30T06:50:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5deb400640 1 -- 172.21.15.37:0/2552048454 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de4005470 con 0x7f5df406e000 2024-05-30T06:50:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5deb400640 1 -- 172.21.15.37:0/2552048454 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4007260 con 0x7f5df406e000 2024-05-30T06:50:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5df9a00640 1 -- 172.21.15.37:0/2552048454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df40ade50 con 0x7f5df406e000 2024-05-30T06:50:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5df9a00640 1 -- 172.21.15.37:0/2552048454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df40ae410 con 0x7f5df406e000 2024-05-30T06:50:39.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5df9a00640 1 -- 172.21.15.37:0/2552048454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df4068b20 con 0x7f5df406e000 2024-05-30T06:50:39.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5deb400640 1 -- 172.21.15.37:0/2552048454 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f5de4007400 con 0x7f5df406e000 2024-05-30T06:50:39.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.325+0000 7f5deb400640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dd0069100 0x7f5dd006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:39.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.329+0000 7f5deb400640 1 -- 172.21.15.37:0/2552048454 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f5de4084b10 con 0x7f5df406e000 2024-05-30T06:50:39.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.329+0000 7f5dea000640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dd0069100 0x7f5dd006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:39.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.329+0000 7f5dea000640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dd0069100 0x7f5dd006b5c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0b2000 tx=0x7f5ddc0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:39.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.333+0000 7f5deb400640 1 -- 172.21.15.37:0/2552048454 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5de40568d0 con 0x7f5df406e000 2024-05-30T06:50:39.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.529+0000 7f5df9a00640 1 -- 172.21.15.37:0/2552048454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5df4143fd0 con 0x7f5df406e000 2024-05-30T06:50:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.533+0000 7f5deb400640 1 -- 172.21.15.37:0/2552048454 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5186 (secure 0 0 0) 0x7f5de40561d0 con 0x7f5df406e000 2024-05-30T06:50:39.533 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:39.533 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6086,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/855324379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":855324379},{"type":"v1","addr":"172.21.15.105:6836","nonce":855324379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6089,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3353563250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3353563250},{"type":"v1","addr":"172.21.15.105:6837","nonce":3353563250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6933,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1946331427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1946331427},{"type":"v1","addr":"172.21.15.37:6834","nonce":1946331427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:50:35.512352+0000","modified":"2024-05-30T06:50:38.536531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3396138806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3396138806},{"type":"v1","addr":"172.21.15.37:6835","nonce":3396138806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6939,"qdb_cluster":[6939]},"id":5}]} 2024-05-30T06:50:39.533 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 46 2024-05-30T06:50:39.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.533+0000 7f5df9a00640 1 -- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dd0069100 msgr2=0x7f5dd006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.533+0000 7f5df9a00640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dd0069100 0x7f5dd006b5c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0b2000 tx=0x7f5ddc0aa070 comp rx=0 tx=0).stop 2024-05-30T06:50:39.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.533+0000 7f5df9a00640 1 -- 172.21.15.37:0/2552048454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df406e000 msgr2=0x7f5df413eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.533+0000 7f5df9a00640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df406e000 0x7f5df413eaf0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f5de400c370 tx=0x7f5de400c830 comp rx=0 tx=0).stop 2024-05-30T06:50:39.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.533+0000 7f5df9a00640 1 -- 172.21.15.37:0/2552048454 shutdown_connections 2024-05-30T06:50:39.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.533+0000 7f5df9a00640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5df415cd80 0x7f5df415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.533+0000 7f5df9a00640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dd0069100 0x7f5dd006b5c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.533+0000 7f5df9a00640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5df40ce8d0 0x7f5df413b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.533+0000 7f5df9a00640 1 --2- 172.21.15.37:0/2552048454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5df406e000 0x7f5df413eaf0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.533+0000 7f5df9a00640 1 -- 172.21.15.37:0/2552048454 >> 172.21.15.37:0/2552048454 conn(0x7f5df40b23a0 msgr2=0x7f5df4144ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:39.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.533+0000 7f5df9a00640 1 -- 172.21.15.37:0/2552048454 shutdown_connections 2024-05-30T06:50:39.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.533+0000 7f5df9a00640 1 -- 172.21.15.37:0/2552048454 wait complete. 2024-05-30T06:50:39.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:50:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.693+0000 7f0e35800640 1 Processor -- start 2024-05-30T06:50:39.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.693+0000 7f0e35800640 1 -- start start 2024-05-30T06:50:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.697+0000 7f0e35800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e300b2ec0 0x7f0e300b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.697+0000 7f0e35800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e3015c8f0 con 0x7f0e30155e60 2024-05-30T06:50:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.697+0000 7f0e35800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e300ccc80 con 0x7f0e3006f9a0 2024-05-30T06:50:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.697+0000 7f0e35800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0e300ccff0 con 0x7f0e300b2ec0 2024-05-30T06:50:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.697+0000 7f0e2ea00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0e30155e60 0x7f0e300cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59644/0 (socket says 172.21.15.37:59644) 2024-05-30T06:50:39.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.697+0000 7f0e2ea00640 1 -- 172.21.15.37:0/1127239519 learned_addr learned my addr 172.21.15.37:0/1127239519 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.697+0000 7f0e2f400640 1 --2- 172.21.15.37:0/1127239519 >> v2:172.21.15.37:3300/0 conn(0x7f0e300b2ec0 0x7f0e300b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.697+0000 7f0e2e000640 1 -- 172.21.15.37:0/1127239519 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 73866371 0 0) 0x7f0e3015c8f0 con 0x7f0e30155e60 2024-05-30T06:50:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.697+0000 7f0e2e000640 1 -- 172.21.15.37:0/1127239519 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e14003530 con 0x7f0e30155e60 2024-05-30T06:50:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.697+0000 7f0e2f400640 1 -- 172.21.15.37:0/1127239519 >> v1:172.21.15.105:6789/0 conn(0x7f0e3006f9a0 legacy=0x7f0e300cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.697+0000 7f0e2f400640 1 -- 172.21.15.37:0/1127239519 >> v1:172.21.15.37:6789/0 conn(0x7f0e30155e60 legacy=0x7f0e300cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.697+0000 7f0e2f400640 1 -- 172.21.15.37:0/1127239519 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3015cbd0 con 0x7f0e300b2ec0 2024-05-30T06:50:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.701+0000 7f0e2f400640 1 --2- 172.21.15.37:0/1127239519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2ec0 0x7f0e300b36a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009d90 tx=0x7f0e2801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4206611e59ca4a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.701+0000 7f0e2e000640 1 -- 172.21.15.37:0/1127239519 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280b2070 con 0x7f0e300b2ec0 2024-05-30T06:50:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.701+0000 7f0e2e000640 1 -- 172.21.15.37:0/1127239519 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e280a58c0 con 0x7f0e300b2ec0 2024-05-30T06:50:39.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.701+0000 7f0e2e000640 1 -- 172.21.15.37:0/1127239519 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e280a5c90 con 0x7f0e300b2ec0 2024-05-30T06:50:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.701+0000 7f0e35800640 1 -- 172.21.15.37:0/1127239519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2ec0 msgr2=0x7f0e300b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.701+0000 7f0e35800640 1 --2- 172.21.15.37:0/1127239519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2ec0 0x7f0e300b36a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009d90 tx=0x7f0e2801c930 comp rx=0 tx=0).stop 2024-05-30T06:50:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.701+0000 7f0e35800640 1 -- 172.21.15.37:0/1127239519 shutdown_connections 2024-05-30T06:50:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.701+0000 7f0e35800640 1 --2- 172.21.15.37:0/1127239519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2ec0 0x7f0e300b36a0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.701+0000 7f0e35800640 1 -- 172.21.15.37:0/1127239519 >> 172.21.15.37:0/1127239519 conn(0x7f0e300b23a0 msgr2=0x7f0e300b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.701+0000 7f0e35800640 1 -- 172.21.15.37:0/1127239519 shutdown_connections 2024-05-30T06:50:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.701+0000 7f0e35800640 1 -- 172.21.15.37:0/1127239519 wait complete. 2024-05-30T06:50:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.701+0000 7f0e35800640 1 Processor -- start 2024-05-30T06:50:39.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.701+0000 7f0e35800640 1 -- start start 2024-05-30T06:50:39.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e35800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3006f9a0 0x7f0e3013eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:39.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e35800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2ec0 0x7f0e3013f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:39.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e35800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e30155e60 0x7f0e30156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:39.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e35800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0e30169a00 con 0x7f0e300b2ec0 2024-05-30T06:50:39.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e35800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e30169880 con 0x7f0e3006f9a0 2024-05-30T06:50:39.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e35800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e30169b80 con 0x7f0e30155e60 2024-05-30T06:50:39.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e27e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2ec0 0x7f0e3013f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:39.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e27e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2ec0 0x7f0e3013f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43940/0 (socket says 172.21.15.37:43940) 2024-05-30T06:50:39.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e27e00640 1 -- 172.21.15.37:0/1384154789 learned_addr learned my addr 172.21.15.37:0/1384154789 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:39.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e2ea00640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3006f9a0 0x7f0e3013eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e2f400640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e30155e60 0x7f0e30156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e27e00640 1 -- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e30155e60 msgr2=0x7f0e30156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e27e00640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e30155e60 0x7f0e30156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e27e00640 1 -- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3006f9a0 msgr2=0x7f0e3013eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e27e00640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3006f9a0 0x7f0e3013eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e27e00640 1 -- 172.21.15.37:0/1384154789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3013f3f0 con 0x7f0e300b2ec0 2024-05-30T06:50:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e2ea00640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3006f9a0 0x7f0e3013eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e2f400640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e30155e60 0x7f0e30156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:39.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e27e00640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2ec0 0x7f0e3013f6e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800c480 tx=0x7f0e1800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e26a00640 1 -- 172.21.15.37:0/1384154789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18012830 con 0x7f0e300b2ec0 2024-05-30T06:50:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e26a00640 1 -- 172.21.15.37:0/1384154789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e18017070 con 0x7f0e300b2ec0 2024-05-30T06:50:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e35800640 1 -- 172.21.15.37:0/1384154789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e300b0400 con 0x7f0e300b2ec0 2024-05-30T06:50:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e26a00640 1 -- 172.21.15.37:0/1384154789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18012c30 con 0x7f0e300b2ec0 2024-05-30T06:50:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e35800640 1 -- 172.21.15.37:0/1384154789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e300b09c0 con 0x7f0e300b2ec0 2024-05-30T06:50:39.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e35800640 1 -- 172.21.15.37:0/1384154789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e30068b20 con 0x7f0e300b2ec0 2024-05-30T06:50:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.705+0000 7f0e26a00640 1 -- 172.21.15.37:0/1384154789 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f0e1801c460 con 0x7f0e300b2ec0 2024-05-30T06:50:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.709+0000 7f0e26a00640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c069100 0x7f0e0c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.709+0000 7f0e26a00640 1 -- 172.21.15.37:0/1384154789 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f0e180854d0 con 0x7f0e300b2ec0 2024-05-30T06:50:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.709+0000 7f0e2ea00640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c069100 0x7f0e0c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:39.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.709+0000 7f0e2ea00640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c069100 0x7f0e0c06b5c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0e20005890 tx=0x7f0e20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:39.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.713+0000 7f0e26a00640 1 -- 172.21.15.37:0/1384154789 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e18057230 con 0x7f0e300b2ec0 2024-05-30T06:50:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.877+0000 7f0e35800640 1 -- 172.21.15.37:0/1384154789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e30159270 con 0x7f0e300b2ec0 2024-05-30T06:50:39.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.877+0000 7f0e26a00640 1 -- 172.21.15.37:0/1384154789 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+16699 (secure 0 0 0) 0x7f0e18056b30 con 0x7f0e300b2ec0 2024-05-30T06:50:39.879 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:39.879 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":73,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:50:37.125302+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:50:33.347094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T06:50:34.475297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:50:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.881+0000 7f0e35800640 1 -- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c069100 msgr2=0x7f0e0c06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.881+0000 7f0e35800640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c069100 0x7f0e0c06b5c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0e20005890 tx=0x7f0e20009040 comp rx=0 tx=0).stop 2024-05-30T06:50:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.881+0000 7f0e35800640 1 -- 172.21.15.37:0/1384154789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2ec0 msgr2=0x7f0e3013f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.881+0000 7f0e35800640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2ec0 0x7f0e3013f6e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800c480 tx=0x7f0e1800c940 comp rx=0 tx=0).stop 2024-05-30T06:50:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.881+0000 7f0e35800640 1 -- 172.21.15.37:0/1384154789 shutdown_connections 2024-05-30T06:50:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.881+0000 7f0e35800640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e30155e60 0x7f0e30156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.881+0000 7f0e35800640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e300b2ec0 0x7f0e3013f6e0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.881+0000 7f0e35800640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0e0c069100 0x7f0e0c06b5c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.881+0000 7f0e35800640 1 --2- 172.21.15.37:0/1384154789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e3006f9a0 0x7f0e3013eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.881+0000 7f0e35800640 1 -- 172.21.15.37:0/1384154789 >> 172.21.15.37:0/1384154789 conn(0x7f0e300b23a0 msgr2=0x7f0e30154ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.881+0000 7f0e35800640 1 -- 172.21.15.37:0/1384154789 shutdown_connections 2024-05-30T06:50:39.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:39.881+0000 7f0e35800640 1 -- 172.21.15.37:0/1384154789 wait complete. 2024-05-30T06:50:39.902 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-30T06:50:39.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:50:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.041+0000 7f0571400640 1 Processor -- start 2024-05-30T06:50:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.041+0000 7f0571400640 1 -- start start 2024-05-30T06:50:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.041+0000 7f0571400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f056c0b2ec0 0x7f056c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.041+0000 7f0571400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f056c15c8f0 con 0x7f056c06f9a0 2024-05-30T06:50:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.041+0000 7f0571400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f056c0ccc80 con 0x7f056c155e60 2024-05-30T06:50:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.041+0000 7f0571400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f056c0ccff0 con 0x7f056c0b2ec0 2024-05-30T06:50:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.041+0000 7f0561e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f056c06f9a0 0x7f056c0cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59652/0 (socket says 172.21.15.37:59652) 2024-05-30T06:50:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.041+0000 7f0561e00640 1 -- 172.21.15.37:0/4082380956 learned_addr learned my addr 172.21.15.37:0/4082380956 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.041+0000 7f056b200640 1 --2- 172.21.15.37:0/4082380956 >> v2:172.21.15.105:3300/0 conn(0x7f056c0b2ec0 0x7f056c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.041+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073691815 0 0) 0x7f056c15c8f0 con 0x7f056c06f9a0 2024-05-30T06:50:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.041+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0550005740 con 0x7f056c06f9a0 2024-05-30T06:50:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1540080089 0 0) 0x7f0550005740 con 0x7f056c06f9a0 2024-05-30T06:50:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 >> v2:172.21.15.105:3300/0 conn(0x7f056c0b2ec0 msgr2=0x7f056c0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 --2- 172.21.15.37:0/4082380956 >> v2:172.21.15.105:3300/0 conn(0x7f056c0b2ec0 0x7f056c0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 >> v1:172.21.15.105:6789/0 conn(0x7f056c155e60 legacy=0x7f056c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056c15cbd0 con 0x7f056c06f9a0 2024-05-30T06:50:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f0554001680 con 0x7f056c06f9a0 2024-05-30T06:50:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 >> v1:172.21.15.37:6789/0 conn(0x7f056c06f9a0 legacy=0x7f056c0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 --2- 172.21.15.37:0/4082380956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0550005bd0 0x7f0550005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 --2- 172.21.15.37:0/4082380956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0550006a20 0x7f0550006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 --2- 172.21.15.37:0/4082380956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05500073e0 0x7f055000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f056c0ccff0 con 0x7f0550005bd0 2024-05-30T06:50:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f055000e280 con 0x7f0550006a20 2024-05-30T06:50:40.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f055000e480 con 0x7f05500073e0 2024-05-30T06:50:40.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f056a800640 1 --2- 172.21.15.37:0/4082380956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0550005bd0 0x7f0550005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0561e00640 1 --2- 172.21.15.37:0/4082380956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0550006a20 0x7f0550006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f056b200640 1 --2- 172.21.15.37:0/4082380956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05500073e0 0x7f055000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f056a800640 1 -- 172.21.15.37:0/4082380956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05500073e0 msgr2=0x7f055000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:40.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f056a800640 1 --2- 172.21.15.37:0/4082380956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05500073e0 0x7f055000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f056a800640 1 -- 172.21.15.37:0/4082380956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0550006a20 msgr2=0x7f0550006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:40.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f056a800640 1 --2- 172.21.15.37:0/4082380956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0550006a20 0x7f0550006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f056a800640 1 -- 172.21.15.37:0/4082380956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0550005740 con 0x7f0550005bd0 2024-05-30T06:50:40.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0561e00640 1 --2- 172.21.15.37:0/4082380956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0550006a20 0x7f0550006ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:40.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f056b200640 1 -- 172.21.15.37:0/4082380956 reap_dead start 2024-05-30T06:50:40.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f056a800640 1 --2- 172.21.15.37:0/4082380956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0550005bd0 0x7f0550005ff0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f055c001780 tx=0x7f055c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a35c2b3962d8584 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:40.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.045+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c0013a0 con 0x7f0550005bd0 2024-05-30T06:50:40.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f055c0052f0 con 0x7f0550005bd0 2024-05-30T06:50:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0569e00640 1 -- 172.21.15.37:0/4082380956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c003840 con 0x7f0550005bd0 2024-05-30T06:50:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 -- 172.21.15.37:0/4082380956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0550005bd0 msgr2=0x7f0550005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 --2- 172.21.15.37:0/4082380956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0550005bd0 0x7f0550005ff0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f055c001780 tx=0x7f055c01c420 comp rx=0 tx=0).stop 2024-05-30T06:50:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 -- 172.21.15.37:0/4082380956 shutdown_connections 2024-05-30T06:50:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 --2- 172.21.15.37:0/4082380956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0550005bd0 0x7f0550005ff0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 -- 172.21.15.37:0/4082380956 >> 172.21.15.37:0/4082380956 conn(0x7f056c0b23a0 msgr2=0x7f056c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:40.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 -- 172.21.15.37:0/4082380956 shutdown_connections 2024-05-30T06:50:40.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 -- 172.21.15.37:0/4082380956 wait complete. 2024-05-30T06:50:40.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 Processor -- start 2024-05-30T06:50:40.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 -- start start 2024-05-30T06:50:40.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0550005bd0 0x7f056c149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f056c150790 0x7f056c1f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f056c1f3b20 0x7f056c1f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f056c0cff20 con 0x7f0550005bd0 2024-05-30T06:50:40.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f056c0cfda0 con 0x7f056c1f3b20 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0571400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f056c0d00a0 con 0x7f056c150790 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f056a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0550005bd0 0x7f056c149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f056a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0550005bd0 0x7f056c149ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43948/0 (socket says 172.21.15.37:43948) 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f056a800640 1 -- 172.21.15.37:0/3203106315 learned_addr learned my addr 172.21.15.37:0/3203106315 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f0561e00640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f056c150790 0x7f056c1f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.049+0000 7f056b200640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f056c1f3b20 0x7f056c1f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f056a800640 1 -- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f056c150790 msgr2=0x7f056c1f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f056a800640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f056c150790 0x7f056c1f35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f056a800640 1 -- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f056c1f3b20 msgr2=0x7f056c1f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f056a800640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f056c1f3b20 0x7f056c1f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f056a800640 1 -- 172.21.15.37:0/3203106315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056c14a530 con 0x7f0550005bd0 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f056b200640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f056c1f3b20 0x7f056c1f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f0561e00640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f056c150790 0x7f056c1f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:40.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f056a800640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0550005bd0 0x7f056c149ff0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f055c01c250 tx=0x7f0550007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:40.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f0563400640 1 -- 172.21.15.37:0/3203106315 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c0b8070 con 0x7f0550005bd0 2024-05-30T06:50:40.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f0563400640 1 -- 172.21.15.37:0/3203106315 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f055c0054a0 con 0x7f0550005bd0 2024-05-30T06:50:40.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f0563400640 1 -- 172.21.15.37:0/3203106315 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c0013a0 con 0x7f0550005bd0 2024-05-30T06:50:40.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f0571400640 1 -- 172.21.15.37:0/3203106315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056c1f3fa0 con 0x7f0550005bd0 2024-05-30T06:50:40.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f0571400640 1 -- 172.21.15.37:0/3203106315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f056c158ca0 con 0x7f0550005bd0 2024-05-30T06:50:40.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f0571400640 1 -- 172.21.15.37:0/3203106315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f056c068b20 con 0x7f0550005bd0 2024-05-30T06:50:40.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f0563400640 1 -- 172.21.15.37:0/3203106315 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f055c007470 con 0x7f0550005bd0 2024-05-30T06:50:40.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f0563400640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0548069180 0x7f054806b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.053+0000 7f0563400640 1 -- 172.21.15.37:0/3203106315 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f055c11f8a0 con 0x7f0550005bd0 2024-05-30T06:50:40.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.057+0000 7f0561e00640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0548069180 0x7f054806b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.057+0000 7f0561e00640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0548069180 0x7f054806b640 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f056c154fc0 tx=0x7f0554009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:40.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.057+0000 7f0563400640 1 -- 172.21.15.37:0/3203106315 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f056c1f3fa0 con 0x7f0550005bd0 2024-05-30T06:50:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.225+0000 7f0571400640 1 -- 172.21.15.37:0/3203106315 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f056c154440 con 0x7f0548069180 2024-05-30T06:50:40.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.233+0000 7f0563400640 1 -- 172.21.15.37:0/3203106315 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242251 (secure 0 0 0) 0x7f056c154440 con 0x7f0548069180 2024-05-30T06:50:40.236 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:40.238 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:50:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.237+0000 7f0571400640 1 -- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0548069180 msgr2=0x7f054806b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.237+0000 7f0571400640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0548069180 0x7f054806b640 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f056c154fc0 tx=0x7f0554009040 comp rx=0 tx=0).stop 2024-05-30T06:50:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.237+0000 7f0571400640 1 -- 172.21.15.37:0/3203106315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0550005bd0 msgr2=0x7f056c149ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.237+0000 7f0571400640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0550005bd0 0x7f056c149ff0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f055c01c250 tx=0x7f0550007a50 comp rx=0 tx=0).stop 2024-05-30T06:50:40.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.237+0000 7f0571400640 1 -- 172.21.15.37:0/3203106315 shutdown_connections 2024-05-30T06:50:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.237+0000 7f0571400640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0548069180 0x7f054806b640 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.237+0000 7f0571400640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f056c1f3b20 0x7f056c1f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.237+0000 7f0571400640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f056c150790 0x7f056c1f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.237+0000 7f0571400640 1 --2- 172.21.15.37:0/3203106315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0550005bd0 0x7f056c149ff0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.237+0000 7f0571400640 1 -- 172.21.15.37:0/3203106315 >> 172.21.15.37:0/3203106315 conn(0x7f056c0b23a0 msgr2=0x7f056c0b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.237+0000 7f0571400640 1 -- 172.21.15.37:0/3203106315 shutdown_connections 2024-05-30T06:50:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.237+0000 7f0571400640 1 -- 172.21.15.37:0/3203106315 wait complete. 2024-05-30T06:50:40.256 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-05-30T06:50:38.790575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":435020,"kb_used_data":7884,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754539700,"statfs":{"total":773094113280,"available":772648652800,"internally_reserved":0,"allocated":8073216,"data_stored":4092417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":437243440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.691295"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190991+0000","last_change":"2024-05-30T06:50:36.135494+0000","last_active":"2024-05-30T06:50:37.190991+0000","last_peered":"2024-05-30T06:50:37.190991+0000","last_clean":"2024-05-30T06:50:37.190991+0000","last_became_active":"2024-05-30T06:50:36.135105+0000","last_became_peered":"2024-05-30T06:50:36.135105+0000","last_unstale":"2024-05-30T06:50:37.190991+0000","last_undegraded":"2024-05-30T06:50:37.190991+0000","last_fullsized":"2024-05-30T06:50:37.190991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:16.744233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190492+0000","last_change":"2024-05-30T06:50:36.132795+0000","last_active":"2024-05-30T06:50:37.190492+0000","last_peered":"2024-05-30T06:50:37.190492+0000","last_clean":"2024-05-30T06:50:37.190492+0000","last_became_active":"2024-05-30T06:50:36.132512+0000","last_became_peered":"2024-05-30T06:50:36.132512+0000","last_unstale":"2024-05-30T06:50:37.190492+0000","last_undegraded":"2024-05-30T06:50:37.190492+0000","last_fullsized":"2024-05-30T06:50:37.190492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:34:49.401832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191645+0000","last_change":"2024-05-30T06:50:36.138009+0000","last_active":"2024-05-30T06:50:37.191645+0000","last_peered":"2024-05-30T06:50:37.191645+0000","last_clean":"2024-05-30T06:50:37.191645+0000","last_became_active":"2024-05-30T06:50:36.137224+0000","last_became_peered":"2024-05-30T06:50:36.137224+0000","last_unstale":"2024-05-30T06:50:37.191645+0000","last_undegraded":"2024-05-30T06:50:37.191645+0000","last_fullsized":"2024-05-30T06:50:37.191645+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:31:20.436064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190100+0000","last_change":"2024-05-30T06:50:36.128090+0000","last_active":"2024-05-30T06:50:37.190100+0000","last_peered":"2024-05-30T06:50:37.190100+0000","last_clean":"2024-05-30T06:50:37.190100+0000","last_became_active":"2024-05-30T06:50:36.127805+0000","last_became_peered":"2024-05-30T06:50:36.127805+0000","last_unstale":"2024-05-30T06:50:37.190100+0000","last_undegraded":"2024-05-30T06:50:37.190100+0000","last_fullsized":"2024-05-30T06:50:37.190100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:40.263358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190952+0000","last_change":"2024-05-30T06:50:36.128319+0000","last_active":"2024-05-30T06:50:37.190952+0000","last_peered":"2024-05-30T06:50:37.190952+0000","last_clean":"2024-05-30T06:50:37.190952+0000","last_became_active":"2024-05-30T06:50:36.127722+0000","last_became_peered":"2024-05-30T06:50:36.127722+0000","last_unstale":"2024-05-30T06:50:37.190952+0000","last_undegraded":"2024-05-30T06:50:37.190952+0000","last_fullsized":"2024-05-30T06:50:37.190952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:36:15.100211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189834+0000","last_change":"2024-05-30T06:50:36.130537+0000","last_active":"2024-05-30T06:50:37.189834+0000","last_peered":"2024-05-30T06:50:37.189834+0000","last_clean":"2024-05-30T06:50:37.189834+0000","last_became_active":"2024-05-30T06:50:36.130275+0000","last_became_peered":"2024-05-30T06:50:36.130275+0000","last_unstale":"2024-05-30T06:50:37.189834+0000","last_undegraded":"2024-05-30T06:50:37.189834+0000","last_fullsized":"2024-05-30T06:50:37.189834+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:23.879376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191805+0000","last_change":"2024-05-30T06:50:36.137706+0000","last_active":"2024-05-30T06:50:37.191805+0000","last_peered":"2024-05-30T06:50:37.191805+0000","last_clean":"2024-05-30T06:50:37.191805+0000","last_became_active":"2024-05-30T06:50:36.136870+0000","last_became_peered":"2024-05-30T06:50:36.136870+0000","last_unstale":"2024-05-30T06:50:37.191805+0000","last_undegraded":"2024-05-30T06:50:37.191805+0000","last_fullsized":"2024-05-30T06:50:37.191805+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:00:22.867977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190046+0000","last_change":"2024-05-30T06:50:36.124537+0000","last_active":"2024-05-30T06:50:37.190046+0000","last_peered":"2024-05-30T06:50:37.190046+0000","last_clean":"2024-05-30T06:50:37.190046+0000","last_became_active":"2024-05-30T06:50:36.124254+0000","last_became_peered":"2024-05-30T06:50:36.124254+0000","last_unstale":"2024-05-30T06:50:37.190046+0000","last_undegraded":"2024-05-30T06:50:37.190046+0000","last_fullsized":"2024-05-30T06:50:37.190046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:56.549987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191123+0000","last_change":"2024-05-30T06:50:36.142813+0000","last_active":"2024-05-30T06:50:37.191123+0000","last_peered":"2024-05-30T06:50:37.191123+0000","last_clean":"2024-05-30T06:50:37.191123+0000","last_became_active":"2024-05-30T06:50:36.141331+0000","last_became_peered":"2024-05-30T06:50:36.141331+0000","last_unstale":"2024-05-30T06:50:37.191123+0000","last_undegraded":"2024-05-30T06:50:37.191123+0000","last_fullsized":"2024-05-30T06:50:37.191123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:00:33.525966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190308+0000","last_change":"2024-05-30T06:50:36.137982+0000","last_active":"2024-05-30T06:50:37.190308+0000","last_peered":"2024-05-30T06:50:37.190308+0000","last_clean":"2024-05-30T06:50:37.190308+0000","last_became_active":"2024-05-30T06:50:36.137660+0000","last_became_peered":"2024-05-30T06:50:36.137660+0000","last_unstale":"2024-05-30T06:50:37.190308+0000","last_undegraded":"2024-05-30T06:50:37.190308+0000","last_fullsized":"2024-05-30T06:50:37.190308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:12:39.654448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191741+0000","last_change":"2024-05-30T06:50:36.137484+0000","last_active":"2024-05-30T06:50:37.191741+0000","last_peered":"2024-05-30T06:50:37.191741+0000","last_clean":"2024-05-30T06:50:37.191741+0000","last_became_active":"2024-05-30T06:50:36.136537+0000","last_became_peered":"2024-05-30T06:50:36.136537+0000","last_unstale":"2024-05-30T06:50:37.191741+0000","last_undegraded":"2024-05-30T06:50:37.191741+0000","last_fullsized":"2024-05-30T06:50:37.191741+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:49.864351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190761+0000","last_change":"2024-05-30T06:50:35.129396+0000","last_active":"2024-05-30T06:50:37.190761+0000","last_peered":"2024-05-30T06:50:37.190761+0000","last_clean":"2024-05-30T06:50:37.190761+0000","last_became_active":"2024-05-30T06:50:35.128968+0000","last_became_peered":"2024-05-30T06:50:35.128968+0000","last_unstale":"2024-05-30T06:50:37.190761+0000","last_undegraded":"2024-05-30T06:50:37.190761+0000","last_fullsized":"2024-05-30T06:50:37.190761+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:01.742927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190858+0000","last_change":"2024-05-30T06:50:35.131068+0000","last_active":"2024-05-30T06:50:37.190858+0000","last_peered":"2024-05-30T06:50:37.190858+0000","last_clean":"2024-05-30T06:50:37.190858+0000","last_became_active":"2024-05-30T06:50:35.130730+0000","last_became_peered":"2024-05-30T06:50:35.130730+0000","last_unstale":"2024-05-30T06:50:37.190858+0000","last_undegraded":"2024-05-30T06:50:37.190858+0000","last_fullsized":"2024-05-30T06:50:37.190858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:17:44.762161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190728+0000","last_change":"2024-05-30T06:50:36.127242+0000","last_active":"2024-05-30T06:50:37.190728+0000","last_peered":"2024-05-30T06:50:37.190728+0000","last_clean":"2024-05-30T06:50:37.190728+0000","last_became_active":"2024-05-30T06:50:36.126954+0000","last_became_peered":"2024-05-30T06:50:36.126954+0000","last_unstale":"2024-05-30T06:50:37.190728+0000","last_undegraded":"2024-05-30T06:50:37.190728+0000","last_fullsized":"2024-05-30T06:50:37.190728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:38:37.252400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190443+0000","last_change":"2024-05-30T06:50:36.137216+0000","last_active":"2024-05-30T06:50:37.190443+0000","last_peered":"2024-05-30T06:50:37.190443+0000","last_clean":"2024-05-30T06:50:37.190443+0000","last_became_active":"2024-05-30T06:50:36.136945+0000","last_became_peered":"2024-05-30T06:50:36.136945+0000","last_unstale":"2024-05-30T06:50:37.190443+0000","last_undegraded":"2024-05-30T06:50:37.190443+0000","last_fullsized":"2024-05-30T06:50:37.190443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:58.008213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190825+0000","last_change":"2024-05-30T06:50:35.119974+0000","last_active":"2024-05-30T06:50:37.190825+0000","last_peered":"2024-05-30T06:50:37.190825+0000","last_clean":"2024-05-30T06:50:37.190825+0000","last_became_active":"2024-05-30T06:50:35.119188+0000","last_became_peered":"2024-05-30T06:50:35.119188+0000","last_unstale":"2024-05-30T06:50:37.190825+0000","last_undegraded":"2024-05-30T06:50:37.190825+0000","last_fullsized":"2024-05-30T06:50:37.190825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:45:15.601089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191222+0000","last_change":"2024-05-30T06:50:35.126131+0000","last_active":"2024-05-30T06:50:37.191222+0000","last_peered":"2024-05-30T06:50:37.191222+0000","last_clean":"2024-05-30T06:50:37.191222+0000","last_became_active":"2024-05-30T06:50:35.125864+0000","last_became_peered":"2024-05-30T06:50:35.125864+0000","last_unstale":"2024-05-30T06:50:37.191222+0000","last_undegraded":"2024-05-30T06:50:37.191222+0000","last_fullsized":"2024-05-30T06:50:37.191222+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:04.103814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191224+0000","last_change":"2024-05-30T06:50:36.130870+0000","last_active":"2024-05-30T06:50:37.191224+0000","last_peered":"2024-05-30T06:50:37.191224+0000","last_clean":"2024-05-30T06:50:37.191224+0000","last_became_active":"2024-05-30T06:50:36.130296+0000","last_became_peered":"2024-05-30T06:50:36.130296+0000","last_unstale":"2024-05-30T06:50:37.191224+0000","last_undegraded":"2024-05-30T06:50:37.191224+0000","last_fullsized":"2024-05-30T06:50:37.191224+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:12:29.459735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189783+0000","last_change":"2024-05-30T06:50:36.128699+0000","last_active":"2024-05-30T06:50:37.189783+0000","last_peered":"2024-05-30T06:50:37.189783+0000","last_clean":"2024-05-30T06:50:37.189783+0000","last_became_active":"2024-05-30T06:50:36.128437+0000","last_became_peered":"2024-05-30T06:50:36.128437+0000","last_unstale":"2024-05-30T06:50:37.189783+0000","last_undegraded":"2024-05-30T06:50:37.189783+0000","last_fullsized":"2024-05-30T06:50:37.189783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:36:45.423083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190598+0000","last_change":"2024-05-30T06:50:36.131744+0000","last_active":"2024-05-30T06:50:37.190598+0000","last_peered":"2024-05-30T06:50:37.190598+0000","last_clean":"2024-05-30T06:50:37.190598+0000","last_became_active":"2024-05-30T06:50:36.131457+0000","last_became_peered":"2024-05-30T06:50:36.131457+0000","last_unstale":"2024-05-30T06:50:37.190598+0000","last_undegraded":"2024-05-30T06:50:37.190598+0000","last_fullsized":"2024-05-30T06:50:37.190598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:59:24.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191380+0000","last_change":"2024-05-30T06:50:36.131097+0000","last_active":"2024-05-30T06:50:37.191380+0000","last_peered":"2024-05-30T06:50:37.191380+0000","last_clean":"2024-05-30T06:50:37.191380+0000","last_became_active":"2024-05-30T06:50:36.130633+0000","last_became_peered":"2024-05-30T06:50:36.130633+0000","last_unstale":"2024-05-30T06:50:37.191380+0000","last_undegraded":"2024-05-30T06:50:37.191380+0000","last_fullsized":"2024-05-30T06:50:37.191380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:58.210674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190438+0000","last_change":"2024-05-30T06:50:36.132872+0000","last_active":"2024-05-30T06:50:37.190438+0000","last_peered":"2024-05-30T06:50:37.190438+0000","last_clean":"2024-05-30T06:50:37.190438+0000","last_became_active":"2024-05-30T06:50:36.132575+0000","last_became_peered":"2024-05-30T06:50:36.132575+0000","last_unstale":"2024-05-30T06:50:37.190438+0000","last_undegraded":"2024-05-30T06:50:37.190438+0000","last_fullsized":"2024-05-30T06:50:37.190438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:20:55.332407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190597+0000","last_change":"2024-05-30T06:50:36.147488+0000","last_active":"2024-05-30T06:50:37.190597+0000","last_peered":"2024-05-30T06:50:37.190597+0000","last_clean":"2024-05-30T06:50:37.190597+0000","last_became_active":"2024-05-30T06:50:36.147127+0000","last_became_peered":"2024-05-30T06:50:36.147127+0000","last_unstale":"2024-05-30T06:50:37.190597+0000","last_undegraded":"2024-05-30T06:50:37.190597+0000","last_fullsized":"2024-05-30T06:50:37.190597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:39:18.706486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191167+0000","last_change":"2024-05-30T06:50:36.147478+0000","last_active":"2024-05-30T06:50:37.191167+0000","last_peered":"2024-05-30T06:50:37.191167+0000","last_clean":"2024-05-30T06:50:37.191167+0000","last_became_active":"2024-05-30T06:50:36.147202+0000","last_became_peered":"2024-05-30T06:50:36.147202+0000","last_unstale":"2024-05-30T06:50:37.191167+0000","last_undegraded":"2024-05-30T06:50:37.191167+0000","last_fullsized":"2024-05-30T06:50:37.191167+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:02:01.998106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189714+0000","last_change":"2024-05-30T06:50:35.132241+0000","last_active":"2024-05-30T06:50:37.189714+0000","last_peered":"2024-05-30T06:50:37.189714+0000","last_clean":"2024-05-30T06:50:37.189714+0000","last_became_active":"2024-05-30T06:50:35.131928+0000","last_became_peered":"2024-05-30T06:50:35.131928+0000","last_unstale":"2024-05-30T06:50:37.189714+0000","last_undegraded":"2024-05-30T06:50:37.189714+0000","last_fullsized":"2024-05-30T06:50:37.189714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:27:26.418862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190605+0000","last_change":"2024-05-30T06:50:36.133274+0000","last_active":"2024-05-30T06:50:37.190605+0000","last_peered":"2024-05-30T06:50:37.190605+0000","last_clean":"2024-05-30T06:50:37.190605+0000","last_became_active":"2024-05-30T06:50:36.133004+0000","last_became_peered":"2024-05-30T06:50:36.133004+0000","last_unstale":"2024-05-30T06:50:37.190605+0000","last_undegraded":"2024-05-30T06:50:37.190605+0000","last_fullsized":"2024-05-30T06:50:37.190605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:07:33.282727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191475+0000","last_change":"2024-05-30T06:50:35.130139+0000","last_active":"2024-05-30T06:50:37.191475+0000","last_peered":"2024-05-30T06:50:37.191475+0000","last_clean":"2024-05-30T06:50:37.191475+0000","last_became_active":"2024-05-30T06:50:35.129737+0000","last_became_peered":"2024-05-30T06:50:35.129737+0000","last_unstale":"2024-05-30T06:50:37.191475+0000","last_undegraded":"2024-05-30T06:50:37.191475+0000","last_fullsized":"2024-05-30T06:50:37.191475+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:21.214580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190140+0000","last_change":"2024-05-30T06:50:35.133839+0000","last_active":"2024-05-30T06:50:37.190140+0000","last_peered":"2024-05-30T06:50:37.190140+0000","last_clean":"2024-05-30T06:50:37.190140+0000","last_became_active":"2024-05-30T06:50:35.133509+0000","last_became_peered":"2024-05-30T06:50:35.133509+0000","last_unstale":"2024-05-30T06:50:37.190140+0000","last_undegraded":"2024-05-30T06:50:37.190140+0000","last_fullsized":"2024-05-30T06:50:37.190140+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:14:41.337933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191005+0000","last_change":"2024-05-30T06:50:36.128003+0000","last_active":"2024-05-30T06:50:37.191005+0000","last_peered":"2024-05-30T06:50:37.191005+0000","last_clean":"2024-05-30T06:50:37.191005+0000","last_became_active":"2024-05-30T06:50:36.127402+0000","last_became_peered":"2024-05-30T06:50:36.127402+0000","last_unstale":"2024-05-30T06:50:37.191005+0000","last_undegraded":"2024-05-30T06:50:37.191005+0000","last_fullsized":"2024-05-30T06:50:37.191005+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:55:12.624496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191040+0000","last_change":"2024-05-30T06:50:35.120912+0000","last_active":"2024-05-30T06:50:37.191040+0000","last_peered":"2024-05-30T06:50:37.191040+0000","last_clean":"2024-05-30T06:50:37.191040+0000","last_became_active":"2024-05-30T06:50:35.120133+0000","last_became_peered":"2024-05-30T06:50:35.120133+0000","last_unstale":"2024-05-30T06:50:37.191040+0000","last_undegraded":"2024-05-30T06:50:37.191040+0000","last_fullsized":"2024-05-30T06:50:37.191040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:06:53.698943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191653+0000","last_change":"2024-05-30T06:50:36.147464+0000","last_active":"2024-05-30T06:50:37.191653+0000","last_peered":"2024-05-30T06:50:37.191653+0000","last_clean":"2024-05-30T06:50:37.191653+0000","last_became_active":"2024-05-30T06:50:36.146592+0000","last_became_peered":"2024-05-30T06:50:36.146592+0000","last_unstale":"2024-05-30T06:50:37.191653+0000","last_undegraded":"2024-05-30T06:50:37.191653+0000","last_fullsized":"2024-05-30T06:50:37.191653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:47:48.079037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":263,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-30T06:50:31.967860+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:50:31.967860+0000","last_peered":"2024-05-30T06:50:31.967860+0000","last_clean":"2024-05-30T06:50:31.967860+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:50:31.967860+0000","last_undegraded":"2024-05-30T06:50:31.967860+0000","last_fullsized":"2024-05-30T06:50:31.967860+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54792,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317048,"statfs":{"total":96636764160,"available":96580657152,"internally_reserved":0,"allocated":1433600,"data_stored":944633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54208,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317632,"statfs":{"total":96636764160,"available":96581255168,"internally_reserved":0,"allocated":839680,"data_stored":354265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54208,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317632,"statfs":{"total":96636764160,"available":96581255168,"internally_reserved":0,"allocated":839680,"data_stored":354265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54216,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317624,"statfs":{"total":96636764160,"available":96581246976,"internally_reserved":0,"allocated":839680,"data_stored":354265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574955,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58428,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313412,"statfs":{"total":96636764160,"available":96576933888,"internally_reserved":0,"allocated":897024,"data_stored":379656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50116,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321724,"statfs":{"total":96636764160,"available":96585445376,"internally_reserved":0,"allocated":901120,"data_stored":381156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54216,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317624,"statfs":{"total":96636764160,"available":96581246976,"internally_reserved":0,"allocated":839680,"data_stored":354265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54836,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317004,"statfs":{"total":96636764160,"available":96580612096,"internally_reserved":0,"allocated":1482752,"data_stored":969912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:50:40.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:50:40.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.437+0000 7f302a400640 1 Processor -- start 2024-05-30T06:50:40.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.437+0000 7f302a400640 1 -- start start 2024-05-30T06:50:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f302a400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3024155e60 0x7f30240b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f302a400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f302406f9a0 0x7f30240cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f302a400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f30240b2ec0 0x7f30240cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f302a400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f30240ccff0 con 0x7f3024155e60 2024-05-30T06:50:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f302a400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f30240d00e0 con 0x7f30240b2ec0 2024-05-30T06:50:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f302a400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f302415c8f0 con 0x7f302406f9a0 2024-05-30T06:50:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f3023400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3024155e60 0x7f30240b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f3023400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3024155e60 0x7f30240b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43956/0 (socket says 172.21.15.37:43956) 2024-05-30T06:50:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f3023400640 1 -- 172.21.15.37:0/3817452290 learned_addr learned my addr 172.21.15.37:0/3817452290 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f301aa00640 1 --2- 172.21.15.37:0/3817452290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f302406f9a0 0x7f30240cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f3023e00640 1 --2- 172.21.15.37:0/3817452290 >> v2:172.21.15.105:3300/0 conn(0x7f30240b2ec0 0x7f30240cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f3023400640 1 -- 172.21.15.37:0/3817452290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f302406f9a0 msgr2=0x7f30240cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f3023400640 1 --2- 172.21.15.37:0/3817452290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f302406f9a0 0x7f30240cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f3023400640 1 -- 172.21.15.37:0/3817452290 >> v2:172.21.15.105:3300/0 conn(0x7f30240b2ec0 msgr2=0x7f30240cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f3023400640 1 --2- 172.21.15.37:0/3817452290 >> v2:172.21.15.105:3300/0 conn(0x7f30240b2ec0 0x7f30240cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.441+0000 7f3023400640 1 -- 172.21.15.37:0/3817452290 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30240ccc80 con 0x7f3024155e60 2024-05-30T06:50:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f3023400640 1 --2- 172.21.15.37:0/3817452290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3024155e60 0x7f30240b36a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3024070df0 tx=0x7f301401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfdc2c62c05ea1ac server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f3022a00640 1 -- 172.21.15.37:0/3817452290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30140ab5f0 con 0x7f3024155e60 2024-05-30T06:50:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f3022a00640 1 -- 172.21.15.37:0/3817452290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30140b0070 con 0x7f3024155e60 2024-05-30T06:50:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f3022a00640 1 -- 172.21.15.37:0/3817452290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30140ab9b0 con 0x7f3024155e60 2024-05-30T06:50:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f302a400640 1 -- 172.21.15.37:0/3817452290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3024155e60 msgr2=0x7f30240b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f302a400640 1 --2- 172.21.15.37:0/3817452290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3024155e60 0x7f30240b36a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f3024070df0 tx=0x7f301401c520 comp rx=0 tx=0).stop 2024-05-30T06:50:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f302a400640 1 -- 172.21.15.37:0/3817452290 shutdown_connections 2024-05-30T06:50:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f302a400640 1 --2- 172.21.15.37:0/3817452290 >> v2:172.21.15.105:3300/0 conn(0x7f30240b2ec0 0x7f30240cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f302a400640 1 --2- 172.21.15.37:0/3817452290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f302406f9a0 0x7f30240cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f302a400640 1 --2- 172.21.15.37:0/3817452290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3024155e60 0x7f30240b36a0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f302a400640 1 -- 172.21.15.37:0/3817452290 >> 172.21.15.37:0/3817452290 conn(0x7f30240b23a0 msgr2=0x7f30240b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:40.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f302a400640 1 -- 172.21.15.37:0/3817452290 shutdown_connections 2024-05-30T06:50:40.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f302a400640 1 -- 172.21.15.37:0/3817452290 wait complete. 2024-05-30T06:50:40.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f302a400640 1 Processor -- start 2024-05-30T06:50:40.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.445+0000 7f302a400640 1 -- start start 2024-05-30T06:50:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f302a400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f302406f9a0 0x7f3024147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f302a400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30240b2ec0 0x7f3024150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f302a400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3024155e60 0x7f3024143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f302a400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f30240ce020 con 0x7f30240b2ec0 2024-05-30T06:50:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f302a400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f30240cdea0 con 0x7f302406f9a0 2024-05-30T06:50:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f302a400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f30240ce1a0 con 0x7f3024155e60 2024-05-30T06:50:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f301aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30240b2ec0 0x7f3024150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f301aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30240b2ec0 0x7f3024150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43964/0 (socket says 172.21.15.37:43964) 2024-05-30T06:50:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f301aa00640 1 -- 172.21.15.37:0/2464124386 learned_addr learned my addr 172.21.15.37:0/2464124386 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f3023400640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f302406f9a0 0x7f3024147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f3023e00640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3024155e60 0x7f3024143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f301aa00640 1 -- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3024155e60 msgr2=0x7f3024143920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f301aa00640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3024155e60 0x7f3024143920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f301aa00640 1 -- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f302406f9a0 msgr2=0x7f3024147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f301aa00640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f302406f9a0 0x7f3024147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f301aa00640 1 -- 172.21.15.37:0/2464124386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30241492c0 con 0x7f30240b2ec0 2024-05-30T06:50:40.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f3023e00640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3024155e60 0x7f3024143920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:40.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f301aa00640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30240b2ec0 0x7f3024150fb0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f300c00d7d0 tx=0x7f300c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:40.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f301be00640 1 -- 172.21.15.37:0/2464124386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c018030 con 0x7f30240b2ec0 2024-05-30T06:50:40.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f301be00640 1 -- 172.21.15.37:0/2464124386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c004020 con 0x7f30240b2ec0 2024-05-30T06:50:40.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f301be00640 1 -- 172.21.15.37:0/2464124386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c004210 con 0x7f30240b2ec0 2024-05-30T06:50:40.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f302a400640 1 -- 172.21.15.37:0/2464124386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30241514f0 con 0x7f30240b2ec0 2024-05-30T06:50:40.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f302a400640 1 -- 172.21.15.37:0/2464124386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3024148220 con 0x7f30240b2ec0 2024-05-30T06:50:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f302a400640 1 -- 172.21.15.37:0/2464124386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3024068b20 con 0x7f30240b2ec0 2024-05-30T06:50:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.449+0000 7f301be00640 1 -- 172.21.15.37:0/2464124386 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f300c01b070 con 0x7f30240b2ec0 2024-05-30T06:50:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.453+0000 7f301be00640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3000069100 0x7f300006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.453+0000 7f301be00640 1 -- 172.21.15.37:0/2464124386 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f300c0857a0 con 0x7f30240b2ec0 2024-05-30T06:50:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.453+0000 7f3023400640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3000069100 0x7f300006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.453+0000 7f3023400640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3000069100 0x7f300006b5c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f30140af000 tx=0x7f30140a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.457+0000 7f301be00640 1 -- 172.21.15.37:0/2464124386 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f300c0574a0 con 0x7f30240b2ec0 2024-05-30T06:50:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.617+0000 7f302a400640 1 -- 172.21.15.37:0/2464124386 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3024072fb0 con 0x7f3000069100 2024-05-30T06:50:40.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.625+0000 7f301be00640 1 -- 172.21.15.37:0/2464124386 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242251 (secure 0 0 0) 0x7f3024072fb0 con 0x7f3000069100 2024-05-30T06:50:40.628 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:50:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.629+0000 7f302a400640 1 -- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3000069100 msgr2=0x7f300006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.629+0000 7f302a400640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3000069100 0x7f300006b5c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f30140af000 tx=0x7f30140a7000 comp rx=0 tx=0).stop 2024-05-30T06:50:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.629+0000 7f302a400640 1 -- 172.21.15.37:0/2464124386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30240b2ec0 msgr2=0x7f3024150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.629+0000 7f302a400640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30240b2ec0 0x7f3024150fb0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f300c00d7d0 tx=0x7f300c00dc90 comp rx=0 tx=0).stop 2024-05-30T06:50:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.629+0000 7f302a400640 1 -- 172.21.15.37:0/2464124386 shutdown_connections 2024-05-30T06:50:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.629+0000 7f302a400640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3024155e60 0x7f3024143920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.629+0000 7f302a400640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30240b2ec0 0x7f3024150fb0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.629+0000 7f302a400640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3000069100 0x7f300006b5c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.629+0000 7f302a400640 1 --2- 172.21.15.37:0/2464124386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f302406f9a0 0x7f3024147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.629+0000 7f302a400640 1 -- 172.21.15.37:0/2464124386 >> 172.21.15.37:0/2464124386 conn(0x7f30240b23a0 msgr2=0x7f30240b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:40.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.629+0000 7f302a400640 1 -- 172.21.15.37:0/2464124386 shutdown_connections 2024-05-30T06:50:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.629+0000 7f302a400640 1 -- 172.21.15.37:0/2464124386 wait complete. 2024-05-30T06:50:40.649 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-05-30T06:50:38.790575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":435020,"kb_used_data":7884,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754539700,"statfs":{"total":773094113280,"available":772648652800,"internally_reserved":0,"allocated":8073216,"data_stored":4092417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":437243440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.691295"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190991+0000","last_change":"2024-05-30T06:50:36.135494+0000","last_active":"2024-05-30T06:50:37.190991+0000","last_peered":"2024-05-30T06:50:37.190991+0000","last_clean":"2024-05-30T06:50:37.190991+0000","last_became_active":"2024-05-30T06:50:36.135105+0000","last_became_peered":"2024-05-30T06:50:36.135105+0000","last_unstale":"2024-05-30T06:50:37.190991+0000","last_undegraded":"2024-05-30T06:50:37.190991+0000","last_fullsized":"2024-05-30T06:50:37.190991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:16.744233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190492+0000","last_change":"2024-05-30T06:50:36.132795+0000","last_active":"2024-05-30T06:50:37.190492+0000","last_peered":"2024-05-30T06:50:37.190492+0000","last_clean":"2024-05-30T06:50:37.190492+0000","last_became_active":"2024-05-30T06:50:36.132512+0000","last_became_peered":"2024-05-30T06:50:36.132512+0000","last_unstale":"2024-05-30T06:50:37.190492+0000","last_undegraded":"2024-05-30T06:50:37.190492+0000","last_fullsized":"2024-05-30T06:50:37.190492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:34:49.401832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191645+0000","last_change":"2024-05-30T06:50:36.138009+0000","last_active":"2024-05-30T06:50:37.191645+0000","last_peered":"2024-05-30T06:50:37.191645+0000","last_clean":"2024-05-30T06:50:37.191645+0000","last_became_active":"2024-05-30T06:50:36.137224+0000","last_became_peered":"2024-05-30T06:50:36.137224+0000","last_unstale":"2024-05-30T06:50:37.191645+0000","last_undegraded":"2024-05-30T06:50:37.191645+0000","last_fullsized":"2024-05-30T06:50:37.191645+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:31:20.436064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190100+0000","last_change":"2024-05-30T06:50:36.128090+0000","last_active":"2024-05-30T06:50:37.190100+0000","last_peered":"2024-05-30T06:50:37.190100+0000","last_clean":"2024-05-30T06:50:37.190100+0000","last_became_active":"2024-05-30T06:50:36.127805+0000","last_became_peered":"2024-05-30T06:50:36.127805+0000","last_unstale":"2024-05-30T06:50:37.190100+0000","last_undegraded":"2024-05-30T06:50:37.190100+0000","last_fullsized":"2024-05-30T06:50:37.190100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:40.263358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190952+0000","last_change":"2024-05-30T06:50:36.128319+0000","last_active":"2024-05-30T06:50:37.190952+0000","last_peered":"2024-05-30T06:50:37.190952+0000","last_clean":"2024-05-30T06:50:37.190952+0000","last_became_active":"2024-05-30T06:50:36.127722+0000","last_became_peered":"2024-05-30T06:50:36.127722+0000","last_unstale":"2024-05-30T06:50:37.190952+0000","last_undegraded":"2024-05-30T06:50:37.190952+0000","last_fullsized":"2024-05-30T06:50:37.190952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:36:15.100211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189834+0000","last_change":"2024-05-30T06:50:36.130537+0000","last_active":"2024-05-30T06:50:37.189834+0000","last_peered":"2024-05-30T06:50:37.189834+0000","last_clean":"2024-05-30T06:50:37.189834+0000","last_became_active":"2024-05-30T06:50:36.130275+0000","last_became_peered":"2024-05-30T06:50:36.130275+0000","last_unstale":"2024-05-30T06:50:37.189834+0000","last_undegraded":"2024-05-30T06:50:37.189834+0000","last_fullsized":"2024-05-30T06:50:37.189834+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:23.879376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191805+0000","last_change":"2024-05-30T06:50:36.137706+0000","last_active":"2024-05-30T06:50:37.191805+0000","last_peered":"2024-05-30T06:50:37.191805+0000","last_clean":"2024-05-30T06:50:37.191805+0000","last_became_active":"2024-05-30T06:50:36.136870+0000","last_became_peered":"2024-05-30T06:50:36.136870+0000","last_unstale":"2024-05-30T06:50:37.191805+0000","last_undegraded":"2024-05-30T06:50:37.191805+0000","last_fullsized":"2024-05-30T06:50:37.191805+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:00:22.867977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190046+0000","last_change":"2024-05-30T06:50:36.124537+0000","last_active":"2024-05-30T06:50:37.190046+0000","last_peered":"2024-05-30T06:50:37.190046+0000","last_clean":"2024-05-30T06:50:37.190046+0000","last_became_active":"2024-05-30T06:50:36.124254+0000","last_became_peered":"2024-05-30T06:50:36.124254+0000","last_unstale":"2024-05-30T06:50:37.190046+0000","last_undegraded":"2024-05-30T06:50:37.190046+0000","last_fullsized":"2024-05-30T06:50:37.190046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:56.549987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191123+0000","last_change":"2024-05-30T06:50:36.142813+0000","last_active":"2024-05-30T06:50:37.191123+0000","last_peered":"2024-05-30T06:50:37.191123+0000","last_clean":"2024-05-30T06:50:37.191123+0000","last_became_active":"2024-05-30T06:50:36.141331+0000","last_became_peered":"2024-05-30T06:50:36.141331+0000","last_unstale":"2024-05-30T06:50:37.191123+0000","last_undegraded":"2024-05-30T06:50:37.191123+0000","last_fullsized":"2024-05-30T06:50:37.191123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:00:33.525966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190308+0000","last_change":"2024-05-30T06:50:36.137982+0000","last_active":"2024-05-30T06:50:37.190308+0000","last_peered":"2024-05-30T06:50:37.190308+0000","last_clean":"2024-05-30T06:50:37.190308+0000","last_became_active":"2024-05-30T06:50:36.137660+0000","last_became_peered":"2024-05-30T06:50:36.137660+0000","last_unstale":"2024-05-30T06:50:37.190308+0000","last_undegraded":"2024-05-30T06:50:37.190308+0000","last_fullsized":"2024-05-30T06:50:37.190308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:12:39.654448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191741+0000","last_change":"2024-05-30T06:50:36.137484+0000","last_active":"2024-05-30T06:50:37.191741+0000","last_peered":"2024-05-30T06:50:37.191741+0000","last_clean":"2024-05-30T06:50:37.191741+0000","last_became_active":"2024-05-30T06:50:36.136537+0000","last_became_peered":"2024-05-30T06:50:36.136537+0000","last_unstale":"2024-05-30T06:50:37.191741+0000","last_undegraded":"2024-05-30T06:50:37.191741+0000","last_fullsized":"2024-05-30T06:50:37.191741+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:49.864351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190761+0000","last_change":"2024-05-30T06:50:35.129396+0000","last_active":"2024-05-30T06:50:37.190761+0000","last_peered":"2024-05-30T06:50:37.190761+0000","last_clean":"2024-05-30T06:50:37.190761+0000","last_became_active":"2024-05-30T06:50:35.128968+0000","last_became_peered":"2024-05-30T06:50:35.128968+0000","last_unstale":"2024-05-30T06:50:37.190761+0000","last_undegraded":"2024-05-30T06:50:37.190761+0000","last_fullsized":"2024-05-30T06:50:37.190761+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:01.742927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190858+0000","last_change":"2024-05-30T06:50:35.131068+0000","last_active":"2024-05-30T06:50:37.190858+0000","last_peered":"2024-05-30T06:50:37.190858+0000","last_clean":"2024-05-30T06:50:37.190858+0000","last_became_active":"2024-05-30T06:50:35.130730+0000","last_became_peered":"2024-05-30T06:50:35.130730+0000","last_unstale":"2024-05-30T06:50:37.190858+0000","last_undegraded":"2024-05-30T06:50:37.190858+0000","last_fullsized":"2024-05-30T06:50:37.190858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:17:44.762161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190728+0000","last_change":"2024-05-30T06:50:36.127242+0000","last_active":"2024-05-30T06:50:37.190728+0000","last_peered":"2024-05-30T06:50:37.190728+0000","last_clean":"2024-05-30T06:50:37.190728+0000","last_became_active":"2024-05-30T06:50:36.126954+0000","last_became_peered":"2024-05-30T06:50:36.126954+0000","last_unstale":"2024-05-30T06:50:37.190728+0000","last_undegraded":"2024-05-30T06:50:37.190728+0000","last_fullsized":"2024-05-30T06:50:37.190728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:38:37.252400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190443+0000","last_change":"2024-05-30T06:50:36.137216+0000","last_active":"2024-05-30T06:50:37.190443+0000","last_peered":"2024-05-30T06:50:37.190443+0000","last_clean":"2024-05-30T06:50:37.190443+0000","last_became_active":"2024-05-30T06:50:36.136945+0000","last_became_peered":"2024-05-30T06:50:36.136945+0000","last_unstale":"2024-05-30T06:50:37.190443+0000","last_undegraded":"2024-05-30T06:50:37.190443+0000","last_fullsized":"2024-05-30T06:50:37.190443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:58.008213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190825+0000","last_change":"2024-05-30T06:50:35.119974+0000","last_active":"2024-05-30T06:50:37.190825+0000","last_peered":"2024-05-30T06:50:37.190825+0000","last_clean":"2024-05-30T06:50:37.190825+0000","last_became_active":"2024-05-30T06:50:35.119188+0000","last_became_peered":"2024-05-30T06:50:35.119188+0000","last_unstale":"2024-05-30T06:50:37.190825+0000","last_undegraded":"2024-05-30T06:50:37.190825+0000","last_fullsized":"2024-05-30T06:50:37.190825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:45:15.601089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191222+0000","last_change":"2024-05-30T06:50:35.126131+0000","last_active":"2024-05-30T06:50:37.191222+0000","last_peered":"2024-05-30T06:50:37.191222+0000","last_clean":"2024-05-30T06:50:37.191222+0000","last_became_active":"2024-05-30T06:50:35.125864+0000","last_became_peered":"2024-05-30T06:50:35.125864+0000","last_unstale":"2024-05-30T06:50:37.191222+0000","last_undegraded":"2024-05-30T06:50:37.191222+0000","last_fullsized":"2024-05-30T06:50:37.191222+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:04.103814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191224+0000","last_change":"2024-05-30T06:50:36.130870+0000","last_active":"2024-05-30T06:50:37.191224+0000","last_peered":"2024-05-30T06:50:37.191224+0000","last_clean":"2024-05-30T06:50:37.191224+0000","last_became_active":"2024-05-30T06:50:36.130296+0000","last_became_peered":"2024-05-30T06:50:36.130296+0000","last_unstale":"2024-05-30T06:50:37.191224+0000","last_undegraded":"2024-05-30T06:50:37.191224+0000","last_fullsized":"2024-05-30T06:50:37.191224+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:12:29.459735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189783+0000","last_change":"2024-05-30T06:50:36.128699+0000","last_active":"2024-05-30T06:50:37.189783+0000","last_peered":"2024-05-30T06:50:37.189783+0000","last_clean":"2024-05-30T06:50:37.189783+0000","last_became_active":"2024-05-30T06:50:36.128437+0000","last_became_peered":"2024-05-30T06:50:36.128437+0000","last_unstale":"2024-05-30T06:50:37.189783+0000","last_undegraded":"2024-05-30T06:50:37.189783+0000","last_fullsized":"2024-05-30T06:50:37.189783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:36:45.423083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190598+0000","last_change":"2024-05-30T06:50:36.131744+0000","last_active":"2024-05-30T06:50:37.190598+0000","last_peered":"2024-05-30T06:50:37.190598+0000","last_clean":"2024-05-30T06:50:37.190598+0000","last_became_active":"2024-05-30T06:50:36.131457+0000","last_became_peered":"2024-05-30T06:50:36.131457+0000","last_unstale":"2024-05-30T06:50:37.190598+0000","last_undegraded":"2024-05-30T06:50:37.190598+0000","last_fullsized":"2024-05-30T06:50:37.190598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:59:24.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191380+0000","last_change":"2024-05-30T06:50:36.131097+0000","last_active":"2024-05-30T06:50:37.191380+0000","last_peered":"2024-05-30T06:50:37.191380+0000","last_clean":"2024-05-30T06:50:37.191380+0000","last_became_active":"2024-05-30T06:50:36.130633+0000","last_became_peered":"2024-05-30T06:50:36.130633+0000","last_unstale":"2024-05-30T06:50:37.191380+0000","last_undegraded":"2024-05-30T06:50:37.191380+0000","last_fullsized":"2024-05-30T06:50:37.191380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:58.210674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190438+0000","last_change":"2024-05-30T06:50:36.132872+0000","last_active":"2024-05-30T06:50:37.190438+0000","last_peered":"2024-05-30T06:50:37.190438+0000","last_clean":"2024-05-30T06:50:37.190438+0000","last_became_active":"2024-05-30T06:50:36.132575+0000","last_became_peered":"2024-05-30T06:50:36.132575+0000","last_unstale":"2024-05-30T06:50:37.190438+0000","last_undegraded":"2024-05-30T06:50:37.190438+0000","last_fullsized":"2024-05-30T06:50:37.190438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:20:55.332407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190597+0000","last_change":"2024-05-30T06:50:36.147488+0000","last_active":"2024-05-30T06:50:37.190597+0000","last_peered":"2024-05-30T06:50:37.190597+0000","last_clean":"2024-05-30T06:50:37.190597+0000","last_became_active":"2024-05-30T06:50:36.147127+0000","last_became_peered":"2024-05-30T06:50:36.147127+0000","last_unstale":"2024-05-30T06:50:37.190597+0000","last_undegraded":"2024-05-30T06:50:37.190597+0000","last_fullsized":"2024-05-30T06:50:37.190597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:39:18.706486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191167+0000","last_change":"2024-05-30T06:50:36.147478+0000","last_active":"2024-05-30T06:50:37.191167+0000","last_peered":"2024-05-30T06:50:37.191167+0000","last_clean":"2024-05-30T06:50:37.191167+0000","last_became_active":"2024-05-30T06:50:36.147202+0000","last_became_peered":"2024-05-30T06:50:36.147202+0000","last_unstale":"2024-05-30T06:50:37.191167+0000","last_undegraded":"2024-05-30T06:50:37.191167+0000","last_fullsized":"2024-05-30T06:50:37.191167+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:02:01.998106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189714+0000","last_change":"2024-05-30T06:50:35.132241+0000","last_active":"2024-05-30T06:50:37.189714+0000","last_peered":"2024-05-30T06:50:37.189714+0000","last_clean":"2024-05-30T06:50:37.189714+0000","last_became_active":"2024-05-30T06:50:35.131928+0000","last_became_peered":"2024-05-30T06:50:35.131928+0000","last_unstale":"2024-05-30T06:50:37.189714+0000","last_undegraded":"2024-05-30T06:50:37.189714+0000","last_fullsized":"2024-05-30T06:50:37.189714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:27:26.418862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190605+0000","last_change":"2024-05-30T06:50:36.133274+0000","last_active":"2024-05-30T06:50:37.190605+0000","last_peered":"2024-05-30T06:50:37.190605+0000","last_clean":"2024-05-30T06:50:37.190605+0000","last_became_active":"2024-05-30T06:50:36.133004+0000","last_became_peered":"2024-05-30T06:50:36.133004+0000","last_unstale":"2024-05-30T06:50:37.190605+0000","last_undegraded":"2024-05-30T06:50:37.190605+0000","last_fullsized":"2024-05-30T06:50:37.190605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:07:33.282727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191475+0000","last_change":"2024-05-30T06:50:35.130139+0000","last_active":"2024-05-30T06:50:37.191475+0000","last_peered":"2024-05-30T06:50:37.191475+0000","last_clean":"2024-05-30T06:50:37.191475+0000","last_became_active":"2024-05-30T06:50:35.129737+0000","last_became_peered":"2024-05-30T06:50:35.129737+0000","last_unstale":"2024-05-30T06:50:37.191475+0000","last_undegraded":"2024-05-30T06:50:37.191475+0000","last_fullsized":"2024-05-30T06:50:37.191475+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:21.214580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190140+0000","last_change":"2024-05-30T06:50:35.133839+0000","last_active":"2024-05-30T06:50:37.190140+0000","last_peered":"2024-05-30T06:50:37.190140+0000","last_clean":"2024-05-30T06:50:37.190140+0000","last_became_active":"2024-05-30T06:50:35.133509+0000","last_became_peered":"2024-05-30T06:50:35.133509+0000","last_unstale":"2024-05-30T06:50:37.190140+0000","last_undegraded":"2024-05-30T06:50:37.190140+0000","last_fullsized":"2024-05-30T06:50:37.190140+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:14:41.337933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191005+0000","last_change":"2024-05-30T06:50:36.128003+0000","last_active":"2024-05-30T06:50:37.191005+0000","last_peered":"2024-05-30T06:50:37.191005+0000","last_clean":"2024-05-30T06:50:37.191005+0000","last_became_active":"2024-05-30T06:50:36.127402+0000","last_became_peered":"2024-05-30T06:50:36.127402+0000","last_unstale":"2024-05-30T06:50:37.191005+0000","last_undegraded":"2024-05-30T06:50:37.191005+0000","last_fullsized":"2024-05-30T06:50:37.191005+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:55:12.624496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191040+0000","last_change":"2024-05-30T06:50:35.120912+0000","last_active":"2024-05-30T06:50:37.191040+0000","last_peered":"2024-05-30T06:50:37.191040+0000","last_clean":"2024-05-30T06:50:37.191040+0000","last_became_active":"2024-05-30T06:50:35.120133+0000","last_became_peered":"2024-05-30T06:50:35.120133+0000","last_unstale":"2024-05-30T06:50:37.191040+0000","last_undegraded":"2024-05-30T06:50:37.191040+0000","last_fullsized":"2024-05-30T06:50:37.191040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:06:53.698943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:35.096915+0000","last_change":"2024-05-30T06:50:35.096915+0000","last_active":"2024-05-30T06:50:35.096915+0000","last_peered":"2024-05-30T06:50:35.096915+0000","last_clean":"2024-05-30T06:50:35.096915+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:35.096915+0000","last_undegraded":"2024-05-30T06:50:35.096915+0000","last_fullsized":"2024-05-30T06:50:35.096915+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191653+0000","last_change":"2024-05-30T06:50:36.147464+0000","last_active":"2024-05-30T06:50:37.191653+0000","last_peered":"2024-05-30T06:50:37.191653+0000","last_clean":"2024-05-30T06:50:37.191653+0000","last_became_active":"2024-05-30T06:50:36.146592+0000","last_became_peered":"2024-05-30T06:50:36.146592+0000","last_unstale":"2024-05-30T06:50:37.191653+0000","last_undegraded":"2024-05-30T06:50:37.191653+0000","last_fullsized":"2024-05-30T06:50:37.191653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:47:48.079037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:50:34.088143+0000","last_change":"2024-05-30T06:50:34.088143+0000","last_active":"2024-05-30T06:50:34.088143+0000","last_peered":"2024-05-30T06:50:34.088143+0000","last_clean":"2024-05-30T06:50:34.088143+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:50:34.088143+0000","last_undegraded":"2024-05-30T06:50:34.088143+0000","last_fullsized":"2024-05-30T06:50:34.088143+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":263,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-05-30T06:50:31.967860+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:50:31.967860+0000","last_peered":"2024-05-30T06:50:31.967860+0000","last_clean":"2024-05-30T06:50:31.967860+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:50:31.967860+0000","last_undegraded":"2024-05-30T06:50:31.967860+0000","last_fullsized":"2024-05-30T06:50:31.967860+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574954,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54792,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317048,"statfs":{"total":96636764160,"available":96580657152,"internally_reserved":0,"allocated":1433600,"data_stored":944633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54208,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317632,"statfs":{"total":96636764160,"available":96581255168,"internally_reserved":0,"allocated":839680,"data_stored":354265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54208,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317632,"statfs":{"total":96636764160,"available":96581255168,"internally_reserved":0,"allocated":839680,"data_stored":354265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54216,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317624,"statfs":{"total":96636764160,"available":96581246976,"internally_reserved":0,"allocated":839680,"data_stored":354265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574955,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58428,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313412,"statfs":{"total":96636764160,"available":96576933888,"internally_reserved":0,"allocated":897024,"data_stored":379656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50116,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321724,"statfs":{"total":96636764160,"available":96585445376,"internally_reserved":0,"allocated":901120,"data_stored":381156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54216,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317624,"statfs":{"total":96636764160,"available":96581246976,"internally_reserved":0,"allocated":839680,"data_stored":354265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54836,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317004,"statfs":{"total":96636764160,"available":96580612096,"internally_reserved":0,"allocated":1482752,"data_stored":969912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:50:40.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:50:40.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.833+0000 7f28eb400640 1 Processor -- start 2024-05-30T06:50:40.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.833+0000 7f28eb400640 1 -- start start 2024-05-30T06:50:40.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28eb400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28e406e000 0x7f28e40ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28eb400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f28e40cee10 0x7f28e406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28eb400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e40cd120 con 0x7f28e415cd80 2024-05-30T06:50:40.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28eb400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f28e40a9530 con 0x7f28e406e000 2024-05-30T06:50:40.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28eb400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f28e40cd400 con 0x7f28e40cee10 2024-05-30T06:50:40.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28e8a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28e406e000 0x7f28e40ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28e8a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28e406e000 0x7f28e40ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43976/0 (socket says 172.21.15.37:43976) 2024-05-30T06:50:40.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28e8a00640 1 -- 172.21.15.37:0/3136616188 learned_addr learned my addr 172.21.15.37:0/3136616188 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:40.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28e9400640 1 --2- 172.21.15.37:0/3136616188 >> v2:172.21.15.105:3300/0 conn(0x7f28e40cee10 0x7f28e406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28e8a00640 1 -- 172.21.15.37:0/3136616188 >> v2:172.21.15.105:3300/0 conn(0x7f28e40cee10 msgr2=0x7f28e406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:40.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28e8a00640 1 --2- 172.21.15.37:0/3136616188 >> v2:172.21.15.105:3300/0 conn(0x7f28e40cee10 0x7f28e406f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28e8a00640 1 -- 172.21.15.37:0/3136616188 >> v1:172.21.15.105:6789/0 conn(0x7f28e415cd80 legacy=0x7f28e40ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:40.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28e8a00640 1 -- 172.21.15.37:0/3136616188 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e40cd6e0 con 0x7f28e406e000 2024-05-30T06:50:40.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.837+0000 7f28e9400640 1 --2- 172.21.15.37:0/3136616188 >> v2:172.21.15.105:3300/0 conn(0x7f28e40cee10 0x7f28e406f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:40.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28e8a00640 1 --2- 172.21.15.37:0/3136616188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e406e000 0x7f28e40ce1c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f28e406c7b0 tx=0x7f28d401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3c7eafd251619a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:40.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28e3e00640 1 -- 172.21.15.37:0/3136616188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40b5070 con 0x7f28e406e000 2024-05-30T06:50:40.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28e3e00640 1 -- 172.21.15.37:0/3136616188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d40a89d0 con 0x7f28e406e000 2024-05-30T06:50:40.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28e3e00640 1 -- 172.21.15.37:0/3136616188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d40a8da0 con 0x7f28e406e000 2024-05-30T06:50:40.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28eb400640 1 -- 172.21.15.37:0/3136616188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e406e000 msgr2=0x7f28e40ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28eb400640 1 --2- 172.21.15.37:0/3136616188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e406e000 0x7f28e40ce1c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f28e406c7b0 tx=0x7f28d401ecd0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28eb400640 1 -- 172.21.15.37:0/3136616188 shutdown_connections 2024-05-30T06:50:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28eb400640 1 --2- 172.21.15.37:0/3136616188 >> v2:172.21.15.105:3300/0 conn(0x7f28e40cee10 0x7f28e406f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28eb400640 1 --2- 172.21.15.37:0/3136616188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e406e000 0x7f28e40ce1c0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28eb400640 1 -- 172.21.15.37:0/3136616188 >> 172.21.15.37:0/3136616188 conn(0x7f28e40b23a0 msgr2=0x7f28e40b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28eb400640 1 -- 172.21.15.37:0/3136616188 shutdown_connections 2024-05-30T06:50:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28eb400640 1 -- 172.21.15.37:0/3136616188 wait complete. 2024-05-30T06:50:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28eb400640 1 Processor -- start 2024-05-30T06:50:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.841+0000 7f28eb400640 1 -- start start 2024-05-30T06:50:40.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28eb400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28e406e000 0x7f28e41f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28eb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e40cee10 0x7f28e40b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28eb400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28e415cd80 0x7f28e41424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28eb400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f28e406f930 con 0x7f28e40cee10 2024-05-30T06:50:40.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28eb400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28e40cdca0 con 0x7f28e406e000 2024-05-30T06:50:40.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28eb400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f28e406fab0 con 0x7f28e415cd80 2024-05-30T06:50:40.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28dbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e40cee10 0x7f28e40b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28dbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e40cee10 0x7f28e40b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43982/0 (socket says 172.21.15.37:43982) 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28dbe00640 1 -- 172.21.15.37:0/52051516 learned_addr learned my addr 172.21.15.37:0/52051516 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28e8a00640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28e406e000 0x7f28e41f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28e9400640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28e415cd80 0x7f28e41424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28dbe00640 1 -- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28e415cd80 msgr2=0x7f28e41424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28dbe00640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28e415cd80 0x7f28e41424f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28dbe00640 1 -- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28e406e000 msgr2=0x7f28e41f41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28dbe00640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28e406e000 0x7f28e41f41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28dbe00640 1 -- 172.21.15.37:0/52051516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e41f4730 con 0x7f28e40cee10 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28dbe00640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e40cee10 0x7f28e40b41b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00c480 tx=0x7f28cc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28e1600640 1 -- 172.21.15.37:0/52051516 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc012830 con 0x7f28e40cee10 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28e1600640 1 -- 172.21.15.37:0/52051516 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28cc017070 con 0x7f28e40cee10 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28e1600640 1 -- 172.21.15.37:0/52051516 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28cc012c30 con 0x7f28e40cee10 2024-05-30T06:50:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28eb400640 1 -- 172.21.15.37:0/52051516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e40b5230 con 0x7f28e40cee10 2024-05-30T06:50:40.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28eb400640 1 -- 172.21.15.37:0/52051516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e40b4f50 con 0x7f28e40cee10 2024-05-30T06:50:40.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28eb400640 1 -- 172.21.15.37:0/52051516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e4068b20 con 0x7f28e40cee10 2024-05-30T06:50:40.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.845+0000 7f28e1600640 1 -- 172.21.15.37:0/52051516 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f28cc01c460 con 0x7f28e40cee10 2024-05-30T06:50:40.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.849+0000 7f28e1600640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f28c0069130 0x7f28c006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:40.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.849+0000 7f28e1600640 1 -- 172.21.15.37:0/52051516 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f28cc085300 con 0x7f28e40cee10 2024-05-30T06:50:40.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.849+0000 7f28e8a00640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f28c0069130 0x7f28c006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:40.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.849+0000 7f28e8a00640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f28c0069130 0x7f28c006b5f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f28d40b2000 tx=0x7f28d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:40.853+0000 7f28e1600640 1 -- 172.21.15.37:0/52051516 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f28cc056a10 con 0x7f28e40cee10 2024-05-30T06:50:41.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.013+0000 7f28eb400640 1 -- 172.21.15.37:0/52051516 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28e415a3c0 con 0x7f28c0069130 2024-05-30T06:50:41.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.025+0000 7f28e1600640 1 -- 172.21.15.37:0/52051516 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252069 (secure 0 0 0) 0x7f28e415a3c0 con 0x7f28c0069130 2024-05-30T06:50:41.025 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:41.027 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:50:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.025+0000 7f28eb400640 1 -- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f28c0069130 msgr2=0x7f28c006b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.025+0000 7f28eb400640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f28c0069130 0x7f28c006b5f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f28d40b2000 tx=0x7f28d4009040 comp rx=0 tx=0).stop 2024-05-30T06:50:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.025+0000 7f28eb400640 1 -- 172.21.15.37:0/52051516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e40cee10 msgr2=0x7f28e40b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.025+0000 7f28eb400640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e40cee10 0x7f28e40b41b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00c480 tx=0x7f28cc00c940 comp rx=0 tx=0).stop 2024-05-30T06:50:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.025+0000 7f28eb400640 1 -- 172.21.15.37:0/52051516 shutdown_connections 2024-05-30T06:50:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.025+0000 7f28eb400640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28e415cd80 0x7f28e41424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.025+0000 7f28eb400640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e40cee10 0x7f28e40b41b0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.025+0000 7f28eb400640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f28c0069130 0x7f28c006b5f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.025+0000 7f28eb400640 1 --2- 172.21.15.37:0/52051516 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28e406e000 0x7f28e41f41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.025+0000 7f28eb400640 1 -- 172.21.15.37:0/52051516 >> 172.21.15.37:0/52051516 conn(0x7f28e40b23a0 msgr2=0x7f28e41595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.025+0000 7f28eb400640 1 -- 172.21.15.37:0/52051516 shutdown_connections 2024-05-30T06:50:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.025+0000 7f28eb400640 1 -- 172.21.15.37:0/52051516 wait complete. 2024-05-30T06:50:41.046 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-05-30T06:50:40.791098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":435304,"kb_used_data":8168,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754539416,"statfs":{"total":773094113280,"available":772648361984,"internally_reserved":0,"allocated":8364032,"data_stored":4221908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":437243440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001531"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192368+0000","last_change":"2024-05-30T06:50:36.141724+0000","last_active":"2024-05-30T06:50:37.192368+0000","last_peered":"2024-05-30T06:50:37.192368+0000","last_clean":"2024-05-30T06:50:37.192368+0000","last_became_active":"2024-05-30T06:50:36.141318+0000","last_became_peered":"2024-05-30T06:50:36.141318+0000","last_unstale":"2024-05-30T06:50:37.192368+0000","last_undegraded":"2024-05-30T06:50:37.192368+0000","last_fullsized":"2024-05-30T06:50:37.192368+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:20:35.641203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192847+0000","last_change":"2024-05-30T06:50:36.136008+0000","last_active":"2024-05-30T06:50:37.192847+0000","last_peered":"2024-05-30T06:50:37.192847+0000","last_clean":"2024-05-30T06:50:37.192847+0000","last_became_active":"2024-05-30T06:50:36.135609+0000","last_became_peered":"2024-05-30T06:50:36.135609+0000","last_unstale":"2024-05-30T06:50:37.192847+0000","last_undegraded":"2024-05-30T06:50:37.192847+0000","last_fullsized":"2024-05-30T06:50:37.192847+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:29.341913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190991+0000","last_change":"2024-05-30T06:50:36.135494+0000","last_active":"2024-05-30T06:50:37.190991+0000","last_peered":"2024-05-30T06:50:37.190991+0000","last_clean":"2024-05-30T06:50:37.190991+0000","last_became_active":"2024-05-30T06:50:36.135105+0000","last_became_peered":"2024-05-30T06:50:36.135105+0000","last_unstale":"2024-05-30T06:50:37.190991+0000","last_undegraded":"2024-05-30T06:50:37.190991+0000","last_fullsized":"2024-05-30T06:50:37.190991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:16.744233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133455+0000","last_change":"2024-05-30T06:50:36.134884+0000","last_active":"2024-05-30T06:50:37.133455+0000","last_peered":"2024-05-30T06:50:37.133455+0000","last_clean":"2024-05-30T06:50:37.133455+0000","last_became_active":"2024-05-30T06:50:36.134671+0000","last_became_peered":"2024-05-30T06:50:36.134671+0000","last_unstale":"2024-05-30T06:50:37.133455+0000","last_undegraded":"2024-05-30T06:50:37.133455+0000","last_fullsized":"2024-05-30T06:50:37.133455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:19.626381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190492+0000","last_change":"2024-05-30T06:50:36.132795+0000","last_active":"2024-05-30T06:50:37.190492+0000","last_peered":"2024-05-30T06:50:37.190492+0000","last_clean":"2024-05-30T06:50:37.190492+0000","last_became_active":"2024-05-30T06:50:36.132512+0000","last_became_peered":"2024-05-30T06:50:36.132512+0000","last_unstale":"2024-05-30T06:50:37.190492+0000","last_undegraded":"2024-05-30T06:50:37.190492+0000","last_fullsized":"2024-05-30T06:50:37.190492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:34:49.401832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192499+0000","last_change":"2024-05-30T06:50:36.131467+0000","last_active":"2024-05-30T06:50:37.192499+0000","last_peered":"2024-05-30T06:50:37.192499+0000","last_clean":"2024-05-30T06:50:37.192499+0000","last_became_active":"2024-05-30T06:50:36.131112+0000","last_became_peered":"2024-05-30T06:50:36.131112+0000","last_unstale":"2024-05-30T06:50:37.192499+0000","last_undegraded":"2024-05-30T06:50:37.192499+0000","last_fullsized":"2024-05-30T06:50:37.192499+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:36:19.920062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.135957+0000","last_change":"2024-05-30T06:50:36.123669+0000","last_active":"2024-05-30T06:50:37.135957+0000","last_peered":"2024-05-30T06:50:37.135957+0000","last_clean":"2024-05-30T06:50:37.135957+0000","last_became_active":"2024-05-30T06:50:36.123352+0000","last_became_peered":"2024-05-30T06:50:36.123352+0000","last_unstale":"2024-05-30T06:50:37.135957+0000","last_undegraded":"2024-05-30T06:50:37.135957+0000","last_fullsized":"2024-05-30T06:50:37.135957+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:40.263358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191990+0000","last_change":"2024-05-30T06:50:36.127388+0000","last_active":"2024-05-30T06:50:37.191990+0000","last_peered":"2024-05-30T06:50:37.191990+0000","last_clean":"2024-05-30T06:50:37.191990+0000","last_became_active":"2024-05-30T06:50:36.127124+0000","last_became_peered":"2024-05-30T06:50:36.127124+0000","last_unstale":"2024-05-30T06:50:37.191990+0000","last_undegraded":"2024-05-30T06:50:37.191990+0000","last_fullsized":"2024-05-30T06:50:37.191990+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:47.847094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191645+0000","last_change":"2024-05-30T06:50:36.138009+0000","last_active":"2024-05-30T06:50:37.191645+0000","last_peered":"2024-05-30T06:50:37.191645+0000","last_clean":"2024-05-30T06:50:37.191645+0000","last_became_active":"2024-05-30T06:50:36.137224+0000","last_became_peered":"2024-05-30T06:50:36.137224+0000","last_unstale":"2024-05-30T06:50:37.191645+0000","last_undegraded":"2024-05-30T06:50:37.191645+0000","last_fullsized":"2024-05-30T06:50:37.191645+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:31:20.436064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137057+0000","last_change":"2024-05-30T06:50:36.145133+0000","last_active":"2024-05-30T06:50:37.137057+0000","last_peered":"2024-05-30T06:50:37.137057+0000","last_clean":"2024-05-30T06:50:37.137057+0000","last_became_active":"2024-05-30T06:50:36.144866+0000","last_became_peered":"2024-05-30T06:50:36.144866+0000","last_unstale":"2024-05-30T06:50:37.137057+0000","last_undegraded":"2024-05-30T06:50:37.137057+0000","last_fullsized":"2024-05-30T06:50:37.137057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:09:27.992413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192859+0000","last_change":"2024-05-30T06:50:36.146835+0000","last_active":"2024-05-30T06:50:37.192859+0000","last_peered":"2024-05-30T06:50:37.192859+0000","last_clean":"2024-05-30T06:50:37.192859+0000","last_became_active":"2024-05-30T06:50:36.146478+0000","last_became_peered":"2024-05-30T06:50:36.146478+0000","last_unstale":"2024-05-30T06:50:37.192859+0000","last_undegraded":"2024-05-30T06:50:37.192859+0000","last_fullsized":"2024-05-30T06:50:37.192859+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:59:28.920236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133479+0000","last_change":"2024-05-30T06:50:36.133491+0000","last_active":"2024-05-30T06:50:37.133479+0000","last_peered":"2024-05-30T06:50:37.133479+0000","last_clean":"2024-05-30T06:50:37.133479+0000","last_became_active":"2024-05-30T06:50:36.133242+0000","last_became_peered":"2024-05-30T06:50:36.133242+0000","last_unstale":"2024-05-30T06:50:37.133479+0000","last_undegraded":"2024-05-30T06:50:37.133479+0000","last_fullsized":"2024-05-30T06:50:37.133479+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:39:50.722112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190100+0000","last_change":"2024-05-30T06:50:36.128090+0000","last_active":"2024-05-30T06:50:37.190100+0000","last_peered":"2024-05-30T06:50:37.190100+0000","last_clean":"2024-05-30T06:50:37.190100+0000","last_became_active":"2024-05-30T06:50:36.127805+0000","last_became_peered":"2024-05-30T06:50:36.127805+0000","last_unstale":"2024-05-30T06:50:37.190100+0000","last_undegraded":"2024-05-30T06:50:37.190100+0000","last_fullsized":"2024-05-30T06:50:37.190100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:40.263358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190952+0000","last_change":"2024-05-30T06:50:36.128319+0000","last_active":"2024-05-30T06:50:37.190952+0000","last_peered":"2024-05-30T06:50:37.190952+0000","last_clean":"2024-05-30T06:50:37.190952+0000","last_became_active":"2024-05-30T06:50:36.127722+0000","last_became_peered":"2024-05-30T06:50:36.127722+0000","last_unstale":"2024-05-30T06:50:37.190952+0000","last_undegraded":"2024-05-30T06:50:37.190952+0000","last_fullsized":"2024-05-30T06:50:37.190952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:36:15.100211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189834+0000","last_change":"2024-05-30T06:50:36.130537+0000","last_active":"2024-05-30T06:50:37.189834+0000","last_peered":"2024-05-30T06:50:37.189834+0000","last_clean":"2024-05-30T06:50:37.189834+0000","last_became_active":"2024-05-30T06:50:36.130275+0000","last_became_peered":"2024-05-30T06:50:36.130275+0000","last_unstale":"2024-05-30T06:50:37.189834+0000","last_undegraded":"2024-05-30T06:50:37.189834+0000","last_fullsized":"2024-05-30T06:50:37.189834+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:23.879376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.135722+0000","last_change":"2024-05-30T06:50:36.129772+0000","last_active":"2024-05-30T06:50:37.135722+0000","last_peered":"2024-05-30T06:50:37.135722+0000","last_clean":"2024-05-30T06:50:37.135722+0000","last_became_active":"2024-05-30T06:50:36.129459+0000","last_became_peered":"2024-05-30T06:50:36.129459+0000","last_unstale":"2024-05-30T06:50:37.135722+0000","last_undegraded":"2024-05-30T06:50:37.135722+0000","last_fullsized":"2024-05-30T06:50:37.135722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:46:18.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191805+0000","last_change":"2024-05-30T06:50:36.137706+0000","last_active":"2024-05-30T06:50:37.191805+0000","last_peered":"2024-05-30T06:50:37.191805+0000","last_clean":"2024-05-30T06:50:37.191805+0000","last_became_active":"2024-05-30T06:50:36.136870+0000","last_became_peered":"2024-05-30T06:50:36.136870+0000","last_unstale":"2024-05-30T06:50:37.191805+0000","last_undegraded":"2024-05-30T06:50:37.191805+0000","last_fullsized":"2024-05-30T06:50:37.191805+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:00:22.867977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133656+0000","last_change":"2024-05-30T06:50:36.134700+0000","last_active":"2024-05-30T06:50:37.133656+0000","last_peered":"2024-05-30T06:50:37.133656+0000","last_clean":"2024-05-30T06:50:37.133656+0000","last_became_active":"2024-05-30T06:50:36.134433+0000","last_became_peered":"2024-05-30T06:50:36.134433+0000","last_unstale":"2024-05-30T06:50:37.133656+0000","last_undegraded":"2024-05-30T06:50:37.133656+0000","last_fullsized":"2024-05-30T06:50:37.133656+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:49:01.139347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192372+0000","last_change":"2024-05-30T06:50:36.128464+0000","last_active":"2024-05-30T06:50:37.192372+0000","last_peered":"2024-05-30T06:50:37.192372+0000","last_clean":"2024-05-30T06:50:37.192372+0000","last_became_active":"2024-05-30T06:50:36.128170+0000","last_became_peered":"2024-05-30T06:50:36.128170+0000","last_unstale":"2024-05-30T06:50:37.192372+0000","last_undegraded":"2024-05-30T06:50:37.192372+0000","last_fullsized":"2024-05-30T06:50:37.192372+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:22:49.338617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190046+0000","last_change":"2024-05-30T06:50:36.124537+0000","last_active":"2024-05-30T06:50:37.190046+0000","last_peered":"2024-05-30T06:50:37.190046+0000","last_clean":"2024-05-30T06:50:37.190046+0000","last_became_active":"2024-05-30T06:50:36.124254+0000","last_became_peered":"2024-05-30T06:50:36.124254+0000","last_unstale":"2024-05-30T06:50:37.190046+0000","last_undegraded":"2024-05-30T06:50:37.190046+0000","last_fullsized":"2024-05-30T06:50:37.190046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:56.549987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136570+0000","last_change":"2024-05-30T06:50:36.129938+0000","last_active":"2024-05-30T06:50:37.136570+0000","last_peered":"2024-05-30T06:50:37.136570+0000","last_clean":"2024-05-30T06:50:37.136570+0000","last_became_active":"2024-05-30T06:50:36.129593+0000","last_became_peered":"2024-05-30T06:50:36.129593+0000","last_unstale":"2024-05-30T06:50:37.136570+0000","last_undegraded":"2024-05-30T06:50:37.136570+0000","last_fullsized":"2024-05-30T06:50:37.136570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:21:52.455652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136415+0000","last_change":"2024-05-30T06:50:36.145803+0000","last_active":"2024-05-30T06:50:37.136415+0000","last_peered":"2024-05-30T06:50:37.136415+0000","last_clean":"2024-05-30T06:50:37.136415+0000","last_became_active":"2024-05-30T06:50:36.145507+0000","last_became_peered":"2024-05-30T06:50:36.145507+0000","last_unstale":"2024-05-30T06:50:37.136415+0000","last_undegraded":"2024-05-30T06:50:37.136415+0000","last_fullsized":"2024-05-30T06:50:37.136415+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:57.447664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192150+0000","last_change":"2024-05-30T06:50:36.133852+0000","last_active":"2024-05-30T06:50:37.192150+0000","last_peered":"2024-05-30T06:50:37.192150+0000","last_clean":"2024-05-30T06:50:37.192150+0000","last_became_active":"2024-05-30T06:50:36.133264+0000","last_became_peered":"2024-05-30T06:50:36.133264+0000","last_unstale":"2024-05-30T06:50:37.192150+0000","last_undegraded":"2024-05-30T06:50:37.192150+0000","last_fullsized":"2024-05-30T06:50:37.192150+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:47:06.431698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191824+0000","last_change":"2024-05-30T06:50:36.138660+0000","last_active":"2024-05-30T06:50:37.191824+0000","last_peered":"2024-05-30T06:50:37.191824+0000","last_clean":"2024-05-30T06:50:37.191824+0000","last_became_active":"2024-05-30T06:50:36.135036+0000","last_became_peered":"2024-05-30T06:50:36.135036+0000","last_unstale":"2024-05-30T06:50:37.191824+0000","last_undegraded":"2024-05-30T06:50:37.191824+0000","last_fullsized":"2024-05-30T06:50:37.191824+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:30:13.290474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136978+0000","last_change":"2024-05-30T06:50:36.137261+0000","last_active":"2024-05-30T06:50:37.136978+0000","last_peered":"2024-05-30T06:50:37.136978+0000","last_clean":"2024-05-30T06:50:37.136978+0000","last_became_active":"2024-05-30T06:50:36.136976+0000","last_became_peered":"2024-05-30T06:50:36.136976+0000","last_unstale":"2024-05-30T06:50:37.136978+0000","last_undegraded":"2024-05-30T06:50:37.136978+0000","last_fullsized":"2024-05-30T06:50:37.136978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:21:42.786793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137337+0000","last_change":"2024-05-30T06:50:36.131795+0000","last_active":"2024-05-30T06:50:37.137337+0000","last_peered":"2024-05-30T06:50:37.137337+0000","last_clean":"2024-05-30T06:50:37.137337+0000","last_became_active":"2024-05-30T06:50:36.131557+0000","last_became_peered":"2024-05-30T06:50:36.131557+0000","last_unstale":"2024-05-30T06:50:37.137337+0000","last_undegraded":"2024-05-30T06:50:37.137337+0000","last_fullsized":"2024-05-30T06:50:37.137337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:17:34.623293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191123+0000","last_change":"2024-05-30T06:50:36.142813+0000","last_active":"2024-05-30T06:50:37.191123+0000","last_peered":"2024-05-30T06:50:37.191123+0000","last_clean":"2024-05-30T06:50:37.191123+0000","last_became_active":"2024-05-30T06:50:36.141331+0000","last_became_peered":"2024-05-30T06:50:36.141331+0000","last_unstale":"2024-05-30T06:50:37.191123+0000","last_undegraded":"2024-05-30T06:50:37.191123+0000","last_fullsized":"2024-05-30T06:50:37.191123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:00:33.525966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136476+0000","last_change":"2024-05-30T06:50:36.134492+0000","last_active":"2024-05-30T06:50:37.136476+0000","last_peered":"2024-05-30T06:50:37.136476+0000","last_clean":"2024-05-30T06:50:37.136476+0000","last_became_active":"2024-05-30T06:50:36.132522+0000","last_became_peered":"2024-05-30T06:50:36.132522+0000","last_unstale":"2024-05-30T06:50:37.136476+0000","last_undegraded":"2024-05-30T06:50:37.136476+0000","last_fullsized":"2024-05-30T06:50:37.136476+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:08:13.224977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190308+0000","last_change":"2024-05-30T06:50:36.137982+0000","last_active":"2024-05-30T06:50:37.190308+0000","last_peered":"2024-05-30T06:50:37.190308+0000","last_clean":"2024-05-30T06:50:37.190308+0000","last_became_active":"2024-05-30T06:50:36.137660+0000","last_became_peered":"2024-05-30T06:50:36.137660+0000","last_unstale":"2024-05-30T06:50:37.190308+0000","last_undegraded":"2024-05-30T06:50:37.190308+0000","last_fullsized":"2024-05-30T06:50:37.190308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:12:39.654448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136046+0000","last_change":"2024-05-30T06:50:36.127494+0000","last_active":"2024-05-30T06:50:37.136046+0000","last_peered":"2024-05-30T06:50:37.136046+0000","last_clean":"2024-05-30T06:50:37.136046+0000","last_became_active":"2024-05-30T06:50:36.126783+0000","last_became_peered":"2024-05-30T06:50:36.126783+0000","last_unstale":"2024-05-30T06:50:37.136046+0000","last_undegraded":"2024-05-30T06:50:37.136046+0000","last_fullsized":"2024-05-30T06:50:37.136046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:58.008213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136126+0000","last_change":"2024-05-30T06:50:36.130480+0000","last_active":"2024-05-30T06:50:37.136126+0000","last_peered":"2024-05-30T06:50:37.136126+0000","last_clean":"2024-05-30T06:50:37.136126+0000","last_became_active":"2024-05-30T06:50:36.130164+0000","last_became_peered":"2024-05-30T06:50:36.130164+0000","last_unstale":"2024-05-30T06:50:37.136126+0000","last_undegraded":"2024-05-30T06:50:37.136126+0000","last_fullsized":"2024-05-30T06:50:37.136126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:07:33.282727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192047+0000","last_change":"2024-05-30T06:50:36.139305+0000","last_active":"2024-05-30T06:50:37.192047+0000","last_peered":"2024-05-30T06:50:37.192047+0000","last_clean":"2024-05-30T06:50:37.192047+0000","last_became_active":"2024-05-30T06:50:36.138559+0000","last_became_peered":"2024-05-30T06:50:36.138559+0000","last_unstale":"2024-05-30T06:50:37.192047+0000","last_undegraded":"2024-05-30T06:50:37.192047+0000","last_fullsized":"2024-05-30T06:50:37.192047+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:38:35.033699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192497+0000","last_change":"2024-05-30T06:50:36.148984+0000","last_active":"2024-05-30T06:50:37.192497+0000","last_peered":"2024-05-30T06:50:37.192497+0000","last_clean":"2024-05-30T06:50:37.192497+0000","last_became_active":"2024-05-30T06:50:36.148443+0000","last_became_peered":"2024-05-30T06:50:36.148443+0000","last_unstale":"2024-05-30T06:50:37.192497+0000","last_undegraded":"2024-05-30T06:50:37.192497+0000","last_fullsized":"2024-05-30T06:50:37.192497+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:30:56.516597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192950+0000","last_change":"2024-05-30T06:50:35.135469+0000","last_active":"2024-05-30T06:50:37.192950+0000","last_peered":"2024-05-30T06:50:37.192950+0000","last_clean":"2024-05-30T06:50:37.192950+0000","last_became_active":"2024-05-30T06:50:35.135165+0000","last_became_peered":"2024-05-30T06:50:35.135165+0000","last_unstale":"2024-05-30T06:50:37.192950+0000","last_undegraded":"2024-05-30T06:50:37.192950+0000","last_fullsized":"2024-05-30T06:50:37.192950+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:55:43.836193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191741+0000","last_change":"2024-05-30T06:50:36.137484+0000","last_active":"2024-05-30T06:50:37.191741+0000","last_peered":"2024-05-30T06:50:37.191741+0000","last_clean":"2024-05-30T06:50:37.191741+0000","last_became_active":"2024-05-30T06:50:36.136537+0000","last_became_peered":"2024-05-30T06:50:36.136537+0000","last_unstale":"2024-05-30T06:50:37.191741+0000","last_undegraded":"2024-05-30T06:50:37.191741+0000","last_fullsized":"2024-05-30T06:50:37.191741+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:49.864351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190761+0000","last_change":"2024-05-30T06:50:35.129396+0000","last_active":"2024-05-30T06:50:37.190761+0000","last_peered":"2024-05-30T06:50:37.190761+0000","last_clean":"2024-05-30T06:50:37.190761+0000","last_became_active":"2024-05-30T06:50:35.128968+0000","last_became_peered":"2024-05-30T06:50:35.128968+0000","last_unstale":"2024-05-30T06:50:37.190761+0000","last_undegraded":"2024-05-30T06:50:37.190761+0000","last_fullsized":"2024-05-30T06:50:37.190761+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:01.742927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192187+0000","last_change":"2024-05-30T06:50:36.140265+0000","last_active":"2024-05-30T06:50:37.192187+0000","last_peered":"2024-05-30T06:50:37.192187+0000","last_clean":"2024-05-30T06:50:37.192187+0000","last_became_active":"2024-05-30T06:50:36.139996+0000","last_became_peered":"2024-05-30T06:50:36.139996+0000","last_unstale":"2024-05-30T06:50:37.192187+0000","last_undegraded":"2024-05-30T06:50:37.192187+0000","last_fullsized":"2024-05-30T06:50:37.192187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:58:16.706670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136834+0000","last_change":"2024-05-30T06:50:35.128453+0000","last_active":"2024-05-30T06:50:37.136834+0000","last_peered":"2024-05-30T06:50:37.136834+0000","last_clean":"2024-05-30T06:50:37.136834+0000","last_became_active":"2024-05-30T06:50:35.128177+0000","last_became_peered":"2024-05-30T06:50:35.128177+0000","last_unstale":"2024-05-30T06:50:37.136834+0000","last_undegraded":"2024-05-30T06:50:37.136834+0000","last_fullsized":"2024-05-30T06:50:37.136834+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:26.592642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192977+0000","last_change":"2024-05-30T06:50:36.137261+0000","last_active":"2024-05-30T06:50:37.192977+0000","last_peered":"2024-05-30T06:50:37.192977+0000","last_clean":"2024-05-30T06:50:37.192977+0000","last_became_active":"2024-05-30T06:50:36.137006+0000","last_became_peered":"2024-05-30T06:50:36.137006+0000","last_unstale":"2024-05-30T06:50:37.192977+0000","last_undegraded":"2024-05-30T06:50:37.192977+0000","last_fullsized":"2024-05-30T06:50:37.192977+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:28:35.661821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192596+0000","last_change":"2024-05-30T06:50:35.130217+0000","last_active":"2024-05-30T06:50:37.192596+0000","last_peered":"2024-05-30T06:50:37.192596+0000","last_clean":"2024-05-30T06:50:37.192596+0000","last_became_active":"2024-05-30T06:50:35.129905+0000","last_became_peered":"2024-05-30T06:50:35.129905+0000","last_unstale":"2024-05-30T06:50:37.192596+0000","last_undegraded":"2024-05-30T06:50:37.192596+0000","last_fullsized":"2024-05-30T06:50:37.192596+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:14.947254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136751+0000","last_change":"2024-05-30T06:50:36.127673+0000","last_active":"2024-05-30T06:50:37.136751+0000","last_peered":"2024-05-30T06:50:37.136751+0000","last_clean":"2024-05-30T06:50:37.136751+0000","last_became_active":"2024-05-30T06:50:36.127204+0000","last_became_peered":"2024-05-30T06:50:36.127204+0000","last_unstale":"2024-05-30T06:50:37.136751+0000","last_undegraded":"2024-05-30T06:50:37.136751+0000","last_fullsized":"2024-05-30T06:50:37.136751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:09:53.013517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190858+0000","last_change":"2024-05-30T06:50:35.131068+0000","last_active":"2024-05-30T06:50:37.190858+0000","last_peered":"2024-05-30T06:50:37.190858+0000","last_clean":"2024-05-30T06:50:37.190858+0000","last_became_active":"2024-05-30T06:50:35.130730+0000","last_became_peered":"2024-05-30T06:50:35.130730+0000","last_unstale":"2024-05-30T06:50:37.190858+0000","last_undegraded":"2024-05-30T06:50:37.190858+0000","last_fullsized":"2024-05-30T06:50:37.190858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:17:44.762161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136386+0000","last_change":"2024-05-30T06:50:36.137654+0000","last_active":"2024-05-30T06:50:37.136386+0000","last_peered":"2024-05-30T06:50:37.136386+0000","last_clean":"2024-05-30T06:50:37.136386+0000","last_became_active":"2024-05-30T06:50:36.137316+0000","last_became_peered":"2024-05-30T06:50:36.137316+0000","last_unstale":"2024-05-30T06:50:37.136386+0000","last_undegraded":"2024-05-30T06:50:37.136386+0000","last_fullsized":"2024-05-30T06:50:37.136386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:29.341913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192564+0000","last_change":"2024-05-30T06:50:35.132955+0000","last_active":"2024-05-30T06:50:37.192564+0000","last_peered":"2024-05-30T06:50:37.192564+0000","last_clean":"2024-05-30T06:50:37.192564+0000","last_became_active":"2024-05-30T06:50:35.132679+0000","last_became_peered":"2024-05-30T06:50:35.132679+0000","last_unstale":"2024-05-30T06:50:37.192564+0000","last_undegraded":"2024-05-30T06:50:37.192564+0000","last_fullsized":"2024-05-30T06:50:37.192564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:39:49.713340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190728+0000","last_change":"2024-05-30T06:50:36.127242+0000","last_active":"2024-05-30T06:50:37.190728+0000","last_peered":"2024-05-30T06:50:37.190728+0000","last_clean":"2024-05-30T06:50:37.190728+0000","last_became_active":"2024-05-30T06:50:36.126954+0000","last_became_peered":"2024-05-30T06:50:36.126954+0000","last_unstale":"2024-05-30T06:50:37.190728+0000","last_undegraded":"2024-05-30T06:50:37.190728+0000","last_fullsized":"2024-05-30T06:50:37.190728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:38:37.252400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133237+0000","last_change":"2024-05-30T06:50:35.128609+0000","last_active":"2024-05-30T06:50:37.133237+0000","last_peered":"2024-05-30T06:50:37.133237+0000","last_clean":"2024-05-30T06:50:37.133237+0000","last_became_active":"2024-05-30T06:50:35.128214+0000","last_became_peered":"2024-05-30T06:50:35.128214+0000","last_unstale":"2024-05-30T06:50:37.133237+0000","last_undegraded":"2024-05-30T06:50:37.133237+0000","last_fullsized":"2024-05-30T06:50:37.133237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:57.201902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190443+0000","last_change":"2024-05-30T06:50:36.137216+0000","last_active":"2024-05-30T06:50:37.190443+0000","last_peered":"2024-05-30T06:50:37.190443+0000","last_clean":"2024-05-30T06:50:37.190443+0000","last_became_active":"2024-05-30T06:50:36.136945+0000","last_became_peered":"2024-05-30T06:50:36.136945+0000","last_unstale":"2024-05-30T06:50:37.190443+0000","last_undegraded":"2024-05-30T06:50:37.190443+0000","last_fullsized":"2024-05-30T06:50:37.190443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:58.008213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190825+0000","last_change":"2024-05-30T06:50:35.119974+0000","last_active":"2024-05-30T06:50:37.190825+0000","last_peered":"2024-05-30T06:50:37.190825+0000","last_clean":"2024-05-30T06:50:37.190825+0000","last_became_active":"2024-05-30T06:50:35.119188+0000","last_became_peered":"2024-05-30T06:50:35.119188+0000","last_unstale":"2024-05-30T06:50:37.190825+0000","last_undegraded":"2024-05-30T06:50:37.190825+0000","last_fullsized":"2024-05-30T06:50:37.190825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:45:15.601089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137573+0000","last_change":"2024-05-30T06:50:36.135040+0000","last_active":"2024-05-30T06:50:37.137573+0000","last_peered":"2024-05-30T06:50:37.137573+0000","last_clean":"2024-05-30T06:50:37.137573+0000","last_became_active":"2024-05-30T06:50:36.134764+0000","last_became_peered":"2024-05-30T06:50:36.134764+0000","last_unstale":"2024-05-30T06:50:37.137573+0000","last_undegraded":"2024-05-30T06:50:37.137573+0000","last_fullsized":"2024-05-30T06:50:37.137573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:29:12.186720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137016+0000","last_change":"2024-05-30T06:50:35.133698+0000","last_active":"2024-05-30T06:50:37.137016+0000","last_peered":"2024-05-30T06:50:37.137016+0000","last_clean":"2024-05-30T06:50:37.137016+0000","last_became_active":"2024-05-30T06:50:35.132932+0000","last_became_peered":"2024-05-30T06:50:35.132932+0000","last_unstale":"2024-05-30T06:50:37.137016+0000","last_undegraded":"2024-05-30T06:50:37.137016+0000","last_fullsized":"2024-05-30T06:50:37.137016+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:29:04.354604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192807+0000","last_change":"2024-05-30T06:50:36.148139+0000","last_active":"2024-05-30T06:50:37.192807+0000","last_peered":"2024-05-30T06:50:37.192807+0000","last_clean":"2024-05-30T06:50:37.192807+0000","last_became_active":"2024-05-30T06:50:36.147823+0000","last_became_peered":"2024-05-30T06:50:36.147823+0000","last_unstale":"2024-05-30T06:50:37.192807+0000","last_undegraded":"2024-05-30T06:50:37.192807+0000","last_fullsized":"2024-05-30T06:50:37.192807+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:51:43.331082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192947+0000","last_change":"2024-05-30T06:50:35.126864+0000","last_active":"2024-05-30T06:50:37.192947+0000","last_peered":"2024-05-30T06:50:37.192947+0000","last_clean":"2024-05-30T06:50:37.192947+0000","last_became_active":"2024-05-30T06:50:35.126599+0000","last_became_peered":"2024-05-30T06:50:35.126599+0000","last_unstale":"2024-05-30T06:50:37.192947+0000","last_undegraded":"2024-05-30T06:50:37.192947+0000","last_fullsized":"2024-05-30T06:50:37.192947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:29:09.412208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192881+0000","last_change":"2024-05-30T06:50:36.132398+0000","last_active":"2024-05-30T06:50:37.192881+0000","last_peered":"2024-05-30T06:50:37.192881+0000","last_clean":"2024-05-30T06:50:37.192881+0000","last_became_active":"2024-05-30T06:50:36.132093+0000","last_became_peered":"2024-05-30T06:50:36.132093+0000","last_unstale":"2024-05-30T06:50:37.192881+0000","last_undegraded":"2024-05-30T06:50:37.192881+0000","last_fullsized":"2024-05-30T06:50:37.192881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:57.447664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191222+0000","last_change":"2024-05-30T06:50:35.126131+0000","last_active":"2024-05-30T06:50:37.191222+0000","last_peered":"2024-05-30T06:50:37.191222+0000","last_clean":"2024-05-30T06:50:37.191222+0000","last_became_active":"2024-05-30T06:50:35.125864+0000","last_became_peered":"2024-05-30T06:50:35.125864+0000","last_unstale":"2024-05-30T06:50:37.191222+0000","last_undegraded":"2024-05-30T06:50:37.191222+0000","last_fullsized":"2024-05-30T06:50:37.191222+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:04.103814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191224+0000","last_change":"2024-05-30T06:50:36.130870+0000","last_active":"2024-05-30T06:50:37.191224+0000","last_peered":"2024-05-30T06:50:37.191224+0000","last_clean":"2024-05-30T06:50:37.191224+0000","last_became_active":"2024-05-30T06:50:36.130296+0000","last_became_peered":"2024-05-30T06:50:36.130296+0000","last_unstale":"2024-05-30T06:50:37.191224+0000","last_undegraded":"2024-05-30T06:50:37.191224+0000","last_fullsized":"2024-05-30T06:50:37.191224+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:12:29.459735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133579+0000","last_change":"2024-05-30T06:50:35.115426+0000","last_active":"2024-05-30T06:50:37.133579+0000","last_peered":"2024-05-30T06:50:37.133579+0000","last_clean":"2024-05-30T06:50:37.133579+0000","last_became_active":"2024-05-30T06:50:35.115117+0000","last_became_peered":"2024-05-30T06:50:35.115117+0000","last_unstale":"2024-05-30T06:50:37.133579+0000","last_undegraded":"2024-05-30T06:50:37.133579+0000","last_fullsized":"2024-05-30T06:50:37.133579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:00:21.859206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191968+0000","last_change":"2024-05-30T06:50:36.145873+0000","last_active":"2024-05-30T06:50:37.191968+0000","last_peered":"2024-05-30T06:50:37.191968+0000","last_clean":"2024-05-30T06:50:37.191968+0000","last_became_active":"2024-05-30T06:50:36.145712+0000","last_became_peered":"2024-05-30T06:50:36.145712+0000","last_unstale":"2024-05-30T06:50:37.191968+0000","last_undegraded":"2024-05-30T06:50:37.191968+0000","last_fullsized":"2024-05-30T06:50:37.191968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:13:18.388535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133395+0000","last_change":"2024-05-30T06:50:35.128766+0000","last_active":"2024-05-30T06:50:37.133395+0000","last_peered":"2024-05-30T06:50:37.133395+0000","last_clean":"2024-05-30T06:50:37.133395+0000","last_became_active":"2024-05-30T06:50:35.128339+0000","last_became_peered":"2024-05-30T06:50:35.128339+0000","last_unstale":"2024-05-30T06:50:37.133395+0000","last_undegraded":"2024-05-30T06:50:37.133395+0000","last_fullsized":"2024-05-30T06:50:37.133395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:48.855579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136777+0000","last_change":"2024-05-30T06:50:36.136119+0000","last_active":"2024-05-30T06:50:37.136777+0000","last_peered":"2024-05-30T06:50:37.136777+0000","last_clean":"2024-05-30T06:50:37.136777+0000","last_became_active":"2024-05-30T06:50:36.135862+0000","last_became_peered":"2024-05-30T06:50:36.135862+0000","last_unstale":"2024-05-30T06:50:37.136777+0000","last_undegraded":"2024-05-30T06:50:37.136777+0000","last_fullsized":"2024-05-30T06:50:37.136777+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:56:57.945018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.193082+0000","last_change":"2024-05-30T06:50:35.125536+0000","last_active":"2024-05-30T06:50:37.193082+0000","last_peered":"2024-05-30T06:50:37.193082+0000","last_clean":"2024-05-30T06:50:37.193082+0000","last_became_active":"2024-05-30T06:50:35.125221+0000","last_became_peered":"2024-05-30T06:50:35.125221+0000","last_unstale":"2024-05-30T06:50:37.193082+0000","last_undegraded":"2024-05-30T06:50:37.193082+0000","last_fullsized":"2024-05-30T06:50:37.193082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:33:36.208132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189783+0000","last_change":"2024-05-30T06:50:36.128699+0000","last_active":"2024-05-30T06:50:37.189783+0000","last_peered":"2024-05-30T06:50:37.189783+0000","last_clean":"2024-05-30T06:50:37.189783+0000","last_became_active":"2024-05-30T06:50:36.128437+0000","last_became_peered":"2024-05-30T06:50:36.128437+0000","last_unstale":"2024-05-30T06:50:37.189783+0000","last_undegraded":"2024-05-30T06:50:37.189783+0000","last_fullsized":"2024-05-30T06:50:37.189783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:36:45.423083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136052+0000","last_change":"2024-05-30T06:50:35.134033+0000","last_active":"2024-05-30T06:50:37.136052+0000","last_peered":"2024-05-30T06:50:37.136052+0000","last_clean":"2024-05-30T06:50:37.136052+0000","last_became_active":"2024-05-30T06:50:35.133639+0000","last_became_peered":"2024-05-30T06:50:35.133639+0000","last_unstale":"2024-05-30T06:50:37.136052+0000","last_undegraded":"2024-05-30T06:50:37.136052+0000","last_fullsized":"2024-05-30T06:50:37.136052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:01.742927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190598+0000","last_change":"2024-05-30T06:50:36.131744+0000","last_active":"2024-05-30T06:50:37.190598+0000","last_peered":"2024-05-30T06:50:37.190598+0000","last_clean":"2024-05-30T06:50:37.190598+0000","last_became_active":"2024-05-30T06:50:36.131457+0000","last_became_peered":"2024-05-30T06:50:36.131457+0000","last_unstale":"2024-05-30T06:50:37.190598+0000","last_undegraded":"2024-05-30T06:50:37.190598+0000","last_fullsized":"2024-05-30T06:50:37.190598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:59:24.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.135752+0000","last_change":"2024-05-30T06:50:35.136029+0000","last_active":"2024-05-30T06:50:37.135752+0000","last_peered":"2024-05-30T06:50:37.135752+0000","last_clean":"2024-05-30T06:50:37.135752+0000","last_became_active":"2024-05-30T06:50:35.135713+0000","last_became_peered":"2024-05-30T06:50:35.135713+0000","last_unstale":"2024-05-30T06:50:37.135752+0000","last_undegraded":"2024-05-30T06:50:37.135752+0000","last_fullsized":"2024-05-30T06:50:37.135752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:15:02.073672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137214+0000","last_change":"2024-05-30T06:50:36.134135+0000","last_active":"2024-05-30T06:50:37.137214+0000","last_peered":"2024-05-30T06:50:37.137214+0000","last_clean":"2024-05-30T06:50:37.137214+0000","last_became_active":"2024-05-30T06:50:36.133844+0000","last_became_peered":"2024-05-30T06:50:36.133844+0000","last_unstale":"2024-05-30T06:50:37.137214+0000","last_undegraded":"2024-05-30T06:50:37.137214+0000","last_fullsized":"2024-05-30T06:50:37.137214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:31:40.226715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.193019+0000","last_change":"2024-05-30T06:50:35.128218+0000","last_active":"2024-05-30T06:50:37.193019+0000","last_peered":"2024-05-30T06:50:37.193019+0000","last_clean":"2024-05-30T06:50:37.193019+0000","last_became_active":"2024-05-30T06:50:35.127706+0000","last_became_peered":"2024-05-30T06:50:35.127706+0000","last_unstale":"2024-05-30T06:50:37.193019+0000","last_undegraded":"2024-05-30T06:50:37.193019+0000","last_fullsized":"2024-05-30T06:50:37.193019+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:48.855579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192841+0000","last_change":"2024-05-30T06:50:36.148013+0000","last_active":"2024-05-30T06:50:37.192841+0000","last_peered":"2024-05-30T06:50:37.192841+0000","last_clean":"2024-05-30T06:50:37.192841+0000","last_became_active":"2024-05-30T06:50:36.147503+0000","last_became_peered":"2024-05-30T06:50:36.147503+0000","last_unstale":"2024-05-30T06:50:37.192841+0000","last_undegraded":"2024-05-30T06:50:37.192841+0000","last_fullsized":"2024-05-30T06:50:37.192841+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:49:49.412116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137298+0000","last_change":"2024-05-30T06:50:35.131458+0000","last_active":"2024-05-30T06:50:37.137298+0000","last_peered":"2024-05-30T06:50:37.137298+0000","last_clean":"2024-05-30T06:50:37.137298+0000","last_became_active":"2024-05-30T06:50:35.129558+0000","last_became_peered":"2024-05-30T06:50:35.129558+0000","last_unstale":"2024-05-30T06:50:37.137298+0000","last_undegraded":"2024-05-30T06:50:37.137298+0000","last_fullsized":"2024-05-30T06:50:37.137298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:20:45.793165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133605+0000","last_change":"2024-05-30T06:50:36.132603+0000","last_active":"2024-05-30T06:50:37.133605+0000","last_peered":"2024-05-30T06:50:37.133605+0000","last_clean":"2024-05-30T06:50:37.133605+0000","last_became_active":"2024-05-30T06:50:36.132338+0000","last_became_peered":"2024-05-30T06:50:36.132338+0000","last_unstale":"2024-05-30T06:50:37.133605+0000","last_undegraded":"2024-05-30T06:50:37.133605+0000","last_fullsized":"2024-05-30T06:50:37.133605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:15.956026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192405+0000","last_change":"2024-05-30T06:50:35.133861+0000","last_active":"2024-05-30T06:50:37.192405+0000","last_peered":"2024-05-30T06:50:37.192405+0000","last_clean":"2024-05-30T06:50:37.192405+0000","last_became_active":"2024-05-30T06:50:35.133568+0000","last_became_peered":"2024-05-30T06:50:35.133568+0000","last_unstale":"2024-05-30T06:50:37.192405+0000","last_undegraded":"2024-05-30T06:50:37.192405+0000","last_fullsized":"2024-05-30T06:50:37.192405+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:56:18.728983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191380+0000","last_change":"2024-05-30T06:50:36.131097+0000","last_active":"2024-05-30T06:50:37.191380+0000","last_peered":"2024-05-30T06:50:37.191380+0000","last_clean":"2024-05-30T06:50:37.191380+0000","last_became_active":"2024-05-30T06:50:36.130633+0000","last_became_peered":"2024-05-30T06:50:36.130633+0000","last_unstale":"2024-05-30T06:50:37.191380+0000","last_undegraded":"2024-05-30T06:50:37.191380+0000","last_fullsized":"2024-05-30T06:50:37.191380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:58.210674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192643+0000","last_change":"2024-05-30T06:50:35.135020+0000","last_active":"2024-05-30T06:50:37.192643+0000","last_peered":"2024-05-30T06:50:37.192643+0000","last_clean":"2024-05-30T06:50:37.192643+0000","last_became_active":"2024-05-30T06:50:35.134670+0000","last_became_peered":"2024-05-30T06:50:35.134670+0000","last_unstale":"2024-05-30T06:50:37.192643+0000","last_undegraded":"2024-05-30T06:50:37.192643+0000","last_fullsized":"2024-05-30T06:50:37.192643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:00:52.604142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190438+0000","last_change":"2024-05-30T06:50:36.132872+0000","last_active":"2024-05-30T06:50:37.190438+0000","last_peered":"2024-05-30T06:50:37.190438+0000","last_clean":"2024-05-30T06:50:37.190438+0000","last_became_active":"2024-05-30T06:50:36.132575+0000","last_became_peered":"2024-05-30T06:50:36.132575+0000","last_unstale":"2024-05-30T06:50:37.190438+0000","last_undegraded":"2024-05-30T06:50:37.190438+0000","last_fullsized":"2024-05-30T06:50:37.190438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:20:55.332407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.193068+0000","last_change":"2024-05-30T06:50:35.132673+0000","last_active":"2024-05-30T06:50:37.193068+0000","last_peered":"2024-05-30T06:50:37.193068+0000","last_clean":"2024-05-30T06:50:37.193068+0000","last_became_active":"2024-05-30T06:50:35.131785+0000","last_became_peered":"2024-05-30T06:50:35.131785+0000","last_unstale":"2024-05-30T06:50:37.193068+0000","last_undegraded":"2024-05-30T06:50:37.193068+0000","last_fullsized":"2024-05-30T06:50:37.193068+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:18.617610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190597+0000","last_change":"2024-05-30T06:50:36.147488+0000","last_active":"2024-05-30T06:50:37.190597+0000","last_peered":"2024-05-30T06:50:37.190597+0000","last_clean":"2024-05-30T06:50:37.190597+0000","last_became_active":"2024-05-30T06:50:36.147127+0000","last_became_peered":"2024-05-30T06:50:36.147127+0000","last_unstale":"2024-05-30T06:50:37.190597+0000","last_undegraded":"2024-05-30T06:50:37.190597+0000","last_fullsized":"2024-05-30T06:50:37.190597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:39:18.706486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136181+0000","last_change":"2024-05-30T06:50:35.121519+0000","last_active":"2024-05-30T06:50:37.136181+0000","last_peered":"2024-05-30T06:50:37.136181+0000","last_clean":"2024-05-30T06:50:37.136181+0000","last_became_active":"2024-05-30T06:50:35.121245+0000","last_became_peered":"2024-05-30T06:50:35.121245+0000","last_unstale":"2024-05-30T06:50:37.136181+0000","last_undegraded":"2024-05-30T06:50:37.136181+0000","last_fullsized":"2024-05-30T06:50:37.136181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:42:34.991573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191167+0000","last_change":"2024-05-30T06:50:36.147478+0000","last_active":"2024-05-30T06:50:37.191167+0000","last_peered":"2024-05-30T06:50:37.191167+0000","last_clean":"2024-05-30T06:50:37.191167+0000","last_became_active":"2024-05-30T06:50:36.147202+0000","last_became_peered":"2024-05-30T06:50:36.147202+0000","last_unstale":"2024-05-30T06:50:37.191167+0000","last_undegraded":"2024-05-30T06:50:37.191167+0000","last_fullsized":"2024-05-30T06:50:37.191167+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:02:01.998106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189714+0000","last_change":"2024-05-30T06:50:35.132241+0000","last_active":"2024-05-30T06:50:37.189714+0000","last_peered":"2024-05-30T06:50:37.189714+0000","last_clean":"2024-05-30T06:50:37.189714+0000","last_became_active":"2024-05-30T06:50:35.131928+0000","last_became_peered":"2024-05-30T06:50:35.131928+0000","last_unstale":"2024-05-30T06:50:37.189714+0000","last_undegraded":"2024-05-30T06:50:37.189714+0000","last_fullsized":"2024-05-30T06:50:37.189714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:27:26.418862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190605+0000","last_change":"2024-05-30T06:50:36.133274+0000","last_active":"2024-05-30T06:50:37.190605+0000","last_peered":"2024-05-30T06:50:37.190605+0000","last_clean":"2024-05-30T06:50:37.190605+0000","last_became_active":"2024-05-30T06:50:36.133004+0000","last_became_peered":"2024-05-30T06:50:36.133004+0000","last_unstale":"2024-05-30T06:50:37.190605+0000","last_undegraded":"2024-05-30T06:50:37.190605+0000","last_fullsized":"2024-05-30T06:50:37.190605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:07:33.282727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192797+0000","last_change":"2024-05-30T06:50:35.128349+0000","last_active":"2024-05-30T06:50:37.192797+0000","last_peered":"2024-05-30T06:50:37.192797+0000","last_clean":"2024-05-30T06:50:37.192797+0000","last_became_active":"2024-05-30T06:50:35.128091+0000","last_became_peered":"2024-05-30T06:50:35.128091+0000","last_unstale":"2024-05-30T06:50:37.192797+0000","last_undegraded":"2024-05-30T06:50:37.192797+0000","last_fullsized":"2024-05-30T06:50:37.192797+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:00:21.859206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137210+0000","last_change":"2024-05-30T06:50:36.127379+0000","last_active":"2024-05-30T06:50:37.137210+0000","last_peered":"2024-05-30T06:50:37.137210+0000","last_clean":"2024-05-30T06:50:37.137210+0000","last_became_active":"2024-05-30T06:50:36.127078+0000","last_became_peered":"2024-05-30T06:50:36.127078+0000","last_unstale":"2024-05-30T06:50:37.137210+0000","last_undegraded":"2024-05-30T06:50:37.137210+0000","last_fullsized":"2024-05-30T06:50:37.137210+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:44:28.467327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:38.122025+0000","last_change":"2024-05-30T06:50:35.131220+0000","last_active":"2024-05-30T06:50:38.122025+0000","last_peered":"2024-05-30T06:50:38.122025+0000","last_clean":"2024-05-30T06:50:38.122025+0000","last_became_active":"2024-05-30T06:50:35.130941+0000","last_became_peered":"2024-05-30T06:50:35.130941+0000","last_unstale":"2024-05-30T06:50:38.122025+0000","last_undegraded":"2024-05-30T06:50:38.122025+0000","last_fullsized":"2024-05-30T06:50:38.122025+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:25.867400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192660+0000","last_change":"2024-05-30T06:50:36.149218+0000","last_active":"2024-05-30T06:50:37.192660+0000","last_peered":"2024-05-30T06:50:37.192660+0000","last_clean":"2024-05-30T06:50:37.192660+0000","last_became_active":"2024-05-30T06:50:36.148877+0000","last_became_peered":"2024-05-30T06:50:36.148877+0000","last_unstale":"2024-05-30T06:50:37.192660+0000","last_undegraded":"2024-05-30T06:50:37.192660+0000","last_fullsized":"2024-05-30T06:50:37.192660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:18:23.790436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191475+0000","last_change":"2024-05-30T06:50:35.130139+0000","last_active":"2024-05-30T06:50:37.191475+0000","last_peered":"2024-05-30T06:50:37.191475+0000","last_clean":"2024-05-30T06:50:37.191475+0000","last_became_active":"2024-05-30T06:50:35.129737+0000","last_became_peered":"2024-05-30T06:50:35.129737+0000","last_unstale":"2024-05-30T06:50:37.191475+0000","last_undegraded":"2024-05-30T06:50:37.191475+0000","last_fullsized":"2024-05-30T06:50:37.191475+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:21.214580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192999+0000","last_change":"2024-05-30T06:50:36.137637+0000","last_active":"2024-05-30T06:50:37.192999+0000","last_peered":"2024-05-30T06:50:37.192999+0000","last_clean":"2024-05-30T06:50:37.192999+0000","last_became_active":"2024-05-30T06:50:36.133825+0000","last_became_peered":"2024-05-30T06:50:36.133825+0000","last_unstale":"2024-05-30T06:50:37.192999+0000","last_undegraded":"2024-05-30T06:50:37.192999+0000","last_fullsized":"2024-05-30T06:50:37.192999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:56:49.909109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190140+0000","last_change":"2024-05-30T06:50:35.133839+0000","last_active":"2024-05-30T06:50:37.190140+0000","last_peered":"2024-05-30T06:50:37.190140+0000","last_clean":"2024-05-30T06:50:37.190140+0000","last_became_active":"2024-05-30T06:50:35.133509+0000","last_became_peered":"2024-05-30T06:50:35.133509+0000","last_unstale":"2024-05-30T06:50:37.190140+0000","last_undegraded":"2024-05-30T06:50:37.190140+0000","last_fullsized":"2024-05-30T06:50:37.190140+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:14:41.337933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191005+0000","last_change":"2024-05-30T06:50:36.128003+0000","last_active":"2024-05-30T06:50:37.191005+0000","last_peered":"2024-05-30T06:50:37.191005+0000","last_clean":"2024-05-30T06:50:37.191005+0000","last_became_active":"2024-05-30T06:50:36.127402+0000","last_became_peered":"2024-05-30T06:50:36.127402+0000","last_unstale":"2024-05-30T06:50:37.191005+0000","last_undegraded":"2024-05-30T06:50:37.191005+0000","last_fullsized":"2024-05-30T06:50:37.191005+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:55:12.624496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191040+0000","last_change":"2024-05-30T06:50:35.120912+0000","last_active":"2024-05-30T06:50:37.191040+0000","last_peered":"2024-05-30T06:50:37.191040+0000","last_clean":"2024-05-30T06:50:37.191040+0000","last_became_active":"2024-05-30T06:50:35.120133+0000","last_became_peered":"2024-05-30T06:50:35.120133+0000","last_unstale":"2024-05-30T06:50:37.191040+0000","last_undegraded":"2024-05-30T06:50:37.191040+0000","last_fullsized":"2024-05-30T06:50:37.191040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:06:53.698943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192803+0000","last_change":"2024-05-30T06:50:36.137692+0000","last_active":"2024-05-30T06:50:37.192803+0000","last_peered":"2024-05-30T06:50:37.192803+0000","last_clean":"2024-05-30T06:50:37.192803+0000","last_became_active":"2024-05-30T06:50:36.137348+0000","last_became_peered":"2024-05-30T06:50:36.137348+0000","last_unstale":"2024-05-30T06:50:37.192803+0000","last_undegraded":"2024-05-30T06:50:37.192803+0000","last_fullsized":"2024-05-30T06:50:37.192803+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:46:18.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133238+0000","last_change":"2024-05-30T06:50:35.129598+0000","last_active":"2024-05-30T06:50:37.133238+0000","last_peered":"2024-05-30T06:50:37.133238+0000","last_clean":"2024-05-30T06:50:37.133238+0000","last_became_active":"2024-05-30T06:50:35.129318+0000","last_became_peered":"2024-05-30T06:50:35.129318+0000","last_unstale":"2024-05-30T06:50:37.133238+0000","last_undegraded":"2024-05-30T06:50:37.133238+0000","last_fullsized":"2024-05-30T06:50:37.133238+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:31:19.427293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.134066+0000","last_change":"2024-05-30T06:50:36.132474+0000","last_active":"2024-05-30T06:50:37.134066+0000","last_peered":"2024-05-30T06:50:37.134066+0000","last_clean":"2024-05-30T06:50:37.134066+0000","last_became_active":"2024-05-30T06:50:36.132096+0000","last_became_peered":"2024-05-30T06:50:36.132096+0000","last_unstale":"2024-05-30T06:50:37.134066+0000","last_undegraded":"2024-05-30T06:50:37.134066+0000","last_fullsized":"2024-05-30T06:50:37.134066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:56:10.332933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.135971+0000","last_change":"2024-05-30T06:50:35.133302+0000","last_active":"2024-05-30T06:50:37.135971+0000","last_peered":"2024-05-30T06:50:37.135971+0000","last_clean":"2024-05-30T06:50:37.135971+0000","last_became_active":"2024-05-30T06:50:35.132843+0000","last_became_peered":"2024-05-30T06:50:35.132843+0000","last_unstale":"2024-05-30T06:50:37.135971+0000","last_undegraded":"2024-05-30T06:50:37.135971+0000","last_fullsized":"2024-05-30T06:50:37.135971+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:56:09.324161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192151+0000","last_change":"2024-05-30T06:50:36.137950+0000","last_active":"2024-05-30T06:50:37.192151+0000","last_peered":"2024-05-30T06:50:37.192151+0000","last_clean":"2024-05-30T06:50:37.192151+0000","last_became_active":"2024-05-30T06:50:36.137696+0000","last_became_peered":"2024-05-30T06:50:36.137696+0000","last_unstale":"2024-05-30T06:50:37.192151+0000","last_undegraded":"2024-05-30T06:50:37.192151+0000","last_fullsized":"2024-05-30T06:50:37.192151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:27:30.281514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192111+0000","last_change":"2024-05-30T06:50:35.133777+0000","last_active":"2024-05-30T06:50:37.192111+0000","last_peered":"2024-05-30T06:50:37.192111+0000","last_clean":"2024-05-30T06:50:37.192111+0000","last_became_active":"2024-05-30T06:50:35.129708+0000","last_became_peered":"2024-05-30T06:50:35.129708+0000","last_unstale":"2024-05-30T06:50:37.192111+0000","last_undegraded":"2024-05-30T06:50:37.192111+0000","last_fullsized":"2024-05-30T06:50:37.192111+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:38:41.689658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191653+0000","last_change":"2024-05-30T06:50:36.147464+0000","last_active":"2024-05-30T06:50:37.191653+0000","last_peered":"2024-05-30T06:50:37.191653+0000","last_clean":"2024-05-30T06:50:37.191653+0000","last_became_active":"2024-05-30T06:50:36.146592+0000","last_became_peered":"2024-05-30T06:50:36.146592+0000","last_unstale":"2024-05-30T06:50:37.191653+0000","last_undegraded":"2024-05-30T06:50:37.191653+0000","last_fullsized":"2024-05-30T06:50:37.191653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:47:48.079037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192646+0000","last_change":"2024-05-30T06:50:35.124280+0000","last_active":"2024-05-30T06:50:37.192646+0000","last_peered":"2024-05-30T06:50:37.192646+0000","last_clean":"2024-05-30T06:50:37.192646+0000","last_became_active":"2024-05-30T06:50:35.123615+0000","last_became_peered":"2024-05-30T06:50:35.123615+0000","last_unstale":"2024-05-30T06:50:37.192646+0000","last_undegraded":"2024-05-30T06:50:37.192646+0000","last_fullsized":"2024-05-30T06:50:37.192646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:35:34.494559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":271,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191782+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:50:37.191782+0000","last_peered":"2024-05-30T06:50:37.191782+0000","last_clean":"2024-05-30T06:50:37.191782+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:50:37.191782+0000","last_undegraded":"2024-05-30T06:50:37.191782+0000","last_fullsized":"2024-05-30T06:50:37.191782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574955,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54844,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316996,"statfs":{"total":96636764160,"available":96580603904,"internally_reserved":0,"allocated":1490944,"data_stored":970528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54272,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":897024,"data_stored":379636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574956,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54268,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317572,"statfs":{"total":96636764160,"available":96581193728,"internally_reserved":0,"allocated":892928,"data_stored":379634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574955,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54260,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317580,"statfs":{"total":96636764160,"available":96581201920,"internally_reserved":0,"allocated":892928,"data_stored":379614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574955,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58428,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313412,"statfs":{"total":96636764160,"available":96576933888,"internally_reserved":0,"allocated":897024,"data_stored":379656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50116,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321724,"statfs":{"total":96636764160,"available":96585445376,"internally_reserved":0,"allocated":901120,"data_stored":381156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54280,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317560,"statfs":{"total":96636764160,"available":96581181440,"internally_reserved":0,"allocated":909312,"data_stored":381772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54836,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317004,"statfs":{"total":96636764160,"available":96580612096,"internally_reserved":0,"allocated":1482752,"data_stored":969912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:50:41.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-30T06:50:41.084 INFO:tasks.ceph.mds.a.smithi037.stderr:2024-05-30T06:50:41.085+0000 7f04bea00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T06:50:41.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.221+0000 7f9735e00640 1 Processor -- start 2024-05-30T06:50:41.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.221+0000 7f9735e00640 1 -- start start 2024-05-30T06:50:41.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.225+0000 7f9735e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9730155e60 0x7f97300b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:41.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.225+0000 7f9735e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97300b2ec0 0x7f97300cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:41.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.225+0000 7f9735e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f973015c8f0 con 0x7f973006f9a0 2024-05-30T06:50:41.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.225+0000 7f9735e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f97300ccff0 con 0x7f97300b2ec0 2024-05-30T06:50:41.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.225+0000 7f9735e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f97300ccc80 con 0x7f9730155e60 2024-05-30T06:50:41.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.225+0000 7f972f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97300b2ec0 0x7f97300cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:41.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.225+0000 7f972f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97300b2ec0 0x7f97300cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43988/0 (socket says 172.21.15.37:43988) 2024-05-30T06:50:41.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.225+0000 7f972f400640 1 -- 172.21.15.37:0/1786255307 learned_addr learned my addr 172.21.15.37:0/1786255307 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:41.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.225+0000 7f972ea00640 1 --2- 172.21.15.37:0/1786255307 >> v2:172.21.15.105:3300/0 conn(0x7f9730155e60 0x7f97300b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:41.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.225+0000 7f972f400640 1 -- 172.21.15.37:0/1786255307 >> v2:172.21.15.105:3300/0 conn(0x7f9730155e60 msgr2=0x7f97300b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:41.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.225+0000 7f972f400640 1 --2- 172.21.15.37:0/1786255307 >> v2:172.21.15.105:3300/0 conn(0x7f9730155e60 0x7f97300b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.225+0000 7f972f400640 1 -- 172.21.15.37:0/1786255307 >> v1:172.21.15.105:6789/0 conn(0x7f973006f9a0 legacy=0x7f97300cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:41.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.225+0000 7f972f400640 1 -- 172.21.15.37:0/1786255307 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973015cbd0 con 0x7f97300b2ec0 2024-05-30T06:50:41.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f972f400640 1 --2- 172.21.15.37:0/1786255307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97300b2ec0 0x7f97300cd480 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f9730073930 tx=0x7f972801ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e03a92f6ca49372 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:41.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f972e000640 1 -- 172.21.15.37:0/1786255307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f972800b2d0 con 0x7f97300b2ec0 2024-05-30T06:50:41.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f972e000640 1 -- 172.21.15.37:0/1786255307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f972800b470 con 0x7f97300b2ec0 2024-05-30T06:50:41.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f972e000640 1 -- 172.21.15.37:0/1786255307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97280a7bb0 con 0x7f97300b2ec0 2024-05-30T06:50:41.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f9735e00640 1 -- 172.21.15.37:0/1786255307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97300b2ec0 msgr2=0x7f97300cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:41.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f9735e00640 1 --2- 172.21.15.37:0/1786255307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97300b2ec0 0x7f97300cd480 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f9730073930 tx=0x7f972801ebb0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f9735e00640 1 -- 172.21.15.37:0/1786255307 shutdown_connections 2024-05-30T06:50:41.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f9735e00640 1 --2- 172.21.15.37:0/1786255307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97300b2ec0 0x7f97300cd480 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f9735e00640 1 --2- 172.21.15.37:0/1786255307 >> v2:172.21.15.105:3300/0 conn(0x7f9730155e60 0x7f97300b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f9735e00640 1 -- 172.21.15.37:0/1786255307 >> 172.21.15.37:0/1786255307 conn(0x7f97300b23a0 msgr2=0x7f97300b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f9735e00640 1 -- 172.21.15.37:0/1786255307 shutdown_connections 2024-05-30T06:50:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f9735e00640 1 -- 172.21.15.37:0/1786255307 wait complete. 2024-05-30T06:50:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f9735e00640 1 Processor -- start 2024-05-30T06:50:41.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.229+0000 7f9735e00640 1 -- start start 2024-05-30T06:50:41.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9735e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f973006f9a0 0x7f973015e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:41.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9735e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97300b2ec0 0x7f9730150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:41.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9735e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9730155e60 0x7f9730153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:41.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9735e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f973006ec60 con 0x7f9730155e60 2024-05-30T06:50:41.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9735e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f973006eae0 con 0x7f97300b2ec0 2024-05-30T06:50:41.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9735e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f973006ede0 con 0x7f973006f9a0 2024-05-30T06:50:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f972f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9730155e60 0x7f9730153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f972f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9730155e60 0x7f9730153e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43992/0 (socket says 172.21.15.37:43992) 2024-05-30T06:50:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f972f400640 1 -- 172.21.15.37:0/2651478871 learned_addr learned my addr 172.21.15.37:0/2651478871 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f972ea00640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f973006f9a0 0x7f973015e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9727e00640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97300b2ec0 0x7f9730150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f972f400640 1 -- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f973006f9a0 msgr2=0x7f973015e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f972f400640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f973006f9a0 0x7f973015e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f972f400640 1 -- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97300b2ec0 msgr2=0x7f9730150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f972f400640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97300b2ec0 0x7f9730150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f972f400640 1 -- 172.21.15.37:0/2651478871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97301512d0 con 0x7f9730155e60 2024-05-30T06:50:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f972f400640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9730155e60 0x7f9730153e10 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f972801c7e0 tx=0x7f972801b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9727400640 1 -- 172.21.15.37:0/2651478871 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9728009800 con 0x7f9730155e60 2024-05-30T06:50:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9727400640 1 -- 172.21.15.37:0/2651478871 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97280c0070 con 0x7f9730155e60 2024-05-30T06:50:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9735e00640 1 -- 172.21.15.37:0/2651478871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9730158210 con 0x7f9730155e60 2024-05-30T06:50:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9727400640 1 -- 172.21.15.37:0/2651478871 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9728009be0 con 0x7f9730155e60 2024-05-30T06:50:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9735e00640 1 -- 172.21.15.37:0/2651478871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97301587d0 con 0x7f9730155e60 2024-05-30T06:50:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9735e00640 1 -- 172.21.15.37:0/2651478871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f973006e2b0 con 0x7f9730155e60 2024-05-30T06:50:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.233+0000 7f9727400640 1 -- 172.21.15.37:0/2651478871 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f972800b2e0 con 0x7f9730155e60 2024-05-30T06:50:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.237+0000 7f9727400640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f970c069100 0x7f970c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.237+0000 7f9727400640 1 -- 172.21.15.37:0/2651478871 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f9728122850 con 0x7f9730155e60 2024-05-30T06:50:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.237+0000 7f972ea00640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f970c069100 0x7f970c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:41.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.237+0000 7f972ea00640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f970c069100 0x7f970c06b5c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f97301665f0 tx=0x7f9720008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:41.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.241+0000 7f9727400640 1 -- 172.21.15.37:0/2651478871 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f97280187a0 con 0x7f9730155e60 2024-05-30T06:50:41.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.469+0000 7f9735e00640 1 -- 172.21.15.37:0/2651478871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9730072fb0 con 0x7f9730155e60 2024-05-30T06:50:41.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.469+0000 7f9727400640 1 -- 172.21.15.37:0/2651478871 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1014 (secure 0 0 0) 0x7f97280f3f60 con 0x7f9730155e60 2024-05-30T06:50:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:41.472 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":535,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":73,"num_osds":8,"num_up_osds":8,"osd_up_since":1717051317,"num_in_osds":8,"osd_in_since":1717051308,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":445751296,"bytes_avail":772648361984,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":46,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6939}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-05-30T06:49:42.776273+0000","services":{}},"progress_events":{}} 2024-05-30T06:50:41.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.473+0000 7f9735e00640 1 -- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f970c069100 msgr2=0x7f970c06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.473+0000 7f9735e00640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f970c069100 0x7f970c06b5c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f97301665f0 tx=0x7f9720008040 comp rx=0 tx=0).stop 2024-05-30T06:50:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.473+0000 7f9735e00640 1 -- 172.21.15.37:0/2651478871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9730155e60 msgr2=0x7f9730153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.473+0000 7f9735e00640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9730155e60 0x7f9730153e10 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f972801c7e0 tx=0x7f972801b950 comp rx=0 tx=0).stop 2024-05-30T06:50:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.473+0000 7f9735e00640 1 -- 172.21.15.37:0/2651478871 shutdown_connections 2024-05-30T06:50:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.473+0000 7f9735e00640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9730155e60 0x7f9730153e10 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.473+0000 7f9735e00640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f970c069100 0x7f970c06b5c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.473+0000 7f9735e00640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97300b2ec0 0x7f9730150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.473+0000 7f9735e00640 1 --2- 172.21.15.37:0/2651478871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f973006f9a0 0x7f973015e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.473+0000 7f9735e00640 1 -- 172.21.15.37:0/2651478871 >> 172.21.15.37:0/2651478871 conn(0x7f97300b23a0 msgr2=0x7f97300b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.473+0000 7f9735e00640 1 -- 172.21.15.37:0/2651478871 shutdown_connections 2024-05-30T06:50:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.473+0000 7f9735e00640 1 -- 172.21.15.37:0/2651478871 wait complete. 2024-05-30T06:50:41.494 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-30T06:50:41.494 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:50:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.633+0000 7f4c27000640 1 Processor -- start 2024-05-30T06:50:41.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.633+0000 7f4c27000640 1 -- start start 2024-05-30T06:50:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.633+0000 7f4c27000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c20155e60 0x7f4c200b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:41.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.633+0000 7f4c27000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4c200b2ec0 0x7f4c200cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:41.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.633+0000 7f4c27000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c2015c8f0 con 0x7f4c2006f9a0 2024-05-30T06:50:41.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.633+0000 7f4c27000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4c200ccff0 con 0x7f4c200b2ec0 2024-05-30T06:50:41.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.633+0000 7f4c27000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4c200ccc80 con 0x7f4c20155e60 2024-05-30T06:50:41.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.637+0000 7f4c17400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4c2006f9a0 0x7f4c200cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59662/0 (socket says 172.21.15.37:59662) 2024-05-30T06:50:41.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.637+0000 7f4c17400640 1 -- 172.21.15.37:0/4061833862 learned_addr learned my addr 172.21.15.37:0/4061833862 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:41.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.637+0000 7f4c25000640 1 --2- 172.21.15.37:0/4061833862 >> v2:172.21.15.105:3300/0 conn(0x7f4c200b2ec0 0x7f4c200cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:41.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.637+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/4061833862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c20155e60 0x7f4c200b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.637+0000 7f4c1f400640 1 -- 172.21.15.37:0/4061833862 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2599373299 0 0) 0x7f4c2015c8f0 con 0x7f4c2006f9a0 2024-05-30T06:50:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.637+0000 7f4c1f400640 1 -- 172.21.15.37:0/4061833862 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c04005740 con 0x7f4c2006f9a0 2024-05-30T06:50:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.637+0000 7f4c1f400640 1 -- 172.21.15.37:0/4061833862 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3248588495 0 0) 0x7f4c04005740 con 0x7f4c2006f9a0 2024-05-30T06:50:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.637+0000 7f4c1fe00640 1 -- 172.21.15.37:0/4061833862 >> v2:172.21.15.105:3300/0 conn(0x7f4c200b2ec0 msgr2=0x7f4c200cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.637+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/4061833862 >> v2:172.21.15.105:3300/0 conn(0x7f4c200b2ec0 0x7f4c200cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.637+0000 7f4c1fe00640 1 -- 172.21.15.37:0/4061833862 >> v1:172.21.15.37:6789/0 conn(0x7f4c2006f9a0 legacy=0x7f4c200cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.637+0000 7f4c1fe00640 1 -- 172.21.15.37:0/4061833862 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2015cbd0 con 0x7f4c20155e60 2024-05-30T06:50:41.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.637+0000 7f4c25000640 1 --2- 172.21.15.37:0/4061833862 >> v2:172.21.15.105:3300/0 conn(0x7f4c200b2ec0 0x7f4c200cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:41.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/4061833862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c20155e60 0x7f4c200b36a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4c100097c0 tx=0x7f4c1001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c81f2791ca444252 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c1f400640 1 -- 172.21.15.37:0/4061833862 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c100b0070 con 0x7f4c20155e60 2024-05-30T06:50:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c1f400640 1 -- 172.21.15.37:0/4061833862 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c100ab400 con 0x7f4c20155e60 2024-05-30T06:50:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c1f400640 1 -- 172.21.15.37:0/4061833862 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08001680 con 0x7f4c20155e60 2024-05-30T06:50:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 -- 172.21.15.37:0/4061833862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c20155e60 msgr2=0x7f4c200b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:41.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 --2- 172.21.15.37:0/4061833862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c20155e60 0x7f4c200b36a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4c100097c0 tx=0x7f4c1001c3c0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 -- 172.21.15.37:0/4061833862 shutdown_connections 2024-05-30T06:50:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 --2- 172.21.15.37:0/4061833862 >> v2:172.21.15.105:3300/0 conn(0x7f4c200b2ec0 0x7f4c200cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 --2- 172.21.15.37:0/4061833862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c20155e60 0x7f4c200b36a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 -- 172.21.15.37:0/4061833862 >> 172.21.15.37:0/4061833862 conn(0x7f4c200b23a0 msgr2=0x7f4c200b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 -- 172.21.15.37:0/4061833862 shutdown_connections 2024-05-30T06:50:41.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 -- 172.21.15.37:0/4061833862 wait complete. 2024-05-30T06:50:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 Processor -- start 2024-05-30T06:50:41.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 -- start start 2024-05-30T06:50:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c2006f9a0 0x7f4c201fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c200b2ec0 0x7f4c20153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c20155e60 0x7f4c2015a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2006ec20 con 0x7f4c200b2ec0 2024-05-30T06:50:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2006eaa0 con 0x7f4c20155e60 2024-05-30T06:50:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.641+0000 7f4c27000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2006eda0 con 0x7f4c2006f9a0 2024-05-30T06:50:41.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c17400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c200b2ec0 0x7f4c20153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c17400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c200b2ec0 0x7f4c20153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44004/0 (socket says 172.21.15.37:44004) 2024-05-30T06:50:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c17400640 1 -- 172.21.15.37:0/1953181427 learned_addr learned my addr 172.21.15.37:0/1953181427 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c25000640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c20155e60 0x7f4c2015a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c2006f9a0 0x7f4c201fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c17400640 1 -- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c2006f9a0 msgr2=0x7f4c201fa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c17400640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c2006f9a0 0x7f4c201fa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c17400640 1 -- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c20155e60 msgr2=0x7f4c2015a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c17400640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c20155e60 0x7f4c2015a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c17400640 1 -- 172.21.15.37:0/1953181427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c20154970 con 0x7f4c200b2ec0 2024-05-30T06:50:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c25000640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c20155e60 0x7f4c2015a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:41.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c17400640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c200b2ec0 0x7f4c20153ef0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f4c080017f0 tx=0x7f4c0800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:41.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c1cc00640 1 -- 172.21.15.37:0/1953181427 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08005ae0 con 0x7f4c200b2ec0 2024-05-30T06:50:41.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c1cc00640 1 -- 172.21.15.37:0/1953181427 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c08005c80 con 0x7f4c200b2ec0 2024-05-30T06:50:41.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c1cc00640 1 -- 172.21.15.37:0/1953181427 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c080072b0 con 0x7f4c200b2ec0 2024-05-30T06:50:41.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c27000640 1 -- 172.21.15.37:0/1953181427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c20154c50 con 0x7f4c200b2ec0 2024-05-30T06:50:41.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c27000640 1 -- 172.21.15.37:0/1953181427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c20155210 con 0x7f4c200b2ec0 2024-05-30T06:50:41.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c27000640 1 -- 172.21.15.37:0/1953181427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c20068b20 con 0x7f4c200b2ec0 2024-05-30T06:50:41.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.645+0000 7f4c1cc00640 1 -- 172.21.15.37:0/1953181427 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f4c08007450 con 0x7f4c200b2ec0 2024-05-30T06:50:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.649+0000 7f4c1cc00640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bfc069130 0x7f4bfc06b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.649+0000 7f4c1cc00640 1 -- 172.21.15.37:0/1953181427 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f4c08085470 con 0x7f4c200b2ec0 2024-05-30T06:50:41.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.649+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bfc069130 0x7f4bfc06b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:41.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.649+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bfc069130 0x7f4bfc06b5f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4c100ad000 tx=0x7f4c100a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:41.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.653+0000 7f4c1cc00640 1 -- 172.21.15.37:0/1953181427 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4c080571d0 con 0x7f4c200b2ec0 2024-05-30T06:50:41.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.813+0000 7f4c27000640 1 -- 172.21.15.37:0/1953181427 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c20072fb0 con 0x7f4bfc069130 2024-05-30T06:50:41.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.821+0000 7f4c1cc00640 1 -- 172.21.15.37:0/1953181427 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252069 (secure 0 0 0) 0x7f4c20072fb0 con 0x7f4bfc069130 2024-05-30T06:50:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:41.827 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:50:41.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.825+0000 7f4c27000640 1 -- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bfc069130 msgr2=0x7f4bfc06b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.825+0000 7f4c27000640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bfc069130 0x7f4bfc06b5f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4c100ad000 tx=0x7f4c100a6000 comp rx=0 tx=0).stop 2024-05-30T06:50:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.825+0000 7f4c27000640 1 -- 172.21.15.37:0/1953181427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c200b2ec0 msgr2=0x7f4c20153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.825+0000 7f4c27000640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c200b2ec0 0x7f4c20153ef0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f4c080017f0 tx=0x7f4c0800cbe0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.825+0000 7f4c27000640 1 -- 172.21.15.37:0/1953181427 shutdown_connections 2024-05-30T06:50:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.825+0000 7f4c27000640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4bfc069130 0x7f4bfc06b5f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.825+0000 7f4c27000640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c20155e60 0x7f4c2015a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.825+0000 7f4c27000640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c200b2ec0 0x7f4c20153ef0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.825+0000 7f4c27000640 1 --2- 172.21.15.37:0/1953181427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c2006f9a0 0x7f4c201fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.825+0000 7f4c27000640 1 -- 172.21.15.37:0/1953181427 >> 172.21.15.37:0/1953181427 conn(0x7f4c200b23a0 msgr2=0x7f4c20150cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.825+0000 7f4c27000640 1 -- 172.21.15.37:0/1953181427 shutdown_connections 2024-05-30T06:50:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:41.825+0000 7f4c27000640 1 -- 172.21.15.37:0/1953181427 wait complete. 2024-05-30T06:50:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-05-30T06:50:40.791098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":435304,"kb_used_data":8168,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754539416,"statfs":{"total":773094113280,"available":772648361984,"internally_reserved":0,"allocated":8364032,"data_stored":4221908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":437243440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001531"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192368+0000","last_change":"2024-05-30T06:50:36.141724+0000","last_active":"2024-05-30T06:50:37.192368+0000","last_peered":"2024-05-30T06:50:37.192368+0000","last_clean":"2024-05-30T06:50:37.192368+0000","last_became_active":"2024-05-30T06:50:36.141318+0000","last_became_peered":"2024-05-30T06:50:36.141318+0000","last_unstale":"2024-05-30T06:50:37.192368+0000","last_undegraded":"2024-05-30T06:50:37.192368+0000","last_fullsized":"2024-05-30T06:50:37.192368+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:20:35.641203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192847+0000","last_change":"2024-05-30T06:50:36.136008+0000","last_active":"2024-05-30T06:50:37.192847+0000","last_peered":"2024-05-30T06:50:37.192847+0000","last_clean":"2024-05-30T06:50:37.192847+0000","last_became_active":"2024-05-30T06:50:36.135609+0000","last_became_peered":"2024-05-30T06:50:36.135609+0000","last_unstale":"2024-05-30T06:50:37.192847+0000","last_undegraded":"2024-05-30T06:50:37.192847+0000","last_fullsized":"2024-05-30T06:50:37.192847+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:29.341913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190991+0000","last_change":"2024-05-30T06:50:36.135494+0000","last_active":"2024-05-30T06:50:37.190991+0000","last_peered":"2024-05-30T06:50:37.190991+0000","last_clean":"2024-05-30T06:50:37.190991+0000","last_became_active":"2024-05-30T06:50:36.135105+0000","last_became_peered":"2024-05-30T06:50:36.135105+0000","last_unstale":"2024-05-30T06:50:37.190991+0000","last_undegraded":"2024-05-30T06:50:37.190991+0000","last_fullsized":"2024-05-30T06:50:37.190991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:16.744233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133455+0000","last_change":"2024-05-30T06:50:36.134884+0000","last_active":"2024-05-30T06:50:37.133455+0000","last_peered":"2024-05-30T06:50:37.133455+0000","last_clean":"2024-05-30T06:50:37.133455+0000","last_became_active":"2024-05-30T06:50:36.134671+0000","last_became_peered":"2024-05-30T06:50:36.134671+0000","last_unstale":"2024-05-30T06:50:37.133455+0000","last_undegraded":"2024-05-30T06:50:37.133455+0000","last_fullsized":"2024-05-30T06:50:37.133455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:19.626381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190492+0000","last_change":"2024-05-30T06:50:36.132795+0000","last_active":"2024-05-30T06:50:37.190492+0000","last_peered":"2024-05-30T06:50:37.190492+0000","last_clean":"2024-05-30T06:50:37.190492+0000","last_became_active":"2024-05-30T06:50:36.132512+0000","last_became_peered":"2024-05-30T06:50:36.132512+0000","last_unstale":"2024-05-30T06:50:37.190492+0000","last_undegraded":"2024-05-30T06:50:37.190492+0000","last_fullsized":"2024-05-30T06:50:37.190492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:34:49.401832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192499+0000","last_change":"2024-05-30T06:50:36.131467+0000","last_active":"2024-05-30T06:50:37.192499+0000","last_peered":"2024-05-30T06:50:37.192499+0000","last_clean":"2024-05-30T06:50:37.192499+0000","last_became_active":"2024-05-30T06:50:36.131112+0000","last_became_peered":"2024-05-30T06:50:36.131112+0000","last_unstale":"2024-05-30T06:50:37.192499+0000","last_undegraded":"2024-05-30T06:50:37.192499+0000","last_fullsized":"2024-05-30T06:50:37.192499+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:36:19.920062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.135957+0000","last_change":"2024-05-30T06:50:36.123669+0000","last_active":"2024-05-30T06:50:37.135957+0000","last_peered":"2024-05-30T06:50:37.135957+0000","last_clean":"2024-05-30T06:50:37.135957+0000","last_became_active":"2024-05-30T06:50:36.123352+0000","last_became_peered":"2024-05-30T06:50:36.123352+0000","last_unstale":"2024-05-30T06:50:37.135957+0000","last_undegraded":"2024-05-30T06:50:37.135957+0000","last_fullsized":"2024-05-30T06:50:37.135957+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:40.263358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191990+0000","last_change":"2024-05-30T06:50:36.127388+0000","last_active":"2024-05-30T06:50:37.191990+0000","last_peered":"2024-05-30T06:50:37.191990+0000","last_clean":"2024-05-30T06:50:37.191990+0000","last_became_active":"2024-05-30T06:50:36.127124+0000","last_became_peered":"2024-05-30T06:50:36.127124+0000","last_unstale":"2024-05-30T06:50:37.191990+0000","last_undegraded":"2024-05-30T06:50:37.191990+0000","last_fullsized":"2024-05-30T06:50:37.191990+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:47.847094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191645+0000","last_change":"2024-05-30T06:50:36.138009+0000","last_active":"2024-05-30T06:50:37.191645+0000","last_peered":"2024-05-30T06:50:37.191645+0000","last_clean":"2024-05-30T06:50:37.191645+0000","last_became_active":"2024-05-30T06:50:36.137224+0000","last_became_peered":"2024-05-30T06:50:36.137224+0000","last_unstale":"2024-05-30T06:50:37.191645+0000","last_undegraded":"2024-05-30T06:50:37.191645+0000","last_fullsized":"2024-05-30T06:50:37.191645+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:31:20.436064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137057+0000","last_change":"2024-05-30T06:50:36.145133+0000","last_active":"2024-05-30T06:50:37.137057+0000","last_peered":"2024-05-30T06:50:37.137057+0000","last_clean":"2024-05-30T06:50:37.137057+0000","last_became_active":"2024-05-30T06:50:36.144866+0000","last_became_peered":"2024-05-30T06:50:36.144866+0000","last_unstale":"2024-05-30T06:50:37.137057+0000","last_undegraded":"2024-05-30T06:50:37.137057+0000","last_fullsized":"2024-05-30T06:50:37.137057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:09:27.992413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192859+0000","last_change":"2024-05-30T06:50:36.146835+0000","last_active":"2024-05-30T06:50:37.192859+0000","last_peered":"2024-05-30T06:50:37.192859+0000","last_clean":"2024-05-30T06:50:37.192859+0000","last_became_active":"2024-05-30T06:50:36.146478+0000","last_became_peered":"2024-05-30T06:50:36.146478+0000","last_unstale":"2024-05-30T06:50:37.192859+0000","last_undegraded":"2024-05-30T06:50:37.192859+0000","last_fullsized":"2024-05-30T06:50:37.192859+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:59:28.920236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133479+0000","last_change":"2024-05-30T06:50:36.133491+0000","last_active":"2024-05-30T06:50:37.133479+0000","last_peered":"2024-05-30T06:50:37.133479+0000","last_clean":"2024-05-30T06:50:37.133479+0000","last_became_active":"2024-05-30T06:50:36.133242+0000","last_became_peered":"2024-05-30T06:50:36.133242+0000","last_unstale":"2024-05-30T06:50:37.133479+0000","last_undegraded":"2024-05-30T06:50:37.133479+0000","last_fullsized":"2024-05-30T06:50:37.133479+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:39:50.722112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190100+0000","last_change":"2024-05-30T06:50:36.128090+0000","last_active":"2024-05-30T06:50:37.190100+0000","last_peered":"2024-05-30T06:50:37.190100+0000","last_clean":"2024-05-30T06:50:37.190100+0000","last_became_active":"2024-05-30T06:50:36.127805+0000","last_became_peered":"2024-05-30T06:50:36.127805+0000","last_unstale":"2024-05-30T06:50:37.190100+0000","last_undegraded":"2024-05-30T06:50:37.190100+0000","last_fullsized":"2024-05-30T06:50:37.190100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:40.263358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190952+0000","last_change":"2024-05-30T06:50:36.128319+0000","last_active":"2024-05-30T06:50:37.190952+0000","last_peered":"2024-05-30T06:50:37.190952+0000","last_clean":"2024-05-30T06:50:37.190952+0000","last_became_active":"2024-05-30T06:50:36.127722+0000","last_became_peered":"2024-05-30T06:50:36.127722+0000","last_unstale":"2024-05-30T06:50:37.190952+0000","last_undegraded":"2024-05-30T06:50:37.190952+0000","last_fullsized":"2024-05-30T06:50:37.190952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:36:15.100211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189834+0000","last_change":"2024-05-30T06:50:36.130537+0000","last_active":"2024-05-30T06:50:37.189834+0000","last_peered":"2024-05-30T06:50:37.189834+0000","last_clean":"2024-05-30T06:50:37.189834+0000","last_became_active":"2024-05-30T06:50:36.130275+0000","last_became_peered":"2024-05-30T06:50:36.130275+0000","last_unstale":"2024-05-30T06:50:37.189834+0000","last_undegraded":"2024-05-30T06:50:37.189834+0000","last_fullsized":"2024-05-30T06:50:37.189834+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:23.879376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.135722+0000","last_change":"2024-05-30T06:50:36.129772+0000","last_active":"2024-05-30T06:50:37.135722+0000","last_peered":"2024-05-30T06:50:37.135722+0000","last_clean":"2024-05-30T06:50:37.135722+0000","last_became_active":"2024-05-30T06:50:36.129459+0000","last_became_peered":"2024-05-30T06:50:36.129459+0000","last_unstale":"2024-05-30T06:50:37.135722+0000","last_undegraded":"2024-05-30T06:50:37.135722+0000","last_fullsized":"2024-05-30T06:50:37.135722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:46:18.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191805+0000","last_change":"2024-05-30T06:50:36.137706+0000","last_active":"2024-05-30T06:50:37.191805+0000","last_peered":"2024-05-30T06:50:37.191805+0000","last_clean":"2024-05-30T06:50:37.191805+0000","last_became_active":"2024-05-30T06:50:36.136870+0000","last_became_peered":"2024-05-30T06:50:36.136870+0000","last_unstale":"2024-05-30T06:50:37.191805+0000","last_undegraded":"2024-05-30T06:50:37.191805+0000","last_fullsized":"2024-05-30T06:50:37.191805+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:00:22.867977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133656+0000","last_change":"2024-05-30T06:50:36.134700+0000","last_active":"2024-05-30T06:50:37.133656+0000","last_peered":"2024-05-30T06:50:37.133656+0000","last_clean":"2024-05-30T06:50:37.133656+0000","last_became_active":"2024-05-30T06:50:36.134433+0000","last_became_peered":"2024-05-30T06:50:36.134433+0000","last_unstale":"2024-05-30T06:50:37.133656+0000","last_undegraded":"2024-05-30T06:50:37.133656+0000","last_fullsized":"2024-05-30T06:50:37.133656+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:49:01.139347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192372+0000","last_change":"2024-05-30T06:50:36.128464+0000","last_active":"2024-05-30T06:50:37.192372+0000","last_peered":"2024-05-30T06:50:37.192372+0000","last_clean":"2024-05-30T06:50:37.192372+0000","last_became_active":"2024-05-30T06:50:36.128170+0000","last_became_peered":"2024-05-30T06:50:36.128170+0000","last_unstale":"2024-05-30T06:50:37.192372+0000","last_undegraded":"2024-05-30T06:50:37.192372+0000","last_fullsized":"2024-05-30T06:50:37.192372+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:22:49.338617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190046+0000","last_change":"2024-05-30T06:50:36.124537+0000","last_active":"2024-05-30T06:50:37.190046+0000","last_peered":"2024-05-30T06:50:37.190046+0000","last_clean":"2024-05-30T06:50:37.190046+0000","last_became_active":"2024-05-30T06:50:36.124254+0000","last_became_peered":"2024-05-30T06:50:36.124254+0000","last_unstale":"2024-05-30T06:50:37.190046+0000","last_undegraded":"2024-05-30T06:50:37.190046+0000","last_fullsized":"2024-05-30T06:50:37.190046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:56.549987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136570+0000","last_change":"2024-05-30T06:50:36.129938+0000","last_active":"2024-05-30T06:50:37.136570+0000","last_peered":"2024-05-30T06:50:37.136570+0000","last_clean":"2024-05-30T06:50:37.136570+0000","last_became_active":"2024-05-30T06:50:36.129593+0000","last_became_peered":"2024-05-30T06:50:36.129593+0000","last_unstale":"2024-05-30T06:50:37.136570+0000","last_undegraded":"2024-05-30T06:50:37.136570+0000","last_fullsized":"2024-05-30T06:50:37.136570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:21:52.455652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136415+0000","last_change":"2024-05-30T06:50:36.145803+0000","last_active":"2024-05-30T06:50:37.136415+0000","last_peered":"2024-05-30T06:50:37.136415+0000","last_clean":"2024-05-30T06:50:37.136415+0000","last_became_active":"2024-05-30T06:50:36.145507+0000","last_became_peered":"2024-05-30T06:50:36.145507+0000","last_unstale":"2024-05-30T06:50:37.136415+0000","last_undegraded":"2024-05-30T06:50:37.136415+0000","last_fullsized":"2024-05-30T06:50:37.136415+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:57.447664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192150+0000","last_change":"2024-05-30T06:50:36.133852+0000","last_active":"2024-05-30T06:50:37.192150+0000","last_peered":"2024-05-30T06:50:37.192150+0000","last_clean":"2024-05-30T06:50:37.192150+0000","last_became_active":"2024-05-30T06:50:36.133264+0000","last_became_peered":"2024-05-30T06:50:36.133264+0000","last_unstale":"2024-05-30T06:50:37.192150+0000","last_undegraded":"2024-05-30T06:50:37.192150+0000","last_fullsized":"2024-05-30T06:50:37.192150+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:47:06.431698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191824+0000","last_change":"2024-05-30T06:50:36.138660+0000","last_active":"2024-05-30T06:50:37.191824+0000","last_peered":"2024-05-30T06:50:37.191824+0000","last_clean":"2024-05-30T06:50:37.191824+0000","last_became_active":"2024-05-30T06:50:36.135036+0000","last_became_peered":"2024-05-30T06:50:36.135036+0000","last_unstale":"2024-05-30T06:50:37.191824+0000","last_undegraded":"2024-05-30T06:50:37.191824+0000","last_fullsized":"2024-05-30T06:50:37.191824+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:30:13.290474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136978+0000","last_change":"2024-05-30T06:50:36.137261+0000","last_active":"2024-05-30T06:50:37.136978+0000","last_peered":"2024-05-30T06:50:37.136978+0000","last_clean":"2024-05-30T06:50:37.136978+0000","last_became_active":"2024-05-30T06:50:36.136976+0000","last_became_peered":"2024-05-30T06:50:36.136976+0000","last_unstale":"2024-05-30T06:50:37.136978+0000","last_undegraded":"2024-05-30T06:50:37.136978+0000","last_fullsized":"2024-05-30T06:50:37.136978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:21:42.786793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137337+0000","last_change":"2024-05-30T06:50:36.131795+0000","last_active":"2024-05-30T06:50:37.137337+0000","last_peered":"2024-05-30T06:50:37.137337+0000","last_clean":"2024-05-30T06:50:37.137337+0000","last_became_active":"2024-05-30T06:50:36.131557+0000","last_became_peered":"2024-05-30T06:50:36.131557+0000","last_unstale":"2024-05-30T06:50:37.137337+0000","last_undegraded":"2024-05-30T06:50:37.137337+0000","last_fullsized":"2024-05-30T06:50:37.137337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:17:34.623293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191123+0000","last_change":"2024-05-30T06:50:36.142813+0000","last_active":"2024-05-30T06:50:37.191123+0000","last_peered":"2024-05-30T06:50:37.191123+0000","last_clean":"2024-05-30T06:50:37.191123+0000","last_became_active":"2024-05-30T06:50:36.141331+0000","last_became_peered":"2024-05-30T06:50:36.141331+0000","last_unstale":"2024-05-30T06:50:37.191123+0000","last_undegraded":"2024-05-30T06:50:37.191123+0000","last_fullsized":"2024-05-30T06:50:37.191123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:00:33.525966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136476+0000","last_change":"2024-05-30T06:50:36.134492+0000","last_active":"2024-05-30T06:50:37.136476+0000","last_peered":"2024-05-30T06:50:37.136476+0000","last_clean":"2024-05-30T06:50:37.136476+0000","last_became_active":"2024-05-30T06:50:36.132522+0000","last_became_peered":"2024-05-30T06:50:36.132522+0000","last_unstale":"2024-05-30T06:50:37.136476+0000","last_undegraded":"2024-05-30T06:50:37.136476+0000","last_fullsized":"2024-05-30T06:50:37.136476+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:08:13.224977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190308+0000","last_change":"2024-05-30T06:50:36.137982+0000","last_active":"2024-05-30T06:50:37.190308+0000","last_peered":"2024-05-30T06:50:37.190308+0000","last_clean":"2024-05-30T06:50:37.190308+0000","last_became_active":"2024-05-30T06:50:36.137660+0000","last_became_peered":"2024-05-30T06:50:36.137660+0000","last_unstale":"2024-05-30T06:50:37.190308+0000","last_undegraded":"2024-05-30T06:50:37.190308+0000","last_fullsized":"2024-05-30T06:50:37.190308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:12:39.654448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136046+0000","last_change":"2024-05-30T06:50:36.127494+0000","last_active":"2024-05-30T06:50:37.136046+0000","last_peered":"2024-05-30T06:50:37.136046+0000","last_clean":"2024-05-30T06:50:37.136046+0000","last_became_active":"2024-05-30T06:50:36.126783+0000","last_became_peered":"2024-05-30T06:50:36.126783+0000","last_unstale":"2024-05-30T06:50:37.136046+0000","last_undegraded":"2024-05-30T06:50:37.136046+0000","last_fullsized":"2024-05-30T06:50:37.136046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:58.008213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136126+0000","last_change":"2024-05-30T06:50:36.130480+0000","last_active":"2024-05-30T06:50:37.136126+0000","last_peered":"2024-05-30T06:50:37.136126+0000","last_clean":"2024-05-30T06:50:37.136126+0000","last_became_active":"2024-05-30T06:50:36.130164+0000","last_became_peered":"2024-05-30T06:50:36.130164+0000","last_unstale":"2024-05-30T06:50:37.136126+0000","last_undegraded":"2024-05-30T06:50:37.136126+0000","last_fullsized":"2024-05-30T06:50:37.136126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:07:33.282727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192047+0000","last_change":"2024-05-30T06:50:36.139305+0000","last_active":"2024-05-30T06:50:37.192047+0000","last_peered":"2024-05-30T06:50:37.192047+0000","last_clean":"2024-05-30T06:50:37.192047+0000","last_became_active":"2024-05-30T06:50:36.138559+0000","last_became_peered":"2024-05-30T06:50:36.138559+0000","last_unstale":"2024-05-30T06:50:37.192047+0000","last_undegraded":"2024-05-30T06:50:37.192047+0000","last_fullsized":"2024-05-30T06:50:37.192047+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:38:35.033699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192497+0000","last_change":"2024-05-30T06:50:36.148984+0000","last_active":"2024-05-30T06:50:37.192497+0000","last_peered":"2024-05-30T06:50:37.192497+0000","last_clean":"2024-05-30T06:50:37.192497+0000","last_became_active":"2024-05-30T06:50:36.148443+0000","last_became_peered":"2024-05-30T06:50:36.148443+0000","last_unstale":"2024-05-30T06:50:37.192497+0000","last_undegraded":"2024-05-30T06:50:37.192497+0000","last_fullsized":"2024-05-30T06:50:37.192497+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:30:56.516597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192950+0000","last_change":"2024-05-30T06:50:35.135469+0000","last_active":"2024-05-30T06:50:37.192950+0000","last_peered":"2024-05-30T06:50:37.192950+0000","last_clean":"2024-05-30T06:50:37.192950+0000","last_became_active":"2024-05-30T06:50:35.135165+0000","last_became_peered":"2024-05-30T06:50:35.135165+0000","last_unstale":"2024-05-30T06:50:37.192950+0000","last_undegraded":"2024-05-30T06:50:37.192950+0000","last_fullsized":"2024-05-30T06:50:37.192950+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:55:43.836193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191741+0000","last_change":"2024-05-30T06:50:36.137484+0000","last_active":"2024-05-30T06:50:37.191741+0000","last_peered":"2024-05-30T06:50:37.191741+0000","last_clean":"2024-05-30T06:50:37.191741+0000","last_became_active":"2024-05-30T06:50:36.136537+0000","last_became_peered":"2024-05-30T06:50:36.136537+0000","last_unstale":"2024-05-30T06:50:37.191741+0000","last_undegraded":"2024-05-30T06:50:37.191741+0000","last_fullsized":"2024-05-30T06:50:37.191741+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:49.864351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190761+0000","last_change":"2024-05-30T06:50:35.129396+0000","last_active":"2024-05-30T06:50:37.190761+0000","last_peered":"2024-05-30T06:50:37.190761+0000","last_clean":"2024-05-30T06:50:37.190761+0000","last_became_active":"2024-05-30T06:50:35.128968+0000","last_became_peered":"2024-05-30T06:50:35.128968+0000","last_unstale":"2024-05-30T06:50:37.190761+0000","last_undegraded":"2024-05-30T06:50:37.190761+0000","last_fullsized":"2024-05-30T06:50:37.190761+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:01.742927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192187+0000","last_change":"2024-05-30T06:50:36.140265+0000","last_active":"2024-05-30T06:50:37.192187+0000","last_peered":"2024-05-30T06:50:37.192187+0000","last_clean":"2024-05-30T06:50:37.192187+0000","last_became_active":"2024-05-30T06:50:36.139996+0000","last_became_peered":"2024-05-30T06:50:36.139996+0000","last_unstale":"2024-05-30T06:50:37.192187+0000","last_undegraded":"2024-05-30T06:50:37.192187+0000","last_fullsized":"2024-05-30T06:50:37.192187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:58:16.706670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136834+0000","last_change":"2024-05-30T06:50:35.128453+0000","last_active":"2024-05-30T06:50:37.136834+0000","last_peered":"2024-05-30T06:50:37.136834+0000","last_clean":"2024-05-30T06:50:37.136834+0000","last_became_active":"2024-05-30T06:50:35.128177+0000","last_became_peered":"2024-05-30T06:50:35.128177+0000","last_unstale":"2024-05-30T06:50:37.136834+0000","last_undegraded":"2024-05-30T06:50:37.136834+0000","last_fullsized":"2024-05-30T06:50:37.136834+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:26.592642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192977+0000","last_change":"2024-05-30T06:50:36.137261+0000","last_active":"2024-05-30T06:50:37.192977+0000","last_peered":"2024-05-30T06:50:37.192977+0000","last_clean":"2024-05-30T06:50:37.192977+0000","last_became_active":"2024-05-30T06:50:36.137006+0000","last_became_peered":"2024-05-30T06:50:36.137006+0000","last_unstale":"2024-05-30T06:50:37.192977+0000","last_undegraded":"2024-05-30T06:50:37.192977+0000","last_fullsized":"2024-05-30T06:50:37.192977+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:28:35.661821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192596+0000","last_change":"2024-05-30T06:50:35.130217+0000","last_active":"2024-05-30T06:50:37.192596+0000","last_peered":"2024-05-30T06:50:37.192596+0000","last_clean":"2024-05-30T06:50:37.192596+0000","last_became_active":"2024-05-30T06:50:35.129905+0000","last_became_peered":"2024-05-30T06:50:35.129905+0000","last_unstale":"2024-05-30T06:50:37.192596+0000","last_undegraded":"2024-05-30T06:50:37.192596+0000","last_fullsized":"2024-05-30T06:50:37.192596+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:14.947254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136751+0000","last_change":"2024-05-30T06:50:36.127673+0000","last_active":"2024-05-30T06:50:37.136751+0000","last_peered":"2024-05-30T06:50:37.136751+0000","last_clean":"2024-05-30T06:50:37.136751+0000","last_became_active":"2024-05-30T06:50:36.127204+0000","last_became_peered":"2024-05-30T06:50:36.127204+0000","last_unstale":"2024-05-30T06:50:37.136751+0000","last_undegraded":"2024-05-30T06:50:37.136751+0000","last_fullsized":"2024-05-30T06:50:37.136751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:09:53.013517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190858+0000","last_change":"2024-05-30T06:50:35.131068+0000","last_active":"2024-05-30T06:50:37.190858+0000","last_peered":"2024-05-30T06:50:37.190858+0000","last_clean":"2024-05-30T06:50:37.190858+0000","last_became_active":"2024-05-30T06:50:35.130730+0000","last_became_peered":"2024-05-30T06:50:35.130730+0000","last_unstale":"2024-05-30T06:50:37.190858+0000","last_undegraded":"2024-05-30T06:50:37.190858+0000","last_fullsized":"2024-05-30T06:50:37.190858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:17:44.762161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136386+0000","last_change":"2024-05-30T06:50:36.137654+0000","last_active":"2024-05-30T06:50:37.136386+0000","last_peered":"2024-05-30T06:50:37.136386+0000","last_clean":"2024-05-30T06:50:37.136386+0000","last_became_active":"2024-05-30T06:50:36.137316+0000","last_became_peered":"2024-05-30T06:50:36.137316+0000","last_unstale":"2024-05-30T06:50:37.136386+0000","last_undegraded":"2024-05-30T06:50:37.136386+0000","last_fullsized":"2024-05-30T06:50:37.136386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:29.341913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192564+0000","last_change":"2024-05-30T06:50:35.132955+0000","last_active":"2024-05-30T06:50:37.192564+0000","last_peered":"2024-05-30T06:50:37.192564+0000","last_clean":"2024-05-30T06:50:37.192564+0000","last_became_active":"2024-05-30T06:50:35.132679+0000","last_became_peered":"2024-05-30T06:50:35.132679+0000","last_unstale":"2024-05-30T06:50:37.192564+0000","last_undegraded":"2024-05-30T06:50:37.192564+0000","last_fullsized":"2024-05-30T06:50:37.192564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:39:49.713340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190728+0000","last_change":"2024-05-30T06:50:36.127242+0000","last_active":"2024-05-30T06:50:37.190728+0000","last_peered":"2024-05-30T06:50:37.190728+0000","last_clean":"2024-05-30T06:50:37.190728+0000","last_became_active":"2024-05-30T06:50:36.126954+0000","last_became_peered":"2024-05-30T06:50:36.126954+0000","last_unstale":"2024-05-30T06:50:37.190728+0000","last_undegraded":"2024-05-30T06:50:37.190728+0000","last_fullsized":"2024-05-30T06:50:37.190728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:38:37.252400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133237+0000","last_change":"2024-05-30T06:50:35.128609+0000","last_active":"2024-05-30T06:50:37.133237+0000","last_peered":"2024-05-30T06:50:37.133237+0000","last_clean":"2024-05-30T06:50:37.133237+0000","last_became_active":"2024-05-30T06:50:35.128214+0000","last_became_peered":"2024-05-30T06:50:35.128214+0000","last_unstale":"2024-05-30T06:50:37.133237+0000","last_undegraded":"2024-05-30T06:50:37.133237+0000","last_fullsized":"2024-05-30T06:50:37.133237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:57.201902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190443+0000","last_change":"2024-05-30T06:50:36.137216+0000","last_active":"2024-05-30T06:50:37.190443+0000","last_peered":"2024-05-30T06:50:37.190443+0000","last_clean":"2024-05-30T06:50:37.190443+0000","last_became_active":"2024-05-30T06:50:36.136945+0000","last_became_peered":"2024-05-30T06:50:36.136945+0000","last_unstale":"2024-05-30T06:50:37.190443+0000","last_undegraded":"2024-05-30T06:50:37.190443+0000","last_fullsized":"2024-05-30T06:50:37.190443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:58.008213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190825+0000","last_change":"2024-05-30T06:50:35.119974+0000","last_active":"2024-05-30T06:50:37.190825+0000","last_peered":"2024-05-30T06:50:37.190825+0000","last_clean":"2024-05-30T06:50:37.190825+0000","last_became_active":"2024-05-30T06:50:35.119188+0000","last_became_peered":"2024-05-30T06:50:35.119188+0000","last_unstale":"2024-05-30T06:50:37.190825+0000","last_undegraded":"2024-05-30T06:50:37.190825+0000","last_fullsized":"2024-05-30T06:50:37.190825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:45:15.601089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137573+0000","last_change":"2024-05-30T06:50:36.135040+0000","last_active":"2024-05-30T06:50:37.137573+0000","last_peered":"2024-05-30T06:50:37.137573+0000","last_clean":"2024-05-30T06:50:37.137573+0000","last_became_active":"2024-05-30T06:50:36.134764+0000","last_became_peered":"2024-05-30T06:50:36.134764+0000","last_unstale":"2024-05-30T06:50:37.137573+0000","last_undegraded":"2024-05-30T06:50:37.137573+0000","last_fullsized":"2024-05-30T06:50:37.137573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:29:12.186720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137016+0000","last_change":"2024-05-30T06:50:35.133698+0000","last_active":"2024-05-30T06:50:37.137016+0000","last_peered":"2024-05-30T06:50:37.137016+0000","last_clean":"2024-05-30T06:50:37.137016+0000","last_became_active":"2024-05-30T06:50:35.132932+0000","last_became_peered":"2024-05-30T06:50:35.132932+0000","last_unstale":"2024-05-30T06:50:37.137016+0000","last_undegraded":"2024-05-30T06:50:37.137016+0000","last_fullsized":"2024-05-30T06:50:37.137016+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:29:04.354604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192807+0000","last_change":"2024-05-30T06:50:36.148139+0000","last_active":"2024-05-30T06:50:37.192807+0000","last_peered":"2024-05-30T06:50:37.192807+0000","last_clean":"2024-05-30T06:50:37.192807+0000","last_became_active":"2024-05-30T06:50:36.147823+0000","last_became_peered":"2024-05-30T06:50:36.147823+0000","last_unstale":"2024-05-30T06:50:37.192807+0000","last_undegraded":"2024-05-30T06:50:37.192807+0000","last_fullsized":"2024-05-30T06:50:37.192807+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:51:43.331082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192947+0000","last_change":"2024-05-30T06:50:35.126864+0000","last_active":"2024-05-30T06:50:37.192947+0000","last_peered":"2024-05-30T06:50:37.192947+0000","last_clean":"2024-05-30T06:50:37.192947+0000","last_became_active":"2024-05-30T06:50:35.126599+0000","last_became_peered":"2024-05-30T06:50:35.126599+0000","last_unstale":"2024-05-30T06:50:37.192947+0000","last_undegraded":"2024-05-30T06:50:37.192947+0000","last_fullsized":"2024-05-30T06:50:37.192947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:29:09.412208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192881+0000","last_change":"2024-05-30T06:50:36.132398+0000","last_active":"2024-05-30T06:50:37.192881+0000","last_peered":"2024-05-30T06:50:37.192881+0000","last_clean":"2024-05-30T06:50:37.192881+0000","last_became_active":"2024-05-30T06:50:36.132093+0000","last_became_peered":"2024-05-30T06:50:36.132093+0000","last_unstale":"2024-05-30T06:50:37.192881+0000","last_undegraded":"2024-05-30T06:50:37.192881+0000","last_fullsized":"2024-05-30T06:50:37.192881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:57.447664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191222+0000","last_change":"2024-05-30T06:50:35.126131+0000","last_active":"2024-05-30T06:50:37.191222+0000","last_peered":"2024-05-30T06:50:37.191222+0000","last_clean":"2024-05-30T06:50:37.191222+0000","last_became_active":"2024-05-30T06:50:35.125864+0000","last_became_peered":"2024-05-30T06:50:35.125864+0000","last_unstale":"2024-05-30T06:50:37.191222+0000","last_undegraded":"2024-05-30T06:50:37.191222+0000","last_fullsized":"2024-05-30T06:50:37.191222+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:04.103814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191224+0000","last_change":"2024-05-30T06:50:36.130870+0000","last_active":"2024-05-30T06:50:37.191224+0000","last_peered":"2024-05-30T06:50:37.191224+0000","last_clean":"2024-05-30T06:50:37.191224+0000","last_became_active":"2024-05-30T06:50:36.130296+0000","last_became_peered":"2024-05-30T06:50:36.130296+0000","last_unstale":"2024-05-30T06:50:37.191224+0000","last_undegraded":"2024-05-30T06:50:37.191224+0000","last_fullsized":"2024-05-30T06:50:37.191224+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:12:29.459735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133579+0000","last_change":"2024-05-30T06:50:35.115426+0000","last_active":"2024-05-30T06:50:37.133579+0000","last_peered":"2024-05-30T06:50:37.133579+0000","last_clean":"2024-05-30T06:50:37.133579+0000","last_became_active":"2024-05-30T06:50:35.115117+0000","last_became_peered":"2024-05-30T06:50:35.115117+0000","last_unstale":"2024-05-30T06:50:37.133579+0000","last_undegraded":"2024-05-30T06:50:37.133579+0000","last_fullsized":"2024-05-30T06:50:37.133579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:00:21.859206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191968+0000","last_change":"2024-05-30T06:50:36.145873+0000","last_active":"2024-05-30T06:50:37.191968+0000","last_peered":"2024-05-30T06:50:37.191968+0000","last_clean":"2024-05-30T06:50:37.191968+0000","last_became_active":"2024-05-30T06:50:36.145712+0000","last_became_peered":"2024-05-30T06:50:36.145712+0000","last_unstale":"2024-05-30T06:50:37.191968+0000","last_undegraded":"2024-05-30T06:50:37.191968+0000","last_fullsized":"2024-05-30T06:50:37.191968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:13:18.388535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133395+0000","last_change":"2024-05-30T06:50:35.128766+0000","last_active":"2024-05-30T06:50:37.133395+0000","last_peered":"2024-05-30T06:50:37.133395+0000","last_clean":"2024-05-30T06:50:37.133395+0000","last_became_active":"2024-05-30T06:50:35.128339+0000","last_became_peered":"2024-05-30T06:50:35.128339+0000","last_unstale":"2024-05-30T06:50:37.133395+0000","last_undegraded":"2024-05-30T06:50:37.133395+0000","last_fullsized":"2024-05-30T06:50:37.133395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:48.855579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136777+0000","last_change":"2024-05-30T06:50:36.136119+0000","last_active":"2024-05-30T06:50:37.136777+0000","last_peered":"2024-05-30T06:50:37.136777+0000","last_clean":"2024-05-30T06:50:37.136777+0000","last_became_active":"2024-05-30T06:50:36.135862+0000","last_became_peered":"2024-05-30T06:50:36.135862+0000","last_unstale":"2024-05-30T06:50:37.136777+0000","last_undegraded":"2024-05-30T06:50:37.136777+0000","last_fullsized":"2024-05-30T06:50:37.136777+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:56:57.945018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.193082+0000","last_change":"2024-05-30T06:50:35.125536+0000","last_active":"2024-05-30T06:50:37.193082+0000","last_peered":"2024-05-30T06:50:37.193082+0000","last_clean":"2024-05-30T06:50:37.193082+0000","last_became_active":"2024-05-30T06:50:35.125221+0000","last_became_peered":"2024-05-30T06:50:35.125221+0000","last_unstale":"2024-05-30T06:50:37.193082+0000","last_undegraded":"2024-05-30T06:50:37.193082+0000","last_fullsized":"2024-05-30T06:50:37.193082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:33:36.208132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189783+0000","last_change":"2024-05-30T06:50:36.128699+0000","last_active":"2024-05-30T06:50:37.189783+0000","last_peered":"2024-05-30T06:50:37.189783+0000","last_clean":"2024-05-30T06:50:37.189783+0000","last_became_active":"2024-05-30T06:50:36.128437+0000","last_became_peered":"2024-05-30T06:50:36.128437+0000","last_unstale":"2024-05-30T06:50:37.189783+0000","last_undegraded":"2024-05-30T06:50:37.189783+0000","last_fullsized":"2024-05-30T06:50:37.189783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:36:45.423083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136052+0000","last_change":"2024-05-30T06:50:35.134033+0000","last_active":"2024-05-30T06:50:37.136052+0000","last_peered":"2024-05-30T06:50:37.136052+0000","last_clean":"2024-05-30T06:50:37.136052+0000","last_became_active":"2024-05-30T06:50:35.133639+0000","last_became_peered":"2024-05-30T06:50:35.133639+0000","last_unstale":"2024-05-30T06:50:37.136052+0000","last_undegraded":"2024-05-30T06:50:37.136052+0000","last_fullsized":"2024-05-30T06:50:37.136052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:01.742927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190598+0000","last_change":"2024-05-30T06:50:36.131744+0000","last_active":"2024-05-30T06:50:37.190598+0000","last_peered":"2024-05-30T06:50:37.190598+0000","last_clean":"2024-05-30T06:50:37.190598+0000","last_became_active":"2024-05-30T06:50:36.131457+0000","last_became_peered":"2024-05-30T06:50:36.131457+0000","last_unstale":"2024-05-30T06:50:37.190598+0000","last_undegraded":"2024-05-30T06:50:37.190598+0000","last_fullsized":"2024-05-30T06:50:37.190598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:59:24.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.135752+0000","last_change":"2024-05-30T06:50:35.136029+0000","last_active":"2024-05-30T06:50:37.135752+0000","last_peered":"2024-05-30T06:50:37.135752+0000","last_clean":"2024-05-30T06:50:37.135752+0000","last_became_active":"2024-05-30T06:50:35.135713+0000","last_became_peered":"2024-05-30T06:50:35.135713+0000","last_unstale":"2024-05-30T06:50:37.135752+0000","last_undegraded":"2024-05-30T06:50:37.135752+0000","last_fullsized":"2024-05-30T06:50:37.135752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:15:02.073672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137214+0000","last_change":"2024-05-30T06:50:36.134135+0000","last_active":"2024-05-30T06:50:37.137214+0000","last_peered":"2024-05-30T06:50:37.137214+0000","last_clean":"2024-05-30T06:50:37.137214+0000","last_became_active":"2024-05-30T06:50:36.133844+0000","last_became_peered":"2024-05-30T06:50:36.133844+0000","last_unstale":"2024-05-30T06:50:37.137214+0000","last_undegraded":"2024-05-30T06:50:37.137214+0000","last_fullsized":"2024-05-30T06:50:37.137214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:31:40.226715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.193019+0000","last_change":"2024-05-30T06:50:35.128218+0000","last_active":"2024-05-30T06:50:37.193019+0000","last_peered":"2024-05-30T06:50:37.193019+0000","last_clean":"2024-05-30T06:50:37.193019+0000","last_became_active":"2024-05-30T06:50:35.127706+0000","last_became_peered":"2024-05-30T06:50:35.127706+0000","last_unstale":"2024-05-30T06:50:37.193019+0000","last_undegraded":"2024-05-30T06:50:37.193019+0000","last_fullsized":"2024-05-30T06:50:37.193019+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:48.855579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192841+0000","last_change":"2024-05-30T06:50:36.148013+0000","last_active":"2024-05-30T06:50:37.192841+0000","last_peered":"2024-05-30T06:50:37.192841+0000","last_clean":"2024-05-30T06:50:37.192841+0000","last_became_active":"2024-05-30T06:50:36.147503+0000","last_became_peered":"2024-05-30T06:50:36.147503+0000","last_unstale":"2024-05-30T06:50:37.192841+0000","last_undegraded":"2024-05-30T06:50:37.192841+0000","last_fullsized":"2024-05-30T06:50:37.192841+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:49:49.412116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137298+0000","last_change":"2024-05-30T06:50:35.131458+0000","last_active":"2024-05-30T06:50:37.137298+0000","last_peered":"2024-05-30T06:50:37.137298+0000","last_clean":"2024-05-30T06:50:37.137298+0000","last_became_active":"2024-05-30T06:50:35.129558+0000","last_became_peered":"2024-05-30T06:50:35.129558+0000","last_unstale":"2024-05-30T06:50:37.137298+0000","last_undegraded":"2024-05-30T06:50:37.137298+0000","last_fullsized":"2024-05-30T06:50:37.137298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:20:45.793165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133605+0000","last_change":"2024-05-30T06:50:36.132603+0000","last_active":"2024-05-30T06:50:37.133605+0000","last_peered":"2024-05-30T06:50:37.133605+0000","last_clean":"2024-05-30T06:50:37.133605+0000","last_became_active":"2024-05-30T06:50:36.132338+0000","last_became_peered":"2024-05-30T06:50:36.132338+0000","last_unstale":"2024-05-30T06:50:37.133605+0000","last_undegraded":"2024-05-30T06:50:37.133605+0000","last_fullsized":"2024-05-30T06:50:37.133605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:15.956026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192405+0000","last_change":"2024-05-30T06:50:35.133861+0000","last_active":"2024-05-30T06:50:37.192405+0000","last_peered":"2024-05-30T06:50:37.192405+0000","last_clean":"2024-05-30T06:50:37.192405+0000","last_became_active":"2024-05-30T06:50:35.133568+0000","last_became_peered":"2024-05-30T06:50:35.133568+0000","last_unstale":"2024-05-30T06:50:37.192405+0000","last_undegraded":"2024-05-30T06:50:37.192405+0000","last_fullsized":"2024-05-30T06:50:37.192405+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:56:18.728983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191380+0000","last_change":"2024-05-30T06:50:36.131097+0000","last_active":"2024-05-30T06:50:37.191380+0000","last_peered":"2024-05-30T06:50:37.191380+0000","last_clean":"2024-05-30T06:50:37.191380+0000","last_became_active":"2024-05-30T06:50:36.130633+0000","last_became_peered":"2024-05-30T06:50:36.130633+0000","last_unstale":"2024-05-30T06:50:37.191380+0000","last_undegraded":"2024-05-30T06:50:37.191380+0000","last_fullsized":"2024-05-30T06:50:37.191380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:58.210674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192643+0000","last_change":"2024-05-30T06:50:35.135020+0000","last_active":"2024-05-30T06:50:37.192643+0000","last_peered":"2024-05-30T06:50:37.192643+0000","last_clean":"2024-05-30T06:50:37.192643+0000","last_became_active":"2024-05-30T06:50:35.134670+0000","last_became_peered":"2024-05-30T06:50:35.134670+0000","last_unstale":"2024-05-30T06:50:37.192643+0000","last_undegraded":"2024-05-30T06:50:37.192643+0000","last_fullsized":"2024-05-30T06:50:37.192643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:00:52.604142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190438+0000","last_change":"2024-05-30T06:50:36.132872+0000","last_active":"2024-05-30T06:50:37.190438+0000","last_peered":"2024-05-30T06:50:37.190438+0000","last_clean":"2024-05-30T06:50:37.190438+0000","last_became_active":"2024-05-30T06:50:36.132575+0000","last_became_peered":"2024-05-30T06:50:36.132575+0000","last_unstale":"2024-05-30T06:50:37.190438+0000","last_undegraded":"2024-05-30T06:50:37.190438+0000","last_fullsized":"2024-05-30T06:50:37.190438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:20:55.332407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.193068+0000","last_change":"2024-05-30T06:50:35.132673+0000","last_active":"2024-05-30T06:50:37.193068+0000","last_peered":"2024-05-30T06:50:37.193068+0000","last_clean":"2024-05-30T06:50:37.193068+0000","last_became_active":"2024-05-30T06:50:35.131785+0000","last_became_peered":"2024-05-30T06:50:35.131785+0000","last_unstale":"2024-05-30T06:50:37.193068+0000","last_undegraded":"2024-05-30T06:50:37.193068+0000","last_fullsized":"2024-05-30T06:50:37.193068+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:18.617610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190597+0000","last_change":"2024-05-30T06:50:36.147488+0000","last_active":"2024-05-30T06:50:37.190597+0000","last_peered":"2024-05-30T06:50:37.190597+0000","last_clean":"2024-05-30T06:50:37.190597+0000","last_became_active":"2024-05-30T06:50:36.147127+0000","last_became_peered":"2024-05-30T06:50:36.147127+0000","last_unstale":"2024-05-30T06:50:37.190597+0000","last_undegraded":"2024-05-30T06:50:37.190597+0000","last_fullsized":"2024-05-30T06:50:37.190597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:39:18.706486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136181+0000","last_change":"2024-05-30T06:50:35.121519+0000","last_active":"2024-05-30T06:50:37.136181+0000","last_peered":"2024-05-30T06:50:37.136181+0000","last_clean":"2024-05-30T06:50:37.136181+0000","last_became_active":"2024-05-30T06:50:35.121245+0000","last_became_peered":"2024-05-30T06:50:35.121245+0000","last_unstale":"2024-05-30T06:50:37.136181+0000","last_undegraded":"2024-05-30T06:50:37.136181+0000","last_fullsized":"2024-05-30T06:50:37.136181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:42:34.991573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191167+0000","last_change":"2024-05-30T06:50:36.147478+0000","last_active":"2024-05-30T06:50:37.191167+0000","last_peered":"2024-05-30T06:50:37.191167+0000","last_clean":"2024-05-30T06:50:37.191167+0000","last_became_active":"2024-05-30T06:50:36.147202+0000","last_became_peered":"2024-05-30T06:50:36.147202+0000","last_unstale":"2024-05-30T06:50:37.191167+0000","last_undegraded":"2024-05-30T06:50:37.191167+0000","last_fullsized":"2024-05-30T06:50:37.191167+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:02:01.998106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189714+0000","last_change":"2024-05-30T06:50:35.132241+0000","last_active":"2024-05-30T06:50:37.189714+0000","last_peered":"2024-05-30T06:50:37.189714+0000","last_clean":"2024-05-30T06:50:37.189714+0000","last_became_active":"2024-05-30T06:50:35.131928+0000","last_became_peered":"2024-05-30T06:50:35.131928+0000","last_unstale":"2024-05-30T06:50:37.189714+0000","last_undegraded":"2024-05-30T06:50:37.189714+0000","last_fullsized":"2024-05-30T06:50:37.189714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:27:26.418862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190605+0000","last_change":"2024-05-30T06:50:36.133274+0000","last_active":"2024-05-30T06:50:37.190605+0000","last_peered":"2024-05-30T06:50:37.190605+0000","last_clean":"2024-05-30T06:50:37.190605+0000","last_became_active":"2024-05-30T06:50:36.133004+0000","last_became_peered":"2024-05-30T06:50:36.133004+0000","last_unstale":"2024-05-30T06:50:37.190605+0000","last_undegraded":"2024-05-30T06:50:37.190605+0000","last_fullsized":"2024-05-30T06:50:37.190605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:07:33.282727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192797+0000","last_change":"2024-05-30T06:50:35.128349+0000","last_active":"2024-05-30T06:50:37.192797+0000","last_peered":"2024-05-30T06:50:37.192797+0000","last_clean":"2024-05-30T06:50:37.192797+0000","last_became_active":"2024-05-30T06:50:35.128091+0000","last_became_peered":"2024-05-30T06:50:35.128091+0000","last_unstale":"2024-05-30T06:50:37.192797+0000","last_undegraded":"2024-05-30T06:50:37.192797+0000","last_fullsized":"2024-05-30T06:50:37.192797+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:00:21.859206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137210+0000","last_change":"2024-05-30T06:50:36.127379+0000","last_active":"2024-05-30T06:50:37.137210+0000","last_peered":"2024-05-30T06:50:37.137210+0000","last_clean":"2024-05-30T06:50:37.137210+0000","last_became_active":"2024-05-30T06:50:36.127078+0000","last_became_peered":"2024-05-30T06:50:36.127078+0000","last_unstale":"2024-05-30T06:50:37.137210+0000","last_undegraded":"2024-05-30T06:50:37.137210+0000","last_fullsized":"2024-05-30T06:50:37.137210+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:44:28.467327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:38.122025+0000","last_change":"2024-05-30T06:50:35.131220+0000","last_active":"2024-05-30T06:50:38.122025+0000","last_peered":"2024-05-30T06:50:38.122025+0000","last_clean":"2024-05-30T06:50:38.122025+0000","last_became_active":"2024-05-30T06:50:35.130941+0000","last_became_peered":"2024-05-30T06:50:35.130941+0000","last_unstale":"2024-05-30T06:50:38.122025+0000","last_undegraded":"2024-05-30T06:50:38.122025+0000","last_fullsized":"2024-05-30T06:50:38.122025+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:25.867400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192660+0000","last_change":"2024-05-30T06:50:36.149218+0000","last_active":"2024-05-30T06:50:37.192660+0000","last_peered":"2024-05-30T06:50:37.192660+0000","last_clean":"2024-05-30T06:50:37.192660+0000","last_became_active":"2024-05-30T06:50:36.148877+0000","last_became_peered":"2024-05-30T06:50:36.148877+0000","last_unstale":"2024-05-30T06:50:37.192660+0000","last_undegraded":"2024-05-30T06:50:37.192660+0000","last_fullsized":"2024-05-30T06:50:37.192660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:18:23.790436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191475+0000","last_change":"2024-05-30T06:50:35.130139+0000","last_active":"2024-05-30T06:50:37.191475+0000","last_peered":"2024-05-30T06:50:37.191475+0000","last_clean":"2024-05-30T06:50:37.191475+0000","last_became_active":"2024-05-30T06:50:35.129737+0000","last_became_peered":"2024-05-30T06:50:35.129737+0000","last_unstale":"2024-05-30T06:50:37.191475+0000","last_undegraded":"2024-05-30T06:50:37.191475+0000","last_fullsized":"2024-05-30T06:50:37.191475+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:21.214580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192999+0000","last_change":"2024-05-30T06:50:36.137637+0000","last_active":"2024-05-30T06:50:37.192999+0000","last_peered":"2024-05-30T06:50:37.192999+0000","last_clean":"2024-05-30T06:50:37.192999+0000","last_became_active":"2024-05-30T06:50:36.133825+0000","last_became_peered":"2024-05-30T06:50:36.133825+0000","last_unstale":"2024-05-30T06:50:37.192999+0000","last_undegraded":"2024-05-30T06:50:37.192999+0000","last_fullsized":"2024-05-30T06:50:37.192999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:56:49.909109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190140+0000","last_change":"2024-05-30T06:50:35.133839+0000","last_active":"2024-05-30T06:50:37.190140+0000","last_peered":"2024-05-30T06:50:37.190140+0000","last_clean":"2024-05-30T06:50:37.190140+0000","last_became_active":"2024-05-30T06:50:35.133509+0000","last_became_peered":"2024-05-30T06:50:35.133509+0000","last_unstale":"2024-05-30T06:50:37.190140+0000","last_undegraded":"2024-05-30T06:50:37.190140+0000","last_fullsized":"2024-05-30T06:50:37.190140+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:14:41.337933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191005+0000","last_change":"2024-05-30T06:50:36.128003+0000","last_active":"2024-05-30T06:50:37.191005+0000","last_peered":"2024-05-30T06:50:37.191005+0000","last_clean":"2024-05-30T06:50:37.191005+0000","last_became_active":"2024-05-30T06:50:36.127402+0000","last_became_peered":"2024-05-30T06:50:36.127402+0000","last_unstale":"2024-05-30T06:50:37.191005+0000","last_undegraded":"2024-05-30T06:50:37.191005+0000","last_fullsized":"2024-05-30T06:50:37.191005+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:55:12.624496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191040+0000","last_change":"2024-05-30T06:50:35.120912+0000","last_active":"2024-05-30T06:50:37.191040+0000","last_peered":"2024-05-30T06:50:37.191040+0000","last_clean":"2024-05-30T06:50:37.191040+0000","last_became_active":"2024-05-30T06:50:35.120133+0000","last_became_peered":"2024-05-30T06:50:35.120133+0000","last_unstale":"2024-05-30T06:50:37.191040+0000","last_undegraded":"2024-05-30T06:50:37.191040+0000","last_fullsized":"2024-05-30T06:50:37.191040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:06:53.698943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192803+0000","last_change":"2024-05-30T06:50:36.137692+0000","last_active":"2024-05-30T06:50:37.192803+0000","last_peered":"2024-05-30T06:50:37.192803+0000","last_clean":"2024-05-30T06:50:37.192803+0000","last_became_active":"2024-05-30T06:50:36.137348+0000","last_became_peered":"2024-05-30T06:50:36.137348+0000","last_unstale":"2024-05-30T06:50:37.192803+0000","last_undegraded":"2024-05-30T06:50:37.192803+0000","last_fullsized":"2024-05-30T06:50:37.192803+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:46:18.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133238+0000","last_change":"2024-05-30T06:50:35.129598+0000","last_active":"2024-05-30T06:50:37.133238+0000","last_peered":"2024-05-30T06:50:37.133238+0000","last_clean":"2024-05-30T06:50:37.133238+0000","last_became_active":"2024-05-30T06:50:35.129318+0000","last_became_peered":"2024-05-30T06:50:35.129318+0000","last_unstale":"2024-05-30T06:50:37.133238+0000","last_undegraded":"2024-05-30T06:50:37.133238+0000","last_fullsized":"2024-05-30T06:50:37.133238+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:31:19.427293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.134066+0000","last_change":"2024-05-30T06:50:36.132474+0000","last_active":"2024-05-30T06:50:37.134066+0000","last_peered":"2024-05-30T06:50:37.134066+0000","last_clean":"2024-05-30T06:50:37.134066+0000","last_became_active":"2024-05-30T06:50:36.132096+0000","last_became_peered":"2024-05-30T06:50:36.132096+0000","last_unstale":"2024-05-30T06:50:37.134066+0000","last_undegraded":"2024-05-30T06:50:37.134066+0000","last_fullsized":"2024-05-30T06:50:37.134066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:56:10.332933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.135971+0000","last_change":"2024-05-30T06:50:35.133302+0000","last_active":"2024-05-30T06:50:37.135971+0000","last_peered":"2024-05-30T06:50:37.135971+0000","last_clean":"2024-05-30T06:50:37.135971+0000","last_became_active":"2024-05-30T06:50:35.132843+0000","last_became_peered":"2024-05-30T06:50:35.132843+0000","last_unstale":"2024-05-30T06:50:37.135971+0000","last_undegraded":"2024-05-30T06:50:37.135971+0000","last_fullsized":"2024-05-30T06:50:37.135971+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:56:09.324161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192151+0000","last_change":"2024-05-30T06:50:36.137950+0000","last_active":"2024-05-30T06:50:37.192151+0000","last_peered":"2024-05-30T06:50:37.192151+0000","last_clean":"2024-05-30T06:50:37.192151+0000","last_became_active":"2024-05-30T06:50:36.137696+0000","last_became_peered":"2024-05-30T06:50:36.137696+0000","last_unstale":"2024-05-30T06:50:37.192151+0000","last_undegraded":"2024-05-30T06:50:37.192151+0000","last_fullsized":"2024-05-30T06:50:37.192151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:27:30.281514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192111+0000","last_change":"2024-05-30T06:50:35.133777+0000","last_active":"2024-05-30T06:50:37.192111+0000","last_peered":"2024-05-30T06:50:37.192111+0000","last_clean":"2024-05-30T06:50:37.192111+0000","last_became_active":"2024-05-30T06:50:35.129708+0000","last_became_peered":"2024-05-30T06:50:35.129708+0000","last_unstale":"2024-05-30T06:50:37.192111+0000","last_undegraded":"2024-05-30T06:50:37.192111+0000","last_fullsized":"2024-05-30T06:50:37.192111+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:38:41.689658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191653+0000","last_change":"2024-05-30T06:50:36.147464+0000","last_active":"2024-05-30T06:50:37.191653+0000","last_peered":"2024-05-30T06:50:37.191653+0000","last_clean":"2024-05-30T06:50:37.191653+0000","last_became_active":"2024-05-30T06:50:36.146592+0000","last_became_peered":"2024-05-30T06:50:36.146592+0000","last_unstale":"2024-05-30T06:50:37.191653+0000","last_undegraded":"2024-05-30T06:50:37.191653+0000","last_fullsized":"2024-05-30T06:50:37.191653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:47:48.079037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192646+0000","last_change":"2024-05-30T06:50:35.124280+0000","last_active":"2024-05-30T06:50:37.192646+0000","last_peered":"2024-05-30T06:50:37.192646+0000","last_clean":"2024-05-30T06:50:37.192646+0000","last_became_active":"2024-05-30T06:50:35.123615+0000","last_became_peered":"2024-05-30T06:50:35.123615+0000","last_unstale":"2024-05-30T06:50:37.192646+0000","last_undegraded":"2024-05-30T06:50:37.192646+0000","last_fullsized":"2024-05-30T06:50:37.192646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:35:34.494559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":271,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191782+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:50:37.191782+0000","last_peered":"2024-05-30T06:50:37.191782+0000","last_clean":"2024-05-30T06:50:37.191782+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:50:37.191782+0000","last_undegraded":"2024-05-30T06:50:37.191782+0000","last_fullsized":"2024-05-30T06:50:37.191782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574955,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54844,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316996,"statfs":{"total":96636764160,"available":96580603904,"internally_reserved":0,"allocated":1490944,"data_stored":970528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54272,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":897024,"data_stored":379636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574956,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54268,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317572,"statfs":{"total":96636764160,"available":96581193728,"internally_reserved":0,"allocated":892928,"data_stored":379634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574955,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54260,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317580,"statfs":{"total":96636764160,"available":96581201920,"internally_reserved":0,"allocated":892928,"data_stored":379614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574955,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58428,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313412,"statfs":{"total":96636764160,"available":96576933888,"internally_reserved":0,"allocated":897024,"data_stored":379656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50116,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321724,"statfs":{"total":96636764160,"available":96585445376,"internally_reserved":0,"allocated":901120,"data_stored":381156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54280,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317560,"statfs":{"total":96636764160,"available":96581181440,"internally_reserved":0,"allocated":909312,"data_stored":381772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54836,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317004,"statfs":{"total":96636764160,"available":96580612096,"internally_reserved":0,"allocated":1482752,"data_stored":969912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:50:44.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:50:45.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.001+0000 7f60fbe00640 1 Processor -- start 2024-05-30T06:50:45.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.001+0000 7f60fbe00640 1 -- start start 2024-05-30T06:50:45.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.005+0000 7f60fbe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60f406f9a0 0x7f60f40b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.005+0000 7f60fbe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f60f40b2ec0 0x7f60f40cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.005+0000 7f60fbe00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60f415c8f0 con 0x7f60f4155e60 2024-05-30T06:50:45.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.005+0000 7f60fbe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f60f40ccff0 con 0x7f60f406f9a0 2024-05-30T06:50:45.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.005+0000 7f60fbe00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f60f40ccc80 con 0x7f60f40b2ec0 2024-05-30T06:50:45.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.005+0000 7f60f8a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60f406f9a0 0x7f60f40b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.005+0000 7f60f8a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60f406f9a0 0x7f60f40b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44010/0 (socket says 172.21.15.37:44010) 2024-05-30T06:50:45.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.005+0000 7f60f8a00640 1 -- 172.21.15.37:0/1173666555 learned_addr learned my addr 172.21.15.37:0/1173666555 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:45.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.005+0000 7f60f9e00640 1 --2- 172.21.15.37:0/1173666555 >> v2:172.21.15.105:3300/0 conn(0x7f60f40b2ec0 0x7f60f40cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.005+0000 7f60f8a00640 1 -- 172.21.15.37:0/1173666555 >> v2:172.21.15.105:3300/0 conn(0x7f60f40b2ec0 msgr2=0x7f60f40cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:45.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.005+0000 7f60f8a00640 1 --2- 172.21.15.37:0/1173666555 >> v2:172.21.15.105:3300/0 conn(0x7f60f40b2ec0 0x7f60f40cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.005+0000 7f60f8a00640 1 -- 172.21.15.37:0/1173666555 >> v1:172.21.15.105:6789/0 conn(0x7f60f4155e60 legacy=0x7f60f40cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.005+0000 7f60f8a00640 1 -- 172.21.15.37:0/1173666555 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f415cbd0 con 0x7f60f406f9a0 2024-05-30T06:50:45.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60f8a00640 1 --2- 172.21.15.37:0/1173666555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f406f9a0 0x7f60f40b36a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f60f40718e0 tx=0x7f60e001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72727a87aa1868 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:45.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60f3e00640 1 -- 172.21.15.37:0/1173666555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e00ab430 con 0x7f60f406f9a0 2024-05-30T06:50:45.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60f3e00640 1 -- 172.21.15.37:0/1173666555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e00b0070 con 0x7f60f406f9a0 2024-05-30T06:50:45.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60f3e00640 1 -- 172.21.15.37:0/1173666555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e00ab7f0 con 0x7f60f406f9a0 2024-05-30T06:50:45.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 -- 172.21.15.37:0/1173666555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f406f9a0 msgr2=0x7f60f40b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 --2- 172.21.15.37:0/1173666555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f406f9a0 0x7f60f40b36a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f60f40718e0 tx=0x7f60e001c520 comp rx=0 tx=0).stop 2024-05-30T06:50:45.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 -- 172.21.15.37:0/1173666555 shutdown_connections 2024-05-30T06:50:45.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 --2- 172.21.15.37:0/1173666555 >> v2:172.21.15.105:3300/0 conn(0x7f60f40b2ec0 0x7f60f40cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 --2- 172.21.15.37:0/1173666555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f406f9a0 0x7f60f40b36a0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 -- 172.21.15.37:0/1173666555 >> 172.21.15.37:0/1173666555 conn(0x7f60f40b23a0 msgr2=0x7f60f40b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:45.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 -- 172.21.15.37:0/1173666555 shutdown_connections 2024-05-30T06:50:45.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 -- 172.21.15.37:0/1173666555 wait complete. 2024-05-30T06:50:45.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 Processor -- start 2024-05-30T06:50:45.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 -- start start 2024-05-30T06:50:45.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f406f9a0 0x7f60f4140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f40b2ec0 0x7f60f4156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f4155e60 0x7f60f415e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f60f4166a20 con 0x7f60f4155e60 2024-05-30T06:50:45.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f60f41668a0 con 0x7f60f40b2ec0 2024-05-30T06:50:45.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.009+0000 7f60fbe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f60f4166ba0 con 0x7f60f406f9a0 2024-05-30T06:50:45.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f4155e60 0x7f60f415e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f4155e60 0x7f60f415e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44012/0 (socket says 172.21.15.37:44012) 2024-05-30T06:50:45.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f9e00640 1 -- 172.21.15.37:0/1898926298 learned_addr learned my addr 172.21.15.37:0/1898926298 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:45.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f8a00640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f40b2ec0 0x7f60f4156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f9400640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f406f9a0 0x7f60f4140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f9e00640 1 -- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f406f9a0 msgr2=0x7f60f4140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f9e00640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f406f9a0 0x7f60f4140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f9e00640 1 -- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f40b2ec0 msgr2=0x7f60f4156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f9e00640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f40b2ec0 0x7f60f4156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f9e00640 1 -- 172.21.15.37:0/1898926298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f4158c20 con 0x7f60f4155e60 2024-05-30T06:50:45.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f9e00640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f4155e60 0x7f60f415e2c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009dd0 tx=0x7f60ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:45.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f1600640 1 -- 172.21.15.37:0/1898926298 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec018020 con 0x7f60f4155e60 2024-05-30T06:50:45.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f1600640 1 -- 172.21.15.37:0/1898926298 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ec014480 con 0x7f60f4155e60 2024-05-30T06:50:45.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f1600640 1 -- 172.21.15.37:0/1898926298 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec014870 con 0x7f60f4155e60 2024-05-30T06:50:45.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60fbe00640 1 -- 172.21.15.37:0/1898926298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f4158f00 con 0x7f60f4155e60 2024-05-30T06:50:45.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60fbe00640 1 -- 172.21.15.37:0/1898926298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f4167240 con 0x7f60f4155e60 2024-05-30T06:50:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60fbe00640 1 -- 172.21.15.37:0/1898926298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60f4068b20 con 0x7f60f4155e60 2024-05-30T06:50:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.013+0000 7f60f1600640 1 -- 172.21.15.37:0/1898926298 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f60ec01b020 con 0x7f60f4155e60 2024-05-30T06:50:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.017+0000 7f60f1600640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60d4069100 0x7f60d406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.017+0000 7f60f1600640 1 -- 172.21.15.37:0/1898926298 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f60ec086150 con 0x7f60f4155e60 2024-05-30T06:50:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.017+0000 7f60f9400640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60d4069100 0x7f60d406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.017+0000 7f60f9400640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60d4069100 0x7f60d406b5c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f60e80015b0 tx=0x7f60e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.021+0000 7f60f1600640 1 -- 172.21.15.37:0/1898926298 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f60ec022070 con 0x7f60f4155e60 2024-05-30T06:50:45.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.181+0000 7f60fbe00640 1 -- 172.21.15.37:0/1898926298 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60f4072fb0 con 0x7f60d4069100 2024-05-30T06:50:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.189+0000 7f60f1600640 1 -- 172.21.15.37:0/1898926298 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251957 (secure 0 0 0) 0x7f60f4072fb0 con 0x7f60d4069100 2024-05-30T06:50:45.194 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:50:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.193+0000 7f60fbe00640 1 -- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60d4069100 msgr2=0x7f60d406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.193+0000 7f60fbe00640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60d4069100 0x7f60d406b5c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f60e80015b0 tx=0x7f60e8009040 comp rx=0 tx=0).stop 2024-05-30T06:50:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.193+0000 7f60fbe00640 1 -- 172.21.15.37:0/1898926298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f4155e60 msgr2=0x7f60f415e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.193+0000 7f60fbe00640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f4155e60 0x7f60f415e2c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009dd0 tx=0x7f60ec00c490 comp rx=0 tx=0).stop 2024-05-30T06:50:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.193+0000 7f60fbe00640 1 -- 172.21.15.37:0/1898926298 shutdown_connections 2024-05-30T06:50:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.193+0000 7f60fbe00640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60f4155e60 0x7f60f415e2c0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.193+0000 7f60fbe00640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60d4069100 0x7f60d406b5c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.193+0000 7f60fbe00640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f40b2ec0 0x7f60f4156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.193+0000 7f60fbe00640 1 --2- 172.21.15.37:0/1898926298 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f406f9a0 0x7f60f4140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.193+0000 7f60fbe00640 1 -- 172.21.15.37:0/1898926298 >> 172.21.15.37:0/1898926298 conn(0x7f60f40b23a0 msgr2=0x7f60f40b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.193+0000 7f60fbe00640 1 -- 172.21.15.37:0/1898926298 shutdown_connections 2024-05-30T06:50:45.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.193+0000 7f60fbe00640 1 -- 172.21.15.37:0/1898926298 wait complete. 2024-05-30T06:50:45.215 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-05-30T06:50:44.792090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":435304,"kb_used_data":8168,"kb_used_omap":12,"kb_used_meta":426995,"kb_avail":754539416,"statfs":{"total":773094113280,"available":772648361984,"internally_reserved":0,"allocated":8364032,"data_stored":4221908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":437243440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.678768"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192368+0000","last_change":"2024-05-30T06:50:36.141724+0000","last_active":"2024-05-30T06:50:37.192368+0000","last_peered":"2024-05-30T06:50:37.192368+0000","last_clean":"2024-05-30T06:50:37.192368+0000","last_became_active":"2024-05-30T06:50:36.141318+0000","last_became_peered":"2024-05-30T06:50:36.141318+0000","last_unstale":"2024-05-30T06:50:37.192368+0000","last_undegraded":"2024-05-30T06:50:37.192368+0000","last_fullsized":"2024-05-30T06:50:37.192368+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:20:35.641203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192847+0000","last_change":"2024-05-30T06:50:36.136008+0000","last_active":"2024-05-30T06:50:37.192847+0000","last_peered":"2024-05-30T06:50:37.192847+0000","last_clean":"2024-05-30T06:50:37.192847+0000","last_became_active":"2024-05-30T06:50:36.135609+0000","last_became_peered":"2024-05-30T06:50:36.135609+0000","last_unstale":"2024-05-30T06:50:37.192847+0000","last_undegraded":"2024-05-30T06:50:37.192847+0000","last_fullsized":"2024-05-30T06:50:37.192847+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:29.341913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190991+0000","last_change":"2024-05-30T06:50:36.135494+0000","last_active":"2024-05-30T06:50:37.190991+0000","last_peered":"2024-05-30T06:50:37.190991+0000","last_clean":"2024-05-30T06:50:37.190991+0000","last_became_active":"2024-05-30T06:50:36.135105+0000","last_became_peered":"2024-05-30T06:50:36.135105+0000","last_unstale":"2024-05-30T06:50:37.190991+0000","last_undegraded":"2024-05-30T06:50:37.190991+0000","last_fullsized":"2024-05-30T06:50:37.190991+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:16.744233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133455+0000","last_change":"2024-05-30T06:50:36.134884+0000","last_active":"2024-05-30T06:50:37.133455+0000","last_peered":"2024-05-30T06:50:37.133455+0000","last_clean":"2024-05-30T06:50:37.133455+0000","last_became_active":"2024-05-30T06:50:36.134671+0000","last_became_peered":"2024-05-30T06:50:36.134671+0000","last_unstale":"2024-05-30T06:50:37.133455+0000","last_undegraded":"2024-05-30T06:50:37.133455+0000","last_fullsized":"2024-05-30T06:50:37.133455+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:19.626381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190492+0000","last_change":"2024-05-30T06:50:36.132795+0000","last_active":"2024-05-30T06:50:37.190492+0000","last_peered":"2024-05-30T06:50:37.190492+0000","last_clean":"2024-05-30T06:50:37.190492+0000","last_became_active":"2024-05-30T06:50:36.132512+0000","last_became_peered":"2024-05-30T06:50:36.132512+0000","last_unstale":"2024-05-30T06:50:37.190492+0000","last_undegraded":"2024-05-30T06:50:37.190492+0000","last_fullsized":"2024-05-30T06:50:37.190492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:34:49.401832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192499+0000","last_change":"2024-05-30T06:50:36.131467+0000","last_active":"2024-05-30T06:50:37.192499+0000","last_peered":"2024-05-30T06:50:37.192499+0000","last_clean":"2024-05-30T06:50:37.192499+0000","last_became_active":"2024-05-30T06:50:36.131112+0000","last_became_peered":"2024-05-30T06:50:36.131112+0000","last_unstale":"2024-05-30T06:50:37.192499+0000","last_undegraded":"2024-05-30T06:50:37.192499+0000","last_fullsized":"2024-05-30T06:50:37.192499+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:36:19.920062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.135957+0000","last_change":"2024-05-30T06:50:36.123669+0000","last_active":"2024-05-30T06:50:37.135957+0000","last_peered":"2024-05-30T06:50:37.135957+0000","last_clean":"2024-05-30T06:50:37.135957+0000","last_became_active":"2024-05-30T06:50:36.123352+0000","last_became_peered":"2024-05-30T06:50:36.123352+0000","last_unstale":"2024-05-30T06:50:37.135957+0000","last_undegraded":"2024-05-30T06:50:37.135957+0000","last_fullsized":"2024-05-30T06:50:37.135957+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:40.263358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191990+0000","last_change":"2024-05-30T06:50:36.127388+0000","last_active":"2024-05-30T06:50:37.191990+0000","last_peered":"2024-05-30T06:50:37.191990+0000","last_clean":"2024-05-30T06:50:37.191990+0000","last_became_active":"2024-05-30T06:50:36.127124+0000","last_became_peered":"2024-05-30T06:50:36.127124+0000","last_unstale":"2024-05-30T06:50:37.191990+0000","last_undegraded":"2024-05-30T06:50:37.191990+0000","last_fullsized":"2024-05-30T06:50:37.191990+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:20:47.847094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191645+0000","last_change":"2024-05-30T06:50:36.138009+0000","last_active":"2024-05-30T06:50:37.191645+0000","last_peered":"2024-05-30T06:50:37.191645+0000","last_clean":"2024-05-30T06:50:37.191645+0000","last_became_active":"2024-05-30T06:50:36.137224+0000","last_became_peered":"2024-05-30T06:50:36.137224+0000","last_unstale":"2024-05-30T06:50:37.191645+0000","last_undegraded":"2024-05-30T06:50:37.191645+0000","last_fullsized":"2024-05-30T06:50:37.191645+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:31:20.436064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137057+0000","last_change":"2024-05-30T06:50:36.145133+0000","last_active":"2024-05-30T06:50:37.137057+0000","last_peered":"2024-05-30T06:50:37.137057+0000","last_clean":"2024-05-30T06:50:37.137057+0000","last_became_active":"2024-05-30T06:50:36.144866+0000","last_became_peered":"2024-05-30T06:50:36.144866+0000","last_unstale":"2024-05-30T06:50:37.137057+0000","last_undegraded":"2024-05-30T06:50:37.137057+0000","last_fullsized":"2024-05-30T06:50:37.137057+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:09:27.992413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192859+0000","last_change":"2024-05-30T06:50:36.146835+0000","last_active":"2024-05-30T06:50:37.192859+0000","last_peered":"2024-05-30T06:50:37.192859+0000","last_clean":"2024-05-30T06:50:37.192859+0000","last_became_active":"2024-05-30T06:50:36.146478+0000","last_became_peered":"2024-05-30T06:50:36.146478+0000","last_unstale":"2024-05-30T06:50:37.192859+0000","last_undegraded":"2024-05-30T06:50:37.192859+0000","last_fullsized":"2024-05-30T06:50:37.192859+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:59:28.920236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133479+0000","last_change":"2024-05-30T06:50:36.133491+0000","last_active":"2024-05-30T06:50:37.133479+0000","last_peered":"2024-05-30T06:50:37.133479+0000","last_clean":"2024-05-30T06:50:37.133479+0000","last_became_active":"2024-05-30T06:50:36.133242+0000","last_became_peered":"2024-05-30T06:50:36.133242+0000","last_unstale":"2024-05-30T06:50:37.133479+0000","last_undegraded":"2024-05-30T06:50:37.133479+0000","last_fullsized":"2024-05-30T06:50:37.133479+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:39:50.722112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190100+0000","last_change":"2024-05-30T06:50:36.128090+0000","last_active":"2024-05-30T06:50:37.190100+0000","last_peered":"2024-05-30T06:50:37.190100+0000","last_clean":"2024-05-30T06:50:37.190100+0000","last_became_active":"2024-05-30T06:50:36.127805+0000","last_became_peered":"2024-05-30T06:50:36.127805+0000","last_unstale":"2024-05-30T06:50:37.190100+0000","last_undegraded":"2024-05-30T06:50:37.190100+0000","last_fullsized":"2024-05-30T06:50:37.190100+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:40.263358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190952+0000","last_change":"2024-05-30T06:50:36.128319+0000","last_active":"2024-05-30T06:50:37.190952+0000","last_peered":"2024-05-30T06:50:37.190952+0000","last_clean":"2024-05-30T06:50:37.190952+0000","last_became_active":"2024-05-30T06:50:36.127722+0000","last_became_peered":"2024-05-30T06:50:36.127722+0000","last_unstale":"2024-05-30T06:50:37.190952+0000","last_undegraded":"2024-05-30T06:50:37.190952+0000","last_fullsized":"2024-05-30T06:50:37.190952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:36:15.100211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189834+0000","last_change":"2024-05-30T06:50:36.130537+0000","last_active":"2024-05-30T06:50:37.189834+0000","last_peered":"2024-05-30T06:50:37.189834+0000","last_clean":"2024-05-30T06:50:37.189834+0000","last_became_active":"2024-05-30T06:50:36.130275+0000","last_became_peered":"2024-05-30T06:50:36.130275+0000","last_unstale":"2024-05-30T06:50:37.189834+0000","last_undegraded":"2024-05-30T06:50:37.189834+0000","last_fullsized":"2024-05-30T06:50:37.189834+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:39:23.879376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.135722+0000","last_change":"2024-05-30T06:50:36.129772+0000","last_active":"2024-05-30T06:50:37.135722+0000","last_peered":"2024-05-30T06:50:37.135722+0000","last_clean":"2024-05-30T06:50:37.135722+0000","last_became_active":"2024-05-30T06:50:36.129459+0000","last_became_peered":"2024-05-30T06:50:36.129459+0000","last_unstale":"2024-05-30T06:50:37.135722+0000","last_undegraded":"2024-05-30T06:50:37.135722+0000","last_fullsized":"2024-05-30T06:50:37.135722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:46:18.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191805+0000","last_change":"2024-05-30T06:50:36.137706+0000","last_active":"2024-05-30T06:50:37.191805+0000","last_peered":"2024-05-30T06:50:37.191805+0000","last_clean":"2024-05-30T06:50:37.191805+0000","last_became_active":"2024-05-30T06:50:36.136870+0000","last_became_peered":"2024-05-30T06:50:36.136870+0000","last_unstale":"2024-05-30T06:50:37.191805+0000","last_undegraded":"2024-05-30T06:50:37.191805+0000","last_fullsized":"2024-05-30T06:50:37.191805+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:00:22.867977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133656+0000","last_change":"2024-05-30T06:50:36.134700+0000","last_active":"2024-05-30T06:50:37.133656+0000","last_peered":"2024-05-30T06:50:37.133656+0000","last_clean":"2024-05-30T06:50:37.133656+0000","last_became_active":"2024-05-30T06:50:36.134433+0000","last_became_peered":"2024-05-30T06:50:36.134433+0000","last_unstale":"2024-05-30T06:50:37.133656+0000","last_undegraded":"2024-05-30T06:50:37.133656+0000","last_fullsized":"2024-05-30T06:50:37.133656+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:49:01.139347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192372+0000","last_change":"2024-05-30T06:50:36.128464+0000","last_active":"2024-05-30T06:50:37.192372+0000","last_peered":"2024-05-30T06:50:37.192372+0000","last_clean":"2024-05-30T06:50:37.192372+0000","last_became_active":"2024-05-30T06:50:36.128170+0000","last_became_peered":"2024-05-30T06:50:36.128170+0000","last_unstale":"2024-05-30T06:50:37.192372+0000","last_undegraded":"2024-05-30T06:50:37.192372+0000","last_fullsized":"2024-05-30T06:50:37.192372+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:22:49.338617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190046+0000","last_change":"2024-05-30T06:50:36.124537+0000","last_active":"2024-05-30T06:50:37.190046+0000","last_peered":"2024-05-30T06:50:37.190046+0000","last_clean":"2024-05-30T06:50:37.190046+0000","last_became_active":"2024-05-30T06:50:36.124254+0000","last_became_peered":"2024-05-30T06:50:36.124254+0000","last_unstale":"2024-05-30T06:50:37.190046+0000","last_undegraded":"2024-05-30T06:50:37.190046+0000","last_fullsized":"2024-05-30T06:50:37.190046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:25:56.549987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136570+0000","last_change":"2024-05-30T06:50:36.129938+0000","last_active":"2024-05-30T06:50:37.136570+0000","last_peered":"2024-05-30T06:50:37.136570+0000","last_clean":"2024-05-30T06:50:37.136570+0000","last_became_active":"2024-05-30T06:50:36.129593+0000","last_became_peered":"2024-05-30T06:50:36.129593+0000","last_unstale":"2024-05-30T06:50:37.136570+0000","last_undegraded":"2024-05-30T06:50:37.136570+0000","last_fullsized":"2024-05-30T06:50:37.136570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:21:52.455652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136415+0000","last_change":"2024-05-30T06:50:36.145803+0000","last_active":"2024-05-30T06:50:37.136415+0000","last_peered":"2024-05-30T06:50:37.136415+0000","last_clean":"2024-05-30T06:50:37.136415+0000","last_became_active":"2024-05-30T06:50:36.145507+0000","last_became_peered":"2024-05-30T06:50:36.145507+0000","last_unstale":"2024-05-30T06:50:37.136415+0000","last_undegraded":"2024-05-30T06:50:37.136415+0000","last_fullsized":"2024-05-30T06:50:37.136415+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:57.447664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192150+0000","last_change":"2024-05-30T06:50:36.133852+0000","last_active":"2024-05-30T06:50:37.192150+0000","last_peered":"2024-05-30T06:50:37.192150+0000","last_clean":"2024-05-30T06:50:37.192150+0000","last_became_active":"2024-05-30T06:50:36.133264+0000","last_became_peered":"2024-05-30T06:50:36.133264+0000","last_unstale":"2024-05-30T06:50:37.192150+0000","last_undegraded":"2024-05-30T06:50:37.192150+0000","last_fullsized":"2024-05-30T06:50:37.192150+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:47:06.431698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191824+0000","last_change":"2024-05-30T06:50:36.138660+0000","last_active":"2024-05-30T06:50:37.191824+0000","last_peered":"2024-05-30T06:50:37.191824+0000","last_clean":"2024-05-30T06:50:37.191824+0000","last_became_active":"2024-05-30T06:50:36.135036+0000","last_became_peered":"2024-05-30T06:50:36.135036+0000","last_unstale":"2024-05-30T06:50:37.191824+0000","last_undegraded":"2024-05-30T06:50:37.191824+0000","last_fullsized":"2024-05-30T06:50:37.191824+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:30:13.290474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136978+0000","last_change":"2024-05-30T06:50:36.137261+0000","last_active":"2024-05-30T06:50:37.136978+0000","last_peered":"2024-05-30T06:50:37.136978+0000","last_clean":"2024-05-30T06:50:37.136978+0000","last_became_active":"2024-05-30T06:50:36.136976+0000","last_became_peered":"2024-05-30T06:50:36.136976+0000","last_unstale":"2024-05-30T06:50:37.136978+0000","last_undegraded":"2024-05-30T06:50:37.136978+0000","last_fullsized":"2024-05-30T06:50:37.136978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:21:42.786793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137337+0000","last_change":"2024-05-30T06:50:36.131795+0000","last_active":"2024-05-30T06:50:37.137337+0000","last_peered":"2024-05-30T06:50:37.137337+0000","last_clean":"2024-05-30T06:50:37.137337+0000","last_became_active":"2024-05-30T06:50:36.131557+0000","last_became_peered":"2024-05-30T06:50:36.131557+0000","last_unstale":"2024-05-30T06:50:37.137337+0000","last_undegraded":"2024-05-30T06:50:37.137337+0000","last_fullsized":"2024-05-30T06:50:37.137337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:17:34.623293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191123+0000","last_change":"2024-05-30T06:50:36.142813+0000","last_active":"2024-05-30T06:50:37.191123+0000","last_peered":"2024-05-30T06:50:37.191123+0000","last_clean":"2024-05-30T06:50:37.191123+0000","last_became_active":"2024-05-30T06:50:36.141331+0000","last_became_peered":"2024-05-30T06:50:36.141331+0000","last_unstale":"2024-05-30T06:50:37.191123+0000","last_undegraded":"2024-05-30T06:50:37.191123+0000","last_fullsized":"2024-05-30T06:50:37.191123+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:00:33.525966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136476+0000","last_change":"2024-05-30T06:50:36.134492+0000","last_active":"2024-05-30T06:50:37.136476+0000","last_peered":"2024-05-30T06:50:37.136476+0000","last_clean":"2024-05-30T06:50:37.136476+0000","last_became_active":"2024-05-30T06:50:36.132522+0000","last_became_peered":"2024-05-30T06:50:36.132522+0000","last_unstale":"2024-05-30T06:50:37.136476+0000","last_undegraded":"2024-05-30T06:50:37.136476+0000","last_fullsized":"2024-05-30T06:50:37.136476+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:08:13.224977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190308+0000","last_change":"2024-05-30T06:50:36.137982+0000","last_active":"2024-05-30T06:50:37.190308+0000","last_peered":"2024-05-30T06:50:37.190308+0000","last_clean":"2024-05-30T06:50:37.190308+0000","last_became_active":"2024-05-30T06:50:36.137660+0000","last_became_peered":"2024-05-30T06:50:36.137660+0000","last_unstale":"2024-05-30T06:50:37.190308+0000","last_undegraded":"2024-05-30T06:50:37.190308+0000","last_fullsized":"2024-05-30T06:50:37.190308+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:12:39.654448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136046+0000","last_change":"2024-05-30T06:50:36.127494+0000","last_active":"2024-05-30T06:50:37.136046+0000","last_peered":"2024-05-30T06:50:37.136046+0000","last_clean":"2024-05-30T06:50:37.136046+0000","last_became_active":"2024-05-30T06:50:36.126783+0000","last_became_peered":"2024-05-30T06:50:36.126783+0000","last_unstale":"2024-05-30T06:50:37.136046+0000","last_undegraded":"2024-05-30T06:50:37.136046+0000","last_fullsized":"2024-05-30T06:50:37.136046+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:58.008213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136126+0000","last_change":"2024-05-30T06:50:36.130480+0000","last_active":"2024-05-30T06:50:37.136126+0000","last_peered":"2024-05-30T06:50:37.136126+0000","last_clean":"2024-05-30T06:50:37.136126+0000","last_became_active":"2024-05-30T06:50:36.130164+0000","last_became_peered":"2024-05-30T06:50:36.130164+0000","last_unstale":"2024-05-30T06:50:37.136126+0000","last_undegraded":"2024-05-30T06:50:37.136126+0000","last_fullsized":"2024-05-30T06:50:37.136126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:07:33.282727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192047+0000","last_change":"2024-05-30T06:50:36.139305+0000","last_active":"2024-05-30T06:50:37.192047+0000","last_peered":"2024-05-30T06:50:37.192047+0000","last_clean":"2024-05-30T06:50:37.192047+0000","last_became_active":"2024-05-30T06:50:36.138559+0000","last_became_peered":"2024-05-30T06:50:36.138559+0000","last_unstale":"2024-05-30T06:50:37.192047+0000","last_undegraded":"2024-05-30T06:50:37.192047+0000","last_fullsized":"2024-05-30T06:50:37.192047+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:38:35.033699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192497+0000","last_change":"2024-05-30T06:50:36.148984+0000","last_active":"2024-05-30T06:50:37.192497+0000","last_peered":"2024-05-30T06:50:37.192497+0000","last_clean":"2024-05-30T06:50:37.192497+0000","last_became_active":"2024-05-30T06:50:36.148443+0000","last_became_peered":"2024-05-30T06:50:36.148443+0000","last_unstale":"2024-05-30T06:50:37.192497+0000","last_undegraded":"2024-05-30T06:50:37.192497+0000","last_fullsized":"2024-05-30T06:50:37.192497+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:30:56.516597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"72'4","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192950+0000","last_change":"2024-05-30T06:50:35.135469+0000","last_active":"2024-05-30T06:50:37.192950+0000","last_peered":"2024-05-30T06:50:37.192950+0000","last_clean":"2024-05-30T06:50:37.192950+0000","last_became_active":"2024-05-30T06:50:35.135165+0000","last_became_peered":"2024-05-30T06:50:35.135165+0000","last_unstale":"2024-05-30T06:50:37.192950+0000","last_undegraded":"2024-05-30T06:50:37.192950+0000","last_fullsized":"2024-05-30T06:50:37.192950+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:55:43.836193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191741+0000","last_change":"2024-05-30T06:50:36.137484+0000","last_active":"2024-05-30T06:50:37.191741+0000","last_peered":"2024-05-30T06:50:37.191741+0000","last_clean":"2024-05-30T06:50:37.191741+0000","last_became_active":"2024-05-30T06:50:36.136537+0000","last_became_peered":"2024-05-30T06:50:36.136537+0000","last_unstale":"2024-05-30T06:50:37.191741+0000","last_undegraded":"2024-05-30T06:50:37.191741+0000","last_fullsized":"2024-05-30T06:50:37.191741+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:49.864351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190761+0000","last_change":"2024-05-30T06:50:35.129396+0000","last_active":"2024-05-30T06:50:37.190761+0000","last_peered":"2024-05-30T06:50:37.190761+0000","last_clean":"2024-05-30T06:50:37.190761+0000","last_became_active":"2024-05-30T06:50:35.128968+0000","last_became_peered":"2024-05-30T06:50:35.128968+0000","last_unstale":"2024-05-30T06:50:37.190761+0000","last_undegraded":"2024-05-30T06:50:37.190761+0000","last_fullsized":"2024-05-30T06:50:37.190761+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:01.742927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192187+0000","last_change":"2024-05-30T06:50:36.140265+0000","last_active":"2024-05-30T06:50:37.192187+0000","last_peered":"2024-05-30T06:50:37.192187+0000","last_clean":"2024-05-30T06:50:37.192187+0000","last_became_active":"2024-05-30T06:50:36.139996+0000","last_became_peered":"2024-05-30T06:50:36.139996+0000","last_unstale":"2024-05-30T06:50:37.192187+0000","last_undegraded":"2024-05-30T06:50:37.192187+0000","last_fullsized":"2024-05-30T06:50:37.192187+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:58:16.706670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136834+0000","last_change":"2024-05-30T06:50:35.128453+0000","last_active":"2024-05-30T06:50:37.136834+0000","last_peered":"2024-05-30T06:50:37.136834+0000","last_clean":"2024-05-30T06:50:37.136834+0000","last_became_active":"2024-05-30T06:50:35.128177+0000","last_became_peered":"2024-05-30T06:50:35.128177+0000","last_unstale":"2024-05-30T06:50:37.136834+0000","last_undegraded":"2024-05-30T06:50:37.136834+0000","last_fullsized":"2024-05-30T06:50:37.136834+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:10:26.592642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192977+0000","last_change":"2024-05-30T06:50:36.137261+0000","last_active":"2024-05-30T06:50:37.192977+0000","last_peered":"2024-05-30T06:50:37.192977+0000","last_clean":"2024-05-30T06:50:37.192977+0000","last_became_active":"2024-05-30T06:50:36.137006+0000","last_became_peered":"2024-05-30T06:50:36.137006+0000","last_unstale":"2024-05-30T06:50:37.192977+0000","last_undegraded":"2024-05-30T06:50:37.192977+0000","last_fullsized":"2024-05-30T06:50:37.192977+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:28:35.661821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192596+0000","last_change":"2024-05-30T06:50:35.130217+0000","last_active":"2024-05-30T06:50:37.192596+0000","last_peered":"2024-05-30T06:50:37.192596+0000","last_clean":"2024-05-30T06:50:37.192596+0000","last_became_active":"2024-05-30T06:50:35.129905+0000","last_became_peered":"2024-05-30T06:50:35.129905+0000","last_unstale":"2024-05-30T06:50:37.192596+0000","last_undegraded":"2024-05-30T06:50:37.192596+0000","last_fullsized":"2024-05-30T06:50:37.192596+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:14.947254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136751+0000","last_change":"2024-05-30T06:50:36.127673+0000","last_active":"2024-05-30T06:50:37.136751+0000","last_peered":"2024-05-30T06:50:37.136751+0000","last_clean":"2024-05-30T06:50:37.136751+0000","last_became_active":"2024-05-30T06:50:36.127204+0000","last_became_peered":"2024-05-30T06:50:36.127204+0000","last_unstale":"2024-05-30T06:50:37.136751+0000","last_undegraded":"2024-05-30T06:50:37.136751+0000","last_fullsized":"2024-05-30T06:50:37.136751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:09:53.013517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190858+0000","last_change":"2024-05-30T06:50:35.131068+0000","last_active":"2024-05-30T06:50:37.190858+0000","last_peered":"2024-05-30T06:50:37.190858+0000","last_clean":"2024-05-30T06:50:37.190858+0000","last_became_active":"2024-05-30T06:50:35.130730+0000","last_became_peered":"2024-05-30T06:50:35.130730+0000","last_unstale":"2024-05-30T06:50:37.190858+0000","last_undegraded":"2024-05-30T06:50:37.190858+0000","last_fullsized":"2024-05-30T06:50:37.190858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:17:44.762161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136386+0000","last_change":"2024-05-30T06:50:36.137654+0000","last_active":"2024-05-30T06:50:37.136386+0000","last_peered":"2024-05-30T06:50:37.136386+0000","last_clean":"2024-05-30T06:50:37.136386+0000","last_became_active":"2024-05-30T06:50:36.137316+0000","last_became_peered":"2024-05-30T06:50:36.137316+0000","last_unstale":"2024-05-30T06:50:37.136386+0000","last_undegraded":"2024-05-30T06:50:37.136386+0000","last_fullsized":"2024-05-30T06:50:37.136386+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:08:29.341913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192564+0000","last_change":"2024-05-30T06:50:35.132955+0000","last_active":"2024-05-30T06:50:37.192564+0000","last_peered":"2024-05-30T06:50:37.192564+0000","last_clean":"2024-05-30T06:50:37.192564+0000","last_became_active":"2024-05-30T06:50:35.132679+0000","last_became_peered":"2024-05-30T06:50:35.132679+0000","last_unstale":"2024-05-30T06:50:37.192564+0000","last_undegraded":"2024-05-30T06:50:37.192564+0000","last_fullsized":"2024-05-30T06:50:37.192564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:39:49.713340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190728+0000","last_change":"2024-05-30T06:50:36.127242+0000","last_active":"2024-05-30T06:50:37.190728+0000","last_peered":"2024-05-30T06:50:37.190728+0000","last_clean":"2024-05-30T06:50:37.190728+0000","last_became_active":"2024-05-30T06:50:36.126954+0000","last_became_peered":"2024-05-30T06:50:36.126954+0000","last_unstale":"2024-05-30T06:50:37.190728+0000","last_undegraded":"2024-05-30T06:50:37.190728+0000","last_fullsized":"2024-05-30T06:50:37.190728+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:38:37.252400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133237+0000","last_change":"2024-05-30T06:50:35.128609+0000","last_active":"2024-05-30T06:50:37.133237+0000","last_peered":"2024-05-30T06:50:37.133237+0000","last_clean":"2024-05-30T06:50:37.133237+0000","last_became_active":"2024-05-30T06:50:35.128214+0000","last_became_peered":"2024-05-30T06:50:35.128214+0000","last_unstale":"2024-05-30T06:50:37.133237+0000","last_undegraded":"2024-05-30T06:50:37.133237+0000","last_fullsized":"2024-05-30T06:50:37.133237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:57.201902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190443+0000","last_change":"2024-05-30T06:50:36.137216+0000","last_active":"2024-05-30T06:50:37.190443+0000","last_peered":"2024-05-30T06:50:37.190443+0000","last_clean":"2024-05-30T06:50:37.190443+0000","last_became_active":"2024-05-30T06:50:36.136945+0000","last_became_peered":"2024-05-30T06:50:36.136945+0000","last_unstale":"2024-05-30T06:50:37.190443+0000","last_undegraded":"2024-05-30T06:50:37.190443+0000","last_fullsized":"2024-05-30T06:50:37.190443+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:58.008213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190825+0000","last_change":"2024-05-30T06:50:35.119974+0000","last_active":"2024-05-30T06:50:37.190825+0000","last_peered":"2024-05-30T06:50:37.190825+0000","last_clean":"2024-05-30T06:50:37.190825+0000","last_became_active":"2024-05-30T06:50:35.119188+0000","last_became_peered":"2024-05-30T06:50:35.119188+0000","last_unstale":"2024-05-30T06:50:37.190825+0000","last_undegraded":"2024-05-30T06:50:37.190825+0000","last_fullsized":"2024-05-30T06:50:37.190825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:45:15.601089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137573+0000","last_change":"2024-05-30T06:50:36.135040+0000","last_active":"2024-05-30T06:50:37.137573+0000","last_peered":"2024-05-30T06:50:37.137573+0000","last_clean":"2024-05-30T06:50:37.137573+0000","last_became_active":"2024-05-30T06:50:36.134764+0000","last_became_peered":"2024-05-30T06:50:36.134764+0000","last_unstale":"2024-05-30T06:50:37.137573+0000","last_undegraded":"2024-05-30T06:50:37.137573+0000","last_fullsized":"2024-05-30T06:50:37.137573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:29:12.186720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137016+0000","last_change":"2024-05-30T06:50:35.133698+0000","last_active":"2024-05-30T06:50:37.137016+0000","last_peered":"2024-05-30T06:50:37.137016+0000","last_clean":"2024-05-30T06:50:37.137016+0000","last_became_active":"2024-05-30T06:50:35.132932+0000","last_became_peered":"2024-05-30T06:50:35.132932+0000","last_unstale":"2024-05-30T06:50:37.137016+0000","last_undegraded":"2024-05-30T06:50:37.137016+0000","last_fullsized":"2024-05-30T06:50:37.137016+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:29:04.354604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192807+0000","last_change":"2024-05-30T06:50:36.148139+0000","last_active":"2024-05-30T06:50:37.192807+0000","last_peered":"2024-05-30T06:50:37.192807+0000","last_clean":"2024-05-30T06:50:37.192807+0000","last_became_active":"2024-05-30T06:50:36.147823+0000","last_became_peered":"2024-05-30T06:50:36.147823+0000","last_unstale":"2024-05-30T06:50:37.192807+0000","last_undegraded":"2024-05-30T06:50:37.192807+0000","last_fullsized":"2024-05-30T06:50:37.192807+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:51:43.331082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192947+0000","last_change":"2024-05-30T06:50:35.126864+0000","last_active":"2024-05-30T06:50:37.192947+0000","last_peered":"2024-05-30T06:50:37.192947+0000","last_clean":"2024-05-30T06:50:37.192947+0000","last_became_active":"2024-05-30T06:50:35.126599+0000","last_became_peered":"2024-05-30T06:50:35.126599+0000","last_unstale":"2024-05-30T06:50:37.192947+0000","last_undegraded":"2024-05-30T06:50:37.192947+0000","last_fullsized":"2024-05-30T06:50:37.192947+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:29:09.412208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192881+0000","last_change":"2024-05-30T06:50:36.132398+0000","last_active":"2024-05-30T06:50:37.192881+0000","last_peered":"2024-05-30T06:50:37.192881+0000","last_clean":"2024-05-30T06:50:37.192881+0000","last_became_active":"2024-05-30T06:50:36.132093+0000","last_became_peered":"2024-05-30T06:50:36.132093+0000","last_unstale":"2024-05-30T06:50:37.192881+0000","last_undegraded":"2024-05-30T06:50:37.192881+0000","last_fullsized":"2024-05-30T06:50:37.192881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:40:57.447664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"72'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191222+0000","last_change":"2024-05-30T06:50:35.126131+0000","last_active":"2024-05-30T06:50:37.191222+0000","last_peered":"2024-05-30T06:50:37.191222+0000","last_clean":"2024-05-30T06:50:37.191222+0000","last_became_active":"2024-05-30T06:50:35.125864+0000","last_became_peered":"2024-05-30T06:50:35.125864+0000","last_unstale":"2024-05-30T06:50:37.191222+0000","last_undegraded":"2024-05-30T06:50:37.191222+0000","last_fullsized":"2024-05-30T06:50:37.191222+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:04.103814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191224+0000","last_change":"2024-05-30T06:50:36.130870+0000","last_active":"2024-05-30T06:50:37.191224+0000","last_peered":"2024-05-30T06:50:37.191224+0000","last_clean":"2024-05-30T06:50:37.191224+0000","last_became_active":"2024-05-30T06:50:36.130296+0000","last_became_peered":"2024-05-30T06:50:36.130296+0000","last_unstale":"2024-05-30T06:50:37.191224+0000","last_undegraded":"2024-05-30T06:50:37.191224+0000","last_fullsized":"2024-05-30T06:50:37.191224+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:12:29.459735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"72'6","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133579+0000","last_change":"2024-05-30T06:50:35.115426+0000","last_active":"2024-05-30T06:50:37.133579+0000","last_peered":"2024-05-30T06:50:37.133579+0000","last_clean":"2024-05-30T06:50:37.133579+0000","last_became_active":"2024-05-30T06:50:35.115117+0000","last_became_peered":"2024-05-30T06:50:35.115117+0000","last_unstale":"2024-05-30T06:50:37.133579+0000","last_undegraded":"2024-05-30T06:50:37.133579+0000","last_fullsized":"2024-05-30T06:50:37.133579+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:00:21.859206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191968+0000","last_change":"2024-05-30T06:50:36.145873+0000","last_active":"2024-05-30T06:50:37.191968+0000","last_peered":"2024-05-30T06:50:37.191968+0000","last_clean":"2024-05-30T06:50:37.191968+0000","last_became_active":"2024-05-30T06:50:36.145712+0000","last_became_peered":"2024-05-30T06:50:36.145712+0000","last_unstale":"2024-05-30T06:50:37.191968+0000","last_undegraded":"2024-05-30T06:50:37.191968+0000","last_fullsized":"2024-05-30T06:50:37.191968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:13:18.388535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133395+0000","last_change":"2024-05-30T06:50:35.128766+0000","last_active":"2024-05-30T06:50:37.133395+0000","last_peered":"2024-05-30T06:50:37.133395+0000","last_clean":"2024-05-30T06:50:37.133395+0000","last_became_active":"2024-05-30T06:50:35.128339+0000","last_became_peered":"2024-05-30T06:50:35.128339+0000","last_unstale":"2024-05-30T06:50:37.133395+0000","last_undegraded":"2024-05-30T06:50:37.133395+0000","last_fullsized":"2024-05-30T06:50:37.133395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:48.855579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136777+0000","last_change":"2024-05-30T06:50:36.136119+0000","last_active":"2024-05-30T06:50:37.136777+0000","last_peered":"2024-05-30T06:50:37.136777+0000","last_clean":"2024-05-30T06:50:37.136777+0000","last_became_active":"2024-05-30T06:50:36.135862+0000","last_became_peered":"2024-05-30T06:50:36.135862+0000","last_unstale":"2024-05-30T06:50:37.136777+0000","last_undegraded":"2024-05-30T06:50:37.136777+0000","last_fullsized":"2024-05-30T06:50:37.136777+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:56:57.945018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.193082+0000","last_change":"2024-05-30T06:50:35.125536+0000","last_active":"2024-05-30T06:50:37.193082+0000","last_peered":"2024-05-30T06:50:37.193082+0000","last_clean":"2024-05-30T06:50:37.193082+0000","last_became_active":"2024-05-30T06:50:35.125221+0000","last_became_peered":"2024-05-30T06:50:35.125221+0000","last_unstale":"2024-05-30T06:50:37.193082+0000","last_undegraded":"2024-05-30T06:50:37.193082+0000","last_fullsized":"2024-05-30T06:50:37.193082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:33:36.208132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189783+0000","last_change":"2024-05-30T06:50:36.128699+0000","last_active":"2024-05-30T06:50:37.189783+0000","last_peered":"2024-05-30T06:50:37.189783+0000","last_clean":"2024-05-30T06:50:37.189783+0000","last_became_active":"2024-05-30T06:50:36.128437+0000","last_became_peered":"2024-05-30T06:50:36.128437+0000","last_unstale":"2024-05-30T06:50:37.189783+0000","last_undegraded":"2024-05-30T06:50:37.189783+0000","last_fullsized":"2024-05-30T06:50:37.189783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:36:45.423083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136052+0000","last_change":"2024-05-30T06:50:35.134033+0000","last_active":"2024-05-30T06:50:37.136052+0000","last_peered":"2024-05-30T06:50:37.136052+0000","last_clean":"2024-05-30T06:50:37.136052+0000","last_became_active":"2024-05-30T06:50:35.133639+0000","last_became_peered":"2024-05-30T06:50:35.133639+0000","last_unstale":"2024-05-30T06:50:37.136052+0000","last_undegraded":"2024-05-30T06:50:37.136052+0000","last_fullsized":"2024-05-30T06:50:37.136052+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:01.742927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190598+0000","last_change":"2024-05-30T06:50:36.131744+0000","last_active":"2024-05-30T06:50:37.190598+0000","last_peered":"2024-05-30T06:50:37.190598+0000","last_clean":"2024-05-30T06:50:37.190598+0000","last_became_active":"2024-05-30T06:50:36.131457+0000","last_became_peered":"2024-05-30T06:50:36.131457+0000","last_unstale":"2024-05-30T06:50:37.190598+0000","last_undegraded":"2024-05-30T06:50:37.190598+0000","last_fullsized":"2024-05-30T06:50:37.190598+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:59:24.735462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"72'8","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.135752+0000","last_change":"2024-05-30T06:50:35.136029+0000","last_active":"2024-05-30T06:50:37.135752+0000","last_peered":"2024-05-30T06:50:37.135752+0000","last_clean":"2024-05-30T06:50:37.135752+0000","last_became_active":"2024-05-30T06:50:35.135713+0000","last_became_peered":"2024-05-30T06:50:35.135713+0000","last_unstale":"2024-05-30T06:50:37.135752+0000","last_undegraded":"2024-05-30T06:50:37.135752+0000","last_fullsized":"2024-05-30T06:50:37.135752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:15:02.073672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137214+0000","last_change":"2024-05-30T06:50:36.134135+0000","last_active":"2024-05-30T06:50:37.137214+0000","last_peered":"2024-05-30T06:50:37.137214+0000","last_clean":"2024-05-30T06:50:37.137214+0000","last_became_active":"2024-05-30T06:50:36.133844+0000","last_became_peered":"2024-05-30T06:50:36.133844+0000","last_unstale":"2024-05-30T06:50:37.137214+0000","last_undegraded":"2024-05-30T06:50:37.137214+0000","last_fullsized":"2024-05-30T06:50:37.137214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:31:40.226715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.193019+0000","last_change":"2024-05-30T06:50:35.128218+0000","last_active":"2024-05-30T06:50:37.193019+0000","last_peered":"2024-05-30T06:50:37.193019+0000","last_clean":"2024-05-30T06:50:37.193019+0000","last_became_active":"2024-05-30T06:50:35.127706+0000","last_became_peered":"2024-05-30T06:50:35.127706+0000","last_unstale":"2024-05-30T06:50:37.193019+0000","last_undegraded":"2024-05-30T06:50:37.193019+0000","last_fullsized":"2024-05-30T06:50:37.193019+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:51:48.855579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192841+0000","last_change":"2024-05-30T06:50:36.148013+0000","last_active":"2024-05-30T06:50:37.192841+0000","last_peered":"2024-05-30T06:50:37.192841+0000","last_clean":"2024-05-30T06:50:37.192841+0000","last_became_active":"2024-05-30T06:50:36.147503+0000","last_became_peered":"2024-05-30T06:50:36.147503+0000","last_unstale":"2024-05-30T06:50:37.192841+0000","last_undegraded":"2024-05-30T06:50:37.192841+0000","last_fullsized":"2024-05-30T06:50:37.192841+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:49:49.412116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137298+0000","last_change":"2024-05-30T06:50:35.131458+0000","last_active":"2024-05-30T06:50:37.137298+0000","last_peered":"2024-05-30T06:50:37.137298+0000","last_clean":"2024-05-30T06:50:37.137298+0000","last_became_active":"2024-05-30T06:50:35.129558+0000","last_became_peered":"2024-05-30T06:50:35.129558+0000","last_unstale":"2024-05-30T06:50:37.137298+0000","last_undegraded":"2024-05-30T06:50:37.137298+0000","last_fullsized":"2024-05-30T06:50:37.137298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:20:45.793165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133605+0000","last_change":"2024-05-30T06:50:36.132603+0000","last_active":"2024-05-30T06:50:37.133605+0000","last_peered":"2024-05-30T06:50:37.133605+0000","last_clean":"2024-05-30T06:50:37.133605+0000","last_became_active":"2024-05-30T06:50:36.132338+0000","last_became_peered":"2024-05-30T06:50:36.132338+0000","last_unstale":"2024-05-30T06:50:37.133605+0000","last_undegraded":"2024-05-30T06:50:37.133605+0000","last_fullsized":"2024-05-30T06:50:37.133605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:39:15.956026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192405+0000","last_change":"2024-05-30T06:50:35.133861+0000","last_active":"2024-05-30T06:50:37.192405+0000","last_peered":"2024-05-30T06:50:37.192405+0000","last_clean":"2024-05-30T06:50:37.192405+0000","last_became_active":"2024-05-30T06:50:35.133568+0000","last_became_peered":"2024-05-30T06:50:35.133568+0000","last_unstale":"2024-05-30T06:50:37.192405+0000","last_undegraded":"2024-05-30T06:50:37.192405+0000","last_fullsized":"2024-05-30T06:50:37.192405+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:56:18.728983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191380+0000","last_change":"2024-05-30T06:50:36.131097+0000","last_active":"2024-05-30T06:50:37.191380+0000","last_peered":"2024-05-30T06:50:37.191380+0000","last_clean":"2024-05-30T06:50:37.191380+0000","last_became_active":"2024-05-30T06:50:36.130633+0000","last_became_peered":"2024-05-30T06:50:36.130633+0000","last_unstale":"2024-05-30T06:50:37.191380+0000","last_undegraded":"2024-05-30T06:50:37.191380+0000","last_fullsized":"2024-05-30T06:50:37.191380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:58.210674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192643+0000","last_change":"2024-05-30T06:50:35.135020+0000","last_active":"2024-05-30T06:50:37.192643+0000","last_peered":"2024-05-30T06:50:37.192643+0000","last_clean":"2024-05-30T06:50:37.192643+0000","last_became_active":"2024-05-30T06:50:35.134670+0000","last_became_peered":"2024-05-30T06:50:35.134670+0000","last_unstale":"2024-05-30T06:50:37.192643+0000","last_undegraded":"2024-05-30T06:50:37.192643+0000","last_fullsized":"2024-05-30T06:50:37.192643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:00:52.604142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190438+0000","last_change":"2024-05-30T06:50:36.132872+0000","last_active":"2024-05-30T06:50:37.190438+0000","last_peered":"2024-05-30T06:50:37.190438+0000","last_clean":"2024-05-30T06:50:37.190438+0000","last_became_active":"2024-05-30T06:50:36.132575+0000","last_became_peered":"2024-05-30T06:50:36.132575+0000","last_unstale":"2024-05-30T06:50:37.190438+0000","last_undegraded":"2024-05-30T06:50:37.190438+0000","last_fullsized":"2024-05-30T06:50:37.190438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:20:55.332407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.193068+0000","last_change":"2024-05-30T06:50:35.132673+0000","last_active":"2024-05-30T06:50:37.193068+0000","last_peered":"2024-05-30T06:50:37.193068+0000","last_clean":"2024-05-30T06:50:37.193068+0000","last_became_active":"2024-05-30T06:50:35.131785+0000","last_became_peered":"2024-05-30T06:50:35.131785+0000","last_unstale":"2024-05-30T06:50:37.193068+0000","last_undegraded":"2024-05-30T06:50:37.193068+0000","last_fullsized":"2024-05-30T06:50:37.193068+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:54:18.617610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190597+0000","last_change":"2024-05-30T06:50:36.147488+0000","last_active":"2024-05-30T06:50:37.190597+0000","last_peered":"2024-05-30T06:50:37.190597+0000","last_clean":"2024-05-30T06:50:37.190597+0000","last_became_active":"2024-05-30T06:50:36.147127+0000","last_became_peered":"2024-05-30T06:50:36.147127+0000","last_unstale":"2024-05-30T06:50:37.190597+0000","last_undegraded":"2024-05-30T06:50:37.190597+0000","last_fullsized":"2024-05-30T06:50:37.190597+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:39:18.706486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.136181+0000","last_change":"2024-05-30T06:50:35.121519+0000","last_active":"2024-05-30T06:50:37.136181+0000","last_peered":"2024-05-30T06:50:37.136181+0000","last_clean":"2024-05-30T06:50:37.136181+0000","last_became_active":"2024-05-30T06:50:35.121245+0000","last_became_peered":"2024-05-30T06:50:35.121245+0000","last_unstale":"2024-05-30T06:50:37.136181+0000","last_undegraded":"2024-05-30T06:50:37.136181+0000","last_fullsized":"2024-05-30T06:50:37.136181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:42:34.991573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191167+0000","last_change":"2024-05-30T06:50:36.147478+0000","last_active":"2024-05-30T06:50:37.191167+0000","last_peered":"2024-05-30T06:50:37.191167+0000","last_clean":"2024-05-30T06:50:37.191167+0000","last_became_active":"2024-05-30T06:50:36.147202+0000","last_became_peered":"2024-05-30T06:50:36.147202+0000","last_unstale":"2024-05-30T06:50:37.191167+0000","last_undegraded":"2024-05-30T06:50:37.191167+0000","last_fullsized":"2024-05-30T06:50:37.191167+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:02:01.998106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.189714+0000","last_change":"2024-05-30T06:50:35.132241+0000","last_active":"2024-05-30T06:50:37.189714+0000","last_peered":"2024-05-30T06:50:37.189714+0000","last_clean":"2024-05-30T06:50:37.189714+0000","last_became_active":"2024-05-30T06:50:35.131928+0000","last_became_peered":"2024-05-30T06:50:35.131928+0000","last_unstale":"2024-05-30T06:50:37.189714+0000","last_undegraded":"2024-05-30T06:50:37.189714+0000","last_fullsized":"2024-05-30T06:50:37.189714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:27:26.418862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190605+0000","last_change":"2024-05-30T06:50:36.133274+0000","last_active":"2024-05-30T06:50:37.190605+0000","last_peered":"2024-05-30T06:50:37.190605+0000","last_clean":"2024-05-30T06:50:37.190605+0000","last_became_active":"2024-05-30T06:50:36.133004+0000","last_became_peered":"2024-05-30T06:50:36.133004+0000","last_unstale":"2024-05-30T06:50:37.190605+0000","last_undegraded":"2024-05-30T06:50:37.190605+0000","last_fullsized":"2024-05-30T06:50:37.190605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:07:33.282727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192797+0000","last_change":"2024-05-30T06:50:35.128349+0000","last_active":"2024-05-30T06:50:37.192797+0000","last_peered":"2024-05-30T06:50:37.192797+0000","last_clean":"2024-05-30T06:50:37.192797+0000","last_became_active":"2024-05-30T06:50:35.128091+0000","last_became_peered":"2024-05-30T06:50:35.128091+0000","last_unstale":"2024-05-30T06:50:37.192797+0000","last_undegraded":"2024-05-30T06:50:37.192797+0000","last_fullsized":"2024-05-30T06:50:37.192797+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:00:21.859206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.137210+0000","last_change":"2024-05-30T06:50:36.127379+0000","last_active":"2024-05-30T06:50:37.137210+0000","last_peered":"2024-05-30T06:50:37.137210+0000","last_clean":"2024-05-30T06:50:37.137210+0000","last_became_active":"2024-05-30T06:50:36.127078+0000","last_became_peered":"2024-05-30T06:50:36.127078+0000","last_unstale":"2024-05-30T06:50:37.137210+0000","last_undegraded":"2024-05-30T06:50:37.137210+0000","last_fullsized":"2024-05-30T06:50:37.137210+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:44:28.467327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"73'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:38.122025+0000","last_change":"2024-05-30T06:50:35.131220+0000","last_active":"2024-05-30T06:50:38.122025+0000","last_peered":"2024-05-30T06:50:38.122025+0000","last_clean":"2024-05-30T06:50:38.122025+0000","last_became_active":"2024-05-30T06:50:35.130941+0000","last_became_peered":"2024-05-30T06:50:35.130941+0000","last_unstale":"2024-05-30T06:50:38.122025+0000","last_undegraded":"2024-05-30T06:50:38.122025+0000","last_fullsized":"2024-05-30T06:50:38.122025+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:18:25.867400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192660+0000","last_change":"2024-05-30T06:50:36.149218+0000","last_active":"2024-05-30T06:50:37.192660+0000","last_peered":"2024-05-30T06:50:37.192660+0000","last_clean":"2024-05-30T06:50:37.192660+0000","last_became_active":"2024-05-30T06:50:36.148877+0000","last_became_peered":"2024-05-30T06:50:36.148877+0000","last_unstale":"2024-05-30T06:50:37.192660+0000","last_undegraded":"2024-05-30T06:50:37.192660+0000","last_fullsized":"2024-05-30T06:50:37.192660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:18:23.790436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191475+0000","last_change":"2024-05-30T06:50:35.130139+0000","last_active":"2024-05-30T06:50:37.191475+0000","last_peered":"2024-05-30T06:50:37.191475+0000","last_clean":"2024-05-30T06:50:37.191475+0000","last_became_active":"2024-05-30T06:50:35.129737+0000","last_became_peered":"2024-05-30T06:50:35.129737+0000","last_unstale":"2024-05-30T06:50:37.191475+0000","last_undegraded":"2024-05-30T06:50:37.191475+0000","last_fullsized":"2024-05-30T06:50:37.191475+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:21.214580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192999+0000","last_change":"2024-05-30T06:50:36.137637+0000","last_active":"2024-05-30T06:50:37.192999+0000","last_peered":"2024-05-30T06:50:37.192999+0000","last_clean":"2024-05-30T06:50:37.192999+0000","last_became_active":"2024-05-30T06:50:36.133825+0000","last_became_peered":"2024-05-30T06:50:36.133825+0000","last_unstale":"2024-05-30T06:50:37.192999+0000","last_undegraded":"2024-05-30T06:50:37.192999+0000","last_fullsized":"2024-05-30T06:50:37.192999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:56:49.909109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.190140+0000","last_change":"2024-05-30T06:50:35.133839+0000","last_active":"2024-05-30T06:50:37.190140+0000","last_peered":"2024-05-30T06:50:37.190140+0000","last_clean":"2024-05-30T06:50:37.190140+0000","last_became_active":"2024-05-30T06:50:35.133509+0000","last_became_peered":"2024-05-30T06:50:35.133509+0000","last_unstale":"2024-05-30T06:50:37.190140+0000","last_undegraded":"2024-05-30T06:50:37.190140+0000","last_fullsized":"2024-05-30T06:50:37.190140+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:14:41.337933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191005+0000","last_change":"2024-05-30T06:50:36.128003+0000","last_active":"2024-05-30T06:50:37.191005+0000","last_peered":"2024-05-30T06:50:37.191005+0000","last_clean":"2024-05-30T06:50:37.191005+0000","last_became_active":"2024-05-30T06:50:36.127402+0000","last_became_peered":"2024-05-30T06:50:36.127402+0000","last_unstale":"2024-05-30T06:50:37.191005+0000","last_undegraded":"2024-05-30T06:50:37.191005+0000","last_fullsized":"2024-05-30T06:50:37.191005+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:55:12.624496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191040+0000","last_change":"2024-05-30T06:50:35.120912+0000","last_active":"2024-05-30T06:50:37.191040+0000","last_peered":"2024-05-30T06:50:37.191040+0000","last_clean":"2024-05-30T06:50:37.191040+0000","last_became_active":"2024-05-30T06:50:35.120133+0000","last_became_peered":"2024-05-30T06:50:35.120133+0000","last_unstale":"2024-05-30T06:50:37.191040+0000","last_undegraded":"2024-05-30T06:50:37.191040+0000","last_fullsized":"2024-05-30T06:50:37.191040+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:06:53.698943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192803+0000","last_change":"2024-05-30T06:50:36.137692+0000","last_active":"2024-05-30T06:50:37.192803+0000","last_peered":"2024-05-30T06:50:37.192803+0000","last_clean":"2024-05-30T06:50:37.192803+0000","last_became_active":"2024-05-30T06:50:36.137348+0000","last_became_peered":"2024-05-30T06:50:36.137348+0000","last_unstale":"2024-05-30T06:50:37.192803+0000","last_undegraded":"2024-05-30T06:50:37.192803+0000","last_fullsized":"2024-05-30T06:50:37.192803+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:46:18.862176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.133238+0000","last_change":"2024-05-30T06:50:35.129598+0000","last_active":"2024-05-30T06:50:37.133238+0000","last_peered":"2024-05-30T06:50:37.133238+0000","last_clean":"2024-05-30T06:50:37.133238+0000","last_became_active":"2024-05-30T06:50:35.129318+0000","last_became_peered":"2024-05-30T06:50:35.129318+0000","last_unstale":"2024-05-30T06:50:37.133238+0000","last_undegraded":"2024-05-30T06:50:37.133238+0000","last_fullsized":"2024-05-30T06:50:37.133238+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:31:19.427293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.134066+0000","last_change":"2024-05-30T06:50:36.132474+0000","last_active":"2024-05-30T06:50:37.134066+0000","last_peered":"2024-05-30T06:50:37.134066+0000","last_clean":"2024-05-30T06:50:37.134066+0000","last_became_active":"2024-05-30T06:50:36.132096+0000","last_became_peered":"2024-05-30T06:50:36.132096+0000","last_unstale":"2024-05-30T06:50:37.134066+0000","last_undegraded":"2024-05-30T06:50:37.134066+0000","last_fullsized":"2024-05-30T06:50:37.134066+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:56:10.332933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.135971+0000","last_change":"2024-05-30T06:50:35.133302+0000","last_active":"2024-05-30T06:50:37.135971+0000","last_peered":"2024-05-30T06:50:37.135971+0000","last_clean":"2024-05-30T06:50:37.135971+0000","last_became_active":"2024-05-30T06:50:35.132843+0000","last_became_peered":"2024-05-30T06:50:35.132843+0000","last_unstale":"2024-05-30T06:50:37.135971+0000","last_undegraded":"2024-05-30T06:50:37.135971+0000","last_fullsized":"2024-05-30T06:50:37.135971+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:56:09.324161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192151+0000","last_change":"2024-05-30T06:50:36.137950+0000","last_active":"2024-05-30T06:50:37.192151+0000","last_peered":"2024-05-30T06:50:37.192151+0000","last_clean":"2024-05-30T06:50:37.192151+0000","last_became_active":"2024-05-30T06:50:36.137696+0000","last_became_peered":"2024-05-30T06:50:36.137696+0000","last_unstale":"2024-05-30T06:50:37.192151+0000","last_undegraded":"2024-05-30T06:50:37.192151+0000","last_fullsized":"2024-05-30T06:50:37.192151+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:27:30.281514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192111+0000","last_change":"2024-05-30T06:50:35.133777+0000","last_active":"2024-05-30T06:50:37.192111+0000","last_peered":"2024-05-30T06:50:37.192111+0000","last_clean":"2024-05-30T06:50:37.192111+0000","last_became_active":"2024-05-30T06:50:35.129708+0000","last_became_peered":"2024-05-30T06:50:35.129708+0000","last_unstale":"2024-05-30T06:50:37.192111+0000","last_undegraded":"2024-05-30T06:50:37.192111+0000","last_fullsized":"2024-05-30T06:50:37.192111+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:38:41.689658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191653+0000","last_change":"2024-05-30T06:50:36.147464+0000","last_active":"2024-05-30T06:50:37.191653+0000","last_peered":"2024-05-30T06:50:37.191653+0000","last_clean":"2024-05-30T06:50:37.191653+0000","last_became_active":"2024-05-30T06:50:36.146592+0000","last_became_peered":"2024-05-30T06:50:36.146592+0000","last_unstale":"2024-05-30T06:50:37.191653+0000","last_undegraded":"2024-05-30T06:50:37.191653+0000","last_fullsized":"2024-05-30T06:50:37.191653+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:35.096915+0000","last_clean_scrub_stamp":"2024-05-30T06:50:35.096915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:47:48.079037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"72'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.192646+0000","last_change":"2024-05-30T06:50:35.124280+0000","last_active":"2024-05-30T06:50:37.192646+0000","last_peered":"2024-05-30T06:50:37.192646+0000","last_clean":"2024-05-30T06:50:37.192646+0000","last_became_active":"2024-05-30T06:50:35.123615+0000","last_became_peered":"2024-05-30T06:50:35.123615+0000","last_unstale":"2024-05-30T06:50:37.192646+0000","last_undegraded":"2024-05-30T06:50:37.192646+0000","last_fullsized":"2024-05-30T06:50:37.192646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:50:34.088143+0000","last_clean_scrub_stamp":"2024-05-30T06:50:34.088143+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:35:34.494559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":271,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-05-30T06:50:37.191782+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:50:37.191782+0000","last_peered":"2024-05-30T06:50:37.191782+0000","last_clean":"2024-05-30T06:50:37.191782+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:50:37.191782+0000","last_undegraded":"2024-05-30T06:50:37.191782+0000","last_fullsized":"2024-05-30T06:50:37.191782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54844,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316996,"statfs":{"total":96636764160,"available":96580603904,"internally_reserved":0,"allocated":1490944,"data_stored":970528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574957,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54272,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317568,"statfs":{"total":96636764160,"available":96581189632,"internally_reserved":0,"allocated":897024,"data_stored":379636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54268,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317572,"statfs":{"total":96636764160,"available":96581193728,"internally_reserved":0,"allocated":892928,"data_stored":379634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54260,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317580,"statfs":{"total":96636764160,"available":96581201920,"internally_reserved":0,"allocated":892928,"data_stored":379614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58428,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313412,"statfs":{"total":96636764160,"available":96576933888,"internally_reserved":0,"allocated":897024,"data_stored":379656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574955,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50116,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321724,"statfs":{"total":96636764160,"available":96585445376,"internally_reserved":0,"allocated":901120,"data_stored":381156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54280,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317560,"statfs":{"total":96636764160,"available":96581181440,"internally_reserved":0,"allocated":909312,"data_stored":381772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574957,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54836,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317004,"statfs":{"total":96636764160,"available":96580612096,"internally_reserved":0,"allocated":1482752,"data_stored":969912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:50:45.219 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-30T06:50:45.219 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T06:50:45.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.401+0000 7f0743800640 1 Processor -- start 2024-05-30T06:50:45.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.401+0000 7f0743800640 1 -- start start 2024-05-30T06:50:45.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0743800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f073c0cd440 0x7f073c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0743800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f073c06f5a0 0x7f073c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0743800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f073c15f310 con 0x7f073c155da0 2024-05-30T06:50:45.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0743800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f073c06fa10 con 0x7f073c06f5a0 2024-05-30T06:50:45.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0743800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f073c15f5f0 con 0x7f073c0cd440 2024-05-30T06:50:45.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0741800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f073c06f5a0 0x7f073c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0741800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f073c06f5a0 0x7f073c0b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44020/0 (socket says 172.21.15.37:44020) 2024-05-30T06:50:45.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0741800640 1 -- 172.21.15.37:0/1101560366 learned_addr learned my addr 172.21.15.37:0/1101560366 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:45.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0740e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f073c155da0 0x7f073c0cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59666/0 (socket says 172.21.15.37:59666) 2024-05-30T06:50:45.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0733e00640 1 --2- 172.21.15.37:0/1101560366 >> v2:172.21.15.105:3300/0 conn(0x7f073c0cd440 0x7f073c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0741800640 1 -- 172.21.15.37:0/1101560366 >> v2:172.21.15.105:3300/0 conn(0x7f073c0cd440 msgr2=0x7f073c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:45.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0741800640 1 --2- 172.21.15.37:0/1101560366 >> v2:172.21.15.105:3300/0 conn(0x7f073c0cd440 0x7f073c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0741800640 1 -- 172.21.15.37:0/1101560366 >> v1:172.21.15.37:6789/0 conn(0x7f073c155da0 legacy=0x7f073c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.405+0000 7f0741800640 1 -- 172.21.15.37:0/1101560366 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073c15f8d0 con 0x7f073c06f5a0 2024-05-30T06:50:45.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0741800640 1 --2- 172.21.15.37:0/1101560366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073c06f5a0 0x7f073c0b3750 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f073c0b2f00 tx=0x7f073401ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709f1ba67925ed65 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:45.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f073be00640 1 -- 172.21.15.37:0/1101560366 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073400b2d0 con 0x7f073c06f5a0 2024-05-30T06:50:45.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f073be00640 1 -- 172.21.15.37:0/1101560366 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f073400b470 con 0x7f073c06f5a0 2024-05-30T06:50:45.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f073be00640 1 -- 172.21.15.37:0/1101560366 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07340a79c0 con 0x7f073c06f5a0 2024-05-30T06:50:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0743800640 1 -- 172.21.15.37:0/1101560366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073c06f5a0 msgr2=0x7f073c0b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0743800640 1 --2- 172.21.15.37:0/1101560366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073c06f5a0 0x7f073c0b3750 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f073c0b2f00 tx=0x7f073401ead0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0743800640 1 -- 172.21.15.37:0/1101560366 shutdown_connections 2024-05-30T06:50:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0743800640 1 --2- 172.21.15.37:0/1101560366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073c06f5a0 0x7f073c0b3750 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0743800640 1 --2- 172.21.15.37:0/1101560366 >> v2:172.21.15.105:3300/0 conn(0x7f073c0cd440 0x7f073c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0743800640 1 -- 172.21.15.37:0/1101560366 >> 172.21.15.37:0/1101560366 conn(0x7f073c06bf60 msgr2=0x7f073c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0743800640 1 -- 172.21.15.37:0/1101560366 shutdown_connections 2024-05-30T06:50:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0743800640 1 -- 172.21.15.37:0/1101560366 wait complete. 2024-05-30T06:50:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0743800640 1 Processor -- start 2024-05-30T06:50:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0743800640 1 -- start start 2024-05-30T06:50:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0743800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f073c06f5a0 0x7f073c14dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0743800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f073c155da0 0x7f073c15d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.409+0000 7f0743800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073c153e80 0x7f073c158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0743800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f073c06df50 con 0x7f073c153e80 2024-05-30T06:50:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0743800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f073c0b46b0 con 0x7f073c06f5a0 2024-05-30T06:50:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0743800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f073c06e0d0 con 0x7f073c155da0 2024-05-30T06:50:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0741800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073c153e80 0x7f073c158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0741800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073c153e80 0x7f073c158480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44034/0 (socket says 172.21.15.37:44034) 2024-05-30T06:50:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0741800640 1 -- 172.21.15.37:0/3726049040 learned_addr learned my addr 172.21.15.37:0/3726049040 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0741800640 1 -- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f073c155da0 msgr2=0x7f073c15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0741800640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f073c155da0 0x7f073c15d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0741800640 1 -- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f073c06f5a0 msgr2=0x7f073c14dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0740e00640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f073c06f5a0 0x7f073c14dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0741800640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f073c06f5a0 0x7f073c14dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0741800640 1 -- 172.21.15.37:0/3726049040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073c15dde0 con 0x7f073c153e80 2024-05-30T06:50:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0740e00640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f073c06f5a0 0x7f073c14dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0741800640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073c153e80 0x7f073c158480 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f07340b1040 tx=0x7f073401b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0739600640 1 -- 172.21.15.37:0/3726049040 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07340be020 con 0x7f073c153e80 2024-05-30T06:50:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0739600640 1 -- 172.21.15.37:0/3726049040 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0734009800 con 0x7f073c153e80 2024-05-30T06:50:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0739600640 1 -- 172.21.15.37:0/3726049040 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073400b720 con 0x7f073c153e80 2024-05-30T06:50:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0743800640 1 -- 172.21.15.37:0/3726049040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f073c15e3d0 con 0x7f073c153e80 2024-05-30T06:50:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0743800640 1 -- 172.21.15.37:0/3726049040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f073c15b900 con 0x7f073c153e80 2024-05-30T06:50:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0743800640 1 -- 172.21.15.37:0/3726049040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f073c068bc0 con 0x7f073c153e80 2024-05-30T06:50:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.413+0000 7f0739600640 1 -- 172.21.15.37:0/3726049040 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f07340c1020 con 0x7f073c153e80 2024-05-30T06:50:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.417+0000 7f0739600640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0718069100 0x7f071806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.417+0000 7f0739600640 1 -- 172.21.15.37:0/3726049040 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f07341227a0 con 0x7f073c153e80 2024-05-30T06:50:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.417+0000 7f0740e00640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0718069100 0x7f071806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.417+0000 7f0740e00640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0718069100 0x7f071806b5c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f072c007fd0 tx=0x7f072c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.421+0000 7f0739600640 1 -- 172.21.15.37:0/3726049040 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f07340c8030 con 0x7f073c153e80 2024-05-30T06:50:45.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.645+0000 7f0743800640 1 -- 172.21.15.37:0/3726049040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f073c0b6790 con 0x7f073c153e80 2024-05-30T06:50:45.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.649+0000 7f0739600640 1 -- 172.21.15.37:0/3726049040 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f07340187e0 con 0x7f073c153e80 2024-05-30T06:50:45.652 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-30T06:50:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A== 2024-05-30T06:50:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-30T06:50:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-30T06:50:45.652 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T06:50:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-30T06:50:45.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.653+0000 7f0743800640 1 -- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0718069100 msgr2=0x7f071806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.653+0000 7f0743800640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0718069100 0x7f071806b5c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f072c007fd0 tx=0x7f072c009040 comp rx=0 tx=0).stop 2024-05-30T06:50:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.653+0000 7f0743800640 1 -- 172.21.15.37:0/3726049040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073c153e80 msgr2=0x7f073c158480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.653+0000 7f0743800640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073c153e80 0x7f073c158480 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f07340b1040 tx=0x7f073401b870 comp rx=0 tx=0).stop 2024-05-30T06:50:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.653+0000 7f0743800640 1 -- 172.21.15.37:0/3726049040 shutdown_connections 2024-05-30T06:50:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.653+0000 7f0743800640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073c153e80 0x7f073c158480 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.653+0000 7f0743800640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f073c155da0 0x7f073c15d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.653+0000 7f0743800640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0718069100 0x7f071806b5c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.653+0000 7f0743800640 1 --2- 172.21.15.37:0/3726049040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f073c06f5a0 0x7f073c14dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.653+0000 7f0743800640 1 -- 172.21.15.37:0/3726049040 >> 172.21.15.37:0/3726049040 conn(0x7f073c06bf60 msgr2=0x7f073c15a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.653+0000 7f0743800640 1 -- 172.21.15.37:0/3726049040 shutdown_connections 2024-05-30T06:50:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.653+0000 7f0743800640 1 -- 172.21.15.37:0/3726049040 wait complete. 2024-05-30T06:50:45.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:50:45.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.813+0000 7f50a6c00640 1 Processor -- start 2024-05-30T06:50:45.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.813+0000 7f50a6c00640 1 -- start start 2024-05-30T06:50:45.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.813+0000 7f50a6c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50a0155e60 0x7f50a00b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.813+0000 7f50a6c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50a006f9a0 0x7f50a00cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.813+0000 7f50a6c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f50a00b2ec0 0x7f50a00cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.813+0000 7f50a6c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f50a00ccff0 con 0x7f50a006f9a0 2024-05-30T06:50:45.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.813+0000 7f50a6c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f50a00d00e0 con 0x7f50a00b2ec0 2024-05-30T06:50:45.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.813+0000 7f50a6c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f50a015c8f0 con 0x7f50a0155e60 2024-05-30T06:50:45.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f5097400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50a006f9a0 0x7f50a00cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f5097400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50a006f9a0 0x7f50a00cf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44040/0 (socket says 172.21.15.37:44040) 2024-05-30T06:50:45.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f5097400640 1 -- 172.21.15.37:0/3759471010 learned_addr learned my addr 172.21.15.37:0/3759471010 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:45.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f50a4c00640 1 --2- 172.21.15.37:0/3759471010 >> v2:172.21.15.105:3300/0 conn(0x7f50a00b2ec0 0x7f50a00cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f509fe00640 1 --2- 172.21.15.37:0/3759471010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50a0155e60 0x7f50a00b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f5097400640 1 -- 172.21.15.37:0/3759471010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50a0155e60 msgr2=0x7f50a00b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:45.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f5097400640 1 --2- 172.21.15.37:0/3759471010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50a0155e60 0x7f50a00b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f5097400640 1 -- 172.21.15.37:0/3759471010 >> v2:172.21.15.105:3300/0 conn(0x7f50a00b2ec0 msgr2=0x7f50a00cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:45.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f5097400640 1 --2- 172.21.15.37:0/3759471010 >> v2:172.21.15.105:3300/0 conn(0x7f50a00b2ec0 0x7f50a00cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f5097400640 1 -- 172.21.15.37:0/3759471010 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a00ccc80 con 0x7f50a006f9a0 2024-05-30T06:50:45.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f509fe00640 1 --2- 172.21.15.37:0/3759471010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50a0155e60 0x7f50a00b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:45.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f5097400640 1 --2- 172.21.15.37:0/3759471010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a006f9a0 0x7f50a00cf660 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f50a0070df0 tx=0x7f508801ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd09d034aa68bb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:45.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f509f400640 1 -- 172.21.15.37:0/3759471010 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50880a79a0 con 0x7f50a006f9a0 2024-05-30T06:50:45.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f509f400640 1 -- 172.21.15.37:0/3759471010 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50880a7b40 con 0x7f50a006f9a0 2024-05-30T06:50:45.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.817+0000 7f509f400640 1 -- 172.21.15.37:0/3759471010 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50880af3f0 con 0x7f50a006f9a0 2024-05-30T06:50:45.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 -- 172.21.15.37:0/3759471010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a006f9a0 msgr2=0x7f50a00cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 --2- 172.21.15.37:0/3759471010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a006f9a0 0x7f50a00cf660 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f50a0070df0 tx=0x7f508801ec00 comp rx=0 tx=0).stop 2024-05-30T06:50:45.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 -- 172.21.15.37:0/3759471010 shutdown_connections 2024-05-30T06:50:45.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 --2- 172.21.15.37:0/3759471010 >> v2:172.21.15.105:3300/0 conn(0x7f50a00b2ec0 0x7f50a00cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 --2- 172.21.15.37:0/3759471010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a006f9a0 0x7f50a00cf660 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 --2- 172.21.15.37:0/3759471010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50a0155e60 0x7f50a00b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 -- 172.21.15.37:0/3759471010 >> 172.21.15.37:0/3759471010 conn(0x7f50a00b23a0 msgr2=0x7f50a00b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:45.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 -- 172.21.15.37:0/3759471010 shutdown_connections 2024-05-30T06:50:45.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 -- 172.21.15.37:0/3759471010 wait complete. 2024-05-30T06:50:45.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 Processor -- start 2024-05-30T06:50:45.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 -- start start 2024-05-30T06:50:45.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a006f9a0 0x7f50a0145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50a00b2ec0 0x7f50a0165920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50a0155e60 0x7f50a0165e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50a00ce000 con 0x7f50a006f9a0 2024-05-30T06:50:45.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f50a00cde80 con 0x7f50a0155e60 2024-05-30T06:50:45.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a6c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f50a00ce180 con 0x7f50a00b2ec0 2024-05-30T06:50:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f509fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a006f9a0 0x7f50a0145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f509fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a006f9a0 0x7f50a0145300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44044/0 (socket says 172.21.15.37:44044) 2024-05-30T06:50:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f509fe00640 1 -- 172.21.15.37:0/3804300992 learned_addr learned my addr 172.21.15.37:0/3804300992 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f5097400640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50a00b2ec0 0x7f50a0165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f50a4c00640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50a0155e60 0x7f50a0165e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f509fe00640 1 -- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50a00b2ec0 msgr2=0x7f50a0165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f509fe00640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50a00b2ec0 0x7f50a0165920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f509fe00640 1 -- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50a0155e60 msgr2=0x7f50a0165e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f509fe00640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50a0155e60 0x7f50a0165e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.821+0000 7f509fe00640 1 -- 172.21.15.37:0/3804300992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a0145840 con 0x7f50a006f9a0 2024-05-30T06:50:45.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.825+0000 7f509fe00640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a006f9a0 0x7f50a0145300 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f509000d830 tx=0x7f509000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:45.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.825+0000 7f509cc00640 1 -- 172.21.15.37:0/3804300992 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090018020 con 0x7f50a006f9a0 2024-05-30T06:50:45.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.825+0000 7f509cc00640 1 -- 172.21.15.37:0/3804300992 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50900096c0 con 0x7f50a006f9a0 2024-05-30T06:50:45.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.825+0000 7f50a6c00640 1 -- 172.21.15.37:0/3804300992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a0157940 con 0x7f50a006f9a0 2024-05-30T06:50:45.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.825+0000 7f509cc00640 1 -- 172.21.15.37:0/3804300992 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090009ab0 con 0x7f50a006f9a0 2024-05-30T06:50:45.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.825+0000 7f50a6c00640 1 -- 172.21.15.37:0/3804300992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a0157f00 con 0x7f50a006f9a0 2024-05-30T06:50:45.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.825+0000 7f50a6c00640 1 -- 172.21.15.37:0/3804300992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a0068b20 con 0x7f50a006f9a0 2024-05-30T06:50:45.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.825+0000 7f509cc00640 1 -- 172.21.15.37:0/3804300992 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f509001b020 con 0x7f50a006f9a0 2024-05-30T06:50:45.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.825+0000 7f509cc00640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f507c069100 0x7f507c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:45.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.825+0000 7f509cc00640 1 -- 172.21.15.37:0/3804300992 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f5090085cb0 con 0x7f50a006f9a0 2024-05-30T06:50:45.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.825+0000 7f5097400640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f507c069100 0x7f507c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:45.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.829+0000 7f5097400640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f507c069100 0x7f507c06b5c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f50880b0000 tx=0x7f508800d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:45.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:45.829+0000 7f509cc00640 1 -- 172.21.15.37:0/3804300992 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5090022020 con 0x7f50a006f9a0 2024-05-30T06:50:46.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.029+0000 7f50a6c00640 1 -- 172.21.15.37:0/3804300992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50a00b5260 con 0x7f50a006f9a0 2024-05-30T06:50:46.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.029+0000 7f509cc00640 1 -- 172.21.15.37:0/3804300992 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5186 (secure 0 0 0) 0x7f50a0145840 con 0x7f50a006f9a0 2024-05-30T06:50:46.031 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:50:46.031 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6086,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/855324379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":855324379},{"type":"v1","addr":"172.21.15.105:6836","nonce":855324379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6089,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3353563250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3353563250},{"type":"v1","addr":"172.21.15.105:6837","nonce":3353563250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6933,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1946331427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1946331427},{"type":"v1","addr":"172.21.15.37:6834","nonce":1946331427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:50:35.512352+0000","modified":"2024-05-30T06:50:38.536531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3396138806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3396138806},{"type":"v1","addr":"172.21.15.37:6835","nonce":3396138806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6939,"qdb_cluster":[6939]},"id":5}]} 2024-05-30T06:50:46.032 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 46 2024-05-30T06:50:46.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.029+0000 7f50a6c00640 1 -- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f507c069100 msgr2=0x7f507c06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.029+0000 7f50a6c00640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f507c069100 0x7f507c06b5c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f50880b0000 tx=0x7f508800d040 comp rx=0 tx=0).stop 2024-05-30T06:50:46.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.029+0000 7f50a6c00640 1 -- 172.21.15.37:0/3804300992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a006f9a0 msgr2=0x7f50a0145300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.029+0000 7f50a6c00640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a006f9a0 0x7f50a0145300 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f509000d830 tx=0x7f509000dcf0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.033+0000 7f50a6c00640 1 -- 172.21.15.37:0/3804300992 shutdown_connections 2024-05-30T06:50:46.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.033+0000 7f50a6c00640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f507c069100 0x7f507c06b5c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.033+0000 7f50a6c00640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50a0155e60 0x7f50a0165e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.033+0000 7f50a6c00640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50a00b2ec0 0x7f50a0165920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.033+0000 7f50a6c00640 1 --2- 172.21.15.37:0/3804300992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50a006f9a0 0x7f50a0145300 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.033+0000 7f50a6c00640 1 -- 172.21.15.37:0/3804300992 >> 172.21.15.37:0/3804300992 conn(0x7f50a00b23a0 msgr2=0x7f50a01550d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:46.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.033+0000 7f50a6c00640 1 -- 172.21.15.37:0/3804300992 shutdown_connections 2024-05-30T06:50:46.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.033+0000 7f50a6c00640 1 -- 172.21.15.37:0/3804300992 wait complete. 2024-05-30T06:50:46.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T06:50:35.512352+0000', 'modified': '2024-05-30T06:50:38.536531+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6939}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6939': {'gid': 6939, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/3396138806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 3396138806}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 3396138806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6939, 'qdb_cluster': [6939]} 2024-05-30T06:50:46.456 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T06:50:46.456 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-30T06:50:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.601+0000 7fc747c00640 1 Processor -- start 2024-05-30T06:50:46.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.601+0000 7fc747c00640 1 -- start start 2024-05-30T06:50:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.605+0000 7fc747c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7400b59d0 0x7fc7400b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.605+0000 7fc747c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc74015d7e0 0x7fc740160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.605+0000 7fc747c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7400b62f0 con 0x7fc74015d350 2024-05-30T06:50:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.605+0000 7fc747c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc740142030 con 0x7fc7400b59d0 2024-05-30T06:50:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.605+0000 7fc747c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc740142310 con 0x7fc74015d7e0 2024-05-30T06:50:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.605+0000 7fc745200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7400b59d0 0x7fc7400b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.605+0000 7fc745200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7400b59d0 0x7fc7400b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44046/0 (socket says 172.21.15.37:44046) 2024-05-30T06:50:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.605+0000 7fc745200640 1 -- 172.21.15.37:0/1797815115 learned_addr learned my addr 172.21.15.37:0/1797815115 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.605+0000 7fc745c00640 1 --2- 172.21.15.37:0/1797815115 >> v2:172.21.15.105:3300/0 conn(0x7fc74015d7e0 0x7fc740160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.605+0000 7fc745200640 1 -- 172.21.15.37:0/1797815115 >> v2:172.21.15.105:3300/0 conn(0x7fc74015d7e0 msgr2=0x7fc740160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.605+0000 7fc745200640 1 --2- 172.21.15.37:0/1797815115 >> v2:172.21.15.105:3300/0 conn(0x7fc74015d7e0 0x7fc740160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.605+0000 7fc745200640 1 -- 172.21.15.37:0/1797815115 >> v1:172.21.15.105:6789/0 conn(0x7fc74015d350 legacy=0x7fc740160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.605+0000 7fc745200640 1 -- 172.21.15.37:0/1797815115 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7401425f0 con 0x7fc7400b59d0 2024-05-30T06:50:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc745200640 1 --2- 172.21.15.37:0/1797815115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7400b59d0 0x7fc7400b5db0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fc730009870 tx=0x7fc73001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e01270fa3538f97 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:46.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc73fe00640 1 -- 172.21.15.37:0/1797815115 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7300b5070 con 0x7fc7400b59d0 2024-05-30T06:50:46.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc73fe00640 1 -- 172.21.15.37:0/1797815115 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7300a89d0 con 0x7fc7400b59d0 2024-05-30T06:50:46.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc73fe00640 1 -- 172.21.15.37:0/1797815115 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7300a8da0 con 0x7fc7400b59d0 2024-05-30T06:50:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 -- 172.21.15.37:0/1797815115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7400b59d0 msgr2=0x7fc7400b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 --2- 172.21.15.37:0/1797815115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7400b59d0 0x7fc7400b5db0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fc730009870 tx=0x7fc73001ecd0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 -- 172.21.15.37:0/1797815115 shutdown_connections 2024-05-30T06:50:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 --2- 172.21.15.37:0/1797815115 >> v2:172.21.15.105:3300/0 conn(0x7fc74015d7e0 0x7fc740160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 --2- 172.21.15.37:0/1797815115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7400b59d0 0x7fc7400b5db0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 -- 172.21.15.37:0/1797815115 >> 172.21.15.37:0/1797815115 conn(0x7fc74006bf60 msgr2=0x7fc7400b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 -- 172.21.15.37:0/1797815115 shutdown_connections 2024-05-30T06:50:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 -- 172.21.15.37:0/1797815115 wait complete. 2024-05-30T06:50:46.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 Processor -- start 2024-05-30T06:50:46.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 -- start start 2024-05-30T06:50:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7400b59d0 0x7fc74013e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74015d350 0x7fc740152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc74015d7e0 0x7fc740154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc74013fe60 con 0x7fc74015d7e0 2024-05-30T06:50:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc74013fce0 con 0x7fc7400b59d0 2024-05-30T06:50:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc747c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc7400aff20 con 0x7fc74015d350 2024-05-30T06:50:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc745c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc74015d7e0 0x7fc740154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc745c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc74015d7e0 0x7fc740154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44052/0 (socket says 172.21.15.37:44052) 2024-05-30T06:50:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.609+0000 7fc745c00640 1 -- 172.21.15.37:0/4042843880 learned_addr learned my addr 172.21.15.37:0/4042843880 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc745200640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7400b59d0 0x7fc74013e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc745c00640 1 -- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74015d350 msgr2=0x7fc740152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc737e00640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74015d350 0x7fc740152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc745c00640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74015d350 0x7fc740152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc745c00640 1 -- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7400b59d0 msgr2=0x7fc74013e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc745c00640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7400b59d0 0x7fc74013e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc745c00640 1 -- 172.21.15.37:0/4042843880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7401536b0 con 0x7fc74015d7e0 2024-05-30T06:50:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc745200640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7400b59d0 0x7fc74013e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc737e00640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74015d350 0x7fc740152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc745c00640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc74015d7e0 0x7fc740154630 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fc738007e90 tx=0x7fc73800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc73d600640 1 -- 172.21.15.37:0/4042843880 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738014420 con 0x7fc74015d7e0 2024-05-30T06:50:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc73d600640 1 -- 172.21.15.37:0/4042843880 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc738019070 con 0x7fc74015d7e0 2024-05-30T06:50:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc747c00640 1 -- 172.21.15.37:0/4042843880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc740153990 con 0x7fc74015d7e0 2024-05-30T06:50:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc73d600640 1 -- 172.21.15.37:0/4042843880 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738014800 con 0x7fc74015d7e0 2024-05-30T06:50:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc747c00640 1 -- 172.21.15.37:0/4042843880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc74013beb0 con 0x7fc74015d7e0 2024-05-30T06:50:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.613+0000 7fc73d600640 1 -- 172.21.15.37:0/4042843880 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fc7380149a0 con 0x7fc74015d7e0 2024-05-30T06:50:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc73d600640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc71c069100 0x7fc71c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc73d600640 1 -- 172.21.15.37:0/4042843880 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7fc738085f40 con 0x7fc74015d7e0 2024-05-30T06:50:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 Processor -- start 2024-05-30T06:50:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 -- start start 2024-05-30T06:50:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc745200640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc71c069100 0x7fc71c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a530120 0x55e56a530500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a530a40 0x55e56a4e3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a4e3650 0x55e56a4e3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e56a334420 con 0x55e56a530a40 2024-05-30T06:50:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e56a2cebf0 con 0x55e56a530120 2024-05-30T06:50:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55e56a3303e0 con 0x55e56a4e3650 2024-05-30T06:50:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc745200640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc71c069100 0x7fc71c06b5c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc7300b2000 tx=0x7fc7300aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc737e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a530a40 0x55e56a4e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc737e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a530a40 0x55e56a4e3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44056/0 (socket says 172.21.15.37:44056) 2024-05-30T06:50:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc737e00640 1 -- 172.21.15.37:0/3752975032 learned_addr learned my addr 172.21.15.37:0/3752975032 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc745200640 1 --2- 172.21.15.37:0/3752975032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a530120 0x55e56a530500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc745c00640 1 --2- 172.21.15.37:0/3752975032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a4e3650 0x55e56a4e3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc737e00640 1 -- 172.21.15.37:0/3752975032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a4e3650 msgr2=0x55e56a4e3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc737e00640 1 --2- 172.21.15.37:0/3752975032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a4e3650 0x55e56a4e3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc737e00640 1 -- 172.21.15.37:0/3752975032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a530120 msgr2=0x55e56a530500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc737e00640 1 --2- 172.21.15.37:0/3752975032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a530120 0x55e56a530500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc737e00640 1 -- 172.21.15.37:0/3752975032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56a3dc450 con 0x55e56a530a40 2024-05-30T06:50:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc737e00640 1 --2- 172.21.15.37:0/3752975032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a530a40 0x55e56a4e3110 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fc728003f10 tx=0x7fc7280043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95830ac146648557 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc735600640 1 -- 172.21.15.37:0/3752975032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72800db40 con 0x55e56a530a40 2024-05-30T06:50:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc735600640 1 -- 172.21.15.37:0/3752975032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc72800dce0 con 0x55e56a530a40 2024-05-30T06:50:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc735600640 1 -- 172.21.15.37:0/3752975032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc728007270 con 0x55e56a530a40 2024-05-30T06:50:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 -- 172.21.15.37:0/3752975032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a530a40 msgr2=0x55e56a4e3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 --2- 172.21.15.37:0/3752975032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a530a40 0x55e56a4e3110 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fc728003f10 tx=0x7fc7280043d0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 -- 172.21.15.37:0/3752975032 shutdown_connections 2024-05-30T06:50:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 --2- 172.21.15.37:0/3752975032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a4e3650 0x55e56a4e3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 --2- 172.21.15.37:0/3752975032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a530a40 0x55e56a4e3110 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 --2- 172.21.15.37:0/3752975032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a530120 0x55e56a530500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 -- 172.21.15.37:0/3752975032 >> 172.21.15.37:0/3752975032 conn(0x55e56a510ec0 msgr2=0x55e56a5132b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 -- 172.21.15.37:0/3752975032 shutdown_connections 2024-05-30T06:50:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.617+0000 7fc74b136000 1 -- 172.21.15.37:0/3752975032 wait complete. 2024-05-30T06:50:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 1 -- start start 2024-05-30T06:50:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 1 Processor -- start 2024-05-30T06:50:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 0x55e56a4e8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a4e9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a530a40 0x55e56a4e9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e56a2d4ec0 con 0x55e56a4e3650 2024-05-30T06:50:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e56a3b5120 con 0x55e56a530a40 2024-05-30T06:50:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55e56a33f350 con 0x55e56a530120 2024-05-30T06:50:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 10 client.0 _ll_register_callbacks cb 0x55e56a3114d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:50:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc745200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 0x55e56a4e8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc745200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 0x55e56a4e8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44066/0 (socket says 172.21.15.37:44066) 2024-05-30T06:50:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc745200640 1 -- 172.21.15.37:0/3673578319 learned_addr learned my addr 172.21.15.37:0/3673578319 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc737e00640 1 --2- 172.21.15.37:0/3673578319 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a4e9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc745c00640 1 --2- 172.21.15.37:0/3673578319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a530a40 0x55e56a4e9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc745200640 1 -- 172.21.15.37:0/3673578319 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 msgr2=0x55e56a4e9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc745200640 1 --2- 172.21.15.37:0/3673578319 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a4e9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc745200640 1 -- 172.21.15.37:0/3673578319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a530a40 msgr2=0x55e56a4e9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc745200640 1 --2- 172.21.15.37:0/3673578319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a530a40 0x55e56a4e9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc745200640 1 -- 172.21.15.37:0/3673578319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e56a379f80 con 0x55e56a4e3650 2024-05-30T06:50:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc745200640 1 --2- 172.21.15.37:0/3673578319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 0x55e56a4e8b00 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc73001c900 tx=0x7fc7300046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2cccc82bbdd8f96 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc72e000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:50:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc72e000640 1 -- 172.21.15.37:0/3673578319 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7300cd060 con 0x55e56a4e3650 2024-05-30T06:50:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc72e000640 1 -- 172.21.15.37:0/3673578319 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7fc7300b1920 con 0x55e56a4e3650 2024-05-30T06:50:46.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 1 -- 172.21.15.37:0/3673578319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc72800dce0 con 0x55e56a4e3650 2024-05-30T06:50:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc72e000640 1 -- 172.21.15.37:0/3673578319 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fc7300d3050 con 0x55e56a4e3650 2024-05-30T06:50:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 10 client.7098 fetch_fsmap learned FSMap version 46 2024-05-30T06:50:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 1 -- 172.21.15.37:0/3673578319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55e56a30df00 con 0x55e56a4e3650 2024-05-30T06:50:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc72e000640 1 -- 172.21.15.37:0/3673578319 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc72800dce0 con 0x55e56a4e3650 2024-05-30T06:50:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc72e000640 1 -- 172.21.15.37:0/3673578319 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 46) ==== 3494+0+0 (secure 0 0 0) 0x7fc7300b1b20 con 0x55e56a4e3650 2024-05-30T06:50:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 10 client.7098 fetch_fsmap finished waiting for FSMap version 46 2024-05-30T06:50:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 10 client.7098 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-30T06:50:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 20 client.7098 populate_metadata read hostname 'smithi037' 2024-05-30T06:50:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 1 --2- 172.21.15.37:0/3673578319 >> [v2:172.21.15.37:6832/3396138806,v1:172.21.15.37:6835/3396138806] conn(0x55e56a53f3c0 0x55e56a5417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 4 client.7098 mds_command: new command op to 6939 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T06:50:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc74b136000 1 -- 172.21.15.37:0/3673578319 --> [v2:172.21.15.37:6832/3396138806,v1:172.21.15.37:6835/3396138806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e56a2cdbc0 con 0x55e56a53f3c0 2024-05-30T06:50:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.621+0000 7fc737e00640 1 --2- 172.21.15.37:0/3673578319 >> [v2:172.21.15.37:6832/3396138806,v1:172.21.15.37:6835/3396138806] conn(0x55e56a53f3c0 0x55e56a5417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc737e00640 1 --2- 172.21.15.37:0/3673578319 >> [v2:172.21.15.37:6832/3396138806,v1:172.21.15.37:6835/3396138806] conn(0x55e56a53f3c0 0x55e56a5417b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12e6d7f4173c9d92 server_cookie=4f6e6ec8789df788 in_seq=0 out_seq=0 2024-05-30T06:50:46.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc72e000640 10 client.7098 ms_handle_connect on v2:172.21.15.37:6832/3396138806 2024-05-30T06:50:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc72e000640 1 -- 172.21.15.37:0/3673578319 <== mds.0 v2:172.21.15.37:6832/3396138806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e56a2cdbc0 con 0x55e56a53f3c0 2024-05-30T06:50:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc72e000640 10 client.7098 handle_command_reply: tid=0 2024-05-30T06:50:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc74b136000 1 client.7098 shutdown 2024-05-30T06:50:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc74b136000 1 -- 172.21.15.37:0/3673578319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 msgr2=0x55e56a4e8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc74b136000 1 --2- 172.21.15.37:0/3673578319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 0x55e56a4e8b00 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc73001c900 tx=0x7fc7300046d0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc74b136000 1 -- 172.21.15.37:0/3673578319 shutdown_connections 2024-05-30T06:50:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc74b136000 1 --2- 172.21.15.37:0/3673578319 >> [v2:172.21.15.37:6832/3396138806,v1:172.21.15.37:6835/3396138806] conn(0x55e56a53f3c0 0x55e56a5417b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc74b136000 1 --2- 172.21.15.37:0/3673578319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a530a40 0x55e56a4e9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc74b136000 1 --2- 172.21.15.37:0/3673578319 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a4e9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc72e000640 0 client.7098 ms_handle_reset on v2:172.21.15.37:6832/3396138806 2024-05-30T06:50:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc74b136000 1 --2- 172.21.15.37:0/3673578319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 0x55e56a4e8b00 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc74b136000 1 -- 172.21.15.37:0/3673578319 >> 172.21.15.37:0/3673578319 conn(0x55e56a510ec0 msgr2=0x55e56a5132b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:46.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc74b136000 1 -- 172.21.15.37:0/3673578319 shutdown_connections 2024-05-30T06:50:46.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc74b136000 1 -- 172.21.15.37:0/3673578319 wait complete. 2024-05-30T06:50:46.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.625+0000 7fc74b136000 20 client.7098 trim_cache size 0 max 16384 2024-05-30T06:50:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.641+0000 7fc74b136000 1 Processor -- start 2024-05-30T06:50:46.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.641+0000 7fc74b136000 1 -- start start 2024-05-30T06:50:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a510ec0 0x55e56a4e2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 0x55e56a4e2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a5417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7401fde90 con 0x55e56a4e3650 2024-05-30T06:50:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc7401fd1f0 con 0x55e56a510ec0 2024-05-30T06:50:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc7401fd840 con 0x55e56a530120 2024-05-30T06:50:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc737e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 0x55e56a4e2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc737e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 0x55e56a4e2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44074/0 (socket says 172.21.15.37:44074) 2024-05-30T06:50:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc737e00640 1 -- 172.21.15.37:0/2153075108 learned_addr learned my addr 172.21.15.37:0/2153075108 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc745200640 1 --2- 172.21.15.37:0/2153075108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a510ec0 0x55e56a4e2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc745c00640 1 --2- 172.21.15.37:0/2153075108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a5417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc737e00640 1 -- 172.21.15.37:0/2153075108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 msgr2=0x55e56a5417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc737e00640 1 --2- 172.21.15.37:0/2153075108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a5417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc737e00640 1 -- 172.21.15.37:0/2153075108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a510ec0 msgr2=0x55e56a4e2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc737e00640 1 --2- 172.21.15.37:0/2153075108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a510ec0 0x55e56a4e2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc737e00640 1 -- 172.21.15.37:0/2153075108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e56a530870 con 0x55e56a4e3650 2024-05-30T06:50:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc745c00640 1 --2- 172.21.15.37:0/2153075108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a5417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc745200640 1 --2- 172.21.15.37:0/2153075108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a510ec0 0x55e56a4e2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc737e00640 1 --2- 172.21.15.37:0/2153075108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 0x55e56a4e2cb0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fc728004410 tx=0x7fc728012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1d6e5b3bfe3995 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc734c00640 1 -- 172.21.15.37:0/2153075108 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72800dca0 con 0x55e56a4e3650 2024-05-30T06:50:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc734c00640 1 -- 172.21.15.37:0/2153075108 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc728007a70 con 0x55e56a4e3650 2024-05-30T06:50:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc734c00640 1 -- 172.21.15.37:0/2153075108 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc728006a00 con 0x55e56a4e3650 2024-05-30T06:50:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 -- 172.21.15.37:0/2153075108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 msgr2=0x55e56a4e2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 --2- 172.21.15.37:0/2153075108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 0x55e56a4e2cb0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fc728004410 tx=0x7fc728012000 comp rx=0 tx=0).stop 2024-05-30T06:50:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 -- 172.21.15.37:0/2153075108 shutdown_connections 2024-05-30T06:50:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 --2- 172.21.15.37:0/2153075108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a5417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 --2- 172.21.15.37:0/2153075108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a4e3650 0x55e56a4e2cb0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 --2- 172.21.15.37:0/2153075108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a510ec0 0x55e56a4e2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 -- 172.21.15.37:0/2153075108 >> 172.21.15.37:0/2153075108 conn(0x55e56a4eb500 msgr2=0x55e56a544a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 -- 172.21.15.37:0/2153075108 shutdown_connections 2024-05-30T06:50:46.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 -- 172.21.15.37:0/2153075108 wait complete. 2024-05-30T06:50:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 -- start start 2024-05-30T06:50:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.645+0000 7fc74b136000 1 Processor -- start 2024-05-30T06:50:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a4e3650 0x55e56a544970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a510ec0 0x55e56a55f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a55fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e56a333730 con 0x55e56a510ec0 2024-05-30T06:50:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55e56a3009e0 con 0x55e56a4e3650 2024-05-30T06:50:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55e56a338a50 con 0x55e56a530120 2024-05-30T06:50:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 10 client.0 _ll_register_callbacks cb 0x7fc7300096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:50:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc737e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a510ec0 0x55e56a55f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc737e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a510ec0 0x55e56a55f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44076/0 (socket says 172.21.15.37:44076) 2024-05-30T06:50:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc737e00640 1 -- 172.21.15.37:0/765290441 learned_addr learned my addr 172.21.15.37:0/765290441 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc745200640 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a4e3650 0x55e56a544970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc745c00640 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a55fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc737e00640 1 -- 172.21.15.37:0/765290441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 msgr2=0x55e56a55fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc737e00640 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a55fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc737e00640 1 -- 172.21.15.37:0/765290441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a4e3650 msgr2=0x55e56a544970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc737e00640 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a4e3650 0x55e56a544970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc737e00640 1 -- 172.21.15.37:0/765290441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e56a2bae80 con 0x55e56a510ec0 2024-05-30T06:50:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc745c00640 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a55fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc745200640 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a4e3650 0x55e56a544970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc737e00640 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a510ec0 0x55e56a55f750 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fc728007000 tx=0x7fc728010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5856195497daf122 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc72e000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:50:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc72e000640 1 -- 172.21.15.37:0/765290441 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7280069e0 con 0x55e56a510ec0 2024-05-30T06:50:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc72e000640 1 -- 172.21.15.37:0/765290441 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7fc728006b80 con 0x55e56a510ec0 2024-05-30T06:50:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 -- 172.21.15.37:0/765290441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc728007a70 con 0x55e56a510ec0 2024-05-30T06:50:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc72e000640 1 -- 172.21.15.37:0/765290441 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fc72803c050 con 0x55e56a510ec0 2024-05-30T06:50:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 10 client.7104 fetch_fsmap learned FSMap version 46 2024-05-30T06:50:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 -- 172.21.15.37:0/765290441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) -- 0x55e56a2fcb30 con 0x55e56a510ec0 2024-05-30T06:50:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc72e000640 1 -- 172.21.15.37:0/765290441 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc728007a70 con 0x55e56a510ec0 2024-05-30T06:50:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc72e000640 1 -- 172.21.15.37:0/765290441 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 46) ==== 3494+0+0 (secure 0 0 0) 0x7fc72803f020 con 0x55e56a510ec0 2024-05-30T06:50:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 10 client.7104 fetch_fsmap finished waiting for FSMap version 46 2024-05-30T06:50:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 10 client.7104 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-30T06:50:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 20 client.7104 populate_metadata read hostname 'smithi037' 2024-05-30T06:50:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.37:6832/3396138806,v1:172.21.15.37:6835/3396138806] conn(0x55e56a530a40 0x55e56a5601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 4 client.7104 mds_command: new command op to 6939 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T06:50:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 -- 172.21.15.37:0/765290441 --> [v2:172.21.15.37:6832/3396138806,v1:172.21.15.37:6835/3396138806] -- command(tid 0: {"prefix": "status"}) -- 0x55e56a341e40 con 0x55e56a530a40 2024-05-30T06:50:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc745200640 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.37:6832/3396138806,v1:172.21.15.37:6835/3396138806] conn(0x55e56a530a40 0x55e56a5601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc745200640 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.37:6832/3396138806,v1:172.21.15.37:6835/3396138806] conn(0x55e56a530a40 0x55e56a5601d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd84d61d81fa70bd server_cookie=a5d245df088c06be in_seq=0 out_seq=0 2024-05-30T06:50:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc72e000640 10 client.7104 ms_handle_connect on v2:172.21.15.37:6832/3396138806 2024-05-30T06:50:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc72e000640 1 -- 172.21.15.37:0/765290441 <== mds.0 v2:172.21.15.37:6832/3396138806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55e56a341e40 con 0x55e56a530a40 2024-05-30T06:50:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc72e000640 10 client.7104 handle_command_reply: tid=0 2024-05-30T06:50:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 client.7104 shutdown 2024-05-30T06:50:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 -- 172.21.15.37:0/765290441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a510ec0 msgr2=0x55e56a55f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a510ec0 0x55e56a55f750 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fc728007000 tx=0x7fc728010000 comp rx=0 tx=0).stop 2024-05-30T06:50:46.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 -- 172.21.15.37:0/765290441 shutdown_connections 2024-05-30T06:50:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55e56a530120 0x55e56a55fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e56a510ec0 0x55e56a55f750 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.37:6832/3396138806,v1:172.21.15.37:6835/3396138806] conn(0x55e56a530a40 0x55e56a5601d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 --2- 172.21.15.37:0/765290441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55e56a4e3650 0x55e56a544970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc72e000640 0 client.7104 ms_handle_reset on v2:172.21.15.37:6832/3396138806 2024-05-30T06:50:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 -- 172.21.15.37:0/765290441 >> 172.21.15.37:0/765290441 conn(0x55e56a4eb500 msgr2=0x55e56a52e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 -- 172.21.15.37:0/765290441 shutdown_connections 2024-05-30T06:50:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 1 -- 172.21.15.37:0/765290441 wait complete. 2024-05-30T06:50:46.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.649+0000 7fc74b136000 20 client.7104 trim_cache size 0 max 16384 2024-05-30T06:50:46.658 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:50:46.658 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:50:46.658 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-30T06:50:46.658 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6939, 2024-05-30T06:50:46.658 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-30T06:50:46.658 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-30T06:50:46.658 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-30T06:50:46.658 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.546613513, 2024-05-30T06:50:46.658 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 46, 2024-05-30T06:50:46.658 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 73, 2024-05-30T06:50:46.658 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 73, 2024-05-30T06:50:46.659 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 16.388986235000001 2024-05-30T06:50:46.659 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:50:46.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.653+0000 7fc747c00640 1 -- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc71c069100 msgr2=0x7fc71c06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.653+0000 7fc747c00640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc71c069100 0x7fc71c06b5c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc7300b2000 tx=0x7fc7300aa070 comp rx=0 tx=0).stop 2024-05-30T06:50:46.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.653+0000 7fc747c00640 1 -- 172.21.15.37:0/4042843880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc74015d7e0 msgr2=0x7fc740154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.653+0000 7fc747c00640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc74015d7e0 0x7fc740154630 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fc738007e90 tx=0x7fc73800e4b0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.653+0000 7fc747c00640 1 -- 172.21.15.37:0/4042843880 shutdown_connections 2024-05-30T06:50:46.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.653+0000 7fc747c00640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc74015d7e0 0x7fc740154630 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.653+0000 7fc747c00640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc74015d350 0x7fc740152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.653+0000 7fc747c00640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc71c069100 0x7fc71c06b5c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.653+0000 7fc747c00640 1 --2- 172.21.15.37:0/4042843880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7400b59d0 0x7fc74013e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.653+0000 7fc747c00640 1 -- 172.21.15.37:0/4042843880 >> 172.21.15.37:0/4042843880 conn(0x7fc74006bf60 msgr2=0x7fc7401408d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:46.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.653+0000 7fc747c00640 1 -- 172.21.15.37:0/4042843880 shutdown_connections 2024-05-30T06:50:46.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.653+0000 7fc747c00640 1 -- 172.21.15.37:0/4042843880 wait complete. 2024-05-30T06:50:46.672 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T06:50:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f738fa00640 1 Processor -- start 2024-05-30T06:50:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f738fa00640 1 -- start start 2024-05-30T06:50:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f738fa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7388160b90 0x7f738809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f738fa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7388161020 0x7f738809afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f738fa00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73880d0430 con 0x7f73880b2e20 2024-05-30T06:50:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f738fa00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f73880b3200 con 0x7f7388160b90 2024-05-30T06:50:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f738fa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f73880d01e0 con 0x7f7388161020 2024-05-30T06:50:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f7387e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7388160b90 0x7f738809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f7387e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7388160b90 0x7f738809aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44086/0 (socket says 172.21.15.37:44086) 2024-05-30T06:50:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f7387e00640 1 -- 172.21.15.37:0/3950033792 learned_addr learned my addr 172.21.15.37:0/3950033792 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f738da00640 1 --2- 172.21.15.37:0/3950033792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7388161020 0x7f738809afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f7387e00640 1 -- 172.21.15.37:0/3950033792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7388161020 msgr2=0x7f738809afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f7387e00640 1 --2- 172.21.15.37:0/3950033792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7388161020 0x7f738809afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f7387e00640 1 -- 172.21.15.37:0/3950033792 >> v1:172.21.15.105:6789/0 conn(0x7f73880b2e20 legacy=0x7f7388160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.813+0000 7f7387e00640 1 -- 172.21.15.37:0/3950033792 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73880d0710 con 0x7f7388160b90 2024-05-30T06:50:46.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.817+0000 7f7387e00640 1 --2- 172.21.15.37:0/3950033792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7388160b90 0x7f738809aa60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7374009870 tx=0x7f737401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c8c4687e8d0656 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:46.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.817+0000 7f7387400640 1 -- 172.21.15.37:0/3950033792 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73740ab650 con 0x7f7388160b90 2024-05-30T06:50:46.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.817+0000 7f7387400640 1 -- 172.21.15.37:0/3950033792 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73740b0070 con 0x7f7388160b90 2024-05-30T06:50:46.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.817+0000 7f7387400640 1 -- 172.21.15.37:0/3950033792 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73740aba10 con 0x7f7388160b90 2024-05-30T06:50:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.817+0000 7f738fa00640 1 -- 172.21.15.37:0/3950033792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7388160b90 msgr2=0x7f738809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.817+0000 7f738fa00640 1 --2- 172.21.15.37:0/3950033792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7388160b90 0x7f738809aa60 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7374009870 tx=0x7f737401c560 comp rx=0 tx=0).stop 2024-05-30T06:50:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.817+0000 7f738fa00640 1 -- 172.21.15.37:0/3950033792 shutdown_connections 2024-05-30T06:50:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.817+0000 7f738fa00640 1 --2- 172.21.15.37:0/3950033792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7388161020 0x7f738809afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.817+0000 7f738fa00640 1 --2- 172.21.15.37:0/3950033792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7388160b90 0x7f738809aa60 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.817+0000 7f738fa00640 1 -- 172.21.15.37:0/3950033792 >> 172.21.15.37:0/3950033792 conn(0x7f73880b4100 msgr2=0x7f73880b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.817+0000 7f738fa00640 1 -- 172.21.15.37:0/3950033792 shutdown_connections 2024-05-30T06:50:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.817+0000 7f738fa00640 1 -- 172.21.15.37:0/3950033792 wait complete. 2024-05-30T06:50:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.817+0000 7f738fa00640 1 Processor -- start 2024-05-30T06:50:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f738fa00640 1 -- start start 2024-05-30T06:50:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f738fa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73880b2e20 0x7f7388149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f738fa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7388160b90 0x7f7388149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f738fa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7388161020 0x7f73881663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f738fa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f73880ce410 con 0x7f7388160b90 2024-05-30T06:50:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f738fa00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73880ce290 con 0x7f73880b2e20 2024-05-30T06:50:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f738fa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f73881697c0 con 0x7f7388161020 2024-05-30T06:50:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f7387e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7388160b90 0x7f7388149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f7387e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7388160b90 0x7f7388149a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44094/0 (socket says 172.21.15.37:44094) 2024-05-30T06:50:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f7387e00640 1 -- 172.21.15.37:0/1184974888 learned_addr learned my addr 172.21.15.37:0/1184974888 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f738d000640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73880b2e20 0x7f7388149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f738da00640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7388161020 0x7f73881663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f7387e00640 1 -- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7388161020 msgr2=0x7f73881663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f7387e00640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7388161020 0x7f73881663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f7387e00640 1 -- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73880b2e20 msgr2=0x7f7388149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f7387e00640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73880b2e20 0x7f7388149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f7387e00640 1 -- 172.21.15.37:0/1184974888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738814c9b0 con 0x7f7388160b90 2024-05-30T06:50:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f7387e00640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7388160b90 0x7f7388149a60 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f737401a190 tx=0x7f737401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f7384c00640 1 -- 172.21.15.37:0/1184974888 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73740be5f0 con 0x7f7388160b90 2024-05-30T06:50:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f7384c00640 1 -- 172.21.15.37:0/1184974888 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73740be790 con 0x7f7388160b90 2024-05-30T06:50:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f7384c00640 1 -- 172.21.15.37:0/1184974888 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73740beb80 con 0x7f7388160b90 2024-05-30T06:50:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f738fa00640 1 -- 172.21.15.37:0/1184974888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73880b0b20 con 0x7f7388160b90 2024-05-30T06:50:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f738fa00640 1 -- 172.21.15.37:0/1184974888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73880b10e0 con 0x7f7388160b90 2024-05-30T06:50:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.821+0000 7f738fa00640 1 -- 172.21.15.37:0/1184974888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7388068b20 con 0x7f7388160b90 2024-05-30T06:50:46.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.825+0000 7f7384c00640 1 -- 172.21.15.37:0/1184974888 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f73740b43f0 con 0x7f7388160b90 2024-05-30T06:50:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.825+0000 7f7384c00640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7368069100 0x7f736806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.825+0000 7f7384c00640 1 -- 172.21.15.37:0/1184974888 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f73741202d0 con 0x7f7388160b90 2024-05-30T06:50:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.825+0000 7f738d000640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7368069100 0x7f736806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.825+0000 7f738d000640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7368069100 0x7f736806b5c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f73881fb390 tx=0x7f737c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:46.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:46.829+0000 7f7384c00640 1 -- 172.21.15.37:0/1184974888 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f73740c4060 con 0x7f7388160b90 2024-05-30T06:50:47.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.029+0000 7f738fa00640 1 -- 172.21.15.37:0/1184974888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f73880ce860 con 0x7f7388160b90 2024-05-30T06:50:47.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.029+0000 7f7384c00640 1 -- 172.21.15.37:0/1184974888 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) ==== 53+0+73 (secure 0 0 0) 0x7f7374016150 con 0x7f7388160b90 2024-05-30T06:50:47.032 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T06:50:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.033+0000 7f738fa00640 1 -- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7368069100 msgr2=0x7f736806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.033+0000 7f738fa00640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7368069100 0x7f736806b5c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f73881fb390 tx=0x7f737c009040 comp rx=0 tx=0).stop 2024-05-30T06:50:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.033+0000 7f738fa00640 1 -- 172.21.15.37:0/1184974888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7388160b90 msgr2=0x7f7388149a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.033+0000 7f738fa00640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7388160b90 0x7f7388149a60 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f737401a190 tx=0x7f737401ada0 comp rx=0 tx=0).stop 2024-05-30T06:50:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.033+0000 7f738fa00640 1 -- 172.21.15.37:0/1184974888 shutdown_connections 2024-05-30T06:50:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.033+0000 7f738fa00640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7388161020 0x7f73881663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.033+0000 7f738fa00640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7388160b90 0x7f7388149a60 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.033+0000 7f738fa00640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7368069100 0x7f736806b5c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.033+0000 7f738fa00640 1 --2- 172.21.15.37:0/1184974888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73880b2e20 0x7f7388149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.033+0000 7f738fa00640 1 -- 172.21.15.37:0/1184974888 >> 172.21.15.37:0/1184974888 conn(0x7f73880b4100 msgr2=0x7f7388160460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.033+0000 7f738fa00640 1 -- 172.21.15.37:0/1184974888 shutdown_connections 2024-05-30T06:50:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.033+0000 7f738fa00640 1 -- 172.21.15.37:0/1184974888 wait complete. 2024-05-30T06:50:47.054 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-30T06:50:47.055 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T06:50:47.055 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-30T06:50:47.055 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T06:50:47.055 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T06:50:47.055 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-30T06:50:47.055 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-30T06:50:47.055 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T06:50:47.055 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:50:47.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:50:47.056 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-30T06:50:47.065 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:50:47.065 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:50:47.065 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:50:47.065 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:50:47.065 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-30T06:50:47.065 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:50:47.065 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:50:47.065 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:50:47.065 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-30T06:50:47.065 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T06:50:47.065 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:50:47.065 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-30T06:50:47.066 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T06:50:47.066 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41957sec preferred_lft 41957sec 2024-05-30T06:50:47.066 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-05-30T06:50:47.066 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:50:47.066 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:50:47.066 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:50:47.066 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-30T06:50:47.066 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:50:47.066 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:50:47.066 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-30T06:50:47.066 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T06:50:47.066 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:30:63:12:21 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:50:47.067 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T06:50:47.067 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:50:47.067 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:50:47.067 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T06:50:47.067 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T06:50:47.067 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:50:47.067 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T06:50:47.067 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:50:47.067 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:50:47.067 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T06:50:47.067 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T06:50:47.067 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:50:47.067 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:50:47.068 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T06:50:47.068 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T06:50:47.068 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:50:47.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:50:47.069 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T06:50:47.131 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-30T06:50:47.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:50:47.133 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-30T06:50:47.185 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-30T06:50:47.185 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T06:50:47.185 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T06:50:47.185 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T06:50:47.185 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T06:50:47.185 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T06:50:47.186 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:50:47.186 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:50:47.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T06:50:47.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T06:50:47.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T06:50:47.186 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:50:47.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:50:47.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:50:47.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:50:47.329 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T06:50:47.338 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T06:50:47.338 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T06:50:47.339 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:50:47.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:50:47.339 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-30T06:50:47.400 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:50:47.400 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T06:50:47.452 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:50:47.452 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:50:47.452 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:50:47.503 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T06:50:47.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:50:47.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:50:47.593 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:50:47.594 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:50:47.606 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:50:47.606 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:50:47.606 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-05-30T06:50:47.606 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@393250aa-2b42-4955-adf1-f790b8ba4d8c.cephfs=/ 2024-05-30T06:50:47.606 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-05-30T06:50:47.610 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T06:50:47.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:50:47.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:50:47.631 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:50:47.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:50:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:50:47.737 INFO:teuthology.orchestra.run.smithi037.stdout:client7113 2024-05-30T06:50:47.737 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:50:47.737 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:50:47.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T06:50:47.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.933+0000 7fb44ae00640 1 Processor -- start 2024-05-30T06:50:47.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.933+0000 7fb44ae00640 1 -- start start 2024-05-30T06:50:47.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.937+0000 7fb44ae00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb44415eb60 0x7fb44406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:47.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.937+0000 7fb44ae00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4440b15c0 0x7fb4440cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:47.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.937+0000 7fb44ae00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb44409bba0 con 0x7fb4440cf460 2024-05-30T06:50:47.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.937+0000 7fb44ae00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb44409ab00 con 0x7fb4440b15c0 2024-05-30T06:50:47.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.937+0000 7fb44ae00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb44409ade0 con 0x7fb44415eb60 2024-05-30T06:50:47.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.937+0000 7fb43b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4440b15c0 0x7fb4440cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:47.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.937+0000 7fb43b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4440b15c0 0x7fb4440cef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53740/0 (socket says 172.21.15.37:53740) 2024-05-30T06:50:47.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.937+0000 7fb43b400640 1 -- 172.21.15.37:0/830768243 learned_addr learned my addr 172.21.15.37:0/830768243 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:47.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.937+0000 7fb443e00640 1 --2- 172.21.15.37:0/830768243 >> v2:172.21.15.105:3300/0 conn(0x7fb44415eb60 0x7fb44406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:47.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.937+0000 7fb43b400640 1 -- 172.21.15.37:0/830768243 >> v2:172.21.15.105:3300/0 conn(0x7fb44415eb60 msgr2=0x7fb44406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:47.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.937+0000 7fb43b400640 1 --2- 172.21.15.37:0/830768243 >> v2:172.21.15.105:3300/0 conn(0x7fb44415eb60 0x7fb44406d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:47.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.937+0000 7fb43b400640 1 -- 172.21.15.37:0/830768243 >> v1:172.21.15.105:6789/0 conn(0x7fb4440cf460 legacy=0x7fb4441625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:47.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.937+0000 7fb43b400640 1 -- 172.21.15.37:0/830768243 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44409b0c0 con 0x7fb4440b15c0 2024-05-30T06:50:47.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb43b400640 1 --2- 172.21.15.37:0/830768243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4440b15c0 0x7fb4440cef20 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb4440b8730 tx=0x7fb43401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4f6ea97499776f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:47.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb443400640 1 -- 172.21.15.37:0/830768243 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4340b0070 con 0x7fb4440b15c0 2024-05-30T06:50:47.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb443400640 1 -- 172.21.15.37:0/830768243 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4340ab600 con 0x7fb4440b15c0 2024-05-30T06:50:47.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb443400640 1 -- 172.21.15.37:0/830768243 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4340ab9d0 con 0x7fb4440b15c0 2024-05-30T06:50:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb44ae00640 1 -- 172.21.15.37:0/830768243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4440b15c0 msgr2=0x7fb4440cef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb44ae00640 1 --2- 172.21.15.37:0/830768243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4440b15c0 0x7fb4440cef20 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb4440b8730 tx=0x7fb43401c520 comp rx=0 tx=0).stop 2024-05-30T06:50:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb44ae00640 1 -- 172.21.15.37:0/830768243 shutdown_connections 2024-05-30T06:50:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb44ae00640 1 --2- 172.21.15.37:0/830768243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4440b15c0 0x7fb4440cef20 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:47.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb44ae00640 1 --2- 172.21.15.37:0/830768243 >> v2:172.21.15.105:3300/0 conn(0x7fb44415eb60 0x7fb44406d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:47.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb44ae00640 1 -- 172.21.15.37:0/830768243 >> 172.21.15.37:0/830768243 conn(0x7fb4440d26a0 msgr2=0x7fb4440d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:47.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb44ae00640 1 -- 172.21.15.37:0/830768243 shutdown_connections 2024-05-30T06:50:47.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb44ae00640 1 -- 172.21.15.37:0/830768243 wait complete. 2024-05-30T06:50:47.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb44ae00640 1 Processor -- start 2024-05-30T06:50:47.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.941+0000 7fb44ae00640 1 -- start start 2024-05-30T06:50:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb44ae00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4440b15c0 0x7fb444147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb44ae00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4440cf460 0x7fb44415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb44ae00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44415eb60 0x7fb444157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb44ae00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb4440d1800 con 0x7fb4440b15c0 2024-05-30T06:50:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb44ae00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4440d1680 con 0x7fb4440cf460 2024-05-30T06:50:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb44ae00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb44416b8e0 con 0x7fb44415eb60 2024-05-30T06:50:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb443e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4440b15c0 0x7fb444147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb443e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4440b15c0 0x7fb444147a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53742/0 (socket says 172.21.15.37:53742) 2024-05-30T06:50:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb443e00640 1 -- 172.21.15.37:0/3623529093 learned_addr learned my addr 172.21.15.37:0/3623529093 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:47.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb43b400640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4440cf460 0x7fb44415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb448e00640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44415eb60 0x7fb444157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb443e00640 1 -- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44415eb60 msgr2=0x7fb444157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb443e00640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44415eb60 0x7fb444157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb443e00640 1 -- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4440cf460 msgr2=0x7fb44415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb443e00640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4440cf460 0x7fb44415dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb443e00640 1 -- 172.21.15.37:0/3623529093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb444156390 con 0x7fb4440b15c0 2024-05-30T06:50:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb43b400640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4440cf460 0x7fb44415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb443e00640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4440b15c0 0x7fb444147a10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00d830 tx=0x7fb42c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb440c00640 1 -- 172.21.15.37:0/3623529093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00b6c0 con 0x7fb4440b15c0 2024-05-30T06:50:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb440c00640 1 -- 172.21.15.37:0/3623529093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42c019070 con 0x7fb4440b15c0 2024-05-30T06:50:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb440c00640 1 -- 172.21.15.37:0/3623529093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00ba60 con 0x7fb4440b15c0 2024-05-30T06:50:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb44ae00640 1 -- 172.21.15.37:0/3623529093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb444156630 con 0x7fb4440b15c0 2024-05-30T06:50:47.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb44ae00640 1 -- 172.21.15.37:0/3623529093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44415e320 con 0x7fb4440b15c0 2024-05-30T06:50:47.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb44ae00640 1 -- 172.21.15.37:0/3623529093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb444068d40 con 0x7fb4440b15c0 2024-05-30T06:50:47.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.945+0000 7fb440c00640 1 -- 172.21.15.37:0/3623529093 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7fb42c01e460 con 0x7fb4440b15c0 2024-05-30T06:50:47.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.949+0000 7fb440c00640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb420069130 0x7fb42006b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:47.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.949+0000 7fb440c00640 1 -- 172.21.15.37:0/3623529093 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7fb42c085da0 con 0x7fb4440b15c0 2024-05-30T06:50:47.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.949+0000 7fb43b400640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb420069130 0x7fb42006b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:47.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.949+0000 7fb43b400640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb420069130 0x7fb42006b5f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb4340ad000 tx=0x7fb4340a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:47.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:47.953+0000 7fb440c00640 1 -- 172.21.15.37:0/3623529093 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb42c057b00 con 0x7fb4440b15c0 2024-05-30T06:50:48.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.153+0000 7fb44ae00640 1 -- 172.21.15.37:0/3623529093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fb444158300 con 0x7fb4440b15c0 2024-05-30T06:50:48.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.177+0000 7fb440c00640 1 -- 172.21.15.37:0/3623529093 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v47) ==== 136+0+0 (secure 0 0 0) 0x7fb42c057400 con 0x7fb4440b15c0 2024-05-30T06:50:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.177+0000 7fb44ae00640 1 -- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb420069130 msgr2=0x7fb42006b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.177+0000 7fb44ae00640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb420069130 0x7fb42006b5f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb4340ad000 tx=0x7fb4340a6000 comp rx=0 tx=0).stop 2024-05-30T06:50:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.177+0000 7fb44ae00640 1 -- 172.21.15.37:0/3623529093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4440b15c0 msgr2=0x7fb444147a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.177+0000 7fb44ae00640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4440b15c0 0x7fb444147a10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00d830 tx=0x7fb42c00dcf0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.177+0000 7fb44ae00640 1 -- 172.21.15.37:0/3623529093 shutdown_connections 2024-05-30T06:50:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.177+0000 7fb44ae00640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb44415eb60 0x7fb444157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.177+0000 7fb44ae00640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb420069130 0x7fb42006b5f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.177+0000 7fb44ae00640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4440cf460 0x7fb44415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.177+0000 7fb44ae00640 1 --2- 172.21.15.37:0/3623529093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4440b15c0 0x7fb444147a10 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.177+0000 7fb44ae00640 1 -- 172.21.15.37:0/3623529093 >> 172.21.15.37:0/3623529093 conn(0x7fb4440d26a0 msgr2=0x7fb4440709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.177+0000 7fb44ae00640 1 -- 172.21.15.37:0/3623529093 shutdown_connections 2024-05-30T06:50:48.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.177+0000 7fb44ae00640 1 -- 172.21.15.37:0/3623529093 wait complete. 2024-05-30T06:50:48.199 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:50:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.341+0000 7f523ba00640 1 Processor -- start 2024-05-30T06:50:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.341+0000 7f523ba00640 1 -- start start 2024-05-30T06:50:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.341+0000 7f523ba00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f523406f770 0x7f5234166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.341+0000 7f523ba00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f523415f310 con 0x7f5234155da0 2024-05-30T06:50:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.341+0000 7f523ba00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f523415f5f0 con 0x7f52340cd440 2024-05-30T06:50:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.341+0000 7f523ba00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f52340b4760 con 0x7f523406f770 2024-05-30T06:50:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.341+0000 7f5239a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f523406f770 0x7f5234166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.341+0000 7f5239000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5234155da0 0x7f52340cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55060/0 (socket says 172.21.15.37:55060) 2024-05-30T06:50:48.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.341+0000 7f5239000640 1 -- 172.21.15.37:0/1201994669 learned_addr learned my addr 172.21.15.37:0/1201994669 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:48.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.341+0000 7f5239a00640 1 -- 172.21.15.37:0/1201994669 >> v1:172.21.15.105:6789/0 conn(0x7f52340cd440 legacy=0x7f523406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:48.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.341+0000 7f5239a00640 1 -- 172.21.15.37:0/1201994669 >> v1:172.21.15.37:6789/0 conn(0x7f5234155da0 legacy=0x7f52340cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.341+0000 7f5233e00640 1 -- 172.21.15.37:0/1201994669 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4134719623 0 0) 0x7f523415f310 con 0x7f5234155da0 2024-05-30T06:50:48.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.341+0000 7f5239a00640 1 -- 172.21.15.37:0/1201994669 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523415f8d0 con 0x7f523406f770 2024-05-30T06:50:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.345+0000 7f5239a00640 1 --2- 172.21.15.37:0/1201994669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523406f770 0x7f5234166570 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f522c009d90 tx=0x7f522c01c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73b42364a05d065 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.345+0000 7f5233e00640 1 -- 172.21.15.37:0/1201994669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522c0a66e0 con 0x7f523406f770 2024-05-30T06:50:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.345+0000 7f5233e00640 1 -- 172.21.15.37:0/1201994669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522c0a6880 con 0x7f523406f770 2024-05-30T06:50:48.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.345+0000 7f5233e00640 1 -- 172.21.15.37:0/1201994669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522c0a6c50 con 0x7f523406f770 2024-05-30T06:50:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.345+0000 7f523ba00640 1 -- 172.21.15.37:0/1201994669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523406f770 msgr2=0x7f5234166570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.345+0000 7f523ba00640 1 --2- 172.21.15.37:0/1201994669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523406f770 0x7f5234166570 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f522c009d90 tx=0x7f522c01c810 comp rx=0 tx=0).stop 2024-05-30T06:50:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.345+0000 7f523ba00640 1 -- 172.21.15.37:0/1201994669 shutdown_connections 2024-05-30T06:50:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.345+0000 7f523ba00640 1 --2- 172.21.15.37:0/1201994669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523406f770 0x7f5234166570 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.345+0000 7f523ba00640 1 -- 172.21.15.37:0/1201994669 >> 172.21.15.37:0/1201994669 conn(0x7f523406bf60 msgr2=0x7f52340b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.345+0000 7f523ba00640 1 -- 172.21.15.37:0/1201994669 shutdown_connections 2024-05-30T06:50:48.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.345+0000 7f523ba00640 1 -- 172.21.15.37:0/1201994669 wait complete. 2024-05-30T06:50:48.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.345+0000 7f523ba00640 1 Processor -- start 2024-05-30T06:50:48.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.345+0000 7f523ba00640 1 -- start start 2024-05-30T06:50:48.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f523ba00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523406f770 0x7f52341f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:48.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f523ba00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5234155da0 0x7f523414ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:48.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f523ba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5234154370 0x7f523406df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:48.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f523ba00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5234169a70 con 0x7f523406f770 2024-05-30T06:50:48.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f523ba00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f52341698f0 con 0x7f5234155da0 2024-05-30T06:50:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f523ba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5234169bf0 con 0x7f5234154370 2024-05-30T06:50:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f5239000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523406f770 0x7f52341f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f5239000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523406f770 0x7f52341f80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53758/0 (socket says 172.21.15.37:53758) 2024-05-30T06:50:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f5239000640 1 -- 172.21.15.37:0/701894611 learned_addr learned my addr 172.21.15.37:0/701894611 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f5239000640 1 -- 172.21.15.37:0/701894611 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5234154370 msgr2=0x7f523406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f5239000640 1 --2- 172.21.15.37:0/701894611 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5234154370 0x7f523406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f5239000640 1 -- 172.21.15.37:0/701894611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5234155da0 msgr2=0x7f523414ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f5239000640 1 --2- 172.21.15.37:0/701894611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5234155da0 0x7f523414ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f5239000640 1 -- 172.21.15.37:0/701894611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52341f85f0 con 0x7f523406f770 2024-05-30T06:50:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f5239000640 1 --2- 172.21.15.37:0/701894611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523406f770 0x7f52341f80b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f522400c4b0 tx=0x7f522400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f5231600640 1 -- 172.21.15.37:0/701894611 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224018070 con 0x7f523406f770 2024-05-30T06:50:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f5231600640 1 -- 172.21.15.37:0/701894611 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5224007500 con 0x7f523406f770 2024-05-30T06:50:48.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f523ba00640 1 -- 172.21.15.37:0/701894611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52341532d0 con 0x7f523406f770 2024-05-30T06:50:48.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f5231600640 1 -- 172.21.15.37:0/701894611 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224004a30 con 0x7f523406f770 2024-05-30T06:50:48.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f523ba00640 1 -- 172.21.15.37:0/701894611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5234153890 con 0x7f523406f770 2024-05-30T06:50:48.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f523ba00640 1 -- 172.21.15.37:0/701894611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5234068bc0 con 0x7f523406f770 2024-05-30T06:50:48.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.349+0000 7f5231600640 1 -- 172.21.15.37:0/701894611 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f522401b070 con 0x7f523406f770 2024-05-30T06:50:48.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.353+0000 7f5231600640 1 --2- 172.21.15.37:0/701894611 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5210069100 0x7f521006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:48.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.353+0000 7f5231600640 1 -- 172.21.15.37:0/701894611 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f52240849c0 con 0x7f523406f770 2024-05-30T06:50:48.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.353+0000 7f522be00640 1 --2- 172.21.15.37:0/701894611 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5210069100 0x7f521006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:48.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.353+0000 7f522be00640 1 --2- 172.21.15.37:0/701894611 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5210069100 0x7f521006b5c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5234165fb0 tx=0x7f521c0079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:48.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.357+0000 7f5231600640 1 -- 172.21.15.37:0/701894611 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f52341f85f0 con 0x7f523406f770 2024-05-30T06:50:48.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.549+0000 7f523ba00640 1 -- 172.21.15.37:0/701894611 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f5234075550 con 0x7f5210069100 2024-05-30T06:50:48.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.549+0000 7f5231600640 1 -- 172.21.15.37:0/701894611 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f5234075550 con 0x7f5210069100 2024-05-30T06:50:48.552 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:50:48.552 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:50:48.552 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:50:48.552 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:50:48.552 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:50:48.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.553+0000 7f523ba00640 1 -- 172.21.15.37:0/701894611 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5210069100 msgr2=0x7f521006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.553+0000 7f523ba00640 1 --2- 172.21.15.37:0/701894611 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5210069100 0x7f521006b5c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5234165fb0 tx=0x7f521c0079c0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.553+0000 7f523ba00640 1 -- 172.21.15.37:0/701894611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523406f770 msgr2=0x7f52341f80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.553+0000 7f523ba00640 1 --2- 172.21.15.37:0/701894611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523406f770 0x7f52341f80b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f522400c4b0 tx=0x7f522400c970 comp rx=0 tx=0).stop 2024-05-30T06:50:48.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.553+0000 7f523ba00640 1 -- 172.21.15.37:0/701894611 shutdown_connections 2024-05-30T06:50:48.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.553+0000 7f523ba00640 1 --2- 172.21.15.37:0/701894611 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5234154370 0x7f523406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.553+0000 7f523ba00640 1 --2- 172.21.15.37:0/701894611 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5210069100 0x7f521006b5c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.553+0000 7f523ba00640 1 --2- 172.21.15.37:0/701894611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5234155da0 0x7f523414ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.553+0000 7f523ba00640 1 --2- 172.21.15.37:0/701894611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f523406f770 0x7f52341f80b0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.553+0000 7f523ba00640 1 -- 172.21.15.37:0/701894611 >> 172.21.15.37:0/701894611 conn(0x7f523406bf60 msgr2=0x7f52340726f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:48.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.553+0000 7f523ba00640 1 -- 172.21.15.37:0/701894611 shutdown_connections 2024-05-30T06:50:48.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.553+0000 7f523ba00640 1 -- 172.21.15.37:0/701894611 wait complete. 2024-05-30T06:50:48.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:50:48.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0ce6c00640 1 Processor -- start 2024-05-30T06:50:48.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0ce6c00640 1 -- start start 2024-05-30T06:50:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0ce6c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0ce00713a0 0x7f0ce0070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0ce6c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ce00cdf20 0x7f0ce015d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0ce6c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ce00ce4c0 con 0x7f0ce006b960 2024-05-30T06:50:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0ce6c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0ce00ce7a0 con 0x7f0ce00713a0 2024-05-30T06:50:48.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0ce6c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce00cea80 con 0x7f0ce00cdf20 2024-05-30T06:50:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0cdfe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0ce00713a0 0x7f0ce0070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0cdf400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ce00cdf20 0x7f0ce015d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0ce4c00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f0ce006b960 0x7f0ce00b0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:45910/0 (socket says 172.21.15.37:45910) 2024-05-30T06:50:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0ce4c00640 1 -- 172.21.15.37:0/451823855 learned_addr learned my addr 172.21.15.37:0/451823855 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0cdfe00640 1 -- 172.21.15.37:0/451823855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ce00cdf20 msgr2=0x7f0ce015d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0cdfe00640 1 --2- 172.21.15.37:0/451823855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ce00cdf20 0x7f0ce015d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0cdfe00640 1 -- 172.21.15.37:0/451823855 >> v1:172.21.15.105:6789/0 conn(0x7f0ce006b960 legacy=0x7f0ce00b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0cdfe00640 1 -- 172.21.15.37:0/451823855 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce00ced60 con 0x7f0ce00713a0 2024-05-30T06:50:48.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.717+0000 7f0cdea00640 1 -- 172.21.15.37:0/451823855 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2988823218 0 0) 0x7f0ce00ce4c0 con 0x7f0ce006b960 2024-05-30T06:50:48.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.721+0000 7f0cdfe00640 1 --2- 172.21.15.37:0/451823855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ce00713a0 0x7f0ce0070870 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00097c0 tx=0x7f0cd001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d0cb5684681fdb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:48.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.721+0000 7f0cdea00640 1 -- 172.21.15.37:0/451823855 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00aa620 con 0x7f0ce00713a0 2024-05-30T06:50:48.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.721+0000 7f0cdea00640 1 -- 172.21.15.37:0/451823855 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd00af070 con 0x7f0ce00713a0 2024-05-30T06:50:48.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.721+0000 7f0cdea00640 1 -- 172.21.15.37:0/451823855 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00aa9e0 con 0x7f0ce00713a0 2024-05-30T06:50:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.721+0000 7f0ce6c00640 1 -- 172.21.15.37:0/451823855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ce00713a0 msgr2=0x7f0ce0070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.721+0000 7f0ce6c00640 1 --2- 172.21.15.37:0/451823855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ce00713a0 0x7f0ce0070870 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00097c0 tx=0x7f0cd001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.721+0000 7f0ce6c00640 1 -- 172.21.15.37:0/451823855 shutdown_connections 2024-05-30T06:50:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.721+0000 7f0ce6c00640 1 --2- 172.21.15.37:0/451823855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ce00cdf20 0x7f0ce015d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.721+0000 7f0ce6c00640 1 --2- 172.21.15.37:0/451823855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ce00713a0 0x7f0ce0070870 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.721+0000 7f0ce6c00640 1 -- 172.21.15.37:0/451823855 >> 172.21.15.37:0/451823855 conn(0x7f0ce006f110 msgr2=0x7f0ce006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.721+0000 7f0ce6c00640 1 -- 172.21.15.37:0/451823855 shutdown_connections 2024-05-30T06:50:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.721+0000 7f0ce6c00640 1 -- 172.21.15.37:0/451823855 wait complete. 2024-05-30T06:50:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce6c00640 1 Processor -- start 2024-05-30T06:50:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce6c00640 1 -- start start 2024-05-30T06:50:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce6c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ce006b960 0x7f0ce01560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce6c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ce00713a0 0x7f0ce0141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce6c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ce00cdf20 0x7f0ce015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce6c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce0073bc0 con 0x7f0ce00cdf20 2024-05-30T06:50:48.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce6c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce0071990 con 0x7f0ce00713a0 2024-05-30T06:50:48.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce6c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce0073d40 con 0x7f0ce006b960 2024-05-30T06:50:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ce00cdf20 0x7f0ce015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0cdfe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ce006b960 0x7f0ce01560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0cdf400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ce00713a0 0x7f0ce0141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0cdfe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ce006b960 0x7f0ce01560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34624/0 (socket says 172.21.15.37:34624) 2024-05-30T06:50:48.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0cdf400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ce00713a0 0x7f0ce0141260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:42144/0 (socket says 172.21.15.37:42144) 2024-05-30T06:50:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0cdfe00640 1 -- 172.21.15.37:0/3671784267 learned_addr learned my addr 172.21.15.37:0/3671784267 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce4c00640 1 -- 172.21.15.37:0/3671784267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ce006b960 msgr2=0x7f0ce01560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce4c00640 1 --2- 172.21.15.37:0/3671784267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ce006b960 0x7f0ce01560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce4c00640 1 -- 172.21.15.37:0/3671784267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ce00713a0 msgr2=0x7f0ce0141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce4c00640 1 --2- 172.21.15.37:0/3671784267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ce00713a0 0x7f0ce0141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce4c00640 1 -- 172.21.15.37:0/3671784267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce00b60c0 con 0x7f0ce00cdf20 2024-05-30T06:50:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0cdfe00640 1 --2- 172.21.15.37:0/3671784267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ce006b960 0x7f0ce01560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:50:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce4c00640 1 --2- 172.21.15.37:0/3671784267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ce00cdf20 0x7f0ce015b780 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800c6e0 tx=0x7f0cd800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0cd7e00640 1 -- 172.21.15.37:0/3671784267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8018070 con 0x7f0ce00cdf20 2024-05-30T06:50:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0cd7e00640 1 -- 172.21.15.37:0/3671784267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cd8004d90 con 0x7f0ce00cdf20 2024-05-30T06:50:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce6c00640 1 -- 172.21.15.37:0/3671784267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce00b5020 con 0x7f0ce00cdf20 2024-05-30T06:50:48.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0cd7e00640 1 -- 172.21.15.37:0/3671784267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd800a880 con 0x7f0ce00cdf20 2024-05-30T06:50:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce6c00640 1 -- 172.21.15.37:0/3671784267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce00b58c0 con 0x7f0ce00cdf20 2024-05-30T06:50:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.725+0000 7f0ce6c00640 1 -- 172.21.15.37:0/3671784267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ce0068bc0 con 0x7f0ce00cdf20 2024-05-30T06:50:48.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.729+0000 7f0cd7e00640 1 -- 172.21.15.37:0/3671784267 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f0cd801b070 con 0x7f0ce00cdf20 2024-05-30T06:50:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.729+0000 7f0cd7e00640 1 --2- 172.21.15.37:0/3671784267 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0cc0069100 0x7f0cc006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.729+0000 7f0cd7e00640 1 -- 172.21.15.37:0/3671784267 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f0cd8084b50 con 0x7f0ce00cdf20 2024-05-30T06:50:48.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.729+0000 7f0cdfe00640 1 --2- 172.21.15.37:0/3671784267 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0cc0069100 0x7f0cc006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:48.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.729+0000 7f0cdfe00640 1 --2- 172.21.15.37:0/3671784267 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0cc0069100 0x7f0cc006b5c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0cd001ab50 tx=0x7f0cd00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:48.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.733+0000 7f0cd7e00640 1 -- 172.21.15.37:0/3671784267 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0cd8056260 con 0x7f0ce00cdf20 2024-05-30T06:50:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.897+0000 7f0ce6c00640 1 -- 172.21.15.37:0/3671784267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0ce00b2320 con 0x7f0ce00cdf20 2024-05-30T06:50:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.897+0000 7f0cd7e00640 1 -- 172.21.15.37:0/3671784267 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f0cd805a560 con 0x7f0ce00cdf20 2024-05-30T06:50:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.901+0000 7f0ce6c00640 1 -- 172.21.15.37:0/3671784267 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0cc0069100 msgr2=0x7f0cc006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.901+0000 7f0ce6c00640 1 --2- 172.21.15.37:0/3671784267 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0cc0069100 0x7f0cc006b5c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0cd001ab50 tx=0x7f0cd00a7000 comp rx=0 tx=0).stop 2024-05-30T06:50:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.901+0000 7f0ce6c00640 1 -- 172.21.15.37:0/3671784267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ce00cdf20 msgr2=0x7f0ce015b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.901+0000 7f0ce6c00640 1 --2- 172.21.15.37:0/3671784267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ce00cdf20 0x7f0ce015b780 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0cd800c6e0 tx=0x7f0cd800cba0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.901+0000 7f0ce6c00640 1 -- 172.21.15.37:0/3671784267 shutdown_connections 2024-05-30T06:50:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.901+0000 7f0ce6c00640 1 --2- 172.21.15.37:0/3671784267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ce00cdf20 0x7f0ce015b780 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.901+0000 7f0ce6c00640 1 --2- 172.21.15.37:0/3671784267 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0cc0069100 0x7f0cc006b5c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.901+0000 7f0ce6c00640 1 --2- 172.21.15.37:0/3671784267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ce00713a0 0x7f0ce0141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.901+0000 7f0ce6c00640 1 --2- 172.21.15.37:0/3671784267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ce006b960 0x7f0ce01560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:48.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.901+0000 7f0ce6c00640 1 -- 172.21.15.37:0/3671784267 >> 172.21.15.37:0/3671784267 conn(0x7f0ce006f110 msgr2=0x7f0ce015f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:48.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.901+0000 7f0ce6c00640 1 -- 172.21.15.37:0/3671784267 shutdown_connections 2024-05-30T06:50:48.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:48.901+0000 7f0ce6c00640 1 -- 172.21.15.37:0/3671784267 wait complete. 2024-05-30T06:50:48.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_no_wait false 2024-05-30T06:50:49.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.061+0000 7f63f0a00640 1 Processor -- start 2024-05-30T06:50:49.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.061+0000 7f63f0a00640 1 -- start start 2024-05-30T06:50:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.065+0000 7f63f0a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f63ec155da0 0x7f63ec0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.065+0000 7f63f0a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f63ec0cd440 0x7f63ec06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.065+0000 7f63f0a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63ec15f310 con 0x7f63ec06f5a0 2024-05-30T06:50:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.065+0000 7f63f0a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f63ec06fa10 con 0x7f63ec0cd440 2024-05-30T06:50:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.065+0000 7f63f0a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f63ec0b4760 con 0x7f63ec155da0 2024-05-30T06:50:49.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.065+0000 7f63e3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f63ec0cd440 0x7f63ec06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.065+0000 7f63ea800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f63ec06f5a0 0x7f63ec0cf4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55068/0 (socket says 172.21.15.37:55068) 2024-05-30T06:50:49.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.065+0000 7f63ea800640 1 -- 172.21.15.37:0/3797237893 learned_addr learned my addr 172.21.15.37:0/3797237893 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.065+0000 7f63e9e00640 1 --2- 172.21.15.37:0/3797237893 >> v2:172.21.15.105:3300/0 conn(0x7f63ec155da0 0x7f63ec0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.065+0000 7f63e3e00640 1 -- 172.21.15.37:0/3797237893 >> v2:172.21.15.105:3300/0 conn(0x7f63ec155da0 msgr2=0x7f63ec0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.065+0000 7f63e3e00640 1 --2- 172.21.15.37:0/3797237893 >> v2:172.21.15.105:3300/0 conn(0x7f63ec155da0 0x7f63ec0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.065+0000 7f63e3e00640 1 -- 172.21.15.37:0/3797237893 >> v1:172.21.15.37:6789/0 conn(0x7f63ec06f5a0 legacy=0x7f63ec0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.065+0000 7f63e3e00640 1 -- 172.21.15.37:0/3797237893 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ec15f5f0 con 0x7f63ec0cd440 2024-05-30T06:50:49.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63e3e00640 1 --2- 172.21.15.37:0/3797237893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ec0cd440 0x7f63ec06f060 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f63ec06fec0 tx=0x7f63d401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4360bbddfa4b707 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:49.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63e9400640 1 -- 172.21.15.37:0/3797237893 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d40b0070 con 0x7f63ec0cd440 2024-05-30T06:50:49.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63e9400640 1 -- 172.21.15.37:0/3797237893 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d40ab600 con 0x7f63ec0cd440 2024-05-30T06:50:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63e9400640 1 -- 172.21.15.37:0/3797237893 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d40ab9d0 con 0x7f63ec0cd440 2024-05-30T06:50:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63f0a00640 1 -- 172.21.15.37:0/3797237893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ec0cd440 msgr2=0x7f63ec06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63f0a00640 1 --2- 172.21.15.37:0/3797237893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ec0cd440 0x7f63ec06f060 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f63ec06fec0 tx=0x7f63d401c360 comp rx=0 tx=0).stop 2024-05-30T06:50:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63f0a00640 1 -- 172.21.15.37:0/3797237893 shutdown_connections 2024-05-30T06:50:49.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63f0a00640 1 --2- 172.21.15.37:0/3797237893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ec0cd440 0x7f63ec06f060 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63f0a00640 1 --2- 172.21.15.37:0/3797237893 >> v2:172.21.15.105:3300/0 conn(0x7f63ec155da0 0x7f63ec0cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63f0a00640 1 -- 172.21.15.37:0/3797237893 >> 172.21.15.37:0/3797237893 conn(0x7f63ec06bf60 msgr2=0x7f63ec0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63f0a00640 1 -- 172.21.15.37:0/3797237893 shutdown_connections 2024-05-30T06:50:49.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63f0a00640 1 -- 172.21.15.37:0/3797237893 wait complete. 2024-05-30T06:50:49.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63f0a00640 1 Processor -- start 2024-05-30T06:50:49.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.069+0000 7f63f0a00640 1 -- start start 2024-05-30T06:50:49.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63f0a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ec06f5a0 0x7f63ec15d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63f0a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63ec155da0 0x7f63ec154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63f0a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63ec0aa4f0 0x7f63ec0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63f0a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec0b4e20 con 0x7f63ec06f5a0 2024-05-30T06:50:49.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63f0a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec0b4ca0 con 0x7f63ec0aa4f0 2024-05-30T06:50:49.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63f0a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f63ec168580 con 0x7f63ec155da0 2024-05-30T06:50:49.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ec06f5a0 0x7f63ec15d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ec06f5a0 0x7f63ec15d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53782/0 (socket says 172.21.15.37:53782) 2024-05-30T06:50:49.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e9e00640 1 -- 172.21.15.37:0/3369472333 learned_addr learned my addr 172.21.15.37:0/3369472333 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:49.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e3e00640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63ec155da0 0x7f63ec154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63ea800640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63ec0aa4f0 0x7f63ec0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e9e00640 1 -- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63ec155da0 msgr2=0x7f63ec154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e9e00640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63ec155da0 0x7f63ec154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e9e00640 1 -- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63ec0aa4f0 msgr2=0x7f63ec0b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e9e00640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63ec0aa4f0 0x7f63ec0b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e9e00640 1 -- 172.21.15.37:0/3369472333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ec15ed90 con 0x7f63ec06f5a0 2024-05-30T06:50:49.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e9e00640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ec06f5a0 0x7f63ec15d970 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00d830 tx=0x7f63dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:49.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e2000640 1 -- 172.21.15.37:0/3369472333 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00b6c0 con 0x7f63ec06f5a0 2024-05-30T06:50:49.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e2000640 1 -- 172.21.15.37:0/3369472333 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63dc019070 con 0x7f63ec06f5a0 2024-05-30T06:50:49.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e2000640 1 -- 172.21.15.37:0/3369472333 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00ba60 con 0x7f63ec06f5a0 2024-05-30T06:50:49.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63f0a00640 1 -- 172.21.15.37:0/3369472333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ec15e210 con 0x7f63ec06f5a0 2024-05-30T06:50:49.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63f0a00640 1 -- 172.21.15.37:0/3369472333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ec15e7d0 con 0x7f63ec06f5a0 2024-05-30T06:50:49.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63f0a00640 1 -- 172.21.15.37:0/3369472333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63ec068bc0 con 0x7f63ec06f5a0 2024-05-30T06:50:49.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.073+0000 7f63e2000640 1 -- 172.21.15.37:0/3369472333 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f63dc01e460 con 0x7f63ec06f5a0 2024-05-30T06:50:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.077+0000 7f63e2000640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f63c8069100 0x7f63c806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.077+0000 7f63e2000640 1 -- 172.21.15.37:0/3369472333 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f63dc085cb0 con 0x7f63ec06f5a0 2024-05-30T06:50:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.077+0000 7f63e3e00640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f63c8069100 0x7f63c806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.077+0000 7f63e3e00640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f63c8069100 0x7f63c806b5c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f63d40ad000 tx=0x7f63d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:49.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.081+0000 7f63e2000640 1 -- 172.21.15.37:0/3369472333 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f63dc057a70 con 0x7f63ec06f5a0 2024-05-30T06:50:49.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.245+0000 7f63f0a00640 1 -- 172.21.15.37:0/3369472333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}] v 0) -- 0x7f63ec0b5c70 con 0x7f63ec06f5a0 2024-05-30T06:50:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.249+0000 7f63e2000640 1 -- 172.21.15.37:0/3369472333 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}]=0 v19)=0 v19) ==== 136+0+0 (secure 0 0 0) 0x7f63dc057370 con 0x7f63ec06f5a0 2024-05-30T06:50:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.249+0000 7f63f0a00640 1 -- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f63c8069100 msgr2=0x7f63c806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.249+0000 7f63f0a00640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f63c8069100 0x7f63c806b5c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f63d40ad000 tx=0x7f63d4008040 comp rx=0 tx=0).stop 2024-05-30T06:50:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.249+0000 7f63f0a00640 1 -- 172.21.15.37:0/3369472333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ec06f5a0 msgr2=0x7f63ec15d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.249+0000 7f63f0a00640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ec06f5a0 0x7f63ec15d970 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00d830 tx=0x7f63dc00dcf0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.249+0000 7f63f0a00640 1 -- 172.21.15.37:0/3369472333 shutdown_connections 2024-05-30T06:50:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.249+0000 7f63f0a00640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f63c8069100 0x7f63c806b5c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.249+0000 7f63f0a00640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f63ec0aa4f0 0x7f63ec0b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.249+0000 7f63f0a00640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f63ec155da0 0x7f63ec154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.249+0000 7f63f0a00640 1 --2- 172.21.15.37:0/3369472333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63ec06f5a0 0x7f63ec15d970 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.249+0000 7f63f0a00640 1 -- 172.21.15.37:0/3369472333 >> 172.21.15.37:0/3369472333 conn(0x7f63ec06bf60 msgr2=0x7f63ec0cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:49.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.249+0000 7f63f0a00640 1 -- 172.21.15.37:0/3369472333 shutdown_connections 2024-05-30T06:50:49.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.249+0000 7f63f0a00640 1 -- 172.21.15.37:0/3369472333 wait complete. 2024-05-30T06:50:49.270 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:49.267+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:49.270 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:49.267+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:49.270 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:49.267+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:49.270 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:49.267+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:49.271 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:49.267+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:49.272 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T06:50:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f7de00640 1 Processor -- start 2024-05-30T06:50:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f7de00640 1 -- start start 2024-05-30T06:50:49.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f7de00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4f780716b0 0x7f4f780b3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f7de00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4f780b38d0 0x7f4f780ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f7de00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f780ce470 con 0x7f4f78161ee0 2024-05-30T06:50:49.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f7de00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4f781622c0 con 0x7f4f780716b0 2024-05-30T06:50:49.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f7de00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4f780b4f30 con 0x7f4f780b38d0 2024-05-30T06:50:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f76a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4f78161ee0 0x7f4f780b4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55084/0 (socket says 172.21.15.37:55084) 2024-05-30T06:50:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f76a00640 1 -- 172.21.15.37:0/295464896 learned_addr learned my addr 172.21.15.37:0/295464896 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f6fe00640 1 --2- 172.21.15.37:0/295464896 >> v2:172.21.15.37:3300/0 conn(0x7f4f780716b0 0x7f4f780b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f77400640 1 --2- 172.21.15.37:0/295464896 >> v2:172.21.15.105:3300/0 conn(0x7f4f780b38d0 0x7f4f780ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f6fe00640 1 -- 172.21.15.37:0/295464896 >> v2:172.21.15.105:3300/0 conn(0x7f4f780b38d0 msgr2=0x7f4f780ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f6fe00640 1 --2- 172.21.15.37:0/295464896 >> v2:172.21.15.105:3300/0 conn(0x7f4f780b38d0 0x7f4f780ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f6fe00640 1 -- 172.21.15.37:0/295464896 >> v1:172.21.15.37:6789/0 conn(0x7f4f78161ee0 legacy=0x7f4f780b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f6fe00640 1 -- 172.21.15.37:0/295464896 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f780b5210 con 0x7f4f780716b0 2024-05-30T06:50:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f76000640 1 -- 172.21.15.37:0/295464896 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 676398249 0 0) 0x7f4f780ce470 con 0x7f4f78161ee0 2024-05-30T06:50:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.417+0000 7f4f77400640 1 --2- 172.21.15.37:0/295464896 >> v2:172.21.15.105:3300/0 conn(0x7f4f780b38d0 0x7f4f780ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:50:49.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.421+0000 7f4f6fe00640 1 --2- 172.21.15.37:0/295464896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f780716b0 0x7f4f780b3390 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f4f600097c0 tx=0x7f4f6001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5aca909de6cc907 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:49.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.421+0000 7f4f76000640 1 -- 172.21.15.37:0/295464896 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600b0070 con 0x7f4f780716b0 2024-05-30T06:50:49.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.421+0000 7f4f76000640 1 -- 172.21.15.37:0/295464896 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f600ab600 con 0x7f4f780716b0 2024-05-30T06:50:49.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.421+0000 7f4f76000640 1 -- 172.21.15.37:0/295464896 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600ab9d0 con 0x7f4f780716b0 2024-05-30T06:50:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.421+0000 7f4f7de00640 1 -- 172.21.15.37:0/295464896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f780716b0 msgr2=0x7f4f780b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.421+0000 7f4f7de00640 1 --2- 172.21.15.37:0/295464896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f780716b0 0x7f4f780b3390 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f4f600097c0 tx=0x7f4f6001c460 comp rx=0 tx=0).stop 2024-05-30T06:50:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.421+0000 7f4f7de00640 1 -- 172.21.15.37:0/295464896 shutdown_connections 2024-05-30T06:50:49.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.421+0000 7f4f7de00640 1 --2- 172.21.15.37:0/295464896 >> v2:172.21.15.105:3300/0 conn(0x7f4f780b38d0 0x7f4f780ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.421+0000 7f4f7de00640 1 --2- 172.21.15.37:0/295464896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f780716b0 0x7f4f780b3390 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.421+0000 7f4f7de00640 1 -- 172.21.15.37:0/295464896 >> 172.21.15.37:0/295464896 conn(0x7f4f7806f110 msgr2=0x7f4f7806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:49.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.421+0000 7f4f7de00640 1 -- 172.21.15.37:0/295464896 shutdown_connections 2024-05-30T06:50:49.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.421+0000 7f4f7de00640 1 -- 172.21.15.37:0/295464896 wait complete. 2024-05-30T06:50:49.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f7de00640 1 Processor -- start 2024-05-30T06:50:49.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f7de00640 1 -- start start 2024-05-30T06:50:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f7de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f780716b0 0x7f4f7813a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f7de00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f780b38d0 0x7f4f7815ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f7de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f78161ee0 0x7f4f78157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f7de00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4f780cfa50 con 0x7f4f780716b0 2024-05-30T06:50:49.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f7de00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4f780cf8d0 con 0x7f4f780b38d0 2024-05-30T06:50:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f7de00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4f780cfbd0 con 0x7f4f78161ee0 2024-05-30T06:50:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f76a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f780716b0 0x7f4f7813a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f76a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f780716b0 0x7f4f7813a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53788/0 (socket says 172.21.15.37:53788) 2024-05-30T06:50:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f76a00640 1 -- 172.21.15.37:0/394700339 learned_addr learned my addr 172.21.15.37:0/394700339 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f6fe00640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f780b38d0 0x7f4f7815ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f77400640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f78161ee0 0x7f4f78157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f76a00640 1 -- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f78161ee0 msgr2=0x7f4f78157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f76a00640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f78161ee0 0x7f4f78157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f76a00640 1 -- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f780b38d0 msgr2=0x7f4f7815ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f76a00640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f780b38d0 0x7f4f7815ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f76a00640 1 -- 172.21.15.37:0/394700339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f78156130 con 0x7f4f780716b0 2024-05-30T06:50:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f6fe00640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f780b38d0 0x7f4f7815ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:49.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f76a00640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f780716b0 0x7f4f7813a3d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4f680011f0 tx=0x7f4f6800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:49.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f6f400640 1 -- 172.21.15.37:0/394700339 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68018070 con 0x7f4f780716b0 2024-05-30T06:50:49.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f6f400640 1 -- 172.21.15.37:0/394700339 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f680074e0 con 0x7f4f780716b0 2024-05-30T06:50:49.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f6f400640 1 -- 172.21.15.37:0/394700339 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68004a10 con 0x7f4f780716b0 2024-05-30T06:50:49.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f7de00640 1 -- 172.21.15.37:0/394700339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f781563f0 con 0x7f4f780716b0 2024-05-30T06:50:49.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f7de00640 1 -- 172.21.15.37:0/394700339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f781569b0 con 0x7f4f780716b0 2024-05-30T06:50:49.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.425+0000 7f4f7de00640 1 -- 172.21.15.37:0/394700339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f78068d40 con 0x7f4f780716b0 2024-05-30T06:50:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.429+0000 7f4f6f400640 1 -- 172.21.15.37:0/394700339 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f4f68004bb0 con 0x7f4f780716b0 2024-05-30T06:50:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.429+0000 7f4f6f400640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f54069100 0x7f4f5406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.429+0000 7f4f6f400640 1 -- 172.21.15.37:0/394700339 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f4f68084ab0 con 0x7f4f780716b0 2024-05-30T06:50:49.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.429+0000 7f4f6fe00640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f54069100 0x7f4f5406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.429+0000 7f4f6fe00640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f54069100 0x7f4f5406b5c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4f600ad000 tx=0x7f4f60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.433+0000 7f4f6f400640 1 -- 172.21.15.37:0/394700339 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4f68056810 con 0x7f4f780716b0 2024-05-30T06:50:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.625+0000 7f4f7de00640 1 -- 172.21.15.37:0/394700339 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f4f780ce470 con 0x7f4f54069100 2024-05-30T06:50:49.635 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:49.635+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:49.635 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:49.635+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:49.636 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:49.635+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:49.636 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:49.635+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:49.636 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:50:49.635+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:50:49.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.669+0000 7f4f6f400640 1 -- 172.21.15.37:0/394700339 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4f780ce470 con 0x7f4f54069100 2024-05-30T06:50:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.669+0000 7f4f7de00640 1 -- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f54069100 msgr2=0x7f4f5406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.669+0000 7f4f7de00640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f54069100 0x7f4f5406b5c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4f600ad000 tx=0x7f4f60008040 comp rx=0 tx=0).stop 2024-05-30T06:50:49.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.669+0000 7f4f7de00640 1 -- 172.21.15.37:0/394700339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f780716b0 msgr2=0x7f4f7813a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.669+0000 7f4f7de00640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f780716b0 0x7f4f7813a3d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4f680011f0 tx=0x7f4f6800c9b0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.669+0000 7f4f7de00640 1 -- 172.21.15.37:0/394700339 shutdown_connections 2024-05-30T06:50:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.669+0000 7f4f7de00640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f78161ee0 0x7f4f78157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.669+0000 7f4f7de00640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4f54069100 0x7f4f5406b5c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.669+0000 7f4f7de00640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f780b38d0 0x7f4f7815ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.669+0000 7f4f7de00640 1 --2- 172.21.15.37:0/394700339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f780716b0 0x7f4f7813a3d0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.669+0000 7f4f7de00640 1 -- 172.21.15.37:0/394700339 >> 172.21.15.37:0/394700339 conn(0x7f4f7806f110 msgr2=0x7f4f78158580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.669+0000 7f4f7de00640 1 -- 172.21.15.37:0/394700339 shutdown_connections 2024-05-30T06:50:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.669+0000 7f4f7de00640 1 -- 172.21.15.37:0/394700339 wait complete. 2024-05-30T06:50:49.691 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:50:49.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.833+0000 7f508bc00640 1 Processor -- start 2024-05-30T06:50:49.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.833+0000 7f508bc00640 1 -- start start 2024-05-30T06:50:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f508bc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415d7e0 0x7f508406e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f508bc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5084142030 con 0x7f50840b59d0 2024-05-30T06:50:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f508bc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5084142310 con 0x7f508415d350 2024-05-30T06:50:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f508bc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f50841425f0 con 0x7f508415d7e0 2024-05-30T06:50:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5089200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f50840b59d0 0x7f50840b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55098/0 (socket says 172.21.15.37:55098) 2024-05-30T06:50:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5089200640 1 -- 172.21.15.37:0/2123989297 learned_addr learned my addr 172.21.15.37:0/2123989297 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:50:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5089c00640 1 --2- 172.21.15.37:0/2123989297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415d7e0 0x7f508406e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 839492718 0 0) 0x7f5084142030 con 0x7f50840b59d0 2024-05-30T06:50:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5068003530 con 0x7f50840b59d0 2024-05-30T06:50:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1948117546 0 0) 0x7f5084142310 con 0x7f508415d350 2024-05-30T06:50:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5084142030 con 0x7f508415d350 2024-05-30T06:50:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2570630144 0 0) 0x7f5068003530 con 0x7f50840b59d0 2024-05-30T06:50:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415d7e0 msgr2=0x7f508406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 --2- 172.21.15.37:0/2123989297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415d7e0 0x7f508406e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 >> v1:172.21.15.105:6789/0 conn(0x7f508415d350 legacy=0x7f508406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50841428d0 con 0x7f50840b59d0 2024-05-30T06:50:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f5074001680 con 0x7f50840b59d0 2024-05-30T06:50:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 >> v1:172.21.15.37:6789/0 conn(0x7f50840b59d0 legacy=0x7f50840b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 --2- 172.21.15.37:0/2123989297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5068003b80 0x7f5068003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 --2- 172.21.15.37:0/2123989297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5068004810 0x7f5068004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 --2- 172.21.15.37:0/2123989297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415d7e0 0x7f50680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50841425f0 con 0x7f5068003b80 2024-05-30T06:50:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f506800ba80 con 0x7f5068004810 2024-05-30T06:50:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f506800bc50 con 0x7f508415d7e0 2024-05-30T06:50:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5089200640 1 --2- 172.21.15.37:0/2123989297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5068003b80 0x7f5068003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f507be00640 1 --2- 172.21.15.37:0/2123989297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5068004810 0x7f5068004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5089c00640 1 --2- 172.21.15.37:0/2123989297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415d7e0 0x7f50680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5089200640 1 -- 172.21.15.37:0/2123989297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415d7e0 msgr2=0x7f50680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5089200640 1 --2- 172.21.15.37:0/2123989297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415d7e0 0x7f50680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5089200640 1 -- 172.21.15.37:0/2123989297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5068004810 msgr2=0x7f5068004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:50:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5089200640 1 --2- 172.21.15.37:0/2123989297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5068004810 0x7f5068004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f5089200640 1 -- 172.21.15.37:0/2123989297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5068003530 con 0x7f5068003b80 2024-05-30T06:50:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.837+0000 7f507be00640 1 --2- 172.21.15.37:0/2123989297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5068004810 0x7f5068004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.841+0000 7f5089200640 1 --2- 172.21.15.37:0/2123989297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5068003b80 0x7f5068003f80 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f507400c1c0 tx=0x7f507401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a8006630c65109 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.841+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5074007cf0 con 0x7f5068003b80 2024-05-30T06:50:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.841+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50740a9020 con 0x7f5068003b80 2024-05-30T06:50:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.841+0000 7f5083e00640 1 -- 172.21.15.37:0/2123989297 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5074005b00 con 0x7f5068003b80 2024-05-30T06:50:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.841+0000 7f508bc00640 1 -- 172.21.15.37:0/2123989297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5068003b80 msgr2=0x7f5068003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.841+0000 7f508bc00640 1 --2- 172.21.15.37:0/2123989297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5068003b80 0x7f5068003f80 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f507400c1c0 tx=0x7f507401cbc0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.841+0000 7f5089c00640 1 -- 172.21.15.37:0/2123989297 reap_dead start 2024-05-30T06:50:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.841+0000 7f508bc00640 1 -- 172.21.15.37:0/2123989297 shutdown_connections 2024-05-30T06:50:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.841+0000 7f508bc00640 1 -- 172.21.15.37:0/2123989297 >> 172.21.15.37:0/2123989297 conn(0x7f508406bf60 msgr2=0x7f50840b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.841+0000 7f508bc00640 1 -- 172.21.15.37:0/2123989297 shutdown_connections 2024-05-30T06:50:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.841+0000 7f508bc00640 1 -- 172.21.15.37:0/2123989297 wait complete. 2024-05-30T06:50:49.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.841+0000 7f508bc00640 1 Processor -- start 2024-05-30T06:50:49.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.841+0000 7f508bc00640 1 -- start start 2024-05-30T06:50:49.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f508bc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5068003b80 0x7f508413cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f508bc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50840b0220 0x7f50840b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f508bc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415b230 0x7f508415b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f508bc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50840b00a0 con 0x7f5068003b80 2024-05-30T06:50:49.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f508bc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f50840aff20 con 0x7f50840b0220 2024-05-30T06:50:49.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f508bc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f508413f860 con 0x7f508415b230 2024-05-30T06:50:49.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5089200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5068003b80 0x7f508413cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5089200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5068003b80 0x7f508413cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53818/0 (socket says 172.21.15.37:53818) 2024-05-30T06:50:49.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5089200640 1 -- 172.21.15.37:0/1261166641 learned_addr learned my addr 172.21.15.37:0/1261166641 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:50:49.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5089c00640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415b230 0x7f508415b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f507be00640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50840b0220 0x7f50840b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5089200640 1 -- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415b230 msgr2=0x7f508415b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5089200640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415b230 0x7f508415b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5089200640 1 -- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50840b0220 msgr2=0x7f50840b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:49.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5089200640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50840b0220 0x7f50840b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:49.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5089200640 1 -- 172.21.15.37:0/1261166641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508413c5c0 con 0x7f5068003b80 2024-05-30T06:50:49.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5089c00640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415b230 0x7f508415b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:50:49.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5089200640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5068003b80 0x7f508413cf10 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f507400c1c0 tx=0x7f5068005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:49.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5081600640 1 -- 172.21.15.37:0/1261166641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50740a5d90 con 0x7f5068003b80 2024-05-30T06:50:49.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5081600640 1 -- 172.21.15.37:0/1261166641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50740047f0 con 0x7f5068003b80 2024-05-30T06:50:49.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f508bc00640 1 -- 172.21.15.37:0/1261166641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508413d450 con 0x7f5068003b80 2024-05-30T06:50:49.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5081600640 1 -- 172.21.15.37:0/1261166641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5074004ba0 con 0x7f5068003b80 2024-05-30T06:50:49.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f508bc00640 1 -- 172.21.15.37:0/1261166641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50840b1070 con 0x7f5068003b80 2024-05-30T06:50:49.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f508bc00640 1 -- 172.21.15.37:0/1261166641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5084068bc0 con 0x7f5068003b80 2024-05-30T06:50:49.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.845+0000 7f5081600640 1 -- 172.21.15.37:0/1261166641 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 89211+0+0 (secure 0 0 0) 0x7f5074007110 con 0x7f5068003b80 2024-05-30T06:50:49.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.849+0000 7f5081600640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5060069100 0x7f506006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:50:49.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.849+0000 7f5081600640 1 -- 172.21.15.37:0/1261166641 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5737+0+0 (secure 0 0 0) 0x7f507411f900 con 0x7f5068003b80 2024-05-30T06:50:49.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.849+0000 7f507be00640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5060069100 0x7f506006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:50:49.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.849+0000 7f507be00640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5060069100 0x7f506006b5c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f50840b59a0 tx=0x7f506c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:50:49.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:49.853+0000 7f5081600640 1 -- 172.21.15.37:0/1261166641 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f50740168d0 con 0x7f5068003b80 2024-05-30T06:50:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.041+0000 7f508bc00640 1 -- 172.21.15.37:0/1261166641 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f508406f0a0 con 0x7f5060069100 2024-05-30T06:50:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.049+0000 7f5081600640 1 -- 172.21.15.37:0/1261166641 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f508406f0a0 con 0x7f5060069100 2024-05-30T06:50:50.048 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4 2024-05-30T06:50:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.049+0000 7f508bc00640 1 -- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5060069100 msgr2=0x7f506006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.049+0000 7f508bc00640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5060069100 0x7f506006b5c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f50840b59a0 tx=0x7f506c009040 comp rx=0 tx=0).stop 2024-05-30T06:50:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.049+0000 7f508bc00640 1 -- 172.21.15.37:0/1261166641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5068003b80 msgr2=0x7f508413cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:50:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.049+0000 7f508bc00640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5068003b80 0x7f508413cf10 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f507400c1c0 tx=0x7f5068005840 comp rx=0 tx=0).stop 2024-05-30T06:50:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.049+0000 7f508bc00640 1 -- 172.21.15.37:0/1261166641 shutdown_connections 2024-05-30T06:50:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.049+0000 7f508bc00640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f508415b230 0x7f508415b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.049+0000 7f508bc00640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5060069100 0x7f506006b5c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.049+0000 7f508bc00640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50840b0220 0x7f50840b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.049+0000 7f508bc00640 1 --2- 172.21.15.37:0/1261166641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5068003b80 0x7f508413cf10 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:50:50.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.049+0000 7f508bc00640 1 -- 172.21.15.37:0/1261166641 >> 172.21.15.37:0/1261166641 conn(0x7f508406bf60 msgr2=0x7f508406e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:50:50.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.049+0000 7f508bc00640 1 -- 172.21.15.37:0/1261166641 shutdown_connections 2024-05-30T06:50:50.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:50:50.049+0000 7f508bc00640 1 -- 172.21.15.37:0/1261166641 wait complete. 2024-05-30T06:50:50.070 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4 2024-05-30T06:50:50.071 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:50:50.071 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:50:50.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:50:50.080 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:50:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:50:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:50:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.32046 s, 129 MB/s 2024-05-30T06:50:58.456 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:50:58.457 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:50:58.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:50:58.466 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:51:04.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:51:04.836 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:51:06.847 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:51:06.847 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:51:06.847 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.32984 s, 129 MB/s 2024-05-30T06:51:06.848 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:51:06.849 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:51:06.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:51:06.858 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:51:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:51:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:51:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.42869 s, 127 MB/s 2024-05-30T06:51:15.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T06:51:15.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.484+0000 7f62aee00640 1 Processor -- start 2024-05-30T06:51:15.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.484+0000 7f62aee00640 1 -- start start 2024-05-30T06:51:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.484+0000 7f62aee00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f62a8073900 0x7f62a81603b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.484+0000 7f62aee00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f62a80b3390 0x7f62a80b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.484+0000 7f62aee00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62a80d1410 con 0x7f62a815c820 2024-05-30T06:51:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.484+0000 7f62aee00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f62a80b3d00 con 0x7f62a80b3390 2024-05-30T06:51:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.484+0000 7f62aee00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f62a8160ab0 con 0x7f62a8073900 2024-05-30T06:51:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.484+0000 7f62ace00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f62a80b3390 0x7f62a80b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f62a7e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f62a815c820 0x7f62a80ce000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:55018/0 (socket says 172.21.15.37:55018) 2024-05-30T06:51:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f62ace00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f62a80b3390 0x7f62a80b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45236/0 (socket says 172.21.15.37:45236) 2024-05-30T06:51:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f62a7e00640 1 -- 172.21.15.37:0/196206136 learned_addr learned my addr 172.21.15.37:0/196206136 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:51:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f629fe00640 1 --2- 172.21.15.37:0/196206136 >> v2:172.21.15.105:3300/0 conn(0x7f62a8073900 0x7f62a81603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f62ace00640 1 -- 172.21.15.37:0/196206136 >> v2:172.21.15.105:3300/0 conn(0x7f62a8073900 msgr2=0x7f62a81603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f62ace00640 1 --2- 172.21.15.37:0/196206136 >> v2:172.21.15.105:3300/0 conn(0x7f62a8073900 0x7f62a81603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f62ace00640 1 -- 172.21.15.37:0/196206136 >> v1:172.21.15.105:6789/0 conn(0x7f62a815c820 legacy=0x7f62a80ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f62ace00640 1 -- 172.21.15.37:0/196206136 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a8160d90 con 0x7f62a80b3390 2024-05-30T06:51:15.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f62ace00640 1 --2- 172.21.15.37:0/196206136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a80b3390 0x7f62a80b37c0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f62a806da50 tx=0x7f62a001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd22811e540fc41b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f62a7400640 1 -- 172.21.15.37:0/196206136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a00b2070 con 0x7f62a80b3390 2024-05-30T06:51:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f62a7400640 1 -- 172.21.15.37:0/196206136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a00a5900 con 0x7f62a80b3390 2024-05-30T06:51:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f62a7400640 1 -- 172.21.15.37:0/196206136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a00a5cd0 con 0x7f62a80b3390 2024-05-30T06:51:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f62aee00640 1 -- 172.21.15.37:0/196206136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a80b3390 msgr2=0x7f62a80b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.488+0000 7f62aee00640 1 --2- 172.21.15.37:0/196206136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a80b3390 0x7f62a80b37c0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f62a806da50 tx=0x7f62a001c930 comp rx=0 tx=0).stop 2024-05-30T06:51:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 -- 172.21.15.37:0/196206136 shutdown_connections 2024-05-30T06:51:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 --2- 172.21.15.37:0/196206136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a80b3390 0x7f62a80b37c0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 --2- 172.21.15.37:0/196206136 >> v2:172.21.15.105:3300/0 conn(0x7f62a8073900 0x7f62a81603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 -- 172.21.15.37:0/196206136 >> 172.21.15.37:0/196206136 conn(0x7f62a806f110 msgr2=0x7f62a806f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 -- 172.21.15.37:0/196206136 shutdown_connections 2024-05-30T06:51:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 -- 172.21.15.37:0/196206136 wait complete. 2024-05-30T06:51:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 Processor -- start 2024-05-30T06:51:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 -- start start 2024-05-30T06:51:15.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a8073900 0x7f62a814cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62a80b3390 0x7f62a81555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a815c820 0x7f62a8155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f62a80718c0 con 0x7f62a815c820 2024-05-30T06:51:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62a8071740 con 0x7f62a8073900 2024-05-30T06:51:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62aee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f62a8169730 con 0x7f62a80b3390 2024-05-30T06:51:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62ace00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a815c820 0x7f62a8155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62ace00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a815c820 0x7f62a8155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45242/0 (socket says 172.21.15.37:45242) 2024-05-30T06:51:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62ace00640 1 -- 172.21.15.37:0/3835520300 learned_addr learned my addr 172.21.15.37:0/3835520300 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62a7e00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a8073900 0x7f62a814cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f629fe00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62a80b3390 0x7f62a81555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62ace00640 1 -- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62a80b3390 msgr2=0x7f62a81555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62ace00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62a80b3390 0x7f62a81555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62ace00640 1 -- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a8073900 msgr2=0x7f62a814cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:15.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62ace00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a8073900 0x7f62a814cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.492+0000 7f62ace00640 1 -- 172.21.15.37:0/3835520300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a815e490 con 0x7f62a815c820 2024-05-30T06:51:15.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.496+0000 7f62ace00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a815c820 0x7f62a8155b20 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f62a00b0040 tx=0x7f62a00196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:15.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.496+0000 7f62a4c00640 1 -- 172.21.15.37:0/3835520300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a00b2050 con 0x7f62a815c820 2024-05-30T06:51:15.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.496+0000 7f62a4c00640 1 -- 172.21.15.37:0/3835520300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a00be070 con 0x7f62a815c820 2024-05-30T06:51:15.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.496+0000 7f62a4c00640 1 -- 172.21.15.37:0/3835520300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a00ada90 con 0x7f62a815c820 2024-05-30T06:51:15.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.496+0000 7f62aee00640 1 -- 172.21.15.37:0/3835520300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a815e730 con 0x7f62a815c820 2024-05-30T06:51:15.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.496+0000 7f62aee00640 1 -- 172.21.15.37:0/3835520300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a815ecf0 con 0x7f62a815c820 2024-05-30T06:51:15.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.496+0000 7f62aee00640 1 -- 172.21.15.37:0/3835520300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62a8068d40 con 0x7f62a815c820 2024-05-30T06:51:15.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.496+0000 7f62a4c00640 1 -- 172.21.15.37:0/3835520300 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 89313+0+0 (secure 0 0 0) 0x7f62a00adc30 con 0x7f62a815c820 2024-05-30T06:51:15.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.496+0000 7f62a4c00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6284069220 0x7f628406b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.496+0000 7f62a4c00640 1 -- 172.21.15.37:0/3835520300 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f62a01207d0 con 0x7f62a815c820 2024-05-30T06:51:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.496+0000 7f62a7e00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6284069220 0x7f628406b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.500+0000 7f62a7e00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6284069220 0x7f628406b6e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f62a81567a0 tx=0x7f6298007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:15.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.500+0000 7f62a4c00640 1 -- 172.21.15.37:0/3835520300 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f62a0016520 con 0x7f62a815c820 2024-05-30T06:51:15.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.692+0000 7f62aee00640 1 -- 172.21.15.37:0/3835520300 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f62a8167500 con 0x7f6284069220 2024-05-30T06:51:15.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.708+0000 7f62a4c00640 1 -- 172.21.15.37:0/3835520300 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f62a8167500 con 0x7f6284069220 2024-05-30T06:51:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.708+0000 7f62aee00640 1 -- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6284069220 msgr2=0x7f628406b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.708+0000 7f62aee00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6284069220 0x7f628406b6e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f62a81567a0 tx=0x7f6298007e90 comp rx=0 tx=0).stop 2024-05-30T06:51:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.708+0000 7f62aee00640 1 -- 172.21.15.37:0/3835520300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a815c820 msgr2=0x7f62a8155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.708+0000 7f62aee00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a815c820 0x7f62a8155b20 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f62a00b0040 tx=0x7f62a00196d0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.708+0000 7f62aee00640 1 -- 172.21.15.37:0/3835520300 shutdown_connections 2024-05-30T06:51:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.708+0000 7f62aee00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a815c820 0x7f62a8155b20 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.708+0000 7f62aee00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62a80b3390 0x7f62a81555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.708+0000 7f62aee00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6284069220 0x7f628406b6e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.708+0000 7f62aee00640 1 --2- 172.21.15.37:0/3835520300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62a8073900 0x7f62a814cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.708+0000 7f62aee00640 1 -- 172.21.15.37:0/3835520300 >> 172.21.15.37:0/3835520300 conn(0x7f62a806f110 msgr2=0x7f62a815b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.708+0000 7f62aee00640 1 -- 172.21.15.37:0/3835520300 shutdown_connections 2024-05-30T06:51:15.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.708+0000 7f62aee00640 1 -- 172.21.15.37:0/3835520300 wait complete. 2024-05-30T06:51:15.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:51:15.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3951600640 1 Processor -- start 2024-05-30T06:51:15.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3951600640 1 -- start start 2024-05-30T06:51:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3951600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f394c1556e0 0x7f394c155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3951600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394c15f9a0 0x7f394c0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3951600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f394c0cf290 0x7f394c162590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3951600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f394c0b3ef0 con 0x7f394c0cf290 2024-05-30T06:51:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3951600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f394c09ba50 con 0x7f394c1556e0 2024-05-30T06:51:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3951600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f394c09bee0 con 0x7f394c15f9a0 2024-05-30T06:51:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3950c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f394c0cf290 0x7f394c162590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f394be00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f394c1556e0 0x7f394c155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3943e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394c15f9a0 0x7f394c0ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3950c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f394c0cf290 0x7f394c162590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45248/0 (socket says 172.21.15.37:45248) 2024-05-30T06:51:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3950c00640 1 -- 172.21.15.37:0/3099600465 learned_addr learned my addr 172.21.15.37:0/3099600465 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3943e00640 1 -- 172.21.15.37:0/3099600465 >> v2:172.21.15.105:3300/0 conn(0x7f394c1556e0 msgr2=0x7f394c155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:15.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3943e00640 1 --2- 172.21.15.37:0/3099600465 >> v2:172.21.15.105:3300/0 conn(0x7f394c1556e0 0x7f394c155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3943e00640 1 -- 172.21.15.37:0/3099600465 >> v2:172.21.15.37:3300/0 conn(0x7f394c0cf290 msgr2=0x7f394c162590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:15.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3943e00640 1 --2- 172.21.15.37:0/3099600465 >> v2:172.21.15.37:3300/0 conn(0x7f394c0cf290 0x7f394c162590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.872+0000 7f3943e00640 1 -- 172.21.15.37:0/3099600465 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c09ae40 con 0x7f394c15f9a0 2024-05-30T06:51:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.876+0000 7f3943e00640 1 --2- 172.21.15.37:0/3099600465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394c15f9a0 0x7f394c0ced50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f394c06f870 tx=0x7f393401c1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=466d6610d6db411b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:15.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.876+0000 7f394b400640 1 -- 172.21.15.37:0/3099600465 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39340b0070 con 0x7f394c15f9a0 2024-05-30T06:51:15.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.876+0000 7f394b400640 1 -- 172.21.15.37:0/3099600465 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39340ab600 con 0x7f394c15f9a0 2024-05-30T06:51:15.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.876+0000 7f394b400640 1 -- 172.21.15.37:0/3099600465 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39340ab9d0 con 0x7f394c15f9a0 2024-05-30T06:51:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.876+0000 7f3951600640 1 -- 172.21.15.37:0/3099600465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394c15f9a0 msgr2=0x7f394c0ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.876+0000 7f3951600640 1 --2- 172.21.15.37:0/3099600465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394c15f9a0 0x7f394c0ced50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f394c06f870 tx=0x7f393401c1c0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.876+0000 7f3951600640 1 -- 172.21.15.37:0/3099600465 shutdown_connections 2024-05-30T06:51:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.876+0000 7f3951600640 1 --2- 172.21.15.37:0/3099600465 >> v2:172.21.15.37:3300/0 conn(0x7f394c0cf290 0x7f394c162590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.876+0000 7f3951600640 1 --2- 172.21.15.37:0/3099600465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394c15f9a0 0x7f394c0ced50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.876+0000 7f3951600640 1 --2- 172.21.15.37:0/3099600465 >> v2:172.21.15.105:3300/0 conn(0x7f394c1556e0 0x7f394c155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.876+0000 7f3951600640 1 -- 172.21.15.37:0/3099600465 >> 172.21.15.37:0/3099600465 conn(0x7f394c0b4070 msgr2=0x7f394c0b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.876+0000 7f3951600640 1 -- 172.21.15.37:0/3099600465 shutdown_connections 2024-05-30T06:51:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.876+0000 7f3951600640 1 -- 172.21.15.37:0/3099600465 wait complete. 2024-05-30T06:51:15.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3951600640 1 Processor -- start 2024-05-30T06:51:15.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3951600640 1 -- start start 2024-05-30T06:51:15.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3951600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f394c0cf290 0x7f394c0afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:15.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3951600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394c1556e0 0x7f394c14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:15.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3951600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394c15f9a0 0x7f394c160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:15.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3951600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f394c0d1d90 con 0x7f394c15f9a0 2024-05-30T06:51:15.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3951600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f394c15fde0 con 0x7f394c0cf290 2024-05-30T06:51:15.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3951600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f394c0d1f10 con 0x7f394c1556e0 2024-05-30T06:51:15.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3950c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394c15f9a0 0x7f394c160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3950c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394c15f9a0 0x7f394c160ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45264/0 (socket says 172.21.15.37:45264) 2024-05-30T06:51:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3950c00640 1 -- 172.21.15.37:0/1547350592 learned_addr learned my addr 172.21.15.37:0/1547350592 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f394be00640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f394c0cf290 0x7f394c0afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3943e00640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394c1556e0 0x7f394c14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3950c00640 1 -- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394c1556e0 msgr2=0x7f394c14fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3950c00640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394c1556e0 0x7f394c14fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3950c00640 1 -- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f394c0cf290 msgr2=0x7f394c0afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3950c00640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f394c0cf290 0x7f394c0afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3950c00640 1 -- 172.21.15.37:0/1547350592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c1500c0 con 0x7f394c15f9a0 2024-05-30T06:51:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3950c00640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394c15f9a0 0x7f394c160ab0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f394400eed0 tx=0x7f394400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3948c00640 1 -- 172.21.15.37:0/1547350592 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394401a070 con 0x7f394c15f9a0 2024-05-30T06:51:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3948c00640 1 -- 172.21.15.37:0/1547350592 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394400bb10 con 0x7f394c15f9a0 2024-05-30T06:51:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3948c00640 1 -- 172.21.15.37:0/1547350592 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39440039a0 con 0x7f394c15f9a0 2024-05-30T06:51:15.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3951600640 1 -- 172.21.15.37:0/1547350592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f394c0b02f0 con 0x7f394c15f9a0 2024-05-30T06:51:15.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3951600640 1 -- 172.21.15.37:0/1547350592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f394c155ff0 con 0x7f394c15f9a0 2024-05-30T06:51:15.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.880+0000 7f3951600640 1 -- 172.21.15.37:0/1547350592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f394c068ab0 con 0x7f394c15f9a0 2024-05-30T06:51:15.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.884+0000 7f3948c00640 1 -- 172.21.15.37:0/1547350592 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 89313+0+0 (secure 0 0 0) 0x7f394401d070 con 0x7f394c15f9a0 2024-05-30T06:51:15.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.884+0000 7f3948c00640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3928069250 0x7f392806b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:15.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.884+0000 7f3948c00640 1 -- 172.21.15.37:0/1547350592 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f39440854e0 con 0x7f394c15f9a0 2024-05-30T06:51:15.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.884+0000 7f394be00640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3928069250 0x7f392806b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:15.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.884+0000 7f394be00640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3928069250 0x7f392806b710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f393c009b60 tx=0x7f393c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:15.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:15.888+0000 7f3948c00640 1 -- 172.21.15.37:0/1547350592 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3944056e60 con 0x7f394c15f9a0 2024-05-30T06:51:16.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.080+0000 7f3951600640 1 -- 172.21.15.37:0/1547350592 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f394c0b2b40 con 0x7f3928069250 2024-05-30T06:51:16.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.084+0000 7f3948c00640 1 -- 172.21.15.37:0/1547350592 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f394c0b2b40 con 0x7f3928069250 2024-05-30T06:51:16.086 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4 2024-05-30T06:51:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.084+0000 7f3951600640 1 -- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3928069250 msgr2=0x7f392806b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.084+0000 7f3951600640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3928069250 0x7f392806b710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f393c009b60 tx=0x7f393c009190 comp rx=0 tx=0).stop 2024-05-30T06:51:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.084+0000 7f3951600640 1 -- 172.21.15.37:0/1547350592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394c15f9a0 msgr2=0x7f394c160ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.084+0000 7f3951600640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394c15f9a0 0x7f394c160ab0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f394400eed0 tx=0x7f394400b480 comp rx=0 tx=0).stop 2024-05-30T06:51:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.084+0000 7f3951600640 1 -- 172.21.15.37:0/1547350592 shutdown_connections 2024-05-30T06:51:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.084+0000 7f3951600640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f394c15f9a0 0x7f394c160ab0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.084+0000 7f3951600640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f394c1556e0 0x7f394c14fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.084+0000 7f3951600640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3928069250 0x7f392806b710 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.084+0000 7f3951600640 1 --2- 172.21.15.37:0/1547350592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f394c0cf290 0x7f394c0afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.084+0000 7f3951600640 1 -- 172.21.15.37:0/1547350592 >> 172.21.15.37:0/1547350592 conn(0x7f394c0b4070 msgr2=0x7f394c070010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.084+0000 7f3951600640 1 -- 172.21.15.37:0/1547350592 shutdown_connections 2024-05-30T06:51:16.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:16.084+0000 7f3951600640 1 -- 172.21.15.37:0/1547350592 wait complete. 2024-05-30T06:51:16.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:51:16.108 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4 2024-05-30T06:51:16.108 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:51:16.117 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4 2024-05-30T06:51:16.118 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3055190016" 2024-05-30T06:51:16.118 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:51:16.119 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 exp_size = 3221225472 2024-05-30T06:51:18.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:51:18.120 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4 2024-05-30T06:51:18.120 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:51:18.131 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4 2024-05-30T06:51:18.131 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3055190016" 2024-05-30T06:51:18.131 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:51:18.132 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 exp_size = 3221225472 2024-05-30T06:51:20.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:51:20.133 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4 2024-05-30T06:51:20.133 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:51:20.144 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4 2024-05-30T06:51:20.144 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3055190016" 2024-05-30T06:51:20.144 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:51:20.145 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 exp_size = 3221225472 2024-05-30T06:51:22.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:51:22.147 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4 2024-05-30T06:51:22.147 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:51:22.158 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/e5ba633d-99b7-4b05-b591-d0702b6887d4 2024-05-30T06:51:22.158 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T06:51:22.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:51:22.159 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T06:51:22.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone37101 2024-05-30T06:51:22.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1139400640 1 Processor -- start 2024-05-30T06:51:22.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1139400640 1 -- start start 2024-05-30T06:51:22.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1139400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f113415c650 0x7f11340d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:22.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1139400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11340b2890 0x7f11340d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1139400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11340b3f40 con 0x7f113415ca30 2024-05-30T06:51:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1139400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f11340cce80 con 0x7f11340b2890 2024-05-30T06:51:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1139400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f11340b2ec0 con 0x7f113415c650 2024-05-30T06:51:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1133200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11340b2890 0x7f11340d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1133200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11340b2890 0x7f11340d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42686/0 (socket says 172.21.15.37:42686) 2024-05-30T06:51:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1133200640 1 -- 172.21.15.37:0/323230055 learned_addr learned my addr 172.21.15.37:0/323230055 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1132800640 1 --2- 172.21.15.37:0/323230055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f113415c650 0x7f11340d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1133200640 1 -- 172.21.15.37:0/323230055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f113415c650 msgr2=0x7f11340d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1133200640 1 --2- 172.21.15.37:0/323230055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f113415c650 0x7f11340d09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1133200640 1 -- 172.21.15.37:0/323230055 >> v1:172.21.15.105:6789/0 conn(0x7f113415ca30 legacy=0x7f11340b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.360+0000 7f1133200640 1 -- 172.21.15.37:0/323230055 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11340b3180 con 0x7f11340b2890 2024-05-30T06:51:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.364+0000 7f1133200640 1 --2- 172.21.15.37:0/323230055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11340b2890 0x7f11340d0f20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f112c009870 tx=0x7f112c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7dd8149ff6bb38 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.364+0000 7f1131e00640 1 -- 172.21.15.37:0/323230055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c0b5070 con 0x7f11340b2890 2024-05-30T06:51:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.364+0000 7f1131e00640 1 -- 172.21.15.37:0/323230055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f112c0a8a50 con 0x7f11340b2890 2024-05-30T06:51:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.364+0000 7f1131e00640 1 -- 172.21.15.37:0/323230055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c0a8e20 con 0x7f11340b2890 2024-05-30T06:51:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.364+0000 7f1139400640 1 -- 172.21.15.37:0/323230055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11340b2890 msgr2=0x7f11340d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.364+0000 7f1139400640 1 --2- 172.21.15.37:0/323230055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11340b2890 0x7f11340d0f20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f112c009870 tx=0x7f112c01ed50 comp rx=0 tx=0).stop 2024-05-30T06:51:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.364+0000 7f1139400640 1 -- 172.21.15.37:0/323230055 shutdown_connections 2024-05-30T06:51:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.364+0000 7f1139400640 1 --2- 172.21.15.37:0/323230055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11340b2890 0x7f11340d0f20 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.364+0000 7f1139400640 1 --2- 172.21.15.37:0/323230055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f113415c650 0x7f11340d09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.364+0000 7f1139400640 1 -- 172.21.15.37:0/323230055 >> 172.21.15.37:0/323230055 conn(0x7f11340b4130 msgr2=0x7f11340b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.364+0000 7f1139400640 1 -- 172.21.15.37:0/323230055 shutdown_connections 2024-05-30T06:51:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.364+0000 7f1139400640 1 -- 172.21.15.37:0/323230055 wait complete. 2024-05-30T06:51:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1139400640 1 Processor -- start 2024-05-30T06:51:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1139400640 1 -- start start 2024-05-30T06:51:22.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1139400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11340b2890 0x7f11340b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:22.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1139400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f113415c650 0x7f11340b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:22.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1139400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f113415ca30 0x7f1134149900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:22.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1139400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f11340b3a20 con 0x7f113415c650 2024-05-30T06:51:22.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1139400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f11340b3740 con 0x7f113415ca30 2024-05-30T06:51:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1139400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f11340af410 con 0x7f11340b2890 2024-05-30T06:51:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1129e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f113415c650 0x7f11340b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1129e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f113415c650 0x7f11340b5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42700/0 (socket says 172.21.15.37:42700) 2024-05-30T06:51:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1129e00640 1 -- 172.21.15.37:0/2256888094 learned_addr learned my addr 172.21.15.37:0/2256888094 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1133200640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f113415ca30 0x7f1134149900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1132800640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11340b2890 0x7f11340b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1129e00640 1 -- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11340b2890 msgr2=0x7f11340b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1129e00640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11340b2890 0x7f11340b7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1129e00640 1 -- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f113415ca30 msgr2=0x7f1134149900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1129e00640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f113415ca30 0x7f1134149900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1129e00640 1 -- 172.21.15.37:0/2256888094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11341f6b70 con 0x7f113415c650 2024-05-30T06:51:22.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1129e00640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f113415c650 0x7f11340b5240 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f111c00c730 tx=0x7f111c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f112b400640 1 -- 172.21.15.37:0/2256888094 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c016020 con 0x7f113415c650 2024-05-30T06:51:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f112b400640 1 -- 172.21.15.37:0/2256888094 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111c006d60 con 0x7f113415c650 2024-05-30T06:51:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1139400640 1 -- 172.21.15.37:0/2256888094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11340b6df0 con 0x7f113415c650 2024-05-30T06:51:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f112b400640 1 -- 172.21.15.37:0/2256888094 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c003bc0 con 0x7f113415c650 2024-05-30T06:51:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.368+0000 7f1139400640 1 -- 172.21.15.37:0/2256888094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11340b73b0 con 0x7f113415c650 2024-05-30T06:51:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.372+0000 7f1139400640 1 -- 172.21.15.37:0/2256888094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1134068bc0 con 0x7f113415c650 2024-05-30T06:51:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.372+0000 7f112b400640 1 -- 172.21.15.37:0/2256888094 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 89313+0+0 (secure 0 0 0) 0x7f111c00a850 con 0x7f113415c650 2024-05-30T06:51:22.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.372+0000 7f112b400640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1110069220 0x7f111006b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:22.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.372+0000 7f112b400640 1 -- 172.21.15.37:0/2256888094 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f111c085010 con 0x7f113415c650 2024-05-30T06:51:22.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.372+0000 7f1132800640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1110069220 0x7f111006b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:22.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.372+0000 7f1132800640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1110069220 0x7f111006b6e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1124007a60 tx=0x7f1124008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:22.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.376+0000 7f112b400640 1 -- 172.21.15.37:0/2256888094 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f111c08b030 con 0x7f113415c650 2024-05-30T06:51:22.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.576+0000 7f1139400640 1 -- 172.21.15.37:0/2256888094 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone37101", "target": ["mon-mgr", ""]}) -- 0x7f11340b85a0 con 0x7f1110069220 2024-05-30T06:51:22.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.644+0000 7f112b400640 1 -- 172.21.15.37:0/2256888094 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f11340b85a0 con 0x7f1110069220 2024-05-30T06:51:22.650 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:22.651+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:22.650 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:22.651+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:22.650 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:22.651+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:22.650 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:22.651+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:22.650 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:22.651+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.644+0000 7f1139400640 1 -- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1110069220 msgr2=0x7f111006b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.644+0000 7f1139400640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1110069220 0x7f111006b6e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1124007a60 tx=0x7f1124008040 comp rx=0 tx=0).stop 2024-05-30T06:51:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.644+0000 7f1139400640 1 -- 172.21.15.37:0/2256888094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f113415c650 msgr2=0x7f11340b5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.644+0000 7f1139400640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f113415c650 0x7f11340b5240 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f111c00c730 tx=0x7f111c00cbf0 comp rx=0 tx=0).stop 2024-05-30T06:51:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.644+0000 7f1139400640 1 -- 172.21.15.37:0/2256888094 shutdown_connections 2024-05-30T06:51:22.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.644+0000 7f1139400640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1110069220 0x7f111006b6e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:22.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.644+0000 7f1139400640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f113415ca30 0x7f1134149900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:22.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.644+0000 7f1139400640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f113415c650 0x7f11340b5240 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:22.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.644+0000 7f1139400640 1 --2- 172.21.15.37:0/2256888094 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11340b2890 0x7f11340b7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:22.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.644+0000 7f1139400640 1 -- 172.21.15.37:0/2256888094 >> 172.21.15.37:0/2256888094 conn(0x7f11340b4130 msgr2=0x7f1134159c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:22.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.648+0000 7f1139400640 1 -- 172.21.15.37:0/2256888094 shutdown_connections 2024-05-30T06:51:22.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.648+0000 7f1139400640 1 -- 172.21.15.37:0/2256888094 wait complete. 2024-05-30T06:51:22.666 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:22.667+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:22.666 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:22.667+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:22.666 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:22.667+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:22.666 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:22.667+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:22.666 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:22.667+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:22.671 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone37102 2024-05-30T06:51:22.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f8285800640 1 Processor -- start 2024-05-30T06:51:22.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f8285800640 1 -- start start 2024-05-30T06:51:22.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f8285800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f828015d7e0 0x7f828006e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:22.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f8285800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8280142030 con 0x7f82800b59d0 2024-05-30T06:51:22.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f8285800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8280142310 con 0x7f828015d350 2024-05-30T06:51:22.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f8285800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f82801425f0 con 0x7f828015d7e0 2024-05-30T06:51:22.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f827ea00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f82800b59d0 0x7f82800b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:32882/0 (socket says 172.21.15.37:32882) 2024-05-30T06:51:22.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f827ea00640 1 -- 172.21.15.37:0/800640553 learned_addr learned my addr 172.21.15.37:0/800640553 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:51:22.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f827f400640 1 --2- 172.21.15.37:0/800640553 >> v2:172.21.15.105:3300/0 conn(0x7f828015d7e0 0x7f828006e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:22.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f827e000640 1 -- 172.21.15.37:0/800640553 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4021387405 0 0) 0x7f8280142030 con 0x7f82800b59d0 2024-05-30T06:51:22.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f827e000640 1 -- 172.21.15.37:0/800640553 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8264003530 con 0x7f82800b59d0 2024-05-30T06:51:22.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f827e000640 1 -- 172.21.15.37:0/800640553 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297205051 0 0) 0x7f8280142310 con 0x7f828015d350 2024-05-30T06:51:22.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f827e000640 1 -- 172.21.15.37:0/800640553 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8280142030 con 0x7f828015d350 2024-05-30T06:51:22.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f827f400640 1 -- 172.21.15.37:0/800640553 >> v1:172.21.15.105:6789/0 conn(0x7f828015d350 legacy=0x7f828006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:22.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f827f400640 1 -- 172.21.15.37:0/800640553 >> v1:172.21.15.37:6789/0 conn(0x7f82800b59d0 legacy=0x7f82800b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:22.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.820+0000 7f827f400640 1 -- 172.21.15.37:0/800640553 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82801428d0 con 0x7f828015d7e0 2024-05-30T06:51:22.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.824+0000 7f827f400640 1 --2- 172.21.15.37:0/800640553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f828015d7e0 0x7f828006e660 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8278009dc0 tx=0x7f827801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6e4848a2de4acdd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:22.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.824+0000 7f827e000640 1 -- 172.21.15.37:0/800640553 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82780b2070 con 0x7f828015d7e0 2024-05-30T06:51:22.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.824+0000 7f827e000640 1 -- 172.21.15.37:0/800640553 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82780a5920 con 0x7f828015d7e0 2024-05-30T06:51:22.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.824+0000 7f827e000640 1 -- 172.21.15.37:0/800640553 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82780a5cf0 con 0x7f828015d7e0 2024-05-30T06:51:22.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.824+0000 7f8285800640 1 -- 172.21.15.37:0/800640553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f828015d7e0 msgr2=0x7f828006e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:22.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.824+0000 7f8285800640 1 --2- 172.21.15.37:0/800640553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f828015d7e0 0x7f828006e660 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8278009dc0 tx=0x7f827801c950 comp rx=0 tx=0).stop 2024-05-30T06:51:22.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.824+0000 7f8285800640 1 -- 172.21.15.37:0/800640553 shutdown_connections 2024-05-30T06:51:22.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.824+0000 7f8285800640 1 --2- 172.21.15.37:0/800640553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f828015d7e0 0x7f828006e660 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:22.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.824+0000 7f8285800640 1 -- 172.21.15.37:0/800640553 >> 172.21.15.37:0/800640553 conn(0x7f828006bf60 msgr2=0x7f82800b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:22.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.824+0000 7f8285800640 1 -- 172.21.15.37:0/800640553 shutdown_connections 2024-05-30T06:51:22.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.824+0000 7f8285800640 1 -- 172.21.15.37:0/800640553 wait complete. 2024-05-30T06:51:22.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8285800640 1 Processor -- start 2024-05-30T06:51:22.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8285800640 1 -- start start 2024-05-30T06:51:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8285800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82800b59d0 0x7f828013a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8285800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f828015d350 0x7f8280152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8285800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828015d7e0 0x7f828015ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8285800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8280141d70 con 0x7f828015d7e0 2024-05-30T06:51:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8285800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8280141bf0 con 0x7f828015d350 2024-05-30T06:51:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8285800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f828016ae40 con 0x7f82800b59d0 2024-05-30T06:51:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f827f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828015d7e0 0x7f828015ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f827f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828015d7e0 0x7f828015ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42712/0 (socket says 172.21.15.37:42712) 2024-05-30T06:51:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f827f400640 1 -- 172.21.15.37:0/3126567308 learned_addr learned my addr 172.21.15.37:0/3126567308 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f827ea00640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82800b59d0 0x7f828013a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f827f400640 1 -- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82800b59d0 msgr2=0x7f828013a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:22.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f827f400640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82800b59d0 0x7f828013a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:22.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f827f400640 1 -- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f828015d350 msgr2=0x7f8280152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:22.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8277e00640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f828015d350 0x7f8280152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:22.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f827f400640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f828015d350 0x7f8280152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:22.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f827f400640 1 -- 172.21.15.37:0/3126567308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828013a920 con 0x7f828015d7e0 2024-05-30T06:51:22.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8277e00640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f828015d350 0x7f8280152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:51:22.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f827f400640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828015d7e0 0x7f828015ef00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f827801ce30 tx=0x7f82780196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:22.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8276a00640 1 -- 172.21.15.37:0/3126567308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82780b2050 con 0x7f828015d7e0 2024-05-30T06:51:22.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8276a00640 1 -- 172.21.15.37:0/3126567308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82780be070 con 0x7f828015d7e0 2024-05-30T06:51:22.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8276a00640 1 -- 172.21.15.37:0/3126567308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82780ad890 con 0x7f828015d7e0 2024-05-30T06:51:22.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8285800640 1 -- 172.21.15.37:0/3126567308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f828013ac00 con 0x7f828015d7e0 2024-05-30T06:51:22.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8285800640 1 -- 172.21.15.37:0/3126567308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f828013b1c0 con 0x7f828015d7e0 2024-05-30T06:51:22.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.828+0000 7f8285800640 1 -- 172.21.15.37:0/3126567308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8280068bc0 con 0x7f828015d7e0 2024-05-30T06:51:22.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.832+0000 7f8276a00640 1 -- 172.21.15.37:0/3126567308 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 89313+0+0 (secure 0 0 0) 0x7f82780ada30 con 0x7f828015d7e0 2024-05-30T06:51:22.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.832+0000 7f8276a00640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f825c069250 0x7f825c06b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:22.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.832+0000 7f8276a00640 1 -- 172.21.15.37:0/3126567308 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f8278120740 con 0x7f828015d7e0 2024-05-30T06:51:22.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.832+0000 7f827ea00640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f825c069250 0x7f825c06b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:22.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.832+0000 7f827ea00640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f825c069250 0x7f825c06b710 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8270000f70 tx=0x7f8270009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:22.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:22.836+0000 7f8276a00640 1 -- 172.21.15.37:0/3126567308 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8278016540 con 0x7f828015d7e0 2024-05-30T06:51:23.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.032+0000 7f8285800640 1 -- 172.21.15.37:0/3126567308 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone37102", "target": ["mon-mgr", ""]}) -- 0x7f828015ca70 con 0x7f825c069250 2024-05-30T06:51:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.388+0000 7f8276a00640 1 -- 172.21.15.37:0/3126567308 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 27) ==== 89415+0+0 (secure 0 0 0) 0x7f82780ee350 con 0x7f828015d7e0 2024-05-30T06:51:23.651 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:23.651+0000 7f0008400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:23.651 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:23.651+0000 7f0008400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:23.651 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:23.651+0000 7f0008400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:23.651 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:23.651+0000 7f0008400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:23.651 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:23.651+0000 7f0008400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.728+0000 7f8276a00640 1 -- 172.21.15.37:0/3126567308 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f828015ca70 con 0x7f825c069250 2024-05-30T06:51:23.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.732+0000 7f8285800640 1 -- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f825c069250 msgr2=0x7f825c06b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:23.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.732+0000 7f8285800640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f825c069250 0x7f825c06b710 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8270000f70 tx=0x7f8270009040 comp rx=0 tx=0).stop 2024-05-30T06:51:23.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.732+0000 7f8285800640 1 -- 172.21.15.37:0/3126567308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828015d7e0 msgr2=0x7f828015ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:23.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.732+0000 7f8285800640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828015d7e0 0x7f828015ef00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f827801ce30 tx=0x7f82780196f0 comp rx=0 tx=0).stop 2024-05-30T06:51:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.732+0000 7f8285800640 1 -- 172.21.15.37:0/3126567308 shutdown_connections 2024-05-30T06:51:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.732+0000 7f8285800640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828015d7e0 0x7f828015ef00 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.732+0000 7f8285800640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f825c069250 0x7f825c06b710 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.732+0000 7f8285800640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f828015d350 0x7f8280152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.732+0000 7f8285800640 1 --2- 172.21.15.37:0/3126567308 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82800b59d0 0x7f828013a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.732+0000 7f8285800640 1 -- 172.21.15.37:0/3126567308 >> 172.21.15.37:0/3126567308 conn(0x7f828006bf60 msgr2=0x7f828013ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.732+0000 7f8285800640 1 -- 172.21.15.37:0/3126567308 shutdown_connections 2024-05-30T06:51:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:23.732+0000 7f8285800640 1 -- 172.21.15.37:0/3126567308 wait complete. 2024-05-30T06:51:23.745 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:23.743+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:23.745 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:23.743+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:23.745 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:23.743+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:23.745 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:23.743+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:23.745 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:23.743+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:23.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone37103 2024-05-30T06:51:24.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.028+0000 7f50a3200640 1 Processor -- start 2024-05-30T06:51:24.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.028+0000 7f50a3200640 1 -- start start 2024-05-30T06:51:24.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.032+0000 7f50a3200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f509c0b59d0 0x7f509c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:24.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.032+0000 7f50a3200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f509c070000 0x7f509c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:24.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.032+0000 7f50a3200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f509c15f380 con 0x7f509c0b4ca0 2024-05-30T06:51:24.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.032+0000 7f50a3200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f509c15ff90 con 0x7f509c0b59d0 2024-05-30T06:51:24.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.032+0000 7f50a3200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f509c15f660 con 0x7f509c070000 2024-05-30T06:51:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.032+0000 7f509b400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f509c0b4ca0 0x7f509c06f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:52394/0 (socket says 172.21.15.37:52394) 2024-05-30T06:51:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.032+0000 7f509b400640 1 -- 172.21.15.37:0/635749683 learned_addr learned my addr 172.21.15.37:0/635749683 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:51:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.036+0000 7f509be00640 1 --2- 172.21.15.37:0/635749683 >> v2:172.21.15.105:3300/0 conn(0x7f509c0b59d0 0x7f509c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.032+0000 7f50a1200640 1 --2- 172.21.15.37:0/635749683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f509c070000 0x7f509c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:24.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.036+0000 7f509aa00640 1 -- 172.21.15.37:0/635749683 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2511602962 0 0) 0x7f509c15f380 con 0x7f509c0b4ca0 2024-05-30T06:51:24.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.036+0000 7f509aa00640 1 -- 172.21.15.37:0/635749683 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5080003530 con 0x7f509c0b4ca0 2024-05-30T06:51:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.036+0000 7f509be00640 1 -- 172.21.15.37:0/635749683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f509c070000 msgr2=0x7f509c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.036+0000 7f509be00640 1 --2- 172.21.15.37:0/635749683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f509c070000 0x7f509c0cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.036+0000 7f509be00640 1 -- 172.21.15.37:0/635749683 >> v1:172.21.15.105:6789/0 conn(0x7f509c0b4ca0 legacy=0x7f509c06f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.036+0000 7f509be00640 1 -- 172.21.15.37:0/635749683 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c15f940 con 0x7f509c0b59d0 2024-05-30T06:51:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.040+0000 7f509be00640 1 --2- 172.21.15.37:0/635749683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f509c0b59d0 0x7f509c0cd8a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f508c0097c0 tx=0x7f508c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16d723cf3183e190 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.040+0000 7f509aa00640 1 -- 172.21.15.37:0/635749683 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c0ab610 con 0x7f509c0b59d0 2024-05-30T06:51:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.040+0000 7f509aa00640 1 -- 172.21.15.37:0/635749683 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c0b0070 con 0x7f509c0b59d0 2024-05-30T06:51:24.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.040+0000 7f509aa00640 1 -- 172.21.15.37:0/635749683 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c0ab9d0 con 0x7f509c0b59d0 2024-05-30T06:51:24.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.044+0000 7f50a3200640 1 -- 172.21.15.37:0/635749683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f509c0b59d0 msgr2=0x7f509c0cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:24.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.044+0000 7f50a3200640 1 --2- 172.21.15.37:0/635749683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f509c0b59d0 0x7f509c0cd8a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f508c0097c0 tx=0x7f508c01c470 comp rx=0 tx=0).stop 2024-05-30T06:51:24.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.044+0000 7f50a3200640 1 -- 172.21.15.37:0/635749683 shutdown_connections 2024-05-30T06:51:24.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.044+0000 7f50a3200640 1 --2- 172.21.15.37:0/635749683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f509c070000 0x7f509c0cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:24.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.044+0000 7f50a3200640 1 --2- 172.21.15.37:0/635749683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f509c0b59d0 0x7f509c0cd8a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:24.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.044+0000 7f50a3200640 1 -- 172.21.15.37:0/635749683 >> 172.21.15.37:0/635749683 conn(0x7f509c0b23c0 msgr2=0x7f509c0b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:24.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.044+0000 7f50a3200640 1 -- 172.21.15.37:0/635749683 shutdown_connections 2024-05-30T06:51:24.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.044+0000 7f50a3200640 1 -- 172.21.15.37:0/635749683 wait complete. 2024-05-30T06:51:24.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.044+0000 7f50a3200640 1 Processor -- start 2024-05-30T06:51:24.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.044+0000 7f50a3200640 1 -- start start 2024-05-30T06:51:24.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f50a3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c070000 0x7f509c14c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:24.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f50a3200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f509c0b4ca0 0x7f509c169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:24.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f50a3200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f509c0b59d0 0x7f509c151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:24.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f50a3200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f509c06e960 con 0x7f509c070000 2024-05-30T06:51:24.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f50a3200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f509c06e7e0 con 0x7f509c0b59d0 2024-05-30T06:51:24.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f50a3200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f509c06eae0 con 0x7f509c0b4ca0 2024-05-30T06:51:24.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f509be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c070000 0x7f509c14c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:24.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f509be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c070000 0x7f509c14c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42718/0 (socket says 172.21.15.37:42718) 2024-05-30T06:51:24.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f509be00640 1 -- 172.21.15.37:0/3226705895 learned_addr learned my addr 172.21.15.37:0/3226705895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:24.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f50a1200640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f509c0b59d0 0x7f509c151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f509be00640 1 -- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f509c0b4ca0 msgr2=0x7f509c169900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f509be00640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f509c0b4ca0 0x7f509c169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f509be00640 1 -- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f509c0b59d0 msgr2=0x7f509c151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f509be00640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f509c0b59d0 0x7f509c151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f509be00640 1 -- 172.21.15.37:0/3226705895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c14c8a0 con 0x7f509c070000 2024-05-30T06:51:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.048+0000 7f50a1200640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f509c0b59d0 0x7f509c151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:51:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.052+0000 7f509be00640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c070000 0x7f509c14c360 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f508c01a0a0 tx=0x7f508c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.052+0000 7f5093e00640 1 -- 172.21.15.37:0/3226705895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c0bf410 con 0x7f509c070000 2024-05-30T06:51:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.052+0000 7f5093e00640 1 -- 172.21.15.37:0/3226705895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c0bf5d0 con 0x7f509c070000 2024-05-30T06:51:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.052+0000 7f5093e00640 1 -- 172.21.15.37:0/3226705895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c0bf9c0 con 0x7f509c070000 2024-05-30T06:51:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.052+0000 7f50a3200640 1 -- 172.21.15.37:0/3226705895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509c16cc20 con 0x7f509c070000 2024-05-30T06:51:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.052+0000 7f50a3200640 1 -- 172.21.15.37:0/3226705895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509c16d1e0 con 0x7f509c070000 2024-05-30T06:51:24.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.052+0000 7f50a3200640 1 -- 172.21.15.37:0/3226705895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f509c068bc0 con 0x7f509c070000 2024-05-30T06:51:24.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.052+0000 7f5093e00640 1 -- 172.21.15.37:0/3226705895 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 27) ==== 89415+0+0 (secure 0 0 0) 0x7f508c0bd020 con 0x7f509c070000 2024-05-30T06:51:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.056+0000 7f5093e00640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f507c069390 0x7f507c06b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.056+0000 7f5093e00640 1 -- 172.21.15.37:0/3226705895 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f508c1200d0 con 0x7f509c070000 2024-05-30T06:51:24.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.056+0000 7f509b400640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f507c069390 0x7f507c06b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.064+0000 7f5093e00640 1 -- 172.21.15.37:0/3226705895 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f508c0c4060 con 0x7f509c070000 2024-05-30T06:51:24.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.100+0000 7f509b400640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f507c069390 0x7f507c06b850 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5088007fd0 tx=0x7f5088007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:24.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.392+0000 7f50a3200640 1 -- 172.21.15.37:0/3226705895 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone37103", "target": ["mon-mgr", ""]}) -- 0x7f509c06e4c0 con 0x7f507c069390 2024-05-30T06:51:24.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.920+0000 7f5093e00640 1 -- 172.21.15.37:0/3226705895 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f509c06e4c0 con 0x7f507c069390 2024-05-30T06:51:24.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.924+0000 7f50a3200640 1 -- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f507c069390 msgr2=0x7f507c06b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:24.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.924+0000 7f50a3200640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f507c069390 0x7f507c06b850 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5088007fd0 tx=0x7f5088007900 comp rx=0 tx=0).stop 2024-05-30T06:51:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.924+0000 7f50a3200640 1 -- 172.21.15.37:0/3226705895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c070000 msgr2=0x7f509c14c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.924+0000 7f50a3200640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c070000 0x7f509c14c360 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f508c01a0a0 tx=0x7f508c01acb0 comp rx=0 tx=0).stop 2024-05-30T06:51:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.924+0000 7f50a3200640 1 -- 172.21.15.37:0/3226705895 shutdown_connections 2024-05-30T06:51:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.924+0000 7f50a3200640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f507c069390 0x7f507c06b850 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.924+0000 7f50a3200640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f509c0b59d0 0x7f509c151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.924+0000 7f50a3200640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f509c0b4ca0 0x7f509c169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.924+0000 7f50a3200640 1 --2- 172.21.15.37:0/3226705895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f509c070000 0x7f509c14c360 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.924+0000 7f50a3200640 1 -- 172.21.15.37:0/3226705895 >> 172.21.15.37:0/3226705895 conn(0x7f509c0b23c0 msgr2=0x7f509c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.924+0000 7f50a3200640 1 -- 172.21.15.37:0/3226705895 shutdown_connections 2024-05-30T06:51:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:24.924+0000 7f50a3200640 1 -- 172.21.15.37:0/3226705895 wait complete. 2024-05-30T06:51:24.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone37104 2024-05-30T06:51:25.022 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:25.023+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:25.022 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:25.023+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:25.022 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:25.023+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:25.023 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:25.023+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:25.023 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:51:25.023+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:51:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.200+0000 7f8bb4000640 1 Processor -- start 2024-05-30T06:51:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.200+0000 7f8bb4000640 1 -- start start 2024-05-30T06:51:25.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.204+0000 7f8bb4000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bac0b59d0 0x7f8bac0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.204+0000 7f8bb4000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bac15d350 0x7f8bac160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.204+0000 7f8bb4000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bac0b62f0 con 0x7f8bac15d7b0 2024-05-30T06:51:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.204+0000 7f8bb4000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8bac142030 con 0x7f8bac0b59d0 2024-05-30T06:51:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.204+0000 7f8bb4000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8bac142310 con 0x7f8bac15d350 2024-05-30T06:51:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.204+0000 7f8bb1600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bac0b59d0 0x7f8bac0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.204+0000 7f8bb1600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bac0b59d0 0x7f8bac0b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42720/0 (socket says 172.21.15.37:42720) 2024-05-30T06:51:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.204+0000 7f8bb1600640 1 -- 172.21.15.37:0/2071406027 learned_addr learned my addr 172.21.15.37:0/2071406027 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:25.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.204+0000 7f8bb1600640 1 -- 172.21.15.37:0/2071406027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bac15d350 msgr2=0x7f8bac160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:25.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.204+0000 7f8bb1600640 1 --2- 172.21.15.37:0/2071406027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bac15d350 0x7f8bac160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:25.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.204+0000 7f8bb1600640 1 -- 172.21.15.37:0/2071406027 >> v1:172.21.15.105:6789/0 conn(0x7f8bac15d7b0 legacy=0x7f8bac1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:25.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.204+0000 7f8bb1600640 1 -- 172.21.15.37:0/2071406027 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bac1425f0 con 0x7f8bac0b59d0 2024-05-30T06:51:25.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.212+0000 7f8bb1600640 1 --2- 172.21.15.37:0/2071406027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bac0b59d0 0x7f8bac0b5db0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009870 tx=0x7f8ba001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4308cd22e309d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:25.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.212+0000 7f8babe00640 1 -- 172.21.15.37:0/2071406027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba00b5070 con 0x7f8bac0b59d0 2024-05-30T06:51:25.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.212+0000 7f8babe00640 1 -- 172.21.15.37:0/2071406027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba00a89d0 con 0x7f8bac0b59d0 2024-05-30T06:51:25.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.212+0000 7f8babe00640 1 -- 172.21.15.37:0/2071406027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba00a8da0 con 0x7f8bac0b59d0 2024-05-30T06:51:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.212+0000 7f8bb4000640 1 -- 172.21.15.37:0/2071406027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bac0b59d0 msgr2=0x7f8bac0b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.212+0000 7f8bb4000640 1 --2- 172.21.15.37:0/2071406027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bac0b59d0 0x7f8bac0b5db0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0009870 tx=0x7f8ba001ed10 comp rx=0 tx=0).stop 2024-05-30T06:51:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.212+0000 7f8bb4000640 1 -- 172.21.15.37:0/2071406027 shutdown_connections 2024-05-30T06:51:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.212+0000 7f8bb4000640 1 --2- 172.21.15.37:0/2071406027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bac15d350 0x7f8bac160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.212+0000 7f8bb4000640 1 --2- 172.21.15.37:0/2071406027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bac0b59d0 0x7f8bac0b5db0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.212+0000 7f8bb4000640 1 -- 172.21.15.37:0/2071406027 >> 172.21.15.37:0/2071406027 conn(0x7f8bac06bf60 msgr2=0x7f8bac0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.212+0000 7f8bb4000640 1 -- 172.21.15.37:0/2071406027 shutdown_connections 2024-05-30T06:51:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.212+0000 7f8bb4000640 1 -- 172.21.15.37:0/2071406027 wait complete. 2024-05-30T06:51:25.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb4000640 1 Processor -- start 2024-05-30T06:51:25.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb4000640 1 -- start start 2024-05-30T06:51:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb4000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bac0b59d0 0x7f8bac1560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb4000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bac15d350 0x7f8bac1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:25.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb4000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bac15d7b0 0x7f8bac13b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:25.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb4000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac13fe60 con 0x7f8bac0b59d0 2024-05-30T06:51:25.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb4000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac13fce0 con 0x7f8bac15d7b0 2024-05-30T06:51:25.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb4000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8bac0aff20 con 0x7f8bac15d350 2024-05-30T06:51:25.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb1600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bac0b59d0 0x7f8bac1560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:25.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb1600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bac0b59d0 0x7f8bac1560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42722/0 (socket says 172.21.15.37:42722) 2024-05-30T06:51:25.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb1600640 1 -- 172.21.15.37:0/4020122625 learned_addr learned my addr 172.21.15.37:0/4020122625 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:25.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb1600640 1 -- 172.21.15.37:0/4020122625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bac15d350 msgr2=0x7f8bac1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:25.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb1600640 1 --2- 172.21.15.37:0/4020122625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bac15d350 0x7f8bac1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:25.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb1600640 1 -- 172.21.15.37:0/4020122625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bac15d7b0 msgr2=0x7f8bac13b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:25.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb1600640 1 --2- 172.21.15.37:0/4020122625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bac15d7b0 0x7f8bac13b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:25.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.216+0000 7f8bb1600640 1 -- 172.21.15.37:0/4020122625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bac154710 con 0x7f8bac0b59d0 2024-05-30T06:51:25.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.220+0000 7f8bb1600640 1 --2- 172.21.15.37:0/4020122625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bac0b59d0 0x7f8bac1560b0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00b3040 tx=0x7f8ba001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.220+0000 7f8ba9600640 1 -- 172.21.15.37:0/4020122625 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba00c0070 con 0x7f8bac0b59d0 2024-05-30T06:51:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.220+0000 7f8ba9600640 1 -- 172.21.15.37:0/4020122625 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba00b08f0 con 0x7f8bac0b59d0 2024-05-30T06:51:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.220+0000 7f8bb4000640 1 -- 172.21.15.37:0/4020122625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bac13c240 con 0x7f8bac0b59d0 2024-05-30T06:51:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.220+0000 7f8bb4000640 1 -- 172.21.15.37:0/4020122625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bac13c800 con 0x7f8bac0b59d0 2024-05-30T06:51:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.220+0000 7f8ba9600640 1 -- 172.21.15.37:0/4020122625 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba00b5040 con 0x7f8bac0b59d0 2024-05-30T06:51:25.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.220+0000 7f8bb4000640 1 -- 172.21.15.37:0/4020122625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bac068bc0 con 0x7f8bac0b59d0 2024-05-30T06:51:25.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.224+0000 7f8ba9600640 1 -- 172.21.15.37:0/4020122625 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 27) ==== 89415+0+0 (secure 0 0 0) 0x7f8ba00c3070 con 0x7f8bac0b59d0 2024-05-30T06:51:25.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.224+0000 7f8ba9600640 1 --2- 172.21.15.37:0/4020122625 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b8c069370 0x7f8b8c06b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:25.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.224+0000 7f8ba9600640 1 -- 172.21.15.37:0/4020122625 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f8ba0122610 con 0x7f8bac0b59d0 2024-05-30T06:51:25.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.224+0000 7f8bb0c00640 1 --2- 172.21.15.37:0/4020122625 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b8c069370 0x7f8b8c06b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:25.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.228+0000 7f8bb0c00640 1 --2- 172.21.15.37:0/4020122625 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b8c069370 0x7f8b8c06b830 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8bac1f6040 tx=0x7f8b98006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:25.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.228+0000 7f8ba9600640 1 -- 172.21.15.37:0/4020122625 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8ba0018870 con 0x7f8bac0b59d0 2024-05-30T06:51:25.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.428+0000 7f8ba9600640 1 -- 172.21.15.37:0/4020122625 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 28) ==== 89517+0+0 (secure 0 0 0) 0x7f8ba00b0ce0 con 0x7f8bac0b59d0 2024-05-30T06:51:25.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:25.536+0000 7f8bb4000640 1 -- 172.21.15.37:0/4020122625 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone37104", "target": ["mon-mgr", ""]}) -- 0x7f8bac13b700 con 0x7f8b8c069370 2024-05-30T06:51:26.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.196+0000 7f8ba9600640 1 -- 172.21.15.37:0/4020122625 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8bac13b700 con 0x7f8b8c069370 2024-05-30T06:51:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.200+0000 7f8bb4000640 1 -- 172.21.15.37:0/4020122625 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b8c069370 msgr2=0x7f8b8c06b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.200+0000 7f8bb4000640 1 --2- 172.21.15.37:0/4020122625 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b8c069370 0x7f8b8c06b830 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8bac1f6040 tx=0x7f8b98006ca0 comp rx=0 tx=0).stop 2024-05-30T06:51:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.200+0000 7f8bb4000640 1 -- 172.21.15.37:0/4020122625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bac0b59d0 msgr2=0x7f8bac1560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.200+0000 7f8bb4000640 1 --2- 172.21.15.37:0/4020122625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bac0b59d0 0x7f8bac1560b0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00b3040 tx=0x7f8ba001bab0 comp rx=0 tx=0).stop 2024-05-30T06:51:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.200+0000 7f8bb4000640 1 -- 172.21.15.37:0/4020122625 shutdown_connections 2024-05-30T06:51:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.200+0000 7f8bb4000640 1 --2- 172.21.15.37:0/4020122625 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b8c069370 0x7f8b8c06b830 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.200+0000 7f8bb4000640 1 --2- 172.21.15.37:0/4020122625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bac15d7b0 0x7f8bac13b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.200+0000 7f8bb4000640 1 --2- 172.21.15.37:0/4020122625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bac15d350 0x7f8bac1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.200+0000 7f8bb4000640 1 --2- 172.21.15.37:0/4020122625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bac0b59d0 0x7f8bac1560b0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.200+0000 7f8bb4000640 1 -- 172.21.15.37:0/4020122625 >> 172.21.15.37:0/4020122625 conn(0x7f8bac06bf60 msgr2=0x7f8bac15cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.200+0000 7f8bb4000640 1 -- 172.21.15.37:0/4020122625 shutdown_connections 2024-05-30T06:51:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.204+0000 7f8bb4000640 1 -- 172.21.15.37:0/4020122625 wait complete. 2024-05-30T06:51:26.245 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone37105 2024-05-30T06:51:26.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.520+0000 7fbdcfa00640 1 Processor -- start 2024-05-30T06:51:26.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.520+0000 7fbdcfa00640 1 -- start start 2024-05-30T06:51:26.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.524+0000 7fbdcfa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbdc809b800 0x7fbdc806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:26.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.524+0000 7fbdcfa00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbdc806dcf0 0x7fbdc809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:26.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.524+0000 7fbdcfa00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc80d0840 con 0x7fbdc815ebc0 2024-05-30T06:51:26.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.524+0000 7fbdcfa00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc809bce0 con 0x7fbdc809b800 2024-05-30T06:51:26.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.524+0000 7fbdcfa00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc80d0ae0 con 0x7fbdc806dcf0 2024-05-30T06:51:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.524+0000 7fbdc7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbdc809b800 0x7fbdc806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.524+0000 7fbdc7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbdc809b800 0x7fbdc806d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42730/0 (socket says 172.21.15.37:42730) 2024-05-30T06:51:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.524+0000 7fbdc7e00640 1 -- 172.21.15.37:0/1346455287 learned_addr learned my addr 172.21.15.37:0/1346455287 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.524+0000 7fbdcda00640 1 --2- 172.21.15.37:0/1346455287 >> v2:172.21.15.105:3300/0 conn(0x7fbdc806dcf0 0x7fbdc809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.524+0000 7fbdc7e00640 1 -- 172.21.15.37:0/1346455287 >> v2:172.21.15.105:3300/0 conn(0x7fbdc806dcf0 msgr2=0x7fbdc809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.524+0000 7fbdc7e00640 1 --2- 172.21.15.37:0/1346455287 >> v2:172.21.15.105:3300/0 conn(0x7fbdc806dcf0 0x7fbdc809aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.524+0000 7fbdc7e00640 1 -- 172.21.15.37:0/1346455287 >> v1:172.21.15.105:6789/0 conn(0x7fbdc815ebc0 legacy=0x7fbdc80d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.524+0000 7fbdc7e00640 1 -- 172.21.15.37:0/1346455287 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc80d0dc0 con 0x7fbdc809b800 2024-05-30T06:51:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.528+0000 7fbdc7e00640 1 --2- 172.21.15.37:0/1346455287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdc809b800 0x7fbdc806d7b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80cefa0 tx=0x7fbdb401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6db21717d788ea8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.528+0000 7fbdc7400640 1 -- 172.21.15.37:0/1346455287 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40b0070 con 0x7fbdc809b800 2024-05-30T06:51:26.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.528+0000 7fbdc7400640 1 -- 172.21.15.37:0/1346455287 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb40ab600 con 0x7fbdc809b800 2024-05-30T06:51:26.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.528+0000 7fbdc7400640 1 -- 172.21.15.37:0/1346455287 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40ab9d0 con 0x7fbdc809b800 2024-05-30T06:51:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.528+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1346455287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdc809b800 msgr2=0x7fbdc806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.528+0000 7fbdcfa00640 1 --2- 172.21.15.37:0/1346455287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdc809b800 0x7fbdc806d7b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80cefa0 tx=0x7fbdb401c4e0 comp rx=0 tx=0).stop 2024-05-30T06:51:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.532+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1346455287 shutdown_connections 2024-05-30T06:51:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.532+0000 7fbdcfa00640 1 --2- 172.21.15.37:0/1346455287 >> v2:172.21.15.105:3300/0 conn(0x7fbdc806dcf0 0x7fbdc809aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.532+0000 7fbdcfa00640 1 --2- 172.21.15.37:0/1346455287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdc809b800 0x7fbdc806d7b0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.532+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1346455287 >> 172.21.15.37:0/1346455287 conn(0x7fbdc80b4060 msgr2=0x7fbdc80b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.532+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1346455287 shutdown_connections 2024-05-30T06:51:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.532+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1346455287 wait complete. 2024-05-30T06:51:26.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.532+0000 7fbdcfa00640 1 Processor -- start 2024-05-30T06:51:26.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.532+0000 7fbdcfa00640 1 -- start start 2024-05-30T06:51:26.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdcfa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbdc806dcf0 0x7fbdc8158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:26.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdcfa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdc809b800 0x7fbdc815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:26.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdcfa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc815ebc0 0x7fbdc8156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:26.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdcfa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc809b3b0 con 0x7fbdc809b800 2024-05-30T06:51:26.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdcfa00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc80cd5e0 con 0x7fbdc806dcf0 2024-05-30T06:51:26.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdcfa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc816ba70 con 0x7fbdc815ebc0 2024-05-30T06:51:26.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdc7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdc809b800 0x7fbdc815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:26.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdc7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdc809b800 0x7fbdc815a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42734/0 (socket says 172.21.15.37:42734) 2024-05-30T06:51:26.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdc7e00640 1 -- 172.21.15.37:0/1381223675 learned_addr learned my addr 172.21.15.37:0/1381223675 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdc7e00640 1 -- 172.21.15.37:0/1381223675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc815ebc0 msgr2=0x7fbdc8156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdc7e00640 1 --2- 172.21.15.37:0/1381223675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc815ebc0 0x7fbdc8156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdc7e00640 1 -- 172.21.15.37:0/1381223675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbdc806dcf0 msgr2=0x7fbdc8158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdc7e00640 1 --2- 172.21.15.37:0/1381223675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbdc806dcf0 0x7fbdc8158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdc7e00640 1 -- 172.21.15.37:0/1381223675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc815da30 con 0x7fbdc809b800 2024-05-30T06:51:26.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdc7e00640 1 --2- 172.21.15.37:0/1381223675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdc809b800 0x7fbdc815a940 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fbdb401a110 tx=0x7fbdb4019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdc4c00640 1 -- 172.21.15.37:0/1381223675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40b0040 con 0x7fbdc809b800 2024-05-30T06:51:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdc4c00640 1 -- 172.21.15.37:0/1381223675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb40b4620 con 0x7fbdc809b800 2024-05-30T06:51:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdc4c00640 1 -- 172.21.15.37:0/1381223675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40b4a10 con 0x7fbdc809b800 2024-05-30T06:51:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1381223675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc815ae80 con 0x7fbdc809b800 2024-05-30T06:51:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.536+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1381223675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc815dcd0 con 0x7fbdc809b800 2024-05-30T06:51:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.540+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1381223675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc8068bc0 con 0x7fbdc809b800 2024-05-30T06:51:26.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.540+0000 7fbdc4c00640 1 -- 172.21.15.37:0/1381223675 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 28) ==== 89517+0+0 (secure 0 0 0) 0x7fbdb40ab4c0 con 0x7fbdc809b800 2024-05-30T06:51:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.540+0000 7fbdc4c00640 1 --2- 172.21.15.37:0/1381223675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbda8069460 0x7fbda806b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:26.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.544+0000 7fbdc4c00640 1 -- 172.21.15.37:0/1381223675 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fbdb411f4c0 con 0x7fbdc809b800 2024-05-30T06:51:26.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.548+0000 7fbdcd000640 1 --2- 172.21.15.37:0/1381223675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbda8069460 0x7fbda806b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:26.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.548+0000 7fbdc4c00640 1 -- 172.21.15.37:0/1381223675 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbdb40160d0 con 0x7fbdc809b800 2024-05-30T06:51:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.552+0000 7fbdcd000640 1 --2- 172.21.15.37:0/1381223675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbda8069460 0x7fbda806b920 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc007fd0 tx=0x7fbdbc0079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:26.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:26.904+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1381223675 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone37105", "target": ["mon-mgr", ""]}) -- 0x7fbdc8157db0 con 0x7fbda8069460 2024-05-30T06:51:27.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.596+0000 7fbdc4c00640 1 -- 172.21.15.37:0/1381223675 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbdc8157db0 con 0x7fbda8069460 2024-05-30T06:51:27.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.596+0000 7fbdc4c00640 1 -- 172.21.15.37:0/1381223675 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7fbdb40ed160 con 0x7fbdc809b800 2024-05-30T06:51:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.600+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1381223675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbda8069460 msgr2=0x7fbda806b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.600+0000 7fbdcfa00640 1 --2- 172.21.15.37:0/1381223675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbda8069460 0x7fbda806b920 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc007fd0 tx=0x7fbdbc0079a0 comp rx=0 tx=0).stop 2024-05-30T06:51:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.600+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1381223675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdc809b800 msgr2=0x7fbdc815a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.600+0000 7fbdcfa00640 1 --2- 172.21.15.37:0/1381223675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdc809b800 0x7fbdc815a940 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fbdb401a110 tx=0x7fbdb4019280 comp rx=0 tx=0).stop 2024-05-30T06:51:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.600+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1381223675 shutdown_connections 2024-05-30T06:51:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.600+0000 7fbdcfa00640 1 --2- 172.21.15.37:0/1381223675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdc815ebc0 0x7fbdc8156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.600+0000 7fbdcfa00640 1 --2- 172.21.15.37:0/1381223675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdc809b800 0x7fbdc815a940 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.600+0000 7fbdcfa00640 1 --2- 172.21.15.37:0/1381223675 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbda8069460 0x7fbda806b920 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:27.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.600+0000 7fbdcfa00640 1 --2- 172.21.15.37:0/1381223675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbdc806dcf0 0x7fbdc8158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:27.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.600+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1381223675 >> 172.21.15.37:0/1381223675 conn(0x7fbdc80b4060 msgr2=0x7fbdc81582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:27.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.600+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1381223675 shutdown_connections 2024-05-30T06:51:27.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.600+0000 7fbdcfa00640 1 -- 172.21.15.37:0/1381223675 wait complete. 2024-05-30T06:51:27.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:51:27.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.900+0000 7fbd9de00640 1 Processor -- start 2024-05-30T06:51:27.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.900+0000 7fbd9de00640 1 -- start start 2024-05-30T06:51:27.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.904+0000 7fbd9de00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbd980b2e20 0x7fbd98160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:27.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.904+0000 7fbd9de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd981609c0 0x7fbd98160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:27.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.904+0000 7fbd9de00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd980d0430 con 0x7fbd980cd280 2024-05-30T06:51:27.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.904+0000 7fbd9de00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbd980b3200 con 0x7fbd980b2e20 2024-05-30T06:51:27.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.904+0000 7fbd9de00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd980d01e0 con 0x7fbd981609c0 2024-05-30T06:51:27.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.904+0000 7fbd96000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd981609c0 0x7fbd98160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:27.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.904+0000 7fbd96000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd981609c0 0x7fbd98160e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:35712/0 (socket says 172.21.15.37:35712) 2024-05-30T06:51:27.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.904+0000 7fbd96000640 1 -- 172.21.15.37:0/2136004757 learned_addr learned my addr 172.21.15.37:0/2136004757 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:27.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.904+0000 7fbd96000640 1 -- 172.21.15.37:0/2136004757 >> v2:172.21.15.105:3300/0 conn(0x7fbd980b2e20 msgr2=0x7fbd98160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:27.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.904+0000 7fbd96000640 1 --2- 172.21.15.37:0/2136004757 >> v2:172.21.15.105:3300/0 conn(0x7fbd980b2e20 0x7fbd98160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:27.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.904+0000 7fbd96000640 1 -- 172.21.15.37:0/2136004757 >> v1:172.21.15.105:6789/0 conn(0x7fbd980cd280 legacy=0x7fbd980cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:27.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.904+0000 7fbd96000640 1 -- 172.21.15.37:0/2136004757 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd980d0710 con 0x7fbd981609c0 2024-05-30T06:51:27.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.908+0000 7fbd96000640 1 --2- 172.21.15.37:0/2136004757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd981609c0 0x7fbd98160e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbd800098a0 tx=0x7fbd8001c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d69a32497051925d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:27.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.916+0000 7fbd95600640 1 -- 172.21.15.37:0/2136004757 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd800b1070 con 0x7fbd981609c0 2024-05-30T06:51:27.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.916+0000 7fbd95600640 1 -- 172.21.15.37:0/2136004757 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd800ac410 con 0x7fbd981609c0 2024-05-30T06:51:27.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.916+0000 7fbd95600640 1 -- 172.21.15.37:0/2136004757 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd800ac7e0 con 0x7fbd981609c0 2024-05-30T06:51:27.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.916+0000 7fbd9de00640 1 -- 172.21.15.37:0/2136004757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd981609c0 msgr2=0x7fbd98160e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:27.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.916+0000 7fbd9de00640 1 --2- 172.21.15.37:0/2136004757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd981609c0 0x7fbd98160e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbd800098a0 tx=0x7fbd8001c500 comp rx=0 tx=0).stop 2024-05-30T06:51:27.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.916+0000 7fbd9de00640 1 -- 172.21.15.37:0/2136004757 shutdown_connections 2024-05-30T06:51:27.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.916+0000 7fbd9de00640 1 --2- 172.21.15.37:0/2136004757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd981609c0 0x7fbd98160e20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:27.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.916+0000 7fbd9de00640 1 --2- 172.21.15.37:0/2136004757 >> v2:172.21.15.105:3300/0 conn(0x7fbd980b2e20 0x7fbd98160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:27.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.916+0000 7fbd9de00640 1 -- 172.21.15.37:0/2136004757 >> 172.21.15.37:0/2136004757 conn(0x7fbd980b4100 msgr2=0x7fbd980b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:27.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.916+0000 7fbd9de00640 1 -- 172.21.15.37:0/2136004757 shutdown_connections 2024-05-30T06:51:27.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.916+0000 7fbd9de00640 1 -- 172.21.15.37:0/2136004757 wait complete. 2024-05-30T06:51:27.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd9de00640 1 Processor -- start 2024-05-30T06:51:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd9de00640 1 -- start start 2024-05-30T06:51:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd9de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd980b2e20 0x7fbd980b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd9de00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd980cd280 0x7fbd9815c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd9de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd981609c0 0x7fbd9815c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd9de00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd98169940 con 0x7fbd980b2e20 2024-05-30T06:51:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd9de00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbd981697c0 con 0x7fbd980cd280 2024-05-30T06:51:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd9de00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbd98169ac0 con 0x7fbd981609c0 2024-05-30T06:51:27.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd96a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd980b2e20 0x7fbd980b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:27.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd96a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd980b2e20 0x7fbd980b7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32870/0 (socket says 172.21.15.37:32870) 2024-05-30T06:51:27.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd96a00640 1 -- 172.21.15.37:0/2291484103 learned_addr learned my addr 172.21.15.37:0/2291484103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:27.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd96a00640 1 -- 172.21.15.37:0/2291484103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd981609c0 msgr2=0x7fbd9815c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:27.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd96a00640 1 --2- 172.21.15.37:0/2291484103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd981609c0 0x7fbd9815c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:27.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd96a00640 1 -- 172.21.15.37:0/2291484103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd980cd280 msgr2=0x7fbd9815c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:27.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd96a00640 1 --2- 172.21.15.37:0/2291484103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd980cd280 0x7fbd9815c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:27.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.920+0000 7fbd96a00640 1 -- 172.21.15.37:0/2291484103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9806e900 con 0x7fbd980b2e20 2024-05-30T06:51:27.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.924+0000 7fbd96a00640 1 --2- 172.21.15.37:0/2291484103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd980b2e20 0x7fbd980b7d60 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000ba80 tx=0x7fbd9000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:27.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.924+0000 7fbd8f400640 1 -- 172.21.15.37:0/2291484103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd90019070 con 0x7fbd980b2e20 2024-05-30T06:51:27.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.924+0000 7fbd8f400640 1 -- 172.21.15.37:0/2291484103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd9000cc20 con 0x7fbd980b2e20 2024-05-30T06:51:27.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.924+0000 7fbd8f400640 1 -- 172.21.15.37:0/2291484103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd90014440 con 0x7fbd980b2e20 2024-05-30T06:51:27.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.924+0000 7fbd9de00640 1 -- 172.21.15.37:0/2291484103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9815d840 con 0x7fbd980b2e20 2024-05-30T06:51:27.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.924+0000 7fbd9de00640 1 -- 172.21.15.37:0/2291484103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd9806e340 con 0x7fbd980b2e20 2024-05-30T06:51:27.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.924+0000 7fbd9de00640 1 -- 172.21.15.37:0/2291484103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd9815da10 con 0x7fbd980b2e20 2024-05-30T06:51:27.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.924+0000 7fbd8f400640 1 -- 172.21.15.37:0/2291484103 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7fbd9001c070 con 0x7fbd980b2e20 2024-05-30T06:51:27.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.928+0000 7fbd8f400640 1 --2- 172.21.15.37:0/2291484103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd74069520 0x7fbd7406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:27.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.928+0000 7fbd8f400640 1 -- 172.21.15.37:0/2291484103 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fbd90085680 con 0x7fbd980b2e20 2024-05-30T06:51:27.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.936+0000 7fbd8f400640 1 -- 172.21.15.37:0/2291484103 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbd90057320 con 0x7fbd980b2e20 2024-05-30T06:51:27.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.948+0000 7fbd96000640 1 --2- 172.21.15.37:0/2291484103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd74069520 0x7fbd7406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:27.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:27.976+0000 7fbd96000640 1 --2- 172.21.15.37:0/2291484103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd74069520 0x7fbd7406b9e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbd800ae000 tx=0x7fbd80004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:28.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd9de00640 1 -- 172.21.15.37:0/2291484103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fbd98068b20 con 0x7fbd980b2e20 2024-05-30T06:51:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd8f400640 1 -- 172.21.15.37:0/2291484103 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2134 (secure 0 0 0) 0x7fbd90056c20 con 0x7fbd980b2e20 2024-05-30T06:51:28.277 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:51:28.277 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:51:28.277 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:51:28.277 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:51:28.277 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:51:28.278 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:28.279 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 582, 2024-05-30T06:51:28.279 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:51:28.279 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:51:28.279 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:51:28.279 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:51:28.279 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:28.279 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:51:28.279 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:51:28.279 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:51:28.279 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:51:28.279 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:51:28.279 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:51:28.280 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:51:28.280 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:51:28.280 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:28.280 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:51:28.280 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:51:28.280 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:51:28.280 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:51:28.280 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:51:28.280 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:28.280 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:28.280 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:51:28.280 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:51:28.281 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 806, 2024-05-30T06:51:28.281 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 3251523815, 2024-05-30T06:51:28.281 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 6901657600, 2024-05-30T06:51:28.281 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 766192455680, 2024-05-30T06:51:28.281 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:51:28.281 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 6639476, 2024-05-30T06:51:28.281 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 47887170, 2024-05-30T06:51:28.281 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 1, 2024-05-30T06:51:28.281 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 15 2024-05-30T06:51:28.281 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:28.281 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:51:28.281 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:51:28.281 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:51:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:51:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:51:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:51:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:51:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:51:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:51:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:51:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:51:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:51:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:51:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:51:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:51:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:51:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:51:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:51:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:51:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:51:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:51:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:51:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:51:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 10, 2024-05-30T06:51:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:49:42.776273+0000", 2024-05-30T06:51:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:51:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:51:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:51:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "2 ongoing clones; Avg progress is 14.713% (1s)\n [====........................] (remaining: 10s)", 2024-05-30T06:51:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.14712999761104584, 2024-05-30T06:51:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:51:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:28.284 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:51:28.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd9de00640 1 -- 172.21.15.37:0/2291484103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd74069520 msgr2=0x7fbd7406b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:28.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd9de00640 1 --2- 172.21.15.37:0/2291484103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd74069520 0x7fbd7406b9e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbd800ae000 tx=0x7fbd80004740 comp rx=0 tx=0).stop 2024-05-30T06:51:28.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd9de00640 1 -- 172.21.15.37:0/2291484103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd980b2e20 msgr2=0x7fbd980b7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:28.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd9de00640 1 --2- 172.21.15.37:0/2291484103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd980b2e20 0x7fbd980b7d60 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000ba80 tx=0x7fbd9000bf40 comp rx=0 tx=0).stop 2024-05-30T06:51:28.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd9de00640 1 -- 172.21.15.37:0/2291484103 shutdown_connections 2024-05-30T06:51:28.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd9de00640 1 --2- 172.21.15.37:0/2291484103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbd981609c0 0x7fbd9815c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:28.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd9de00640 1 --2- 172.21.15.37:0/2291484103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbd74069520 0x7fbd7406b9e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:28.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd9de00640 1 --2- 172.21.15.37:0/2291484103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbd980cd280 0x7fbd9815c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:28.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd9de00640 1 --2- 172.21.15.37:0/2291484103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd980b2e20 0x7fbd980b7d60 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:28.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd9de00640 1 -- 172.21.15.37:0/2291484103 >> 172.21.15.37:0/2291484103 conn(0x7fbd980b4100 msgr2=0x7fbd98074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:28.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd9de00640 1 -- 172.21.15.37:0/2291484103 shutdown_connections 2024-05-30T06:51:28.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:28.276+0000 7fbd9de00640 1 -- 172.21.15.37:0/2291484103 wait complete. 2024-05-30T06:51:29.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:51:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.524+0000 7f344f800640 1 Processor -- start 2024-05-30T06:51:29.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.524+0000 7f344f800640 1 -- start start 2024-05-30T06:51:29.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.528+0000 7f344f800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34480ce8d0 0x7f34480ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:29.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.528+0000 7f344f800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34480cd120 con 0x7f344815cd80 2024-05-30T06:51:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.528+0000 7f344f800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34480cd400 con 0x7f344806e000 2024-05-30T06:51:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.528+0000 7f344f800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f34480a9530 con 0x7f34480ce8d0 2024-05-30T06:51:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.528+0000 7f344d800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34480ce8d0 0x7f34480ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.528+0000 7f344d800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34480ce8d0 0x7f34480ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32886/0 (socket says 172.21.15.37:32886) 2024-05-30T06:51:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.528+0000 7f344d800640 1 -- 172.21.15.37:0/3328378233 learned_addr learned my addr 172.21.15.37:0/3328378233 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:29.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.528+0000 7f344d800640 1 -- 172.21.15.37:0/3328378233 >> v1:172.21.15.105:6789/0 conn(0x7f344806e000 legacy=0x7f34480ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:29.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.528+0000 7f344d800640 1 -- 172.21.15.37:0/3328378233 >> v1:172.21.15.37:6789/0 conn(0x7f344815cd80 legacy=0x7f344806f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:29.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.528+0000 7f344d800640 1 -- 172.21.15.37:0/3328378233 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34480cd6e0 con 0x7f34480ce8d0 2024-05-30T06:51:29.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.532+0000 7f344d800640 1 --2- 172.21.15.37:0/3328378233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34480ce8d0 0x7f34480ced20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3440009e50 tx=0x7f344001f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946d6127e057f15b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:29.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.532+0000 7f3447400640 1 -- 172.21.15.37:0/3328378233 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400b4070 con 0x7f34480ce8d0 2024-05-30T06:51:29.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.532+0000 7f3447400640 1 -- 172.21.15.37:0/3328378233 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34400af400 con 0x7f34480ce8d0 2024-05-30T06:51:29.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.532+0000 7f3447400640 1 -- 172.21.15.37:0/3328378233 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400af7d0 con 0x7f34480ce8d0 2024-05-30T06:51:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.536+0000 7f344f800640 1 -- 172.21.15.37:0/3328378233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34480ce8d0 msgr2=0x7f34480ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:29.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.536+0000 7f344f800640 1 --2- 172.21.15.37:0/3328378233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34480ce8d0 0x7f34480ced20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f3440009e50 tx=0x7f344001f1a0 comp rx=0 tx=0).stop 2024-05-30T06:51:29.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.536+0000 7f344f800640 1 -- 172.21.15.37:0/3328378233 shutdown_connections 2024-05-30T06:51:29.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.536+0000 7f344f800640 1 --2- 172.21.15.37:0/3328378233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34480ce8d0 0x7f34480ced20 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:29.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.536+0000 7f344f800640 1 -- 172.21.15.37:0/3328378233 >> 172.21.15.37:0/3328378233 conn(0x7f34480b23a0 msgr2=0x7f34480b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:29.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.536+0000 7f344f800640 1 -- 172.21.15.37:0/3328378233 shutdown_connections 2024-05-30T06:51:29.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.536+0000 7f344f800640 1 -- 172.21.15.37:0/3328378233 wait complete. 2024-05-30T06:51:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.536+0000 7f344f800640 1 Processor -- start 2024-05-30T06:51:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344f800640 1 -- start start 2024-05-30T06:51:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344f800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f344806e000 0x7f344813ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344f800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34480ce8d0 0x7f344813be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344f800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f344815cd80 0x7f34481f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344f800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34481673d0 con 0x7f344815cd80 2024-05-30T06:51:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344f800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f34480cdca0 con 0x7f34480ce8d0 2024-05-30T06:51:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344f800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3448167550 con 0x7f344806e000 2024-05-30T06:51:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f344815cd80 0x7f34481f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f344815cd80 0x7f34481f8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32888/0 (socket says 172.21.15.37:32888) 2024-05-30T06:51:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344d800640 1 -- 172.21.15.37:0/1859902104 learned_addr learned my addr 172.21.15.37:0/1859902104 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:29.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344d800640 1 -- 172.21.15.37:0/1859902104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f344806e000 msgr2=0x7f344813ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:29.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344d800640 1 --2- 172.21.15.37:0/1859902104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f344806e000 0x7f344813ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:29.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344d800640 1 -- 172.21.15.37:0/1859902104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34480ce8d0 msgr2=0x7f344813be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:29.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344d800640 1 --2- 172.21.15.37:0/1859902104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34480ce8d0 0x7f344813be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:29.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344d800640 1 -- 172.21.15.37:0/1859902104 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f344813c760 con 0x7f344815cd80 2024-05-30T06:51:29.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344d800640 1 --2- 172.21.15.37:0/1859902104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f344815cd80 0x7f34481f8b50 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f344001cdd0 tx=0x7f344001bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f3444c00640 1 -- 172.21.15.37:0/1859902104 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400b4040 con 0x7f344815cd80 2024-05-30T06:51:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f3444c00640 1 -- 172.21.15.37:0/1859902104 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34400afd30 con 0x7f344815cd80 2024-05-30T06:51:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.540+0000 7f344f800640 1 -- 172.21.15.37:0/1859902104 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f344813c9e0 con 0x7f344815cd80 2024-05-30T06:51:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.544+0000 7f3444c00640 1 -- 172.21.15.37:0/1859902104 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400b9460 con 0x7f344815cd80 2024-05-30T06:51:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.544+0000 7f344f800640 1 -- 172.21.15.37:0/1859902104 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f344813e960 con 0x7f344815cd80 2024-05-30T06:51:29.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.544+0000 7f344f800640 1 -- 172.21.15.37:0/1859902104 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34240052a0 con 0x7f344815cd80 2024-05-30T06:51:29.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.548+0000 7f3444c00640 1 -- 172.21.15.37:0/1859902104 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7f34400c3020 con 0x7f344815cd80 2024-05-30T06:51:29.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.548+0000 7f3444c00640 1 --2- 172.21.15.37:0/1859902104 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f34280695c0 0x7f342806ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:29.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.548+0000 7f3444c00640 1 -- 172.21.15.37:0/1859902104 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f3440123520 con 0x7f344815cd80 2024-05-30T06:51:29.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.556+0000 7f3444c00640 1 -- 172.21.15.37:0/1859902104 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f34400ca020 con 0x7f344815cd80 2024-05-30T06:51:29.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.556+0000 7f344ce00640 1 --2- 172.21.15.37:0/1859902104 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f34280695c0 0x7f342806ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:29.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.584+0000 7f344ce00640 1 --2- 172.21.15.37:0/1859902104 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f34280695c0 0x7f342806ba80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f344815b3f0 tx=0x7f343c006bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:29.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.944+0000 7f344f800640 1 -- 172.21.15.37:0/1859902104 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f3424005860 con 0x7f344815cd80 2024-05-30T06:51:29.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:51:29.946 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:51:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:51:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:51:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:51:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:51:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:51:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:51:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:51:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:51:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:51:29.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:51:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:51:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:51:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:51:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:51:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 584, 2024-05-30T06:51:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:51:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:51:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:51:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:51:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:29.947 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:51:29.948 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:51:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:51:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 911, 2024-05-30T06:51:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 3696119859, 2024-05-30T06:51:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 7484661760, 2024-05-30T06:51:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 765609451520, 2024-05-30T06:51:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:51:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 44375274, 2024-05-30T06:51:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 84922327, 2024-05-30T06:51:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 10, 2024-05-30T06:51:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 24 2024-05-30T06:51:29.949 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:51:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:51:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:51:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:51:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:51:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:51:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:51:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:51:29.950 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:51:29.951 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 10, 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:49:42.776273+0000", 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "4 ongoing clones; Avg progress is 17.513% (3s)\n [====........................] (remaining: 15s)", 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.17512999475002289, 2024-05-30T06:51:29.952 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:51:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:29.953 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:29.953 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:51:29.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.944+0000 7f3444c00640 1 -- 172.21.15.37:0/1859902104 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2136 (secure 0 0 0) 0x7f344813c760 con 0x7f344815cd80 2024-05-30T06:51:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.948+0000 7f344f800640 1 -- 172.21.15.37:0/1859902104 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f34280695c0 msgr2=0x7f342806ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.948+0000 7f344f800640 1 --2- 172.21.15.37:0/1859902104 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f34280695c0 0x7f342806ba80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f344815b3f0 tx=0x7f343c006bb0 comp rx=0 tx=0).stop 2024-05-30T06:51:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.948+0000 7f344f800640 1 -- 172.21.15.37:0/1859902104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f344815cd80 msgr2=0x7f34481f8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.948+0000 7f344f800640 1 --2- 172.21.15.37:0/1859902104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f344815cd80 0x7f34481f8b50 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f344001cdd0 tx=0x7f344001bf40 comp rx=0 tx=0).stop 2024-05-30T06:51:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.948+0000 7f344f800640 1 -- 172.21.15.37:0/1859902104 shutdown_connections 2024-05-30T06:51:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.948+0000 7f344f800640 1 --2- 172.21.15.37:0/1859902104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f344815cd80 0x7f34481f8b50 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.948+0000 7f344f800640 1 --2- 172.21.15.37:0/1859902104 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f34280695c0 0x7f342806ba80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.948+0000 7f344f800640 1 --2- 172.21.15.37:0/1859902104 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34480ce8d0 0x7f344813be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.948+0000 7f344f800640 1 --2- 172.21.15.37:0/1859902104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f344806e000 0x7f344813ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.948+0000 7f344f800640 1 -- 172.21.15.37:0/1859902104 >> 172.21.15.37:0/1859902104 conn(0x7f34480b23a0 msgr2=0x7f344806f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.948+0000 7f344f800640 1 -- 172.21.15.37:0/1859902104 shutdown_connections 2024-05-30T06:51:29.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:29.948+0000 7f344f800640 1 -- 172.21.15.37:0/1859902104 wait complete. 2024-05-30T06:51:30.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:51:31.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.228+0000 7fd14ba00640 1 Processor -- start 2024-05-30T06:51:31.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.228+0000 7fd14ba00640 1 -- start start 2024-05-30T06:51:31.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd14ba00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd14406b960 0x7fd14415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:31.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd14ba00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1440cd2a0 0x7fd1440b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:31.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd14ba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd14406bd40 0x7fd1440cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:31.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd14ba00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd1440b3fd0 con 0x7fd1440cd2a0 2024-05-30T06:51:31.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd14ba00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd144160580 con 0x7fd14406b960 2024-05-30T06:51:31.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd14ba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd144160860 con 0x7fd14406bd40 2024-05-30T06:51:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd143e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1440cd2a0 0x7fd1440b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd143e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1440cd2a0 0x7fd1440b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32902/0 (socket says 172.21.15.37:32902) 2024-05-30T06:51:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd143e00640 1 -- 172.21.15.37:0/780819973 learned_addr learned my addr 172.21.15.37:0/780819973 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd149000640 1 --2- 172.21.15.37:0/780819973 >> v2:172.21.15.105:3300/0 conn(0x7fd14406b960 0x7fd14415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd149a00640 1 --2- 172.21.15.37:0/780819973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd14406bd40 0x7fd1440cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd143e00640 1 -- 172.21.15.37:0/780819973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd14406bd40 msgr2=0x7fd1440cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd143e00640 1 --2- 172.21.15.37:0/780819973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd14406bd40 0x7fd1440cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd143e00640 1 -- 172.21.15.37:0/780819973 >> v2:172.21.15.105:3300/0 conn(0x7fd14406b960 msgr2=0x7fd14415cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:31.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd143e00640 1 --2- 172.21.15.37:0/780819973 >> v2:172.21.15.105:3300/0 conn(0x7fd14406b960 0x7fd14415cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:31.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.232+0000 7fd143e00640 1 -- 172.21.15.37:0/780819973 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd144160b40 con 0x7fd1440cd2a0 2024-05-30T06:51:31.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.236+0000 7fd143e00640 1 --2- 172.21.15.37:0/780819973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1440cd2a0 0x7fd1440b3a90 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd1440d1480 tx=0x7fd13001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38869d53b96c3390 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:31.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.240+0000 7fd143400640 1 -- 172.21.15.37:0/780819973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1300b0070 con 0x7fd1440cd2a0 2024-05-30T06:51:31.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.240+0000 7fd143400640 1 -- 172.21.15.37:0/780819973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1300ab600 con 0x7fd1440cd2a0 2024-05-30T06:51:31.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.240+0000 7fd143400640 1 -- 172.21.15.37:0/780819973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1300ab9d0 con 0x7fd1440cd2a0 2024-05-30T06:51:31.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.240+0000 7fd14ba00640 1 -- 172.21.15.37:0/780819973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1440cd2a0 msgr2=0x7fd1440b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:31.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.240+0000 7fd14ba00640 1 --2- 172.21.15.37:0/780819973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1440cd2a0 0x7fd1440b3a90 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd1440d1480 tx=0x7fd13001c230 comp rx=0 tx=0).stop 2024-05-30T06:51:31.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.240+0000 7fd14ba00640 1 -- 172.21.15.37:0/780819973 shutdown_connections 2024-05-30T06:51:31.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.240+0000 7fd14ba00640 1 --2- 172.21.15.37:0/780819973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd14406bd40 0x7fd1440cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:31.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.240+0000 7fd14ba00640 1 --2- 172.21.15.37:0/780819973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1440cd2a0 0x7fd1440b3a90 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:31.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.240+0000 7fd14ba00640 1 --2- 172.21.15.37:0/780819973 >> v2:172.21.15.105:3300/0 conn(0x7fd14406b960 0x7fd14415cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:31.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.240+0000 7fd14ba00640 1 -- 172.21.15.37:0/780819973 >> 172.21.15.37:0/780819973 conn(0x7fd14409aa60 msgr2=0x7fd1440b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:31.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.240+0000 7fd14ba00640 1 -- 172.21.15.37:0/780819973 shutdown_connections 2024-05-30T06:51:31.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.240+0000 7fd14ba00640 1 -- 172.21.15.37:0/780819973 wait complete. 2024-05-30T06:51:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.244+0000 7fd14ba00640 1 Processor -- start 2024-05-30T06:51:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.244+0000 7fd14ba00640 1 -- start start 2024-05-30T06:51:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.244+0000 7fd14ba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd14406b960 0x7fd144150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.244+0000 7fd14ba00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14406bd40 0x7fd1441593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.244+0000 7fd14ba00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1440cd2a0 0x7fd144159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.244+0000 7fd14ba00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd14415a800 con 0x7fd14406bd40 2024-05-30T06:51:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.244+0000 7fd14ba00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd14415a680 con 0x7fd1440cd2a0 2024-05-30T06:51:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.244+0000 7fd14ba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd1440d0410 con 0x7fd14406b960 2024-05-30T06:51:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.244+0000 7fd143e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14406bd40 0x7fd1441593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.244+0000 7fd143e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14406bd40 0x7fd1441593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32906/0 (socket says 172.21.15.37:32906) 2024-05-30T06:51:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.244+0000 7fd143e00640 1 -- 172.21.15.37:0/2020572344 learned_addr learned my addr 172.21.15.37:0/2020572344 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.248+0000 7fd149000640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd14406b960 0x7fd144150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.248+0000 7fd149a00640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1440cd2a0 0x7fd144159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.248+0000 7fd149000640 1 -- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1440cd2a0 msgr2=0x7fd144159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.248+0000 7fd149000640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1440cd2a0 0x7fd144159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.248+0000 7fd149000640 1 -- 172.21.15.37:0/2020572344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14406bd40 msgr2=0x7fd1441593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.248+0000 7fd149000640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14406bd40 0x7fd1441593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.248+0000 7fd149000640 1 -- 172.21.15.37:0/2020572344 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd14415aab0 con 0x7fd14406b960 2024-05-30T06:51:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.248+0000 7fd149000640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd14406b960 0x7fd144150430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd13800d5f0 tx=0x7fd13800dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.248+0000 7fd140c00640 1 -- 172.21.15.37:0/2020572344 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd138018020 con 0x7fd14406b960 2024-05-30T06:51:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.248+0000 7fd14ba00640 1 -- 172.21.15.37:0/2020572344 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd14415ad90 con 0x7fd14406b960 2024-05-30T06:51:31.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.248+0000 7fd14ba00640 1 -- 172.21.15.37:0/2020572344 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd14415b350 con 0x7fd14406b960 2024-05-30T06:51:31.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.252+0000 7fd140c00640 1 -- 172.21.15.37:0/2020572344 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd138014620 con 0x7fd14406b960 2024-05-30T06:51:31.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.252+0000 7fd140c00640 1 -- 172.21.15.37:0/2020572344 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1380149d0 con 0x7fd14406b960 2024-05-30T06:51:31.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.252+0000 7fd14ba00640 1 -- 172.21.15.37:0/2020572344 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1200052a0 con 0x7fd14406b960 2024-05-30T06:51:31.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.256+0000 7fd140c00640 1 -- 172.21.15.37:0/2020572344 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7fd13801b020 con 0x7fd14406b960 2024-05-30T06:51:31.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.256+0000 7fd140c00640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1240694f0 0x7fd12406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:31.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.260+0000 7fd140c00640 1 -- 172.21.15.37:0/2020572344 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fd1380557a0 con 0x7fd14406b960 2024-05-30T06:51:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.268+0000 7fd140c00640 1 -- 172.21.15.37:0/2020572344 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd138022020 con 0x7fd14406b960 2024-05-30T06:51:31.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.276+0000 7fd143e00640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1240694f0 0x7fd12406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:31.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.304+0000 7fd143e00640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1240694f0 0x7fd12406b9b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd130000c10 tx=0x7fd1300a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:31.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.736+0000 7fd14ba00640 1 -- 172.21.15.37:0/2020572344 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd120005860 con 0x7fd14406b960 2024-05-30T06:51:31.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.740+0000 7fd140c00640 1 -- 172.21.15.37:0/2020572344 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2136 (secure 0 0 0) 0x7fd138057e00 con 0x7fd14406b960 2024-05-30T06:51:31.741 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:51:31.741 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:51:31.741 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:51:31.741 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:51:31.741 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:51:31.741 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:51:31.741 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:51:31.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:31.742 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:51:31.742 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:51:31.742 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:51:31.742 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:51:31.742 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:51:31.742 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:31.742 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:51:31.742 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:51:31.742 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:51:31.742 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:51:31.742 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:31.743 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 586, 2024-05-30T06:51:31.743 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:51:31.743 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:51:31.743 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:51:31.743 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:51:31.743 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:31.743 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:51:31.743 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:51:31.743 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:51:31.743 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:51:31.743 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:51:31.743 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 911, 2024-05-30T06:51:31.744 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 3696119859, 2024-05-30T06:51:31.745 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 7484661760, 2024-05-30T06:51:31.745 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 765609451520, 2024-05-30T06:51:31.745 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:51:31.745 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 44375274, 2024-05-30T06:51:31.745 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 84922327, 2024-05-30T06:51:31.745 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 10, 2024-05-30T06:51:31.745 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 24 2024-05-30T06:51:31.745 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:31.745 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:51:31.745 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:51:31.745 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:51:31.745 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:51:31.745 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:51:31.746 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:51:31.746 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:51:31.746 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:51:31.746 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:51:31.746 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:51:31.746 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:51:31.746 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:51:31.746 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:51:31.746 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:31.746 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:31.746 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:51:31.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:31.746 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:51:31.747 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:51:31.747 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:51:31.747 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:51:31.747 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:51:31.747 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:51:31.747 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:51:31.747 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:31.747 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:51:31.747 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:31.747 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:51:31.747 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 10, 2024-05-30T06:51:31.747 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:49:42.776273+0000", 2024-05-30T06:51:31.747 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:51:31.748 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:31.748 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:51:31.748 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:51:31.748 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "4 ongoing clones; Avg progress is 17.513% (3s)\n [====........................] (remaining: 15s)", 2024-05-30T06:51:31.748 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.17512999475002289, 2024-05-30T06:51:31.748 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:51:31.748 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:31.748 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:31.748 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:51:31.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.740+0000 7fd14ba00640 1 -- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1240694f0 msgr2=0x7fd12406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:31.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.740+0000 7fd14ba00640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1240694f0 0x7fd12406b9b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd130000c10 tx=0x7fd1300a6000 comp rx=0 tx=0).stop 2024-05-30T06:51:31.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.740+0000 7fd14ba00640 1 -- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd14406b960 msgr2=0x7fd144150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:31.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.740+0000 7fd14ba00640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd14406b960 0x7fd144150430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd13800d5f0 tx=0x7fd13800dab0 comp rx=0 tx=0).stop 2024-05-30T06:51:31.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.740+0000 7fd14ba00640 1 -- 172.21.15.37:0/2020572344 shutdown_connections 2024-05-30T06:51:31.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.740+0000 7fd14ba00640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1240694f0 0x7fd12406b9b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:31.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.740+0000 7fd14ba00640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1440cd2a0 0x7fd144159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:31.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.740+0000 7fd14ba00640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14406bd40 0x7fd1441593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:31.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.740+0000 7fd14ba00640 1 --2- 172.21.15.37:0/2020572344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd14406b960 0x7fd144150430 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:31.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.740+0000 7fd14ba00640 1 -- 172.21.15.37:0/2020572344 >> 172.21.15.37:0/2020572344 conn(0x7fd14409aa60 msgr2=0x7fd1440ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:31.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.740+0000 7fd14ba00640 1 -- 172.21.15.37:0/2020572344 shutdown_connections 2024-05-30T06:51:31.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:31.740+0000 7fd14ba00640 1 -- 172.21.15.37:0/2020572344 wait complete. 2024-05-30T06:51:32.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:51:33.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.028+0000 7fa54d000640 1 Processor -- start 2024-05-30T06:51:33.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.028+0000 7fa54d000640 1 -- start start 2024-05-30T06:51:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.032+0000 7fa54d000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa54815e900 0x7fa54815ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.032+0000 7fa54d000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa54809b170 0x7fa5480b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.032+0000 7fa54d000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa54815f350 con 0x7fa54806dce0 2024-05-30T06:51:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.032+0000 7fa54d000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa54815f630 con 0x7fa54815e900 2024-05-30T06:51:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.032+0000 7fa54d000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa54815f910 con 0x7fa54809b170 2024-05-30T06:51:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.032+0000 7fa547400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa54815e900 0x7fa54815ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.032+0000 7fa547400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa54815e900 0x7fa54815ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32910/0 (socket says 172.21.15.37:32910) 2024-05-30T06:51:33.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.032+0000 7fa547400640 1 -- 172.21.15.37:0/1248551093 learned_addr learned my addr 172.21.15.37:0/1248551093 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.032+0000 7fa547400640 1 -- 172.21.15.37:0/1248551093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa54809b170 msgr2=0x7fa5480b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.032+0000 7fa547400640 1 --2- 172.21.15.37:0/1248551093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa54809b170 0x7fa5480b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.032+0000 7fa547400640 1 -- 172.21.15.37:0/1248551093 >> v1:172.21.15.105:6789/0 conn(0x7fa54806dce0 legacy=0x7fa54809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:33.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.032+0000 7fa547400640 1 -- 172.21.15.37:0/1248551093 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54815fbf0 con 0x7fa54815e900 2024-05-30T06:51:33.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.036+0000 7fa547400640 1 --2- 172.21.15.37:0/1248551093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54815e900 0x7fa54815ece0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa538009870 tx=0x7fa53801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bddfbd8060ba8db server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:33.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.036+0000 7fa546a00640 1 -- 172.21.15.37:0/1248551093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5380b0070 con 0x7fa54815e900 2024-05-30T06:51:33.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.036+0000 7fa546a00640 1 -- 172.21.15.37:0/1248551093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5380ab600 con 0x7fa54815e900 2024-05-30T06:51:33.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.036+0000 7fa546a00640 1 -- 172.21.15.37:0/1248551093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5380ab9d0 con 0x7fa54815e900 2024-05-30T06:51:33.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.040+0000 7fa54d000640 1 -- 172.21.15.37:0/1248551093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54815e900 msgr2=0x7fa54815ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:33.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.040+0000 7fa54d000640 1 --2- 172.21.15.37:0/1248551093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54815e900 0x7fa54815ece0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa538009870 tx=0x7fa53801c4b0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.040+0000 7fa54d000640 1 -- 172.21.15.37:0/1248551093 shutdown_connections 2024-05-30T06:51:33.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.040+0000 7fa54d000640 1 --2- 172.21.15.37:0/1248551093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa54809b170 0x7fa5480b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.040+0000 7fa54d000640 1 --2- 172.21.15.37:0/1248551093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54815e900 0x7fa54815ece0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.040+0000 7fa54d000640 1 -- 172.21.15.37:0/1248551093 >> 172.21.15.37:0/1248551093 conn(0x7fa5480b40e0 msgr2=0x7fa5480b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:33.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.040+0000 7fa54d000640 1 -- 172.21.15.37:0/1248551093 shutdown_connections 2024-05-30T06:51:33.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.040+0000 7fa54d000640 1 -- 172.21.15.37:0/1248551093 wait complete. 2024-05-30T06:51:33.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.044+0000 7fa54d000640 1 Processor -- start 2024-05-30T06:51:33.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.044+0000 7fa54d000640 1 -- start start 2024-05-30T06:51:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.044+0000 7fa54d000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa54806dce0 0x7fa54814f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.044+0000 7fa54d000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa54809b170 0x7fa54809e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:33.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.044+0000 7fa54d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54815e900 0x7fa54809ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.044+0000 7fa54d000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa5480b7430 con 0x7fa54815e900 2024-05-30T06:51:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.044+0000 7fa54d000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa5480b72b0 con 0x7fa54809b170 2024-05-30T06:51:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.044+0000 7fa54d000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa5480b75b0 con 0x7fa54806dce0 2024-05-30T06:51:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.044+0000 7fa547e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54815e900 0x7fa54809ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:33.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.044+0000 7fa547e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54815e900 0x7fa54809ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32926/0 (socket says 172.21.15.37:32926) 2024-05-30T06:51:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.044+0000 7fa547e00640 1 -- 172.21.15.37:0/2893031299 learned_addr learned my addr 172.21.15.37:0/2893031299 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.048+0000 7fa547e00640 1 -- 172.21.15.37:0/2893031299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa54806dce0 msgr2=0x7fa54814f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.048+0000 7fa547e00640 1 --2- 172.21.15.37:0/2893031299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa54806dce0 0x7fa54814f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.048+0000 7fa547e00640 1 -- 172.21.15.37:0/2893031299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa54809b170 msgr2=0x7fa54809e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.048+0000 7fa547e00640 1 --2- 172.21.15.37:0/2893031299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa54809b170 0x7fa54809e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.048+0000 7fa547e00640 1 -- 172.21.15.37:0/2893031299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa548161510 con 0x7fa54815e900 2024-05-30T06:51:33.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.048+0000 7fa547e00640 1 --2- 172.21.15.37:0/2893031299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54815e900 0x7fa54809ee40 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fa54000ba10 tx=0x7fa54000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.048+0000 7fa53f400640 1 -- 172.21.15.37:0/2893031299 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540019070 con 0x7fa54815e900 2024-05-30T06:51:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.048+0000 7fa53f400640 1 -- 172.21.15.37:0/2893031299 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54000cb20 con 0x7fa54815e900 2024-05-30T06:51:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.048+0000 7fa53f400640 1 -- 172.21.15.37:0/2893031299 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540014440 con 0x7fa54815e900 2024-05-30T06:51:33.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.048+0000 7fa54d000640 1 -- 172.21.15.37:0/2893031299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5481617f0 con 0x7fa54815e900 2024-05-30T06:51:33.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.048+0000 7fa54d000640 1 -- 172.21.15.37:0/2893031299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa54809c850 con 0x7fa54815e900 2024-05-30T06:51:33.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.052+0000 7fa54d000640 1 -- 172.21.15.37:0/2893031299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5200052a0 con 0x7fa54815e900 2024-05-30T06:51:33.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.052+0000 7fa53f400640 1 -- 172.21.15.37:0/2893031299 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7fa54001c070 con 0x7fa54815e900 2024-05-30T06:51:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.052+0000 7fa53f400640 1 --2- 172.21.15.37:0/2893031299 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa5240694f0 0x7fa52406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:33.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.056+0000 7fa53f400640 1 -- 172.21.15.37:0/2893031299 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fa5400855d0 con 0x7fa54815e900 2024-05-30T06:51:33.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.060+0000 7fa547400640 1 --2- 172.21.15.37:0/2893031299 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa5240694f0 0x7fa52406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:33.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.064+0000 7fa53f400640 1 -- 172.21.15.37:0/2893031299 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa540057200 con 0x7fa54815e900 2024-05-30T06:51:33.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.144+0000 7fa547400640 1 --2- 172.21.15.37:0/2893031299 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa5240694f0 0x7fa52406b9b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa5380ad000 tx=0x7fa538004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:33.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.428+0000 7fa54d000640 1 -- 172.21.15.37:0/2893031299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa520005860 con 0x7fa54815e900 2024-05-30T06:51:33.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.432+0000 7fa53f400640 1 -- 172.21.15.37:0/2893031299 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2400 (secure 0 0 0) 0x7fa540056b00 con 0x7fa54815e900 2024-05-30T06:51:33.436 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:51:33.436 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:51:33.436 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:51:33.436 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:51:33.436 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:51:33.436 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:51:33.436 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:51:33.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:33.436 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 587, 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:51:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:51:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:51:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:51:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:51:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:51:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:51:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:51:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:51:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:51:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:51:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:51:33.438 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1725, 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 7093804155, 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 14150332416, 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 758943780864, 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 335419570, 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 344197388, 2024-05-30T06:51:33.439 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 82, 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 96 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:51:33.440 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:51:33.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 10, 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:49:42.776273+0000", 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: "37467ab0-9e28-4c72-9193-e79e68c05454": { 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "5 ongoing+pending clones; Avg progress is 21.042% (0s)\n [=====.......................] ", 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.21041999757289886, 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "4 ongoing clones; Avg progress is 26.302% (5s)\n [=======.....................] (remaining: 14s)", 2024-05-30T06:51:33.442 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.26302000880241394, 2024-05-30T06:51:33.443 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:51:33.443 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:33.443 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:51:33.443 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:51:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.436+0000 7fa54d000640 1 -- 172.21.15.37:0/2893031299 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa5240694f0 msgr2=0x7fa52406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.436+0000 7fa54d000640 1 --2- 172.21.15.37:0/2893031299 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa5240694f0 0x7fa52406b9b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa5380ad000 tx=0x7fa538004740 comp rx=0 tx=0).stop 2024-05-30T06:51:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.436+0000 7fa54d000640 1 -- 172.21.15.37:0/2893031299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54815e900 msgr2=0x7fa54809ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.436+0000 7fa54d000640 1 --2- 172.21.15.37:0/2893031299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54815e900 0x7fa54809ee40 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fa54000ba10 tx=0x7fa54000bed0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.436+0000 7fa54d000640 1 -- 172.21.15.37:0/2893031299 shutdown_connections 2024-05-30T06:51:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.436+0000 7fa54d000640 1 --2- 172.21.15.37:0/2893031299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54815e900 0x7fa54809ee40 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.436+0000 7fa54d000640 1 --2- 172.21.15.37:0/2893031299 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa5240694f0 0x7fa52406b9b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.436+0000 7fa54d000640 1 --2- 172.21.15.37:0/2893031299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa54809b170 0x7fa54809e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.436+0000 7fa54d000640 1 --2- 172.21.15.37:0/2893031299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa54806dce0 0x7fa54814f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.436+0000 7fa54d000640 1 -- 172.21.15.37:0/2893031299 >> 172.21.15.37:0/2893031299 conn(0x7fa5480b40e0 msgr2=0x7fa5480d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.436+0000 7fa54d000640 1 -- 172.21.15.37:0/2893031299 shutdown_connections 2024-05-30T06:51:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.436+0000 7fa54d000640 1 -- 172.21.15.37:0/2893031299 wait complete. 2024-05-30T06:51:33.476 INFO:tasks.cephfs.test_volumes:pevs - {'37467ab0-9e28-4c72-9193-e79e68c05454': {'message': '5 ongoing+pending clones; Avg progress is 21.042% (0s)\n [=====.......................] ', 'progress': 0.21041999757289886, 'add_to_ceph_s': True}, 'c2a8ed33-2876-45d4-ae98-defcf6508d81': {'message': '4 ongoing clones; Avg progress is 26.302% (5s)\n [=======.....................] (remaining: 14s)', 'progress': 0.26302000880241394, 'add_to_ceph_s': True}} 2024-05-30T06:51:33.477 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone37106 2024-05-30T06:51:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.696+0000 7fb0a5600640 1 Processor -- start 2024-05-30T06:51:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.696+0000 7fb0a5600640 1 -- start start 2024-05-30T06:51:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb0a5600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0a0070b60 0x7fb0a006c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb0a5600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb0a0162be0 0x7fb0a00cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb0a5600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0a00cef30 con 0x7fb0a00cbfa0 2024-05-30T06:51:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb0a5600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb0a006ca10 con 0x7fb0a0070b60 2024-05-30T06:51:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb0a5600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb0a006ccf0 con 0x7fb0a0162be0 2024-05-30T06:51:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb09ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0a0070b60 0x7fb0a006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb09ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0a0070b60 0x7fb0a006c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32942/0 (socket says 172.21.15.37:32942) 2024-05-30T06:51:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb09e000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb0a00cbfa0 0x7fb0a01624d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58580/0 (socket says 172.21.15.37:58580) 2024-05-30T06:51:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb09ea00640 1 -- 172.21.15.37:0/3736016770 learned_addr learned my addr 172.21.15.37:0/3736016770 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb09f400640 1 --2- 172.21.15.37:0/3736016770 >> v2:172.21.15.105:3300/0 conn(0x7fb0a0162be0 0x7fb0a00cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:33.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb09ea00640 1 -- 172.21.15.37:0/3736016770 >> v2:172.21.15.105:3300/0 conn(0x7fb0a0162be0 msgr2=0x7fb0a00cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:33.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb09ea00640 1 --2- 172.21.15.37:0/3736016770 >> v2:172.21.15.105:3300/0 conn(0x7fb0a0162be0 0x7fb0a00cf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb09d600640 1 -- 172.21.15.37:0/3736016770 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 648383113 0 0) 0x7fb0a00cef30 con 0x7fb0a00cbfa0 2024-05-30T06:51:33.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb09ea00640 1 -- 172.21.15.37:0/3736016770 >> v1:172.21.15.37:6789/0 conn(0x7fb0a00cbfa0 legacy=0x7fb0a01624d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:33.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.700+0000 7fb09ea00640 1 -- 172.21.15.37:0/3736016770 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a006cfd0 con 0x7fb0a0070b60 2024-05-30T06:51:33.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.704+0000 7fb09ea00640 1 --2- 172.21.15.37:0/3736016770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a0070b60 0x7fb0a006c370 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00cbcf0 tx=0x7fb09001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd193c675337dfb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:33.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.704+0000 7fb09d600640 1 -- 172.21.15.37:0/3736016770 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0900aa610 con 0x7fb0a0070b60 2024-05-30T06:51:33.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.704+0000 7fb09d600640 1 -- 172.21.15.37:0/3736016770 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0900af070 con 0x7fb0a0070b60 2024-05-30T06:51:33.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.704+0000 7fb09d600640 1 -- 172.21.15.37:0/3736016770 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0900aa9d0 con 0x7fb0a0070b60 2024-05-30T06:51:33.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.704+0000 7fb0a5600640 1 -- 172.21.15.37:0/3736016770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a0070b60 msgr2=0x7fb0a006c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:33.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.704+0000 7fb0a5600640 1 --2- 172.21.15.37:0/3736016770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a0070b60 0x7fb0a006c370 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fb0a00cbcf0 tx=0x7fb09001c490 comp rx=0 tx=0).stop 2024-05-30T06:51:33.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.704+0000 7fb0a5600640 1 -- 172.21.15.37:0/3736016770 shutdown_connections 2024-05-30T06:51:33.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.704+0000 7fb0a5600640 1 --2- 172.21.15.37:0/3736016770 >> v2:172.21.15.105:3300/0 conn(0x7fb0a0162be0 0x7fb0a00cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.704+0000 7fb0a5600640 1 --2- 172.21.15.37:0/3736016770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a0070b60 0x7fb0a006c370 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.704+0000 7fb0a5600640 1 -- 172.21.15.37:0/3736016770 >> 172.21.15.37:0/3736016770 conn(0x7fb0a00cd790 msgr2=0x7fb0a00cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:33.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.704+0000 7fb0a5600640 1 -- 172.21.15.37:0/3736016770 shutdown_connections 2024-05-30T06:51:33.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.704+0000 7fb0a5600640 1 -- 172.21.15.37:0/3736016770 wait complete. 2024-05-30T06:51:33.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.708+0000 7fb0a5600640 1 Processor -- start 2024-05-30T06:51:33.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.708+0000 7fb0a5600640 1 -- start start 2024-05-30T06:51:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb0a5600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0a0070b60 0x7fb0a0161a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb0a5600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0a00cbfa0 0x7fb0a0160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb0a5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a0162be0 0x7fb0a015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb0a5600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a00d02e0 con 0x7fb0a0162be0 2024-05-30T06:51:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb0a5600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb0a00d0160 con 0x7fb0a00cbfa0 2024-05-30T06:51:33.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb0a5600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a00d0460 con 0x7fb0a0070b60 2024-05-30T06:51:33.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb09f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a0162be0 0x7fb0a015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:33.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb09f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a0162be0 0x7fb0a015bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32948/0 (socket says 172.21.15.37:32948) 2024-05-30T06:51:33.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb09f400640 1 -- 172.21.15.37:0/1890073164 learned_addr learned my addr 172.21.15.37:0/1890073164 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb09ea00640 1 --2- 172.21.15.37:0/1890073164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0a0070b60 0x7fb0a0161a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb09f400640 1 -- 172.21.15.37:0/1890073164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0a0070b60 msgr2=0x7fb0a0161a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb09f400640 1 --2- 172.21.15.37:0/1890073164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0a0070b60 0x7fb0a0161a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb09f400640 1 -- 172.21.15.37:0/1890073164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0a00cbfa0 msgr2=0x7fb0a0160010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T06:51:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb09f400640 1 --2- 172.21.15.37:0/1890073164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0a00cbfa0 0x7fb0a0160010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb09f400640 1 -- 172.21.15.37:0/1890073164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a0162090 con 0x7fb0a0162be0 2024-05-30T06:51:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb09f400640 1 --2- 172.21.15.37:0/1890073164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a0162be0 0x7fb0a015bd90 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fb09800cc00 tx=0x7fb09800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb096a00640 1 -- 172.21.15.37:0/1890073164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09800ce10 con 0x7fb0a0162be0 2024-05-30T06:51:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb096a00640 1 -- 172.21.15.37:0/1890073164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0980039a0 con 0x7fb0a0162be0 2024-05-30T06:51:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb096a00640 1 -- 172.21.15.37:0/1890073164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098003d70 con 0x7fb0a0162be0 2024-05-30T06:51:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb0a5600640 1 -- 172.21.15.37:0/1890073164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0a01564c0 con 0x7fb0a0162be0 2024-05-30T06:51:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.712+0000 7fb0a5600640 1 -- 172.21.15.37:0/1890073164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0a0156a80 con 0x7fb0a0162be0 2024-05-30T06:51:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.716+0000 7fb0a5600640 1 -- 172.21.15.37:0/1890073164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0a0075580 con 0x7fb0a0162be0 2024-05-30T06:51:33.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.716+0000 7fb096a00640 1 -- 172.21.15.37:0/1890073164 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7fb098003f10 con 0x7fb0a0162be0 2024-05-30T06:51:33.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.716+0000 7fb096a00640 1 --2- 172.21.15.37:0/1890073164 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb0800694f0 0x7fb08006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:33.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.716+0000 7fb096a00640 1 -- 172.21.15.37:0/1890073164 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fb098085cd0 con 0x7fb0a0162be0 2024-05-30T06:51:33.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.724+0000 7fb09ea00640 1 --2- 172.21.15.37:0/1890073164 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb0800694f0 0x7fb08006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.728+0000 7fb096a00640 1 -- 172.21.15.37:0/1890073164 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb098014030 con 0x7fb0a0162be0 2024-05-30T06:51:33.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:33.756+0000 7fb09ea00640 1 --2- 172.21.15.37:0/1890073164 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb0800694f0 0x7fb08006b9b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb0900ae000 tx=0x7fb0900a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:34.028+0000 7fb0a5600640 1 -- 172.21.15.37:0/1890073164 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone37106", "target": ["mon-mgr", ""]}) -- 0x7fb0a00ce9b0 con 0x7fb0800694f0 2024-05-30T06:51:34.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:51:34.899 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:51:35.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.148+0000 7fb096a00640 1 -- 172.21.15.37:0/1890073164 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb0a00ce9b0 con 0x7fb0800694f0 2024-05-30T06:51:35.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.152+0000 7fb0a5600640 1 -- 172.21.15.37:0/1890073164 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb0800694f0 msgr2=0x7fb08006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:35.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.152+0000 7fb0a5600640 1 --2- 172.21.15.37:0/1890073164 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb0800694f0 0x7fb08006b9b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb0900ae000 tx=0x7fb0900a7000 comp rx=0 tx=0).stop 2024-05-30T06:51:35.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.152+0000 7fb0a5600640 1 -- 172.21.15.37:0/1890073164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a0162be0 msgr2=0x7fb0a015bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:35.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.152+0000 7fb0a5600640 1 --2- 172.21.15.37:0/1890073164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a0162be0 0x7fb0a015bd90 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fb09800cc00 tx=0x7fb09800a5c0 comp rx=0 tx=0).stop 2024-05-30T06:51:35.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.156+0000 7fb0a5600640 1 -- 172.21.15.37:0/1890073164 shutdown_connections 2024-05-30T06:51:35.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.156+0000 7fb0a5600640 1 --2- 172.21.15.37:0/1890073164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0a0162be0 0x7fb0a015bd90 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:35.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.156+0000 7fb0a5600640 1 --2- 172.21.15.37:0/1890073164 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb0800694f0 0x7fb08006b9b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:35.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.156+0000 7fb0a5600640 1 --2- 172.21.15.37:0/1890073164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0a00cbfa0 0x7fb0a0160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:35.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.156+0000 7fb0a5600640 1 --2- 172.21.15.37:0/1890073164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0a0070b60 0x7fb0a0161a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:35.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.156+0000 7fb0a5600640 1 -- 172.21.15.37:0/1890073164 >> 172.21.15.37:0/1890073164 conn(0x7fb0a00cd790 msgr2=0x7fb0a00cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:35.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.156+0000 7fb0a5600640 1 -- 172.21.15.37:0/1890073164 shutdown_connections 2024-05-30T06:51:35.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.156+0000 7fb0a5600640 1 -- 172.21.15.37:0/1890073164 wait complete. 2024-05-30T06:51:35.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone37107 2024-05-30T06:51:35.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.452+0000 7f81eb000640 1 Processor -- start 2024-05-30T06:51:35.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.452+0000 7f81eb000640 1 -- start start 2024-05-30T06:51:35.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.452+0000 7f81eb000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81e4160860 0x7f81e406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:35.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.452+0000 7f81eb000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f81e40cdfb0 0x7f81e4071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:35.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.452+0000 7f81eb000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e4163330 con 0x7f81e4072340 2024-05-30T06:51:35.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.452+0000 7f81eb000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f81e41630e0 con 0x7f81e4160860 2024-05-30T06:51:35.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.452+0000 7f81eb000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f81e4163f40 con 0x7f81e40cdfb0 2024-05-30T06:51:35.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.456+0000 7f81e9c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81e4160860 0x7f81e406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:35.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.456+0000 7f81e9c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81e4160860 0x7f81e406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32950/0 (socket says 172.21.15.37:32950) 2024-05-30T06:51:35.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.456+0000 7f81e9c00640 1 -- 172.21.15.37:0/1225429107 learned_addr learned my addr 172.21.15.37:0/1225429107 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:35.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.456+0000 7f81e9c00640 1 -- 172.21.15.37:0/1225429107 >> v2:172.21.15.105:3300/0 conn(0x7f81e40cdfb0 msgr2=0x7f81e4071e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T06:51:35.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.456+0000 7f81e9c00640 1 --2- 172.21.15.37:0/1225429107 >> v2:172.21.15.105:3300/0 conn(0x7f81e40cdfb0 0x7f81e4071e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:35.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.456+0000 7f81e9c00640 1 -- 172.21.15.37:0/1225429107 >> v1:172.21.15.37:6789/0 conn(0x7f81e4072340 legacy=0x7f81e406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.456+0000 7f81e9c00640 1 -- 172.21.15.37:0/1225429107 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e4163610 con 0x7f81e4160860 2024-05-30T06:51:35.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.464+0000 7f81e9c00640 1 --2- 172.21.15.37:0/1225429107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e4160860 0x7f81e406f5d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f81e4164290 tx=0x7f81d801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3454dc0e8fd96c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.464+0000 7f81e3e00640 1 -- 172.21.15.37:0/1225429107 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d80ab680 con 0x7f81e4160860 2024-05-30T06:51:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.464+0000 7f81e3e00640 1 -- 172.21.15.37:0/1225429107 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d80b0070 con 0x7f81e4160860 2024-05-30T06:51:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.464+0000 7f81e3e00640 1 -- 172.21.15.37:0/1225429107 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d80aba40 con 0x7f81e4160860 2024-05-30T06:51:35.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.464+0000 7f81eb000640 1 -- 172.21.15.37:0/1225429107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e4160860 msgr2=0x7f81e406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:35.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.464+0000 7f81eb000640 1 --2- 172.21.15.37:0/1225429107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e4160860 0x7f81e406f5d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f81e4164290 tx=0x7f81d801c540 comp rx=0 tx=0).stop 2024-05-30T06:51:35.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.464+0000 7f81eb000640 1 -- 172.21.15.37:0/1225429107 shutdown_connections 2024-05-30T06:51:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.464+0000 7f81eb000640 1 --2- 172.21.15.37:0/1225429107 >> v2:172.21.15.105:3300/0 conn(0x7f81e40cdfb0 0x7f81e4071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.464+0000 7f81eb000640 1 --2- 172.21.15.37:0/1225429107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e4160860 0x7f81e406f5d0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.464+0000 7f81eb000640 1 -- 172.21.15.37:0/1225429107 >> 172.21.15.37:0/1225429107 conn(0x7f81e4067d60 msgr2=0x7f81e406b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81eb000640 1 -- 172.21.15.37:0/1225429107 shutdown_connections 2024-05-30T06:51:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81eb000640 1 -- 172.21.15.37:0/1225429107 wait complete. 2024-05-30T06:51:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81eb000640 1 Processor -- start 2024-05-30T06:51:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81eb000640 1 -- start start 2024-05-30T06:51:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81eb000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81e4072340 0x7f81e40af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81eb000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e40cdfb0 0x7f81e40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81eb000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e4160860 0x7f81e4155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81eb000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81e406f180 con 0x7f81e4160860 2024-05-30T06:51:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81eb000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f81e4072750 con 0x7f81e40cdfb0 2024-05-30T06:51:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81eb000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f81e406f300 con 0x7f81e4072340 2024-05-30T06:51:35.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81ea600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e4160860 0x7f81e4155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81ea600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e4160860 0x7f81e4155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32952/0 (socket says 172.21.15.37:32952) 2024-05-30T06:51:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81ea600640 1 -- 172.21.15.37:0/4102227007 learned_addr learned my addr 172.21.15.37:0/4102227007 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81e9c00640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81e4072340 0x7f81e40af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81e9200640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e40cdfb0 0x7f81e40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81ea600640 1 -- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81e4072340 msgr2=0x7f81e40af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81ea600640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81e4072340 0x7f81e40af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81ea600640 1 -- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e40cdfb0 msgr2=0x7f81e40b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81ea600640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e40cdfb0 0x7f81e40b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81ea600640 1 -- 172.21.15.37:0/4102227007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e40ce890 con 0x7f81e4160860 2024-05-30T06:51:35.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.468+0000 7f81e9200640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e40cdfb0 0x7f81e40b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:51:35.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.472+0000 7f81ea600640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e4160860 0x7f81e4155550 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c770 tx=0x7f81dc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:35.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.472+0000 7f81e1600640 1 -- 172.21.15.37:0/4102227007 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc003b80 con 0x7f81e4160860 2024-05-30T06:51:35.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.472+0000 7f81eb000640 1 -- 172.21.15.37:0/4102227007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e415d570 con 0x7f81e4160860 2024-05-30T06:51:35.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.472+0000 7f81e1600640 1 -- 172.21.15.37:0/4102227007 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc003d20 con 0x7f81e4160860 2024-05-30T06:51:35.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.472+0000 7f81eb000640 1 -- 172.21.15.37:0/4102227007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e40ceb30 con 0x7f81e4160860 2024-05-30T06:51:35.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.472+0000 7f81e1600640 1 -- 172.21.15.37:0/4102227007 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc00aa90 con 0x7f81e4160860 2024-05-30T06:51:35.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.472+0000 7f81eb000640 1 -- 172.21.15.37:0/4102227007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e4068700 con 0x7f81e4160860 2024-05-30T06:51:35.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.476+0000 7f81e1600640 1 -- 172.21.15.37:0/4102227007 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7f81dc00ac30 con 0x7f81e4160860 2024-05-30T06:51:35.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.476+0000 7f81e1600640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f81c80694f0 0x7f81c806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:35.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.476+0000 7f81e1600640 1 -- 172.21.15.37:0/4102227007 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f81dc085810 con 0x7f81e4160860 2024-05-30T06:51:35.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.480+0000 7f81e9c00640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f81c80694f0 0x7f81c806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:35.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.484+0000 7f81e1600640 1 -- 172.21.15.37:0/4102227007 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f81dc0574b0 con 0x7f81e4160860 2024-05-30T06:51:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.512+0000 7f81e9c00640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f81c80694f0 0x7f81c806b9b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f81d80af000 tx=0x7f81d80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:35.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:35.880+0000 7f81eb000640 1 -- 172.21.15.37:0/4102227007 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone37107", "target": ["mon-mgr", ""]}) -- 0x7f81e4068ab0 con 0x7f81c80694f0 2024-05-30T06:51:36.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.648+0000 7f81e1600640 1 -- 172.21.15.37:0/4102227007 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f81e4068ab0 con 0x7f81c80694f0 2024-05-30T06:51:36.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.652+0000 7f81eb000640 1 -- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f81c80694f0 msgr2=0x7f81c806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:36.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.652+0000 7f81eb000640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f81c80694f0 0x7f81c806b9b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f81d80af000 tx=0x7f81d80a7000 comp rx=0 tx=0).stop 2024-05-30T06:51:36.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.652+0000 7f81eb000640 1 -- 172.21.15.37:0/4102227007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e4160860 msgr2=0x7f81e4155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:36.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.652+0000 7f81eb000640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e4160860 0x7f81e4155550 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c770 tx=0x7f81dc00cc30 comp rx=0 tx=0).stop 2024-05-30T06:51:36.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.652+0000 7f81eb000640 1 -- 172.21.15.37:0/4102227007 shutdown_connections 2024-05-30T06:51:36.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.652+0000 7f81eb000640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e4160860 0x7f81e4155550 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.652+0000 7f81eb000640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f81c80694f0 0x7f81c806b9b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.652+0000 7f81eb000640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81e40cdfb0 0x7f81e40b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.652+0000 7f81eb000640 1 --2- 172.21.15.37:0/4102227007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81e4072340 0x7f81e40af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.652+0000 7f81eb000640 1 -- 172.21.15.37:0/4102227007 >> 172.21.15.37:0/4102227007 conn(0x7f81e4067d60 msgr2=0x7f81e40b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.652+0000 7f81eb000640 1 -- 172.21.15.37:0/4102227007 shutdown_connections 2024-05-30T06:51:36.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.652+0000 7f81eb000640 1 -- 172.21.15.37:0/4102227007 wait complete. 2024-05-30T06:51:36.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone37108 2024-05-30T06:51:36.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.928+0000 7fb209200640 1 Processor -- start 2024-05-30T06:51:36.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.928+0000 7fb209200640 1 -- start start 2024-05-30T06:51:36.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.936+0000 7fb209200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb204071e00 0x7fb2040b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:36.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.936+0000 7fb209200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb2040b4fe0 0x7fb2040721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:36.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.936+0000 7fb209200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2040ce1e0 con 0x7fb2040cef60 2024-05-30T06:51:36.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.936+0000 7fb209200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb2040cead0 con 0x7fb2040b4fe0 2024-05-30T06:51:36.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.936+0000 7fb209200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb204072720 con 0x7fb204071e00 2024-05-30T06:51:36.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.936+0000 7fb203e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb2040cef60 0x7fb20406de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58598/0 (socket says 172.21.15.37:58598) 2024-05-30T06:51:36.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.936+0000 7fb203e00640 1 -- 172.21.15.37:0/447488988 learned_addr learned my addr 172.21.15.37:0/447488988 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:51:36.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.936+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 912076256 0 0) 0x7fb2040ce1e0 con 0x7fb2040cef60 2024-05-30T06:51:36.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.936+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1e8003530 con 0x7fb2040cef60 2024-05-30T06:51:36.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.936+0000 7fb203400640 1 --2- 172.21.15.37:0/447488988 >> v2:172.21.15.105:3300/0 conn(0x7fb204071e00 0x7fb2040b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:36.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202a00640 1 --2- 172.21.15.37:0/447488988 >> v2:172.21.15.37:3300/0 conn(0x7fb2040b4fe0 0x7fb2040721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:36.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1000890284 0 0) 0x7fb1e8003530 con 0x7fb2040cef60 2024-05-30T06:51:36.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 >> v2:172.21.15.105:3300/0 conn(0x7fb204071e00 msgr2=0x7fb2040b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:36.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 --2- 172.21.15.37:0/447488988 >> v2:172.21.15.105:3300/0 conn(0x7fb204071e00 0x7fb2040b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:36.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 >> v2:172.21.15.37:3300/0 conn(0x7fb2040b4fe0 msgr2=0x7fb2040721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:36.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 --2- 172.21.15.37:0/447488988 >> v2:172.21.15.37:3300/0 conn(0x7fb2040b4fe0 0x7fb2040721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:36.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2040ce480 con 0x7fb2040cef60 2024-05-30T06:51:36.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fb1f00016a0 con 0x7fb2040cef60 2024-05-30T06:51:36.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 >> v1:172.21.15.37:6789/0 conn(0x7fb2040cef60 legacy=0x7fb20406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:36.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 --2- 172.21.15.37:0/447488988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1e80039c0 0x7fb1e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:36.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 --2- 172.21.15.37:0/447488988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1e8004810 0x7fb1e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:36.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb203400640 1 --2- 172.21.15.37:0/447488988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1e80039c0 0x7fb1e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:36.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 --2- 172.21.15.37:0/447488988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e80051d0 0x7fb1e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:36.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2040cead0 con 0x7fb1e80039c0 2024-05-30T06:51:36.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb204072720 con 0x7fb1e80051d0 2024-05-30T06:51:36.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e800c070 con 0x7fb1e8004810 2024-05-30T06:51:36.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb202a00640 1 --2- 172.21.15.37:0/447488988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1e8004810 0x7fb1e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:36.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb203400640 1 -- 172.21.15.37:0/447488988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1e8004810 msgr2=0x7fb1e8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:36.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb203400640 1 --2- 172.21.15.37:0/447488988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1e8004810 0x7fb1e8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:36.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb203400640 1 -- 172.21.15.37:0/447488988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e80051d0 msgr2=0x7fb1e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:36.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb203400640 1 --2- 172.21.15.37:0/447488988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1e80051d0 0x7fb1e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:36.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb203400640 1 -- 172.21.15.37:0/447488988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e8003530 con 0x7fb1e80039c0 2024-05-30T06:51:36.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.940+0000 7fb203e00640 1 -- 172.21.15.37:0/447488988 reap_dead start 2024-05-30T06:51:36.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.948+0000 7fb203400640 1 --2- 172.21.15.37:0/447488988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1e80039c0 0x7fb1e8003da0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc007360 tx=0x7fb1fc01ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0c1c65640b869b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:36.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.948+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc0b2070 con 0x7fb1e80039c0 2024-05-30T06:51:36.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.948+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1fc0a5c90 con 0x7fb1e80039c0 2024-05-30T06:51:36.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.948+0000 7fb202000640 1 -- 172.21.15.37:0/447488988 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc0b2070 con 0x7fb1e80039c0 2024-05-30T06:51:36.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.948+0000 7fb209200640 1 -- 172.21.15.37:0/447488988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1e80039c0 msgr2=0x7fb1e8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:36.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.948+0000 7fb209200640 1 --2- 172.21.15.37:0/447488988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1e80039c0 0x7fb1e8003da0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc007360 tx=0x7fb1fc01ce30 comp rx=0 tx=0).stop 2024-05-30T06:51:36.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.952+0000 7fb209200640 1 -- 172.21.15.37:0/447488988 shutdown_connections 2024-05-30T06:51:36.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.952+0000 7fb209200640 1 --2- 172.21.15.37:0/447488988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1e80039c0 0x7fb1e8003da0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:36.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.952+0000 7fb209200640 1 -- 172.21.15.37:0/447488988 >> 172.21.15.37:0/447488988 conn(0x7fb204067b60 msgr2=0x7fb20406b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:36.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.952+0000 7fb209200640 1 -- 172.21.15.37:0/447488988 shutdown_connections 2024-05-30T06:51:36.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.952+0000 7fb209200640 1 -- 172.21.15.37:0/447488988 wait complete. 2024-05-30T06:51:36.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.952+0000 7fb209200640 1 Processor -- start 2024-05-30T06:51:36.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.952+0000 7fb209200640 1 -- start start 2024-05-30T06:51:36.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.956+0000 7fb209200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1e80039c0 0x7fb204167d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:36.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.956+0000 7fb209200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204169350 0x7fb2041697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:36.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.956+0000 7fb209200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb204166490 0x7fb204166940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:36.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.956+0000 7fb209200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2040b5540 con 0x7fb204169350 2024-05-30T06:51:36.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.956+0000 7fb209200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb2040b53c0 con 0x7fb204166490 2024-05-30T06:51:36.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.956+0000 7fb209200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb20406e650 con 0x7fb1e80039c0 2024-05-30T06:51:36.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.956+0000 7fb202a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204169350 0x7fb2041697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:36.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.956+0000 7fb203400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1e80039c0 0x7fb204167d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:36.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.956+0000 7fb203400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1e80039c0 0x7fb204167d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:35782/0 (socket says 172.21.15.37:35782) 2024-05-30T06:51:36.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.956+0000 7fb203400640 1 -- 172.21.15.37:0/526758748 learned_addr learned my addr 172.21.15.37:0/526758748 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:36.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.956+0000 7fb203e00640 1 --2- 172.21.15.37:0/526758748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb204166490 0x7fb204166940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.960+0000 7fb202a00640 1 -- 172.21.15.37:0/526758748 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1e80039c0 msgr2=0x7fb204167d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.960+0000 7fb202a00640 1 --2- 172.21.15.37:0/526758748 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1e80039c0 0x7fb204167d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.960+0000 7fb202a00640 1 -- 172.21.15.37:0/526758748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb204166490 msgr2=0x7fb204166940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.960+0000 7fb202a00640 1 --2- 172.21.15.37:0/526758748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb204166490 0x7fb204166940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.960+0000 7fb202a00640 1 -- 172.21.15.37:0/526758748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20420a0c0 con 0x7fb204169350 2024-05-30T06:51:36.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.960+0000 7fb202a00640 1 --2- 172.21.15.37:0/526758748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204169350 0x7fb2041697d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb204050430 tx=0x7fb1f400f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:36.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.960+0000 7fb1fb400640 1 -- 172.21.15.37:0/526758748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4017020 con 0x7fb204169350 2024-05-30T06:51:36.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.960+0000 7fb1fb400640 1 -- 172.21.15.37:0/526758748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f4004440 con 0x7fb204169350 2024-05-30T06:51:36.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.960+0000 7fb1fb400640 1 -- 172.21.15.37:0/526758748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4003860 con 0x7fb204169350 2024-05-30T06:51:36.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.960+0000 7fb209200640 1 -- 172.21.15.37:0/526758748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb204169d10 con 0x7fb204169350 2024-05-30T06:51:36.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.960+0000 7fb209200640 1 -- 172.21.15.37:0/526758748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb204168430 con 0x7fb204169350 2024-05-30T06:51:36.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.968+0000 7fb209200640 1 -- 172.21.15.37:0/526758748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb204068700 con 0x7fb204169350 2024-05-30T06:51:36.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.972+0000 7fb1fb400640 1 -- 172.21.15.37:0/526758748 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7fb1f401a020 con 0x7fb204169350 2024-05-30T06:51:36.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.972+0000 7fb1fb400640 1 --2- 172.21.15.37:0/526758748 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb1e40695f0 0x7fb1e406bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:36.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.972+0000 7fb1fb400640 1 -- 172.21.15.37:0/526758748 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fb1f4085770 con 0x7fb204169350 2024-05-30T06:51:36.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:36.980+0000 7fb1fb400640 1 -- 172.21.15.37:0/526758748 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb1f4021020 con 0x7fb204169350 2024-05-30T06:51:37.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:37.328+0000 7fb209200640 1 -- 172.21.15.37:0/526758748 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone37108", "target": ["mon-mgr", ""]}) -- 0x7fb204068ab0 con 0x7fb1e40695f0 2024-05-30T06:51:37.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:37.980+0000 7fb203400640 1 --2- 172.21.15.37:0/526758748 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb1e40695f0 0x7fb1e406bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:37.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:37.984+0000 7fb203400640 1 --2- 172.21.15.37:0/526758748 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb1e40695f0 0x7fb1e406bab0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb204167280 tx=0x7fb1fc0a7040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:39.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.112+0000 7fb1fb400640 1 -- 172.21.15.37:0/526758748 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb204068ab0 con 0x7fb1e40695f0 2024-05-30T06:51:39.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.112+0000 7fb209200640 1 -- 172.21.15.37:0/526758748 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb1e40695f0 msgr2=0x7fb1e406bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:39.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.112+0000 7fb209200640 1 --2- 172.21.15.37:0/526758748 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb1e40695f0 0x7fb1e406bab0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb204167280 tx=0x7fb1fc0a7040 comp rx=0 tx=0).stop 2024-05-30T06:51:39.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.112+0000 7fb209200640 1 -- 172.21.15.37:0/526758748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204169350 msgr2=0x7fb2041697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:39.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.112+0000 7fb209200640 1 --2- 172.21.15.37:0/526758748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204169350 0x7fb2041697d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb204050430 tx=0x7fb1f400f920 comp rx=0 tx=0).stop 2024-05-30T06:51:39.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.112+0000 7fb209200640 1 -- 172.21.15.37:0/526758748 shutdown_connections 2024-05-30T06:51:39.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.112+0000 7fb209200640 1 --2- 172.21.15.37:0/526758748 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb1e40695f0 0x7fb1e406bab0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:39.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.112+0000 7fb209200640 1 --2- 172.21.15.37:0/526758748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb204166490 0x7fb204166940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:39.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.112+0000 7fb209200640 1 --2- 172.21.15.37:0/526758748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb204169350 0x7fb2041697d0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:39.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.112+0000 7fb209200640 1 --2- 172.21.15.37:0/526758748 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1e80039c0 0x7fb204167d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:39.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.112+0000 7fb209200640 1 -- 172.21.15.37:0/526758748 >> 172.21.15.37:0/526758748 conn(0x7fb204067b60 msgr2=0x7fb2040b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:39.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.112+0000 7fb209200640 1 -- 172.21.15.37:0/526758748 shutdown_connections 2024-05-30T06:51:39.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.112+0000 7fb209200640 1 -- 172.21.15.37:0/526758748 wait complete. 2024-05-30T06:51:39.139 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone37109 2024-05-30T06:51:39.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.352+0000 7fafefc00640 1 Processor -- start 2024-05-30T06:51:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.352+0000 7fafefc00640 1 -- start start 2024-05-30T06:51:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafefc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafe806e190 0x7fafe80bbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:39.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafefc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe80bc330 con 0x7fafe8162fb0 2024-05-30T06:51:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafefc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafe80bc610 con 0x7fafe806c070 2024-05-30T06:51:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafefc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fafe8163390 con 0x7fafe806e190 2024-05-30T06:51:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafe7e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fafe806c070 0x7fafe80d5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:40832/0 (socket says 172.21.15.37:40832) 2024-05-30T06:51:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafe7e00640 1 -- 172.21.15.37:0/4188142203 learned_addr learned my addr 172.21.15.37:0/4188142203 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:51:39.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafedc00640 1 --2- 172.21.15.37:0/4188142203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafe806e190 0x7fafe80bbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:39.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103148144 0 0) 0x7fafe80bc610 con 0x7fafe806c070 2024-05-30T06:51:39.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafd0003530 con 0x7fafe806c070 2024-05-30T06:51:39.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1735970132 0 0) 0x7fafe80bc330 con 0x7fafe8162fb0 2024-05-30T06:51:39.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafe80bc610 con 0x7fafe8162fb0 2024-05-30T06:51:39.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2742581009 0 0) 0x7fafd0003530 con 0x7fafe806c070 2024-05-30T06:51:39.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafe806e190 msgr2=0x7fafe80bbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:39.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.356+0000 7fafe7400640 1 --2- 172.21.15.37:0/4188142203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafe806e190 0x7fafe80bbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:39.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 >> v1:172.21.15.37:6789/0 conn(0x7fafe8162fb0 legacy=0x7fafe806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:39.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe80bc8f0 con 0x7fafe806c070 2024-05-30T06:51:39.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fafdc001680 con 0x7fafe806c070 2024-05-30T06:51:39.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 >> v1:172.21.15.105:6789/0 conn(0x7fafe806c070 legacy=0x7fafe80d5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:39.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafe7400640 1 --2- 172.21.15.37:0/4188142203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafd0003b50 0x7fafd0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:39.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafe7400640 1 --2- 172.21.15.37:0/4188142203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd0004810 0x7fafd0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:39.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafe7400640 1 --2- 172.21.15.37:0/4188142203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd00051d0 0x7fafd000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:39.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fafd000bff0 con 0x7fafd00051d0 2024-05-30T06:51:39.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fafd000c1a0 con 0x7fafd0004810 2024-05-30T06:51:39.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fafd000c3a0 con 0x7fafd0003b50 2024-05-30T06:51:39.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafedc00640 1 --2- 172.21.15.37:0/4188142203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd00051d0 0x7fafd000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:39.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafe7e00640 1 --2- 172.21.15.37:0/4188142203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd0004810 0x7fafd0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:39.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafedc00640 1 -- 172.21.15.37:0/4188142203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafd0003b50 msgr2=0x7fafd0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:39.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafedc00640 1 --2- 172.21.15.37:0/4188142203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafd0003b50 0x7fafd0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:39.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafedc00640 1 -- 172.21.15.37:0/4188142203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd0004810 msgr2=0x7fafd0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:39.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafedc00640 1 --2- 172.21.15.37:0/4188142203 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd0004810 0x7fafd0004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:39.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.360+0000 7fafedc00640 1 -- 172.21.15.37:0/4188142203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe80bc8f0 con 0x7fafd00051d0 2024-05-30T06:51:39.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.364+0000 7fafedc00640 1 --2- 172.21.15.37:0/4188142203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd00051d0 0x7fafd000b9d0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fafe806e570 tx=0x7fafe001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64fce73c9ba75da server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:39.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.364+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe00b2070 con 0x7fafd00051d0 2024-05-30T06:51:39.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.364+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe00a5bf0 con 0x7fafd00051d0 2024-05-30T06:51:39.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.364+0000 7fafe7400640 1 -- 172.21.15.37:0/4188142203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe0009bb0 con 0x7fafd00051d0 2024-05-30T06:51:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.368+0000 7fafefc00640 1 -- 172.21.15.37:0/4188142203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd00051d0 msgr2=0x7fafd000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.368+0000 7fafefc00640 1 --2- 172.21.15.37:0/4188142203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd00051d0 0x7fafd000b9d0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fafe806e570 tx=0x7fafe001cba0 comp rx=0 tx=0).stop 2024-05-30T06:51:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.368+0000 7fafedc00640 1 -- 172.21.15.37:0/4188142203 reap_dead start 2024-05-30T06:51:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.368+0000 7fafefc00640 1 -- 172.21.15.37:0/4188142203 shutdown_connections 2024-05-30T06:51:39.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.368+0000 7fafefc00640 1 -- 172.21.15.37:0/4188142203 >> 172.21.15.37:0/4188142203 conn(0x7fafe80ba9a0 msgr2=0x7fafe80badb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:39.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.368+0000 7fafefc00640 1 -- 172.21.15.37:0/4188142203 shutdown_connections 2024-05-30T06:51:39.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.368+0000 7fafefc00640 1 -- 172.21.15.37:0/4188142203 wait complete. 2024-05-30T06:51:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafefc00640 1 Processor -- start 2024-05-30T06:51:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafefc00640 1 -- start start 2024-05-30T06:51:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafefc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd00051d0 0x7fafe814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafefc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80b2100 0x7fafe814d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafefc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafe814dda0 0x7fafe814adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafefc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fafe80bbca0 con 0x7fafe80b2100 2024-05-30T06:51:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafefc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fafe806fc10 con 0x7fafd00051d0 2024-05-30T06:51:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafefc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fafe80bbe20 con 0x7fafe814dda0 2024-05-30T06:51:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafe7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80b2100 0x7fafe814d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafe7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80b2100 0x7fafe814d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35704/0 (socket says 172.21.15.37:35704) 2024-05-30T06:51:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafed200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd00051d0 0x7fafe814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafe7e00640 1 -- 172.21.15.37:0/778143761 learned_addr learned my addr 172.21.15.37:0/778143761 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafedc00640 1 --2- 172.21.15.37:0/778143761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafe814dda0 0x7fafe814adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafe7e00640 1 -- 172.21.15.37:0/778143761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafe814dda0 msgr2=0x7fafe814adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafe7e00640 1 --2- 172.21.15.37:0/778143761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafe814dda0 0x7fafe814adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafe7e00640 1 -- 172.21.15.37:0/778143761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd00051d0 msgr2=0x7fafe814bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.372+0000 7fafe7e00640 1 --2- 172.21.15.37:0/778143761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd00051d0 0x7fafe814bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:39.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.376+0000 7fafe7e00640 1 -- 172.21.15.37:0/778143761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe814c170 con 0x7fafe80b2100 2024-05-30T06:51:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.376+0000 7fafe7e00640 1 --2- 172.21.15.37:0/778143761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80b2100 0x7fafe814d210 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00d7c0 tx=0x7fafdc00dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.376+0000 7fafe4c00640 1 -- 172.21.15.37:0/778143761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc019070 con 0x7fafe80b2100 2024-05-30T06:51:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.376+0000 7fafe4c00640 1 -- 172.21.15.37:0/778143761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafdc0074e0 con 0x7fafe80b2100 2024-05-30T06:51:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.376+0000 7fafefc00640 1 -- 172.21.15.37:0/778143761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafe814c450 con 0x7fafe80b2100 2024-05-30T06:51:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.376+0000 7fafe4c00640 1 -- 172.21.15.37:0/778143761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafdc0049f0 con 0x7fafe80b2100 2024-05-30T06:51:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.376+0000 7fafefc00640 1 -- 172.21.15.37:0/778143761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafe814ca10 con 0x7fafe80b2100 2024-05-30T06:51:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.380+0000 7fafe4c00640 1 -- 172.21.15.37:0/778143761 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7fafdc01c070 con 0x7fafe80b2100 2024-05-30T06:51:39.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.380+0000 7fafefc00640 1 -- 172.21.15.37:0/778143761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafe8068bc0 con 0x7fafe80b2100 2024-05-30T06:51:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.380+0000 7fafe4c00640 1 --2- 172.21.15.37:0/778143761 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafc8069570 0x7fafc806ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:39.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.380+0000 7fafe4c00640 1 -- 172.21.15.37:0/778143761 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fafdc085210 con 0x7fafe80b2100 2024-05-30T06:51:39.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.384+0000 7fafed200640 1 --2- 172.21.15.37:0/778143761 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafc8069570 0x7fafc806ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:39.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.384+0000 7fafed200640 1 --2- 172.21.15.37:0/778143761 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafc8069570 0x7fafc806ba30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fafd400ae70 tx=0x7fafd400c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:39.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.392+0000 7fafe4c00640 1 -- 172.21.15.37:0/778143761 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fafdc056880 con 0x7fafe80b2100 2024-05-30T06:51:39.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:39.696+0000 7fafefc00640 1 -- 172.21.15.37:0/778143761 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone37109", "target": ["mon-mgr", ""]}) -- 0x7fafe806b960 con 0x7fafc8069570 2024-05-30T06:51:40.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.376+0000 7fafe4c00640 1 -- 172.21.15.37:0/778143761 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fafe806b960 con 0x7fafc8069570 2024-05-30T06:51:40.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.376+0000 7fafefc00640 1 -- 172.21.15.37:0/778143761 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafc8069570 msgr2=0x7fafc806ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:40.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.376+0000 7fafefc00640 1 --2- 172.21.15.37:0/778143761 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafc8069570 0x7fafc806ba30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fafd400ae70 tx=0x7fafd400c040 comp rx=0 tx=0).stop 2024-05-30T06:51:40.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.376+0000 7fafefc00640 1 -- 172.21.15.37:0/778143761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80b2100 msgr2=0x7fafe814d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.376+0000 7fafefc00640 1 --2- 172.21.15.37:0/778143761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80b2100 0x7fafe814d210 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fafdc00d7c0 tx=0x7fafdc00dc80 comp rx=0 tx=0).stop 2024-05-30T06:51:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.376+0000 7fafefc00640 1 -- 172.21.15.37:0/778143761 shutdown_connections 2024-05-30T06:51:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.376+0000 7fafefc00640 1 --2- 172.21.15.37:0/778143761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafe814dda0 0x7fafe814adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.376+0000 7fafefc00640 1 --2- 172.21.15.37:0/778143761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80b2100 0x7fafe814d210 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.376+0000 7fafefc00640 1 --2- 172.21.15.37:0/778143761 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafc8069570 0x7fafc806ba30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.376+0000 7fafefc00640 1 --2- 172.21.15.37:0/778143761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd00051d0 0x7fafe814bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.376+0000 7fafefc00640 1 -- 172.21.15.37:0/778143761 >> 172.21.15.37:0/778143761 conn(0x7fafe80ba9a0 msgr2=0x7fafe80b8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.376+0000 7fafefc00640 1 -- 172.21.15.37:0/778143761 shutdown_connections 2024-05-30T06:51:40.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.376+0000 7fafefc00640 1 -- 172.21.15.37:0/778143761 wait complete. 2024-05-30T06:51:40.403 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone371010 2024-05-30T06:51:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.568+0000 7f4970400640 1 Processor -- start 2024-05-30T06:51:40.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.568+0000 7f4970400640 1 -- start start 2024-05-30T06:51:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f4970400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f49680d0c60 0x7f496815da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f4970400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49680d1040 0x7f49680d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f4970400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49680d07b0 0x7f4968160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f4970400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f49680cd350 con 0x7f49680d1040 2024-05-30T06:51:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f4970400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f49680cd610 con 0x7f49680d0c60 2024-05-30T06:51:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f4970400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f49680cd8f0 con 0x7f49680d07b0 2024-05-30T06:51:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f496d000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49680d1040 0x7f49680d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f496d000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49680d1040 0x7f49680d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35712/0 (socket says 172.21.15.37:35712) 2024-05-30T06:51:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f496d000640 1 -- 172.21.15.37:0/3964714125 learned_addr learned my addr 172.21.15.37:0/3964714125 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f496e400640 1 --2- 172.21.15.37:0/3964714125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49680d07b0 0x7f4968160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f496da00640 1 --2- 172.21.15.37:0/3964714125 >> v2:172.21.15.105:3300/0 conn(0x7f49680d0c60 0x7f496815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f496d000640 1 -- 172.21.15.37:0/3964714125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49680d07b0 msgr2=0x7f4968160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f496d000640 1 --2- 172.21.15.37:0/3964714125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49680d07b0 0x7f4968160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f496d000640 1 -- 172.21.15.37:0/3964714125 >> v2:172.21.15.105:3300/0 conn(0x7f49680d0c60 msgr2=0x7f496815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f496d000640 1 --2- 172.21.15.37:0/3964714125 >> v2:172.21.15.105:3300/0 conn(0x7f49680d0c60 0x7f496815da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f496d000640 1 -- 172.21.15.37:0/3964714125 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49680cdbd0 con 0x7f49680d1040 2024-05-30T06:51:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.572+0000 7f496e400640 1 --2- 172.21.15.37:0/3964714125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49680d07b0 0x7f4968160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:51:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f496d000640 1 --2- 172.21.15.37:0/3964714125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49680d1040 0x7f49680d0270 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f4968073290 tx=0x7f495401c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c0c36e55bddbc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:40.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4967e00640 1 -- 172.21.15.37:0/3964714125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49540b0070 con 0x7f49680d1040 2024-05-30T06:51:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4967e00640 1 -- 172.21.15.37:0/3964714125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49540ab600 con 0x7f49680d1040 2024-05-30T06:51:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4967e00640 1 -- 172.21.15.37:0/3964714125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49540ab9d0 con 0x7f49680d1040 2024-05-30T06:51:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4970400640 1 -- 172.21.15.37:0/3964714125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49680d1040 msgr2=0x7f49680d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4970400640 1 --2- 172.21.15.37:0/3964714125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49680d1040 0x7f49680d0270 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f4968073290 tx=0x7f495401c1d0 comp rx=0 tx=0).stop 2024-05-30T06:51:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4970400640 1 -- 172.21.15.37:0/3964714125 shutdown_connections 2024-05-30T06:51:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4970400640 1 --2- 172.21.15.37:0/3964714125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49680d07b0 0x7f4968160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4970400640 1 --2- 172.21.15.37:0/3964714125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49680d1040 0x7f49680d0270 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4970400640 1 --2- 172.21.15.37:0/3964714125 >> v2:172.21.15.105:3300/0 conn(0x7f49680d0c60 0x7f496815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4970400640 1 -- 172.21.15.37:0/3964714125 >> 172.21.15.37:0/3964714125 conn(0x7f49680b4190 msgr2=0x7f49680b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4970400640 1 -- 172.21.15.37:0/3964714125 shutdown_connections 2024-05-30T06:51:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4970400640 1 -- 172.21.15.37:0/3964714125 wait complete. 2024-05-30T06:51:40.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4970400640 1 Processor -- start 2024-05-30T06:51:40.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4970400640 1 -- start start 2024-05-30T06:51:40.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4970400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49680d07b0 0x7f49680c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:40.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.576+0000 7f4970400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49680d0c60 0x7f496806df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:40.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f4970400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49680d1040 0x7f49680b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:40.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f4970400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f496809aa60 con 0x7f49680d1040 2024-05-30T06:51:40.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f4970400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f49680ce5e0 con 0x7f49680d07b0 2024-05-30T06:51:40.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f4970400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f496809abe0 con 0x7f49680d0c60 2024-05-30T06:51:40.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f496e400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49680d1040 0x7f49680b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:40.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f496e400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49680d1040 0x7f49680b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35724/0 (socket says 172.21.15.37:35724) 2024-05-30T06:51:40.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f496e400640 1 -- 172.21.15.37:0/2106638423 learned_addr learned my addr 172.21.15.37:0/2106638423 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:40.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f496da00640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49680d07b0 0x7f49680c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:40.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f496d000640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49680d0c60 0x7f496806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:40.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f496e400640 1 -- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49680d0c60 msgr2=0x7f496806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:40.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f496e400640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49680d0c60 0x7f496806df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:40.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f496e400640 1 -- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49680d07b0 msgr2=0x7f49680c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:40.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f496e400640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49680d07b0 0x7f49680c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:40.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f496e400640 1 -- 172.21.15.37:0/2106638423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496806d650 con 0x7f49680d1040 2024-05-30T06:51:40.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f496e400640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49680d1040 0x7f49680b3050 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f4960007ef0 tx=0x7f496000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:40.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f4965600640 1 -- 172.21.15.37:0/2106638423 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496001a070 con 0x7f49680d1040 2024-05-30T06:51:40.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f4965600640 1 -- 172.21.15.37:0/2106638423 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4960003ba0 con 0x7f49680d1040 2024-05-30T06:51:40.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f4965600640 1 -- 172.21.15.37:0/2106638423 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4960004030 con 0x7f49680d1040 2024-05-30T06:51:40.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f4970400640 1 -- 172.21.15.37:0/2106638423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496806d930 con 0x7f49680d1040 2024-05-30T06:51:40.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f4970400640 1 -- 172.21.15.37:0/2106638423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49680af3c0 con 0x7f49680d1040 2024-05-30T06:51:40.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f4970400640 1 -- 172.21.15.37:0/2106638423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4968068bc0 con 0x7f49680d1040 2024-05-30T06:51:40.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.580+0000 7f4965600640 1 -- 172.21.15.37:0/2106638423 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7f496001d070 con 0x7f49680d1040 2024-05-30T06:51:40.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.584+0000 7f4965600640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4948069520 0x7f494806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:40.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.584+0000 7f4965600640 1 -- 172.21.15.37:0/2106638423 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f4960085ac0 con 0x7f49680d1040 2024-05-30T06:51:40.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.584+0000 7f496da00640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4948069520 0x7f494806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:40.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.584+0000 7f496da00640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4948069520 0x7f494806b9e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f495c009ae0 tx=0x7f495c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.588+0000 7f4965600640 1 -- 172.21.15.37:0/2106638423 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4960010070 con 0x7f49680d1040 2024-05-30T06:51:40.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:40.788+0000 7f4970400640 1 -- 172.21.15.37:0/2106638423 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone371010", "target": ["mon-mgr", ""]}) -- 0x7f49680b8620 con 0x7f4948069520 2024-05-30T06:51:45.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.344+0000 7f4965600640 1 -- 172.21.15.37:0/2106638423 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f49680b8620 con 0x7f4948069520 2024-05-30T06:51:45.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.348+0000 7f4970400640 1 -- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4948069520 msgr2=0x7f494806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:45.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.348+0000 7f4970400640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4948069520 0x7f494806b9e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f495c009ae0 tx=0x7f495c009190 comp rx=0 tx=0).stop 2024-05-30T06:51:45.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.348+0000 7f4970400640 1 -- 172.21.15.37:0/2106638423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49680d1040 msgr2=0x7f49680b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:45.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.348+0000 7f4970400640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49680d1040 0x7f49680b3050 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f4960007ef0 tx=0x7f496000d4a0 comp rx=0 tx=0).stop 2024-05-30T06:51:45.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.348+0000 7f4970400640 1 -- 172.21.15.37:0/2106638423 shutdown_connections 2024-05-30T06:51:45.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.348+0000 7f4970400640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49680d1040 0x7f49680b3050 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:45.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.348+0000 7f4970400640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49680d0c60 0x7f496806df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:45.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.348+0000 7f4970400640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4948069520 0x7f494806b9e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:45.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.348+0000 7f4970400640 1 --2- 172.21.15.37:0/2106638423 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49680d07b0 0x7f49680c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:45.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.348+0000 7f4970400640 1 -- 172.21.15.37:0/2106638423 >> 172.21.15.37:0/2106638423 conn(0x7f49680b4190 msgr2=0x7f4968070280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:45.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.348+0000 7f4970400640 1 -- 172.21.15.37:0/2106638423 shutdown_connections 2024-05-30T06:51:45.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.348+0000 7f4970400640 1 -- 172.21.15.37:0/2106638423 wait complete. 2024-05-30T06:51:45.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone371011 2024-05-30T06:51:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.592+0000 7fd5c6600640 1 Processor -- start 2024-05-30T06:51:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.592+0000 7fd5c6600640 1 -- start start 2024-05-30T06:51:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.596+0000 7fd5c6600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd5c0072510 0x7fd5c00b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.596+0000 7fd5c6600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5c00b50d0 0x7fd5c00aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.596+0000 7fd5c6600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5c006dfc0 con 0x7fd5c01472f0 2024-05-30T06:51:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.596+0000 7fd5c6600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd5c00b58c0 con 0x7fd5c0072510 2024-05-30T06:51:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.596+0000 7fd5c6600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c006e2a0 con 0x7fd5c00b50d0 2024-05-30T06:51:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.596+0000 7fd5bfe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd5c0072510 0x7fd5c00b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.596+0000 7fd5bfe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd5c0072510 0x7fd5c00b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35736/0 (socket says 172.21.15.37:35736) 2024-05-30T06:51:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.596+0000 7fd5bfe00640 1 -- 172.21.15.37:0/2746582017 learned_addr learned my addr 172.21.15.37:0/2746582017 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.596+0000 7fd5bfe00640 1 -- 172.21.15.37:0/2746582017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5c00b50d0 msgr2=0x7fd5c00aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.596+0000 7fd5bfe00640 1 --2- 172.21.15.37:0/2746582017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5c00b50d0 0x7fd5c00aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.596+0000 7fd5bfe00640 1 -- 172.21.15.37:0/2746582017 >> v1:172.21.15.105:6789/0 conn(0x7fd5c01472f0 legacy=0x7fd5c0071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.596+0000 7fd5bfe00640 1 -- 172.21.15.37:0/2746582017 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c006e580 con 0x7fd5c0072510 2024-05-30T06:51:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.600+0000 7fd5bfe00640 1 --2- 172.21.15.37:0/2746582017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5c0072510 0x7fd5c00b4b90 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009870 tx=0x7fd5a801cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4573836231742d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:45.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.600+0000 7fd5bf400640 1 -- 172.21.15.37:0/2746582017 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80aa430 con 0x7fd5c0072510 2024-05-30T06:51:45.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.600+0000 7fd5bf400640 1 -- 172.21.15.37:0/2746582017 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a80af070 con 0x7fd5c0072510 2024-05-30T06:51:45.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.600+0000 7fd5bf400640 1 -- 172.21.15.37:0/2746582017 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80aa7f0 con 0x7fd5c0072510 2024-05-30T06:51:45.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.604+0000 7fd5c6600640 1 -- 172.21.15.37:0/2746582017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5c0072510 msgr2=0x7fd5c00b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:45.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.604+0000 7fd5c6600640 1 --2- 172.21.15.37:0/2746582017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5c0072510 0x7fd5c00b4b90 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009870 tx=0x7fd5a801cf50 comp rx=0 tx=0).stop 2024-05-30T06:51:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.604+0000 7fd5c6600640 1 -- 172.21.15.37:0/2746582017 shutdown_connections 2024-05-30T06:51:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.604+0000 7fd5c6600640 1 --2- 172.21.15.37:0/2746582017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5c00b50d0 0x7fd5c00aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.604+0000 7fd5c6600640 1 --2- 172.21.15.37:0/2746582017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5c0072510 0x7fd5c00b4b90 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.604+0000 7fd5c6600640 1 -- 172.21.15.37:0/2746582017 >> 172.21.15.37:0/2746582017 conn(0x7fd5c0067b60 msgr2=0x7fd5c006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.604+0000 7fd5c6600640 1 -- 172.21.15.37:0/2746582017 shutdown_connections 2024-05-30T06:51:45.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.604+0000 7fd5c6600640 1 -- 172.21.15.37:0/2746582017 wait complete. 2024-05-30T06:51:45.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.604+0000 7fd5c6600640 1 Processor -- start 2024-05-30T06:51:45.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c6600640 1 -- start start 2024-05-30T06:51:45.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c6600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5c0072510 0x7fd5c0133b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:45.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c6600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5c00b50d0 0x7fd5c0135400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:45.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c6600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5c01472f0 0x7fd5c015d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:45.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c6600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c006eee0 con 0x7fd5c0072510 2024-05-30T06:51:45.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c6600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c006ed60 con 0x7fd5c00b50d0 2024-05-30T06:51:45.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c6600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c00af810 con 0x7fd5c01472f0 2024-05-30T06:51:45.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5c0072510 0x7fd5c0133b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:45.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5c0072510 0x7fd5c0133b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35750/0 (socket says 172.21.15.37:35750) 2024-05-30T06:51:45.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c5200640 1 -- 172.21.15.37:0/814236861 learned_addr learned my addr 172.21.15.37:0/814236861 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:45.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c5200640 1 -- 172.21.15.37:0/814236861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5c01472f0 msgr2=0x7fd5c015d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:45.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c5200640 1 --2- 172.21.15.37:0/814236861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5c01472f0 0x7fd5c015d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:45.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c5200640 1 -- 172.21.15.37:0/814236861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5c00b50d0 msgr2=0x7fd5c0135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:45.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c5200640 1 --2- 172.21.15.37:0/814236861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5c00b50d0 0x7fd5c0135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:45.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c5200640 1 -- 172.21.15.37:0/814236861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c0134360 con 0x7fd5c0072510 2024-05-30T06:51:45.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c5200640 1 --2- 172.21.15.37:0/814236861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5c0072510 0x7fd5c0133b10 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800ba50 tx=0x7fd5b800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:45.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5bcc00640 1 -- 172.21.15.37:0/814236861 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8019070 con 0x7fd5c0072510 2024-05-30T06:51:45.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5bcc00640 1 -- 172.21.15.37:0/814236861 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b800cc20 con 0x7fd5c0072510 2024-05-30T06:51:45.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5bcc00640 1 -- 172.21.15.37:0/814236861 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8014680 con 0x7fd5c0072510 2024-05-30T06:51:45.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c6600640 1 -- 172.21.15.37:0/814236861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c0134640 con 0x7fd5c0072510 2024-05-30T06:51:45.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.608+0000 7fd5c6600640 1 -- 172.21.15.37:0/814236861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c0134ee0 con 0x7fd5c0072510 2024-05-30T06:51:45.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.612+0000 7fd5c6600640 1 -- 172.21.15.37:0/814236861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c0134a30 con 0x7fd5c0072510 2024-05-30T06:51:45.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.612+0000 7fd5bcc00640 1 -- 172.21.15.37:0/814236861 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7fd5b801c070 con 0x7fd5c0072510 2024-05-30T06:51:45.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.612+0000 7fd5bcc00640 1 --2- 172.21.15.37:0/814236861 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd59c0694f0 0x7fd59c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:45.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.612+0000 7fd5bcc00640 1 -- 172.21.15.37:0/814236861 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fd5b8085530 con 0x7fd5c0072510 2024-05-30T06:51:45.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.620+0000 7fd5bfe00640 1 --2- 172.21.15.37:0/814236861 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd59c0694f0 0x7fd59c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:45.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.620+0000 7fd5bcc00640 1 -- 172.21.15.37:0/814236861 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd5b8056be0 con 0x7fd5c0072510 2024-05-30T06:51:45.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.644+0000 7fd5bfe00640 1 --2- 172.21.15.37:0/814236861 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd59c0694f0 0x7fd59c06b9b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80ae000 tx=0x7fd5a80046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:45.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:45.976+0000 7fd5c6600640 1 -- 172.21.15.37:0/814236861 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone371011", "target": ["mon-mgr", ""]}) -- 0x7fd5c0068700 con 0x7fd59c0694f0 2024-05-30T06:51:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:46.836+0000 7fd5bcc00640 1 -- 172.21.15.37:0/814236861 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd5c0068700 con 0x7fd59c0694f0 2024-05-30T06:51:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:46.840+0000 7fd5c6600640 1 -- 172.21.15.37:0/814236861 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd59c0694f0 msgr2=0x7fd59c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:46.840+0000 7fd5c6600640 1 --2- 172.21.15.37:0/814236861 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd59c0694f0 0x7fd59c06b9b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80ae000 tx=0x7fd5a80046d0 comp rx=0 tx=0).stop 2024-05-30T06:51:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:46.840+0000 7fd5c6600640 1 -- 172.21.15.37:0/814236861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5c0072510 msgr2=0x7fd5c0133b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:46.840+0000 7fd5c6600640 1 --2- 172.21.15.37:0/814236861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5c0072510 0x7fd5c0133b10 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800ba50 tx=0x7fd5b800bf10 comp rx=0 tx=0).stop 2024-05-30T06:51:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:46.840+0000 7fd5c6600640 1 -- 172.21.15.37:0/814236861 shutdown_connections 2024-05-30T06:51:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:46.840+0000 7fd5c6600640 1 --2- 172.21.15.37:0/814236861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5c01472f0 0x7fd5c015d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:46.840+0000 7fd5c6600640 1 --2- 172.21.15.37:0/814236861 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd59c0694f0 0x7fd59c06b9b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:46.840+0000 7fd5c6600640 1 --2- 172.21.15.37:0/814236861 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5c00b50d0 0x7fd5c0135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:46.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:46.840+0000 7fd5c6600640 1 --2- 172.21.15.37:0/814236861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5c0072510 0x7fd5c0133b10 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:46.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:46.840+0000 7fd5c6600640 1 -- 172.21.15.37:0/814236861 >> 172.21.15.37:0/814236861 conn(0x7fd5c0067b60 msgr2=0x7fd5c015ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:46.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:46.840+0000 7fd5c6600640 1 -- 172.21.15.37:0/814236861 shutdown_connections 2024-05-30T06:51:46.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:46.840+0000 7fd5c6600640 1 -- 172.21.15.37:0/814236861 wait complete. 2024-05-30T06:51:46.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone371012 2024-05-30T06:51:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.172+0000 7fac81800640 1 Processor -- start 2024-05-30T06:51:47.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.172+0000 7fac81800640 1 -- start start 2024-05-30T06:51:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac81800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7c0b6180 0x7fac7c0b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac81800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fac7c0ae5b0 0x7fac7c0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac81800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac7c0b6aa0 con 0x7fac7c162d80 2024-05-30T06:51:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac81800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fac7c0b1180 con 0x7fac7c0ae5b0 2024-05-30T06:51:47.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac81800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fac7c0b1460 con 0x7fac7c0b6180 2024-05-30T06:51:47.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac7be00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7c0b6180 0x7fac7c0b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:47.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac7be00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7c0b6180 0x7fac7c0b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:55236/0 (socket says 172.21.15.37:55236) 2024-05-30T06:51:47.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac7be00640 1 -- 172.21.15.37:0/2218924399 learned_addr learned my addr 172.21.15.37:0/2218924399 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:47.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac80e00640 1 --2- 172.21.15.37:0/2218924399 >> v2:172.21.15.105:3300/0 conn(0x7fac7c0ae5b0 0x7fac7c0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:47.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac7be00640 1 -- 172.21.15.37:0/2218924399 >> v2:172.21.15.105:3300/0 conn(0x7fac7c0ae5b0 msgr2=0x7fac7c0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:47.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac7be00640 1 --2- 172.21.15.37:0/2218924399 >> v2:172.21.15.105:3300/0 conn(0x7fac7c0ae5b0 0x7fac7c0aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:47.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac7be00640 1 -- 172.21.15.37:0/2218924399 >> v1:172.21.15.37:6789/0 conn(0x7fac7c162d80 legacy=0x7fac7c0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:47.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac7aa00640 1 -- 172.21.15.37:0/2218924399 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354032315 0 0) 0x7fac7c0b6aa0 con 0x7fac7c162d80 2024-05-30T06:51:47.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.176+0000 7fac7be00640 1 -- 172.21.15.37:0/2218924399 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7c0b1740 con 0x7fac7c0b6180 2024-05-30T06:51:47.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.188+0000 7fac7be00640 1 --2- 172.21.15.37:0/2218924399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7c0b6180 0x7fac7c0b6560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009870 tx=0x7fac6c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbcd5134d9eb6cbe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:47.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.188+0000 7fac7aa00640 1 -- 172.21.15.37:0/2218924399 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c0ab650 con 0x7fac7c0b6180 2024-05-30T06:51:47.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.188+0000 7fac7aa00640 1 -- 172.21.15.37:0/2218924399 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6c0b0070 con 0x7fac7c0b6180 2024-05-30T06:51:47.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.188+0000 7fac7aa00640 1 -- 172.21.15.37:0/2218924399 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c0aba10 con 0x7fac7c0b6180 2024-05-30T06:51:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.192+0000 7fac81800640 1 -- 172.21.15.37:0/2218924399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7c0b6180 msgr2=0x7fac7c0b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.192+0000 7fac81800640 1 --2- 172.21.15.37:0/2218924399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7c0b6180 0x7fac7c0b6560 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009870 tx=0x7fac6c01c560 comp rx=0 tx=0).stop 2024-05-30T06:51:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.192+0000 7fac81800640 1 -- 172.21.15.37:0/2218924399 shutdown_connections 2024-05-30T06:51:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.192+0000 7fac81800640 1 --2- 172.21.15.37:0/2218924399 >> v2:172.21.15.105:3300/0 conn(0x7fac7c0ae5b0 0x7fac7c0aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.192+0000 7fac81800640 1 --2- 172.21.15.37:0/2218924399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7c0b6180 0x7fac7c0b6560 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.192+0000 7fac81800640 1 -- 172.21.15.37:0/2218924399 >> 172.21.15.37:0/2218924399 conn(0x7fac7c06d4f0 msgr2=0x7fac7c09aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.192+0000 7fac81800640 1 -- 172.21.15.37:0/2218924399 shutdown_connections 2024-05-30T06:51:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.192+0000 7fac81800640 1 -- 172.21.15.37:0/2218924399 wait complete. 2024-05-30T06:51:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.196+0000 7fac81800640 1 Processor -- start 2024-05-30T06:51:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.196+0000 7fac81800640 1 -- start start 2024-05-30T06:51:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.200+0000 7fac81800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac7c0ae5b0 0x7fac7c158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.200+0000 7fac81800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac7c0b6180 0x7fac7c161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.200+0000 7fac81800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7c162d80 0x7fac7c09b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.200+0000 7fac81800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c06c3a0 con 0x7fac7c0ae5b0 2024-05-30T06:51:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.200+0000 7fac81800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c06c220 con 0x7fac7c0b6180 2024-05-30T06:51:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.200+0000 7fac81800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fac7c06c520 con 0x7fac7c162d80 2024-05-30T06:51:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.200+0000 7fac7be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac7c0ae5b0 0x7fac7c158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.200+0000 7fac7be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac7c0ae5b0 0x7fac7c158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35758/0 (socket says 172.21.15.37:35758) 2024-05-30T06:51:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.200+0000 7fac7be00640 1 -- 172.21.15.37:0/2407666154 learned_addr learned my addr 172.21.15.37:0/2407666154 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:47.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.204+0000 7fac7be00640 1 -- 172.21.15.37:0/2407666154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7c162d80 msgr2=0x7fac7c09b960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:51:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.204+0000 7fac7be00640 1 --2- 172.21.15.37:0/2407666154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7c162d80 0x7fac7c09b960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.204+0000 7fac7be00640 1 -- 172.21.15.37:0/2407666154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac7c0b6180 msgr2=0x7fac7c161bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:51:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.204+0000 7fac7be00640 1 --2- 172.21.15.37:0/2407666154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac7c0b6180 0x7fac7c161bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.204+0000 7fac7be00640 1 -- 172.21.15.37:0/2407666154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7c0b50d0 con 0x7fac7c0ae5b0 2024-05-30T06:51:47.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.204+0000 7fac7be00640 1 --2- 172.21.15.37:0/2407666154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac7c0ae5b0 0x7fac7c158570 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0ad040 tx=0x7fac6c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.204+0000 7fac73e00640 1 -- 172.21.15.37:0/2407666154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c0be5f0 con 0x7fac7c0ae5b0 2024-05-30T06:51:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.204+0000 7fac73e00640 1 -- 172.21.15.37:0/2407666154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6c0be7b0 con 0x7fac7c0ae5b0 2024-05-30T06:51:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.204+0000 7fac73e00640 1 -- 172.21.15.37:0/2407666154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c0beba0 con 0x7fac7c0ae5b0 2024-05-30T06:51:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.204+0000 7fac81800640 1 -- 172.21.15.37:0/2407666154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7c068ab0 con 0x7fac7c0ae5b0 2024-05-30T06:51:47.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.204+0000 7fac81800640 1 -- 172.21.15.37:0/2407666154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac7c1577b0 con 0x7fac7c0ae5b0 2024-05-30T06:51:47.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.204+0000 7fac81800640 1 -- 172.21.15.37:0/2407666154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac7c075580 con 0x7fac7c0ae5b0 2024-05-30T06:51:47.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.208+0000 7fac73e00640 1 -- 172.21.15.37:0/2407666154 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7fac6c0c7430 con 0x7fac7c0ae5b0 2024-05-30T06:51:47.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.208+0000 7fac73e00640 1 --2- 172.21.15.37:0/2407666154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fac5c0694f0 0x7fac5c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:47.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.208+0000 7fac73e00640 1 -- 172.21.15.37:0/2407666154 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fac6c1207a0 con 0x7fac7c0ae5b0 2024-05-30T06:51:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.216+0000 7fac73e00640 1 -- 172.21.15.37:0/2407666154 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fac6c016150 con 0x7fac7c0ae5b0 2024-05-30T06:51:47.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.224+0000 7fac7b400640 1 --2- 172.21.15.37:0/2407666154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fac5c0694f0 0x7fac5c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:47.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.252+0000 7fac7b400640 1 --2- 172.21.15.37:0/2407666154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fac5c0694f0 0x7fac5c06b9b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fac68000f70 tx=0x7fac68007890 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:47.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:47.548+0000 7fac81800640 1 -- 172.21.15.37:0/2407666154 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone371012", "target": ["mon-mgr", ""]}) -- 0x7fac7c160ed0 con 0x7fac5c0694f0 2024-05-30T06:51:48.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.284+0000 7fac73e00640 1 -- 172.21.15.37:0/2407666154 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fac7c160ed0 con 0x7fac5c0694f0 2024-05-30T06:51:48.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.288+0000 7fac81800640 1 -- 172.21.15.37:0/2407666154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fac5c0694f0 msgr2=0x7fac5c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:48.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.288+0000 7fac81800640 1 --2- 172.21.15.37:0/2407666154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fac5c0694f0 0x7fac5c06b9b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fac68000f70 tx=0x7fac68007890 comp rx=0 tx=0).stop 2024-05-30T06:51:48.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.288+0000 7fac81800640 1 -- 172.21.15.37:0/2407666154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac7c0ae5b0 msgr2=0x7fac7c158570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:48.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.288+0000 7fac81800640 1 --2- 172.21.15.37:0/2407666154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac7c0ae5b0 0x7fac7c158570 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0ad040 tx=0x7fac6c01ada0 comp rx=0 tx=0).stop 2024-05-30T06:51:48.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.288+0000 7fac81800640 1 -- 172.21.15.37:0/2407666154 shutdown_connections 2024-05-30T06:51:48.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.288+0000 7fac81800640 1 --2- 172.21.15.37:0/2407666154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7c162d80 0x7fac7c09b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:48.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.288+0000 7fac81800640 1 --2- 172.21.15.37:0/2407666154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fac5c0694f0 0x7fac5c06b9b0 secure :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fac68000f70 tx=0x7fac68007890 comp rx=0 tx=0).stop 2024-05-30T06:51:48.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.288+0000 7fac81800640 1 --2- 172.21.15.37:0/2407666154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac7c0b6180 0x7fac7c161bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:48.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.288+0000 7fac81800640 1 --2- 172.21.15.37:0/2407666154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac7c0ae5b0 0x7fac7c158570 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:48.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.288+0000 7fac81800640 1 -- 172.21.15.37:0/2407666154 >> 172.21.15.37:0/2407666154 conn(0x7fac7c06d4f0 msgr2=0x7fac7c070800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:48.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.292+0000 7fac81800640 1 -- 172.21.15.37:0/2407666154 shutdown_connections 2024-05-30T06:51:48.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.292+0000 7fac81800640 1 -- 172.21.15.37:0/2407666154 wait complete. 2024-05-30T06:51:48.329 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone371013 2024-05-30T06:51:48.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.520+0000 7f1f14200640 1 Processor -- start 2024-05-30T06:51:48.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.520+0000 7f1f14200640 1 -- start start 2024-05-30T06:51:48.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.520+0000 7f1f14200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1f0c162010 0x7f1f0c0cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:48.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.520+0000 7f1f14200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f0c0d4090 0x7f1f0c0cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:48.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.520+0000 7f1f14200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f0c0d1640 con 0x7f1f0c0d10d0 2024-05-30T06:51:48.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.520+0000 7f1f14200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1f0c0d2bf0 con 0x7f1f0c162010 2024-05-30T06:51:48.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.520+0000 7f1f14200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0c0d1920 con 0x7f1f0c0d4090 2024-05-30T06:51:48.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.524+0000 7f1f12200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f0c0d4090 0x7f1f0c0cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:48.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.524+0000 7f1f11800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1f0c162010 0x7f1f0c0cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:48.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.524+0000 7f1f12200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f0c0d4090 0x7f1f0c0cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:51410/0 (socket says 172.21.15.37:51410) 2024-05-30T06:51:48.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.524+0000 7f1f11800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1f0c162010 0x7f1f0c0cf4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:36052/0 (socket says 172.21.15.37:36052) 2024-05-30T06:51:48.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.524+0000 7f1f12200640 1 -- 172.21.15.37:0/754984771 learned_addr learned my addr 172.21.15.37:0/754984771 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:48.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.524+0000 7f1f12200640 1 -- 172.21.15.37:0/754984771 >> v2:172.21.15.105:3300/0 conn(0x7f1f0c162010 msgr2=0x7f1f0c0cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:48.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.524+0000 7f1f12200640 1 --2- 172.21.15.37:0/754984771 >> v2:172.21.15.105:3300/0 conn(0x7f1f0c162010 0x7f1f0c0cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.524+0000 7f1f12200640 1 -- 172.21.15.37:0/754984771 >> v1:172.21.15.105:6789/0 conn(0x7f1f0c0d10d0 legacy=0x7f1f0c162590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.524+0000 7f1f12200640 1 -- 172.21.15.37:0/754984771 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c0d1c00 con 0x7f1f0c0d4090 2024-05-30T06:51:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.532+0000 7f1f12200640 1 --2- 172.21.15.37:0/754984771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f0c0d4090 0x7f1f0c0cfa30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009e50 tx=0x7f1f0401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeae0aa88dc60e93 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.532+0000 7f1f0be00640 1 -- 172.21.15.37:0/754984771 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f040a5700 con 0x7f1f0c0d4090 2024-05-30T06:51:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.532+0000 7f1f0be00640 1 -- 172.21.15.37:0/754984771 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f040a58a0 con 0x7f1f0c0d4090 2024-05-30T06:51:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.532+0000 7f1f0be00640 1 -- 172.21.15.37:0/754984771 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f040a5c70 con 0x7f1f0c0d4090 2024-05-30T06:51:48.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.532+0000 7f1f14200640 1 -- 172.21.15.37:0/754984771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f0c0d4090 msgr2=0x7f1f0c0cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:48.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.532+0000 7f1f14200640 1 --2- 172.21.15.37:0/754984771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f0c0d4090 0x7f1f0c0cfa30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009e50 tx=0x7f1f0401ca30 comp rx=0 tx=0).stop 2024-05-30T06:51:48.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.536+0000 7f1f14200640 1 -- 172.21.15.37:0/754984771 shutdown_connections 2024-05-30T06:51:48.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.536+0000 7f1f14200640 1 --2- 172.21.15.37:0/754984771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f0c0d4090 0x7f1f0c0cfa30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:48.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.536+0000 7f1f14200640 1 --2- 172.21.15.37:0/754984771 >> v2:172.21.15.105:3300/0 conn(0x7f1f0c162010 0x7f1f0c0cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:48.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.536+0000 7f1f14200640 1 -- 172.21.15.37:0/754984771 >> 172.21.15.37:0/754984771 conn(0x7f1f0c06cc50 msgr2=0x7f1f0c06d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:48.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.536+0000 7f1f14200640 1 -- 172.21.15.37:0/754984771 shutdown_connections 2024-05-30T06:51:48.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.536+0000 7f1f14200640 1 -- 172.21.15.37:0/754984771 wait complete. 2024-05-30T06:51:48.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f14200640 1 Processor -- start 2024-05-30T06:51:48.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f14200640 1 -- start start 2024-05-30T06:51:48.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f14200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c0d10d0 0x7f1f0c158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f14200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f0c0d4090 0x7f1f0c161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f14200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f0c162010 0x7f1f0c0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f14200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c16bc60 con 0x7f1f0c0d10d0 2024-05-30T06:51:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f14200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c16bae0 con 0x7f1f0c162010 2024-05-30T06:51:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f14200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0c16bde0 con 0x7f1f0c0d4090 2024-05-30T06:51:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f11800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c0d10d0 0x7f1f0c158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f11800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c0d10d0 0x7f1f0c158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44898/0 (socket says 172.21.15.37:44898) 2024-05-30T06:51:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f11800640 1 -- 172.21.15.37:0/3409656773 learned_addr learned my addr 172.21.15.37:0/3409656773 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:48.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f10e00640 1 --2- 172.21.15.37:0/3409656773 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f0c0d4090 0x7f1f0c161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:48.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f11800640 1 -- 172.21.15.37:0/3409656773 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f0c0d4090 msgr2=0x7f1f0c161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:48.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f11800640 1 --2- 172.21.15.37:0/3409656773 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f0c0d4090 0x7f1f0c161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:48.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f11800640 1 -- 172.21.15.37:0/3409656773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f0c162010 msgr2=0x7f1f0c0c99d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:51:48.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f11800640 1 --2- 172.21.15.37:0/3409656773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f0c162010 0x7f1f0c0c99d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:48.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f11800640 1 -- 172.21.15.37:0/3409656773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c154ca0 con 0x7f1f0c0d10d0 2024-05-30T06:51:48.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f11800640 1 --2- 172.21.15.37:0/3409656773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c0d10d0 0x7f1f0c158b10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000e9b0 tx=0x7f1f0000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:48.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f09600640 1 -- 172.21.15.37:0/3409656773 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00017070 con 0x7f1f0c0d10d0 2024-05-30T06:51:48.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f09600640 1 -- 172.21.15.37:0/3409656773 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f0000c9a0 con 0x7f1f0c0d10d0 2024-05-30T06:51:48.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f09600640 1 -- 172.21.15.37:0/3409656773 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0000cd70 con 0x7f1f0c0d10d0 2024-05-30T06:51:48.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.540+0000 7f1f14200640 1 -- 172.21.15.37:0/3409656773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0c154f80 con 0x7f1f0c0d10d0 2024-05-30T06:51:48.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.544+0000 7f1f14200640 1 -- 172.21.15.37:0/3409656773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0c159050 con 0x7f1f0c0d10d0 2024-05-30T06:51:48.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.544+0000 7f1f14200640 1 -- 172.21.15.37:0/3409656773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f0c068bc0 con 0x7f1f0c0d10d0 2024-05-30T06:51:48.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.544+0000 7f1f09600640 1 -- 172.21.15.37:0/3409656773 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7f1f0001a070 con 0x7f1f0c0d10d0 2024-05-30T06:51:48.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.548+0000 7f1f09600640 1 --2- 172.21.15.37:0/3409656773 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1eec069520 0x7f1eec06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:48.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.548+0000 7f1f09600640 1 -- 172.21.15.37:0/3409656773 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f1f00085cc0 con 0x7f1f0c0d10d0 2024-05-30T06:51:48.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.548+0000 7f1f10e00640 1 --2- 172.21.15.37:0/3409656773 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1eec069520 0x7f1eec06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:48.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.552+0000 7f1f09600640 1 -- 172.21.15.37:0/3409656773 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f00057980 con 0x7f1f0c0d10d0 2024-05-30T06:51:48.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.556+0000 7f1f10e00640 1 --2- 172.21.15.37:0/3409656773 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1eec069520 0x7f1eec06b9e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c15f560 tx=0x7f1ef8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:48.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:48.864+0000 7f1f14200640 1 -- 172.21.15.37:0/3409656773 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone371013", "target": ["mon-mgr", ""]}) -- 0x7f1f0c06d280 con 0x7f1eec069520 2024-05-30T06:51:49.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.648+0000 7f1f09600640 1 -- 172.21.15.37:0/3409656773 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1f0c06d280 con 0x7f1eec069520 2024-05-30T06:51:49.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.652+0000 7f1f14200640 1 -- 172.21.15.37:0/3409656773 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1eec069520 msgr2=0x7f1eec06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.652+0000 7f1f14200640 1 --2- 172.21.15.37:0/3409656773 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1eec069520 0x7f1eec06b9e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c15f560 tx=0x7f1ef8009040 comp rx=0 tx=0).stop 2024-05-30T06:51:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.652+0000 7f1f14200640 1 -- 172.21.15.37:0/3409656773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c0d10d0 msgr2=0x7f1f0c158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.652+0000 7f1f14200640 1 --2- 172.21.15.37:0/3409656773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c0d10d0 0x7f1f0c158b10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f1f0000e9b0 tx=0x7f1f0000ee70 comp rx=0 tx=0).stop 2024-05-30T06:51:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.652+0000 7f1f14200640 1 -- 172.21.15.37:0/3409656773 shutdown_connections 2024-05-30T06:51:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.652+0000 7f1f14200640 1 --2- 172.21.15.37:0/3409656773 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1eec069520 0x7f1eec06b9e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.652+0000 7f1f14200640 1 --2- 172.21.15.37:0/3409656773 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f0c162010 0x7f1f0c0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.652+0000 7f1f14200640 1 --2- 172.21.15.37:0/3409656773 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f0c0d4090 0x7f1f0c161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.652+0000 7f1f14200640 1 --2- 172.21.15.37:0/3409656773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f0c0d10d0 0x7f1f0c158b10 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.652+0000 7f1f14200640 1 -- 172.21.15.37:0/3409656773 >> 172.21.15.37:0/3409656773 conn(0x7f1f0c06cc50 msgr2=0x7f1f0c162570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.652+0000 7f1f14200640 1 -- 172.21.15.37:0/3409656773 shutdown_connections 2024-05-30T06:51:49.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.652+0000 7f1f14200640 1 -- 172.21.15.37:0/3409656773 wait complete. 2024-05-30T06:51:49.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone371014 2024-05-30T06:51:49.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.936+0000 7fbb37400640 1 Processor -- start 2024-05-30T06:51:49.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.936+0000 7fbb37400640 1 -- start start 2024-05-30T06:51:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.936+0000 7fbb37400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb3015c980 0x7fbb300d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.936+0000 7fbb37400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbb300d0f10 0x7fbb300b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.936+0000 7fbb37400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb300b3680 0x7fbb3009aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.936+0000 7fbb37400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbb3015cd60 con 0x7fbb300b3680 2024-05-30T06:51:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.936+0000 7fbb37400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbb300afd30 con 0x7fbb300d0f10 2024-05-30T06:51:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.936+0000 7fbb37400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbb300d1350 con 0x7fbb3015c980 2024-05-30T06:51:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.936+0000 7fbb35400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb300b3680 0x7fbb3009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.936+0000 7fbb35400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb300b3680 0x7fbb3009aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44914/0 (socket says 172.21.15.37:44914) 2024-05-30T06:51:49.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.936+0000 7fbb35400640 1 -- 172.21.15.37:0/3399656997 learned_addr learned my addr 172.21.15.37:0/3399656997 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:49.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.940+0000 7fbb35400640 1 -- 172.21.15.37:0/3399656997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb3015c980 msgr2=0x7fbb300d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:49.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.940+0000 7fbb35400640 1 --2- 172.21.15.37:0/3399656997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb3015c980 0x7fbb300d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:49.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.940+0000 7fbb35400640 1 -- 172.21.15.37:0/3399656997 >> v2:172.21.15.105:3300/0 conn(0x7fbb300d0f10 msgr2=0x7fbb300b3140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T06:51:49.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.940+0000 7fbb35400640 1 --2- 172.21.15.37:0/3399656997 >> v2:172.21.15.105:3300/0 conn(0x7fbb300d0f10 0x7fbb300b3140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:49.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.940+0000 7fbb35400640 1 -- 172.21.15.37:0/3399656997 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb300af440 con 0x7fbb300b3680 2024-05-30T06:51:49.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.944+0000 7fbb35400640 1 --2- 172.21.15.37:0/3399656997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb300b3680 0x7fbb3009aa60 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009e50 tx=0x7fbb2801c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aae8724659c1141 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:49.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.944+0000 7fbb2f400640 1 -- 172.21.15.37:0/3399656997 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb280a55d0 con 0x7fbb300b3680 2024-05-30T06:51:49.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.944+0000 7fbb2f400640 1 -- 172.21.15.37:0/3399656997 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb280a5770 con 0x7fbb300b3680 2024-05-30T06:51:49.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.944+0000 7fbb2f400640 1 -- 172.21.15.37:0/3399656997 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb280a5b40 con 0x7fbb300b3680 2024-05-30T06:51:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.944+0000 7fbb37400640 1 -- 172.21.15.37:0/3399656997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb300b3680 msgr2=0x7fbb3009aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.944+0000 7fbb37400640 1 --2- 172.21.15.37:0/3399656997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb300b3680 0x7fbb3009aa60 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009e50 tx=0x7fbb2801c750 comp rx=0 tx=0).stop 2024-05-30T06:51:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.944+0000 7fbb37400640 1 -- 172.21.15.37:0/3399656997 shutdown_connections 2024-05-30T06:51:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.944+0000 7fbb37400640 1 --2- 172.21.15.37:0/3399656997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb300b3680 0x7fbb3009aa60 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.944+0000 7fbb37400640 1 --2- 172.21.15.37:0/3399656997 >> v2:172.21.15.105:3300/0 conn(0x7fbb300d0f10 0x7fbb300b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.944+0000 7fbb37400640 1 --2- 172.21.15.37:0/3399656997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb3015c980 0x7fbb300d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.944+0000 7fbb37400640 1 -- 172.21.15.37:0/3399656997 >> 172.21.15.37:0/3399656997 conn(0x7fbb300d2610 msgr2=0x7fbb300d2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.944+0000 7fbb37400640 1 -- 172.21.15.37:0/3399656997 shutdown_connections 2024-05-30T06:51:49.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.944+0000 7fbb37400640 1 -- 172.21.15.37:0/3399656997 wait complete. 2024-05-30T06:51:49.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb37400640 1 Processor -- start 2024-05-30T06:51:49.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb37400640 1 -- start start 2024-05-30T06:51:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb37400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb300b3680 0x7fbb30152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb37400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb300d0f10 0x7fbb3015f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb37400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb3015c980 0x7fbb300c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb37400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb300b3c90 con 0x7fbb300b3680 2024-05-30T06:51:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb37400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbb300b3b10 con 0x7fbb3015c980 2024-05-30T06:51:49.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb37400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbb300b01c0 con 0x7fbb300d0f10 2024-05-30T06:51:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb34a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb300b3680 0x7fbb30152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb34a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb300b3680 0x7fbb30152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44922/0 (socket says 172.21.15.37:44922) 2024-05-30T06:51:49.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb34a00640 1 -- 172.21.15.37:0/1527442000 learned_addr learned my addr 172.21.15.37:0/1527442000 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb34a00640 1 -- 172.21.15.37:0/1527442000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb300d0f10 msgr2=0x7fbb3015f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb34a00640 1 --2- 172.21.15.37:0/1527442000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb300d0f10 0x7fbb3015f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb34a00640 1 -- 172.21.15.37:0/1527442000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb3015c980 msgr2=0x7fbb300c96e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:51:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb34a00640 1 --2- 172.21.15.37:0/1527442000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb3015c980 0x7fbb300c96e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb34a00640 1 -- 172.21.15.37:0/1527442000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb300ccc40 con 0x7fbb300b3680 2024-05-30T06:51:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb34a00640 1 --2- 172.21.15.37:0/1527442000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb300b3680 0x7fbb30152800 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000b410 tx=0x7fbb2000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb2cc00640 1 -- 172.21.15.37:0/1527442000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20015020 con 0x7fbb300b3680 2024-05-30T06:51:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb2cc00640 1 -- 172.21.15.37:0/1527442000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb20011830 con 0x7fbb300b3680 2024-05-30T06:51:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.948+0000 7fbb2cc00640 1 -- 172.21.15.37:0/1527442000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20011c20 con 0x7fbb300b3680 2024-05-30T06:51:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.952+0000 7fbb37400640 1 -- 172.21.15.37:0/1527442000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3015e4e0 con 0x7fbb300b3680 2024-05-30T06:51:49.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.952+0000 7fbb37400640 1 -- 172.21.15.37:0/1527442000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3015eaa0 con 0x7fbb300b3680 2024-05-30T06:51:49.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.952+0000 7fbb37400640 1 -- 172.21.15.37:0/1527442000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb30075580 con 0x7fbb300b3680 2024-05-30T06:51:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.952+0000 7fbb2cc00640 1 -- 172.21.15.37:0/1527442000 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 29) ==== 89568+0+0 (secure 0 0 0) 0x7fbb20018020 con 0x7fbb300b3680 2024-05-30T06:51:49.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.956+0000 7fbb2cc00640 1 --2- 172.21.15.37:0/1527442000 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb0c0694f0 0x7fbb0c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.956+0000 7fbb2cc00640 1 -- 172.21.15.37:0/1527442000 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fbb200857b0 con 0x7fbb300b3680 2024-05-30T06:51:49.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.960+0000 7fbb2cc00640 1 -- 172.21.15.37:0/1527442000 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbb2001f020 con 0x7fbb300b3680 2024-05-30T06:51:49.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:49.988+0000 7fbb2fe00640 1 --2- 172.21.15.37:0/1527442000 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb0c0694f0 0x7fbb0c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:50.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:50.072+0000 7fbb2fe00640 1 --2- 172.21.15.37:0/1527442000 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb0c0694f0 0x7fbb0c06b9b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbb300d0150 tx=0x7fbb18006c50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:50.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:50.344+0000 7fbb37400640 1 -- 172.21.15.37:0/1527442000 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone371014", "target": ["mon-mgr", ""]}) -- 0x7fbb300b10d0 con 0x7fbb0c0694f0 2024-05-30T06:51:51.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.272+0000 7fbb2cc00640 1 -- 172.21.15.37:0/1527442000 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbb300b10d0 con 0x7fbb0c0694f0 2024-05-30T06:51:51.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.276+0000 7fbb37400640 1 -- 172.21.15.37:0/1527442000 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb0c0694f0 msgr2=0x7fbb0c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:51.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.276+0000 7fbb37400640 1 --2- 172.21.15.37:0/1527442000 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb0c0694f0 0x7fbb0c06b9b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbb300d0150 tx=0x7fbb18006c50 comp rx=0 tx=0).stop 2024-05-30T06:51:51.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.276+0000 7fbb37400640 1 -- 172.21.15.37:0/1527442000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb300b3680 msgr2=0x7fbb30152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:51.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.276+0000 7fbb37400640 1 --2- 172.21.15.37:0/1527442000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb300b3680 0x7fbb30152800 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000b410 tx=0x7fbb2000b8d0 comp rx=0 tx=0).stop 2024-05-30T06:51:51.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.276+0000 7fbb37400640 1 -- 172.21.15.37:0/1527442000 shutdown_connections 2024-05-30T06:51:51.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.276+0000 7fbb37400640 1 --2- 172.21.15.37:0/1527442000 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb0c0694f0 0x7fbb0c06b9b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:51.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.276+0000 7fbb37400640 1 --2- 172.21.15.37:0/1527442000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb3015c980 0x7fbb300c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:51.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.276+0000 7fbb37400640 1 --2- 172.21.15.37:0/1527442000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb300d0f10 0x7fbb3015f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:51.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.276+0000 7fbb37400640 1 --2- 172.21.15.37:0/1527442000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb300b3680 0x7fbb30152800 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:51.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.276+0000 7fbb37400640 1 -- 172.21.15.37:0/1527442000 >> 172.21.15.37:0/1527442000 conn(0x7fbb300d2610 msgr2=0x7fbb300b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:51.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.276+0000 7fbb37400640 1 -- 172.21.15.37:0/1527442000 shutdown_connections 2024-05-30T06:51:51.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.276+0000 7fbb37400640 1 -- 172.21.15.37:0/1527442000 wait complete. 2024-05-30T06:51:51.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone371015 2024-05-30T06:51:51.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.556+0000 7f7d05800640 1 Processor -- start 2024-05-30T06:51:51.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.556+0000 7f7d05800640 1 -- start start 2024-05-30T06:51:51.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.560+0000 7f7d05800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7d0015e660 0x7f7d000b0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:51.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.560+0000 7f7d05800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d000b1830 0x7f7d000b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:51.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.560+0000 7f7d05800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d000b6430 con 0x7f7d000b28e0 2024-05-30T06:51:51.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.560+0000 7f7d05800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7d000b4350 con 0x7f7d000b1830 2024-05-30T06:51:51.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.560+0000 7f7d05800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7d000b6710 con 0x7f7d0015e660 2024-05-30T06:51:51.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.560+0000 7f7d04e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d000b1830 0x7f7d000b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:51.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.560+0000 7f7d04e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d000b1830 0x7f7d000b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44938/0 (socket says 172.21.15.37:44938) 2024-05-30T06:51:51.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.560+0000 7f7d04e00640 1 -- 172.21.15.37:0/3571655792 learned_addr learned my addr 172.21.15.37:0/3571655792 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:51.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.560+0000 7f7cff400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f7d000b28e0 0x7f7d000ae330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:50610/0 (socket says 172.21.15.37:50610) 2024-05-30T06:51:51.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.560+0000 7f7d04e00640 1 -- 172.21.15.37:0/3571655792 >> v2:172.21.15.105:3300/0 conn(0x7f7d0015e660 msgr2=0x7f7d000b0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:51.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.560+0000 7f7d04e00640 1 --2- 172.21.15.37:0/3571655792 >> v2:172.21.15.105:3300/0 conn(0x7f7d0015e660 0x7f7d000b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:51.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.560+0000 7f7d04e00640 1 -- 172.21.15.37:0/3571655792 >> v1:172.21.15.105:6789/0 conn(0x7f7d000b28e0 legacy=0x7f7d000ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:51.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.560+0000 7f7d04e00640 1 -- 172.21.15.37:0/3571655792 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d000b45a0 con 0x7f7d000b1830 2024-05-30T06:51:51.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.564+0000 7f7d04e00640 1 --2- 172.21.15.37:0/3571655792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d000b1830 0x7f7d000b1ca0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f7d00073f50 tx=0x7f7cf801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aff3f22eb1993a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:51.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.564+0000 7f7cfea00640 1 -- 172.21.15.37:0/3571655792 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf80a5680 con 0x7f7d000b1830 2024-05-30T06:51:51.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.564+0000 7f7cfea00640 1 -- 172.21.15.37:0/3571655792 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf80a5820 con 0x7f7d000b1830 2024-05-30T06:51:51.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.564+0000 7f7cfea00640 1 -- 172.21.15.37:0/3571655792 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf80a5bf0 con 0x7f7d000b1830 2024-05-30T06:51:51.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.568+0000 7f7d05800640 1 -- 172.21.15.37:0/3571655792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d000b1830 msgr2=0x7f7d000b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:51.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.568+0000 7f7d05800640 1 --2- 172.21.15.37:0/3571655792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d000b1830 0x7f7d000b1ca0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f7d00073f50 tx=0x7f7cf801c9b0 comp rx=0 tx=0).stop 2024-05-30T06:51:51.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.568+0000 7f7d05800640 1 -- 172.21.15.37:0/3571655792 shutdown_connections 2024-05-30T06:51:51.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.568+0000 7f7d05800640 1 --2- 172.21.15.37:0/3571655792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d000b1830 0x7f7d000b1ca0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:51.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.568+0000 7f7d05800640 1 --2- 172.21.15.37:0/3571655792 >> v2:172.21.15.105:3300/0 conn(0x7f7d0015e660 0x7f7d000b0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:51.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.568+0000 7f7d05800640 1 -- 172.21.15.37:0/3571655792 >> 172.21.15.37:0/3571655792 conn(0x7f7d000b6a90 msgr2=0x7f7d0009aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:51.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.568+0000 7f7d05800640 1 -- 172.21.15.37:0/3571655792 shutdown_connections 2024-05-30T06:51:51.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.568+0000 7f7d05800640 1 -- 172.21.15.37:0/3571655792 wait complete. 2024-05-30T06:51:51.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7d05800640 1 Processor -- start 2024-05-30T06:51:51.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7d05800640 1 -- start start 2024-05-30T06:51:51.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7d05800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d000b1830 0x7f7d00152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:51.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7d05800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d000b28e0 0x7f7d0015f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:51.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7d05800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d0015e660 0x7f7d001502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:51.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7d05800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0015ebc0 con 0x7f7d000b28e0 2024-05-30T06:51:51.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7d05800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0015ea40 con 0x7f7d000b1830 2024-05-30T06:51:51.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7d05800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0016b500 con 0x7f7d0015e660 2024-05-30T06:51:51.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7cff400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d000b28e0 0x7f7d0015f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7cffe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d000b1830 0x7f7d00152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7cff400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d000b28e0 0x7f7d0015f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44944/0 (socket says 172.21.15.37:44944) 2024-05-30T06:51:51.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7cff400640 1 -- 172.21.15.37:0/942904245 learned_addr learned my addr 172.21.15.37:0/942904245 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:51.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7cff400640 1 -- 172.21.15.37:0/942904245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d0015e660 msgr2=0x7f7d001502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:51.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7cff400640 1 --2- 172.21.15.37:0/942904245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d0015e660 0x7f7d001502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:51.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7cff400640 1 -- 172.21.15.37:0/942904245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d000b1830 msgr2=0x7f7d00152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:51.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7cff400640 1 --2- 172.21.15.37:0/942904245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d000b1830 0x7f7d00152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:51.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7cff400640 1 -- 172.21.15.37:0/942904245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0009e470 con 0x7f7d000b28e0 2024-05-30T06:51:51.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.572+0000 7f7cff400640 1 --2- 172.21.15.37:0/942904245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d000b28e0 0x7f7d0015f770 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00c460 tx=0x7f7cec00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:51.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.576+0000 7f7cf7e00640 1 -- 172.21.15.37:0/942904245 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec017070 con 0x7f7d000b28e0 2024-05-30T06:51:51.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.576+0000 7f7cf7e00640 1 -- 172.21.15.37:0/942904245 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cec0074a0 con 0x7f7d000b28e0 2024-05-30T06:51:51.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.576+0000 7f7cf7e00640 1 -- 172.21.15.37:0/942904245 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec005a60 con 0x7f7d000b28e0 2024-05-30T06:51:51.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.576+0000 7f7d05800640 1 -- 172.21.15.37:0/942904245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0009e750 con 0x7f7d000b28e0 2024-05-30T06:51:51.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.576+0000 7f7d05800640 1 -- 172.21.15.37:0/942904245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d0009ed10 con 0x7f7d000b28e0 2024-05-30T06:51:51.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.580+0000 7f7d05800640 1 -- 172.21.15.37:0/942904245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d00068700 con 0x7f7d000b28e0 2024-05-30T06:51:51.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.580+0000 7f7cf7e00640 1 -- 172.21.15.37:0/942904245 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) ==== 89517+0+0 (secure 0 0 0) 0x7f7cec01a070 con 0x7f7d000b28e0 2024-05-30T06:51:51.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.584+0000 7f7cf7e00640 1 --2- 172.21.15.37:0/942904245 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ce00694b0 0x7f7ce006b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:51.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.584+0000 7f7cf7e00640 1 -- 172.21.15.37:0/942904245 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f7cec084c10 con 0x7f7d000b28e0 2024-05-30T06:51:51.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.592+0000 7f7cf7e00640 1 -- 172.21.15.37:0/942904245 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7cec056920 con 0x7f7d000b28e0 2024-05-30T06:51:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.620+0000 7f7cffe00640 1 --2- 172.21.15.37:0/942904245 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ce00694b0 0x7f7ce006b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:51.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.660+0000 7f7cffe00640 1 --2- 172.21.15.37:0/942904245 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ce00694b0 0x7f7ce006b970 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0006fd0 tx=0x7f7cf0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:51.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:51.904+0000 7f7d05800640 1 -- 172.21.15.37:0/942904245 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone371015", "target": ["mon-mgr", ""]}) -- 0x7f7d000ae460 con 0x7f7ce00694b0 2024-05-30T06:51:53.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.200+0000 7f7cf7e00640 1 -- 172.21.15.37:0/942904245 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7d000ae460 con 0x7f7ce00694b0 2024-05-30T06:51:53.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.204+0000 7f7d05800640 1 -- 172.21.15.37:0/942904245 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ce00694b0 msgr2=0x7f7ce006b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:53.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.204+0000 7f7d05800640 1 --2- 172.21.15.37:0/942904245 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ce00694b0 0x7f7ce006b970 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0006fd0 tx=0x7f7cf0008040 comp rx=0 tx=0).stop 2024-05-30T06:51:53.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.204+0000 7f7d05800640 1 -- 172.21.15.37:0/942904245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d000b28e0 msgr2=0x7f7d0015f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:53.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.204+0000 7f7d05800640 1 --2- 172.21.15.37:0/942904245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d000b28e0 0x7f7d0015f770 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00c460 tx=0x7f7cec00c920 comp rx=0 tx=0).stop 2024-05-30T06:51:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.204+0000 7f7d05800640 1 -- 172.21.15.37:0/942904245 shutdown_connections 2024-05-30T06:51:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.204+0000 7f7d05800640 1 --2- 172.21.15.37:0/942904245 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d0015e660 0x7f7d001502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.204+0000 7f7d05800640 1 --2- 172.21.15.37:0/942904245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d000b28e0 0x7f7d0015f770 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.204+0000 7f7d05800640 1 --2- 172.21.15.37:0/942904245 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ce00694b0 0x7f7ce006b970 secure :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0006fd0 tx=0x7f7cf0008040 comp rx=0 tx=0).stop 2024-05-30T06:51:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.204+0000 7f7d05800640 1 --2- 172.21.15.37:0/942904245 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d000b1830 0x7f7d00152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.204+0000 7f7d05800640 1 -- 172.21.15.37:0/942904245 >> 172.21.15.37:0/942904245 conn(0x7f7d000b6a90 msgr2=0x7f7d000b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.204+0000 7f7d05800640 1 -- 172.21.15.37:0/942904245 shutdown_connections 2024-05-30T06:51:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.204+0000 7f7d05800640 1 -- 172.21.15.37:0/942904245 wait complete. 2024-05-30T06:51:53.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone371016 2024-05-30T06:51:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f691e600640 1 Processor -- start 2024-05-30T06:51:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f691e600640 1 -- start start 2024-05-30T06:51:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f691e600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f691815ebc0 0x7f69180d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f691e600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69180d0840 con 0x7f691809aa60 2024-05-30T06:51:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f691e600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f691806dec0 con 0x7f691809b800 2024-05-30T06:51:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f691e600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f691809bce0 con 0x7f691815ebc0 2024-05-30T06:51:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f6917e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f691809aa60 0x7f69180ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48236/0 (socket says 172.21.15.37:48236) 2024-05-30T06:51:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f6917e00640 1 -- 172.21.15.37:0/2121408097 learned_addr learned my addr 172.21.15.37:0/2121408097 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:51:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f6917400640 1 --2- 172.21.15.37:0/2121408097 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f691815ebc0 0x7f69180d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f6916000640 1 -- 172.21.15.37:0/2121408097 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606674724 0 0) 0x7f69180d0840 con 0x7f691809aa60 2024-05-30T06:51:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f6916000640 1 -- 172.21.15.37:0/2121408097 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68fc003530 con 0x7f691809aa60 2024-05-30T06:51:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f6916000640 1 -- 172.21.15.37:0/2121408097 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1746511904 0 0) 0x7f691806dec0 con 0x7f691809b800 2024-05-30T06:51:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f6916000640 1 -- 172.21.15.37:0/2121408097 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69180d0840 con 0x7f691809b800 2024-05-30T06:51:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f6917400640 1 -- 172.21.15.37:0/2121408097 >> v1:172.21.15.105:6789/0 conn(0x7f691809b800 legacy=0x7f691806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f6917400640 1 -- 172.21.15.37:0/2121408097 >> v1:172.21.15.37:6789/0 conn(0x7f691809aa60 legacy=0x7f69180ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.436+0000 7f6917400640 1 -- 172.21.15.37:0/2121408097 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69180d0ae0 con 0x7f691815ebc0 2024-05-30T06:51:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.440+0000 7f6917400640 1 --2- 172.21.15.37:0/2121408097 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f691815ebc0 0x7f69180d15c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f69080097f0 tx=0x7f690801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0a972b706b2346c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.440+0000 7f6916000640 1 -- 172.21.15.37:0/2121408097 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69080b0070 con 0x7f691815ebc0 2024-05-30T06:51:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.440+0000 7f6916000640 1 -- 172.21.15.37:0/2121408097 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69080ab600 con 0x7f691815ebc0 2024-05-30T06:51:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.440+0000 7f6916000640 1 -- 172.21.15.37:0/2121408097 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69080ab9d0 con 0x7f691815ebc0 2024-05-30T06:51:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 -- 172.21.15.37:0/2121408097 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f691815ebc0 msgr2=0x7f69180d15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 --2- 172.21.15.37:0/2121408097 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f691815ebc0 0x7f69180d15c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f69080097f0 tx=0x7f690801c4e0 comp rx=0 tx=0).stop 2024-05-30T06:51:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 -- 172.21.15.37:0/2121408097 shutdown_connections 2024-05-30T06:51:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 --2- 172.21.15.37:0/2121408097 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f691815ebc0 0x7f69180d15c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 -- 172.21.15.37:0/2121408097 >> 172.21.15.37:0/2121408097 conn(0x7f69180b4060 msgr2=0x7f69180b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 -- 172.21.15.37:0/2121408097 shutdown_connections 2024-05-30T06:51:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 -- 172.21.15.37:0/2121408097 wait complete. 2024-05-30T06:51:53.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 Processor -- start 2024-05-30T06:51:53.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 -- start start 2024-05-30T06:51:53.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f691809aa60 0x7f6918155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:53.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f691809b800 0x7f6918074f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:53.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691815ebc0 0x7f6918154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:53.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69180d1b00 con 0x7f691815ebc0 2024-05-30T06:51:53.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f691809b280 con 0x7f691809b800 2024-05-30T06:51:53.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f691e600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f69180c6b70 con 0x7f691809aa60 2024-05-30T06:51:53.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f6917e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691815ebc0 0x7f6918154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:53.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f6917e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691815ebc0 0x7f6918154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44958/0 (socket says 172.21.15.37:44958) 2024-05-30T06:51:53.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f6917e00640 1 -- 172.21.15.37:0/1426348759 learned_addr learned my addr 172.21.15.37:0/1426348759 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:53.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f6916a00640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f691809b800 0x7f6918074f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:53.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f6917400640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f691809aa60 0x7f6918155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:53.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f6917e00640 1 -- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f691809aa60 msgr2=0x7f6918155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:53.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f6917e00640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f691809aa60 0x7f6918155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:53.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f6917e00640 1 -- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f691809b800 msgr2=0x7f6918074f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:53.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f6917e00640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f691809b800 0x7f6918074f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:53.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f6917e00640 1 -- 172.21.15.37:0/1426348759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6918153ef0 con 0x7f691815ebc0 2024-05-30T06:51:53.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f6916a00640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f691809b800 0x7f6918074f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:51:53.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.444+0000 7f6917e00640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691815ebc0 0x7f6918154260 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f691000caf0 tx=0x7f691000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:53.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.448+0000 7f690f400640 1 -- 172.21.15.37:0/1426348759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6910017070 con 0x7f691815ebc0 2024-05-30T06:51:53.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.448+0000 7f690f400640 1 -- 172.21.15.37:0/1426348759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f691000ac40 con 0x7f691815ebc0 2024-05-30T06:51:53.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.448+0000 7f691e600640 1 -- 172.21.15.37:0/1426348759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69180c6240 con 0x7f691815ebc0 2024-05-30T06:51:53.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.448+0000 7f690f400640 1 -- 172.21.15.37:0/1426348759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6910012400 con 0x7f691815ebc0 2024-05-30T06:51:53.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.448+0000 7f691e600640 1 -- 172.21.15.37:0/1426348759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69180c6800 con 0x7f691815ebc0 2024-05-30T06:51:53.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.448+0000 7f691e600640 1 -- 172.21.15.37:0/1426348759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6918068bc0 con 0x7f691815ebc0 2024-05-30T06:51:53.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.448+0000 7f690f400640 1 -- 172.21.15.37:0/1426348759 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) ==== 89517+0+0 (secure 0 0 0) 0x7f691001a070 con 0x7f691815ebc0 2024-05-30T06:51:53.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.448+0000 7f690f400640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68f8069460 0x7f68f806b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:53.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.448+0000 7f690f400640 1 -- 172.21.15.37:0/1426348759 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f69100855e0 con 0x7f691815ebc0 2024-05-30T06:51:53.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.448+0000 7f6917400640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68f8069460 0x7f68f806b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:53.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.452+0000 7f6917400640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68f8069460 0x7f68f806b920 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f69080ad000 tx=0x7f69080a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:53.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.452+0000 7f690f400640 1 -- 172.21.15.37:0/1426348759 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6910057280 con 0x7f691815ebc0 2024-05-30T06:51:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:53.844+0000 7f691e600640 1 -- 172.21.15.37:0/1426348759 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone371016", "target": ["mon-mgr", ""]}) -- 0x7f69180c6d20 con 0x7f68f8069460 2024-05-30T06:51:54.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.548+0000 7f690f400640 1 -- 172.21.15.37:0/1426348759 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f69080b5410 con 0x7f68f8069460 2024-05-30T06:51:54.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.552+0000 7f691e600640 1 -- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68f8069460 msgr2=0x7f68f806b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:54.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.552+0000 7f691e600640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68f8069460 0x7f68f806b920 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f69080ad000 tx=0x7f69080a6000 comp rx=0 tx=0).stop 2024-05-30T06:51:54.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.552+0000 7f691e600640 1 -- 172.21.15.37:0/1426348759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691815ebc0 msgr2=0x7f6918154260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:54.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.552+0000 7f691e600640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691815ebc0 0x7f6918154260 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f691000caf0 tx=0x7f691000a060 comp rx=0 tx=0).stop 2024-05-30T06:51:54.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.552+0000 7f691e600640 1 -- 172.21.15.37:0/1426348759 shutdown_connections 2024-05-30T06:51:54.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.552+0000 7f691e600640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f691815ebc0 0x7f6918154260 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:54.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.552+0000 7f691e600640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f68f8069460 0x7f68f806b920 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:54.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.552+0000 7f691e600640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f691809b800 0x7f6918074f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:54.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.552+0000 7f691e600640 1 --2- 172.21.15.37:0/1426348759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f691809aa60 0x7f6918155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:54.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.552+0000 7f691e600640 1 -- 172.21.15.37:0/1426348759 >> 172.21.15.37:0/1426348759 conn(0x7f69180b4060 msgr2=0x7f69180b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:54.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.552+0000 7f691e600640 1 -- 172.21.15.37:0/1426348759 shutdown_connections 2024-05-30T06:51:54.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.552+0000 7f691e600640 1 -- 172.21.15.37:0/1426348759 wait complete. 2024-05-30T06:51:54.583 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone371017 2024-05-30T06:51:54.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff500e00640 1 Processor -- start 2024-05-30T06:51:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff500e00640 1 -- start start 2024-05-30T06:51:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff500e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff4fc15ebc0 0x7ff4fc0d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:54.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff500e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4fc09b800 0x7ff4fc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff500e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4fc0d0840 con 0x7ff4fc06dcf0 2024-05-30T06:51:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff500e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff4fc09bce0 con 0x7ff4fc09b800 2024-05-30T06:51:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff500e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff4fc0d0ae0 con 0x7ff4fc15ebc0 2024-05-30T06:51:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff4f1400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4fc09b800 0x7ff4fc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff4fa800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff4fc06dcf0 0x7ff4fc09aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48240/0 (socket says 172.21.15.37:48240) 2024-05-30T06:51:54.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff4fa800640 1 -- 172.21.15.37:0/2017387527 learned_addr learned my addr 172.21.15.37:0/2017387527 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:51:54.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff4f1400640 1 -- 172.21.15.37:0/2017387527 >> v2:172.21.15.105:3300/0 conn(0x7ff4fc15ebc0 msgr2=0x7ff4fc0d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:54.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff4f1400640 1 --2- 172.21.15.37:0/2017387527 >> v2:172.21.15.105:3300/0 conn(0x7ff4fc15ebc0 0x7ff4fc0d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:54.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff4f1400640 1 -- 172.21.15.37:0/2017387527 >> v1:172.21.15.37:6789/0 conn(0x7ff4fc06dcf0 legacy=0x7ff4fc09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:54.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.792+0000 7ff4f1400640 1 -- 172.21.15.37:0/2017387527 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4fc0d0dc0 con 0x7ff4fc09b800 2024-05-30T06:51:54.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.796+0000 7ff4f1400640 1 --2- 172.21.15.37:0/2017387527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4fc09b800 0x7ff4fc06d7b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc073610 tx=0x7ff4e401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113330d62ac9f327 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:54.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.796+0000 7ff4f9400640 1 -- 172.21.15.37:0/2017387527 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40b1070 con 0x7ff4fc09b800 2024-05-30T06:51:54.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.796+0000 7ff4f9400640 1 -- 172.21.15.37:0/2017387527 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e40ac640 con 0x7ff4fc09b800 2024-05-30T06:51:54.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.796+0000 7ff4f9400640 1 -- 172.21.15.37:0/2017387527 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40aca10 con 0x7ff4fc09b800 2024-05-30T06:51:54.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.796+0000 7ff500e00640 1 -- 172.21.15.37:0/2017387527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4fc09b800 msgr2=0x7ff4fc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:54.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.796+0000 7ff500e00640 1 --2- 172.21.15.37:0/2017387527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4fc09b800 0x7ff4fc06d7b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc073610 tx=0x7ff4e401c480 comp rx=0 tx=0).stop 2024-05-30T06:51:54.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.796+0000 7ff500e00640 1 -- 172.21.15.37:0/2017387527 shutdown_connections 2024-05-30T06:51:54.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.796+0000 7ff500e00640 1 --2- 172.21.15.37:0/2017387527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4fc09b800 0x7ff4fc06d7b0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:54.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.796+0000 7ff500e00640 1 --2- 172.21.15.37:0/2017387527 >> v2:172.21.15.105:3300/0 conn(0x7ff4fc15ebc0 0x7ff4fc0d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:54.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.796+0000 7ff500e00640 1 -- 172.21.15.37:0/2017387527 >> 172.21.15.37:0/2017387527 conn(0x7ff4fc0b4060 msgr2=0x7ff4fc0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:54.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.796+0000 7ff500e00640 1 -- 172.21.15.37:0/2017387527 shutdown_connections 2024-05-30T06:51:54.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.796+0000 7ff500e00640 1 -- 172.21.15.37:0/2017387527 wait complete. 2024-05-30T06:51:54.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.800+0000 7ff500e00640 1 Processor -- start 2024-05-30T06:51:54.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.800+0000 7ff500e00640 1 -- start start 2024-05-30T06:51:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff500e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4fc06dcf0 0x7ff4fc15bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff500e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4fc09b800 0x7ff4fc154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff500e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4fc15ebc0 0x7ff4fc156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff500e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc09b2f0 con 0x7ff4fc15ebc0 2024-05-30T06:51:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff500e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc09b170 con 0x7ff4fc06dcf0 2024-05-30T06:51:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff500e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff4fc0cd3d0 con 0x7ff4fc09b800 2024-05-30T06:51:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4f9e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4fc06dcf0 0x7ff4fc15bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4f9e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4fc06dcf0 0x7ff4fc15bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:36118/0 (socket says 172.21.15.37:36118) 2024-05-30T06:51:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4f9e00640 1 -- 172.21.15.37:0/3238850111 learned_addr learned my addr 172.21.15.37:0/3238850111 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:54.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4f1400640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4fc09b800 0x7ff4fc154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:54.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4fa800640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4fc15ebc0 0x7ff4fc156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:54.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4f9e00640 1 -- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4fc09b800 msgr2=0x7ff4fc154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:54.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4f9e00640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4fc09b800 0x7ff4fc154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:54.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4f9e00640 1 -- 172.21.15.37:0/3238850111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4fc15ebc0 msgr2=0x7ff4fc156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:54.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4f9e00640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4fc15ebc0 0x7ff4fc156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:54.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4f9e00640 1 -- 172.21.15.37:0/3238850111 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4fc157420 con 0x7ff4fc06dcf0 2024-05-30T06:51:54.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4fa800640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4fc15ebc0 0x7ff4fc156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:51:54.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4f9e00640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4fc06dcf0 0x7ff4fc15bd70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00b440 tx=0x7ff4ec00b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:54.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4f2a00640 1 -- 172.21.15.37:0/3238850111 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec015020 con 0x7ff4fc06dcf0 2024-05-30T06:51:54.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4f2a00640 1 -- 172.21.15.37:0/3238850111 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ec0118b0 con 0x7ff4fc06dcf0 2024-05-30T06:51:54.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff500e00640 1 -- 172.21.15.37:0/3238850111 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4fc15c350 con 0x7ff4fc06dcf0 2024-05-30T06:51:54.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff4f2a00640 1 -- 172.21.15.37:0/3238850111 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec011ca0 con 0x7ff4fc06dcf0 2024-05-30T06:51:54.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.804+0000 7ff500e00640 1 -- 172.21.15.37:0/3238850111 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4fc1566e0 con 0x7ff4fc06dcf0 2024-05-30T06:51:54.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.808+0000 7ff500e00640 1 -- 172.21.15.37:0/3238850111 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4fc068bc0 con 0x7ff4fc06dcf0 2024-05-30T06:51:54.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.808+0000 7ff4f2a00640 1 -- 172.21.15.37:0/3238850111 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 30) ==== 89517+0+0 (secure 0 0 0) 0x7ff4ec018020 con 0x7ff4fc06dcf0 2024-05-30T06:51:54.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.808+0000 7ff4f2a00640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff4d80694b0 0x7ff4d806b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:54.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.808+0000 7ff4f2a00640 1 -- 172.21.15.37:0/3238850111 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7ff4ec085c40 con 0x7ff4fc06dcf0 2024-05-30T06:51:54.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.816+0000 7ff4f2a00640 1 -- 172.21.15.37:0/3238850111 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff4ec01f020 con 0x7ff4fc06dcf0 2024-05-30T06:51:54.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.856+0000 7ff4f1400640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff4d80694b0 0x7ff4d806b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:54.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:54.860+0000 7ff4f1400640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff4d80694b0 0x7ff4d806b970 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40ae000 tx=0x7ff4e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.140+0000 7ff500e00640 1 -- 172.21.15.37:0/3238850111 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone371017", "target": ["mon-mgr", ""]}) -- 0x7ff4fc154ba0 con 0x7ff4d80694b0 2024-05-30T06:51:55.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.524+0000 7ff4f2a00640 1 -- 172.21.15.37:0/3238850111 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff4fc154ba0 con 0x7ff4d80694b0 2024-05-30T06:51:55.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.524+0000 7ff500e00640 1 -- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff4d80694b0 msgr2=0x7ff4d806b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:55.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.524+0000 7ff500e00640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff4d80694b0 0x7ff4d806b970 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40ae000 tx=0x7ff4e4008040 comp rx=0 tx=0).stop 2024-05-30T06:51:55.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.524+0000 7ff500e00640 1 -- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4fc06dcf0 msgr2=0x7ff4fc15bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:55.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.524+0000 7ff500e00640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4fc06dcf0 0x7ff4fc15bd70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00b440 tx=0x7ff4ec00b900 comp rx=0 tx=0).stop 2024-05-30T06:51:55.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.524+0000 7ff500e00640 1 -- 172.21.15.37:0/3238850111 shutdown_connections 2024-05-30T06:51:55.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.524+0000 7ff500e00640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4fc15ebc0 0x7ff4fc156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:55.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.524+0000 7ff500e00640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4fc09b800 0x7ff4fc154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:55.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.524+0000 7ff500e00640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff4d80694b0 0x7ff4d806b970 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:55.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.524+0000 7ff500e00640 1 --2- 172.21.15.37:0/3238850111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4fc06dcf0 0x7ff4fc15bd70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:55.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.524+0000 7ff500e00640 1 -- 172.21.15.37:0/3238850111 >> 172.21.15.37:0/3238850111 conn(0x7ff4fc0b4060 msgr2=0x7ff4fc0b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:55.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.524+0000 7ff500e00640 1 -- 172.21.15.37:0/3238850111 shutdown_connections 2024-05-30T06:51:55.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.524+0000 7ff500e00640 1 -- 172.21.15.37:0/3238850111 wait complete. 2024-05-30T06:51:55.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone371018 2024-05-30T06:51:55.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.784+0000 7fa37e000640 1 Processor -- start 2024-05-30T06:51:55.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.784+0000 7fa37e000640 1 -- start start 2024-05-30T06:51:55.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa37e000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa378072230 0x7fa3780726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:55.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa37e000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780cddb0 0x7fa3780ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:55.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa37e000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37815cf60 con 0x7fa378156b50 2024-05-30T06:51:55.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa37e000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa378072be0 con 0x7fa378072230 2024-05-30T06:51:55.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa37e000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa378160d60 con 0x7fa3780cddb0 2024-05-30T06:51:55.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa37cc00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa378156b50 0x7fa378160230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48244/0 (socket says 172.21.15.37:48244) 2024-05-30T06:51:55.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa37cc00640 1 -- 172.21.15.37:0/3574796923 learned_addr learned my addr 172.21.15.37:0/3574796923 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:51:55.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258299013 0 0) 0x7fa37815cf60 con 0x7fa378156b50 2024-05-30T06:51:55.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa360003530 con 0x7fa378156b50 2024-05-30T06:51:55.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2088595889 0 0) 0x7fa360003530 con 0x7fa378156b50 2024-05-30T06:51:55.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780cddb0 msgr2=0x7fa3780ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:55.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 --2- 172.21.15.37:0/3574796923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780cddb0 0x7fa3780ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 >> v2:172.21.15.105:3300/0 conn(0x7fa378072230 msgr2=0x7fa3780726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 --2- 172.21.15.37:0/3574796923 >> v2:172.21.15.105:3300/0 conn(0x7fa378072230 0x7fa3780726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa378161040 con 0x7fa378156b50 2024-05-30T06:51:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fa36c0016a0 con 0x7fa378156b50 2024-05-30T06:51:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 >> v1:172.21.15.37:6789/0 conn(0x7fa378156b50 legacy=0x7fa378160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 --2- 172.21.15.37:0/3574796923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3600039c0 0x7fa360003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 --2- 172.21.15.37:0/3574796923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780cddb0 0x7fa360004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 --2- 172.21.15.37:0/3574796923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa360004da0 0x7fa360005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa378072be0 con 0x7fa360004da0 2024-05-30T06:51:55.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa378160d60 con 0x7fa3600039c0 2024-05-30T06:51:55.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa360010070 con 0x7fa3780cddb0 2024-05-30T06:51:55.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa37d600640 1 --2- 172.21.15.37:0/3574796923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa360004da0 0x7fa360005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:55.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa37d600640 1 -- 172.21.15.37:0/3574796923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780cddb0 msgr2=0x7fa360004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:55.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa37d600640 1 --2- 172.21.15.37:0/3574796923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3780cddb0 0x7fa360004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:55.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa37d600640 1 -- 172.21.15.37:0/3574796923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3600039c0 msgr2=0x7fa360003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:55.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa37d600640 1 --2- 172.21.15.37:0/3574796923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3600039c0 0x7fa360003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:55.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.788+0000 7fa37d600640 1 -- 172.21.15.37:0/3574796923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa360003530 con 0x7fa360004da0 2024-05-30T06:51:55.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.792+0000 7fa37d600640 1 --2- 172.21.15.37:0/3574796923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa360004da0 0x7fa360005220 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fa370009ca0 tx=0x7fa37001cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e1fa86de89527a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:55.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.796+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700b2070 con 0x7fa360004da0 2024-05-30T06:51:55.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.796+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3700a5ca0 con 0x7fa360004da0 2024-05-30T06:51:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.796+0000 7fa377400640 1 -- 172.21.15.37:0/3574796923 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370006e60 con 0x7fa360004da0 2024-05-30T06:51:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.796+0000 7fa37e000640 1 -- 172.21.15.37:0/3574796923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa360004da0 msgr2=0x7fa360005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.796+0000 7fa37e000640 1 --2- 172.21.15.37:0/3574796923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa360004da0 0x7fa360005220 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fa370009ca0 tx=0x7fa37001cc70 comp rx=0 tx=0).stop 2024-05-30T06:51:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.796+0000 7fa37d600640 1 -- 172.21.15.37:0/3574796923 reap_dead start 2024-05-30T06:51:55.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.796+0000 7fa37e000640 1 -- 172.21.15.37:0/3574796923 shutdown_connections 2024-05-30T06:51:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.796+0000 7fa37e000640 1 -- 172.21.15.37:0/3574796923 >> 172.21.15.37:0/3574796923 conn(0x7fa3780b25f0 msgr2=0x7fa3780b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.796+0000 7fa37e000640 1 -- 172.21.15.37:0/3574796923 shutdown_connections 2024-05-30T06:51:55.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.796+0000 7fa37e000640 1 -- 172.21.15.37:0/3574796923 wait complete. 2024-05-30T06:51:55.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa37e000640 1 Processor -- start 2024-05-30T06:51:55.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa37e000640 1 -- start start 2024-05-30T06:51:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa37e000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378155990 0x7fa3781539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa37e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa378134fb0 0x7fa378152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa37e000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa378155d70 0x7fa378152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa37e000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780cd890 con 0x7fa378134fb0 2024-05-30T06:51:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa37e000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3780cd5b0 con 0x7fa378155d70 2024-05-30T06:51:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa37e000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa378160940 con 0x7fa378155990 2024-05-30T06:51:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa377e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa378134fb0 0x7fa378152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa377e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa378134fb0 0x7fa378152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44998/0 (socket says 172.21.15.37:44998) 2024-05-30T06:51:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa377e00640 1 -- 172.21.15.37:0/3260765856 learned_addr learned my addr 172.21.15.37:0/3260765856 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa377e00640 1 -- 172.21.15.37:0/3260765856 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378155990 msgr2=0x7fa3781539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa377e00640 1 --2- 172.21.15.37:0/3260765856 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378155990 0x7fa3781539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa377e00640 1 -- 172.21.15.37:0/3260765856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa378155d70 msgr2=0x7fa378152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa377e00640 1 --2- 172.21.15.37:0/3260765856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa378155d70 0x7fa378152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:55.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa377e00640 1 -- 172.21.15.37:0/3260765856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37814e120 con 0x7fa378134fb0 2024-05-30T06:51:55.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.800+0000 7fa377e00640 1 --2- 172.21.15.37:0/3260765856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa378134fb0 0x7fa378152610 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fa36800b430 tx=0x7fa36800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:55.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.804+0000 7fa374c00640 1 -- 172.21.15.37:0/3260765856 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368015020 con 0x7fa378134fb0 2024-05-30T06:51:55.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.804+0000 7fa374c00640 1 -- 172.21.15.37:0/3260765856 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa368011830 con 0x7fa378134fb0 2024-05-30T06:51:55.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.804+0000 7fa37e000640 1 -- 172.21.15.37:0/3260765856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37814e400 con 0x7fa378134fb0 2024-05-30T06:51:55.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.804+0000 7fa374c00640 1 -- 172.21.15.37:0/3260765856 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368011c20 con 0x7fa378134fb0 2024-05-30T06:51:55.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.804+0000 7fa37e000640 1 -- 172.21.15.37:0/3260765856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37814e9c0 con 0x7fa378134fb0 2024-05-30T06:51:55.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.804+0000 7fa37e000640 1 -- 172.21.15.37:0/3260765856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa378153f10 con 0x7fa378134fb0 2024-05-30T06:51:55.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.808+0000 7fa374c00640 1 -- 172.21.15.37:0/3260765856 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) ==== 89517+0+0 (secure 0 0 0) 0x7fa368018020 con 0x7fa378134fb0 2024-05-30T06:51:55.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.808+0000 7fa374c00640 1 --2- 172.21.15.37:0/3260765856 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa35c0694e0 0x7fa35c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:55.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.808+0000 7fa374c00640 1 -- 172.21.15.37:0/3260765856 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fa368085ac0 con 0x7fa378134fb0 2024-05-30T06:51:55.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.812+0000 7fa374c00640 1 -- 172.21.15.37:0/3260765856 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa36801f020 con 0x7fa378134fb0 2024-05-30T06:51:55.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.824+0000 7fa37cc00640 1 --2- 172.21.15.37:0/3260765856 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa35c0694e0 0x7fa35c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:55.904+0000 7fa37cc00640 1 --2- 172.21.15.37:0/3260765856 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa35c0694e0 0x7fa35c06b9a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa37815ddb0 tx=0x7fa36c001560 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:56.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:56.092+0000 7fa37e000640 1 -- 172.21.15.37:0/3260765856 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone371018", "target": ["mon-mgr", ""]}) -- 0x7fa3780731d0 con 0x7fa35c0694e0 2024-05-30T06:51:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.188+0000 7fa374c00640 1 -- 172.21.15.37:0/3260765856 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa3780731d0 con 0x7fa35c0694e0 2024-05-30T06:51:57.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.188+0000 7fa37e000640 1 -- 172.21.15.37:0/3260765856 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa35c0694e0 msgr2=0x7fa35c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:57.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.188+0000 7fa37e000640 1 --2- 172.21.15.37:0/3260765856 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa35c0694e0 0x7fa35c06b9a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa37815ddb0 tx=0x7fa36c001560 comp rx=0 tx=0).stop 2024-05-30T06:51:57.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.188+0000 7fa37e000640 1 -- 172.21.15.37:0/3260765856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa378134fb0 msgr2=0x7fa378152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:57.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.188+0000 7fa37e000640 1 --2- 172.21.15.37:0/3260765856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa378134fb0 0x7fa378152610 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fa36800b430 tx=0x7fa36800b8f0 comp rx=0 tx=0).stop 2024-05-30T06:51:57.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.192+0000 7fa37e000640 1 -- 172.21.15.37:0/3260765856 shutdown_connections 2024-05-30T06:51:57.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.192+0000 7fa37e000640 1 --2- 172.21.15.37:0/3260765856 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa35c0694e0 0x7fa35c06b9a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:57.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.192+0000 7fa37e000640 1 --2- 172.21.15.37:0/3260765856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa378155d70 0x7fa378152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:57.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.192+0000 7fa37e000640 1 --2- 172.21.15.37:0/3260765856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa378134fb0 0x7fa378152610 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:57.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.192+0000 7fa37e000640 1 --2- 172.21.15.37:0/3260765856 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa378155990 0x7fa3781539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:57.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.192+0000 7fa37e000640 1 -- 172.21.15.37:0/3260765856 >> 172.21.15.37:0/3260765856 conn(0x7fa3780b25f0 msgr2=0x7fa37815f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:57.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.192+0000 7fa37e000640 1 -- 172.21.15.37:0/3260765856 shutdown_connections 2024-05-30T06:51:57.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.192+0000 7fa37e000640 1 -- 172.21.15.37:0/3260765856 wait complete. 2024-05-30T06:51:57.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone371019 2024-05-30T06:51:57.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7faff1400640 1 Processor -- start 2024-05-30T06:51:57.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7faff1400640 1 -- start start 2024-05-30T06:51:57.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7faff1400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fafec0d1db0 0x7fafec160400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:57.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7faff1400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafec160940 0x7fafec06b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:57.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7faff1400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec0d1290 con 0x7fafec15c9c0 2024-05-30T06:51:57.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7faff1400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fafec0d09f0 con 0x7fafec160940 2024-05-30T06:51:57.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7faff1400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fafec0d0cd0 con 0x7fafec0d1db0 2024-05-30T06:51:57.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7fafea800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fafec15c9c0 0x7fafec0ce4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47134/0 (socket says 172.21.15.37:47134) 2024-05-30T06:51:57.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7fafeb200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafec160940 0x7fafec06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:57.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7fafea800640 1 -- 172.21.15.37:0/3142173162 learned_addr learned my addr 172.21.15.37:0/3142173162 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:51:57.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7fafe1e00640 1 --2- 172.21.15.37:0/3142173162 >> v2:172.21.15.105:3300/0 conn(0x7fafec0d1db0 0x7fafec160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:57.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7fafeb200640 1 -- 172.21.15.37:0/3142173162 >> v2:172.21.15.105:3300/0 conn(0x7fafec0d1db0 msgr2=0x7fafec160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:57.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7fafeb200640 1 --2- 172.21.15.37:0/3142173162 >> v2:172.21.15.105:3300/0 conn(0x7fafec0d1db0 0x7fafec160400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:57.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7fafeb200640 1 -- 172.21.15.37:0/3142173162 >> v1:172.21.15.37:6789/0 conn(0x7fafec15c9c0 legacy=0x7fafec0ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:57.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7fafeb200640 1 -- 172.21.15.37:0/3142173162 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafec0d0fb0 con 0x7fafec160940 2024-05-30T06:51:57.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.432+0000 7fafe9e00640 1 -- 172.21.15.37:0/3142173162 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899743868 0 0) 0x7fafec0d1290 con 0x7fafec15c9c0 2024-05-30T06:51:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.436+0000 7fafeb200640 1 --2- 172.21.15.37:0/3142173162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafec160940 0x7fafec06b960 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fafec0b3fe0 tx=0x7fafe40206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41023e52f08b84a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.440+0000 7fafe9e00640 1 -- 172.21.15.37:0/3142173162 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe40ac420 con 0x7fafec160940 2024-05-30T06:51:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.440+0000 7fafe9e00640 1 -- 172.21.15.37:0/3142173162 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe40ac5c0 con 0x7fafec160940 2024-05-30T06:51:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.440+0000 7fafe9e00640 1 -- 172.21.15.37:0/3142173162 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe40ac990 con 0x7fafec160940 2024-05-30T06:51:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.440+0000 7faff1400640 1 -- 172.21.15.37:0/3142173162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafec160940 msgr2=0x7fafec06b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.440+0000 7faff1400640 1 --2- 172.21.15.37:0/3142173162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafec160940 0x7fafec06b960 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fafec0b3fe0 tx=0x7fafe40206e0 comp rx=0 tx=0).stop 2024-05-30T06:51:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.440+0000 7faff1400640 1 -- 172.21.15.37:0/3142173162 shutdown_connections 2024-05-30T06:51:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.440+0000 7faff1400640 1 --2- 172.21.15.37:0/3142173162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafec160940 0x7fafec06b960 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:57.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.440+0000 7faff1400640 1 --2- 172.21.15.37:0/3142173162 >> v2:172.21.15.105:3300/0 conn(0x7fafec0d1db0 0x7fafec160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:57.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.440+0000 7faff1400640 1 -- 172.21.15.37:0/3142173162 >> 172.21.15.37:0/3142173162 conn(0x7fafec09aa60 msgr2=0x7fafec0d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:57.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.440+0000 7faff1400640 1 -- 172.21.15.37:0/3142173162 shutdown_connections 2024-05-30T06:51:57.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.440+0000 7faff1400640 1 -- 172.21.15.37:0/3142173162 wait complete. 2024-05-30T06:51:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.440+0000 7faff1400640 1 Processor -- start 2024-05-30T06:51:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.440+0000 7faff1400640 1 -- start start 2024-05-30T06:51:57.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7faff1400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafec0d1db0 0x7fafec0c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:57.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7faff1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafec15c9c0 0x7fafec1538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:57.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7faff1400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafec160940 0x7fafec0cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:57.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7faff1400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fafec06c2b0 con 0x7fafec15c9c0 2024-05-30T06:51:57.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7faff1400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fafec167fa0 con 0x7fafec0d1db0 2024-05-30T06:51:57.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7faff1400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fafec168120 con 0x7fafec160940 2024-05-30T06:51:57.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7fafe1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafec15c9c0 0x7fafec1538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:57.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7fafe1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafec15c9c0 0x7fafec1538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59762/0 (socket says 172.21.15.37:59762) 2024-05-30T06:51:57.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7fafe1e00640 1 -- 172.21.15.37:0/3287065469 learned_addr learned my addr 172.21.15.37:0/3287065469 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:57.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7fafe1e00640 1 -- 172.21.15.37:0/3287065469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafec160940 msgr2=0x7fafec0cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:57.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7fafe1e00640 1 --2- 172.21.15.37:0/3287065469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafec160940 0x7fafec0cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:57.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7fafe1e00640 1 -- 172.21.15.37:0/3287065469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafec0d1db0 msgr2=0x7fafec0c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:57.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7fafe1e00640 1 --2- 172.21.15.37:0/3287065469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafec0d1db0 0x7fafec0c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:57.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7fafe1e00640 1 -- 172.21.15.37:0/3287065469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafec153de0 con 0x7fafec15c9c0 2024-05-30T06:51:57.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.444+0000 7fafe1e00640 1 --2- 172.21.15.37:0/3287065469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafec15c9c0 0x7fafec1538a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fafd400d620 tx=0x7fafd400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:57.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.448+0000 7fafe3400640 1 -- 172.21.15.37:0/3287065469 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd400b620 con 0x7fafec15c9c0 2024-05-30T06:51:57.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.448+0000 7fafe3400640 1 -- 172.21.15.37:0/3287065469 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd4019070 con 0x7fafec15c9c0 2024-05-30T06:51:57.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.448+0000 7fafe3400640 1 -- 172.21.15.37:0/3287065469 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd400b9c0 con 0x7fafec15c9c0 2024-05-30T06:51:57.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.448+0000 7faff1400640 1 -- 172.21.15.37:0/3287065469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafec0c77a0 con 0x7fafec15c9c0 2024-05-30T06:51:57.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.448+0000 7faff1400640 1 -- 172.21.15.37:0/3287065469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafec0c7d60 con 0x7fafec15c9c0 2024-05-30T06:51:57.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.448+0000 7faff1400640 1 -- 172.21.15.37:0/3287065469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafec068bc0 con 0x7fafec15c9c0 2024-05-30T06:51:57.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.448+0000 7fafe3400640 1 -- 172.21.15.37:0/3287065469 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) ==== 89517+0+0 (secure 0 0 0) 0x7fafd400bb60 con 0x7fafec15c9c0 2024-05-30T06:51:57.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.448+0000 7fafe3400640 1 --2- 172.21.15.37:0/3287065469 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafc8069490 0x7fafc806b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:57.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.448+0000 7fafe3400640 1 -- 172.21.15.37:0/3287065469 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fafd40858d0 con 0x7fafec15c9c0 2024-05-30T06:51:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.452+0000 7fafe3400640 1 -- 172.21.15.37:0/3287065469 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fafd4057940 con 0x7fafec15c9c0 2024-05-30T06:51:57.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.492+0000 7fafea800640 1 --2- 172.21.15.37:0/3287065469 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafc8069490 0x7fafc806b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.632+0000 7fafea800640 1 --2- 172.21.15.37:0/3287065469 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafc8069490 0x7fafc806b950 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fafec15b3a0 tx=0x7fafdc007cf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:57.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:57.752+0000 7faff1400640 1 -- 172.21.15.37:0/3287065469 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone371019", "target": ["mon-mgr", ""]}) -- 0x7fafec0c4c30 con 0x7fafc8069490 2024-05-30T06:51:58.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:58.948+0000 7fafe3400640 1 -- 172.21.15.37:0/3287065469 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fafec0c4c30 con 0x7fafc8069490 2024-05-30T06:51:58.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:58.952+0000 7faff1400640 1 -- 172.21.15.37:0/3287065469 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafc8069490 msgr2=0x7fafc806b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:58.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:58.952+0000 7faff1400640 1 --2- 172.21.15.37:0/3287065469 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafc8069490 0x7fafc806b950 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fafec15b3a0 tx=0x7fafdc007cf0 comp rx=0 tx=0).stop 2024-05-30T06:51:58.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:58.952+0000 7faff1400640 1 -- 172.21.15.37:0/3287065469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafec15c9c0 msgr2=0x7fafec1538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:58.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:58.952+0000 7faff1400640 1 --2- 172.21.15.37:0/3287065469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafec15c9c0 0x7fafec1538a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fafd400d620 tx=0x7fafd400dae0 comp rx=0 tx=0).stop 2024-05-30T06:51:58.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:58.952+0000 7faff1400640 1 -- 172.21.15.37:0/3287065469 shutdown_connections 2024-05-30T06:51:58.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:58.952+0000 7faff1400640 1 --2- 172.21.15.37:0/3287065469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafec160940 0x7fafec0cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:58.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:58.952+0000 7faff1400640 1 --2- 172.21.15.37:0/3287065469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafec15c9c0 0x7fafec1538a0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:58.952+0000 7faff1400640 1 --2- 172.21.15.37:0/3287065469 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafc8069490 0x7fafc806b950 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:58.952+0000 7faff1400640 1 --2- 172.21.15.37:0/3287065469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafec0d1db0 0x7fafec0c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:58.952+0000 7faff1400640 1 -- 172.21.15.37:0/3287065469 >> 172.21.15.37:0/3287065469 conn(0x7fafec09aa60 msgr2=0x7fafec0b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:58.952+0000 7faff1400640 1 -- 172.21.15.37:0/3287065469 shutdown_connections 2024-05-30T06:51:58.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:58.952+0000 7faff1400640 1 -- 172.21.15.37:0/3287065469 wait complete. 2024-05-30T06:51:58.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone371020 2024-05-30T06:51:59.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.264+0000 7fe31fe00640 1 Processor -- start 2024-05-30T06:51:59.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.264+0000 7fe31fe00640 1 -- start start 2024-05-30T06:51:59.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.268+0000 7fe31fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3180b5d00 0x7fe3180b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:59.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.268+0000 7fe31fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe31815bc10 0x7fe3180ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:59.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.268+0000 7fe31fe00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3180b6620 con 0x7fe3180ced80 2024-05-30T06:51:59.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.268+0000 7fe31fe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe3180cf240 con 0x7fe31815bc10 2024-05-30T06:51:59.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.268+0000 7fe31fe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe3180cf520 con 0x7fe3180b5d00 2024-05-30T06:51:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.268+0000 7fe31de00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe3180ced80 0x7fe31815e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47136/0 (socket says 172.21.15.37:47136) 2024-05-30T06:51:59.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.268+0000 7fe31de00640 1 -- 172.21.15.37:0/1944641695 learned_addr learned my addr 172.21.15.37:0/1944641695 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:51:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2511714654 0 0) 0x7fe3180b6620 con 0x7fe3180ced80 2024-05-30T06:51:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe300003530 con 0x7fe3180ced80 2024-05-30T06:51:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3513009914 0 0) 0x7fe300003530 con 0x7fe3180ced80 2024-05-30T06:51:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3180b5d00 msgr2=0x7fe3180b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 --2- 172.21.15.37:0/1944641695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3180b5d00 0x7fe3180b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 >> v2:172.21.15.37:3300/0 conn(0x7fe31815bc10 msgr2=0x7fe3180ce840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T06:51:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 --2- 172.21.15.37:0/1944641695 >> v2:172.21.15.37:3300/0 conn(0x7fe31815bc10 0x7fe3180ce840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3180cf800 con 0x7fe3180ced80 2024-05-30T06:51:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fe310001a00 con 0x7fe3180ced80 2024-05-30T06:51:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 >> v1:172.21.15.37:6789/0 conn(0x7fe3180ced80 legacy=0x7fe31815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 --2- 172.21.15.37:0/1944641695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3000039c0 0x7fe300003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 --2- 172.21.15.37:0/1944641695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe300004810 0x7fe300004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 --2- 172.21.15.37:0/1944641695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3000051d0 0x7fe3000145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3180cf240 con 0x7fe3000039c0 2024-05-30T06:51:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe3180cf520 con 0x7fe3000051d0 2024-05-30T06:51:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe300014b10 con 0x7fe300004810 2024-05-30T06:51:59.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe31d400640 1 --2- 172.21.15.37:0/1944641695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3000039c0 0x7fe300003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:59.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe31d400640 1 -- 172.21.15.37:0/1944641695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe300004810 msgr2=0x7fe300004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T06:51:59.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe31d400640 1 --2- 172.21.15.37:0/1944641695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe300004810 0x7fe300004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:59.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe31d400640 1 -- 172.21.15.37:0/1944641695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3000051d0 msgr2=0x7fe3000145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:51:59.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe31d400640 1 --2- 172.21.15.37:0/1944641695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3000051d0 0x7fe3000145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:59.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.272+0000 7fe31d400640 1 -- 172.21.15.37:0/1944641695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe300003530 con 0x7fe3000039c0 2024-05-30T06:51:59.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.280+0000 7fe31d400640 1 --2- 172.21.15.37:0/1944641695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3000039c0 0x7fe300003de0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe30c006fd0 tx=0x7fe30c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758ada7087ec76d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.280+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0b0070 con 0x7fe3000039c0 2024-05-30T06:51:59.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.280+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c0ab600 con 0x7fe3000039c0 2024-05-30T06:51:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.280+0000 7fe317e00640 1 -- 172.21.15.37:0/1944641695 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0093f0 con 0x7fe3000039c0 2024-05-30T06:51:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.280+0000 7fe31fe00640 1 -- 172.21.15.37:0/1944641695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3000039c0 msgr2=0x7fe300003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.280+0000 7fe31fe00640 1 --2- 172.21.15.37:0/1944641695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3000039c0 0x7fe300003de0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe30c006fd0 tx=0x7fe30c01c210 comp rx=0 tx=0).stop 2024-05-30T06:51:59.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.280+0000 7fe31de00640 1 -- 172.21.15.37:0/1944641695 reap_dead start 2024-05-30T06:51:59.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.284+0000 7fe31fe00640 1 -- 172.21.15.37:0/1944641695 shutdown_connections 2024-05-30T06:51:59.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.284+0000 7fe31fe00640 1 -- 172.21.15.37:0/1944641695 >> 172.21.15.37:0/1944641695 conn(0x7fe31806bf60 msgr2=0x7fe3180b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:51:59.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.284+0000 7fe31fe00640 1 -- 172.21.15.37:0/1944641695 shutdown_connections 2024-05-30T06:51:59.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.284+0000 7fe31fe00640 1 -- 172.21.15.37:0/1944641695 wait complete. 2024-05-30T06:51:59.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.284+0000 7fe31fe00640 1 Processor -- start 2024-05-30T06:51:59.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.284+0000 7fe31fe00640 1 -- start start 2024-05-30T06:51:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3000039c0 0x7fe31815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3180af1b0 0x7fe3180b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31fe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3180af610 0x7fe3180b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3180b6260 con 0x7fe3000039c0 2024-05-30T06:51:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31fe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe3180b60e0 con 0x7fe3180af610 2024-05-30T06:51:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31fe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe3180b63e0 con 0x7fe3180af1b0 2024-05-30T06:51:59.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3000039c0 0x7fe31815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:59.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3000039c0 0x7fe31815a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59784/0 (socket says 172.21.15.37:59784) 2024-05-30T06:51:59.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31d400640 1 -- 172.21.15.37:0/461995210 learned_addr learned my addr 172.21.15.37:0/461995210 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:51:59.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31d400640 1 -- 172.21.15.37:0/461995210 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3180af1b0 msgr2=0x7fe3180b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:59.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31d400640 1 --2- 172.21.15.37:0/461995210 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3180af1b0 0x7fe3180b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:59.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31d400640 1 -- 172.21.15.37:0/461995210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3180af610 msgr2=0x7fe3180b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:51:59.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31d400640 1 --2- 172.21.15.37:0/461995210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3180af610 0x7fe3180b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:51:59.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31d400640 1 -- 172.21.15.37:0/461995210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3180aaa60 con 0x7fe3000039c0 2024-05-30T06:51:59.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31d400640 1 --2- 172.21.15.37:0/461995210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3000039c0 0x7fe31815a3f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe30c01c040 tx=0x7fe300005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:59.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe315600640 1 -- 172.21.15.37:0/461995210 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0b0040 con 0x7fe3000039c0 2024-05-30T06:51:59.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe315600640 1 -- 172.21.15.37:0/461995210 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe30c0bd070 con 0x7fe3000039c0 2024-05-30T06:51:59.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe315600640 1 -- 172.21.15.37:0/461995210 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe30c0b5460 con 0x7fe3000039c0 2024-05-30T06:51:59.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.288+0000 7fe31fe00640 1 -- 172.21.15.37:0/461995210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3180aad40 con 0x7fe3000039c0 2024-05-30T06:51:59.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.292+0000 7fe31fe00640 1 -- 172.21.15.37:0/461995210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3180ab300 con 0x7fe3000039c0 2024-05-30T06:51:59.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.292+0000 7fe31fe00640 1 -- 172.21.15.37:0/461995210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe318068bc0 con 0x7fe3000039c0 2024-05-30T06:51:59.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.292+0000 7fe315600640 1 -- 172.21.15.37:0/461995210 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) ==== 89517+0+0 (secure 0 0 0) 0x7fe30c0b3070 con 0x7fe3000039c0 2024-05-30T06:51:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.296+0000 7fe315600640 1 --2- 172.21.15.37:0/461995210 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2f80694b0 0x7fe2f806b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:51:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.296+0000 7fe315600640 1 -- 172.21.15.37:0/461995210 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fe30c11f690 con 0x7fe3000039c0 2024-05-30T06:51:59.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.304+0000 7fe31ca00640 1 --2- 172.21.15.37:0/461995210 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2f80694b0 0x7fe2f806b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:51:59.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.312+0000 7fe315600640 1 -- 172.21.15.37:0/461995210 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe30c015f70 con 0x7fe3000039c0 2024-05-30T06:51:59.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.316+0000 7fe31ca00640 1 --2- 172.21.15.37:0/461995210 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2f80694b0 0x7fe2f806b970 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe3180b1ec0 tx=0x7fe304006c50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:51:59.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:51:59.632+0000 7fe31fe00640 1 -- 172.21.15.37:0/461995210 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone371020", "target": ["mon-mgr", ""]}) -- 0x7fe3180aa810 con 0x7fe2f80694b0 2024-05-30T06:52:00.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:00.704+0000 7fe315600640 1 -- 172.21.15.37:0/461995210 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe3180aa810 con 0x7fe2f80694b0 2024-05-30T06:52:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:00.704+0000 7fe31fe00640 1 -- 172.21.15.37:0/461995210 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2f80694b0 msgr2=0x7fe2f806b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:00.704+0000 7fe31fe00640 1 --2- 172.21.15.37:0/461995210 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2f80694b0 0x7fe2f806b970 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe3180b1ec0 tx=0x7fe304006c50 comp rx=0 tx=0).stop 2024-05-30T06:52:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:00.704+0000 7fe31fe00640 1 -- 172.21.15.37:0/461995210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3000039c0 msgr2=0x7fe31815a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:00.704+0000 7fe31fe00640 1 --2- 172.21.15.37:0/461995210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3000039c0 0x7fe31815a3f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe30c01c040 tx=0x7fe300005840 comp rx=0 tx=0).stop 2024-05-30T06:52:00.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:00.704+0000 7fe31fe00640 1 -- 172.21.15.37:0/461995210 shutdown_connections 2024-05-30T06:52:00.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:00.704+0000 7fe31fe00640 1 --2- 172.21.15.37:0/461995210 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2f80694b0 0x7fe2f806b970 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:00.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:00.704+0000 7fe31fe00640 1 --2- 172.21.15.37:0/461995210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3180af610 0x7fe3180b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:00.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:00.704+0000 7fe31fe00640 1 --2- 172.21.15.37:0/461995210 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3180af1b0 0x7fe3180b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:00.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:00.704+0000 7fe31fe00640 1 --2- 172.21.15.37:0/461995210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3000039c0 0x7fe31815a3f0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:00.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:00.704+0000 7fe31fe00640 1 -- 172.21.15.37:0/461995210 >> 172.21.15.37:0/461995210 conn(0x7fe31806bf60 msgr2=0x7fe3180ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:00.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:00.708+0000 7fe31fe00640 1 -- 172.21.15.37:0/461995210 shutdown_connections 2024-05-30T06:52:00.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:00.708+0000 7fe31fe00640 1 -- 172.21.15.37:0/461995210 wait complete. 2024-05-30T06:52:02.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:52:02.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.964+0000 7f598ba00640 1 Processor -- start 2024-05-30T06:52:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.964+0000 7f598ba00640 1 -- start start 2024-05-30T06:52:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.964+0000 7f598ba00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f598406b960 0x7f598415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.964+0000 7f598ba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59840cd2a0 0x7f59840b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.964+0000 7f598ba00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5984160580 con 0x7f598406bd40 2024-05-30T06:52:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.964+0000 7f598ba00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f59840b3fd0 con 0x7f598406b960 2024-05-30T06:52:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.964+0000 7f598ba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5984160860 con 0x7f59840cd2a0 2024-05-30T06:52:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.968+0000 7f5983e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59840cd2a0 0x7f59840b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.968+0000 7f5983e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59840cd2a0 0x7f59840b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:43754/0 (socket says 172.21.15.37:43754) 2024-05-30T06:52:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.968+0000 7f5983e00640 1 -- 172.21.15.37:0/1400812322 learned_addr learned my addr 172.21.15.37:0/1400812322 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:02.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.968+0000 7f5989000640 1 --2- 172.21.15.37:0/1400812322 >> v2:172.21.15.105:3300/0 conn(0x7f598406b960 0x7f598415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:02.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.972+0000 7f5983e00640 1 -- 172.21.15.37:0/1400812322 >> v2:172.21.15.105:3300/0 conn(0x7f598406b960 msgr2=0x7f598415cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:02.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.972+0000 7f5983e00640 1 --2- 172.21.15.37:0/1400812322 >> v2:172.21.15.105:3300/0 conn(0x7f598406b960 0x7f598415cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:02.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.972+0000 7f5983e00640 1 -- 172.21.15.37:0/1400812322 >> v1:172.21.15.105:6789/0 conn(0x7f598406bd40 legacy=0x7f59840cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:02.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.972+0000 7f5983e00640 1 -- 172.21.15.37:0/1400812322 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5984160b40 con 0x7f59840cd2a0 2024-05-30T06:52:02.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.980+0000 7f5983e00640 1 --2- 172.21.15.37:0/1400812322 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59840cd2a0 0x7f59840b3a90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5970009870 tx=0x7f597001c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57807e4a8bc60163 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:02.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.980+0000 7f5983400640 1 -- 172.21.15.37:0/1400812322 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59700b1070 con 0x7f59840cd2a0 2024-05-30T06:52:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.980+0000 7f5983400640 1 -- 172.21.15.37:0/1400812322 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59700ac630 con 0x7f59840cd2a0 2024-05-30T06:52:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.980+0000 7f5983400640 1 -- 172.21.15.37:0/1400812322 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59700a8050 con 0x7f59840cd2a0 2024-05-30T06:52:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.980+0000 7f598ba00640 1 -- 172.21.15.37:0/1400812322 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59840cd2a0 msgr2=0x7f59840b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.980+0000 7f598ba00640 1 --2- 172.21.15.37:0/1400812322 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59840cd2a0 0x7f59840b3a90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5970009870 tx=0x7f597001c4f0 comp rx=0 tx=0).stop 2024-05-30T06:52:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.980+0000 7f598ba00640 1 -- 172.21.15.37:0/1400812322 shutdown_connections 2024-05-30T06:52:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.980+0000 7f598ba00640 1 --2- 172.21.15.37:0/1400812322 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59840cd2a0 0x7f59840b3a90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.980+0000 7f598ba00640 1 --2- 172.21.15.37:0/1400812322 >> v2:172.21.15.105:3300/0 conn(0x7f598406b960 0x7f598415cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.980+0000 7f598ba00640 1 -- 172.21.15.37:0/1400812322 >> 172.21.15.37:0/1400812322 conn(0x7f598409aa60 msgr2=0x7f59840b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.980+0000 7f598ba00640 1 -- 172.21.15.37:0/1400812322 shutdown_connections 2024-05-30T06:52:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.980+0000 7f598ba00640 1 -- 172.21.15.37:0/1400812322 wait complete. 2024-05-30T06:52:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.984+0000 7f598ba00640 1 Processor -- start 2024-05-30T06:52:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.984+0000 7f598ba00640 1 -- start start 2024-05-30T06:52:02.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f598ba00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f598406b960 0x7f598414cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:02.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f598ba00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f598406bd40 0x7f59840caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:02.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f598ba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59840cd2a0 0x7f59840c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:02.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f598ba00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f598415a800 con 0x7f598406b960 2024-05-30T06:52:02.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f598ba00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f598415a680 con 0x7f598406bd40 2024-05-30T06:52:02.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f598ba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5984169780 con 0x7f59840cd2a0 2024-05-30T06:52:02.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5989000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f598406b960 0x7f598414cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:02.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5989000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f598406b960 0x7f598414cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59794/0 (socket says 172.21.15.37:59794) 2024-05-30T06:52:02.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5989000640 1 -- 172.21.15.37:0/2456672572 learned_addr learned my addr 172.21.15.37:0/2456672572 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:02.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5983e00640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f598406bd40 0x7f59840caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:02.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5989a00640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59840cd2a0 0x7f59840c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:02.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5989000640 1 -- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59840cd2a0 msgr2=0x7f59840c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:02.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5989000640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59840cd2a0 0x7f59840c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:02.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5989000640 1 -- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f598406bd40 msgr2=0x7f59840caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:02.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5989000640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f598406bd40 0x7f59840caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:02.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5989000640 1 -- 172.21.15.37:0/2456672572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59840cdf00 con 0x7f598406b960 2024-05-30T06:52:02.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5989000640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f598406b960 0x7f598414cd80 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f597800e930 tx=0x7f597800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5980c00640 1 -- 172.21.15.37:0/2456672572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5978017070 con 0x7f598406b960 2024-05-30T06:52:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5980c00640 1 -- 172.21.15.37:0/2456672572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f597800ca00 con 0x7f598406b960 2024-05-30T06:52:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f598ba00640 1 -- 172.21.15.37:0/2456672572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59840ce1e0 con 0x7f598406b960 2024-05-30T06:52:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f5980c00640 1 -- 172.21.15.37:0/2456672572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597800cdb0 con 0x7f598406b960 2024-05-30T06:52:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f598ba00640 1 -- 172.21.15.37:0/2456672572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59840b2180 con 0x7f598406b960 2024-05-30T06:52:02.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.988+0000 7f598ba00640 1 -- 172.21.15.37:0/2456672572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5984068b20 con 0x7f598406b960 2024-05-30T06:52:02.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.992+0000 7f5980c00640 1 -- 172.21.15.37:0/2456672572 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) ==== 89517+0+0 (secure 0 0 0) 0x7f597801a070 con 0x7f598406b960 2024-05-30T06:52:02.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.992+0000 7f5980c00640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5964069460 0x7f596406b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:02.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:02.992+0000 7f5980c00640 1 -- 172.21.15.37:0/2456672572 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f5978085970 con 0x7f598406b960 2024-05-30T06:52:03.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.008+0000 7f5980c00640 1 -- 172.21.15.37:0/2456672572 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5978057680 con 0x7f598406b960 2024-05-30T06:52:03.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.036+0000 7f5983e00640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5964069460 0x7f596406b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.080+0000 7f5983e00640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5964069460 0x7f596406b920 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f59700ae000 tx=0x7f5970008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f598ba00640 1 -- 172.21.15.37:0/2456672572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f598406c490 con 0x7f598406b960 2024-05-30T06:52:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f5980c00640 1 -- 172.21.15.37:0/2456672572 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2420 (secure 0 0 0) 0x7f5978056f80 con 0x7f598406b960 2024-05-30T06:52:03.350 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:52:03.350 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:52:03.350 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:52:03.350 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:52:03.350 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:52:03.350 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:52:03.350 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:52:03.350 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:03.350 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:52:03.350 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:52:03.350 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:52:03.351 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:52:03.351 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:52:03.351 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:03.351 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:52:03.351 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:52:03.351 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:52:03.351 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:52:03.351 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:03.351 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 617, 2024-05-30T06:52:03.351 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:52:03.351 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:52:03.351 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:52:03.351 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:52:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:52:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:52:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:52:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:52:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:52:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:52:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:52:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:52:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:52:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:52:03.352 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 6199, 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 25801931632, 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 51561275392, 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 721532837888, 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 791481621, 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 793310587, 2024-05-30T06:52:03.353 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 192, 2024-05-30T06:52:03.354 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 214 2024-05-30T06:52:03.354 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:03.354 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:52:03.354 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:52:03.354 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:52:03.354 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:52:03.354 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:52:03.354 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:52:03.354 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:52:03.354 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:03.354 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:52:03.354 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:52:03.354 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:52:03.355 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:52:03.355 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:52:03.355 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:03.355 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:03.355 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:52:03.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:03.355 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:52:03.355 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:52:03.355 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:52:03.355 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:52:03.355 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:52:03.355 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:52:03.355 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 12, 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:51:42.820933+0000", 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: "37467ab0-9e28-4c72-9193-e79e68c05454": { 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "11 ongoing+pending clones; Avg progress is 21.236% (27s)\n [=====.......................] (remaining: 102s)", 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.21235999464988708, 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:03.356 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:52:03.357 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "4 ongoing clones; Avg progress is 15.3% (32s)\n [====........................] (remaining: 3m)", 2024-05-30T06:52:03.357 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.15299999713897705, 2024-05-30T06:52:03.357 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:03.357 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:03.357 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:03.357 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:52:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f598ba00640 1 -- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5964069460 msgr2=0x7f596406b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f598ba00640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5964069460 0x7f596406b920 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f59700ae000 tx=0x7f5970008040 comp rx=0 tx=0).stop 2024-05-30T06:52:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f598ba00640 1 -- 172.21.15.37:0/2456672572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f598406b960 msgr2=0x7f598414cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f598ba00640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f598406b960 0x7f598414cd80 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f597800e930 tx=0x7f597800edf0 comp rx=0 tx=0).stop 2024-05-30T06:52:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f598ba00640 1 -- 172.21.15.37:0/2456672572 shutdown_connections 2024-05-30T06:52:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f598ba00640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59840cd2a0 0x7f59840c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f598ba00640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5964069460 0x7f596406b920 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f598ba00640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f598406bd40 0x7f59840caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:03.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f598ba00640 1 --2- 172.21.15.37:0/2456672572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f598406b960 0x7f598414cd80 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:03.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f598ba00640 1 -- 172.21.15.37:0/2456672572 >> 172.21.15.37:0/2456672572 conn(0x7f598409aa60 msgr2=0x7f59841514d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:03.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f598ba00640 1 -- 172.21.15.37:0/2456672572 shutdown_connections 2024-05-30T06:52:03.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:03.348+0000 7f598ba00640 1 -- 172.21.15.37:0/2456672572 wait complete. 2024-05-30T06:52:03.371 INFO:tasks.cephfs.test_volumes:pevs - {'37467ab0-9e28-4c72-9193-e79e68c05454': {'message': '11 ongoing+pending clones; Avg progress is 21.236% (27s)\n [=====.......................] (remaining: 102s)', 'progress': 0.21235999464988708, 'add_to_ceph_s': True}, 'c2a8ed33-2876-45d4-ae98-defcf6508d81': {'message': '4 ongoing clones; Avg progress is 15.3% (32s)\n [====........................] (remaining: 3m)', 'progress': 0.15299999713897705, 'add_to_ceph_s': True}} 2024-05-30T06:52:03.371 INFO:tasks.cephfs.test_volumes:on_p = 0.26302000880241394 new_on_p = 0.15299999713897705 2024-05-30T06:52:03.371 INFO:tasks.cephfs.test_volumes:onpen_p = 0.21041999757289886 new_onpen_p = 0.21235999464988708 2024-05-30T06:52:03.372 INFO:tasks.cephfs.test_volumes:onpen_count = 5 new_onpen_count = 11 2024-05-30T06:52:04.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:52:04.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1aba00640 1 Processor -- start 2024-05-30T06:52:04.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1aba00640 1 -- start start 2024-05-30T06:52:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1aba00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1a415e930 0x7fe1a409b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1aba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1a40d1240 0x7fe1a41625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1aba00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1a409abe0 con 0x7fe1a40d1660 2024-05-30T06:52:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1aba00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe1a409bee0 con 0x7fe1a415e930 2024-05-30T06:52:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1aba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a409aec0 con 0x7fe1a40d1240 2024-05-30T06:52:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1a9000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1a415e930 0x7fe1a409b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1a9000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1a415e930 0x7fe1a409b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59808/0 (socket says 172.21.15.37:59808) 2024-05-30T06:52:04.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1a9000640 1 -- 172.21.15.37:0/1476336869 learned_addr learned my addr 172.21.15.37:0/1476336869 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:04.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1a3e00640 1 --2- 172.21.15.37:0/1476336869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1a40d1240 0x7fe1a41625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:04.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1a9000640 1 -- 172.21.15.37:0/1476336869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1a40d1240 msgr2=0x7fe1a41625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:04.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1a9000640 1 --2- 172.21.15.37:0/1476336869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1a40d1240 0x7fe1a41625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:04.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1a9000640 1 -- 172.21.15.37:0/1476336869 >> v1:172.21.15.105:6789/0 conn(0x7fe1a40d1660 legacy=0x7fe1a40ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:04.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.524+0000 7fe1a9000640 1 -- 172.21.15.37:0/1476336869 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a409b1a0 con 0x7fe1a415e930 2024-05-30T06:52:04.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.528+0000 7fe1a9000640 1 --2- 172.21.15.37:0/1476336869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a415e930 0x7fe1a409b9a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe198009870 tx=0x7fe19801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0ec27b67cbc87c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:04.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.528+0000 7fe1a3400640 1 -- 172.21.15.37:0/1476336869 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1980a7070 con 0x7fe1a415e930 2024-05-30T06:52:04.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.528+0000 7fe1a3400640 1 -- 172.21.15.37:0/1476336869 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1980b0070 con 0x7fe1a415e930 2024-05-30T06:52:04.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.528+0000 7fe1a3400640 1 -- 172.21.15.37:0/1476336869 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1980ab890 con 0x7fe1a415e930 2024-05-30T06:52:04.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.528+0000 7fe1aba00640 1 -- 172.21.15.37:0/1476336869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a415e930 msgr2=0x7fe1a409b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:04.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.528+0000 7fe1aba00640 1 --2- 172.21.15.37:0/1476336869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a415e930 0x7fe1a409b9a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe198009870 tx=0x7fe19801c560 comp rx=0 tx=0).stop 2024-05-30T06:52:04.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.528+0000 7fe1aba00640 1 -- 172.21.15.37:0/1476336869 shutdown_connections 2024-05-30T06:52:04.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.528+0000 7fe1aba00640 1 --2- 172.21.15.37:0/1476336869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1a40d1240 0x7fe1a41625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:04.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.528+0000 7fe1aba00640 1 --2- 172.21.15.37:0/1476336869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a415e930 0x7fe1a409b9a0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:04.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.528+0000 7fe1aba00640 1 -- 172.21.15.37:0/1476336869 >> 172.21.15.37:0/1476336869 conn(0x7fe1a40b4100 msgr2=0x7fe1a40b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:04.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.528+0000 7fe1aba00640 1 -- 172.21.15.37:0/1476336869 shutdown_connections 2024-05-30T06:52:04.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.528+0000 7fe1aba00640 1 -- 172.21.15.37:0/1476336869 wait complete. 2024-05-30T06:52:04.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1aba00640 1 Processor -- start 2024-05-30T06:52:04.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1aba00640 1 -- start start 2024-05-30T06:52:04.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1aba00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1a40d1240 0x7fe1a41622a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:04.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1aba00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a40d1660 0x7fe1a415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:04.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1aba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1a415e930 0x7fe1a415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:04.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1aba00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a415ed10 con 0x7fe1a40d1660 2024-05-30T06:52:04.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1aba00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a4162ef0 con 0x7fe1a40d1240 2024-05-30T06:52:04.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1aba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a415ee90 con 0x7fe1a415e930 2024-05-30T06:52:04.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a40d1660 0x7fe1a415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:04.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a40d1660 0x7fe1a415cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59824/0 (socket says 172.21.15.37:59824) 2024-05-30T06:52:04.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a3e00640 1 -- 172.21.15.37:0/601111406 learned_addr learned my addr 172.21.15.37:0/601111406 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:04.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a9000640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1a40d1240 0x7fe1a41622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:04.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a9a00640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1a415e930 0x7fe1a415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:04.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a3e00640 1 -- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1a415e930 msgr2=0x7fe1a415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:04.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a3e00640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1a415e930 0x7fe1a415d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:04.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a3e00640 1 -- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1a40d1240 msgr2=0x7fe1a41622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:04.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a3e00640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1a40d1240 0x7fe1a41622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:04.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a3e00640 1 -- 172.21.15.37:0/601111406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a415aa80 con 0x7fe1a40d1660 2024-05-30T06:52:04.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a3e00640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a40d1660 0x7fe1a415cb70 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe19000d620 tx=0x7fe19000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:04.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a0c00640 1 -- 172.21.15.37:0/601111406 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19000b620 con 0x7fe1a40d1660 2024-05-30T06:52:04.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a0c00640 1 -- 172.21.15.37:0/601111406 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe190019070 con 0x7fe1a40d1660 2024-05-30T06:52:04.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1aba00640 1 -- 172.21.15.37:0/601111406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a415d6e0 con 0x7fe1a40d1660 2024-05-30T06:52:04.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1a0c00640 1 -- 172.21.15.37:0/601111406 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19000ba20 con 0x7fe1a40d1660 2024-05-30T06:52:04.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1aba00640 1 -- 172.21.15.37:0/601111406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a4158cf0 con 0x7fe1a40d1660 2024-05-30T06:52:04.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.532+0000 7fe1aba00640 1 -- 172.21.15.37:0/601111406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a4068b20 con 0x7fe1a40d1660 2024-05-30T06:52:04.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.536+0000 7fe1a0c00640 1 -- 172.21.15.37:0/601111406 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) ==== 89517+0+0 (secure 0 0 0) 0x7fe19000bbc0 con 0x7fe1a40d1660 2024-05-30T06:52:04.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.536+0000 7fe1a0c00640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe184069460 0x7fe18406b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:04.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.536+0000 7fe1a0c00640 1 -- 172.21.15.37:0/601111406 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fe190085850 con 0x7fe1a40d1660 2024-05-30T06:52:04.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.536+0000 7fe1a9000640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe184069460 0x7fe18406b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:04.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.536+0000 7fe1a9000640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe184069460 0x7fe18406b920 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe1980af000 tx=0x7fe1980a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:04.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.540+0000 7fe1a0c00640 1 -- 172.21.15.37:0/601111406 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe190057250 con 0x7fe1a40d1660 2024-05-30T06:52:04.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1aba00640 1 -- 172.21.15.37:0/601111406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fe1a40b8490 con 0x7fe1a40d1660 2024-05-30T06:52:04.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1a0c00640 1 -- 172.21.15.37:0/601111406 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2421 (secure 0 0 0) 0x7fe19005b550 con 0x7fe1a40d1660 2024-05-30T06:52:04.770 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:52:04.771 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:52:04.771 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:52:04.771 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:52:04.771 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:52:04.771 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:52:04.771 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:52:04.771 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:04.771 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:52:04.771 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:52:04.771 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:52:04.771 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:52:04.771 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:52:04.771 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:04.772 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:52:04.772 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:52:04.772 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:52:04.772 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:52:04.772 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:04.772 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 619, 2024-05-30T06:52:04.772 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:52:04.772 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:52:04.772 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:52:04.772 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:52:04.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:04.772 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:52:04.772 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:04.773 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:04.774 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:52:04.774 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:52:04.774 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 6199, 2024-05-30T06:52:04.774 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 25801931632, 2024-05-30T06:52:04.774 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 51561275392, 2024-05-30T06:52:04.774 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 721532837888, 2024-05-30T06:52:04.774 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:52:04.774 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 597584771, 2024-05-30T06:52:04.774 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 594846315, 2024-05-30T06:52:04.774 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 143, 2024-05-30T06:52:04.774 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 158 2024-05-30T06:52:04.774 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:04.775 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:04.776 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:52:04.776 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:04.776 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:52:04.776 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:52:04.776 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:52:04.776 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:52:04.776 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:52:04.776 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:52:04.776 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:52:04.776 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:04.776 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:04.776 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:04.776 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:52:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 12, 2024-05-30T06:52:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:51:42.820933+0000", 2024-05-30T06:52:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:52:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: "37467ab0-9e28-4c72-9193-e79e68c05454": { 2024-05-30T06:52:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "14 ongoing+pending clones; Avg progress is 25.893% (32s)\n [=======.....................] (remaining: 93s)", 2024-05-30T06:52:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.25892999768257141, 2024-05-30T06:52:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:52:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "4 ongoing clones; Avg progress is 22.656% (37s)\n [======......................] (remaining: 2m)", 2024-05-30T06:52:04.777 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.22655999660491943, 2024-05-30T06:52:04.778 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:04.778 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:04.778 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:04.778 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:52:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1aba00640 1 -- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe184069460 msgr2=0x7fe18406b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1aba00640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe184069460 0x7fe18406b920 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe1980af000 tx=0x7fe1980a7000 comp rx=0 tx=0).stop 2024-05-30T06:52:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1aba00640 1 -- 172.21.15.37:0/601111406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a40d1660 msgr2=0x7fe1a415cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1aba00640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a40d1660 0x7fe1a415cb70 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe19000d620 tx=0x7fe19000dae0 comp rx=0 tx=0).stop 2024-05-30T06:52:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1aba00640 1 -- 172.21.15.37:0/601111406 shutdown_connections 2024-05-30T06:52:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1aba00640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1a415e930 0x7fe1a415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1aba00640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a40d1660 0x7fe1a415cb70 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1aba00640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe184069460 0x7fe18406b920 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1aba00640 1 --2- 172.21.15.37:0/601111406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1a40d1240 0x7fe1a41622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1aba00640 1 -- 172.21.15.37:0/601111406 >> 172.21.15.37:0/601111406 conn(0x7fe1a40b4100 msgr2=0x7fe1a40cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1aba00640 1 -- 172.21.15.37:0/601111406 shutdown_connections 2024-05-30T06:52:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:04.768+0000 7fe1aba00640 1 -- 172.21.15.37:0/601111406 wait complete. 2024-05-30T06:52:04.792 INFO:tasks.cephfs.test_volumes:pevs - {'37467ab0-9e28-4c72-9193-e79e68c05454': {'message': '14 ongoing+pending clones; Avg progress is 25.893% (32s)\n [=======.....................] (remaining: 93s)', 'progress': 0.2589299976825714, 'add_to_ceph_s': True}, 'c2a8ed33-2876-45d4-ae98-defcf6508d81': {'message': '4 ongoing clones; Avg progress is 22.656% (37s)\n [======......................] (remaining: 2m)', 'progress': 0.22655999660491943, 'add_to_ceph_s': True}} 2024-05-30T06:52:04.792 INFO:tasks.cephfs.test_volumes:on_p = 0.26302000880241394 new_on_p = 0.22655999660491943 2024-05-30T06:52:04.792 INFO:tasks.cephfs.test_volumes:onpen_p = 0.21041999757289886 new_onpen_p = 0.2589299976825714 2024-05-30T06:52:04.792 INFO:tasks.cephfs.test_volumes:onpen_count = 5 new_onpen_count = 14 2024-05-30T06:52:05.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:52:05.010 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:52:05.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:52:05.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.932+0000 7fbaa3000640 1 Processor -- start 2024-05-30T06:52:05.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.936+0000 7fbaa3000640 1 -- start start 2024-05-30T06:52:05.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.936+0000 7fbaa3000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba9c09b170 0x7fba9c06cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:05.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.936+0000 7fbaa3000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba9c15f970 con 0x7fba9c0b39f0 2024-05-30T06:52:05.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.936+0000 7fbaa3000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba9c15fc50 con 0x7fba9c0d10f0 2024-05-30T06:52:05.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.936+0000 7fbaa3000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fba9c0d0c60 con 0x7fba9c09b170 2024-05-30T06:52:05.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.936+0000 7fba93400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba9c09b170 0x7fba9c06cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:05.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.936+0000 7fba93400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba9c09b170 0x7fba9c06cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59830/0 (socket says 172.21.15.37:59830) 2024-05-30T06:52:05.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.936+0000 7fba93400640 1 -- 172.21.15.37:0/1840087446 learned_addr learned my addr 172.21.15.37:0/1840087446 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:05.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.936+0000 7fba93400640 1 -- 172.21.15.37:0/1840087446 >> v1:172.21.15.105:6789/0 conn(0x7fba9c0d10f0 legacy=0x7fba9c0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:05.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.936+0000 7fba93400640 1 -- 172.21.15.37:0/1840087446 >> v1:172.21.15.37:6789/0 conn(0x7fba9c0b39f0 legacy=0x7fba9c09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:05.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.936+0000 7fba93400640 1 -- 172.21.15.37:0/1840087446 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9c15ff30 con 0x7fba9c09b170 2024-05-30T06:52:05.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.936+0000 7fba9b400640 1 -- 172.21.15.37:0/1840087446 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893729271 0 0) 0x7fba9c15f970 con 0x7fba9c0b39f0 2024-05-30T06:52:05.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.940+0000 7fba93400640 1 --2- 172.21.15.37:0/1840087446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c09b170 0x7fba9c06cea0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fba84009870 tx=0x7fba8401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8236a9939f49b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:05.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.940+0000 7fba9b400640 1 -- 172.21.15.37:0/1840087446 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba840a9620 con 0x7fba9c09b170 2024-05-30T06:52:05.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.940+0000 7fba9b400640 1 -- 172.21.15.37:0/1840087446 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba840a97c0 con 0x7fba9c09b170 2024-05-30T06:52:05.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.940+0000 7fba9b400640 1 -- 172.21.15.37:0/1840087446 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba840a9b90 con 0x7fba9c09b170 2024-05-30T06:52:05.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.940+0000 7fbaa3000640 1 -- 172.21.15.37:0/1840087446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c09b170 msgr2=0x7fba9c06cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:05.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.940+0000 7fbaa3000640 1 --2- 172.21.15.37:0/1840087446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c09b170 0x7fba9c06cea0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fba84009870 tx=0x7fba8401c560 comp rx=0 tx=0).stop 2024-05-30T06:52:05.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.940+0000 7fbaa3000640 1 -- 172.21.15.37:0/1840087446 shutdown_connections 2024-05-30T06:52:05.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.940+0000 7fbaa3000640 1 --2- 172.21.15.37:0/1840087446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c09b170 0x7fba9c06cea0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:05.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.940+0000 7fbaa3000640 1 -- 172.21.15.37:0/1840087446 >> 172.21.15.37:0/1840087446 conn(0x7fba9c0b4100 msgr2=0x7fba9c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:05.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.940+0000 7fbaa3000640 1 -- 172.21.15.37:0/1840087446 shutdown_connections 2024-05-30T06:52:05.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.940+0000 7fbaa3000640 1 -- 172.21.15.37:0/1840087446 wait complete. 2024-05-30T06:52:05.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.940+0000 7fbaa3000640 1 Processor -- start 2024-05-30T06:52:05.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.940+0000 7fbaa3000640 1 -- start start 2024-05-30T06:52:05.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fbaa3000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba9c09b170 0x7fba9c0b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:05.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fbaa3000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c0b39f0 0x7fba9c0b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:05.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fbaa3000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fba9c0d10f0 0x7fba9c0b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:05.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fbaa3000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c0b3dd0 con 0x7fba9c0b39f0 2024-05-30T06:52:05.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fbaa3000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fba9c0d0850 con 0x7fba9c09b170 2024-05-30T06:52:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fbaa3000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fba9c0b3f50 con 0x7fba9c0d10f0 2024-05-30T06:52:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba93400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c0b39f0 0x7fba9c0b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba93400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c0b39f0 0x7fba9c0b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59836/0 (socket says 172.21.15.37:59836) 2024-05-30T06:52:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba93400640 1 -- 172.21.15.37:0/2555950644 learned_addr learned my addr 172.21.15.37:0/2555950644 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba9be00640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba9c09b170 0x7fba9c0b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fbaa1000640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fba9c0d10f0 0x7fba9c0b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba93400640 1 -- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fba9c0d10f0 msgr2=0x7fba9c0b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba93400640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fba9c0d10f0 0x7fba9c0b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba93400640 1 -- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba9c09b170 msgr2=0x7fba9c0b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba93400640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba9c09b170 0x7fba9c0b79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba93400640 1 -- 172.21.15.37:0/2555950644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9c0c9ff0 con 0x7fba9c0b39f0 2024-05-30T06:52:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fbaa1000640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fba9c0d10f0 0x7fba9c0b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:52:05.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba93400640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c0b39f0 0x7fba9c0b5200 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fba8401a190 tx=0x7fba84019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:05.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba98c00640 1 -- 172.21.15.37:0/2555950644 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba840bb3f0 con 0x7fba9c0b39f0 2024-05-30T06:52:05.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba98c00640 1 -- 172.21.15.37:0/2555950644 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba840bb5b0 con 0x7fba9c0b39f0 2024-05-30T06:52:05.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba98c00640 1 -- 172.21.15.37:0/2555950644 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba840bb9a0 con 0x7fba9c0b39f0 2024-05-30T06:52:05.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fbaa3000640 1 -- 172.21.15.37:0/2555950644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9c154f10 con 0x7fba9c0b39f0 2024-05-30T06:52:05.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fbaa3000640 1 -- 172.21.15.37:0/2555950644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba9c1554d0 con 0x7fba9c0b39f0 2024-05-30T06:52:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fbaa3000640 1 -- 172.21.15.37:0/2555950644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba9c068b20 con 0x7fba9c0b39f0 2024-05-30T06:52:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.944+0000 7fba98c00640 1 -- 172.21.15.37:0/2555950644 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) ==== 89517+0+0 (secure 0 0 0) 0x7fba840c43f0 con 0x7fba9c0b39f0 2024-05-30T06:52:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.948+0000 7fba98c00640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fba78069460 0x7fba7806b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.948+0000 7fba98c00640 1 -- 172.21.15.37:0/2555950644 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fba8411fe00 con 0x7fba9c0b39f0 2024-05-30T06:52:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.948+0000 7fba9be00640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fba78069460 0x7fba7806b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:05.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.948+0000 7fba9be00640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fba78069460 0x7fba7806b920 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fba8c007fd0 tx=0x7fba8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:05.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:05.952+0000 7fba98c00640 1 -- 172.21.15.37:0/2555950644 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fba840ad020 con 0x7fba9c0b39f0 2024-05-30T06:52:06.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fbaa3000640 1 -- 172.21.15.37:0/2555950644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fba9c0b8590 con 0x7fba9c0b39f0 2024-05-30T06:52:06.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fba98c00640 1 -- 172.21.15.37:0/2555950644 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2421 (secure 0 0 0) 0x7fba84016150 con 0x7fba9c0b39f0 2024-05-30T06:52:06.177 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:52:06.177 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:52:06.177 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:52:06.178 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:52:06.178 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:52:06.178 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:52:06.178 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:52:06.178 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:06.178 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:52:06.178 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:52:06.178 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:52:06.178 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:52:06.178 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:52:06.179 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:06.179 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:52:06.179 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:52:06.179 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:52:06.179 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:52:06.179 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:06.179 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 620, 2024-05-30T06:52:06.179 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:52:06.179 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:52:06.179 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:52:06.179 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:52:06.179 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:06.180 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:52:06.180 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:52:06.180 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:52:06.180 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:52:06.180 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:52:06.180 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:52:06.180 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:52:06.180 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:52:06.180 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:06.180 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:52:06.180 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:52:06.180 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 6963, 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 28993936975, 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 58548903936, 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 714545209344, 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 847977616, 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 860244624, 2024-05-30T06:52:06.181 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 204, 2024-05-30T06:52:06.182 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 225 2024-05-30T06:52:06.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:06.182 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:52:06.182 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:52:06.182 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:52:06.182 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:52:06.182 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:52:06.182 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:52:06.182 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:52:06.182 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:06.182 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:52:06.182 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:52:06.182 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:52:06.183 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:06.184 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:06.184 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:06.184 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:52:06.184 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 12, 2024-05-30T06:52:06.184 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:51:42.820933+0000", 2024-05-30T06:52:06.184 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:06.184 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:06.184 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:52:06.184 INFO:teuthology.orchestra.run.smithi037.stdout: "37467ab0-9e28-4c72-9193-e79e68c05454": { 2024-05-30T06:52:06.184 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "14 ongoing+pending clones; Avg progress is 25.893% (32s)\n [=======.....................] (remaining: 93s)", 2024-05-30T06:52:06.184 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.25892999768257141, 2024-05-30T06:52:06.185 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:06.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:06.185 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:52:06.185 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "4 ongoing clones; Avg progress is 22.656% (37s)\n [======......................] (remaining: 2m)", 2024-05-30T06:52:06.185 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.22655999660491943, 2024-05-30T06:52:06.185 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:06.185 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:06.185 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:06.185 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:52:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fbaa3000640 1 -- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fba78069460 msgr2=0x7fba7806b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fbaa3000640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fba78069460 0x7fba7806b920 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fba8c007fd0 tx=0x7fba8c009040 comp rx=0 tx=0).stop 2024-05-30T06:52:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fbaa3000640 1 -- 172.21.15.37:0/2555950644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c0b39f0 msgr2=0x7fba9c0b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fbaa3000640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c0b39f0 0x7fba9c0b5200 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fba8401a190 tx=0x7fba84019300 comp rx=0 tx=0).stop 2024-05-30T06:52:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fbaa3000640 1 -- 172.21.15.37:0/2555950644 shutdown_connections 2024-05-30T06:52:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fbaa3000640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fba9c0d10f0 0x7fba9c0b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fbaa3000640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba9c0b39f0 0x7fba9c0b5200 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fbaa3000640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fba78069460 0x7fba7806b920 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fbaa3000640 1 --2- 172.21.15.37:0/2555950644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fba9c09b170 0x7fba9c0b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:06.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fbaa3000640 1 -- 172.21.15.37:0/2555950644 >> 172.21.15.37:0/2555950644 conn(0x7fba9c0b4100 msgr2=0x7fba9c0d1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:06.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fbaa3000640 1 -- 172.21.15.37:0/2555950644 shutdown_connections 2024-05-30T06:52:06.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:06.176+0000 7fbaa3000640 1 -- 172.21.15.37:0/2555950644 wait complete. 2024-05-30T06:52:06.199 INFO:tasks.cephfs.test_volumes:pevs - {'37467ab0-9e28-4c72-9193-e79e68c05454': {'message': '14 ongoing+pending clones; Avg progress is 25.893% (32s)\n [=======.....................] (remaining: 93s)', 'progress': 0.2589299976825714, 'add_to_ceph_s': True}, 'c2a8ed33-2876-45d4-ae98-defcf6508d81': {'message': '4 ongoing clones; Avg progress is 22.656% (37s)\n [======......................] (remaining: 2m)', 'progress': 0.22655999660491943, 'add_to_ceph_s': True}} 2024-05-30T06:52:06.199 INFO:tasks.cephfs.test_volumes:on_p = 0.26302000880241394 new_on_p = 0.22655999660491943 2024-05-30T06:52:06.199 INFO:tasks.cephfs.test_volumes:onpen_p = 0.21041999757289886 new_onpen_p = 0.2589299976825714 2024-05-30T06:52:06.199 INFO:tasks.cephfs.test_volumes:onpen_count = 5 new_onpen_count = 14 2024-05-30T06:52:07.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:52:07.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.452+0000 7f1351e00640 1 Processor -- start 2024-05-30T06:52:07.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.452+0000 7f1351e00640 1 -- start start 2024-05-30T06:52:07.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.452+0000 7f1351e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f134c06e000 0x7f134c0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:07.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.452+0000 7f1351e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f134c0cd120 con 0x7f134c0cee10 2024-05-30T06:52:07.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.452+0000 7f1351e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f134c0cd400 con 0x7f134c15cd80 2024-05-30T06:52:07.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.452+0000 7f1351e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f134c0a9530 con 0x7f134c06e000 2024-05-30T06:52:07.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.456+0000 7f134b400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f134c0cee10 0x7f134c06f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36576/0 (socket says 172.21.15.37:36576) 2024-05-30T06:52:07.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.456+0000 7f134b400640 1 -- 172.21.15.37:0/922790146 learned_addr learned my addr 172.21.15.37:0/922790146 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.456+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1325860359 0 0) 0x7f134c0cd120 con 0x7f134c0cee10 2024-05-30T06:52:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.456+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1330003530 con 0x7f134c0cee10 2024-05-30T06:52:07.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 20500251 0 0) 0x7f1330003530 con 0x7f134c0cee10 2024-05-30T06:52:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 >> v2:172.21.15.105:3300/0 conn(0x7f134c06e000 msgr2=0x7f134c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134a000640 1 --2- 172.21.15.37:0/922790146 >> v2:172.21.15.105:3300/0 conn(0x7f134c06e000 0x7f134c0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 >> v1:172.21.15.105:6789/0 conn(0x7f134c15cd80 legacy=0x7f134c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134c0cd6e0 con 0x7f134c0cee10 2024-05-30T06:52:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f1344001680 con 0x7f134c0cee10 2024-05-30T06:52:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 >> v1:172.21.15.37:6789/0 conn(0x7f134c0cee10 legacy=0x7f134c06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134a000640 1 --2- 172.21.15.37:0/922790146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13300039c0 0x7f1330003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134a000640 1 --2- 172.21.15.37:0/922790146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1330004810 0x7f1330004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134a000640 1 --2- 172.21.15.37:0/922790146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13300052f0 0x7f133000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f133000c1b0 con 0x7f13300039c0 2024-05-30T06:52:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f133000c360 con 0x7f13300052f0 2024-05-30T06:52:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f133000c560 con 0x7f1330004810 2024-05-30T06:52:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134aa00640 1 --2- 172.21.15.37:0/922790146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13300039c0 0x7f1330003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.460+0000 7f134b400640 1 --2- 172.21.15.37:0/922790146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13300052f0 0x7f133000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.464+0000 7f134aa00640 1 -- 172.21.15.37:0/922790146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1330004810 msgr2=0x7f1330004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.464+0000 7f134aa00640 1 --2- 172.21.15.37:0/922790146 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1330004810 0x7f1330004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.464+0000 7f134aa00640 1 -- 172.21.15.37:0/922790146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13300052f0 msgr2=0x7f133000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:07.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.464+0000 7f134aa00640 1 --2- 172.21.15.37:0/922790146 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f13300052f0 0x7f133000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:07.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.464+0000 7f134aa00640 1 -- 172.21.15.37:0/922790146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134c0cd6e0 con 0x7f13300039c0 2024-05-30T06:52:07.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.468+0000 7f134b400640 1 -- 172.21.15.37:0/922790146 reap_dead start 2024-05-30T06:52:07.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.468+0000 7f134aa00640 1 --2- 172.21.15.37:0/922790146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13300039c0 0x7f1330003dc0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f133c009c70 tx=0x7f133c01cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c187763fc2ae03db server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:07.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.468+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c0b2070 con 0x7f13300039c0 2024-05-30T06:52:07.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.472+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f133c0a5b30 con 0x7f13300039c0 2024-05-30T06:52:07.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.472+0000 7f134a000640 1 -- 172.21.15.37:0/922790146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c006e60 con 0x7f13300039c0 2024-05-30T06:52:07.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.472+0000 7f1351e00640 1 -- 172.21.15.37:0/922790146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13300039c0 msgr2=0x7f1330003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.472+0000 7f1351e00640 1 --2- 172.21.15.37:0/922790146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13300039c0 0x7f1330003dc0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f133c009c70 tx=0x7f133c01cc70 comp rx=0 tx=0).stop 2024-05-30T06:52:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.472+0000 7f1351e00640 1 -- 172.21.15.37:0/922790146 shutdown_connections 2024-05-30T06:52:07.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.472+0000 7f1351e00640 1 --2- 172.21.15.37:0/922790146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13300039c0 0x7f1330003dc0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:07.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.472+0000 7f1351e00640 1 -- 172.21.15.37:0/922790146 >> 172.21.15.37:0/922790146 conn(0x7f134c0b23a0 msgr2=0x7f134c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:07.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.480+0000 7f1351e00640 1 -- 172.21.15.37:0/922790146 shutdown_connections 2024-05-30T06:52:07.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.480+0000 7f1351e00640 1 -- 172.21.15.37:0/922790146 wait complete. 2024-05-30T06:52:07.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.480+0000 7f1351e00640 1 Processor -- start 2024-05-30T06:52:07.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f1351e00640 1 -- start start 2024-05-30T06:52:07.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f1351e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f134c141020 0x7f134c15ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:07.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f1351e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f134c072710 0x7f134c072b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:07.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f1351e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f134c1f8970 0x7f134c1f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:07.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f1351e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f134c0ce1c0 con 0x7f134c1f8970 2024-05-30T06:52:07.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f1351e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f134c0cdca0 con 0x7f134c141020 2024-05-30T06:52:07.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f1351e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f134c0ce340 con 0x7f134c072710 2024-05-30T06:52:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f134b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f134c1f8970 0x7f134c1f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f134b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f134c1f8970 0x7f134c1f8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51098/0 (socket says 172.21.15.37:51098) 2024-05-30T06:52:07.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f134b400640 1 -- 172.21.15.37:0/1640382370 learned_addr learned my addr 172.21.15.37:0/1640382370 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:07.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f1342000640 1 --2- 172.21.15.37:0/1640382370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f134c072710 0x7f134c072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:07.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f134b400640 1 -- 172.21.15.37:0/1640382370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f134c072710 msgr2=0x7f134c072b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:07.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f134b400640 1 --2- 172.21.15.37:0/1640382370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f134c072710 0x7f134c072b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:07.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f134b400640 1 -- 172.21.15.37:0/1640382370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f134c141020 msgr2=0x7f134c15ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:07.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f134b400640 1 --2- 172.21.15.37:0/1640382370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f134c141020 0x7f134c15ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:07.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f134b400640 1 -- 172.21.15.37:0/1640382370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134c1f9830 con 0x7f134c1f8970 2024-05-30T06:52:07.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f134b400640 1 --2- 172.21.15.37:0/1640382370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f134c1f8970 0x7f134c1f8df0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f1344005e20 tx=0x7f1344007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:07.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.484+0000 7f1343e00640 1 -- 172.21.15.37:0/1640382370 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1344011040 con 0x7f134c1f8970 2024-05-30T06:52:07.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.488+0000 7f1351e00640 1 -- 172.21.15.37:0/1640382370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f134c1f9550 con 0x7f134c1f8970 2024-05-30T06:52:07.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.488+0000 7f1351e00640 1 -- 172.21.15.37:0/1640382370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f134c15e530 con 0x7f134c1f8970 2024-05-30T06:52:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.488+0000 7f1343e00640 1 -- 172.21.15.37:0/1640382370 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1344007610 con 0x7f134c1f8970 2024-05-30T06:52:07.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.488+0000 7f1343e00640 1 -- 172.21.15.37:0/1640382370 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1344010990 con 0x7f134c1f8970 2024-05-30T06:52:07.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.488+0000 7f1351e00640 1 -- 172.21.15.37:0/1640382370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f134c068b20 con 0x7f134c1f8970 2024-05-30T06:52:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.492+0000 7f1343e00640 1 -- 172.21.15.37:0/1640382370 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) ==== 89517+0+0 (secure 0 0 0) 0x7f134401c020 con 0x7f134c1f8970 2024-05-30T06:52:07.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.496+0000 7f1343e00640 1 --2- 172.21.15.37:0/1640382370 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1328069460 0x7f132806b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:07.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.496+0000 7f1343e00640 1 -- 172.21.15.37:0/1640382370 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f1344087750 con 0x7f134c1f8970 2024-05-30T06:52:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.504+0000 7f1343e00640 1 -- 172.21.15.37:0/1640382370 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1344023020 con 0x7f134c1f8970 2024-05-30T06:52:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.520+0000 7f134aa00640 1 --2- 172.21.15.37:0/1640382370 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1328069460 0x7f132806b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.528+0000 7f134aa00640 1 --2- 172.21.15.37:0/1640382370 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1328069460 0x7f132806b920 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f133c0af000 tx=0x7f133c004b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:07.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.900+0000 7f1351e00640 1 -- 172.21.15.37:0/1640382370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f134c0721f0 con 0x7f134c1f8970 2024-05-30T06:52:07.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.904+0000 7f1343e00640 1 -- 172.21.15.37:0/1640382370 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2384 (secure 0 0 0) 0x7f13440597c0 con 0x7f134c1f8970 2024-05-30T06:52:07.909 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:52:07.909 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:52:07.909 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:52:07.909 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:52:07.909 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:52:07.909 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:52:07.910 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:52:07.910 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:07.910 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:52:07.910 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:52:07.910 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:52:07.910 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:52:07.910 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:52:07.910 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:07.910 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:52:07.910 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:52:07.911 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:52:07.911 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:52:07.911 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:07.911 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 622, 2024-05-30T06:52:07.911 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:52:07.911 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:52:07.911 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:52:07.911 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:52:07.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:07.911 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:52:07.911 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:52:07.912 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:52:07.912 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:52:07.912 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:52:07.912 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:52:07.912 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:52:07.912 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:52:07.912 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:07.912 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:52:07.912 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:52:07.912 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:07.912 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:52:07.912 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:52:07.912 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:07.913 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:07.913 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:52:07.913 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:52:07.913 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 6963, 2024-05-30T06:52:07.913 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 28993936975, 2024-05-30T06:52:07.913 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 58548903936, 2024-05-30T06:52:07.913 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 714545209344, 2024-05-30T06:52:07.913 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:52:07.913 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 544958593, 2024-05-30T06:52:07.913 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 561385147, 2024-05-30T06:52:07.913 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 131, 2024-05-30T06:52:07.913 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 146 2024-05-30T06:52:07.914 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:07.914 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:52:07.914 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:52:07.914 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:52:07.914 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:52:07.914 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:52:07.914 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:52:07.914 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:52:07.914 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:07.914 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:52:07.914 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:52:07.915 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:52:07.915 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:52:07.915 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:52:07.915 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:07.915 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:07.915 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:52:07.915 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:07.915 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:52:07.915 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:52:07.915 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:52:07.915 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:52:07.915 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:52:07.915 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:52:07.916 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:52:07.916 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:07.916 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:07.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:07.916 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:52:07.916 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 12, 2024-05-30T06:52:07.916 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:51:42.820933+0000", 2024-05-30T06:52:07.916 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:07.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:07.916 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:52:07.916 INFO:teuthology.orchestra.run.smithi037.stdout: "37467ab0-9e28-4c72-9193-e79e68c05454": { 2024-05-30T06:52:07.916 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "13 ongoing+pending clones; Avg progress is 7.692% (36s)\n [==..........................] (remaining: 7m)", 2024-05-30T06:52:07.917 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.076920002698898315, 2024-05-30T06:52:07.917 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:07.917 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:07.917 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:52:07.917 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "4 ongoing clones; Avg progress is 0.0% (41s)\n [............................] ", 2024-05-30T06:52:07.917 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0, 2024-05-30T06:52:07.917 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:07.917 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:07.917 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:07.917 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:52:07.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.908+0000 7f1340c00640 1 -- 172.21.15.37:0/1640382370 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1328069460 msgr2=0x7f132806b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.908+0000 7f1340c00640 1 --2- 172.21.15.37:0/1640382370 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1328069460 0x7f132806b920 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f133c0af000 tx=0x7f133c004b60 comp rx=0 tx=0).stop 2024-05-30T06:52:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.908+0000 7f1340c00640 1 -- 172.21.15.37:0/1640382370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f134c1f8970 msgr2=0x7f134c1f8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.908+0000 7f1340c00640 1 --2- 172.21.15.37:0/1640382370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f134c1f8970 0x7f134c1f8df0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f1344005e20 tx=0x7f1344007420 comp rx=0 tx=0).stop 2024-05-30T06:52:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.912+0000 7f1340c00640 1 -- 172.21.15.37:0/1640382370 shutdown_connections 2024-05-30T06:52:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.912+0000 7f1340c00640 1 --2- 172.21.15.37:0/1640382370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f134c1f8970 0x7f134c1f8df0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.912+0000 7f1340c00640 1 --2- 172.21.15.37:0/1640382370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f134c072710 0x7f134c072b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.912+0000 7f1340c00640 1 --2- 172.21.15.37:0/1640382370 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1328069460 0x7f132806b920 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.912+0000 7f1340c00640 1 --2- 172.21.15.37:0/1640382370 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f134c141020 0x7f134c15ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.912+0000 7f1340c00640 1 -- 172.21.15.37:0/1640382370 >> 172.21.15.37:0/1640382370 conn(0x7f134c0b23a0 msgr2=0x7f134c1432b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.912+0000 7f1340c00640 1 -- 172.21.15.37:0/1640382370 shutdown_connections 2024-05-30T06:52:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:07.912+0000 7f1340c00640 1 -- 172.21.15.37:0/1640382370 wait complete. 2024-05-30T06:52:07.967 INFO:tasks.cephfs.test_volumes:pevs - {'37467ab0-9e28-4c72-9193-e79e68c05454': {'message': '13 ongoing+pending clones; Avg progress is 7.692% (36s)\n [==..........................] (remaining: 7m)', 'progress': 0.07692000269889832, 'add_to_ceph_s': True}, 'c2a8ed33-2876-45d4-ae98-defcf6508d81': {'message': '4 ongoing clones; Avg progress is 0.0% (41s)\n [............................] ', 'progress': 0, 'add_to_ceph_s': True}} 2024-05-30T06:52:07.967 INFO:tasks.cephfs.test_volumes:new_onpen_p is less than onpen_p. 2024-05-30T06:52:07.967 INFO:tasks.cephfs.test_volumes:new_onpen_p = 0.07692000269889832; onpen_p = 0.21041999757289886 2024-05-30T06:52:07.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone37101 2024-05-30T06:52:08.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.212+0000 7fd252e00640 1 Processor -- start 2024-05-30T06:52:08.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.212+0000 7fd252e00640 1 -- start start 2024-05-30T06:52:08.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.212+0000 7fd252e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd24c09b170 0x7fd24c0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:08.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.212+0000 7fd24be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd24c15c870 0x7fd24c0cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36586/0 (socket says 172.21.15.37:36586) 2024-05-30T06:52:08.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.212+0000 7fd24be00640 1 -- 172.21.15.37:0/3778517160 learned_addr learned my addr 172.21.15.37:0/3778517160 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:08.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.212+0000 7fd252e00640 1 -- 172.21.15.37:0/3778517160 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd24c09bb80 con 0x7fd24c15c870 2024-05-30T06:52:08.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.212+0000 7fd252e00640 1 -- 172.21.15.37:0/3778517160 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd24c0cd340 con 0x7fd24c0d03c0 2024-05-30T06:52:08.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.212+0000 7fd250e00640 1 --2- 172.21.15.37:0/3778517160 >> v2:172.21.15.37:3300/0 conn(0x7fd24c09b170 0x7fd24c0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:08.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.212+0000 7fd252e00640 1 -- 172.21.15.37:0/3778517160 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd24c0cd110 con 0x7fd24c09b170 2024-05-30T06:52:08.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.212+0000 7fd250e00640 1 -- 172.21.15.37:0/3778517160 >> v1:172.21.15.105:6789/0 conn(0x7fd24c0d03c0 legacy=0x7fd24c09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:08.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.212+0000 7fd250e00640 1 -- 172.21.15.37:0/3778517160 >> v1:172.21.15.37:6789/0 conn(0x7fd24c15c870 legacy=0x7fd24c0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:08.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.212+0000 7fd250e00640 1 -- 172.21.15.37:0/3778517160 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24c0cd620 con 0x7fd24c09b170 2024-05-30T06:52:08.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.216+0000 7fd250e00640 1 --2- 172.21.15.37:0/3778517160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c09b170 0x7fd24c0af1e0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd244009d90 tx=0x7fd24401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c999a546e6007ace server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:08.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.216+0000 7fd24aa00640 1 -- 172.21.15.37:0/3778517160 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2440b2070 con 0x7fd24c09b170 2024-05-30T06:52:08.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.216+0000 7fd24aa00640 1 -- 172.21.15.37:0/3778517160 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2440a57f0 con 0x7fd24c09b170 2024-05-30T06:52:08.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.216+0000 7fd24aa00640 1 -- 172.21.15.37:0/3778517160 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2440a5bc0 con 0x7fd24c09b170 2024-05-30T06:52:08.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.220+0000 7fd252e00640 1 -- 172.21.15.37:0/3778517160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c09b170 msgr2=0x7fd24c0af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:08.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.220+0000 7fd252e00640 1 --2- 172.21.15.37:0/3778517160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c09b170 0x7fd24c0af1e0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd244009d90 tx=0x7fd24401c930 comp rx=0 tx=0).stop 2024-05-30T06:52:08.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.220+0000 7fd252e00640 1 -- 172.21.15.37:0/3778517160 shutdown_connections 2024-05-30T06:52:08.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.220+0000 7fd252e00640 1 --2- 172.21.15.37:0/3778517160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c09b170 0x7fd24c0af1e0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:08.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.220+0000 7fd252e00640 1 -- 172.21.15.37:0/3778517160 >> 172.21.15.37:0/3778517160 conn(0x7fd24c0b4060 msgr2=0x7fd24c0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:08.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.220+0000 7fd252e00640 1 -- 172.21.15.37:0/3778517160 shutdown_connections 2024-05-30T06:52:08.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.220+0000 7fd252e00640 1 -- 172.21.15.37:0/3778517160 wait complete. 2024-05-30T06:52:08.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.220+0000 7fd252e00640 1 Processor -- start 2024-05-30T06:52:08.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.220+0000 7fd252e00640 1 -- start start 2024-05-30T06:52:08.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd252e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd24c09b170 0x7fd24c158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:08.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd252e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c0d03c0 0x7fd24c0cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:08.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd252e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd24c15c870 0x7fd24c15b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:08.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd252e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c0cd990 con 0x7fd24c0d03c0 2024-05-30T06:52:08.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd252e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c09be60 con 0x7fd24c09b170 2024-05-30T06:52:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd252e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd24c0ce530 con 0x7fd24c15c870 2024-05-30T06:52:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd24b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c0d03c0 0x7fd24c0cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd24b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c0d03c0 0x7fd24c0cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51118/0 (socket says 172.21.15.37:51118) 2024-05-30T06:52:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd24b400640 1 -- 172.21.15.37:0/1695660338 learned_addr learned my addr 172.21.15.37:0/1695660338 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd250e00640 1 --2- 172.21.15.37:0/1695660338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd24c15c870 0x7fd24c15b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd24be00640 1 --2- 172.21.15.37:0/1695660338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd24c09b170 0x7fd24c158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:08.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd24b400640 1 -- 172.21.15.37:0/1695660338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd24c15c870 msgr2=0x7fd24c15b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd24b400640 1 --2- 172.21.15.37:0/1695660338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd24c15c870 0x7fd24c15b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd24b400640 1 -- 172.21.15.37:0/1695660338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd24c09b170 msgr2=0x7fd24c158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd24b400640 1 --2- 172.21.15.37:0/1695660338 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd24c09b170 0x7fd24c158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd24b400640 1 -- 172.21.15.37:0/1695660338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24c159230 con 0x7fd24c0d03c0 2024-05-30T06:52:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd24b400640 1 --2- 172.21.15.37:0/1695660338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd24c0d03c0 0x7fd24c0cb420 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd23800c410 tx=0x7fd23800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd243e00640 1 -- 172.21.15.37:0/1695660338 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238011790 con 0x7fd24c0d03c0 2024-05-30T06:52:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd243e00640 1 -- 172.21.15.37:0/1695660338 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd238017070 con 0x7fd24c0d03c0 2024-05-30T06:52:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd243e00640 1 -- 172.21.15.37:0/1695660338 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238011bb0 con 0x7fd24c0d03c0 2024-05-30T06:52:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd252e00640 1 -- 172.21.15.37:0/1695660338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24c0cc440 con 0x7fd24c0d03c0 2024-05-30T06:52:08.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd252e00640 1 -- 172.21.15.37:0/1695660338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd24c0b51e0 con 0x7fd24c0d03c0 2024-05-30T06:52:08.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.224+0000 7fd252e00640 1 -- 172.21.15.37:0/1695660338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd24c068bc0 con 0x7fd24c0d03c0 2024-05-30T06:52:08.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.228+0000 7fd243e00640 1 -- 172.21.15.37:0/1695660338 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) ==== 89517+0+0 (secure 0 0 0) 0x7fd23801c460 con 0x7fd24c0d03c0 2024-05-30T06:52:08.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.228+0000 7fd243e00640 1 --2- 172.21.15.37:0/1695660338 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd22c069460 0x7fd22c06b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:08.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.228+0000 7fd243e00640 1 -- 172.21.15.37:0/1695660338 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fd238085180 con 0x7fd24c0d03c0 2024-05-30T06:52:08.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.240+0000 7fd243e00640 1 -- 172.21.15.37:0/1695660338 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd238021020 con 0x7fd24c0d03c0 2024-05-30T06:52:08.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.244+0000 7fd24be00640 1 --2- 172.21.15.37:0/1695660338 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd22c069460 0x7fd22c06b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.328+0000 7fd24be00640 1 --2- 172.21.15.37:0/1695660338 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd22c069460 0x7fd22c06b920 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd23c005890 tx=0x7fd23c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:08.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:08.676+0000 7fd252e00640 1 -- 172.21.15.37:0/1695660338 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone37101", "target": ["mon-mgr", ""]}) -- 0x7fd24c0cedd0 con 0x7fd22c069460 2024-05-30T06:52:08.908 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:08.902+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:52:08.908 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:08.902+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:52:08.908 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:08.902+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:52:08.908 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:08.902+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:52:08.908 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:08.902+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:52:09.869 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:09.866+0000 7f004c600640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:09.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:09.880+0000 7fd243e00640 1 -- 172.21.15.37:0/1695660338 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7fd24c0cedd0 con 0x7fd22c069460 2024-05-30T06:52:09.883 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:09.892 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T06:52:09.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone37102 2024-05-30T06:52:10.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.084+0000 7fb026200640 1 Processor -- start 2024-05-30T06:52:10.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.084+0000 7fb026200640 1 -- start start 2024-05-30T06:52:10.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.084+0000 7fb026200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0200d0600 0x7fb0200cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:10.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.084+0000 7fb026200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0200af0d0 con 0x7fb02015c9a0 2024-05-30T06:52:10.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.084+0000 7fb026200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0200ce000 con 0x7fb0200cffd0 2024-05-30T06:52:10.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.084+0000 7fb026200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb0200ce2e0 con 0x7fb0200d0600 2024-05-30T06:52:10.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.084+0000 7fb024e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0200d0600 0x7fb0200cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:10.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.084+0000 7fb024e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0200d0600 0x7fb0200cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51124/0 (socket says 172.21.15.37:51124) 2024-05-30T06:52:10.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.084+0000 7fb024e00640 1 -- 172.21.15.37:0/398682858 learned_addr learned my addr 172.21.15.37:0/398682858 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:10.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.084+0000 7fb01fe00640 1 --1- 172.21.15.37:0/398682858 >> v1:172.21.15.37:6789/0 conn(0x7fb02015c9a0 0x7fb0200d09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36600/0 (socket says 172.21.15.37:36600) 2024-05-30T06:52:10.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.084+0000 7fb024e00640 1 -- 172.21.15.37:0/398682858 >> v1:172.21.15.105:6789/0 conn(0x7fb0200cffd0 legacy=0x7fb0200afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:10.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.084+0000 7fb024e00640 1 -- 172.21.15.37:0/398682858 >> v1:172.21.15.37:6789/0 conn(0x7fb02015c9a0 legacy=0x7fb0200d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:10.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.084+0000 7fb024e00640 1 -- 172.21.15.37:0/398682858 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0200af370 con 0x7fb0200d0600 2024-05-30T06:52:10.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.092+0000 7fb024e00640 1 --2- 172.21.15.37:0/398682858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0200d0600 0x7fb0200cd9d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fb014009870 tx=0x7fb01401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b08db75f8dd818d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:10.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.092+0000 7fb01f400640 1 -- 172.21.15.37:0/398682858 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0140ab620 con 0x7fb0200d0600 2024-05-30T06:52:10.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.092+0000 7fb01f400640 1 -- 172.21.15.37:0/398682858 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0140b0070 con 0x7fb0200d0600 2024-05-30T06:52:10.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.092+0000 7fb01f400640 1 -- 172.21.15.37:0/398682858 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0140ab9e0 con 0x7fb0200d0600 2024-05-30T06:52:10.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.092+0000 7fb026200640 1 -- 172.21.15.37:0/398682858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0200d0600 msgr2=0x7fb0200cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:10.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.092+0000 7fb026200640 1 --2- 172.21.15.37:0/398682858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0200d0600 0x7fb0200cd9d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fb014009870 tx=0x7fb01401c4f0 comp rx=0 tx=0).stop 2024-05-30T06:52:10.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.092+0000 7fb026200640 1 -- 172.21.15.37:0/398682858 shutdown_connections 2024-05-30T06:52:10.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.092+0000 7fb026200640 1 --2- 172.21.15.37:0/398682858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0200d0600 0x7fb0200cd9d0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:10.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.092+0000 7fb026200640 1 -- 172.21.15.37:0/398682858 >> 172.21.15.37:0/398682858 conn(0x7fb0200b3ef0 msgr2=0x7fb0200b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:10.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.092+0000 7fb026200640 1 -- 172.21.15.37:0/398682858 shutdown_connections 2024-05-30T06:52:10.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.092+0000 7fb026200640 1 -- 172.21.15.37:0/398682858 wait complete. 2024-05-30T06:52:10.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb026200640 1 Processor -- start 2024-05-30T06:52:10.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb026200640 1 -- start start 2024-05-30T06:52:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb026200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0200cffd0 0x7fb02015d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb026200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb02015c9a0 0x7fb0201f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb026200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb020152280 0x7fb0200b6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb026200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb0200b0e20 con 0x7fb020152280 2024-05-30T06:52:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb026200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb0200b0ca0 con 0x7fb0200cffd0 2024-05-30T06:52:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb026200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb02016a340 con 0x7fb02015c9a0 2024-05-30T06:52:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb025800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb020152280 0x7fb0200b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb025800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb020152280 0x7fb0200b6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51138/0 (socket says 172.21.15.37:51138) 2024-05-30T06:52:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb025800640 1 -- 172.21.15.37:0/1705643552 learned_addr learned my addr 172.21.15.37:0/1705643552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb025800640 1 -- 172.21.15.37:0/1705643552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb02015c9a0 msgr2=0x7fb0201f5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb025800640 1 --2- 172.21.15.37:0/1705643552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb02015c9a0 0x7fb0201f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb025800640 1 -- 172.21.15.37:0/1705643552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0200cffd0 msgr2=0x7fb02015d720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T06:52:10.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb025800640 1 --2- 172.21.15.37:0/1705643552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0200cffd0 0x7fb02015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb025800640 1 -- 172.21.15.37:0/1705643552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb020152a00 con 0x7fb020152280 2024-05-30T06:52:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.096+0000 7fb025800640 1 --2- 172.21.15.37:0/1705643552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb020152280 0x7fb0200b6400 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fb01800ba10 tx=0x7fb01800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.100+0000 7fb01cc00640 1 -- 172.21.15.37:0/1705643552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb018019070 con 0x7fb020152280 2024-05-30T06:52:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.100+0000 7fb01cc00640 1 -- 172.21.15.37:0/1705643552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb01800cba0 con 0x7fb020152280 2024-05-30T06:52:10.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.100+0000 7fb01cc00640 1 -- 172.21.15.37:0/1705643552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb018014440 con 0x7fb020152280 2024-05-30T06:52:10.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.100+0000 7fb026200640 1 -- 172.21.15.37:0/1705643552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb020152ce0 con 0x7fb020152280 2024-05-30T06:52:10.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.100+0000 7fb026200640 1 -- 172.21.15.37:0/1705643552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0201532a0 con 0x7fb020152280 2024-05-30T06:52:10.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.100+0000 7fb026200640 1 -- 172.21.15.37:0/1705643552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb020068ab0 con 0x7fb020152280 2024-05-30T06:52:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.104+0000 7fb01cc00640 1 -- 172.21.15.37:0/1705643552 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) ==== 89517+0+0 (secure 0 0 0) 0x7fb01801c070 con 0x7fb020152280 2024-05-30T06:52:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.104+0000 7fb01cc00640 1 --2- 172.21.15.37:0/1705643552 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb000069460 0x7fb00006b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.104+0000 7fb01cc00640 1 -- 172.21.15.37:0/1705643552 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fb018085590 con 0x7fb020152280 2024-05-30T06:52:10.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.108+0000 7fb01cc00640 1 -- 172.21.15.37:0/1705643552 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb0180572c0 con 0x7fb020152280 2024-05-30T06:52:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.124+0000 7fb024e00640 1 --2- 172.21.15.37:0/1705643552 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb000069460 0x7fb00006b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.128+0000 7fb024e00640 1 --2- 172.21.15.37:0/1705643552 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb000069460 0x7fb00006b920 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb0140af000 tx=0x7fb014004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:10.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.476+0000 7fb026200640 1 -- 172.21.15.37:0/1705643552 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone37102", "target": ["mon-mgr", ""]}) -- 0x7fb020153470 con 0x7fb000069460 2024-05-30T06:52:10.737 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:10.734+0000 7f004c600640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:10.752+0000 7fb01cc00640 1 -- 172.21.15.37:0/1705643552 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7fb020153470 con 0x7fb000069460 2024-05-30T06:52:10.756 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:10.784 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T06:52:10.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone37103 2024-05-30T06:52:11.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.016+0000 7fafcec00640 1 Processor -- start 2024-05-30T06:52:11.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.016+0000 7fafcec00640 1 -- start start 2024-05-30T06:52:11.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.016+0000 7fafcec00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafc809b170 0x7fafc80af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:11.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.016+0000 7fafcec00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafc809bb80 con 0x7fafc80d03c0 2024-05-30T06:52:11.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.016+0000 7fafcec00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafc80cd340 con 0x7fafc815c870 2024-05-30T06:52:11.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.016+0000 7fafcec00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fafc80cd110 con 0x7fafc809b170 2024-05-30T06:52:11.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc7400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fafc80d03c0 0x7fafc809aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36610/0 (socket says 172.21.15.37:36610) 2024-05-30T06:52:11.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc7400640 1 -- 172.21.15.37:0/3653385187 learned_addr learned my addr 172.21.15.37:0/3653385187 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:11.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafccc00640 1 --2- 172.21.15.37:0/3653385187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafc809b170 0x7fafc80af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:11.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4028652871 0 0) 0x7fafc809bb80 con 0x7fafc80d03c0 2024-05-30T06:52:11.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafac003530 con 0x7fafc80d03c0 2024-05-30T06:52:11.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2311575754 0 0) 0x7fafac003530 con 0x7fafc80d03c0 2024-05-30T06:52:11.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafc809b170 msgr2=0x7fafc80af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 --2- 172.21.15.37:0/3653385187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafc809b170 0x7fafc80af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 >> v1:172.21.15.105:6789/0 conn(0x7fafc815c870 legacy=0x7fafc80cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc80cd620 con 0x7fafc80d03c0 2024-05-30T06:52:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fafb4001680 con 0x7fafc80d03c0 2024-05-30T06:52:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafccc00640 1 --2- 172.21.15.37:0/3653385187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafc809b170 0x7fafc80af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:52:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 >> v1:172.21.15.37:6789/0 conn(0x7fafc80d03c0 legacy=0x7fafc809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 --2- 172.21.15.37:0/3653385187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafc809b170 0x7fafac0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 --2- 172.21.15.37:0/3653385187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafac003f30 0x7fafac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 --2- 172.21.15.37:0/3653385187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafac004d50 0x7fafac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fafac00ba80 con 0x7fafac003f30 2024-05-30T06:52:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fafac00bc00 con 0x7fafac004d50 2024-05-30T06:52:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fafac00be00 con 0x7fafc809b170 2024-05-30T06:52:11.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc7400640 1 --2- 172.21.15.37:0/3653385187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafac003f30 0x7fafac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:11.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafccc00640 1 --2- 172.21.15.37:0/3653385187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafac004d50 0x7fafac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:11.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc7e00640 1 --2- 172.21.15.37:0/3653385187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafc809b170 0x7fafac0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:11.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc7400640 1 -- 172.21.15.37:0/3653385187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafc809b170 msgr2=0x7fafac0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:11.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc7400640 1 --2- 172.21.15.37:0/3653385187 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafc809b170 0x7fafac0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:11.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc7400640 1 -- 172.21.15.37:0/3653385187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafac004d50 msgr2=0x7fafac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:11.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc7400640 1 --2- 172.21.15.37:0/3653385187 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafac004d50 0x7fafac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:11.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.020+0000 7fafc7400640 1 -- 172.21.15.37:0/3653385187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafac003530 con 0x7fafac003f30 2024-05-30T06:52:11.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.024+0000 7fafc7400640 1 --2- 172.21.15.37:0/3653385187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafac003f30 0x7fafac004810 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fafc80d0800 tx=0x7fafb401f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd690e8cc3081fb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:11.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.024+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4007d40 con 0x7fafac003f30 2024-05-30T06:52:11.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.024+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb4005b00 con 0x7fafac003f30 2024-05-30T06:52:11.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.024+0000 7fafc6a00640 1 -- 172.21.15.37:0/3653385187 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4007070 con 0x7fafac003f30 2024-05-30T06:52:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.024+0000 7fafcec00640 1 -- 172.21.15.37:0/3653385187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafac003f30 msgr2=0x7fafac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.024+0000 7fafcec00640 1 --2- 172.21.15.37:0/3653385187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafac003f30 0x7fafac004810 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fafc80d0800 tx=0x7fafb401f3d0 comp rx=0 tx=0).stop 2024-05-30T06:52:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.024+0000 7fafccc00640 1 -- 172.21.15.37:0/3653385187 reap_dead start 2024-05-30T06:52:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.024+0000 7fafcec00640 1 -- 172.21.15.37:0/3653385187 shutdown_connections 2024-05-30T06:52:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.024+0000 7fafcec00640 1 -- 172.21.15.37:0/3653385187 >> 172.21.15.37:0/3653385187 conn(0x7fafc80b4060 msgr2=0x7fafc80b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.024+0000 7fafcec00640 1 -- 172.21.15.37:0/3653385187 shutdown_connections 2024-05-30T06:52:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.024+0000 7fafcec00640 1 -- 172.21.15.37:0/3653385187 wait complete. 2024-05-30T06:52:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafcec00640 1 Processor -- start 2024-05-30T06:52:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafcec00640 1 -- start start 2024-05-30T06:52:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafcec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafac003f30 0x7fafc8157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafcec00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafc80b2460 0x7fafc80b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafcec00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafc80b6d60 0x7fafc806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafcec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fafc80cd990 con 0x7fafac003f30 2024-05-30T06:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafcec00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fafc809be60 con 0x7fafc80b2460 2024-05-30T06:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafcec00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fafc80ce530 con 0x7fafc80b6d60 2024-05-30T06:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafc7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafac003f30 0x7fafc8157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafc7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafac003f30 0x7fafc8157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51144/0 (socket says 172.21.15.37:51144) 2024-05-30T06:52:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafc7e00640 1 -- 172.21.15.37:0/2654314620 learned_addr learned my addr 172.21.15.37:0/2654314620 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:11.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafc7e00640 1 -- 172.21.15.37:0/2654314620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafc80b6d60 msgr2=0x7fafc806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:11.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafc7e00640 1 --2- 172.21.15.37:0/2654314620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafc80b6d60 0x7fafc806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:11.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafc7e00640 1 -- 172.21.15.37:0/2654314620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafc80b2460 msgr2=0x7fafc80b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafc7e00640 1 --2- 172.21.15.37:0/2654314620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafc80b2460 0x7fafc80b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafc7e00640 1 -- 172.21.15.37:0/2654314620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc80b52e0 con 0x7fafac003f30 2024-05-30T06:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafc7e00640 1 --2- 172.21.15.37:0/2654314620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafac003f30 0x7fafc8157b50 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fafb800e550 tx=0x7fafb800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafbfe00640 1 -- 172.21.15.37:0/2654314620 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb80052e0 con 0x7fafac003f30 2024-05-30T06:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafbfe00640 1 -- 172.21.15.37:0/2654314620 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb8018070 con 0x7fafac003f30 2024-05-30T06:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafbfe00640 1 -- 172.21.15.37:0/2654314620 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8003820 con 0x7fafac003f30 2024-05-30T06:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafcec00640 1 -- 172.21.15.37:0/2654314620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc80b55c0 con 0x7fafac003f30 2024-05-30T06:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.028+0000 7fafcec00640 1 -- 172.21.15.37:0/2654314620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc80b5b80 con 0x7fafac003f30 2024-05-30T06:52:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.032+0000 7fafcec00640 1 -- 172.21.15.37:0/2654314620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc80b7180 con 0x7fafac003f30 2024-05-30T06:52:11.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.032+0000 7fafbfe00640 1 -- 172.21.15.37:0/2654314620 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) ==== 89517+0+0 (secure 0 0 0) 0x7fafb80039c0 con 0x7fafac003f30 2024-05-30T06:52:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.032+0000 7fafbfe00640 1 --2- 172.21.15.37:0/2654314620 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafa8069460 0x7fafa806b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.032+0000 7fafbfe00640 1 -- 172.21.15.37:0/2654314620 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fafb8085230 con 0x7fafac003f30 2024-05-30T06:52:11.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.040+0000 7fafbfe00640 1 -- 172.21.15.37:0/2654314620 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fafb801a310 con 0x7fafac003f30 2024-05-30T06:52:11.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.056+0000 7fafc7400640 1 --2- 172.21.15.37:0/2654314620 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafa8069460 0x7fafa806b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:11.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.076+0000 7fafc7400640 1 --2- 172.21.15.37:0/2654314620 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafa8069460 0x7fafa806b920 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fafc80d0800 tx=0x7fafb4001a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:11.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.364+0000 7fafcec00640 1 -- 172.21.15.37:0/2654314620 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone37103", "target": ["mon-mgr", ""]}) -- 0x7fafc80b5ef0 con 0x7fafa8069460 2024-05-30T06:52:11.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.692+0000 7fafbfe00640 1 -- 172.21.15.37:0/2654314620 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7fafb8053270 con 0x7fafac003f30 2024-05-30T06:52:11.926 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:11.926+0000 7f004c600640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:11.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:11.924+0000 7fafbfe00640 1 -- 172.21.15.37:0/2654314620 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7fafc80b5ef0 con 0x7fafa8069460 2024-05-30T06:52:11.927 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:11.939 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T06:52:11.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone37104 2024-05-30T06:52:12.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc891e00640 1 Processor -- start 2024-05-30T06:52:12.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc891e00640 1 -- start start 2024-05-30T06:52:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc891e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc88c15d350 0x7fc88c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc891e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc88c15d7e0 0x7fc88c06e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc891e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88c142030 con 0x7fc88c0b59d0 2024-05-30T06:52:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc891e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc88c142310 con 0x7fc88c15d350 2024-05-30T06:52:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc891e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc88c1425f0 con 0x7fc88c15d7e0 2024-05-30T06:52:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc882000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc88c15d350 0x7fc88c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc882000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc88c15d350 0x7fc88c06df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51154/0 (socket says 172.21.15.37:51154) 2024-05-30T06:52:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc882000640 1 -- 172.21.15.37:0/963629212 learned_addr learned my addr 172.21.15.37:0/963629212 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:12.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc88b400640 1 --2- 172.21.15.37:0/963629212 >> v2:172.21.15.105:3300/0 conn(0x7fc88c15d7e0 0x7fc88c06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:12.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc882000640 1 -- 172.21.15.37:0/963629212 >> v2:172.21.15.105:3300/0 conn(0x7fc88c15d7e0 msgr2=0x7fc88c06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:12.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc882000640 1 --2- 172.21.15.37:0/963629212 >> v2:172.21.15.105:3300/0 conn(0x7fc88c15d7e0 0x7fc88c06e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:12.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc882000640 1 -- 172.21.15.37:0/963629212 >> v1:172.21.15.105:6789/0 conn(0x7fc88c0b59d0 legacy=0x7fc88c0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:12.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.168+0000 7fc882000640 1 -- 172.21.15.37:0/963629212 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c1428d0 con 0x7fc88c15d350 2024-05-30T06:52:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.172+0000 7fc882000640 1 --2- 172.21.15.37:0/963629212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc88c15d350 0x7fc88c06df50 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fc874009870 tx=0x7fc87401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2cf211c8dd3dbee server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.172+0000 7fc88a000640 1 -- 172.21.15.37:0/963629212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8740ab430 con 0x7fc88c15d350 2024-05-30T06:52:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.172+0000 7fc88a000640 1 -- 172.21.15.37:0/963629212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8740b0070 con 0x7fc88c15d350 2024-05-30T06:52:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.172+0000 7fc88a000640 1 -- 172.21.15.37:0/963629212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8740ab7f0 con 0x7fc88c15d350 2024-05-30T06:52:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.176+0000 7fc891e00640 1 -- 172.21.15.37:0/963629212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc88c15d350 msgr2=0x7fc88c06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.176+0000 7fc891e00640 1 --2- 172.21.15.37:0/963629212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc88c15d350 0x7fc88c06df50 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fc874009870 tx=0x7fc87401c520 comp rx=0 tx=0).stop 2024-05-30T06:52:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.176+0000 7fc891e00640 1 -- 172.21.15.37:0/963629212 shutdown_connections 2024-05-30T06:52:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.176+0000 7fc891e00640 1 --2- 172.21.15.37:0/963629212 >> v2:172.21.15.105:3300/0 conn(0x7fc88c15d7e0 0x7fc88c06e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.176+0000 7fc891e00640 1 --2- 172.21.15.37:0/963629212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc88c15d350 0x7fc88c06df50 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.176+0000 7fc891e00640 1 -- 172.21.15.37:0/963629212 >> 172.21.15.37:0/963629212 conn(0x7fc88c06bf60 msgr2=0x7fc88c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.176+0000 7fc891e00640 1 -- 172.21.15.37:0/963629212 shutdown_connections 2024-05-30T06:52:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.176+0000 7fc891e00640 1 -- 172.21.15.37:0/963629212 wait complete. 2024-05-30T06:52:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc891e00640 1 Processor -- start 2024-05-30T06:52:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc891e00640 1 -- start start 2024-05-30T06:52:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc891e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc88c0b59d0 0x7fc88c0b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc891e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc88c15d350 0x7fc88c0b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc891e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc88c15d7e0 0x7fc88c15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc891e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c13f9e0 con 0x7fc88c15d350 2024-05-30T06:52:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc891e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c13f860 con 0x7fc88c0b59d0 2024-05-30T06:52:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc891e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc88c141bf0 con 0x7fc88c15d7e0 2024-05-30T06:52:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc882000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc88c15d350 0x7fc88c0b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc882000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc88c15d350 0x7fc88c0b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51170/0 (socket says 172.21.15.37:51170) 2024-05-30T06:52:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc882000640 1 -- 172.21.15.37:0/2946348444 learned_addr learned my addr 172.21.15.37:0/2946348444 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc882000640 1 -- 172.21.15.37:0/2946348444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc88c15d7e0 msgr2=0x7fc88c15bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc88b400640 1 --2- 172.21.15.37:0/2946348444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc88c15d7e0 0x7fc88c15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc882000640 1 --2- 172.21.15.37:0/2946348444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc88c15d7e0 0x7fc88c15bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc882000640 1 -- 172.21.15.37:0/2946348444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc88c0b59d0 msgr2=0x7fc88c0b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc882000640 1 --2- 172.21.15.37:0/2946348444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc88c0b59d0 0x7fc88c0b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc882000640 1 -- 172.21.15.37:0/2946348444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c13ec30 con 0x7fc88c15d350 2024-05-30T06:52:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc88b400640 1 --2- 172.21.15.37:0/2946348444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc88c15d7e0 0x7fc88c15bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:52:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc882000640 1 --2- 172.21.15.37:0/2946348444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc88c15d350 0x7fc88c0b37c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fc87401abd0 tx=0x7fc87401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc883e00640 1 -- 172.21.15.37:0/2946348444 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8740be5f0 con 0x7fc88c15d350 2024-05-30T06:52:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc883e00640 1 -- 172.21.15.37:0/2946348444 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8740be790 con 0x7fc88c15d350 2024-05-30T06:52:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.180+0000 7fc883e00640 1 -- 172.21.15.37:0/2946348444 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8740beb80 con 0x7fc88c15d350 2024-05-30T06:52:12.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.184+0000 7fc891e00640 1 -- 172.21.15.37:0/2946348444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c13e670 con 0x7fc88c15d350 2024-05-30T06:52:12.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.184+0000 7fc891e00640 1 -- 172.21.15.37:0/2946348444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88c0ae4d0 con 0x7fc88c15d350 2024-05-30T06:52:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.184+0000 7fc880c00640 1 -- 172.21.15.37:0/2946348444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc88c068bc0 con 0x7fc88c15d350 2024-05-30T06:52:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.184+0000 7fc883e00640 1 -- 172.21.15.37:0/2946348444 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7fc8740b43f0 con 0x7fc88c15d350 2024-05-30T06:52:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.184+0000 7fc883e00640 1 --2- 172.21.15.37:0/2946348444 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc8680694f0 0x7fc86806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.184+0000 7fc883e00640 1 -- 172.21.15.37:0/2946348444 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fc8740a8030 con 0x7fc88c15d350 2024-05-30T06:52:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.188+0000 7fc88aa00640 1 --2- 172.21.15.37:0/2946348444 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc8680694f0 0x7fc86806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:12.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.192+0000 7fc88aa00640 1 --2- 172.21.15.37:0/2946348444 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc8680694f0 0x7fc86806b9b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc87c007fd0 tx=0x7fc87c007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:12.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.196+0000 7fc883e00640 1 -- 172.21.15.37:0/2946348444 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc874016110 con 0x7fc88c15d350 2024-05-30T06:52:12.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.516+0000 7fc880c00640 1 -- 172.21.15.37:0/2946348444 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone37104", "target": ["mon-mgr", ""]}) -- 0x7fc88c0b53b0 con 0x7fc8680694f0 2024-05-30T06:52:12.889 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:12.886+0000 7f004c600640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:12.888+0000 7fc883e00640 1 -- 172.21.15.37:0/2946348444 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7fc88c0b53b0 con 0x7fc8680694f0 2024-05-30T06:52:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:12.905 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T06:52:12.905 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone37105 2024-05-30T06:52:13.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.156+0000 7f5725200640 1 Processor -- start 2024-05-30T06:52:13.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.156+0000 7f5725200640 1 -- start start 2024-05-30T06:52:13.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.156+0000 7f5725200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f57200b59d0 0x7f57200b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.156+0000 7f5725200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57201610a0 con 0x7f572015d350 2024-05-30T06:52:13.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.156+0000 7f5725200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57200b62f0 con 0x7f572015d7e0 2024-05-30T06:52:13.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.156+0000 7f5725200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5720142030 con 0x7f57200b59d0 2024-05-30T06:52:13.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.156+0000 7f571d400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f572015d350 0x7f5720160280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36616/0 (socket says 172.21.15.37:36616) 2024-05-30T06:52:13.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.156+0000 7f571d400640 1 -- 172.21.15.37:0/3962663198 learned_addr learned my addr 172.21.15.37:0/3962663198 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:13.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.156+0000 7f571de00640 1 --2- 172.21.15.37:0/3962663198 >> v2:172.21.15.105:3300/0 conn(0x7f57200b59d0 0x7f57200b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:13.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659963666 0 0) 0x7f57201610a0 con 0x7f572015d350 2024-05-30T06:52:13.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5704003530 con 0x7f572015d350 2024-05-30T06:52:13.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3244380375 0 0) 0x7f5704003530 con 0x7f572015d350 2024-05-30T06:52:13.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 >> v2:172.21.15.105:3300/0 conn(0x7f57200b59d0 msgr2=0x7f57200b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:13.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 --2- 172.21.15.37:0/3962663198 >> v2:172.21.15.105:3300/0 conn(0x7f57200b59d0 0x7f57200b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:13.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 >> v1:172.21.15.105:6789/0 conn(0x7f572015d7e0 legacy=0x7f5720160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:13.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5720142310 con 0x7f572015d350 2024-05-30T06:52:13.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f570c001680 con 0x7f572015d350 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 >> v1:172.21.15.37:6789/0 conn(0x7f572015d350 legacy=0x7f5720160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 --2- 172.21.15.37:0/3962663198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57040039c0 0x7f5704003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 --2- 172.21.15.37:0/3962663198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704004810 0x7f5704004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 --2- 172.21.15.37:0/3962663198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57040051d0 0x7f570400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5720142030 con 0x7f5704004810 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f570400c080 con 0x7f57040051d0 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f570400c280 con 0x7f57040039c0 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571d400640 1 --2- 172.21.15.37:0/3962663198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704004810 0x7f5704004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571e800640 1 --2- 172.21.15.37:0/3962663198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57040051d0 0x7f570400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571de00640 1 --2- 172.21.15.37:0/3962663198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57040039c0 0x7f5704003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571d400640 1 -- 172.21.15.37:0/3962663198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57040039c0 msgr2=0x7f5704003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571d400640 1 --2- 172.21.15.37:0/3962663198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57040039c0 0x7f5704003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571d400640 1 -- 172.21.15.37:0/3962663198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57040051d0 msgr2=0x7f570400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:13.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571d400640 1 --2- 172.21.15.37:0/3962663198 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57040051d0 0x7f570400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:13.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571d400640 1 -- 172.21.15.37:0/3962663198 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5704003530 con 0x7f5704004810 2024-05-30T06:52:13.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.160+0000 7f571e800640 1 -- 172.21.15.37:0/3962663198 reap_dead start 2024-05-30T06:52:13.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.164+0000 7f571d400640 1 --2- 172.21.15.37:0/3962663198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704004810 0x7f5704004c90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c210 tx=0x7f570c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1585a05f19b15030 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:13.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.164+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c007d40 con 0x7f5704004810 2024-05-30T06:52:13.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.164+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570c0a9070 con 0x7f5704004810 2024-05-30T06:52:13.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.164+0000 7f571ca00640 1 -- 172.21.15.37:0/3962663198 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c0a5e40 con 0x7f5704004810 2024-05-30T06:52:13.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.164+0000 7f5725200640 1 -- 172.21.15.37:0/3962663198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704004810 msgr2=0x7f5704004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:13.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.164+0000 7f5725200640 1 --2- 172.21.15.37:0/3962663198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704004810 0x7f5704004c90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f570c00c210 tx=0x7f570c01cca0 comp rx=0 tx=0).stop 2024-05-30T06:52:13.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.164+0000 7f5725200640 1 -- 172.21.15.37:0/3962663198 shutdown_connections 2024-05-30T06:52:13.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.164+0000 7f5725200640 1 --2- 172.21.15.37:0/3962663198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704004810 0x7f5704004c90 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:13.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.164+0000 7f5725200640 1 -- 172.21.15.37:0/3962663198 >> 172.21.15.37:0/3962663198 conn(0x7f572006bf60 msgr2=0x7f57200b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:13.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.164+0000 7f5725200640 1 -- 172.21.15.37:0/3962663198 shutdown_connections 2024-05-30T06:52:13.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.164+0000 7f5725200640 1 -- 172.21.15.37:0/3962663198 wait complete. 2024-05-30T06:52:13.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.164+0000 7f5725200640 1 Processor -- start 2024-05-30T06:52:13.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.164+0000 7f5725200640 1 -- start start 2024-05-30T06:52:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f5725200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704004810 0x7f5720152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f5725200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57201f48d0 0x7f5720156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f5725200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f572015ef40 0x7f572015f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f5725200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f572013fce0 con 0x7f5704004810 2024-05-30T06:52:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f5725200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f57201428d0 con 0x7f572015ef40 2024-05-30T06:52:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f5725200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f572013fe60 con 0x7f57201f48d0 2024-05-30T06:52:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f571de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704004810 0x7f5720152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f571de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704004810 0x7f5720152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51196/0 (socket says 172.21.15.37:51196) 2024-05-30T06:52:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f571de00640 1 -- 172.21.15.37:0/3288213717 learned_addr learned my addr 172.21.15.37:0/3288213717 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f571e800640 1 --2- 172.21.15.37:0/3288213717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f572015ef40 0x7f572015f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f571de00640 1 -- 172.21.15.37:0/3288213717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57201f48d0 msgr2=0x7f5720156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f571de00640 1 --2- 172.21.15.37:0/3288213717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57201f48d0 0x7f5720156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f571de00640 1 -- 172.21.15.37:0/3288213717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f572015ef40 msgr2=0x7f572015f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f571de00640 1 --2- 172.21.15.37:0/3288213717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f572015ef40 0x7f572015f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f571de00640 1 -- 172.21.15.37:0/3288213717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57201f4e70 con 0x7f5704004810 2024-05-30T06:52:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f571de00640 1 --2- 172.21.15.37:0/3288213717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5704004810 0x7f5720152b90 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f5710011500 tx=0x7f57100119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f5716000640 1 -- 172.21.15.37:0/3288213717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710015870 con 0x7f5704004810 2024-05-30T06:52:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f5716000640 1 -- 172.21.15.37:0/3288213717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5710015a10 con 0x7f5704004810 2024-05-30T06:52:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f5716000640 1 -- 172.21.15.37:0/3288213717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710015dc0 con 0x7f5704004810 2024-05-30T06:52:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f5725200640 1 -- 172.21.15.37:0/3288213717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57201f5150 con 0x7f5704004810 2024-05-30T06:52:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f5725200640 1 -- 172.21.15.37:0/3288213717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57201f5710 con 0x7f5704004810 2024-05-30T06:52:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.168+0000 7f5725200640 1 -- 172.21.15.37:0/3288213717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5720068bc0 con 0x7f5704004810 2024-05-30T06:52:13.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.172+0000 7f5716000640 1 -- 172.21.15.37:0/3288213717 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f5710013400 con 0x7f5704004810 2024-05-30T06:52:13.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.172+0000 7f5716000640 1 --2- 172.21.15.37:0/3288213717 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5700069520 0x7f570006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.172+0000 7f5716000640 1 -- 172.21.15.37:0/3288213717 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f57100863a0 con 0x7f5704004810 2024-05-30T06:52:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.172+0000 7f571d400640 1 --2- 172.21.15.37:0/3288213717 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5700069520 0x7f570006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:13.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.176+0000 7f5716000640 1 -- 172.21.15.37:0/3288213717 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5710019030 con 0x7f5704004810 2024-05-30T06:52:13.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.176+0000 7f571d400640 1 --2- 172.21.15.37:0/3288213717 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5700069520 0x7f570006b9e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f570c0ab000 tx=0x7f570c001a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:13.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.476+0000 7f5725200640 1 -- 172.21.15.37:0/3288213717 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone37105", "target": ["mon-mgr", ""]}) -- 0x7f572006f0a0 con 0x7f5700069520 2024-05-30T06:52:13.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.668+0000 7f5716000640 1 -- 172.21.15.37:0/3288213717 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f572006f0a0 con 0x7f5700069520 2024-05-30T06:52:13.671 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:13.674 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:13.670+0000 7f004c600640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:13.682 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T06:52:13.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone37106 2024-05-30T06:52:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.936+0000 7fd3c5600640 1 Processor -- start 2024-05-30T06:52:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.936+0000 7fd3c5600640 1 -- start start 2024-05-30T06:52:13.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.940+0000 7fd3c5600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd3c015c870 0x7fd3c00cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.940+0000 7fd3c5600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3c009b170 0x7fd3c00af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.940+0000 7fd3c5600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3c009bb80 con 0x7fd3c00d03c0 2024-05-30T06:52:13.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.940+0000 7fd3c5600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c00cd110 con 0x7fd3c015c870 2024-05-30T06:52:13.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.940+0000 7fd3c5600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c009be60 con 0x7fd3c009b170 2024-05-30T06:52:13.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.940+0000 7fd3bf400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3c009b170 0x7fd3c00af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:13.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.940+0000 7fd3bf400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3c009b170 0x7fd3c00af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:52014/0 (socket says 172.21.15.37:52014) 2024-05-30T06:52:13.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.940+0000 7fd3bf400640 1 -- 172.21.15.37:0/444381056 learned_addr learned my addr 172.21.15.37:0/444381056 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.944+0000 7fd3bea00640 1 --2- 172.21.15.37:0/444381056 >> v2:172.21.15.105:3300/0 conn(0x7fd3c015c870 0x7fd3c00cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:13.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.944+0000 7fd3bea00640 1 -- 172.21.15.37:0/444381056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3c009b170 msgr2=0x7fd3c00af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:13.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.944+0000 7fd3bea00640 1 --2- 172.21.15.37:0/444381056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3c009b170 0x7fd3c00af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:13.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.944+0000 7fd3bea00640 1 -- 172.21.15.37:0/444381056 >> v1:172.21.15.105:6789/0 conn(0x7fd3c00d03c0 legacy=0x7fd3c009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:13.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.944+0000 7fd3bea00640 1 -- 172.21.15.37:0/444381056 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c00cd340 con 0x7fd3c015c870 2024-05-30T06:52:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.948+0000 7fd3bea00640 1 --2- 172.21.15.37:0/444381056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c015c870 0x7fd3c00cde20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00097c0 tx=0x7fd3b001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8099b46253be99c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.948+0000 7fd3bd600640 1 -- 172.21.15.37:0/444381056 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00b0070 con 0x7fd3c015c870 2024-05-30T06:52:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.948+0000 7fd3bd600640 1 -- 172.21.15.37:0/444381056 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b00ab600 con 0x7fd3c015c870 2024-05-30T06:52:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.948+0000 7fd3bd600640 1 -- 172.21.15.37:0/444381056 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00ab9d0 con 0x7fd3c015c870 2024-05-30T06:52:13.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.952+0000 7fd3c5600640 1 -- 172.21.15.37:0/444381056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c015c870 msgr2=0x7fd3c00cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.952+0000 7fd3c5600640 1 --2- 172.21.15.37:0/444381056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c015c870 0x7fd3c00cde20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00097c0 tx=0x7fd3b001c460 comp rx=0 tx=0).stop 2024-05-30T06:52:13.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.956+0000 7fd3c5600640 1 -- 172.21.15.37:0/444381056 shutdown_connections 2024-05-30T06:52:13.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.956+0000 7fd3c5600640 1 --2- 172.21.15.37:0/444381056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3c009b170 0x7fd3c00af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:13.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.956+0000 7fd3c5600640 1 --2- 172.21.15.37:0/444381056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c015c870 0x7fd3c00cde20 secure :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00097c0 tx=0x7fd3b001c460 comp rx=0 tx=0).stop 2024-05-30T06:52:13.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.956+0000 7fd3c5600640 1 -- 172.21.15.37:0/444381056 >> 172.21.15.37:0/444381056 conn(0x7fd3c00b4060 msgr2=0x7fd3c00b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:13.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.956+0000 7fd3c5600640 1 -- 172.21.15.37:0/444381056 shutdown_connections 2024-05-30T06:52:13.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.956+0000 7fd3c5600640 1 -- 172.21.15.37:0/444381056 wait complete. 2024-05-30T06:52:13.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.960+0000 7fd3c5600640 1 Processor -- start 2024-05-30T06:52:13.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.964+0000 7fd3c5600640 1 -- start start 2024-05-30T06:52:13.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.968+0000 7fd3c5600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3c009b170 0x7fd3c014eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.968+0000 7fd3c5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c00d03c0 0x7fd3c015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.968+0000 7fd3c5600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c0155180 0x7fd3c0155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.968+0000 7fd3c5600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c015cdd0 con 0x7fd3c00d03c0 2024-05-30T06:52:13.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.968+0000 7fd3c5600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c015cc50 con 0x7fd3c0155180 2024-05-30T06:52:13.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.968+0000 7fd3c5600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c00ce360 con 0x7fd3c009b170 2024-05-30T06:52:13.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.968+0000 7fd3bea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3c009b170 0x7fd3c014eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:13.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.968+0000 7fd3bea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3c009b170 0x7fd3c014eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:52022/0 (socket says 172.21.15.37:52022) 2024-05-30T06:52:13.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.968+0000 7fd3bea00640 1 -- 172.21.15.37:0/3617630685 learned_addr learned my addr 172.21.15.37:0/3617630685 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.976+0000 7fd3bf400640 1 --2- 172.21.15.37:0/3617630685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c0155180 0x7fd3c0155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.976+0000 7fd3be000640 1 --2- 172.21.15.37:0/3617630685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c00d03c0 0x7fd3c015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.976+0000 7fd3bea00640 1 -- 172.21.15.37:0/3617630685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c0155180 msgr2=0x7fd3c0155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.976+0000 7fd3bea00640 1 --2- 172.21.15.37:0/3617630685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3c0155180 0x7fd3c0155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.976+0000 7fd3bea00640 1 -- 172.21.15.37:0/3617630685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c00d03c0 msgr2=0x7fd3c015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.976+0000 7fd3bea00640 1 --2- 172.21.15.37:0/3617630685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3c00d03c0 0x7fd3c015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.976+0000 7fd3bea00640 1 -- 172.21.15.37:0/3617630685 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c014f090 con 0x7fd3c009b170 2024-05-30T06:52:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.980+0000 7fd3bea00640 1 --2- 172.21.15.37:0/3617630685 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3c009b170 0x7fd3c014eb50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd3b001ab10 tx=0x7fd3b0019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.980+0000 7fd3b6a00640 1 -- 172.21.15.37:0/3617630685 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00b0040 con 0x7fd3c009b170 2024-05-30T06:52:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.980+0000 7fd3b6a00640 1 -- 172.21.15.37:0/3617630685 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b00bb070 con 0x7fd3c009b170 2024-05-30T06:52:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.980+0000 7fd3b6a00640 1 -- 172.21.15.37:0/3617630685 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b00b56c0 con 0x7fd3c009b170 2024-05-30T06:52:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.980+0000 7fd3c5600640 1 -- 172.21.15.37:0/3617630685 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c0157880 con 0x7fd3c009b170 2024-05-30T06:52:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.980+0000 7fd3c5600640 1 -- 172.21.15.37:0/3617630685 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c0157e40 con 0x7fd3c009b170 2024-05-30T06:52:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.984+0000 7fd3c5600640 1 -- 172.21.15.37:0/3617630685 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3980052a0 con 0x7fd3c009b170 2024-05-30T06:52:13.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.992+0000 7fd3b6a00640 1 -- 172.21.15.37:0/3617630685 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7fd3b00b3070 con 0x7fd3c009b170 2024-05-30T06:52:13.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.992+0000 7fd3b6a00640 1 --2- 172.21.15.37:0/3617630685 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd3a00695c0 0x7fd3a006ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:13.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:13.992+0000 7fd3b6a00640 1 -- 172.21.15.37:0/3617630685 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fd3b011ffe0 con 0x7fd3c009b170 2024-05-30T06:52:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:14.000+0000 7fd3b6a00640 1 -- 172.21.15.37:0/3617630685 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd3b0016050 con 0x7fd3c009b170 2024-05-30T06:52:14.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:14.056+0000 7fd3be000640 1 --2- 172.21.15.37:0/3617630685 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd3a00695c0 0x7fd3a006ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:14.108+0000 7fd3be000640 1 --2- 172.21.15.37:0/3617630685 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd3a00695c0 0x7fd3a006ba80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd3c00d0e10 tx=0x7fd3ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:14.360+0000 7fd3c5600640 1 -- 172.21.15.37:0/3617630685 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone37106", "target": ["mon-mgr", ""]}) -- 0x7fd398000bd0 con 0x7fd3a00695c0 2024-05-30T06:52:15.044 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:15.042+0000 7f004c600640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:15.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.040+0000 7fd3b6a00640 1 -- 172.21.15.37:0/3617630685 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7fd398000bd0 con 0x7fd3a00695c0 2024-05-30T06:52:15.044 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:15.061 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T06:52:15.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone37107 2024-05-30T06:52:15.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.280+0000 7f4620e00640 1 Processor -- start 2024-05-30T06:52:15.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.280+0000 7f4620e00640 1 -- start start 2024-05-30T06:52:15.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.284+0000 7f4620e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f461c15e8b0 0x7f461c0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:15.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.284+0000 7f4620e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f461c06d200 0x7f461c06d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:15.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.284+0000 7f4620e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f461c09aa60 0x7f461c09aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:15.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.284+0000 7f4620e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f461c06db80 con 0x7f461c06d200 2024-05-30T06:52:15.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.284+0000 7f4620e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f461c163350 con 0x7f461c09aa60 2024-05-30T06:52:15.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.284+0000 7f4620e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f461c0cfb30 con 0x7f461c15e8b0 2024-05-30T06:52:15.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.288+0000 7f4619400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f461c06d200 0x7f461c06d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:15.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.288+0000 7f4619400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f461c06d200 0x7f461c06d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51220/0 (socket says 172.21.15.37:51220) 2024-05-30T06:52:15.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.288+0000 7f4619400640 1 -- 172.21.15.37:0/3370288566 learned_addr learned my addr 172.21.15.37:0/3370288566 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:15.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.288+0000 7f4619e00640 1 --2- 172.21.15.37:0/3370288566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f461c15e8b0 0x7f461c0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:15.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.288+0000 7f461a800640 1 --2- 172.21.15.37:0/3370288566 >> v2:172.21.15.105:3300/0 conn(0x7f461c09aa60 0x7f461c09aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:15.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.288+0000 7f4619400640 1 -- 172.21.15.37:0/3370288566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f461c15e8b0 msgr2=0x7f461c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:15.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.288+0000 7f4619400640 1 --2- 172.21.15.37:0/3370288566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f461c15e8b0 0x7f461c0cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:15.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.288+0000 7f4619400640 1 -- 172.21.15.37:0/3370288566 >> v2:172.21.15.105:3300/0 conn(0x7f461c09aa60 msgr2=0x7f461c09aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:15.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.288+0000 7f4619400640 1 --2- 172.21.15.37:0/3370288566 >> v2:172.21.15.105:3300/0 conn(0x7f461c09aa60 0x7f461c09aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:15.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.288+0000 7f4619400640 1 -- 172.21.15.37:0/3370288566 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c1627d0 con 0x7f461c06d200 2024-05-30T06:52:15.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.288+0000 7f4619e00640 1 --2- 172.21.15.37:0/3370288566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f461c15e8b0 0x7f461c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:52:15.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.300+0000 7f4619400640 1 --2- 172.21.15.37:0/3370288566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f461c06d200 0x7f461c06d640 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f461c0b4ea0 tx=0x7f460c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90d94b65109dfcc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:15.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.304+0000 7f4618a00640 1 -- 172.21.15.37:0/3370288566 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c0b1070 con 0x7f461c06d200 2024-05-30T06:52:15.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.304+0000 7f4618a00640 1 -- 172.21.15.37:0/3370288566 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460c0ac630 con 0x7f461c06d200 2024-05-30T06:52:15.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.304+0000 7f4618a00640 1 -- 172.21.15.37:0/3370288566 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c0b1070 con 0x7f461c06d200 2024-05-30T06:52:15.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.308+0000 7f4620e00640 1 -- 172.21.15.37:0/3370288566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f461c06d200 msgr2=0x7f461c06d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:15.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.308+0000 7f4620e00640 1 --2- 172.21.15.37:0/3370288566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f461c06d200 0x7f461c06d640 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f461c0b4ea0 tx=0x7f460c01c520 comp rx=0 tx=0).stop 2024-05-30T06:52:15.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.308+0000 7f4620e00640 1 -- 172.21.15.37:0/3370288566 shutdown_connections 2024-05-30T06:52:15.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.308+0000 7f4620e00640 1 --2- 172.21.15.37:0/3370288566 >> v2:172.21.15.105:3300/0 conn(0x7f461c09aa60 0x7f461c09aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:15.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.308+0000 7f4620e00640 1 --2- 172.21.15.37:0/3370288566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f461c06d200 0x7f461c06d640 secure :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f461c0b4ea0 tx=0x7f460c01c520 comp rx=0 tx=0).stop 2024-05-30T06:52:15.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.308+0000 7f4620e00640 1 --2- 172.21.15.37:0/3370288566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f461c15e8b0 0x7f461c0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:15.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.308+0000 7f4620e00640 1 -- 172.21.15.37:0/3370288566 >> 172.21.15.37:0/3370288566 conn(0x7f461c0b4130 msgr2=0x7f461c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:15.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.308+0000 7f4620e00640 1 -- 172.21.15.37:0/3370288566 shutdown_connections 2024-05-30T06:52:15.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.308+0000 7f4620e00640 1 -- 172.21.15.37:0/3370288566 wait complete. 2024-05-30T06:52:15.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.316+0000 7f4620e00640 1 Processor -- start 2024-05-30T06:52:15.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.316+0000 7f4620e00640 1 -- start start 2024-05-30T06:52:15.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.316+0000 7f4620e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f461c09aa60 0x7f461c1fcee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:15.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.316+0000 7f4620e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461c15e8b0 0x7f461c15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:15.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.320+0000 7f4620e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f461c15d440 0x7f461c155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.320+0000 7f4620e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f461c15ec90 con 0x7f461c15d440 2024-05-30T06:52:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.320+0000 7f4620e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f461c09b820 con 0x7f461c15e8b0 2024-05-30T06:52:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.320+0000 7f4620e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f461c162480 con 0x7f461c09aa60 2024-05-30T06:52:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.320+0000 7f4619400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461c15e8b0 0x7f461c15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.320+0000 7f4619400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461c15e8b0 0x7f461c15cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:57068/0 (socket says 172.21.15.37:57068) 2024-05-30T06:52:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.320+0000 7f4619400640 1 -- 172.21.15.37:0/3298213923 learned_addr learned my addr 172.21.15.37:0/3298213923 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:15.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.320+0000 7f4619e00640 1 --2- 172.21.15.37:0/3298213923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f461c09aa60 0x7f461c1fcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:15.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.320+0000 7f461a800640 1 --2- 172.21.15.37:0/3298213923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f461c15d440 0x7f461c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:15.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.324+0000 7f4619400640 1 -- 172.21.15.37:0/3298213923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f461c09aa60 msgr2=0x7f461c1fcee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:15.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.324+0000 7f4619400640 1 --2- 172.21.15.37:0/3298213923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f461c09aa60 0x7f461c1fcee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:15.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.324+0000 7f4619400640 1 -- 172.21.15.37:0/3298213923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f461c15d440 msgr2=0x7f461c155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:15.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.324+0000 7f4619400640 1 --2- 172.21.15.37:0/3298213923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f461c15d440 0x7f461c155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:15.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.324+0000 7f4619400640 1 -- 172.21.15.37:0/3298213923 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c1fd420 con 0x7f461c15e8b0 2024-05-30T06:52:15.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.324+0000 7f4619400640 1 --2- 172.21.15.37:0/3298213923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f461c15e8b0 0x7f461c15cf00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f460c0af040 tx=0x7f460c0192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:15.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.324+0000 7f4612000640 1 -- 172.21.15.37:0/3298213923 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c0b1040 con 0x7f461c15e8b0 2024-05-30T06:52:15.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.324+0000 7f4612000640 1 -- 172.21.15.37:0/3298213923 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460c0ba070 con 0x7f461c15e8b0 2024-05-30T06:52:15.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.324+0000 7f4612000640 1 -- 172.21.15.37:0/3298213923 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460c0a8050 con 0x7f461c15e8b0 2024-05-30T06:52:15.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.324+0000 7f4620e00640 1 -- 172.21.15.37:0/3298213923 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461c0c69e0 con 0x7f461c15e8b0 2024-05-30T06:52:15.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.324+0000 7f4620e00640 1 -- 172.21.15.37:0/3298213923 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461c0c6fa0 con 0x7f461c15e8b0 2024-05-30T06:52:15.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.328+0000 7f4620e00640 1 -- 172.21.15.37:0/3298213923 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f461c15d850 con 0x7f461c15e8b0 2024-05-30T06:52:15.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.328+0000 7f4612000640 1 -- 172.21.15.37:0/3298213923 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f460c0acc20 con 0x7f461c15e8b0 2024-05-30T06:52:15.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.332+0000 7f4612000640 1 --2- 172.21.15.37:0/3298213923 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f45f8069540 0x7f45f806ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:15.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.332+0000 7f4612000640 1 -- 172.21.15.37:0/3298213923 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f460c0df020 con 0x7f461c15e8b0 2024-05-30T06:52:15.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.332+0000 7f4619e00640 1 --2- 172.21.15.37:0/3298213923 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f45f8069540 0x7f45f806ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.340+0000 7f4612000640 1 -- 172.21.15.37:0/3298213923 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f461c15d850 con 0x7f461c15e8b0 2024-05-30T06:52:15.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.372+0000 7f4619e00640 1 --2- 172.21.15.37:0/3298213923 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f45f8069540 0x7f45f806ba00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f461c15de80 tx=0x7f4604008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:15.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.644+0000 7f4620e00640 1 -- 172.21.15.37:0/3298213923 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone37107", "target": ["mon-mgr", ""]}) -- 0x7f461c09b1f0 con 0x7f45f8069540 2024-05-30T06:52:15.761 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:15.762+0000 7f004c600640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:15.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:15.764+0000 7f4612000640 1 -- 172.21.15.37:0/3298213923 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f461c09b1f0 con 0x7f45f8069540 2024-05-30T06:52:15.765 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:15.782 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T06:52:15.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone37108 2024-05-30T06:52:16.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.008+0000 7f3b63400640 1 Processor -- start 2024-05-30T06:52:16.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.008+0000 7f3b63400640 1 -- start start 2024-05-30T06:52:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.008+0000 7f3b63400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b5c15c650 0x7f3b5c0d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.008+0000 7f3b63400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c0b2890 0x7f3b5c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.008+0000 7f3b63400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c0b3f40 con 0x7f3b5c15ca30 2024-05-30T06:52:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.008+0000 7f3b63400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5c0cce80 con 0x7f3b5c15c650 2024-05-30T06:52:16.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.008+0000 7f3b63400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c0b2ec0 con 0x7f3b5c0b2890 2024-05-30T06:52:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.008+0000 7f3b53e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3b5c15ca30 0x7f3b5c0b2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36624/0 (socket says 172.21.15.37:36624) 2024-05-30T06:52:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.008+0000 7f3b53e00640 1 -- 172.21.15.37:0/1681580469 learned_addr learned my addr 172.21.15.37:0/1681580469 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.012+0000 7f3b60a00640 1 --2- 172.21.15.37:0/1681580469 >> v2:172.21.15.37:3300/0 conn(0x7f3b5c15c650 0x7f3b5c0d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.012+0000 7f3b5be00640 1 -- 172.21.15.37:0/1681580469 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228240086 0 0) 0x7f3b5c0b3f40 con 0x7f3b5c15ca30 2024-05-30T06:52:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.012+0000 7f3b61400640 1 --2- 172.21.15.37:0/1681580469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c0b2890 0x7f3b5c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:16.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.012+0000 7f3b60a00640 1 -- 172.21.15.37:0/1681580469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c0b2890 msgr2=0x7f3b5c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.012+0000 7f3b60a00640 1 --2- 172.21.15.37:0/1681580469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c0b2890 0x7f3b5c0d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.012+0000 7f3b60a00640 1 -- 172.21.15.37:0/1681580469 >> v1:172.21.15.37:6789/0 conn(0x7f3b5c15ca30 legacy=0x7f3b5c0b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:16.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.012+0000 7f3b60a00640 1 -- 172.21.15.37:0/1681580469 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c0b3180 con 0x7f3b5c15c650 2024-05-30T06:52:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.016+0000 7f3b60a00640 1 --2- 172.21.15.37:0/1681580469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c15c650 0x7f3b5c0d09e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0097c0 tx=0x7f3b4c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c3da72ed69bd16 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.016+0000 7f3b5be00640 1 -- 172.21.15.37:0/1681580469 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0b5070 con 0x7f3b5c15c650 2024-05-30T06:52:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.016+0000 7f3b5be00640 1 -- 172.21.15.37:0/1681580469 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4c0a8990 con 0x7f3b5c15c650 2024-05-30T06:52:16.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.016+0000 7f3b5be00640 1 -- 172.21.15.37:0/1681580469 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0a8d60 con 0x7f3b5c15c650 2024-05-30T06:52:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.016+0000 7f3b63400640 1 -- 172.21.15.37:0/1681580469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c15c650 msgr2=0x7f3b5c0d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.016+0000 7f3b63400640 1 --2- 172.21.15.37:0/1681580469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c15c650 0x7f3b5c0d09e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0097c0 tx=0x7f3b4c01ec90 comp rx=0 tx=0).stop 2024-05-30T06:52:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.016+0000 7f3b63400640 1 -- 172.21.15.37:0/1681580469 shutdown_connections 2024-05-30T06:52:16.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.016+0000 7f3b63400640 1 --2- 172.21.15.37:0/1681580469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c0b2890 0x7f3b5c0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.016+0000 7f3b63400640 1 --2- 172.21.15.37:0/1681580469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c15c650 0x7f3b5c0d09e0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.016+0000 7f3b63400640 1 -- 172.21.15.37:0/1681580469 >> 172.21.15.37:0/1681580469 conn(0x7f3b5c0b4130 msgr2=0x7f3b5c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.016+0000 7f3b63400640 1 -- 172.21.15.37:0/1681580469 shutdown_connections 2024-05-30T06:52:16.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.016+0000 7f3b63400640 1 -- 172.21.15.37:0/1681580469 wait complete. 2024-05-30T06:52:16.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b63400640 1 Processor -- start 2024-05-30T06:52:16.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b63400640 1 -- start start 2024-05-30T06:52:16.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b63400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c0b2890 0x7f3b5c0cf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:16.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b63400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c15c650 0x7f3b5c0c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:16.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b63400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c15ca30 0x7f3b5c0c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:16.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b63400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0b3740 con 0x7f3b5c15c650 2024-05-30T06:52:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b63400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c0b2ca0 con 0x7f3b5c15ca30 2024-05-30T06:52:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b63400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c0b3a20 con 0x7f3b5c0b2890 2024-05-30T06:52:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b53e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c15c650 0x7f3b5c0c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b53e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c15c650 0x7f3b5c0c51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51242/0 (socket says 172.21.15.37:51242) 2024-05-30T06:52:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b53e00640 1 -- 172.21.15.37:0/1592445572 learned_addr learned my addr 172.21.15.37:0/1592445572 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b60a00640 1 --2- 172.21.15.37:0/1592445572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c0b2890 0x7f3b5c0cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b61400640 1 --2- 172.21.15.37:0/1592445572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c15ca30 0x7f3b5c0c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b53e00640 1 -- 172.21.15.37:0/1592445572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c0b2890 msgr2=0x7f3b5c0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b53e00640 1 --2- 172.21.15.37:0/1592445572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c0b2890 0x7f3b5c0cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b53e00640 1 -- 172.21.15.37:0/1592445572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c15ca30 msgr2=0x7f3b5c0c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b53e00640 1 --2- 172.21.15.37:0/1592445572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c15ca30 0x7f3b5c0c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:16.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b53e00640 1 -- 172.21.15.37:0/1592445572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c15d7f0 con 0x7f3b5c15c650 2024-05-30T06:52:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b53e00640 1 --2- 172.21.15.37:0/1592445572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c15c650 0x7f3b5c0c51d0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f3b4400c480 tx=0x7f3b4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b59600640 1 -- 172.21.15.37:0/1592445572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44018070 con 0x7f3b5c15c650 2024-05-30T06:52:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b59600640 1 -- 172.21.15.37:0/1592445572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b44007500 con 0x7f3b5c15c650 2024-05-30T06:52:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b59600640 1 -- 172.21.15.37:0/1592445572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44004a30 con 0x7f3b5c15c650 2024-05-30T06:52:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b63400640 1 -- 172.21.15.37:0/1592445572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c0c6f20 con 0x7f3b5c15c650 2024-05-30T06:52:16.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.020+0000 7f3b63400640 1 -- 172.21.15.37:0/1592445572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c0cd620 con 0x7f3b5c15c650 2024-05-30T06:52:16.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.024+0000 7f3b63400640 1 -- 172.21.15.37:0/1592445572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c068bc0 con 0x7f3b5c15c650 2024-05-30T06:52:16.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.028+0000 7f3b59600640 1 -- 172.21.15.37:0/1592445572 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f3b44004bd0 con 0x7f3b5c15c650 2024-05-30T06:52:16.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.028+0000 7f3b59600640 1 --2- 172.21.15.37:0/1592445572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b380694f0 0x7f3b3806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:16.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.028+0000 7f3b59600640 1 -- 172.21.15.37:0/1592445572 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f3b44084af0 con 0x7f3b5c15c650 2024-05-30T06:52:16.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.036+0000 7f3b59600640 1 -- 172.21.15.37:0/1592445572 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3b44056810 con 0x7f3b5c15c650 2024-05-30T06:52:16.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.040+0000 7f3b60a00640 1 --2- 172.21.15.37:0/1592445572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b380694f0 0x7f3b3806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.052+0000 7f3b60a00640 1 --2- 172.21.15.37:0/1592445572 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b380694f0 0x7f3b3806b9b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0b2000 tx=0x7f3b4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:16.380+0000 7f3b63400640 1 -- 172.21.15.37:0/1592445572 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone37108", "target": ["mon-mgr", ""]}) -- 0x7f3b5c0c7440 con 0x7f3b380694f0 2024-05-30T06:52:17.275 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:17.274+0000 7f004c600640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:17.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.308+0000 7f3b59600640 1 -- 172.21.15.37:0/1592445572 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f3b4c0a8ab0 con 0x7f3b380694f0 2024-05-30T06:52:17.314 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:17.334 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T06:52:17.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone37109 2024-05-30T06:52:17.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.564+0000 7f2247e00640 1 Processor -- start 2024-05-30T06:52:17.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.564+0000 7f2247e00640 1 -- start start 2024-05-30T06:52:17.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.568+0000 7f2247e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224806c070 0x7f224816dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:17.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.568+0000 7f2247e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22481630a0 con 0x7f2248162cc0 2024-05-30T06:52:17.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.568+0000 7f2247e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2248070d40 con 0x7f2248070900 2024-05-30T06:52:17.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.568+0000 7f2247e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f22480b5d40 con 0x7f224806c070 2024-05-30T06:52:17.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.568+0000 7f2246000640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f2248070900 0x7f224806b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:37702/0 (socket says 172.21.15.37:37702) 2024-05-30T06:52:17.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.568+0000 7f2246000640 1 -- 172.21.15.37:0/1797470807 learned_addr learned my addr 172.21.15.37:0/1797470807 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:17.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.572+0000 7f2247400640 1 --2- 172.21.15.37:0/1797470807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224806c070 0x7f224816dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.572+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279180229 0 0) 0x7f22481630a0 con 0x7f2248162cc0 2024-05-30T06:52:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.572+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f222c003530 con 0x7f2248162cc0 2024-05-30T06:52:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.572+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1646392377 0 0) 0x7f222c003530 con 0x7f2248162cc0 2024-05-30T06:52:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.572+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224806c070 msgr2=0x7f224816dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.572+0000 7f2245600640 1 --2- 172.21.15.37:0/1797470807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224806c070 0x7f224816dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.572+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 >> v1:172.21.15.105:6789/0 conn(0x7f2248070900 legacy=0x7f224806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:17.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.572+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22480d1c40 con 0x7f2248162cc0 2024-05-30T06:52:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.572+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f2238001a00 con 0x7f2248162cc0 2024-05-30T06:52:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.572+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 >> v1:172.21.15.37:6789/0 conn(0x7f2248162cc0 legacy=0x7f22480b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.572+0000 7f2245600640 1 --2- 172.21.15.37:0/1797470807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f222c0039f0 0x7f222c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.572+0000 7f2245600640 1 --2- 172.21.15.37:0/1797470807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f222c004810 0x7f222c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.576+0000 7f2245600640 1 --2- 172.21.15.37:0/1797470807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f222c0051d0 0x7f222c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.576+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f222c00c080 con 0x7f222c0039f0 2024-05-30T06:52:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.576+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f222c00c230 con 0x7f222c0051d0 2024-05-30T06:52:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.576+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f222c00c430 con 0x7f222c004810 2024-05-30T06:52:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.576+0000 7f2247400640 1 --2- 172.21.15.37:0/1797470807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f224806c070 0x7f224816dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:52:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.576+0000 7f2247400640 1 --2- 172.21.15.37:0/1797470807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f222c0051d0 0x7f222c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.576+0000 7f2246a00640 1 --2- 172.21.15.37:0/1797470807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f222c0039f0 0x7f222c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.576+0000 7f2246a00640 1 -- 172.21.15.37:0/1797470807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f222c004810 msgr2=0x7f222c004c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T06:52:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.576+0000 7f2246a00640 1 --2- 172.21.15.37:0/1797470807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f222c004810 0x7f222c004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.576+0000 7f2246a00640 1 -- 172.21.15.37:0/1797470807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f222c0051d0 msgr2=0x7f222c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.576+0000 7f2246a00640 1 --2- 172.21.15.37:0/1797470807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f222c0051d0 0x7f222c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.576+0000 7f2246a00640 1 -- 172.21.15.37:0/1797470807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222c003530 con 0x7f222c0039f0 2024-05-30T06:52:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.588+0000 7f2246a00640 1 --2- 172.21.15.37:0/1797470807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f222c0039f0 0x7f222c003e10 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f223800c4c0 tx=0x7f223801f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704bc8863d86442a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.588+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223800c0e0 con 0x7f222c0039f0 2024-05-30T06:52:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.588+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2238006d60 con 0x7f222c0039f0 2024-05-30T06:52:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.588+0000 7f2245600640 1 -- 172.21.15.37:0/1797470807 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223800c0e0 con 0x7f222c0039f0 2024-05-30T06:52:17.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.588+0000 7f2247e00640 1 -- 172.21.15.37:0/1797470807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f222c0039f0 msgr2=0x7f222c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:17.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.588+0000 7f2247e00640 1 --2- 172.21.15.37:0/1797470807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f222c0039f0 0x7f222c003e10 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f223800c4c0 tx=0x7f223801f5e0 comp rx=0 tx=0).stop 2024-05-30T06:52:17.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.592+0000 7f2247400640 1 -- 172.21.15.37:0/1797470807 reap_dead start 2024-05-30T06:52:17.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.592+0000 7f2247e00640 1 -- 172.21.15.37:0/1797470807 shutdown_connections 2024-05-30T06:52:17.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.592+0000 7f2247e00640 1 -- 172.21.15.37:0/1797470807 >> 172.21.15.37:0/1797470807 conn(0x7f224809aa60 msgr2=0x7f22480b6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:17.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.592+0000 7f2247e00640 1 -- 172.21.15.37:0/1797470807 shutdown_connections 2024-05-30T06:52:17.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.592+0000 7f2247e00640 1 -- 172.21.15.37:0/1797470807 wait complete. 2024-05-30T06:52:17.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.596+0000 7f2247e00640 1 Processor -- start 2024-05-30T06:52:17.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.596+0000 7f2247e00640 1 -- start start 2024-05-30T06:52:17.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.596+0000 7f2247e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f224814a3c0 0x7f2248159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2247e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f224814a7a0 0x7f2248162070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2247e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2248154fc0 0x7f2248155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2247e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22480b5f70 con 0x7f224814a3c0 2024-05-30T06:52:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2247e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f22480d2200 con 0x7f224814a7a0 2024-05-30T06:52:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2247e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f22480b6490 con 0x7f2248154fc0 2024-05-30T06:52:17.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2246a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f224814a3c0 0x7f2248159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:17.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2246a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f224814a3c0 0x7f2248159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55574/0 (socket says 172.21.15.37:55574) 2024-05-30T06:52:17.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2246a00640 1 -- 172.21.15.37:0/2131560959 learned_addr learned my addr 172.21.15.37:0/2131560959 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:17.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2246000640 1 --2- 172.21.15.37:0/2131560959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f224814a7a0 0x7f2248162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2246a00640 1 -- 172.21.15.37:0/2131560959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2248154fc0 msgr2=0x7f2248155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2246a00640 1 --2- 172.21.15.37:0/2131560959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2248154fc0 0x7f2248155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2246a00640 1 -- 172.21.15.37:0/2131560959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f224814a7a0 msgr2=0x7f2248162070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2246a00640 1 --2- 172.21.15.37:0/2131560959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f224814a7a0 0x7f2248162070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.600+0000 7f2246a00640 1 -- 172.21.15.37:0/2131560959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2248163290 con 0x7f224814a3c0 2024-05-30T06:52:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.604+0000 7f2246a00640 1 --2- 172.21.15.37:0/2131560959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f224814a3c0 0x7f2248159fa0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f223801fe80 tx=0x7f222c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.604+0000 7f223ea00640 1 -- 172.21.15.37:0/2131560959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22380bf070 con 0x7f224814a3c0 2024-05-30T06:52:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.604+0000 7f223ea00640 1 -- 172.21.15.37:0/2131560959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2238003980 con 0x7f224814a3c0 2024-05-30T06:52:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.604+0000 7f223ea00640 1 -- 172.21.15.37:0/2131560959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2238003d70 con 0x7f224814a3c0 2024-05-30T06:52:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.604+0000 7f2247e00640 1 -- 172.21.15.37:0/2131560959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2248163570 con 0x7f224814a3c0 2024-05-30T06:52:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.604+0000 7f2247e00640 1 -- 172.21.15.37:0/2131560959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2248163b30 con 0x7f224814a3c0 2024-05-30T06:52:17.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.608+0000 7f2247e00640 1 -- 172.21.15.37:0/2131560959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2248075580 con 0x7f224814a3c0 2024-05-30T06:52:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.620+0000 7f223ea00640 1 -- 172.21.15.37:0/2131560959 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f22380c2070 con 0x7f224814a3c0 2024-05-30T06:52:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.624+0000 7f223ea00640 1 --2- 172.21.15.37:0/2131560959 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22280695f0 0x7f222806bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.624+0000 7f223ea00640 1 -- 172.21.15.37:0/2131560959 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f2238122bd0 con 0x7f224814a3c0 2024-05-30T06:52:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.632+0000 7f223ea00640 1 -- 172.21.15.37:0/2131560959 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2238122e20 con 0x7f224814a3c0 2024-05-30T06:52:17.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.640+0000 7f2246000640 1 --2- 172.21.15.37:0/2131560959 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22280695f0 0x7f222806bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:17.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.656+0000 7f2246000640 1 --2- 172.21.15.37:0/2131560959 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22280695f0 0x7f222806bab0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f224815a810 tx=0x7f2234009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:17.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:17.992+0000 7f2247e00640 1 -- 172.21.15.37:0/2131560959 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone37109", "target": ["mon-mgr", ""]}) -- 0x7f2248161050 con 0x7f22280695f0 2024-05-30T06:52:19.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.072+0000 7f223ea00640 1 -- 172.21.15.37:0/2131560959 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2248161050 con 0x7f22280695f0 2024-05-30T06:52:19.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.080+0000 7f2247e00640 1 -- 172.21.15.37:0/2131560959 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22280695f0 msgr2=0x7f222806bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:19.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.080+0000 7f2247e00640 1 --2- 172.21.15.37:0/2131560959 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22280695f0 0x7f222806bab0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f224815a810 tx=0x7f2234009040 comp rx=0 tx=0).stop 2024-05-30T06:52:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.080+0000 7f2247e00640 1 -- 172.21.15.37:0/2131560959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f224814a3c0 msgr2=0x7f2248159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.080+0000 7f2247e00640 1 --2- 172.21.15.37:0/2131560959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f224814a3c0 0x7f2248159fa0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f223801fe80 tx=0x7f222c005840 comp rx=0 tx=0).stop 2024-05-30T06:52:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.080+0000 7f2247e00640 1 -- 172.21.15.37:0/2131560959 shutdown_connections 2024-05-30T06:52:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.080+0000 7f2247e00640 1 --2- 172.21.15.37:0/2131560959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2248154fc0 0x7f2248155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.080+0000 7f2247e00640 1 --2- 172.21.15.37:0/2131560959 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22280695f0 0x7f222806bab0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.080+0000 7f2247e00640 1 --2- 172.21.15.37:0/2131560959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f224814a7a0 0x7f2248162070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.080+0000 7f2247e00640 1 --2- 172.21.15.37:0/2131560959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f224814a3c0 0x7f2248159fa0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:19.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.080+0000 7f2247e00640 1 -- 172.21.15.37:0/2131560959 >> 172.21.15.37:0/2131560959 conn(0x7f224809aa60 msgr2=0x7f22480b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:19.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.080+0000 7f2247e00640 1 -- 172.21.15.37:0/2131560959 shutdown_connections 2024-05-30T06:52:19.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.084+0000 7f2247e00640 1 -- 172.21.15.37:0/2131560959 wait complete. 2024-05-30T06:52:19.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone371010 2024-05-30T06:52:19.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.328+0000 7f0b36c00640 1 Processor -- start 2024-05-30T06:52:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.328+0000 7f0b36c00640 1 -- start start 2024-05-30T06:52:19.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.332+0000 7f0b36c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b300cf7e0 0x7f0b3016dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:19.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.332+0000 7f0b36c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b300ccfc0 con 0x7f0b30162e70 2024-05-30T06:52:19.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.332+0000 7f0b36c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b30164190 con 0x7f0b30163250 2024-05-30T06:52:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.332+0000 7f0b36c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0b3006f8e0 con 0x7f0b300cf7e0 2024-05-30T06:52:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.332+0000 7f0b34c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b300cf7e0 0x7f0b3016dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.332+0000 7f0b34c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b300cf7e0 0x7f0b3016dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55584/0 (socket says 172.21.15.37:55584) 2024-05-30T06:52:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.332+0000 7f0b34c00640 1 -- 172.21.15.37:0/2519861693 learned_addr learned my addr 172.21.15.37:0/2519861693 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.332+0000 7f0b34c00640 1 -- 172.21.15.37:0/2519861693 >> v1:172.21.15.105:6789/0 conn(0x7f0b30163250 legacy=0x7f0b301636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.332+0000 7f0b34c00640 1 -- 172.21.15.37:0/2519861693 >> v1:172.21.15.37:6789/0 conn(0x7f0b30162e70 legacy=0x7f0b300cc8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-30T06:52:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.332+0000 7f0b34c00640 1 -- 172.21.15.37:0/2519861693 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3006ecd0 con 0x7f0b300cf7e0 2024-05-30T06:52:19.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.336+0000 7f0b34c00640 1 --2- 172.21.15.37:0/2519861693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b300cf7e0 0x7f0b3016dc30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009e50 tx=0x7f0b2801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249e2e480768e1ac server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.340+0000 7f0b2ea00640 1 -- 172.21.15.37:0/2519861693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b280a57b0 con 0x7f0b300cf7e0 2024-05-30T06:52:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.340+0000 7f0b2ea00640 1 -- 172.21.15.37:0/2519861693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b280a5950 con 0x7f0b300cf7e0 2024-05-30T06:52:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.340+0000 7f0b2ea00640 1 -- 172.21.15.37:0/2519861693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b280a5d20 con 0x7f0b300cf7e0 2024-05-30T06:52:19.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.340+0000 7f0b36c00640 1 -- 172.21.15.37:0/2519861693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b300cf7e0 msgr2=0x7f0b3016dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:19.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.340+0000 7f0b36c00640 1 --2- 172.21.15.37:0/2519861693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b300cf7e0 0x7f0b3016dc30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009e50 tx=0x7f0b2801c8f0 comp rx=0 tx=0).stop 2024-05-30T06:52:19.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.340+0000 7f0b36c00640 1 -- 172.21.15.37:0/2519861693 shutdown_connections 2024-05-30T06:52:19.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.340+0000 7f0b36c00640 1 --2- 172.21.15.37:0/2519861693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b300cf7e0 0x7f0b3016dc30 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:19.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.340+0000 7f0b36c00640 1 -- 172.21.15.37:0/2519861693 >> 172.21.15.37:0/2519861693 conn(0x7f0b3006bf60 msgr2=0x7f0b300b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:19.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.340+0000 7f0b36c00640 1 -- 172.21.15.37:0/2519861693 shutdown_connections 2024-05-30T06:52:19.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.340+0000 7f0b36c00640 1 -- 172.21.15.37:0/2519861693 wait complete. 2024-05-30T06:52:19.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.344+0000 7f0b36c00640 1 Processor -- start 2024-05-30T06:52:19.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.344+0000 7f0b36c00640 1 -- start start 2024-05-30T06:52:19.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b36c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b300cf7e0 0x7f0b30168a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:19.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b36c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b30162e70 0x7f0b30169540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:19.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b36c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b30163250 0x7f0b30156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:19.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b36c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b30170990 con 0x7f0b30162e70 2024-05-30T06:52:19.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b36c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3006e960 con 0x7f0b30163250 2024-05-30T06:52:19.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b36c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0b30170b10 con 0x7f0b300cf7e0 2024-05-30T06:52:19.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b2fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b300cf7e0 0x7f0b30168a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:19.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b2f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b30162e70 0x7f0b30169540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:19.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b2fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b300cf7e0 0x7f0b30168a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:43680/0 (socket says 172.21.15.37:43680) 2024-05-30T06:52:19.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b2fe00640 1 -- 172.21.15.37:0/294097133 learned_addr learned my addr 172.21.15.37:0/294097133 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:19.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b2f400640 1 -- 172.21.15.37:0/294097133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b300cf7e0 msgr2=0x7f0b30168a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:19.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b2f400640 1 --2- 172.21.15.37:0/294097133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b300cf7e0 0x7f0b30168a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:19.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b2f400640 1 -- 172.21.15.37:0/294097133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b30163250 msgr2=0x7f0b30156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:19.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b2f400640 1 --2- 172.21.15.37:0/294097133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b30163250 0x7f0b30156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b2f400640 1 -- 172.21.15.37:0/294097133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b30169c40 con 0x7f0b30162e70 2024-05-30T06:52:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b2f400640 1 --2- 172.21.15.37:0/294097133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b30162e70 0x7f0b30169540 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000b410 tx=0x7f0b2000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:19.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.348+0000 7f0b27e00640 1 -- 172.21.15.37:0/294097133 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20015020 con 0x7f0b30162e70 2024-05-30T06:52:19.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.352+0000 7f0b27e00640 1 -- 172.21.15.37:0/294097133 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b20011830 con 0x7f0b30162e70 2024-05-30T06:52:19.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.352+0000 7f0b36c00640 1 -- 172.21.15.37:0/294097133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b30169f20 con 0x7f0b30162e70 2024-05-30T06:52:19.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.352+0000 7f0b27e00640 1 -- 172.21.15.37:0/294097133 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20011c20 con 0x7f0b30162e70 2024-05-30T06:52:19.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.352+0000 7f0b36c00640 1 -- 172.21.15.37:0/294097133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b3016a4e0 con 0x7f0b30162e70 2024-05-30T06:52:19.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.352+0000 7f0b36c00640 1 -- 172.21.15.37:0/294097133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b30068bc0 con 0x7f0b30162e70 2024-05-30T06:52:19.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.356+0000 7f0b27e00640 1 -- 172.21.15.37:0/294097133 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f0b20018020 con 0x7f0b30162e70 2024-05-30T06:52:19.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.356+0000 7f0b27e00640 1 --2- 172.21.15.37:0/294097133 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0b100695f0 0x7f0b1006bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:19.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.356+0000 7f0b27e00640 1 -- 172.21.15.37:0/294097133 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f0b20085140 con 0x7f0b30162e70 2024-05-30T06:52:19.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.360+0000 7f0b2fe00640 1 --2- 172.21.15.37:0/294097133 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0b100695f0 0x7f0b1006bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:19.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.360+0000 7f0b2fe00640 1 --2- 172.21.15.37:0/294097133 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0b100695f0 0x7f0b1006bab0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c001960 tx=0x7f0b1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:19.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.364+0000 7f0b27e00640 1 -- 172.21.15.37:0/294097133 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b2001f070 con 0x7f0b30162e70 2024-05-30T06:52:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:19.728+0000 7f0b36c00640 1 -- 172.21.15.37:0/294097133 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone371010", "target": ["mon-mgr", ""]}) -- 0x7f0b300b30b0 con 0x7f0b100695f0 2024-05-30T06:52:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.036+0000 7f0b27e00640 1 -- 172.21.15.37:0/294097133 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0b300b30b0 con 0x7f0b100695f0 2024-05-30T06:52:21.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.048+0000 7f0b36c00640 1 -- 172.21.15.37:0/294097133 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0b100695f0 msgr2=0x7f0b1006bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:21.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.048+0000 7f0b36c00640 1 --2- 172.21.15.37:0/294097133 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0b100695f0 0x7f0b1006bab0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c001960 tx=0x7f0b1c009040 comp rx=0 tx=0).stop 2024-05-30T06:52:21.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.048+0000 7f0b36c00640 1 -- 172.21.15.37:0/294097133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b30162e70 msgr2=0x7f0b30169540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:21.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.048+0000 7f0b36c00640 1 --2- 172.21.15.37:0/294097133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b30162e70 0x7f0b30169540 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0b2000b410 tx=0x7f0b2000b8d0 comp rx=0 tx=0).stop 2024-05-30T06:52:21.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.048+0000 7f0b36c00640 1 -- 172.21.15.37:0/294097133 shutdown_connections 2024-05-30T06:52:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.048+0000 7f0b36c00640 1 --2- 172.21.15.37:0/294097133 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0b100695f0 0x7f0b1006bab0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.048+0000 7f0b36c00640 1 --2- 172.21.15.37:0/294097133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b30163250 0x7f0b30156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.048+0000 7f0b36c00640 1 --2- 172.21.15.37:0/294097133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b30162e70 0x7f0b30169540 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.048+0000 7f0b36c00640 1 --2- 172.21.15.37:0/294097133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b300cf7e0 0x7f0b30168a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.048+0000 7f0b36c00640 1 -- 172.21.15.37:0/294097133 >> 172.21.15.37:0/294097133 conn(0x7f0b3006bf60 msgr2=0x7f0b30074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.048+0000 7f0b36c00640 1 -- 172.21.15.37:0/294097133 shutdown_connections 2024-05-30T06:52:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.048+0000 7f0b36c00640 1 -- 172.21.15.37:0/294097133 wait complete. 2024-05-30T06:52:21.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone371011 2024-05-30T06:52:21.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.396+0000 7fd3c2c00640 1 Processor -- start 2024-05-30T06:52:21.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.396+0000 7fd3c2c00640 1 -- start start 2024-05-30T06:52:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.400+0000 7fd3c2c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3bc0cd5f0 0x7fd3bc0cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.400+0000 7fd3c2c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3bc09aff0 con 0x7fd3bc0b2b80 2024-05-30T06:52:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.400+0000 7fd3c2c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3bc06bcd0 con 0x7fd3bc15ea50 2024-05-30T06:52:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.400+0000 7fd3c2c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd3bc0b0bf0 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.400+0000 7fd3c0e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd3bc0b2b80 0x7fd3bc0b1080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47836/0 (socket says 172.21.15.37:47836) 2024-05-30T06:52:21.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.400+0000 7fd3c0e00640 1 -- 172.21.15.37:0/3011837814 learned_addr learned my addr 172.21.15.37:0/3011837814 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:21.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.400+0000 7fd3c2200640 1 --2- 172.21.15.37:0/3011837814 >> v2:172.21.15.37:3300/0 conn(0x7fd3bc0cd5f0 0x7fd3bc0cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:21.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.400+0000 7fd3c2200640 1 -- 172.21.15.37:0/3011837814 >> v1:172.21.15.105:6789/0 conn(0x7fd3bc15ea50 legacy=0x7fd3bc0d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:21.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.400+0000 7fd3c2200640 1 -- 172.21.15.37:0/3011837814 >> v1:172.21.15.37:6789/0 conn(0x7fd3bc0b2b80 legacy=0x7fd3bc0b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:21.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.400+0000 7fd3bbe00640 1 -- 172.21.15.37:0/3011837814 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1075892111 0 0) 0x7fd3bc09aff0 con 0x7fd3bc0b2b80 2024-05-30T06:52:21.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.400+0000 7fd3c2200640 1 -- 172.21.15.37:0/3011837814 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3bc06bfb0 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.404+0000 7fd3c2200640 1 --2- 172.21.15.37:0/3011837814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3bc0cd5f0 0x7fd3bc0cba60 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4009d90 tx=0x7fd3b401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1648213b5d6f67 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:21.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.404+0000 7fd3bbe00640 1 -- 172.21.15.37:0/3011837814 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40b2070 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.404+0000 7fd3bbe00640 1 -- 172.21.15.37:0/3011837814 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b40a59e0 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.408+0000 7fd3bbe00640 1 -- 172.21.15.37:0/3011837814 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40a5db0 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.408+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3011837814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3bc0cd5f0 msgr2=0x7fd3bc0cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:21.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.408+0000 7fd3c2c00640 1 --2- 172.21.15.37:0/3011837814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3bc0cd5f0 0x7fd3bc0cba60 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4009d90 tx=0x7fd3b401c900 comp rx=0 tx=0).stop 2024-05-30T06:52:21.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.408+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3011837814 shutdown_connections 2024-05-30T06:52:21.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.408+0000 7fd3c2c00640 1 --2- 172.21.15.37:0/3011837814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3bc0cd5f0 0x7fd3bc0cba60 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:21.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.408+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3011837814 >> 172.21.15.37:0/3011837814 conn(0x7fd3bc09aa60 msgr2=0x7fd3bc0b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:21.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.408+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3011837814 shutdown_connections 2024-05-30T06:52:21.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.408+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3011837814 wait complete. 2024-05-30T06:52:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.408+0000 7fd3c2c00640 1 Processor -- start 2024-05-30T06:52:21.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.408+0000 7fd3c2c00640 1 -- start start 2024-05-30T06:52:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c2c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3bc0b2b80 0x7fd3bc1fb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c2c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3bc0cd5f0 0x7fd3bc1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c2c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3bc15ea50 0x7fd3bc155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c2c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc0b1ba0 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c2c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc06b960 con 0x7fd3bc15ea50 2024-05-30T06:52:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c2c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd3bc0b1d20 con 0x7fd3bc0b2b80 2024-05-30T06:52:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3bc0cd5f0 0x7fd3bc1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3bc0cd5f0 0x7fd3bc1553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55614/0 (socket says 172.21.15.37:55614) 2024-05-30T06:52:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c0e00640 1 -- 172.21.15.37:0/3296378847 learned_addr learned my addr 172.21.15.37:0/3296378847 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c0e00640 1 -- 172.21.15.37:0/3296378847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3bc0b2b80 msgr2=0x7fd3bc1fb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c0e00640 1 --2- 172.21.15.37:0/3296378847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3bc0b2b80 0x7fd3bc1fb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c0e00640 1 -- 172.21.15.37:0/3296378847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3bc15ea50 msgr2=0x7fd3bc155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c0e00640 1 --2- 172.21.15.37:0/3296378847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3bc15ea50 0x7fd3bc155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c0e00640 1 -- 172.21.15.37:0/3296378847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3bc0b5f60 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c0e00640 1 --2- 172.21.15.37:0/3296378847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3bc0cd5f0 0x7fd3bc1553d0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800c450 tx=0x7fd3a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3b9600640 1 -- 172.21.15.37:0/3296378847 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8018070 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3b9600640 1 -- 172.21.15.37:0/3296378847 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a80074e0 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3b9600640 1 -- 172.21.15.37:0/3296378847 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a80049f0 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3296378847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3bc0b6240 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3296378847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3bc14b500 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.412+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3296378847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3bc068ab0 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.416+0000 7fd3b9600640 1 -- 172.21.15.37:0/3296378847 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7fd3a801b070 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.416+0000 7fd3b9600640 1 --2- 172.21.15.37:0/3296378847 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd39c0694f0 0x7fd39c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:21.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.416+0000 7fd3b9600640 1 -- 172.21.15.37:0/3296378847 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fd3a8084c40 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.424+0000 7fd3b9600640 1 -- 172.21.15.37:0/3296378847 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd3a8056900 con 0x7fd3bc0cd5f0 2024-05-30T06:52:21.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.440+0000 7fd3c1800640 1 --2- 172.21.15.37:0/3296378847 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd39c0694f0 0x7fd39c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:21.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.448+0000 7fd3c1800640 1 --2- 172.21.15.37:0/3296378847 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd39c0694f0 0x7fd39c06b9b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0007fd0 tx=0x7fd3b00079a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:21.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:21.776+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3296378847 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone371011", "target": ["mon-mgr", ""]}) -- 0x7fd3bc06eae0 con 0x7fd39c0694f0 2024-05-30T06:52:23.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.096+0000 7fd3b9600640 1 -- 172.21.15.37:0/3296378847 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd3bc06eae0 con 0x7fd39c0694f0 2024-05-30T06:52:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.100+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3296378847 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd39c0694f0 msgr2=0x7fd39c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.100+0000 7fd3c2c00640 1 --2- 172.21.15.37:0/3296378847 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd39c0694f0 0x7fd39c06b9b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0007fd0 tx=0x7fd3b00079a0 comp rx=0 tx=0).stop 2024-05-30T06:52:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.100+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3296378847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3bc0cd5f0 msgr2=0x7fd3bc1553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.100+0000 7fd3c2c00640 1 --2- 172.21.15.37:0/3296378847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3bc0cd5f0 0x7fd3bc1553d0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800c450 tx=0x7fd3a800c910 comp rx=0 tx=0).stop 2024-05-30T06:52:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.100+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3296378847 shutdown_connections 2024-05-30T06:52:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.100+0000 7fd3c2c00640 1 --2- 172.21.15.37:0/3296378847 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd39c0694f0 0x7fd39c06b9b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.100+0000 7fd3c2c00640 1 --2- 172.21.15.37:0/3296378847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3bc15ea50 0x7fd3bc155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.100+0000 7fd3c2c00640 1 --2- 172.21.15.37:0/3296378847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3bc0cd5f0 0x7fd3bc1553d0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.100+0000 7fd3c2c00640 1 --2- 172.21.15.37:0/3296378847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3bc0b2b80 0x7fd3bc1fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.100+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3296378847 >> 172.21.15.37:0/3296378847 conn(0x7fd3bc09aa60 msgr2=0x7fd3bc06fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:23.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.100+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3296378847 shutdown_connections 2024-05-30T06:52:23.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.104+0000 7fd3c2c00640 1 -- 172.21.15.37:0/3296378847 wait complete. 2024-05-30T06:52:23.146 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone371012 2024-05-30T06:52:23.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.396+0000 7fd884200640 1 Processor -- start 2024-05-30T06:52:23.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.396+0000 7fd884200640 1 -- start start 2024-05-30T06:52:23.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd884200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd87c0b5370 0x7fd87c15ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:23.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd884200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd87c0cf4b0 0x7fd87c0cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:23.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd884200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd87c15d820 con 0x7fd87c072750 2024-05-30T06:52:23.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd884200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd87c0cf020 con 0x7fd87c0b5370 2024-05-30T06:52:23.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd884200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd87c15db00 con 0x7fd87c0cf4b0 2024-05-30T06:52:23.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd881800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd87c072750 0x7fd87c072b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47846/0 (socket says 172.21.15.37:47846) 2024-05-30T06:52:23.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd881800640 1 -- 172.21.15.37:0/306693635 learned_addr learned my addr 172.21.15.37:0/306693635 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:23.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd880e00640 1 --2- 172.21.15.37:0/306693635 >> v2:172.21.15.105:3300/0 conn(0x7fd87c0b5370 0x7fd87c15ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:23.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd882200640 1 --2- 172.21.15.37:0/306693635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd87c0cf4b0 0x7fd87c0cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:23.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3430249526 0 0) 0x7fd87c15d820 con 0x7fd87c072750 2024-05-30T06:52:23.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd864003530 con 0x7fd87c072750 2024-05-30T06:52:23.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2918192316 0 0) 0x7fd864003530 con 0x7fd87c072750 2024-05-30T06:52:23.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd87c0cf4b0 msgr2=0x7fd87c0cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:23.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 --2- 172.21.15.37:0/306693635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd87c0cf4b0 0x7fd87c0cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:23.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 >> v2:172.21.15.105:3300/0 conn(0x7fd87c0b5370 msgr2=0x7fd87c15ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:23.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 --2- 172.21.15.37:0/306693635 >> v2:172.21.15.105:3300/0 conn(0x7fd87c0b5370 0x7fd87c15ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:23.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87c15dde0 con 0x7fd87c072750 2024-05-30T06:52:23.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fd870001680 con 0x7fd87c072750 2024-05-30T06:52:23.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 >> v1:172.21.15.37:6789/0 conn(0x7fd87c072750 legacy=0x7fd87c072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:23.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 --2- 172.21.15.37:0/306693635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd87c0cf4b0 0x7fd8640039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:23.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 --2- 172.21.15.37:0/306693635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd864003ff0 0x7fd864004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:23.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 --2- 172.21.15.37:0/306693635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd864004d50 0x7fd8640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:23.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c0cf020 con 0x7fd864004d50 2024-05-30T06:52:23.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c15db00 con 0x7fd864003ff0 2024-05-30T06:52:23.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd86400bad0 con 0x7fd87c0cf4b0 2024-05-30T06:52:23.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd882200640 1 --2- 172.21.15.37:0/306693635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd864004d50 0x7fd8640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd881800640 1 --2- 172.21.15.37:0/306693635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd87c0cf4b0 0x7fd8640039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd882200640 1 -- 172.21.15.37:0/306693635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd87c0cf4b0 msgr2=0x7fd8640039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd882200640 1 --2- 172.21.15.37:0/306693635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd87c0cf4b0 0x7fd8640039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd882200640 1 -- 172.21.15.37:0/306693635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd864003ff0 msgr2=0x7fd864004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd882200640 1 --2- 172.21.15.37:0/306693635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd864003ff0 0x7fd864004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.400+0000 7fd882200640 1 -- 172.21.15.37:0/306693635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd864003530 con 0x7fd864004d50 2024-05-30T06:52:23.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.404+0000 7fd882200640 1 --2- 172.21.15.37:0/306693635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd864004d50 0x7fd8640051d0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd874007360 tx=0x7fd87401ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea3d99ed3bd0be2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.408+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8740b2070 con 0x7fd864004d50 2024-05-30T06:52:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.408+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8740a5d40 con 0x7fd864004d50 2024-05-30T06:52:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.408+0000 7fd87be00640 1 -- 172.21.15.37:0/306693635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874009be0 con 0x7fd864004d50 2024-05-30T06:52:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.408+0000 7fd884200640 1 -- 172.21.15.37:0/306693635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd864004d50 msgr2=0x7fd8640051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.408+0000 7fd884200640 1 --2- 172.21.15.37:0/306693635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd864004d50 0x7fd8640051d0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd874007360 tx=0x7fd87401ce40 comp rx=0 tx=0).stop 2024-05-30T06:52:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.408+0000 7fd882200640 1 -- 172.21.15.37:0/306693635 reap_dead start 2024-05-30T06:52:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.408+0000 7fd884200640 1 -- 172.21.15.37:0/306693635 shutdown_connections 2024-05-30T06:52:23.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.408+0000 7fd884200640 1 -- 172.21.15.37:0/306693635 >> 172.21.15.37:0/306693635 conn(0x7fd87c0b2ac0 msgr2=0x7fd87c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:23.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.408+0000 7fd884200640 1 -- 172.21.15.37:0/306693635 shutdown_connections 2024-05-30T06:52:23.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.408+0000 7fd884200640 1 -- 172.21.15.37:0/306693635 wait complete. 2024-05-30T06:52:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd884200640 1 Processor -- start 2024-05-30T06:52:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd884200640 1 -- start start 2024-05-30T06:52:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd884200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd864004d50 0x7fd87c1550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd884200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c1e7af0 0x7fd87c1e7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd884200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd87c06e4d0 0x7fd87c06e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd884200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c15d590 con 0x7fd87c1e7af0 2024-05-30T06:52:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd884200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd87c15d410 con 0x7fd87c06e4d0 2024-05-30T06:52:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd884200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd87c1571c0 con 0x7fd864004d50 2024-05-30T06:52:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd880e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c1e7af0 0x7fd87c1e7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd880e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c1e7af0 0x7fd87c1e7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55636/0 (socket says 172.21.15.37:55636) 2024-05-30T06:52:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd880e00640 1 -- 172.21.15.37:0/4267071460 learned_addr learned my addr 172.21.15.37:0/4267071460 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:23.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd880e00640 1 -- 172.21.15.37:0/4267071460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd864004d50 msgr2=0x7fd87c1550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:23.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd880e00640 1 --2- 172.21.15.37:0/4267071460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd864004d50 0x7fd87c1550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:23.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd880e00640 1 -- 172.21.15.37:0/4267071460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd87c06e4d0 msgr2=0x7fd87c06e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:23.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd880e00640 1 --2- 172.21.15.37:0/4267071460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd87c06e4d0 0x7fd87c06e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:23.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd880e00640 1 -- 172.21.15.37:0/4267071460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87c155610 con 0x7fd87c1e7af0 2024-05-30T06:52:23.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd880e00640 1 --2- 172.21.15.37:0/4267071460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87c1e7af0 0x7fd87c1e7f50 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fd86800d800 tx=0x7fd86800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:23.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd879600640 1 -- 172.21.15.37:0/4267071460 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86800b640 con 0x7fd87c1e7af0 2024-05-30T06:52:23.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.412+0000 7fd884200640 1 -- 172.21.15.37:0/4267071460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd87c06f240 con 0x7fd87c1e7af0 2024-05-30T06:52:23.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.416+0000 7fd879600640 1 -- 172.21.15.37:0/4267071460 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd868019070 con 0x7fd87c1e7af0 2024-05-30T06:52:23.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.416+0000 7fd879600640 1 -- 172.21.15.37:0/4267071460 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86800ba20 con 0x7fd87c1e7af0 2024-05-30T06:52:23.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.416+0000 7fd884200640 1 -- 172.21.15.37:0/4267071460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd87c06f800 con 0x7fd87c1e7af0 2024-05-30T06:52:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.416+0000 7fd884200640 1 -- 172.21.15.37:0/4267071460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd87c068bc0 con 0x7fd87c1e7af0 2024-05-30T06:52:23.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.416+0000 7fd879600640 1 -- 172.21.15.37:0/4267071460 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7fd86800bbc0 con 0x7fd87c1e7af0 2024-05-30T06:52:23.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.416+0000 7fd879600640 1 --2- 172.21.15.37:0/4267071460 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd85c069520 0x7fd85c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:23.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.420+0000 7fd879600640 1 -- 172.21.15.37:0/4267071460 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fd868085d30 con 0x7fd87c1e7af0 2024-05-30T06:52:23.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.424+0000 7fd879600640 1 -- 172.21.15.37:0/4267071460 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd8680579c0 con 0x7fd87c1e7af0 2024-05-30T06:52:23.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.428+0000 7fd881800640 1 --2- 172.21.15.37:0/4267071460 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd85c069520 0x7fd85c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:23.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.432+0000 7fd881800640 1 --2- 172.21.15.37:0/4267071460 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd85c069520 0x7fd85c06b9e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd8700059e0 tx=0x7fd870000ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:23.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:23.776+0000 7fd884200640 1 -- 172.21.15.37:0/4267071460 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone371012", "target": ["mon-mgr", ""]}) -- 0x7fd87c067ee0 con 0x7fd85c069520 2024-05-30T06:52:23.992 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:52:23.990+0000 7f004c600640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:24.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.000+0000 7fd879600640 1 -- 172.21.15.37:0/4267071460 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7fd87c067ee0 con 0x7fd85c069520 2024-05-30T06:52:24.002 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T06:52:24.014 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T06:52:24.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone371013 2024-05-30T06:52:24.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f1695c00640 1 Processor -- start 2024-05-30T06:52:24.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f1695c00640 1 -- start start 2024-05-30T06:52:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f1695c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f16900b59d0 0x7f16900b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f1695c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f169015d7e0 0x7f1690160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f1695c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16900b62f0 con 0x7f169015d350 2024-05-30T06:52:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f1695c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1690142030 con 0x7f16900b59d0 2024-05-30T06:52:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f1695c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1690142310 con 0x7f169015d7e0 2024-05-30T06:52:24.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f1686000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f169015d350 0x7f1690160280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47852/0 (socket says 172.21.15.37:47852) 2024-05-30T06:52:24.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f1686000640 1 -- 172.21.15.37:0/2801559678 learned_addr learned my addr 172.21.15.37:0/2801559678 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 829389178 0 0) 0x7f16900b62f0 con 0x7f169015d350 2024-05-30T06:52:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1674003530 con 0x7f169015d350 2024-05-30T06:52:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 166045212 0 0) 0x7f1674003530 con 0x7f169015d350 2024-05-30T06:52:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f169015d7e0 msgr2=0x7f1690160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f168e000640 1 --2- 172.21.15.37:0/2801559678 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f169015d7e0 0x7f1690160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 >> v2:172.21.15.105:3300/0 conn(0x7f16900b59d0 msgr2=0x7f16900b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.244+0000 7f168e000640 1 --2- 172.21.15.37:0/2801559678 >> v2:172.21.15.105:3300/0 conn(0x7f16900b59d0 0x7f16900b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16901425f0 con 0x7f169015d350 2024-05-30T06:52:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f1678001680 con 0x7f169015d350 2024-05-30T06:52:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 >> v1:172.21.15.37:6789/0 conn(0x7f169015d350 legacy=0x7f1690160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168e000640 1 --2- 172.21.15.37:0/2801559678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16740039c0 0x7f1674003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168e000640 1 --2- 172.21.15.37:0/2801559678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1674004810 0x7f1674004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168e000640 1 --2- 172.21.15.37:0/2801559678 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f169015d7e0 0x7f167400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1690142030 con 0x7f16740039c0 2024-05-30T06:52:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1690142310 con 0x7f1674004810 2024-05-30T06:52:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1674005640 con 0x7f169015d7e0 2024-05-30T06:52:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168ea00640 1 --2- 172.21.15.37:0/2801559678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16740039c0 0x7f1674003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168ea00640 1 -- 172.21.15.37:0/2801559678 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f169015d7e0 msgr2=0x7f167400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:24.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168ea00640 1 --2- 172.21.15.37:0/2801559678 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f169015d7e0 0x7f167400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:24.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168ea00640 1 -- 172.21.15.37:0/2801559678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1674004810 msgr2=0x7f1674004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:24.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168ea00640 1 --2- 172.21.15.37:0/2801559678 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1674004810 0x7f1674004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:24.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.248+0000 7f168ea00640 1 -- 172.21.15.37:0/2801559678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1674003530 con 0x7f16740039c0 2024-05-30T06:52:24.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.252+0000 7f168ea00640 1 --2- 172.21.15.37:0/2801559678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16740039c0 0x7f1674003de0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f1680009890 tx=0x7f168001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428589aa100d13f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:24.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.252+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16800b0070 con 0x7f16740039c0 2024-05-30T06:52:24.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.252+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16800ab620 con 0x7f16740039c0 2024-05-30T06:52:24.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.252+0000 7f168e000640 1 -- 172.21.15.37:0/2801559678 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680009460 con 0x7f16740039c0 2024-05-30T06:52:24.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.252+0000 7f1695c00640 1 -- 172.21.15.37:0/2801559678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16740039c0 msgr2=0x7f1674003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:24.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.252+0000 7f1695c00640 1 --2- 172.21.15.37:0/2801559678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16740039c0 0x7f1674003de0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f1680009890 tx=0x7f168001c360 comp rx=0 tx=0).stop 2024-05-30T06:52:24.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.252+0000 7f168f400640 1 -- 172.21.15.37:0/2801559678 reap_dead start 2024-05-30T06:52:24.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.252+0000 7f1695c00640 1 -- 172.21.15.37:0/2801559678 shutdown_connections 2024-05-30T06:52:24.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.252+0000 7f1695c00640 1 -- 172.21.15.37:0/2801559678 >> 172.21.15.37:0/2801559678 conn(0x7f169006bf60 msgr2=0x7f16900b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:24.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.252+0000 7f1695c00640 1 -- 172.21.15.37:0/2801559678 shutdown_connections 2024-05-30T06:52:24.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.252+0000 7f1695c00640 1 -- 172.21.15.37:0/2801559678 wait complete. 2024-05-30T06:52:24.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f1695c00640 1 Processor -- start 2024-05-30T06:52:24.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f1695c00640 1 -- start start 2024-05-30T06:52:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f1695c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16740039c0 0x7f169013d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f1695c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1690154e40 0x7f169015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f1695c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f16901552c0 0x7f169015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f1695c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f169013fe60 con 0x7f16740039c0 2024-05-30T06:52:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f1695c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f169013fce0 con 0x7f1690154e40 2024-05-30T06:52:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f1695c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f16900aff20 con 0x7f16901552c0 2024-05-30T06:52:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f168ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16740039c0 0x7f169013d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f168ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16740039c0 0x7f169013d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55660/0 (socket says 172.21.15.37:55660) 2024-05-30T06:52:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f168ea00640 1 -- 172.21.15.37:0/3886352080 learned_addr learned my addr 172.21.15.37:0/3886352080 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f1686000640 1 --2- 172.21.15.37:0/3886352080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1690154e40 0x7f169015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f168ea00640 1 -- 172.21.15.37:0/3886352080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f16901552c0 msgr2=0x7f169015bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f168ea00640 1 --2- 172.21.15.37:0/3886352080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f16901552c0 0x7f169015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f168ea00640 1 -- 172.21.15.37:0/3886352080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1690154e40 msgr2=0x7f169015b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f168ea00640 1 --2- 172.21.15.37:0/3886352080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1690154e40 0x7f169015b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f168ea00640 1 -- 172.21.15.37:0/3886352080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1690157400 con 0x7f16740039c0 2024-05-30T06:52:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f168ea00640 1 --2- 172.21.15.37:0/3886352080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16740039c0 0x7f169013d790 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f168001c190 tx=0x7f1674005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.256+0000 7f1687400640 1 -- 172.21.15.37:0/3886352080 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16800b0040 con 0x7f16740039c0 2024-05-30T06:52:24.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.260+0000 7f1687400640 1 -- 172.21.15.37:0/3886352080 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16800bd070 con 0x7f16740039c0 2024-05-30T06:52:24.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.260+0000 7f1687400640 1 -- 172.21.15.37:0/3886352080 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16800aba10 con 0x7f16740039c0 2024-05-30T06:52:24.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.260+0000 7f1695c00640 1 -- 172.21.15.37:0/3886352080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1690155800 con 0x7f16740039c0 2024-05-30T06:52:24.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.260+0000 7f1695c00640 1 -- 172.21.15.37:0/3886352080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1690154000 con 0x7f16740039c0 2024-05-30T06:52:24.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.260+0000 7f1695c00640 1 -- 172.21.15.37:0/3886352080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1690068bc0 con 0x7f16740039c0 2024-05-30T06:52:24.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.264+0000 7f1687400640 1 -- 172.21.15.37:0/3886352080 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f16800b3070 con 0x7f16740039c0 2024-05-30T06:52:24.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.264+0000 7f1687400640 1 --2- 172.21.15.37:0/3886352080 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f166c069520 0x7f166c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:24.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.268+0000 7f1687400640 1 -- 172.21.15.37:0/3886352080 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f168011f800 con 0x7f16740039c0 2024-05-30T06:52:24.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.272+0000 7f1686000640 1 --2- 172.21.15.37:0/3886352080 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f166c069520 0x7f166c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.272+0000 7f1687400640 1 -- 172.21.15.37:0/3886352080 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1690157400 con 0x7f16740039c0 2024-05-30T06:52:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.272+0000 7f1686000640 1 --2- 172.21.15.37:0/3886352080 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f166c069520 0x7f166c06b9e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1678000f70 tx=0x7f1678001670 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:24.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:24.580+0000 7f1695c00640 1 -- 172.21.15.37:0/3886352080 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone371013", "target": ["mon-mgr", ""]}) -- 0x7f169015c890 con 0x7f166c069520 2024-05-30T06:52:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.340+0000 7f1687400640 1 -- 172.21.15.37:0/3886352080 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f169015c890 con 0x7f166c069520 2024-05-30T06:52:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.344+0000 7f1695c00640 1 -- 172.21.15.37:0/3886352080 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f166c069520 msgr2=0x7f166c06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.344+0000 7f1695c00640 1 --2- 172.21.15.37:0/3886352080 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f166c069520 0x7f166c06b9e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1678000f70 tx=0x7f1678001670 comp rx=0 tx=0).stop 2024-05-30T06:52:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.344+0000 7f1695c00640 1 -- 172.21.15.37:0/3886352080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16740039c0 msgr2=0x7f169013d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.344+0000 7f1695c00640 1 --2- 172.21.15.37:0/3886352080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16740039c0 0x7f169013d790 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f168001c190 tx=0x7f1674005840 comp rx=0 tx=0).stop 2024-05-30T06:52:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.344+0000 7f1695c00640 1 -- 172.21.15.37:0/3886352080 shutdown_connections 2024-05-30T06:52:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.344+0000 7f1695c00640 1 --2- 172.21.15.37:0/3886352080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f16901552c0 0x7f169015bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.344+0000 7f1695c00640 1 --2- 172.21.15.37:0/3886352080 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f166c069520 0x7f166c06b9e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.344+0000 7f1695c00640 1 --2- 172.21.15.37:0/3886352080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1690154e40 0x7f169015b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.344+0000 7f1695c00640 1 --2- 172.21.15.37:0/3886352080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16740039c0 0x7f169013d790 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:25.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.344+0000 7f1695c00640 1 -- 172.21.15.37:0/3886352080 >> 172.21.15.37:0/3886352080 conn(0x7f169006bf60 msgr2=0x7f16901531b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:25.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.344+0000 7f1695c00640 1 -- 172.21.15.37:0/3886352080 shutdown_connections 2024-05-30T06:52:25.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.344+0000 7f1695c00640 1 -- 172.21.15.37:0/3886352080 wait complete. 2024-05-30T06:52:25.381 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone371014 2024-05-30T06:52:25.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.592+0000 7f9aeac00640 1 Processor -- start 2024-05-30T06:52:25.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.592+0000 7f9aeac00640 1 -- start start 2024-05-30T06:52:25.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.592+0000 7f9aeac00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9ae406c970 0x7f9ae406cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:25.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.592+0000 7f9aeac00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ae40b3ce0 0x7f9ae40b4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:25.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.592+0000 7f9aeac00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ae40cf670 con 0x7f9ae40d03f0 2024-05-30T06:52:25.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.592+0000 7f9aeac00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9ae406d290 con 0x7f9ae406c970 2024-05-30T06:52:25.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.592+0000 7f9aeac00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae40cf910 con 0x7f9ae40b3ce0 2024-05-30T06:52:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.596+0000 7f9aea200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ae40b3ce0 0x7f9ae40b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.596+0000 7f9ae8e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f9ae40d03f0 0x7f9ae406e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:37740/0 (socket says 172.21.15.37:37740) 2024-05-30T06:52:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.596+0000 7f9ae8e00640 1 -- 172.21.15.37:0/1706878291 learned_addr learned my addr 172.21.15.37:0/1706878291 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.596+0000 7f9ae9800640 1 --2- 172.21.15.37:0/1706878291 >> v2:172.21.15.105:3300/0 conn(0x7f9ae406c970 0x7f9ae406cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.596+0000 7f9ae9800640 1 -- 172.21.15.37:0/1706878291 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ae40b3ce0 msgr2=0x7f9ae40b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:25.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.596+0000 7f9ae9800640 1 --2- 172.21.15.37:0/1706878291 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ae40b3ce0 0x7f9ae40b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.596+0000 7f9ae9800640 1 -- 172.21.15.37:0/1706878291 >> v1:172.21.15.105:6789/0 conn(0x7f9ae40d03f0 legacy=0x7f9ae406e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:25.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.596+0000 7f9ae9800640 1 -- 172.21.15.37:0/1706878291 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae40cfbf0 con 0x7f9ae406c970 2024-05-30T06:52:25.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.600+0000 7f9ae9800640 1 --2- 172.21.15.37:0/1706878291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ae406c970 0x7f9ae406cd50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80097c0 tx=0x7f9ad801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9173ada1bd4c7792 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.600+0000 7f9ae3e00640 1 -- 172.21.15.37:0/1706878291 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad80ab610 con 0x7f9ae406c970 2024-05-30T06:52:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.600+0000 7f9ae3e00640 1 -- 172.21.15.37:0/1706878291 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad80b0070 con 0x7f9ae406c970 2024-05-30T06:52:25.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.600+0000 7f9ae3e00640 1 -- 172.21.15.37:0/1706878291 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad80ab9d0 con 0x7f9ae406c970 2024-05-30T06:52:25.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.600+0000 7f9aeac00640 1 -- 172.21.15.37:0/1706878291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ae406c970 msgr2=0x7f9ae406cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:25.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.600+0000 7f9aeac00640 1 --2- 172.21.15.37:0/1706878291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ae406c970 0x7f9ae406cd50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80097c0 tx=0x7f9ad801c470 comp rx=0 tx=0).stop 2024-05-30T06:52:25.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.600+0000 7f9aeac00640 1 -- 172.21.15.37:0/1706878291 shutdown_connections 2024-05-30T06:52:25.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.600+0000 7f9aeac00640 1 --2- 172.21.15.37:0/1706878291 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ae40b3ce0 0x7f9ae40b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:25.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.600+0000 7f9aeac00640 1 --2- 172.21.15.37:0/1706878291 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ae406c970 0x7f9ae406cd50 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:25.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.600+0000 7f9aeac00640 1 -- 172.21.15.37:0/1706878291 >> 172.21.15.37:0/1706878291 conn(0x7f9ae40ce540 msgr2=0x7f9ae4072680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:25.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.600+0000 7f9aeac00640 1 -- 172.21.15.37:0/1706878291 shutdown_connections 2024-05-30T06:52:25.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.600+0000 7f9aeac00640 1 -- 172.21.15.37:0/1706878291 wait complete. 2024-05-30T06:52:25.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.604+0000 7f9aeac00640 1 Processor -- start 2024-05-30T06:52:25.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.604+0000 7f9aeac00640 1 -- start start 2024-05-30T06:52:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.604+0000 7f9aeac00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ae406c970 0x7f9ae4152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.604+0000 7f9aeac00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ae40b3ce0 0x7f9ae4152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.604+0000 7f9aeac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ae40d03f0 0x7f9ae414e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.604+0000 7f9aeac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae406ecc0 con 0x7f9ae40d03f0 2024-05-30T06:52:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.604+0000 7f9aeac00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae4073860 con 0x7f9ae40b3ce0 2024-05-30T06:52:25.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.604+0000 7f9aeac00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae4148ec0 con 0x7f9ae406c970 2024-05-30T06:52:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.604+0000 7f9aea200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ae40d03f0 0x7f9ae414e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.604+0000 7f9aea200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ae40d03f0 0x7f9ae414e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55670/0 (socket says 172.21.15.37:55670) 2024-05-30T06:52:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.604+0000 7f9aea200640 1 -- 172.21.15.37:0/3237443353 learned_addr learned my addr 172.21.15.37:0/3237443353 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.608+0000 7f9ae9800640 1 --2- 172.21.15.37:0/3237443353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ae406c970 0x7f9ae4152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.608+0000 7f9aea200640 1 -- 172.21.15.37:0/3237443353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ae406c970 msgr2=0x7f9ae4152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.608+0000 7f9aea200640 1 --2- 172.21.15.37:0/3237443353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ae406c970 0x7f9ae4152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.608+0000 7f9aea200640 1 -- 172.21.15.37:0/3237443353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ae40b3ce0 msgr2=0x7f9ae4152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:25.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.608+0000 7f9aea200640 1 --2- 172.21.15.37:0/3237443353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ae40b3ce0 0x7f9ae4152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.608+0000 7f9aea200640 1 -- 172.21.15.37:0/3237443353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae414fe70 con 0x7f9ae40d03f0 2024-05-30T06:52:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.608+0000 7f9aea200640 1 --2- 172.21.15.37:0/3237443353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ae40d03f0 0x7f9ae414e690 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00cd70 tx=0x7f9adc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.608+0000 7f9ae1600640 1 -- 172.21.15.37:0/3237443353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc003ba0 con 0x7f9ae40d03f0 2024-05-30T06:52:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.608+0000 7f9ae1600640 1 -- 172.21.15.37:0/3237443353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9adc003d40 con 0x7f9ae40d03f0 2024-05-30T06:52:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.608+0000 7f9ae1600640 1 -- 172.21.15.37:0/3237443353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc004240 con 0x7f9ae40d03f0 2024-05-30T06:52:25.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.608+0000 7f9aeac00640 1 -- 172.21.15.37:0/3237443353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae4150150 con 0x7f9ae40d03f0 2024-05-30T06:52:25.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.608+0000 7f9aeac00640 1 -- 172.21.15.37:0/3237443353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae415e080 con 0x7f9ae40d03f0 2024-05-30T06:52:25.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.608+0000 7f9aeac00640 1 -- 172.21.15.37:0/3237443353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae4075580 con 0x7f9ae40d03f0 2024-05-30T06:52:25.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.612+0000 7f9ae1600640 1 -- 172.21.15.37:0/3237443353 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f9adc0043e0 con 0x7f9ae40d03f0 2024-05-30T06:52:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.612+0000 7f9ae1600640 1 --2- 172.21.15.37:0/3237443353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9ac40694f0 0x7f9ac406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:25.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.612+0000 7f9ae1600640 1 -- 172.21.15.37:0/3237443353 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f9adc086400 con 0x7f9ae40d03f0 2024-05-30T06:52:25.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.620+0000 7f9ae1600640 1 -- 172.21.15.37:0/3237443353 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9adc0580c0 con 0x7f9ae40d03f0 2024-05-30T06:52:25.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.636+0000 7f9ae9800640 1 --2- 172.21.15.37:0/3237443353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9ac40694f0 0x7f9ac406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:25.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.648+0000 7f9ae9800640 1 --2- 172.21.15.37:0/3237443353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9ac40694f0 0x7f9ac406b9b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80af000 tx=0x7f9ad80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:25.960+0000 7f9aeac00640 1 -- 172.21.15.37:0/3237443353 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone371014", "target": ["mon-mgr", ""]}) -- 0x7f9ae414ab10 con 0x7f9ac40694f0 2024-05-30T06:52:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.672+0000 7f9ae1600640 1 -- 172.21.15.37:0/3237443353 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9ae414ab10 con 0x7f9ac40694f0 2024-05-30T06:52:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.680+0000 7f9aeac00640 1 -- 172.21.15.37:0/3237443353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9ac40694f0 msgr2=0x7f9ac406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.680+0000 7f9aeac00640 1 --2- 172.21.15.37:0/3237443353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9ac40694f0 0x7f9ac406b9b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80af000 tx=0x7f9ad80a7000 comp rx=0 tx=0).stop 2024-05-30T06:52:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.680+0000 7f9aeac00640 1 -- 172.21.15.37:0/3237443353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ae40d03f0 msgr2=0x7f9ae414e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.680+0000 7f9aeac00640 1 --2- 172.21.15.37:0/3237443353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ae40d03f0 0x7f9ae414e690 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00cd70 tx=0x7f9adc00a660 comp rx=0 tx=0).stop 2024-05-30T06:52:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.680+0000 7f9aeac00640 1 -- 172.21.15.37:0/3237443353 shutdown_connections 2024-05-30T06:52:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.680+0000 7f9aeac00640 1 --2- 172.21.15.37:0/3237443353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ae40d03f0 0x7f9ae414e690 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.680+0000 7f9aeac00640 1 --2- 172.21.15.37:0/3237443353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9ac40694f0 0x7f9ac406b9b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.680+0000 7f9aeac00640 1 --2- 172.21.15.37:0/3237443353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ae40b3ce0 0x7f9ae4152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.680+0000 7f9aeac00640 1 --2- 172.21.15.37:0/3237443353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ae406c970 0x7f9ae4152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.680+0000 7f9aeac00640 1 -- 172.21.15.37:0/3237443353 >> 172.21.15.37:0/3237443353 conn(0x7f9ae40ce540 msgr2=0x7f9ae4154710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.680+0000 7f9aeac00640 1 -- 172.21.15.37:0/3237443353 shutdown_connections 2024-05-30T06:52:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.680+0000 7f9aeac00640 1 -- 172.21.15.37:0/3237443353 wait complete. 2024-05-30T06:52:26.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone371015 2024-05-30T06:52:26.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.980+0000 7f617a600640 1 Processor -- start 2024-05-30T06:52:26.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.980+0000 7f617a600640 1 -- start start 2024-05-30T06:52:26.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.980+0000 7f617a600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f617406c070 0x7f6174070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:26.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.980+0000 7f617a600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61740cdf20 0x7f617415d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:26.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.980+0000 7f617a600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61740ce4c0 con 0x7f61740713a0 2024-05-30T06:52:26.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.980+0000 7f617a600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f61740ce7a0 con 0x7f61740cdf20 2024-05-30T06:52:26.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.980+0000 7f617a600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f61740cea80 con 0x7f617406c070 2024-05-30T06:52:26.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.980+0000 7f6173e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61740cdf20 0x7f617415d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:26.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.980+0000 7f6173e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61740cdf20 0x7f617415d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55672/0 (socket says 172.21.15.37:55672) 2024-05-30T06:52:26.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.980+0000 7f6173e00640 1 -- 172.21.15.37:0/3414962272 learned_addr learned my addr 172.21.15.37:0/3414962272 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:26.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.980+0000 7f6173e00640 1 -- 172.21.15.37:0/3414962272 >> v2:172.21.15.105:3300/0 conn(0x7f617406c070 msgr2=0x7f6174070870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T06:52:26.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.980+0000 7f6173e00640 1 --2- 172.21.15.37:0/3414962272 >> v2:172.21.15.105:3300/0 conn(0x7f617406c070 0x7f6174070870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:26.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.980+0000 7f6173e00640 1 -- 172.21.15.37:0/3414962272 >> v1:172.21.15.105:6789/0 conn(0x7f61740713a0 legacy=0x7f617406b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:26.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.984+0000 7f6173e00640 1 -- 172.21.15.37:0/3414962272 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61740ced60 con 0x7f61740cdf20 2024-05-30T06:52:26.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.988+0000 7f6173e00640 1 --2- 172.21.15.37:0/3414962272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61740cdf20 0x7f617415d730 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f617406fde0 tx=0x7f616c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21add1e5aed9c43 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:26.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.988+0000 7f6172000640 1 -- 172.21.15.37:0/3414962272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c0b4070 con 0x7f61740cdf20 2024-05-30T06:52:26.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.988+0000 7f6172000640 1 -- 172.21.15.37:0/3414962272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f616c0af400 con 0x7f61740cdf20 2024-05-30T06:52:26.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.988+0000 7f6172000640 1 -- 172.21.15.37:0/3414962272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c0af7d0 con 0x7f61740cdf20 2024-05-30T06:52:26.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.988+0000 7f617a600640 1 -- 172.21.15.37:0/3414962272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61740cdf20 msgr2=0x7f617415d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:26.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.988+0000 7f617a600640 1 --2- 172.21.15.37:0/3414962272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61740cdf20 0x7f617415d730 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f617406fde0 tx=0x7f616c01f1c0 comp rx=0 tx=0).stop 2024-05-30T06:52:26.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.988+0000 7f617a600640 1 -- 172.21.15.37:0/3414962272 shutdown_connections 2024-05-30T06:52:26.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.988+0000 7f617a600640 1 --2- 172.21.15.37:0/3414962272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61740cdf20 0x7f617415d730 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:26.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.988+0000 7f617a600640 1 --2- 172.21.15.37:0/3414962272 >> v2:172.21.15.105:3300/0 conn(0x7f617406c070 0x7f6174070870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:26.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.988+0000 7f617a600640 1 -- 172.21.15.37:0/3414962272 >> 172.21.15.37:0/3414962272 conn(0x7f617406f110 msgr2=0x7f617406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:26.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.992+0000 7f617a600640 1 -- 172.21.15.37:0/3414962272 shutdown_connections 2024-05-30T06:52:26.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.992+0000 7f617a600640 1 -- 172.21.15.37:0/3414962272 wait complete. 2024-05-30T06:52:26.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.992+0000 7f617a600640 1 Processor -- start 2024-05-30T06:52:26.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.992+0000 7f617a600640 1 -- start start 2024-05-30T06:52:26.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.992+0000 7f617a600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617406c070 0x7f6174157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:26.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.992+0000 7f617a600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61740713a0 0x7f61741f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:26.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.992+0000 7f617a600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61740cdf20 0x7f61741f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:26.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.992+0000 7f617a600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f61740b0530 con 0x7f617406c070 2024-05-30T06:52:26.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.992+0000 7f617a600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6174071990 con 0x7f61740713a0 2024-05-30T06:52:26.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.992+0000 7f617a600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f61740b06b0 con 0x7f61740cdf20 2024-05-30T06:52:26.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f6172a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61740713a0 0x7f61741f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:26.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f6172a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61740713a0 0x7f61741f2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:45062/0 (socket says 172.21.15.37:45062) 2024-05-30T06:52:26.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f6172a00640 1 -- 172.21.15.37:0/3282893140 learned_addr learned my addr 172.21.15.37:0/3282893140 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:26.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f6172a00640 1 -- 172.21.15.37:0/3282893140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61740cdf20 msgr2=0x7f61741f28c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T06:52:26.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f6172a00640 1 --2- 172.21.15.37:0/3282893140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61740cdf20 0x7f61741f28c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:26.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f6172a00640 1 -- 172.21.15.37:0/3282893140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617406c070 msgr2=0x7f6174157cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-30T06:52:26.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f6172a00640 1 --2- 172.21.15.37:0/3282893140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617406c070 0x7f6174157cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:26.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f6172a00640 1 -- 172.21.15.37:0/3282893140 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617414f910 con 0x7f61740713a0 2024-05-30T06:52:26.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f6172a00640 1 --2- 172.21.15.37:0/3282893140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61740713a0 0x7f61741f2380 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f616000b470 tx=0x7f616000b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:27.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f616b400640 1 -- 172.21.15.37:0/3282893140 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160015020 con 0x7f61740713a0 2024-05-30T06:52:27.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f616b400640 1 -- 172.21.15.37:0/3282893140 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6160011890 con 0x7f61740713a0 2024-05-30T06:52:27.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f617a600640 1 -- 172.21.15.37:0/3282893140 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61741efd80 con 0x7f61740713a0 2024-05-30T06:52:27.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f617a600640 1 -- 172.21.15.37:0/3282893140 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6174150170 con 0x7f61740713a0 2024-05-30T06:52:27.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:26.996+0000 7f616b400640 1 -- 172.21.15.37:0/3282893140 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6160011c80 con 0x7f61740713a0 2024-05-30T06:52:27.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:27.000+0000 7f617a600640 1 -- 172.21.15.37:0/3282893140 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614c0052a0 con 0x7f61740713a0 2024-05-30T06:52:27.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:27.000+0000 7f616b400640 1 -- 172.21.15.37:0/3282893140 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f6160018020 con 0x7f61740713a0 2024-05-30T06:52:27.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:27.004+0000 7f616b400640 1 --2- 172.21.15.37:0/3282893140 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f61540694f0 0x7f615406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:27.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:27.004+0000 7f616b400640 1 -- 172.21.15.37:0/3282893140 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f6160084da0 con 0x7f61740713a0 2024-05-30T06:52:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:27.012+0000 7f616b400640 1 -- 172.21.15.37:0/3282893140 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f616000d040 con 0x7f61740713a0 2024-05-30T06:52:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:27.016+0000 7f6173400640 1 --2- 172.21.15.37:0/3282893140 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f61540694f0 0x7f615406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:27.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:27.028+0000 7f6173400640 1 --2- 172.21.15.37:0/3282893140 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f61540694f0 0x7f615406b9b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6164003c80 tx=0x7f61640079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:27.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:27.372+0000 7f617a600640 1 -- 172.21.15.37:0/3282893140 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone371015", "target": ["mon-mgr", ""]}) -- 0x7f614c000bd0 con 0x7f61540694f0 2024-05-30T06:52:28.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.460+0000 7f616b400640 1 -- 172.21.15.37:0/3282893140 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f614c000bd0 con 0x7f61540694f0 2024-05-30T06:52:28.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.464+0000 7f617a600640 1 -- 172.21.15.37:0/3282893140 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f61540694f0 msgr2=0x7f615406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:28.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.464+0000 7f617a600640 1 --2- 172.21.15.37:0/3282893140 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f61540694f0 0x7f615406b9b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6164003c80 tx=0x7f61640079c0 comp rx=0 tx=0).stop 2024-05-30T06:52:28.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.464+0000 7f617a600640 1 -- 172.21.15.37:0/3282893140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61740713a0 msgr2=0x7f61741f2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:28.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.464+0000 7f617a600640 1 --2- 172.21.15.37:0/3282893140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61740713a0 0x7f61741f2380 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f616000b470 tx=0x7f616000b930 comp rx=0 tx=0).stop 2024-05-30T06:52:28.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.464+0000 7f617a600640 1 -- 172.21.15.37:0/3282893140 shutdown_connections 2024-05-30T06:52:28.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.464+0000 7f617a600640 1 --2- 172.21.15.37:0/3282893140 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61740cdf20 0x7f61741f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:28.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.464+0000 7f617a600640 1 --2- 172.21.15.37:0/3282893140 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f61540694f0 0x7f615406b9b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:28.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.464+0000 7f617a600640 1 --2- 172.21.15.37:0/3282893140 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61740713a0 0x7f61741f2380 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:28.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.464+0000 7f617a600640 1 --2- 172.21.15.37:0/3282893140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f617406c070 0x7f6174157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:28.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.464+0000 7f617a600640 1 -- 172.21.15.37:0/3282893140 >> 172.21.15.37:0/3282893140 conn(0x7f617406f110 msgr2=0x7f61740b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:28.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.464+0000 7f617a600640 1 -- 172.21.15.37:0/3282893140 shutdown_connections 2024-05-30T06:52:28.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.464+0000 7f617a600640 1 -- 172.21.15.37:0/3282893140 wait complete. 2024-05-30T06:52:28.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone371016 2024-05-30T06:52:28.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.748+0000 7ff07b200640 1 Processor -- start 2024-05-30T06:52:28.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.748+0000 7ff07b200640 1 -- start start 2024-05-30T06:52:28.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.748+0000 7ff07b200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff07415ebc0 0x7ff0740d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:28.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.748+0000 7ff07b200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0740d0840 con 0x7ff07409b800 2024-05-30T06:52:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.748+0000 7ff07b200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff07406dec0 con 0x7ff07409aa60 2024-05-30T06:52:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.748+0000 7ff07b200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff07409bce0 con 0x7ff07415ebc0 2024-05-30T06:52:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.748+0000 7ff073400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff07409b800 0x7ff07406d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54046/0 (socket says 172.21.15.37:54046) 2024-05-30T06:52:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.748+0000 7ff073400640 1 -- 172.21.15.37:0/468742476 learned_addr learned my addr 172.21.15.37:0/468742476 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.748+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078424775 0 0) 0x7ff0740d0840 con 0x7ff07409b800 2024-05-30T06:52:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.748+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff058003530 con 0x7ff07409b800 2024-05-30T06:52:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 474505768 0 0) 0x7ff058003530 con 0x7ff07409b800 2024-05-30T06:52:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 >> v2:172.21.15.105:3300/0 conn(0x7ff07415ebc0 msgr2=0x7ff0740d15c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T06:52:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff072a00640 1 --2- 172.21.15.37:0/468742476 >> v2:172.21.15.105:3300/0 conn(0x7ff07415ebc0 0x7ff0740d15c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 >> v1:172.21.15.105:6789/0 conn(0x7ff07409aa60 legacy=0x7ff07409ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0740d0ae0 con 0x7ff07409b800 2024-05-30T06:52:28.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7ff060001680 con 0x7ff07409b800 2024-05-30T06:52:28.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 >> v1:172.21.15.37:6789/0 conn(0x7ff07409b800 legacy=0x7ff07406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:28.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff072a00640 1 --2- 172.21.15.37:0/468742476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0580039c0 0x7ff058003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:28.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff072a00640 1 --2- 172.21.15.37:0/468742476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff058004810 0x7ff058004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:28.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff072a00640 1 --2- 172.21.15.37:0/468742476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0580052f0 0x7ff05800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:28.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff07409bce0 con 0x7ff0580039c0 2024-05-30T06:52:28.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff05800c1f0 con 0x7ff058004810 2024-05-30T06:52:28.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff05800c3f0 con 0x7ff0580052f0 2024-05-30T06:52:28.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff073e00640 1 --2- 172.21.15.37:0/468742476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0580039c0 0x7ff058003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:28.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff073e00640 1 -- 172.21.15.37:0/468742476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0580052f0 msgr2=0x7ff05800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:28.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff073e00640 1 --2- 172.21.15.37:0/468742476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0580052f0 0x7ff05800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:28.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff073e00640 1 -- 172.21.15.37:0/468742476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff058004810 msgr2=0x7ff058004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:28.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff073e00640 1 --2- 172.21.15.37:0/468742476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff058004810 0x7ff058004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:28.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff073e00640 1 -- 172.21.15.37:0/468742476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff058003530 con 0x7ff0580039c0 2024-05-30T06:52:28.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.752+0000 7ff079200640 1 -- 172.21.15.37:0/468742476 reap_dead start 2024-05-30T06:52:28.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.756+0000 7ff073e00640 1 --2- 172.21.15.37:0/468742476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0580039c0 0x7ff058003dc0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff064009e30 tx=0x7ff06401cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad19b54831487ae server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:28.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.756+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0640b2070 con 0x7ff0580039c0 2024-05-30T06:52:28.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.756+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0640a5cd0 con 0x7ff0580039c0 2024-05-30T06:52:28.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.756+0000 7ff072a00640 1 -- 172.21.15.37:0/468742476 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064009a30 con 0x7ff0580039c0 2024-05-30T06:52:28.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.756+0000 7ff07b200640 1 -- 172.21.15.37:0/468742476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0580039c0 msgr2=0x7ff058003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:28.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.756+0000 7ff07b200640 1 --2- 172.21.15.37:0/468742476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0580039c0 0x7ff058003dc0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff064009e30 tx=0x7ff06401cdf0 comp rx=0 tx=0).stop 2024-05-30T06:52:28.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.756+0000 7ff07b200640 1 -- 172.21.15.37:0/468742476 shutdown_connections 2024-05-30T06:52:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.756+0000 7ff07b200640 1 --2- 172.21.15.37:0/468742476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0580039c0 0x7ff058003dc0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.756+0000 7ff07b200640 1 -- 172.21.15.37:0/468742476 >> 172.21.15.37:0/468742476 conn(0x7ff0740b4060 msgr2=0x7ff0740b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.756+0000 7ff07b200640 1 -- 172.21.15.37:0/468742476 shutdown_connections 2024-05-30T06:52:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.756+0000 7ff07b200640 1 -- 172.21.15.37:0/468742476 wait complete. 2024-05-30T06:52:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.756+0000 7ff07b200640 1 Processor -- start 2024-05-30T06:52:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.756+0000 7ff07b200640 1 -- start start 2024-05-30T06:52:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff07b200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0580039c0 0x7ff074149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff07b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0741495d0 0x7ff0740c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff07b200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0740c9b80 0x7ff0740b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff07b200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff07406dd40 con 0x7ff0741495d0 2024-05-30T06:52:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff07b200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff07406dbc0 con 0x7ff0740c9b80 2024-05-30T06:52:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff07b200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff07409b250 con 0x7ff0580039c0 2024-05-30T06:52:28.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff073400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0741495d0 0x7ff0740c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:28.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff073400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0741495d0 0x7ff0740c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51290/0 (socket says 172.21.15.37:51290) 2024-05-30T06:52:28.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff073400640 1 -- 172.21.15.37:0/3970423062 learned_addr learned my addr 172.21.15.37:0/3970423062 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:28.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff073400640 1 -- 172.21.15.37:0/3970423062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0580039c0 msgr2=0x7ff074149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:28.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff073400640 1 --2- 172.21.15.37:0/3970423062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0580039c0 0x7ff074149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:28.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff073400640 1 -- 172.21.15.37:0/3970423062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0740c9b80 msgr2=0x7ff0740b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:28.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff073400640 1 --2- 172.21.15.37:0/3970423062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0740c9b80 0x7ff0740b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:28.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff073400640 1 -- 172.21.15.37:0/3970423062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0740b6ca0 con 0x7ff0741495d0 2024-05-30T06:52:28.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff073400640 1 --2- 172.21.15.37:0/3970423062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0741495d0 0x7ff0740c9640 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff06000c840 tx=0x7ff06000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:28.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff06be00640 1 -- 172.21.15.37:0/3970423062 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060018070 con 0x7ff0741495d0 2024-05-30T06:52:28.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff06be00640 1 -- 172.21.15.37:0/3970423062 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff060007500 con 0x7ff0741495d0 2024-05-30T06:52:28.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff06be00640 1 -- 172.21.15.37:0/3970423062 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060004a30 con 0x7ff0741495d0 2024-05-30T06:52:28.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff07b200640 1 -- 172.21.15.37:0/3970423062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0740b6f80 con 0x7ff0741495d0 2024-05-30T06:52:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff07b200640 1 -- 172.21.15.37:0/3970423062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0740b7540 con 0x7ff0741495d0 2024-05-30T06:52:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.760+0000 7ff07b200640 1 -- 172.21.15.37:0/3970423062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0740c9fa0 con 0x7ff0741495d0 2024-05-30T06:52:28.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.764+0000 7ff06be00640 1 -- 172.21.15.37:0/3970423062 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7ff06001b070 con 0x7ff0741495d0 2024-05-30T06:52:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.764+0000 7ff06be00640 1 --2- 172.21.15.37:0/3970423062 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff054069520 0x7ff05406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:28.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.764+0000 7ff06be00640 1 -- 172.21.15.37:0/3970423062 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7ff060084dd0 con 0x7ff0741495d0 2024-05-30T06:52:28.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.764+0000 7ff073e00640 1 --2- 172.21.15.37:0/3970423062 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff054069520 0x7ff05406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:28.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.768+0000 7ff073e00640 1 --2- 172.21.15.37:0/3970423062 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff054069520 0x7ff05406b9e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff0640af000 tx=0x7ff064004a90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:28.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:28.772+0000 7ff06be00640 1 -- 172.21.15.37:0/3970423062 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff060056af0 con 0x7ff0741495d0 2024-05-30T06:52:29.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:29.088+0000 7ff07b200640 1 -- 172.21.15.37:0/3970423062 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone371016", "target": ["mon-mgr", ""]}) -- 0x7ff074163320 con 0x7ff054069520 2024-05-30T06:52:30.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.471+0000 7ff06be00640 1 -- 172.21.15.37:0/3970423062 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff074163320 con 0x7ff054069520 2024-05-30T06:52:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.475+0000 7ff07b200640 1 -- 172.21.15.37:0/3970423062 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff054069520 msgr2=0x7ff05406b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.475+0000 7ff07b200640 1 --2- 172.21.15.37:0/3970423062 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff054069520 0x7ff05406b9e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff0640af000 tx=0x7ff064004a90 comp rx=0 tx=0).stop 2024-05-30T06:52:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.475+0000 7ff07b200640 1 -- 172.21.15.37:0/3970423062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0741495d0 msgr2=0x7ff0740c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.475+0000 7ff07b200640 1 --2- 172.21.15.37:0/3970423062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0741495d0 0x7ff0740c9640 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff06000c840 tx=0x7ff06000cd00 comp rx=0 tx=0).stop 2024-05-30T06:52:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.475+0000 7ff07b200640 1 -- 172.21.15.37:0/3970423062 shutdown_connections 2024-05-30T06:52:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.475+0000 7ff07b200640 1 --2- 172.21.15.37:0/3970423062 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff054069520 0x7ff05406b9e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.475+0000 7ff07b200640 1 --2- 172.21.15.37:0/3970423062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0740c9b80 0x7ff0740b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.475+0000 7ff07b200640 1 --2- 172.21.15.37:0/3970423062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0741495d0 0x7ff0740c9640 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.475+0000 7ff07b200640 1 --2- 172.21.15.37:0/3970423062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0580039c0 0x7ff074149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.475+0000 7ff07b200640 1 -- 172.21.15.37:0/3970423062 >> 172.21.15.37:0/3970423062 conn(0x7ff0740b4060 msgr2=0x7ff0740714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.475+0000 7ff07b200640 1 -- 172.21.15.37:0/3970423062 shutdown_connections 2024-05-30T06:52:30.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.475+0000 7ff07b200640 1 -- 172.21.15.37:0/3970423062 wait complete. 2024-05-30T06:52:30.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone371017 2024-05-30T06:52:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.791+0000 7f549fe00640 1 Processor -- start 2024-05-30T06:52:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.791+0000 7f549fe00640 1 -- start start 2024-05-30T06:52:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.795+0000 7f549fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54a006b960 0x7f54a00b6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.795+0000 7f549fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54a00b4350 0x7f54a006bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.795+0000 7f549fe00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54a0164e20 con 0x7f54a00b0a40 2024-05-30T06:52:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.795+0000 7f549fe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f54a01656e0 con 0x7f54a006b960 2024-05-30T06:52:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.795+0000 7f549fe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f54a00b47d0 con 0x7f54a00b4350 2024-05-30T06:52:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.795+0000 7f549ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54a006b960 0x7f54a00b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.795+0000 7f549f400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f54a00b0a40 0x7f54a0165b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54056/0 (socket says 172.21.15.37:54056) 2024-05-30T06:52:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.795+0000 7f549f400640 1 -- 172.21.15.37:0/3810370951 learned_addr learned my addr 172.21.15.37:0/3810370951 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.795+0000 7f549ea00640 1 -- 172.21.15.37:0/3810370951 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54a00b4350 msgr2=0x7f54a006bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.795+0000 7f549ea00640 1 --2- 172.21.15.37:0/3810370951 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54a00b4350 0x7f54a006bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.795+0000 7f549ea00640 1 -- 172.21.15.37:0/3810370951 >> v1:172.21.15.37:6789/0 conn(0x7f54a00b0a40 legacy=0x7f54a0165b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.795+0000 7f549ea00640 1 -- 172.21.15.37:0/3810370951 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a006c280 con 0x7f54a006b960 2024-05-30T06:52:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.795+0000 7f549d600640 1 -- 172.21.15.37:0/3810370951 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2794074372 0 0) 0x7f54a0164e20 con 0x7f54a00b0a40 2024-05-30T06:52:30.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.803+0000 7f549ea00640 1 --2- 172.21.15.37:0/3810370951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a006b960 0x7f54a00b6400 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5498009d90 tx=0x7f549801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c16b34bbc78dc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:30.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.807+0000 7f549d600640 1 -- 172.21.15.37:0/3810370951 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54980b2070 con 0x7f54a006b960 2024-05-30T06:52:30.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.807+0000 7f549d600640 1 -- 172.21.15.37:0/3810370951 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54980a5920 con 0x7f54a006b960 2024-05-30T06:52:30.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.807+0000 7f549d600640 1 -- 172.21.15.37:0/3810370951 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54980a5cf0 con 0x7f54a006b960 2024-05-30T06:52:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.807+0000 7f549fe00640 1 -- 172.21.15.37:0/3810370951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a006b960 msgr2=0x7f54a00b6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.807+0000 7f549fe00640 1 --2- 172.21.15.37:0/3810370951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a006b960 0x7f54a00b6400 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5498009d90 tx=0x7f549801c970 comp rx=0 tx=0).stop 2024-05-30T06:52:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.807+0000 7f549fe00640 1 -- 172.21.15.37:0/3810370951 shutdown_connections 2024-05-30T06:52:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.807+0000 7f549fe00640 1 --2- 172.21.15.37:0/3810370951 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54a00b4350 0x7f54a006bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.807+0000 7f549fe00640 1 --2- 172.21.15.37:0/3810370951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a006b960 0x7f54a00b6400 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.807+0000 7f549fe00640 1 -- 172.21.15.37:0/3810370951 >> 172.21.15.37:0/3810370951 conn(0x7f54a00b6a90 msgr2=0x7f54a009aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.811+0000 7f549fe00640 1 -- 172.21.15.37:0/3810370951 shutdown_connections 2024-05-30T06:52:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.811+0000 7f549fe00640 1 -- 172.21.15.37:0/3810370951 wait complete. 2024-05-30T06:52:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549fe00640 1 Processor -- start 2024-05-30T06:52:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549fe00640 1 -- start start 2024-05-30T06:52:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54a006b960 0x7f54a00b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549fe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a00b0a40 0x7f54a0141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a00b4350 0x7f54a0154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54a0163fe0 con 0x7f54a00b4350 2024-05-30T06:52:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549fe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f54a0163e60 con 0x7f54a00b0a40 2024-05-30T06:52:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549fe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f54a0170000 con 0x7f54a006b960 2024-05-30T06:52:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a00b4350 0x7f54a0154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a00b4350 0x7f54a0154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51316/0 (socket says 172.21.15.37:51316) 2024-05-30T06:52:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549f400640 1 -- 172.21.15.37:0/3868244316 learned_addr learned my addr 172.21.15.37:0/3868244316 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:30.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549ea00640 1 --2- 172.21.15.37:0/3868244316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54a006b960 0x7f54a00b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549f400640 1 -- 172.21.15.37:0/3868244316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54a006b960 msgr2=0x7f54a00b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549f400640 1 --2- 172.21.15.37:0/3868244316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54a006b960 0x7f54a00b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549f400640 1 -- 172.21.15.37:0/3868244316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a00b0a40 msgr2=0x7f54a0141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549f400640 1 --2- 172.21.15.37:0/3868244316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a00b0a40 0x7f54a0141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:30.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.815+0000 7f549f400640 1 -- 172.21.15.37:0/3868244316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a00b07f0 con 0x7f54a00b4350 2024-05-30T06:52:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.819+0000 7f549f400640 1 --2- 172.21.15.37:0/3868244316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a00b4350 0x7f54a0154830 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f548c00c4b0 tx=0x7f548c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:30.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.819+0000 7f5496a00640 1 -- 172.21.15.37:0/3868244316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c018070 con 0x7f54a00b4350 2024-05-30T06:52:30.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.819+0000 7f5496a00640 1 -- 172.21.15.37:0/3868244316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548c0074e0 con 0x7f54a00b4350 2024-05-30T06:52:30.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.819+0000 7f5496a00640 1 -- 172.21.15.37:0/3868244316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c004a30 con 0x7f54a00b4350 2024-05-30T06:52:30.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.819+0000 7f549fe00640 1 -- 172.21.15.37:0/3868244316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a0156a70 con 0x7f54a00b4350 2024-05-30T06:52:30.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.819+0000 7f549fe00640 1 -- 172.21.15.37:0/3868244316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a014fa40 con 0x7f54a00b4350 2024-05-30T06:52:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.823+0000 7f549fe00640 1 -- 172.21.15.37:0/3868244316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a0068700 con 0x7f54a00b4350 2024-05-30T06:52:30.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.823+0000 7f5496a00640 1 -- 172.21.15.37:0/3868244316 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f548c01b070 con 0x7f54a00b4350 2024-05-30T06:52:30.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.823+0000 7f5496a00640 1 --2- 172.21.15.37:0/3868244316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5480069540 0x7f548006ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:30.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.823+0000 7f5496a00640 1 -- 172.21.15.37:0/3868244316 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f548c084b60 con 0x7f54a00b4350 2024-05-30T06:52:30.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.827+0000 7f549ea00640 1 --2- 172.21.15.37:0/3868244316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5480069540 0x7f548006ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:30.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.831+0000 7f5496a00640 1 -- 172.21.15.37:0/3868244316 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f548c056210 con 0x7f54a00b4350 2024-05-30T06:52:30.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:30.867+0000 7f549ea00640 1 --2- 172.21.15.37:0/3868244316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5480069540 0x7f548006ba00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f54980af000 tx=0x7f54980a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:31.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:31.183+0000 7f549fe00640 1 -- 172.21.15.37:0/3868244316 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone371017", "target": ["mon-mgr", ""]}) -- 0x7f54a0075580 con 0x7f5480069540 2024-05-30T06:52:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.347+0000 7f5496a00640 1 -- 172.21.15.37:0/3868244316 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f54a0075580 con 0x7f5480069540 2024-05-30T06:52:32.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.351+0000 7f549fe00640 1 -- 172.21.15.37:0/3868244316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5480069540 msgr2=0x7f548006ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:32.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.351+0000 7f549fe00640 1 --2- 172.21.15.37:0/3868244316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5480069540 0x7f548006ba00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f54980af000 tx=0x7f54980a7070 comp rx=0 tx=0).stop 2024-05-30T06:52:32.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.351+0000 7f549fe00640 1 -- 172.21.15.37:0/3868244316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a00b4350 msgr2=0x7f54a0154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:32.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.351+0000 7f549fe00640 1 --2- 172.21.15.37:0/3868244316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a00b4350 0x7f54a0154830 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f548c00c4b0 tx=0x7f548c00c970 comp rx=0 tx=0).stop 2024-05-30T06:52:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.351+0000 7f549fe00640 1 -- 172.21.15.37:0/3868244316 shutdown_connections 2024-05-30T06:52:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.351+0000 7f549fe00640 1 --2- 172.21.15.37:0/3868244316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a00b4350 0x7f54a0154830 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.351+0000 7f549fe00640 1 --2- 172.21.15.37:0/3868244316 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5480069540 0x7f548006ba00 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.351+0000 7f549fe00640 1 --2- 172.21.15.37:0/3868244316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54a00b0a40 0x7f54a0141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.351+0000 7f549fe00640 1 --2- 172.21.15.37:0/3868244316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54a006b960 0x7f54a00b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.351+0000 7f549fe00640 1 -- 172.21.15.37:0/3868244316 >> 172.21.15.37:0/3868244316 conn(0x7f54a00b6a90 msgr2=0x7f54a0164950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.351+0000 7f549fe00640 1 -- 172.21.15.37:0/3868244316 shutdown_connections 2024-05-30T06:52:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.351+0000 7f549fe00640 1 -- 172.21.15.37:0/3868244316 wait complete. 2024-05-30T06:52:32.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone371018 2024-05-30T06:52:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.603+0000 7f2443200640 1 Processor -- start 2024-05-30T06:52:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.603+0000 7f2443200640 1 -- start start 2024-05-30T06:52:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2443200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f244415c9a0 0x7f24440cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2443200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24440cffd0 0x7f24440afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2443200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24440af0d0 con 0x7f24440d0600 2024-05-30T06:52:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2443200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f24440ce000 con 0x7f244415c9a0 2024-05-30T06:52:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2443200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f24440ce2e0 con 0x7f24440cffd0 2024-05-30T06:52:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2441e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f24440d0600 0x7f24440d09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54062/0 (socket says 172.21.15.37:54062) 2024-05-30T06:52:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2441e00640 1 -- 172.21.15.37:0/808253869 learned_addr learned my addr 172.21.15.37:0/808253869 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716395887 0 0) 0x7f24440af0d0 con 0x7f24440d0600 2024-05-30T06:52:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2428003530 con 0x7f24440d0600 2024-05-30T06:52:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2442800640 1 --2- 172.21.15.37:0/808253869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24440cffd0 0x7f24440afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3056922446 0 0) 0x7f2428003530 con 0x7f24440d0600 2024-05-30T06:52:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24440cffd0 msgr2=0x7f24440afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 --2- 172.21.15.37:0/808253869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24440cffd0 0x7f24440afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 >> v2:172.21.15.105:3300/0 conn(0x7f244415c9a0 msgr2=0x7f24440cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 --2- 172.21.15.37:0/808253869 >> v2:172.21.15.105:3300/0 conn(0x7f244415c9a0 0x7f24440cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24440af370 con 0x7f24440d0600 2024-05-30T06:52:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f24340016a0 con 0x7f24440d0600 2024-05-30T06:52:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 >> v1:172.21.15.37:6789/0 conn(0x7f24440d0600 legacy=0x7f24440d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 --2- 172.21.15.37:0/808253869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24280039c0 0x7f2428003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 --2- 172.21.15.37:0/808253869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24440cffd0 0x7f2428004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 --2- 172.21.15.37:0/808253869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2428004d50 0x7f24280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f24440ce000 con 0x7f24280039c0 2024-05-30T06:52:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f24440ce2e0 con 0x7f2428004d50 2024-05-30T06:52:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f242800ffa0 con 0x7f24440cffd0 2024-05-30T06:52:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.607+0000 7f2441e00640 1 --2- 172.21.15.37:0/808253869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24280039c0 0x7f2428003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.611+0000 7f2442800640 1 --2- 172.21.15.37:0/808253869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2428004d50 0x7f24280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.611+0000 7f2441e00640 1 -- 172.21.15.37:0/808253869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24440cffd0 msgr2=0x7f2428004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.611+0000 7f2441e00640 1 --2- 172.21.15.37:0/808253869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24440cffd0 0x7f2428004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.611+0000 7f2441e00640 1 -- 172.21.15.37:0/808253869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2428004d50 msgr2=0x7f24280051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.611+0000 7f2441e00640 1 --2- 172.21.15.37:0/808253869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2428004d50 0x7f24280051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.611+0000 7f2441e00640 1 -- 172.21.15.37:0/808253869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2428003530 con 0x7f24280039c0 2024-05-30T06:52:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.611+0000 7f2442800640 1 --2- 172.21.15.37:0/808253869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2428004d50 0x7f24280051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:52:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.615+0000 7f2441e00640 1 --2- 172.21.15.37:0/808253869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24280039c0 0x7f2428003de0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f24440af2a0 tx=0x7f243401cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5db545fad95f96c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.615+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434007da0 con 0x7f24280039c0 2024-05-30T06:52:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.615+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24340a9070 con 0x7f24280039c0 2024-05-30T06:52:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.615+0000 7f2440a00640 1 -- 172.21.15.37:0/808253869 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434005d20 con 0x7f24280039c0 2024-05-30T06:52:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.615+0000 7f2443200640 1 -- 172.21.15.37:0/808253869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24280039c0 msgr2=0x7f2428003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.615+0000 7f2443200640 1 --2- 172.21.15.37:0/808253869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24280039c0 0x7f2428003de0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f24440af2a0 tx=0x7f243401cbb0 comp rx=0 tx=0).stop 2024-05-30T06:52:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.615+0000 7f2442800640 1 -- 172.21.15.37:0/808253869 reap_dead start 2024-05-30T06:52:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.615+0000 7f2443200640 1 -- 172.21.15.37:0/808253869 shutdown_connections 2024-05-30T06:52:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.615+0000 7f2443200640 1 -- 172.21.15.37:0/808253869 >> 172.21.15.37:0/808253869 conn(0x7f24440b3ef0 msgr2=0x7f24440b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.615+0000 7f2443200640 1 -- 172.21.15.37:0/808253869 shutdown_connections 2024-05-30T06:52:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.615+0000 7f2443200640 1 -- 172.21.15.37:0/808253869 wait complete. 2024-05-30T06:52:32.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.619+0000 7f2443200640 1 Processor -- start 2024-05-30T06:52:32.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.619+0000 7f2443200640 1 -- start start 2024-05-30T06:52:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.619+0000 7f2443200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24280039c0 0x7f24440b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.619+0000 7f2443200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24440b7d60 0x7f2444152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.619+0000 7f2443200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24440b5ac0 0x7f244415a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.619+0000 7f2443200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f24440b0710 con 0x7f24440b7d60 2024-05-30T06:52:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.619+0000 7f2443200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f24440b0590 con 0x7f24440b5ac0 2024-05-30T06:52:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.619+0000 7f2443200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f24440b0890 con 0x7f24280039c0 2024-05-30T06:52:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.619+0000 7f2441400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24440b7d60 0x7f2444152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.619+0000 7f2441400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24440b7d60 0x7f2444152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51340/0 (socket says 172.21.15.37:51340) 2024-05-30T06:52:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.619+0000 7f2441400640 1 -- 172.21.15.37:0/1122388071 learned_addr learned my addr 172.21.15.37:0/1122388071 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.623+0000 7f2441400640 1 -- 172.21.15.37:0/1122388071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24280039c0 msgr2=0x7f24440b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.623+0000 7f2441400640 1 --2- 172.21.15.37:0/1122388071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24280039c0 0x7f24440b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.623+0000 7f2441400640 1 -- 172.21.15.37:0/1122388071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24440b5ac0 msgr2=0x7f244415a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.623+0000 7f2441400640 1 --2- 172.21.15.37:0/1122388071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24440b5ac0 0x7f244415a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.623+0000 7f2441400640 1 -- 172.21.15.37:0/1122388071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24440b6cc0 con 0x7f24440b7d60 2024-05-30T06:52:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.623+0000 7f2441400640 1 --2- 172.21.15.37:0/1122388071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24440b7d60 0x7f2444152c20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f243000b580 tx=0x7f243000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.623+0000 7f243a000640 1 -- 172.21.15.37:0/1122388071 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430014070 con 0x7f24440b7d60 2024-05-30T06:52:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.623+0000 7f243a000640 1 -- 172.21.15.37:0/1122388071 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2430010890 con 0x7f24440b7d60 2024-05-30T06:52:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.623+0000 7f243a000640 1 -- 172.21.15.37:0/1122388071 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430010c80 con 0x7f24440b7d60 2024-05-30T06:52:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.623+0000 7f2443200640 1 -- 172.21.15.37:0/1122388071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24440b6fa0 con 0x7f24440b7d60 2024-05-30T06:52:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.623+0000 7f2443200640 1 -- 172.21.15.37:0/1122388071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24440b7560 con 0x7f24440b7d60 2024-05-30T06:52:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.623+0000 7f2443200640 1 -- 172.21.15.37:0/1122388071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2444068ab0 con 0x7f24440b7d60 2024-05-30T06:52:32.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.627+0000 7f243a000640 1 -- 172.21.15.37:0/1122388071 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f2430017070 con 0x7f24440b7d60 2024-05-30T06:52:32.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.627+0000 7f243a000640 1 --2- 172.21.15.37:0/1122388071 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f24240694f0 0x7f242406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:32.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.627+0000 7f243a000640 1 -- 172.21.15.37:0/1122388071 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f24300857b0 con 0x7f24440b7d60 2024-05-30T06:52:32.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.639+0000 7f2441e00640 1 --2- 172.21.15.37:0/1122388071 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f24240694f0 0x7f242406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:32.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.639+0000 7f243a000640 1 -- 172.21.15.37:0/1122388071 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f24300573f0 con 0x7f24440b7d60 2024-05-30T06:52:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.683+0000 7f2441e00640 1 --2- 172.21.15.37:0/1122388071 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f24240694f0 0x7f242406b9b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f24340ab000 tx=0x7f2434001a70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:32.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:32.967+0000 7f2443200640 1 -- 172.21.15.37:0/1122388071 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone371018", "target": ["mon-mgr", ""]}) -- 0x7f2444071c60 con 0x7f24240694f0 2024-05-30T06:52:34.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.083+0000 7f243a000640 1 -- 172.21.15.37:0/1122388071 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2444071c60 con 0x7f24240694f0 2024-05-30T06:52:34.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.087+0000 7f2443200640 1 -- 172.21.15.37:0/1122388071 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f24240694f0 msgr2=0x7f242406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:34.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.087+0000 7f2443200640 1 --2- 172.21.15.37:0/1122388071 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f24240694f0 0x7f242406b9b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f24340ab000 tx=0x7f2434001a70 comp rx=0 tx=0).stop 2024-05-30T06:52:34.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.087+0000 7f2443200640 1 -- 172.21.15.37:0/1122388071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24440b7d60 msgr2=0x7f2444152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:34.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.087+0000 7f2443200640 1 --2- 172.21.15.37:0/1122388071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24440b7d60 0x7f2444152c20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f243000b580 tx=0x7f243000ba40 comp rx=0 tx=0).stop 2024-05-30T06:52:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.091+0000 7f2443200640 1 -- 172.21.15.37:0/1122388071 shutdown_connections 2024-05-30T06:52:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.091+0000 7f2443200640 1 --2- 172.21.15.37:0/1122388071 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f24240694f0 0x7f242406b9b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.091+0000 7f2443200640 1 --2- 172.21.15.37:0/1122388071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24440b5ac0 0x7f244415a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.091+0000 7f2443200640 1 --2- 172.21.15.37:0/1122388071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24440b7d60 0x7f2444152c20 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.091+0000 7f2443200640 1 --2- 172.21.15.37:0/1122388071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24280039c0 0x7f24440b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.091+0000 7f2443200640 1 -- 172.21.15.37:0/1122388071 >> 172.21.15.37:0/1122388071 conn(0x7f24440b3ef0 msgr2=0x7f24440b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.091+0000 7f2443200640 1 -- 172.21.15.37:0/1122388071 shutdown_connections 2024-05-30T06:52:34.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.091+0000 7f2443200640 1 -- 172.21.15.37:0/1122388071 wait complete. 2024-05-30T06:52:34.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone371019 2024-05-30T06:52:34.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f623aa00640 1 Processor -- start 2024-05-30T06:52:34.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f623aa00640 1 -- start start 2024-05-30T06:52:34.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f623aa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62340b0c70 0x7f62340b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:34.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f623aa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f62340b50e0 0x7f623406b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:34.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f623aa00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62340b1050 con 0x7f623406bea0 2024-05-30T06:52:34.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f623aa00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6234163610 con 0x7f62340b50e0 2024-05-30T06:52:34.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f623aa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f62341638f0 con 0x7f62340b0c70 2024-05-30T06:52:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f622be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f62340b50e0 0x7f623406b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f6238a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f623406bea0 0x7f6234166b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54072/0 (socket says 172.21.15.37:54072) 2024-05-30T06:52:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f6238a00640 1 -- 172.21.15.37:0/1458567554 learned_addr learned my addr 172.21.15.37:0/1458567554 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f6233e00640 1 --2- 172.21.15.37:0/1458567554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62340b0c70 0x7f62340b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f6233400640 1 -- 172.21.15.37:0/1458567554 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 912296234 0 0) 0x7f62340b1050 con 0x7f623406bea0 2024-05-30T06:52:34.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f622be00640 1 -- 172.21.15.37:0/1458567554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62340b0c70 msgr2=0x7f62340b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f622be00640 1 --2- 172.21.15.37:0/1458567554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62340b0c70 0x7f62340b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f622be00640 1 -- 172.21.15.37:0/1458567554 >> v1:172.21.15.37:6789/0 conn(0x7f623406bea0 legacy=0x7f6234166b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:34.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.359+0000 7f622be00640 1 -- 172.21.15.37:0/1458567554 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6234163bd0 con 0x7f62340b50e0 2024-05-30T06:52:34.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.367+0000 7f622be00640 1 --2- 172.21.15.37:0/1458567554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62340b50e0 0x7f623406b960 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f621c0097c0 tx=0x7f621c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fb02d9b704caa7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:34.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.367+0000 7f6233400640 1 -- 172.21.15.37:0/1458567554 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c0b0070 con 0x7f62340b50e0 2024-05-30T06:52:34.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.367+0000 7f6233400640 1 -- 172.21.15.37:0/1458567554 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621c0ab600 con 0x7f62340b50e0 2024-05-30T06:52:34.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.367+0000 7f6233400640 1 -- 172.21.15.37:0/1458567554 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c0ab9d0 con 0x7f62340b50e0 2024-05-30T06:52:34.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.367+0000 7f623aa00640 1 -- 172.21.15.37:0/1458567554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62340b50e0 msgr2=0x7f623406b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:34.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.367+0000 7f623aa00640 1 --2- 172.21.15.37:0/1458567554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62340b50e0 0x7f623406b960 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f621c0097c0 tx=0x7f621c01c410 comp rx=0 tx=0).stop 2024-05-30T06:52:34.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.367+0000 7f623aa00640 1 -- 172.21.15.37:0/1458567554 shutdown_connections 2024-05-30T06:52:34.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.367+0000 7f623aa00640 1 --2- 172.21.15.37:0/1458567554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62340b50e0 0x7f623406b960 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:34.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.367+0000 7f623aa00640 1 --2- 172.21.15.37:0/1458567554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62340b0c70 0x7f62340b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:34.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.367+0000 7f623aa00640 1 -- 172.21.15.37:0/1458567554 >> 172.21.15.37:0/1458567554 conn(0x7f623406f110 msgr2=0x7f623406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:34.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.367+0000 7f623aa00640 1 -- 172.21.15.37:0/1458567554 shutdown_connections 2024-05-30T06:52:34.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.367+0000 7f623aa00640 1 -- 172.21.15.37:0/1458567554 wait complete. 2024-05-30T06:52:34.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.371+0000 7f623aa00640 1 Processor -- start 2024-05-30T06:52:34.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.371+0000 7f623aa00640 1 -- start start 2024-05-30T06:52:34.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.371+0000 7f623aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623406bea0 0x7f6234153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:34.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.371+0000 7f623aa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62340b0c70 0x7f62341526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.371+0000 7f623aa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62340b50e0 0x7f623414b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.371+0000 7f623aa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f62341676b0 con 0x7f623406bea0 2024-05-30T06:52:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.371+0000 7f623aa00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62340b5560 con 0x7f62340b50e0 2024-05-30T06:52:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.371+0000 7f623aa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6234167830 con 0x7f62340b0c70 2024-05-30T06:52:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.371+0000 7f6233e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623406bea0 0x7f6234153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.371+0000 7f6233e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623406bea0 0x7f6234153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51366/0 (socket says 172.21.15.37:51366) 2024-05-30T06:52:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.371+0000 7f6233e00640 1 -- 172.21.15.37:0/2779175143 learned_addr learned my addr 172.21.15.37:0/2779175143 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.371+0000 7f6238a00640 1 --2- 172.21.15.37:0/2779175143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62340b50e0 0x7f623414b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.375+0000 7f6233e00640 1 -- 172.21.15.37:0/2779175143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62340b0c70 msgr2=0x7f62341526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.375+0000 7f6233e00640 1 --2- 172.21.15.37:0/2779175143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62340b0c70 0x7f62341526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.375+0000 7f6233e00640 1 -- 172.21.15.37:0/2779175143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62340b50e0 msgr2=0x7f623414b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.375+0000 7f6233e00640 1 --2- 172.21.15.37:0/2779175143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62340b50e0 0x7f623414b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.375+0000 7f6233e00640 1 -- 172.21.15.37:0/2779175143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6234151ee0 con 0x7f623406bea0 2024-05-30T06:52:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.375+0000 7f6233e00640 1 --2- 172.21.15.37:0/2779175143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623406bea0 0x7f6234153870 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f622400e870 tx=0x7f622400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.375+0000 7f6230c00640 1 -- 172.21.15.37:0/2779175143 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6224017070 con 0x7f623406bea0 2024-05-30T06:52:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.375+0000 7f6230c00640 1 -- 172.21.15.37:0/2779175143 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622400c8e0 con 0x7f623406bea0 2024-05-30T06:52:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.375+0000 7f6230c00640 1 -- 172.21.15.37:0/2779175143 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622400cc90 con 0x7f623406bea0 2024-05-30T06:52:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.375+0000 7f623aa00640 1 -- 172.21.15.37:0/2779175143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6234153fe0 con 0x7f623406bea0 2024-05-30T06:52:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.375+0000 7f623aa00640 1 -- 172.21.15.37:0/2779175143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62341545a0 con 0x7f623406bea0 2024-05-30T06:52:34.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.379+0000 7f623aa00640 1 -- 172.21.15.37:0/2779175143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6234068bc0 con 0x7f623406bea0 2024-05-30T06:52:34.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.383+0000 7f6230c00640 1 -- 172.21.15.37:0/2779175143 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f622401a070 con 0x7f623406bea0 2024-05-30T06:52:34.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.383+0000 7f6230c00640 1 --2- 172.21.15.37:0/2779175143 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f62100695c0 0x7f621006ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:34.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.383+0000 7f6230c00640 1 -- 172.21.15.37:0/2779175143 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f62240856a0 con 0x7f623406bea0 2024-05-30T06:52:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.395+0000 7f6230c00640 1 -- 172.21.15.37:0/2779175143 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6224056d10 con 0x7f623406bea0 2024-05-30T06:52:34.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.395+0000 7f622be00640 1 --2- 172.21.15.37:0/2779175143 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f62100695c0 0x7f621006ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:34.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.415+0000 7f622be00640 1 --2- 172.21.15.37:0/2779175143 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f62100695c0 0x7f621006ba80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f621c0ad000 tx=0x7f621c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:34.743+0000 7f623aa00640 1 -- 172.21.15.37:0/2779175143 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone371019", "target": ["mon-mgr", ""]}) -- 0x7f62340ce1b0 con 0x7f62100695c0 2024-05-30T06:52:35.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:52:35.087 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:52:35.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.271+0000 7f6230c00640 1 -- 172.21.15.37:0/2779175143 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f62340ce1b0 con 0x7f62100695c0 2024-05-30T06:52:35.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.275+0000 7f623aa00640 1 -- 172.21.15.37:0/2779175143 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f62100695c0 msgr2=0x7f621006ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:35.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.275+0000 7f623aa00640 1 --2- 172.21.15.37:0/2779175143 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f62100695c0 0x7f621006ba80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f621c0ad000 tx=0x7f621c008040 comp rx=0 tx=0).stop 2024-05-30T06:52:35.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.275+0000 7f623aa00640 1 -- 172.21.15.37:0/2779175143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623406bea0 msgr2=0x7f6234153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:35.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.275+0000 7f623aa00640 1 --2- 172.21.15.37:0/2779175143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623406bea0 0x7f6234153870 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f622400e870 tx=0x7f622400ec70 comp rx=0 tx=0).stop 2024-05-30T06:52:35.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.279+0000 7f623aa00640 1 -- 172.21.15.37:0/2779175143 shutdown_connections 2024-05-30T06:52:35.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.279+0000 7f623aa00640 1 --2- 172.21.15.37:0/2779175143 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f62100695c0 0x7f621006ba80 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:35.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.279+0000 7f623aa00640 1 --2- 172.21.15.37:0/2779175143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62340b50e0 0x7f623414b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:35.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.279+0000 7f623aa00640 1 --2- 172.21.15.37:0/2779175143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62340b0c70 0x7f62341526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:35.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.279+0000 7f623aa00640 1 --2- 172.21.15.37:0/2779175143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f623406bea0 0x7f6234153870 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:35.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.279+0000 7f623aa00640 1 -- 172.21.15.37:0/2779175143 >> 172.21.15.37:0/2779175143 conn(0x7f623406f110 msgr2=0x7f62340cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.279+0000 7f623aa00640 1 -- 172.21.15.37:0/2779175143 shutdown_connections 2024-05-30T06:52:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.279+0000 7f623aa00640 1 -- 172.21.15.37:0/2779175143 wait complete. 2024-05-30T06:52:35.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone371020 2024-05-30T06:52:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.511+0000 7f85ea200640 1 Processor -- start 2024-05-30T06:52:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.511+0000 7f85ea200640 1 -- start start 2024-05-30T06:52:35.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85ea200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85e4155da0 0x7f85e40cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:35.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85ea200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85e40cd440 0x7f85e406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:35.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85ea200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f85e406f5a0 0x7f85e40cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:35.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85ea200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f85e415f310 con 0x7f85e4155da0 2024-05-30T06:52:35.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85ea200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f85e415f5f0 con 0x7f85e406f5a0 2024-05-30T06:52:35.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85ea200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f85e415f8d0 con 0x7f85e40cd440 2024-05-30T06:52:35.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85e3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85e4155da0 0x7f85e40cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:35.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85e3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85e4155da0 0x7f85e40cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51380/0 (socket says 172.21.15.37:51380) 2024-05-30T06:52:35.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85e3400640 1 -- 172.21.15.37:0/356556839 learned_addr learned my addr 172.21.15.37:0/356556839 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:35.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85e2a00640 1 --2- 172.21.15.37:0/356556839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85e40cd440 0x7f85e406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:35.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85e3e00640 1 --2- 172.21.15.37:0/356556839 >> v2:172.21.15.105:3300/0 conn(0x7f85e406f5a0 0x7f85e40cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:35.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85e3400640 1 -- 172.21.15.37:0/356556839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85e40cd440 msgr2=0x7f85e406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:35.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85e3400640 1 --2- 172.21.15.37:0/356556839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85e40cd440 0x7f85e406f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:35.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85e3400640 1 -- 172.21.15.37:0/356556839 >> v2:172.21.15.105:3300/0 conn(0x7f85e406f5a0 msgr2=0x7f85e40cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:35.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85e3400640 1 --2- 172.21.15.37:0/356556839 >> v2:172.21.15.105:3300/0 conn(0x7f85e406f5a0 0x7f85e40cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:35.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.515+0000 7f85e3400640 1 -- 172.21.15.37:0/356556839 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e415fbb0 con 0x7f85e4155da0 2024-05-30T06:52:35.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.519+0000 7f85e3400640 1 --2- 172.21.15.37:0/356556839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e4155da0 0x7f85e40cd950 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f85e40cd0c0 tx=0x7f85cc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15abb341a05cad50 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:35.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.519+0000 7f85e2000640 1 -- 172.21.15.37:0/356556839 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0b0070 con 0x7f85e4155da0 2024-05-30T06:52:35.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.519+0000 7f85e2000640 1 -- 172.21.15.37:0/356556839 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc0a4e50 con 0x7f85e4155da0 2024-05-30T06:52:35.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.519+0000 7f85e2000640 1 -- 172.21.15.37:0/356556839 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0ab820 con 0x7f85e4155da0 2024-05-30T06:52:35.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.519+0000 7f85ea200640 1 -- 172.21.15.37:0/356556839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e4155da0 msgr2=0x7f85e40cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:35.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.523+0000 7f85ea200640 1 --2- 172.21.15.37:0/356556839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e4155da0 0x7f85e40cd950 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f85e40cd0c0 tx=0x7f85cc01c400 comp rx=0 tx=0).stop 2024-05-30T06:52:35.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.523+0000 7f85ea200640 1 -- 172.21.15.37:0/356556839 shutdown_connections 2024-05-30T06:52:35.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.523+0000 7f85ea200640 1 --2- 172.21.15.37:0/356556839 >> v2:172.21.15.105:3300/0 conn(0x7f85e406f5a0 0x7f85e40cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:35.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.523+0000 7f85ea200640 1 --2- 172.21.15.37:0/356556839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85e40cd440 0x7f85e406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:35.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.523+0000 7f85ea200640 1 --2- 172.21.15.37:0/356556839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e4155da0 0x7f85e40cd950 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:35.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.523+0000 7f85ea200640 1 -- 172.21.15.37:0/356556839 >> 172.21.15.37:0/356556839 conn(0x7f85e406bf60 msgr2=0x7f85e40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:35.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.523+0000 7f85ea200640 1 -- 172.21.15.37:0/356556839 shutdown_connections 2024-05-30T06:52:35.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.523+0000 7f85ea200640 1 -- 172.21.15.37:0/356556839 wait complete. 2024-05-30T06:52:35.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.523+0000 7f85ea200640 1 Processor -- start 2024-05-30T06:52:35.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.523+0000 7f85ea200640 1 -- start start 2024-05-30T06:52:35.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85ea200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406f5a0 0x7f85e4164720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:35.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85ea200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85e4155da0 0x7f85e4162a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:35.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85ea200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85e4203eb0 0x7f85e4160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:35.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85ea200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f85e40b3ae0 con 0x7f85e406f5a0 2024-05-30T06:52:35.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85ea200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f85e40b3960 con 0x7f85e4203eb0 2024-05-30T06:52:35.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85ea200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f85e40b3c60 con 0x7f85e4155da0 2024-05-30T06:52:35.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85e3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406f5a0 0x7f85e4164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:35.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85e3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406f5a0 0x7f85e4164720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51390/0 (socket says 172.21.15.37:51390) 2024-05-30T06:52:35.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85e3400640 1 -- 172.21.15.37:0/886888615 learned_addr learned my addr 172.21.15.37:0/886888615 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:35.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85e3400640 1 -- 172.21.15.37:0/886888615 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85e4155da0 msgr2=0x7f85e4162a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:35.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85e3400640 1 --2- 172.21.15.37:0/886888615 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85e4155da0 0x7f85e4162a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:35.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85e3400640 1 -- 172.21.15.37:0/886888615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85e4203eb0 msgr2=0x7f85e4160c10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:52:35.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85e3400640 1 --2- 172.21.15.37:0/886888615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85e4203eb0 0x7f85e4160c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:35.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85e3400640 1 -- 172.21.15.37:0/886888615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e4162fc0 con 0x7f85e406f5a0 2024-05-30T06:52:35.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85e3400640 1 --2- 172.21.15.37:0/886888615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406f5a0 0x7f85e4164720 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0ae040 tx=0x7f85cc01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:35.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85db400640 1 -- 172.21.15.37:0/886888615 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0ba020 con 0x7f85e406f5a0 2024-05-30T06:52:35.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85db400640 1 -- 172.21.15.37:0/886888615 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc0b6420 con 0x7f85e406f5a0 2024-05-30T06:52:35.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85db400640 1 -- 172.21.15.37:0/886888615 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85cc0b0040 con 0x7f85e406f5a0 2024-05-30T06:52:35.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85ea200640 1 -- 172.21.15.37:0/886888615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e4163260 con 0x7f85e406f5a0 2024-05-30T06:52:35.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.527+0000 7f85ea200640 1 -- 172.21.15.37:0/886888615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e4163820 con 0x7f85e406f5a0 2024-05-30T06:52:35.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.531+0000 7f85ea200640 1 -- 172.21.15.37:0/886888615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e4068bc0 con 0x7f85e406f5a0 2024-05-30T06:52:35.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.531+0000 7f85db400640 1 -- 172.21.15.37:0/886888615 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f85cc0bd020 con 0x7f85e406f5a0 2024-05-30T06:52:35.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.531+0000 7f85db400640 1 --2- 172.21.15.37:0/886888615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f85c0069540 0x7f85c006ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:35.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.531+0000 7f85db400640 1 -- 172.21.15.37:0/886888615 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f85cc11f8e0 con 0x7f85e406f5a0 2024-05-30T06:52:35.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.531+0000 7f85e2a00640 1 --2- 172.21.15.37:0/886888615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f85c0069540 0x7f85c006ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.535+0000 7f85e2a00640 1 --2- 172.21.15.37:0/886888615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f85c0069540 0x7f85c006ba00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f85e415ee00 tx=0x7f85d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:35.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.539+0000 7f85db400640 1 -- 172.21.15.37:0/886888615 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f85cc0c4030 con 0x7f85e406f5a0 2024-05-30T06:52:35.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:35.855+0000 7f85ea200640 1 -- 172.21.15.37:0/886888615 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone371020", "target": ["mon-mgr", ""]}) -- 0x7f85e40b6790 con 0x7f85c0069540 2024-05-30T06:52:36.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.075+0000 7f85db400640 1 -- 172.21.15.37:0/886888615 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f85e40b6790 con 0x7f85c0069540 2024-05-30T06:52:36.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.075+0000 7f85ea200640 1 -- 172.21.15.37:0/886888615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f85c0069540 msgr2=0x7f85c006ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.075+0000 7f85ea200640 1 --2- 172.21.15.37:0/886888615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f85c0069540 0x7f85c006ba00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f85e415ee00 tx=0x7f85d4008040 comp rx=0 tx=0).stop 2024-05-30T06:52:36.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.075+0000 7f85ea200640 1 -- 172.21.15.37:0/886888615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406f5a0 msgr2=0x7f85e4164720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.075+0000 7f85ea200640 1 --2- 172.21.15.37:0/886888615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406f5a0 0x7f85e4164720 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0ae040 tx=0x7f85cc01ac40 comp rx=0 tx=0).stop 2024-05-30T06:52:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.075+0000 7f85ea200640 1 -- 172.21.15.37:0/886888615 shutdown_connections 2024-05-30T06:52:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.075+0000 7f85ea200640 1 --2- 172.21.15.37:0/886888615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f85c0069540 0x7f85c006ba00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.075+0000 7f85ea200640 1 --2- 172.21.15.37:0/886888615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85e4203eb0 0x7f85e4160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.075+0000 7f85ea200640 1 --2- 172.21.15.37:0/886888615 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85e4155da0 0x7f85e4162a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.075+0000 7f85ea200640 1 --2- 172.21.15.37:0/886888615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e406f5a0 0x7f85e4164720 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.075+0000 7f85ea200640 1 -- 172.21.15.37:0/886888615 >> 172.21.15.37:0/886888615 conn(0x7f85e406bf60 msgr2=0x7f85e4164e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.075+0000 7f85ea200640 1 -- 172.21.15.37:0/886888615 shutdown_connections 2024-05-30T06:52:36.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.075+0000 7f85ea200640 1 -- 172.21.15.37:0/886888615 wait complete. 2024-05-30T06:52:36.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:52:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff7c00640 1 Processor -- start 2024-05-30T06:52:36.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff7c00640 1 -- start start 2024-05-30T06:52:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff7c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcff015c650 0x7fcff00d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff7c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff00b2890 0x7fcff00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff7c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff00b3f40 con 0x7fcff015ca30 2024-05-30T06:52:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff7c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcff00cce80 con 0x7fcff015c650 2024-05-30T06:52:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff7c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcff00b2ec0 con 0x7fcff00b2890 2024-05-30T06:52:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff5200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcff015c650 0x7fcff00d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcfefe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcff015ca30 0x7fcff00b2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54078/0 (socket says 172.21.15.37:54078) 2024-05-30T06:52:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcfefe00640 1 -- 172.21.15.37:0/912048012 learned_addr learned my addr 172.21.15.37:0/912048012 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff5200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcff015c650 0x7fcff00d09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51392/0 (socket says 172.21.15.37:51392) 2024-05-30T06:52:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff5c00640 1 --2- 172.21.15.37:0/912048012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff00b2890 0x7fcff00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcfef400640 1 -- 172.21.15.37:0/912048012 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443247438 0 0) 0x7fcff00b3f40 con 0x7fcff015ca30 2024-05-30T06:52:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff5200640 1 -- 172.21.15.37:0/912048012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff00b2890 msgr2=0x7fcff00d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff5200640 1 --2- 172.21.15.37:0/912048012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff00b2890 0x7fcff00d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff5200640 1 -- 172.21.15.37:0/912048012 >> v1:172.21.15.37:6789/0 conn(0x7fcff015ca30 legacy=0x7fcff00b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.243+0000 7fcff5200640 1 -- 172.21.15.37:0/912048012 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff00b3180 con 0x7fcff015c650 2024-05-30T06:52:36.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.247+0000 7fcff5200640 1 --2- 172.21.15.37:0/912048012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff015c650 0x7fcff00d09e0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40097c0 tx=0x7fcfe401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110b4f2336c41c40 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:36.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.247+0000 7fcfef400640 1 -- 172.21.15.37:0/912048012 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40b5070 con 0x7fcff015c650 2024-05-30T06:52:36.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.247+0000 7fcfef400640 1 -- 172.21.15.37:0/912048012 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe40a8990 con 0x7fcff015c650 2024-05-30T06:52:36.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.247+0000 7fcfef400640 1 -- 172.21.15.37:0/912048012 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40a8d60 con 0x7fcff015c650 2024-05-30T06:52:36.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.247+0000 7fcff7c00640 1 -- 172.21.15.37:0/912048012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff015c650 msgr2=0x7fcff00d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.247+0000 7fcff7c00640 1 --2- 172.21.15.37:0/912048012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff015c650 0x7fcff00d09e0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40097c0 tx=0x7fcfe401ec90 comp rx=0 tx=0).stop 2024-05-30T06:52:36.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.247+0000 7fcff7c00640 1 -- 172.21.15.37:0/912048012 shutdown_connections 2024-05-30T06:52:36.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.247+0000 7fcff7c00640 1 --2- 172.21.15.37:0/912048012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff00b2890 0x7fcff00d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.247+0000 7fcff7c00640 1 --2- 172.21.15.37:0/912048012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff015c650 0x7fcff00d09e0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.247+0000 7fcff7c00640 1 -- 172.21.15.37:0/912048012 >> 172.21.15.37:0/912048012 conn(0x7fcff00b4130 msgr2=0x7fcff00b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:36.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.247+0000 7fcff7c00640 1 -- 172.21.15.37:0/912048012 shutdown_connections 2024-05-30T06:52:36.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.247+0000 7fcff7c00640 1 -- 172.21.15.37:0/912048012 wait complete. 2024-05-30T06:52:36.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff7c00640 1 Processor -- start 2024-05-30T06:52:36.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff7c00640 1 -- start start 2024-05-30T06:52:36.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff7c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff00b2890 0x7fcff00cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:36.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff7c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff015c650 0x7fcff015f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:36.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff7c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff015ca30 0x7fcff015ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:36.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff7c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcff00b3a20 con 0x7fcff00b2890 2024-05-30T06:52:36.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff7c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcff00b3740 con 0x7fcff015c650 2024-05-30T06:52:36.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff7c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcff00af410 con 0x7fcff015ca30 2024-05-30T06:52:36.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff00b2890 0x7fcff00cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:36.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff00b2890 0x7fcff00cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51394/0 (socket says 172.21.15.37:51394) 2024-05-30T06:52:36.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff5200640 1 -- 172.21.15.37:0/400662300 learned_addr learned my addr 172.21.15.37:0/400662300 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:36.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcfefe00640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff015c650 0x7fcff015f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:36.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff5c00640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff015ca30 0x7fcff015ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:36.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff5200640 1 -- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff015ca30 msgr2=0x7fcff015ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff5200640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff015ca30 0x7fcff015ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff5200640 1 -- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff015c650 msgr2=0x7fcff015f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff5200640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff015c650 0x7fcff015f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff5200640 1 -- 172.21.15.37:0/400662300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff00cbfe0 con 0x7fcff00b2890 2024-05-30T06:52:36.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff5200640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff00b2890 0x7fcff00cb6b0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40b3040 tx=0x7fcfe401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:36.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcfecc00640 1 -- 172.21.15.37:0/400662300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40c0070 con 0x7fcff00b2890 2024-05-30T06:52:36.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcfecc00640 1 -- 172.21.15.37:0/400662300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe4004230 con 0x7fcff00b2890 2024-05-30T06:52:36.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff7c00640 1 -- 172.21.15.37:0/400662300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff00cc570 con 0x7fcff00b2890 2024-05-30T06:52:36.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcfecc00640 1 -- 172.21.15.37:0/400662300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40b5040 con 0x7fcff00b2890 2024-05-30T06:52:36.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.251+0000 7fcff7c00640 1 -- 172.21.15.37:0/400662300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff00cd390 con 0x7fcff00b2890 2024-05-30T06:52:36.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.255+0000 7fcff7c00640 1 -- 172.21.15.37:0/400662300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff0068bc0 con 0x7fcff00b2890 2024-05-30T06:52:36.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.255+0000 7fcfecc00640 1 -- 172.21.15.37:0/400662300 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7fcfe40c3070 con 0x7fcff00b2890 2024-05-30T06:52:36.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.255+0000 7fcfecc00640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfd00694f0 0x7fcfd006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:36.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.255+0000 7fcfecc00640 1 -- 172.21.15.37:0/400662300 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fcfe4121ec0 con 0x7fcff00b2890 2024-05-30T06:52:36.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.255+0000 7fcfefe00640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfd00694f0 0x7fcfd006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:36.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.255+0000 7fcfefe00640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfd00694f0 0x7fcfd006b9b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcff015a7c0 tx=0x7fcfdc007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:36.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.259+0000 7fcfecc00640 1 -- 172.21.15.37:0/400662300 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcfe40187f0 con 0x7fcff00b2890 2024-05-30T06:52:36.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.447+0000 7fcff7c00640 1 -- 172.21.15.37:0/400662300 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fcff00b85a0 con 0x7fcfd00694f0 2024-05-30T06:52:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.447+0000 7fcfecc00640 1 -- 172.21.15.37:0/400662300 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fcff00b85a0 con 0x7fcfd00694f0 2024-05-30T06:52:36.452 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:52:36.452 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:36.452 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:52:36.453 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:36.453 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:52:36.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.451+0000 7fcff7c00640 1 -- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfd00694f0 msgr2=0x7fcfd006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.451+0000 7fcff7c00640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfd00694f0 0x7fcfd006b9b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcff015a7c0 tx=0x7fcfdc007df0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.451+0000 7fcff7c00640 1 -- 172.21.15.37:0/400662300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff00b2890 msgr2=0x7fcff00cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.451+0000 7fcff7c00640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff00b2890 0x7fcff00cb6b0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40b3040 tx=0x7fcfe401ba30 comp rx=0 tx=0).stop 2024-05-30T06:52:36.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.451+0000 7fcff7c00640 1 -- 172.21.15.37:0/400662300 shutdown_connections 2024-05-30T06:52:36.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.451+0000 7fcff7c00640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff015ca30 0x7fcff015ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.451+0000 7fcff7c00640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfd00694f0 0x7fcfd006b9b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.451+0000 7fcff7c00640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff015c650 0x7fcff015f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.451+0000 7fcff7c00640 1 --2- 172.21.15.37:0/400662300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff00b2890 0x7fcff00cb6b0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.451+0000 7fcff7c00640 1 -- 172.21.15.37:0/400662300 >> 172.21.15.37:0/400662300 conn(0x7fcff00b4130 msgr2=0x7fcff006e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:36.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.451+0000 7fcff7c00640 1 -- 172.21.15.37:0/400662300 shutdown_connections 2024-05-30T06:52:36.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.451+0000 7fcff7c00640 1 -- 172.21.15.37:0/400662300 wait complete. 2024-05-30T06:52:36.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:52:36.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.611+0000 7f83ff200640 1 Processor -- start 2024-05-30T06:52:36.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.611+0000 7f83ff200640 1 -- start start 2024-05-30T06:52:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.611+0000 7f83ff200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8400161fc0 0x7f84000d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.611+0000 7f83ff200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f840006dc60 con 0x7f84000cd1c0 2024-05-30T06:52:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.611+0000 7f83ff200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84000d0790 con 0x7f840006d480 2024-05-30T06:52:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.611+0000 7f83ff200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f84000d10c0 con 0x7f8400161fc0 2024-05-30T06:52:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.611+0000 7f83fde00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8400161fc0 0x7f84000d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.611+0000 7f83fe800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f84000cd1c0 0x7f8400162570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54082/0 (socket says 172.21.15.37:54082) 2024-05-30T06:52:36.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.611+0000 7f83fe800640 1 -- 172.21.15.37:0/2198135731 learned_addr learned my addr 172.21.15.37:0/2198135731 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.611+0000 7f83fde00640 1 -- 172.21.15.37:0/2198135731 >> v1:172.21.15.105:6789/0 conn(0x7f840006d480 legacy=0x7f84000ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.611+0000 7f83fde00640 1 -- 172.21.15.37:0/2198135731 >> v1:172.21.15.37:6789/0 conn(0x7f84000cd1c0 legacy=0x7f8400162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.611+0000 7f83fde00640 1 -- 172.21.15.37:0/2198135731 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84000d0a70 con 0x7f8400161fc0 2024-05-30T06:52:36.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.611+0000 7f83fd400640 1 -- 172.21.15.37:0/2198135731 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 699908400 0 0) 0x7f840006dc60 con 0x7f84000cd1c0 2024-05-30T06:52:36.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.615+0000 7f83fde00640 1 --2- 172.21.15.37:0/2198135731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8400161fc0 0x7f84000d1550 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f83f0009d90 tx=0x7f83f001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538825eed0c9378 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:36.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.615+0000 7f83fd400640 1 -- 172.21.15.37:0/2198135731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f00b2070 con 0x7f8400161fc0 2024-05-30T06:52:36.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.615+0000 7f83fd400640 1 -- 172.21.15.37:0/2198135731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f00a5710 con 0x7f8400161fc0 2024-05-30T06:52:36.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.615+0000 7f83fd400640 1 -- 172.21.15.37:0/2198135731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f00a5ae0 con 0x7f8400161fc0 2024-05-30T06:52:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.615+0000 7f83ff200640 1 -- 172.21.15.37:0/2198135731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8400161fc0 msgr2=0x7f84000d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.615+0000 7f83ff200640 1 --2- 172.21.15.37:0/2198135731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8400161fc0 0x7f84000d1550 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f83f0009d90 tx=0x7f83f001c930 comp rx=0 tx=0).stop 2024-05-30T06:52:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.615+0000 7f83ff200640 1 -- 172.21.15.37:0/2198135731 shutdown_connections 2024-05-30T06:52:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.615+0000 7f83ff200640 1 --2- 172.21.15.37:0/2198135731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8400161fc0 0x7f84000d1550 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.615+0000 7f83ff200640 1 -- 172.21.15.37:0/2198135731 >> 172.21.15.37:0/2198135731 conn(0x7f84000b3f50 msgr2=0x7f84000b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:36.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.615+0000 7f83ff200640 1 -- 172.21.15.37:0/2198135731 shutdown_connections 2024-05-30T06:52:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.615+0000 7f83ff200640 1 -- 172.21.15.37:0/2198135731 wait complete. 2024-05-30T06:52:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83ff200640 1 Processor -- start 2024-05-30T06:52:36.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83ff200640 1 -- start start 2024-05-30T06:52:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83ff200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f840006d480 0x7f84000b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83ff200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cd1c0 0x7f8400158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83ff200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8400161fc0 0x7f84000b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83ff200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f840016ca40 con 0x7f84000cd1c0 2024-05-30T06:52:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83ff200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f840016c8c0 con 0x7f840006d480 2024-05-30T06:52:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83ff200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f840016cbc0 con 0x7f8400161fc0 2024-05-30T06:52:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83f5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cd1c0 0x7f8400158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83f5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cd1c0 0x7f8400158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51414/0 (socket says 172.21.15.37:51414) 2024-05-30T06:52:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83f5400640 1 -- 172.21.15.37:0/4212144505 learned_addr learned my addr 172.21.15.37:0/4212144505 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:36.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83fde00640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f840006d480 0x7f84000b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83fe800640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8400161fc0 0x7f84000b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83f5400640 1 -- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8400161fc0 msgr2=0x7f84000b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83f5400640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8400161fc0 0x7f84000b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83f5400640 1 -- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f840006d480 msgr2=0x7f84000b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83f5400640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f840006d480 0x7f84000b7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83f5400640 1 -- 172.21.15.37:0/4212144505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84000b5140 con 0x7f84000cd1c0 2024-05-30T06:52:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83fe800640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8400161fc0 0x7f84000b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:52:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83f5400640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cd1c0 0x7f8400158f10 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f83e800c490 tx=0x7f83e8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83f6a00640 1 -- 172.21.15.37:0/4212144505 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8017070 con 0x7f84000cd1c0 2024-05-30T06:52:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83f6a00640 1 -- 172.21.15.37:0/4212144505 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e8003600 con 0x7f84000cd1c0 2024-05-30T06:52:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83f6a00640 1 -- 172.21.15.37:0/4212144505 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8003a30 con 0x7f84000cd1c0 2024-05-30T06:52:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83ff200640 1 -- 172.21.15.37:0/4212144505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84000b5420 con 0x7f84000cd1c0 2024-05-30T06:52:36.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83ff200640 1 -- 172.21.15.37:0/4212144505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84000b59e0 con 0x7f84000cd1c0 2024-05-30T06:52:36.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.619+0000 7f83ff200640 1 -- 172.21.15.37:0/4212144505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8400068ab0 con 0x7f84000cd1c0 2024-05-30T06:52:36.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.623+0000 7f83f6a00640 1 -- 172.21.15.37:0/4212144505 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f83e8003bd0 con 0x7f84000cd1c0 2024-05-30T06:52:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.623+0000 7f83f6a00640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f83dc069520 0x7f83dc06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.623+0000 7f83f6a00640 1 -- 172.21.15.37:0/4212144505 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f83e8084ad0 con 0x7f84000cd1c0 2024-05-30T06:52:36.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.623+0000 7f83fde00640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f83dc069520 0x7f83dc06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:36.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.623+0000 7f83fde00640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f83dc069520 0x7f83dc06b9e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f83f00af000 tx=0x7f83f00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:36.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.627+0000 7f83f6a00640 1 -- 172.21.15.37:0/4212144505 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f83e8056140 con 0x7f84000cd1c0 2024-05-30T06:52:36.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.851+0000 7f83ff200640 1 -- 172.21.15.37:0/4212144505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f84000b83e0 con 0x7f84000cd1c0 2024-05-30T06:52:36.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.851+0000 7f83f6a00640 1 -- 172.21.15.37:0/4212144505 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2418 (secure 0 0 0) 0x7f83e805a440 con 0x7f84000cd1c0 2024-05-30T06:52:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:52:36.856 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:52:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:52:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:52:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:52:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:52:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:52:36.856 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:52:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:52:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:52:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:52:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:52:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:52:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:52:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:52:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:52:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 651, 2024-05-30T06:52:36.857 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:52:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:52:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:52:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:52:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:52:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:52:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:52:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:52:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:52:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:52:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:52:36.858 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 11488, 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 47962227587, 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 96067379200, 2024-05-30T06:52:36.859 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 677026734080, 2024-05-30T06:52:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:52:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 850962595, 2024-05-30T06:52:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 835336636, 2024-05-30T06:52:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 209, 2024-05-30T06:52:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 228 2024-05-30T06:52:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:52:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:52:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:52:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:52:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:52:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:52:36.860 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:52:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:52:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:52:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:52:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:52:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:52:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:52:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:52:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:52:36.861 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 12, 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:51:42.820933+0000", 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:52:36.862 INFO:teuthology.orchestra.run.smithi037.stdout: "37467ab0-9e28-4c72-9193-e79e68c05454": { 2024-05-30T06:52:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "3 ongoing+pending clones; Avg progress is 24.826% (64s)\n [======......................] (remaining: 3m)", 2024-05-30T06:52:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.2482600063085556, 2024-05-30T06:52:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:52:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "3 ongoing clones; Avg progress is 24.826% (70s)\n [======......................] (remaining: 3m)", 2024-05-30T06:52:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.2482600063085556, 2024-05-30T06:52:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:36.863 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:36.863 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:52:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.855+0000 7f83ff200640 1 -- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f83dc069520 msgr2=0x7f83dc06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.855+0000 7f83ff200640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f83dc069520 0x7f83dc06b9e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f83f00af000 tx=0x7f83f00a7070 comp rx=0 tx=0).stop 2024-05-30T06:52:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.855+0000 7f83ff200640 1 -- 172.21.15.37:0/4212144505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cd1c0 msgr2=0x7f8400158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.855+0000 7f83ff200640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cd1c0 0x7f8400158f10 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f83e800c490 tx=0x7f83e8001e80 comp rx=0 tx=0).stop 2024-05-30T06:52:36.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.855+0000 7f83ff200640 1 -- 172.21.15.37:0/4212144505 shutdown_connections 2024-05-30T06:52:36.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.855+0000 7f83ff200640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8400161fc0 0x7f84000b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.855+0000 7f83ff200640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84000cd1c0 0x7f8400158f10 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.855+0000 7f83ff200640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f83dc069520 0x7f83dc06b9e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.855+0000 7f83ff200640 1 --2- 172.21.15.37:0/4212144505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f840006d480 0x7f84000b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:36.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.855+0000 7f83ff200640 1 -- 172.21.15.37:0/4212144505 >> 172.21.15.37:0/4212144505 conn(0x7f84000b3f50 msgr2=0x7f84000cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:36.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.855+0000 7f83ff200640 1 -- 172.21.15.37:0/4212144505 shutdown_connections 2024-05-30T06:52:36.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:36.855+0000 7f83ff200640 1 -- 172.21.15.37:0/4212144505 wait complete. 2024-05-30T06:52:41.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:52:42.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.027+0000 7fa3a7c00640 1 Processor -- start 2024-05-30T06:52:42.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.027+0000 7fa3a7c00640 1 -- start start 2024-05-30T06:52:42.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.027+0000 7fa3a7c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3a006f9a0 0x7fa3a00b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:42.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.027+0000 7fa3a7c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa3a00b2ec0 0x7fa3a00cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:42.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.027+0000 7fa3a7c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a015c8f0 con 0x7fa3a0155e60 2024-05-30T06:52:42.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.027+0000 7fa3a7c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a00ccff0 con 0x7fa3a00b2ec0 2024-05-30T06:52:42.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.027+0000 7fa3a7c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a00ccc80 con 0x7fa3a006f9a0 2024-05-30T06:52:42.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.027+0000 7fa3a5200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa3a0155e60 0x7fa3a00cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53660/0 (socket says 172.21.15.37:53660) 2024-05-30T06:52:42.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.027+0000 7fa3a5200640 1 -- 172.21.15.37:0/962060341 learned_addr learned my addr 172.21.15.37:0/962060341 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:42.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.027+0000 7fa397e00640 1 --2- 172.21.15.37:0/962060341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3a006f9a0 0x7fa3a00b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:42.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.027+0000 7fa3a5c00640 1 --2- 172.21.15.37:0/962060341 >> v2:172.21.15.105:3300/0 conn(0x7fa3a00b2ec0 0x7fa3a00cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:42.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.027+0000 7fa39fe00640 1 -- 172.21.15.37:0/962060341 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1679211929 0 0) 0x7fa3a015c8f0 con 0x7fa3a0155e60 2024-05-30T06:52:42.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.031+0000 7fa39fe00640 1 -- 172.21.15.37:0/962060341 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa384003530 con 0x7fa3a0155e60 2024-05-30T06:52:42.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.031+0000 7fa3a5c00640 1 -- 172.21.15.37:0/962060341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3a006f9a0 msgr2=0x7fa3a00b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:42.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.031+0000 7fa3a5c00640 1 --2- 172.21.15.37:0/962060341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3a006f9a0 0x7fa3a00b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:42.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.031+0000 7fa3a5c00640 1 -- 172.21.15.37:0/962060341 >> v1:172.21.15.37:6789/0 conn(0x7fa3a0155e60 legacy=0x7fa3a00cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:42.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.031+0000 7fa3a5c00640 1 -- 172.21.15.37:0/962060341 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a015cbd0 con 0x7fa3a00b2ec0 2024-05-30T06:52:42.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.031+0000 7fa397e00640 1 --2- 172.21.15.37:0/962060341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3a006f9a0 0x7fa3a00b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:52:42.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.031+0000 7fa3a5c00640 1 --2- 172.21.15.37:0/962060341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a00b2ec0 0x7fa3a00cd480 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa398009d90 tx=0x7fa39801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=806185e903b93f95 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:42.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.031+0000 7fa39fe00640 1 -- 172.21.15.37:0/962060341 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3980b2070 con 0x7fa3a00b2ec0 2024-05-30T06:52:42.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.031+0000 7fa39fe00640 1 -- 172.21.15.37:0/962060341 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3980a5940 con 0x7fa3a00b2ec0 2024-05-30T06:52:42.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.031+0000 7fa39fe00640 1 -- 172.21.15.37:0/962060341 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3980a5d10 con 0x7fa3a00b2ec0 2024-05-30T06:52:42.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 -- 172.21.15.37:0/962060341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a00b2ec0 msgr2=0x7fa3a00cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:42.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 --2- 172.21.15.37:0/962060341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a00b2ec0 0x7fa3a00cd480 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa398009d90 tx=0x7fa39801c970 comp rx=0 tx=0).stop 2024-05-30T06:52:42.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 -- 172.21.15.37:0/962060341 shutdown_connections 2024-05-30T06:52:42.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 --2- 172.21.15.37:0/962060341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a00b2ec0 0x7fa3a00cd480 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:42.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 --2- 172.21.15.37:0/962060341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3a006f9a0 0x7fa3a00b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:42.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 -- 172.21.15.37:0/962060341 >> 172.21.15.37:0/962060341 conn(0x7fa3a00b23a0 msgr2=0x7fa3a00b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:42.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 -- 172.21.15.37:0/962060341 shutdown_connections 2024-05-30T06:52:42.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 -- 172.21.15.37:0/962060341 wait complete. 2024-05-30T06:52:42.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 Processor -- start 2024-05-30T06:52:42.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 -- start start 2024-05-30T06:52:42.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a006f9a0 0x7fa3a014d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:42.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3a00b2ec0 0x7fa3a0157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:42.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a0155e60 0x7fa3a00afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:42.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a006ea10 con 0x7fa3a006f9a0 2024-05-30T06:52:42.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a006e890 con 0x7fa3a0155e60 2024-05-30T06:52:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a7c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a006eb90 con 0x7fa3a00b2ec0 2024-05-30T06:52:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a006f9a0 0x7fa3a014d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a006f9a0 0x7fa3a014d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44544/0 (socket says 172.21.15.37:44544) 2024-05-30T06:52:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a5200640 1 -- 172.21.15.37:0/4084032991 learned_addr learned my addr 172.21.15.37:0/4084032991 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a5c00640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a0155e60 0x7fa3a00afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa397e00640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3a00b2ec0 0x7fa3a0157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a5200640 1 -- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3a00b2ec0 msgr2=0x7fa3a0157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a5200640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3a00b2ec0 0x7fa3a0157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a5200640 1 -- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a0155e60 msgr2=0x7fa3a00afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a5200640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a0155e60 0x7fa3a00afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:42.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a5200640 1 -- 172.21.15.37:0/4084032991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a01654b0 con 0x7fa3a006f9a0 2024-05-30T06:52:42.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.035+0000 7fa3a5200640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a006f9a0 0x7fa3a014d0e0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fa39000c3c0 tx=0x7fa39000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.039+0000 7fa39d600640 1 -- 172.21.15.37:0/4084032991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390017070 con 0x7fa3a006f9a0 2024-05-30T06:52:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.039+0000 7fa39d600640 1 -- 172.21.15.37:0/4084032991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa390005cf0 con 0x7fa3a006f9a0 2024-05-30T06:52:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.039+0000 7fa39d600640 1 -- 172.21.15.37:0/4084032991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3900072f0 con 0x7fa3a006f9a0 2024-05-30T06:52:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.039+0000 7fa3a7c00640 1 -- 172.21.15.37:0/4084032991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a0165790 con 0x7fa3a006f9a0 2024-05-30T06:52:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.039+0000 7fa3a7c00640 1 -- 172.21.15.37:0/4084032991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a0157740 con 0x7fa3a006f9a0 2024-05-30T06:52:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.039+0000 7fa3a7c00640 1 -- 172.21.15.37:0/4084032991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a0068b20 con 0x7fa3a006f9a0 2024-05-30T06:52:42.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.039+0000 7fa39d600640 1 -- 172.21.15.37:0/4084032991 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7fa39001a070 con 0x7fa3a006f9a0 2024-05-30T06:52:42.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.039+0000 7fa39d600640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa37c0694f0 0x7fa37c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:42.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.039+0000 7fa39d600640 1 -- 172.21.15.37:0/4084032991 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fa390084c60 con 0x7fa3a006f9a0 2024-05-30T06:52:42.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.039+0000 7fa397e00640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa37c0694f0 0x7fa37c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:42.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.043+0000 7fa397e00640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa37c0694f0 0x7fa37c06b9b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa388009580 tx=0x7fa388009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:42.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.043+0000 7fa39d600640 1 -- 172.21.15.37:0/4084032991 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa3900562d0 con 0x7fa3a006f9a0 2024-05-30T06:52:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa3a7c00640 1 -- 172.21.15.37:0/4084032991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa3a0072fb0 con 0x7fa3a006f9a0 2024-05-30T06:52:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa39d600640 1 -- 172.21.15.37:0/4084032991 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2380 (secure 0 0 0) 0x7fa39005a5d0 con 0x7fa3a006f9a0 2024-05-30T06:52:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:52:42.274 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:52:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:52:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:52:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:52:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:52:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:52:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:52:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:52:42.274 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 656, 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:52:42.275 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:52:42.276 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 11793, 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 49262614392, 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 99079086080, 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 674015027200, 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 609660094, 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 602398346, 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 151, 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 170 2024-05-30T06:52:42.277 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:52:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:52:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:52:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:52:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:52:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:52:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:52:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:52:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:52:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:52:42.278 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:42.279 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 12, 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:51:42.820933+0000", 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "37467ab0-9e28-4c72-9193-e79e68c05454": { 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 26.0 seconds before exiting (71s)\n [============================] ", 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:52:42.280 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 26.0 seconds before exiting (76s)\n [============================] ", 2024-05-30T06:52:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:52:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:42.281 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:42.281 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:52:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa3a7c00640 1 -- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa37c0694f0 msgr2=0x7fa37c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa3a7c00640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa37c0694f0 0x7fa37c06b9b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa388009580 tx=0x7fa388009190 comp rx=0 tx=0).stop 2024-05-30T06:52:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa3a7c00640 1 -- 172.21.15.37:0/4084032991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a006f9a0 msgr2=0x7fa3a014d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa3a7c00640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a006f9a0 0x7fa3a014d0e0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fa39000c3c0 tx=0x7fa39000c880 comp rx=0 tx=0).stop 2024-05-30T06:52:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa3a7c00640 1 -- 172.21.15.37:0/4084032991 shutdown_connections 2024-05-30T06:52:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa3a7c00640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa37c0694f0 0x7fa37c06b9b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa3a7c00640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa3a0155e60 0x7fa3a00afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa3a7c00640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3a00b2ec0 0x7fa3a0157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa3a7c00640 1 --2- 172.21.15.37:0/4084032991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a006f9a0 0x7fa3a014d0e0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa3a7c00640 1 -- 172.21.15.37:0/4084032991 >> 172.21.15.37:0/4084032991 conn(0x7fa3a00b23a0 msgr2=0x7fa3a0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa3a7c00640 1 -- 172.21.15.37:0/4084032991 shutdown_connections 2024-05-30T06:52:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:42.271+0000 7fa3a7c00640 1 -- 172.21.15.37:0/4084032991 wait complete. 2024-05-30T06:52:47.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:52:47.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c5a800640 1 Processor -- start 2024-05-30T06:52:47.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c5a800640 1 -- start start 2024-05-30T06:52:47.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c5a800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8c5406f9a0 0x7f8c540b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:47.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c5a800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c540b2ec0 0x7f8c540cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:47.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c5a800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c5415c8f0 con 0x7f8c54155e60 2024-05-30T06:52:47.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c5a800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8c540ccff0 con 0x7f8c540b2ec0 2024-05-30T06:52:47.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c5a800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8c540ccc80 con 0x7f8c5406f9a0 2024-05-30T06:52:47.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c53e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c540b2ec0 0x7f8c540cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:47.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c53e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c540b2ec0 0x7f8c540cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45462/0 (socket says 172.21.15.37:45462) 2024-05-30T06:52:47.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c53e00640 1 -- 172.21.15.37:0/650829250 learned_addr learned my addr 172.21.15.37:0/650829250 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:47.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c53400640 1 --1- 172.21.15.37:0/650829250 >> v1:172.21.15.37:6789/0 conn(0x7f8c54155e60 0x7f8c540cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35616/0 (socket says 172.21.15.37:35616) 2024-05-30T06:52:47.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c4be00640 1 --2- 172.21.15.37:0/650829250 >> v2:172.21.15.105:3300/0 conn(0x7f8c5406f9a0 0x7f8c540b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:47.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c53e00640 1 -- 172.21.15.37:0/650829250 >> v2:172.21.15.105:3300/0 conn(0x7f8c5406f9a0 msgr2=0x7f8c540b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:47.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c53e00640 1 --2- 172.21.15.37:0/650829250 >> v2:172.21.15.105:3300/0 conn(0x7f8c5406f9a0 0x7f8c540b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:47.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c53e00640 1 -- 172.21.15.37:0/650829250 >> v1:172.21.15.37:6789/0 conn(0x7f8c54155e60 legacy=0x7f8c540cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:47.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c53e00640 1 -- 172.21.15.37:0/650829250 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5415cbd0 con 0x7f8c540b2ec0 2024-05-30T06:52:47.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c52a00640 1 -- 172.21.15.37:0/650829250 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1300836466 0 0) 0x7f8c5415c8f0 con 0x7f8c54155e60 2024-05-30T06:52:47.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.447+0000 7f8c4be00640 1 --2- 172.21.15.37:0/650829250 >> v2:172.21.15.105:3300/0 conn(0x7f8c5406f9a0 0x7f8c540b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:52:47.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.451+0000 7f8c53e00640 1 --2- 172.21.15.37:0/650829250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c540b2ec0 0x7f8c540cd480 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f8c5406e820 tx=0x7f8c4c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2809e3e8a2b1191 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:47.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.451+0000 7f8c52a00640 1 -- 172.21.15.37:0/650829250 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c0a57d0 con 0x7f8c540b2ec0 2024-05-30T06:52:47.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.451+0000 7f8c52a00640 1 -- 172.21.15.37:0/650829250 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c4c0a5970 con 0x7f8c540b2ec0 2024-05-30T06:52:47.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.451+0000 7f8c52a00640 1 -- 172.21.15.37:0/650829250 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c0a5d40 con 0x7f8c540b2ec0 2024-05-30T06:52:47.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.451+0000 7f8c5a800640 1 -- 172.21.15.37:0/650829250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c540b2ec0 msgr2=0x7f8c540cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:47.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.451+0000 7f8c5a800640 1 --2- 172.21.15.37:0/650829250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c540b2ec0 0x7f8c540cd480 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f8c5406e820 tx=0x7f8c4c01c9f0 comp rx=0 tx=0).stop 2024-05-30T06:52:47.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.451+0000 7f8c5a800640 1 -- 172.21.15.37:0/650829250 shutdown_connections 2024-05-30T06:52:47.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.451+0000 7f8c5a800640 1 --2- 172.21.15.37:0/650829250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c540b2ec0 0x7f8c540cd480 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:47.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.451+0000 7f8c5a800640 1 --2- 172.21.15.37:0/650829250 >> v2:172.21.15.105:3300/0 conn(0x7f8c5406f9a0 0x7f8c540b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:47.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.451+0000 7f8c5a800640 1 -- 172.21.15.37:0/650829250 >> 172.21.15.37:0/650829250 conn(0x7f8c540b23a0 msgr2=0x7f8c540b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:47.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.451+0000 7f8c5a800640 1 -- 172.21.15.37:0/650829250 shutdown_connections 2024-05-30T06:52:47.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.451+0000 7f8c5a800640 1 -- 172.21.15.37:0/650829250 wait complete. 2024-05-30T06:52:47.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c5a800640 1 Processor -- start 2024-05-30T06:52:47.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c5a800640 1 -- start start 2024-05-30T06:52:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c5a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5406f9a0 0x7f8c541647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c5a800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c540b2ec0 0x7f8c54151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c5a800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c54155e60 0x7f8c54152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c5a800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5406ea10 con 0x7f8c5406f9a0 2024-05-30T06:52:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c5a800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5406e890 con 0x7f8c540b2ec0 2024-05-30T06:52:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c5a800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8c5406eb90 con 0x7f8c54155e60 2024-05-30T06:52:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c53400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5406f9a0 0x7f8c541647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c53400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5406f9a0 0x7f8c541647a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45474/0 (socket says 172.21.15.37:45474) 2024-05-30T06:52:47.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c53400640 1 -- 172.21.15.37:0/3353783885 learned_addr learned my addr 172.21.15.37:0/3353783885 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c4be00640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c540b2ec0 0x7f8c54151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c53e00640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c54155e60 0x7f8c54152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c53400640 1 -- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c54155e60 msgr2=0x7f8c54152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c53400640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c54155e60 0x7f8c54152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c53400640 1 -- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c540b2ec0 msgr2=0x7f8c54151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c53400640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c540b2ec0 0x7f8c54151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c53400640 1 -- 172.21.15.37:0/3353783885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c54164ff0 con 0x7f8c5406f9a0 2024-05-30T06:52:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c4be00640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c540b2ec0 0x7f8c54151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:52:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c53e00640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c54155e60 0x7f8c54152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:52:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c53400640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5406f9a0 0x7f8c541647a0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400c480 tx=0x7f8c4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c4b400640 1 -- 172.21.15.37:0/3353783885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44018070 con 0x7f8c5406f9a0 2024-05-30T06:52:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c4b400640 1 -- 172.21.15.37:0/3353783885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c44007500 con 0x7f8c5406f9a0 2024-05-30T06:52:47.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c5a800640 1 -- 172.21.15.37:0/3353783885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c541652d0 con 0x7f8c5406f9a0 2024-05-30T06:52:47.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c4b400640 1 -- 172.21.15.37:0/3353783885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c44004a30 con 0x7f8c5406f9a0 2024-05-30T06:52:47.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.455+0000 7f8c5a800640 1 -- 172.21.15.37:0/3353783885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c54165890 con 0x7f8c5406f9a0 2024-05-30T06:52:47.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.459+0000 7f8c5a800640 1 -- 172.21.15.37:0/3353783885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c54068b20 con 0x7f8c5406f9a0 2024-05-30T06:52:47.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.459+0000 7f8c4b400640 1 -- 172.21.15.37:0/3353783885 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f8c4401b070 con 0x7f8c5406f9a0 2024-05-30T06:52:47.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.459+0000 7f8c4b400640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8c300694f0 0x7f8c3006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:47.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.459+0000 7f8c4b400640 1 -- 172.21.15.37:0/3353783885 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f8c44084c20 con 0x7f8c5406f9a0 2024-05-30T06:52:47.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.459+0000 7f8c4be00640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8c300694f0 0x7f8c3006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:47.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.459+0000 7f8c4be00640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8c300694f0 0x7f8c3006b9b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c006fd0 tx=0x7f8c3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:47.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.463+0000 7f8c4b400640 1 -- 172.21.15.37:0/3353783885 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8c440568e0 con 0x7f8c5406f9a0 2024-05-30T06:52:47.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.691+0000 7f8c5a800640 1 -- 172.21.15.37:0/3353783885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8c540cd7a0 con 0x7f8c5406f9a0 2024-05-30T06:52:47.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.695+0000 7f8c4b400640 1 -- 172.21.15.37:0/3353783885 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2378 (secure 0 0 0) 0x7f8c440561e0 con 0x7f8c5406f9a0 2024-05-30T06:52:47.693 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:52:47.693 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:52:47.693 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:52:47.693 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:52:47.693 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:52:47.693 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:52:47.693 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:52:47.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:47.694 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:52:47.694 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:52:47.694 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:52:47.694 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:52:47.694 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:52:47.694 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:47.694 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:52:47.694 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:52:47.694 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:52:47.694 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:52:47.695 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:47.695 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 662, 2024-05-30T06:52:47.695 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:52:47.695 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:52:47.695 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:52:47.695 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:52:47.695 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:47.695 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:52:47.695 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:52:47.695 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:52:47.695 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:52:47.695 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:52:47.695 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:52:47.696 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:52:47.696 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:52:47.696 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:47.696 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:52:47.696 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:52:47.696 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:47.696 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:52:47.696 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:52:47.696 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:47.696 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:47.696 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:52:47.696 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:52:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 11792, 2024-05-30T06:52:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 49262662668, 2024-05-30T06:52:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 99079176192, 2024-05-30T06:52:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 674014937088, 2024-05-30T06:52:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:52:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 102033807, 2024-05-30T06:52:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 108342411, 2024-05-30T06:52:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 25, 2024-05-30T06:52:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 34 2024-05-30T06:52:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:52:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:52:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:52:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:52:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:52:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:52:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:52:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:52:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:52:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:52:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:52:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:52:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:47.699 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:52:47.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:47.699 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:52:47.699 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:52:47.699 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:52:47.699 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:52:47.699 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:52:47.699 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:52:47.699 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:52:47.699 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:47.699 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:47.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:47.699 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 12, 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:51:42.820933+0000", 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: "37467ab0-9e28-4c72-9193-e79e68c05454": { 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 20.0 seconds before exiting (77s)\n [============================] ", 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 20.0 seconds before exiting (82s)\n [============================] ", 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:52:47.700 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:47.701 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:47.701 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:52:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.695+0000 7f8c5a800640 1 -- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8c300694f0 msgr2=0x7f8c3006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.695+0000 7f8c5a800640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8c300694f0 0x7f8c3006b9b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c006fd0 tx=0x7f8c3c008040 comp rx=0 tx=0).stop 2024-05-30T06:52:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.695+0000 7f8c5a800640 1 -- 172.21.15.37:0/3353783885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5406f9a0 msgr2=0x7f8c541647a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.695+0000 7f8c5a800640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5406f9a0 0x7f8c541647a0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f8c4400c480 tx=0x7f8c4400c940 comp rx=0 tx=0).stop 2024-05-30T06:52:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.695+0000 7f8c5a800640 1 -- 172.21.15.37:0/3353783885 shutdown_connections 2024-05-30T06:52:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.695+0000 7f8c5a800640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c54155e60 0x7f8c54152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.695+0000 7f8c5a800640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8c300694f0 0x7f8c3006b9b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.695+0000 7f8c5a800640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c540b2ec0 0x7f8c54151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.695+0000 7f8c5a800640 1 --2- 172.21.15.37:0/3353783885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c5406f9a0 0x7f8c541647a0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.695+0000 7f8c5a800640 1 -- 172.21.15.37:0/3353783885 >> 172.21.15.37:0/3353783885 conn(0x7f8c540b23a0 msgr2=0x7f8c540ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.695+0000 7f8c5a800640 1 -- 172.21.15.37:0/3353783885 shutdown_connections 2024-05-30T06:52:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:47.695+0000 7f8c5a800640 1 -- 172.21.15.37:0/3353783885 wait complete. 2024-05-30T06:52:52.716 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:52:52.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f501ea00640 1 Processor -- start 2024-05-30T06:52:52.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f501ea00640 1 -- start start 2024-05-30T06:52:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f501ea00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f50180cd2a0 0x7f501815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f501ea00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5018160580 con 0x7f501806b960 2024-05-30T06:52:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f501ea00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5018160860 con 0x7f50180b3a90 2024-05-30T06:52:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f501ea00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5018160b40 con 0x7f50180cd2a0 2024-05-30T06:52:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f5017e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f501806b960 0x7f501806bd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35632/0 (socket says 172.21.15.37:35632) 2024-05-30T06:52:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f5017e00640 1 -- 172.21.15.37:0/1631636768 learned_addr learned my addr 172.21.15.37:0/1631636768 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:52:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f500f400640 1 --2- 172.21.15.37:0/1631636768 >> v2:172.21.15.105:3300/0 conn(0x7f50180cd2a0 0x7f501815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f5017400640 1 -- 172.21.15.37:0/1631636768 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662828096 0 0) 0x7f5018160580 con 0x7f501806b960 2024-05-30T06:52:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f5017400640 1 -- 172.21.15.37:0/1631636768 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ffc003530 con 0x7f501806b960 2024-05-30T06:52:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f5017400640 1 -- 172.21.15.37:0/1631636768 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 737900098 0 0) 0x7f4ffc003530 con 0x7f501806b960 2024-05-30T06:52:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f500f400640 1 -- 172.21.15.37:0/1631636768 >> v1:172.21.15.105:6789/0 conn(0x7f50180b3a90 legacy=0x7f50180d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f500f400640 1 -- 172.21.15.37:0/1631636768 >> v1:172.21.15.37:6789/0 conn(0x7f501806b960 legacy=0x7f501806bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.867+0000 7f500f400640 1 -- 172.21.15.37:0/1631636768 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5018160e20 con 0x7f50180cd2a0 2024-05-30T06:52:52.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.871+0000 7f500f400640 1 --2- 172.21.15.37:0/1631636768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50180cd2a0 0x7f501815cdf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5000009d90 tx=0x7f500001c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6c9e8e8888f04fb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:52.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.871+0000 7f5017400640 1 -- 172.21.15.37:0/1631636768 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50000b2070 con 0x7f50180cd2a0 2024-05-30T06:52:52.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.871+0000 7f5017400640 1 -- 172.21.15.37:0/1631636768 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50000a56c0 con 0x7f50180cd2a0 2024-05-30T06:52:52.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.871+0000 7f5017400640 1 -- 172.21.15.37:0/1631636768 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5008001680 con 0x7f50180cd2a0 2024-05-30T06:52:52.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.871+0000 7f501ea00640 1 -- 172.21.15.37:0/1631636768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50180cd2a0 msgr2=0x7f501815cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:52.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.871+0000 7f501ea00640 1 --2- 172.21.15.37:0/1631636768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50180cd2a0 0x7f501815cdf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5000009d90 tx=0x7f500001c860 comp rx=0 tx=0).stop 2024-05-30T06:52:52.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.871+0000 7f501ea00640 1 -- 172.21.15.37:0/1631636768 shutdown_connections 2024-05-30T06:52:52.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.871+0000 7f501ea00640 1 --2- 172.21.15.37:0/1631636768 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50180cd2a0 0x7f501815cdf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:52.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.871+0000 7f501ea00640 1 -- 172.21.15.37:0/1631636768 >> 172.21.15.37:0/1631636768 conn(0x7f501809aa60 msgr2=0x7f50180b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:52.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.871+0000 7f501ea00640 1 -- 172.21.15.37:0/1631636768 shutdown_connections 2024-05-30T06:52:52.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.871+0000 7f501ea00640 1 -- 172.21.15.37:0/1631636768 wait complete. 2024-05-30T06:52:52.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f501ea00640 1 Processor -- start 2024-05-30T06:52:52.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f501ea00640 1 -- start start 2024-05-30T06:52:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f501ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f501806b960 0x7f5018150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f501ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50180b3a90 0x7f50180b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f501ea00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50180cd2a0 0x7f50180704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f501ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f501816a910 con 0x7f50180b3a90 2024-05-30T06:52:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f501ea00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f501816a790 con 0x7f50180cd2a0 2024-05-30T06:52:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f501ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f501816aa90 con 0x7f501806b960 2024-05-30T06:52:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f500f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50180b3a90 0x7f50180b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f500f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50180b3a90 0x7f50180b2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45478/0 (socket says 172.21.15.37:45478) 2024-05-30T06:52:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f500f400640 1 -- 172.21.15.37:0/3174505119 learned_addr learned my addr 172.21.15.37:0/3174505119 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f5017e00640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f501806b960 0x7f5018150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:52.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f501ca00640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50180cd2a0 0x7f50180704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:52.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f500f400640 1 -- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f501806b960 msgr2=0x7f5018150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f500f400640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f501806b960 0x7f5018150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f500f400640 1 -- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50180cd2a0 msgr2=0x7f50180704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f500f400640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50180cd2a0 0x7f50180704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f500f400640 1 -- 172.21.15.37:0/3174505119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50180b22b0 con 0x7f50180b3a90 2024-05-30T06:52:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f500f400640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50180b3a90 0x7f50180b2af0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f50000b0040 tx=0x7f5000019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f5014c00640 1 -- 172.21.15.37:0/3174505119 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50000b2040 con 0x7f50180b3a90 2024-05-30T06:52:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f5014c00640 1 -- 172.21.15.37:0/3174505119 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5000003bc0 con 0x7f50180b3a90 2024-05-30T06:52:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f5014c00640 1 -- 172.21.15.37:0/3174505119 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5000009450 con 0x7f50180b3a90 2024-05-30T06:52:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f501ea00640 1 -- 172.21.15.37:0/3174505119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50180b2590 con 0x7f50180b3a90 2024-05-30T06:52:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.875+0000 7f501ea00640 1 -- 172.21.15.37:0/3174505119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50180709e0 con 0x7f50180b3a90 2024-05-30T06:52:52.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.879+0000 7f501ea00640 1 -- 172.21.15.37:0/3174505119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5018068b20 con 0x7f50180b3a90 2024-05-30T06:52:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.879+0000 7f5014c00640 1 -- 172.21.15.37:0/3174505119 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f5000004030 con 0x7f50180b3a90 2024-05-30T06:52:52.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.879+0000 7f5014c00640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ff40694f0 0x7f4ff406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:52.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.879+0000 7f5014c00640 1 -- 172.21.15.37:0/3174505119 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f5000120bf0 con 0x7f50180b3a90 2024-05-30T06:52:52.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.879+0000 7f5017e00640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ff40694f0 0x7f4ff406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:52.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.879+0000 7f5017e00640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ff40694f0 0x7f4ff406b9b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5008005890 tx=0x7f5008005800 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:52.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:52.883+0000 7f5014c00640 1 -- 172.21.15.37:0/3174505119 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5000016480 con 0x7f50180b3a90 2024-05-30T06:52:53.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.115+0000 7f501ea00640 1 -- 172.21.15.37:0/3174505119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5018168560 con 0x7f50180b3a90 2024-05-30T06:52:53.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.115+0000 7f5014c00640 1 -- 172.21.15.37:0/3174505119 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2376 (secure 0 0 0) 0x7f50000f2260 con 0x7f50180b3a90 2024-05-30T06:52:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:52:53.115 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:52:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:52:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:52:53.115 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:52:53.116 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 667, 2024-05-30T06:52:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:52:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:52:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:52:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:52:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:52:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:52:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:52:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:52:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:52:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:52:53.117 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:52:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:52:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:52:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:52:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:52:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:52:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:52:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:52:53.118 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 11792, 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 49262692208, 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 99083493376, 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 674010619904, 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 78273317, 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 80740473, 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 19, 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 27 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:52:53.119 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:52:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:52:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:52:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:52:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:52:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:52:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:52:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:52:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:52:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 12, 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:51:42.820933+0000", 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:53.121 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:52:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "37467ab0-9e28-4c72-9193-e79e68c05454": { 2024-05-30T06:52:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 16.0 seconds before exiting (81s)\n [============================] ", 2024-05-30T06:52:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:52:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:52:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 16.0 seconds before exiting (86s)\n [============================] ", 2024-05-30T06:52:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:52:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:53.122 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:53.122 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:52:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.119+0000 7f501ea00640 1 -- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ff40694f0 msgr2=0x7f4ff406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.119+0000 7f501ea00640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ff40694f0 0x7f4ff406b9b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5008005890 tx=0x7f5008005800 comp rx=0 tx=0).stop 2024-05-30T06:52:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.119+0000 7f501ea00640 1 -- 172.21.15.37:0/3174505119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50180b3a90 msgr2=0x7f50180b2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:53.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.119+0000 7f501ea00640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50180b3a90 0x7f50180b2af0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f50000b0040 tx=0x7f5000019600 comp rx=0 tx=0).stop 2024-05-30T06:52:53.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.119+0000 7f501ea00640 1 -- 172.21.15.37:0/3174505119 shutdown_connections 2024-05-30T06:52:53.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.119+0000 7f501ea00640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ff40694f0 0x7f4ff406b9b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:53.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.119+0000 7f501ea00640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50180cd2a0 0x7f50180704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:53.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.119+0000 7f501ea00640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50180b3a90 0x7f50180b2af0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:53.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.119+0000 7f501ea00640 1 --2- 172.21.15.37:0/3174505119 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f501806b960 0x7f5018150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:53.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.119+0000 7f501ea00640 1 -- 172.21.15.37:0/3174505119 >> 172.21.15.37:0/3174505119 conn(0x7f501809aa60 msgr2=0x7f50180cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:53.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.119+0000 7f501ea00640 1 -- 172.21.15.37:0/3174505119 shutdown_connections 2024-05-30T06:52:53.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:53.119+0000 7f501ea00640 1 -- 172.21.15.37:0/3174505119 wait complete. 2024-05-30T06:52:58.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:52:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc66b600640 1 Processor -- start 2024-05-30T06:52:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc66b600640 1 -- start start 2024-05-30T06:52:58.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc66b600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6640cde00 0x7fc6640d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:58.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc66b600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc66415c3d0 0x7fc66415c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:58.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc66b600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6640d0b10 con 0x7fc6640ceaf0 2024-05-30T06:52:58.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc66b600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc6640d0df0 con 0x7fc6640cde00 2024-05-30T06:52:58.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc66b600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc6640d10d0 con 0x7fc66415c3d0 2024-05-30T06:52:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc668c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6640cde00 0x7fc6640d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc668c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6640cde00 0x7fc6640d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45410/0 (socket says 172.21.15.37:45410) 2024-05-30T06:52:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc668c00640 1 -- 172.21.15.37:0/1134030346 learned_addr learned my addr 172.21.15.37:0/1134030346 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc669600640 1 --2- 172.21.15.37:0/1134030346 >> v2:172.21.15.105:3300/0 conn(0x7fc66415c3d0 0x7fc66415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc668c00640 1 -- 172.21.15.37:0/1134030346 >> v2:172.21.15.105:3300/0 conn(0x7fc66415c3d0 msgr2=0x7fc66415c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:52:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc668c00640 1 --2- 172.21.15.37:0/1134030346 >> v2:172.21.15.105:3300/0 conn(0x7fc66415c3d0 0x7fc66415c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc668c00640 1 -- 172.21.15.37:0/1134030346 >> v1:172.21.15.105:6789/0 conn(0x7fc6640ceaf0 legacy=0x7fc6640ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.291+0000 7fc668c00640 1 -- 172.21.15.37:0/1134030346 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66415beb0 con 0x7fc6640cde00 2024-05-30T06:52:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.295+0000 7fc668c00640 1 --2- 172.21.15.37:0/1134030346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6640cde00 0x7fc6640d04a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc66415cdc0 tx=0x7fc65401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848926d27e8543d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.295+0000 7fc663e00640 1 -- 172.21.15.37:0/1134030346 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540b0070 con 0x7fc6640cde00 2024-05-30T06:52:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.295+0000 7fc663e00640 1 -- 172.21.15.37:0/1134030346 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6540ab600 con 0x7fc6640cde00 2024-05-30T06:52:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.295+0000 7fc663e00640 1 -- 172.21.15.37:0/1134030346 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540ab9d0 con 0x7fc6640cde00 2024-05-30T06:52:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.295+0000 7fc66b600640 1 -- 172.21.15.37:0/1134030346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6640cde00 msgr2=0x7fc6640d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.295+0000 7fc66b600640 1 --2- 172.21.15.37:0/1134030346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6640cde00 0x7fc6640d04a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fc66415cdc0 tx=0x7fc65401c400 comp rx=0 tx=0).stop 2024-05-30T06:52:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.295+0000 7fc66b600640 1 -- 172.21.15.37:0/1134030346 shutdown_connections 2024-05-30T06:52:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.295+0000 7fc66b600640 1 --2- 172.21.15.37:0/1134030346 >> v2:172.21.15.105:3300/0 conn(0x7fc66415c3d0 0x7fc66415c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.295+0000 7fc66b600640 1 --2- 172.21.15.37:0/1134030346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6640cde00 0x7fc6640d04a0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.295+0000 7fc66b600640 1 -- 172.21.15.37:0/1134030346 >> 172.21.15.37:0/1134030346 conn(0x7fc6640b3390 msgr2=0x7fc6640b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.295+0000 7fc66b600640 1 -- 172.21.15.37:0/1134030346 shutdown_connections 2024-05-30T06:52:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.295+0000 7fc66b600640 1 -- 172.21.15.37:0/1134030346 wait complete. 2024-05-30T06:52:58.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc66b600640 1 Processor -- start 2024-05-30T06:52:58.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc66b600640 1 -- start start 2024-05-30T06:52:58.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc66b600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6640cde00 0x7fc664147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:58.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc66b600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6640ceaf0 0x7fc66414ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:58.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc66b600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc66415c3d0 0x7fc66414c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:58.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc66b600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc664168670 con 0x7fc6640cde00 2024-05-30T06:52:58.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc66b600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc6641684f0 con 0x7fc66415c3d0 2024-05-30T06:52:58.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc66b600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc6641687f0 con 0x7fc6640ceaf0 2024-05-30T06:52:58.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc668c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6640cde00 0x7fc664147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:58.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc668c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6640cde00 0x7fc664147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45412/0 (socket says 172.21.15.37:45412) 2024-05-30T06:52:58.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc668c00640 1 -- 172.21.15.37:0/1506371831 learned_addr learned my addr 172.21.15.37:0/1506371831 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:52:58.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc669600640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc66415c3d0 0x7fc66414c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:58.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc65be00640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6640ceaf0 0x7fc66414ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:58.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc668c00640 1 -- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6640ceaf0 msgr2=0x7fc66414ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:58.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc668c00640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6640ceaf0 0x7fc66414ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:58.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc668c00640 1 -- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc66415c3d0 msgr2=0x7fc66414c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:58.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc668c00640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc66415c3d0 0x7fc66414c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:58.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc668c00640 1 -- 172.21.15.37:0/1506371831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc664150bd0 con 0x7fc6640cde00 2024-05-30T06:52:58.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc668c00640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6640cde00 0x7fc664147cf0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fc6540ae040 tx=0x7fc65401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:58.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc661600640 1 -- 172.21.15.37:0/1506371831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540ba020 con 0x7fc6640cde00 2024-05-30T06:52:58.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc661600640 1 -- 172.21.15.37:0/1506371831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6540b6420 con 0x7fc6640cde00 2024-05-30T06:52:58.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc66b600640 1 -- 172.21.15.37:0/1506371831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc664149750 con 0x7fc6640cde00 2024-05-30T06:52:58.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc661600640 1 -- 172.21.15.37:0/1506371831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540b0040 con 0x7fc6640cde00 2024-05-30T06:52:58.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.299+0000 7fc66b600640 1 -- 172.21.15.37:0/1506371831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc664149d10 con 0x7fc6640cde00 2024-05-30T06:52:58.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.303+0000 7fc66b600640 1 -- 172.21.15.37:0/1506371831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc664068b20 con 0x7fc6640cde00 2024-05-30T06:52:58.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.303+0000 7fc661600640 1 -- 172.21.15.37:0/1506371831 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7fc6540bd020 con 0x7fc6640cde00 2024-05-30T06:52:58.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.303+0000 7fc661600640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6400694f0 0x7fc64006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:52:58.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.303+0000 7fc661600640 1 -- 172.21.15.37:0/1506371831 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fc65411f9b0 con 0x7fc6640cde00 2024-05-30T06:52:58.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.303+0000 7fc65be00640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6400694f0 0x7fc64006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:52:58.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.303+0000 7fc65be00640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6400694f0 0x7fc64006b9b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc664152b90 tx=0x7fc64c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:52:58.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.307+0000 7fc661600640 1 -- 172.21.15.37:0/1506371831 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc6540c4030 con 0x7fc6640cde00 2024-05-30T06:52:58.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc66b600640 1 -- 172.21.15.37:0/1506371831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc6640b0f40 con 0x7fc6640cde00 2024-05-30T06:52:58.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc661600640 1 -- 172.21.15.37:0/1506371831 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2334 (secure 0 0 0) 0x7fc654016110 con 0x7fc6640cde00 2024-05-30T06:52:58.530 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:52:58.530 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:52:58.530 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:52:58.531 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:52:58.531 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:52:58.531 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:52:58.531 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:52:58.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:58.531 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:52:58.531 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:52:58.531 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:52:58.531 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:52:58.531 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:52:58.531 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:58.531 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:52:58.531 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 672, 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:52:58.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:52:58.533 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 11792, 2024-05-30T06:52:58.534 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 49262697417, 2024-05-30T06:52:58.534 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 99083509760, 2024-05-30T06:52:58.534 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 674010603520, 2024-05-30T06:52:58.534 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:52:58.534 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 3327, 2024-05-30T06:52:58.534 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:52:58.534 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 1 2024-05-30T06:52:58.534 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:58.534 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:52:58.534 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:52:58.534 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:52:58.534 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:52:58.534 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:52:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:52:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:52:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:52:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:52:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:52:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:52:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:52:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:52:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:52:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:58.535 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:52:58.536 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:52:58.536 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:52:58.536 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:52:58.536 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:52:58.536 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:52:58.536 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:52:58.536 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:52:58.536 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:58.536 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:58.536 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:52:58.536 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 12, 2024-05-30T06:52:58.536 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:51:42.820933+0000", 2024-05-30T06:52:58.536 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout: "37467ab0-9e28-4c72-9193-e79e68c05454": { 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 10.0 seconds before exiting (87s)\n [============================] ", 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 10.0 seconds before exiting (92s)\n [============================] ", 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:52:58.537 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:52:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc66b600640 1 -- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6400694f0 msgr2=0x7fc64006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc66b600640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6400694f0 0x7fc64006b9b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc664152b90 tx=0x7fc64c009040 comp rx=0 tx=0).stop 2024-05-30T06:52:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc66b600640 1 -- 172.21.15.37:0/1506371831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6640cde00 msgr2=0x7fc664147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:52:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc66b600640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6640cde00 0x7fc664147cf0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fc6540ae040 tx=0x7fc65401ac40 comp rx=0 tx=0).stop 2024-05-30T06:52:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc66b600640 1 -- 172.21.15.37:0/1506371831 shutdown_connections 2024-05-30T06:52:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc66b600640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6400694f0 0x7fc64006b9b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc66b600640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc66415c3d0 0x7fc66414c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc66b600640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6640ceaf0 0x7fc66414ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc66b600640 1 --2- 172.21.15.37:0/1506371831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6640cde00 0x7fc664147cf0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:52:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc66b600640 1 -- 172.21.15.37:0/1506371831 >> 172.21.15.37:0/1506371831 conn(0x7fc6640b3390 msgr2=0x7fc66415b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:52:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc66b600640 1 -- 172.21.15.37:0/1506371831 shutdown_connections 2024-05-30T06:52:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:52:58.531+0000 7fc66b600640 1 -- 172.21.15.37:0/1506371831 wait complete. 2024-05-30T06:53:03.551 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:53:03.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad9a00640 1 Processor -- start 2024-05-30T06:53:03.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad9a00640 1 -- start start 2024-05-30T06:53:03.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad9a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad406e000 0x7f3ad40ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:03.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad9a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad40cd120 con 0x7f3ad40cee10 2024-05-30T06:53:03.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad9a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad40cd400 con 0x7f3ad415cd80 2024-05-30T06:53:03.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad9a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad40a9530 con 0x7f3ad406e000 2024-05-30T06:53:03.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad3400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3ad40cee10 0x7f3ad406f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36706/0 (socket says 172.21.15.37:36706) 2024-05-30T06:53:03.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad3400640 1 -- 172.21.15.37:0/4217589610 learned_addr learned my addr 172.21.15.37:0/4217589610 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:03.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2a00640 1 --2- 172.21.15.37:0/4217589610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad406e000 0x7f3ad40ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:03.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3835948442 0 0) 0x7f3ad40cd120 con 0x7f3ad40cee10 2024-05-30T06:53:03.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ab8003530 con 0x7f3ad40cee10 2024-05-30T06:53:03.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3687005207 0 0) 0x7f3ad40cd400 con 0x7f3ad415cd80 2024-05-30T06:53:03.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ad40cd120 con 0x7f3ad415cd80 2024-05-30T06:53:03.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1377387549 0 0) 0x7f3ab8003530 con 0x7f3ad40cee10 2024-05-30T06:53:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad406e000 msgr2=0x7f3ad40ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 --2- 172.21.15.37:0/4217589610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad406e000 0x7f3ad40ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 >> v1:172.21.15.105:6789/0 conn(0x7f3ad415cd80 legacy=0x7f3ad40ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad40cd6e0 con 0x7f3ad40cee10 2024-05-30T06:53:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f3acc001a00 con 0x7f3ad40cee10 2024-05-30T06:53:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2a00640 1 --2- 172.21.15.37:0/4217589610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad406e000 0x7f3ad40ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 >> v1:172.21.15.37:6789/0 conn(0x7f3ad40cee10 legacy=0x7f3ad406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 --2- 172.21.15.37:0/4217589610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab8003b80 0x7f3ab8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 --2- 172.21.15.37:0/4217589610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad406e000 0x7f3ab8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 --2- 172.21.15.37:0/4217589610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ab8004d50 0x7f3ab80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab800ba80 con 0x7f3ab8004d50 2024-05-30T06:53:03.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab800bc00 con 0x7f3ab8003b80 2024-05-30T06:53:03.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab800bd80 con 0x7f3ad406e000 2024-05-30T06:53:03.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.703+0000 7f3ad3400640 1 --2- 172.21.15.37:0/4217589610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ab8004d50 0x7f3ab80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:03.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3ad2a00640 1 --2- 172.21.15.37:0/4217589610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab8003b80 0x7f3ab8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:03.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3aca000640 1 --2- 172.21.15.37:0/4217589610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad406e000 0x7f3ab8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:03.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3ad3400640 1 -- 172.21.15.37:0/4217589610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad406e000 msgr2=0x7f3ab8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:03.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3ad3400640 1 --2- 172.21.15.37:0/4217589610 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad406e000 0x7f3ab8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:03.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3ad3400640 1 -- 172.21.15.37:0/4217589610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab8003b80 msgr2=0x7f3ab8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:03.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3ad3400640 1 --2- 172.21.15.37:0/4217589610 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ab8003b80 0x7f3ab8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:03.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3ad3400640 1 -- 172.21.15.37:0/4217589610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab8003530 con 0x7f3ab8004d50 2024-05-30T06:53:03.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3ad3400640 1 --2- 172.21.15.37:0/4217589610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ab8004d50 0x7f3ab80051d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00a820 tx=0x7f3acc01d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7b4dd4f47ab97 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:03.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc00a410 con 0x7f3ab8004d50 2024-05-30T06:53:03.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3acc0ad630 con 0x7f3ab8004d50 2024-05-30T06:53:03.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3ad2000640 1 -- 172.21.15.37:0/4217589610 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc0ada20 con 0x7f3ab8004d50 2024-05-30T06:53:03.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3ad9a00640 1 -- 172.21.15.37:0/4217589610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ab8004d50 msgr2=0x7f3ab80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:03.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3ad9a00640 1 --2- 172.21.15.37:0/4217589610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ab8004d50 0x7f3ab80051d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00a820 tx=0x7f3acc01d2e0 comp rx=0 tx=0).stop 2024-05-30T06:53:03.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.707+0000 7f3ad3400640 1 -- 172.21.15.37:0/4217589610 reap_dead start 2024-05-30T06:53:03.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad9a00640 1 -- 172.21.15.37:0/4217589610 shutdown_connections 2024-05-30T06:53:03.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad9a00640 1 -- 172.21.15.37:0/4217589610 >> 172.21.15.37:0/4217589610 conn(0x7f3ad40b23a0 msgr2=0x7f3ad40b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:03.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad9a00640 1 -- 172.21.15.37:0/4217589610 shutdown_connections 2024-05-30T06:53:03.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad9a00640 1 -- 172.21.15.37:0/4217589610 wait complete. 2024-05-30T06:53:03.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad9a00640 1 Processor -- start 2024-05-30T06:53:03.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad9a00640 1 -- start start 2024-05-30T06:53:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad9a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ab8004d50 0x7f3ad4138d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad9a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad40c5e90 0x7f3ad41444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad9a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ad40c6310 0x7f3ad41f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad9a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad40ce1c0 con 0x7f3ab8004d50 2024-05-30T06:53:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad9a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad40cdca0 con 0x7f3ad40c6310 2024-05-30T06:53:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad9a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad40ce340 con 0x7f3ad40c5e90 2024-05-30T06:53:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ab8004d50 0x7f3ad4138d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ab8004d50 0x7f3ad4138d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45426/0 (socket says 172.21.15.37:45426) 2024-05-30T06:53:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad2a00640 1 -- 172.21.15.37:0/274992253 learned_addr learned my addr 172.21.15.37:0/274992253 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3aca000640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad40c5e90 0x7f3ad41444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad3400640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ad40c6310 0x7f3ad41f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad2a00640 1 -- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad40c5e90 msgr2=0x7f3ad41444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad2a00640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad40c5e90 0x7f3ad41444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad2a00640 1 -- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ad40c6310 msgr2=0x7f3ad41f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad2a00640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ad40c6310 0x7f3ad41f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad2a00640 1 -- 172.21.15.37:0/274992253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad4139290 con 0x7f3ab8004d50 2024-05-30T06:53:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3aca000640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad40c5e90 0x7f3ad41444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad2a00640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ab8004d50 0x7f3ad4138d50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4011a00 tx=0x7f3ac4011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3acb400640 1 -- 172.21.15.37:0/274992253 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400fb50 con 0x7f3ab8004d50 2024-05-30T06:53:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3acb400640 1 -- 172.21.15.37:0/274992253 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac400fcf0 con 0x7f3ab8004d50 2024-05-30T06:53:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.711+0000 7f3ad9a00640 1 -- 172.21.15.37:0/274992253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad4143410 con 0x7f3ab8004d50 2024-05-30T06:53:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.715+0000 7f3acb400640 1 -- 172.21.15.37:0/274992253 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400fea0 con 0x7f3ab8004d50 2024-05-30T06:53:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.715+0000 7f3ad9a00640 1 -- 172.21.15.37:0/274992253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad41439d0 con 0x7f3ab8004d50 2024-05-30T06:53:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.715+0000 7f3ad9a00640 1 -- 172.21.15.37:0/274992253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad4068b20 con 0x7f3ab8004d50 2024-05-30T06:53:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.715+0000 7f3acb400640 1 -- 172.21.15.37:0/274992253 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f3ac4012040 con 0x7f3ab8004d50 2024-05-30T06:53:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.715+0000 7f3acb400640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3ab00694f0 0x7f3ab006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.715+0000 7f3acb400640 1 -- 172.21.15.37:0/274992253 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f3ac4085d30 con 0x7f3ab8004d50 2024-05-30T06:53:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.715+0000 7f3aca000640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3ab00694f0 0x7f3ab006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.719+0000 7f3aca000640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3ab00694f0 0x7f3ab006b9b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3ad41395e0 tx=0x7f3abc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:03.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.719+0000 7f3acb400640 1 -- 172.21.15.37:0/274992253 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3ac4019070 con 0x7f3ab8004d50 2024-05-30T06:53:03.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3ad9a00640 1 -- 172.21.15.37:0/274992253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f3ad40754e0 con 0x7f3ab8004d50 2024-05-30T06:53:03.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3acb400640 1 -- 172.21.15.37:0/274992253 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2332 (secure 0 0 0) 0x7f3ac40579f0 con 0x7f3ab8004d50 2024-05-30T06:53:03.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:03.946 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:53:03.946 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:53:03.946 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:53:03.946 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:53:03.946 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:53:03.946 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:53:03.946 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:03.946 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:53:03.946 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:53:03.946 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:53:03.946 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:53:03.947 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:53:03.947 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:53:03.947 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:53:03.947 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:53:03.947 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:53:03.947 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:53:03.947 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:53:03.947 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 678, 2024-05-30T06:53:03.947 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:53:03.947 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:53:03.947 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:53:03.947 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:53:03.947 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:03.948 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:53:03.948 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:53:03.948 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:53:03.948 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:53:03.948 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:53:03.948 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:53:03.948 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:53:03.948 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:53:03.948 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:03.948 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:53:03.948 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:53:03.948 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:03.948 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:53:03.949 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:53:03.949 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:03.949 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:53:03.949 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:53:03.949 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:53:03.949 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 11792, 2024-05-30T06:53:03.949 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 49262703518, 2024-05-30T06:53:03.949 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 99083517952, 2024-05-30T06:53:03.949 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 674010595328, 2024-05-30T06:53:03.949 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:53:03.949 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 1194, 2024-05-30T06:53:03.949 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:53:03.949 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:53:03.950 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:03.950 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:53:03.950 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:53:03.950 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:53:03.950 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:53:03.950 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:53:03.950 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:53:03.950 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:53:03.950 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:03.950 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:53:03.950 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:53:03.950 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:53:03.950 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:53:03.951 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:53:03.951 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:03.951 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:53:03.951 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:53:03.951 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:03.951 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:53:03.951 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:53:03.951 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:53:03.951 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:53:03.951 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:53:03.951 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:53:03.951 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:53:03.951 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:53:03.952 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:53:03.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:03.952 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:53:03.952 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 12, 2024-05-30T06:53:03.952 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:51:42.820933+0000", 2024-05-30T06:53:03.952 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:53:03.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:03.952 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:53:03.952 INFO:teuthology.orchestra.run.smithi037.stdout: "37467ab0-9e28-4c72-9193-e79e68c05454": { 2024-05-30T06:53:03.952 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 4.0 seconds before exiting (93s)\n [============================] ", 2024-05-30T06:53:03.952 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:53:03.952 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:53:03.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:03.953 INFO:teuthology.orchestra.run.smithi037.stdout: "c2a8ed33-2876-45d4-ae98-defcf6508d81": { 2024-05-30T06:53:03.953 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 4.0 seconds before exiting (98s)\n [============================] ", 2024-05-30T06:53:03.953 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:53:03.953 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:53:03.953 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:03.953 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:03.953 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:53:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3ad9a00640 1 -- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3ab00694f0 msgr2=0x7f3ab006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3ad9a00640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3ab00694f0 0x7f3ab006b9b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3ad41395e0 tx=0x7f3abc009040 comp rx=0 tx=0).stop 2024-05-30T06:53:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3ad9a00640 1 -- 172.21.15.37:0/274992253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ab8004d50 msgr2=0x7f3ad4138d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3ad9a00640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ab8004d50 0x7f3ad4138d50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4011a00 tx=0x7f3ac4011ec0 comp rx=0 tx=0).stop 2024-05-30T06:53:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3ad9a00640 1 -- 172.21.15.37:0/274992253 shutdown_connections 2024-05-30T06:53:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3ad9a00640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3ab00694f0 0x7f3ab006b9b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:03.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3ad9a00640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ad40c6310 0x7f3ad41f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:03.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3ad9a00640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ad40c5e90 0x7f3ad41444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:03.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3ad9a00640 1 --2- 172.21.15.37:0/274992253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ab8004d50 0x7f3ad4138d50 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:03.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3ad9a00640 1 -- 172.21.15.37:0/274992253 >> 172.21.15.37:0/274992253 conn(0x7f3ad40b23a0 msgr2=0x7f3ad40b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:03.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3ad9a00640 1 -- 172.21.15.37:0/274992253 shutdown_connections 2024-05-30T06:53:03.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:03.947+0000 7f3ad9a00640 1 -- 172.21.15.37:0/274992253 wait complete. 2024-05-30T06:53:05.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:53:05.161 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:53:08.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:53:09.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.119+0000 7f4532c00640 1 Processor -- start 2024-05-30T06:53:09.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.119+0000 7f4532c00640 1 -- start start 2024-05-30T06:53:09.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4532c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f452c1605d0 0x7f452c0b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4532c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f452c1609b0 0x7f452c160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4532c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f452c15f7d0 0x7f452c15fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4532c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f452c0cdda0 con 0x7f452c1605d0 2024-05-30T06:53:09.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4532c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f452c0ce080 con 0x7f452c1609b0 2024-05-30T06:53:09.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4532c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f452c09ac00 con 0x7f452c15f7d0 2024-05-30T06:53:09.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4531800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f452c1605d0 0x7f452c0b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4531800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f452c1605d0 0x7f452c0b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40338/0 (socket says 172.21.15.37:40338) 2024-05-30T06:53:09.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4531800640 1 -- 172.21.15.37:0/727713855 learned_addr learned my addr 172.21.15.37:0/727713855 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:09.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4532200640 1 --2- 172.21.15.37:0/727713855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f452c15f7d0 0x7f452c15fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4530e00640 1 --2- 172.21.15.37:0/727713855 >> v2:172.21.15.105:3300/0 conn(0x7f452c1609b0 0x7f452c160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4531800640 1 -- 172.21.15.37:0/727713855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f452c15f7d0 msgr2=0x7f452c15fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:09.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4531800640 1 --2- 172.21.15.37:0/727713855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f452c15f7d0 0x7f452c15fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4531800640 1 -- 172.21.15.37:0/727713855 >> v2:172.21.15.105:3300/0 conn(0x7f452c1609b0 msgr2=0x7f452c160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:09.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4531800640 1 --2- 172.21.15.37:0/727713855 >> v2:172.21.15.105:3300/0 conn(0x7f452c1609b0 0x7f452c160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4531800640 1 -- 172.21.15.37:0/727713855 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452c09aee0 con 0x7f452c1605d0 2024-05-30T06:53:09.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4532200640 1 --2- 172.21.15.37:0/727713855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f452c15f7d0 0x7f452c15fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:09.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.123+0000 7f4530e00640 1 --2- 172.21.15.37:0/727713855 >> v2:172.21.15.105:3300/0 conn(0x7f452c1609b0 0x7f452c160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f4531800640 1 --2- 172.21.15.37:0/727713855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452c1605d0 0x7f452c0b52b0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f452c072e70 tx=0x7f452001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750ab7f65141a83 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f452be00640 1 -- 172.21.15.37:0/727713855 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45200b0070 con 0x7f452c1605d0 2024-05-30T06:53:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f452be00640 1 -- 172.21.15.37:0/727713855 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45200ab600 con 0x7f452c1605d0 2024-05-30T06:53:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f452be00640 1 -- 172.21.15.37:0/727713855 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45200ab9d0 con 0x7f452c1605d0 2024-05-30T06:53:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f4532c00640 1 -- 172.21.15.37:0/727713855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452c1605d0 msgr2=0x7f452c0b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f4532c00640 1 --2- 172.21.15.37:0/727713855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452c1605d0 0x7f452c0b52b0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f452c072e70 tx=0x7f452001c520 comp rx=0 tx=0).stop 2024-05-30T06:53:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f4532c00640 1 -- 172.21.15.37:0/727713855 shutdown_connections 2024-05-30T06:53:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f4532c00640 1 --2- 172.21.15.37:0/727713855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f452c15f7d0 0x7f452c15fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f4532c00640 1 --2- 172.21.15.37:0/727713855 >> v2:172.21.15.105:3300/0 conn(0x7f452c1609b0 0x7f452c160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f4532c00640 1 --2- 172.21.15.37:0/727713855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452c1605d0 0x7f452c0b52b0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f4532c00640 1 -- 172.21.15.37:0/727713855 >> 172.21.15.37:0/727713855 conn(0x7f452c0b3f50 msgr2=0x7f452c0b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f4532c00640 1 -- 172.21.15.37:0/727713855 shutdown_connections 2024-05-30T06:53:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f4532c00640 1 -- 172.21.15.37:0/727713855 wait complete. 2024-05-30T06:53:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f4532c00640 1 Processor -- start 2024-05-30T06:53:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.127+0000 7f4532c00640 1 -- start start 2024-05-30T06:53:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4532c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f452c15f7d0 0x7f452c14c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4532c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452c1605d0 0x7f452c15d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4532c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f452c1609b0 0x7f452c156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4532c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f452c0d0030 con 0x7f452c1605d0 2024-05-30T06:53:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4532c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f452c09be60 con 0x7f452c1609b0 2024-05-30T06:53:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4532c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f452c0d01b0 con 0x7f452c15f7d0 2024-05-30T06:53:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4530e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452c1605d0 0x7f452c15d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4530e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452c1605d0 0x7f452c15d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40350/0 (socket says 172.21.15.37:40350) 2024-05-30T06:53:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4530e00640 1 -- 172.21.15.37:0/1776479039 learned_addr learned my addr 172.21.15.37:0/1776479039 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4532200640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f452c1609b0 0x7f452c156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4531800640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f452c15f7d0 0x7f452c14c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4530e00640 1 -- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f452c15f7d0 msgr2=0x7f452c14c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4530e00640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f452c15f7d0 0x7f452c14c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4530e00640 1 -- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f452c1609b0 msgr2=0x7f452c156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4530e00640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f452c1609b0 0x7f452c156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4530e00640 1 -- 172.21.15.37:0/1776479039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452c14ce40 con 0x7f452c1605d0 2024-05-30T06:53:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4530e00640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452c1605d0 0x7f452c15d0f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f451800c820 tx=0x7f451800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4529600640 1 -- 172.21.15.37:0/1776479039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518015070 con 0x7f452c1605d0 2024-05-30T06:53:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4529600640 1 -- 172.21.15.37:0/1776479039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4518007a30 con 0x7f452c1605d0 2024-05-30T06:53:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4532c00640 1 -- 172.21.15.37:0/1776479039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452c14e300 con 0x7f452c1605d0 2024-05-30T06:53:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4529600640 1 -- 172.21.15.37:0/1776479039 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518007de0 con 0x7f452c1605d0 2024-05-30T06:53:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4532c00640 1 -- 172.21.15.37:0/1776479039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f452c155f30 con 0x7f452c1605d0 2024-05-30T06:53:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4532c00640 1 -- 172.21.15.37:0/1776479039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f452c068ab0 con 0x7f452c1605d0 2024-05-30T06:53:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.131+0000 7f4529600640 1 -- 172.21.15.37:0/1776479039 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f4518018070 con 0x7f452c1605d0 2024-05-30T06:53:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.135+0000 7f4529600640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f450c0694f0 0x7f450c06b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.135+0000 7f4529600640 1 -- 172.21.15.37:0/1776479039 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f45180856e0 con 0x7f452c1605d0 2024-05-30T06:53:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.135+0000 7f4531800640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f450c0694f0 0x7f450c06b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.135+0000 7f4531800640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f450c0694f0 0x7f450c06b9b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f45200ad000 tx=0x7f45200a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.139+0000 7f4529600640 1 -- 172.21.15.37:0/1776479039 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f45180573a0 con 0x7f452c1605d0 2024-05-30T06:53:09.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4532c00640 1 -- 172.21.15.37:0/1776479039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f452c158ed0 con 0x7f452c1605d0 2024-05-30T06:53:09.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4529600640 1 -- 172.21.15.37:0/1776479039 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1825 (secure 0 0 0) 0x7f4518056ca0 con 0x7f452c1605d0 2024-05-30T06:53:09.362 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:09.363 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:53:09.363 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:53:09.363 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:53:09.363 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:53:09.363 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:53:09.363 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:53:09.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.363 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:53:09.363 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:53:09.363 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:53:09.363 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:53:09.364 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:53:09.364 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:53:09.364 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:53:09.364 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:53:09.364 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:53:09.364 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:53:09.364 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:53:09.364 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 683, 2024-05-30T06:53:09.364 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:53:09.364 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:53:09.364 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:53:09.364 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:53:09.364 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:53:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:53:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:53:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:53:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:53:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:53:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:53:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:53:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:53:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:53:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:53:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:53:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:53:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:53:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:53:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 11792, 2024-05-30T06:53:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 49262703518, 2024-05-30T06:53:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 99083517952, 2024-05-30T06:53:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 674010595328, 2024-05-30T06:53:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:53:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 682, 2024-05-30T06:53:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 47, 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5, 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 5, 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:53:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 6939 2024-05-30T06:53:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:53:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:53:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:53:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:53:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:53:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:53:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:53:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:53:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:53:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:53:09.369 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:53:09.369 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.369 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:53:09.369 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 12, 2024-05-30T06:53:09.369 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:51:42.820933+0000", 2024-05-30T06:53:09.369 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:53:09.369 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.369 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": {} 2024-05-30T06:53:09.369 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:53:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4532c00640 1 -- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f450c0694f0 msgr2=0x7f450c06b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4532c00640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f450c0694f0 0x7f450c06b9b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f45200ad000 tx=0x7f45200a6000 comp rx=0 tx=0).stop 2024-05-30T06:53:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4532c00640 1 -- 172.21.15.37:0/1776479039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452c1605d0 msgr2=0x7f452c15d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4532c00640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452c1605d0 0x7f452c15d0f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f451800c820 tx=0x7f451800cce0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4532c00640 1 -- 172.21.15.37:0/1776479039 shutdown_connections 2024-05-30T06:53:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4532c00640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f450c0694f0 0x7f450c06b9b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4532c00640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f452c1609b0 0x7f452c156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4532c00640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452c1605d0 0x7f452c15d0f0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4532c00640 1 --2- 172.21.15.37:0/1776479039 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f452c15f7d0 0x7f452c14c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4532c00640 1 -- 172.21.15.37:0/1776479039 >> 172.21.15.37:0/1776479039 conn(0x7f452c0b3f50 msgr2=0x7f452c158610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:09.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4532c00640 1 -- 172.21.15.37:0/1776479039 shutdown_connections 2024-05-30T06:53:09.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.363+0000 7f4532c00640 1 -- 172.21.15.37:0/1776479039 wait complete. 2024-05-30T06:53:09.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T06:53:09.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.527+0000 7f7a29a00640 1 Processor -- start 2024-05-30T06:53:09.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.527+0000 7f7a29a00640 1 -- start start 2024-05-30T06:53:09.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a29a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7a24155da0 0x7f7a240cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a29a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a2406f770 0x7f7a240b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a29a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2415f310 con 0x7f7a240cd440 2024-05-30T06:53:09.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a29a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7a2415f5f0 con 0x7f7a24155da0 2024-05-30T06:53:09.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a29a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7a2415f8d0 con 0x7f7a2406f770 2024-05-30T06:53:09.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a22a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7a24155da0 0x7f7a240cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a1be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7a240cd440 0x7f7a2406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33542/0 (socket says 172.21.15.37:33542) 2024-05-30T06:53:09.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a1be00640 1 -- 172.21.15.37:0/2584077205 learned_addr learned my addr 172.21.15.37:0/2584077205 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:09.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a23400640 1 --2- 172.21.15.37:0/2584077205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a2406f770 0x7f7a240b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a22a00640 1 -- 172.21.15.37:0/2584077205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a2406f770 msgr2=0x7f7a240b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:09.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a22a00640 1 --2- 172.21.15.37:0/2584077205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a2406f770 0x7f7a240b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a22a00640 1 -- 172.21.15.37:0/2584077205 >> v1:172.21.15.37:6789/0 conn(0x7f7a240cd440 legacy=0x7f7a2406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a22a00640 1 -- 172.21.15.37:0/2584077205 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2415fbb0 con 0x7f7a24155da0 2024-05-30T06:53:09.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.531+0000 7f7a22000640 1 -- 172.21.15.37:0/2584077205 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1906077259 0 0) 0x7f7a2415f310 con 0x7f7a240cd440 2024-05-30T06:53:09.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a22a00640 1 --2- 172.21.15.37:0/2584077205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24155da0 0x7f7a240cd950 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f7a140097c0 tx=0x7f7a1401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adacd81f2691154c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:09.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a22000640 1 -- 172.21.15.37:0/2584077205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a140b0070 con 0x7f7a24155da0 2024-05-30T06:53:09.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a22000640 1 -- 172.21.15.37:0/2584077205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a140ab600 con 0x7f7a24155da0 2024-05-30T06:53:09.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a22000640 1 -- 172.21.15.37:0/2584077205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a140ab9d0 con 0x7f7a24155da0 2024-05-30T06:53:09.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 -- 172.21.15.37:0/2584077205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24155da0 msgr2=0x7f7a240cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 --2- 172.21.15.37:0/2584077205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24155da0 0x7f7a240cd950 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f7a140097c0 tx=0x7f7a1401c380 comp rx=0 tx=0).stop 2024-05-30T06:53:09.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 -- 172.21.15.37:0/2584077205 shutdown_connections 2024-05-30T06:53:09.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 --2- 172.21.15.37:0/2584077205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a2406f770 0x7f7a240b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 --2- 172.21.15.37:0/2584077205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24155da0 0x7f7a240cd950 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 -- 172.21.15.37:0/2584077205 >> 172.21.15.37:0/2584077205 conn(0x7f7a2406bf60 msgr2=0x7f7a240b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:09.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 -- 172.21.15.37:0/2584077205 shutdown_connections 2024-05-30T06:53:09.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 -- 172.21.15.37:0/2584077205 wait complete. 2024-05-30T06:53:09.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 Processor -- start 2024-05-30T06:53:09.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 -- start start 2024-05-30T06:53:09.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a2406f770 0x7f7a2413ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a24155da0 0x7f7a241f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a241f7520 0x7f7a24156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7a24168580 con 0x7f7a241f7520 2024-05-30T06:53:09.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a240b46f0 con 0x7f7a24155da0 2024-05-30T06:53:09.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a29a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7a24168700 con 0x7f7a2406f770 2024-05-30T06:53:09.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a23400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a241f7520 0x7f7a24156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a23400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a241f7520 0x7f7a24156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40374/0 (socket says 172.21.15.37:40374) 2024-05-30T06:53:09.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.535+0000 7f7a23400640 1 -- 172.21.15.37:0/1560761257 learned_addr learned my addr 172.21.15.37:0/1560761257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:09.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a1be00640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a24155da0 0x7f7a241f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a22a00640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a2406f770 0x7f7a2413ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a23400640 1 -- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a2406f770 msgr2=0x7f7a2413ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a23400640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a2406f770 0x7f7a2413ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a23400640 1 -- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a24155da0 msgr2=0x7f7a241f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a23400640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a24155da0 0x7f7a241f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a23400640 1 -- 172.21.15.37:0/1560761257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a24164ea0 con 0x7f7a241f7520 2024-05-30T06:53:09.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a23400640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a241f7520 0x7f7a24156dc0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00efc0 tx=0x7f7a1c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:09.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a1aa00640 1 -- 172.21.15.37:0/1560761257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c018020 con 0x7f7a241f7520 2024-05-30T06:53:09.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a1aa00640 1 -- 172.21.15.37:0/1560761257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a1c014480 con 0x7f7a241f7520 2024-05-30T06:53:09.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a1aa00640 1 -- 172.21.15.37:0/1560761257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c014870 con 0x7f7a241f7520 2024-05-30T06:53:09.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a29a00640 1 -- 172.21.15.37:0/1560761257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a24165180 con 0x7f7a241f7520 2024-05-30T06:53:09.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a29a00640 1 -- 172.21.15.37:0/1560761257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a24165740 con 0x7f7a241f7520 2024-05-30T06:53:09.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a29a00640 1 -- 172.21.15.37:0/1560761257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a24068bc0 con 0x7f7a241f7520 2024-05-30T06:53:09.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a1aa00640 1 -- 172.21.15.37:0/1560761257 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f7a1c01b020 con 0x7f7a241f7520 2024-05-30T06:53:09.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a1aa00640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a000694f0 0x7f7a0006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.539+0000 7f7a1aa00640 1 -- 172.21.15.37:0/1560761257 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f7a1c0866d0 con 0x7f7a241f7520 2024-05-30T06:53:09.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.543+0000 7f7a22a00640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a000694f0 0x7f7a0006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.543+0000 7f7a22a00640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a000694f0 0x7f7a0006b9b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7a140ad000 tx=0x7f7a14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:09.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.547+0000 7f7a1aa00640 1 -- 172.21.15.37:0/1560761257 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7a1c022030 con 0x7f7a241f7520 2024-05-30T06:53:09.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.735+0000 7f7a29a00640 1 -- 172.21.15.37:0/1560761257 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a240b6790 con 0x7f7a000694f0 2024-05-30T06:53:09.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.751+0000 7f7a1aa00640 1 -- 172.21.15.37:0/1560761257 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1029 (secure 0 0 0) 0x7f7a240b6790 con 0x7f7a000694f0 2024-05-30T06:53:09.750 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:09.750 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:53:09.750 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.750 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone371016" 2024-05-30T06:53:09.751 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.751 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.751 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone371010" 2024-05-30T06:53:09.751 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.751 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.751 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone37105" 2024-05-30T06:53:09.751 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.751 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.751 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone37108" 2024-05-30T06:53:09.751 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.751 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.751 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone37107" 2024-05-30T06:53:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone371020" 2024-05-30T06:53:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sv1" 2024-05-30T06:53:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone371013" 2024-05-30T06:53:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone371017" 2024-05-30T06:53:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.753 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.753 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone37106" 2024-05-30T06:53:09.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.753 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.753 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone371015" 2024-05-30T06:53:09.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.753 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.753 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone371018" 2024-05-30T06:53:09.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.753 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.753 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone37104" 2024-05-30T06:53:09.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.753 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.754 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone37101" 2024-05-30T06:53:09.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.754 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.754 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone37103" 2024-05-30T06:53:09.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.754 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.754 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone37109" 2024-05-30T06:53:09.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.754 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.754 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone37102" 2024-05-30T06:53:09.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.754 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.754 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone371011" 2024-05-30T06:53:09.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.755 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone371019" 2024-05-30T06:53:09.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.755 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone371014" 2024-05-30T06:53:09.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:09.755 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:09.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone371012" 2024-05-30T06:53:09.755 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:09.755 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:53:09.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.751+0000 7f7a29a00640 1 -- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a000694f0 msgr2=0x7f7a0006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.751+0000 7f7a29a00640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a000694f0 0x7f7a0006b9b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7a140ad000 tx=0x7f7a14008040 comp rx=0 tx=0).stop 2024-05-30T06:53:09.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.751+0000 7f7a29a00640 1 -- 172.21.15.37:0/1560761257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a241f7520 msgr2=0x7f7a24156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.751+0000 7f7a29a00640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a241f7520 0x7f7a24156dc0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00efc0 tx=0x7f7a1c00c490 comp rx=0 tx=0).stop 2024-05-30T06:53:09.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.751+0000 7f7a29a00640 1 -- 172.21.15.37:0/1560761257 shutdown_connections 2024-05-30T06:53:09.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.751+0000 7f7a29a00640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a241f7520 0x7f7a24156dc0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.751+0000 7f7a29a00640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a000694f0 0x7f7a0006b9b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.751+0000 7f7a29a00640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a24155da0 0x7f7a241f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.751+0000 7f7a29a00640 1 --2- 172.21.15.37:0/1560761257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a2406f770 0x7f7a2413ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.751+0000 7f7a29a00640 1 -- 172.21.15.37:0/1560761257 >> 172.21.15.37:0/1560761257 conn(0x7f7a2406bf60 msgr2=0x7f7a2406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:09.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.751+0000 7f7a29a00640 1 -- 172.21.15.37:0/1560761257 shutdown_connections 2024-05-30T06:53:09.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.751+0000 7f7a29a00640 1 -- 172.21.15.37:0/1560761257 wait complete. 2024-05-30T06:53:09.772 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone371016 2024-05-30T06:53:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f62c00640 1 Processor -- start 2024-05-30T06:53:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f62c00640 1 -- start start 2024-05-30T06:53:09.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f62c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3f5c070900 0x7f3f5c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f62c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c06ceb0 0x7f3f5c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f62c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f5c0aeca0 con 0x7f3f5c15fcd0 2024-05-30T06:53:09.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f62c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3f5c0aef80 con 0x7f3f5c070900 2024-05-30T06:53:09.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f62c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3f5c0af260 con 0x7f3f5c06ceb0 2024-05-30T06:53:09.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f61800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3f5c15fcd0 0x7f3f5c06ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33550/0 (socket says 172.21.15.37:33550) 2024-05-30T06:53:09.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f61800640 1 -- 172.21.15.37:0/2772720080 learned_addr learned my addr 172.21.15.37:0/2772720080 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f60e00640 1 --2- 172.21.15.37:0/2772720080 >> v2:172.21.15.105:3300/0 conn(0x7f3f5c070900 0x7f3f5c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f62200640 1 --2- 172.21.15.37:0/2772720080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c06ceb0 0x7f3f5c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258158075 0 0) 0x7f3f5c0aeca0 con 0x7f3f5c15fcd0 2024-05-30T06:53:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f44005740 con 0x7f3f5c15fcd0 2024-05-30T06:53:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2409163980 0 0) 0x7f3f44005740 con 0x7f3f5c15fcd0 2024-05-30T06:53:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c06ceb0 msgr2=0x7f3f5c15ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f5be00640 1 --2- 172.21.15.37:0/2772720080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c06ceb0 0x7f3f5c15ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 >> v2:172.21.15.105:3300/0 conn(0x7f3f5c070900 msgr2=0x7f3f5c06c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f5be00640 1 --2- 172.21.15.37:0/2772720080 >> v2:172.21.15.105:3300/0 conn(0x7f3f5c070900 0x7f3f5c06c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5c0af540 con 0x7f3f5c15fcd0 2024-05-30T06:53:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f3f50001680 con 0x7f3f5c15fcd0 2024-05-30T06:53:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f62200640 1 --2- 172.21.15.37:0/2772720080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c06ceb0 0x7f3f5c15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.919+0000 7f3f60e00640 1 --2- 172.21.15.37:0/2772720080 >> v2:172.21.15.105:3300/0 conn(0x7f3f5c070900 0x7f3f5c06c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 >> v1:172.21.15.37:6789/0 conn(0x7f3f5c15fcd0 legacy=0x7f3f5c06ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f5be00640 1 --2- 172.21.15.37:0/2772720080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f44005bd0 0x7f3f44005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f5be00640 1 --2- 172.21.15.37:0/2772720080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c06ceb0 0x7f3f44006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f5be00640 1 --2- 172.21.15.37:0/2772720080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f44006f60 0x7f3f440073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c0aef80 con 0x7f3f44006f60 2024-05-30T06:53:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c0af260 con 0x7f3f44005bd0 2024-05-30T06:53:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3f4400dbe0 con 0x7f3f5c06ceb0 2024-05-30T06:53:09.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f62200640 1 --2- 172.21.15.37:0/2772720080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f44006f60 0x7f3f440073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f60e00640 1 --2- 172.21.15.37:0/2772720080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c06ceb0 0x7f3f44006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f61800640 1 --2- 172.21.15.37:0/2772720080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f44005bd0 0x7f3f44005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f62200640 1 -- 172.21.15.37:0/2772720080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c06ceb0 msgr2=0x7f3f44006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f62200640 1 --2- 172.21.15.37:0/2772720080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c06ceb0 0x7f3f44006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f62200640 1 -- 172.21.15.37:0/2772720080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f44005bd0 msgr2=0x7f3f44005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f62200640 1 --2- 172.21.15.37:0/2772720080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f44005bd0 0x7f3f44005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f62200640 1 -- 172.21.15.37:0/2772720080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f44005740 con 0x7f3f44006f60 2024-05-30T06:53:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f62200640 1 --2- 172.21.15.37:0/2772720080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f44006f60 0x7f3f440073e0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400e350 tx=0x7f3f5401ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda34973bfcd1bc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f540b2070 con 0x7f3f44006f60 2024-05-30T06:53:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f540a5e10 con 0x7f3f44006f60 2024-05-30T06:53:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.923+0000 7f3f5be00640 1 -- 172.21.15.37:0/2772720080 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f54009de0 con 0x7f3f44006f60 2024-05-30T06:53:09.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 -- 172.21.15.37:0/2772720080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f44006f60 msgr2=0x7f3f440073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 --2- 172.21.15.37:0/2772720080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f44006f60 0x7f3f440073e0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400e350 tx=0x7f3f5401ce00 comp rx=0 tx=0).stop 2024-05-30T06:53:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62200640 1 -- 172.21.15.37:0/2772720080 reap_dead start 2024-05-30T06:53:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 -- 172.21.15.37:0/2772720080 shutdown_connections 2024-05-30T06:53:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 -- 172.21.15.37:0/2772720080 >> 172.21.15.37:0/2772720080 conn(0x7f3f5c072a10 msgr2=0x7f3f5c072e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 -- 172.21.15.37:0/2772720080 shutdown_connections 2024-05-30T06:53:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 -- 172.21.15.37:0/2772720080 wait complete. 2024-05-30T06:53:09.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 Processor -- start 2024-05-30T06:53:09.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 -- start start 2024-05-30T06:53:09.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f44006f60 0x7f3f5c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c15b050 0x7f3f5c1443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5c15a210 0x7f3f5c15a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c0b3e60 con 0x7f3f5c15a210 2024-05-30T06:53:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c0b3ce0 con 0x7f3f44006f60 2024-05-30T06:53:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3f5c0b3fe0 con 0x7f3f5c15b050 2024-05-30T06:53:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5c15a210 0x7f3f5c15a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5c15a210 0x7f3f5c15a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40394/0 (socket says 172.21.15.37:40394) 2024-05-30T06:53:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62200640 1 -- 172.21.15.37:0/1871330937 learned_addr learned my addr 172.21.15.37:0/1871330937 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f61800640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f44006f60 0x7f3f5c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f60e00640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c15b050 0x7f3f5c1443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62200640 1 -- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c15b050 msgr2=0x7f3f5c1443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62200640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c15b050 0x7f3f5c1443a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62200640 1 -- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f44006f60 msgr2=0x7f3f5c0cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:09.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62200640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f44006f60 0x7f3f5c0cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:09.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.927+0000 7f3f62200640 1 -- 172.21.15.37:0/1871330937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5c14ef90 con 0x7f3f5c15a210 2024-05-30T06:53:09.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.931+0000 7f3f62200640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5c15a210 0x7f3f5c15a690 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f3f54002240 tx=0x7f3f54009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.931+0000 7f3f59600640 1 -- 172.21.15.37:0/1871330937 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f540b2040 con 0x7f3f5c15a210 2024-05-30T06:53:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.931+0000 7f3f59600640 1 -- 172.21.15.37:0/1871330937 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f54009a50 con 0x7f3f5c15a210 2024-05-30T06:53:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.931+0000 7f3f62c00640 1 -- 172.21.15.37:0/1871330937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f5c0cd910 con 0x7f3f5c15a210 2024-05-30T06:53:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.931+0000 7f3f59600640 1 -- 172.21.15.37:0/1871330937 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f54009de0 con 0x7f3f5c15a210 2024-05-30T06:53:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.931+0000 7f3f62c00640 1 -- 172.21.15.37:0/1871330937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f5c0cded0 con 0x7f3f5c15a210 2024-05-30T06:53:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.931+0000 7f3f62c00640 1 -- 172.21.15.37:0/1871330937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f5c075580 con 0x7f3f5c15a210 2024-05-30T06:53:09.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.931+0000 7f3f59600640 1 -- 172.21.15.37:0/1871330937 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f3f540be020 con 0x7f3f5c15a210 2024-05-30T06:53:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.931+0000 7f3f59600640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f3c069520 0x7f3f3c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.931+0000 7f3f59600640 1 -- 172.21.15.37:0/1871330937 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f3f5411f820 con 0x7f3f5c15a210 2024-05-30T06:53:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.931+0000 7f3f61800640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f3c069520 0x7f3f3c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:09.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.935+0000 7f3f61800640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f3c069520 0x7f3f3c06b9e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3f50000c10 tx=0x7f3f50007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:09.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:09.935+0000 7f3f59600640 1 -- 172.21.15.37:0/1871330937 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3f540c5020 con 0x7f3f5c15a210 2024-05-30T06:53:10.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.123+0000 7f3f62c00640 1 -- 172.21.15.37:0/1871330937 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone371016", "target": ["mon-mgr", ""]}) -- 0x7f3f5c0ae3f0 con 0x7f3f3c069520 2024-05-30T06:53:10.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.143+0000 7f3f59600640 1 -- 172.21.15.37:0/1871330937 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3f5c0ae3f0 con 0x7f3f3c069520 2024-05-30T06:53:10.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.147+0000 7f3f62c00640 1 -- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f3c069520 msgr2=0x7f3f3c06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:10.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.147+0000 7f3f62c00640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f3c069520 0x7f3f3c06b9e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3f50000c10 tx=0x7f3f50007900 comp rx=0 tx=0).stop 2024-05-30T06:53:10.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.147+0000 7f3f62c00640 1 -- 172.21.15.37:0/1871330937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5c15a210 msgr2=0x7f3f5c15a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:10.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.147+0000 7f3f62c00640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5c15a210 0x7f3f5c15a690 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f3f54002240 tx=0x7f3f54009750 comp rx=0 tx=0).stop 2024-05-30T06:53:10.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.147+0000 7f3f62c00640 1 -- 172.21.15.37:0/1871330937 shutdown_connections 2024-05-30T06:53:10.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.147+0000 7f3f62c00640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f5c15a210 0x7f3f5c15a690 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.147+0000 7f3f62c00640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f5c15b050 0x7f3f5c1443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.147+0000 7f3f62c00640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f3c069520 0x7f3f3c06b9e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.147+0000 7f3f62c00640 1 --2- 172.21.15.37:0/1871330937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f44006f60 0x7f3f5c0cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.147+0000 7f3f62c00640 1 -- 172.21.15.37:0/1871330937 >> 172.21.15.37:0/1871330937 conn(0x7f3f5c072a10 msgr2=0x7f3f5c06ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:10.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.147+0000 7f3f62c00640 1 -- 172.21.15.37:0/1871330937 shutdown_connections 2024-05-30T06:53:10.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.147+0000 7f3f62c00640 1 -- 172.21.15.37:0/1871330937 wait complete. 2024-05-30T06:53:10.148 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:10.149+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:10.148 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:10.149+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:10.148 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:10.149+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:10.148 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:10.149+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:10.148 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:10.149+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:10.164 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:10.165+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:10.164 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:10.165+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:10.164 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:10.165+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:10.165 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:10.165+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:10.165 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:10.165+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:10.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone371010 2024-05-30T06:53:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6dab400640 1 Processor -- start 2024-05-30T06:53:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6dab400640 1 -- start start 2024-05-30T06:53:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6dab400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6da4072e60 0x7f6da40cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6dab400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da40702d0 0x7f6da40cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6dab400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6da41601a0 con 0x7f6da4159490 2024-05-30T06:53:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6dab400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6da4162800 con 0x7f6da4072e60 2024-05-30T06:53:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6dab400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6da40d06e0 con 0x7f6da40702d0 2024-05-30T06:53:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6da3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6da4072e60 0x7f6da40cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6da3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6da4072e60 0x7f6da40cec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40404/0 (socket says 172.21.15.37:40404) 2024-05-30T06:53:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6da3e00640 1 -- 172.21.15.37:0/864639772 learned_addr learned my addr 172.21.15.37:0/864639772 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6da9400640 1 --2- 172.21.15.37:0/864639772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da40702d0 0x7f6da40cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6da3e00640 1 -- 172.21.15.37:0/864639772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da40702d0 msgr2=0x7f6da40cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6da3e00640 1 --2- 172.21.15.37:0/864639772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da40702d0 0x7f6da40cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6da3e00640 1 -- 172.21.15.37:0/864639772 >> v1:172.21.15.105:6789/0 conn(0x7f6da4159490 legacy=0x7f6da4072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.319+0000 7f6da3e00640 1 -- 172.21.15.37:0/864639772 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da4162a50 con 0x7f6da4072e60 2024-05-30T06:53:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.323+0000 7f6da3e00640 1 --2- 172.21.15.37:0/864639772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da4072e60 0x7f6da40cec50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6da4162980 tx=0x7f6d9001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0351474f8d238b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.323+0000 7f6da3400640 1 -- 172.21.15.37:0/864639772 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d900b0070 con 0x7f6da4072e60 2024-05-30T06:53:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.323+0000 7f6da3400640 1 -- 172.21.15.37:0/864639772 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d900ab600 con 0x7f6da4072e60 2024-05-30T06:53:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.323+0000 7f6da3400640 1 -- 172.21.15.37:0/864639772 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d900ab9d0 con 0x7f6da4072e60 2024-05-30T06:53:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.323+0000 7f6dab400640 1 -- 172.21.15.37:0/864639772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da4072e60 msgr2=0x7f6da40cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.323+0000 7f6dab400640 1 --2- 172.21.15.37:0/864639772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da4072e60 0x7f6da40cec50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6da4162980 tx=0x7f6d9001c420 comp rx=0 tx=0).stop 2024-05-30T06:53:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.323+0000 7f6dab400640 1 -- 172.21.15.37:0/864639772 shutdown_connections 2024-05-30T06:53:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.323+0000 7f6dab400640 1 --2- 172.21.15.37:0/864639772 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da40702d0 0x7f6da40cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.323+0000 7f6dab400640 1 --2- 172.21.15.37:0/864639772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da4072e60 0x7f6da40cec50 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.323+0000 7f6dab400640 1 -- 172.21.15.37:0/864639772 >> 172.21.15.37:0/864639772 conn(0x7f6da40d0d50 msgr2=0x7f6da40d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.323+0000 7f6dab400640 1 -- 172.21.15.37:0/864639772 shutdown_connections 2024-05-30T06:53:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.323+0000 7f6dab400640 1 -- 172.21.15.37:0/864639772 wait complete. 2024-05-30T06:53:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6dab400640 1 Processor -- start 2024-05-30T06:53:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6dab400640 1 -- start start 2024-05-30T06:53:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6dab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da40702d0 0x7f6da4157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6dab400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6da4072e60 0x7f6da40b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6dab400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da4159490 0x7f6da4150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6dab400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6da40d0270 con 0x7f6da40702d0 2024-05-30T06:53:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6dab400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6da40d00f0 con 0x7f6da4072e60 2024-05-30T06:53:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6dab400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6da40d03f0 con 0x7f6da4159490 2024-05-30T06:53:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da40702d0 0x7f6da4157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da40702d0 0x7f6da4157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40420/0 (socket says 172.21.15.37:40420) 2024-05-30T06:53:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da8a00640 1 -- 172.21.15.37:0/4232836600 learned_addr learned my addr 172.21.15.37:0/4232836600 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da3e00640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6da4072e60 0x7f6da40b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da9400640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da4159490 0x7f6da4150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da8a00640 1 -- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da4159490 msgr2=0x7f6da4150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da8a00640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da4159490 0x7f6da4150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da8a00640 1 -- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6da4072e60 msgr2=0x7f6da40b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da8a00640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6da4072e60 0x7f6da40b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da8a00640 1 -- 172.21.15.37:0/4232836600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da4157aa0 con 0x7f6da40702d0 2024-05-30T06:53:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da8a00640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da40702d0 0x7f6da4157410 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800c420 tx=0x7f6d9800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da0c00640 1 -- 172.21.15.37:0/4232836600 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d980052d0 con 0x7f6da40702d0 2024-05-30T06:53:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da0c00640 1 -- 172.21.15.37:0/4232836600 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d98005470 con 0x7f6da40702d0 2024-05-30T06:53:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6da0c00640 1 -- 172.21.15.37:0/4232836600 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98007260 con 0x7f6da40702d0 2024-05-30T06:53:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6dab400640 1 -- 172.21.15.37:0/4232836600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da4157d80 con 0x7f6da40702d0 2024-05-30T06:53:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6dab400640 1 -- 172.21.15.37:0/4232836600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da4158340 con 0x7f6da40702d0 2024-05-30T06:53:10.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.327+0000 7f6dab400640 1 -- 172.21.15.37:0/4232836600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da4068d40 con 0x7f6da40702d0 2024-05-30T06:53:10.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.331+0000 7f6da0c00640 1 -- 172.21.15.37:0/4232836600 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7f6d98007400 con 0x7f6da40702d0 2024-05-30T06:53:10.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.331+0000 7f6da0c00640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d840694f0 0x7f6d8406b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:10.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.331+0000 7f6da0c00640 1 -- 172.21.15.37:0/4232836600 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f6d98084d20 con 0x7f6da40702d0 2024-05-30T06:53:10.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.331+0000 7f6da3e00640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d840694f0 0x7f6d8406b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.331+0000 7f6da3e00640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d840694f0 0x7f6d8406b9b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6d900ad000 tx=0x7f6d90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.335+0000 7f6da0c00640 1 -- 172.21.15.37:0/4232836600 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6d98056390 con 0x7f6da40702d0 2024-05-30T06:53:10.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.523+0000 7f6dab400640 1 -- 172.21.15.37:0/4232836600 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone371010", "target": ["mon-mgr", ""]}) -- 0x7f6da415ebe0 con 0x7f6d840694f0 2024-05-30T06:53:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.547+0000 7f6da0c00640 1 -- 172.21.15.37:0/4232836600 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6da415ebe0 con 0x7f6d840694f0 2024-05-30T06:53:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.547+0000 7f6dab400640 1 -- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d840694f0 msgr2=0x7f6d8406b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.547+0000 7f6dab400640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d840694f0 0x7f6d8406b9b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6d900ad000 tx=0x7f6d90008040 comp rx=0 tx=0).stop 2024-05-30T06:53:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.547+0000 7f6dab400640 1 -- 172.21.15.37:0/4232836600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da40702d0 msgr2=0x7f6da4157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.547+0000 7f6dab400640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da40702d0 0x7f6da4157410 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800c420 tx=0x7f6d9800c8e0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.547+0000 7f6dab400640 1 -- 172.21.15.37:0/4232836600 shutdown_connections 2024-05-30T06:53:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.547+0000 7f6dab400640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da4159490 0x7f6da4150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.547+0000 7f6dab400640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d840694f0 0x7f6d8406b9b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.547+0000 7f6dab400640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6da4072e60 0x7f6da40b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.547+0000 7f6dab400640 1 --2- 172.21.15.37:0/4232836600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da40702d0 0x7f6da4157410 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.547+0000 7f6dab400640 1 -- 172.21.15.37:0/4232836600 >> 172.21.15.37:0/4232836600 conn(0x7f6da40d0d50 msgr2=0x7f6da4072750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.547+0000 7f6dab400640 1 -- 172.21.15.37:0/4232836600 shutdown_connections 2024-05-30T06:53:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.547+0000 7f6dab400640 1 -- 172.21.15.37:0/4232836600 wait complete. 2024-05-30T06:53:10.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone37105 2024-05-30T06:53:10.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa531800640 1 Processor -- start 2024-05-30T06:53:10.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa531800640 1 -- start start 2024-05-30T06:53:10.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa531800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa52c0b25d0 0x7fa52c09b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:10.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa531800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa52c0af410 0x7fa52c0af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:10.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa531800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa52c0b2a00 con 0x7fa52c15c780 2024-05-30T06:53:10.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa531800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa52c0b38c0 con 0x7fa52c0af410 2024-05-30T06:53:10.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa531800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa52c0b2cb0 con 0x7fa52c0b25d0 2024-05-30T06:53:10.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa52b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa52c0af410 0x7fa52c0af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:10.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa52b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa52c0af410 0x7fa52c0af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40426/0 (socket says 172.21.15.37:40426) 2024-05-30T06:53:10.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa52b400640 1 -- 172.21.15.37:0/3468358200 learned_addr learned my addr 172.21.15.37:0/3468358200 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:10.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa52b400640 1 -- 172.21.15.37:0/3468358200 >> v2:172.21.15.105:3300/0 conn(0x7fa52c0b25d0 msgr2=0x7fa52c09b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:10.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa52b400640 1 --2- 172.21.15.37:0/3468358200 >> v2:172.21.15.105:3300/0 conn(0x7fa52c0b25d0 0x7fa52c09b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa52b400640 1 -- 172.21.15.37:0/3468358200 >> v1:172.21.15.105:6789/0 conn(0x7fa52c15c780 legacy=0x7fa52c09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:10.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.719+0000 7fa52b400640 1 -- 172.21.15.37:0/3468358200 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52c0b2f90 con 0x7fa52c0af410 2024-05-30T06:53:10.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.723+0000 7fa52b400640 1 --2- 172.21.15.37:0/3468358200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa52c0af410 0x7fa52c0af850 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0d3650 tx=0x7fa52401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8d27159bd00ae6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:10.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.723+0000 7fa52a000640 1 -- 172.21.15.37:0/3468358200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240a5840 con 0x7fa52c0af410 2024-05-30T06:53:10.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.723+0000 7fa52a000640 1 -- 172.21.15.37:0/3468358200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5240a59e0 con 0x7fa52c0af410 2024-05-30T06:53:10.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.723+0000 7fa52a000640 1 -- 172.21.15.37:0/3468358200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240a5db0 con 0x7fa52c0af410 2024-05-30T06:53:10.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.723+0000 7fa531800640 1 -- 172.21.15.37:0/3468358200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa52c0af410 msgr2=0x7fa52c0af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:10.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.723+0000 7fa531800640 1 --2- 172.21.15.37:0/3468358200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa52c0af410 0x7fa52c0af850 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0d3650 tx=0x7fa52401c980 comp rx=0 tx=0).stop 2024-05-30T06:53:10.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.723+0000 7fa531800640 1 -- 172.21.15.37:0/3468358200 shutdown_connections 2024-05-30T06:53:10.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.723+0000 7fa531800640 1 --2- 172.21.15.37:0/3468358200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa52c0af410 0x7fa52c0af850 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.723+0000 7fa531800640 1 --2- 172.21.15.37:0/3468358200 >> v2:172.21.15.105:3300/0 conn(0x7fa52c0b25d0 0x7fa52c09b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.723+0000 7fa531800640 1 -- 172.21.15.37:0/3468358200 >> 172.21.15.37:0/3468358200 conn(0x7fa52c0d26a0 msgr2=0x7fa52c0d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:10.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.723+0000 7fa531800640 1 -- 172.21.15.37:0/3468358200 shutdown_connections 2024-05-30T06:53:10.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.723+0000 7fa531800640 1 -- 172.21.15.37:0/3468358200 wait complete. 2024-05-30T06:53:10.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa531800640 1 Processor -- start 2024-05-30T06:53:10.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa531800640 1 -- start start 2024-05-30T06:53:10.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa531800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa52c0af410 0x7fa52c166220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:10.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa531800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa52c0b25d0 0x7fa52c0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:10.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa531800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa52c15c780 0x7fa52c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:10.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa531800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa52c0b3ed0 con 0x7fa52c0af410 2024-05-30T06:53:10.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa531800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa52c0b3d50 con 0x7fa52c15c780 2024-05-30T06:53:10.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa531800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa52c09b6b0 con 0x7fa52c0b25d0 2024-05-30T06:53:10.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa52aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa52c0af410 0x7fa52c166220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa52aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa52c0af410 0x7fa52c166220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40436/0 (socket says 172.21.15.37:40436) 2024-05-30T06:53:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa52aa00640 1 -- 172.21.15.37:0/180503745 learned_addr learned my addr 172.21.15.37:0/180503745 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa52aa00640 1 -- 172.21.15.37:0/180503745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa52c0b25d0 msgr2=0x7fa52c0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa52aa00640 1 --2- 172.21.15.37:0/180503745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa52c0b25d0 0x7fa52c0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa52aa00640 1 -- 172.21.15.37:0/180503745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa52c15c780 msgr2=0x7fa52c1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa52aa00640 1 --2- 172.21.15.37:0/180503745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa52c15c780 0x7fa52c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa52aa00640 1 -- 172.21.15.37:0/180503745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52c155c20 con 0x7fa52c0af410 2024-05-30T06:53:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa52aa00640 1 --2- 172.21.15.37:0/180503745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa52c0af410 0x7fa52c166220 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00b3e0 tx=0x7fa51c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa523400640 1 -- 172.21.15.37:0/180503745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c015020 con 0x7fa52c0af410 2024-05-30T06:53:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa523400640 1 -- 172.21.15.37:0/180503745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51c011850 con 0x7fa52c0af410 2024-05-30T06:53:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa523400640 1 -- 172.21.15.37:0/180503745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c011c40 con 0x7fa52c0af410 2024-05-30T06:53:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa531800640 1 -- 172.21.15.37:0/180503745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa52c155ec0 con 0x7fa52c0af410 2024-05-30T06:53:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa531800640 1 -- 172.21.15.37:0/180503745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa52c0b0b10 con 0x7fa52c0af410 2024-05-30T06:53:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.727+0000 7fa531800640 1 -- 172.21.15.37:0/180503745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa52c068d40 con 0x7fa52c0af410 2024-05-30T06:53:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.731+0000 7fa523400640 1 -- 172.21.15.37:0/180503745 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7fa51c018020 con 0x7fa52c0af410 2024-05-30T06:53:10.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.731+0000 7fa523400640 1 --2- 172.21.15.37:0/180503745 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa5080694f0 0x7fa50806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:10.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.731+0000 7fa523400640 1 -- 172.21.15.37:0/180503745 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fa51c085830 con 0x7fa52c0af410 2024-05-30T06:53:10.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.731+0000 7fa522000640 1 --2- 172.21.15.37:0/180503745 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa5080694f0 0x7fa50806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:10.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.731+0000 7fa522000640 1 --2- 172.21.15.37:0/180503745 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa5080694f0 0x7fa50806b9b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa52c070460 tx=0x7fa514006ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:10.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.735+0000 7fa523400640 1 -- 172.21.15.37:0/180503745 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa51c01f020 con 0x7fa52c0af410 2024-05-30T06:53:10.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.927+0000 7fa531800640 1 -- 172.21.15.37:0/180503745 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone37105", "target": ["mon-mgr", ""]}) -- 0x7fa52c15a240 con 0x7fa5080694f0 2024-05-30T06:53:10.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.951+0000 7fa523400640 1 -- 172.21.15.37:0/180503745 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa52c15a240 con 0x7fa5080694f0 2024-05-30T06:53:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.951+0000 7fa531800640 1 -- 172.21.15.37:0/180503745 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa5080694f0 msgr2=0x7fa50806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.951+0000 7fa531800640 1 --2- 172.21.15.37:0/180503745 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa5080694f0 0x7fa50806b9b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa52c070460 tx=0x7fa514006ca0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.951+0000 7fa531800640 1 -- 172.21.15.37:0/180503745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa52c0af410 msgr2=0x7fa52c166220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.951+0000 7fa531800640 1 --2- 172.21.15.37:0/180503745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa52c0af410 0x7fa52c166220 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00b3e0 tx=0x7fa51c00b8a0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.951+0000 7fa531800640 1 -- 172.21.15.37:0/180503745 shutdown_connections 2024-05-30T06:53:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.951+0000 7fa531800640 1 --2- 172.21.15.37:0/180503745 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa5080694f0 0x7fa50806b9b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.951+0000 7fa531800640 1 --2- 172.21.15.37:0/180503745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa52c15c780 0x7fa52c1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.951+0000 7fa531800640 1 --2- 172.21.15.37:0/180503745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa52c0b25d0 0x7fa52c0b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.951+0000 7fa531800640 1 --2- 172.21.15.37:0/180503745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa52c0af410 0x7fa52c166220 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.951+0000 7fa531800640 1 -- 172.21.15.37:0/180503745 >> 172.21.15.37:0/180503745 conn(0x7fa52c0d26a0 msgr2=0x7fa52c0d0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.951+0000 7fa531800640 1 -- 172.21.15.37:0/180503745 shutdown_connections 2024-05-30T06:53:10.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:10.951+0000 7fa531800640 1 -- 172.21.15.37:0/180503745 wait complete. 2024-05-30T06:53:10.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone37108 2024-05-30T06:53:11.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.123+0000 7fa689800640 1 Processor -- start 2024-05-30T06:53:11.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.123+0000 7fa689800640 1 -- start start 2024-05-30T06:53:11.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.123+0000 7fa689800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa6841590c0 0x7fa6840cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.123+0000 7fa689800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6840cd400 0x7fa6840b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.123+0000 7fa689800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa68415f230 con 0x7fa6840cde60 2024-05-30T06:53:11.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.123+0000 7fa689800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa68415f510 con 0x7fa6841590c0 2024-05-30T06:53:11.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.123+0000 7fa689800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa68415f7f0 con 0x7fa6840cd400 2024-05-30T06:53:11.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.127+0000 7fa683400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6840cd400 0x7fa6840b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.127+0000 7fa682a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa6841590c0 0x7fa6840cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.127+0000 7fa683400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6840cd400 0x7fa6840b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:51056/0 (socket says 172.21.15.37:51056) 2024-05-30T06:53:11.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.127+0000 7fa683400640 1 -- 172.21.15.37:0/1694617505 learned_addr learned my addr 172.21.15.37:0/1694617505 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:11.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.127+0000 7fa67a000640 1 --1- 172.21.15.37:0/1694617505 >> v1:172.21.15.105:6789/0 conn(0x7fa6840cde60 0x7fa68406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47582/0 (socket says 172.21.15.37:47582) 2024-05-30T06:53:11.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.127+0000 7fa682a00640 1 -- 172.21.15.37:0/1694617505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6840cd400 msgr2=0x7fa6840b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:11.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.127+0000 7fa682a00640 1 --2- 172.21.15.37:0/1694617505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6840cd400 0x7fa6840b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.127+0000 7fa682a00640 1 -- 172.21.15.37:0/1694617505 >> v1:172.21.15.105:6789/0 conn(0x7fa6840cde60 legacy=0x7fa68406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.127+0000 7fa682a00640 1 -- 172.21.15.37:0/1694617505 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68415fad0 con 0x7fa6841590c0 2024-05-30T06:53:11.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.127+0000 7fa683400640 1 --2- 172.21.15.37:0/1694617505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6840cd400 0x7fa6840b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:11.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.127+0000 7fa682000640 1 -- 172.21.15.37:0/1694617505 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1623127135 0 0) 0x7fa68415f230 con 0x7fa6840cde60 2024-05-30T06:53:11.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.127+0000 7fa682a00640 1 --2- 172.21.15.37:0/1694617505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6841590c0 0x7fa6840cd920 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa6740097c0 tx=0x7fa67401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a703920b1ac690af server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:11.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa682000640 1 -- 172.21.15.37:0/1694617505 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6740b0070 con 0x7fa6841590c0 2024-05-30T06:53:11.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa682000640 1 -- 172.21.15.37:0/1694617505 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6740ab600 con 0x7fa6841590c0 2024-05-30T06:53:11.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa682000640 1 -- 172.21.15.37:0/1694617505 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6740ab9d0 con 0x7fa6841590c0 2024-05-30T06:53:11.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 -- 172.21.15.37:0/1694617505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6841590c0 msgr2=0x7fa6840cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 --2- 172.21.15.37:0/1694617505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6841590c0 0x7fa6840cd920 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa6740097c0 tx=0x7fa67401c410 comp rx=0 tx=0).stop 2024-05-30T06:53:11.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 -- 172.21.15.37:0/1694617505 shutdown_connections 2024-05-30T06:53:11.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 --2- 172.21.15.37:0/1694617505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6840cd400 0x7fa6840b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 --2- 172.21.15.37:0/1694617505 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6841590c0 0x7fa6840cd920 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 -- 172.21.15.37:0/1694617505 >> 172.21.15.37:0/1694617505 conn(0x7fa68406bf60 msgr2=0x7fa6840b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:11.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 -- 172.21.15.37:0/1694617505 shutdown_connections 2024-05-30T06:53:11.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 -- 172.21.15.37:0/1694617505 wait complete. 2024-05-30T06:53:11.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 Processor -- start 2024-05-30T06:53:11.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 -- start start 2024-05-30T06:53:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6840cd400 0x7fa68415c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6840cde60 0x7fa684159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6841590c0 0x7fa68413ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa68406f770 con 0x7fa6840cde60 2024-05-30T06:53:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa6840b46b0 con 0x7fa6841590c0 2024-05-30T06:53:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa689800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa68406f8f0 con 0x7fa6840cd400 2024-05-30T06:53:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa67a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6840cde60 0x7fa684159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa67a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6840cde60 0x7fa684159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40438/0 (socket says 172.21.15.37:40438) 2024-05-30T06:53:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa67a000640 1 -- 172.21.15.37:0/1607849474 learned_addr learned my addr 172.21.15.37:0/1607849474 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa683400640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6841590c0 0x7fa68413ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.131+0000 7fa682a00640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6840cd400 0x7fa68415c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.135+0000 7fa67a000640 1 -- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6840cd400 msgr2=0x7fa68415c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.135+0000 7fa67a000640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6840cd400 0x7fa68415c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.135+0000 7fa67a000640 1 -- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6841590c0 msgr2=0x7fa68413ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.135+0000 7fa67a000640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6841590c0 0x7fa68413ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.135+0000 7fa67a000640 1 -- 172.21.15.37:0/1607849474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68415e7f0 con 0x7fa6840cde60 2024-05-30T06:53:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.135+0000 7fa67a000640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6840cde60 0x7fa684159710 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c4b0 tx=0x7fa66c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.135+0000 7fa67b400640 1 -- 172.21.15.37:0/1607849474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c018070 con 0x7fa6840cde60 2024-05-30T06:53:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.135+0000 7fa67b400640 1 -- 172.21.15.37:0/1607849474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c007500 con 0x7fa6840cde60 2024-05-30T06:53:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.135+0000 7fa67b400640 1 -- 172.21.15.37:0/1607849474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c004a30 con 0x7fa6840cde60 2024-05-30T06:53:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.135+0000 7fa689800640 1 -- 172.21.15.37:0/1607849474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68415ead0 con 0x7fa6840cde60 2024-05-30T06:53:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.135+0000 7fa689800640 1 -- 172.21.15.37:0/1607849474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa68414cb20 con 0x7fa6840cde60 2024-05-30T06:53:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.135+0000 7fa689800640 1 -- 172.21.15.37:0/1607849474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa684068d40 con 0x7fa6840cde60 2024-05-30T06:53:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.135+0000 7fa67b400640 1 -- 172.21.15.37:0/1607849474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7fa66c004bd0 con 0x7fa6840cde60 2024-05-30T06:53:11.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.139+0000 7fa67b400640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa6600694f0 0x7fa66006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.139+0000 7fa67b400640 1 -- 172.21.15.37:0/1607849474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fa66c084a70 con 0x7fa6840cde60 2024-05-30T06:53:11.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.139+0000 7fa682a00640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa6600694f0 0x7fa66006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.139+0000 7fa682a00640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa6600694f0 0x7fa66006b9b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa6740ad000 tx=0x7fa6740a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.143+0000 7fa67b400640 1 -- 172.21.15.37:0/1607849474 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa66c056200 con 0x7fa6840cde60 2024-05-30T06:53:11.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.335+0000 7fa689800640 1 -- 172.21.15.37:0/1607849474 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone37108", "target": ["mon-mgr", ""]}) -- 0x7fa68415e5a0 con 0x7fa6600694f0 2024-05-30T06:53:11.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.359+0000 7fa67b400640 1 -- 172.21.15.37:0/1607849474 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa68415e5a0 con 0x7fa6600694f0 2024-05-30T06:53:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.363+0000 7fa689800640 1 -- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa6600694f0 msgr2=0x7fa66006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.363+0000 7fa689800640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa6600694f0 0x7fa66006b9b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa6740ad000 tx=0x7fa6740a6000 comp rx=0 tx=0).stop 2024-05-30T06:53:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.363+0000 7fa689800640 1 -- 172.21.15.37:0/1607849474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6840cde60 msgr2=0x7fa684159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.363+0000 7fa689800640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6840cde60 0x7fa684159710 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c4b0 tx=0x7fa66c00c970 comp rx=0 tx=0).stop 2024-05-30T06:53:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.363+0000 7fa689800640 1 -- 172.21.15.37:0/1607849474 shutdown_connections 2024-05-30T06:53:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.363+0000 7fa689800640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa6600694f0 0x7fa66006b9b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.363+0000 7fa689800640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6841590c0 0x7fa68413ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.363+0000 7fa689800640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6840cde60 0x7fa684159710 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.363+0000 7fa689800640 1 --2- 172.21.15.37:0/1607849474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6840cd400 0x7fa68415c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.363+0000 7fa689800640 1 -- 172.21.15.37:0/1607849474 >> 172.21.15.37:0/1607849474 conn(0x7fa68406bf60 msgr2=0x7fa6841651c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.363+0000 7fa689800640 1 -- 172.21.15.37:0/1607849474 shutdown_connections 2024-05-30T06:53:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.363+0000 7fa689800640 1 -- 172.21.15.37:0/1607849474 wait complete. 2024-05-30T06:53:11.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone37107 2024-05-30T06:53:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa19c00640 1 Processor -- start 2024-05-30T06:53:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa19c00640 1 -- start start 2024-05-30T06:53:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa19c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffa1415fc40 0x7ffa140cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa19c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa140d0fb0 con 0x7ffa140d0090 2024-05-30T06:53:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa19c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa140cd170 con 0x7ffa1409b170 2024-05-30T06:53:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa19c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ffa140d2310 con 0x7ffa1415fc40 2024-05-30T06:53:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa0b400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffa140d0090 0x7ffa1409aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33556/0 (socket says 172.21.15.37:33556) 2024-05-30T06:53:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa0b400640 1 -- 172.21.15.37:0/1368985313 learned_addr learned my addr 172.21.15.37:0/1368985313 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa13e00640 1 --2- 172.21.15.37:0/1368985313 >> v2:172.21.15.105:3300/0 conn(0x7ffa1415fc40 0x7ffa140cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa13400640 1 -- 172.21.15.37:0/1368985313 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1445484312 0 0) 0x7ffa140d0fb0 con 0x7ffa140d0090 2024-05-30T06:53:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa13400640 1 -- 172.21.15.37:0/1368985313 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9f8003530 con 0x7ffa140d0090 2024-05-30T06:53:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa13400640 1 -- 172.21.15.37:0/1368985313 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 54208048 0 0) 0x7ffa140cd170 con 0x7ffa1409b170 2024-05-30T06:53:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa13400640 1 -- 172.21.15.37:0/1368985313 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa140d0fb0 con 0x7ffa1409b170 2024-05-30T06:53:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa13e00640 1 -- 172.21.15.37:0/1368985313 >> v1:172.21.15.105:6789/0 conn(0x7ffa1409b170 legacy=0x7ffa140c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa13e00640 1 -- 172.21.15.37:0/1368985313 >> v1:172.21.15.37:6789/0 conn(0x7ffa140d0090 legacy=0x7ffa1409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.531+0000 7ffa13e00640 1 -- 172.21.15.37:0/1368985313 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa140cd450 con 0x7ffa1415fc40 2024-05-30T06:53:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.535+0000 7ffa13e00640 1 --2- 172.21.15.37:0/1368985313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa1415fc40 0x7ffa140cdc50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ffa040097c0 tx=0x7ffa0401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b274fb9572a4bcf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.535+0000 7ffa13400640 1 -- 172.21.15.37:0/1368985313 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa040b0070 con 0x7ffa1415fc40 2024-05-30T06:53:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.535+0000 7ffa13400640 1 -- 172.21.15.37:0/1368985313 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa040ab600 con 0x7ffa1415fc40 2024-05-30T06:53:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.535+0000 7ffa13400640 1 -- 172.21.15.37:0/1368985313 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa040ab9d0 con 0x7ffa1415fc40 2024-05-30T06:53:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.535+0000 7ffa19c00640 1 -- 172.21.15.37:0/1368985313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa1415fc40 msgr2=0x7ffa140cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.535+0000 7ffa19c00640 1 --2- 172.21.15.37:0/1368985313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa1415fc40 0x7ffa140cdc50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ffa040097c0 tx=0x7ffa0401c410 comp rx=0 tx=0).stop 2024-05-30T06:53:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.535+0000 7ffa19c00640 1 -- 172.21.15.37:0/1368985313 shutdown_connections 2024-05-30T06:53:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.535+0000 7ffa19c00640 1 --2- 172.21.15.37:0/1368985313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa1415fc40 0x7ffa140cdc50 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.535+0000 7ffa19c00640 1 -- 172.21.15.37:0/1368985313 >> 172.21.15.37:0/1368985313 conn(0x7ffa140d24c0 msgr2=0x7ffa140d28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.535+0000 7ffa19c00640 1 -- 172.21.15.37:0/1368985313 shutdown_connections 2024-05-30T06:53:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.535+0000 7ffa19c00640 1 -- 172.21.15.37:0/1368985313 wait complete. 2024-05-30T06:53:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19c00640 1 Processor -- start 2024-05-30T06:53:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19c00640 1 -- start start 2024-05-30T06:53:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa1409b170 0x7ffa1414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa140d0090 0x7ffa1406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa1415fc40 0x7ffa140cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa140ce310 con 0x7ffa1415fc40 2024-05-30T06:53:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffa140ce190 con 0x7ffa140d0090 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1406ca70 con 0x7ffa1409b170 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa1415fc40 0x7ffa140cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa1415fc40 0x7ffa140cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40444/0 (socket says 172.21.15.37:40444) 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19200640 1 -- 172.21.15.37:0/2575497149 learned_addr learned my addr 172.21.15.37:0/2575497149 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa0b400640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa140d0090 0x7ffa1406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19200640 1 -- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa1409b170 msgr2=0x7ffa1414f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa13e00640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa1409b170 0x7ffa1414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19200640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa1409b170 0x7ffa1414f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19200640 1 -- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa140d0090 msgr2=0x7ffa1406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19200640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa140d0090 0x7ffa1406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19200640 1 -- 172.21.15.37:0/2575497149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa141500b0 con 0x7ffa1415fc40 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa13e00640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa1409b170 0x7ffa1414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa0b400640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa140d0090 0x7ffa1406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19200640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa1415fc40 0x7ffa140cbe50 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00c790 tx=0x7ffa0c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:11.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa10c00640 1 -- 172.21.15.37:0/2575497149 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c003b80 con 0x7ffa1415fc40 2024-05-30T06:53:11.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa10c00640 1 -- 172.21.15.37:0/2575497149 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c003d20 con 0x7ffa1415fc40 2024-05-30T06:53:11.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa10c00640 1 -- 172.21.15.37:0/2575497149 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c00aa50 con 0x7ffa1415fc40 2024-05-30T06:53:11.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19c00640 1 -- 172.21.15.37:0/2575497149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa14150390 con 0x7ffa1415fc40 2024-05-30T06:53:11.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19c00640 1 -- 172.21.15.37:0/2575497149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa14150950 con 0x7ffa1415fc40 2024-05-30T06:53:11.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.539+0000 7ffa19c00640 1 -- 172.21.15.37:0/2575497149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa14068ab0 con 0x7ffa1415fc40 2024-05-30T06:53:11.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.543+0000 7ffa10c00640 1 -- 172.21.15.37:0/2575497149 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) ==== 89568+0+0 (secure 0 0 0) 0x7ffa0c00abf0 con 0x7ffa1415fc40 2024-05-30T06:53:11.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.543+0000 7ffa10c00640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff9f00694f0 0x7ff9f006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.543+0000 7ffa10c00640 1 -- 172.21.15.37:0/2575497149 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7ffa0c085870 con 0x7ffa1415fc40 2024-05-30T06:53:11.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.543+0000 7ffa13e00640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff9f00694f0 0x7ff9f006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.543+0000 7ffa13e00640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff9f00694f0 0x7ff9f006b9b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ffa040ad000 tx=0x7ffa04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:11.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.547+0000 7ffa10c00640 1 -- 172.21.15.37:0/2575497149 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffa0c057530 con 0x7ffa1415fc40 2024-05-30T06:53:11.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.735+0000 7ffa19c00640 1 -- 172.21.15.37:0/2575497149 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone37107", "target": ["mon-mgr", ""]}) -- 0x7ffa140d3040 con 0x7ff9f00694f0 2024-05-30T06:53:11.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.759+0000 7ffa10c00640 1 -- 172.21.15.37:0/2575497149 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ffa140d3040 con 0x7ff9f00694f0 2024-05-30T06:53:11.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.763+0000 7ffa19c00640 1 -- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff9f00694f0 msgr2=0x7ff9f006b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.763+0000 7ffa19c00640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff9f00694f0 0x7ff9f006b9b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ffa040ad000 tx=0x7ffa04008040 comp rx=0 tx=0).stop 2024-05-30T06:53:11.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.763+0000 7ffa19c00640 1 -- 172.21.15.37:0/2575497149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa1415fc40 msgr2=0x7ffa140cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.763+0000 7ffa19c00640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa1415fc40 0x7ffa140cbe50 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00c790 tx=0x7ffa0c00cc50 comp rx=0 tx=0).stop 2024-05-30T06:53:11.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.763+0000 7ffa19c00640 1 -- 172.21.15.37:0/2575497149 shutdown_connections 2024-05-30T06:53:11.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.763+0000 7ffa19c00640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa1415fc40 0x7ffa140cbe50 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.763+0000 7ffa19c00640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff9f00694f0 0x7ff9f006b9b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.763+0000 7ffa19c00640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa140d0090 0x7ffa1406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.763+0000 7ffa19c00640 1 --2- 172.21.15.37:0/2575497149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa1409b170 0x7ffa1414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.763+0000 7ffa19c00640 1 -- 172.21.15.37:0/2575497149 >> 172.21.15.37:0/2575497149 conn(0x7ffa140d24c0 msgr2=0x7ffa14070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:11.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.763+0000 7ffa19c00640 1 -- 172.21.15.37:0/2575497149 shutdown_connections 2024-05-30T06:53:11.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.763+0000 7ffa19c00640 1 -- 172.21.15.37:0/2575497149 wait complete. 2024-05-30T06:53:11.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone371020 2024-05-30T06:53:11.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.931+0000 7f31ac200640 1 Processor -- start 2024-05-30T06:53:11.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.931+0000 7f31ac200640 1 -- start start 2024-05-30T06:53:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31ac200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31a40cd400 0x7f31a406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31ac200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f31a406f5a0 0x7f31a40b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31ac200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a40ce030 con 0x7f31a41590c0 2024-05-30T06:53:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31ac200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f31a415f230 con 0x7f31a406f5a0 2024-05-30T06:53:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31ac200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31a415f510 con 0x7f31a40cd400 2024-05-30T06:53:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31a9800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f31a41590c0 0x7f31a40cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33568/0 (socket says 172.21.15.37:33568) 2024-05-30T06:53:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31a9800640 1 -- 172.21.15.37:0/982587317 learned_addr learned my addr 172.21.15.37:0/982587317 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31a8e00640 1 --2- 172.21.15.37:0/982587317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31a40cd400 0x7f31a406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31aa200640 1 --2- 172.21.15.37:0/982587317 >> v2:172.21.15.105:3300/0 conn(0x7f31a406f5a0 0x7f31a40b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31a3e00640 1 -- 172.21.15.37:0/982587317 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976963956 0 0) 0x7f31a40ce030 con 0x7f31a41590c0 2024-05-30T06:53:11.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31a3e00640 1 -- 172.21.15.37:0/982587317 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f318c003530 con 0x7f31a41590c0 2024-05-30T06:53:11.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31a8e00640 1 -- 172.21.15.37:0/982587317 >> v2:172.21.15.105:3300/0 conn(0x7f31a406f5a0 msgr2=0x7f31a40b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:11.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31a8e00640 1 --2- 172.21.15.37:0/982587317 >> v2:172.21.15.105:3300/0 conn(0x7f31a406f5a0 0x7f31a40b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31a8e00640 1 -- 172.21.15.37:0/982587317 >> v1:172.21.15.37:6789/0 conn(0x7f31a41590c0 legacy=0x7f31a40cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31a8e00640 1 -- 172.21.15.37:0/982587317 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a415f7f0 con 0x7f31a40cd400 2024-05-30T06:53:11.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.935+0000 7f31aa200640 1 --2- 172.21.15.37:0/982587317 >> v2:172.21.15.105:3300/0 conn(0x7f31a406f5a0 0x7f31a40b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:11.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31a8e00640 1 --2- 172.21.15.37:0/982587317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31a40cd400 0x7f31a406f060 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f31900097c0 tx=0x7f319001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f74113d345f8c565 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:11.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31a3e00640 1 -- 172.21.15.37:0/982587317 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31900b0070 con 0x7f31a40cd400 2024-05-30T06:53:11.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31a3e00640 1 -- 172.21.15.37:0/982587317 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31900ab600 con 0x7f31a40cd400 2024-05-30T06:53:11.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31a3e00640 1 -- 172.21.15.37:0/982587317 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31900ab9d0 con 0x7f31a40cd400 2024-05-30T06:53:11.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 -- 172.21.15.37:0/982587317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31a40cd400 msgr2=0x7f31a406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 --2- 172.21.15.37:0/982587317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31a40cd400 0x7f31a406f060 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f31900097c0 tx=0x7f319001c410 comp rx=0 tx=0).stop 2024-05-30T06:53:11.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 -- 172.21.15.37:0/982587317 shutdown_connections 2024-05-30T06:53:11.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 --2- 172.21.15.37:0/982587317 >> v2:172.21.15.105:3300/0 conn(0x7f31a406f5a0 0x7f31a40b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 --2- 172.21.15.37:0/982587317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31a40cd400 0x7f31a406f060 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 -- 172.21.15.37:0/982587317 >> 172.21.15.37:0/982587317 conn(0x7f31a406bf60 msgr2=0x7f31a40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:11.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 -- 172.21.15.37:0/982587317 shutdown_connections 2024-05-30T06:53:11.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 -- 172.21.15.37:0/982587317 wait complete. 2024-05-30T06:53:11.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 Processor -- start 2024-05-30T06:53:11.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 -- start start 2024-05-30T06:53:11.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31a406f5a0 0x7f31a413b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31a40cd400 0x7f31a4161c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31a41590c0 0x7f31a413bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f31a41684a0 con 0x7f31a40cd400 2024-05-30T06:53:11.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31a406f9b0 con 0x7f31a41590c0 2024-05-30T06:53:11.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31ac200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31a4168620 con 0x7f31a406f5a0 2024-05-30T06:53:11.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31a8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31a40cd400 0x7f31a4161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31a8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31a40cd400 0x7f31a4161c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40460/0 (socket says 172.21.15.37:40460) 2024-05-30T06:53:11.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31a8e00640 1 -- 172.21.15.37:0/3582139617 learned_addr learned my addr 172.21.15.37:0/3582139617 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:11.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.939+0000 7f31a9800640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31a406f5a0 0x7f31a413b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31aa200640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31a41590c0 0x7f31a413bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31a8e00640 1 -- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31a406f5a0 msgr2=0x7f31a413b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31a8e00640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31a406f5a0 0x7f31a413b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31a8e00640 1 -- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31a41590c0 msgr2=0x7f31a413bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:11.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31a8e00640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31a41590c0 0x7f31a413bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:11.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31a8e00640 1 -- 172.21.15.37:0/3582139617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a413c380 con 0x7f31a40cd400 2024-05-30T06:53:11.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31a8e00640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31a40cd400 0x7f31a4161c00 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f319001a040 tx=0x7f31900191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:11.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31a1600640 1 -- 172.21.15.37:0/3582139617 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31900b8020 con 0x7f31a40cd400 2024-05-30T06:53:11.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31a1600640 1 -- 172.21.15.37:0/3582139617 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31900b4410 con 0x7f31a40cd400 2024-05-30T06:53:11.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31a1600640 1 -- 172.21.15.37:0/3582139617 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31900b0040 con 0x7f31a40cd400 2024-05-30T06:53:11.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31ac200640 1 -- 172.21.15.37:0/3582139617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a413c660 con 0x7f31a40cd400 2024-05-30T06:53:11.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31ac200640 1 -- 172.21.15.37:0/3582139617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a413cc20 con 0x7f31a40cd400 2024-05-30T06:53:11.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31ac200640 1 -- 172.21.15.37:0/3582139617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a4068d40 con 0x7f31a40cd400 2024-05-30T06:53:11.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31a1600640 1 -- 172.21.15.37:0/3582139617 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 32) ==== 89670+0+0 (secure 0 0 0) 0x7f31900bb020 con 0x7f31a40cd400 2024-05-30T06:53:11.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31a1600640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3184069610 0x7f318406bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:11.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.943+0000 7f31a1600640 1 -- 172.21.15.37:0/3582139617 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f319011f310 con 0x7f31a40cd400 2024-05-30T06:53:11.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.947+0000 7f31a9800640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3184069610 0x7f318406bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.947+0000 7f31a9800640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3184069610 0x7f318406bad0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3198007fd0 tx=0x7f3198009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:11.947+0000 7f31a1600640 1 -- 172.21.15.37:0/3582139617 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31900c2030 con 0x7f31a40cd400 2024-05-30T06:53:12.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.139+0000 7f31ac200640 1 -- 172.21.15.37:0/3582139617 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone371020", "target": ["mon-mgr", ""]}) -- 0x7f31a415c0d0 con 0x7f3184069610 2024-05-30T06:53:12.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.163+0000 7f31a1600640 1 -- 172.21.15.37:0/3582139617 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f31a415c0d0 con 0x7f3184069610 2024-05-30T06:53:12.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.163+0000 7f31ac200640 1 -- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3184069610 msgr2=0x7f318406bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:12.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.163+0000 7f31ac200640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3184069610 0x7f318406bad0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3198007fd0 tx=0x7f3198009040 comp rx=0 tx=0).stop 2024-05-30T06:53:12.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.163+0000 7f31ac200640 1 -- 172.21.15.37:0/3582139617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31a40cd400 msgr2=0x7f31a4161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:12.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.163+0000 7f31ac200640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31a40cd400 0x7f31a4161c00 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f319001a040 tx=0x7f31900191b0 comp rx=0 tx=0).stop 2024-05-30T06:53:12.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.163+0000 7f31ac200640 1 -- 172.21.15.37:0/3582139617 shutdown_connections 2024-05-30T06:53:12.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.163+0000 7f31ac200640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3184069610 0x7f318406bad0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:12.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.163+0000 7f31ac200640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31a41590c0 0x7f31a413bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:12.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.163+0000 7f31ac200640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31a40cd400 0x7f31a4161c00 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:12.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.163+0000 7f31ac200640 1 --2- 172.21.15.37:0/3582139617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31a406f5a0 0x7f31a413b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:12.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.163+0000 7f31ac200640 1 -- 172.21.15.37:0/3582139617 >> 172.21.15.37:0/3582139617 conn(0x7f31a406bf60 msgr2=0x7f31a406e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:12.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.163+0000 7f31ac200640 1 -- 172.21.15.37:0/3582139617 shutdown_connections 2024-05-30T06:53:12.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.163+0000 7f31ac200640 1 -- 172.21.15.37:0/3582139617 wait complete. 2024-05-30T06:53:12.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T06:53:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.367+0000 7f1f21200640 1 Processor -- start 2024-05-30T06:53:12.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.367+0000 7f1f21200640 1 -- start start 2024-05-30T06:53:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.371+0000 7f1f21200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1f1c0ced10 0x7f1f1c06ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.371+0000 7f1f21200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f1c15d4e0 0x7f1f1c0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.371+0000 7f1f21200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c15db00 con 0x7f1f1c0b59d0 2024-05-30T06:53:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.371+0000 7f1f21200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1f1c06df50 con 0x7f1f1c0ced10 2024-05-30T06:53:12.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.371+0000 7f1f21200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1c06e7d0 con 0x7f1f1c15d4e0 2024-05-30T06:53:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.371+0000 7f1f19e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1f1c0ced10 0x7f1f1c06ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.371+0000 7f1f19400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f1f1c0b59d0 0x7f1f1c15cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47612/0 (socket says 172.21.15.37:47612) 2024-05-30T06:53:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.371+0000 7f1f19400640 1 -- 172.21.15.37:0/2736284301 learned_addr learned my addr 172.21.15.37:0/2736284301 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:12.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.371+0000 7f1f1a800640 1 --2- 172.21.15.37:0/2736284301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f1c15d4e0 0x7f1f1c0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:12.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.371+0000 7f1f18a00640 1 -- 172.21.15.37:0/2736284301 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2702941586 0 0) 0x7f1f1c15db00 con 0x7f1f1c0b59d0 2024-05-30T06:53:12.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.371+0000 7f1f18a00640 1 -- 172.21.15.37:0/2736284301 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f00003530 con 0x7f1f1c0b59d0 2024-05-30T06:53:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.375+0000 7f1f1a800640 1 -- 172.21.15.37:0/2736284301 >> v2:172.21.15.105:3300/0 conn(0x7f1f1c0ced10 msgr2=0x7f1f1c06ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.375+0000 7f1f1a800640 1 --2- 172.21.15.37:0/2736284301 >> v2:172.21.15.105:3300/0 conn(0x7f1f1c0ced10 0x7f1f1c06ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.375+0000 7f1f1a800640 1 -- 172.21.15.37:0/2736284301 >> v1:172.21.15.105:6789/0 conn(0x7f1f1c0b59d0 legacy=0x7f1f1c15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:12.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.375+0000 7f1f1a800640 1 -- 172.21.15.37:0/2736284301 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c06e180 con 0x7f1f1c15d4e0 2024-05-30T06:53:12.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.379+0000 7f1f1a800640 1 --2- 172.21.15.37:0/2736284301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f1c15d4e0 0x7f1f1c0b5e60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009d90 tx=0x7f1f1401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2f8a9dfdad2340e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:12.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.379+0000 7f1f18a00640 1 -- 172.21.15.37:0/2736284301 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140b2070 con 0x7f1f1c15d4e0 2024-05-30T06:53:12.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.379+0000 7f1f18a00640 1 -- 172.21.15.37:0/2736284301 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f140a5940 con 0x7f1f1c15d4e0 2024-05-30T06:53:12.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.379+0000 7f1f18a00640 1 -- 172.21.15.37:0/2736284301 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140a5d10 con 0x7f1f1c15d4e0 2024-05-30T06:53:12.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.379+0000 7f1f21200640 1 -- 172.21.15.37:0/2736284301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f1c15d4e0 msgr2=0x7f1f1c0b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:12.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.379+0000 7f1f21200640 1 --2- 172.21.15.37:0/2736284301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f1c15d4e0 0x7f1f1c0b5e60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009d90 tx=0x7f1f1401c970 comp rx=0 tx=0).stop 2024-05-30T06:53:12.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.379+0000 7f1f21200640 1 -- 172.21.15.37:0/2736284301 shutdown_connections 2024-05-30T06:53:12.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.379+0000 7f1f21200640 1 --2- 172.21.15.37:0/2736284301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f1c15d4e0 0x7f1f1c0b5e60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:12.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.379+0000 7f1f21200640 1 --2- 172.21.15.37:0/2736284301 >> v2:172.21.15.105:3300/0 conn(0x7f1f1c0ced10 0x7f1f1c06ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:12.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.379+0000 7f1f21200640 1 -- 172.21.15.37:0/2736284301 >> 172.21.15.37:0/2736284301 conn(0x7f1f1c06bf60 msgr2=0x7f1f1c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:12.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.379+0000 7f1f21200640 1 -- 172.21.15.37:0/2736284301 shutdown_connections 2024-05-30T06:53:12.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.379+0000 7f1f21200640 1 -- 172.21.15.37:0/2736284301 wait complete. 2024-05-30T06:53:12.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f21200640 1 Processor -- start 2024-05-30T06:53:12.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f21200640 1 -- start start 2024-05-30T06:53:12.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f21200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f1c0b59d0 0x7f1f1c14d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:12.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f21200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f1c0ced10 0x7f1f1c14c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:12.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f21200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c15d4e0 0x7f1f1c1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:12.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f21200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c15ead0 con 0x7f1f1c0ced10 2024-05-30T06:53:12.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f21200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c15e950 con 0x7f1f1c15d4e0 2024-05-30T06:53:12.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f21200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1c169450 con 0x7f1f1c0b59d0 2024-05-30T06:53:12.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f19e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f1c0b59d0 0x7f1f1c14d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:12.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f19e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f1c0b59d0 0x7f1f1c14d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:51096/0 (socket says 172.21.15.37:51096) 2024-05-30T06:53:12.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f19e00640 1 -- 172.21.15.37:0/3403931296 learned_addr learned my addr 172.21.15.37:0/3403931296 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:12.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f1a800640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c15d4e0 0x7f1f1c1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:12.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f19400640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f1c0ced10 0x7f1f1c14c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:12.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f19400640 1 -- 172.21.15.37:0/3403931296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f1c0b59d0 msgr2=0x7f1f1c14d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:12.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f19400640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f1c0b59d0 0x7f1f1c14d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:12.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f19400640 1 -- 172.21.15.37:0/3403931296 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c15d4e0 msgr2=0x7f1f1c1517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:12.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f19400640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c15d4e0 0x7f1f1c1517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:12.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f19400640 1 -- 172.21.15.37:0/3403931296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c14db10 con 0x7f1f1c0ced10 2024-05-30T06:53:12.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.383+0000 7f1f19400640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f1c0ced10 0x7f1f1c14c330 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f1f08001ec0 tx=0x7f1f0800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:12.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.387+0000 7f1f12000640 1 -- 172.21.15.37:0/3403931296 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f08017070 con 0x7f1f1c0ced10 2024-05-30T06:53:12.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.387+0000 7f1f12000640 1 -- 172.21.15.37:0/3403931296 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f08005cf0 con 0x7f1f1c0ced10 2024-05-30T06:53:12.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.387+0000 7f1f12000640 1 -- 172.21.15.37:0/3403931296 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f080072d0 con 0x7f1f1c0ced10 2024-05-30T06:53:12.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.387+0000 7f1f21200640 1 -- 172.21.15.37:0/3403931296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c14ddf0 con 0x7f1f1c0ced10 2024-05-30T06:53:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.387+0000 7f1f21200640 1 -- 172.21.15.37:0/3403931296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c14e3b0 con 0x7f1f1c0ced10 2024-05-30T06:53:12.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.387+0000 7f1f21200640 1 -- 172.21.15.37:0/3403931296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f1c14e8a0 con 0x7f1f1c0ced10 2024-05-30T06:53:12.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.391+0000 7f1f12000640 1 -- 172.21.15.37:0/3403931296 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 32) ==== 89670+0+0 (secure 0 0 0) 0x7f1f0801a070 con 0x7f1f1c0ced10 2024-05-30T06:53:12.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.391+0000 7f1f12000640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1efc069660 0x7f1efc06bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:12.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.391+0000 7f1f12000640 1 -- 172.21.15.37:0/3403931296 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f1f080854c0 con 0x7f1f1c0ced10 2024-05-30T06:53:12.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.391+0000 7f1f19e00640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1efc069660 0x7f1efc06bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:12.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.395+0000 7f1f19e00640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1efc069660 0x7f1efc06bb20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009bb0 tx=0x7f1f0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:12.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.395+0000 7f1f12000640 1 -- 172.21.15.37:0/3403931296 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f08056b00 con 0x7f1f1c0ced10 2024-05-30T06:53:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:12.759+0000 7f1f21200640 1 -- 172.21.15.37:0/3403931296 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1f1c068d40 con 0x7f1efc069660 2024-05-30T06:53:15.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.283+0000 7f1f12000640 1 -- 172.21.15.37:0/3403931296 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f1f1c068d40 con 0x7f1efc069660 2024-05-30T06:53:15.283 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:15.283 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:53:15.283 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:15.283 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ss1" 2024-05-30T06:53:15.283 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:15.283 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:53:15.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.287+0000 7f1f21200640 1 -- 172.21.15.37:0/3403931296 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1efc069660 msgr2=0x7f1efc06bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.287+0000 7f1f21200640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1efc069660 0x7f1efc06bb20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009bb0 tx=0x7f1f0c008040 comp rx=0 tx=0).stop 2024-05-30T06:53:15.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.287+0000 7f1f21200640 1 -- 172.21.15.37:0/3403931296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f1c0ced10 msgr2=0x7f1f1c14c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.287+0000 7f1f21200640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f1c0ced10 0x7f1f1c14c330 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f1f08001ec0 tx=0x7f1f0800c820 comp rx=0 tx=0).stop 2024-05-30T06:53:15.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.287+0000 7f1f21200640 1 -- 172.21.15.37:0/3403931296 shutdown_connections 2024-05-30T06:53:15.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.287+0000 7f1f21200640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1efc069660 0x7f1efc06bb20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.287+0000 7f1f21200640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f1c15d4e0 0x7f1f1c1517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.287+0000 7f1f21200640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f1c0ced10 0x7f1f1c14c330 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.287+0000 7f1f21200640 1 --2- 172.21.15.37:0/3403931296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f1c0b59d0 0x7f1f1c14d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.287+0000 7f1f21200640 1 -- 172.21.15.37:0/3403931296 >> 172.21.15.37:0/3403931296 conn(0x7f1f1c06bf60 msgr2=0x7f1f1c15c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:15.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.287+0000 7f1f21200640 1 -- 172.21.15.37:0/3403931296 shutdown_connections 2024-05-30T06:53:15.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.287+0000 7f1f21200640 1 -- 172.21.15.37:0/3403931296 wait complete. 2024-05-30T06:53:15.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T06:53:15.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.455+0000 7fb87cc00640 1 Processor -- start 2024-05-30T06:53:15.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.455+0000 7fb87cc00640 1 -- start start 2024-05-30T06:53:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb87cc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb87806f770 0x7fb878166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb87cc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb87815f310 con 0x7fb8780cd440 2024-05-30T06:53:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb87cc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb87815f5f0 con 0x7fb878155da0 2024-05-30T06:53:15.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb87cc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb8780b4760 con 0x7fb87806f770 2024-05-30T06:53:15.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb86d400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb8780cd440 0x7fb87806f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33582/0 (socket says 172.21.15.37:33582) 2024-05-30T06:53:15.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb86d400640 1 -- 172.21.15.37:0/4121165158 learned_addr learned my addr 172.21.15.37:0/4121165158 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:15.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb876800640 1 --2- 172.21.15.37:0/4121165158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb87806f770 0x7fb878166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642334478 0 0) 0x7fb87815f310 con 0x7fb8780cd440 2024-05-30T06:53:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb85c003530 con 0x7fb8780cd440 2024-05-30T06:53:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2363040475 0 0) 0x7fb85c003530 con 0x7fb8780cd440 2024-05-30T06:53:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb87806f770 msgr2=0x7fb878166570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 --2- 172.21.15.37:0/4121165158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb87806f770 0x7fb878166570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 >> v1:172.21.15.105:6789/0 conn(0x7fb878155da0 legacy=0x7fb8780cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87815f8d0 con 0x7fb8780cd440 2024-05-30T06:53:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fb860001680 con 0x7fb8780cd440 2024-05-30T06:53:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 >> v1:172.21.15.37:6789/0 conn(0x7fb8780cd440 legacy=0x7fb87806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 --2- 172.21.15.37:0/4121165158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c0039f0 0x7fb85c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 --2- 172.21.15.37:0/4121165158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb87806f770 0x7fb85c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 --2- 172.21.15.37:0/4121165158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c004d50 0x7fb85c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c00bb60 con 0x7fb85c0039f0 2024-05-30T06:53:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c00bce0 con 0x7fb85c004d50 2024-05-30T06:53:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb85c00bee0 con 0x7fb87806f770 2024-05-30T06:53:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875e00640 1 --2- 172.21.15.37:0/4121165158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c0039f0 0x7fb85c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb86d400640 1 --2- 172.21.15.37:0/4121165158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb87806f770 0x7fb85c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb876800640 1 --2- 172.21.15.37:0/4121165158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c004d50 0x7fb85c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875e00640 1 -- 172.21.15.37:0/4121165158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb87806f770 msgr2=0x7fb85c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875e00640 1 --2- 172.21.15.37:0/4121165158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb87806f770 0x7fb85c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875e00640 1 -- 172.21.15.37:0/4121165158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c004d50 msgr2=0x7fb85c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875e00640 1 --2- 172.21.15.37:0/4121165158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c004d50 0x7fb85c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb875e00640 1 -- 172.21.15.37:0/4121165158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c003530 con 0x7fb85c0039f0 2024-05-30T06:53:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.459+0000 7fb876800640 1 --2- 172.21.15.37:0/4121165158 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c004d50 0x7fb85c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:15.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.463+0000 7fb875e00640 1 --2- 172.21.15.37:0/4121165158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c0039f0 0x7fb85c003dd0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fb868001f60 tx=0x7fb86801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf58895c9de51d59 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:15.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.463+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb868001b60 con 0x7fb85c0039f0 2024-05-30T06:53:15.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.463+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8680af070 con 0x7fb85c0039f0 2024-05-30T06:53:15.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.463+0000 7fb875400640 1 -- 172.21.15.37:0/4121165158 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8680aa860 con 0x7fb85c0039f0 2024-05-30T06:53:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.463+0000 7fb87cc00640 1 -- 172.21.15.37:0/4121165158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c0039f0 msgr2=0x7fb85c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.463+0000 7fb87cc00640 1 --2- 172.21.15.37:0/4121165158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb85c0039f0 0x7fb85c003dd0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fb868001f60 tx=0x7fb86801c8a0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.463+0000 7fb876800640 1 -- 172.21.15.37:0/4121165158 reap_dead start 2024-05-30T06:53:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.463+0000 7fb87cc00640 1 -- 172.21.15.37:0/4121165158 shutdown_connections 2024-05-30T06:53:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.463+0000 7fb87cc00640 1 -- 172.21.15.37:0/4121165158 >> 172.21.15.37:0/4121165158 conn(0x7fb87806bf60 msgr2=0x7fb8780b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.463+0000 7fb87cc00640 1 -- 172.21.15.37:0/4121165158 shutdown_connections 2024-05-30T06:53:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.463+0000 7fb87cc00640 1 -- 172.21.15.37:0/4121165158 wait complete. 2024-05-30T06:53:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.463+0000 7fb87cc00640 1 Processor -- start 2024-05-30T06:53:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb87cc00640 1 -- start start 2024-05-30T06:53:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb87cc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c0039f0 0x7fb87814d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb87cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb87814d9c0 0x7fb87814cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb87cc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb87815a500 0x7fb87815a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb87cc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb87806eaf0 con 0x7fb87814d9c0 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb87cc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb87806e970 con 0x7fb85c0039f0 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb87cc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb87806ec70 con 0x7fb87815a500 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb86d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb87814d9c0 0x7fb87814cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb86d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb87814d9c0 0x7fb87814cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40472/0 (socket says 172.21.15.37:40472) 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb86d400640 1 -- 172.21.15.37:0/3785410336 learned_addr learned my addr 172.21.15.37:0/3785410336 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb876800640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb87815a500 0x7fb87815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb875e00640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c0039f0 0x7fb87814d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb86d400640 1 -- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb87815a500 msgr2=0x7fb87815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb86d400640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb87815a500 0x7fb87815a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb86d400640 1 -- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c0039f0 msgr2=0x7fb87814d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb86d400640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c0039f0 0x7fb87814d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb86d400640 1 -- 172.21.15.37:0/3785410336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb878157250 con 0x7fb87814d9c0 2024-05-30T06:53:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb875e00640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c0039f0 0x7fb87814d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:15.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb86d400640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb87814d9c0 0x7fb87814cc60 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fb8600072c0 tx=0x7fb860007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:15.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb86ea00640 1 -- 172.21.15.37:0/3785410336 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86000f960 con 0x7fb87814d9c0 2024-05-30T06:53:15.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb86ea00640 1 -- 172.21.15.37:0/3785410336 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb860018070 con 0x7fb87814d9c0 2024-05-30T06:53:15.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb86ea00640 1 -- 172.21.15.37:0/3785410336 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86000fd60 con 0x7fb87814d9c0 2024-05-30T06:53:15.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb87cc00640 1 -- 172.21.15.37:0/3785410336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb878157530 con 0x7fb87814d9c0 2024-05-30T06:53:15.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb87cc00640 1 -- 172.21.15.37:0/3785410336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb878157fc0 con 0x7fb87814d9c0 2024-05-30T06:53:15.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.467+0000 7fb87cc00640 1 -- 172.21.15.37:0/3785410336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb878068bc0 con 0x7fb87814d9c0 2024-05-30T06:53:15.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.471+0000 7fb86ea00640 1 -- 172.21.15.37:0/3785410336 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 32) ==== 89670+0+0 (secure 0 0 0) 0x7fb86001c410 con 0x7fb87814d9c0 2024-05-30T06:53:15.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.471+0000 7fb86ea00640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb854069640 0x7fb85406bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.471+0000 7fb86ea00640 1 -- 172.21.15.37:0/3785410336 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fb8600851f0 con 0x7fb87814d9c0 2024-05-30T06:53:15.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.471+0000 7fb875e00640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb854069640 0x7fb85406bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.471+0000 7fb875e00640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb854069640 0x7fb85406bb00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb868001f60 tx=0x7fb8680a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:15.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.475+0000 7fb86ea00640 1 -- 172.21.15.37:0/3785410336 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb860057200 con 0x7fb87814d9c0 2024-05-30T06:53:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.671+0000 7fb87cc00640 1 -- 172.21.15.37:0/3785410336 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8780b2810 con 0x7fb854069640 2024-05-30T06:53:15.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.695+0000 7fb86ea00640 1 -- 172.21.15.37:0/3785410336 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb8780b2810 con 0x7fb854069640 2024-05-30T06:53:15.696 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:15.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.699+0000 7fb87cc00640 1 -- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb854069640 msgr2=0x7fb85406bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.699+0000 7fb87cc00640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb854069640 0x7fb85406bb00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb868001f60 tx=0x7fb8680a7000 comp rx=0 tx=0).stop 2024-05-30T06:53:15.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.699+0000 7fb87cc00640 1 -- 172.21.15.37:0/3785410336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb87814d9c0 msgr2=0x7fb87814cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.699+0000 7fb87cc00640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb87814d9c0 0x7fb87814cc60 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fb8600072c0 tx=0x7fb860007780 comp rx=0 tx=0).stop 2024-05-30T06:53:15.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.699+0000 7fb87cc00640 1 -- 172.21.15.37:0/3785410336 shutdown_connections 2024-05-30T06:53:15.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.699+0000 7fb87cc00640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb87815a500 0x7fb87815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.699+0000 7fb87cc00640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb87814d9c0 0x7fb87814cc60 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.699+0000 7fb87cc00640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb854069640 0x7fb85406bb00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.699+0000 7fb87cc00640 1 --2- 172.21.15.37:0/3785410336 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c0039f0 0x7fb87814d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.699+0000 7fb87cc00640 1 -- 172.21.15.37:0/3785410336 >> 172.21.15.37:0/3785410336 conn(0x7fb87806bf60 msgr2=0x7fb878152e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:15.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.699+0000 7fb87cc00640 1 -- 172.21.15.37:0/3785410336 shutdown_connections 2024-05-30T06:53:15.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.699+0000 7fb87cc00640 1 -- 172.21.15.37:0/3785410336 wait complete. 2024-05-30T06:53:15.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T06:53:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.863+0000 7fd319600640 1 Processor -- start 2024-05-30T06:53:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.863+0000 7fd319600640 1 -- start start 2024-05-30T06:53:15.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd319600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd31415d350 0x7fd31406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd319600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd314142030 con 0x7fd3140b59d0 2024-05-30T06:53:15.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd319600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd314142310 con 0x7fd31415d7e0 2024-05-30T06:53:15.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd319600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd3141425f0 con 0x7fd31415d350 2024-05-30T06:53:15.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd3140b59d0 0x7fd3140b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33584/0 (socket says 172.21.15.37:33584) 2024-05-30T06:53:15.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312a00640 1 -- 172.21.15.37:0/2968062680 learned_addr learned my addr 172.21.15.37:0/2968062680 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd30be00640 1 --2- 172.21.15.37:0/2968062680 >> v2:172.21.15.105:3300/0 conn(0x7fd31415d350 0x7fd31406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899285317 0 0) 0x7fd314142030 con 0x7fd3140b59d0 2024-05-30T06:53:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2f8003530 con 0x7fd3140b59d0 2024-05-30T06:53:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3024555896 0 0) 0x7fd314142310 con 0x7fd31415d7e0 2024-05-30T06:53:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd314142030 con 0x7fd31415d7e0 2024-05-30T06:53:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3150623663 0 0) 0x7fd2f8003530 con 0x7fd3140b59d0 2024-05-30T06:53:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 >> v2:172.21.15.105:3300/0 conn(0x7fd31415d350 msgr2=0x7fd31406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 --2- 172.21.15.37:0/2968062680 >> v2:172.21.15.105:3300/0 conn(0x7fd31415d350 0x7fd31406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 >> v1:172.21.15.105:6789/0 conn(0x7fd31415d7e0 legacy=0x7fd31406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3141428d0 con 0x7fd3140b59d0 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fd304001600 con 0x7fd3140b59d0 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 >> v1:172.21.15.37:6789/0 conn(0x7fd3140b59d0 legacy=0x7fd3140b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 --2- 172.21.15.37:0/2968062680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2f8003bd0 0x7fd2f8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 --2- 172.21.15.37:0/2968062680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f8004810 0x7fd2f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 --2- 172.21.15.37:0/2968062680 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2f80051d0 0x7fd2f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3141425f0 con 0x7fd2f8004810 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f800c0d0 con 0x7fd2f8003bd0 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f800c2d0 con 0x7fd2f80051d0 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd30be00640 1 --2- 172.21.15.37:0/2968062680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f8004810 0x7fd2f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd312a00640 1 --2- 172.21.15.37:0/2968062680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2f8003bd0 0x7fd2f8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd313400640 1 --2- 172.21.15.37:0/2968062680 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2f80051d0 0x7fd2f800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd30be00640 1 -- 172.21.15.37:0/2968062680 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2f80051d0 msgr2=0x7fd2f800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd30be00640 1 --2- 172.21.15.37:0/2968062680 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2f80051d0 0x7fd2f800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd30be00640 1 -- 172.21.15.37:0/2968062680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2f8003bd0 msgr2=0x7fd2f8003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd30be00640 1 --2- 172.21.15.37:0/2968062680 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2f8003bd0 0x7fd2f8003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd30be00640 1 -- 172.21.15.37:0/2968062680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f8003530 con 0x7fd2f8004810 2024-05-30T06:53:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.867+0000 7fd313400640 1 -- 172.21.15.37:0/2968062680 reap_dead start 2024-05-30T06:53:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.871+0000 7fd30be00640 1 --2- 172.21.15.37:0/2968062680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f8004810 0x7fd2f8004c90 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009ae0 tx=0x7fd2fc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e080caafccf61da6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.871+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc0b2070 con 0x7fd2f8004810 2024-05-30T06:53:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.871+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2fc0a5550 con 0x7fd2f8004810 2024-05-30T06:53:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.871+0000 7fd312000640 1 -- 172.21.15.37:0/2968062680 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc0096b0 con 0x7fd2f8004810 2024-05-30T06:53:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.871+0000 7fd319600640 1 -- 172.21.15.37:0/2968062680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f8004810 msgr2=0x7fd2f8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.871+0000 7fd319600640 1 --2- 172.21.15.37:0/2968062680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f8004810 0x7fd2f8004c90 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009ae0 tx=0x7fd2fc01ca70 comp rx=0 tx=0).stop 2024-05-30T06:53:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.871+0000 7fd319600640 1 -- 172.21.15.37:0/2968062680 shutdown_connections 2024-05-30T06:53:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.871+0000 7fd319600640 1 --2- 172.21.15.37:0/2968062680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2f8004810 0x7fd2f8004c90 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.871+0000 7fd319600640 1 -- 172.21.15.37:0/2968062680 >> 172.21.15.37:0/2968062680 conn(0x7fd31406bf60 msgr2=0x7fd3140b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.871+0000 7fd319600640 1 -- 172.21.15.37:0/2968062680 shutdown_connections 2024-05-30T06:53:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.871+0000 7fd319600640 1 -- 172.21.15.37:0/2968062680 wait complete. 2024-05-30T06:53:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd319600640 1 Processor -- start 2024-05-30T06:53:15.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd319600640 1 -- start start 2024-05-30T06:53:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd319600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2f8004810 0x7fd31415ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd319600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd314156730 0x7fd3140b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd319600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31413d700 0x7fd31413db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd319600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3140b00a0 con 0x7fd31413d700 2024-05-30T06:53:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd319600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd3140aff20 con 0x7fd314156730 2024-05-30T06:53:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd319600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd31413f860 con 0x7fd2f8004810 2024-05-30T06:53:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd313400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31413d700 0x7fd31413db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd312a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2f8004810 0x7fd31415ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd313400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31413d700 0x7fd31413db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40490/0 (socket says 172.21.15.37:40490) 2024-05-30T06:53:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd313400640 1 -- 172.21.15.37:0/129709265 learned_addr learned my addr 172.21.15.37:0/129709265 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd30be00640 1 --2- 172.21.15.37:0/129709265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd314156730 0x7fd3140b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd313400640 1 -- 172.21.15.37:0/129709265 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2f8004810 msgr2=0x7fd31415ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd313400640 1 --2- 172.21.15.37:0/129709265 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2f8004810 0x7fd31415ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd313400640 1 -- 172.21.15.37:0/129709265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd314156730 msgr2=0x7fd3140b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd313400640 1 --2- 172.21.15.37:0/129709265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd314156730 0x7fd3140b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd313400640 1 -- 172.21.15.37:0/129709265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31415fd00 con 0x7fd31413d700 2024-05-30T06:53:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd313400640 1 --2- 172.21.15.37:0/129709265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31413d700 0x7fd31413db80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd31406c700 tx=0x7fd30c012dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd30aa00640 1 -- 172.21.15.37:0/129709265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c010be0 con 0x7fd31413d700 2024-05-30T06:53:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd30aa00640 1 -- 172.21.15.37:0/129709265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30c01b070 con 0x7fd31413d700 2024-05-30T06:53:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd319600640 1 -- 172.21.15.37:0/129709265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31415f0f0 con 0x7fd31413d700 2024-05-30T06:53:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd30aa00640 1 -- 172.21.15.37:0/129709265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30c016480 con 0x7fd31413d700 2024-05-30T06:53:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd319600640 1 -- 172.21.15.37:0/129709265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31415f6b0 con 0x7fd31413d700 2024-05-30T06:53:15.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.875+0000 7fd319600640 1 -- 172.21.15.37:0/129709265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd314068bc0 con 0x7fd31413d700 2024-05-30T06:53:15.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.879+0000 7fd30aa00640 1 -- 172.21.15.37:0/129709265 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 32) ==== 89670+0+0 (secure 0 0 0) 0x7fd30c016620 con 0x7fd31413d700 2024-05-30T06:53:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.879+0000 7fd30aa00640 1 --2- 172.21.15.37:0/129709265 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2f0069640 0x7fd2f006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.879+0000 7fd30aa00640 1 -- 172.21.15.37:0/129709265 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fd30c088ec0 con 0x7fd31413d700 2024-05-30T06:53:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.879+0000 7fd312a00640 1 --2- 172.21.15.37:0/129709265 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2f0069640 0x7fd2f006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:15.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.879+0000 7fd312a00640 1 --2- 172.21.15.37:0/129709265 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2f0069640 0x7fd2f006bb00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd304000c10 tx=0x7fd304001ae0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:15.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:15.883+0000 7fd30aa00640 1 -- 172.21.15.37:0/129709265 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd30c05a500 con 0x7fd31413d700 2024-05-30T06:53:16.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.075+0000 7fd319600640 1 -- 172.21.15.37:0/129709265 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fd31406ec40 con 0x7fd2f0069640 2024-05-30T06:53:16.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.091+0000 7fd30aa00640 1 -- 172.21.15.37:0/129709265 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd31406ec40 con 0x7fd2f0069640 2024-05-30T06:53:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.095+0000 7fd319600640 1 -- 172.21.15.37:0/129709265 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2f0069640 msgr2=0x7fd2f006bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.095+0000 7fd319600640 1 --2- 172.21.15.37:0/129709265 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2f0069640 0x7fd2f006bb00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd304000c10 tx=0x7fd304001ae0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.095+0000 7fd319600640 1 -- 172.21.15.37:0/129709265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31413d700 msgr2=0x7fd31413db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.095+0000 7fd319600640 1 --2- 172.21.15.37:0/129709265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31413d700 0x7fd31413db80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd31406c700 tx=0x7fd30c012dd0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.095+0000 7fd319600640 1 -- 172.21.15.37:0/129709265 shutdown_connections 2024-05-30T06:53:16.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.095+0000 7fd319600640 1 --2- 172.21.15.37:0/129709265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd31413d700 0x7fd31413db80 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.095+0000 7fd319600640 1 --2- 172.21.15.37:0/129709265 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2f0069640 0x7fd2f006bb00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.095+0000 7fd319600640 1 --2- 172.21.15.37:0/129709265 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd314156730 0x7fd3140b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.095+0000 7fd319600640 1 --2- 172.21.15.37:0/129709265 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2f8004810 0x7fd31415ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.095+0000 7fd319600640 1 -- 172.21.15.37:0/129709265 >> 172.21.15.37:0/129709265 conn(0x7fd31406bf60 msgr2=0x7fd314074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:16.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.095+0000 7fd319600640 1 -- 172.21.15.37:0/129709265 shutdown_connections 2024-05-30T06:53:16.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.095+0000 7fd319600640 1 -- 172.21.15.37:0/129709265 wait complete. 2024-05-30T06:53:16.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone371013 2024-05-30T06:53:16.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.271+0000 7f4b03e00640 1 Processor -- start 2024-05-30T06:53:16.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.271+0000 7f4b03e00640 1 -- start start 2024-05-30T06:53:16.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.271+0000 7f4b03e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406ca70 0x7f4b040d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:16.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.271+0000 7f4b03e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4b040cd720 0x7f4b040cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:16.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.271+0000 7f4b03e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b0409bca0 con 0x7f4b0406d130 2024-05-30T06:53:16.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.271+0000 7f4b03e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4b040b1950 con 0x7f4b040cd720 2024-05-30T06:53:16.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.271+0000 7f4b03e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4b040d17f0 con 0x7f4b0406ca70 2024-05-30T06:53:16.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.271+0000 7f4b02a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4b0406d130 0x7f4b0406d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33596/0 (socket says 172.21.15.37:33596) 2024-05-30T06:53:16.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.275+0000 7f4b02a00640 1 -- 172.21.15.37:0/3586860749 learned_addr learned my addr 172.21.15.37:0/3586860749 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:16.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.275+0000 7f4afa000640 1 --2- 172.21.15.37:0/3586860749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406ca70 0x7f4b040d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:16.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.275+0000 7f4b03400640 1 --2- 172.21.15.37:0/3586860749 >> v2:172.21.15.105:3300/0 conn(0x7f4b040cd720 0x7f4b040cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:16.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.275+0000 7f4b02000640 1 -- 172.21.15.37:0/3586860749 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2647783870 0 0) 0x7f4b0409bca0 con 0x7f4b0406d130 2024-05-30T06:53:16.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.275+0000 7f4b02000640 1 -- 172.21.15.37:0/3586860749 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ae8003530 con 0x7f4b0406d130 2024-05-30T06:53:16.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.275+0000 7f4afa000640 1 -- 172.21.15.37:0/3586860749 >> v2:172.21.15.105:3300/0 conn(0x7f4b040cd720 msgr2=0x7f4b040cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:16.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.275+0000 7f4afa000640 1 --2- 172.21.15.37:0/3586860749 >> v2:172.21.15.105:3300/0 conn(0x7f4b040cd720 0x7f4b040cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.275+0000 7f4afa000640 1 -- 172.21.15.37:0/3586860749 >> v1:172.21.15.37:6789/0 conn(0x7f4b0406d130 legacy=0x7f4b0406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.275+0000 7f4afa000640 1 -- 172.21.15.37:0/3586860749 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b040ccc40 con 0x7f4b0406ca70 2024-05-30T06:53:16.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.275+0000 7f4afa000640 1 --2- 172.21.15.37:0/3586860749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406ca70 0x7f4b040d10f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4af40097c0 tx=0x7f4af401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a274ed1acb4a85f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:16.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.275+0000 7f4b02000640 1 -- 172.21.15.37:0/3586860749 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af40b0070 con 0x7f4b0406ca70 2024-05-30T06:53:16.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.275+0000 7f4b02000640 1 -- 172.21.15.37:0/3586860749 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af40ab600 con 0x7f4b0406ca70 2024-05-30T06:53:16.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.275+0000 7f4b02000640 1 -- 172.21.15.37:0/3586860749 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af40ab9d0 con 0x7f4b0406ca70 2024-05-30T06:53:16.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 -- 172.21.15.37:0/3586860749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406ca70 msgr2=0x7f4b040d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 --2- 172.21.15.37:0/3586860749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406ca70 0x7f4b040d10f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4af40097c0 tx=0x7f4af401c410 comp rx=0 tx=0).stop 2024-05-30T06:53:16.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 -- 172.21.15.37:0/3586860749 shutdown_connections 2024-05-30T06:53:16.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 --2- 172.21.15.37:0/3586860749 >> v2:172.21.15.105:3300/0 conn(0x7f4b040cd720 0x7f4b040cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 --2- 172.21.15.37:0/3586860749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406ca70 0x7f4b040d10f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 -- 172.21.15.37:0/3586860749 >> 172.21.15.37:0/3586860749 conn(0x7f4b040b3f40 msgr2=0x7f4b040b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:16.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 -- 172.21.15.37:0/3586860749 shutdown_connections 2024-05-30T06:53:16.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 -- 172.21.15.37:0/3586860749 wait complete. 2024-05-30T06:53:16.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 Processor -- start 2024-05-30T06:53:16.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 -- start start 2024-05-30T06:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406ca70 0x7f4b041564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0406d130 0x7f4b040b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:16.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b040cd720 0x7f4b0415ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:16.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0416b600 con 0x7f4b0406d130 2024-05-30T06:53:16.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0416b480 con 0x7f4b040cd720 2024-05-30T06:53:16.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4b0416b780 con 0x7f4b0406ca70 2024-05-30T06:53:16.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4afa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0406d130 0x7f4b040b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:16.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4afa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0406d130 0x7f4b040b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40504/0 (socket says 172.21.15.37:40504) 2024-05-30T06:53:16.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4afa000640 1 -- 172.21.15.37:0/1920799391 learned_addr learned my addr 172.21.15.37:0/1920799391 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:16.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b02a00640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406ca70 0x7f4b041564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:16.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4b03400640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b040cd720 0x7f4b0415ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:16.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4afa000640 1 -- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406ca70 msgr2=0x7f4b041564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4afa000640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406ca70 0x7f4b041564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4afa000640 1 -- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b040cd720 msgr2=0x7f4b0415ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4afa000640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b040cd720 0x7f4b0415ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.279+0000 7f4afa000640 1 -- 172.21.15.37:0/1920799391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b040b8130 con 0x7f4b0406d130 2024-05-30T06:53:16.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.283+0000 7f4afa000640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0406d130 0x7f4b040b52a0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4af401a040 tx=0x7f4af40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:16.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.283+0000 7f4afbe00640 1 -- 172.21.15.37:0/1920799391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af40b0040 con 0x7f4b0406d130 2024-05-30T06:53:16.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.283+0000 7f4afbe00640 1 -- 172.21.15.37:0/1920799391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af40b9070 con 0x7f4b0406d130 2024-05-30T06:53:16.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.283+0000 7f4b03e00640 1 -- 172.21.15.37:0/1920799391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b040b7090 con 0x7f4b0406d130 2024-05-30T06:53:16.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.283+0000 7f4afbe00640 1 -- 172.21.15.37:0/1920799391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af40b4650 con 0x7f4b0406d130 2024-05-30T06:53:16.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.283+0000 7f4b03e00640 1 -- 172.21.15.37:0/1920799391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b040b7650 con 0x7f4b0406d130 2024-05-30T06:53:16.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.283+0000 7f4b03e00640 1 -- 172.21.15.37:0/1920799391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b04068ab0 con 0x7f4b0406d130 2024-05-30T06:53:16.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.283+0000 7f4afbe00640 1 -- 172.21.15.37:0/1920799391 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 32) ==== 89670+0+0 (secure 0 0 0) 0x7f4af40b47f0 con 0x7f4b0406d130 2024-05-30T06:53:16.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.283+0000 7f4afbe00640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ae0069640 0x7f4ae006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:16.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.287+0000 7f4afbe00640 1 -- 172.21.15.37:0/1920799391 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f4af411f2f0 con 0x7f4b0406d130 2024-05-30T06:53:16.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.287+0000 7f4b02a00640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ae0069640 0x7f4ae006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:16.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.287+0000 7f4b02a00640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ae0069640 0x7f4ae006bb00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4aec007fd0 tx=0x7f4aec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:16.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.291+0000 7f4afbe00640 1 -- 172.21.15.37:0/1920799391 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4af4016090 con 0x7f4b0406d130 2024-05-30T06:53:16.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.479+0000 7f4b03e00640 1 -- 172.21.15.37:0/1920799391 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone371013", "target": ["mon-mgr", ""]}) -- 0x7f4b040d09a0 con 0x7f4ae0069640 2024-05-30T06:53:16.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.503+0000 7f4afbe00640 1 -- 172.21.15.37:0/1920799391 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4b040d09a0 con 0x7f4ae0069640 2024-05-30T06:53:16.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.503+0000 7f4b03e00640 1 -- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ae0069640 msgr2=0x7f4ae006bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.503+0000 7f4b03e00640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ae0069640 0x7f4ae006bb00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4aec007fd0 tx=0x7f4aec009040 comp rx=0 tx=0).stop 2024-05-30T06:53:16.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.503+0000 7f4b03e00640 1 -- 172.21.15.37:0/1920799391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0406d130 msgr2=0x7f4b040b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.503+0000 7f4b03e00640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0406d130 0x7f4b040b52a0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f4af401a040 tx=0x7f4af40191b0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.503+0000 7f4b03e00640 1 -- 172.21.15.37:0/1920799391 shutdown_connections 2024-05-30T06:53:16.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.503+0000 7f4b03e00640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4ae0069640 0x7f4ae006bb00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.503+0000 7f4b03e00640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b040cd720 0x7f4b0415ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.503+0000 7f4b03e00640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b0406d130 0x7f4b040b52a0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.503+0000 7f4b03e00640 1 --2- 172.21.15.37:0/1920799391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b0406ca70 0x7f4b041564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.503+0000 7f4b03e00640 1 -- 172.21.15.37:0/1920799391 >> 172.21.15.37:0/1920799391 conn(0x7f4b040b3f40 msgr2=0x7f4b0415a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:16.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.503+0000 7f4b03e00640 1 -- 172.21.15.37:0/1920799391 shutdown_connections 2024-05-30T06:53:16.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.503+0000 7f4b03e00640 1 -- 172.21.15.37:0/1920799391 wait complete. 2024-05-30T06:53:16.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone371017 2024-05-30T06:53:16.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7fc00640 1 Processor -- start 2024-05-30T06:53:16.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7fc00640 1 -- start start 2024-05-30T06:53:16.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7fc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9a780cd400 0x7f9a7806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:16.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7fc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9a7806f5a0 0x7f9a780b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:16.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7fc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a780ce030 con 0x7f9a781590c0 2024-05-30T06:53:16.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7fc00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9a7815f230 con 0x7f9a7806f5a0 2024-05-30T06:53:16.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7fc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9a7815f510 con 0x7f9a780cd400 2024-05-30T06:53:16.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7dc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9a7806f5a0 0x7f9a780b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:16.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7dc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9a7806f5a0 0x7f9a780b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40518/0 (socket says 172.21.15.37:40518) 2024-05-30T06:53:16.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7dc00640 1 -- 172.21.15.37:0/3108051154 learned_addr learned my addr 172.21.15.37:0/3108051154 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:16.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a6fe00640 1 --2- 172.21.15.37:0/3108051154 >> v2:172.21.15.105:3300/0 conn(0x7f9a780cd400 0x7f9a7806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:16.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7dc00640 1 -- 172.21.15.37:0/3108051154 >> v2:172.21.15.105:3300/0 conn(0x7f9a780cd400 msgr2=0x7f9a7806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:16.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7dc00640 1 --2- 172.21.15.37:0/3108051154 >> v2:172.21.15.105:3300/0 conn(0x7f9a780cd400 0x7f9a7806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7dc00640 1 -- 172.21.15.37:0/3108051154 >> v1:172.21.15.37:6789/0 conn(0x7f9a781590c0 legacy=0x7f9a780cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a7dc00640 1 -- 172.21.15.37:0/3108051154 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7815f7f0 con 0x7f9a7806f5a0 2024-05-30T06:53:16.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a6fe00640 1 --2- 172.21.15.37:0/3108051154 >> v2:172.21.15.105:3300/0 conn(0x7f9a780cd400 0x7f9a7806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:16.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.671+0000 7f9a77e00640 1 -- 172.21.15.37:0/3108051154 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1977121811 0 0) 0x7f9a780ce030 con 0x7f9a781590c0 2024-05-30T06:53:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.675+0000 7f9a7dc00640 1 --2- 172.21.15.37:0/3108051154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a7806f5a0 0x7f9a780b3750 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f9a780b2ea0 tx=0x7f9a7001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9075bf1c0313b88 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:16.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.675+0000 7f9a77e00640 1 -- 172.21.15.37:0/3108051154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a700a5590 con 0x7f9a7806f5a0 2024-05-30T06:53:16.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.675+0000 7f9a77e00640 1 -- 172.21.15.37:0/3108051154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a700a5730 con 0x7f9a7806f5a0 2024-05-30T06:53:16.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.675+0000 7f9a77e00640 1 -- 172.21.15.37:0/3108051154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a700a5b00 con 0x7f9a7806f5a0 2024-05-30T06:53:16.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.675+0000 7f9a7fc00640 1 -- 172.21.15.37:0/3108051154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a7806f5a0 msgr2=0x7f9a780b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.675+0000 7f9a7fc00640 1 --2- 172.21.15.37:0/3108051154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a7806f5a0 0x7f9a780b3750 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f9a780b2ea0 tx=0x7f9a7001c8d0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.675+0000 7f9a7fc00640 1 -- 172.21.15.37:0/3108051154 shutdown_connections 2024-05-30T06:53:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.675+0000 7f9a7fc00640 1 --2- 172.21.15.37:0/3108051154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a7806f5a0 0x7f9a780b3750 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.675+0000 7f9a7fc00640 1 --2- 172.21.15.37:0/3108051154 >> v2:172.21.15.105:3300/0 conn(0x7f9a780cd400 0x7f9a7806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.675+0000 7f9a7fc00640 1 -- 172.21.15.37:0/3108051154 >> 172.21.15.37:0/3108051154 conn(0x7f9a7806bf60 msgr2=0x7f9a780b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.675+0000 7f9a7fc00640 1 -- 172.21.15.37:0/3108051154 shutdown_connections 2024-05-30T06:53:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.675+0000 7f9a7fc00640 1 -- 172.21.15.37:0/3108051154 wait complete. 2024-05-30T06:53:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7fc00640 1 Processor -- start 2024-05-30T06:53:16.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7fc00640 1 -- start start 2024-05-30T06:53:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7fc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a7806f5a0 0x7f9a7815c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7fc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a780cd400 0x7f9a78150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7fc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a781590c0 0x7f9a7814e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7fc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a78168620 con 0x7f9a781590c0 2024-05-30T06:53:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7fc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9a781684a0 con 0x7f9a7806f5a0 2024-05-30T06:53:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7fc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9a781687a0 con 0x7f9a780cd400 2024-05-30T06:53:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a781590c0 0x7f9a7814e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7d200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a7806f5a0 0x7f9a7815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a781590c0 0x7f9a7814e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40526/0 (socket says 172.21.15.37:40526) 2024-05-30T06:53:16.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7dc00640 1 -- 172.21.15.37:0/1132002369 learned_addr learned my addr 172.21.15.37:0/1132002369 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:16.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a6fe00640 1 --2- 172.21.15.37:0/1132002369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a780cd400 0x7f9a78150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:16.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7dc00640 1 -- 172.21.15.37:0/1132002369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a780cd400 msgr2=0x7f9a78150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7dc00640 1 --2- 172.21.15.37:0/1132002369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a780cd400 0x7f9a78150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7dc00640 1 -- 172.21.15.37:0/1132002369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a7806f5a0 msgr2=0x7f9a7815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7dc00640 1 --2- 172.21.15.37:0/1132002369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a7806f5a0 0x7f9a7815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7dc00640 1 -- 172.21.15.37:0/1132002369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a78150a50 con 0x7f9a781590c0 2024-05-30T06:53:16.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7dc00640 1 --2- 172.21.15.37:0/1132002369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a781590c0 0x7f9a7814e6c0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9a700af040 tx=0x7f9a70019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:16.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a75600640 1 -- 172.21.15.37:0/1132002369 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a700bc020 con 0x7f9a781590c0 2024-05-30T06:53:16.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a75600640 1 -- 172.21.15.37:0/1132002369 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a700b8670 con 0x7f9a781590c0 2024-05-30T06:53:16.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a75600640 1 -- 172.21.15.37:0/1132002369 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70009510 con 0x7f9a781590c0 2024-05-30T06:53:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7fc00640 1 -- 172.21.15.37:0/1132002369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7814f470 con 0x7f9a781590c0 2024-05-30T06:53:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7fc00640 1 -- 172.21.15.37:0/1132002369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7814fa30 con 0x7f9a781590c0 2024-05-30T06:53:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.679+0000 7f9a7fc00640 1 -- 172.21.15.37:0/1132002369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a78068d40 con 0x7f9a781590c0 2024-05-30T06:53:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.683+0000 7f9a75600640 1 -- 172.21.15.37:0/1132002369 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 32) ==== 89670+0+0 (secure 0 0 0) 0x7f9a700bf020 con 0x7f9a781590c0 2024-05-30T06:53:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.683+0000 7f9a75600640 1 --2- 172.21.15.37:0/1132002369 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a54069610 0x7f9a5406bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.683+0000 7f9a75600640 1 -- 172.21.15.37:0/1132002369 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f9a701203b0 con 0x7f9a781590c0 2024-05-30T06:53:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.683+0000 7f9a7d200640 1 --2- 172.21.15.37:0/1132002369 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a54069610 0x7f9a5406bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.683+0000 7f9a7d200640 1 --2- 172.21.15.37:0/1132002369 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a54069610 0x7f9a5406bad0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9a68007fd0 tx=0x7f9a68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:16.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.687+0000 7f9a75600640 1 -- 172.21.15.37:0/1132002369 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9a700c6030 con 0x7f9a781590c0 2024-05-30T06:53:16.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.879+0000 7f9a7fc00640 1 -- 172.21.15.37:0/1132002369 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone371017", "target": ["mon-mgr", ""]}) -- 0x7f9a780b31b0 con 0x7f9a54069610 2024-05-30T06:53:16.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.899+0000 7f9a75600640 1 -- 172.21.15.37:0/1132002369 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9a780b31b0 con 0x7f9a54069610 2024-05-30T06:53:16.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.899+0000 7f9a7fc00640 1 -- 172.21.15.37:0/1132002369 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a54069610 msgr2=0x7f9a5406bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.899+0000 7f9a7fc00640 1 --2- 172.21.15.37:0/1132002369 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a54069610 0x7f9a5406bad0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f9a68007fd0 tx=0x7f9a68009040 comp rx=0 tx=0).stop 2024-05-30T06:53:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.899+0000 7f9a7fc00640 1 -- 172.21.15.37:0/1132002369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a781590c0 msgr2=0x7f9a7814e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.899+0000 7f9a7fc00640 1 --2- 172.21.15.37:0/1132002369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a781590c0 0x7f9a7814e6c0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9a700af040 tx=0x7f9a70019670 comp rx=0 tx=0).stop 2024-05-30T06:53:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.899+0000 7f9a7fc00640 1 -- 172.21.15.37:0/1132002369 shutdown_connections 2024-05-30T06:53:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.899+0000 7f9a7fc00640 1 --2- 172.21.15.37:0/1132002369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a781590c0 0x7f9a7814e6c0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.899+0000 7f9a7fc00640 1 --2- 172.21.15.37:0/1132002369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a780cd400 0x7f9a78150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.899+0000 7f9a7fc00640 1 --2- 172.21.15.37:0/1132002369 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9a54069610 0x7f9a5406bad0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.899+0000 7f9a7fc00640 1 --2- 172.21.15.37:0/1132002369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a7806f5a0 0x7f9a7815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.899+0000 7f9a7fc00640 1 -- 172.21.15.37:0/1132002369 >> 172.21.15.37:0/1132002369 conn(0x7f9a7806bf60 msgr2=0x7f9a780b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.899+0000 7f9a7fc00640 1 -- 172.21.15.37:0/1132002369 shutdown_connections 2024-05-30T06:53:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:16.899+0000 7f9a7fc00640 1 -- 172.21.15.37:0/1132002369 wait complete. 2024-05-30T06:53:16.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone37106 2024-05-30T06:53:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.067+0000 7f78f4c00640 1 Processor -- start 2024-05-30T06:53:17.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.067+0000 7f78f4c00640 1 -- start start 2024-05-30T06:53:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78f4c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78f01590c0 0x7f78f00cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78f4c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78f00cde60 0x7f78f006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78f4c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f78f00cd400 0x7f78f006f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78f4c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f78f015f230 con 0x7f78f00cde60 2024-05-30T06:53:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78f4c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f78f015f510 con 0x7f78f00cd400 2024-05-30T06:53:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78f4c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f78f015f7f0 con 0x7f78f01590c0 2024-05-30T06:53:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78e5400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78f00cde60 0x7f78f006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:17.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78e5400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78f00cde60 0x7f78f006f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40538/0 (socket says 172.21.15.37:40538) 2024-05-30T06:53:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78e5400640 1 -- 172.21.15.37:0/859870150 learned_addr learned my addr 172.21.15.37:0/859870150 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78ede00640 1 --2- 172.21.15.37:0/859870150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78f01590c0 0x7f78f00cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:17.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78ee800640 1 --2- 172.21.15.37:0/859870150 >> v2:172.21.15.105:3300/0 conn(0x7f78f00cd400 0x7f78f006f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78e5400640 1 -- 172.21.15.37:0/859870150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78f01590c0 msgr2=0x7f78f00cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78e5400640 1 --2- 172.21.15.37:0/859870150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78f01590c0 0x7f78f00cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78e5400640 1 -- 172.21.15.37:0/859870150 >> v2:172.21.15.105:3300/0 conn(0x7f78f00cd400 msgr2=0x7f78f006f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78e5400640 1 --2- 172.21.15.37:0/859870150 >> v2:172.21.15.105:3300/0 conn(0x7f78f00cd400 0x7f78f006f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78e5400640 1 -- 172.21.15.37:0/859870150 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f015fad0 con 0x7f78f00cde60 2024-05-30T06:53:17.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78ee800640 1 --2- 172.21.15.37:0/859870150 >> v2:172.21.15.105:3300/0 conn(0x7f78f00cd400 0x7f78f006f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:17.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.071+0000 7f78e5400640 1 --2- 172.21.15.37:0/859870150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78f00cde60 0x7f78f006f060 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f78f015fdb0 tx=0x7f78d801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e849b1fbdb64e59a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78ed400640 1 -- 172.21.15.37:0/859870150 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d80b0070 con 0x7f78f00cde60 2024-05-30T06:53:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78ed400640 1 -- 172.21.15.37:0/859870150 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d80ab600 con 0x7f78f00cde60 2024-05-30T06:53:17.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78ed400640 1 -- 172.21.15.37:0/859870150 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d80ab9d0 con 0x7f78f00cde60 2024-05-30T06:53:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 -- 172.21.15.37:0/859870150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78f00cde60 msgr2=0x7f78f006f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 --2- 172.21.15.37:0/859870150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78f00cde60 0x7f78f006f060 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f78f015fdb0 tx=0x7f78d801c400 comp rx=0 tx=0).stop 2024-05-30T06:53:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 -- 172.21.15.37:0/859870150 shutdown_connections 2024-05-30T06:53:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 --2- 172.21.15.37:0/859870150 >> v2:172.21.15.105:3300/0 conn(0x7f78f00cd400 0x7f78f006f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 --2- 172.21.15.37:0/859870150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78f00cde60 0x7f78f006f060 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 --2- 172.21.15.37:0/859870150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78f01590c0 0x7f78f00cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 -- 172.21.15.37:0/859870150 >> 172.21.15.37:0/859870150 conn(0x7f78f006bf60 msgr2=0x7f78f00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 -- 172.21.15.37:0/859870150 shutdown_connections 2024-05-30T06:53:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 -- 172.21.15.37:0/859870150 wait complete. 2024-05-30T06:53:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 Processor -- start 2024-05-30T06:53:17.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 -- start start 2024-05-30T06:53:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78f00cd400 0x7f78f014b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78f00cde60 0x7f78f014cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f01590c0 0x7f78f0137ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f78f00d0080 con 0x7f78f00cd400 2024-05-30T06:53:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f78f00cff00 con 0x7f78f01590c0 2024-05-30T06:53:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78f4c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f78f00d0200 con 0x7f78f00cde60 2024-05-30T06:53:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78ede00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78f00cd400 0x7f78f014b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78ede00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78f00cd400 0x7f78f014b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40544/0 (socket says 172.21.15.37:40544) 2024-05-30T06:53:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78ede00640 1 -- 172.21.15.37:0/1329972925 learned_addr learned my addr 172.21.15.37:0/1329972925 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78e5400640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78f00cde60 0x7f78f014cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.075+0000 7f78ee800640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f01590c0 0x7f78f0137ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78ede00640 1 -- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78f00cde60 msgr2=0x7f78f014cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78ede00640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78f00cde60 0x7f78f014cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78ede00640 1 -- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f01590c0 msgr2=0x7f78f0137ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78ede00640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f01590c0 0x7f78f0137ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78ede00640 1 -- 172.21.15.37:0/1329972925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f0138430 con 0x7f78f00cd400 2024-05-30T06:53:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78ede00640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78f00cd400 0x7f78f014b5f0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f78e0007e70 tx=0x7f78e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78e6a00640 1 -- 172.21.15.37:0/1329972925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0014420 con 0x7f78f00cd400 2024-05-30T06:53:17.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78e6a00640 1 -- 172.21.15.37:0/1329972925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e0019070 con 0x7f78f00cd400 2024-05-30T06:53:17.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78e6a00640 1 -- 172.21.15.37:0/1329972925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0014800 con 0x7f78f00cd400 2024-05-30T06:53:17.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78f4c00640 1 -- 172.21.15.37:0/1329972925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f014bbd0 con 0x7f78f00cd400 2024-05-30T06:53:17.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78f4c00640 1 -- 172.21.15.37:0/1329972925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f014c190 con 0x7f78f00cd400 2024-05-30T06:53:17.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78f4c00640 1 -- 172.21.15.37:0/1329972925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f0068d40 con 0x7f78f00cd400 2024-05-30T06:53:17.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78e6a00640 1 -- 172.21.15.37:0/1329972925 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 32) ==== 89670+0+0 (secure 0 0 0) 0x7f78e00149a0 con 0x7f78f00cd400 2024-05-30T06:53:17.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78e6a00640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f78cc069610 0x7f78cc06bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:17.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78e6a00640 1 -- 172.21.15.37:0/1329972925 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7f78e0086090 con 0x7f78f00cd400 2024-05-30T06:53:17.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.079+0000 7f78e5400640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f78cc069610 0x7f78cc06bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:17.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.083+0000 7f78e5400640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f78cc069610 0x7f78cc06bad0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f78d80ad000 tx=0x7f78d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:17.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.083+0000 7f78e6a00640 1 -- 172.21.15.37:0/1329972925 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f78e0057d20 con 0x7f78f00cd400 2024-05-30T06:53:17.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.275+0000 7f78f4c00640 1 -- 172.21.15.37:0/1329972925 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone37106", "target": ["mon-mgr", ""]}) -- 0x7f78f006eb70 con 0x7f78cc069610 2024-05-30T06:53:17.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.303+0000 7f78e6a00640 1 -- 172.21.15.37:0/1329972925 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f78f006eb70 con 0x7f78cc069610 2024-05-30T06:53:17.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.307+0000 7f78f4c00640 1 -- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f78cc069610 msgr2=0x7f78cc06bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:17.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.307+0000 7f78f4c00640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f78cc069610 0x7f78cc06bad0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f78d80ad000 tx=0x7f78d8008040 comp rx=0 tx=0).stop 2024-05-30T06:53:17.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.307+0000 7f78f4c00640 1 -- 172.21.15.37:0/1329972925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78f00cd400 msgr2=0x7f78f014b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:17.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.307+0000 7f78f4c00640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78f00cd400 0x7f78f014b5f0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f78e0007e70 tx=0x7f78e000e4b0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.307+0000 7f78f4c00640 1 -- 172.21.15.37:0/1329972925 shutdown_connections 2024-05-30T06:53:17.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.307+0000 7f78f4c00640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f78cc069610 0x7f78cc06bad0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.307+0000 7f78f4c00640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78f01590c0 0x7f78f0137ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.307+0000 7f78f4c00640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78f00cde60 0x7f78f014cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.307+0000 7f78f4c00640 1 --2- 172.21.15.37:0/1329972925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78f00cd400 0x7f78f014b5f0 secure :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f78e0007e70 tx=0x7f78e000e4b0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.307+0000 7f78f4c00640 1 -- 172.21.15.37:0/1329972925 >> 172.21.15.37:0/1329972925 conn(0x7f78f006bf60 msgr2=0x7f78f00b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:17.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.311+0000 7f78f4c00640 1 -- 172.21.15.37:0/1329972925 shutdown_connections 2024-05-30T06:53:17.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.311+0000 7f78f4c00640 1 -- 172.21.15.37:0/1329972925 wait complete. 2024-05-30T06:53:17.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone371015 2024-05-30T06:53:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.583+0000 7fe549c00640 1 Processor -- start 2024-05-30T06:53:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.583+0000 7fe549c00640 1 -- start start 2024-05-30T06:53:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.583+0000 7fe549c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe54415e9a0 0x7fe54406c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.583+0000 7fe549c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe5440c78a0 0x7fe5440b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.583+0000 7fe549c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5440c81d0 con 0x7fe5440c7d30 2024-05-30T06:53:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.583+0000 7fe549c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe54415ed80 con 0x7fe54415e9a0 2024-05-30T06:53:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.583+0000 7fe549c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe5440cbb30 con 0x7fe5440c78a0 2024-05-30T06:53:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.587+0000 7fe549200640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fe5440c7d30 0x7fe5440cdd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:48988/0 (socket says 172.21.15.37:48988) 2024-05-30T06:53:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.587+0000 7fe549200640 1 -- 172.21.15.37:0/1701747688 learned_addr learned my addr 172.21.15.37:0/1701747688 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.587+0000 7fe543e00640 1 --2- 172.21.15.37:0/1701747688 >> v2:172.21.15.37:3300/0 conn(0x7fe54415e9a0 0x7fe54406c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.587+0000 7fe543400640 1 --2- 172.21.15.37:0/1701747688 >> v2:172.21.15.105:3300/0 conn(0x7fe5440c78a0 0x7fe5440b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.587+0000 7fe542a00640 1 -- 172.21.15.37:0/1701747688 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4130786567 0 0) 0x7fe5440c81d0 con 0x7fe5440c7d30 2024-05-30T06:53:17.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.587+0000 7fe543400640 1 -- 172.21.15.37:0/1701747688 >> v2:172.21.15.37:3300/0 conn(0x7fe54415e9a0 msgr2=0x7fe54406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:17.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.587+0000 7fe543400640 1 --2- 172.21.15.37:0/1701747688 >> v2:172.21.15.37:3300/0 conn(0x7fe54415e9a0 0x7fe54406c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.587+0000 7fe543400640 1 -- 172.21.15.37:0/1701747688 >> v1:172.21.15.105:6789/0 conn(0x7fe5440c7d30 legacy=0x7fe5440cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:17.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.587+0000 7fe543400640 1 -- 172.21.15.37:0/1701747688 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5440cbe10 con 0x7fe5440c78a0 2024-05-30T06:53:17.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.587+0000 7fe543e00640 1 --2- 172.21.15.37:0/1701747688 >> v2:172.21.15.37:3300/0 conn(0x7fe54415e9a0 0x7fe54406c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.591+0000 7fe543400640 1 --2- 172.21.15.37:0/1701747688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5440c78a0 0x7fe5440b2430 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe544162400 tx=0x7fe53401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c22d0a3d2d48982 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:17.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.591+0000 7fe542a00640 1 -- 172.21.15.37:0/1701747688 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5340b0070 con 0x7fe5440c78a0 2024-05-30T06:53:17.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.591+0000 7fe542a00640 1 -- 172.21.15.37:0/1701747688 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5340ab600 con 0x7fe5440c78a0 2024-05-30T06:53:17.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.591+0000 7fe542a00640 1 -- 172.21.15.37:0/1701747688 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5340ab9d0 con 0x7fe5440c78a0 2024-05-30T06:53:17.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.591+0000 7fe549c00640 1 -- 172.21.15.37:0/1701747688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5440c78a0 msgr2=0x7fe5440b2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:17.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.591+0000 7fe549c00640 1 --2- 172.21.15.37:0/1701747688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5440c78a0 0x7fe5440b2430 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe544162400 tx=0x7fe53401c3f0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.595+0000 7fe549c00640 1 -- 172.21.15.37:0/1701747688 shutdown_connections 2024-05-30T06:53:17.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.595+0000 7fe549c00640 1 --2- 172.21.15.37:0/1701747688 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5440c78a0 0x7fe5440b2430 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.595+0000 7fe549c00640 1 --2- 172.21.15.37:0/1701747688 >> v2:172.21.15.37:3300/0 conn(0x7fe54415e9a0 0x7fe54406c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.595+0000 7fe549c00640 1 -- 172.21.15.37:0/1701747688 >> 172.21.15.37:0/1701747688 conn(0x7fe54409aa60 msgr2=0x7fe5440b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:17.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.595+0000 7fe549c00640 1 -- 172.21.15.37:0/1701747688 shutdown_connections 2024-05-30T06:53:17.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.595+0000 7fe549c00640 1 -- 172.21.15.37:0/1701747688 wait complete. 2024-05-30T06:53:17.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.599+0000 7fe549c00640 1 Processor -- start 2024-05-30T06:53:17.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.599+0000 7fe549c00640 1 -- start start 2024-05-30T06:53:17.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.599+0000 7fe549c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5440c78a0 0x7fe5440c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:17.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.599+0000 7fe549c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5440c7d30 0x7fe544157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:17.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.599+0000 7fe549c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe54415e9a0 0x7fe5441552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:17.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.599+0000 7fe549c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe54416b510 con 0x7fe5440c7d30 2024-05-30T06:53:17.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.599+0000 7fe543e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5440c78a0 0x7fe5440c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:17.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.599+0000 7fe543e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5440c78a0 0x7fe5440c90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:39424/0 (socket says 172.21.15.37:39424) 2024-05-30T06:53:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.599+0000 7fe543e00640 1 -- 172.21.15.37:0/1137822013 learned_addr learned my addr 172.21.15.37:0/1137822013 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.599+0000 7fe543400640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5440c7d30 0x7fe544157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.599+0000 7fe549200640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe54415e9a0 0x7fe5441552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.599+0000 7fe549c00640 1 -- 172.21.15.37:0/1137822013 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe54416b690 con 0x7fe5440c78a0 2024-05-30T06:53:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.599+0000 7fe549c00640 1 -- 172.21.15.37:0/1137822013 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe54416b810 con 0x7fe54415e9a0 2024-05-30T06:53:17.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.603+0000 7fe543400640 1 -- 172.21.15.37:0/1137822013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe54415e9a0 msgr2=0x7fe5441552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:17.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.603+0000 7fe543400640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe54415e9a0 0x7fe5441552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.603+0000 7fe543400640 1 -- 172.21.15.37:0/1137822013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5440c78a0 msgr2=0x7fe5440c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:17.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.603+0000 7fe543400640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5440c78a0 0x7fe5440c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.603+0000 7fe543400640 1 -- 172.21.15.37:0/1137822013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5440c95e0 con 0x7fe5440c7d30 2024-05-30T06:53:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.603+0000 7fe543400640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5440c7d30 0x7fe544157cd0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fe5440cbcb0 tx=0x7fe534019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.603+0000 7fe53be00640 1 -- 172.21.15.37:0/1137822013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5340b8020 con 0x7fe5440c7d30 2024-05-30T06:53:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.603+0000 7fe53be00640 1 -- 172.21.15.37:0/1137822013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5340b4640 con 0x7fe5440c7d30 2024-05-30T06:53:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.603+0000 7fe549c00640 1 -- 172.21.15.37:0/1137822013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe544158210 con 0x7fe5440c7d30 2024-05-30T06:53:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.603+0000 7fe53be00640 1 -- 172.21.15.37:0/1137822013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5340b0040 con 0x7fe5440c7d30 2024-05-30T06:53:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.603+0000 7fe549c00640 1 -- 172.21.15.37:0/1137822013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54406f120 con 0x7fe5440c7d30 2024-05-30T06:53:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.603+0000 7fe549c00640 1 -- 172.21.15.37:0/1137822013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe544075580 con 0x7fe5440c7d30 2024-05-30T06:53:17.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.603+0000 7fe53be00640 1 -- 172.21.15.37:0/1137822013 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 32) ==== 89670+0+0 (secure 0 0 0) 0x7fe5340bb020 con 0x7fe5440c7d30 2024-05-30T06:53:17.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.607+0000 7fe53be00640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe524069610 0x7fe52406bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:17.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.607+0000 7fe53be00640 1 -- 172.21.15.37:0/1137822013 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7fe53411f300 con 0x7fe5440c7d30 2024-05-30T06:53:17.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.607+0000 7fe543e00640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe524069610 0x7fe52406bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.607+0000 7fe543e00640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe524069610 0x7fe52406bad0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe54415cf60 tx=0x7fe530009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:17.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.611+0000 7fe53be00640 1 -- 172.21.15.37:0/1137822013 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe534016070 con 0x7fe5440c7d30 2024-05-30T06:53:17.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.891+0000 7fe549c00640 1 -- 172.21.15.37:0/1137822013 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone371015", "target": ["mon-mgr", ""]}) -- 0x7fe544158e80 con 0x7fe524069610 2024-05-30T06:53:17.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.907+0000 7fe53be00640 1 -- 172.21.15.37:0/1137822013 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe544158e80 con 0x7fe524069610 2024-05-30T06:53:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.907+0000 7fe549c00640 1 -- 172.21.15.37:0/1137822013 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe524069610 msgr2=0x7fe52406bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.907+0000 7fe549c00640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe524069610 0x7fe52406bad0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe54415cf60 tx=0x7fe530009190 comp rx=0 tx=0).stop 2024-05-30T06:53:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.907+0000 7fe549c00640 1 -- 172.21.15.37:0/1137822013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5440c7d30 msgr2=0x7fe544157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:17.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.907+0000 7fe549c00640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5440c7d30 0x7fe544157cd0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fe5440cbcb0 tx=0x7fe534019190 comp rx=0 tx=0).stop 2024-05-30T06:53:17.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.907+0000 7fe549c00640 1 -- 172.21.15.37:0/1137822013 shutdown_connections 2024-05-30T06:53:17.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.907+0000 7fe549c00640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe54415e9a0 0x7fe5441552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.907+0000 7fe549c00640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5440c7d30 0x7fe544157cd0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.907+0000 7fe549c00640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe524069610 0x7fe52406bad0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.907+0000 7fe549c00640 1 --2- 172.21.15.37:0/1137822013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5440c78a0 0x7fe5440c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:17.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.907+0000 7fe549c00640 1 -- 172.21.15.37:0/1137822013 >> 172.21.15.37:0/1137822013 conn(0x7fe54409aa60 msgr2=0x7fe5440b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:17.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.907+0000 7fe549c00640 1 -- 172.21.15.37:0/1137822013 shutdown_connections 2024-05-30T06:53:17.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:17.907+0000 7fe549c00640 1 -- 172.21.15.37:0/1137822013 wait complete. 2024-05-30T06:53:17.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone371018 2024-05-30T06:53:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.075+0000 7efdc8800640 1 Processor -- start 2024-05-30T06:53:18.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.075+0000 7efdc8800640 1 -- start start 2024-05-30T06:53:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.075+0000 7efdc8800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efdc0161ee0 0x7efdc00b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.075+0000 7efdc8800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efdc00b3aa0 0x7efdc00ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.075+0000 7efdc8800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc00ce470 con 0x7efdc00716b0 2024-05-30T06:53:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.075+0000 7efdc8800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efdc01622c0 con 0x7efdc0161ee0 2024-05-30T06:53:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.075+0000 7efdc8800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7efdc00b4f30 con 0x7efdc00b3aa0 2024-05-30T06:53:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.075+0000 7efdc5e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efdc0161ee0 0x7efdc00b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.075+0000 7efdc5e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efdc0161ee0 0x7efdc00b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57976/0 (socket says 172.21.15.37:57976) 2024-05-30T06:53:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.075+0000 7efdc5e00640 1 -- 172.21.15.37:0/393919457 learned_addr learned my addr 172.21.15.37:0/393919457 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.075+0000 7efdc6800640 1 --2- 172.21.15.37:0/393919457 >> v2:172.21.15.105:3300/0 conn(0x7efdc00b3aa0 0x7efdc00ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc5e00640 1 -- 172.21.15.37:0/393919457 >> v2:172.21.15.105:3300/0 conn(0x7efdc00b3aa0 msgr2=0x7efdc00ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc5e00640 1 --2- 172.21.15.37:0/393919457 >> v2:172.21.15.105:3300/0 conn(0x7efdc00b3aa0 0x7efdc00ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc5e00640 1 -- 172.21.15.37:0/393919457 >> v1:172.21.15.105:6789/0 conn(0x7efdc00716b0 legacy=0x7efdc00b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc5e00640 1 -- 172.21.15.37:0/393919457 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc00b5210 con 0x7efdc0161ee0 2024-05-30T06:53:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc4a00640 1 -- 172.21.15.37:0/393919457 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2403180912 0 0) 0x7efdc00ce470 con 0x7efdc00716b0 2024-05-30T06:53:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc5e00640 1 --2- 172.21.15.37:0/393919457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc0161ee0 0x7efdc00b4700 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7efdc00b6470 tx=0x7efdb401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e2ab15af131822 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc4a00640 1 -- 172.21.15.37:0/393919457 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb40b0070 con 0x7efdc0161ee0 2024-05-30T06:53:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc4a00640 1 -- 172.21.15.37:0/393919457 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb40ab600 con 0x7efdc0161ee0 2024-05-30T06:53:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc4a00640 1 -- 172.21.15.37:0/393919457 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb40ab9d0 con 0x7efdc0161ee0 2024-05-30T06:53:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc8800640 1 -- 172.21.15.37:0/393919457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc0161ee0 msgr2=0x7efdc00b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc8800640 1 --2- 172.21.15.37:0/393919457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc0161ee0 0x7efdc00b4700 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7efdc00b6470 tx=0x7efdb401c520 comp rx=0 tx=0).stop 2024-05-30T06:53:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc8800640 1 -- 172.21.15.37:0/393919457 shutdown_connections 2024-05-30T06:53:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc8800640 1 --2- 172.21.15.37:0/393919457 >> v2:172.21.15.105:3300/0 conn(0x7efdc00b3aa0 0x7efdc00ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc8800640 1 --2- 172.21.15.37:0/393919457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc0161ee0 0x7efdc00b4700 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc8800640 1 -- 172.21.15.37:0/393919457 >> 172.21.15.37:0/393919457 conn(0x7efdc006f110 msgr2=0x7efdc006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc8800640 1 -- 172.21.15.37:0/393919457 shutdown_connections 2024-05-30T06:53:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.079+0000 7efdc8800640 1 -- 172.21.15.37:0/393919457 wait complete. 2024-05-30T06:53:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc8800640 1 Processor -- start 2024-05-30T06:53:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc8800640 1 -- start start 2024-05-30T06:53:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc8800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdc00716b0 0x7efdc00cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc8800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc00b3aa0 0x7efdc0156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc8800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc0161ee0 0x7efdc00cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc8800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efdc00cf840 con 0x7efdc00b3aa0 2024-05-30T06:53:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc8800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efdc00cf6c0 con 0x7efdc00716b0 2024-05-30T06:53:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc8800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efdc00cf9c0 con 0x7efdc0161ee0 2024-05-30T06:53:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc00b3aa0 0x7efdc0156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc00b3aa0 0x7efdc0156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57990/0 (socket says 172.21.15.37:57990) 2024-05-30T06:53:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc5400640 1 -- 172.21.15.37:0/1008828155 learned_addr learned my addr 172.21.15.37:0/1008828155 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc6800640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc0161ee0 0x7efdc00cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc5e00640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdc00716b0 0x7efdc00cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc5400640 1 -- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc0161ee0 msgr2=0x7efdc00cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc5400640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc0161ee0 0x7efdc00cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc5400640 1 -- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdc00716b0 msgr2=0x7efdc00cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc5400640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdc00716b0 0x7efdc00cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc5400640 1 -- 172.21.15.37:0/1008828155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc00b1250 con 0x7efdc00b3aa0 2024-05-30T06:53:18.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc5400640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc00b3aa0 0x7efdc0156a10 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7efdb000c4d0 tx=0x7efdb000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdba000640 1 -- 172.21.15.37:0/1008828155 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0017070 con 0x7efdc00b3aa0 2024-05-30T06:53:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdba000640 1 -- 172.21.15.37:0/1008828155 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdb0005480 con 0x7efdc00b3aa0 2024-05-30T06:53:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc8800640 1 -- 172.21.15.37:0/1008828155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc0156f50 con 0x7efdc00b3aa0 2024-05-30T06:53:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdba000640 1 -- 172.21.15.37:0/1008828155 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0003840 con 0x7efdc00b3aa0 2024-05-30T06:53:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.083+0000 7efdc8800640 1 -- 172.21.15.37:0/1008828155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc01574b0 con 0x7efdc00b3aa0 2024-05-30T06:53:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.087+0000 7efdc8800640 1 -- 172.21.15.37:0/1008828155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc015d2a0 con 0x7efdc00b3aa0 2024-05-30T06:53:18.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.087+0000 7efdba000640 1 -- 172.21.15.37:0/1008828155 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 32) ==== 89670+0+0 (secure 0 0 0) 0x7efdb001a070 con 0x7efdc00b3aa0 2024-05-30T06:53:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.087+0000 7efdba000640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efda4069610 0x7efda406bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.087+0000 7efdba000640 1 -- 172.21.15.37:0/1008828155 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5795+0+0 (secure 0 0 0) 0x7efdb0084cf0 con 0x7efdc00b3aa0 2024-05-30T06:53:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.087+0000 7efdc5e00640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efda4069610 0x7efda406bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.087+0000 7efdc5e00640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efda4069610 0x7efda406bad0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efdb40ad000 tx=0x7efdb40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:18.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.091+0000 7efdba000640 1 -- 172.21.15.37:0/1008828155 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efdc0156f50 con 0x7efdc00b3aa0 2024-05-30T06:53:18.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:18.283+0000 7efdc8800640 1 -- 172.21.15.37:0/1008828155 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone371018", "target": ["mon-mgr", ""]}) -- 0x7efdc00ce470 con 0x7efda4069610 2024-05-30T06:53:20.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:20.839+0000 7efdba000640 1 -- 172.21.15.37:0/1008828155 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efdc00ce470 con 0x7efda4069610 2024-05-30T06:53:20.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:20.843+0000 7efdc8800640 1 -- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efda4069610 msgr2=0x7efda406bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:20.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:20.843+0000 7efdc8800640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efda4069610 0x7efda406bad0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efdb40ad000 tx=0x7efdb40a6000 comp rx=0 tx=0).stop 2024-05-30T06:53:20.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:20.843+0000 7efdc8800640 1 -- 172.21.15.37:0/1008828155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc00b3aa0 msgr2=0x7efdc0156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:20.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:20.843+0000 7efdc8800640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc00b3aa0 0x7efdc0156a10 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7efdb000c4d0 tx=0x7efdb000c990 comp rx=0 tx=0).stop 2024-05-30T06:53:20.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:20.843+0000 7efdc8800640 1 -- 172.21.15.37:0/1008828155 shutdown_connections 2024-05-30T06:53:20.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:20.843+0000 7efdc8800640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdc0161ee0 0x7efdc00cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:20.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:20.843+0000 7efdc8800640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdc00b3aa0 0x7efdc0156a10 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:20.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:20.843+0000 7efdc8800640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efda4069610 0x7efda406bad0 secure :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efdb40ad000 tx=0x7efdb40a6000 comp rx=0 tx=0).stop 2024-05-30T06:53:20.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:20.843+0000 7efdc8800640 1 --2- 172.21.15.37:0/1008828155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdc00716b0 0x7efdc00cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:20.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:20.843+0000 7efdc8800640 1 -- 172.21.15.37:0/1008828155 >> 172.21.15.37:0/1008828155 conn(0x7efdc006f110 msgr2=0x7efdc0160ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:20.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:20.843+0000 7efdc8800640 1 -- 172.21.15.37:0/1008828155 shutdown_connections 2024-05-30T06:53:20.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:20.847+0000 7efdc8800640 1 -- 172.21.15.37:0/1008828155 wait complete. 2024-05-30T06:53:20.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone37104 2024-05-30T06:53:21.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6ec1200640 1 Processor -- start 2024-05-30T06:53:21.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6ec1200640 1 -- start start 2024-05-30T06:53:21.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6ec1200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ebc1590c0 0x7f6ebc0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6ec1200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0cd400 0x7f6ebc0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6ec1200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ebc15f230 con 0x7f6ebc0cde60 2024-05-30T06:53:21.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6ec1200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6ebc15f510 con 0x7f6ebc1590c0 2024-05-30T06:53:21.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6ec1200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6ebc15f7f0 con 0x7f6ebc0cd400 2024-05-30T06:53:21.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6eb9e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ebc1590c0 0x7f6ebc0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6eb9e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ebc1590c0 0x7f6ebc0cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57998/0 (socket says 172.21.15.37:57998) 2024-05-30T06:53:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6eb9e00640 1 -- 172.21.15.37:0/62738055 learned_addr learned my addr 172.21.15.37:0/62738055 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6eba800640 1 --2- 172.21.15.37:0/62738055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0cd400 0x7f6ebc0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6eb9e00640 1 -- 172.21.15.37:0/62738055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0cd400 msgr2=0x7f6ebc0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6eb9e00640 1 --2- 172.21.15.37:0/62738055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0cd400 0x7f6ebc0b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6eb9e00640 1 -- 172.21.15.37:0/62738055 >> v1:172.21.15.105:6789/0 conn(0x7f6ebc0cde60 legacy=0x7f6ebc06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6eb9e00640 1 -- 172.21.15.37:0/62738055 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc15fad0 con 0x7f6ebc1590c0 2024-05-30T06:53:21.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.031+0000 7f6eba800640 1 --2- 172.21.15.37:0/62738055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0cd400 0x7f6ebc0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:21.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.035+0000 7f6eb9e00640 1 --2- 172.21.15.37:0/62738055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ebc1590c0 0x7f6ebc0cd920 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009870 tx=0x7f6eac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cb6b4c10b7ad95 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:21.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.035+0000 7f6eb9400640 1 -- 172.21.15.37:0/62738055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0b0070 con 0x7f6ebc1590c0 2024-05-30T06:53:21.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.035+0000 7f6eb9400640 1 -- 172.21.15.37:0/62738055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac0ab600 con 0x7f6ebc1590c0 2024-05-30T06:53:21.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.035+0000 7f6eb9400640 1 -- 172.21.15.37:0/62738055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0ab9d0 con 0x7f6ebc1590c0 2024-05-30T06:53:21.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.035+0000 7f6ec1200640 1 -- 172.21.15.37:0/62738055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ebc1590c0 msgr2=0x7f6ebc0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.035+0000 7f6ec1200640 1 --2- 172.21.15.37:0/62738055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ebc1590c0 0x7f6ebc0cd920 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009870 tx=0x7f6eac01c4d0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.035+0000 7f6ec1200640 1 -- 172.21.15.37:0/62738055 shutdown_connections 2024-05-30T06:53:21.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.035+0000 7f6ec1200640 1 --2- 172.21.15.37:0/62738055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0cd400 0x7f6ebc0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.035+0000 7f6ec1200640 1 --2- 172.21.15.37:0/62738055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ebc1590c0 0x7f6ebc0cd920 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.035+0000 7f6ec1200640 1 -- 172.21.15.37:0/62738055 >> 172.21.15.37:0/62738055 conn(0x7f6ebc06bf60 msgr2=0x7f6ebc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.035+0000 7f6ec1200640 1 -- 172.21.15.37:0/62738055 shutdown_connections 2024-05-30T06:53:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.035+0000 7f6ec1200640 1 -- 172.21.15.37:0/62738055 wait complete. 2024-05-30T06:53:21.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6ec1200640 1 Processor -- start 2024-05-30T06:53:21.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6ec1200640 1 -- start start 2024-05-30T06:53:21.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6ec1200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ebc0cd400 0x7f6ebc14f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6ec1200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0cde60 0x7f6ebc15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6ec1200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ebc1590c0 0x7f6ebc14d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6ec1200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc06f770 con 0x7f6ebc0cd400 2024-05-30T06:53:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6ec1200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc0b46b0 con 0x7f6ebc1590c0 2024-05-30T06:53:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6ec1200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6ebc06f8f0 con 0x7f6ebc0cde60 2024-05-30T06:53:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ebc0cd400 0x7f6ebc14f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ebc0cd400 0x7f6ebc14f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58014/0 (socket says 172.21.15.37:58014) 2024-05-30T06:53:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb9e00640 1 -- 172.21.15.37:0/3663846543 learned_addr learned my addr 172.21.15.37:0/3663846543 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eba800640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ebc1590c0 0x7f6ebc14d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb1400640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0cde60 0x7f6ebc15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb9e00640 1 -- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0cde60 msgr2=0x7f6ebc15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb9e00640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0cde60 0x7f6ebc15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb9e00640 1 -- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ebc1590c0 msgr2=0x7f6ebc14d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb9e00640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ebc1590c0 0x7f6ebc14d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb9e00640 1 -- 172.21.15.37:0/3663846543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc15c6e0 con 0x7f6ebc0cd400 2024-05-30T06:53:21.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb1400640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0cde60 0x7f6ebc15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:21.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb9e00640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ebc0cd400 0x7f6ebc14f4e0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0ae040 tx=0x7f6eac019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:21.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb2a00640 1 -- 172.21.15.37:0/3663846543 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0bb070 con 0x7f6ebc0cd400 2024-05-30T06:53:21.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb2a00640 1 -- 172.21.15.37:0/3663846543 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac0b6430 con 0x7f6ebc0cd400 2024-05-30T06:53:21.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6eb2a00640 1 -- 172.21.15.37:0/3663846543 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0b0040 con 0x7f6ebc0cd400 2024-05-30T06:53:21.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6ec1200640 1 -- 172.21.15.37:0/3663846543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ebc159840 con 0x7f6ebc0cd400 2024-05-30T06:53:21.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.039+0000 7f6ec1200640 1 -- 172.21.15.37:0/3663846543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ebc159ae0 con 0x7f6ebc0cd400 2024-05-30T06:53:21.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.043+0000 7f6ec1200640 1 -- 172.21.15.37:0/3663846543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ebc068d40 con 0x7f6ebc0cd400 2024-05-30T06:53:21.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.043+0000 7f6eb2a00640 1 -- 172.21.15.37:0/3663846543 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 32) ==== 89670+0+0 (secure 0 0 0) 0x7f6eac0be070 con 0x7f6ebc0cd400 2024-05-30T06:53:21.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.043+0000 7f6eb2a00640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6e98069610 0x7f6e9806bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.043+0000 7f6eb2a00640 1 -- 172.21.15.37:0/3663846543 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7f6eac11f070 con 0x7f6ebc0cd400 2024-05-30T06:53:21.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.043+0000 7f6eb1400640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6e98069610 0x7f6e9806bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.043+0000 7f6eb1400640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6e98069610 0x7f6e9806bad0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc1459c0 tx=0x7f6ea4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:21.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.047+0000 7f6eb2a00640 1 -- 172.21.15.37:0/3663846543 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6eac016150 con 0x7f6ebc0cd400 2024-05-30T06:53:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.239+0000 7f6ec1200640 1 -- 172.21.15.37:0/3663846543 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone37104", "target": ["mon-mgr", ""]}) -- 0x7f6ebc152950 con 0x7f6e98069610 2024-05-30T06:53:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.259+0000 7f6eb2a00640 1 -- 172.21.15.37:0/3663846543 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6ebc152950 con 0x7f6e98069610 2024-05-30T06:53:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.259+0000 7f6ec1200640 1 -- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6e98069610 msgr2=0x7f6e9806bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.259+0000 7f6ec1200640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6e98069610 0x7f6e9806bad0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc1459c0 tx=0x7f6ea4009040 comp rx=0 tx=0).stop 2024-05-30T06:53:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.259+0000 7f6ec1200640 1 -- 172.21.15.37:0/3663846543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ebc0cd400 msgr2=0x7f6ebc14f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.259+0000 7f6ec1200640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ebc0cd400 0x7f6ebc14f4e0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0ae040 tx=0x7f6eac019270 comp rx=0 tx=0).stop 2024-05-30T06:53:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.259+0000 7f6ec1200640 1 -- 172.21.15.37:0/3663846543 shutdown_connections 2024-05-30T06:53:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.259+0000 7f6ec1200640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6e98069610 0x7f6e9806bad0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.259+0000 7f6ec1200640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ebc1590c0 0x7f6ebc14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.259+0000 7f6ec1200640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ebc0cde60 0x7f6ebc15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.259+0000 7f6ec1200640 1 --2- 172.21.15.37:0/3663846543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ebc0cd400 0x7f6ebc14f4e0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.259+0000 7f6ec1200640 1 -- 172.21.15.37:0/3663846543 >> 172.21.15.37:0/3663846543 conn(0x7f6ebc06bf60 msgr2=0x7f6ebc15d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:21.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.259+0000 7f6ec1200640 1 -- 172.21.15.37:0/3663846543 shutdown_connections 2024-05-30T06:53:21.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.259+0000 7f6ec1200640 1 -- 172.21.15.37:0/3663846543 wait complete. 2024-05-30T06:53:21.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone37101 2024-05-30T06:53:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.427+0000 7fd947e00640 1 Processor -- start 2024-05-30T06:53:21.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.427+0000 7fd947e00640 1 -- start start 2024-05-30T06:53:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.427+0000 7fd947e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd940159490 0x7fd940072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.427+0000 7fd947e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd9400702d0 0x7fd940072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.427+0000 7fd947e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9400d06e0 con 0x7fd94015f190 2024-05-30T06:53:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.427+0000 7fd947e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd940162800 con 0x7fd9400702d0 2024-05-30T06:53:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.427+0000 7fd947e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd940162a50 con 0x7fd940159490 2024-05-30T06:53:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.427+0000 7fd944a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd9400702d0 0x7fd940072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.427+0000 7fd944a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd9400702d0 0x7fd940072c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58024/0 (socket says 172.21.15.37:58024) 2024-05-30T06:53:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.427+0000 7fd944a00640 1 -- 172.21.15.37:0/4221069167 learned_addr learned my addr 172.21.15.37:0/4221069167 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.427+0000 7fd945400640 1 --2- 172.21.15.37:0/4221069167 >> v2:172.21.15.105:3300/0 conn(0x7fd940159490 0x7fd940072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.431+0000 7fd944a00640 1 -- 172.21.15.37:0/4221069167 >> v2:172.21.15.105:3300/0 conn(0x7fd940159490 msgr2=0x7fd940072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.431+0000 7fd944a00640 1 --2- 172.21.15.37:0/4221069167 >> v2:172.21.15.105:3300/0 conn(0x7fd940159490 0x7fd940072750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.431+0000 7fd944a00640 1 -- 172.21.15.37:0/4221069167 >> v1:172.21.15.37:6789/0 conn(0x7fd94015f190 legacy=0x7fd94015f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.431+0000 7fd944a00640 1 -- 172.21.15.37:0/4221069167 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd940162d30 con 0x7fd9400702d0 2024-05-30T06:53:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.431+0000 7fd944a00640 1 --2- 172.21.15.37:0/4221069167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9400702d0 0x7fd940072c90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd9400d0d20 tx=0x7fd92c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1d9089b5848190 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.431+0000 7fd93fe00640 1 -- 172.21.15.37:0/4221069167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0b0070 con 0x7fd9400702d0 2024-05-30T06:53:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.431+0000 7fd93fe00640 1 -- 172.21.15.37:0/4221069167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c0ab600 con 0x7fd9400702d0 2024-05-30T06:53:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.431+0000 7fd93fe00640 1 -- 172.21.15.37:0/4221069167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0ab9d0 con 0x7fd9400702d0 2024-05-30T06:53:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.431+0000 7fd947e00640 1 -- 172.21.15.37:0/4221069167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9400702d0 msgr2=0x7fd940072c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.431+0000 7fd947e00640 1 --2- 172.21.15.37:0/4221069167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9400702d0 0x7fd940072c90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd9400d0d20 tx=0x7fd92c01c400 comp rx=0 tx=0).stop 2024-05-30T06:53:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.431+0000 7fd947e00640 1 -- 172.21.15.37:0/4221069167 shutdown_connections 2024-05-30T06:53:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.431+0000 7fd947e00640 1 --2- 172.21.15.37:0/4221069167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9400702d0 0x7fd940072c90 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.431+0000 7fd947e00640 1 --2- 172.21.15.37:0/4221069167 >> v2:172.21.15.105:3300/0 conn(0x7fd940159490 0x7fd940072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd947e00640 1 -- 172.21.15.37:0/4221069167 >> 172.21.15.37:0/4221069167 conn(0x7fd9400d0d50 msgr2=0x7fd9400d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd947e00640 1 -- 172.21.15.37:0/4221069167 shutdown_connections 2024-05-30T06:53:21.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd947e00640 1 -- 172.21.15.37:0/4221069167 wait complete. 2024-05-30T06:53:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd947e00640 1 Processor -- start 2024-05-30T06:53:21.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd947e00640 1 -- start start 2024-05-30T06:53:21.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd947e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9400702d0 0x7fd940157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd947e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd940159490 0x7fd9400b1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd947e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd94015f190 0x7fd9401485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd947e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd94016bf30 con 0x7fd9400702d0 2024-05-30T06:53:21.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd947e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd94016bdb0 con 0x7fd94015f190 2024-05-30T06:53:21.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd947e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd94016c0b0 con 0x7fd940159490 2024-05-30T06:53:21.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd945400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9400702d0 0x7fd940157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd945400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9400702d0 0x7fd940157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58028/0 (socket says 172.21.15.37:58028) 2024-05-30T06:53:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd945400640 1 -- 172.21.15.37:0/3541884003 learned_addr learned my addr 172.21.15.37:0/3541884003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd945e00640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd94015f190 0x7fd9401485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd944a00640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd940159490 0x7fd9400b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd945400640 1 -- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd940159490 msgr2=0x7fd9400b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd945400640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd940159490 0x7fd9400b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd945400640 1 -- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd94015f190 msgr2=0x7fd9401485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd945400640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd94015f190 0x7fd9401485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd945400640 1 -- 172.21.15.37:0/3541884003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9400ae260 con 0x7fd9400702d0 2024-05-30T06:53:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd945e00640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd94015f190 0x7fd9401485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:21.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd945400640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9400702d0 0x7fd940157480 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd93400e930 tx=0x7fd93400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd93d600640 1 -- 172.21.15.37:0/3541884003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd934017070 con 0x7fd9400702d0 2024-05-30T06:53:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd93d600640 1 -- 172.21.15.37:0/3541884003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93400ca00 con 0x7fd9400702d0 2024-05-30T06:53:21.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.435+0000 7fd93d600640 1 -- 172.21.15.37:0/3541884003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93400cdb0 con 0x7fd9400702d0 2024-05-30T06:53:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.439+0000 7fd947e00640 1 -- 172.21.15.37:0/3541884003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd940157bd0 con 0x7fd9400702d0 2024-05-30T06:53:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.439+0000 7fd947e00640 1 -- 172.21.15.37:0/3541884003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd940158190 con 0x7fd9400702d0 2024-05-30T06:53:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.439+0000 7fd947e00640 1 -- 172.21.15.37:0/3541884003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd940068d40 con 0x7fd9400702d0 2024-05-30T06:53:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.439+0000 7fd93d600640 1 -- 172.21.15.37:0/3541884003 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 32) ==== 89670+0+0 (secure 0 0 0) 0x7fd93401a070 con 0x7fd9400702d0 2024-05-30T06:53:21.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.439+0000 7fd93d600640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd920069640 0x7fd92006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.439+0000 7fd93d600640 1 -- 172.21.15.37:0/3541884003 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7fd934085900 con 0x7fd9400702d0 2024-05-30T06:53:21.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.439+0000 7fd944a00640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd920069640 0x7fd92006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.439+0000 7fd944a00640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd920069640 0x7fd92006bb00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0ad000 tx=0x7fd92c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:21.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.443+0000 7fd93d600640 1 -- 172.21.15.37:0/3541884003 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd934057380 con 0x7fd9400702d0 2024-05-30T06:53:21.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.631+0000 7fd947e00640 1 -- 172.21.15.37:0/3541884003 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone37101", "target": ["mon-mgr", ""]}) -- 0x7fd9400b1ab0 con 0x7fd920069640 2024-05-30T06:53:21.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.651+0000 7fd93d600640 1 -- 172.21.15.37:0/3541884003 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd92c0b1040 con 0x7fd920069640 2024-05-30T06:53:21.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.655+0000 7fd947e00640 1 -- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd920069640 msgr2=0x7fd92006bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.655+0000 7fd947e00640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd920069640 0x7fd92006bb00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0ad000 tx=0x7fd92c008040 comp rx=0 tx=0).stop 2024-05-30T06:53:21.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.655+0000 7fd947e00640 1 -- 172.21.15.37:0/3541884003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9400702d0 msgr2=0x7fd940157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.655+0000 7fd947e00640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9400702d0 0x7fd940157480 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd93400e930 tx=0x7fd93400edf0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.655+0000 7fd947e00640 1 -- 172.21.15.37:0/3541884003 shutdown_connections 2024-05-30T06:53:21.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.655+0000 7fd947e00640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd920069640 0x7fd92006bb00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.655+0000 7fd947e00640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd94015f190 0x7fd9401485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.655+0000 7fd947e00640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd940159490 0x7fd9400b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.655+0000 7fd947e00640 1 --2- 172.21.15.37:0/3541884003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9400702d0 0x7fd940157480 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.655+0000 7fd947e00640 1 -- 172.21.15.37:0/3541884003 >> 172.21.15.37:0/3541884003 conn(0x7fd9400d0d50 msgr2=0x7fd9400b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:21.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.655+0000 7fd947e00640 1 -- 172.21.15.37:0/3541884003 shutdown_connections 2024-05-30T06:53:21.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.655+0000 7fd947e00640 1 -- 172.21.15.37:0/3541884003 wait complete. 2024-05-30T06:53:21.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone37103 2024-05-30T06:53:21.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.819+0000 7faaa6e00640 1 Processor -- start 2024-05-30T06:53:21.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.819+0000 7faaa6e00640 1 -- start start 2024-05-30T06:53:21.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faaa6e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7faaa01590c0 0x7faaa00cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faaa6e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa015f230 con 0x7faaa00cd400 2024-05-30T06:53:21.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faaa6e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa015f510 con 0x7faaa00cde60 2024-05-30T06:53:21.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faaa6e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7faaa015f7f0 con 0x7faaa01590c0 2024-05-30T06:53:21.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faaa4e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faaa00cd400 0x7faaa00b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44504/0 (socket says 172.21.15.37:44504) 2024-05-30T06:53:21.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faaa4e00640 1 -- 172.21.15.37:0/563617285 learned_addr learned my addr 172.21.15.37:0/563617285 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:21.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9fe00640 1 --2- 172.21.15.37:0/563617285 >> v2:172.21.15.105:3300/0 conn(0x7faaa01590c0 0x7faaa00cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4244118197 0 0) 0x7faaa015f230 con 0x7faaa00cd400 2024-05-30T06:53:21.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa84003530 con 0x7faaa00cd400 2024-05-30T06:53:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2391035166 0 0) 0x7faa84003530 con 0x7faaa00cd400 2024-05-30T06:53:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 >> v2:172.21.15.105:3300/0 conn(0x7faaa01590c0 msgr2=0x7faaa00cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 --2- 172.21.15.37:0/563617285 >> v2:172.21.15.105:3300/0 conn(0x7faaa01590c0 0x7faaa00cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 >> v1:172.21.15.105:6789/0 conn(0x7faaa00cde60 legacy=0x7faaa006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa015fad0 con 0x7faaa00cd400 2024-05-30T06:53:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7faa98001a00 con 0x7faaa00cd400 2024-05-30T06:53:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 >> v1:172.21.15.37:6789/0 conn(0x7faaa00cd400 legacy=0x7faaa00b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 --2- 172.21.15.37:0/563617285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa840039c0 0x7faa84003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 --2- 172.21.15.37:0/563617285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa84004810 0x7faa84004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 --2- 172.21.15.37:0/563617285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa840052f0 0x7faa8400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faaa015f7f0 con 0x7faa840052f0 2024-05-30T06:53:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa8400c1c0 con 0x7faa840039c0 2024-05-30T06:53:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa8400c3c0 con 0x7faa84004810 2024-05-30T06:53:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9fe00640 1 --2- 172.21.15.37:0/563617285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa840039c0 0x7faa84003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faaa4e00640 1 --2- 172.21.15.37:0/563617285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa840052f0 0x7faa8400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa97400640 1 --2- 172.21.15.37:0/563617285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa84004810 0x7faa84004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9fe00640 1 -- 172.21.15.37:0/563617285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa84004810 msgr2=0x7faa84004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9fe00640 1 --2- 172.21.15.37:0/563617285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa84004810 0x7faa84004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9fe00640 1 -- 172.21.15.37:0/563617285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa840052f0 msgr2=0x7faa8400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9fe00640 1 --2- 172.21.15.37:0/563617285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa840052f0 0x7faa8400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faa9fe00640 1 -- 172.21.15.37:0/563617285 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa84003530 con 0x7faa840039c0 2024-05-30T06:53:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.823+0000 7faaa4e00640 1 -- 172.21.15.37:0/563617285 reap_dead start 2024-05-30T06:53:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.827+0000 7faa9fe00640 1 --2- 172.21.15.37:0/563617285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa840039c0 0x7faa84003de0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7faa90009ab0 tx=0x7faa9001ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee55ab3a3b65f35f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.827+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa900096b0 con 0x7faa840039c0 2024-05-30T06:53:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.827+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa900a9430 con 0x7faa840039c0 2024-05-30T06:53:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.827+0000 7faa9f400640 1 -- 172.21.15.37:0/563617285 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa900a9860 con 0x7faa840039c0 2024-05-30T06:53:21.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.827+0000 7faaa6e00640 1 -- 172.21.15.37:0/563617285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa840039c0 msgr2=0x7faa84003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.827+0000 7faaa6e00640 1 --2- 172.21.15.37:0/563617285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa840039c0 0x7faa84003de0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7faa90009ab0 tx=0x7faa9001ca50 comp rx=0 tx=0).stop 2024-05-30T06:53:21.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.827+0000 7faaa6e00640 1 -- 172.21.15.37:0/563617285 shutdown_connections 2024-05-30T06:53:21.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.827+0000 7faaa6e00640 1 --2- 172.21.15.37:0/563617285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa840039c0 0x7faa84003de0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.827+0000 7faaa6e00640 1 -- 172.21.15.37:0/563617285 >> 172.21.15.37:0/563617285 conn(0x7faaa006bf60 msgr2=0x7faaa00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:21.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.827+0000 7faaa6e00640 1 -- 172.21.15.37:0/563617285 shutdown_connections 2024-05-30T06:53:21.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.827+0000 7faaa6e00640 1 -- 172.21.15.37:0/563617285 wait complete. 2024-05-30T06:53:21.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faaa6e00640 1 Processor -- start 2024-05-30T06:53:21.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faaa6e00640 1 -- start start 2024-05-30T06:53:21.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faaa6e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa840039c0 0x7faaa00a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faaa6e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa015bfe0 0x7faaa006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faaa6e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa015c460 0x7faaa006f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faaa6e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faaa00d0140 con 0x7faaa015c460 2024-05-30T06:53:21.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faaa6e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faaa00cffc0 con 0x7faaa015bfe0 2024-05-30T06:53:21.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faaa6e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faaa00d02c0 con 0x7faa840039c0 2024-05-30T06:53:21.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faa9fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa840039c0 0x7faaa00a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faaa4e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa015c460 0x7faaa006f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faa9fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa840039c0 0x7faaa00a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:35226/0 (socket says 172.21.15.37:35226) 2024-05-30T06:53:21.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faa9fe00640 1 -- 172.21.15.37:0/3636726912 learned_addr learned my addr 172.21.15.37:0/3636726912 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:21.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faa97400640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa015bfe0 0x7faaa006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faa9fe00640 1 -- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa015bfe0 msgr2=0x7faaa006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faa9fe00640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa015bfe0 0x7faaa006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faa9fe00640 1 -- 172.21.15.37:0/3636726912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa015c460 msgr2=0x7faaa006f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faa9fe00640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa015c460 0x7faaa006f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faa9fe00640 1 -- 172.21.15.37:0/3636726912 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa0159ab0 con 0x7faa840039c0 2024-05-30T06:53:21.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faaa4e00640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa015c460 0x7faaa006f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:21.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faa9fe00640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa840039c0 0x7faaa00a9d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faa900ab040 tx=0x7faa900197f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:21.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faa9cc00640 1 -- 172.21.15.37:0/3636726912 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa900bf070 con 0x7faa840039c0 2024-05-30T06:53:21.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faa9cc00640 1 -- 172.21.15.37:0/3636726912 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9000f000 con 0x7faa840039c0 2024-05-30T06:53:21.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faa9cc00640 1 -- 172.21.15.37:0/3636726912 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa900a9da0 con 0x7faa840039c0 2024-05-30T06:53:21.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faaa6e00640 1 -- 172.21.15.37:0/3636726912 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa0159d90 con 0x7faa840039c0 2024-05-30T06:53:21.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faaa6e00640 1 -- 172.21.15.37:0/3636726912 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa015a350 con 0x7faa840039c0 2024-05-30T06:53:21.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.831+0000 7faaa6e00640 1 -- 172.21.15.37:0/3636726912 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa0068d40 con 0x7faa840039c0 2024-05-30T06:53:21.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.835+0000 7faa9cc00640 1 -- 172.21.15.37:0/3636726912 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 32) ==== 89670+0+0 (secure 0 0 0) 0x7faa900059a0 con 0x7faa840039c0 2024-05-30T06:53:21.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.835+0000 7faa9cc00640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faa7c069610 0x7faa7c06bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:21.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.835+0000 7faa9cc00640 1 -- 172.21.15.37:0/3636726912 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7faa9011ef00 con 0x7faa840039c0 2024-05-30T06:53:21.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.835+0000 7faa97400640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faa7c069610 0x7faa7c06bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:21.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.835+0000 7faa97400640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faa7c069610 0x7faa7c06bad0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7faa88000c10 tx=0x7faa88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:21.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.839+0000 7faa9cc00640 1 -- 172.21.15.37:0/3636726912 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faa900ad020 con 0x7faa840039c0 2024-05-30T06:53:21.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:21.851+0000 7faa9cc00640 1 -- 172.21.15.37:0/3636726912 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7faa9011f180 con 0x7faa840039c0 2024-05-30T06:53:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.039+0000 7faaa6e00640 1 -- 172.21.15.37:0/3636726912 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone37103", "target": ["mon-mgr", ""]}) -- 0x7faaa00b31b0 con 0x7faa7c069610 2024-05-30T06:53:22.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.059+0000 7faa9cc00640 1 -- 172.21.15.37:0/3636726912 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7faaa00b31b0 con 0x7faa7c069610 2024-05-30T06:53:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.063+0000 7faaa6e00640 1 -- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faa7c069610 msgr2=0x7faa7c06bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.063+0000 7faaa6e00640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faa7c069610 0x7faa7c06bad0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7faa88000c10 tx=0x7faa88009040 comp rx=0 tx=0).stop 2024-05-30T06:53:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.063+0000 7faaa6e00640 1 -- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa840039c0 msgr2=0x7faaa00a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.063+0000 7faaa6e00640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa840039c0 0x7faaa00a9d10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faa900ab040 tx=0x7faa900197f0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.063+0000 7faaa6e00640 1 -- 172.21.15.37:0/3636726912 shutdown_connections 2024-05-30T06:53:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.063+0000 7faaa6e00640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaa015c460 0x7faaa006f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.063+0000 7faaa6e00640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faa7c069610 0x7faa7c06bad0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.063+0000 7faaa6e00640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faaa015bfe0 0x7faaa006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.063+0000 7faaa6e00640 1 --2- 172.21.15.37:0/3636726912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa840039c0 0x7faaa00a9d10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.063+0000 7faaa6e00640 1 -- 172.21.15.37:0/3636726912 >> 172.21.15.37:0/3636726912 conn(0x7faaa006bf60 msgr2=0x7faaa00b11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:22.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.063+0000 7faaa6e00640 1 -- 172.21.15.37:0/3636726912 shutdown_connections 2024-05-30T06:53:22.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.063+0000 7faaa6e00640 1 -- 172.21.15.37:0/3636726912 wait complete. 2024-05-30T06:53:22.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone37109 2024-05-30T06:53:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd668a00640 1 Processor -- start 2024-05-30T06:53:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd668a00640 1 -- start start 2024-05-30T06:53:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd668a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6640b15c0 0x7fd6640cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd668a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6640cf460 0x7fd6640d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd668a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66409bba0 con 0x7fd66415eb60 2024-05-30T06:53:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd668a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd66406db90 con 0x7fd6640cf460 2024-05-30T06:53:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd668a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd66409ab00 con 0x7fd6640b15c0 2024-05-30T06:53:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd662800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6640cf460 0x7fd6640d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd662800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6640cf460 0x7fd6640d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58046/0 (socket says 172.21.15.37:58046) 2024-05-30T06:53:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd662800640 1 -- 172.21.15.37:0/2976798424 learned_addr learned my addr 172.21.15.37:0/2976798424 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd661e00640 1 --1- 172.21.15.37:0/2976798424 >> v1:172.21.15.37:6789/0 conn(0x7fd66415eb60 0x7fd66406d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44512/0 (socket says 172.21.15.37:44512) 2024-05-30T06:53:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd659400640 1 --2- 172.21.15.37:0/2976798424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6640b15c0 0x7fd6640cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd662800640 1 -- 172.21.15.37:0/2976798424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6640b15c0 msgr2=0x7fd6640cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd662800640 1 --2- 172.21.15.37:0/2976798424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6640b15c0 0x7fd6640cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd662800640 1 -- 172.21.15.37:0/2976798424 >> v1:172.21.15.37:6789/0 conn(0x7fd66415eb60 legacy=0x7fd66406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd662800640 1 -- 172.21.15.37:0/2976798424 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66409ade0 con 0x7fd6640cf460 2024-05-30T06:53:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.231+0000 7fd659400640 1 --2- 172.21.15.37:0/2976798424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6640b15c0 0x7fd6640cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:22.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.235+0000 7fd662800640 1 --2- 172.21.15.37:0/2976798424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6640cf460 0x7fd6640d0670 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009870 tx=0x7fd65c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158338185da6af7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:22.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.235+0000 7fd661400640 1 -- 172.21.15.37:0/2976798424 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c0b2070 con 0x7fd6640cf460 2024-05-30T06:53:22.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.235+0000 7fd661400640 1 -- 172.21.15.37:0/2976798424 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65c0a9070 con 0x7fd6640cf460 2024-05-30T06:53:22.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.235+0000 7fd661400640 1 -- 172.21.15.37:0/2976798424 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c0ad880 con 0x7fd6640cf460 2024-05-30T06:53:22.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.235+0000 7fd668a00640 1 -- 172.21.15.37:0/2976798424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6640cf460 msgr2=0x7fd6640d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.235+0000 7fd668a00640 1 --2- 172.21.15.37:0/2976798424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6640cf460 0x7fd6640d0670 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009870 tx=0x7fd65c01c560 comp rx=0 tx=0).stop 2024-05-30T06:53:22.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.235+0000 7fd668a00640 1 -- 172.21.15.37:0/2976798424 shutdown_connections 2024-05-30T06:53:22.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.235+0000 7fd668a00640 1 --2- 172.21.15.37:0/2976798424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6640cf460 0x7fd6640d0670 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.235+0000 7fd668a00640 1 --2- 172.21.15.37:0/2976798424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6640b15c0 0x7fd6640cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.235+0000 7fd668a00640 1 -- 172.21.15.37:0/2976798424 >> 172.21.15.37:0/2976798424 conn(0x7fd6640d26a0 msgr2=0x7fd6640d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:22.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.235+0000 7fd668a00640 1 -- 172.21.15.37:0/2976798424 shutdown_connections 2024-05-30T06:53:22.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.235+0000 7fd668a00640 1 -- 172.21.15.37:0/2976798424 wait complete. 2024-05-30T06:53:22.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd668a00640 1 Processor -- start 2024-05-30T06:53:22.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd668a00640 1 -- start start 2024-05-30T06:53:22.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd668a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6640b15c0 0x7fd6640c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:22.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd668a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6640cf460 0x7fd664144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:22.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd668a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd66415eb60 0x7fd6640b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:22.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd668a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640d1540 con 0x7fd6640b15c0 2024-05-30T06:53:22.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd668a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640d13c0 con 0x7fd66415eb60 2024-05-30T06:53:22.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd668a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd6640d16c0 con 0x7fd6640cf460 2024-05-30T06:53:22.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd661e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6640b15c0 0x7fd6640c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:22.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd661e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6640b15c0 0x7fd6640c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58052/0 (socket says 172.21.15.37:58052) 2024-05-30T06:53:22.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd661e00640 1 -- 172.21.15.37:0/2596142956 learned_addr learned my addr 172.21.15.37:0/2596142956 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:22.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd662800640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd66415eb60 0x7fd6640b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:22.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd659400640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6640cf460 0x7fd664144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:22.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd661e00640 1 -- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6640cf460 msgr2=0x7fd664144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd661e00640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6640cf460 0x7fd664144220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd661e00640 1 -- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd66415eb60 msgr2=0x7fd6640b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd661e00640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd66415eb60 0x7fd6640b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd661e00640 1 -- 172.21.15.37:0/2596142956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd664157120 con 0x7fd6640b15c0 2024-05-30T06:53:22.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd659400640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6640cf460 0x7fd664144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:22.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd661e00640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6640b15c0 0x7fd6640c8b00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c760 tx=0x7fd65400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:22.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd65aa00640 1 -- 172.21.15.37:0/2596142956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654017070 con 0x7fd6640b15c0 2024-05-30T06:53:22.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd65aa00640 1 -- 172.21.15.37:0/2596142956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65400a640 con 0x7fd6640b15c0 2024-05-30T06:53:22.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd668a00640 1 -- 172.21.15.37:0/2596142956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd664144760 con 0x7fd6640b15c0 2024-05-30T06:53:22.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd65aa00640 1 -- 172.21.15.37:0/2596142956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65400aa10 con 0x7fd6640b15c0 2024-05-30T06:53:22.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.239+0000 7fd668a00640 1 -- 172.21.15.37:0/2596142956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6640b7920 con 0x7fd6640b15c0 2024-05-30T06:53:22.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.243+0000 7fd668a00640 1 -- 172.21.15.37:0/2596142956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd664068d40 con 0x7fd6640b15c0 2024-05-30T06:53:22.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.243+0000 7fd65aa00640 1 -- 172.21.15.37:0/2596142956 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fd65401a070 con 0x7fd6640b15c0 2024-05-30T06:53:22.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.243+0000 7fd65aa00640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd6400695b0 0x7fd64006ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:22.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.243+0000 7fd65aa00640 1 -- 172.21.15.37:0/2596142956 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7fd654084f70 con 0x7fd6640b15c0 2024-05-30T06:53:22.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.243+0000 7fd659400640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd6400695b0 0x7fd64006ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:22.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.243+0000 7fd659400640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd6400695b0 0x7fd64006ba70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd6640ccb40 tx=0x7fd64c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.247+0000 7fd65aa00640 1 -- 172.21.15.37:0/2596142956 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd654056c10 con 0x7fd6640b15c0 2024-05-30T06:53:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.519+0000 7fd668a00640 1 -- 172.21.15.37:0/2596142956 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone37109", "target": ["mon-mgr", ""]}) -- 0x7fd6640c9040 con 0x7fd6400695b0 2024-05-30T06:53:22.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.539+0000 7fd65aa00640 1 -- 172.21.15.37:0/2596142956 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd64c008620 con 0x7fd6400695b0 2024-05-30T06:53:22.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.539+0000 7fd668a00640 1 -- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd6400695b0 msgr2=0x7fd64006ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.539+0000 7fd668a00640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd6400695b0 0x7fd64006ba70 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd6640ccb40 tx=0x7fd64c008040 comp rx=0 tx=0).stop 2024-05-30T06:53:22.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.539+0000 7fd668a00640 1 -- 172.21.15.37:0/2596142956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6640b15c0 msgr2=0x7fd6640c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.539+0000 7fd668a00640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6640b15c0 0x7fd6640c8b00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c760 tx=0x7fd65400cc20 comp rx=0 tx=0).stop 2024-05-30T06:53:22.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.539+0000 7fd668a00640 1 -- 172.21.15.37:0/2596142956 shutdown_connections 2024-05-30T06:53:22.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.539+0000 7fd668a00640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd6400695b0 0x7fd64006ba70 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.539+0000 7fd668a00640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd66415eb60 0x7fd6640b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.539+0000 7fd668a00640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6640cf460 0x7fd664144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.539+0000 7fd668a00640 1 --2- 172.21.15.37:0/2596142956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6640b15c0 0x7fd6640c8b00 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.539+0000 7fd668a00640 1 -- 172.21.15.37:0/2596142956 >> 172.21.15.37:0/2596142956 conn(0x7fd6640d26a0 msgr2=0x7fd664070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:22.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.539+0000 7fd668a00640 1 -- 172.21.15.37:0/2596142956 shutdown_connections 2024-05-30T06:53:22.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.539+0000 7fd668a00640 1 -- 172.21.15.37:0/2596142956 wait complete. 2024-05-30T06:53:22.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone37102 2024-05-30T06:53:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b2c00640 1 Processor -- start 2024-05-30T06:53:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b2c00640 1 -- start start 2024-05-30T06:53:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b2c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac06d130 0x7fe4ac0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b2c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe4ac0cd720 0x7fe4ac0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b2c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4ac09bca0 con 0x7fe4ac06ca70 2024-05-30T06:53:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b2c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe4ac0b1950 con 0x7fe4ac0cd720 2024-05-30T06:53:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b2c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe4ac0d17f0 con 0x7fe4ac06d130 2024-05-30T06:53:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b1800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac06d130 0x7fe4ac0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b2200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe4ac0cd720 0x7fe4ac0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b1800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac06d130 0x7fe4ac0d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:35252/0 (socket says 172.21.15.37:35252) 2024-05-30T06:53:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b1800640 1 -- 172.21.15.37:0/2351586552 learned_addr learned my addr 172.21.15.37:0/2351586552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:22.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b2200640 1 -- 172.21.15.37:0/2351586552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac06d130 msgr2=0x7fe4ac0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:22.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b2200640 1 --2- 172.21.15.37:0/2351586552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac06d130 0x7fe4ac0d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b2200640 1 -- 172.21.15.37:0/2351586552 >> v1:172.21.15.105:6789/0 conn(0x7fe4ac06ca70 legacy=0x7fe4ac06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b2200640 1 -- 172.21.15.37:0/2351586552 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ac0ccc40 con 0x7fe4ac0cd720 2024-05-30T06:53:22.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.711+0000 7fe4b1800640 1 --2- 172.21.15.37:0/2351586552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac06d130 0x7fe4ac0d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:22.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.715+0000 7fe4b2200640 1 --2- 172.21.15.37:0/2351586552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac0cd720 0x7fe4ac0cdbb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009d90 tx=0x7fe4a401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abcfcc777fb4fe78 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:22.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.715+0000 7fe4abe00640 1 -- 172.21.15.37:0/2351586552 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40b2070 con 0x7fe4ac0cd720 2024-05-30T06:53:22.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.715+0000 7fe4abe00640 1 -- 172.21.15.37:0/2351586552 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a40a58b0 con 0x7fe4ac0cd720 2024-05-30T06:53:22.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.715+0000 7fe4abe00640 1 -- 172.21.15.37:0/2351586552 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40a5c80 con 0x7fe4ac0cd720 2024-05-30T06:53:22.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.715+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2351586552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac0cd720 msgr2=0x7fe4ac0cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.715+0000 7fe4b2c00640 1 --2- 172.21.15.37:0/2351586552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac0cd720 0x7fe4ac0cdbb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009d90 tx=0x7fe4a401c8e0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.715+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2351586552 shutdown_connections 2024-05-30T06:53:22.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.715+0000 7fe4b2c00640 1 --2- 172.21.15.37:0/2351586552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac0cd720 0x7fe4ac0cdbb0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.715+0000 7fe4b2c00640 1 --2- 172.21.15.37:0/2351586552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac06d130 0x7fe4ac0d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.715+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2351586552 >> 172.21.15.37:0/2351586552 conn(0x7fe4ac0b3f40 msgr2=0x7fe4ac0b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:22.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.715+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2351586552 shutdown_connections 2024-05-30T06:53:22.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.715+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2351586552 wait complete. 2024-05-30T06:53:22.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.715+0000 7fe4b2c00640 1 Processor -- start 2024-05-30T06:53:22.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2c00640 1 -- start start 2024-05-30T06:53:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac06ca70 0x7fe4ac0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac06d130 0x7fe4ac15d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4ac0cd720 0x7fe4ac15dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ac16b600 con 0x7fe4ac0cd720 2024-05-30T06:53:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ac16b480 con 0x7fe4ac06ca70 2024-05-30T06:53:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe4ac16b780 con 0x7fe4ac06d130 2024-05-30T06:53:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4ac0cd720 0x7fe4ac15dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4ac0cd720 0x7fe4ac15dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58064/0 (socket says 172.21.15.37:58064) 2024-05-30T06:53:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2200640 1 -- 172.21.15.37:0/2113572325 learned_addr learned my addr 172.21.15.37:0/2113572325 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b1800640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac06ca70 0x7fe4ac0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b0e00640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac06d130 0x7fe4ac15d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2200640 1 -- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac06d130 msgr2=0x7fe4ac15d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2200640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac06d130 0x7fe4ac15d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2200640 1 -- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac06ca70 msgr2=0x7fe4ac0710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2200640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac06ca70 0x7fe4ac0710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2200640 1 -- 172.21.15.37:0/2113572325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ac0af5e0 con 0x7fe4ac0cd720 2024-05-30T06:53:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2200640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4ac0cd720 0x7fe4ac15dab0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40b0040 tx=0x7fe4a4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4a9600640 1 -- 172.21.15.37:0/2113572325 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40b2050 con 0x7fe4ac0cd720 2024-05-30T06:53:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4a9600640 1 -- 172.21.15.37:0/2113572325 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a40be070 con 0x7fe4ac0cd720 2024-05-30T06:53:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2113572325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ac0af8c0 con 0x7fe4ac0cd720 2024-05-30T06:53:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4a9600640 1 -- 172.21.15.37:0/2113572325 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40ad870 con 0x7fe4ac0cd720 2024-05-30T06:53:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2113572325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4ac0afe80 con 0x7fe4ac0cd720 2024-05-30T06:53:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.719+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2113572325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4ac068ab0 con 0x7fe4ac0cd720 2024-05-30T06:53:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.723+0000 7fe4a9600640 1 -- 172.21.15.37:0/2113572325 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fe4a40ada10 con 0x7fe4ac0cd720 2024-05-30T06:53:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.723+0000 7fe4a9600640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe48c069580 0x7fe48c06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.723+0000 7fe4a9600640 1 -- 172.21.15.37:0/2113572325 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7fe4a4120440 con 0x7fe4ac0cd720 2024-05-30T06:53:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.723+0000 7fe4b1800640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe48c069580 0x7fe48c06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.723+0000 7fe4b1800640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe48c069580 0x7fe48c06ba40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009630 tx=0x7fe4a0009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.727+0000 7fe4a9600640 1 -- 172.21.15.37:0/2113572325 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe4a4016560 con 0x7fe4ac0cd720 2024-05-30T06:53:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.915+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2113572325 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone37102", "target": ["mon-mgr", ""]}) -- 0x7fe4ac0c5d10 con 0x7fe48c069580 2024-05-30T06:53:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.939+0000 7fe4a9600640 1 -- 172.21.15.37:0/2113572325 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe4ac0c5d10 con 0x7fe48c069580 2024-05-30T06:53:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.939+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe48c069580 msgr2=0x7fe48c06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.939+0000 7fe4b2c00640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe48c069580 0x7fe48c06ba40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe4a0009630 tx=0x7fe4a0009240 comp rx=0 tx=0).stop 2024-05-30T06:53:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.939+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2113572325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4ac0cd720 msgr2=0x7fe4ac15dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.939+0000 7fe4b2c00640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4ac0cd720 0x7fe4ac15dab0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40b0040 tx=0x7fe4a4019680 comp rx=0 tx=0).stop 2024-05-30T06:53:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.939+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2113572325 shutdown_connections 2024-05-30T06:53:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.939+0000 7fe4b2c00640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4ac0cd720 0x7fe4ac15dab0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.939+0000 7fe4b2c00640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4ac06d130 0x7fe4ac15d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.939+0000 7fe4b2c00640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe48c069580 0x7fe48c06ba40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.939+0000 7fe4b2c00640 1 --2- 172.21.15.37:0/2113572325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4ac06ca70 0x7fe4ac0710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.939+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2113572325 >> 172.21.15.37:0/2113572325 conn(0x7fe4ac0b3f40 msgr2=0x7fe4ac0b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.939+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2113572325 shutdown_connections 2024-05-30T06:53:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:22.939+0000 7fe4b2c00640 1 -- 172.21.15.37:0/2113572325 wait complete. 2024-05-30T06:53:22.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone371011 2024-05-30T06:53:23.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc113600640 1 Processor -- start 2024-05-30T06:53:23.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc113600640 1 -- start start 2024-05-30T06:53:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc113600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc10c15c780 0x7fc10c0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc113600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc10c0b2cb0 con 0x7fc10c09b5a0 2024-05-30T06:53:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc113600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc10c0b2f90 con 0x7fc10c09aa60 2024-05-30T06:53:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc113600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc10c0b38c0 con 0x7fc10c15c780 2024-05-30T06:53:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc111600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc10c09b5a0 0x7fc10c0af410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44524/0 (socket says 172.21.15.37:44524) 2024-05-30T06:53:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc111600640 1 -- 172.21.15.37:0/229363194 learned_addr learned my addr 172.21.15.37:0/229363194 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc110c00640 1 --2- 172.21.15.37:0/229363194 >> v2:172.21.15.105:3300/0 conn(0x7fc10c15c780 0x7fc10c0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc10b400640 1 -- 172.21.15.37:0/229363194 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060701866 0 0) 0x7fc10c0b2cb0 con 0x7fc10c09b5a0 2024-05-30T06:53:23.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc10b400640 1 -- 172.21.15.37:0/229363194 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0f4003530 con 0x7fc10c09b5a0 2024-05-30T06:53:23.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc110c00640 1 -- 172.21.15.37:0/229363194 >> v1:172.21.15.105:6789/0 conn(0x7fc10c09aa60 legacy=0x7fc10c09ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:23.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc110c00640 1 -- 172.21.15.37:0/229363194 >> v1:172.21.15.37:6789/0 conn(0x7fc10c09b5a0 legacy=0x7fc10c0af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:23.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.111+0000 7fc110c00640 1 -- 172.21.15.37:0/229363194 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10c0b3270 con 0x7fc10c15c780 2024-05-30T06:53:23.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.115+0000 7fc110c00640 1 --2- 172.21.15.37:0/229363194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc10c15c780 0x7fc10c0b25d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0b3a40 tx=0x7fc10001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a0a214355f394c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:23.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.115+0000 7fc10b400640 1 -- 172.21.15.37:0/229363194 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1000b2070 con 0x7fc10c15c780 2024-05-30T06:53:23.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.115+0000 7fc10b400640 1 -- 172.21.15.37:0/229363194 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1000a5900 con 0x7fc10c15c780 2024-05-30T06:53:23.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.115+0000 7fc10b400640 1 -- 172.21.15.37:0/229363194 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1000a5cb0 con 0x7fc10c15c780 2024-05-30T06:53:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.115+0000 7fc113600640 1 -- 172.21.15.37:0/229363194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc10c15c780 msgr2=0x7fc10c0b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.115+0000 7fc113600640 1 --2- 172.21.15.37:0/229363194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc10c15c780 0x7fc10c0b25d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc10c0b3a40 tx=0x7fc10001c920 comp rx=0 tx=0).stop 2024-05-30T06:53:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.115+0000 7fc113600640 1 -- 172.21.15.37:0/229363194 shutdown_connections 2024-05-30T06:53:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.115+0000 7fc113600640 1 --2- 172.21.15.37:0/229363194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc10c15c780 0x7fc10c0b25d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.115+0000 7fc113600640 1 -- 172.21.15.37:0/229363194 >> 172.21.15.37:0/229363194 conn(0x7fc10c0d26a0 msgr2=0x7fc10c0d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.115+0000 7fc113600640 1 -- 172.21.15.37:0/229363194 shutdown_connections 2024-05-30T06:53:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.115+0000 7fc113600640 1 -- 172.21.15.37:0/229363194 wait complete. 2024-05-30T06:53:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.115+0000 7fc113600640 1 Processor -- start 2024-05-30T06:53:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.115+0000 7fc113600640 1 -- start start 2024-05-30T06:53:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc113600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc10c09aa60 0x7fc10c168150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc113600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc10c09b5a0 0x7fc10c0d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc113600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc10c15c780 0x7fc10c14d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc113600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c16a840 con 0x7fc10c09b5a0 2024-05-30T06:53:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc113600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c16a6c0 con 0x7fc10c09aa60 2024-05-30T06:53:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc113600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc10c16a9c0 con 0x7fc10c15c780 2024-05-30T06:53:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc10be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc10c09b5a0 0x7fc10c0d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc10be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc10c09b5a0 0x7fc10c0d05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58068/0 (socket says 172.21.15.37:58068) 2024-05-30T06:53:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc10be00640 1 -- 172.21.15.37:0/1659296422 learned_addr learned my addr 172.21.15.37:0/1659296422 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc110c00640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc10c09aa60 0x7fc10c168150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc111600640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc10c15c780 0x7fc10c14d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc10be00640 1 -- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc10c15c780 msgr2=0x7fc10c14d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:23.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc10be00640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc10c15c780 0x7fc10c14d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:23.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc10be00640 1 -- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc10c09aa60 msgr2=0x7fc10c168150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:23.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc10be00640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc10c09aa60 0x7fc10c168150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:23.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc10be00640 1 -- 172.21.15.37:0/1659296422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10c1670d0 con 0x7fc10c09b5a0 2024-05-30T06:53:23.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc10be00640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc10c09b5a0 0x7fc10c0d05f0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c420 tx=0x7fc0f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:23.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc108c00640 1 -- 172.21.15.37:0/1659296422 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f80052d0 con 0x7fc10c09b5a0 2024-05-30T06:53:23.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc108c00640 1 -- 172.21.15.37:0/1659296422 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f8005470 con 0x7fc10c09b5a0 2024-05-30T06:53:23.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc113600640 1 -- 172.21.15.37:0/1659296422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc10c1673b0 con 0x7fc10c09b5a0 2024-05-30T06:53:23.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc108c00640 1 -- 172.21.15.37:0/1659296422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8007260 con 0x7fc10c09b5a0 2024-05-30T06:53:23.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc113600640 1 -- 172.21.15.37:0/1659296422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc10c167c50 con 0x7fc10c09b5a0 2024-05-30T06:53:23.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.119+0000 7fc113600640 1 -- 172.21.15.37:0/1659296422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc10c068d40 con 0x7fc10c09b5a0 2024-05-30T06:53:23.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.123+0000 7fc108c00640 1 -- 172.21.15.37:0/1659296422 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fc0f8007400 con 0x7fc10c09b5a0 2024-05-30T06:53:23.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.123+0000 7fc108c00640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0ec069580 0x7fc0ec06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:23.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.123+0000 7fc108c00640 1 -- 172.21.15.37:0/1659296422 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7fc0f8084d30 con 0x7fc10c09b5a0 2024-05-30T06:53:23.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.123+0000 7fc110c00640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0ec069580 0x7fc0ec06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.123+0000 7fc110c00640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0ec069580 0x7fc0ec06ba40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc1000af000 tx=0x7fc1000a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.127+0000 7fc108c00640 1 -- 172.21.15.37:0/1659296422 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc0f8056380 con 0x7fc10c09b5a0 2024-05-30T06:53:23.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.343+0000 7fc113600640 1 -- 172.21.15.37:0/1659296422 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone371011", "target": ["mon-mgr", ""]}) -- 0x7fc10c09c080 con 0x7fc0ec069580 2024-05-30T06:53:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.367+0000 7fc108c00640 1 -- 172.21.15.37:0/1659296422 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc10c09c080 con 0x7fc0ec069580 2024-05-30T06:53:23.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.375+0000 7fc113600640 1 -- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0ec069580 msgr2=0x7fc0ec06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:23.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.375+0000 7fc113600640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0ec069580 0x7fc0ec06ba40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc1000af000 tx=0x7fc1000a7070 comp rx=0 tx=0).stop 2024-05-30T06:53:23.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.375+0000 7fc113600640 1 -- 172.21.15.37:0/1659296422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc10c09b5a0 msgr2=0x7fc10c0d05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:23.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.375+0000 7fc113600640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc10c09b5a0 0x7fc10c0d05f0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800c420 tx=0x7fc0f800c8e0 comp rx=0 tx=0).stop 2024-05-30T06:53:23.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.375+0000 7fc113600640 1 -- 172.21.15.37:0/1659296422 shutdown_connections 2024-05-30T06:53:23.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.375+0000 7fc113600640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc10c15c780 0x7fc10c14d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:23.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.375+0000 7fc113600640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc10c09b5a0 0x7fc10c0d05f0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:23.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.375+0000 7fc113600640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0ec069580 0x7fc0ec06ba40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:23.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.375+0000 7fc113600640 1 --2- 172.21.15.37:0/1659296422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc10c09aa60 0x7fc10c168150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:23.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.375+0000 7fc113600640 1 -- 172.21.15.37:0/1659296422 >> 172.21.15.37:0/1659296422 conn(0x7fc10c0d26a0 msgr2=0x7fc10c0b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:23.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.379+0000 7fc113600640 1 -- 172.21.15.37:0/1659296422 shutdown_connections 2024-05-30T06:53:23.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.379+0000 7fc113600640 1 -- 172.21.15.37:0/1659296422 wait complete. 2024-05-30T06:53:23.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone371019 2024-05-30T06:53:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.651+0000 7f5a82000640 1 Processor -- start 2024-05-30T06:53:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.651+0000 7f5a82000640 1 -- start start 2024-05-30T06:53:23.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.655+0000 7f5a82000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a7c144f00 0x7f5a7c0b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:23.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.655+0000 7f5a82000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7c072e30 con 0x7f5a7c06ef30 2024-05-30T06:53:23.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.655+0000 7f5a81600640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f5a7c0cd790 0x7f5a7c15ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:49050/0 (socket says 172.21.15.37:49050) 2024-05-30T06:53:23.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.655+0000 7f5a81600640 1 -- 172.21.15.37:0/274619549 learned_addr learned my addr 172.21.15.37:0/274619549 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:23.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.655+0000 7f5a82000640 1 -- 172.21.15.37:0/274619549 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a7c0cdc60 con 0x7f5a7c0cd790 2024-05-30T06:53:23.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.655+0000 7f5a80c00640 1 --2- 172.21.15.37:0/274619549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a7c144f00 0x7f5a7c0b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:23.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.655+0000 7f5a82000640 1 -- 172.21.15.37:0/274619549 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c0b3b50 con 0x7f5a7c144f00 2024-05-30T06:53:23.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.655+0000 7f5a7b400640 1 -- 172.21.15.37:0/274619549 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2807250553 0 0) 0x7f5a7c0cdc60 con 0x7f5a7c0cd790 2024-05-30T06:53:23.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.655+0000 7f5a7b400640 1 -- 172.21.15.37:0/274619549 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a64005740 con 0x7f5a7c0cd790 2024-05-30T06:53:23.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.655+0000 7f5a80c00640 1 -- 172.21.15.37:0/274619549 >> v1:172.21.15.105:6789/0 conn(0x7f5a7c0cd790 legacy=0x7f5a7c15ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:23.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.655+0000 7f5a80c00640 1 -- 172.21.15.37:0/274619549 >> v1:172.21.15.37:6789/0 conn(0x7f5a7c06ef30 legacy=0x7f5a7c0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:23.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.659+0000 7f5a80c00640 1 -- 172.21.15.37:0/274619549 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c0b3e30 con 0x7f5a7c144f00 2024-05-30T06:53:23.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.663+0000 7f5a80c00640 1 --2- 172.21.15.37:0/274619549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a7c144f00 0x7f5a7c0b4910 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5a680097f0 tx=0x7f5a6801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81f98b9e44968689 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.663+0000 7f5a7b400640 1 -- 172.21.15.37:0/274619549 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a680b0070 con 0x7f5a7c144f00 2024-05-30T06:53:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.663+0000 7f5a7b400640 1 -- 172.21.15.37:0/274619549 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a680ab600 con 0x7f5a7c144f00 2024-05-30T06:53:23.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.663+0000 7f5a82000640 1 -- 172.21.15.37:0/274619549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a7c144f00 msgr2=0x7f5a7c0b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:23.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.663+0000 7f5a82000640 1 --2- 172.21.15.37:0/274619549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a7c144f00 0x7f5a7c0b4910 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5a680097f0 tx=0x7f5a6801c3e0 comp rx=0 tx=0).stop 2024-05-30T06:53:23.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.663+0000 7f5a82000640 1 -- 172.21.15.37:0/274619549 shutdown_connections 2024-05-30T06:53:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.663+0000 7f5a82000640 1 --2- 172.21.15.37:0/274619549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a7c144f00 0x7f5a7c0b4910 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.663+0000 7f5a82000640 1 -- 172.21.15.37:0/274619549 >> 172.21.15.37:0/274619549 conn(0x7f5a7c0b2120 msgr2=0x7f5a7c0b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.663+0000 7f5a82000640 1 -- 172.21.15.37:0/274619549 shutdown_connections 2024-05-30T06:53:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.663+0000 7f5a82000640 1 -- 172.21.15.37:0/274619549 wait complete. 2024-05-30T06:53:23.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.667+0000 7f5a82000640 1 Processor -- start 2024-05-30T06:53:23.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.667+0000 7f5a82000640 1 -- start start 2024-05-30T06:53:23.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.667+0000 7f5a82000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a7c06ef30 0x7f5a7c15b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:23.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.667+0000 7f5a82000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a7c0cd790 0x7f5a7c074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:23.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.667+0000 7f5a82000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a7c075230 0x7f5a7c137330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.667+0000 7f5a82000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c06f720 con 0x7f5a7c06ef30 2024-05-30T06:53:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.667+0000 7f5a82000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c0b4e50 con 0x7f5a7c0cd790 2024-05-30T06:53:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.667+0000 7f5a82000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c06f8a0 con 0x7f5a7c075230 2024-05-30T06:53:23.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a81600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a7c075230 0x7f5a7c137330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:23.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a7be00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a7c0cd790 0x7f5a7c074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:23.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a81600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a7c075230 0x7f5a7c137330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:35298/0 (socket says 172.21.15.37:35298) 2024-05-30T06:53:23.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a81600640 1 -- 172.21.15.37:0/2153393139 learned_addr learned my addr 172.21.15.37:0/2153393139 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:23.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a80c00640 1 --2- 172.21.15.37:0/2153393139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a7c06ef30 0x7f5a7c15b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:23.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a81600640 1 -- 172.21.15.37:0/2153393139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a7c0cd790 msgr2=0x7f5a7c074cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:23.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a81600640 1 --2- 172.21.15.37:0/2153393139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a7c0cd790 0x7f5a7c074cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:23.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a81600640 1 -- 172.21.15.37:0/2153393139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a7c06ef30 msgr2=0x7f5a7c15b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:23.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a81600640 1 --2- 172.21.15.37:0/2153393139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a7c06ef30 0x7f5a7c15b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:23.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a81600640 1 -- 172.21.15.37:0/2153393139 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c137f10 con 0x7f5a7c075230 2024-05-30T06:53:23.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a81600640 1 --2- 172.21.15.37:0/2153393139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a7c075230 0x7f5a7c137330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400c770 tx=0x7f5a7400cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a78c00640 1 -- 172.21.15.37:0/2153393139 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74018070 con 0x7f5a7c075230 2024-05-30T06:53:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a78c00640 1 -- 172.21.15.37:0/2153393139 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7400a5e0 con 0x7f5a7c075230 2024-05-30T06:53:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a78c00640 1 -- 172.21.15.37:0/2153393139 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400a990 con 0x7f5a7c075230 2024-05-30T06:53:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a82000640 1 -- 172.21.15.37:0/2153393139 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c1381f0 con 0x7f5a7c075230 2024-05-30T06:53:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.671+0000 7f5a82000640 1 -- 172.21.15.37:0/2153393139 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7c1456f0 con 0x7f5a7c075230 2024-05-30T06:53:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.675+0000 7f5a82000640 1 -- 172.21.15.37:0/2153393139 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7c068ab0 con 0x7f5a7c075230 2024-05-30T06:53:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.675+0000 7f5a78c00640 1 -- 172.21.15.37:0/2153393139 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f5a7401b070 con 0x7f5a7c075230 2024-05-30T06:53:23.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.675+0000 7f5a78c00640 1 --2- 172.21.15.37:0/2153393139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a5c0695d0 0x7f5a5c06ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:23.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.675+0000 7f5a78c00640 1 -- 172.21.15.37:0/2153393139 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7f5a74085110 con 0x7f5a7c075230 2024-05-30T06:53:23.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.675+0000 7f5a80c00640 1 --2- 172.21.15.37:0/2153393139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a5c0695d0 0x7f5a5c06ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:23.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.679+0000 7f5a80c00640 1 --2- 172.21.15.37:0/2153393139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a5c0695d0 0x7f5a5c06ba90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5a680ad000 tx=0x7f5a680a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:23.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:23.683+0000 7f5a78c00640 1 -- 172.21.15.37:0/2153393139 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5a74056760 con 0x7f5a7c075230 2024-05-30T06:53:24.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.035+0000 7f5a82000640 1 -- 172.21.15.37:0/2153393139 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone371019", "target": ["mon-mgr", ""]}) -- 0x7f5a7c15b690 con 0x7f5a5c0695d0 2024-05-30T06:53:24.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.063+0000 7f5a78c00640 1 -- 172.21.15.37:0/2153393139 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5a680ab830 con 0x7f5a5c0695d0 2024-05-30T06:53:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.067+0000 7f5a82000640 1 -- 172.21.15.37:0/2153393139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a5c0695d0 msgr2=0x7f5a5c06ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.067+0000 7f5a82000640 1 --2- 172.21.15.37:0/2153393139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a5c0695d0 0x7f5a5c06ba90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5a680ad000 tx=0x7f5a680a6000 comp rx=0 tx=0).stop 2024-05-30T06:53:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.067+0000 7f5a82000640 1 -- 172.21.15.37:0/2153393139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a7c075230 msgr2=0x7f5a7c137330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.067+0000 7f5a82000640 1 --2- 172.21.15.37:0/2153393139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a7c075230 0x7f5a7c137330 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400c770 tx=0x7f5a7400cc30 comp rx=0 tx=0).stop 2024-05-30T06:53:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.067+0000 7f5a82000640 1 -- 172.21.15.37:0/2153393139 shutdown_connections 2024-05-30T06:53:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.067+0000 7f5a82000640 1 --2- 172.21.15.37:0/2153393139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a7c075230 0x7f5a7c137330 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.067+0000 7f5a82000640 1 --2- 172.21.15.37:0/2153393139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a5c0695d0 0x7f5a5c06ba90 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.067+0000 7f5a82000640 1 --2- 172.21.15.37:0/2153393139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a7c0cd790 0x7f5a7c074cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.067+0000 7f5a82000640 1 --2- 172.21.15.37:0/2153393139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a7c06ef30 0x7f5a7c15b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.067+0000 7f5a82000640 1 -- 172.21.15.37:0/2153393139 >> 172.21.15.37:0/2153393139 conn(0x7f5a7c0b2120 msgr2=0x7f5a7c06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.067+0000 7f5a82000640 1 -- 172.21.15.37:0/2153393139 shutdown_connections 2024-05-30T06:53:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.067+0000 7f5a82000640 1 -- 172.21.15.37:0/2153393139 wait complete. 2024-05-30T06:53:24.104 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone371014 2024-05-30T06:53:24.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.267+0000 7f2743c00640 1 Processor -- start 2024-05-30T06:53:24.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.267+0000 7f2743c00640 1 -- start start 2024-05-30T06:53:24.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.267+0000 7f2743c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f273c0cd400 0x7f273c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:24.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f2743c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f273c0ce030 con 0x7f273c1590c0 2024-05-30T06:53:24.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f2743c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f273c15f230 con 0x7f273c06f5a0 2024-05-30T06:53:24.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f2743c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f273c15f510 con 0x7f273c0cd400 2024-05-30T06:53:24.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f2741200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f273c1590c0 0x7f273c0cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44530/0 (socket says 172.21.15.37:44530) 2024-05-30T06:53:24.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f2741200640 1 -- 172.21.15.37:0/3868935393 learned_addr learned my addr 172.21.15.37:0/3868935393 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:24.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f273be00640 1 --2- 172.21.15.37:0/3868935393 >> v2:172.21.15.37:3300/0 conn(0x7f273c0cd400 0x7f273c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:24.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f273b400640 1 -- 172.21.15.37:0/3868935393 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3669464048 0 0) 0x7f273c0ce030 con 0x7f273c1590c0 2024-05-30T06:53:24.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f273b400640 1 -- 172.21.15.37:0/3868935393 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2724003530 con 0x7f273c1590c0 2024-05-30T06:53:24.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f273be00640 1 -- 172.21.15.37:0/3868935393 >> v1:172.21.15.105:6789/0 conn(0x7f273c06f5a0 legacy=0x7f273c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:24.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f273b400640 1 -- 172.21.15.37:0/3868935393 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811445910 0 0) 0x7f273c15f230 con 0x7f273c06f5a0 2024-05-30T06:53:24.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f273be00640 1 -- 172.21.15.37:0/3868935393 >> v1:172.21.15.37:6789/0 conn(0x7f273c1590c0 legacy=0x7f273c0cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:24.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f273be00640 1 -- 172.21.15.37:0/3868935393 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273c15f7f0 con 0x7f273c0cd400 2024-05-30T06:53:24.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f273be00640 1 --2- 172.21.15.37:0/3868935393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0cd400 0x7f273c06f060 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f27280097c0 tx=0x7f272801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3a2aa56aa3b815 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:24.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.271+0000 7f273b400640 1 -- 172.21.15.37:0/3868935393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27280b0070 con 0x7f273c0cd400 2024-05-30T06:53:24.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f273b400640 1 -- 172.21.15.37:0/3868935393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27280ab600 con 0x7f273c0cd400 2024-05-30T06:53:24.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f273b400640 1 -- 172.21.15.37:0/3868935393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27280ab9d0 con 0x7f273c0cd400 2024-05-30T06:53:24.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 -- 172.21.15.37:0/3868935393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0cd400 msgr2=0x7f273c06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:24.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 --2- 172.21.15.37:0/3868935393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0cd400 0x7f273c06f060 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f27280097c0 tx=0x7f272801c380 comp rx=0 tx=0).stop 2024-05-30T06:53:24.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 -- 172.21.15.37:0/3868935393 shutdown_connections 2024-05-30T06:53:24.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 --2- 172.21.15.37:0/3868935393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0cd400 0x7f273c06f060 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 -- 172.21.15.37:0/3868935393 >> 172.21.15.37:0/3868935393 conn(0x7f273c06bf60 msgr2=0x7f273c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:24.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 -- 172.21.15.37:0/3868935393 shutdown_connections 2024-05-30T06:53:24.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 -- 172.21.15.37:0/3868935393 wait complete. 2024-05-30T06:53:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 Processor -- start 2024-05-30T06:53:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 -- start start 2024-05-30T06:53:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c06f5a0 0x7f273c13ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f273c0cd400 0x7f273c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f273c1590c0 0x7f273c13b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f273c1694b0 con 0x7f273c06f5a0 2024-05-30T06:53:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f273c06f9f0 con 0x7f273c1590c0 2024-05-30T06:53:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2743c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f273c169630 con 0x7f273c0cd400 2024-05-30T06:53:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2741200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c06f5a0 0x7f273c13ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2741200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c06f5a0 0x7f273c13ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58098/0 (socket says 172.21.15.37:58098) 2024-05-30T06:53:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2741200640 1 -- 172.21.15.37:0/337393762 learned_addr learned my addr 172.21.15.37:0/337393762 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f273be00640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f273c0cd400 0x7f273c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.275+0000 7f2741c00640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f273c1590c0 0x7f273c13b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2741200640 1 -- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f273c0cd400 msgr2=0x7f273c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2741200640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f273c0cd400 0x7f273c15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2741200640 1 -- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f273c1590c0 msgr2=0x7f273c13b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2741200640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f273c1590c0 0x7f273c13b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2741200640 1 -- 172.21.15.37:0/337393762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273c15ace0 con 0x7f273c06f5a0 2024-05-30T06:53:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2741c00640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f273c1590c0 0x7f273c13b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2741200640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c06f5a0 0x7f273c13ad60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f273000c3c0 tx=0x7f273000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2738c00640 1 -- 172.21.15.37:0/337393762 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2730017070 con 0x7f273c06f5a0 2024-05-30T06:53:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2738c00640 1 -- 172.21.15.37:0/337393762 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2730005cf0 con 0x7f273c06f5a0 2024-05-30T06:53:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2738c00640 1 -- 172.21.15.37:0/337393762 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27300072f0 con 0x7f273c06f5a0 2024-05-30T06:53:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2743c00640 1 -- 172.21.15.37:0/337393762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273c15afc0 con 0x7f273c06f5a0 2024-05-30T06:53:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2743c00640 1 -- 172.21.15.37:0/337393762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273c15b580 con 0x7f273c06f5a0 2024-05-30T06:53:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2743c00640 1 -- 172.21.15.37:0/337393762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f273c068d40 con 0x7f273c06f5a0 2024-05-30T06:53:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2738c00640 1 -- 172.21.15.37:0/337393762 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f273001a070 con 0x7f273c06f5a0 2024-05-30T06:53:24.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2738c00640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f271c069580 0x7f271c06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:24.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f2738c00640 1 -- 172.21.15.37:0/337393762 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7f2730084c40 con 0x7f273c06f5a0 2024-05-30T06:53:24.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.279+0000 7f273be00640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f271c069580 0x7f271c06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:24.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.283+0000 7f273be00640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f271c069580 0x7f271c06ba40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f27280ad000 tx=0x7f27280a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:24.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.287+0000 7f2738c00640 1 -- 172.21.15.37:0/337393762 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2730056290 con 0x7f273c06f5a0 2024-05-30T06:53:24.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.659+0000 7f2743c00640 1 -- 172.21.15.37:0/337393762 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone371014", "target": ["mon-mgr", ""]}) -- 0x7f273c0cd930 con 0x7f271c069580 2024-05-30T06:53:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.703+0000 7f2738c00640 1 -- 172.21.15.37:0/337393762 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f273c0cd930 con 0x7f271c069580 2024-05-30T06:53:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.707+0000 7f2743c00640 1 -- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f271c069580 msgr2=0x7f271c06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.707+0000 7f2743c00640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f271c069580 0x7f271c06ba40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f27280ad000 tx=0x7f27280a6000 comp rx=0 tx=0).stop 2024-05-30T06:53:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.707+0000 7f2743c00640 1 -- 172.21.15.37:0/337393762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c06f5a0 msgr2=0x7f273c13ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.707+0000 7f2743c00640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c06f5a0 0x7f273c13ad60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f273000c3c0 tx=0x7f273000c880 comp rx=0 tx=0).stop 2024-05-30T06:53:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.707+0000 7f2743c00640 1 -- 172.21.15.37:0/337393762 shutdown_connections 2024-05-30T06:53:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.707+0000 7f2743c00640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f271c069580 0x7f271c06ba40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.707+0000 7f2743c00640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f273c1590c0 0x7f273c13b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.707+0000 7f2743c00640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f273c0cd400 0x7f273c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.707+0000 7f2743c00640 1 --2- 172.21.15.37:0/337393762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c06f5a0 0x7f273c13ad60 secure :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f273000c3c0 tx=0x7f273000c880 comp rx=0 tx=0).stop 2024-05-30T06:53:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.707+0000 7f2743c00640 1 -- 172.21.15.37:0/337393762 >> 172.21.15.37:0/337393762 conn(0x7f273c06bf60 msgr2=0x7f273c071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.707+0000 7f2743c00640 1 -- 172.21.15.37:0/337393762 shutdown_connections 2024-05-30T06:53:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.707+0000 7f2743c00640 1 -- 172.21.15.37:0/337393762 wait complete. 2024-05-30T06:53:24.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone371012 2024-05-30T06:53:24.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.979+0000 7f2c15000640 1 Processor -- start 2024-05-30T06:53:24.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.979+0000 7f2c15000640 1 -- start start 2024-05-30T06:53:24.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.979+0000 7f2c15000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2c100ced10 0x7f2c1006ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:24.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.979+0000 7f2c15000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c100b59d0 0x7f2c100b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:24.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.979+0000 7f2c15000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1015db00 con 0x7f2c1015cdd0 2024-05-30T06:53:24.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.979+0000 7f2c15000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2c1006df50 con 0x7f2c100ced10 2024-05-30T06:53:24.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.979+0000 7f2c15000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2c100b6370 con 0x7f2c100b59d0 2024-05-30T06:53:24.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.983+0000 7f2c0de00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2c100ced10 0x7f2c1006ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:24.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.983+0000 7f2c0de00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2c100ced10 0x7f2c1006ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:39582/0 (socket says 172.21.15.37:39582) 2024-05-30T06:53:24.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.983+0000 7f2c0de00640 1 -- 172.21.15.37:0/3202652947 learned_addr learned my addr 172.21.15.37:0/3202652947 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:24.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.983+0000 7f2c05400640 1 --2- 172.21.15.37:0/3202652947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c100b59d0 0x7f2c100b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:24.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.983+0000 7f2c0d400640 1 -- 172.21.15.37:0/3202652947 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1406736808 0 0) 0x7f2c1015db00 con 0x7f2c1015cdd0 2024-05-30T06:53:24.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.983+0000 7f2c0d400640 1 -- 172.21.15.37:0/3202652947 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf0003530 con 0x7f2c1015cdd0 2024-05-30T06:53:24.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.983+0000 7f2c05400640 1 -- 172.21.15.37:0/3202652947 >> v2:172.21.15.105:3300/0 conn(0x7f2c100ced10 msgr2=0x7f2c1006ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:24.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.983+0000 7f2c05400640 1 --2- 172.21.15.37:0/3202652947 >> v2:172.21.15.105:3300/0 conn(0x7f2c100ced10 0x7f2c1006ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.983+0000 7f2c05400640 1 -- 172.21.15.37:0/3202652947 >> v1:172.21.15.37:6789/0 conn(0x7f2c1015cdd0 legacy=0x7f2c1015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:24.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.983+0000 7f2c05400640 1 -- 172.21.15.37:0/3202652947 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1006e180 con 0x7f2c100b59d0 2024-05-30T06:53:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.987+0000 7f2c05400640 1 --2- 172.21.15.37:0/3202652947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c100b59d0 0x7f2c100b5e30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80097c0 tx=0x7f2bf801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a5136ce4a86b54 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:24.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.987+0000 7f2c0d400640 1 -- 172.21.15.37:0/3202652947 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80b0070 con 0x7f2c100b59d0 2024-05-30T06:53:24.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.987+0000 7f2c0d400640 1 -- 172.21.15.37:0/3202652947 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf80ab600 con 0x7f2c100b59d0 2024-05-30T06:53:24.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.987+0000 7f2c0d400640 1 -- 172.21.15.37:0/3202652947 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80ab9d0 con 0x7f2c100b59d0 2024-05-30T06:53:24.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.991+0000 7f2c15000640 1 -- 172.21.15.37:0/3202652947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c100b59d0 msgr2=0x7f2c100b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:24.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.991+0000 7f2c15000640 1 --2- 172.21.15.37:0/3202652947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c100b59d0 0x7f2c100b5e30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80097c0 tx=0x7f2bf801c4a0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.991+0000 7f2c15000640 1 -- 172.21.15.37:0/3202652947 shutdown_connections 2024-05-30T06:53:24.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.991+0000 7f2c15000640 1 --2- 172.21.15.37:0/3202652947 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c100b59d0 0x7f2c100b5e30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.991+0000 7f2c15000640 1 --2- 172.21.15.37:0/3202652947 >> v2:172.21.15.105:3300/0 conn(0x7f2c100ced10 0x7f2c1006ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.991+0000 7f2c15000640 1 -- 172.21.15.37:0/3202652947 >> 172.21.15.37:0/3202652947 conn(0x7f2c1006bf60 msgr2=0x7f2c100b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:24.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.991+0000 7f2c15000640 1 -- 172.21.15.37:0/3202652947 shutdown_connections 2024-05-30T06:53:24.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.991+0000 7f2c15000640 1 -- 172.21.15.37:0/3202652947 wait complete. 2024-05-30T06:53:24.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.991+0000 7f2c15000640 1 Processor -- start 2024-05-30T06:53:24.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.991+0000 7f2c15000640 1 -- start start 2024-05-30T06:53:24.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c15000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c100b59d0 0x7f2c10150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:24.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c15000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c100ced10 0x7f2c10158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:24.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c15000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c1015cdd0 0x7f2c10159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:24.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c15000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1015ea50 con 0x7f2c100b59d0 2024-05-30T06:53:24.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c15000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1015e8d0 con 0x7f2c1015cdd0 2024-05-30T06:53:24.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c15000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2c10159840 con 0x7f2c100ced10 2024-05-30T06:53:24.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c0e800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c1015cdd0 0x7f2c10159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c05400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c100ced10 0x7f2c10158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c0e800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c1015cdd0 0x7f2c10159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:39596/0 (socket says 172.21.15.37:39596) 2024-05-30T06:53:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c0de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c100b59d0 0x7f2c10150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c0e800640 1 -- 172.21.15.37:0/1733282413 learned_addr learned my addr 172.21.15.37:0/1733282413 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c0e800640 1 -- 172.21.15.37:0/1733282413 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c100ced10 msgr2=0x7f2c10158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c0e800640 1 --2- 172.21.15.37:0/1733282413 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c100ced10 0x7f2c10158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c0e800640 1 -- 172.21.15.37:0/1733282413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c100b59d0 msgr2=0x7f2c10150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c0e800640 1 --2- 172.21.15.37:0/1733282413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c100b59d0 0x7f2c10150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:24.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c0e800640 1 -- 172.21.15.37:0/1733282413 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c10159b20 con 0x7f2c1015cdd0 2024-05-30T06:53:24.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c0e800640 1 --2- 172.21.15.37:0/1733282413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c1015cdd0 0x7f2c10159170 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c430 tx=0x7f2c0800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:24.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c06a00640 1 -- 172.21.15.37:0/1733282413 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08017070 con 0x7f2c1015cdd0 2024-05-30T06:53:24.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c06a00640 1 -- 172.21.15.37:0/1733282413 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c080052f0 con 0x7f2c1015cdd0 2024-05-30T06:53:24.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.995+0000 7f2c06a00640 1 -- 172.21.15.37:0/1733282413 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08003840 con 0x7f2c1015cdd0 2024-05-30T06:53:24.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.999+0000 7f2c15000640 1 -- 172.21.15.37:0/1733282413 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c10159e00 con 0x7f2c1015cdd0 2024-05-30T06:53:24.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.999+0000 7f2c15000640 1 -- 172.21.15.37:0/1733282413 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c10151200 con 0x7f2c1015cdd0 2024-05-30T06:53:24.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:24.999+0000 7f2c15000640 1 -- 172.21.15.37:0/1733282413 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c10068d40 con 0x7f2c1015cdd0 2024-05-30T06:53:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.003+0000 7f2c06a00640 1 -- 172.21.15.37:0/1733282413 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f2c0801a070 con 0x7f2c1015cdd0 2024-05-30T06:53:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.003+0000 7f2c06a00640 1 --2- 172.21.15.37:0/1733282413 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bec069650 0x7f2bec06bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.003+0000 7f2c06a00640 1 -- 172.21.15.37:0/1733282413 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7f2c08084cd0 con 0x7f2c1015cdd0 2024-05-30T06:53:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.003+0000 7f2c0de00640 1 --2- 172.21.15.37:0/1733282413 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bec069650 0x7f2bec06bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:25.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.003+0000 7f2c0de00640 1 --2- 172.21.15.37:0/1733282413 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bec069650 0x7f2bec06bb10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2c1016c830 tx=0x7f2c0000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:25.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.007+0000 7f2c06a00640 1 -- 172.21.15.37:0/1733282413 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2c08056320 con 0x7f2c1015cdd0 2024-05-30T06:53:25.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.199+0000 7f2c15000640 1 -- 172.21.15.37:0/1733282413 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone371012", "target": ["mon-mgr", ""]}) -- 0x7f2c1006ffd0 con 0x7f2bec069650 2024-05-30T06:53:25.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.219+0000 7f2c06a00640 1 -- 172.21.15.37:0/1733282413 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2c1006ffd0 con 0x7f2bec069650 2024-05-30T06:53:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.223+0000 7f2c15000640 1 -- 172.21.15.37:0/1733282413 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bec069650 msgr2=0x7f2bec06bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.223+0000 7f2c15000640 1 --2- 172.21.15.37:0/1733282413 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bec069650 0x7f2bec06bb10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2c1016c830 tx=0x7f2c0000b040 comp rx=0 tx=0).stop 2024-05-30T06:53:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.223+0000 7f2c15000640 1 -- 172.21.15.37:0/1733282413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c1015cdd0 msgr2=0x7f2c10159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:25.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.223+0000 7f2c15000640 1 --2- 172.21.15.37:0/1733282413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c1015cdd0 0x7f2c10159170 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c430 tx=0x7f2c0800c8f0 comp rx=0 tx=0).stop 2024-05-30T06:53:25.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.223+0000 7f2c15000640 1 -- 172.21.15.37:0/1733282413 shutdown_connections 2024-05-30T06:53:25.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.223+0000 7f2c15000640 1 --2- 172.21.15.37:0/1733282413 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bec069650 0x7f2bec06bb10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:25.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.223+0000 7f2c15000640 1 --2- 172.21.15.37:0/1733282413 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c1015cdd0 0x7f2c10159170 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:25.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.223+0000 7f2c15000640 1 --2- 172.21.15.37:0/1733282413 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c100ced10 0x7f2c10158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:25.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.223+0000 7f2c15000640 1 --2- 172.21.15.37:0/1733282413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c100b59d0 0x7f2c10150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:25.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.223+0000 7f2c15000640 1 -- 172.21.15.37:0/1733282413 >> 172.21.15.37:0/1733282413 conn(0x7f2c1006bf60 msgr2=0x7f2c101601a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:25.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.223+0000 7f2c15000640 1 -- 172.21.15.37:0/1733282413 shutdown_connections 2024-05-30T06:53:25.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.223+0000 7f2c15000640 1 -- 172.21.15.37:0/1733282413 wait complete. 2024-05-30T06:53:25.242 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T06:53:25.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:53:25.302 INFO:teuthology.orchestra.run.smithi037.stdout:2 2024-05-30T06:53:25.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:53:25.312 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:53:25.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:53:25.395 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:53:25.496 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:53:25.496 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:53:25.496 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:53:25.496 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:53:25.512 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:53:25.512 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:53:25.566 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:53:25.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.855+0000 7fc710a00640 1 Processor -- start 2024-05-30T06:53:25.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.855+0000 7fc710a00640 1 -- start start 2024-05-30T06:53:25.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.859+0000 7fc710a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc70c15e9e0 0x7fc70c162ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:25.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.859+0000 7fc710a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc70c0d1150 0x7fc70c073940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:25.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.859+0000 7fc710a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc70c163530 con 0x7fc70c0b3240 2024-05-30T06:53:25.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.859+0000 7fc710a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc70c0d2470 con 0x7fc70c15e9e0 2024-05-30T06:53:25.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.859+0000 7fc710a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc70c0d1eb0 con 0x7fc70c0d1150 2024-05-30T06:53:25.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.859+0000 7fc709e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc70c15e9e0 0x7fc70c162ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:25.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.859+0000 7fc709e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc70c15e9e0 0x7fc70c162ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:39606/0 (socket says 172.21.15.37:39606) 2024-05-30T06:53:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.859+0000 7fc709e00640 1 -- 172.21.15.37:0/670698000 learned_addr learned my addr 172.21.15.37:0/670698000 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.859+0000 7fc709400640 1 --2- 172.21.15.37:0/670698000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc70c0d1150 0x7fc70c073940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.859+0000 7fc709e00640 1 -- 172.21.15.37:0/670698000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc70c0d1150 msgr2=0x7fc70c073940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.859+0000 7fc709e00640 1 --2- 172.21.15.37:0/670698000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc70c0d1150 0x7fc70c073940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.859+0000 7fc709e00640 1 -- 172.21.15.37:0/670698000 >> v1:172.21.15.105:6789/0 conn(0x7fc70c0b3240 legacy=0x7fc70c0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.859+0000 7fc709e00640 1 -- 172.21.15.37:0/670698000 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70c0d2190 con 0x7fc70c15e9e0 2024-05-30T06:53:25.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.863+0000 7fc709e00640 1 --2- 172.21.15.37:0/670698000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc70c15e9e0 0x7fc70c162ff0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009870 tx=0x7fc6fc01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c8062b5efa0097f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:25.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.863+0000 7fc708a00640 1 -- 172.21.15.37:0/670698000 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0b0070 con 0x7fc70c15e9e0 2024-05-30T06:53:25.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.863+0000 7fc708a00640 1 -- 172.21.15.37:0/670698000 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6fc0ab600 con 0x7fc70c15e9e0 2024-05-30T06:53:25.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.863+0000 7fc708a00640 1 -- 172.21.15.37:0/670698000 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0ab9d0 con 0x7fc70c15e9e0 2024-05-30T06:53:25.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.867+0000 7fc710a00640 1 -- 172.21.15.37:0/670698000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc70c15e9e0 msgr2=0x7fc70c162ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:25.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.867+0000 7fc710a00640 1 --2- 172.21.15.37:0/670698000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc70c15e9e0 0x7fc70c162ff0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009870 tx=0x7fc6fc01c4d0 comp rx=0 tx=0).stop 2024-05-30T06:53:25.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.867+0000 7fc710a00640 1 -- 172.21.15.37:0/670698000 shutdown_connections 2024-05-30T06:53:25.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.867+0000 7fc710a00640 1 --2- 172.21.15.37:0/670698000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc70c0d1150 0x7fc70c073940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:25.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.867+0000 7fc710a00640 1 --2- 172.21.15.37:0/670698000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc70c15e9e0 0x7fc70c162ff0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:25.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.867+0000 7fc710a00640 1 -- 172.21.15.37:0/670698000 >> 172.21.15.37:0/670698000 conn(0x7fc70c067930 msgr2=0x7fc70c06ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:25.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.867+0000 7fc710a00640 1 -- 172.21.15.37:0/670698000 shutdown_connections 2024-05-30T06:53:25.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.867+0000 7fc710a00640 1 -- 172.21.15.37:0/670698000 wait complete. 2024-05-30T06:53:25.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc710a00640 1 Processor -- start 2024-05-30T06:53:25.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc710a00640 1 -- start start 2024-05-30T06:53:25.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc710a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc70c0b3240 0x7fc70c15fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:25.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc710a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc70c0d1150 0x7fc70c14f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:25.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc710a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc70c15e9e0 0x7fc70c152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:25.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc710a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c0b3a60 con 0x7fc70c0d1150 2024-05-30T06:53:25.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc710a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c073e80 con 0x7fc70c15e9e0 2024-05-30T06:53:25.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc710a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc70c161f00 con 0x7fc70c0b3240 2024-05-30T06:53:25.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc709400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc70c0d1150 0x7fc70c14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:25.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc70a800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc70c15e9e0 0x7fc70c152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:25.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc709400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc70c0d1150 0x7fc70c14f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58128/0 (socket says 172.21.15.37:58128) 2024-05-30T06:53:25.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc709400640 1 -- 172.21.15.37:0/4153299710 learned_addr learned my addr 172.21.15.37:0/4153299710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:25.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc709e00640 1 --2- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc70c0b3240 0x7fc70c15fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:25.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc709e00640 1 -- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc70c15e9e0 msgr2=0x7fc70c152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:25.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc709e00640 1 --2- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc70c15e9e0 0x7fc70c152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:25.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc709e00640 1 -- 172.21.15.37:0/4153299710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc70c0d1150 msgr2=0x7fc70c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:25.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc709e00640 1 --2- 172.21.15.37:0/4153299710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc70c0d1150 0x7fc70c14f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:25.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc709e00640 1 -- 172.21.15.37:0/4153299710 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70c151000 con 0x7fc70c0b3240 2024-05-30T06:53:25.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.871+0000 7fc709e00640 1 --2- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc70c0b3240 0x7fc70c15fc20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0ab000 tx=0x7fc6fc01ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:25.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.875+0000 7fc702000640 1 -- 172.21.15.37:0/4153299710 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0ba020 con 0x7fc70c0b3240 2024-05-30T06:53:25.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.875+0000 7fc702000640 1 -- 172.21.15.37:0/4153299710 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6fc0b6420 con 0x7fc70c0b3240 2024-05-30T06:53:25.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.875+0000 7fc702000640 1 -- 172.21.15.37:0/4153299710 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0b0040 con 0x7fc70c0b3240 2024-05-30T06:53:25.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.875+0000 7fc710a00640 1 -- 172.21.15.37:0/4153299710 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc70c1618b0 con 0x7fc70c0b3240 2024-05-30T06:53:25.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.875+0000 7fc710a00640 1 -- 172.21.15.37:0/4153299710 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc70c153070 con 0x7fc70c0b3240 2024-05-30T06:53:25.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.875+0000 7fc710a00640 1 -- 172.21.15.37:0/4153299710 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc70c068b20 con 0x7fc70c0b3240 2024-05-30T06:53:25.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.879+0000 7fc702000640 1 -- 172.21.15.37:0/4153299710 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fc6fc0bd020 con 0x7fc70c0b3240 2024-05-30T06:53:25.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.879+0000 7fc702000640 1 --2- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6ec069580 0x7fc6ec06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:25.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.879+0000 7fc702000640 1 -- 172.21.15.37:0/4153299710 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7fc6fc11f860 con 0x7fc70c0b3240 2024-05-30T06:53:25.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.883+0000 7fc709400640 1 --2- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6ec069580 0x7fc6ec06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.883+0000 7fc709400640 1 --2- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6ec069580 0x7fc6ec06ba40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc70c1fb6f0 tx=0x7fc6f8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:25.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:25.887+0000 7fc702000640 1 -- 172.21.15.37:0/4153299710 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc6fc0c4030 con 0x7fc70c0b3240 2024-05-30T06:53:26.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.187+0000 7fc710a00640 1 -- 172.21.15.37:0/4153299710 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc70c0d1850 con 0x7fc70c0b3240 2024-05-30T06:53:26.191 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:26.191 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:53:20.822362+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:50:33.347094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T06:50:34.475297+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:53:26.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.191+0000 7fc702000640 1 -- 172.21.15.37:0/4153299710 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+16908 (secure 0 0 0) 0x7fc6fc016150 con 0x7fc70c0b3240 2024-05-30T06:53:26.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.195+0000 7fc710a00640 1 -- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6ec069580 msgr2=0x7fc6ec06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.195+0000 7fc710a00640 1 --2- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6ec069580 0x7fc6ec06ba40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc70c1fb6f0 tx=0x7fc6f8009190 comp rx=0 tx=0).stop 2024-05-30T06:53:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.195+0000 7fc710a00640 1 -- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc70c0b3240 msgr2=0x7fc70c15fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.195+0000 7fc710a00640 1 --2- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc70c0b3240 0x7fc70c15fc20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0ab000 tx=0x7fc6fc01ad10 comp rx=0 tx=0).stop 2024-05-30T06:53:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.195+0000 7fc710a00640 1 -- 172.21.15.37:0/4153299710 shutdown_connections 2024-05-30T06:53:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.195+0000 7fc710a00640 1 --2- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6ec069580 0x7fc6ec06ba40 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.195+0000 7fc710a00640 1 --2- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc70c15e9e0 0x7fc70c152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.195+0000 7fc710a00640 1 --2- 172.21.15.37:0/4153299710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc70c0d1150 0x7fc70c14f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.195+0000 7fc710a00640 1 --2- 172.21.15.37:0/4153299710 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc70c0b3240 0x7fc70c15fc20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.195+0000 7fc710a00640 1 -- 172.21.15.37:0/4153299710 >> 172.21.15.37:0/4153299710 conn(0x7fc70c067930 msgr2=0x7fc70c0cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.195+0000 7fc710a00640 1 -- 172.21.15.37:0/4153299710 shutdown_connections 2024-05-30T06:53:26.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.195+0000 7fc710a00640 1 -- 172.21.15.37:0/4153299710 wait complete. 2024-05-30T06:53:26.229 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:50:33.347094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:50:34.475297+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 76, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:53:26.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:53:26.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f4135c00640 1 Processor -- start 2024-05-30T06:53:26.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f4135c00640 1 -- start start 2024-05-30T06:53:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f4135c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4130155da0 0x7f41300cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f4135c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41300cd440 0x7f413006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f4135c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f413015f310 con 0x7f413006f5a0 2024-05-30T06:53:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f4135c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f41300b4760 con 0x7f4130155da0 2024-05-30T06:53:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f4135c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f413015f5f0 con 0x7f41300cd440 2024-05-30T06:53:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412f400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f413006f5a0 0x7f41300cf4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44552/0 (socket says 172.21.15.37:44552) 2024-05-30T06:53:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412f400640 1 -- 172.21.15.37:0/1324798364 learned_addr learned my addr 172.21.15.37:0/1324798364 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412e000640 1 --2- 172.21.15.37:0/1324798364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41300cd440 0x7f413006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412ea00640 1 --2- 172.21.15.37:0/1324798364 >> v2:172.21.15.105:3300/0 conn(0x7f4130155da0 0x7f41300cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600727269 0 0) 0x7f413015f310 con 0x7f413006f5a0 2024-05-30T06:53:26.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4114003530 con 0x7f413006f5a0 2024-05-30T06:53:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3365870181 0 0) 0x7f4114003530 con 0x7f413006f5a0 2024-05-30T06:53:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41300cd440 msgr2=0x7f413006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 --2- 172.21.15.37:0/1324798364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41300cd440 0x7f413006f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 >> v2:172.21.15.105:3300/0 conn(0x7f4130155da0 msgr2=0x7f41300cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 --2- 172.21.15.37:0/1324798364 >> v2:172.21.15.105:3300/0 conn(0x7f4130155da0 0x7f41300cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413015f8d0 con 0x7f413006f5a0 2024-05-30T06:53:26.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f4128001a00 con 0x7f413006f5a0 2024-05-30T06:53:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412e000640 1 --2- 172.21.15.37:0/1324798364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41300cd440 0x7f413006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 >> v1:172.21.15.37:6789/0 conn(0x7f413006f5a0 legacy=0x7f41300cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 --2- 172.21.15.37:0/1324798364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41140039c0 0x7f4114003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 --2- 172.21.15.37:0/1324798364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4114004810 0x7f4114004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 --2- 172.21.15.37:0/1324798364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41140051d0 0x7f411400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f413015f5f0 con 0x7f41140039c0 2024-05-30T06:53:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f411400e120 con 0x7f4114004810 2024-05-30T06:53:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f411400e2a0 con 0x7f41140051d0 2024-05-30T06:53:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412ea00640 1 --2- 172.21.15.37:0/1324798364 >> v2:172.21.15.105:3300/0 conn(0x7f4130155da0 0x7f41300cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412e000640 1 --2- 172.21.15.37:0/1324798364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4114004810 0x7f4114004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412f400640 1 --2- 172.21.15.37:0/1324798364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41140051d0 0x7f411400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412ea00640 1 --2- 172.21.15.37:0/1324798364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41140039c0 0x7f4114003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412e000640 1 -- 172.21.15.37:0/1324798364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41140051d0 msgr2=0x7f411400dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:26.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412e000640 1 --2- 172.21.15.37:0/1324798364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41140051d0 0x7f411400dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412e000640 1 -- 172.21.15.37:0/1324798364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41140039c0 msgr2=0x7f4114003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:26.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412e000640 1 --2- 172.21.15.37:0/1324798364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41140039c0 0x7f4114003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.455+0000 7f412e000640 1 -- 172.21.15.37:0/1324798364 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4114003530 con 0x7f4114004810 2024-05-30T06:53:26.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.459+0000 7f412e000640 1 --2- 172.21.15.37:0/1324798364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4114004810 0x7f4114004c90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f411c009cb0 tx=0x7f411c01cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c6ad0297f66195b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:26.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.459+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c0b2070 con 0x7f4114004810 2024-05-30T06:53:26.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.459+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f411c0a56b0 con 0x7f4114004810 2024-05-30T06:53:26.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.459+0000 7f412d600640 1 -- 172.21.15.37:0/1324798364 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c009880 con 0x7f4114004810 2024-05-30T06:53:26.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.459+0000 7f4135c00640 1 -- 172.21.15.37:0/1324798364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4114004810 msgr2=0x7f4114004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.459+0000 7f4135c00640 1 --2- 172.21.15.37:0/1324798364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4114004810 0x7f4114004c90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f411c009cb0 tx=0x7f411c01cc10 comp rx=0 tx=0).stop 2024-05-30T06:53:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.459+0000 7f412f400640 1 -- 172.21.15.37:0/1324798364 reap_dead start 2024-05-30T06:53:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.459+0000 7f4135c00640 1 -- 172.21.15.37:0/1324798364 shutdown_connections 2024-05-30T06:53:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.459+0000 7f4135c00640 1 -- 172.21.15.37:0/1324798364 >> 172.21.15.37:0/1324798364 conn(0x7f413006bf60 msgr2=0x7f41300b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.459+0000 7f4135c00640 1 -- 172.21.15.37:0/1324798364 shutdown_connections 2024-05-30T06:53:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.459+0000 7f4135c00640 1 -- 172.21.15.37:0/1324798364 wait complete. 2024-05-30T06:53:26.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f4135c00640 1 Processor -- start 2024-05-30T06:53:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f4135c00640 1 -- start start 2024-05-30T06:53:26.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f4135c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4114004810 0x7f41301f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f4135c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4130162040 0x7f41301eac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f4135c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f413015ded0 0x7f413015e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f4135c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f413006df50 con 0x7f4130162040 2024-05-30T06:53:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f4135c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f413006f9d0 con 0x7f413015ded0 2024-05-30T06:53:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f4135c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f413006e0d0 con 0x7f4114004810 2024-05-30T06:53:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f412e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4130162040 0x7f41301eac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f412e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4130162040 0x7f41301eac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58138/0 (socket says 172.21.15.37:58138) 2024-05-30T06:53:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f412e000640 1 -- 172.21.15.37:0/2973052936 learned_addr learned my addr 172.21.15.37:0/2973052936 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f412ea00640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4114004810 0x7f41301f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f412f400640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f413015ded0 0x7f413015e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f412e000640 1 -- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4114004810 msgr2=0x7f41301f6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f412e000640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4114004810 0x7f41301f6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f412e000640 1 -- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f413015ded0 msgr2=0x7f413015e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f412e000640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f413015ded0 0x7f413015e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f412e000640 1 -- 172.21.15.37:0/2973052936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4130156430 con 0x7f4130162040 2024-05-30T06:53:26.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f412e000640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4130162040 0x7f41301eac20 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f411c01ca40 tx=0x7f4114005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:26.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f4126a00640 1 -- 172.21.15.37:0/2973052936 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c0b2040 con 0x7f4130162040 2024-05-30T06:53:26.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f4126a00640 1 -- 172.21.15.37:0/2973052936 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f411c009400 con 0x7f4130162040 2024-05-30T06:53:26.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f4135c00640 1 -- 172.21.15.37:0/2973052936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4130156710 con 0x7f4130162040 2024-05-30T06:53:26.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f4126a00640 1 -- 172.21.15.37:0/2973052936 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411c009880 con 0x7f4130162040 2024-05-30T06:53:26.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.463+0000 7f4135c00640 1 -- 172.21.15.37:0/2973052936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4130156cd0 con 0x7f4130162040 2024-05-30T06:53:26.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.467+0000 7f4135c00640 1 -- 172.21.15.37:0/2973052936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f413015e890 con 0x7f4130162040 2024-05-30T06:53:26.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.467+0000 7f4126a00640 1 -- 172.21.15.37:0/2973052936 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f411c0c0030 con 0x7f4130162040 2024-05-30T06:53:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.467+0000 7f4126a00640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f41100695b0 0x7f411006ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.467+0000 7f4126a00640 1 -- 172.21.15.37:0/2973052936 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7f411c11eab0 con 0x7f4130162040 2024-05-30T06:53:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.467+0000 7f412ea00640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f41100695b0 0x7f411006ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.467+0000 7f412ea00640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f41100695b0 0x7f411006ba70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4120009de0 tx=0x7f4120009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:26.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.471+0000 7f4126a00640 1 -- 172.21.15.37:0/2973052936 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f411c016920 con 0x7f4130162040 2024-05-30T06:53:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.635+0000 7f4135c00640 1 -- 172.21.15.37:0/2973052936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f41300b6790 con 0x7f4130162040 2024-05-30T06:53:26.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.635+0000 7f4126a00640 1 -- 172.21.15.37:0/2973052936 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7f411c0f0470 con 0x7f4130162040 2024-05-30T06:53:26.635 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:53:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.639+0000 7f4135c00640 1 -- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f41100695b0 msgr2=0x7f411006ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.639+0000 7f4135c00640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f41100695b0 0x7f411006ba70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4120009de0 tx=0x7f4120009190 comp rx=0 tx=0).stop 2024-05-30T06:53:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.639+0000 7f4135c00640 1 -- 172.21.15.37:0/2973052936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4130162040 msgr2=0x7f41301eac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.639+0000 7f4135c00640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4130162040 0x7f41301eac20 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f411c01ca40 tx=0x7f4114005840 comp rx=0 tx=0).stop 2024-05-30T06:53:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.639+0000 7f4135c00640 1 -- 172.21.15.37:0/2973052936 shutdown_connections 2024-05-30T06:53:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.639+0000 7f4135c00640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f41100695b0 0x7f411006ba70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.639+0000 7f4135c00640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f413015ded0 0x7f413015e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.639+0000 7f4135c00640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4130162040 0x7f41301eac20 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.639+0000 7f4135c00640 1 --2- 172.21.15.37:0/2973052936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4114004810 0x7f41301f6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.639+0000 7f4135c00640 1 -- 172.21.15.37:0/2973052936 >> 172.21.15.37:0/2973052936 conn(0x7f413006bf60 msgr2=0x7f41300726d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:26.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.639+0000 7f4135c00640 1 -- 172.21.15.37:0/2973052936 shutdown_connections 2024-05-30T06:53:26.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.639+0000 7f4135c00640 1 -- 172.21.15.37:0/2973052936 wait complete. 2024-05-30T06:53:26.656 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:53:26.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0ef600640 1 Processor -- start 2024-05-30T06:53:26.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0ef600640 1 -- start start 2024-05-30T06:53:26.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0ef600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc0e806f770 0x7fc0e8166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0ef600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0e815f310 con 0x7fc0e80cd440 2024-05-30T06:53:26.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0ef600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0e815f5f0 con 0x7fc0e8155da0 2024-05-30T06:53:26.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0ef600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e80b4760 con 0x7fc0e806f770 2024-05-30T06:53:26.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0dfe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc0e80cd440 0x7fc0e806f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44558/0 (socket says 172.21.15.37:44558) 2024-05-30T06:53:26.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0dfe00640 1 -- 172.21.15.37:0/1521127394 learned_addr learned my addr 172.21.15.37:0/1521127394 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:26.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0ed600640 1 --2- 172.21.15.37:0/1521127394 >> v2:172.21.15.105:3300/0 conn(0x7fc0e806f770 0x7fc0e8166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0e7e00640 1 -- 172.21.15.37:0/1521127394 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 891353831 0 0) 0x7fc0e815f310 con 0x7fc0e80cd440 2024-05-30T06:53:26.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0e7e00640 1 -- 172.21.15.37:0/1521127394 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0cc003530 con 0x7fc0e80cd440 2024-05-30T06:53:26.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0ed600640 1 -- 172.21.15.37:0/1521127394 >> v1:172.21.15.105:6789/0 conn(0x7fc0e8155da0 legacy=0x7fc0e80cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0ed600640 1 -- 172.21.15.37:0/1521127394 >> v1:172.21.15.37:6789/0 conn(0x7fc0e80cd440 legacy=0x7fc0e806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.803+0000 7fc0ed600640 1 -- 172.21.15.37:0/1521127394 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e815f8d0 con 0x7fc0e806f770 2024-05-30T06:53:26.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.807+0000 7fc0ed600640 1 --2- 172.21.15.37:0/1521127394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e806f770 0x7fc0e8166570 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009d90 tx=0x7fc0e001c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ec13b1ac51a4801 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:26.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.807+0000 7fc0e7e00640 1 -- 172.21.15.37:0/1521127394 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e00b2070 con 0x7fc0e806f770 2024-05-30T06:53:26.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.807+0000 7fc0e7e00640 1 -- 172.21.15.37:0/1521127394 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e00a5710 con 0x7fc0e806f770 2024-05-30T06:53:26.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.807+0000 7fc0e7e00640 1 -- 172.21.15.37:0/1521127394 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e00a5ae0 con 0x7fc0e806f770 2024-05-30T06:53:26.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.807+0000 7fc0ef600640 1 -- 172.21.15.37:0/1521127394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e806f770 msgr2=0x7fc0e8166570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.807+0000 7fc0ef600640 1 --2- 172.21.15.37:0/1521127394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e806f770 0x7fc0e8166570 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009d90 tx=0x7fc0e001c850 comp rx=0 tx=0).stop 2024-05-30T06:53:26.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.807+0000 7fc0ef600640 1 -- 172.21.15.37:0/1521127394 shutdown_connections 2024-05-30T06:53:26.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.807+0000 7fc0ef600640 1 --2- 172.21.15.37:0/1521127394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e806f770 0x7fc0e8166570 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.807+0000 7fc0ef600640 1 -- 172.21.15.37:0/1521127394 >> 172.21.15.37:0/1521127394 conn(0x7fc0e806bf60 msgr2=0x7fc0e80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:26.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.807+0000 7fc0ef600640 1 -- 172.21.15.37:0/1521127394 shutdown_connections 2024-05-30T06:53:26.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.807+0000 7fc0ef600640 1 -- 172.21.15.37:0/1521127394 wait complete. 2024-05-30T06:53:26.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0ef600640 1 Processor -- start 2024-05-30T06:53:26.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0ef600640 1 -- start start 2024-05-30T06:53:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0ef600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0e806f770 0x7fc0e815e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0ef600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e8155da0 0x7fc0e814d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0ef600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e814eed0 0x7fc0e8154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0ef600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e8169a70 con 0x7fc0e8155da0 2024-05-30T06:53:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0ef600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e81698f0 con 0x7fc0e814eed0 2024-05-30T06:53:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0ef600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e8169bf0 con 0x7fc0e806f770 2024-05-30T06:53:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e8155da0 0x7fc0e814d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e8155da0 0x7fc0e814d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58140/0 (socket says 172.21.15.37:58140) 2024-05-30T06:53:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0dfe00640 1 -- 172.21.15.37:0/283147030 learned_addr learned my addr 172.21.15.37:0/283147030 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0ecc00640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0e806f770 0x7fc0e815e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0ed600640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e814eed0 0x7fc0e8154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0dfe00640 1 -- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0e806f770 msgr2=0x7fc0e815e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0dfe00640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0e806f770 0x7fc0e815e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0dfe00640 1 -- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e814eed0 msgr2=0x7fc0e8154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0dfe00640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e814eed0 0x7fc0e8154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0dfe00640 1 -- 172.21.15.37:0/283147030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e814ec00 con 0x7fc0e8155da0 2024-05-30T06:53:26.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0dfe00640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e8155da0 0x7fc0e814d0b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000c500 tx=0x7fc0d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:26.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0e5600640 1 -- 172.21.15.37:0/283147030 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0017070 con 0x7fc0e8155da0 2024-05-30T06:53:26.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0e5600640 1 -- 172.21.15.37:0/283147030 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d0005cf0 con 0x7fc0e8155da0 2024-05-30T06:53:26.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0ef600640 1 -- 172.21.15.37:0/283147030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e814e640 con 0x7fc0e8155da0 2024-05-30T06:53:26.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0e5600640 1 -- 172.21.15.37:0/283147030 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00072f0 con 0x7fc0e8155da0 2024-05-30T06:53:26.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0ef600640 1 -- 172.21.15.37:0/283147030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e814f9a0 con 0x7fc0e8155da0 2024-05-30T06:53:26.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.811+0000 7fc0ef600640 1 -- 172.21.15.37:0/283147030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e8068bc0 con 0x7fc0e8155da0 2024-05-30T06:53:26.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.815+0000 7fc0e5600640 1 -- 172.21.15.37:0/283147030 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fc0d001a070 con 0x7fc0e8155da0 2024-05-30T06:53:26.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.815+0000 7fc0e5600640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0c4069580 0x7fc0c406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:26.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.815+0000 7fc0e5600640 1 -- 172.21.15.37:0/283147030 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7fc0d0084cc0 con 0x7fc0e8155da0 2024-05-30T06:53:26.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.815+0000 7fc0ecc00640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0c4069580 0x7fc0c406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:26.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.815+0000 7fc0ecc00640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0c4069580 0x7fc0c406ba40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8001770 tx=0x7fc0d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:26.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.819+0000 7fc0e5600640 1 -- 172.21.15.37:0/283147030 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc0d0056310 con 0x7fc0e8155da0 2024-05-30T06:53:26.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0ef600640 1 -- 172.21.15.37:0/283147030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc0e806e360 con 0x7fc0e8155da0 2024-05-30T06:53:26.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0e5600640 1 -- 172.21.15.37:0/283147030 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) ==== 104+0+11 (secure 0 0 0) 0x7fc0d005a610 con 0x7fc0e8155da0 2024-05-30T06:53:26.987 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:53:26.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0ef600640 1 -- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0c4069580 msgr2=0x7fc0c406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0ef600640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0c4069580 0x7fc0c406ba40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8001770 tx=0x7fc0d8009040 comp rx=0 tx=0).stop 2024-05-30T06:53:26.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0ef600640 1 -- 172.21.15.37:0/283147030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e8155da0 msgr2=0x7fc0e814d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:26.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0ef600640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e8155da0 0x7fc0e814d0b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000c500 tx=0x7fc0d000c9c0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0ef600640 1 -- 172.21.15.37:0/283147030 shutdown_connections 2024-05-30T06:53:26.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0ef600640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0c4069580 0x7fc0c406ba40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0ef600640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e814eed0 0x7fc0e8154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0ef600640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e8155da0 0x7fc0e814d0b0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0ef600640 1 --2- 172.21.15.37:0/283147030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0e806f770 0x7fc0e815e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:26.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0ef600640 1 -- 172.21.15.37:0/283147030 >> 172.21.15.37:0/283147030 conn(0x7fc0e806bf60 msgr2=0x7fc0e8071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:26.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0ef600640 1 -- 172.21.15.37:0/283147030 shutdown_connections 2024-05-30T06:53:26.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:26.987+0000 7fc0ef600640 1 -- 172.21.15.37:0/283147030 wait complete. 2024-05-30T06:53:27.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:53:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.151+0000 7fcdce000640 1 Processor -- start 2024-05-30T06:53:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.151+0000 7fcdce000640 1 -- start start 2024-05-30T06:53:27.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.155+0000 7fcdce000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcdc80cd440 0x7fcdc806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:27.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.155+0000 7fcdce000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdc806f5a0 0x7fcdc80b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:27.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.155+0000 7fcdce000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdc815f310 con 0x7fcdc8155da0 2024-05-30T06:53:27.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.155+0000 7fcdce000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcdc815f5f0 con 0x7fcdc80cd440 2024-05-30T06:53:27.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.155+0000 7fcdce000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc815f8d0 con 0x7fcdc806f5a0 2024-05-30T06:53:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.155+0000 7fcdc7e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdc806f5a0 0x7fcdc80b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.155+0000 7fcdc7e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdc806f5a0 0x7fcdc80b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:35424/0 (socket says 172.21.15.37:35424) 2024-05-30T06:53:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.155+0000 7fcdc7e00640 1 -- 172.21.15.37:0/2198296429 learned_addr learned my addr 172.21.15.37:0/2198296429 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.155+0000 7fcdbea00640 1 --2- 172.21.15.37:0/2198296429 >> v2:172.21.15.105:3300/0 conn(0x7fcdc80cd440 0x7fcdc806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.155+0000 7fcdc7e00640 1 -- 172.21.15.37:0/2198296429 >> v2:172.21.15.105:3300/0 conn(0x7fcdc80cd440 msgr2=0x7fcdc806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.155+0000 7fcdc7e00640 1 --2- 172.21.15.37:0/2198296429 >> v2:172.21.15.105:3300/0 conn(0x7fcdc80cd440 0x7fcdc806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.155+0000 7fcdc7e00640 1 -- 172.21.15.37:0/2198296429 >> v1:172.21.15.105:6789/0 conn(0x7fcdc8155da0 legacy=0x7fcdc80cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.155+0000 7fcdc7e00640 1 -- 172.21.15.37:0/2198296429 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc815fbb0 con 0x7fcdc806f5a0 2024-05-30T06:53:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdc7e00640 1 --2- 172.21.15.37:0/2198296429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdc806f5a0 0x7fcdc80b3750 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009e50 tx=0x7fcdc001c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bda06251e2af3167 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdc6a00640 1 -- 172.21.15.37:0/2198296429 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc00a56e0 con 0x7fcdc806f5a0 2024-05-30T06:53:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdc6a00640 1 -- 172.21.15.37:0/2198296429 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc00a5880 con 0x7fcdc806f5a0 2024-05-30T06:53:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdc6a00640 1 -- 172.21.15.37:0/2198296429 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc00a5c50 con 0x7fcdc806f5a0 2024-05-30T06:53:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdce000640 1 -- 172.21.15.37:0/2198296429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdc806f5a0 msgr2=0x7fcdc80b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdce000640 1 --2- 172.21.15.37:0/2198296429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdc806f5a0 0x7fcdc80b3750 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009e50 tx=0x7fcdc001c910 comp rx=0 tx=0).stop 2024-05-30T06:53:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdce000640 1 -- 172.21.15.37:0/2198296429 shutdown_connections 2024-05-30T06:53:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdce000640 1 --2- 172.21.15.37:0/2198296429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdc806f5a0 0x7fcdc80b3750 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdce000640 1 --2- 172.21.15.37:0/2198296429 >> v2:172.21.15.105:3300/0 conn(0x7fcdc80cd440 0x7fcdc806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdce000640 1 -- 172.21.15.37:0/2198296429 >> 172.21.15.37:0/2198296429 conn(0x7fcdc806bf60 msgr2=0x7fcdc80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdce000640 1 -- 172.21.15.37:0/2198296429 shutdown_connections 2024-05-30T06:53:27.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdce000640 1 -- 172.21.15.37:0/2198296429 wait complete. 2024-05-30T06:53:27.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdce000640 1 Processor -- start 2024-05-30T06:53:27.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.159+0000 7fcdce000640 1 -- start start 2024-05-30T06:53:27.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdce000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdc806f5a0 0x7fcdc81515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdce000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc8155da0 0x7fcdc80b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdce000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc8157300 0x7fcdc815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdce000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc8168580 con 0x7fcdc8155da0 2024-05-30T06:53:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdce000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc80b46b0 con 0x7fcdc8157300 2024-05-30T06:53:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdce000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc8168700 con 0x7fcdc806f5a0 2024-05-30T06:53:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdbea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc8155da0 0x7fcdc80b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdbea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc8155da0 0x7fcdc80b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58144/0 (socket says 172.21.15.37:58144) 2024-05-30T06:53:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdbea00640 1 -- 172.21.15.37:0/2106904922 learned_addr learned my addr 172.21.15.37:0/2106904922 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdc7e00640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc8157300 0x7fcdc815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdc7400640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdc806f5a0 0x7fcdc81515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdbea00640 1 -- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdc806f5a0 msgr2=0x7fcdc81515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:27.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdbea00640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdc806f5a0 0x7fcdc81515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdbea00640 1 -- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc8157300 msgr2=0x7fcdc815bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:27.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdbea00640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc8157300 0x7fcdc815bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdbea00640 1 -- 172.21.15.37:0/2106904922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc815d5a0 con 0x7fcdc8155da0 2024-05-30T06:53:27.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdbea00640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc8155da0 0x7fcdc80b10b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000e960 tx=0x7fcdb000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:27.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdbfe00640 1 -- 172.21.15.37:0/2106904922 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0017070 con 0x7fcdc8155da0 2024-05-30T06:53:27.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdbfe00640 1 -- 172.21.15.37:0/2106904922 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb000c9a0 con 0x7fcdc8155da0 2024-05-30T06:53:27.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdbfe00640 1 -- 172.21.15.37:0/2106904922 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb000cd50 con 0x7fcdc8155da0 2024-05-30T06:53:27.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdce000640 1 -- 172.21.15.37:0/2106904922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc815d840 con 0x7fcdc8155da0 2024-05-30T06:53:27.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdce000640 1 -- 172.21.15.37:0/2106904922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc80b1770 con 0x7fcdc8155da0 2024-05-30T06:53:27.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdce000640 1 -- 172.21.15.37:0/2106904922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdc8068bc0 con 0x7fcdc8155da0 2024-05-30T06:53:27.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.163+0000 7fcdbfe00640 1 -- 172.21.15.37:0/2106904922 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fcdb001a070 con 0x7fcdc8155da0 2024-05-30T06:53:27.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.167+0000 7fcdbfe00640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcda40695b0 0x7fcda406ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:27.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.167+0000 7fcdbfe00640 1 -- 172.21.15.37:0/2106904922 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7fcdb0085860 con 0x7fcdc8155da0 2024-05-30T06:53:27.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.167+0000 7fcdc7400640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcda40695b0 0x7fcda406ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:27.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.167+0000 7fcdc7400640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcda40695b0 0x7fcda406ba70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcdc81664a0 tx=0x7fcdb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:27.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.171+0000 7fcdbfe00640 1 -- 172.21.15.37:0/2106904922 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcdb0056e90 con 0x7fcdc8155da0 2024-05-30T06:53:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.367+0000 7fcdce000640 1 -- 172.21.15.37:0/2106904922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcdc80b6790 con 0x7fcdc8155da0 2024-05-30T06:53:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.367+0000 7fcdbfe00640 1 -- 172.21.15.37:0/2106904922 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) ==== 100+0+11 (secure 0 0 0) 0x7fcdb005b190 con 0x7fcdc8155da0 2024-05-30T06:53:27.368 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:53:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.371+0000 7fcdce000640 1 -- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcda40695b0 msgr2=0x7fcda406ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.371+0000 7fcdce000640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcda40695b0 0x7fcda406ba70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcdc81664a0 tx=0x7fcdb8009040 comp rx=0 tx=0).stop 2024-05-30T06:53:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.371+0000 7fcdce000640 1 -- 172.21.15.37:0/2106904922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc8155da0 msgr2=0x7fcdc80b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.371+0000 7fcdce000640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc8155da0 0x7fcdc80b10b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000e960 tx=0x7fcdb000ee20 comp rx=0 tx=0).stop 2024-05-30T06:53:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.371+0000 7fcdce000640 1 -- 172.21.15.37:0/2106904922 shutdown_connections 2024-05-30T06:53:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.371+0000 7fcdce000640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcda40695b0 0x7fcda406ba70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.371+0000 7fcdce000640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdc8157300 0x7fcdc815bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.371+0000 7fcdce000640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc8155da0 0x7fcdc80b10b0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.371+0000 7fcdce000640 1 --2- 172.21.15.37:0/2106904922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdc806f5a0 0x7fcdc81515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.371+0000 7fcdce000640 1 -- 172.21.15.37:0/2106904922 >> 172.21.15.37:0/2106904922 conn(0x7fcdc806bf60 msgr2=0x7fcdc81656a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.371+0000 7fcdce000640 1 -- 172.21.15.37:0/2106904922 shutdown_connections 2024-05-30T06:53:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.371+0000 7fcdce000640 1 -- 172.21.15.37:0/2106904922 wait complete. 2024-05-30T06:53:27.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T06:53:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.635+0000 7f4ceb800640 1 Processor -- start 2024-05-30T06:53:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.635+0000 7f4ceb800640 1 -- start start 2024-05-30T06:53:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.635+0000 7f4ceb800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4ce40d03c0 0x7f4ce409aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.635+0000 7f4ceb800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce40b14b0 0x7f4ce409afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.639+0000 7f4ceb800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ce409bb80 con 0x7f4ce415c870 2024-05-30T06:53:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.639+0000 7f4ceb800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4ce40cd110 con 0x7f4ce40d03c0 2024-05-30T06:53:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.639+0000 7f4ceb800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce409be60 con 0x7f4ce40b14b0 2024-05-30T06:53:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.639+0000 7f4ce8e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f4ce415c870 0x7f4ce40cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:38224/0 (socket says 172.21.15.37:38224) 2024-05-30T06:53:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.639+0000 7f4ce8e00640 1 -- 172.21.15.37:0/2666544535 learned_addr learned my addr 172.21.15.37:0/2666544535 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.639+0000 7f4ce3e00640 1 --2- 172.21.15.37:0/2666544535 >> v2:172.21.15.37:3300/0 conn(0x7f4ce40d03c0 0x7f4ce409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.639+0000 7f4ce3e00640 1 -- 172.21.15.37:0/2666544535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce40b14b0 msgr2=0x7f4ce409afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.639+0000 7f4ce3e00640 1 --2- 172.21.15.37:0/2666544535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce40b14b0 0x7f4ce409afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.639+0000 7f4ce3e00640 1 -- 172.21.15.37:0/2666544535 >> v1:172.21.15.105:6789/0 conn(0x7f4ce415c870 legacy=0x7f4ce40cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.639+0000 7f4ce3e00640 1 -- 172.21.15.37:0/2666544535 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce40cd340 con 0x7f4ce40d03c0 2024-05-30T06:53:27.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.643+0000 7f4ce3e00640 1 --2- 172.21.15.37:0/2666544535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce40d03c0 0x7f4ce409aa60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40097c0 tx=0x7f4cd401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26bfab22c7faca84 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.647+0000 7f4ce3400640 1 -- 172.21.15.37:0/2666544535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40b0070 con 0x7f4ce40d03c0 2024-05-30T06:53:27.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.647+0000 7f4ce3400640 1 -- 172.21.15.37:0/2666544535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd40ab600 con 0x7f4ce40d03c0 2024-05-30T06:53:27.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.647+0000 7f4ce3400640 1 -- 172.21.15.37:0/2666544535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40ab9d0 con 0x7f4ce40d03c0 2024-05-30T06:53:27.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.647+0000 7f4ceb800640 1 -- 172.21.15.37:0/2666544535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce40d03c0 msgr2=0x7f4ce409aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:27.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.647+0000 7f4ceb800640 1 --2- 172.21.15.37:0/2666544535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce40d03c0 0x7f4ce409aa60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40097c0 tx=0x7f4cd401c330 comp rx=0 tx=0).stop 2024-05-30T06:53:27.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.647+0000 7f4ceb800640 1 -- 172.21.15.37:0/2666544535 shutdown_connections 2024-05-30T06:53:27.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.647+0000 7f4ceb800640 1 --2- 172.21.15.37:0/2666544535 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce40b14b0 0x7f4ce409afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.647+0000 7f4ceb800640 1 --2- 172.21.15.37:0/2666544535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce40d03c0 0x7f4ce409aa60 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.647+0000 7f4ceb800640 1 -- 172.21.15.37:0/2666544535 >> 172.21.15.37:0/2666544535 conn(0x7f4ce40b4060 msgr2=0x7f4ce40b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:27.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.647+0000 7f4ceb800640 1 -- 172.21.15.37:0/2666544535 shutdown_connections 2024-05-30T06:53:27.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.647+0000 7f4ceb800640 1 -- 172.21.15.37:0/2666544535 wait complete. 2024-05-30T06:53:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ceb800640 1 Processor -- start 2024-05-30T06:53:27.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ceb800640 1 -- start start 2024-05-30T06:53:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ceb800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce40b14b0 0x7f4ce40c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ceb800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce40d03c0 0x7f4ce40b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:27.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ceb800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ce415c870 0x7f4ce4159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ceb800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce406ca70 con 0x7f4ce40b14b0 2024-05-30T06:53:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ceb800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce40ce530 con 0x7f4ce415c870 2024-05-30T06:53:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ceb800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce406cbf0 con 0x7f4ce40d03c0 2024-05-30T06:53:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ce8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce40b14b0 0x7f4ce40c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ce3e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce40d03c0 0x7f4ce40b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ce8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce40b14b0 0x7f4ce40c5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56780/0 (socket says 172.21.15.37:56780) 2024-05-30T06:53:27.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ce8e00640 1 -- 172.21.15.37:0/2634624862 learned_addr learned my addr 172.21.15.37:0/2634624862 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:27.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ce9800640 1 --2- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ce415c870 0x7f4ce4159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:27.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ce3e00640 1 -- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ce415c870 msgr2=0x7f4ce4159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:27.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ce3e00640 1 --2- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ce415c870 0x7f4ce4159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ce3e00640 1 -- 172.21.15.37:0/2634624862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce40b14b0 msgr2=0x7f4ce40c5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:27.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ce3e00640 1 --2- 172.21.15.37:0/2634624862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce40b14b0 0x7f4ce40c5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ce3e00640 1 -- 172.21.15.37:0/2634624862 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce415be90 con 0x7f4ce40d03c0 2024-05-30T06:53:27.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.651+0000 7f4ce3e00640 1 --2- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce40d03c0 0x7f4ce40b3140 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40ab000 tx=0x7f4cd40190d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:27.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.655+0000 7f4ce0c00640 1 -- 172.21.15.37:0/2634624862 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40b9070 con 0x7f4ce40d03c0 2024-05-30T06:53:27.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.655+0000 7f4ce0c00640 1 -- 172.21.15.37:0/2634624862 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd40b5680 con 0x7f4ce40d03c0 2024-05-30T06:53:27.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.655+0000 7f4ceb800640 1 -- 172.21.15.37:0/2634624862 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce40b2660 con 0x7f4ce40d03c0 2024-05-30T06:53:27.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.655+0000 7f4ce0c00640 1 -- 172.21.15.37:0/2634624862 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40b9070 con 0x7f4ce40d03c0 2024-05-30T06:53:27.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.655+0000 7f4ceb800640 1 -- 172.21.15.37:0/2634624862 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce415a4a0 con 0x7f4ce40d03c0 2024-05-30T06:53:27.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.655+0000 7f4ceb800640 1 -- 172.21.15.37:0/2634624862 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cbc0052a0 con 0x7f4ce40d03c0 2024-05-30T06:53:27.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.659+0000 7f4ce0c00640 1 -- 172.21.15.37:0/2634624862 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f4cd40bc070 con 0x7f4ce40d03c0 2024-05-30T06:53:27.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.659+0000 7f4ce0c00640 1 --2- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cc0069780 0x7f4cc006bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:27.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.659+0000 7f4ce0c00640 1 -- 172.21.15.37:0/2634624862 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7f4cd411fc30 con 0x7f4ce40d03c0 2024-05-30T06:53:27.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.659+0000 7f4ce8e00640 1 --2- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cc0069780 0x7f4cc006bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:27.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.663+0000 7f4ce8e00640 1 --2- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cc0069780 0x7f4cc006bc40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc000f90 tx=0x7f4cdc0018d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:27.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.667+0000 7f4ce0c00640 1 -- 172.21.15.37:0/2634624862 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4cd40c3030 con 0x7f4ce40d03c0 2024-05-30T06:53:27.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.863+0000 7f4ceb800640 1 -- 172.21.15.37:0/2634624862 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4cbc005590 con 0x7f4ce40d03c0 2024-05-30T06:53:27.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.867+0000 7f4ce0c00640 1 -- 172.21.15.37:0/2634624862 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) ==== 80+0+0 (secure 0 0 0) 0x7f4cd4015fb0 con 0x7f4ce40d03c0 2024-05-30T06:53:27.865 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-30T06:53:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.867+0000 7f4ceb800640 1 -- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cc0069780 msgr2=0x7f4cc006bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:27.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.867+0000 7f4ceb800640 1 --2- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cc0069780 0x7f4cc006bc40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc000f90 tx=0x7f4cdc0018d0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.867+0000 7f4ceb800640 1 -- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce40d03c0 msgr2=0x7f4ce40b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.867+0000 7f4ceb800640 1 --2- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce40d03c0 0x7f4ce40b3140 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40ab000 tx=0x7f4cd40190d0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.867+0000 7f4ceb800640 1 -- 172.21.15.37:0/2634624862 shutdown_connections 2024-05-30T06:53:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.867+0000 7f4ceb800640 1 --2- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4cc0069780 0x7f4cc006bc40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.867+0000 7f4ceb800640 1 --2- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ce415c870 0x7f4ce4159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.867+0000 7f4ceb800640 1 --2- 172.21.15.37:0/2634624862 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ce40d03c0 0x7f4ce40b3140 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.867+0000 7f4ceb800640 1 --2- 172.21.15.37:0/2634624862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce40b14b0 0x7f4ce40c5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.867+0000 7f4ceb800640 1 -- 172.21.15.37:0/2634624862 >> 172.21.15.37:0/2634624862 conn(0x7f4ce40b4060 msgr2=0x7f4ce4070870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.867+0000 7f4ceb800640 1 -- 172.21.15.37:0/2634624862 shutdown_connections 2024-05-30T06:53:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:27.867+0000 7f4ceb800640 1 -- 172.21.15.37:0/2634624862 wait complete. 2024-05-30T06:53:27.888 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T06:53:27.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:53:27.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-30T06:53:27.932 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:53:27.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:53:27.933 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T06:53:27.985 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:53:27.985 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:53:27.985 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:53:27.994 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:53:27.994 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:53:27.994 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:53:27.994 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:53:28.041 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:53:28.041 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:53:28.041 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:53:28.042 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:53:28.050 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:53:28.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:53:28.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d76400640 1 Processor -- start 2024-05-30T06:53:28.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d76400640 1 -- start start 2024-05-30T06:53:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d76400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d70161fc0 0x7f8d700d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d76400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8d7006d480 0x7f8d700ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d76400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d7006dc60 con 0x7f8d700ccff0 2024-05-30T06:53:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d76400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8d700d10c0 con 0x7f8d7006d480 2024-05-30T06:53:28.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d76400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8d700d0790 con 0x7f8d70161fc0 2024-05-30T06:53:28.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d75a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8d700ccff0 0x7f8d7009aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41890/0 (socket says 172.21.15.37:41890) 2024-05-30T06:53:28.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d75a00640 1 -- 172.21.15.37:0/3024852994 learned_addr learned my addr 172.21.15.37:0/3024852994 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:28.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d6fe00640 1 --2- 172.21.15.37:0/3024852994 >> v2:172.21.15.105:3300/0 conn(0x7f8d7006d480 0x7f8d700ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d75000640 1 --2- 172.21.15.37:0/3024852994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d70161fc0 0x7f8d700d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d6f400640 1 -- 172.21.15.37:0/3024852994 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1718720666 0 0) 0x7f8d7006dc60 con 0x7f8d700ccff0 2024-05-30T06:53:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d6f400640 1 -- 172.21.15.37:0/3024852994 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d58003530 con 0x7f8d700ccff0 2024-05-30T06:53:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d75000640 1 -- 172.21.15.37:0/3024852994 >> v2:172.21.15.105:3300/0 conn(0x7f8d7006d480 msgr2=0x7f8d700ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d75000640 1 --2- 172.21.15.37:0/3024852994 >> v2:172.21.15.105:3300/0 conn(0x7f8d7006d480 0x7f8d700ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d75000640 1 -- 172.21.15.37:0/3024852994 >> v1:172.21.15.37:6789/0 conn(0x7f8d700ccff0 legacy=0x7f8d7009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.227+0000 7f8d75000640 1 -- 172.21.15.37:0/3024852994 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d700d0a70 con 0x7f8d70161fc0 2024-05-30T06:53:28.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.231+0000 7f8d75000640 1 --2- 172.21.15.37:0/3024852994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d70161fc0 0x7f8d700d1550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8d640097c0 tx=0x7f8d6401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6a68d140658cc53 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:28.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.231+0000 7f8d6f400640 1 -- 172.21.15.37:0/3024852994 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d640b0070 con 0x7f8d70161fc0 2024-05-30T06:53:28.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.231+0000 7f8d6f400640 1 -- 172.21.15.37:0/3024852994 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d640ab600 con 0x7f8d70161fc0 2024-05-30T06:53:28.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.231+0000 7f8d6f400640 1 -- 172.21.15.37:0/3024852994 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d640ab9d0 con 0x7f8d70161fc0 2024-05-30T06:53:28.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.231+0000 7f8d76400640 1 -- 172.21.15.37:0/3024852994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d70161fc0 msgr2=0x7f8d700d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.231+0000 7f8d76400640 1 --2- 172.21.15.37:0/3024852994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d70161fc0 0x7f8d700d1550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8d640097c0 tx=0x7f8d6401c4a0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.231+0000 7f8d76400640 1 -- 172.21.15.37:0/3024852994 shutdown_connections 2024-05-30T06:53:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.231+0000 7f8d76400640 1 --2- 172.21.15.37:0/3024852994 >> v2:172.21.15.105:3300/0 conn(0x7f8d7006d480 0x7f8d700ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.231+0000 7f8d76400640 1 --2- 172.21.15.37:0/3024852994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d70161fc0 0x7f8d700d1550 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.231+0000 7f8d76400640 1 -- 172.21.15.37:0/3024852994 >> 172.21.15.37:0/3024852994 conn(0x7f8d700b3f50 msgr2=0x7f8d700b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.231+0000 7f8d76400640 1 -- 172.21.15.37:0/3024852994 shutdown_connections 2024-05-30T06:53:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.231+0000 7f8d76400640 1 -- 172.21.15.37:0/3024852994 wait complete. 2024-05-30T06:53:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d76400640 1 Processor -- start 2024-05-30T06:53:28.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d76400640 1 -- start start 2024-05-30T06:53:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d76400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d7006d480 0x7f8d700b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d76400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d700ccff0 0x7f8d700c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d76400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d70161fc0 0x7f8d700ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d76400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7016bc40 con 0x7f8d700ccff0 2024-05-30T06:53:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d76400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7016bac0 con 0x7f8d70161fc0 2024-05-30T06:53:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d76400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7016bdc0 con 0x7f8d7006d480 2024-05-30T06:53:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d6fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d700ccff0 0x7f8d700c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d6fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d700ccff0 0x7f8d700c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56790/0 (socket says 172.21.15.37:56790) 2024-05-30T06:53:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d6fe00640 1 -- 172.21.15.37:0/169948287 learned_addr learned my addr 172.21.15.37:0/169948287 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d75000640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d7006d480 0x7f8d700b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d75a00640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d70161fc0 0x7f8d700ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d6fe00640 1 -- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d7006d480 msgr2=0x7f8d700b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d6fe00640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d7006d480 0x7f8d700b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d6fe00640 1 -- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d70161fc0 msgr2=0x7f8d700ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d6fe00640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d70161fc0 0x7f8d700ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d6fe00640 1 -- 172.21.15.37:0/169948287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d700c8660 con 0x7f8d700ccff0 2024-05-30T06:53:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d75a00640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d70161fc0 0x7f8d700ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d6fe00640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d700ccff0 0x7f8d700c75c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00e960 tx=0x7f8d5c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d6cc00640 1 -- 172.21.15.37:0/169948287 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c017070 con 0x7f8d700ccff0 2024-05-30T06:53:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d6cc00640 1 -- 172.21.15.37:0/169948287 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5c00ca00 con 0x7f8d700ccff0 2024-05-30T06:53:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d6cc00640 1 -- 172.21.15.37:0/169948287 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c00cdb0 con 0x7f8d700ccff0 2024-05-30T06:53:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d76400640 1 -- 172.21.15.37:0/169948287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d700c80a0 con 0x7f8d700ccff0 2024-05-30T06:53:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d76400640 1 -- 172.21.15.37:0/169948287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d700ca3a0 con 0x7f8d700ccff0 2024-05-30T06:53:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.235+0000 7f8d76400640 1 -- 172.21.15.37:0/169948287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d70068ab0 con 0x7f8d700ccff0 2024-05-30T06:53:28.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.239+0000 7f8d6cc00640 1 -- 172.21.15.37:0/169948287 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f8d5c01a070 con 0x7f8d700ccff0 2024-05-30T06:53:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.239+0000 7f8d6cc00640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8d50069580 0x7f8d5006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.239+0000 7f8d6cc00640 1 -- 172.21.15.37:0/169948287 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7f8d5c085cf0 con 0x7f8d700ccff0 2024-05-30T06:53:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.239+0000 7f8d75000640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8d50069580 0x7f8d5006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.239+0000 7f8d75000640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8d50069580 0x7f8d5006ba40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8d640ad000 tx=0x7f8d640a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.243+0000 7f8d6cc00640 1 -- 172.21.15.37:0/169948287 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8d5c0579d0 con 0x7f8d700ccff0 2024-05-30T06:53:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.439+0000 7f8d76400640 1 -- 172.21.15.37:0/169948287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d700d1ef0 con 0x7f8d700ccff0 2024-05-30T06:53:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.443+0000 7f8d6cc00640 1 -- 172.21.15.37:0/169948287 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5186 (secure 0 0 0) 0x7f8d5c0572d0 con 0x7f8d700ccff0 2024-05-30T06:53:28.441 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:28.441 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6086,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/855324379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":855324379},{"type":"v1","addr":"172.21.15.105:6836","nonce":855324379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6089,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3353563250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3353563250},{"type":"v1","addr":"172.21.15.105:6837","nonce":3353563250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6933,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1946331427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1946331427},{"type":"v1","addr":"172.21.15.37:6834","nonce":1946331427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:50:35.512352+0000","modified":"2024-05-30T06:50:38.536531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3396138806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3396138806},{"type":"v1","addr":"172.21.15.37:6835","nonce":3396138806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6939,"qdb_cluster":[6939]},"id":5}]} 2024-05-30T06:53:28.441 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 47 2024-05-30T06:53:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.443+0000 7f8d76400640 1 -- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8d50069580 msgr2=0x7f8d5006ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.443+0000 7f8d76400640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8d50069580 0x7f8d5006ba40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8d640ad000 tx=0x7f8d640a6000 comp rx=0 tx=0).stop 2024-05-30T06:53:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.443+0000 7f8d76400640 1 -- 172.21.15.37:0/169948287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d700ccff0 msgr2=0x7f8d700c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.443+0000 7f8d76400640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d700ccff0 0x7f8d700c75c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00e960 tx=0x7f8d5c00ee20 comp rx=0 tx=0).stop 2024-05-30T06:53:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.443+0000 7f8d76400640 1 -- 172.21.15.37:0/169948287 shutdown_connections 2024-05-30T06:53:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.443+0000 7f8d76400640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8d50069580 0x7f8d5006ba40 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.443+0000 7f8d76400640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d70161fc0 0x7f8d700ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.443+0000 7f8d76400640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d700ccff0 0x7f8d700c75c0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.443+0000 7f8d76400640 1 --2- 172.21.15.37:0/169948287 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d7006d480 0x7f8d700b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.443+0000 7f8d76400640 1 -- 172.21.15.37:0/169948287 >> 172.21.15.37:0/169948287 conn(0x7f8d700b3f50 msgr2=0x7f8d7006ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.443+0000 7f8d76400640 1 -- 172.21.15.37:0/169948287 shutdown_connections 2024-05-30T06:53:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.443+0000 7f8d76400640 1 -- 172.21.15.37:0/169948287 wait complete. 2024-05-30T06:53:28.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:53:28.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.603+0000 7f300f800640 1 Processor -- start 2024-05-30T06:53:28.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.603+0000 7f300f800640 1 -- start start 2024-05-30T06:53:28.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.607+0000 7f300f800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f30080b55a0 0x7f30080b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.607+0000 7f300f800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f300815fb30 0x7f30080aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.607+0000 7f300f800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3008162f70 con 0x7f300806d080 2024-05-30T06:53:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.607+0000 7f300f800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f30080b5ec0 con 0x7f30080b55a0 2024-05-30T06:53:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.607+0000 7f300f800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3008163210 con 0x7f300815fb30 2024-05-30T06:53:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.607+0000 7f300ce00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f30080b55a0 0x7f30080b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.607+0000 7f300ce00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f30080b55a0 0x7f30080b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56794/0 (socket says 172.21.15.37:56794) 2024-05-30T06:53:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.607+0000 7f300ce00640 1 -- 172.21.15.37:0/2450823754 learned_addr learned my addr 172.21.15.37:0/2450823754 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:28.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.607+0000 7f300ce00640 1 -- 172.21.15.37:0/2450823754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f300815fb30 msgr2=0x7f30080aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:28.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.607+0000 7f300ce00640 1 --2- 172.21.15.37:0/2450823754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f300815fb30 0x7f30080aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.607+0000 7f300ce00640 1 -- 172.21.15.37:0/2450823754 >> v1:172.21.15.37:6789/0 conn(0x7f300806d080 legacy=0x7f30080b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.607+0000 7f300ce00640 1 -- 172.21.15.37:0/2450823754 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30080b4040 con 0x7f30080b55a0 2024-05-30T06:53:28.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300ce00640 1 --2- 172.21.15.37:0/2450823754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30080b55a0 0x7f30080b5980 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009870 tx=0x7f2ffc01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d92d9bc7524c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:28.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f3007400640 1 -- 172.21.15.37:0/2450823754 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc0b1070 con 0x7f30080b55a0 2024-05-30T06:53:28.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f3007400640 1 -- 172.21.15.37:0/2450823754 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ffc0ac630 con 0x7f30080b55a0 2024-05-30T06:53:28.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f3007400640 1 -- 172.21.15.37:0/2450823754 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc0a8050 con 0x7f30080b55a0 2024-05-30T06:53:28.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 -- 172.21.15.37:0/2450823754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30080b55a0 msgr2=0x7f30080b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 --2- 172.21.15.37:0/2450823754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30080b55a0 0x7f30080b5980 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009870 tx=0x7f2ffc01c4c0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 -- 172.21.15.37:0/2450823754 shutdown_connections 2024-05-30T06:53:28.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 --2- 172.21.15.37:0/2450823754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f300815fb30 0x7f30080aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 --2- 172.21.15.37:0/2450823754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30080b55a0 0x7f30080b5980 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 -- 172.21.15.37:0/2450823754 >> 172.21.15.37:0/2450823754 conn(0x7f3008073680 msgr2=0x7f300806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:28.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 -- 172.21.15.37:0/2450823754 shutdown_connections 2024-05-30T06:53:28.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 -- 172.21.15.37:0/2450823754 wait complete. 2024-05-30T06:53:28.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 Processor -- start 2024-05-30T06:53:28.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 -- start start 2024-05-30T06:53:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f300806d080 0x7f30081497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30080b55a0 0x7f3008160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300815fb30 0x7f30080b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f30080b07c0 con 0x7f300815fb30 2024-05-30T06:53:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f30080b0640 con 0x7f300806d080 2024-05-30T06:53:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.611+0000 7f300f800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f300816be60 con 0x7f30080b55a0 2024-05-30T06:53:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f300d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300815fb30 0x7f30080b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f300d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300815fb30 0x7f30080b1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56810/0 (socket says 172.21.15.37:56810) 2024-05-30T06:53:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f300d800640 1 -- 172.21.15.37:0/37784739 learned_addr learned my addr 172.21.15.37:0/37784739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f300ce00640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f300806d080 0x7f30081497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f3007e00640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30080b55a0 0x7f3008160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f300d800640 1 -- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30080b55a0 msgr2=0x7f3008160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f300d800640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30080b55a0 0x7f3008160fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f300d800640 1 -- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f300806d080 msgr2=0x7f30081497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f300d800640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f300806d080 0x7f30081497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f300d800640 1 -- 172.21.15.37:0/37784739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300814b800 con 0x7f300815fb30 2024-05-30T06:53:28.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f300d800640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300815fb30 0x7f30080b1500 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f300000be80 tx=0x7f300000bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:28.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f3004c00640 1 -- 172.21.15.37:0/37784739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000019070 con 0x7f300815fb30 2024-05-30T06:53:28.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f3004c00640 1 -- 172.21.15.37:0/37784739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3000014440 con 0x7f300815fb30 2024-05-30T06:53:28.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f300f800640 1 -- 172.21.15.37:0/37784739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300814a350 con 0x7f300815fb30 2024-05-30T06:53:28.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f3004c00640 1 -- 172.21.15.37:0/37784739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000014830 con 0x7f300815fb30 2024-05-30T06:53:28.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f300f800640 1 -- 172.21.15.37:0/37784739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f300814a910 con 0x7f300815fb30 2024-05-30T06:53:28.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f300f800640 1 -- 172.21.15.37:0/37784739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3008068b20 con 0x7f300815fb30 2024-05-30T06:53:28.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f3004c00640 1 -- 172.21.15.37:0/37784739 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f300001c070 con 0x7f300815fb30 2024-05-30T06:53:28.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.615+0000 7f3004c00640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2fe8069580 0x7f2fe806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.619+0000 7f3004c00640 1 -- 172.21.15.37:0/37784739 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7f3000085550 con 0x7f300815fb30 2024-05-30T06:53:28.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.619+0000 7f300ce00640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2fe8069580 0x7f2fe806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.619+0000 7f300ce00640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2fe8069580 0x7f2fe806ba40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0ae000 tx=0x7f2ffc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:28.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.619+0000 7f3004c00640 1 -- 172.21.15.37:0/37784739 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f300814b800 con 0x7f300815fb30 2024-05-30T06:53:28.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.787+0000 7f300f800640 1 -- 172.21.15.37:0/37784739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3008154e20 con 0x7f300815fb30 2024-05-30T06:53:28.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.787+0000 7f3004c00640 1 -- 172.21.15.37:0/37784739 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+16908 (secure 0 0 0) 0x7f3000056f50 con 0x7f300815fb30 2024-05-30T06:53:28.788 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:28.788 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:53:20.822362+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:50:33.347094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T06:50:34.475297+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:53:28.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.791+0000 7f300f800640 1 -- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2fe8069580 msgr2=0x7f2fe806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.791+0000 7f300f800640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2fe8069580 0x7f2fe806ba40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc0ae000 tx=0x7f2ffc008040 comp rx=0 tx=0).stop 2024-05-30T06:53:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.791+0000 7f300f800640 1 -- 172.21.15.37:0/37784739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300815fb30 msgr2=0x7f30080b1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.791+0000 7f300f800640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300815fb30 0x7f30080b1500 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f300000be80 tx=0x7f300000bf70 comp rx=0 tx=0).stop 2024-05-30T06:53:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.791+0000 7f300f800640 1 -- 172.21.15.37:0/37784739 shutdown_connections 2024-05-30T06:53:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.791+0000 7f300f800640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300815fb30 0x7f30080b1500 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.791+0000 7f300f800640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30080b55a0 0x7f3008160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.791+0000 7f300f800640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2fe8069580 0x7f2fe806ba40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.791+0000 7f300f800640 1 --2- 172.21.15.37:0/37784739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f300806d080 0x7f30081497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.791+0000 7f300f800640 1 -- 172.21.15.37:0/37784739 >> 172.21.15.37:0/37784739 conn(0x7f3008073680 msgr2=0x7f3008157e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.791+0000 7f300f800640 1 -- 172.21.15.37:0/37784739 shutdown_connections 2024-05-30T06:53:28.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.791+0000 7f300f800640 1 -- 172.21.15.37:0/37784739 wait complete. 2024-05-30T06:53:28.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:50:33.347094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:50:34.475297+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 76, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:53:28.810 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:53:28.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.955+0000 7ffa79400640 1 Processor -- start 2024-05-30T06:53:28.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.955+0000 7ffa79400640 1 -- start start 2024-05-30T06:53:28.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa79400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffa740cd440 0x7ffa7406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa79400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa7406f5a0 0x7ffa740b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa79400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa7415f310 con 0x7ffa74155da0 2024-05-30T06:53:28.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa79400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ffa7415f5f0 con 0x7ffa740cd440 2024-05-30T06:53:28.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa79400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffa7415f8d0 con 0x7ffa7406f5a0 2024-05-30T06:53:28.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa72800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffa74155da0 0x7ffa740cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41914/0 (socket says 172.21.15.37:41914) 2024-05-30T06:53:28.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa72800640 1 -- 172.21.15.37:0/1107157770 learned_addr learned my addr 172.21.15.37:0/1107157770 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:28.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa73200640 1 --2- 172.21.15.37:0/1107157770 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa7406f5a0 0x7ffa740b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa69e00640 1 --2- 172.21.15.37:0/1107157770 >> v2:172.21.15.105:3300/0 conn(0x7ffa740cd440 0x7ffa7406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa71e00640 1 -- 172.21.15.37:0/1107157770 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3146058076 0 0) 0x7ffa7415f310 con 0x7ffa74155da0 2024-05-30T06:53:28.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa71e00640 1 -- 172.21.15.37:0/1107157770 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa58003530 con 0x7ffa74155da0 2024-05-30T06:53:28.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa69e00640 1 -- 172.21.15.37:0/1107157770 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa7406f5a0 msgr2=0x7ffa740b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:28.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa69e00640 1 --2- 172.21.15.37:0/1107157770 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa7406f5a0 0x7ffa740b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa69e00640 1 -- 172.21.15.37:0/1107157770 >> v1:172.21.15.37:6789/0 conn(0x7ffa74155da0 legacy=0x7ffa740cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.959+0000 7ffa69e00640 1 -- 172.21.15.37:0/1107157770 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7415fbb0 con 0x7ffa740cd440 2024-05-30T06:53:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa69e00640 1 --2- 172.21.15.37:0/1107157770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa740cd440 0x7ffa7406f060 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0097c0 tx=0x7ffa5c01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=417b847ea28251d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa71e00640 1 -- 172.21.15.37:0/1107157770 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0b0070 con 0x7ffa740cd440 2024-05-30T06:53:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa71e00640 1 -- 172.21.15.37:0/1107157770 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c0ab600 con 0x7ffa740cd440 2024-05-30T06:53:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa71e00640 1 -- 172.21.15.37:0/1107157770 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0ab9d0 con 0x7ffa740cd440 2024-05-30T06:53:28.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 -- 172.21.15.37:0/1107157770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa740cd440 msgr2=0x7ffa7406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 --2- 172.21.15.37:0/1107157770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa740cd440 0x7ffa7406f060 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0097c0 tx=0x7ffa5c01c380 comp rx=0 tx=0).stop 2024-05-30T06:53:28.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 -- 172.21.15.37:0/1107157770 shutdown_connections 2024-05-30T06:53:28.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 --2- 172.21.15.37:0/1107157770 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa7406f5a0 0x7ffa740b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 --2- 172.21.15.37:0/1107157770 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa740cd440 0x7ffa7406f060 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 -- 172.21.15.37:0/1107157770 >> 172.21.15.37:0/1107157770 conn(0x7ffa7406bf60 msgr2=0x7ffa740b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:28.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 -- 172.21.15.37:0/1107157770 shutdown_connections 2024-05-30T06:53:28.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 -- 172.21.15.37:0/1107157770 wait complete. 2024-05-30T06:53:28.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 Processor -- start 2024-05-30T06:53:28.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 -- start start 2024-05-30T06:53:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa7406f5a0 0x7ffa74151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa74155da0 0x7ffa74153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa7415e930 0x7ffa74153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa7406f9b0 con 0x7ffa7415e930 2024-05-30T06:53:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffa740b46f0 con 0x7ffa74155da0 2024-05-30T06:53:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.963+0000 7ffa79400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffa7406df50 con 0x7ffa7406f5a0 2024-05-30T06:53:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa73200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa7415e930 0x7ffa74153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa73200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa7415e930 0x7ffa74153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56812/0 (socket says 172.21.15.37:56812) 2024-05-30T06:53:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa73200640 1 -- 172.21.15.37:0/2121611976 learned_addr learned my addr 172.21.15.37:0/2121611976 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa69e00640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa74155da0 0x7ffa74153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa72800640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa7406f5a0 0x7ffa74151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa73200640 1 -- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa7406f5a0 msgr2=0x7ffa74151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa73200640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa7406f5a0 0x7ffa74151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa73200640 1 -- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa74155da0 msgr2=0x7ffa74153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa73200640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa74155da0 0x7ffa74153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa73200640 1 -- 172.21.15.37:0/2121611976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa74158b60 con 0x7ffa7415e930 2024-05-30T06:53:28.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa73200640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa7415e930 0x7ffa74153f80 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009dd0 tx=0x7ffa6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:28.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa6b400640 1 -- 172.21.15.37:0/2121611976 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c018020 con 0x7ffa7415e930 2024-05-30T06:53:28.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa6b400640 1 -- 172.21.15.37:0/2121611976 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa6c014480 con 0x7ffa7415e930 2024-05-30T06:53:28.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa6b400640 1 -- 172.21.15.37:0/2121611976 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c014870 con 0x7ffa7415e930 2024-05-30T06:53:28.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa79400640 1 -- 172.21.15.37:0/2121611976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa74158e40 con 0x7ffa7415e930 2024-05-30T06:53:28.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa79400640 1 -- 172.21.15.37:0/2121611976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa7415a620 con 0x7ffa7415e930 2024-05-30T06:53:28.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa79400640 1 -- 172.21.15.37:0/2121611976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa74068bc0 con 0x7ffa7415e930 2024-05-30T06:53:28.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.967+0000 7ffa6b400640 1 -- 172.21.15.37:0/2121611976 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7ffa6c01b020 con 0x7ffa7415e930 2024-05-30T06:53:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.971+0000 7ffa6b400640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffa50069580 0x7ffa5006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.971+0000 7ffa6b400640 1 -- 172.21.15.37:0/2121611976 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7ffa6c085f50 con 0x7ffa7415e930 2024-05-30T06:53:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.971+0000 7ffa72800640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffa50069580 0x7ffa5006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.971+0000 7ffa72800640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffa50069580 0x7ffa5006ba40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ffa64007fd0 tx=0x7ffa64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:28.975+0000 7ffa6b400640 1 -- 172.21.15.37:0/2121611976 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffa6c022070 con 0x7ffa7415e930 2024-05-30T06:53:29.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.139+0000 7ffa79400640 1 -- 172.21.15.37:0/2121611976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ffa740b6790 con 0x7ffa7415e930 2024-05-30T06:53:29.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.139+0000 7ffa6b400640 1 -- 172.21.15.37:0/2121611976 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7ffa6c010040 con 0x7ffa7415e930 2024-05-30T06:53:29.139 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:53:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.139+0000 7ffa79400640 1 -- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffa50069580 msgr2=0x7ffa5006ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.139+0000 7ffa79400640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffa50069580 0x7ffa5006ba40 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ffa64007fd0 tx=0x7ffa64009040 comp rx=0 tx=0).stop 2024-05-30T06:53:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.139+0000 7ffa79400640 1 -- 172.21.15.37:0/2121611976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa7415e930 msgr2=0x7ffa74153f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.139+0000 7ffa79400640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa7415e930 0x7ffa74153f80 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009dd0 tx=0x7ffa6c00c490 comp rx=0 tx=0).stop 2024-05-30T06:53:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.139+0000 7ffa79400640 1 -- 172.21.15.37:0/2121611976 shutdown_connections 2024-05-30T06:53:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.139+0000 7ffa79400640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa7415e930 0x7ffa74153f80 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.139+0000 7ffa79400640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffa50069580 0x7ffa5006ba40 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.139+0000 7ffa79400640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa74155da0 0x7ffa74153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.139+0000 7ffa79400640 1 --2- 172.21.15.37:0/2121611976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa7406f5a0 0x7ffa74151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.139+0000 7ffa79400640 1 -- 172.21.15.37:0/2121611976 >> 172.21.15.37:0/2121611976 conn(0x7ffa7406bf60 msgr2=0x7ffa74074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:29.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.139+0000 7ffa79400640 1 -- 172.21.15.37:0/2121611976 shutdown_connections 2024-05-30T06:53:29.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.143+0000 7ffa79400640 1 -- 172.21.15.37:0/2121611976 wait complete. 2024-05-30T06:53:29.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:53:29.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f7305c00640 1 Processor -- start 2024-05-30T06:53:29.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f7305c00640 1 -- start start 2024-05-30T06:53:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f7305c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7300155da0 0x7f73000cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f7305c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f730006f770 0x7f73000b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f7305c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f730015f310 con 0x7f73000cd440 2024-05-30T06:53:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f7305c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f730015f5f0 con 0x7f7300155da0 2024-05-30T06:53:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f7305c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f730015f8d0 con 0x7f730006f770 2024-05-30T06:53:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f72f6000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f73000cd440 0x7f730006f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41922/0 (socket says 172.21.15.37:41922) 2024-05-30T06:53:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f72f6000640 1 -- 172.21.15.37:0/114244180 learned_addr learned my addr 172.21.15.37:0/114244180 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f72fea00640 1 --2- 172.21.15.37:0/114244180 >> v2:172.21.15.105:3300/0 conn(0x7f7300155da0 0x7f73000cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f72ff400640 1 --2- 172.21.15.37:0/114244180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f730006f770 0x7f73000b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f72fe000640 1 -- 172.21.15.37:0/114244180 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286113167 0 0) 0x7f730015f310 con 0x7f73000cd440 2024-05-30T06:53:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f72fe000640 1 -- 172.21.15.37:0/114244180 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72e4003530 con 0x7f73000cd440 2024-05-30T06:53:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f72fea00640 1 -- 172.21.15.37:0/114244180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f730006f770 msgr2=0x7f73000b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f72fea00640 1 --2- 172.21.15.37:0/114244180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f730006f770 0x7f73000b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f72fea00640 1 -- 172.21.15.37:0/114244180 >> v1:172.21.15.37:6789/0 conn(0x7f73000cd440 legacy=0x7f730006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.306+0000 7f72fea00640 1 -- 172.21.15.37:0/114244180 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730015fbb0 con 0x7f7300155da0 2024-05-30T06:53:29.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.310+0000 7f72fea00640 1 --2- 172.21.15.37:0/114244180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7300155da0 0x7f73000cd950 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009d90 tx=0x7f72f001ea60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aca3b37aac2c4f2f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:29.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.310+0000 7f72fe000640 1 -- 172.21.15.37:0/114244180 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f00b4070 con 0x7f7300155da0 2024-05-30T06:53:29.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.310+0000 7f72fe000640 1 -- 172.21.15.37:0/114244180 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f00a7930 con 0x7f7300155da0 2024-05-30T06:53:29.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.310+0000 7f72fe000640 1 -- 172.21.15.37:0/114244180 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f00a7d00 con 0x7f7300155da0 2024-05-30T06:53:29.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.310+0000 7f7305c00640 1 -- 172.21.15.37:0/114244180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7300155da0 msgr2=0x7f73000cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.310+0000 7f7305c00640 1 --2- 172.21.15.37:0/114244180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7300155da0 0x7f73000cd950 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009d90 tx=0x7f72f001ea60 comp rx=0 tx=0).stop 2024-05-30T06:53:29.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.310+0000 7f7305c00640 1 -- 172.21.15.37:0/114244180 shutdown_connections 2024-05-30T06:53:29.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.310+0000 7f7305c00640 1 --2- 172.21.15.37:0/114244180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f730006f770 0x7f73000b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.310+0000 7f7305c00640 1 --2- 172.21.15.37:0/114244180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7300155da0 0x7f73000cd950 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.310+0000 7f7305c00640 1 -- 172.21.15.37:0/114244180 >> 172.21.15.37:0/114244180 conn(0x7f730006bf60 msgr2=0x7f73000b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:29.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.310+0000 7f7305c00640 1 -- 172.21.15.37:0/114244180 shutdown_connections 2024-05-30T06:53:29.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.310+0000 7f7305c00640 1 -- 172.21.15.37:0/114244180 wait complete. 2024-05-30T06:53:29.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f7305c00640 1 Processor -- start 2024-05-30T06:53:29.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f7305c00640 1 -- start start 2024-05-30T06:53:29.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f7305c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f730006f770 0x7f73001424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f7305c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7300155da0 0x7f7300154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f7305c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7300145130 0x7f730014f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f7305c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f730006df50 con 0x7f7300145130 2024-05-30T06:53:29.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f7305c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73000b46b0 con 0x7f7300155da0 2024-05-30T06:53:29.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f7305c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f730006e0d0 con 0x7f730006f770 2024-05-30T06:53:29.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72ff400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7300145130 0x7f730014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72ff400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7300145130 0x7f730014f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56824/0 (socket says 172.21.15.37:56824) 2024-05-30T06:53:29.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72ff400640 1 -- 172.21.15.37:0/4235729339 learned_addr learned my addr 172.21.15.37:0/4235729339 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:29.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72fea00640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f730006f770 0x7f73001424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72f6000640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7300155da0 0x7f7300154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72ff400640 1 -- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f730006f770 msgr2=0x7f73001424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72ff400640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f730006f770 0x7f73001424c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72ff400640 1 -- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7300155da0 msgr2=0x7f7300154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72ff400640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7300155da0 0x7f7300154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72ff400640 1 -- 172.21.15.37:0/4235729339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7300142a00 con 0x7f7300145130 2024-05-30T06:53:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72f6000640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7300155da0 0x7f7300154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72ff400640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7300145130 0x7f730014f080 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f72f800e840 tx=0x7f72f800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72f7400640 1 -- 172.21.15.37:0/4235729339 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8017070 con 0x7f7300145130 2024-05-30T06:53:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72f7400640 1 -- 172.21.15.37:0/4235729339 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f800c940 con 0x7f7300145130 2024-05-30T06:53:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f7305c00640 1 -- 172.21.15.37:0/4235729339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7300153470 con 0x7f7300145130 2024-05-30T06:53:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f72f7400640 1 -- 172.21.15.37:0/4235729339 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f800cd10 con 0x7f7300145130 2024-05-30T06:53:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f7305c00640 1 -- 172.21.15.37:0/4235729339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7300153a30 con 0x7f7300145130 2024-05-30T06:53:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.314+0000 7f7305c00640 1 -- 172.21.15.37:0/4235729339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7300068bc0 con 0x7f7300145130 2024-05-30T06:53:29.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.318+0000 7f72f7400640 1 -- 172.21.15.37:0/4235729339 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f72f801a070 con 0x7f7300145130 2024-05-30T06:53:29.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.318+0000 7f72f7400640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f72dc069580 0x7f72dc06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.318+0000 7f72f7400640 1 -- 172.21.15.37:0/4235729339 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7f72f8085850 con 0x7f7300145130 2024-05-30T06:53:29.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.318+0000 7f72fea00640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f72dc069580 0x7f72dc06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.318+0000 7f72fea00640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f72dc069580 0x7f72dc06ba40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f72f00b1000 tx=0x7f72f00a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:29.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.322+0000 7f72f7400640 1 -- 172.21.15.37:0/4235729339 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f72f8056e60 con 0x7f7300145130 2024-05-30T06:53:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.482+0000 7f7305c00640 1 -- 172.21.15.37:0/4235729339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f73000ceda0 con 0x7f7300145130 2024-05-30T06:53:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.486+0000 7f72f7400640 1 -- 172.21.15.37:0/4235729339 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) ==== 104+0+11 (secure 0 0 0) 0x7f72f805b160 con 0x7f7300145130 2024-05-30T06:53:29.485 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:53:29.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.486+0000 7f7305c00640 1 -- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f72dc069580 msgr2=0x7f72dc06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.486+0000 7f7305c00640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f72dc069580 0x7f72dc06ba40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f72f00b1000 tx=0x7f72f00a9070 comp rx=0 tx=0).stop 2024-05-30T06:53:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.486+0000 7f7305c00640 1 -- 172.21.15.37:0/4235729339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7300145130 msgr2=0x7f730014f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.486+0000 7f7305c00640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7300145130 0x7f730014f080 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f72f800e840 tx=0x7f72f800ed00 comp rx=0 tx=0).stop 2024-05-30T06:53:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.486+0000 7f7305c00640 1 -- 172.21.15.37:0/4235729339 shutdown_connections 2024-05-30T06:53:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.486+0000 7f7305c00640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7300145130 0x7f730014f080 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.486+0000 7f7305c00640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f72dc069580 0x7f72dc06ba40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.486+0000 7f7305c00640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7300155da0 0x7f7300154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.486+0000 7f7305c00640 1 --2- 172.21.15.37:0/4235729339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f730006f770 0x7f73001424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.486+0000 7f7305c00640 1 -- 172.21.15.37:0/4235729339 >> 172.21.15.37:0/4235729339 conn(0x7f730006bf60 msgr2=0x7f73000b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.486+0000 7f7305c00640 1 -- 172.21.15.37:0/4235729339 shutdown_connections 2024-05-30T06:53:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.486+0000 7f7305c00640 1 -- 172.21.15.37:0/4235729339 wait complete. 2024-05-30T06:53:29.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:53:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.650+0000 7f9ec5200640 1 Processor -- start 2024-05-30T06:53:29.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ec5200640 1 -- start start 2024-05-30T06:53:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ec5200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9ec006f770 0x7f9ec0166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ec5200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec015f310 con 0x7f9ec0155da0 2024-05-30T06:53:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ec5200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec015f5f0 con 0x7f9ec00cd440 2024-05-30T06:53:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ec5200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9ec00b4760 con 0x7f9ec006f770 2024-05-30T06:53:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebde00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9ec0155da0 0x7f9ec00cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41924/0 (socket says 172.21.15.37:41924) 2024-05-30T06:53:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebde00640 1 -- 172.21.15.37:0/166876147 learned_addr learned my addr 172.21.15.37:0/166876147 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebe800640 1 --2- 172.21.15.37:0/166876147 >> v2:172.21.15.105:3300/0 conn(0x7f9ec006f770 0x7f9ec0166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809517877 0 0) 0x7f9ec015f310 con 0x7f9ec0155da0 2024-05-30T06:53:29.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ea4003530 con 0x7f9ec0155da0 2024-05-30T06:53:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 396860269 0 0) 0x7f9ea4003530 con 0x7f9ec0155da0 2024-05-30T06:53:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 >> v2:172.21.15.105:3300/0 conn(0x7f9ec006f770 msgr2=0x7f9ec0166570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 --2- 172.21.15.37:0/166876147 >> v2:172.21.15.105:3300/0 conn(0x7f9ec006f770 0x7f9ec0166570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 >> v1:172.21.15.105:6789/0 conn(0x7f9ec00cd440 legacy=0x7f9ec006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec015f8d0 con 0x7f9ec0155da0 2024-05-30T06:53:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f9eb0001a00 con 0x7f9ec0155da0 2024-05-30T06:53:29.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebe800640 1 --2- 172.21.15.37:0/166876147 >> v2:172.21.15.105:3300/0 conn(0x7f9ec006f770 0x7f9ec0166570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 >> v1:172.21.15.37:6789/0 conn(0x7f9ec0155da0 legacy=0x7f9ec00cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 --2- 172.21.15.37:0/166876147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ea40039c0 0x7f9ea4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 --2- 172.21.15.37:0/166876147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ea4004810 0x7f9ea4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 --2- 172.21.15.37:0/166876147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ea40052f0 0x7f9ea400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea400c190 con 0x7f9ea4004810 2024-05-30T06:53:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea400c340 con 0x7f9ea40039c0 2024-05-30T06:53:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea400e750 con 0x7f9ea40052f0 2024-05-30T06:53:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9eb5400640 1 --2- 172.21.15.37:0/166876147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ea4004810 0x7f9ea4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebde00640 1 --2- 172.21.15.37:0/166876147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ea40039c0 0x7f9ea4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebe800640 1 --2- 172.21.15.37:0/166876147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ea40052f0 0x7f9ea400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9eb5400640 1 -- 172.21.15.37:0/166876147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ea40052f0 msgr2=0x7f9ea400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9eb5400640 1 --2- 172.21.15.37:0/166876147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ea40052f0 0x7f9ea400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9eb5400640 1 -- 172.21.15.37:0/166876147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ea40039c0 msgr2=0x7f9ea4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:29.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9eb5400640 1 --2- 172.21.15.37:0/166876147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ea40039c0 0x7f9ea4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9eb5400640 1 -- 172.21.15.37:0/166876147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea4003530 con 0x7f9ea4004810 2024-05-30T06:53:29.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.654+0000 7f9ebe800640 1 -- 172.21.15.37:0/166876147 reap_dead start 2024-05-30T06:53:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.658+0000 7f9eb5400640 1 --2- 172.21.15.37:0/166876147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ea4004810 0x7f9ea4004c90 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8001750 tx=0x7f9ea801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511aa85615da04a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.658+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80013a0 con 0x7f9ea4004810 2024-05-30T06:53:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.658+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea80052f0 con 0x7f9ea4004810 2024-05-30T06:53:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.658+0000 7f9ebd400640 1 -- 172.21.15.37:0/166876147 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8003840 con 0x7f9ea4004810 2024-05-30T06:53:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.658+0000 7f9ec5200640 1 -- 172.21.15.37:0/166876147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ea4004810 msgr2=0x7f9ea4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.658+0000 7f9ec5200640 1 --2- 172.21.15.37:0/166876147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ea4004810 0x7f9ea4004c90 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8001750 tx=0x7f9ea801c370 comp rx=0 tx=0).stop 2024-05-30T06:53:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.658+0000 7f9ec5200640 1 -- 172.21.15.37:0/166876147 shutdown_connections 2024-05-30T06:53:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.658+0000 7f9ec5200640 1 --2- 172.21.15.37:0/166876147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ea4004810 0x7f9ea4004c90 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.658+0000 7f9ec5200640 1 -- 172.21.15.37:0/166876147 >> 172.21.15.37:0/166876147 conn(0x7f9ec006bf60 msgr2=0x7f9ec00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:29.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.658+0000 7f9ec5200640 1 -- 172.21.15.37:0/166876147 shutdown_connections 2024-05-30T06:53:29.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.658+0000 7f9ec5200640 1 -- 172.21.15.37:0/166876147 wait complete. 2024-05-30T06:53:29.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ec5200640 1 Processor -- start 2024-05-30T06:53:29.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ec5200640 1 -- start start 2024-05-30T06:53:29.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ec5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ea4004810 0x7f9ec0158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ec5200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ec0156290 0x7f9ec01f6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ec5200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ec01f7090 0x7f9ec0074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ec5200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec00b3ae0 con 0x7f9ea4004810 2024-05-30T06:53:29.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ec5200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec00b3960 con 0x7f9ec0156290 2024-05-30T06:53:29.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ec5200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec00b3c60 con 0x7f9ec01f7090 2024-05-30T06:53:29.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ebde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ea4004810 0x7f9ec0158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ebde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ea4004810 0x7f9ec0158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56842/0 (socket says 172.21.15.37:56842) 2024-05-30T06:53:29.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ebde00640 1 -- 172.21.15.37:0/99018066 learned_addr learned my addr 172.21.15.37:0/99018066 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:29.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9eb5400640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ec0156290 0x7f9ec01f6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ebe800640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ec01f7090 0x7f9ec0074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ebde00640 1 -- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ec01f7090 msgr2=0x7f9ec0074cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ebde00640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ec01f7090 0x7f9ec0074cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ebde00640 1 -- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ec0156290 msgr2=0x7f9ec01f6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ebde00640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ec0156290 0x7f9ec01f6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ebde00640 1 -- 172.21.15.37:0/99018066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec01e77e0 con 0x7f9ea4004810 2024-05-30T06:53:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ebe800640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ec01f7090 0x7f9ec0074cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9eb5400640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ec0156290 0x7f9ec01f6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ebde00640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ea4004810 0x7f9ec0158d40 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0007690 tx=0x7f9eb0007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9eb6a00640 1 -- 172.21.15.37:0/99018066 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0017020 con 0x7f9ea4004810 2024-05-30T06:53:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9eb6a00640 1 -- 172.21.15.37:0/99018066 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb000ab90 con 0x7f9ea4004810 2024-05-30T06:53:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ec5200640 1 -- 172.21.15.37:0/99018066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec01e7ac0 con 0x7f9ea4004810 2024-05-30T06:53:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9eb6a00640 1 -- 172.21.15.37:0/99018066 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb00133f0 con 0x7f9ea4004810 2024-05-30T06:53:29.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ec5200640 1 -- 172.21.15.37:0/99018066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec01e8080 con 0x7f9ea4004810 2024-05-30T06:53:29.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.662+0000 7f9ec5200640 1 -- 172.21.15.37:0/99018066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec0068bc0 con 0x7f9ea4004810 2024-05-30T06:53:29.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.666+0000 7f9eb6a00640 1 -- 172.21.15.37:0/99018066 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f9eb001a020 con 0x7f9ea4004810 2024-05-30T06:53:29.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.666+0000 7f9eb6a00640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9e9c069580 0x7f9e9c06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:29.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.666+0000 7f9eb6a00640 1 -- 172.21.15.37:0/99018066 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7f9eb00862e0 con 0x7f9ea4004810 2024-05-30T06:53:29.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.666+0000 7f9eb5400640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9e9c069580 0x7f9e9c06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:29.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.666+0000 7f9eb5400640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9e9c069580 0x7f9e9c06ba40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40057f0 tx=0x7f9ea80011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:29.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.670+0000 7f9eb6a00640 1 -- 172.21.15.37:0/99018066 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9eb0021020 con 0x7f9ea4004810 2024-05-30T06:53:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.846+0000 7f9ec5200640 1 -- 172.21.15.37:0/99018066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9ec0072b50 con 0x7f9ea4004810 2024-05-30T06:53:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.846+0000 7f9eb6a00640 1 -- 172.21.15.37:0/99018066 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) ==== 100+0+11 (secure 0 0 0) 0x7f9eb0057f80 con 0x7f9ea4004810 2024-05-30T06:53:29.848 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:53:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.850+0000 7f9ec5200640 1 -- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9e9c069580 msgr2=0x7f9e9c06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.850+0000 7f9ec5200640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9e9c069580 0x7f9e9c06ba40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40057f0 tx=0x7f9ea80011a0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.850+0000 7f9ec5200640 1 -- 172.21.15.37:0/99018066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ea4004810 msgr2=0x7f9ec0158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.850+0000 7f9ec5200640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ea4004810 0x7f9ec0158d40 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0007690 tx=0x7f9eb0007b50 comp rx=0 tx=0).stop 2024-05-30T06:53:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.850+0000 7f9ec5200640 1 -- 172.21.15.37:0/99018066 shutdown_connections 2024-05-30T06:53:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.850+0000 7f9ec5200640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ec01f7090 0x7f9ec0074cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.850+0000 7f9ec5200640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9e9c069580 0x7f9e9c06ba40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.850+0000 7f9ec5200640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ec0156290 0x7f9ec01f6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.850+0000 7f9ec5200640 1 --2- 172.21.15.37:0/99018066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ea4004810 0x7f9ec0158d40 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.850+0000 7f9ec5200640 1 -- 172.21.15.37:0/99018066 >> 172.21.15.37:0/99018066 conn(0x7f9ec006bf60 msgr2=0x7f9ec00aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.850+0000 7f9ec5200640 1 -- 172.21.15.37:0/99018066 shutdown_connections 2024-05-30T06:53:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:29.850+0000 7f9ec5200640 1 -- 172.21.15.37:0/99018066 wait complete. 2024-05-30T06:53:29.869 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:53:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.014+0000 7f4cbb200640 1 Processor -- start 2024-05-30T06:53:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.014+0000 7f4cbb200640 1 -- start start 2024-05-30T06:53:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.014+0000 7f4cbb200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4cb41462b0 0x7f4cb4160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.014+0000 7f4cbb200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4cb40cfdf0 0x7f4cb415d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.014+0000 7f4cbb200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb415d850 con 0x7f4cb415cdb0 2024-05-30T06:53:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.014+0000 7f4cbb200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb415db30 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.014+0000 7f4cbb200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb4160590 con 0x7f4cb41462b0 2024-05-30T06:53:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.018+0000 7f4cb9200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4cb40cfdf0 0x7f4cb415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.018+0000 7f4cb9200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4cb40cfdf0 0x7f4cb415d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56850/0 (socket says 172.21.15.37:56850) 2024-05-30T06:53:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.018+0000 7f4cb9200640 1 -- 172.21.15.37:0/781010459 learned_addr learned my addr 172.21.15.37:0/781010459 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.018+0000 7f4cb3e00640 1 --2- 172.21.15.37:0/781010459 >> v2:172.21.15.105:3300/0 conn(0x7f4cb41462b0 0x7f4cb4160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.018+0000 7f4cb9200640 1 -- 172.21.15.37:0/781010459 >> v2:172.21.15.105:3300/0 conn(0x7f4cb41462b0 msgr2=0x7f4cb4160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.018+0000 7f4cb9200640 1 --2- 172.21.15.37:0/781010459 >> v2:172.21.15.105:3300/0 conn(0x7f4cb41462b0 0x7f4cb4160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.018+0000 7f4cb9200640 1 -- 172.21.15.37:0/781010459 >> v1:172.21.15.105:6789/0 conn(0x7f4cb415cdb0 legacy=0x7f4cb40cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.018+0000 7f4cb9200640 1 -- 172.21.15.37:0/781010459 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb4160870 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.018+0000 7f4cb9200640 1 --2- 172.21.15.37:0/781010459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb40cfdf0 0x7f4cb415d220 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009e50 tx=0x7f4cac01f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed759d31d389985 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.018+0000 7f4cb3400640 1 -- 172.21.15.37:0/781010459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0b4070 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.018+0000 7f4cb3400640 1 -- 172.21.15.37:0/781010459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cac0af400 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.018+0000 7f4cb3400640 1 -- 172.21.15.37:0/781010459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0af7d0 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 -- 172.21.15.37:0/781010459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb40cfdf0 msgr2=0x7f4cb415d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 --2- 172.21.15.37:0/781010459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb40cfdf0 0x7f4cb415d220 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009e50 tx=0x7f4cac01f1a0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 -- 172.21.15.37:0/781010459 shutdown_connections 2024-05-30T06:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 --2- 172.21.15.37:0/781010459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb40cfdf0 0x7f4cb415d220 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 --2- 172.21.15.37:0/781010459 >> v2:172.21.15.105:3300/0 conn(0x7f4cb41462b0 0x7f4cb4160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 -- 172.21.15.37:0/781010459 >> 172.21.15.37:0/781010459 conn(0x7f4cb40b3390 msgr2=0x7f4cb40b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 -- 172.21.15.37:0/781010459 shutdown_connections 2024-05-30T06:53:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 -- 172.21.15.37:0/781010459 wait complete. 2024-05-30T06:53:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 Processor -- start 2024-05-30T06:53:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 -- start start 2024-05-30T06:53:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb40cfdf0 0x7f4cb4142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cb41462b0 0x7f4cb40c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cb415cdb0 0x7f4cb40c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb40b4150 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb40b3fd0 con 0x7f4cb415cdb0 2024-05-30T06:53:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cbb200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb40ce050 con 0x7f4cb41462b0 2024-05-30T06:53:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cb3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb40cfdf0 0x7f4cb4142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cb3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb40cfdf0 0x7f4cb4142500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56858/0 (socket says 172.21.15.37:56858) 2024-05-30T06:53:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cb3e00640 1 -- 172.21.15.37:0/4148747888 learned_addr learned my addr 172.21.15.37:0/4148747888 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cabe00640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cb41462b0 0x7f4cb40c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cb9200640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cb415cdb0 0x7f4cb40c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cb3e00640 1 -- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cb41462b0 msgr2=0x7f4cb40c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cb3e00640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cb41462b0 0x7f4cb40c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cb3e00640 1 -- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cb415cdb0 msgr2=0x7f4cb40c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cb3e00640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cb415cdb0 0x7f4cb40c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cb3e00640 1 -- 172.21.15.37:0/4148747888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb40c6910 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cb9200640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cb415cdb0 0x7f4cb40c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cb3e00640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb40cfdf0 0x7f4cb4142500 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400d800 tx=0x7f4ca400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cb0c00640 1 -- 172.21.15.37:0/4148747888 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca400b6c0 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.022+0000 7f4cb0c00640 1 -- 172.21.15.37:0/4148747888 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca4019070 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.026+0000 7f4cb0c00640 1 -- 172.21.15.37:0/4148747888 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca400ba60 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.026+0000 7f4cbb200640 1 -- 172.21.15.37:0/4148747888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb40c6bf0 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.026+0000 7f4cbb200640 1 -- 172.21.15.37:0/4148747888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb40c71b0 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.026+0000 7f4cbb200640 1 -- 172.21.15.37:0/4148747888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb4068b20 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.026+0000 7f4cb0c00640 1 -- 172.21.15.37:0/4148747888 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f4ca400bc00 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.026+0000 7f4cb0c00640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4c900695b0 0x7f4c9006ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.026+0000 7f4cb0c00640 1 -- 172.21.15.37:0/4148747888 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7f4ca40859b0 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.026+0000 7f4cabe00640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4c900695b0 0x7f4c9006ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.030+0000 7f4cabe00640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4c900695b0 0x7f4c9006ba70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40cdb00 tx=0x7f4c9c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:30.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.030+0000 7f4cb0c00640 1 -- 172.21.15.37:0/4148747888 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ca40579c0 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cbb200640 1 -- 172.21.15.37:0/4148747888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cb406c740 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cb0c00640 1 -- 172.21.15.37:0/4148747888 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5186 (secure 0 0 0) 0x7f4ca40572c0 con 0x7f4cb40cfdf0 2024-05-30T06:53:30.234 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:30.234 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6086,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/855324379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":855324379},{"type":"v1","addr":"172.21.15.105:6836","nonce":855324379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6089,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3353563250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3353563250},{"type":"v1","addr":"172.21.15.105:6837","nonce":3353563250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6933,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1946331427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1946331427},{"type":"v1","addr":"172.21.15.37:6834","nonce":1946331427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:50:35.512352+0000","modified":"2024-05-30T06:50:38.536531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3396138806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3396138806},{"type":"v1","addr":"172.21.15.37:6835","nonce":3396138806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6939,"qdb_cluster":[6939]},"id":5}]} 2024-05-30T06:53:30.234 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 47 2024-05-30T06:53:30.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cbb200640 1 -- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4c900695b0 msgr2=0x7f4c9006ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cbb200640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4c900695b0 0x7f4c9006ba70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40cdb00 tx=0x7f4c9c009060 comp rx=0 tx=0).stop 2024-05-30T06:53:30.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cbb200640 1 -- 172.21.15.37:0/4148747888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb40cfdf0 msgr2=0x7f4cb4142500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cbb200640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb40cfdf0 0x7f4cb4142500 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400d800 tx=0x7f4ca400dcc0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cbb200640 1 -- 172.21.15.37:0/4148747888 shutdown_connections 2024-05-30T06:53:30.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cbb200640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4c900695b0 0x7f4c9006ba70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cbb200640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cb415cdb0 0x7f4cb40c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cbb200640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cb41462b0 0x7f4cb40c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cbb200640 1 --2- 172.21.15.37:0/4148747888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb40cfdf0 0x7f4cb4142500 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cbb200640 1 -- 172.21.15.37:0/4148747888 >> 172.21.15.37:0/4148747888 conn(0x7f4cb40b3390 msgr2=0x7f4cb4141550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cbb200640 1 -- 172.21.15.37:0/4148747888 shutdown_connections 2024-05-30T06:53:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.234+0000 7f4cbb200640 1 -- 172.21.15.37:0/4148747888 wait complete. 2024-05-30T06:53:30.255 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:53:30.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d55400640 1 Processor -- start 2024-05-30T06:53:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d55400640 1 -- start start 2024-05-30T06:53:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d55400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d501605d0 0x7f4d500b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d55400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4d501609b0 0x7f4d50160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d55400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d500cdda0 con 0x7f4d5015f7d0 2024-05-30T06:53:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d55400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4d500ce080 con 0x7f4d501605d0 2024-05-30T06:53:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d55400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4d5009ac00 con 0x7f4d501609b0 2024-05-30T06:53:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d4fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d501605d0 0x7f4d500b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d4fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d501605d0 0x7f4d500b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56864/0 (socket says 172.21.15.37:56864) 2024-05-30T06:53:30.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d4fe00640 1 -- 172.21.15.37:0/2541009399 learned_addr learned my addr 172.21.15.37:0/2541009399 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d47e00640 1 --2- 172.21.15.37:0/2541009399 >> v2:172.21.15.105:3300/0 conn(0x7f4d501609b0 0x7f4d50160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d4fe00640 1 -- 172.21.15.37:0/2541009399 >> v2:172.21.15.105:3300/0 conn(0x7f4d501609b0 msgr2=0x7f4d50160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d4fe00640 1 --2- 172.21.15.37:0/2541009399 >> v2:172.21.15.105:3300/0 conn(0x7f4d501609b0 0x7f4d50160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d4fe00640 1 -- 172.21.15.37:0/2541009399 >> v1:172.21.15.105:6789/0 conn(0x7f4d5015f7d0 legacy=0x7f4d5009b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.402+0000 7f4d4fe00640 1 -- 172.21.15.37:0/2541009399 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5009aee0 con 0x7f4d501605d0 2024-05-30T06:53:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.406+0000 7f4d4fe00640 1 --2- 172.21.15.37:0/2541009399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d501605d0 0x7f4d500b52b0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f4d50072e70 tx=0x7f4d4001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d5120dadd6d6ab server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.406+0000 7f4d4f400640 1 -- 172.21.15.37:0/2541009399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400b0070 con 0x7f4d501605d0 2024-05-30T06:53:30.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.406+0000 7f4d4f400640 1 -- 172.21.15.37:0/2541009399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d400ab600 con 0x7f4d501605d0 2024-05-30T06:53:30.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.406+0000 7f4d4f400640 1 -- 172.21.15.37:0/2541009399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400ab9d0 con 0x7f4d501605d0 2024-05-30T06:53:30.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.406+0000 7f4d55400640 1 -- 172.21.15.37:0/2541009399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d501605d0 msgr2=0x7f4d500b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.406+0000 7f4d55400640 1 --2- 172.21.15.37:0/2541009399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d501605d0 0x7f4d500b52b0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f4d50072e70 tx=0x7f4d4001c4e0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.406+0000 7f4d55400640 1 -- 172.21.15.37:0/2541009399 shutdown_connections 2024-05-30T06:53:30.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.406+0000 7f4d55400640 1 --2- 172.21.15.37:0/2541009399 >> v2:172.21.15.105:3300/0 conn(0x7f4d501609b0 0x7f4d50160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.406+0000 7f4d55400640 1 --2- 172.21.15.37:0/2541009399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d501605d0 0x7f4d500b52b0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.406+0000 7f4d55400640 1 -- 172.21.15.37:0/2541009399 >> 172.21.15.37:0/2541009399 conn(0x7f4d500b3f50 msgr2=0x7f4d500b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:30.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.406+0000 7f4d55400640 1 -- 172.21.15.37:0/2541009399 shutdown_connections 2024-05-30T06:53:30.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.406+0000 7f4d55400640 1 -- 172.21.15.37:0/2541009399 wait complete. 2024-05-30T06:53:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d55400640 1 Processor -- start 2024-05-30T06:53:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d55400640 1 -- start start 2024-05-30T06:53:30.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d55400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d5015f7d0 0x7f4d500b7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d55400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d501605d0 0x7f4d500c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d55400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d501609b0 0x7f4d5006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d55400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4d50160030 con 0x7f4d5015f7d0 2024-05-30T06:53:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d55400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5015feb0 con 0x7f4d501605d0 2024-05-30T06:53:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d55400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4d50169ec0 con 0x7f4d501609b0 2024-05-30T06:53:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d4fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d5015f7d0 0x7f4d500b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d4fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d5015f7d0 0x7f4d500b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56878/0 (socket says 172.21.15.37:56878) 2024-05-30T06:53:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d4fe00640 1 -- 172.21.15.37:0/1260916852 learned_addr learned my addr 172.21.15.37:0/1260916852 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d47e00640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d501605d0 0x7f4d500c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d54a00640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d501609b0 0x7f4d5006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d4fe00640 1 -- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d501609b0 msgr2=0x7f4d5006e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d4fe00640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d501609b0 0x7f4d5006e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d4fe00640 1 -- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d501605d0 msgr2=0x7f4d500c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d4fe00640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d501605d0 0x7f4d500c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d4fe00640 1 -- 172.21.15.37:0/1260916852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d500cbdc0 con 0x7f4d5015f7d0 2024-05-30T06:53:30.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d54a00640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d501609b0 0x7f4d5006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d4fe00640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d5015f7d0 0x7f4d500b7750 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f4d400ae040 tx=0x7f4d4001ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d4cc00640 1 -- 172.21.15.37:0/1260916852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400b0040 con 0x7f4d5015f7d0 2024-05-30T06:53:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d4cc00640 1 -- 172.21.15.37:0/1260916852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d400bc070 con 0x7f4d5015f7d0 2024-05-30T06:53:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d4cc00640 1 -- 172.21.15.37:0/1260916852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400b6660 con 0x7f4d5015f7d0 2024-05-30T06:53:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d55400640 1 -- 172.21.15.37:0/1260916852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d500cc0a0 con 0x7f4d5015f7d0 2024-05-30T06:53:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d55400640 1 -- 172.21.15.37:0/1260916852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d500ca6b0 con 0x7f4d5015f7d0 2024-05-30T06:53:30.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.410+0000 7f4d55400640 1 -- 172.21.15.37:0/1260916852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d50068ab0 con 0x7f4d5015f7d0 2024-05-30T06:53:30.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.414+0000 7f4d4cc00640 1 -- 172.21.15.37:0/1260916852 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f4d400b6800 con 0x7f4d5015f7d0 2024-05-30T06:53:30.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.414+0000 7f4d4cc00640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4d2c069580 0x7f4d2c06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.414+0000 7f4d4cc00640 1 -- 172.21.15.37:0/1260916852 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5851+0+0 (secure 0 0 0) 0x7f4d4011fbb0 con 0x7f4d5015f7d0 2024-05-30T06:53:30.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.414+0000 7f4d47e00640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4d2c069580 0x7f4d2c06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.414+0000 7f4d47e00640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4d2c069580 0x7f4d2c06ba40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4d50154760 tx=0x7f4d38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:30.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.418+0000 7f4d4cc00640 1 -- 172.21.15.37:0/1260916852 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d400160d0 con 0x7f4d5015f7d0 2024-05-30T06:53:30.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.590+0000 7f4d55400640 1 -- 172.21.15.37:0/1260916852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d500d0b20 con 0x7f4d5015f7d0 2024-05-30T06:53:30.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.590+0000 7f4d4cc00640 1 -- 172.21.15.37:0/1260916852 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+16863 (secure 0 0 0) 0x7f4d400f1850 con 0x7f4d5015f7d0 2024-05-30T06:53:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:30.591 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":77,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:53:30.513202+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:50:33.347094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T06:50:34.475297+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:53:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.590+0000 7f4d55400640 1 -- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4d2c069580 msgr2=0x7f4d2c06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.594+0000 7f4d55400640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4d2c069580 0x7f4d2c06ba40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4d50154760 tx=0x7f4d38008040 comp rx=0 tx=0).stop 2024-05-30T06:53:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.594+0000 7f4d55400640 1 -- 172.21.15.37:0/1260916852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d5015f7d0 msgr2=0x7f4d500b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.594+0000 7f4d55400640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d5015f7d0 0x7f4d500b7750 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f4d400ae040 tx=0x7f4d4001ad20 comp rx=0 tx=0).stop 2024-05-30T06:53:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.594+0000 7f4d55400640 1 -- 172.21.15.37:0/1260916852 shutdown_connections 2024-05-30T06:53:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.594+0000 7f4d55400640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d501609b0 0x7f4d5006e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.594+0000 7f4d55400640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4d2c069580 0x7f4d2c06ba40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.594+0000 7f4d55400640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d501605d0 0x7f4d500c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.594+0000 7f4d55400640 1 --2- 172.21.15.37:0/1260916852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d5015f7d0 0x7f4d500b7750 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.594+0000 7f4d55400640 1 -- 172.21.15.37:0/1260916852 >> 172.21.15.37:0/1260916852 conn(0x7f4d500b3f50 msgr2=0x7f4d5009b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.594+0000 7f4d55400640 1 -- 172.21.15.37:0/1260916852 shutdown_connections 2024-05-30T06:53:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.594+0000 7f4d55400640 1 -- 172.21.15.37:0/1260916852 wait complete. 2024-05-30T06:53:30.614 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T06:53:30.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:53:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.762+0000 7fed50e00640 1 Processor -- start 2024-05-30T06:53:30.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.762+0000 7fed50e00640 1 -- start start 2024-05-30T06:53:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.762+0000 7fed50e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fed4c0b45d0 0x7fed4c070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.762+0000 7fed50e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed4c0b6030 con 0x7fed4c147790 2024-05-30T06:53:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.762+0000 7fed50e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed4c0b62d0 con 0x7fed4c06b960 2024-05-30T06:53:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.762+0000 7fed50e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fed4c0b6890 con 0x7fed4c0b45d0 2024-05-30T06:53:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.762+0000 7fed49e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fed4c147790 0x7fed4c0ae520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41928/0 (socket says 172.21.15.37:41928) 2024-05-30T06:53:30.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.762+0000 7fed49e00640 1 -- 172.21.15.37:0/3800026903 learned_addr learned my addr 172.21.15.37:0/3800026903 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:30.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed43e00640 1 --2- 172.21.15.37:0/3800026903 >> v2:172.21.15.105:3300/0 conn(0x7fed4c0b45d0 0x7fed4c070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3259045266 0 0) 0x7fed4c0b6030 con 0x7fed4c147790 2024-05-30T06:53:30.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed30003530 con 0x7fed4c147790 2024-05-30T06:53:30.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1657352296 0 0) 0x7fed30003530 con 0x7fed4c147790 2024-05-30T06:53:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 >> v2:172.21.15.105:3300/0 conn(0x7fed4c0b45d0 msgr2=0x7fed4c070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 --2- 172.21.15.37:0/3800026903 >> v2:172.21.15.105:3300/0 conn(0x7fed4c0b45d0 0x7fed4c070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 >> v1:172.21.15.105:6789/0 conn(0x7fed4c06b960 legacy=0x7fed4c06f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4c0b65b0 con 0x7fed4c147790 2024-05-30T06:53:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fed3c0016a0 con 0x7fed4c147790 2024-05-30T06:53:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 >> v1:172.21.15.37:6789/0 conn(0x7fed4c147790 legacy=0x7fed4c0ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 --2- 172.21.15.37:0/3800026903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed300039c0 0x7fed30003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 --2- 172.21.15.37:0/3800026903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed30004810 0x7fed30004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 --2- 172.21.15.37:0/3800026903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed300051d0 0x7fed3000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c0b6890 con 0x7fed300051d0 2024-05-30T06:53:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed3000c170 con 0x7fed30004810 2024-05-30T06:53:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fed3000c370 con 0x7fed300039c0 2024-05-30T06:53:30.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed4a800640 1 --2- 172.21.15.37:0/3800026903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed300051d0 0x7fed3000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed43e00640 1 --2- 172.21.15.37:0/3800026903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed30004810 0x7fed30004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed49e00640 1 --2- 172.21.15.37:0/3800026903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed300039c0 0x7fed30003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed4a800640 1 -- 172.21.15.37:0/3800026903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed300039c0 msgr2=0x7fed30003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed4a800640 1 --2- 172.21.15.37:0/3800026903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed300039c0 0x7fed30003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed4a800640 1 -- 172.21.15.37:0/3800026903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed30004810 msgr2=0x7fed30004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed4a800640 1 --2- 172.21.15.37:0/3800026903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed30004810 0x7fed30004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.766+0000 7fed4a800640 1 -- 172.21.15.37:0/3800026903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed30003530 con 0x7fed300051d0 2024-05-30T06:53:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed4a800640 1 -- 172.21.15.37:0/3800026903 reap_dead start 2024-05-30T06:53:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed4a800640 1 --2- 172.21.15.37:0/3800026903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed300051d0 0x7fed3000b9d0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fed44001e70 tx=0x7fed4401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1694290457d1819d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44001a90 con 0x7fed300051d0 2024-05-30T06:53:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed44003bc0 con 0x7fed300051d0 2024-05-30T06:53:30.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed49400640 1 -- 172.21.15.37:0/3800026903 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44005020 con 0x7fed300051d0 2024-05-30T06:53:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 -- 172.21.15.37:0/3800026903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed300051d0 msgr2=0x7fed3000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 --2- 172.21.15.37:0/3800026903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed300051d0 0x7fed3000b9d0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fed44001e70 tx=0x7fed4401c780 comp rx=0 tx=0).stop 2024-05-30T06:53:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 -- 172.21.15.37:0/3800026903 shutdown_connections 2024-05-30T06:53:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 --2- 172.21.15.37:0/3800026903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed300051d0 0x7fed3000b9d0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 -- 172.21.15.37:0/3800026903 >> 172.21.15.37:0/3800026903 conn(0x7fed4c0b6a60 msgr2=0x7fed4c0b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:30.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 -- 172.21.15.37:0/3800026903 shutdown_connections 2024-05-30T06:53:30.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 -- 172.21.15.37:0/3800026903 wait complete. 2024-05-30T06:53:30.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 Processor -- start 2024-05-30T06:53:30.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 -- start start 2024-05-30T06:53:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed300051d0 0x7fed4c142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c0b2cc0 0x7fed4c0b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed4c1f8240 0x7fed4c1f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c06bdd0 con 0x7fed4c0b2cc0 2024-05-30T06:53:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed4c0b5e90 con 0x7fed300051d0 2024-05-30T06:53:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.770+0000 7fed50e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fed4c06bf50 con 0x7fed4c1f8240 2024-05-30T06:53:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed43e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c0b2cc0 0x7fed4c0b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed43e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c0b2cc0 0x7fed4c0b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56888/0 (socket says 172.21.15.37:56888) 2024-05-30T06:53:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed43e00640 1 -- 172.21.15.37:0/2366252160 learned_addr learned my addr 172.21.15.37:0/2366252160 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed49e00640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed300051d0 0x7fed4c142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed4a800640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed4c1f8240 0x7fed4c1f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed43e00640 1 -- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed4c1f8240 msgr2=0x7fed4c1f86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed43e00640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed4c1f8240 0x7fed4c1f86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed43e00640 1 -- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed300051d0 msgr2=0x7fed4c142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed43e00640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed300051d0 0x7fed4c142660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed43e00640 1 -- 172.21.15.37:0/2366252160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4c1e5360 con 0x7fed4c0b2cc0 2024-05-30T06:53:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed43e00640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c0b2cc0 0x7fed4c0b3140 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fed34011990 tx=0x7fed34011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed42000640 1 -- 172.21.15.37:0/2366252160 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3400fa30 con 0x7fed4c0b2cc0 2024-05-30T06:53:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed42000640 1 -- 172.21.15.37:0/2366252160 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3400fbd0 con 0x7fed4c0b2cc0 2024-05-30T06:53:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed42000640 1 -- 172.21.15.37:0/2366252160 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34014440 con 0x7fed4c0b2cc0 2024-05-30T06:53:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed50e00640 1 -- 172.21.15.37:0/2366252160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4c1e5640 con 0x7fed4c0b2cc0 2024-05-30T06:53:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed50e00640 1 -- 172.21.15.37:0/2366252160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4c1e5c00 con 0x7fed4c0b2cc0 2024-05-30T06:53:30.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed50e00640 1 -- 172.21.15.37:0/2366252160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed4c068b20 con 0x7fed4c0b2cc0 2024-05-30T06:53:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.774+0000 7fed42000640 1 -- 172.21.15.37:0/2366252160 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fed34012040 con 0x7fed4c0b2cc0 2024-05-30T06:53:30.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.778+0000 7fed42000640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed280695b0 0x7fed2806ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.778+0000 7fed42000640 1 -- 172.21.15.37:0/2366252160 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5823+0+0 (secure 0 0 0) 0x7fed34085e40 con 0x7fed4c0b2cc0 2024-05-30T06:53:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.778+0000 7fed49e00640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed280695b0 0x7fed2806ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.778+0000 7fed49e00640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed280695b0 0x7fed2806ba70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0b6200 tx=0x7fed3c000ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.782+0000 7fed42000640 1 -- 172.21.15.37:0/2366252160 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed34019030 con 0x7fed4c0b2cc0 2024-05-30T06:53:30.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed50e00640 1 -- 172.21.15.37:0/2366252160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed4c146050 con 0x7fed4c0b2cc0 2024-05-30T06:53:30.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed42000640 1 -- 172.21.15.37:0/2366252160 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5186 (secure 0 0 0) 0x7fed34057b40 con 0x7fed4c0b2cc0 2024-05-30T06:53:30.986 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:30.986 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6086,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/855324379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":855324379},{"type":"v1","addr":"172.21.15.105:6836","nonce":855324379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6089,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3353563250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3353563250},{"type":"v1","addr":"172.21.15.105:6837","nonce":3353563250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6933,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1946331427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1946331427},{"type":"v1","addr":"172.21.15.37:6834","nonce":1946331427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:50:35.512352+0000","modified":"2024-05-30T06:50:38.536531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3396138806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3396138806},{"type":"v1","addr":"172.21.15.37:6835","nonce":3396138806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6939,"qdb_cluster":[6939]},"id":5}]} 2024-05-30T06:53:30.987 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 47 2024-05-30T06:53:30.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed50e00640 1 -- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed280695b0 msgr2=0x7fed2806ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed50e00640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed280695b0 0x7fed2806ba70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0b6200 tx=0x7fed3c000ee0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed50e00640 1 -- 172.21.15.37:0/2366252160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c0b2cc0 msgr2=0x7fed4c0b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:30.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed50e00640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c0b2cc0 0x7fed4c0b3140 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fed34011990 tx=0x7fed34011d90 comp rx=0 tx=0).stop 2024-05-30T06:53:30.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed50e00640 1 -- 172.21.15.37:0/2366252160 shutdown_connections 2024-05-30T06:53:30.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed50e00640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed4c1f8240 0x7fed4c1f86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed50e00640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed4c0b2cc0 0x7fed4c0b3140 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed50e00640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed280695b0 0x7fed2806ba70 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed50e00640 1 --2- 172.21.15.37:0/2366252160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed300051d0 0x7fed4c142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:30.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed50e00640 1 -- 172.21.15.37:0/2366252160 >> 172.21.15.37:0/2366252160 conn(0x7fed4c0b6a60 msgr2=0x7fed4c0aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:30.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed50e00640 1 -- 172.21.15.37:0/2366252160 shutdown_connections 2024-05-30T06:53:30.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:30.986+0000 7fed50e00640 1 -- 172.21.15.37:0/2366252160 wait complete. 2024-05-30T06:53:31.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:53:31.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd949400640 1 Processor -- start 2024-05-30T06:53:31.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd949400640 1 -- start start 2024-05-30T06:53:31.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd949400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd94406f9a0 0x7fd9440b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd949400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd94415c8f0 con 0x7fd9440b2ec0 2024-05-30T06:53:31.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd949400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9440ccc80 con 0x7fd944155e60 2024-05-30T06:53:31.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd949400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9440ccff0 con 0x7fd94406f9a0 2024-05-30T06:53:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd943200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd9440b2ec0 0x7fd9440cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41942/0 (socket says 172.21.15.37:41942) 2024-05-30T06:53:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd943200640 1 -- 172.21.15.37:0/1009674196 learned_addr learned my addr 172.21.15.37:0/1009674196 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd941e00640 1 --2- 172.21.15.37:0/1009674196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd94406f9a0 0x7fd9440b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd941400640 1 -- 172.21.15.37:0/1009674196 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2035973003 0 0) 0x7fd94415c8f0 con 0x7fd9440b2ec0 2024-05-30T06:53:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd941400640 1 -- 172.21.15.37:0/1009674196 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd928003530 con 0x7fd9440b2ec0 2024-05-30T06:53:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd941400640 1 -- 172.21.15.37:0/1009674196 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471252908 0 0) 0x7fd9440ccc80 con 0x7fd944155e60 2024-05-30T06:53:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd941400640 1 -- 172.21.15.37:0/1009674196 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd94415c8f0 con 0x7fd944155e60 2024-05-30T06:53:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd941400640 1 -- 172.21.15.37:0/1009674196 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2098921605 0 0) 0x7fd928003530 con 0x7fd9440b2ec0 2024-05-30T06:53:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd941e00640 1 -- 172.21.15.37:0/1009674196 >> v1:172.21.15.105:6789/0 conn(0x7fd944155e60 legacy=0x7fd9440cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd941e00640 1 -- 172.21.15.37:0/1009674196 >> v1:172.21.15.37:6789/0 conn(0x7fd9440b2ec0 legacy=0x7fd9440cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.150+0000 7fd941e00640 1 -- 172.21.15.37:0/1009674196 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94415cbd0 con 0x7fd94406f9a0 2024-05-30T06:53:31.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.154+0000 7fd941e00640 1 --2- 172.21.15.37:0/1009674196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd94406f9a0 0x7fd9440b36a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd9300097f0 tx=0x7fd93001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9a237676b416a25 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:31.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.154+0000 7fd941400640 1 -- 172.21.15.37:0/1009674196 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9300b0070 con 0x7fd94406f9a0 2024-05-30T06:53:31.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.154+0000 7fd941400640 1 -- 172.21.15.37:0/1009674196 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9300ab400 con 0x7fd94406f9a0 2024-05-30T06:53:31.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.154+0000 7fd941400640 1 -- 172.21.15.37:0/1009674196 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c001a00 con 0x7fd94406f9a0 2024-05-30T06:53:31.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.154+0000 7fd949400640 1 -- 172.21.15.37:0/1009674196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd94406f9a0 msgr2=0x7fd9440b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.154+0000 7fd949400640 1 --2- 172.21.15.37:0/1009674196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd94406f9a0 0x7fd9440b36a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd9300097f0 tx=0x7fd93001c400 comp rx=0 tx=0).stop 2024-05-30T06:53:31.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.154+0000 7fd949400640 1 -- 172.21.15.37:0/1009674196 shutdown_connections 2024-05-30T06:53:31.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.154+0000 7fd949400640 1 --2- 172.21.15.37:0/1009674196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd94406f9a0 0x7fd9440b36a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.154+0000 7fd949400640 1 -- 172.21.15.37:0/1009674196 >> 172.21.15.37:0/1009674196 conn(0x7fd9440b23a0 msgr2=0x7fd9440b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:31.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.154+0000 7fd949400640 1 -- 172.21.15.37:0/1009674196 shutdown_connections 2024-05-30T06:53:31.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.154+0000 7fd949400640 1 -- 172.21.15.37:0/1009674196 wait complete. 2024-05-30T06:53:31.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd949400640 1 Processor -- start 2024-05-30T06:53:31.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd949400640 1 -- start start 2024-05-30T06:53:31.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd949400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd94406f9a0 0x7fd94414c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd949400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9440b2ec0 0x7fd94413dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd949400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd944155e60 0x7fd94415f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd949400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd94406ec60 con 0x7fd9440b2ec0 2024-05-30T06:53:31.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd949400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd94406eae0 con 0x7fd94406f9a0 2024-05-30T06:53:31.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd949400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd94406ede0 con 0x7fd944155e60 2024-05-30T06:53:31.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd941e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9440b2ec0 0x7fd94413dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd941e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9440b2ec0 0x7fd94413dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56894/0 (socket says 172.21.15.37:56894) 2024-05-30T06:53:31.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd941e00640 1 -- 172.21.15.37:0/2915685679 learned_addr learned my addr 172.21.15.37:0/2915685679 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:31.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd943200640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd944155e60 0x7fd94415f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd942800640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd94406f9a0 0x7fd94414c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd941e00640 1 -- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd944155e60 msgr2=0x7fd94415f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd941e00640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd944155e60 0x7fd94415f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd941e00640 1 -- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd94406f9a0 msgr2=0x7fd94414c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd941e00640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd94406f9a0 0x7fd94414c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd941e00640 1 -- 172.21.15.37:0/2915685679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94414dfe0 con 0x7fd9440b2ec0 2024-05-30T06:53:31.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd941e00640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9440b2ec0 0x7fd94413dea0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fd9300097f0 tx=0x7fd9300191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:31.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd93aa00640 1 -- 172.21.15.37:0/2915685679 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9300b8070 con 0x7fd9440b2ec0 2024-05-30T06:53:31.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd93aa00640 1 -- 172.21.15.37:0/2915685679 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd930004220 con 0x7fd9440b2ec0 2024-05-30T06:53:31.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd949400640 1 -- 172.21.15.37:0/2915685679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94414e2c0 con 0x7fd9440b2ec0 2024-05-30T06:53:31.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd93aa00640 1 -- 172.21.15.37:0/2915685679 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9300b0040 con 0x7fd9440b2ec0 2024-05-30T06:53:31.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.158+0000 7fd949400640 1 -- 172.21.15.37:0/2915685679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94414e880 con 0x7fd9440b2ec0 2024-05-30T06:53:31.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.162+0000 7fd949400640 1 -- 172.21.15.37:0/2915685679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd944068b20 con 0x7fd9440b2ec0 2024-05-30T06:53:31.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.162+0000 7fd93aa00640 1 -- 172.21.15.37:0/2915685679 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fd930003620 con 0x7fd9440b2ec0 2024-05-30T06:53:31.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.162+0000 7fd93aa00640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd924069580 0x7fd92406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.162+0000 7fd93aa00640 1 -- 172.21.15.37:0/2915685679 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5823+0+0 (secure 0 0 0) 0x7fd93011f510 con 0x7fd9440b2ec0 2024-05-30T06:53:31.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.162+0000 7fd942800640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd924069580 0x7fd92406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.162+0000 7fd942800640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd924069580 0x7fd92406ba40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd9340011f0 tx=0x7fd934009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:31.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.166+0000 7fd93aa00640 1 -- 172.21.15.37:0/2915685679 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd930015ff0 con 0x7fd9440b2ec0 2024-05-30T06:53:31.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.366+0000 7fd949400640 1 -- 172.21.15.37:0/2915685679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd944072fb0 con 0x7fd9440b2ec0 2024-05-30T06:53:31.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.366+0000 7fd93aa00640 1 -- 172.21.15.37:0/2915685679 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5186 (secure 0 0 0) 0x7fd9300f12d0 con 0x7fd9440b2ec0 2024-05-30T06:53:31.367 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:31.367 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6086,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/855324379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":855324379},{"type":"v1","addr":"172.21.15.105:6836","nonce":855324379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6089,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3353563250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3353563250},{"type":"v1","addr":"172.21.15.105:6837","nonce":3353563250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6933,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1946331427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1946331427},{"type":"v1","addr":"172.21.15.37:6834","nonce":1946331427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:50:35.512352+0000","modified":"2024-05-30T06:50:38.536531+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6939},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6939":{"gid":6939,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3396138806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3396138806},{"type":"v1","addr":"172.21.15.37:6835","nonce":3396138806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6939,"qdb_cluster":[6939]},"id":5}]} 2024-05-30T06:53:31.368 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 47 2024-05-30T06:53:31.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.370+0000 7fd949400640 1 -- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd924069580 msgr2=0x7fd92406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.370+0000 7fd949400640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd924069580 0x7fd92406ba40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd9340011f0 tx=0x7fd934009040 comp rx=0 tx=0).stop 2024-05-30T06:53:31.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.370+0000 7fd949400640 1 -- 172.21.15.37:0/2915685679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9440b2ec0 msgr2=0x7fd94413dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.370+0000 7fd949400640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9440b2ec0 0x7fd94413dea0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fd9300097f0 tx=0x7fd9300191a0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.370+0000 7fd949400640 1 -- 172.21.15.37:0/2915685679 shutdown_connections 2024-05-30T06:53:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.370+0000 7fd949400640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd944155e60 0x7fd94415f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.370+0000 7fd949400640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9440b2ec0 0x7fd94413dea0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.370+0000 7fd949400640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd924069580 0x7fd92406ba40 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.370+0000 7fd949400640 1 --2- 172.21.15.37:0/2915685679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd94406f9a0 0x7fd94414c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.370+0000 7fd949400640 1 -- 172.21.15.37:0/2915685679 >> 172.21.15.37:0/2915685679 conn(0x7fd9440b23a0 msgr2=0x7fd9440cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.370+0000 7fd949400640 1 -- 172.21.15.37:0/2915685679 shutdown_connections 2024-05-30T06:53:31.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.370+0000 7fd949400640 1 -- 172.21.15.37:0/2915685679 wait complete. 2024-05-30T06:53:31.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:53:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.530+0000 7fbfe1a00640 1 Processor -- start 2024-05-30T06:53:31.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfe1a00640 1 -- start start 2024-05-30T06:53:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfe1a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbfdc161fc0 0x7fbfdc0d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfe1a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbfdc06d480 0x7fbfdc0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfe1a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfdc06dc60 con 0x7fbfdc0ccff0 2024-05-30T06:53:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfe1a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fbfdc0d10c0 con 0x7fbfdc06d480 2024-05-30T06:53:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfe1a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbfdc0d0790 con 0x7fbfdc161fc0 2024-05-30T06:53:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfdb400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbfdc06d480 0x7fbfdc0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfdb400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbfdc06d480 0x7fbfdc0ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56906/0 (socket says 172.21.15.37:56906) 2024-05-30T06:53:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfdb400640 1 -- 172.21.15.37:0/3789851617 learned_addr learned my addr 172.21.15.37:0/3789851617 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfdbe00640 1 --2- 172.21.15.37:0/3789851617 >> v2:172.21.15.105:3300/0 conn(0x7fbfdc161fc0 0x7fbfdc0d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfdb400640 1 -- 172.21.15.37:0/3789851617 >> v2:172.21.15.105:3300/0 conn(0x7fbfdc161fc0 msgr2=0x7fbfdc0d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:31.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfdb400640 1 --2- 172.21.15.37:0/3789851617 >> v2:172.21.15.105:3300/0 conn(0x7fbfdc161fc0 0x7fbfdc0d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfdb400640 1 -- 172.21.15.37:0/3789851617 >> v1:172.21.15.37:6789/0 conn(0x7fbfdc0ccff0 legacy=0x7fbfdc09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.534+0000 7fbfdb400640 1 -- 172.21.15.37:0/3789851617 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfdc0d0a70 con 0x7fbfdc06d480 2024-05-30T06:53:31.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfdb400640 1 --2- 172.21.15.37:0/3789851617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfdc06d480 0x7fbfdc0ccab0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc06c940 tx=0x7fbfc801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50ec87b46e0a1a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfdaa00640 1 -- 172.21.15.37:0/3789851617 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc80b0070 con 0x7fbfdc06d480 2024-05-30T06:53:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfdaa00640 1 -- 172.21.15.37:0/3789851617 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc80ab600 con 0x7fbfdc06d480 2024-05-30T06:53:31.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfdaa00640 1 -- 172.21.15.37:0/3789851617 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc80ab9d0 con 0x7fbfdc06d480 2024-05-30T06:53:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfe1a00640 1 -- 172.21.15.37:0/3789851617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfdc06d480 msgr2=0x7fbfdc0ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfe1a00640 1 --2- 172.21.15.37:0/3789851617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfdc06d480 0x7fbfdc0ccab0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc06c940 tx=0x7fbfc801c520 comp rx=0 tx=0).stop 2024-05-30T06:53:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfe1a00640 1 -- 172.21.15.37:0/3789851617 shutdown_connections 2024-05-30T06:53:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfe1a00640 1 --2- 172.21.15.37:0/3789851617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfdc06d480 0x7fbfdc0ccab0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfe1a00640 1 --2- 172.21.15.37:0/3789851617 >> v2:172.21.15.105:3300/0 conn(0x7fbfdc161fc0 0x7fbfdc0d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfe1a00640 1 -- 172.21.15.37:0/3789851617 >> 172.21.15.37:0/3789851617 conn(0x7fbfdc0b3f50 msgr2=0x7fbfdc0b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfe1a00640 1 -- 172.21.15.37:0/3789851617 shutdown_connections 2024-05-30T06:53:31.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfe1a00640 1 -- 172.21.15.37:0/3789851617 wait complete. 2024-05-30T06:53:31.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfe1a00640 1 Processor -- start 2024-05-30T06:53:31.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.538+0000 7fbfe1a00640 1 -- start start 2024-05-30T06:53:31.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfe1a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfdc06d480 0x7fbfdc0b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfe1a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfdc0ccff0 0x7fbfdc0c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfe1a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfdc161fc0 0x7fbfdc09f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfe1a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbfdc16bc40 con 0x7fbfdc06d480 2024-05-30T06:53:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfe1a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbfdc16bac0 con 0x7fbfdc0ccff0 2024-05-30T06:53:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfe1a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbfdc16bdc0 con 0x7fbfdc161fc0 2024-05-30T06:53:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfdbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfdc06d480 0x7fbfdc0b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfdbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfdc06d480 0x7fbfdc0b66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56912/0 (socket says 172.21.15.37:56912) 2024-05-30T06:53:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfdbe00640 1 -- 172.21.15.37:0/96566999 learned_addr learned my addr 172.21.15.37:0/96566999 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfdb400640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfdc0ccff0 0x7fbfdc0c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfe1000640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfdc161fc0 0x7fbfdc09f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfdbe00640 1 -- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfdc161fc0 msgr2=0x7fbfdc09f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfdbe00640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfdc161fc0 0x7fbfdc09f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfdbe00640 1 -- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfdc0ccff0 msgr2=0x7fbfdc0c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfdbe00640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfdc0ccff0 0x7fbfdc0c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfdbe00640 1 -- 172.21.15.37:0/96566999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfdc0b3a90 con 0x7fbfdc06d480 2024-05-30T06:53:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfe1000640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfdc161fc0 0x7fbfdc09f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfdb400640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfdc0ccff0 0x7fbfdc0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfdbe00640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfdc06d480 0x7fbfdc0b66a0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00d620 tx=0x7fbfcc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfd3e00640 1 -- 172.21.15.37:0/96566999 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc00b620 con 0x7fbfdc06d480 2024-05-30T06:53:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfd3e00640 1 -- 172.21.15.37:0/96566999 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc019070 con 0x7fbfdc06d480 2024-05-30T06:53:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfd3e00640 1 -- 172.21.15.37:0/96566999 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc00b9e0 con 0x7fbfdc06d480 2024-05-30T06:53:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfe1a00640 1 -- 172.21.15.37:0/96566999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfdc09cd90 con 0x7fbfdc06d480 2024-05-30T06:53:31.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfe1a00640 1 -- 172.21.15.37:0/96566999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfdc09d350 con 0x7fbfdc06d480 2024-05-30T06:53:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfe1a00640 1 -- 172.21.15.37:0/96566999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfdc068ab0 con 0x7fbfdc06d480 2024-05-30T06:53:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.542+0000 7fbfd3e00640 1 -- 172.21.15.37:0/96566999 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fbfcc00bb80 con 0x7fbfdc06d480 2024-05-30T06:53:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.546+0000 7fbfd3e00640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbfbc0695d0 0x7fbfbc06ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.546+0000 7fbfd3e00640 1 -- 172.21.15.37:0/96566999 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5823+0+0 (secure 0 0 0) 0x7fbfcc0859e0 con 0x7fbfdc06d480 2024-05-30T06:53:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.546+0000 7fbfdb400640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbfbc0695d0 0x7fbfbc06ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.546+0000 7fbfdb400640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbfbc0695d0 0x7fbfbc06ba90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80ad000 tx=0x7fbfc80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:31.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.550+0000 7fbfd3e00640 1 -- 172.21.15.37:0/96566999 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbfcc0579f0 con 0x7fbfdc06d480 2024-05-30T06:53:31.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.714+0000 7fbfe1a00640 1 -- 172.21.15.37:0/96566999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbfdc0d1ef0 con 0x7fbfdc06d480 2024-05-30T06:53:31.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.718+0000 7fbfd3e00640 1 -- 172.21.15.37:0/96566999 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+16863 (secure 0 0 0) 0x7fbfcc0572f0 con 0x7fbfdc06d480 2024-05-30T06:53:31.717 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:31.717 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":77,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:53:30.513202+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:50:33.347094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-05-30T06:50:34.475297+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":11,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:53:31.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.718+0000 7fbfe1a00640 1 -- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbfbc0695d0 msgr2=0x7fbfbc06ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.718+0000 7fbfe1a00640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbfbc0695d0 0x7fbfbc06ba90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80ad000 tx=0x7fbfc80a6000 comp rx=0 tx=0).stop 2024-05-30T06:53:31.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.718+0000 7fbfe1a00640 1 -- 172.21.15.37:0/96566999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfdc06d480 msgr2=0x7fbfdc0b66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.718+0000 7fbfe1a00640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfdc06d480 0x7fbfdc0b66a0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00d620 tx=0x7fbfcc00dae0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.718+0000 7fbfe1a00640 1 -- 172.21.15.37:0/96566999 shutdown_connections 2024-05-30T06:53:31.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.718+0000 7fbfe1a00640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfdc161fc0 0x7fbfdc09f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.718+0000 7fbfe1a00640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbfbc0695d0 0x7fbfbc06ba90 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.718+0000 7fbfe1a00640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfdc0ccff0 0x7fbfdc0c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.718+0000 7fbfe1a00640 1 --2- 172.21.15.37:0/96566999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfdc06d480 0x7fbfdc0b66a0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.718+0000 7fbfe1a00640 1 -- 172.21.15.37:0/96566999 >> 172.21.15.37:0/96566999 conn(0x7fbfdc0b3f50 msgr2=0x7fbfdc1571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:31.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.718+0000 7fbfe1a00640 1 -- 172.21.15.37:0/96566999 shutdown_connections 2024-05-30T06:53:31.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.718+0000 7fbfe1a00640 1 -- 172.21.15.37:0/96566999 wait complete. 2024-05-30T06:53:31.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T06:53:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.882+0000 7f7a72a00640 1 Processor -- start 2024-05-30T06:53:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.882+0000 7f7a72a00640 1 -- start start 2024-05-30T06:53:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.882+0000 7f7a72a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7a6c155da0 0x7f7a6c0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.882+0000 7f7a72a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c0cd440 0x7f7a6c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.886+0000 7f7a72a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a6c15f310 con 0x7f7a6c06f5a0 2024-05-30T06:53:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.886+0000 7f7a72a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7a6c0b4760 con 0x7f7a6c155da0 2024-05-30T06:53:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.886+0000 7f7a72a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6c15f5f0 con 0x7f7a6c0cd440 2024-05-30T06:53:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.886+0000 7f7a63400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c0cd440 0x7f7a6c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.886+0000 7f7a6be00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7a6c155da0 0x7f7a6c0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.886+0000 7f7a63400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c0cd440 0x7f7a6c06f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34774/0 (socket says 172.21.15.37:34774) 2024-05-30T06:53:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.886+0000 7f7a63400640 1 -- 172.21.15.37:0/831875455 learned_addr learned my addr 172.21.15.37:0/831875455 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:31.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.886+0000 7f7a6be00640 1 -- 172.21.15.37:0/831875455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c0cd440 msgr2=0x7f7a6c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:31.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.886+0000 7f7a6be00640 1 --2- 172.21.15.37:0/831875455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c0cd440 0x7f7a6c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.886+0000 7f7a6be00640 1 -- 172.21.15.37:0/831875455 >> v1:172.21.15.105:6789/0 conn(0x7f7a6c06f5a0 legacy=0x7f7a6c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.886+0000 7f7a6be00640 1 -- 172.21.15.37:0/831875455 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6c15f8d0 con 0x7f7a6c155da0 2024-05-30T06:53:31.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.886+0000 7f7a63400640 1 --2- 172.21.15.37:0/831875455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c0cd440 0x7f7a6c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:31.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.886+0000 7f7a6be00640 1 --2- 172.21.15.37:0/831875455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a6c155da0 0x7f7a6c0cd950 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0097c0 tx=0x7f7a5c01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dc02e5e31498c0d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:31.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a6b400640 1 -- 172.21.15.37:0/831875455 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c0b0070 con 0x7f7a6c155da0 2024-05-30T06:53:31.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a6b400640 1 -- 172.21.15.37:0/831875455 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5c0ab600 con 0x7f7a6c155da0 2024-05-30T06:53:31.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a6b400640 1 -- 172.21.15.37:0/831875455 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c0ab9d0 con 0x7f7a6c155da0 2024-05-30T06:53:31.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 -- 172.21.15.37:0/831875455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a6c155da0 msgr2=0x7f7a6c0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 --2- 172.21.15.37:0/831875455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a6c155da0 0x7f7a6c0cd950 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0097c0 tx=0x7f7a5c01c380 comp rx=0 tx=0).stop 2024-05-30T06:53:31.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 -- 172.21.15.37:0/831875455 shutdown_connections 2024-05-30T06:53:31.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 --2- 172.21.15.37:0/831875455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c0cd440 0x7f7a6c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 --2- 172.21.15.37:0/831875455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a6c155da0 0x7f7a6c0cd950 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 -- 172.21.15.37:0/831875455 >> 172.21.15.37:0/831875455 conn(0x7f7a6c06bf60 msgr2=0x7f7a6c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:31.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 -- 172.21.15.37:0/831875455 shutdown_connections 2024-05-30T06:53:31.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 -- 172.21.15.37:0/831875455 wait complete. 2024-05-30T06:53:31.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 Processor -- start 2024-05-30T06:53:31.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 -- start start 2024-05-30T06:53:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c06f5a0 0x7f7a6c15e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a6c155da0 0x7f7a6c164980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a6c164ec0 0x7f7a6c165340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c166570 con 0x7f7a6c155da0 2024-05-30T06:53:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c06f9d0 con 0x7f7a6c164ec0 2024-05-30T06:53:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a72a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6c1666f0 con 0x7f7a6c06f5a0 2024-05-30T06:53:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a63400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a6c155da0 0x7f7a6c164980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a6be00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c06f5a0 0x7f7a6c15e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a63400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a6c155da0 0x7f7a6c164980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56918/0 (socket says 172.21.15.37:56918) 2024-05-30T06:53:31.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a6be00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c06f5a0 0x7f7a6c15e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34782/0 (socket says 172.21.15.37:34782) 2024-05-30T06:53:31.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a63400640 1 -- 172.21.15.37:0/1958886514 learned_addr learned my addr 172.21.15.37:0/1958886514 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:31.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.890+0000 7f7a70a00640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a6c164ec0 0x7f7a6c165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a63400640 1 -- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c06f5a0 msgr2=0x7f7a6c15e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a63400640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c06f5a0 0x7f7a6c15e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a63400640 1 -- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a6c164ec0 msgr2=0x7f7a6c165340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:31.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a63400640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a6c164ec0 0x7f7a6c165340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:31.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a63400640 1 -- 172.21.15.37:0/1958886514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6c158980 con 0x7f7a6c155da0 2024-05-30T06:53:31.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a6be00640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c06f5a0 0x7f7a6c15e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:31.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a63400640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a6c155da0 0x7f7a6c164980 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400e9d0 tx=0x7f7a5400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:31.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a68c00640 1 -- 172.21.15.37:0/1958886514 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54017070 con 0x7f7a6c155da0 2024-05-30T06:53:31.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a72a00640 1 -- 172.21.15.37:0/1958886514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6c15da00 con 0x7f7a6c155da0 2024-05-30T06:53:31.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a68c00640 1 -- 172.21.15.37:0/1958886514 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5400ca60 con 0x7f7a6c155da0 2024-05-30T06:53:31.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a72a00640 1 -- 172.21.15.37:0/1958886514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a6c15eb60 con 0x7f7a6c155da0 2024-05-30T06:53:31.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a68c00640 1 -- 172.21.15.37:0/1958886514 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5400ce10 con 0x7f7a6c155da0 2024-05-30T06:53:31.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a72a00640 1 -- 172.21.15.37:0/1958886514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a440052a0 con 0x7f7a6c155da0 2024-05-30T06:53:31.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.894+0000 7f7a68c00640 1 -- 172.21.15.37:0/1958886514 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f7a5401a070 con 0x7f7a6c155da0 2024-05-30T06:53:31.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.898+0000 7f7a68c00640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a48069580 0x7f7a4806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:31.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.898+0000 7f7a68c00640 1 -- 172.21.15.37:0/1958886514 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5823+0+0 (secure 0 0 0) 0x7f7a54085b30 con 0x7f7a6c155da0 2024-05-30T06:53:31.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.898+0000 7f7a6be00640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a48069580 0x7f7a4806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:31.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.898+0000 7f7a6be00640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a48069580 0x7f7a4806ba40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0ad000 tx=0x7f7a5c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:31.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:31.902+0000 7f7a68c00640 1 -- 172.21.15.37:0/1958886514 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7a54057180 con 0x7f7a6c155da0 2024-05-30T06:53:32.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.102+0000 7f7a72a00640 1 -- 172.21.15.37:0/1958886514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7a44005860 con 0x7f7a6c155da0 2024-05-30T06:53:32.102 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-30T06:53:32.102+0000 7fd1bb400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T06:53:32.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.102+0000 7f7a68c00640 1 -- 172.21.15.37:0/1958886514 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) ==== 161+0+0 (secure 0 0 0) 0x7f7a5405b480 con 0x7f7a6c155da0 2024-05-30T06:53:32.104 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T06:53:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.106+0000 7f7a72a00640 1 -- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a48069580 msgr2=0x7f7a4806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.106+0000 7f7a72a00640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a48069580 0x7f7a4806ba40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c0ad000 tx=0x7f7a5c0a6000 comp rx=0 tx=0).stop 2024-05-30T06:53:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.106+0000 7f7a72a00640 1 -- 172.21.15.37:0/1958886514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a6c155da0 msgr2=0x7f7a6c164980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:32.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.106+0000 7f7a72a00640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a6c155da0 0x7f7a6c164980 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400e9d0 tx=0x7f7a5400ee90 comp rx=0 tx=0).stop 2024-05-30T06:53:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.106+0000 7f7a72a00640 1 -- 172.21.15.37:0/1958886514 shutdown_connections 2024-05-30T06:53:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.106+0000 7f7a72a00640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7a48069580 0x7f7a4806ba40 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.106+0000 7f7a72a00640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a6c164ec0 0x7f7a6c165340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.106+0000 7f7a72a00640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a6c155da0 0x7f7a6c164980 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.106+0000 7f7a72a00640 1 --2- 172.21.15.37:0/1958886514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a6c06f5a0 0x7f7a6c15e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.106+0000 7f7a72a00640 1 -- 172.21.15.37:0/1958886514 >> 172.21.15.37:0/1958886514 conn(0x7f7a6c06bf60 msgr2=0x7f7a6c0cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:32.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.106+0000 7f7a72a00640 1 -- 172.21.15.37:0/1958886514 shutdown_connections 2024-05-30T06:53:32.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.106+0000 7f7a72a00640 1 -- 172.21.15.37:0/1958886514 wait complete. 2024-05-30T06:53:32.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T06:53:32.177 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-30T06:53:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43fee00640 1 Processor -- start 2024-05-30T06:53:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43fee00640 1 -- start start 2024-05-30T06:53:32.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43fee00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f43f815d350 0x7f43f806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43fee00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43f8142030 con 0x7f43f80b59d0 2024-05-30T06:53:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43fee00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43f8142310 con 0x7f43f815d7e0 2024-05-30T06:53:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43fee00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f43f81425f0 con 0x7f43f815d350 2024-05-30T06:53:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43f7400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f43f815d350 0x7f43f806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43f7400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f43f815d350 0x7f43f806df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56934/0 (socket says 172.21.15.37:56934) 2024-05-30T06:53:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43f7e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f43f80b59d0 0x7f43f80b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41966/0 (socket says 172.21.15.37:41966) 2024-05-30T06:53:32.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43f7400640 1 -- 172.21.15.37:0/838181852 learned_addr learned my addr 172.21.15.37:0/838181852 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43f7400640 1 -- 172.21.15.37:0/838181852 >> v1:172.21.15.105:6789/0 conn(0x7f43f815d7e0 legacy=0x7f43f806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43f7400640 1 -- 172.21.15.37:0/838181852 >> v1:172.21.15.37:6789/0 conn(0x7f43f80b59d0 legacy=0x7f43f80b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43f7400640 1 -- 172.21.15.37:0/838181852 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f81428d0 con 0x7f43f815d350 2024-05-30T06:53:32.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.278+0000 7f43f6a00640 1 -- 172.21.15.37:0/838181852 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2208614966 0 0) 0x7f43f8142030 con 0x7f43f80b59d0 2024-05-30T06:53:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.282+0000 7f43f7400640 1 --2- 172.21.15.37:0/838181852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f815d350 0x7f43f806df50 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f43e40098a0 tx=0x7f43e401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a5bc955f6abf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.282+0000 7f43f6a00640 1 -- 172.21.15.37:0/838181852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e40ab610 con 0x7f43f815d350 2024-05-30T06:53:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.282+0000 7f43f6a00640 1 -- 172.21.15.37:0/838181852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e40b0070 con 0x7f43f815d350 2024-05-30T06:53:32.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.282+0000 7f43f6a00640 1 -- 172.21.15.37:0/838181852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e40ab9d0 con 0x7f43f815d350 2024-05-30T06:53:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.282+0000 7f43fee00640 1 -- 172.21.15.37:0/838181852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f815d350 msgr2=0x7f43f806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.282+0000 7f43fee00640 1 --2- 172.21.15.37:0/838181852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f815d350 0x7f43f806df50 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f43e40098a0 tx=0x7f43e401c500 comp rx=0 tx=0).stop 2024-05-30T06:53:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.282+0000 7f43fee00640 1 -- 172.21.15.37:0/838181852 shutdown_connections 2024-05-30T06:53:32.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.282+0000 7f43fee00640 1 --2- 172.21.15.37:0/838181852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f815d350 0x7f43f806df50 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.282+0000 7f43fee00640 1 -- 172.21.15.37:0/838181852 >> 172.21.15.37:0/838181852 conn(0x7f43f806bf60 msgr2=0x7f43f80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.282+0000 7f43fee00640 1 -- 172.21.15.37:0/838181852 shutdown_connections 2024-05-30T06:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.282+0000 7f43fee00640 1 -- 172.21.15.37:0/838181852 wait complete. 2024-05-30T06:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.282+0000 7f43fee00640 1 Processor -- start 2024-05-30T06:53:32.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.282+0000 7f43fee00640 1 -- start start 2024-05-30T06:53:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43fee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43f80b59d0 0x7f43f81f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43fee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f815d350 0x7f43f813d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43fee00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43f815d7e0 0x7f43f80b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:32.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43fee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f43f8141d70 con 0x7f43f815d350 2024-05-30T06:53:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43fee00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f43f8141bf0 con 0x7f43f815d7e0 2024-05-30T06:53:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43fee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f43f816ae40 con 0x7f43f80b59d0 2024-05-30T06:53:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43f7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f815d350 0x7f43f813d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43f7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f815d350 0x7f43f813d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56950/0 (socket says 172.21.15.37:56950) 2024-05-30T06:53:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43f7400640 1 -- 172.21.15.37:0/3593859446 learned_addr learned my addr 172.21.15.37:0/3593859446 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43fce00640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43f815d7e0 0x7f43f80b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43f7e00640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43f80b59d0 0x7f43f81f7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43f7400640 1 -- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43f80b59d0 msgr2=0x7f43f81f7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43f7400640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43f80b59d0 0x7f43f81f7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43f7400640 1 -- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43f815d7e0 msgr2=0x7f43f80b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43f7400640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43f815d7e0 0x7f43f80b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:32.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43f7400640 1 -- 172.21.15.37:0/3593859446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43f80b5190 con 0x7f43f815d350 2024-05-30T06:53:32.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43f7e00640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43f80b59d0 0x7f43f81f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:32.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43f7400640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f815d350 0x7f43f813d930 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f43e40ad040 tx=0x7f43e401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:32.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43efe00640 1 -- 172.21.15.37:0/3593859446 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e40b4600 con 0x7f43f815d350 2024-05-30T06:53:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43efe00640 1 -- 172.21.15.37:0/3593859446 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e40b47e0 con 0x7f43f815d350 2024-05-30T06:53:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43efe00640 1 -- 172.21.15.37:0/3593859446 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e40b4bd0 con 0x7f43f815d350 2024-05-30T06:53:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43fee00640 1 -- 172.21.15.37:0/3593859446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43f815a950 con 0x7f43f815d350 2024-05-30T06:53:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43fee00640 1 -- 172.21.15.37:0/3593859446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43f815abf0 con 0x7f43f815d350 2024-05-30T06:53:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.286+0000 7f43fee00640 1 -- 172.21.15.37:0/3593859446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f8068bc0 con 0x7f43f815d350 2024-05-30T06:53:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.290+0000 7f43efe00640 1 -- 172.21.15.37:0/3593859446 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f43e40b3380 con 0x7f43f815d350 2024-05-30T06:53:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.290+0000 7f43efe00640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f43d8069580 0x7f43d806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.290+0000 7f43efe00640 1 -- 172.21.15.37:0/3593859446 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5881+0+0 (secure 0 0 0) 0x7f43e411f720 con 0x7f43f815d350 2024-05-30T06:53:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.290+0000 7f43f7e00640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f43d8069580 0x7f43d806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.290+0000 7f43f7e00640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f43d8069580 0x7f43d806ba40 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f43e8007fd0 tx=0x7f43e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:32.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.294+0000 7f43efe00640 1 -- 172.21.15.37:0/3593859446 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f43e40a8050 con 0x7f43f815d350 2024-05-30T06:53:32.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:32.494+0000 7f43fee00640 1 -- 172.21.15.37:0/3593859446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f43f806f0a0 con 0x7f43f815d350 2024-05-30T06:53:33.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.106+0000 7f43efe00640 1 -- 172.21.15.37:0/3593859446 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7f43e40160f0 con 0x7f43f815d350 2024-05-30T06:53:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.106+0000 7f43fee00640 1 -- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f43d8069580 msgr2=0x7f43d806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.106+0000 7f43fee00640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f43d8069580 0x7f43d806ba40 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f43e8007fd0 tx=0x7f43e8009040 comp rx=0 tx=0).stop 2024-05-30T06:53:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.106+0000 7f43fee00640 1 -- 172.21.15.37:0/3593859446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f815d350 msgr2=0x7f43f813d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.106+0000 7f43fee00640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f815d350 0x7f43f813d930 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f43e40ad040 tx=0x7f43e401ad40 comp rx=0 tx=0).stop 2024-05-30T06:53:33.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.106+0000 7f43fee00640 1 -- 172.21.15.37:0/3593859446 shutdown_connections 2024-05-30T06:53:33.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.106+0000 7f43fee00640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f43d8069580 0x7f43d806ba40 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:33.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.106+0000 7f43fee00640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43f815d7e0 0x7f43f80b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:33.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.106+0000 7f43fee00640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43f815d350 0x7f43f813d930 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:33.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.106+0000 7f43fee00640 1 --2- 172.21.15.37:0/3593859446 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f43f80b59d0 0x7f43f81f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:33.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.106+0000 7f43fee00640 1 -- 172.21.15.37:0/3593859446 >> 172.21.15.37:0/3593859446 conn(0x7f43f806bf60 msgr2=0x7f43f8074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:33.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.106+0000 7f43fee00640 1 -- 172.21.15.37:0/3593859446 shutdown_connections 2024-05-30T06:53:33.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.106+0000 7f43fee00640 1 -- 172.21.15.37:0/3593859446 wait complete. 2024-05-30T06:53:33.132 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T06:53:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d46200640 1 Processor -- start 2024-05-30T06:53:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d46200640 1 -- start start 2024-05-30T06:53:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d46200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3d4015eb60 0x7f3d4006d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d46200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d400cf630 0x7f3d400d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:33.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d46200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4009bba0 con 0x7f3d400b15c0 2024-05-30T06:53:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d46200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3d4009ab00 con 0x7f3d400cf630 2024-05-30T06:53:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d46200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3d4009ade0 con 0x7f3d4015eb60 2024-05-30T06:53:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d3fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d400cf630 0x7f3d400d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d3fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d400cf630 0x7f3d400d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56962/0 (socket says 172.21.15.37:56962) 2024-05-30T06:53:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d3fe00640 1 -- 172.21.15.37:0/2986893702 learned_addr learned my addr 172.21.15.37:0/2986893702 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d3f400640 1 --2- 172.21.15.37:0/2986893702 >> v2:172.21.15.105:3300/0 conn(0x7f3d4015eb60 0x7f3d4006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d3fe00640 1 -- 172.21.15.37:0/2986893702 >> v2:172.21.15.105:3300/0 conn(0x7f3d4015eb60 msgr2=0x7f3d4006d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d3fe00640 1 --2- 172.21.15.37:0/2986893702 >> v2:172.21.15.105:3300/0 conn(0x7f3d4015eb60 0x7f3d4006d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d3fe00640 1 -- 172.21.15.37:0/2986893702 >> v1:172.21.15.105:6789/0 conn(0x7f3d400b15c0 legacy=0x7f3d400cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d3fe00640 1 -- 172.21.15.37:0/2986893702 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4009b0c0 con 0x7f3d400cf630 2024-05-30T06:53:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.278+0000 7f3d3f400640 1 --2- 172.21.15.37:0/2986893702 >> v2:172.21.15.105:3300/0 conn(0x7f3d4015eb60 0x7f3d4006d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.282+0000 7f3d3fe00640 1 --2- 172.21.15.37:0/2986893702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d400cf630 0x7f3d400d0670 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f3d400b8730 tx=0x7f3d3801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a56f0355a44b19 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.282+0000 7f3d3ea00640 1 -- 172.21.15.37:0/2986893702 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d380ab610 con 0x7f3d400cf630 2024-05-30T06:53:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.282+0000 7f3d3ea00640 1 -- 172.21.15.37:0/2986893702 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d380b0070 con 0x7f3d400cf630 2024-05-30T06:53:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.282+0000 7f3d3ea00640 1 -- 172.21.15.37:0/2986893702 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d380ab9d0 con 0x7f3d400cf630 2024-05-30T06:53:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.282+0000 7f3d46200640 1 -- 172.21.15.37:0/2986893702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d400cf630 msgr2=0x7f3d400d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.282+0000 7f3d46200640 1 --2- 172.21.15.37:0/2986893702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d400cf630 0x7f3d400d0670 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f3d400b8730 tx=0x7f3d3801c520 comp rx=0 tx=0).stop 2024-05-30T06:53:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.282+0000 7f3d46200640 1 -- 172.21.15.37:0/2986893702 shutdown_connections 2024-05-30T06:53:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.282+0000 7f3d46200640 1 --2- 172.21.15.37:0/2986893702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d400cf630 0x7f3d400d0670 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.282+0000 7f3d46200640 1 --2- 172.21.15.37:0/2986893702 >> v2:172.21.15.105:3300/0 conn(0x7f3d4015eb60 0x7f3d4006d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.282+0000 7f3d46200640 1 -- 172.21.15.37:0/2986893702 >> 172.21.15.37:0/2986893702 conn(0x7f3d400d26a0 msgr2=0x7f3d400d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.282+0000 7f3d46200640 1 -- 172.21.15.37:0/2986893702 shutdown_connections 2024-05-30T06:53:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.282+0000 7f3d46200640 1 -- 172.21.15.37:0/2986893702 wait complete. 2024-05-30T06:53:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d46200640 1 Processor -- start 2024-05-30T06:53:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d46200640 1 -- start start 2024-05-30T06:53:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d46200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d400b15c0 0x7f3d40155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d46200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d400cf630 0x7f3d400c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d46200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d4015eb60 0x7f3d400c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d46200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d400d1540 con 0x7f3d400b15c0 2024-05-30T06:53:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d46200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3d400d13c0 con 0x7f3d4015eb60 2024-05-30T06:53:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d46200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3d400d16c0 con 0x7f3d400cf630 2024-05-30T06:53:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d3f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d400b15c0 0x7f3d40155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d3f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d400b15c0 0x7f3d40155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56968/0 (socket says 172.21.15.37:56968) 2024-05-30T06:53:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d3f400640 1 -- 172.21.15.37:0/2232533191 learned_addr learned my addr 172.21.15.37:0/2232533191 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d36a00640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d400cf630 0x7f3d400c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d3fe00640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d4015eb60 0x7f3d400c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d3f400640 1 -- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d400cf630 msgr2=0x7f3d400c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d3f400640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d400cf630 0x7f3d400c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d3f400640 1 -- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d4015eb60 msgr2=0x7f3d400c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d3f400640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d4015eb60 0x7f3d400c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d3f400640 1 -- 172.21.15.37:0/2232533191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4015d0c0 con 0x7f3d400b15c0 2024-05-30T06:53:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d36a00640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d400cf630 0x7f3d400c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:33.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d3f400640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d400b15c0 0x7f3d40155e70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009fa0 tx=0x7f3d3000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:33.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d37e00640 1 -- 172.21.15.37:0/2232533191 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3001a070 con 0x7f3d400b15c0 2024-05-30T06:53:33.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d37e00640 1 -- 172.21.15.37:0/2232533191 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d30003bc0 con 0x7f3d400b15c0 2024-05-30T06:53:33.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d37e00640 1 -- 172.21.15.37:0/2232533191 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30004030 con 0x7f3d400b15c0 2024-05-30T06:53:33.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d46200640 1 -- 172.21.15.37:0/2232533191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d4015d3a0 con 0x7f3d400b15c0 2024-05-30T06:53:33.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.286+0000 7f3d46200640 1 -- 172.21.15.37:0/2232533191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d400cd050 con 0x7f3d400b15c0 2024-05-30T06:53:33.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.290+0000 7f3d46200640 1 -- 172.21.15.37:0/2232533191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d40068d40 con 0x7f3d400b15c0 2024-05-30T06:53:33.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.290+0000 7f3d37e00640 1 -- 172.21.15.37:0/2232533191 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f3d3001d070 con 0x7f3d400b15c0 2024-05-30T06:53:33.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.290+0000 7f3d37e00640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d1c069580 0x7f3d1c06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:33.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.290+0000 7f3d37e00640 1 -- 172.21.15.37:0/2232533191 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5881+0+0 (secure 0 0 0) 0x7f3d30085b10 con 0x7f3d400b15c0 2024-05-30T06:53:33.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.290+0000 7f3d36a00640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d1c069580 0x7f3d1c06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:33.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.290+0000 7f3d36a00640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d1c069580 0x7f3d1c06ba40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3d400cf480 tx=0x7f3d28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:33.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.294+0000 7f3d37e00640 1 -- 172.21.15.37:0/2232533191 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d30010070 con 0x7f3d400b15c0 2024-05-30T06:53:33.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:33.458+0000 7f3d46200640 1 -- 172.21.15.37:0/2232533191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3d40070f20 con 0x7f3d400b15c0 2024-05-30T06:53:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.106+0000 7f3d37e00640 1 -- 172.21.15.37:0/2232533191 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) ==== 181+0+0 (secure 0 0 0) 0x7f3d30057160 con 0x7f3d400b15c0 2024-05-30T06:53:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-30T06:53:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.110+0000 7f3d46200640 1 -- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d1c069580 msgr2=0x7f3d1c06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.110+0000 7f3d46200640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d1c069580 0x7f3d1c06ba40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3d400cf480 tx=0x7f3d28009040 comp rx=0 tx=0).stop 2024-05-30T06:53:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.110+0000 7f3d46200640 1 -- 172.21.15.37:0/2232533191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d400b15c0 msgr2=0x7f3d40155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.110+0000 7f3d46200640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d400b15c0 0x7f3d40155e70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009fa0 tx=0x7f3d3000d560 comp rx=0 tx=0).stop 2024-05-30T06:53:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.110+0000 7f3d46200640 1 -- 172.21.15.37:0/2232533191 shutdown_connections 2024-05-30T06:53:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.110+0000 7f3d46200640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d1c069580 0x7f3d1c06ba40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.110+0000 7f3d46200640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d4015eb60 0x7f3d400c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.110+0000 7f3d46200640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d400cf630 0x7f3d400c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.110+0000 7f3d46200640 1 --2- 172.21.15.37:0/2232533191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d400b15c0 0x7f3d40155e70 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.110+0000 7f3d46200640 1 -- 172.21.15.37:0/2232533191 >> 172.21.15.37:0/2232533191 conn(0x7f3d400d26a0 msgr2=0x7f3d400af410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.110+0000 7f3d46200640 1 -- 172.21.15.37:0/2232533191 shutdown_connections 2024-05-30T06:53:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.110+0000 7f3d46200640 1 -- 172.21.15.37:0/2232533191 wait complete. 2024-05-30T06:53:34.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T06:53:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd30ac00640 1 Processor -- start 2024-05-30T06:53:34.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd30ac00640 1 -- start start 2024-05-30T06:53:34.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd30ac00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3040ced10 0x7fd30406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:34.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd30ac00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30415db00 con 0x7fd3040b59d0 2024-05-30T06:53:34.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd30ac00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30406e180 con 0x7fd30415d4e0 2024-05-30T06:53:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd30ac00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd30406df50 con 0x7fd3040ced10 2024-05-30T06:53:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd303e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3040ced10 0x7fd30406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd2fbe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd3040b59d0 0x7fd30415cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41976/0 (socket says 172.21.15.37:41976) 2024-05-30T06:53:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd303e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd3040ced10 0x7fd30406ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56970/0 (socket says 172.21.15.37:56970) 2024-05-30T06:53:34.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd2fbe00640 1 -- 172.21.15.37:0/2614072142 learned_addr learned my addr 172.21.15.37:0/2614072142 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd303e00640 1 -- 172.21.15.37:0/2614072142 >> v1:172.21.15.105:6789/0 conn(0x7fd30415d4e0 legacy=0x7fd30415deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd303e00640 1 -- 172.21.15.37:0/2614072142 >> v1:172.21.15.37:6789/0 conn(0x7fd3040b59d0 legacy=0x7fd30415cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd303400640 1 -- 172.21.15.37:0/2614072142 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352360890 0 0) 0x7fd30415db00 con 0x7fd3040b59d0 2024-05-30T06:53:34.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.290+0000 7fd303e00640 1 -- 172.21.15.37:0/2614072142 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30406e460 con 0x7fd3040ced10 2024-05-30T06:53:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.294+0000 7fd303e00640 1 --2- 172.21.15.37:0/2614072142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3040ced10 0x7fd30406ec60 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40097c0 tx=0x7fd2f401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6863e6924bdf0f86 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.294+0000 7fd303400640 1 -- 172.21.15.37:0/2614072142 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40b0070 con 0x7fd3040ced10 2024-05-30T06:53:34.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.294+0000 7fd303400640 1 -- 172.21.15.37:0/2614072142 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f40ab600 con 0x7fd3040ced10 2024-05-30T06:53:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.294+0000 7fd303400640 1 -- 172.21.15.37:0/2614072142 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40ab9d0 con 0x7fd3040ced10 2024-05-30T06:53:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.294+0000 7fd30ac00640 1 -- 172.21.15.37:0/2614072142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3040ced10 msgr2=0x7fd30406ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.294+0000 7fd30ac00640 1 --2- 172.21.15.37:0/2614072142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3040ced10 0x7fd30406ec60 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40097c0 tx=0x7fd2f401c4a0 comp rx=0 tx=0).stop 2024-05-30T06:53:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.294+0000 7fd30ac00640 1 -- 172.21.15.37:0/2614072142 shutdown_connections 2024-05-30T06:53:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.294+0000 7fd30ac00640 1 --2- 172.21.15.37:0/2614072142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3040ced10 0x7fd30406ec60 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:34.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.294+0000 7fd30ac00640 1 -- 172.21.15.37:0/2614072142 >> 172.21.15.37:0/2614072142 conn(0x7fd30406bf60 msgr2=0x7fd3040b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.294+0000 7fd30ac00640 1 -- 172.21.15.37:0/2614072142 shutdown_connections 2024-05-30T06:53:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.294+0000 7fd30ac00640 1 -- 172.21.15.37:0/2614072142 wait complete. 2024-05-30T06:53:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.294+0000 7fd30ac00640 1 Processor -- start 2024-05-30T06:53:34.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd30ac00640 1 -- start start 2024-05-30T06:53:34.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd30ac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3040b59d0 0x7fd3040cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:34.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd30ac00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3040ced10 0x7fd304144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:34.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd30ac00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd30415d4e0 0x7fd30414fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:34.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd30ac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd30416adf0 con 0x7fd3040b59d0 2024-05-30T06:53:34.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd30ac00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd30416ac70 con 0x7fd30415d4e0 2024-05-30T06:53:34.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd30ac00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd30416af70 con 0x7fd3040ced10 2024-05-30T06:53:34.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd303e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3040b59d0 0x7fd3040cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:34.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd303e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3040b59d0 0x7fd3040cdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56974/0 (socket says 172.21.15.37:56974) 2024-05-30T06:53:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd303e00640 1 -- 172.21.15.37:0/3260945639 learned_addr learned my addr 172.21.15.37:0/3260945639 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd2fbe00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3040ced10 0x7fd304144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd308c00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd30415d4e0 0x7fd30414fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd303e00640 1 -- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3040ced10 msgr2=0x7fd304144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd303e00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3040ced10 0x7fd304144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd303e00640 1 -- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd30415d4e0 msgr2=0x7fd30414fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd303e00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd30415d4e0 0x7fd30414fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd303e00640 1 -- 172.21.15.37:0/3260945639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd304144b40 con 0x7fd3040b59d0 2024-05-30T06:53:34.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd308c00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd30415d4e0 0x7fd30414fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:34.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd303e00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3040b59d0 0x7fd3040cdbe0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40ae040 tx=0x7fd2f401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:34.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd300c00640 1 -- 172.21.15.37:0/3260945639 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40b0050 con 0x7fd3040b59d0 2024-05-30T06:53:34.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd300c00640 1 -- 172.21.15.37:0/3260945639 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f40bc070 con 0x7fd3040b59d0 2024-05-30T06:53:34.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd300c00640 1 -- 172.21.15.37:0/3260945639 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40b5a70 con 0x7fd3040b59d0 2024-05-30T06:53:34.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd30ac00640 1 -- 172.21.15.37:0/3260945639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3041500a0 con 0x7fd3040b59d0 2024-05-30T06:53:34.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd30ac00640 1 -- 172.21.15.37:0/3260945639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd304150620 con 0x7fd3040b59d0 2024-05-30T06:53:34.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.298+0000 7fd30ac00640 1 -- 172.21.15.37:0/3260945639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd304068d40 con 0x7fd3040b59d0 2024-05-30T06:53:34.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.302+0000 7fd300c00640 1 -- 172.21.15.37:0/3260945639 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fd2f40ab4c0 con 0x7fd3040b59d0 2024-05-30T06:53:34.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.302+0000 7fd300c00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2e0069580 0x7fd2e006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:34.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.302+0000 7fd300c00640 1 -- 172.21.15.37:0/3260945639 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5443+0+0 (secure 0 0 0) 0x7fd2f4120230 con 0x7fd3040b59d0 2024-05-30T06:53:34.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.302+0000 7fd2fbe00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2e0069580 0x7fd2e006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:34.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.302+0000 7fd2fbe00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2e0069580 0x7fd2e006ba40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd304147e90 tx=0x7fd2ec007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:34.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.306+0000 7fd300c00640 1 -- 172.21.15.37:0/3260945639 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd2f4016090 con 0x7fd3040b59d0 2024-05-30T06:53:34.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:34.482+0000 7fd30ac00640 1 -- 172.21.15.37:0/3260945639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd304074e90 con 0x7fd3040b59d0 2024-05-30T06:53:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.114+0000 7fd300c00640 1 -- 172.21.15.37:0/3260945639 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) ==== 169+0+0 (secure 0 0 0) 0x7fd2f40f1f30 con 0x7fd3040b59d0 2024-05-30T06:53:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-30T06:53:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.118+0000 7fd30ac00640 1 -- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2e0069580 msgr2=0x7fd2e006ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.118+0000 7fd30ac00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2e0069580 0x7fd2e006ba40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd304147e90 tx=0x7fd2ec007d10 comp rx=0 tx=0).stop 2024-05-30T06:53:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.118+0000 7fd30ac00640 1 -- 172.21.15.37:0/3260945639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3040b59d0 msgr2=0x7fd3040cdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.118+0000 7fd30ac00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3040b59d0 0x7fd3040cdbe0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40ae040 tx=0x7fd2f401ace0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.118+0000 7fd30ac00640 1 -- 172.21.15.37:0/3260945639 shutdown_connections 2024-05-30T06:53:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.118+0000 7fd30ac00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd2e0069580 0x7fd2e006ba40 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.118+0000 7fd30ac00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd30415d4e0 0x7fd30414fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.118+0000 7fd30ac00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3040ced10 0x7fd304144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.118+0000 7fd30ac00640 1 --2- 172.21.15.37:0/3260945639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3040b59d0 0x7fd3040cdbe0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.118+0000 7fd30ac00640 1 -- 172.21.15.37:0/3260945639 >> 172.21.15.37:0/3260945639 conn(0x7fd30406bf60 msgr2=0x7fd3040b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.118+0000 7fd30ac00640 1 -- 172.21.15.37:0/3260945639 shutdown_connections 2024-05-30T06:53:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.118+0000 7fd30ac00640 1 -- 172.21.15.37:0/3260945639 wait complete. 2024-05-30T06:53:35.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_no_wait 2024-05-30T06:53:35.214 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:53:35.218 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:53:35.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c75000640 1 Processor -- start 2024-05-30T06:53:35.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c75000640 1 -- start start 2024-05-30T06:53:35.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c75000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c700d0380 0x7f1c700d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:35.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c75000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1c700b18a0 0x7f1c7006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:35.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c75000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c70070210 0x7f1c700af350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:35.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c75000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1c700d0ca0 con 0x7f1c70070210 2024-05-30T06:53:35.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c75000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1c700d2fa0 con 0x7f1c700b18a0 2024-05-30T06:53:35.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c75000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1c700d3280 con 0x7f1c700d0380 2024-05-30T06:53:35.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c6fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c70070210 0x7f1c700af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:35.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c6fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c70070210 0x7f1c700af350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56982/0 (socket says 172.21.15.37:56982) 2024-05-30T06:53:35.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c6fe00640 1 -- 172.21.15.37:0/3398127348 learned_addr learned my addr 172.21.15.37:0/3398127348 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:35.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c6f400640 1 --2- 172.21.15.37:0/3398127348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c700d0380 0x7f1c700d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:35.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c66a00640 1 --2- 172.21.15.37:0/3398127348 >> v2:172.21.15.105:3300/0 conn(0x7f1c700b18a0 0x7f1c7006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:35.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c6fe00640 1 -- 172.21.15.37:0/3398127348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c700d0380 msgr2=0x7f1c700d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:35.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c6fe00640 1 --2- 172.21.15.37:0/3398127348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c700d0380 0x7f1c700d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.318+0000 7f1c6fe00640 1 -- 172.21.15.37:0/3398127348 >> v2:172.21.15.105:3300/0 conn(0x7f1c700b18a0 msgr2=0x7f1c7006fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:35.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c6fe00640 1 --2- 172.21.15.37:0/3398127348 >> v2:172.21.15.105:3300/0 conn(0x7f1c700b18a0 0x7f1c7006fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c6fe00640 1 -- 172.21.15.37:0/3398127348 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c70071cb0 con 0x7f1c70070210 2024-05-30T06:53:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c6fe00640 1 --2- 172.21.15.37:0/3398127348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c70070210 0x7f1c700af350 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f1c700697b0 tx=0x7f1c6801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8fe4466f6acc06 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c6ea00640 1 -- 172.21.15.37:0/3398127348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c680a5830 con 0x7f1c70070210 2024-05-30T06:53:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c6ea00640 1 -- 172.21.15.37:0/3398127348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c7009ba70 con 0x7f1c70070210 2024-05-30T06:53:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c6ea00640 1 -- 172.21.15.37:0/3398127348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c680a5bf0 con 0x7f1c70070210 2024-05-30T06:53:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c75000640 1 -- 172.21.15.37:0/3398127348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c70070210 msgr2=0x7f1c700af350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c75000640 1 --2- 172.21.15.37:0/3398127348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c70070210 0x7f1c700af350 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f1c700697b0 tx=0x7f1c6801c9b0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c75000640 1 -- 172.21.15.37:0/3398127348 shutdown_connections 2024-05-30T06:53:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c75000640 1 --2- 172.21.15.37:0/3398127348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c70070210 0x7f1c700af350 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c75000640 1 --2- 172.21.15.37:0/3398127348 >> v2:172.21.15.105:3300/0 conn(0x7f1c700b18a0 0x7f1c7006fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c75000640 1 --2- 172.21.15.37:0/3398127348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c700d0380 0x7f1c700d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c75000640 1 -- 172.21.15.37:0/3398127348 >> 172.21.15.37:0/3398127348 conn(0x7f1c700d2480 msgr2=0x7f1c700d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:35.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c75000640 1 -- 172.21.15.37:0/3398127348 shutdown_connections 2024-05-30T06:53:35.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.322+0000 7f1c75000640 1 -- 172.21.15.37:0/3398127348 wait complete. 2024-05-30T06:53:35.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c75000640 1 Processor -- start 2024-05-30T06:53:35.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c75000640 1 -- start start 2024-05-30T06:53:35.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c75000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c70070210 0x7f1c7015ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:35.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c75000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c700b18a0 0x7f1c701532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:35.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c75000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c700d0380 0x7f1c7014a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:35.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c75000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7009b270 con 0x7f1c700d0380 2024-05-30T06:53:35.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c75000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1c70071940 con 0x7f1c70070210 2024-05-30T06:53:35.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c75000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1c7009b3f0 con 0x7f1c700b18a0 2024-05-30T06:53:35.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c6fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c700d0380 0x7f1c7014a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:35.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c6fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c700d0380 0x7f1c7014a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56990/0 (socket says 172.21.15.37:56990) 2024-05-30T06:53:35.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c6fe00640 1 -- 172.21.15.37:0/3388793491 learned_addr learned my addr 172.21.15.37:0/3388793491 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:35.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c6f400640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c70070210 0x7f1c7015ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:35.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c66a00640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c700b18a0 0x7f1c701532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:35.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c6fe00640 1 -- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c700b18a0 msgr2=0x7f1c701532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c6fe00640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c700b18a0 0x7f1c701532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c6fe00640 1 -- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c70070210 msgr2=0x7f1c7015ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c6fe00640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c70070210 0x7f1c7015ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c6fe00640 1 -- 172.21.15.37:0/3388793491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7015c3f0 con 0x7f1c700d0380 2024-05-30T06:53:35.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c6fe00640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c700d0380 0x7f1c7014a710 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f1c680af040 tx=0x7f1c68019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:35.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c67e00640 1 -- 172.21.15.37:0/3388793491 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c680b8670 con 0x7f1c700d0380 2024-05-30T06:53:35.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c67e00640 1 -- 172.21.15.37:0/3388793491 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c680be070 con 0x7f1c700d0380 2024-05-30T06:53:35.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c67e00640 1 -- 172.21.15.37:0/3388793491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c680b8a50 con 0x7f1c700d0380 2024-05-30T06:53:35.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.326+0000 7f1c75000640 1 -- 172.21.15.37:0/3388793491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7014aeb0 con 0x7f1c700d0380 2024-05-30T06:53:35.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.330+0000 7f1c75000640 1 -- 172.21.15.37:0/3388793491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c7015c6b0 con 0x7f1c700d0380 2024-05-30T06:53:35.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.330+0000 7f1c75000640 1 -- 172.21.15.37:0/3388793491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c70068ab0 con 0x7f1c700d0380 2024-05-30T06:53:35.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.330+0000 7f1c67e00640 1 -- 172.21.15.37:0/3388793491 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f1c680b8bf0 con 0x7f1c700d0380 2024-05-30T06:53:35.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.330+0000 7f1c67e00640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1c4c069580 0x7f1c4c06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:35.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.330+0000 7f1c67e00640 1 -- 172.21.15.37:0/3388793491 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 4971+0+0 (secure 0 0 0) 0x7f1c68120860 con 0x7f1c700d0380 2024-05-30T06:53:35.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.330+0000 7f1c6f400640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1c4c069580 0x7f1c4c06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:35.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.330+0000 7f1c6f400640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1c4c069580 0x7f1c4c06ba40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1c600079c0 tx=0x7f1c60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.334+0000 7f1c67e00640 1 -- 172.21.15.37:0/3388793491 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1c680165a0 con 0x7f1c700d0380 2024-05-30T06:53:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.510+0000 7f1c75000640 1 -- 172.21.15.37:0/3388793491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_no_wait"} v 0) -- 0x7f1c70070d90 con 0x7f1c700d0380 2024-05-30T06:53:35.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.514+0000 7f1c67e00640 1 -- 172.21.15.37:0/3388793491 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_no_wait"}]=0 v20) ==== 117+0+0 (secure 0 0 0) 0x7f1c680f2400 con 0x7f1c700d0380 2024-05-30T06:53:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.514+0000 7f1c75000640 1 -- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1c4c069580 msgr2=0x7f1c4c06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.514+0000 7f1c75000640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1c4c069580 0x7f1c4c06ba40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1c600079c0 tx=0x7f1c60008040 comp rx=0 tx=0).stop 2024-05-30T06:53:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.514+0000 7f1c75000640 1 -- 172.21.15.37:0/3388793491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c700d0380 msgr2=0x7f1c7014a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.514+0000 7f1c75000640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c700d0380 0x7f1c7014a710 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f1c680af040 tx=0x7f1c68019750 comp rx=0 tx=0).stop 2024-05-30T06:53:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.514+0000 7f1c75000640 1 -- 172.21.15.37:0/3388793491 shutdown_connections 2024-05-30T06:53:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.514+0000 7f1c75000640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c700d0380 0x7f1c7014a710 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.514+0000 7f1c75000640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1c700b18a0 0x7f1c701532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.514+0000 7f1c75000640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1c4c069580 0x7f1c4c06ba40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.514+0000 7f1c75000640 1 --2- 172.21.15.37:0/3388793491 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1c70070210 0x7f1c7015ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.514+0000 7f1c75000640 1 -- 172.21.15.37:0/3388793491 >> 172.21.15.37:0/3388793491 conn(0x7f1c700d2480 msgr2=0x7f1c700d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:35.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.518+0000 7f1c75000640 1 -- 172.21.15.37:0/3388793491 shutdown_connections 2024-05-30T06:53:35.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.518+0000 7f1c75000640 1 -- 172.21.15.37:0/3388793491 wait complete. 2024-05-30T06:53:35.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T06:53:35.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08f3000640 1 Processor -- start 2024-05-30T06:53:35.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08f3000640 1 -- start start 2024-05-30T06:53:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08f3000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f08ec155da0 0x7f08ec0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:35.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08f3000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08ec15f310 con 0x7f08ec0cd440 2024-05-30T06:53:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08f3000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08ec15f5f0 con 0x7f08ec06f770 2024-05-30T06:53:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08f3000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f08ec15f8d0 con 0x7f08ec155da0 2024-05-30T06:53:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08e3400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f08ec0cd440 0x7f08ec06f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41980/0 (socket says 172.21.15.37:41980) 2024-05-30T06:53:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08e3400640 1 -- 172.21.15.37:0/2405905061 learned_addr learned my addr 172.21.15.37:0/2405905061 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:35.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08ebe00640 1 --2- 172.21.15.37:0/2405905061 >> v2:172.21.15.105:3300/0 conn(0x7f08ec155da0 0x7f08ec0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08eb400640 1 -- 172.21.15.37:0/2405905061 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1666553887 0 0) 0x7f08ec15f310 con 0x7f08ec0cd440 2024-05-30T06:53:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08eb400640 1 -- 172.21.15.37:0/2405905061 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08d0003530 con 0x7f08ec0cd440 2024-05-30T06:53:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08eb400640 1 -- 172.21.15.37:0/2405905061 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080142844 0 0) 0x7f08ec15f5f0 con 0x7f08ec06f770 2024-05-30T06:53:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08ebe00640 1 -- 172.21.15.37:0/2405905061 >> v1:172.21.15.105:6789/0 conn(0x7f08ec06f770 legacy=0x7f08ec0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08ebe00640 1 -- 172.21.15.37:0/2405905061 >> v1:172.21.15.37:6789/0 conn(0x7f08ec0cd440 legacy=0x7f08ec06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.698+0000 7f08ebe00640 1 -- 172.21.15.37:0/2405905061 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ec15fbb0 con 0x7f08ec155da0 2024-05-30T06:53:35.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.702+0000 7f08ebe00640 1 --2- 172.21.15.37:0/2405905061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ec155da0 0x7f08ec0cd950 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0097c0 tx=0x7f08dc01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e4d3246c30b3e42 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:35.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.702+0000 7f08eb400640 1 -- 172.21.15.37:0/2405905061 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc0b0070 con 0x7f08ec155da0 2024-05-30T06:53:35.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.702+0000 7f08eb400640 1 -- 172.21.15.37:0/2405905061 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08dc0ab600 con 0x7f08ec155da0 2024-05-30T06:53:35.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.702+0000 7f08eb400640 1 -- 172.21.15.37:0/2405905061 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc0ab9d0 con 0x7f08ec155da0 2024-05-30T06:53:35.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.702+0000 7f08f3000640 1 -- 172.21.15.37:0/2405905061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ec155da0 msgr2=0x7f08ec0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.702+0000 7f08f3000640 1 --2- 172.21.15.37:0/2405905061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ec155da0 0x7f08ec0cd950 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0097c0 tx=0x7f08dc01c380 comp rx=0 tx=0).stop 2024-05-30T06:53:35.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.702+0000 7f08f3000640 1 -- 172.21.15.37:0/2405905061 shutdown_connections 2024-05-30T06:53:35.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.702+0000 7f08f3000640 1 --2- 172.21.15.37:0/2405905061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ec155da0 0x7f08ec0cd950 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.702+0000 7f08f3000640 1 -- 172.21.15.37:0/2405905061 >> 172.21.15.37:0/2405905061 conn(0x7f08ec06bf60 msgr2=0x7f08ec0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.702+0000 7f08f3000640 1 -- 172.21.15.37:0/2405905061 shutdown_connections 2024-05-30T06:53:35.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.702+0000 7f08f3000640 1 -- 172.21.15.37:0/2405905061 wait complete. 2024-05-30T06:53:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.702+0000 7f08f3000640 1 Processor -- start 2024-05-30T06:53:35.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f3000640 1 -- start start 2024-05-30T06:53:35.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f3000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08ec06f770 0x7f08ec14c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:35.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f3000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ec155da0 0x7f08ec165020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f3000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ec165560 0x7f08ec1695a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f3000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec06e320 con 0x7f08ec165560 2024-05-30T06:53:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f3000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec06e1a0 con 0x7f08ec155da0 2024-05-30T06:53:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f3000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f08ec06e4a0 con 0x7f08ec06f770 2024-05-30T06:53:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f1000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ec165560 0x7f08ec1695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f1000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ec165560 0x7f08ec1695a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56996/0 (socket says 172.21.15.37:56996) 2024-05-30T06:53:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f1000640 1 -- 172.21.15.37:0/497170066 learned_addr learned my addr 172.21.15.37:0/497170066 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08ebe00640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08ec06f770 0x7f08ec14c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08e3400640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ec155da0 0x7f08ec165020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f1000640 1 -- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08ec06f770 msgr2=0x7f08ec14c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f1000640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08ec06f770 0x7f08ec14c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f1000640 1 -- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ec155da0 msgr2=0x7f08ec165020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f1000640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ec155da0 0x7f08ec165020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f1000640 1 -- 172.21.15.37:0/497170066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ec165aa0 con 0x7f08ec165560 2024-05-30T06:53:35.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08ebe00640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08ec06f770 0x7f08ec14c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:35.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f1000640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ec165560 0x7f08ec1695a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f08e400c710 tx=0x7f08e400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:35.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08e8c00640 1 -- 172.21.15.37:0/497170066 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e4003db0 con 0x7f08ec165560 2024-05-30T06:53:35.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08e8c00640 1 -- 172.21.15.37:0/497170066 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e400ce20 con 0x7f08ec165560 2024-05-30T06:53:35.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08e8c00640 1 -- 172.21.15.37:0/497170066 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e40052b0 con 0x7f08ec165560 2024-05-30T06:53:35.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f3000640 1 -- 172.21.15.37:0/497170066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08ec166030 con 0x7f08ec165560 2024-05-30T06:53:35.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f3000640 1 -- 172.21.15.37:0/497170066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08ec156770 con 0x7f08ec165560 2024-05-30T06:53:35.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.706+0000 7f08f3000640 1 -- 172.21.15.37:0/497170066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08ec068bc0 con 0x7f08ec165560 2024-05-30T06:53:35.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.710+0000 7f08e8c00640 1 -- 172.21.15.37:0/497170066 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f08e4005450 con 0x7f08ec165560 2024-05-30T06:53:35.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.710+0000 7f08e8c00640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f08c8069580 0x7f08c806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:35.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.710+0000 7f08e8c00640 1 -- 172.21.15.37:0/497170066 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 4971+0+0 (secure 0 0 0) 0x7f08e4085810 con 0x7f08ec165560 2024-05-30T06:53:35.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.710+0000 7f08ebe00640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f08c8069580 0x7f08c806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:35.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.710+0000 7f08ebe00640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f08c8069580 0x7f08c806ba40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0ad000 tx=0x7f08dc0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:35.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.714+0000 7f08e8c00640 1 -- 172.21.15.37:0/497170066 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f08e40574b0 con 0x7f08ec165560 2024-05-30T06:53:35.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.878+0000 7f08f3000640 1 -- 172.21.15.37:0/497170066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f08ec0b6790 con 0x7f08ec165560 2024-05-30T06:53:35.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.882+0000 7f08e8c00640 1 -- 172.21.15.37:0/497170066 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f08e4056db0 con 0x7f08ec165560 2024-05-30T06:53:35.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.886+0000 7f08f3000640 1 -- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f08c8069580 msgr2=0x7f08c806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.886+0000 7f08f3000640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f08c8069580 0x7f08c806ba40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0ad000 tx=0x7f08dc0a6000 comp rx=0 tx=0).stop 2024-05-30T06:53:35.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.886+0000 7f08f3000640 1 -- 172.21.15.37:0/497170066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ec165560 msgr2=0x7f08ec1695a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:35.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.886+0000 7f08f3000640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ec165560 0x7f08ec1695a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f08e400c710 tx=0x7f08e400cbd0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.886+0000 7f08f3000640 1 -- 172.21.15.37:0/497170066 shutdown_connections 2024-05-30T06:53:35.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.886+0000 7f08f3000640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ec165560 0x7f08ec1695a0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.886+0000 7f08f3000640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f08c8069580 0x7f08c806ba40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.886+0000 7f08f3000640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08ec155da0 0x7f08ec165020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.886+0000 7f08f3000640 1 --2- 172.21.15.37:0/497170066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08ec06f770 0x7f08ec14c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:35.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.886+0000 7f08f3000640 1 -- 172.21.15.37:0/497170066 >> 172.21.15.37:0/497170066 conn(0x7f08ec06bf60 msgr2=0x7f08ec071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:35.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.886+0000 7f08f3000640 1 -- 172.21.15.37:0/497170066 shutdown_connections 2024-05-30T06:53:35.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:35.886+0000 7f08f3000640 1 -- 172.21.15.37:0/497170066 wait complete. 2024-05-30T06:53:35.905 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added' 2024-05-30T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.050+0000 7f2f3dc00640 1 Processor -- start 2024-05-30T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.050+0000 7f2f3dc00640 1 -- start start 2024-05-30T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.050+0000 7f2f3dc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f38070a20 0x7f2f3806f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.050+0000 7f2f3dc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f3815f080 con 0x7f2f38070e80 2024-05-30T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.050+0000 7f2f3dc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f3815f360 con 0x7f2f3806b960 2024-05-30T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.050+0000 7f2f3dc00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2f3815fc90 con 0x7f2f38070a20 2024-05-30T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.050+0000 7f2f2e000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f38070a20 0x7f2f3806f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.050+0000 7f2f37400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2f38070e80 0x7f2f3806f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41990/0 (socket says 172.21.15.37:41990) 2024-05-30T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.050+0000 7f2f37400640 1 -- 172.21.15.37:0/1883815317 learned_addr learned my addr 172.21.15.37:0/1883815317 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.050+0000 7f2f2e000640 1 -- 172.21.15.37:0/1883815317 >> v1:172.21.15.105:6789/0 conn(0x7f2f3806b960 legacy=0x7f2f3806bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.050+0000 7f2f2e000640 1 -- 172.21.15.37:0/1883815317 >> v1:172.21.15.37:6789/0 conn(0x7f2f38070e80 legacy=0x7f2f3806f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.050+0000 7f2f2e000640 1 -- 172.21.15.37:0/1883815317 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f3815f640 con 0x7f2f38070a20 2024-05-30T06:53:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.054+0000 7f2f2e000640 1 --2- 172.21.15.37:0/1883815317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f38070a20 0x7f2f3806f340 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2f200097c0 tx=0x7f2f2001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7871a260f6f256d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.054+0000 7f2f36000640 1 -- 172.21.15.37:0/1883815317 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f200b1070 con 0x7f2f38070a20 2024-05-30T06:53:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.054+0000 7f2f36000640 1 -- 172.21.15.37:0/1883815317 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f200ac410 con 0x7f2f38070a20 2024-05-30T06:53:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.054+0000 7f2f36000640 1 -- 172.21.15.37:0/1883815317 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f200ac7e0 con 0x7f2f38070a20 2024-05-30T06:53:36.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.054+0000 7f2f3dc00640 1 -- 172.21.15.37:0/1883815317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f38070a20 msgr2=0x7f2f3806f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:36.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.054+0000 7f2f3dc00640 1 --2- 172.21.15.37:0/1883815317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f38070a20 0x7f2f3806f340 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2f200097c0 tx=0x7f2f2001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:53:36.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.054+0000 7f2f3dc00640 1 -- 172.21.15.37:0/1883815317 shutdown_connections 2024-05-30T06:53:36.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.054+0000 7f2f3dc00640 1 --2- 172.21.15.37:0/1883815317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f38070a20 0x7f2f3806f340 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:36.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.054+0000 7f2f3dc00640 1 -- 172.21.15.37:0/1883815317 >> 172.21.15.37:0/1883815317 conn(0x7f2f380b6a60 msgr2=0x7f2f380b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:36.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.054+0000 7f2f3dc00640 1 -- 172.21.15.37:0/1883815317 shutdown_connections 2024-05-30T06:53:36.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.054+0000 7f2f3dc00640 1 -- 172.21.15.37:0/1883815317 wait complete. 2024-05-30T06:53:36.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f3dc00640 1 Processor -- start 2024-05-30T06:53:36.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f3dc00640 1 -- start start 2024-05-30T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f3dc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f3806b960 0x7f2f38142fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f3dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f38070a20 0x7f2f38140000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f3dc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f38070e80 0x7f2f38155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f3dc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f38160100 con 0x7f2f38070a20 2024-05-30T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f3dc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2f3815ff80 con 0x7f2f38070e80 2024-05-30T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f3dc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2f3816cdf0 con 0x7f2f3806b960 2024-05-30T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f2e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f38070a20 0x7f2f38140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f2e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f38070a20 0x7f2f38140000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57008/0 (socket says 172.21.15.37:57008) 2024-05-30T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f2e000640 1 -- 172.21.15.37:0/2247369590 learned_addr learned my addr 172.21.15.37:0/2247369590 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f37400640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f38070e80 0x7f2f38155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f36a00640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f3806b960 0x7f2f38142fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f2e000640 1 -- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f3806b960 msgr2=0x7f2f38142fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f2e000640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f3806b960 0x7f2f38142fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f2e000640 1 -- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f38070e80 msgr2=0x7f2f38155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f2e000640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f38070e80 0x7f2f38155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f2e000640 1 -- 172.21.15.37:0/2247369590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f381567e0 con 0x7f2f38070a20 2024-05-30T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f37400640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f38070e80 0x7f2f38155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f36a00640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f3806b960 0x7f2f38142fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f2e000640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f38070a20 0x7f2f38140000 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2f200097c0 tx=0x7f2f20019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f2f400640 1 -- 172.21.15.37:0/2247369590 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f200b1040 con 0x7f2f38070a20 2024-05-30T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f2f400640 1 -- 172.21.15.37:0/2247369590 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f200bb070 con 0x7f2f38070a20 2024-05-30T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f3dc00640 1 -- 172.21.15.37:0/2247369590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f38156500 con 0x7f2f38070a20 2024-05-30T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f2f400640 1 -- 172.21.15.37:0/2247369590 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f200b5410 con 0x7f2f38070a20 2024-05-30T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f3dc00640 1 -- 172.21.15.37:0/2247369590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f381427e0 con 0x7f2f38070a20 2024-05-30T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.058+0000 7f2f3dc00640 1 -- 172.21.15.37:0/2247369590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f38068b20 con 0x7f2f38070a20 2024-05-30T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.062+0000 7f2f2f400640 1 -- 172.21.15.37:0/2247369590 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f2f200b55b0 con 0x7f2f38070a20 2024-05-30T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.062+0000 7f2f2f400640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2f14069580 0x7f2f1406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.062+0000 7f2f2f400640 1 -- 172.21.15.37:0/2247369590 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 4971+0+0 (secure 0 0 0) 0x7f2f2011f480 con 0x7f2f38070a20 2024-05-30T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.062+0000 7f2f36a00640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2f14069580 0x7f2f1406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.062+0000 7f2f36a00640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2f14069580 0x7f2f1406ba40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2f28000f70 tx=0x7f2f28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.066+0000 7f2f2f400640 1 -- 172.21.15.37:0/2247369590 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2f20016090 con 0x7f2f38070a20 2024-05-30T06:53:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:36.290+0000 7f2f3dc00640 1 -- 172.21.15.37:0/2247369590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]} v 0) -- 0x7f2f381442a0 con 0x7f2f38070a20 2024-05-30T06:53:37.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.122+0000 7f2f2f400640 1 -- 172.21.15.37:0/2247369590 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_progress_drops_when_new_jobs_are_added"]}]=0 v531) ==== 174+0+0 (secure 0 0 0) 0x7f2f200f1120 con 0x7f2f38070a20 2024-05-30T06:53:37.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.126+0000 7f2f3dc00640 1 -- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2f14069580 msgr2=0x7f2f1406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.126+0000 7f2f3dc00640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2f14069580 0x7f2f1406ba40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2f28000f70 tx=0x7f2f28009040 comp rx=0 tx=0).stop 2024-05-30T06:53:37.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.126+0000 7f2f3dc00640 1 -- 172.21.15.37:0/2247369590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f38070a20 msgr2=0x7f2f38140000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.126+0000 7f2f3dc00640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f38070a20 0x7f2f38140000 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2f200097c0 tx=0x7f2f20019240 comp rx=0 tx=0).stop 2024-05-30T06:53:37.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.126+0000 7f2f3dc00640 1 -- 172.21.15.37:0/2247369590 shutdown_connections 2024-05-30T06:53:37.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.126+0000 7f2f3dc00640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2f14069580 0x7f2f1406ba40 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.126+0000 7f2f3dc00640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f38070e80 0x7f2f38155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.126+0000 7f2f3dc00640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f38070a20 0x7f2f38140000 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.126+0000 7f2f3dc00640 1 --2- 172.21.15.37:0/2247369590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f3806b960 0x7f2f38142fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.126+0000 7f2f3dc00640 1 -- 172.21.15.37:0/2247369590 >> 172.21.15.37:0/2247369590 conn(0x7f2f380b6a60 msgr2=0x7f2f380aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:37.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.126+0000 7f2f3dc00640 1 -- 172.21.15.37:0/2247369590 shutdown_connections 2024-05-30T06:53:37.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.126+0000 7f2f3dc00640 1 -- 172.21.15.37:0/2247369590 wait complete. 2024-05-30T06:53:37.151 INFO:tasks.cephfs_test_runner:Test that progress indicated by progress bar for ongoing+pending clones ... ok 2024-05-30T06:53:37.152 INFO:tasks.cephfs_test_runner:Starting test: test_stats_are_printed (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that the command "ceph fs clone status" prints progress stats 2024-05-30T06:53:37.152 INFO:tasks.cephfs_test_runner:test_stats_are_printed (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T06:53:37.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:53:37.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.298+0000 7fb44d400640 1 Processor -- start 2024-05-30T06:53:37.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.298+0000 7fb44d400640 1 -- start start 2024-05-30T06:53:37.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.298+0000 7fb44d400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb44806f9a0 0x7fb4480b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.298+0000 7fb44d400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb4480b2ec0 0x7fb4480cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.298+0000 7fb44d400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb44815c8f0 con 0x7fb448155e60 2024-05-30T06:53:37.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.298+0000 7fb44d400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb4480ccff0 con 0x7fb44806f9a0 2024-05-30T06:53:37.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.298+0000 7fb44d400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb4480ccc80 con 0x7fb4480b2ec0 2024-05-30T06:53:37.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.298+0000 7fb446800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb448155e60 0x7fb4480cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41994/0 (socket says 172.21.15.37:41994) 2024-05-30T06:53:37.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.298+0000 7fb446800640 1 -- 172.21.15.37:0/417655387 learned_addr learned my addr 172.21.15.37:0/417655387 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.298+0000 7fb43fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb44806f9a0 0x7fb4480b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.298+0000 7fb447200640 1 --2- 172.21.15.37:0/417655387 >> v2:172.21.15.105:3300/0 conn(0x7fb4480b2ec0 0x7fb4480cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.298+0000 7fb445e00640 1 -- 172.21.15.37:0/417655387 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113753774 0 0) 0x7fb44815c8f0 con 0x7fb448155e60 2024-05-30T06:53:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb445e00640 1 -- 172.21.15.37:0/417655387 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb42c003530 con 0x7fb448155e60 2024-05-30T06:53:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb43fe00640 1 -- 172.21.15.37:0/417655387 >> v2:172.21.15.105:3300/0 conn(0x7fb4480b2ec0 msgr2=0x7fb4480cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb43fe00640 1 --2- 172.21.15.37:0/417655387 >> v2:172.21.15.105:3300/0 conn(0x7fb4480b2ec0 0x7fb4480cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb43fe00640 1 -- 172.21.15.37:0/417655387 >> v1:172.21.15.37:6789/0 conn(0x7fb448155e60 legacy=0x7fb4480cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb43fe00640 1 -- 172.21.15.37:0/417655387 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44815cbd0 con 0x7fb44806f9a0 2024-05-30T06:53:37.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb43fe00640 1 --2- 172.21.15.37:0/417655387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44806f9a0 0x7fb4480b36a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fb4480718e0 tx=0x7fb43001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be294939186a675f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:37.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb445e00640 1 -- 172.21.15.37:0/417655387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4300b1070 con 0x7fb44806f9a0 2024-05-30T06:53:37.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb445e00640 1 -- 172.21.15.37:0/417655387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4300ac5f0 con 0x7fb44806f9a0 2024-05-30T06:53:37.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb445e00640 1 -- 172.21.15.37:0/417655387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4300ac9c0 con 0x7fb44806f9a0 2024-05-30T06:53:37.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb44d400640 1 -- 172.21.15.37:0/417655387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44806f9a0 msgr2=0x7fb4480b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb44d400640 1 --2- 172.21.15.37:0/417655387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44806f9a0 0x7fb4480b36a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fb4480718e0 tx=0x7fb43001c480 comp rx=0 tx=0).stop 2024-05-30T06:53:37.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb44d400640 1 -- 172.21.15.37:0/417655387 shutdown_connections 2024-05-30T06:53:37.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb44d400640 1 --2- 172.21.15.37:0/417655387 >> v2:172.21.15.105:3300/0 conn(0x7fb4480b2ec0 0x7fb4480cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb44d400640 1 --2- 172.21.15.37:0/417655387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44806f9a0 0x7fb4480b36a0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb44d400640 1 -- 172.21.15.37:0/417655387 >> 172.21.15.37:0/417655387 conn(0x7fb4480b23a0 msgr2=0x7fb4480b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:37.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb44d400640 1 -- 172.21.15.37:0/417655387 shutdown_connections 2024-05-30T06:53:37.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.302+0000 7fb44d400640 1 -- 172.21.15.37:0/417655387 wait complete. 2024-05-30T06:53:37.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb44d400640 1 Processor -- start 2024-05-30T06:53:37.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb44d400640 1 -- start start 2024-05-30T06:53:37.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb44d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44806f9a0 0x7fb44814c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb44d400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4480b2ec0 0x7fb44814b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb44d400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb448155e60 0x7fb448152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb44d400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481689f0 con 0x7fb44806f9a0 2024-05-30T06:53:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb44d400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb448168870 con 0x7fb448155e60 2024-05-30T06:53:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb44d400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb448168b70 con 0x7fb4480b2ec0 2024-05-30T06:53:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb446800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44806f9a0 0x7fb44814c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb446800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44806f9a0 0x7fb44814c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57028/0 (socket says 172.21.15.37:57028) 2024-05-30T06:53:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb446800640 1 -- 172.21.15.37:0/125550985 learned_addr learned my addr 172.21.15.37:0/125550985 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb43fe00640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4480b2ec0 0x7fb44814b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb447200640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb448155e60 0x7fb448152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb446800640 1 -- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4480b2ec0 msgr2=0x7fb44814b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb446800640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4480b2ec0 0x7fb44814b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb446800640 1 -- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb448155e60 msgr2=0x7fb448152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb446800640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb448155e60 0x7fb448152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb446800640 1 -- 172.21.15.37:0/125550985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44814b5b0 con 0x7fb44806f9a0 2024-05-30T06:53:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb447200640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb448155e60 0x7fb448152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb43fe00640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4480b2ec0 0x7fb44814b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb446800640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44806f9a0 0x7fb44814c400 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c3f0 tx=0x7fb43800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb43ea00640 1 -- 172.21.15.37:0/125550985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438017070 con 0x7fb44806f9a0 2024-05-30T06:53:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb43ea00640 1 -- 172.21.15.37:0/125550985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb438005cf0 con 0x7fb44806f9a0 2024-05-30T06:53:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb43ea00640 1 -- 172.21.15.37:0/125550985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4380072f0 con 0x7fb44806f9a0 2024-05-30T06:53:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb44d400640 1 -- 172.21.15.37:0/125550985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb448153210 con 0x7fb44806f9a0 2024-05-30T06:53:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.306+0000 7fb44d400640 1 -- 172.21.15.37:0/125550985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44814bc00 con 0x7fb44806f9a0 2024-05-30T06:53:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.310+0000 7fb44d400640 1 -- 172.21.15.37:0/125550985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb448068b20 con 0x7fb44806f9a0 2024-05-30T06:53:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.310+0000 7fb43ea00640 1 -- 172.21.15.37:0/125550985 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fb43801a070 con 0x7fb44806f9a0 2024-05-30T06:53:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.310+0000 7fb43ea00640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb424069580 0x7fb42406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.310+0000 7fb43ea00640 1 -- 172.21.15.37:0/125550985 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 4971+0+0 (secure 0 0 0) 0x7fb438084da0 con 0x7fb44806f9a0 2024-05-30T06:53:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.310+0000 7fb43fe00640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb424069580 0x7fb42406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.310+0000 7fb43fe00640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb424069580 0x7fb42406ba40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb4300ae000 tx=0x7fb4300a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:37.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.314+0000 7fb43ea00640 1 -- 172.21.15.37:0/125550985 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb438056a40 con 0x7fb44806f9a0 2024-05-30T06:53:37.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.478+0000 7fb44d400640 1 -- 172.21.15.37:0/125550985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb448072fb0 con 0x7fb44806f9a0 2024-05-30T06:53:37.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.482+0000 7fb43ea00640 1 -- 172.21.15.37:0/125550985 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+13052 (secure 0 0 0) 0x7fb438056340 con 0x7fb44806f9a0 2024-05-30T06:53:37.482 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:37.482 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":80,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:53:35.111226+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/3396138806":"2024-05-31T06:53:32.104510+0000","172.21.15.37:6832/3396138806":"2024-05-31T06:53:32.104510+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:53:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.482+0000 7fb44d400640 1 -- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb424069580 msgr2=0x7fb42406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.482+0000 7fb44d400640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb424069580 0x7fb42406ba40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb4300ae000 tx=0x7fb4300a7000 comp rx=0 tx=0).stop 2024-05-30T06:53:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.482+0000 7fb44d400640 1 -- 172.21.15.37:0/125550985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44806f9a0 msgr2=0x7fb44814c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.482+0000 7fb44d400640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44806f9a0 0x7fb44814c400 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c3f0 tx=0x7fb43800c8b0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.482+0000 7fb44d400640 1 -- 172.21.15.37:0/125550985 shutdown_connections 2024-05-30T06:53:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.482+0000 7fb44d400640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb424069580 0x7fb42406ba40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.482+0000 7fb44d400640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb448155e60 0x7fb448152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.482+0000 7fb44d400640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4480b2ec0 0x7fb44814b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.482+0000 7fb44d400640 1 --2- 172.21.15.37:0/125550985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44806f9a0 0x7fb44814c400 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.482+0000 7fb44d400640 1 -- 172.21.15.37:0/125550985 >> 172.21.15.37:0/125550985 conn(0x7fb4480b23a0 msgr2=0x7fb4480b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:37.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.482+0000 7fb44d400640 1 -- 172.21.15.37:0/125550985 shutdown_connections 2024-05-30T06:53:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.482+0000 7fb44d400640 1 -- 172.21.15.37:0/125550985 wait complete. 2024-05-30T06:53:37.503 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:53:37.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:53:37.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.646+0000 7f6660e00640 1 Processor -- start 2024-05-30T06:53:37.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.646+0000 7f6660e00640 1 -- start start 2024-05-30T06:53:37.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.646+0000 7f6660e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f665c06d200 0x7f665c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.646+0000 7f6660e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f665c0d0ac0 0x7f665c0d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.646+0000 7f6660e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f665c06db60 con 0x7f665c15e8b0 2024-05-30T06:53:37.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.646+0000 7f6660e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f665c163350 con 0x7f665c0d0ac0 2024-05-30T06:53:37.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.646+0000 7f6660e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f665c1627d0 con 0x7f665c06d200 2024-05-30T06:53:37.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.646+0000 7f665a800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f665c0d0ac0 0x7f665c0d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.646+0000 7f6659e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f665c15e8b0 0x7f665c0cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42758/0 (socket says 172.21.15.37:42758) 2024-05-30T06:53:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.646+0000 7f6659e00640 1 -- 172.21.15.37:0/3750936986 learned_addr learned my addr 172.21.15.37:0/3750936986 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.650+0000 7f6651400640 1 --2- 172.21.15.37:0/3750936986 >> v2:172.21.15.105:3300/0 conn(0x7f665c06d200 0x7f665c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.650+0000 7f665a800640 1 -- 172.21.15.37:0/3750936986 >> v2:172.21.15.105:3300/0 conn(0x7f665c06d200 msgr2=0x7f665c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.650+0000 7f665a800640 1 --2- 172.21.15.37:0/3750936986 >> v2:172.21.15.105:3300/0 conn(0x7f665c06d200 0x7f665c06d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.650+0000 7f665a800640 1 -- 172.21.15.37:0/3750936986 >> v1:172.21.15.37:6789/0 conn(0x7f665c15e8b0 legacy=0x7f665c0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.650+0000 7f665a800640 1 -- 172.21.15.37:0/3750936986 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c162ab0 con 0x7f665c0d0ac0 2024-05-30T06:53:37.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.650+0000 7f6659400640 1 -- 172.21.15.37:0/3750936986 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1209042733 0 0) 0x7f665c06db60 con 0x7f665c15e8b0 2024-05-30T06:53:37.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.650+0000 7f665a800640 1 --2- 172.21.15.37:0/3750936986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c0d0ac0 0x7f665c0d0ed0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f665c0d25b0 tx=0x7f665401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed29fbeb0a14b7b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:37.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.650+0000 7f6659400640 1 -- 172.21.15.37:0/3750936986 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66540b2070 con 0x7f665c0d0ac0 2024-05-30T06:53:37.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.650+0000 7f6659400640 1 -- 172.21.15.37:0/3750936986 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66540a58e0 con 0x7f665c0d0ac0 2024-05-30T06:53:37.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.650+0000 7f6659400640 1 -- 172.21.15.37:0/3750936986 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66540a5cb0 con 0x7f665c0d0ac0 2024-05-30T06:53:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.650+0000 7f6660e00640 1 -- 172.21.15.37:0/3750936986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c0d0ac0 msgr2=0x7f665c0d0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.650+0000 7f6660e00640 1 --2- 172.21.15.37:0/3750936986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c0d0ac0 0x7f665c0d0ed0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f665c0d25b0 tx=0x7f665401c930 comp rx=0 tx=0).stop 2024-05-30T06:53:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 -- 172.21.15.37:0/3750936986 shutdown_connections 2024-05-30T06:53:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 --2- 172.21.15.37:0/3750936986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c0d0ac0 0x7f665c0d0ed0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 --2- 172.21.15.37:0/3750936986 >> v2:172.21.15.105:3300/0 conn(0x7f665c06d200 0x7f665c06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 -- 172.21.15.37:0/3750936986 >> 172.21.15.37:0/3750936986 conn(0x7f665c0b4130 msgr2=0x7f665c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:37.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 -- 172.21.15.37:0/3750936986 shutdown_connections 2024-05-30T06:53:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 -- 172.21.15.37:0/3750936986 wait complete. 2024-05-30T06:53:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 Processor -- start 2024-05-30T06:53:37.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 -- start start 2024-05-30T06:53:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665c06d200 0x7f665c152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665c0d0ac0 0x7f665c0b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c15e8b0 0x7f665c0b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f665c0cf050 con 0x7f665c15e8b0 2024-05-30T06:53:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f665c162480 con 0x7f665c0d0ac0 2024-05-30T06:53:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6660e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f665c16b820 con 0x7f665c06d200 2024-05-30T06:53:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f665a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c15e8b0 0x7f665c0b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f665a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c15e8b0 0x7f665c0b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50848/0 (socket says 172.21.15.37:50848) 2024-05-30T06:53:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f665a800640 1 -- 172.21.15.37:0/3377950713 learned_addr learned my addr 172.21.15.37:0/3377950713 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6651400640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665c0d0ac0 0x7f665c0b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6659e00640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665c06d200 0x7f665c152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f665a800640 1 -- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665c06d200 msgr2=0x7f665c152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f665a800640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665c06d200 0x7f665c152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f665a800640 1 -- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665c0d0ac0 msgr2=0x7f665c0b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f665a800640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665c0d0ac0 0x7f665c0b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f665a800640 1 -- 172.21.15.37:0/3377950713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c1532e0 con 0x7f665c15e8b0 2024-05-30T06:53:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6651400640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665c0d0ac0 0x7f665c0b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f6659e00640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665c06d200 0x7f665c152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.654+0000 7f665a800640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c15e8b0 0x7f665c0b09a0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f665401a560 tx=0x7f66540196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.658+0000 7f6652a00640 1 -- 172.21.15.37:0/3377950713 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66540b2050 con 0x7f665c15e8b0 2024-05-30T06:53:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.658+0000 7f6652a00640 1 -- 172.21.15.37:0/3377950713 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66540be070 con 0x7f665c15e8b0 2024-05-30T06:53:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.658+0000 7f6652a00640 1 -- 172.21.15.37:0/3377950713 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66540ada90 con 0x7f665c15e8b0 2024-05-30T06:53:37.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.658+0000 7f6660e00640 1 -- 172.21.15.37:0/3377950713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665c155170 con 0x7f665c15e8b0 2024-05-30T06:53:37.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.658+0000 7f6660e00640 1 -- 172.21.15.37:0/3377950713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665c153980 con 0x7f665c15e8b0 2024-05-30T06:53:37.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.658+0000 7f6660e00640 1 -- 172.21.15.37:0/3377950713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f665c068bc0 con 0x7f665c15e8b0 2024-05-30T06:53:37.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.658+0000 7f6652a00640 1 -- 172.21.15.37:0/3377950713 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f66540adc30 con 0x7f665c15e8b0 2024-05-30T06:53:37.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.658+0000 7f6652a00640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6638069580 0x7f663806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.658+0000 7f6652a00640 1 -- 172.21.15.37:0/3377950713 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 4971+0+0 (secure 0 0 0) 0x7f6654120800 con 0x7f665c15e8b0 2024-05-30T06:53:37.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.658+0000 7f6659e00640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6638069580 0x7f663806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.662+0000 7f6659e00640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6638069580 0x7f663806ba40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f664c000f70 tx=0x7f664c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.662+0000 7f6652a00640 1 -- 172.21.15.37:0/3377950713 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6654016520 con 0x7f665c15e8b0 2024-05-30T06:53:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6660e00640 1 -- 172.21.15.37:0/3377950713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f665c071fb0 con 0x7f665c15e8b0 2024-05-30T06:53:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6652a00640 1 -- 172.21.15.37:0/3377950713 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) ==== 93+0+10 (secure 0 0 0) 0x7f66540ab340 con 0x7f665c15e8b0 2024-05-30T06:53:37.830 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:53:37.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6660e00640 1 -- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6638069580 msgr2=0x7f663806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6660e00640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6638069580 0x7f663806ba40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f664c000f70 tx=0x7f664c009040 comp rx=0 tx=0).stop 2024-05-30T06:53:37.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6660e00640 1 -- 172.21.15.37:0/3377950713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c15e8b0 msgr2=0x7f665c0b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6660e00640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c15e8b0 0x7f665c0b09a0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f665401a560 tx=0x7f66540196d0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6660e00640 1 -- 172.21.15.37:0/3377950713 shutdown_connections 2024-05-30T06:53:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6660e00640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c15e8b0 0x7f665c0b09a0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6660e00640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6638069580 0x7f663806ba40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6660e00640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665c0d0ac0 0x7f665c0b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6660e00640 1 --2- 172.21.15.37:0/3377950713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665c06d200 0x7f665c152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6660e00640 1 -- 172.21.15.37:0/3377950713 >> 172.21.15.37:0/3377950713 conn(0x7f665c0b4130 msgr2=0x7f665c09b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6660e00640 1 -- 172.21.15.37:0/3377950713 shutdown_connections 2024-05-30T06:53:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.830+0000 7f6660e00640 1 -- 172.21.15.37:0/3377950713 wait complete. 2024-05-30T06:53:37.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_stats_are_printed' 2024-05-30T06:53:37.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.990+0000 7f961ee00640 1 Processor -- start 2024-05-30T06:53:37.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.990+0000 7f961ee00640 1 -- start start 2024-05-30T06:53:37.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.990+0000 7f961ee00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96180c8fc0 0x7f96180d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.990+0000 7f961ee00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f961809aa60 0x7f961809aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:37.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.990+0000 7f961ee00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96180c9450 con 0x7f961815ed50 2024-05-30T06:53:37.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.990+0000 7f961ee00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f961815f130 con 0x7f96180c8fc0 2024-05-30T06:53:37.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.990+0000 7f961ee00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f96180d0f00 con 0x7f961809aa60 2024-05-30T06:53:37.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.994+0000 7f960f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96180c8fc0 0x7f96180d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.994+0000 7f960f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96180c8fc0 0x7f96180d09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50860/0 (socket says 172.21.15.37:50860) 2024-05-30T06:53:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.994+0000 7f960f400640 1 -- 172.21.15.37:0/3458315011 learned_addr learned my addr 172.21.15.37:0/3458315011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.994+0000 7f961ce00640 1 --2- 172.21.15.37:0/3458315011 >> v2:172.21.15.105:3300/0 conn(0x7f961809aa60 0x7f961809aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.994+0000 7f960f400640 1 -- 172.21.15.37:0/3458315011 >> v2:172.21.15.105:3300/0 conn(0x7f961809aa60 msgr2=0x7f961809aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.994+0000 7f960f400640 1 --2- 172.21.15.37:0/3458315011 >> v2:172.21.15.105:3300/0 conn(0x7f961809aa60 0x7f961809aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.994+0000 7f960f400640 1 -- 172.21.15.37:0/3458315011 >> v1:172.21.15.105:6789/0 conn(0x7f961815ed50 legacy=0x7f96180d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.994+0000 7f960f400640 1 -- 172.21.15.37:0/3458315011 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96180c7f20 con 0x7f96180c8fc0 2024-05-30T06:53:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.994+0000 7f960f400640 1 --2- 172.21.15.37:0/3458315011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180c8fc0 0x7f96180d09c0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f9618073860 tx=0x7f960001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbc50e975d846be server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.994+0000 7f9617400640 1 -- 172.21.15.37:0/3458315011 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96000a5880 con 0x7f96180c8fc0 2024-05-30T06:53:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.994+0000 7f9617400640 1 -- 172.21.15.37:0/3458315011 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96000a5a20 con 0x7f96180c8fc0 2024-05-30T06:53:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.994+0000 7f9617400640 1 -- 172.21.15.37:0/3458315011 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96000a5df0 con 0x7f96180c8fc0 2024-05-30T06:53:37.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 -- 172.21.15.37:0/3458315011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180c8fc0 msgr2=0x7f96180d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:37.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 --2- 172.21.15.37:0/3458315011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180c8fc0 0x7f96180d09c0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f9618073860 tx=0x7f960001c9c0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 -- 172.21.15.37:0/3458315011 shutdown_connections 2024-05-30T06:53:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 --2- 172.21.15.37:0/3458315011 >> v2:172.21.15.105:3300/0 conn(0x7f961809aa60 0x7f961809aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 --2- 172.21.15.37:0/3458315011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180c8fc0 0x7f96180d09c0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 -- 172.21.15.37:0/3458315011 >> 172.21.15.37:0/3458315011 conn(0x7f96180d26e0 msgr2=0x7f96180d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 -- 172.21.15.37:0/3458315011 shutdown_connections 2024-05-30T06:53:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 -- 172.21.15.37:0/3458315011 wait complete. 2024-05-30T06:53:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 Processor -- start 2024-05-30T06:53:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 -- start start 2024-05-30T06:53:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961809aa60 0x7f961814e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180c8fc0 0x7f961815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f961815ed50 0x7f961815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96180c7ad0 con 0x7f96180c8fc0 2024-05-30T06:53:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f96180c8aa0 con 0x7f961815ed50 2024-05-30T06:53:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f96180c7c50 con 0x7f961809aa60 2024-05-30T06:53:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f960f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180c8fc0 0x7f961815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f960f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180c8fc0 0x7f961815cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50874/0 (socket says 172.21.15.37:50874) 2024-05-30T06:53:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f960f400640 1 -- 172.21.15.37:0/104989889 learned_addr learned my addr 172.21.15.37:0/104989889 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ce00640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f961815ed50 0x7f961815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f9617e00640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961809aa60 0x7f961814e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f960f400640 1 -- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961809aa60 msgr2=0x7f961814e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f960f400640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961809aa60 0x7f961814e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f960f400640 1 -- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f961815ed50 msgr2=0x7f961815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:38.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f960f400640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f961815ed50 0x7f961815d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:38.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f960f400640 1 -- 172.21.15.37:0/104989889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96180b6cd0 con 0x7f96180c8fc0 2024-05-30T06:53:38.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f961ce00640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f961815ed50 0x7f961815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:38.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:37.998+0000 7f960f400640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180c8fc0 0x7f961815cc60 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f96000195d0 tx=0x7f9600019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:38.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:38.002+0000 7f9614c00640 1 -- 172.21.15.37:0/104989889 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96000b8670 con 0x7f96180c8fc0 2024-05-30T06:53:38.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:38.002+0000 7f9614c00640 1 -- 172.21.15.37:0/104989889 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96000be070 con 0x7f96180c8fc0 2024-05-30T06:53:38.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:38.002+0000 7f9614c00640 1 -- 172.21.15.37:0/104989889 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96000b8a70 con 0x7f96180c8fc0 2024-05-30T06:53:38.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:38.002+0000 7f961ee00640 1 -- 172.21.15.37:0/104989889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96180b6fb0 con 0x7f96180c8fc0 2024-05-30T06:53:38.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:38.002+0000 7f961ee00640 1 -- 172.21.15.37:0/104989889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f961815f800 con 0x7f96180c8fc0 2024-05-30T06:53:38.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:38.002+0000 7f961ee00640 1 -- 172.21.15.37:0/104989889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9618068b20 con 0x7f96180c8fc0 2024-05-30T06:53:38.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:38.002+0000 7f9614c00640 1 -- 172.21.15.37:0/104989889 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f96000b8c10 con 0x7f96180c8fc0 2024-05-30T06:53:38.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:38.002+0000 7f9614c00640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95f4069580 0x7f95f406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:38.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:38.002+0000 7f9614c00640 1 -- 172.21.15.37:0/104989889 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 4971+0+0 (secure 0 0 0) 0x7f9600120700 con 0x7f96180c8fc0 2024-05-30T06:53:38.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:38.002+0000 7f9617e00640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95f4069580 0x7f95f406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:38.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:38.006+0000 7f9617e00640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95f4069580 0x7f95f406ba40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f96080015b0 tx=0x7f9608009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:38.006+0000 7f9614c00640 1 -- 172.21.15.37:0/104989889 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f96000165e0 con 0x7f96180c8fc0 2024-05-30T06:53:38.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:38.230+0000 7f961ee00640 1 -- 172.21.15.37:0/104989889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_stats_are_printed"]} v 0) -- 0x7f96180cec50 con 0x7f96180c8fc0 2024-05-30T06:53:39.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.134+0000 7f9614c00640 1 -- 172.21.15.37:0/104989889 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_stats_are_printed"]}]=0 v533) ==== 156+0+0 (secure 0 0 0) 0x7f96000f2770 con 0x7f96180c8fc0 2024-05-30T06:53:39.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.138+0000 7f961ee00640 1 -- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95f4069580 msgr2=0x7f95f406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:39.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.138+0000 7f961ee00640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95f4069580 0x7f95f406ba40 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f96080015b0 tx=0x7f9608009040 comp rx=0 tx=0).stop 2024-05-30T06:53:39.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.138+0000 7f961ee00640 1 -- 172.21.15.37:0/104989889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180c8fc0 msgr2=0x7f961815cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:39.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.138+0000 7f961ee00640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180c8fc0 0x7f961815cc60 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f96000195d0 tx=0x7f9600019760 comp rx=0 tx=0).stop 2024-05-30T06:53:39.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.138+0000 7f961ee00640 1 -- 172.21.15.37:0/104989889 shutdown_connections 2024-05-30T06:53:39.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.138+0000 7f961ee00640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95f4069580 0x7f95f406ba40 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.138+0000 7f961ee00640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f961815ed50 0x7f961815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.138+0000 7f961ee00640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180c8fc0 0x7f961815cc60 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.138+0000 7f961ee00640 1 --2- 172.21.15.37:0/104989889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f961809aa60 0x7f961814e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.138+0000 7f961ee00640 1 -- 172.21.15.37:0/104989889 >> 172.21.15.37:0/104989889 conn(0x7f96180d26e0 msgr2=0x7f9618071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:39.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.138+0000 7f961ee00640 1 -- 172.21.15.37:0/104989889 shutdown_connections 2024-05-30T06:53:39.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.138+0000 7f961ee00640 1 -- 172.21.15.37:0/104989889 wait complete. 2024-05-30T06:53:39.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:53:39.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46f4a00640 1 Processor -- start 2024-05-30T06:53:39.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46f4a00640 1 -- start start 2024-05-30T06:53:39.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46f4a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f0162e70 0x7f46f00cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:39.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46f4a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46f0163250 0x7f46f01636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:39.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46f4a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f0164190 con 0x7f46f01668a0 2024-05-30T06:53:39.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46f4a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f46f006f8e0 con 0x7f46f0163250 2024-05-30T06:53:39.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46f4a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46f006ecd0 con 0x7f46f0162e70 2024-05-30T06:53:39.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46e7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46f0163250 0x7f46f01636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:39.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46e7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46f0163250 0x7f46f01636d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50886/0 (socket says 172.21.15.37:50886) 2024-05-30T06:53:39.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46e7e00640 1 -- 172.21.15.37:0/1047178178 learned_addr learned my addr 172.21.15.37:0/1047178178 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:39.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46ede00640 1 --2- 172.21.15.37:0/1047178178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f0162e70 0x7f46f00cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:39.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46e7e00640 1 -- 172.21.15.37:0/1047178178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f0162e70 msgr2=0x7f46f00cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:39.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46e7e00640 1 --2- 172.21.15.37:0/1047178178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f0162e70 0x7f46f00cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46e7e00640 1 -- 172.21.15.37:0/1047178178 >> v1:172.21.15.105:6789/0 conn(0x7f46f01668a0 legacy=0x7f46f0166d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:39.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46e7e00640 1 -- 172.21.15.37:0/1047178178 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f006efb0 con 0x7f46f0163250 2024-05-30T06:53:39.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.310+0000 7f46ede00640 1 --2- 172.21.15.37:0/1047178178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f0162e70 0x7f46f00cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:39.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46e7e00640 1 --2- 172.21.15.37:0/1047178178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46f0163250 0x7f46f01636d0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009870 tx=0x7f46d801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b2b3542d6eda78 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:39.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46ed400640 1 -- 172.21.15.37:0/1047178178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d80ab620 con 0x7f46f0163250 2024-05-30T06:53:39.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46ed400640 1 -- 172.21.15.37:0/1047178178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d80b0070 con 0x7f46f0163250 2024-05-30T06:53:39.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46ed400640 1 -- 172.21.15.37:0/1047178178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d80ab9e0 con 0x7f46f0163250 2024-05-30T06:53:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46f4a00640 1 -- 172.21.15.37:0/1047178178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46f0163250 msgr2=0x7f46f01636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46f4a00640 1 --2- 172.21.15.37:0/1047178178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46f0163250 0x7f46f01636d0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009870 tx=0x7f46d801c460 comp rx=0 tx=0).stop 2024-05-30T06:53:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46f4a00640 1 -- 172.21.15.37:0/1047178178 shutdown_connections 2024-05-30T06:53:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46f4a00640 1 --2- 172.21.15.37:0/1047178178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46f0163250 0x7f46f01636d0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46f4a00640 1 --2- 172.21.15.37:0/1047178178 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f0162e70 0x7f46f00cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46f4a00640 1 -- 172.21.15.37:0/1047178178 >> 172.21.15.37:0/1047178178 conn(0x7f46f006bf60 msgr2=0x7f46f00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46f4a00640 1 -- 172.21.15.37:0/1047178178 shutdown_connections 2024-05-30T06:53:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46f4a00640 1 -- 172.21.15.37:0/1047178178 wait complete. 2024-05-30T06:53:39.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46f4a00640 1 Processor -- start 2024-05-30T06:53:39.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.314+0000 7f46f4a00640 1 -- start start 2024-05-30T06:53:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46f4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46f0162e70 0x7f46f0144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46f4a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f0163250 0x7f46f0148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46f4a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46f01668a0 0x7f46f014e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46f4a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f46f00ccdf0 con 0x7f46f0162e70 2024-05-30T06:53:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46f4a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f46f006e960 con 0x7f46f01668a0 2024-05-30T06:53:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46f4a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46f00ccf70 con 0x7f46f0163250 2024-05-30T06:53:39.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46ede00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46f0162e70 0x7f46f0144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46ede00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46f0162e70 0x7f46f0144030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50898/0 (socket says 172.21.15.37:50898) 2024-05-30T06:53:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46ede00640 1 -- 172.21.15.37:0/1382327561 learned_addr learned my addr 172.21.15.37:0/1382327561 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46e7e00640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f0163250 0x7f46f0148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46ee800640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46f01668a0 0x7f46f014e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46ede00640 1 -- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f0163250 msgr2=0x7f46f0148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46ede00640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f0163250 0x7f46f0148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46ede00640 1 -- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46f01668a0 msgr2=0x7f46f014e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46ede00640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46f01668a0 0x7f46f014e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46ede00640 1 -- 172.21.15.37:0/1382327561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f0148d50 con 0x7f46f0162e70 2024-05-30T06:53:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46ede00640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46f0162e70 0x7f46f0144030 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c7c0 tx=0x7f46e000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:39.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46e6000640 1 -- 172.21.15.37:0/1382327561 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0007a30 con 0x7f46f0162e70 2024-05-30T06:53:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46e6000640 1 -- 172.21.15.37:0/1382327561 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e0007bd0 con 0x7f46f0162e70 2024-05-30T06:53:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46e6000640 1 -- 172.21.15.37:0/1382327561 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e00113f0 con 0x7f46f0162e70 2024-05-30T06:53:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46f4a00640 1 -- 172.21.15.37:0/1382327561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f00b3590 con 0x7f46f0162e70 2024-05-30T06:53:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46f4a00640 1 -- 172.21.15.37:0/1382327561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f00b3b50 con 0x7f46f0162e70 2024-05-30T06:53:39.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.318+0000 7f46f4a00640 1 -- 172.21.15.37:0/1382327561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f0151ad0 con 0x7f46f0162e70 2024-05-30T06:53:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.322+0000 7f46e6000640 1 -- 172.21.15.37:0/1382327561 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f46e0011590 con 0x7f46f0162e70 2024-05-30T06:53:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.322+0000 7f46e6000640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f46cc0695b0 0x7f46cc06ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:39.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.322+0000 7f46e6000640 1 -- 172.21.15.37:0/1382327561 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 4971+0+0 (secure 0 0 0) 0x7f46e0085a70 con 0x7f46f0162e70 2024-05-30T06:53:39.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.322+0000 7f46e7e00640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f46cc0695b0 0x7f46cc06ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:39.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.322+0000 7f46e7e00640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f46cc0695b0 0x7f46cc06ba70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f46d80af000 tx=0x7f46d80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:39.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.326+0000 7f46e6000640 1 -- 172.21.15.37:0/1382327561 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f46e0015020 con 0x7f46f0162e70 2024-05-30T06:53:39.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.490+0000 7f46f4a00640 1 -- 172.21.15.37:0/1382327561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f46f01656a0 con 0x7f46f0162e70 2024-05-30T06:53:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.494+0000 7f46e6000640 1 -- 172.21.15.37:0/1382327561 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f46e00570c0 con 0x7f46f0162e70 2024-05-30T06:53:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.494+0000 7f46f4a00640 1 -- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f46cc0695b0 msgr2=0x7f46cc06ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.494+0000 7f46f4a00640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f46cc0695b0 0x7f46cc06ba70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f46d80af000 tx=0x7f46d80a7000 comp rx=0 tx=0).stop 2024-05-30T06:53:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.494+0000 7f46f4a00640 1 -- 172.21.15.37:0/1382327561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46f0162e70 msgr2=0x7f46f0144030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.494+0000 7f46f4a00640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46f0162e70 0x7f46f0144030 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c7c0 tx=0x7f46e000cc80 comp rx=0 tx=0).stop 2024-05-30T06:53:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.494+0000 7f46f4a00640 1 -- 172.21.15.37:0/1382327561 shutdown_connections 2024-05-30T06:53:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.494+0000 7f46f4a00640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f46cc0695b0 0x7f46cc06ba70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.494+0000 7f46f4a00640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46f01668a0 0x7f46f014e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.494+0000 7f46f4a00640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46f0163250 0x7f46f0148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.494+0000 7f46f4a00640 1 --2- 172.21.15.37:0/1382327561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46f0162e70 0x7f46f0144030 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.494+0000 7f46f4a00640 1 -- 172.21.15.37:0/1382327561 >> 172.21.15.37:0/1382327561 conn(0x7f46f006bf60 msgr2=0x7f46f0074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.494+0000 7f46f4a00640 1 -- 172.21.15.37:0/1382327561 shutdown_connections 2024-05-30T06:53:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.494+0000 7f46f4a00640 1 -- 172.21.15.37:0/1382327561 wait complete. 2024-05-30T06:53:39.515 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:53:39.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:53:39.607 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:53:39.683 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:53:39.683 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:53:39.684 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:53:39.692 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:53:39.693 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:53:39.693 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:53:39.702 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:53:39.702 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:53:39.702 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:53:39.744 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:53:39.744 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:53:39.744 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:53:39.753 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:53:39.753 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T06:53:39.753 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:53:39.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.930+0000 7efe71200640 1 Processor -- start 2024-05-30T06:53:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.930+0000 7efe71200640 1 -- start start 2024-05-30T06:53:39.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe71200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe6c0b2e20 0x7efe6c160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:39.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe71200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe6c09ba70 0x7efe6c160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:39.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe71200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe6c0d0430 con 0x7efe6c1609c0 2024-05-30T06:53:39.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe71200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efe6c0b3200 con 0x7efe6c09ba70 2024-05-30T06:53:39.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe71200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efe6c0d01e0 con 0x7efe6c0b2e20 2024-05-30T06:53:39.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe6a800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe6c09ba70 0x7efe6c160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:39.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe6a800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe6c09ba70 0x7efe6c160e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50902/0 (socket says 172.21.15.37:50902) 2024-05-30T06:53:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe6a800640 1 -- 172.21.15.37:0/600882583 learned_addr learned my addr 172.21.15.37:0/600882583 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe69e00640 1 --2- 172.21.15.37:0/600882583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe6c0b2e20 0x7efe6c160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe6a800640 1 -- 172.21.15.37:0/600882583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe6c0b2e20 msgr2=0x7efe6c160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe6a800640 1 --2- 172.21.15.37:0/600882583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe6c0b2e20 0x7efe6c160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe6a800640 1 -- 172.21.15.37:0/600882583 >> v1:172.21.15.105:6789/0 conn(0x7efe6c1609c0 legacy=0x7efe6c0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:39.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe69400640 1 -- 172.21.15.37:0/600882583 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428647061 0 0) 0x7efe6c0d0430 con 0x7efe6c1609c0 2024-05-30T06:53:39.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.934+0000 7efe6a800640 1 -- 172.21.15.37:0/600882583 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe6c0d0710 con 0x7efe6c09ba70 2024-05-30T06:53:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe6a800640 1 --2- 172.21.15.37:0/600882583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c09ba70 0x7efe6c160e20 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7efe64009e50 tx=0x7efe6401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05031414066279a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:39.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe69400640 1 -- 172.21.15.37:0/600882583 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe640a57f0 con 0x7efe6c09ba70 2024-05-30T06:53:39.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe69400640 1 -- 172.21.15.37:0/600882583 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe640a5990 con 0x7efe6c09ba70 2024-05-30T06:53:39.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe69400640 1 -- 172.21.15.37:0/600882583 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe640a5d60 con 0x7efe6c09ba70 2024-05-30T06:53:39.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe71200640 1 -- 172.21.15.37:0/600882583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c09ba70 msgr2=0x7efe6c160e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:39.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe71200640 1 --2- 172.21.15.37:0/600882583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c09ba70 0x7efe6c160e20 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7efe64009e50 tx=0x7efe6401ca30 comp rx=0 tx=0).stop 2024-05-30T06:53:39.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe71200640 1 -- 172.21.15.37:0/600882583 shutdown_connections 2024-05-30T06:53:39.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe71200640 1 --2- 172.21.15.37:0/600882583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c09ba70 0x7efe6c160e20 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe71200640 1 --2- 172.21.15.37:0/600882583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe6c0b2e20 0x7efe6c160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe71200640 1 -- 172.21.15.37:0/600882583 >> 172.21.15.37:0/600882583 conn(0x7efe6c0b4100 msgr2=0x7efe6c0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:39.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe71200640 1 -- 172.21.15.37:0/600882583 shutdown_connections 2024-05-30T06:53:39.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe71200640 1 -- 172.21.15.37:0/600882583 wait complete. 2024-05-30T06:53:39.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe71200640 1 Processor -- start 2024-05-30T06:53:39.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.938+0000 7efe71200640 1 -- start start 2024-05-30T06:53:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe71200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe6c09ba70 0x7efe6c1576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe71200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe6c0b2e20 0x7efe6c0c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe71200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c1609c0 0x7efe6c15f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe71200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c0ce320 con 0x7efe6c1609c0 2024-05-30T06:53:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe71200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c0ce1a0 con 0x7efe6c09ba70 2024-05-30T06:53:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe71200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efe6c06cf30 con 0x7efe6c0b2e20 2024-05-30T06:53:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe6a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c1609c0 0x7efe6c15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe6a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c1609c0 0x7efe6c15f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50908/0 (socket says 172.21.15.37:50908) 2024-05-30T06:53:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe6a800640 1 -- 172.21.15.37:0/1946113270 learned_addr learned my addr 172.21.15.37:0/1946113270 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe69e00640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe6c09ba70 0x7efe6c1576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe61400640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe6c0b2e20 0x7efe6c0c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:39.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe6a800640 1 -- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe6c0b2e20 msgr2=0x7efe6c0c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:39.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe6a800640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe6c0b2e20 0x7efe6c0c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe6a800640 1 -- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe6c09ba70 msgr2=0x7efe6c1576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:39.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe6a800640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe6c09ba70 0x7efe6c1576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:39.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe6a800640 1 -- 172.21.15.37:0/1946113270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe6c06d210 con 0x7efe6c1609c0 2024-05-30T06:53:39.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe6a800640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c1609c0 0x7efe6c15f470 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7efe6401a660 tx=0x7efe640197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:39.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe62a00640 1 -- 172.21.15.37:0/1946113270 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe640b8670 con 0x7efe6c1609c0 2024-05-30T06:53:39.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe62a00640 1 -- 172.21.15.37:0/1946113270 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe640be070 con 0x7efe6c1609c0 2024-05-30T06:53:39.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe62a00640 1 -- 172.21.15.37:0/1946113270 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe640b8a30 con 0x7efe6c1609c0 2024-05-30T06:53:39.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe71200640 1 -- 172.21.15.37:0/1946113270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe6c15ec70 con 0x7efe6c1609c0 2024-05-30T06:53:39.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe71200640 1 -- 172.21.15.37:0/1946113270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe6c0c6ed0 con 0x7efe6c1609c0 2024-05-30T06:53:39.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe71200640 1 -- 172.21.15.37:0/1946113270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe6c068b20 con 0x7efe6c1609c0 2024-05-30T06:53:39.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.942+0000 7efe62a00640 1 -- 172.21.15.37:0/1946113270 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7efe640b8bd0 con 0x7efe6c1609c0 2024-05-30T06:53:39.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.946+0000 7efe62a00640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efe48069580 0x7efe4806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:39.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.946+0000 7efe62a00640 1 -- 172.21.15.37:0/1946113270 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 4971+0+0 (secure 0 0 0) 0x7efe64120660 con 0x7efe6c1609c0 2024-05-30T06:53:39.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.946+0000 7efe69e00640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efe48069580 0x7efe4806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:39.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.946+0000 7efe69e00640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efe48069580 0x7efe4806ba40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009af0 tx=0x7efe5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:39.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:39.950+0000 7efe62a00640 1 -- 172.21.15.37:0/1946113270 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe64016620 con 0x7efe6c1609c0 2024-05-30T06:53:40.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.146+0000 7efe71200640 1 -- 172.21.15.37:0/1946113270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe6c0d12f0 con 0x7efe6c1609c0 2024-05-30T06:53:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.146+0000 7efe62a00640 1 -- 172.21.15.37:0/1946113270 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+3872 (secure 0 0 0) 0x7efe640f2670 con 0x7efe6c1609c0 2024-05-30T06:53:40.148 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:40.148 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6086,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/855324379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":855324379},{"type":"v1","addr":"172.21.15.105:6836","nonce":855324379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6089,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/3353563250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3353563250},{"type":"v1","addr":"172.21.15.105:6837","nonce":3353563250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6933,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1946331427","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1946331427},{"type":"v1","addr":"172.21.15.37:6834","nonce":1946331427}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":7354,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1575416119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1575416119},{"type":"v1","addr":"172.21.15.37:6835","nonce":1575416119}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[]} 2024-05-30T06:53:40.148 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 49 2024-05-30T06:53:40.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.150+0000 7efe71200640 1 -- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efe48069580 msgr2=0x7efe4806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:40.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.150+0000 7efe71200640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efe48069580 0x7efe4806ba40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009af0 tx=0x7efe5c008040 comp rx=0 tx=0).stop 2024-05-30T06:53:40.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.150+0000 7efe71200640 1 -- 172.21.15.37:0/1946113270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c1609c0 msgr2=0x7efe6c15f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:40.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.150+0000 7efe71200640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c1609c0 0x7efe6c15f470 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7efe6401a660 tx=0x7efe640197d0 comp rx=0 tx=0).stop 2024-05-30T06:53:40.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.150+0000 7efe71200640 1 -- 172.21.15.37:0/1946113270 shutdown_connections 2024-05-30T06:53:40.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.150+0000 7efe71200640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c1609c0 0x7efe6c15f470 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:40.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.150+0000 7efe71200640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe6c0b2e20 0x7efe6c0c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:40.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.150+0000 7efe71200640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efe48069580 0x7efe4806ba40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:40.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.150+0000 7efe71200640 1 --2- 172.21.15.37:0/1946113270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe6c09ba70 0x7efe6c1576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:40.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.150+0000 7efe71200640 1 -- 172.21.15.37:0/1946113270 >> 172.21.15.37:0/1946113270 conn(0x7efe6c0b4100 msgr2=0x7efe6c15d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:40.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.150+0000 7efe71200640 1 -- 172.21.15.37:0/1946113270 shutdown_connections 2024-05-30T06:53:40.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.150+0000 7efe71200640 1 -- 172.21.15.37:0/1946113270 wait complete. 2024-05-30T06:53:40.171 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T06:53:40.171 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T06:53:40.171 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T06:53:40.171 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:53:40.171 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T06:53:40.171 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T06:53:40.171 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T06:53:40.172 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:53:40.172 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T06:53:40.172 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T06:53:40.172 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T06:53:40.172 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:53:40.172 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T06:53:40.172 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T06:53:40.172 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T06:53:40.173 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:53:40.185 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T06:53:40.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T06:53:40.186 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T06:53:40.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T06:53:40.188 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T06:53:40.188 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T06:53:40.189 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T06:53:40.189 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T06:53:40.231 INFO:tasks.ceph.mds.c:Started 2024-05-30T06:53:40.231 DEBUG:teuthology.parallel:result is None 2024-05-30T06:53:40.232 INFO:tasks.ceph.mds.a:Started 2024-05-30T06:53:40.233 DEBUG:teuthology.parallel:result is None 2024-05-30T06:53:40.239 INFO:tasks.ceph.mds.b:Started 2024-05-30T06:53:40.239 DEBUG:teuthology.parallel:result is None 2024-05-30T06:53:40.240 INFO:tasks.ceph.mds.d:Started 2024-05-30T06:53:40.241 DEBUG:teuthology.parallel:result is None 2024-05-30T06:53:40.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T06:53:40.317 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-30T06:53:40.318 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-30T06:53:40.329 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-05-30T06:53:40.330 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-05-30T06:53:40.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc60cc00640 1 Processor -- start 2024-05-30T06:53:40.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc60cc00640 1 -- start start 2024-05-30T06:53:40.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc60cc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc608155da0 0x7fc6080cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:40.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc60cc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc6080cd440 0x7fc60806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc60cc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc60815f310 con 0x7fc60806f5a0 2024-05-30T06:53:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc60cc00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc60806fa10 con 0x7fc608155da0 2024-05-30T06:53:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc60cc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc6080b4760 con 0x7fc6080cd440 2024-05-30T06:53:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc605e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc608155da0 0x7fc6080cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc605e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc608155da0 0x7fc6080cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50950/0 (socket says 172.21.15.37:50950) 2024-05-30T06:53:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc605e00640 1 -- 172.21.15.37:0/3777559058 learned_addr learned my addr 172.21.15.37:0/3777559058 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc5fd400640 1 --2- 172.21.15.37:0/3777559058 >> v2:172.21.15.105:3300/0 conn(0x7fc6080cd440 0x7fc60806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc605e00640 1 -- 172.21.15.37:0/3777559058 >> v2:172.21.15.105:3300/0 conn(0x7fc6080cd440 msgr2=0x7fc60806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc605e00640 1 --2- 172.21.15.37:0/3777559058 >> v2:172.21.15.105:3300/0 conn(0x7fc6080cd440 0x7fc60806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.386+0000 7fc605e00640 1 -- 172.21.15.37:0/3777559058 >> v1:172.21.15.105:6789/0 conn(0x7fc60806f5a0 legacy=0x7fc6080cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:40.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.390+0000 7fc605e00640 1 -- 172.21.15.37:0/3777559058 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60815f5f0 con 0x7fc608155da0 2024-05-30T06:53:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.390+0000 7fc605e00640 1 --2- 172.21.15.37:0/3777559058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc608155da0 0x7fc6080cd950 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc6080b2f00 tx=0x7fc5f801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21c6d95c84ed75f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.390+0000 7fc605400640 1 -- 172.21.15.37:0/3777559058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80b0070 con 0x7fc608155da0 2024-05-30T06:53:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.390+0000 7fc605400640 1 -- 172.21.15.37:0/3777559058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f80ab600 con 0x7fc608155da0 2024-05-30T06:53:40.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.390+0000 7fc605400640 1 -- 172.21.15.37:0/3777559058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80ab9d0 con 0x7fc608155da0 2024-05-30T06:53:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.390+0000 7fc60cc00640 1 -- 172.21.15.37:0/3777559058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc608155da0 msgr2=0x7fc6080cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.390+0000 7fc60cc00640 1 --2- 172.21.15.37:0/3777559058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc608155da0 0x7fc6080cd950 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc6080b2f00 tx=0x7fc5f801c400 comp rx=0 tx=0).stop 2024-05-30T06:53:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.390+0000 7fc60cc00640 1 -- 172.21.15.37:0/3777559058 shutdown_connections 2024-05-30T06:53:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.390+0000 7fc60cc00640 1 --2- 172.21.15.37:0/3777559058 >> v2:172.21.15.105:3300/0 conn(0x7fc6080cd440 0x7fc60806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.390+0000 7fc60cc00640 1 --2- 172.21.15.37:0/3777559058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc608155da0 0x7fc6080cd950 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.390+0000 7fc60cc00640 1 -- 172.21.15.37:0/3777559058 >> 172.21.15.37:0/3777559058 conn(0x7fc60806bf60 msgr2=0x7fc6080b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.390+0000 7fc60cc00640 1 -- 172.21.15.37:0/3777559058 shutdown_connections 2024-05-30T06:53:40.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.390+0000 7fc60cc00640 1 -- 172.21.15.37:0/3777559058 wait complete. 2024-05-30T06:53:40.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc60cc00640 1 Processor -- start 2024-05-30T06:53:40.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc60cc00640 1 -- start start 2024-05-30T06:53:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc60cc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc60806f5a0 0x7fc608156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc60cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc608155da0 0x7fc608160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc60cc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc60814d650 0x7fc60814dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc60cc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc6080b4e20 con 0x7fc608155da0 2024-05-30T06:53:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc60cc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc6080b4ca0 con 0x7fc60806f5a0 2024-05-30T06:53:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc60cc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc608168580 con 0x7fc60814d650 2024-05-30T06:53:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc5fd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc608155da0 0x7fc608160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc5fd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc608155da0 0x7fc608160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50966/0 (socket says 172.21.15.37:50966) 2024-05-30T06:53:40.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc5fd400640 1 -- 172.21.15.37:0/2380345881 learned_addr learned my addr 172.21.15.37:0/2380345881 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:40.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc605e00640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc60806f5a0 0x7fc608156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:40.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc606800640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc60814d650 0x7fc60814dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:40.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc606800640 1 -- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc60806f5a0 msgr2=0x7fc608156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:40.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc606800640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc60806f5a0 0x7fc608156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:40.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc606800640 1 -- 172.21.15.37:0/2380345881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc608155da0 msgr2=0x7fc608160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:40.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc606800640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc608155da0 0x7fc608160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:40.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc606800640 1 -- 172.21.15.37:0/2380345881 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60814fc20 con 0x7fc60814d650 2024-05-30T06:53:40.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc5fd400640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc608155da0 0x7fc608160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:40.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc606800640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc60814d650 0x7fc60814dae0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c730 tx=0x7fc60000cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc5fea00640 1 -- 172.21.15.37:0/2380345881 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600003b80 con 0x7fc60814d650 2024-05-30T06:53:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc5fea00640 1 -- 172.21.15.37:0/2380345881 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc600003d20 con 0x7fc60814d650 2024-05-30T06:53:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc5fea00640 1 -- 172.21.15.37:0/2380345881 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600005310 con 0x7fc60814d650 2024-05-30T06:53:40.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.394+0000 7fc60cc00640 1 -- 172.21.15.37:0/2380345881 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60814ff00 con 0x7fc60814d650 2024-05-30T06:53:40.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.398+0000 7fc60cc00640 1 -- 172.21.15.37:0/2380345881 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6081504c0 con 0x7fc60814d650 2024-05-30T06:53:40.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.398+0000 7fc60cc00640 1 -- 172.21.15.37:0/2380345881 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc608068bc0 con 0x7fc60814d650 2024-05-30T06:53:40.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.398+0000 7fc5fea00640 1 -- 172.21.15.37:0/2380345881 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fc6000056c0 con 0x7fc60814d650 2024-05-30T06:53:40.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.398+0000 7fc5fea00640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5e4069580 0x7fc5e406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:40.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.398+0000 7fc5fea00640 1 -- 172.21.15.37:0/2380345881 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(80..80 src has 1..80) ==== 4971+0+0 (secure 0 0 0) 0x7fc600085780 con 0x7fc60814d650 2024-05-30T06:53:40.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.398+0000 7fc605e00640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5e4069580 0x7fc5e406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:40.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.402+0000 7fc605e00640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5e4069580 0x7fc5e406ba40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80ad000 tx=0x7fc5f80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.402+0000 7fc5fea00640 1 -- 172.21.15.37:0/2380345881 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc600056dd0 con 0x7fc60814d650 2024-05-30T06:53:40.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:40.578+0000 7fc60cc00640 1 -- 172.21.15.37:0/2380345881 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc6080ce460 con 0x7fc60814d650 2024-05-30T06:53:41.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.146+0000 7fc5fea00640 1 -- 172.21.15.37:0/2380345881 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v82) ==== 97+0+0 (secure 0 0 0) 0x7fc60005b0d0 con 0x7fc60814d650 2024-05-30T06:53:41.149 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-30T06:53:41.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.150+0000 7fc60cc00640 1 -- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5e4069580 msgr2=0x7fc5e406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.150+0000 7fc60cc00640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5e4069580 0x7fc5e406ba40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc5f80ad000 tx=0x7fc5f80a6000 comp rx=0 tx=0).stop 2024-05-30T06:53:41.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.150+0000 7fc60cc00640 1 -- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc60814d650 msgr2=0x7fc60814dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.150+0000 7fc60cc00640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc60814d650 0x7fc60814dae0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c730 tx=0x7fc60000cbf0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.150+0000 7fc60cc00640 1 -- 172.21.15.37:0/2380345881 shutdown_connections 2024-05-30T06:53:41.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.150+0000 7fc60cc00640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc60814d650 0x7fc60814dae0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.150+0000 7fc60cc00640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc608155da0 0x7fc608160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.150+0000 7fc60cc00640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5e4069580 0x7fc5e406ba40 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.150+0000 7fc60cc00640 1 --2- 172.21.15.37:0/2380345881 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc60806f5a0 0x7fc608156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.150+0000 7fc60cc00640 1 -- 172.21.15.37:0/2380345881 >> 172.21.15.37:0/2380345881 conn(0x7fc60806bf60 msgr2=0x7fc60806eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:41.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.150+0000 7fc60cc00640 1 -- 172.21.15.37:0/2380345881 shutdown_connections 2024-05-30T06:53:41.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.150+0000 7fc60cc00640 1 -- 172.21.15.37:0/2380345881 wait complete. 2024-05-30T06:53:41.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T06:53:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcafa400640 1 Processor -- start 2024-05-30T06:53:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcafa400640 1 -- start start 2024-05-30T06:53:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcafa400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf406ff20 0x7fcaf40cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcafa400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcaf406d040 0x7fcaf40cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcafa400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf40b5170 con 0x7fcaf415b550 2024-05-30T06:53:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcafa400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf40b5410 con 0x7fcaf406d040 2024-05-30T06:53:41.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcafa400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf40b56f0 con 0x7fcaf406ff20 2024-05-30T06:53:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcaf9a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcaf406d040 0x7fcaf40cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcaf9a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcaf406d040 0x7fcaf40cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50982/0 (socket says 172.21.15.37:50982) 2024-05-30T06:53:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcaf9a00640 1 -- 172.21.15.37:0/2714666405 learned_addr learned my addr 172.21.15.37:0/2714666405 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcaf3e00640 1 --2- 172.21.15.37:0/2714666405 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf406ff20 0x7fcaf40cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcaf9a00640 1 -- 172.21.15.37:0/2714666405 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf406ff20 msgr2=0x7fcaf40cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcaf9a00640 1 --2- 172.21.15.37:0/2714666405 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf406ff20 0x7fcaf40cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcaf9a00640 1 -- 172.21.15.37:0/2714666405 >> v1:172.21.15.105:6789/0 conn(0x7fcaf415b550 legacy=0x7fcaf406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcaf9a00640 1 -- 172.21.15.37:0/2714666405 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf40b59d0 con 0x7fcaf406d040 2024-05-30T06:53:41.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.318+0000 7fcaf3400640 1 -- 172.21.15.37:0/2714666405 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572201551 0 0) 0x7fcaf40b5170 con 0x7fcaf415b550 2024-05-30T06:53:41.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.322+0000 7fcaf9a00640 1 --2- 172.21.15.37:0/2714666405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaf406d040 0x7fcaf40cf150 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009e50 tx=0x7fcaec01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e822e59ef59d4f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:41.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.322+0000 7fcaf3400640 1 -- 172.21.15.37:0/2714666405 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec0a58d0 con 0x7fcaf406d040 2024-05-30T06:53:41.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.322+0000 7fcaf3400640 1 -- 172.21.15.37:0/2714666405 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaec0a5a70 con 0x7fcaf406d040 2024-05-30T06:53:41.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.322+0000 7fcaf3400640 1 -- 172.21.15.37:0/2714666405 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaec0a5e40 con 0x7fcaf406d040 2024-05-30T06:53:41.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.322+0000 7fcafa400640 1 -- 172.21.15.37:0/2714666405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaf406d040 msgr2=0x7fcaf40cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.322+0000 7fcafa400640 1 --2- 172.21.15.37:0/2714666405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaf406d040 0x7fcaf40cf150 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fcaec009e50 tx=0x7fcaec01ca00 comp rx=0 tx=0).stop 2024-05-30T06:53:41.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.322+0000 7fcafa400640 1 -- 172.21.15.37:0/2714666405 shutdown_connections 2024-05-30T06:53:41.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.322+0000 7fcafa400640 1 --2- 172.21.15.37:0/2714666405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaf406d040 0x7fcaf40cf150 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.322+0000 7fcafa400640 1 --2- 172.21.15.37:0/2714666405 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf406ff20 0x7fcaf40cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.322+0000 7fcafa400640 1 -- 172.21.15.37:0/2714666405 >> 172.21.15.37:0/2714666405 conn(0x7fcaf40cd710 msgr2=0x7fcaf40cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:41.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.322+0000 7fcafa400640 1 -- 172.21.15.37:0/2714666405 shutdown_connections 2024-05-30T06:53:41.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.322+0000 7fcafa400640 1 -- 172.21.15.37:0/2714666405 wait complete. 2024-05-30T06:53:41.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.322+0000 7fcafa400640 1 Processor -- start 2024-05-30T06:53:41.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcafa400640 1 -- start start 2024-05-30T06:53:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcafa400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcaf406d040 0x7fcaf40ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcafa400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaf406ff20 0x7fcaf4153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcafa400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf415b550 0x7fcaf4155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcafa400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf415bab0 con 0x7fcaf406ff20 2024-05-30T06:53:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcafa400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf415b930 con 0x7fcaf406d040 2024-05-30T06:53:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcafa400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf406b960 con 0x7fcaf415b550 2024-05-30T06:53:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaf406ff20 0x7fcaf4153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:41.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaf406ff20 0x7fcaf4153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50984/0 (socket says 172.21.15.37:50984) 2024-05-30T06:53:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf3e00640 1 -- 172.21.15.37:0/623627151 learned_addr learned my addr 172.21.15.37:0/623627151 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf9000640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcaf406d040 0x7fcaf40ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf9a00640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf415b550 0x7fcaf4155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf3e00640 1 -- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf415b550 msgr2=0x7fcaf4155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf3e00640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf415b550 0x7fcaf4155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf3e00640 1 -- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcaf406d040 msgr2=0x7fcaf40ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf3e00640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcaf406d040 0x7fcaf40ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf3e00640 1 -- 172.21.15.37:0/623627151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf40ae9b0 con 0x7fcaf406ff20 2024-05-30T06:53:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf3e00640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaf406ff20 0x7fcaf4153c60 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e930 tx=0x7fcae000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf0c00640 1 -- 172.21.15.37:0/623627151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0017070 con 0x7fcaf406ff20 2024-05-30T06:53:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf0c00640 1 -- 172.21.15.37:0/623627151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae000ca00 con 0x7fcaf406ff20 2024-05-30T06:53:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcaf0c00640 1 -- 172.21.15.37:0/623627151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae000cdb0 con 0x7fcaf406ff20 2024-05-30T06:53:41.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcafa400640 1 -- 172.21.15.37:0/623627151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf40aec90 con 0x7fcaf406ff20 2024-05-30T06:53:41.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcafa400640 1 -- 172.21.15.37:0/623627151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf40af250 con 0x7fcaf406ff20 2024-05-30T06:53:41.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.326+0000 7fcafa400640 1 -- 172.21.15.37:0/623627151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf4075580 con 0x7fcaf406ff20 2024-05-30T06:53:41.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.330+0000 7fcaf0c00640 1 -- 172.21.15.37:0/623627151 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fcae001a070 con 0x7fcaf406ff20 2024-05-30T06:53:41.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.330+0000 7fcaf0c00640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcad4069580 0x7fcad406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:41.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.330+0000 7fcaf0c00640 1 -- 172.21.15.37:0/623627151 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4885+0+0 (secure 0 0 0) 0x7fcae0085c60 con 0x7fcaf406ff20 2024-05-30T06:53:41.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.330+0000 7fcaf9000640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcad4069580 0x7fcad406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:41.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.330+0000 7fcaf9000640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcad4069580 0x7fcad406ba40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4159f90 tx=0x7fcae8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:41.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.334+0000 7fcaf0c00640 1 -- 172.21.15.37:0/623627151 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcae0057370 con 0x7fcaf406ff20 2024-05-30T06:53:41.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.562+0000 7fcafa400640 1 -- 172.21.15.37:0/623627151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fcaf40677c0 con 0x7fcaf406ff20 2024-05-30T06:53:41.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.562+0000 7fcaf0c00640 1 -- 172.21.15.37:0/623627151 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fcae005b670 con 0x7fcaf406ff20 2024-05-30T06:53:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:41.564 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:53:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-30T06:53:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-30T06:53:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmcRfnBBAAk60J/SRTolMhKoS8b8A9jQ==", 2024-05-30T06:53:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:53:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:53:41.564 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:53:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-30T06:53:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmzScrERAAbIJ5somf+sguc6jEuR04zg==", 2024-05-30T06:53:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:53:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:53:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:53:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-30T06:53:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm2jEhDBAAGKUYGtJznRYpt1LHlMOTrw==", 2024-05-30T06:53:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:53:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:53:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:53:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.566 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-30T06:53:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm95RdGBAAaaaNAKnr4Dtmu+L1NaMVbw==", 2024-05-30T06:53:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:53:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:53:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:53:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-30T06:53:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCFH1hmygxjHhAA1ee1eBP6dvsC0K9w+6d0OQ==", 2024-05-30T06:53:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.567 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCIH1hmNJsBKRAAhns5CNodS7CKFU1Jg3PFCA==", 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.568 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCLH1hmlx5FNBAAn2Iann8U/uTZy0tFcFx04w==", 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCPH1hmxJnxAhAAt5cEb3YVLDhkQD5WjLQuog==", 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:53:41.569 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:53:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-30T06:53:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCUH1hmEn5cOBAAFzBuH8TO418e4obqTNeIXg==", 2024-05-30T06:53:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:53:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:53:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.570 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-30T06:53:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCYH1hmij3RCBAAHzQPoM1ClYGGEt6ly6ZrqQ==", 2024-05-30T06:53:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:53:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:53:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-30T06:53:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCbH1hmDqdpERAA46/Bs4B/xVjviQ1gNpNaaw==", 2024-05-30T06:53:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.571 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:53:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:53:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.572 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-30T06:53:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCeH1hmnrfVHRAAlqk48vSVw45YDCXWWb/MUA==", 2024-05-30T06:53:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:53:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:53:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-30T06:53:41.573 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A==", 2024-05-30T06:53:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:53:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2024-05-30T06:53:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T06:53:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-30T06:53:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmf8sdJhAATAP7EzLJxXXnXeEQL9fdpw==", 2024-05-30T06:53:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:53:41.574 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:53:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:53:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:53:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-30T06:53:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm1qB9IhAAszAwOgm2Igb1DM4diPC7ow==", 2024-05-30T06:53:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:53:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:53:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:53:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:53:41.575 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-30T06:53:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmY6AULBAAYNza0fpC3KO69ulNQaSldQ==", 2024-05-30T06:53:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:53:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:53:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:53:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:53:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.576 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-30T06:53:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmbSCrJBAAhn69RBUeyuaAMWiB3o7ByQ==", 2024-05-30T06:53:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:53:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:53:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:53:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-30T06:53:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmN/fjABAAdldbCncRiHy6RFEF9H7gnQ==", 2024-05-30T06:53:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.577 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:53:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:53:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:53:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-30T06:53:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmNdeSOBAA3V4vK0bNlWFoosV41f/ASQ==", 2024-05-30T06:53:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:53:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:53:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:53:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:53:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.578 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:41.579 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-30T06:53:41.579 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:53:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.566+0000 7fcafa400640 1 -- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcad4069580 msgr2=0x7fcad406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.566+0000 7fcafa400640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcad4069580 0x7fcad406ba40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4159f90 tx=0x7fcae8009040 comp rx=0 tx=0).stop 2024-05-30T06:53:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.566+0000 7fcafa400640 1 -- 172.21.15.37:0/623627151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaf406ff20 msgr2=0x7fcaf4153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.566+0000 7fcafa400640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaf406ff20 0x7fcaf4153c60 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fcae000e930 tx=0x7fcae000edf0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.566+0000 7fcafa400640 1 -- 172.21.15.37:0/623627151 shutdown_connections 2024-05-30T06:53:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.566+0000 7fcafa400640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf415b550 0x7fcaf4155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.566+0000 7fcafa400640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcaf406ff20 0x7fcaf4153c60 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.566+0000 7fcafa400640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcad4069580 0x7fcad406ba40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.566+0000 7fcafa400640 1 --2- 172.21.15.37:0/623627151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcaf406d040 0x7fcaf40ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.566+0000 7fcafa400640 1 -- 172.21.15.37:0/623627151 >> 172.21.15.37:0/623627151 conn(0x7fcaf40cd710 msgr2=0x7fcaf406e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.566+0000 7fcafa400640 1 -- 172.21.15.37:0/623627151 shutdown_connections 2024-05-30T06:53:41.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.566+0000 7fcafa400640 1 -- 172.21.15.37:0/623627151 wait complete. 2024-05-30T06:53:41.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:53:41.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.726+0000 7f359f800640 1 Processor -- start 2024-05-30T06:53:41.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.726+0000 7f359f800640 1 -- start start 2024-05-30T06:53:41.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.726+0000 7f359f800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35980ce8d0 0x7f35980ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:41.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.726+0000 7f359f800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35980cd120 con 0x7f359806e000 2024-05-30T06:53:41.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.726+0000 7f359f800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35980cd400 con 0x7f359815cd80 2024-05-30T06:53:41.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.726+0000 7f359f800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f35980a9530 con 0x7f35980ce8d0 2024-05-30T06:53:41.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.730+0000 7f359ce00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f359806e000 0x7f35980ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42774/0 (socket says 172.21.15.37:42774) 2024-05-30T06:53:41.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.730+0000 7f359ce00640 1 -- 172.21.15.37:0/4037609426 learned_addr learned my addr 172.21.15.37:0/4037609426 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:41.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.730+0000 7f359d800640 1 --2- 172.21.15.37:0/4037609426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35980ce8d0 0x7f35980ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:41.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.730+0000 7f3597400640 1 -- 172.21.15.37:0/4037609426 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 696255533 0 0) 0x7f35980cd120 con 0x7f359806e000 2024-05-30T06:53:41.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.730+0000 7f3597400640 1 -- 172.21.15.37:0/4037609426 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3580003530 con 0x7f359806e000 2024-05-30T06:53:41.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.730+0000 7f3597400640 1 -- 172.21.15.37:0/4037609426 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044031871 0 0) 0x7f35980cd400 con 0x7f359815cd80 2024-05-30T06:53:41.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.730+0000 7f3597400640 1 -- 172.21.15.37:0/4037609426 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35980cd120 con 0x7f359815cd80 2024-05-30T06:53:41.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.730+0000 7f359d800640 1 -- 172.21.15.37:0/4037609426 >> v1:172.21.15.105:6789/0 conn(0x7f359815cd80 legacy=0x7f359806f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.730+0000 7f359d800640 1 -- 172.21.15.37:0/4037609426 >> v1:172.21.15.37:6789/0 conn(0x7f359806e000 legacy=0x7f35980ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.730+0000 7f359d800640 1 -- 172.21.15.37:0/4037609426 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35980cd6e0 con 0x7f35980ce8d0 2024-05-30T06:53:41.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.730+0000 7f359d800640 1 --2- 172.21.15.37:0/4037609426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35980ce8d0 0x7f35980ced60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3590009dc0 tx=0x7f359001f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44c2f3e52329fc53 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:41.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.730+0000 7f3597400640 1 -- 172.21.15.37:0/4037609426 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35900b4070 con 0x7f35980ce8d0 2024-05-30T06:53:41.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f3597400640 1 -- 172.21.15.37:0/4037609426 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35900af600 con 0x7f35980ce8d0 2024-05-30T06:53:41.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f3597400640 1 -- 172.21.15.37:0/4037609426 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35900af9b0 con 0x7f35980ce8d0 2024-05-30T06:53:41.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 -- 172.21.15.37:0/4037609426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35980ce8d0 msgr2=0x7f35980ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 --2- 172.21.15.37:0/4037609426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35980ce8d0 0x7f35980ced60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3590009dc0 tx=0x7f359001f170 comp rx=0 tx=0).stop 2024-05-30T06:53:41.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 -- 172.21.15.37:0/4037609426 shutdown_connections 2024-05-30T06:53:41.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 --2- 172.21.15.37:0/4037609426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35980ce8d0 0x7f35980ced60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 -- 172.21.15.37:0/4037609426 >> 172.21.15.37:0/4037609426 conn(0x7f35980b23a0 msgr2=0x7f35980b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:41.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 -- 172.21.15.37:0/4037609426 shutdown_connections 2024-05-30T06:53:41.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 -- 172.21.15.37:0/4037609426 wait complete. 2024-05-30T06:53:41.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 Processor -- start 2024-05-30T06:53:41.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 -- start start 2024-05-30T06:53:41.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359806e000 0x7f3598166160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:41.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35980ce8d0 0x7f359813efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:41.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f359815cd80 0x7f359813bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:41.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f35981673d0 con 0x7f359815cd80 2024-05-30T06:53:41.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f35980cdca0 con 0x7f35980ce8d0 2024-05-30T06:53:41.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359f800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3598167550 con 0x7f359806e000 2024-05-30T06:53:41.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f359815cd80 0x7f359813bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:41.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f359815cd80 0x7f359813bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50992/0 (socket says 172.21.15.37:50992) 2024-05-30T06:53:41.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359d800640 1 -- 172.21.15.37:0/88159746 learned_addr learned my addr 172.21.15.37:0/88159746 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:41.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359ce00640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359806e000 0x7f3598166160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:41.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f3597e00640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35980ce8d0 0x7f359813efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:41.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359d800640 1 -- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359806e000 msgr2=0x7f3598166160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359d800640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359806e000 0x7f3598166160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359d800640 1 -- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35980ce8d0 msgr2=0x7f359813efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359d800640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35980ce8d0 0x7f359813efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359d800640 1 -- 172.21.15.37:0/88159746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359813c6e0 con 0x7f359815cd80 2024-05-30T06:53:41.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.734+0000 7f359ce00640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359806e000 0x7f3598166160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:41.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.738+0000 7f359d800640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f359815cd80 0x7f359813bf60 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f359001cda0 tx=0x7f359001bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:41.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.738+0000 7f3594c00640 1 -- 172.21.15.37:0/88159746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35900b4040 con 0x7f359815cd80 2024-05-30T06:53:41.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.738+0000 7f3594c00640 1 -- 172.21.15.37:0/88159746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35900bf070 con 0x7f359815cd80 2024-05-30T06:53:41.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.738+0000 7f3594c00640 1 -- 172.21.15.37:0/88159746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35900af9d0 con 0x7f359815cd80 2024-05-30T06:53:41.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.738+0000 7f359f800640 1 -- 172.21.15.37:0/88159746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359813c9c0 con 0x7f359815cd80 2024-05-30T06:53:41.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.738+0000 7f359f800640 1 -- 172.21.15.37:0/88159746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359813cf80 con 0x7f359815cd80 2024-05-30T06:53:41.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.738+0000 7f359f800640 1 -- 172.21.15.37:0/88159746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3598068b20 con 0x7f359815cd80 2024-05-30T06:53:41.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.738+0000 7f3594c00640 1 -- 172.21.15.37:0/88159746 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f35900afb70 con 0x7f359815cd80 2024-05-30T06:53:41.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.738+0000 7f3594c00640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3578069580 0x7f357806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:41.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.738+0000 7f3594c00640 1 -- 172.21.15.37:0/88159746 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4885+0+0 (secure 0 0 0) 0x7f3590123a70 con 0x7f359815cd80 2024-05-30T06:53:41.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.738+0000 7f359ce00640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3578069580 0x7f357806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:41.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.742+0000 7f359ce00640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3578069580 0x7f357806ba40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f358c000f70 tx=0x7f358c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:41.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.742+0000 7f3594c00640 1 -- 172.21.15.37:0/88159746 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3590018cd0 con 0x7f359815cd80 2024-05-30T06:53:41.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.910+0000 7f359f800640 1 -- 172.21.15.37:0/88159746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3598143450 con 0x7f359815cd80 2024-05-30T06:53:41.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.910+0000 7f3594c00640 1 -- 172.21.15.37:0/88159746 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+12923 (secure 0 0 0) 0x7f35900c2360 con 0x7f359815cd80 2024-05-30T06:53:41.912 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:53:41.157246+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:53:41.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.914+0000 7f359f800640 1 -- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3578069580 msgr2=0x7f357806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.914+0000 7f359f800640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3578069580 0x7f357806ba40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f358c000f70 tx=0x7f358c009040 comp rx=0 tx=0).stop 2024-05-30T06:53:41.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.914+0000 7f359f800640 1 -- 172.21.15.37:0/88159746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f359815cd80 msgr2=0x7f359813bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:41.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.914+0000 7f359f800640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f359815cd80 0x7f359813bf60 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f359001cda0 tx=0x7f359001bf10 comp rx=0 tx=0).stop 2024-05-30T06:53:41.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.914+0000 7f359f800640 1 -- 172.21.15.37:0/88159746 shutdown_connections 2024-05-30T06:53:41.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.914+0000 7f359f800640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f359815cd80 0x7f359813bf60 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.914+0000 7f359f800640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3578069580 0x7f357806ba40 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.914+0000 7f359f800640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35980ce8d0 0x7f359813efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.914+0000 7f359f800640 1 --2- 172.21.15.37:0/88159746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359806e000 0x7f3598166160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:41.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.914+0000 7f359f800640 1 -- 172.21.15.37:0/88159746 >> 172.21.15.37:0/88159746 conn(0x7f35980b23a0 msgr2=0x7f359815c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:41.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.914+0000 7f359f800640 1 -- 172.21.15.37:0/88159746 shutdown_connections 2024-05-30T06:53:41.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:41.914+0000 7f359f800640 1 -- 172.21.15.37:0/88159746 wait complete. 2024-05-30T06:53:41.934 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:53:41.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:53:42.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f2704600640 1 Processor -- start 2024-05-30T06:53:42.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f2704600640 1 -- start start 2024-05-30T06:53:42.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f2704600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f26fc06c070 0x7f26fc070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f2704600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26fc0ce4c0 con 0x7f26fc0713a0 2024-05-30T06:53:42.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f2704600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26fc0ce7a0 con 0x7f26fc0cdf20 2024-05-30T06:53:42.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f2704600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f26fc0cea80 con 0x7f26fc06c070 2024-05-30T06:53:42.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f2701c00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f26fc0713a0 0x7f26fc06b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42784/0 (socket says 172.21.15.37:42784) 2024-05-30T06:53:42.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f2701c00640 1 -- 172.21.15.37:0/2350228454 learned_addr learned my addr 172.21.15.37:0/2350228454 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f2701200640 1 --2- 172.21.15.37:0/2350228454 >> v2:172.21.15.105:3300/0 conn(0x7f26fc06c070 0x7f26fc070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f26fbe00640 1 -- 172.21.15.37:0/2350228454 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752604113 0 0) 0x7f26fc0ce4c0 con 0x7f26fc0713a0 2024-05-30T06:53:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f26fbe00640 1 -- 172.21.15.37:0/2350228454 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26e4003530 con 0x7f26fc0713a0 2024-05-30T06:53:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f26fbe00640 1 -- 172.21.15.37:0/2350228454 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 559900253 0 0) 0x7f26fc0ce7a0 con 0x7f26fc0cdf20 2024-05-30T06:53:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f2701200640 1 -- 172.21.15.37:0/2350228454 >> v1:172.21.15.105:6789/0 conn(0x7f26fc0cdf20 legacy=0x7f26fc0b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f2701200640 1 -- 172.21.15.37:0/2350228454 >> v1:172.21.15.37:6789/0 conn(0x7f26fc0713a0 legacy=0x7f26fc06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.078+0000 7f2701200640 1 -- 172.21.15.37:0/2350228454 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26fc0ced60 con 0x7f26fc06c070 2024-05-30T06:53:42.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.082+0000 7f2701200640 1 --2- 172.21.15.37:0/2350228454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26fc06c070 0x7f26fc070870 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f26e80097c0 tx=0x7f26e801ead0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c75be11a24c2bc7f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:42.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.082+0000 7f26fbe00640 1 -- 172.21.15.37:0/2350228454 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e80b5070 con 0x7f26fc06c070 2024-05-30T06:53:42.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.082+0000 7f26fbe00640 1 -- 172.21.15.37:0/2350228454 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e80a8590 con 0x7f26fc06c070 2024-05-30T06:53:42.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.082+0000 7f26fbe00640 1 -- 172.21.15.37:0/2350228454 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0001680 con 0x7f26fc06c070 2024-05-30T06:53:42.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.082+0000 7f2704600640 1 -- 172.21.15.37:0/2350228454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26fc06c070 msgr2=0x7f26fc070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.082+0000 7f2704600640 1 --2- 172.21.15.37:0/2350228454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26fc06c070 0x7f26fc070870 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f26e80097c0 tx=0x7f26e801ead0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.082+0000 7f2704600640 1 -- 172.21.15.37:0/2350228454 shutdown_connections 2024-05-30T06:53:42.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.082+0000 7f2704600640 1 --2- 172.21.15.37:0/2350228454 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26fc06c070 0x7f26fc070870 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.082+0000 7f2704600640 1 -- 172.21.15.37:0/2350228454 >> 172.21.15.37:0/2350228454 conn(0x7f26fc06f110 msgr2=0x7f26fc06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:42.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.082+0000 7f2704600640 1 -- 172.21.15.37:0/2350228454 shutdown_connections 2024-05-30T06:53:42.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.082+0000 7f2704600640 1 -- 172.21.15.37:0/2350228454 wait complete. 2024-05-30T06:53:42.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2704600640 1 Processor -- start 2024-05-30T06:53:42.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2704600640 1 -- start start 2024-05-30T06:53:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2704600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26fc06c070 0x7f26fc136d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2704600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26fc0713a0 0x7f26fc15b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2704600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc0cdf20 0x7f26fc15bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2704600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc15d730 con 0x7f26fc0cdf20 2024-05-30T06:53:42.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2704600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc071990 con 0x7f26fc0713a0 2024-05-30T06:53:42.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2704600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f26fc15d8b0 con 0x7f26fc06c070 2024-05-30T06:53:42.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2702600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc0cdf20 0x7f26fc15bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2702600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc0cdf20 0x7f26fc15bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51008/0 (socket says 172.21.15.37:51008) 2024-05-30T06:53:42.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2702600640 1 -- 172.21.15.37:0/3566007422 learned_addr learned my addr 172.21.15.37:0/3566007422 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:42.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2701c00640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26fc06c070 0x7f26fc136d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2701200640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26fc0713a0 0x7f26fc15b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2702600640 1 -- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26fc06c070 msgr2=0x7f26fc136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2702600640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26fc06c070 0x7f26fc136d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2702600640 1 -- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26fc0713a0 msgr2=0x7f26fc15b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2702600640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26fc0713a0 0x7f26fc15b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2702600640 1 -- 172.21.15.37:0/3566007422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26fc0cd6f0 con 0x7f26fc0cdf20 2024-05-30T06:53:42.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2702600640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc0cdf20 0x7f26fc15bcc0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f26f400c780 tx=0x7f26f400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:42.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f26f9600640 1 -- 172.21.15.37:0/3566007422 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4003db0 con 0x7f26fc0cdf20 2024-05-30T06:53:42.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f26f9600640 1 -- 172.21.15.37:0/3566007422 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f400ce30 con 0x7f26fc0cdf20 2024-05-30T06:53:42.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f26f9600640 1 -- 172.21.15.37:0/3566007422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4005290 con 0x7f26fc0cdf20 2024-05-30T06:53:42.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2704600640 1 -- 172.21.15.37:0/3566007422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26fc1f44a0 con 0x7f26fc0cdf20 2024-05-30T06:53:42.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2704600640 1 -- 172.21.15.37:0/3566007422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26fc1f4150 con 0x7f26fc0cdf20 2024-05-30T06:53:42.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.086+0000 7f2704600640 1 -- 172.21.15.37:0/3566007422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26fc068bc0 con 0x7f26fc0cdf20 2024-05-30T06:53:42.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.090+0000 7f26f9600640 1 -- 172.21.15.37:0/3566007422 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f26f4005430 con 0x7f26fc0cdf20 2024-05-30T06:53:42.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.090+0000 7f26f9600640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f26dc0695b0 0x7f26dc06ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.090+0000 7f26f9600640 1 -- 172.21.15.37:0/3566007422 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4885+0+0 (secure 0 0 0) 0x7f26f4085600 con 0x7f26fc0cdf20 2024-05-30T06:53:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.090+0000 7f2701c00640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f26dc0695b0 0x7f26dc06ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.090+0000 7f2701c00640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f26dc0695b0 0x7f26dc06ba70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f26f00016d0 tx=0x7f26f0001620 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.094+0000 7f26f9600640 1 -- 172.21.15.37:0/3566007422 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f26f4056c50 con 0x7f26fc0cdf20 2024-05-30T06:53:42.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.262+0000 7f2704600640 1 -- 172.21.15.37:0/3566007422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f26fc0ca7d0 con 0x7f26fc0cdf20 2024-05-30T06:53:42.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.262+0000 7f26f9600640 1 -- 172.21.15.37:0/3566007422 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f26f405af50 con 0x7f26fc0cdf20 2024-05-30T06:53:42.264 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:53:42.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.266+0000 7f2704600640 1 -- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f26dc0695b0 msgr2=0x7f26dc06ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.266+0000 7f2704600640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f26dc0695b0 0x7f26dc06ba70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f26f00016d0 tx=0x7f26f0001620 comp rx=0 tx=0).stop 2024-05-30T06:53:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.266+0000 7f2704600640 1 -- 172.21.15.37:0/3566007422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc0cdf20 msgr2=0x7f26fc15bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.266+0000 7f2704600640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc0cdf20 0x7f26fc15bcc0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f26f400c780 tx=0x7f26f400cc40 comp rx=0 tx=0).stop 2024-05-30T06:53:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.266+0000 7f2704600640 1 -- 172.21.15.37:0/3566007422 shutdown_connections 2024-05-30T06:53:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.266+0000 7f2704600640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc0cdf20 0x7f26fc15bcc0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.266+0000 7f2704600640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f26dc0695b0 0x7f26dc06ba70 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.266+0000 7f2704600640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26fc0713a0 0x7f26fc15b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.266+0000 7f2704600640 1 --2- 172.21.15.37:0/3566007422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26fc06c070 0x7f26fc136d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.266+0000 7f2704600640 1 -- 172.21.15.37:0/3566007422 >> 172.21.15.37:0/3566007422 conn(0x7f26fc06f110 msgr2=0x7f26fc070900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.266+0000 7f2704600640 1 -- 172.21.15.37:0/3566007422 shutdown_connections 2024-05-30T06:53:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.266+0000 7f2704600640 1 -- 172.21.15.37:0/3566007422 wait complete. 2024-05-30T06:53:42.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T06:53:42.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce9b000640 1 Processor -- start 2024-05-30T06:53:42.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce9b000640 1 -- start start 2024-05-30T06:53:42.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce9b000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce940b2e20 0x7fce94160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce9b000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fce9409ba70 0x7fce94160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce9b000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce940d0430 con 0x7fce941609c0 2024-05-30T06:53:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce9b000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fce940b3200 con 0x7fce9409ba70 2024-05-30T06:53:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce9b000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fce940d01e0 con 0x7fce940b2e20 2024-05-30T06:53:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce8be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fce941609c0 0x7fce940cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42792/0 (socket says 172.21.15.37:42792) 2024-05-30T06:53:42.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce8be00640 1 -- 172.21.15.37:0/3327388163 learned_addr learned my addr 172.21.15.37:0/3327388163 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:42.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce99000640 1 --2- 172.21.15.37:0/3327388163 >> v2:172.21.15.105:3300/0 conn(0x7fce9409ba70 0x7fce94160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93e00640 1 --2- 172.21.15.37:0/3327388163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce940b2e20 0x7fce94160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3036500715 0 0) 0x7fce940d0430 con 0x7fce941609c0 2024-05-30T06:53:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce78003530 con 0x7fce941609c0 2024-05-30T06:53:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2164376143 0 0) 0x7fce78003530 con 0x7fce941609c0 2024-05-30T06:53:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce940b2e20 msgr2=0x7fce94160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 --2- 172.21.15.37:0/3327388163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce940b2e20 0x7fce94160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 >> v2:172.21.15.105:3300/0 conn(0x7fce9409ba70 msgr2=0x7fce94160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 --2- 172.21.15.37:0/3327388163 >> v2:172.21.15.105:3300/0 conn(0x7fce9409ba70 0x7fce94160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce940d0710 con 0x7fce941609c0 2024-05-30T06:53:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fce7c001680 con 0x7fce941609c0 2024-05-30T06:53:42.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce99000640 1 --2- 172.21.15.37:0/3327388163 >> v2:172.21.15.105:3300/0 conn(0x7fce9409ba70 0x7fce94160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 >> v1:172.21.15.37:6789/0 conn(0x7fce941609c0 legacy=0x7fce940cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 --2- 172.21.15.37:0/3327388163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce940b2e20 0x7fce780039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 --2- 172.21.15.37:0/3327388163 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce78003f40 0x7fce78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 --2- 172.21.15.37:0/3327388163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce78004d50 0x7fce780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce940b3200 con 0x7fce78004d50 2024-05-30T06:53:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce940d01e0 con 0x7fce78003f40 2024-05-30T06:53:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fce7800b9d0 con 0x7fce940b2e20 2024-05-30T06:53:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce99000640 1 --2- 172.21.15.37:0/3327388163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce78004d50 0x7fce780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce93e00640 1 --2- 172.21.15.37:0/3327388163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce940b2e20 0x7fce780039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce8be00640 1 --2- 172.21.15.37:0/3327388163 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce78003f40 0x7fce78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce99000640 1 -- 172.21.15.37:0/3327388163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce940b2e20 msgr2=0x7fce780039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:42.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce99000640 1 --2- 172.21.15.37:0/3327388163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce940b2e20 0x7fce780039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce99000640 1 -- 172.21.15.37:0/3327388163 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce78003f40 msgr2=0x7fce78004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:42.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce99000640 1 --2- 172.21.15.37:0/3327388163 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce78003f40 0x7fce78004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.426+0000 7fce99000640 1 -- 172.21.15.37:0/3327388163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce78003530 con 0x7fce78004d50 2024-05-30T06:53:42.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.430+0000 7fce99000640 1 --2- 172.21.15.37:0/3327388163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce78004d50 0x7fce780051d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00e320 tx=0x7fce8c01cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f410566fe8f818dc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:42.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.430+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c009de0 con 0x7fce78004d50 2024-05-30T06:53:42.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.430+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c0a5e50 con 0x7fce78004d50 2024-05-30T06:53:42.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.430+0000 7fce93400640 1 -- 172.21.15.37:0/3327388163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c003ba0 con 0x7fce78004d50 2024-05-30T06:53:42.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.430+0000 7fce9b000640 1 -- 172.21.15.37:0/3327388163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce78004d50 msgr2=0x7fce780051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.430+0000 7fce9b000640 1 --2- 172.21.15.37:0/3327388163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce78004d50 0x7fce780051d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00e320 tx=0x7fce8c01cde0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.430+0000 7fce99000640 1 -- 172.21.15.37:0/3327388163 reap_dead start 2024-05-30T06:53:42.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.430+0000 7fce9b000640 1 -- 172.21.15.37:0/3327388163 shutdown_connections 2024-05-30T06:53:42.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.430+0000 7fce9b000640 1 -- 172.21.15.37:0/3327388163 >> 172.21.15.37:0/3327388163 conn(0x7fce940b4100 msgr2=0x7fce940b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:42.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.430+0000 7fce9b000640 1 -- 172.21.15.37:0/3327388163 shutdown_connections 2024-05-30T06:53:42.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.430+0000 7fce9b000640 1 -- 172.21.15.37:0/3327388163 wait complete. 2024-05-30T06:53:42.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce9b000640 1 Processor -- start 2024-05-30T06:53:42.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce9b000640 1 -- start start 2024-05-30T06:53:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce9b000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce78004d50 0x7fce940c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce9b000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce94154b00 0x7fce940b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce9b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce940b59a0 0x7fce940b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce9b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce940b38d0 con 0x7fce940b59a0 2024-05-30T06:53:42.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce9b000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce940b33a0 con 0x7fce78004d50 2024-05-30T06:53:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce9b000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fce940cee40 con 0x7fce94154b00 2024-05-30T06:53:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce99000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce940b59a0 0x7fce940b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce99000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce940b59a0 0x7fce940b7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51028/0 (socket says 172.21.15.37:51028) 2024-05-30T06:53:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce99000640 1 -- 172.21.15.37:0/1941949869 learned_addr learned my addr 172.21.15.37:0/1941949869 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce8be00640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce94154b00 0x7fce940b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce93e00640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce78004d50 0x7fce940c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce99000640 1 -- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce94154b00 msgr2=0x7fce940b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce99000640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce94154b00 0x7fce940b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce99000640 1 -- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce78004d50 msgr2=0x7fce940c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce99000640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce78004d50 0x7fce940c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce99000640 1 -- 172.21.15.37:0/1941949869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce940c7730 con 0x7fce940b59a0 2024-05-30T06:53:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce99000640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce940b59a0 0x7fce940b7830 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00e320 tx=0x7fce8c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce90c00640 1 -- 172.21.15.37:0/1941949869 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c009de0 con 0x7fce940b59a0 2024-05-30T06:53:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce90c00640 1 -- 172.21.15.37:0/1941949869 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c0a5c50 con 0x7fce940b59a0 2024-05-30T06:53:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce90c00640 1 -- 172.21.15.37:0/1941949869 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c0039a0 con 0x7fce940b59a0 2024-05-30T06:53:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce9b000640 1 -- 172.21.15.37:0/1941949869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce940c7a10 con 0x7fce940b59a0 2024-05-30T06:53:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.434+0000 7fce9b000640 1 -- 172.21.15.37:0/1941949869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce940c7fd0 con 0x7fce940b59a0 2024-05-30T06:53:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.438+0000 7fce9b000640 1 -- 172.21.15.37:0/1941949869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce94068b20 con 0x7fce940b59a0 2024-05-30T06:53:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.438+0000 7fce90c00640 1 -- 172.21.15.37:0/1941949869 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fce8c0bf020 con 0x7fce940b59a0 2024-05-30T06:53:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.438+0000 7fce90c00640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce70069580 0x7fce7006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.438+0000 7fce90c00640 1 -- 172.21.15.37:0/1941949869 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4885+0+0 (secure 0 0 0) 0x7fce8c120020 con 0x7fce940b59a0 2024-05-30T06:53:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.438+0000 7fce93e00640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce70069580 0x7fce7006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.438+0000 7fce93e00640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce70069580 0x7fce7006ba40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fce84009be0 tx=0x7fce84009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.442+0000 7fce90c00640 1 -- 172.21.15.37:0/1941949869 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fce8c016b50 con 0x7fce940b59a0 2024-05-30T06:53:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce9b000640 1 -- 172.21.15.37:0/1941949869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fce940709c0 con 0x7fce940b59a0 2024-05-30T06:53:42.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce90c00640 1 -- 172.21.15.37:0/1941949869 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) ==== 84+0+65 (secure 0 0 0) 0x7fce8c0f2150 con 0x7fce940b59a0 2024-05-30T06:53:42.610 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:42.610 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:53:42.610 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:42.610 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-30T06:53:42.610 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-30T06:53:42.610 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:42.610 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:53:42.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce9b000640 1 -- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce70069580 msgr2=0x7fce7006ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce9b000640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce70069580 0x7fce7006ba40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fce84009be0 tx=0x7fce84009190 comp rx=0 tx=0).stop 2024-05-30T06:53:42.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce9b000640 1 -- 172.21.15.37:0/1941949869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce940b59a0 msgr2=0x7fce940b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce9b000640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce940b59a0 0x7fce940b7830 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00e320 tx=0x7fce8c009750 comp rx=0 tx=0).stop 2024-05-30T06:53:42.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce9b000640 1 -- 172.21.15.37:0/1941949869 shutdown_connections 2024-05-30T06:53:42.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce9b000640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce940b59a0 0x7fce940b7830 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce9b000640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce94154b00 0x7fce940b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce9b000640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce70069580 0x7fce7006ba40 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce9b000640 1 --2- 172.21.15.37:0/1941949869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce78004d50 0x7fce940c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce9b000640 1 -- 172.21.15.37:0/1941949869 >> 172.21.15.37:0/1941949869 conn(0x7fce940b4100 msgr2=0x7fce940cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:42.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce9b000640 1 -- 172.21.15.37:0/1941949869 shutdown_connections 2024-05-30T06:53:42.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.610+0000 7fce9b000640 1 -- 172.21.15.37:0/1941949869 wait complete. 2024-05-30T06:53:42.631 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T06:53:42.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T06:53:42.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.774+0000 7f0d87800640 1 Processor -- start 2024-05-30T06:53:42.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.774+0000 7f0d87800640 1 -- start start 2024-05-30T06:53:42.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d87800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d800cd400 0x7f0d8006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d87800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d800ce030 con 0x7f0d801590c0 2024-05-30T06:53:42.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d87800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d8015f230 con 0x7f0d8006f5a0 2024-05-30T06:53:42.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d87800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8015f510 con 0x7f0d800cd400 2024-05-30T06:53:42.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d84e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0d801590c0 0x7f0d800cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42800/0 (socket says 172.21.15.37:42800) 2024-05-30T06:53:42.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d84e00640 1 -- 172.21.15.37:0/2090509827 learned_addr learned my addr 172.21.15.37:0/2090509827 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7fe00640 1 --2- 172.21.15.37:0/2090509827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d800cd400 0x7f0d8006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562350312 0 0) 0x7f0d800ce030 con 0x7f0d801590c0 2024-05-30T06:53:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d68003530 con 0x7f0d801590c0 2024-05-30T06:53:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667563232 0 0) 0x7f0d8015f230 con 0x7f0d8006f5a0 2024-05-30T06:53:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d800ce030 con 0x7f0d8006f5a0 2024-05-30T06:53:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2718942849 0 0) 0x7f0d68003530 con 0x7f0d801590c0 2024-05-30T06:53:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d800cd400 msgr2=0x7f0d8006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 --2- 172.21.15.37:0/2090509827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d800cd400 0x7f0d8006f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 >> v1:172.21.15.105:6789/0 conn(0x7f0d8006f5a0 legacy=0x7f0d800b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8015f7f0 con 0x7f0d801590c0 2024-05-30T06:53:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f0d74001680 con 0x7f0d801590c0 2024-05-30T06:53:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 >> v1:172.21.15.37:6789/0 conn(0x7f0d801590c0 legacy=0x7f0d800cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 --2- 172.21.15.37:0/2090509827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68003b80 0x7f0d68003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 --2- 172.21.15.37:0/2090509827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d800cd400 0x7f0d68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 --2- 172.21.15.37:0/2090509827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d68004d50 0x7f0d680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8015f510 con 0x7f0d68003b80 2024-05-30T06:53:42.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6800bad0 con 0x7f0d68004d50 2024-05-30T06:53:42.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0d6800dee0 con 0x7f0d800cd400 2024-05-30T06:53:42.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d84e00640 1 --2- 172.21.15.37:0/2090509827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68003b80 0x7f0d68003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d85800640 1 --2- 172.21.15.37:0/2090509827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d68004d50 0x7f0d680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d7fe00640 1 --2- 172.21.15.37:0/2090509827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d800cd400 0x7f0d68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d84e00640 1 -- 172.21.15.37:0/2090509827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d800cd400 msgr2=0x7f0d68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:42.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d84e00640 1 --2- 172.21.15.37:0/2090509827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d800cd400 0x7f0d68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d84e00640 1 -- 172.21.15.37:0/2090509827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d68004d50 msgr2=0x7f0d680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:42.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d84e00640 1 --2- 172.21.15.37:0/2090509827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d68004d50 0x7f0d680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.778+0000 7f0d84e00640 1 -- 172.21.15.37:0/2090509827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d68003530 con 0x7f0d68003b80 2024-05-30T06:53:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.782+0000 7f0d84e00640 1 --2- 172.21.15.37:0/2090509827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68003b80 0x7f0d68003f80 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c190 tx=0x7f0d7401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8987194fe30399bd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.782+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74007cb0 con 0x7f0d68003b80 2024-05-30T06:53:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.782+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d740a9020 con 0x7f0d68003b80 2024-05-30T06:53:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.782+0000 7f0d7f400640 1 -- 172.21.15.37:0/2090509827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d74005ae0 con 0x7f0d68003b80 2024-05-30T06:53:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.782+0000 7f0d87800640 1 -- 172.21.15.37:0/2090509827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68003b80 msgr2=0x7f0d68003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.782+0000 7f0d87800640 1 --2- 172.21.15.37:0/2090509827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68003b80 0x7f0d68003f80 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c190 tx=0x7f0d7401cc20 comp rx=0 tx=0).stop 2024-05-30T06:53:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.782+0000 7f0d85800640 1 -- 172.21.15.37:0/2090509827 reap_dead start 2024-05-30T06:53:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.782+0000 7f0d87800640 1 -- 172.21.15.37:0/2090509827 shutdown_connections 2024-05-30T06:53:42.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.782+0000 7f0d87800640 1 -- 172.21.15.37:0/2090509827 >> 172.21.15.37:0/2090509827 conn(0x7f0d8006bf60 msgr2=0x7f0d800b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:42.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.782+0000 7f0d87800640 1 -- 172.21.15.37:0/2090509827 shutdown_connections 2024-05-30T06:53:42.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.782+0000 7f0d87800640 1 -- 172.21.15.37:0/2090509827 wait complete. 2024-05-30T06:53:42.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.782+0000 7f0d87800640 1 Processor -- start 2024-05-30T06:53:42.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.782+0000 7f0d87800640 1 -- start start 2024-05-30T06:53:42.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d87800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68003b80 0x7f0d8015df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d87800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d80151d90 0x7f0d8015b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d87800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d8015bd60 0x7f0d80144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d87800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8006df50 con 0x7f0d68003b80 2024-05-30T06:53:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d87800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8006f9b0 con 0x7f0d80151d90 2024-05-30T06:53:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d87800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8006e0d0 con 0x7f0d8015bd60 2024-05-30T06:53:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d84e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68003b80 0x7f0d8015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d84e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68003b80 0x7f0d8015df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51044/0 (socket says 172.21.15.37:51044) 2024-05-30T06:53:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d84e00640 1 -- 172.21.15.37:0/151525661 learned_addr learned my addr 172.21.15.37:0/151525661 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d85800640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d8015bd60 0x7f0d80144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d7fe00640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d80151d90 0x7f0d8015b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d84e00640 1 -- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d8015bd60 msgr2=0x7f0d80144b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d84e00640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d8015bd60 0x7f0d80144b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d84e00640 1 -- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d80151d90 msgr2=0x7f0d8015b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d84e00640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d80151d90 0x7f0d8015b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d84e00640 1 -- 172.21.15.37:0/151525661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d80150cf0 con 0x7f0d68003b80 2024-05-30T06:53:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d85800640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d8015bd60 0x7f0d80144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d7fe00640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d80151d90 0x7f0d8015b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d84e00640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68003b80 0x7f0d8015df60 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f0d740ab040 tx=0x7f0d68005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d7cc00640 1 -- 172.21.15.37:0/151525661 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d740049f0 con 0x7f0d68003b80 2024-05-30T06:53:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d7cc00640 1 -- 172.21.15.37:0/151525661 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d74004b90 con 0x7f0d68003b80 2024-05-30T06:53:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d87800640 1 -- 172.21.15.37:0/151525661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d80150fd0 con 0x7f0d68003b80 2024-05-30T06:53:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d7cc00640 1 -- 172.21.15.37:0/151525661 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d740070d0 con 0x7f0d68003b80 2024-05-30T06:53:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d87800640 1 -- 172.21.15.37:0/151525661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d80151590 con 0x7f0d68003b80 2024-05-30T06:53:42.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.786+0000 7f0d87800640 1 -- 172.21.15.37:0/151525661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d80068d40 con 0x7f0d68003b80 2024-05-30T06:53:42.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.790+0000 7f0d7cc00640 1 -- 172.21.15.37:0/151525661 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f0d74007270 con 0x7f0d68003b80 2024-05-30T06:53:42.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.790+0000 7f0d7cc00640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0d60069580 0x7f0d6006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:42.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.790+0000 7f0d7cc00640 1 -- 172.21.15.37:0/151525661 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4885+0+0 (secure 0 0 0) 0x7f0d7411eed0 con 0x7f0d68003b80 2024-05-30T06:53:42.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.790+0000 7f0d7fe00640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0d60069580 0x7f0d6006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:42.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.790+0000 7f0d7fe00640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0d60069580 0x7f0d6006ba40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0d800b5db0 tx=0x7f0d6c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:42.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.794+0000 7f0d7cc00640 1 -- 172.21.15.37:0/151525661 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0d74016930 con 0x7f0d68003b80 2024-05-30T06:53:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:42.958+0000 7f0d87800640 1 -- 172.21.15.37:0/151525661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0d800cd030 con 0x7f0d68003b80 2024-05-30T06:53:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.154+0000 7f0d7cc00640 1 -- 172.21.15.37:0/151525661 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v85) ==== 138+0+0 (secure 0 0 0) 0x7f0d740f0ee0 con 0x7f0d68003b80 2024-05-30T06:53:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-30T06:53:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.154+0000 7f0d87800640 1 -- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0d60069580 msgr2=0x7f0d6006ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.154+0000 7f0d87800640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0d60069580 0x7f0d6006ba40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0d800b5db0 tx=0x7f0d6c008040 comp rx=0 tx=0).stop 2024-05-30T06:53:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.154+0000 7f0d87800640 1 -- 172.21.15.37:0/151525661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68003b80 msgr2=0x7f0d8015df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.154+0000 7f0d87800640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68003b80 0x7f0d8015df60 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f0d740ab040 tx=0x7f0d68005840 comp rx=0 tx=0).stop 2024-05-30T06:53:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.158+0000 7f0d87800640 1 -- 172.21.15.37:0/151525661 shutdown_connections 2024-05-30T06:53:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.158+0000 7f0d87800640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d8015bd60 0x7f0d80144b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.158+0000 7f0d87800640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0d60069580 0x7f0d6006ba40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.158+0000 7f0d87800640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d80151d90 0x7f0d8015b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.158+0000 7f0d87800640 1 --2- 172.21.15.37:0/151525661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d68003b80 0x7f0d8015df60 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.158+0000 7f0d87800640 1 -- 172.21.15.37:0/151525661 >> 172.21.15.37:0/151525661 conn(0x7f0d8006bf60 msgr2=0x7f0d801619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.158+0000 7f0d87800640 1 -- 172.21.15.37:0/151525661 shutdown_connections 2024-05-30T06:53:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.158+0000 7f0d87800640 1 -- 172.21.15.37:0/151525661 wait complete. 2024-05-30T06:53:43.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T06:53:43.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97d7c00640 1 Processor -- start 2024-05-30T06:53:43.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97d7c00640 1 -- start start 2024-05-30T06:53:43.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97d7c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97d015d350 0x7f97d006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:43.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97d7c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f97d015d7b0 0x7f97d006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:43.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97d7c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97d0142030 con 0x7f97d00b59d0 2024-05-30T06:53:43.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97d7c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f97d0142310 con 0x7f97d015d7b0 2024-05-30T06:53:43.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97d7c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f97d01425f0 con 0x7f97d015d350 2024-05-30T06:53:43.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97d5200640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f97d00b59d0 0x7f97d00b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:58434/0 (socket says 172.21.15.37:58434) 2024-05-30T06:53:43.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97d5200640 1 -- 172.21.15.37:0/1162391757 learned_addr learned my addr 172.21.15.37:0/1162391757 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:43.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97c7e00640 1 --2- 172.21.15.37:0/1162391757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97d015d350 0x7f97d006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:43.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97d5c00640 1 --2- 172.21.15.37:0/1162391757 >> v2:172.21.15.105:3300/0 conn(0x7f97d015d7b0 0x7f97d006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:43.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97c7e00640 1 -- 172.21.15.37:0/1162391757 >> v2:172.21.15.105:3300/0 conn(0x7f97d015d7b0 msgr2=0x7f97d006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97c7e00640 1 --2- 172.21.15.37:0/1162391757 >> v2:172.21.15.105:3300/0 conn(0x7f97d015d7b0 0x7f97d006e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97cfe00640 1 -- 172.21.15.37:0/1162391757 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151815583 0 0) 0x7f97d0142030 con 0x7f97d00b59d0 2024-05-30T06:53:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97c7e00640 1 -- 172.21.15.37:0/1162391757 >> v1:172.21.15.105:6789/0 conn(0x7f97d00b59d0 legacy=0x7f97d00b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:43.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.330+0000 7f97c7e00640 1 -- 172.21.15.37:0/1162391757 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d01428d0 con 0x7f97d015d350 2024-05-30T06:53:43.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.334+0000 7f97c7e00640 1 --2- 172.21.15.37:0/1162391757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97d015d350 0x7f97d006df50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f97b80097c0 tx=0x7f97b801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f6c9e13ca4aa1ba server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:43.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.334+0000 7f97cfe00640 1 -- 172.21.15.37:0/1162391757 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b80b5070 con 0x7f97d015d350 2024-05-30T06:53:43.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.334+0000 7f97cfe00640 1 -- 172.21.15.37:0/1162391757 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97b80a8990 con 0x7f97d015d350 2024-05-30T06:53:43.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.334+0000 7f97cfe00640 1 -- 172.21.15.37:0/1162391757 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b80a8d60 con 0x7f97d015d350 2024-05-30T06:53:43.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.334+0000 7f97d7c00640 1 -- 172.21.15.37:0/1162391757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97d015d350 msgr2=0x7f97d006df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:43.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.334+0000 7f97d7c00640 1 --2- 172.21.15.37:0/1162391757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97d015d350 0x7f97d006df50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f97b80097c0 tx=0x7f97b801ec90 comp rx=0 tx=0).stop 2024-05-30T06:53:43.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.334+0000 7f97d7c00640 1 -- 172.21.15.37:0/1162391757 shutdown_connections 2024-05-30T06:53:43.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.334+0000 7f97d7c00640 1 --2- 172.21.15.37:0/1162391757 >> v2:172.21.15.105:3300/0 conn(0x7f97d015d7b0 0x7f97d006e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:43.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.334+0000 7f97d7c00640 1 --2- 172.21.15.37:0/1162391757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97d015d350 0x7f97d006df50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:43.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.334+0000 7f97d7c00640 1 -- 172.21.15.37:0/1162391757 >> 172.21.15.37:0/1162391757 conn(0x7f97d006bf60 msgr2=0x7f97d00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:43.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.334+0000 7f97d7c00640 1 -- 172.21.15.37:0/1162391757 shutdown_connections 2024-05-30T06:53:43.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.334+0000 7f97d7c00640 1 -- 172.21.15.37:0/1162391757 wait complete. 2024-05-30T06:53:43.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d7c00640 1 Processor -- start 2024-05-30T06:53:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d7c00640 1 -- start start 2024-05-30T06:53:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d7c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d00b59d0 0x7f97d0159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d7c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97d015d350 0x7f97d01f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d7c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97d015d7b0 0x7f97d015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d7c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97d00b00a0 con 0x7f97d00b59d0 2024-05-30T06:53:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d7c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f97d00aff20 con 0x7f97d015d350 2024-05-30T06:53:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d7c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f97d013f860 con 0x7f97d015d7b0 2024-05-30T06:53:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d00b59d0 0x7f97d0159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d00b59d0 0x7f97d0159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51054/0 (socket says 172.21.15.37:51054) 2024-05-30T06:53:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d5200640 1 -- 172.21.15.37:0/800286362 learned_addr learned my addr 172.21.15.37:0/800286362 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d5c00640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97d015d7b0 0x7f97d015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97c7e00640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97d015d350 0x7f97d01f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d5200640 1 -- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97d015d7b0 msgr2=0x7f97d015a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d5200640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97d015d7b0 0x7f97d015a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d5200640 1 -- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97d015d350 msgr2=0x7f97d01f43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:43.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d5200640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97d015d350 0x7f97d01f43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:43.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d5200640 1 -- 172.21.15.37:0/800286362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d01f4d50 con 0x7f97d00b59d0 2024-05-30T06:53:43.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97c7e00640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97d015d350 0x7f97d01f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:43.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d5200640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d00b59d0 0x7f97d0159870 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f97c000c4b0 tx=0x7f97c000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:43.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97cd600640 1 -- 172.21.15.37:0/800286362 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c0018070 con 0x7f97d00b59d0 2024-05-30T06:53:43.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97cd600640 1 -- 172.21.15.37:0/800286362 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c0007500 con 0x7f97d00b59d0 2024-05-30T06:53:43.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d7c00640 1 -- 172.21.15.37:0/800286362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d01f5030 con 0x7f97d00b59d0 2024-05-30T06:53:43.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97cd600640 1 -- 172.21.15.37:0/800286362 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c0004a30 con 0x7f97d00b59d0 2024-05-30T06:53:43.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.338+0000 7f97d7c00640 1 -- 172.21.15.37:0/800286362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d015de20 con 0x7f97d00b59d0 2024-05-30T06:53:43.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.342+0000 7f97d7c00640 1 -- 172.21.15.37:0/800286362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d0068bc0 con 0x7f97d00b59d0 2024-05-30T06:53:43.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.342+0000 7f97cd600640 1 -- 172.21.15.37:0/800286362 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f97c001b070 con 0x7f97d00b59d0 2024-05-30T06:53:43.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.342+0000 7f97cd600640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97ac069580 0x7f97ac06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:43.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.342+0000 7f97cd600640 1 -- 172.21.15.37:0/800286362 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 5255+0+0 (secure 0 0 0) 0x7f97c0084fa0 con 0x7f97d00b59d0 2024-05-30T06:53:43.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.342+0000 7f97c7e00640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97ac069580 0x7f97ac06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:43.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.342+0000 7f97c7e00640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97ac069580 0x7f97ac06ba40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f97b80b2000 tx=0x7f97b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:43.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.346+0000 7f97cd600640 1 -- 172.21.15.37:0/800286362 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f97c0056c80 con 0x7f97d00b59d0 2024-05-30T06:53:43.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:43.510+0000 7f97d7c00640 1 -- 172.21.15.37:0/800286362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f97d006ebb0 con 0x7f97d00b59d0 2024-05-30T06:53:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.158+0000 7f97cd600640 1 -- 172.21.15.37:0/800286362 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) ==== 170+0+0 (secure 0 0 0) 0x7f97c0001100 con 0x7f97d00b59d0 2024-05-30T06:53:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-30T06:53:44.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.158+0000 7f97d7c00640 1 -- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97ac069580 msgr2=0x7f97ac06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:44.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.158+0000 7f97d7c00640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97ac069580 0x7f97ac06ba40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f97b80b2000 tx=0x7f97b8008040 comp rx=0 tx=0).stop 2024-05-30T06:53:44.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.158+0000 7f97d7c00640 1 -- 172.21.15.37:0/800286362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d00b59d0 msgr2=0x7f97d0159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:44.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.158+0000 7f97d7c00640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d00b59d0 0x7f97d0159870 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f97c000c4b0 tx=0x7f97c000c970 comp rx=0 tx=0).stop 2024-05-30T06:53:44.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.162+0000 7f97d7c00640 1 -- 172.21.15.37:0/800286362 shutdown_connections 2024-05-30T06:53:44.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.162+0000 7f97d7c00640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97d015d7b0 0x7f97d015a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:44.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.162+0000 7f97d7c00640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97ac069580 0x7f97ac06ba40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:44.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.162+0000 7f97d7c00640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97d015d350 0x7f97d01f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:44.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.162+0000 7f97d7c00640 1 --2- 172.21.15.37:0/800286362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d00b59d0 0x7f97d0159870 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:44.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.162+0000 7f97d7c00640 1 -- 172.21.15.37:0/800286362 >> 172.21.15.37:0/800286362 conn(0x7f97d006bf60 msgr2=0x7f97d0072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:44.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.162+0000 7f97d7c00640 1 -- 172.21.15.37:0/800286362 shutdown_connections 2024-05-30T06:53:44.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.162+0000 7f97d7c00640 1 -- 172.21.15.37:0/800286362 wait complete. 2024-05-30T06:53:44.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T06:53:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f5775600640 1 Processor -- start 2024-05-30T06:53:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f5775600640 1 -- start start 2024-05-30T06:53:44.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f5775600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f577006f770 0x7f5770166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:44.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f5775600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577015f310 con 0x7f57700cd440 2024-05-30T06:53:44.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f5775600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577015f5f0 con 0x7f5770155da0 2024-05-30T06:53:44.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f5775600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f57700b4760 con 0x7f577006f770 2024-05-30T06:53:44.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f5767e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f57700cd440 0x7f577006f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42802/0 (socket says 172.21.15.37:42802) 2024-05-30T06:53:44.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f5767e00640 1 -- 172.21.15.37:0/3551932761 learned_addr learned my addr 172.21.15.37:0/3551932761 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576f400640 1 --2- 172.21.15.37:0/3551932761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f577006f770 0x7f5770166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3222568001 0 0) 0x7f577015f310 con 0x7f57700cd440 2024-05-30T06:53:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5754003530 con 0x7f57700cd440 2024-05-30T06:53:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1164267436 0 0) 0x7f5754003530 con 0x7f57700cd440 2024-05-30T06:53:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f577006f770 msgr2=0x7f5770166570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 --2- 172.21.15.37:0/3551932761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f577006f770 0x7f5770166570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 >> v1:172.21.15.105:6789/0 conn(0x7f5770155da0 legacy=0x7f57700cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577015f8d0 con 0x7f57700cd440 2024-05-30T06:53:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f5758001680 con 0x7f57700cd440 2024-05-30T06:53:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 >> v1:172.21.15.37:6789/0 conn(0x7f57700cd440 legacy=0x7f577006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 --2- 172.21.15.37:0/3551932761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540039f0 0x7f5754003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 --2- 172.21.15.37:0/3551932761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5754004810 0x7f5754004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 --2- 172.21.15.37:0/3551932761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f577006f770 0x7f5754005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f575400bb00 con 0x7f57540039f0 2024-05-30T06:53:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f575400dec0 con 0x7f5754004810 2024-05-30T06:53:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f575400e0c0 con 0x7f577006f770 2024-05-30T06:53:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576ea00640 1 --2- 172.21.15.37:0/3551932761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540039f0 0x7f5754003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f5767e00640 1 --2- 172.21.15.37:0/3551932761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5754004810 0x7f5754004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576f400640 1 --2- 172.21.15.37:0/3551932761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f577006f770 0x7f5754005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576ea00640 1 -- 172.21.15.37:0/3551932761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f577006f770 msgr2=0x7f5754005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576ea00640 1 --2- 172.21.15.37:0/3551932761 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f577006f770 0x7f5754005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576ea00640 1 -- 172.21.15.37:0/3551932761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5754004810 msgr2=0x7f5754004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:44.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576ea00640 1 --2- 172.21.15.37:0/3551932761 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5754004810 0x7f5754004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.350+0000 7f576ea00640 1 -- 172.21.15.37:0/3551932761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5754003530 con 0x7f57540039f0 2024-05-30T06:53:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.354+0000 7f576ea00640 1 --2- 172.21.15.37:0/3551932761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540039f0 0x7f5754003dd0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f5760001910 tx=0x7f576001c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec23371c4769628 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.354+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57600b0070 con 0x7f57540039f0 2024-05-30T06:53:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.354+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57600ab620 con 0x7f57540039f0 2024-05-30T06:53:44.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.354+0000 7f576e000640 1 -- 172.21.15.37:0/3551932761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760001510 con 0x7f57540039f0 2024-05-30T06:53:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.354+0000 7f5775600640 1 -- 172.21.15.37:0/3551932761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540039f0 msgr2=0x7f5754003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.354+0000 7f5775600640 1 --2- 172.21.15.37:0/3551932761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540039f0 0x7f5754003dd0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f5760001910 tx=0x7f576001c580 comp rx=0 tx=0).stop 2024-05-30T06:53:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.354+0000 7f576f400640 1 -- 172.21.15.37:0/3551932761 reap_dead start 2024-05-30T06:53:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.354+0000 7f5775600640 1 -- 172.21.15.37:0/3551932761 shutdown_connections 2024-05-30T06:53:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.354+0000 7f5775600640 1 -- 172.21.15.37:0/3551932761 >> 172.21.15.37:0/3551932761 conn(0x7f577006bf60 msgr2=0x7f57700b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.354+0000 7f5775600640 1 -- 172.21.15.37:0/3551932761 shutdown_connections 2024-05-30T06:53:44.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.354+0000 7f5775600640 1 -- 172.21.15.37:0/3551932761 wait complete. 2024-05-30T06:53:44.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5775600640 1 Processor -- start 2024-05-30T06:53:44.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5775600640 1 -- start start 2024-05-30T06:53:44.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5775600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57540039f0 0x7f577015e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:44.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5775600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f577014cb60 0x7f577014c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5775600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57701514a0 0x7f5770151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5775600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f577006eaf0 con 0x7f57701514a0 2024-05-30T06:53:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5775600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f577006e970 con 0x7f577014cb60 2024-05-30T06:53:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5775600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f577006ec70 con 0x7f57540039f0 2024-05-30T06:53:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f576f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57701514a0 0x7f5770151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f576f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57701514a0 0x7f5770151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51070/0 (socket says 172.21.15.37:51070) 2024-05-30T06:53:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f576f400640 1 -- 172.21.15.37:0/2150193133 learned_addr learned my addr 172.21.15.37:0/2150193133 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5767e00640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f577014cb60 0x7f577014c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f576ea00640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57540039f0 0x7f577015e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f576f400640 1 -- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57540039f0 msgr2=0x7f577015e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f576f400640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57540039f0 0x7f577015e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f576f400640 1 -- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f577014cb60 msgr2=0x7f577014c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:44.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f576f400640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f577014cb60 0x7f577014c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:44.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f576f400640 1 -- 172.21.15.37:0/2150193133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577015c220 con 0x7f57701514a0 2024-05-30T06:53:44.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f576f400640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57701514a0 0x7f5770151920 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f5770071ca0 tx=0x7f576800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5766a00640 1 -- 172.21.15.37:0/2150193133 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768019070 con 0x7f57701514a0 2024-05-30T06:53:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5766a00640 1 -- 172.21.15.37:0/2150193133 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57680039a0 con 0x7f57701514a0 2024-05-30T06:53:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5775600640 1 -- 172.21.15.37:0/2150193133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f577015bc60 con 0x7f57701514a0 2024-05-30T06:53:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5766a00640 1 -- 172.21.15.37:0/2150193133 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768003d90 con 0x7f57701514a0 2024-05-30T06:53:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.358+0000 7f5775600640 1 -- 172.21.15.37:0/2150193133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5770156d50 con 0x7f57701514a0 2024-05-30T06:53:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.362+0000 7f5775600640 1 -- 172.21.15.37:0/2150193133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5770068bc0 con 0x7f57701514a0 2024-05-30T06:53:44.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.362+0000 7f5766a00640 1 -- 172.21.15.37:0/2150193133 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f576801c070 con 0x7f57701514a0 2024-05-30T06:53:44.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.362+0000 7f5766a00640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f574c0695b0 0x7f574c06ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:44.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.362+0000 7f5766a00640 1 -- 172.21.15.37:0/2150193133 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5637+0+0 (secure 0 0 0) 0x7f5768086710 con 0x7f57701514a0 2024-05-30T06:53:44.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.362+0000 7f576ea00640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f574c0695b0 0x7f574c06ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:44.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.366+0000 7f576ea00640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f574c0695b0 0x7f574c06ba70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f57600ad000 tx=0x7f5760001330 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:44.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.366+0000 7f5766a00640 1 -- 172.21.15.37:0/2150193133 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5768010040 con 0x7f57701514a0 2024-05-30T06:53:44.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:44.570+0000 7f5775600640 1 -- 172.21.15.37:0/2150193133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5770164340 con 0x7f57701514a0 2024-05-30T06:53:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.186+0000 7f5766a00640 1 -- 172.21.15.37:0/2150193133 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v52) ==== 174+0+0 (secure 0 0 0) 0x7f57680583b0 con 0x7f57701514a0 2024-05-30T06:53:45.193 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 12 and data pool 13 2024-05-30T06:53:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.202+0000 7f5775600640 1 -- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f574c0695b0 msgr2=0x7f574c06ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.202+0000 7f5775600640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f574c0695b0 0x7f574c06ba70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f57600ad000 tx=0x7f5760001330 comp rx=0 tx=0).stop 2024-05-30T06:53:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.202+0000 7f5775600640 1 -- 172.21.15.37:0/2150193133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57701514a0 msgr2=0x7f5770151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.202+0000 7f5775600640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57701514a0 0x7f5770151920 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f5770071ca0 tx=0x7f576800f580 comp rx=0 tx=0).stop 2024-05-30T06:53:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.206+0000 7f5775600640 1 -- 172.21.15.37:0/2150193133 shutdown_connections 2024-05-30T06:53:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.206+0000 7f5775600640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57701514a0 0x7f5770151920 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.206+0000 7f5775600640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f574c0695b0 0x7f574c06ba70 secure :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f57600ad000 tx=0x7f5760001330 comp rx=0 tx=0).stop 2024-05-30T06:53:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.206+0000 7f5775600640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f577014cb60 0x7f577014c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.206+0000 7f5775600640 1 --2- 172.21.15.37:0/2150193133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57540039f0 0x7f577015e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.206+0000 7f5775600640 1 -- 172.21.15.37:0/2150193133 >> 172.21.15.37:0/2150193133 conn(0x7f577006bf60 msgr2=0x7f5770152030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:45.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.206+0000 7f5775600640 1 -- 172.21.15.37:0/2150193133 shutdown_connections 2024-05-30T06:53:45.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.206+0000 7f5775600640 1 -- 172.21.15.37:0/2150193133 wait complete. 2024-05-30T06:53:45.236 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:53:45.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.378+0000 7f3742800640 1 Processor -- start 2024-05-30T06:53:45.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.378+0000 7f3742800640 1 -- start start 2024-05-30T06:53:45.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.378+0000 7f3742800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f373c155e60 0x7f373c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.378+0000 7f3742800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f373c06f9a0 0x7f373c0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.378+0000 7f3742800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f373c0b2ec0 0x7f373c0cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.378+0000 7f3742800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f373c0ccff0 con 0x7f373c155e60 2024-05-30T06:53:45.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.378+0000 7f3742800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f373c0d00e0 con 0x7f373c0b2ec0 2024-05-30T06:53:45.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.378+0000 7f3742800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f373c15c8f0 con 0x7f373c06f9a0 2024-05-30T06:53:45.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.378+0000 7f373b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f373c155e60 0x7f373c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.378+0000 7f373b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f373c155e60 0x7f373c0b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51078/0 (socket says 172.21.15.37:51078) 2024-05-30T06:53:45.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.378+0000 7f373b400640 1 -- 172.21.15.37:0/2101540342 learned_addr learned my addr 172.21.15.37:0/2101540342 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:45.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f373be00640 1 --2- 172.21.15.37:0/2101540342 >> v2:172.21.15.105:3300/0 conn(0x7f373c0b2ec0 0x7f373c0cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f373b400640 1 -- 172.21.15.37:0/2101540342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f373c06f9a0 msgr2=0x7f373c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:45.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f3732a00640 1 --2- 172.21.15.37:0/2101540342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f373c06f9a0 0x7f373c0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f373b400640 1 --2- 172.21.15.37:0/2101540342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f373c06f9a0 0x7f373c0cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f373b400640 1 -- 172.21.15.37:0/2101540342 >> v2:172.21.15.105:3300/0 conn(0x7f373c0b2ec0 msgr2=0x7f373c0cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:45.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f373b400640 1 --2- 172.21.15.37:0/2101540342 >> v2:172.21.15.105:3300/0 conn(0x7f373c0b2ec0 0x7f373c0cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f373b400640 1 -- 172.21.15.37:0/2101540342 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373c0ccc80 con 0x7f373c155e60 2024-05-30T06:53:45.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f373be00640 1 --2- 172.21.15.37:0/2101540342 >> v2:172.21.15.105:3300/0 conn(0x7f373c0b2ec0 0x7f373c0cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:45.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f3732a00640 1 --2- 172.21.15.37:0/2101540342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f373c06f9a0 0x7f373c0cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:45.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f373b400640 1 --2- 172.21.15.37:0/2101540342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f373c155e60 0x7f373c0b36a0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f373c070df0 tx=0x7f372c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47c899d066e786b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:45.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f373aa00640 1 -- 172.21.15.37:0/2101540342 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c0ab5f0 con 0x7f373c155e60 2024-05-30T06:53:45.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f373aa00640 1 -- 172.21.15.37:0/2101540342 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372c0b0070 con 0x7f373c155e60 2024-05-30T06:53:45.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f373aa00640 1 -- 172.21.15.37:0/2101540342 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c0ab9b0 con 0x7f373c155e60 2024-05-30T06:53:45.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f3742800640 1 -- 172.21.15.37:0/2101540342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f373c155e60 msgr2=0x7f373c0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:45.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.382+0000 7f3742800640 1 --2- 172.21.15.37:0/2101540342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f373c155e60 0x7f373c0b36a0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f373c070df0 tx=0x7f372c01c520 comp rx=0 tx=0).stop 2024-05-30T06:53:45.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 -- 172.21.15.37:0/2101540342 shutdown_connections 2024-05-30T06:53:45.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 --2- 172.21.15.37:0/2101540342 >> v2:172.21.15.105:3300/0 conn(0x7f373c0b2ec0 0x7f373c0cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 --2- 172.21.15.37:0/2101540342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f373c06f9a0 0x7f373c0cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 --2- 172.21.15.37:0/2101540342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f373c155e60 0x7f373c0b36a0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 -- 172.21.15.37:0/2101540342 >> 172.21.15.37:0/2101540342 conn(0x7f373c0b23a0 msgr2=0x7f373c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:45.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 -- 172.21.15.37:0/2101540342 shutdown_connections 2024-05-30T06:53:45.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 -- 172.21.15.37:0/2101540342 wait complete. 2024-05-30T06:53:45.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 Processor -- start 2024-05-30T06:53:45.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 -- start start 2024-05-30T06:53:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f373c06f9a0 0x7f373c1470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f373c0b2ec0 0x7f373c15e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f373c155e60 0x7f373c15e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f373c0ce020 con 0x7f373c0b2ec0 2024-05-30T06:53:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f373c0cdea0 con 0x7f373c155e60 2024-05-30T06:53:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3742800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f373c0ce1a0 con 0x7f373c06f9a0 2024-05-30T06:53:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3732a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f373c0b2ec0 0x7f373c15e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3732a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f373c0b2ec0 0x7f373c15e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51092/0 (socket says 172.21.15.37:51092) 2024-05-30T06:53:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3732a00640 1 -- 172.21.15.37:0/1956597643 learned_addr learned my addr 172.21.15.37:0/1956597643 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f373b400640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f373c06f9a0 0x7f373c1470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f373be00640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f373c155e60 0x7f373c15e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3732a00640 1 -- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f373c06f9a0 msgr2=0x7f373c1470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3732a00640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f373c06f9a0 0x7f373c1470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3732a00640 1 -- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f373c155e60 msgr2=0x7f373c15e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3732a00640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f373c155e60 0x7f373c15e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3732a00640 1 -- 172.21.15.37:0/1956597643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373c151450 con 0x7f373c0b2ec0 2024-05-30T06:53:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3732a00640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f373c0b2ec0 0x7f373c15e110 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f372400cf00 tx=0x7f372400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.386+0000 7f3733e00640 1 -- 172.21.15.37:0/1956597643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3724003ba0 con 0x7f373c0b2ec0 2024-05-30T06:53:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.390+0000 7f3733e00640 1 -- 172.21.15.37:0/1956597643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3724003d40 con 0x7f373c0b2ec0 2024-05-30T06:53:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.390+0000 7f3742800640 1 -- 172.21.15.37:0/1956597643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f373c151730 con 0x7f373c0b2ec0 2024-05-30T06:53:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.390+0000 7f3733e00640 1 -- 172.21.15.37:0/1956597643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372400d860 con 0x7f373c0b2ec0 2024-05-30T06:53:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.390+0000 7f3742800640 1 -- 172.21.15.37:0/1956597643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f373c14b010 con 0x7f373c0b2ec0 2024-05-30T06:53:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.390+0000 7f3742800640 1 -- 172.21.15.37:0/1956597643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f373c068b20 con 0x7f373c0b2ec0 2024-05-30T06:53:45.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.390+0000 7f3733e00640 1 -- 172.21.15.37:0/1956597643 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f372400da00 con 0x7f373c0b2ec0 2024-05-30T06:53:45.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.390+0000 7f3733e00640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f37180695b0 0x7f371806ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.390+0000 7f3733e00640 1 -- 172.21.15.37:0/1956597643 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5737+0+0 (secure 0 0 0) 0x7f3724086090 con 0x7f373c0b2ec0 2024-05-30T06:53:45.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.390+0000 7f373b400640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f37180695b0 0x7f371806ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.394+0000 7f373b400640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f37180695b0 0x7f371806ba70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f372c0af000 tx=0x7f372c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:45.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.394+0000 7f3733e00640 1 -- 172.21.15.37:0/1956597643 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f37240580d0 con 0x7f373c0b2ec0 2024-05-30T06:53:45.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.566+0000 7f3742800640 1 -- 172.21.15.37:0/1956597643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f373c072fb0 con 0x7f373c0b2ec0 2024-05-30T06:53:45.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.566+0000 7f3733e00640 1 -- 172.21.15.37:0/1956597643 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16704 (secure 0 0 0) 0x7f37240579d0 con 0x7f373c0b2ec0 2024-05-30T06:53:45.569 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:45.569 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:53:44.572746+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:53:42.973928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-05-30T06:53:43.524517+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:53:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.570+0000 7f3742800640 1 -- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f37180695b0 msgr2=0x7f371806ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.570+0000 7f3742800640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f37180695b0 0x7f371806ba70 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f372c0af000 tx=0x7f372c0a7000 comp rx=0 tx=0).stop 2024-05-30T06:53:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.570+0000 7f3742800640 1 -- 172.21.15.37:0/1956597643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f373c0b2ec0 msgr2=0x7f373c15e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.570+0000 7f3742800640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f373c0b2ec0 0x7f373c15e110 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f372400cf00 tx=0x7f372400a710 comp rx=0 tx=0).stop 2024-05-30T06:53:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.570+0000 7f3742800640 1 -- 172.21.15.37:0/1956597643 shutdown_connections 2024-05-30T06:53:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.570+0000 7f3742800640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f37180695b0 0x7f371806ba70 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.570+0000 7f3742800640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f373c155e60 0x7f373c15e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.570+0000 7f3742800640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f373c0b2ec0 0x7f373c15e110 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.570+0000 7f3742800640 1 --2- 172.21.15.37:0/1956597643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f373c06f9a0 0x7f373c1470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.570+0000 7f3742800640 1 -- 172.21.15.37:0/1956597643 >> 172.21.15.37:0/1956597643 conn(0x7f373c0b23a0 msgr2=0x7f373c0b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.570+0000 7f3742800640 1 -- 172.21.15.37:0/1956597643 shutdown_connections 2024-05-30T06:53:45.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.570+0000 7f3742800640 1 -- 172.21.15.37:0/1956597643 wait complete. 2024-05-30T06:53:45.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:53:45.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.730+0000 7f956a600640 1 Processor -- start 2024-05-30T06:53:45.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.730+0000 7f956a600640 1 -- start start 2024-05-30T06:53:45.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.730+0000 7f956a600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9564155e60 0x7f95640b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.730+0000 7f956a600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f956406f9a0 0x7f95640cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.730+0000 7f956a600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f95640b2ec0 0x7f95640cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f956a600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f95640ccff0 con 0x7f956406f9a0 2024-05-30T06:53:45.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f956a600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f95640d00e0 con 0x7f95640b2ec0 2024-05-30T06:53:45.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f956a600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f956415c8f0 con 0x7f9564155e60 2024-05-30T06:53:45.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f955aa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f956406f9a0 0x7f95640cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f955aa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f956406f9a0 0x7f95640cf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51100/0 (socket says 172.21.15.37:51100) 2024-05-30T06:53:45.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f955aa00640 1 -- 172.21.15.37:0/4192315568 learned_addr learned my addr 172.21.15.37:0/4192315568 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:45.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f9563400640 1 --2- 172.21.15.37:0/4192315568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9564155e60 0x7f95640b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f9563e00640 1 --2- 172.21.15.37:0/4192315568 >> v2:172.21.15.105:3300/0 conn(0x7f95640b2ec0 0x7f95640cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f955aa00640 1 -- 172.21.15.37:0/4192315568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9564155e60 msgr2=0x7f95640b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:45.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f955aa00640 1 --2- 172.21.15.37:0/4192315568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9564155e60 0x7f95640b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f955aa00640 1 -- 172.21.15.37:0/4192315568 >> v2:172.21.15.105:3300/0 conn(0x7f95640b2ec0 msgr2=0x7f95640cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:45.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f955aa00640 1 --2- 172.21.15.37:0/4192315568 >> v2:172.21.15.105:3300/0 conn(0x7f95640b2ec0 0x7f95640cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f955aa00640 1 -- 172.21.15.37:0/4192315568 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95640ccc80 con 0x7f956406f9a0 2024-05-30T06:53:45.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f9563e00640 1 --2- 172.21.15.37:0/4192315568 >> v2:172.21.15.105:3300/0 conn(0x7f95640b2ec0 0x7f95640cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:45.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f9563400640 1 --2- 172.21.15.37:0/4192315568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9564155e60 0x7f95640b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:45.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f955aa00640 1 --2- 172.21.15.37:0/4192315568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f956406f9a0 0x7f95640cf660 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f9564070df0 tx=0x7f954c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ea2aac418a65a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:45.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f9562a00640 1 -- 172.21.15.37:0/4192315568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c0ab5f0 con 0x7f956406f9a0 2024-05-30T06:53:45.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f9562a00640 1 -- 172.21.15.37:0/4192315568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f954c0b0070 con 0x7f956406f9a0 2024-05-30T06:53:45.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.734+0000 7f9562a00640 1 -- 172.21.15.37:0/4192315568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c0ab9b0 con 0x7f956406f9a0 2024-05-30T06:53:45.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 -- 172.21.15.37:0/4192315568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f956406f9a0 msgr2=0x7f95640cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:45.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 --2- 172.21.15.37:0/4192315568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f956406f9a0 0x7f95640cf660 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f9564070df0 tx=0x7f954c01c520 comp rx=0 tx=0).stop 2024-05-30T06:53:45.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 -- 172.21.15.37:0/4192315568 shutdown_connections 2024-05-30T06:53:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 --2- 172.21.15.37:0/4192315568 >> v2:172.21.15.105:3300/0 conn(0x7f95640b2ec0 0x7f95640cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 --2- 172.21.15.37:0/4192315568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f956406f9a0 0x7f95640cf660 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 --2- 172.21.15.37:0/4192315568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9564155e60 0x7f95640b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 -- 172.21.15.37:0/4192315568 >> 172.21.15.37:0/4192315568 conn(0x7f95640b23a0 msgr2=0x7f95640b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 -- 172.21.15.37:0/4192315568 shutdown_connections 2024-05-30T06:53:45.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 -- 172.21.15.37:0/4192315568 wait complete. 2024-05-30T06:53:45.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 Processor -- start 2024-05-30T06:53:45.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 -- start start 2024-05-30T06:53:45.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956406f9a0 0x7f9564145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95640b2ec0 0x7f956415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9564155e60 0x7f956415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95640ce000 con 0x7f9564155e60 2024-05-30T06:53:45.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95640cde80 con 0x7f956406f9a0 2024-05-30T06:53:45.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f956a600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f95640ce180 con 0x7f95640b2ec0 2024-05-30T06:53:45.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f9563e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9564155e60 0x7f956415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f9563e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9564155e60 0x7f956415daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51114/0 (socket says 172.21.15.37:51114) 2024-05-30T06:53:45.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f9563e00640 1 -- 172.21.15.37:0/408526954 learned_addr learned my addr 172.21.15.37:0/408526954 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:45.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f9563400640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956406f9a0 0x7f9564145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f955aa00640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95640b2ec0 0x7f956415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f9563e00640 1 -- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95640b2ec0 msgr2=0x7f956415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f9563e00640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95640b2ec0 0x7f956415ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f9563e00640 1 -- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956406f9a0 msgr2=0x7f9564145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f9563e00640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956406f9a0 0x7f9564145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f9563e00640 1 -- 172.21.15.37:0/408526954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9564159b50 con 0x7f9564155e60 2024-05-30T06:53:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.738+0000 7f9563400640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956406f9a0 0x7f9564145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.742+0000 7f9563e00640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9564155e60 0x7f956415daf0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f955c00cf20 tx=0x7f955c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.742+0000 7f955be00640 1 -- 172.21.15.37:0/408526954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c01a070 con 0x7f9564155e60 2024-05-30T06:53:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.742+0000 7f955be00640 1 -- 172.21.15.37:0/408526954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955c00d840 con 0x7f9564155e60 2024-05-30T06:53:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.742+0000 7f956a600640 1 -- 172.21.15.37:0/408526954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9564159e30 con 0x7f9564155e60 2024-05-30T06:53:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.742+0000 7f955be00640 1 -- 172.21.15.37:0/408526954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c00dc30 con 0x7f9564155e60 2024-05-30T06:53:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.742+0000 7f956a600640 1 -- 172.21.15.37:0/408526954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956415a3f0 con 0x7f9564155e60 2024-05-30T06:53:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.742+0000 7f956a600640 1 -- 172.21.15.37:0/408526954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9564068b20 con 0x7f9564155e60 2024-05-30T06:53:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.742+0000 7f955be00640 1 -- 172.21.15.37:0/408526954 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f955c01d070 con 0x7f9564155e60 2024-05-30T06:53:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.742+0000 7f955be00640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9540069580 0x7f954006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.742+0000 7f955be00640 1 -- 172.21.15.37:0/408526954 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5737+0+0 (secure 0 0 0) 0x7f955c085df0 con 0x7f9564155e60 2024-05-30T06:53:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.742+0000 7f9563400640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9540069580 0x7f954006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:45.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.746+0000 7f9563400640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9540069580 0x7f954006ba40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f955400a9b0 tx=0x7f9554008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:45.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.746+0000 7f955be00640 1 -- 172.21.15.37:0/408526954 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f955c057e00 con 0x7f9564155e60 2024-05-30T06:53:45.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.914+0000 7f956a600640 1 -- 172.21.15.37:0/408526954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9564072fb0 con 0x7f9564155e60 2024-05-30T06:53:45.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.914+0000 7f955be00640 1 -- 172.21.15.37:0/408526954 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16704 (secure 0 0 0) 0x7f955c057700 con 0x7f9564155e60 2024-05-30T06:53:45.917 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:45.917 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:53:44.572746+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:53:42.973928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-05-30T06:53:43.524517+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:53:45.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.918+0000 7f956a600640 1 -- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9540069580 msgr2=0x7f954006ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:45.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.918+0000 7f956a600640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9540069580 0x7f954006ba40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f955400a9b0 tx=0x7f9554008040 comp rx=0 tx=0).stop 2024-05-30T06:53:45.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.918+0000 7f956a600640 1 -- 172.21.15.37:0/408526954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9564155e60 msgr2=0x7f956415daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:45.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.918+0000 7f956a600640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9564155e60 0x7f956415daf0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f955c00cf20 tx=0x7f955c00a710 comp rx=0 tx=0).stop 2024-05-30T06:53:45.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.918+0000 7f956a600640 1 -- 172.21.15.37:0/408526954 shutdown_connections 2024-05-30T06:53:45.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.918+0000 7f956a600640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9564155e60 0x7f956415daf0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.918+0000 7f956a600640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95640b2ec0 0x7f956415ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.918+0000 7f956a600640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9540069580 0x7f954006ba40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.918+0000 7f956a600640 1 --2- 172.21.15.37:0/408526954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956406f9a0 0x7f9564145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:45.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.918+0000 7f956a600640 1 -- 172.21.15.37:0/408526954 >> 172.21.15.37:0/408526954 conn(0x7f95640b23a0 msgr2=0x7f95640b47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:45.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.918+0000 7f956a600640 1 -- 172.21.15.37:0/408526954 shutdown_connections 2024-05-30T06:53:45.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:45.918+0000 7f956a600640 1 -- 172.21.15.37:0/408526954 wait complete. 2024-05-30T06:53:45.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T06:53:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9e5c00640 1 Processor -- start 2024-05-30T06:53:46.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9e5c00640 1 -- start start 2024-05-30T06:53:46.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9e5c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9e006f770 0x7ff9e0166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:46.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9e5c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e015f310 con 0x7ff9e00cd440 2024-05-30T06:53:46.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9e5c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e015f5f0 con 0x7ff9e0155da0 2024-05-30T06:53:46.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9e5c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e00b4760 con 0x7ff9e006f770 2024-05-30T06:53:46.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9d6000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff9e00cd440 0x7ff9e006f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42816/0 (socket says 172.21.15.37:42816) 2024-05-30T06:53:46.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9d6000640 1 -- 172.21.15.37:0/4292719280 learned_addr learned my addr 172.21.15.37:0/4292719280 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:46.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9df400640 1 --2- 172.21.15.37:0/4292719280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9e006f770 0x7ff9e0166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:46.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9de000640 1 -- 172.21.15.37:0/4292719280 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307551827 0 0) 0x7ff9e015f310 con 0x7ff9e00cd440 2024-05-30T06:53:46.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9de000640 1 -- 172.21.15.37:0/4292719280 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9c4003530 con 0x7ff9e00cd440 2024-05-30T06:53:46.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9de000640 1 -- 172.21.15.37:0/4292719280 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1423908734 0 0) 0x7ff9e015f5f0 con 0x7ff9e0155da0 2024-05-30T06:53:46.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9de000640 1 -- 172.21.15.37:0/4292719280 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e015f310 con 0x7ff9e0155da0 2024-05-30T06:53:46.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9de000640 1 -- 172.21.15.37:0/4292719280 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1497997360 0 0) 0x7ff9c4003530 con 0x7ff9e00cd440 2024-05-30T06:53:46.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9df400640 1 -- 172.21.15.37:0/4292719280 >> v1:172.21.15.105:6789/0 conn(0x7ff9e0155da0 legacy=0x7ff9e00cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:46.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9df400640 1 -- 172.21.15.37:0/4292719280 >> v1:172.21.15.37:6789/0 conn(0x7ff9e00cd440 legacy=0x7ff9e006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:46.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.082+0000 7ff9df400640 1 -- 172.21.15.37:0/4292719280 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e015f8d0 con 0x7ff9e006f770 2024-05-30T06:53:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.086+0000 7ff9df400640 1 --2- 172.21.15.37:0/4292719280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9e006f770 0x7ff9e0166570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009dc0 tx=0x7ff9d801c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18c2ce8e5802fbbe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.086+0000 7ff9de000640 1 -- 172.21.15.37:0/4292719280 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8001680 con 0x7ff9e006f770 2024-05-30T06:53:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.086+0000 7ff9de000640 1 -- 172.21.15.37:0/4292719280 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d80af070 con 0x7ff9e006f770 2024-05-30T06:53:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.086+0000 7ff9de000640 1 -- 172.21.15.37:0/4292719280 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80aa6a0 con 0x7ff9e006f770 2024-05-30T06:53:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.086+0000 7ff9e5c00640 1 -- 172.21.15.37:0/4292719280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9e006f770 msgr2=0x7ff9e0166570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.086+0000 7ff9e5c00640 1 --2- 172.21.15.37:0/4292719280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9e006f770 0x7ff9e0166570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009dc0 tx=0x7ff9d801c790 comp rx=0 tx=0).stop 2024-05-30T06:53:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.086+0000 7ff9e5c00640 1 -- 172.21.15.37:0/4292719280 shutdown_connections 2024-05-30T06:53:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.086+0000 7ff9e5c00640 1 --2- 172.21.15.37:0/4292719280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9e006f770 0x7ff9e0166570 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.086+0000 7ff9e5c00640 1 -- 172.21.15.37:0/4292719280 >> 172.21.15.37:0/4292719280 conn(0x7ff9e006bf60 msgr2=0x7ff9e00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.086+0000 7ff9e5c00640 1 -- 172.21.15.37:0/4292719280 shutdown_connections 2024-05-30T06:53:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.086+0000 7ff9e5c00640 1 -- 172.21.15.37:0/4292719280 wait complete. 2024-05-30T06:53:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9e5c00640 1 Processor -- start 2024-05-30T06:53:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9e5c00640 1 -- start start 2024-05-30T06:53:46.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9e5c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9e006f770 0x7ff9e01f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:46.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9e5c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e0155da0 0x7ff9e01510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:46.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9e5c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9e01568d0 0x7ff9e0156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:46.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9e5c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e006eb70 con 0x7ff9e0155da0 2024-05-30T06:53:46.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9e5c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e006e9f0 con 0x7ff9e01568d0 2024-05-30T06:53:46.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9e5c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e006ecf0 con 0x7ff9e006f770 2024-05-30T06:53:46.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9d6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e0155da0 0x7ff9e01510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:46.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9d6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e0155da0 0x7ff9e01510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51120/0 (socket says 172.21.15.37:51120) 2024-05-30T06:53:46.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9d6000640 1 -- 172.21.15.37:0/3462577902 learned_addr learned my addr 172.21.15.37:0/3462577902 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:46.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9dea00640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9e006f770 0x7ff9e01f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:46.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9df400640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9e01568d0 0x7ff9e0156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:46.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9d6000640 1 -- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9e006f770 msgr2=0x7ff9e01f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:46.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9d6000640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9e006f770 0x7ff9e01f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:46.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9d6000640 1 -- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9e01568d0 msgr2=0x7ff9e0156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:46.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9d6000640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9e01568d0 0x7ff9e0156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:46.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9d6000640 1 -- 172.21.15.37:0/3462577902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e0157350 con 0x7ff9e0155da0 2024-05-30T06:53:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9d6000640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e0155da0 0x7ff9e01510c0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800c780 tx=0x7ff9c800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9d7400640 1 -- 172.21.15.37:0/3462577902 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8017070 con 0x7ff9e0155da0 2024-05-30T06:53:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9d7400640 1 -- 172.21.15.37:0/3462577902 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c8005b00 con 0x7ff9e0155da0 2024-05-30T06:53:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9e5c00640 1 -- 172.21.15.37:0/3462577902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e0157630 con 0x7ff9e0155da0 2024-05-30T06:53:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9d7400640 1 -- 172.21.15.37:0/3462577902 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8007070 con 0x7ff9e0155da0 2024-05-30T06:53:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.090+0000 7ff9e5c00640 1 -- 172.21.15.37:0/3462577902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e0157bf0 con 0x7ff9e0155da0 2024-05-30T06:53:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.094+0000 7ff9e5c00640 1 -- 172.21.15.37:0/3462577902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e0068bc0 con 0x7ff9e0155da0 2024-05-30T06:53:46.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.094+0000 7ff9d7400640 1 -- 172.21.15.37:0/3462577902 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7ff9c801a070 con 0x7ff9e0155da0 2024-05-30T06:53:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.094+0000 7ff9d7400640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff9bc069580 0x7ff9bc06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.094+0000 7ff9d7400640 1 -- 172.21.15.37:0/3462577902 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5737+0+0 (secure 0 0 0) 0x7ff9c8084ec0 con 0x7ff9e0155da0 2024-05-30T06:53:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.094+0000 7ff9dea00640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff9bc069580 0x7ff9bc06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.094+0000 7ff9dea00640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff9bc069580 0x7ff9bc06ba40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00011f0 tx=0x7ff9d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:46.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.098+0000 7ff9d7400640 1 -- 172.21.15.37:0/3462577902 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff9c8056b60 con 0x7ff9e0155da0 2024-05-30T06:53:46.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:46.302+0000 7ff9e5c00640 1 -- 172.21.15.37:0/3462577902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff9e00b6790 con 0x7ff9e0155da0 2024-05-30T06:53:47.153 INFO:tasks.ceph.mds.b.smithi105.stderr:2024-05-30T06:53:47.157+0000 7f2d46000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T06:53:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.198+0000 7ff9d7400640 1 -- 172.21.15.37:0/3462577902 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) ==== 118+0+0 (secure 0 0 0) 0x7ff9c8056460 con 0x7ff9e0155da0 2024-05-30T06:53:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.202+0000 7ff9e5c00640 1 -- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff9bc069580 msgr2=0x7ff9bc06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.202+0000 7ff9e5c00640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff9bc069580 0x7ff9bc06ba40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff9d00011f0 tx=0x7ff9d0009040 comp rx=0 tx=0).stop 2024-05-30T06:53:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.202+0000 7ff9e5c00640 1 -- 172.21.15.37:0/3462577902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e0155da0 msgr2=0x7ff9e01510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.202+0000 7ff9e5c00640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e0155da0 0x7ff9e01510c0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800c780 tx=0x7ff9c800cc40 comp rx=0 tx=0).stop 2024-05-30T06:53:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.202+0000 7ff9e5c00640 1 -- 172.21.15.37:0/3462577902 shutdown_connections 2024-05-30T06:53:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.202+0000 7ff9e5c00640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff9bc069580 0x7ff9bc06ba40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.202+0000 7ff9e5c00640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9e01568d0 0x7ff9e0156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.202+0000 7ff9e5c00640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e0155da0 0x7ff9e01510c0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.202+0000 7ff9e5c00640 1 --2- 172.21.15.37:0/3462577902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9e006f770 0x7ff9e01f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.202+0000 7ff9e5c00640 1 -- 172.21.15.37:0/3462577902 >> 172.21.15.37:0/3462577902 conn(0x7ff9e006bf60 msgr2=0x7ff9e00b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:47.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.202+0000 7ff9e5c00640 1 -- 172.21.15.37:0/3462577902 shutdown_connections 2024-05-30T06:53:47.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.202+0000 7ff9e5c00640 1 -- 172.21.15.37:0/3462577902 wait complete. 2024-05-30T06:53:47.227 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T06:53:47.227 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T06:53:47.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.374+0000 7f7c2e800640 1 Processor -- start 2024-05-30T06:53:47.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.374+0000 7f7c2e800640 1 -- start start 2024-05-30T06:53:47.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c2e800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c28144c00 0x7f7c2806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:47.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c2e800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c280cf430 con 0x7f7c2815f9c0 2024-05-30T06:53:47.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c2e800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c280cf6f0 con 0x7f7c28144fe0 2024-05-30T06:53:47.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c2e800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7c280b3bf0 con 0x7f7c28144c00 2024-05-30T06:53:47.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c2de00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7c2815f9c0 0x7f7c28071e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53420/0 (socket says 172.21.15.37:53420) 2024-05-30T06:53:47.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c2de00640 1 -- 172.21.15.37:0/2999034510 learned_addr learned my addr 172.21.15.37:0/2999034510 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:47.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c2d400640 1 --2- 172.21.15.37:0/2999034510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c28144c00 0x7f7c2806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:47.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c27e00640 1 -- 172.21.15.37:0/2999034510 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199515104 0 0) 0x7f7c280cf430 con 0x7f7c2815f9c0 2024-05-30T06:53:47.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c27e00640 1 -- 172.21.15.37:0/2999034510 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c10003530 con 0x7f7c2815f9c0 2024-05-30T06:53:47.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c27e00640 1 -- 172.21.15.37:0/2999034510 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123343541 0 0) 0x7f7c280cf6f0 con 0x7f7c28144fe0 2024-05-30T06:53:47.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c27e00640 1 -- 172.21.15.37:0/2999034510 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c280cf430 con 0x7f7c28144fe0 2024-05-30T06:53:47.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c2d400640 1 -- 172.21.15.37:0/2999034510 >> v1:172.21.15.105:6789/0 conn(0x7f7c28144fe0 legacy=0x7f7c2815f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:47.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c27e00640 1 -- 172.21.15.37:0/2999034510 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2348665054 0 0) 0x7f7c10003530 con 0x7f7c2815f9c0 2024-05-30T06:53:47.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c2d400640 1 -- 172.21.15.37:0/2999034510 >> v1:172.21.15.37:6789/0 conn(0x7f7c2815f9c0 legacy=0x7f7c28071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:47.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.378+0000 7f7c2d400640 1 -- 172.21.15.37:0/2999034510 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c280cf9d0 con 0x7f7c28144c00 2024-05-30T06:53:47.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.382+0000 7f7c2d400640 1 --2- 172.21.15.37:0/2999034510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c28144c00 0x7f7c2806ef50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0097f0 tx=0x7f7c1c01c220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4200b2a96fd5373 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:47.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.382+0000 7f7c27e00640 1 -- 172.21.15.37:0/2999034510 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0b0070 con 0x7f7c28144c00 2024-05-30T06:53:47.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.382+0000 7f7c27e00640 1 -- 172.21.15.37:0/2999034510 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0ab400 con 0x7f7c28144c00 2024-05-30T06:53:47.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.382+0000 7f7c27e00640 1 -- 172.21.15.37:0/2999034510 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20001a00 con 0x7f7c28144c00 2024-05-30T06:53:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.382+0000 7f7c2e800640 1 -- 172.21.15.37:0/2999034510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c28144c00 msgr2=0x7f7c2806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.382+0000 7f7c2e800640 1 --2- 172.21.15.37:0/2999034510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c28144c00 0x7f7c2806ef50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0097f0 tx=0x7f7c1c01c220 comp rx=0 tx=0).stop 2024-05-30T06:53:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.382+0000 7f7c2e800640 1 -- 172.21.15.37:0/2999034510 shutdown_connections 2024-05-30T06:53:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.382+0000 7f7c2e800640 1 --2- 172.21.15.37:0/2999034510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c28144c00 0x7f7c2806ef50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:47.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.382+0000 7f7c2e800640 1 -- 172.21.15.37:0/2999034510 >> 172.21.15.37:0/2999034510 conn(0x7f7c28067d60 msgr2=0x7f7c2806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:47.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.382+0000 7f7c2e800640 1 -- 172.21.15.37:0/2999034510 shutdown_connections 2024-05-30T06:53:47.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.382+0000 7f7c2e800640 1 -- 172.21.15.37:0/2999034510 wait complete. 2024-05-30T06:53:47.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.382+0000 7f7c2e800640 1 Processor -- start 2024-05-30T06:53:47.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.382+0000 7f7c2e800640 1 -- start start 2024-05-30T06:53:47.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2e800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c28144c00 0x7f7c280af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:47.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2e800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c28144fe0 0x7f7c2815ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:47.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c2815f9c0 0x7f7c28141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:47.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2e800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c280cfd40 con 0x7f7c2815f9c0 2024-05-30T06:53:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2e800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7c280d01d0 con 0x7f7c28144fe0 2024-05-30T06:53:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2e800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7c280cf1d0 con 0x7f7c28144c00 2024-05-30T06:53:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c2815f9c0 0x7f7c28141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c2815f9c0 0x7f7c28141d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56704/0 (socket says 172.21.15.37:56704) 2024-05-30T06:53:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2d400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c28144c00 0x7f7c280af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2de00640 1 -- 172.21.15.37:0/144070230 learned_addr learned my addr 172.21.15.37:0/144070230 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2ca00640 1 --2- 172.21.15.37:0/144070230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c28144fe0 0x7f7c2815ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2de00640 1 -- 172.21.15.37:0/144070230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c28144c00 msgr2=0x7f7c280af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2de00640 1 --2- 172.21.15.37:0/144070230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c28144c00 0x7f7c280af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2de00640 1 -- 172.21.15.37:0/144070230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c28144fe0 msgr2=0x7f7c2815ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2de00640 1 --2- 172.21.15.37:0/144070230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c28144fe0 0x7f7c2815ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2de00640 1 -- 172.21.15.37:0/144070230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c28140cb0 con 0x7f7c2815f9c0 2024-05-30T06:53:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2de00640 1 --2- 172.21.15.37:0/144070230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c2815f9c0 0x7f7c28141d50 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000cc50 tx=0x7f7c2000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c25600640 1 -- 172.21.15.37:0/144070230 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2000ce60 con 0x7f7c2815f9c0 2024-05-30T06:53:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c25600640 1 -- 172.21.15.37:0/144070230 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c20012400 con 0x7f7c2815f9c0 2024-05-30T06:53:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c25600640 1 -- 172.21.15.37:0/144070230 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c200127f0 con 0x7f7c2815f9c0 2024-05-30T06:53:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2e800640 1 -- 172.21.15.37:0/144070230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c28140f90 con 0x7f7c2815f9c0 2024-05-30T06:53:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2e800640 1 -- 172.21.15.37:0/144070230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c28141550 con 0x7f7c2815f9c0 2024-05-30T06:53:47.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c2e800640 1 -- 172.21.15.37:0/144070230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c28068700 con 0x7f7c2815f9c0 2024-05-30T06:53:47.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.386+0000 7f7c25600640 1 -- 172.21.15.37:0/144070230 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f7c20012990 con 0x7f7c2815f9c0 2024-05-30T06:53:47.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.390+0000 7f7c25600640 1 --2- 172.21.15.37:0/144070230 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7c080695b0 0x7f7c0806ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:47.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.390+0000 7f7c25600640 1 -- 172.21.15.37:0/144070230 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5737+0+0 (secure 0 0 0) 0x7f7c20086010 con 0x7f7c2815f9c0 2024-05-30T06:53:47.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.390+0000 7f7c2d400640 1 --2- 172.21.15.37:0/144070230 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7c080695b0 0x7f7c0806ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:47.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.390+0000 7f7c2d400640 1 --2- 172.21.15.37:0/144070230 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7c080695b0 0x7f7c0806ba70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ad000 tx=0x7f7c1c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:47.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.394+0000 7f7c25600640 1 -- 172.21.15.37:0/144070230 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7c200575d0 con 0x7f7c2815f9c0 2024-05-30T06:53:47.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:47.594+0000 7f7c2e800640 1 -- 172.21.15.37:0/144070230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7c2815b3c0 con 0x7f7c2815f9c0 2024-05-30T06:53:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.202+0000 7f7c25600640 1 -- 172.21.15.37:0/144070230 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v55) ==== 122+0+0 (secure 0 0 0) 0x7f7c2005b8d0 con 0x7f7c2815f9c0 2024-05-30T06:53:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.202+0000 7f7c2e800640 1 -- 172.21.15.37:0/144070230 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7c080695b0 msgr2=0x7f7c0806ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.202+0000 7f7c2e800640 1 --2- 172.21.15.37:0/144070230 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7c080695b0 0x7f7c0806ba70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ad000 tx=0x7f7c1c0a6000 comp rx=0 tx=0).stop 2024-05-30T06:53:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.202+0000 7f7c2e800640 1 -- 172.21.15.37:0/144070230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c2815f9c0 msgr2=0x7f7c28141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.202+0000 7f7c2e800640 1 --2- 172.21.15.37:0/144070230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c2815f9c0 0x7f7c28141d50 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000cc50 tx=0x7f7c2000a430 comp rx=0 tx=0).stop 2024-05-30T06:53:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.202+0000 7f7c2e800640 1 -- 172.21.15.37:0/144070230 shutdown_connections 2024-05-30T06:53:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.202+0000 7f7c2e800640 1 --2- 172.21.15.37:0/144070230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c2815f9c0 0x7f7c28141d50 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.202+0000 7f7c2e800640 1 --2- 172.21.15.37:0/144070230 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7c080695b0 0x7f7c0806ba70 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.202+0000 7f7c2e800640 1 --2- 172.21.15.37:0/144070230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7c28144fe0 0x7f7c2815ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.202+0000 7f7c2e800640 1 --2- 172.21.15.37:0/144070230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7c28144c00 0x7f7c280af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.202+0000 7f7c2e800640 1 -- 172.21.15.37:0/144070230 >> 172.21.15.37:0/144070230 conn(0x7f7c28067d60 msgr2=0x7f7c28142b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.202+0000 7f7c2e800640 1 -- 172.21.15.37:0/144070230 shutdown_connections 2024-05-30T06:53:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.202+0000 7f7c2e800640 1 -- 172.21.15.37:0/144070230 wait complete. 2024-05-30T06:53:48.230 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T06:53:48.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:53:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3415800640 1 Processor -- start 2024-05-30T06:53:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3415800640 1 -- start start 2024-05-30T06:53:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3415800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015e9f0 0x7f34100d4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:48.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3415800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34100d54b0 0x7f34100d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3415800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34100b3e30 con 0x7f34100d16b0 2024-05-30T06:53:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3415800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f34100b4130 con 0x7f34100d54b0 2024-05-30T06:53:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3415800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f34100cfeb0 con 0x7f341015e9f0 2024-05-30T06:53:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3407400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34100d54b0 0x7f34100d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3407400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34100d54b0 0x7f34100d1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56710/0 (socket says 172.21.15.37:56710) 2024-05-30T06:53:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3414e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f34100d16b0 0x7f34100d2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53426/0 (socket says 172.21.15.37:53426) 2024-05-30T06:53:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3407400640 1 -- 172.21.15.37:0/556872856 learned_addr learned my addr 172.21.15.37:0/556872856 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f340fe00640 1 --2- 172.21.15.37:0/556872856 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015e9f0 0x7f34100d4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3407400640 1 -- 172.21.15.37:0/556872856 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015e9f0 msgr2=0x7f34100d4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3407400640 1 --2- 172.21.15.37:0/556872856 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015e9f0 0x7f34100d4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3407400640 1 -- 172.21.15.37:0/556872856 >> v1:172.21.15.37:6789/0 conn(0x7f34100d16b0 legacy=0x7f34100d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.378+0000 7f3407400640 1 -- 172.21.15.37:0/556872856 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34100d0190 con 0x7f34100d54b0 2024-05-30T06:53:48.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f3407400640 1 --2- 172.21.15.37:0/556872856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100d54b0 0x7f34100d1170 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009870 tx=0x7f33f801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a37a25fcc62eaa server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:48.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f340f400640 1 -- 172.21.15.37:0/556872856 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f80a7070 con 0x7f34100d54b0 2024-05-30T06:53:48.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f340f400640 1 -- 172.21.15.37:0/556872856 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f80b0070 con 0x7f34100d54b0 2024-05-30T06:53:48.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f340f400640 1 -- 172.21.15.37:0/556872856 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f80ab890 con 0x7f34100d54b0 2024-05-30T06:53:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f3415800640 1 -- 172.21.15.37:0/556872856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100d54b0 msgr2=0x7f34100d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f3415800640 1 --2- 172.21.15.37:0/556872856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100d54b0 0x7f34100d1170 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009870 tx=0x7f33f801c560 comp rx=0 tx=0).stop 2024-05-30T06:53:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f3415800640 1 -- 172.21.15.37:0/556872856 shutdown_connections 2024-05-30T06:53:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f3415800640 1 --2- 172.21.15.37:0/556872856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100d54b0 0x7f34100d1170 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f3415800640 1 --2- 172.21.15.37:0/556872856 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015e9f0 0x7f34100d4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f3415800640 1 -- 172.21.15.37:0/556872856 >> 172.21.15.37:0/556872856 conn(0x7f341008bff0 msgr2=0x7f34100d4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f3415800640 1 -- 172.21.15.37:0/556872856 shutdown_connections 2024-05-30T06:53:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f3415800640 1 -- 172.21.15.37:0/556872856 wait complete. 2024-05-30T06:53:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f3415800640 1 Processor -- start 2024-05-30T06:53:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.382+0000 7f3415800640 1 -- start start 2024-05-30T06:53:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f3415800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100d16b0 0x7f34100c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f3415800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34100d54b0 0x7f341014db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f3415800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015e9f0 0x7f341006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f3415800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34100d1ac0 con 0x7f34100d16b0 2024-05-30T06:53:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f3415800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f34100d3720 con 0x7f34100d54b0 2024-05-30T06:53:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f3415800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f341016b690 con 0x7f341015e9f0 2024-05-30T06:53:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f340fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100d16b0 0x7f34100c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f340fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100d16b0 0x7f34100c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56724/0 (socket says 172.21.15.37:56724) 2024-05-30T06:53:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f340fe00640 1 -- 172.21.15.37:0/2150751542 learned_addr learned my addr 172.21.15.37:0/2150751542 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f3414e00640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015e9f0 0x7f341006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f3407400640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34100d54b0 0x7f341014db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f340fe00640 1 -- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015e9f0 msgr2=0x7f341006dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f340fe00640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015e9f0 0x7f341006dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f340fe00640 1 -- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34100d54b0 msgr2=0x7f341014db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f340fe00640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34100d54b0 0x7f341014db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f340fe00640 1 -- 172.21.15.37:0/2150751542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341015d8d0 con 0x7f34100d16b0 2024-05-30T06:53:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f340fe00640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100d16b0 0x7f34100c8290 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f340000d5f0 tx=0x7f340000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f340cc00640 1 -- 172.21.15.37:0/2150751542 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34000125f0 con 0x7f34100d16b0 2024-05-30T06:53:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f340cc00640 1 -- 172.21.15.37:0/2150751542 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3400019070 con 0x7f34100d16b0 2024-05-30T06:53:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f340cc00640 1 -- 172.21.15.37:0/2150751542 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34000129b0 con 0x7f34100d16b0 2024-05-30T06:53:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f3415800640 1 -- 172.21.15.37:0/2150751542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34100b9d20 con 0x7f34100d16b0 2024-05-30T06:53:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f3415800640 1 -- 172.21.15.37:0/2150751542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34101551c0 con 0x7f34100d16b0 2024-05-30T06:53:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f3415800640 1 -- 172.21.15.37:0/2150751542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34100ba240 con 0x7f34100d16b0 2024-05-30T06:53:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.386+0000 7f340cc00640 1 -- 172.21.15.37:0/2150751542 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f3400012b50 con 0x7f34100d16b0 2024-05-30T06:53:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.390+0000 7f340cc00640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33ec0695b0 0x7f33ec06ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.390+0000 7f340cc00640 1 -- 172.21.15.37:0/2150751542 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5737+0+0 (secure 0 0 0) 0x7f34000859f0 con 0x7f34100d16b0 2024-05-30T06:53:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.390+0000 7f3407400640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33ec0695b0 0x7f33ec06ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:48.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.390+0000 7f3407400640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33ec0695b0 0x7f33ec06ba70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f33f80af000 tx=0x7f33f80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:48.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.394+0000 7f340cc00640 1 -- 172.21.15.37:0/2150751542 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f34000579d0 con 0x7f34100d16b0 2024-05-30T06:53:48.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.590+0000 7f3415800640 1 -- 172.21.15.37:0/2150751542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3410068ab0 con 0x7f34100d16b0 2024-05-30T06:53:48.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.590+0000 7f340cc00640 1 -- 172.21.15.37:0/2150751542 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5186 (secure 0 0 0) 0x7f34000572d0 con 0x7f34100d16b0 2024-05-30T06:53:48.591 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:48.591 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/714267880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":714267880},{"type":"v1","addr":"172.21.15.105:6836","nonce":714267880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3425209937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3425209937},{"type":"v1","addr":"172.21.15.37:6834","nonce":3425209937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1537275411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1537275411},{"type":"v1","addr":"172.21.15.37:6835","nonce":1537275411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:53:44.572714+0000","modified":"2024-05-30T06:53:47.596443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7932":{"gid":7932,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/3708478889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3708478889},{"type":"v1","addr":"172.21.15.105:6837","nonce":3708478889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7932,"qdb_cluster":[7932]},"id":6}]} 2024-05-30T06:53:48.592 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 55 2024-05-30T06:53:48.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.594+0000 7f3415800640 1 -- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33ec0695b0 msgr2=0x7f33ec06ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.594+0000 7f3415800640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33ec0695b0 0x7f33ec06ba70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f33f80af000 tx=0x7f33f80a7000 comp rx=0 tx=0).stop 2024-05-30T06:53:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.594+0000 7f3415800640 1 -- 172.21.15.37:0/2150751542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100d16b0 msgr2=0x7f34100c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.594+0000 7f3415800640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100d16b0 0x7f34100c8290 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f340000d5f0 tx=0x7f340000dab0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.594+0000 7f3415800640 1 -- 172.21.15.37:0/2150751542 shutdown_connections 2024-05-30T06:53:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.594+0000 7f3415800640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015e9f0 0x7f341006dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.594+0000 7f3415800640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33ec0695b0 0x7f33ec06ba70 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.594+0000 7f3415800640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34100d54b0 0x7f341014db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.594+0000 7f3415800640 1 --2- 172.21.15.37:0/2150751542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100d16b0 0x7f34100c8290 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.594+0000 7f3415800640 1 -- 172.21.15.37:0/2150751542 >> 172.21.15.37:0/2150751542 conn(0x7f341008bff0 msgr2=0x7f34100b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:48.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.594+0000 7f3415800640 1 -- 172.21.15.37:0/2150751542 shutdown_connections 2024-05-30T06:53:48.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.594+0000 7f3415800640 1 -- 172.21.15.37:0/2150751542 wait complete. 2024-05-30T06:53:48.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:53:48.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3732a00640 1 Processor -- start 2024-05-30T06:53:48.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3732a00640 1 -- start start 2024-05-30T06:53:48.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3732a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f372c161fc0 0x7f372c0d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:48.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3732a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f372c06d480 0x7f372c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:48.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3732a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f372c06dc60 con 0x7f372c0ccff0 2024-05-30T06:53:48.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3732a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f372c0d10c0 con 0x7f372c06d480 2024-05-30T06:53:48.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3732a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f372c0d0790 con 0x7f372c161fc0 2024-05-30T06:53:48.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3730c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f372c06d480 0x7f372c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:48.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3730c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f372c06d480 0x7f372c0ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56738/0 (socket says 172.21.15.37:56738) 2024-05-30T06:53:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3730c00640 1 -- 172.21.15.37:0/2059947894 learned_addr learned my addr 172.21.15.37:0/2059947894 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3732000640 1 --1- 172.21.15.37:0/2059947894 >> v1:172.21.15.37:6789/0 conn(0x7f372c0ccff0 0x7f372c09aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53434/0 (socket says 172.21.15.37:53434) 2024-05-30T06:53:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3731600640 1 --2- 172.21.15.37:0/2059947894 >> v2:172.21.15.105:3300/0 conn(0x7f372c161fc0 0x7f372c0d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3730c00640 1 -- 172.21.15.37:0/2059947894 >> v2:172.21.15.105:3300/0 conn(0x7f372c161fc0 msgr2=0x7f372c0d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3730c00640 1 --2- 172.21.15.37:0/2059947894 >> v2:172.21.15.105:3300/0 conn(0x7f372c161fc0 0x7f372c0d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3730c00640 1 -- 172.21.15.37:0/2059947894 >> v1:172.21.15.37:6789/0 conn(0x7f372c0ccff0 legacy=0x7f372c09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f3730c00640 1 -- 172.21.15.37:0/2059947894 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372c0d0a70 con 0x7f372c06d480 2024-05-30T06:53:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.754+0000 7f372be00640 1 -- 172.21.15.37:0/2059947894 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1115897047 0 0) 0x7f372c06dc60 con 0x7f372c0ccff0 2024-05-30T06:53:48.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f3730c00640 1 --2- 172.21.15.37:0/2059947894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f372c06d480 0x7f372c0ccab0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f372c06c940 tx=0x7f371801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becbcdfff1565ce6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:48.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f372be00640 1 -- 172.21.15.37:0/2059947894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37180b0070 con 0x7f372c06d480 2024-05-30T06:53:48.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f372be00640 1 -- 172.21.15.37:0/2059947894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37180ab600 con 0x7f372c06d480 2024-05-30T06:53:48.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f372be00640 1 -- 172.21.15.37:0/2059947894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37180ab9d0 con 0x7f372c06d480 2024-05-30T06:53:48.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f3732a00640 1 -- 172.21.15.37:0/2059947894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f372c06d480 msgr2=0x7f372c0ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f3732a00640 1 --2- 172.21.15.37:0/2059947894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f372c06d480 0x7f372c0ccab0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f372c06c940 tx=0x7f371801c520 comp rx=0 tx=0).stop 2024-05-30T06:53:48.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f3732a00640 1 -- 172.21.15.37:0/2059947894 shutdown_connections 2024-05-30T06:53:48.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f3732a00640 1 --2- 172.21.15.37:0/2059947894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f372c06d480 0x7f372c0ccab0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f3732a00640 1 --2- 172.21.15.37:0/2059947894 >> v2:172.21.15.105:3300/0 conn(0x7f372c161fc0 0x7f372c0d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f3732a00640 1 -- 172.21.15.37:0/2059947894 >> 172.21.15.37:0/2059947894 conn(0x7f372c0b3f50 msgr2=0x7f372c0b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:48.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f3732a00640 1 -- 172.21.15.37:0/2059947894 shutdown_connections 2024-05-30T06:53:48.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f3732a00640 1 -- 172.21.15.37:0/2059947894 wait complete. 2024-05-30T06:53:48.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f3732a00640 1 Processor -- start 2024-05-30T06:53:48.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.758+0000 7f3732a00640 1 -- start start 2024-05-30T06:53:48.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f372c06d480 0x7f372c157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:48.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f372c0ccff0 0x7f372c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:48.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f372c161fc0 0x7f372c156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:48.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f372c16bc40 con 0x7f372c161fc0 2024-05-30T06:53:48.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f372c16bac0 con 0x7f372c06d480 2024-05-30T06:53:48.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f372c16bdc0 con 0x7f372c0ccff0 2024-05-30T06:53:48.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f372c161fc0 0x7f372c156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:48.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f372c161fc0 0x7f372c156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56740/0 (socket says 172.21.15.37:56740) 2024-05-30T06:53:48.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732000640 1 -- 172.21.15.37:0/3424800339 learned_addr learned my addr 172.21.15.37:0/3424800339 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:48.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3730c00640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f372c0ccff0 0x7f372c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:48.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3731600640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f372c06d480 0x7f372c157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:48.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732000640 1 -- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f372c0ccff0 msgr2=0x7f372c155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732000640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f372c0ccff0 0x7f372c155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732000640 1 -- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f372c06d480 msgr2=0x7f372c157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732000640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f372c06d480 0x7f372c157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732000640 1 -- 172.21.15.37:0/3424800339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372c156d90 con 0x7f372c161fc0 2024-05-30T06:53:48.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3730c00640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f372c0ccff0 0x7f372c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:48.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3731600640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f372c06d480 0x7f372c157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:48.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732000640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f372c161fc0 0x7f372c156560 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f372400c7a0 tx=0x7f372400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:48.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3729600640 1 -- 172.21.15.37:0/3424800339 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3724018070 con 0x7f372c161fc0 2024-05-30T06:53:48.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3729600640 1 -- 172.21.15.37:0/3424800339 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372400a640 con 0x7f372c161fc0 2024-05-30T06:53:48.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732a00640 1 -- 172.21.15.37:0/3424800339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372c157070 con 0x7f372c161fc0 2024-05-30T06:53:48.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3729600640 1 -- 172.21.15.37:0/3424800339 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372400aab0 con 0x7f372c161fc0 2024-05-30T06:53:48.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732a00640 1 -- 172.21.15.37:0/3424800339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372c157630 con 0x7f372c161fc0 2024-05-30T06:53:48.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3732a00640 1 -- 172.21.15.37:0/3424800339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f372c157870 con 0x7f372c161fc0 2024-05-30T06:53:48.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.762+0000 7f3729600640 1 -- 172.21.15.37:0/3424800339 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f372401b070 con 0x7f372c161fc0 2024-05-30T06:53:48.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.766+0000 7f3729600640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f370c069580 0x7f370c06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:48.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.766+0000 7f3729600640 1 -- 172.21.15.37:0/3424800339 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5737+0+0 (secure 0 0 0) 0x7f3724084f90 con 0x7f372c161fc0 2024-05-30T06:53:48.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.766+0000 7f3731600640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f370c069580 0x7f370c06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:48.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.766+0000 7f3731600640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f370c069580 0x7f370c06ba40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f372c1fb410 tx=0x7f3720008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:48.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.770+0000 7f3729600640 1 -- 172.21.15.37:0/3424800339 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f372c157870 con 0x7f372c161fc0 2024-05-30T06:53:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.934+0000 7f3732a00640 1 -- 172.21.15.37:0/3424800339 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f372c068ab0 con 0x7f372c161fc0 2024-05-30T06:53:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.934+0000 7f3729600640 1 -- 172.21.15.37:0/3424800339 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+16691 (secure 0 0 0) 0x7f3724056c30 con 0x7f372c161fc0 2024-05-30T06:53:48.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:48.937 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":88,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:53:46.188938+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:53:42.973928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-05-30T06:53:43.524517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:53:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.938+0000 7f3732a00640 1 -- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f370c069580 msgr2=0x7f370c06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.938+0000 7f3732a00640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f370c069580 0x7f370c06ba40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f372c1fb410 tx=0x7f3720008040 comp rx=0 tx=0).stop 2024-05-30T06:53:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.938+0000 7f3732a00640 1 -- 172.21.15.37:0/3424800339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f372c161fc0 msgr2=0x7f372c156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.938+0000 7f3732a00640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f372c161fc0 0x7f372c156560 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f372400c7a0 tx=0x7f372400cc60 comp rx=0 tx=0).stop 2024-05-30T06:53:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.938+0000 7f3732a00640 1 -- 172.21.15.37:0/3424800339 shutdown_connections 2024-05-30T06:53:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.938+0000 7f3732a00640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f372c161fc0 0x7f372c156560 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.938+0000 7f3732a00640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f372c0ccff0 0x7f372c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.938+0000 7f3732a00640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f370c069580 0x7f370c06ba40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.938+0000 7f3732a00640 1 --2- 172.21.15.37:0/3424800339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f372c06d480 0x7f372c157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.938+0000 7f3732a00640 1 -- 172.21.15.37:0/3424800339 >> 172.21.15.37:0/3424800339 conn(0x7f372c0b3f50 msgr2=0x7f372c06ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.938+0000 7f3732a00640 1 -- 172.21.15.37:0/3424800339 shutdown_connections 2024-05-30T06:53:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:48.938+0000 7f3732a00640 1 -- 172.21.15.37:0/3424800339 wait complete. 2024-05-30T06:53:48.958 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-30T06:53:48.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:53:49.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.098+0000 7f3662e00640 1 Processor -- start 2024-05-30T06:53:49.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.098+0000 7f3662e00640 1 -- start start 2024-05-30T06:53:49.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f3662e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f365c155e60 0x7f365c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f3662e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f365c0b2ec0 0x7f365c0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f3662e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f365c15c8f0 con 0x7f365c06f9a0 2024-05-30T06:53:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f3662e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f365c0ccff0 con 0x7f365c0b2ec0 2024-05-30T06:53:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f3662e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f365c0ccc80 con 0x7f365c155e60 2024-05-30T06:53:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f3653400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f365c06f9a0 0x7f365c0cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53448/0 (socket says 172.21.15.37:53448) 2024-05-30T06:53:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f3653400640 1 -- 172.21.15.37:0/3700131146 learned_addr learned my addr 172.21.15.37:0/3700131146 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f3660e00640 1 --2- 172.21.15.37:0/3700131146 >> v2:172.21.15.37:3300/0 conn(0x7f365c0b2ec0 0x7f365c0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f365be00640 1 --2- 172.21.15.37:0/3700131146 >> v2:172.21.15.105:3300/0 conn(0x7f365c155e60 0x7f365c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f365b400640 1 -- 172.21.15.37:0/3700131146 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1136895322 0 0) 0x7f365c15c8f0 con 0x7f365c06f9a0 2024-05-30T06:53:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f3660e00640 1 -- 172.21.15.37:0/3700131146 >> v2:172.21.15.105:3300/0 conn(0x7f365c155e60 msgr2=0x7f365c0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:49.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f3660e00640 1 --2- 172.21.15.37:0/3700131146 >> v2:172.21.15.105:3300/0 conn(0x7f365c155e60 0x7f365c0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f3660e00640 1 -- 172.21.15.37:0/3700131146 >> v1:172.21.15.37:6789/0 conn(0x7f365c06f9a0 legacy=0x7f365c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f3660e00640 1 -- 172.21.15.37:0/3700131146 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c15cbd0 con 0x7f365c0b2ec0 2024-05-30T06:53:49.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.102+0000 7f3660e00640 1 --2- 172.21.15.37:0/3700131146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f365c0b2ec0 0x7f365c0cd480 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f365c073930 tx=0x7f365401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b5af964b6031e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f365b400640 1 -- 172.21.15.37:0/3700131146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36540b2070 con 0x7f365c0b2ec0 2024-05-30T06:53:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f365b400640 1 -- 172.21.15.37:0/3700131146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36540a5900 con 0x7f365c0b2ec0 2024-05-30T06:53:49.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f365b400640 1 -- 172.21.15.37:0/3700131146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36540a5cd0 con 0x7f365c0b2ec0 2024-05-30T06:53:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 -- 172.21.15.37:0/3700131146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f365c0b2ec0 msgr2=0x7f365c0cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 --2- 172.21.15.37:0/3700131146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f365c0b2ec0 0x7f365c0cd480 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f365c073930 tx=0x7f365401c930 comp rx=0 tx=0).stop 2024-05-30T06:53:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 -- 172.21.15.37:0/3700131146 shutdown_connections 2024-05-30T06:53:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 --2- 172.21.15.37:0/3700131146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f365c0b2ec0 0x7f365c0cd480 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 --2- 172.21.15.37:0/3700131146 >> v2:172.21.15.105:3300/0 conn(0x7f365c155e60 0x7f365c0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 -- 172.21.15.37:0/3700131146 >> 172.21.15.37:0/3700131146 conn(0x7f365c0b23a0 msgr2=0x7f365c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 -- 172.21.15.37:0/3700131146 shutdown_connections 2024-05-30T06:53:49.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 -- 172.21.15.37:0/3700131146 wait complete. 2024-05-30T06:53:49.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 Processor -- start 2024-05-30T06:53:49.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 -- start start 2024-05-30T06:53:49.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f365c06f9a0 0x7f365c14c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f365c0b2ec0 0x7f365c153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f365c155e60 0x7f365c154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f365c1669e0 con 0x7f365c0b2ec0 2024-05-30T06:53:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f365c166860 con 0x7f365c06f9a0 2024-05-30T06:53:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3662e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f365c166b60 con 0x7f365c155e60 2024-05-30T06:53:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3653400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f365c0b2ec0 0x7f365c153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3653400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f365c0b2ec0 0x7f365c153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56758/0 (socket says 172.21.15.37:56758) 2024-05-30T06:53:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3653400640 1 -- 172.21.15.37:0/3538027366 learned_addr learned my addr 172.21.15.37:0/3538027366 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3660e00640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f365c155e60 0x7f365c154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f365be00640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f365c06f9a0 0x7f365c14c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3653400640 1 -- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f365c155e60 msgr2=0x7f365c154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3653400640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f365c155e60 0x7f365c154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3653400640 1 -- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f365c06f9a0 msgr2=0x7f365c14c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3653400640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f365c06f9a0 0x7f365c14c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.106+0000 7f3653400640 1 -- 172.21.15.37:0/3538027366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c168550 con 0x7f365c0b2ec0 2024-05-30T06:53:49.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.110+0000 7f3653400640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f365c0b2ec0 0x7f365c153ff0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f364c0011f0 tx=0x7f364c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:49.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.110+0000 7f3658c00640 1 -- 172.21.15.37:0/3538027366 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c018070 con 0x7f365c0b2ec0 2024-05-30T06:53:49.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.110+0000 7f3658c00640 1 -- 172.21.15.37:0/3538027366 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364c0074e0 con 0x7f365c0b2ec0 2024-05-30T06:53:49.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.110+0000 7f3662e00640 1 -- 172.21.15.37:0/3538027366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365c168830 con 0x7f365c0b2ec0 2024-05-30T06:53:49.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.110+0000 7f3658c00640 1 -- 172.21.15.37:0/3538027366 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c004a10 con 0x7f365c0b2ec0 2024-05-30T06:53:49.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.110+0000 7f3662e00640 1 -- 172.21.15.37:0/3538027366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365c168df0 con 0x7f365c0b2ec0 2024-05-30T06:53:49.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.110+0000 7f3662e00640 1 -- 172.21.15.37:0/3538027366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f365c068b20 con 0x7f365c0b2ec0 2024-05-30T06:53:49.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.110+0000 7f3658c00640 1 -- 172.21.15.37:0/3538027366 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f364c01b070 con 0x7f365c0b2ec0 2024-05-30T06:53:49.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.110+0000 7f3658c00640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3638069580 0x7f363806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.114+0000 7f3658c00640 1 -- 172.21.15.37:0/3538027366 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5737+0+0 (secure 0 0 0) 0x7f364c084cc0 con 0x7f365c0b2ec0 2024-05-30T06:53:49.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.114+0000 7f365be00640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3638069580 0x7f363806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.114+0000 7f365be00640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3638069580 0x7f363806ba40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3644009a50 tx=0x7f3644008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:49.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.118+0000 7f3658c00640 1 -- 172.21.15.37:0/3538027366 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f364c056960 con 0x7f365c0b2ec0 2024-05-30T06:53:49.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.278+0000 7f3662e00640 1 -- 172.21.15.37:0/3538027366 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f365c072fb0 con 0x7f3638069580 2024-05-30T06:53:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.286+0000 7f3658c00640 1 -- 172.21.15.37:0/3538027366 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244158 (secure 0 0 0) 0x7f365c072fb0 con 0x7f3638069580 2024-05-30T06:53:49.288 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:49.290 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:53:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.290+0000 7f3662e00640 1 -- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3638069580 msgr2=0x7f363806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.290+0000 7f3662e00640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3638069580 0x7f363806ba40 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3644009a50 tx=0x7f3644008040 comp rx=0 tx=0).stop 2024-05-30T06:53:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.290+0000 7f3662e00640 1 -- 172.21.15.37:0/3538027366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f365c0b2ec0 msgr2=0x7f365c153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.290+0000 7f3662e00640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f365c0b2ec0 0x7f365c153ff0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f364c0011f0 tx=0x7f364c00c9b0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.290+0000 7f3662e00640 1 -- 172.21.15.37:0/3538027366 shutdown_connections 2024-05-30T06:53:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.290+0000 7f3662e00640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f365c155e60 0x7f365c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.290+0000 7f3662e00640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f365c0b2ec0 0x7f365c153ff0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.290+0000 7f3662e00640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3638069580 0x7f363806ba40 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.290+0000 7f3662e00640 1 --2- 172.21.15.37:0/3538027366 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f365c06f9a0 0x7f365c14c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.290+0000 7f3662e00640 1 -- 172.21.15.37:0/3538027366 >> 172.21.15.37:0/3538027366 conn(0x7f365c0b23a0 msgr2=0x7f365c0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.290+0000 7f3662e00640 1 -- 172.21.15.37:0/3538027366 shutdown_connections 2024-05-30T06:53:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.290+0000 7f3662e00640 1 -- 172.21.15.37:0/3538027366 wait complete. 2024-05-30T06:53:49.309 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":436,"stamp":"2024-05-30T06:53:48.913390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":120,"acting":120,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":763708,"kb_used_data":9396,"kb_used_omap":12,"kb_used_meta":754163,"kb_avail":754211012,"statfs":{"total":773094113280,"available":772312076288,"internally_reserved":0,"allocated":9621504,"data_stored":4802229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":772263472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.751546"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.170664+0000","last_change":"2024-05-30T06:53:44.170664+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.170664+0000","last_undegraded":"2024-05-30T06:53:44.170664+0000","last_fullsized":"2024-05-30T06:53:44.170664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.173379+0000","last_change":"2024-05-30T06:53:44.173379+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.173379+0000","last_undegraded":"2024-05-30T06:53:44.173379+0000","last_fullsized":"2024-05-30T06:53:44.173379+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168986+0000","last_change":"2024-05-30T06:53:44.168986+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168986+0000","last_undegraded":"2024-05-30T06:53:44.168986+0000","last_fullsized":"2024-05-30T06:53:44.168986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.171231+0000","last_change":"2024-05-30T06:53:44.171231+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.171231+0000","last_undegraded":"2024-05-30T06:53:44.171231+0000","last_fullsized":"2024-05-30T06:53:44.171231+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172323+0000","last_change":"2024-05-30T06:53:44.172323+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172323+0000","last_undegraded":"2024-05-30T06:53:44.172323+0000","last_fullsized":"2024-05-30T06:53:44.172323+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192824+0000","last_change":"2024-05-30T06:53:45.198790+0000","last_active":"2024-05-30T06:53:46.192824+0000","last_peered":"2024-05-30T06:53:46.192824+0000","last_clean":"2024-05-30T06:53:46.192824+0000","last_became_active":"2024-05-30T06:53:45.198496+0000","last_became_peered":"2024-05-30T06:53:45.198496+0000","last_unstale":"2024-05-30T06:53:46.192824+0000","last_undegraded":"2024-05-30T06:53:46.192824+0000","last_fullsized":"2024-05-30T06:53:46.192824+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:19:48.656142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.205025+0000","last_change":"2024-05-30T06:53:45.203371+0000","last_active":"2024-05-30T06:53:46.205025+0000","last_peered":"2024-05-30T06:53:46.205025+0000","last_clean":"2024-05-30T06:53:46.205025+0000","last_became_active":"2024-05-30T06:53:45.202893+0000","last_became_peered":"2024-05-30T06:53:45.202893+0000","last_unstale":"2024-05-30T06:53:46.205025+0000","last_undegraded":"2024-05-30T06:53:46.205025+0000","last_fullsized":"2024-05-30T06:53:46.205025+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:48.071424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168972+0000","last_change":"2024-05-30T06:53:44.168972+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168972+0000","last_undegraded":"2024-05-30T06:53:44.168972+0000","last_fullsized":"2024-05-30T06:53:44.168972+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.173361+0000","last_change":"2024-05-30T06:53:44.173361+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.173361+0000","last_undegraded":"2024-05-30T06:53:44.173361+0000","last_fullsized":"2024-05-30T06:53:44.173361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.170782+0000","last_change":"2024-05-30T06:53:44.170782+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.170782+0000","last_undegraded":"2024-05-30T06:53:44.170782+0000","last_fullsized":"2024-05-30T06:53:44.170782+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168334+0000","last_change":"2024-05-30T06:53:44.168334+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168334+0000","last_undegraded":"2024-05-30T06:53:44.168334+0000","last_fullsized":"2024-05-30T06:53:44.168334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185484+0000","last_change":"2024-05-30T06:53:44.182937+0000","last_active":"2024-05-30T06:53:44.185484+0000","last_peered":"2024-05-30T06:53:44.185484+0000","last_clean":"2024-05-30T06:53:44.185484+0000","last_became_active":"2024-05-30T06:53:44.182611+0000","last_became_peered":"2024-05-30T06:53:44.182611+0000","last_unstale":"2024-05-30T06:53:44.185484+0000","last_undegraded":"2024-05-30T06:53:44.185484+0000","last_fullsized":"2024-05-30T06:53:44.185484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:49:16.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.170159+0000","last_change":"2024-05-30T06:53:44.170159+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.170159+0000","last_undegraded":"2024-05-30T06:53:44.170159+0000","last_fullsized":"2024-05-30T06:53:44.170159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.163516+0000","last_change":"2024-05-30T06:53:43.163516+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.163516+0000","last_undegraded":"2024-05-30T06:53:43.163516+0000","last_fullsized":"2024-05-30T06:53:43.163516+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.169094+0000","last_change":"2024-05-30T06:53:44.169094+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.169094+0000","last_undegraded":"2024-05-30T06:53:44.169094+0000","last_fullsized":"2024-05-30T06:53:44.169094+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204932+0000","last_change":"2024-05-30T06:53:44.180212+0000","last_active":"2024-05-30T06:53:46.204932+0000","last_peered":"2024-05-30T06:53:46.204932+0000","last_clean":"2024-05-30T06:53:46.204932+0000","last_became_active":"2024-05-30T06:53:44.179929+0000","last_became_peered":"2024-05-30T06:53:44.179929+0000","last_unstale":"2024-05-30T06:53:46.204932+0000","last_undegraded":"2024-05-30T06:53:46.204932+0000","last_fullsized":"2024-05-30T06:53:46.204932+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:11:30.173203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172092+0000","last_change":"2024-05-30T06:53:44.172092+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172092+0000","last_undegraded":"2024-05-30T06:53:44.172092+0000","last_fullsized":"2024-05-30T06:53:44.172092+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204772+0000","last_change":"2024-05-30T06:53:44.180631+0000","last_active":"2024-05-30T06:53:46.204772+0000","last_peered":"2024-05-30T06:53:46.204772+0000","last_clean":"2024-05-30T06:53:46.204772+0000","last_became_active":"2024-05-30T06:53:44.180328+0000","last_became_peered":"2024-05-30T06:53:44.180328+0000","last_unstale":"2024-05-30T06:53:46.204772+0000","last_undegraded":"2024-05-30T06:53:46.204772+0000","last_fullsized":"2024-05-30T06:53:46.204772+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:43.524704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.165240+0000","last_change":"2024-05-30T06:53:43.165240+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.165240+0000","last_undegraded":"2024-05-30T06:53:43.165240+0000","last_fullsized":"2024-05-30T06:53:43.165240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.164620+0000","last_change":"2024-05-30T06:53:43.164620+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.164620+0000","last_undegraded":"2024-05-30T06:53:43.164620+0000","last_fullsized":"2024-05-30T06:53:43.164620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172355+0000","last_change":"2024-05-30T06:53:44.172355+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172355+0000","last_undegraded":"2024-05-30T06:53:44.172355+0000","last_fullsized":"2024-05-30T06:53:44.172355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204593+0000","last_change":"2024-05-30T06:53:44.183688+0000","last_active":"2024-05-30T06:53:46.204593+0000","last_peered":"2024-05-30T06:53:46.204593+0000","last_clean":"2024-05-30T06:53:46.204593+0000","last_became_active":"2024-05-30T06:53:44.183409+0000","last_became_peered":"2024-05-30T06:53:44.183409+0000","last_unstale":"2024-05-30T06:53:46.204593+0000","last_undegraded":"2024-05-30T06:53:46.204593+0000","last_fullsized":"2024-05-30T06:53:46.204593+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:42:06.579962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192838+0000","last_change":"2024-05-30T06:53:45.198210+0000","last_active":"2024-05-30T06:53:46.192838+0000","last_peered":"2024-05-30T06:53:46.192838+0000","last_clean":"2024-05-30T06:53:46.192838+0000","last_became_active":"2024-05-30T06:53:45.197947+0000","last_became_peered":"2024-05-30T06:53:45.197947+0000","last_unstale":"2024-05-30T06:53:46.192838+0000","last_undegraded":"2024-05-30T06:53:46.192838+0000","last_fullsized":"2024-05-30T06:53:46.192838+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:31.917254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.162028+0000","last_change":"2024-05-30T06:53:43.162028+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.162028+0000","last_undegraded":"2024-05-30T06:53:43.162028+0000","last_fullsized":"2024-05-30T06:53:43.162028+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.193239+0000","last_change":"2024-05-30T06:53:45.192238+0000","last_active":"2024-05-30T06:53:46.193239+0000","last_peered":"2024-05-30T06:53:46.193239+0000","last_clean":"2024-05-30T06:53:46.193239+0000","last_became_active":"2024-05-30T06:53:45.191951+0000","last_became_peered":"2024-05-30T06:53:45.191951+0000","last_unstale":"2024-05-30T06:53:46.193239+0000","last_undegraded":"2024-05-30T06:53:46.193239+0000","last_fullsized":"2024-05-30T06:53:46.193239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:54.540262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185463+0000","last_change":"2024-05-30T06:53:44.178845+0000","last_active":"2024-05-30T06:53:44.185463+0000","last_peered":"2024-05-30T06:53:44.185463+0000","last_clean":"2024-05-30T06:53:44.185463+0000","last_became_active":"2024-05-30T06:53:44.178561+0000","last_became_peered":"2024-05-30T06:53:44.178561+0000","last_unstale":"2024-05-30T06:53:44.185463+0000","last_undegraded":"2024-05-30T06:53:44.185463+0000","last_fullsized":"2024-05-30T06:53:44.185463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:00:39.723750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.191433+0000","last_change":"2024-05-30T06:53:44.187386+0000","last_active":"2024-05-30T06:53:44.191433+0000","last_peered":"2024-05-30T06:53:44.191433+0000","last_clean":"2024-05-30T06:53:44.191433+0000","last_became_active":"2024-05-30T06:53:44.187038+0000","last_became_peered":"2024-05-30T06:53:44.187038+0000","last_unstale":"2024-05-30T06:53:44.191433+0000","last_undegraded":"2024-05-30T06:53:44.191433+0000","last_fullsized":"2024-05-30T06:53:44.191433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:28:13.793714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204881+0000","last_change":"2024-05-30T06:53:45.201568+0000","last_active":"2024-05-30T06:53:46.204881+0000","last_peered":"2024-05-30T06:53:46.204881+0000","last_clean":"2024-05-30T06:53:46.204881+0000","last_became_active":"2024-05-30T06:53:45.201291+0000","last_became_peered":"2024-05-30T06:53:45.201291+0000","last_unstale":"2024-05-30T06:53:46.204881+0000","last_undegraded":"2024-05-30T06:53:46.204881+0000","last_fullsized":"2024-05-30T06:53:46.204881+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:27:56.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.189498+0000","last_change":"2024-05-30T06:53:44.186134+0000","last_active":"2024-05-30T06:53:44.189498+0000","last_peered":"2024-05-30T06:53:44.189498+0000","last_clean":"2024-05-30T06:53:44.189498+0000","last_became_active":"2024-05-30T06:53:44.185863+0000","last_became_peered":"2024-05-30T06:53:44.185863+0000","last_unstale":"2024-05-30T06:53:44.189498+0000","last_undegraded":"2024-05-30T06:53:44.189498+0000","last_fullsized":"2024-05-30T06:53:44.189498+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:04:30.643407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.165312+0000","last_change":"2024-05-30T06:53:43.165312+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.165312+0000","last_undegraded":"2024-05-30T06:53:43.165312+0000","last_fullsized":"2024-05-30T06:53:43.165312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204610+0000","last_change":"2024-05-30T06:53:45.205031+0000","last_active":"2024-05-30T06:53:46.204610+0000","last_peered":"2024-05-30T06:53:46.204610+0000","last_clean":"2024-05-30T06:53:46.204610+0000","last_became_active":"2024-05-30T06:53:45.203028+0000","last_became_peered":"2024-05-30T06:53:45.203028+0000","last_unstale":"2024-05-30T06:53:46.204610+0000","last_undegraded":"2024-05-30T06:53:46.204610+0000","last_fullsized":"2024-05-30T06:53:46.204610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:00:25.498984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.161425+0000","last_change":"2024-05-30T06:53:43.161425+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.161425+0000","last_undegraded":"2024-05-30T06:53:43.161425+0000","last_fullsized":"2024-05-30T06:53:43.161425+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.171784+0000","last_change":"2024-05-30T06:53:44.171784+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.171784+0000","last_undegraded":"2024-05-30T06:53:44.171784+0000","last_fullsized":"2024-05-30T06:53:44.171784+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192837+0000","last_change":"2024-05-30T06:53:44.187226+0000","last_active":"2024-05-30T06:53:46.192837+0000","last_peered":"2024-05-30T06:53:46.192837+0000","last_clean":"2024-05-30T06:53:46.192837+0000","last_became_active":"2024-05-30T06:53:44.182670+0000","last_became_peered":"2024-05-30T06:53:44.182670+0000","last_unstale":"2024-05-30T06:53:46.192837+0000","last_undegraded":"2024-05-30T06:53:46.192837+0000","last_fullsized":"2024-05-30T06:53:46.192837+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:33:13.413258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.164418+0000","last_change":"2024-05-30T06:53:43.164418+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.164418+0000","last_undegraded":"2024-05-30T06:53:43.164418+0000","last_fullsized":"2024-05-30T06:53:43.164418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204488+0000","last_change":"2024-05-30T06:53:44.185405+0000","last_active":"2024-05-30T06:53:46.204488+0000","last_peered":"2024-05-30T06:53:46.204488+0000","last_clean":"2024-05-30T06:53:46.204488+0000","last_became_active":"2024-05-30T06:53:44.185131+0000","last_became_peered":"2024-05-30T06:53:44.185131+0000","last_unstale":"2024-05-30T06:53:46.204488+0000","last_undegraded":"2024-05-30T06:53:46.204488+0000","last_fullsized":"2024-05-30T06:53:46.204488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:41:25.174084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172914+0000","last_change":"2024-05-30T06:53:44.172914+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172914+0000","last_undegraded":"2024-05-30T06:53:44.172914+0000","last_fullsized":"2024-05-30T06:53:44.172914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.191748+0000","last_change":"2024-05-30T06:53:44.190185+0000","last_active":"2024-05-30T06:53:44.191748+0000","last_peered":"2024-05-30T06:53:44.191748+0000","last_clean":"2024-05-30T06:53:44.191748+0000","last_became_active":"2024-05-30T06:53:44.189820+0000","last_became_peered":"2024-05-30T06:53:44.189820+0000","last_unstale":"2024-05-30T06:53:44.191748+0000","last_undegraded":"2024-05-30T06:53:44.191748+0000","last_fullsized":"2024-05-30T06:53:44.191748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:28:43.250137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.169703+0000","last_change":"2024-05-30T06:53:44.169703+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.169703+0000","last_undegraded":"2024-05-30T06:53:44.169703+0000","last_fullsized":"2024-05-30T06:53:44.169703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204948+0000","last_change":"2024-05-30T06:53:44.186669+0000","last_active":"2024-05-30T06:53:46.204948+0000","last_peered":"2024-05-30T06:53:46.204948+0000","last_clean":"2024-05-30T06:53:46.204948+0000","last_became_active":"2024-05-30T06:53:44.186320+0000","last_became_peered":"2024-05-30T06:53:44.186320+0000","last_unstale":"2024-05-30T06:53:46.204948+0000","last_undegraded":"2024-05-30T06:53:46.204948+0000","last_fullsized":"2024-05-30T06:53:46.204948+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:16:37.222002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204913+0000","last_change":"2024-05-30T06:53:44.186972+0000","last_active":"2024-05-30T06:53:46.204913+0000","last_peered":"2024-05-30T06:53:46.204913+0000","last_clean":"2024-05-30T06:53:46.204913+0000","last_became_active":"2024-05-30T06:53:44.186707+0000","last_became_peered":"2024-05-30T06:53:44.186707+0000","last_unstale":"2024-05-30T06:53:46.204913+0000","last_undegraded":"2024-05-30T06:53:46.204913+0000","last_fullsized":"2024-05-30T06:53:46.204913+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:43.623167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192951+0000","last_change":"2024-05-30T06:53:44.176262+0000","last_active":"2024-05-30T06:53:46.192951+0000","last_peered":"2024-05-30T06:53:46.192951+0000","last_clean":"2024-05-30T06:53:46.192951+0000","last_became_active":"2024-05-30T06:53:44.175893+0000","last_became_peered":"2024-05-30T06:53:44.175893+0000","last_unstale":"2024-05-30T06:53:46.192951+0000","last_undegraded":"2024-05-30T06:53:46.192951+0000","last_fullsized":"2024-05-30T06:53:46.192951+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:52.690379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.167273+0000","last_change":"2024-05-30T06:53:43.167273+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.167273+0000","last_undegraded":"2024-05-30T06:53:43.167273+0000","last_fullsized":"2024-05-30T06:53:43.167273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.166771+0000","last_change":"2024-05-30T06:53:43.166771+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.166771+0000","last_undegraded":"2024-05-30T06:53:43.166771+0000","last_fullsized":"2024-05-30T06:53:43.166771+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192684+0000","last_change":"2024-05-30T06:53:44.168334+0000","last_active":"2024-05-30T06:53:46.192684+0000","last_peered":"2024-05-30T06:53:46.192684+0000","last_clean":"2024-05-30T06:53:46.192684+0000","last_became_active":"2024-05-30T06:53:44.168056+0000","last_became_peered":"2024-05-30T06:53:44.168056+0000","last_unstale":"2024-05-30T06:53:46.192684+0000","last_undegraded":"2024-05-30T06:53:46.192684+0000","last_fullsized":"2024-05-30T06:53:46.192684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:33:36.114248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.161408+0000","last_change":"2024-05-30T06:53:43.161408+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.161408+0000","last_undegraded":"2024-05-30T06:53:43.161408+0000","last_fullsized":"2024-05-30T06:53:43.161408+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172873+0000","last_change":"2024-05-30T06:53:44.172873+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172873+0000","last_undegraded":"2024-05-30T06:53:44.172873+0000","last_fullsized":"2024-05-30T06:53:44.172873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.161648+0000","last_change":"2024-05-30T06:53:43.161648+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.161648+0000","last_undegraded":"2024-05-30T06:53:43.161648+0000","last_fullsized":"2024-05-30T06:53:43.161648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168354+0000","last_change":"2024-05-30T06:53:44.168354+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168354+0000","last_undegraded":"2024-05-30T06:53:44.168354+0000","last_fullsized":"2024-05-30T06:53:44.168354+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.183553+0000","last_change":"2024-05-30T06:53:44.177960+0000","last_active":"2024-05-30T06:53:44.183553+0000","last_peered":"2024-05-30T06:53:44.183553+0000","last_clean":"2024-05-30T06:53:44.183553+0000","last_became_active":"2024-05-30T06:53:44.177390+0000","last_became_peered":"2024-05-30T06:53:44.177390+0000","last_unstale":"2024-05-30T06:53:44.183553+0000","last_undegraded":"2024-05-30T06:53:44.183553+0000","last_fullsized":"2024-05-30T06:53:44.183553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:51:00.599943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185759+0000","last_change":"2024-05-30T06:53:44.183971+0000","last_active":"2024-05-30T06:53:44.185759+0000","last_peered":"2024-05-30T06:53:44.185759+0000","last_clean":"2024-05-30T06:53:44.185759+0000","last_became_active":"2024-05-30T06:53:44.180960+0000","last_became_peered":"2024-05-30T06:53:44.180960+0000","last_unstale":"2024-05-30T06:53:44.185759+0000","last_undegraded":"2024-05-30T06:53:44.185759+0000","last_fullsized":"2024-05-30T06:53:44.185759+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:01:32.576119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204792+0000","last_change":"2024-05-30T06:53:44.183606+0000","last_active":"2024-05-30T06:53:46.204792+0000","last_peered":"2024-05-30T06:53:46.204792+0000","last_clean":"2024-05-30T06:53:46.204792+0000","last_became_active":"2024-05-30T06:53:44.183319+0000","last_became_peered":"2024-05-30T06:53:44.183319+0000","last_unstale":"2024-05-30T06:53:46.204792+0000","last_undegraded":"2024-05-30T06:53:46.204792+0000","last_fullsized":"2024-05-30T06:53:46.204792+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:52:12.665818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204884+0000","last_change":"2024-05-30T06:53:45.203178+0000","last_active":"2024-05-30T06:53:46.204884+0000","last_peered":"2024-05-30T06:53:46.204884+0000","last_clean":"2024-05-30T06:53:46.204884+0000","last_became_active":"2024-05-30T06:53:45.202780+0000","last_became_peered":"2024-05-30T06:53:45.202780+0000","last_unstale":"2024-05-30T06:53:46.204884+0000","last_undegraded":"2024-05-30T06:53:46.204884+0000","last_fullsized":"2024-05-30T06:53:46.204884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:24.340830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.163557+0000","last_change":"2024-05-30T06:53:43.163557+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.163557+0000","last_undegraded":"2024-05-30T06:53:43.163557+0000","last_fullsized":"2024-05-30T06:53:43.163557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.171709+0000","last_change":"2024-05-30T06:53:44.171709+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.171709+0000","last_undegraded":"2024-05-30T06:53:44.171709+0000","last_fullsized":"2024-05-30T06:53:44.171709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185359+0000","last_change":"2024-05-30T06:53:44.179060+0000","last_active":"2024-05-30T06:53:44.185359+0000","last_peered":"2024-05-30T06:53:44.185359+0000","last_clean":"2024-05-30T06:53:44.185359+0000","last_became_active":"2024-05-30T06:53:44.178777+0000","last_became_peered":"2024-05-30T06:53:44.178777+0000","last_unstale":"2024-05-30T06:53:44.185359+0000","last_undegraded":"2024-05-30T06:53:44.185359+0000","last_fullsized":"2024-05-30T06:53:44.185359+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:06:19.143736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168310+0000","last_change":"2024-05-30T06:53:44.168310+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168310+0000","last_undegraded":"2024-05-30T06:53:44.168310+0000","last_fullsized":"2024-05-30T06:53:44.168310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.163585+0000","last_change":"2024-05-30T06:53:43.163585+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.163585+0000","last_undegraded":"2024-05-30T06:53:43.163585+0000","last_fullsized":"2024-05-30T06:53:43.163585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.190906+0000","last_change":"2024-05-30T06:53:44.188978+0000","last_active":"2024-05-30T06:53:44.190906+0000","last_peered":"2024-05-30T06:53:44.190906+0000","last_clean":"2024-05-30T06:53:44.190906+0000","last_became_active":"2024-05-30T06:53:44.188093+0000","last_became_peered":"2024-05-30T06:53:44.188093+0000","last_unstale":"2024-05-30T06:53:44.190906+0000","last_undegraded":"2024-05-30T06:53:44.190906+0000","last_fullsized":"2024-05-30T06:53:44.190906+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:28:06.478699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":296,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.176377+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:53:44.176377+0000","last_peered":"2024-05-30T06:53:44.176377+0000","last_clean":"2024-05-30T06:53:44.176377+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:53:44.176377+0000","last_undegraded":"2024-05-30T06:53:44.176377+0000","last_fullsized":"2024-05-30T06:53:44.176377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":4},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100748,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271092,"statfs":{"total":96636764160,"available":96533598208,"internally_reserved":0,"allocated":1638400,"data_stored":1038721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101513674},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118220,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253620,"statfs":{"total":96636764160,"available":96515706880,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72392,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299448,"statfs":{"total":96636764160,"available":96562634752,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76564,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295276,"statfs":{"total":96636764160,"available":96558362624,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140480,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231360,"statfs":{"total":96636764160,"available":96492912640,"internally_reserved":0,"allocated":1093632,"data_stored":469399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":142735815},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100164,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271676,"statfs":{"total":96636764160,"available":96534196224,"internally_reserved":0,"allocated":1032192,"data_stored":442508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82120,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94289720,"statfs":{"total":96636764160,"available":96552673280,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73020,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298820,"statfs":{"total":96636764160,"available":96561991680,"internally_reserved":0,"allocated":1679360,"data_stored":1058189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:53:49.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:53:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8cae00640 1 Processor -- start 2024-05-30T06:53:49.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8cae00640 1 -- start start 2024-05-30T06:53:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8cae00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c40afbf0 0x7fa8c406e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8cae00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa8c415ec60 0x7fa8c415f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8cae00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c40affd0 con 0x7fa8c415f600 2024-05-30T06:53:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8cae00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa8c406fb40 con 0x7fa8c415ec60 2024-05-30T06:53:49.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8cae00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c406f6b0 con 0x7fa8c40afbf0 2024-05-30T06:53:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c40afbf0 0x7fa8c406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8bbe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa8c415ec60 0x7fa8c415f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c40afbf0 0x7fa8c406e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:32854/0 (socket says 172.21.15.37:32854) 2024-05-30T06:53:49.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8c8e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa8c415f600 0x7fa8c415ab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:44348/0 (socket says 172.21.15.37:44348) 2024-05-30T06:53:49.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8c3e00640 1 -- 172.21.15.37:0/1344160729 learned_addr learned my addr 172.21.15.37:0/1344160729 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:49.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8c3e00640 1 -- 172.21.15.37:0/1344160729 >> v2:172.21.15.105:3300/0 conn(0x7fa8c415ec60 msgr2=0x7fa8c415f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:49.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8c3e00640 1 --2- 172.21.15.37:0/1344160729 >> v2:172.21.15.105:3300/0 conn(0x7fa8c415ec60 0x7fa8c415f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8c3e00640 1 -- 172.21.15.37:0/1344160729 >> v1:172.21.15.105:6789/0 conn(0x7fa8c415f600 legacy=0x7fa8c415ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8c3e00640 1 -- 172.21.15.37:0/1344160729 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c40cd170 con 0x7fa8c40afbf0 2024-05-30T06:53:49.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.498+0000 7fa8bbe00640 1 --2- 172.21.15.37:0/1344160729 >> v2:172.21.15.105:3300/0 conn(0x7fa8c415ec60 0x7fa8c415f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:49.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.502+0000 7fa8c3e00640 1 --2- 172.21.15.37:0/1344160729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c40afbf0 0x7fa8c406e000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009870 tx=0x7fa8b401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82aa99dd920f241a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:49.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.502+0000 7fa8c3400640 1 -- 172.21.15.37:0/1344160729 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40ab650 con 0x7fa8c40afbf0 2024-05-30T06:53:49.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.502+0000 7fa8c3400640 1 -- 172.21.15.37:0/1344160729 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b40b0070 con 0x7fa8c40afbf0 2024-05-30T06:53:49.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.502+0000 7fa8c3400640 1 -- 172.21.15.37:0/1344160729 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40aba10 con 0x7fa8c40afbf0 2024-05-30T06:53:49.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.502+0000 7fa8cae00640 1 -- 172.21.15.37:0/1344160729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c40afbf0 msgr2=0x7fa8c406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.502+0000 7fa8cae00640 1 --2- 172.21.15.37:0/1344160729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c40afbf0 0x7fa8c406e000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa8b4009870 tx=0x7fa8b401c560 comp rx=0 tx=0).stop 2024-05-30T06:53:49.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.502+0000 7fa8cae00640 1 -- 172.21.15.37:0/1344160729 shutdown_connections 2024-05-30T06:53:49.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.502+0000 7fa8cae00640 1 --2- 172.21.15.37:0/1344160729 >> v2:172.21.15.105:3300/0 conn(0x7fa8c415ec60 0x7fa8c415f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.502+0000 7fa8cae00640 1 --2- 172.21.15.37:0/1344160729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c40afbf0 0x7fa8c406e000 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.502+0000 7fa8cae00640 1 -- 172.21.15.37:0/1344160729 >> 172.21.15.37:0/1344160729 conn(0x7fa8c40b23a0 msgr2=0x7fa8c40b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:49.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.502+0000 7fa8cae00640 1 -- 172.21.15.37:0/1344160729 shutdown_connections 2024-05-30T06:53:49.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.502+0000 7fa8cae00640 1 -- 172.21.15.37:0/1344160729 wait complete. 2024-05-30T06:53:49.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8cae00640 1 Processor -- start 2024-05-30T06:53:49.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8cae00640 1 -- start start 2024-05-30T06:53:49.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8cae00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c40afbf0 0x7fa8c4156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8cae00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c415ec60 0x7fa8c41584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8cae00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c415f600 0x7fa8c414d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8cae00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c40cd730 con 0x7fa8c40afbf0 2024-05-30T06:53:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8cae00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c40cfe70 con 0x7fa8c415ec60 2024-05-30T06:53:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8cae00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c40cd8b0 con 0x7fa8c415f600 2024-05-30T06:53:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c40afbf0 0x7fa8c4156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8c3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c40afbf0 0x7fa8c4156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56774/0 (socket says 172.21.15.37:56774) 2024-05-30T06:53:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8c3e00640 1 -- 172.21.15.37:0/2543316017 learned_addr learned my addr 172.21.15.37:0/2543316017 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8bbe00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c415ec60 0x7fa8c41584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8c8e00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c415f600 0x7fa8c414d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8c3e00640 1 -- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c415f600 msgr2=0x7fa8c414d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8c3e00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c415f600 0x7fa8c414d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8c3e00640 1 -- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c415ec60 msgr2=0x7fa8c41584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8c3e00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c415ec60 0x7fa8c41584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8c3e00640 1 -- 172.21.15.37:0/2543316017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c415e110 con 0x7fa8c40afbf0 2024-05-30T06:53:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8c3e00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c40afbf0 0x7fa8c4156bf0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40ad040 tx=0x7fa8b401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8c0c00640 1 -- 172.21.15.37:0/2543316017 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40be5f0 con 0x7fa8c40afbf0 2024-05-30T06:53:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8c0c00640 1 -- 172.21.15.37:0/2543316017 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b40be7b0 con 0x7fa8c40afbf0 2024-05-30T06:53:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8cae00640 1 -- 172.21.15.37:0/2543316017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c4155130 con 0x7fa8c40afbf0 2024-05-30T06:53:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8c0c00640 1 -- 172.21.15.37:0/2543316017 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40beba0 con 0x7fa8c40afbf0 2024-05-30T06:53:49.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.506+0000 7fa8cae00640 1 -- 172.21.15.37:0/2543316017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c415e690 con 0x7fa8c40afbf0 2024-05-30T06:53:49.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.510+0000 7fa8cae00640 1 -- 172.21.15.37:0/2543316017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c4068b20 con 0x7fa8c40afbf0 2024-05-30T06:53:49.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.510+0000 7fa8c0c00640 1 -- 172.21.15.37:0/2543316017 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fa8b40b43f0 con 0x7fa8c40afbf0 2024-05-30T06:53:49.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.510+0000 7fa8c0c00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8a00695b0 0x7fa8a006ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.510+0000 7fa8c0c00640 1 -- 172.21.15.37:0/2543316017 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5737+0+0 (secure 0 0 0) 0x7fa8b41203a0 con 0x7fa8c40afbf0 2024-05-30T06:53:49.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.510+0000 7fa8bbe00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8a00695b0 0x7fa8a006ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.514+0000 7fa8bbe00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8a00695b0 0x7fa8a006ba70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009580 tx=0x7fa8ac009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.514+0000 7fa8c0c00640 1 -- 172.21.15.37:0/2543316017 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa8b40c4060 con 0x7fa8c40afbf0 2024-05-30T06:53:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.674+0000 7fa8cae00640 1 -- 172.21.15.37:0/2543316017 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa8c4072fb0 con 0x7fa8a00695b0 2024-05-30T06:53:49.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.682+0000 7fa8c0c00640 1 -- 172.21.15.37:0/2543316017 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244158 (secure 0 0 0) 0x7fa8c4072fb0 con 0x7fa8a00695b0 2024-05-30T06:53:49.686 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:49.688 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:53:49.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.686+0000 7fa8cae00640 1 -- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8a00695b0 msgr2=0x7fa8a006ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.686+0000 7fa8cae00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8a00695b0 0x7fa8a006ba70 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009580 tx=0x7fa8ac009190 comp rx=0 tx=0).stop 2024-05-30T06:53:49.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.686+0000 7fa8cae00640 1 -- 172.21.15.37:0/2543316017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c40afbf0 msgr2=0x7fa8c4156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.686+0000 7fa8cae00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c40afbf0 0x7fa8c4156bf0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40ad040 tx=0x7fa8b401ada0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.686+0000 7fa8cae00640 1 -- 172.21.15.37:0/2543316017 shutdown_connections 2024-05-30T06:53:49.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.686+0000 7fa8cae00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8c415f600 0x7fa8c414d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.686+0000 7fa8cae00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8a00695b0 0x7fa8a006ba70 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.686+0000 7fa8cae00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8c415ec60 0x7fa8c41584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.686+0000 7fa8cae00640 1 --2- 172.21.15.37:0/2543316017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8c40afbf0 0x7fa8c4156bf0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.686+0000 7fa8cae00640 1 -- 172.21.15.37:0/2543316017 >> 172.21.15.37:0/2543316017 conn(0x7fa8c40b23a0 msgr2=0x7fa8c406e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.686+0000 7fa8cae00640 1 -- 172.21.15.37:0/2543316017 shutdown_connections 2024-05-30T06:53:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.686+0000 7fa8cae00640 1 -- 172.21.15.37:0/2543316017 wait complete. 2024-05-30T06:53:49.708 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":436,"stamp":"2024-05-30T06:53:48.913390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":120,"acting":120,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":763708,"kb_used_data":9396,"kb_used_omap":12,"kb_used_meta":754163,"kb_avail":754211012,"statfs":{"total":773094113280,"available":772312076288,"internally_reserved":0,"allocated":9621504,"data_stored":4802229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":772263472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.751546"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.170664+0000","last_change":"2024-05-30T06:53:44.170664+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.170664+0000","last_undegraded":"2024-05-30T06:53:44.170664+0000","last_fullsized":"2024-05-30T06:53:44.170664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.173379+0000","last_change":"2024-05-30T06:53:44.173379+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.173379+0000","last_undegraded":"2024-05-30T06:53:44.173379+0000","last_fullsized":"2024-05-30T06:53:44.173379+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168986+0000","last_change":"2024-05-30T06:53:44.168986+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168986+0000","last_undegraded":"2024-05-30T06:53:44.168986+0000","last_fullsized":"2024-05-30T06:53:44.168986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.171231+0000","last_change":"2024-05-30T06:53:44.171231+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.171231+0000","last_undegraded":"2024-05-30T06:53:44.171231+0000","last_fullsized":"2024-05-30T06:53:44.171231+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172323+0000","last_change":"2024-05-30T06:53:44.172323+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172323+0000","last_undegraded":"2024-05-30T06:53:44.172323+0000","last_fullsized":"2024-05-30T06:53:44.172323+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192824+0000","last_change":"2024-05-30T06:53:45.198790+0000","last_active":"2024-05-30T06:53:46.192824+0000","last_peered":"2024-05-30T06:53:46.192824+0000","last_clean":"2024-05-30T06:53:46.192824+0000","last_became_active":"2024-05-30T06:53:45.198496+0000","last_became_peered":"2024-05-30T06:53:45.198496+0000","last_unstale":"2024-05-30T06:53:46.192824+0000","last_undegraded":"2024-05-30T06:53:46.192824+0000","last_fullsized":"2024-05-30T06:53:46.192824+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:19:48.656142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.205025+0000","last_change":"2024-05-30T06:53:45.203371+0000","last_active":"2024-05-30T06:53:46.205025+0000","last_peered":"2024-05-30T06:53:46.205025+0000","last_clean":"2024-05-30T06:53:46.205025+0000","last_became_active":"2024-05-30T06:53:45.202893+0000","last_became_peered":"2024-05-30T06:53:45.202893+0000","last_unstale":"2024-05-30T06:53:46.205025+0000","last_undegraded":"2024-05-30T06:53:46.205025+0000","last_fullsized":"2024-05-30T06:53:46.205025+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:48.071424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168972+0000","last_change":"2024-05-30T06:53:44.168972+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168972+0000","last_undegraded":"2024-05-30T06:53:44.168972+0000","last_fullsized":"2024-05-30T06:53:44.168972+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.173361+0000","last_change":"2024-05-30T06:53:44.173361+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.173361+0000","last_undegraded":"2024-05-30T06:53:44.173361+0000","last_fullsized":"2024-05-30T06:53:44.173361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.170782+0000","last_change":"2024-05-30T06:53:44.170782+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.170782+0000","last_undegraded":"2024-05-30T06:53:44.170782+0000","last_fullsized":"2024-05-30T06:53:44.170782+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168334+0000","last_change":"2024-05-30T06:53:44.168334+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168334+0000","last_undegraded":"2024-05-30T06:53:44.168334+0000","last_fullsized":"2024-05-30T06:53:44.168334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185484+0000","last_change":"2024-05-30T06:53:44.182937+0000","last_active":"2024-05-30T06:53:44.185484+0000","last_peered":"2024-05-30T06:53:44.185484+0000","last_clean":"2024-05-30T06:53:44.185484+0000","last_became_active":"2024-05-30T06:53:44.182611+0000","last_became_peered":"2024-05-30T06:53:44.182611+0000","last_unstale":"2024-05-30T06:53:44.185484+0000","last_undegraded":"2024-05-30T06:53:44.185484+0000","last_fullsized":"2024-05-30T06:53:44.185484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:49:16.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.170159+0000","last_change":"2024-05-30T06:53:44.170159+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.170159+0000","last_undegraded":"2024-05-30T06:53:44.170159+0000","last_fullsized":"2024-05-30T06:53:44.170159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.163516+0000","last_change":"2024-05-30T06:53:43.163516+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.163516+0000","last_undegraded":"2024-05-30T06:53:43.163516+0000","last_fullsized":"2024-05-30T06:53:43.163516+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.169094+0000","last_change":"2024-05-30T06:53:44.169094+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.169094+0000","last_undegraded":"2024-05-30T06:53:44.169094+0000","last_fullsized":"2024-05-30T06:53:44.169094+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204932+0000","last_change":"2024-05-30T06:53:44.180212+0000","last_active":"2024-05-30T06:53:46.204932+0000","last_peered":"2024-05-30T06:53:46.204932+0000","last_clean":"2024-05-30T06:53:46.204932+0000","last_became_active":"2024-05-30T06:53:44.179929+0000","last_became_peered":"2024-05-30T06:53:44.179929+0000","last_unstale":"2024-05-30T06:53:46.204932+0000","last_undegraded":"2024-05-30T06:53:46.204932+0000","last_fullsized":"2024-05-30T06:53:46.204932+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:11:30.173203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172092+0000","last_change":"2024-05-30T06:53:44.172092+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172092+0000","last_undegraded":"2024-05-30T06:53:44.172092+0000","last_fullsized":"2024-05-30T06:53:44.172092+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204772+0000","last_change":"2024-05-30T06:53:44.180631+0000","last_active":"2024-05-30T06:53:46.204772+0000","last_peered":"2024-05-30T06:53:46.204772+0000","last_clean":"2024-05-30T06:53:46.204772+0000","last_became_active":"2024-05-30T06:53:44.180328+0000","last_became_peered":"2024-05-30T06:53:44.180328+0000","last_unstale":"2024-05-30T06:53:46.204772+0000","last_undegraded":"2024-05-30T06:53:46.204772+0000","last_fullsized":"2024-05-30T06:53:46.204772+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:43.524704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.165240+0000","last_change":"2024-05-30T06:53:43.165240+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.165240+0000","last_undegraded":"2024-05-30T06:53:43.165240+0000","last_fullsized":"2024-05-30T06:53:43.165240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.164620+0000","last_change":"2024-05-30T06:53:43.164620+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.164620+0000","last_undegraded":"2024-05-30T06:53:43.164620+0000","last_fullsized":"2024-05-30T06:53:43.164620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172355+0000","last_change":"2024-05-30T06:53:44.172355+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172355+0000","last_undegraded":"2024-05-30T06:53:44.172355+0000","last_fullsized":"2024-05-30T06:53:44.172355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204593+0000","last_change":"2024-05-30T06:53:44.183688+0000","last_active":"2024-05-30T06:53:46.204593+0000","last_peered":"2024-05-30T06:53:46.204593+0000","last_clean":"2024-05-30T06:53:46.204593+0000","last_became_active":"2024-05-30T06:53:44.183409+0000","last_became_peered":"2024-05-30T06:53:44.183409+0000","last_unstale":"2024-05-30T06:53:46.204593+0000","last_undegraded":"2024-05-30T06:53:46.204593+0000","last_fullsized":"2024-05-30T06:53:46.204593+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:42:06.579962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192838+0000","last_change":"2024-05-30T06:53:45.198210+0000","last_active":"2024-05-30T06:53:46.192838+0000","last_peered":"2024-05-30T06:53:46.192838+0000","last_clean":"2024-05-30T06:53:46.192838+0000","last_became_active":"2024-05-30T06:53:45.197947+0000","last_became_peered":"2024-05-30T06:53:45.197947+0000","last_unstale":"2024-05-30T06:53:46.192838+0000","last_undegraded":"2024-05-30T06:53:46.192838+0000","last_fullsized":"2024-05-30T06:53:46.192838+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:31.917254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.162028+0000","last_change":"2024-05-30T06:53:43.162028+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.162028+0000","last_undegraded":"2024-05-30T06:53:43.162028+0000","last_fullsized":"2024-05-30T06:53:43.162028+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.193239+0000","last_change":"2024-05-30T06:53:45.192238+0000","last_active":"2024-05-30T06:53:46.193239+0000","last_peered":"2024-05-30T06:53:46.193239+0000","last_clean":"2024-05-30T06:53:46.193239+0000","last_became_active":"2024-05-30T06:53:45.191951+0000","last_became_peered":"2024-05-30T06:53:45.191951+0000","last_unstale":"2024-05-30T06:53:46.193239+0000","last_undegraded":"2024-05-30T06:53:46.193239+0000","last_fullsized":"2024-05-30T06:53:46.193239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:54.540262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185463+0000","last_change":"2024-05-30T06:53:44.178845+0000","last_active":"2024-05-30T06:53:44.185463+0000","last_peered":"2024-05-30T06:53:44.185463+0000","last_clean":"2024-05-30T06:53:44.185463+0000","last_became_active":"2024-05-30T06:53:44.178561+0000","last_became_peered":"2024-05-30T06:53:44.178561+0000","last_unstale":"2024-05-30T06:53:44.185463+0000","last_undegraded":"2024-05-30T06:53:44.185463+0000","last_fullsized":"2024-05-30T06:53:44.185463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:00:39.723750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.191433+0000","last_change":"2024-05-30T06:53:44.187386+0000","last_active":"2024-05-30T06:53:44.191433+0000","last_peered":"2024-05-30T06:53:44.191433+0000","last_clean":"2024-05-30T06:53:44.191433+0000","last_became_active":"2024-05-30T06:53:44.187038+0000","last_became_peered":"2024-05-30T06:53:44.187038+0000","last_unstale":"2024-05-30T06:53:44.191433+0000","last_undegraded":"2024-05-30T06:53:44.191433+0000","last_fullsized":"2024-05-30T06:53:44.191433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:28:13.793714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204881+0000","last_change":"2024-05-30T06:53:45.201568+0000","last_active":"2024-05-30T06:53:46.204881+0000","last_peered":"2024-05-30T06:53:46.204881+0000","last_clean":"2024-05-30T06:53:46.204881+0000","last_became_active":"2024-05-30T06:53:45.201291+0000","last_became_peered":"2024-05-30T06:53:45.201291+0000","last_unstale":"2024-05-30T06:53:46.204881+0000","last_undegraded":"2024-05-30T06:53:46.204881+0000","last_fullsized":"2024-05-30T06:53:46.204881+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:27:56.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.189498+0000","last_change":"2024-05-30T06:53:44.186134+0000","last_active":"2024-05-30T06:53:44.189498+0000","last_peered":"2024-05-30T06:53:44.189498+0000","last_clean":"2024-05-30T06:53:44.189498+0000","last_became_active":"2024-05-30T06:53:44.185863+0000","last_became_peered":"2024-05-30T06:53:44.185863+0000","last_unstale":"2024-05-30T06:53:44.189498+0000","last_undegraded":"2024-05-30T06:53:44.189498+0000","last_fullsized":"2024-05-30T06:53:44.189498+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:04:30.643407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.165312+0000","last_change":"2024-05-30T06:53:43.165312+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.165312+0000","last_undegraded":"2024-05-30T06:53:43.165312+0000","last_fullsized":"2024-05-30T06:53:43.165312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204610+0000","last_change":"2024-05-30T06:53:45.205031+0000","last_active":"2024-05-30T06:53:46.204610+0000","last_peered":"2024-05-30T06:53:46.204610+0000","last_clean":"2024-05-30T06:53:46.204610+0000","last_became_active":"2024-05-30T06:53:45.203028+0000","last_became_peered":"2024-05-30T06:53:45.203028+0000","last_unstale":"2024-05-30T06:53:46.204610+0000","last_undegraded":"2024-05-30T06:53:46.204610+0000","last_fullsized":"2024-05-30T06:53:46.204610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:00:25.498984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.161425+0000","last_change":"2024-05-30T06:53:43.161425+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.161425+0000","last_undegraded":"2024-05-30T06:53:43.161425+0000","last_fullsized":"2024-05-30T06:53:43.161425+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.171784+0000","last_change":"2024-05-30T06:53:44.171784+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.171784+0000","last_undegraded":"2024-05-30T06:53:44.171784+0000","last_fullsized":"2024-05-30T06:53:44.171784+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192837+0000","last_change":"2024-05-30T06:53:44.187226+0000","last_active":"2024-05-30T06:53:46.192837+0000","last_peered":"2024-05-30T06:53:46.192837+0000","last_clean":"2024-05-30T06:53:46.192837+0000","last_became_active":"2024-05-30T06:53:44.182670+0000","last_became_peered":"2024-05-30T06:53:44.182670+0000","last_unstale":"2024-05-30T06:53:46.192837+0000","last_undegraded":"2024-05-30T06:53:46.192837+0000","last_fullsized":"2024-05-30T06:53:46.192837+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:33:13.413258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.164418+0000","last_change":"2024-05-30T06:53:43.164418+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.164418+0000","last_undegraded":"2024-05-30T06:53:43.164418+0000","last_fullsized":"2024-05-30T06:53:43.164418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204488+0000","last_change":"2024-05-30T06:53:44.185405+0000","last_active":"2024-05-30T06:53:46.204488+0000","last_peered":"2024-05-30T06:53:46.204488+0000","last_clean":"2024-05-30T06:53:46.204488+0000","last_became_active":"2024-05-30T06:53:44.185131+0000","last_became_peered":"2024-05-30T06:53:44.185131+0000","last_unstale":"2024-05-30T06:53:46.204488+0000","last_undegraded":"2024-05-30T06:53:46.204488+0000","last_fullsized":"2024-05-30T06:53:46.204488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:41:25.174084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172914+0000","last_change":"2024-05-30T06:53:44.172914+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172914+0000","last_undegraded":"2024-05-30T06:53:44.172914+0000","last_fullsized":"2024-05-30T06:53:44.172914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.191748+0000","last_change":"2024-05-30T06:53:44.190185+0000","last_active":"2024-05-30T06:53:44.191748+0000","last_peered":"2024-05-30T06:53:44.191748+0000","last_clean":"2024-05-30T06:53:44.191748+0000","last_became_active":"2024-05-30T06:53:44.189820+0000","last_became_peered":"2024-05-30T06:53:44.189820+0000","last_unstale":"2024-05-30T06:53:44.191748+0000","last_undegraded":"2024-05-30T06:53:44.191748+0000","last_fullsized":"2024-05-30T06:53:44.191748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:28:43.250137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.169703+0000","last_change":"2024-05-30T06:53:44.169703+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.169703+0000","last_undegraded":"2024-05-30T06:53:44.169703+0000","last_fullsized":"2024-05-30T06:53:44.169703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204948+0000","last_change":"2024-05-30T06:53:44.186669+0000","last_active":"2024-05-30T06:53:46.204948+0000","last_peered":"2024-05-30T06:53:46.204948+0000","last_clean":"2024-05-30T06:53:46.204948+0000","last_became_active":"2024-05-30T06:53:44.186320+0000","last_became_peered":"2024-05-30T06:53:44.186320+0000","last_unstale":"2024-05-30T06:53:46.204948+0000","last_undegraded":"2024-05-30T06:53:46.204948+0000","last_fullsized":"2024-05-30T06:53:46.204948+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:16:37.222002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204913+0000","last_change":"2024-05-30T06:53:44.186972+0000","last_active":"2024-05-30T06:53:46.204913+0000","last_peered":"2024-05-30T06:53:46.204913+0000","last_clean":"2024-05-30T06:53:46.204913+0000","last_became_active":"2024-05-30T06:53:44.186707+0000","last_became_peered":"2024-05-30T06:53:44.186707+0000","last_unstale":"2024-05-30T06:53:46.204913+0000","last_undegraded":"2024-05-30T06:53:46.204913+0000","last_fullsized":"2024-05-30T06:53:46.204913+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:43.623167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192951+0000","last_change":"2024-05-30T06:53:44.176262+0000","last_active":"2024-05-30T06:53:46.192951+0000","last_peered":"2024-05-30T06:53:46.192951+0000","last_clean":"2024-05-30T06:53:46.192951+0000","last_became_active":"2024-05-30T06:53:44.175893+0000","last_became_peered":"2024-05-30T06:53:44.175893+0000","last_unstale":"2024-05-30T06:53:46.192951+0000","last_undegraded":"2024-05-30T06:53:46.192951+0000","last_fullsized":"2024-05-30T06:53:46.192951+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:52.690379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.167273+0000","last_change":"2024-05-30T06:53:43.167273+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.167273+0000","last_undegraded":"2024-05-30T06:53:43.167273+0000","last_fullsized":"2024-05-30T06:53:43.167273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.166771+0000","last_change":"2024-05-30T06:53:43.166771+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.166771+0000","last_undegraded":"2024-05-30T06:53:43.166771+0000","last_fullsized":"2024-05-30T06:53:43.166771+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192684+0000","last_change":"2024-05-30T06:53:44.168334+0000","last_active":"2024-05-30T06:53:46.192684+0000","last_peered":"2024-05-30T06:53:46.192684+0000","last_clean":"2024-05-30T06:53:46.192684+0000","last_became_active":"2024-05-30T06:53:44.168056+0000","last_became_peered":"2024-05-30T06:53:44.168056+0000","last_unstale":"2024-05-30T06:53:46.192684+0000","last_undegraded":"2024-05-30T06:53:46.192684+0000","last_fullsized":"2024-05-30T06:53:46.192684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:33:36.114248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.161408+0000","last_change":"2024-05-30T06:53:43.161408+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.161408+0000","last_undegraded":"2024-05-30T06:53:43.161408+0000","last_fullsized":"2024-05-30T06:53:43.161408+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172873+0000","last_change":"2024-05-30T06:53:44.172873+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172873+0000","last_undegraded":"2024-05-30T06:53:44.172873+0000","last_fullsized":"2024-05-30T06:53:44.172873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.161648+0000","last_change":"2024-05-30T06:53:43.161648+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.161648+0000","last_undegraded":"2024-05-30T06:53:43.161648+0000","last_fullsized":"2024-05-30T06:53:43.161648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168354+0000","last_change":"2024-05-30T06:53:44.168354+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168354+0000","last_undegraded":"2024-05-30T06:53:44.168354+0000","last_fullsized":"2024-05-30T06:53:44.168354+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.183553+0000","last_change":"2024-05-30T06:53:44.177960+0000","last_active":"2024-05-30T06:53:44.183553+0000","last_peered":"2024-05-30T06:53:44.183553+0000","last_clean":"2024-05-30T06:53:44.183553+0000","last_became_active":"2024-05-30T06:53:44.177390+0000","last_became_peered":"2024-05-30T06:53:44.177390+0000","last_unstale":"2024-05-30T06:53:44.183553+0000","last_undegraded":"2024-05-30T06:53:44.183553+0000","last_fullsized":"2024-05-30T06:53:44.183553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:51:00.599943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185759+0000","last_change":"2024-05-30T06:53:44.183971+0000","last_active":"2024-05-30T06:53:44.185759+0000","last_peered":"2024-05-30T06:53:44.185759+0000","last_clean":"2024-05-30T06:53:44.185759+0000","last_became_active":"2024-05-30T06:53:44.180960+0000","last_became_peered":"2024-05-30T06:53:44.180960+0000","last_unstale":"2024-05-30T06:53:44.185759+0000","last_undegraded":"2024-05-30T06:53:44.185759+0000","last_fullsized":"2024-05-30T06:53:44.185759+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:01:32.576119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204792+0000","last_change":"2024-05-30T06:53:44.183606+0000","last_active":"2024-05-30T06:53:46.204792+0000","last_peered":"2024-05-30T06:53:46.204792+0000","last_clean":"2024-05-30T06:53:46.204792+0000","last_became_active":"2024-05-30T06:53:44.183319+0000","last_became_peered":"2024-05-30T06:53:44.183319+0000","last_unstale":"2024-05-30T06:53:46.204792+0000","last_undegraded":"2024-05-30T06:53:46.204792+0000","last_fullsized":"2024-05-30T06:53:46.204792+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:52:12.665818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204884+0000","last_change":"2024-05-30T06:53:45.203178+0000","last_active":"2024-05-30T06:53:46.204884+0000","last_peered":"2024-05-30T06:53:46.204884+0000","last_clean":"2024-05-30T06:53:46.204884+0000","last_became_active":"2024-05-30T06:53:45.202780+0000","last_became_peered":"2024-05-30T06:53:45.202780+0000","last_unstale":"2024-05-30T06:53:46.204884+0000","last_undegraded":"2024-05-30T06:53:46.204884+0000","last_fullsized":"2024-05-30T06:53:46.204884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:24.340830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.163557+0000","last_change":"2024-05-30T06:53:43.163557+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.163557+0000","last_undegraded":"2024-05-30T06:53:43.163557+0000","last_fullsized":"2024-05-30T06:53:43.163557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.171709+0000","last_change":"2024-05-30T06:53:44.171709+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.171709+0000","last_undegraded":"2024-05-30T06:53:44.171709+0000","last_fullsized":"2024-05-30T06:53:44.171709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185359+0000","last_change":"2024-05-30T06:53:44.179060+0000","last_active":"2024-05-30T06:53:44.185359+0000","last_peered":"2024-05-30T06:53:44.185359+0000","last_clean":"2024-05-30T06:53:44.185359+0000","last_became_active":"2024-05-30T06:53:44.178777+0000","last_became_peered":"2024-05-30T06:53:44.178777+0000","last_unstale":"2024-05-30T06:53:44.185359+0000","last_undegraded":"2024-05-30T06:53:44.185359+0000","last_fullsized":"2024-05-30T06:53:44.185359+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:06:19.143736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168310+0000","last_change":"2024-05-30T06:53:44.168310+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168310+0000","last_undegraded":"2024-05-30T06:53:44.168310+0000","last_fullsized":"2024-05-30T06:53:44.168310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.163585+0000","last_change":"2024-05-30T06:53:43.163585+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.163585+0000","last_undegraded":"2024-05-30T06:53:43.163585+0000","last_fullsized":"2024-05-30T06:53:43.163585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.190906+0000","last_change":"2024-05-30T06:53:44.188978+0000","last_active":"2024-05-30T06:53:44.190906+0000","last_peered":"2024-05-30T06:53:44.190906+0000","last_clean":"2024-05-30T06:53:44.190906+0000","last_became_active":"2024-05-30T06:53:44.188093+0000","last_became_peered":"2024-05-30T06:53:44.188093+0000","last_unstale":"2024-05-30T06:53:44.190906+0000","last_undegraded":"2024-05-30T06:53:44.190906+0000","last_fullsized":"2024-05-30T06:53:44.190906+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:28:06.478699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":296,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.176377+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:53:44.176377+0000","last_peered":"2024-05-30T06:53:44.176377+0000","last_clean":"2024-05-30T06:53:44.176377+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:53:44.176377+0000","last_undegraded":"2024-05-30T06:53:44.176377+0000","last_fullsized":"2024-05-30T06:53:44.176377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":4},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100748,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271092,"statfs":{"total":96636764160,"available":96533598208,"internally_reserved":0,"allocated":1638400,"data_stored":1038721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101513674},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118220,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253620,"statfs":{"total":96636764160,"available":96515706880,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72392,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299448,"statfs":{"total":96636764160,"available":96562634752,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76564,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295276,"statfs":{"total":96636764160,"available":96558362624,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140480,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231360,"statfs":{"total":96636764160,"available":96492912640,"internally_reserved":0,"allocated":1093632,"data_stored":469399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":142735815},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100164,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271676,"statfs":{"total":96636764160,"available":96534196224,"internally_reserved":0,"allocated":1032192,"data_stored":442508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82120,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94289720,"statfs":{"total":96636764160,"available":96552673280,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73020,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298820,"statfs":{"total":96636764160,"available":96561991680,"internally_reserved":0,"allocated":1679360,"data_stored":1058189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:53:49.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:53:49.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.890+0000 7fc47e400640 1 Processor -- start 2024-05-30T06:53:49.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.890+0000 7fc47e400640 1 -- start start 2024-05-30T06:53:49.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.894+0000 7fc47e400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc478155e60 0x7fc4780b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.894+0000 7fc47e400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc47815c8f0 con 0x7fc47806f9a0 2024-05-30T06:53:49.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.894+0000 7fc47e400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4780ccc80 con 0x7fc4780b2ec0 2024-05-30T06:53:49.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.894+0000 7fc47e400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc4780ccff0 con 0x7fc478155e60 2024-05-30T06:53:49.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.894+0000 7fc477400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc478155e60 0x7fc4780b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.894+0000 7fc46fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc47806f9a0 0x7fc4780cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53460/0 (socket says 172.21.15.37:53460) 2024-05-30T06:53:49.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.894+0000 7fc46fe00640 1 -- 172.21.15.37:0/1275987681 learned_addr learned my addr 172.21.15.37:0/1275987681 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:49.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.894+0000 7fc477400640 1 -- 172.21.15.37:0/1275987681 >> v1:172.21.15.105:6789/0 conn(0x7fc4780b2ec0 legacy=0x7fc4780cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:49.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.894+0000 7fc477400640 1 -- 172.21.15.37:0/1275987681 >> v1:172.21.15.37:6789/0 conn(0x7fc47806f9a0 legacy=0x7fc4780cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.894+0000 7fc476a00640 1 -- 172.21.15.37:0/1275987681 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 572971000 0 0) 0x7fc47815c8f0 con 0x7fc47806f9a0 2024-05-30T06:53:49.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.894+0000 7fc477400640 1 -- 172.21.15.37:0/1275987681 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47815cbd0 con 0x7fc478155e60 2024-05-30T06:53:49.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.898+0000 7fc477400640 1 --2- 172.21.15.37:0/1275987681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc478155e60 0x7fc4780b36a0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fc4680097c0 tx=0x7fc46801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836490e5f139a528 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:49.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.898+0000 7fc476a00640 1 -- 172.21.15.37:0/1275987681 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4680b0070 con 0x7fc478155e60 2024-05-30T06:53:49.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.898+0000 7fc476a00640 1 -- 172.21.15.37:0/1275987681 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4680ab600 con 0x7fc478155e60 2024-05-30T06:53:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.898+0000 7fc476a00640 1 -- 172.21.15.37:0/1275987681 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4680ab9d0 con 0x7fc478155e60 2024-05-30T06:53:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.898+0000 7fc47e400640 1 -- 172.21.15.37:0/1275987681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc478155e60 msgr2=0x7fc4780b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.898+0000 7fc47e400640 1 --2- 172.21.15.37:0/1275987681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc478155e60 0x7fc4780b36a0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fc4680097c0 tx=0x7fc46801c4a0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.898+0000 7fc47e400640 1 -- 172.21.15.37:0/1275987681 shutdown_connections 2024-05-30T06:53:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.898+0000 7fc47e400640 1 --2- 172.21.15.37:0/1275987681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc478155e60 0x7fc4780b36a0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.898+0000 7fc47e400640 1 -- 172.21.15.37:0/1275987681 >> 172.21.15.37:0/1275987681 conn(0x7fc4780b23a0 msgr2=0x7fc4780b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.898+0000 7fc47e400640 1 -- 172.21.15.37:0/1275987681 shutdown_connections 2024-05-30T06:53:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.898+0000 7fc47e400640 1 -- 172.21.15.37:0/1275987681 wait complete. 2024-05-30T06:53:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.898+0000 7fc47e400640 1 Processor -- start 2024-05-30T06:53:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.898+0000 7fc47e400640 1 -- start start 2024-05-30T06:53:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc47e400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc47806f9a0 0x7fc4781f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc47e400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b2ec0 0x7fc478145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc47e400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc478155e60 0x7fc478148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc47e400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc478169a00 con 0x7fc4780b2ec0 2024-05-30T06:53:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc47e400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc478169880 con 0x7fc47806f9a0 2024-05-30T06:53:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc47e400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc478169b80 con 0x7fc478155e60 2024-05-30T06:53:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc46fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b2ec0 0x7fc478145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc46fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b2ec0 0x7fc478145cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56784/0 (socket says 172.21.15.37:56784) 2024-05-30T06:53:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc46fe00640 1 -- 172.21.15.37:0/87771237 learned_addr learned my addr 172.21.15.37:0/87771237 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc477400640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc47806f9a0 0x7fc4781f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc477e00640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc478155e60 0x7fc478148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc46fe00640 1 -- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc478155e60 msgr2=0x7fc478148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc46fe00640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc478155e60 0x7fc478148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc46fe00640 1 -- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc47806f9a0 msgr2=0x7fc4781f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc46fe00640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc47806f9a0 0x7fc4781f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc46fe00640 1 -- 172.21.15.37:0/87771237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc478146210 con 0x7fc4780b2ec0 2024-05-30T06:53:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc46fe00640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b2ec0 0x7fc478145cd0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fc46000c4d0 tx=0x7fc46000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc46f400640 1 -- 172.21.15.37:0/87771237 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460018070 con 0x7fc4780b2ec0 2024-05-30T06:53:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc46f400640 1 -- 172.21.15.37:0/87771237 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4600074e0 con 0x7fc4780b2ec0 2024-05-30T06:53:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc46f400640 1 -- 172.21.15.37:0/87771237 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc460004a30 con 0x7fc4780b2ec0 2024-05-30T06:53:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc47e400640 1 -- 172.21.15.37:0/87771237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4781f5450 con 0x7fc4780b2ec0 2024-05-30T06:53:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc47e400640 1 -- 172.21.15.37:0/87771237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc47815b600 con 0x7fc4780b2ec0 2024-05-30T06:53:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc47e400640 1 -- 172.21.15.37:0/87771237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc478068b20 con 0x7fc4780b2ec0 2024-05-30T06:53:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.902+0000 7fc46f400640 1 -- 172.21.15.37:0/87771237 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fc460004bd0 con 0x7fc4780b2ec0 2024-05-30T06:53:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.906+0000 7fc46f400640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc454069580 0x7fc45406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.906+0000 7fc46f400640 1 -- 172.21.15.37:0/87771237 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5737+0+0 (secure 0 0 0) 0x7fc460084ae0 con 0x7fc4780b2ec0 2024-05-30T06:53:49.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.906+0000 7fc477400640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc454069580 0x7fc45406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:49.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.906+0000 7fc477400640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc454069580 0x7fc45406ba40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc4680ad000 tx=0x7fc4680a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:49.910+0000 7fc46f400640 1 -- 172.21.15.37:0/87771237 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc460056130 con 0x7fc4780b2ec0 2024-05-30T06:53:50.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.070+0000 7fc47e400640 1 -- 172.21.15.37:0/87771237 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc47815b0d0 con 0x7fc454069580 2024-05-30T06:53:50.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.074+0000 7fc46f400640 1 -- 172.21.15.37:0/87771237 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244158 (secure 0 0 0) 0x7fc47815b0d0 con 0x7fc454069580 2024-05-30T06:53:50.079 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:50.080 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:53:50.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.078+0000 7fc47e400640 1 -- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc454069580 msgr2=0x7fc45406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.078+0000 7fc47e400640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc454069580 0x7fc45406ba40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc4680ad000 tx=0x7fc4680a6000 comp rx=0 tx=0).stop 2024-05-30T06:53:50.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.078+0000 7fc47e400640 1 -- 172.21.15.37:0/87771237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b2ec0 msgr2=0x7fc478145cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.078+0000 7fc47e400640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b2ec0 0x7fc478145cd0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fc46000c4d0 tx=0x7fc46000c990 comp rx=0 tx=0).stop 2024-05-30T06:53:50.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.078+0000 7fc47e400640 1 -- 172.21.15.37:0/87771237 shutdown_connections 2024-05-30T06:53:50.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.078+0000 7fc47e400640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc478155e60 0x7fc478148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.078+0000 7fc47e400640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b2ec0 0x7fc478145cd0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.078+0000 7fc47e400640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc454069580 0x7fc45406ba40 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.078+0000 7fc47e400640 1 --2- 172.21.15.37:0/87771237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc47806f9a0 0x7fc4781f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.078+0000 7fc47e400640 1 -- 172.21.15.37:0/87771237 >> 172.21.15.37:0/87771237 conn(0x7fc4780b23a0 msgr2=0x7fc4780b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.082+0000 7fc47e400640 1 -- 172.21.15.37:0/87771237 shutdown_connections 2024-05-30T06:53:50.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.082+0000 7fc47e400640 1 -- 172.21.15.37:0/87771237 wait complete. 2024-05-30T06:53:50.100 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":436,"stamp":"2024-05-30T06:53:48.913390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":120,"acting":120,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":763708,"kb_used_data":9396,"kb_used_omap":12,"kb_used_meta":754163,"kb_avail":754211012,"statfs":{"total":773094113280,"available":772312076288,"internally_reserved":0,"allocated":9621504,"data_stored":4802229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":772263472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.751546"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.170664+0000","last_change":"2024-05-30T06:53:44.170664+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.170664+0000","last_undegraded":"2024-05-30T06:53:44.170664+0000","last_fullsized":"2024-05-30T06:53:44.170664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.173379+0000","last_change":"2024-05-30T06:53:44.173379+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.173379+0000","last_undegraded":"2024-05-30T06:53:44.173379+0000","last_fullsized":"2024-05-30T06:53:44.173379+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168986+0000","last_change":"2024-05-30T06:53:44.168986+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168986+0000","last_undegraded":"2024-05-30T06:53:44.168986+0000","last_fullsized":"2024-05-30T06:53:44.168986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.171231+0000","last_change":"2024-05-30T06:53:44.171231+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.171231+0000","last_undegraded":"2024-05-30T06:53:44.171231+0000","last_fullsized":"2024-05-30T06:53:44.171231+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172323+0000","last_change":"2024-05-30T06:53:44.172323+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172323+0000","last_undegraded":"2024-05-30T06:53:44.172323+0000","last_fullsized":"2024-05-30T06:53:44.172323+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192824+0000","last_change":"2024-05-30T06:53:45.198790+0000","last_active":"2024-05-30T06:53:46.192824+0000","last_peered":"2024-05-30T06:53:46.192824+0000","last_clean":"2024-05-30T06:53:46.192824+0000","last_became_active":"2024-05-30T06:53:45.198496+0000","last_became_peered":"2024-05-30T06:53:45.198496+0000","last_unstale":"2024-05-30T06:53:46.192824+0000","last_undegraded":"2024-05-30T06:53:46.192824+0000","last_fullsized":"2024-05-30T06:53:46.192824+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:19:48.656142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.205025+0000","last_change":"2024-05-30T06:53:45.203371+0000","last_active":"2024-05-30T06:53:46.205025+0000","last_peered":"2024-05-30T06:53:46.205025+0000","last_clean":"2024-05-30T06:53:46.205025+0000","last_became_active":"2024-05-30T06:53:45.202893+0000","last_became_peered":"2024-05-30T06:53:45.202893+0000","last_unstale":"2024-05-30T06:53:46.205025+0000","last_undegraded":"2024-05-30T06:53:46.205025+0000","last_fullsized":"2024-05-30T06:53:46.205025+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:48.071424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168972+0000","last_change":"2024-05-30T06:53:44.168972+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168972+0000","last_undegraded":"2024-05-30T06:53:44.168972+0000","last_fullsized":"2024-05-30T06:53:44.168972+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.173361+0000","last_change":"2024-05-30T06:53:44.173361+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.173361+0000","last_undegraded":"2024-05-30T06:53:44.173361+0000","last_fullsized":"2024-05-30T06:53:44.173361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.170782+0000","last_change":"2024-05-30T06:53:44.170782+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.170782+0000","last_undegraded":"2024-05-30T06:53:44.170782+0000","last_fullsized":"2024-05-30T06:53:44.170782+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168334+0000","last_change":"2024-05-30T06:53:44.168334+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168334+0000","last_undegraded":"2024-05-30T06:53:44.168334+0000","last_fullsized":"2024-05-30T06:53:44.168334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185484+0000","last_change":"2024-05-30T06:53:44.182937+0000","last_active":"2024-05-30T06:53:44.185484+0000","last_peered":"2024-05-30T06:53:44.185484+0000","last_clean":"2024-05-30T06:53:44.185484+0000","last_became_active":"2024-05-30T06:53:44.182611+0000","last_became_peered":"2024-05-30T06:53:44.182611+0000","last_unstale":"2024-05-30T06:53:44.185484+0000","last_undegraded":"2024-05-30T06:53:44.185484+0000","last_fullsized":"2024-05-30T06:53:44.185484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:49:16.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.170159+0000","last_change":"2024-05-30T06:53:44.170159+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.170159+0000","last_undegraded":"2024-05-30T06:53:44.170159+0000","last_fullsized":"2024-05-30T06:53:44.170159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.163516+0000","last_change":"2024-05-30T06:53:43.163516+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.163516+0000","last_undegraded":"2024-05-30T06:53:43.163516+0000","last_fullsized":"2024-05-30T06:53:43.163516+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.169094+0000","last_change":"2024-05-30T06:53:44.169094+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.169094+0000","last_undegraded":"2024-05-30T06:53:44.169094+0000","last_fullsized":"2024-05-30T06:53:44.169094+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204932+0000","last_change":"2024-05-30T06:53:44.180212+0000","last_active":"2024-05-30T06:53:46.204932+0000","last_peered":"2024-05-30T06:53:46.204932+0000","last_clean":"2024-05-30T06:53:46.204932+0000","last_became_active":"2024-05-30T06:53:44.179929+0000","last_became_peered":"2024-05-30T06:53:44.179929+0000","last_unstale":"2024-05-30T06:53:46.204932+0000","last_undegraded":"2024-05-30T06:53:46.204932+0000","last_fullsized":"2024-05-30T06:53:46.204932+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:11:30.173203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172092+0000","last_change":"2024-05-30T06:53:44.172092+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172092+0000","last_undegraded":"2024-05-30T06:53:44.172092+0000","last_fullsized":"2024-05-30T06:53:44.172092+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204772+0000","last_change":"2024-05-30T06:53:44.180631+0000","last_active":"2024-05-30T06:53:46.204772+0000","last_peered":"2024-05-30T06:53:46.204772+0000","last_clean":"2024-05-30T06:53:46.204772+0000","last_became_active":"2024-05-30T06:53:44.180328+0000","last_became_peered":"2024-05-30T06:53:44.180328+0000","last_unstale":"2024-05-30T06:53:46.204772+0000","last_undegraded":"2024-05-30T06:53:46.204772+0000","last_fullsized":"2024-05-30T06:53:46.204772+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:43.524704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.165240+0000","last_change":"2024-05-30T06:53:43.165240+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.165240+0000","last_undegraded":"2024-05-30T06:53:43.165240+0000","last_fullsized":"2024-05-30T06:53:43.165240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.164620+0000","last_change":"2024-05-30T06:53:43.164620+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.164620+0000","last_undegraded":"2024-05-30T06:53:43.164620+0000","last_fullsized":"2024-05-30T06:53:43.164620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172355+0000","last_change":"2024-05-30T06:53:44.172355+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172355+0000","last_undegraded":"2024-05-30T06:53:44.172355+0000","last_fullsized":"2024-05-30T06:53:44.172355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204593+0000","last_change":"2024-05-30T06:53:44.183688+0000","last_active":"2024-05-30T06:53:46.204593+0000","last_peered":"2024-05-30T06:53:46.204593+0000","last_clean":"2024-05-30T06:53:46.204593+0000","last_became_active":"2024-05-30T06:53:44.183409+0000","last_became_peered":"2024-05-30T06:53:44.183409+0000","last_unstale":"2024-05-30T06:53:46.204593+0000","last_undegraded":"2024-05-30T06:53:46.204593+0000","last_fullsized":"2024-05-30T06:53:46.204593+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:42:06.579962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192838+0000","last_change":"2024-05-30T06:53:45.198210+0000","last_active":"2024-05-30T06:53:46.192838+0000","last_peered":"2024-05-30T06:53:46.192838+0000","last_clean":"2024-05-30T06:53:46.192838+0000","last_became_active":"2024-05-30T06:53:45.197947+0000","last_became_peered":"2024-05-30T06:53:45.197947+0000","last_unstale":"2024-05-30T06:53:46.192838+0000","last_undegraded":"2024-05-30T06:53:46.192838+0000","last_fullsized":"2024-05-30T06:53:46.192838+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:31.917254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.162028+0000","last_change":"2024-05-30T06:53:43.162028+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.162028+0000","last_undegraded":"2024-05-30T06:53:43.162028+0000","last_fullsized":"2024-05-30T06:53:43.162028+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.193239+0000","last_change":"2024-05-30T06:53:45.192238+0000","last_active":"2024-05-30T06:53:46.193239+0000","last_peered":"2024-05-30T06:53:46.193239+0000","last_clean":"2024-05-30T06:53:46.193239+0000","last_became_active":"2024-05-30T06:53:45.191951+0000","last_became_peered":"2024-05-30T06:53:45.191951+0000","last_unstale":"2024-05-30T06:53:46.193239+0000","last_undegraded":"2024-05-30T06:53:46.193239+0000","last_fullsized":"2024-05-30T06:53:46.193239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:54.540262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185463+0000","last_change":"2024-05-30T06:53:44.178845+0000","last_active":"2024-05-30T06:53:44.185463+0000","last_peered":"2024-05-30T06:53:44.185463+0000","last_clean":"2024-05-30T06:53:44.185463+0000","last_became_active":"2024-05-30T06:53:44.178561+0000","last_became_peered":"2024-05-30T06:53:44.178561+0000","last_unstale":"2024-05-30T06:53:44.185463+0000","last_undegraded":"2024-05-30T06:53:44.185463+0000","last_fullsized":"2024-05-30T06:53:44.185463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:00:39.723750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.191433+0000","last_change":"2024-05-30T06:53:44.187386+0000","last_active":"2024-05-30T06:53:44.191433+0000","last_peered":"2024-05-30T06:53:44.191433+0000","last_clean":"2024-05-30T06:53:44.191433+0000","last_became_active":"2024-05-30T06:53:44.187038+0000","last_became_peered":"2024-05-30T06:53:44.187038+0000","last_unstale":"2024-05-30T06:53:44.191433+0000","last_undegraded":"2024-05-30T06:53:44.191433+0000","last_fullsized":"2024-05-30T06:53:44.191433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:28:13.793714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204881+0000","last_change":"2024-05-30T06:53:45.201568+0000","last_active":"2024-05-30T06:53:46.204881+0000","last_peered":"2024-05-30T06:53:46.204881+0000","last_clean":"2024-05-30T06:53:46.204881+0000","last_became_active":"2024-05-30T06:53:45.201291+0000","last_became_peered":"2024-05-30T06:53:45.201291+0000","last_unstale":"2024-05-30T06:53:46.204881+0000","last_undegraded":"2024-05-30T06:53:46.204881+0000","last_fullsized":"2024-05-30T06:53:46.204881+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:27:56.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.189498+0000","last_change":"2024-05-30T06:53:44.186134+0000","last_active":"2024-05-30T06:53:44.189498+0000","last_peered":"2024-05-30T06:53:44.189498+0000","last_clean":"2024-05-30T06:53:44.189498+0000","last_became_active":"2024-05-30T06:53:44.185863+0000","last_became_peered":"2024-05-30T06:53:44.185863+0000","last_unstale":"2024-05-30T06:53:44.189498+0000","last_undegraded":"2024-05-30T06:53:44.189498+0000","last_fullsized":"2024-05-30T06:53:44.189498+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:04:30.643407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.165312+0000","last_change":"2024-05-30T06:53:43.165312+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.165312+0000","last_undegraded":"2024-05-30T06:53:43.165312+0000","last_fullsized":"2024-05-30T06:53:43.165312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204610+0000","last_change":"2024-05-30T06:53:45.205031+0000","last_active":"2024-05-30T06:53:46.204610+0000","last_peered":"2024-05-30T06:53:46.204610+0000","last_clean":"2024-05-30T06:53:46.204610+0000","last_became_active":"2024-05-30T06:53:45.203028+0000","last_became_peered":"2024-05-30T06:53:45.203028+0000","last_unstale":"2024-05-30T06:53:46.204610+0000","last_undegraded":"2024-05-30T06:53:46.204610+0000","last_fullsized":"2024-05-30T06:53:46.204610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:00:25.498984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.161425+0000","last_change":"2024-05-30T06:53:43.161425+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.161425+0000","last_undegraded":"2024-05-30T06:53:43.161425+0000","last_fullsized":"2024-05-30T06:53:43.161425+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.171784+0000","last_change":"2024-05-30T06:53:44.171784+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.171784+0000","last_undegraded":"2024-05-30T06:53:44.171784+0000","last_fullsized":"2024-05-30T06:53:44.171784+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192837+0000","last_change":"2024-05-30T06:53:44.187226+0000","last_active":"2024-05-30T06:53:46.192837+0000","last_peered":"2024-05-30T06:53:46.192837+0000","last_clean":"2024-05-30T06:53:46.192837+0000","last_became_active":"2024-05-30T06:53:44.182670+0000","last_became_peered":"2024-05-30T06:53:44.182670+0000","last_unstale":"2024-05-30T06:53:46.192837+0000","last_undegraded":"2024-05-30T06:53:46.192837+0000","last_fullsized":"2024-05-30T06:53:46.192837+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:33:13.413258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.164418+0000","last_change":"2024-05-30T06:53:43.164418+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.164418+0000","last_undegraded":"2024-05-30T06:53:43.164418+0000","last_fullsized":"2024-05-30T06:53:43.164418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204488+0000","last_change":"2024-05-30T06:53:44.185405+0000","last_active":"2024-05-30T06:53:46.204488+0000","last_peered":"2024-05-30T06:53:46.204488+0000","last_clean":"2024-05-30T06:53:46.204488+0000","last_became_active":"2024-05-30T06:53:44.185131+0000","last_became_peered":"2024-05-30T06:53:44.185131+0000","last_unstale":"2024-05-30T06:53:46.204488+0000","last_undegraded":"2024-05-30T06:53:46.204488+0000","last_fullsized":"2024-05-30T06:53:46.204488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:41:25.174084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172914+0000","last_change":"2024-05-30T06:53:44.172914+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172914+0000","last_undegraded":"2024-05-30T06:53:44.172914+0000","last_fullsized":"2024-05-30T06:53:44.172914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.191748+0000","last_change":"2024-05-30T06:53:44.190185+0000","last_active":"2024-05-30T06:53:44.191748+0000","last_peered":"2024-05-30T06:53:44.191748+0000","last_clean":"2024-05-30T06:53:44.191748+0000","last_became_active":"2024-05-30T06:53:44.189820+0000","last_became_peered":"2024-05-30T06:53:44.189820+0000","last_unstale":"2024-05-30T06:53:44.191748+0000","last_undegraded":"2024-05-30T06:53:44.191748+0000","last_fullsized":"2024-05-30T06:53:44.191748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:28:43.250137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.169703+0000","last_change":"2024-05-30T06:53:44.169703+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.169703+0000","last_undegraded":"2024-05-30T06:53:44.169703+0000","last_fullsized":"2024-05-30T06:53:44.169703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204948+0000","last_change":"2024-05-30T06:53:44.186669+0000","last_active":"2024-05-30T06:53:46.204948+0000","last_peered":"2024-05-30T06:53:46.204948+0000","last_clean":"2024-05-30T06:53:46.204948+0000","last_became_active":"2024-05-30T06:53:44.186320+0000","last_became_peered":"2024-05-30T06:53:44.186320+0000","last_unstale":"2024-05-30T06:53:46.204948+0000","last_undegraded":"2024-05-30T06:53:46.204948+0000","last_fullsized":"2024-05-30T06:53:46.204948+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:16:37.222002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204913+0000","last_change":"2024-05-30T06:53:44.186972+0000","last_active":"2024-05-30T06:53:46.204913+0000","last_peered":"2024-05-30T06:53:46.204913+0000","last_clean":"2024-05-30T06:53:46.204913+0000","last_became_active":"2024-05-30T06:53:44.186707+0000","last_became_peered":"2024-05-30T06:53:44.186707+0000","last_unstale":"2024-05-30T06:53:46.204913+0000","last_undegraded":"2024-05-30T06:53:46.204913+0000","last_fullsized":"2024-05-30T06:53:46.204913+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:43.623167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192951+0000","last_change":"2024-05-30T06:53:44.176262+0000","last_active":"2024-05-30T06:53:46.192951+0000","last_peered":"2024-05-30T06:53:46.192951+0000","last_clean":"2024-05-30T06:53:46.192951+0000","last_became_active":"2024-05-30T06:53:44.175893+0000","last_became_peered":"2024-05-30T06:53:44.175893+0000","last_unstale":"2024-05-30T06:53:46.192951+0000","last_undegraded":"2024-05-30T06:53:46.192951+0000","last_fullsized":"2024-05-30T06:53:46.192951+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:52.690379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.167273+0000","last_change":"2024-05-30T06:53:43.167273+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.167273+0000","last_undegraded":"2024-05-30T06:53:43.167273+0000","last_fullsized":"2024-05-30T06:53:43.167273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.166771+0000","last_change":"2024-05-30T06:53:43.166771+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.166771+0000","last_undegraded":"2024-05-30T06:53:43.166771+0000","last_fullsized":"2024-05-30T06:53:43.166771+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192684+0000","last_change":"2024-05-30T06:53:44.168334+0000","last_active":"2024-05-30T06:53:46.192684+0000","last_peered":"2024-05-30T06:53:46.192684+0000","last_clean":"2024-05-30T06:53:46.192684+0000","last_became_active":"2024-05-30T06:53:44.168056+0000","last_became_peered":"2024-05-30T06:53:44.168056+0000","last_unstale":"2024-05-30T06:53:46.192684+0000","last_undegraded":"2024-05-30T06:53:46.192684+0000","last_fullsized":"2024-05-30T06:53:46.192684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:33:36.114248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.161408+0000","last_change":"2024-05-30T06:53:43.161408+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.161408+0000","last_undegraded":"2024-05-30T06:53:43.161408+0000","last_fullsized":"2024-05-30T06:53:43.161408+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172873+0000","last_change":"2024-05-30T06:53:44.172873+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172873+0000","last_undegraded":"2024-05-30T06:53:44.172873+0000","last_fullsized":"2024-05-30T06:53:44.172873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.161648+0000","last_change":"2024-05-30T06:53:43.161648+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.161648+0000","last_undegraded":"2024-05-30T06:53:43.161648+0000","last_fullsized":"2024-05-30T06:53:43.161648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168354+0000","last_change":"2024-05-30T06:53:44.168354+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168354+0000","last_undegraded":"2024-05-30T06:53:44.168354+0000","last_fullsized":"2024-05-30T06:53:44.168354+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.183553+0000","last_change":"2024-05-30T06:53:44.177960+0000","last_active":"2024-05-30T06:53:44.183553+0000","last_peered":"2024-05-30T06:53:44.183553+0000","last_clean":"2024-05-30T06:53:44.183553+0000","last_became_active":"2024-05-30T06:53:44.177390+0000","last_became_peered":"2024-05-30T06:53:44.177390+0000","last_unstale":"2024-05-30T06:53:44.183553+0000","last_undegraded":"2024-05-30T06:53:44.183553+0000","last_fullsized":"2024-05-30T06:53:44.183553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:51:00.599943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185759+0000","last_change":"2024-05-30T06:53:44.183971+0000","last_active":"2024-05-30T06:53:44.185759+0000","last_peered":"2024-05-30T06:53:44.185759+0000","last_clean":"2024-05-30T06:53:44.185759+0000","last_became_active":"2024-05-30T06:53:44.180960+0000","last_became_peered":"2024-05-30T06:53:44.180960+0000","last_unstale":"2024-05-30T06:53:44.185759+0000","last_undegraded":"2024-05-30T06:53:44.185759+0000","last_fullsized":"2024-05-30T06:53:44.185759+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:01:32.576119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204792+0000","last_change":"2024-05-30T06:53:44.183606+0000","last_active":"2024-05-30T06:53:46.204792+0000","last_peered":"2024-05-30T06:53:46.204792+0000","last_clean":"2024-05-30T06:53:46.204792+0000","last_became_active":"2024-05-30T06:53:44.183319+0000","last_became_peered":"2024-05-30T06:53:44.183319+0000","last_unstale":"2024-05-30T06:53:46.204792+0000","last_undegraded":"2024-05-30T06:53:46.204792+0000","last_fullsized":"2024-05-30T06:53:46.204792+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:52:12.665818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204884+0000","last_change":"2024-05-30T06:53:45.203178+0000","last_active":"2024-05-30T06:53:46.204884+0000","last_peered":"2024-05-30T06:53:46.204884+0000","last_clean":"2024-05-30T06:53:46.204884+0000","last_became_active":"2024-05-30T06:53:45.202780+0000","last_became_peered":"2024-05-30T06:53:45.202780+0000","last_unstale":"2024-05-30T06:53:46.204884+0000","last_undegraded":"2024-05-30T06:53:46.204884+0000","last_fullsized":"2024-05-30T06:53:46.204884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:24.340830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.163557+0000","last_change":"2024-05-30T06:53:43.163557+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.163557+0000","last_undegraded":"2024-05-30T06:53:43.163557+0000","last_fullsized":"2024-05-30T06:53:43.163557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.171709+0000","last_change":"2024-05-30T06:53:44.171709+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.171709+0000","last_undegraded":"2024-05-30T06:53:44.171709+0000","last_fullsized":"2024-05-30T06:53:44.171709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185359+0000","last_change":"2024-05-30T06:53:44.179060+0000","last_active":"2024-05-30T06:53:44.185359+0000","last_peered":"2024-05-30T06:53:44.185359+0000","last_clean":"2024-05-30T06:53:44.185359+0000","last_became_active":"2024-05-30T06:53:44.178777+0000","last_became_peered":"2024-05-30T06:53:44.178777+0000","last_unstale":"2024-05-30T06:53:44.185359+0000","last_undegraded":"2024-05-30T06:53:44.185359+0000","last_fullsized":"2024-05-30T06:53:44.185359+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:06:19.143736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168310+0000","last_change":"2024-05-30T06:53:44.168310+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168310+0000","last_undegraded":"2024-05-30T06:53:44.168310+0000","last_fullsized":"2024-05-30T06:53:44.168310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.163585+0000","last_change":"2024-05-30T06:53:43.163585+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.163585+0000","last_undegraded":"2024-05-30T06:53:43.163585+0000","last_fullsized":"2024-05-30T06:53:43.163585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.190906+0000","last_change":"2024-05-30T06:53:44.188978+0000","last_active":"2024-05-30T06:53:44.190906+0000","last_peered":"2024-05-30T06:53:44.190906+0000","last_clean":"2024-05-30T06:53:44.190906+0000","last_became_active":"2024-05-30T06:53:44.188093+0000","last_became_peered":"2024-05-30T06:53:44.188093+0000","last_unstale":"2024-05-30T06:53:44.190906+0000","last_undegraded":"2024-05-30T06:53:44.190906+0000","last_fullsized":"2024-05-30T06:53:44.190906+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:28:06.478699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":296,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.176377+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:53:44.176377+0000","last_peered":"2024-05-30T06:53:44.176377+0000","last_clean":"2024-05-30T06:53:44.176377+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:53:44.176377+0000","last_undegraded":"2024-05-30T06:53:44.176377+0000","last_fullsized":"2024-05-30T06:53:44.176377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":4},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100748,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271092,"statfs":{"total":96636764160,"available":96533598208,"internally_reserved":0,"allocated":1638400,"data_stored":1038721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101513674},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118220,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253620,"statfs":{"total":96636764160,"available":96515706880,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72392,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299448,"statfs":{"total":96636764160,"available":96562634752,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76564,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295276,"statfs":{"total":96636764160,"available":96558362624,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140480,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231360,"statfs":{"total":96636764160,"available":96492912640,"internally_reserved":0,"allocated":1093632,"data_stored":469399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":142735815},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100164,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271676,"statfs":{"total":96636764160,"available":96534196224,"internally_reserved":0,"allocated":1032192,"data_stored":442508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82120,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94289720,"statfs":{"total":96636764160,"available":96552673280,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73020,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298820,"statfs":{"total":96636764160,"available":96561991680,"internally_reserved":0,"allocated":1679360,"data_stored":1058189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:53:50.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2024-05-30T06:53:50.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.170664+0000', 'last_change': '2024-05-30T06:53:44.170664+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.170664+0000', 'last_undegraded': '2024-05-30T06:53:44.170664+0000', 'last_fullsized': '2024-05-30T06:53:44.170664+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:53:50.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2024-05-30T06:53:50.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2024-05-30T06:53:50.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.173379+0000', 'last_change': '2024-05-30T06:53:44.173379+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.173379+0000', 'last_undegraded': '2024-05-30T06:53:44.173379+0000', 'last_fullsized': '2024-05-30T06:53:44.173379+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:53:50.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2024-05-30T06:53:50.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2024-05-30T06:53:50.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2024-05-30T06:53:50.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2024-05-30T06:53:50.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2024-05-30T06:53:50.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2024-05-30T06:53:50.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2024-05-30T06:53:50.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.168986+0000', 'last_change': '2024-05-30T06:53:44.168986+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.168986+0000', 'last_undegraded': '2024-05-30T06:53:44.168986+0000', 'last_fullsized': '2024-05-30T06:53:44.168986+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:53:50.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2024-05-30T06:53:50.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2024-05-30T06:53:50.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.171231+0000', 'last_change': '2024-05-30T06:53:44.171231+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.171231+0000', 'last_undegraded': '2024-05-30T06:53:44.171231+0000', 'last_fullsized': '2024-05-30T06:53:44.171231+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:53:50.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2024-05-30T06:53:50.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.172323+0000', 'last_change': '2024-05-30T06:53:44.172323+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.172323+0000', 'last_undegraded': '2024-05-30T06:53:44.172323+0000', 'last_fullsized': '2024-05-30T06:53:44.172323+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:53:50.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2024-05-30T06:53:50.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2024-05-30T06:53:50.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2024-05-30T06:53:50.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2024-05-30T06:53:50.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2024-05-30T06:53:50.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2024-05-30T06:53:50.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2024-05-30T06:53:50.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2024-05-30T06:53:50.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.168972+0000', 'last_change': '2024-05-30T06:53:44.168972+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.168972+0000', 'last_undegraded': '2024-05-30T06:53:44.168972+0000', 'last_fullsized': '2024-05-30T06:53:44.168972+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:53:50.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2024-05-30T06:53:50.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2024-05-30T06:53:50.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2024-05-30T06:53:50.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.173361+0000', 'last_change': '2024-05-30T06:53:44.173361+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.173361+0000', 'last_undegraded': '2024-05-30T06:53:44.173361+0000', 'last_fullsized': '2024-05-30T06:53:44.173361+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:53:50.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2024-05-30T06:53:50.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2024-05-30T06:53:50.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.170782+0000', 'last_change': '2024-05-30T06:53:44.170782+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.170782+0000', 'last_undegraded': '2024-05-30T06:53:44.170782+0000', 'last_fullsized': '2024-05-30T06:53:44.170782+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:53:50.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2024-05-30T06:53:50.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2024-05-30T06:53:50.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2024-05-30T06:53:50.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2024-05-30T06:53:50.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.168334+0000', 'last_change': '2024-05-30T06:53:44.168334+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.168334+0000', 'last_undegraded': '2024-05-30T06:53:44.168334+0000', 'last_fullsized': '2024-05-30T06:53:44.168334+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:53:50.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2024-05-30T06:53:50.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2024-05-30T06:53:50.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.170159+0000', 'last_change': '2024-05-30T06:53:44.170159+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.170159+0000', 'last_undegraded': '2024-05-30T06:53:44.170159+0000', 'last_fullsized': '2024-05-30T06:53:44.170159+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:53:50.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2024-05-30T06:53:50.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:43.163516+0000', 'last_change': '2024-05-30T06:53:43.163516+0000', 'last_active': '2024-05-30T06:53:43.151673+0000', 'last_peered': '2024-05-30T06:53:43.151673+0000', 'last_clean': '2024-05-30T06:53:43.151673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:43.163516+0000', 'last_undegraded': '2024-05-30T06:53:43.163516+0000', 'last_fullsized': '2024-05-30T06:53:43.163516+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:53:50.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2024-05-30T06:53:50.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.169094+0000', 'last_change': '2024-05-30T06:53:44.169094+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.169094+0000', 'last_undegraded': '2024-05-30T06:53:44.169094+0000', 'last_fullsized': '2024-05-30T06:53:44.169094+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:53:50.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2024-05-30T06:53:50.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.172092+0000', 'last_change': '2024-05-30T06:53:44.172092+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.172092+0000', 'last_undegraded': '2024-05-30T06:53:44.172092+0000', 'last_fullsized': '2024-05-30T06:53:44.172092+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:53:50.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2024-05-30T06:53:50.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2024-05-30T06:53:50.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:43.165240+0000', 'last_change': '2024-05-30T06:53:43.165240+0000', 'last_active': '2024-05-30T06:53:43.151673+0000', 'last_peered': '2024-05-30T06:53:43.151673+0000', 'last_clean': '2024-05-30T06:53:43.151673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:43.165240+0000', 'last_undegraded': '2024-05-30T06:53:43.165240+0000', 'last_fullsized': '2024-05-30T06:53:43.165240+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:53:50.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2024-05-30T06:53:50.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2024-05-30T06:53:50.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:43.164620+0000', 'last_change': '2024-05-30T06:53:43.164620+0000', 'last_active': '2024-05-30T06:53:43.151673+0000', 'last_peered': '2024-05-30T06:53:43.151673+0000', 'last_clean': '2024-05-30T06:53:43.151673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:43.164620+0000', 'last_undegraded': '2024-05-30T06:53:43.164620+0000', 'last_fullsized': '2024-05-30T06:53:43.164620+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:53:50.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2024-05-30T06:53:50.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.172355+0000', 'last_change': '2024-05-30T06:53:44.172355+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.172355+0000', 'last_undegraded': '2024-05-30T06:53:44.172355+0000', 'last_fullsized': '2024-05-30T06:53:44.172355+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:53:50.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2024-05-30T06:53:50.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:43.162028+0000', 'last_change': '2024-05-30T06:53:43.162028+0000', 'last_active': '2024-05-30T06:53:43.151673+0000', 'last_peered': '2024-05-30T06:53:43.151673+0000', 'last_clean': '2024-05-30T06:53:43.151673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:43.162028+0000', 'last_undegraded': '2024-05-30T06:53:43.162028+0000', 'last_fullsized': '2024-05-30T06:53:43.162028+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:53:50.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2024-05-30T06:53:50.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2024-05-30T06:53:50.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2024-05-30T06:53:50.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:43.165312+0000', 'last_change': '2024-05-30T06:53:43.165312+0000', 'last_active': '2024-05-30T06:53:43.151673+0000', 'last_peered': '2024-05-30T06:53:43.151673+0000', 'last_clean': '2024-05-30T06:53:43.151673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:43.165312+0000', 'last_undegraded': '2024-05-30T06:53:43.165312+0000', 'last_fullsized': '2024-05-30T06:53:43.165312+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:53:50.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2024-05-30T06:53:50.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:43.161425+0000', 'last_change': '2024-05-30T06:53:43.161425+0000', 'last_active': '2024-05-30T06:53:43.151673+0000', 'last_peered': '2024-05-30T06:53:43.151673+0000', 'last_clean': '2024-05-30T06:53:43.151673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:43.161425+0000', 'last_undegraded': '2024-05-30T06:53:43.161425+0000', 'last_fullsized': '2024-05-30T06:53:43.161425+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:53:50.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2024-05-30T06:53:50.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.171784+0000', 'last_change': '2024-05-30T06:53:44.171784+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.171784+0000', 'last_undegraded': '2024-05-30T06:53:44.171784+0000', 'last_fullsized': '2024-05-30T06:53:44.171784+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:53:50.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2024-05-30T06:53:50.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2024-05-30T06:53:50.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:43.164418+0000', 'last_change': '2024-05-30T06:53:43.164418+0000', 'last_active': '2024-05-30T06:53:43.151673+0000', 'last_peered': '2024-05-30T06:53:43.151673+0000', 'last_clean': '2024-05-30T06:53:43.151673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:43.164418+0000', 'last_undegraded': '2024-05-30T06:53:43.164418+0000', 'last_fullsized': '2024-05-30T06:53:43.164418+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:53:50.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2024-05-30T06:53:50.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2024-05-30T06:53:50.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.172914+0000', 'last_change': '2024-05-30T06:53:44.172914+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.172914+0000', 'last_undegraded': '2024-05-30T06:53:44.172914+0000', 'last_fullsized': '2024-05-30T06:53:44.172914+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:53:50.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2024-05-30T06:53:50.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.169703+0000', 'last_change': '2024-05-30T06:53:44.169703+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.169703+0000', 'last_undegraded': '2024-05-30T06:53:44.169703+0000', 'last_fullsized': '2024-05-30T06:53:44.169703+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:53:50.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2024-05-30T06:53:50.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2024-05-30T06:53:50.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2024-05-30T06:53:50.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2024-05-30T06:53:50.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:43.167273+0000', 'last_change': '2024-05-30T06:53:43.167273+0000', 'last_active': '2024-05-30T06:53:43.151673+0000', 'last_peered': '2024-05-30T06:53:43.151673+0000', 'last_clean': '2024-05-30T06:53:43.151673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:43.167273+0000', 'last_undegraded': '2024-05-30T06:53:43.167273+0000', 'last_fullsized': '2024-05-30T06:53:43.167273+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:53:50.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2024-05-30T06:53:50.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2024-05-30T06:53:50.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:43.166771+0000', 'last_change': '2024-05-30T06:53:43.166771+0000', 'last_active': '2024-05-30T06:53:43.151673+0000', 'last_peered': '2024-05-30T06:53:43.151673+0000', 'last_clean': '2024-05-30T06:53:43.151673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:43.166771+0000', 'last_undegraded': '2024-05-30T06:53:43.166771+0000', 'last_fullsized': '2024-05-30T06:53:43.166771+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:53:50.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2024-05-30T06:53:50.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2024-05-30T06:53:50.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2024-05-30T06:53:50.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:43.161408+0000', 'last_change': '2024-05-30T06:53:43.161408+0000', 'last_active': '2024-05-30T06:53:43.151673+0000', 'last_peered': '2024-05-30T06:53:43.151673+0000', 'last_clean': '2024-05-30T06:53:43.151673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:43.161408+0000', 'last_undegraded': '2024-05-30T06:53:43.161408+0000', 'last_fullsized': '2024-05-30T06:53:43.161408+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:53:50.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2024-05-30T06:53:50.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.172873+0000', 'last_change': '2024-05-30T06:53:44.172873+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.172873+0000', 'last_undegraded': '2024-05-30T06:53:44.172873+0000', 'last_fullsized': '2024-05-30T06:53:44.172873+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:53:50.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2024-05-30T06:53:50.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:43.161648+0000', 'last_change': '2024-05-30T06:53:43.161648+0000', 'last_active': '2024-05-30T06:53:43.151673+0000', 'last_peered': '2024-05-30T06:53:43.151673+0000', 'last_clean': '2024-05-30T06:53:43.151673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:43.161648+0000', 'last_undegraded': '2024-05-30T06:53:43.161648+0000', 'last_fullsized': '2024-05-30T06:53:43.161648+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:53:50.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2024-05-30T06:53:50.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.168354+0000', 'last_change': '2024-05-30T06:53:44.168354+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.168354+0000', 'last_undegraded': '2024-05-30T06:53:44.168354+0000', 'last_fullsized': '2024-05-30T06:53:44.168354+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:53:50.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2024-05-30T06:53:50.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2024-05-30T06:53:50.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2024-05-30T06:53:50.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:43.163557+0000', 'last_change': '2024-05-30T06:53:43.163557+0000', 'last_active': '2024-05-30T06:53:43.151673+0000', 'last_peered': '2024-05-30T06:53:43.151673+0000', 'last_clean': '2024-05-30T06:53:43.151673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:43.163557+0000', 'last_undegraded': '2024-05-30T06:53:43.163557+0000', 'last_fullsized': '2024-05-30T06:53:43.163557+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:53:50.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2024-05-30T06:53:50.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.171709+0000', 'last_change': '2024-05-30T06:53:44.171709+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.171709+0000', 'last_undegraded': '2024-05-30T06:53:44.171709+0000', 'last_fullsized': '2024-05-30T06:53:44.171709+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:53:50.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2024-05-30T06:53:50.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 86, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:44.168310+0000', 'last_change': '2024-05-30T06:53:44.168310+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.168310+0000', 'last_undegraded': '2024-05-30T06:53:44.168310+0000', 'last_fullsized': '2024-05-30T06:53:44.168310+0000', 'mapping_epoch': 86, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 86, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:53:50.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2024-05-30T06:53:50.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 85, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:53:43.163585+0000', 'last_change': '2024-05-30T06:53:43.163585+0000', 'last_active': '2024-05-30T06:53:43.151673+0000', 'last_peered': '2024-05-30T06:53:43.151673+0000', 'last_clean': '2024-05-30T06:53:43.151673+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:43.163585+0000', 'last_undegraded': '2024-05-30T06:53:43.163585+0000', 'last_fullsized': '2024-05-30T06:53:43.163585+0000', 'mapping_epoch': 85, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 85, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:43.151673+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:53:50.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2024-05-30T06:53:50.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-30T06:53:44.157032+0000', 'last_change': '2024-05-30T06:53:44.157032+0000', 'last_active': '2024-05-30T06:53:44.157032+0000', 'last_peered': '2024-05-30T06:53:44.157032+0000', 'last_clean': '2024-05-30T06:53:44.157032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:53:44.157032+0000', 'last_undegraded': '2024-05-30T06:53:44.157032+0000', 'last_fullsized': '2024-05-30T06:53:44.157032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'last_clean_scrub_stamp': '2024-05-30T06:53:44.157032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-30T06:53:50.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-30T06:53:50.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.278+0000 7f4a6c000640 1 Processor -- start 2024-05-30T06:53:50.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.278+0000 7f4a6c000640 1 -- start start 2024-05-30T06:53:50.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a6c000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a64155e60 0x7f4a640b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a6c000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a6415c8f0 con 0x7f4a6406f9a0 2024-05-30T06:53:50.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a6c000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a640ccc80 con 0x7f4a640b2ec0 2024-05-30T06:53:50.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a6c000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4a640ccff0 con 0x7f4a64155e60 2024-05-30T06:53:50.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a68c00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4a6406f9a0 0x7f4a640cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53464/0 (socket says 172.21.15.37:53464) 2024-05-30T06:53:50.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a68c00640 1 -- 172.21.15.37:0/2526902534 learned_addr learned my addr 172.21.15.37:0/2526902534 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:50.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4172168589 0 0) 0x7f4a6415c8f0 con 0x7f4a6406f9a0 2024-05-30T06:53:50.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a4c003530 con 0x7f4a6406f9a0 2024-05-30T06:53:50.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a69600640 1 --2- 172.21.15.37:0/2526902534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a64155e60 0x7f4a640b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4144487469 0 0) 0x7f4a4c003530 con 0x7f4a6406f9a0 2024-05-30T06:53:50.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a64155e60 msgr2=0x7f4a640b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:50.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 --2- 172.21.15.37:0/2526902534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a64155e60 0x7f4a640b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 >> v1:172.21.15.105:6789/0 conn(0x7f4a640b2ec0 legacy=0x7f4a640cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6415cbd0 con 0x7f4a6406f9a0 2024-05-30T06:53:50.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f4a50001680 con 0x7f4a6406f9a0 2024-05-30T06:53:50.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 >> v1:172.21.15.37:6789/0 conn(0x7f4a6406f9a0 legacy=0x7f4a640cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 --2- 172.21.15.37:0/2526902534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a64155e60 0x7f4a4c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 --2- 172.21.15.37:0/2526902534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a4c003f70 0x7f4a4c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 --2- 172.21.15.37:0/2526902534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a4c004d50 0x7f4a4c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4a640ccff0 con 0x7f4a4c003f70 2024-05-30T06:53:50.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4c00bab0 con 0x7f4a4c004d50 2024-05-30T06:53:50.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4a4c00dec0 con 0x7f4a64155e60 2024-05-30T06:53:50.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a68c00640 1 --2- 172.21.15.37:0/2526902534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a4c003f70 0x7f4a4c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a69600640 1 --2- 172.21.15.37:0/2526902534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a64155e60 0x7f4a4c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a6a000640 1 --2- 172.21.15.37:0/2526902534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a4c004d50 0x7f4a4c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a68c00640 1 -- 172.21.15.37:0/2526902534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a64155e60 msgr2=0x7f4a4c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:50.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a68c00640 1 --2- 172.21.15.37:0/2526902534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a64155e60 0x7f4a4c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a68c00640 1 -- 172.21.15.37:0/2526902534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a4c004d50 msgr2=0x7f4a4c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:50.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a68c00640 1 --2- 172.21.15.37:0/2526902534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a4c004d50 0x7f4a4c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a68c00640 1 -- 172.21.15.37:0/2526902534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a4c003530 con 0x7f4a4c003f70 2024-05-30T06:53:50.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.282+0000 7f4a69600640 1 --2- 172.21.15.37:0/2526902534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a64155e60 0x7f4a4c0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:50.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.286+0000 7f4a68c00640 1 --2- 172.21.15.37:0/2526902534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a4c003f70 0x7f4a4c004810 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f4a6406fe20 tx=0x7f4a5001f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82badae8e80a9258 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:50.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.286+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50007d40 con 0x7f4a4c003f70 2024-05-30T06:53:50.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.286+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a50005b00 con 0x7f4a4c003f70 2024-05-30T06:53:50.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.286+0000 7f4a63e00640 1 -- 172.21.15.37:0/2526902534 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50007070 con 0x7f4a4c003f70 2024-05-30T06:53:50.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.286+0000 7f4a6c000640 1 -- 172.21.15.37:0/2526902534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a4c003f70 msgr2=0x7f4a4c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.286+0000 7f4a6c000640 1 --2- 172.21.15.37:0/2526902534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a4c003f70 0x7f4a4c004810 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f4a6406fe20 tx=0x7f4a5001f3d0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.286+0000 7f4a6a000640 1 -- 172.21.15.37:0/2526902534 reap_dead start 2024-05-30T06:53:50.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.286+0000 7f4a6c000640 1 -- 172.21.15.37:0/2526902534 shutdown_connections 2024-05-30T06:53:50.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.286+0000 7f4a6c000640 1 -- 172.21.15.37:0/2526902534 >> 172.21.15.37:0/2526902534 conn(0x7f4a640b23a0 msgr2=0x7f4a640b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:50.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.286+0000 7f4a6c000640 1 -- 172.21.15.37:0/2526902534 shutdown_connections 2024-05-30T06:53:50.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.286+0000 7f4a6c000640 1 -- 172.21.15.37:0/2526902534 wait complete. 2024-05-30T06:53:50.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.286+0000 7f4a6c000640 1 Processor -- start 2024-05-30T06:53:50.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.286+0000 7f4a6c000640 1 -- start start 2024-05-30T06:53:50.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6c000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a4c003f70 0x7f4a6414d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6c000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a64154190 0x7f4a64141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6c000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a6414df30 0x7f4a6414e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6c000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4a640cfef0 con 0x7f4a6414df30 2024-05-30T06:53:50.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6c000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4a640cfd70 con 0x7f4a64154190 2024-05-30T06:53:50.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6c000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4a640d0070 con 0x7f4a4c003f70 2024-05-30T06:53:50.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a6414df30 0x7f4a6414e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a6414df30 0x7f4a6414e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56798/0 (socket says 172.21.15.37:56798) 2024-05-30T06:53:50.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6a000640 1 -- 172.21.15.37:0/2199959720 learned_addr learned my addr 172.21.15.37:0/2199959720 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:50.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a69600640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a4c003f70 0x7f4a6414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a68c00640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a64154190 0x7f4a64141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6a000640 1 -- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a4c003f70 msgr2=0x7f4a6414d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6a000640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a4c003f70 0x7f4a6414d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6a000640 1 -- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a64154190 msgr2=0x7f4a64141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6a000640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a64154190 0x7f4a64141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6a000640 1 -- 172.21.15.37:0/2199959720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a64145820 con 0x7f4a6414df30 2024-05-30T06:53:50.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6a000640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a6414df30 0x7f4a6414e3b0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00e700 tx=0x7f4a5c00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:50.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a61600640 1 -- 172.21.15.37:0/2199959720 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c003980 con 0x7f4a6414df30 2024-05-30T06:53:50.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a61600640 1 -- 172.21.15.37:0/2199959720 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5c018070 con 0x7f4a6414df30 2024-05-30T06:53:50.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a61600640 1 -- 172.21.15.37:0/2199959720 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5c003d60 con 0x7f4a6414df30 2024-05-30T06:53:50.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6c000640 1 -- 172.21.15.37:0/2199959720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a641514b0 con 0x7f4a6414df30 2024-05-30T06:53:50.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6c000640 1 -- 172.21.15.37:0/2199959720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a64151a70 con 0x7f4a6414df30 2024-05-30T06:53:50.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.290+0000 7f4a6c000640 1 -- 172.21.15.37:0/2199959720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a64144310 con 0x7f4a6414df30 2024-05-30T06:53:50.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.294+0000 7f4a61600640 1 -- 172.21.15.37:0/2199959720 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f4a5c0050d0 con 0x7f4a6414df30 2024-05-30T06:53:50.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.294+0000 7f4a61600640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4a440695b0 0x7f4a4406ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.294+0000 7f4a61600640 1 -- 172.21.15.37:0/2199959720 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5737+0+0 (secure 0 0 0) 0x7f4a5c085410 con 0x7f4a6414df30 2024-05-30T06:53:50.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.294+0000 7f4a69600640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4a440695b0 0x7f4a4406ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.294+0000 7f4a69600640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4a440695b0 0x7f4a4406ba70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009b60 tx=0x7f4a58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:50.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.298+0000 7f4a61600640 1 -- 172.21.15.37:0/2199959720 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4a64145820 con 0x7f4a6414df30 2024-05-30T06:53:50.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.518+0000 7f4a6c000640 1 -- 172.21.15.37:0/2199959720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4a64068b20 con 0x7f4a6414df30 2024-05-30T06:53:50.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.518+0000 7f4a61600640 1 -- 172.21.15.37:0/2199959720 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1173 (secure 0 0 0) 0x7f4a5c056a60 con 0x7f4a6414df30 2024-05-30T06:53:50.520 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:50.520 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":724,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":88,"num_osds":8,"num_up_osds":8,"osd_up_since":1717051317,"num_in_osds":8,"osd_in_since":1717051308,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":37},{"state_name":"creating+peering","count":33},{"state_name":"active+clean","count":27}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":590368,"bytes_used":782036992,"bytes_avail":772312076288,"bytes_total":773094113280,"unknown_pgs_ratio":0.38144329190254211,"inactive_pgs_ratio":0.34020617604255676,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":55,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"b","status":"up:active","gid":7932}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-05-30T06:51:42.820933+0000","services":{}},"progress_events":{}} 2024-05-30T06:53:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.522+0000 7f4a6c000640 1 -- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4a440695b0 msgr2=0x7f4a4406ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.522+0000 7f4a6c000640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4a440695b0 0x7f4a4406ba70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009b60 tx=0x7f4a58008040 comp rx=0 tx=0).stop 2024-05-30T06:53:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.522+0000 7f4a6c000640 1 -- 172.21.15.37:0/2199959720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a6414df30 msgr2=0x7f4a6414e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.522+0000 7f4a6c000640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a6414df30 0x7f4a6414e3b0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00e700 tx=0x7f4a5c00ebc0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.522+0000 7f4a6c000640 1 -- 172.21.15.37:0/2199959720 shutdown_connections 2024-05-30T06:53:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.522+0000 7f4a6c000640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a6414df30 0x7f4a6414e3b0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.522+0000 7f4a6c000640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4a440695b0 0x7f4a4406ba70 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.522+0000 7f4a6c000640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a64154190 0x7f4a64141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.522+0000 7f4a6c000640 1 --2- 172.21.15.37:0/2199959720 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a4c003f70 0x7f4a6414d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.522+0000 7f4a6c000640 1 -- 172.21.15.37:0/2199959720 >> 172.21.15.37:0/2199959720 conn(0x7f4a640b23a0 msgr2=0x7f4a6415aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.522+0000 7f4a6c000640 1 -- 172.21.15.37:0/2199959720 shutdown_connections 2024-05-30T06:53:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.522+0000 7f4a6c000640 1 -- 172.21.15.37:0/2199959720 wait complete. 2024-05-30T06:53:50.542 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-30T06:53:50.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:53:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.682+0000 7f9841a00640 1 Processor -- start 2024-05-30T06:53:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.682+0000 7f9841a00640 1 -- start start 2024-05-30T06:53:50.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.682+0000 7f9841a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f983c155e60 0x7f983c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.682+0000 7f9841a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f983c06f9a0 0x7f983c0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.682+0000 7f9841a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f983c0b2ec0 0x7f983c0cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.682+0000 7f9841a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f983c0ccff0 con 0x7f983c0b2ec0 2024-05-30T06:53:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.682+0000 7f9841a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f983c0d00e0 con 0x7f983c06f9a0 2024-05-30T06:53:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.682+0000 7f9841a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f983c15c8f0 con 0x7f983c155e60 2024-05-30T06:53:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.682+0000 7f983b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f983c0b2ec0 0x7f983c0cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.682+0000 7f983b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f983c0b2ec0 0x7f983c0cfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56800/0 (socket says 172.21.15.37:56800) 2024-05-30T06:53:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.682+0000 7f983b400640 1 -- 172.21.15.37:0/2363746697 learned_addr learned my addr 172.21.15.37:0/2363746697 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.682+0000 7f983aa00640 1 --2- 172.21.15.37:0/2363746697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f983c155e60 0x7f983c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.682+0000 7f9832000640 1 --2- 172.21.15.37:0/2363746697 >> v2:172.21.15.105:3300/0 conn(0x7f983c06f9a0 0x7f983c0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f983b400640 1 -- 172.21.15.37:0/2363746697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f983c155e60 msgr2=0x7f983c0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f983b400640 1 --2- 172.21.15.37:0/2363746697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f983c155e60 0x7f983c0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f983b400640 1 -- 172.21.15.37:0/2363746697 >> v2:172.21.15.105:3300/0 conn(0x7f983c06f9a0 msgr2=0x7f983c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f983b400640 1 --2- 172.21.15.37:0/2363746697 >> v2:172.21.15.105:3300/0 conn(0x7f983c06f9a0 0x7f983c0cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f983b400640 1 -- 172.21.15.37:0/2363746697 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983c0ccc80 con 0x7f983c0b2ec0 2024-05-30T06:53:50.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f983b400640 1 --2- 172.21.15.37:0/2363746697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f983c0b2ec0 0x7f983c0cfba0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f983c06df50 tx=0x7f983401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f55a03ddfe82d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:50.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f983a000640 1 -- 172.21.15.37:0/2363746697 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98340a5780 con 0x7f983c0b2ec0 2024-05-30T06:53:50.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f983a000640 1 -- 172.21.15.37:0/2363746697 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98340a5920 con 0x7f983c0b2ec0 2024-05-30T06:53:50.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f983a000640 1 -- 172.21.15.37:0/2363746697 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98340a5cf0 con 0x7f983c0b2ec0 2024-05-30T06:53:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f9841a00640 1 -- 172.21.15.37:0/2363746697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f983c0b2ec0 msgr2=0x7f983c0cfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f9841a00640 1 --2- 172.21.15.37:0/2363746697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f983c0b2ec0 0x7f983c0cfba0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f983c06df50 tx=0x7f983401c9f0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f9841a00640 1 -- 172.21.15.37:0/2363746697 shutdown_connections 2024-05-30T06:53:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f9841a00640 1 --2- 172.21.15.37:0/2363746697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f983c0b2ec0 0x7f983c0cfba0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f9841a00640 1 --2- 172.21.15.37:0/2363746697 >> v2:172.21.15.105:3300/0 conn(0x7f983c06f9a0 0x7f983c0cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f9841a00640 1 --2- 172.21.15.37:0/2363746697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f983c155e60 0x7f983c0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f9841a00640 1 -- 172.21.15.37:0/2363746697 >> 172.21.15.37:0/2363746697 conn(0x7f983c0b23a0 msgr2=0x7f983c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f9841a00640 1 -- 172.21.15.37:0/2363746697 shutdown_connections 2024-05-30T06:53:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.686+0000 7f9841a00640 1 -- 172.21.15.37:0/2363746697 wait complete. 2024-05-30T06:53:50.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9841a00640 1 Processor -- start 2024-05-30T06:53:50.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9841a00640 1 -- start start 2024-05-30T06:53:50.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9841a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f983c06f9a0 0x7f983c141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9841a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f983c0b2ec0 0x7f983c14c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9841a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f983c155e60 0x7f983c074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9841a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f983c0ce000 con 0x7f983c06f9a0 2024-05-30T06:53:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9841a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f983c0cde80 con 0x7f983c155e60 2024-05-30T06:53:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9841a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f983c0ce180 con 0x7f983c0b2ec0 2024-05-30T06:53:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f983aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f983c06f9a0 0x7f983c141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f983aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f983c06f9a0 0x7f983c141540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56814/0 (socket says 172.21.15.37:56814) 2024-05-30T06:53:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f983aa00640 1 -- 172.21.15.37:0/2282603191 learned_addr learned my addr 172.21.15.37:0/2282603191 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f983b400640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f983c155e60 0x7f983c074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9832000640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f983c0b2ec0 0x7f983c14c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f983aa00640 1 -- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f983c0b2ec0 msgr2=0x7f983c14c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f983aa00640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f983c0b2ec0 0x7f983c14c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f983aa00640 1 -- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f983c155e60 msgr2=0x7f983c074cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f983aa00640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f983c155e60 0x7f983c074cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f983aa00640 1 -- 172.21.15.37:0/2282603191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983c141b50 con 0x7f983c06f9a0 2024-05-30T06:53:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9832000640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f983c0b2ec0 0x7f983c14c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f983aa00640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f983c06f9a0 0x7f983c141540 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f982c00d990 tx=0x7f982c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9833400640 1 -- 172.21.15.37:0/2282603191 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c015070 con 0x7f983c06f9a0 2024-05-30T06:53:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9833400640 1 -- 172.21.15.37:0/2282603191 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c007b10 con 0x7f983c06f9a0 2024-05-30T06:53:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9841a00640 1 -- 172.21.15.37:0/2282603191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983c14d200 con 0x7f983c06f9a0 2024-05-30T06:53:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9833400640 1 -- 172.21.15.37:0/2282603191 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c010470 con 0x7f983c06f9a0 2024-05-30T06:53:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.690+0000 7f9841a00640 1 -- 172.21.15.37:0/2282603191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f983c1563c0 con 0x7f983c06f9a0 2024-05-30T06:53:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.694+0000 7f9841a00640 1 -- 172.21.15.37:0/2282603191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f983c068b20 con 0x7f983c06f9a0 2024-05-30T06:53:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.694+0000 7f9833400640 1 -- 172.21.15.37:0/2282603191 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f982c018070 con 0x7f983c06f9a0 2024-05-30T06:53:50.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.694+0000 7f9833400640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9818069580 0x7f981806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:50.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.694+0000 7f9833400640 1 -- 172.21.15.37:0/2282603191 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5737+0+0 (secure 0 0 0) 0x7f982c085f30 con 0x7f983c06f9a0 2024-05-30T06:53:50.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.694+0000 7f9832000640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9818069580 0x7f981806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:50.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.698+0000 7f9832000640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9818069580 0x7f981806ba40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f983c147f20 tx=0x7f982400f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:50.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.698+0000 7f9833400640 1 -- 172.21.15.37:0/2282603191 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f982c057580 con 0x7f983c06f9a0 2024-05-30T06:53:50.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.862+0000 7f9841a00640 1 -- 172.21.15.37:0/2282603191 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f983c14d720 con 0x7f9818069580 2024-05-30T06:53:50.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.866+0000 7f9833400640 1 -- 172.21.15.37:0/2282603191 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244158 (secure 0 0 0) 0x7f983c14d720 con 0x7f9818069580 2024-05-30T06:53:50.870 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:50.871 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:53:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.870+0000 7f9841a00640 1 -- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9818069580 msgr2=0x7f981806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.870+0000 7f9841a00640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9818069580 0x7f981806ba40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f983c147f20 tx=0x7f982400f040 comp rx=0 tx=0).stop 2024-05-30T06:53:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.870+0000 7f9841a00640 1 -- 172.21.15.37:0/2282603191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f983c06f9a0 msgr2=0x7f983c141540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.870+0000 7f9841a00640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f983c06f9a0 0x7f983c141540 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f982c00d990 tx=0x7f982c00dd90 comp rx=0 tx=0).stop 2024-05-30T06:53:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.870+0000 7f9841a00640 1 -- 172.21.15.37:0/2282603191 shutdown_connections 2024-05-30T06:53:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.870+0000 7f9841a00640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9818069580 0x7f981806ba40 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.870+0000 7f9841a00640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f983c155e60 0x7f983c074cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.870+0000 7f9841a00640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f983c0b2ec0 0x7f983c14c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.870+0000 7f9841a00640 1 --2- 172.21.15.37:0/2282603191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f983c06f9a0 0x7f983c141540 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:50.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.870+0000 7f9841a00640 1 -- 172.21.15.37:0/2282603191 >> 172.21.15.37:0/2282603191 conn(0x7f983c0b23a0 msgr2=0x7f983c1511e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.870+0000 7f9841a00640 1 -- 172.21.15.37:0/2282603191 shutdown_connections 2024-05-30T06:53:50.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:50.870+0000 7f9841a00640 1 -- 172.21.15.37:0/2282603191 wait complete. 2024-05-30T06:53:50.890 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":436,"stamp":"2024-05-30T06:53:48.913390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":120,"acting":120,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":763708,"kb_used_data":9396,"kb_used_omap":12,"kb_used_meta":754163,"kb_avail":754211012,"statfs":{"total":773094113280,"available":772312076288,"internally_reserved":0,"allocated":9621504,"data_stored":4802229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":772263472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.751546"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.170664+0000","last_change":"2024-05-30T06:53:44.170664+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.170664+0000","last_undegraded":"2024-05-30T06:53:44.170664+0000","last_fullsized":"2024-05-30T06:53:44.170664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.173379+0000","last_change":"2024-05-30T06:53:44.173379+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.173379+0000","last_undegraded":"2024-05-30T06:53:44.173379+0000","last_fullsized":"2024-05-30T06:53:44.173379+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168986+0000","last_change":"2024-05-30T06:53:44.168986+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168986+0000","last_undegraded":"2024-05-30T06:53:44.168986+0000","last_fullsized":"2024-05-30T06:53:44.168986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.171231+0000","last_change":"2024-05-30T06:53:44.171231+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.171231+0000","last_undegraded":"2024-05-30T06:53:44.171231+0000","last_fullsized":"2024-05-30T06:53:44.171231+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172323+0000","last_change":"2024-05-30T06:53:44.172323+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172323+0000","last_undegraded":"2024-05-30T06:53:44.172323+0000","last_fullsized":"2024-05-30T06:53:44.172323+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192824+0000","last_change":"2024-05-30T06:53:45.198790+0000","last_active":"2024-05-30T06:53:46.192824+0000","last_peered":"2024-05-30T06:53:46.192824+0000","last_clean":"2024-05-30T06:53:46.192824+0000","last_became_active":"2024-05-30T06:53:45.198496+0000","last_became_peered":"2024-05-30T06:53:45.198496+0000","last_unstale":"2024-05-30T06:53:46.192824+0000","last_undegraded":"2024-05-30T06:53:46.192824+0000","last_fullsized":"2024-05-30T06:53:46.192824+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:19:48.656142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.205025+0000","last_change":"2024-05-30T06:53:45.203371+0000","last_active":"2024-05-30T06:53:46.205025+0000","last_peered":"2024-05-30T06:53:46.205025+0000","last_clean":"2024-05-30T06:53:46.205025+0000","last_became_active":"2024-05-30T06:53:45.202893+0000","last_became_peered":"2024-05-30T06:53:45.202893+0000","last_unstale":"2024-05-30T06:53:46.205025+0000","last_undegraded":"2024-05-30T06:53:46.205025+0000","last_fullsized":"2024-05-30T06:53:46.205025+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:48.071424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168972+0000","last_change":"2024-05-30T06:53:44.168972+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168972+0000","last_undegraded":"2024-05-30T06:53:44.168972+0000","last_fullsized":"2024-05-30T06:53:44.168972+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.173361+0000","last_change":"2024-05-30T06:53:44.173361+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.173361+0000","last_undegraded":"2024-05-30T06:53:44.173361+0000","last_fullsized":"2024-05-30T06:53:44.173361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.170782+0000","last_change":"2024-05-30T06:53:44.170782+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.170782+0000","last_undegraded":"2024-05-30T06:53:44.170782+0000","last_fullsized":"2024-05-30T06:53:44.170782+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168334+0000","last_change":"2024-05-30T06:53:44.168334+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168334+0000","last_undegraded":"2024-05-30T06:53:44.168334+0000","last_fullsized":"2024-05-30T06:53:44.168334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185484+0000","last_change":"2024-05-30T06:53:44.182937+0000","last_active":"2024-05-30T06:53:44.185484+0000","last_peered":"2024-05-30T06:53:44.185484+0000","last_clean":"2024-05-30T06:53:44.185484+0000","last_became_active":"2024-05-30T06:53:44.182611+0000","last_became_peered":"2024-05-30T06:53:44.182611+0000","last_unstale":"2024-05-30T06:53:44.185484+0000","last_undegraded":"2024-05-30T06:53:44.185484+0000","last_fullsized":"2024-05-30T06:53:44.185484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:49:16.315568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.170159+0000","last_change":"2024-05-30T06:53:44.170159+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.170159+0000","last_undegraded":"2024-05-30T06:53:44.170159+0000","last_fullsized":"2024-05-30T06:53:44.170159+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.163516+0000","last_change":"2024-05-30T06:53:43.163516+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.163516+0000","last_undegraded":"2024-05-30T06:53:43.163516+0000","last_fullsized":"2024-05-30T06:53:43.163516+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.169094+0000","last_change":"2024-05-30T06:53:44.169094+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.169094+0000","last_undegraded":"2024-05-30T06:53:44.169094+0000","last_fullsized":"2024-05-30T06:53:44.169094+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204932+0000","last_change":"2024-05-30T06:53:44.180212+0000","last_active":"2024-05-30T06:53:46.204932+0000","last_peered":"2024-05-30T06:53:46.204932+0000","last_clean":"2024-05-30T06:53:46.204932+0000","last_became_active":"2024-05-30T06:53:44.179929+0000","last_became_peered":"2024-05-30T06:53:44.179929+0000","last_unstale":"2024-05-30T06:53:46.204932+0000","last_undegraded":"2024-05-30T06:53:46.204932+0000","last_fullsized":"2024-05-30T06:53:46.204932+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:11:30.173203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172092+0000","last_change":"2024-05-30T06:53:44.172092+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172092+0000","last_undegraded":"2024-05-30T06:53:44.172092+0000","last_fullsized":"2024-05-30T06:53:44.172092+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204772+0000","last_change":"2024-05-30T06:53:44.180631+0000","last_active":"2024-05-30T06:53:46.204772+0000","last_peered":"2024-05-30T06:53:46.204772+0000","last_clean":"2024-05-30T06:53:46.204772+0000","last_became_active":"2024-05-30T06:53:44.180328+0000","last_became_peered":"2024-05-30T06:53:44.180328+0000","last_unstale":"2024-05-30T06:53:46.204772+0000","last_undegraded":"2024-05-30T06:53:46.204772+0000","last_fullsized":"2024-05-30T06:53:46.204772+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:43.524704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.165240+0000","last_change":"2024-05-30T06:53:43.165240+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.165240+0000","last_undegraded":"2024-05-30T06:53:43.165240+0000","last_fullsized":"2024-05-30T06:53:43.165240+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.164620+0000","last_change":"2024-05-30T06:53:43.164620+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.164620+0000","last_undegraded":"2024-05-30T06:53:43.164620+0000","last_fullsized":"2024-05-30T06:53:43.164620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172355+0000","last_change":"2024-05-30T06:53:44.172355+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172355+0000","last_undegraded":"2024-05-30T06:53:44.172355+0000","last_fullsized":"2024-05-30T06:53:44.172355+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204593+0000","last_change":"2024-05-30T06:53:44.183688+0000","last_active":"2024-05-30T06:53:46.204593+0000","last_peered":"2024-05-30T06:53:46.204593+0000","last_clean":"2024-05-30T06:53:46.204593+0000","last_became_active":"2024-05-30T06:53:44.183409+0000","last_became_peered":"2024-05-30T06:53:44.183409+0000","last_unstale":"2024-05-30T06:53:46.204593+0000","last_undegraded":"2024-05-30T06:53:46.204593+0000","last_fullsized":"2024-05-30T06:53:46.204593+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:42:06.579962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192838+0000","last_change":"2024-05-30T06:53:45.198210+0000","last_active":"2024-05-30T06:53:46.192838+0000","last_peered":"2024-05-30T06:53:46.192838+0000","last_clean":"2024-05-30T06:53:46.192838+0000","last_became_active":"2024-05-30T06:53:45.197947+0000","last_became_peered":"2024-05-30T06:53:45.197947+0000","last_unstale":"2024-05-30T06:53:46.192838+0000","last_undegraded":"2024-05-30T06:53:46.192838+0000","last_fullsized":"2024-05-30T06:53:46.192838+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:31.917254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.162028+0000","last_change":"2024-05-30T06:53:43.162028+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.162028+0000","last_undegraded":"2024-05-30T06:53:43.162028+0000","last_fullsized":"2024-05-30T06:53:43.162028+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.193239+0000","last_change":"2024-05-30T06:53:45.192238+0000","last_active":"2024-05-30T06:53:46.193239+0000","last_peered":"2024-05-30T06:53:46.193239+0000","last_clean":"2024-05-30T06:53:46.193239+0000","last_became_active":"2024-05-30T06:53:45.191951+0000","last_became_peered":"2024-05-30T06:53:45.191951+0000","last_unstale":"2024-05-30T06:53:46.193239+0000","last_undegraded":"2024-05-30T06:53:46.193239+0000","last_fullsized":"2024-05-30T06:53:46.193239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:54.540262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185463+0000","last_change":"2024-05-30T06:53:44.178845+0000","last_active":"2024-05-30T06:53:44.185463+0000","last_peered":"2024-05-30T06:53:44.185463+0000","last_clean":"2024-05-30T06:53:44.185463+0000","last_became_active":"2024-05-30T06:53:44.178561+0000","last_became_peered":"2024-05-30T06:53:44.178561+0000","last_unstale":"2024-05-30T06:53:44.185463+0000","last_undegraded":"2024-05-30T06:53:44.185463+0000","last_fullsized":"2024-05-30T06:53:44.185463+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:00:39.723750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.191433+0000","last_change":"2024-05-30T06:53:44.187386+0000","last_active":"2024-05-30T06:53:44.191433+0000","last_peered":"2024-05-30T06:53:44.191433+0000","last_clean":"2024-05-30T06:53:44.191433+0000","last_became_active":"2024-05-30T06:53:44.187038+0000","last_became_peered":"2024-05-30T06:53:44.187038+0000","last_unstale":"2024-05-30T06:53:44.191433+0000","last_undegraded":"2024-05-30T06:53:44.191433+0000","last_fullsized":"2024-05-30T06:53:44.191433+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:28:13.793714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204881+0000","last_change":"2024-05-30T06:53:45.201568+0000","last_active":"2024-05-30T06:53:46.204881+0000","last_peered":"2024-05-30T06:53:46.204881+0000","last_clean":"2024-05-30T06:53:46.204881+0000","last_became_active":"2024-05-30T06:53:45.201291+0000","last_became_peered":"2024-05-30T06:53:45.201291+0000","last_unstale":"2024-05-30T06:53:46.204881+0000","last_undegraded":"2024-05-30T06:53:46.204881+0000","last_fullsized":"2024-05-30T06:53:46.204881+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:27:56.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.189498+0000","last_change":"2024-05-30T06:53:44.186134+0000","last_active":"2024-05-30T06:53:44.189498+0000","last_peered":"2024-05-30T06:53:44.189498+0000","last_clean":"2024-05-30T06:53:44.189498+0000","last_became_active":"2024-05-30T06:53:44.185863+0000","last_became_peered":"2024-05-30T06:53:44.185863+0000","last_unstale":"2024-05-30T06:53:44.189498+0000","last_undegraded":"2024-05-30T06:53:44.189498+0000","last_fullsized":"2024-05-30T06:53:44.189498+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:04:30.643407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.165312+0000","last_change":"2024-05-30T06:53:43.165312+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.165312+0000","last_undegraded":"2024-05-30T06:53:43.165312+0000","last_fullsized":"2024-05-30T06:53:43.165312+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204610+0000","last_change":"2024-05-30T06:53:45.205031+0000","last_active":"2024-05-30T06:53:46.204610+0000","last_peered":"2024-05-30T06:53:46.204610+0000","last_clean":"2024-05-30T06:53:46.204610+0000","last_became_active":"2024-05-30T06:53:45.203028+0000","last_became_peered":"2024-05-30T06:53:45.203028+0000","last_unstale":"2024-05-30T06:53:46.204610+0000","last_undegraded":"2024-05-30T06:53:46.204610+0000","last_fullsized":"2024-05-30T06:53:46.204610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:00:25.498984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.161425+0000","last_change":"2024-05-30T06:53:43.161425+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.161425+0000","last_undegraded":"2024-05-30T06:53:43.161425+0000","last_fullsized":"2024-05-30T06:53:43.161425+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.171784+0000","last_change":"2024-05-30T06:53:44.171784+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.171784+0000","last_undegraded":"2024-05-30T06:53:44.171784+0000","last_fullsized":"2024-05-30T06:53:44.171784+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192837+0000","last_change":"2024-05-30T06:53:44.187226+0000","last_active":"2024-05-30T06:53:46.192837+0000","last_peered":"2024-05-30T06:53:46.192837+0000","last_clean":"2024-05-30T06:53:46.192837+0000","last_became_active":"2024-05-30T06:53:44.182670+0000","last_became_peered":"2024-05-30T06:53:44.182670+0000","last_unstale":"2024-05-30T06:53:46.192837+0000","last_undegraded":"2024-05-30T06:53:46.192837+0000","last_fullsized":"2024-05-30T06:53:46.192837+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:33:13.413258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.164418+0000","last_change":"2024-05-30T06:53:43.164418+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.164418+0000","last_undegraded":"2024-05-30T06:53:43.164418+0000","last_fullsized":"2024-05-30T06:53:43.164418+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204488+0000","last_change":"2024-05-30T06:53:44.185405+0000","last_active":"2024-05-30T06:53:46.204488+0000","last_peered":"2024-05-30T06:53:46.204488+0000","last_clean":"2024-05-30T06:53:46.204488+0000","last_became_active":"2024-05-30T06:53:44.185131+0000","last_became_peered":"2024-05-30T06:53:44.185131+0000","last_unstale":"2024-05-30T06:53:46.204488+0000","last_undegraded":"2024-05-30T06:53:46.204488+0000","last_fullsized":"2024-05-30T06:53:46.204488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:41:25.174084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172914+0000","last_change":"2024-05-30T06:53:44.172914+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172914+0000","last_undegraded":"2024-05-30T06:53:44.172914+0000","last_fullsized":"2024-05-30T06:53:44.172914+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.191748+0000","last_change":"2024-05-30T06:53:44.190185+0000","last_active":"2024-05-30T06:53:44.191748+0000","last_peered":"2024-05-30T06:53:44.191748+0000","last_clean":"2024-05-30T06:53:44.191748+0000","last_became_active":"2024-05-30T06:53:44.189820+0000","last_became_peered":"2024-05-30T06:53:44.189820+0000","last_unstale":"2024-05-30T06:53:44.191748+0000","last_undegraded":"2024-05-30T06:53:44.191748+0000","last_fullsized":"2024-05-30T06:53:44.191748+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:28:43.250137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.169703+0000","last_change":"2024-05-30T06:53:44.169703+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.169703+0000","last_undegraded":"2024-05-30T06:53:44.169703+0000","last_fullsized":"2024-05-30T06:53:44.169703+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204948+0000","last_change":"2024-05-30T06:53:44.186669+0000","last_active":"2024-05-30T06:53:46.204948+0000","last_peered":"2024-05-30T06:53:46.204948+0000","last_clean":"2024-05-30T06:53:46.204948+0000","last_became_active":"2024-05-30T06:53:44.186320+0000","last_became_peered":"2024-05-30T06:53:44.186320+0000","last_unstale":"2024-05-30T06:53:46.204948+0000","last_undegraded":"2024-05-30T06:53:46.204948+0000","last_fullsized":"2024-05-30T06:53:46.204948+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:16:37.222002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204913+0000","last_change":"2024-05-30T06:53:44.186972+0000","last_active":"2024-05-30T06:53:46.204913+0000","last_peered":"2024-05-30T06:53:46.204913+0000","last_clean":"2024-05-30T06:53:46.204913+0000","last_became_active":"2024-05-30T06:53:44.186707+0000","last_became_peered":"2024-05-30T06:53:44.186707+0000","last_unstale":"2024-05-30T06:53:46.204913+0000","last_undegraded":"2024-05-30T06:53:46.204913+0000","last_fullsized":"2024-05-30T06:53:46.204913+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:43.623167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192951+0000","last_change":"2024-05-30T06:53:44.176262+0000","last_active":"2024-05-30T06:53:46.192951+0000","last_peered":"2024-05-30T06:53:46.192951+0000","last_clean":"2024-05-30T06:53:46.192951+0000","last_became_active":"2024-05-30T06:53:44.175893+0000","last_became_peered":"2024-05-30T06:53:44.175893+0000","last_unstale":"2024-05-30T06:53:46.192951+0000","last_undegraded":"2024-05-30T06:53:46.192951+0000","last_fullsized":"2024-05-30T06:53:46.192951+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:52.690379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.167273+0000","last_change":"2024-05-30T06:53:43.167273+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.167273+0000","last_undegraded":"2024-05-30T06:53:43.167273+0000","last_fullsized":"2024-05-30T06:53:43.167273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.166771+0000","last_change":"2024-05-30T06:53:43.166771+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.166771+0000","last_undegraded":"2024-05-30T06:53:43.166771+0000","last_fullsized":"2024-05-30T06:53:43.166771+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192684+0000","last_change":"2024-05-30T06:53:44.168334+0000","last_active":"2024-05-30T06:53:46.192684+0000","last_peered":"2024-05-30T06:53:46.192684+0000","last_clean":"2024-05-30T06:53:46.192684+0000","last_became_active":"2024-05-30T06:53:44.168056+0000","last_became_peered":"2024-05-30T06:53:44.168056+0000","last_unstale":"2024-05-30T06:53:46.192684+0000","last_undegraded":"2024-05-30T06:53:46.192684+0000","last_fullsized":"2024-05-30T06:53:46.192684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:33:36.114248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.161408+0000","last_change":"2024-05-30T06:53:43.161408+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.161408+0000","last_undegraded":"2024-05-30T06:53:43.161408+0000","last_fullsized":"2024-05-30T06:53:43.161408+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.172873+0000","last_change":"2024-05-30T06:53:44.172873+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.172873+0000","last_undegraded":"2024-05-30T06:53:44.172873+0000","last_fullsized":"2024-05-30T06:53:44.172873+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.161648+0000","last_change":"2024-05-30T06:53:43.161648+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.161648+0000","last_undegraded":"2024-05-30T06:53:43.161648+0000","last_fullsized":"2024-05-30T06:53:43.161648+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168354+0000","last_change":"2024-05-30T06:53:44.168354+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168354+0000","last_undegraded":"2024-05-30T06:53:44.168354+0000","last_fullsized":"2024-05-30T06:53:44.168354+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.183553+0000","last_change":"2024-05-30T06:53:44.177960+0000","last_active":"2024-05-30T06:53:44.183553+0000","last_peered":"2024-05-30T06:53:44.183553+0000","last_clean":"2024-05-30T06:53:44.183553+0000","last_became_active":"2024-05-30T06:53:44.177390+0000","last_became_peered":"2024-05-30T06:53:44.177390+0000","last_unstale":"2024-05-30T06:53:44.183553+0000","last_undegraded":"2024-05-30T06:53:44.183553+0000","last_fullsized":"2024-05-30T06:53:44.183553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:51:00.599943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185759+0000","last_change":"2024-05-30T06:53:44.183971+0000","last_active":"2024-05-30T06:53:44.185759+0000","last_peered":"2024-05-30T06:53:44.185759+0000","last_clean":"2024-05-30T06:53:44.185759+0000","last_became_active":"2024-05-30T06:53:44.180960+0000","last_became_peered":"2024-05-30T06:53:44.180960+0000","last_unstale":"2024-05-30T06:53:44.185759+0000","last_undegraded":"2024-05-30T06:53:44.185759+0000","last_fullsized":"2024-05-30T06:53:44.185759+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:01:32.576119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204792+0000","last_change":"2024-05-30T06:53:44.183606+0000","last_active":"2024-05-30T06:53:46.204792+0000","last_peered":"2024-05-30T06:53:46.204792+0000","last_clean":"2024-05-30T06:53:46.204792+0000","last_became_active":"2024-05-30T06:53:44.183319+0000","last_became_peered":"2024-05-30T06:53:44.183319+0000","last_unstale":"2024-05-30T06:53:46.204792+0000","last_undegraded":"2024-05-30T06:53:46.204792+0000","last_fullsized":"2024-05-30T06:53:46.204792+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:52:12.665818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204884+0000","last_change":"2024-05-30T06:53:45.203178+0000","last_active":"2024-05-30T06:53:46.204884+0000","last_peered":"2024-05-30T06:53:46.204884+0000","last_clean":"2024-05-30T06:53:46.204884+0000","last_became_active":"2024-05-30T06:53:45.202780+0000","last_became_peered":"2024-05-30T06:53:45.202780+0000","last_unstale":"2024-05-30T06:53:46.204884+0000","last_undegraded":"2024-05-30T06:53:46.204884+0000","last_fullsized":"2024-05-30T06:53:46.204884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:24.340830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.163557+0000","last_change":"2024-05-30T06:53:43.163557+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.163557+0000","last_undegraded":"2024-05-30T06:53:43.163557+0000","last_fullsized":"2024-05-30T06:53:43.163557+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.171709+0000","last_change":"2024-05-30T06:53:44.171709+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.171709+0000","last_undegraded":"2024-05-30T06:53:44.171709+0000","last_fullsized":"2024-05-30T06:53:44.171709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.185359+0000","last_change":"2024-05-30T06:53:44.179060+0000","last_active":"2024-05-30T06:53:44.185359+0000","last_peered":"2024-05-30T06:53:44.185359+0000","last_clean":"2024-05-30T06:53:44.185359+0000","last_became_active":"2024-05-30T06:53:44.178777+0000","last_became_peered":"2024-05-30T06:53:44.178777+0000","last_unstale":"2024-05-30T06:53:44.185359+0000","last_undegraded":"2024-05-30T06:53:44.185359+0000","last_fullsized":"2024-05-30T06:53:44.185359+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:06:19.143736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":86,"state":"creating+peering","last_fresh":"2024-05-30T06:53:44.168310+0000","last_change":"2024-05-30T06:53:44.168310+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.168310+0000","last_undegraded":"2024-05-30T06:53:44.168310+0000","last_fullsized":"2024-05-30T06:53:44.168310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":85,"state":"creating+peering","last_fresh":"2024-05-30T06:53:43.163585+0000","last_change":"2024-05-30T06:53:43.163585+0000","last_active":"2024-05-30T06:53:43.151673+0000","last_peered":"2024-05-30T06:53:43.151673+0000","last_clean":"2024-05-30T06:53:43.151673+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:43.163585+0000","last_undegraded":"2024-05-30T06:53:43.163585+0000","last_fullsized":"2024-05-30T06:53:43.163585+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-30T06:53:44.157032+0000","last_change":"2024-05-30T06:53:44.157032+0000","last_active":"2024-05-30T06:53:44.157032+0000","last_peered":"2024-05-30T06:53:44.157032+0000","last_clean":"2024-05-30T06:53:44.157032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:53:44.157032+0000","last_undegraded":"2024-05-30T06:53:44.157032+0000","last_fullsized":"2024-05-30T06:53:44.157032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.190906+0000","last_change":"2024-05-30T06:53:44.188978+0000","last_active":"2024-05-30T06:53:44.190906+0000","last_peered":"2024-05-30T06:53:44.190906+0000","last_clean":"2024-05-30T06:53:44.190906+0000","last_became_active":"2024-05-30T06:53:44.188093+0000","last_became_peered":"2024-05-30T06:53:44.188093+0000","last_unstale":"2024-05-30T06:53:44.190906+0000","last_undegraded":"2024-05-30T06:53:44.190906+0000","last_fullsized":"2024-05-30T06:53:44.190906+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:28:06.478699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":296,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-05-30T06:53:44.176377+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:53:44.176377+0000","last_peered":"2024-05-30T06:53:44.176377+0000","last_clean":"2024-05-30T06:53:44.176377+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:53:44.176377+0000","last_undegraded":"2024-05-30T06:53:44.176377+0000","last_fullsized":"2024-05-30T06:53:44.176377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":4},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100748,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271092,"statfs":{"total":96636764160,"available":96533598208,"internally_reserved":0,"allocated":1638400,"data_stored":1038721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101513674},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118220,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253620,"statfs":{"total":96636764160,"available":96515706880,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72392,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299448,"statfs":{"total":96636764160,"available":96562634752,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76564,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295276,"statfs":{"total":96636764160,"available":96558362624,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140480,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231360,"statfs":{"total":96636764160,"available":96492912640,"internally_reserved":0,"allocated":1093632,"data_stored":469399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":142735815},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100164,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271676,"statfs":{"total":96636764160,"available":96534196224,"internally_reserved":0,"allocated":1032192,"data_stored":442508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82120,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94289720,"statfs":{"total":96636764160,"available":96552673280,"internally_reserved":0,"allocated":1044480,"data_stored":448353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73020,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298820,"statfs":{"total":96636764160,"available":96561991680,"internally_reserved":0,"allocated":1679360,"data_stored":1058189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:53:53.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:53:54.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.102+0000 7f2ea6a00640 1 Processor -- start 2024-05-30T06:53:54.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.102+0000 7f2ea6a00640 1 -- start start 2024-05-30T06:53:54.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.106+0000 7f2ea6a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ea015f5e0 0x7f2ea00af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.106+0000 7f2ea6a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea00afe30 con 0x7f2ea00b2ec0 2024-05-30T06:53:54.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.106+0000 7f2ea6a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea006e210 con 0x7f2ea01482d0 2024-05-30T06:53:54.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.106+0000 7f2ea6a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea006e860 con 0x7f2ea015f5e0 2024-05-30T06:53:54.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.106+0000 7f2ea4a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ea015f5e0 0x7f2ea00af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.106+0000 7f2e97e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2ea00b2ec0 0x7f2ea015eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53466/0 (socket says 172.21.15.37:53466) 2024-05-30T06:53:54.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.106+0000 7f2e97e00640 1 -- 172.21.15.37:0/2772230726 learned_addr learned my addr 172.21.15.37:0/2772230726 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.106+0000 7f2ea4a00640 1 -- 172.21.15.37:0/2772230726 >> v1:172.21.15.105:6789/0 conn(0x7f2ea01482d0 legacy=0x7f2ea015ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.106+0000 7f2ea4a00640 1 -- 172.21.15.37:0/2772230726 >> v1:172.21.15.37:6789/0 conn(0x7f2ea00b2ec0 legacy=0x7f2ea015eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.106+0000 7f2ea4a00640 1 -- 172.21.15.37:0/2772230726 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea006e4f0 con 0x7f2ea015f5e0 2024-05-30T06:53:54.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.106+0000 7f2e9f400640 1 -- 172.21.15.37:0/2772230726 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4004487683 0 0) 0x7f2ea00afe30 con 0x7f2ea00b2ec0 2024-05-30T06:53:54.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.110+0000 7f2ea4a00640 1 --2- 172.21.15.37:0/2772230726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea015f5e0 0x7f2ea00af690 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009d90 tx=0x7f2e9801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66f03daeb23d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:54.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.110+0000 7f2e9f400640 1 -- 172.21.15.37:0/2772230726 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e980b2070 con 0x7f2ea015f5e0 2024-05-30T06:53:54.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.110+0000 7f2e9f400640 1 -- 172.21.15.37:0/2772230726 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e980a57a0 con 0x7f2ea015f5e0 2024-05-30T06:53:54.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.110+0000 7f2e9f400640 1 -- 172.21.15.37:0/2772230726 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e980a5b70 con 0x7f2ea015f5e0 2024-05-30T06:53:54.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.110+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2772230726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea015f5e0 msgr2=0x7f2ea00af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.110+0000 7f2ea6a00640 1 --2- 172.21.15.37:0/2772230726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea015f5e0 0x7f2ea00af690 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009d90 tx=0x7f2e9801c8e0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.110+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2772230726 shutdown_connections 2024-05-30T06:53:54.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.110+0000 7f2ea6a00640 1 --2- 172.21.15.37:0/2772230726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea015f5e0 0x7f2ea00af690 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.110+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2772230726 >> 172.21.15.37:0/2772230726 conn(0x7f2ea00b23a0 msgr2=0x7f2ea00b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:54.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.110+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2772230726 shutdown_connections 2024-05-30T06:53:54.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.110+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2772230726 wait complete. 2024-05-30T06:53:54.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.110+0000 7f2ea6a00640 1 Processor -- start 2024-05-30T06:53:54.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.110+0000 7f2ea6a00640 1 -- start start 2024-05-30T06:53:54.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2ea6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea00b2ec0 0x7f2ea015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2ea6a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ea01482d0 0x7f2ea015c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2ea6a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ea015f5e0 0x7f2ea015cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2ea6a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea006f8b0 con 0x7f2ea00b2ec0 2024-05-30T06:53:54.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2ea6a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea006f730 con 0x7f2ea01482d0 2024-05-30T06:53:54.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2ea6a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea00afbd0 con 0x7f2ea015f5e0 2024-05-30T06:53:54.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e9fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea00b2ec0 0x7f2ea015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e9fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea00b2ec0 0x7f2ea015c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56838/0 (socket says 172.21.15.37:56838) 2024-05-30T06:53:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e9fe00640 1 -- 172.21.15.37:0/2925189821 learned_addr learned my addr 172.21.15.37:0/2925189821 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2ea4a00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ea015f5e0 0x7f2ea015cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e97e00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ea01482d0 0x7f2ea015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e9fe00640 1 -- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ea015f5e0 msgr2=0x7f2ea015cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e9fe00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ea015f5e0 0x7f2ea015cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e9fe00640 1 -- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ea01482d0 msgr2=0x7f2ea015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e9fe00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ea01482d0 0x7f2ea015c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e9fe00640 1 -- 172.21.15.37:0/2925189821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea0139830 con 0x7f2ea00b2ec0 2024-05-30T06:53:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e97e00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ea01482d0 0x7f2ea015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e9fe00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea00b2ec0 0x7f2ea015c1d0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c500 tx=0x7f2e9000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e9cc00640 1 -- 172.21.15.37:0/2925189821 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90016020 con 0x7f2ea00b2ec0 2024-05-30T06:53:54.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e9cc00640 1 -- 172.21.15.37:0/2925189821 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e90005220 con 0x7f2ea00b2ec0 2024-05-30T06:53:54.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2925189821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea0139b10 con 0x7f2ea00b2ec0 2024-05-30T06:53:54.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e9cc00640 1 -- 172.21.15.37:0/2925189821 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90007030 con 0x7f2ea00b2ec0 2024-05-30T06:53:54.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2925189821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea013a3b0 con 0x7f2ea00b2ec0 2024-05-30T06:53:54.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2925189821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea013a5b0 con 0x7f2ea00b2ec0 2024-05-30T06:53:54.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.114+0000 7f2e9cc00640 1 -- 172.21.15.37:0/2925189821 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f2e900071f0 con 0x7f2ea00b2ec0 2024-05-30T06:53:54.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.118+0000 7f2e9cc00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2e7c069580 0x7f2e7c06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.118+0000 7f2e9cc00640 1 -- 172.21.15.37:0/2925189821 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f2e90085390 con 0x7f2ea00b2ec0 2024-05-30T06:53:54.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.118+0000 7f2e97e00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2e7c069580 0x7f2e7c06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.118+0000 7f2e97e00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2e7c069580 0x7f2e7c06ba40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2ea016a750 tx=0x7f2e88007c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:54.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.122+0000 7f2e9cc00640 1 -- 172.21.15.37:0/2925189821 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2ea013a5b0 con 0x7f2ea00b2ec0 2024-05-30T06:53:54.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.282+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2925189821 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ea015df10 con 0x7f2e7c069580 2024-05-30T06:53:54.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.290+0000 7f2e9cc00640 1 -- 172.21.15.37:0/2925189821 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252096 (secure 0 0 0) 0x7f2ea015df10 con 0x7f2e7c069580 2024-05-30T06:53:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:54.297 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:53:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.294+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2e7c069580 msgr2=0x7f2e7c06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.294+0000 7f2ea6a00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2e7c069580 0x7f2e7c06ba40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2ea016a750 tx=0x7f2e88007c60 comp rx=0 tx=0).stop 2024-05-30T06:53:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.294+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2925189821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea00b2ec0 msgr2=0x7f2ea015c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.294+0000 7f2ea6a00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea00b2ec0 0x7f2ea015c1d0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c500 tx=0x7f2e9000c9c0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.294+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2925189821 shutdown_connections 2024-05-30T06:53:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.294+0000 7f2ea6a00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ea015f5e0 0x7f2ea015cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.294+0000 7f2ea6a00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2e7c069580 0x7f2e7c06ba40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.294+0000 7f2ea6a00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ea01482d0 0x7f2ea015c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.294+0000 7f2ea6a00640 1 --2- 172.21.15.37:0/2925189821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea00b2ec0 0x7f2ea015c1d0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.294+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2925189821 >> 172.21.15.37:0/2925189821 conn(0x7f2ea00b23a0 msgr2=0x7f2ea00b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.294+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2925189821 shutdown_connections 2024-05-30T06:53:54.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.294+0000 7f2ea6a00640 1 -- 172.21.15.37:0/2925189821 wait complete. 2024-05-30T06:53:54.316 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":440,"stamp":"2024-05-30T06:53:53.552746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":763968,"kb_used_data":9672,"kb_used_omap":12,"kb_used_meta":754163,"kb_avail":754210752,"statfs":{"total":773094113280,"available":772311810048,"internally_reserved":0,"allocated":9904128,"data_stored":4927852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":772263472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.357605"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035609+0000","last_change":"2024-05-30T06:53:45.219406+0000","last_active":"2024-05-30T06:53:47.035609+0000","last_peered":"2024-05-30T06:53:47.035609+0000","last_clean":"2024-05-30T06:53:47.035609+0000","last_became_active":"2024-05-30T06:53:45.219197+0000","last_became_peered":"2024-05-30T06:53:45.219197+0000","last_unstale":"2024-05-30T06:53:47.035609+0000","last_undegraded":"2024-05-30T06:53:47.035609+0000","last_fullsized":"2024-05-30T06:53:47.035609+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:52:13.671176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202673+0000","last_change":"2024-05-30T06:53:45.201949+0000","last_active":"2024-05-30T06:53:46.202673+0000","last_peered":"2024-05-30T06:53:46.202673+0000","last_clean":"2024-05-30T06:53:46.202673+0000","last_became_active":"2024-05-30T06:53:45.201670+0000","last_became_peered":"2024-05-30T06:53:45.201670+0000","last_unstale":"2024-05-30T06:53:46.202673+0000","last_undegraded":"2024-05-30T06:53:46.202673+0000","last_fullsized":"2024-05-30T06:53:46.202673+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:10:20.462528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035272+0000","last_change":"2024-05-30T06:53:45.210128+0000","last_active":"2024-05-30T06:53:47.035272+0000","last_peered":"2024-05-30T06:53:47.035272+0000","last_clean":"2024-05-30T06:53:47.035272+0000","last_became_active":"2024-05-30T06:53:45.209868+0000","last_became_peered":"2024-05-30T06:53:45.209868+0000","last_unstale":"2024-05-30T06:53:47.035272+0000","last_undegraded":"2024-05-30T06:53:47.035272+0000","last_fullsized":"2024-05-30T06:53:47.035272+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:44:51.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.032808+0000","last_change":"2024-05-30T06:53:45.205076+0000","last_active":"2024-05-30T06:53:47.032808+0000","last_peered":"2024-05-30T06:53:47.032808+0000","last_clean":"2024-05-30T06:53:47.032808+0000","last_became_active":"2024-05-30T06:53:45.204803+0000","last_became_peered":"2024-05-30T06:53:45.204803+0000","last_unstale":"2024-05-30T06:53:47.032808+0000","last_undegraded":"2024-05-30T06:53:47.032808+0000","last_fullsized":"2024-05-30T06:53:47.032808+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:44:46.793086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197460+0000","last_change":"2024-05-30T06:53:45.192901+0000","last_active":"2024-05-30T06:53:46.197460+0000","last_peered":"2024-05-30T06:53:46.197460+0000","last_clean":"2024-05-30T06:53:46.197460+0000","last_became_active":"2024-05-30T06:53:45.192633+0000","last_became_peered":"2024-05-30T06:53:45.192633+0000","last_unstale":"2024-05-30T06:53:46.197460+0000","last_undegraded":"2024-05-30T06:53:46.197460+0000","last_fullsized":"2024-05-30T06:53:46.197460+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:52:13.671176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197428+0000","last_change":"2024-05-30T06:53:45.211851+0000","last_active":"2024-05-30T06:53:46.197428+0000","last_peered":"2024-05-30T06:53:46.197428+0000","last_clean":"2024-05-30T06:53:46.197428+0000","last_became_active":"2024-05-30T06:53:45.211564+0000","last_became_peered":"2024-05-30T06:53:45.211564+0000","last_unstale":"2024-05-30T06:53:46.197428+0000","last_undegraded":"2024-05-30T06:53:46.197428+0000","last_fullsized":"2024-05-30T06:53:46.197428+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:00:25.498984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.032374+0000","last_change":"2024-05-30T06:53:45.204293+0000","last_active":"2024-05-30T06:53:47.032374+0000","last_peered":"2024-05-30T06:53:47.032374+0000","last_clean":"2024-05-30T06:53:47.032374+0000","last_became_active":"2024-05-30T06:53:45.203992+0000","last_became_peered":"2024-05-30T06:53:45.203992+0000","last_unstale":"2024-05-30T06:53:47.032374+0000","last_undegraded":"2024-05-30T06:53:47.032374+0000","last_fullsized":"2024-05-30T06:53:47.032374+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:50:57.139153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.196807+0000","last_change":"2024-05-30T06:53:45.213748+0000","last_active":"2024-05-30T06:53:46.196807+0000","last_peered":"2024-05-30T06:53:46.196807+0000","last_clean":"2024-05-30T06:53:46.196807+0000","last_became_active":"2024-05-30T06:53:45.213474+0000","last_became_peered":"2024-05-30T06:53:45.213474+0000","last_unstale":"2024-05-30T06:53:46.196807+0000","last_undegraded":"2024-05-30T06:53:46.196807+0000","last_fullsized":"2024-05-30T06:53:46.196807+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:35:16.095617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.196937+0000","last_change":"2024-05-30T06:53:45.203584+0000","last_active":"2024-05-30T06:53:46.196937+0000","last_peered":"2024-05-30T06:53:46.196937+0000","last_clean":"2024-05-30T06:53:46.196937+0000","last_became_active":"2024-05-30T06:53:45.203288+0000","last_became_peered":"2024-05-30T06:53:45.203288+0000","last_unstale":"2024-05-30T06:53:46.196937+0000","last_undegraded":"2024-05-30T06:53:46.196937+0000","last_fullsized":"2024-05-30T06:53:46.196937+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:28:07.484058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035336+0000","last_change":"2024-05-30T06:53:45.206165+0000","last_active":"2024-05-30T06:53:47.035336+0000","last_peered":"2024-05-30T06:53:47.035336+0000","last_clean":"2024-05-30T06:53:47.035336+0000","last_became_active":"2024-05-30T06:53:45.203881+0000","last_became_peered":"2024-05-30T06:53:45.203881+0000","last_unstale":"2024-05-30T06:53:47.035336+0000","last_undegraded":"2024-05-30T06:53:47.035336+0000","last_fullsized":"2024-05-30T06:53:47.035336+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:42:07.585320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202584+0000","last_change":"2024-05-30T06:53:45.197779+0000","last_active":"2024-05-30T06:53:46.202584+0000","last_peered":"2024-05-30T06:53:46.202584+0000","last_clean":"2024-05-30T06:53:46.202584+0000","last_became_active":"2024-05-30T06:53:45.197508+0000","last_became_peered":"2024-05-30T06:53:45.197508+0000","last_unstale":"2024-05-30T06:53:46.202584+0000","last_undegraded":"2024-05-30T06:53:46.202584+0000","last_fullsized":"2024-05-30T06:53:46.202584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:12:22.025268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035030+0000","last_change":"2024-05-30T06:53:45.207388+0000","last_active":"2024-05-30T06:53:47.035030+0000","last_peered":"2024-05-30T06:53:47.035030+0000","last_clean":"2024-05-30T06:53:47.035030+0000","last_became_active":"2024-05-30T06:53:45.207029+0000","last_became_peered":"2024-05-30T06:53:45.207029+0000","last_unstale":"2024-05-30T06:53:47.035030+0000","last_undegraded":"2024-05-30T06:53:47.035030+0000","last_fullsized":"2024-05-30T06:53:47.035030+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:28:50.187360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035293+0000","last_change":"2024-05-30T06:53:45.220060+0000","last_active":"2024-05-30T06:53:47.035293+0000","last_peered":"2024-05-30T06:53:47.035293+0000","last_clean":"2024-05-30T06:53:47.035293+0000","last_became_active":"2024-05-30T06:53:45.219790+0000","last_became_peered":"2024-05-30T06:53:45.219790+0000","last_unstale":"2024-05-30T06:53:47.035293+0000","last_undegraded":"2024-05-30T06:53:47.035293+0000","last_fullsized":"2024-05-30T06:53:47.035293+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:28.370644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.032481+0000","last_change":"2024-05-30T06:53:45.206431+0000","last_active":"2024-05-30T06:53:47.032481+0000","last_peered":"2024-05-30T06:53:47.032481+0000","last_clean":"2024-05-30T06:53:47.032481+0000","last_became_active":"2024-05-30T06:53:45.205869+0000","last_became_peered":"2024-05-30T06:53:45.205869+0000","last_unstale":"2024-05-30T06:53:47.032481+0000","last_undegraded":"2024-05-30T06:53:47.032481+0000","last_fullsized":"2024-05-30T06:53:47.032481+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:45:32.477905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192824+0000","last_change":"2024-05-30T06:53:45.198790+0000","last_active":"2024-05-30T06:53:46.192824+0000","last_peered":"2024-05-30T06:53:46.192824+0000","last_clean":"2024-05-30T06:53:46.192824+0000","last_became_active":"2024-05-30T06:53:45.198496+0000","last_became_peered":"2024-05-30T06:53:45.198496+0000","last_unstale":"2024-05-30T06:53:46.192824+0000","last_undegraded":"2024-05-30T06:53:46.192824+0000","last_fullsized":"2024-05-30T06:53:46.192824+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:19:48.656142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197214+0000","last_change":"2024-05-30T06:53:45.207663+0000","last_active":"2024-05-30T06:53:46.197214+0000","last_peered":"2024-05-30T06:53:46.197214+0000","last_clean":"2024-05-30T06:53:46.197214+0000","last_became_active":"2024-05-30T06:53:45.204564+0000","last_became_peered":"2024-05-30T06:53:45.204564+0000","last_unstale":"2024-05-30T06:53:46.197214+0000","last_undegraded":"2024-05-30T06:53:46.197214+0000","last_fullsized":"2024-05-30T06:53:46.197214+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:42:07.585320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197963+0000","last_change":"2024-05-30T06:53:45.212184+0000","last_active":"2024-05-30T06:53:46.197963+0000","last_peered":"2024-05-30T06:53:46.197963+0000","last_clean":"2024-05-30T06:53:46.197963+0000","last_became_active":"2024-05-30T06:53:45.209359+0000","last_became_peered":"2024-05-30T06:53:45.209359+0000","last_unstale":"2024-05-30T06:53:46.197963+0000","last_undegraded":"2024-05-30T06:53:46.197963+0000","last_fullsized":"2024-05-30T06:53:46.197963+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:35:16.095617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.032868+0000","last_change":"2024-05-30T06:53:45.202547+0000","last_active":"2024-05-30T06:53:47.032868+0000","last_peered":"2024-05-30T06:53:47.032868+0000","last_clean":"2024-05-30T06:53:47.032868+0000","last_became_active":"2024-05-30T06:53:45.202101+0000","last_became_peered":"2024-05-30T06:53:45.202101+0000","last_unstale":"2024-05-30T06:53:47.032868+0000","last_undegraded":"2024-05-30T06:53:47.032868+0000","last_fullsized":"2024-05-30T06:53:47.032868+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:27:39.656017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.205025+0000","last_change":"2024-05-30T06:53:45.203371+0000","last_active":"2024-05-30T06:53:46.205025+0000","last_peered":"2024-05-30T06:53:46.205025+0000","last_clean":"2024-05-30T06:53:46.205025+0000","last_became_active":"2024-05-30T06:53:45.202893+0000","last_became_peered":"2024-05-30T06:53:45.202893+0000","last_unstale":"2024-05-30T06:53:46.205025+0000","last_undegraded":"2024-05-30T06:53:46.205025+0000","last_fullsized":"2024-05-30T06:53:46.205025+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:54:48.071424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.032962+0000","last_change":"2024-05-30T06:53:45.202078+0000","last_active":"2024-05-30T06:53:47.032962+0000","last_peered":"2024-05-30T06:53:47.032962+0000","last_clean":"2024-05-30T06:53:47.032962+0000","last_became_active":"2024-05-30T06:53:45.201826+0000","last_became_peered":"2024-05-30T06:53:45.201826+0000","last_unstale":"2024-05-30T06:53:47.032962+0000","last_undegraded":"2024-05-30T06:53:47.032962+0000","last_fullsized":"2024-05-30T06:53:47.032962+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:12:51.929424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.032597+0000","last_change":"2024-05-30T06:53:45.203692+0000","last_active":"2024-05-30T06:53:47.032597+0000","last_peered":"2024-05-30T06:53:47.032597+0000","last_clean":"2024-05-30T06:53:47.032597+0000","last_became_active":"2024-05-30T06:53:45.203343+0000","last_became_peered":"2024-05-30T06:53:45.203343+0000","last_unstale":"2024-05-30T06:53:47.032597+0000","last_undegraded":"2024-05-30T06:53:47.032597+0000","last_fullsized":"2024-05-30T06:53:47.032597+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:51.364538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202184+0000","last_change":"2024-05-30T06:53:45.191870+0000","last_active":"2024-05-30T06:53:46.202184+0000","last_peered":"2024-05-30T06:53:46.202184+0000","last_clean":"2024-05-30T06:53:46.202184+0000","last_became_active":"2024-05-30T06:53:45.191260+0000","last_became_peered":"2024-05-30T06:53:45.191260+0000","last_unstale":"2024-05-30T06:53:46.202184+0000","last_undegraded":"2024-05-30T06:53:46.202184+0000","last_fullsized":"2024-05-30T06:53:46.202184+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:01:33.581477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.034965+0000","last_change":"2024-05-30T06:53:45.201144+0000","last_active":"2024-05-30T06:53:47.034965+0000","last_peered":"2024-05-30T06:53:47.034965+0000","last_clean":"2024-05-30T06:53:47.034965+0000","last_became_active":"2024-05-30T06:53:45.200877+0000","last_became_peered":"2024-05-30T06:53:45.200877+0000","last_unstale":"2024-05-30T06:53:47.034965+0000","last_undegraded":"2024-05-30T06:53:47.034965+0000","last_fullsized":"2024-05-30T06:53:47.034965+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:46:34.421446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.032243+0000","last_change":"2024-05-30T06:53:45.205261+0000","last_active":"2024-05-30T06:53:47.032243+0000","last_peered":"2024-05-30T06:53:47.032243+0000","last_clean":"2024-05-30T06:53:47.032243+0000","last_became_active":"2024-05-30T06:53:45.204928+0000","last_became_peered":"2024-05-30T06:53:45.204928+0000","last_unstale":"2024-05-30T06:53:47.032243+0000","last_undegraded":"2024-05-30T06:53:47.032243+0000","last_fullsized":"2024-05-30T06:53:47.032243+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:05:11.058223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202623+0000","last_change":"2024-05-30T06:53:45.204674+0000","last_active":"2024-05-30T06:53:46.202623+0000","last_peered":"2024-05-30T06:53:46.202623+0000","last_clean":"2024-05-30T06:53:46.202623+0000","last_became_active":"2024-05-30T06:53:45.201315+0000","last_became_peered":"2024-05-30T06:53:45.201315+0000","last_unstale":"2024-05-30T06:53:46.202623+0000","last_undegraded":"2024-05-30T06:53:46.202623+0000","last_fullsized":"2024-05-30T06:53:46.202623+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:42:05.255662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.036055+0000","last_change":"2024-05-30T06:53:45.199690+0000","last_active":"2024-05-30T06:53:47.036055+0000","last_peered":"2024-05-30T06:53:47.036055+0000","last_clean":"2024-05-30T06:53:47.036055+0000","last_became_active":"2024-05-30T06:53:45.199376+0000","last_became_peered":"2024-05-30T06:53:45.199376+0000","last_unstale":"2024-05-30T06:53:47.036055+0000","last_undegraded":"2024-05-30T06:53:47.036055+0000","last_fullsized":"2024-05-30T06:53:47.036055+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:33:14.418616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197747+0000","last_change":"2024-05-30T06:53:45.197568+0000","last_active":"2024-05-30T06:53:46.197747+0000","last_peered":"2024-05-30T06:53:46.197747+0000","last_clean":"2024-05-30T06:53:46.197747+0000","last_became_active":"2024-05-30T06:53:45.196913+0000","last_became_peered":"2024-05-30T06:53:45.196913+0000","last_unstale":"2024-05-30T06:53:46.197747+0000","last_undegraded":"2024-05-30T06:53:46.197747+0000","last_fullsized":"2024-05-30T06:53:46.197747+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:16:38.227360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035208+0000","last_change":"2024-05-30T06:53:45.215045+0000","last_active":"2024-05-30T06:53:47.035208+0000","last_peered":"2024-05-30T06:53:47.035208+0000","last_clean":"2024-05-30T06:53:47.035208+0000","last_became_active":"2024-05-30T06:53:45.214679+0000","last_became_peered":"2024-05-30T06:53:45.214679+0000","last_unstale":"2024-05-30T06:53:47.035208+0000","last_undegraded":"2024-05-30T06:53:47.035208+0000","last_fullsized":"2024-05-30T06:53:47.035208+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:51:55.105636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202306+0000","last_change":"2024-05-30T06:53:45.202939+0000","last_active":"2024-05-30T06:53:46.202306+0000","last_peered":"2024-05-30T06:53:46.202306+0000","last_clean":"2024-05-30T06:53:46.202306+0000","last_became_active":"2024-05-30T06:53:45.201799+0000","last_became_peered":"2024-05-30T06:53:45.201799+0000","last_unstale":"2024-05-30T06:53:46.202306+0000","last_undegraded":"2024-05-30T06:53:46.202306+0000","last_fullsized":"2024-05-30T06:53:46.202306+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:28:14.799072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202197+0000","last_change":"2024-05-30T06:53:45.208849+0000","last_active":"2024-05-30T06:53:46.202197+0000","last_peered":"2024-05-30T06:53:46.202197+0000","last_clean":"2024-05-30T06:53:46.202197+0000","last_became_active":"2024-05-30T06:53:45.208489+0000","last_became_peered":"2024-05-30T06:53:45.208489+0000","last_unstale":"2024-05-30T06:53:46.202197+0000","last_undegraded":"2024-05-30T06:53:46.202197+0000","last_fullsized":"2024-05-30T06:53:46.202197+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:04:31.648766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197406+0000","last_change":"2024-05-30T06:53:45.198899+0000","last_active":"2024-05-30T06:53:46.197406+0000","last_peered":"2024-05-30T06:53:46.197406+0000","last_clean":"2024-05-30T06:53:46.197406+0000","last_became_active":"2024-05-30T06:53:45.196321+0000","last_became_peered":"2024-05-30T06:53:45.196321+0000","last_unstale":"2024-05-30T06:53:46.197406+0000","last_undegraded":"2024-05-30T06:53:46.197406+0000","last_fullsized":"2024-05-30T06:53:46.197406+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:44.530062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.034865+0000","last_change":"2024-05-30T06:53:45.204417+0000","last_active":"2024-05-30T06:53:47.034865+0000","last_peered":"2024-05-30T06:53:47.034865+0000","last_clean":"2024-05-30T06:53:47.034865+0000","last_became_active":"2024-05-30T06:53:45.204100+0000","last_became_peered":"2024-05-30T06:53:45.204100+0000","last_unstale":"2024-05-30T06:53:47.034865+0000","last_undegraded":"2024-05-30T06:53:47.034865+0000","last_fullsized":"2024-05-30T06:53:47.034865+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:49:16.973176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197868+0000","last_change":"2024-05-30T06:53:45.206492+0000","last_active":"2024-05-30T06:53:46.197868+0000","last_peered":"2024-05-30T06:53:46.197868+0000","last_clean":"2024-05-30T06:53:46.197868+0000","last_became_active":"2024-05-30T06:53:45.205121+0000","last_became_peered":"2024-05-30T06:53:45.205121+0000","last_unstale":"2024-05-30T06:53:46.197868+0000","last_undegraded":"2024-05-30T06:53:46.197868+0000","last_fullsized":"2024-05-30T06:53:46.197868+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:44.628526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"87'4","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035581+0000","last_change":"2024-05-30T06:53:44.182937+0000","last_active":"2024-05-30T06:53:47.035581+0000","last_peered":"2024-05-30T06:53:47.035581+0000","last_clean":"2024-05-30T06:53:47.035581+0000","last_became_active":"2024-05-30T06:53:44.182611+0000","last_became_peered":"2024-05-30T06:53:44.182611+0000","last_unstale":"2024-05-30T06:53:47.035581+0000","last_undegraded":"2024-05-30T06:53:47.035581+0000","last_fullsized":"2024-05-30T06:53:47.035581+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:44:30.416914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035330+0000","last_change":"2024-05-30T06:53:45.204328+0000","last_active":"2024-05-30T06:53:47.035330+0000","last_peered":"2024-05-30T06:53:47.035330+0000","last_clean":"2024-05-30T06:53:47.035330+0000","last_became_active":"2024-05-30T06:53:45.204028+0000","last_became_peered":"2024-05-30T06:53:45.204028+0000","last_unstale":"2024-05-30T06:53:47.035330+0000","last_undegraded":"2024-05-30T06:53:47.035330+0000","last_fullsized":"2024-05-30T06:53:47.035330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:41:26.179442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.198120+0000","last_change":"2024-05-30T06:53:44.186109+0000","last_active":"2024-05-30T06:53:46.198120+0000","last_peered":"2024-05-30T06:53:46.198120+0000","last_clean":"2024-05-30T06:53:46.198120+0000","last_became_active":"2024-05-30T06:53:44.185827+0000","last_became_peered":"2024-05-30T06:53:44.185827+0000","last_unstale":"2024-05-30T06:53:46.198120+0000","last_undegraded":"2024-05-30T06:53:46.198120+0000","last_fullsized":"2024-05-30T06:53:46.198120+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:06:25.010869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035870+0000","last_change":"2024-05-30T06:53:45.207248+0000","last_active":"2024-05-30T06:53:47.035870+0000","last_peered":"2024-05-30T06:53:47.035870+0000","last_clean":"2024-05-30T06:53:47.035870+0000","last_became_active":"2024-05-30T06:53:45.206453+0000","last_became_peered":"2024-05-30T06:53:45.206453+0000","last_unstale":"2024-05-30T06:53:47.035870+0000","last_undegraded":"2024-05-30T06:53:47.035870+0000","last_fullsized":"2024-05-30T06:53:47.035870+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:16:38.227360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204932+0000","last_change":"2024-05-30T06:53:44.180212+0000","last_active":"2024-05-30T06:53:46.204932+0000","last_peered":"2024-05-30T06:53:46.204932+0000","last_clean":"2024-05-30T06:53:46.204932+0000","last_became_active":"2024-05-30T06:53:44.179929+0000","last_became_peered":"2024-05-30T06:53:44.179929+0000","last_unstale":"2024-05-30T06:53:46.204932+0000","last_undegraded":"2024-05-30T06:53:46.204932+0000","last_fullsized":"2024-05-30T06:53:46.204932+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:11:30.173203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035554+0000","last_change":"2024-05-30T06:53:45.207180+0000","last_active":"2024-05-30T06:53:47.035554+0000","last_peered":"2024-05-30T06:53:47.035554+0000","last_clean":"2024-05-30T06:53:47.035554+0000","last_became_active":"2024-05-30T06:53:45.206871+0000","last_became_peered":"2024-05-30T06:53:45.206871+0000","last_unstale":"2024-05-30T06:53:47.035554+0000","last_undegraded":"2024-05-30T06:53:47.035554+0000","last_fullsized":"2024-05-30T06:53:47.035554+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:40:24.154222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204772+0000","last_change":"2024-05-30T06:53:44.180631+0000","last_active":"2024-05-30T06:53:46.204772+0000","last_peered":"2024-05-30T06:53:46.204772+0000","last_clean":"2024-05-30T06:53:46.204772+0000","last_became_active":"2024-05-30T06:53:44.180328+0000","last_became_peered":"2024-05-30T06:53:44.180328+0000","last_unstale":"2024-05-30T06:53:46.204772+0000","last_undegraded":"2024-05-30T06:53:46.204772+0000","last_fullsized":"2024-05-30T06:53:46.204772+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:43.524704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202366+0000","last_change":"2024-05-30T06:53:45.208799+0000","last_active":"2024-05-30T06:53:46.202366+0000","last_peered":"2024-05-30T06:53:46.202366+0000","last_clean":"2024-05-30T06:53:46.202366+0000","last_became_active":"2024-05-30T06:53:45.208423+0000","last_became_peered":"2024-05-30T06:53:45.208423+0000","last_unstale":"2024-05-30T06:53:46.202366+0000","last_undegraded":"2024-05-30T06:53:46.202366+0000","last_fullsized":"2024-05-30T06:53:46.202366+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:28:44.255495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197751+0000","last_change":"2024-05-30T06:53:44.189631+0000","last_active":"2024-05-30T06:53:46.197751+0000","last_peered":"2024-05-30T06:53:46.197751+0000","last_clean":"2024-05-30T06:53:46.197751+0000","last_became_active":"2024-05-30T06:53:44.189303+0000","last_became_peered":"2024-05-30T06:53:44.189303+0000","last_unstale":"2024-05-30T06:53:46.197751+0000","last_undegraded":"2024-05-30T06:53:46.197751+0000","last_fullsized":"2024-05-30T06:53:46.197751+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:54:58.109697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.198287+0000","last_change":"2024-05-30T06:53:45.216697+0000","last_active":"2024-05-30T06:53:46.198287+0000","last_peered":"2024-05-30T06:53:46.198287+0000","last_clean":"2024-05-30T06:53:46.198287+0000","last_became_active":"2024-05-30T06:53:45.212976+0000","last_became_peered":"2024-05-30T06:53:45.212976+0000","last_unstale":"2024-05-30T06:53:46.198287+0000","last_undegraded":"2024-05-30T06:53:46.198287+0000","last_fullsized":"2024-05-30T06:53:46.198287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:13:52.992397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197908+0000","last_change":"2024-05-30T06:53:44.184928+0000","last_active":"2024-05-30T06:53:46.197908+0000","last_peered":"2024-05-30T06:53:46.197908+0000","last_clean":"2024-05-30T06:53:46.197908+0000","last_became_active":"2024-05-30T06:53:44.184643+0000","last_became_peered":"2024-05-30T06:53:44.184643+0000","last_unstale":"2024-05-30T06:53:46.197908+0000","last_undegraded":"2024-05-30T06:53:46.197908+0000","last_fullsized":"2024-05-30T06:53:46.197908+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:48:47.371451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.034781+0000","last_change":"2024-05-30T06:53:45.199532+0000","last_active":"2024-05-30T06:53:47.034781+0000","last_peered":"2024-05-30T06:53:47.034781+0000","last_clean":"2024-05-30T06:53:47.034781+0000","last_became_active":"2024-05-30T06:53:45.199091+0000","last_became_peered":"2024-05-30T06:53:45.199091+0000","last_unstale":"2024-05-30T06:53:47.034781+0000","last_undegraded":"2024-05-30T06:53:47.034781+0000","last_fullsized":"2024-05-30T06:53:47.034781+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:42:09.493101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204593+0000","last_change":"2024-05-30T06:53:44.183688+0000","last_active":"2024-05-30T06:53:46.204593+0000","last_peered":"2024-05-30T06:53:46.204593+0000","last_clean":"2024-05-30T06:53:46.204593+0000","last_became_active":"2024-05-30T06:53:44.183409+0000","last_became_peered":"2024-05-30T06:53:44.183409+0000","last_unstale":"2024-05-30T06:53:46.204593+0000","last_undegraded":"2024-05-30T06:53:46.204593+0000","last_fullsized":"2024-05-30T06:53:46.204593+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:42:06.579962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192838+0000","last_change":"2024-05-30T06:53:45.198210+0000","last_active":"2024-05-30T06:53:46.192838+0000","last_peered":"2024-05-30T06:53:46.192838+0000","last_clean":"2024-05-30T06:53:46.192838+0000","last_became_active":"2024-05-30T06:53:45.197947+0000","last_became_peered":"2024-05-30T06:53:45.197947+0000","last_unstale":"2024-05-30T06:53:46.192838+0000","last_undegraded":"2024-05-30T06:53:46.192838+0000","last_fullsized":"2024-05-30T06:53:46.192838+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:31.917254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202056+0000","last_change":"2024-05-30T06:53:44.188817+0000","last_active":"2024-05-30T06:53:46.202056+0000","last_peered":"2024-05-30T06:53:46.202056+0000","last_clean":"2024-05-30T06:53:46.202056+0000","last_became_active":"2024-05-30T06:53:44.188550+0000","last_became_peered":"2024-05-30T06:53:44.188550+0000","last_unstale":"2024-05-30T06:53:46.202056+0000","last_undegraded":"2024-05-30T06:53:46.202056+0000","last_fullsized":"2024-05-30T06:53:46.202056+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:41.580725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.193239+0000","last_change":"2024-05-30T06:53:45.192238+0000","last_active":"2024-05-30T06:53:46.193239+0000","last_peered":"2024-05-30T06:53:46.193239+0000","last_clean":"2024-05-30T06:53:46.193239+0000","last_became_active":"2024-05-30T06:53:45.191951+0000","last_became_peered":"2024-05-30T06:53:45.191951+0000","last_unstale":"2024-05-30T06:53:46.193239+0000","last_undegraded":"2024-05-30T06:53:46.193239+0000","last_fullsized":"2024-05-30T06:53:46.193239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:35:54.540262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035683+0000","last_change":"2024-05-30T06:53:44.178845+0000","last_active":"2024-05-30T06:53:47.035683+0000","last_peered":"2024-05-30T06:53:47.035683+0000","last_clean":"2024-05-30T06:53:47.035683+0000","last_became_active":"2024-05-30T06:53:44.178561+0000","last_became_peered":"2024-05-30T06:53:44.178561+0000","last_unstale":"2024-05-30T06:53:47.035683+0000","last_undegraded":"2024-05-30T06:53:47.035683+0000","last_fullsized":"2024-05-30T06:53:47.035683+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:26:01.166600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197248+0000","last_change":"2024-05-30T06:53:45.211209+0000","last_active":"2024-05-30T06:53:46.197248+0000","last_peered":"2024-05-30T06:53:46.197248+0000","last_clean":"2024-05-30T06:53:46.197248+0000","last_became_active":"2024-05-30T06:53:45.210938+0000","last_became_peered":"2024-05-30T06:53:45.210938+0000","last_unstale":"2024-05-30T06:53:46.197248+0000","last_undegraded":"2024-05-30T06:53:46.197248+0000","last_fullsized":"2024-05-30T06:53:46.197248+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:13:52.992397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035436+0000","last_change":"2024-05-30T06:53:44.187386+0000","last_active":"2024-05-30T06:53:47.035436+0000","last_peered":"2024-05-30T06:53:47.035436+0000","last_clean":"2024-05-30T06:53:47.035436+0000","last_became_active":"2024-05-30T06:53:44.187038+0000","last_became_peered":"2024-05-30T06:53:44.187038+0000","last_unstale":"2024-05-30T06:53:47.035436+0000","last_undegraded":"2024-05-30T06:53:47.035436+0000","last_fullsized":"2024-05-30T06:53:47.035436+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:10:19.457170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204881+0000","last_change":"2024-05-30T06:53:45.201568+0000","last_active":"2024-05-30T06:53:46.204881+0000","last_peered":"2024-05-30T06:53:46.204881+0000","last_clean":"2024-05-30T06:53:46.204881+0000","last_became_active":"2024-05-30T06:53:45.201291+0000","last_became_peered":"2024-05-30T06:53:45.201291+0000","last_unstale":"2024-05-30T06:53:46.204881+0000","last_undegraded":"2024-05-30T06:53:46.204881+0000","last_fullsized":"2024-05-30T06:53:46.204881+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:27:56.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"87'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.036012+0000","last_change":"2024-05-30T06:53:44.186134+0000","last_active":"2024-05-30T06:53:47.036012+0000","last_peered":"2024-05-30T06:53:47.036012+0000","last_clean":"2024-05-30T06:53:47.036012+0000","last_became_active":"2024-05-30T06:53:44.185863+0000","last_became_peered":"2024-05-30T06:53:44.185863+0000","last_unstale":"2024-05-30T06:53:47.036012+0000","last_undegraded":"2024-05-30T06:53:47.036012+0000","last_fullsized":"2024-05-30T06:53:47.036012+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:13:00.659078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197930+0000","last_change":"2024-05-30T06:53:45.198962+0000","last_active":"2024-05-30T06:53:46.197930+0000","last_peered":"2024-05-30T06:53:46.197930+0000","last_clean":"2024-05-30T06:53:46.197930+0000","last_became_active":"2024-05-30T06:53:45.198693+0000","last_became_peered":"2024-05-30T06:53:45.198693+0000","last_unstale":"2024-05-30T06:53:46.197930+0000","last_undegraded":"2024-05-30T06:53:46.197930+0000","last_fullsized":"2024-05-30T06:53:46.197930+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:11:31.178561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"87'6","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197081+0000","last_change":"2024-05-30T06:53:44.188486+0000","last_active":"2024-05-30T06:53:46.197081+0000","last_peered":"2024-05-30T06:53:46.197081+0000","last_clean":"2024-05-30T06:53:46.197081+0000","last_became_active":"2024-05-30T06:53:44.186298+0000","last_became_peered":"2024-05-30T06:53:44.186298+0000","last_unstale":"2024-05-30T06:53:46.197081+0000","last_undegraded":"2024-05-30T06:53:46.197081+0000","last_fullsized":"2024-05-30T06:53:46.197081+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:51:54.100278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204610+0000","last_change":"2024-05-30T06:53:45.205031+0000","last_active":"2024-05-30T06:53:46.204610+0000","last_peered":"2024-05-30T06:53:46.204610+0000","last_clean":"2024-05-30T06:53:46.204610+0000","last_became_active":"2024-05-30T06:53:45.203028+0000","last_became_peered":"2024-05-30T06:53:45.203028+0000","last_unstale":"2024-05-30T06:53:46.204610+0000","last_undegraded":"2024-05-30T06:53:46.204610+0000","last_fullsized":"2024-05-30T06:53:46.204610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:00:25.498984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202212+0000","last_change":"2024-05-30T06:53:44.182557+0000","last_active":"2024-05-30T06:53:46.202212+0000","last_peered":"2024-05-30T06:53:46.202212+0000","last_clean":"2024-05-30T06:53:46.202212+0000","last_became_active":"2024-05-30T06:53:44.182251+0000","last_became_peered":"2024-05-30T06:53:44.182251+0000","last_unstale":"2024-05-30T06:53:46.202212+0000","last_undegraded":"2024-05-30T06:53:46.202212+0000","last_fullsized":"2024-05-30T06:53:46.202212+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:54:24.798991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035489+0000","last_change":"2024-05-30T06:53:45.202342+0000","last_active":"2024-05-30T06:53:47.035489+0000","last_peered":"2024-05-30T06:53:47.035489+0000","last_clean":"2024-05-30T06:53:47.035489+0000","last_became_active":"2024-05-30T06:53:45.202070+0000","last_became_peered":"2024-05-30T06:53:45.202070+0000","last_unstale":"2024-05-30T06:53:47.035489+0000","last_undegraded":"2024-05-30T06:53:47.035489+0000","last_fullsized":"2024-05-30T06:53:47.035489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:58:31.089278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192837+0000","last_change":"2024-05-30T06:53:44.187226+0000","last_active":"2024-05-30T06:53:46.192837+0000","last_peered":"2024-05-30T06:53:46.192837+0000","last_clean":"2024-05-30T06:53:46.192837+0000","last_became_active":"2024-05-30T06:53:44.182670+0000","last_became_peered":"2024-05-30T06:53:44.182670+0000","last_unstale":"2024-05-30T06:53:46.192837+0000","last_undegraded":"2024-05-30T06:53:46.192837+0000","last_fullsized":"2024-05-30T06:53:46.192837+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:33:13.413258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202088+0000","last_change":"2024-05-30T06:53:45.208945+0000","last_active":"2024-05-30T06:53:46.202088+0000","last_peered":"2024-05-30T06:53:46.202088+0000","last_clean":"2024-05-30T06:53:46.202088+0000","last_became_active":"2024-05-30T06:53:45.207959+0000","last_became_peered":"2024-05-30T06:53:45.207959+0000","last_unstale":"2024-05-30T06:53:46.202088+0000","last_undegraded":"2024-05-30T06:53:46.202088+0000","last_fullsized":"2024-05-30T06:53:46.202088+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:49:17.320926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.196961+0000","last_change":"2024-05-30T06:53:44.188125+0000","last_active":"2024-05-30T06:53:46.196961+0000","last_peered":"2024-05-30T06:53:46.196961+0000","last_clean":"2024-05-30T06:53:46.196961+0000","last_became_active":"2024-05-30T06:53:44.187825+0000","last_became_peered":"2024-05-30T06:53:44.187825+0000","last_unstale":"2024-05-30T06:53:46.196961+0000","last_undegraded":"2024-05-30T06:53:46.196961+0000","last_fullsized":"2024-05-30T06:53:46.196961+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:46:33.416087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202067+0000","last_change":"2024-05-30T06:53:45.204458+0000","last_active":"2024-05-30T06:53:46.202067+0000","last_peered":"2024-05-30T06:53:46.202067+0000","last_clean":"2024-05-30T06:53:46.202067+0000","last_became_active":"2024-05-30T06:53:45.201279+0000","last_became_peered":"2024-05-30T06:53:45.201279+0000","last_unstale":"2024-05-30T06:53:46.202067+0000","last_undegraded":"2024-05-30T06:53:46.202067+0000","last_fullsized":"2024-05-30T06:53:46.202067+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:06:20.149094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"87'8","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204488+0000","last_change":"2024-05-30T06:53:44.185405+0000","last_active":"2024-05-30T06:53:46.204488+0000","last_peered":"2024-05-30T06:53:46.204488+0000","last_clean":"2024-05-30T06:53:46.204488+0000","last_became_active":"2024-05-30T06:53:44.185131+0000","last_became_peered":"2024-05-30T06:53:44.185131+0000","last_unstale":"2024-05-30T06:53:46.204488+0000","last_undegraded":"2024-05-30T06:53:46.204488+0000","last_fullsized":"2024-05-30T06:53:46.204488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:41:25.174084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035675+0000","last_change":"2024-05-30T06:53:45.204549+0000","last_active":"2024-05-30T06:53:47.035675+0000","last_peered":"2024-05-30T06:53:47.035675+0000","last_clean":"2024-05-30T06:53:47.035675+0000","last_became_active":"2024-05-30T06:53:45.203804+0000","last_became_peered":"2024-05-30T06:53:45.203804+0000","last_unstale":"2024-05-30T06:53:47.035675+0000","last_undegraded":"2024-05-30T06:53:47.035675+0000","last_fullsized":"2024-05-30T06:53:47.035675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:42.747152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035783+0000","last_change":"2024-05-30T06:53:44.190185+0000","last_active":"2024-05-30T06:53:47.035783+0000","last_peered":"2024-05-30T06:53:47.035783+0000","last_clean":"2024-05-30T06:53:47.035783+0000","last_became_active":"2024-05-30T06:53:44.189820+0000","last_became_peered":"2024-05-30T06:53:44.189820+0000","last_unstale":"2024-05-30T06:53:47.035783+0000","last_undegraded":"2024-05-30T06:53:47.035783+0000","last_fullsized":"2024-05-30T06:53:47.035783+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:08:16.564258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035487+0000","last_change":"2024-05-30T06:53:45.207242+0000","last_active":"2024-05-30T06:53:47.035487+0000","last_peered":"2024-05-30T06:53:47.035487+0000","last_clean":"2024-05-30T06:53:47.035487+0000","last_became_active":"2024-05-30T06:53:45.206907+0000","last_became_peered":"2024-05-30T06:53:45.206907+0000","last_unstale":"2024-05-30T06:53:47.035487+0000","last_undegraded":"2024-05-30T06:53:47.035487+0000","last_fullsized":"2024-05-30T06:53:47.035487+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:44.530062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204948+0000","last_change":"2024-05-30T06:53:44.186669+0000","last_active":"2024-05-30T06:53:46.204948+0000","last_peered":"2024-05-30T06:53:46.204948+0000","last_clean":"2024-05-30T06:53:46.204948+0000","last_became_active":"2024-05-30T06:53:44.186320+0000","last_became_peered":"2024-05-30T06:53:44.186320+0000","last_unstale":"2024-05-30T06:53:46.204948+0000","last_undegraded":"2024-05-30T06:53:46.204948+0000","last_fullsized":"2024-05-30T06:53:46.204948+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:16:37.222002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.198107+0000","last_change":"2024-05-30T06:53:45.197308+0000","last_active":"2024-05-30T06:53:46.198107+0000","last_peered":"2024-05-30T06:53:46.198107+0000","last_clean":"2024-05-30T06:53:46.198107+0000","last_became_active":"2024-05-30T06:53:45.196495+0000","last_became_peered":"2024-05-30T06:53:45.196495+0000","last_unstale":"2024-05-30T06:53:46.198107+0000","last_undegraded":"2024-05-30T06:53:46.198107+0000","last_fullsized":"2024-05-30T06:53:46.198107+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:28:07.484058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204913+0000","last_change":"2024-05-30T06:53:44.186972+0000","last_active":"2024-05-30T06:53:46.204913+0000","last_peered":"2024-05-30T06:53:46.204913+0000","last_clean":"2024-05-30T06:53:46.204913+0000","last_became_active":"2024-05-30T06:53:44.186707+0000","last_became_peered":"2024-05-30T06:53:44.186707+0000","last_unstale":"2024-05-30T06:53:46.204913+0000","last_undegraded":"2024-05-30T06:53:46.204913+0000","last_fullsized":"2024-05-30T06:53:46.204913+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:43.623167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.032570+0000","last_change":"2024-05-30T06:53:45.206217+0000","last_active":"2024-05-30T06:53:47.032570+0000","last_peered":"2024-05-30T06:53:47.032570+0000","last_clean":"2024-05-30T06:53:47.032570+0000","last_became_active":"2024-05-30T06:53:45.205541+0000","last_became_peered":"2024-05-30T06:53:45.205541+0000","last_unstale":"2024-05-30T06:53:47.032570+0000","last_undegraded":"2024-05-30T06:53:47.032570+0000","last_fullsized":"2024-05-30T06:53:47.032570+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:18:45.832675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192951+0000","last_change":"2024-05-30T06:53:44.176262+0000","last_active":"2024-05-30T06:53:46.192951+0000","last_peered":"2024-05-30T06:53:46.192951+0000","last_clean":"2024-05-30T06:53:46.192951+0000","last_became_active":"2024-05-30T06:53:44.175893+0000","last_became_peered":"2024-05-30T06:53:44.175893+0000","last_unstale":"2024-05-30T06:53:46.192951+0000","last_undegraded":"2024-05-30T06:53:46.192951+0000","last_fullsized":"2024-05-30T06:53:46.192951+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:52.690379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.198286+0000","last_change":"2024-05-30T06:53:45.205915+0000","last_active":"2024-05-30T06:53:46.198286+0000","last_peered":"2024-05-30T06:53:46.198286+0000","last_clean":"2024-05-30T06:53:46.198286+0000","last_became_active":"2024-05-30T06:53:45.205635+0000","last_became_peered":"2024-05-30T06:53:45.205635+0000","last_unstale":"2024-05-30T06:53:46.198286+0000","last_undegraded":"2024-05-30T06:53:46.198286+0000","last_fullsized":"2024-05-30T06:53:46.198286+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:27:56.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.032549+0000","last_change":"2024-05-30T06:53:44.177435+0000","last_active":"2024-05-30T06:53:47.032549+0000","last_peered":"2024-05-30T06:53:47.032549+0000","last_clean":"2024-05-30T06:53:47.032549+0000","last_became_active":"2024-05-30T06:53:44.177120+0000","last_became_peered":"2024-05-30T06:53:44.177120+0000","last_unstale":"2024-05-30T06:53:47.032549+0000","last_undegraded":"2024-05-30T06:53:47.032549+0000","last_fullsized":"2024-05-30T06:53:47.032549+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:13:11.830941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.032437+0000","last_change":"2024-05-30T06:53:45.205451+0000","last_active":"2024-05-30T06:53:47.032437+0000","last_peered":"2024-05-30T06:53:47.032437+0000","last_clean":"2024-05-30T06:53:47.032437+0000","last_became_active":"2024-05-30T06:53:45.205091+0000","last_became_peered":"2024-05-30T06:53:45.205091+0000","last_unstale":"2024-05-30T06:53:47.032437+0000","last_undegraded":"2024-05-30T06:53:47.032437+0000","last_fullsized":"2024-05-30T06:53:47.032437+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:33:43.130371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.032275+0000","last_change":"2024-05-30T06:53:44.173333+0000","last_active":"2024-05-30T06:53:47.032275+0000","last_peered":"2024-05-30T06:53:47.032275+0000","last_clean":"2024-05-30T06:53:47.032275+0000","last_became_active":"2024-05-30T06:53:44.172927+0000","last_became_peered":"2024-05-30T06:53:44.172927+0000","last_unstale":"2024-05-30T06:53:47.032275+0000","last_undegraded":"2024-05-30T06:53:47.032275+0000","last_fullsized":"2024-05-30T06:53:47.032275+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:51:01.949785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.196899+0000","last_change":"2024-05-30T06:53:45.203708+0000","last_active":"2024-05-30T06:53:46.196899+0000","last_peered":"2024-05-30T06:53:46.196899+0000","last_clean":"2024-05-30T06:53:46.196899+0000","last_became_active":"2024-05-30T06:53:45.203391+0000","last_became_peered":"2024-05-30T06:53:45.203391+0000","last_unstale":"2024-05-30T06:53:46.196899+0000","last_undegraded":"2024-05-30T06:53:46.196899+0000","last_fullsized":"2024-05-30T06:53:46.196899+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:23:05.727156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.192684+0000","last_change":"2024-05-30T06:53:44.168334+0000","last_active":"2024-05-30T06:53:46.192684+0000","last_peered":"2024-05-30T06:53:46.192684+0000","last_clean":"2024-05-30T06:53:46.192684+0000","last_became_active":"2024-05-30T06:53:44.168056+0000","last_became_peered":"2024-05-30T06:53:44.168056+0000","last_unstale":"2024-05-30T06:53:46.192684+0000","last_undegraded":"2024-05-30T06:53:46.192684+0000","last_fullsized":"2024-05-30T06:53:46.192684+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:33:36.114248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.198049+0000","last_change":"2024-05-30T06:53:45.208196+0000","last_active":"2024-05-30T06:53:46.198049+0000","last_peered":"2024-05-30T06:53:46.198049+0000","last_clean":"2024-05-30T06:53:46.198049+0000","last_became_active":"2024-05-30T06:53:45.207910+0000","last_became_peered":"2024-05-30T06:53:45.207910+0000","last_unstale":"2024-05-30T06:53:46.198049+0000","last_undegraded":"2024-05-30T06:53:46.198049+0000","last_fullsized":"2024-05-30T06:53:46.198049+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:23:05.727156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"87'2","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202681+0000","last_change":"2024-05-30T06:53:44.185925+0000","last_active":"2024-05-30T06:53:46.202681+0000","last_peered":"2024-05-30T06:53:46.202681+0000","last_clean":"2024-05-30T06:53:46.202681+0000","last_became_active":"2024-05-30T06:53:44.185660+0000","last_became_peered":"2024-05-30T06:53:44.185660+0000","last_unstale":"2024-05-30T06:53:46.202681+0000","last_undegraded":"2024-05-30T06:53:46.202681+0000","last_fullsized":"2024-05-30T06:53:46.202681+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:24:03.387166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035890+0000","last_change":"2024-05-30T06:53:45.210548+0000","last_active":"2024-05-30T06:53:47.035890+0000","last_peered":"2024-05-30T06:53:47.035890+0000","last_clean":"2024-05-30T06:53:47.035890+0000","last_became_active":"2024-05-30T06:53:45.210272+0000","last_became_peered":"2024-05-30T06:53:45.210272+0000","last_unstale":"2024-05-30T06:53:47.035890+0000","last_undegraded":"2024-05-30T06:53:47.035890+0000","last_fullsized":"2024-05-30T06:53:47.035890+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:33:37.119606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"88'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202623+0000","last_change":"2024-05-30T06:53:44.182146+0000","last_active":"2024-05-30T06:53:46.202623+0000","last_peered":"2024-05-30T06:53:46.202623+0000","last_clean":"2024-05-30T06:53:46.202623+0000","last_became_active":"2024-05-30T06:53:44.181864+0000","last_became_peered":"2024-05-30T06:53:44.181864+0000","last_unstale":"2024-05-30T06:53:46.202623+0000","last_undegraded":"2024-05-30T06:53:46.202623+0000","last_fullsized":"2024-05-30T06:53:46.202623+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:42:26.761244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035999+0000","last_change":"2024-05-30T06:53:45.208790+0000","last_active":"2024-05-30T06:53:47.035999+0000","last_peered":"2024-05-30T06:53:47.035999+0000","last_clean":"2024-05-30T06:53:47.035999+0000","last_became_active":"2024-05-30T06:53:45.208521+0000","last_became_peered":"2024-05-30T06:53:45.208521+0000","last_unstale":"2024-05-30T06:53:47.035999+0000","last_undegraded":"2024-05-30T06:53:47.035999+0000","last_fullsized":"2024-05-30T06:53:47.035999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:44.628526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.036118+0000","last_change":"2024-05-30T06:53:44.177960+0000","last_active":"2024-05-30T06:53:47.036118+0000","last_peered":"2024-05-30T06:53:47.036118+0000","last_clean":"2024-05-30T06:53:47.036118+0000","last_became_active":"2024-05-30T06:53:44.177390+0000","last_became_peered":"2024-05-30T06:53:44.177390+0000","last_unstale":"2024-05-30T06:53:47.036118+0000","last_undegraded":"2024-05-30T06:53:47.036118+0000","last_fullsized":"2024-05-30T06:53:47.036118+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:12:21.019910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.198238+0000","last_change":"2024-05-30T06:53:45.194119+0000","last_active":"2024-05-30T06:53:46.198238+0000","last_peered":"2024-05-30T06:53:46.198238+0000","last_clean":"2024-05-30T06:53:46.198238+0000","last_became_active":"2024-05-30T06:53:45.193823+0000","last_became_peered":"2024-05-30T06:53:45.193823+0000","last_unstale":"2024-05-30T06:53:46.198238+0000","last_undegraded":"2024-05-30T06:53:46.198238+0000","last_fullsized":"2024-05-30T06:53:46.198238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:13:22.643121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035980+0000","last_change":"2024-05-30T06:53:44.183971+0000","last_active":"2024-05-30T06:53:47.035980+0000","last_peered":"2024-05-30T06:53:47.035980+0000","last_clean":"2024-05-30T06:53:47.035980+0000","last_became_active":"2024-05-30T06:53:44.180960+0000","last_became_peered":"2024-05-30T06:53:44.180960+0000","last_unstale":"2024-05-30T06:53:47.035980+0000","last_undegraded":"2024-05-30T06:53:47.035980+0000","last_fullsized":"2024-05-30T06:53:47.035980+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:31:49.699198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197101+0000","last_change":"2024-05-30T06:53:45.205732+0000","last_active":"2024-05-30T06:53:46.197101+0000","last_peered":"2024-05-30T06:53:46.197101+0000","last_clean":"2024-05-30T06:53:46.197101+0000","last_became_active":"2024-05-30T06:53:45.204369+0000","last_became_peered":"2024-05-30T06:53:45.204369+0000","last_unstale":"2024-05-30T06:53:46.197101+0000","last_undegraded":"2024-05-30T06:53:46.197101+0000","last_fullsized":"2024-05-30T06:53:46.197101+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:13:22.643121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204792+0000","last_change":"2024-05-30T06:53:44.183606+0000","last_active":"2024-05-30T06:53:46.204792+0000","last_peered":"2024-05-30T06:53:46.204792+0000","last_clean":"2024-05-30T06:53:46.204792+0000","last_became_active":"2024-05-30T06:53:44.183319+0000","last_became_peered":"2024-05-30T06:53:44.183319+0000","last_unstale":"2024-05-30T06:53:46.204792+0000","last_undegraded":"2024-05-30T06:53:46.204792+0000","last_fullsized":"2024-05-30T06:53:46.204792+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:52:12.665818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.204884+0000","last_change":"2024-05-30T06:53:45.203178+0000","last_active":"2024-05-30T06:53:46.204884+0000","last_peered":"2024-05-30T06:53:46.204884+0000","last_clean":"2024-05-30T06:53:46.204884+0000","last_became_active":"2024-05-30T06:53:45.202780+0000","last_became_peered":"2024-05-30T06:53:45.202780+0000","last_unstale":"2024-05-30T06:53:46.204884+0000","last_undegraded":"2024-05-30T06:53:46.204884+0000","last_fullsized":"2024-05-30T06:53:46.204884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:24.340830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197515+0000","last_change":"2024-05-30T06:53:44.183092+0000","last_active":"2024-05-30T06:53:46.197515+0000","last_peered":"2024-05-30T06:53:46.197515+0000","last_clean":"2024-05-30T06:53:46.197515+0000","last_became_active":"2024-05-30T06:53:44.182795+0000","last_became_peered":"2024-05-30T06:53:44.182795+0000","last_unstale":"2024-05-30T06:53:46.197515+0000","last_undegraded":"2024-05-30T06:53:46.197515+0000","last_fullsized":"2024-05-30T06:53:46.197515+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:48:35.228783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035103+0000","last_change":"2024-05-30T06:53:45.199342+0000","last_active":"2024-05-30T06:53:47.035103+0000","last_peered":"2024-05-30T06:53:47.035103+0000","last_clean":"2024-05-30T06:53:47.035103+0000","last_became_active":"2024-05-30T06:53:45.198774+0000","last_became_peered":"2024-05-30T06:53:45.198774+0000","last_unstale":"2024-05-30T06:53:47.035103+0000","last_undegraded":"2024-05-30T06:53:47.035103+0000","last_fullsized":"2024-05-30T06:53:47.035103+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:42:32.831342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035142+0000","last_change":"2024-05-30T06:53:44.179060+0000","last_active":"2024-05-30T06:53:47.035142+0000","last_peered":"2024-05-30T06:53:47.035142+0000","last_clean":"2024-05-30T06:53:47.035142+0000","last_became_active":"2024-05-30T06:53:44.178777+0000","last_became_peered":"2024-05-30T06:53:44.178777+0000","last_unstale":"2024-05-30T06:53:47.035142+0000","last_undegraded":"2024-05-30T06:53:47.035142+0000","last_fullsized":"2024-05-30T06:53:47.035142+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:42:04.250304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035022+0000","last_change":"2024-05-30T06:53:45.208756+0000","last_active":"2024-05-30T06:53:47.035022+0000","last_peered":"2024-05-30T06:53:47.035022+0000","last_clean":"2024-05-30T06:53:47.035022+0000","last_became_active":"2024-05-30T06:53:45.208493+0000","last_became_peered":"2024-05-30T06:53:45.208493+0000","last_unstale":"2024-05-30T06:53:47.035022+0000","last_undegraded":"2024-05-30T06:53:47.035022+0000","last_fullsized":"2024-05-30T06:53:47.035022+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:44:58.533539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.197133+0000","last_change":"2024-05-30T06:53:44.188265+0000","last_active":"2024-05-30T06:53:46.197133+0000","last_peered":"2024-05-30T06:53:46.197133+0000","last_clean":"2024-05-30T06:53:46.197133+0000","last_became_active":"2024-05-30T06:53:44.185234+0000","last_became_peered":"2024-05-30T06:53:44.185234+0000","last_unstale":"2024-05-30T06:53:46.197133+0000","last_undegraded":"2024-05-30T06:53:46.197133+0000","last_fullsized":"2024-05-30T06:53:46.197133+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:36.799751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:46.202504+0000","last_change":"2024-05-30T06:53:45.202232+0000","last_active":"2024-05-30T06:53:46.202504+0000","last_peered":"2024-05-30T06:53:46.202504+0000","last_clean":"2024-05-30T06:53:46.202504+0000","last_became_active":"2024-05-30T06:53:45.201342+0000","last_became_peered":"2024-05-30T06:53:45.201342+0000","last_unstale":"2024-05-30T06:53:46.202504+0000","last_undegraded":"2024-05-30T06:53:46.202504+0000","last_fullsized":"2024-05-30T06:53:46.202504+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:44.157032+0000","last_clean_scrub_stamp":"2024-05-30T06:53:44.157032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:13:01.664436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"87'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035403+0000","last_change":"2024-05-30T06:53:44.188978+0000","last_active":"2024-05-30T06:53:47.035403+0000","last_peered":"2024-05-30T06:53:47.035403+0000","last_clean":"2024-05-30T06:53:47.035403+0000","last_became_active":"2024-05-30T06:53:44.188093+0000","last_became_peered":"2024-05-30T06:53:44.188093+0000","last_unstale":"2024-05-30T06:53:47.035403+0000","last_undegraded":"2024-05-30T06:53:47.035403+0000","last_fullsized":"2024-05-30T06:53:47.035403+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:53:43.151673+0000","last_clean_scrub_stamp":"2024-05-30T06:53:43.151673+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:13:51.987038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":300,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-05-30T06:53:47.035231+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:53:47.035231+0000","last_peered":"2024-05-30T06:53:47.035231+0000","last_clean":"2024-05-30T06:53:47.035231+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:53:47.035231+0000","last_undegraded":"2024-05-30T06:53:47.035231+0000","last_fullsized":"2024-05-30T06:53:47.035231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100788,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271052,"statfs":{"total":96636764160,"available":96533557248,"internally_reserved":0,"allocated":1679360,"data_stored":1058225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101513674},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118264,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94253576,"statfs":{"total":96636764160,"available":96515661824,"internally_reserved":0,"allocated":1093632,"data_stored":468481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72444,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94299396,"statfs":{"total":96636764160,"available":96562581504,"internally_reserved":0,"allocated":1097728,"data_stored":469421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76596,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295244,"statfs":{"total":96636764160,"available":96558329856,"internally_reserved":0,"allocated":1081344,"data_stored":467787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140480,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231360,"statfs":{"total":96636764160,"available":96492912640,"internally_reserved":0,"allocated":1093632,"data_stored":469399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":142735815},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100208,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94271632,"statfs":{"total":96636764160,"available":96534151168,"internally_reserved":0,"allocated":1085440,"data_stored":468369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82168,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94289672,"statfs":{"total":96636764160,"available":96552624128,"internally_reserved":0,"allocated":1093632,"data_stored":467981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73020,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94298820,"statfs":{"total":96636764160,"available":96561991680,"internally_reserved":0,"allocated":1679360,"data_stored":1058189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:53:54.321 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-30T06:53:54.321 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T06:53:54.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.502+0000 7fe262c00640 1 Processor -- start 2024-05-30T06:53:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.502+0000 7fe262c00640 1 -- start start 2024-05-30T06:53:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe262c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe25c15d350 0x7fe25c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe262c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe25c15d7e0 0x7fe25c06e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe262c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe25c142030 con 0x7fe25c0b59d0 2024-05-30T06:53:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe262c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe25c142310 con 0x7fe25c15d350 2024-05-30T06:53:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe262c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe25c1425f0 con 0x7fe25c15d7e0 2024-05-30T06:53:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe25c0b59d0 0x7fe25c0b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53472/0 (socket says 172.21.15.37:53472) 2024-05-30T06:53:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25be00640 1 -- 172.21.15.37:0/2560913625 learned_addr learned my addr 172.21.15.37:0/2560913625 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe260c00640 1 --2- 172.21.15.37:0/2560913625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe25c15d7e0 0x7fe25c06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe253400640 1 --2- 172.21.15.37:0/2560913625 >> v2:172.21.15.105:3300/0 conn(0x7fe25c15d350 0x7fe25c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3249962986 0 0) 0x7fe25c142030 con 0x7fe25c0b59d0 2024-05-30T06:53:54.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe240003530 con 0x7fe25c0b59d0 2024-05-30T06:53:54.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 864338634 0 0) 0x7fe240003530 con 0x7fe25c0b59d0 2024-05-30T06:53:54.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe25c15d7e0 msgr2=0x7fe25c06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:54.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 --2- 172.21.15.37:0/2560913625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe25c15d7e0 0x7fe25c06e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 >> v2:172.21.15.105:3300/0 conn(0x7fe25c15d350 msgr2=0x7fe25c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:54.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 --2- 172.21.15.37:0/2560913625 >> v2:172.21.15.105:3300/0 conn(0x7fe25c15d350 0x7fe25c06df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c1428d0 con 0x7fe25c0b59d0 2024-05-30T06:53:54.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fe24c001a00 con 0x7fe25c0b59d0 2024-05-30T06:53:54.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 >> v1:172.21.15.37:6789/0 conn(0x7fe25c0b59d0 legacy=0x7fe25c0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 --2- 172.21.15.37:0/2560913625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2400039c0 0x7fe240003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 --2- 172.21.15.37:0/2560913625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe240004810 0x7fe240004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 --2- 172.21.15.37:0/2560913625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe25c15d7e0 0x7fe2400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c142310 con 0x7fe2400039c0 2024-05-30T06:53:54.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1425f0 con 0x7fe240004810 2024-05-30T06:53:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe24000b9d0 con 0x7fe25c15d7e0 2024-05-30T06:53:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25be00640 1 --2- 172.21.15.37:0/2560913625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2400039c0 0x7fe240003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe260c00640 1 --2- 172.21.15.37:0/2560913625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe25c15d7e0 0x7fe2400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe253400640 1 --2- 172.21.15.37:0/2560913625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe240004810 0x7fe240004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25be00640 1 -- 172.21.15.37:0/2560913625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe25c15d7e0 msgr2=0x7fe2400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25be00640 1 --2- 172.21.15.37:0/2560913625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe25c15d7e0 0x7fe2400051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25be00640 1 -- 172.21.15.37:0/2560913625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe240004810 msgr2=0x7fe240004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25be00640 1 --2- 172.21.15.37:0/2560913625 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe240004810 0x7fe240004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.506+0000 7fe25be00640 1 -- 172.21.15.37:0/2560913625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe240003530 con 0x7fe2400039c0 2024-05-30T06:53:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.510+0000 7fe25be00640 1 --2- 172.21.15.37:0/2560913625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2400039c0 0x7fe240003de0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00a850 tx=0x7fe24c01fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84676362adc07554 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.510+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c00a4a0 con 0x7fe2400039c0 2024-05-30T06:53:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.510+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe24c0aa650 con 0x7fe2400039c0 2024-05-30T06:53:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.510+0000 7fe25b400640 1 -- 172.21.15.37:0/2560913625 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c0aaa40 con 0x7fe2400039c0 2024-05-30T06:53:54.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.510+0000 7fe262c00640 1 -- 172.21.15.37:0/2560913625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2400039c0 msgr2=0x7fe240003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.510+0000 7fe262c00640 1 --2- 172.21.15.37:0/2560913625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2400039c0 0x7fe240003de0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00a850 tx=0x7fe24c01fb00 comp rx=0 tx=0).stop 2024-05-30T06:53:54.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.510+0000 7fe260c00640 1 -- 172.21.15.37:0/2560913625 reap_dead start 2024-05-30T06:53:54.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.510+0000 7fe262c00640 1 -- 172.21.15.37:0/2560913625 shutdown_connections 2024-05-30T06:53:54.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.510+0000 7fe262c00640 1 -- 172.21.15.37:0/2560913625 >> 172.21.15.37:0/2560913625 conn(0x7fe25c06bf60 msgr2=0x7fe25c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:54.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.510+0000 7fe262c00640 1 -- 172.21.15.37:0/2560913625 shutdown_connections 2024-05-30T06:53:54.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.510+0000 7fe262c00640 1 -- 172.21.15.37:0/2560913625 wait complete. 2024-05-30T06:53:54.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.510+0000 7fe262c00640 1 Processor -- start 2024-05-30T06:53:54.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.510+0000 7fe262c00640 1 -- start start 2024-05-30T06:53:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe262c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2400039c0 0x7fe25c1f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe262c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe25c13cca0 0x7fe25c132c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe262c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c13d880 0x7fe25c13dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe262c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c0b00a0 con 0x7fe25c13d880 2024-05-30T06:53:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe262c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c0aff20 con 0x7fe2400039c0 2024-05-30T06:53:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe262c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe25c13f860 con 0x7fe25c13cca0 2024-05-30T06:53:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe260c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c13d880 0x7fe25c13dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe260c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c13d880 0x7fe25c13dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56862/0 (socket says 172.21.15.37:56862) 2024-05-30T06:53:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe260c00640 1 -- 172.21.15.37:0/2524844369 learned_addr learned my addr 172.21.15.37:0/2524844369 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe25be00640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2400039c0 0x7fe25c1f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe253400640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe25c13cca0 0x7fe25c132c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe260c00640 1 -- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe25c13cca0 msgr2=0x7fe25c132c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe260c00640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe25c13cca0 0x7fe25c132c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe260c00640 1 -- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2400039c0 msgr2=0x7fe25c1f5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe260c00640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2400039c0 0x7fe25c1f5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe260c00640 1 -- 172.21.15.37:0/2524844369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c1f6350 con 0x7fe25c13d880 2024-05-30T06:53:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe260c00640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c13d880 0x7fe25c13dd00 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe25c06c700 tx=0x7fe254011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe258c00640 1 -- 172.21.15.37:0/2524844369 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254003620 con 0x7fe25c13d880 2024-05-30T06:53:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe258c00640 1 -- 172.21.15.37:0/2524844369 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25401b070 con 0x7fe25c13d880 2024-05-30T06:53:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe262c00640 1 -- 172.21.15.37:0/2524844369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25c1f6630 con 0x7fe25c13d880 2024-05-30T06:53:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe258c00640 1 -- 172.21.15.37:0/2524844369 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254003a40 con 0x7fe25c13d880 2024-05-30T06:53:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe262c00640 1 -- 172.21.15.37:0/2524844369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe25c1331c0 con 0x7fe25c13d880 2024-05-30T06:53:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.514+0000 7fe262c00640 1 -- 172.21.15.37:0/2524844369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe25c068bc0 con 0x7fe25c13d880 2024-05-30T06:53:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.518+0000 7fe258c00640 1 -- 172.21.15.37:0/2524844369 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fe254003be0 con 0x7fe25c13d880 2024-05-30T06:53:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.518+0000 7fe258c00640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe238069580 0x7fe23806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.518+0000 7fe258c00640 1 -- 172.21.15.37:0/2524844369 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7fe2540855c0 con 0x7fe25c13d880 2024-05-30T06:53:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.518+0000 7fe25be00640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe238069580 0x7fe23806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.518+0000 7fe25be00640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe238069580 0x7fe23806ba40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0b0000 tx=0x7fe24c0b7040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.522+0000 7fe258c00640 1 -- 172.21.15.37:0/2524844369 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe254025020 con 0x7fe25c13d880 2024-05-30T06:53:54.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.742+0000 7fe262c00640 1 -- 172.21.15.37:0/2524844369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe25c153d00 con 0x7fe25c13d880 2024-05-30T06:53:54.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.746+0000 7fe258c00640 1 -- 172.21.15.37:0/2524844369 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7fe254056f80 con 0x7fe25c13d880 2024-05-30T06:53:54.747 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-30T06:53:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A== 2024-05-30T06:53:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-30T06:53:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-30T06:53:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T06:53:54.748 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-30T06:53:54.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.750+0000 7fe262c00640 1 -- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe238069580 msgr2=0x7fe23806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.750+0000 7fe262c00640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe238069580 0x7fe23806ba40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0b0000 tx=0x7fe24c0b7040 comp rx=0 tx=0).stop 2024-05-30T06:53:54.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.750+0000 7fe262c00640 1 -- 172.21.15.37:0/2524844369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c13d880 msgr2=0x7fe25c13dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.750+0000 7fe262c00640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c13d880 0x7fe25c13dd00 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe25c06c700 tx=0x7fe254011920 comp rx=0 tx=0).stop 2024-05-30T06:53:54.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.750+0000 7fe262c00640 1 -- 172.21.15.37:0/2524844369 shutdown_connections 2024-05-30T06:53:54.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.750+0000 7fe262c00640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe25c13d880 0x7fe25c13dd00 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.750+0000 7fe262c00640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe25c13cca0 0x7fe25c132c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.750+0000 7fe262c00640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe238069580 0x7fe23806ba40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.750+0000 7fe262c00640 1 --2- 172.21.15.37:0/2524844369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2400039c0 0x7fe25c1f5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.750+0000 7fe262c00640 1 -- 172.21.15.37:0/2524844369 >> 172.21.15.37:0/2524844369 conn(0x7fe25c06bf60 msgr2=0x7fe25c06e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.750+0000 7fe262c00640 1 -- 172.21.15.37:0/2524844369 shutdown_connections 2024-05-30T06:53:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.750+0000 7fe262c00640 1 -- 172.21.15.37:0/2524844369 wait complete. 2024-05-30T06:53:54.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:53:54.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed9d800640 1 Processor -- start 2024-05-30T06:53:54.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed9d800640 1 -- start start 2024-05-30T06:53:54.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed9d800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fed9809b9a0 0x7fed981625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed9d800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fed98162ae0 0x7fed980ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed9d800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed98162f00 con 0x7fed9815e930 2024-05-30T06:53:54.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed9d800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fed9809abe0 con 0x7fed98162ae0 2024-05-30T06:53:54.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed9d800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fed9809aec0 con 0x7fed9809b9a0 2024-05-30T06:53:54.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed97400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fed98162ae0 0x7fed980ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed97400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fed98162ae0 0x7fed980ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56874/0 (socket says 172.21.15.37:56874) 2024-05-30T06:53:54.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed97400640 1 -- 172.21.15.37:0/2208304566 learned_addr learned my addr 172.21.15.37:0/2208304566 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:54.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed8e000640 1 --2- 172.21.15.37:0/2208304566 >> v2:172.21.15.105:3300/0 conn(0x7fed9809b9a0 0x7fed981625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed97400640 1 -- 172.21.15.37:0/2208304566 >> v2:172.21.15.105:3300/0 conn(0x7fed9809b9a0 msgr2=0x7fed981625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:54.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed97400640 1 --2- 172.21.15.37:0/2208304566 >> v2:172.21.15.105:3300/0 conn(0x7fed9809b9a0 0x7fed981625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed97400640 1 -- 172.21.15.37:0/2208304566 >> v1:172.21.15.105:6789/0 conn(0x7fed9815e930 legacy=0x7fed980d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.910+0000 7fed97400640 1 -- 172.21.15.37:0/2208304566 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9809b1a0 con 0x7fed98162ae0 2024-05-30T06:53:54.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.914+0000 7fed97400640 1 --2- 172.21.15.37:0/2208304566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed98162ae0 0x7fed980ccc60 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fed98073320 tx=0x7fed9001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c9fe0515625f95 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:54.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.914+0000 7fed96000640 1 -- 172.21.15.37:0/2208304566 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed900a57a0 con 0x7fed98162ae0 2024-05-30T06:53:54.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.914+0000 7fed96000640 1 -- 172.21.15.37:0/2208304566 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed900a5940 con 0x7fed98162ae0 2024-05-30T06:53:54.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.914+0000 7fed96000640 1 -- 172.21.15.37:0/2208304566 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed900a5d10 con 0x7fed98162ae0 2024-05-30T06:53:54.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.914+0000 7fed9d800640 1 -- 172.21.15.37:0/2208304566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed98162ae0 msgr2=0x7fed980ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.914+0000 7fed9d800640 1 --2- 172.21.15.37:0/2208304566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed98162ae0 0x7fed980ccc60 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fed98073320 tx=0x7fed9001c9f0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.914+0000 7fed9d800640 1 -- 172.21.15.37:0/2208304566 shutdown_connections 2024-05-30T06:53:54.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.914+0000 7fed9d800640 1 --2- 172.21.15.37:0/2208304566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed98162ae0 0x7fed980ccc60 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.914+0000 7fed9d800640 1 --2- 172.21.15.37:0/2208304566 >> v2:172.21.15.105:3300/0 conn(0x7fed9809b9a0 0x7fed981625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.914+0000 7fed9d800640 1 -- 172.21.15.37:0/2208304566 >> 172.21.15.37:0/2208304566 conn(0x7fed980b4100 msgr2=0x7fed980b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:54.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.914+0000 7fed9d800640 1 -- 172.21.15.37:0/2208304566 shutdown_connections 2024-05-30T06:53:54.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.914+0000 7fed9d800640 1 -- 172.21.15.37:0/2208304566 wait complete. 2024-05-30T06:53:54.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed9d800640 1 Processor -- start 2024-05-30T06:53:54.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed9d800640 1 -- start start 2024-05-30T06:53:54.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed9d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed9809b9a0 0x7fed98152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed9d800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed9815e930 0x7fed9815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed9d800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed98162ae0 0x7fed9815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed9d800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed9806ddc0 con 0x7fed9809b9a0 2024-05-30T06:53:54.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed9d800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed9806dc40 con 0x7fed98162ae0 2024-05-30T06:53:54.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed9d800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fed9815ed10 con 0x7fed9815e930 2024-05-30T06:53:54.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed96a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed9809b9a0 0x7fed98152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed96a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed9809b9a0 0x7fed98152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56876/0 (socket says 172.21.15.37:56876) 2024-05-30T06:53:54.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed96a00640 1 -- 172.21.15.37:0/3309572517 learned_addr learned my addr 172.21.15.37:0/3309572517 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:54.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed8e000640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed9815e930 0x7fed9815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed97400640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed98162ae0 0x7fed9815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed96a00640 1 -- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed9815e930 msgr2=0x7fed9815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed96a00640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed9815e930 0x7fed9815c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed96a00640 1 -- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed98162ae0 msgr2=0x7fed9815cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:54.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed96a00640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed98162ae0 0x7fed9815cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:54.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed96a00640 1 -- 172.21.15.37:0/3309572517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed98153160 con 0x7fed9809b9a0 2024-05-30T06:53:54.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed8e000640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed9815e930 0x7fed9815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:54.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed96a00640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed9809b9a0 0x7fed98152c20 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fed8800c420 tx=0x7fed8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:54.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed8f400640 1 -- 172.21.15.37:0/3309572517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed880052d0 con 0x7fed9809b9a0 2024-05-30T06:53:54.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed8f400640 1 -- 172.21.15.37:0/3309572517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed88005470 con 0x7fed9809b9a0 2024-05-30T06:53:54.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed8f400640 1 -- 172.21.15.37:0/3309572517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed88007260 con 0x7fed9809b9a0 2024-05-30T06:53:54.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed9d800640 1 -- 172.21.15.37:0/3309572517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed980b5d00 con 0x7fed9809b9a0 2024-05-30T06:53:54.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.918+0000 7fed9d800640 1 -- 172.21.15.37:0/3309572517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed980b62c0 con 0x7fed9809b9a0 2024-05-30T06:53:54.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.922+0000 7fed9d800640 1 -- 172.21.15.37:0/3309572517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed98068b20 con 0x7fed9809b9a0 2024-05-30T06:53:54.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.922+0000 7fed8f400640 1 -- 172.21.15.37:0/3309572517 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fed88007400 con 0x7fed9809b9a0 2024-05-30T06:53:54.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.922+0000 7fed8f400640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed74069580 0x7fed7406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:54.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.922+0000 7fed8f400640 1 -- 172.21.15.37:0/3309572517 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7fed88084d50 con 0x7fed9809b9a0 2024-05-30T06:53:54.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.922+0000 7fed8e000640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed74069580 0x7fed7406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:54.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.922+0000 7fed8e000640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed74069580 0x7fed7406ba40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fed980712f0 tx=0x7fed80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:54.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:54.926+0000 7fed8f400640 1 -- 172.21.15.37:0/3309572517 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed98153160 con 0x7fed9809b9a0 2024-05-30T06:53:55.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed9d800640 1 -- 172.21.15.37:0/3309572517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed9806e350 con 0x7fed9809b9a0 2024-05-30T06:53:55.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed8f400640 1 -- 172.21.15.37:0/3309572517 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5186 (secure 0 0 0) 0x7fed880563a0 con 0x7fed9809b9a0 2024-05-30T06:53:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:53:55.126 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":55,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/714267880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":714267880},{"type":"v1","addr":"172.21.15.105:6836","nonce":714267880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3425209937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3425209937},{"type":"v1","addr":"172.21.15.37:6834","nonce":3425209937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1537275411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1537275411},{"type":"v1","addr":"172.21.15.37:6835","nonce":1537275411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:53:44.572714+0000","modified":"2024-05-30T06:53:47.596443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7932":{"gid":7932,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/3708478889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3708478889},{"type":"v1","addr":"172.21.15.105:6837","nonce":3708478889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7932,"qdb_cluster":[7932]},"id":6}]} 2024-05-30T06:53:55.126 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 55 2024-05-30T06:53:55.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed9d800640 1 -- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed74069580 msgr2=0x7fed7406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed9d800640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed74069580 0x7fed7406ba40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fed980712f0 tx=0x7fed80008040 comp rx=0 tx=0).stop 2024-05-30T06:53:55.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed9d800640 1 -- 172.21.15.37:0/3309572517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed9809b9a0 msgr2=0x7fed98152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed9d800640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed9809b9a0 0x7fed98152c20 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fed8800c420 tx=0x7fed8800c8e0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed9d800640 1 -- 172.21.15.37:0/3309572517 shutdown_connections 2024-05-30T06:53:55.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed9d800640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed74069580 0x7fed7406ba40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed9d800640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed98162ae0 0x7fed9815cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed9d800640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed9815e930 0x7fed9815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed9d800640 1 --2- 172.21.15.37:0/3309572517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed9809b9a0 0x7fed98152c20 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed9d800640 1 -- 172.21.15.37:0/3309572517 >> 172.21.15.37:0/3309572517 conn(0x7fed980b4100 msgr2=0x7fed98074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:55.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed9d800640 1 -- 172.21.15.37:0/3309572517 shutdown_connections 2024-05-30T06:53:55.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.126+0000 7fed9d800640 1 -- 172.21.15.37:0/3309572517 wait complete. 2024-05-30T06:53:55.550 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T06:53:44.572714+0000', 'modified': '2024-05-30T06:53:47.596443+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7932}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7932': {'gid': 7932, 'name': 'b', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6837/3708478889', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6835', 'nonce': 3708478889}, {'type': 'v1', 'addr': '172.21.15.105:6837', 'nonce': 3708478889}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7932, 'qdb_cluster': [7932]} 2024-05-30T06:53:55.551 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T06:53:55.551 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-30T06:53:55.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.694+0000 7f1900000640 1 Processor -- start 2024-05-30T06:53:55.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.694+0000 7f1900000640 1 -- start start 2024-05-30T06:53:55.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.694+0000 7f1900000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f18f8155da0 0x7f18f80cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.694+0000 7f1900000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18f806f770 0x7f18f80b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.694+0000 7f1900000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f815f310 con 0x7f18f80cd440 2024-05-30T06:53:55.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.694+0000 7f1900000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f18f815f5f0 con 0x7f18f8155da0 2024-05-30T06:53:55.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.694+0000 7f1900000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f18f815f8d0 con 0x7f18f806f770 2024-05-30T06:53:55.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.694+0000 7f18fe000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18f806f770 0x7f18f80b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.694+0000 7f18fd600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f18f8155da0 0x7f18f80cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.694+0000 7f18fcc00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f18f80cd440 0x7f18f806f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:44398/0 (socket says 172.21.15.37:44398) 2024-05-30T06:53:55.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.694+0000 7f18fe000640 1 --2- 172.21.15.37:0/3753495614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18f806f770 0x7f18f80b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:33004/0 (socket says 172.21.15.37:33004) 2024-05-30T06:53:55.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.694+0000 7f18fcc00640 1 -- 172.21.15.37:0/3753495614 learned_addr learned my addr 172.21.15.37:0/3753495614 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:55.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.698+0000 7f18fd600640 1 -- 172.21.15.37:0/3753495614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18f806f770 msgr2=0x7f18f80b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:55.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.698+0000 7f18fd600640 1 --2- 172.21.15.37:0/3753495614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18f806f770 0x7f18f80b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.698+0000 7f18fd600640 1 -- 172.21.15.37:0/3753495614 >> v1:172.21.15.105:6789/0 conn(0x7f18f80cd440 legacy=0x7f18f806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.698+0000 7f18fd600640 1 -- 172.21.15.37:0/3753495614 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f815fbb0 con 0x7f18f8155da0 2024-05-30T06:53:55.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.698+0000 7f18fe000640 1 --2- 172.21.15.37:0/3753495614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18f806f770 0x7f18f80b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:53:55.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.698+0000 7f18fd600640 1 --2- 172.21.15.37:0/3753495614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18f8155da0 0x7f18f80cd950 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0097c0 tx=0x7f18ec01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73ebc222a67f849f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:55.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.698+0000 7f18f7e00640 1 -- 172.21.15.37:0/3753495614 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0b0070 con 0x7f18f8155da0 2024-05-30T06:53:55.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.698+0000 7f18f7e00640 1 -- 172.21.15.37:0/3753495614 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ec0ab600 con 0x7f18f8155da0 2024-05-30T06:53:55.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.698+0000 7f18f7e00640 1 -- 172.21.15.37:0/3753495614 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0ab9d0 con 0x7f18f8155da0 2024-05-30T06:53:55.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 -- 172.21.15.37:0/3753495614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18f8155da0 msgr2=0x7f18f80cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 --2- 172.21.15.37:0/3753495614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18f8155da0 0x7f18f80cd950 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0097c0 tx=0x7f18ec01c380 comp rx=0 tx=0).stop 2024-05-30T06:53:55.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 -- 172.21.15.37:0/3753495614 shutdown_connections 2024-05-30T06:53:55.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 --2- 172.21.15.37:0/3753495614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18f806f770 0x7f18f80b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 --2- 172.21.15.37:0/3753495614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18f8155da0 0x7f18f80cd950 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 -- 172.21.15.37:0/3753495614 >> 172.21.15.37:0/3753495614 conn(0x7f18f806bf60 msgr2=0x7f18f80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:55.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 -- 172.21.15.37:0/3753495614 shutdown_connections 2024-05-30T06:53:55.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 -- 172.21.15.37:0/3753495614 wait complete. 2024-05-30T06:53:55.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 Processor -- start 2024-05-30T06:53:55.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 -- start start 2024-05-30T06:53:55.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18f806f770 0x7f18f81f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18f8155da0 0x7f18f815db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f8161f30 0x7f18f81f8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18f8168580 con 0x7f18f8161f30 2024-05-30T06:53:55.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f18f80b46b0 con 0x7f18f8155da0 2024-05-30T06:53:55.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f1900000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f18f8168700 con 0x7f18f806f770 2024-05-30T06:53:55.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f18fe000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f8161f30 0x7f18f81f8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f18fe000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f8161f30 0x7f18f81f8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56886/0 (socket says 172.21.15.37:56886) 2024-05-30T06:53:55.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f18fe000640 1 -- 172.21.15.37:0/3959829733 learned_addr learned my addr 172.21.15.37:0/3959829733 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:55.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f18fd600640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18f806f770 0x7f18f81f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f18fcc00640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18f8155da0 0x7f18f815db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f18fe000640 1 -- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18f806f770 msgr2=0x7f18f81f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f18fe000640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18f806f770 0x7f18f81f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f18fe000640 1 -- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18f8155da0 msgr2=0x7f18f815db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f18fe000640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18f8155da0 0x7f18f815db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.702+0000 7f18fe000640 1 -- 172.21.15.37:0/3959829733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f81f57f0 con 0x7f18f8161f30 2024-05-30T06:53:55.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.706+0000 7f18fe000640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f8161f30 0x7f18f81f8d30 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f18f000ef90 tx=0x7f18f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:55.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.706+0000 7f18f5600640 1 -- 172.21.15.37:0/3959829733 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0018020 con 0x7f18f8161f30 2024-05-30T06:53:55.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.706+0000 7f18f5600640 1 -- 172.21.15.37:0/3959829733 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f0014480 con 0x7f18f8161f30 2024-05-30T06:53:55.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.706+0000 7f18f5600640 1 -- 172.21.15.37:0/3959829733 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0014850 con 0x7f18f8161f30 2024-05-30T06:53:55.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.706+0000 7f1900000640 1 -- 172.21.15.37:0/3959829733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f81f5ad0 con 0x7f18f8161f30 2024-05-30T06:53:55.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.706+0000 7f1900000640 1 -- 172.21.15.37:0/3959829733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f81f8810 con 0x7f18f8161f30 2024-05-30T06:53:55.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.706+0000 7f18f5600640 1 -- 172.21.15.37:0/3959829733 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f18f001b020 con 0x7f18f8161f30 2024-05-30T06:53:55.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.706+0000 7f18f5600640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18d8069580 0x7f18d806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.706+0000 7f18f5600640 1 -- 172.21.15.37:0/3959829733 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f18f0086200 con 0x7f18f8161f30 2024-05-30T06:53:55.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.706+0000 7f18fd600640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18d8069580 0x7f18d806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.706+0000 7f190354e000 1 Processor -- start 2024-05-30T06:53:55.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 -- start start 2024-05-30T06:53:55.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18fd600640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18d8069580 0x7f18d806ba40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0ad000 tx=0x7f18ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:55.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 0x55c644b98500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b98a40 0x55c644b4b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b4b650 0x55c644b4ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c64499c420 con 0x55c644b98120 2024-05-30T06:53:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c644936bf0 con 0x55c644b4b650 2024-05-30T06:53:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55c6449983e0 con 0x55c644b98a40 2024-05-30T06:53:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18fd600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 0x55c644b98500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18fd600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 0x55c644b98500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56890/0 (socket says 172.21.15.37:56890) 2024-05-30T06:53:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18fd600640 1 -- 172.21.15.37:0/1873840629 learned_addr learned my addr 172.21.15.37:0/1873840629 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18fcc00640 1 --2- 172.21.15.37:0/1873840629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b98a40 0x55c644b4b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18fe000640 1 --2- 172.21.15.37:0/1873840629 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b4b650 0x55c644b4ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18fd600640 1 -- 172.21.15.37:0/1873840629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b98a40 msgr2=0x55c644b4b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18fd600640 1 --2- 172.21.15.37:0/1873840629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b98a40 0x55c644b4b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18fd600640 1 -- 172.21.15.37:0/1873840629 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b4b650 msgr2=0x55c644b4ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18fd600640 1 --2- 172.21.15.37:0/1873840629 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b4b650 0x55c644b4ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18fd600640 1 -- 172.21.15.37:0/1873840629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c644a44450 con 0x55c644b98120 2024-05-30T06:53:55.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18fd600640 1 --2- 172.21.15.37:0/1873840629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 0x55c644b98500 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f18ec01aa30 tx=0x7f18ec004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe3f4ff9e4496d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18ea000640 1 -- 172.21.15.37:0/1873840629 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0b0040 con 0x55c644b98120 2024-05-30T06:53:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18ea000640 1 -- 172.21.15.37:0/1873840629 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ec0b6440 con 0x55c644b98120 2024-05-30T06:53:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f18ea000640 1 -- 172.21.15.37:0/1873840629 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0b67f0 con 0x55c644b98120 2024-05-30T06:53:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 -- 172.21.15.37:0/1873840629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 msgr2=0x55c644b98500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 --2- 172.21.15.37:0/1873840629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 0x55c644b98500 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f18ec01aa30 tx=0x7f18ec004740 comp rx=0 tx=0).stop 2024-05-30T06:53:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 -- 172.21.15.37:0/1873840629 shutdown_connections 2024-05-30T06:53:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 --2- 172.21.15.37:0/1873840629 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b4b650 0x55c644b4ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 --2- 172.21.15.37:0/1873840629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b98a40 0x55c644b4b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 --2- 172.21.15.37:0/1873840629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 0x55c644b98500 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 -- 172.21.15.37:0/1873840629 >> 172.21.15.37:0/1873840629 conn(0x55c644b78ec0 msgr2=0x55c644b7b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 -- 172.21.15.37:0/1873840629 shutdown_connections 2024-05-30T06:53:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 -- 172.21.15.37:0/1873840629 wait complete. 2024-05-30T06:53:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 -- start start 2024-05-30T06:53:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.710+0000 7f190354e000 1 Processor -- start 2024-05-30T06:53:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 0x55c644b7d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98120 0x55c644b7d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 0x55c644b7dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c64493cec0 con 0x55c644b98a40 2024-05-30T06:53:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c644a1d120 con 0x55c644b98120 2024-05-30T06:53:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55c6449a7350 con 0x55c644b4b650 2024-05-30T06:53:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 10 client.0 _ll_register_callbacks cb 0x55c6449794d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:53:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18fe000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 0x55c644b7dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18fe000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 0x55c644b7dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56908/0 (socket says 172.21.15.37:56908) 2024-05-30T06:53:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18fe000640 1 -- 172.21.15.37:0/3520185722 learned_addr learned my addr 172.21.15.37:0/3520185722 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18fd600640 1 --2- 172.21.15.37:0/3520185722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 0x55c644b7d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18fcc00640 1 --2- 172.21.15.37:0/3520185722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98120 0x55c644b7d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18fe000640 1 -- 172.21.15.37:0/3520185722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 msgr2=0x55c644b7d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18fe000640 1 --2- 172.21.15.37:0/3520185722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 0x55c644b7d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18fe000640 1 -- 172.21.15.37:0/3520185722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98120 msgr2=0x55c644b7d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18fe000640 1 --2- 172.21.15.37:0/3520185722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98120 0x55c644b7d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18fe000640 1 -- 172.21.15.37:0/3520185722 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6449e1f80 con 0x55c644b98a40 2024-05-30T06:53:55.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18fe000640 1 --2- 172.21.15.37:0/3520185722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 0x55c644b7dbd0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f18f00070b0 tx=0x7f18f0057bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8808e8f9e292d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:55.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18dea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:53:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18dea00640 1 -- 172.21.15.37:0/3520185722 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0057210 con 0x55c644b98a40 2024-05-30T06:53:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18dea00640 1 -- 172.21.15.37:0/3520185722 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f18f005e0c0 con 0x55c644b98a40 2024-05-30T06:53:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 1 -- 172.21.15.37:0/3520185722 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18ec0b6440 con 0x55c644b98a40 2024-05-30T06:53:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18dea00640 1 -- 172.21.15.37:0/3520185722 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f18f00606f0 con 0x55c644b98a40 2024-05-30T06:53:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 10 client.8082 fetch_fsmap learned FSMap version 55 2024-05-30T06:53:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 1 -- 172.21.15.37:0/3520185722 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55c644975f00 con 0x55c644b98a40 2024-05-30T06:53:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18dea00640 1 -- 172.21.15.37:0/3520185722 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ec0b6440 con 0x55c644b98a40 2024-05-30T06:53:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18dea00640 1 -- 172.21.15.37:0/3520185722 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f18f0071060 con 0x55c644b98a40 2024-05-30T06:53:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 10 client.8082 fetch_fsmap finished waiting for FSMap version 55 2024-05-30T06:53:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 10 client.8082 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-30T06:53:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 20 client.8082 populate_metadata read hostname 'smithi037' 2024-05-30T06:53:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 1 --2- 172.21.15.37:0/3520185722 >> [v2:172.21.15.105:6835/3708478889,v1:172.21.15.105:6837/3708478889] conn(0x55c644b7e5e0 0x55c644bad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 4 client.8082 mds_command: new command op to 7932 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T06:53:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f190354e000 1 -- 172.21.15.37:0/3520185722 --> [v2:172.21.15.105:6835/3708478889,v1:172.21.15.105:6837/3708478889] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c644935bc0 con 0x55c644b7e5e0 2024-05-30T06:53:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18fd600640 1 --2- 172.21.15.37:0/3520185722 >> [v2:172.21.15.105:6835/3708478889,v1:172.21.15.105:6837/3708478889] conn(0x55c644b7e5e0 0x55c644bad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18fd600640 1 --2- 172.21.15.37:0/3520185722 >> [v2:172.21.15.105:6835/3708478889,v1:172.21.15.105:6837/3708478889] conn(0x55c644b7e5e0 0x55c644bad410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0bd8c3c95914810 server_cookie=e26953d6d85cb9e1 in_seq=0 out_seq=0 2024-05-30T06:53:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.714+0000 7f18dea00640 10 client.8082 ms_handle_connect on v2:172.21.15.105:6835/3708478889 2024-05-30T06:53:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f18dea00640 1 -- 172.21.15.37:0/3520185722 <== mds.0 v2:172.21.15.105:6835/3708478889 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c644935bc0 con 0x55c644b7e5e0 2024-05-30T06:53:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f18dea00640 10 client.8082 handle_command_reply: tid=0 2024-05-30T06:53:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f190354e000 1 client.8082 shutdown 2024-05-30T06:53:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f190354e000 1 -- 172.21.15.37:0/3520185722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 msgr2=0x55c644b7dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f190354e000 1 --2- 172.21.15.37:0/3520185722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 0x55c644b7dbd0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f18f00070b0 tx=0x7f18f0057bc0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f190354e000 1 -- 172.21.15.37:0/3520185722 shutdown_connections 2024-05-30T06:53:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f190354e000 1 --2- 172.21.15.37:0/3520185722 >> [v2:172.21.15.105:6835/3708478889,v1:172.21.15.105:6837/3708478889] conn(0x55c644b7e5e0 0x55c644bad410 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f190354e000 1 --2- 172.21.15.37:0/3520185722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 0x55c644b7dbd0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f190354e000 1 --2- 172.21.15.37:0/3520185722 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98120 0x55c644b7d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f190354e000 1 --2- 172.21.15.37:0/3520185722 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 0x55c644b7d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f190354e000 1 -- 172.21.15.37:0/3520185722 >> 172.21.15.37:0/3520185722 conn(0x55c644b78ec0 msgr2=0x55c644b7b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f18dea00640 0 client.8082 ms_handle_reset on v2:172.21.15.105:6835/3708478889 2024-05-30T06:53:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f190354e000 1 -- 172.21.15.37:0/3520185722 shutdown_connections 2024-05-30T06:53:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f190354e000 1 -- 172.21.15.37:0/3520185722 wait complete. 2024-05-30T06:53:55.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.718+0000 7f190354e000 20 client.8082 trim_cache size 0 max 16384 2024-05-30T06:53:55.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.734+0000 7f190354e000 1 Processor -- start 2024-05-30T06:53:55.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.734+0000 7f190354e000 1 -- start start 2024-05-30T06:53:55.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.734+0000 7f190354e000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 0x55c644c07bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.734+0000 7f190354e000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 0x55c644c08130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.734+0000 7f190354e000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98a40 0x55c644c08670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.734+0000 7f190354e000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18f815cbb0 con 0x55c644b98120 2024-05-30T06:53:55.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.734+0000 7f190354e000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f18f814eba0 con 0x55c644b98a40 2024-05-30T06:53:55.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.734+0000 7f190354e000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f18f814f1f0 con 0x55c644b4b650 2024-05-30T06:53:55.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.734+0000 7f18fcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 0x55c644c08130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 0x55c644c08130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56920/0 (socket says 172.21.15.37:56920) 2024-05-30T06:53:55.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fcc00640 1 -- 172.21.15.37:0/2939751387 learned_addr learned my addr 172.21.15.37:0/2939751387 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:55.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fe000640 1 --2- 172.21.15.37:0/2939751387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98a40 0x55c644c08670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fd600640 1 --2- 172.21.15.37:0/2939751387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 0x55c644c07bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fcc00640 1 -- 172.21.15.37:0/2939751387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 msgr2=0x55c644c07bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:55.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fcc00640 1 --2- 172.21.15.37:0/2939751387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 0x55c644c07bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fcc00640 1 -- 172.21.15.37:0/2939751387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98a40 msgr2=0x55c644c08670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:55.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fcc00640 1 --2- 172.21.15.37:0/2939751387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98a40 0x55c644c08670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fcc00640 1 -- 172.21.15.37:0/2939751387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c644922e80 con 0x55c644b98120 2024-05-30T06:53:55.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fcc00640 1 --2- 172.21.15.37:0/2939751387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 0x55c644c08130 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f18e4004f10 tx=0x7f18e4007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4ee7224515d523 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:55.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18e9600640 1 -- 172.21.15.37:0/2939751387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e401a070 con 0x55c644b98120 2024-05-30T06:53:55.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18e9600640 1 -- 172.21.15.37:0/2939751387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e4001730 con 0x55c644b98120 2024-05-30T06:53:55.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18e9600640 1 -- 172.21.15.37:0/2939751387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4001ae0 con 0x55c644b98120 2024-05-30T06:53:55.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 -- 172.21.15.37:0/2939751387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 msgr2=0x55c644c08130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 --2- 172.21.15.37:0/2939751387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 0x55c644c08130 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f18e4004f10 tx=0x7f18e4007e90 comp rx=0 tx=0).stop 2024-05-30T06:53:55.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 -- 172.21.15.37:0/2939751387 shutdown_connections 2024-05-30T06:53:55.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 --2- 172.21.15.37:0/2939751387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98a40 0x55c644c08670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 --2- 172.21.15.37:0/2939751387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98120 0x55c644c08130 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 --2- 172.21.15.37:0/2939751387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 0x55c644c07bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 -- 172.21.15.37:0/2939751387 >> 172.21.15.37:0/2939751387 conn(0x55c644b78ec0 msgr2=0x55c644b4a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:55.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 -- 172.21.15.37:0/2939751387 shutdown_connections 2024-05-30T06:53:55.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 -- 172.21.15.37:0/2939751387 wait complete. 2024-05-30T06:53:55.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 -- start start 2024-05-30T06:53:55.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 Processor -- start 2024-05-30T06:53:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 0x55c644c0b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98120 0x55c644c0bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 0x55c644bc6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c64499b730 con 0x55c644b98a40 2024-05-30T06:53:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c6449689e0 con 0x55c644b98120 2024-05-30T06:53:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55c6449a0a50 con 0x55c644b4b650 2024-05-30T06:53:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f190354e000 10 client.0 _ll_register_callbacks cb 0x7f18f0009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:53:55.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fe000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 0x55c644bc6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fe000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 0x55c644bc6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56926/0 (socket says 172.21.15.37:56926) 2024-05-30T06:53:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fe000640 1 -- 172.21.15.37:0/1890144142 learned_addr learned my addr 172.21.15.37:0/1890144142 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fd600640 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 0x55c644c0b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.738+0000 7f18fcc00640 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98120 0x55c644c0bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18fe000640 1 -- 172.21.15.37:0/1890144142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 msgr2=0x55c644c0b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18fe000640 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 0x55c644c0b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18fe000640 1 -- 172.21.15.37:0/1890144142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98120 msgr2=0x55c644c0bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18fe000640 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98120 0x55c644c0bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18fe000640 1 -- 172.21.15.37:0/1890144142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c644964b30 con 0x55c644b98a40 2024-05-30T06:53:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18fcc00640 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98120 0x55c644c0bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18fe000640 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 0x55c644bc6440 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f18f0054540 tx=0x7f18f005b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d22d6431fbf3f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18dea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:53:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18dea00640 1 -- 172.21.15.37:0/1890144142 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0065060 con 0x55c644b98a40 2024-05-30T06:53:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18dea00640 1 -- 172.21.15.37:0/1890144142 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f18f0053910 con 0x55c644b98a40 2024-05-30T06:53:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 -- 172.21.15.37:0/1890144142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18e4001730 con 0x55c644b98a40 2024-05-30T06:53:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18dea00640 1 -- 172.21.15.37:0/1890144142 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f18f006b050 con 0x55c644b98a40 2024-05-30T06:53:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 10 client.8088 fetch_fsmap learned FSMap version 55 2024-05-30T06:53:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 -- 172.21.15.37:0/1890144142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) -- 0x55c644a1d5b0 con 0x55c644b98a40 2024-05-30T06:53:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18dea00640 1 -- 172.21.15.37:0/1890144142 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e4001730 con 0x55c644b98a40 2024-05-30T06:53:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18dea00640 1 -- 172.21.15.37:0/1890144142 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 55) ==== 3494+0+0 (secure 0 0 0) 0x7f18f007d030 con 0x55c644b98a40 2024-05-30T06:53:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 10 client.8088 fetch_fsmap finished waiting for FSMap version 55 2024-05-30T06:53:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 10 client.8088 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-30T06:53:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 20 client.8088 populate_metadata read hostname 'smithi037' 2024-05-30T06:53:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.105:6835/3708478889,v1:172.21.15.105:6837/3708478889] conn(0x55c644bc6da0 0x55c644bc7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 4 client.8088 mds_command: new command op to 7932 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T06:53:55.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 -- 172.21.15.37:0/1890144142 --> [v2:172.21.15.105:6835/3708478889,v1:172.21.15.105:6837/3708478889] -- command(tid 0: {"prefix": "status"}) -- 0x55c6449a9e40 con 0x55c644bc6da0 2024-05-30T06:53:55.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18fd600640 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.105:6835/3708478889,v1:172.21.15.105:6837/3708478889] conn(0x55c644bc6da0 0x55c644bc7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18fd600640 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.105:6835/3708478889,v1:172.21.15.105:6837/3708478889] conn(0x55c644bc6da0 0x55c644bc7180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a8e3f0ed79d6b server_cookie=ba2abf2ab0310f95 in_seq=0 out_seq=0 2024-05-30T06:53:55.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18dea00640 10 client.8088 ms_handle_connect on v2:172.21.15.105:6835/3708478889 2024-05-30T06:53:55.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18dea00640 1 -- 172.21.15.37:0/1890144142 <== mds.0 v2:172.21.15.105:6835/3708478889 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x55c6449a9e40 con 0x55c644bc6da0 2024-05-30T06:53:55.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18dea00640 10 client.8088 handle_command_reply: tid=0 2024-05-30T06:53:55.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 client.8088 shutdown 2024-05-30T06:53:55.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 -- 172.21.15.37:0/1890144142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 msgr2=0x55c644bc6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 0x55c644bc6440 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f18f0054540 tx=0x7f18f005b040 comp rx=0 tx=0).stop 2024-05-30T06:53:55.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 -- 172.21.15.37:0/1890144142 shutdown_connections 2024-05-30T06:53:55.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.105:6835/3708478889,v1:172.21.15.105:6837/3708478889] conn(0x55c644bc6da0 0x55c644bc7180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c644b98a40 0x55c644bc6440 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c644b98120 0x55c644c0bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 --2- 172.21.15.37:0/1890144142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c644b4b650 0x55c644c0b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f18dea00640 0 client.8088 ms_handle_reset on v2:172.21.15.105:6835/3708478889 2024-05-30T06:53:55.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 -- 172.21.15.37:0/1890144142 >> 172.21.15.37:0/1890144142 conn(0x55c644b78ec0 msgr2=0x55c644bad410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:55.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 -- 172.21.15.37:0/1890144142 shutdown_connections 2024-05-30T06:53:55.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 1 -- 172.21.15.37:0/1890144142 wait complete. 2024-05-30T06:53:55.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f190354e000 20 client.8088 trim_cache size 0 max 16384 2024-05-30T06:53:55.748 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:53:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:53:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-30T06:53:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7932, 2024-05-30T06:53:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-30T06:53:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-30T06:53:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-30T06:53:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.555269613, 2024-05-30T06:53:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 55, 2024-05-30T06:53:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 90, 2024-05-30T06:53:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 88, 2024-05-30T06:53:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 15.408739981 2024-05-30T06:53:55.750 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:53:55.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f1900000640 1 -- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18d8069580 msgr2=0x7f18d806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f1900000640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18d8069580 0x7f18d806ba40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0ad000 tx=0x7f18ec008040 comp rx=0 tx=0).stop 2024-05-30T06:53:55.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f1900000640 1 -- 172.21.15.37:0/3959829733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f8161f30 msgr2=0x7f18f81f8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f1900000640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f8161f30 0x7f18f81f8d30 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f18f000ef90 tx=0x7f18f000c490 comp rx=0 tx=0).stop 2024-05-30T06:53:55.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f1900000640 1 -- 172.21.15.37:0/3959829733 shutdown_connections 2024-05-30T06:53:55.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f1900000640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f8161f30 0x7f18f81f8d30 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f1900000640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18d8069580 0x7f18d806ba40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f1900000640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18f8155da0 0x7f18f815db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f1900000640 1 --2- 172.21.15.37:0/3959829733 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18f806f770 0x7f18f81f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.742+0000 7f1900000640 1 -- 172.21.15.37:0/3959829733 >> 172.21.15.37:0/3959829733 conn(0x7f18f806bf60 msgr2=0x7f18f8156520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:55.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.746+0000 7f1900000640 1 -- 172.21.15.37:0/3959829733 shutdown_connections 2024-05-30T06:53:55.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.746+0000 7f1900000640 1 -- 172.21.15.37:0/3959829733 wait complete. 2024-05-30T06:53:55.765 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T06:53:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd040800640 1 Processor -- start 2024-05-30T06:53:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd040800640 1 -- start start 2024-05-30T06:53:55.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd040800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd03809b9a0 0x7fd0381625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd040800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd038162ae0 0x7fd0380ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd040800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd03809abe0 con 0x7fd03815e930 2024-05-30T06:53:55.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd040800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd038162f50 con 0x7fd03809b9a0 2024-05-30T06:53:55.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd040800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd03809aec0 con 0x7fd038162ae0 2024-05-30T06:53:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd03d400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd03809b9a0 0x7fd0381625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd03de00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd03815e930 0x7fd0380d1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53488/0 (socket says 172.21.15.37:53488) 2024-05-30T06:53:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd03de00640 1 -- 172.21.15.37:0/351740616 learned_addr learned my addr 172.21.15.37:0/351740616 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd03e800640 1 --2- 172.21.15.37:0/351740616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd038162ae0 0x7fd0380ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd03d400640 1 -- 172.21.15.37:0/351740616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd038162ae0 msgr2=0x7fd0380ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd03d400640 1 --2- 172.21.15.37:0/351740616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd038162ae0 0x7fd0380ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd03d400640 1 -- 172.21.15.37:0/351740616 >> v1:172.21.15.37:6789/0 conn(0x7fd03815e930 legacy=0x7fd0380d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd03d400640 1 -- 172.21.15.37:0/351740616 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03809b1a0 con 0x7fd03809b9a0 2024-05-30T06:53:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd03e800640 1 --2- 172.21.15.37:0/351740616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd038162ae0 0x7fd0380ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.906+0000 7fd03ca00640 1 -- 172.21.15.37:0/351740616 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2157596528 0 0) 0x7fd03809abe0 con 0x7fd03815e930 2024-05-30T06:53:55.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.910+0000 7fd03d400640 1 --2- 172.21.15.37:0/351740616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03809b9a0 0x7fd0381625a0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fd0280097c0 tx=0x7fd02801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb45ad1549dd402 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:55.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.910+0000 7fd03ca00640 1 -- 172.21.15.37:0/351740616 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0280b2070 con 0x7fd03809b9a0 2024-05-30T06:53:55.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.910+0000 7fd03ca00640 1 -- 172.21.15.37:0/351740616 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0280ad640 con 0x7fd03809b9a0 2024-05-30T06:53:55.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.910+0000 7fd03ca00640 1 -- 172.21.15.37:0/351740616 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0280ada10 con 0x7fd03809b9a0 2024-05-30T06:53:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.910+0000 7fd040800640 1 -- 172.21.15.37:0/351740616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03809b9a0 msgr2=0x7fd0381625a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.910+0000 7fd040800640 1 --2- 172.21.15.37:0/351740616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03809b9a0 0x7fd0381625a0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fd0280097c0 tx=0x7fd02801c4a0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.910+0000 7fd040800640 1 -- 172.21.15.37:0/351740616 shutdown_connections 2024-05-30T06:53:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.910+0000 7fd040800640 1 --2- 172.21.15.37:0/351740616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd038162ae0 0x7fd0380ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.910+0000 7fd040800640 1 --2- 172.21.15.37:0/351740616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03809b9a0 0x7fd0381625a0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.910+0000 7fd040800640 1 -- 172.21.15.37:0/351740616 >> 172.21.15.37:0/351740616 conn(0x7fd0380b4100 msgr2=0x7fd0380b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.910+0000 7fd040800640 1 -- 172.21.15.37:0/351740616 shutdown_connections 2024-05-30T06:53:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.910+0000 7fd040800640 1 -- 172.21.15.37:0/351740616 wait complete. 2024-05-30T06:53:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd040800640 1 Processor -- start 2024-05-30T06:53:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd040800640 1 -- start start 2024-05-30T06:53:55.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd040800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03809b9a0 0x7fd038153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd040800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03815e930 0x7fd03814baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd040800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd038162ae0 0x7fd03815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd040800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd03806ddc0 con 0x7fd03809b9a0 2024-05-30T06:53:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd040800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd03806dc40 con 0x7fd03815e930 2024-05-30T06:53:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd040800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd03815ed10 con 0x7fd038162ae0 2024-05-30T06:53:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd03de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03809b9a0 0x7fd038153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd03de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03809b9a0 0x7fd038153cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56954/0 (socket says 172.21.15.37:56954) 2024-05-30T06:53:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd03de00640 1 -- 172.21.15.37:0/2890514206 learned_addr learned my addr 172.21.15.37:0/2890514206 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd03d400640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03815e930 0x7fd03814baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd03e800640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd038162ae0 0x7fd03815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd03de00640 1 -- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd038162ae0 msgr2=0x7fd03815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd03de00640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd038162ae0 0x7fd03815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd03de00640 1 -- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03815e930 msgr2=0x7fd03814baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd03de00640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03815e930 0x7fd03814baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd03de00640 1 -- 172.21.15.37:0/2890514206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd038152f00 con 0x7fd03809b9a0 2024-05-30T06:53:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd03de00640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03809b9a0 0x7fd038153cc0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00c580 tx=0x7fd02c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd032000640 1 -- 172.21.15.37:0/2890514206 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c017070 con 0x7fd03809b9a0 2024-05-30T06:53:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd032000640 1 -- 172.21.15.37:0/2890514206 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02c005d10 con 0x7fd03809b9a0 2024-05-30T06:53:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd040800640 1 -- 172.21.15.37:0/2890514206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0381531e0 con 0x7fd03809b9a0 2024-05-30T06:53:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd032000640 1 -- 172.21.15.37:0/2890514206 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c007330 con 0x7fd03809b9a0 2024-05-30T06:53:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd040800640 1 -- 172.21.15.37:0/2890514206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0381537a0 con 0x7fd03809b9a0 2024-05-30T06:53:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.914+0000 7fd040800640 1 -- 172.21.15.37:0/2890514206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd038068b20 con 0x7fd03809b9a0 2024-05-30T06:53:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.918+0000 7fd032000640 1 -- 172.21.15.37:0/2890514206 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fd02c01a070 con 0x7fd03809b9a0 2024-05-30T06:53:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.918+0000 7fd032000640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd01c069580 0x7fd01c06ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.918+0000 7fd032000640 1 -- 172.21.15.37:0/2890514206 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7fd02c084d80 con 0x7fd03809b9a0 2024-05-30T06:53:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.918+0000 7fd03d400640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd01c069580 0x7fd01c06ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.918+0000 7fd03d400640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd01c069580 0x7fd01c06ba40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd0280af000 tx=0x7fd0280a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:55.922+0000 7fd032000640 1 -- 172.21.15.37:0/2890514206 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd02c056350 con 0x7fd03809b9a0 2024-05-30T06:53:56.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd040800640 1 -- 172.21.15.37:0/2890514206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd03806e350 con 0x7fd03809b9a0 2024-05-30T06:53:56.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd032000640 1 -- 172.21.15.37:0/2890514206 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) ==== 53+0+73 (secure 0 0 0) 0x7fd02c05a650 con 0x7fd03809b9a0 2024-05-30T06:53:56.127 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T06:53:56.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd040800640 1 -- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd01c069580 msgr2=0x7fd01c06ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:56.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd040800640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd01c069580 0x7fd01c06ba40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd0280af000 tx=0x7fd0280a7070 comp rx=0 tx=0).stop 2024-05-30T06:53:56.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd040800640 1 -- 172.21.15.37:0/2890514206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03809b9a0 msgr2=0x7fd038153cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:56.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd040800640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03809b9a0 0x7fd038153cc0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00c580 tx=0x7fd02c00ca40 comp rx=0 tx=0).stop 2024-05-30T06:53:56.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd040800640 1 -- 172.21.15.37:0/2890514206 shutdown_connections 2024-05-30T06:53:56.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd040800640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd038162ae0 0x7fd03815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:56.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd040800640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd01c069580 0x7fd01c06ba40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:56.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd040800640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd03815e930 0x7fd03814baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:56.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd040800640 1 --2- 172.21.15.37:0/2890514206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd03809b9a0 0x7fd038153cc0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:56.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd040800640 1 -- 172.21.15.37:0/2890514206 >> 172.21.15.37:0/2890514206 conn(0x7fd0380b4100 msgr2=0x7fd0380716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:56.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd040800640 1 -- 172.21.15.37:0/2890514206 shutdown_connections 2024-05-30T06:53:56.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56.126+0000 7fd040800640 1 -- 172.21.15.37:0/2890514206 wait complete. 2024-05-30T06:53:56.148 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-30T06:53:56.148 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T06:53:56.148 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-30T06:53:56.149 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T06:53:56.149 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T06:53:56.149 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-30T06:53:56.149 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-30T06:53:56.149 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T06:53:56.149 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:53:56.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:53:56.149 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-30T06:53:56.159 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:53:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:53:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:53:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:53:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-30T06:53:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:53:56.159 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:53:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:53:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-30T06:53:56.159 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41768sec preferred_lft 41768sec 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T06:53:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:30:63:12:21 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:53:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T06:53:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T06:53:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:53:56.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:53:56.162 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T06:53:56.222 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-30T06:53:56.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:53:56.224 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-30T06:53:56.277 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-30T06:53:56.278 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T06:53:56.278 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T06:53:56.278 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T06:53:56.278 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T06:53:56.278 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T06:53:56.278 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:53:56.278 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:53:56.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T06:53:56.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T06:53:56.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T06:53:56.279 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:53:56.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:53:56.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:53:56.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:53:56.418 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T06:53:56.428 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T06:53:56.428 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T06:53:56.428 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:53:56.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:53:56.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-30T06:53:56.492 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:53:56.492 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T06:53:56.558 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:53:56.559 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:53:56.559 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:53:56.608 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T06:53:56.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:53:56.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:53:56.697 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:53:56.698 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:53:56.711 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:53:56.711 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:53:56.711 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-05-30T06:53:56.711 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@393250aa-2b42-4955-adf1-f790b8ba4d8c.cephfs=/ 2024-05-30T06:53:56.711 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-05-30T06:53:56.715 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T06:53:56.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:53:56.715 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:53:56.736 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:53:56.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:53:56.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:53:56.844 INFO:teuthology.orchestra.run.smithi037.stdout:client8100 2024-05-30T06:53:56.844 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:53:56.844 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:53:56.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T06:53:57.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.038+0000 7f557dc00640 1 Processor -- start 2024-05-30T06:53:57.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.038+0000 7f557dc00640 1 -- start start 2024-05-30T06:53:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.042+0000 7f557dc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f55780cd400 0x7f557806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.042+0000 7f557dc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55780ce030 con 0x7f55781590c0 2024-05-30T06:53:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.042+0000 7f557dc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f557815f230 con 0x7f557806f5a0 2024-05-30T06:53:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.042+0000 7f557dc00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f557815f510 con 0x7f55780cd400 2024-05-30T06:53:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.042+0000 7f5576a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f55781590c0 0x7f55780cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53498/0 (socket says 172.21.15.37:53498) 2024-05-30T06:53:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.042+0000 7f5576a00640 1 -- 172.21.15.37:0/4275300477 learned_addr learned my addr 172.21.15.37:0/4275300477 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.042+0000 7f556fe00640 1 --2- 172.21.15.37:0/4275300477 >> v2:172.21.15.37:3300/0 conn(0x7f55780cd400 0x7f557806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:57.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.042+0000 7f5576000640 1 -- 172.21.15.37:0/4275300477 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 285232746 0 0) 0x7f55780ce030 con 0x7f55781590c0 2024-05-30T06:53:57.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.042+0000 7f5576000640 1 -- 172.21.15.37:0/4275300477 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f555c005740 con 0x7f55781590c0 2024-05-30T06:53:57.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.042+0000 7f556fe00640 1 -- 172.21.15.37:0/4275300477 >> v1:172.21.15.105:6789/0 conn(0x7f557806f5a0 legacy=0x7f55780b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:57.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.042+0000 7f556fe00640 1 -- 172.21.15.37:0/4275300477 >> v1:172.21.15.37:6789/0 conn(0x7f55781590c0 legacy=0x7f55780cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:57.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.042+0000 7f556fe00640 1 -- 172.21.15.37:0/4275300477 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557815f7f0 con 0x7f55780cd400 2024-05-30T06:53:57.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.046+0000 7f556fe00640 1 --2- 172.21.15.37:0/4275300477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55780cd400 0x7f557806f060 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f55600097c0 tx=0x7f556001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa01fc5a48b9143e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.046+0000 7f5576000640 1 -- 172.21.15.37:0/4275300477 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55600b0070 con 0x7f55780cd400 2024-05-30T06:53:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.046+0000 7f5576000640 1 -- 172.21.15.37:0/4275300477 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55600ab600 con 0x7f55780cd400 2024-05-30T06:53:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.046+0000 7f5576000640 1 -- 172.21.15.37:0/4275300477 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55600ab9b0 con 0x7f55780cd400 2024-05-30T06:53:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.046+0000 7f557dc00640 1 -- 172.21.15.37:0/4275300477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55780cd400 msgr2=0x7f557806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.046+0000 7f557dc00640 1 --2- 172.21.15.37:0/4275300477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55780cd400 0x7f557806f060 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f55600097c0 tx=0x7f556001c380 comp rx=0 tx=0).stop 2024-05-30T06:53:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.046+0000 7f557dc00640 1 -- 172.21.15.37:0/4275300477 shutdown_connections 2024-05-30T06:53:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.046+0000 7f557dc00640 1 --2- 172.21.15.37:0/4275300477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55780cd400 0x7f557806f060 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.046+0000 7f557dc00640 1 -- 172.21.15.37:0/4275300477 >> 172.21.15.37:0/4275300477 conn(0x7f557806bf60 msgr2=0x7f55780b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.046+0000 7f557dc00640 1 -- 172.21.15.37:0/4275300477 shutdown_connections 2024-05-30T06:53:57.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.046+0000 7f557dc00640 1 -- 172.21.15.37:0/4275300477 wait complete. 2024-05-30T06:53:57.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.046+0000 7f557dc00640 1 Processor -- start 2024-05-30T06:53:57.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.046+0000 7f557dc00640 1 -- start start 2024-05-30T06:53:57.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f557dc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f557806f5a0 0x7f55781460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:57.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f557dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55780cd400 0x7f55781f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:57.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f557dc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55781590c0 0x7f5578158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:57.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f557dc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f557806df50 con 0x7f55780cd400 2024-05-30T06:53:57.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f557dc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f557806f9b0 con 0x7f557806f5a0 2024-05-30T06:53:57.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f557dc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f557806e0d0 con 0x7f55781590c0 2024-05-30T06:53:57.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f556fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55780cd400 0x7f55781f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:57.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f556fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55780cd400 0x7f55781f7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56976/0 (socket says 172.21.15.37:56976) 2024-05-30T06:53:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f556fe00640 1 -- 172.21.15.37:0/1533182036 learned_addr learned my addr 172.21.15.37:0/1533182036 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f5576a00640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f557806f5a0 0x7f55781460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f5577400640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55781590c0 0x7f5578158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f556fe00640 1 -- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55781590c0 msgr2=0x7f5578158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f556fe00640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55781590c0 0x7f5578158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f556fe00640 1 -- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f557806f5a0 msgr2=0x7f55781460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f556fe00640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f557806f5a0 0x7f55781460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f556fe00640 1 -- 172.21.15.37:0/1533182036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557814a510 con 0x7f55780cd400 2024-05-30T06:53:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f556fe00640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55780cd400 0x7f55781f7960 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f55600ae040 tx=0x7f556001abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f556ea00640 1 -- 172.21.15.37:0/1533182036 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55600b0050 con 0x7f55780cd400 2024-05-30T06:53:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f556ea00640 1 -- 172.21.15.37:0/1533182036 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55600b1040 con 0x7f55780cd400 2024-05-30T06:53:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f556ea00640 1 -- 172.21.15.37:0/1533182036 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560006e20 con 0x7f55780cd400 2024-05-30T06:53:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f557dc00640 1 -- 172.21.15.37:0/1533182036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f557814a7f0 con 0x7f55780cd400 2024-05-30T06:53:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f557dc00640 1 -- 172.21.15.37:0/1533182036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f557814adb0 con 0x7f55780cd400 2024-05-30T06:53:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f557dc00640 1 -- 172.21.15.37:0/1533182036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5578068d40 con 0x7f55780cd400 2024-05-30T06:53:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.050+0000 7f556ea00640 1 -- 172.21.15.37:0/1533182036 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f55600be060 con 0x7f55780cd400 2024-05-30T06:53:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.054+0000 7f556ea00640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5554069580 0x7f555406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.054+0000 7f556ea00640 1 -- 172.21.15.37:0/1533182036 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f556011f1a0 con 0x7f55780cd400 2024-05-30T06:53:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.054+0000 7f5576a00640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5554069580 0x7f555406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.054+0000 7f5576a00640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5554069580 0x7f555406ba40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f55680011f0 tx=0x7f5568007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.058+0000 7f556ea00640 1 -- 172.21.15.37:0/1533182036 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5560016090 con 0x7f55780cd400 2024-05-30T06:53:57.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.258+0000 7f557dc00640 1 -- 172.21.15.37:0/1533182036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f55780b31b0 con 0x7f55780cd400 2024-05-30T06:53:57.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.758+0000 7f556ea00640 1 -- 172.21.15.37:0/1533182036 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v56) ==== 136+0+0 (secure 0 0 0) 0x7f55600f07f0 con 0x7f55780cd400 2024-05-30T06:53:57.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.762+0000 7f557dc00640 1 -- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5554069580 msgr2=0x7f555406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:57.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.762+0000 7f557dc00640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5554069580 0x7f555406ba40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f55680011f0 tx=0x7f5568007d40 comp rx=0 tx=0).stop 2024-05-30T06:53:57.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.762+0000 7f557dc00640 1 -- 172.21.15.37:0/1533182036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55780cd400 msgr2=0x7f55781f7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:57.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.762+0000 7f557dc00640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55780cd400 0x7f55781f7960 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f55600ae040 tx=0x7f556001abc0 comp rx=0 tx=0).stop 2024-05-30T06:53:57.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.762+0000 7f557dc00640 1 -- 172.21.15.37:0/1533182036 shutdown_connections 2024-05-30T06:53:57.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.762+0000 7f557dc00640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55781590c0 0x7f5578158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:57.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.762+0000 7f557dc00640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55780cd400 0x7f55781f7960 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:57.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.762+0000 7f557dc00640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5554069580 0x7f555406ba40 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:57.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.762+0000 7f557dc00640 1 --2- 172.21.15.37:0/1533182036 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f557806f5a0 0x7f55781460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:57.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.762+0000 7f557dc00640 1 -- 172.21.15.37:0/1533182036 >> 172.21.15.37:0/1533182036 conn(0x7f557806bf60 msgr2=0x7f557815e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:57.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.762+0000 7f557dc00640 1 -- 172.21.15.37:0/1533182036 shutdown_connections 2024-05-30T06:53:57.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.762+0000 7f557dc00640 1 -- 172.21.15.37:0/1533182036 wait complete. 2024-05-30T06:53:57.784 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:53:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.926+0000 7f5a4fc00640 1 Processor -- start 2024-05-30T06:53:57.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.926+0000 7f5a4fc00640 1 -- start start 2024-05-30T06:53:57.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a4fc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a480b59d0 0x7f5a480b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:57.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a4fc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a4815d350 0x7f5a48160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:57.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a4fc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a480b62f0 con 0x7f5a4815d7b0 2024-05-30T06:53:57.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a4fc00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5a48142030 con 0x7f5a480b59d0 2024-05-30T06:53:57.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a4fc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5a48142310 con 0x7f5a4815d350 2024-05-30T06:53:57.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a4d200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a480b59d0 0x7f5a480b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:57.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a4d200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a480b59d0 0x7f5a480b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60466/0 (socket says 172.21.15.37:60466) 2024-05-30T06:53:57.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a4d200640 1 -- 172.21.15.37:0/2427741895 learned_addr learned my addr 172.21.15.37:0/2427741895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:57.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a3fe00640 1 --2- 172.21.15.37:0/2427741895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a4815d350 0x7f5a48160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:57.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a4d200640 1 -- 172.21.15.37:0/2427741895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a4815d350 msgr2=0x7f5a48160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:57.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a4d200640 1 --2- 172.21.15.37:0/2427741895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a4815d350 0x7f5a48160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:57.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a4d200640 1 -- 172.21.15.37:0/2427741895 >> v1:172.21.15.105:6789/0 conn(0x7f5a4815d7b0 legacy=0x7f5a481607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:57.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a4d200640 1 -- 172.21.15.37:0/2427741895 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a481425f0 con 0x7f5a480b59d0 2024-05-30T06:53:57.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.930+0000 7f5a3fe00640 1 --2- 172.21.15.37:0/2427741895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a4815d350 0x7f5a48160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:53:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4d200640 1 --2- 172.21.15.37:0/2427741895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a480b59d0 0x7f5a480b5db0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009870 tx=0x7f5a3801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535d83b2f36e06da server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a47e00640 1 -- 172.21.15.37:0/2427741895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380b5070 con 0x7f5a480b59d0 2024-05-30T06:53:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a47e00640 1 -- 172.21.15.37:0/2427741895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a380a89d0 con 0x7f5a480b59d0 2024-05-30T06:53:57.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a47e00640 1 -- 172.21.15.37:0/2427741895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380a8da0 con 0x7f5a480b59d0 2024-05-30T06:53:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2427741895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a480b59d0 msgr2=0x7f5a480b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 --2- 172.21.15.37:0/2427741895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a480b59d0 0x7f5a480b5db0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f5a38009870 tx=0x7f5a3801ed10 comp rx=0 tx=0).stop 2024-05-30T06:53:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2427741895 shutdown_connections 2024-05-30T06:53:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 --2- 172.21.15.37:0/2427741895 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a4815d350 0x7f5a48160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 --2- 172.21.15.37:0/2427741895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a480b59d0 0x7f5a480b5db0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2427741895 >> 172.21.15.37:0/2427741895 conn(0x7f5a4806bf60 msgr2=0x7f5a480b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2427741895 shutdown_connections 2024-05-30T06:53:57.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2427741895 wait complete. 2024-05-30T06:53:57.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 Processor -- start 2024-05-30T06:53:57.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 -- start start 2024-05-30T06:53:57.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a480b59d0 0x7f5a48158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:57.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a4815d350 0x7f5a4813c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:57.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a4815d7b0 0x7f5a481f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:57.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4813fe60 con 0x7f5a480b59d0 2024-05-30T06:53:57.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4813fce0 con 0x7f5a4815d7b0 2024-05-30T06:53:57.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4fc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5a480aff20 con 0x7f5a4815d350 2024-05-30T06:53:57.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.934+0000 7f5a4d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a480b59d0 0x7f5a48158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:57.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a4d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a480b59d0 0x7f5a48158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60478/0 (socket says 172.21.15.37:60478) 2024-05-30T06:53:57.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a4d200640 1 -- 172.21.15.37:0/2671949823 learned_addr learned my addr 172.21.15.37:0/2671949823 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:57.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a3fe00640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a4815d350 0x7f5a4813c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:57.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a4dc00640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a4815d7b0 0x7f5a481f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:57.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a4d200640 1 -- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a4815d350 msgr2=0x7f5a4813c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:57.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a4d200640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a4815d350 0x7f5a4813c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:57.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a4d200640 1 -- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a4815d7b0 msgr2=0x7f5a481f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:57.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a4d200640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a4815d7b0 0x7f5a481f53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:57.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a4d200640 1 -- 172.21.15.37:0/2671949823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4813cd80 con 0x7f5a480b59d0 2024-05-30T06:53:57.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a4d200640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a480b59d0 0x7f5a48158830 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f5a380b3040 tx=0x7f5a3801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a45600640 1 -- 172.21.15.37:0/2671949823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380c0070 con 0x7f5a480b59d0 2024-05-30T06:53:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a45600640 1 -- 172.21.15.37:0/2671949823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a380b08f0 con 0x7f5a480b59d0 2024-05-30T06:53:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a45600640 1 -- 172.21.15.37:0/2671949823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a380b5040 con 0x7f5a480b59d0 2024-05-30T06:53:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2671949823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4813d020 con 0x7f5a480b59d0 2024-05-30T06:53:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2671949823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4813d5e0 con 0x7f5a480b59d0 2024-05-30T06:53:57.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2671949823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a48068bc0 con 0x7f5a480b59d0 2024-05-30T06:53:57.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.938+0000 7f5a45600640 1 -- 172.21.15.37:0/2671949823 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f5a380b0cc0 con 0x7f5a480b59d0 2024-05-30T06:53:57.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.942+0000 7f5a45600640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a24069580 0x7f5a2406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:57.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.942+0000 7f5a45600640 1 -- 172.21.15.37:0/2671949823 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f5a381226a0 con 0x7f5a480b59d0 2024-05-30T06:53:57.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.942+0000 7f5a3fe00640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a24069580 0x7f5a2406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:57.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.942+0000 7f5a3fe00640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a24069580 0x7f5a2406ba40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5a4813bfa0 tx=0x7f5a30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:57.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:57.946+0000 7f5a45600640 1 -- 172.21.15.37:0/2671949823 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5a38018870 con 0x7f5a480b59d0 2024-05-30T06:53:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.134+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2671949823 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f5a4806f0a0 con 0x7f5a24069580 2024-05-30T06:53:58.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.134+0000 7f5a45600640 1 -- 172.21.15.37:0/2671949823 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f5a4806f0a0 con 0x7f5a24069580 2024-05-30T06:53:58.135 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:53:58.135 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:53:58.135 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:53:58.135 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:53:58.135 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:53:58.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.138+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a24069580 msgr2=0x7f5a2406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.138+0000 7f5a4fc00640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a24069580 0x7f5a2406ba40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5a4813bfa0 tx=0x7f5a30008040 comp rx=0 tx=0).stop 2024-05-30T06:53:58.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.138+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2671949823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a480b59d0 msgr2=0x7f5a48158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.138+0000 7f5a4fc00640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a480b59d0 0x7f5a48158830 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f5a380b3040 tx=0x7f5a3801bab0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.138+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2671949823 shutdown_connections 2024-05-30T06:53:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.138+0000 7f5a4fc00640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5a24069580 0x7f5a2406ba40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.138+0000 7f5a4fc00640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5a4815d7b0 0x7f5a481f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.138+0000 7f5a4fc00640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5a4815d350 0x7f5a4813c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.138+0000 7f5a4fc00640 1 --2- 172.21.15.37:0/2671949823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a480b59d0 0x7f5a48158830 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.138+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2671949823 >> 172.21.15.37:0/2671949823 conn(0x7f5a4806bf60 msgr2=0x7f5a4815cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.138+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2671949823 shutdown_connections 2024-05-30T06:53:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.138+0000 7f5a4fc00640 1 -- 172.21.15.37:0/2671949823 wait complete. 2024-05-30T06:53:58.157 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:53:58.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.298+0000 7fafdf200640 1 Processor -- start 2024-05-30T06:53:58.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.298+0000 7fafdf200640 1 -- start start 2024-05-30T06:53:58.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.302+0000 7fafdf200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafd8155da0 0x7fafd80cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:58.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.302+0000 7fafdf200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd815f310 con 0x7fafd806f770 2024-05-30T06:53:58.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.302+0000 7fafdf200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd815f5f0 con 0x7fafd80cd440 2024-05-30T06:53:58.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.302+0000 7fafdf200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fafd815f8d0 con 0x7fafd8155da0 2024-05-30T06:53:58.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.302+0000 7fafd7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafd8155da0 0x7fafd80cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:58.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.302+0000 7fafd7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafd8155da0 0x7fafd80cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60484/0 (socket says 172.21.15.37:60484) 2024-05-30T06:53:58.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.302+0000 7fafdd200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fafd806f770 0x7fafd80b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53990/0 (socket says 172.21.15.37:53990) 2024-05-30T06:53:58.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.302+0000 7fafd7e00640 1 -- 172.21.15.37:0/1131958617 learned_addr learned my addr 172.21.15.37:0/1131958617 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:58.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.302+0000 7fafd7e00640 1 -- 172.21.15.37:0/1131958617 >> v1:172.21.15.105:6789/0 conn(0x7fafd80cd440 legacy=0x7fafd806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:58.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.302+0000 7fafd7e00640 1 -- 172.21.15.37:0/1131958617 >> v1:172.21.15.37:6789/0 conn(0x7fafd806f770 legacy=0x7fafd80b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.302+0000 7fafd7e00640 1 -- 172.21.15.37:0/1131958617 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd815fbb0 con 0x7fafd8155da0 2024-05-30T06:53:58.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.302+0000 7fafd7400640 1 -- 172.21.15.37:0/1131958617 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 29728869 0 0) 0x7fafd815f310 con 0x7fafd806f770 2024-05-30T06:53:58.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.306+0000 7fafd7e00640 1 --2- 172.21.15.37:0/1131958617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd8155da0 0x7fafd80cd950 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009870 tx=0x7fafc801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d85ddfb0962582 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:58.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.306+0000 7fafd7400640 1 -- 172.21.15.37:0/1131958617 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc80b0070 con 0x7fafd8155da0 2024-05-30T06:53:58.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.306+0000 7fafd7400640 1 -- 172.21.15.37:0/1131958617 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc80ab600 con 0x7fafd8155da0 2024-05-30T06:53:58.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.306+0000 7fafd7400640 1 -- 172.21.15.37:0/1131958617 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc80ab9d0 con 0x7fafd8155da0 2024-05-30T06:53:58.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.306+0000 7fafdf200640 1 -- 172.21.15.37:0/1131958617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd8155da0 msgr2=0x7fafd80cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.306+0000 7fafdf200640 1 --2- 172.21.15.37:0/1131958617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd8155da0 0x7fafd80cd950 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009870 tx=0x7fafc801c440 comp rx=0 tx=0).stop 2024-05-30T06:53:58.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.306+0000 7fafdf200640 1 -- 172.21.15.37:0/1131958617 shutdown_connections 2024-05-30T06:53:58.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.306+0000 7fafdf200640 1 --2- 172.21.15.37:0/1131958617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd8155da0 0x7fafd80cd950 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.306+0000 7fafdf200640 1 -- 172.21.15.37:0/1131958617 >> 172.21.15.37:0/1131958617 conn(0x7fafd806bf60 msgr2=0x7fafd80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:58.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.306+0000 7fafdf200640 1 -- 172.21.15.37:0/1131958617 shutdown_connections 2024-05-30T06:53:58.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.306+0000 7fafdf200640 1 -- 172.21.15.37:0/1131958617 wait complete. 2024-05-30T06:53:58.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.306+0000 7fafdf200640 1 Processor -- start 2024-05-30T06:53:58.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.306+0000 7fafdf200640 1 -- start start 2024-05-30T06:53:58.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafdf200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd806f770 0x7fafd8141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafdf200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd8155da0 0x7fafd8150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafdf200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafd814f080 0x7fafd81594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafdf200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fafd8169920 con 0x7fafd806f770 2024-05-30T06:53:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafdf200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fafd81697a0 con 0x7fafd8155da0 2024-05-30T06:53:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafdf200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fafd8169aa0 con 0x7fafd814f080 2024-05-30T06:53:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafd7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd806f770 0x7fafd8141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafd7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd806f770 0x7fafd8141fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60488/0 (socket says 172.21.15.37:60488) 2024-05-30T06:53:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafd7e00640 1 -- 172.21.15.37:0/1523170031 learned_addr learned my addr 172.21.15.37:0/1523170031 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafcf400640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd8155da0 0x7fafd8150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafdd200640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafd814f080 0x7fafd81594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafd7e00640 1 -- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafd814f080 msgr2=0x7fafd81594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafd7e00640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafd814f080 0x7fafd81594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafd7e00640 1 -- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd8155da0 msgr2=0x7fafd8150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafd7e00640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd8155da0 0x7fafd8150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafd7e00640 1 -- 172.21.15.37:0/1523170031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd8151340 con 0x7fafd806f770 2024-05-30T06:53:58.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafcf400640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd8155da0 0x7fafd8150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:58.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafd7e00640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd806f770 0x7fafd8141fe0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fafc8019050 tx=0x7fafc801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafd4c00640 1 -- 172.21.15.37:0/1523170031 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc80ba020 con 0x7fafd806f770 2024-05-30T06:53:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafd4c00640 1 -- 172.21.15.37:0/1523170031 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc80b6620 con 0x7fafd806f770 2024-05-30T06:53:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafdf200640 1 -- 172.21.15.37:0/1523170031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd81563e0 con 0x7fafd806f770 2024-05-30T06:53:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafd4c00640 1 -- 172.21.15.37:0/1523170031 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc80b0040 con 0x7fafd806f770 2024-05-30T06:53:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafdf200640 1 -- 172.21.15.37:0/1523170031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd81569a0 con 0x7fafd806f770 2024-05-30T06:53:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafdf200640 1 -- 172.21.15.37:0/1523170031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd8068bc0 con 0x7fafd806f770 2024-05-30T06:53:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.310+0000 7fafd4c00640 1 -- 172.21.15.37:0/1523170031 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fafc80bd020 con 0x7fafd806f770 2024-05-30T06:53:58.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.314+0000 7fafd4c00640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafb4069580 0x7fafb406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:58.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.314+0000 7fafd4c00640 1 -- 172.21.15.37:0/1523170031 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7fafc811fc00 con 0x7fafd806f770 2024-05-30T06:53:58.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.314+0000 7fafcf400640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafb4069580 0x7fafb406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:58.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.314+0000 7fafcf400640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafb4069580 0x7fafb406ba40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fafd8142520 tx=0x7fafc0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.318+0000 7fafd4c00640 1 -- 172.21.15.37:0/1523170031 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fafc80c4030 con 0x7fafd806f770 2024-05-30T06:53:58.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafdf200640 1 -- 172.21.15.37:0/1523170031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fafd8151570 con 0x7fafd806f770 2024-05-30T06:53:58.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafd4c00640 1 -- 172.21.15.37:0/1523170031 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7fafd8151340 con 0x7fafd806f770 2024-05-30T06:53:58.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafdf200640 1 -- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafb4069580 msgr2=0x7fafb406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafdf200640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafb4069580 0x7fafb406ba40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fafd8142520 tx=0x7fafc0009040 comp rx=0 tx=0).stop 2024-05-30T06:53:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafdf200640 1 -- 172.21.15.37:0/1523170031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd806f770 msgr2=0x7fafd8141fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafdf200640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd806f770 0x7fafd8141fe0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fafc8019050 tx=0x7fafc801ac80 comp rx=0 tx=0).stop 2024-05-30T06:53:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafdf200640 1 -- 172.21.15.37:0/1523170031 shutdown_connections 2024-05-30T06:53:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafdf200640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafd814f080 0x7fafd81594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafdf200640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fafb4069580 0x7fafb406ba40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafdf200640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd8155da0 0x7fafd8150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafdf200640 1 --2- 172.21.15.37:0/1523170031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafd806f770 0x7fafd8141fe0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafdf200640 1 -- 172.21.15.37:0/1523170031 >> 172.21.15.37:0/1523170031 conn(0x7fafd806bf60 msgr2=0x7fafd815b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafdf200640 1 -- 172.21.15.37:0/1523170031 shutdown_connections 2024-05-30T06:53:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.482+0000 7fafdf200640 1 -- 172.21.15.37:0/1523170031 wait complete. 2024-05-30T06:53:58.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T06:53:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.646+0000 7fa53d000640 1 Processor -- start 2024-05-30T06:53:58.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.650+0000 7fa53d000640 1 -- start start 2024-05-30T06:53:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.650+0000 7fa53d000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5380cd790 0x7fa53806f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.650+0000 7fa53d000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa538072e30 con 0x7fa538144f00 2024-05-30T06:53:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.650+0000 7fa53d000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5380cdc60 con 0x7fa53806ef30 2024-05-30T06:53:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.650+0000 7fa53d000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa53806f8d0 con 0x7fa5380cd790 2024-05-30T06:53:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.650+0000 7fa537e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5380cd790 0x7fa53806f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.650+0000 7fa537400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa538144f00 0x7fa5380b4910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54000/0 (socket says 172.21.15.37:54000) 2024-05-30T06:53:58.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.650+0000 7fa537400640 1 -- 172.21.15.37:0/1518132029 learned_addr learned my addr 172.21.15.37:0/1518132029 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.650+0000 7fa537e00640 1 -- 172.21.15.37:0/1518132029 >> v1:172.21.15.105:6789/0 conn(0x7fa53806ef30 legacy=0x7fa5380cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.650+0000 7fa537e00640 1 -- 172.21.15.37:0/1518132029 >> v1:172.21.15.37:6789/0 conn(0x7fa538144f00 legacy=0x7fa5380b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.650+0000 7fa537e00640 1 -- 172.21.15.37:0/1518132029 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5380b3b50 con 0x7fa5380cd790 2024-05-30T06:53:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.650+0000 7fa536a00640 1 -- 172.21.15.37:0/1518132029 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2992680283 0 0) 0x7fa528001120 con 0x7fa538144f00 2024-05-30T06:53:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.654+0000 7fa537e00640 1 --2- 172.21.15.37:0/1518132029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380cd790 0x7fa53806f390 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fa530009d90 tx=0x7fa53001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc37051e8fbcf34 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.654+0000 7fa536a00640 1 -- 172.21.15.37:0/1518132029 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5300b2070 con 0x7fa5380cd790 2024-05-30T06:53:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.654+0000 7fa536a00640 1 -- 172.21.15.37:0/1518132029 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5300a5970 con 0x7fa5380cd790 2024-05-30T06:53:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.654+0000 7fa536a00640 1 -- 172.21.15.37:0/1518132029 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5300a5d40 con 0x7fa5380cd790 2024-05-30T06:53:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.654+0000 7fa53d000640 1 -- 172.21.15.37:0/1518132029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380cd790 msgr2=0x7fa53806f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.654+0000 7fa53d000640 1 --2- 172.21.15.37:0/1518132029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380cd790 0x7fa53806f390 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fa530009d90 tx=0x7fa53001c8b0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.654+0000 7fa53d000640 1 -- 172.21.15.37:0/1518132029 shutdown_connections 2024-05-30T06:53:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.654+0000 7fa53d000640 1 --2- 172.21.15.37:0/1518132029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380cd790 0x7fa53806f390 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.654+0000 7fa53d000640 1 -- 172.21.15.37:0/1518132029 >> 172.21.15.37:0/1518132029 conn(0x7fa5380b2120 msgr2=0x7fa5380b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.654+0000 7fa53d000640 1 -- 172.21.15.37:0/1518132029 shutdown_connections 2024-05-30T06:53:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.654+0000 7fa53d000640 1 -- 172.21.15.37:0/1518132029 wait complete. 2024-05-30T06:53:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.654+0000 7fa53d000640 1 Processor -- start 2024-05-30T06:53:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.654+0000 7fa53d000640 1 -- start start 2024-05-30T06:53:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa53d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa53806ef30 0x7fa538152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa53d000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5380cd790 0x7fa5381410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa53d000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa538144f00 0x7fa53813b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa53d000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa53815c410 con 0x7fa53806ef30 2024-05-30T06:53:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa53d000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa53815c290 con 0x7fa5380cd790 2024-05-30T06:53:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa53d000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa53815c590 con 0x7fa538144f00 2024-05-30T06:53:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa537400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa53806ef30 0x7fa538152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa537400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa53806ef30 0x7fa538152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60512/0 (socket says 172.21.15.37:60512) 2024-05-30T06:53:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa537400640 1 -- 172.21.15.37:0/1326945763 learned_addr learned my addr 172.21.15.37:0/1326945763 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa537e00640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa538144f00 0x7fa53813b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa52ea00640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5380cd790 0x7fa5381410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa537400640 1 -- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa538144f00 msgr2=0x7fa53813b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa537400640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa538144f00 0x7fa53813b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa537400640 1 -- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5380cd790 msgr2=0x7fa5381410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa537400640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5380cd790 0x7fa5381410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa537400640 1 -- 172.21.15.37:0/1326945763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa538141ab0 con 0x7fa53806ef30 2024-05-30T06:53:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa52ea00640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5380cd790 0x7fa5381410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa537400640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa53806ef30 0x7fa538152810 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa52800c410 tx=0x7fa52800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa52fe00640 1 -- 172.21.15.37:0/1326945763 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5280074e0 con 0x7fa53806ef30 2024-05-30T06:53:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa52fe00640 1 -- 172.21.15.37:0/1326945763 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5280047f0 con 0x7fa53806ef30 2024-05-30T06:53:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa52fe00640 1 -- 172.21.15.37:0/1326945763 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa528007680 con 0x7fa53806ef30 2024-05-30T06:53:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa53d000640 1 -- 172.21.15.37:0/1326945763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa538141d90 con 0x7fa53806ef30 2024-05-30T06:53:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa53d000640 1 -- 172.21.15.37:0/1326945763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa538142350 con 0x7fa53806ef30 2024-05-30T06:53:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa53d000640 1 -- 172.21.15.37:0/1326945763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5380ad9f0 con 0x7fa53806ef30 2024-05-30T06:53:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.658+0000 7fa52fe00640 1 -- 172.21.15.37:0/1326945763 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7fa528011070 con 0x7fa53806ef30 2024-05-30T06:53:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.662+0000 7fa52fe00640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa514069580 0x7fa51406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.662+0000 7fa52fe00640 1 -- 172.21.15.37:0/1326945763 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7fa528085150 con 0x7fa53806ef30 2024-05-30T06:53:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.662+0000 7fa52ea00640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa514069580 0x7fa51406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:58.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.662+0000 7fa52ea00640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa514069580 0x7fa51406ba40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa538074dc0 tx=0x7fa520009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.666+0000 7fa52fe00640 1 -- 172.21.15.37:0/1326945763 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa538072e30 con 0x7fa53806ef30 2024-05-30T06:53:58.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.854+0000 7fa53d000640 1 -- 172.21.15.37:0/1326945763 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7fa538068ab0 con 0x7fa514069580 2024-05-30T06:53:58.864 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:58.865+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:58.864 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:58.865+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:58.864 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:58.865+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:58.865 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:58.865+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:58.865 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:53:58.865+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:53:58.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.898+0000 7fa52fe00640 1 -- 172.21.15.37:0/1326945763 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa538068ab0 con 0x7fa514069580 2024-05-30T06:53:58.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.898+0000 7fa53d000640 1 -- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa514069580 msgr2=0x7fa51406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.898+0000 7fa53d000640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa514069580 0x7fa51406ba40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa538074dc0 tx=0x7fa520009040 comp rx=0 tx=0).stop 2024-05-30T06:53:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.898+0000 7fa53d000640 1 -- 172.21.15.37:0/1326945763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa53806ef30 msgr2=0x7fa538152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.898+0000 7fa53d000640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa53806ef30 0x7fa538152810 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fa52800c410 tx=0x7fa52800c8d0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.898+0000 7fa53d000640 1 -- 172.21.15.37:0/1326945763 shutdown_connections 2024-05-30T06:53:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.898+0000 7fa53d000640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa538144f00 0x7fa53813b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.898+0000 7fa53d000640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa514069580 0x7fa51406ba40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.898+0000 7fa53d000640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5380cd790 0x7fa5381410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.898+0000 7fa53d000640 1 --2- 172.21.15.37:0/1326945763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa53806ef30 0x7fa538152810 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.898+0000 7fa53d000640 1 -- 172.21.15.37:0/1326945763 >> 172.21.15.37:0/1326945763 conn(0x7fa5380b2120 msgr2=0x7fa53806de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.898+0000 7fa53d000640 1 -- 172.21.15.37:0/1326945763 shutdown_connections 2024-05-30T06:53:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:58.898+0000 7fa53d000640 1 -- 172.21.15.37:0/1326945763 wait complete. 2024-05-30T06:53:58.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:53:59.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.062+0000 7f8bbd200640 1 Processor -- start 2024-05-30T06:53:59.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.062+0000 7f8bbd200640 1 -- start start 2024-05-30T06:53:59.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.062+0000 7f8bbd200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bb80cd440 0x7f8bb806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.062+0000 7f8bbd200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb815f310 con 0x7f8bb8155da0 2024-05-30T06:53:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.062+0000 7f8bbd200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb815f5f0 con 0x7f8bb806f5a0 2024-05-30T06:53:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.062+0000 7f8bbd200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb815f8d0 con 0x7f8bb80cd440 2024-05-30T06:53:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8bb8155da0 0x7f8bb80cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54012/0 (socket says 172.21.15.37:54012) 2024-05-30T06:53:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5e00640 1 -- 172.21.15.37:0/40283769 learned_addr learned my addr 172.21.15.37:0/40283769 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:53:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bad400640 1 --2- 172.21.15.37:0/40283769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bb80cd440 0x7f8bb806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262107190 0 0) 0x7f8bb815f310 con 0x7f8bb8155da0 2024-05-30T06:53:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b9c003530 con 0x7f8bb8155da0 2024-05-30T06:53:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3088681736 0 0) 0x7f8b9c003530 con 0x7f8bb8155da0 2024-05-30T06:53:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bb80cd440 msgr2=0x7f8bb806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 --2- 172.21.15.37:0/40283769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bb80cd440 0x7f8bb806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 >> v1:172.21.15.105:6789/0 conn(0x7f8bb806f5a0 legacy=0x7f8bb80b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb815fbb0 con 0x7f8bb8155da0 2024-05-30T06:53:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f8ba8001a00 con 0x7f8bb8155da0 2024-05-30T06:53:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 >> v1:172.21.15.37:6789/0 conn(0x7f8bb8155da0 legacy=0x7f8bb80cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 --2- 172.21.15.37:0/40283769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b9c0039f0 0x7f8b9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 --2- 172.21.15.37:0/40283769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b9c004810 0x7f8b9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 --2- 172.21.15.37:0/40283769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c005190 0x7f8b9c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb815f8d0 con 0x7f8b9c005190 2024-05-30T06:53:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c00bfc0 con 0x7f8b9c0039f0 2024-05-30T06:53:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c00e3a0 con 0x7f8b9c004810 2024-05-30T06:53:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb6800640 1 --2- 172.21.15.37:0/40283769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c005190 0x7f8b9c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bad400640 1 --2- 172.21.15.37:0/40283769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b9c004810 0x7f8b9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5e00640 1 --2- 172.21.15.37:0/40283769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b9c0039f0 0x7f8b9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb6800640 1 -- 172.21.15.37:0/40283769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b9c004810 msgr2=0x7f8b9c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb6800640 1 --2- 172.21.15.37:0/40283769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b9c004810 0x7f8b9c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb6800640 1 -- 172.21.15.37:0/40283769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b9c0039f0 msgr2=0x7f8b9c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:53:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb6800640 1 --2- 172.21.15.37:0/40283769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b9c0039f0 0x7f8b9c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb6800640 1 -- 172.21.15.37:0/40283769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c003530 con 0x7f8b9c005190 2024-05-30T06:53:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.066+0000 7f8bb5e00640 1 --2- 172.21.15.37:0/40283769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b9c0039f0 0x7f8b9c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.070+0000 7f8bb6800640 1 --2- 172.21.15.37:0/40283769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c005190 0x7f8b9c00b9d0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00017b0 tx=0x7f8bb001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec3833f70b0e3d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.070+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00013a0 con 0x7f8b9c005190 2024-05-30T06:53:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.070+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb00052f0 con 0x7f8b9c005190 2024-05-30T06:53:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.070+0000 7f8bb5400640 1 -- 172.21.15.37:0/40283769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0003840 con 0x7f8b9c005190 2024-05-30T06:53:59.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.070+0000 7f8bbd200640 1 -- 172.21.15.37:0/40283769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c005190 msgr2=0x7f8b9c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:59.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.070+0000 7f8bbd200640 1 --2- 172.21.15.37:0/40283769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b9c005190 0x7f8b9c00b9d0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00017b0 tx=0x7f8bb001c400 comp rx=0 tx=0).stop 2024-05-30T06:53:59.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.070+0000 7f8bb6800640 1 -- 172.21.15.37:0/40283769 reap_dead start 2024-05-30T06:53:59.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.070+0000 7f8bbd200640 1 -- 172.21.15.37:0/40283769 shutdown_connections 2024-05-30T06:53:59.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.070+0000 7f8bbd200640 1 -- 172.21.15.37:0/40283769 >> 172.21.15.37:0/40283769 conn(0x7f8bb806bf60 msgr2=0x7f8bb80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:59.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.070+0000 7f8bbd200640 1 -- 172.21.15.37:0/40283769 shutdown_connections 2024-05-30T06:53:59.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.070+0000 7f8bbd200640 1 -- 172.21.15.37:0/40283769 wait complete. 2024-05-30T06:53:59.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.070+0000 7f8bbd200640 1 Processor -- start 2024-05-30T06:53:59.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.070+0000 7f8bbd200640 1 -- start start 2024-05-30T06:53:59.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bbd200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8140ff0 0x7f8bb8151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:59.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bbd200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bb814f1a0 0x7f8bb8152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:59.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bbd200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bb8158db0 0x7f8bb815cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:59.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bbd200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb806eaf0 con 0x7f8bb8140ff0 2024-05-30T06:53:59.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bbd200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb806e970 con 0x7f8bb8158db0 2024-05-30T06:53:59.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bbd200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb806ec70 con 0x7f8bb814f1a0 2024-05-30T06:53:59.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bb5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8140ff0 0x7f8bb8151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:59.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bb5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8140ff0 0x7f8bb8151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60538/0 (socket says 172.21.15.37:60538) 2024-05-30T06:53:59.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bb5e00640 1 -- 172.21.15.37:0/3695482983 learned_addr learned my addr 172.21.15.37:0/3695482983 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:53:59.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bad400640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bb814f1a0 0x7f8bb8152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:59.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bb6800640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bb8158db0 0x7f8bb815cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:59.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bb5e00640 1 -- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bb814f1a0 msgr2=0x7f8bb8152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:59.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bb5e00640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bb814f1a0 0x7f8bb8152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:59.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bb5e00640 1 -- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bb8158db0 msgr2=0x7f8bb815cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:59.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bb5e00640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bb8158db0 0x7f8bb815cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:59.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bb5e00640 1 -- 172.21.15.37:0/3695482983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb81505f0 con 0x7f8bb8140ff0 2024-05-30T06:53:59.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bad400640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bb814f1a0 0x7f8bb8152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:53:59.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bb5e00640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8140ff0 0x7f8bb8151f00 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8001590 tx=0x7f8ba800e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:59.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8baea00640 1 -- 172.21.15.37:0/3695482983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8012590 con 0x7f8bb8140ff0 2024-05-30T06:53:59.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8baea00640 1 -- 172.21.15.37:0/3695482983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba8018070 con 0x7f8bb8140ff0 2024-05-30T06:53:59.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8baea00640 1 -- 172.21.15.37:0/3695482983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8012950 con 0x7f8bb8140ff0 2024-05-30T06:53:59.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bbd200640 1 -- 172.21.15.37:0/3695482983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb81508d0 con 0x7f8bb8140ff0 2024-05-30T06:53:59.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bbd200640 1 -- 172.21.15.37:0/3695482983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb81570b0 con 0x7f8bb8140ff0 2024-05-30T06:53:59.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8bbd200640 1 -- 172.21.15.37:0/3695482983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb8068bc0 con 0x7f8bb8140ff0 2024-05-30T06:53:59.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.074+0000 7f8baea00640 1 -- 172.21.15.37:0/3695482983 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) ==== 89619+0+0 (secure 0 0 0) 0x7f8ba8012af0 con 0x7f8bb8140ff0 2024-05-30T06:53:59.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.078+0000 7f8baea00640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b94069580 0x7f8b9406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:53:59.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.078+0000 7f8baea00640 1 -- 172.21.15.37:0/3695482983 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f8ba80862e0 con 0x7f8bb8140ff0 2024-05-30T06:53:59.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.078+0000 7f8bad400640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b94069580 0x7f8b9406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:53:59.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.078+0000 7f8bad400640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b94069580 0x7f8b9406ba40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8bb81ee370 tx=0x7f8ba0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:53:59.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.082+0000 7f8baea00640 1 -- 172.21.15.37:0/3695482983 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8ba8057f80 con 0x7f8bb8140ff0 2024-05-30T06:53:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.274+0000 7f8bbd200640 1 -- 172.21.15.37:0/3695482983 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f8bb81503a0 con 0x7f8b94069580 2024-05-30T06:53:59.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.278+0000 7f8baea00640 1 -- 172.21.15.37:0/3695482983 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f8bb81503a0 con 0x7f8b94069580 2024-05-30T06:53:59.279 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b 2024-05-30T06:53:59.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.282+0000 7f8bbd200640 1 -- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b94069580 msgr2=0x7f8b9406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:59.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.282+0000 7f8bbd200640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b94069580 0x7f8b9406ba40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8bb81ee370 tx=0x7f8ba0008040 comp rx=0 tx=0).stop 2024-05-30T06:53:59.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.282+0000 7f8bbd200640 1 -- 172.21.15.37:0/3695482983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8140ff0 msgr2=0x7f8bb8151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:53:59.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.282+0000 7f8bbd200640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8140ff0 0x7f8bb8151f00 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8001590 tx=0x7f8ba800e880 comp rx=0 tx=0).stop 2024-05-30T06:53:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.282+0000 7f8bbd200640 1 -- 172.21.15.37:0/3695482983 shutdown_connections 2024-05-30T06:53:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.282+0000 7f8bbd200640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8b94069580 0x7f8b9406ba40 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.282+0000 7f8bbd200640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8bb8158db0 0x7f8bb815cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.282+0000 7f8bbd200640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8bb814f1a0 0x7f8bb8152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.282+0000 7f8bbd200640 1 --2- 172.21.15.37:0/3695482983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb8140ff0 0x7f8bb8151f00 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:53:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.282+0000 7f8bbd200640 1 -- 172.21.15.37:0/3695482983 >> 172.21.15.37:0/3695482983 conn(0x7f8bb806bf60 msgr2=0x7f8bb8153860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:53:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.282+0000 7f8bbd200640 1 -- 172.21.15.37:0/3695482983 shutdown_connections 2024-05-30T06:53:59.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:53:59.282+0000 7f8bbd200640 1 -- 172.21.15.37:0/3695482983 wait complete. 2024-05-30T06:53:59.300 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b 2024-05-30T06:53:59.300 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:53:59.300 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:53:59.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:53:59.309 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:54:05.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:54:05.285 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:54:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:54:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:54:07.898 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.52839 s, 126 MB/s 2024-05-30T06:54:07.899 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:54:07.899 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:54:07.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:54:07.908 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:54:16.504 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:54:16.505 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:54:16.505 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.54177 s, 126 MB/s 2024-05-30T06:54:16.506 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:54:16.506 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:54:16.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:54:16.515 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:54:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:54:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:54:25.125 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.55935 s, 125 MB/s 2024-05-30T06:54:25.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T06:54:25.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.274+0000 7f5e14e00640 1 Processor -- start 2024-05-30T06:54:25.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.274+0000 7f5e14e00640 1 -- start start 2024-05-30T06:54:25.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.274+0000 7f5e14e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e100d0440 0x7f5e100ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:25.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.274+0000 7f5e14e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5e100d0820 0x7f5e100cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:25.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.274+0000 7f5e14e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e100ce320 con 0x7f5e1009aa60 2024-05-30T06:54:25.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.274+0000 7f5e14e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5e100b21f0 con 0x7f5e100d0820 2024-05-30T06:54:25.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.274+0000 7f5e14e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5e100ce5f0 con 0x7f5e100d0440 2024-05-30T06:54:25.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.278+0000 7f5e0fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5e1009aa60 0x7f5e1009aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42476/0 (socket says 172.21.15.37:42476) 2024-05-30T06:54:25.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.278+0000 7f5e0fe00640 1 -- 172.21.15.37:0/1574003714 learned_addr learned my addr 172.21.15.37:0/1574003714 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:54:25.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.278+0000 7f5e06a00640 1 --2- 172.21.15.37:0/1574003714 >> v2:172.21.15.105:3300/0 conn(0x7f5e100d0820 0x7f5e100cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:25.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.278+0000 7f5e0f400640 1 --2- 172.21.15.37:0/1574003714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e100d0440 0x7f5e100ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:25.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.278+0000 7f5e0ea00640 1 -- 172.21.15.37:0/1574003714 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375959743 0 0) 0x7f5e100ce320 con 0x7f5e1009aa60 2024-05-30T06:54:25.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.278+0000 7f5e0ea00640 1 -- 172.21.15.37:0/1574003714 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5df4003530 con 0x7f5e1009aa60 2024-05-30T06:54:25.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.278+0000 7f5e06a00640 1 -- 172.21.15.37:0/1574003714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e100d0440 msgr2=0x7f5e100ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:25.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.278+0000 7f5e06a00640 1 --2- 172.21.15.37:0/1574003714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e100d0440 0x7f5e100ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.278+0000 7f5e06a00640 1 -- 172.21.15.37:0/1574003714 >> v1:172.21.15.37:6789/0 conn(0x7f5e1009aa60 legacy=0x7f5e1009aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:25.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.278+0000 7f5e06a00640 1 -- 172.21.15.37:0/1574003714 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e100ce8d0 con 0x7f5e100d0820 2024-05-30T06:54:25.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.278+0000 7f5e0f400640 1 --2- 172.21.15.37:0/1574003714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e100d0440 0x7f5e100ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:54:25.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.278+0000 7f5e06a00640 1 --2- 172.21.15.37:0/1574003714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e100d0820 0x7f5e100cdde0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5df80097c0 tx=0x7f5df801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bb49ca06e5dd327 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e0ea00640 1 -- 172.21.15.37:0/1574003714 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df80b1070 con 0x7f5e100d0820 2024-05-30T06:54:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e0ea00640 1 -- 172.21.15.37:0/1574003714 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df80ac410 con 0x7f5e100d0820 2024-05-30T06:54:25.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e0ea00640 1 -- 172.21.15.37:0/1574003714 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df80ac7c0 con 0x7f5e100d0820 2024-05-30T06:54:25.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 -- 172.21.15.37:0/1574003714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e100d0820 msgr2=0x7f5e100cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:25.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 --2- 172.21.15.37:0/1574003714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e100d0820 0x7f5e100cdde0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5df80097c0 tx=0x7f5df801c4a0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 -- 172.21.15.37:0/1574003714 shutdown_connections 2024-05-30T06:54:25.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 --2- 172.21.15.37:0/1574003714 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e100d0820 0x7f5e100cdde0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 --2- 172.21.15.37:0/1574003714 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e100d0440 0x7f5e100ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 -- 172.21.15.37:0/1574003714 >> 172.21.15.37:0/1574003714 conn(0x7f5e100b4150 msgr2=0x7f5e100b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:25.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 -- 172.21.15.37:0/1574003714 shutdown_connections 2024-05-30T06:54:25.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 -- 172.21.15.37:0/1574003714 wait complete. 2024-05-30T06:54:25.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 Processor -- start 2024-05-30T06:54:25.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 -- start start 2024-05-30T06:54:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e1009aa60 0x7f5e1015f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e100d0440 0x7f5e10156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e100d0820 0x7f5e100b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1006cbf0 con 0x7f5e100d0440 2024-05-30T06:54:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1006ca70 con 0x7f5e1009aa60 2024-05-30T06:54:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e14e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5e1006cd70 con 0x7f5e100d0820 2024-05-30T06:54:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e06a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e100d0440 0x7f5e10156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e06a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e100d0440 0x7f5e10156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40082/0 (socket says 172.21.15.37:40082) 2024-05-30T06:54:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e06a00640 1 -- 172.21.15.37:0/684488139 learned_addr learned my addr 172.21.15.37:0/684488139 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e0fe00640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e100d0820 0x7f5e100b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e0f400640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e1009aa60 0x7f5e1015f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e06a00640 1 -- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e100d0820 msgr2=0x7f5e100b71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e06a00640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e100d0820 0x7f5e100b71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e06a00640 1 -- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e1009aa60 msgr2=0x7f5e1015f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e06a00640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e1009aa60 0x7f5e1015f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e06a00640 1 -- 172.21.15.37:0/684488139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1015e830 con 0x7f5e100d0440 2024-05-30T06:54:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.282+0000 7f5e0f400640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e1009aa60 0x7f5e1015f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:54:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.286+0000 7f5e06a00640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e100d0440 0x7f5e10156f60 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f5df801a0d0 tx=0x7f5df8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:25.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.286+0000 7f5e07e00640 1 -- 172.21.15.37:0/684488139 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df80b1040 con 0x7f5e100d0440 2024-05-30T06:54:25.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.286+0000 7f5e07e00640 1 -- 172.21.15.37:0/684488139 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df80ba070 con 0x7f5e100d0440 2024-05-30T06:54:25.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.286+0000 7f5e14e00640 1 -- 172.21.15.37:0/684488139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e1015eb10 con 0x7f5e100d0440 2024-05-30T06:54:25.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.286+0000 7f5e07e00640 1 -- 172.21.15.37:0/684488139 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df8006e20 con 0x7f5e100d0440 2024-05-30T06:54:25.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.286+0000 7f5e14e00640 1 -- 172.21.15.37:0/684488139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e101574a0 con 0x7f5e100d0440 2024-05-30T06:54:25.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.286+0000 7f5e14e00640 1 -- 172.21.15.37:0/684488139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e10068ab0 con 0x7f5e100d0440 2024-05-30T06:54:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.286+0000 7f5e07e00640 1 -- 172.21.15.37:0/684488139 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 34) ==== 89670+0+0 (secure 0 0 0) 0x7f5df80b5630 con 0x7f5e100d0440 2024-05-30T06:54:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.286+0000 7f5e07e00640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dec069610 0x7f5dec06bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.286+0000 7f5e07e00640 1 -- 172.21.15.37:0/684488139 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f5df811f720 con 0x7f5e100d0440 2024-05-30T06:54:25.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.286+0000 7f5e0f400640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dec069610 0x7f5dec06bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:25.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.290+0000 7f5e0f400640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dec069610 0x7f5dec06bad0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5e100b8450 tx=0x7f5e0000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.290+0000 7f5e07e00640 1 -- 172.21.15.37:0/684488139 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5df8126030 con 0x7f5e100d0440 2024-05-30T06:54:25.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.486+0000 7f5e14e00640 1 -- 172.21.15.37:0/684488139 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f5e1015e5e0 con 0x7f5dec069610 2024-05-30T06:54:25.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.498+0000 7f5e07e00640 1 -- 172.21.15.37:0/684488139 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5e1015e5e0 con 0x7f5dec069610 2024-05-30T06:54:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.498+0000 7f5e14e00640 1 -- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dec069610 msgr2=0x7f5dec06bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.498+0000 7f5e14e00640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dec069610 0x7f5dec06bad0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5e100b8450 tx=0x7f5e0000b040 comp rx=0 tx=0).stop 2024-05-30T06:54:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.498+0000 7f5e14e00640 1 -- 172.21.15.37:0/684488139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e100d0440 msgr2=0x7f5e10156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.498+0000 7f5e14e00640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e100d0440 0x7f5e10156f60 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f5df801a0d0 tx=0x7f5df8019240 comp rx=0 tx=0).stop 2024-05-30T06:54:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.498+0000 7f5e14e00640 1 -- 172.21.15.37:0/684488139 shutdown_connections 2024-05-30T06:54:25.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.498+0000 7f5e14e00640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e100d0820 0x7f5e100b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.498+0000 7f5e14e00640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e100d0440 0x7f5e10156f60 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.498+0000 7f5e14e00640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dec069610 0x7f5dec06bad0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.498+0000 7f5e14e00640 1 --2- 172.21.15.37:0/684488139 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e1009aa60 0x7f5e1015f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.498+0000 7f5e14e00640 1 -- 172.21.15.37:0/684488139 >> 172.21.15.37:0/684488139 conn(0x7f5e100b4150 msgr2=0x7f5e100701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:25.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.498+0000 7f5e14e00640 1 -- 172.21.15.37:0/684488139 shutdown_connections 2024-05-30T06:54:25.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.498+0000 7f5e14e00640 1 -- 172.21.15.37:0/684488139 wait complete. 2024-05-30T06:54:25.518 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:54:25.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.658+0000 7f1443800640 1 Processor -- start 2024-05-30T06:54:25.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f1443800640 1 -- start start 2024-05-30T06:54:25.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f1443800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f143c0cd440 0x7f143c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:25.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f1443800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f143c15f310 con 0x7f143c06f5a0 2024-05-30T06:54:25.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f1443800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f143c15f5f0 con 0x7f143c155da0 2024-05-30T06:54:25.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f1443800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f143c15f8d0 con 0x7f143c0cd440 2024-05-30T06:54:25.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f1441800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f143c06f5a0 0x7f143c0b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42488/0 (socket says 172.21.15.37:42488) 2024-05-30T06:54:25.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f1441800640 1 -- 172.21.15.37:0/3066637409 learned_addr learned my addr 172.21.15.37:0/3066637409 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:54:25.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f1433e00640 1 --2- 172.21.15.37:0/3066637409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f143c0cd440 0x7f143c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:25.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f143be00640 1 -- 172.21.15.37:0/3066637409 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430870145 0 0) 0x7f143c15f310 con 0x7f143c06f5a0 2024-05-30T06:54:25.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f143be00640 1 -- 172.21.15.37:0/3066637409 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1420003530 con 0x7f143c06f5a0 2024-05-30T06:54:25.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f143be00640 1 -- 172.21.15.37:0/3066637409 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92309133 0 0) 0x7f143c15f5f0 con 0x7f143c155da0 2024-05-30T06:54:25.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f143be00640 1 -- 172.21.15.37:0/3066637409 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f143c15f310 con 0x7f143c155da0 2024-05-30T06:54:25.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f1433e00640 1 -- 172.21.15.37:0/3066637409 >> v1:172.21.15.105:6789/0 conn(0x7f143c155da0 legacy=0x7f143c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:25.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f1433e00640 1 -- 172.21.15.37:0/3066637409 >> v1:172.21.15.37:6789/0 conn(0x7f143c06f5a0 legacy=0x7f143c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:25.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.662+0000 7f1433e00640 1 -- 172.21.15.37:0/3066637409 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143c15fbb0 con 0x7f143c0cd440 2024-05-30T06:54:25.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.666+0000 7f1433e00640 1 --2- 172.21.15.37:0/3066637409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f143c0cd440 0x7f143c06f060 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f14240097f0 tx=0x7f142401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad3798f7856f5be server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:25.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.666+0000 7f143be00640 1 -- 172.21.15.37:0/3066637409 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14240b0070 con 0x7f143c0cd440 2024-05-30T06:54:25.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.666+0000 7f143be00640 1 -- 172.21.15.37:0/3066637409 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14240ab600 con 0x7f143c0cd440 2024-05-30T06:54:25.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.666+0000 7f143be00640 1 -- 172.21.15.37:0/3066637409 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14240ab9d0 con 0x7f143c0cd440 2024-05-30T06:54:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.666+0000 7f1443800640 1 -- 172.21.15.37:0/3066637409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f143c0cd440 msgr2=0x7f143c06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.666+0000 7f1443800640 1 --2- 172.21.15.37:0/3066637409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f143c0cd440 0x7f143c06f060 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f14240097f0 tx=0x7f142401c3c0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.666+0000 7f1443800640 1 -- 172.21.15.37:0/3066637409 shutdown_connections 2024-05-30T06:54:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.666+0000 7f1443800640 1 --2- 172.21.15.37:0/3066637409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f143c0cd440 0x7f143c06f060 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.666+0000 7f1443800640 1 -- 172.21.15.37:0/3066637409 >> 172.21.15.37:0/3066637409 conn(0x7f143c06bf60 msgr2=0x7f143c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:25.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.666+0000 7f1443800640 1 -- 172.21.15.37:0/3066637409 shutdown_connections 2024-05-30T06:54:25.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.666+0000 7f1443800640 1 -- 172.21.15.37:0/3066637409 wait complete. 2024-05-30T06:54:25.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.666+0000 7f1443800640 1 Processor -- start 2024-05-30T06:54:25.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.666+0000 7f1443800640 1 -- start start 2024-05-30T06:54:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1443800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c06f5a0 0x7f143c1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1443800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f143c155da0 0x7f143c148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1443800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f143c156810 0x7f143c153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1443800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f143c06eaf0 con 0x7f143c06f5a0 2024-05-30T06:54:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1443800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f143c06e970 con 0x7f143c156810 2024-05-30T06:54:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1443800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f143c06ec70 con 0x7f143c155da0 2024-05-30T06:54:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1440e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c06f5a0 0x7f143c1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1440e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c06f5a0 0x7f143c1550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40098/0 (socket says 172.21.15.37:40098) 2024-05-30T06:54:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1440e00640 1 -- 172.21.15.37:0/2466829623 learned_addr learned my addr 172.21.15.37:0/2466829623 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1441800640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f143c156810 0x7f143c153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1433e00640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f143c155da0 0x7f143c148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1440e00640 1 -- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f143c155da0 msgr2=0x7f143c148440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1440e00640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f143c155da0 0x7f143c148440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1440e00640 1 -- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f143c156810 msgr2=0x7f143c153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1440e00640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f143c156810 0x7f143c153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1440e00640 1 -- 172.21.15.37:0/2466829623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143c1555f0 con 0x7f143c06f5a0 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1441800640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f143c156810 0x7f143c153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1433e00640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f143c155da0 0x7f143c148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1440e00640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c06f5a0 0x7f143c1550b0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f142c00c430 tx=0x7f142c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1439600640 1 -- 172.21.15.37:0/2466829623 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c017070 con 0x7f143c06f5a0 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1439600640 1 -- 172.21.15.37:0/2466829623 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f142c0052f0 con 0x7f143c06f5a0 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1443800640 1 -- 172.21.15.37:0/2466829623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143c154010 con 0x7f143c06f5a0 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1439600640 1 -- 172.21.15.37:0/2466829623 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142c003840 con 0x7f143c06f5a0 2024-05-30T06:54:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1443800640 1 -- 172.21.15.37:0/2466829623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f143c1545d0 con 0x7f143c06f5a0 2024-05-30T06:54:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1443800640 1 -- 172.21.15.37:0/2466829623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f143c068bc0 con 0x7f143c06f5a0 2024-05-30T06:54:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.670+0000 7f1439600640 1 -- 172.21.15.37:0/2466829623 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 34) ==== 89670+0+0 (secure 0 0 0) 0x7f142c01a070 con 0x7f143c06f5a0 2024-05-30T06:54:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.674+0000 7f1439600640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1418069610 0x7f141806bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.674+0000 7f1439600640 1 -- 172.21.15.37:0/2466829623 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f142c084d00 con 0x7f143c06f5a0 2024-05-30T06:54:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.674+0000 7f1433e00640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1418069610 0x7f141806bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.674+0000 7f1433e00640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1418069610 0x7f141806bad0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f14240ad000 tx=0x7f1424008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:25.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.678+0000 7f1439600640 1 -- 172.21.15.37:0/2466829623 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f143c1555f0 con 0x7f143c06f5a0 2024-05-30T06:54:25.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.866+0000 7f1443800640 1 -- 172.21.15.37:0/2466829623 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f143c148980 con 0x7f1418069610 2024-05-30T06:54:25.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.870+0000 7f1439600640 1 -- 172.21.15.37:0/2466829623 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f143c148980 con 0x7f1418069610 2024-05-30T06:54:25.873 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b 2024-05-30T06:54:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.874+0000 7f1443800640 1 -- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1418069610 msgr2=0x7f141806bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.874+0000 7f1443800640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1418069610 0x7f141806bad0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f14240ad000 tx=0x7f1424008040 comp rx=0 tx=0).stop 2024-05-30T06:54:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.874+0000 7f1443800640 1 -- 172.21.15.37:0/2466829623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c06f5a0 msgr2=0x7f143c1550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.874+0000 7f1443800640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c06f5a0 0x7f143c1550b0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f142c00c430 tx=0x7f142c00c8f0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.874+0000 7f1443800640 1 -- 172.21.15.37:0/2466829623 shutdown_connections 2024-05-30T06:54:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.874+0000 7f1443800640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1418069610 0x7f141806bad0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.874+0000 7f1443800640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f143c156810 0x7f143c153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.874+0000 7f1443800640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f143c155da0 0x7f143c148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.874+0000 7f1443800640 1 --2- 172.21.15.37:0/2466829623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c06f5a0 0x7f143c1550b0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.874+0000 7f1443800640 1 -- 172.21.15.37:0/2466829623 >> 172.21.15.37:0/2466829623 conn(0x7f143c06bf60 msgr2=0x7f143c159910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.874+0000 7f1443800640 1 -- 172.21.15.37:0/2466829623 shutdown_connections 2024-05-30T06:54:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:25.874+0000 7f1443800640 1 -- 172.21.15.37:0/2466829623 wait complete. 2024-05-30T06:54:25.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:54:25.894 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b 2024-05-30T06:54:25.894 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:54:25.904 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b 2024-05-30T06:54:25.905 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3055190016" 2024-05-30T06:54:25.905 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:54:25.905 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 exp_size = 3221225472 2024-05-30T06:54:27.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:54:27.906 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b 2024-05-30T06:54:27.906 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:54:27.917 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b 2024-05-30T06:54:27.917 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3055190016" 2024-05-30T06:54:27.917 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:54:27.918 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 exp_size = 3221225472 2024-05-30T06:54:29.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:54:29.919 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b 2024-05-30T06:54:29.919 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:54:29.931 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b 2024-05-30T06:54:29.931 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3055190016" 2024-05-30T06:54:29.931 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:54:29.932 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 exp_size = 3221225472 2024-05-30T06:54:31.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:54:31.934 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b 2024-05-30T06:54:31.934 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:54:31.945 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/547d35a5-51b1-434c-8036-9c2d86fe214b 2024-05-30T06:54:31.945 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T06:54:31.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:54:31.946 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T06:54:31.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-05-30T06:54:32.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.150+0000 7f173fe00640 1 Processor -- start 2024-05-30T06:54:32.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.150+0000 7f173fe00640 1 -- start start 2024-05-30T06:54:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.150+0000 7f173fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f174015d390 0x7f1740071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.150+0000 7f173fe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f17401422f0 0x7f1740072340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.150+0000 7f173fe00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1740142900 con 0x7f174015d770 2024-05-30T06:54:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.150+0000 7f173fe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f174006de40 con 0x7f174015d390 2024-05-30T06:54:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.150+0000 7f173fe00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f174013fd50 con 0x7f17401422f0 2024-05-30T06:54:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.150+0000 7f173ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f174015d390 0x7f1740071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.150+0000 7f173ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f174015d390 0x7f1740071e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50474/0 (socket says 172.21.15.37:50474) 2024-05-30T06:54:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.150+0000 7f173ea00640 1 -- 172.21.15.37:0/455301451 learned_addr learned my addr 172.21.15.37:0/455301451 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.150+0000 7f173e000640 1 --1- 172.21.15.37:0/455301451 >> v1:172.21.15.37:6789/0 conn(0x7f174015d770 0x7f1740141be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45712/0 (socket says 172.21.15.37:45712) 2024-05-30T06:54:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.150+0000 7f173f400640 1 --2- 172.21.15.37:0/455301451 >> v2:172.21.15.105:3300/0 conn(0x7f17401422f0 0x7f1740072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173ea00640 1 -- 172.21.15.37:0/455301451 >> v2:172.21.15.105:3300/0 conn(0x7f17401422f0 msgr2=0x7f1740072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173ea00640 1 --2- 172.21.15.37:0/455301451 >> v2:172.21.15.105:3300/0 conn(0x7f17401422f0 0x7f1740072340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173ea00640 1 -- 172.21.15.37:0/455301451 >> v1:172.21.15.37:6789/0 conn(0x7f174015d770 legacy=0x7f1740141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173ea00640 1 -- 172.21.15.37:0/455301451 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1740140030 con 0x7f174015d390 2024-05-30T06:54:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173f400640 1 --2- 172.21.15.37:0/455301451 >> v2:172.21.15.105:3300/0 conn(0x7f17401422f0 0x7f1740072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:54:32.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173ea00640 1 --2- 172.21.15.37:0/455301451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f174015d390 0x7f1740071e00 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f174015a5c0 tx=0x7f173001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea90f828fce87998 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:32.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173d600640 1 -- 172.21.15.37:0/455301451 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300b0070 con 0x7f174015d390 2024-05-30T06:54:32.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173d600640 1 -- 172.21.15.37:0/455301451 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17300ab600 con 0x7f174015d390 2024-05-30T06:54:32.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173d600640 1 -- 172.21.15.37:0/455301451 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300ab9d0 con 0x7f174015d390 2024-05-30T06:54:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173fe00640 1 -- 172.21.15.37:0/455301451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f174015d390 msgr2=0x7f1740071e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173fe00640 1 --2- 172.21.15.37:0/455301451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f174015d390 0x7f1740071e00 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f174015a5c0 tx=0x7f173001c490 comp rx=0 tx=0).stop 2024-05-30T06:54:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173fe00640 1 -- 172.21.15.37:0/455301451 shutdown_connections 2024-05-30T06:54:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173fe00640 1 --2- 172.21.15.37:0/455301451 >> v2:172.21.15.105:3300/0 conn(0x7f17401422f0 0x7f1740072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173fe00640 1 --2- 172.21.15.37:0/455301451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f174015d390 0x7f1740071e00 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173fe00640 1 -- 172.21.15.37:0/455301451 >> 172.21.15.37:0/455301451 conn(0x7f1740067d60 msgr2=0x7f174006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.154+0000 7f173fe00640 1 -- 172.21.15.37:0/455301451 shutdown_connections 2024-05-30T06:54:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173fe00640 1 -- 172.21.15.37:0/455301451 wait complete. 2024-05-30T06:54:32.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173fe00640 1 Processor -- start 2024-05-30T06:54:32.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173fe00640 1 -- start start 2024-05-30T06:54:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17401422f0 0x7f1740160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174015d390 0x7f1740136640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173fe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f174015d770 0x7f1740136b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f174006fb80 con 0x7f17401422f0 2024-05-30T06:54:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173fe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f174006fa00 con 0x7f174015d770 2024-05-30T06:54:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173fe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f174006fd00 con 0x7f174015d390 2024-05-30T06:54:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17401422f0 0x7f1740160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17401422f0 0x7f1740160730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50476/0 (socket says 172.21.15.37:50476) 2024-05-30T06:54:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173ea00640 1 -- 172.21.15.37:0/3823123929 learned_addr learned my addr 172.21.15.37:0/3823123929 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173e000640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174015d390 0x7f1740136640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173ea00640 1 -- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174015d390 msgr2=0x7f1740136640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173f400640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f174015d770 0x7f1740136b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173ea00640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174015d390 0x7f1740136640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173ea00640 1 -- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f174015d770 msgr2=0x7f1740136b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173ea00640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f174015d770 0x7f1740136b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173ea00640 1 -- 172.21.15.37:0/3823123929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17400ae7d0 con 0x7f17401422f0 2024-05-30T06:54:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173e000640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174015d390 0x7f1740136640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:54:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173f400640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f174015d770 0x7f1740136b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:54:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173ea00640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17401422f0 0x7f1740160730 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f17300190a0 tx=0x7f1730019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f1736a00640 1 -- 172.21.15.37:0/3823123929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300b0040 con 0x7f17401422f0 2024-05-30T06:54:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f1736a00640 1 -- 172.21.15.37:0/3823123929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17300b9070 con 0x7f17401422f0 2024-05-30T06:54:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f1736a00640 1 -- 172.21.15.37:0/3823123929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300b38a0 con 0x7f17401422f0 2024-05-30T06:54:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.158+0000 7f173fe00640 1 -- 172.21.15.37:0/3823123929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17400aeab0 con 0x7f17401422f0 2024-05-30T06:54:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.162+0000 7f173fe00640 1 -- 172.21.15.37:0/3823123929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17400af070 con 0x7f17401422f0 2024-05-30T06:54:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.162+0000 7f173fe00640 1 -- 172.21.15.37:0/3823123929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1740068ab0 con 0x7f17401422f0 2024-05-30T06:54:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.162+0000 7f1736a00640 1 -- 172.21.15.37:0/3823123929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 34) ==== 89670+0+0 (secure 0 0 0) 0x7f17300b3a40 con 0x7f17401422f0 2024-05-30T06:54:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.162+0000 7f1736a00640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1720069640 0x7f172006bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.162+0000 7f1736a00640 1 -- 172.21.15.37:0/3823123929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f173011f810 con 0x7f17401422f0 2024-05-30T06:54:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.162+0000 7f173e000640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1720069640 0x7f172006bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.166+0000 7f173e000640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1720069640 0x7f172006bb00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f172c007fd0 tx=0x7f172c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.166+0000 7f1736a00640 1 -- 172.21.15.37:0/3823123929 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1730016110 con 0x7f17401422f0 2024-05-30T06:54:32.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.366+0000 7f173fe00640 1 -- 172.21.15.37:0/3823123929 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f1740072e60 con 0x7f1720069640 2024-05-30T06:54:32.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.426+0000 7f1736a00640 1 -- 172.21.15.37:0/3823123929 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1740072e60 con 0x7f1720069640 2024-05-30T06:54:32.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.430+0000 7f173fe00640 1 -- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1720069640 msgr2=0x7f172006bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:32.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.430+0000 7f173fe00640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1720069640 0x7f172006bb00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f172c007fd0 tx=0x7f172c009040 comp rx=0 tx=0).stop 2024-05-30T06:54:32.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.430+0000 7f173fe00640 1 -- 172.21.15.37:0/3823123929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17401422f0 msgr2=0x7f1740160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:32.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.430+0000 7f173fe00640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17401422f0 0x7f1740160730 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f17300190a0 tx=0x7f1730019230 comp rx=0 tx=0).stop 2024-05-30T06:54:32.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.430+0000 7f173fe00640 1 -- 172.21.15.37:0/3823123929 shutdown_connections 2024-05-30T06:54:32.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.430+0000 7f173fe00640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1720069640 0x7f172006bb00 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:32.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.430+0000 7f173fe00640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f174015d770 0x7f1740136b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:32.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.430+0000 7f173fe00640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174015d390 0x7f1740136640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:32.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.430+0000 7f173fe00640 1 --2- 172.21.15.37:0/3823123929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17401422f0 0x7f1740160730 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:32.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.430+0000 7f173fe00640 1 -- 172.21.15.37:0/3823123929 >> 172.21.15.37:0/3823123929 conn(0x7f1740067d60 msgr2=0x7f174013af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:32.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.430+0000 7f173fe00640 1 -- 172.21.15.37:0/3823123929 shutdown_connections 2024-05-30T06:54:32.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.430+0000 7f173fe00640 1 -- 172.21.15.37:0/3823123929 wait complete. 2024-05-30T06:54:32.432 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:32.436+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:32.432 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:32.436+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:32.432 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:32.436+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:32.433 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:32.436+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:32.433 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:32.436+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:32.449 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:32.452+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:32.449 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:32.452+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:32.449 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:32.452+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:32.449 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:32.452+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:32.449 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:32.452+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:32.450 INFO:tasks.cephfs.test_volumes:expected clone state = ('in-progress',) 2024-05-30T06:54:32.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T06:54:32.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.594+0000 7f3036800640 1 Processor -- start 2024-05-30T06:54:32.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.594+0000 7f3036800640 1 -- start start 2024-05-30T06:54:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.598+0000 7f3036800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3030155da0 0x7f30300cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.598+0000 7f3036800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f303015f310 con 0x7f303006f770 2024-05-30T06:54:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.598+0000 7f3036800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f303015f5f0 con 0x7f30300cd440 2024-05-30T06:54:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.598+0000 7f3036800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f303015f8d0 con 0x7f3030155da0 2024-05-30T06:54:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.598+0000 7f302fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f303006f770 0x7f30300b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45726/0 (socket says 172.21.15.37:45726) 2024-05-30T06:54:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.598+0000 7f302fe00640 1 -- 172.21.15.37:0/832003635 learned_addr learned my addr 172.21.15.37:0/832003635 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:54:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.598+0000 7f302f400640 1 --2- 172.21.15.37:0/832003635 >> v2:172.21.15.105:3300/0 conn(0x7f3030155da0 0x7f30300cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.598+0000 7f302ea00640 1 -- 172.21.15.37:0/832003635 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575693354 0 0) 0x7f303015f310 con 0x7f303006f770 2024-05-30T06:54:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.598+0000 7f302ea00640 1 -- 172.21.15.37:0/832003635 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3014005740 con 0x7f303006f770 2024-05-30T06:54:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.598+0000 7f302f400640 1 -- 172.21.15.37:0/832003635 >> v1:172.21.15.105:6789/0 conn(0x7f30300cd440 legacy=0x7f303006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.598+0000 7f302f400640 1 -- 172.21.15.37:0/832003635 >> v1:172.21.15.37:6789/0 conn(0x7f303006f770 legacy=0x7f30300b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.598+0000 7f302ea00640 1 -- 172.21.15.37:0/832003635 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399606054 0 0) 0x7f303015f5f0 con 0x7f30300cd440 2024-05-30T06:54:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.598+0000 7f302f400640 1 -- 172.21.15.37:0/832003635 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303015fbb0 con 0x7f3030155da0 2024-05-30T06:54:32.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.602+0000 7f302f400640 1 --2- 172.21.15.37:0/832003635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3030155da0 0x7f30300cd950 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f30200097c0 tx=0x7f302001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e4908ccc09f2bb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:32.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.602+0000 7f302ea00640 1 -- 172.21.15.37:0/832003635 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30200b0070 con 0x7f3030155da0 2024-05-30T06:54:32.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.602+0000 7f302ea00640 1 -- 172.21.15.37:0/832003635 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30200ab600 con 0x7f3030155da0 2024-05-30T06:54:32.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.602+0000 7f302ea00640 1 -- 172.21.15.37:0/832003635 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30200ab9d0 con 0x7f3030155da0 2024-05-30T06:54:32.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.602+0000 7f3036800640 1 -- 172.21.15.37:0/832003635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3030155da0 msgr2=0x7f30300cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:32.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.602+0000 7f3036800640 1 --2- 172.21.15.37:0/832003635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3030155da0 0x7f30300cd950 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f30200097c0 tx=0x7f302001c380 comp rx=0 tx=0).stop 2024-05-30T06:54:32.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.602+0000 7f3036800640 1 -- 172.21.15.37:0/832003635 shutdown_connections 2024-05-30T06:54:32.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.602+0000 7f3036800640 1 --2- 172.21.15.37:0/832003635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3030155da0 0x7f30300cd950 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:32.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.602+0000 7f3036800640 1 -- 172.21.15.37:0/832003635 >> 172.21.15.37:0/832003635 conn(0x7f303006bf60 msgr2=0x7f30300b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:32.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.602+0000 7f3036800640 1 -- 172.21.15.37:0/832003635 shutdown_connections 2024-05-30T06:54:32.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.602+0000 7f3036800640 1 -- 172.21.15.37:0/832003635 wait complete. 2024-05-30T06:54:32.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.602+0000 7f3036800640 1 Processor -- start 2024-05-30T06:54:32.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.602+0000 7f3036800640 1 -- start start 2024-05-30T06:54:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3036800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f303006f770 0x7f3030166490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3036800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3030155da0 0x7f30301510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3036800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30301562b0 0x7f3030151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:32.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3036800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f303006e360 con 0x7f3030155da0 2024-05-30T06:54:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3036800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f303006e1e0 con 0x7f303006f770 2024-05-30T06:54:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3036800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f303006e4e0 con 0x7f30301562b0 2024-05-30T06:54:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3027e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3030155da0 0x7f30301510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3027e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3030155da0 0x7f30301510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50492/0 (socket says 172.21.15.37:50492) 2024-05-30T06:54:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3027e00640 1 -- 172.21.15.37:0/1913764264 learned_addr learned my addr 172.21.15.37:0/1913764264 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f302f400640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f303006f770 0x7f3030166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f302fe00640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30301562b0 0x7f3030151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3027e00640 1 -- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30301562b0 msgr2=0x7f3030151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3027e00640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30301562b0 0x7f3030151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3027e00640 1 -- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f303006f770 msgr2=0x7f3030166490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3027e00640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f303006f770 0x7f3030166490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3027e00640 1 -- 172.21.15.37:0/1913764264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30301669d0 con 0x7f3030155da0 2024-05-30T06:54:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f302f400640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f303006f770 0x7f3030166490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:54:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3027e00640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3030155da0 0x7f30301510c0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f301800c4b0 tx=0x7f301800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3027400640 1 -- 172.21.15.37:0/1913764264 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018005480 con 0x7f3030155da0 2024-05-30T06:54:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3027400640 1 -- 172.21.15.37:0/1913764264 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3018003600 con 0x7f3030155da0 2024-05-30T06:54:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3027400640 1 -- 172.21.15.37:0/1913764264 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30180039f0 con 0x7f3030155da0 2024-05-30T06:54:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3036800640 1 -- 172.21.15.37:0/1913764264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3030156790 con 0x7f3030155da0 2024-05-30T06:54:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3036800640 1 -- 172.21.15.37:0/1913764264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3030156d50 con 0x7f3030155da0 2024-05-30T06:54:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.606+0000 7f3036800640 1 -- 172.21.15.37:0/1913764264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3030068bc0 con 0x7f3030155da0 2024-05-30T06:54:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.610+0000 7f3027400640 1 -- 172.21.15.37:0/1913764264 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 34) ==== 89670+0+0 (secure 0 0 0) 0x7f3018003b90 con 0x7f3030155da0 2024-05-30T06:54:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.610+0000 7f3027400640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f300c069610 0x7f300c06bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.610+0000 7f3027400640 1 -- 172.21.15.37:0/1913764264 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f3018085640 con 0x7f3030155da0 2024-05-30T06:54:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.610+0000 7f302f400640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f300c069610 0x7f300c06bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.610+0000 7f302f400640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f300c069610 0x7f300c06bad0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f30200ad000 tx=0x7f3020008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.614+0000 7f3027400640 1 -- 172.21.15.37:0/1913764264 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f30180572a0 con 0x7f3030155da0 2024-05-30T06:54:32.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:32.818+0000 7f3036800640 1 -- 172.21.15.37:0/1913764264 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f30300b6790 con 0x7f300c069610 2024-05-30T06:54:33.434 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:33.436+0000 7f0009800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:33.434 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:33.436+0000 7f0009800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:33.434 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:33.436+0000 7f0009800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:33.434 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:33.436+0000 7f0009800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:33.434 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:54:33.436+0000 7f0009800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:54:33.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.466+0000 7f3027400640 1 -- 172.21.15.37:0/1913764264 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+275 (secure 0 0 0) 0x7f30300b6790 con 0x7f300c069610 2024-05-30T06:54:33.466 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: "status": { 2024-05-30T06:54:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "in-progress", 2024-05-30T06:54:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: "source": { 2024-05-30T06:54:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: "volume": "cephfs", 2024-05-30T06:54:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: "subvolume": "sv1", 2024-05-30T06:54:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot": "ss1" 2024-05-30T06:54:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_report": { 2024-05-30T06:54:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: "percentage cloned": 0.0, 2024-05-30T06:54:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: "amount cloned": "184/3.0G", 2024-05-30T06:54:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: "files cloned": "3/6" 2024-05-30T06:54:33.467 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:33.468 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.466+0000 7f3036800640 1 -- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f300c069610 msgr2=0x7f300c06bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.466+0000 7f3036800640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f300c069610 0x7f300c06bad0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f30200ad000 tx=0x7f3020008040 comp rx=0 tx=0).stop 2024-05-30T06:54:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.466+0000 7f3036800640 1 -- 172.21.15.37:0/1913764264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3030155da0 msgr2=0x7f30301510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.466+0000 7f3036800640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3030155da0 0x7f30301510c0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f301800c4b0 tx=0x7f301800c970 comp rx=0 tx=0).stop 2024-05-30T06:54:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.466+0000 7f3036800640 1 -- 172.21.15.37:0/1913764264 shutdown_connections 2024-05-30T06:54:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.466+0000 7f3036800640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30301562b0 0x7f3030151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.466+0000 7f3036800640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3030155da0 0x7f30301510c0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.466+0000 7f3036800640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f300c069610 0x7f300c06bad0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:33.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.466+0000 7f3036800640 1 --2- 172.21.15.37:0/1913764264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f303006f770 0x7f3030166490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.466+0000 7f3036800640 1 -- 172.21.15.37:0/1913764264 >> 172.21.15.37:0/1913764264 conn(0x7f303006bf60 msgr2=0x7f303015a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.470+0000 7f3036800640 1 -- 172.21.15.37:0/1913764264 shutdown_connections 2024-05-30T06:54:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.470+0000 7f3036800640 1 -- 172.21.15.37:0/1913764264 wait complete. 2024-05-30T06:54:33.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T06:54:33.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.682+0000 7f6f10c00640 1 Processor -- start 2024-05-30T06:54:33.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.682+0000 7f6f10c00640 1 -- start start 2024-05-30T06:54:33.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.686+0000 7f6f10c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f0c15c610 0x7f6f0c0d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:33.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.686+0000 7f6f10c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6f0c06f3a0 0x7f6f0c06f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:33.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.686+0000 7f6f10c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f0c0ce130 con 0x7f6f0c155990 2024-05-30T06:54:33.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.686+0000 7f6f10c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6f0c0cde50 con 0x7f6f0c06f3a0 2024-05-30T06:54:33.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.686+0000 7f6f10c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0c0cf820 con 0x7f6f0c15c610 2024-05-30T06:54:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.686+0000 7f6f0b400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6f0c155990 0x7f6f0c0cd550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45728/0 (socket says 172.21.15.37:45728) 2024-05-30T06:54:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.686+0000 7f6f0b400640 1 -- 172.21.15.37:0/74978470 learned_addr learned my addr 172.21.15.37:0/74978470 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:54:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.686+0000 7f6f0aa00640 1 --2- 172.21.15.37:0/74978470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f0c15c610 0x7f6f0c0d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.686+0000 7f6f0be00640 1 --2- 172.21.15.37:0/74978470 >> v2:172.21.15.105:3300/0 conn(0x7f6f0c06f3a0 0x7f6f0c06f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:33.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.686+0000 7f6f0be00640 1 -- 172.21.15.37:0/74978470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f0c15c610 msgr2=0x7f6f0c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:33.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.686+0000 7f6f0be00640 1 --2- 172.21.15.37:0/74978470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f0c15c610 0x7f6f0c0d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:33.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.686+0000 7f6f0be00640 1 -- 172.21.15.37:0/74978470 >> v1:172.21.15.37:6789/0 conn(0x7f6f0c155990 legacy=0x7f6f0c0cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:33.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.686+0000 7f6f0be00640 1 -- 172.21.15.37:0/74978470 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0c0cfb00 con 0x7f6f0c06f3a0 2024-05-30T06:54:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.690+0000 7f6f0be00640 1 --2- 172.21.15.37:0/74978470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f0c06f3a0 0x7f6f0c06f830 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6f04009d90 tx=0x7f6f0401c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=751bf4222803b832 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.690+0000 7f6f0a000640 1 -- 172.21.15.37:0/74978470 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f040ac070 con 0x7f6f0c06f3a0 2024-05-30T06:54:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.690+0000 7f6f0a000640 1 -- 172.21.15.37:0/74978470 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f040a6610 con 0x7f6f0c06f3a0 2024-05-30T06:54:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.690+0000 7f6f0a000640 1 -- 172.21.15.37:0/74978470 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f040a69e0 con 0x7f6f0c06f3a0 2024-05-30T06:54:33.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.694+0000 7f6f10c00640 1 -- 172.21.15.37:0/74978470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f0c06f3a0 msgr2=0x7f6f0c06f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.694+0000 7f6f10c00640 1 --2- 172.21.15.37:0/74978470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f0c06f3a0 0x7f6f0c06f830 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6f04009d90 tx=0x7f6f0401c820 comp rx=0 tx=0).stop 2024-05-30T06:54:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.694+0000 7f6f10c00640 1 -- 172.21.15.37:0/74978470 shutdown_connections 2024-05-30T06:54:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.694+0000 7f6f10c00640 1 --2- 172.21.15.37:0/74978470 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f0c06f3a0 0x7f6f0c06f830 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.694+0000 7f6f10c00640 1 --2- 172.21.15.37:0/74978470 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f0c15c610 0x7f6f0c0d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.694+0000 7f6f10c00640 1 -- 172.21.15.37:0/74978470 >> 172.21.15.37:0/74978470 conn(0x7f6f0c0b25f0 msgr2=0x7f6f0c0b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.694+0000 7f6f10c00640 1 -- 172.21.15.37:0/74978470 shutdown_connections 2024-05-30T06:54:33.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.694+0000 7f6f10c00640 1 -- 172.21.15.37:0/74978470 wait complete. 2024-05-30T06:54:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.694+0000 7f6f10c00640 1 Processor -- start 2024-05-30T06:54:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.694+0000 7f6f10c00640 1 -- start start 2024-05-30T06:54:33.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f10c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f0c06f3a0 0x7f6f0c162fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:33.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f10c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f0c155990 0x7f6f0c15f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:33.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f10c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f0c15c610 0x7f6f0c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:33.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f10c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c072dd0 con 0x7f6f0c155990 2024-05-30T06:54:33.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f10c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c072c50 con 0x7f6f0c06f3a0 2024-05-30T06:54:33.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f10c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6f0c072f50 con 0x7f6f0c15c610 2024-05-30T06:54:33.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f0aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f0c155990 0x7f6f0c15f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:33.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f0aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f0c155990 0x7f6f0c15f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50494/0 (socket says 172.21.15.37:50494) 2024-05-30T06:54:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f0aa00640 1 -- 172.21.15.37:0/2537451074 learned_addr learned my addr 172.21.15.37:0/2537451074 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f0b400640 1 --2- 172.21.15.37:0/2537451074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f0c06f3a0 0x7f6f0c162fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f0aa00640 1 -- 172.21.15.37:0/2537451074 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f0c15c610 msgr2=0x7f6f0c06e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f0aa00640 1 --2- 172.21.15.37:0/2537451074 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f0c15c610 0x7f6f0c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f0aa00640 1 -- 172.21.15.37:0/2537451074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f0c06f3a0 msgr2=0x7f6f0c162fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f0aa00640 1 --2- 172.21.15.37:0/2537451074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f0c06f3a0 0x7f6f0c162fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f0aa00640 1 -- 172.21.15.37:0/2537451074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0c1635f0 con 0x7f6f0c155990 2024-05-30T06:54:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f0aa00640 1 --2- 172.21.15.37:0/2537451074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f0c155990 0x7f6f0c15f1c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800d5f0 tx=0x7f6ef800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f03400640 1 -- 172.21.15.37:0/2537451074 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80125f0 con 0x7f6f0c155990 2024-05-30T06:54:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f03400640 1 -- 172.21.15.37:0/2537451074 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef8019070 con 0x7f6f0c155990 2024-05-30T06:54:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f03400640 1 -- 172.21.15.37:0/2537451074 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80129b0 con 0x7f6f0c155990 2024-05-30T06:54:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f10c00640 1 -- 172.21.15.37:0/2537451074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f0c1638d0 con 0x7f6f0c155990 2024-05-30T06:54:33.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.698+0000 7f6f10c00640 1 -- 172.21.15.37:0/2537451074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f0c163e90 con 0x7f6f0c155990 2024-05-30T06:54:33.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.702+0000 7f6f10c00640 1 -- 172.21.15.37:0/2537451074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f0c075580 con 0x7f6f0c155990 2024-05-30T06:54:33.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.702+0000 7f6f03400640 1 -- 172.21.15.37:0/2537451074 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 34) ==== 89670+0+0 (secure 0 0 0) 0x7f6ef8012b50 con 0x7f6f0c155990 2024-05-30T06:54:33.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.702+0000 7f6f03400640 1 --2- 172.21.15.37:0/2537451074 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6eec069660 0x7f6eec06bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:33.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.702+0000 7f6f03400640 1 -- 172.21.15.37:0/2537451074 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f6ef8085cc0 con 0x7f6f0c155990 2024-05-30T06:54:33.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.706+0000 7f6f0b400640 1 --2- 172.21.15.37:0/2537451074 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6eec069660 0x7f6eec06bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:33.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.706+0000 7f6f0b400640 1 --2- 172.21.15.37:0/2537451074 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6eec069660 0x7f6eec06bb20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6efc000f70 tx=0x7f6efc007e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:33.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.710+0000 7f6f03400640 1 -- 172.21.15.37:0/2537451074 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6ef8057990 con 0x7f6f0c155990 2024-05-30T06:54:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:33.894+0000 7f6f03400640 1 -- 172.21.15.37:0/2537451074 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 35) ==== 89772+0+0 (secure 0 0 0) 0x7f6ef8053900 con 0x7f6f0c155990 2024-05-30T06:54:34.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.010+0000 7f6f10c00640 1 -- 172.21.15.37:0/2537451074 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f6f0c15dda0 con 0x7f6eec069660 2024-05-30T06:54:34.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.058+0000 7f6f03400640 1 -- 172.21.15.37:0/2537451074 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+275 (secure 0 0 0) 0x7f6f0c15dda0 con 0x7f6eec069660 2024-05-30T06:54:34.058 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: "status": { 2024-05-30T06:54:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "in-progress", 2024-05-30T06:54:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: "source": { 2024-05-30T06:54:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: "volume": "cephfs", 2024-05-30T06:54:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: "subvolume": "sv1", 2024-05-30T06:54:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot": "ss1" 2024-05-30T06:54:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_report": { 2024-05-30T06:54:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: "percentage cloned": 0.0, 2024-05-30T06:54:34.059 INFO:teuthology.orchestra.run.smithi037.stdout: "amount cloned": "184/3.0G", 2024-05-30T06:54:34.059 INFO:teuthology.orchestra.run.smithi037.stdout: "files cloned": "4/6" 2024-05-30T06:54:34.059 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:34.059 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:34.059 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:34.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.058+0000 7f6f10c00640 1 -- 172.21.15.37:0/2537451074 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6eec069660 msgr2=0x7f6eec06bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:34.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.058+0000 7f6f10c00640 1 --2- 172.21.15.37:0/2537451074 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6eec069660 0x7f6eec06bb20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f6efc000f70 tx=0x7f6efc007e10 comp rx=0 tx=0).stop 2024-05-30T06:54:34.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.058+0000 7f6f10c00640 1 -- 172.21.15.37:0/2537451074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f0c155990 msgr2=0x7f6f0c15f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:34.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.058+0000 7f6f10c00640 1 --2- 172.21.15.37:0/2537451074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f0c155990 0x7f6f0c15f1c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800d5f0 tx=0x7f6ef800dab0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.058+0000 7f6f10c00640 1 -- 172.21.15.37:0/2537451074 shutdown_connections 2024-05-30T06:54:34.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.058+0000 7f6f10c00640 1 --2- 172.21.15.37:0/2537451074 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f0c15c610 0x7f6f0c06e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.058+0000 7f6f10c00640 1 --2- 172.21.15.37:0/2537451074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f0c155990 0x7f6f0c15f1c0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.058+0000 7f6f10c00640 1 --2- 172.21.15.37:0/2537451074 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6eec069660 0x7f6eec06bb20 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.058+0000 7f6f10c00640 1 --2- 172.21.15.37:0/2537451074 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f0c06f3a0 0x7f6f0c162fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.058+0000 7f6f10c00640 1 -- 172.21.15.37:0/2537451074 >> 172.21.15.37:0/2537451074 conn(0x7f6f0c0b25f0 msgr2=0x7f6f0c074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:34.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.058+0000 7f6f10c00640 1 -- 172.21.15.37:0/2537451074 shutdown_connections 2024-05-30T06:54:34.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.058+0000 7f6f10c00640 1 -- 172.21.15.37:0/2537451074 wait complete. 2024-05-30T06:54:34.090 INFO:tasks.cephfs.test_volumes:percentage cloned = 0.0 2024-05-30T06:54:34.090 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T06:54:34.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.306+0000 7fab07200640 1 Processor -- start 2024-05-30T06:54:34.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.306+0000 7fab07200640 1 -- start start 2024-05-30T06:54:34.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.306+0000 7fab07200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab0015ebc0 0x7fab000d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:34.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.306+0000 7fab07200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fab0009aa60 0x7fab0009ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:34.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.306+0000 7fab07200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab0009b3b0 con 0x7fab0009b800 2024-05-30T06:54:34.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.306+0000 7fab07200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fab000d0840 con 0x7fab0015ebc0 2024-05-30T06:54:34.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.306+0000 7fab07200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fab0006dec0 con 0x7fab0009aa60 2024-05-30T06:54:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.310+0000 7faaffe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab0015ebc0 0x7fab000d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.310+0000 7faaffe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab0015ebc0 0x7fab000d15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50496/0 (socket says 172.21.15.37:50496) 2024-05-30T06:54:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.310+0000 7faaffe00640 1 -- 172.21.15.37:0/19162336 learned_addr learned my addr 172.21.15.37:0/19162336 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.310+0000 7fab05200640 1 --2- 172.21.15.37:0/19162336 >> v2:172.21.15.105:3300/0 conn(0x7fab0009aa60 0x7fab0009ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:34.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.310+0000 7faaffe00640 1 -- 172.21.15.37:0/19162336 >> v2:172.21.15.105:3300/0 conn(0x7fab0009aa60 msgr2=0x7fab0009ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:34.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.310+0000 7faaffe00640 1 --2- 172.21.15.37:0/19162336 >> v2:172.21.15.105:3300/0 conn(0x7fab0009aa60 0x7fab0009ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.310+0000 7faaffe00640 1 -- 172.21.15.37:0/19162336 >> v1:172.21.15.105:6789/0 conn(0x7fab0009b800 legacy=0x7fab0006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:34.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.310+0000 7faaffe00640 1 -- 172.21.15.37:0/19162336 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0009bce0 con 0x7fab0015ebc0 2024-05-30T06:54:34.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.310+0000 7faaffe00640 1 --2- 172.21.15.37:0/19162336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab0015ebc0 0x7fab000d15c0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fab000cefa0 tx=0x7faaf001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b647fc4d89cc12 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:34.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.314+0000 7faafea00640 1 -- 172.21.15.37:0/19162336 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf00ab610 con 0x7fab0015ebc0 2024-05-30T06:54:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.314+0000 7faafea00640 1 -- 172.21.15.37:0/19162336 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf00b0070 con 0x7fab0015ebc0 2024-05-30T06:54:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.314+0000 7faafea00640 1 -- 172.21.15.37:0/19162336 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf00ab9d0 con 0x7fab0015ebc0 2024-05-30T06:54:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.314+0000 7fab07200640 1 -- 172.21.15.37:0/19162336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab0015ebc0 msgr2=0x7fab000d15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:34.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.314+0000 7fab07200640 1 --2- 172.21.15.37:0/19162336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab0015ebc0 0x7fab000d15c0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fab000cefa0 tx=0x7faaf001c520 comp rx=0 tx=0).stop 2024-05-30T06:54:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.314+0000 7fab07200640 1 -- 172.21.15.37:0/19162336 shutdown_connections 2024-05-30T06:54:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.314+0000 7fab07200640 1 --2- 172.21.15.37:0/19162336 >> v2:172.21.15.105:3300/0 conn(0x7fab0009aa60 0x7fab0009ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.314+0000 7fab07200640 1 --2- 172.21.15.37:0/19162336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab0015ebc0 0x7fab000d15c0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.314+0000 7fab07200640 1 -- 172.21.15.37:0/19162336 >> 172.21.15.37:0/19162336 conn(0x7fab000b4060 msgr2=0x7fab000b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:34.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.314+0000 7fab07200640 1 -- 172.21.15.37:0/19162336 shutdown_connections 2024-05-30T06:54:34.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.314+0000 7fab07200640 1 -- 172.21.15.37:0/19162336 wait complete. 2024-05-30T06:54:34.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.314+0000 7fab07200640 1 Processor -- start 2024-05-30T06:54:34.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.314+0000 7fab07200640 1 -- start start 2024-05-30T06:54:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7fab07200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0009aa60 0x7fab000c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7fab07200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab0009b800 0x7fab00153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7fab07200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab0015ebc0 0x7fab00155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:34.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7fab07200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fab000d1b00 con 0x7fab0015ebc0 2024-05-30T06:54:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7fab07200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fab0015efa0 con 0x7fab0009aa60 2024-05-30T06:54:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7fab07200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fab000afd90 con 0x7fab0009b800 2024-05-30T06:54:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7fab05200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab0015ebc0 0x7fab00155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:34.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7faaffe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0009aa60 0x7fab000c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:34.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7faaffe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0009aa60 0x7fab000c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:45338/0 (socket says 172.21.15.37:45338) 2024-05-30T06:54:34.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7fab05200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab0015ebc0 0x7fab00155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50502/0 (socket says 172.21.15.37:50502) 2024-05-30T06:54:34.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7faaffe00640 1 -- 172.21.15.37:0/524888593 learned_addr learned my addr 172.21.15.37:0/524888593 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7fab05200640 1 -- 172.21.15.37:0/524888593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab0009b800 msgr2=0x7fab00153900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:54:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7fab05200640 1 --2- 172.21.15.37:0/524888593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab0009b800 0x7fab00153900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7fab05200640 1 -- 172.21.15.37:0/524888593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0009aa60 msgr2=0x7fab000c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7fab05200640 1 --2- 172.21.15.37:0/524888593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0009aa60 0x7fab000c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7fab05200640 1 -- 172.21.15.37:0/524888593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab001541e0 con 0x7fab0015ebc0 2024-05-30T06:54:34.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.318+0000 7faaffe00640 1 --2- 172.21.15.37:0/524888593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0009aa60 0x7fab000c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:54:34.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.322+0000 7fab05200640 1 --2- 172.21.15.37:0/524888593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab0015ebc0 0x7fab00155810 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7faaf8007cf0 tx=0x7faaf800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:34.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.322+0000 7faaf7e00640 1 -- 172.21.15.37:0/524888593 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf800edd0 con 0x7fab0015ebc0 2024-05-30T06:54:34.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.322+0000 7fab07200640 1 -- 172.21.15.37:0/524888593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab001544c0 con 0x7fab0015ebc0 2024-05-30T06:54:34.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.322+0000 7faaf7e00640 1 -- 172.21.15.37:0/524888593 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf80039a0 con 0x7fab0015ebc0 2024-05-30T06:54:34.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.322+0000 7faaf7e00640 1 -- 172.21.15.37:0/524888593 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf8003d90 con 0x7fab0015ebc0 2024-05-30T06:54:34.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.322+0000 7fab07200640 1 -- 172.21.15.37:0/524888593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab00154a80 con 0x7fab0015ebc0 2024-05-30T06:54:34.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.322+0000 7fab07200640 1 -- 172.21.15.37:0/524888593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab00068bc0 con 0x7fab0015ebc0 2024-05-30T06:54:34.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.326+0000 7faaf7e00640 1 -- 172.21.15.37:0/524888593 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 35) ==== 89772+0+0 (secure 0 0 0) 0x7faaf801b020 con 0x7fab0015ebc0 2024-05-30T06:54:34.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.330+0000 7faaf7e00640 1 --2- 172.21.15.37:0/524888593 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faae0069730 0x7faae006bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:34.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.330+0000 7faaf7e00640 1 -- 172.21.15.37:0/524888593 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7faaf8086240 con 0x7fab0015ebc0 2024-05-30T06:54:34.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.330+0000 7faaffe00640 1 --2- 172.21.15.37:0/524888593 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faae0069730 0x7faae006bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:34.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.330+0000 7faaffe00640 1 --2- 172.21.15.37:0/524888593 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faae0069730 0x7faae006bbf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7faaf0000c10 tx=0x7faaf00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:34.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.334+0000 7faaf7e00640 1 -- 172.21.15.37:0/524888593 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faaf8058250 con 0x7fab0015ebc0 2024-05-30T06:54:34.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.630+0000 7fab07200640 1 -- 172.21.15.37:0/524888593 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fab00154c50 con 0x7faae0069730 2024-05-30T06:54:34.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.661+0000 7faaf7e00640 1 -- 172.21.15.37:0/524888593 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+275 (secure 0 0 0) 0x7fab00154c50 con 0x7faae0069730 2024-05-30T06:54:34.664 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:34.664 INFO:teuthology.orchestra.run.smithi037.stdout: "status": { 2024-05-30T06:54:34.664 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "in-progress", 2024-05-30T06:54:34.665 INFO:teuthology.orchestra.run.smithi037.stdout: "source": { 2024-05-30T06:54:34.665 INFO:teuthology.orchestra.run.smithi037.stdout: "volume": "cephfs", 2024-05-30T06:54:34.665 INFO:teuthology.orchestra.run.smithi037.stdout: "subvolume": "sv1", 2024-05-30T06:54:34.665 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot": "ss1" 2024-05-30T06:54:34.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:34.665 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_report": { 2024-05-30T06:54:34.665 INFO:teuthology.orchestra.run.smithi037.stdout: "percentage cloned": 0.0, 2024-05-30T06:54:34.665 INFO:teuthology.orchestra.run.smithi037.stdout: "amount cloned": "184/3.0G", 2024-05-30T06:54:34.665 INFO:teuthology.orchestra.run.smithi037.stdout: "files cloned": "4/6" 2024-05-30T06:54:34.665 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:34.665 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:34.665 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:34.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.665+0000 7fab07200640 1 -- 172.21.15.37:0/524888593 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faae0069730 msgr2=0x7faae006bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:34.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.665+0000 7fab07200640 1 --2- 172.21.15.37:0/524888593 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faae0069730 0x7faae006bbf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7faaf0000c10 tx=0x7faaf00a7000 comp rx=0 tx=0).stop 2024-05-30T06:54:34.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.665+0000 7fab07200640 1 -- 172.21.15.37:0/524888593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab0015ebc0 msgr2=0x7fab00155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:34.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.665+0000 7fab07200640 1 --2- 172.21.15.37:0/524888593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab0015ebc0 0x7fab00155810 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7faaf8007cf0 tx=0x7faaf800e4b0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.665+0000 7fab07200640 1 -- 172.21.15.37:0/524888593 shutdown_connections 2024-05-30T06:54:34.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.665+0000 7fab07200640 1 --2- 172.21.15.37:0/524888593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab0015ebc0 0x7fab00155810 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.665+0000 7fab07200640 1 --2- 172.21.15.37:0/524888593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab0009b800 0x7fab00153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.665+0000 7fab07200640 1 --2- 172.21.15.37:0/524888593 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faae0069730 0x7faae006bbf0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.665+0000 7fab07200640 1 --2- 172.21.15.37:0/524888593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab0009aa60 0x7fab000c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.665+0000 7fab07200640 1 -- 172.21.15.37:0/524888593 >> 172.21.15.37:0/524888593 conn(0x7fab000b4060 msgr2=0x7fab000b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:34.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.665+0000 7fab07200640 1 -- 172.21.15.37:0/524888593 shutdown_connections 2024-05-30T06:54:34.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.665+0000 7fab07200640 1 -- 172.21.15.37:0/524888593 wait complete. 2024-05-30T06:54:34.704 INFO:tasks.cephfs.test_volumes:percentage cloned = 0.0 2024-05-30T06:54:34.705 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T06:54:34.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b63e00640 1 Processor -- start 2024-05-30T06:54:34.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b63e00640 1 -- start start 2024-05-30T06:54:34.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b63e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9b6409b0a0 0x7f9b6406e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:34.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b63e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b640d1140 0x7f9b640cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:34.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b63e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b640d15b0 con 0x7f9b6409acc0 2024-05-30T06:54:34.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b63e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9b640ce590 con 0x7f9b6409b0a0 2024-05-30T06:54:34.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b63e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9b640cd730 con 0x7f9b640d1140 2024-05-30T06:54:34.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b62000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9b6409b0a0 0x7f9b6406e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:34.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b62000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9b6409b0a0 0x7f9b6406e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50504/0 (socket says 172.21.15.37:50504) 2024-05-30T06:54:34.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b62000640 1 -- 172.21.15.37:0/2957238460 learned_addr learned my addr 172.21.15.37:0/2957238460 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:34.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b63400640 1 --2- 172.21.15.37:0/2957238460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b640d1140 0x7f9b640cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:34.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b62000640 1 -- 172.21.15.37:0/2957238460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b640d1140 msgr2=0x7f9b640cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:34.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b62000640 1 --2- 172.21.15.37:0/2957238460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b640d1140 0x7f9b640cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b62000640 1 -- 172.21.15.37:0/2957238460 >> v1:172.21.15.105:6789/0 conn(0x7f9b6409acc0 legacy=0x7f9b6406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:34.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.937+0000 7f9b62000640 1 -- 172.21.15.37:0/2957238460 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b640cd980 con 0x7f9b6409b0a0 2024-05-30T06:54:34.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.941+0000 7f9b62000640 1 --2- 172.21.15.37:0/2957238460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b6409b0a0 0x7f9b6406e290 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009870 tx=0x7f9b5001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb088bc5f0028cde server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:34.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.941+0000 7f9b61600640 1 -- 172.21.15.37:0/2957238460 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b500b5070 con 0x7f9b6409b0a0 2024-05-30T06:54:34.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.941+0000 7f9b61600640 1 -- 172.21.15.37:0/2957238460 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b500a89d0 con 0x7f9b6409b0a0 2024-05-30T06:54:34.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.941+0000 7f9b61600640 1 -- 172.21.15.37:0/2957238460 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b500a8da0 con 0x7f9b6409b0a0 2024-05-30T06:54:34.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.941+0000 7f9b63e00640 1 -- 172.21.15.37:0/2957238460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b6409b0a0 msgr2=0x7f9b6406e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:34.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.941+0000 7f9b63e00640 1 --2- 172.21.15.37:0/2957238460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b6409b0a0 0x7f9b6406e290 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009870 tx=0x7f9b5001ed10 comp rx=0 tx=0).stop 2024-05-30T06:54:34.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.941+0000 7f9b63e00640 1 -- 172.21.15.37:0/2957238460 shutdown_connections 2024-05-30T06:54:34.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.941+0000 7f9b63e00640 1 --2- 172.21.15.37:0/2957238460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b640d1140 0x7f9b640cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.941+0000 7f9b63e00640 1 --2- 172.21.15.37:0/2957238460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b6409b0a0 0x7f9b6406e290 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.941+0000 7f9b63e00640 1 -- 172.21.15.37:0/2957238460 >> 172.21.15.37:0/2957238460 conn(0x7f9b640b3ef0 msgr2=0x7f9b640b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:34.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.941+0000 7f9b63e00640 1 -- 172.21.15.37:0/2957238460 shutdown_connections 2024-05-30T06:54:34.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b63e00640 1 -- 172.21.15.37:0/2957238460 wait complete. 2024-05-30T06:54:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b63e00640 1 Processor -- start 2024-05-30T06:54:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b63e00640 1 -- start start 2024-05-30T06:54:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b63e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b6409acc0 0x7f9b640cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b63e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b640d1140 0x7f9b640ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b63e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b640cac50 0x7f9b640c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b63e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b640ce220 con 0x7f9b640cac50 2024-05-30T06:54:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b63e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9b640cdf40 con 0x7f9b6409acc0 2024-05-30T06:54:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b63e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9b640cea20 con 0x7f9b640d1140 2024-05-30T06:54:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b63400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b640cac50 0x7f9b640c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b63400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b640cac50 0x7f9b640c6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50512/0 (socket says 172.21.15.37:50512) 2024-05-30T06:54:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b63400640 1 -- 172.21.15.37:0/3859821344 learned_addr learned my addr 172.21.15.37:0/3859821344 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b62000640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b640d1140 0x7f9b640ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.945+0000 7f9b62a00640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b6409acc0 0x7f9b640cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:34.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.949+0000 7f9b63400640 1 -- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b640d1140 msgr2=0x7f9b640ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:34.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.949+0000 7f9b63400640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b640d1140 0x7f9b640ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.949+0000 7f9b63400640 1 -- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b6409acc0 msgr2=0x7f9b640cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:34.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.949+0000 7f9b63400640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b6409acc0 0x7f9b640cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:34.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.949+0000 7f9b63400640 1 -- 172.21.15.37:0/3859821344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b640c9690 con 0x7f9b640cac50 2024-05-30T06:54:34.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.949+0000 7f9b62a00640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b6409acc0 0x7f9b640cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:54:34.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.949+0000 7f9b63400640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b640cac50 0x7f9b640c6390 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00efc0 tx=0x7f9b5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:34.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.949+0000 7f9b5aa00640 1 -- 172.21.15.37:0/3859821344 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c018020 con 0x7f9b640cac50 2024-05-30T06:54:34.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.949+0000 7f9b5aa00640 1 -- 172.21.15.37:0/3859821344 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b5c014480 con 0x7f9b640cac50 2024-05-30T06:54:34.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.949+0000 7f9b5aa00640 1 -- 172.21.15.37:0/3859821344 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c014870 con 0x7f9b640cac50 2024-05-30T06:54:34.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.949+0000 7f9b63e00640 1 -- 172.21.15.37:0/3859821344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b640c9950 con 0x7f9b640cac50 2024-05-30T06:54:34.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.949+0000 7f9b63e00640 1 -- 172.21.15.37:0/3859821344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b640c9f10 con 0x7f9b640cac50 2024-05-30T06:54:34.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.949+0000 7f9b63e00640 1 -- 172.21.15.37:0/3859821344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b64068ab0 con 0x7f9b640cac50 2024-05-30T06:54:34.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.953+0000 7f9b5aa00640 1 -- 172.21.15.37:0/3859821344 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 35) ==== 89772+0+0 (secure 0 0 0) 0x7f9b5c01b020 con 0x7f9b640cac50 2024-05-30T06:54:34.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.953+0000 7f9b5aa00640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9b44069730 0x7f9b4406bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:34.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.953+0000 7f9b5aa00640 1 -- 172.21.15.37:0/3859821344 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f9b5c086370 con 0x7f9b640cac50 2024-05-30T06:54:34.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.957+0000 7f9b62a00640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9b44069730 0x7f9b4406bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:34.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.957+0000 7f9b62a00640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9b44069730 0x7f9b4406bbf0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009890 tx=0x7f9b54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:34.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:34.961+0000 7f9b5aa00640 1 -- 172.21.15.37:0/3859821344 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9b5c022070 con 0x7f9b640cac50 2024-05-30T06:54:35.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.281+0000 7f9b63e00640 1 -- 172.21.15.37:0/3859821344 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f9b64071990 con 0x7f9b44069730 2024-05-30T06:54:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.293+0000 7f9b5aa00640 1 -- 172.21.15.37:0/3859821344 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+279 (secure 0 0 0) 0x7f9b64071990 con 0x7f9b44069730 2024-05-30T06:54:35.298 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:35.298 INFO:teuthology.orchestra.run.smithi037.stdout: "status": { 2024-05-30T06:54:35.298 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "in-progress", 2024-05-30T06:54:35.298 INFO:teuthology.orchestra.run.smithi037.stdout: "source": { 2024-05-30T06:54:35.298 INFO:teuthology.orchestra.run.smithi037.stdout: "volume": "cephfs", 2024-05-30T06:54:35.298 INFO:teuthology.orchestra.run.smithi037.stdout: "subvolume": "sv1", 2024-05-30T06:54:35.298 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot": "ss1" 2024-05-30T06:54:35.298 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:35.298 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_report": { 2024-05-30T06:54:35.298 INFO:teuthology.orchestra.run.smithi037.stdout: "percentage cloned": 23.958, 2024-05-30T06:54:35.299 INFO:teuthology.orchestra.run.smithi037.stdout: "amount cloned": "736M/3.0G", 2024-05-30T06:54:35.299 INFO:teuthology.orchestra.run.smithi037.stdout: "files cloned": "4/6" 2024-05-30T06:54:35.299 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:35.299 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:35.299 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:35.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.297+0000 7f9b63e00640 1 -- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9b44069730 msgr2=0x7f9b4406bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:35.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.297+0000 7f9b63e00640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9b44069730 0x7f9b4406bbf0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009890 tx=0x7f9b54008040 comp rx=0 tx=0).stop 2024-05-30T06:54:35.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.297+0000 7f9b63e00640 1 -- 172.21.15.37:0/3859821344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b640cac50 msgr2=0x7f9b640c6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:35.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.297+0000 7f9b63e00640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b640cac50 0x7f9b640c6390 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c00efc0 tx=0x7f9b5c00c490 comp rx=0 tx=0).stop 2024-05-30T06:54:35.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.297+0000 7f9b63e00640 1 -- 172.21.15.37:0/3859821344 shutdown_connections 2024-05-30T06:54:35.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.297+0000 7f9b63e00640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b640cac50 0x7f9b640c6390 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:35.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.297+0000 7f9b63e00640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b640d1140 0x7f9b640ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:35.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.297+0000 7f9b63e00640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9b44069730 0x7f9b4406bbf0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:35.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.297+0000 7f9b63e00640 1 --2- 172.21.15.37:0/3859821344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b6409acc0 0x7f9b640cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:35.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.297+0000 7f9b63e00640 1 -- 172.21.15.37:0/3859821344 >> 172.21.15.37:0/3859821344 conn(0x7f9b640b3ef0 msgr2=0x7f9b640ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.297+0000 7f9b63e00640 1 -- 172.21.15.37:0/3859821344 shutdown_connections 2024-05-30T06:54:35.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.297+0000 7f9b63e00640 1 -- 172.21.15.37:0/3859821344 wait complete. 2024-05-30T06:54:35.317 INFO:tasks.cephfs.test_volumes:percentage cloned = 23.958 2024-05-30T06:54:35.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T06:54:35.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:54:35.367 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:54:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.533+0000 7f60d3800640 1 Processor -- start 2024-05-30T06:54:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.533+0000 7f60d3800640 1 -- start start 2024-05-30T06:54:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.537+0000 7f60d3800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f60cc0d01e0 0x7f60cc09baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.537+0000 7f60d3800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60cc0d0b70 0x7f60cc0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.537+0000 7f60d3800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60cc0d0730 con 0x7f60cc15c8a0 2024-05-30T06:54:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.537+0000 7f60d3800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f60cc0d1560 con 0x7f60cc0d01e0 2024-05-30T06:54:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.537+0000 7f60d3800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f60cc0cd3c0 con 0x7f60cc0d0b70 2024-05-30T06:54:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.537+0000 7f60cbe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f60cc0d01e0 0x7f60cc09baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.537+0000 7f60d1800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60cc0d0b70 0x7f60cc0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.537+0000 7f60cbe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f60cc0d01e0 0x7f60cc09baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:45368/0 (socket says 172.21.15.37:45368) 2024-05-30T06:54:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.537+0000 7f60cbe00640 1 -- 172.21.15.37:0/3766557380 learned_addr learned my addr 172.21.15.37:0/3766557380 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.537+0000 7f60cbe00640 1 -- 172.21.15.37:0/3766557380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60cc0d0b70 msgr2=0x7f60cc0d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:35.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.537+0000 7f60cbe00640 1 --2- 172.21.15.37:0/3766557380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60cc0d0b70 0x7f60cc0d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:35.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.537+0000 7f60cbe00640 1 -- 172.21.15.37:0/3766557380 >> v1:172.21.15.105:6789/0 conn(0x7f60cc15c8a0 legacy=0x7f60cc0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:35.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.537+0000 7f60cbe00640 1 -- 172.21.15.37:0/3766557380 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60cc0cd6a0 con 0x7f60cc0d01e0 2024-05-30T06:54:35.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.541+0000 7f60cbe00640 1 --2- 172.21.15.37:0/3766557380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60cc0d01e0 0x7f60cc09baa0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009870 tx=0x7f60b801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85f382e7546260b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:35.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.541+0000 7f60cb400640 1 -- 172.21.15.37:0/3766557380 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b80b5070 con 0x7f60cc0d01e0 2024-05-30T06:54:35.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.545+0000 7f60cb400640 1 -- 172.21.15.37:0/3766557380 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60b80a8a50 con 0x7f60cc0d01e0 2024-05-30T06:54:35.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.545+0000 7f60cb400640 1 -- 172.21.15.37:0/3766557380 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b80a8e20 con 0x7f60cc0d01e0 2024-05-30T06:54:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.545+0000 7f60d3800640 1 -- 172.21.15.37:0/3766557380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60cc0d01e0 msgr2=0x7f60cc09baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.545+0000 7f60d3800640 1 --2- 172.21.15.37:0/3766557380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60cc0d01e0 0x7f60cc09baa0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009870 tx=0x7f60b801ed50 comp rx=0 tx=0).stop 2024-05-30T06:54:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.545+0000 7f60d3800640 1 -- 172.21.15.37:0/3766557380 shutdown_connections 2024-05-30T06:54:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.545+0000 7f60d3800640 1 --2- 172.21.15.37:0/3766557380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60cc0d0b70 0x7f60cc0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.545+0000 7f60d3800640 1 --2- 172.21.15.37:0/3766557380 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60cc0d01e0 0x7f60cc09baa0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.545+0000 7f60d3800640 1 -- 172.21.15.37:0/3766557380 >> 172.21.15.37:0/3766557380 conn(0x7f60cc0b4100 msgr2=0x7f60cc0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.545+0000 7f60d3800640 1 -- 172.21.15.37:0/3766557380 shutdown_connections 2024-05-30T06:54:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.545+0000 7f60d3800640 1 -- 172.21.15.37:0/3766557380 wait complete. 2024-05-30T06:54:35.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d3800640 1 Processor -- start 2024-05-30T06:54:35.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d3800640 1 -- start start 2024-05-30T06:54:35.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d3800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60cc0d01e0 0x7f60cc157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:35.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d3800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60cc0d0b70 0x7f60cc1f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:35.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d3800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60cc15c8a0 0x7f60cc1f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:35.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d3800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc15cc80 con 0x7f60cc0d01e0 2024-05-30T06:54:35.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d3800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc0c9410 con 0x7f60cc15c8a0 2024-05-30T06:54:35.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d3800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f60cc15ce00 con 0x7f60cc0d0b70 2024-05-30T06:54:35.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60cc0d01e0 0x7f60cc157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:35.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60cc0d01e0 0x7f60cc157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50522/0 (socket says 172.21.15.37:50522) 2024-05-30T06:54:35.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d0e00640 1 -- 172.21.15.37:0/2226035311 learned_addr learned my addr 172.21.15.37:0/2226035311 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:35.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60cbe00640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60cc0d0b70 0x7f60cc1f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:35.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d1800640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60cc15c8a0 0x7f60cc1f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:35.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d0e00640 1 -- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60cc0d0b70 msgr2=0x7f60cc1f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:35.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d0e00640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60cc0d0b70 0x7f60cc1f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:35.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d0e00640 1 -- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60cc15c8a0 msgr2=0x7f60cc1f3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:35.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d0e00640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60cc15c8a0 0x7f60cc1f3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:35.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d0e00640 1 -- 172.21.15.37:0/2226035311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60cc1f3fd0 con 0x7f60cc0d01e0 2024-05-30T06:54:35.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d0e00640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60cc0d01e0 0x7f60cc157b60 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f60c000c3a0 tx=0x7f60c000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:35.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60c8c00640 1 -- 172.21.15.37:0/2226035311 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c00052d0 con 0x7f60cc0d01e0 2024-05-30T06:54:35.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60c8c00640 1 -- 172.21.15.37:0/2226035311 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c0005470 con 0x7f60cc0d01e0 2024-05-30T06:54:35.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d3800640 1 -- 172.21.15.37:0/2226035311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60cc1f42b0 con 0x7f60cc0d01e0 2024-05-30T06:54:35.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60c8c00640 1 -- 172.21.15.37:0/2226035311 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c0007260 con 0x7f60cc0d01e0 2024-05-30T06:54:35.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.549+0000 7f60d3800640 1 -- 172.21.15.37:0/2226035311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60cc1f4870 con 0x7f60cc0d01e0 2024-05-30T06:54:35.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.553+0000 7f60d3800640 1 -- 172.21.15.37:0/2226035311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60cc068bc0 con 0x7f60cc0d01e0 2024-05-30T06:54:35.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.557+0000 7f60c8c00640 1 -- 172.21.15.37:0/2226035311 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 35) ==== 89772+0+0 (secure 0 0 0) 0x7f60c0007400 con 0x7f60cc0d01e0 2024-05-30T06:54:35.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.557+0000 7f60c8c00640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60ac069760 0x7f60ac06bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:35.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.561+0000 7f60c8c00640 1 -- 172.21.15.37:0/2226035311 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f60c0054d20 con 0x7f60cc0d01e0 2024-05-30T06:54:35.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.561+0000 7f60c8c00640 1 -- 172.21.15.37:0/2226035311 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f60c0057380 con 0x7f60cc0d01e0 2024-05-30T06:54:35.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.565+0000 7f60cbe00640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60ac069760 0x7f60ac06bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.565+0000 7f60cbe00640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60ac069760 0x7f60ac06bc20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f60b80b2000 tx=0x7f60b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:35.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.869+0000 7f60d3800640 1 -- 172.21.15.37:0/2226035311 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f60cc0b4e30 con 0x7f60ac069760 2024-05-30T06:54:35.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.917+0000 7f60c8c00640 1 -- 172.21.15.37:0/2226035311 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+278 (secure 0 0 0) 0x7f60cc0b4e30 con 0x7f60ac069760 2024-05-30T06:54:35.918 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:35.918 INFO:teuthology.orchestra.run.smithi037.stdout: "status": { 2024-05-30T06:54:35.918 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "in-progress", 2024-05-30T06:54:35.918 INFO:teuthology.orchestra.run.smithi037.stdout: "source": { 2024-05-30T06:54:35.918 INFO:teuthology.orchestra.run.smithi037.stdout: "volume": "cephfs", 2024-05-30T06:54:35.918 INFO:teuthology.orchestra.run.smithi037.stdout: "subvolume": "sv1", 2024-05-30T06:54:35.918 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot": "ss1" 2024-05-30T06:54:35.918 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:35.919 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_report": { 2024-05-30T06:54:35.919 INFO:teuthology.orchestra.run.smithi037.stdout: "percentage cloned": 43.75, 2024-05-30T06:54:35.919 INFO:teuthology.orchestra.run.smithi037.stdout: "amount cloned": "1.3G/3.0G", 2024-05-30T06:54:35.919 INFO:teuthology.orchestra.run.smithi037.stdout: "files cloned": "5/6" 2024-05-30T06:54:35.919 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:35.919 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:35.919 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:35.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.921+0000 7f60d3800640 1 -- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60ac069760 msgr2=0x7f60ac06bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:35.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.921+0000 7f60d3800640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60ac069760 0x7f60ac06bc20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f60b80b2000 tx=0x7f60b8008040 comp rx=0 tx=0).stop 2024-05-30T06:54:35.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.921+0000 7f60d3800640 1 -- 172.21.15.37:0/2226035311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60cc0d01e0 msgr2=0x7f60cc157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:35.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.921+0000 7f60d3800640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60cc0d01e0 0x7f60cc157b60 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f60c000c3a0 tx=0x7f60c000c860 comp rx=0 tx=0).stop 2024-05-30T06:54:35.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.921+0000 7f60d3800640 1 -- 172.21.15.37:0/2226035311 shutdown_connections 2024-05-30T06:54:35.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.921+0000 7f60d3800640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60ac069760 0x7f60ac06bc20 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:35.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.921+0000 7f60d3800640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60cc15c8a0 0x7f60cc1f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:35.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.921+0000 7f60d3800640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60cc0d0b70 0x7f60cc1f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:35.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.921+0000 7f60d3800640 1 --2- 172.21.15.37:0/2226035311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60cc0d01e0 0x7f60cc157b60 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:35.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.921+0000 7f60d3800640 1 -- 172.21.15.37:0/2226035311 >> 172.21.15.37:0/2226035311 conn(0x7f60cc0b4100 msgr2=0x7f60cc0ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:35.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.921+0000 7f60d3800640 1 -- 172.21.15.37:0/2226035311 shutdown_connections 2024-05-30T06:54:35.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:35.921+0000 7f60d3800640 1 -- 172.21.15.37:0/2226035311 wait complete. 2024-05-30T06:54:35.952 INFO:tasks.cephfs.test_volumes:percentage cloned = 43.75 2024-05-30T06:54:35.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T06:54:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.157+0000 7f2ecb200640 1 Processor -- start 2024-05-30T06:54:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.157+0000 7f2ecb200640 1 -- start start 2024-05-30T06:54:36.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ecb200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ecc09aa60 0x7f2ecc09aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:36.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ecb200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ecc0d10e0 0x7f2ecc0d1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:36.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ecb200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ecc09b5d0 con 0x7f2ecc0c7dd0 2024-05-30T06:54:36.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ecb200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2ecc0d0c50 con 0x7f2ecc09aa60 2024-05-30T06:54:36.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ecb200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2ecc09b8b0 con 0x7f2ecc0d10e0 2024-05-30T06:54:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ec9400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ecc09aa60 0x7f2ecc09aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ec9400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ecc09aa60 0x7f2ecc09aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50524/0 (socket says 172.21.15.37:50524) 2024-05-30T06:54:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ec9400640 1 -- 172.21.15.37:0/759067485 learned_addr learned my addr 172.21.15.37:0/759067485 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ec9e00640 1 --1- 172.21.15.37:0/759067485 >> v1:172.21.15.37:6789/0 conn(0x7f2ecc0c7dd0 0x7f2ecc0c81b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45732/0 (socket says 172.21.15.37:45732) 2024-05-30T06:54:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ec9400640 1 -- 172.21.15.37:0/759067485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ecc0d10e0 msgr2=0x7f2ecc0d1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ec9400640 1 --2- 172.21.15.37:0/759067485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ecc0d10e0 0x7f2ecc0d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ec9400640 1 -- 172.21.15.37:0/759067485 >> v1:172.21.15.37:6789/0 conn(0x7f2ecc0c7dd0 legacy=0x7f2ecc0c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ec9400640 1 -- 172.21.15.37:0/759067485 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc09bb90 con 0x7f2ecc09aa60 2024-05-30T06:54:36.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.161+0000 7f2ec8a00640 1 -- 172.21.15.37:0/759067485 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419498158 0 0) 0x7f2ecc09b5d0 con 0x7f2ecc0c7dd0 2024-05-30T06:54:36.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.165+0000 7f2ec9400640 1 --2- 172.21.15.37:0/759067485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc09aa60 0x7f2ecc09aee0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8009870 tx=0x7f2eb801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edcf6be9e248887 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:36.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.165+0000 7f2ec8a00640 1 -- 172.21.15.37:0/759067485 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80a7070 con 0x7f2ecc09aa60 2024-05-30T06:54:36.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.165+0000 7f2ec8a00640 1 -- 172.21.15.37:0/759067485 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb80b0070 con 0x7f2ecc09aa60 2024-05-30T06:54:36.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.165+0000 7f2ec8a00640 1 -- 172.21.15.37:0/759067485 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80ab890 con 0x7f2ecc09aa60 2024-05-30T06:54:36.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.165+0000 7f2ecb200640 1 -- 172.21.15.37:0/759067485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc09aa60 msgr2=0x7f2ecc09aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:36.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.165+0000 7f2ecb200640 1 --2- 172.21.15.37:0/759067485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc09aa60 0x7f2ecc09aee0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8009870 tx=0x7f2eb801c560 comp rx=0 tx=0).stop 2024-05-30T06:54:36.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.165+0000 7f2ecb200640 1 -- 172.21.15.37:0/759067485 shutdown_connections 2024-05-30T06:54:36.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.165+0000 7f2ecb200640 1 --2- 172.21.15.37:0/759067485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ecc0d10e0 0x7f2ecc0d1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.165+0000 7f2ecb200640 1 --2- 172.21.15.37:0/759067485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc09aa60 0x7f2ecc09aee0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.165+0000 7f2ecb200640 1 -- 172.21.15.37:0/759067485 >> 172.21.15.37:0/759067485 conn(0x7f2ecc0cef80 msgr2=0x7f2ecc0cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:36.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.165+0000 7f2ecb200640 1 -- 172.21.15.37:0/759067485 shutdown_connections 2024-05-30T06:54:36.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.165+0000 7f2ecb200640 1 -- 172.21.15.37:0/759067485 wait complete. 2024-05-30T06:54:36.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.169+0000 7f2ecb200640 1 Processor -- start 2024-05-30T06:54:36.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.169+0000 7f2ecb200640 1 -- start start 2024-05-30T06:54:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.169+0000 7f2ecb200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ecc09aa60 0x7f2ecc0b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.169+0000 7f2ecb200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0c7dd0 0x7f2ecc0b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.169+0000 7f2ecb200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ecc0d10e0 0x7f2ecc1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.169+0000 7f2ecb200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc169570 con 0x7f2ecc0c7dd0 2024-05-30T06:54:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.169+0000 7f2ecb200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc0ce930 con 0x7f2ecc09aa60 2024-05-30T06:54:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.169+0000 7f2ecb200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2ecc1696f0 con 0x7f2ecc0d10e0 2024-05-30T06:54:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.169+0000 7f2ec9e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ecc09aa60 0x7f2ecc0b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.169+0000 7f2ec9e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ecc09aa60 0x7f2ecc0b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:45374/0 (socket says 172.21.15.37:45374) 2024-05-30T06:54:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.169+0000 7f2ec9e00640 1 -- 172.21.15.37:0/1751473128 learned_addr learned my addr 172.21.15.37:0/1751473128 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.169+0000 7f2eca800640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ecc0d10e0 0x7f2ecc1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:36.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.173+0000 7f2ec9400640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0c7dd0 0x7f2ecc0b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:36.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.173+0000 7f2ec9e00640 1 -- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ecc0d10e0 msgr2=0x7f2ecc1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:36.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.173+0000 7f2ec9e00640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ecc0d10e0 0x7f2ecc1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.173+0000 7f2ec9e00640 1 -- 172.21.15.37:0/1751473128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0c7dd0 msgr2=0x7f2ecc0b7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:36.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.173+0000 7f2ec9e00640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0c7dd0 0x7f2ecc0b7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.173+0000 7f2ec9e00640 1 -- 172.21.15.37:0/1751473128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc0b7960 con 0x7f2ecc09aa60 2024-05-30T06:54:36.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.173+0000 7f2ec9400640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0c7dd0 0x7f2ecc0b7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:54:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.177+0000 7f2ec9e00640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ecc09aa60 0x7f2ecc0b5210 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0011f0 tx=0x7f2ebc00c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:36.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.177+0000 7f2ec2000640 1 -- 172.21.15.37:0/1751473128 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc018070 con 0x7f2ecc09aa60 2024-05-30T06:54:36.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.177+0000 7f2ecb200640 1 -- 172.21.15.37:0/1751473128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ecc1555e0 con 0x7f2ecc09aa60 2024-05-30T06:54:36.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.177+0000 7f2ecb200640 1 -- 172.21.15.37:0/1751473128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ecc0b5bd0 con 0x7f2ecc09aa60 2024-05-30T06:54:36.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.177+0000 7f2ec2000640 1 -- 172.21.15.37:0/1751473128 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0074e0 con 0x7f2ecc09aa60 2024-05-30T06:54:36.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.177+0000 7f2ec2000640 1 -- 172.21.15.37:0/1751473128 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc022060 con 0x7f2ecc09aa60 2024-05-30T06:54:36.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.181+0000 7f2ec2000640 1 -- 172.21.15.37:0/1751473128 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7f2ebc01b070 con 0x7f2ecc09aa60 2024-05-30T06:54:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.181+0000 7f2ecb200640 1 -- 172.21.15.37:0/1751473128 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea40052a0 con 0x7f2ecc09aa60 2024-05-30T06:54:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.185+0000 7f2ec2000640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2eac0697c0 0x7f2eac06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.185+0000 7f2ec2000640 1 -- 172.21.15.37:0/1751473128 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f2ebc084d00 con 0x7f2ecc09aa60 2024-05-30T06:54:36.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.185+0000 7f2ec9400640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2eac0697c0 0x7f2eac06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:36.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.189+0000 7f2ec9400640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2eac0697c0 0x7f2eac06bc80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80af000 tx=0x7f2eb80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:36.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.193+0000 7f2ec2000640 1 -- 172.21.15.37:0/1751473128 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2ebc0562f0 con 0x7f2ecc09aa60 2024-05-30T06:54:36.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.509+0000 7f2ecb200640 1 -- 172.21.15.37:0/1751473128 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f2ea4000bd0 con 0x7f2eac0697c0 2024-05-30T06:54:36.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.529+0000 7f2ec2000640 1 -- 172.21.15.37:0/1751473128 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+278 (secure 0 0 0) 0x7f2ea4000bd0 con 0x7f2eac0697c0 2024-05-30T06:54:36.530 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "status": { 2024-05-30T06:54:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "in-progress", 2024-05-30T06:54:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "source": { 2024-05-30T06:54:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "volume": "cephfs", 2024-05-30T06:54:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "subvolume": "sv1", 2024-05-30T06:54:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot": "ss1" 2024-05-30T06:54:36.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_report": { 2024-05-30T06:54:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "percentage cloned": 43.75, 2024-05-30T06:54:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "amount cloned": "1.3G/3.0G", 2024-05-30T06:54:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: "files cloned": "5/6" 2024-05-30T06:54:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:36.531 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:36.531 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.533+0000 7f2ecb200640 1 -- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2eac0697c0 msgr2=0x7f2eac06bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.533+0000 7f2ecb200640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2eac0697c0 0x7f2eac06bc80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80af000 tx=0x7f2eb80a7000 comp rx=0 tx=0).stop 2024-05-30T06:54:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.533+0000 7f2ecb200640 1 -- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ecc09aa60 msgr2=0x7f2ecc0b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.533+0000 7f2ecb200640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ecc09aa60 0x7f2ecc0b5210 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0011f0 tx=0x7f2ebc00c9b0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.533+0000 7f2ecb200640 1 -- 172.21.15.37:0/1751473128 shutdown_connections 2024-05-30T06:54:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.533+0000 7f2ecb200640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ecc0d10e0 0x7f2ecc1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.533+0000 7f2ecb200640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0c7dd0 0x7f2ecc0b7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.533+0000 7f2ecb200640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2eac0697c0 0x7f2eac06bc80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.533+0000 7f2ecb200640 1 --2- 172.21.15.37:0/1751473128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ecc09aa60 0x7f2ecc0b5210 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.533+0000 7f2ecb200640 1 -- 172.21.15.37:0/1751473128 >> 172.21.15.37:0/1751473128 conn(0x7f2ecc0cef80 msgr2=0x7f2ecc0c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.533+0000 7f2ecb200640 1 -- 172.21.15.37:0/1751473128 shutdown_connections 2024-05-30T06:54:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.533+0000 7f2ecb200640 1 -- 172.21.15.37:0/1751473128 wait complete. 2024-05-30T06:54:36.571 INFO:tasks.cephfs.test_volumes:percentage cloned = 43.75 2024-05-30T06:54:36.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T06:54:36.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.789+0000 7f5fa1800640 1 Processor -- start 2024-05-30T06:54:36.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.789+0000 7f5fa1800640 1 -- start start 2024-05-30T06:54:36.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.789+0000 7f5fa1800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5f9c15ebc0 0x7f5f9c0d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:36.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.789+0000 7f5fa1800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f9c09b800 0x7f5f9c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:36.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.789+0000 7f5fa1800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f9c0d0840 con 0x7f5f9c06dcf0 2024-05-30T06:54:36.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.789+0000 7f5fa1800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5f9c09bce0 con 0x7f5f9c15ebc0 2024-05-30T06:54:36.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.789+0000 7f5fa1800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5f9c0d0ae0 con 0x7f5f9c09b800 2024-05-30T06:54:36.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.789+0000 7f5f9aa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5f9c15ebc0 0x7f5f9c0d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:36.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.789+0000 7f5f9aa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5f9c15ebc0 0x7f5f9c0d15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50546/0 (socket says 172.21.15.37:50546) 2024-05-30T06:54:36.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.793+0000 7f5f9aa00640 1 -- 172.21.15.37:0/589265209 learned_addr learned my addr 172.21.15.37:0/589265209 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:36.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.793+0000 7f5f9aa00640 1 -- 172.21.15.37:0/589265209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f9c09b800 msgr2=0x7f5f9c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:36.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.793+0000 7f5f9aa00640 1 --2- 172.21.15.37:0/589265209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f9c09b800 0x7f5f9c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.793+0000 7f5f9aa00640 1 -- 172.21.15.37:0/589265209 >> v1:172.21.15.37:6789/0 conn(0x7f5f9c06dcf0 legacy=0x7f5f9c09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:36.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.793+0000 7f5f9aa00640 1 -- 172.21.15.37:0/589265209 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c0d0dc0 con 0x7f5f9c15ebc0 2024-05-30T06:54:36.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.797+0000 7f5f9aa00640 1 --2- 172.21.15.37:0/589265209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c15ebc0 0x7f5f9c0d15c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c009870 tx=0x7f5f8c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33683381ae7adff6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:36.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.797+0000 7f5f99600640 1 -- 172.21.15.37:0/589265209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0b0070 con 0x7f5f9c15ebc0 2024-05-30T06:54:36.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.797+0000 7f5f99600640 1 -- 172.21.15.37:0/589265209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8c004230 con 0x7f5f9c15ebc0 2024-05-30T06:54:36.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.797+0000 7f5f99600640 1 -- 172.21.15.37:0/589265209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c003620 con 0x7f5f9c15ebc0 2024-05-30T06:54:36.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.797+0000 7f5fa1800640 1 -- 172.21.15.37:0/589265209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c15ebc0 msgr2=0x7f5f9c0d15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:36.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.797+0000 7f5fa1800640 1 --2- 172.21.15.37:0/589265209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c15ebc0 0x7f5f9c0d15c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c009870 tx=0x7f5f8c01c3f0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.797+0000 7f5fa1800640 1 -- 172.21.15.37:0/589265209 shutdown_connections 2024-05-30T06:54:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.797+0000 7f5fa1800640 1 --2- 172.21.15.37:0/589265209 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f9c09b800 0x7f5f9c06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.797+0000 7f5fa1800640 1 --2- 172.21.15.37:0/589265209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c15ebc0 0x7f5f9c0d15c0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.797+0000 7f5fa1800640 1 -- 172.21.15.37:0/589265209 >> 172.21.15.37:0/589265209 conn(0x7f5f9c0b4060 msgr2=0x7f5f9c0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.797+0000 7f5fa1800640 1 -- 172.21.15.37:0/589265209 shutdown_connections 2024-05-30T06:54:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.797+0000 7f5fa1800640 1 -- 172.21.15.37:0/589265209 wait complete. 2024-05-30T06:54:36.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5fa1800640 1 Processor -- start 2024-05-30T06:54:36.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5fa1800640 1 -- start start 2024-05-30T06:54:36.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5fa1800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f9c06dcf0 0x7f5f9c160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5fa1800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c09b800 0x7f5f9c0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5fa1800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f9c15ebc0 0x7f5f9c0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5fa1800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c0d1b00 con 0x7f5f9c09b800 2024-05-30T06:54:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5fa1800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c15efa0 con 0x7f5f9c15ebc0 2024-05-30T06:54:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5fa1800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5f9c160fa0 con 0x7f5f9c06dcf0 2024-05-30T06:54:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f9a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c09b800 0x7f5f9c0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f9a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c09b800 0x7f5f9c0c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50556/0 (socket says 172.21.15.37:50556) 2024-05-30T06:54:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f9a000640 1 -- 172.21.15.37:0/701673067 learned_addr learned my addr 172.21.15.37:0/701673067 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f9aa00640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f9c06dcf0 0x7f5f9c160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f9b400640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f9c15ebc0 0x7f5f9c0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f9a000640 1 -- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f9c06dcf0 msgr2=0x7f5f9c160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:36.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f9a000640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f9c06dcf0 0x7f5f9c160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f9a000640 1 -- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f9c15ebc0 msgr2=0x7f5f9c0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f9a000640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f9c15ebc0 0x7f5f9c0cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f9a000640 1 -- 172.21.15.37:0/701673067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c0ca020 con 0x7f5f9c09b800 2024-05-30T06:54:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f9b400640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f9c15ebc0 0x7f5f9c0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:54:36.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f9a000640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c09b800 0x7f5f9c0c97d0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800b550 tx=0x7f5f8800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f92a00640 1 -- 172.21.15.37:0/701673067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88014070 con 0x7f5f9c09b800 2024-05-30T06:54:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f92a00640 1 -- 172.21.15.37:0/701673067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f88010890 con 0x7f5f9c09b800 2024-05-30T06:54:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5fa1800640 1 -- 172.21.15.37:0/701673067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9c0ca300 con 0x7f5f9c09b800 2024-05-30T06:54:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5f92a00640 1 -- 172.21.15.37:0/701673067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88010c80 con 0x7f5f9c09b800 2024-05-30T06:54:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.801+0000 7f5fa1800640 1 -- 172.21.15.37:0/701673067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f9c0ca8c0 con 0x7f5f9c09b800 2024-05-30T06:54:36.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.805+0000 7f5fa1800640 1 -- 172.21.15.37:0/701673067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9c068bc0 con 0x7f5f9c09b800 2024-05-30T06:54:36.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.805+0000 7f5f92a00640 1 -- 172.21.15.37:0/701673067 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7f5f88017070 con 0x7f5f9c09b800 2024-05-30T06:54:36.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.809+0000 7f5f92a00640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5f7c0697c0 0x7f5f7c06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:36.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.809+0000 7f5f92a00640 1 -- 172.21.15.37:0/701673067 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f5f88085c60 con 0x7f5f9c09b800 2024-05-30T06:54:36.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.813+0000 7f5f92a00640 1 -- 172.21.15.37:0/701673067 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5f88057250 con 0x7f5f9c09b800 2024-05-30T06:54:36.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.813+0000 7f5f9aa00640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5f7c0697c0 0x7f5f7c06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:36.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:36.829+0000 7f5f9aa00640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5f7c0697c0 0x7f5f7c06bc80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0ad000 tx=0x7f5f8c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:37.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.109+0000 7f5fa1800640 1 -- 172.21.15.37:0/701673067 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f5f9c09ade0 con 0x7f5f7c0697c0 2024-05-30T06:54:37.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.137+0000 7f5f92a00640 1 -- 172.21.15.37:0/701673067 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+279 (secure 0 0 0) 0x7f5f9c09ade0 con 0x7f5f7c0697c0 2024-05-30T06:54:37.141 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "status": { 2024-05-30T06:54:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "in-progress", 2024-05-30T06:54:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "source": { 2024-05-30T06:54:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "volume": "cephfs", 2024-05-30T06:54:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "subvolume": "sv1", 2024-05-30T06:54:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot": "ss1" 2024-05-30T06:54:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_report": { 2024-05-30T06:54:37.141 INFO:teuthology.orchestra.run.smithi037.stdout: "percentage cloned": 66.667, 2024-05-30T06:54:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: "amount cloned": "2.0G/3.0G", 2024-05-30T06:54:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: "files cloned": "5/6" 2024-05-30T06:54:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:37.142 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:37.142 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:37.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.141+0000 7f5fa1800640 1 -- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5f7c0697c0 msgr2=0x7f5f7c06bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:37.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.141+0000 7f5fa1800640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5f7c0697c0 0x7f5f7c06bc80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0ad000 tx=0x7f5f8c0a6000 comp rx=0 tx=0).stop 2024-05-30T06:54:37.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.141+0000 7f5fa1800640 1 -- 172.21.15.37:0/701673067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c09b800 msgr2=0x7f5f9c0c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:37.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.141+0000 7f5fa1800640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c09b800 0x7f5f9c0c97d0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f5f8800b550 tx=0x7f5f8800ba10 comp rx=0 tx=0).stop 2024-05-30T06:54:37.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.141+0000 7f5fa1800640 1 -- 172.21.15.37:0/701673067 shutdown_connections 2024-05-30T06:54:37.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.141+0000 7f5fa1800640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5f7c0697c0 0x7f5f7c06bc80 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.141+0000 7f5fa1800640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5f9c15ebc0 0x7f5f9c0cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.141+0000 7f5fa1800640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f9c09b800 0x7f5f9c0c97d0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.141+0000 7f5fa1800640 1 --2- 172.21.15.37:0/701673067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5f9c06dcf0 0x7f5f9c160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.141+0000 7f5fa1800640 1 -- 172.21.15.37:0/701673067 >> 172.21.15.37:0/701673067 conn(0x7f5f9c0b4060 msgr2=0x7f5f9c0ccba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:37.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.141+0000 7f5fa1800640 1 -- 172.21.15.37:0/701673067 shutdown_connections 2024-05-30T06:54:37.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.141+0000 7f5fa1800640 1 -- 172.21.15.37:0/701673067 wait complete. 2024-05-30T06:54:37.178 INFO:tasks.cephfs.test_volumes:percentage cloned = 66.667 2024-05-30T06:54:37.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T06:54:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.413+0000 7fac30600640 1 Processor -- start 2024-05-30T06:54:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.413+0000 7fac30600640 1 -- start start 2024-05-30T06:54:37.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.413+0000 7fac30600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fac2815ed00 0x7fac280b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:37.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.413+0000 7fac30600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac280d12f0 0x7fac280d1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:37.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.413+0000 7fac30600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac2806df50 con 0x7fac280b63a0 2024-05-30T06:54:37.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.413+0000 7fac30600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fac280d34b0 con 0x7fac2815ed00 2024-05-30T06:54:37.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.413+0000 7fac30600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fac28162c00 con 0x7fac280d12f0 2024-05-30T06:54:37.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.413+0000 7fac2dc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fac2815ed00 0x7fac280b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:37.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.413+0000 7fac2d200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac280d12f0 0x7fac280d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:37.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.417+0000 7fac2dc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fac2815ed00 0x7fac280b7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:60256/0 (socket says 172.21.15.37:60256) 2024-05-30T06:54:37.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.417+0000 7fac2dc00640 1 -- 172.21.15.37:0/660111466 learned_addr learned my addr 172.21.15.37:0/660111466 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:37.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.417+0000 7fac2d200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac280d12f0 0x7fac280d1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34960/0 (socket says 172.21.15.37:34960) 2024-05-30T06:54:37.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.417+0000 7fac2d200640 1 -- 172.21.15.37:0/660111466 >> v2:172.21.15.105:3300/0 conn(0x7fac2815ed00 msgr2=0x7fac280b7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:37.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.417+0000 7fac2d200640 1 --2- 172.21.15.37:0/660111466 >> v2:172.21.15.105:3300/0 conn(0x7fac2815ed00 0x7fac280b7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.417+0000 7fac2d200640 1 -- 172.21.15.37:0/660111466 >> v1:172.21.15.105:6789/0 conn(0x7fac280b63a0 legacy=0x7fac280d3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:37.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.417+0000 7fac2d200640 1 -- 172.21.15.37:0/660111466 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac280d2ea0 con 0x7fac280d12f0 2024-05-30T06:54:37.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.421+0000 7fac2d200640 1 --2- 172.21.15.37:0/660111466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac280d12f0 0x7fac280d1770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fac140097c0 tx=0x7fac1401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36930c2d85bd88ee server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:37.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.421+0000 7fac27e00640 1 -- 172.21.15.37:0/660111466 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac140b0070 con 0x7fac280d12f0 2024-05-30T06:54:37.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.421+0000 7fac27e00640 1 -- 172.21.15.37:0/660111466 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac140ab600 con 0x7fac280d12f0 2024-05-30T06:54:37.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.421+0000 7fac27e00640 1 -- 172.21.15.37:0/660111466 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac140ab9d0 con 0x7fac280d12f0 2024-05-30T06:54:37.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.421+0000 7fac30600640 1 -- 172.21.15.37:0/660111466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac280d12f0 msgr2=0x7fac280d1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:37.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.421+0000 7fac30600640 1 --2- 172.21.15.37:0/660111466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac280d12f0 0x7fac280d1770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fac140097c0 tx=0x7fac1401c4a0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.421+0000 7fac30600640 1 -- 172.21.15.37:0/660111466 shutdown_connections 2024-05-30T06:54:37.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.421+0000 7fac30600640 1 --2- 172.21.15.37:0/660111466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac280d12f0 0x7fac280d1770 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.421+0000 7fac30600640 1 --2- 172.21.15.37:0/660111466 >> v2:172.21.15.105:3300/0 conn(0x7fac2815ed00 0x7fac280b7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.421+0000 7fac30600640 1 -- 172.21.15.37:0/660111466 >> 172.21.15.37:0/660111466 conn(0x7fac2806cde0 msgr2=0x7fac2806d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:37.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.421+0000 7fac30600640 1 -- 172.21.15.37:0/660111466 shutdown_connections 2024-05-30T06:54:37.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.421+0000 7fac30600640 1 -- 172.21.15.37:0/660111466 wait complete. 2024-05-30T06:54:37.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac30600640 1 Processor -- start 2024-05-30T06:54:37.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac30600640 1 -- start start 2024-05-30T06:54:37.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac30600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac280b63a0 0x7fac2815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:37.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac30600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac280d12f0 0x7fac281592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:37.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac30600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac2815ed00 0x7fac28158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:37.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac30600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fac2815f260 con 0x7fac2815ed00 2024-05-30T06:54:37.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac30600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fac2815f0e0 con 0x7fac280b63a0 2024-05-30T06:54:37.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac30600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fac280b6bc0 con 0x7fac280d12f0 2024-05-30T06:54:37.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac2e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac2815ed00 0x7fac28158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:37.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac2e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac2815ed00 0x7fac28158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59728/0 (socket says 172.21.15.37:59728) 2024-05-30T06:54:37.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac2e600640 1 -- 172.21.15.37:0/3617972562 learned_addr learned my addr 172.21.15.37:0/3617972562 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:37.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac2dc00640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac280b63a0 0x7fac2815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:37.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac2d200640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac280d12f0 0x7fac281592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:37.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac2e600640 1 -- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac280d12f0 msgr2=0x7fac281592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:37.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac2e600640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac280d12f0 0x7fac281592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac2e600640 1 -- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac280b63a0 msgr2=0x7fac2815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:37.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac2e600640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac280b63a0 0x7fac2815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac2e600640 1 -- 172.21.15.37:0/3617972562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac281597f0 con 0x7fac2815ed00 2024-05-30T06:54:37.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac2e600640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac2815ed00 0x7fac28158100 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c730 tx=0x7fac2000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:37.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac25600640 1 -- 172.21.15.37:0/3617972562 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac20003b80 con 0x7fac2815ed00 2024-05-30T06:54:37.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac25600640 1 -- 172.21.15.37:0/3617972562 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac20003d20 con 0x7fac2815ed00 2024-05-30T06:54:37.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac25600640 1 -- 172.21.15.37:0/3617972562 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2000aa30 con 0x7fac2815ed00 2024-05-30T06:54:37.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac30600640 1 -- 172.21.15.37:0/3617972562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac28158640 con 0x7fac2815ed00 2024-05-30T06:54:37.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.425+0000 7fac30600640 1 -- 172.21.15.37:0/3617972562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac28157340 con 0x7fac2815ed00 2024-05-30T06:54:37.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.429+0000 7fac30600640 1 -- 172.21.15.37:0/3617972562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac280d26d0 con 0x7fac2815ed00 2024-05-30T06:54:37.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.429+0000 7fac25600640 1 -- 172.21.15.37:0/3617972562 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7fac2000abd0 con 0x7fac2815ed00 2024-05-30T06:54:37.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.433+0000 7fac25600640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fac080697c0 0x7fac0806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:37.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.433+0000 7fac25600640 1 -- 172.21.15.37:0/3617972562 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7fac20086440 con 0x7fac2815ed00 2024-05-30T06:54:37.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.433+0000 7fac25600640 1 -- 172.21.15.37:0/3617972562 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fac281597f0 con 0x7fac2815ed00 2024-05-30T06:54:37.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.437+0000 7fac2dc00640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fac080697c0 0x7fac0806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:37.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.437+0000 7fac2dc00640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fac080697c0 0x7fac0806bc80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009ae0 tx=0x7fac1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:37.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.729+0000 7fac30600640 1 -- 172.21.15.37:0/3617972562 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fac280c8430 con 0x7fac080697c0 2024-05-30T06:54:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.761+0000 7fac25600640 1 -- 172.21.15.37:0/3617972562 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+279 (secure 0 0 0) 0x7fac280c8430 con 0x7fac080697c0 2024-05-30T06:54:37.763 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: "status": { 2024-05-30T06:54:37.763 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "in-progress", 2024-05-30T06:54:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "source": { 2024-05-30T06:54:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "volume": "cephfs", 2024-05-30T06:54:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "subvolume": "sv1", 2024-05-30T06:54:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot": "ss1" 2024-05-30T06:54:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_report": { 2024-05-30T06:54:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "percentage cloned": 66.667, 2024-05-30T06:54:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "amount cloned": "2.0G/3.0G", 2024-05-30T06:54:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: "files cloned": "5/6" 2024-05-30T06:54:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:37.764 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:37.764 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.765+0000 7fac30600640 1 -- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fac080697c0 msgr2=0x7fac0806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.765+0000 7fac30600640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fac080697c0 0x7fac0806bc80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fac1c009ae0 tx=0x7fac1c008040 comp rx=0 tx=0).stop 2024-05-30T06:54:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.765+0000 7fac30600640 1 -- 172.21.15.37:0/3617972562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac2815ed00 msgr2=0x7fac28158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.765+0000 7fac30600640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac2815ed00 0x7fac28158100 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c730 tx=0x7fac2000cbf0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.765+0000 7fac30600640 1 -- 172.21.15.37:0/3617972562 shutdown_connections 2024-05-30T06:54:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.765+0000 7fac30600640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac2815ed00 0x7fac28158100 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.765+0000 7fac30600640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac280d12f0 0x7fac281592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.765+0000 7fac30600640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fac080697c0 0x7fac0806bc80 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.765+0000 7fac30600640 1 --2- 172.21.15.37:0/3617972562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac280b63a0 0x7fac2815a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.765+0000 7fac30600640 1 -- 172.21.15.37:0/3617972562 >> 172.21.15.37:0/3617972562 conn(0x7fac2806cde0 msgr2=0x7fac280c9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.765+0000 7fac30600640 1 -- 172.21.15.37:0/3617972562 shutdown_connections 2024-05-30T06:54:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:37.765+0000 7fac30600640 1 -- 172.21.15.37:0/3617972562 wait complete. 2024-05-30T06:54:37.795 INFO:tasks.cephfs.test_volumes:percentage cloned = 66.667 2024-05-30T06:54:37.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T06:54:38.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.005+0000 7f3375400640 1 Processor -- start 2024-05-30T06:54:38.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.005+0000 7f3375400640 1 -- start start 2024-05-30T06:54:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.005+0000 7f3375400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3370162e70 0x7f33700cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.005+0000 7f3375400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33700ce7d0 0x7f33700cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.005+0000 7f3375400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3370164190 con 0x7f3370163250 2024-05-30T06:54:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.005+0000 7f3375400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f337006f8e0 con 0x7f3370162e70 2024-05-30T06:54:38.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.005+0000 7f3375400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f337006ecd0 con 0x7f33700ce7d0 2024-05-30T06:54:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.009+0000 7f3365e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3370163250 0x7f33701636d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:50114/0 (socket says 172.21.15.37:50114) 2024-05-30T06:54:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.009+0000 7f336e800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3370162e70 0x7f33700cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.009+0000 7f3365e00640 1 -- 172.21.15.37:0/3134492377 learned_addr learned my addr 172.21.15.37:0/3134492377 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:54:38.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.009+0000 7f336f200640 1 --2- 172.21.15.37:0/3134492377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33700ce7d0 0x7f33700cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.009+0000 7f336e800640 1 -- 172.21.15.37:0/3134492377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33700ce7d0 msgr2=0x7f33700cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:38.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.009+0000 7f336e800640 1 --2- 172.21.15.37:0/3134492377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33700ce7d0 0x7f33700cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.009+0000 7f336e800640 1 -- 172.21.15.37:0/3134492377 >> v1:172.21.15.105:6789/0 conn(0x7f3370163250 legacy=0x7f33701636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:38.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.009+0000 7f336e800640 1 -- 172.21.15.37:0/3134492377 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f337006efb0 con 0x7f3370162e70 2024-05-30T06:54:38.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.013+0000 7f336e800640 1 --2- 172.21.15.37:0/3134492377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3370162e70 0x7f33700cc8b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f33600097c0 tx=0x7f336001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1e2c78937ac3061 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:38.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.021+0000 7f336de00640 1 -- 172.21.15.37:0/3134492377 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33600b1070 con 0x7f3370162e70 2024-05-30T06:54:38.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.025+0000 7f336de00640 1 -- 172.21.15.37:0/3134492377 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33600a8050 con 0x7f3370162e70 2024-05-30T06:54:38.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.025+0000 7f336de00640 1 -- 172.21.15.37:0/3134492377 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33600ac860 con 0x7f3370162e70 2024-05-30T06:54:38.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.025+0000 7f3375400640 1 -- 172.21.15.37:0/3134492377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3370162e70 msgr2=0x7f33700cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.025+0000 7f3375400640 1 --2- 172.21.15.37:0/3134492377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3370162e70 0x7f33700cc8b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f33600097c0 tx=0x7f336001c3e0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.025+0000 7f3375400640 1 -- 172.21.15.37:0/3134492377 shutdown_connections 2024-05-30T06:54:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.025+0000 7f3375400640 1 --2- 172.21.15.37:0/3134492377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33700ce7d0 0x7f33700cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.025+0000 7f3375400640 1 --2- 172.21.15.37:0/3134492377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3370162e70 0x7f33700cc8b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.025+0000 7f3375400640 1 -- 172.21.15.37:0/3134492377 >> 172.21.15.37:0/3134492377 conn(0x7f337006bf60 msgr2=0x7f33700b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.025+0000 7f3375400640 1 -- 172.21.15.37:0/3134492377 shutdown_connections 2024-05-30T06:54:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.025+0000 7f3375400640 1 -- 172.21.15.37:0/3134492377 wait complete. 2024-05-30T06:54:38.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.025+0000 7f3375400640 1 Processor -- start 2024-05-30T06:54:38.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3375400640 1 -- start start 2024-05-30T06:54:38.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3375400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33700ce7d0 0x7f33701467d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3375400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3370162e70 0x7f3370161db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3375400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3370163250 0x7f3370157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3375400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f33700ccf70 con 0x7f3370162e70 2024-05-30T06:54:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3375400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f33700ccdf0 con 0x7f33700ce7d0 2024-05-30T06:54:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3375400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f337016fc40 con 0x7f3370163250 2024-05-30T06:54:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3365e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3370162e70 0x7f3370161db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3365e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3370162e70 0x7f3370161db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59736/0 (socket says 172.21.15.37:59736) 2024-05-30T06:54:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3365e00640 1 -- 172.21.15.37:0/229524611 learned_addr learned my addr 172.21.15.37:0/229524611 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f336e800640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33700ce7d0 0x7f33701467d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f336f200640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3370163250 0x7f3370157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3365e00640 1 -- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3370163250 msgr2=0x7f3370157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3365e00640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3370163250 0x7f3370157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3365e00640 1 -- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33700ce7d0 msgr2=0x7f33701467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3365e00640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33700ce7d0 0x7f33701467d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3365e00640 1 -- 172.21.15.37:0/229524611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3370146d10 con 0x7f3370162e70 2024-05-30T06:54:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.029+0000 7f3365e00640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3370162e70 0x7f3370161db0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f335800c3a0 tx=0x7f335800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:38.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.037+0000 7f3367400640 1 -- 172.21.15.37:0/229524611 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358017070 con 0x7f3370162e70 2024-05-30T06:54:38.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.037+0000 7f3367400640 1 -- 172.21.15.37:0/229524611 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3358005cf0 con 0x7f3370162e70 2024-05-30T06:54:38.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.037+0000 7f3367400640 1 -- 172.21.15.37:0/229524611 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33580072f0 con 0x7f3370162e70 2024-05-30T06:54:38.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.037+0000 7f3375400640 1 -- 172.21.15.37:0/229524611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33700b5d40 con 0x7f3370162e70 2024-05-30T06:54:38.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.037+0000 7f3375400640 1 -- 172.21.15.37:0/229524611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33701615b0 con 0x7f3370162e70 2024-05-30T06:54:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.041+0000 7f3375400640 1 -- 172.21.15.37:0/229524611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3370068bc0 con 0x7f3370162e70 2024-05-30T06:54:38.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.041+0000 7f3367400640 1 -- 172.21.15.37:0/229524611 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7f335801a070 con 0x7f3370162e70 2024-05-30T06:54:38.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.041+0000 7f3367400640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f334c0697c0 0x7f334c06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.041+0000 7f3367400640 1 -- 172.21.15.37:0/229524611 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f3358084d90 con 0x7f3370162e70 2024-05-30T06:54:38.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.045+0000 7f336e800640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f334c0697c0 0x7f334c06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.045+0000 7f336e800640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f334c0697c0 0x7f334c06bc80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f33600ae000 tx=0x7f33600a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:38.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.045+0000 7f3367400640 1 -- 172.21.15.37:0/229524611 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f33580569d0 con 0x7f3370162e70 2024-05-30T06:54:38.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.337+0000 7f3375400640 1 -- 172.21.15.37:0/229524611 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f33700b30b0 con 0x7f334c0697c0 2024-05-30T06:54:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.365+0000 7f3367400640 1 -- 172.21.15.37:0/229524611 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+279 (secure 0 0 0) 0x7f33700b30b0 con 0x7f334c0697c0 2024-05-30T06:54:38.366 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:38.366 INFO:teuthology.orchestra.run.smithi037.stdout: "status": { 2024-05-30T06:54:38.366 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "in-progress", 2024-05-30T06:54:38.366 INFO:teuthology.orchestra.run.smithi037.stdout: "source": { 2024-05-30T06:54:38.366 INFO:teuthology.orchestra.run.smithi037.stdout: "volume": "cephfs", 2024-05-30T06:54:38.367 INFO:teuthology.orchestra.run.smithi037.stdout: "subvolume": "sv1", 2024-05-30T06:54:38.367 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot": "ss1" 2024-05-30T06:54:38.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:38.367 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_report": { 2024-05-30T06:54:38.367 INFO:teuthology.orchestra.run.smithi037.stdout: "percentage cloned": 90.625, 2024-05-30T06:54:38.367 INFO:teuthology.orchestra.run.smithi037.stdout: "amount cloned": "2.7G/3.0G", 2024-05-30T06:54:38.367 INFO:teuthology.orchestra.run.smithi037.stdout: "files cloned": "6/6" 2024-05-30T06:54:38.367 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:38.367 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:38.367 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.365+0000 7f3375400640 1 -- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f334c0697c0 msgr2=0x7f334c06bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.365+0000 7f3375400640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f334c0697c0 0x7f334c06bc80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f33600ae000 tx=0x7f33600a7000 comp rx=0 tx=0).stop 2024-05-30T06:54:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.365+0000 7f3375400640 1 -- 172.21.15.37:0/229524611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3370162e70 msgr2=0x7f3370161db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.365+0000 7f3375400640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3370162e70 0x7f3370161db0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f335800c3a0 tx=0x7f335800c860 comp rx=0 tx=0).stop 2024-05-30T06:54:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.365+0000 7f3375400640 1 -- 172.21.15.37:0/229524611 shutdown_connections 2024-05-30T06:54:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.365+0000 7f3375400640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3370163250 0x7f3370157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.365+0000 7f3375400640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3370162e70 0x7f3370161db0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.365+0000 7f3375400640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f334c0697c0 0x7f334c06bc80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.365+0000 7f3375400640 1 --2- 172.21.15.37:0/229524611 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33700ce7d0 0x7f33701467d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.365+0000 7f3375400640 1 -- 172.21.15.37:0/229524611 >> 172.21.15.37:0/229524611 conn(0x7f337006bf60 msgr2=0x7f3370074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.365+0000 7f3375400640 1 -- 172.21.15.37:0/229524611 shutdown_connections 2024-05-30T06:54:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.365+0000 7f3375400640 1 -- 172.21.15.37:0/229524611 wait complete. 2024-05-30T06:54:38.401 INFO:tasks.cephfs.test_volumes:percentage cloned = 90.625 2024-05-30T06:54:38.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T06:54:38.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.625+0000 7f0b3fe00640 1 Processor -- start 2024-05-30T06:54:38.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.625+0000 7f0b3fe00640 1 -- start start 2024-05-30T06:54:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b3fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b380cd440 0x7f0b3806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b3fe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0b3806f5a0 0x7f0b380b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b3fe00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b3815f310 con 0x7f0b38155da0 2024-05-30T06:54:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b3fe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0b3806fa10 con 0x7f0b380cd440 2024-05-30T06:54:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b3fe00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0b3815f5f0 con 0x7f0b3806f5a0 2024-05-30T06:54:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b3ca00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b380cd440 0x7f0b3806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b3d400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0b38155da0 0x7f0b380cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41500/0 (socket says 172.21.15.37:41500) 2024-05-30T06:54:38.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b3d400640 1 -- 172.21.15.37:0/1951006121 learned_addr learned my addr 172.21.15.37:0/1951006121 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:54:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2825105485 0 0) 0x7f0b3815f310 con 0x7f0b38155da0 2024-05-30T06:54:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b20003530 con 0x7f0b38155da0 2024-05-30T06:54:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b3de00640 1 --2- 172.21.15.37:0/1951006121 >> v2:172.21.15.105:3300/0 conn(0x7f0b3806f5a0 0x7f0b380b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2455643690 0 0) 0x7f0b20003530 con 0x7f0b38155da0 2024-05-30T06:54:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 >> v2:172.21.15.105:3300/0 conn(0x7f0b3806f5a0 msgr2=0x7f0b380b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b37e00640 1 --2- 172.21.15.37:0/1951006121 >> v2:172.21.15.105:3300/0 conn(0x7f0b3806f5a0 0x7f0b380b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 >> v2:172.21.15.37:3300/0 conn(0x7f0b380cd440 msgr2=0x7f0b3806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.629+0000 7f0b37e00640 1 --2- 172.21.15.37:0/1951006121 >> v2:172.21.15.37:3300/0 conn(0x7f0b380cd440 0x7f0b3806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3815f8d0 con 0x7f0b38155da0 2024-05-30T06:54:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f0b2c001680 con 0x7f0b38155da0 2024-05-30T06:54:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 >> v1:172.21.15.37:6789/0 conn(0x7f0b38155da0 legacy=0x7f0b380cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b37e00640 1 --2- 172.21.15.37:0/1951006121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b200039c0 0x7f0b20003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b37e00640 1 --2- 172.21.15.37:0/1951006121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b20004810 0x7f0b20004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b37e00640 1 --2- 172.21.15.37:0/1951006121 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b200053d0 0x7f0b2000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3806fa10 con 0x7f0b20004810 2024-05-30T06:54:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3815f5f0 con 0x7f0b200039c0 2024-05-30T06:54:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0b2000c2e0 con 0x7f0b200053d0 2024-05-30T06:54:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b3d400640 1 --2- 172.21.15.37:0/1951006121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b200039c0 0x7f0b20003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b3ca00640 1 --2- 172.21.15.37:0/1951006121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b20004810 0x7f0b20004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b3de00640 1 --2- 172.21.15.37:0/1951006121 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b200053d0 0x7f0b2000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b3ca00640 1 -- 172.21.15.37:0/1951006121 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b200053d0 msgr2=0x7f0b2000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b3ca00640 1 --2- 172.21.15.37:0/1951006121 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b200053d0 0x7f0b2000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b3ca00640 1 -- 172.21.15.37:0/1951006121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b200039c0 msgr2=0x7f0b20003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b3ca00640 1 --2- 172.21.15.37:0/1951006121 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b200039c0 0x7f0b20003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b3ca00640 1 -- 172.21.15.37:0/1951006121 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3815f8d0 con 0x7f0b20004810 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.633+0000 7f0b3de00640 1 -- 172.21.15.37:0/1951006121 reap_dead start 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.641+0000 7f0b3ca00640 1 --2- 172.21.15.37:0/1951006121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b20004810 0x7f0b20004c90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400ba10 tx=0x7f0b2401e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f731a96fde1568f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.641+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2400b5e0 con 0x7f0b20004810 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.641+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b240b2070 con 0x7f0b20004810 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.641+0000 7f0b37e00640 1 -- 172.21.15.37:0/1951006121 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b240ad8a0 con 0x7f0b20004810 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.641+0000 7f0b3fe00640 1 -- 172.21.15.37:0/1951006121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b20004810 msgr2=0x7f0b20004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.641+0000 7f0b3fe00640 1 --2- 172.21.15.37:0/1951006121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b20004810 0x7f0b20004c90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f0b2400ba10 tx=0x7f0b2401e860 comp rx=0 tx=0).stop 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.641+0000 7f0b3fe00640 1 -- 172.21.15.37:0/1951006121 shutdown_connections 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.641+0000 7f0b3fe00640 1 --2- 172.21.15.37:0/1951006121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b20004810 0x7f0b20004c90 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.641+0000 7f0b3fe00640 1 -- 172.21.15.37:0/1951006121 >> 172.21.15.37:0/1951006121 conn(0x7f0b3806bf60 msgr2=0x7f0b380b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.645+0000 7f0b3fe00640 1 -- 172.21.15.37:0/1951006121 shutdown_connections 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.645+0000 7f0b3fe00640 1 -- 172.21.15.37:0/1951006121 wait complete. 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.645+0000 7f0b3fe00640 1 Processor -- start 2024-05-30T06:54:38.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3fe00640 1 -- start start 2024-05-30T06:54:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3fe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b20004810 0x7f0b380cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b38146df0 0x7f0b380af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38147250 0x7f0b380af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b380cf830 con 0x7f0b38147250 2024-05-30T06:54:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3fe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0b380cf6b0 con 0x7f0b20004810 2024-05-30T06:54:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3fe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0b380cf9b0 con 0x7f0b38146df0 2024-05-30T06:54:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38147250 0x7f0b380af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3d400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b20004810 0x7f0b380cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3ca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b38146df0 0x7f0b380af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3ca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b38146df0 0x7f0b380af120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:35006/0 (socket says 172.21.15.37:35006) 2024-05-30T06:54:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3ca00640 1 -- 172.21.15.37:0/2563811739 learned_addr learned my addr 172.21.15.37:0/2563811739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:38.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38147250 0x7f0b380af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59774/0 (socket says 172.21.15.37:59774) 2024-05-30T06:54:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3ca00640 1 -- 172.21.15.37:0/2563811739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b20004810 msgr2=0x7f0b380cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3ca00640 1 --2- 172.21.15.37:0/2563811739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b20004810 0x7f0b380cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3ca00640 1 -- 172.21.15.37:0/2563811739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38147250 msgr2=0x7f0b380af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3ca00640 1 --2- 172.21.15.37:0/2563811739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38147250 0x7f0b380af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.649+0000 7f0b3ca00640 1 -- 172.21.15.37:0/2563811739 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b380cc810 con 0x7f0b38146df0 2024-05-30T06:54:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.653+0000 7f0b3ca00640 1 --2- 172.21.15.37:0/2563811739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b38146df0 0x7f0b380af120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0b2401e690 tx=0x7f0b20005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.653+0000 7f0b35600640 1 -- 172.21.15.37:0/2563811739 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2400b5e0 con 0x7f0b38146df0 2024-05-30T06:54:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.653+0000 7f0b35600640 1 -- 172.21.15.37:0/2563811739 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b240bf070 con 0x7f0b38146df0 2024-05-30T06:54:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.653+0000 7f0b3fe00640 1 -- 172.21.15.37:0/2563811739 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b38155140 con 0x7f0b38146df0 2024-05-30T06:54:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.653+0000 7f0b35600640 1 -- 172.21.15.37:0/2563811739 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b240adce0 con 0x7f0b38146df0 2024-05-30T06:54:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.653+0000 7f0b3fe00640 1 -- 172.21.15.37:0/2563811739 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b3815a060 con 0x7f0b38146df0 2024-05-30T06:54:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.653+0000 7f0b3fe00640 1 -- 172.21.15.37:0/2563811739 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b38068bc0 con 0x7f0b38146df0 2024-05-30T06:54:38.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.657+0000 7f0b35600640 1 -- 172.21.15.37:0/2563811739 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7f0b240c4460 con 0x7f0b38146df0 2024-05-30T06:54:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.657+0000 7f0b35600640 1 --2- 172.21.15.37:0/2563811739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0b180697c0 0x7f0b1806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.657+0000 7f0b35600640 1 -- 172.21.15.37:0/2563811739 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f0b24120db0 con 0x7f0b38146df0 2024-05-30T06:54:38.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.665+0000 7f0b3d400640 1 --2- 172.21.15.37:0/2563811739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0b180697c0 0x7f0b1806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:38.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.665+0000 7f0b35600640 1 -- 172.21.15.37:0/2563811739 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b240185a0 con 0x7f0b38146df0 2024-05-30T06:54:38.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.673+0000 7f0b3d400640 1 --2- 172.21.15.37:0/2563811739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0b180697c0 0x7f0b1806bc80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0b38069160 tx=0x7f0b2c001090 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:38.889+0000 7f0b3fe00640 1 -- 172.21.15.37:0/2563811739 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f0b380b1d50 con 0x7f0b180697c0 2024-05-30T06:54:40.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.345+0000 7f0b35600640 1 -- 172.21.15.37:0/2563811739 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f0b380b1d50 con 0x7f0b180697c0 2024-05-30T06:54:40.348 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:40.348 INFO:teuthology.orchestra.run.smithi037.stdout: "status": { 2024-05-30T06:54:40.348 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "complete" 2024-05-30T06:54:40.349 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:40.349 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:40.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.349+0000 7f0b3fe00640 1 -- 172.21.15.37:0/2563811739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0b180697c0 msgr2=0x7f0b1806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:40.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.349+0000 7f0b3fe00640 1 --2- 172.21.15.37:0/2563811739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0b180697c0 0x7f0b1806bc80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0b38069160 tx=0x7f0b2c001090 comp rx=0 tx=0).stop 2024-05-30T06:54:40.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.349+0000 7f0b3fe00640 1 -- 172.21.15.37:0/2563811739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b38146df0 msgr2=0x7f0b380af120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:40.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.349+0000 7f0b3fe00640 1 --2- 172.21.15.37:0/2563811739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b38146df0 0x7f0b380af120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0b2401e690 tx=0x7f0b20005840 comp rx=0 tx=0).stop 2024-05-30T06:54:40.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.349+0000 7f0b3fe00640 1 -- 172.21.15.37:0/2563811739 shutdown_connections 2024-05-30T06:54:40.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.349+0000 7f0b3fe00640 1 --2- 172.21.15.37:0/2563811739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b38147250 0x7f0b380af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.349+0000 7f0b3fe00640 1 --2- 172.21.15.37:0/2563811739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b38146df0 0x7f0b380af120 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.349+0000 7f0b3fe00640 1 --2- 172.21.15.37:0/2563811739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0b180697c0 0x7f0b1806bc80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.349+0000 7f0b3fe00640 1 --2- 172.21.15.37:0/2563811739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b20004810 0x7f0b380cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.349+0000 7f0b3fe00640 1 -- 172.21.15.37:0/2563811739 >> 172.21.15.37:0/2563811739 conn(0x7f0b3806bf60 msgr2=0x7f0b381e8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:40.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.349+0000 7f0b3fe00640 1 -- 172.21.15.37:0/2563811739 shutdown_connections 2024-05-30T06:54:40.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.349+0000 7f0b3fe00640 1 -- 172.21.15.37:0/2563811739 wait complete. 2024-05-30T06:54:40.374 INFO:tasks.cephfs.test_volumes:expected clone state = ('complete',) 2024-05-30T06:54:40.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs ss1clone1 2024-05-30T06:54:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.521+0000 7fcff6000640 1 Processor -- start 2024-05-30T06:54:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.521+0000 7fcff6000640 1 -- start start 2024-05-30T06:54:40.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.525+0000 7fcff6000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcff0144fe0 0x7fcff015f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:40.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.525+0000 7fcff6000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff006f660 0x7fcff015f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:40.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.525+0000 7fcff6000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff00cf430 con 0x7fcff0144c00 2024-05-30T06:54:40.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.525+0000 7fcff6000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcff00b3bf0 con 0x7fcff0144fe0 2024-05-30T06:54:40.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.525+0000 7fcff6000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcff0072e10 con 0x7fcff006f660 2024-05-30T06:54:40.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.525+0000 7fcfe7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcff0144fe0 0x7fcff015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:40.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.525+0000 7fcfe7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcff0144fe0 0x7fcff015f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59788/0 (socket says 172.21.15.37:59788) 2024-05-30T06:54:40.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.525+0000 7fcfe7e00640 1 -- 172.21.15.37:0/3409553832 learned_addr learned my addr 172.21.15.37:0/3409553832 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:40.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.525+0000 7fcff5600640 1 --2- 172.21.15.37:0/3409553832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff006f660 0x7fcff015f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.525+0000 7fcfe7e00640 1 -- 172.21.15.37:0/3409553832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff006f660 msgr2=0x7fcff015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.525+0000 7fcfe7e00640 1 --2- 172.21.15.37:0/3409553832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff006f660 0x7fcff015f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.525+0000 7fcfe7e00640 1 -- 172.21.15.37:0/3409553832 >> v1:172.21.15.105:6789/0 conn(0x7fcff0144c00 legacy=0x7fcff006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.525+0000 7fcfe7e00640 1 -- 172.21.15.37:0/3409553832 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff015fd30 con 0x7fcff0144fe0 2024-05-30T06:54:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcfe7e00640 1 --2- 172.21.15.37:0/3409553832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff0144fe0 0x7fcff015f2b0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009870 tx=0x7fcfd801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d94aa276020ac5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcfefe00640 1 -- 172.21.15.37:0/3409553832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80a7070 con 0x7fcff0144fe0 2024-05-30T06:54:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcfefe00640 1 -- 172.21.15.37:0/3409553832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd80b0070 con 0x7fcff0144fe0 2024-05-30T06:54:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcfefe00640 1 -- 172.21.15.37:0/3409553832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80ab890 con 0x7fcff0144fe0 2024-05-30T06:54:40.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 -- 172.21.15.37:0/3409553832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff0144fe0 msgr2=0x7fcff015f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:40.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 --2- 172.21.15.37:0/3409553832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff0144fe0 0x7fcff015f2b0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009870 tx=0x7fcfd801c560 comp rx=0 tx=0).stop 2024-05-30T06:54:40.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 -- 172.21.15.37:0/3409553832 shutdown_connections 2024-05-30T06:54:40.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 --2- 172.21.15.37:0/3409553832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff006f660 0x7fcff015f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 --2- 172.21.15.37:0/3409553832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff0144fe0 0x7fcff015f2b0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 -- 172.21.15.37:0/3409553832 >> 172.21.15.37:0/3409553832 conn(0x7fcff0067d60 msgr2=0x7fcff006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 -- 172.21.15.37:0/3409553832 shutdown_connections 2024-05-30T06:54:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 -- 172.21.15.37:0/3409553832 wait complete. 2024-05-30T06:54:40.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 Processor -- start 2024-05-30T06:54:40.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 -- start start 2024-05-30T06:54:40.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff006f660 0x7fcff013b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:40.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff0144c00 0x7fcff013d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:40.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff0144fe0 0x7fcff015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcff0072a20 con 0x7fcff006f660 2024-05-30T06:54:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcff00728a0 con 0x7fcff0144fe0 2024-05-30T06:54:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.529+0000 7fcff6000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcff0072ba0 con 0x7fcff0144c00 2024-05-30T06:54:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcff4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff006f660 0x7fcff013b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcff4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff006f660 0x7fcff013b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59796/0 (socket says 172.21.15.37:59796) 2024-05-30T06:54:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcff4c00640 1 -- 172.21.15.37:0/4061335623 learned_addr learned my addr 172.21.15.37:0/4061335623 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcfe7e00640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff0144c00 0x7fcff013d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcff5600640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff0144fe0 0x7fcff015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcff4c00640 1 -- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff0144c00 msgr2=0x7fcff013d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcff4c00640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff0144c00 0x7fcff013d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcff4c00640 1 -- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff0144fe0 msgr2=0x7fcff015a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:40.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcff4c00640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff0144fe0 0x7fcff015a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcff4c00640 1 -- 172.21.15.37:0/4061335623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff013bce0 con 0x7fcff006f660 2024-05-30T06:54:40.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcff4c00640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff006f660 0x7fcff013b7a0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000c450 tx=0x7fcfe000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:40.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcfed600640 1 -- 172.21.15.37:0/4061335623 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0016020 con 0x7fcff006f660 2024-05-30T06:54:40.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcff6000640 1 -- 172.21.15.37:0/4061335623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff01388c0 con 0x7fcff006f660 2024-05-30T06:54:40.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcfed600640 1 -- 172.21.15.37:0/4061335623 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe00052d0 con 0x7fcff006f660 2024-05-30T06:54:40.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcfed600640 1 -- 172.21.15.37:0/4061335623 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0007260 con 0x7fcff006f660 2024-05-30T06:54:40.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcff6000640 1 -- 172.21.15.37:0/4061335623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff0138e80 con 0x7fcff006f660 2024-05-30T06:54:40.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcff6000640 1 -- 172.21.15.37:0/4061335623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff0068700 con 0x7fcff006f660 2024-05-30T06:54:40.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcfed600640 1 -- 172.21.15.37:0/4061335623 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7fcfe0007400 con 0x7fcff006f660 2024-05-30T06:54:40.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.533+0000 7fcfed600640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfcc0697c0 0x7fcfcc06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:40.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.537+0000 7fcfed600640 1 -- 172.21.15.37:0/4061335623 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7fcfe0085340 con 0x7fcff006f660 2024-05-30T06:54:40.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.537+0000 7fcfe7e00640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfcc0697c0 0x7fcfcc06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:40.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.537+0000 7fcfe7e00640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfcc0697c0 0x7fcfcc06bc80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80af000 tx=0x7fcfd80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:40.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.541+0000 7fcfed600640 1 -- 172.21.15.37:0/4061335623 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcfe0020020 con 0x7fcff006f660 2024-05-30T06:54:40.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.741+0000 7fcff6000640 1 -- 172.21.15.37:0/4061335623 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7fcff0140cb0 con 0x7fcfcc0697c0 2024-05-30T06:54:40.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.745+0000 7fcfed600640 1 -- 172.21.15.37:0/4061335623 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7fcff0140cb0 con 0x7fcfcc0697c0 2024-05-30T06:54:40.748 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:40.749 INFO:teuthology.orchestra.run.smithi037.stdout: "status": { 2024-05-30T06:54:40.749 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "complete" 2024-05-30T06:54:40.749 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:40.749 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:40.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.749+0000 7fcff6000640 1 -- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfcc0697c0 msgr2=0x7fcfcc06bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:40.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.749+0000 7fcff6000640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfcc0697c0 0x7fcfcc06bc80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80af000 tx=0x7fcfd80a7000 comp rx=0 tx=0).stop 2024-05-30T06:54:40.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.749+0000 7fcff6000640 1 -- 172.21.15.37:0/4061335623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff006f660 msgr2=0x7fcff013b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:40.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.749+0000 7fcff6000640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff006f660 0x7fcff013b7a0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000c450 tx=0x7fcfe000c910 comp rx=0 tx=0).stop 2024-05-30T06:54:40.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.749+0000 7fcff6000640 1 -- 172.21.15.37:0/4061335623 shutdown_connections 2024-05-30T06:54:40.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.749+0000 7fcff6000640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcfcc0697c0 0x7fcfcc06bc80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.749+0000 7fcff6000640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcff0144fe0 0x7fcff015a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.749+0000 7fcff6000640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcff0144c00 0x7fcff013d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.749+0000 7fcff6000640 1 --2- 172.21.15.37:0/4061335623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff006f660 0x7fcff013b7a0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.749+0000 7fcff6000640 1 -- 172.21.15.37:0/4061335623 >> 172.21.15.37:0/4061335623 conn(0x7fcff0067d60 msgr2=0x7fcff0143e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:40.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.749+0000 7fcff6000640 1 -- 172.21.15.37:0/4061335623 shutdown_connections 2024-05-30T06:54:40.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.749+0000 7fcff6000640 1 -- 172.21.15.37:0/4061335623 wait complete. 2024-05-30T06:54:40.770 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:54:40.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.913+0000 7f7427200640 1 Processor -- start 2024-05-30T06:54:40.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.913+0000 7f7427200640 1 -- start start 2024-05-30T06:54:40.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.913+0000 7f7427200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f74280cffd0 0x7f74280cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:40.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.913+0000 7f7427200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74280af0d0 con 0x7f742815c9a0 2024-05-30T06:54:40.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.913+0000 7f7427200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74280ce000 con 0x7f74280d0600 2024-05-30T06:54:40.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.913+0000 7f7427200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f74280ce2e0 con 0x7f74280cffd0 2024-05-30T06:54:40.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.913+0000 7f7426800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f74280cffd0 0x7f74280cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:40.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.913+0000 7f741d400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f742815c9a0 0x7f74280afb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41516/0 (socket says 172.21.15.37:41516) 2024-05-30T06:54:40.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.913+0000 7f741d400640 1 -- 172.21.15.37:0/1312428793 learned_addr learned my addr 172.21.15.37:0/1312428793 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:54:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.913+0000 7f7426800640 1 -- 172.21.15.37:0/1312428793 >> v1:172.21.15.105:6789/0 conn(0x7f74280d0600 legacy=0x7f74280d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.913+0000 7f7426800640 1 -- 172.21.15.37:0/1312428793 >> v1:172.21.15.37:6789/0 conn(0x7f742815c9a0 legacy=0x7f74280afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:40.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.913+0000 7f7426800640 1 -- 172.21.15.37:0/1312428793 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74280af370 con 0x7f74280cffd0 2024-05-30T06:54:40.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.917+0000 7f7426800640 1 --2- 172.21.15.37:0/1312428793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280cffd0 0x7f74280cd9d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f74200097c0 tx=0x7f742001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f86a9d7a5eb552 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:40.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.917+0000 7f7425400640 1 -- 172.21.15.37:0/1312428793 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74200b1070 con 0x7f74280cffd0 2024-05-30T06:54:40.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.917+0000 7f7425400640 1 -- 172.21.15.37:0/1312428793 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74200ac600 con 0x7f74280cffd0 2024-05-30T06:54:40.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.917+0000 7f7425400640 1 -- 172.21.15.37:0/1312428793 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74200ac9d0 con 0x7f74280cffd0 2024-05-30T06:54:40.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.917+0000 7f7427200640 1 -- 172.21.15.37:0/1312428793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280cffd0 msgr2=0x7f74280cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:40.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.917+0000 7f7427200640 1 --2- 172.21.15.37:0/1312428793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280cffd0 0x7f74280cd9d0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f74200097c0 tx=0x7f742001c470 comp rx=0 tx=0).stop 2024-05-30T06:54:40.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.917+0000 7f7427200640 1 -- 172.21.15.37:0/1312428793 shutdown_connections 2024-05-30T06:54:40.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.917+0000 7f7427200640 1 --2- 172.21.15.37:0/1312428793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280cffd0 0x7f74280cd9d0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.917+0000 7f7427200640 1 -- 172.21.15.37:0/1312428793 >> 172.21.15.37:0/1312428793 conn(0x7f74280b3ef0 msgr2=0x7f74280b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:40.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.917+0000 7f7427200640 1 -- 172.21.15.37:0/1312428793 shutdown_connections 2024-05-30T06:54:40.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.917+0000 7f7427200640 1 -- 172.21.15.37:0/1312428793 wait complete. 2024-05-30T06:54:40.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.917+0000 7f7427200640 1 Processor -- start 2024-05-30T06:54:40.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7427200640 1 -- start start 2024-05-30T06:54:40.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7427200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280cffd0 0x7f74280b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:40.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7427200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74280d0600 0x7f74280b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:40.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7427200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f742815c9a0 0x7f74280b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:40.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7427200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74280b0e20 con 0x7f74280cffd0 2024-05-30T06:54:40.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7427200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f74280b0ca0 con 0x7f74280d0600 2024-05-30T06:54:40.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7427200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f742816a340 con 0x7f742815c9a0 2024-05-30T06:54:40.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7425e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280cffd0 0x7f74280b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:40.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7425e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280cffd0 0x7f74280b65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59802/0 (socket says 172.21.15.37:59802) 2024-05-30T06:54:40.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7425e00640 1 -- 172.21.15.37:0/41071313 learned_addr learned my addr 172.21.15.37:0/41071313 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:40.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f741d400640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74280d0600 0x7f74280b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:40.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7426800640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f742815c9a0 0x7f74280b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7425e00640 1 -- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f742815c9a0 msgr2=0x7f74280b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7425e00640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f742815c9a0 0x7f74280b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7425e00640 1 -- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74280d0600 msgr2=0x7f74280b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7425e00640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74280d0600 0x7f74280b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7425e00640 1 -- 172.21.15.37:0/41071313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742806d6d0 con 0x7f74280cffd0 2024-05-30T06:54:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7425e00640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280cffd0 0x7f74280b65c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f741800c7d0 tx=0x7f741800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f741ea00640 1 -- 172.21.15.37:0/41071313 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418003b80 con 0x7f74280cffd0 2024-05-30T06:54:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f741ea00640 1 -- 172.21.15.37:0/41071313 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7418003d20 con 0x7f74280cffd0 2024-05-30T06:54:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f741ea00640 1 -- 172.21.15.37:0/41071313 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741800aa90 con 0x7f74280cffd0 2024-05-30T06:54:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7427200640 1 -- 172.21.15.37:0/41071313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742806d9b0 con 0x7f74280cffd0 2024-05-30T06:54:40.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7427200640 1 -- 172.21.15.37:0/41071313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742806df70 con 0x7f74280cffd0 2024-05-30T06:54:40.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.921+0000 7f7427200640 1 -- 172.21.15.37:0/41071313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7428068ab0 con 0x7f74280cffd0 2024-05-30T06:54:40.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.925+0000 7f741ea00640 1 -- 172.21.15.37:0/41071313 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7f741800ac30 con 0x7f74280cffd0 2024-05-30T06:54:40.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.925+0000 7f741ea00640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74040697c0 0x7f740406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:40.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.925+0000 7f741ea00640 1 -- 172.21.15.37:0/41071313 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f7418085880 con 0x7f74280cffd0 2024-05-30T06:54:40.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.925+0000 7f741d400640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74040697c0 0x7f740406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:40.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.925+0000 7f741d400640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74040697c0 0x7f740406bc80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f74280755e0 tx=0x7f7410009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:40.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:40.929+0000 7f741ea00640 1 -- 172.21.15.37:0/41071313 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f74180574c0 con 0x7f74280cffd0 2024-05-30T06:54:41.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.117+0000 7f7427200640 1 -- 172.21.15.37:0/41071313 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f74280ce930 con 0x7f74040697c0 2024-05-30T06:54:41.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.117+0000 7f741ea00640 1 -- 172.21.15.37:0/41071313 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f74280ce930 con 0x7f74040697c0 2024-05-30T06:54:41.119 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:54:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:54:41.119 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:54:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:41.120 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:54:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.121+0000 7f7427200640 1 -- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74040697c0 msgr2=0x7f740406bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.121+0000 7f7427200640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74040697c0 0x7f740406bc80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f74280755e0 tx=0x7f7410009040 comp rx=0 tx=0).stop 2024-05-30T06:54:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.121+0000 7f7427200640 1 -- 172.21.15.37:0/41071313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280cffd0 msgr2=0x7f74280b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.121+0000 7f7427200640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280cffd0 0x7f74280b65c0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f741800c7d0 tx=0x7f741800cc90 comp rx=0 tx=0).stop 2024-05-30T06:54:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.121+0000 7f7427200640 1 -- 172.21.15.37:0/41071313 shutdown_connections 2024-05-30T06:54:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.121+0000 7f7427200640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f742815c9a0 0x7f74280b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.121+0000 7f7427200640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f74040697c0 0x7f740406bc80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.121+0000 7f7427200640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f74280d0600 0x7f74280b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.121+0000 7f7427200640 1 --2- 172.21.15.37:0/41071313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280cffd0 0x7f74280b65c0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.121+0000 7f7427200640 1 -- 172.21.15.37:0/41071313 >> 172.21.15.37:0/41071313 conn(0x7f74280b3ef0 msgr2=0x7f7428154500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.121+0000 7f7427200640 1 -- 172.21.15.37:0/41071313 shutdown_connections 2024-05-30T06:54:41.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.121+0000 7f7427200640 1 -- 172.21.15.37:0/41071313 wait complete. 2024-05-30T06:54:41.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:54:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1cee00640 1 Processor -- start 2024-05-30T06:54:41.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1cee00640 1 -- start start 2024-05-30T06:54:41.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1cee00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff1c8161fc0 0x7ff1c80d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1cee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c806d480 0x7ff1c80ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1cee00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1c80ccff0 0x7ff1c809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1cee00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c80d10c0 con 0x7ff1c80ccff0 2024-05-30T06:54:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1cee00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c806dc60 con 0x7ff1c8161fc0 2024-05-30T06:54:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1cee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c80d0790 con 0x7ff1c806d480 2024-05-30T06:54:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1ce400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1c80ccff0 0x7ff1c809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1ce400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1c80ccff0 0x7ff1c809aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59810/0 (socket says 172.21.15.37:59810) 2024-05-30T06:54:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1ce400640 1 -- 172.21.15.37:0/818830337 learned_addr learned my addr 172.21.15.37:0/818830337 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1cda00640 1 --2- 172.21.15.37:0/818830337 >> v2:172.21.15.105:3300/0 conn(0x7ff1c8161fc0 0x7ff1c80d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:41.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1cd000640 1 --2- 172.21.15.37:0/818830337 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c806d480 0x7ff1c80ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1ce400640 1 -- 172.21.15.37:0/818830337 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c806d480 msgr2=0x7ff1c80ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1ce400640 1 --2- 172.21.15.37:0/818830337 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c806d480 0x7ff1c80ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1ce400640 1 -- 172.21.15.37:0/818830337 >> v2:172.21.15.105:3300/0 conn(0x7ff1c8161fc0 msgr2=0x7ff1c80d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1ce400640 1 --2- 172.21.15.37:0/818830337 >> v2:172.21.15.105:3300/0 conn(0x7ff1c8161fc0 0x7ff1c80d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.285+0000 7ff1ce400640 1 -- 172.21.15.37:0/818830337 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c80d0a70 con 0x7ff1c80ccff0 2024-05-30T06:54:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.289+0000 7ff1ce400640 1 --2- 172.21.15.37:0/818830337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1c80ccff0 0x7ff1c809aa60 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7ff1c806c940 tx=0x7ff1c001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c2bb0067ff4b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.289+0000 7ff1c7e00640 1 -- 172.21.15.37:0/818830337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c00a5670 con 0x7ff1c80ccff0 2024-05-30T06:54:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.289+0000 7ff1c7e00640 1 -- 172.21.15.37:0/818830337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c00a5810 con 0x7ff1c80ccff0 2024-05-30T06:54:41.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.289+0000 7ff1c7e00640 1 -- 172.21.15.37:0/818830337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c00a5be0 con 0x7ff1c80ccff0 2024-05-30T06:54:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.289+0000 7ff1cee00640 1 -- 172.21.15.37:0/818830337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1c80ccff0 msgr2=0x7ff1c809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.289+0000 7ff1cee00640 1 --2- 172.21.15.37:0/818830337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1c80ccff0 0x7ff1c809aa60 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7ff1c806c940 tx=0x7ff1c001c9f0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.289+0000 7ff1cee00640 1 -- 172.21.15.37:0/818830337 shutdown_connections 2024-05-30T06:54:41.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.289+0000 7ff1cee00640 1 --2- 172.21.15.37:0/818830337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1c80ccff0 0x7ff1c809aa60 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.289+0000 7ff1cee00640 1 --2- 172.21.15.37:0/818830337 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c806d480 0x7ff1c80ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.289+0000 7ff1cee00640 1 --2- 172.21.15.37:0/818830337 >> v2:172.21.15.105:3300/0 conn(0x7ff1c8161fc0 0x7ff1c80d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.289+0000 7ff1cee00640 1 -- 172.21.15.37:0/818830337 >> 172.21.15.37:0/818830337 conn(0x7ff1c80b3f50 msgr2=0x7ff1c80b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.289+0000 7ff1cee00640 1 -- 172.21.15.37:0/818830337 shutdown_connections 2024-05-30T06:54:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.289+0000 7ff1cee00640 1 -- 172.21.15.37:0/818830337 wait complete. 2024-05-30T06:54:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cee00640 1 Processor -- start 2024-05-30T06:54:41.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cee00640 1 -- start start 2024-05-30T06:54:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cee00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1c806d480 0x7ff1c815b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1c80ccff0 0x7ff1c80b7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c8161fc0 0x7ff1c8160c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c8162900 con 0x7ff1c80ccff0 2024-05-30T06:54:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cee00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c8162780 con 0x7ff1c806d480 2024-05-30T06:54:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c8162a80 con 0x7ff1c8161fc0 2024-05-30T06:54:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cd000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1c80ccff0 0x7ff1c80b7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cd000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1c80ccff0 0x7ff1c80b7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59822/0 (socket says 172.21.15.37:59822) 2024-05-30T06:54:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cd000640 1 -- 172.21.15.37:0/1742693168 learned_addr learned my addr 172.21.15.37:0/1742693168 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cda00640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1c806d480 0x7ff1c815b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1ce400640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c8161fc0 0x7ff1c8160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cd000640 1 -- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c8161fc0 msgr2=0x7ff1c8160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cd000640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c8161fc0 0x7ff1c8160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cd000640 1 -- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1c806d480 msgr2=0x7ff1c815b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cd000640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1c806d480 0x7ff1c815b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cd000640 1 -- 172.21.15.37:0/1742693168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c8075880 con 0x7ff1c80ccff0 2024-05-30T06:54:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cd000640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1c80ccff0 0x7ff1c80b7630 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400e930 tx=0x7ff1b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1c5600640 1 -- 172.21.15.37:0/1742693168 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4017070 con 0x7ff1c80ccff0 2024-05-30T06:54:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1c5600640 1 -- 172.21.15.37:0/1742693168 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b400ca00 con 0x7ff1c80ccff0 2024-05-30T06:54:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1c5600640 1 -- 172.21.15.37:0/1742693168 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b400cdb0 con 0x7ff1c80ccff0 2024-05-30T06:54:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cee00640 1 -- 172.21.15.37:0/1742693168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c815bf60 con 0x7ff1c80ccff0 2024-05-30T06:54:41.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.293+0000 7ff1cee00640 1 -- 172.21.15.37:0/1742693168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c815a810 con 0x7ff1c80ccff0 2024-05-30T06:54:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.297+0000 7ff1cee00640 1 -- 172.21.15.37:0/1742693168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1c8068ab0 con 0x7ff1c80ccff0 2024-05-30T06:54:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.297+0000 7ff1c5600640 1 -- 172.21.15.37:0/1742693168 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7ff1b401a070 con 0x7ff1c80ccff0 2024-05-30T06:54:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.297+0000 7ff1c5600640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff1a80697c0 0x7ff1a806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.297+0000 7ff1c5600640 1 -- 172.21.15.37:0/1742693168 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7ff1b4085a10 con 0x7ff1c80ccff0 2024-05-30T06:54:41.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.297+0000 7ff1cda00640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff1a80697c0 0x7ff1a806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:41.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.297+0000 7ff1cda00640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff1a80697c0 0x7ff1a806bc80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009a40 tx=0x7ff1bc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.301+0000 7ff1c5600640 1 -- 172.21.15.37:0/1742693168 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff1b40570c0 con 0x7ff1c80ccff0 2024-05-30T06:54:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1cee00640 1 -- 172.21.15.37:0/1742693168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff1c80d1ef0 con 0x7ff1c80ccff0 2024-05-30T06:54:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1c5600640 1 -- 172.21.15.37:0/1742693168 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2122 (secure 0 0 0) 0x7ff1b405b3c0 con 0x7ff1c80ccff0 2024-05-30T06:54:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:54:41.526 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:54:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:54:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:54:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:54:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:54:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:54:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:54:41.526 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:54:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:54:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:54:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:54:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:54:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:54:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:54:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 775, 2024-05-30T06:54:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:54:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:54:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:54:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:54:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:54:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 90, 2024-05-30T06:54:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:54:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:54:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:54:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:54:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:54:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:54:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:54:41.528 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:54:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:54:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:54:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:54:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:54:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:54:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1568, 2024-05-30T06:54:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 6443463820, 2024-05-30T06:54:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 13321236480, 2024-05-30T06:54:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 759772876800, 2024-05-30T06:54:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:54:41.529 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 268356677, 2024-05-30T06:54:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 294236323, 2024-05-30T06:54:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 64, 2024-05-30T06:54:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 77 2024-05-30T06:54:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:54:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 56, 2024-05-30T06:54:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6, 2024-05-30T06:54:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:54:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:54:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:54:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:54:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:54:41.530 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 6, 2024-05-30T06:54:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:54:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:54:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:54:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 7932 2024-05-30T06:54:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:54:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:54:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:54:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:54:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:54:41.531 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 12, 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:51:42.820933+0000", 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "b464851b-ad75-46d3-ab1c-f5a77c3e2df7": { 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 29.0 seconds before exiting (7s)\n [============================] ", 2024-05-30T06:54:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:54:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:54:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:41.533 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1cee00640 1 -- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff1a80697c0 msgr2=0x7ff1a806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1cee00640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff1a80697c0 0x7ff1a806bc80 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009a40 tx=0x7ff1bc009190 comp rx=0 tx=0).stop 2024-05-30T06:54:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1cee00640 1 -- 172.21.15.37:0/1742693168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1c80ccff0 msgr2=0x7ff1c80b7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1cee00640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1c80ccff0 0x7ff1c80b7630 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400e930 tx=0x7ff1b400edf0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1cee00640 1 -- 172.21.15.37:0/1742693168 shutdown_connections 2024-05-30T06:54:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1cee00640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1c8161fc0 0x7ff1c8160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1cee00640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1c80ccff0 0x7ff1c80b7630 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1cee00640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff1a80697c0 0x7ff1a806bc80 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1cee00640 1 --2- 172.21.15.37:0/1742693168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1c806d480 0x7ff1c815b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1cee00640 1 -- 172.21.15.37:0/1742693168 >> 172.21.15.37:0/1742693168 conn(0x7ff1c80b3f50 msgr2=0x7ff1c80c95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1cee00640 1 -- 172.21.15.37:0/1742693168 shutdown_connections 2024-05-30T06:54:41.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:41.525+0000 7ff1cee00640 1 -- 172.21.15.37:0/1742693168 wait complete. 2024-05-30T06:54:46.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:54:46.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.697+0000 7f6193400640 1 Processor -- start 2024-05-30T06:54:46.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.697+0000 7f6193400640 1 -- start start 2024-05-30T06:54:46.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f6193400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f618c155e60 0x7f618c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f6193400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f618c15c8f0 con 0x7f618c06f9a0 2024-05-30T06:54:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f6193400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f618c0ccc80 con 0x7f618c0b2ec0 2024-05-30T06:54:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f6193400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f618c0ccff0 con 0x7f618c155e60 2024-05-30T06:54:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f618c06f9a0 0x7f618c0cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41532/0 (socket says 172.21.15.37:41532) 2024-05-30T06:54:46.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618be00640 1 -- 172.21.15.37:0/649581967 learned_addr learned my addr 172.21.15.37:0/649581967 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:54:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f6190a00640 1 --2- 172.21.15.37:0/649581967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f618c155e60 0x7f618c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1179990434 0 0) 0x7f618c15c8f0 con 0x7f618c06f9a0 2024-05-30T06:54:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6174005740 con 0x7f618c06f9a0 2024-05-30T06:54:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1573108057 0 0) 0x7f618c0ccc80 con 0x7f618c0b2ec0 2024-05-30T06:54:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f618c15c8f0 con 0x7f618c0b2ec0 2024-05-30T06:54:46.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3069812446 0 0) 0x7f6174005740 con 0x7f618c06f9a0 2024-05-30T06:54:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f618c155e60 msgr2=0x7f618c0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 --2- 172.21.15.37:0/649581967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f618c155e60 0x7f618c0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 >> v1:172.21.15.105:6789/0 conn(0x7f618c0b2ec0 legacy=0x7f618c0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c15cbd0 con 0x7f618c06f9a0 2024-05-30T06:54:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f6178001680 con 0x7f618c06f9a0 2024-05-30T06:54:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 >> v1:172.21.15.37:6789/0 conn(0x7f618c06f9a0 legacy=0x7f618c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 --2- 172.21.15.37:0/649581967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f618c155e60 0x7f6174005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 --2- 172.21.15.37:0/649581967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6174006340 0x7f6174006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 --2- 172.21.15.37:0/649581967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6174006f60 0x7f61740073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0ccff0 con 0x7f6174006340 2024-05-30T06:54:46.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f617400dd20 con 0x7f6174006f60 2024-05-30T06:54:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f617400df20 con 0x7f618c155e60 2024-05-30T06:54:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618be00640 1 --2- 172.21.15.37:0/649581967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6174006340 0x7f6174006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f6190a00640 1 --2- 172.21.15.37:0/649581967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f618c155e60 0x7f6174005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f6191400640 1 --2- 172.21.15.37:0/649581967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6174006f60 0x7f61740073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618be00640 1 -- 172.21.15.37:0/649581967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f618c155e60 msgr2=0x7f6174005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618be00640 1 --2- 172.21.15.37:0/649581967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f618c155e60 0x7f6174005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618be00640 1 -- 172.21.15.37:0/649581967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6174006f60 msgr2=0x7f61740073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618be00640 1 --2- 172.21.15.37:0/649581967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6174006f60 0x7f61740073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:46.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.701+0000 7f618be00640 1 -- 172.21.15.37:0/649581967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6174005740 con 0x7f6174006340 2024-05-30T06:54:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.705+0000 7f618be00640 1 --2- 172.21.15.37:0/649581967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6174006340 0x7f6174006a20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f618c06fe20 tx=0x7f617801ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cb51fb0fbb743c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.705+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178007c10 con 0x7f6174006340 2024-05-30T06:54:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.705+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61780a9070 con 0x7f6174006340 2024-05-30T06:54:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.705+0000 7f618b400640 1 -- 172.21.15.37:0/649581967 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178005d80 con 0x7f6174006340 2024-05-30T06:54:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.705+0000 7f6193400640 1 -- 172.21.15.37:0/649581967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6174006340 msgr2=0x7f6174006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.705+0000 7f6193400640 1 --2- 172.21.15.37:0/649581967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6174006340 0x7f6174006a20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f618c06fe20 tx=0x7f617801ca60 comp rx=0 tx=0).stop 2024-05-30T06:54:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.705+0000 7f6191400640 1 -- 172.21.15.37:0/649581967 reap_dead start 2024-05-30T06:54:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.705+0000 7f6193400640 1 -- 172.21.15.37:0/649581967 shutdown_connections 2024-05-30T06:54:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.705+0000 7f6193400640 1 -- 172.21.15.37:0/649581967 >> 172.21.15.37:0/649581967 conn(0x7f618c0b23a0 msgr2=0x7f618c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:46.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.705+0000 7f6193400640 1 -- 172.21.15.37:0/649581967 shutdown_connections 2024-05-30T06:54:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.705+0000 7f6193400640 1 -- 172.21.15.37:0/649581967 wait complete. 2024-05-30T06:54:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6193400640 1 Processor -- start 2024-05-30T06:54:46.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6193400640 1 -- start start 2024-05-30T06:54:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6193400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6174006340 0x7f618c14ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6193400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f618c148fe0 0x7f618c151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6193400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f618c14e530 0x7f618c14e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6193400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0cfef0 con 0x7f618c148fe0 2024-05-30T06:54:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6193400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0cfd70 con 0x7f6174006340 2024-05-30T06:54:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6193400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f618c0d0070 con 0x7f618c14e530 2024-05-30T06:54:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f618be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f618c148fe0 0x7f618c151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f618be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f618c148fe0 0x7f618c151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59832/0 (socket says 172.21.15.37:59832) 2024-05-30T06:54:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f618be00640 1 -- 172.21.15.37:0/2052796365 learned_addr learned my addr 172.21.15.37:0/2052796365 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:46.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6190a00640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6174006340 0x7f618c14ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6191400640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f618c14e530 0x7f618c14e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f618be00640 1 -- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f618c14e530 msgr2=0x7f618c14e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f618be00640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f618c14e530 0x7f618c14e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f618be00640 1 -- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6174006340 msgr2=0x7f618c14ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f618be00640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6174006340 0x7f618c14ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:46.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f618be00640 1 -- 172.21.15.37:0/2052796365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c151b80 con 0x7f618c148fe0 2024-05-30T06:54:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f618be00640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f618c148fe0 0x7f618c151640 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f617801c890 tx=0x7f6174007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6188c00640 1 -- 172.21.15.37:0/2052796365 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61780bd070 con 0x7f618c148fe0 2024-05-30T06:54:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6188c00640 1 -- 172.21.15.37:0/2052796365 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6178007bf0 con 0x7f618c148fe0 2024-05-30T06:54:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6188c00640 1 -- 172.21.15.37:0/2052796365 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178007040 con 0x7f618c148fe0 2024-05-30T06:54:46.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6193400640 1 -- 172.21.15.37:0/2052796365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618c14d490 con 0x7f618c148fe0 2024-05-30T06:54:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6193400640 1 -- 172.21.15.37:0/2052796365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618c14da50 con 0x7f618c148fe0 2024-05-30T06:54:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.709+0000 7f6193400640 1 -- 172.21.15.37:0/2052796365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618c068b20 con 0x7f618c148fe0 2024-05-30T06:54:46.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.713+0000 7f6188c00640 1 -- 172.21.15.37:0/2052796365 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7f61780c0070 con 0x7f618c148fe0 2024-05-30T06:54:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.713+0000 7f6188c00640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f616c0697f0 0x7f616c06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.713+0000 7f6188c00640 1 -- 172.21.15.37:0/2052796365 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f617811f070 con 0x7f618c148fe0 2024-05-30T06:54:46.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.713+0000 7f6190a00640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f616c0697f0 0x7f616c06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:46.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.713+0000 7f6190a00640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f616c0697f0 0x7f616c06bcb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6180009b00 tx=0x7f6180009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:46.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.717+0000 7f6188c00640 1 -- 172.21.15.37:0/2052796365 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6178016770 con 0x7f618c148fe0 2024-05-30T06:54:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6193400640 1 -- 172.21.15.37:0/2052796365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f618c0b29e0 con 0x7f618c148fe0 2024-05-30T06:54:46.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6188c00640 1 -- 172.21.15.37:0/2052796365 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2576 (secure 0 0 0) 0x7f61780f0660 con 0x7f618c148fe0 2024-05-30T06:54:46.942 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:54:46.942 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:46.942 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:54:46.942 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:54:46.942 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:54:46.942 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:54:46.942 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:54:46.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:46.943 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:54:46.943 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:54:46.943 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:54:46.943 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:54:46.943 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:54:46.943 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:46.943 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:54:46.943 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:54:46.943 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:54:46.943 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:54:46.944 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:46.944 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 781, 2024-05-30T06:54:46.944 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:54:46.944 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:54:46.944 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:54:46.944 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:54:46.944 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:46.944 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:54:46.944 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 90, 2024-05-30T06:54:46.944 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:54:46.944 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:54:46.944 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:54:46.945 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:54:46.945 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:54:46.945 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:54:46.945 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:46.945 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:54:46.945 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:54:46.945 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:54:46.945 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:54:46.945 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:54:46.945 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:46.945 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:46.945 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:54:46.945 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:54:46.946 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1565, 2024-05-30T06:54:46.946 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 6443478027, 2024-05-30T06:54:46.946 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 13744988160, 2024-05-30T06:54:46.946 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 759349125120, 2024-05-30T06:54:46.946 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:54:46.946 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 268355178, 2024-05-30T06:54:46.946 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 268378041, 2024-05-30T06:54:46.946 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 64, 2024-05-30T06:54:46.946 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 72 2024-05-30T06:54:46.946 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:46.946 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:54:46.946 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 56, 2024-05-30T06:54:46.946 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6, 2024-05-30T06:54:46.947 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:54:46.947 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:54:46.947 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:54:46.947 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:54:46.947 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:54:46.947 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 6, 2024-05-30T06:54:46.947 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:54:46.947 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:54:46.947 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:54:46.947 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 7932 2024-05-30T06:54:46.947 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:46.947 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:46.948 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:54:46.948 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:46.948 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:54:46.948 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:54:46.948 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:54:46.948 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:54:46.948 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:54:46.948 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:54:46.948 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:54:46.948 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:46.948 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:54:46.948 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 13, 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:54:42.928232+0000", 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "daemons": { 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "summary": "", 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "b": { 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "start_epoch": 0, 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "start_stamp": "0.000000", 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 0, 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": {}, 2024-05-30T06:54:46.949 INFO:teuthology.orchestra.run.smithi037.stdout: "task_status": {} 2024-05-30T06:54:46.950 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:46.950 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:46.950 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:46.950 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:46.950 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:46.950 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:54:46.950 INFO:teuthology.orchestra.run.smithi037.stdout: "b464851b-ad75-46d3-ab1c-f5a77c3e2df7": { 2024-05-30T06:54:46.950 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 25.0 seconds before exiting (11s)\n [============================] ", 2024-05-30T06:54:46.950 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:54:46.950 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:54:46.950 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:46.950 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:46.950 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:46.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6193400640 1 -- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f616c0697f0 msgr2=0x7f616c06bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:46.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6193400640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f616c0697f0 0x7f616c06bcb0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6180009b00 tx=0x7f6180009190 comp rx=0 tx=0).stop 2024-05-30T06:54:46.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6193400640 1 -- 172.21.15.37:0/2052796365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f618c148fe0 msgr2=0x7f618c151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:46.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6193400640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f618c148fe0 0x7f618c151640 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f617801c890 tx=0x7f6174007a50 comp rx=0 tx=0).stop 2024-05-30T06:54:46.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6193400640 1 -- 172.21.15.37:0/2052796365 shutdown_connections 2024-05-30T06:54:46.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6193400640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f618c14e530 0x7f618c14e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:46.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6193400640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f618c148fe0 0x7f618c151640 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:46.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6193400640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f616c0697f0 0x7f616c06bcb0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:46.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6193400640 1 --2- 172.21.15.37:0/2052796365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6174006340 0x7f618c14ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:46.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6193400640 1 -- 172.21.15.37:0/2052796365 >> 172.21.15.37:0/2052796365 conn(0x7f618c0b23a0 msgr2=0x7f618c0b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:46.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6193400640 1 -- 172.21.15.37:0/2052796365 shutdown_connections 2024-05-30T06:54:46.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:46.941+0000 7f6193400640 1 -- 172.21.15.37:0/2052796365 wait complete. 2024-05-30T06:54:51.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:54:52.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe20600640 1 Processor -- start 2024-05-30T06:54:52.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe20600640 1 -- start start 2024-05-30T06:54:52.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe20600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1806e000 0x7efe180ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:52.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe20600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe180cee10 0x7efe1806f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:52.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe20600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe180cd120 con 0x7efe1815cd80 2024-05-30T06:54:52.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe20600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efe180a9530 con 0x7efe180cee10 2024-05-30T06:54:52.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe20600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efe180cd400 con 0x7efe1806e000 2024-05-30T06:54:52.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe1e600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe180cee10 0x7efe1806f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:52.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe1e600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe180cee10 0x7efe1806f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53454/0 (socket says 172.21.15.37:53454) 2024-05-30T06:54:52.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe1e600640 1 -- 172.21.15.37:0/1238819763 learned_addr learned my addr 172.21.15.37:0/1238819763 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:52.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe1e600640 1 -- 172.21.15.37:0/1238819763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1806e000 msgr2=0x7efe180ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:52.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe1dc00640 1 --2- 172.21.15.37:0/1238819763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1806e000 0x7efe180ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:52.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe1e600640 1 --2- 172.21.15.37:0/1238819763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1806e000 0x7efe180ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:52.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe1e600640 1 -- 172.21.15.37:0/1238819763 >> v1:172.21.15.105:6789/0 conn(0x7efe1815cd80 legacy=0x7efe180ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:52.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe1e600640 1 -- 172.21.15.37:0/1238819763 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe180cd6e0 con 0x7efe180cee10 2024-05-30T06:54:52.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.117+0000 7efe1dc00640 1 --2- 172.21.15.37:0/1238819763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1806e000 0x7efe180ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:54:52.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe1e600640 1 --2- 172.21.15.37:0/1238819763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180cee10 0x7efe1806f3f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7efe10009e50 tx=0x7efe1001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536197140a8643e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:52.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe17e00640 1 -- 172.21.15.37:0/1238819763 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe100b4070 con 0x7efe180cee10 2024-05-30T06:54:52.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe17e00640 1 -- 172.21.15.37:0/1238819763 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe100af400 con 0x7efe180cee10 2024-05-30T06:54:52.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe17e00640 1 -- 172.21.15.37:0/1238819763 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe100af7d0 con 0x7efe180cee10 2024-05-30T06:54:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe20600640 1 -- 172.21.15.37:0/1238819763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180cee10 msgr2=0x7efe1806f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe20600640 1 --2- 172.21.15.37:0/1238819763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180cee10 0x7efe1806f3f0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7efe10009e50 tx=0x7efe1001f210 comp rx=0 tx=0).stop 2024-05-30T06:54:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe20600640 1 -- 172.21.15.37:0/1238819763 shutdown_connections 2024-05-30T06:54:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe20600640 1 --2- 172.21.15.37:0/1238819763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180cee10 0x7efe1806f3f0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe20600640 1 --2- 172.21.15.37:0/1238819763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1806e000 0x7efe180ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe20600640 1 -- 172.21.15.37:0/1238819763 >> 172.21.15.37:0/1238819763 conn(0x7efe180b23a0 msgr2=0x7efe180b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe20600640 1 -- 172.21.15.37:0/1238819763 shutdown_connections 2024-05-30T06:54:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe20600640 1 -- 172.21.15.37:0/1238819763 wait complete. 2024-05-30T06:54:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe20600640 1 Processor -- start 2024-05-30T06:54:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.121+0000 7efe20600640 1 -- start start 2024-05-30T06:54:52.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe20600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe1806e000 0x7efe1815f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe20600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180cee10 0x7efe1813e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe20600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1815cd80 0x7efe18140c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe20600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe1806f930 con 0x7efe180cee10 2024-05-30T06:54:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe20600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efe180cdca0 con 0x7efe1806e000 2024-05-30T06:54:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe20600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efe1806fab0 con 0x7efe1815cd80 2024-05-30T06:54:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe1d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180cee10 0x7efe1813e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe1dc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe1806e000 0x7efe1815f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe1e600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1815cd80 0x7efe18140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe1d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180cee10 0x7efe1813e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53460/0 (socket says 172.21.15.37:53460) 2024-05-30T06:54:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe1d200640 1 -- 172.21.15.37:0/1828649239 learned_addr learned my addr 172.21.15.37:0/1828649239 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe1d200640 1 -- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1815cd80 msgr2=0x7efe18140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe1d200640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1815cd80 0x7efe18140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe1d200640 1 -- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe1806e000 msgr2=0x7efe1815f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe1d200640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe1806e000 0x7efe1815f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe1d200640 1 -- 172.21.15.37:0/1828649239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1813ebf0 con 0x7efe180cee10 2024-05-30T06:54:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe1dc00640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe1806e000 0x7efe1815f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:54:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe1e600640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1815cd80 0x7efe18140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:54:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe1d200640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180cee10 0x7efe1813e6b0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7efe0400c420 tx=0x7efe0400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe15600640 1 -- 172.21.15.37:0/1828649239 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe040052d0 con 0x7efe180cee10 2024-05-30T06:54:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe15600640 1 -- 172.21.15.37:0/1828649239 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe04005470 con 0x7efe180cee10 2024-05-30T06:54:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe15600640 1 -- 172.21.15.37:0/1828649239 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe04007260 con 0x7efe180cee10 2024-05-30T06:54:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe20600640 1 -- 172.21.15.37:0/1828649239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1813d450 con 0x7efe180cee10 2024-05-30T06:54:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe20600640 1 -- 172.21.15.37:0/1828649239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1813deb0 con 0x7efe180cee10 2024-05-30T06:54:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.125+0000 7efe20600640 1 -- 172.21.15.37:0/1828649239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe18068b20 con 0x7efe180cee10 2024-05-30T06:54:52.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.129+0000 7efe15600640 1 -- 172.21.15.37:0/1828649239 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7efe04007400 con 0x7efe180cee10 2024-05-30T06:54:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.129+0000 7efe15600640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efdf80697c0 0x7efdf806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.129+0000 7efe15600640 1 -- 172.21.15.37:0/1828649239 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7efe04084eb0 con 0x7efe180cee10 2024-05-30T06:54:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.129+0000 7efe1dc00640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efdf80697c0 0x7efdf806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:52.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.129+0000 7efe1dc00640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efdf80697c0 0x7efdf806bc80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efe0c006fd0 tx=0x7efe0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:52.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.133+0000 7efe15600640 1 -- 172.21.15.37:0/1828649239 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe1813d450 con 0x7efe180cee10 2024-05-30T06:54:52.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.353+0000 7efe20600640 1 -- 172.21.15.37:0/1828649239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7efe18072600 con 0x7efe180cee10 2024-05-30T06:54:52.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.353+0000 7efe15600640 1 -- 172.21.15.37:0/1828649239 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2576 (secure 0 0 0) 0x7efe040564a0 con 0x7efe180cee10 2024-05-30T06:54:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:54:52.357 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:54:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:54:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:54:52.357 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:54:52.358 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 786, 2024-05-30T06:54:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:54:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:54:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:54:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:54:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:54:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 90, 2024-05-30T06:54:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:54:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:54:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:54:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:54:52.359 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:54:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:54:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:54:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:54:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:54:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:54:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:54:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:54:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:54:52.360 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1565, 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 6443505305, 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 13745037312, 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 759349075968, 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 209307763, 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 208975056, 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 50, 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 56 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 56, 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6, 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:54:52.361 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:54:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:54:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:54:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:54:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 6, 2024-05-30T06:54:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:54:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:54:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:54:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 7932 2024-05-30T06:54:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:54:52.362 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:54:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:54:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:54:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:54:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:54:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:54:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:54:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:54:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:54:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 13, 2024-05-30T06:54:52.363 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:54:42.928232+0000", 2024-05-30T06:54:52.364 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-05-30T06:54:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-05-30T06:54:52.365 INFO:teuthology.orchestra.run.smithi037.stdout: "daemons": { 2024-05-30T06:54:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "summary": "", 2024-05-30T06:54:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "b": { 2024-05-30T06:54:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "start_epoch": 0, 2024-05-30T06:54:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "start_stamp": "0.000000", 2024-05-30T06:54:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 0, 2024-05-30T06:54:52.366 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T06:54:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": {}, 2024-05-30T06:54:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "task_status": {} 2024-05-30T06:54:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:54:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "b464851b-ad75-46d3-ab1c-f5a77c3e2df7": { 2024-05-30T06:54:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 19.0 seconds before exiting (17s)\n [============================] ", 2024-05-30T06:54:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:54:52.367 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:54:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:52.368 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:52.368 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:52.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.357+0000 7efe20600640 1 -- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efdf80697c0 msgr2=0x7efdf806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:52.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.357+0000 7efe20600640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efdf80697c0 0x7efdf806bc80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7efe0c006fd0 tx=0x7efe0c008040 comp rx=0 tx=0).stop 2024-05-30T06:54:52.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.357+0000 7efe20600640 1 -- 172.21.15.37:0/1828649239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180cee10 msgr2=0x7efe1813e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:52.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.357+0000 7efe20600640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180cee10 0x7efe1813e6b0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7efe0400c420 tx=0x7efe0400c8e0 comp rx=0 tx=0).stop 2024-05-30T06:54:52.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.357+0000 7efe20600640 1 -- 172.21.15.37:0/1828649239 shutdown_connections 2024-05-30T06:54:52.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.357+0000 7efe20600640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe1815cd80 0x7efe18140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:52.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.357+0000 7efe20600640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe180cee10 0x7efe1813e6b0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:52.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.357+0000 7efe20600640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efdf80697c0 0x7efdf806bc80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:52.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.357+0000 7efe20600640 1 --2- 172.21.15.37:0/1828649239 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe1806e000 0x7efe1815f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:52.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.357+0000 7efe20600640 1 -- 172.21.15.37:0/1828649239 >> 172.21.15.37:0/1828649239 conn(0x7efe180b23a0 msgr2=0x7efe18072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:52.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.357+0000 7efe20600640 1 -- 172.21.15.37:0/1828649239 shutdown_connections 2024-05-30T06:54:52.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:52.357+0000 7efe20600640 1 -- 172.21.15.37:0/1828649239 wait complete. 2024-05-30T06:54:57.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:54:57.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.529+0000 7fce4d600640 1 Processor -- start 2024-05-30T06:54:57.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.529+0000 7fce4d600640 1 -- start start 2024-05-30T06:54:57.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce4d600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fce480cfdf0 0x7fce4815d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:57.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce4d600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4815d850 con 0x7fce4815cdb0 2024-05-30T06:54:57.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce4d600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce4815db30 con 0x7fce481462b0 2024-05-30T06:54:57.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce4d600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fce48160590 con 0x7fce480cfdf0 2024-05-30T06:54:57.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce3fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fce4815cdb0 0x7fce480cf6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37596/0 (socket says 172.21.15.37:37596) 2024-05-30T06:54:57.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce3fe00640 1 -- 172.21.15.37:0/1662015620 learned_addr learned my addr 172.21.15.37:0/1662015620 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:54:57.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce47400640 1 --2- 172.21.15.37:0/1662015620 >> v2:172.21.15.105:3300/0 conn(0x7fce480cfdf0 0x7fce4815d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:57.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632800630 0 0) 0x7fce4815d850 con 0x7fce4815cdb0 2024-05-30T06:54:57.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce2c003530 con 0x7fce4815cdb0 2024-05-30T06:54:57.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3568509666 0 0) 0x7fce2c003530 con 0x7fce4815cdb0 2024-05-30T06:54:57.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 >> v2:172.21.15.105:3300/0 conn(0x7fce480cfdf0 msgr2=0x7fce4815d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 --2- 172.21.15.37:0/1662015620 >> v2:172.21.15.105:3300/0 conn(0x7fce480cfdf0 0x7fce4815d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 >> v1:172.21.15.105:6789/0 conn(0x7fce481462b0 legacy=0x7fce48160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce48160870 con 0x7fce4815cdb0 2024-05-30T06:54:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fce30001680 con 0x7fce4815cdb0 2024-05-30T06:54:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 >> v1:172.21.15.37:6789/0 conn(0x7fce4815cdb0 legacy=0x7fce480cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 --2- 172.21.15.37:0/1662015620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce2c0039c0 0x7fce2c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 --2- 172.21.15.37:0/1662015620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce2c004810 0x7fce2c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 --2- 172.21.15.37:0/1662015620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce2c0051d0 0x7fce2c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce48160590 con 0x7fce2c0039c0 2024-05-30T06:54:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce2c00c080 con 0x7fce2c0051d0 2024-05-30T06:54:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fce2c00c280 con 0x7fce2c004810 2024-05-30T06:54:57.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46a00640 1 --2- 172.21.15.37:0/1662015620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce2c0039c0 0x7fce2c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:57.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce47400640 1 --2- 172.21.15.37:0/1662015620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce2c0051d0 0x7fce2c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:57.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce3fe00640 1 --2- 172.21.15.37:0/1662015620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce2c004810 0x7fce2c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:57.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46a00640 1 -- 172.21.15.37:0/1662015620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce2c004810 msgr2=0x7fce2c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:57.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46a00640 1 --2- 172.21.15.37:0/1662015620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce2c004810 0x7fce2c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:57.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46a00640 1 -- 172.21.15.37:0/1662015620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce2c0051d0 msgr2=0x7fce2c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:54:57.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46a00640 1 --2- 172.21.15.37:0/1662015620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce2c0051d0 0x7fce2c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:57.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce46a00640 1 -- 172.21.15.37:0/1662015620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce2c003530 con 0x7fce2c0039c0 2024-05-30T06:54:57.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce47400640 1 --2- 172.21.15.37:0/1662015620 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce2c0051d0 0x7fce2c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:54:57.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.533+0000 7fce47400640 1 -- 172.21.15.37:0/1662015620 reap_dead start 2024-05-30T06:54:57.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.537+0000 7fce46a00640 1 --2- 172.21.15.37:0/1662015620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce2c0039c0 0x7fce2c003de0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fce38001780 tx=0x7fce3801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e040f5e710a001f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:57.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.537+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce380013a0 con 0x7fce2c0039c0 2024-05-30T06:54:57.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.537+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce380052f0 con 0x7fce2c0039c0 2024-05-30T06:54:57.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.537+0000 7fce46000640 1 -- 172.21.15.37:0/1662015620 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38003840 con 0x7fce2c0039c0 2024-05-30T06:54:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.537+0000 7fce4d600640 1 -- 172.21.15.37:0/1662015620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce2c0039c0 msgr2=0x7fce2c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.537+0000 7fce4d600640 1 --2- 172.21.15.37:0/1662015620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce2c0039c0 0x7fce2c003de0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fce38001780 tx=0x7fce3801c400 comp rx=0 tx=0).stop 2024-05-30T06:54:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.537+0000 7fce4d600640 1 -- 172.21.15.37:0/1662015620 shutdown_connections 2024-05-30T06:54:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.537+0000 7fce4d600640 1 --2- 172.21.15.37:0/1662015620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce2c0039c0 0x7fce2c003de0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.537+0000 7fce4d600640 1 -- 172.21.15.37:0/1662015620 >> 172.21.15.37:0/1662015620 conn(0x7fce480b3390 msgr2=0x7fce480b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.537+0000 7fce4d600640 1 -- 172.21.15.37:0/1662015620 shutdown_connections 2024-05-30T06:54:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.537+0000 7fce4d600640 1 -- 172.21.15.37:0/1662015620 wait complete. 2024-05-30T06:54:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.537+0000 7fce4d600640 1 Processor -- start 2024-05-30T06:54:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.537+0000 7fce4d600640 1 -- start start 2024-05-30T06:54:57.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce4d600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce2c0039c0 0x7fce4815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:57.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce4d600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce481f8c70 0x7fce480cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:57.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce4d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce480b5a70 0x7fce480b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:57.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce4d600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce4815d220 con 0x7fce480b5a70 2024-05-30T06:54:57.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce4d600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce480b41e0 con 0x7fce2c0039c0 2024-05-30T06:54:57.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce4d600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fce4815d3a0 con 0x7fce481f8c70 2024-05-30T06:54:57.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce47400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce480b5a70 0x7fce480b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:57.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce47400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce480b5a70 0x7fce480b5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53408/0 (socket says 172.21.15.37:53408) 2024-05-30T06:54:57.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce47400640 1 -- 172.21.15.37:0/3670474932 learned_addr learned my addr 172.21.15.37:0/3670474932 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:54:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce3fe00640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce481f8c70 0x7fce480cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce46a00640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce2c0039c0 0x7fce4815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce47400640 1 -- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce481f8c70 msgr2=0x7fce480cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce47400640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce481f8c70 0x7fce480cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce47400640 1 -- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce2c0039c0 msgr2=0x7fce4815eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce47400640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce2c0039c0 0x7fce4815eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce47400640 1 -- 172.21.15.37:0/3670474932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce480b6440 con 0x7fce480b5a70 2024-05-30T06:54:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce47400640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce480b5a70 0x7fce480b5f00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fce480729e0 tx=0x7fce4000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce3ea00640 1 -- 172.21.15.37:0/3670474932 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40009c10 con 0x7fce480b5a70 2024-05-30T06:54:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce3ea00640 1 -- 172.21.15.37:0/3670474932 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4000fd90 con 0x7fce480b5a70 2024-05-30T06:54:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce3ea00640 1 -- 172.21.15.37:0/3670474932 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40003be0 con 0x7fce480b5a70 2024-05-30T06:54:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce4d600640 1 -- 172.21.15.37:0/3670474932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce480cbdc0 con 0x7fce480b5a70 2024-05-30T06:54:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce4d600640 1 -- 172.21.15.37:0/3670474932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce480b5270 con 0x7fce480b5a70 2024-05-30T06:54:57.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.541+0000 7fce4d600640 1 -- 172.21.15.37:0/3670474932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce48068b20 con 0x7fce480b5a70 2024-05-30T06:54:57.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.545+0000 7fce3ea00640 1 -- 172.21.15.37:0/3670474932 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7fce4001f020 con 0x7fce480b5a70 2024-05-30T06:54:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.545+0000 7fce3ea00640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce240697c0 0x7fce2406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:54:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.545+0000 7fce3ea00640 1 -- 172.21.15.37:0/3670474932 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7fce40085bf0 con 0x7fce480b5a70 2024-05-30T06:54:57.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.545+0000 7fce46a00640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce240697c0 0x7fce2406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:54:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.545+0000 7fce46a00640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce240697c0 0x7fce2406bc80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fce38001750 tx=0x7fce380011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:54:57.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.549+0000 7fce3ea00640 1 -- 172.21.15.37:0/3670474932 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fce40010040 con 0x7fce480b5a70 2024-05-30T06:54:57.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.769+0000 7fce4d600640 1 -- 172.21.15.37:0/3670474932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fce48070440 con 0x7fce480b5a70 2024-05-30T06:54:57.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.769+0000 7fce3ea00640 1 -- 172.21.15.37:0/3670474932 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2079 (secure 0 0 0) 0x7fce40057220 con 0x7fce480b5a70 2024-05-30T06:54:57.773 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:54:57.773 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:54:57.773 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:54:57.773 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:54:57.773 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:54:57.773 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:54:57.773 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:54:57.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:57.773 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:54:57.773 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:54:57.773 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:54:57.774 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:54:57.774 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:54:57.774 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:57.774 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:54:57.774 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:54:57.774 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:54:57.774 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:54:57.774 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:57.774 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 792, 2024-05-30T06:54:57.774 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:54:57.774 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:54:57.774 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:54:57.774 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:54:57.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:57.775 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:54:57.775 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 90, 2024-05-30T06:54:57.775 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:54:57.775 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:54:57.775 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:54:57.775 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:54:57.775 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:54:57.775 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:54:57.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:57.776 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:54:57.776 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:54:57.776 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:54:57.776 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:54:57.776 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:54:57.776 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:57.776 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:57.776 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:54:57.776 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:54:57.776 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1565, 2024-05-30T06:54:57.776 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 6443505305, 2024-05-30T06:54:57.776 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 13745037312, 2024-05-30T06:54:57.776 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 759349075968, 2024-05-30T06:54:57.777 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:54:57.777 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 2388, 2024-05-30T06:54:57.777 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:54:57.777 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:54:57.777 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:57.777 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:54:57.777 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 56, 2024-05-30T06:54:57.777 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6, 2024-05-30T06:54:57.777 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:54:57.777 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:54:57.777 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:54:57.777 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:54:57.777 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:54:57.778 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 6, 2024-05-30T06:54:57.778 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:54:57.778 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:54:57.778 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:54:57.778 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 7932 2024-05-30T06:54:57.778 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:57.778 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:57.778 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:54:57.778 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:57.778 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:54:57.778 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:54:57.778 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:54:57.778 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 14, 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:54:52.931035+0000", 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: "b464851b-ad75-46d3-ab1c-f5a77c3e2df7": { 2024-05-30T06:54:57.779 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 13.0 seconds before exiting (23s)\n [============================] ", 2024-05-30T06:54:57.780 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:54:57.780 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:54:57.780 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:57.780 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:54:57.780 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:54:57.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.773+0000 7fce4d600640 1 -- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce240697c0 msgr2=0x7fce2406bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:57.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.773+0000 7fce4d600640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce240697c0 0x7fce2406bc80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fce38001750 tx=0x7fce380011a0 comp rx=0 tx=0).stop 2024-05-30T06:54:57.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.773+0000 7fce4d600640 1 -- 172.21.15.37:0/3670474932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce480b5a70 msgr2=0x7fce480b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:54:57.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.773+0000 7fce4d600640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce480b5a70 0x7fce480b5f00 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fce480729e0 tx=0x7fce4000f580 comp rx=0 tx=0).stop 2024-05-30T06:54:57.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.773+0000 7fce4d600640 1 -- 172.21.15.37:0/3670474932 shutdown_connections 2024-05-30T06:54:57.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.773+0000 7fce4d600640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce480b5a70 0x7fce480b5f00 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:57.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.773+0000 7fce4d600640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce481f8c70 0x7fce480cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:57.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.773+0000 7fce4d600640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce240697c0 0x7fce2406bc80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:57.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.773+0000 7fce4d600640 1 --2- 172.21.15.37:0/3670474932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce2c0039c0 0x7fce4815eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:54:57.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.773+0000 7fce4d600640 1 -- 172.21.15.37:0/3670474932 >> 172.21.15.37:0/3670474932 conn(0x7fce480b3390 msgr2=0x7fce480ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:54:57.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.773+0000 7fce4d600640 1 -- 172.21.15.37:0/3670474932 shutdown_connections 2024-05-30T06:54:57.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:54:57.773+0000 7fce4d600640 1 -- 172.21.15.37:0/3670474932 wait complete. 2024-05-30T06:55:02.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:55:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.945+0000 7fb42ca00640 1 Processor -- start 2024-05-30T06:55:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.945+0000 7fb42ca00640 1 -- start start 2024-05-30T06:55:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.945+0000 7fb42ca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4280af1e0 0x7fb42815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.945+0000 7fb42ca00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4280cd340 0x7fb4280af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.945+0000 7fb42ca00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb42806e890 0x7fb42806ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.945+0000 7fb42ca00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb4280afb00 con 0x7fb4280cd340 2024-05-30T06:55:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.945+0000 7fb42ca00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb4280adf40 con 0x7fb42806e890 2024-05-30T06:55:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.945+0000 7fb42ca00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb4280ae220 con 0x7fb4280af1e0 2024-05-30T06:55:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.945+0000 7fb41fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4280cd340 0x7fb4280af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.945+0000 7fb41fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4280cd340 0x7fb4280af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53424/0 (socket says 172.21.15.37:53424) 2024-05-30T06:55:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.945+0000 7fb41fe00640 1 -- 172.21.15.37:0/3223626645 learned_addr learned my addr 172.21.15.37:0/3223626645 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.949+0000 7fb425e00640 1 --2- 172.21.15.37:0/3223626645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4280af1e0 0x7fb42815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.949+0000 7fb426800640 1 --2- 172.21.15.37:0/3223626645 >> v2:172.21.15.105:3300/0 conn(0x7fb42806e890 0x7fb42806ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.949+0000 7fb41fe00640 1 -- 172.21.15.37:0/3223626645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4280af1e0 msgr2=0x7fb42815cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.949+0000 7fb41fe00640 1 --2- 172.21.15.37:0/3223626645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4280af1e0 0x7fb42815cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.949+0000 7fb41fe00640 1 -- 172.21.15.37:0/3223626645 >> v2:172.21.15.105:3300/0 conn(0x7fb42806e890 msgr2=0x7fb42806ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.949+0000 7fb41fe00640 1 --2- 172.21.15.37:0/3223626645 >> v2:172.21.15.105:3300/0 conn(0x7fb42806e890 0x7fb42806ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.949+0000 7fb41fe00640 1 -- 172.21.15.37:0/3223626645 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4280ae500 con 0x7fb4280cd340 2024-05-30T06:55:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.949+0000 7fb426800640 1 --2- 172.21.15.37:0/3223626645 >> v2:172.21.15.105:3300/0 conn(0x7fb42806e890 0x7fb42806ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.949+0000 7fb41fe00640 1 --2- 172.21.15.37:0/3223626645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4280cd340 0x7fb4280af5c0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fb428072500 tx=0x7fb41001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270a70b4a0b19d05 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.949+0000 7fb425400640 1 -- 172.21.15.37:0/3223626645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4100b0070 con 0x7fb4280cd340 2024-05-30T06:55:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.949+0000 7fb425400640 1 -- 172.21.15.37:0/3223626645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4100ab600 con 0x7fb4280cd340 2024-05-30T06:55:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.949+0000 7fb425400640 1 -- 172.21.15.37:0/3223626645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4100ab9d0 con 0x7fb4280cd340 2024-05-30T06:55:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 -- 172.21.15.37:0/3223626645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4280cd340 msgr2=0x7fb4280af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 --2- 172.21.15.37:0/3223626645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4280cd340 0x7fb4280af5c0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fb428072500 tx=0x7fb41001c3d0 comp rx=0 tx=0).stop 2024-05-30T06:55:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 -- 172.21.15.37:0/3223626645 shutdown_connections 2024-05-30T06:55:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 --2- 172.21.15.37:0/3223626645 >> v2:172.21.15.105:3300/0 conn(0x7fb42806e890 0x7fb42806ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 --2- 172.21.15.37:0/3223626645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4280cd340 0x7fb4280af5c0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 --2- 172.21.15.37:0/3223626645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4280af1e0 0x7fb42815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 -- 172.21.15.37:0/3223626645 >> 172.21.15.37:0/3223626645 conn(0x7fb428073680 msgr2=0x7fb42806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 -- 172.21.15.37:0/3223626645 shutdown_connections 2024-05-30T06:55:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 -- 172.21.15.37:0/3223626645 wait complete. 2024-05-30T06:55:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 Processor -- start 2024-05-30T06:55:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 -- start start 2024-05-30T06:55:02.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb42806e890 0x7fb428165ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:02.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4280af1e0 0x7fb42815bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:02.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4280cd340 0x7fb428153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:02.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb428168450 con 0x7fb4280cd340 2024-05-30T06:55:02.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4281682d0 con 0x7fb4280af1e0 2024-05-30T06:55:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb42ca00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb4281685d0 con 0x7fb42806e890 2024-05-30T06:55:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb426800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4280cd340 0x7fb428153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb426800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4280cd340 0x7fb428153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53428/0 (socket says 172.21.15.37:53428) 2024-05-30T06:55:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb426800640 1 -- 172.21.15.37:0/950222312 learned_addr learned my addr 172.21.15.37:0/950222312 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb41fe00640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4280af1e0 0x7fb42815bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb425e00640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb42806e890 0x7fb428165ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb426800640 1 -- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb42806e890 msgr2=0x7fb428165ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb426800640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb42806e890 0x7fb428165ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb426800640 1 -- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4280af1e0 msgr2=0x7fb42815bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb426800640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4280af1e0 0x7fb42815bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb426800640 1 -- 172.21.15.37:0/950222312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4280cee90 con 0x7fb4280cd340 2024-05-30T06:55:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.953+0000 7fb426800640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4280cd340 0x7fb428153770 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fb42000cf20 tx=0x7fb42000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.957+0000 7fb41e000640 1 -- 172.21.15.37:0/950222312 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42001a070 con 0x7fb4280cd340 2024-05-30T06:55:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.957+0000 7fb41e000640 1 -- 172.21.15.37:0/950222312 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42000d840 con 0x7fb4280cd340 2024-05-30T06:55:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.957+0000 7fb42ca00640 1 -- 172.21.15.37:0/950222312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4280cf170 con 0x7fb4280cd340 2024-05-30T06:55:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.957+0000 7fb41e000640 1 -- 172.21.15.37:0/950222312 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42000dc30 con 0x7fb4280cd340 2024-05-30T06:55:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.957+0000 7fb42ca00640 1 -- 172.21.15.37:0/950222312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42815b2a0 con 0x7fb4280cd340 2024-05-30T06:55:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.957+0000 7fb42ca00640 1 -- 172.21.15.37:0/950222312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb428068b20 con 0x7fb4280cd340 2024-05-30T06:55:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.957+0000 7fb41e000640 1 -- 172.21.15.37:0/950222312 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7fb42001d070 con 0x7fb4280cd340 2024-05-30T06:55:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.957+0000 7fb41e000640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb4040697c0 0x7fb40406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.957+0000 7fb41e000640 1 -- 172.21.15.37:0/950222312 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7fb420085ea0 con 0x7fb4280cd340 2024-05-30T06:55:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.957+0000 7fb425e00640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb4040697c0 0x7fb40406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.961+0000 7fb425e00640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb4040697c0 0x7fb40406bc80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb418007a60 tx=0x7fb418008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:02.961+0000 7fb41e000640 1 -- 172.21.15.37:0/950222312 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb4200577d0 con 0x7fb4280cd340 2024-05-30T06:55:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.189+0000 7fb42ca00640 1 -- 172.21.15.37:0/950222312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb4280cf340 con 0x7fb4280cd340 2024-05-30T06:55:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.193+0000 7fb41e000640 1 -- 172.21.15.37:0/950222312 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1984 (secure 0 0 0) 0x7fb42005bad0 con 0x7fb4280cd340 2024-05-30T06:55:03.193 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:03.193 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:55:03.194 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:55:03.194 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:55:03.194 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:55:03.194 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:55:03.194 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:55:03.194 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:03.194 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:55:03.194 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:55:03.194 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:55:03.194 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:55:03.194 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:55:03.194 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:03.195 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:55:03.195 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:55:03.195 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:55:03.195 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:55:03.195 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:03.195 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 797, 2024-05-30T06:55:03.195 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:55:03.195 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:55:03.195 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:55:03.195 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:55:03.195 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:03.195 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:55:03.195 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 90, 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:03.196 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1565, 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 6443505305, 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 13745037312, 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 759349075968, 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 56, 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6, 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:55:03.197 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:55:03.198 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:55:03.198 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:03.198 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 6, 2024-05-30T06:55:03.198 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:55:03.198 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:55:03.198 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:55:03.199 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 7932 2024-05-30T06:55:03.199 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:03.199 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:03.199 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:55:03.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:03.200 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:55:03.200 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:55:03.200 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:55:03.200 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:55:03.200 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:55:03.200 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:55:03.200 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:55:03.200 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:03.200 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:55:03.200 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:03.200 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:55:03.200 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 14, 2024-05-30T06:55:03.200 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:54:52.931035+0000", 2024-05-30T06:55:03.201 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:55:03.201 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:03.201 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:55:03.201 INFO:teuthology.orchestra.run.smithi037.stdout: "b464851b-ad75-46d3-ab1c-f5a77c3e2df7": { 2024-05-30T06:55:03.201 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 7.0 seconds before exiting (29s)\n [============================] ", 2024-05-30T06:55:03.201 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:55:03.201 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:55:03.201 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:03.201 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:03.201 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:55:03.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.193+0000 7fb42ca00640 1 -- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb4040697c0 msgr2=0x7fb40406bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:03.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.193+0000 7fb42ca00640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb4040697c0 0x7fb40406bc80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb418007a60 tx=0x7fb418008040 comp rx=0 tx=0).stop 2024-05-30T06:55:03.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.193+0000 7fb42ca00640 1 -- 172.21.15.37:0/950222312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4280cd340 msgr2=0x7fb428153770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.193+0000 7fb42ca00640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4280cd340 0x7fb428153770 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fb42000cf20 tx=0x7fb42000a710 comp rx=0 tx=0).stop 2024-05-30T06:55:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.193+0000 7fb42ca00640 1 -- 172.21.15.37:0/950222312 shutdown_connections 2024-05-30T06:55:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.193+0000 7fb42ca00640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4280cd340 0x7fb428153770 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.193+0000 7fb42ca00640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb4040697c0 0x7fb40406bc80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.193+0000 7fb42ca00640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4280af1e0 0x7fb42815bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.193+0000 7fb42ca00640 1 --2- 172.21.15.37:0/950222312 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb42806e890 0x7fb428165ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.193+0000 7fb42ca00640 1 -- 172.21.15.37:0/950222312 >> 172.21.15.37:0/950222312 conn(0x7fb428073680 msgr2=0x7fb42806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.193+0000 7fb42ca00640 1 -- 172.21.15.37:0/950222312 shutdown_connections 2024-05-30T06:55:03.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:03.193+0000 7fb42ca00640 1 -- 172.21.15.37:0/950222312 wait complete. 2024-05-30T06:55:05.434 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:55:05.438 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:55:08.216 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:55:08.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.365+0000 7f180e000640 1 Processor -- start 2024-05-30T06:55:08.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.365+0000 7f180e000640 1 -- start start 2024-05-30T06:55:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.365+0000 7f180e000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18081482d0 0x7f18080b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.365+0000 7f180e000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f18080af690 0x7f180815ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.365+0000 7f180e000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1808160440 con 0x7f180815eed0 2024-05-30T06:55:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.365+0000 7f180e000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f180806e860 con 0x7f18081482d0 2024-05-30T06:55:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.365+0000 7f180e000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f18080afe30 con 0x7f18080af690 2024-05-30T06:55:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.369+0000 7f1807400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18081482d0 0x7f18080b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.369+0000 7f1807400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18081482d0 0x7f18080b2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42452/0 (socket says 172.21.15.37:42452) 2024-05-30T06:55:08.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.369+0000 7f1807400640 1 -- 172.21.15.37:0/1047438647 learned_addr learned my addr 172.21.15.37:0/1047438647 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:08.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.369+0000 7f17fea00640 1 --2- 172.21.15.37:0/1047438647 >> v2:172.21.15.105:3300/0 conn(0x7f18080af690 0x7f180815ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:08.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.369+0000 7f1807400640 1 -- 172.21.15.37:0/1047438647 >> v2:172.21.15.105:3300/0 conn(0x7f18080af690 msgr2=0x7f180815ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:08.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.369+0000 7f1807400640 1 --2- 172.21.15.37:0/1047438647 >> v2:172.21.15.105:3300/0 conn(0x7f18080af690 0x7f180815ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:08.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.369+0000 7f1807400640 1 -- 172.21.15.37:0/1047438647 >> v1:172.21.15.37:6789/0 conn(0x7f180815eed0 legacy=0x7f180815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:08.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.369+0000 7f1807400640 1 -- 172.21.15.37:0/1047438647 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180806e210 con 0x7f18081482d0 2024-05-30T06:55:08.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.369+0000 7f1806a00640 1 -- 172.21.15.37:0/1047438647 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132499573 0 0) 0x7f1808160440 con 0x7f180815eed0 2024-05-30T06:55:08.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.369+0000 7f1807400640 1 --2- 172.21.15.37:0/1047438647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18081482d0 0x7f18080b2ec0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f18080b5b70 tx=0x7f17f801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91461d1adf2b9b5d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:08.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.369+0000 7f1806a00640 1 -- 172.21.15.37:0/1047438647 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f80a5620 con 0x7f18081482d0 2024-05-30T06:55:08.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.369+0000 7f1806a00640 1 -- 172.21.15.37:0/1047438647 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f80a57c0 con 0x7f18081482d0 2024-05-30T06:55:08.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.369+0000 7f1806a00640 1 -- 172.21.15.37:0/1047438647 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f80a5b90 con 0x7f18081482d0 2024-05-30T06:55:08.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 -- 172.21.15.37:0/1047438647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18081482d0 msgr2=0x7f18080b2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:08.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 --2- 172.21.15.37:0/1047438647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18081482d0 0x7f18080b2ec0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f18080b5b70 tx=0x7f17f801c960 comp rx=0 tx=0).stop 2024-05-30T06:55:08.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 -- 172.21.15.37:0/1047438647 shutdown_connections 2024-05-30T06:55:08.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 --2- 172.21.15.37:0/1047438647 >> v2:172.21.15.105:3300/0 conn(0x7f18080af690 0x7f180815ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:08.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 --2- 172.21.15.37:0/1047438647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18081482d0 0x7f18080b2ec0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:08.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 -- 172.21.15.37:0/1047438647 >> 172.21.15.37:0/1047438647 conn(0x7f18080b23a0 msgr2=0x7f18080b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:08.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 -- 172.21.15.37:0/1047438647 shutdown_connections 2024-05-30T06:55:08.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 -- 172.21.15.37:0/1047438647 wait complete. 2024-05-30T06:55:08.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 Processor -- start 2024-05-30T06:55:08.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 -- start start 2024-05-30T06:55:08.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18080af690 0x7f180813e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18081482d0 0x7f18080cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f180815eed0 0x7f18080b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f180806f890 con 0x7f18081482d0 2024-05-30T06:55:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f180806f710 con 0x7f180815eed0 2024-05-30T06:55:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f180e000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f180816b890 con 0x7f18080af690 2024-05-30T06:55:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f17fea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18081482d0 0x7f18080cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f17fea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18081482d0 0x7f18080cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42458/0 (socket says 172.21.15.37:42458) 2024-05-30T06:55:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f17fea00640 1 -- 172.21.15.37:0/73671866 learned_addr learned my addr 172.21.15.37:0/73671866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f1807400640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18080af690 0x7f180813e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f1807e00640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f180815eed0 0x7f18080b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f17fea00640 1 -- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18080af690 msgr2=0x7f180813e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f17fea00640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18080af690 0x7f180813e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f17fea00640 1 -- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f180815eed0 msgr2=0x7f18080b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:08.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f17fea00640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f180815eed0 0x7f18080b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:08.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.373+0000 7f17fea00640 1 -- 172.21.15.37:0/73671866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18080cd2d0 con 0x7f18081482d0 2024-05-30T06:55:08.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.377+0000 7f17fea00640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18081482d0 0x7f18080cf940 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f17f000d5f0 tx=0x7f17f000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:08.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.377+0000 7f17ffe00640 1 -- 172.21.15.37:0/73671866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f00125f0 con 0x7f18081482d0 2024-05-30T06:55:08.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.377+0000 7f17ffe00640 1 -- 172.21.15.37:0/73671866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f0019070 con 0x7f18081482d0 2024-05-30T06:55:08.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.377+0000 7f17ffe00640 1 -- 172.21.15.37:0/73671866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f00129b0 con 0x7f18081482d0 2024-05-30T06:55:08.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.377+0000 7f180e000640 1 -- 172.21.15.37:0/73671866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180813d330 con 0x7f18081482d0 2024-05-30T06:55:08.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.377+0000 7f180e000640 1 -- 172.21.15.37:0/73671866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f180813d8f0 con 0x7f18081482d0 2024-05-30T06:55:08.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.377+0000 7f180e000640 1 -- 172.21.15.37:0/73671866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1808068b20 con 0x7f18081482d0 2024-05-30T06:55:08.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.377+0000 7f17ffe00640 1 -- 172.21.15.37:0/73671866 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7f17f0012b50 con 0x7f18081482d0 2024-05-30T06:55:08.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.377+0000 7f17ffe00640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f17e40697f0 0x7f17e406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:08.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.377+0000 7f17ffe00640 1 -- 172.21.15.37:0/73671866 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f17f0085e50 con 0x7f18081482d0 2024-05-30T06:55:08.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.377+0000 7f1807400640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f17e40697f0 0x7f17e406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:08.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.381+0000 7f1807400640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f17e40697f0 0x7f17e406bcb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f17f80ae000 tx=0x7f17f80a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:08.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.381+0000 7f17ffe00640 1 -- 172.21.15.37:0/73671866 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f17f008be20 con 0x7f18081482d0 2024-05-30T06:55:08.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.609+0000 7f180e000640 1 -- 172.21.15.37:0/73671866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1808072fb0 con 0x7f18081482d0 2024-05-30T06:55:08.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.609+0000 7f17ffe00640 1 -- 172.21.15.37:0/73671866 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1984 (secure 0 0 0) 0x7f17f0057a90 con 0x7f18081482d0 2024-05-30T06:55:08.611 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:08.611 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:55:08.611 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:55:08.611 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:55:08.611 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:55:08.611 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:55:08.611 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:55:08.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:08.611 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 802, 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:55:08.612 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:55:08.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:08.613 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:55:08.613 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 90, 2024-05-30T06:55:08.613 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:55:08.613 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:55:08.613 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:55:08.613 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:55:08.613 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:55:08.613 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:55:08.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:08.613 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:55:08.613 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:55:08.613 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:08.614 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:55:08.614 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:55:08.614 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:08.614 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:08.614 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:55:08.614 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:55:08.614 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1565, 2024-05-30T06:55:08.614 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 6443505305, 2024-05-30T06:55:08.614 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 13745037312, 2024-05-30T06:55:08.614 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 759349075968, 2024-05-30T06:55:08.614 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280 2024-05-30T06:55:08.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:08.614 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 56, 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6, 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 6, 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 7932 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:08.615 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:08.616 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:55:08.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:08.616 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:55:08.616 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:55:08.616 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:55:08.616 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:55:08.616 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:55:08.616 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:55:08.616 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:55:08.616 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:08.616 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:55:08.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:08.616 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:55:08.617 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 14, 2024-05-30T06:55:08.617 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:54:52.931035+0000", 2024-05-30T06:55:08.617 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:55:08.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:08.617 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:55:08.617 INFO:teuthology.orchestra.run.smithi037.stdout: "b464851b-ad75-46d3-ab1c-f5a77c3e2df7": { 2024-05-30T06:55:08.617 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 3.0 seconds before exiting (33s)\n [============================] ", 2024-05-30T06:55:08.617 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:55:08.617 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:55:08.617 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:08.617 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:08.617 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:55:08.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.609+0000 7f180e000640 1 -- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f17e40697f0 msgr2=0x7f17e406bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:08.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.609+0000 7f180e000640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f17e40697f0 0x7f17e406bcb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f17f80ae000 tx=0x7f17f80a7070 comp rx=0 tx=0).stop 2024-05-30T06:55:08.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.609+0000 7f180e000640 1 -- 172.21.15.37:0/73671866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18081482d0 msgr2=0x7f18080cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:08.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.609+0000 7f180e000640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18081482d0 0x7f18080cf940 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f17f000d5f0 tx=0x7f17f000dab0 comp rx=0 tx=0).stop 2024-05-30T06:55:08.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.609+0000 7f180e000640 1 -- 172.21.15.37:0/73671866 shutdown_connections 2024-05-30T06:55:08.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.609+0000 7f180e000640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f17e40697f0 0x7f17e406bcb0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:08.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.609+0000 7f180e000640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f180815eed0 0x7f18080b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:08.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.609+0000 7f180e000640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18081482d0 0x7f18080cf940 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:08.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.609+0000 7f180e000640 1 --2- 172.21.15.37:0/73671866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18080af690 0x7f180813e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:08.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.609+0000 7f180e000640 1 -- 172.21.15.37:0/73671866 >> 172.21.15.37:0/73671866 conn(0x7f18080b23a0 msgr2=0x7f18080b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:08.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.613+0000 7f180e000640 1 -- 172.21.15.37:0/73671866 shutdown_connections 2024-05-30T06:55:08.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:08.613+0000 7f180e000640 1 -- 172.21.15.37:0/73671866 wait complete. 2024-05-30T06:55:13.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:55:13.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.785+0000 7f5692200640 1 Processor -- start 2024-05-30T06:55:13.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.785+0000 7f5692200640 1 -- start start 2024-05-30T06:55:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.785+0000 7f5692200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f568c155e60 0x7f568c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.785+0000 7f5692200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f568c15c8f0 con 0x7f568c0b2ec0 2024-05-30T06:55:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.785+0000 7f5692200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f568c0ccc80 con 0x7f568c06f9a0 2024-05-30T06:55:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.785+0000 7f5692200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f568c0ccff0 con 0x7f568c155e60 2024-05-30T06:55:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.785+0000 7f568be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f568c0b2ec0 0x7f568c0cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41748/0 (socket says 172.21.15.37:41748) 2024-05-30T06:55:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.785+0000 7f568be00640 1 -- 172.21.15.37:0/2426009616 learned_addr learned my addr 172.21.15.37:0/2426009616 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:13.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.785+0000 7f568b400640 1 --2- 172.21.15.37:0/2426009616 >> v2:172.21.15.105:3300/0 conn(0x7f568c155e60 0x7f568c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:13.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.785+0000 7f568aa00640 1 -- 172.21.15.37:0/2426009616 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2118997150 0 0) 0x7f568c15c8f0 con 0x7f568c0b2ec0 2024-05-30T06:55:13.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.789+0000 7f568aa00640 1 -- 172.21.15.37:0/2426009616 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5670003530 con 0x7f568c0b2ec0 2024-05-30T06:55:13.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.789+0000 7f568aa00640 1 -- 172.21.15.37:0/2426009616 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517010530 0 0) 0x7f568c0ccc80 con 0x7f568c06f9a0 2024-05-30T06:55:13.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.789+0000 7f568aa00640 1 -- 172.21.15.37:0/2426009616 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f568c15c8f0 con 0x7f568c06f9a0 2024-05-30T06:55:13.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.789+0000 7f568b400640 1 -- 172.21.15.37:0/2426009616 >> v1:172.21.15.105:6789/0 conn(0x7f568c06f9a0 legacy=0x7f568c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:13.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.789+0000 7f568aa00640 1 -- 172.21.15.37:0/2426009616 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3859624891 0 0) 0x7f5670003530 con 0x7f568c0b2ec0 2024-05-30T06:55:13.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.789+0000 7f568b400640 1 -- 172.21.15.37:0/2426009616 >> v1:172.21.15.37:6789/0 conn(0x7f568c0b2ec0 legacy=0x7f568c0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:13.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.789+0000 7f568b400640 1 -- 172.21.15.37:0/2426009616 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568c15cbd0 con 0x7f568c155e60 2024-05-30T06:55:13.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.789+0000 7f568b400640 1 --2- 172.21.15.37:0/2426009616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f568c155e60 0x7f568c0b36a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f567c0097c0 tx=0x7f567c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=182e7d2fc7801a55 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:13.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.793+0000 7f568aa00640 1 -- 172.21.15.37:0/2426009616 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c0b0070 con 0x7f568c155e60 2024-05-30T06:55:13.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.793+0000 7f568aa00640 1 -- 172.21.15.37:0/2426009616 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c0ab400 con 0x7f568c155e60 2024-05-30T06:55:13.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.793+0000 7f568aa00640 1 -- 172.21.15.37:0/2426009616 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684001a00 con 0x7f568c155e60 2024-05-30T06:55:13.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.793+0000 7f5692200640 1 -- 172.21.15.37:0/2426009616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f568c155e60 msgr2=0x7f568c0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:13.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.793+0000 7f5692200640 1 --2- 172.21.15.37:0/2426009616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f568c155e60 0x7f568c0b36a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f567c0097c0 tx=0x7f567c01c3c0 comp rx=0 tx=0).stop 2024-05-30T06:55:13.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5692200640 1 -- 172.21.15.37:0/2426009616 shutdown_connections 2024-05-30T06:55:13.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5692200640 1 --2- 172.21.15.37:0/2426009616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f568c155e60 0x7f568c0b36a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:13.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5692200640 1 -- 172.21.15.37:0/2426009616 >> 172.21.15.37:0/2426009616 conn(0x7f568c0b23a0 msgr2=0x7f568c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:13.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5692200640 1 -- 172.21.15.37:0/2426009616 shutdown_connections 2024-05-30T06:55:13.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5692200640 1 -- 172.21.15.37:0/2426009616 wait complete. 2024-05-30T06:55:13.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5692200640 1 Processor -- start 2024-05-30T06:55:13.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5692200640 1 -- start start 2024-05-30T06:55:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5692200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f568c06f9a0 0x7f568c0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5692200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f568c0b2ec0 0x7f568c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5692200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f568c155e60 0x7f568c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5692200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f568c169a00 con 0x7f568c155e60 2024-05-30T06:55:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5692200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f568c169880 con 0x7f568c0b2ec0 2024-05-30T06:55:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5692200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f568c169b80 con 0x7f568c06f9a0 2024-05-30T06:55:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f568be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f568c155e60 0x7f568c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:13.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f568be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f568c155e60 0x7f568c1536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42462/0 (socket says 172.21.15.37:42462) 2024-05-30T06:55:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f568be00640 1 -- 172.21.15.37:0/2117725993 learned_addr learned my addr 172.21.15.37:0/2117725993 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f5683e00640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f568c0b2ec0 0x7f568c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:13.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f568b400640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f568c06f9a0 0x7f568c0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f568be00640 1 -- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f568c06f9a0 msgr2=0x7f568c0c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f568be00640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f568c06f9a0 0x7f568c0c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f568be00640 1 -- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f568c0b2ec0 msgr2=0x7f568c1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f568be00640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f568c0b2ec0 0x7f568c1531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f568be00640 1 -- 172.21.15.37:0/2117725993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568c0cb8c0 con 0x7f568c155e60 2024-05-30T06:55:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.797+0000 7f568be00640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f568c155e60 0x7f568c1536f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f5684001fd0 tx=0x7f568400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.801+0000 7f5683400640 1 -- 172.21.15.37:0/2117725993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684012400 con 0x7f568c155e60 2024-05-30T06:55:13.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.801+0000 7f5683400640 1 -- 172.21.15.37:0/2117725993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56840125a0 con 0x7f568c155e60 2024-05-30T06:55:13.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.801+0000 7f5692200640 1 -- 172.21.15.37:0/2117725993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568c0cbba0 con 0x7f568c155e60 2024-05-30T06:55:13.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.801+0000 7f5683400640 1 -- 172.21.15.37:0/2117725993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684012990 con 0x7f568c155e60 2024-05-30T06:55:13.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.801+0000 7f5692200640 1 -- 172.21.15.37:0/2117725993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f568c0cc160 con 0x7f568c155e60 2024-05-30T06:55:13.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.801+0000 7f5692200640 1 -- 172.21.15.37:0/2117725993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f568c068b20 con 0x7f568c155e60 2024-05-30T06:55:13.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.801+0000 7f5683400640 1 -- 172.21.15.37:0/2117725993 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7f5684012b30 con 0x7f568c155e60 2024-05-30T06:55:13.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.801+0000 7f5683400640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f56680697c0 0x7f566806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:13.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.801+0000 7f5683400640 1 -- 172.21.15.37:0/2117725993 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f5684085d90 con 0x7f568c155e60 2024-05-30T06:55:13.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.801+0000 7f568b400640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f56680697c0 0x7f566806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:13.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.805+0000 7f568b400640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f56680697c0 0x7f566806bc80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f567c0ad000 tx=0x7f567c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:13.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:13.805+0000 7f5683400640 1 -- 172.21.15.37:0/2117725993 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5684012e20 con 0x7f568c155e60 2024-05-30T06:55:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.029+0000 7f5692200640 1 -- 172.21.15.37:0/2117725993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f568c072fb0 con 0x7f568c155e60 2024-05-30T06:55:14.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.029+0000 7f5683400640 1 -- 172.21.15.37:0/2117725993 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1730 (secure 0 0 0) 0x7f56840577b0 con 0x7f568c155e60 2024-05-30T06:55:14.033 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:14.033 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:55:14.033 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:55:14.033 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:55:14.033 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:55:14.033 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:55:14.033 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:55:14.033 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:14.033 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:55:14.034 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:55:14.034 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:55:14.034 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:55:14.034 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:55:14.034 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:14.034 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:55:14.034 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:55:14.034 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:55:14.034 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:55:14.034 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:14.034 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 808, 2024-05-30T06:55:14.034 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 90, 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:14.035 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:55:14.036 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:55:14.036 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:14.036 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:55:14.036 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:55:14.036 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:14.036 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:14.036 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:55:14.036 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:55:14.036 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1565, 2024-05-30T06:55:14.036 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 6443505305, 2024-05-30T06:55:14.036 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 13745037312, 2024-05-30T06:55:14.036 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 759349075968, 2024-05-30T06:55:14.036 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 56, 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6, 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 6, 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "b", 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:55:14.037 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 7932 2024-05-30T06:55:14.038 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:14.038 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:14.038 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:55:14.038 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:14.038 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:55:14.038 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:55:14.038 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:55:14.038 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:55:14.038 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:55:14.038 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:55:14.038 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:55:14.038 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:55:14.038 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:55:14.039 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:14.039 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:55:14.039 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 14, 2024-05-30T06:55:14.039 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:54:52.931035+0000", 2024-05-30T06:55:14.039 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:55:14.039 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:14.039 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": {} 2024-05-30T06:55:14.039 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:55:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.033+0000 7f5692200640 1 -- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f56680697c0 msgr2=0x7f566806bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.033+0000 7f5692200640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f56680697c0 0x7f566806bc80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f567c0ad000 tx=0x7f567c0a6000 comp rx=0 tx=0).stop 2024-05-30T06:55:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.033+0000 7f5692200640 1 -- 172.21.15.37:0/2117725993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f568c155e60 msgr2=0x7f568c1536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.033+0000 7f5692200640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f568c155e60 0x7f568c1536f0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f5684001fd0 tx=0x7f568400cf90 comp rx=0 tx=0).stop 2024-05-30T06:55:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.033+0000 7f5692200640 1 -- 172.21.15.37:0/2117725993 shutdown_connections 2024-05-30T06:55:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.033+0000 7f5692200640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f568c155e60 0x7f568c1536f0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.033+0000 7f5692200640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f56680697c0 0x7f566806bc80 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.033+0000 7f5692200640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f568c0b2ec0 0x7f568c1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.033+0000 7f5692200640 1 --2- 172.21.15.37:0/2117725993 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f568c06f9a0 0x7f568c0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.033+0000 7f5692200640 1 -- 172.21.15.37:0/2117725993 >> 172.21.15.37:0/2117725993 conn(0x7f568c0b23a0 msgr2=0x7f568c0cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.033+0000 7f5692200640 1 -- 172.21.15.37:0/2117725993 shutdown_connections 2024-05-30T06:55:14.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.033+0000 7f5692200640 1 -- 172.21.15.37:0/2117725993 wait complete. 2024-05-30T06:55:14.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T06:55:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.197+0000 7fc19b800640 1 Processor -- start 2024-05-30T06:55:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.197+0000 7fc19b800640 1 -- start start 2024-05-30T06:55:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.197+0000 7fc19b800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc19415c890 0x7fc194162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.197+0000 7fc19b800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc194163020 con 0x7fc19415f210 2024-05-30T06:55:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.197+0000 7fc19b800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc194163300 con 0x7fc194072e60 2024-05-30T06:55:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.197+0000 7fc19b800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc1941635e0 con 0x7fc19415c890 2024-05-30T06:55:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.197+0000 7fc198e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc19415c890 0x7fc194162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.197+0000 7fc198e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc19415c890 0x7fc194162720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42464/0 (socket says 172.21.15.37:42464) 2024-05-30T06:55:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.197+0000 7fc198e00640 1 -- 172.21.15.37:0/639719256 learned_addr learned my addr 172.21.15.37:0/639719256 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.197+0000 7fc18be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc19415f210 0x7fc194072750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41750/0 (socket says 172.21.15.37:41750) 2024-05-30T06:55:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.197+0000 7fc198e00640 1 -- 172.21.15.37:0/639719256 >> v1:172.21.15.105:6789/0 conn(0x7fc194072e60 legacy=0x7fc19406c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.197+0000 7fc198e00640 1 -- 172.21.15.37:0/639719256 >> v1:172.21.15.37:6789/0 conn(0x7fc19415f210 legacy=0x7fc194072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.197+0000 7fc198e00640 1 -- 172.21.15.37:0/639719256 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19406ba00 con 0x7fc19415c890 2024-05-30T06:55:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.201+0000 7fc198e00640 1 --2- 172.21.15.37:0/639719256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc19415c890 0x7fc194162720 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fc184009870 tx=0x7fc18401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb71037263725a3d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.201+0000 7fc193e00640 1 -- 172.21.15.37:0/639719256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1840b0070 con 0x7fc19415c890 2024-05-30T06:55:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.201+0000 7fc193e00640 1 -- 172.21.15.37:0/639719256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1840ab600 con 0x7fc19415c890 2024-05-30T06:55:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.201+0000 7fc193e00640 1 -- 172.21.15.37:0/639719256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1840ab9d0 con 0x7fc19415c890 2024-05-30T06:55:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.201+0000 7fc19b800640 1 -- 172.21.15.37:0/639719256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc19415c890 msgr2=0x7fc194162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.201+0000 7fc19b800640 1 --2- 172.21.15.37:0/639719256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc19415c890 0x7fc194162720 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fc184009870 tx=0x7fc18401c490 comp rx=0 tx=0).stop 2024-05-30T06:55:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.201+0000 7fc19b800640 1 -- 172.21.15.37:0/639719256 shutdown_connections 2024-05-30T06:55:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.201+0000 7fc19b800640 1 --2- 172.21.15.37:0/639719256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc19415c890 0x7fc194162720 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.201+0000 7fc19b800640 1 -- 172.21.15.37:0/639719256 >> 172.21.15.37:0/639719256 conn(0x7fc1940b2ac0 msgr2=0x7fc1940b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.201+0000 7fc19b800640 1 -- 172.21.15.37:0/639719256 shutdown_connections 2024-05-30T06:55:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.201+0000 7fc19b800640 1 -- 172.21.15.37:0/639719256 wait complete. 2024-05-30T06:55:14.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc19b800640 1 Processor -- start 2024-05-30T06:55:14.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc19b800640 1 -- start start 2024-05-30T06:55:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc19b800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc194072e60 0x7fc194141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc19b800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc19415c890 0x7fc194143fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc19b800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc19415f210 0x7fc1940b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc19b800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc19416ce60 con 0x7fc194072e60 2024-05-30T06:55:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc19b800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc19416cce0 con 0x7fc19415c890 2024-05-30T06:55:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc19b800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc19416cfe0 con 0x7fc19415f210 2024-05-30T06:55:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc198e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc194072e60 0x7fc194141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc198e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc194072e60 0x7fc194141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42474/0 (socket says 172.21.15.37:42474) 2024-05-30T06:55:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc198e00640 1 -- 172.21.15.37:0/1392242696 learned_addr learned my addr 172.21.15.37:0/1392242696 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc199800640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc19415f210 0x7fc1940b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc18be00640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc19415c890 0x7fc194143fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc198e00640 1 -- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc19415f210 msgr2=0x7fc1940b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc198e00640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc19415f210 0x7fc1940b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc198e00640 1 -- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc19415c890 msgr2=0x7fc194143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc198e00640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc19415c890 0x7fc194143fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc198e00640 1 -- 172.21.15.37:0/1392242696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1941448a0 con 0x7fc194072e60 2024-05-30T06:55:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc198e00640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc194072e60 0x7fc194141770 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fc1840190a0 tx=0x7fc18401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc191600640 1 -- 172.21.15.37:0/1392242696 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1840ba020 con 0x7fc194072e60 2024-05-30T06:55:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc191600640 1 -- 172.21.15.37:0/1392242696 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1840aa9f0 con 0x7fc194072e60 2024-05-30T06:55:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc191600640 1 -- 172.21.15.37:0/1392242696 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1840b0040 con 0x7fc194072e60 2024-05-30T06:55:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc19b800640 1 -- 172.21.15.37:0/1392242696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc194144b80 con 0x7fc194072e60 2024-05-30T06:55:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc19b800640 1 -- 172.21.15.37:0/1392242696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc194141fb0 con 0x7fc194072e60 2024-05-30T06:55:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.205+0000 7fc19b800640 1 -- 172.21.15.37:0/1392242696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc194068bc0 con 0x7fc194072e60 2024-05-30T06:55:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.209+0000 7fc191600640 1 -- 172.21.15.37:0/1392242696 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7fc1840bd020 con 0x7fc194072e60 2024-05-30T06:55:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.209+0000 7fc191600640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc1700697c0 0x7fc17006bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.209+0000 7fc191600640 1 -- 172.21.15.37:0/1392242696 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7fc18411fc80 con 0x7fc194072e60 2024-05-30T06:55:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.209+0000 7fc18be00640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc1700697c0 0x7fc17006bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.209+0000 7fc18be00640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc1700697c0 0x7fc17006bc80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc1940d0220 tx=0x7fc17c007cf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.213+0000 7fc191600640 1 -- 172.21.15.37:0/1392242696 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc1840c4030 con 0x7fc194072e60 2024-05-30T06:55:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.401+0000 7fc19b800640 1 -- 172.21.15.37:0/1392242696 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc19406c6f0 con 0x7fc1700697c0 2024-05-30T06:55:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.405+0000 7fc191600640 1 -- 172.21.15.37:0/1392242696 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+79 (secure 0 0 0) 0x7fc19406c6f0 con 0x7fc1700697c0 2024-05-30T06:55:14.409 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:14.409 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:55:14.409 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:14.409 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sv1" 2024-05-30T06:55:14.409 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:14.409 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:14.409 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ss1clone1" 2024-05-30T06:55:14.409 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:14.409 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:55:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.409+0000 7fc19b800640 1 -- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc1700697c0 msgr2=0x7fc17006bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.409+0000 7fc19b800640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc1700697c0 0x7fc17006bc80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc1940d0220 tx=0x7fc17c007cf0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.409+0000 7fc19b800640 1 -- 172.21.15.37:0/1392242696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc194072e60 msgr2=0x7fc194141770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.409+0000 7fc19b800640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc194072e60 0x7fc194141770 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fc1840190a0 tx=0x7fc18401acd0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.409+0000 7fc19b800640 1 -- 172.21.15.37:0/1392242696 shutdown_connections 2024-05-30T06:55:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.409+0000 7fc19b800640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc19415f210 0x7fc1940b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.409+0000 7fc19b800640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc1700697c0 0x7fc17006bc80 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.409+0000 7fc19b800640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc19415c890 0x7fc194143fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.409+0000 7fc19b800640 1 --2- 172.21.15.37:0/1392242696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc194072e60 0x7fc194141770 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.409+0000 7fc19b800640 1 -- 172.21.15.37:0/1392242696 >> 172.21.15.37:0/1392242696 conn(0x7fc1940b2ac0 msgr2=0x7fc1940b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.409+0000 7fc19b800640 1 -- 172.21.15.37:0/1392242696 shutdown_connections 2024-05-30T06:55:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.409+0000 7fc19b800640 1 -- 172.21.15.37:0/1392242696 wait complete. 2024-05-30T06:55:14.431 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T06:55:14.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8089600640 1 Processor -- start 2024-05-30T06:55:14.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8089600640 1 -- start start 2024-05-30T06:55:14.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8089600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f808415eb60 0x7f808406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8089600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80840b15c0 0x7f80840cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8089600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80840cf460 0x7f80841625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8089600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f808409bba0 con 0x7f80840cf460 2024-05-30T06:55:14.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8089600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f808409ab00 con 0x7f808415eb60 2024-05-30T06:55:14.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8089600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f808409ade0 con 0x7f80840b15c0 2024-05-30T06:55:14.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8083400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80840cf460 0x7f80841625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8083400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80840cf460 0x7f80841625a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42490/0 (socket says 172.21.15.37:42490) 2024-05-30T06:55:14.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8083400640 1 -- 172.21.15.37:0/657750691 learned_addr learned my addr 172.21.15.37:0/657750691 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:14.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8082000640 1 --2- 172.21.15.37:0/657750691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80840b15c0 0x7f80840cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8082a00640 1 --2- 172.21.15.37:0/657750691 >> v2:172.21.15.105:3300/0 conn(0x7f808415eb60 0x7f808406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8083400640 1 -- 172.21.15.37:0/657750691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80840b15c0 msgr2=0x7f80840cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:14.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8083400640 1 --2- 172.21.15.37:0/657750691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80840b15c0 0x7f80840cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8083400640 1 -- 172.21.15.37:0/657750691 >> v2:172.21.15.105:3300/0 conn(0x7f808415eb60 msgr2=0x7f808406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:14.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8083400640 1 --2- 172.21.15.37:0/657750691 >> v2:172.21.15.105:3300/0 conn(0x7f808415eb60 0x7f808406d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8083400640 1 -- 172.21.15.37:0/657750691 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808409b0c0 con 0x7f80840cf460 2024-05-30T06:55:14.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.573+0000 7f8082a00640 1 --2- 172.21.15.37:0/657750691 >> v2:172.21.15.105:3300/0 conn(0x7f808415eb60 0x7f808406d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:14.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.577+0000 7f8083400640 1 --2- 172.21.15.37:0/657750691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80840cf460 0x7f80841625a0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f80840b8730 tx=0x7f807c01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50985665404084d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:14.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.577+0000 7f8081600640 1 -- 172.21.15.37:0/657750691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c0ac070 con 0x7f80840cf460 2024-05-30T06:55:14.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.577+0000 7f8081600640 1 -- 172.21.15.37:0/657750691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c0a8420 con 0x7f80840cf460 2024-05-30T06:55:14.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.577+0000 7f8081600640 1 -- 172.21.15.37:0/657750691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c0a87f0 con 0x7f80840cf460 2024-05-30T06:55:14.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.577+0000 7f8089600640 1 -- 172.21.15.37:0/657750691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80840cf460 msgr2=0x7f80841625a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.577+0000 7f8089600640 1 --2- 172.21.15.37:0/657750691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80840cf460 0x7f80841625a0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f80840b8730 tx=0x7f807c01c730 comp rx=0 tx=0).stop 2024-05-30T06:55:14.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.577+0000 7f8089600640 1 -- 172.21.15.37:0/657750691 shutdown_connections 2024-05-30T06:55:14.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.577+0000 7f8089600640 1 --2- 172.21.15.37:0/657750691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80840cf460 0x7f80841625a0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.577+0000 7f8089600640 1 --2- 172.21.15.37:0/657750691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80840b15c0 0x7f80840cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.577+0000 7f8089600640 1 --2- 172.21.15.37:0/657750691 >> v2:172.21.15.105:3300/0 conn(0x7f808415eb60 0x7f808406d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.577+0000 7f8089600640 1 -- 172.21.15.37:0/657750691 >> 172.21.15.37:0/657750691 conn(0x7f80840d26a0 msgr2=0x7f80840d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:14.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.577+0000 7f8089600640 1 -- 172.21.15.37:0/657750691 shutdown_connections 2024-05-30T06:55:14.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.577+0000 7f8089600640 1 -- 172.21.15.37:0/657750691 wait complete. 2024-05-30T06:55:14.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8089600640 1 Processor -- start 2024-05-30T06:55:14.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8089600640 1 -- start start 2024-05-30T06:55:14.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8089600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80840b15c0 0x7f808415a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8089600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80840cf460 0x7f8084155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8089600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f808415eb60 0x7f80840b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8089600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f80840d07f0 con 0x7f808415eb60 2024-05-30T06:55:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8089600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f80840d0670 con 0x7f80840cf460 2024-05-30T06:55:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8089600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f80840d0970 con 0x7f80840b15c0 2024-05-30T06:55:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8083400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f808415eb60 0x7f80840b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8083400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f808415eb60 0x7f80840b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42500/0 (socket says 172.21.15.37:42500) 2024-05-30T06:55:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8083400640 1 -- 172.21.15.37:0/565709066 learned_addr learned my addr 172.21.15.37:0/565709066 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8082000640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80840cf460 0x7f8084155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8082a00640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80840b15c0 0x7f808415a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8083400640 1 -- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80840b15c0 msgr2=0x7f808415a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8083400640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80840b15c0 0x7f808415a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8083400640 1 -- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80840cf460 msgr2=0x7f8084155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8083400640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80840cf460 0x7f8084155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8083400640 1 -- 172.21.15.37:0/565709066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80840c7870 con 0x7f808415eb60 2024-05-30T06:55:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8083400640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f808415eb60 0x7f80840b0590 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f807c01ade0 tx=0x7f807c0194d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:14.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f807aa00640 1 -- 172.21.15.37:0/565709066 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c0ac040 con 0x7f808415eb60 2024-05-30T06:55:14.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f807aa00640 1 -- 172.21.15.37:0/565709066 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c0bd650 con 0x7f808415eb60 2024-05-30T06:55:14.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8089600640 1 -- 172.21.15.37:0/565709066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80841599d0 con 0x7f808415eb60 2024-05-30T06:55:14.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f807aa00640 1 -- 172.21.15.37:0/565709066 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807c009510 con 0x7f808415eb60 2024-05-30T06:55:14.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.581+0000 7f8089600640 1 -- 172.21.15.37:0/565709066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80841562f0 con 0x7f808415eb60 2024-05-30T06:55:14.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.585+0000 7f8089600640 1 -- 172.21.15.37:0/565709066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8084068d40 con 0x7f808415eb60 2024-05-30T06:55:14.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.585+0000 7f807aa00640 1 -- 172.21.15.37:0/565709066 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7f807c0af070 con 0x7f808415eb60 2024-05-30T06:55:14.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.585+0000 7f807aa00640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80640697c0 0x7f806406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.585+0000 7f807aa00640 1 -- 172.21.15.37:0/565709066 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f807c11fe10 con 0x7f808415eb60 2024-05-30T06:55:14.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.585+0000 7f8082a00640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80640697c0 0x7f806406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.585+0000 7f8082a00640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80640697c0 0x7f806406bc80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8074006e90 tx=0x7f8074008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:14.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.589+0000 7f807aa00640 1 -- 172.21.15.37:0/565709066 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f80840c7870 con 0x7f808415eb60 2024-05-30T06:55:14.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.781+0000 7f8089600640 1 -- 172.21.15.37:0/565709066 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f808415b790 con 0x7f80640697c0 2024-05-30T06:55:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.793+0000 7f807aa00640 1 -- 172.21.15.37:0/565709066 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f808415b790 con 0x7f80640697c0 2024-05-30T06:55:14.796 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:14.796 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:55:14.796 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:14.796 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ss1" 2024-05-30T06:55:14.796 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:14.796 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:55:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.797+0000 7f8089600640 1 -- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80640697c0 msgr2=0x7f806406bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.797+0000 7f8089600640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80640697c0 0x7f806406bc80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8074006e90 tx=0x7f8074008040 comp rx=0 tx=0).stop 2024-05-30T06:55:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.797+0000 7f8089600640 1 -- 172.21.15.37:0/565709066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f808415eb60 msgr2=0x7f80840b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.797+0000 7f8089600640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f808415eb60 0x7f80840b0590 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f807c01ade0 tx=0x7f807c0194d0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.797+0000 7f8089600640 1 -- 172.21.15.37:0/565709066 shutdown_connections 2024-05-30T06:55:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.797+0000 7f8089600640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f808415eb60 0x7f80840b0590 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.797+0000 7f8089600640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f80640697c0 0x7f806406bc80 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.797+0000 7f8089600640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80840cf460 0x7f8084155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.797+0000 7f8089600640 1 --2- 172.21.15.37:0/565709066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80840b15c0 0x7f808415a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.797+0000 7f8089600640 1 -- 172.21.15.37:0/565709066 >> 172.21.15.37:0/565709066 conn(0x7f80840d26a0 msgr2=0x7f8084070470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.797+0000 7f8089600640 1 -- 172.21.15.37:0/565709066 shutdown_connections 2024-05-30T06:55:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.797+0000 7f8089600640 1 -- 172.21.15.37:0/565709066 wait complete. 2024-05-30T06:55:14.818 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T06:55:14.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.965+0000 7f8b24000640 1 Processor -- start 2024-05-30T06:55:14.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.965+0000 7f8b24000640 1 -- start start 2024-05-30T06:55:14.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.965+0000 7f8b24000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b1c072e60 0x7f8b1c06c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.965+0000 7f8b24000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b1c163020 con 0x7f8b1c15c890 2024-05-30T06:55:14.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.965+0000 7f8b24000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b1c163300 con 0x7f8b1c15f210 2024-05-30T06:55:14.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.965+0000 7f8b24000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8b1c1635e0 con 0x7f8b1c072e60 2024-05-30T06:55:14.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.965+0000 7f8b21600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8b1c15c890 0x7f8b1c162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41766/0 (socket says 172.21.15.37:41766) 2024-05-30T06:55:14.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.965+0000 7f8b21600640 1 -- 172.21.15.37:0/2519404705 learned_addr learned my addr 172.21.15.37:0/2519404705 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:14.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.965+0000 7f8b22000640 1 --2- 172.21.15.37:0/2519404705 >> v2:172.21.15.37:3300/0 conn(0x7f8b1c072e60 0x7f8b1c06c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.965+0000 7f8b1be00640 1 -- 172.21.15.37:0/2519404705 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2067256581 0 0) 0x7f8b1c163020 con 0x7f8b1c15c890 2024-05-30T06:55:14.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.965+0000 7f8b22000640 1 -- 172.21.15.37:0/2519404705 >> v1:172.21.15.105:6789/0 conn(0x7f8b1c15f210 legacy=0x7f8b1c072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.965+0000 7f8b22000640 1 -- 172.21.15.37:0/2519404705 >> v1:172.21.15.37:6789/0 conn(0x7f8b1c15c890 legacy=0x7f8b1c162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.965+0000 7f8b22000640 1 -- 172.21.15.37:0/2519404705 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c06ba00 con 0x7f8b1c072e60 2024-05-30T06:55:14.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.969+0000 7f8b22000640 1 --2- 172.21.15.37:0/2519404705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b1c072e60 0x7f8b1c06c200 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009d90 tx=0x7f8b1401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e5029ef28b267a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:14.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.969+0000 7f8b1be00640 1 -- 172.21.15.37:0/2519404705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b140b2070 con 0x7f8b1c072e60 2024-05-30T06:55:14.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.969+0000 7f8b1be00640 1 -- 172.21.15.37:0/2519404705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b140a55a0 con 0x7f8b1c072e60 2024-05-30T06:55:14.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.969+0000 7f8b1be00640 1 -- 172.21.15.37:0/2519404705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b140a5970 con 0x7f8b1c072e60 2024-05-30T06:55:14.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.969+0000 7f8b24000640 1 -- 172.21.15.37:0/2519404705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b1c072e60 msgr2=0x7f8b1c06c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.969+0000 7f8b24000640 1 --2- 172.21.15.37:0/2519404705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b1c072e60 0x7f8b1c06c200 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f8b14009d90 tx=0x7f8b1401c8e0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.969+0000 7f8b24000640 1 -- 172.21.15.37:0/2519404705 shutdown_connections 2024-05-30T06:55:14.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.969+0000 7f8b24000640 1 --2- 172.21.15.37:0/2519404705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b1c072e60 0x7f8b1c06c200 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.969+0000 7f8b24000640 1 -- 172.21.15.37:0/2519404705 >> 172.21.15.37:0/2519404705 conn(0x7f8b1c0b2ac0 msgr2=0x7f8b1c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:14.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.969+0000 7f8b24000640 1 -- 172.21.15.37:0/2519404705 shutdown_connections 2024-05-30T06:55:14.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.969+0000 7f8b24000640 1 -- 172.21.15.37:0/2519404705 wait complete. 2024-05-30T06:55:14.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.969+0000 7f8b24000640 1 Processor -- start 2024-05-30T06:55:14.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b24000640 1 -- start start 2024-05-30T06:55:14.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b24000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b1c072e60 0x7f8b1c159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b24000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b1c15c890 0x7f8b1c0af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b24000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1c15f210 0x7f8b1c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b24000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c16ce60 con 0x7f8b1c072e60 2024-05-30T06:55:14.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b24000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c16cce0 con 0x7f8b1c15f210 2024-05-30T06:55:14.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b24000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1c16cfe0 con 0x7f8b1c15c890 2024-05-30T06:55:14.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b21600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b1c072e60 0x7f8b1c159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b21600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b1c072e60 0x7f8b1c159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42518/0 (socket says 172.21.15.37:42518) 2024-05-30T06:55:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b21600640 1 -- 172.21.15.37:0/3279482001 learned_addr learned my addr 172.21.15.37:0/3279482001 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b22000640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1c15f210 0x7f8b1c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b20c00640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b1c15c890 0x7f8b1c0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b21600640 1 -- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b1c15c890 msgr2=0x7f8b1c0af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b21600640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b1c15c890 0x7f8b1c0af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b21600640 1 -- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1c15f210 msgr2=0x7f8b1c0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b21600640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1c15f210 0x7f8b1c0af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b21600640 1 -- 172.21.15.37:0/3279482001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c158540 con 0x7f8b1c072e60 2024-05-30T06:55:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b22000640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1c15f210 0x7f8b1c0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b20c00640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b1c15c890 0x7f8b1c0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:14.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b21600640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b1c072e60 0x7f8b1c159300 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000c4a0 tx=0x7f8b1000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:14.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b19600640 1 -- 172.21.15.37:0/3279482001 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10018070 con 0x7f8b1c072e60 2024-05-30T06:55:14.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b19600640 1 -- 172.21.15.37:0/3279482001 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b100074e0 con 0x7f8b1c072e60 2024-05-30T06:55:14.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b19600640 1 -- 172.21.15.37:0/3279482001 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10004a30 con 0x7f8b1c072e60 2024-05-30T06:55:14.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b24000640 1 -- 172.21.15.37:0/3279482001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1c158820 con 0x7f8b1c072e60 2024-05-30T06:55:14.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b24000640 1 -- 172.21.15.37:0/3279482001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1c158de0 con 0x7f8b1c072e60 2024-05-30T06:55:14.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.973+0000 7f8b24000640 1 -- 172.21.15.37:0/3279482001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b1c16a390 con 0x7f8b1c072e60 2024-05-30T06:55:14.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.977+0000 7f8b19600640 1 -- 172.21.15.37:0/3279482001 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7f8b1001b070 con 0x7f8b1c072e60 2024-05-30T06:55:14.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.977+0000 7f8b19600640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8afc0697c0 0x7f8afc06bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:14.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.977+0000 7f8b19600640 1 -- 172.21.15.37:0/3279482001 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f8b10084d30 con 0x7f8b1c072e60 2024-05-30T06:55:14.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.977+0000 7f8b20c00640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8afc0697c0 0x7f8afc06bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:14.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.977+0000 7f8b20c00640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8afc0697c0 0x7f8afc06bc80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c161f00 tx=0x7f8b08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:14.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:14.981+0000 7f8b19600640 1 -- 172.21.15.37:0/3279482001 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8b100569b0 con 0x7f8b1c072e60 2024-05-30T06:55:15.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.177+0000 7f8b24000640 1 -- 172.21.15.37:0/3279482001 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b1c158fb0 con 0x7f8afc0697c0 2024-05-30T06:55:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.205+0000 7f8b19600640 1 -- 172.21.15.37:0/3279482001 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8b1c158fb0 con 0x7f8afc0697c0 2024-05-30T06:55:15.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.205+0000 7f8b24000640 1 -- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8afc0697c0 msgr2=0x7f8afc06bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.205+0000 7f8b24000640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8afc0697c0 0x7f8afc06bc80 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c161f00 tx=0x7f8b08009040 comp rx=0 tx=0).stop 2024-05-30T06:55:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.205+0000 7f8b24000640 1 -- 172.21.15.37:0/3279482001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b1c072e60 msgr2=0x7f8b1c159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.205+0000 7f8b24000640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b1c072e60 0x7f8b1c159300 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000c4a0 tx=0x7f8b1000c960 comp rx=0 tx=0).stop 2024-05-30T06:55:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.205+0000 7f8b24000640 1 -- 172.21.15.37:0/3279482001 shutdown_connections 2024-05-30T06:55:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.205+0000 7f8b24000640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8afc0697c0 0x7f8afc06bc80 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.205+0000 7f8b24000640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1c15f210 0x7f8b1c0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.205+0000 7f8b24000640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b1c15c890 0x7f8b1c0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.205+0000 7f8b24000640 1 --2- 172.21.15.37:0/3279482001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b1c072e60 0x7f8b1c159300 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.205+0000 7f8b24000640 1 -- 172.21.15.37:0/3279482001 >> 172.21.15.37:0/3279482001 conn(0x7f8b1c0b2ac0 msgr2=0x7f8b1c160e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.205+0000 7f8b24000640 1 -- 172.21.15.37:0/3279482001 shutdown_connections 2024-05-30T06:55:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.205+0000 7f8b24000640 1 -- 172.21.15.37:0/3279482001 wait complete. 2024-05-30T06:55:15.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T06:55:15.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.369+0000 7fe684200640 1 Processor -- start 2024-05-30T06:55:15.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.369+0000 7fe684200640 1 -- start start 2024-05-30T06:55:15.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.369+0000 7fe684200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe67c155da0 0x7fe67c0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:15.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.369+0000 7fe684200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe67c0cd440 0x7fe67c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:15.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.369+0000 7fe684200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe67c15f310 con 0x7fe67c06f5a0 2024-05-30T06:55:15.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.369+0000 7fe684200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe67c0b4760 con 0x7fe67c0cd440 2024-05-30T06:55:15.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.369+0000 7fe684200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe67c15f5f0 con 0x7fe67c155da0 2024-05-30T06:55:15.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.369+0000 7fe680e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe67c0cd440 0x7fe67c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:15.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.369+0000 7fe680e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe67c0cd440 0x7fe67c06f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42532/0 (socket says 172.21.15.37:42532) 2024-05-30T06:55:15.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.369+0000 7fe680e00640 1 -- 172.21.15.37:0/2772328147 learned_addr learned my addr 172.21.15.37:0/2772328147 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:15.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.369+0000 7fe681800640 1 --2- 172.21.15.37:0/2772328147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe67c155da0 0x7fe67c0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:15.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe680e00640 1 -- 172.21.15.37:0/2772328147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe67c155da0 msgr2=0x7fe67c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:15.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe680e00640 1 --2- 172.21.15.37:0/2772328147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe67c155da0 0x7fe67c0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe680e00640 1 -- 172.21.15.37:0/2772328147 >> v1:172.21.15.105:6789/0 conn(0x7fe67c06f5a0 legacy=0x7fe67c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:15.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe680e00640 1 -- 172.21.15.37:0/2772328147 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c15f8d0 con 0x7fe67c0cd440 2024-05-30T06:55:15.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe681800640 1 --2- 172.21.15.37:0/2772328147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe67c155da0 0x7fe67c0cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:15.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe680e00640 1 --2- 172.21.15.37:0/2772328147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67c0cd440 0x7fe67c06f060 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fe668009870 tx=0x7fe66801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f33d423ca8b8921 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:15.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe67be00640 1 -- 172.21.15.37:0/2772328147 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6680b0070 con 0x7fe67c0cd440 2024-05-30T06:55:15.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe67be00640 1 -- 172.21.15.37:0/2772328147 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6680a4e50 con 0x7fe67c0cd440 2024-05-30T06:55:15.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe67be00640 1 -- 172.21.15.37:0/2772328147 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6680ab820 con 0x7fe67c0cd440 2024-05-30T06:55:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe684200640 1 -- 172.21.15.37:0/2772328147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67c0cd440 msgr2=0x7fe67c06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe684200640 1 --2- 172.21.15.37:0/2772328147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67c0cd440 0x7fe67c06f060 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fe668009870 tx=0x7fe66801c400 comp rx=0 tx=0).stop 2024-05-30T06:55:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe684200640 1 -- 172.21.15.37:0/2772328147 shutdown_connections 2024-05-30T06:55:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe684200640 1 --2- 172.21.15.37:0/2772328147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67c0cd440 0x7fe67c06f060 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe684200640 1 --2- 172.21.15.37:0/2772328147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe67c155da0 0x7fe67c0cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe684200640 1 -- 172.21.15.37:0/2772328147 >> 172.21.15.37:0/2772328147 conn(0x7fe67c06bf60 msgr2=0x7fe67c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.373+0000 7fe684200640 1 -- 172.21.15.37:0/2772328147 shutdown_connections 2024-05-30T06:55:15.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe684200640 1 -- 172.21.15.37:0/2772328147 wait complete. 2024-05-30T06:55:15.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe684200640 1 Processor -- start 2024-05-30T06:55:15.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe684200640 1 -- start start 2024-05-30T06:55:15.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe684200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe67c06f5a0 0x7fe67c149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:15.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe684200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67c155da0 0x7fe67c1656a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:15.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe684200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe67c0afd20 0x7fe67c149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:15.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe684200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c168700 con 0x7fe67c155da0 2024-05-30T06:55:15.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe684200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c168580 con 0x7fe67c06f5a0 2024-05-30T06:55:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe684200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe67c168880 con 0x7fe67c0afd20 2024-05-30T06:55:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe680e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67c155da0 0x7fe67c1656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe680e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67c155da0 0x7fe67c1656a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42544/0 (socket says 172.21.15.37:42544) 2024-05-30T06:55:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe680e00640 1 -- 172.21.15.37:0/1025377221 learned_addr learned my addr 172.21.15.37:0/1025377221 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe681800640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe67c06f5a0 0x7fe67c149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe682200640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe67c0afd20 0x7fe67c149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe680e00640 1 -- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe67c0afd20 msgr2=0x7fe67c149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe680e00640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe67c0afd20 0x7fe67c149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe680e00640 1 -- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe67c06f5a0 msgr2=0x7fe67c149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe680e00640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe67c06f5a0 0x7fe67c149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe680e00640 1 -- 172.21.15.37:0/1025377221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c165be0 con 0x7fe67c155da0 2024-05-30T06:55:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe682200640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe67c0afd20 0x7fe67c149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe680e00640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67c155da0 0x7fe67c1656a0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fe6680ae040 tx=0x7fe66801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe679600640 1 -- 172.21.15.37:0/1025377221 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6680ba020 con 0x7fe67c155da0 2024-05-30T06:55:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe679600640 1 -- 172.21.15.37:0/1025377221 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6680b6420 con 0x7fe67c155da0 2024-05-30T06:55:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe679600640 1 -- 172.21.15.37:0/1025377221 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6680b0040 con 0x7fe67c155da0 2024-05-30T06:55:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.377+0000 7fe684200640 1 -- 172.21.15.37:0/1025377221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67c156430 con 0x7fe67c155da0 2024-05-30T06:55:15.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.381+0000 7fe684200640 1 -- 172.21.15.37:0/1025377221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67c1569f0 con 0x7fe67c155da0 2024-05-30T06:55:15.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.381+0000 7fe684200640 1 -- 172.21.15.37:0/1025377221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe67c068bc0 con 0x7fe67c155da0 2024-05-30T06:55:15.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.381+0000 7fe679600640 1 -- 172.21.15.37:0/1025377221 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7fe6680bd020 con 0x7fe67c155da0 2024-05-30T06:55:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.381+0000 7fe679600640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe65c0697f0 0x7fe65c06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.381+0000 7fe679600640 1 -- 172.21.15.37:0/1025377221 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7fe66811f880 con 0x7fe67c155da0 2024-05-30T06:55:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.381+0000 7fe681800640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe65c0697f0 0x7fe65c06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:15.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.385+0000 7fe681800640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe65c0697f0 0x7fe65c06bcb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe670006fd0 tx=0x7fe670008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.385+0000 7fe679600640 1 -- 172.21.15.37:0/1025377221 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe6680c4030 con 0x7fe67c155da0 2024-05-30T06:55:15.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.573+0000 7fe684200640 1 -- 172.21.15.37:0/1025377221 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fe67c0b6790 con 0x7fe65c0697f0 2024-05-30T06:55:15.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.593+0000 7fe679600640 1 -- 172.21.15.37:0/1025377221 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe67c0b6790 con 0x7fe65c0697f0 2024-05-30T06:55:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.597+0000 7fe684200640 1 -- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe65c0697f0 msgr2=0x7fe65c06bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.597+0000 7fe684200640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe65c0697f0 0x7fe65c06bcb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe670006fd0 tx=0x7fe670008040 comp rx=0 tx=0).stop 2024-05-30T06:55:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.597+0000 7fe684200640 1 -- 172.21.15.37:0/1025377221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67c155da0 msgr2=0x7fe67c1656a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.597+0000 7fe684200640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67c155da0 0x7fe67c1656a0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fe6680ae040 tx=0x7fe66801ac40 comp rx=0 tx=0).stop 2024-05-30T06:55:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.597+0000 7fe684200640 1 -- 172.21.15.37:0/1025377221 shutdown_connections 2024-05-30T06:55:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.597+0000 7fe684200640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe67c0afd20 0x7fe67c149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.597+0000 7fe684200640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67c155da0 0x7fe67c1656a0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.597+0000 7fe684200640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe65c0697f0 0x7fe65c06bcb0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.597+0000 7fe684200640 1 --2- 172.21.15.37:0/1025377221 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe67c06f5a0 0x7fe67c149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.597+0000 7fe684200640 1 -- 172.21.15.37:0/1025377221 >> 172.21.15.37:0/1025377221 conn(0x7fe67c06bf60 msgr2=0x7fe67c074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.597+0000 7fe684200640 1 -- 172.21.15.37:0/1025377221 shutdown_connections 2024-05-30T06:55:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.597+0000 7fe684200640 1 -- 172.21.15.37:0/1025377221 wait complete. 2024-05-30T06:55:15.601 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:15.604+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:15.601 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:15.604+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:15.602 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:15.604+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:15.602 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:15.604+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:15.602 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:15.604+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:15.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-05-30T06:55:15.619 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:15.620+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:15.620 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:15.620+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:15.620 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:15.620+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:15.620 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:15.620+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:15.620 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:15.620+0000 7f004f800640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:15.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.761+0000 7f6bcc000640 1 Processor -- start 2024-05-30T06:55:15.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.761+0000 7f6bcc000640 1 -- start start 2024-05-30T06:55:15.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bcc000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6bc40ced10 0x7f6bc406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:15.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bcc000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc415d4e0 0x7f6bc40b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:15.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bcc000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc415db00 con 0x7f6bc40b59d0 2024-05-30T06:55:15.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bcc000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6bc406df50 con 0x7f6bc40ced10 2024-05-30T06:55:15.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bcc000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc406e7d0 con 0x7f6bc415d4e0 2024-05-30T06:55:15.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bc9600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6bc40ced10 0x7f6bc406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:15.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bc9600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6bc40ced10 0x7f6bc406ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42548/0 (socket says 172.21.15.37:42548) 2024-05-30T06:55:15.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bc9600640 1 -- 172.21.15.37:0/638962829 learned_addr learned my addr 172.21.15.37:0/638962829 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:15.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bca000640 1 --2- 172.21.15.37:0/638962829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc415d4e0 0x7f6bc40b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:15.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bc9600640 1 -- 172.21.15.37:0/638962829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc415d4e0 msgr2=0x7f6bc40b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:15.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bc9600640 1 --2- 172.21.15.37:0/638962829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc415d4e0 0x7f6bc40b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bc9600640 1 -- 172.21.15.37:0/638962829 >> v1:172.21.15.105:6789/0 conn(0x7f6bc40b59d0 legacy=0x7f6bc415cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:15.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bc9600640 1 -- 172.21.15.37:0/638962829 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc406e180 con 0x7f6bc40ced10 2024-05-30T06:55:15.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.765+0000 7f6bc9600640 1 --2- 172.21.15.37:0/638962829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bc40ced10 0x7f6bc406ec60 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009870 tx=0x7f6bb801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2f004190ba47e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:15.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bc3e00640 1 -- 172.21.15.37:0/638962829 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80b2070 con 0x7f6bc40ced10 2024-05-30T06:55:15.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bc3e00640 1 -- 172.21.15.37:0/638962829 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb80a9070 con 0x7f6bc40ced10 2024-05-30T06:55:15.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bc3e00640 1 -- 172.21.15.37:0/638962829 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80ad880 con 0x7f6bc40ced10 2024-05-30T06:55:15.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 -- 172.21.15.37:0/638962829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bc40ced10 msgr2=0x7f6bc406ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:15.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 --2- 172.21.15.37:0/638962829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bc40ced10 0x7f6bc406ec60 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009870 tx=0x7f6bb801c560 comp rx=0 tx=0).stop 2024-05-30T06:55:15.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 -- 172.21.15.37:0/638962829 shutdown_connections 2024-05-30T06:55:15.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 --2- 172.21.15.37:0/638962829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc415d4e0 0x7f6bc40b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 --2- 172.21.15.37:0/638962829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bc40ced10 0x7f6bc406ec60 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 -- 172.21.15.37:0/638962829 >> 172.21.15.37:0/638962829 conn(0x7f6bc406bf60 msgr2=0x7f6bc40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:15.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 -- 172.21.15.37:0/638962829 shutdown_connections 2024-05-30T06:55:15.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 -- 172.21.15.37:0/638962829 wait complete. 2024-05-30T06:55:15.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 Processor -- start 2024-05-30T06:55:15.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 -- start start 2024-05-30T06:55:15.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bc40b59d0 0x7f6bc41525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:15.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc40ced10 0x7f6bc413ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:15.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bc415d4e0 0x7f6bc41fb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:15.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc415ead0 con 0x7f6bc40b59d0 2024-05-30T06:55:15.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc415e950 con 0x7f6bc415d4e0 2024-05-30T06:55:15.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bcc000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc4169450 con 0x7f6bc40ced10 2024-05-30T06:55:15.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bc9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bc40b59d0 0x7f6bc41525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:15.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bc9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bc40b59d0 0x7f6bc41525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42554/0 (socket says 172.21.15.37:42554) 2024-05-30T06:55:15.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bc9600640 1 -- 172.21.15.37:0/1120105147 learned_addr learned my addr 172.21.15.37:0/1120105147 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:15.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bca000640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bc415d4e0 0x7f6bc41fb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:15.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.769+0000 7f6bc8c00640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc40ced10 0x7f6bc413ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:15.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.773+0000 7f6bc9600640 1 -- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc40ced10 msgr2=0x7f6bc413ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:15.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.773+0000 7f6bc9600640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc40ced10 0x7f6bc413ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.773+0000 7f6bc9600640 1 -- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bc415d4e0 msgr2=0x7f6bc41fb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:15.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.773+0000 7f6bc9600640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bc415d4e0 0x7f6bc41fb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:15.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.773+0000 7f6bc9600640 1 -- 172.21.15.37:0/1120105147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc413f320 con 0x7f6bc40b59d0 2024-05-30T06:55:15.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.773+0000 7f6bc9600640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bc40b59d0 0x7f6bc41525a0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80b0040 tx=0x7f6bb801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:15.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.773+0000 7f6bc1600640 1 -- 172.21.15.37:0/1120105147 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80b2040 con 0x7f6bc40b59d0 2024-05-30T06:55:15.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.773+0000 7f6bc1600640 1 -- 172.21.15.37:0/1120105147 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb80be070 con 0x7f6bc40b59d0 2024-05-30T06:55:15.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.773+0000 7f6bcc000640 1 -- 172.21.15.37:0/1120105147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc4152c30 con 0x7f6bc40b59d0 2024-05-30T06:55:15.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.773+0000 7f6bc1600640 1 -- 172.21.15.37:0/1120105147 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80b8420 con 0x7f6bc40b59d0 2024-05-30T06:55:15.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.773+0000 7f6bcc000640 1 -- 172.21.15.37:0/1120105147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc40b5320 con 0x7f6bc40b59d0 2024-05-30T06:55:15.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.773+0000 7f6bcc000640 1 -- 172.21.15.37:0/1120105147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc4068d40 con 0x7f6bc40b59d0 2024-05-30T06:55:15.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.773+0000 7f6bc1600640 1 -- 172.21.15.37:0/1120105147 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7f6bb80ab070 con 0x7f6bc40b59d0 2024-05-30T06:55:15.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.777+0000 7f6bc1600640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ba40697f0 0x7f6ba406bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:15.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.777+0000 7f6bc1600640 1 -- 172.21.15.37:0/1120105147 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5766+0+0 (secure 0 0 0) 0x7f6bb811f870 con 0x7f6bc40b59d0 2024-05-30T06:55:15.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.777+0000 7f6bc8c00640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ba40697f0 0x7f6ba406bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:15.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.777+0000 7f6bc8c00640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ba40697f0 0x7f6ba406bcb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40af7a0 tx=0x7f6bb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:15.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.781+0000 7f6bc1600640 1 -- 172.21.15.37:0/1120105147 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6bb8016150 con 0x7f6bc40b59d0 2024-05-30T06:55:15.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.977+0000 7f6bcc000640 1 -- 172.21.15.37:0/1120105147 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f6bc415f0d0 con 0x7f6ba40697f0 2024-05-30T06:55:16.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:15.997+0000 7f6bc1600640 1 -- 172.21.15.37:0/1120105147 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6bc415f0d0 con 0x7f6ba40697f0 2024-05-30T06:55:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.001+0000 7f6bcc000640 1 -- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ba40697f0 msgr2=0x7f6ba406bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.001+0000 7f6bcc000640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ba40697f0 0x7f6ba406bcb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40af7a0 tx=0x7f6bb0009040 comp rx=0 tx=0).stop 2024-05-30T06:55:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.001+0000 7f6bcc000640 1 -- 172.21.15.37:0/1120105147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bc40b59d0 msgr2=0x7f6bc41525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.001+0000 7f6bcc000640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bc40b59d0 0x7f6bc41525a0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80b0040 tx=0x7f6bb801ada0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.001+0000 7f6bcc000640 1 -- 172.21.15.37:0/1120105147 shutdown_connections 2024-05-30T06:55:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.001+0000 7f6bcc000640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6ba40697f0 0x7f6ba406bcb0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.001+0000 7f6bcc000640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bc415d4e0 0x7f6bc41fb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.001+0000 7f6bcc000640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc40ced10 0x7f6bc413ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.001+0000 7f6bcc000640 1 --2- 172.21.15.37:0/1120105147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bc40b59d0 0x7f6bc41525a0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.001+0000 7f6bcc000640 1 -- 172.21.15.37:0/1120105147 >> 172.21.15.37:0/1120105147 conn(0x7f6bc406bf60 msgr2=0x7f6bc415f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.001+0000 7f6bcc000640 1 -- 172.21.15.37:0/1120105147 shutdown_connections 2024-05-30T06:55:16.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.001+0000 7f6bcc000640 1 -- 172.21.15.37:0/1120105147 wait complete. 2024-05-30T06:55:16.023 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T06:55:16.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:55:16.079 INFO:teuthology.orchestra.run.smithi037.stdout:2 2024-05-30T06:55:16.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:55:16.086 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:55:16.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:55:16.148 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:55:16.195 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:55:16.195 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:55:16.195 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:55:16.195 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:55:16.204 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:55:16.204 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:55:16.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:55:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d29a00640 1 Processor -- start 2024-05-30T06:55:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d29a00640 1 -- start start 2024-05-30T06:55:16.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d29a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9d2406b960 0x7f9d2406bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d29a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d24070e80 0x7f9d24162b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d29a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d2406c280 con 0x7f9d24070a20 2024-05-30T06:55:16.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d29a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9d2415fc90 con 0x7f9d2406b960 2024-05-30T06:55:16.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d29a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9d2415f080 con 0x7f9d24070e80 2024-05-30T06:55:16.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d22000640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f9d24070a20 0x7f9d24162460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:53572/0 (socket says 172.21.15.37:53572) 2024-05-30T06:55:16.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d22a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9d2406b960 0x7f9d2406bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d22000640 1 -- 172.21.15.37:0/3215393314 learned_addr learned my addr 172.21.15.37:0/3215393314 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:16.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d23400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d24070e80 0x7f9d24162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d21600640 1 -- 172.21.15.37:0/3215393314 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1844441861 0 0) 0x7f9d2406c280 con 0x7f9d24070a20 2024-05-30T06:55:16.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d23400640 1 -- 172.21.15.37:0/3215393314 >> v2:172.21.15.105:3300/0 conn(0x7f9d2406b960 msgr2=0x7f9d2406bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:16.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d23400640 1 --2- 172.21.15.37:0/3215393314 >> v2:172.21.15.105:3300/0 conn(0x7f9d2406b960 0x7f9d2406bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d23400640 1 -- 172.21.15.37:0/3215393314 >> v1:172.21.15.105:6789/0 conn(0x7f9d24070a20 legacy=0x7f9d24162460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.445+0000 7f9d23400640 1 -- 172.21.15.37:0/3215393314 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2415f360 con 0x7f9d24070e80 2024-05-30T06:55:16.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.449+0000 7f9d23400640 1 --2- 172.21.15.37:0/3215393314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d24070e80 0x7f9d24162b70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009d90 tx=0x7f9d1c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c53318aa2688d04 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:16.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.449+0000 7f9d21600640 1 -- 172.21.15.37:0/3215393314 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0b2070 con 0x7f9d24070e80 2024-05-30T06:55:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.449+0000 7f9d21600640 1 -- 172.21.15.37:0/3215393314 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1c0a5920 con 0x7f9d24070e80 2024-05-30T06:55:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.449+0000 7f9d21600640 1 -- 172.21.15.37:0/3215393314 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0a5cf0 con 0x7f9d24070e80 2024-05-30T06:55:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.449+0000 7f9d29a00640 1 -- 172.21.15.37:0/3215393314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d24070e80 msgr2=0x7f9d24162b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.449+0000 7f9d29a00640 1 --2- 172.21.15.37:0/3215393314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d24070e80 0x7f9d24162b70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009d90 tx=0x7f9d1c01c970 comp rx=0 tx=0).stop 2024-05-30T06:55:16.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.449+0000 7f9d29a00640 1 -- 172.21.15.37:0/3215393314 shutdown_connections 2024-05-30T06:55:16.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.449+0000 7f9d29a00640 1 --2- 172.21.15.37:0/3215393314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d24070e80 0x7f9d24162b70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.449+0000 7f9d29a00640 1 --2- 172.21.15.37:0/3215393314 >> v2:172.21.15.105:3300/0 conn(0x7f9d2406b960 0x7f9d2406bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.449+0000 7f9d29a00640 1 -- 172.21.15.37:0/3215393314 >> 172.21.15.37:0/3215393314 conn(0x7f9d240b6a60 msgr2=0x7f9d240b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:16.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.449+0000 7f9d29a00640 1 -- 172.21.15.37:0/3215393314 shutdown_connections 2024-05-30T06:55:16.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.449+0000 7f9d29a00640 1 -- 172.21.15.37:0/3215393314 wait complete. 2024-05-30T06:55:16.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d29a00640 1 Processor -- start 2024-05-30T06:55:16.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d29a00640 1 -- start start 2024-05-30T06:55:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d29a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d2406b960 0x7f9d24137c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d29a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d24070a20 0x7f9d24143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d29a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d24070e80 0x7f9d2415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d29a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2415c800 con 0x7f9d2406b960 2024-05-30T06:55:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d29a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2415c680 con 0x7f9d24070a20 2024-05-30T06:55:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d29a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9d2415ff80 con 0x7f9d24070e80 2024-05-30T06:55:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d22a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d2406b960 0x7f9d24137c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d22a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d2406b960 0x7f9d24137c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42558/0 (socket says 172.21.15.37:42558) 2024-05-30T06:55:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d22a00640 1 -- 172.21.15.37:0/4265556129 learned_addr learned my addr 172.21.15.37:0/4265556129 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d23400640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d24070e80 0x7f9d2415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d22000640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d24070a20 0x7f9d24143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d22a00640 1 -- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d24070e80 msgr2=0x7f9d2415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d22a00640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d24070e80 0x7f9d2415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d22a00640 1 -- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d24070a20 msgr2=0x7f9d24143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d22a00640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d24070a20 0x7f9d24143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d22a00640 1 -- 172.21.15.37:0/4265556129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d240706b0 con 0x7f9d2406b960 2024-05-30T06:55:16.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d22a00640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d2406b960 0x7f9d24137c90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400e8a0 tx=0x7f9d1400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:16.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d1aa00640 1 -- 172.21.15.37:0/4265556129 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14017070 con 0x7f9d2406b960 2024-05-30T06:55:16.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d1aa00640 1 -- 172.21.15.37:0/4265556129 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1400c940 con 0x7f9d2406b960 2024-05-30T06:55:16.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d29a00640 1 -- 172.21.15.37:0/4265556129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d241405a0 con 0x7f9d2406b960 2024-05-30T06:55:16.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d1aa00640 1 -- 172.21.15.37:0/4265556129 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400cd10 con 0x7f9d2406b960 2024-05-30T06:55:16.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d29a00640 1 -- 172.21.15.37:0/4265556129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d24140b60 con 0x7f9d2406b960 2024-05-30T06:55:16.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.453+0000 7f9d29a00640 1 -- 172.21.15.37:0/4265556129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d24068b20 con 0x7f9d2406b960 2024-05-30T06:55:16.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.457+0000 7f9d1aa00640 1 -- 172.21.15.37:0/4265556129 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7f9d1401a070 con 0x7f9d2406b960 2024-05-30T06:55:16.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.457+0000 7f9d1aa00640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9d040697c0 0x7f9d0406bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.457+0000 7f9d1aa00640 1 -- 172.21.15.37:0/4265556129 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7f9d14085c50 con 0x7f9d2406b960 2024-05-30T06:55:16.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.457+0000 7f9d22000640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9d040697c0 0x7f9d0406bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.457+0000 7f9d22000640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9d040697c0 0x7f9d0406bc80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9d240b0010 tx=0x7f9d10007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:16.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.461+0000 7f9d1aa00640 1 -- 172.21.15.37:0/4265556129 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9d14057240 con 0x7f9d2406b960 2024-05-30T06:55:16.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.625+0000 7f9d29a00640 1 -- 172.21.15.37:0/4265556129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d240b08c0 con 0x7f9d2406b960 2024-05-30T06:55:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.625+0000 7f9d1aa00640 1 -- 172.21.15.37:0/4265556129 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+16852 (secure 0 0 0) 0x7f9d1405b540 con 0x7f9d2406b960 2024-05-30T06:55:16.629 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:16.629 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":91,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:55:15.795724+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:53:42.973928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-05-30T06:53:43.524517+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:55:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.629+0000 7f9d29a00640 1 -- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9d040697c0 msgr2=0x7f9d0406bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.629+0000 7f9d29a00640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9d040697c0 0x7f9d0406bc80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9d240b0010 tx=0x7f9d10007df0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.629+0000 7f9d29a00640 1 -- 172.21.15.37:0/4265556129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d2406b960 msgr2=0x7f9d24137c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.629+0000 7f9d29a00640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d2406b960 0x7f9d24137c90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400e8a0 tx=0x7f9d1400ed60 comp rx=0 tx=0).stop 2024-05-30T06:55:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.629+0000 7f9d29a00640 1 -- 172.21.15.37:0/4265556129 shutdown_connections 2024-05-30T06:55:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.629+0000 7f9d29a00640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d24070e80 0x7f9d2415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.629+0000 7f9d29a00640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9d040697c0 0x7f9d0406bc80 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.629+0000 7f9d29a00640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d24070a20 0x7f9d24143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.629+0000 7f9d29a00640 1 --2- 172.21.15.37:0/4265556129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d2406b960 0x7f9d24137c90 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.629+0000 7f9d29a00640 1 -- 172.21.15.37:0/4265556129 >> 172.21.15.37:0/4265556129 conn(0x7f9d240b6a60 msgr2=0x7f9d240b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.629+0000 7f9d29a00640 1 -- 172.21.15.37:0/4265556129 shutdown_connections 2024-05-30T06:55:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.629+0000 7f9d29a00640 1 -- 172.21.15.37:0/4265556129 wait complete. 2024-05-30T06:55:16.650 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:53:42.973928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:53:43.524517+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:55:16.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:55:16.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3eaa00640 1 Processor -- start 2024-05-30T06:55:16.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3eaa00640 1 -- start start 2024-05-30T06:55:16.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3eaa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e415d350 0x7fc3e406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3eaa00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc3e415d7b0 0x7fc3e406e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3eaa00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e4142030 con 0x7fc3e40b59d0 2024-05-30T06:55:16.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3eaa00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc3e4142310 con 0x7fc3e415d7b0 2024-05-30T06:55:16.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3eaa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e41425f0 con 0x7fc3e415d350 2024-05-30T06:55:16.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc3e40b59d0 0x7fc3e40b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41778/0 (socket says 172.21.15.37:41778) 2024-05-30T06:55:16.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3e00640 1 -- 172.21.15.37:0/4020558774 learned_addr learned my addr 172.21.15.37:0/4020558774 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3db400640 1 --2- 172.21.15.37:0/4020558774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e415d350 0x7fc3e406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3430854235 0 0) 0x7fc3e4142030 con 0x7fc3e40b59d0 2024-05-30T06:55:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e8a00640 1 --2- 172.21.15.37:0/4020558774 >> v2:172.21.15.105:3300/0 conn(0x7fc3e415d7b0 0x7fc3e406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3c8003530 con 0x7fc3e40b59d0 2024-05-30T06:55:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 863808580 0 0) 0x7fc3c8003530 con 0x7fc3e40b59d0 2024-05-30T06:55:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e415d350 msgr2=0x7fc3e406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 --2- 172.21.15.37:0/4020558774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e415d350 0x7fc3e406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 >> v2:172.21.15.105:3300/0 conn(0x7fc3e415d7b0 msgr2=0x7fc3e406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 --2- 172.21.15.37:0/4020558774 >> v2:172.21.15.105:3300/0 conn(0x7fc3e415d7b0 0x7fc3e406e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e41428d0 con 0x7fc3e40b59d0 2024-05-30T06:55:16.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fc3d4001a00 con 0x7fc3e40b59d0 2024-05-30T06:55:16.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 >> v1:172.21.15.37:6789/0 conn(0x7fc3e40b59d0 legacy=0x7fc3e40b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 --2- 172.21.15.37:0/4020558774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80039c0 0x7fc3c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 --2- 172.21.15.37:0/4020558774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e415d350 0x7fc3c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 --2- 172.21.15.37:0/4020558774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c8004d50 0x7fc3c80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e4142310 con 0x7fc3c80039c0 2024-05-30T06:55:16.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e41425f0 con 0x7fc3c8004d50 2024-05-30T06:55:16.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.793+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c800b9d0 con 0x7fc3e415d350 2024-05-30T06:55:16.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.797+0000 7fc3e3e00640 1 --2- 172.21.15.37:0/4020558774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80039c0 0x7fc3c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.797+0000 7fc3e8a00640 1 --2- 172.21.15.37:0/4020558774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c8004d50 0x7fc3c80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.797+0000 7fc3db400640 1 --2- 172.21.15.37:0/4020558774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e415d350 0x7fc3c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.797+0000 7fc3e3e00640 1 -- 172.21.15.37:0/4020558774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e415d350 msgr2=0x7fc3c8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:16.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.797+0000 7fc3e3e00640 1 --2- 172.21.15.37:0/4020558774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e415d350 0x7fc3c8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.797+0000 7fc3e3e00640 1 -- 172.21.15.37:0/4020558774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c8004d50 msgr2=0x7fc3c80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:16.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.797+0000 7fc3e3e00640 1 --2- 172.21.15.37:0/4020558774 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c8004d50 0x7fc3c80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.797+0000 7fc3e3e00640 1 -- 172.21.15.37:0/4020558774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c8003530 con 0x7fc3c80039c0 2024-05-30T06:55:16.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.797+0000 7fc3e3e00640 1 --2- 172.21.15.37:0/4020558774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80039c0 0x7fc3c8003de0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400a8a0 tx=0x7fc3d401fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80b38879130d6f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:16.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.797+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400a4c0 con 0x7fc3c80039c0 2024-05-30T06:55:16.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.797+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d40ad020 con 0x7fc3c80039c0 2024-05-30T06:55:16.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.797+0000 7fc3e3400640 1 -- 172.21.15.37:0/4020558774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40a9740 con 0x7fc3c80039c0 2024-05-30T06:55:16.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 -- 172.21.15.37:0/4020558774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80039c0 msgr2=0x7fc3c8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 --2- 172.21.15.37:0/4020558774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80039c0 0x7fc3c8003de0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400a8a0 tx=0x7fc3d401fb20 comp rx=0 tx=0).stop 2024-05-30T06:55:16.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3e8a00640 1 -- 172.21.15.37:0/4020558774 reap_dead start 2024-05-30T06:55:16.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 -- 172.21.15.37:0/4020558774 shutdown_connections 2024-05-30T06:55:16.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 -- 172.21.15.37:0/4020558774 >> 172.21.15.37:0/4020558774 conn(0x7fc3e406bf60 msgr2=0x7fc3e40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:16.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 -- 172.21.15.37:0/4020558774 shutdown_connections 2024-05-30T06:55:16.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 -- 172.21.15.37:0/4020558774 wait complete. 2024-05-30T06:55:16.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 Processor -- start 2024-05-30T06:55:16.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 -- start start 2024-05-30T06:55:16.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80039c0 0x7fc3e413cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e4137070 0x7fc3e40b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3e413ac20 0x7fc3e415ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e40b00a0 con 0x7fc3c80039c0 2024-05-30T06:55:16.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e40aff20 con 0x7fc3e413ac20 2024-05-30T06:55:16.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3eaa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e413f860 con 0x7fc3e4137070 2024-05-30T06:55:16.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3e3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80039c0 0x7fc3e413cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3e3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80039c0 0x7fc3e413cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42570/0 (socket says 172.21.15.37:42570) 2024-05-30T06:55:16.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3e3e00640 1 -- 172.21.15.37:0/3790467378 learned_addr learned my addr 172.21.15.37:0/3790467378 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:16.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3db400640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e4137070 0x7fc3e40b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3e8a00640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3e413ac20 0x7fc3e415ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3e3e00640 1 -- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e4137070 msgr2=0x7fc3e40b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3e3e00640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e4137070 0x7fc3e40b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3e3e00640 1 -- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3e413ac20 msgr2=0x7fc3e415ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3e3e00640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3e413ac20 0x7fc3e415ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3e3e00640 1 -- 172.21.15.37:0/3790467378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e40aef10 con 0x7fc3c80039c0 2024-05-30T06:55:16.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3db400640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e4137070 0x7fc3e40b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:16.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.801+0000 7fc3e8a00640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3e413ac20 0x7fc3e415ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.805+0000 7fc3e3e00640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80039c0 0x7fc3e413cae0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400a8a0 tx=0x7fc3c8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.805+0000 7fc3e0c00640 1 -- 172.21.15.37:0/3790467378 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4004d70 con 0x7fc3c80039c0 2024-05-30T06:55:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.805+0000 7fc3e0c00640 1 -- 172.21.15.37:0/3790467378 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d40a9540 con 0x7fc3c80039c0 2024-05-30T06:55:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.805+0000 7fc3e0c00640 1 -- 172.21.15.37:0/3790467378 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40a98f0 con 0x7fc3c80039c0 2024-05-30T06:55:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.805+0000 7fc3eaa00640 1 -- 172.21.15.37:0/3790467378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e40af1f0 con 0x7fc3c80039c0 2024-05-30T06:55:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.805+0000 7fc3eaa00640 1 -- 172.21.15.37:0/3790467378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e413b0a0 con 0x7fc3c80039c0 2024-05-30T06:55:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.805+0000 7fc3eaa00640 1 -- 172.21.15.37:0/3790467378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e4068bc0 con 0x7fc3c80039c0 2024-05-30T06:55:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.805+0000 7fc3e0c00640 1 -- 172.21.15.37:0/3790467378 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7fc3d40a9a90 con 0x7fc3c80039c0 2024-05-30T06:55:16.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.805+0000 7fc3e0c00640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc3c00697f0 0x7fc3c006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:16.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.805+0000 7fc3e0c00640 1 -- 172.21.15.37:0/3790467378 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7fc3d4122df0 con 0x7fc3c80039c0 2024-05-30T06:55:16.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.805+0000 7fc3db400640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc3c00697f0 0x7fc3c006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:16.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.809+0000 7fc3db400640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc3c00697f0 0x7fc3c006bcb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4072c70 tx=0x7fc3cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:16.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.809+0000 7fc3e0c00640 1 -- 172.21.15.37:0/3790467378 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc3d4019830 con 0x7fc3c80039c0 2024-05-30T06:55:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.977+0000 7fc3eaa00640 1 -- 172.21.15.37:0/3790467378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc3e40b4370 con 0x7fc3c80039c0 2024-05-30T06:55:16.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.977+0000 7fc3e0c00640 1 -- 172.21.15.37:0/3790467378 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7fc3d40f4e60 con 0x7fc3c80039c0 2024-05-30T06:55:16.979 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:55:16.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.977+0000 7fc3eaa00640 1 -- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc3c00697f0 msgr2=0x7fc3c006bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.977+0000 7fc3eaa00640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc3c00697f0 0x7fc3c006bcb0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4072c70 tx=0x7fc3cc008040 comp rx=0 tx=0).stop 2024-05-30T06:55:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.977+0000 7fc3eaa00640 1 -- 172.21.15.37:0/3790467378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80039c0 msgr2=0x7fc3e413cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.977+0000 7fc3eaa00640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80039c0 0x7fc3e413cae0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400a8a0 tx=0x7fc3c8005840 comp rx=0 tx=0).stop 2024-05-30T06:55:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.977+0000 7fc3eaa00640 1 -- 172.21.15.37:0/3790467378 shutdown_connections 2024-05-30T06:55:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.977+0000 7fc3eaa00640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc3c00697f0 0x7fc3c006bcb0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.977+0000 7fc3eaa00640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3e413ac20 0x7fc3e415ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.977+0000 7fc3eaa00640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3e4137070 0x7fc3e40b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.977+0000 7fc3eaa00640 1 --2- 172.21.15.37:0/3790467378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3c80039c0 0x7fc3e413cae0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.977+0000 7fc3eaa00640 1 -- 172.21.15.37:0/3790467378 >> 172.21.15.37:0/3790467378 conn(0x7fc3e406bf60 msgr2=0x7fc3e40b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.981+0000 7fc3eaa00640 1 -- 172.21.15.37:0/3790467378 shutdown_connections 2024-05-30T06:55:16.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:16.981+0000 7fc3eaa00640 1 -- 172.21.15.37:0/3790467378 wait complete. 2024-05-30T06:55:17.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:55:17.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.141+0000 7fa1e5a00640 1 Processor -- start 2024-05-30T06:55:17.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.141+0000 7fa1e5a00640 1 -- start start 2024-05-30T06:55:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.141+0000 7fa1e5a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1e015c890 0x7fa1e0162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.141+0000 7fa1e5a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e0072e60 0x7fa1e006c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.141+0000 7fa1e5a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e0163020 con 0x7fa1e015f210 2024-05-30T06:55:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.141+0000 7fa1e5a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e0163300 con 0x7fa1e015c890 2024-05-30T06:55:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.141+0000 7fa1e5a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e01635e0 con 0x7fa1e0072e60 2024-05-30T06:55:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.145+0000 7fa1dea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1e015c890 0x7fa1e0162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.145+0000 7fa1dea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1e015c890 0x7fa1e0162720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42584/0 (socket says 172.21.15.37:42584) 2024-05-30T06:55:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.145+0000 7fa1dea00640 1 -- 172.21.15.37:0/2032789271 learned_addr learned my addr 172.21.15.37:0/2032789271 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:17.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.145+0000 7fa1df400640 1 --2- 172.21.15.37:0/2032789271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e0072e60 0x7fa1e006c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.145+0000 7fa1dea00640 1 -- 172.21.15.37:0/2032789271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e0072e60 msgr2=0x7fa1e006c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:17.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.145+0000 7fa1dea00640 1 --2- 172.21.15.37:0/2032789271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e0072e60 0x7fa1e006c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.145+0000 7fa1dea00640 1 -- 172.21.15.37:0/2032789271 >> v1:172.21.15.105:6789/0 conn(0x7fa1e015f210 legacy=0x7fa1e0072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.145+0000 7fa1dea00640 1 -- 172.21.15.37:0/2032789271 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e006ba00 con 0x7fa1e015c890 2024-05-30T06:55:17.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.145+0000 7fa1df400640 1 --2- 172.21.15.37:0/2032789271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e0072e60 0x7fa1e006c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:17.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.145+0000 7fa1dea00640 1 --2- 172.21.15.37:0/2032789271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e015c890 0x7fa1e0162720 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009e50 tx=0x7fa1d001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b1e7c9b10adaa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.145+0000 7fa1de000640 1 -- 172.21.15.37:0/2032789271 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00090d0 con 0x7fa1e015c890 2024-05-30T06:55:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.145+0000 7fa1de000640 1 -- 172.21.15.37:0/2032789271 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d00a5660 con 0x7fa1e015c890 2024-05-30T06:55:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.145+0000 7fa1de000640 1 -- 172.21.15.37:0/2032789271 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0009270 con 0x7fa1e015c890 2024-05-30T06:55:17.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 -- 172.21.15.37:0/2032789271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e015c890 msgr2=0x7fa1e0162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 --2- 172.21.15.37:0/2032789271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e015c890 0x7fa1e0162720 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009e50 tx=0x7fa1d001c9a0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 -- 172.21.15.37:0/2032789271 shutdown_connections 2024-05-30T06:55:17.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 --2- 172.21.15.37:0/2032789271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e0072e60 0x7fa1e006c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 --2- 172.21.15.37:0/2032789271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e015c890 0x7fa1e0162720 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 -- 172.21.15.37:0/2032789271 >> 172.21.15.37:0/2032789271 conn(0x7fa1e00b2ac0 msgr2=0x7fa1e00b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:17.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 -- 172.21.15.37:0/2032789271 shutdown_connections 2024-05-30T06:55:17.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 -- 172.21.15.37:0/2032789271 wait complete. 2024-05-30T06:55:17.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 Processor -- start 2024-05-30T06:55:17.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 -- start start 2024-05-30T06:55:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e0072e60 0x7fa1e00b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e015c890 0x7fa1e0156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1e015f210 0x7fa1e0157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e016be50 con 0x7fa1e015c890 2024-05-30T06:55:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e016bcd0 con 0x7fa1e015f210 2024-05-30T06:55:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1e5a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e016bfd0 con 0x7fa1e0072e60 2024-05-30T06:55:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1d6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e015c890 0x7fa1e0156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1d6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e015c890 0x7fa1e0156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42596/0 (socket says 172.21.15.37:42596) 2024-05-30T06:55:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1d6000640 1 -- 172.21.15.37:0/3724771482 learned_addr learned my addr 172.21.15.37:0/3724771482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1dea00640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e0072e60 0x7fa1e00b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1df400640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1e015f210 0x7fa1e0157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1d6000640 1 -- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e0072e60 msgr2=0x7fa1e00b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1d6000640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e0072e60 0x7fa1e00b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1d6000640 1 -- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1e015f210 msgr2=0x7fa1e0157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1d6000640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1e015f210 0x7fa1e0157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1d6000640 1 -- 172.21.15.37:0/3724771482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e01f7ed0 con 0x7fa1e015c890 2024-05-30T06:55:17.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.149+0000 7fa1df400640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1e015f210 0x7fa1e0157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:17.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.153+0000 7fa1d6000640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e015c890 0x7fa1e0156190 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c3a0 tx=0x7fa1c800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:17.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.153+0000 7fa1d7400640 1 -- 172.21.15.37:0/3724771482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c80052d0 con 0x7fa1e015c890 2024-05-30T06:55:17.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.153+0000 7fa1d7400640 1 -- 172.21.15.37:0/3724771482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c8005470 con 0x7fa1e015c890 2024-05-30T06:55:17.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.153+0000 7fa1d7400640 1 -- 172.21.15.37:0/3724771482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8007260 con 0x7fa1e015c890 2024-05-30T06:55:17.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.153+0000 7fa1e5a00640 1 -- 172.21.15.37:0/3724771482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e00b3df0 con 0x7fa1e015c890 2024-05-30T06:55:17.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.153+0000 7fa1e5a00640 1 -- 172.21.15.37:0/3724771482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e00b4370 con 0x7fa1e015c890 2024-05-30T06:55:17.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.153+0000 7fa1e5a00640 1 -- 172.21.15.37:0/3724771482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e0068bc0 con 0x7fa1e015c890 2024-05-30T06:55:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.153+0000 7fa1d7400640 1 -- 172.21.15.37:0/3724771482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7fa1c8007400 con 0x7fa1e015c890 2024-05-30T06:55:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.153+0000 7fa1d7400640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1bc0697f0 0x7fa1bc06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.153+0000 7fa1d7400640 1 -- 172.21.15.37:0/3724771482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7fa1c8084e60 con 0x7fa1e015c890 2024-05-30T06:55:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.153+0000 7fa1dea00640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1bc0697f0 0x7fa1bc06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.157+0000 7fa1dea00640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1bc0697f0 0x7fa1bc06bcb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00ae000 tx=0x7fa1d00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:17.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.157+0000 7fa1d7400640 1 -- 172.21.15.37:0/3724771482 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa1e01f7ed0 con 0x7fa1e015c890 2024-05-30T06:55:17.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.321+0000 7fa1e5a00640 1 -- 172.21.15.37:0/3724771482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa1e0067d90 con 0x7fa1e015c890 2024-05-30T06:55:17.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.321+0000 7fa1d7400640 1 -- 172.21.15.37:0/3724771482 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7fa1c8056450 con 0x7fa1e015c890 2024-05-30T06:55:17.324 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:55:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.325+0000 7fa1e5a00640 1 -- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1bc0697f0 msgr2=0x7fa1bc06bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.325+0000 7fa1e5a00640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1bc0697f0 0x7fa1bc06bcb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa1d00ae000 tx=0x7fa1d00a7070 comp rx=0 tx=0).stop 2024-05-30T06:55:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.325+0000 7fa1e5a00640 1 -- 172.21.15.37:0/3724771482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e015c890 msgr2=0x7fa1e0156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.325+0000 7fa1e5a00640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e015c890 0x7fa1e0156190 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800c3a0 tx=0x7fa1c800c860 comp rx=0 tx=0).stop 2024-05-30T06:55:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.325+0000 7fa1e5a00640 1 -- 172.21.15.37:0/3724771482 shutdown_connections 2024-05-30T06:55:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.325+0000 7fa1e5a00640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1bc0697f0 0x7fa1bc06bcb0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.325+0000 7fa1e5a00640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1e015f210 0x7fa1e0157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.325+0000 7fa1e5a00640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1e015c890 0x7fa1e0156190 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.325+0000 7fa1e5a00640 1 --2- 172.21.15.37:0/3724771482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1e0072e60 0x7fa1e00b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.325+0000 7fa1e5a00640 1 -- 172.21.15.37:0/3724771482 >> 172.21.15.37:0/3724771482 conn(0x7fa1e00b2ac0 msgr2=0x7fa1e00cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.325+0000 7fa1e5a00640 1 -- 172.21.15.37:0/3724771482 shutdown_connections 2024-05-30T06:55:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.325+0000 7fa1e5a00640 1 -- 172.21.15.37:0/3724771482 wait complete. 2024-05-30T06:55:17.345 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:55:17.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.485+0000 7f9a20c00640 1 Processor -- start 2024-05-30T06:55:17.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.485+0000 7f9a20c00640 1 -- start start 2024-05-30T06:55:17.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a20c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a1c155da0 0x7f9a1c0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a20c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9a1c0cd440 0x7f9a1c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a20c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a1c15f310 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a20c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9a1c0b4760 con 0x7f9a1c0cd440 2024-05-30T06:55:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a20c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1c15f5f0 con 0x7f9a1c155da0 2024-05-30T06:55:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a1a800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9a1c06f5a0 0x7f9a1c0cf4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43880/0 (socket says 172.21.15.37:43880) 2024-05-30T06:55:17.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a1a800640 1 -- 172.21.15.37:0/471807847 learned_addr learned my addr 172.21.15.37:0/471807847 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a13e00640 1 --2- 172.21.15.37:0/471807847 >> v2:172.21.15.105:3300/0 conn(0x7f9a1c0cd440 0x7f9a1c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a19e00640 1 --2- 172.21.15.37:0/471807847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a1c155da0 0x7f9a1c0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a19400640 1 -- 172.21.15.37:0/471807847 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 11138125 0 0) 0x7f9a1c15f310 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a19400640 1 -- 172.21.15.37:0/471807847 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a00003530 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a13e00640 1 -- 172.21.15.37:0/471807847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a1c155da0 msgr2=0x7f9a1c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a13e00640 1 --2- 172.21.15.37:0/471807847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a1c155da0 0x7f9a1c0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a13e00640 1 -- 172.21.15.37:0/471807847 >> v1:172.21.15.37:6789/0 conn(0x7f9a1c06f5a0 legacy=0x7f9a1c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.489+0000 7f9a13e00640 1 -- 172.21.15.37:0/471807847 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c15f8d0 con 0x7f9a1c0cd440 2024-05-30T06:55:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a13e00640 1 --2- 172.21.15.37:0/471807847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c0cd440 0x7f9a1c06f060 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9a040097c0 tx=0x7f9a0401c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39b959a88875e2b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:17.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a19400640 1 -- 172.21.15.37:0/471807847 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a040b0070 con 0x7f9a1c0cd440 2024-05-30T06:55:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a19400640 1 -- 172.21.15.37:0/471807847 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a040ab600 con 0x7f9a1c0cd440 2024-05-30T06:55:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a19400640 1 -- 172.21.15.37:0/471807847 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a040ab9b0 con 0x7f9a1c0cd440 2024-05-30T06:55:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a20c00640 1 -- 172.21.15.37:0/471807847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c0cd440 msgr2=0x7f9a1c06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a20c00640 1 --2- 172.21.15.37:0/471807847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c0cd440 0x7f9a1c06f060 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9a040097c0 tx=0x7f9a0401c380 comp rx=0 tx=0).stop 2024-05-30T06:55:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a20c00640 1 -- 172.21.15.37:0/471807847 shutdown_connections 2024-05-30T06:55:17.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a20c00640 1 --2- 172.21.15.37:0/471807847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c0cd440 0x7f9a1c06f060 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a20c00640 1 --2- 172.21.15.37:0/471807847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a1c155da0 0x7f9a1c0cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a20c00640 1 -- 172.21.15.37:0/471807847 >> 172.21.15.37:0/471807847 conn(0x7f9a1c06bf60 msgr2=0x7f9a1c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:17.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a20c00640 1 -- 172.21.15.37:0/471807847 shutdown_connections 2024-05-30T06:55:17.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a20c00640 1 -- 172.21.15.37:0/471807847 wait complete. 2024-05-30T06:55:17.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a20c00640 1 Processor -- start 2024-05-30T06:55:17.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a20c00640 1 -- start start 2024-05-30T06:55:17.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a20c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a1c06f5a0 0x7f9a1c13af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a20c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c155da0 0x7f9a1c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.493+0000 7f9a20c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a1c0b53f0 0x7f9a1c15aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a20c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c168580 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a20c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c06f9d0 con 0x7f9a1c155da0 2024-05-30T06:55:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a20c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1c168700 con 0x7f9a1c0b53f0 2024-05-30T06:55:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a19e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a1c06f5a0 0x7f9a1c13af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a19e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a1c06f5a0 0x7f9a1c13af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36348/0 (socket says 172.21.15.37:36348) 2024-05-30T06:55:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a19e00640 1 -- 172.21.15.37:0/1434745499 learned_addr learned my addr 172.21.15.37:0/1434745499 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a13e00640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c155da0 0x7f9a1c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a1a800640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a1c0b53f0 0x7f9a1c15aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a19e00640 1 -- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a1c0b53f0 msgr2=0x7f9a1c15aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a19e00640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a1c0b53f0 0x7f9a1c15aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a19e00640 1 -- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c155da0 msgr2=0x7f9a1c0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a19e00640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c155da0 0x7f9a1c0b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a19e00640 1 -- 172.21.15.37:0/1434745499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c15b600 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a19e00640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a1c06f5a0 0x7f9a1c13af20 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00e870 tx=0x7f9a0c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:17.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a12000640 1 -- 172.21.15.37:0/1434745499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c017070 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a12000640 1 -- 172.21.15.37:0/1434745499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c00c8e0 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a20c00640 1 -- 172.21.15.37:0/1434745499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1c15b8e0 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a12000640 1 -- 172.21.15.37:0/1434745499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c00cc90 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a20c00640 1 -- 172.21.15.37:0/1434745499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a1c15bea0 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.497+0000 7f9a20c00640 1 -- 172.21.15.37:0/1434745499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a1c0b5800 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.501+0000 7f9a12000640 1 -- 172.21.15.37:0/1434745499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) ==== 89823+0+0 (secure 0 0 0) 0x7f9a0c01a070 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.501+0000 7f9a12000640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f99f80697f0 0x7f99f806bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.501+0000 7f9a12000640 1 -- 172.21.15.37:0/1434745499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7f9a0c085fe0 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.501+0000 7f9a13e00640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f99f80697f0 0x7f99f806bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.501+0000 7f9a13e00640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f99f80697f0 0x7f99f806bcb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9a040ad000 tx=0x7f9a040a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:17.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.505+0000 7f9a12000640 1 -- 172.21.15.37:0/1434745499 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9a1c0b5800 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.669+0000 7f9a20c00640 1 -- 172.21.15.37:0/1434745499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9a1c074cf0 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.669+0000 7f9a12000640 1 -- 172.21.15.37:0/1434745499 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f9a0c0575d0 con 0x7f9a1c06f5a0 2024-05-30T06:55:17.673 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:55:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.673+0000 7f9a20c00640 1 -- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f99f80697f0 msgr2=0x7f99f806bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.673+0000 7f9a20c00640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f99f80697f0 0x7f99f806bcb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9a040ad000 tx=0x7f9a040a6000 comp rx=0 tx=0).stop 2024-05-30T06:55:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.673+0000 7f9a20c00640 1 -- 172.21.15.37:0/1434745499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a1c06f5a0 msgr2=0x7f9a1c13af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.673+0000 7f9a20c00640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a1c06f5a0 0x7f9a1c13af20 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00e870 tx=0x7f9a0c00ec70 comp rx=0 tx=0).stop 2024-05-30T06:55:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.673+0000 7f9a20c00640 1 -- 172.21.15.37:0/1434745499 shutdown_connections 2024-05-30T06:55:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.673+0000 7f9a20c00640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a1c0b53f0 0x7f9a1c15aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.673+0000 7f9a20c00640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f99f80697f0 0x7f99f806bcb0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.673+0000 7f9a20c00640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a1c155da0 0x7f9a1c0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.673+0000 7f9a20c00640 1 --2- 172.21.15.37:0/1434745499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a1c06f5a0 0x7f9a1c13af20 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.673+0000 7f9a20c00640 1 -- 172.21.15.37:0/1434745499 >> 172.21.15.37:0/1434745499 conn(0x7f9a1c06bf60 msgr2=0x7f9a1c1533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.673+0000 7f9a20c00640 1 -- 172.21.15.37:0/1434745499 shutdown_connections 2024-05-30T06:55:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.673+0000 7f9a20c00640 1 -- 172.21.15.37:0/1434745499 wait complete. 2024-05-30T06:55:17.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T06:55:17.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.837+0000 7f0d08000640 1 Processor -- start 2024-05-30T06:55:17.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.837+0000 7f0d08000640 1 -- start start 2024-05-30T06:55:17.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.837+0000 7f0d08000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0d000b59d0 0x7f0d000b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.837+0000 7f0d08000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d0015d350 0x7f0d00160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.837+0000 7f0d08000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0015d7e0 0x7f0d001607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.837+0000 7f0d08000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0d000b62f0 con 0x7f0d0015d350 2024-05-30T06:55:17.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.837+0000 7f0d08000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0d00142030 con 0x7f0d000b59d0 2024-05-30T06:55:17.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.837+0000 7f0d08000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0d00142310 con 0x7f0d0015d7e0 2024-05-30T06:55:17.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.837+0000 7f0d04c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d0015d350 0x7f0d00160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.837+0000 7f0d04c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d0015d350 0x7f0d00160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36364/0 (socket says 172.21.15.37:36364) 2024-05-30T06:55:17.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.837+0000 7f0d04c00640 1 -- 172.21.15.37:0/3057135341 learned_addr learned my addr 172.21.15.37:0/3057135341 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:17.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d05600640 1 --2- 172.21.15.37:0/3057135341 >> v2:172.21.15.105:3300/0 conn(0x7f0d000b59d0 0x7f0d000b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d06000640 1 --2- 172.21.15.37:0/3057135341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0015d7e0 0x7f0d001607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d04c00640 1 -- 172.21.15.37:0/3057135341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0015d7e0 msgr2=0x7f0d001607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:17.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d04c00640 1 --2- 172.21.15.37:0/3057135341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0015d7e0 0x7f0d001607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d04c00640 1 -- 172.21.15.37:0/3057135341 >> v2:172.21.15.105:3300/0 conn(0x7f0d000b59d0 msgr2=0x7f0d000b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:17.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d04c00640 1 --2- 172.21.15.37:0/3057135341 >> v2:172.21.15.105:3300/0 conn(0x7f0d000b59d0 0x7f0d000b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d04c00640 1 -- 172.21.15.37:0/3057135341 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d001425f0 con 0x7f0d0015d350 2024-05-30T06:55:17.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d05600640 1 --2- 172.21.15.37:0/3057135341 >> v2:172.21.15.105:3300/0 conn(0x7f0d000b59d0 0x7f0d000b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:17.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d06000640 1 --2- 172.21.15.37:0/3057135341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0015d7e0 0x7f0d001607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:17.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d04c00640 1 --2- 172.21.15.37:0/3057135341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d0015d350 0x7f0d00160280 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009870 tx=0x7f0cec01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e167674791c12a83 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:17.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0cffe00640 1 -- 172.21.15.37:0/3057135341 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0b5070 con 0x7f0d0015d350 2024-05-30T06:55:17.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0cffe00640 1 -- 172.21.15.37:0/3057135341 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cec0a89d0 con 0x7f0d0015d350 2024-05-30T06:55:17.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0cffe00640 1 -- 172.21.15.37:0/3057135341 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0a8da0 con 0x7f0d0015d350 2024-05-30T06:55:17.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d08000640 1 -- 172.21.15.37:0/3057135341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d0015d350 msgr2=0x7f0d00160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d08000640 1 --2- 172.21.15.37:0/3057135341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d0015d350 0x7f0d00160280 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009870 tx=0x7f0cec01ed10 comp rx=0 tx=0).stop 2024-05-30T06:55:17.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d08000640 1 -- 172.21.15.37:0/3057135341 shutdown_connections 2024-05-30T06:55:17.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d08000640 1 --2- 172.21.15.37:0/3057135341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0015d7e0 0x7f0d001607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d08000640 1 --2- 172.21.15.37:0/3057135341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d0015d350 0x7f0d00160280 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d08000640 1 --2- 172.21.15.37:0/3057135341 >> v2:172.21.15.105:3300/0 conn(0x7f0d000b59d0 0x7f0d000b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d08000640 1 -- 172.21.15.37:0/3057135341 >> 172.21.15.37:0/3057135341 conn(0x7f0d0006bf60 msgr2=0x7f0d000b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:17.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d08000640 1 -- 172.21.15.37:0/3057135341 shutdown_connections 2024-05-30T06:55:17.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.841+0000 7f0d08000640 1 -- 172.21.15.37:0/3057135341 wait complete. 2024-05-30T06:55:17.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d08000640 1 Processor -- start 2024-05-30T06:55:17.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d08000640 1 -- start start 2024-05-30T06:55:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d08000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d000b59d0 0x7f0d000b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d08000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0015d350 0x7f0d0013a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d08000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d0015d7e0 0x7f0d000ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d08000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0013fe60 con 0x7f0d0015d7e0 2024-05-30T06:55:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d08000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0013fce0 con 0x7f0d000b59d0 2024-05-30T06:55:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d08000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0d000aff20 con 0x7f0d0015d350 2024-05-30T06:55:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d06000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d0015d7e0 0x7f0d000ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d06000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d0015d7e0 0x7f0d000ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36366/0 (socket says 172.21.15.37:36366) 2024-05-30T06:55:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d06000640 1 -- 172.21.15.37:0/1486074863 learned_addr learned my addr 172.21.15.37:0/1486074863 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d05600640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d000b59d0 0x7f0d000b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d04c00640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0015d350 0x7f0d0013a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d06000640 1 -- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0015d350 msgr2=0x7f0d0013a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d06000640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0015d350 0x7f0d0013a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d06000640 1 -- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d000b59d0 msgr2=0x7f0d000b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d06000640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d000b59d0 0x7f0d000b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d06000640 1 -- 172.21.15.37:0/1486074863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d000b4aa0 con 0x7f0d0015d7e0 2024-05-30T06:55:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d06000640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d0015d7e0 0x7f0d000ad8d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800cd80 tx=0x7f0cf800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0cfd600640 1 -- 172.21.15.37:0/1486074863 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800f680 con 0x7f0d0015d7e0 2024-05-30T06:55:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0cfd600640 1 -- 172.21.15.37:0/1486074863 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf800f840 con 0x7f0d0015d7e0 2024-05-30T06:55:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0cfd600640 1 -- 172.21.15.37:0/1486074863 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800fc30 con 0x7f0d0015d7e0 2024-05-30T06:55:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.845+0000 7f0d08000640 1 -- 172.21.15.37:0/1486074863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d000b4d80 con 0x7f0d0015d7e0 2024-05-30T06:55:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.849+0000 7f0d08000640 1 -- 172.21.15.37:0/1486074863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d000b5340 con 0x7f0d0015d7e0 2024-05-30T06:55:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.849+0000 7f0d08000640 1 -- 172.21.15.37:0/1486074863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d00068bc0 con 0x7f0d0015d7e0 2024-05-30T06:55:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.849+0000 7f0cfd600640 1 -- 172.21.15.37:0/1486074863 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f0cf80213f0 con 0x7f0d0015d7e0 2024-05-30T06:55:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.849+0000 7f0cfd600640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ce0069910 0x7f0ce006bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.849+0000 7f0cfd600640 1 -- 172.21.15.37:0/1486074863 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7f0cf80867c0 con 0x7f0d0015d7e0 2024-05-30T06:55:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.849+0000 7f0d05600640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ce0069910 0x7f0ce006bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.849+0000 7f0d05600640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ce0069910 0x7f0ce006bdd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4006b20 tx=0x7f0cf4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:17.853+0000 7f0cfd600640 1 -- 172.21.15.37:0/1486074863 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0cf8014030 con 0x7f0d0015d7e0 2024-05-30T06:55:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.029+0000 7f0d08000640 1 -- 172.21.15.37:0/1486074863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0d0006ea00 con 0x7f0d0015d7e0 2024-05-30T06:55:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.029+0000 7f0cfd600640 1 -- 172.21.15.37:0/1486074863 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v91) ==== 80+0+0 (secure 0 0 0) 0x7f0cf8057cf0 con 0x7f0d0015d7e0 2024-05-30T06:55:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-30T06:55:18.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.033+0000 7f0d08000640 1 -- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ce0069910 msgr2=0x7f0ce006bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:18.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.033+0000 7f0d08000640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ce0069910 0x7f0ce006bdd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4006b20 tx=0x7f0cf4008040 comp rx=0 tx=0).stop 2024-05-30T06:55:18.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.033+0000 7f0d08000640 1 -- 172.21.15.37:0/1486074863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d0015d7e0 msgr2=0x7f0d000ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:18.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.033+0000 7f0d08000640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d0015d7e0 0x7f0d000ad8d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800cd80 tx=0x7f0cf800a650 comp rx=0 tx=0).stop 2024-05-30T06:55:18.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.033+0000 7f0d08000640 1 -- 172.21.15.37:0/1486074863 shutdown_connections 2024-05-30T06:55:18.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.033+0000 7f0d08000640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d0015d7e0 0x7f0d000ad8d0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:18.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.033+0000 7f0d08000640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d0015d350 0x7f0d0013a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:18.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.033+0000 7f0d08000640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0ce0069910 0x7f0ce006bdd0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:18.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.033+0000 7f0d08000640 1 --2- 172.21.15.37:0/1486074863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d000b59d0 0x7f0d000b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:18.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.033+0000 7f0d08000640 1 -- 172.21.15.37:0/1486074863 >> 172.21.15.37:0/1486074863 conn(0x7f0d0006bf60 msgr2=0x7f0d000ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:18.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.033+0000 7f0d08000640 1 -- 172.21.15.37:0/1486074863 shutdown_connections 2024-05-30T06:55:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.033+0000 7f0d08000640 1 -- 172.21.15.37:0/1486074863 wait complete. 2024-05-30T06:55:18.054 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T06:55:18.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:55:18.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-30T06:55:18.110 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:55:18.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:55:18.111 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T06:55:18.130 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:55:18.130 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:55:18.130 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:55:18.142 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:55:18.142 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:55:18.142 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:55:18.142 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:55:18.181 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:55:18.181 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:55:18.181 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:55:18.181 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:55:18.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:55:18.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:55:18.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.421+0000 7fd7c5800640 1 Processor -- start 2024-05-30T06:55:18.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.421+0000 7fd7c5800640 1 -- start start 2024-05-30T06:55:18.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.425+0000 7fd7c5800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7c015d3d0 0x7fd7c00ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:18.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.425+0000 7fd7c5800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7c00cea10 con 0x7fd7c00b5660 2024-05-30T06:55:18.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.425+0000 7fd7c5800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7c00cecf0 con 0x7fd7c0163e10 2024-05-30T06:55:18.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.425+0000 7fd7c5800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd7c006fc40 con 0x7fd7c015d3d0 2024-05-30T06:55:18.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.425+0000 7fd7bea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7c015d3d0 0x7fd7c00ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:18.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.425+0000 7fd7bea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7c015d3d0 0x7fd7c00ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36368/0 (socket says 172.21.15.37:36368) 2024-05-30T06:55:18.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.425+0000 7fd7bea00640 1 -- 172.21.15.37:0/1795588658 learned_addr learned my addr 172.21.15.37:0/1795588658 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:18.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.425+0000 7fd7bea00640 1 -- 172.21.15.37:0/1795588658 >> v1:172.21.15.105:6789/0 conn(0x7fd7c0163e10 legacy=0x7fd7c00b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:18.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.425+0000 7fd7bea00640 1 -- 172.21.15.37:0/1795588658 >> v1:172.21.15.37:6789/0 conn(0x7fd7c00b5660 legacy=0x7fd7c00af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:18.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.425+0000 7fd7bea00640 1 -- 172.21.15.37:0/1795588658 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c00cefd0 con 0x7fd7c015d3d0 2024-05-30T06:55:18.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.429+0000 7fd7bea00640 1 --2- 172.21.15.37:0/1795588658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7c015d3d0 0x7fd7c00ce410 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009870 tx=0x7fd7b001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e501606de6c1a530 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:18.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.429+0000 7fd7bd600640 1 -- 172.21.15.37:0/1795588658 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00b0070 con 0x7fd7c015d3d0 2024-05-30T06:55:18.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.429+0000 7fd7bd600640 1 -- 172.21.15.37:0/1795588658 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b00ab600 con 0x7fd7c015d3d0 2024-05-30T06:55:18.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.429+0000 7fd7bd600640 1 -- 172.21.15.37:0/1795588658 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00ab9d0 con 0x7fd7c015d3d0 2024-05-30T06:55:18.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.433+0000 7fd7c5800640 1 -- 172.21.15.37:0/1795588658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7c015d3d0 msgr2=0x7fd7c00ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:18.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.433+0000 7fd7c5800640 1 --2- 172.21.15.37:0/1795588658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7c015d3d0 0x7fd7c00ce410 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009870 tx=0x7fd7b001c4e0 comp rx=0 tx=0).stop 2024-05-30T06:55:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.433+0000 7fd7c5800640 1 -- 172.21.15.37:0/1795588658 shutdown_connections 2024-05-30T06:55:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.433+0000 7fd7c5800640 1 --2- 172.21.15.37:0/1795588658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7c015d3d0 0x7fd7c00ce410 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.433+0000 7fd7c5800640 1 -- 172.21.15.37:0/1795588658 >> 172.21.15.37:0/1795588658 conn(0x7fd7c00b23a0 msgr2=0x7fd7c00b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.433+0000 7fd7c5800640 1 -- 172.21.15.37:0/1795588658 shutdown_connections 2024-05-30T06:55:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.433+0000 7fd7c5800640 1 -- 172.21.15.37:0/1795588658 wait complete. 2024-05-30T06:55:18.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7c5800640 1 Processor -- start 2024-05-30T06:55:18.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7c5800640 1 -- start start 2024-05-30T06:55:18.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7c5800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7c00b5660 0x7fd7c0160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:18.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7c5800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7c015d3d0 0x7fd7c015cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:18.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7c5800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7c0163e10 0x7fd7c0166b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:18.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7c5800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0171540 con 0x7fd7c00b5660 2024-05-30T06:55:18.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7c5800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c00b0040 con 0x7fd7c015d3d0 2024-05-30T06:55:18.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7c5800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c01716c0 con 0x7fd7c0163e10 2024-05-30T06:55:18.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7bea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7c00b5660 0x7fd7c0160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:18.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7bea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7c00b5660 0x7fd7c0160500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36384/0 (socket says 172.21.15.37:36384) 2024-05-30T06:55:18.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7bea00640 1 -- 172.21.15.37:0/1936566629 learned_addr learned my addr 172.21.15.37:0/1936566629 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:18.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7bea00640 1 -- 172.21.15.37:0/1936566629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7c0163e10 msgr2=0x7fd7c0166b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:18.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7bea00640 1 --2- 172.21.15.37:0/1936566629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7c0163e10 0x7fd7c0166b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:18.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7bea00640 1 -- 172.21.15.37:0/1936566629 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7c015d3d0 msgr2=0x7fd7c015cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:18.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7bea00640 1 --2- 172.21.15.37:0/1936566629 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7c015d3d0 0x7fd7c015cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:18.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7bea00640 1 -- 172.21.15.37:0/1936566629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c0160060 con 0x7fd7c00b5660 2024-05-30T06:55:18.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.437+0000 7fd7bea00640 1 --2- 172.21.15.37:0/1936566629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7c00b5660 0x7fd7c0160500 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fd7b001a110 tx=0x7fd7b001ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:18.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.441+0000 7fd7b6a00640 1 -- 172.21.15.37:0/1936566629 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00b0040 con 0x7fd7c00b5660 2024-05-30T06:55:18.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.441+0000 7fd7b6a00640 1 -- 172.21.15.37:0/1936566629 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b00bc070 con 0x7fd7c00b5660 2024-05-30T06:55:18.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.441+0000 7fd7b6a00640 1 -- 172.21.15.37:0/1936566629 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00b6860 con 0x7fd7c00b5660 2024-05-30T06:55:18.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.441+0000 7fd7c5800640 1 -- 172.21.15.37:0/1936566629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c015ebc0 con 0x7fd7c00b5660 2024-05-30T06:55:18.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.441+0000 7fd7c5800640 1 -- 172.21.15.37:0/1936566629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c015e600 con 0x7fd7c00b5660 2024-05-30T06:55:18.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.441+0000 7fd7c5800640 1 -- 172.21.15.37:0/1936566629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c0068b20 con 0x7fd7c00b5660 2024-05-30T06:55:18.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.445+0000 7fd7b6a00640 1 -- 172.21.15.37:0/1936566629 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fd7b00ab4c0 con 0x7fd7c00b5660 2024-05-30T06:55:18.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.445+0000 7fd7b6a00640 1 --2- 172.21.15.37:0/1936566629 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd7a0069930 0x7fd7a006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:18.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.445+0000 7fd7b6a00640 1 -- 172.21.15.37:0/1936566629 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7fd7b011fe80 con 0x7fd7c00b5660 2024-05-30T06:55:18.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.445+0000 7fd7be000640 1 --2- 172.21.15.37:0/1936566629 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd7a0069930 0x7fd7a006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:18.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.449+0000 7fd7be000640 1 --2- 172.21.15.37:0/1936566629 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd7a0069930 0x7fd7a006bdf0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd7c015fe50 tx=0x7fd7ac0079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:18.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.453+0000 7fd7b6a00640 1 -- 172.21.15.37:0/1936566629 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd7b00160d0 con 0x7fd7c00b5660 2024-05-30T06:55:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.841+0000 7fd7c5800640 1 -- 172.21.15.37:0/1936566629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7c0072fb0 con 0x7fd7c00b5660 2024-05-30T06:55:18.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.841+0000 7fd7b6a00640 1 -- 172.21.15.37:0/1936566629 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5186 (secure 0 0 0) 0x7fd7b00f1a90 con 0x7fd7c00b5660 2024-05-30T06:55:18.845 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:18.845 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/714267880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":714267880},{"type":"v1","addr":"172.21.15.105:6836","nonce":714267880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3425209937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3425209937},{"type":"v1","addr":"172.21.15.37:6834","nonce":3425209937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1537275411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1537275411},{"type":"v1","addr":"172.21.15.37:6835","nonce":1537275411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:53:44.572714+0000","modified":"2024-05-30T06:53:47.596443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7932":{"gid":7932,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/3708478889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3708478889},{"type":"v1","addr":"172.21.15.105:6837","nonce":3708478889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7932,"qdb_cluster":[7932]},"id":6}]} 2024-05-30T06:55:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 56 2024-05-30T06:55:18.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.845+0000 7fd7c5800640 1 -- 172.21.15.37:0/1936566629 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd7a0069930 msgr2=0x7fd7a006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:18.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.845+0000 7fd7c5800640 1 --2- 172.21.15.37:0/1936566629 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd7a0069930 0x7fd7a006bdf0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd7c015fe50 tx=0x7fd7ac0079c0 comp rx=0 tx=0).stop 2024-05-30T06:55:18.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.845+0000 7fd7c5800640 1 -- 172.21.15.37:0/1936566629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7c00b5660 msgr2=0x7fd7c0160500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:18.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.845+0000 7fd7c5800640 1 --2- 172.21.15.37:0/1936566629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7c00b5660 0x7fd7c0160500 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fd7b001a110 tx=0x7fd7b001ad20 comp rx=0 tx=0).stop 2024-05-30T06:55:18.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.845+0000 7fd7c5800640 1 -- 172.21.15.37:0/1936566629 shutdown_connections 2024-05-30T06:55:18.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.845+0000 7fd7c5800640 1 --2- 172.21.15.37:0/1936566629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7c0163e10 0x7fd7c0166b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:18.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.845+0000 7fd7c5800640 1 --2- 172.21.15.37:0/1936566629 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd7a0069930 0x7fd7a006bdf0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:18.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.845+0000 7fd7c5800640 1 --2- 172.21.15.37:0/1936566629 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7c015d3d0 0x7fd7c015cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:18.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.845+0000 7fd7c5800640 1 --2- 172.21.15.37:0/1936566629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7c00b5660 0x7fd7c0160500 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:18.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.845+0000 7fd7c5800640 1 -- 172.21.15.37:0/1936566629 >> 172.21.15.37:0/1936566629 conn(0x7fd7c00b23a0 msgr2=0x7fd7c0155030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:18.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.845+0000 7fd7c5800640 1 -- 172.21.15.37:0/1936566629 shutdown_connections 2024-05-30T06:55:18.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:18.849+0000 7fd7c5800640 1 -- 172.21.15.37:0/1936566629 wait complete. 2024-05-30T06:55:18.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:55:19.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb067600640 1 Processor -- start 2024-05-30T06:55:19.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb067600640 1 -- start start 2024-05-30T06:55:19.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb067600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb06015c950 0x7fb06015cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb067600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0600cdeb0 0x7fb0600ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb067600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0600d09b0 con 0x7fb0600d1b20 2024-05-30T06:55:19.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb067600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb0600d1530 con 0x7fb06015c950 2024-05-30T06:55:19.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb067600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb0600d0c90 con 0x7fb0600cdeb0 2024-05-30T06:55:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb064c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb06015c950 0x7fb06015cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb065600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb0600d1b20 0x7fb060073380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43900/0 (socket says 172.21.15.37:43900) 2024-05-30T06:55:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb065600640 1 -- 172.21.15.37:0/2336339498 learned_addr learned my addr 172.21.15.37:0/2336339498 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb05fe00640 1 --2- 172.21.15.37:0/2336339498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0600cdeb0 0x7fb0600ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb064c00640 1 -- 172.21.15.37:0/2336339498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0600cdeb0 msgr2=0x7fb0600ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb064c00640 1 --2- 172.21.15.37:0/2336339498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0600cdeb0 0x7fb0600ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb064c00640 1 -- 172.21.15.37:0/2336339498 >> v1:172.21.15.37:6789/0 conn(0x7fb0600d1b20 legacy=0x7fb060073380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb064c00640 1 -- 172.21.15.37:0/2336339498 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0600d0f70 con 0x7fb06015c950 2024-05-30T06:55:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb05f400640 1 -- 172.21.15.37:0/2336339498 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2543905311 0 0) 0x7fb0600d09b0 con 0x7fb0600d1b20 2024-05-30T06:55:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.101+0000 7fb05fe00640 1 --2- 172.21.15.37:0/2336339498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0600cdeb0 0x7fb0600ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.105+0000 7fb064c00640 1 --2- 172.21.15.37:0/2336339498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06015c950 0x7fb06015cd30 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fb0540097c0 tx=0x7fb05401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfe17edf1b484df server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:19.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.105+0000 7fb05f400640 1 -- 172.21.15.37:0/2336339498 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0540b2070 con 0x7fb06015c950 2024-05-30T06:55:19.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.105+0000 7fb05f400640 1 -- 172.21.15.37:0/2336339498 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0540ad680 con 0x7fb06015c950 2024-05-30T06:55:19.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.105+0000 7fb05f400640 1 -- 172.21.15.37:0/2336339498 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0540ada50 con 0x7fb06015c950 2024-05-30T06:55:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.105+0000 7fb067600640 1 -- 172.21.15.37:0/2336339498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06015c950 msgr2=0x7fb06015cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.105+0000 7fb067600640 1 --2- 172.21.15.37:0/2336339498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06015c950 0x7fb06015cd30 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fb0540097c0 tx=0x7fb05401c3e0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.105+0000 7fb067600640 1 -- 172.21.15.37:0/2336339498 shutdown_connections 2024-05-30T06:55:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.105+0000 7fb067600640 1 --2- 172.21.15.37:0/2336339498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0600cdeb0 0x7fb0600ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.105+0000 7fb067600640 1 --2- 172.21.15.37:0/2336339498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb06015c950 0x7fb06015cd30 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.105+0000 7fb067600640 1 -- 172.21.15.37:0/2336339498 >> 172.21.15.37:0/2336339498 conn(0x7fb060067930 msgr2=0x7fb06006ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.105+0000 7fb067600640 1 -- 172.21.15.37:0/2336339498 shutdown_connections 2024-05-30T06:55:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.105+0000 7fb067600640 1 -- 172.21.15.37:0/2336339498 wait complete. 2024-05-30T06:55:19.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb067600640 1 Processor -- start 2024-05-30T06:55:19.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb067600640 1 -- start start 2024-05-30T06:55:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb067600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0600cdeb0 0x7fb06013eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb067600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600d1b20 0x7fb060150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb067600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb06015c950 0x7fb0600b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb067600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb0600d2340 con 0x7fb0600d1b20 2024-05-30T06:55:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb067600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb06015d270 con 0x7fb06015c950 2024-05-30T06:55:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb067600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb06014e630 con 0x7fb0600cdeb0 2024-05-30T06:55:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb05fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600d1b20 0x7fb060150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb05fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600d1b20 0x7fb060150050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36416/0 (socket says 172.21.15.37:36416) 2024-05-30T06:55:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb05fe00640 1 -- 172.21.15.37:0/3504825482 learned_addr learned my addr 172.21.15.37:0/3504825482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb064c00640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0600cdeb0 0x7fb06013eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb065600640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb06015c950 0x7fb0600b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb05fe00640 1 -- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0600cdeb0 msgr2=0x7fb06013eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb05fe00640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0600cdeb0 0x7fb06013eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb05fe00640 1 -- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb06015c950 msgr2=0x7fb0600b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb05fe00640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb06015c950 0x7fb0600b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb05fe00640 1 -- 172.21.15.37:0/3504825482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0600b0c50 con 0x7fb0600d1b20 2024-05-30T06:55:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb05fe00640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600d1b20 0x7fb060150050 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00d800 tx=0x7fb04c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb05cc00640 1 -- 172.21.15.37:0/3504825482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c018020 con 0x7fb0600d1b20 2024-05-30T06:55:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb05cc00640 1 -- 172.21.15.37:0/3504825482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb04c0096c0 con 0x7fb0600d1b20 2024-05-30T06:55:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb05cc00640 1 -- 172.21.15.37:0/3504825482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c009ab0 con 0x7fb0600d1b20 2024-05-30T06:55:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb067600640 1 -- 172.21.15.37:0/3504825482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb06013f430 con 0x7fb0600d1b20 2024-05-30T06:55:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb067600640 1 -- 172.21.15.37:0/3504825482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb060150b80 con 0x7fb0600d1b20 2024-05-30T06:55:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.109+0000 7fb067600640 1 -- 172.21.15.37:0/3504825482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb060068b20 con 0x7fb0600d1b20 2024-05-30T06:55:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.113+0000 7fb05cc00640 1 -- 172.21.15.37:0/3504825482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fb04c01b020 con 0x7fb0600d1b20 2024-05-30T06:55:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.113+0000 7fb05cc00640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb040069910 0x7fb04006bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.113+0000 7fb05cc00640 1 -- 172.21.15.37:0/3504825482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7fb04c085f70 con 0x7fb0600d1b20 2024-05-30T06:55:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.113+0000 7fb064c00640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb040069910 0x7fb04006bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.113+0000 7fb064c00640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb040069910 0x7fb04006bdd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb0540af000 tx=0x7fb0540a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.117+0000 7fb05cc00640 1 -- 172.21.15.37:0/3504825482 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb04c022020 con 0x7fb0600d1b20 2024-05-30T06:55:19.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.285+0000 7fb067600640 1 -- 172.21.15.37:0/3504825482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb060075830 con 0x7fb0600d1b20 2024-05-30T06:55:19.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.285+0000 7fb05cc00640 1 -- 172.21.15.37:0/3504825482 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+16852 (secure 0 0 0) 0x7fb04c057be0 con 0x7fb0600d1b20 2024-05-30T06:55:19.288 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:19.288 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":91,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:55:15.795724+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:53:42.973928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-05-30T06:53:43.524517+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:55:19.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.289+0000 7fb067600640 1 -- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb040069910 msgr2=0x7fb04006bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.289+0000 7fb067600640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb040069910 0x7fb04006bdd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb0540af000 tx=0x7fb0540a7000 comp rx=0 tx=0).stop 2024-05-30T06:55:19.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.289+0000 7fb067600640 1 -- 172.21.15.37:0/3504825482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600d1b20 msgr2=0x7fb060150050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.289+0000 7fb067600640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600d1b20 0x7fb060150050 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00d800 tx=0x7fb04c00dcc0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.289+0000 7fb067600640 1 -- 172.21.15.37:0/3504825482 shutdown_connections 2024-05-30T06:55:19.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.289+0000 7fb067600640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb040069910 0x7fb04006bdd0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.289+0000 7fb067600640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb06015c950 0x7fb0600b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.289+0000 7fb067600640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0600d1b20 0x7fb060150050 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.289+0000 7fb067600640 1 --2- 172.21.15.37:0/3504825482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0600cdeb0 0x7fb06013eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.289+0000 7fb067600640 1 -- 172.21.15.37:0/3504825482 >> 172.21.15.37:0/3504825482 conn(0x7fb060067930 msgr2=0x7fb06015d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:19.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.289+0000 7fb067600640 1 -- 172.21.15.37:0/3504825482 shutdown_connections 2024-05-30T06:55:19.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.289+0000 7fb067600640 1 -- 172.21.15.37:0/3504825482 wait complete. 2024-05-30T06:55:19.310 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:53:42.973928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:53:43.524517+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:55:19.310 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:55:19.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc05d000640 1 Processor -- start 2024-05-30T06:55:19.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc05d000640 1 -- start start 2024-05-30T06:55:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc05d000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580ce660 0x7fc05806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc05d000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc0580d1dd0 0x7fc05809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc05d000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc0580d0850 0x7fc05809afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc05d000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc0580cea40 con 0x7fc0580d1dd0 2024-05-30T06:55:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc05d000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc0580d0d30 con 0x7fc0580d0850 2024-05-30T06:55:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc05d000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc0580d1010 con 0x7fc0580ce660 2024-05-30T06:55:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc04d400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc0580d1dd0 0x7fc05809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc04d400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc0580d1dd0 0x7fc05809aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36420/0 (socket says 172.21.15.37:36420) 2024-05-30T06:55:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc04d400640 1 -- 172.21.15.37:0/3154686042 learned_addr learned my addr 172.21.15.37:0/3154686042 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc055e00640 1 --2- 172.21.15.37:0/3154686042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580ce660 0x7fc05806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc056800640 1 --2- 172.21.15.37:0/3154686042 >> v2:172.21.15.105:3300/0 conn(0x7fc0580d0850 0x7fc05809afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc04d400640 1 -- 172.21.15.37:0/3154686042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580ce660 msgr2=0x7fc05806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc04d400640 1 --2- 172.21.15.37:0/3154686042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580ce660 0x7fc05806d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc04d400640 1 -- 172.21.15.37:0/3154686042 >> v2:172.21.15.105:3300/0 conn(0x7fc0580d0850 msgr2=0x7fc05809afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc04d400640 1 --2- 172.21.15.37:0/3154686042 >> v2:172.21.15.105:3300/0 conn(0x7fc0580d0850 0x7fc05809afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.453+0000 7fc04d400640 1 -- 172.21.15.37:0/3154686042 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0580d12f0 con 0x7fc0580d1dd0 2024-05-30T06:55:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.457+0000 7fc04d400640 1 --2- 172.21.15.37:0/3154686042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0580d1dd0 0x7fc05809aa60 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fc0580b19a0 tx=0x7fc04001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48fb97ebd7a621d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.457+0000 7fc055400640 1 -- 172.21.15.37:0/3154686042 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0400aa610 con 0x7fc0580d1dd0 2024-05-30T06:55:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.457+0000 7fc055400640 1 -- 172.21.15.37:0/3154686042 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0400af070 con 0x7fc0580d1dd0 2024-05-30T06:55:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.457+0000 7fc055400640 1 -- 172.21.15.37:0/3154686042 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0400aa9d0 con 0x7fc0580d1dd0 2024-05-30T06:55:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.457+0000 7fc05d000640 1 -- 172.21.15.37:0/3154686042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0580d1dd0 msgr2=0x7fc05809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.457+0000 7fc05d000640 1 --2- 172.21.15.37:0/3154686042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0580d1dd0 0x7fc05809aa60 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fc0580b19a0 tx=0x7fc04001c4f0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.457+0000 7fc05d000640 1 -- 172.21.15.37:0/3154686042 shutdown_connections 2024-05-30T06:55:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.457+0000 7fc05d000640 1 --2- 172.21.15.37:0/3154686042 >> v2:172.21.15.105:3300/0 conn(0x7fc0580d0850 0x7fc05809afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.457+0000 7fc05d000640 1 --2- 172.21.15.37:0/3154686042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0580d1dd0 0x7fc05809aa60 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.457+0000 7fc05d000640 1 --2- 172.21.15.37:0/3154686042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580ce660 0x7fc05806d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.457+0000 7fc05d000640 1 -- 172.21.15.37:0/3154686042 >> 172.21.15.37:0/3154686042 conn(0x7fc0580b4100 msgr2=0x7fc0580b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.457+0000 7fc05d000640 1 -- 172.21.15.37:0/3154686042 shutdown_connections 2024-05-30T06:55:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.457+0000 7fc05d000640 1 -- 172.21.15.37:0/3154686042 wait complete. 2024-05-30T06:55:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc05d000640 1 Processor -- start 2024-05-30T06:55:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc05d000640 1 -- start start 2024-05-30T06:55:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc05d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0580ce660 0x7fc0580b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc05d000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0580d0850 0x7fc058152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc05d000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580d1dd0 0x7fc058153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc05d000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc05815ea90 con 0x7fc0580ce660 2024-05-30T06:55:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc05d000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc05806cc70 con 0x7fc0580d0850 2024-05-30T06:55:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc05d000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc05815ec10 con 0x7fc0580d1dd0 2024-05-30T06:55:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc055e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0580ce660 0x7fc0580b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc055e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0580ce660 0x7fc0580b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36430/0 (socket says 172.21.15.37:36430) 2024-05-30T06:55:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc055e00640 1 -- 172.21.15.37:0/1981629534 learned_addr learned my addr 172.21.15.37:0/1981629534 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc04d400640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0580d0850 0x7fc058152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc056800640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580d1dd0 0x7fc058153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc055e00640 1 -- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580d1dd0 msgr2=0x7fc058153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc055e00640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580d1dd0 0x7fc058153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc055e00640 1 -- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0580d0850 msgr2=0x7fc058152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc055e00640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0580d0850 0x7fc058152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc055e00640 1 -- 172.21.15.37:0/1981629534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc058152b90 con 0x7fc0580ce660 2024-05-30T06:55:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc055e00640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0580ce660 0x7fc0580b39d0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fc04800e930 tx=0x7fc04800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc04ea00640 1 -- 172.21.15.37:0/1981629534 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc048017070 con 0x7fc0580ce660 2024-05-30T06:55:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc04ea00640 1 -- 172.21.15.37:0/1981629534 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc04800ca00 con 0x7fc0580ce660 2024-05-30T06:55:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc04ea00640 1 -- 172.21.15.37:0/1981629534 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04800cdb0 con 0x7fc0580ce660 2024-05-30T06:55:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc05d000640 1 -- 172.21.15.37:0/1981629534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc058153fe0 con 0x7fc0580ce660 2024-05-30T06:55:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.461+0000 7fc05d000640 1 -- 172.21.15.37:0/1981629534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0581545a0 con 0x7fc0580ce660 2024-05-30T06:55:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.465+0000 7fc05d000640 1 -- 172.21.15.37:0/1981629534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc058068bc0 con 0x7fc0580ce660 2024-05-30T06:55:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.465+0000 7fc04ea00640 1 -- 172.21.15.37:0/1981629534 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fc04801a070 con 0x7fc0580ce660 2024-05-30T06:55:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.465+0000 7fc04ea00640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0340698e0 0x7fc03406bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.465+0000 7fc04ea00640 1 -- 172.21.15.37:0/1981629534 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7fc048085740 con 0x7fc0580ce660 2024-05-30T06:55:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.465+0000 7fc04d400640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0340698e0 0x7fc03406bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.465+0000 7fc04d400640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0340698e0 0x7fc03406bda0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc0400ae000 tx=0x7fc0400a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:19.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.469+0000 7fc04ea00640 1 -- 172.21.15.37:0/1981629534 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc048057130 con 0x7fc0580ce660 2024-05-30T06:55:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.633+0000 7fc05d000640 1 -- 172.21.15.37:0/1981629534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc05806e1d0 con 0x7fc0580ce660 2024-05-30T06:55:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.633+0000 7fc04ea00640 1 -- 172.21.15.37:0/1981629534 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7fc048085bc0 con 0x7fc0580ce660 2024-05-30T06:55:19.636 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:55:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.637+0000 7fc05d000640 1 -- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0340698e0 msgr2=0x7fc03406bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.637+0000 7fc05d000640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0340698e0 0x7fc03406bda0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc0400ae000 tx=0x7fc0400a7000 comp rx=0 tx=0).stop 2024-05-30T06:55:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.637+0000 7fc05d000640 1 -- 172.21.15.37:0/1981629534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0580ce660 msgr2=0x7fc0580b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.637+0000 7fc05d000640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0580ce660 0x7fc0580b39d0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fc04800e930 tx=0x7fc04800edf0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.637+0000 7fc05d000640 1 -- 172.21.15.37:0/1981629534 shutdown_connections 2024-05-30T06:55:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.637+0000 7fc05d000640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580d1dd0 0x7fc058153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.637+0000 7fc05d000640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0340698e0 0x7fc03406bda0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.637+0000 7fc05d000640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0580d0850 0x7fc058152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.637+0000 7fc05d000640 1 --2- 172.21.15.37:0/1981629534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0580ce660 0x7fc0580b39d0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.637+0000 7fc05d000640 1 -- 172.21.15.37:0/1981629534 >> 172.21.15.37:0/1981629534 conn(0x7fc0580b4100 msgr2=0x7fc0580b79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.637+0000 7fc05d000640 1 -- 172.21.15.37:0/1981629534 shutdown_connections 2024-05-30T06:55:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.637+0000 7fc05d000640 1 -- 172.21.15.37:0/1981629534 wait complete. 2024-05-30T06:55:19.657 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:55:19.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.797+0000 7fadff000640 1 Processor -- start 2024-05-30T06:55:19.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.797+0000 7fadff000640 1 -- start start 2024-05-30T06:55:19.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadff000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fadf8155da0 0x7fadf80cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadff000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fadf806f770 0x7fadf80b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadff000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf815f310 con 0x7fadf80cd440 2024-05-30T06:55:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadff000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fadf815f5f0 con 0x7fadf806f770 2024-05-30T06:55:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadff000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fadf815f8d0 con 0x7fadf8155da0 2024-05-30T06:55:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadef400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fadf80cd440 0x7fadf806f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43910/0 (socket says 172.21.15.37:43910) 2024-05-30T06:55:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadef400640 1 -- 172.21.15.37:0/3303211960 learned_addr learned my addr 172.21.15.37:0/3303211960 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadfd000640 1 --2- 172.21.15.37:0/3303211960 >> v2:172.21.15.37:3300/0 conn(0x7fadf806f770 0x7fadf80b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadf7e00640 1 --2- 172.21.15.37:0/3303211960 >> v2:172.21.15.105:3300/0 conn(0x7fadf8155da0 0x7fadf80cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadf7400640 1 -- 172.21.15.37:0/3303211960 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3925161354 0 0) 0x7fadf815f310 con 0x7fadf80cd440 2024-05-30T06:55:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadf7400640 1 -- 172.21.15.37:0/3303211960 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faddc005740 con 0x7fadf80cd440 2024-05-30T06:55:19.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadfd000640 1 -- 172.21.15.37:0/3303211960 >> v2:172.21.15.105:3300/0 conn(0x7fadf8155da0 msgr2=0x7fadf80cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:19.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadfd000640 1 --2- 172.21.15.37:0/3303211960 >> v2:172.21.15.105:3300/0 conn(0x7fadf8155da0 0x7fadf80cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadfd000640 1 -- 172.21.15.37:0/3303211960 >> v1:172.21.15.37:6789/0 conn(0x7fadf80cd440 legacy=0x7fadf806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.801+0000 7fadfd000640 1 -- 172.21.15.37:0/3303211960 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf815fbb0 con 0x7fadf806f770 2024-05-30T06:55:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadfd000640 1 --2- 172.21.15.37:0/3303211960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf806f770 0x7fadf80b3750 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fadf806fec0 tx=0x7fadf001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7bf9d1b8b02db7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadf7400640 1 -- 172.21.15.37:0/3303211960 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf00b0070 con 0x7fadf806f770 2024-05-30T06:55:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadf7400640 1 -- 172.21.15.37:0/3303211960 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf00ab600 con 0x7fadf806f770 2024-05-30T06:55:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadf7400640 1 -- 172.21.15.37:0/3303211960 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf00ab9b0 con 0x7fadf806f770 2024-05-30T06:55:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadff000640 1 -- 172.21.15.37:0/3303211960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf806f770 msgr2=0x7fadf80b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadff000640 1 --2- 172.21.15.37:0/3303211960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf806f770 0x7fadf80b3750 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fadf806fec0 tx=0x7fadf001c360 comp rx=0 tx=0).stop 2024-05-30T06:55:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadff000640 1 -- 172.21.15.37:0/3303211960 shutdown_connections 2024-05-30T06:55:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadff000640 1 --2- 172.21.15.37:0/3303211960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf806f770 0x7fadf80b3750 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadff000640 1 --2- 172.21.15.37:0/3303211960 >> v2:172.21.15.105:3300/0 conn(0x7fadf8155da0 0x7fadf80cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadff000640 1 -- 172.21.15.37:0/3303211960 >> 172.21.15.37:0/3303211960 conn(0x7fadf806bf60 msgr2=0x7fadf80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadff000640 1 -- 172.21.15.37:0/3303211960 shutdown_connections 2024-05-30T06:55:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadff000640 1 -- 172.21.15.37:0/3303211960 wait complete. 2024-05-30T06:55:19.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadff000640 1 Processor -- start 2024-05-30T06:55:19.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.805+0000 7fadff000640 1 -- start start 2024-05-30T06:55:19.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadff000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf806f770 0x7fadf8146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadff000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf8155da0 0x7fadf814c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadff000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf814ca60 0x7fadf8156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadff000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fadf806df50 con 0x7fadf8155da0 2024-05-30T06:55:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadff000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fadf80b46f0 con 0x7fadf806f770 2024-05-30T06:55:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadff000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fadf806e0d0 con 0x7fadf814ca60 2024-05-30T06:55:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf8155da0 0x7fadf814c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadf7e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf806f770 0x7fadf8146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf8155da0 0x7fadf814c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36458/0 (socket says 172.21.15.37:36458) 2024-05-30T06:55:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadef400640 1 -- 172.21.15.37:0/123041144 learned_addr learned my addr 172.21.15.37:0/123041144 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:19.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadfd000640 1 --2- 172.21.15.37:0/123041144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf814ca60 0x7fadf8156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadef400640 1 -- 172.21.15.37:0/123041144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf814ca60 msgr2=0x7fadf8156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadef400640 1 --2- 172.21.15.37:0/123041144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf814ca60 0x7fadf8156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadef400640 1 -- 172.21.15.37:0/123041144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf806f770 msgr2=0x7fadf8146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadef400640 1 --2- 172.21.15.37:0/123041144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf806f770 0x7fadf8146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadef400640 1 -- 172.21.15.37:0/123041144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf8159820 con 0x7fadf8155da0 2024-05-30T06:55:19.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadef400640 1 --2- 172.21.15.37:0/123041144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf8155da0 0x7fadf814c520 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fade000c450 tx=0x7fade000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:19.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadf4c00640 1 -- 172.21.15.37:0/123041144 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0017070 con 0x7fadf8155da0 2024-05-30T06:55:19.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadf4c00640 1 -- 172.21.15.37:0/123041144 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade0005cf0 con 0x7fadf8155da0 2024-05-30T06:55:19.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadff000640 1 -- 172.21.15.37:0/123041144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf8159b00 con 0x7fadf8155da0 2024-05-30T06:55:19.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadf4c00640 1 -- 172.21.15.37:0/123041144 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0007290 con 0x7fadf8155da0 2024-05-30T06:55:19.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadff000640 1 -- 172.21.15.37:0/123041144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf815a0c0 con 0x7fadf8155da0 2024-05-30T06:55:19.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadff000640 1 -- 172.21.15.37:0/123041144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf814ce70 con 0x7fadf8155da0 2024-05-30T06:55:19.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.809+0000 7fadf4c00640 1 -- 172.21.15.37:0/123041144 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fade001a070 con 0x7fadf8155da0 2024-05-30T06:55:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.813+0000 7fadf4c00640 1 --2- 172.21.15.37:0/123041144 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fadd40698e0 0x7fadd406bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.813+0000 7fadf4c00640 1 -- 172.21.15.37:0/123041144 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7fade0084dc0 con 0x7fadf8155da0 2024-05-30T06:55:19.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.813+0000 7fadf7e00640 1 --2- 172.21.15.37:0/123041144 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fadd40698e0 0x7fadd406bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:19.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.813+0000 7fadf7e00640 1 --2- 172.21.15.37:0/123041144 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fadd40698e0 0x7fadd406bda0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fade8011340 tx=0x7fade800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:19.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.817+0000 7fadf4c00640 1 -- 172.21.15.37:0/123041144 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fadf814ce70 con 0x7fadf8155da0 2024-05-30T06:55:19.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadff000640 1 -- 172.21.15.37:0/123041144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fadf80b6790 con 0x7fadf8155da0 2024-05-30T06:55:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadf4c00640 1 -- 172.21.15.37:0/123041144 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7fade00563e0 con 0x7fadf8155da0 2024-05-30T06:55:19.983 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:55:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadff000640 1 -- 172.21.15.37:0/123041144 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fadd40698e0 msgr2=0x7fadd406bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadff000640 1 --2- 172.21.15.37:0/123041144 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fadd40698e0 0x7fadd406bda0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fade8011340 tx=0x7fade800b040 comp rx=0 tx=0).stop 2024-05-30T06:55:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadff000640 1 -- 172.21.15.37:0/123041144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf8155da0 msgr2=0x7fadf814c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadff000640 1 --2- 172.21.15.37:0/123041144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf8155da0 0x7fadf814c520 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fade000c450 tx=0x7fade000c910 comp rx=0 tx=0).stop 2024-05-30T06:55:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadff000640 1 -- 172.21.15.37:0/123041144 shutdown_connections 2024-05-30T06:55:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadff000640 1 --2- 172.21.15.37:0/123041144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadf814ca60 0x7fadf8156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadff000640 1 --2- 172.21.15.37:0/123041144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadf8155da0 0x7fadf814c520 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadff000640 1 --2- 172.21.15.37:0/123041144 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fadd40698e0 0x7fadd406bda0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadff000640 1 --2- 172.21.15.37:0/123041144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf806f770 0x7fadf8146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadff000640 1 -- 172.21.15.37:0/123041144 >> 172.21.15.37:0/123041144 conn(0x7fadf806bf60 msgr2=0x7fadf80b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadff000640 1 -- 172.21.15.37:0/123041144 shutdown_connections 2024-05-30T06:55:19.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:19.981+0000 7fadff000640 1 -- 172.21.15.37:0/123041144 wait complete. 2024-05-30T06:55:20.004 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:55:20.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.145+0000 7f498a200640 1 Processor -- start 2024-05-30T06:55:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.145+0000 7f498a200640 1 -- start start 2024-05-30T06:55:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.149+0000 7f498a200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49840cfeb0 0x7f49840afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.149+0000 7f498a200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49840b36c0 0x7f4984162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.149+0000 7f498a200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49840b5f70 con 0x7f49841629d0 2024-05-30T06:55:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.149+0000 7f498a200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4984162de0 con 0x7f49840b36c0 2024-05-30T06:55:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.149+0000 7f498a200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f49840b67a0 con 0x7f49840cfeb0 2024-05-30T06:55:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.149+0000 7f4983e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f49841629d0 0x7f4984147680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43916/0 (socket says 172.21.15.37:43916) 2024-05-30T06:55:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.149+0000 7f497aa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49840b36c0 0x7f4984162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.149+0000 7f4983e00640 1 -- 172.21.15.37:0/1926983682 learned_addr learned my addr 172.21.15.37:0/1926983682 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.149+0000 7f4983400640 1 --2- 172.21.15.37:0/1926983682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49840cfeb0 0x7f49840afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.149+0000 7f497aa00640 1 -- 172.21.15.37:0/1926983682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49840cfeb0 msgr2=0x7f49840afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.149+0000 7f497aa00640 1 --2- 172.21.15.37:0/1926983682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49840cfeb0 0x7f49840afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.149+0000 7f497aa00640 1 -- 172.21.15.37:0/1926983682 >> v1:172.21.15.37:6789/0 conn(0x7f49841629d0 legacy=0x7f4984147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.149+0000 7f497aa00640 1 -- 172.21.15.37:0/1926983682 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49840b3b20 con 0x7f49840b36c0 2024-05-30T06:55:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f497aa00640 1 --2- 172.21.15.37:0/1926983682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49840b36c0 0x7f4984162490 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f496c0097c0 tx=0x7f496c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fffd9c84c684896 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f4982a00640 1 -- 172.21.15.37:0/1926983682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c0b0070 con 0x7f49840b36c0 2024-05-30T06:55:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f4982a00640 1 -- 172.21.15.37:0/1926983682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496c0ab600 con 0x7f49840b36c0 2024-05-30T06:55:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f4982a00640 1 -- 172.21.15.37:0/1926983682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c0ab9d0 con 0x7f49840b36c0 2024-05-30T06:55:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 -- 172.21.15.37:0/1926983682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49840b36c0 msgr2=0x7f4984162490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 --2- 172.21.15.37:0/1926983682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49840b36c0 0x7f4984162490 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f496c0097c0 tx=0x7f496c01c410 comp rx=0 tx=0).stop 2024-05-30T06:55:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 -- 172.21.15.37:0/1926983682 shutdown_connections 2024-05-30T06:55:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 --2- 172.21.15.37:0/1926983682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49840b36c0 0x7f4984162490 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 --2- 172.21.15.37:0/1926983682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49840cfeb0 0x7f49840afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 -- 172.21.15.37:0/1926983682 >> 172.21.15.37:0/1926983682 conn(0x7f498406bf60 msgr2=0x7f49840b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 -- 172.21.15.37:0/1926983682 shutdown_connections 2024-05-30T06:55:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 -- 172.21.15.37:0/1926983682 wait complete. 2024-05-30T06:55:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 Processor -- start 2024-05-30T06:55:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 -- start start 2024-05-30T06:55:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49840b36c0 0x7f498415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840cfeb0 0x7f49841459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49841629d0 0x7f4984145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f49840ae290 con 0x7f49840b36c0 2024-05-30T06:55:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f49840ae110 con 0x7f49840cfeb0 2024-05-30T06:55:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.153+0000 7f498a200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f49840ae410 con 0x7f49841629d0 2024-05-30T06:55:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f4983400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49840b36c0 0x7f498415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f4983400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49840b36c0 0x7f498415baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36464/0 (socket says 172.21.15.37:36464) 2024-05-30T06:55:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f4983400640 1 -- 172.21.15.37:0/146242212 learned_addr learned my addr 172.21.15.37:0/146242212 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f4983e00640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49841629d0 0x7f4984145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f497aa00640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840cfeb0 0x7f49841459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f4983400640 1 -- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49841629d0 msgr2=0x7f4984145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f4983400640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49841629d0 0x7f4984145f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f4983400640 1 -- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840cfeb0 msgr2=0x7f49841459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f4983400640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840cfeb0 0x7f49841459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f4983400640 1 -- 172.21.15.37:0/146242212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4984137e90 con 0x7f49840b36c0 2024-05-30T06:55:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f4983400640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49840b36c0 0x7f498415baa0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f497400d800 tx=0x7f497400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f497be00640 1 -- 172.21.15.37:0/146242212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497400b6c0 con 0x7f49840b36c0 2024-05-30T06:55:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f497be00640 1 -- 172.21.15.37:0/146242212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4974019070 con 0x7f49840b36c0 2024-05-30T06:55:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f498a200640 1 -- 172.21.15.37:0/146242212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49840b1600 con 0x7f49840b36c0 2024-05-30T06:55:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f497be00640 1 -- 172.21.15.37:0/146242212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497400ba60 con 0x7f49840b36c0 2024-05-30T06:55:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f498a200640 1 -- 172.21.15.37:0/146242212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4984138410 con 0x7f49840b36c0 2024-05-30T06:55:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f498a200640 1 -- 172.21.15.37:0/146242212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4984068bc0 con 0x7f49840b36c0 2024-05-30T06:55:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f497be00640 1 -- 172.21.15.37:0/146242212 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f497400bc00 con 0x7f49840b36c0 2024-05-30T06:55:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.157+0000 7f497be00640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f49600698e0 0x7f496006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.161+0000 7f497be00640 1 -- 172.21.15.37:0/146242212 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7f4974085ff0 con 0x7f49840b36c0 2024-05-30T06:55:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.161+0000 7f497aa00640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f49600698e0 0x7f496006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.161+0000 7f497aa00640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f49600698e0 0x7f496006bda0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f496c0ad000 tx=0x7f496c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.161+0000 7f497be00640 1 -- 172.21.15.37:0/146242212 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4974057c00 con 0x7f49840b36c0 2024-05-30T06:55:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f498a200640 1 -- 172.21.15.37:0/146242212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f49840adb80 con 0x7f49840b36c0 2024-05-30T06:55:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f497be00640 1 -- 172.21.15.37:0/146242212 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7f4974086470 con 0x7f49840b36c0 2024-05-30T06:55:20.330 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:55:20.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f498a200640 1 -- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f49600698e0 msgr2=0x7f496006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f498a200640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f49600698e0 0x7f496006bda0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f496c0ad000 tx=0x7f496c008040 comp rx=0 tx=0).stop 2024-05-30T06:55:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f498a200640 1 -- 172.21.15.37:0/146242212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49840b36c0 msgr2=0x7f498415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f498a200640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49840b36c0 0x7f498415baa0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f497400d800 tx=0x7f497400dcc0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f498a200640 1 -- 172.21.15.37:0/146242212 shutdown_connections 2024-05-30T06:55:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f498a200640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49841629d0 0x7f4984145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f498a200640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f49600698e0 0x7f496006bda0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f498a200640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49840cfeb0 0x7f49841459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f498a200640 1 --2- 172.21.15.37:0/146242212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49840b36c0 0x7f498415baa0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f498a200640 1 -- 172.21.15.37:0/146242212 >> 172.21.15.37:0/146242212 conn(0x7f498406bf60 msgr2=0x7f498415cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f498a200640 1 -- 172.21.15.37:0/146242212 shutdown_connections 2024-05-30T06:55:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.329+0000 7f498a200640 1 -- 172.21.15.37:0/146242212 wait complete. 2024-05-30T06:55:20.353 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:55:20.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f988f400640 1 Processor -- start 2024-05-30T06:55:20.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f988f400640 1 -- start start 2024-05-30T06:55:20.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f988f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9888162cb0 0x7f98880ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f988f400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f988809abe0 con 0x7f988815e930 2024-05-30T06:55:20.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f988f400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f988809aec0 con 0x7f988809b9a0 2024-05-30T06:55:20.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f988f400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f988809b1a0 con 0x7f9888162cb0 2024-05-30T06:55:20.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f988ca00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f988815e930 0x7f98880d1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43928/0 (socket says 172.21.15.37:43928) 2024-05-30T06:55:20.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f988ca00640 1 -- 172.21.15.37:0/1582923913 learned_addr learned my addr 172.21.15.37:0/1582923913 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:20.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f988d400640 1 --2- 172.21.15.37:0/1582923913 >> v2:172.21.15.37:3300/0 conn(0x7f9888162cb0 0x7f98880ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f9887e00640 1 -- 172.21.15.37:0/1582923913 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051844491 0 0) 0x7f988809abe0 con 0x7f988815e930 2024-05-30T06:55:20.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f9887e00640 1 -- 172.21.15.37:0/1582923913 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f986c003530 con 0x7f988815e930 2024-05-30T06:55:20.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f988d400640 1 -- 172.21.15.37:0/1582923913 >> v1:172.21.15.105:6789/0 conn(0x7f988809b9a0 legacy=0x7f98881625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f988d400640 1 -- 172.21.15.37:0/1582923913 >> v1:172.21.15.37:6789/0 conn(0x7f988815e930 legacy=0x7f98880d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.493+0000 7f988d400640 1 -- 172.21.15.37:0/1582923913 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988809b480 con 0x7f9888162cb0 2024-05-30T06:55:20.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.497+0000 7f988d400640 1 --2- 172.21.15.37:0/1582923913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9888162cb0 0x7f98880ccc60 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f9880009d90 tx=0x7f988001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1b8ba8566f62d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:20.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.497+0000 7f9887e00640 1 -- 172.21.15.37:0/1582923913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98800b2070 con 0x7f9888162cb0 2024-05-30T06:55:20.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.497+0000 7f9887e00640 1 -- 172.21.15.37:0/1582923913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98800a5880 con 0x7f9888162cb0 2024-05-30T06:55:20.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.497+0000 7f9887e00640 1 -- 172.21.15.37:0/1582923913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98800a5c50 con 0x7f9888162cb0 2024-05-30T06:55:20.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.497+0000 7f988f400640 1 -- 172.21.15.37:0/1582923913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9888162cb0 msgr2=0x7f98880ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.497+0000 7f988f400640 1 --2- 172.21.15.37:0/1582923913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9888162cb0 0x7f98880ccc60 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f9880009d90 tx=0x7f988001c970 comp rx=0 tx=0).stop 2024-05-30T06:55:20.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.497+0000 7f988f400640 1 -- 172.21.15.37:0/1582923913 shutdown_connections 2024-05-30T06:55:20.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.497+0000 7f988f400640 1 --2- 172.21.15.37:0/1582923913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9888162cb0 0x7f98880ccc60 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.497+0000 7f988f400640 1 -- 172.21.15.37:0/1582923913 >> 172.21.15.37:0/1582923913 conn(0x7f98880b4100 msgr2=0x7f98880b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:20.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.497+0000 7f988f400640 1 -- 172.21.15.37:0/1582923913 shutdown_connections 2024-05-30T06:55:20.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.497+0000 7f988f400640 1 -- 172.21.15.37:0/1582923913 wait complete. 2024-05-30T06:55:20.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988f400640 1 Processor -- start 2024-05-30T06:55:20.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988f400640 1 -- start start 2024-05-30T06:55:20.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988f400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f988809b9a0 0x7f98880cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988f400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f988815e930 0x7f98880ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9888162cb0 0x7f9888152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988f400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f988815ee90 con 0x7f9888162cb0 2024-05-30T06:55:20.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988f400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f988815ed10 con 0x7f988809b9a0 2024-05-30T06:55:20.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988f400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f988816c950 con 0x7f988815e930 2024-05-30T06:55:20.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9888162cb0 0x7f9888152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9888162cb0 0x7f9888152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36478/0 (socket says 172.21.15.37:36478) 2024-05-30T06:55:20.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988d400640 1 -- 172.21.15.37:0/2106529429 learned_addr learned my addr 172.21.15.37:0/2106529429 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:20.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988ca00640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f988809b9a0 0x7f98880cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f987fe00640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f988815e930 0x7f98880ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988d400640 1 -- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f988815e930 msgr2=0x7f98880ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988d400640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f988815e930 0x7f98880ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988d400640 1 -- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f988809b9a0 msgr2=0x7f98880cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988d400640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f988809b9a0 0x7f98880cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988d400640 1 -- 172.21.15.37:0/2106529429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98880b13c0 con 0x7f9888162cb0 2024-05-30T06:55:20.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988d400640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9888162cb0 0x7f9888152c30 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f98800b0040 tx=0x7f9880019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f9885600640 1 -- 172.21.15.37:0/2106529429 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98800b2050 con 0x7f9888162cb0 2024-05-30T06:55:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f9885600640 1 -- 172.21.15.37:0/2106529429 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98800be070 con 0x7f9888162cb0 2024-05-30T06:55:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f9885600640 1 -- 172.21.15.37:0/2106529429 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98800ada90 con 0x7f9888162cb0 2024-05-30T06:55:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988f400640 1 -- 172.21.15.37:0/2106529429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98880b5590 con 0x7f9888162cb0 2024-05-30T06:55:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988f400640 1 -- 172.21.15.37:0/2106529429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98880b5b50 con 0x7f9888162cb0 2024-05-30T06:55:20.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.501+0000 7f988f400640 1 -- 172.21.15.37:0/2106529429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9888068b20 con 0x7f9888162cb0 2024-05-30T06:55:20.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.505+0000 7f9885600640 1 -- 172.21.15.37:0/2106529429 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f98800a5700 con 0x7f9888162cb0 2024-05-30T06:55:20.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.505+0000 7f9885600640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9864069910 0x7f986406bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.505+0000 7f9885600640 1 -- 172.21.15.37:0/2106529429 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7f9880120a10 con 0x7f9888162cb0 2024-05-30T06:55:20.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.505+0000 7f988ca00640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9864069910 0x7f986406bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.505+0000 7f988ca00640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9864069910 0x7f986406bdd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f98780011f0 tx=0x7f9878007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:20.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.509+0000 7f9885600640 1 -- 172.21.15.37:0/2106529429 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9880016560 con 0x7f9888162cb0 2024-05-30T06:55:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f988f400640 1 -- 172.21.15.37:0/2106529429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f988806e350 con 0x7f9888162cb0 2024-05-30T06:55:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f9885600640 1 -- 172.21.15.37:0/2106529429 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5186 (secure 0 0 0) 0x7f9880120e90 con 0x7f9888162cb0 2024-05-30T06:55:20.714 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:20.715 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/714267880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":714267880},{"type":"v1","addr":"172.21.15.105:6836","nonce":714267880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3425209937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3425209937},{"type":"v1","addr":"172.21.15.37:6834","nonce":3425209937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1537275411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1537275411},{"type":"v1","addr":"172.21.15.37:6835","nonce":1537275411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:53:44.572714+0000","modified":"2024-05-30T06:53:47.596443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7932":{"gid":7932,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/3708478889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3708478889},{"type":"v1","addr":"172.21.15.105:6837","nonce":3708478889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7932,"qdb_cluster":[7932]},"id":6}]} 2024-05-30T06:55:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 56 2024-05-30T06:55:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f988f400640 1 -- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9864069910 msgr2=0x7f986406bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f988f400640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9864069910 0x7f986406bdd0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f98780011f0 tx=0x7f9878007d40 comp rx=0 tx=0).stop 2024-05-30T06:55:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f988f400640 1 -- 172.21.15.37:0/2106529429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9888162cb0 msgr2=0x7f9888152c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f988f400640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9888162cb0 0x7f9888152c30 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f98800b0040 tx=0x7f9880019710 comp rx=0 tx=0).stop 2024-05-30T06:55:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f988f400640 1 -- 172.21.15.37:0/2106529429 shutdown_connections 2024-05-30T06:55:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f988f400640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9888162cb0 0x7f9888152c30 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f988f400640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f988815e930 0x7f98880ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f988f400640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9864069910 0x7f986406bdd0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f988f400640 1 --2- 172.21.15.37:0/2106529429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f988809b9a0 0x7f98880cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f988f400640 1 -- 172.21.15.37:0/2106529429 >> 172.21.15.37:0/2106529429 conn(0x7f98880b4100 msgr2=0x7f9888074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f988f400640 1 -- 172.21.15.37:0/2106529429 shutdown_connections 2024-05-30T06:55:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.713+0000 7f988f400640 1 -- 172.21.15.37:0/2106529429 wait complete. 2024-05-30T06:55:20.736 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:55:20.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd20e00640 1 Processor -- start 2024-05-30T06:55:20.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd20e00640 1 -- start start 2024-05-30T06:55:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd20e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd1c06f9a0 0x7fcd1c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd20e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcd1c0b2ec0 0x7fcd1c0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd20e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd1c15c8f0 con 0x7fcd1c155e60 2024-05-30T06:55:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd20e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcd1c0ccff0 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd20e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcd1c0ccc80 con 0x7fcd1c06f9a0 2024-05-30T06:55:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd19e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcd1c155e60 0x7fcd1c0cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43930/0 (socket says 172.21.15.37:43930) 2024-05-30T06:55:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd19e00640 1 -- 172.21.15.37:0/4144197126 learned_addr learned my addr 172.21.15.37:0/4144197126 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd1a800640 1 --2- 172.21.15.37:0/4144197126 >> v2:172.21.15.105:3300/0 conn(0x7fcd1c0b2ec0 0x7fcd1c0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd19400640 1 --2- 172.21.15.37:0/4144197126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd1c06f9a0 0x7fcd1c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd18a00640 1 -- 172.21.15.37:0/4144197126 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2549348295 0 0) 0x7fcd1c15c8f0 con 0x7fcd1c155e60 2024-05-30T06:55:20.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd18a00640 1 -- 172.21.15.37:0/4144197126 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd00003530 con 0x7fcd1c155e60 2024-05-30T06:55:20.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd1a800640 1 -- 172.21.15.37:0/4144197126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd1c06f9a0 msgr2=0x7fcd1c0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:20.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd1a800640 1 --2- 172.21.15.37:0/4144197126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd1c06f9a0 0x7fcd1c0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd1a800640 1 -- 172.21.15.37:0/4144197126 >> v1:172.21.15.37:6789/0 conn(0x7fcd1c155e60 legacy=0x7fcd1c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.877+0000 7fcd1a800640 1 -- 172.21.15.37:0/4144197126 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c15cbd0 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.881+0000 7fcd1a800640 1 --2- 172.21.15.37:0/4144197126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd1c0b2ec0 0x7fcd1c0cd480 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009d90 tx=0x7fcd1401eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc50bc205f9fad4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:20.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.881+0000 7fcd18a00640 1 -- 172.21.15.37:0/4144197126 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd140b4070 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.881+0000 7fcd18a00640 1 -- 172.21.15.37:0/4144197126 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd140a7b60 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.881+0000 7fcd18a00640 1 -- 172.21.15.37:0/4144197126 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd140af440 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.881+0000 7fcd20e00640 1 -- 172.21.15.37:0/4144197126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd1c0b2ec0 msgr2=0x7fcd1c0cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.881+0000 7fcd20e00640 1 --2- 172.21.15.37:0/4144197126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd1c0b2ec0 0x7fcd1c0cd480 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009d90 tx=0x7fcd1401eb80 comp rx=0 tx=0).stop 2024-05-30T06:55:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.881+0000 7fcd20e00640 1 -- 172.21.15.37:0/4144197126 shutdown_connections 2024-05-30T06:55:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.881+0000 7fcd20e00640 1 --2- 172.21.15.37:0/4144197126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd1c0b2ec0 0x7fcd1c0cd480 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.881+0000 7fcd20e00640 1 --2- 172.21.15.37:0/4144197126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd1c06f9a0 0x7fcd1c0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.881+0000 7fcd20e00640 1 -- 172.21.15.37:0/4144197126 >> 172.21.15.37:0/4144197126 conn(0x7fcd1c0b23a0 msgr2=0x7fcd1c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:20.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.881+0000 7fcd20e00640 1 -- 172.21.15.37:0/4144197126 shutdown_connections 2024-05-30T06:55:20.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.881+0000 7fcd20e00640 1 -- 172.21.15.37:0/4144197126 wait complete. 2024-05-30T06:55:20.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd20e00640 1 Processor -- start 2024-05-30T06:55:20.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd20e00640 1 -- start start 2024-05-30T06:55:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd20e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd1c06f9a0 0x7fcd1c147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd20e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd1c0b2ec0 0x7fcd1c15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd20e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd1c155e60 0x7fcd1c15d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd20e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c06ec20 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd20e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c06eaa0 con 0x7fcd1c155e60 2024-05-30T06:55:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd20e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcd1c06eda0 con 0x7fcd1c06f9a0 2024-05-30T06:55:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd19400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd1c0b2ec0 0x7fcd1c15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd19400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd1c0b2ec0 0x7fcd1c15ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36484/0 (socket says 172.21.15.37:36484) 2024-05-30T06:55:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd19400640 1 -- 172.21.15.37:0/639858524 learned_addr learned my addr 172.21.15.37:0/639858524 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd1a800640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd1c155e60 0x7fcd1c15d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd19e00640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd1c06f9a0 0x7fcd1c147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd19400640 1 -- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd1c06f9a0 msgr2=0x7fcd1c147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd19400640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd1c06f9a0 0x7fcd1c147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd19400640 1 -- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd1c155e60 msgr2=0x7fcd1c15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd19400640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd1c155e60 0x7fcd1c15d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd19400640 1 -- 172.21.15.37:0/639858524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c156790 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd1a800640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd1c155e60 0x7fcd1c15d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd19e00640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd1c06f9a0 0x7fcd1c147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd19400640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd1c0b2ec0 0x7fcd1c15ce00 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800e930 tx=0x7fcd0800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:20.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd12000640 1 -- 172.21.15.37:0/639858524 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08017070 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd12000640 1 -- 172.21.15.37:0/639858524 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd0800ca00 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd12000640 1 -- 172.21.15.37:0/639858524 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0800cdd0 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd20e00640 1 -- 172.21.15.37:0/639858524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1c156a70 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.885+0000 7fcd20e00640 1 -- 172.21.15.37:0/639858524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1c157030 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.889+0000 7fcd20e00640 1 -- 172.21.15.37:0/639858524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1c068b20 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.889+0000 7fcd12000640 1 -- 172.21.15.37:0/639858524 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fcd0801a070 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.889+0000 7fcd12000640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fccfc069910 0x7fccfc06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:20.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.889+0000 7fcd12000640 1 -- 172.21.15.37:0/639858524 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7fcd08085a20 con 0x7fcd1c0b2ec0 2024-05-30T06:55:20.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.889+0000 7fcd19e00640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fccfc069910 0x7fccfc06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:20.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.889+0000 7fcd19e00640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fccfc069910 0x7fccfc06bdd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c005890 tx=0x7fcd0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:20.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:20.893+0000 7fcd12000640 1 -- 172.21.15.37:0/639858524 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd08057af0 con 0x7fcd1c0b2ec0 2024-05-30T06:55:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.057+0000 7fcd20e00640 1 -- 172.21.15.37:0/639858524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd1c072fb0 con 0x7fcd1c0b2ec0 2024-05-30T06:55:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.061+0000 7fcd12000640 1 -- 172.21.15.37:0/639858524 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+16852 (secure 0 0 0) 0x7fcd080573f0 con 0x7fcd1c0b2ec0 2024-05-30T06:55:21.062 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:21.062 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":91,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:55:15.795724+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:53:42.973928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-05-30T06:53:43.524517+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:55:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.061+0000 7fcd20e00640 1 -- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fccfc069910 msgr2=0x7fccfc06bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.061+0000 7fcd20e00640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fccfc069910 0x7fccfc06bdd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c005890 tx=0x7fcd0c009040 comp rx=0 tx=0).stop 2024-05-30T06:55:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.061+0000 7fcd20e00640 1 -- 172.21.15.37:0/639858524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd1c0b2ec0 msgr2=0x7fcd1c15ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.061+0000 7fcd20e00640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd1c0b2ec0 0x7fcd1c15ce00 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800e930 tx=0x7fcd0800edf0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.061+0000 7fcd20e00640 1 -- 172.21.15.37:0/639858524 shutdown_connections 2024-05-30T06:55:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.061+0000 7fcd20e00640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fccfc069910 0x7fccfc06bdd0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.061+0000 7fcd20e00640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd1c155e60 0x7fcd1c15d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.061+0000 7fcd20e00640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd1c0b2ec0 0x7fcd1c15ce00 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.061+0000 7fcd20e00640 1 --2- 172.21.15.37:0/639858524 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd1c06f9a0 0x7fcd1c147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.061+0000 7fcd20e00640 1 -- 172.21.15.37:0/639858524 >> 172.21.15.37:0/639858524 conn(0x7fcd1c0b23a0 msgr2=0x7fcd1c0cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.061+0000 7fcd20e00640 1 -- 172.21.15.37:0/639858524 shutdown_connections 2024-05-30T06:55:21.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.061+0000 7fcd20e00640 1 -- 172.21.15.37:0/639858524 wait complete. 2024-05-30T06:55:21.083 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T06:55:21.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:55:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb692c00640 1 Processor -- start 2024-05-30T06:55:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb692c00640 1 -- start start 2024-05-30T06:55:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb692c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb68c15e930 0x7fb68c09b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb692c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb68c162cb0 0x7fb68c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb692c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb68c09abe0 con 0x7fb68c0d1240 2024-05-30T06:55:21.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb692c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb68c09bee0 con 0x7fb68c162cb0 2024-05-30T06:55:21.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb692c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb68c09aec0 con 0x7fb68c15e930 2024-05-30T06:55:21.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb690c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb68c162cb0 0x7fb68c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb690c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb68c162cb0 0x7fb68c0ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36490/0 (socket says 172.21.15.37:36490) 2024-05-30T06:55:21.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb690c00640 1 -- 172.21.15.37:0/2707099292 learned_addr learned my addr 172.21.15.37:0/2707099292 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:21.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb68be00640 1 --2- 172.21.15.37:0/2707099292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb68c15e930 0x7fb68c09b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb690c00640 1 -- 172.21.15.37:0/2707099292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb68c15e930 msgr2=0x7fb68c09b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:21.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb690c00640 1 --2- 172.21.15.37:0/2707099292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb68c15e930 0x7fb68c09b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb690c00640 1 -- 172.21.15.37:0/2707099292 >> v1:172.21.15.105:6789/0 conn(0x7fb68c0d1240 legacy=0x7fb68c1625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.225+0000 7fb690c00640 1 -- 172.21.15.37:0/2707099292 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68c09b1a0 con 0x7fb68c162cb0 2024-05-30T06:55:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.229+0000 7fb690c00640 1 --2- 172.21.15.37:0/2707099292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c162cb0 0x7fb68c0ccc60 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fb684009e50 tx=0x7fb68401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec732b6ac885d0f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.229+0000 7fb68b400640 1 -- 172.21.15.37:0/2707099292 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6840a5700 con 0x7fb68c162cb0 2024-05-30T06:55:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.229+0000 7fb68b400640 1 -- 172.21.15.37:0/2707099292 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6840a58a0 con 0x7fb68c162cb0 2024-05-30T06:55:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.229+0000 7fb68b400640 1 -- 172.21.15.37:0/2707099292 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6840a5c70 con 0x7fb68c162cb0 2024-05-30T06:55:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.229+0000 7fb692c00640 1 -- 172.21.15.37:0/2707099292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c162cb0 msgr2=0x7fb68c0ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.229+0000 7fb692c00640 1 --2- 172.21.15.37:0/2707099292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c162cb0 0x7fb68c0ccc60 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fb684009e50 tx=0x7fb68401ca30 comp rx=0 tx=0).stop 2024-05-30T06:55:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.229+0000 7fb692c00640 1 -- 172.21.15.37:0/2707099292 shutdown_connections 2024-05-30T06:55:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.229+0000 7fb692c00640 1 --2- 172.21.15.37:0/2707099292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c162cb0 0x7fb68c0ccc60 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.229+0000 7fb692c00640 1 --2- 172.21.15.37:0/2707099292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb68c15e930 0x7fb68c09b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.229+0000 7fb692c00640 1 -- 172.21.15.37:0/2707099292 >> 172.21.15.37:0/2707099292 conn(0x7fb68c0b4100 msgr2=0x7fb68c0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.229+0000 7fb692c00640 1 -- 172.21.15.37:0/2707099292 shutdown_connections 2024-05-30T06:55:21.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.229+0000 7fb692c00640 1 -- 172.21.15.37:0/2707099292 wait complete. 2024-05-30T06:55:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb692c00640 1 Processor -- start 2024-05-30T06:55:21.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb692c00640 1 -- start start 2024-05-30T06:55:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb692c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0d1240 0x7fb68c14dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb692c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb68c15e930 0x7fb68c0cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb692c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb68c162cb0 0x7fb68c0cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb692c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c16bac0 con 0x7fb68c0d1240 2024-05-30T06:55:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb692c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb68c16b940 con 0x7fb68c162cb0 2024-05-30T06:55:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb692c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb68c16bc40 con 0x7fb68c15e930 2024-05-30T06:55:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb68be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0d1240 0x7fb68c14dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb68be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0d1240 0x7fb68c14dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36496/0 (socket says 172.21.15.37:36496) 2024-05-30T06:55:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb68be00640 1 -- 172.21.15.37:0/3031230096 learned_addr learned my addr 172.21.15.37:0/3031230096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb690c00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb68c162cb0 0x7fb68c0cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb683e00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb68c15e930 0x7fb68c0cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb68be00640 1 -- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb68c15e930 msgr2=0x7fb68c0cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb68be00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb68c15e930 0x7fb68c0cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb68be00640 1 -- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb68c162cb0 msgr2=0x7fb68c0cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb68be00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb68c162cb0 0x7fb68c0cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb68be00640 1 -- 172.21.15.37:0/3031230096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb68c0b5db0 con 0x7fb68c0d1240 2024-05-30T06:55:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb690c00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb68c162cb0 0x7fb68c0cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb68be00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0d1240 0x7fb68c14dbf0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00d830 tx=0x7fb67c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb688c00640 1 -- 172.21.15.37:0/3031230096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00b6c0 con 0x7fb68c0d1240 2024-05-30T06:55:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb688c00640 1 -- 172.21.15.37:0/3031230096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb67c019070 con 0x7fb68c0d1240 2024-05-30T06:55:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb688c00640 1 -- 172.21.15.37:0/3031230096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00bae0 con 0x7fb68c0d1240 2024-05-30T06:55:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb692c00640 1 -- 172.21.15.37:0/3031230096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb68c15b5d0 con 0x7fb68c0d1240 2024-05-30T06:55:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.233+0000 7fb692c00640 1 -- 172.21.15.37:0/3031230096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb68c15bb90 con 0x7fb68c0d1240 2024-05-30T06:55:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.237+0000 7fb692c00640 1 -- 172.21.15.37:0/3031230096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb68c06e350 con 0x7fb68c0d1240 2024-05-30T06:55:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.237+0000 7fb688c00640 1 -- 172.21.15.37:0/3031230096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fb67c01e460 con 0x7fb68c0d1240 2024-05-30T06:55:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.237+0000 7fb688c00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb6680698e0 0x7fb66806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.237+0000 7fb688c00640 1 -- 172.21.15.37:0/3031230096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7fb67c086300 con 0x7fb68c0d1240 2024-05-30T06:55:21.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.237+0000 7fb683e00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb6680698e0 0x7fb66806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.237+0000 7fb683e00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb6680698e0 0x7fb66806bda0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb68c15e6a0 tx=0x7fb674009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.241+0000 7fb688c00640 1 -- 172.21.15.37:0/3031230096 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb68c0b5db0 con 0x7fb68c0d1240 2024-05-30T06:55:21.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.441+0000 7fb692c00640 1 -- 172.21.15.37:0/3031230096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb68c0b8490 con 0x7fb68c0d1240 2024-05-30T06:55:21.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.441+0000 7fb688c00640 1 -- 172.21.15.37:0/3031230096 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5186 (secure 0 0 0) 0x7fb67c057e80 con 0x7fb68c0d1240 2024-05-30T06:55:21.444 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:21.444 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/714267880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":714267880},{"type":"v1","addr":"172.21.15.105:6836","nonce":714267880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3425209937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3425209937},{"type":"v1","addr":"172.21.15.37:6834","nonce":3425209937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1537275411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1537275411},{"type":"v1","addr":"172.21.15.37:6835","nonce":1537275411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:53:44.572714+0000","modified":"2024-05-30T06:53:47.596443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7932":{"gid":7932,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/3708478889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3708478889},{"type":"v1","addr":"172.21.15.105:6837","nonce":3708478889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7932,"qdb_cluster":[7932]},"id":6}]} 2024-05-30T06:55:21.444 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 56 2024-05-30T06:55:21.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.445+0000 7fb692c00640 1 -- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb6680698e0 msgr2=0x7fb66806bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.445+0000 7fb692c00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb6680698e0 0x7fb66806bda0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb68c15e6a0 tx=0x7fb674009040 comp rx=0 tx=0).stop 2024-05-30T06:55:21.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.445+0000 7fb692c00640 1 -- 172.21.15.37:0/3031230096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0d1240 msgr2=0x7fb68c14dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.445+0000 7fb692c00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0d1240 0x7fb68c14dbf0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00d830 tx=0x7fb67c00dcf0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.445+0000 7fb692c00640 1 -- 172.21.15.37:0/3031230096 shutdown_connections 2024-05-30T06:55:21.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.445+0000 7fb692c00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb6680698e0 0x7fb66806bda0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.445+0000 7fb692c00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb68c162cb0 0x7fb68c0cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.445+0000 7fb692c00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb68c15e930 0x7fb68c0cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.445+0000 7fb692c00640 1 --2- 172.21.15.37:0/3031230096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0d1240 0x7fb68c14dbf0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.445+0000 7fb692c00640 1 -- 172.21.15.37:0/3031230096 >> 172.21.15.37:0/3031230096 conn(0x7fb68c0b4100 msgr2=0x7fb68c070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:21.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.445+0000 7fb692c00640 1 -- 172.21.15.37:0/3031230096 shutdown_connections 2024-05-30T06:55:21.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.445+0000 7fb692c00640 1 -- 172.21.15.37:0/3031230096 wait complete. 2024-05-30T06:55:21.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:55:21.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff814a00640 1 Processor -- start 2024-05-30T06:55:21.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff814a00640 1 -- start start 2024-05-30T06:55:21.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff814a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8100b2e20 0x7ff810160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff814a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff8101609c0 0x7ff810160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff814a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8100d0430 con 0x7ff8100cd280 2024-05-30T06:55:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff814a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff8100b3200 con 0x7ff8101609c0 2024-05-30T06:55:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff814a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff8100d01e0 con 0x7ff8100b2e20 2024-05-30T06:55:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff80de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8100b2e20 0x7ff810160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff807e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff8101609c0 0x7ff810160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff80e800640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff8100cd280 0x7ff8100cd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:40004/0 (socket says 172.21.15.37:40004) 2024-05-30T06:55:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff80de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8100b2e20 0x7ff810160480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:36984/0 (socket says 172.21.15.37:36984) 2024-05-30T06:55:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff80e800640 1 -- 172.21.15.37:0/1181836612 learned_addr learned my addr 172.21.15.37:0/1181836612 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff807e00640 1 -- 172.21.15.37:0/1181836612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8100b2e20 msgr2=0x7ff810160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff807e00640 1 --2- 172.21.15.37:0/1181836612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8100b2e20 0x7ff810160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff807e00640 1 -- 172.21.15.37:0/1181836612 >> v1:172.21.15.105:6789/0 conn(0x7ff8100cd280 legacy=0x7ff8100cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.605+0000 7ff807e00640 1 -- 172.21.15.37:0/1181836612 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8100d0710 con 0x7ff8101609c0 2024-05-30T06:55:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.609+0000 7ff807e00640 1 --2- 172.21.15.37:0/1181836612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8101609c0 0x7ff810160e20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80097f0 tx=0x7ff7f801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=154476ed2ea6409f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:21.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.609+0000 7ff80d400640 1 -- 172.21.15.37:0/1181836612 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80b2070 con 0x7ff8101609c0 2024-05-30T06:55:21.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.609+0000 7ff80d400640 1 -- 172.21.15.37:0/1181836612 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f80ad640 con 0x7ff8101609c0 2024-05-30T06:55:21.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.609+0000 7ff80d400640 1 -- 172.21.15.37:0/1181836612 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80ada10 con 0x7ff8101609c0 2024-05-30T06:55:21.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.609+0000 7ff814a00640 1 -- 172.21.15.37:0/1181836612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8101609c0 msgr2=0x7ff810160e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.609+0000 7ff814a00640 1 --2- 172.21.15.37:0/1181836612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8101609c0 0x7ff810160e20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80097f0 tx=0x7ff7f801c4a0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.609+0000 7ff814a00640 1 -- 172.21.15.37:0/1181836612 shutdown_connections 2024-05-30T06:55:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.609+0000 7ff814a00640 1 --2- 172.21.15.37:0/1181836612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8101609c0 0x7ff810160e20 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.609+0000 7ff814a00640 1 --2- 172.21.15.37:0/1181836612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8100b2e20 0x7ff810160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.609+0000 7ff814a00640 1 -- 172.21.15.37:0/1181836612 >> 172.21.15.37:0/1181836612 conn(0x7ff8100b4100 msgr2=0x7ff8100b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.609+0000 7ff814a00640 1 -- 172.21.15.37:0/1181836612 shutdown_connections 2024-05-30T06:55:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.609+0000 7ff814a00640 1 -- 172.21.15.37:0/1181836612 wait complete. 2024-05-30T06:55:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff814a00640 1 Processor -- start 2024-05-30T06:55:21.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff814a00640 1 -- start start 2024-05-30T06:55:21.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff814a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8100b2e20 0x7ff81014d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff814a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8100cd280 0x7ff8100b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff814a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8101609c0 0x7ff8100b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff814a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff810169940 con 0x7ff8100cd280 2024-05-30T06:55:21.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff814a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff8101697c0 con 0x7ff8100b2e20 2024-05-30T06:55:21.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff814a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff810169ac0 con 0x7ff8101609c0 2024-05-30T06:55:21.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff807e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8100cd280 0x7ff8100b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff807e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8100cd280 0x7ff8100b61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36508/0 (socket says 172.21.15.37:36508) 2024-05-30T06:55:21.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff807e00640 1 -- 172.21.15.37:0/984652482 learned_addr learned my addr 172.21.15.37:0/984652482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:21.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff80de00640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8100b2e20 0x7ff81014d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff80e800640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8101609c0 0x7ff8100b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff807e00640 1 -- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8101609c0 msgr2=0x7ff8100b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff807e00640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8101609c0 0x7ff8100b7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff807e00640 1 -- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8100b2e20 msgr2=0x7ff81014d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff807e00640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8100b2e20 0x7ff81014d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff807e00640 1 -- 172.21.15.37:0/984652482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8100b6700 con 0x7ff8100cd280 2024-05-30T06:55:21.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff80de00640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8100b2e20 0x7ff81014d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:21.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff807e00640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8100cd280 0x7ff8100b61c0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80097f0 tx=0x7ff7f8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:21.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff806000640 1 -- 172.21.15.37:0/984652482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80bc020 con 0x7ff8100cd280 2024-05-30T06:55:21.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff806000640 1 -- 172.21.15.37:0/984652482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f80b8420 con 0x7ff8100cd280 2024-05-30T06:55:21.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff814a00640 1 -- 172.21.15.37:0/984652482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8100b8090 con 0x7ff8100cd280 2024-05-30T06:55:21.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff806000640 1 -- 172.21.15.37:0/984652482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80b2040 con 0x7ff8100cd280 2024-05-30T06:55:21.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.613+0000 7ff814a00640 1 -- 172.21.15.37:0/984652482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81015f2e0 con 0x7ff8100cd280 2024-05-30T06:55:21.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.617+0000 7ff814a00640 1 -- 172.21.15.37:0/984652482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff810068b20 con 0x7ff8100cd280 2024-05-30T06:55:21.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.617+0000 7ff806000640 1 -- 172.21.15.37:0/984652482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7ff7f80bf020 con 0x7ff8100cd280 2024-05-30T06:55:21.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.617+0000 7ff806000640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7ec0698e0 0x7ff7ec06bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.617+0000 7ff806000640 1 -- 172.21.15.37:0/984652482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7ff7f8120030 con 0x7ff8100cd280 2024-05-30T06:55:21.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.617+0000 7ff80de00640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7ec0698e0 0x7ff7ec06bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.617+0000 7ff80de00640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7ec0698e0 0x7ff7ec06bda0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff800009b10 tx=0x7ff800008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:21.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.621+0000 7ff806000640 1 -- 172.21.15.37:0/984652482 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff7f80c6030 con 0x7ff8100cd280 2024-05-30T06:55:21.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.821+0000 7ff814a00640 1 -- 172.21.15.37:0/984652482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8100ce860 con 0x7ff8100cd280 2024-05-30T06:55:21.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.821+0000 7ff806000640 1 -- 172.21.15.37:0/984652482 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5186 (secure 0 0 0) 0x7ff8100b8090 con 0x7ff8100cd280 2024-05-30T06:55:21.823 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:21.823 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":56,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/714267880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":714267880},{"type":"v1","addr":"172.21.15.105:6836","nonce":714267880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3425209937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3425209937},{"type":"v1","addr":"172.21.15.37:6834","nonce":3425209937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1537275411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1537275411},{"type":"v1","addr":"172.21.15.37:6835","nonce":1537275411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:53:44.572714+0000","modified":"2024-05-30T06:53:47.596443+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7932":{"gid":7932,"name":"b","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/3708478889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":3708478889},{"type":"v1","addr":"172.21.15.105:6837","nonce":3708478889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7932,"qdb_cluster":[7932]},"id":6}]} 2024-05-30T06:55:21.824 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 56 2024-05-30T06:55:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.825+0000 7ff814a00640 1 -- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7ec0698e0 msgr2=0x7ff7ec06bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.825+0000 7ff814a00640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7ec0698e0 0x7ff7ec06bda0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff800009b10 tx=0x7ff800008040 comp rx=0 tx=0).stop 2024-05-30T06:55:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.825+0000 7ff814a00640 1 -- 172.21.15.37:0/984652482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8100cd280 msgr2=0x7ff8100b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.825+0000 7ff814a00640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8100cd280 0x7ff8100b61c0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7ff7f80097f0 tx=0x7ff7f8019240 comp rx=0 tx=0).stop 2024-05-30T06:55:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.825+0000 7ff814a00640 1 -- 172.21.15.37:0/984652482 shutdown_connections 2024-05-30T06:55:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.825+0000 7ff814a00640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff8101609c0 0x7ff8100b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.825+0000 7ff814a00640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8100cd280 0x7ff8100b61c0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.825+0000 7ff814a00640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7ec0698e0 0x7ff7ec06bda0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.825+0000 7ff814a00640 1 --2- 172.21.15.37:0/984652482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8100b2e20 0x7ff81014d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.825+0000 7ff814a00640 1 -- 172.21.15.37:0/984652482 >> 172.21.15.37:0/984652482 conn(0x7ff8100b4100 msgr2=0x7ff810070640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.825+0000 7ff814a00640 1 -- 172.21.15.37:0/984652482 shutdown_connections 2024-05-30T06:55:21.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.825+0000 7ff814a00640 1 -- 172.21.15.37:0/984652482 wait complete. 2024-05-30T06:55:21.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:55:21.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bdc400640 1 Processor -- start 2024-05-30T06:55:21.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bdc400640 1 -- start start 2024-05-30T06:55:21.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bdc400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1bd415e930 0x7f1bd409b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bdc400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1bd4162cb0 0x7f1bd40ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bdc400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd409abe0 con 0x7f1bd40d1240 2024-05-30T06:55:21.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bdc400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd409bee0 con 0x7f1bd4162cb0 2024-05-30T06:55:21.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bdc400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd409aec0 con 0x7f1bd415e930 2024-05-30T06:55:21.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bd9000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1bd40d1240 0x7f1bd41625a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43946/0 (socket says 172.21.15.37:43946) 2024-05-30T06:55:21.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bda400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1bd4162cb0 0x7f1bd40ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bd9000640 1 -- 172.21.15.37:0/645746904 learned_addr learned my addr 172.21.15.37:0/645746904 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:21.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bd9a00640 1 --2- 172.21.15.37:0/645746904 >> v2:172.21.15.105:3300/0 conn(0x7f1bd415e930 0x7f1bd409b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bd3e00640 1 -- 172.21.15.37:0/645746904 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2436806336 0 0) 0x7f1bd409abe0 con 0x7f1bd40d1240 2024-05-30T06:55:21.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bd3e00640 1 -- 172.21.15.37:0/645746904 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bbc003530 con 0x7f1bd40d1240 2024-05-30T06:55:21.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bda400640 1 -- 172.21.15.37:0/645746904 >> v2:172.21.15.105:3300/0 conn(0x7f1bd415e930 msgr2=0x7f1bd409b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:21.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bda400640 1 --2- 172.21.15.37:0/645746904 >> v2:172.21.15.105:3300/0 conn(0x7f1bd415e930 0x7f1bd409b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bda400640 1 -- 172.21.15.37:0/645746904 >> v1:172.21.15.37:6789/0 conn(0x7f1bd40d1240 legacy=0x7f1bd41625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bda400640 1 -- 172.21.15.37:0/645746904 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd409b1a0 con 0x7f1bd4162cb0 2024-05-30T06:55:21.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.985+0000 7f1bd9a00640 1 --2- 172.21.15.37:0/645746904 >> v2:172.21.15.105:3300/0 conn(0x7f1bd415e930 0x7f1bd409b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:21.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.989+0000 7f1bda400640 1 --2- 172.21.15.37:0/645746904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd4162cb0 0x7f1bd40ccc60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f1bd406ff70 tx=0x7f1bcc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74405908882ad572 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:21.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.989+0000 7f1bd3e00640 1 -- 172.21.15.37:0/645746904 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0b2070 con 0x7f1bd4162cb0 2024-05-30T06:55:21.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.989+0000 7f1bd3e00640 1 -- 172.21.15.37:0/645746904 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bcc0a57f0 con 0x7f1bd4162cb0 2024-05-30T06:55:21.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.989+0000 7f1bd3e00640 1 -- 172.21.15.37:0/645746904 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0a5bc0 con 0x7f1bd4162cb0 2024-05-30T06:55:21.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.989+0000 7f1bdc400640 1 -- 172.21.15.37:0/645746904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd4162cb0 msgr2=0x7f1bd40ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.989+0000 7f1bdc400640 1 --2- 172.21.15.37:0/645746904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd4162cb0 0x7f1bd40ccc60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f1bd406ff70 tx=0x7f1bcc01c930 comp rx=0 tx=0).stop 2024-05-30T06:55:21.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.989+0000 7f1bdc400640 1 -- 172.21.15.37:0/645746904 shutdown_connections 2024-05-30T06:55:21.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.989+0000 7f1bdc400640 1 --2- 172.21.15.37:0/645746904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd4162cb0 0x7f1bd40ccc60 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.989+0000 7f1bdc400640 1 --2- 172.21.15.37:0/645746904 >> v2:172.21.15.105:3300/0 conn(0x7f1bd415e930 0x7f1bd409b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.989+0000 7f1bdc400640 1 -- 172.21.15.37:0/645746904 >> 172.21.15.37:0/645746904 conn(0x7f1bd40b4100 msgr2=0x7f1bd40b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:21.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.989+0000 7f1bdc400640 1 -- 172.21.15.37:0/645746904 shutdown_connections 2024-05-30T06:55:21.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.989+0000 7f1bdc400640 1 -- 172.21.15.37:0/645746904 wait complete. 2024-05-30T06:55:21.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bdc400640 1 Processor -- start 2024-05-30T06:55:21.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bdc400640 1 -- start start 2024-05-30T06:55:21.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bdc400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bd40d1240 0x7f1bd41518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bdc400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bd415e930 0x7f1bd415b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bdc400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd4162cb0 0x7f1bd40b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bdc400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd416bac0 con 0x7f1bd4162cb0 2024-05-30T06:55:21.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bdc400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd416b940 con 0x7f1bd40d1240 2024-05-30T06:55:21.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bdc400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd416bc40 con 0x7f1bd415e930 2024-05-30T06:55:21.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bda400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd4162cb0 0x7f1bd40b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bda400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd4162cb0 0x7f1bd40b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36534/0 (socket says 172.21.15.37:36534) 2024-05-30T06:55:21.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bda400640 1 -- 172.21.15.37:0/378565692 learned_addr learned my addr 172.21.15.37:0/378565692 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:21.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bda400640 1 -- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bd415e930 msgr2=0x7f1bd415b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bda400640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bd415e930 0x7f1bd415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bda400640 1 -- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bd40d1240 msgr2=0x7f1bd41518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:21.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bd9a00640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bd40d1240 0x7f1bd41518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bda400640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bd40d1240 0x7f1bd41518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:21.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bda400640 1 -- 172.21.15.37:0/378565692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd415b990 con 0x7f1bd4162cb0 2024-05-30T06:55:21.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bd9a00640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bd40d1240 0x7f1bd41518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:21.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bda400640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd4162cb0 0x7f1bd40b5460 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc019540 tx=0x7f1bcc0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:21.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bd1600640 1 -- 172.21.15.37:0/378565692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0b2050 con 0x7f1bd4162cb0 2024-05-30T06:55:21.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bd1600640 1 -- 172.21.15.37:0/378565692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bcc0be070 con 0x7f1bd4162cb0 2024-05-30T06:55:21.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bdc400640 1 -- 172.21.15.37:0/378565692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd40b68c0 con 0x7f1bd4162cb0 2024-05-30T06:55:21.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bd1600640 1 -- 172.21.15.37:0/378565692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0ad870 con 0x7f1bd4162cb0 2024-05-30T06:55:21.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bdc400640 1 -- 172.21.15.37:0/378565692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd4153110 con 0x7f1bd4162cb0 2024-05-30T06:55:21.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.993+0000 7f1bdc400640 1 -- 172.21.15.37:0/378565692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd4068b20 con 0x7f1bd4162cb0 2024-05-30T06:55:21.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.997+0000 7f1bd1600640 1 -- 172.21.15.37:0/378565692 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f1bcc0ada10 con 0x7f1bd4162cb0 2024-05-30T06:55:21.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.997+0000 7f1bd1600640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1bb40698e0 0x7f1bb406bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:21.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.997+0000 7f1bd1600640 1 -- 172.21.15.37:0/378565692 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7f1bcc120b90 con 0x7f1bd4162cb0 2024-05-30T06:55:21.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.997+0000 7f1bd9a00640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1bb40698e0 0x7f1bb406bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:21.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:21.997+0000 7f1bd9a00640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1bb40698e0 0x7f1bb406bda0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009980 tx=0x7f1bc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:22.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.001+0000 7f1bd1600640 1 -- 172.21.15.37:0/378565692 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1bcc016520 con 0x7f1bd4162cb0 2024-05-30T06:55:22.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bdc400640 1 -- 172.21.15.37:0/378565692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bd406e350 con 0x7f1bd4162cb0 2024-05-30T06:55:22.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bd1600640 1 -- 172.21.15.37:0/378565692 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+16852 (secure 0 0 0) 0x7f1bcc0f28c0 con 0x7f1bd4162cb0 2024-05-30T06:55:22.171 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:22.171 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":91,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:55:15.795724+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:53:42.973928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-05-30T06:53:43.524517+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.3e","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":13,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:55:22.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bdc400640 1 -- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1bb40698e0 msgr2=0x7f1bb406bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:22.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bdc400640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1bb40698e0 0x7f1bb406bda0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009980 tx=0x7f1bc8008040 comp rx=0 tx=0).stop 2024-05-30T06:55:22.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bdc400640 1 -- 172.21.15.37:0/378565692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd4162cb0 msgr2=0x7f1bd40b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:22.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bdc400640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd4162cb0 0x7f1bd40b5460 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc019540 tx=0x7f1bcc0196d0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bdc400640 1 -- 172.21.15.37:0/378565692 shutdown_connections 2024-05-30T06:55:22.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bdc400640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd4162cb0 0x7f1bd40b5460 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bdc400640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1bd415e930 0x7f1bd415b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bdc400640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1bb40698e0 0x7f1bb406bda0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bdc400640 1 --2- 172.21.15.37:0/378565692 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1bd40d1240 0x7f1bd41518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bdc400640 1 -- 172.21.15.37:0/378565692 >> 172.21.15.37:0/378565692 conn(0x7f1bd40b4100 msgr2=0x7f1bd406d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:22.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bdc400640 1 -- 172.21.15.37:0/378565692 shutdown_connections 2024-05-30T06:55:22.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.169+0000 7f1bdc400640 1 -- 172.21.15.37:0/378565692 wait complete. 2024-05-30T06:55:22.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T06:55:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f1753c00640 1 Processor -- start 2024-05-30T06:55:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f1753c00640 1 -- start start 2024-05-30T06:55:22.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f1753c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c06fd30 0x7f174c06b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f1753c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f174c070be0 con 0x7f174c0b0920 2024-05-30T06:55:22.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f1753c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f174c070eb0 con 0x7f174c06bea0 2024-05-30T06:55:22.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f1753c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f174c162500 con 0x7f174c06fd30 2024-05-30T06:55:22.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f1751200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f174c0b0920 0x7f174c0704d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43950/0 (socket says 172.21.15.37:43950) 2024-05-30T06:55:22.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f1751200640 1 -- 172.21.15.37:0/2098696024 learned_addr learned my addr 172.21.15.37:0/2098696024 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:22.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354875082 0 0) 0x7f174c070be0 con 0x7f174c0b0920 2024-05-30T06:55:22.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174be00640 1 --2- 172.21.15.37:0/2098696024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c06fd30 0x7f174c06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1734003530 con 0x7f174c0b0920 2024-05-30T06:55:22.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3877588824 0 0) 0x7f1734003530 con 0x7f174c0b0920 2024-05-30T06:55:22.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c06fd30 msgr2=0x7f174c06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:22.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 --2- 172.21.15.37:0/2098696024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c06fd30 0x7f174c06b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 >> v1:172.21.15.105:6789/0 conn(0x7f174c06bea0 legacy=0x7f174c0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c06ef70 con 0x7f174c0b0920 2024-05-30T06:55:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f1740001680 con 0x7f174c0b0920 2024-05-30T06:55:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 >> v1:172.21.15.37:6789/0 conn(0x7f174c0b0920 legacy=0x7f174c0704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 --2- 172.21.15.37:0/2098696024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17340039f0 0x7f1734003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 --2- 172.21.15.37:0/2098696024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1734004810 0x7f1734004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 --2- 172.21.15.37:0/2098696024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c06fd30 0x7f17340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f174c162500 con 0x7f17340039f0 2024-05-30T06:55:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f173400bb10 con 0x7f1734004810 2024-05-30T06:55:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f173400bd10 con 0x7f174c06fd30 2024-05-30T06:55:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f1751200640 1 --2- 172.21.15.37:0/2098696024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17340039f0 0x7f1734003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f174be00640 1 --2- 172.21.15.37:0/2098696024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1734004810 0x7f1734004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f1751c00640 1 --2- 172.21.15.37:0/2098696024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c06fd30 0x7f17340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f1751200640 1 -- 172.21.15.37:0/2098696024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c06fd30 msgr2=0x7f17340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.333+0000 7f1751200640 1 --2- 172.21.15.37:0/2098696024 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c06fd30 0x7f17340051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f1751200640 1 -- 172.21.15.37:0/2098696024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1734004810 msgr2=0x7f1734004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f1751200640 1 --2- 172.21.15.37:0/2098696024 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1734004810 0x7f1734004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f1751200640 1 -- 172.21.15.37:0/2098696024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1734003530 con 0x7f17340039f0 2024-05-30T06:55:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f1751200640 1 --2- 172.21.15.37:0/2098696024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17340039f0 0x7f1734003e10 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1740001ec0 tx=0x7f174001f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2533e5894f761e0f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740007d40 con 0x7f17340039f0 2024-05-30T06:55:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1740005b00 con 0x7f17340039f0 2024-05-30T06:55:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f174b400640 1 -- 172.21.15.37:0/2098696024 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740007070 con 0x7f17340039f0 2024-05-30T06:55:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f1753c00640 1 -- 172.21.15.37:0/2098696024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17340039f0 msgr2=0x7f1734003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f1753c00640 1 --2- 172.21.15.37:0/2098696024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17340039f0 0x7f1734003e10 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1740001ec0 tx=0x7f174001f3b0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f1751c00640 1 -- 172.21.15.37:0/2098696024 reap_dead start 2024-05-30T06:55:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f1753c00640 1 -- 172.21.15.37:0/2098696024 shutdown_connections 2024-05-30T06:55:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f1753c00640 1 -- 172.21.15.37:0/2098696024 >> 172.21.15.37:0/2098696024 conn(0x7f174c09aa60 msgr2=0x7f174c0d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f1753c00640 1 -- 172.21.15.37:0/2098696024 shutdown_connections 2024-05-30T06:55:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.337+0000 7f1753c00640 1 -- 172.21.15.37:0/2098696024 wait complete. 2024-05-30T06:55:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1753c00640 1 Processor -- start 2024-05-30T06:55:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1753c00640 1 -- start start 2024-05-30T06:55:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1753c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17340039f0 0x7f174c1566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1753c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f174c0caba0 0x7f174c0cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1753c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c0cb020 0x7f174c0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1753c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f174c06f810 con 0x7f174c0caba0 2024-05-30T06:55:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1753c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f174c06f530 con 0x7f17340039f0 2024-05-30T06:55:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1753c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f174c0d21b0 con 0x7f174c0cb020 2024-05-30T06:55:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f174be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f174c0caba0 0x7f174c0cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f174be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f174c0caba0 0x7f174c0cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36552/0 (socket says 172.21.15.37:36552) 2024-05-30T06:55:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f174be00640 1 -- 172.21.15.37:0/1820855609 learned_addr learned my addr 172.21.15.37:0/1820855609 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1751200640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17340039f0 0x7f174c1566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1751c00640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c0cb020 0x7f174c0cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f174be00640 1 -- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c0cb020 msgr2=0x7f174c0cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f174be00640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c0cb020 0x7f174c0cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f174be00640 1 -- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17340039f0 msgr2=0x7f174c1566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f174be00640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17340039f0 0x7f174c1566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f174be00640 1 -- 172.21.15.37:0/1820855609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c0b43b0 con 0x7f174c0caba0 2024-05-30T06:55:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1751200640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17340039f0 0x7f174c1566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f174be00640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f174c0caba0 0x7f174c0cbe90 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f1738011990 tx=0x7f1738011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1748c00640 1 -- 172.21.15.37:0/1820855609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173800fa70 con 0x7f174c0caba0 2024-05-30T06:55:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1748c00640 1 -- 172.21.15.37:0/1820855609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f173800fc10 con 0x7f174c0caba0 2024-05-30T06:55:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1753c00640 1 -- 172.21.15.37:0/1820855609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c0b4690 con 0x7f174c0caba0 2024-05-30T06:55:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.341+0000 7f1748c00640 1 -- 172.21.15.37:0/1820855609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1738014440 con 0x7f174c0caba0 2024-05-30T06:55:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.345+0000 7f1753c00640 1 -- 172.21.15.37:0/1820855609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c0b4c50 con 0x7f174c0caba0 2024-05-30T06:55:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.345+0000 7f1753c00640 1 -- 172.21.15.37:0/1820855609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f174c068bc0 con 0x7f174c0caba0 2024-05-30T06:55:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.345+0000 7f1748c00640 1 -- 172.21.15.37:0/1820855609 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f1738012040 con 0x7f174c0caba0 2024-05-30T06:55:22.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.345+0000 7f1748c00640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f172c0698e0 0x7f172c06bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.345+0000 7f1748c00640 1 -- 172.21.15.37:0/1820855609 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5822+0+0 (secure 0 0 0) 0x7f1738086040 con 0x7f174c0caba0 2024-05-30T06:55:22.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.345+0000 7f1751200640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f172c0698e0 0x7f172c06bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.349+0000 7f1751200640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f172c0698e0 0x7f172c06bda0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f17400af000 tx=0x7f17400aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:22.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.349+0000 7f1748c00640 1 -- 172.21.15.37:0/1820855609 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1738019030 con 0x7f174c0caba0 2024-05-30T06:55:22.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.549+0000 7f1753c00640 1 -- 172.21.15.37:0/1820855609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f174c0b7400 con 0x7f174c0caba0 2024-05-30T06:55:22.552 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-30T06:55:22.549+0000 7fd1bb400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T06:55:22.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.553+0000 7f1748c00640 1 -- 172.21.15.37:0/1820855609 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) ==== 161+0+0 (secure 0 0 0) 0x7f1738057cb0 con 0x7f174c0caba0 2024-05-30T06:55:22.553 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T06:55:22.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.553+0000 7f1753c00640 1 -- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f172c0698e0 msgr2=0x7f172c06bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:22.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.553+0000 7f1753c00640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f172c0698e0 0x7f172c06bda0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f17400af000 tx=0x7f17400aa000 comp rx=0 tx=0).stop 2024-05-30T06:55:22.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.553+0000 7f1753c00640 1 -- 172.21.15.37:0/1820855609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f174c0caba0 msgr2=0x7f174c0cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:22.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.553+0000 7f1753c00640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f174c0caba0 0x7f174c0cbe90 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f1738011990 tx=0x7f1738011e50 comp rx=0 tx=0).stop 2024-05-30T06:55:22.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.553+0000 7f1753c00640 1 -- 172.21.15.37:0/1820855609 shutdown_connections 2024-05-30T06:55:22.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.553+0000 7f1753c00640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c0cb020 0x7f174c0cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.553+0000 7f1753c00640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f174c0caba0 0x7f174c0cbe90 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.553+0000 7f1753c00640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f172c0698e0 0x7f172c06bda0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.553+0000 7f1753c00640 1 --2- 172.21.15.37:0/1820855609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17340039f0 0x7f174c1566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.553+0000 7f1753c00640 1 -- 172.21.15.37:0/1820855609 >> 172.21.15.37:0/1820855609 conn(0x7f174c09aa60 msgr2=0x7f174c161980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:22.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.553+0000 7f1753c00640 1 -- 172.21.15.37:0/1820855609 shutdown_connections 2024-05-30T06:55:22.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.553+0000 7f1753c00640 1 -- 172.21.15.37:0/1820855609 wait complete. 2024-05-30T06:55:22.576 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T06:55:22.625 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-05-30T06:55:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3dd200640 1 Processor -- start 2024-05-30T06:55:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3dd200640 1 -- start start 2024-05-30T06:55:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3dd200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3d80b59d0 0x7fe3d80b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3dd200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe3d815d350 0x7fe3d8160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3dd200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3d815d7b0 0x7fe3d81607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3dd200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d80b62f0 con 0x7fe3d815d7b0 2024-05-30T06:55:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3dd200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe3d8142030 con 0x7fe3d815d350 2024-05-30T06:55:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3dd200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d8142310 con 0x7fe3d80b59d0 2024-05-30T06:55:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3d6800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3d815d7b0 0x7fe3d81607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3d6800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3d815d7b0 0x7fe3d81607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36558/0 (socket says 172.21.15.37:36558) 2024-05-30T06:55:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3d6800640 1 -- 172.21.15.37:0/111081110 learned_addr learned my addr 172.21.15.37:0/111081110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3cfe00640 1 --2- 172.21.15.37:0/111081110 >> v2:172.21.15.105:3300/0 conn(0x7fe3d815d350 0x7fe3d8160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3d5e00640 1 --2- 172.21.15.37:0/111081110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3d80b59d0 0x7fe3d80b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3d6800640 1 -- 172.21.15.37:0/111081110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3d80b59d0 msgr2=0x7fe3d80b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3d6800640 1 --2- 172.21.15.37:0/111081110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3d80b59d0 0x7fe3d80b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3d6800640 1 -- 172.21.15.37:0/111081110 >> v2:172.21.15.105:3300/0 conn(0x7fe3d815d350 msgr2=0x7fe3d8160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3d6800640 1 --2- 172.21.15.37:0/111081110 >> v2:172.21.15.105:3300/0 conn(0x7fe3d815d350 0x7fe3d8160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.717+0000 7fe3d6800640 1 -- 172.21.15.37:0/111081110 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d81425f0 con 0x7fe3d815d7b0 2024-05-30T06:55:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.721+0000 7fe3d6800640 1 --2- 172.21.15.37:0/111081110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d815d7b0 0x7fe3d81607c0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fe3d806c610 tx=0x7fe3d001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5025f410971993e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.721+0000 7fe3d5400640 1 -- 172.21.15.37:0/111081110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00b4070 con 0x7fe3d815d7b0 2024-05-30T06:55:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.721+0000 7fe3d5400640 1 -- 172.21.15.37:0/111081110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d00af400 con 0x7fe3d815d7b0 2024-05-30T06:55:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.721+0000 7fe3d5400640 1 -- 172.21.15.37:0/111081110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00af7d0 con 0x7fe3d815d7b0 2024-05-30T06:55:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.721+0000 7fe3dd200640 1 -- 172.21.15.37:0/111081110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d815d7b0 msgr2=0x7fe3d81607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.721+0000 7fe3dd200640 1 --2- 172.21.15.37:0/111081110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d815d7b0 0x7fe3d81607c0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fe3d806c610 tx=0x7fe3d001f1e0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.721+0000 7fe3dd200640 1 -- 172.21.15.37:0/111081110 shutdown_connections 2024-05-30T06:55:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.721+0000 7fe3dd200640 1 --2- 172.21.15.37:0/111081110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d815d7b0 0x7fe3d81607c0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.721+0000 7fe3dd200640 1 --2- 172.21.15.37:0/111081110 >> v2:172.21.15.105:3300/0 conn(0x7fe3d815d350 0x7fe3d8160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.721+0000 7fe3dd200640 1 --2- 172.21.15.37:0/111081110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3d80b59d0 0x7fe3d80b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.721+0000 7fe3dd200640 1 -- 172.21.15.37:0/111081110 >> 172.21.15.37:0/111081110 conn(0x7fe3d806bf60 msgr2=0x7fe3d80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.721+0000 7fe3dd200640 1 -- 172.21.15.37:0/111081110 shutdown_connections 2024-05-30T06:55:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.721+0000 7fe3dd200640 1 -- 172.21.15.37:0/111081110 wait complete. 2024-05-30T06:55:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3dd200640 1 Processor -- start 2024-05-30T06:55:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3dd200640 1 -- start start 2024-05-30T06:55:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3dd200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3d80b59d0 0x7fe3d813ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3dd200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3d815d350 0x7fe3d80aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3dd200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d815d7b0 0x7fe3d81601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3dd200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d813fe60 con 0x7fe3d815d7b0 2024-05-30T06:55:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3dd200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d813fce0 con 0x7fe3d815d350 2024-05-30T06:55:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3dd200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe3d80aff20 con 0x7fe3d80b59d0 2024-05-30T06:55:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3d6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d815d7b0 0x7fe3d81601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3d6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d815d7b0 0x7fe3d81601f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36572/0 (socket says 172.21.15.37:36572) 2024-05-30T06:55:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3d6800640 1 -- 172.21.15.37:0/1225375752 learned_addr learned my addr 172.21.15.37:0/1225375752 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3cfe00640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3d815d350 0x7fe3d80aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3d5e00640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3d80b59d0 0x7fe3d813ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3d6800640 1 -- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3d80b59d0 msgr2=0x7fe3d813ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3d6800640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3d80b59d0 0x7fe3d813ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3d6800640 1 -- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3d815d350 msgr2=0x7fe3d80aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3d6800640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3d815d350 0x7fe3d80aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3d6800640 1 -- 172.21.15.37:0/1225375752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d8156d60 con 0x7fe3d815d7b0 2024-05-30T06:55:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3d6800640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d815d7b0 0x7fe3d81601f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00b2040 tx=0x7fe3d001bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3ce000640 1 -- 172.21.15.37:0/1225375752 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00b4040 con 0x7fe3d815d7b0 2024-05-30T06:55:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3ce000640 1 -- 172.21.15.37:0/1225375752 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d00c1070 con 0x7fe3d815d7b0 2024-05-30T06:55:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3dd200640 1 -- 172.21.15.37:0/1225375752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d81f7ed0 con 0x7fe3d815d7b0 2024-05-30T06:55:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3ce000640 1 -- 172.21.15.37:0/1225375752 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0009510 con 0x7fe3d815d7b0 2024-05-30T06:55:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.725+0000 7fe3dd200640 1 -- 172.21.15.37:0/1225375752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d81f8450 con 0x7fe3d815d7b0 2024-05-30T06:55:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.729+0000 7fe3dd200640 1 -- 172.21.15.37:0/1225375752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d8068bc0 con 0x7fe3d815d7b0 2024-05-30T06:55:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.729+0000 7fe3ce000640 1 -- 172.21.15.37:0/1225375752 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fe3d00b7070 con 0x7fe3d815d7b0 2024-05-30T06:55:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.729+0000 7fe3ce000640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe3b40698e0 0x7fe3b406bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.729+0000 7fe3ce000640 1 -- 172.21.15.37:0/1225375752 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5880+0+0 (secure 0 0 0) 0x7fe3d01239f0 con 0x7fe3d815d7b0 2024-05-30T06:55:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.729+0000 7fe3d5e00640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe3b40698e0 0x7fe3b406bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:22.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.729+0000 7fe3d5e00640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe3b40698e0 0x7fe3b406bda0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009a40 tx=0x7fe3c8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.733+0000 7fe3ce000640 1 -- 172.21.15.37:0/1225375752 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe3d8156d60 con 0x7fe3d815d7b0 2024-05-30T06:55:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:22.933+0000 7fe3dd200640 1 -- 172.21.15.37:0/1225375752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe3d806f0a0 con 0x7fe3d815d7b0 2024-05-30T06:55:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.553+0000 7fe3ce000640 1 -- 172.21.15.37:0/1225375752 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) ==== 104+0+0 (secure 0 0 0) 0x7fe3d0018d40 con 0x7fe3d815d7b0 2024-05-30T06:55:23.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.557+0000 7fe3dd200640 1 -- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe3b40698e0 msgr2=0x7fe3b406bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:23.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.557+0000 7fe3dd200640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe3b40698e0 0x7fe3b406bda0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009a40 tx=0x7fe3c8009190 comp rx=0 tx=0).stop 2024-05-30T06:55:23.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.557+0000 7fe3dd200640 1 -- 172.21.15.37:0/1225375752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d815d7b0 msgr2=0x7fe3d81601f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:23.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.557+0000 7fe3dd200640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d815d7b0 0x7fe3d81601f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00b2040 tx=0x7fe3d001bf80 comp rx=0 tx=0).stop 2024-05-30T06:55:23.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.557+0000 7fe3dd200640 1 -- 172.21.15.37:0/1225375752 shutdown_connections 2024-05-30T06:55:23.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.557+0000 7fe3dd200640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d815d7b0 0x7fe3d81601f0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:23.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.557+0000 7fe3dd200640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe3b40698e0 0x7fe3b406bda0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:23.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.557+0000 7fe3dd200640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe3d815d350 0x7fe3d80aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:23.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.557+0000 7fe3dd200640 1 --2- 172.21.15.37:0/1225375752 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3d80b59d0 0x7fe3d813ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:23.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.557+0000 7fe3dd200640 1 -- 172.21.15.37:0/1225375752 >> 172.21.15.37:0/1225375752 conn(0x7fe3d806bf60 msgr2=0x7fe3d80b04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:23.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.557+0000 7fe3dd200640 1 -- 172.21.15.37:0/1225375752 shutdown_connections 2024-05-30T06:55:23.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.557+0000 7fe3dd200640 1 -- 172.21.15.37:0/1225375752 wait complete. 2024-05-30T06:55:23.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T06:55:23.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611f200640 1 Processor -- start 2024-05-30T06:55:23.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611f200640 1 -- start start 2024-05-30T06:55:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611f200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6120145da0 0x7f6120160200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611f200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6120072510 0x7f61200cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611f200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6120160b50 con 0x7f612006f120 2024-05-30T06:55:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611f200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f61200cd210 con 0x7f6120072510 2024-05-30T06:55:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611f200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6120160e30 con 0x7f6120145da0 2024-05-30T06:55:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611e800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6120072510 0x7f61200cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f6117e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f612006f120 0x7f6120071e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43964/0 (socket says 172.21.15.37:43964) 2024-05-30T06:55:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f6117e00640 1 -- 172.21.15.37:0/837332591 learned_addr learned my addr 172.21.15.37:0/837332591 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611de00640 1 --2- 172.21.15.37:0/837332591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6120145da0 0x7f6120160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611e800640 1 -- 172.21.15.37:0/837332591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6120145da0 msgr2=0x7f6120160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:23.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611e800640 1 --2- 172.21.15.37:0/837332591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6120145da0 0x7f6120160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:23.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611e800640 1 -- 172.21.15.37:0/837332591 >> v1:172.21.15.37:6789/0 conn(0x7f612006f120 legacy=0x7f6120071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:23.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611e800640 1 -- 172.21.15.37:0/837332591 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6120161110 con 0x7f6120072510 2024-05-30T06:55:23.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.729+0000 7f611d400640 1 -- 172.21.15.37:0/837332591 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2774739422 0 0) 0x7f6120160b50 con 0x7f612006f120 2024-05-30T06:55:23.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.733+0000 7f611e800640 1 --2- 172.21.15.37:0/837332591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6120072510 0x7f61200cd6a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f6118009d90 tx=0x7f611801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9fb0fa1bbb2311 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:23.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.733+0000 7f611d400640 1 -- 172.21.15.37:0/837332591 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61180b2070 con 0x7f6120072510 2024-05-30T06:55:23.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.733+0000 7f611d400640 1 -- 172.21.15.37:0/837332591 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61180a5990 con 0x7f6120072510 2024-05-30T06:55:23.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.733+0000 7f611d400640 1 -- 172.21.15.37:0/837332591 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61180a5d60 con 0x7f6120072510 2024-05-30T06:55:23.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.733+0000 7f611f200640 1 -- 172.21.15.37:0/837332591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6120072510 msgr2=0x7f61200cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:23.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.733+0000 7f611f200640 1 --2- 172.21.15.37:0/837332591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6120072510 0x7f61200cd6a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f6118009d90 tx=0x7f611801c8b0 comp rx=0 tx=0).stop 2024-05-30T06:55:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.733+0000 7f611f200640 1 -- 172.21.15.37:0/837332591 shutdown_connections 2024-05-30T06:55:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.733+0000 7f611f200640 1 --2- 172.21.15.37:0/837332591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6120072510 0x7f61200cd6a0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.733+0000 7f611f200640 1 --2- 172.21.15.37:0/837332591 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6120145da0 0x7f6120160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.733+0000 7f611f200640 1 -- 172.21.15.37:0/837332591 >> 172.21.15.37:0/837332591 conn(0x7f61200b2120 msgr2=0x7f61200b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.733+0000 7f611f200640 1 -- 172.21.15.37:0/837332591 shutdown_connections 2024-05-30T06:55:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.733+0000 7f611f200640 1 -- 172.21.15.37:0/837332591 wait complete. 2024-05-30T06:55:23.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611f200640 1 Processor -- start 2024-05-30T06:55:23.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611f200640 1 -- start start 2024-05-30T06:55:23.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611f200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f612006f120 0x7f612015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:23.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611f200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6120072510 0x7f612013c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:23.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6120145da0 0x7f61200b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:23.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f61200ce570 con 0x7f6120145da0 2024-05-30T06:55:23.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611f200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f61200ce3f0 con 0x7f612006f120 2024-05-30T06:55:23.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611f200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f61200ce6f0 con 0x7f6120072510 2024-05-30T06:55:23.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6120145da0 0x7f61200b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:23.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6120145da0 0x7f61200b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36588/0 (socket says 172.21.15.37:36588) 2024-05-30T06:55:23.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611e800640 1 -- 172.21.15.37:0/2972305904 learned_addr learned my addr 172.21.15.37:0/2972305904 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:23.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611de00640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f612006f120 0x7f612015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:23.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f6117e00640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6120072510 0x7f612013c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611e800640 1 -- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6120072510 msgr2=0x7f612013c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611e800640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6120072510 0x7f612013c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611e800640 1 -- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f612006f120 msgr2=0x7f612015b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611e800640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f612006f120 0x7f612015b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611e800640 1 -- 172.21.15.37:0/2972305904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612013f3e0 con 0x7f6120145da0 2024-05-30T06:55:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611e800640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6120145da0 0x7f61200b3750 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f61180b0040 tx=0x7f6118019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f6116000640 1 -- 172.21.15.37:0/2972305904 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61180b2050 con 0x7f6120145da0 2024-05-30T06:55:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f6116000640 1 -- 172.21.15.37:0/2972305904 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61180be070 con 0x7f6120145da0 2024-05-30T06:55:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f6116000640 1 -- 172.21.15.37:0/2972305904 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61180ada90 con 0x7f6120145da0 2024-05-30T06:55:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611f200640 1 -- 172.21.15.37:0/2972305904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6120143360 con 0x7f6120145da0 2024-05-30T06:55:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611f200640 1 -- 172.21.15.37:0/2972305904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6120143920 con 0x7f6120145da0 2024-05-30T06:55:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.737+0000 7f611f200640 1 -- 172.21.15.37:0/2972305904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6120068ab0 con 0x7f6120145da0 2024-05-30T06:55:23.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.741+0000 7f6116000640 1 -- 172.21.15.37:0/2972305904 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f61180adc30 con 0x7f6120145da0 2024-05-30T06:55:23.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.741+0000 7f6116000640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60fc0698e0 0x7f60fc06bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:23.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.741+0000 7f6116000640 1 -- 172.21.15.37:0/2972305904 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5880+0+0 (secure 0 0 0) 0x7f6118120c40 con 0x7f6120145da0 2024-05-30T06:55:23.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.741+0000 7f611de00640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60fc0698e0 0x7f60fc06bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:23.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.741+0000 7f611de00640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60fc0698e0 0x7f60fc06bda0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f61100079c0 tx=0x7f6110008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.745+0000 7f6116000640 1 -- 172.21.15.37:0/2972305904 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6118016560 con 0x7f6120145da0 2024-05-30T06:55:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:23.913+0000 7f611f200640 1 -- 172.21.15.37:0/2972305904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f61200721f0 con 0x7f6120145da0 2024-05-30T06:55:24.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:24.841+0000 7f6116000640 1 -- 172.21.15.37:0/2972305904 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) ==== 181+0+0 (secure 0 0 0) 0x7f61180f2320 con 0x7f6120145da0 2024-05-30T06:55:24.845 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-30T06:55:24.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:24.845+0000 7f611f200640 1 -- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60fc0698e0 msgr2=0x7f60fc06bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:24.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:24.845+0000 7f611f200640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60fc0698e0 0x7f60fc06bda0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f61100079c0 tx=0x7f6110008040 comp rx=0 tx=0).stop 2024-05-30T06:55:24.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:24.845+0000 7f611f200640 1 -- 172.21.15.37:0/2972305904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6120145da0 msgr2=0x7f61200b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:24.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:24.845+0000 7f611f200640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6120145da0 0x7f61200b3750 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f61180b0040 tx=0x7f6118019650 comp rx=0 tx=0).stop 2024-05-30T06:55:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:24.849+0000 7f611f200640 1 -- 172.21.15.37:0/2972305904 shutdown_connections 2024-05-30T06:55:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:24.849+0000 7f611f200640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6120145da0 0x7f61200b3750 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:24.849+0000 7f611f200640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6120072510 0x7f612013c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:24.849+0000 7f611f200640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60fc0698e0 0x7f60fc06bda0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:24.849+0000 7f611f200640 1 --2- 172.21.15.37:0/2972305904 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f612006f120 0x7f612015b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:24.849+0000 7f611f200640 1 -- 172.21.15.37:0/2972305904 >> 172.21.15.37:0/2972305904 conn(0x7f61200b2120 msgr2=0x7f612015cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:24.849+0000 7f611f200640 1 -- 172.21.15.37:0/2972305904 shutdown_connections 2024-05-30T06:55:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:24.849+0000 7f611f200640 1 -- 172.21.15.37:0/2972305904 wait complete. 2024-05-30T06:55:24.879 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T06:55:25.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f0300a00640 1 Processor -- start 2024-05-30T06:55:25.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f0300a00640 1 -- start start 2024-05-30T06:55:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f0300a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f02fc0d10f0 0x7f02fc0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f0300a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02fc09bca0 con 0x7f02fc06d130 2024-05-30T06:55:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f0300a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02fc0d1580 con 0x7f02fc06ca70 2024-05-30T06:55:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f0300a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f02fc0b1950 con 0x7f02fc0d10f0 2024-05-30T06:55:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fb400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f02fc06d130 0x7f02fc06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43970/0 (socket says 172.21.15.37:43970) 2024-05-30T06:55:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fb400640 1 -- 172.21.15.37:0/2539543 learned_addr learned my addr 172.21.15.37:0/2539543 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:25.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2836145737 0 0) 0x7f02fc09bca0 con 0x7f02fc06d130 2024-05-30T06:55:25.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02e0003530 con 0x7f02fc06d130 2024-05-30T06:55:25.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fbe00640 1 --2- 172.21.15.37:0/2539543 >> v2:172.21.15.105:3300/0 conn(0x7f02fc0d10f0 0x7f02fc0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2709559733 0 0) 0x7f02e0003530 con 0x7f02fc06d130 2024-05-30T06:55:25.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 >> v2:172.21.15.105:3300/0 conn(0x7f02fc0d10f0 msgr2=0x7f02fc0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:25.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 --2- 172.21.15.37:0/2539543 >> v2:172.21.15.105:3300/0 conn(0x7f02fc0d10f0 0x7f02fc0cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 >> v1:172.21.15.105:6789/0 conn(0x7f02fc06ca70 legacy=0x7f02fc0cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02fc0d17f0 con 0x7f02fc06d130 2024-05-30T06:55:25.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f02ec001680 con 0x7f02fc06d130 2024-05-30T06:55:25.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 >> v1:172.21.15.37:6789/0 conn(0x7f02fc06d130 legacy=0x7f02fc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 --2- 172.21.15.37:0/2539543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02e00039c0 0x7f02e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 --2- 172.21.15.37:0/2539543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02e0004810 0x7f02e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 --2- 172.21.15.37:0/2539543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e00052f0 0x7f02e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02e000c190 con 0x7f02e00039c0 2024-05-30T06:55:25.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02e000c340 con 0x7f02e00052f0 2024-05-30T06:55:25.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f02e000c540 con 0x7f02e0004810 2024-05-30T06:55:25.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fb400640 1 --2- 172.21.15.37:0/2539543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02e00039c0 0x7f02e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fbe00640 1 --2- 172.21.15.37:0/2539543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e00052f0 0x7f02e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02faa00640 1 --2- 172.21.15.37:0/2539543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02e0004810 0x7f02e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fb400640 1 -- 172.21.15.37:0/2539543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02e0004810 msgr2=0x7f02e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:25.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fb400640 1 --2- 172.21.15.37:0/2539543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02e0004810 0x7f02e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fb400640 1 -- 172.21.15.37:0/2539543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e00052f0 msgr2=0x7f02e000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:25.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fb400640 1 --2- 172.21.15.37:0/2539543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e00052f0 0x7f02e000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fb400640 1 -- 172.21.15.37:0/2539543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e0003530 con 0x7f02e00039c0 2024-05-30T06:55:25.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02fbe00640 1 -- 172.21.15.37:0/2539543 reap_dead start 2024-05-30T06:55:25.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.033+0000 7f02faa00640 1 --2- 172.21.15.37:0/2539543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02e0004810 0x7f02e0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:25.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.037+0000 7f02fb400640 1 --2- 172.21.15.37:0/2539543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02e00039c0 0x7f02e0003de0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f02ec001ec0 tx=0x7f02ec01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6e6045332bc368 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:25.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.037+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec007d40 con 0x7f02e00039c0 2024-05-30T06:55:25.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.037+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ec0a9070 con 0x7f02e00039c0 2024-05-30T06:55:25.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.037+0000 7f02fa000640 1 -- 172.21.15.37:0/2539543 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec005d80 con 0x7f02e00039c0 2024-05-30T06:55:25.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.037+0000 7f0300a00640 1 -- 172.21.15.37:0/2539543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02e00039c0 msgr2=0x7f02e0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.037+0000 7f0300a00640 1 --2- 172.21.15.37:0/2539543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02e00039c0 0x7f02e0003de0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f02ec001ec0 tx=0x7f02ec01cc20 comp rx=0 tx=0).stop 2024-05-30T06:55:25.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.037+0000 7f0300a00640 1 -- 172.21.15.37:0/2539543 shutdown_connections 2024-05-30T06:55:25.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.037+0000 7f0300a00640 1 --2- 172.21.15.37:0/2539543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02e00039c0 0x7f02e0003de0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.037+0000 7f0300a00640 1 -- 172.21.15.37:0/2539543 >> 172.21.15.37:0/2539543 conn(0x7f02fc0b3f40 msgr2=0x7f02fc0b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:25.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.037+0000 7f0300a00640 1 -- 172.21.15.37:0/2539543 shutdown_connections 2024-05-30T06:55:25.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.037+0000 7f0300a00640 1 -- 172.21.15.37:0/2539543 wait complete. 2024-05-30T06:55:25.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f0300a00640 1 Processor -- start 2024-05-30T06:55:25.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f0300a00640 1 -- start start 2024-05-30T06:55:25.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f0300a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e00039c0 0x7f02fc1f7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f0300a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02fc1547d0 0x7f02fc0cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f0300a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02fc0cbc50 0x7f02fc0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f0300a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc1620b0 con 0x7f02fc0cbc50 2024-05-30T06:55:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f0300a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02fc06d920 con 0x7f02e00039c0 2024-05-30T06:55:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f0300a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f02fc09c470 con 0x7f02fc1547d0 2024-05-30T06:55:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02fbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02fc0cbc50 0x7f02fc0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02fbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02fc0cbc50 0x7f02fc0ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36606/0 (socket says 172.21.15.37:36606) 2024-05-30T06:55:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02fbe00640 1 -- 172.21.15.37:0/3019996045 learned_addr learned my addr 172.21.15.37:0/3019996045 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02fb400640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e00039c0 0x7f02fc1f7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02faa00640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02fc1547d0 0x7f02fc0cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02fbe00640 1 -- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02fc1547d0 msgr2=0x7f02fc0cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02fbe00640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02fc1547d0 0x7f02fc0cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02fbe00640 1 -- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e00039c0 msgr2=0x7f02fc1f7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02fbe00640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e00039c0 0x7f02fc1f7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02fbe00640 1 -- 172.21.15.37:0/3019996045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02fc09c750 con 0x7f02fc0cbc50 2024-05-30T06:55:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02fb400640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e00039c0 0x7f02fc1f7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02faa00640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02fc1547d0 0x7f02fc0cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02fbe00640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02fc0cbc50 0x7f02fc0ca6f0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f02fc073570 tx=0x7f02f4007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02f3400640 1 -- 172.21.15.37:0/3019996045 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4004680 con 0x7f02fc0cbc50 2024-05-30T06:55:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02f3400640 1 -- 172.21.15.37:0/3019996045 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f401a070 con 0x7f02fc0cbc50 2024-05-30T06:55:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f0300a00640 1 -- 172.21.15.37:0/3019996045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02fc09ca30 con 0x7f02fc0cbc50 2024-05-30T06:55:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f02f3400640 1 -- 172.21.15.37:0/3019996045 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4015660 con 0x7f02fc0cbc50 2024-05-30T06:55:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.041+0000 7f0300a00640 1 -- 172.21.15.37:0/3019996045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02fc09cff0 con 0x7f02fc0cbc50 2024-05-30T06:55:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.045+0000 7f0300a00640 1 -- 172.21.15.37:0/3019996045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02fc068ab0 con 0x7f02fc0cbc50 2024-05-30T06:55:25.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.045+0000 7f02f3400640 1 -- 172.21.15.37:0/3019996045 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f02f4015800 con 0x7f02fc0cbc50 2024-05-30T06:55:25.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.045+0000 7f02f3400640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02dc0698e0 0x7f02dc06bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.045+0000 7f02f3400640 1 -- 172.21.15.37:0/3019996045 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5442+0+0 (secure 0 0 0) 0x7f02f40860a0 con 0x7f02fc0cbc50 2024-05-30T06:55:25.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.045+0000 7f02fb400640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02dc0698e0 0x7f02dc06bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.045+0000 7f02fb400640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02dc0698e0 0x7f02dc06bda0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0ab000 tx=0x7f02ec0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:25.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.049+0000 7f02f3400640 1 -- 172.21.15.37:0/3019996045 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f02f408f020 con 0x7f02fc0cbc50 2024-05-30T06:55:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.217+0000 7f0300a00640 1 -- 172.21.15.37:0/3019996045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f02fc0b4a60 con 0x7f02fc0cbc50 2024-05-30T06:55:25.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.533+0000 7f02f3400640 1 -- 172.21.15.37:0/3019996045 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) ==== 169+0+0 (secure 0 0 0) 0x7f02f4057cb0 con 0x7f02fc0cbc50 2024-05-30T06:55:25.536 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-30T06:55:25.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.537+0000 7f0300a00640 1 -- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02dc0698e0 msgr2=0x7f02dc06bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.537+0000 7f0300a00640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02dc0698e0 0x7f02dc06bda0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0ab000 tx=0x7f02ec0a7070 comp rx=0 tx=0).stop 2024-05-30T06:55:25.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.537+0000 7f0300a00640 1 -- 172.21.15.37:0/3019996045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02fc0cbc50 msgr2=0x7f02fc0ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.537+0000 7f0300a00640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02fc0cbc50 0x7f02fc0ca6f0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f02fc073570 tx=0x7f02f4007700 comp rx=0 tx=0).stop 2024-05-30T06:55:25.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.537+0000 7f0300a00640 1 -- 172.21.15.37:0/3019996045 shutdown_connections 2024-05-30T06:55:25.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.537+0000 7f0300a00640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02fc0cbc50 0x7f02fc0ca6f0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.537+0000 7f0300a00640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02fc1547d0 0x7f02fc0cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.537+0000 7f0300a00640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f02dc0698e0 0x7f02dc06bda0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.537+0000 7f0300a00640 1 --2- 172.21.15.37:0/3019996045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02e00039c0 0x7f02fc1f7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.537+0000 7f0300a00640 1 -- 172.21.15.37:0/3019996045 >> 172.21.15.37:0/3019996045 conn(0x7f02fc0b3f40 msgr2=0x7f02fc160fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.537+0000 7f0300a00640 1 -- 172.21.15.37:0/3019996045 shutdown_connections 2024-05-30T06:55:25.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.537+0000 7f0300a00640 1 -- 172.21.15.37:0/3019996045 wait complete. 2024-05-30T06:55:25.566 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T06:55:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.705+0000 7f45aa800640 1 Processor -- start 2024-05-30T06:55:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.705+0000 7f45aa800640 1 -- start start 2024-05-30T06:55:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45aa800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f45a406d200 0x7f45a406d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45aa800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a406db60 con 0x7f45a415e8b0 2024-05-30T06:55:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45aa800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a4163350 con 0x7f45a40d0ac0 2024-05-30T06:55:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45aa800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f45a41627d0 con 0x7f45a406d200 2024-05-30T06:55:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a3400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f45a415e8b0 0x7f45a40cf5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43972/0 (socket says 172.21.15.37:43972) 2024-05-30T06:55:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a3400640 1 -- 172.21.15.37:0/3572684008 learned_addr learned my addr 172.21.15.37:0/3572684008 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f459aa00640 1 --2- 172.21.15.37:0/3572684008 >> v2:172.21.15.105:3300/0 conn(0x7f45a406d200 0x7f45a406d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3754253609 0 0) 0x7f45a406db60 con 0x7f45a415e8b0 2024-05-30T06:55:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4588003530 con 0x7f45a415e8b0 2024-05-30T06:55:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3327876474 0 0) 0x7f4588003530 con 0x7f45a415e8b0 2024-05-30T06:55:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 >> v2:172.21.15.105:3300/0 conn(0x7f45a406d200 msgr2=0x7f45a406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 --2- 172.21.15.37:0/3572684008 >> v2:172.21.15.105:3300/0 conn(0x7f45a406d200 0x7f45a406d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 >> v1:172.21.15.105:6789/0 conn(0x7f45a40d0ac0 legacy=0x7f45a40d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a4162ab0 con 0x7f45a415e8b0 2024-05-30T06:55:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f4594001680 con 0x7f45a415e8b0 2024-05-30T06:55:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 >> v1:172.21.15.37:6789/0 conn(0x7f45a415e8b0 legacy=0x7f45a40cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 --2- 172.21.15.37:0/3572684008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45880039c0 0x7f4588003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 --2- 172.21.15.37:0/3572684008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4588004810 0x7f4588004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 --2- 172.21.15.37:0/3572684008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45880051d0 0x7f458800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f45a41627d0 con 0x7f45880051d0 2024-05-30T06:55:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f458800c070 con 0x7f45880039c0 2024-05-30T06:55:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f458800c270 con 0x7f4588004810 2024-05-30T06:55:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a3e00640 1 --2- 172.21.15.37:0/3572684008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45880051d0 0x7f458800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a3400640 1 --2- 172.21.15.37:0/3572684008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45880039c0 0x7f4588003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f459aa00640 1 --2- 172.21.15.37:0/3572684008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4588004810 0x7f4588004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a3e00640 1 -- 172.21.15.37:0/3572684008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4588004810 msgr2=0x7f4588004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a3e00640 1 --2- 172.21.15.37:0/3572684008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4588004810 0x7f4588004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a3e00640 1 -- 172.21.15.37:0/3572684008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45880039c0 msgr2=0x7f4588003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a3e00640 1 --2- 172.21.15.37:0/3572684008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45880039c0 0x7f4588003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a3e00640 1 -- 172.21.15.37:0/3572684008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4588003530 con 0x7f45880051d0 2024-05-30T06:55:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.709+0000 7f45a3400640 1 --2- 172.21.15.37:0/3572684008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45880039c0 0x7f4588003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:55:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.713+0000 7f45a3e00640 1 -- 172.21.15.37:0/3572684008 reap_dead start 2024-05-30T06:55:25.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.713+0000 7f45a3e00640 1 --2- 172.21.15.37:0/3572684008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45880051d0 0x7f458800b9d0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f459c001e70 tx=0x7f459c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4492da3c782157ed server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:25.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.713+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594007d20 con 0x7f45880051d0 2024-05-30T06:55:25.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.713+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c003bc0 con 0x7f45880051d0 2024-05-30T06:55:25.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.713+0000 7f45a2a00640 1 -- 172.21.15.37:0/3572684008 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c001a90 con 0x7f45880051d0 2024-05-30T06:55:25.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.713+0000 7f45aa800640 1 -- 172.21.15.37:0/3572684008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45880051d0 msgr2=0x7f458800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.713+0000 7f45aa800640 1 --2- 172.21.15.37:0/3572684008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45880051d0 0x7f458800b9d0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f459c001e70 tx=0x7f459c01c780 comp rx=0 tx=0).stop 2024-05-30T06:55:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.713+0000 7f45aa800640 1 -- 172.21.15.37:0/3572684008 shutdown_connections 2024-05-30T06:55:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.713+0000 7f45aa800640 1 --2- 172.21.15.37:0/3572684008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45880051d0 0x7f458800b9d0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.713+0000 7f45aa800640 1 -- 172.21.15.37:0/3572684008 >> 172.21.15.37:0/3572684008 conn(0x7f45a40b4130 msgr2=0x7f45a40b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.713+0000 7f45aa800640 1 -- 172.21.15.37:0/3572684008 shutdown_connections 2024-05-30T06:55:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.713+0000 7f45aa800640 1 -- 172.21.15.37:0/3572684008 wait complete. 2024-05-30T06:55:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.713+0000 7f45aa800640 1 Processor -- start 2024-05-30T06:55:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f45aa800640 1 -- start start 2024-05-30T06:55:25.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f45aa800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45880051d0 0x7f45a4151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f45aa800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a4153520 0x7f45a41539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f45aa800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45a41f7c60 0x7f45a41f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f45aa800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f45a415ec90 con 0x7f45a4153520 2024-05-30T06:55:25.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f45aa800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f45a4163070 con 0x7f45880051d0 2024-05-30T06:55:25.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f45aa800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f45a40cf050 con 0x7f45a41f7c60 2024-05-30T06:55:25.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f459aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a4153520 0x7f45a41539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f459aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a4153520 0x7f45a41539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36632/0 (socket says 172.21.15.37:36632) 2024-05-30T06:55:25.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f459aa00640 1 -- 172.21.15.37:0/1356786263 learned_addr learned my addr 172.21.15.37:0/1356786263 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:25.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f45a3400640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45880051d0 0x7f45a4151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f45a3e00640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45a41f7c60 0x7f45a41f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f459aa00640 1 -- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45a41f7c60 msgr2=0x7f45a41f80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f459aa00640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45a41f7c60 0x7f45a41f80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f459aa00640 1 -- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45880051d0 msgr2=0x7f45a4151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f459aa00640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45880051d0 0x7f45a4151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f459aa00640 1 -- 172.21.15.37:0/1356786263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a40c7e50 con 0x7f45a4153520 2024-05-30T06:55:25.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f459aa00640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a4153520 0x7f45a41539a0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f458c011960 tx=0x7f458c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:25.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f459be00640 1 -- 172.21.15.37:0/1356786263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c00faf0 con 0x7f45a4153520 2024-05-30T06:55:25.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f459be00640 1 -- 172.21.15.37:0/1356786263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c00fc90 con 0x7f45a4153520 2024-05-30T06:55:25.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f459be00640 1 -- 172.21.15.37:0/1356786263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c014680 con 0x7f45a4153520 2024-05-30T06:55:25.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f45aa800640 1 -- 172.21.15.37:0/1356786263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a4152290 con 0x7f45a4153520 2024-05-30T06:55:25.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f45aa800640 1 -- 172.21.15.37:0/1356786263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a41f8b20 con 0x7f45a4153520 2024-05-30T06:55:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.717+0000 7f45aa800640 1 -- 172.21.15.37:0/1356786263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a4068bc0 con 0x7f45a4153520 2024-05-30T06:55:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.721+0000 7f459be00640 1 -- 172.21.15.37:0/1356786263 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f458c012040 con 0x7f45a4153520 2024-05-30T06:55:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.721+0000 7f459be00640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4580069910 0x7f458006bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.721+0000 7f459be00640 1 -- 172.21.15.37:0/1356786263 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4999+0+0 (secure 0 0 0) 0x7f458c085f70 con 0x7f45a4153520 2024-05-30T06:55:25.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.721+0000 7f45a3400640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4580069910 0x7f458006bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:25.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.721+0000 7f45a3400640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4580069910 0x7f458006bdd0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4594001000 tx=0x7f4594000f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:25.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.725+0000 7f459be00640 1 -- 172.21.15.37:0/1356786263 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f458c019030 con 0x7f45a4153520 2024-05-30T06:55:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.889+0000 7f45aa800640 1 -- 172.21.15.37:0/1356786263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f45a40b85a0 con 0x7f45a4153520 2024-05-30T06:55:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.893+0000 7f459be00640 1 -- 172.21.15.37:0/1356786263 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f458c0574a0 con 0x7f45a4153520 2024-05-30T06:55:25.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.893+0000 7f45aa800640 1 -- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4580069910 msgr2=0x7f458006bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.893+0000 7f45aa800640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4580069910 0x7f458006bdd0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4594001000 tx=0x7f4594000f90 comp rx=0 tx=0).stop 2024-05-30T06:55:25.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.893+0000 7f45aa800640 1 -- 172.21.15.37:0/1356786263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a4153520 msgr2=0x7f45a41539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:25.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.893+0000 7f45aa800640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a4153520 0x7f45a41539a0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f458c011960 tx=0x7f458c011e20 comp rx=0 tx=0).stop 2024-05-30T06:55:25.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.893+0000 7f45aa800640 1 -- 172.21.15.37:0/1356786263 shutdown_connections 2024-05-30T06:55:25.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.893+0000 7f45aa800640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45a41f7c60 0x7f45a41f80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.893+0000 7f45aa800640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45a4153520 0x7f45a41539a0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.893+0000 7f45aa800640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4580069910 0x7f458006bdd0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.893+0000 7f45aa800640 1 --2- 172.21.15.37:0/1356786263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45880051d0 0x7f45a4151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:25.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.893+0000 7f45aa800640 1 -- 172.21.15.37:0/1356786263 >> 172.21.15.37:0/1356786263 conn(0x7f45a40b4130 msgr2=0x7f45a4074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:25.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.893+0000 7f45aa800640 1 -- 172.21.15.37:0/1356786263 shutdown_connections 2024-05-30T06:55:25.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:25.893+0000 7f45aa800640 1 -- 172.21.15.37:0/1356786263 wait complete. 2024-05-30T06:55:25.922 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_stats_are_printed' 2024-05-30T06:55:26.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b38400640 1 Processor -- start 2024-05-30T06:55:26.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b38400640 1 -- start start 2024-05-30T06:55:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b38400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7b30147790 0x7f7b300ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b38400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b300b45d0 0x7f7b30070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b38400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b300b6030 con 0x7f7b3006b960 2024-05-30T06:55:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b38400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7b300b6890 con 0x7f7b300b45d0 2024-05-30T06:55:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b38400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7b300b62d0 con 0x7f7b30147790 2024-05-30T06:55:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b35000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b300b45d0 0x7f7b30070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b36400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7b3006b960 0x7f7b3006f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43980/0 (socket says 172.21.15.37:43980) 2024-05-30T06:55:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b36400640 1 -- 172.21.15.37:0/4013518482 learned_addr learned my addr 172.21.15.37:0/4013518482 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b35a00640 1 --2- 172.21.15.37:0/4013518482 >> v2:172.21.15.105:3300/0 conn(0x7f7b30147790 0x7f7b300ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b35000640 1 -- 172.21.15.37:0/4013518482 >> v2:172.21.15.105:3300/0 conn(0x7f7b30147790 msgr2=0x7f7b300ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b35000640 1 --2- 172.21.15.37:0/4013518482 >> v2:172.21.15.105:3300/0 conn(0x7f7b30147790 0x7f7b300ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b35000640 1 -- 172.21.15.37:0/4013518482 >> v1:172.21.15.37:6789/0 conn(0x7f7b3006b960 legacy=0x7f7b3006f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b2fe00640 1 -- 172.21.15.37:0/4013518482 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413082133 0 0) 0x7f7b300b6030 con 0x7f7b3006b960 2024-05-30T06:55:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.073+0000 7f7b35000640 1 -- 172.21.15.37:0/4013518482 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b300b65b0 con 0x7f7b300b45d0 2024-05-30T06:55:26.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.077+0000 7f7b35000640 1 --2- 172.21.15.37:0/4013518482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b45d0 0x7f7b30070a70 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f7b300b1080 tx=0x7f7b1c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf676a9ddf9a747 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:26.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.077+0000 7f7b2fe00640 1 -- 172.21.15.37:0/4013518482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0b0070 con 0x7f7b300b45d0 2024-05-30T06:55:26.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.077+0000 7f7b2fe00640 1 -- 172.21.15.37:0/4013518482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c0ab600 con 0x7f7b300b45d0 2024-05-30T06:55:26.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.077+0000 7f7b2fe00640 1 -- 172.21.15.37:0/4013518482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0ab9d0 con 0x7f7b300b45d0 2024-05-30T06:55:26.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.077+0000 7f7b38400640 1 -- 172.21.15.37:0/4013518482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b45d0 msgr2=0x7f7b30070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:26.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.077+0000 7f7b38400640 1 --2- 172.21.15.37:0/4013518482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b45d0 0x7f7b30070a70 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f7b300b1080 tx=0x7f7b1c01c3c0 comp rx=0 tx=0).stop 2024-05-30T06:55:26.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.077+0000 7f7b38400640 1 -- 172.21.15.37:0/4013518482 shutdown_connections 2024-05-30T06:55:26.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.077+0000 7f7b38400640 1 --2- 172.21.15.37:0/4013518482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300b45d0 0x7f7b30070a70 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:26.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.077+0000 7f7b38400640 1 --2- 172.21.15.37:0/4013518482 >> v2:172.21.15.105:3300/0 conn(0x7f7b30147790 0x7f7b300ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:26.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.077+0000 7f7b38400640 1 -- 172.21.15.37:0/4013518482 >> 172.21.15.37:0/4013518482 conn(0x7f7b300b6a60 msgr2=0x7f7b300b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:26.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.077+0000 7f7b38400640 1 -- 172.21.15.37:0/4013518482 shutdown_connections 2024-05-30T06:55:26.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.077+0000 7f7b38400640 1 -- 172.21.15.37:0/4013518482 wait complete. 2024-05-30T06:55:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.077+0000 7f7b38400640 1 Processor -- start 2024-05-30T06:55:26.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b38400640 1 -- start start 2024-05-30T06:55:26.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b38400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b3006b960 0x7f7b3015d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:26.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b38400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b300b45d0 0x7f7b30140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:26.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b38400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b30147790 0x7f7b3015c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b38400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7b30071130 con 0x7f7b3006b960 2024-05-30T06:55:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b38400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7b30070fb0 con 0x7f7b30147790 2024-05-30T06:55:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b38400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3016bde0 con 0x7f7b300b45d0 2024-05-30T06:55:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b35a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b3006b960 0x7f7b3015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b35a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b3006b960 0x7f7b3015d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36650/0 (socket says 172.21.15.37:36650) 2024-05-30T06:55:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b35a00640 1 -- 172.21.15.37:0/988947788 learned_addr learned my addr 172.21.15.37:0/988947788 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b36400640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b30147790 0x7f7b3015c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b35000640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b300b45d0 0x7f7b30140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b35a00640 1 -- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b300b45d0 msgr2=0x7f7b30140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b35a00640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b300b45d0 0x7f7b30140890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b35a00640 1 -- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b30147790 msgr2=0x7f7b3015c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:26.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b35a00640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b30147790 0x7f7b3015c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:26.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b35a00640 1 -- 172.21.15.37:0/988947788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3015d610 con 0x7f7b3006b960 2024-05-30T06:55:26.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b35000640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b300b45d0 0x7f7b30140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:26.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b35a00640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b3006b960 0x7f7b3015d030 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400e960 tx=0x7f7b2400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:26.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b2d600640 1 -- 172.21.15.37:0/988947788 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24017070 con 0x7f7b3006b960 2024-05-30T06:55:26.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b2d600640 1 -- 172.21.15.37:0/988947788 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b2400ca00 con 0x7f7b3006b960 2024-05-30T06:55:26.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b38400640 1 -- 172.21.15.37:0/988947788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b3015d8f0 con 0x7f7b3006b960 2024-05-30T06:55:26.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b2d600640 1 -- 172.21.15.37:0/988947788 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2400cdb0 con 0x7f7b3006b960 2024-05-30T06:55:26.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b38400640 1 -- 172.21.15.37:0/988947788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b3015deb0 con 0x7f7b3006b960 2024-05-30T06:55:26.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.081+0000 7f7b38400640 1 -- 172.21.15.37:0/988947788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b3006da00 con 0x7f7b3006b960 2024-05-30T06:55:26.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.085+0000 7f7b2d600640 1 -- 172.21.15.37:0/988947788 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f7b2401a070 con 0x7f7b3006b960 2024-05-30T06:55:26.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.085+0000 7f7b2d600640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b10069910 0x7f7b1006bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:26.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.085+0000 7f7b2d600640 1 -- 172.21.15.37:0/988947788 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4999+0+0 (secure 0 0 0) 0x7f7b24085770 con 0x7f7b3006b960 2024-05-30T06:55:26.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.085+0000 7f7b35000640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b10069910 0x7f7b1006bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:26.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.085+0000 7f7b35000640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b10069910 0x7f7b1006bdd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0ad000 tx=0x7f7b1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:26.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.089+0000 7f7b2d600640 1 -- 172.21.15.37:0/988947788 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b240576f0 con 0x7f7b3006b960 2024-05-30T06:55:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.313+0000 7f7b38400640 1 -- 172.21.15.37:0/988947788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_stats_are_printed"]} v 0) -- 0x7f7b301451a0 con 0x7f7b3006b960 2024-05-30T06:55:26.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.853+0000 7f7b2d600640 1 -- 172.21.15.37:0/988947788 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_stats_are_printed"]}]=0 v611) ==== 153+0+0 (secure 0 0 0) 0x7f7b24056ff0 con 0x7f7b3006b960 2024-05-30T06:55:26.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.857+0000 7f7b38400640 1 -- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b10069910 msgr2=0x7f7b1006bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:26.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.857+0000 7f7b38400640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b10069910 0x7f7b1006bdd0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0ad000 tx=0x7f7b1c008040 comp rx=0 tx=0).stop 2024-05-30T06:55:26.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.857+0000 7f7b38400640 1 -- 172.21.15.37:0/988947788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b3006b960 msgr2=0x7f7b3015d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:26.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.857+0000 7f7b38400640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b3006b960 0x7f7b3015d030 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400e960 tx=0x7f7b2400ee20 comp rx=0 tx=0).stop 2024-05-30T06:55:26.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.857+0000 7f7b38400640 1 -- 172.21.15.37:0/988947788 shutdown_connections 2024-05-30T06:55:26.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.857+0000 7f7b38400640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b10069910 0x7f7b1006bdd0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:26.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.857+0000 7f7b38400640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b30147790 0x7f7b3015c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:26.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.857+0000 7f7b38400640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b300b45d0 0x7f7b30140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:26.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.857+0000 7f7b38400640 1 --2- 172.21.15.37:0/988947788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b3006b960 0x7f7b3015d030 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:26.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.857+0000 7f7b38400640 1 -- 172.21.15.37:0/988947788 >> 172.21.15.37:0/988947788 conn(0x7f7b300b6a60 msgr2=0x7f7b30147c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:26.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.857+0000 7f7b38400640 1 -- 172.21.15.37:0/988947788 shutdown_connections 2024-05-30T06:55:26.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:26.857+0000 7f7b38400640 1 -- 172.21.15.37:0/988947788 wait complete. 2024-05-30T06:55:26.879 INFO:tasks.cephfs_test_runner:Test that the command "ceph fs clone status" prints progress stats ... ok 2024-05-30T06:55:26.880 INFO:tasks.cephfs_test_runner:Starting test: test_when_1_clone_is_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that the progress bar, that is printed for 1 ongoing clone job, is 2024-05-30T06:55:26.880 INFO:tasks.cephfs_test_runner:test_when_1_clone_is_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T06:55:26.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:55:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9113e00640 1 Processor -- start 2024-05-30T06:55:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9113e00640 1 -- start start 2024-05-30T06:55:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9113e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140cd1c0 0x7f91141698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9113e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91140d19b0 con 0x7f9114161fc0 2024-05-30T06:55:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9113e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f911406dc60 con 0x7f91140d1550 2024-05-30T06:55:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9113e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f91140d10c0 con 0x7f91140cd1c0 2024-05-30T06:55:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9112a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9114161fc0 0x7f911406d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43990/0 (socket says 172.21.15.37:43990) 2024-05-30T06:55:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9112a00640 1 -- 172.21.15.37:0/3838842229 learned_addr learned my addr 172.21.15.37:0/3838842229 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9113400640 1 --2- 172.21.15.37:0/3838842229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140cd1c0 0x7f91141698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9112000640 1 -- 172.21.15.37:0/3838842229 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257788341 0 0) 0x7f91140d19b0 con 0x7f9114161fc0 2024-05-30T06:55:27.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9112000640 1 -- 172.21.15.37:0/3838842229 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90f8003530 con 0x7f9114161fc0 2024-05-30T06:55:27.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9112000640 1 -- 172.21.15.37:0/3838842229 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051097682 0 0) 0x7f911406dc60 con 0x7f91140d1550 2024-05-30T06:55:27.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9112000640 1 -- 172.21.15.37:0/3838842229 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91140d19b0 con 0x7f91140d1550 2024-05-30T06:55:27.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9113400640 1 -- 172.21.15.37:0/3838842229 >> v1:172.21.15.105:6789/0 conn(0x7f91140d1550 legacy=0x7f91140ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9113400640 1 -- 172.21.15.37:0/3838842229 >> v1:172.21.15.37:6789/0 conn(0x7f9114161fc0 legacy=0x7f911406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.025+0000 7f9113400640 1 -- 172.21.15.37:0/3838842229 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91140d0790 con 0x7f91140cd1c0 2024-05-30T06:55:27.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.029+0000 7f9113400640 1 --2- 172.21.15.37:0/3838842229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140cd1c0 0x7f91141698a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f910c009dc0 tx=0x7f910c01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9a4273a49896416 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:27.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.029+0000 7f9112000640 1 -- 172.21.15.37:0/3838842229 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c0b2070 con 0x7f91140cd1c0 2024-05-30T06:55:27.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.029+0000 7f9112000640 1 -- 172.21.15.37:0/3838842229 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f910c0a5850 con 0x7f91140cd1c0 2024-05-30T06:55:27.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.029+0000 7f9112000640 1 -- 172.21.15.37:0/3838842229 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c0a5c20 con 0x7f91140cd1c0 2024-05-30T06:55:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.029+0000 7f9113e00640 1 -- 172.21.15.37:0/3838842229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140cd1c0 msgr2=0x7f91141698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.029+0000 7f9113e00640 1 --2- 172.21.15.37:0/3838842229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140cd1c0 0x7f91141698a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f910c009dc0 tx=0x7f910c01c990 comp rx=0 tx=0).stop 2024-05-30T06:55:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.029+0000 7f9113e00640 1 -- 172.21.15.37:0/3838842229 shutdown_connections 2024-05-30T06:55:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.029+0000 7f9113e00640 1 --2- 172.21.15.37:0/3838842229 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140cd1c0 0x7f91141698a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.029+0000 7f9113e00640 1 -- 172.21.15.37:0/3838842229 >> 172.21.15.37:0/3838842229 conn(0x7f91140b3f50 msgr2=0x7f91140b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.029+0000 7f9113e00640 1 -- 172.21.15.37:0/3838842229 shutdown_connections 2024-05-30T06:55:27.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.029+0000 7f9113e00640 1 -- 172.21.15.37:0/3838842229 wait complete. 2024-05-30T06:55:27.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113e00640 1 Processor -- start 2024-05-30T06:55:27.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113e00640 1 -- start start 2024-05-30T06:55:27.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140cd1c0 0x7f9114155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91140d1550 0x7f9114159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9114161fc0 0x7f91140caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f911416c780 con 0x7f9114161fc0 2024-05-30T06:55:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f911416c600 con 0x7f91140d1550 2024-05-30T06:55:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f911416c900 con 0x7f91140cd1c0 2024-05-30T06:55:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9114161fc0 0x7f91140caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9114161fc0 0x7f91140caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36666/0 (socket says 172.21.15.37:36666) 2024-05-30T06:55:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113400640 1 -- 172.21.15.37:0/2646087821 learned_addr learned my addr 172.21.15.37:0/2646087821 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f910be00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91140d1550 0x7f9114159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9112a00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140cd1c0 0x7f9114155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f910be00640 1 -- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140cd1c0 msgr2=0x7f9114155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f910be00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140cd1c0 0x7f9114155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f910be00640 1 -- 172.21.15.37:0/2646087821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9114161fc0 msgr2=0x7f91140caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f910be00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9114161fc0 0x7f91140caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f910be00640 1 -- 172.21.15.37:0/2646087821 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911415a0b0 con 0x7f91140d1550 2024-05-30T06:55:27.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113400640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9114161fc0 0x7f91140caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:27.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f910be00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91140d1550 0x7f9114159b70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00c3c0 tx=0x7f90fc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:27.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f910aa00640 1 -- 172.21.15.37:0/2646087821 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc017070 con 0x7f91140d1550 2024-05-30T06:55:27.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f910aa00640 1 -- 172.21.15.37:0/2646087821 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90fc0052f0 con 0x7f91140d1550 2024-05-30T06:55:27.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f910aa00640 1 -- 172.21.15.37:0/2646087821 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc003840 con 0x7f91140d1550 2024-05-30T06:55:27.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113e00640 1 -- 172.21.15.37:0/2646087821 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91140c9a30 con 0x7f91140d1550 2024-05-30T06:55:27.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113e00640 1 -- 172.21.15.37:0/2646087821 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91140c9ff0 con 0x7f91140d1550 2024-05-30T06:55:27.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.033+0000 7f9113e00640 1 -- 172.21.15.37:0/2646087821 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9114068ab0 con 0x7f91140d1550 2024-05-30T06:55:27.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.037+0000 7f910aa00640 1 -- 172.21.15.37:0/2646087821 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f90fc01a070 con 0x7f91140d1550 2024-05-30T06:55:27.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.037+0000 7f910aa00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f90f00698e0 0x7f90f006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.037+0000 7f910aa00640 1 -- 172.21.15.37:0/2646087821 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4999+0+0 (secure 0 0 0) 0x7f90fc084f40 con 0x7f91140d1550 2024-05-30T06:55:27.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.037+0000 7f9112a00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f90f00698e0 0x7f90f006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.037+0000 7f9112a00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f90f00698e0 0x7f90f006bda0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f91040011f0 tx=0x7f9104007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:27.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.041+0000 7f910aa00640 1 -- 172.21.15.37:0/2646087821 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f90fc056500 con 0x7f91140d1550 2024-05-30T06:55:27.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.209+0000 7f9113e00640 1 -- 172.21.15.37:0/2646087821 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91140b83e0 con 0x7f91140d1550 2024-05-30T06:55:27.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.213+0000 7f910aa00640 1 -- 172.21.15.37:0/2646087821 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+13098 (secure 0 0 0) 0x7f90fc05a800 con 0x7f91140d1550 2024-05-30T06:55:27.214 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:27.214 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":94,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:55:25.536484+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6837/3708478889":"2024-05-31T06:55:22.553634+0000","172.21.15.105:6835/3708478889":"2024-05-31T06:55:22.553634+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":13,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:55:27.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.213+0000 7f9113e00640 1 -- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f90f00698e0 msgr2=0x7f90f006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.213+0000 7f9113e00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f90f00698e0 0x7f90f006bda0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f91040011f0 tx=0x7f9104007d40 comp rx=0 tx=0).stop 2024-05-30T06:55:27.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.213+0000 7f9113e00640 1 -- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91140d1550 msgr2=0x7f9114159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.213+0000 7f9113e00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91140d1550 0x7f9114159b70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00c3c0 tx=0x7f90fc00c880 comp rx=0 tx=0).stop 2024-05-30T06:55:27.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.213+0000 7f9113e00640 1 -- 172.21.15.37:0/2646087821 shutdown_connections 2024-05-30T06:55:27.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.213+0000 7f9113e00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9114161fc0 0x7f91140caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.213+0000 7f9113e00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f90f00698e0 0x7f90f006bda0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.213+0000 7f9113e00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91140d1550 0x7f9114159b70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.213+0000 7f9113e00640 1 --2- 172.21.15.37:0/2646087821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91140cd1c0 0x7f9114155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.213+0000 7f9113e00640 1 -- 172.21.15.37:0/2646087821 >> 172.21.15.37:0/2646087821 conn(0x7f91140b3f50 msgr2=0x7f91140701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:27.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.213+0000 7f9113e00640 1 -- 172.21.15.37:0/2646087821 shutdown_connections 2024-05-30T06:55:27.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.213+0000 7f9113e00640 1 -- 172.21.15.37:0/2646087821 wait complete. 2024-05-30T06:55:27.234 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:55:27.235 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:55:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f203a800640 1 Processor -- start 2024-05-30T06:55:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f203a800640 1 -- start start 2024-05-30T06:55:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f203a800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f203415cc70 0x7f203415d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f203a800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f203409b470 0x7f2034160170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f203a800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20340cd020 con 0x7f203409b8f0 2024-05-30T06:55:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f203a800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f203415d590 con 0x7f203415cc70 2024-05-30T06:55:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f203a800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f20340cd2c0 con 0x7f203409b470 2024-05-30T06:55:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f2039400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f203415cc70 0x7f203415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f2039400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f203415cc70 0x7f203415d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51454/0 (socket says 172.21.15.37:51454) 2024-05-30T06:55:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f2039400640 1 -- 172.21.15.37:0/1842223676 learned_addr learned my addr 172.21.15.37:0/1842223676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f2038a00640 1 --2- 172.21.15.37:0/1842223676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f203409b470 0x7f2034160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f2039400640 1 -- 172.21.15.37:0/1842223676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f203409b470 msgr2=0x7f2034160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f2039400640 1 --2- 172.21.15.37:0/1842223676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f203409b470 0x7f2034160170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f2039400640 1 -- 172.21.15.37:0/1842223676 >> v1:172.21.15.105:6789/0 conn(0x7f203409b8f0 legacy=0x7f20341606b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f2039400640 1 -- 172.21.15.37:0/1842223676 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20340cd5a0 con 0x7f203415cc70 2024-05-30T06:55:27.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.377+0000 7f2038a00640 1 --2- 172.21.15.37:0/1842223676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f203409b470 0x7f2034160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:27.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.381+0000 7f2039400640 1 --2- 172.21.15.37:0/1842223676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f203415cc70 0x7f203415d050 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f2028009870 tx=0x7f202801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b2d252bf53b666 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:27.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.381+0000 7f2033e00640 1 -- 172.21.15.37:0/1842223676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280a95f0 con 0x7f203415cc70 2024-05-30T06:55:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.381+0000 7f2033e00640 1 -- 172.21.15.37:0/1842223676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20280a9790 con 0x7f203415cc70 2024-05-30T06:55:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.381+0000 7f2033e00640 1 -- 172.21.15.37:0/1842223676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280a9b60 con 0x7f203415cc70 2024-05-30T06:55:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.381+0000 7f203a800640 1 -- 172.21.15.37:0/1842223676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f203415cc70 msgr2=0x7f203415d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.381+0000 7f203a800640 1 --2- 172.21.15.37:0/1842223676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f203415cc70 0x7f203415d050 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f2028009870 tx=0x7f202801c530 comp rx=0 tx=0).stop 2024-05-30T06:55:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.381+0000 7f203a800640 1 -- 172.21.15.37:0/1842223676 shutdown_connections 2024-05-30T06:55:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.381+0000 7f203a800640 1 --2- 172.21.15.37:0/1842223676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f203409b470 0x7f2034160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.381+0000 7f203a800640 1 --2- 172.21.15.37:0/1842223676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f203415cc70 0x7f203415d050 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.381+0000 7f203a800640 1 -- 172.21.15.37:0/1842223676 >> 172.21.15.37:0/1842223676 conn(0x7f20340d2510 msgr2=0x7f20340d28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.381+0000 7f203a800640 1 -- 172.21.15.37:0/1842223676 shutdown_connections 2024-05-30T06:55:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.381+0000 7f203a800640 1 -- 172.21.15.37:0/1842223676 wait complete. 2024-05-30T06:55:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f203a800640 1 Processor -- start 2024-05-30T06:55:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f203a800640 1 -- start start 2024-05-30T06:55:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f203a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f203409b470 0x7f203415b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f203a800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f203415cc70 0x7f20340af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f203a800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f203414eaf0 0x7f2034153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f203a800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20340d10f0 con 0x7f203409b470 2024-05-30T06:55:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f203a800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20340ce360 con 0x7f203414eaf0 2024-05-30T06:55:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f203a800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f203415c9b0 con 0x7f203415cc70 2024-05-30T06:55:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2039400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f203409b470 0x7f203415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2039400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f203409b470 0x7f203415b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51462/0 (socket says 172.21.15.37:51462) 2024-05-30T06:55:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2039400640 1 -- 172.21.15.37:0/242645462 learned_addr learned my addr 172.21.15.37:0/242645462 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2039e00640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f203414eaf0 0x7f2034153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2038a00640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f203415cc70 0x7f20340af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2039400640 1 -- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f203415cc70 msgr2=0x7f20340af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2039400640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f203415cc70 0x7f20340af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2039400640 1 -- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f203414eaf0 msgr2=0x7f2034153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2039400640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f203414eaf0 0x7f2034153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2039400640 1 -- 172.21.15.37:0/242645462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2034167290 con 0x7f203409b470 2024-05-30T06:55:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2039400640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f203409b470 0x7f203415b410 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f20280ab040 tx=0x7f202801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2031600640 1 -- 172.21.15.37:0/242645462 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280b1800 con 0x7f203409b470 2024-05-30T06:55:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2031600640 1 -- 172.21.15.37:0/242645462 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20280b19c0 con 0x7f203409b470 2024-05-30T06:55:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f2031600640 1 -- 172.21.15.37:0/242645462 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280b1db0 con 0x7f203409b470 2024-05-30T06:55:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f203a800640 1 -- 172.21.15.37:0/242645462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20340d16a0 con 0x7f203409b470 2024-05-30T06:55:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.385+0000 7f203a800640 1 -- 172.21.15.37:0/242645462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20340afa40 con 0x7f203409b470 2024-05-30T06:55:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.389+0000 7f203a800640 1 -- 172.21.15.37:0/242645462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2034075580 con 0x7f203409b470 2024-05-30T06:55:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.389+0000 7f2031600640 1 -- 172.21.15.37:0/242645462 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f20280a8350 con 0x7f203409b470 2024-05-30T06:55:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.389+0000 7f2031600640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2014069910 0x7f201406bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.389+0000 7f2031600640 1 -- 172.21.15.37:0/242645462 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4999+0+0 (secure 0 0 0) 0x7f202811fe10 con 0x7f203409b470 2024-05-30T06:55:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.389+0000 7f2038a00640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2014069910 0x7f201406bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.389+0000 7f2038a00640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2014069910 0x7f201406bdd0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2034158d50 tx=0x7f2020008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.393+0000 7f2031600640 1 -- 172.21.15.37:0/242645462 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f20340afa40 con 0x7f203409b470 2024-05-30T06:55:27.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.557+0000 7f203a800640 1 -- 172.21.15.37:0/242645462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f203409bfa0 con 0x7f203409b470 2024-05-30T06:55:27.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.557+0000 7f2031600640 1 -- 172.21.15.37:0/242645462 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7f20280c3070 con 0x7f203409b470 2024-05-30T06:55:27.560 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:55:27.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.561+0000 7f203a800640 1 -- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2014069910 msgr2=0x7f201406bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.561+0000 7f203a800640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2014069910 0x7f201406bdd0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2034158d50 tx=0x7f2020008040 comp rx=0 tx=0).stop 2024-05-30T06:55:27.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.561+0000 7f203a800640 1 -- 172.21.15.37:0/242645462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f203409b470 msgr2=0x7f203415b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.561+0000 7f203a800640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f203409b470 0x7f203415b410 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f20280ab040 tx=0x7f202801ad70 comp rx=0 tx=0).stop 2024-05-30T06:55:27.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.561+0000 7f203a800640 1 -- 172.21.15.37:0/242645462 shutdown_connections 2024-05-30T06:55:27.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.561+0000 7f203a800640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2014069910 0x7f201406bdd0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.561+0000 7f203a800640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f203414eaf0 0x7f2034153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.561+0000 7f203a800640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f203415cc70 0x7f20340af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.561+0000 7f203a800640 1 --2- 172.21.15.37:0/242645462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f203409b470 0x7f203415b410 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.561+0000 7f203a800640 1 -- 172.21.15.37:0/242645462 >> 172.21.15.37:0/242645462 conn(0x7f20340d2510 msgr2=0x7f20340cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:27.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.561+0000 7f203a800640 1 -- 172.21.15.37:0/242645462 shutdown_connections 2024-05-30T06:55:27.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.561+0000 7f203a800640 1 -- 172.21.15.37:0/242645462 wait complete. 2024-05-30T06:55:27.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_1_clone_is_cancelled' 2024-05-30T06:55:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.721+0000 7fa786000640 1 Processor -- start 2024-05-30T06:55:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.721+0000 7fa786000640 1 -- start start 2024-05-30T06:55:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.721+0000 7fa786000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7801415c0 0x7fa7800b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.721+0000 7fa786000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa780072510 0x7fa7800b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.721+0000 7fa786000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa780162560 con 0x7fa7800b48d0 2024-05-30T06:55:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.721+0000 7fa786000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa780163170 con 0x7fa780072510 2024-05-30T06:55:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.721+0000 7fa786000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa780162840 con 0x7fa7801415c0 2024-05-30T06:55:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.725+0000 7fa784c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7801415c0 0x7fa7800b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.725+0000 7fa785600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa780072510 0x7fa7800b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.725+0000 7fa77fe00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa7800b48d0 0x7fa780071e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:42936/0 (socket says 172.21.15.37:42936) 2024-05-30T06:55:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.725+0000 7fa77fe00640 1 -- 172.21.15.37:0/2914831114 learned_addr learned my addr 172.21.15.37:0/2914831114 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.725+0000 7fa77f400640 1 -- 172.21.15.37:0/2914831114 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3375165392 0 0) 0x7fa780162560 con 0x7fa7800b48d0 2024-05-30T06:55:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.725+0000 7fa784c00640 1 -- 172.21.15.37:0/2914831114 >> v2:172.21.15.105:3300/0 conn(0x7fa780072510 msgr2=0x7fa7800b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.725+0000 7fa784c00640 1 --2- 172.21.15.37:0/2914831114 >> v2:172.21.15.105:3300/0 conn(0x7fa780072510 0x7fa7800b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.725+0000 7fa784c00640 1 -- 172.21.15.37:0/2914831114 >> v1:172.21.15.105:6789/0 conn(0x7fa7800b48d0 legacy=0x7fa780071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.725+0000 7fa784c00640 1 -- 172.21.15.37:0/2914831114 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa780162b20 con 0x7fa7801415c0 2024-05-30T06:55:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.725+0000 7fa784c00640 1 --2- 172.21.15.37:0/2914831114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7801415c0 0x7fa7800b4f90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa7740097c0 tx=0x7fa77401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61f63b1e516f1d66 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa77f400640 1 -- 172.21.15.37:0/2914831114 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7740aa5f0 con 0x7fa7801415c0 2024-05-30T06:55:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa77f400640 1 -- 172.21.15.37:0/2914831114 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7740af070 con 0x7fa7801415c0 2024-05-30T06:55:27.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa77f400640 1 -- 172.21.15.37:0/2914831114 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7740aa9b0 con 0x7fa7801415c0 2024-05-30T06:55:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 -- 172.21.15.37:0/2914831114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7801415c0 msgr2=0x7fa7800b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 --2- 172.21.15.37:0/2914831114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7801415c0 0x7fa7800b4f90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa7740097c0 tx=0x7fa77401c470 comp rx=0 tx=0).stop 2024-05-30T06:55:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 -- 172.21.15.37:0/2914831114 shutdown_connections 2024-05-30T06:55:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 --2- 172.21.15.37:0/2914831114 >> v2:172.21.15.105:3300/0 conn(0x7fa780072510 0x7fa7800b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 --2- 172.21.15.37:0/2914831114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7801415c0 0x7fa7800b4f90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 -- 172.21.15.37:0/2914831114 >> 172.21.15.37:0/2914831114 conn(0x7fa7800b2120 msgr2=0x7fa7800b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 -- 172.21.15.37:0/2914831114 shutdown_connections 2024-05-30T06:55:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 -- 172.21.15.37:0/2914831114 wait complete. 2024-05-30T06:55:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 Processor -- start 2024-05-30T06:55:27.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 -- start start 2024-05-30T06:55:27.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa780072510 0x7fa780134440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800b48d0 0x7fa7801584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7801415c0 0x7fa780143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa78016b8e0 con 0x7fa7800b48d0 2024-05-30T06:55:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa78016b760 con 0x7fa780072510 2024-05-30T06:55:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa786000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa78016ba60 con 0x7fa7801415c0 2024-05-30T06:55:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa77fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800b48d0 0x7fa7801584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa784c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa780072510 0x7fa780134440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa77fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800b48d0 0x7fa7801584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51470/0 (socket says 172.21.15.37:51470) 2024-05-30T06:55:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa77fe00640 1 -- 172.21.15.37:0/3005285311 learned_addr learned my addr 172.21.15.37:0/3005285311 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:27.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.729+0000 7fa785600640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7801415c0 0x7fa780143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa77fe00640 1 -- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7801415c0 msgr2=0x7fa780143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa77fe00640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7801415c0 0x7fa780143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa77fe00640 1 -- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa780072510 msgr2=0x7fa780134440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa77fe00640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa780072510 0x7fa780134440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa77fe00640 1 -- 172.21.15.37:0/3005285311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa780134980 con 0x7fa7800b48d0 2024-05-30T06:55:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa784c00640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa780072510 0x7fa780134440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:55:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa77fe00640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800b48d0 0x7fa7801584f0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00c4e0 tx=0x7fa76c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa77cc00640 1 -- 172.21.15.37:0/3005285311 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c018070 con 0x7fa7800b48d0 2024-05-30T06:55:27.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa77cc00640 1 -- 172.21.15.37:0/3005285311 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa76c007500 con 0x7fa7800b48d0 2024-05-30T06:55:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa786000640 1 -- 172.21.15.37:0/3005285311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa780134c20 con 0x7fa7800b48d0 2024-05-30T06:55:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa77cc00640 1 -- 172.21.15.37:0/3005285311 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c004a30 con 0x7fa7800b48d0 2024-05-30T06:55:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa786000640 1 -- 172.21.15.37:0/3005285311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7801351e0 con 0x7fa7800b48d0 2024-05-30T06:55:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa786000640 1 -- 172.21.15.37:0/3005285311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa780068ab0 con 0x7fa7800b48d0 2024-05-30T06:55:27.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa77cc00640 1 -- 172.21.15.37:0/3005285311 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fa76c01b070 con 0x7fa7800b48d0 2024-05-30T06:55:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa77cc00640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7600698e0 0x7fa76006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.733+0000 7fa77cc00640 1 -- 172.21.15.37:0/3005285311 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4999+0+0 (secure 0 0 0) 0x7fa76c084d30 con 0x7fa7800b48d0 2024-05-30T06:55:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.737+0000 7fa784c00640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7600698e0 0x7fa76006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:27.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.737+0000 7fa784c00640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7600698e0 0x7fa76006bda0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa7740ae000 tx=0x7fa7740a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:27.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.737+0000 7fa77cc00640 1 -- 172.21.15.37:0/3005285311 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa76c056410 con 0x7fa7800b48d0 2024-05-30T06:55:27.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:27.965+0000 7fa786000640 1 -- 172.21.15.37:0/3005285311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_1_clone_is_cancelled"]} v 0) -- 0x7fa780073010 con 0x7fa7800b48d0 2024-05-30T06:55:28.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:28.861+0000 7fa77cc00640 1 -- 172.21.15.37:0/3005285311 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_1_clone_is_cancelled"]}]=0 v613) ==== 164+0+0 (secure 0 0 0) 0x7fa76c05a710 con 0x7fa7800b48d0 2024-05-30T06:55:28.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:28.865+0000 7fa786000640 1 -- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7600698e0 msgr2=0x7fa76006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:28.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:28.865+0000 7fa786000640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7600698e0 0x7fa76006bda0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa7740ae000 tx=0x7fa7740a7000 comp rx=0 tx=0).stop 2024-05-30T06:55:28.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:28.865+0000 7fa786000640 1 -- 172.21.15.37:0/3005285311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800b48d0 msgr2=0x7fa7801584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:28.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:28.865+0000 7fa786000640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800b48d0 0x7fa7801584f0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00c4e0 tx=0x7fa76c00c9a0 comp rx=0 tx=0).stop 2024-05-30T06:55:28.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:28.865+0000 7fa786000640 1 -- 172.21.15.37:0/3005285311 shutdown_connections 2024-05-30T06:55:28.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:28.865+0000 7fa786000640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7801415c0 0x7fa780143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:28.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:28.865+0000 7fa786000640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7800b48d0 0x7fa7801584f0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:28.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:28.865+0000 7fa786000640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa7600698e0 0x7fa76006bda0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:28.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:28.865+0000 7fa786000640 1 --2- 172.21.15.37:0/3005285311 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa780072510 0x7fa780134440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:28.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:28.865+0000 7fa786000640 1 -- 172.21.15.37:0/3005285311 >> 172.21.15.37:0/3005285311 conn(0x7fa7800b2120 msgr2=0x7fa7800b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:28.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:28.865+0000 7fa786000640 1 -- 172.21.15.37:0/3005285311 shutdown_connections 2024-05-30T06:55:28.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:28.865+0000 7fa786000640 1 -- 172.21.15.37:0/3005285311 wait complete. 2024-05-30T06:55:28.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:55:29.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.037+0000 7f9350c00640 1 Processor -- start 2024-05-30T06:55:29.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.037+0000 7f9350c00640 1 -- start start 2024-05-30T06:55:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.041+0000 7f9350c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f934c0b59d0 0x7f934c0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.041+0000 7f9350c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f934c15d350 0x7f934c160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.041+0000 7f9350c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934c0b62f0 con 0x7f934c15d7e0 2024-05-30T06:55:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.041+0000 7f9350c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f934c142030 con 0x7f934c15d350 2024-05-30T06:55:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.041+0000 7f9350c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f934c142310 con 0x7f934c0b59d0 2024-05-30T06:55:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.041+0000 7f9341400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f934c15d350 0x7f934c160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.041+0000 7f9341400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f934c15d350 0x7f934c160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51484/0 (socket says 172.21.15.37:51484) 2024-05-30T06:55:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.041+0000 7f9341400640 1 -- 172.21.15.37:0/3073714787 learned_addr learned my addr 172.21.15.37:0/3073714787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.041+0000 7f9349e00640 1 --2- 172.21.15.37:0/3073714787 >> v2:172.21.15.105:3300/0 conn(0x7f934c0b59d0 0x7f934c0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.041+0000 7f9341400640 1 -- 172.21.15.37:0/3073714787 >> v2:172.21.15.105:3300/0 conn(0x7f934c0b59d0 msgr2=0x7f934c0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.041+0000 7f9341400640 1 --2- 172.21.15.37:0/3073714787 >> v2:172.21.15.105:3300/0 conn(0x7f934c0b59d0 0x7f934c0b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.041+0000 7f9341400640 1 -- 172.21.15.37:0/3073714787 >> v1:172.21.15.37:6789/0 conn(0x7f934c15d7e0 legacy=0x7f934c1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.041+0000 7f9341400640 1 -- 172.21.15.37:0/3073714787 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c1425f0 con 0x7f934c15d350 2024-05-30T06:55:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9341400640 1 --2- 172.21.15.37:0/3073714787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f934c15d350 0x7f934c160280 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f9334009870 tx=0x7f933401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a50670efffb3673 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9349400640 1 -- 172.21.15.37:0/3073714787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93340b5070 con 0x7f934c15d350 2024-05-30T06:55:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9349400640 1 -- 172.21.15.37:0/3073714787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93340a8a10 con 0x7f934c15d350 2024-05-30T06:55:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9349400640 1 -- 172.21.15.37:0/3073714787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93340a8de0 con 0x7f934c15d350 2024-05-30T06:55:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 -- 172.21.15.37:0/3073714787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f934c15d350 msgr2=0x7f934c160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 --2- 172.21.15.37:0/3073714787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f934c15d350 0x7f934c160280 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f9334009870 tx=0x7f933401ed10 comp rx=0 tx=0).stop 2024-05-30T06:55:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 -- 172.21.15.37:0/3073714787 shutdown_connections 2024-05-30T06:55:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 --2- 172.21.15.37:0/3073714787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f934c15d350 0x7f934c160280 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 --2- 172.21.15.37:0/3073714787 >> v2:172.21.15.105:3300/0 conn(0x7f934c0b59d0 0x7f934c0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 -- 172.21.15.37:0/3073714787 >> 172.21.15.37:0/3073714787 conn(0x7f934c06bf60 msgr2=0x7f934c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 -- 172.21.15.37:0/3073714787 shutdown_connections 2024-05-30T06:55:29.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 -- 172.21.15.37:0/3073714787 wait complete. 2024-05-30T06:55:29.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 Processor -- start 2024-05-30T06:55:29.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 -- start start 2024-05-30T06:55:29.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f934c0b59d0 0x7f934c152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:29.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f934c15d350 0x7f934c1f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:29.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f934c15d7e0 0x7f934c15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:29.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f934c13fe60 con 0x7f934c15d350 2024-05-30T06:55:29.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f934c13fce0 con 0x7f934c15d7e0 2024-05-30T06:55:29.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9350c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f934c0aff20 con 0x7f934c0b59d0 2024-05-30T06:55:29.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9341400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f934c15d350 0x7f934c1f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:29.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9341400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f934c15d350 0x7f934c1f2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51490/0 (socket says 172.21.15.37:51490) 2024-05-30T06:55:29.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f9341400640 1 -- 172.21.15.37:0/2585962933 learned_addr learned my addr 172.21.15.37:0/2585962933 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:29.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.045+0000 7f934a800640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f934c15d7e0 0x7f934c15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:29.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9349e00640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f934c0b59d0 0x7f934c152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:29.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9341400640 1 -- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f934c0b59d0 msgr2=0x7f934c152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:29.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9341400640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f934c0b59d0 0x7f934c152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9341400640 1 -- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f934c15d7e0 msgr2=0x7f934c15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:29.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9341400640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f934c15d7e0 0x7f934c15edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9341400640 1 -- 172.21.15.37:0/2585962933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c15b3d0 con 0x7f934c15d350 2024-05-30T06:55:29.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f934a800640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f934c15d7e0 0x7f934c15edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:29.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9341400640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f934c15d350 0x7f934c1f2a90 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f93340b3040 tx=0x7f933401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9342a00640 1 -- 172.21.15.37:0/2585962933 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93340b5070 con 0x7f934c15d350 2024-05-30T06:55:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9342a00640 1 -- 172.21.15.37:0/2585962933 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93340b0ab0 con 0x7f934c15d350 2024-05-30T06:55:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9342a00640 1 -- 172.21.15.37:0/2585962933 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93340bb410 con 0x7f934c15d350 2024-05-30T06:55:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9350c00640 1 -- 172.21.15.37:0/2585962933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934c0b13c0 con 0x7f934c15d350 2024-05-30T06:55:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9350c00640 1 -- 172.21.15.37:0/2585962933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934c152fd0 con 0x7f934c15d350 2024-05-30T06:55:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9350c00640 1 -- 172.21.15.37:0/2585962933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934c068bc0 con 0x7f934c15d350 2024-05-30T06:55:29.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9342a00640 1 -- 172.21.15.37:0/2585962933 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f93340c2060 con 0x7f934c15d350 2024-05-30T06:55:29.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9342a00640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f93280698e0 0x7f932806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:29.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.049+0000 7f9342a00640 1 -- 172.21.15.37:0/2585962933 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4999+0+0 (secure 0 0 0) 0x7f9334122c90 con 0x7f934c15d350 2024-05-30T06:55:29.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.053+0000 7f9349e00640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f93280698e0 0x7f932806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:29.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.053+0000 7f9349e00640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f93280698e0 0x7f932806bda0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f933c00b9d0 tx=0x7f933c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:29.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.053+0000 7f9342a00640 1 -- 172.21.15.37:0/2585962933 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9334018870 con 0x7f934c15d350 2024-05-30T06:55:29.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.221+0000 7f9350c00640 1 -- 172.21.15.37:0/2585962933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f934c0cefb0 con 0x7f934c15d350 2024-05-30T06:55:29.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.225+0000 7f9342a00640 1 -- 172.21.15.37:0/2585962933 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f93340f48a0 con 0x7f934c15d350 2024-05-30T06:55:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.229+0000 7f9350c00640 1 -- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f93280698e0 msgr2=0x7f932806bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.229+0000 7f9350c00640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f93280698e0 0x7f932806bda0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f933c00b9d0 tx=0x7f933c008040 comp rx=0 tx=0).stop 2024-05-30T06:55:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.229+0000 7f9350c00640 1 -- 172.21.15.37:0/2585962933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f934c15d350 msgr2=0x7f934c1f2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.229+0000 7f9350c00640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f934c15d350 0x7f934c1f2a90 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f93340b3040 tx=0x7f933401bab0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.229+0000 7f9350c00640 1 -- 172.21.15.37:0/2585962933 shutdown_connections 2024-05-30T06:55:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.229+0000 7f9350c00640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f93280698e0 0x7f932806bda0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.229+0000 7f9350c00640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f934c15d7e0 0x7f934c15edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.229+0000 7f9350c00640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f934c15d350 0x7f934c1f2a90 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.229+0000 7f9350c00640 1 --2- 172.21.15.37:0/2585962933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f934c0b59d0 0x7f934c152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.229+0000 7f9350c00640 1 -- 172.21.15.37:0/2585962933 >> 172.21.15.37:0/2585962933 conn(0x7f934c06bf60 msgr2=0x7f934c06df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:29.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.229+0000 7f9350c00640 1 -- 172.21.15.37:0/2585962933 shutdown_connections 2024-05-30T06:55:29.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.229+0000 7f9350c00640 1 -- 172.21.15.37:0/2585962933 wait complete. 2024-05-30T06:55:29.249 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:55:29.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:55:29.343 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:55:29.435 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:55:29.435 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:55:29.435 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:55:29.444 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:55:29.444 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:55:29.444 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:55:29.454 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:55:29.454 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:55:29.454 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:55:29.497 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:55:29.497 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:55:29.497 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:55:29.508 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:55:29.508 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T06:55:29.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:55:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.677+0000 7f567e800640 1 Processor -- start 2024-05-30T06:55:29.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.677+0000 7f567e800640 1 -- start start 2024-05-30T06:55:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f567e800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5678155e60 0x7f56780b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f567e800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f567806f9a0 0x7f56780cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f567e800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56780b2ec0 0x7f56780cfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f567e800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f56780ccff0 con 0x7f5678155e60 2024-05-30T06:55:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f567e800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f56780d00e0 con 0x7f567806f9a0 2024-05-30T06:55:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f567e800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f567815c8f0 con 0x7f56780b2ec0 2024-05-30T06:55:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f5677400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5678155e60 0x7f56780b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f5677400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5678155e60 0x7f56780b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51506/0 (socket says 172.21.15.37:51506) 2024-05-30T06:55:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f5677400640 1 -- 172.21.15.37:0/3357300996 learned_addr learned my addr 172.21.15.37:0/3357300996 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f566ea00640 1 --2- 172.21.15.37:0/3357300996 >> v2:172.21.15.105:3300/0 conn(0x7f567806f9a0 0x7f56780cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f5677e00640 1 --2- 172.21.15.37:0/3357300996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56780b2ec0 0x7f56780cfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f5677400640 1 -- 172.21.15.37:0/3357300996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56780b2ec0 msgr2=0x7f56780cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f5677400640 1 --2- 172.21.15.37:0/3357300996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56780b2ec0 0x7f56780cfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f5677400640 1 -- 172.21.15.37:0/3357300996 >> v2:172.21.15.105:3300/0 conn(0x7f567806f9a0 msgr2=0x7f56780cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f5677400640 1 --2- 172.21.15.37:0/3357300996 >> v2:172.21.15.105:3300/0 conn(0x7f567806f9a0 0x7f56780cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.681+0000 7f5677400640 1 -- 172.21.15.37:0/3357300996 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56780ccc80 con 0x7f5678155e60 2024-05-30T06:55:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f5677400640 1 --2- 172.21.15.37:0/3357300996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5678155e60 0x7f56780b36a0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f567806e820 tx=0x7f566801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb1043d54580998 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f5676a00640 1 -- 172.21.15.37:0/3357300996 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56680ab5f0 con 0x7f5678155e60 2024-05-30T06:55:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f5676a00640 1 -- 172.21.15.37:0/3357300996 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56680b0070 con 0x7f5678155e60 2024-05-30T06:55:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f5676a00640 1 -- 172.21.15.37:0/3357300996 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56680ab9b0 con 0x7f5678155e60 2024-05-30T06:55:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f567e800640 1 -- 172.21.15.37:0/3357300996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5678155e60 msgr2=0x7f56780b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f567e800640 1 --2- 172.21.15.37:0/3357300996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5678155e60 0x7f56780b36a0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f567806e820 tx=0x7f566801c520 comp rx=0 tx=0).stop 2024-05-30T06:55:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f567e800640 1 -- 172.21.15.37:0/3357300996 shutdown_connections 2024-05-30T06:55:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f567e800640 1 --2- 172.21.15.37:0/3357300996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56780b2ec0 0x7f56780cfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f567e800640 1 --2- 172.21.15.37:0/3357300996 >> v2:172.21.15.105:3300/0 conn(0x7f567806f9a0 0x7f56780cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f567e800640 1 --2- 172.21.15.37:0/3357300996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5678155e60 0x7f56780b36a0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f567e800640 1 -- 172.21.15.37:0/3357300996 >> 172.21.15.37:0/3357300996 conn(0x7f56780b23a0 msgr2=0x7f56780b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f567e800640 1 -- 172.21.15.37:0/3357300996 shutdown_connections 2024-05-30T06:55:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f567e800640 1 -- 172.21.15.37:0/3357300996 wait complete. 2024-05-30T06:55:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f567e800640 1 Processor -- start 2024-05-30T06:55:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.685+0000 7f567e800640 1 -- start start 2024-05-30T06:55:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f567e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f567806f9a0 0x7f56781515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f567e800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56780b2ec0 0x7f567815ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f567e800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5678155e60 0x7f567815d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f567e800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f56780ce020 con 0x7f567806f9a0 2024-05-30T06:55:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f567e800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f56780cdea0 con 0x7f5678155e60 2024-05-30T06:55:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f567e800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f56780ce1a0 con 0x7f56780b2ec0 2024-05-30T06:55:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f5677400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f567806f9a0 0x7f56781515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f5677400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f567806f9a0 0x7f56781515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51510/0 (socket says 172.21.15.37:51510) 2024-05-30T06:55:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f5677400640 1 -- 172.21.15.37:0/1500233815 learned_addr learned my addr 172.21.15.37:0/1500233815 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f566ea00640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56780b2ec0 0x7f567815ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f5677e00640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5678155e60 0x7f567815d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f5677400640 1 -- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56780b2ec0 msgr2=0x7f567815ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f5677400640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56780b2ec0 0x7f567815ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f5677400640 1 -- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5678155e60 msgr2=0x7f567815d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f5677400640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5678155e60 0x7f567815d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f5677400640 1 -- 172.21.15.37:0/1500233815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5678074f00 con 0x7f567806f9a0 2024-05-30T06:55:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f5677400640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f567806f9a0 0x7f56781515b0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f566801cdc0 tx=0x7f566801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:29.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f566fe00640 1 -- 172.21.15.37:0/1500233815 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56680be5f0 con 0x7f567806f9a0 2024-05-30T06:55:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f566fe00640 1 -- 172.21.15.37:0/1500233815 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56680be7b0 con 0x7f567806f9a0 2024-05-30T06:55:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f566fe00640 1 -- 172.21.15.37:0/1500233815 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56680beba0 con 0x7f567806f9a0 2024-05-30T06:55:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f567e800640 1 -- 172.21.15.37:0/1500233815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5678163280 con 0x7f567806f9a0 2024-05-30T06:55:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f567e800640 1 -- 172.21.15.37:0/1500233815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5678163fd0 con 0x7f567806f9a0 2024-05-30T06:55:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f567e800640 1 -- 172.21.15.37:0/1500233815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5678068b20 con 0x7f567806f9a0 2024-05-30T06:55:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.689+0000 7f566fe00640 1 -- 172.21.15.37:0/1500233815 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f56680b43f0 con 0x7f567806f9a0 2024-05-30T06:55:29.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.693+0000 7f566fe00640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5654069910 0x7f565406bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:29.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.693+0000 7f566fe00640 1 -- 172.21.15.37:0/1500233815 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4999+0+0 (secure 0 0 0) 0x7f566811fd80 con 0x7f567806f9a0 2024-05-30T06:55:29.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.693+0000 7f566ea00640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5654069910 0x7f565406bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:29.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.693+0000 7f566ea00640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5654069910 0x7f565406bdd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f567815aa40 tx=0x7f5660008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.697+0000 7f566fe00640 1 -- 172.21.15.37:0/1500233815 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f56680c4060 con 0x7f567806f9a0 2024-05-30T06:55:29.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f567e800640 1 -- 172.21.15.37:0/1500233815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f567815f790 con 0x7f567806f9a0 2024-05-30T06:55:29.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f566fe00640 1 -- 172.21.15.37:0/1500233815 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+3872 (secure 0 0 0) 0x7f5668016110 con 0x7f567806f9a0 2024-05-30T06:55:29.898 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:29.898 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":58,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/714267880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":714267880},{"type":"v1","addr":"172.21.15.105:6836","nonce":714267880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6995,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/1421703174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":1421703174},{"type":"v1","addr":"172.21.15.105:6837","nonce":1421703174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":7423,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3425209937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3425209937},{"type":"v1","addr":"172.21.15.37:6834","nonce":3425209937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7917,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1537275411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1537275411},{"type":"v1","addr":"172.21.15.37:6835","nonce":1537275411}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[]} 2024-05-30T06:55:29.899 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 58 2024-05-30T06:55:29.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f567e800640 1 -- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5654069910 msgr2=0x7f565406bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:29.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f567e800640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5654069910 0x7f565406bdd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f567815aa40 tx=0x7f5660008040 comp rx=0 tx=0).stop 2024-05-30T06:55:29.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f567e800640 1 -- 172.21.15.37:0/1500233815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f567806f9a0 msgr2=0x7f56781515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:29.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f567e800640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f567806f9a0 0x7f56781515b0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f566801cdc0 tx=0x7f566801ad60 comp rx=0 tx=0).stop 2024-05-30T06:55:29.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f567e800640 1 -- 172.21.15.37:0/1500233815 shutdown_connections 2024-05-30T06:55:29.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f567e800640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5654069910 0x7f565406bdd0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f567e800640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5678155e60 0x7f567815d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f567e800640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56780b2ec0 0x7f567815ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f567e800640 1 --2- 172.21.15.37:0/1500233815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f567806f9a0 0x7f56781515b0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:29.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f567e800640 1 -- 172.21.15.37:0/1500233815 >> 172.21.15.37:0/1500233815 conn(0x7f56780b23a0 msgr2=0x7f56780b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:29.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f567e800640 1 -- 172.21.15.37:0/1500233815 shutdown_connections 2024-05-30T06:55:29.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:29.897+0000 7f567e800640 1 -- 172.21.15.37:0/1500233815 wait complete. 2024-05-30T06:55:29.919 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T06:55:29.919 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T06:55:29.920 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T06:55:29.920 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:55:29.920 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T06:55:29.920 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T06:55:29.920 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T06:55:29.920 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:55:29.921 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T06:55:29.921 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T06:55:29.921 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T06:55:29.921 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:55:29.921 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T06:55:29.921 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T06:55:29.921 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T06:55:29.922 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:55:29.932 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T06:55:29.932 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T06:55:29.933 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T06:55:29.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T06:55:29.939 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T06:55:29.939 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T06:55:29.940 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T06:55:29.940 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T06:55:29.975 INFO:tasks.ceph.mds.a:Started 2024-05-30T06:55:29.976 DEBUG:teuthology.parallel:result is None 2024-05-30T06:55:29.977 INFO:tasks.ceph.mds.c:Started 2024-05-30T06:55:29.978 DEBUG:teuthology.parallel:result is None 2024-05-30T06:55:29.983 INFO:tasks.ceph.mds.d:Started 2024-05-30T06:55:29.983 DEBUG:teuthology.parallel:result is None 2024-05-30T06:55:29.985 INFO:tasks.ceph.mds.b:Started 2024-05-30T06:55:29.986 DEBUG:teuthology.parallel:result is None 2024-05-30T06:55:29.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T06:55:30.063 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-30T06:55:30.064 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-30T06:55:30.076 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-05-30T06:55:30.076 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-05-30T06:55:30.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f6053000640 1 Processor -- start 2024-05-30T06:55:30.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f6053000640 1 -- start start 2024-05-30T06:55:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f6053000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f604c0cd440 0x7f604c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f6053000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f604c06f5a0 0x7f604c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f6053000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f604c15f310 con 0x7f604c155da0 2024-05-30T06:55:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f6053000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f604c06fa10 con 0x7f604c0cd440 2024-05-30T06:55:30.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f6053000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f604c15f5f0 con 0x7f604c06f5a0 2024-05-30T06:55:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f604be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f604c155da0 0x7f604c0cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49252/0 (socket says 172.21.15.37:49252) 2024-05-30T06:55:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f604be00640 1 -- 172.21.15.37:0/2801590988 learned_addr learned my addr 172.21.15.37:0/2801590988 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f6043e00640 1 --2- 172.21.15.37:0/2801590988 >> v2:172.21.15.37:3300/0 conn(0x7f604c0cd440 0x7f604c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f6051000640 1 --2- 172.21.15.37:0/2801590988 >> v2:172.21.15.105:3300/0 conn(0x7f604c06f5a0 0x7f604c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f6051000640 1 -- 172.21.15.37:0/2801590988 >> v2:172.21.15.37:3300/0 conn(0x7f604c0cd440 msgr2=0x7f604c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f6051000640 1 --2- 172.21.15.37:0/2801590988 >> v2:172.21.15.37:3300/0 conn(0x7f604c0cd440 0x7f604c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f6051000640 1 -- 172.21.15.37:0/2801590988 >> v1:172.21.15.37:6789/0 conn(0x7f604c155da0 legacy=0x7f604c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f604b400640 1 -- 172.21.15.37:0/2801590988 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728998260 0 0) 0x7f604c15f310 con 0x7f604c155da0 2024-05-30T06:55:30.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.133+0000 7f6051000640 1 -- 172.21.15.37:0/2801590988 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604c15f8d0 con 0x7f604c06f5a0 2024-05-30T06:55:30.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.137+0000 7f6051000640 1 --2- 172.21.15.37:0/2801590988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604c06f5a0 0x7f604c0b3750 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f604c0b6600 tx=0x7f604401c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=941d43a84a172bae server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:30.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.137+0000 7f604b400640 1 -- 172.21.15.37:0/2801590988 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60440a66e0 con 0x7f604c06f5a0 2024-05-30T06:55:30.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.137+0000 7f604b400640 1 -- 172.21.15.37:0/2801590988 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60440a6880 con 0x7f604c06f5a0 2024-05-30T06:55:30.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.137+0000 7f604b400640 1 -- 172.21.15.37:0/2801590988 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60440a6c50 con 0x7f604c06f5a0 2024-05-30T06:55:30.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.137+0000 7f6053000640 1 -- 172.21.15.37:0/2801590988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604c06f5a0 msgr2=0x7f604c0b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:30.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.137+0000 7f6053000640 1 --2- 172.21.15.37:0/2801590988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604c06f5a0 0x7f604c0b3750 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f604c0b6600 tx=0x7f604401c810 comp rx=0 tx=0).stop 2024-05-30T06:55:30.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.137+0000 7f6053000640 1 -- 172.21.15.37:0/2801590988 shutdown_connections 2024-05-30T06:55:30.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.137+0000 7f6053000640 1 --2- 172.21.15.37:0/2801590988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604c06f5a0 0x7f604c0b3750 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:30.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.137+0000 7f6053000640 1 --2- 172.21.15.37:0/2801590988 >> v2:172.21.15.37:3300/0 conn(0x7f604c0cd440 0x7f604c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:30.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.137+0000 7f6053000640 1 -- 172.21.15.37:0/2801590988 >> 172.21.15.37:0/2801590988 conn(0x7f604c06bf60 msgr2=0x7f604c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:30.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.137+0000 7f6053000640 1 -- 172.21.15.37:0/2801590988 shutdown_connections 2024-05-30T06:55:30.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.137+0000 7f6053000640 1 -- 172.21.15.37:0/2801590988 wait complete. 2024-05-30T06:55:30.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6053000640 1 Processor -- start 2024-05-30T06:55:30.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6053000640 1 -- start start 2024-05-30T06:55:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6053000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f604c06f5a0 0x7f604c14b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6053000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f604c155da0 0x7f604c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6053000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604c06e490 0x7f604c158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6053000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f604c168580 con 0x7f604c155da0 2024-05-30T06:55:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6053000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f604c0b46b0 con 0x7f604c06e490 2024-05-30T06:55:30.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6053000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f604c168700 con 0x7f604c06f5a0 2024-05-30T06:55:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6043e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f604c155da0 0x7f604c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6043e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f604c155da0 0x7f604c06df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51530/0 (socket says 172.21.15.37:51530) 2024-05-30T06:55:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6043e00640 1 -- 172.21.15.37:0/3415332754 learned_addr learned my addr 172.21.15.37:0/3415332754 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6051000640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604c06e490 0x7f604c158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f604be00640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f604c06f5a0 0x7f604c14b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6043e00640 1 -- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f604c06f5a0 msgr2=0x7f604c14b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6043e00640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f604c06f5a0 0x7f604c14b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6043e00640 1 -- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604c06e490 msgr2=0x7f604c158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:30.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6043e00640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604c06e490 0x7f604c158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6043e00640 1 -- 172.21.15.37:0/3415332754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604c06e9a0 con 0x7f604c155da0 2024-05-30T06:55:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6043e00640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f604c155da0 0x7f604c06df50 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f603400e930 tx=0x7f603400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6048c00640 1 -- 172.21.15.37:0/3415332754 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034017070 con 0x7f604c155da0 2024-05-30T06:55:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6048c00640 1 -- 172.21.15.37:0/3415332754 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f603400ca00 con 0x7f604c155da0 2024-05-30T06:55:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6053000640 1 -- 172.21.15.37:0/3415332754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f604c06ec80 con 0x7f604c155da0 2024-05-30T06:55:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6048c00640 1 -- 172.21.15.37:0/3415332754 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603400cdb0 con 0x7f604c155da0 2024-05-30T06:55:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.141+0000 7f6053000640 1 -- 172.21.15.37:0/3415332754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f604c157b90 con 0x7f604c155da0 2024-05-30T06:55:30.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.145+0000 7f6053000640 1 -- 172.21.15.37:0/3415332754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f604c068bc0 con 0x7f604c155da0 2024-05-30T06:55:30.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.145+0000 7f6048c00640 1 -- 172.21.15.37:0/3415332754 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f603401a070 con 0x7f604c155da0 2024-05-30T06:55:30.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.145+0000 7f6048c00640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60280698e0 0x7f602806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:30.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.145+0000 7f6048c00640 1 -- 172.21.15.37:0/3415332754 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4999+0+0 (secure 0 0 0) 0x7f6034085a20 con 0x7f604c155da0 2024-05-30T06:55:30.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.145+0000 7f604be00640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60280698e0 0x7f602806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:30.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.145+0000 7f604be00640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60280698e0 0x7f602806bda0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f603c000f70 tx=0x7f603c007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:30.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.149+0000 7f6048c00640 1 -- 172.21.15.37:0/3415332754 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f60340574a0 con 0x7f604c155da0 2024-05-30T06:55:30.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.325+0000 7f6053000640 1 -- 172.21.15.37:0/3415332754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f604c14c620 con 0x7f604c155da0 2024-05-30T06:55:30.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.885+0000 7f6048c00640 1 -- 172.21.15.37:0/3415332754 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v96) ==== 97+0+0 (secure 0 0 0) 0x7f603405b7a0 con 0x7f604c155da0 2024-05-30T06:55:30.887 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-30T06:55:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.889+0000 7f6053000640 1 -- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60280698e0 msgr2=0x7f602806bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.889+0000 7f6053000640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60280698e0 0x7f602806bda0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f603c000f70 tx=0x7f603c007df0 comp rx=0 tx=0).stop 2024-05-30T06:55:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.889+0000 7f6053000640 1 -- 172.21.15.37:0/3415332754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f604c155da0 msgr2=0x7f604c06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.889+0000 7f6053000640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f604c155da0 0x7f604c06df50 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f603400e930 tx=0x7f603400edf0 comp rx=0 tx=0).stop 2024-05-30T06:55:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.889+0000 7f6053000640 1 -- 172.21.15.37:0/3415332754 shutdown_connections 2024-05-30T06:55:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.889+0000 7f6053000640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f60280698e0 0x7f602806bda0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.889+0000 7f6053000640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f604c06e490 0x7f604c158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.889+0000 7f6053000640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f604c155da0 0x7f604c06df50 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.889+0000 7f6053000640 1 --2- 172.21.15.37:0/3415332754 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f604c06f5a0 0x7f604c14b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.889+0000 7f6053000640 1 -- 172.21.15.37:0/3415332754 >> 172.21.15.37:0/3415332754 conn(0x7f604c06bf60 msgr2=0x7f604c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.889+0000 7f6053000640 1 -- 172.21.15.37:0/3415332754 shutdown_connections 2024-05-30T06:55:30.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:30.889+0000 7f6053000640 1 -- 172.21.15.37:0/3415332754 wait complete. 2024-05-30T06:55:30.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T06:55:31.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.061+0000 7f6a58200640 1 Processor -- start 2024-05-30T06:55:31.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.061+0000 7f6a58200640 1 -- start start 2024-05-30T06:55:31.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a58200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a5006e000 0x7f6a500ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a58200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6a5015cd80 0x7f6a500ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a58200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a500cec40 0x7f6a5006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a58200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6a500a9530 con 0x7f6a500cec40 2024-05-30T06:55:31.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a58200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6a500cd120 con 0x7f6a5015cd80 2024-05-30T06:55:31.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a58200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6a500cd400 con 0x7f6a5006e000 2024-05-30T06:55:31.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a56200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a500cec40 0x7f6a5006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a56200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a500cec40 0x7f6a5006e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51536/0 (socket says 172.21.15.37:51536) 2024-05-30T06:55:31.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a56200640 1 -- 172.21.15.37:0/2669843236 learned_addr learned my addr 172.21.15.37:0/2669843236 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:31.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a55800640 1 --2- 172.21.15.37:0/2669843236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a5006e000 0x7f6a500ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a54e00640 1 --2- 172.21.15.37:0/2669843236 >> v2:172.21.15.105:3300/0 conn(0x7f6a5015cd80 0x7f6a500ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a56200640 1 -- 172.21.15.37:0/2669843236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a5006e000 msgr2=0x7f6a500ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:31.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a56200640 1 --2- 172.21.15.37:0/2669843236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a5006e000 0x7f6a500ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a56200640 1 -- 172.21.15.37:0/2669843236 >> v2:172.21.15.105:3300/0 conn(0x7f6a5015cd80 msgr2=0x7f6a500ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:31.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a56200640 1 --2- 172.21.15.37:0/2669843236 >> v2:172.21.15.105:3300/0 conn(0x7f6a5015cd80 0x7f6a500ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a56200640 1 -- 172.21.15.37:0/2669843236 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a500cd6e0 con 0x7f6a500cec40 2024-05-30T06:55:31.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a54e00640 1 --2- 172.21.15.37:0/2669843236 >> v2:172.21.15.105:3300/0 conn(0x7f6a5015cd80 0x7f6a500ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:31.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.065+0000 7f6a56200640 1 --2- 172.21.15.37:0/2669843236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500cec40 0x7f6a5006e3e0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f6a500b5b70 tx=0x7f6a4801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b715a5a502a462 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:31.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a4fe00640 1 -- 172.21.15.37:0/2669843236 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a480b4070 con 0x7f6a500cec40 2024-05-30T06:55:31.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a4fe00640 1 -- 172.21.15.37:0/2669843236 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a480af400 con 0x7f6a500cec40 2024-05-30T06:55:31.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a4fe00640 1 -- 172.21.15.37:0/2669843236 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a480af7d0 con 0x7f6a500cec40 2024-05-30T06:55:31.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 -- 172.21.15.37:0/2669843236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500cec40 msgr2=0x7f6a5006e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 --2- 172.21.15.37:0/2669843236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500cec40 0x7f6a5006e3e0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f6a500b5b70 tx=0x7f6a4801f1e0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 -- 172.21.15.37:0/2669843236 shutdown_connections 2024-05-30T06:55:31.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 --2- 172.21.15.37:0/2669843236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500cec40 0x7f6a5006e3e0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 --2- 172.21.15.37:0/2669843236 >> v2:172.21.15.105:3300/0 conn(0x7f6a5015cd80 0x7f6a500ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 --2- 172.21.15.37:0/2669843236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a5006e000 0x7f6a500ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 -- 172.21.15.37:0/2669843236 >> 172.21.15.37:0/2669843236 conn(0x7f6a500b23a0 msgr2=0x7f6a500b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 -- 172.21.15.37:0/2669843236 shutdown_connections 2024-05-30T06:55:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 -- 172.21.15.37:0/2669843236 wait complete. 2024-05-30T06:55:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 Processor -- start 2024-05-30T06:55:31.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 -- start start 2024-05-30T06:55:31.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a5006e000 0x7f6a5015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500cec40 0x7f6a500b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a5015cd80 0x7f6a50142e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6a500cf0a0 con 0x7f6a500cec40 2024-05-30T06:55:31.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a500cdca0 con 0x7f6a5006e000 2024-05-30T06:55:31.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a58200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5006e920 con 0x7f6a5015cd80 2024-05-30T06:55:31.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a54e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500cec40 0x7f6a500b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a54e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500cec40 0x7f6a500b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51550/0 (socket says 172.21.15.37:51550) 2024-05-30T06:55:31.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a54e00640 1 -- 172.21.15.37:0/2606895482 learned_addr learned my addr 172.21.15.37:0/2606895482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:31.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a56200640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a5015cd80 0x7f6a50142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a55800640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a5006e000 0x7f6a5015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a54e00640 1 -- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a5015cd80 msgr2=0x7f6a50142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a54e00640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a5015cd80 0x7f6a50142e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a54e00640 1 -- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a5006e000 msgr2=0x7f6a5015a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a54e00640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a5006e000 0x7f6a5015a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.069+0000 7f6a54e00640 1 -- 172.21.15.37:0/2606895482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a500b43b0 con 0x7f6a500cec40 2024-05-30T06:55:31.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.073+0000 7f6a56200640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a5015cd80 0x7f6a50142e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:31.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.073+0000 7f6a55800640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a5006e000 0x7f6a5015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:31.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.073+0000 7f6a54e00640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500cec40 0x7f6a500b3ab0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00e810 tx=0x7f6a3c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:31.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.073+0000 7f6a4d600640 1 -- 172.21.15.37:0/2606895482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c017070 con 0x7f6a500cec40 2024-05-30T06:55:31.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.073+0000 7f6a4d600640 1 -- 172.21.15.37:0/2606895482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3c00c8d0 con 0x7f6a500cec40 2024-05-30T06:55:31.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.073+0000 7f6a4d600640 1 -- 172.21.15.37:0/2606895482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00f040 con 0x7f6a500cec40 2024-05-30T06:55:31.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.073+0000 7f6a58200640 1 -- 172.21.15.37:0/2606895482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a500b4690 con 0x7f6a500cec40 2024-05-30T06:55:31.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.073+0000 7f6a58200640 1 -- 172.21.15.37:0/2606895482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a500b4c50 con 0x7f6a500cec40 2024-05-30T06:55:31.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.073+0000 7f6a58200640 1 -- 172.21.15.37:0/2606895482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a50068b20 con 0x7f6a500cec40 2024-05-30T06:55:31.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.073+0000 7f6a4d600640 1 -- 172.21.15.37:0/2606895482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f6a3c01a070 con 0x7f6a500cec40 2024-05-30T06:55:31.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.073+0000 7f6a4d600640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6a30069910 0x7f6a3006bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.073+0000 7f6a4d600640 1 -- 172.21.15.37:0/2606895482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 4885+0+0 (secure 0 0 0) 0x7f6a3c085700 con 0x7f6a500cec40 2024-05-30T06:55:31.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.073+0000 7f6a55800640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6a30069910 0x7f6a3006bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.077+0000 7f6a55800640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6a30069910 0x7f6a3006bdd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6a500b22d0 tx=0x7f6a44008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:31.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.077+0000 7f6a4d600640 1 -- 172.21.15.37:0/2606895482 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6a3c057310 con 0x7f6a500cec40 2024-05-30T06:55:31.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.301+0000 7f6a58200640 1 -- 172.21.15.37:0/2606895482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6a50072c00 con 0x7f6a500cec40 2024-05-30T06:55:31.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.301+0000 7f6a4d600640 1 -- 172.21.15.37:0/2606895482 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f6a3c085b80 con 0x7f6a500cec40 2024-05-30T06:55:31.303 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:31.303 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:55:31.303 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-30T06:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-30T06:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmcRfnBBAAk60J/SRTolMhKoS8b8A9jQ==", 2024-05-30T06:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-30T06:55:31.304 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmzScrERAAbIJ5somf+sguc6jEuR04zg==", 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm2jEhDBAAGKUYGtJznRYpt1LHlMOTrw==", 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:55:31.305 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:55:31.306 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.306 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.306 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.306 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.306 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-30T06:55:31.306 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm95RdGBAAaaaNAKnr4Dtmu+L1NaMVbw==", 2024-05-30T06:55:31.306 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.306 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:55:31.306 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:55:31.306 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:55:31.306 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.306 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.307 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.307 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.307 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-30T06:55:31.307 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCFH1hmygxjHhAA1ee1eBP6dvsC0K9w+6d0OQ==", 2024-05-30T06:55:31.307 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.307 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:55:31.307 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:55:31.307 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.307 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCIH1hmNJsBKRAAhns5CNodS7CKFU1Jg3PFCA==", 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCLH1hmlx5FNBAAn2Iann8U/uTZy0tFcFx04w==", 2024-05-30T06:55:31.308 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.309 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:55:31.309 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:55:31.309 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.309 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.309 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.309 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.309 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-30T06:55:31.309 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCPH1hmxJnxAhAAt5cEb3YVLDhkQD5WjLQuog==", 2024-05-30T06:55:31.309 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.309 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:55:31.309 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:55:31.309 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.309 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.310 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.310 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.310 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-30T06:55:31.310 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCUH1hmEn5cOBAAFzBuH8TO418e4obqTNeIXg==", 2024-05-30T06:55:31.310 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.310 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:55:31.310 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:55:31.310 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.310 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.310 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.310 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.310 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-30T06:55:31.310 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCYH1hmij3RCBAAHzQPoM1ClYGGEt6ly6ZrqQ==", 2024-05-30T06:55:31.311 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.311 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:55:31.311 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:55:31.311 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.311 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.311 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.311 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.311 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-30T06:55:31.311 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCbH1hmDqdpERAA46/Bs4B/xVjviQ1gNpNaaw==", 2024-05-30T06:55:31.311 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.311 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:55:31.311 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:55:31.311 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.312 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.312 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.312 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.312 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-30T06:55:31.312 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCeH1hmnrfVHRAAlqk48vSVw45YDCXWWb/MUA==", 2024-05-30T06:55:31.312 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.312 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:55:31.312 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:55:31.312 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.312 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.312 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.312 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.312 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A==", 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmf8sdJhAATAP7EzLJxXXnXeEQL9fdpw==", 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:55:31.313 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:55:31.314 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:55:31.314 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.314 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.314 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.314 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-30T06:55:31.314 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm1qB9IhAAszAwOgm2Igb1DM4diPC7ow==", 2024-05-30T06:55:31.314 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.314 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:55:31.314 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:55:31.314 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:55:31.314 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:55:31.314 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.314 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.315 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.315 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-30T06:55:31.315 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmY6AULBAAYNza0fpC3KO69ulNQaSldQ==", 2024-05-30T06:55:31.315 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.315 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:55:31.315 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:55:31.315 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:55:31.315 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:55:31.315 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.315 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.315 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.315 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-30T06:55:31.315 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmbSCrJBAAhn69RBUeyuaAMWiB3o7ByQ==", 2024-05-30T06:55:31.316 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.316 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:55:31.316 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:55:31.316 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:55:31.316 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.316 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.316 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.316 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.316 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-30T06:55:31.316 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmN/fjABAAdldbCncRiHy6RFEF9H7gnQ==", 2024-05-30T06:55:31.316 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.316 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:55:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:55:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:55:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-30T06:55:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmNdeSOBAA3V4vK0bNlWFoosV41f/ASQ==", 2024-05-30T06:55:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:55:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:55:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:55:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:55:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.317 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:31.318 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-30T06:55:31.318 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:55:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.305+0000 7f6a58200640 1 -- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6a30069910 msgr2=0x7f6a3006bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.305+0000 7f6a58200640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6a30069910 0x7f6a3006bdd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6a500b22d0 tx=0x7f6a44008040 comp rx=0 tx=0).stop 2024-05-30T06:55:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.305+0000 7f6a58200640 1 -- 172.21.15.37:0/2606895482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500cec40 msgr2=0x7f6a500b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.305+0000 7f6a58200640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500cec40 0x7f6a500b3ab0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00e810 tx=0x7f6a3c00ecd0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.305+0000 7f6a58200640 1 -- 172.21.15.37:0/2606895482 shutdown_connections 2024-05-30T06:55:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.305+0000 7f6a58200640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a5015cd80 0x7f6a50142e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.305+0000 7f6a58200640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500cec40 0x7f6a500b3ab0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.305+0000 7f6a58200640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6a30069910 0x7f6a3006bdd0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.305+0000 7f6a58200640 1 --2- 172.21.15.37:0/2606895482 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a5006e000 0x7f6a5015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.305+0000 7f6a58200640 1 -- 172.21.15.37:0/2606895482 >> 172.21.15.37:0/2606895482 conn(0x7f6a500b23a0 msgr2=0x7f6a50071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.305+0000 7f6a58200640 1 -- 172.21.15.37:0/2606895482 shutdown_connections 2024-05-30T06:55:31.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.305+0000 7f6a58200640 1 -- 172.21.15.37:0/2606895482 wait complete. 2024-05-30T06:55:31.326 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:55:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.465+0000 7fdb31400640 1 Processor -- start 2024-05-30T06:55:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.465+0000 7fdb31400640 1 -- start start 2024-05-30T06:55:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb31400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdb2c0b55a0 0x7fdb2c0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb31400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb2c15fb30 0x7fdb2c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb31400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb2c162f70 con 0x7fdb2c06d080 2024-05-30T06:55:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb31400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdb2c0b5ec0 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb31400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb2c163210 con 0x7fdb2c15fb30 2024-05-30T06:55:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb2b200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb2c15fb30 0x7fdb2c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb2b200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb2c15fb30 0x7fdb2c0aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:43188/0 (socket says 172.21.15.37:43188) 2024-05-30T06:55:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb2b200640 1 -- 172.21.15.37:0/1396118399 learned_addr learned my addr 172.21.15.37:0/1396118399 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb2a800640 1 --2- 172.21.15.37:0/1396118399 >> v2:172.21.15.105:3300/0 conn(0x7fdb2c0b55a0 0x7fdb2c0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb23e00640 1 --1- 172.21.15.37:0/1396118399 >> v1:172.21.15.105:6789/0 conn(0x7fdb2c06d080 0x7fdb2c0b4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:42954/0 (socket says 172.21.15.37:42954) 2024-05-30T06:55:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb2b200640 1 -- 172.21.15.37:0/1396118399 >> v2:172.21.15.105:3300/0 conn(0x7fdb2c0b55a0 msgr2=0x7fdb2c0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb2b200640 1 --2- 172.21.15.37:0/1396118399 >> v2:172.21.15.105:3300/0 conn(0x7fdb2c0b55a0 0x7fdb2c0b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb29e00640 1 -- 172.21.15.37:0/1396118399 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1245662680 0 0) 0x7fdb2c162f70 con 0x7fdb2c06d080 2024-05-30T06:55:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb2b200640 1 -- 172.21.15.37:0/1396118399 >> v1:172.21.15.105:6789/0 conn(0x7fdb2c06d080 legacy=0x7fdb2c0b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.469+0000 7fdb2b200640 1 -- 172.21.15.37:0/1396118399 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c0b4040 con 0x7fdb2c15fb30 2024-05-30T06:55:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb2b200640 1 --2- 172.21.15.37:0/1396118399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb2c15fb30 0x7fdb2c0aedb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009e50 tx=0x7fdb2401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ae9c47107194afb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb29e00640 1 -- 172.21.15.37:0/1396118399 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb240a5740 con 0x7fdb2c15fb30 2024-05-30T06:55:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb29e00640 1 -- 172.21.15.37:0/1396118399 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb240a58e0 con 0x7fdb2c15fb30 2024-05-30T06:55:31.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb29e00640 1 -- 172.21.15.37:0/1396118399 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb240a5cb0 con 0x7fdb2c15fb30 2024-05-30T06:55:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb31400640 1 -- 172.21.15.37:0/1396118399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb2c15fb30 msgr2=0x7fdb2c0aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb31400640 1 --2- 172.21.15.37:0/1396118399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb2c15fb30 0x7fdb2c0aedb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009e50 tx=0x7fdb2401c970 comp rx=0 tx=0).stop 2024-05-30T06:55:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb31400640 1 -- 172.21.15.37:0/1396118399 shutdown_connections 2024-05-30T06:55:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb31400640 1 --2- 172.21.15.37:0/1396118399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb2c15fb30 0x7fdb2c0aedb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb31400640 1 --2- 172.21.15.37:0/1396118399 >> v2:172.21.15.105:3300/0 conn(0x7fdb2c0b55a0 0x7fdb2c0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb31400640 1 -- 172.21.15.37:0/1396118399 >> 172.21.15.37:0/1396118399 conn(0x7fdb2c073680 msgr2=0x7fdb2c06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb31400640 1 -- 172.21.15.37:0/1396118399 shutdown_connections 2024-05-30T06:55:31.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb31400640 1 -- 172.21.15.37:0/1396118399 wait complete. 2024-05-30T06:55:31.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb31400640 1 Processor -- start 2024-05-30T06:55:31.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.473+0000 7fdb31400640 1 -- start start 2024-05-30T06:55:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb31400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb2c06d080 0x7fdb2c166440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb31400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0b55a0 0x7fdb2c157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb31400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb2c15fb30 0x7fdb2c06f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb31400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c0b07c0 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb31400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdb2c0b0640 con 0x7fdb2c06d080 2024-05-30T06:55:31.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb31400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb2c16be60 con 0x7fdb2c15fb30 2024-05-30T06:55:31.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb23e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0b55a0 0x7fdb2c157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb23e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0b55a0 0x7fdb2c157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51564/0 (socket says 172.21.15.37:51564) 2024-05-30T06:55:31.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb23e00640 1 -- 172.21.15.37:0/1977365032 learned_addr learned my addr 172.21.15.37:0/1977365032 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:31.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb2b200640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb2c15fb30 0x7fdb2c06f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb2a800640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb2c06d080 0x7fdb2c166440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb23e00640 1 -- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb2c15fb30 msgr2=0x7fdb2c06f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb23e00640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb2c15fb30 0x7fdb2c06f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb23e00640 1 -- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb2c06d080 msgr2=0x7fdb2c166440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb23e00640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb2c06d080 0x7fdb2c166440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb23e00640 1 -- 172.21.15.37:0/1977365032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2c159280 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb23e00640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0b55a0 0x7fdb2c157220 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c4b0 tx=0x7fdb1400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:31.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb22a00640 1 -- 172.21.15.37:0/1977365032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14018070 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb22a00640 1 -- 172.21.15.37:0/1977365032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb14007500 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb22a00640 1 -- 172.21.15.37:0/1977365032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14004a30 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb31400640 1 -- 172.21.15.37:0/1977365032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2c159560 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb31400640 1 -- 172.21.15.37:0/1977365032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2c159b20 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb31400640 1 -- 172.21.15.37:0/1977365032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb2c068b20 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.477+0000 7fdb22a00640 1 -- 172.21.15.37:0/1977365032 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fdb14004bd0 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.481+0000 7fdb22a00640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb08069910 0x7fdb0806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.481+0000 7fdb22a00640 1 -- 172.21.15.37:0/1977365032 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 4885+0+0 (secure 0 0 0) 0x7fdb14084d10 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.481+0000 7fdb2a800640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb08069910 0x7fdb0806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.481+0000 7fdb2a800640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb08069910 0x7fdb0806bdd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009af0 tx=0x7fdb1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:31.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.485+0000 7fdb22a00640 1 -- 172.21.15.37:0/1977365032 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdb140569e0 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb31400640 1 -- 172.21.15.37:0/1977365032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb2c163ff0 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb22a00640 1 -- 172.21.15.37:0/1977365032 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+12923 (secure 0 0 0) 0x7fdb14085190 con 0x7fdb2c0b55a0 2024-05-30T06:55:31.654 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:31.654 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":98,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:55:30.902746+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:55:31.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb31400640 1 -- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb08069910 msgr2=0x7fdb0806bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb31400640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb08069910 0x7fdb0806bdd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c009af0 tx=0x7fdb1c008040 comp rx=0 tx=0).stop 2024-05-30T06:55:31.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb31400640 1 -- 172.21.15.37:0/1977365032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0b55a0 msgr2=0x7fdb2c157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb31400640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0b55a0 0x7fdb2c157220 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400c4b0 tx=0x7fdb1400c970 comp rx=0 tx=0).stop 2024-05-30T06:55:31.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb31400640 1 -- 172.21.15.37:0/1977365032 shutdown_connections 2024-05-30T06:55:31.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb31400640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb2c15fb30 0x7fdb2c06f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb31400640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb2c0b55a0 0x7fdb2c157220 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb31400640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb08069910 0x7fdb0806bdd0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb31400640 1 --2- 172.21.15.37:0/1977365032 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb2c06d080 0x7fdb2c166440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb31400640 1 -- 172.21.15.37:0/1977365032 >> 172.21.15.37:0/1977365032 conn(0x7fdb2c073680 msgr2=0x7fdb2c06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:31.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb31400640 1 -- 172.21.15.37:0/1977365032 shutdown_connections 2024-05-30T06:55:31.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.653+0000 7fdb31400640 1 -- 172.21.15.37:0/1977365032 wait complete. 2024-05-30T06:55:31.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:55:31.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:55:31.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.817+0000 7fdd23a00640 1 Processor -- start 2024-05-30T06:55:31.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.817+0000 7fdd23a00640 1 -- start start 2024-05-30T06:55:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.817+0000 7fdd23a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd1c1624a0 0x7fdd1c06b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.817+0000 7fdd23a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd1c0b6130 con 0x7fdd1c06bea0 2024-05-30T06:55:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.817+0000 7fdd23a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd1c071410 con 0x7fdd1c158e00 2024-05-30T06:55:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.817+0000 7fdd23a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1c0b4790 con 0x7fdd1c1624a0 2024-05-30T06:55:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.821+0000 7fdd21a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdd1c06bea0 0x7fdd1c0b4c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49262/0 (socket says 172.21.15.37:49262) 2024-05-30T06:55:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.821+0000 7fdd21a00640 1 -- 172.21.15.37:0/915465879 learned_addr learned my addr 172.21.15.37:0/915465879 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.821+0000 7fdd13e00640 1 --2- 172.21.15.37:0/915465879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd1c1624a0 0x7fdd1c06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.821+0000 7fdd1be00640 1 -- 172.21.15.37:0/915465879 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2720644207 0 0) 0x7fdd1c0b6130 con 0x7fdd1c06bea0 2024-05-30T06:55:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.821+0000 7fdd1be00640 1 -- 172.21.15.37:0/915465879 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd00003530 con 0x7fdd1c06bea0 2024-05-30T06:55:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.821+0000 7fdd1be00640 1 -- 172.21.15.37:0/915465879 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2018535858 0 0) 0x7fdd1c071410 con 0x7fdd1c158e00 2024-05-30T06:55:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.821+0000 7fdd1be00640 1 -- 172.21.15.37:0/915465879 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd1c0b6130 con 0x7fdd1c158e00 2024-05-30T06:55:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.821+0000 7fdd13e00640 1 -- 172.21.15.37:0/915465879 >> v1:172.21.15.105:6789/0 conn(0x7fdd1c158e00 legacy=0x7fdd1c0b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.821+0000 7fdd13e00640 1 -- 172.21.15.37:0/915465879 >> v1:172.21.15.37:6789/0 conn(0x7fdd1c06bea0 legacy=0x7fdd1c0b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.821+0000 7fdd13e00640 1 -- 172.21.15.37:0/915465879 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c162980 con 0x7fdd1c1624a0 2024-05-30T06:55:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.821+0000 7fdd13e00640 1 --2- 172.21.15.37:0/915465879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd1c1624a0 0x7fdd1c06b960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd040097f0 tx=0x7fdd0401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3246863b1f13b4ec server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.821+0000 7fdd1be00640 1 -- 172.21.15.37:0/915465879 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd040b0070 con 0x7fdd1c1624a0 2024-05-30T06:55:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd1be00640 1 -- 172.21.15.37:0/915465879 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd040ab600 con 0x7fdd1c1624a0 2024-05-30T06:55:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd1be00640 1 -- 172.21.15.37:0/915465879 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd040ab9d0 con 0x7fdd1c1624a0 2024-05-30T06:55:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 -- 172.21.15.37:0/915465879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd1c1624a0 msgr2=0x7fdd1c06b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 --2- 172.21.15.37:0/915465879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd1c1624a0 0x7fdd1c06b960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdd040097f0 tx=0x7fdd0401c4e0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 -- 172.21.15.37:0/915465879 shutdown_connections 2024-05-30T06:55:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 --2- 172.21.15.37:0/915465879 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd1c1624a0 0x7fdd1c06b960 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 -- 172.21.15.37:0/915465879 >> 172.21.15.37:0/915465879 conn(0x7fdd1c06f110 msgr2=0x7fdd1c06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 -- 172.21.15.37:0/915465879 shutdown_connections 2024-05-30T06:55:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 -- 172.21.15.37:0/915465879 wait complete. 2024-05-30T06:55:31.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 Processor -- start 2024-05-30T06:55:31.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 -- start start 2024-05-30T06:55:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c06bea0 0x7fdd1c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd1c158e00 0x7fdd1c0cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd1c1624a0 0x7fdd1c14e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c159360 con 0x7fdd1c158e00 2024-05-30T06:55:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c1591e0 con 0x7fdd1c06bea0 2024-05-30T06:55:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd23a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdd1c16d060 con 0x7fdd1c1624a0 2024-05-30T06:55:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd13e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd1c158e00 0x7fdd1c0cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd13e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd1c158e00 0x7fdd1c0cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51566/0 (socket says 172.21.15.37:51566) 2024-05-30T06:55:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd13e00640 1 -- 172.21.15.37:0/271172361 learned_addr learned my addr 172.21.15.37:0/271172361 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd21a00640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd1c1624a0 0x7fdd1c14e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd21000640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c06bea0 0x7fdd1c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd13e00640 1 -- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd1c1624a0 msgr2=0x7fdd1c14e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd13e00640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd1c1624a0 0x7fdd1c14e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd13e00640 1 -- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c06bea0 msgr2=0x7fdd1c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd13e00640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c06bea0 0x7fdd1c0cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd13e00640 1 -- 172.21.15.37:0/271172361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c0b6930 con 0x7fdd1c158e00 2024-05-30T06:55:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.825+0000 7fdd21a00640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd1c1624a0 0x7fdd1c14e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.829+0000 7fdd13e00640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd1c158e00 0x7fdd1c0cda00 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009740 tx=0x7fdd04019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:31.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.829+0000 7fdd19600640 1 -- 172.21.15.37:0/271172361 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd040abe60 con 0x7fdd1c158e00 2024-05-30T06:55:31.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.829+0000 7fdd19600640 1 -- 172.21.15.37:0/271172361 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd040b9070 con 0x7fdd1c158e00 2024-05-30T06:55:31.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.829+0000 7fdd19600640 1 -- 172.21.15.37:0/271172361 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd040b0040 con 0x7fdd1c158e00 2024-05-30T06:55:31.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.829+0000 7fdd23a00640 1 -- 172.21.15.37:0/271172361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1c15ad60 con 0x7fdd1c158e00 2024-05-30T06:55:31.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.829+0000 7fdd23a00640 1 -- 172.21.15.37:0/271172361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd1c15b320 con 0x7fdd1c158e00 2024-05-30T06:55:31.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.829+0000 7fdd23a00640 1 -- 172.21.15.37:0/271172361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd1c068bc0 con 0x7fdd1c158e00 2024-05-30T06:55:31.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.829+0000 7fdd19600640 1 -- 172.21.15.37:0/271172361 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fdd040b4670 con 0x7fdd1c158e00 2024-05-30T06:55:31.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.829+0000 7fdd19600640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdcf80698e0 0x7fdcf806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:31.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.829+0000 7fdd19600640 1 -- 172.21.15.37:0/271172361 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 4885+0+0 (secure 0 0 0) 0x7fdd0411f5a0 con 0x7fdd1c158e00 2024-05-30T06:55:31.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.829+0000 7fdd21000640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdcf80698e0 0x7fdcf806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:31.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.833+0000 7fdd21000640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdcf80698e0 0x7fdcf806bda0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0ce0b0 tx=0x7fdd0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:31.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:31.833+0000 7fdd19600640 1 -- 172.21.15.37:0/271172361 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdd040160d0 con 0x7fdd1c158e00 2024-05-30T06:55:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.001+0000 7fdd23a00640 1 -- 172.21.15.37:0/271172361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdd1c16a620 con 0x7fdd1c158e00 2024-05-30T06:55:32.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.001+0000 7fdd19600640 1 -- 172.21.15.37:0/271172361 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) ==== 93+0+10 (secure 0 0 0) 0x7fdd040f11b0 con 0x7fdd1c158e00 2024-05-30T06:55:32.004 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:55:32.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.005+0000 7fdd23a00640 1 -- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdcf80698e0 msgr2=0x7fdcf806bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.005+0000 7fdd23a00640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdcf80698e0 0x7fdcf806bda0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0ce0b0 tx=0x7fdd0c009040 comp rx=0 tx=0).stop 2024-05-30T06:55:32.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.005+0000 7fdd23a00640 1 -- 172.21.15.37:0/271172361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd1c158e00 msgr2=0x7fdd1c0cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.005+0000 7fdd23a00640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd1c158e00 0x7fdd1c0cda00 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009740 tx=0x7fdd04019280 comp rx=0 tx=0).stop 2024-05-30T06:55:32.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.005+0000 7fdd23a00640 1 -- 172.21.15.37:0/271172361 shutdown_connections 2024-05-30T06:55:32.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.005+0000 7fdd23a00640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd1c1624a0 0x7fdd1c14e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.005+0000 7fdd23a00640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd1c158e00 0x7fdd1c0cda00 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.005+0000 7fdd23a00640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdcf80698e0 0x7fdcf806bda0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.005+0000 7fdd23a00640 1 --2- 172.21.15.37:0/271172361 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd1c06bea0 0x7fdd1c0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.005+0000 7fdd23a00640 1 -- 172.21.15.37:0/271172361 >> 172.21.15.37:0/271172361 conn(0x7fdd1c06f110 msgr2=0x7fdd1c0d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:32.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.005+0000 7fdd23a00640 1 -- 172.21.15.37:0/271172361 shutdown_connections 2024-05-30T06:55:32.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.005+0000 7fdd23a00640 1 -- 172.21.15.37:0/271172361 wait complete. 2024-05-30T06:55:32.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T06:55:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.165+0000 7ff74e000640 1 Processor -- start 2024-05-30T06:55:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.165+0000 7ff74e000640 1 -- start start 2024-05-30T06:55:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.165+0000 7ff74e000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74815ed50 0x7ff7480c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.165+0000 7ff74e000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff7480d02b0 0x7ff7480d0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.165+0000 7ff74e000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7480d0c50 0x7ff7481627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.165+0000 7ff74e000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff7480c9500 con 0x7ff7480d0c50 2024-05-30T06:55:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.165+0000 7ff74e000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff74815f130 con 0x7ff7480d02b0 2024-05-30T06:55:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.165+0000 7ff74e000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff7480c7f20 con 0x7ff74815ed50 2024-05-30T06:55:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff747e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7480d0c50 0x7ff7481627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff747e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7480d0c50 0x7ff7481627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51580/0 (socket says 172.21.15.37:51580) 2024-05-30T06:55:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff747e00640 1 -- 172.21.15.37:0/3642212002 learned_addr learned my addr 172.21.15.37:0/3642212002 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:32.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff747400640 1 --2- 172.21.15.37:0/3642212002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74815ed50 0x7ff7480c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff73ea00640 1 --2- 172.21.15.37:0/3642212002 >> v2:172.21.15.105:3300/0 conn(0x7ff7480d02b0 0x7ff7480d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff747e00640 1 -- 172.21.15.37:0/3642212002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74815ed50 msgr2=0x7ff7480c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff747e00640 1 --2- 172.21.15.37:0/3642212002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74815ed50 0x7ff7480c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff747e00640 1 -- 172.21.15.37:0/3642212002 >> v2:172.21.15.105:3300/0 conn(0x7ff7480d02b0 msgr2=0x7ff7480d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff747e00640 1 --2- 172.21.15.37:0/3642212002 >> v2:172.21.15.105:3300/0 conn(0x7ff7480d02b0 0x7ff7480d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff747e00640 1 -- 172.21.15.37:0/3642212002 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7480c8200 con 0x7ff7480d0c50 2024-05-30T06:55:32.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff747e00640 1 --2- 172.21.15.37:0/3642212002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7480d0c50 0x7ff7481627e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff748073830 tx=0x7ff74001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2755693815c8b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff746a00640 1 -- 172.21.15.37:0/3642212002 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7400b0070 con 0x7ff7480d0c50 2024-05-30T06:55:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff746a00640 1 -- 172.21.15.37:0/3642212002 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7400ab600 con 0x7ff7480d0c50 2024-05-30T06:55:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.169+0000 7ff746a00640 1 -- 172.21.15.37:0/3642212002 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7400ab9d0 con 0x7ff7480d0c50 2024-05-30T06:55:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 -- 172.21.15.37:0/3642212002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7480d0c50 msgr2=0x7ff7481627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 --2- 172.21.15.37:0/3642212002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7480d0c50 0x7ff7481627e0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff748073830 tx=0x7ff74001c230 comp rx=0 tx=0).stop 2024-05-30T06:55:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 -- 172.21.15.37:0/3642212002 shutdown_connections 2024-05-30T06:55:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 --2- 172.21.15.37:0/3642212002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7480d0c50 0x7ff7481627e0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 --2- 172.21.15.37:0/3642212002 >> v2:172.21.15.105:3300/0 conn(0x7ff7480d02b0 0x7ff7480d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 --2- 172.21.15.37:0/3642212002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74815ed50 0x7ff7480c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 -- 172.21.15.37:0/3642212002 >> 172.21.15.37:0/3642212002 conn(0x7ff7480d26e0 msgr2=0x7ff7480d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 -- 172.21.15.37:0/3642212002 shutdown_connections 2024-05-30T06:55:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 -- 172.21.15.37:0/3642212002 wait complete. 2024-05-30T06:55:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 Processor -- start 2024-05-30T06:55:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 -- start start 2024-05-30T06:55:32.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7480d02b0 0x7ff7480b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:32.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7480d0c50 0x7ff748151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74815ed50 0x7ff7481522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7480c7c50 con 0x7ff7480d0c50 2024-05-30T06:55:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff7480c7ad0 con 0x7ff74815ed50 2024-05-30T06:55:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff74e000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff74809aa60 con 0x7ff7480d02b0 2024-05-30T06:55:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff73ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7480d0c50 0x7ff748151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff73ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7480d0c50 0x7ff748151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51596/0 (socket says 172.21.15.37:51596) 2024-05-30T06:55:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff73ea00640 1 -- 172.21.15.37:0/2639223966 learned_addr learned my addr 172.21.15.37:0/2639223966 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff747400640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7480d02b0 0x7ff7480b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff747e00640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74815ed50 0x7ff7481522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff73ea00640 1 -- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7480d02b0 msgr2=0x7ff7480b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff73ea00640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7480d02b0 0x7ff7480b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff73ea00640 1 -- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74815ed50 msgr2=0x7ff7481522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff73ea00640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74815ed50 0x7ff7481522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.173+0000 7ff73ea00640 1 -- 172.21.15.37:0/2639223966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7481527e0 con 0x7ff7480d0c50 2024-05-30T06:55:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.177+0000 7ff73ea00640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7480d0c50 0x7ff748151d60 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff73000e8b0 tx=0x7ff73000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.177+0000 7ff73fe00640 1 -- 172.21.15.37:0/2639223966 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730017070 con 0x7ff7480d0c50 2024-05-30T06:55:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.177+0000 7ff73fe00640 1 -- 172.21.15.37:0/2639223966 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff73000c940 con 0x7ff7480d0c50 2024-05-30T06:55:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.177+0000 7ff73fe00640 1 -- 172.21.15.37:0/2639223966 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73000cd10 con 0x7ff7480d0c50 2024-05-30T06:55:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.177+0000 7ff74e000640 1 -- 172.21.15.37:0/2639223966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7480b5f50 con 0x7ff7480d0c50 2024-05-30T06:55:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.177+0000 7ff74e000640 1 -- 172.21.15.37:0/2639223966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7480b6510 con 0x7ff7480d0c50 2024-05-30T06:55:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.177+0000 7ff74e000640 1 -- 172.21.15.37:0/2639223966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff748068b20 con 0x7ff7480d0c50 2024-05-30T06:55:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.177+0000 7ff73fe00640 1 -- 172.21.15.37:0/2639223966 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7ff73001a070 con 0x7ff7480d0c50 2024-05-30T06:55:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.177+0000 7ff73fe00640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7240698e0 0x7ff72406bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.177+0000 7ff73fe00640 1 -- 172.21.15.37:0/2639223966 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 4885+0+0 (secure 0 0 0) 0x7ff730085620 con 0x7ff7480d0c50 2024-05-30T06:55:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.177+0000 7ff747400640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7240698e0 0x7ff72406bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.181+0000 7ff747400640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7240698e0 0x7ff72406bda0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff7481518f0 tx=0x7ff73800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:32.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.181+0000 7ff73fe00640 1 -- 172.21.15.37:0/2639223966 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff730056fe0 con 0x7ff7480d0c50 2024-05-30T06:55:32.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.349+0000 7ff74e000640 1 -- 172.21.15.37:0/2639223966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff7480d3420 con 0x7ff7480d0c50 2024-05-30T06:55:32.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.349+0000 7ff73fe00640 1 -- 172.21.15.37:0/2639223966 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v98) ==== 84+0+65 (secure 0 0 0) 0x7ff730085aa0 con 0x7ff7480d0c50 2024-05-30T06:55:32.353 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:32.353 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:55:32.353 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:32.353 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-30T06:55:32.353 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-30T06:55:32.353 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:32.353 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:55:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.353+0000 7ff74e000640 1 -- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7240698e0 msgr2=0x7ff72406bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.353+0000 7ff74e000640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7240698e0 0x7ff72406bda0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff7481518f0 tx=0x7ff73800b040 comp rx=0 tx=0).stop 2024-05-30T06:55:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.353+0000 7ff74e000640 1 -- 172.21.15.37:0/2639223966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7480d0c50 msgr2=0x7ff748151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.353+0000 7ff74e000640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7480d0c50 0x7ff748151d60 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff73000e8b0 tx=0x7ff73000ed70 comp rx=0 tx=0).stop 2024-05-30T06:55:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.353+0000 7ff74e000640 1 -- 172.21.15.37:0/2639223966 shutdown_connections 2024-05-30T06:55:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.353+0000 7ff74e000640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7240698e0 0x7ff72406bda0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.353+0000 7ff74e000640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74815ed50 0x7ff7481522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.353+0000 7ff74e000640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7480d0c50 0x7ff748151d60 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.353+0000 7ff74e000640 1 --2- 172.21.15.37:0/2639223966 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7480d02b0 0x7ff7480b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.353+0000 7ff74e000640 1 -- 172.21.15.37:0/2639223966 >> 172.21.15.37:0/2639223966 conn(0x7ff7480d26e0 msgr2=0x7ff7481541b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.353+0000 7ff74e000640 1 -- 172.21.15.37:0/2639223966 shutdown_connections 2024-05-30T06:55:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.353+0000 7ff74e000640 1 -- 172.21.15.37:0/2639223966 wait complete. 2024-05-30T06:55:32.374 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T06:55:32.375 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T06:55:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.517+0000 7f966b600640 1 Processor -- start 2024-05-30T06:55:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.517+0000 7f966b600640 1 -- start start 2024-05-30T06:55:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.517+0000 7f966b600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f966406df50 0x7f96640afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f966b600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96640b3f60 con 0x7f96640ae740 2024-05-30T06:55:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f966b600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96640b36c0 con 0x7f96641623f0 2024-05-30T06:55:32.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f966b600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9664163270 con 0x7f966406df50 2024-05-30T06:55:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f965be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f966406df50 0x7f96640afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f9669600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f96640ae740 0x7f96640aebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49268/0 (socket says 172.21.15.37:49268) 2024-05-30T06:55:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f9669600640 1 -- 172.21.15.37:0/1298566555 learned_addr learned my addr 172.21.15.37:0/1298566555 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f965be00640 1 -- 172.21.15.37:0/1298566555 >> v1:172.21.15.105:6789/0 conn(0x7f96641623f0 legacy=0x7f96641627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f965be00640 1 -- 172.21.15.37:0/1298566555 >> v1:172.21.15.37:6789/0 conn(0x7f96640ae740 legacy=0x7f96640aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f965be00640 1 -- 172.21.15.37:0/1298566555 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96640b39a0 con 0x7f966406df50 2024-05-30T06:55:32.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f9663e00640 1 -- 172.21.15.37:0/1298566555 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881783718 0 0) 0x7f965c0014a0 con 0x7f96640ae740 2024-05-30T06:55:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f965be00640 1 --2- 172.21.15.37:0/1298566555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f966406df50 0x7f96640afa50 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f964c0097c0 tx=0x7f964c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f99063c707f188 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f9663e00640 1 -- 172.21.15.37:0/1298566555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c0b0070 con 0x7f966406df50 2024-05-30T06:55:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f9663e00640 1 -- 172.21.15.37:0/1298566555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f964c0ab600 con 0x7f966406df50 2024-05-30T06:55:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.521+0000 7f9663e00640 1 -- 172.21.15.37:0/1298566555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c0ab9d0 con 0x7f966406df50 2024-05-30T06:55:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 -- 172.21.15.37:0/1298566555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f966406df50 msgr2=0x7f96640afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 --2- 172.21.15.37:0/1298566555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f966406df50 0x7f96640afa50 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f964c0097c0 tx=0x7f964c01c4a0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 -- 172.21.15.37:0/1298566555 shutdown_connections 2024-05-30T06:55:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 --2- 172.21.15.37:0/1298566555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f966406df50 0x7f96640afa50 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 -- 172.21.15.37:0/1298566555 >> 172.21.15.37:0/1298566555 conn(0x7f966406bf60 msgr2=0x7f96640b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 -- 172.21.15.37:0/1298566555 shutdown_connections 2024-05-30T06:55:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 -- 172.21.15.37:0/1298566555 wait complete. 2024-05-30T06:55:32.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 Processor -- start 2024-05-30T06:55:32.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 -- start start 2024-05-30T06:55:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f966406df50 0x7f9664146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96640ae740 0x7f966415a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641623f0 0x7f966415fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96640b0110 con 0x7f96641623f0 2024-05-30T06:55:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f96640aff90 con 0x7f966406df50 2024-05-30T06:55:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f966b600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9664147750 con 0x7f96640ae740 2024-05-30T06:55:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f9669600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641623f0 0x7f966415fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f9669600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641623f0 0x7f966415fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51610/0 (socket says 172.21.15.37:51610) 2024-05-30T06:55:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f9669600640 1 -- 172.21.15.37:0/3589000720 learned_addr learned my addr 172.21.15.37:0/3589000720 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f9668c00640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f966406df50 0x7f9664146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f965be00640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96640ae740 0x7f966415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f9669600640 1 -- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96640ae740 msgr2=0x7f966415a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f9669600640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96640ae740 0x7f966415a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f9669600640 1 -- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f966406df50 msgr2=0x7f9664146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.525+0000 7f9669600640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f966406df50 0x7f9664146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.529+0000 7f9669600640 1 -- 172.21.15.37:0/3589000720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96641455c0 con 0x7f96641623f0 2024-05-30T06:55:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.529+0000 7f9668c00640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f966406df50 0x7f9664146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.529+0000 7f9669600640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641623f0 0x7f966415fc70 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f965c00c820 tx=0x7f965c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.529+0000 7f9661600640 1 -- 172.21.15.37:0/3589000720 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c018070 con 0x7f96641623f0 2024-05-30T06:55:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.529+0000 7f9661600640 1 -- 172.21.15.37:0/3589000720 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f965c00a640 con 0x7f96641623f0 2024-05-30T06:55:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.529+0000 7f9661600640 1 -- 172.21.15.37:0/3589000720 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c00aa30 con 0x7f96641623f0 2024-05-30T06:55:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.529+0000 7f966b600640 1 -- 172.21.15.37:0/3589000720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9664145860 con 0x7f96641623f0 2024-05-30T06:55:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.529+0000 7f966b600640 1 -- 172.21.15.37:0/3589000720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9664145e20 con 0x7f96641623f0 2024-05-30T06:55:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.529+0000 7f966b600640 1 -- 172.21.15.37:0/3589000720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9664068d40 con 0x7f96641623f0 2024-05-30T06:55:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.529+0000 7f9661600640 1 -- 172.21.15.37:0/3589000720 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f965c01b070 con 0x7f96641623f0 2024-05-30T06:55:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.529+0000 7f9661600640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f96400698e0 0x7f964006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.529+0000 7f9661600640 1 -- 172.21.15.37:0/3589000720 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 4885+0+0 (secure 0 0 0) 0x7f965c0850b0 con 0x7f96641623f0 2024-05-30T06:55:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.529+0000 7f9668c00640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f96400698e0 0x7f964006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.533+0000 7f9668c00640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f96400698e0 0x7f964006bda0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f966413df30 tx=0x7f9654009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.533+0000 7f9661600640 1 -- 172.21.15.37:0/3589000720 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f96640b3f60 con 0x7f96641623f0 2024-05-30T06:55:32.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.697+0000 7f966b600640 1 -- 172.21.15.37:0/3589000720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f96640b30b0 con 0x7f96641623f0 2024-05-30T06:55:32.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.905+0000 7f9661600640 1 -- 172.21.15.37:0/3589000720 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v99) ==== 138+0+0 (secure 0 0 0) 0x7f965c056cc0 con 0x7f96641623f0 2024-05-30T06:55:32.908 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-30T06:55:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.909+0000 7f966b600640 1 -- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f96400698e0 msgr2=0x7f964006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.909+0000 7f966b600640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f96400698e0 0x7f964006bda0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f966413df30 tx=0x7f9654009040 comp rx=0 tx=0).stop 2024-05-30T06:55:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.909+0000 7f966b600640 1 -- 172.21.15.37:0/3589000720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641623f0 msgr2=0x7f966415fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.909+0000 7f966b600640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641623f0 0x7f966415fc70 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f965c00c820 tx=0x7f965c00cce0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.909+0000 7f966b600640 1 -- 172.21.15.37:0/3589000720 shutdown_connections 2024-05-30T06:55:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.909+0000 7f966b600640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96641623f0 0x7f966415fc70 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.909+0000 7f966b600640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f96640ae740 0x7f966415a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.909+0000 7f966b600640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f96400698e0 0x7f964006bda0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.909+0000 7f966b600640 1 --2- 172.21.15.37:0/3589000720 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f966406df50 0x7f9664146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.909+0000 7f966b600640 1 -- 172.21.15.37:0/3589000720 >> 172.21.15.37:0/3589000720 conn(0x7f966406bf60 msgr2=0x7f96640b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.909+0000 7f966b600640 1 -- 172.21.15.37:0/3589000720 shutdown_connections 2024-05-30T06:55:32.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:32.909+0000 7f966b600640 1 -- 172.21.15.37:0/3589000720 wait complete. 2024-05-30T06:55:32.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T06:55:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.081+0000 7f0470600640 1 Processor -- start 2024-05-30T06:55:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.081+0000 7f0470600640 1 -- start start 2024-05-30T06:55:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.081+0000 7f0470600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f04680cd440 0x7f046806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.081+0000 7f0470600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f046806f5a0 0x7f04680b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.081+0000 7f0470600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f046815f310 con 0x7f0468155da0 2024-05-30T06:55:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.081+0000 7f0470600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f046806fa10 con 0x7f046806f5a0 2024-05-30T06:55:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.081+0000 7f0470600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f046815f5f0 con 0x7f04680cd440 2024-05-30T06:55:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.085+0000 7f046e600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f046806f5a0 0x7f04680b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.085+0000 7f046e600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f046806f5a0 0x7f04680b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51618/0 (socket says 172.21.15.37:51618) 2024-05-30T06:55:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.085+0000 7f046e600640 1 -- 172.21.15.37:0/1477379087 learned_addr learned my addr 172.21.15.37:0/1477379087 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.085+0000 7f046d200640 1 --2- 172.21.15.37:0/1477379087 >> v2:172.21.15.105:3300/0 conn(0x7f04680cd440 0x7f046806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.085+0000 7f046e600640 1 -- 172.21.15.37:0/1477379087 >> v2:172.21.15.105:3300/0 conn(0x7f04680cd440 msgr2=0x7f046806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.085+0000 7f046e600640 1 --2- 172.21.15.37:0/1477379087 >> v2:172.21.15.105:3300/0 conn(0x7f04680cd440 0x7f046806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.085+0000 7f046e600640 1 -- 172.21.15.37:0/1477379087 >> v1:172.21.15.105:6789/0 conn(0x7f0468155da0 legacy=0x7f04680cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.085+0000 7f046e600640 1 -- 172.21.15.37:0/1477379087 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046815f8d0 con 0x7f046806f5a0 2024-05-30T06:55:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.085+0000 7f046d200640 1 --2- 172.21.15.37:0/1477379087 >> v2:172.21.15.105:3300/0 conn(0x7f04680cd440 0x7f046806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.085+0000 7f046e600640 1 --2- 172.21.15.37:0/1477379087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046806f5a0 0x7f04680b3750 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f04680b2f00 tx=0x7f046001ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd22e16e85748b3b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.085+0000 7f0467e00640 1 -- 172.21.15.37:0/1477379087 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046000b2d0 con 0x7f046806f5a0 2024-05-30T06:55:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.085+0000 7f0467e00640 1 -- 172.21.15.37:0/1477379087 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f046000b470 con 0x7f046806f5a0 2024-05-30T06:55:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.085+0000 7f0467e00640 1 -- 172.21.15.37:0/1477379087 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04600a7980 con 0x7f046806f5a0 2024-05-30T06:55:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 -- 172.21.15.37:0/1477379087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046806f5a0 msgr2=0x7f04680b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 --2- 172.21.15.37:0/1477379087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046806f5a0 0x7f04680b3750 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f04680b2f00 tx=0x7f046001ea90 comp rx=0 tx=0).stop 2024-05-30T06:55:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 -- 172.21.15.37:0/1477379087 shutdown_connections 2024-05-30T06:55:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 --2- 172.21.15.37:0/1477379087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046806f5a0 0x7f04680b3750 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 --2- 172.21.15.37:0/1477379087 >> v2:172.21.15.105:3300/0 conn(0x7f04680cd440 0x7f046806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 -- 172.21.15.37:0/1477379087 >> 172.21.15.37:0/1477379087 conn(0x7f046806bf60 msgr2=0x7f04680b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 -- 172.21.15.37:0/1477379087 shutdown_connections 2024-05-30T06:55:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 -- 172.21.15.37:0/1477379087 wait complete. 2024-05-30T06:55:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 Processor -- start 2024-05-30T06:55:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 -- start start 2024-05-30T06:55:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046806f5a0 0x7f04681fa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0468155da0 0x7f04681faa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0468157370 0x7f04681577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f046806df50 con 0x7f046806f5a0 2024-05-30T06:55:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f04680b46b0 con 0x7f0468155da0 2024-05-30T06:55:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f0470600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f046806e0d0 con 0x7f0468157370 2024-05-30T06:55:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f046dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046806f5a0 0x7f04681fa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f046dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046806f5a0 0x7f04681fa500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51620/0 (socket says 172.21.15.37:51620) 2024-05-30T06:55:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f046dc00640 1 -- 172.21.15.37:0/984330301 learned_addr learned my addr 172.21.15.37:0/984330301 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f046e600640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0468157370 0x7f04681577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f046d200640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0468155da0 0x7f04681faa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f046dc00640 1 -- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0468157370 msgr2=0x7f04681577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f046dc00640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0468157370 0x7f04681577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f046dc00640 1 -- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0468155da0 msgr2=0x7f04681faa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f046dc00640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0468155da0 0x7f04681faa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f046dc00640 1 -- 172.21.15.37:0/984330301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04681580e0 con 0x7f046806f5a0 2024-05-30T06:55:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.089+0000 7f046e600640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0468157370 0x7f04681577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.093+0000 7f046dc00640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046806f5a0 0x7f04681fa500 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f045c00b410 tx=0x7f045c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.093+0000 7f0465600640 1 -- 172.21.15.37:0/984330301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c015030 con 0x7f046806f5a0 2024-05-30T06:55:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.093+0000 7f0465600640 1 -- 172.21.15.37:0/984330301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f045c004020 con 0x7f046806f5a0 2024-05-30T06:55:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.093+0000 7f0465600640 1 -- 172.21.15.37:0/984330301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c004450 con 0x7f046806f5a0 2024-05-30T06:55:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.093+0000 7f0470600640 1 -- 172.21.15.37:0/984330301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04681583c0 con 0x7f046806f5a0 2024-05-30T06:55:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.093+0000 7f0470600640 1 -- 172.21.15.37:0/984330301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0468158980 con 0x7f046806f5a0 2024-05-30T06:55:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.093+0000 7f0470600640 1 -- 172.21.15.37:0/984330301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0468068bc0 con 0x7f046806f5a0 2024-05-30T06:55:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.093+0000 7f0465600640 1 -- 172.21.15.37:0/984330301 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f045c018070 con 0x7f046806f5a0 2024-05-30T06:55:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.093+0000 7f0465600640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0448069910 0x7f044806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.093+0000 7f0465600640 1 -- 172.21.15.37:0/984330301 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5255+0+0 (secure 0 0 0) 0x7f045c085f00 con 0x7f046806f5a0 2024-05-30T06:55:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.093+0000 7f046d200640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0448069910 0x7f044806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:33.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.097+0000 7f046d200640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0448069910 0x7f044806bdd0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0454006fd0 tx=0x7f0454008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:33.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.097+0000 7f0465600640 1 -- 172.21.15.37:0/984330301 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f045c057b10 con 0x7f046806f5a0 2024-05-30T06:55:33.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.261+0000 7f0470600640 1 -- 172.21.15.37:0/984330301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f04680b6790 con 0x7f046806f5a0 2024-05-30T06:55:33.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.913+0000 7f0465600640 1 -- 172.21.15.37:0/984330301 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v100) ==== 170+0+0 (secure 0 0 0) 0x7f045c057410 con 0x7f046806f5a0 2024-05-30T06:55:33.915 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-30T06:55:33.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.917+0000 7f0470600640 1 -- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0448069910 msgr2=0x7f044806bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:33.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.917+0000 7f0470600640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0448069910 0x7f044806bdd0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0454006fd0 tx=0x7f0454008040 comp rx=0 tx=0).stop 2024-05-30T06:55:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.917+0000 7f0470600640 1 -- 172.21.15.37:0/984330301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046806f5a0 msgr2=0x7f04681fa500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.917+0000 7f0470600640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046806f5a0 0x7f04681fa500 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f045c00b410 tx=0x7f045c00b8d0 comp rx=0 tx=0).stop 2024-05-30T06:55:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.917+0000 7f0470600640 1 -- 172.21.15.37:0/984330301 shutdown_connections 2024-05-30T06:55:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.917+0000 7f0470600640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0468157370 0x7f04681577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.917+0000 7f0470600640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0448069910 0x7f044806bdd0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.917+0000 7f0470600640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0468155da0 0x7f04681faa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.917+0000 7f0470600640 1 --2- 172.21.15.37:0/984330301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f046806f5a0 0x7f04681fa500 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.917+0000 7f0470600640 1 -- 172.21.15.37:0/984330301 >> 172.21.15.37:0/984330301 conn(0x7f046806bf60 msgr2=0x7f0468165a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.917+0000 7f0470600640 1 -- 172.21.15.37:0/984330301 shutdown_connections 2024-05-30T06:55:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:33.917+0000 7f0470600640 1 -- 172.21.15.37:0/984330301 wait complete. 2024-05-30T06:55:33.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T06:55:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73f5800640 1 Processor -- start 2024-05-30T06:55:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73f5800640 1 -- start start 2024-05-30T06:55:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73f5800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f73f015d7e0 0x7f73f006e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73f5800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73f0142030 con 0x7f73f015d350 2024-05-30T06:55:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73f5800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73f0142310 con 0x7f73f00b59d0 2024-05-30T06:55:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73f5800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f73f01425f0 con 0x7f73f015d7e0 2024-05-30T06:55:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73e7e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f73f015d350 0x7f73f006df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49274/0 (socket says 172.21.15.37:49274) 2024-05-30T06:55:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73e7e00640 1 -- 172.21.15.37:0/184466252 learned_addr learned my addr 172.21.15.37:0/184466252 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73ef400640 1 --2- 172.21.15.37:0/184466252 >> v2:172.21.15.105:3300/0 conn(0x7f73f015d7e0 0x7f73f006e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 25433783 0 0) 0x7f73f0142030 con 0x7f73f015d350 2024-05-30T06:55:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73d4003530 con 0x7f73f015d350 2024-05-30T06:55:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2816980293 0 0) 0x7f73d4003530 con 0x7f73f015d350 2024-05-30T06:55:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 >> v2:172.21.15.105:3300/0 conn(0x7f73f015d7e0 msgr2=0x7f73f006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73ee000640 1 --2- 172.21.15.37:0/184466252 >> v2:172.21.15.105:3300/0 conn(0x7f73f015d7e0 0x7f73f006e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 >> v1:172.21.15.105:6789/0 conn(0x7f73f00b59d0 legacy=0x7f73f00b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f01428d0 con 0x7f73f015d350 2024-05-30T06:55:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f73d8001680 con 0x7f73f015d350 2024-05-30T06:55:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 >> v1:172.21.15.37:6789/0 conn(0x7f73f015d350 legacy=0x7f73f006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73ee000640 1 --2- 172.21.15.37:0/184466252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73d40039c0 0x7f73d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73ee000640 1 --2- 172.21.15.37:0/184466252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d4004810 0x7f73d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.101+0000 7f73ee000640 1 --2- 172.21.15.37:0/184466252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73d40051d0 0x7f73d400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f73f01425f0 con 0x7f73d4004810 2024-05-30T06:55:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73d400c070 con 0x7f73d40051d0 2024-05-30T06:55:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f73d400c270 con 0x7f73d40039c0 2024-05-30T06:55:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73ef400640 1 --2- 172.21.15.37:0/184466252 >> v2:172.21.15.105:3300/0 conn(0x7f73f015d7e0 0x7f73f006e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:55:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73e7e00640 1 --2- 172.21.15.37:0/184466252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d4004810 0x7f73d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73eea00640 1 --2- 172.21.15.37:0/184466252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73d40039c0 0x7f73d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73ef400640 1 --2- 172.21.15.37:0/184466252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73d40051d0 0x7f73d400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73e7e00640 1 -- 172.21.15.37:0/184466252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73d40039c0 msgr2=0x7f73d4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73e7e00640 1 --2- 172.21.15.37:0/184466252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73d40039c0 0x7f73d4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73e7e00640 1 -- 172.21.15.37:0/184466252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73d40051d0 msgr2=0x7f73d400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73e7e00640 1 --2- 172.21.15.37:0/184466252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73d40051d0 0x7f73d400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73e7e00640 1 -- 172.21.15.37:0/184466252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d4003530 con 0x7f73d4004810 2024-05-30T06:55:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73ef400640 1 --2- 172.21.15.37:0/184466252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73d40051d0 0x7f73d400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73ef400640 1 -- 172.21.15.37:0/184466252 reap_dead start 2024-05-30T06:55:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73e7e00640 1 --2- 172.21.15.37:0/184466252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d4004810 0x7f73d4004c90 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f73d800c210 tx=0x7f73d801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390e49bdcdde48bf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d8007d40 con 0x7f73d4004810 2024-05-30T06:55:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73d8005b00 con 0x7f73d4004810 2024-05-30T06:55:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.105+0000 7f73ee000640 1 -- 172.21.15.37:0/184466252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d8007070 con 0x7f73d4004810 2024-05-30T06:55:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 -- 172.21.15.37:0/184466252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d4004810 msgr2=0x7f73d4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 --2- 172.21.15.37:0/184466252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d4004810 0x7f73d4004c90 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f73d800c210 tx=0x7f73d801f3b0 comp rx=0 tx=0).stop 2024-05-30T06:55:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 -- 172.21.15.37:0/184466252 shutdown_connections 2024-05-30T06:55:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 --2- 172.21.15.37:0/184466252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73d4004810 0x7f73d4004c90 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 -- 172.21.15.37:0/184466252 >> 172.21.15.37:0/184466252 conn(0x7f73f006bf60 msgr2=0x7f73f00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 -- 172.21.15.37:0/184466252 shutdown_connections 2024-05-30T06:55:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 -- 172.21.15.37:0/184466252 wait complete. 2024-05-30T06:55:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 Processor -- start 2024-05-30T06:55:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 -- start start 2024-05-30T06:55:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73d4004810 0x7f73f013dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73f01533d0 0x7f73f0154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73f0153830 0x7f73f0154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f73f00b00a0 con 0x7f73f01533d0 2024-05-30T06:55:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73f00aff20 con 0x7f73f0153830 2024-05-30T06:55:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73f5800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f73f013f860 con 0x7f73d4004810 2024-05-30T06:55:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73e7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73f01533d0 0x7f73f0154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73e7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73f01533d0 0x7f73f0154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51640/0 (socket says 172.21.15.37:51640) 2024-05-30T06:55:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73e7e00640 1 -- 172.21.15.37:0/2461326932 learned_addr learned my addr 172.21.15.37:0/2461326932 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73ef400640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73f0153830 0x7f73f0154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.109+0000 7f73eea00640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73d4004810 0x7f73f013dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.113+0000 7f73e7e00640 1 -- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73d4004810 msgr2=0x7f73f013dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.113+0000 7f73e7e00640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73d4004810 0x7f73f013dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.113+0000 7f73e7e00640 1 -- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73f0153830 msgr2=0x7f73f0154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.113+0000 7f73e7e00640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73f0153830 0x7f73f0154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.113+0000 7f73e7e00640 1 -- 172.21.15.37:0/2461326932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f01f50c0 con 0x7f73f01533d0 2024-05-30T06:55:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.113+0000 7f73e7e00640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73f01533d0 0x7f73f0154750 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f73d8001980 tx=0x7f73d4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.113+0000 7f73e6a00640 1 -- 172.21.15.37:0/2461326932 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d80049f0 con 0x7f73f01533d0 2024-05-30T06:55:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.113+0000 7f73e6a00640 1 -- 172.21.15.37:0/2461326932 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73d80b6070 con 0x7f73f01533d0 2024-05-30T06:55:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.113+0000 7f73f5800640 1 -- 172.21.15.37:0/2461326932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f01f53a0 con 0x7f73f01533d0 2024-05-30T06:55:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.113+0000 7f73e6a00640 1 -- 172.21.15.37:0/2461326932 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d8004dd0 con 0x7f73f01533d0 2024-05-30T06:55:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.113+0000 7f73f5800640 1 -- 172.21.15.37:0/2461326932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f01f5960 con 0x7f73f01533d0 2024-05-30T06:55:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.113+0000 7f73f5800640 1 -- 172.21.15.37:0/2461326932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73f0068bc0 con 0x7f73f01533d0 2024-05-30T06:55:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.113+0000 7f73e6a00640 1 -- 172.21.15.37:0/2461326932 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f73d8007070 con 0x7f73f01533d0 2024-05-30T06:55:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.117+0000 7f73e6a00640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f73cc069910 0x7f73cc06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.117+0000 7f73e6a00640 1 -- 172.21.15.37:0/2461326932 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5637+0+0 (secure 0 0 0) 0x7f73d8123110 con 0x7f73f01533d0 2024-05-30T06:55:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.117+0000 7f73eea00640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f73cc069910 0x7f73cc06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.117+0000 7f73eea00640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f73cc069910 0x7f73cc06bdd0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f73e0000c10 tx=0x7f73e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.121+0000 7f73e6a00640 1 -- 172.21.15.37:0/2461326932 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f73d80190c0 con 0x7f73f01533d0 2024-05-30T06:55:34.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.321+0000 7f73f5800640 1 -- 172.21.15.37:0/2461326932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f73f006f0a0 con 0x7f73f01533d0 2024-05-30T06:55:34.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.913+0000 7f73e6a00640 1 -- 172.21.15.37:0/2461326932 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v61) ==== 174+0+0 (secure 0 0 0) 0x7f73d80f4b30 con 0x7f73f01533d0 2024-05-30T06:55:34.917 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 14 and data pool 15 2024-05-30T06:55:34.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.917+0000 7f73f5800640 1 -- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f73cc069910 msgr2=0x7f73cc06bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:34.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.917+0000 7f73f5800640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f73cc069910 0x7f73cc06bdd0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f73e0000c10 tx=0x7f73e0009040 comp rx=0 tx=0).stop 2024-05-30T06:55:34.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.917+0000 7f73f5800640 1 -- 172.21.15.37:0/2461326932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73f01533d0 msgr2=0x7f73f0154750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:34.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.917+0000 7f73f5800640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73f01533d0 0x7f73f0154750 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f73d8001980 tx=0x7f73d4005840 comp rx=0 tx=0).stop 2024-05-30T06:55:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.921+0000 7f73f5800640 1 -- 172.21.15.37:0/2461326932 shutdown_connections 2024-05-30T06:55:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.921+0000 7f73f5800640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f73cc069910 0x7f73cc06bdd0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.921+0000 7f73f5800640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73f0153830 0x7f73f0154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.921+0000 7f73f5800640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73f01533d0 0x7f73f0154750 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.921+0000 7f73f5800640 1 --2- 172.21.15.37:0/2461326932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73d4004810 0x7f73f013dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:34.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.921+0000 7f73f5800640 1 -- 172.21.15.37:0/2461326932 >> 172.21.15.37:0/2461326932 conn(0x7f73f006bf60 msgr2=0x7f73f013fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:34.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.925+0000 7f73f5800640 1 -- 172.21.15.37:0/2461326932 shutdown_connections 2024-05-30T06:55:34.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:34.925+0000 7f73f5800640 1 -- 172.21.15.37:0/2461326932 wait complete. 2024-05-30T06:55:34.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:55:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.109+0000 7f3e29c00640 1 Processor -- start 2024-05-30T06:55:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.109+0000 7f3e29c00640 1 -- start start 2024-05-30T06:55:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.109+0000 7f3e29c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cffe0 0x7f3e240b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.109+0000 7f3e29c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e240d06c0 0x7f3e2406f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.109+0000 7f3e29c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e240b5e80 con 0x7f3e2415b050 2024-05-30T06:55:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e29c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3e240b5730 con 0x7f3e240d06c0 2024-05-30T06:55:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e29c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3e240cd880 con 0x7f3e240cffe0 2024-05-30T06:55:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e23400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e240d06c0 0x7f3e2406f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e22a00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3e2415b050 0x7f3e240af900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:42998/0 (socket says 172.21.15.37:42998) 2024-05-30T06:55:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e23400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e240d06c0 0x7f3e2406f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51650/0 (socket says 172.21.15.37:51650) 2024-05-30T06:55:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e22a00640 1 -- 172.21.15.37:0/3360867039 learned_addr learned my addr 172.21.15.37:0/3360867039 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e1a000640 1 --2- 172.21.15.37:0/3360867039 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cffe0 0x7f3e240b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e23400640 1 -- 172.21.15.37:0/3360867039 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cffe0 msgr2=0x7f3e240b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e23400640 1 --2- 172.21.15.37:0/3360867039 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cffe0 0x7f3e240b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e23400640 1 -- 172.21.15.37:0/3360867039 >> v1:172.21.15.105:6789/0 conn(0x7f3e2415b050 legacy=0x7f3e240af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e23400640 1 -- 172.21.15.37:0/3360867039 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e240b0550 con 0x7f3e240d06c0 2024-05-30T06:55:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e22000640 1 -- 172.21.15.37:0/3360867039 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1144924584 0 0) 0x7f3e240b5e80 con 0x7f3e2415b050 2024-05-30T06:55:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e23400640 1 --2- 172.21.15.37:0/3360867039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e240d06c0 0x7f3e2406f2a0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0097f0 tx=0x7f3e1c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e6a1e40384cdd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e22000640 1 -- 172.21.15.37:0/3360867039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0b0070 con 0x7f3e240d06c0 2024-05-30T06:55:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e22000640 1 -- 172.21.15.37:0/3360867039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c0ab600 con 0x7f3e240d06c0 2024-05-30T06:55:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.113+0000 7f3e22000640 1 -- 172.21.15.37:0/3360867039 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0ab9d0 con 0x7f3e240d06c0 2024-05-30T06:55:35.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 -- 172.21.15.37:0/3360867039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e240d06c0 msgr2=0x7f3e2406f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 --2- 172.21.15.37:0/3360867039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e240d06c0 0x7f3e2406f2a0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0097f0 tx=0x7f3e1c01c4a0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 -- 172.21.15.37:0/3360867039 shutdown_connections 2024-05-30T06:55:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 --2- 172.21.15.37:0/3360867039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e240d06c0 0x7f3e2406f2a0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 --2- 172.21.15.37:0/3360867039 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cffe0 0x7f3e240b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 -- 172.21.15.37:0/3360867039 >> 172.21.15.37:0/3360867039 conn(0x7f3e24073680 msgr2=0x7f3e2406b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 -- 172.21.15.37:0/3360867039 shutdown_connections 2024-05-30T06:55:35.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 -- 172.21.15.37:0/3360867039 wait complete. 2024-05-30T06:55:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 Processor -- start 2024-05-30T06:55:35.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 -- start start 2024-05-30T06:55:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cffe0 0x7f3e2415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e240d06c0 0x7f3e24152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2415b050 0x7f3e241fab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2406fbb0 con 0x7f3e2415b050 2024-05-30T06:55:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2406fa30 con 0x7f3e240d06c0 2024-05-30T06:55:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e29c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3e2406fd30 con 0x7f3e240cffe0 2024-05-30T06:55:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e23400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2415b050 0x7f3e241fab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e23400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2415b050 0x7f3e241fab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51664/0 (socket says 172.21.15.37:51664) 2024-05-30T06:55:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e23400640 1 -- 172.21.15.37:0/1698656213 learned_addr learned my addr 172.21.15.37:0/1698656213 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e22a00640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cffe0 0x7f3e2415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e1a000640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e240d06c0 0x7f3e24152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e23400640 1 -- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cffe0 msgr2=0x7f3e2415bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e23400640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cffe0 0x7f3e2415bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e23400640 1 -- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e240d06c0 msgr2=0x7f3e24152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e23400640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e240d06c0 0x7f3e24152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.117+0000 7f3e23400640 1 -- 172.21.15.37:0/1698656213 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2415a1a0 con 0x7f3e2415b050 2024-05-30T06:55:35.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.121+0000 7f3e23400640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2415b050 0x7f3e241fab10 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0ae040 tx=0x7f3e1c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.121+0000 7f3e1b400640 1 -- 172.21.15.37:0/1698656213 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0b0040 con 0x7f3e2415b050 2024-05-30T06:55:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.121+0000 7f3e1b400640 1 -- 172.21.15.37:0/1698656213 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c004030 con 0x7f3e2415b050 2024-05-30T06:55:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.121+0000 7f3e1b400640 1 -- 172.21.15.37:0/1698656213 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c006e20 con 0x7f3e2415b050 2024-05-30T06:55:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.121+0000 7f3e29c00640 1 -- 172.21.15.37:0/1698656213 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e241f7540 con 0x7f3e2415b050 2024-05-30T06:55:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.121+0000 7f3e29c00640 1 -- 172.21.15.37:0/1698656213 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2415a410 con 0x7f3e2415b050 2024-05-30T06:55:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.121+0000 7f3e29c00640 1 -- 172.21.15.37:0/1698656213 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e24068b20 con 0x7f3e2415b050 2024-05-30T06:55:35.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.121+0000 7f3e1b400640 1 -- 172.21.15.37:0/1698656213 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f3e1c003620 con 0x7f3e2415b050 2024-05-30T06:55:35.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.121+0000 7f3e1b400640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e000698e0 0x7f3e0006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.121+0000 7f3e1b400640 1 -- 172.21.15.37:0/1698656213 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5737+0+0 (secure 0 0 0) 0x7f3e1c11fb60 con 0x7f3e2415b050 2024-05-30T06:55:35.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.121+0000 7f3e22a00640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e000698e0 0x7f3e0006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.125+0000 7f3e22a00640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e000698e0 0x7f3e0006bda0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3e14000f70 tx=0x7f3e14007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:35.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.125+0000 7f3e1b400640 1 -- 172.21.15.37:0/1698656213 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3e241f7540 con 0x7f3e2415b050 2024-05-30T06:55:35.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.293+0000 7f3e29c00640 1 -- 172.21.15.37:0/1698656213 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e240703a0 con 0x7f3e2415b050 2024-05-30T06:55:35.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.293+0000 7f3e1b400640 1 -- 172.21.15.37:0/1698656213 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16663 (secure 0 0 0) 0x7f3e1c016090 con 0x7f3e2415b050 2024-05-30T06:55:35.295 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:35.296 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":101,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:55:34.327051+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:55:32.713799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-05-30T06:55:33.276484+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:55:35.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.297+0000 7f3e29c00640 1 -- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e000698e0 msgr2=0x7f3e0006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.297+0000 7f3e29c00640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e000698e0 0x7f3e0006bda0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3e14000f70 tx=0x7f3e14007df0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.297+0000 7f3e29c00640 1 -- 172.21.15.37:0/1698656213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2415b050 msgr2=0x7f3e241fab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.297+0000 7f3e29c00640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2415b050 0x7f3e241fab10 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0ae040 tx=0x7f3e1c01ace0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.297+0000 7f3e29c00640 1 -- 172.21.15.37:0/1698656213 shutdown_connections 2024-05-30T06:55:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.297+0000 7f3e29c00640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e2415b050 0x7f3e241fab10 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.297+0000 7f3e29c00640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e000698e0 0x7f3e0006bda0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.297+0000 7f3e29c00640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e240d06c0 0x7f3e24152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.297+0000 7f3e29c00640 1 --2- 172.21.15.37:0/1698656213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e240cffe0 0x7f3e2415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.297+0000 7f3e29c00640 1 -- 172.21.15.37:0/1698656213 >> 172.21.15.37:0/1698656213 conn(0x7f3e24073680 msgr2=0x7f3e240ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.297+0000 7f3e29c00640 1 -- 172.21.15.37:0/1698656213 shutdown_connections 2024-05-30T06:55:35.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.297+0000 7f3e29c00640 1 -- 172.21.15.37:0/1698656213 wait complete. 2024-05-30T06:55:35.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:55:35.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7dbda00640 1 Processor -- start 2024-05-30T06:55:35.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7dbda00640 1 -- start start 2024-05-30T06:55:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7dbda00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7db8070260 0x7f7db80cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7dbda00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7db806b960 0x7f7db806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7dbda00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db8070a90 con 0x7f7db80cd4d0 2024-05-30T06:55:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7dbda00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7db80706a0 con 0x7f7db806b960 2024-05-30T06:55:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7dbda00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7db8070840 con 0x7f7db8070260 2024-05-30T06:55:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7db6a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7db80cd4d0 0x7f7db80ce860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49276/0 (socket says 172.21.15.37:49276) 2024-05-30T06:55:35.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7db6a00640 1 -- 172.21.15.37:0/1544761414 learned_addr learned my addr 172.21.15.37:0/1544761414 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7db7400640 1 --2- 172.21.15.37:0/1544761414 >> v2:172.21.15.37:3300/0 conn(0x7f7db806b960 0x7f7db806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7dae000640 1 --2- 172.21.15.37:0/1544761414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7db8070260 0x7f7db80cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7db6000640 1 -- 172.21.15.37:0/1544761414 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4005200912 0 0) 0x7f7db8070a90 con 0x7f7db80cd4d0 2024-05-30T06:55:35.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7db6000640 1 -- 172.21.15.37:0/1544761414 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d9c003530 con 0x7f7db80cd4d0 2024-05-30T06:55:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7db7400640 1 -- 172.21.15.37:0/1544761414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7db8070260 msgr2=0x7f7db80cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7db7400640 1 --2- 172.21.15.37:0/1544761414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7db8070260 0x7f7db80cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7db7400640 1 -- 172.21.15.37:0/1544761414 >> v1:172.21.15.37:6789/0 conn(0x7f7db80cd4d0 legacy=0x7f7db80ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.457+0000 7f7db7400640 1 -- 172.21.15.37:0/1544761414 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db8070d70 con 0x7f7db806b960 2024-05-30T06:55:35.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.461+0000 7f7db7400640 1 --2- 172.21.15.37:0/1544761414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db806b960 0x7f7db806bdf0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f7db0009d90 tx=0x7f7db001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a104676bcc3499ed server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:35.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.461+0000 7f7db6000640 1 -- 172.21.15.37:0/1544761414 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db00b2070 con 0x7f7db806b960 2024-05-30T06:55:35.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.461+0000 7f7db6000640 1 -- 172.21.15.37:0/1544761414 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db00a5710 con 0x7f7db806b960 2024-05-30T06:55:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.461+0000 7f7db6000640 1 -- 172.21.15.37:0/1544761414 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db00a5ac0 con 0x7f7db806b960 2024-05-30T06:55:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.461+0000 7f7dbda00640 1 -- 172.21.15.37:0/1544761414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db806b960 msgr2=0x7f7db806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.461+0000 7f7dbda00640 1 --2- 172.21.15.37:0/1544761414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db806b960 0x7f7db806bdf0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f7db0009d90 tx=0x7f7db001c850 comp rx=0 tx=0).stop 2024-05-30T06:55:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.461+0000 7f7dbda00640 1 -- 172.21.15.37:0/1544761414 shutdown_connections 2024-05-30T06:55:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.461+0000 7f7dbda00640 1 --2- 172.21.15.37:0/1544761414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db806b960 0x7f7db806bdf0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.461+0000 7f7dbda00640 1 --2- 172.21.15.37:0/1544761414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7db8070260 0x7f7db80cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.461+0000 7f7dbda00640 1 -- 172.21.15.37:0/1544761414 >> 172.21.15.37:0/1544761414 conn(0x7f7db809aa60 msgr2=0x7f7db80b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.461+0000 7f7dbda00640 1 -- 172.21.15.37:0/1544761414 shutdown_connections 2024-05-30T06:55:35.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.461+0000 7f7dbda00640 1 -- 172.21.15.37:0/1544761414 wait complete. 2024-05-30T06:55:35.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dbda00640 1 Processor -- start 2024-05-30T06:55:35.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dbda00640 1 -- start start 2024-05-30T06:55:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dbda00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7db806b960 0x7f7db815e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dbda00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db8070260 0x7f7db8156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dbda00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7db80cd4d0 0x7f7db80b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dbda00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7db8163310 con 0x7f7db8070260 2024-05-30T06:55:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dbda00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7db8163190 con 0x7f7db806b960 2024-05-30T06:55:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dbda00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7db8071050 con 0x7f7db80cd4d0 2024-05-30T06:55:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dae000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db8070260 0x7f7db8156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dae000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db8070260 0x7f7db8156f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51690/0 (socket says 172.21.15.37:51690) 2024-05-30T06:55:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dae000640 1 -- 172.21.15.37:0/1349192194 learned_addr learned my addr 172.21.15.37:0/1349192194 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dae000640 1 -- 172.21.15.37:0/1349192194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7db80cd4d0 msgr2=0x7f7db80b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dae000640 1 --2- 172.21.15.37:0/1349192194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7db80cd4d0 0x7f7db80b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dae000640 1 -- 172.21.15.37:0/1349192194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7db806b960 msgr2=0x7f7db815e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dae000640 1 --2- 172.21.15.37:0/1349192194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7db806b960 0x7f7db815e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dae000640 1 -- 172.21.15.37:0/1349192194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db80b4d90 con 0x7f7db8070260 2024-05-30T06:55:35.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dae000640 1 --2- 172.21.15.37:0/1349192194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db8070260 0x7f7db8156f50 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f7da000e930 tx=0x7f7da000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:35.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7daf400640 1 -- 172.21.15.37:0/1349192194 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0017070 con 0x7f7db8070260 2024-05-30T06:55:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7daf400640 1 -- 172.21.15.37:0/1349192194 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da000ca00 con 0x7f7db8070260 2024-05-30T06:55:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dbda00640 1 -- 172.21.15.37:0/1349192194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db815d7e0 con 0x7f7db8070260 2024-05-30T06:55:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7daf400640 1 -- 172.21.15.37:0/1349192194 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da000cdb0 con 0x7f7db8070260 2024-05-30T06:55:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dbda00640 1 -- 172.21.15.37:0/1349192194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db8157980 con 0x7f7db8070260 2024-05-30T06:55:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.465+0000 7f7dbda00640 1 -- 172.21.15.37:0/1349192194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db8068b20 con 0x7f7db8070260 2024-05-30T06:55:35.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.469+0000 7f7daf400640 1 -- 172.21.15.37:0/1349192194 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f7da001a070 con 0x7f7db8070260 2024-05-30T06:55:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.469+0000 7f7daf400640 1 --2- 172.21.15.37:0/1349192194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7d94069910 0x7f7d9406bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.469+0000 7f7daf400640 1 -- 172.21.15.37:0/1349192194 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5737+0+0 (secure 0 0 0) 0x7f7da0085710 con 0x7f7db8070260 2024-05-30T06:55:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.469+0000 7f7db6a00640 1 --2- 172.21.15.37:0/1349192194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7d94069910 0x7f7d9406bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.469+0000 7f7db6a00640 1 --2- 172.21.15.37:0/1349192194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7d94069910 0x7f7d9406bdd0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7da8007fd0 tx=0x7f7da8007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:35.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.473+0000 7f7daf400640 1 -- 172.21.15.37:0/1349192194 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7da00577e0 con 0x7f7db8070260 2024-05-30T06:55:35.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:55:35.515 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:55:35.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7dbda00640 1 -- 172.21.15.37:0/1349192194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7db80cb740 con 0x7f7db8070260 2024-05-30T06:55:35.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7daf400640 1 -- 172.21.15.37:0/1349192194 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16663 (secure 0 0 0) 0x7f7da0085b90 con 0x7f7db8070260 2024-05-30T06:55:35.642 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:35.642 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":101,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:55:34.327051+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:55:32.713799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-05-30T06:55:33.276484+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:55:35.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7dbda00640 1 -- 172.21.15.37:0/1349192194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7d94069910 msgr2=0x7f7d9406bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7dbda00640 1 --2- 172.21.15.37:0/1349192194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7d94069910 0x7f7d9406bdd0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7da8007fd0 tx=0x7f7da8007900 comp rx=0 tx=0).stop 2024-05-30T06:55:35.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7dbda00640 1 -- 172.21.15.37:0/1349192194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db8070260 msgr2=0x7f7db8156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7dbda00640 1 --2- 172.21.15.37:0/1349192194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db8070260 0x7f7db8156f50 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f7da000e930 tx=0x7f7da000edf0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7dbda00640 1 -- 172.21.15.37:0/1349192194 shutdown_connections 2024-05-30T06:55:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7dbda00640 1 --2- 172.21.15.37:0/1349192194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7db80cd4d0 0x7f7db80b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7dbda00640 1 --2- 172.21.15.37:0/1349192194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db8070260 0x7f7db8156f50 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7dbda00640 1 --2- 172.21.15.37:0/1349192194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7d94069910 0x7f7d9406bdd0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7dbda00640 1 --2- 172.21.15.37:0/1349192194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7db806b960 0x7f7db815e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7dbda00640 1 -- 172.21.15.37:0/1349192194 >> 172.21.15.37:0/1349192194 conn(0x7f7db809aa60 msgr2=0x7f7db80d1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7dbda00640 1 -- 172.21.15.37:0/1349192194 shutdown_connections 2024-05-30T06:55:35.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.641+0000 7f7dbda00640 1 -- 172.21.15.37:0/1349192194 wait complete. 2024-05-30T06:55:35.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T06:55:35.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.805+0000 7f4df8200640 1 Processor -- start 2024-05-30T06:55:35.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.805+0000 7f4df8200640 1 -- start start 2024-05-30T06:55:35.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.805+0000 7f4df8200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4df00cd440 0x7f4df006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.805+0000 7f4df8200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4df006f5a0 0x7f4df00b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.805+0000 7f4df8200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df015f310 con 0x7f4df0155da0 2024-05-30T06:55:35.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.805+0000 7f4df8200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4df006fa10 con 0x7f4df006f5a0 2024-05-30T06:55:35.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.805+0000 7f4df8200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4df015f5f0 con 0x7f4df00cd440 2024-05-30T06:55:35.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.805+0000 7f4df6200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4df006f5a0 0x7f4df00b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.809+0000 7f4df6200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4df006f5a0 0x7f4df00b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51706/0 (socket says 172.21.15.37:51706) 2024-05-30T06:55:35.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.809+0000 7f4df6200640 1 -- 172.21.15.37:0/4263435558 learned_addr learned my addr 172.21.15.37:0/4263435558 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:35.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.809+0000 7f4df6200640 1 -- 172.21.15.37:0/4263435558 >> v2:172.21.15.105:3300/0 conn(0x7f4df00cd440 msgr2=0x7f4df006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:35.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.809+0000 7f4df4e00640 1 --2- 172.21.15.37:0/4263435558 >> v2:172.21.15.105:3300/0 conn(0x7f4df00cd440 0x7f4df006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.809+0000 7f4df6200640 1 --2- 172.21.15.37:0/4263435558 >> v2:172.21.15.105:3300/0 conn(0x7f4df00cd440 0x7f4df006f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.809+0000 7f4df6200640 1 -- 172.21.15.37:0/4263435558 >> v1:172.21.15.105:6789/0 conn(0x7f4df0155da0 legacy=0x7f4df00cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:35.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.809+0000 7f4df6200640 1 -- 172.21.15.37:0/4263435558 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df015f8d0 con 0x7f4df006f5a0 2024-05-30T06:55:35.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.809+0000 7f4df4e00640 1 --2- 172.21.15.37:0/4263435558 >> v2:172.21.15.105:3300/0 conn(0x7f4df00cd440 0x7f4df006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:35.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.809+0000 7f4df6200640 1 --2- 172.21.15.37:0/4263435558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df006f5a0 0x7f4df00b3750 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f4df00b2f00 tx=0x7f4de801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdfd48d387b5bd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:35.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.809+0000 7f4defe00640 1 -- 172.21.15.37:0/4263435558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de80a5550 con 0x7f4df006f5a0 2024-05-30T06:55:35.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.809+0000 7f4defe00640 1 -- 172.21.15.37:0/4263435558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de80a56f0 con 0x7f4df006f5a0 2024-05-30T06:55:35.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.809+0000 7f4defe00640 1 -- 172.21.15.37:0/4263435558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de80a5ac0 con 0x7f4df006f5a0 2024-05-30T06:55:35.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 -- 172.21.15.37:0/4263435558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df006f5a0 msgr2=0x7f4df00b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 --2- 172.21.15.37:0/4263435558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df006f5a0 0x7f4df00b3750 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f4df00b2f00 tx=0x7f4de801c890 comp rx=0 tx=0).stop 2024-05-30T06:55:35.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 -- 172.21.15.37:0/4263435558 shutdown_connections 2024-05-30T06:55:35.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 --2- 172.21.15.37:0/4263435558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df006f5a0 0x7f4df00b3750 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 --2- 172.21.15.37:0/4263435558 >> v2:172.21.15.105:3300/0 conn(0x7f4df00cd440 0x7f4df006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 -- 172.21.15.37:0/4263435558 >> 172.21.15.37:0/4263435558 conn(0x7f4df006bf60 msgr2=0x7f4df00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:35.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 -- 172.21.15.37:0/4263435558 shutdown_connections 2024-05-30T06:55:35.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 -- 172.21.15.37:0/4263435558 wait complete. 2024-05-30T06:55:35.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 Processor -- start 2024-05-30T06:55:35.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 -- start start 2024-05-30T06:55:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4df006f5a0 0x7f4df0157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df0155da0 0x7f4df0148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4df014d7f0 0x7f4df00b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0168580 con 0x7f4df0155da0 2024-05-30T06:55:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4df00b46b0 con 0x7f4df006f5a0 2024-05-30T06:55:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df8200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4df0168700 con 0x7f4df014d7f0 2024-05-30T06:55:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df4e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df0155da0 0x7f4df0148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df4e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df0155da0 0x7f4df0148e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51720/0 (socket says 172.21.15.37:51720) 2024-05-30T06:55:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df4e00640 1 -- 172.21.15.37:0/367464566 learned_addr learned my addr 172.21.15.37:0/367464566 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df6200640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4df014d7f0 0x7f4df00b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.813+0000 7f4df5800640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4df006f5a0 0x7f4df0157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4df4e00640 1 -- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4df014d7f0 msgr2=0x7f4df00b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4df4e00640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4df014d7f0 0x7f4df00b0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4df4e00640 1 -- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4df006f5a0 msgr2=0x7f4df0157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4df4e00640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4df006f5a0 0x7f4df0157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4df4e00640 1 -- 172.21.15.37:0/367464566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df014dcf0 con 0x7f4df0155da0 2024-05-30T06:55:35.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4df4e00640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df0155da0 0x7f4df0148e40 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c7f0 tx=0x7f4ddc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4ded600640 1 -- 172.21.15.37:0/367464566 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc007a30 con 0x7f4df0155da0 2024-05-30T06:55:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4ded600640 1 -- 172.21.15.37:0/367464566 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ddc007bd0 con 0x7f4df0155da0 2024-05-30T06:55:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4ded600640 1 -- 172.21.15.37:0/367464566 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc0113f0 con 0x7f4df0155da0 2024-05-30T06:55:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4df8200640 1 -- 172.21.15.37:0/367464566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df014dfd0 con 0x7f4df0155da0 2024-05-30T06:55:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4df8200640 1 -- 172.21.15.37:0/367464566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df014e590 con 0x7f4df0155da0 2024-05-30T06:55:35.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4df8200640 1 -- 172.21.15.37:0/367464566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df0068bc0 con 0x7f4df0155da0 2024-05-30T06:55:35.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4ded600640 1 -- 172.21.15.37:0/367464566 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f4ddc011590 con 0x7f4df0155da0 2024-05-30T06:55:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4ded600640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4dd00698e0 0x7f4dd006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.817+0000 7f4ded600640 1 -- 172.21.15.37:0/367464566 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5737+0+0 (secure 0 0 0) 0x7f4ddc085c80 con 0x7f4df0155da0 2024-05-30T06:55:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.821+0000 7f4df5800640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4dd00698e0 0x7f4dd006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:35.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.821+0000 7f4df5800640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4dd00698e0 0x7f4dd006bda0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4de40098e0 tx=0x7f4de4009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:35.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:35.825+0000 7f4ded600640 1 -- 172.21.15.37:0/367464566 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ddc015020 con 0x7f4df0155da0 2024-05-30T06:55:35.888 INFO:tasks.ceph.mds.c.smithi037.stderr:2024-05-30T06:55:35.885+0000 7f73f3800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T06:55:36.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.029+0000 7f4df8200640 1 -- 172.21.15.37:0/367464566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4df0153850 con 0x7f4df0155da0 2024-05-30T06:55:36.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.941+0000 7f4ded600640 1 -- 172.21.15.37:0/367464566 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v63) ==== 118+0+0 (secure 0 0 0) 0x7f4ddc057240 con 0x7f4df0155da0 2024-05-30T06:55:36.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.945+0000 7f4df8200640 1 -- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4dd00698e0 msgr2=0x7f4dd006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:36.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.945+0000 7f4df8200640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4dd00698e0 0x7f4dd006bda0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f4de40098e0 tx=0x7f4de4009060 comp rx=0 tx=0).stop 2024-05-30T06:55:36.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.945+0000 7f4df8200640 1 -- 172.21.15.37:0/367464566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df0155da0 msgr2=0x7f4df0148e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:36.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.945+0000 7f4df8200640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df0155da0 0x7f4df0148e40 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c7f0 tx=0x7f4ddc00ccb0 comp rx=0 tx=0).stop 2024-05-30T06:55:36.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.945+0000 7f4df8200640 1 -- 172.21.15.37:0/367464566 shutdown_connections 2024-05-30T06:55:36.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.945+0000 7f4df8200640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4df014d7f0 0x7f4df00b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:36.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.945+0000 7f4df8200640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df0155da0 0x7f4df0148e40 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:36.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.945+0000 7f4df8200640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4dd00698e0 0x7f4dd006bda0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:36.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.945+0000 7f4df8200640 1 --2- 172.21.15.37:0/367464566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4df006f5a0 0x7f4df0157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:36.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.945+0000 7f4df8200640 1 -- 172.21.15.37:0/367464566 >> 172.21.15.37:0/367464566 conn(0x7f4df006bf60 msgr2=0x7f4df00b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:36.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.945+0000 7f4df8200640 1 -- 172.21.15.37:0/367464566 shutdown_connections 2024-05-30T06:55:36.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:36.945+0000 7f4df8200640 1 -- 172.21.15.37:0/367464566 wait complete. 2024-05-30T06:55:36.971 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T06:55:36.971 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T06:55:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.117+0000 7f5619000640 1 Processor -- start 2024-05-30T06:55:37.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.117+0000 7f5619000640 1 -- start start 2024-05-30T06:55:37.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.117+0000 7f5619000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f56140cd440 0x7f561406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:37.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.117+0000 7f5619000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f561406f5a0 0x7f56140b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:37.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.117+0000 7f5619000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561415f310 con 0x7f5614155da0 2024-05-30T06:55:37.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.117+0000 7f5619000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f561415f5f0 con 0x7f56140cd440 2024-05-30T06:55:37.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.117+0000 7f5619000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f561415f8d0 con 0x7f561406f5a0 2024-05-30T06:55:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.121+0000 7f5612800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f561406f5a0 0x7f56140b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.121+0000 7f5612800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f561406f5a0 0x7f56140b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:43344/0 (socket says 172.21.15.37:43344) 2024-05-30T06:55:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.121+0000 7f5612800640 1 -- 172.21.15.37:0/3213872824 learned_addr learned my addr 172.21.15.37:0/3213872824 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.121+0000 7f560be00640 1 --2- 172.21.15.37:0/3213872824 >> v2:172.21.15.105:3300/0 conn(0x7f56140cd440 0x7f561406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.121+0000 7f5612800640 1 -- 172.21.15.37:0/3213872824 >> v2:172.21.15.105:3300/0 conn(0x7f56140cd440 msgr2=0x7f561406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.121+0000 7f5612800640 1 --2- 172.21.15.37:0/3213872824 >> v2:172.21.15.105:3300/0 conn(0x7f56140cd440 0x7f561406f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.121+0000 7f5612800640 1 -- 172.21.15.37:0/3213872824 >> v1:172.21.15.105:6789/0 conn(0x7f5614155da0 legacy=0x7f56140cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.121+0000 7f5612800640 1 -- 172.21.15.37:0/3213872824 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f561415fbb0 con 0x7f561406f5a0 2024-05-30T06:55:37.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.121+0000 7f5612800640 1 --2- 172.21.15.37:0/3213872824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f561406f5a0 0x7f56140b3750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f560c00d150 tx=0x7f560c01eb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd0785a41d92f034 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:37.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.121+0000 7f5611400640 1 -- 172.21.15.37:0/3213872824 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c00b2d0 con 0x7f561406f5a0 2024-05-30T06:55:37.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5611400640 1 -- 172.21.15.37:0/3213872824 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f560c00b470 con 0x7f561406f5a0 2024-05-30T06:55:37.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5611400640 1 -- 172.21.15.37:0/3213872824 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c0a7b10 con 0x7f561406f5a0 2024-05-30T06:55:37.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 -- 172.21.15.37:0/3213872824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f561406f5a0 msgr2=0x7f56140b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:37.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 --2- 172.21.15.37:0/3213872824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f561406f5a0 0x7f56140b3750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f560c00d150 tx=0x7f560c01eb10 comp rx=0 tx=0).stop 2024-05-30T06:55:37.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 -- 172.21.15.37:0/3213872824 shutdown_connections 2024-05-30T06:55:37.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 --2- 172.21.15.37:0/3213872824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f561406f5a0 0x7f56140b3750 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:37.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 --2- 172.21.15.37:0/3213872824 >> v2:172.21.15.105:3300/0 conn(0x7f56140cd440 0x7f561406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:37.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 -- 172.21.15.37:0/3213872824 >> 172.21.15.37:0/3213872824 conn(0x7f561406bf60 msgr2=0x7f56140b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:37.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 -- 172.21.15.37:0/3213872824 shutdown_connections 2024-05-30T06:55:37.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 -- 172.21.15.37:0/3213872824 wait complete. 2024-05-30T06:55:37.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 Processor -- start 2024-05-30T06:55:37.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 -- start start 2024-05-30T06:55:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f561406f5a0 0x7f5614150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5614155da0 0x7f561414d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f561415ce70 0x7f561415b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f561406df50 con 0x7f561406f5a0 2024-05-30T06:55:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f56140b46b0 con 0x7f561415ce70 2024-05-30T06:55:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5619000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f561406e0d0 con 0x7f5614155da0 2024-05-30T06:55:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5611e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f561406f5a0 0x7f5614150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5611e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f561406f5a0 0x7f5614150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51724/0 (socket says 172.21.15.37:51724) 2024-05-30T06:55:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f560be00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5614155da0 0x7f561414d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5611e00640 1 -- 172.21.15.37:0/1395778533 learned_addr learned my addr 172.21.15.37:0/1395778533 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.125+0000 7f5612800640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f561415ce70 0x7f561415b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f5611e00640 1 -- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5614155da0 msgr2=0x7f561414d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f5611e00640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5614155da0 0x7f561414d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f5611e00640 1 -- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f561415ce70 msgr2=0x7f561415b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f5611e00640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f561415ce70 0x7f561415b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f5611e00640 1 -- 172.21.15.37:0/1395778533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56140b6300 con 0x7f561406f5a0 2024-05-30T06:55:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f5612800640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f561415ce70 0x7f561415b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:55:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f5611e00640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f561406f5a0 0x7f5614150410 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f560400c370 tx=0x7f560400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:37.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f560a000640 1 -- 172.21.15.37:0/1395778533 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56040052d0 con 0x7f561406f5a0 2024-05-30T06:55:37.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f560a000640 1 -- 172.21.15.37:0/1395778533 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5604005470 con 0x7f561406f5a0 2024-05-30T06:55:37.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f5619000640 1 -- 172.21.15.37:0/1395778533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f561414f370 con 0x7f561406f5a0 2024-05-30T06:55:37.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f560a000640 1 -- 172.21.15.37:0/1395778533 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604007260 con 0x7f561406f5a0 2024-05-30T06:55:37.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f5619000640 1 -- 172.21.15.37:0/1395778533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f561414f930 con 0x7f561406f5a0 2024-05-30T06:55:37.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f5619000640 1 -- 172.21.15.37:0/1395778533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5614068bc0 con 0x7f561406f5a0 2024-05-30T06:55:37.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f560a000640 1 -- 172.21.15.37:0/1395778533 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f5604007400 con 0x7f561406f5a0 2024-05-30T06:55:37.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f560a000640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f55f00698e0 0x7f55f006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:37.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.129+0000 7f560a000640 1 -- 172.21.15.37:0/1395778533 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f5604084ee0 con 0x7f561406f5a0 2024-05-30T06:55:37.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.133+0000 7f560be00640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f55f00698e0 0x7f55f006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:37.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.133+0000 7f560be00640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f55f00698e0 0x7f55f006bda0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f56140b28d0 tx=0x7f55fc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:37.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.133+0000 7f560a000640 1 -- 172.21.15.37:0/1395778533 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f56040564a0 con 0x7f561406f5a0 2024-05-30T06:55:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.333+0000 7f5619000640 1 -- 172.21.15.37:0/1395778533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5614150950 con 0x7f561406f5a0 2024-05-30T06:55:37.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.949+0000 7f560a000640 1 -- 172.21.15.37:0/1395778533 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v64) ==== 122+0+0 (secure 0 0 0) 0x7f560405a7a0 con 0x7f561406f5a0 2024-05-30T06:55:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.949+0000 7f5619000640 1 -- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f55f00698e0 msgr2=0x7f55f006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.949+0000 7f5619000640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f55f00698e0 0x7f55f006bda0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f56140b28d0 tx=0x7f55fc009190 comp rx=0 tx=0).stop 2024-05-30T06:55:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.949+0000 7f5619000640 1 -- 172.21.15.37:0/1395778533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f561406f5a0 msgr2=0x7f5614150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.949+0000 7f5619000640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f561406f5a0 0x7f5614150410 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f560400c370 tx=0x7f560400c830 comp rx=0 tx=0).stop 2024-05-30T06:55:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.949+0000 7f5619000640 1 -- 172.21.15.37:0/1395778533 shutdown_connections 2024-05-30T06:55:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.949+0000 7f5619000640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f55f00698e0 0x7f55f006bda0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.949+0000 7f5619000640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f561415ce70 0x7f561415b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.949+0000 7f5619000640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5614155da0 0x7f561414d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.949+0000 7f5619000640 1 --2- 172.21.15.37:0/1395778533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f561406f5a0 0x7f5614150410 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:37.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.949+0000 7f5619000640 1 -- 172.21.15.37:0/1395778533 >> 172.21.15.37:0/1395778533 conn(0x7f561406bf60 msgr2=0x7f56140cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:37.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.949+0000 7f5619000640 1 -- 172.21.15.37:0/1395778533 shutdown_connections 2024-05-30T06:55:37.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:37.949+0000 7f5619000640 1 -- 172.21.15.37:0/1395778533 wait complete. 2024-05-30T06:55:37.972 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T06:55:37.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:55:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6bca00640 1 Processor -- start 2024-05-30T06:55:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6bca00640 1 -- start start 2024-05-30T06:55:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6bca00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6b806e000 0x7fc6b80ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6bca00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc6b80cee10 0x7fc6b806f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6bca00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b80cd120 con 0x7fc6b815cd80 2024-05-30T06:55:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6bca00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b80a9530 con 0x7fc6b806e000 2024-05-30T06:55:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6bca00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b80cd400 con 0x7fc6b80cee10 2024-05-30T06:55:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6ad400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc6b815cd80 0x7fc6b80ce700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47370/0 (socket says 172.21.15.37:47370) 2024-05-30T06:55:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6ad400640 1 -- 172.21.15.37:0/2261633660 learned_addr learned my addr 172.21.15.37:0/2261633660 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6b5e00640 1 --2- 172.21.15.37:0/2261633660 >> v2:172.21.15.37:3300/0 conn(0x7fc6b806e000 0x7fc6b80ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6b6800640 1 --2- 172.21.15.37:0/2261633660 >> v2:172.21.15.105:3300/0 conn(0x7fc6b80cee10 0x7fc6b806f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6b5e00640 1 -- 172.21.15.37:0/2261633660 >> v2:172.21.15.105:3300/0 conn(0x7fc6b80cee10 msgr2=0x7fc6b806f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6b5e00640 1 --2- 172.21.15.37:0/2261633660 >> v2:172.21.15.105:3300/0 conn(0x7fc6b80cee10 0x7fc6b806f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6b5e00640 1 -- 172.21.15.37:0/2261633660 >> v1:172.21.15.37:6789/0 conn(0x7fc6b815cd80 legacy=0x7fc6b80ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6b5e00640 1 -- 172.21.15.37:0/2261633660 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b80cd6e0 con 0x7fc6b806e000 2024-05-30T06:55:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6b5400640 1 -- 172.21.15.37:0/2261633660 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231713264 0 0) 0x7fc6b80cd120 con 0x7fc6b815cd80 2024-05-30T06:55:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.113+0000 7fc6b6800640 1 --2- 172.21.15.37:0/2261633660 >> v2:172.21.15.105:3300/0 conn(0x7fc6b80cee10 0x7fc6b806f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.117+0000 7fc6b5e00640 1 --2- 172.21.15.37:0/2261633660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6b806e000 0x7fc6b80ce1c0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fc6b806c7b0 tx=0x7fc6a801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66fdee47b6823e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.117+0000 7fc6b5400640 1 -- 172.21.15.37:0/2261633660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a80b5070 con 0x7fc6b806e000 2024-05-30T06:55:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.117+0000 7fc6b5400640 1 -- 172.21.15.37:0/2261633660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a80a8970 con 0x7fc6b806e000 2024-05-30T06:55:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.117+0000 7fc6b5400640 1 -- 172.21.15.37:0/2261633660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a80a8d40 con 0x7fc6b806e000 2024-05-30T06:55:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.117+0000 7fc6bca00640 1 -- 172.21.15.37:0/2261633660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6b806e000 msgr2=0x7fc6b80ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.117+0000 7fc6bca00640 1 --2- 172.21.15.37:0/2261633660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6b806e000 0x7fc6b80ce1c0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fc6b806c7b0 tx=0x7fc6a801ec70 comp rx=0 tx=0).stop 2024-05-30T06:55:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.117+0000 7fc6bca00640 1 -- 172.21.15.37:0/2261633660 shutdown_connections 2024-05-30T06:55:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.117+0000 7fc6bca00640 1 --2- 172.21.15.37:0/2261633660 >> v2:172.21.15.105:3300/0 conn(0x7fc6b80cee10 0x7fc6b806f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.117+0000 7fc6bca00640 1 --2- 172.21.15.37:0/2261633660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6b806e000 0x7fc6b80ce1c0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.117+0000 7fc6bca00640 1 -- 172.21.15.37:0/2261633660 >> 172.21.15.37:0/2261633660 conn(0x7fc6b80b23a0 msgr2=0x7fc6b80b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.117+0000 7fc6bca00640 1 -- 172.21.15.37:0/2261633660 shutdown_connections 2024-05-30T06:55:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.117+0000 7fc6bca00640 1 -- 172.21.15.37:0/2261633660 wait complete. 2024-05-30T06:55:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6bca00640 1 Processor -- start 2024-05-30T06:55:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6bca00640 1 -- start start 2024-05-30T06:55:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6bca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6b806e000 0x7fc6b81539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6bca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6b80cee10 0x7fc6b81f7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6bca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6b815cd80 0x7fc6b815ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6bca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b806f930 con 0x7fc6b806e000 2024-05-30T06:55:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6bca00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b80cdca0 con 0x7fc6b815cd80 2024-05-30T06:55:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6bca00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc6b806fab0 con 0x7fc6b80cee10 2024-05-30T06:55:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6b5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6b806e000 0x7fc6b81539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6b5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6b806e000 0x7fc6b81539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44994/0 (socket says 172.21.15.37:44994) 2024-05-30T06:55:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6b5e00640 1 -- 172.21.15.37:0/2626697401 learned_addr learned my addr 172.21.15.37:0/2626697401 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6ad400640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6b80cee10 0x7fc6b81f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6b6800640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6b815cd80 0x7fc6b815ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6b5e00640 1 -- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6b80cee10 msgr2=0x7fc6b81f7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6b5e00640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6b80cee10 0x7fc6b81f7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6b5e00640 1 -- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6b815cd80 msgr2=0x7fc6b815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6b5e00640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6b815cd80 0x7fc6b815ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6b5e00640 1 -- 172.21.15.37:0/2626697401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b813bea0 con 0x7fc6b806e000 2024-05-30T06:55:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6b5e00640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6b806e000 0x7fc6b81539d0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc6a801c8a0 tx=0x7fc6a801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6aea00640 1 -- 172.21.15.37:0/2626697401 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a80bf070 con 0x7fc6b806e000 2024-05-30T06:55:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6aea00640 1 -- 172.21.15.37:0/2626697401 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a80b07a0 con 0x7fc6b806e000 2024-05-30T06:55:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6aea00640 1 -- 172.21.15.37:0/2626697401 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a80b5040 con 0x7fc6b806e000 2024-05-30T06:55:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6bca00640 1 -- 172.21.15.37:0/2626697401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b815f970 con 0x7fc6b806e000 2024-05-30T06:55:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.121+0000 7fc6bca00640 1 -- 172.21.15.37:0/2626697401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b81531d0 con 0x7fc6b806e000 2024-05-30T06:55:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.125+0000 7fc6bca00640 1 -- 172.21.15.37:0/2626697401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b8152ce0 con 0x7fc6b806e000 2024-05-30T06:55:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.125+0000 7fc6aea00640 1 -- 172.21.15.37:0/2626697401 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fc6a80c2070 con 0x7fc6b806e000 2024-05-30T06:55:38.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.125+0000 7fc6aea00640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6940698e0 0x7fc69406bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.125+0000 7fc6aea00640 1 -- 172.21.15.37:0/2626697401 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fc6a81222b0 con 0x7fc6b806e000 2024-05-30T06:55:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.125+0000 7fc6ad400640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6940698e0 0x7fc69406bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.125+0000 7fc6ad400640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6940698e0 0x7fc69406bda0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc6b81595c0 tx=0x7fc6a0007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.129+0000 7fc6aea00640 1 -- 172.21.15.37:0/2626697401 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc6a80187d0 con 0x7fc6b806e000 2024-05-30T06:55:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6bca00640 1 -- 172.21.15.37:0/2626697401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6b815c5e0 con 0x7fc6b806e000 2024-05-30T06:55:38.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6aea00640 1 -- 172.21.15.37:0/2626697401 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5180 (secure 0 0 0) 0x7fc6a8122730 con 0x7fc6b806e000 2024-05-30T06:55:38.331 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:38.331 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/667666714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":667666714},{"type":"v1","addr":"172.21.15.105:6836","nonce":667666714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/748743640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":748743640},{"type":"v1","addr":"172.21.15.37:6835","nonce":748743640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/527055184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":527055184},{"type":"v1","addr":"172.21.15.105:6837","nonce":527055184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:55:34.327016+0000","modified":"2024-05-30T06:55:37.340047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8538":{"gid":8538,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/1190106206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1190106206},{"type":"v1","addr":"172.21.15.37:6834","nonce":1190106206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8538,"qdb_cluster":[8538]},"id":7}]} 2024-05-30T06:55:38.331 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 64 2024-05-30T06:55:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6bca00640 1 -- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6940698e0 msgr2=0x7fc69406bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6bca00640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6940698e0 0x7fc69406bda0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc6b81595c0 tx=0x7fc6a0007b60 comp rx=0 tx=0).stop 2024-05-30T06:55:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6bca00640 1 -- 172.21.15.37:0/2626697401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6b806e000 msgr2=0x7fc6b81539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6bca00640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6b806e000 0x7fc6b81539d0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc6a801c8a0 tx=0x7fc6a801ba10 comp rx=0 tx=0).stop 2024-05-30T06:55:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6bca00640 1 -- 172.21.15.37:0/2626697401 shutdown_connections 2024-05-30T06:55:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6bca00640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc6940698e0 0x7fc69406bda0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6bca00640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6b815cd80 0x7fc6b815ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6bca00640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6b80cee10 0x7fc6b81f7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6bca00640 1 --2- 172.21.15.37:0/2626697401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6b806e000 0x7fc6b81539d0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6bca00640 1 -- 172.21.15.37:0/2626697401 >> 172.21.15.37:0/2626697401 conn(0x7fc6b80b23a0 msgr2=0x7fc6b8142010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:38.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6bca00640 1 -- 172.21.15.37:0/2626697401 shutdown_connections 2024-05-30T06:55:38.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.329+0000 7fc6bca00640 1 -- 172.21.15.37:0/2626697401 wait complete. 2024-05-30T06:55:38.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:55:38.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.493+0000 7f1852400640 1 Processor -- start 2024-05-30T06:55:38.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.493+0000 7f1852400640 1 -- start start 2024-05-30T06:55:38.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.493+0000 7f1852400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f184c160b90 0x7f184c09aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.493+0000 7f1852400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f184c0d0430 con 0x7f184c161020 2024-05-30T06:55:38.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.493+0000 7f1852400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f184c0d0710 con 0x7f184c0b2e20 2024-05-30T06:55:38.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.493+0000 7f1852400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f184c0b3200 con 0x7f184c160b90 2024-05-30T06:55:38.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.493+0000 7f184be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f184c161020 0x7f184c09afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47386/0 (socket says 172.21.15.37:47386) 2024-05-30T06:55:38.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.493+0000 7f184be00640 1 -- 172.21.15.37:0/3390102843 learned_addr learned my addr 172.21.15.37:0/3390102843 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:38.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.493+0000 7f184aa00640 1 --2- 172.21.15.37:0/3390102843 >> v2:172.21.15.37:3300/0 conn(0x7f184c160b90 0x7f184c09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.493+0000 7f184aa00640 1 -- 172.21.15.37:0/3390102843 >> v1:172.21.15.105:6789/0 conn(0x7f184c0b2e20 legacy=0x7f184c160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.493+0000 7f184aa00640 1 -- 172.21.15.37:0/3390102843 >> v1:172.21.15.37:6789/0 conn(0x7f184c161020 legacy=0x7f184c09afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.493+0000 7f184aa00640 1 -- 172.21.15.37:0/3390102843 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184c0b35f0 con 0x7f184c160b90 2024-05-30T06:55:38.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.493+0000 7f184a000640 1 -- 172.21.15.37:0/3390102843 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766804733 0 0) 0x7f184c0d0430 con 0x7f184c161020 2024-05-30T06:55:38.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.497+0000 7f184aa00640 1 --2- 172.21.15.37:0/3390102843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f184c160b90 0x7f184c09aa60 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f18380097c0 tx=0x7f183801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d06ed42afa4533 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.497+0000 7f184a000640 1 -- 172.21.15.37:0/3390102843 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18380b0070 con 0x7f184c160b90 2024-05-30T06:55:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.497+0000 7f184a000640 1 -- 172.21.15.37:0/3390102843 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18380ab600 con 0x7f184c160b90 2024-05-30T06:55:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.497+0000 7f184a000640 1 -- 172.21.15.37:0/3390102843 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18380ab9d0 con 0x7f184c160b90 2024-05-30T06:55:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.497+0000 7f1852400640 1 -- 172.21.15.37:0/3390102843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f184c160b90 msgr2=0x7f184c09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.497+0000 7f1852400640 1 --2- 172.21.15.37:0/3390102843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f184c160b90 0x7f184c09aa60 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f18380097c0 tx=0x7f183801c480 comp rx=0 tx=0).stop 2024-05-30T06:55:38.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.497+0000 7f1852400640 1 -- 172.21.15.37:0/3390102843 shutdown_connections 2024-05-30T06:55:38.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.497+0000 7f1852400640 1 --2- 172.21.15.37:0/3390102843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f184c160b90 0x7f184c09aa60 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.497+0000 7f1852400640 1 -- 172.21.15.37:0/3390102843 >> 172.21.15.37:0/3390102843 conn(0x7f184c0b4100 msgr2=0x7f184c0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:38.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.497+0000 7f1852400640 1 -- 172.21.15.37:0/3390102843 shutdown_connections 2024-05-30T06:55:38.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.497+0000 7f1852400640 1 -- 172.21.15.37:0/3390102843 wait complete. 2024-05-30T06:55:38.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.497+0000 7f1852400640 1 Processor -- start 2024-05-30T06:55:38.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.497+0000 7f1852400640 1 -- start start 2024-05-30T06:55:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f1852400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f184c0b2e20 0x7f184c06e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f1852400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f184c160b90 0x7f184c157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f1852400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f184c161020 0x7f184c0c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f1852400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f184c16a950 con 0x7f184c0b2e20 2024-05-30T06:55:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f1852400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f184c16a7d0 con 0x7f184c161020 2024-05-30T06:55:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f1852400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f184c16aad0 con 0x7f184c160b90 2024-05-30T06:55:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f184b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f184c0b2e20 0x7f184c06e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f184b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f184c0b2e20 0x7f184c06e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45020/0 (socket says 172.21.15.37:45020) 2024-05-30T06:55:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f184b400640 1 -- 172.21.15.37:0/3586460667 learned_addr learned my addr 172.21.15.37:0/3586460667 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f184aa00640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f184c160b90 0x7f184c157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f184be00640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f184c161020 0x7f184c0c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f184b400640 1 -- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f184c160b90 msgr2=0x7f184c157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f184b400640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f184c160b90 0x7f184c157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f184b400640 1 -- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f184c161020 msgr2=0x7f184c0c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f184b400640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f184c161020 0x7f184c0c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f184b400640 1 -- 172.21.15.37:0/3586460667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184c1580a0 con 0x7f184c0b2e20 2024-05-30T06:55:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f184aa00640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f184c160b90 0x7f184c157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f184b400640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f184c0b2e20 0x7f184c06e140 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f183c00c3f0 tx=0x7f183c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f1843400640 1 -- 172.21.15.37:0/3586460667 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c017070 con 0x7f184c0b2e20 2024-05-30T06:55:38.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f1843400640 1 -- 172.21.15.37:0/3586460667 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183c0052d0 con 0x7f184c0b2e20 2024-05-30T06:55:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f1843400640 1 -- 172.21.15.37:0/3586460667 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c003840 con 0x7f184c0b2e20 2024-05-30T06:55:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f1852400640 1 -- 172.21.15.37:0/3586460667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184c06dce0 con 0x7f184c0b2e20 2024-05-30T06:55:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f1852400640 1 -- 172.21.15.37:0/3586460667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f184c0b5cb0 con 0x7f184c0b2e20 2024-05-30T06:55:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.501+0000 7f1852400640 1 -- 172.21.15.37:0/3586460667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f184c068b20 con 0x7f184c0b2e20 2024-05-30T06:55:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.505+0000 7f1843400640 1 -- 172.21.15.37:0/3586460667 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f183c01a070 con 0x7f184c0b2e20 2024-05-30T06:55:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.505+0000 7f1843400640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f182c0698e0 0x7f182c06bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.505+0000 7f1843400640 1 -- 172.21.15.37:0/3586460667 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f183c084e90 con 0x7f184c0b2e20 2024-05-30T06:55:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.505+0000 7f184aa00640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f182c0698e0 0x7f182c06bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.505+0000 7f184aa00640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f182c0698e0 0x7f182c06bda0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f18380ad000 tx=0x7f1838008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:38.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.509+0000 7f1843400640 1 -- 172.21.15.37:0/3586460667 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f183c005480 con 0x7f184c0b2e20 2024-05-30T06:55:38.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.673+0000 7f1852400640 1 -- 172.21.15.37:0/3586460667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f184c0ce860 con 0x7f184c0b2e20 2024-05-30T06:55:38.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.677+0000 7f1843400640 1 -- 172.21.15.37:0/3586460667 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16650 (secure 0 0 0) 0x7f183c056aa0 con 0x7f184c0b2e20 2024-05-30T06:55:38.677 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:38.677 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":102,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:55:35.930491+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:55:32.713799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-05-30T06:55:33.276484+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:55:38.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.677+0000 7f1852400640 1 -- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f182c0698e0 msgr2=0x7f182c06bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.677+0000 7f1852400640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f182c0698e0 0x7f182c06bda0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f18380ad000 tx=0x7f1838008040 comp rx=0 tx=0).stop 2024-05-30T06:55:38.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.677+0000 7f1852400640 1 -- 172.21.15.37:0/3586460667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f184c0b2e20 msgr2=0x7f184c06e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.677+0000 7f1852400640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f184c0b2e20 0x7f184c06e140 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f183c00c3f0 tx=0x7f183c00c8b0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.677+0000 7f1852400640 1 -- 172.21.15.37:0/3586460667 shutdown_connections 2024-05-30T06:55:38.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.677+0000 7f1852400640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f182c0698e0 0x7f182c06bda0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.677+0000 7f1852400640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f184c161020 0x7f184c0c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.677+0000 7f1852400640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f184c160b90 0x7f184c157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.677+0000 7f1852400640 1 --2- 172.21.15.37:0/3586460667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f184c0b2e20 0x7f184c06e140 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.677+0000 7f1852400640 1 -- 172.21.15.37:0/3586460667 >> 172.21.15.37:0/3586460667 conn(0x7f184c0b4100 msgr2=0x7f184c074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:38.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.677+0000 7f1852400640 1 -- 172.21.15.37:0/3586460667 shutdown_connections 2024-05-30T06:55:38.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.677+0000 7f1852400640 1 -- 172.21.15.37:0/3586460667 wait complete. 2024-05-30T06:55:38.700 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-30T06:55:38.700 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:55:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.837+0000 7f95a0200640 1 Processor -- start 2024-05-30T06:55:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.837+0000 7f95a0200640 1 -- start start 2024-05-30T06:55:38.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f95a0200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9598155e60 0x7f95980b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f95a0200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f959806f9a0 0x7f95980cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f95a0200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959815c8f0 con 0x7f95980b2ec0 2024-05-30T06:55:38.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f95a0200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f95980ccff0 con 0x7f959806f9a0 2024-05-30T06:55:38.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f95a0200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f95980ccc80 con 0x7f9598155e60 2024-05-30T06:55:38.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f959d800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9598155e60 0x7f95980b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f959ce00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f959806f9a0 0x7f95980cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f959d800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9598155e60 0x7f95980b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34716/0 (socket says 172.21.15.37:34716) 2024-05-30T06:55:38.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f959e200640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f95980b2ec0 0x7f95980cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:53308/0 (socket says 172.21.15.37:53308) 2024-05-30T06:55:38.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f959d800640 1 -- 172.21.15.37:0/3407558819 learned_addr learned my addr 172.21.15.37:0/3407558819 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:38.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f959ce00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f959806f9a0 0x7f95980cf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:50616/0 (socket says 172.21.15.37:50616) 2024-05-30T06:55:38.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f959ce00640 1 -- 172.21.15.37:0/3407558819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9598155e60 msgr2=0x7f95980b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:38.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f959ce00640 1 --2- 172.21.15.37:0/3407558819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9598155e60 0x7f95980b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f959ce00640 1 -- 172.21.15.37:0/3407558819 >> v1:172.21.15.105:6789/0 conn(0x7f95980b2ec0 legacy=0x7f95980cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.841+0000 7f959ce00640 1 -- 172.21.15.37:0/3407558819 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959815cbd0 con 0x7f959806f9a0 2024-05-30T06:55:38.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.845+0000 7f959ce00640 1 --2- 172.21.15.37:0/3407558819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f959806f9a0 0x7f95980cf660 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f95840097c0 tx=0x7f958401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73b4e32a0289e712 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:38.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.845+0000 7f9597e00640 1 -- 172.21.15.37:0/3407558819 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95840b0070 con 0x7f959806f9a0 2024-05-30T06:55:38.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.845+0000 7f9597e00640 1 -- 172.21.15.37:0/3407558819 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95840ab600 con 0x7f959806f9a0 2024-05-30T06:55:38.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.845+0000 7f9597e00640 1 -- 172.21.15.37:0/3407558819 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95840ab9d0 con 0x7f959806f9a0 2024-05-30T06:55:38.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.845+0000 7f95a0200640 1 -- 172.21.15.37:0/3407558819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f959806f9a0 msgr2=0x7f95980cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.845+0000 7f95a0200640 1 --2- 172.21.15.37:0/3407558819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f959806f9a0 0x7f95980cf660 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f95840097c0 tx=0x7f958401c4a0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.845+0000 7f95a0200640 1 -- 172.21.15.37:0/3407558819 shutdown_connections 2024-05-30T06:55:38.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.845+0000 7f95a0200640 1 --2- 172.21.15.37:0/3407558819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f959806f9a0 0x7f95980cf660 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.845+0000 7f95a0200640 1 --2- 172.21.15.37:0/3407558819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9598155e60 0x7f95980b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.845+0000 7f95a0200640 1 -- 172.21.15.37:0/3407558819 >> 172.21.15.37:0/3407558819 conn(0x7f95980b23a0 msgr2=0x7f95980b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:38.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.845+0000 7f95a0200640 1 -- 172.21.15.37:0/3407558819 shutdown_connections 2024-05-30T06:55:38.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.845+0000 7f95a0200640 1 -- 172.21.15.37:0/3407558819 wait complete. 2024-05-30T06:55:38.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.845+0000 7f95a0200640 1 Processor -- start 2024-05-30T06:55:38.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f95a0200640 1 -- start start 2024-05-30T06:55:38.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f95a0200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f959806f9a0 0x7f9598148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f95a0200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95980b2ec0 0x7f95980b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f95a0200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9598155e60 0x7f95980b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f95a0200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f959806ec20 con 0x7f95980b2ec0 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f95a0200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f959806eaa0 con 0x7f9598155e60 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f95a0200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f959806eda0 con 0x7f959806f9a0 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f959ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95980b2ec0 0x7f95980b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f959d800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f959806f9a0 0x7f9598148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f959ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95980b2ec0 0x7f95980b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45030/0 (socket says 172.21.15.37:45030) 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f959ce00640 1 -- 172.21.15.37:0/3903719983 learned_addr learned my addr 172.21.15.37:0/3903719983 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f959e200640 1 --2- 172.21.15.37:0/3903719983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9598155e60 0x7f95980b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f959ce00640 1 -- 172.21.15.37:0/3903719983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f959806f9a0 msgr2=0x7f9598148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f959ce00640 1 --2- 172.21.15.37:0/3903719983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f959806f9a0 0x7f9598148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f959ce00640 1 -- 172.21.15.37:0/3903719983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9598155e60 msgr2=0x7f95980b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f959ce00640 1 --2- 172.21.15.37:0/3903719983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9598155e60 0x7f95980b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:38.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f959ce00640 1 -- 172.21.15.37:0/3903719983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95980cb640 con 0x7f95980b2ec0 2024-05-30T06:55:38.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f959ce00640 1 --2- 172.21.15.37:0/3903719983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95980b2ec0 0x7f95980b46b0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f958401a0d0 tx=0x7f9584019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:38.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f9595600640 1 -- 172.21.15.37:0/3903719983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95840ba070 con 0x7f95980b2ec0 2024-05-30T06:55:38.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f9595600640 1 -- 172.21.15.37:0/3903719983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95840b43f0 con 0x7f95980b2ec0 2024-05-30T06:55:38.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f9595600640 1 -- 172.21.15.37:0/3903719983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95840b0040 con 0x7f95980b2ec0 2024-05-30T06:55:38.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f95a0200640 1 -- 172.21.15.37:0/3903719983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95980cb920 con 0x7f95980b2ec0 2024-05-30T06:55:38.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f95a0200640 1 -- 172.21.15.37:0/3903719983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95980cbee0 con 0x7f95980b2ec0 2024-05-30T06:55:38.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.849+0000 7f95a0200640 1 -- 172.21.15.37:0/3903719983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9598068b20 con 0x7f95980b2ec0 2024-05-30T06:55:38.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.853+0000 7f9595600640 1 -- 172.21.15.37:0/3903719983 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f95840bd070 con 0x7f95980b2ec0 2024-05-30T06:55:38.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.853+0000 7f9595600640 1 --2- 172.21.15.37:0/3903719983 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9578069910 0x7f957806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:38.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.853+0000 7f9595600640 1 -- 172.21.15.37:0/3903719983 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f958411e940 con 0x7f95980b2ec0 2024-05-30T06:55:38.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.853+0000 7f959d800640 1 --2- 172.21.15.37:0/3903719983 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9578069910 0x7f957806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:38.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.853+0000 7f959d800640 1 --2- 172.21.15.37:0/3903719983 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9578069910 0x7f957806bdd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f958c00b240 tx=0x7f958c00b450 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:38.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:38.857+0000 7f9595600640 1 -- 172.21.15.37:0/3903719983 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9584016090 con 0x7f95980b2ec0 2024-05-30T06:55:39.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.017+0000 7f95a0200640 1 -- 172.21.15.37:0/3903719983 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9598072fb0 con 0x7f9578069910 2024-05-30T06:55:39.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.025+0000 7f9595600640 1 -- 172.21.15.37:0/3903719983 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248491 (secure 0 0 0) 0x7f9598072fb0 con 0x7f9578069910 2024-05-30T06:55:39.031 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:55:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.029+0000 7f95a0200640 1 -- 172.21.15.37:0/3903719983 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9578069910 msgr2=0x7f957806bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.029+0000 7f95a0200640 1 --2- 172.21.15.37:0/3903719983 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9578069910 0x7f957806bdd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f958c00b240 tx=0x7f958c00b450 comp rx=0 tx=0).stop 2024-05-30T06:55:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.029+0000 7f95a0200640 1 -- 172.21.15.37:0/3903719983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95980b2ec0 msgr2=0x7f95980b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.029+0000 7f95a0200640 1 --2- 172.21.15.37:0/3903719983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95980b2ec0 0x7f95980b46b0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f958401a0d0 tx=0x7f9584019240 comp rx=0 tx=0).stop 2024-05-30T06:55:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.029+0000 7f95a0200640 1 -- 172.21.15.37:0/3903719983 shutdown_connections 2024-05-30T06:55:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.029+0000 7f95a0200640 1 --2- 172.21.15.37:0/3903719983 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9578069910 0x7f957806bdd0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.029+0000 7f95a0200640 1 --2- 172.21.15.37:0/3903719983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9598155e60 0x7f95980b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.029+0000 7f95a0200640 1 --2- 172.21.15.37:0/3903719983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95980b2ec0 0x7f95980b46b0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.029+0000 7f95a0200640 1 --2- 172.21.15.37:0/3903719983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f959806f9a0 0x7f9598148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.029+0000 7f95a0200640 1 -- 172.21.15.37:0/3903719983 >> 172.21.15.37:0/3903719983 conn(0x7f95980b23a0 msgr2=0x7f959815d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.029+0000 7f95a0200640 1 -- 172.21.15.37:0/3903719983 shutdown_connections 2024-05-30T06:55:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.029+0000 7f95a0200640 1 -- 172.21.15.37:0/3903719983 wait complete. 2024-05-30T06:55:39.051 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":505,"stamp":"2024-05-30T06:55:38.943423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":849808,"kb_used_data":10844,"kb_used_omap":12,"kb_used_meta":838835,"kb_avail":754124912,"statfs":{"total":773094113280,"available":772223909888,"internally_reserved":0,"allocated":11104256,"data_stored":5478090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":858967600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001565"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931039+0000","last_change":"2024-05-30T06:55:33.931039+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931039+0000","last_undegraded":"2024-05-30T06:55:33.931039+0000","last_fullsized":"2024-05-30T06:55:33.931039+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935371+0000","last_change":"2024-05-30T06:55:34.955973+0000","last_active":"2024-05-30T06:55:35.935371+0000","last_peered":"2024-05-30T06:55:35.935371+0000","last_clean":"2024-05-30T06:55:35.935371+0000","last_became_active":"2024-05-30T06:55:34.955604+0000","last_became_peered":"2024-05-30T06:55:34.955604+0000","last_unstale":"2024-05-30T06:55:35.935371+0000","last_undegraded":"2024-05-30T06:55:35.935371+0000","last_fullsized":"2024-05-30T06:55:35.935371+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:13.858335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929293+0000","last_change":"2024-05-30T06:55:33.929293+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929293+0000","last_undegraded":"2024-05-30T06:55:33.929293+0000","last_fullsized":"2024-05-30T06:55:33.929293+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550531+0000","last_change":"2024-05-30T06:55:34.945824+0000","last_active":"2024-05-30T06:55:36.550531+0000","last_peered":"2024-05-30T06:55:36.550531+0000","last_clean":"2024-05-30T06:55:36.550531+0000","last_became_active":"2024-05-30T06:55:34.944885+0000","last_became_peered":"2024-05-30T06:55:34.944885+0000","last_unstale":"2024-05-30T06:55:36.550531+0000","last_undegraded":"2024-05-30T06:55:36.550531+0000","last_fullsized":"2024-05-30T06:55:36.550531+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:39.774985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929953+0000","last_change":"2024-05-30T06:55:33.929953+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929953+0000","last_undegraded":"2024-05-30T06:55:33.929953+0000","last_fullsized":"2024-05-30T06:55:33.929953+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.932061+0000","last_change":"2024-05-30T06:55:33.932061+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.932061+0000","last_undegraded":"2024-05-30T06:55:33.932061+0000","last_fullsized":"2024-05-30T06:55:33.932061+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931628+0000","last_change":"2024-05-30T06:55:33.931628+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931628+0000","last_undegraded":"2024-05-30T06:55:33.931628+0000","last_fullsized":"2024-05-30T06:55:33.931628+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934796+0000","last_change":"2024-05-30T06:55:34.952580+0000","last_active":"2024-05-30T06:55:35.934796+0000","last_peered":"2024-05-30T06:55:35.934796+0000","last_clean":"2024-05-30T06:55:35.934796+0000","last_became_active":"2024-05-30T06:55:34.952313+0000","last_became_peered":"2024-05-30T06:55:34.952313+0000","last_unstale":"2024-05-30T06:55:35.934796+0000","last_undegraded":"2024-05-30T06:55:35.934796+0000","last_fullsized":"2024-05-30T06:55:35.934796+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:54:03.363077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.927115+0000","last_change":"2024-05-30T06:55:33.927115+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.927115+0000","last_undegraded":"2024-05-30T06:55:33.927115+0000","last_fullsized":"2024-05-30T06:55:33.927115+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931449+0000","last_change":"2024-05-30T06:55:33.931449+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931449+0000","last_undegraded":"2024-05-30T06:55:33.931449+0000","last_fullsized":"2024-05-30T06:55:33.931449+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.935677+0000","last_change":"2024-05-30T06:55:33.935677+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.935677+0000","last_undegraded":"2024-05-30T06:55:33.935677+0000","last_fullsized":"2024-05-30T06:55:33.935677+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.927552+0000","last_change":"2024-05-30T06:55:33.927552+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.927552+0000","last_undegraded":"2024-05-30T06:55:33.927552+0000","last_fullsized":"2024-05-30T06:55:33.927552+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550365+0000","last_change":"2024-05-30T06:55:34.952578+0000","last_active":"2024-05-30T06:55:36.550365+0000","last_peered":"2024-05-30T06:55:36.550365+0000","last_clean":"2024-05-30T06:55:36.550365+0000","last_became_active":"2024-05-30T06:55:34.952237+0000","last_became_peered":"2024-05-30T06:55:34.952237+0000","last_unstale":"2024-05-30T06:55:36.550365+0000","last_undegraded":"2024-05-30T06:55:36.550365+0000","last_fullsized":"2024-05-30T06:55:36.550365+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:54.211731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.939233+0000","last_change":"2024-05-30T06:55:33.939233+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.939233+0000","last_undegraded":"2024-05-30T06:55:33.939233+0000","last_fullsized":"2024-05-30T06:55:33.939233+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549571+0000","last_change":"2024-05-30T06:55:34.948290+0000","last_active":"2024-05-30T06:55:36.549571+0000","last_peered":"2024-05-30T06:55:36.549571+0000","last_clean":"2024-05-30T06:55:36.549571+0000","last_became_active":"2024-05-30T06:55:34.947764+0000","last_became_peered":"2024-05-30T06:55:34.947764+0000","last_unstale":"2024-05-30T06:55:36.549571+0000","last_undegraded":"2024-05-30T06:55:36.549571+0000","last_fullsized":"2024-05-30T06:55:36.549571+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:12:13.556946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931145+0000","last_change":"2024-05-30T06:55:33.931145+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931145+0000","last_undegraded":"2024-05-30T06:55:33.931145+0000","last_fullsized":"2024-05-30T06:55:33.931145+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935244+0000","last_change":"2024-05-30T06:55:34.948066+0000","last_active":"2024-05-30T06:55:35.935244+0000","last_peered":"2024-05-30T06:55:35.935244+0000","last_clean":"2024-05-30T06:55:35.935244+0000","last_became_active":"2024-05-30T06:55:34.947836+0000","last_became_peered":"2024-05-30T06:55:34.947836+0000","last_unstale":"2024-05-30T06:55:35.935244+0000","last_undegraded":"2024-05-30T06:55:35.935244+0000","last_fullsized":"2024-05-30T06:55:35.935244+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:56:43.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550353+0000","last_change":"2024-05-30T06:55:34.933997+0000","last_active":"2024-05-30T06:55:36.550353+0000","last_peered":"2024-05-30T06:55:36.550353+0000","last_clean":"2024-05-30T06:55:36.550353+0000","last_became_active":"2024-05-30T06:55:34.933752+0000","last_became_peered":"2024-05-30T06:55:34.933752+0000","last_unstale":"2024-05-30T06:55:36.550353+0000","last_undegraded":"2024-05-30T06:55:36.550353+0000","last_fullsized":"2024-05-30T06:55:36.550353+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:55.380184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.936017+0000","last_change":"2024-05-30T06:55:33.936017+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.936017+0000","last_undegraded":"2024-05-30T06:55:33.936017+0000","last_fullsized":"2024-05-30T06:55:33.936017+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925212+0000","last_change":"2024-05-30T06:55:33.925212+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925212+0000","last_undegraded":"2024-05-30T06:55:33.925212+0000","last_fullsized":"2024-05-30T06:55:33.925212+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.934914+0000","last_change":"2024-05-30T06:55:33.934914+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.934914+0000","last_undegraded":"2024-05-30T06:55:33.934914+0000","last_fullsized":"2024-05-30T06:55:33.934914+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934743+0000","last_change":"2024-05-30T06:55:34.948942+0000","last_active":"2024-05-30T06:55:35.934743+0000","last_peered":"2024-05-30T06:55:35.934743+0000","last_clean":"2024-05-30T06:55:35.934743+0000","last_became_active":"2024-05-30T06:55:34.948665+0000","last_became_peered":"2024-05-30T06:55:34.948665+0000","last_unstale":"2024-05-30T06:55:35.934743+0000","last_undegraded":"2024-05-30T06:55:35.934743+0000","last_fullsized":"2024-05-30T06:55:35.934743+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:19:24.696303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934808+0000","last_change":"2024-05-30T06:55:34.948065+0000","last_active":"2024-05-30T06:55:35.934808+0000","last_peered":"2024-05-30T06:55:35.934808+0000","last_clean":"2024-05-30T06:55:35.934808+0000","last_became_active":"2024-05-30T06:55:34.947811+0000","last_became_peered":"2024-05-30T06:55:34.947811+0000","last_unstale":"2024-05-30T06:55:35.934808+0000","last_undegraded":"2024-05-30T06:55:35.934808+0000","last_fullsized":"2024-05-30T06:55:35.934808+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:03:57.480410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930690+0000","last_change":"2024-05-30T06:55:33.930690+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930690+0000","last_undegraded":"2024-05-30T06:55:33.930690+0000","last_fullsized":"2024-05-30T06:55:33.930690+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.933468+0000","last_change":"2024-05-30T06:55:33.933468+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.933468+0000","last_undegraded":"2024-05-30T06:55:33.933468+0000","last_fullsized":"2024-05-30T06:55:33.933468+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935399+0000","last_change":"2024-05-30T06:55:34.957056+0000","last_active":"2024-05-30T06:55:35.935399+0000","last_peered":"2024-05-30T06:55:35.935399+0000","last_clean":"2024-05-30T06:55:35.935399+0000","last_became_active":"2024-05-30T06:55:34.956742+0000","last_became_peered":"2024-05-30T06:55:34.956742+0000","last_unstale":"2024-05-30T06:55:35.935399+0000","last_undegraded":"2024-05-30T06:55:35.935399+0000","last_fullsized":"2024-05-30T06:55:35.935399+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:55.380184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.935235+0000","last_change":"2024-05-30T06:55:33.935235+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.935235+0000","last_undegraded":"2024-05-30T06:55:33.935235+0000","last_fullsized":"2024-05-30T06:55:33.935235+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930851+0000","last_change":"2024-05-30T06:55:33.930851+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930851+0000","last_undegraded":"2024-05-30T06:55:33.930851+0000","last_fullsized":"2024-05-30T06:55:33.930851+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935062+0000","last_change":"2024-05-30T06:55:34.956501+0000","last_active":"2024-05-30T06:55:35.935062+0000","last_peered":"2024-05-30T06:55:35.935062+0000","last_clean":"2024-05-30T06:55:35.935062+0000","last_became_active":"2024-05-30T06:55:34.956081+0000","last_became_peered":"2024-05-30T06:55:34.956081+0000","last_unstale":"2024-05-30T06:55:35.935062+0000","last_undegraded":"2024-05-30T06:55:35.935062+0000","last_fullsized":"2024-05-30T06:55:35.935062+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:12:13.556946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931295+0000","last_change":"2024-05-30T06:55:33.931295+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931295+0000","last_undegraded":"2024-05-30T06:55:33.931295+0000","last_fullsized":"2024-05-30T06:55:33.931295+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549664+0000","last_change":"2024-05-30T06:55:34.932722+0000","last_active":"2024-05-30T06:55:36.549664+0000","last_peered":"2024-05-30T06:55:36.549664+0000","last_clean":"2024-05-30T06:55:36.549664+0000","last_became_active":"2024-05-30T06:55:34.932454+0000","last_became_peered":"2024-05-30T06:55:34.932454+0000","last_unstale":"2024-05-30T06:55:36.549664+0000","last_undegraded":"2024-05-30T06:55:36.549664+0000","last_fullsized":"2024-05-30T06:55:36.549664+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:56:43.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.927240+0000","last_change":"2024-05-30T06:55:33.927240+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.927240+0000","last_undegraded":"2024-05-30T06:55:33.927240+0000","last_fullsized":"2024-05-30T06:55:33.927240+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.937565+0000","last_change":"2024-05-30T06:55:33.937565+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.937565+0000","last_undegraded":"2024-05-30T06:55:33.937565+0000","last_fullsized":"2024-05-30T06:55:33.937565+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"101'4","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935297+0000","last_change":"2024-05-30T06:55:33.941005+0000","last_active":"2024-05-30T06:55:35.935297+0000","last_peered":"2024-05-30T06:55:35.935297+0000","last_clean":"2024-05-30T06:55:35.935297+0000","last_became_active":"2024-05-30T06:55:33.940750+0000","last_became_peered":"2024-05-30T06:55:33.940750+0000","last_unstale":"2024-05-30T06:55:35.935297+0000","last_undegraded":"2024-05-30T06:55:35.935297+0000","last_fullsized":"2024-05-30T06:55:35.935297+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:30:31.861812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550787+0000","last_change":"2024-05-30T06:55:34.934593+0000","last_active":"2024-05-30T06:55:36.550787+0000","last_peered":"2024-05-30T06:55:36.550787+0000","last_clean":"2024-05-30T06:55:36.550787+0000","last_became_active":"2024-05-30T06:55:34.934338+0000","last_became_peered":"2024-05-30T06:55:34.934338+0000","last_unstale":"2024-05-30T06:55:36.550787+0000","last_undegraded":"2024-05-30T06:55:36.550787+0000","last_fullsized":"2024-05-30T06:55:36.550787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:45:12.188368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.947247+0000","last_change":"2024-05-30T06:55:33.946654+0000","last_active":"2024-05-30T06:55:33.947247+0000","last_peered":"2024-05-30T06:55:33.947247+0000","last_clean":"2024-05-30T06:55:33.947247+0000","last_became_active":"2024-05-30T06:55:33.946353+0000","last_became_peered":"2024-05-30T06:55:33.946353+0000","last_unstale":"2024-05-30T06:55:33.947247+0000","last_undegraded":"2024-05-30T06:55:33.947247+0000","last_fullsized":"2024-05-30T06:55:33.947247+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:48:56.773319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931138+0000","last_change":"2024-05-30T06:55:33.931138+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931138+0000","last_undegraded":"2024-05-30T06:55:33.931138+0000","last_fullsized":"2024-05-30T06:55:33.931138+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934937+0000","last_change":"2024-05-30T06:55:33.948635+0000","last_active":"2024-05-30T06:55:35.934937+0000","last_peered":"2024-05-30T06:55:35.934937+0000","last_clean":"2024-05-30T06:55:35.934937+0000","last_became_active":"2024-05-30T06:55:33.948243+0000","last_became_peered":"2024-05-30T06:55:33.948243+0000","last_unstale":"2024-05-30T06:55:35.934937+0000","last_undegraded":"2024-05-30T06:55:35.934937+0000","last_fullsized":"2024-05-30T06:55:35.934937+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:05:45.736094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.926112+0000","last_change":"2024-05-30T06:55:33.926112+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.926112+0000","last_undegraded":"2024-05-30T06:55:33.926112+0000","last_fullsized":"2024-05-30T06:55:33.926112+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935315+0000","last_change":"2024-05-30T06:55:33.943667+0000","last_active":"2024-05-30T06:55:35.935315+0000","last_peered":"2024-05-30T06:55:35.935315+0000","last_clean":"2024-05-30T06:55:35.935315+0000","last_became_active":"2024-05-30T06:55:33.943405+0000","last_became_peered":"2024-05-30T06:55:33.943405+0000","last_unstale":"2024-05-30T06:55:35.935315+0000","last_undegraded":"2024-05-30T06:55:35.935315+0000","last_fullsized":"2024-05-30T06:55:35.935315+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:51.073112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925670+0000","last_change":"2024-05-30T06:55:33.925670+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925670+0000","last_undegraded":"2024-05-30T06:55:33.925670+0000","last_fullsized":"2024-05-30T06:55:33.925670+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.946645+0000","last_change":"2024-05-30T06:55:33.945265+0000","last_active":"2024-05-30T06:55:33.946645+0000","last_peered":"2024-05-30T06:55:33.946645+0000","last_clean":"2024-05-30T06:55:33.946645+0000","last_became_active":"2024-05-30T06:55:33.944980+0000","last_became_peered":"2024-05-30T06:55:33.944980+0000","last_unstale":"2024-05-30T06:55:33.946645+0000","last_undegraded":"2024-05-30T06:55:33.946645+0000","last_fullsized":"2024-05-30T06:55:33.946645+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:46:40.089247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.932666+0000","last_change":"2024-05-30T06:55:33.932666+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.932666+0000","last_undegraded":"2024-05-30T06:55:33.932666+0000","last_fullsized":"2024-05-30T06:55:33.932666+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934832+0000","last_change":"2024-05-30T06:55:33.937498+0000","last_active":"2024-05-30T06:55:35.934832+0000","last_peered":"2024-05-30T06:55:35.934832+0000","last_clean":"2024-05-30T06:55:35.934832+0000","last_became_active":"2024-05-30T06:55:33.937250+0000","last_became_peered":"2024-05-30T06:55:33.937250+0000","last_unstale":"2024-05-30T06:55:35.934832+0000","last_undegraded":"2024-05-30T06:55:35.934832+0000","last_fullsized":"2024-05-30T06:55:35.934832+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:05:08.736546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549551+0000","last_change":"2024-05-30T06:55:34.946842+0000","last_active":"2024-05-30T06:55:36.549551+0000","last_peered":"2024-05-30T06:55:36.549551+0000","last_clean":"2024-05-30T06:55:36.549551+0000","last_became_active":"2024-05-30T06:55:34.946578+0000","last_became_peered":"2024-05-30T06:55:34.946578+0000","last_unstale":"2024-05-30T06:55:36.549551+0000","last_undegraded":"2024-05-30T06:55:36.549551+0000","last_fullsized":"2024-05-30T06:55:36.549551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:03:57.480410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.944529+0000","last_change":"2024-05-30T06:55:33.943949+0000","last_active":"2024-05-30T06:55:33.944529+0000","last_peered":"2024-05-30T06:55:33.944529+0000","last_clean":"2024-05-30T06:55:33.944529+0000","last_became_active":"2024-05-30T06:55:33.943656+0000","last_became_peered":"2024-05-30T06:55:33.943656+0000","last_unstale":"2024-05-30T06:55:33.944529+0000","last_undegraded":"2024-05-30T06:55:33.944529+0000","last_fullsized":"2024-05-30T06:55:33.944529+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:11:33.204524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925203+0000","last_change":"2024-05-30T06:55:33.925203+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925203+0000","last_undegraded":"2024-05-30T06:55:33.925203+0000","last_fullsized":"2024-05-30T06:55:33.925203+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.945545+0000","last_change":"2024-05-30T06:55:33.942310+0000","last_active":"2024-05-30T06:55:33.945545+0000","last_peered":"2024-05-30T06:55:33.945545+0000","last_clean":"2024-05-30T06:55:33.945545+0000","last_became_active":"2024-05-30T06:55:33.941865+0000","last_became_peered":"2024-05-30T06:55:33.941865+0000","last_unstale":"2024-05-30T06:55:33.945545+0000","last_undegraded":"2024-05-30T06:55:33.945545+0000","last_fullsized":"2024-05-30T06:55:33.945545+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:44:21.582491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935529+0000","last_change":"2024-05-30T06:55:34.945420+0000","last_active":"2024-05-30T06:55:35.935529+0000","last_peered":"2024-05-30T06:55:35.935529+0000","last_clean":"2024-05-30T06:55:35.935529+0000","last_became_active":"2024-05-30T06:55:34.945163+0000","last_became_peered":"2024-05-30T06:55:34.945163+0000","last_unstale":"2024-05-30T06:55:35.935529+0000","last_undegraded":"2024-05-30T06:55:35.935529+0000","last_fullsized":"2024-05-30T06:55:35.935529+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:39.774985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.944347+0000","last_change":"2024-05-30T06:55:33.939208+0000","last_active":"2024-05-30T06:55:33.944347+0000","last_peered":"2024-05-30T06:55:33.944347+0000","last_clean":"2024-05-30T06:55:33.944347+0000","last_became_active":"2024-05-30T06:55:33.938920+0000","last_became_peered":"2024-05-30T06:55:33.938920+0000","last_unstale":"2024-05-30T06:55:33.944347+0000","last_undegraded":"2024-05-30T06:55:33.944347+0000","last_fullsized":"2024-05-30T06:55:33.944347+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:43:58.244250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.926683+0000","last_change":"2024-05-30T06:55:33.926683+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.926683+0000","last_undegraded":"2024-05-30T06:55:33.926683+0000","last_fullsized":"2024-05-30T06:55:33.926683+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550488+0000","last_change":"2024-05-30T06:55:33.941180+0000","last_active":"2024-05-30T06:55:36.550488+0000","last_peered":"2024-05-30T06:55:36.550488+0000","last_clean":"2024-05-30T06:55:36.550488+0000","last_became_active":"2024-05-30T06:55:33.940874+0000","last_became_peered":"2024-05-30T06:55:33.940874+0000","last_unstale":"2024-05-30T06:55:36.550488+0000","last_undegraded":"2024-05-30T06:55:36.550488+0000","last_fullsized":"2024-05-30T06:55:36.550488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:34:52.834290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930355+0000","last_change":"2024-05-30T06:55:33.930355+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930355+0000","last_undegraded":"2024-05-30T06:55:33.930355+0000","last_fullsized":"2024-05-30T06:55:33.930355+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.946279+0000","last_change":"2024-05-30T06:55:33.945685+0000","last_active":"2024-05-30T06:55:33.946279+0000","last_peered":"2024-05-30T06:55:33.946279+0000","last_clean":"2024-05-30T06:55:33.946279+0000","last_became_active":"2024-05-30T06:55:33.945289+0000","last_became_peered":"2024-05-30T06:55:33.945289+0000","last_unstale":"2024-05-30T06:55:33.946279+0000","last_undegraded":"2024-05-30T06:55:33.946279+0000","last_fullsized":"2024-05-30T06:55:33.946279+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:30:31.861812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.934821+0000","last_change":"2024-05-30T06:55:33.934821+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.934821+0000","last_undegraded":"2024-05-30T06:55:33.934821+0000","last_fullsized":"2024-05-30T06:55:33.934821+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.944188+0000","last_change":"2024-05-30T06:55:33.937604+0000","last_active":"2024-05-30T06:55:33.944188+0000","last_peered":"2024-05-30T06:55:33.944188+0000","last_clean":"2024-05-30T06:55:33.944188+0000","last_became_active":"2024-05-30T06:55:33.937237+0000","last_became_peered":"2024-05-30T06:55:33.937237+0000","last_unstale":"2024-05-30T06:55:33.944188+0000","last_undegraded":"2024-05-30T06:55:33.944188+0000","last_fullsized":"2024-05-30T06:55:33.944188+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:28:14.731398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549913+0000","last_change":"2024-05-30T06:55:34.943989+0000","last_active":"2024-05-30T06:55:36.549913+0000","last_peered":"2024-05-30T06:55:36.549913+0000","last_clean":"2024-05-30T06:55:36.549913+0000","last_became_active":"2024-05-30T06:55:34.943713+0000","last_became_peered":"2024-05-30T06:55:34.943713+0000","last_unstale":"2024-05-30T06:55:36.549913+0000","last_undegraded":"2024-05-30T06:55:36.549913+0000","last_fullsized":"2024-05-30T06:55:36.549913+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:13.858335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.948182+0000","last_change":"2024-05-30T06:55:33.946863+0000","last_active":"2024-05-30T06:55:33.948182+0000","last_peered":"2024-05-30T06:55:33.948182+0000","last_clean":"2024-05-30T06:55:33.948182+0000","last_became_active":"2024-05-30T06:55:33.946359+0000","last_became_peered":"2024-05-30T06:55:33.946359+0000","last_unstale":"2024-05-30T06:55:33.948182+0000","last_undegraded":"2024-05-30T06:55:33.948182+0000","last_fullsized":"2024-05-30T06:55:33.948182+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:15:41.743545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.928813+0000","last_change":"2024-05-30T06:55:33.928813+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.928813+0000","last_undegraded":"2024-05-30T06:55:33.928813+0000","last_fullsized":"2024-05-30T06:55:33.928813+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.947913+0000","last_change":"2024-05-30T06:55:33.946627+0000","last_active":"2024-05-30T06:55:33.947913+0000","last_peered":"2024-05-30T06:55:33.947913+0000","last_clean":"2024-05-30T06:55:33.947913+0000","last_became_active":"2024-05-30T06:55:33.946211+0000","last_became_peered":"2024-05-30T06:55:33.946211+0000","last_unstale":"2024-05-30T06:55:33.947913+0000","last_undegraded":"2024-05-30T06:55:33.947913+0000","last_fullsized":"2024-05-30T06:55:33.947913+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:15:11.394270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925487+0000","last_change":"2024-05-30T06:55:33.925487+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925487+0000","last_undegraded":"2024-05-30T06:55:33.925487+0000","last_fullsized":"2024-05-30T06:55:33.925487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.938797+0000","last_change":"2024-05-30T06:55:33.935901+0000","last_active":"2024-05-30T06:55:33.938797+0000","last_peered":"2024-05-30T06:55:33.938797+0000","last_clean":"2024-05-30T06:55:33.938797+0000","last_became_active":"2024-05-30T06:55:33.935035+0000","last_became_peered":"2024-05-30T06:55:33.935035+0000","last_unstale":"2024-05-30T06:55:33.938797+0000","last_undegraded":"2024-05-30T06:55:33.938797+0000","last_fullsized":"2024-05-30T06:55:33.938797+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:08:49.286125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929341+0000","last_change":"2024-05-30T06:55:33.929341+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929341+0000","last_undegraded":"2024-05-30T06:55:33.929341+0000","last_fullsized":"2024-05-30T06:55:33.929341+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.942354+0000","last_change":"2024-05-30T06:55:33.935067+0000","last_active":"2024-05-30T06:55:33.942354+0000","last_peered":"2024-05-30T06:55:33.942354+0000","last_clean":"2024-05-30T06:55:33.942354+0000","last_became_active":"2024-05-30T06:55:33.934711+0000","last_became_peered":"2024-05-30T06:55:33.934711+0000","last_unstale":"2024-05-30T06:55:33.942354+0000","last_undegraded":"2024-05-30T06:55:33.942354+0000","last_fullsized":"2024-05-30T06:55:33.942354+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:42:09.909177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929541+0000","last_change":"2024-05-30T06:55:33.929541+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929541+0000","last_undegraded":"2024-05-30T06:55:33.929541+0000","last_fullsized":"2024-05-30T06:55:33.929541+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.951042+0000","last_change":"2024-05-30T06:55:33.950261+0000","last_active":"2024-05-30T06:55:33.951042+0000","last_peered":"2024-05-30T06:55:33.951042+0000","last_clean":"2024-05-30T06:55:33.951042+0000","last_became_active":"2024-05-30T06:55:33.949959+0000","last_became_peered":"2024-05-30T06:55:33.949959+0000","last_unstale":"2024-05-30T06:55:33.951042+0000","last_undegraded":"2024-05-30T06:55:33.951042+0000","last_fullsized":"2024-05-30T06:55:33.951042+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:43.463300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.926196+0000","last_change":"2024-05-30T06:55:33.926196+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.926196+0000","last_undegraded":"2024-05-30T06:55:33.926196+0000","last_fullsized":"2024-05-30T06:55:33.926196+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.940087+0000","last_change":"2024-05-30T06:55:33.935720+0000","last_active":"2024-05-30T06:55:33.940087+0000","last_peered":"2024-05-30T06:55:33.940087+0000","last_clean":"2024-05-30T06:55:33.940087+0000","last_became_active":"2024-05-30T06:55:33.935370+0000","last_became_peered":"2024-05-30T06:55:33.935370+0000","last_unstale":"2024-05-30T06:55:33.940087+0000","last_undegraded":"2024-05-30T06:55:33.940087+0000","last_fullsized":"2024-05-30T06:55:33.940087+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:20:26.023438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931966+0000","last_change":"2024-05-30T06:55:33.931966+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931966+0000","last_undegraded":"2024-05-30T06:55:33.931966+0000","last_fullsized":"2024-05-30T06:55:33.931966+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935412+0000","last_change":"2024-05-30T06:55:33.935564+0000","last_active":"2024-05-30T06:55:35.935412+0000","last_peered":"2024-05-30T06:55:35.935412+0000","last_clean":"2024-05-30T06:55:35.935412+0000","last_became_active":"2024-05-30T06:55:33.934422+0000","last_became_peered":"2024-05-30T06:55:33.934422+0000","last_unstale":"2024-05-30T06:55:35.935412+0000","last_undegraded":"2024-05-30T06:55:35.935412+0000","last_fullsized":"2024-05-30T06:55:35.935412+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:24:00.583740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930762+0000","last_change":"2024-05-30T06:55:33.930762+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930762+0000","last_undegraded":"2024-05-30T06:55:33.930762+0000","last_fullsized":"2024-05-30T06:55:33.930762+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935114+0000","last_change":"2024-05-30T06:55:33.944968+0000","last_active":"2024-05-30T06:55:35.935114+0000","last_peered":"2024-05-30T06:55:35.935114+0000","last_clean":"2024-05-30T06:55:35.935114+0000","last_became_active":"2024-05-30T06:55:33.944653+0000","last_became_peered":"2024-05-30T06:55:33.944653+0000","last_unstale":"2024-05-30T06:55:35.935114+0000","last_undegraded":"2024-05-30T06:55:35.935114+0000","last_fullsized":"2024-05-30T06:55:35.935114+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:56:24.913375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.934493+0000","last_change":"2024-05-30T06:55:33.934493+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.934493+0000","last_undegraded":"2024-05-30T06:55:33.934493+0000","last_fullsized":"2024-05-30T06:55:33.934493+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.940417+0000","last_change":"2024-05-30T06:55:33.939347+0000","last_active":"2024-05-30T06:55:33.940417+0000","last_peered":"2024-05-30T06:55:33.940417+0000","last_clean":"2024-05-30T06:55:33.940417+0000","last_became_active":"2024-05-30T06:55:33.939016+0000","last_became_peered":"2024-05-30T06:55:33.939016+0000","last_unstale":"2024-05-30T06:55:33.940417+0000","last_undegraded":"2024-05-30T06:55:33.940417+0000","last_fullsized":"2024-05-30T06:55:33.940417+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:58:13.201695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929615+0000","last_change":"2024-05-30T06:55:33.929615+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929615+0000","last_undegraded":"2024-05-30T06:55:33.929615+0000","last_fullsized":"2024-05-30T06:55:33.929615+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.938880+0000","last_change":"2024-05-30T06:55:33.937075+0000","last_active":"2024-05-30T06:55:33.938880+0000","last_peered":"2024-05-30T06:55:33.938880+0000","last_clean":"2024-05-30T06:55:33.938880+0000","last_became_active":"2024-05-30T06:55:33.936712+0000","last_became_peered":"2024-05-30T06:55:33.936712+0000","last_unstale":"2024-05-30T06:55:33.938880+0000","last_undegraded":"2024-05-30T06:55:33.938880+0000","last_fullsized":"2024-05-30T06:55:33.938880+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:11:50.696004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930522+0000","last_change":"2024-05-30T06:55:33.930522+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930522+0000","last_undegraded":"2024-05-30T06:55:33.930522+0000","last_fullsized":"2024-05-30T06:55:33.930522+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934677+0000","last_change":"2024-05-30T06:55:33.939978+0000","last_active":"2024-05-30T06:55:35.934677+0000","last_peered":"2024-05-30T06:55:35.934677+0000","last_clean":"2024-05-30T06:55:35.934677+0000","last_became_active":"2024-05-30T06:55:33.939661+0000","last_became_peered":"2024-05-30T06:55:33.939661+0000","last_unstale":"2024-05-30T06:55:35.934677+0000","last_undegraded":"2024-05-30T06:55:35.934677+0000","last_fullsized":"2024-05-30T06:55:35.934677+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:21:54.215474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935525+0000","last_change":"2024-05-30T06:55:34.947321+0000","last_active":"2024-05-30T06:55:35.935525+0000","last_peered":"2024-05-30T06:55:35.935525+0000","last_clean":"2024-05-30T06:55:35.935525+0000","last_became_active":"2024-05-30T06:55:34.947060+0000","last_became_peered":"2024-05-30T06:55:34.947060+0000","last_unstale":"2024-05-30T06:55:35.935525+0000","last_undegraded":"2024-05-30T06:55:35.935525+0000","last_fullsized":"2024-05-30T06:55:35.935525+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:54.211731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.939513+0000","last_change":"2024-05-30T06:55:33.937091+0000","last_active":"2024-05-30T06:55:33.939513+0000","last_peered":"2024-05-30T06:55:33.939513+0000","last_clean":"2024-05-30T06:55:33.939513+0000","last_became_active":"2024-05-30T06:55:33.936792+0000","last_became_peered":"2024-05-30T06:55:33.936792+0000","last_unstale":"2024-05-30T06:55:33.939513+0000","last_undegraded":"2024-05-30T06:55:33.939513+0000","last_fullsized":"2024-05-30T06:55:33.939513+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:48:21.768843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930529+0000","last_change":"2024-05-30T06:55:33.930529+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930529+0000","last_undegraded":"2024-05-30T06:55:33.930529+0000","last_fullsized":"2024-05-30T06:55:33.930529+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935606+0000","last_change":"2024-05-30T06:55:33.947953+0000","last_active":"2024-05-30T06:55:35.935606+0000","last_peered":"2024-05-30T06:55:35.935606+0000","last_clean":"2024-05-30T06:55:35.935606+0000","last_became_active":"2024-05-30T06:55:33.947682+0000","last_became_peered":"2024-05-30T06:55:33.947682+0000","last_unstale":"2024-05-30T06:55:35.935606+0000","last_undegraded":"2024-05-30T06:55:35.935606+0000","last_fullsized":"2024-05-30T06:55:35.935606+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:42.797019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930665+0000","last_change":"2024-05-30T06:55:33.930665+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930665+0000","last_undegraded":"2024-05-30T06:55:33.930665+0000","last_fullsized":"2024-05-30T06:55:33.930665+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935042+0000","last_change":"2024-05-30T06:55:33.942331+0000","last_active":"2024-05-30T06:55:35.935042+0000","last_peered":"2024-05-30T06:55:35.935042+0000","last_clean":"2024-05-30T06:55:35.935042+0000","last_became_active":"2024-05-30T06:55:33.942074+0000","last_became_peered":"2024-05-30T06:55:33.942074+0000","last_unstale":"2024-05-30T06:55:35.935042+0000","last_undegraded":"2024-05-30T06:55:35.935042+0000","last_fullsized":"2024-05-30T06:55:35.935042+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:28:44.612162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931236+0000","last_change":"2024-05-30T06:55:33.931236+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931236+0000","last_undegraded":"2024-05-30T06:55:33.931236+0000","last_fullsized":"2024-05-30T06:55:33.931236+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.942447+0000","last_change":"2024-05-30T06:55:33.938985+0000","last_active":"2024-05-30T06:55:33.942447+0000","last_peered":"2024-05-30T06:55:33.942447+0000","last_clean":"2024-05-30T06:55:33.942447+0000","last_became_active":"2024-05-30T06:55:33.938648+0000","last_became_peered":"2024-05-30T06:55:33.938648+0000","last_unstale":"2024-05-30T06:55:33.942447+0000","last_undegraded":"2024-05-30T06:55:33.942447+0000","last_fullsized":"2024-05-30T06:55:33.942447+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:34.836617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930350+0000","last_change":"2024-05-30T06:55:33.930350+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930350+0000","last_undegraded":"2024-05-30T06:55:33.930350+0000","last_fullsized":"2024-05-30T06:55:33.930350+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935203+0000","last_change":"2024-05-30T06:55:33.934159+0000","last_active":"2024-05-30T06:55:35.935203+0000","last_peered":"2024-05-30T06:55:35.935203+0000","last_clean":"2024-05-30T06:55:35.935203+0000","last_became_active":"2024-05-30T06:55:33.933841+0000","last_became_peered":"2024-05-30T06:55:33.933841+0000","last_unstale":"2024-05-30T06:55:35.935203+0000","last_undegraded":"2024-05-30T06:55:35.935203+0000","last_fullsized":"2024-05-30T06:55:35.935203+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:47:19.119777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.924820+0000","last_change":"2024-05-30T06:55:33.924820+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.924820+0000","last_undegraded":"2024-05-30T06:55:33.924820+0000","last_fullsized":"2024-05-30T06:55:33.924820+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.942413+0000","last_change":"2024-05-30T06:55:33.938260+0000","last_active":"2024-05-30T06:55:33.942413+0000","last_peered":"2024-05-30T06:55:33.942413+0000","last_clean":"2024-05-30T06:55:33.942413+0000","last_became_active":"2024-05-30T06:55:33.937992+0000","last_became_peered":"2024-05-30T06:55:33.937992+0000","last_unstale":"2024-05-30T06:55:33.942413+0000","last_undegraded":"2024-05-30T06:55:33.942413+0000","last_fullsized":"2024-05-30T06:55:33.942413+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:06:06.482391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929113+0000","last_change":"2024-05-30T06:55:33.929113+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929113+0000","last_undegraded":"2024-05-30T06:55:33.929113+0000","last_fullsized":"2024-05-30T06:55:33.929113+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549631+0000","last_change":"2024-05-30T06:55:33.937358+0000","last_active":"2024-05-30T06:55:36.549631+0000","last_peered":"2024-05-30T06:55:36.549631+0000","last_clean":"2024-05-30T06:55:36.549631+0000","last_became_active":"2024-05-30T06:55:33.937026+0000","last_became_peered":"2024-05-30T06:55:33.937026+0000","last_unstale":"2024-05-30T06:55:36.549631+0000","last_undegraded":"2024-05-30T06:55:36.549631+0000","last_fullsized":"2024-05-30T06:55:36.549631+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:14:56.877290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930033+0000","last_change":"2024-05-30T06:55:33.930033+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930033+0000","last_undegraded":"2024-05-30T06:55:33.930033+0000","last_fullsized":"2024-05-30T06:55:33.930033+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.946883+0000","last_change":"2024-05-30T06:55:33.944390+0000","last_active":"2024-05-30T06:55:33.946883+0000","last_peered":"2024-05-30T06:55:33.946883+0000","last_clean":"2024-05-30T06:55:33.946883+0000","last_became_active":"2024-05-30T06:55:33.943939+0000","last_became_peered":"2024-05-30T06:55:33.943939+0000","last_unstale":"2024-05-30T06:55:33.946883+0000","last_undegraded":"2024-05-30T06:55:33.946883+0000","last_fullsized":"2024-05-30T06:55:33.946883+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:29:56.235206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.937147+0000","last_change":"2024-05-30T06:55:33.937147+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.937147+0000","last_undegraded":"2024-05-30T06:55:33.937147+0000","last_fullsized":"2024-05-30T06:55:33.937147+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.943726+0000","last_change":"2024-05-30T06:55:33.942731+0000","last_active":"2024-05-30T06:55:33.943726+0000","last_peered":"2024-05-30T06:55:33.943726+0000","last_clean":"2024-05-30T06:55:33.943726+0000","last_became_active":"2024-05-30T06:55:33.942215+0000","last_became_peered":"2024-05-30T06:55:33.942215+0000","last_unstale":"2024-05-30T06:55:33.943726+0000","last_undegraded":"2024-05-30T06:55:33.943726+0000","last_fullsized":"2024-05-30T06:55:33.943726+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:42.797019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":323,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.934723+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:55:33.934723+0000","last_peered":"2024-05-30T06:55:33.934723+0000","last_clean":"2024-05-30T06:55:33.934723+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:55:33.934723+0000","last_undegraded":"2024-05-30T06:55:33.934723+0000","last_fullsized":"2024-05-30T06:55:33.934723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123156,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248684,"statfs":{"total":96636764160,"available":96510652416,"internally_reserved":0,"allocated":1830912,"data_stored":1127129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575015,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122552,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249288,"statfs":{"total":96636764160,"available":96511270912,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575015,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76728,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295112,"statfs":{"total":96636764160,"available":96558194688,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575014,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64264,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94307576,"statfs":{"total":96636764160,"available":96570957824,"internally_reserved":0,"allocated":1236992,"data_stored":536761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140656,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231184,"statfs":{"total":96636764160,"available":96492732416,"internally_reserved":0,"allocated":1277952,"data_stored":551526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":142735815},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575013,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140600,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231240,"statfs":{"total":96636764160,"available":96492789760,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575015,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104504,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94267336,"statfs":{"total":96636764160,"available":96529752064,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575016,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77348,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294492,"statfs":{"total":96636764160,"available":96557559808,"internally_reserved":0,"allocated":1859584,"data_stored":1140842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:55:39.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:55:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c72400640 1 Processor -- start 2024-05-30T06:55:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c72400640 1 -- start start 2024-05-30T06:55:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c72400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c6c0cd590 0x7f3c6c0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c72400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c6c06bf20 con 0x7f3c6c15e9b0 2024-05-30T06:55:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c72400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c6c06c200 con 0x7f3c6c0cba70 2024-05-30T06:55:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c72400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3c6c0b0a50 con 0x7f3c6c0cd590 2024-05-30T06:55:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c71000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3c6c15e9b0 0x7f3c6c0d06b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47400/0 (socket says 172.21.15.37:47400) 2024-05-30T06:55:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c71000640 1 -- 172.21.15.37:0/2931978108 learned_addr learned my addr 172.21.15.37:0/2931978108 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c71a00640 1 --2- 172.21.15.37:0/2931978108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c6c0cd590 0x7f3c6c0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1736339319 0 0) 0x7f3c6c06bf20 con 0x7f3c6c15e9b0 2024-05-30T06:55:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c50003530 con 0x7f3c6c15e9b0 2024-05-30T06:55:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 797290689 0 0) 0x7f3c50003530 con 0x7f3c6c15e9b0 2024-05-30T06:55:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c6c0cd590 msgr2=0x7f3c6c0b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 --2- 172.21.15.37:0/2931978108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c6c0cd590 0x7f3c6c0b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 >> v1:172.21.15.105:6789/0 conn(0x7f3c6c0cba70 legacy=0x7f3c6c0b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c06c4e0 con 0x7f3c6c15e9b0 2024-05-30T06:55:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f3c5c001680 con 0x7f3c6c15e9b0 2024-05-30T06:55:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 >> v1:172.21.15.37:6789/0 conn(0x7f3c6c15e9b0 legacy=0x7f3c6c0d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 --2- 172.21.15.37:0/2931978108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c500039f0 0x7f3c50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 --2- 172.21.15.37:0/2931978108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c6c0cd590 0x7f3c50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 --2- 172.21.15.37:0/2931978108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c50004d50 0x7f3c500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c0b0a50 con 0x7f3c50004d50 2024-05-30T06:55:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5000b9d0 con 0x7f3c500039f0 2024-05-30T06:55:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.233+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3c5000bbd0 con 0x7f3c6c0cd590 2024-05-30T06:55:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c71a00640 1 --2- 172.21.15.37:0/2931978108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c50004d50 0x7f3c500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c63e00640 1 --2- 172.21.15.37:0/2931978108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c6c0cd590 0x7f3c50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c71000640 1 --2- 172.21.15.37:0/2931978108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c500039f0 0x7f3c50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c71a00640 1 -- 172.21.15.37:0/2931978108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c6c0cd590 msgr2=0x7f3c50004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c71a00640 1 --2- 172.21.15.37:0/2931978108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c6c0cd590 0x7f3c50004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c71a00640 1 -- 172.21.15.37:0/2931978108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c500039f0 msgr2=0x7f3c50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c71a00640 1 --2- 172.21.15.37:0/2931978108 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c500039f0 0x7f3c50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c71a00640 1 -- 172.21.15.37:0/2931978108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c50003530 con 0x7f3c50004d50 2024-05-30T06:55:39.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c71a00640 1 --2- 172.21.15.37:0/2931978108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c50004d50 0x7f3c500051d0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009fc0 tx=0x7f3c6401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae81ab314c189100 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c640b2070 con 0x7f3c50004d50 2024-05-30T06:55:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c640a5c90 con 0x7f3c50004d50 2024-05-30T06:55:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c6be00640 1 -- 172.21.15.37:0/2931978108 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c64009c10 con 0x7f3c50004d50 2024-05-30T06:55:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c72400640 1 -- 172.21.15.37:0/2931978108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c50004d50 msgr2=0x7f3c500051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c72400640 1 --2- 172.21.15.37:0/2931978108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c50004d50 0x7f3c500051d0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009fc0 tx=0x7f3c6401cc80 comp rx=0 tx=0).stop 2024-05-30T06:55:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.237+0000 7f3c71a00640 1 -- 172.21.15.37:0/2931978108 reap_dead start 2024-05-30T06:55:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c72400640 1 -- 172.21.15.37:0/2931978108 shutdown_connections 2024-05-30T06:55:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c72400640 1 -- 172.21.15.37:0/2931978108 >> 172.21.15.37:0/2931978108 conn(0x7f3c6c09aa60 msgr2=0x7f3c6c0b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c72400640 1 -- 172.21.15.37:0/2931978108 shutdown_connections 2024-05-30T06:55:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c72400640 1 -- 172.21.15.37:0/2931978108 wait complete. 2024-05-30T06:55:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c72400640 1 Processor -- start 2024-05-30T06:55:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c72400640 1 -- start start 2024-05-30T06:55:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c72400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c50004d50 0x7f3c6c149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c72400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c6c148f50 0x7f3c6c0b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c72400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c6c1493d0 0x7f3c6c0b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c72400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c0cf0d0 con 0x7f3c6c148f50 2024-05-30T06:55:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c72400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c15ed90 con 0x7f3c6c1493d0 2024-05-30T06:55:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c72400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3c6c0d0dc0 con 0x7f3c50004d50 2024-05-30T06:55:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c63e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c6c148f50 0x7f3c6c0b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c63e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c6c148f50 0x7f3c6c0b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45048/0 (socket says 172.21.15.37:45048) 2024-05-30T06:55:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c63e00640 1 -- 172.21.15.37:0/4025326616 learned_addr learned my addr 172.21.15.37:0/4025326616 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c71a00640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c6c1493d0 0x7f3c6c0b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c71000640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c50004d50 0x7f3c6c149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c63e00640 1 -- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c50004d50 msgr2=0x7f3c6c149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c63e00640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c50004d50 0x7f3c6c149980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c63e00640 1 -- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c6c1493d0 msgr2=0x7f3c6c0b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c63e00640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c6c1493d0 0x7f3c6c0b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c63e00640 1 -- 172.21.15.37:0/4025326616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c158d50 con 0x7f3c6c148f50 2024-05-30T06:55:39.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c71a00640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c6c1493d0 0x7f3c6c0b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:39.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c63e00640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c6c148f50 0x7f3c6c0b4060 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400f770 tx=0x7f3c5400fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c69600640 1 -- 172.21.15.37:0/4025326616 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400fe80 con 0x7f3c6c148f50 2024-05-30T06:55:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c69600640 1 -- 172.21.15.37:0/4025326616 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c54018070 con 0x7f3c6c148f50 2024-05-30T06:55:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.241+0000 7f3c69600640 1 -- 172.21.15.37:0/4025326616 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400d730 con 0x7f3c6c148f50 2024-05-30T06:55:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.245+0000 7f3c72400640 1 -- 172.21.15.37:0/4025326616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c6c14c900 con 0x7f3c6c148f50 2024-05-30T06:55:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.245+0000 7f3c72400640 1 -- 172.21.15.37:0/4025326616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c6c1602e0 con 0x7f3c6c148f50 2024-05-30T06:55:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.245+0000 7f3c72400640 1 -- 172.21.15.37:0/4025326616 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c6c068ab0 con 0x7f3c6c148f50 2024-05-30T06:55:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.245+0000 7f3c69600640 1 -- 172.21.15.37:0/4025326616 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f3c5400d8d0 con 0x7f3c6c148f50 2024-05-30T06:55:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.245+0000 7f3c69600640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3c480698e0 0x7f3c4806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.245+0000 7f3c69600640 1 -- 172.21.15.37:0/4025326616 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f3c54085a80 con 0x7f3c6c148f50 2024-05-30T06:55:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.245+0000 7f3c71000640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3c480698e0 0x7f3c4806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:39.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.249+0000 7f3c71000640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3c480698e0 0x7f3c4806bda0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0b16a0 tx=0x7f3c5c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:39.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.249+0000 7f3c69600640 1 -- 172.21.15.37:0/4025326616 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3c54057690 con 0x7f3c6c148f50 2024-05-30T06:55:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.417+0000 7f3c72400640 1 -- 172.21.15.37:0/4025326616 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3c6c06c830 con 0x7f3c480698e0 2024-05-30T06:55:39.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.425+0000 7f3c69600640 1 -- 172.21.15.37:0/4025326616 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248491 (secure 0 0 0) 0x7f3c6c06c830 con 0x7f3c480698e0 2024-05-30T06:55:39.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:39.429 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:55:39.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.425+0000 7f3c72400640 1 -- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3c480698e0 msgr2=0x7f3c4806bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.425+0000 7f3c72400640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3c480698e0 0x7f3c4806bda0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c0b16a0 tx=0x7f3c5c009040 comp rx=0 tx=0).stop 2024-05-30T06:55:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.425+0000 7f3c72400640 1 -- 172.21.15.37:0/4025326616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c6c148f50 msgr2=0x7f3c6c0b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.425+0000 7f3c72400640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c6c148f50 0x7f3c6c0b4060 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400f770 tx=0x7f3c5400fc30 comp rx=0 tx=0).stop 2024-05-30T06:55:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.425+0000 7f3c72400640 1 -- 172.21.15.37:0/4025326616 shutdown_connections 2024-05-30T06:55:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.425+0000 7f3c72400640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3c480698e0 0x7f3c4806bda0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.425+0000 7f3c72400640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c6c1493d0 0x7f3c6c0b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.425+0000 7f3c72400640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c6c148f50 0x7f3c6c0b4060 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.425+0000 7f3c72400640 1 --2- 172.21.15.37:0/4025326616 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c50004d50 0x7f3c6c149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.425+0000 7f3c72400640 1 -- 172.21.15.37:0/4025326616 >> 172.21.15.37:0/4025326616 conn(0x7f3c6c09aa60 msgr2=0x7f3c6c06fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.425+0000 7f3c72400640 1 -- 172.21.15.37:0/4025326616 shutdown_connections 2024-05-30T06:55:39.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.425+0000 7f3c72400640 1 -- 172.21.15.37:0/4025326616 wait complete. 2024-05-30T06:55:39.449 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":505,"stamp":"2024-05-30T06:55:38.943423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":849808,"kb_used_data":10844,"kb_used_omap":12,"kb_used_meta":838835,"kb_avail":754124912,"statfs":{"total":773094113280,"available":772223909888,"internally_reserved":0,"allocated":11104256,"data_stored":5478090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":858967600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001565"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931039+0000","last_change":"2024-05-30T06:55:33.931039+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931039+0000","last_undegraded":"2024-05-30T06:55:33.931039+0000","last_fullsized":"2024-05-30T06:55:33.931039+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935371+0000","last_change":"2024-05-30T06:55:34.955973+0000","last_active":"2024-05-30T06:55:35.935371+0000","last_peered":"2024-05-30T06:55:35.935371+0000","last_clean":"2024-05-30T06:55:35.935371+0000","last_became_active":"2024-05-30T06:55:34.955604+0000","last_became_peered":"2024-05-30T06:55:34.955604+0000","last_unstale":"2024-05-30T06:55:35.935371+0000","last_undegraded":"2024-05-30T06:55:35.935371+0000","last_fullsized":"2024-05-30T06:55:35.935371+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:13.858335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929293+0000","last_change":"2024-05-30T06:55:33.929293+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929293+0000","last_undegraded":"2024-05-30T06:55:33.929293+0000","last_fullsized":"2024-05-30T06:55:33.929293+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550531+0000","last_change":"2024-05-30T06:55:34.945824+0000","last_active":"2024-05-30T06:55:36.550531+0000","last_peered":"2024-05-30T06:55:36.550531+0000","last_clean":"2024-05-30T06:55:36.550531+0000","last_became_active":"2024-05-30T06:55:34.944885+0000","last_became_peered":"2024-05-30T06:55:34.944885+0000","last_unstale":"2024-05-30T06:55:36.550531+0000","last_undegraded":"2024-05-30T06:55:36.550531+0000","last_fullsized":"2024-05-30T06:55:36.550531+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:39.774985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929953+0000","last_change":"2024-05-30T06:55:33.929953+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929953+0000","last_undegraded":"2024-05-30T06:55:33.929953+0000","last_fullsized":"2024-05-30T06:55:33.929953+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.932061+0000","last_change":"2024-05-30T06:55:33.932061+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.932061+0000","last_undegraded":"2024-05-30T06:55:33.932061+0000","last_fullsized":"2024-05-30T06:55:33.932061+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931628+0000","last_change":"2024-05-30T06:55:33.931628+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931628+0000","last_undegraded":"2024-05-30T06:55:33.931628+0000","last_fullsized":"2024-05-30T06:55:33.931628+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934796+0000","last_change":"2024-05-30T06:55:34.952580+0000","last_active":"2024-05-30T06:55:35.934796+0000","last_peered":"2024-05-30T06:55:35.934796+0000","last_clean":"2024-05-30T06:55:35.934796+0000","last_became_active":"2024-05-30T06:55:34.952313+0000","last_became_peered":"2024-05-30T06:55:34.952313+0000","last_unstale":"2024-05-30T06:55:35.934796+0000","last_undegraded":"2024-05-30T06:55:35.934796+0000","last_fullsized":"2024-05-30T06:55:35.934796+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:54:03.363077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.927115+0000","last_change":"2024-05-30T06:55:33.927115+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.927115+0000","last_undegraded":"2024-05-30T06:55:33.927115+0000","last_fullsized":"2024-05-30T06:55:33.927115+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931449+0000","last_change":"2024-05-30T06:55:33.931449+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931449+0000","last_undegraded":"2024-05-30T06:55:33.931449+0000","last_fullsized":"2024-05-30T06:55:33.931449+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.935677+0000","last_change":"2024-05-30T06:55:33.935677+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.935677+0000","last_undegraded":"2024-05-30T06:55:33.935677+0000","last_fullsized":"2024-05-30T06:55:33.935677+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.927552+0000","last_change":"2024-05-30T06:55:33.927552+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.927552+0000","last_undegraded":"2024-05-30T06:55:33.927552+0000","last_fullsized":"2024-05-30T06:55:33.927552+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550365+0000","last_change":"2024-05-30T06:55:34.952578+0000","last_active":"2024-05-30T06:55:36.550365+0000","last_peered":"2024-05-30T06:55:36.550365+0000","last_clean":"2024-05-30T06:55:36.550365+0000","last_became_active":"2024-05-30T06:55:34.952237+0000","last_became_peered":"2024-05-30T06:55:34.952237+0000","last_unstale":"2024-05-30T06:55:36.550365+0000","last_undegraded":"2024-05-30T06:55:36.550365+0000","last_fullsized":"2024-05-30T06:55:36.550365+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:54.211731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.939233+0000","last_change":"2024-05-30T06:55:33.939233+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.939233+0000","last_undegraded":"2024-05-30T06:55:33.939233+0000","last_fullsized":"2024-05-30T06:55:33.939233+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549571+0000","last_change":"2024-05-30T06:55:34.948290+0000","last_active":"2024-05-30T06:55:36.549571+0000","last_peered":"2024-05-30T06:55:36.549571+0000","last_clean":"2024-05-30T06:55:36.549571+0000","last_became_active":"2024-05-30T06:55:34.947764+0000","last_became_peered":"2024-05-30T06:55:34.947764+0000","last_unstale":"2024-05-30T06:55:36.549571+0000","last_undegraded":"2024-05-30T06:55:36.549571+0000","last_fullsized":"2024-05-30T06:55:36.549571+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:12:13.556946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931145+0000","last_change":"2024-05-30T06:55:33.931145+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931145+0000","last_undegraded":"2024-05-30T06:55:33.931145+0000","last_fullsized":"2024-05-30T06:55:33.931145+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935244+0000","last_change":"2024-05-30T06:55:34.948066+0000","last_active":"2024-05-30T06:55:35.935244+0000","last_peered":"2024-05-30T06:55:35.935244+0000","last_clean":"2024-05-30T06:55:35.935244+0000","last_became_active":"2024-05-30T06:55:34.947836+0000","last_became_peered":"2024-05-30T06:55:34.947836+0000","last_unstale":"2024-05-30T06:55:35.935244+0000","last_undegraded":"2024-05-30T06:55:35.935244+0000","last_fullsized":"2024-05-30T06:55:35.935244+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:56:43.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550353+0000","last_change":"2024-05-30T06:55:34.933997+0000","last_active":"2024-05-30T06:55:36.550353+0000","last_peered":"2024-05-30T06:55:36.550353+0000","last_clean":"2024-05-30T06:55:36.550353+0000","last_became_active":"2024-05-30T06:55:34.933752+0000","last_became_peered":"2024-05-30T06:55:34.933752+0000","last_unstale":"2024-05-30T06:55:36.550353+0000","last_undegraded":"2024-05-30T06:55:36.550353+0000","last_fullsized":"2024-05-30T06:55:36.550353+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:55.380184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.936017+0000","last_change":"2024-05-30T06:55:33.936017+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.936017+0000","last_undegraded":"2024-05-30T06:55:33.936017+0000","last_fullsized":"2024-05-30T06:55:33.936017+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925212+0000","last_change":"2024-05-30T06:55:33.925212+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925212+0000","last_undegraded":"2024-05-30T06:55:33.925212+0000","last_fullsized":"2024-05-30T06:55:33.925212+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.934914+0000","last_change":"2024-05-30T06:55:33.934914+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.934914+0000","last_undegraded":"2024-05-30T06:55:33.934914+0000","last_fullsized":"2024-05-30T06:55:33.934914+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934743+0000","last_change":"2024-05-30T06:55:34.948942+0000","last_active":"2024-05-30T06:55:35.934743+0000","last_peered":"2024-05-30T06:55:35.934743+0000","last_clean":"2024-05-30T06:55:35.934743+0000","last_became_active":"2024-05-30T06:55:34.948665+0000","last_became_peered":"2024-05-30T06:55:34.948665+0000","last_unstale":"2024-05-30T06:55:35.934743+0000","last_undegraded":"2024-05-30T06:55:35.934743+0000","last_fullsized":"2024-05-30T06:55:35.934743+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:19:24.696303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934808+0000","last_change":"2024-05-30T06:55:34.948065+0000","last_active":"2024-05-30T06:55:35.934808+0000","last_peered":"2024-05-30T06:55:35.934808+0000","last_clean":"2024-05-30T06:55:35.934808+0000","last_became_active":"2024-05-30T06:55:34.947811+0000","last_became_peered":"2024-05-30T06:55:34.947811+0000","last_unstale":"2024-05-30T06:55:35.934808+0000","last_undegraded":"2024-05-30T06:55:35.934808+0000","last_fullsized":"2024-05-30T06:55:35.934808+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:03:57.480410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930690+0000","last_change":"2024-05-30T06:55:33.930690+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930690+0000","last_undegraded":"2024-05-30T06:55:33.930690+0000","last_fullsized":"2024-05-30T06:55:33.930690+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.933468+0000","last_change":"2024-05-30T06:55:33.933468+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.933468+0000","last_undegraded":"2024-05-30T06:55:33.933468+0000","last_fullsized":"2024-05-30T06:55:33.933468+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935399+0000","last_change":"2024-05-30T06:55:34.957056+0000","last_active":"2024-05-30T06:55:35.935399+0000","last_peered":"2024-05-30T06:55:35.935399+0000","last_clean":"2024-05-30T06:55:35.935399+0000","last_became_active":"2024-05-30T06:55:34.956742+0000","last_became_peered":"2024-05-30T06:55:34.956742+0000","last_unstale":"2024-05-30T06:55:35.935399+0000","last_undegraded":"2024-05-30T06:55:35.935399+0000","last_fullsized":"2024-05-30T06:55:35.935399+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:55.380184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.935235+0000","last_change":"2024-05-30T06:55:33.935235+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.935235+0000","last_undegraded":"2024-05-30T06:55:33.935235+0000","last_fullsized":"2024-05-30T06:55:33.935235+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930851+0000","last_change":"2024-05-30T06:55:33.930851+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930851+0000","last_undegraded":"2024-05-30T06:55:33.930851+0000","last_fullsized":"2024-05-30T06:55:33.930851+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935062+0000","last_change":"2024-05-30T06:55:34.956501+0000","last_active":"2024-05-30T06:55:35.935062+0000","last_peered":"2024-05-30T06:55:35.935062+0000","last_clean":"2024-05-30T06:55:35.935062+0000","last_became_active":"2024-05-30T06:55:34.956081+0000","last_became_peered":"2024-05-30T06:55:34.956081+0000","last_unstale":"2024-05-30T06:55:35.935062+0000","last_undegraded":"2024-05-30T06:55:35.935062+0000","last_fullsized":"2024-05-30T06:55:35.935062+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:12:13.556946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931295+0000","last_change":"2024-05-30T06:55:33.931295+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931295+0000","last_undegraded":"2024-05-30T06:55:33.931295+0000","last_fullsized":"2024-05-30T06:55:33.931295+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549664+0000","last_change":"2024-05-30T06:55:34.932722+0000","last_active":"2024-05-30T06:55:36.549664+0000","last_peered":"2024-05-30T06:55:36.549664+0000","last_clean":"2024-05-30T06:55:36.549664+0000","last_became_active":"2024-05-30T06:55:34.932454+0000","last_became_peered":"2024-05-30T06:55:34.932454+0000","last_unstale":"2024-05-30T06:55:36.549664+0000","last_undegraded":"2024-05-30T06:55:36.549664+0000","last_fullsized":"2024-05-30T06:55:36.549664+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:56:43.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.927240+0000","last_change":"2024-05-30T06:55:33.927240+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.927240+0000","last_undegraded":"2024-05-30T06:55:33.927240+0000","last_fullsized":"2024-05-30T06:55:33.927240+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.937565+0000","last_change":"2024-05-30T06:55:33.937565+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.937565+0000","last_undegraded":"2024-05-30T06:55:33.937565+0000","last_fullsized":"2024-05-30T06:55:33.937565+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"101'4","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935297+0000","last_change":"2024-05-30T06:55:33.941005+0000","last_active":"2024-05-30T06:55:35.935297+0000","last_peered":"2024-05-30T06:55:35.935297+0000","last_clean":"2024-05-30T06:55:35.935297+0000","last_became_active":"2024-05-30T06:55:33.940750+0000","last_became_peered":"2024-05-30T06:55:33.940750+0000","last_unstale":"2024-05-30T06:55:35.935297+0000","last_undegraded":"2024-05-30T06:55:35.935297+0000","last_fullsized":"2024-05-30T06:55:35.935297+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:30:31.861812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550787+0000","last_change":"2024-05-30T06:55:34.934593+0000","last_active":"2024-05-30T06:55:36.550787+0000","last_peered":"2024-05-30T06:55:36.550787+0000","last_clean":"2024-05-30T06:55:36.550787+0000","last_became_active":"2024-05-30T06:55:34.934338+0000","last_became_peered":"2024-05-30T06:55:34.934338+0000","last_unstale":"2024-05-30T06:55:36.550787+0000","last_undegraded":"2024-05-30T06:55:36.550787+0000","last_fullsized":"2024-05-30T06:55:36.550787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:45:12.188368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.947247+0000","last_change":"2024-05-30T06:55:33.946654+0000","last_active":"2024-05-30T06:55:33.947247+0000","last_peered":"2024-05-30T06:55:33.947247+0000","last_clean":"2024-05-30T06:55:33.947247+0000","last_became_active":"2024-05-30T06:55:33.946353+0000","last_became_peered":"2024-05-30T06:55:33.946353+0000","last_unstale":"2024-05-30T06:55:33.947247+0000","last_undegraded":"2024-05-30T06:55:33.947247+0000","last_fullsized":"2024-05-30T06:55:33.947247+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:48:56.773319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931138+0000","last_change":"2024-05-30T06:55:33.931138+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931138+0000","last_undegraded":"2024-05-30T06:55:33.931138+0000","last_fullsized":"2024-05-30T06:55:33.931138+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934937+0000","last_change":"2024-05-30T06:55:33.948635+0000","last_active":"2024-05-30T06:55:35.934937+0000","last_peered":"2024-05-30T06:55:35.934937+0000","last_clean":"2024-05-30T06:55:35.934937+0000","last_became_active":"2024-05-30T06:55:33.948243+0000","last_became_peered":"2024-05-30T06:55:33.948243+0000","last_unstale":"2024-05-30T06:55:35.934937+0000","last_undegraded":"2024-05-30T06:55:35.934937+0000","last_fullsized":"2024-05-30T06:55:35.934937+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:05:45.736094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.926112+0000","last_change":"2024-05-30T06:55:33.926112+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.926112+0000","last_undegraded":"2024-05-30T06:55:33.926112+0000","last_fullsized":"2024-05-30T06:55:33.926112+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935315+0000","last_change":"2024-05-30T06:55:33.943667+0000","last_active":"2024-05-30T06:55:35.935315+0000","last_peered":"2024-05-30T06:55:35.935315+0000","last_clean":"2024-05-30T06:55:35.935315+0000","last_became_active":"2024-05-30T06:55:33.943405+0000","last_became_peered":"2024-05-30T06:55:33.943405+0000","last_unstale":"2024-05-30T06:55:35.935315+0000","last_undegraded":"2024-05-30T06:55:35.935315+0000","last_fullsized":"2024-05-30T06:55:35.935315+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:51.073112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925670+0000","last_change":"2024-05-30T06:55:33.925670+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925670+0000","last_undegraded":"2024-05-30T06:55:33.925670+0000","last_fullsized":"2024-05-30T06:55:33.925670+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.946645+0000","last_change":"2024-05-30T06:55:33.945265+0000","last_active":"2024-05-30T06:55:33.946645+0000","last_peered":"2024-05-30T06:55:33.946645+0000","last_clean":"2024-05-30T06:55:33.946645+0000","last_became_active":"2024-05-30T06:55:33.944980+0000","last_became_peered":"2024-05-30T06:55:33.944980+0000","last_unstale":"2024-05-30T06:55:33.946645+0000","last_undegraded":"2024-05-30T06:55:33.946645+0000","last_fullsized":"2024-05-30T06:55:33.946645+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:46:40.089247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.932666+0000","last_change":"2024-05-30T06:55:33.932666+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.932666+0000","last_undegraded":"2024-05-30T06:55:33.932666+0000","last_fullsized":"2024-05-30T06:55:33.932666+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934832+0000","last_change":"2024-05-30T06:55:33.937498+0000","last_active":"2024-05-30T06:55:35.934832+0000","last_peered":"2024-05-30T06:55:35.934832+0000","last_clean":"2024-05-30T06:55:35.934832+0000","last_became_active":"2024-05-30T06:55:33.937250+0000","last_became_peered":"2024-05-30T06:55:33.937250+0000","last_unstale":"2024-05-30T06:55:35.934832+0000","last_undegraded":"2024-05-30T06:55:35.934832+0000","last_fullsized":"2024-05-30T06:55:35.934832+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:05:08.736546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549551+0000","last_change":"2024-05-30T06:55:34.946842+0000","last_active":"2024-05-30T06:55:36.549551+0000","last_peered":"2024-05-30T06:55:36.549551+0000","last_clean":"2024-05-30T06:55:36.549551+0000","last_became_active":"2024-05-30T06:55:34.946578+0000","last_became_peered":"2024-05-30T06:55:34.946578+0000","last_unstale":"2024-05-30T06:55:36.549551+0000","last_undegraded":"2024-05-30T06:55:36.549551+0000","last_fullsized":"2024-05-30T06:55:36.549551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:03:57.480410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.944529+0000","last_change":"2024-05-30T06:55:33.943949+0000","last_active":"2024-05-30T06:55:33.944529+0000","last_peered":"2024-05-30T06:55:33.944529+0000","last_clean":"2024-05-30T06:55:33.944529+0000","last_became_active":"2024-05-30T06:55:33.943656+0000","last_became_peered":"2024-05-30T06:55:33.943656+0000","last_unstale":"2024-05-30T06:55:33.944529+0000","last_undegraded":"2024-05-30T06:55:33.944529+0000","last_fullsized":"2024-05-30T06:55:33.944529+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:11:33.204524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925203+0000","last_change":"2024-05-30T06:55:33.925203+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925203+0000","last_undegraded":"2024-05-30T06:55:33.925203+0000","last_fullsized":"2024-05-30T06:55:33.925203+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.945545+0000","last_change":"2024-05-30T06:55:33.942310+0000","last_active":"2024-05-30T06:55:33.945545+0000","last_peered":"2024-05-30T06:55:33.945545+0000","last_clean":"2024-05-30T06:55:33.945545+0000","last_became_active":"2024-05-30T06:55:33.941865+0000","last_became_peered":"2024-05-30T06:55:33.941865+0000","last_unstale":"2024-05-30T06:55:33.945545+0000","last_undegraded":"2024-05-30T06:55:33.945545+0000","last_fullsized":"2024-05-30T06:55:33.945545+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:44:21.582491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935529+0000","last_change":"2024-05-30T06:55:34.945420+0000","last_active":"2024-05-30T06:55:35.935529+0000","last_peered":"2024-05-30T06:55:35.935529+0000","last_clean":"2024-05-30T06:55:35.935529+0000","last_became_active":"2024-05-30T06:55:34.945163+0000","last_became_peered":"2024-05-30T06:55:34.945163+0000","last_unstale":"2024-05-30T06:55:35.935529+0000","last_undegraded":"2024-05-30T06:55:35.935529+0000","last_fullsized":"2024-05-30T06:55:35.935529+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:39.774985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.944347+0000","last_change":"2024-05-30T06:55:33.939208+0000","last_active":"2024-05-30T06:55:33.944347+0000","last_peered":"2024-05-30T06:55:33.944347+0000","last_clean":"2024-05-30T06:55:33.944347+0000","last_became_active":"2024-05-30T06:55:33.938920+0000","last_became_peered":"2024-05-30T06:55:33.938920+0000","last_unstale":"2024-05-30T06:55:33.944347+0000","last_undegraded":"2024-05-30T06:55:33.944347+0000","last_fullsized":"2024-05-30T06:55:33.944347+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:43:58.244250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.926683+0000","last_change":"2024-05-30T06:55:33.926683+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.926683+0000","last_undegraded":"2024-05-30T06:55:33.926683+0000","last_fullsized":"2024-05-30T06:55:33.926683+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550488+0000","last_change":"2024-05-30T06:55:33.941180+0000","last_active":"2024-05-30T06:55:36.550488+0000","last_peered":"2024-05-30T06:55:36.550488+0000","last_clean":"2024-05-30T06:55:36.550488+0000","last_became_active":"2024-05-30T06:55:33.940874+0000","last_became_peered":"2024-05-30T06:55:33.940874+0000","last_unstale":"2024-05-30T06:55:36.550488+0000","last_undegraded":"2024-05-30T06:55:36.550488+0000","last_fullsized":"2024-05-30T06:55:36.550488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:34:52.834290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930355+0000","last_change":"2024-05-30T06:55:33.930355+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930355+0000","last_undegraded":"2024-05-30T06:55:33.930355+0000","last_fullsized":"2024-05-30T06:55:33.930355+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.946279+0000","last_change":"2024-05-30T06:55:33.945685+0000","last_active":"2024-05-30T06:55:33.946279+0000","last_peered":"2024-05-30T06:55:33.946279+0000","last_clean":"2024-05-30T06:55:33.946279+0000","last_became_active":"2024-05-30T06:55:33.945289+0000","last_became_peered":"2024-05-30T06:55:33.945289+0000","last_unstale":"2024-05-30T06:55:33.946279+0000","last_undegraded":"2024-05-30T06:55:33.946279+0000","last_fullsized":"2024-05-30T06:55:33.946279+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:30:31.861812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.934821+0000","last_change":"2024-05-30T06:55:33.934821+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.934821+0000","last_undegraded":"2024-05-30T06:55:33.934821+0000","last_fullsized":"2024-05-30T06:55:33.934821+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.944188+0000","last_change":"2024-05-30T06:55:33.937604+0000","last_active":"2024-05-30T06:55:33.944188+0000","last_peered":"2024-05-30T06:55:33.944188+0000","last_clean":"2024-05-30T06:55:33.944188+0000","last_became_active":"2024-05-30T06:55:33.937237+0000","last_became_peered":"2024-05-30T06:55:33.937237+0000","last_unstale":"2024-05-30T06:55:33.944188+0000","last_undegraded":"2024-05-30T06:55:33.944188+0000","last_fullsized":"2024-05-30T06:55:33.944188+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:28:14.731398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549913+0000","last_change":"2024-05-30T06:55:34.943989+0000","last_active":"2024-05-30T06:55:36.549913+0000","last_peered":"2024-05-30T06:55:36.549913+0000","last_clean":"2024-05-30T06:55:36.549913+0000","last_became_active":"2024-05-30T06:55:34.943713+0000","last_became_peered":"2024-05-30T06:55:34.943713+0000","last_unstale":"2024-05-30T06:55:36.549913+0000","last_undegraded":"2024-05-30T06:55:36.549913+0000","last_fullsized":"2024-05-30T06:55:36.549913+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:13.858335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.948182+0000","last_change":"2024-05-30T06:55:33.946863+0000","last_active":"2024-05-30T06:55:33.948182+0000","last_peered":"2024-05-30T06:55:33.948182+0000","last_clean":"2024-05-30T06:55:33.948182+0000","last_became_active":"2024-05-30T06:55:33.946359+0000","last_became_peered":"2024-05-30T06:55:33.946359+0000","last_unstale":"2024-05-30T06:55:33.948182+0000","last_undegraded":"2024-05-30T06:55:33.948182+0000","last_fullsized":"2024-05-30T06:55:33.948182+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:15:41.743545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.928813+0000","last_change":"2024-05-30T06:55:33.928813+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.928813+0000","last_undegraded":"2024-05-30T06:55:33.928813+0000","last_fullsized":"2024-05-30T06:55:33.928813+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.947913+0000","last_change":"2024-05-30T06:55:33.946627+0000","last_active":"2024-05-30T06:55:33.947913+0000","last_peered":"2024-05-30T06:55:33.947913+0000","last_clean":"2024-05-30T06:55:33.947913+0000","last_became_active":"2024-05-30T06:55:33.946211+0000","last_became_peered":"2024-05-30T06:55:33.946211+0000","last_unstale":"2024-05-30T06:55:33.947913+0000","last_undegraded":"2024-05-30T06:55:33.947913+0000","last_fullsized":"2024-05-30T06:55:33.947913+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:15:11.394270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925487+0000","last_change":"2024-05-30T06:55:33.925487+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925487+0000","last_undegraded":"2024-05-30T06:55:33.925487+0000","last_fullsized":"2024-05-30T06:55:33.925487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.938797+0000","last_change":"2024-05-30T06:55:33.935901+0000","last_active":"2024-05-30T06:55:33.938797+0000","last_peered":"2024-05-30T06:55:33.938797+0000","last_clean":"2024-05-30T06:55:33.938797+0000","last_became_active":"2024-05-30T06:55:33.935035+0000","last_became_peered":"2024-05-30T06:55:33.935035+0000","last_unstale":"2024-05-30T06:55:33.938797+0000","last_undegraded":"2024-05-30T06:55:33.938797+0000","last_fullsized":"2024-05-30T06:55:33.938797+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:08:49.286125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929341+0000","last_change":"2024-05-30T06:55:33.929341+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929341+0000","last_undegraded":"2024-05-30T06:55:33.929341+0000","last_fullsized":"2024-05-30T06:55:33.929341+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.942354+0000","last_change":"2024-05-30T06:55:33.935067+0000","last_active":"2024-05-30T06:55:33.942354+0000","last_peered":"2024-05-30T06:55:33.942354+0000","last_clean":"2024-05-30T06:55:33.942354+0000","last_became_active":"2024-05-30T06:55:33.934711+0000","last_became_peered":"2024-05-30T06:55:33.934711+0000","last_unstale":"2024-05-30T06:55:33.942354+0000","last_undegraded":"2024-05-30T06:55:33.942354+0000","last_fullsized":"2024-05-30T06:55:33.942354+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:42:09.909177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929541+0000","last_change":"2024-05-30T06:55:33.929541+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929541+0000","last_undegraded":"2024-05-30T06:55:33.929541+0000","last_fullsized":"2024-05-30T06:55:33.929541+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.951042+0000","last_change":"2024-05-30T06:55:33.950261+0000","last_active":"2024-05-30T06:55:33.951042+0000","last_peered":"2024-05-30T06:55:33.951042+0000","last_clean":"2024-05-30T06:55:33.951042+0000","last_became_active":"2024-05-30T06:55:33.949959+0000","last_became_peered":"2024-05-30T06:55:33.949959+0000","last_unstale":"2024-05-30T06:55:33.951042+0000","last_undegraded":"2024-05-30T06:55:33.951042+0000","last_fullsized":"2024-05-30T06:55:33.951042+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:43.463300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.926196+0000","last_change":"2024-05-30T06:55:33.926196+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.926196+0000","last_undegraded":"2024-05-30T06:55:33.926196+0000","last_fullsized":"2024-05-30T06:55:33.926196+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.940087+0000","last_change":"2024-05-30T06:55:33.935720+0000","last_active":"2024-05-30T06:55:33.940087+0000","last_peered":"2024-05-30T06:55:33.940087+0000","last_clean":"2024-05-30T06:55:33.940087+0000","last_became_active":"2024-05-30T06:55:33.935370+0000","last_became_peered":"2024-05-30T06:55:33.935370+0000","last_unstale":"2024-05-30T06:55:33.940087+0000","last_undegraded":"2024-05-30T06:55:33.940087+0000","last_fullsized":"2024-05-30T06:55:33.940087+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:20:26.023438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931966+0000","last_change":"2024-05-30T06:55:33.931966+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931966+0000","last_undegraded":"2024-05-30T06:55:33.931966+0000","last_fullsized":"2024-05-30T06:55:33.931966+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935412+0000","last_change":"2024-05-30T06:55:33.935564+0000","last_active":"2024-05-30T06:55:35.935412+0000","last_peered":"2024-05-30T06:55:35.935412+0000","last_clean":"2024-05-30T06:55:35.935412+0000","last_became_active":"2024-05-30T06:55:33.934422+0000","last_became_peered":"2024-05-30T06:55:33.934422+0000","last_unstale":"2024-05-30T06:55:35.935412+0000","last_undegraded":"2024-05-30T06:55:35.935412+0000","last_fullsized":"2024-05-30T06:55:35.935412+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:24:00.583740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930762+0000","last_change":"2024-05-30T06:55:33.930762+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930762+0000","last_undegraded":"2024-05-30T06:55:33.930762+0000","last_fullsized":"2024-05-30T06:55:33.930762+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935114+0000","last_change":"2024-05-30T06:55:33.944968+0000","last_active":"2024-05-30T06:55:35.935114+0000","last_peered":"2024-05-30T06:55:35.935114+0000","last_clean":"2024-05-30T06:55:35.935114+0000","last_became_active":"2024-05-30T06:55:33.944653+0000","last_became_peered":"2024-05-30T06:55:33.944653+0000","last_unstale":"2024-05-30T06:55:35.935114+0000","last_undegraded":"2024-05-30T06:55:35.935114+0000","last_fullsized":"2024-05-30T06:55:35.935114+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:56:24.913375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.934493+0000","last_change":"2024-05-30T06:55:33.934493+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.934493+0000","last_undegraded":"2024-05-30T06:55:33.934493+0000","last_fullsized":"2024-05-30T06:55:33.934493+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.940417+0000","last_change":"2024-05-30T06:55:33.939347+0000","last_active":"2024-05-30T06:55:33.940417+0000","last_peered":"2024-05-30T06:55:33.940417+0000","last_clean":"2024-05-30T06:55:33.940417+0000","last_became_active":"2024-05-30T06:55:33.939016+0000","last_became_peered":"2024-05-30T06:55:33.939016+0000","last_unstale":"2024-05-30T06:55:33.940417+0000","last_undegraded":"2024-05-30T06:55:33.940417+0000","last_fullsized":"2024-05-30T06:55:33.940417+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:58:13.201695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929615+0000","last_change":"2024-05-30T06:55:33.929615+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929615+0000","last_undegraded":"2024-05-30T06:55:33.929615+0000","last_fullsized":"2024-05-30T06:55:33.929615+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.938880+0000","last_change":"2024-05-30T06:55:33.937075+0000","last_active":"2024-05-30T06:55:33.938880+0000","last_peered":"2024-05-30T06:55:33.938880+0000","last_clean":"2024-05-30T06:55:33.938880+0000","last_became_active":"2024-05-30T06:55:33.936712+0000","last_became_peered":"2024-05-30T06:55:33.936712+0000","last_unstale":"2024-05-30T06:55:33.938880+0000","last_undegraded":"2024-05-30T06:55:33.938880+0000","last_fullsized":"2024-05-30T06:55:33.938880+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:11:50.696004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930522+0000","last_change":"2024-05-30T06:55:33.930522+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930522+0000","last_undegraded":"2024-05-30T06:55:33.930522+0000","last_fullsized":"2024-05-30T06:55:33.930522+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934677+0000","last_change":"2024-05-30T06:55:33.939978+0000","last_active":"2024-05-30T06:55:35.934677+0000","last_peered":"2024-05-30T06:55:35.934677+0000","last_clean":"2024-05-30T06:55:35.934677+0000","last_became_active":"2024-05-30T06:55:33.939661+0000","last_became_peered":"2024-05-30T06:55:33.939661+0000","last_unstale":"2024-05-30T06:55:35.934677+0000","last_undegraded":"2024-05-30T06:55:35.934677+0000","last_fullsized":"2024-05-30T06:55:35.934677+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:21:54.215474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935525+0000","last_change":"2024-05-30T06:55:34.947321+0000","last_active":"2024-05-30T06:55:35.935525+0000","last_peered":"2024-05-30T06:55:35.935525+0000","last_clean":"2024-05-30T06:55:35.935525+0000","last_became_active":"2024-05-30T06:55:34.947060+0000","last_became_peered":"2024-05-30T06:55:34.947060+0000","last_unstale":"2024-05-30T06:55:35.935525+0000","last_undegraded":"2024-05-30T06:55:35.935525+0000","last_fullsized":"2024-05-30T06:55:35.935525+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:54.211731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.939513+0000","last_change":"2024-05-30T06:55:33.937091+0000","last_active":"2024-05-30T06:55:33.939513+0000","last_peered":"2024-05-30T06:55:33.939513+0000","last_clean":"2024-05-30T06:55:33.939513+0000","last_became_active":"2024-05-30T06:55:33.936792+0000","last_became_peered":"2024-05-30T06:55:33.936792+0000","last_unstale":"2024-05-30T06:55:33.939513+0000","last_undegraded":"2024-05-30T06:55:33.939513+0000","last_fullsized":"2024-05-30T06:55:33.939513+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:48:21.768843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930529+0000","last_change":"2024-05-30T06:55:33.930529+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930529+0000","last_undegraded":"2024-05-30T06:55:33.930529+0000","last_fullsized":"2024-05-30T06:55:33.930529+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935606+0000","last_change":"2024-05-30T06:55:33.947953+0000","last_active":"2024-05-30T06:55:35.935606+0000","last_peered":"2024-05-30T06:55:35.935606+0000","last_clean":"2024-05-30T06:55:35.935606+0000","last_became_active":"2024-05-30T06:55:33.947682+0000","last_became_peered":"2024-05-30T06:55:33.947682+0000","last_unstale":"2024-05-30T06:55:35.935606+0000","last_undegraded":"2024-05-30T06:55:35.935606+0000","last_fullsized":"2024-05-30T06:55:35.935606+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:42.797019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930665+0000","last_change":"2024-05-30T06:55:33.930665+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930665+0000","last_undegraded":"2024-05-30T06:55:33.930665+0000","last_fullsized":"2024-05-30T06:55:33.930665+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935042+0000","last_change":"2024-05-30T06:55:33.942331+0000","last_active":"2024-05-30T06:55:35.935042+0000","last_peered":"2024-05-30T06:55:35.935042+0000","last_clean":"2024-05-30T06:55:35.935042+0000","last_became_active":"2024-05-30T06:55:33.942074+0000","last_became_peered":"2024-05-30T06:55:33.942074+0000","last_unstale":"2024-05-30T06:55:35.935042+0000","last_undegraded":"2024-05-30T06:55:35.935042+0000","last_fullsized":"2024-05-30T06:55:35.935042+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:28:44.612162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931236+0000","last_change":"2024-05-30T06:55:33.931236+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931236+0000","last_undegraded":"2024-05-30T06:55:33.931236+0000","last_fullsized":"2024-05-30T06:55:33.931236+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.942447+0000","last_change":"2024-05-30T06:55:33.938985+0000","last_active":"2024-05-30T06:55:33.942447+0000","last_peered":"2024-05-30T06:55:33.942447+0000","last_clean":"2024-05-30T06:55:33.942447+0000","last_became_active":"2024-05-30T06:55:33.938648+0000","last_became_peered":"2024-05-30T06:55:33.938648+0000","last_unstale":"2024-05-30T06:55:33.942447+0000","last_undegraded":"2024-05-30T06:55:33.942447+0000","last_fullsized":"2024-05-30T06:55:33.942447+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:34.836617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930350+0000","last_change":"2024-05-30T06:55:33.930350+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930350+0000","last_undegraded":"2024-05-30T06:55:33.930350+0000","last_fullsized":"2024-05-30T06:55:33.930350+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935203+0000","last_change":"2024-05-30T06:55:33.934159+0000","last_active":"2024-05-30T06:55:35.935203+0000","last_peered":"2024-05-30T06:55:35.935203+0000","last_clean":"2024-05-30T06:55:35.935203+0000","last_became_active":"2024-05-30T06:55:33.933841+0000","last_became_peered":"2024-05-30T06:55:33.933841+0000","last_unstale":"2024-05-30T06:55:35.935203+0000","last_undegraded":"2024-05-30T06:55:35.935203+0000","last_fullsized":"2024-05-30T06:55:35.935203+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:47:19.119777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.924820+0000","last_change":"2024-05-30T06:55:33.924820+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.924820+0000","last_undegraded":"2024-05-30T06:55:33.924820+0000","last_fullsized":"2024-05-30T06:55:33.924820+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.942413+0000","last_change":"2024-05-30T06:55:33.938260+0000","last_active":"2024-05-30T06:55:33.942413+0000","last_peered":"2024-05-30T06:55:33.942413+0000","last_clean":"2024-05-30T06:55:33.942413+0000","last_became_active":"2024-05-30T06:55:33.937992+0000","last_became_peered":"2024-05-30T06:55:33.937992+0000","last_unstale":"2024-05-30T06:55:33.942413+0000","last_undegraded":"2024-05-30T06:55:33.942413+0000","last_fullsized":"2024-05-30T06:55:33.942413+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:06:06.482391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929113+0000","last_change":"2024-05-30T06:55:33.929113+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929113+0000","last_undegraded":"2024-05-30T06:55:33.929113+0000","last_fullsized":"2024-05-30T06:55:33.929113+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549631+0000","last_change":"2024-05-30T06:55:33.937358+0000","last_active":"2024-05-30T06:55:36.549631+0000","last_peered":"2024-05-30T06:55:36.549631+0000","last_clean":"2024-05-30T06:55:36.549631+0000","last_became_active":"2024-05-30T06:55:33.937026+0000","last_became_peered":"2024-05-30T06:55:33.937026+0000","last_unstale":"2024-05-30T06:55:36.549631+0000","last_undegraded":"2024-05-30T06:55:36.549631+0000","last_fullsized":"2024-05-30T06:55:36.549631+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:14:56.877290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930033+0000","last_change":"2024-05-30T06:55:33.930033+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930033+0000","last_undegraded":"2024-05-30T06:55:33.930033+0000","last_fullsized":"2024-05-30T06:55:33.930033+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.946883+0000","last_change":"2024-05-30T06:55:33.944390+0000","last_active":"2024-05-30T06:55:33.946883+0000","last_peered":"2024-05-30T06:55:33.946883+0000","last_clean":"2024-05-30T06:55:33.946883+0000","last_became_active":"2024-05-30T06:55:33.943939+0000","last_became_peered":"2024-05-30T06:55:33.943939+0000","last_unstale":"2024-05-30T06:55:33.946883+0000","last_undegraded":"2024-05-30T06:55:33.946883+0000","last_fullsized":"2024-05-30T06:55:33.946883+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:29:56.235206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.937147+0000","last_change":"2024-05-30T06:55:33.937147+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.937147+0000","last_undegraded":"2024-05-30T06:55:33.937147+0000","last_fullsized":"2024-05-30T06:55:33.937147+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.943726+0000","last_change":"2024-05-30T06:55:33.942731+0000","last_active":"2024-05-30T06:55:33.943726+0000","last_peered":"2024-05-30T06:55:33.943726+0000","last_clean":"2024-05-30T06:55:33.943726+0000","last_became_active":"2024-05-30T06:55:33.942215+0000","last_became_peered":"2024-05-30T06:55:33.942215+0000","last_unstale":"2024-05-30T06:55:33.943726+0000","last_undegraded":"2024-05-30T06:55:33.943726+0000","last_fullsized":"2024-05-30T06:55:33.943726+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:42.797019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":323,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.934723+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:55:33.934723+0000","last_peered":"2024-05-30T06:55:33.934723+0000","last_clean":"2024-05-30T06:55:33.934723+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:55:33.934723+0000","last_undegraded":"2024-05-30T06:55:33.934723+0000","last_fullsized":"2024-05-30T06:55:33.934723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123156,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248684,"statfs":{"total":96636764160,"available":96510652416,"internally_reserved":0,"allocated":1830912,"data_stored":1127129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575015,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122552,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249288,"statfs":{"total":96636764160,"available":96511270912,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575015,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76728,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295112,"statfs":{"total":96636764160,"available":96558194688,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575014,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64264,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94307576,"statfs":{"total":96636764160,"available":96570957824,"internally_reserved":0,"allocated":1236992,"data_stored":536761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140656,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231184,"statfs":{"total":96636764160,"available":96492732416,"internally_reserved":0,"allocated":1277952,"data_stored":551526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":142735815},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575013,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140600,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231240,"statfs":{"total":96636764160,"available":96492789760,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575015,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104504,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94267336,"statfs":{"total":96636764160,"available":96529752064,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575016,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77348,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294492,"statfs":{"total":96636764160,"available":96557559808,"internally_reserved":0,"allocated":1859584,"data_stored":1140842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:55:39.452 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:55:39.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a9ee00640 1 Processor -- start 2024-05-30T06:55:39.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a9ee00640 1 -- start start 2024-05-30T06:55:39.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a9ee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a98160b90 0x7f1a9809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:39.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a9ee00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a980d0430 con 0x7f1a98160ff0 2024-05-30T06:55:39.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a9ee00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a980d0710 con 0x7f1a980b2e20 2024-05-30T06:55:39.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a9ee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1a980b3200 con 0x7f1a98160b90 2024-05-30T06:55:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a9ce00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1a98160ff0 0x7f1a9809afa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47406/0 (socket says 172.21.15.37:47406) 2024-05-30T06:55:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a9ce00640 1 -- 172.21.15.37:0/3679734746 learned_addr learned my addr 172.21.15.37:0/3679734746 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a97400640 1 --2- 172.21.15.37:0/3679734746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a98160b90 0x7f1a9809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a96a00640 1 -- 172.21.15.37:0/3679734746 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3748893851 0 0) 0x7f1a980d0430 con 0x7f1a98160ff0 2024-05-30T06:55:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a96a00640 1 -- 172.21.15.37:0/3679734746 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a7c003530 con 0x7f1a98160ff0 2024-05-30T06:55:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a96a00640 1 -- 172.21.15.37:0/3679734746 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3290491970 0 0) 0x7f1a980d0710 con 0x7f1a980b2e20 2024-05-30T06:55:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a96a00640 1 -- 172.21.15.37:0/3679734746 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a980d0430 con 0x7f1a980b2e20 2024-05-30T06:55:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a97400640 1 -- 172.21.15.37:0/3679734746 >> v1:172.21.15.105:6789/0 conn(0x7f1a980b2e20 legacy=0x7f1a98160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a97400640 1 -- 172.21.15.37:0/3679734746 >> v1:172.21.15.37:6789/0 conn(0x7f1a98160ff0 legacy=0x7f1a9809afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.633+0000 7f1a97400640 1 -- 172.21.15.37:0/3679734746 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a980b35f0 con 0x7f1a98160b90 2024-05-30T06:55:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.637+0000 7f1a97400640 1 --2- 172.21.15.37:0/3679734746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a98160b90 0x7f1a9809aa60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1a840097f0 tx=0x7f1a8401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4d09106fe8347af server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.637+0000 7f1a96a00640 1 -- 172.21.15.37:0/3679734746 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a840b0070 con 0x7f1a98160b90 2024-05-30T06:55:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.637+0000 7f1a96a00640 1 -- 172.21.15.37:0/3679734746 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a840ab600 con 0x7f1a98160b90 2024-05-30T06:55:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.637+0000 7f1a96a00640 1 -- 172.21.15.37:0/3679734746 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a840ab9b0 con 0x7f1a98160b90 2024-05-30T06:55:39.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.637+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3679734746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a98160b90 msgr2=0x7f1a9809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.637+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/3679734746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a98160b90 0x7f1a9809aa60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1a840097f0 tx=0x7f1a8401c4c0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.637+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3679734746 shutdown_connections 2024-05-30T06:55:39.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.637+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/3679734746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a98160b90 0x7f1a9809aa60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.637+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3679734746 >> 172.21.15.37:0/3679734746 conn(0x7f1a980b4100 msgr2=0x7f1a980b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:39.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.637+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3679734746 shutdown_connections 2024-05-30T06:55:39.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.637+0000 7f1a9ee00640 1 -- 172.21.15.37:0/3679734746 wait complete. 2024-05-30T06:55:39.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a9ee00640 1 Processor -- start 2024-05-30T06:55:39.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a9ee00640 1 -- start start 2024-05-30T06:55:39.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a9ee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a980b2e20 0x7f1a98158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:39.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a9ee00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a98160b90 0x7f1a9815cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:39.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a9ee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a98160ff0 0x7f1a980b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:39.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a9ee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9816a7d0 con 0x7f1a980b2e20 2024-05-30T06:55:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a9ee00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9816a950 con 0x7f1a98160b90 2024-05-30T06:55:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a9ee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1a9816aad0 con 0x7f1a98160ff0 2024-05-30T06:55:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a97e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a980b2e20 0x7f1a98158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a97e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a980b2e20 0x7f1a98158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45056/0 (socket says 172.21.15.37:45056) 2024-05-30T06:55:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a97e00640 1 -- 172.21.15.37:0/2216053263 learned_addr learned my addr 172.21.15.37:0/2216053263 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a9ce00640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a98160ff0 0x7f1a980b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a97400640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a98160b90 0x7f1a9815cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a97e00640 1 -- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a98160ff0 msgr2=0x7f1a980b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a97e00640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a98160ff0 0x7f1a980b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a97e00640 1 -- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a98160b90 msgr2=0x7f1a9815cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a97e00640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a98160b90 0x7f1a9815cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a97e00640 1 -- 172.21.15.37:0/2216053263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9806ea70 con 0x7f1a980b2e20 2024-05-30T06:55:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a97e00640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a980b2e20 0x7f1a98158f00 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800c430 tx=0x7f1a8800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:39.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a8fe00640 1 -- 172.21.15.37:0/2216053263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88017070 con 0x7f1a980b2e20 2024-05-30T06:55:39.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a8fe00640 1 -- 172.21.15.37:0/2216053263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a880052f0 con 0x7f1a980b2e20 2024-05-30T06:55:39.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2216053263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a9815d370 con 0x7f1a980b2e20 2024-05-30T06:55:39.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a8fe00640 1 -- 172.21.15.37:0/2216053263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88003840 con 0x7f1a980b2e20 2024-05-30T06:55:39.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2216053263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a9815d930 con 0x7f1a980b2e20 2024-05-30T06:55:39.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.641+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2216053263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a98068b20 con 0x7f1a980b2e20 2024-05-30T06:55:39.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.645+0000 7f1a8fe00640 1 -- 172.21.15.37:0/2216053263 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f1a8801a070 con 0x7f1a980b2e20 2024-05-30T06:55:39.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.645+0000 7f1a8fe00640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a780698e0 0x7f1a7806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:39.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.645+0000 7f1a8fe00640 1 -- 172.21.15.37:0/2216053263 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f1a88084ec0 con 0x7f1a980b2e20 2024-05-30T06:55:39.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.645+0000 7f1a97400640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a780698e0 0x7f1a7806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:39.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.645+0000 7f1a97400640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a780698e0 0x7f1a7806bda0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1a840ad000 tx=0x7f1a840a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:39.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.649+0000 7f1a8fe00640 1 -- 172.21.15.37:0/2216053263 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1a9806ea70 con 0x7f1a980b2e20 2024-05-30T06:55:39.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.809+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2216053263 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a980ce860 con 0x7f1a780698e0 2024-05-30T06:55:39.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.817+0000 7f1a8fe00640 1 -- 172.21.15.37:0/2216053263 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248491 (secure 0 0 0) 0x7f1a980ce860 con 0x7f1a780698e0 2024-05-30T06:55:39.820 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:39.821 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:55:39.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.817+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a780698e0 msgr2=0x7f1a7806bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.817+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a780698e0 0x7f1a7806bda0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1a840ad000 tx=0x7f1a840a6000 comp rx=0 tx=0).stop 2024-05-30T06:55:39.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.817+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2216053263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a980b2e20 msgr2=0x7f1a98158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:39.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.817+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a980b2e20 0x7f1a98158f00 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800c430 tx=0x7f1a8800c8f0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.817+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2216053263 shutdown_connections 2024-05-30T06:55:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.817+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a98160ff0 0x7f1a980b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.817+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a780698e0 0x7f1a7806bda0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.817+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a98160b90 0x7f1a9815cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.817+0000 7f1a9ee00640 1 --2- 172.21.15.37:0/2216053263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a980b2e20 0x7f1a98158f00 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.817+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2216053263 >> 172.21.15.37:0/2216053263 conn(0x7f1a980b4100 msgr2=0x7f1a980714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.821+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2216053263 shutdown_connections 2024-05-30T06:55:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:39.821+0000 7f1a9ee00640 1 -- 172.21.15.37:0/2216053263 wait complete. 2024-05-30T06:55:39.841 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":505,"stamp":"2024-05-30T06:55:38.943423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":849808,"kb_used_data":10844,"kb_used_omap":12,"kb_used_meta":838835,"kb_avail":754124912,"statfs":{"total":773094113280,"available":772223909888,"internally_reserved":0,"allocated":11104256,"data_stored":5478090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":858967600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001565"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931039+0000","last_change":"2024-05-30T06:55:33.931039+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931039+0000","last_undegraded":"2024-05-30T06:55:33.931039+0000","last_fullsized":"2024-05-30T06:55:33.931039+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935371+0000","last_change":"2024-05-30T06:55:34.955973+0000","last_active":"2024-05-30T06:55:35.935371+0000","last_peered":"2024-05-30T06:55:35.935371+0000","last_clean":"2024-05-30T06:55:35.935371+0000","last_became_active":"2024-05-30T06:55:34.955604+0000","last_became_peered":"2024-05-30T06:55:34.955604+0000","last_unstale":"2024-05-30T06:55:35.935371+0000","last_undegraded":"2024-05-30T06:55:35.935371+0000","last_fullsized":"2024-05-30T06:55:35.935371+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:13.858335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929293+0000","last_change":"2024-05-30T06:55:33.929293+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929293+0000","last_undegraded":"2024-05-30T06:55:33.929293+0000","last_fullsized":"2024-05-30T06:55:33.929293+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550531+0000","last_change":"2024-05-30T06:55:34.945824+0000","last_active":"2024-05-30T06:55:36.550531+0000","last_peered":"2024-05-30T06:55:36.550531+0000","last_clean":"2024-05-30T06:55:36.550531+0000","last_became_active":"2024-05-30T06:55:34.944885+0000","last_became_peered":"2024-05-30T06:55:34.944885+0000","last_unstale":"2024-05-30T06:55:36.550531+0000","last_undegraded":"2024-05-30T06:55:36.550531+0000","last_fullsized":"2024-05-30T06:55:36.550531+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:39.774985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929953+0000","last_change":"2024-05-30T06:55:33.929953+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929953+0000","last_undegraded":"2024-05-30T06:55:33.929953+0000","last_fullsized":"2024-05-30T06:55:33.929953+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.932061+0000","last_change":"2024-05-30T06:55:33.932061+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.932061+0000","last_undegraded":"2024-05-30T06:55:33.932061+0000","last_fullsized":"2024-05-30T06:55:33.932061+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931628+0000","last_change":"2024-05-30T06:55:33.931628+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931628+0000","last_undegraded":"2024-05-30T06:55:33.931628+0000","last_fullsized":"2024-05-30T06:55:33.931628+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934796+0000","last_change":"2024-05-30T06:55:34.952580+0000","last_active":"2024-05-30T06:55:35.934796+0000","last_peered":"2024-05-30T06:55:35.934796+0000","last_clean":"2024-05-30T06:55:35.934796+0000","last_became_active":"2024-05-30T06:55:34.952313+0000","last_became_peered":"2024-05-30T06:55:34.952313+0000","last_unstale":"2024-05-30T06:55:35.934796+0000","last_undegraded":"2024-05-30T06:55:35.934796+0000","last_fullsized":"2024-05-30T06:55:35.934796+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:54:03.363077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.927115+0000","last_change":"2024-05-30T06:55:33.927115+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.927115+0000","last_undegraded":"2024-05-30T06:55:33.927115+0000","last_fullsized":"2024-05-30T06:55:33.927115+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931449+0000","last_change":"2024-05-30T06:55:33.931449+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931449+0000","last_undegraded":"2024-05-30T06:55:33.931449+0000","last_fullsized":"2024-05-30T06:55:33.931449+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.935677+0000","last_change":"2024-05-30T06:55:33.935677+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.935677+0000","last_undegraded":"2024-05-30T06:55:33.935677+0000","last_fullsized":"2024-05-30T06:55:33.935677+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.927552+0000","last_change":"2024-05-30T06:55:33.927552+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.927552+0000","last_undegraded":"2024-05-30T06:55:33.927552+0000","last_fullsized":"2024-05-30T06:55:33.927552+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550365+0000","last_change":"2024-05-30T06:55:34.952578+0000","last_active":"2024-05-30T06:55:36.550365+0000","last_peered":"2024-05-30T06:55:36.550365+0000","last_clean":"2024-05-30T06:55:36.550365+0000","last_became_active":"2024-05-30T06:55:34.952237+0000","last_became_peered":"2024-05-30T06:55:34.952237+0000","last_unstale":"2024-05-30T06:55:36.550365+0000","last_undegraded":"2024-05-30T06:55:36.550365+0000","last_fullsized":"2024-05-30T06:55:36.550365+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:54.211731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.939233+0000","last_change":"2024-05-30T06:55:33.939233+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.939233+0000","last_undegraded":"2024-05-30T06:55:33.939233+0000","last_fullsized":"2024-05-30T06:55:33.939233+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549571+0000","last_change":"2024-05-30T06:55:34.948290+0000","last_active":"2024-05-30T06:55:36.549571+0000","last_peered":"2024-05-30T06:55:36.549571+0000","last_clean":"2024-05-30T06:55:36.549571+0000","last_became_active":"2024-05-30T06:55:34.947764+0000","last_became_peered":"2024-05-30T06:55:34.947764+0000","last_unstale":"2024-05-30T06:55:36.549571+0000","last_undegraded":"2024-05-30T06:55:36.549571+0000","last_fullsized":"2024-05-30T06:55:36.549571+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:12:13.556946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931145+0000","last_change":"2024-05-30T06:55:33.931145+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931145+0000","last_undegraded":"2024-05-30T06:55:33.931145+0000","last_fullsized":"2024-05-30T06:55:33.931145+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935244+0000","last_change":"2024-05-30T06:55:34.948066+0000","last_active":"2024-05-30T06:55:35.935244+0000","last_peered":"2024-05-30T06:55:35.935244+0000","last_clean":"2024-05-30T06:55:35.935244+0000","last_became_active":"2024-05-30T06:55:34.947836+0000","last_became_peered":"2024-05-30T06:55:34.947836+0000","last_unstale":"2024-05-30T06:55:35.935244+0000","last_undegraded":"2024-05-30T06:55:35.935244+0000","last_fullsized":"2024-05-30T06:55:35.935244+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:56:43.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550353+0000","last_change":"2024-05-30T06:55:34.933997+0000","last_active":"2024-05-30T06:55:36.550353+0000","last_peered":"2024-05-30T06:55:36.550353+0000","last_clean":"2024-05-30T06:55:36.550353+0000","last_became_active":"2024-05-30T06:55:34.933752+0000","last_became_peered":"2024-05-30T06:55:34.933752+0000","last_unstale":"2024-05-30T06:55:36.550353+0000","last_undegraded":"2024-05-30T06:55:36.550353+0000","last_fullsized":"2024-05-30T06:55:36.550353+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:55.380184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.936017+0000","last_change":"2024-05-30T06:55:33.936017+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.936017+0000","last_undegraded":"2024-05-30T06:55:33.936017+0000","last_fullsized":"2024-05-30T06:55:33.936017+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925212+0000","last_change":"2024-05-30T06:55:33.925212+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925212+0000","last_undegraded":"2024-05-30T06:55:33.925212+0000","last_fullsized":"2024-05-30T06:55:33.925212+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.934914+0000","last_change":"2024-05-30T06:55:33.934914+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.934914+0000","last_undegraded":"2024-05-30T06:55:33.934914+0000","last_fullsized":"2024-05-30T06:55:33.934914+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934743+0000","last_change":"2024-05-30T06:55:34.948942+0000","last_active":"2024-05-30T06:55:35.934743+0000","last_peered":"2024-05-30T06:55:35.934743+0000","last_clean":"2024-05-30T06:55:35.934743+0000","last_became_active":"2024-05-30T06:55:34.948665+0000","last_became_peered":"2024-05-30T06:55:34.948665+0000","last_unstale":"2024-05-30T06:55:35.934743+0000","last_undegraded":"2024-05-30T06:55:35.934743+0000","last_fullsized":"2024-05-30T06:55:35.934743+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:19:24.696303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934808+0000","last_change":"2024-05-30T06:55:34.948065+0000","last_active":"2024-05-30T06:55:35.934808+0000","last_peered":"2024-05-30T06:55:35.934808+0000","last_clean":"2024-05-30T06:55:35.934808+0000","last_became_active":"2024-05-30T06:55:34.947811+0000","last_became_peered":"2024-05-30T06:55:34.947811+0000","last_unstale":"2024-05-30T06:55:35.934808+0000","last_undegraded":"2024-05-30T06:55:35.934808+0000","last_fullsized":"2024-05-30T06:55:35.934808+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:03:57.480410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930690+0000","last_change":"2024-05-30T06:55:33.930690+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930690+0000","last_undegraded":"2024-05-30T06:55:33.930690+0000","last_fullsized":"2024-05-30T06:55:33.930690+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.933468+0000","last_change":"2024-05-30T06:55:33.933468+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.933468+0000","last_undegraded":"2024-05-30T06:55:33.933468+0000","last_fullsized":"2024-05-30T06:55:33.933468+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935399+0000","last_change":"2024-05-30T06:55:34.957056+0000","last_active":"2024-05-30T06:55:35.935399+0000","last_peered":"2024-05-30T06:55:35.935399+0000","last_clean":"2024-05-30T06:55:35.935399+0000","last_became_active":"2024-05-30T06:55:34.956742+0000","last_became_peered":"2024-05-30T06:55:34.956742+0000","last_unstale":"2024-05-30T06:55:35.935399+0000","last_undegraded":"2024-05-30T06:55:35.935399+0000","last_fullsized":"2024-05-30T06:55:35.935399+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:55.380184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.935235+0000","last_change":"2024-05-30T06:55:33.935235+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.935235+0000","last_undegraded":"2024-05-30T06:55:33.935235+0000","last_fullsized":"2024-05-30T06:55:33.935235+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930851+0000","last_change":"2024-05-30T06:55:33.930851+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930851+0000","last_undegraded":"2024-05-30T06:55:33.930851+0000","last_fullsized":"2024-05-30T06:55:33.930851+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935062+0000","last_change":"2024-05-30T06:55:34.956501+0000","last_active":"2024-05-30T06:55:35.935062+0000","last_peered":"2024-05-30T06:55:35.935062+0000","last_clean":"2024-05-30T06:55:35.935062+0000","last_became_active":"2024-05-30T06:55:34.956081+0000","last_became_peered":"2024-05-30T06:55:34.956081+0000","last_unstale":"2024-05-30T06:55:35.935062+0000","last_undegraded":"2024-05-30T06:55:35.935062+0000","last_fullsized":"2024-05-30T06:55:35.935062+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:12:13.556946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931295+0000","last_change":"2024-05-30T06:55:33.931295+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931295+0000","last_undegraded":"2024-05-30T06:55:33.931295+0000","last_fullsized":"2024-05-30T06:55:33.931295+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549664+0000","last_change":"2024-05-30T06:55:34.932722+0000","last_active":"2024-05-30T06:55:36.549664+0000","last_peered":"2024-05-30T06:55:36.549664+0000","last_clean":"2024-05-30T06:55:36.549664+0000","last_became_active":"2024-05-30T06:55:34.932454+0000","last_became_peered":"2024-05-30T06:55:34.932454+0000","last_unstale":"2024-05-30T06:55:36.549664+0000","last_undegraded":"2024-05-30T06:55:36.549664+0000","last_fullsized":"2024-05-30T06:55:36.549664+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:56:43.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.927240+0000","last_change":"2024-05-30T06:55:33.927240+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.927240+0000","last_undegraded":"2024-05-30T06:55:33.927240+0000","last_fullsized":"2024-05-30T06:55:33.927240+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.937565+0000","last_change":"2024-05-30T06:55:33.937565+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.937565+0000","last_undegraded":"2024-05-30T06:55:33.937565+0000","last_fullsized":"2024-05-30T06:55:33.937565+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"101'4","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935297+0000","last_change":"2024-05-30T06:55:33.941005+0000","last_active":"2024-05-30T06:55:35.935297+0000","last_peered":"2024-05-30T06:55:35.935297+0000","last_clean":"2024-05-30T06:55:35.935297+0000","last_became_active":"2024-05-30T06:55:33.940750+0000","last_became_peered":"2024-05-30T06:55:33.940750+0000","last_unstale":"2024-05-30T06:55:35.935297+0000","last_undegraded":"2024-05-30T06:55:35.935297+0000","last_fullsized":"2024-05-30T06:55:35.935297+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:30:31.861812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550787+0000","last_change":"2024-05-30T06:55:34.934593+0000","last_active":"2024-05-30T06:55:36.550787+0000","last_peered":"2024-05-30T06:55:36.550787+0000","last_clean":"2024-05-30T06:55:36.550787+0000","last_became_active":"2024-05-30T06:55:34.934338+0000","last_became_peered":"2024-05-30T06:55:34.934338+0000","last_unstale":"2024-05-30T06:55:36.550787+0000","last_undegraded":"2024-05-30T06:55:36.550787+0000","last_fullsized":"2024-05-30T06:55:36.550787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:45:12.188368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.947247+0000","last_change":"2024-05-30T06:55:33.946654+0000","last_active":"2024-05-30T06:55:33.947247+0000","last_peered":"2024-05-30T06:55:33.947247+0000","last_clean":"2024-05-30T06:55:33.947247+0000","last_became_active":"2024-05-30T06:55:33.946353+0000","last_became_peered":"2024-05-30T06:55:33.946353+0000","last_unstale":"2024-05-30T06:55:33.947247+0000","last_undegraded":"2024-05-30T06:55:33.947247+0000","last_fullsized":"2024-05-30T06:55:33.947247+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:48:56.773319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931138+0000","last_change":"2024-05-30T06:55:33.931138+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931138+0000","last_undegraded":"2024-05-30T06:55:33.931138+0000","last_fullsized":"2024-05-30T06:55:33.931138+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934937+0000","last_change":"2024-05-30T06:55:33.948635+0000","last_active":"2024-05-30T06:55:35.934937+0000","last_peered":"2024-05-30T06:55:35.934937+0000","last_clean":"2024-05-30T06:55:35.934937+0000","last_became_active":"2024-05-30T06:55:33.948243+0000","last_became_peered":"2024-05-30T06:55:33.948243+0000","last_unstale":"2024-05-30T06:55:35.934937+0000","last_undegraded":"2024-05-30T06:55:35.934937+0000","last_fullsized":"2024-05-30T06:55:35.934937+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:05:45.736094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.926112+0000","last_change":"2024-05-30T06:55:33.926112+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.926112+0000","last_undegraded":"2024-05-30T06:55:33.926112+0000","last_fullsized":"2024-05-30T06:55:33.926112+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935315+0000","last_change":"2024-05-30T06:55:33.943667+0000","last_active":"2024-05-30T06:55:35.935315+0000","last_peered":"2024-05-30T06:55:35.935315+0000","last_clean":"2024-05-30T06:55:35.935315+0000","last_became_active":"2024-05-30T06:55:33.943405+0000","last_became_peered":"2024-05-30T06:55:33.943405+0000","last_unstale":"2024-05-30T06:55:35.935315+0000","last_undegraded":"2024-05-30T06:55:35.935315+0000","last_fullsized":"2024-05-30T06:55:35.935315+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:51.073112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925670+0000","last_change":"2024-05-30T06:55:33.925670+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925670+0000","last_undegraded":"2024-05-30T06:55:33.925670+0000","last_fullsized":"2024-05-30T06:55:33.925670+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.946645+0000","last_change":"2024-05-30T06:55:33.945265+0000","last_active":"2024-05-30T06:55:33.946645+0000","last_peered":"2024-05-30T06:55:33.946645+0000","last_clean":"2024-05-30T06:55:33.946645+0000","last_became_active":"2024-05-30T06:55:33.944980+0000","last_became_peered":"2024-05-30T06:55:33.944980+0000","last_unstale":"2024-05-30T06:55:33.946645+0000","last_undegraded":"2024-05-30T06:55:33.946645+0000","last_fullsized":"2024-05-30T06:55:33.946645+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:46:40.089247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.932666+0000","last_change":"2024-05-30T06:55:33.932666+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.932666+0000","last_undegraded":"2024-05-30T06:55:33.932666+0000","last_fullsized":"2024-05-30T06:55:33.932666+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934832+0000","last_change":"2024-05-30T06:55:33.937498+0000","last_active":"2024-05-30T06:55:35.934832+0000","last_peered":"2024-05-30T06:55:35.934832+0000","last_clean":"2024-05-30T06:55:35.934832+0000","last_became_active":"2024-05-30T06:55:33.937250+0000","last_became_peered":"2024-05-30T06:55:33.937250+0000","last_unstale":"2024-05-30T06:55:35.934832+0000","last_undegraded":"2024-05-30T06:55:35.934832+0000","last_fullsized":"2024-05-30T06:55:35.934832+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:05:08.736546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549551+0000","last_change":"2024-05-30T06:55:34.946842+0000","last_active":"2024-05-30T06:55:36.549551+0000","last_peered":"2024-05-30T06:55:36.549551+0000","last_clean":"2024-05-30T06:55:36.549551+0000","last_became_active":"2024-05-30T06:55:34.946578+0000","last_became_peered":"2024-05-30T06:55:34.946578+0000","last_unstale":"2024-05-30T06:55:36.549551+0000","last_undegraded":"2024-05-30T06:55:36.549551+0000","last_fullsized":"2024-05-30T06:55:36.549551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:03:57.480410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.944529+0000","last_change":"2024-05-30T06:55:33.943949+0000","last_active":"2024-05-30T06:55:33.944529+0000","last_peered":"2024-05-30T06:55:33.944529+0000","last_clean":"2024-05-30T06:55:33.944529+0000","last_became_active":"2024-05-30T06:55:33.943656+0000","last_became_peered":"2024-05-30T06:55:33.943656+0000","last_unstale":"2024-05-30T06:55:33.944529+0000","last_undegraded":"2024-05-30T06:55:33.944529+0000","last_fullsized":"2024-05-30T06:55:33.944529+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:11:33.204524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925203+0000","last_change":"2024-05-30T06:55:33.925203+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925203+0000","last_undegraded":"2024-05-30T06:55:33.925203+0000","last_fullsized":"2024-05-30T06:55:33.925203+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.945545+0000","last_change":"2024-05-30T06:55:33.942310+0000","last_active":"2024-05-30T06:55:33.945545+0000","last_peered":"2024-05-30T06:55:33.945545+0000","last_clean":"2024-05-30T06:55:33.945545+0000","last_became_active":"2024-05-30T06:55:33.941865+0000","last_became_peered":"2024-05-30T06:55:33.941865+0000","last_unstale":"2024-05-30T06:55:33.945545+0000","last_undegraded":"2024-05-30T06:55:33.945545+0000","last_fullsized":"2024-05-30T06:55:33.945545+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:44:21.582491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935529+0000","last_change":"2024-05-30T06:55:34.945420+0000","last_active":"2024-05-30T06:55:35.935529+0000","last_peered":"2024-05-30T06:55:35.935529+0000","last_clean":"2024-05-30T06:55:35.935529+0000","last_became_active":"2024-05-30T06:55:34.945163+0000","last_became_peered":"2024-05-30T06:55:34.945163+0000","last_unstale":"2024-05-30T06:55:35.935529+0000","last_undegraded":"2024-05-30T06:55:35.935529+0000","last_fullsized":"2024-05-30T06:55:35.935529+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:39.774985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.944347+0000","last_change":"2024-05-30T06:55:33.939208+0000","last_active":"2024-05-30T06:55:33.944347+0000","last_peered":"2024-05-30T06:55:33.944347+0000","last_clean":"2024-05-30T06:55:33.944347+0000","last_became_active":"2024-05-30T06:55:33.938920+0000","last_became_peered":"2024-05-30T06:55:33.938920+0000","last_unstale":"2024-05-30T06:55:33.944347+0000","last_undegraded":"2024-05-30T06:55:33.944347+0000","last_fullsized":"2024-05-30T06:55:33.944347+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:43:58.244250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.926683+0000","last_change":"2024-05-30T06:55:33.926683+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.926683+0000","last_undegraded":"2024-05-30T06:55:33.926683+0000","last_fullsized":"2024-05-30T06:55:33.926683+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550488+0000","last_change":"2024-05-30T06:55:33.941180+0000","last_active":"2024-05-30T06:55:36.550488+0000","last_peered":"2024-05-30T06:55:36.550488+0000","last_clean":"2024-05-30T06:55:36.550488+0000","last_became_active":"2024-05-30T06:55:33.940874+0000","last_became_peered":"2024-05-30T06:55:33.940874+0000","last_unstale":"2024-05-30T06:55:36.550488+0000","last_undegraded":"2024-05-30T06:55:36.550488+0000","last_fullsized":"2024-05-30T06:55:36.550488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:34:52.834290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930355+0000","last_change":"2024-05-30T06:55:33.930355+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930355+0000","last_undegraded":"2024-05-30T06:55:33.930355+0000","last_fullsized":"2024-05-30T06:55:33.930355+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.946279+0000","last_change":"2024-05-30T06:55:33.945685+0000","last_active":"2024-05-30T06:55:33.946279+0000","last_peered":"2024-05-30T06:55:33.946279+0000","last_clean":"2024-05-30T06:55:33.946279+0000","last_became_active":"2024-05-30T06:55:33.945289+0000","last_became_peered":"2024-05-30T06:55:33.945289+0000","last_unstale":"2024-05-30T06:55:33.946279+0000","last_undegraded":"2024-05-30T06:55:33.946279+0000","last_fullsized":"2024-05-30T06:55:33.946279+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:30:31.861812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.934821+0000","last_change":"2024-05-30T06:55:33.934821+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.934821+0000","last_undegraded":"2024-05-30T06:55:33.934821+0000","last_fullsized":"2024-05-30T06:55:33.934821+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.944188+0000","last_change":"2024-05-30T06:55:33.937604+0000","last_active":"2024-05-30T06:55:33.944188+0000","last_peered":"2024-05-30T06:55:33.944188+0000","last_clean":"2024-05-30T06:55:33.944188+0000","last_became_active":"2024-05-30T06:55:33.937237+0000","last_became_peered":"2024-05-30T06:55:33.937237+0000","last_unstale":"2024-05-30T06:55:33.944188+0000","last_undegraded":"2024-05-30T06:55:33.944188+0000","last_fullsized":"2024-05-30T06:55:33.944188+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:28:14.731398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549913+0000","last_change":"2024-05-30T06:55:34.943989+0000","last_active":"2024-05-30T06:55:36.549913+0000","last_peered":"2024-05-30T06:55:36.549913+0000","last_clean":"2024-05-30T06:55:36.549913+0000","last_became_active":"2024-05-30T06:55:34.943713+0000","last_became_peered":"2024-05-30T06:55:34.943713+0000","last_unstale":"2024-05-30T06:55:36.549913+0000","last_undegraded":"2024-05-30T06:55:36.549913+0000","last_fullsized":"2024-05-30T06:55:36.549913+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:13.858335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.948182+0000","last_change":"2024-05-30T06:55:33.946863+0000","last_active":"2024-05-30T06:55:33.948182+0000","last_peered":"2024-05-30T06:55:33.948182+0000","last_clean":"2024-05-30T06:55:33.948182+0000","last_became_active":"2024-05-30T06:55:33.946359+0000","last_became_peered":"2024-05-30T06:55:33.946359+0000","last_unstale":"2024-05-30T06:55:33.948182+0000","last_undegraded":"2024-05-30T06:55:33.948182+0000","last_fullsized":"2024-05-30T06:55:33.948182+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:15:41.743545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.928813+0000","last_change":"2024-05-30T06:55:33.928813+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.928813+0000","last_undegraded":"2024-05-30T06:55:33.928813+0000","last_fullsized":"2024-05-30T06:55:33.928813+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.947913+0000","last_change":"2024-05-30T06:55:33.946627+0000","last_active":"2024-05-30T06:55:33.947913+0000","last_peered":"2024-05-30T06:55:33.947913+0000","last_clean":"2024-05-30T06:55:33.947913+0000","last_became_active":"2024-05-30T06:55:33.946211+0000","last_became_peered":"2024-05-30T06:55:33.946211+0000","last_unstale":"2024-05-30T06:55:33.947913+0000","last_undegraded":"2024-05-30T06:55:33.947913+0000","last_fullsized":"2024-05-30T06:55:33.947913+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:15:11.394270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925487+0000","last_change":"2024-05-30T06:55:33.925487+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925487+0000","last_undegraded":"2024-05-30T06:55:33.925487+0000","last_fullsized":"2024-05-30T06:55:33.925487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.938797+0000","last_change":"2024-05-30T06:55:33.935901+0000","last_active":"2024-05-30T06:55:33.938797+0000","last_peered":"2024-05-30T06:55:33.938797+0000","last_clean":"2024-05-30T06:55:33.938797+0000","last_became_active":"2024-05-30T06:55:33.935035+0000","last_became_peered":"2024-05-30T06:55:33.935035+0000","last_unstale":"2024-05-30T06:55:33.938797+0000","last_undegraded":"2024-05-30T06:55:33.938797+0000","last_fullsized":"2024-05-30T06:55:33.938797+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:08:49.286125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929341+0000","last_change":"2024-05-30T06:55:33.929341+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929341+0000","last_undegraded":"2024-05-30T06:55:33.929341+0000","last_fullsized":"2024-05-30T06:55:33.929341+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.942354+0000","last_change":"2024-05-30T06:55:33.935067+0000","last_active":"2024-05-30T06:55:33.942354+0000","last_peered":"2024-05-30T06:55:33.942354+0000","last_clean":"2024-05-30T06:55:33.942354+0000","last_became_active":"2024-05-30T06:55:33.934711+0000","last_became_peered":"2024-05-30T06:55:33.934711+0000","last_unstale":"2024-05-30T06:55:33.942354+0000","last_undegraded":"2024-05-30T06:55:33.942354+0000","last_fullsized":"2024-05-30T06:55:33.942354+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:42:09.909177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929541+0000","last_change":"2024-05-30T06:55:33.929541+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929541+0000","last_undegraded":"2024-05-30T06:55:33.929541+0000","last_fullsized":"2024-05-30T06:55:33.929541+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.951042+0000","last_change":"2024-05-30T06:55:33.950261+0000","last_active":"2024-05-30T06:55:33.951042+0000","last_peered":"2024-05-30T06:55:33.951042+0000","last_clean":"2024-05-30T06:55:33.951042+0000","last_became_active":"2024-05-30T06:55:33.949959+0000","last_became_peered":"2024-05-30T06:55:33.949959+0000","last_unstale":"2024-05-30T06:55:33.951042+0000","last_undegraded":"2024-05-30T06:55:33.951042+0000","last_fullsized":"2024-05-30T06:55:33.951042+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:43.463300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.926196+0000","last_change":"2024-05-30T06:55:33.926196+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.926196+0000","last_undegraded":"2024-05-30T06:55:33.926196+0000","last_fullsized":"2024-05-30T06:55:33.926196+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.940087+0000","last_change":"2024-05-30T06:55:33.935720+0000","last_active":"2024-05-30T06:55:33.940087+0000","last_peered":"2024-05-30T06:55:33.940087+0000","last_clean":"2024-05-30T06:55:33.940087+0000","last_became_active":"2024-05-30T06:55:33.935370+0000","last_became_peered":"2024-05-30T06:55:33.935370+0000","last_unstale":"2024-05-30T06:55:33.940087+0000","last_undegraded":"2024-05-30T06:55:33.940087+0000","last_fullsized":"2024-05-30T06:55:33.940087+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:20:26.023438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931966+0000","last_change":"2024-05-30T06:55:33.931966+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931966+0000","last_undegraded":"2024-05-30T06:55:33.931966+0000","last_fullsized":"2024-05-30T06:55:33.931966+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935412+0000","last_change":"2024-05-30T06:55:33.935564+0000","last_active":"2024-05-30T06:55:35.935412+0000","last_peered":"2024-05-30T06:55:35.935412+0000","last_clean":"2024-05-30T06:55:35.935412+0000","last_became_active":"2024-05-30T06:55:33.934422+0000","last_became_peered":"2024-05-30T06:55:33.934422+0000","last_unstale":"2024-05-30T06:55:35.935412+0000","last_undegraded":"2024-05-30T06:55:35.935412+0000","last_fullsized":"2024-05-30T06:55:35.935412+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:24:00.583740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930762+0000","last_change":"2024-05-30T06:55:33.930762+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930762+0000","last_undegraded":"2024-05-30T06:55:33.930762+0000","last_fullsized":"2024-05-30T06:55:33.930762+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935114+0000","last_change":"2024-05-30T06:55:33.944968+0000","last_active":"2024-05-30T06:55:35.935114+0000","last_peered":"2024-05-30T06:55:35.935114+0000","last_clean":"2024-05-30T06:55:35.935114+0000","last_became_active":"2024-05-30T06:55:33.944653+0000","last_became_peered":"2024-05-30T06:55:33.944653+0000","last_unstale":"2024-05-30T06:55:35.935114+0000","last_undegraded":"2024-05-30T06:55:35.935114+0000","last_fullsized":"2024-05-30T06:55:35.935114+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:56:24.913375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.934493+0000","last_change":"2024-05-30T06:55:33.934493+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.934493+0000","last_undegraded":"2024-05-30T06:55:33.934493+0000","last_fullsized":"2024-05-30T06:55:33.934493+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.940417+0000","last_change":"2024-05-30T06:55:33.939347+0000","last_active":"2024-05-30T06:55:33.940417+0000","last_peered":"2024-05-30T06:55:33.940417+0000","last_clean":"2024-05-30T06:55:33.940417+0000","last_became_active":"2024-05-30T06:55:33.939016+0000","last_became_peered":"2024-05-30T06:55:33.939016+0000","last_unstale":"2024-05-30T06:55:33.940417+0000","last_undegraded":"2024-05-30T06:55:33.940417+0000","last_fullsized":"2024-05-30T06:55:33.940417+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:58:13.201695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929615+0000","last_change":"2024-05-30T06:55:33.929615+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929615+0000","last_undegraded":"2024-05-30T06:55:33.929615+0000","last_fullsized":"2024-05-30T06:55:33.929615+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.938880+0000","last_change":"2024-05-30T06:55:33.937075+0000","last_active":"2024-05-30T06:55:33.938880+0000","last_peered":"2024-05-30T06:55:33.938880+0000","last_clean":"2024-05-30T06:55:33.938880+0000","last_became_active":"2024-05-30T06:55:33.936712+0000","last_became_peered":"2024-05-30T06:55:33.936712+0000","last_unstale":"2024-05-30T06:55:33.938880+0000","last_undegraded":"2024-05-30T06:55:33.938880+0000","last_fullsized":"2024-05-30T06:55:33.938880+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:11:50.696004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930522+0000","last_change":"2024-05-30T06:55:33.930522+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930522+0000","last_undegraded":"2024-05-30T06:55:33.930522+0000","last_fullsized":"2024-05-30T06:55:33.930522+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934677+0000","last_change":"2024-05-30T06:55:33.939978+0000","last_active":"2024-05-30T06:55:35.934677+0000","last_peered":"2024-05-30T06:55:35.934677+0000","last_clean":"2024-05-30T06:55:35.934677+0000","last_became_active":"2024-05-30T06:55:33.939661+0000","last_became_peered":"2024-05-30T06:55:33.939661+0000","last_unstale":"2024-05-30T06:55:35.934677+0000","last_undegraded":"2024-05-30T06:55:35.934677+0000","last_fullsized":"2024-05-30T06:55:35.934677+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:21:54.215474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935525+0000","last_change":"2024-05-30T06:55:34.947321+0000","last_active":"2024-05-30T06:55:35.935525+0000","last_peered":"2024-05-30T06:55:35.935525+0000","last_clean":"2024-05-30T06:55:35.935525+0000","last_became_active":"2024-05-30T06:55:34.947060+0000","last_became_peered":"2024-05-30T06:55:34.947060+0000","last_unstale":"2024-05-30T06:55:35.935525+0000","last_undegraded":"2024-05-30T06:55:35.935525+0000","last_fullsized":"2024-05-30T06:55:35.935525+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:54.211731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.939513+0000","last_change":"2024-05-30T06:55:33.937091+0000","last_active":"2024-05-30T06:55:33.939513+0000","last_peered":"2024-05-30T06:55:33.939513+0000","last_clean":"2024-05-30T06:55:33.939513+0000","last_became_active":"2024-05-30T06:55:33.936792+0000","last_became_peered":"2024-05-30T06:55:33.936792+0000","last_unstale":"2024-05-30T06:55:33.939513+0000","last_undegraded":"2024-05-30T06:55:33.939513+0000","last_fullsized":"2024-05-30T06:55:33.939513+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:48:21.768843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930529+0000","last_change":"2024-05-30T06:55:33.930529+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930529+0000","last_undegraded":"2024-05-30T06:55:33.930529+0000","last_fullsized":"2024-05-30T06:55:33.930529+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935606+0000","last_change":"2024-05-30T06:55:33.947953+0000","last_active":"2024-05-30T06:55:35.935606+0000","last_peered":"2024-05-30T06:55:35.935606+0000","last_clean":"2024-05-30T06:55:35.935606+0000","last_became_active":"2024-05-30T06:55:33.947682+0000","last_became_peered":"2024-05-30T06:55:33.947682+0000","last_unstale":"2024-05-30T06:55:35.935606+0000","last_undegraded":"2024-05-30T06:55:35.935606+0000","last_fullsized":"2024-05-30T06:55:35.935606+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:42.797019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930665+0000","last_change":"2024-05-30T06:55:33.930665+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930665+0000","last_undegraded":"2024-05-30T06:55:33.930665+0000","last_fullsized":"2024-05-30T06:55:33.930665+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935042+0000","last_change":"2024-05-30T06:55:33.942331+0000","last_active":"2024-05-30T06:55:35.935042+0000","last_peered":"2024-05-30T06:55:35.935042+0000","last_clean":"2024-05-30T06:55:35.935042+0000","last_became_active":"2024-05-30T06:55:33.942074+0000","last_became_peered":"2024-05-30T06:55:33.942074+0000","last_unstale":"2024-05-30T06:55:35.935042+0000","last_undegraded":"2024-05-30T06:55:35.935042+0000","last_fullsized":"2024-05-30T06:55:35.935042+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:28:44.612162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931236+0000","last_change":"2024-05-30T06:55:33.931236+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931236+0000","last_undegraded":"2024-05-30T06:55:33.931236+0000","last_fullsized":"2024-05-30T06:55:33.931236+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.942447+0000","last_change":"2024-05-30T06:55:33.938985+0000","last_active":"2024-05-30T06:55:33.942447+0000","last_peered":"2024-05-30T06:55:33.942447+0000","last_clean":"2024-05-30T06:55:33.942447+0000","last_became_active":"2024-05-30T06:55:33.938648+0000","last_became_peered":"2024-05-30T06:55:33.938648+0000","last_unstale":"2024-05-30T06:55:33.942447+0000","last_undegraded":"2024-05-30T06:55:33.942447+0000","last_fullsized":"2024-05-30T06:55:33.942447+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:34.836617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930350+0000","last_change":"2024-05-30T06:55:33.930350+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930350+0000","last_undegraded":"2024-05-30T06:55:33.930350+0000","last_fullsized":"2024-05-30T06:55:33.930350+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935203+0000","last_change":"2024-05-30T06:55:33.934159+0000","last_active":"2024-05-30T06:55:35.935203+0000","last_peered":"2024-05-30T06:55:35.935203+0000","last_clean":"2024-05-30T06:55:35.935203+0000","last_became_active":"2024-05-30T06:55:33.933841+0000","last_became_peered":"2024-05-30T06:55:33.933841+0000","last_unstale":"2024-05-30T06:55:35.935203+0000","last_undegraded":"2024-05-30T06:55:35.935203+0000","last_fullsized":"2024-05-30T06:55:35.935203+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:47:19.119777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.924820+0000","last_change":"2024-05-30T06:55:33.924820+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.924820+0000","last_undegraded":"2024-05-30T06:55:33.924820+0000","last_fullsized":"2024-05-30T06:55:33.924820+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.942413+0000","last_change":"2024-05-30T06:55:33.938260+0000","last_active":"2024-05-30T06:55:33.942413+0000","last_peered":"2024-05-30T06:55:33.942413+0000","last_clean":"2024-05-30T06:55:33.942413+0000","last_became_active":"2024-05-30T06:55:33.937992+0000","last_became_peered":"2024-05-30T06:55:33.937992+0000","last_unstale":"2024-05-30T06:55:33.942413+0000","last_undegraded":"2024-05-30T06:55:33.942413+0000","last_fullsized":"2024-05-30T06:55:33.942413+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:06:06.482391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929113+0000","last_change":"2024-05-30T06:55:33.929113+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929113+0000","last_undegraded":"2024-05-30T06:55:33.929113+0000","last_fullsized":"2024-05-30T06:55:33.929113+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549631+0000","last_change":"2024-05-30T06:55:33.937358+0000","last_active":"2024-05-30T06:55:36.549631+0000","last_peered":"2024-05-30T06:55:36.549631+0000","last_clean":"2024-05-30T06:55:36.549631+0000","last_became_active":"2024-05-30T06:55:33.937026+0000","last_became_peered":"2024-05-30T06:55:33.937026+0000","last_unstale":"2024-05-30T06:55:36.549631+0000","last_undegraded":"2024-05-30T06:55:36.549631+0000","last_fullsized":"2024-05-30T06:55:36.549631+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:14:56.877290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930033+0000","last_change":"2024-05-30T06:55:33.930033+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930033+0000","last_undegraded":"2024-05-30T06:55:33.930033+0000","last_fullsized":"2024-05-30T06:55:33.930033+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.946883+0000","last_change":"2024-05-30T06:55:33.944390+0000","last_active":"2024-05-30T06:55:33.946883+0000","last_peered":"2024-05-30T06:55:33.946883+0000","last_clean":"2024-05-30T06:55:33.946883+0000","last_became_active":"2024-05-30T06:55:33.943939+0000","last_became_peered":"2024-05-30T06:55:33.943939+0000","last_unstale":"2024-05-30T06:55:33.946883+0000","last_undegraded":"2024-05-30T06:55:33.946883+0000","last_fullsized":"2024-05-30T06:55:33.946883+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:29:56.235206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.937147+0000","last_change":"2024-05-30T06:55:33.937147+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.937147+0000","last_undegraded":"2024-05-30T06:55:33.937147+0000","last_fullsized":"2024-05-30T06:55:33.937147+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.943726+0000","last_change":"2024-05-30T06:55:33.942731+0000","last_active":"2024-05-30T06:55:33.943726+0000","last_peered":"2024-05-30T06:55:33.943726+0000","last_clean":"2024-05-30T06:55:33.943726+0000","last_became_active":"2024-05-30T06:55:33.942215+0000","last_became_peered":"2024-05-30T06:55:33.942215+0000","last_unstale":"2024-05-30T06:55:33.943726+0000","last_undegraded":"2024-05-30T06:55:33.943726+0000","last_fullsized":"2024-05-30T06:55:33.943726+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:42.797019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":323,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.934723+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:55:33.934723+0000","last_peered":"2024-05-30T06:55:33.934723+0000","last_clean":"2024-05-30T06:55:33.934723+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:55:33.934723+0000","last_undegraded":"2024-05-30T06:55:33.934723+0000","last_fullsized":"2024-05-30T06:55:33.934723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123156,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248684,"statfs":{"total":96636764160,"available":96510652416,"internally_reserved":0,"allocated":1830912,"data_stored":1127129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575015,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122552,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249288,"statfs":{"total":96636764160,"available":96511270912,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575015,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76728,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295112,"statfs":{"total":96636764160,"available":96558194688,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575014,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64264,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94307576,"statfs":{"total":96636764160,"available":96570957824,"internally_reserved":0,"allocated":1236992,"data_stored":536761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140656,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231184,"statfs":{"total":96636764160,"available":96492732416,"internally_reserved":0,"allocated":1277952,"data_stored":551526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":142735815},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575013,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140600,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231240,"statfs":{"total":96636764160,"available":96492789760,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575015,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104504,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94267336,"statfs":{"total":96636764160,"available":96529752064,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575016,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77348,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294492,"statfs":{"total":96636764160,"available":96557559808,"internally_reserved":0,"allocated":1859584,"data_stored":1140842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:55:39.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2024-05-30T06:55:39.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.931039+0000', 'last_change': '2024-05-30T06:55:33.931039+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.931039+0000', 'last_undegraded': '2024-05-30T06:55:33.931039+0000', 'last_fullsized': '2024-05-30T06:55:33.931039+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:55:39.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2024-05-30T06:55:39.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.929293+0000', 'last_change': '2024-05-30T06:55:33.929293+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.929293+0000', 'last_undegraded': '2024-05-30T06:55:33.929293+0000', 'last_fullsized': '2024-05-30T06:55:33.929293+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:55:39.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2024-05-30T06:55:39.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.929953+0000', 'last_change': '2024-05-30T06:55:33.929953+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.929953+0000', 'last_undegraded': '2024-05-30T06:55:33.929953+0000', 'last_fullsized': '2024-05-30T06:55:33.929953+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:55:39.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2024-05-30T06:55:39.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.932061+0000', 'last_change': '2024-05-30T06:55:33.932061+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.932061+0000', 'last_undegraded': '2024-05-30T06:55:33.932061+0000', 'last_fullsized': '2024-05-30T06:55:33.932061+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:55:39.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2024-05-30T06:55:39.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.931628+0000', 'last_change': '2024-05-30T06:55:33.931628+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.931628+0000', 'last_undegraded': '2024-05-30T06:55:33.931628+0000', 'last_fullsized': '2024-05-30T06:55:33.931628+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:55:39.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2024-05-30T06:55:39.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.927115+0000', 'last_change': '2024-05-30T06:55:33.927115+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.927115+0000', 'last_undegraded': '2024-05-30T06:55:33.927115+0000', 'last_fullsized': '2024-05-30T06:55:33.927115+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:55:39.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2024-05-30T06:55:39.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.931449+0000', 'last_change': '2024-05-30T06:55:33.931449+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.931449+0000', 'last_undegraded': '2024-05-30T06:55:33.931449+0000', 'last_fullsized': '2024-05-30T06:55:33.931449+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:55:39.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2024-05-30T06:55:39.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.935677+0000', 'last_change': '2024-05-30T06:55:33.935677+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.935677+0000', 'last_undegraded': '2024-05-30T06:55:33.935677+0000', 'last_fullsized': '2024-05-30T06:55:33.935677+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:55:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2024-05-30T06:55:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.927552+0000', 'last_change': '2024-05-30T06:55:33.927552+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.927552+0000', 'last_undegraded': '2024-05-30T06:55:33.927552+0000', 'last_fullsized': '2024-05-30T06:55:33.927552+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:55:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2024-05-30T06:55:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.939233+0000', 'last_change': '2024-05-30T06:55:33.939233+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.939233+0000', 'last_undegraded': '2024-05-30T06:55:33.939233+0000', 'last_fullsized': '2024-05-30T06:55:33.939233+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:55:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2024-05-30T06:55:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.931145+0000', 'last_change': '2024-05-30T06:55:33.931145+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.931145+0000', 'last_undegraded': '2024-05-30T06:55:33.931145+0000', 'last_fullsized': '2024-05-30T06:55:33.931145+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:55:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2024-05-30T06:55:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.936017+0000', 'last_change': '2024-05-30T06:55:33.936017+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.936017+0000', 'last_undegraded': '2024-05-30T06:55:33.936017+0000', 'last_fullsized': '2024-05-30T06:55:33.936017+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:55:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2024-05-30T06:55:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.925212+0000', 'last_change': '2024-05-30T06:55:33.925212+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.925212+0000', 'last_undegraded': '2024-05-30T06:55:33.925212+0000', 'last_fullsized': '2024-05-30T06:55:33.925212+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:55:39.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2024-05-30T06:55:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.934914+0000', 'last_change': '2024-05-30T06:55:33.934914+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.934914+0000', 'last_undegraded': '2024-05-30T06:55:33.934914+0000', 'last_fullsized': '2024-05-30T06:55:33.934914+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:55:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2024-05-30T06:55:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.930690+0000', 'last_change': '2024-05-30T06:55:33.930690+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.930690+0000', 'last_undegraded': '2024-05-30T06:55:33.930690+0000', 'last_fullsized': '2024-05-30T06:55:33.930690+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:55:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2024-05-30T06:55:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.933468+0000', 'last_change': '2024-05-30T06:55:33.933468+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.933468+0000', 'last_undegraded': '2024-05-30T06:55:33.933468+0000', 'last_fullsized': '2024-05-30T06:55:33.933468+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:55:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2024-05-30T06:55:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.935235+0000', 'last_change': '2024-05-30T06:55:33.935235+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.935235+0000', 'last_undegraded': '2024-05-30T06:55:33.935235+0000', 'last_fullsized': '2024-05-30T06:55:33.935235+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:55:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2024-05-30T06:55:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.930851+0000', 'last_change': '2024-05-30T06:55:33.930851+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.930851+0000', 'last_undegraded': '2024-05-30T06:55:33.930851+0000', 'last_fullsized': '2024-05-30T06:55:33.930851+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:55:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2024-05-30T06:55:39.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.931295+0000', 'last_change': '2024-05-30T06:55:33.931295+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.931295+0000', 'last_undegraded': '2024-05-30T06:55:33.931295+0000', 'last_fullsized': '2024-05-30T06:55:33.931295+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:55:39.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2024-05-30T06:55:39.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.927240+0000', 'last_change': '2024-05-30T06:55:33.927240+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.927240+0000', 'last_undegraded': '2024-05-30T06:55:33.927240+0000', 'last_fullsized': '2024-05-30T06:55:33.927240+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:55:39.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2024-05-30T06:55:39.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.937565+0000', 'last_change': '2024-05-30T06:55:33.937565+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.937565+0000', 'last_undegraded': '2024-05-30T06:55:33.937565+0000', 'last_fullsized': '2024-05-30T06:55:33.937565+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:55:39.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2024-05-30T06:55:39.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.931138+0000', 'last_change': '2024-05-30T06:55:33.931138+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.931138+0000', 'last_undegraded': '2024-05-30T06:55:33.931138+0000', 'last_fullsized': '2024-05-30T06:55:33.931138+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:55:39.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2024-05-30T06:55:39.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.926112+0000', 'last_change': '2024-05-30T06:55:33.926112+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.926112+0000', 'last_undegraded': '2024-05-30T06:55:33.926112+0000', 'last_fullsized': '2024-05-30T06:55:33.926112+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:55:39.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2024-05-30T06:55:39.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.925670+0000', 'last_change': '2024-05-30T06:55:33.925670+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.925670+0000', 'last_undegraded': '2024-05-30T06:55:33.925670+0000', 'last_fullsized': '2024-05-30T06:55:33.925670+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:55:39.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2024-05-30T06:55:39.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.932666+0000', 'last_change': '2024-05-30T06:55:33.932666+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.932666+0000', 'last_undegraded': '2024-05-30T06:55:33.932666+0000', 'last_fullsized': '2024-05-30T06:55:33.932666+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:55:39.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2024-05-30T06:55:39.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.925203+0000', 'last_change': '2024-05-30T06:55:33.925203+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.925203+0000', 'last_undegraded': '2024-05-30T06:55:33.925203+0000', 'last_fullsized': '2024-05-30T06:55:33.925203+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:55:39.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2024-05-30T06:55:39.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.926683+0000', 'last_change': '2024-05-30T06:55:33.926683+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.926683+0000', 'last_undegraded': '2024-05-30T06:55:33.926683+0000', 'last_fullsized': '2024-05-30T06:55:33.926683+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:55:39.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2024-05-30T06:55:39.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.930355+0000', 'last_change': '2024-05-30T06:55:33.930355+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.930355+0000', 'last_undegraded': '2024-05-30T06:55:33.930355+0000', 'last_fullsized': '2024-05-30T06:55:33.930355+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:55:39.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2024-05-30T06:55:39.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.934821+0000', 'last_change': '2024-05-30T06:55:33.934821+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.934821+0000', 'last_undegraded': '2024-05-30T06:55:33.934821+0000', 'last_fullsized': '2024-05-30T06:55:33.934821+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:55:39.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2024-05-30T06:55:39.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.928813+0000', 'last_change': '2024-05-30T06:55:33.928813+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.928813+0000', 'last_undegraded': '2024-05-30T06:55:33.928813+0000', 'last_fullsized': '2024-05-30T06:55:33.928813+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:55:39.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2024-05-30T06:55:39.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.925487+0000', 'last_change': '2024-05-30T06:55:33.925487+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.925487+0000', 'last_undegraded': '2024-05-30T06:55:33.925487+0000', 'last_fullsized': '2024-05-30T06:55:33.925487+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:55:39.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2024-05-30T06:55:39.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.929341+0000', 'last_change': '2024-05-30T06:55:33.929341+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.929341+0000', 'last_undegraded': '2024-05-30T06:55:33.929341+0000', 'last_fullsized': '2024-05-30T06:55:33.929341+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:55:39.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2024-05-30T06:55:39.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.929541+0000', 'last_change': '2024-05-30T06:55:33.929541+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.929541+0000', 'last_undegraded': '2024-05-30T06:55:33.929541+0000', 'last_fullsized': '2024-05-30T06:55:33.929541+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:55:39.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2024-05-30T06:55:39.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.926196+0000', 'last_change': '2024-05-30T06:55:33.926196+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.926196+0000', 'last_undegraded': '2024-05-30T06:55:33.926196+0000', 'last_fullsized': '2024-05-30T06:55:33.926196+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:55:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2024-05-30T06:55:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.931966+0000', 'last_change': '2024-05-30T06:55:33.931966+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.931966+0000', 'last_undegraded': '2024-05-30T06:55:33.931966+0000', 'last_fullsized': '2024-05-30T06:55:33.931966+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:55:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2024-05-30T06:55:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.930762+0000', 'last_change': '2024-05-30T06:55:33.930762+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.930762+0000', 'last_undegraded': '2024-05-30T06:55:33.930762+0000', 'last_fullsized': '2024-05-30T06:55:33.930762+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:55:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2024-05-30T06:55:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.934493+0000', 'last_change': '2024-05-30T06:55:33.934493+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.934493+0000', 'last_undegraded': '2024-05-30T06:55:33.934493+0000', 'last_fullsized': '2024-05-30T06:55:33.934493+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:55:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2024-05-30T06:55:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.929615+0000', 'last_change': '2024-05-30T06:55:33.929615+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.929615+0000', 'last_undegraded': '2024-05-30T06:55:33.929615+0000', 'last_fullsized': '2024-05-30T06:55:33.929615+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:55:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2024-05-30T06:55:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.930522+0000', 'last_change': '2024-05-30T06:55:33.930522+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.930522+0000', 'last_undegraded': '2024-05-30T06:55:33.930522+0000', 'last_fullsized': '2024-05-30T06:55:33.930522+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:55:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2024-05-30T06:55:39.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.930529+0000', 'last_change': '2024-05-30T06:55:33.930529+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.930529+0000', 'last_undegraded': '2024-05-30T06:55:33.930529+0000', 'last_fullsized': '2024-05-30T06:55:33.930529+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:55:39.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2024-05-30T06:55:39.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.930665+0000', 'last_change': '2024-05-30T06:55:33.930665+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.930665+0000', 'last_undegraded': '2024-05-30T06:55:33.930665+0000', 'last_fullsized': '2024-05-30T06:55:33.930665+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:55:39.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2024-05-30T06:55:39.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.931236+0000', 'last_change': '2024-05-30T06:55:33.931236+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.931236+0000', 'last_undegraded': '2024-05-30T06:55:33.931236+0000', 'last_fullsized': '2024-05-30T06:55:33.931236+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:55:39.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2024-05-30T06:55:39.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.930350+0000', 'last_change': '2024-05-30T06:55:33.930350+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.930350+0000', 'last_undegraded': '2024-05-30T06:55:33.930350+0000', 'last_fullsized': '2024-05-30T06:55:33.930350+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:55:39.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2024-05-30T06:55:39.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.924820+0000', 'last_change': '2024-05-30T06:55:33.924820+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.924820+0000', 'last_undegraded': '2024-05-30T06:55:33.924820+0000', 'last_fullsized': '2024-05-30T06:55:33.924820+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:55:39.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2024-05-30T06:55:39.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.929113+0000', 'last_change': '2024-05-30T06:55:33.929113+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.929113+0000', 'last_undegraded': '2024-05-30T06:55:33.929113+0000', 'last_fullsized': '2024-05-30T06:55:33.929113+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:55:39.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2024-05-30T06:55:39.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.930033+0000', 'last_change': '2024-05-30T06:55:33.930033+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.930033+0000', 'last_undegraded': '2024-05-30T06:55:33.930033+0000', 'last_fullsized': '2024-05-30T06:55:33.930033+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:55:39.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2024-05-30T06:55:39.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:55:33.937147+0000', 'last_change': '2024-05-30T06:55:33.937147+0000', 'last_active': '2024-05-30T06:55:33.911105+0000', 'last_peered': '2024-05-30T06:55:33.911105+0000', 'last_clean': '2024-05-30T06:55:33.911105+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:55:33.937147+0000', 'last_undegraded': '2024-05-30T06:55:33.937147+0000', 'last_fullsized': '2024-05-30T06:55:33.937147+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'last_clean_scrub_stamp': '2024-05-30T06:55:33.911105+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:55:39.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-30T06:55:40.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.029+0000 7fee2fe00640 1 Processor -- start 2024-05-30T06:55:40.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.029+0000 7fee2fe00640 1 -- start start 2024-05-30T06:55:40.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.029+0000 7fee2fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee280b2e20 0x7fee28160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:40.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.029+0000 7fee2fe00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee280d0430 con 0x7fee281609c0 2024-05-30T06:55:40.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.029+0000 7fee2fe00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee280d0710 con 0x7fee2809ba70 2024-05-30T06:55:40.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.029+0000 7fee2fe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fee280b3200 con 0x7fee280b2e20 2024-05-30T06:55:40.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.029+0000 7fee2ca00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fee281609c0 0x7fee280cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47410/0 (socket says 172.21.15.37:47410) 2024-05-30T06:55:40.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.029+0000 7fee2ca00640 1 -- 172.21.15.37:0/3426274958 learned_addr learned my addr 172.21.15.37:0/3426274958 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:40.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.029+0000 7fee2d400640 1 --2- 172.21.15.37:0/3426274958 >> v2:172.21.15.37:3300/0 conn(0x7fee280b2e20 0x7fee28160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:40.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.029+0000 7fee2d400640 1 -- 172.21.15.37:0/3426274958 >> v1:172.21.15.105:6789/0 conn(0x7fee2809ba70 legacy=0x7fee280cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:40.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.029+0000 7fee2d400640 1 -- 172.21.15.37:0/3426274958 >> v1:172.21.15.37:6789/0 conn(0x7fee281609c0 legacy=0x7fee280cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:40.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.029+0000 7fee2d400640 1 -- 172.21.15.37:0/3426274958 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee280b35f0 con 0x7fee280b2e20 2024-05-30T06:55:40.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.029+0000 7fee27e00640 1 -- 172.21.15.37:0/3426274958 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822815154 0 0) 0x7fee280d0430 con 0x7fee281609c0 2024-05-30T06:55:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.033+0000 7fee2d400640 1 --2- 172.21.15.37:0/3426274958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280b2e20 0x7fee28160480 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0097c0 tx=0x7fee1c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e13c7afb0e8e482 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.033+0000 7fee27e00640 1 -- 172.21.15.37:0/3426274958 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0b0070 con 0x7fee280b2e20 2024-05-30T06:55:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.033+0000 7fee27e00640 1 -- 172.21.15.37:0/3426274958 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1c0ab600 con 0x7fee280b2e20 2024-05-30T06:55:40.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.033+0000 7fee27e00640 1 -- 172.21.15.37:0/3426274958 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0ab9d0 con 0x7fee280b2e20 2024-05-30T06:55:40.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.033+0000 7fee2fe00640 1 -- 172.21.15.37:0/3426274958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280b2e20 msgr2=0x7fee28160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:40.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.033+0000 7fee2fe00640 1 --2- 172.21.15.37:0/3426274958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280b2e20 0x7fee28160480 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0097c0 tx=0x7fee1c01c4a0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.033+0000 7fee2fe00640 1 -- 172.21.15.37:0/3426274958 shutdown_connections 2024-05-30T06:55:40.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.033+0000 7fee2fe00640 1 --2- 172.21.15.37:0/3426274958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280b2e20 0x7fee28160480 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.033+0000 7fee2fe00640 1 -- 172.21.15.37:0/3426274958 >> 172.21.15.37:0/3426274958 conn(0x7fee280b4100 msgr2=0x7fee280b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:40.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.033+0000 7fee2fe00640 1 -- 172.21.15.37:0/3426274958 shutdown_connections 2024-05-30T06:55:40.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.033+0000 7fee2fe00640 1 -- 172.21.15.37:0/3426274958 wait complete. 2024-05-30T06:55:40.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2fe00640 1 Processor -- start 2024-05-30T06:55:40.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2fe00640 1 -- start start 2024-05-30T06:55:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2809ba70 0x7fee28158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2fe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee280b2e20 0x7fee28157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2fe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee281609c0 0x7fee2815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee2816afe0 con 0x7fee2809ba70 2024-05-30T06:55:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2fe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee280b33a0 con 0x7fee281609c0 2024-05-30T06:55:40.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2fe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fee2816b160 con 0x7fee280b2e20 2024-05-30T06:55:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2809ba70 0x7fee28158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2809ba70 0x7fee28158ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45070/0 (socket says 172.21.15.37:45070) 2024-05-30T06:55:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2d400640 1 -- 172.21.15.37:0/3847330131 learned_addr learned my addr 172.21.15.37:0/3847330131 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2ca00640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee280b2e20 0x7fee28157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2de00640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee281609c0 0x7fee2815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2d400640 1 -- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee280b2e20 msgr2=0x7fee28157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2d400640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee280b2e20 0x7fee28157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2d400640 1 -- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee281609c0 msgr2=0x7fee2815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2d400640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee281609c0 0x7fee2815a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2d400640 1 -- 172.21.15.37:0/3847330131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee281680a0 con 0x7fee2809ba70 2024-05-30T06:55:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2de00640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee281609c0 0x7fee2815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2d400640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2809ba70 0x7fee28158ac0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0190b0 tx=0x7fee1c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee25600640 1 -- 172.21.15.37:0/3847330131 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0b0040 con 0x7fee2809ba70 2024-05-30T06:55:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee25600640 1 -- 172.21.15.37:0/3847330131 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1c0ba070 con 0x7fee2809ba70 2024-05-30T06:55:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2fe00640 1 -- 172.21.15.37:0/3847330131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee28168380 con 0x7fee2809ba70 2024-05-30T06:55:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee25600640 1 -- 172.21.15.37:0/3847330131 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0b4830 con 0x7fee2809ba70 2024-05-30T06:55:40.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2fe00640 1 -- 172.21.15.37:0/3847330131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee2815a9e0 con 0x7fee2809ba70 2024-05-30T06:55:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.037+0000 7fee2fe00640 1 -- 172.21.15.37:0/3847330131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee28068b20 con 0x7fee2809ba70 2024-05-30T06:55:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.041+0000 7fee25600640 1 -- 172.21.15.37:0/3847330131 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fee1c0ab4c0 con 0x7fee2809ba70 2024-05-30T06:55:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.041+0000 7fee25600640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee080698e0 0x7fee0806bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.041+0000 7fee25600640 1 -- 172.21.15.37:0/3847330131 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fee1c11f860 con 0x7fee2809ba70 2024-05-30T06:55:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.041+0000 7fee2ca00640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee080698e0 0x7fee0806bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.041+0000 7fee2ca00640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee080698e0 0x7fee0806bda0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fee14007fd0 tx=0x7fee14007ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.045+0000 7fee25600640 1 -- 172.21.15.37:0/3847330131 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fee1c016090 con 0x7fee2809ba70 2024-05-30T06:55:40.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee2fe00640 1 -- 172.21.15.37:0/3847330131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fee281685a0 con 0x7fee2809ba70 2024-05-30T06:55:40.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee25600640 1 -- 172.21.15.37:0/3847330131 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1099 (secure 0 0 0) 0x7fee1c0f1470 con 0x7fee2809ba70 2024-05-30T06:55:40.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:40.274 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":834,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":102,"num_osds":8,"num_up_osds":8,"osd_up_since":1717051317,"num_in_osds":8,"osd_in_since":1717051308,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":50},{"state_name":"creating+peering","count":47}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":590950,"bytes_used":870203392,"bytes_avail":772223909888,"bytes_total":773094113280,"inactive_pgs_ratio":0.48453608155250549,"write_bytes_sec":170,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":64,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8538}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-05-30T06:54:52.931035+0000","services":{}},"progress_events":{}} 2024-05-30T06:55:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee2fe00640 1 -- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee080698e0 msgr2=0x7fee0806bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee2fe00640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee080698e0 0x7fee0806bda0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fee14007fd0 tx=0x7fee14007ba0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee2fe00640 1 -- 172.21.15.37:0/3847330131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2809ba70 msgr2=0x7fee28158ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee2fe00640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2809ba70 0x7fee28158ac0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0190b0 tx=0x7fee1c019240 comp rx=0 tx=0).stop 2024-05-30T06:55:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee2fe00640 1 -- 172.21.15.37:0/3847330131 shutdown_connections 2024-05-30T06:55:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee2fe00640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee080698e0 0x7fee0806bda0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee2fe00640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee281609c0 0x7fee2815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee2fe00640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee280b2e20 0x7fee28157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee2fe00640 1 --2- 172.21.15.37:0/3847330131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee2809ba70 0x7fee28158ac0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee2fe00640 1 -- 172.21.15.37:0/3847330131 >> 172.21.15.37:0/3847330131 conn(0x7fee280b4100 msgr2=0x7fee28070400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee2fe00640 1 -- 172.21.15.37:0/3847330131 shutdown_connections 2024-05-30T06:55:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.273+0000 7fee2fe00640 1 -- 172.21.15.37:0/3847330131 wait complete. 2024-05-30T06:55:40.296 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-30T06:55:40.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:55:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.433+0000 7f21b2e00640 1 Processor -- start 2024-05-30T06:55:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.433+0000 7f21b2e00640 1 -- start start 2024-05-30T06:55:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21b2e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f21ac155e60 0x7f21ac0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21b2e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21ac06f9a0 0x7f21ac0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21b2e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ac15c8f0 con 0x7f21ac0b2ec0 2024-05-30T06:55:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21b2e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f21ac0ccff0 con 0x7f21ac155e60 2024-05-30T06:55:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21b2e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21ac0ccc80 con 0x7f21ac06f9a0 2024-05-30T06:55:40.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21a3400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21ac06f9a0 0x7f21ac0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:40.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21abe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f21ac155e60 0x7f21ac0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:40.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21a3400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21ac06f9a0 0x7f21ac0cf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:34776/0 (socket says 172.21.15.37:34776) 2024-05-30T06:55:40.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21a3400640 1 -- 172.21.15.37:0/1174157264 learned_addr learned my addr 172.21.15.37:0/1174157264 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:40.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21b0e00640 1 --1- 172.21.15.37:0/1174157264 >> v1:172.21.15.105:6789/0 conn(0x7f21ac0b2ec0 0x7f21ac0cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:53350/0 (socket says 172.21.15.37:53350) 2024-05-30T06:55:40.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21abe00640 1 -- 172.21.15.37:0/1174157264 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21ac06f9a0 msgr2=0x7f21ac0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:40.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21abe00640 1 --2- 172.21.15.37:0/1174157264 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21ac06f9a0 0x7f21ac0cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21abe00640 1 -- 172.21.15.37:0/1174157264 >> v1:172.21.15.105:6789/0 conn(0x7f21ac0b2ec0 legacy=0x7f21ac0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:40.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21ab400640 1 -- 172.21.15.37:0/1174157264 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081701684 0 0) 0x7f21ac15c8f0 con 0x7f21ac0b2ec0 2024-05-30T06:55:40.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.437+0000 7f21abe00640 1 -- 172.21.15.37:0/1174157264 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac15cbd0 con 0x7f21ac155e60 2024-05-30T06:55:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.441+0000 7f21abe00640 1 --2- 172.21.15.37:0/1174157264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ac155e60 0x7f21ac0b36a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f21940097c0 tx=0x7f219401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bab46009454b6bf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.441+0000 7f21ab400640 1 -- 172.21.15.37:0/1174157264 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21940b0070 con 0x7f21ac155e60 2024-05-30T06:55:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.441+0000 7f21ab400640 1 -- 172.21.15.37:0/1174157264 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21940ab600 con 0x7f21ac155e60 2024-05-30T06:55:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.441+0000 7f21ab400640 1 -- 172.21.15.37:0/1174157264 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21940ab9d0 con 0x7f21ac155e60 2024-05-30T06:55:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.441+0000 7f21b2e00640 1 -- 172.21.15.37:0/1174157264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ac155e60 msgr2=0x7f21ac0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.441+0000 7f21b2e00640 1 --2- 172.21.15.37:0/1174157264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ac155e60 0x7f21ac0b36a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f21940097c0 tx=0x7f219401c4a0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.441+0000 7f21b2e00640 1 -- 172.21.15.37:0/1174157264 shutdown_connections 2024-05-30T06:55:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.441+0000 7f21b2e00640 1 --2- 172.21.15.37:0/1174157264 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21ac06f9a0 0x7f21ac0cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.441+0000 7f21b2e00640 1 --2- 172.21.15.37:0/1174157264 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ac155e60 0x7f21ac0b36a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.441+0000 7f21b2e00640 1 -- 172.21.15.37:0/1174157264 >> 172.21.15.37:0/1174157264 conn(0x7f21ac0b23a0 msgr2=0x7f21ac0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:40.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.441+0000 7f21b2e00640 1 -- 172.21.15.37:0/1174157264 shutdown_connections 2024-05-30T06:55:40.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.441+0000 7f21b2e00640 1 -- 172.21.15.37:0/1174157264 wait complete. 2024-05-30T06:55:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21b2e00640 1 Processor -- start 2024-05-30T06:55:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21b2e00640 1 -- start start 2024-05-30T06:55:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21b2e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ac06f9a0 0x7f21ac0b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21b2e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ac0b2ec0 0x7f21ac14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21b2e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21ac155e60 0x7f21ac147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21b2e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac06ec20 con 0x7f21ac06f9a0 2024-05-30T06:55:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21b2e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac06eaa0 con 0x7f21ac0b2ec0 2024-05-30T06:55:40.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21b2e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21ac06eda0 con 0x7f21ac155e60 2024-05-30T06:55:40.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21abe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ac06f9a0 0x7f21ac0b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:40.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21abe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ac06f9a0 0x7f21ac0b1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45078/0 (socket says 172.21.15.37:45078) 2024-05-30T06:55:40.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21abe00640 1 -- 172.21.15.37:0/464512458 learned_addr learned my addr 172.21.15.37:0/464512458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:40.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21b0e00640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21ac155e60 0x7f21ac147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:40.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21abe00640 1 -- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21ac155e60 msgr2=0x7f21ac147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:40.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21abe00640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21ac155e60 0x7f21ac147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21a3400640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ac0b2ec0 0x7f21ac14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:40.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21abe00640 1 -- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ac0b2ec0 msgr2=0x7f21ac14a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:40.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21abe00640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ac0b2ec0 0x7f21ac14a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21abe00640 1 -- 172.21.15.37:0/464512458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac14a5f0 con 0x7f21ac06f9a0 2024-05-30T06:55:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21b0e00640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21ac155e60 0x7f21ac147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21a3400640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ac0b2ec0 0x7f21ac14a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21abe00640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ac06f9a0 0x7f21ac0b1a60 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f219401a0d0 tx=0x7f219401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21a8c00640 1 -- 172.21.15.37:0/464512458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21940b0050 con 0x7f21ac06f9a0 2024-05-30T06:55:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21a8c00640 1 -- 172.21.15.37:0/464512458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21940bc070 con 0x7f21ac06f9a0 2024-05-30T06:55:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21b2e00640 1 -- 172.21.15.37:0/464512458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21ac0b09c0 con 0x7f21ac06f9a0 2024-05-30T06:55:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21a8c00640 1 -- 172.21.15.37:0/464512458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21940b5830 con 0x7f21ac06f9a0 2024-05-30T06:55:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21b2e00640 1 -- 172.21.15.37:0/464512458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ac0b0f80 con 0x7f21ac06f9a0 2024-05-30T06:55:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.445+0000 7f21b2e00640 1 -- 172.21.15.37:0/464512458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21ac068b20 con 0x7f21ac06f9a0 2024-05-30T06:55:40.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.449+0000 7f21a8c00640 1 -- 172.21.15.37:0/464512458 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f21940b59d0 con 0x7f21ac06f9a0 2024-05-30T06:55:40.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.449+0000 7f21a8c00640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2188069910 0x7f218806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:40.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.449+0000 7f21a8c00640 1 -- 172.21.15.37:0/464512458 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f2194120160 con 0x7f21ac06f9a0 2024-05-30T06:55:40.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.449+0000 7f21a3400640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2188069910 0x7f218806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:40.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.449+0000 7f21a3400640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2188069910 0x7f218806bdd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f21ac15b5d0 tx=0x7f219c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.453+0000 7f21a8c00640 1 -- 172.21.15.37:0/464512458 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2194016090 con 0x7f21ac06f9a0 2024-05-30T06:55:40.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.617+0000 7f21b2e00640 1 -- 172.21.15.37:0/464512458 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21ac0cc9c0 con 0x7f2188069910 2024-05-30T06:55:40.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.621+0000 7f21a8c00640 1 -- 172.21.15.37:0/464512458 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+248491 (secure 0 0 0) 0x7f21ac0cc9c0 con 0x7f2188069910 2024-05-30T06:55:40.626 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:40.628 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:55:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.625+0000 7f21b2e00640 1 -- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2188069910 msgr2=0x7f218806bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.625+0000 7f21b2e00640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2188069910 0x7f218806bdd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f21ac15b5d0 tx=0x7f219c008040 comp rx=0 tx=0).stop 2024-05-30T06:55:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.625+0000 7f21b2e00640 1 -- 172.21.15.37:0/464512458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ac06f9a0 msgr2=0x7f21ac0b1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.625+0000 7f21b2e00640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ac06f9a0 0x7f21ac0b1a60 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f219401a0d0 tx=0x7f219401ace0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.625+0000 7f21b2e00640 1 -- 172.21.15.37:0/464512458 shutdown_connections 2024-05-30T06:55:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.625+0000 7f21b2e00640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21ac155e60 0x7f21ac147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.625+0000 7f21b2e00640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2188069910 0x7f218806bdd0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.625+0000 7f21b2e00640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21ac0b2ec0 0x7f21ac14a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.625+0000 7f21b2e00640 1 --2- 172.21.15.37:0/464512458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21ac06f9a0 0x7f21ac0b1a60 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.625+0000 7f21b2e00640 1 -- 172.21.15.37:0/464512458 >> 172.21.15.37:0/464512458 conn(0x7f21ac0b23a0 msgr2=0x7f21ac071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.625+0000 7f21b2e00640 1 -- 172.21.15.37:0/464512458 shutdown_connections 2024-05-30T06:55:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:40.625+0000 7f21b2e00640 1 -- 172.21.15.37:0/464512458 wait complete. 2024-05-30T06:55:40.647 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":505,"stamp":"2024-05-30T06:55:38.943423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":62,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":849808,"kb_used_data":10844,"kb_used_omap":12,"kb_used_meta":838835,"kb_avail":754124912,"statfs":{"total":773094113280,"available":772223909888,"internally_reserved":0,"allocated":11104256,"data_stored":5478090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":858967600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001565"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931039+0000","last_change":"2024-05-30T06:55:33.931039+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931039+0000","last_undegraded":"2024-05-30T06:55:33.931039+0000","last_fullsized":"2024-05-30T06:55:33.931039+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935371+0000","last_change":"2024-05-30T06:55:34.955973+0000","last_active":"2024-05-30T06:55:35.935371+0000","last_peered":"2024-05-30T06:55:35.935371+0000","last_clean":"2024-05-30T06:55:35.935371+0000","last_became_active":"2024-05-30T06:55:34.955604+0000","last_became_peered":"2024-05-30T06:55:34.955604+0000","last_unstale":"2024-05-30T06:55:35.935371+0000","last_undegraded":"2024-05-30T06:55:35.935371+0000","last_fullsized":"2024-05-30T06:55:35.935371+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:13.858335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929293+0000","last_change":"2024-05-30T06:55:33.929293+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929293+0000","last_undegraded":"2024-05-30T06:55:33.929293+0000","last_fullsized":"2024-05-30T06:55:33.929293+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550531+0000","last_change":"2024-05-30T06:55:34.945824+0000","last_active":"2024-05-30T06:55:36.550531+0000","last_peered":"2024-05-30T06:55:36.550531+0000","last_clean":"2024-05-30T06:55:36.550531+0000","last_became_active":"2024-05-30T06:55:34.944885+0000","last_became_peered":"2024-05-30T06:55:34.944885+0000","last_unstale":"2024-05-30T06:55:36.550531+0000","last_undegraded":"2024-05-30T06:55:36.550531+0000","last_fullsized":"2024-05-30T06:55:36.550531+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:39.774985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929953+0000","last_change":"2024-05-30T06:55:33.929953+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929953+0000","last_undegraded":"2024-05-30T06:55:33.929953+0000","last_fullsized":"2024-05-30T06:55:33.929953+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.932061+0000","last_change":"2024-05-30T06:55:33.932061+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.932061+0000","last_undegraded":"2024-05-30T06:55:33.932061+0000","last_fullsized":"2024-05-30T06:55:33.932061+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931628+0000","last_change":"2024-05-30T06:55:33.931628+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931628+0000","last_undegraded":"2024-05-30T06:55:33.931628+0000","last_fullsized":"2024-05-30T06:55:33.931628+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934796+0000","last_change":"2024-05-30T06:55:34.952580+0000","last_active":"2024-05-30T06:55:35.934796+0000","last_peered":"2024-05-30T06:55:35.934796+0000","last_clean":"2024-05-30T06:55:35.934796+0000","last_became_active":"2024-05-30T06:55:34.952313+0000","last_became_peered":"2024-05-30T06:55:34.952313+0000","last_unstale":"2024-05-30T06:55:35.934796+0000","last_undegraded":"2024-05-30T06:55:35.934796+0000","last_fullsized":"2024-05-30T06:55:35.934796+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:54:03.363077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.927115+0000","last_change":"2024-05-30T06:55:33.927115+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.927115+0000","last_undegraded":"2024-05-30T06:55:33.927115+0000","last_fullsized":"2024-05-30T06:55:33.927115+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931449+0000","last_change":"2024-05-30T06:55:33.931449+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931449+0000","last_undegraded":"2024-05-30T06:55:33.931449+0000","last_fullsized":"2024-05-30T06:55:33.931449+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.935677+0000","last_change":"2024-05-30T06:55:33.935677+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.935677+0000","last_undegraded":"2024-05-30T06:55:33.935677+0000","last_fullsized":"2024-05-30T06:55:33.935677+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.927552+0000","last_change":"2024-05-30T06:55:33.927552+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.927552+0000","last_undegraded":"2024-05-30T06:55:33.927552+0000","last_fullsized":"2024-05-30T06:55:33.927552+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550365+0000","last_change":"2024-05-30T06:55:34.952578+0000","last_active":"2024-05-30T06:55:36.550365+0000","last_peered":"2024-05-30T06:55:36.550365+0000","last_clean":"2024-05-30T06:55:36.550365+0000","last_became_active":"2024-05-30T06:55:34.952237+0000","last_became_peered":"2024-05-30T06:55:34.952237+0000","last_unstale":"2024-05-30T06:55:36.550365+0000","last_undegraded":"2024-05-30T06:55:36.550365+0000","last_fullsized":"2024-05-30T06:55:36.550365+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:54.211731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.939233+0000","last_change":"2024-05-30T06:55:33.939233+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.939233+0000","last_undegraded":"2024-05-30T06:55:33.939233+0000","last_fullsized":"2024-05-30T06:55:33.939233+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549571+0000","last_change":"2024-05-30T06:55:34.948290+0000","last_active":"2024-05-30T06:55:36.549571+0000","last_peered":"2024-05-30T06:55:36.549571+0000","last_clean":"2024-05-30T06:55:36.549571+0000","last_became_active":"2024-05-30T06:55:34.947764+0000","last_became_peered":"2024-05-30T06:55:34.947764+0000","last_unstale":"2024-05-30T06:55:36.549571+0000","last_undegraded":"2024-05-30T06:55:36.549571+0000","last_fullsized":"2024-05-30T06:55:36.549571+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:12:13.556946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931145+0000","last_change":"2024-05-30T06:55:33.931145+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931145+0000","last_undegraded":"2024-05-30T06:55:33.931145+0000","last_fullsized":"2024-05-30T06:55:33.931145+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935244+0000","last_change":"2024-05-30T06:55:34.948066+0000","last_active":"2024-05-30T06:55:35.935244+0000","last_peered":"2024-05-30T06:55:35.935244+0000","last_clean":"2024-05-30T06:55:35.935244+0000","last_became_active":"2024-05-30T06:55:34.947836+0000","last_became_peered":"2024-05-30T06:55:34.947836+0000","last_unstale":"2024-05-30T06:55:35.935244+0000","last_undegraded":"2024-05-30T06:55:35.935244+0000","last_fullsized":"2024-05-30T06:55:35.935244+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:56:43.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550353+0000","last_change":"2024-05-30T06:55:34.933997+0000","last_active":"2024-05-30T06:55:36.550353+0000","last_peered":"2024-05-30T06:55:36.550353+0000","last_clean":"2024-05-30T06:55:36.550353+0000","last_became_active":"2024-05-30T06:55:34.933752+0000","last_became_peered":"2024-05-30T06:55:34.933752+0000","last_unstale":"2024-05-30T06:55:36.550353+0000","last_undegraded":"2024-05-30T06:55:36.550353+0000","last_fullsized":"2024-05-30T06:55:36.550353+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:55.380184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.936017+0000","last_change":"2024-05-30T06:55:33.936017+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.936017+0000","last_undegraded":"2024-05-30T06:55:33.936017+0000","last_fullsized":"2024-05-30T06:55:33.936017+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925212+0000","last_change":"2024-05-30T06:55:33.925212+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925212+0000","last_undegraded":"2024-05-30T06:55:33.925212+0000","last_fullsized":"2024-05-30T06:55:33.925212+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.934914+0000","last_change":"2024-05-30T06:55:33.934914+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.934914+0000","last_undegraded":"2024-05-30T06:55:33.934914+0000","last_fullsized":"2024-05-30T06:55:33.934914+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934743+0000","last_change":"2024-05-30T06:55:34.948942+0000","last_active":"2024-05-30T06:55:35.934743+0000","last_peered":"2024-05-30T06:55:35.934743+0000","last_clean":"2024-05-30T06:55:35.934743+0000","last_became_active":"2024-05-30T06:55:34.948665+0000","last_became_peered":"2024-05-30T06:55:34.948665+0000","last_unstale":"2024-05-30T06:55:35.934743+0000","last_undegraded":"2024-05-30T06:55:35.934743+0000","last_fullsized":"2024-05-30T06:55:35.934743+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:19:24.696303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934808+0000","last_change":"2024-05-30T06:55:34.948065+0000","last_active":"2024-05-30T06:55:35.934808+0000","last_peered":"2024-05-30T06:55:35.934808+0000","last_clean":"2024-05-30T06:55:35.934808+0000","last_became_active":"2024-05-30T06:55:34.947811+0000","last_became_peered":"2024-05-30T06:55:34.947811+0000","last_unstale":"2024-05-30T06:55:35.934808+0000","last_undegraded":"2024-05-30T06:55:35.934808+0000","last_fullsized":"2024-05-30T06:55:35.934808+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:03:57.480410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930690+0000","last_change":"2024-05-30T06:55:33.930690+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930690+0000","last_undegraded":"2024-05-30T06:55:33.930690+0000","last_fullsized":"2024-05-30T06:55:33.930690+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.933468+0000","last_change":"2024-05-30T06:55:33.933468+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.933468+0000","last_undegraded":"2024-05-30T06:55:33.933468+0000","last_fullsized":"2024-05-30T06:55:33.933468+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935399+0000","last_change":"2024-05-30T06:55:34.957056+0000","last_active":"2024-05-30T06:55:35.935399+0000","last_peered":"2024-05-30T06:55:35.935399+0000","last_clean":"2024-05-30T06:55:35.935399+0000","last_became_active":"2024-05-30T06:55:34.956742+0000","last_became_peered":"2024-05-30T06:55:34.956742+0000","last_unstale":"2024-05-30T06:55:35.935399+0000","last_undegraded":"2024-05-30T06:55:35.935399+0000","last_fullsized":"2024-05-30T06:55:35.935399+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:55.380184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.935235+0000","last_change":"2024-05-30T06:55:33.935235+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.935235+0000","last_undegraded":"2024-05-30T06:55:33.935235+0000","last_fullsized":"2024-05-30T06:55:33.935235+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930851+0000","last_change":"2024-05-30T06:55:33.930851+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930851+0000","last_undegraded":"2024-05-30T06:55:33.930851+0000","last_fullsized":"2024-05-30T06:55:33.930851+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935062+0000","last_change":"2024-05-30T06:55:34.956501+0000","last_active":"2024-05-30T06:55:35.935062+0000","last_peered":"2024-05-30T06:55:35.935062+0000","last_clean":"2024-05-30T06:55:35.935062+0000","last_became_active":"2024-05-30T06:55:34.956081+0000","last_became_peered":"2024-05-30T06:55:34.956081+0000","last_unstale":"2024-05-30T06:55:35.935062+0000","last_undegraded":"2024-05-30T06:55:35.935062+0000","last_fullsized":"2024-05-30T06:55:35.935062+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:12:13.556946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931295+0000","last_change":"2024-05-30T06:55:33.931295+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931295+0000","last_undegraded":"2024-05-30T06:55:33.931295+0000","last_fullsized":"2024-05-30T06:55:33.931295+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549664+0000","last_change":"2024-05-30T06:55:34.932722+0000","last_active":"2024-05-30T06:55:36.549664+0000","last_peered":"2024-05-30T06:55:36.549664+0000","last_clean":"2024-05-30T06:55:36.549664+0000","last_became_active":"2024-05-30T06:55:34.932454+0000","last_became_peered":"2024-05-30T06:55:34.932454+0000","last_unstale":"2024-05-30T06:55:36.549664+0000","last_undegraded":"2024-05-30T06:55:36.549664+0000","last_fullsized":"2024-05-30T06:55:36.549664+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:56:43.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.927240+0000","last_change":"2024-05-30T06:55:33.927240+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.927240+0000","last_undegraded":"2024-05-30T06:55:33.927240+0000","last_fullsized":"2024-05-30T06:55:33.927240+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.937565+0000","last_change":"2024-05-30T06:55:33.937565+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.937565+0000","last_undegraded":"2024-05-30T06:55:33.937565+0000","last_fullsized":"2024-05-30T06:55:33.937565+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"101'4","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935297+0000","last_change":"2024-05-30T06:55:33.941005+0000","last_active":"2024-05-30T06:55:35.935297+0000","last_peered":"2024-05-30T06:55:35.935297+0000","last_clean":"2024-05-30T06:55:35.935297+0000","last_became_active":"2024-05-30T06:55:33.940750+0000","last_became_peered":"2024-05-30T06:55:33.940750+0000","last_unstale":"2024-05-30T06:55:35.935297+0000","last_undegraded":"2024-05-30T06:55:35.935297+0000","last_fullsized":"2024-05-30T06:55:35.935297+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:30:31.861812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550787+0000","last_change":"2024-05-30T06:55:34.934593+0000","last_active":"2024-05-30T06:55:36.550787+0000","last_peered":"2024-05-30T06:55:36.550787+0000","last_clean":"2024-05-30T06:55:36.550787+0000","last_became_active":"2024-05-30T06:55:34.934338+0000","last_became_peered":"2024-05-30T06:55:34.934338+0000","last_unstale":"2024-05-30T06:55:36.550787+0000","last_undegraded":"2024-05-30T06:55:36.550787+0000","last_fullsized":"2024-05-30T06:55:36.550787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:45:12.188368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.947247+0000","last_change":"2024-05-30T06:55:33.946654+0000","last_active":"2024-05-30T06:55:33.947247+0000","last_peered":"2024-05-30T06:55:33.947247+0000","last_clean":"2024-05-30T06:55:33.947247+0000","last_became_active":"2024-05-30T06:55:33.946353+0000","last_became_peered":"2024-05-30T06:55:33.946353+0000","last_unstale":"2024-05-30T06:55:33.947247+0000","last_undegraded":"2024-05-30T06:55:33.947247+0000","last_fullsized":"2024-05-30T06:55:33.947247+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:48:56.773319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931138+0000","last_change":"2024-05-30T06:55:33.931138+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931138+0000","last_undegraded":"2024-05-30T06:55:33.931138+0000","last_fullsized":"2024-05-30T06:55:33.931138+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934937+0000","last_change":"2024-05-30T06:55:33.948635+0000","last_active":"2024-05-30T06:55:35.934937+0000","last_peered":"2024-05-30T06:55:35.934937+0000","last_clean":"2024-05-30T06:55:35.934937+0000","last_became_active":"2024-05-30T06:55:33.948243+0000","last_became_peered":"2024-05-30T06:55:33.948243+0000","last_unstale":"2024-05-30T06:55:35.934937+0000","last_undegraded":"2024-05-30T06:55:35.934937+0000","last_fullsized":"2024-05-30T06:55:35.934937+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:05:45.736094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.926112+0000","last_change":"2024-05-30T06:55:33.926112+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.926112+0000","last_undegraded":"2024-05-30T06:55:33.926112+0000","last_fullsized":"2024-05-30T06:55:33.926112+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935315+0000","last_change":"2024-05-30T06:55:33.943667+0000","last_active":"2024-05-30T06:55:35.935315+0000","last_peered":"2024-05-30T06:55:35.935315+0000","last_clean":"2024-05-30T06:55:35.935315+0000","last_became_active":"2024-05-30T06:55:33.943405+0000","last_became_peered":"2024-05-30T06:55:33.943405+0000","last_unstale":"2024-05-30T06:55:35.935315+0000","last_undegraded":"2024-05-30T06:55:35.935315+0000","last_fullsized":"2024-05-30T06:55:35.935315+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:51.073112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925670+0000","last_change":"2024-05-30T06:55:33.925670+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925670+0000","last_undegraded":"2024-05-30T06:55:33.925670+0000","last_fullsized":"2024-05-30T06:55:33.925670+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.946645+0000","last_change":"2024-05-30T06:55:33.945265+0000","last_active":"2024-05-30T06:55:33.946645+0000","last_peered":"2024-05-30T06:55:33.946645+0000","last_clean":"2024-05-30T06:55:33.946645+0000","last_became_active":"2024-05-30T06:55:33.944980+0000","last_became_peered":"2024-05-30T06:55:33.944980+0000","last_unstale":"2024-05-30T06:55:33.946645+0000","last_undegraded":"2024-05-30T06:55:33.946645+0000","last_fullsized":"2024-05-30T06:55:33.946645+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:46:40.089247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.932666+0000","last_change":"2024-05-30T06:55:33.932666+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.932666+0000","last_undegraded":"2024-05-30T06:55:33.932666+0000","last_fullsized":"2024-05-30T06:55:33.932666+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934832+0000","last_change":"2024-05-30T06:55:33.937498+0000","last_active":"2024-05-30T06:55:35.934832+0000","last_peered":"2024-05-30T06:55:35.934832+0000","last_clean":"2024-05-30T06:55:35.934832+0000","last_became_active":"2024-05-30T06:55:33.937250+0000","last_became_peered":"2024-05-30T06:55:33.937250+0000","last_unstale":"2024-05-30T06:55:35.934832+0000","last_undegraded":"2024-05-30T06:55:35.934832+0000","last_fullsized":"2024-05-30T06:55:35.934832+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:05:08.736546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549551+0000","last_change":"2024-05-30T06:55:34.946842+0000","last_active":"2024-05-30T06:55:36.549551+0000","last_peered":"2024-05-30T06:55:36.549551+0000","last_clean":"2024-05-30T06:55:36.549551+0000","last_became_active":"2024-05-30T06:55:34.946578+0000","last_became_peered":"2024-05-30T06:55:34.946578+0000","last_unstale":"2024-05-30T06:55:36.549551+0000","last_undegraded":"2024-05-30T06:55:36.549551+0000","last_fullsized":"2024-05-30T06:55:36.549551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:03:57.480410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.944529+0000","last_change":"2024-05-30T06:55:33.943949+0000","last_active":"2024-05-30T06:55:33.944529+0000","last_peered":"2024-05-30T06:55:33.944529+0000","last_clean":"2024-05-30T06:55:33.944529+0000","last_became_active":"2024-05-30T06:55:33.943656+0000","last_became_peered":"2024-05-30T06:55:33.943656+0000","last_unstale":"2024-05-30T06:55:33.944529+0000","last_undegraded":"2024-05-30T06:55:33.944529+0000","last_fullsized":"2024-05-30T06:55:33.944529+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:11:33.204524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925203+0000","last_change":"2024-05-30T06:55:33.925203+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925203+0000","last_undegraded":"2024-05-30T06:55:33.925203+0000","last_fullsized":"2024-05-30T06:55:33.925203+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.945545+0000","last_change":"2024-05-30T06:55:33.942310+0000","last_active":"2024-05-30T06:55:33.945545+0000","last_peered":"2024-05-30T06:55:33.945545+0000","last_clean":"2024-05-30T06:55:33.945545+0000","last_became_active":"2024-05-30T06:55:33.941865+0000","last_became_peered":"2024-05-30T06:55:33.941865+0000","last_unstale":"2024-05-30T06:55:33.945545+0000","last_undegraded":"2024-05-30T06:55:33.945545+0000","last_fullsized":"2024-05-30T06:55:33.945545+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:44:21.582491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935529+0000","last_change":"2024-05-30T06:55:34.945420+0000","last_active":"2024-05-30T06:55:35.935529+0000","last_peered":"2024-05-30T06:55:35.935529+0000","last_clean":"2024-05-30T06:55:35.935529+0000","last_became_active":"2024-05-30T06:55:34.945163+0000","last_became_peered":"2024-05-30T06:55:34.945163+0000","last_unstale":"2024-05-30T06:55:35.935529+0000","last_undegraded":"2024-05-30T06:55:35.935529+0000","last_fullsized":"2024-05-30T06:55:35.935529+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:39.774985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.944347+0000","last_change":"2024-05-30T06:55:33.939208+0000","last_active":"2024-05-30T06:55:33.944347+0000","last_peered":"2024-05-30T06:55:33.944347+0000","last_clean":"2024-05-30T06:55:33.944347+0000","last_became_active":"2024-05-30T06:55:33.938920+0000","last_became_peered":"2024-05-30T06:55:33.938920+0000","last_unstale":"2024-05-30T06:55:33.944347+0000","last_undegraded":"2024-05-30T06:55:33.944347+0000","last_fullsized":"2024-05-30T06:55:33.944347+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:43:58.244250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.926683+0000","last_change":"2024-05-30T06:55:33.926683+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.926683+0000","last_undegraded":"2024-05-30T06:55:33.926683+0000","last_fullsized":"2024-05-30T06:55:33.926683+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550488+0000","last_change":"2024-05-30T06:55:33.941180+0000","last_active":"2024-05-30T06:55:36.550488+0000","last_peered":"2024-05-30T06:55:36.550488+0000","last_clean":"2024-05-30T06:55:36.550488+0000","last_became_active":"2024-05-30T06:55:33.940874+0000","last_became_peered":"2024-05-30T06:55:33.940874+0000","last_unstale":"2024-05-30T06:55:36.550488+0000","last_undegraded":"2024-05-30T06:55:36.550488+0000","last_fullsized":"2024-05-30T06:55:36.550488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:34:52.834290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930355+0000","last_change":"2024-05-30T06:55:33.930355+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930355+0000","last_undegraded":"2024-05-30T06:55:33.930355+0000","last_fullsized":"2024-05-30T06:55:33.930355+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.946279+0000","last_change":"2024-05-30T06:55:33.945685+0000","last_active":"2024-05-30T06:55:33.946279+0000","last_peered":"2024-05-30T06:55:33.946279+0000","last_clean":"2024-05-30T06:55:33.946279+0000","last_became_active":"2024-05-30T06:55:33.945289+0000","last_became_peered":"2024-05-30T06:55:33.945289+0000","last_unstale":"2024-05-30T06:55:33.946279+0000","last_undegraded":"2024-05-30T06:55:33.946279+0000","last_fullsized":"2024-05-30T06:55:33.946279+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:30:31.861812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.934821+0000","last_change":"2024-05-30T06:55:33.934821+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.934821+0000","last_undegraded":"2024-05-30T06:55:33.934821+0000","last_fullsized":"2024-05-30T06:55:33.934821+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.944188+0000","last_change":"2024-05-30T06:55:33.937604+0000","last_active":"2024-05-30T06:55:33.944188+0000","last_peered":"2024-05-30T06:55:33.944188+0000","last_clean":"2024-05-30T06:55:33.944188+0000","last_became_active":"2024-05-30T06:55:33.937237+0000","last_became_peered":"2024-05-30T06:55:33.937237+0000","last_unstale":"2024-05-30T06:55:33.944188+0000","last_undegraded":"2024-05-30T06:55:33.944188+0000","last_fullsized":"2024-05-30T06:55:33.944188+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:28:14.731398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549913+0000","last_change":"2024-05-30T06:55:34.943989+0000","last_active":"2024-05-30T06:55:36.549913+0000","last_peered":"2024-05-30T06:55:36.549913+0000","last_clean":"2024-05-30T06:55:36.549913+0000","last_became_active":"2024-05-30T06:55:34.943713+0000","last_became_peered":"2024-05-30T06:55:34.943713+0000","last_unstale":"2024-05-30T06:55:36.549913+0000","last_undegraded":"2024-05-30T06:55:36.549913+0000","last_fullsized":"2024-05-30T06:55:36.549913+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:13.858335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.948182+0000","last_change":"2024-05-30T06:55:33.946863+0000","last_active":"2024-05-30T06:55:33.948182+0000","last_peered":"2024-05-30T06:55:33.948182+0000","last_clean":"2024-05-30T06:55:33.948182+0000","last_became_active":"2024-05-30T06:55:33.946359+0000","last_became_peered":"2024-05-30T06:55:33.946359+0000","last_unstale":"2024-05-30T06:55:33.948182+0000","last_undegraded":"2024-05-30T06:55:33.948182+0000","last_fullsized":"2024-05-30T06:55:33.948182+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:15:41.743545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.928813+0000","last_change":"2024-05-30T06:55:33.928813+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.928813+0000","last_undegraded":"2024-05-30T06:55:33.928813+0000","last_fullsized":"2024-05-30T06:55:33.928813+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.947913+0000","last_change":"2024-05-30T06:55:33.946627+0000","last_active":"2024-05-30T06:55:33.947913+0000","last_peered":"2024-05-30T06:55:33.947913+0000","last_clean":"2024-05-30T06:55:33.947913+0000","last_became_active":"2024-05-30T06:55:33.946211+0000","last_became_peered":"2024-05-30T06:55:33.946211+0000","last_unstale":"2024-05-30T06:55:33.947913+0000","last_undegraded":"2024-05-30T06:55:33.947913+0000","last_fullsized":"2024-05-30T06:55:33.947913+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:15:11.394270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.925487+0000","last_change":"2024-05-30T06:55:33.925487+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.925487+0000","last_undegraded":"2024-05-30T06:55:33.925487+0000","last_fullsized":"2024-05-30T06:55:33.925487+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.938797+0000","last_change":"2024-05-30T06:55:33.935901+0000","last_active":"2024-05-30T06:55:33.938797+0000","last_peered":"2024-05-30T06:55:33.938797+0000","last_clean":"2024-05-30T06:55:33.938797+0000","last_became_active":"2024-05-30T06:55:33.935035+0000","last_became_peered":"2024-05-30T06:55:33.935035+0000","last_unstale":"2024-05-30T06:55:33.938797+0000","last_undegraded":"2024-05-30T06:55:33.938797+0000","last_fullsized":"2024-05-30T06:55:33.938797+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:08:49.286125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929341+0000","last_change":"2024-05-30T06:55:33.929341+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929341+0000","last_undegraded":"2024-05-30T06:55:33.929341+0000","last_fullsized":"2024-05-30T06:55:33.929341+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.942354+0000","last_change":"2024-05-30T06:55:33.935067+0000","last_active":"2024-05-30T06:55:33.942354+0000","last_peered":"2024-05-30T06:55:33.942354+0000","last_clean":"2024-05-30T06:55:33.942354+0000","last_became_active":"2024-05-30T06:55:33.934711+0000","last_became_peered":"2024-05-30T06:55:33.934711+0000","last_unstale":"2024-05-30T06:55:33.942354+0000","last_undegraded":"2024-05-30T06:55:33.942354+0000","last_fullsized":"2024-05-30T06:55:33.942354+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:42:09.909177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929541+0000","last_change":"2024-05-30T06:55:33.929541+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929541+0000","last_undegraded":"2024-05-30T06:55:33.929541+0000","last_fullsized":"2024-05-30T06:55:33.929541+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.951042+0000","last_change":"2024-05-30T06:55:33.950261+0000","last_active":"2024-05-30T06:55:33.951042+0000","last_peered":"2024-05-30T06:55:33.951042+0000","last_clean":"2024-05-30T06:55:33.951042+0000","last_became_active":"2024-05-30T06:55:33.949959+0000","last_became_peered":"2024-05-30T06:55:33.949959+0000","last_unstale":"2024-05-30T06:55:33.951042+0000","last_undegraded":"2024-05-30T06:55:33.951042+0000","last_fullsized":"2024-05-30T06:55:33.951042+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:43.463300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.926196+0000","last_change":"2024-05-30T06:55:33.926196+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.926196+0000","last_undegraded":"2024-05-30T06:55:33.926196+0000","last_fullsized":"2024-05-30T06:55:33.926196+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.940087+0000","last_change":"2024-05-30T06:55:33.935720+0000","last_active":"2024-05-30T06:55:33.940087+0000","last_peered":"2024-05-30T06:55:33.940087+0000","last_clean":"2024-05-30T06:55:33.940087+0000","last_became_active":"2024-05-30T06:55:33.935370+0000","last_became_peered":"2024-05-30T06:55:33.935370+0000","last_unstale":"2024-05-30T06:55:33.940087+0000","last_undegraded":"2024-05-30T06:55:33.940087+0000","last_fullsized":"2024-05-30T06:55:33.940087+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:20:26.023438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931966+0000","last_change":"2024-05-30T06:55:33.931966+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931966+0000","last_undegraded":"2024-05-30T06:55:33.931966+0000","last_fullsized":"2024-05-30T06:55:33.931966+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935412+0000","last_change":"2024-05-30T06:55:33.935564+0000","last_active":"2024-05-30T06:55:35.935412+0000","last_peered":"2024-05-30T06:55:35.935412+0000","last_clean":"2024-05-30T06:55:35.935412+0000","last_became_active":"2024-05-30T06:55:33.934422+0000","last_became_peered":"2024-05-30T06:55:33.934422+0000","last_unstale":"2024-05-30T06:55:35.935412+0000","last_undegraded":"2024-05-30T06:55:35.935412+0000","last_fullsized":"2024-05-30T06:55:35.935412+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:24:00.583740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930762+0000","last_change":"2024-05-30T06:55:33.930762+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930762+0000","last_undegraded":"2024-05-30T06:55:33.930762+0000","last_fullsized":"2024-05-30T06:55:33.930762+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935114+0000","last_change":"2024-05-30T06:55:33.944968+0000","last_active":"2024-05-30T06:55:35.935114+0000","last_peered":"2024-05-30T06:55:35.935114+0000","last_clean":"2024-05-30T06:55:35.935114+0000","last_became_active":"2024-05-30T06:55:33.944653+0000","last_became_peered":"2024-05-30T06:55:33.944653+0000","last_unstale":"2024-05-30T06:55:35.935114+0000","last_undegraded":"2024-05-30T06:55:35.935114+0000","last_fullsized":"2024-05-30T06:55:35.935114+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:56:24.913375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.934493+0000","last_change":"2024-05-30T06:55:33.934493+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.934493+0000","last_undegraded":"2024-05-30T06:55:33.934493+0000","last_fullsized":"2024-05-30T06:55:33.934493+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.940417+0000","last_change":"2024-05-30T06:55:33.939347+0000","last_active":"2024-05-30T06:55:33.940417+0000","last_peered":"2024-05-30T06:55:33.940417+0000","last_clean":"2024-05-30T06:55:33.940417+0000","last_became_active":"2024-05-30T06:55:33.939016+0000","last_became_peered":"2024-05-30T06:55:33.939016+0000","last_unstale":"2024-05-30T06:55:33.940417+0000","last_undegraded":"2024-05-30T06:55:33.940417+0000","last_fullsized":"2024-05-30T06:55:33.940417+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:58:13.201695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929615+0000","last_change":"2024-05-30T06:55:33.929615+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929615+0000","last_undegraded":"2024-05-30T06:55:33.929615+0000","last_fullsized":"2024-05-30T06:55:33.929615+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.938880+0000","last_change":"2024-05-30T06:55:33.937075+0000","last_active":"2024-05-30T06:55:33.938880+0000","last_peered":"2024-05-30T06:55:33.938880+0000","last_clean":"2024-05-30T06:55:33.938880+0000","last_became_active":"2024-05-30T06:55:33.936712+0000","last_became_peered":"2024-05-30T06:55:33.936712+0000","last_unstale":"2024-05-30T06:55:33.938880+0000","last_undegraded":"2024-05-30T06:55:33.938880+0000","last_fullsized":"2024-05-30T06:55:33.938880+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:11:50.696004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930522+0000","last_change":"2024-05-30T06:55:33.930522+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930522+0000","last_undegraded":"2024-05-30T06:55:33.930522+0000","last_fullsized":"2024-05-30T06:55:33.930522+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934677+0000","last_change":"2024-05-30T06:55:33.939978+0000","last_active":"2024-05-30T06:55:35.934677+0000","last_peered":"2024-05-30T06:55:35.934677+0000","last_clean":"2024-05-30T06:55:35.934677+0000","last_became_active":"2024-05-30T06:55:33.939661+0000","last_became_peered":"2024-05-30T06:55:33.939661+0000","last_unstale":"2024-05-30T06:55:35.934677+0000","last_undegraded":"2024-05-30T06:55:35.934677+0000","last_fullsized":"2024-05-30T06:55:35.934677+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:21:54.215474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935525+0000","last_change":"2024-05-30T06:55:34.947321+0000","last_active":"2024-05-30T06:55:35.935525+0000","last_peered":"2024-05-30T06:55:35.935525+0000","last_clean":"2024-05-30T06:55:35.935525+0000","last_became_active":"2024-05-30T06:55:34.947060+0000","last_became_peered":"2024-05-30T06:55:34.947060+0000","last_unstale":"2024-05-30T06:55:35.935525+0000","last_undegraded":"2024-05-30T06:55:35.935525+0000","last_fullsized":"2024-05-30T06:55:35.935525+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:54.211731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.939513+0000","last_change":"2024-05-30T06:55:33.937091+0000","last_active":"2024-05-30T06:55:33.939513+0000","last_peered":"2024-05-30T06:55:33.939513+0000","last_clean":"2024-05-30T06:55:33.939513+0000","last_became_active":"2024-05-30T06:55:33.936792+0000","last_became_peered":"2024-05-30T06:55:33.936792+0000","last_unstale":"2024-05-30T06:55:33.939513+0000","last_undegraded":"2024-05-30T06:55:33.939513+0000","last_fullsized":"2024-05-30T06:55:33.939513+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:48:21.768843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930529+0000","last_change":"2024-05-30T06:55:33.930529+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930529+0000","last_undegraded":"2024-05-30T06:55:33.930529+0000","last_fullsized":"2024-05-30T06:55:33.930529+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935606+0000","last_change":"2024-05-30T06:55:33.947953+0000","last_active":"2024-05-30T06:55:35.935606+0000","last_peered":"2024-05-30T06:55:35.935606+0000","last_clean":"2024-05-30T06:55:35.935606+0000","last_became_active":"2024-05-30T06:55:33.947682+0000","last_became_peered":"2024-05-30T06:55:33.947682+0000","last_unstale":"2024-05-30T06:55:35.935606+0000","last_undegraded":"2024-05-30T06:55:35.935606+0000","last_fullsized":"2024-05-30T06:55:35.935606+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:42.797019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930665+0000","last_change":"2024-05-30T06:55:33.930665+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930665+0000","last_undegraded":"2024-05-30T06:55:33.930665+0000","last_fullsized":"2024-05-30T06:55:33.930665+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935042+0000","last_change":"2024-05-30T06:55:33.942331+0000","last_active":"2024-05-30T06:55:35.935042+0000","last_peered":"2024-05-30T06:55:35.935042+0000","last_clean":"2024-05-30T06:55:35.935042+0000","last_became_active":"2024-05-30T06:55:33.942074+0000","last_became_peered":"2024-05-30T06:55:33.942074+0000","last_unstale":"2024-05-30T06:55:35.935042+0000","last_undegraded":"2024-05-30T06:55:35.935042+0000","last_fullsized":"2024-05-30T06:55:35.935042+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:28:44.612162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.931236+0000","last_change":"2024-05-30T06:55:33.931236+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.931236+0000","last_undegraded":"2024-05-30T06:55:33.931236+0000","last_fullsized":"2024-05-30T06:55:33.931236+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.942447+0000","last_change":"2024-05-30T06:55:33.938985+0000","last_active":"2024-05-30T06:55:33.942447+0000","last_peered":"2024-05-30T06:55:33.942447+0000","last_clean":"2024-05-30T06:55:33.942447+0000","last_became_active":"2024-05-30T06:55:33.938648+0000","last_became_peered":"2024-05-30T06:55:33.938648+0000","last_unstale":"2024-05-30T06:55:33.942447+0000","last_undegraded":"2024-05-30T06:55:33.942447+0000","last_fullsized":"2024-05-30T06:55:33.942447+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:43:34.836617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930350+0000","last_change":"2024-05-30T06:55:33.930350+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930350+0000","last_undegraded":"2024-05-30T06:55:33.930350+0000","last_fullsized":"2024-05-30T06:55:33.930350+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935203+0000","last_change":"2024-05-30T06:55:33.934159+0000","last_active":"2024-05-30T06:55:35.935203+0000","last_peered":"2024-05-30T06:55:35.935203+0000","last_clean":"2024-05-30T06:55:35.935203+0000","last_became_active":"2024-05-30T06:55:33.933841+0000","last_became_peered":"2024-05-30T06:55:33.933841+0000","last_unstale":"2024-05-30T06:55:35.935203+0000","last_undegraded":"2024-05-30T06:55:35.935203+0000","last_fullsized":"2024-05-30T06:55:35.935203+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:47:19.119777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.924820+0000","last_change":"2024-05-30T06:55:33.924820+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.924820+0000","last_undegraded":"2024-05-30T06:55:33.924820+0000","last_fullsized":"2024-05-30T06:55:33.924820+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.942413+0000","last_change":"2024-05-30T06:55:33.938260+0000","last_active":"2024-05-30T06:55:33.942413+0000","last_peered":"2024-05-30T06:55:33.942413+0000","last_clean":"2024-05-30T06:55:33.942413+0000","last_became_active":"2024-05-30T06:55:33.937992+0000","last_became_peered":"2024-05-30T06:55:33.937992+0000","last_unstale":"2024-05-30T06:55:33.942413+0000","last_undegraded":"2024-05-30T06:55:33.942413+0000","last_fullsized":"2024-05-30T06:55:33.942413+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:06:06.482391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.929113+0000","last_change":"2024-05-30T06:55:33.929113+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.929113+0000","last_undegraded":"2024-05-30T06:55:33.929113+0000","last_fullsized":"2024-05-30T06:55:33.929113+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549631+0000","last_change":"2024-05-30T06:55:33.937358+0000","last_active":"2024-05-30T06:55:36.549631+0000","last_peered":"2024-05-30T06:55:36.549631+0000","last_clean":"2024-05-30T06:55:36.549631+0000","last_became_active":"2024-05-30T06:55:33.937026+0000","last_became_peered":"2024-05-30T06:55:33.937026+0000","last_unstale":"2024-05-30T06:55:36.549631+0000","last_undegraded":"2024-05-30T06:55:36.549631+0000","last_fullsized":"2024-05-30T06:55:36.549631+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:14:56.877290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.930033+0000","last_change":"2024-05-30T06:55:33.930033+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.930033+0000","last_undegraded":"2024-05-30T06:55:33.930033+0000","last_fullsized":"2024-05-30T06:55:33.930033+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.946883+0000","last_change":"2024-05-30T06:55:33.944390+0000","last_active":"2024-05-30T06:55:33.946883+0000","last_peered":"2024-05-30T06:55:33.946883+0000","last_clean":"2024-05-30T06:55:33.946883+0000","last_became_active":"2024-05-30T06:55:33.943939+0000","last_became_peered":"2024-05-30T06:55:33.943939+0000","last_unstale":"2024-05-30T06:55:33.946883+0000","last_undegraded":"2024-05-30T06:55:33.946883+0000","last_fullsized":"2024-05-30T06:55:33.946883+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:29:56.235206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-05-30T06:55:33.937147+0000","last_change":"2024-05-30T06:55:33.937147+0000","last_active":"2024-05-30T06:55:33.911105+0000","last_peered":"2024-05-30T06:55:33.911105+0000","last_clean":"2024-05-30T06:55:33.911105+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:55:33.937147+0000","last_undegraded":"2024-05-30T06:55:33.937147+0000","last_fullsized":"2024-05-30T06:55:33.937147+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.943726+0000","last_change":"2024-05-30T06:55:33.942731+0000","last_active":"2024-05-30T06:55:33.943726+0000","last_peered":"2024-05-30T06:55:33.943726+0000","last_clean":"2024-05-30T06:55:33.943726+0000","last_became_active":"2024-05-30T06:55:33.942215+0000","last_became_peered":"2024-05-30T06:55:33.942215+0000","last_unstale":"2024-05-30T06:55:33.943726+0000","last_undegraded":"2024-05-30T06:55:33.943726+0000","last_fullsized":"2024-05-30T06:55:33.943726+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:42.797019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":323,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-05-30T06:55:33.934723+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:55:33.934723+0000","last_peered":"2024-05-30T06:55:33.934723+0000","last_clean":"2024-05-30T06:55:33.934723+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:55:33.934723+0000","last_undegraded":"2024-05-30T06:55:33.934723+0000","last_fullsized":"2024-05-30T06:55:33.934723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123156,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248684,"statfs":{"total":96636764160,"available":96510652416,"internally_reserved":0,"allocated":1830912,"data_stored":1127129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575015,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122552,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249288,"statfs":{"total":96636764160,"available":96511270912,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575015,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76728,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295112,"statfs":{"total":96636764160,"available":96558194688,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575014,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64264,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94307576,"statfs":{"total":96636764160,"available":96570957824,"internally_reserved":0,"allocated":1236992,"data_stored":536761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140656,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231184,"statfs":{"total":96636764160,"available":96492732416,"internally_reserved":0,"allocated":1277952,"data_stored":551526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":142735815},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575013,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140600,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231240,"statfs":{"total":96636764160,"available":96492789760,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575015,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104504,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94267336,"statfs":{"total":96636764160,"available":96529752064,"internally_reserved":0,"allocated":1224704,"data_stored":530458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575016,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77348,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294492,"statfs":{"total":96636764160,"available":96557559808,"internally_reserved":0,"allocated":1859584,"data_stored":1140842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:55:43.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:55:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.801+0000 7f3419200640 1 Processor -- start 2024-05-30T06:55:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.801+0000 7f3419200640 1 -- start start 2024-05-30T06:55:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.801+0000 7f3419200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f341406e000 0x7f34140ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.801+0000 7f3419200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34140cee10 0x7f341406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.801+0000 7f3419200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34140cd120 con 0x7f341415cd80 2024-05-30T06:55:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.801+0000 7f3419200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f34140a9530 con 0x7f341406e000 2024-05-30T06:55:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.801+0000 7f3419200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f34140cd400 con 0x7f34140cee10 2024-05-30T06:55:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.801+0000 7f3409400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f341415cd80 0x7f34140ce700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47416/0 (socket says 172.21.15.37:47416) 2024-05-30T06:55:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.805+0000 7f3409400640 1 -- 172.21.15.37:0/2594692027 learned_addr learned my addr 172.21.15.37:0/2594692027 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.805+0000 7f3411e00640 1 --2- 172.21.15.37:0/2594692027 >> v2:172.21.15.105:3300/0 conn(0x7f341406e000 0x7f34140ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.805+0000 7f3412800640 1 --2- 172.21.15.37:0/2594692027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34140cee10 0x7f341406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.805+0000 7f3411400640 1 -- 172.21.15.37:0/2594692027 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3999711318 0 0) 0x7f34140cd120 con 0x7f341415cd80 2024-05-30T06:55:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.805+0000 7f3411400640 1 -- 172.21.15.37:0/2594692027 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33f8003530 con 0x7f341415cd80 2024-05-30T06:55:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.805+0000 7f3411e00640 1 -- 172.21.15.37:0/2594692027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34140cee10 msgr2=0x7f341406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.805+0000 7f3411e00640 1 --2- 172.21.15.37:0/2594692027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34140cee10 0x7f341406f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.805+0000 7f3411e00640 1 -- 172.21.15.37:0/2594692027 >> v1:172.21.15.37:6789/0 conn(0x7f341415cd80 legacy=0x7f34140ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.805+0000 7f3411400640 1 -- 172.21.15.37:0/2594692027 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2170683158 0 0) 0x7f33f8003530 con 0x7f341415cd80 2024-05-30T06:55:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.805+0000 7f3411e00640 1 -- 172.21.15.37:0/2594692027 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34140cd6e0 con 0x7f341406e000 2024-05-30T06:55:43.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.805+0000 7f3411e00640 1 --2- 172.21.15.37:0/2594692027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f341406e000 0x7f34140ce1c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f34040097c0 tx=0x7f340401ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abb12b024a3b31e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:43.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3411400640 1 -- 172.21.15.37:0/2594692027 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34040b5070 con 0x7f341406e000 2024-05-30T06:55:43.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3411400640 1 -- 172.21.15.37:0/2594692027 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34040a85f0 con 0x7f341406e000 2024-05-30T06:55:43.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3411400640 1 -- 172.21.15.37:0/2594692027 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc001680 con 0x7f341406e000 2024-05-30T06:55:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 -- 172.21.15.37:0/2594692027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f341406e000 msgr2=0x7f34140ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 --2- 172.21.15.37:0/2594692027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f341406e000 0x7f34140ce1c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f34040097c0 tx=0x7f340401ebb0 comp rx=0 tx=0).stop 2024-05-30T06:55:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 -- 172.21.15.37:0/2594692027 shutdown_connections 2024-05-30T06:55:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 --2- 172.21.15.37:0/2594692027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34140cee10 0x7f341406f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 --2- 172.21.15.37:0/2594692027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f341406e000 0x7f34140ce1c0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 -- 172.21.15.37:0/2594692027 >> 172.21.15.37:0/2594692027 conn(0x7f34140b23a0 msgr2=0x7f34140b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 -- 172.21.15.37:0/2594692027 shutdown_connections 2024-05-30T06:55:43.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 -- 172.21.15.37:0/2594692027 wait complete. 2024-05-30T06:55:43.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 Processor -- start 2024-05-30T06:55:43.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 -- start start 2024-05-30T06:55:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f341406e000 0x7f341413a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34140cee10 0x7f341415e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341415cd80 0x7f341415b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f341406f930 con 0x7f341406e000 2024-05-30T06:55:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f34140cdca0 con 0x7f34140cee10 2024-05-30T06:55:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3419200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f341406fab0 con 0x7f341415cd80 2024-05-30T06:55:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3411e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f341406e000 0x7f341413a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3411e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f341406e000 0x7f341413a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45088/0 (socket says 172.21.15.37:45088) 2024-05-30T06:55:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3411e00640 1 -- 172.21.15.37:0/1699524764 learned_addr learned my addr 172.21.15.37:0/1699524764 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3409400640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34140cee10 0x7f341415e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.809+0000 7f3412800640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341415cd80 0x7f341415b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f3411e00640 1 -- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341415cd80 msgr2=0x7f341415b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f3411e00640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341415cd80 0x7f341415b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f3411e00640 1 -- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34140cee10 msgr2=0x7f341415e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f3411e00640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34140cee10 0x7f341415e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f3411e00640 1 -- 172.21.15.37:0/1699524764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341415ecc0 con 0x7f341406e000 2024-05-30T06:55:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f3412800640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341415cd80 0x7f341415b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f3411e00640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f341406e000 0x7f341413a340 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f340401d260 tx=0x7f340401b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:43.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f340aa00640 1 -- 172.21.15.37:0/1699524764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34040b5040 con 0x7f341406e000 2024-05-30T06:55:43.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f340aa00640 1 -- 172.21.15.37:0/1699524764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34040bf070 con 0x7f341406e000 2024-05-30T06:55:43.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f340aa00640 1 -- 172.21.15.37:0/1699524764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404006e20 con 0x7f341406e000 2024-05-30T06:55:43.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f3419200640 1 -- 172.21.15.37:0/1699524764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341415efa0 con 0x7f341406e000 2024-05-30T06:55:43.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f3419200640 1 -- 172.21.15.37:0/1699524764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341413bc50 con 0x7f341406e000 2024-05-30T06:55:43.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f3419200640 1 -- 172.21.15.37:0/1699524764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3414068b20 con 0x7f341406e000 2024-05-30T06:55:43.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f340aa00640 1 -- 172.21.15.37:0/1699524764 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f34040b08a0 con 0x7f341406e000 2024-05-30T06:55:43.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f340aa00640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33f00698e0 0x7f33f006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:43.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.813+0000 7f340aa00640 1 -- 172.21.15.37:0/1699524764 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f3404122c30 con 0x7f341406e000 2024-05-30T06:55:43.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.817+0000 7f3409400640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33f00698e0 0x7f33f006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:43.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.817+0000 7f3409400640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33f00698e0 0x7f33f006bda0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0013d0 tx=0x7f33fc001360 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:43.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.821+0000 7f340aa00640 1 -- 172.21.15.37:0/1699524764 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3404018710 con 0x7f341406e000 2024-05-30T06:55:43.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.985+0000 7f3419200640 1 -- 172.21.15.37:0/1699524764 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f341406f3b0 con 0x7f33f00698e0 2024-05-30T06:55:43.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.989+0000 7f340aa00640 1 -- 172.21.15.37:0/1699524764 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252438 (secure 0 0 0) 0x7f341406f3b0 con 0x7f33f00698e0 2024-05-30T06:55:43.995 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:43.996 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:55:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.993+0000 7f3419200640 1 -- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33f00698e0 msgr2=0x7f33f006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.993+0000 7f3419200640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33f00698e0 0x7f33f006bda0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0013d0 tx=0x7f33fc001360 comp rx=0 tx=0).stop 2024-05-30T06:55:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.993+0000 7f3419200640 1 -- 172.21.15.37:0/1699524764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f341406e000 msgr2=0x7f341413a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.993+0000 7f3419200640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f341406e000 0x7f341413a340 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f340401d260 tx=0x7f340401b950 comp rx=0 tx=0).stop 2024-05-30T06:55:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.993+0000 7f3419200640 1 -- 172.21.15.37:0/1699524764 shutdown_connections 2024-05-30T06:55:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.993+0000 7f3419200640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341415cd80 0x7f341415b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.993+0000 7f3419200640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33f00698e0 0x7f33f006bda0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.993+0000 7f3419200640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34140cee10 0x7f341415e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.993+0000 7f3419200640 1 --2- 172.21.15.37:0/1699524764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f341406e000 0x7f341413a340 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.993+0000 7f3419200640 1 -- 172.21.15.37:0/1699524764 >> 172.21.15.37:0/1699524764 conn(0x7f34140b23a0 msgr2=0x7f34140b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:43.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.993+0000 7f3419200640 1 -- 172.21.15.37:0/1699524764 shutdown_connections 2024-05-30T06:55:43.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:43.993+0000 7f3419200640 1 -- 172.21.15.37:0/1699524764 wait complete. 2024-05-30T06:55:44.015 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":507,"stamp":"2024-05-30T06:55:42.944625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":868092,"kb_used_data":11080,"kb_used_omap":12,"kb_used_meta":856883,"kb_avail":754106628,"statfs":{"total":773094113280,"available":772205187072,"internally_reserved":0,"allocated":11345920,"data_stored":5584692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":877448752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.020040"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550516+0000","last_change":"2024-05-30T06:55:34.956393+0000","last_active":"2024-05-30T06:55:36.550516+0000","last_peered":"2024-05-30T06:55:36.550516+0000","last_clean":"2024-05-30T06:55:36.550516+0000","last_became_active":"2024-05-30T06:55:34.956070+0000","last_became_peered":"2024-05-30T06:55:34.956070+0000","last_unstale":"2024-05-30T06:55:36.550516+0000","last_undegraded":"2024-05-30T06:55:36.550516+0000","last_fullsized":"2024-05-30T06:55:36.550516+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:13:48.758752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935371+0000","last_change":"2024-05-30T06:55:34.955973+0000","last_active":"2024-05-30T06:55:35.935371+0000","last_peered":"2024-05-30T06:55:35.935371+0000","last_clean":"2024-05-30T06:55:35.935371+0000","last_became_active":"2024-05-30T06:55:34.955604+0000","last_became_peered":"2024-05-30T06:55:34.955604+0000","last_unstale":"2024-05-30T06:55:35.935371+0000","last_undegraded":"2024-05-30T06:55:35.935371+0000","last_fullsized":"2024-05-30T06:55:35.935371+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:13.858335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550144+0000","last_change":"2024-05-30T06:55:34.946981+0000","last_active":"2024-05-30T06:55:36.550144+0000","last_peered":"2024-05-30T06:55:36.550144+0000","last_clean":"2024-05-30T06:55:36.550144+0000","last_became_active":"2024-05-30T06:55:34.946151+0000","last_became_peered":"2024-05-30T06:55:34.946151+0000","last_unstale":"2024-05-30T06:55:36.550144+0000","last_undegraded":"2024-05-30T06:55:36.550144+0000","last_fullsized":"2024-05-30T06:55:36.550144+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:39:25.431726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550531+0000","last_change":"2024-05-30T06:55:34.945824+0000","last_active":"2024-05-30T06:55:36.550531+0000","last_peered":"2024-05-30T06:55:36.550531+0000","last_clean":"2024-05-30T06:55:36.550531+0000","last_became_active":"2024-05-30T06:55:34.944885+0000","last_became_peered":"2024-05-30T06:55:34.944885+0000","last_unstale":"2024-05-30T06:55:36.550531+0000","last_undegraded":"2024-05-30T06:55:36.550531+0000","last_fullsized":"2024-05-30T06:55:36.550531+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:39.774985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.552974+0000","last_change":"2024-05-30T06:55:34.943436+0000","last_active":"2024-05-30T06:55:36.552974+0000","last_peered":"2024-05-30T06:55:36.552974+0000","last_clean":"2024-05-30T06:55:36.552974+0000","last_became_active":"2024-05-30T06:55:34.943127+0000","last_became_peered":"2024-05-30T06:55:34.943127+0000","last_unstale":"2024-05-30T06:55:36.552974+0000","last_undegraded":"2024-05-30T06:55:36.552974+0000","last_fullsized":"2024-05-30T06:55:36.552974+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:48:57.776244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.231000+0000","last_change":"2024-05-30T06:55:34.944472+0000","last_active":"2024-05-30T06:55:36.231000+0000","last_peered":"2024-05-30T06:55:36.231000+0000","last_clean":"2024-05-30T06:55:36.231000+0000","last_became_active":"2024-05-30T06:55:34.944198+0000","last_became_peered":"2024-05-30T06:55:34.944198+0000","last_unstale":"2024-05-30T06:55:36.231000+0000","last_undegraded":"2024-05-30T06:55:36.231000+0000","last_fullsized":"2024-05-30T06:55:36.231000+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:55.380184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.231178+0000","last_change":"2024-05-30T06:55:34.951539+0000","last_active":"2024-05-30T06:55:36.231178+0000","last_peered":"2024-05-30T06:55:36.231178+0000","last_clean":"2024-05-30T06:55:36.231178+0000","last_became_active":"2024-05-30T06:55:34.951182+0000","last_became_peered":"2024-05-30T06:55:34.951182+0000","last_unstale":"2024-05-30T06:55:36.231178+0000","last_undegraded":"2024-05-30T06:55:36.231178+0000","last_fullsized":"2024-05-30T06:55:36.231178+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:48:58.456704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934796+0000","last_change":"2024-05-30T06:55:34.952580+0000","last_active":"2024-05-30T06:55:35.934796+0000","last_peered":"2024-05-30T06:55:35.934796+0000","last_clean":"2024-05-30T06:55:35.934796+0000","last_became_active":"2024-05-30T06:55:34.952313+0000","last_became_peered":"2024-05-30T06:55:34.952313+0000","last_unstale":"2024-05-30T06:55:35.934796+0000","last_undegraded":"2024-05-30T06:55:35.934796+0000","last_fullsized":"2024-05-30T06:55:35.934796+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:54:03.363077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.352055+0000","last_change":"2024-05-30T06:55:34.956868+0000","last_active":"2024-05-30T06:55:36.352055+0000","last_peered":"2024-05-30T06:55:36.352055+0000","last_clean":"2024-05-30T06:55:36.352055+0000","last_became_active":"2024-05-30T06:55:34.952526+0000","last_became_peered":"2024-05-30T06:55:34.952526+0000","last_unstale":"2024-05-30T06:55:36.352055+0000","last_undegraded":"2024-05-30T06:55:36.352055+0000","last_fullsized":"2024-05-30T06:55:36.352055+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:32:09.513760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.553026+0000","last_change":"2024-05-30T06:55:34.957671+0000","last_active":"2024-05-30T06:55:36.553026+0000","last_peered":"2024-05-30T06:55:36.553026+0000","last_clean":"2024-05-30T06:55:36.553026+0000","last_became_active":"2024-05-30T06:55:34.955877+0000","last_became_peered":"2024-05-30T06:55:34.955877+0000","last_unstale":"2024-05-30T06:55:36.553026+0000","last_undegraded":"2024-05-30T06:55:36.553026+0000","last_fullsized":"2024-05-30T06:55:36.553026+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:53.883496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.231175+0000","last_change":"2024-05-30T06:55:34.951937+0000","last_active":"2024-05-30T06:55:36.231175+0000","last_peered":"2024-05-30T06:55:36.231175+0000","last_clean":"2024-05-30T06:55:36.231175+0000","last_became_active":"2024-05-30T06:55:34.951313+0000","last_became_peered":"2024-05-30T06:55:34.951313+0000","last_unstale":"2024-05-30T06:55:36.231175+0000","last_undegraded":"2024-05-30T06:55:36.231175+0000","last_fullsized":"2024-05-30T06:55:36.231175+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:45:12.188368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.351868+0000","last_change":"2024-05-30T06:55:34.958653+0000","last_active":"2024-05-30T06:55:36.351868+0000","last_peered":"2024-05-30T06:55:36.351868+0000","last_clean":"2024-05-30T06:55:36.351868+0000","last_became_active":"2024-05-30T06:55:34.955634+0000","last_became_peered":"2024-05-30T06:55:34.955634+0000","last_unstale":"2024-05-30T06:55:36.351868+0000","last_undegraded":"2024-05-30T06:55:36.351868+0000","last_fullsized":"2024-05-30T06:55:36.351868+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:14:57.880215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550365+0000","last_change":"2024-05-30T06:55:34.952578+0000","last_active":"2024-05-30T06:55:36.550365+0000","last_peered":"2024-05-30T06:55:36.550365+0000","last_clean":"2024-05-30T06:55:36.550365+0000","last_became_active":"2024-05-30T06:55:34.952237+0000","last_became_peered":"2024-05-30T06:55:34.952237+0000","last_unstale":"2024-05-30T06:55:36.550365+0000","last_undegraded":"2024-05-30T06:55:36.550365+0000","last_fullsized":"2024-05-30T06:55:36.550365+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:54.211731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936352+0000","last_change":"2024-05-30T06:55:34.940306+0000","last_active":"2024-05-30T06:55:35.936352+0000","last_peered":"2024-05-30T06:55:35.936352+0000","last_clean":"2024-05-30T06:55:35.936352+0000","last_became_active":"2024-05-30T06:55:34.939992+0000","last_became_peered":"2024-05-30T06:55:34.939992+0000","last_unstale":"2024-05-30T06:55:35.936352+0000","last_undegraded":"2024-05-30T06:55:35.936352+0000","last_fullsized":"2024-05-30T06:55:35.936352+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:50:43.449811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549571+0000","last_change":"2024-05-30T06:55:34.948290+0000","last_active":"2024-05-30T06:55:36.549571+0000","last_peered":"2024-05-30T06:55:36.549571+0000","last_clean":"2024-05-30T06:55:36.549571+0000","last_became_active":"2024-05-30T06:55:34.947764+0000","last_became_peered":"2024-05-30T06:55:34.947764+0000","last_unstale":"2024-05-30T06:55:36.549571+0000","last_undegraded":"2024-05-30T06:55:36.549571+0000","last_fullsized":"2024-05-30T06:55:36.549571+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:12:13.556946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.230944+0000","last_change":"2024-05-30T06:55:34.944816+0000","last_active":"2024-05-30T06:55:36.230944+0000","last_peered":"2024-05-30T06:55:36.230944+0000","last_clean":"2024-05-30T06:55:36.230944+0000","last_became_active":"2024-05-30T06:55:34.944513+0000","last_became_peered":"2024-05-30T06:55:34.944513+0000","last_unstale":"2024-05-30T06:55:36.230944+0000","last_undegraded":"2024-05-30T06:55:36.230944+0000","last_fullsized":"2024-05-30T06:55:36.230944+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:13.858335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935244+0000","last_change":"2024-05-30T06:55:34.948066+0000","last_active":"2024-05-30T06:55:35.935244+0000","last_peered":"2024-05-30T06:55:35.935244+0000","last_clean":"2024-05-30T06:55:35.935244+0000","last_became_active":"2024-05-30T06:55:34.947836+0000","last_became_peered":"2024-05-30T06:55:34.947836+0000","last_unstale":"2024-05-30T06:55:35.935244+0000","last_undegraded":"2024-05-30T06:55:35.935244+0000","last_fullsized":"2024-05-30T06:55:35.935244+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:56:43.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550353+0000","last_change":"2024-05-30T06:55:34.933997+0000","last_active":"2024-05-30T06:55:36.550353+0000","last_peered":"2024-05-30T06:55:36.550353+0000","last_clean":"2024-05-30T06:55:36.550353+0000","last_became_active":"2024-05-30T06:55:34.933752+0000","last_became_peered":"2024-05-30T06:55:34.933752+0000","last_unstale":"2024-05-30T06:55:36.550353+0000","last_undegraded":"2024-05-30T06:55:36.550353+0000","last_fullsized":"2024-05-30T06:55:36.550353+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:55.380184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936791+0000","last_change":"2024-05-30T06:55:34.950484+0000","last_active":"2024-05-30T06:55:35.936791+0000","last_peered":"2024-05-30T06:55:35.936791+0000","last_clean":"2024-05-30T06:55:35.936791+0000","last_became_active":"2024-05-30T06:55:34.950061+0000","last_became_peered":"2024-05-30T06:55:34.950061+0000","last_unstale":"2024-05-30T06:55:35.936791+0000","last_undegraded":"2024-05-30T06:55:35.936791+0000","last_fullsized":"2024-05-30T06:55:35.936791+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:44.294336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.351910+0000","last_change":"2024-05-30T06:55:34.955287+0000","last_active":"2024-05-30T06:55:36.351910+0000","last_peered":"2024-05-30T06:55:36.351910+0000","last_clean":"2024-05-30T06:55:36.351910+0000","last_became_active":"2024-05-30T06:55:34.951229+0000","last_became_peered":"2024-05-30T06:55:34.951229+0000","last_unstale":"2024-05-30T06:55:36.351910+0000","last_undegraded":"2024-05-30T06:55:36.351910+0000","last_fullsized":"2024-05-30T06:55:36.351910+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:34:53.837215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936456+0000","last_change":"2024-05-30T06:55:34.951245+0000","last_active":"2024-05-30T06:55:35.936456+0000","last_peered":"2024-05-30T06:55:35.936456+0000","last_clean":"2024-05-30T06:55:35.936456+0000","last_became_active":"2024-05-30T06:55:34.950825+0000","last_became_peered":"2024-05-30T06:55:34.950825+0000","last_unstale":"2024-05-30T06:55:35.936456+0000","last_undegraded":"2024-05-30T06:55:35.936456+0000","last_fullsized":"2024-05-30T06:55:35.936456+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:23:27.600979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934743+0000","last_change":"2024-05-30T06:55:34.948942+0000","last_active":"2024-05-30T06:55:35.934743+0000","last_peered":"2024-05-30T06:55:35.934743+0000","last_clean":"2024-05-30T06:55:35.934743+0000","last_became_active":"2024-05-30T06:55:34.948665+0000","last_became_peered":"2024-05-30T06:55:34.948665+0000","last_unstale":"2024-05-30T06:55:35.934743+0000","last_undegraded":"2024-05-30T06:55:35.934743+0000","last_fullsized":"2024-05-30T06:55:35.934743+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:19:24.696303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934808+0000","last_change":"2024-05-30T06:55:34.948065+0000","last_active":"2024-05-30T06:55:35.934808+0000","last_peered":"2024-05-30T06:55:35.934808+0000","last_clean":"2024-05-30T06:55:35.934808+0000","last_became_active":"2024-05-30T06:55:34.947811+0000","last_became_peered":"2024-05-30T06:55:34.947811+0000","last_unstale":"2024-05-30T06:55:35.934808+0000","last_undegraded":"2024-05-30T06:55:35.934808+0000","last_fullsized":"2024-05-30T06:55:35.934808+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:03:57.480410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.231048+0000","last_change":"2024-05-30T06:55:34.945402+0000","last_active":"2024-05-30T06:55:36.231048+0000","last_peered":"2024-05-30T06:55:36.231048+0000","last_clean":"2024-05-30T06:55:36.231048+0000","last_became_active":"2024-05-30T06:55:34.945137+0000","last_became_peered":"2024-05-30T06:55:34.945137+0000","last_unstale":"2024-05-30T06:55:36.231048+0000","last_undegraded":"2024-05-30T06:55:36.231048+0000","last_fullsized":"2024-05-30T06:55:36.231048+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:39.774985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.553179+0000","last_change":"2024-05-30T06:55:34.941693+0000","last_active":"2024-05-30T06:55:36.553179+0000","last_peered":"2024-05-30T06:55:36.553179+0000","last_clean":"2024-05-30T06:55:36.553179+0000","last_became_active":"2024-05-30T06:55:34.941307+0000","last_became_peered":"2024-05-30T06:55:34.941307+0000","last_unstale":"2024-05-30T06:55:36.553179+0000","last_undegraded":"2024-05-30T06:55:36.553179+0000","last_fullsized":"2024-05-30T06:55:36.553179+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:14:57.880215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935399+0000","last_change":"2024-05-30T06:55:34.957056+0000","last_active":"2024-05-30T06:55:35.935399+0000","last_peered":"2024-05-30T06:55:35.935399+0000","last_clean":"2024-05-30T06:55:35.935399+0000","last_became_active":"2024-05-30T06:55:34.956742+0000","last_became_peered":"2024-05-30T06:55:34.956742+0000","last_unstale":"2024-05-30T06:55:35.935399+0000","last_undegraded":"2024-05-30T06:55:35.935399+0000","last_fullsized":"2024-05-30T06:55:35.935399+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:55.380184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.231054+0000","last_change":"2024-05-30T06:55:34.934635+0000","last_active":"2024-05-30T06:55:36.231054+0000","last_peered":"2024-05-30T06:55:36.231054+0000","last_clean":"2024-05-30T06:55:36.231054+0000","last_became_active":"2024-05-30T06:55:34.934303+0000","last_became_peered":"2024-05-30T06:55:34.934303+0000","last_unstale":"2024-05-30T06:55:36.231054+0000","last_undegraded":"2024-05-30T06:55:36.231054+0000","last_fullsized":"2024-05-30T06:55:36.231054+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:54.211731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.553181+0000","last_change":"2024-05-30T06:55:34.942182+0000","last_active":"2024-05-30T06:55:36.553181+0000","last_peered":"2024-05-30T06:55:36.553181+0000","last_clean":"2024-05-30T06:55:36.553181+0000","last_became_active":"2024-05-30T06:55:34.941919+0000","last_became_peered":"2024-05-30T06:55:34.941919+0000","last_unstale":"2024-05-30T06:55:36.553181+0000","last_undegraded":"2024-05-30T06:55:36.553181+0000","last_fullsized":"2024-05-30T06:55:36.553181+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:32:09.513760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935062+0000","last_change":"2024-05-30T06:55:34.956501+0000","last_active":"2024-05-30T06:55:35.935062+0000","last_peered":"2024-05-30T06:55:35.935062+0000","last_clean":"2024-05-30T06:55:35.935062+0000","last_became_active":"2024-05-30T06:55:34.956081+0000","last_became_peered":"2024-05-30T06:55:34.956081+0000","last_unstale":"2024-05-30T06:55:35.935062+0000","last_undegraded":"2024-05-30T06:55:35.935062+0000","last_fullsized":"2024-05-30T06:55:35.935062+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:12:13.556946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936371+0000","last_change":"2024-05-30T06:55:34.951672+0000","last_active":"2024-05-30T06:55:35.936371+0000","last_peered":"2024-05-30T06:55:35.936371+0000","last_clean":"2024-05-30T06:55:35.936371+0000","last_became_active":"2024-05-30T06:55:34.949952+0000","last_became_peered":"2024-05-30T06:55:34.949952+0000","last_unstale":"2024-05-30T06:55:35.936371+0000","last_undegraded":"2024-05-30T06:55:35.936371+0000","last_fullsized":"2024-05-30T06:55:35.936371+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:23:08.896071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549664+0000","last_change":"2024-05-30T06:55:34.932722+0000","last_active":"2024-05-30T06:55:36.549664+0000","last_peered":"2024-05-30T06:55:36.549664+0000","last_clean":"2024-05-30T06:55:36.549664+0000","last_became_active":"2024-05-30T06:55:34.932454+0000","last_became_peered":"2024-05-30T06:55:34.932454+0000","last_unstale":"2024-05-30T06:55:36.549664+0000","last_undegraded":"2024-05-30T06:55:36.549664+0000","last_fullsized":"2024-05-30T06:55:36.549664+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:56:43.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549989+0000","last_change":"2024-05-30T06:55:34.943078+0000","last_active":"2024-05-30T06:55:36.549989+0000","last_peered":"2024-05-30T06:55:36.549989+0000","last_clean":"2024-05-30T06:55:36.549989+0000","last_became_active":"2024-05-30T06:55:34.942803+0000","last_became_peered":"2024-05-30T06:55:34.942803+0000","last_unstale":"2024-05-30T06:55:36.549989+0000","last_undegraded":"2024-05-30T06:55:36.549989+0000","last_fullsized":"2024-05-30T06:55:36.549989+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:46:21.671327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936889+0000","last_change":"2024-05-30T06:55:34.937869+0000","last_active":"2024-05-30T06:55:35.936889+0000","last_peered":"2024-05-30T06:55:35.936889+0000","last_clean":"2024-05-30T06:55:35.936889+0000","last_became_active":"2024-05-30T06:55:34.937523+0000","last_became_peered":"2024-05-30T06:55:34.937523+0000","last_unstale":"2024-05-30T06:55:35.936889+0000","last_undegraded":"2024-05-30T06:55:35.936889+0000","last_fullsized":"2024-05-30T06:55:35.936889+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:27:53.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"101'4","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935297+0000","last_change":"2024-05-30T06:55:33.941005+0000","last_active":"2024-05-30T06:55:35.935297+0000","last_peered":"2024-05-30T06:55:35.935297+0000","last_clean":"2024-05-30T06:55:35.935297+0000","last_became_active":"2024-05-30T06:55:33.940750+0000","last_became_peered":"2024-05-30T06:55:33.940750+0000","last_unstale":"2024-05-30T06:55:35.935297+0000","last_undegraded":"2024-05-30T06:55:35.935297+0000","last_fullsized":"2024-05-30T06:55:35.935297+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:30:31.861812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550787+0000","last_change":"2024-05-30T06:55:34.934593+0000","last_active":"2024-05-30T06:55:36.550787+0000","last_peered":"2024-05-30T06:55:36.550787+0000","last_clean":"2024-05-30T06:55:36.550787+0000","last_became_active":"2024-05-30T06:55:34.934338+0000","last_became_peered":"2024-05-30T06:55:34.934338+0000","last_unstale":"2024-05-30T06:55:36.550787+0000","last_undegraded":"2024-05-30T06:55:36.550787+0000","last_fullsized":"2024-05-30T06:55:36.550787+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:45:12.188368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.231071+0000","last_change":"2024-05-30T06:55:33.946654+0000","last_active":"2024-05-30T06:55:36.231071+0000","last_peered":"2024-05-30T06:55:36.231071+0000","last_clean":"2024-05-30T06:55:36.231071+0000","last_became_active":"2024-05-30T06:55:33.946353+0000","last_became_peered":"2024-05-30T06:55:33.946353+0000","last_unstale":"2024-05-30T06:55:36.231071+0000","last_undegraded":"2024-05-30T06:55:36.231071+0000","last_fullsized":"2024-05-30T06:55:36.231071+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:14:56.877290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550283+0000","last_change":"2024-05-30T06:55:34.958230+0000","last_active":"2024-05-30T06:55:36.550283+0000","last_peered":"2024-05-30T06:55:36.550283+0000","last_clean":"2024-05-30T06:55:36.550283+0000","last_became_active":"2024-05-30T06:55:34.957358+0000","last_became_peered":"2024-05-30T06:55:34.957358+0000","last_unstale":"2024-05-30T06:55:36.550283+0000","last_undegraded":"2024-05-30T06:55:36.550283+0000","last_fullsized":"2024-05-30T06:55:36.550283+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:27:53.609893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934937+0000","last_change":"2024-05-30T06:55:33.948635+0000","last_active":"2024-05-30T06:55:35.934937+0000","last_peered":"2024-05-30T06:55:35.934937+0000","last_clean":"2024-05-30T06:55:35.934937+0000","last_became_active":"2024-05-30T06:55:33.948243+0000","last_became_peered":"2024-05-30T06:55:33.948243+0000","last_unstale":"2024-05-30T06:55:35.934937+0000","last_undegraded":"2024-05-30T06:55:35.934937+0000","last_fullsized":"2024-05-30T06:55:35.934937+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:05:45.736094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.352126+0000","last_change":"2024-05-30T06:55:34.956004+0000","last_active":"2024-05-30T06:55:36.352126+0000","last_peered":"2024-05-30T06:55:36.352126+0000","last_clean":"2024-05-30T06:55:36.352126+0000","last_became_active":"2024-05-30T06:55:34.952355+0000","last_became_peered":"2024-05-30T06:55:34.952355+0000","last_unstale":"2024-05-30T06:55:36.352126+0000","last_undegraded":"2024-05-30T06:55:36.352126+0000","last_fullsized":"2024-05-30T06:55:36.352126+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:13:09.951495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935315+0000","last_change":"2024-05-30T06:55:33.943667+0000","last_active":"2024-05-30T06:55:35.935315+0000","last_peered":"2024-05-30T06:55:35.935315+0000","last_clean":"2024-05-30T06:55:35.935315+0000","last_became_active":"2024-05-30T06:55:33.943405+0000","last_became_peered":"2024-05-30T06:55:33.943405+0000","last_unstale":"2024-05-30T06:55:35.935315+0000","last_undegraded":"2024-05-30T06:55:35.935315+0000","last_fullsized":"2024-05-30T06:55:35.935315+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:51.073112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.939588+0000","last_change":"2024-05-30T06:55:34.947404+0000","last_active":"2024-05-30T06:55:35.939588+0000","last_peered":"2024-05-30T06:55:35.939588+0000","last_clean":"2024-05-30T06:55:35.939588+0000","last_became_active":"2024-05-30T06:55:34.947091+0000","last_became_peered":"2024-05-30T06:55:34.947091+0000","last_unstale":"2024-05-30T06:55:35.939588+0000","last_undegraded":"2024-05-30T06:55:35.939588+0000","last_fullsized":"2024-05-30T06:55:35.939588+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:05:09.739472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549952+0000","last_change":"2024-05-30T06:55:33.945265+0000","last_active":"2024-05-30T06:55:36.549952+0000","last_peered":"2024-05-30T06:55:36.549952+0000","last_clean":"2024-05-30T06:55:36.549952+0000","last_became_active":"2024-05-30T06:55:33.944980+0000","last_became_peered":"2024-05-30T06:55:33.944980+0000","last_unstale":"2024-05-30T06:55:36.549952+0000","last_undegraded":"2024-05-30T06:55:36.549952+0000","last_fullsized":"2024-05-30T06:55:36.549952+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:42:12.905371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.230909+0000","last_change":"2024-05-30T06:55:34.933156+0000","last_active":"2024-05-30T06:55:36.230909+0000","last_peered":"2024-05-30T06:55:36.230909+0000","last_clean":"2024-05-30T06:55:36.230909+0000","last_became_active":"2024-05-30T06:55:34.932870+0000","last_became_peered":"2024-05-30T06:55:34.932870+0000","last_unstale":"2024-05-30T06:55:36.230909+0000","last_undegraded":"2024-05-30T06:55:36.230909+0000","last_fullsized":"2024-05-30T06:55:36.230909+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:56:43.656612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934832+0000","last_change":"2024-05-30T06:55:33.937498+0000","last_active":"2024-05-30T06:55:35.934832+0000","last_peered":"2024-05-30T06:55:35.934832+0000","last_clean":"2024-05-30T06:55:35.934832+0000","last_became_active":"2024-05-30T06:55:33.937250+0000","last_became_peered":"2024-05-30T06:55:33.937250+0000","last_unstale":"2024-05-30T06:55:35.934832+0000","last_undegraded":"2024-05-30T06:55:35.934832+0000","last_fullsized":"2024-05-30T06:55:35.934832+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:05:08.736546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549551+0000","last_change":"2024-05-30T06:55:34.946842+0000","last_active":"2024-05-30T06:55:36.549551+0000","last_peered":"2024-05-30T06:55:36.549551+0000","last_clean":"2024-05-30T06:55:36.549551+0000","last_became_active":"2024-05-30T06:55:34.946578+0000","last_became_peered":"2024-05-30T06:55:34.946578+0000","last_unstale":"2024-05-30T06:55:36.549551+0000","last_undegraded":"2024-05-30T06:55:36.549551+0000","last_fullsized":"2024-05-30T06:55:36.549551+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:03:57.480410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.552896+0000","last_change":"2024-05-30T06:55:33.943949+0000","last_active":"2024-05-30T06:55:36.552896+0000","last_peered":"2024-05-30T06:55:36.552896+0000","last_clean":"2024-05-30T06:55:36.552896+0000","last_became_active":"2024-05-30T06:55:33.943656+0000","last_became_peered":"2024-05-30T06:55:33.943656+0000","last_unstale":"2024-05-30T06:55:36.552896+0000","last_undegraded":"2024-05-30T06:55:36.552896+0000","last_fullsized":"2024-05-30T06:55:36.552896+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:48:21.768843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.351578+0000","last_change":"2024-05-30T06:55:34.947007+0000","last_active":"2024-05-30T06:55:36.351578+0000","last_peered":"2024-05-30T06:55:36.351578+0000","last_clean":"2024-05-30T06:55:36.351578+0000","last_became_active":"2024-05-30T06:55:34.946606+0000","last_became_peered":"2024-05-30T06:55:34.946606+0000","last_unstale":"2024-05-30T06:55:36.351578+0000","last_undegraded":"2024-05-30T06:55:36.351578+0000","last_fullsized":"2024-05-30T06:55:36.351578+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:30:32.864737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549907+0000","last_change":"2024-05-30T06:55:33.942310+0000","last_active":"2024-05-30T06:55:36.549907+0000","last_peered":"2024-05-30T06:55:36.549907+0000","last_clean":"2024-05-30T06:55:36.549907+0000","last_became_active":"2024-05-30T06:55:33.941865+0000","last_became_peered":"2024-05-30T06:55:33.941865+0000","last_unstale":"2024-05-30T06:55:36.549907+0000","last_undegraded":"2024-05-30T06:55:36.549907+0000","last_fullsized":"2024-05-30T06:55:36.549907+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:01:17.121793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935529+0000","last_change":"2024-05-30T06:55:34.945420+0000","last_active":"2024-05-30T06:55:35.935529+0000","last_peered":"2024-05-30T06:55:35.935529+0000","last_clean":"2024-05-30T06:55:35.935529+0000","last_became_active":"2024-05-30T06:55:34.945163+0000","last_became_peered":"2024-05-30T06:55:34.945163+0000","last_unstale":"2024-05-30T06:55:35.935529+0000","last_undegraded":"2024-05-30T06:55:35.935529+0000","last_fullsized":"2024-05-30T06:55:35.935529+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:39.774985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550702+0000","last_change":"2024-05-30T06:55:33.939208+0000","last_active":"2024-05-30T06:55:36.550702+0000","last_peered":"2024-05-30T06:55:36.550702+0000","last_clean":"2024-05-30T06:55:36.550702+0000","last_became_active":"2024-05-30T06:55:33.938920+0000","last_became_peered":"2024-05-30T06:55:33.938920+0000","last_unstale":"2024-05-30T06:55:36.550702+0000","last_undegraded":"2024-05-30T06:55:36.550702+0000","last_fullsized":"2024-05-30T06:55:36.550702+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:35:03.169765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.352232+0000","last_change":"2024-05-30T06:55:34.956073+0000","last_active":"2024-05-30T06:55:36.352232+0000","last_peered":"2024-05-30T06:55:36.352232+0000","last_clean":"2024-05-30T06:55:36.352232+0000","last_became_active":"2024-05-30T06:55:34.952647+0000","last_became_peered":"2024-05-30T06:55:34.952647+0000","last_unstale":"2024-05-30T06:55:36.352232+0000","last_undegraded":"2024-05-30T06:55:36.352232+0000","last_fullsized":"2024-05-30T06:55:36.352232+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:37:06.118376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550488+0000","last_change":"2024-05-30T06:55:33.941180+0000","last_active":"2024-05-30T06:55:36.550488+0000","last_peered":"2024-05-30T06:55:36.550488+0000","last_clean":"2024-05-30T06:55:36.550488+0000","last_became_active":"2024-05-30T06:55:33.940874+0000","last_became_peered":"2024-05-30T06:55:33.940874+0000","last_unstale":"2024-05-30T06:55:36.550488+0000","last_undegraded":"2024-05-30T06:55:36.550488+0000","last_fullsized":"2024-05-30T06:55:36.550488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:34:52.834290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.552956+0000","last_change":"2024-05-30T06:55:34.940893+0000","last_active":"2024-05-30T06:55:36.552956+0000","last_peered":"2024-05-30T06:55:36.552956+0000","last_clean":"2024-05-30T06:55:36.552956+0000","last_became_active":"2024-05-30T06:55:34.940633+0000","last_became_peered":"2024-05-30T06:55:34.940633+0000","last_unstale":"2024-05-30T06:55:36.552956+0000","last_undegraded":"2024-05-30T06:55:36.552956+0000","last_fullsized":"2024-05-30T06:55:36.552956+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:30:32.864737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"101'3","reported_seq":17,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.231285+0000","last_change":"2024-05-30T06:55:33.945685+0000","last_active":"2024-05-30T06:55:36.231285+0000","last_peered":"2024-05-30T06:55:36.231285+0000","last_clean":"2024-05-30T06:55:36.231285+0000","last_became_active":"2024-05-30T06:55:33.945289+0000","last_became_peered":"2024-05-30T06:55:33.945289+0000","last_unstale":"2024-05-30T06:55:36.231285+0000","last_undegraded":"2024-05-30T06:55:36.231285+0000","last_fullsized":"2024-05-30T06:55:36.231285+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:32:08.510835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.231197+0000","last_change":"2024-05-30T06:55:34.941190+0000","last_active":"2024-05-30T06:55:36.231197+0000","last_peered":"2024-05-30T06:55:36.231197+0000","last_clean":"2024-05-30T06:55:36.231197+0000","last_became_active":"2024-05-30T06:55:34.940885+0000","last_became_peered":"2024-05-30T06:55:34.940885+0000","last_unstale":"2024-05-30T06:55:36.231197+0000","last_undegraded":"2024-05-30T06:55:36.231197+0000","last_fullsized":"2024-05-30T06:55:36.231197+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:35:15.603331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"101'6","reported_seq":20,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.351997+0000","last_change":"2024-05-30T06:55:33.937604+0000","last_active":"2024-05-30T06:55:36.351997+0000","last_peered":"2024-05-30T06:55:36.351997+0000","last_clean":"2024-05-30T06:55:36.351997+0000","last_became_active":"2024-05-30T06:55:33.937237+0000","last_became_peered":"2024-05-30T06:55:33.937237+0000","last_unstale":"2024-05-30T06:55:36.351997+0000","last_undegraded":"2024-05-30T06:55:36.351997+0000","last_fullsized":"2024-05-30T06:55:36.351997+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:05:37.153173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549913+0000","last_change":"2024-05-30T06:55:34.943989+0000","last_active":"2024-05-30T06:55:36.549913+0000","last_peered":"2024-05-30T06:55:36.549913+0000","last_clean":"2024-05-30T06:55:36.549913+0000","last_became_active":"2024-05-30T06:55:34.943713+0000","last_became_peered":"2024-05-30T06:55:34.943713+0000","last_unstale":"2024-05-30T06:55:36.549913+0000","last_undegraded":"2024-05-30T06:55:36.549913+0000","last_fullsized":"2024-05-30T06:55:36.549913+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:13.858335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936597+0000","last_change":"2024-05-30T06:55:33.946863+0000","last_active":"2024-05-30T06:55:35.936597+0000","last_peered":"2024-05-30T06:55:35.936597+0000","last_clean":"2024-05-30T06:55:35.936597+0000","last_became_active":"2024-05-30T06:55:33.946359+0000","last_became_peered":"2024-05-30T06:55:33.946359+0000","last_unstale":"2024-05-30T06:55:35.936597+0000","last_undegraded":"2024-05-30T06:55:35.936597+0000","last_fullsized":"2024-05-30T06:55:35.936597+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:28:13.091978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550138+0000","last_change":"2024-05-30T06:55:34.954359+0000","last_active":"2024-05-30T06:55:36.550138+0000","last_peered":"2024-05-30T06:55:36.550138+0000","last_clean":"2024-05-30T06:55:36.550138+0000","last_became_active":"2024-05-30T06:55:34.954087+0000","last_became_peered":"2024-05-30T06:55:34.954087+0000","last_unstale":"2024-05-30T06:55:36.550138+0000","last_undegraded":"2024-05-30T06:55:36.550138+0000","last_fullsized":"2024-05-30T06:55:36.550138+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:37:44.294336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936525+0000","last_change":"2024-05-30T06:55:33.946627+0000","last_active":"2024-05-30T06:55:35.936525+0000","last_peered":"2024-05-30T06:55:35.936525+0000","last_clean":"2024-05-30T06:55:35.936525+0000","last_became_active":"2024-05-30T06:55:33.946211+0000","last_became_peered":"2024-05-30T06:55:33.946211+0000","last_unstale":"2024-05-30T06:55:35.936525+0000","last_undegraded":"2024-05-30T06:55:35.936525+0000","last_fullsized":"2024-05-30T06:55:35.936525+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:29:44.806855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.351580+0000","last_change":"2024-05-30T06:55:34.946050+0000","last_active":"2024-05-30T06:55:36.351580+0000","last_peered":"2024-05-30T06:55:36.351580+0000","last_clean":"2024-05-30T06:55:36.351580+0000","last_became_active":"2024-05-30T06:55:34.945783+0000","last_became_peered":"2024-05-30T06:55:34.945783+0000","last_unstale":"2024-05-30T06:55:36.351580+0000","last_undegraded":"2024-05-30T06:55:36.351580+0000","last_fullsized":"2024-05-30T06:55:36.351580+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:48:57.776244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.351506+0000","last_change":"2024-05-30T06:55:33.935901+0000","last_active":"2024-05-30T06:55:36.351506+0000","last_peered":"2024-05-30T06:55:36.351506+0000","last_clean":"2024-05-30T06:55:36.351506+0000","last_became_active":"2024-05-30T06:55:33.935035+0000","last_became_peered":"2024-05-30T06:55:33.935035+0000","last_unstale":"2024-05-30T06:55:36.351506+0000","last_undegraded":"2024-05-30T06:55:36.351506+0000","last_fullsized":"2024-05-30T06:55:36.351506+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:55:49.716384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936137+0000","last_change":"2024-05-30T06:55:34.943858+0000","last_active":"2024-05-30T06:55:35.936137+0000","last_peered":"2024-05-30T06:55:35.936137+0000","last_clean":"2024-05-30T06:55:35.936137+0000","last_became_active":"2024-05-30T06:55:34.943466+0000","last_became_peered":"2024-05-30T06:55:34.943466+0000","last_unstale":"2024-05-30T06:55:35.936137+0000","last_undegraded":"2024-05-30T06:55:35.936137+0000","last_fullsized":"2024-05-30T06:55:35.936137+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:35:04.172690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"101'8","reported_seq":22,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550196+0000","last_change":"2024-05-30T06:55:33.935067+0000","last_active":"2024-05-30T06:55:36.550196+0000","last_peered":"2024-05-30T06:55:36.550196+0000","last_clean":"2024-05-30T06:55:36.550196+0000","last_became_active":"2024-05-30T06:55:33.934711+0000","last_became_peered":"2024-05-30T06:55:33.934711+0000","last_unstale":"2024-05-30T06:55:36.550196+0000","last_undegraded":"2024-05-30T06:55:36.550196+0000","last_fullsized":"2024-05-30T06:55:36.550196+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:00:19.840427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.553176+0000","last_change":"2024-05-30T06:55:34.957679+0000","last_active":"2024-05-30T06:55:36.553176+0000","last_peered":"2024-05-30T06:55:36.553176+0000","last_clean":"2024-05-30T06:55:36.553176+0000","last_became_active":"2024-05-30T06:55:34.957106+0000","last_became_peered":"2024-05-30T06:55:34.957106+0000","last_unstale":"2024-05-30T06:55:36.553176+0000","last_undegraded":"2024-05-30T06:55:36.553176+0000","last_fullsized":"2024-05-30T06:55:36.553176+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:34:53.837215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.351921+0000","last_change":"2024-05-30T06:55:33.950261+0000","last_active":"2024-05-30T06:55:36.351921+0000","last_peered":"2024-05-30T06:55:36.351921+0000","last_clean":"2024-05-30T06:55:36.351921+0000","last_became_active":"2024-05-30T06:55:33.949959+0000","last_became_peered":"2024-05-30T06:55:33.949959+0000","last_unstale":"2024-05-30T06:55:36.351921+0000","last_undegraded":"2024-05-30T06:55:36.351921+0000","last_fullsized":"2024-05-30T06:55:36.351921+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:03:58.824810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.939466+0000","last_change":"2024-05-30T06:55:34.944601+0000","last_active":"2024-05-30T06:55:35.939466+0000","last_peered":"2024-05-30T06:55:35.939466+0000","last_clean":"2024-05-30T06:55:35.939466+0000","last_became_active":"2024-05-30T06:55:34.944280+0000","last_became_peered":"2024-05-30T06:55:34.944280+0000","last_unstale":"2024-05-30T06:55:35.939466+0000","last_undegraded":"2024-05-30T06:55:35.939466+0000","last_fullsized":"2024-05-30T06:55:35.939466+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:05:38.156098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.552949+0000","last_change":"2024-05-30T06:55:33.935720+0000","last_active":"2024-05-30T06:55:36.552949+0000","last_peered":"2024-05-30T06:55:36.552949+0000","last_clean":"2024-05-30T06:55:36.552949+0000","last_became_active":"2024-05-30T06:55:33.935370+0000","last_became_peered":"2024-05-30T06:55:33.935370+0000","last_unstale":"2024-05-30T06:55:36.552949+0000","last_undegraded":"2024-05-30T06:55:36.552949+0000","last_fullsized":"2024-05-30T06:55:36.552949+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:28:14.731398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.231313+0000","last_change":"2024-05-30T06:55:34.951584+0000","last_active":"2024-05-30T06:55:36.231313+0000","last_peered":"2024-05-30T06:55:36.231313+0000","last_clean":"2024-05-30T06:55:36.231313+0000","last_became_active":"2024-05-30T06:55:34.951318+0000","last_became_peered":"2024-05-30T06:55:34.951318+0000","last_unstale":"2024-05-30T06:55:36.231313+0000","last_undegraded":"2024-05-30T06:55:36.231313+0000","last_fullsized":"2024-05-30T06:55:36.231313+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:11:33.495642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935412+0000","last_change":"2024-05-30T06:55:33.935564+0000","last_active":"2024-05-30T06:55:35.935412+0000","last_peered":"2024-05-30T06:55:35.935412+0000","last_clean":"2024-05-30T06:55:35.935412+0000","last_became_active":"2024-05-30T06:55:33.934422+0000","last_became_peered":"2024-05-30T06:55:33.934422+0000","last_unstale":"2024-05-30T06:55:35.935412+0000","last_undegraded":"2024-05-30T06:55:35.935412+0000","last_fullsized":"2024-05-30T06:55:35.935412+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:24:00.583740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936472+0000","last_change":"2024-05-30T06:55:34.937256+0000","last_active":"2024-05-30T06:55:35.936472+0000","last_peered":"2024-05-30T06:55:35.936472+0000","last_clean":"2024-05-30T06:55:35.936472+0000","last_became_active":"2024-05-30T06:55:34.936954+0000","last_became_peered":"2024-05-30T06:55:34.936954+0000","last_unstale":"2024-05-30T06:55:35.936472+0000","last_undegraded":"2024-05-30T06:55:35.936472+0000","last_fullsized":"2024-05-30T06:55:35.936472+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:56:43.822842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935114+0000","last_change":"2024-05-30T06:55:33.944968+0000","last_active":"2024-05-30T06:55:35.935114+0000","last_peered":"2024-05-30T06:55:35.935114+0000","last_clean":"2024-05-30T06:55:35.935114+0000","last_became_active":"2024-05-30T06:55:33.944653+0000","last_became_peered":"2024-05-30T06:55:33.944653+0000","last_unstale":"2024-05-30T06:55:35.935114+0000","last_undegraded":"2024-05-30T06:55:35.935114+0000","last_fullsized":"2024-05-30T06:55:35.935114+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:56:24.913375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936485+0000","last_change":"2024-05-30T06:55:34.938166+0000","last_active":"2024-05-30T06:55:35.936485+0000","last_peered":"2024-05-30T06:55:35.936485+0000","last_clean":"2024-05-30T06:55:35.936485+0000","last_became_active":"2024-05-30T06:55:34.937442+0000","last_became_peered":"2024-05-30T06:55:34.937442+0000","last_unstale":"2024-05-30T06:55:35.936485+0000","last_undegraded":"2024-05-30T06:55:35.936485+0000","last_fullsized":"2024-05-30T06:55:35.936485+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:21:38.410216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.939689+0000","last_change":"2024-05-30T06:55:33.939347+0000","last_active":"2024-05-30T06:55:35.939689+0000","last_peered":"2024-05-30T06:55:35.939689+0000","last_clean":"2024-05-30T06:55:35.939689+0000","last_became_active":"2024-05-30T06:55:33.939016+0000","last_became_peered":"2024-05-30T06:55:33.939016+0000","last_unstale":"2024-05-30T06:55:35.939689+0000","last_undegraded":"2024-05-30T06:55:35.939689+0000","last_fullsized":"2024-05-30T06:55:35.939689+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:08:49.286125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936089+0000","last_change":"2024-05-30T06:55:34.933176+0000","last_active":"2024-05-30T06:55:35.936089+0000","last_peered":"2024-05-30T06:55:35.936089+0000","last_clean":"2024-05-30T06:55:35.936089+0000","last_became_active":"2024-05-30T06:55:34.932903+0000","last_became_peered":"2024-05-30T06:55:34.932903+0000","last_unstale":"2024-05-30T06:55:35.936089+0000","last_undegraded":"2024-05-30T06:55:35.936089+0000","last_fullsized":"2024-05-30T06:55:35.936089+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:52:32.501226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.939362+0000","last_change":"2024-05-30T06:55:33.937075+0000","last_active":"2024-05-30T06:55:35.939362+0000","last_peered":"2024-05-30T06:55:35.939362+0000","last_clean":"2024-05-30T06:55:35.939362+0000","last_became_active":"2024-05-30T06:55:33.936712+0000","last_became_peered":"2024-05-30T06:55:33.936712+0000","last_unstale":"2024-05-30T06:55:35.939362+0000","last_undegraded":"2024-05-30T06:55:35.939362+0000","last_fullsized":"2024-05-30T06:55:35.939362+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:43.463300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.552719+0000","last_change":"2024-05-30T06:55:34.953243+0000","last_active":"2024-05-30T06:55:36.552719+0000","last_peered":"2024-05-30T06:55:36.552719+0000","last_clean":"2024-05-30T06:55:36.552719+0000","last_became_active":"2024-05-30T06:55:34.952943+0000","last_became_peered":"2024-05-30T06:55:34.952943+0000","last_unstale":"2024-05-30T06:55:36.552719+0000","last_undegraded":"2024-05-30T06:55:36.552719+0000","last_fullsized":"2024-05-30T06:55:36.552719+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:58:52.076037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.934677+0000","last_change":"2024-05-30T06:55:33.939978+0000","last_active":"2024-05-30T06:55:35.934677+0000","last_peered":"2024-05-30T06:55:35.934677+0000","last_clean":"2024-05-30T06:55:35.934677+0000","last_became_active":"2024-05-30T06:55:33.939661+0000","last_became_peered":"2024-05-30T06:55:33.939661+0000","last_unstale":"2024-05-30T06:55:35.934677+0000","last_undegraded":"2024-05-30T06:55:35.934677+0000","last_fullsized":"2024-05-30T06:55:35.934677+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:21:54.215474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935525+0000","last_change":"2024-05-30T06:55:34.947321+0000","last_active":"2024-05-30T06:55:35.935525+0000","last_peered":"2024-05-30T06:55:35.935525+0000","last_clean":"2024-05-30T06:55:35.935525+0000","last_became_active":"2024-05-30T06:55:34.947060+0000","last_became_peered":"2024-05-30T06:55:34.947060+0000","last_unstale":"2024-05-30T06:55:35.935525+0000","last_undegraded":"2024-05-30T06:55:35.935525+0000","last_fullsized":"2024-05-30T06:55:35.935525+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:54.211731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"101'2","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.939896+0000","last_change":"2024-05-30T06:55:33.937091+0000","last_active":"2024-05-30T06:55:35.939896+0000","last_peered":"2024-05-30T06:55:35.939896+0000","last_clean":"2024-05-30T06:55:35.939896+0000","last_became_active":"2024-05-30T06:55:33.936792+0000","last_became_peered":"2024-05-30T06:55:33.936792+0000","last_unstale":"2024-05-30T06:55:35.939896+0000","last_undegraded":"2024-05-30T06:55:35.939896+0000","last_fullsized":"2024-05-30T06:55:35.939896+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:28:14.731398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550610+0000","last_change":"2024-05-30T06:55:34.950757+0000","last_active":"2024-05-30T06:55:36.550610+0000","last_peered":"2024-05-30T06:55:36.550610+0000","last_clean":"2024-05-30T06:55:36.550610+0000","last_became_active":"2024-05-30T06:55:34.950468+0000","last_became_peered":"2024-05-30T06:55:34.950468+0000","last_unstale":"2024-05-30T06:55:36.550610+0000","last_undegraded":"2024-05-30T06:55:36.550610+0000","last_fullsized":"2024-05-30T06:55:36.550610+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:47:32.095982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935606+0000","last_change":"2024-05-30T06:55:33.947953+0000","last_active":"2024-05-30T06:55:35.935606+0000","last_peered":"2024-05-30T06:55:35.935606+0000","last_clean":"2024-05-30T06:55:35.935606+0000","last_became_active":"2024-05-30T06:55:33.947682+0000","last_became_peered":"2024-05-30T06:55:33.947682+0000","last_unstale":"2024-05-30T06:55:35.935606+0000","last_undegraded":"2024-05-30T06:55:35.935606+0000","last_fullsized":"2024-05-30T06:55:35.935606+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:42.797019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.550374+0000","last_change":"2024-05-30T06:55:34.940992+0000","last_active":"2024-05-30T06:55:36.550374+0000","last_peered":"2024-05-30T06:55:36.550374+0000","last_clean":"2024-05-30T06:55:36.550374+0000","last_became_active":"2024-05-30T06:55:34.940697+0000","last_became_peered":"2024-05-30T06:55:34.940697+0000","last_unstale":"2024-05-30T06:55:36.550374+0000","last_undegraded":"2024-05-30T06:55:36.550374+0000","last_fullsized":"2024-05-30T06:55:36.550374+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:07:05.864440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935042+0000","last_change":"2024-05-30T06:55:33.942331+0000","last_active":"2024-05-30T06:55:35.935042+0000","last_peered":"2024-05-30T06:55:35.935042+0000","last_clean":"2024-05-30T06:55:35.935042+0000","last_became_active":"2024-05-30T06:55:33.942074+0000","last_became_peered":"2024-05-30T06:55:33.942074+0000","last_unstale":"2024-05-30T06:55:35.935042+0000","last_undegraded":"2024-05-30T06:55:35.935042+0000","last_fullsized":"2024-05-30T06:55:35.935042+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:28:44.612162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.552822+0000","last_change":"2024-05-30T06:55:34.934959+0000","last_active":"2024-05-30T06:55:36.552822+0000","last_peered":"2024-05-30T06:55:36.552822+0000","last_clean":"2024-05-30T06:55:36.552822+0000","last_became_active":"2024-05-30T06:55:34.934536+0000","last_became_peered":"2024-05-30T06:55:34.934536+0000","last_unstale":"2024-05-30T06:55:36.552822+0000","last_undegraded":"2024-05-30T06:55:36.552822+0000","last_fullsized":"2024-05-30T06:55:36.552822+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:43.799944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.553076+0000","last_change":"2024-05-30T06:55:33.938985+0000","last_active":"2024-05-30T06:55:36.553076+0000","last_peered":"2024-05-30T06:55:36.553076+0000","last_clean":"2024-05-30T06:55:36.553076+0000","last_became_active":"2024-05-30T06:55:33.938648+0000","last_became_peered":"2024-05-30T06:55:33.938648+0000","last_unstale":"2024-05-30T06:55:36.553076+0000","last_undegraded":"2024-05-30T06:55:36.553076+0000","last_fullsized":"2024-05-30T06:55:36.553076+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:03:58.824810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936535+0000","last_change":"2024-05-30T06:55:34.947863+0000","last_active":"2024-05-30T06:55:35.936535+0000","last_peered":"2024-05-30T06:55:35.936535+0000","last_clean":"2024-05-30T06:55:35.936535+0000","last_became_active":"2024-05-30T06:55:34.947573+0000","last_became_peered":"2024-05-30T06:55:34.947573+0000","last_unstale":"2024-05-30T06:55:35.936535+0000","last_undegraded":"2024-05-30T06:55:35.936535+0000","last_fullsized":"2024-05-30T06:55:35.936535+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:46:21.671327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.935203+0000","last_change":"2024-05-30T06:55:33.934159+0000","last_active":"2024-05-30T06:55:35.935203+0000","last_peered":"2024-05-30T06:55:35.935203+0000","last_clean":"2024-05-30T06:55:35.935203+0000","last_became_active":"2024-05-30T06:55:33.933841+0000","last_became_peered":"2024-05-30T06:55:33.933841+0000","last_unstale":"2024-05-30T06:55:35.935203+0000","last_undegraded":"2024-05-30T06:55:35.935203+0000","last_fullsized":"2024-05-30T06:55:35.935203+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:47:19.119777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.351689+0000","last_change":"2024-05-30T06:55:34.949419+0000","last_active":"2024-05-30T06:55:36.351689+0000","last_peered":"2024-05-30T06:55:36.351689+0000","last_clean":"2024-05-30T06:55:36.351689+0000","last_became_active":"2024-05-30T06:55:34.949141+0000","last_became_peered":"2024-05-30T06:55:34.949141+0000","last_unstale":"2024-05-30T06:55:36.351689+0000","last_undegraded":"2024-05-30T06:55:36.351689+0000","last_fullsized":"2024-05-30T06:55:36.351689+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:53.883496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.552589+0000","last_change":"2024-05-30T06:55:33.938260+0000","last_active":"2024-05-30T06:55:36.552589+0000","last_peered":"2024-05-30T06:55:36.552589+0000","last_clean":"2024-05-30T06:55:36.552589+0000","last_became_active":"2024-05-30T06:55:33.937992+0000","last_became_peered":"2024-05-30T06:55:33.937992+0000","last_unstale":"2024-05-30T06:55:36.552589+0000","last_undegraded":"2024-05-30T06:55:36.552589+0000","last_fullsized":"2024-05-30T06:55:36.552589+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:58:13.201695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936125+0000","last_change":"2024-05-30T06:55:34.949234+0000","last_active":"2024-05-30T06:55:35.936125+0000","last_peered":"2024-05-30T06:55:35.936125+0000","last_clean":"2024-05-30T06:55:35.936125+0000","last_became_active":"2024-05-30T06:55:34.945676+0000","last_became_peered":"2024-05-30T06:55:34.945676+0000","last_unstale":"2024-05-30T06:55:35.936125+0000","last_undegraded":"2024-05-30T06:55:35.936125+0000","last_fullsized":"2024-05-30T06:55:35.936125+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:35:26.873680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.549631+0000","last_change":"2024-05-30T06:55:33.937358+0000","last_active":"2024-05-30T06:55:36.549631+0000","last_peered":"2024-05-30T06:55:36.549631+0000","last_clean":"2024-05-30T06:55:36.549631+0000","last_became_active":"2024-05-30T06:55:33.937026+0000","last_became_peered":"2024-05-30T06:55:33.937026+0000","last_unstale":"2024-05-30T06:55:36.549631+0000","last_undegraded":"2024-05-30T06:55:36.549631+0000","last_fullsized":"2024-05-30T06:55:36.549631+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:14:56.877290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.552749+0000","last_change":"2024-05-30T06:55:34.936431+0000","last_active":"2024-05-30T06:55:36.552749+0000","last_peered":"2024-05-30T06:55:36.552749+0000","last_clean":"2024-05-30T06:55:36.552749+0000","last_became_active":"2024-05-30T06:55:34.936086+0000","last_became_peered":"2024-05-30T06:55:34.936086+0000","last_unstale":"2024-05-30T06:55:36.552749+0000","last_undegraded":"2024-05-30T06:55:36.552749+0000","last_fullsized":"2024-05-30T06:55:36.552749+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:24:01.586666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936181+0000","last_change":"2024-05-30T06:55:33.944390+0000","last_active":"2024-05-30T06:55:35.936181+0000","last_peered":"2024-05-30T06:55:35.936181+0000","last_clean":"2024-05-30T06:55:35.936181+0000","last_became_active":"2024-05-30T06:55:33.943939+0000","last_became_peered":"2024-05-30T06:55:33.943939+0000","last_unstale":"2024-05-30T06:55:35.936181+0000","last_undegraded":"2024-05-30T06:55:35.936181+0000","last_fullsized":"2024-05-30T06:55:35.936181+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:02:14.250133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:35.936889+0000","last_change":"2024-05-30T06:55:34.945336+0000","last_active":"2024-05-30T06:55:35.936889+0000","last_peered":"2024-05-30T06:55:35.936889+0000","last_clean":"2024-05-30T06:55:35.936889+0000","last_became_active":"2024-05-30T06:55:34.942147+0000","last_became_peered":"2024-05-30T06:55:34.942147+0000","last_unstale":"2024-05-30T06:55:35.936889+0000","last_undegraded":"2024-05-30T06:55:35.936889+0000","last_fullsized":"2024-05-30T06:55:35.936889+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:33.911105+0000","last_clean_scrub_stamp":"2024-05-30T06:55:33.911105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:39:25.431726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"101'1","reported_seq":15,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.230950+0000","last_change":"2024-05-30T06:55:33.942731+0000","last_active":"2024-05-30T06:55:36.230950+0000","last_peered":"2024-05-30T06:55:36.230950+0000","last_clean":"2024-05-30T06:55:36.230950+0000","last_became_active":"2024-05-30T06:55:33.942215+0000","last_became_peered":"2024-05-30T06:55:33.942215+0000","last_unstale":"2024-05-30T06:55:36.230950+0000","last_undegraded":"2024-05-30T06:55:36.230950+0000","last_fullsized":"2024-05-30T06:55:36.230950+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:55:32.908180+0000","last_clean_scrub_stamp":"2024-05-30T06:55:32.908180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:34:52.834290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":327,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-05-30T06:55:36.230657+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:55:36.230657+0000","last_peered":"2024-05-30T06:55:36.230657+0000","last_clean":"2024-05-30T06:55:36.230657+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:55:36.230657+0000","last_undegraded":"2024-05-30T06:55:36.230657+0000","last_fullsized":"2024-05-30T06:55:36.230657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575015,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123180,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248660,"statfs":{"total":96636764160,"available":96510627840,"internally_reserved":0,"allocated":1863680,"data_stored":1140372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575016,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":122596,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94249244,"statfs":{"total":96636764160,"available":96511225856,"internally_reserved":0,"allocated":1269760,"data_stored":550544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":124254662},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575016,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76772,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94295068,"statfs":{"total":96636764160,"available":96558149632,"internally_reserved":0,"allocated":1265664,"data_stored":549962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575015,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82352,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94289488,"statfs":{"total":96636764160,"available":96552435712,"internally_reserved":0,"allocated":1282048,"data_stored":551628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140656,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231184,"statfs":{"total":96636764160,"available":96492732416,"internally_reserved":0,"allocated":1277952,"data_stored":551526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":142735815},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575014,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140644,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94231196,"statfs":{"total":96636764160,"available":96492744704,"internally_reserved":0,"allocated":1265664,"data_stored":549926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575016,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104544,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94267296,"statfs":{"total":96636764160,"available":96529711104,"internally_reserved":0,"allocated":1261568,"data_stored":549892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575016,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77348,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294492,"statfs":{"total":96636764160,"available":96557559808,"internally_reserved":0,"allocated":1859584,"data_stored":1140842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:55:44.019 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-30T06:55:44.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T06:55:44.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.205+0000 7f3a6be00640 1 Processor -- start 2024-05-30T06:55:44.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.205+0000 7f3a6be00640 1 -- start start 2024-05-30T06:55:44.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.205+0000 7f3a6be00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a6415c890 0x7f3a64162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:44.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.205+0000 7f3a6be00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3a64072e60 0x7f3a6406c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:44.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.205+0000 7f3a6be00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a64163020 con 0x7f3a6415f210 2024-05-30T06:55:44.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.205+0000 7f3a6be00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3a64163300 con 0x7f3a64072e60 2024-05-30T06:55:44.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.205+0000 7f3a6be00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3a641635e0 con 0x7f3a6415c890 2024-05-30T06:55:44.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.209+0000 7f3a69400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a6415c890 0x7f3a64162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:44.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.209+0000 7f3a68a00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3a6415f210 0x7f3a64072750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:53356/0 (socket says 172.21.15.37:53356) 2024-05-30T06:55:44.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.209+0000 7f3a68a00640 1 -- 172.21.15.37:0/3434142318 learned_addr learned my addr 172.21.15.37:0/3434142318 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:44.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.209+0000 7f3a69e00640 1 --2- 172.21.15.37:0/3434142318 >> v2:172.21.15.105:3300/0 conn(0x7f3a64072e60 0x7f3a6406c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:44.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.209+0000 7f3a63e00640 1 -- 172.21.15.37:0/3434142318 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237321412 0 0) 0x7f3a64163020 con 0x7f3a6415f210 2024-05-30T06:55:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.209+0000 7f3a63e00640 1 -- 172.21.15.37:0/3434142318 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a4c003530 con 0x7f3a6415f210 2024-05-30T06:55:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.209+0000 7f3a69e00640 1 -- 172.21.15.37:0/3434142318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a6415c890 msgr2=0x7f3a64162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.209+0000 7f3a69e00640 1 --2- 172.21.15.37:0/3434142318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a6415c890 0x7f3a64162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.209+0000 7f3a69e00640 1 -- 172.21.15.37:0/3434142318 >> v1:172.21.15.105:6789/0 conn(0x7f3a6415f210 legacy=0x7f3a64072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.209+0000 7f3a69e00640 1 -- 172.21.15.37:0/3434142318 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6406ba00 con 0x7f3a64072e60 2024-05-30T06:55:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.209+0000 7f3a69400640 1 --2- 172.21.15.37:0/3434142318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a6415c890 0x7f3a64162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:55:44.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.209+0000 7f3a69e00640 1 --2- 172.21.15.37:0/3434142318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a64072e60 0x7f3a6406c200 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009d90 tx=0x7f3a5c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e02b683f82e858ef server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a63e00640 1 -- 172.21.15.37:0/3434142318 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0b2070 con 0x7f3a64072e60 2024-05-30T06:55:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a63e00640 1 -- 172.21.15.37:0/3434142318 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0a55a0 con 0x7f3a64072e60 2024-05-30T06:55:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a63e00640 1 -- 172.21.15.37:0/3434142318 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0a5970 con 0x7f3a64072e60 2024-05-30T06:55:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 -- 172.21.15.37:0/3434142318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a64072e60 msgr2=0x7f3a6406c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 --2- 172.21.15.37:0/3434142318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a64072e60 0x7f3a6406c200 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009d90 tx=0x7f3a5c01c8e0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 -- 172.21.15.37:0/3434142318 shutdown_connections 2024-05-30T06:55:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 --2- 172.21.15.37:0/3434142318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a64072e60 0x7f3a6406c200 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 --2- 172.21.15.37:0/3434142318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a6415c890 0x7f3a64162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 -- 172.21.15.37:0/3434142318 >> 172.21.15.37:0/3434142318 conn(0x7f3a640b2ac0 msgr2=0x7f3a640b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:44.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 -- 172.21.15.37:0/3434142318 shutdown_connections 2024-05-30T06:55:44.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 -- 172.21.15.37:0/3434142318 wait complete. 2024-05-30T06:55:44.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 Processor -- start 2024-05-30T06:55:44.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 -- start start 2024-05-30T06:55:44.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a64072e60 0x7f3a641548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:44.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6415c890 0x7f3a640b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:44.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a6415f210 0x7f3a64158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:44.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6416be50 con 0x7f3a6415f210 2024-05-30T06:55:44.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6416bcd0 con 0x7f3a6415c890 2024-05-30T06:55:44.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a6be00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3a6416bfd0 con 0x7f3a64072e60 2024-05-30T06:55:44.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a69e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a6415f210 0x7f3a64158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:44.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a68a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6415c890 0x7f3a640b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:44.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a69e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a6415f210 0x7f3a64158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45098/0 (socket says 172.21.15.37:45098) 2024-05-30T06:55:44.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a69e00640 1 -- 172.21.15.37:0/310907556 learned_addr learned my addr 172.21.15.37:0/310907556 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:44.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.213+0000 7f3a69400640 1 --2- 172.21.15.37:0/310907556 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a64072e60 0x7f3a641548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:44.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a69e00640 1 -- 172.21.15.37:0/310907556 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a64072e60 msgr2=0x7f3a641548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:44.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a69e00640 1 --2- 172.21.15.37:0/310907556 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a64072e60 0x7f3a641548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a69e00640 1 -- 172.21.15.37:0/310907556 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6415c890 msgr2=0x7f3a640b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:44.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a69e00640 1 --2- 172.21.15.37:0/310907556 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6415c890 0x7f3a640b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a69e00640 1 -- 172.21.15.37:0/310907556 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6415a270 con 0x7f3a6415f210 2024-05-30T06:55:44.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a69e00640 1 --2- 172.21.15.37:0/310907556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a6415f210 0x7f3a64158970 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0b0040 tx=0x7f3a5c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:44.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a61600640 1 -- 172.21.15.37:0/310907556 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0b2050 con 0x7f3a6415f210 2024-05-30T06:55:44.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a61600640 1 -- 172.21.15.37:0/310907556 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0be070 con 0x7f3a6415f210 2024-05-30T06:55:44.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a6be00640 1 -- 172.21.15.37:0/310907556 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6415a550 con 0x7f3a6415f210 2024-05-30T06:55:44.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a61600640 1 -- 172.21.15.37:0/310907556 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c009450 con 0x7f3a6415f210 2024-05-30T06:55:44.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a6be00640 1 -- 172.21.15.37:0/310907556 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a640b3970 con 0x7f3a6415f210 2024-05-30T06:55:44.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a6be00640 1 -- 172.21.15.37:0/310907556 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a64068bc0 con 0x7f3a6415f210 2024-05-30T06:55:44.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a61600640 1 -- 172.21.15.37:0/310907556 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f3a5c0ada90 con 0x7f3a6415f210 2024-05-30T06:55:44.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a61600640 1 --2- 172.21.15.37:0/310907556 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3a440698e0 0x7f3a4406bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:44.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.217+0000 7f3a61600640 1 -- 172.21.15.37:0/310907556 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f3a5c120c90 con 0x7f3a6415f210 2024-05-30T06:55:44.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.221+0000 7f3a69400640 1 --2- 172.21.15.37:0/310907556 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3a440698e0 0x7f3a4406bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:44.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.221+0000 7f3a69400640 1 --2- 172.21.15.37:0/310907556 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3a440698e0 0x7f3a4406bda0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3a6415ee30 tx=0x7f3a58009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:44.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.221+0000 7f3a61600640 1 -- 172.21.15.37:0/310907556 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3a5c016560 con 0x7f3a6415f210 2024-05-30T06:55:44.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.453+0000 7f3a6be00640 1 -- 172.21.15.37:0/310907556 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f3a64067d90 con 0x7f3a6415f210 2024-05-30T06:55:44.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.453+0000 7f3a61600640 1 -- 172.21.15.37:0/310907556 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f3a5c121110 con 0x7f3a6415f210 2024-05-30T06:55:44.456 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-30T06:55:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A== 2024-05-30T06:55:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-30T06:55:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-30T06:55:44.456 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T06:55:44.457 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-30T06:55:44.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.457+0000 7f3a6be00640 1 -- 172.21.15.37:0/310907556 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3a440698e0 msgr2=0x7f3a4406bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:44.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.457+0000 7f3a6be00640 1 --2- 172.21.15.37:0/310907556 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3a440698e0 0x7f3a4406bda0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3a6415ee30 tx=0x7f3a58009190 comp rx=0 tx=0).stop 2024-05-30T06:55:44.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.457+0000 7f3a6be00640 1 -- 172.21.15.37:0/310907556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a6415f210 msgr2=0x7f3a64158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:44.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.457+0000 7f3a6be00640 1 --2- 172.21.15.37:0/310907556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a6415f210 0x7f3a64158970 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0b0040 tx=0x7f3a5c019680 comp rx=0 tx=0).stop 2024-05-30T06:55:44.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.457+0000 7f3a6be00640 1 -- 172.21.15.37:0/310907556 shutdown_connections 2024-05-30T06:55:44.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.457+0000 7f3a6be00640 1 --2- 172.21.15.37:0/310907556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a6415f210 0x7f3a64158970 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.457+0000 7f3a6be00640 1 --2- 172.21.15.37:0/310907556 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3a440698e0 0x7f3a4406bda0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.457+0000 7f3a6be00640 1 --2- 172.21.15.37:0/310907556 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a6415c890 0x7f3a640b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.457+0000 7f3a6be00640 1 --2- 172.21.15.37:0/310907556 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a64072e60 0x7f3a641548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.457+0000 7f3a6be00640 1 -- 172.21.15.37:0/310907556 >> 172.21.15.37:0/310907556 conn(0x7f3a640b2ac0 msgr2=0x7f3a6415bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:44.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.457+0000 7f3a6be00640 1 -- 172.21.15.37:0/310907556 shutdown_connections 2024-05-30T06:55:44.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.457+0000 7f3a6be00640 1 -- 172.21.15.37:0/310907556 wait complete. 2024-05-30T06:55:44.479 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:55:44.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.617+0000 7fb47a600640 1 Processor -- start 2024-05-30T06:55:44.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.617+0000 7fb47a600640 1 -- start start 2024-05-30T06:55:44.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb47a600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb474146180 0x7fb4740b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:44.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb47a600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb47406c070 0x7fb474166490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:44.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb47a600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4740b07a0 con 0x7fb47415ce90 2024-05-30T06:55:44.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb47a600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb4740ae850 con 0x7fb47406c070 2024-05-30T06:55:44.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb47a600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb4740b0a80 con 0x7fb474146180 2024-05-30T06:55:44.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb46be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb47415ce90 0x7fb47406b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47422/0 (socket says 172.21.15.37:47422) 2024-05-30T06:55:44.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb46be00640 1 -- 172.21.15.37:0/769816157 learned_addr learned my addr 172.21.15.37:0/769816157 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:44.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb473400640 1 --2- 172.21.15.37:0/769816157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb474146180 0x7fb4740b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:44.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb473e00640 1 --2- 172.21.15.37:0/769816157 >> v2:172.21.15.105:3300/0 conn(0x7fb47406c070 0x7fb474166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:44.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb472a00640 1 -- 172.21.15.37:0/769816157 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429779834 0 0) 0x7fb4740b07a0 con 0x7fb47415ce90 2024-05-30T06:55:44.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb472a00640 1 -- 172.21.15.37:0/769816157 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb458003530 con 0x7fb47415ce90 2024-05-30T06:55:44.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb473400640 1 -- 172.21.15.37:0/769816157 >> v2:172.21.15.105:3300/0 conn(0x7fb47406c070 msgr2=0x7fb474166490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:44.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb473400640 1 --2- 172.21.15.37:0/769816157 >> v2:172.21.15.105:3300/0 conn(0x7fb47406c070 0x7fb474166490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb473400640 1 -- 172.21.15.37:0/769816157 >> v1:172.21.15.37:6789/0 conn(0x7fb47415ce90 legacy=0x7fb47406b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:44.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb473400640 1 -- 172.21.15.37:0/769816157 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4740b0d60 con 0x7fb474146180 2024-05-30T06:55:44.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.621+0000 7fb473e00640 1 --2- 172.21.15.37:0/769816157 >> v2:172.21.15.105:3300/0 conn(0x7fb47406c070 0x7fb474166490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:55:44.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb473400640 1 --2- 172.21.15.37:0/769816157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb474146180 0x7fb4740b6030 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb4640097c0 tx=0x7fb46401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62c256937e7c2eaf server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:44.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb472a00640 1 -- 172.21.15.37:0/769816157 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4640b0070 con 0x7fb474146180 2024-05-30T06:55:44.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb472a00640 1 -- 172.21.15.37:0/769816157 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4640ab600 con 0x7fb474146180 2024-05-30T06:55:44.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb472a00640 1 -- 172.21.15.37:0/769816157 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4640ab9d0 con 0x7fb474146180 2024-05-30T06:55:44.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb47a600640 1 -- 172.21.15.37:0/769816157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb474146180 msgr2=0x7fb4740b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:44.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb47a600640 1 --2- 172.21.15.37:0/769816157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb474146180 0x7fb4740b6030 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb4640097c0 tx=0x7fb46401c410 comp rx=0 tx=0).stop 2024-05-30T06:55:44.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb47a600640 1 -- 172.21.15.37:0/769816157 shutdown_connections 2024-05-30T06:55:44.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb47a600640 1 --2- 172.21.15.37:0/769816157 >> v2:172.21.15.105:3300/0 conn(0x7fb47406c070 0x7fb474166490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb47a600640 1 --2- 172.21.15.37:0/769816157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb474146180 0x7fb4740b6030 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb47a600640 1 -- 172.21.15.37:0/769816157 >> 172.21.15.37:0/769816157 conn(0x7fb4740b6a60 msgr2=0x7fb4740b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:44.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb47a600640 1 -- 172.21.15.37:0/769816157 shutdown_connections 2024-05-30T06:55:44.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb47a600640 1 -- 172.21.15.37:0/769816157 wait complete. 2024-05-30T06:55:44.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb47a600640 1 Processor -- start 2024-05-30T06:55:44.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.625+0000 7fb47a600640 1 -- start start 2024-05-30T06:55:44.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb47a600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb47406c070 0x7fb4741f7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:44.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb47a600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb474146180 0x7fb474152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:44.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb47a600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb47415ce90 0x7fb4740b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:44.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb47a600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb474169580 con 0x7fb47415ce90 2024-05-30T06:55:44.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb47a600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb474169400 con 0x7fb474146180 2024-05-30T06:55:44.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb47a600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb474169700 con 0x7fb47406c070 2024-05-30T06:55:44.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb473e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb47415ce90 0x7fb4740b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:44.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb473e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb47415ce90 0x7fb4740b2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45106/0 (socket says 172.21.15.37:45106) 2024-05-30T06:55:44.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb473e00640 1 -- 172.21.15.37:0/1781802921 learned_addr learned my addr 172.21.15.37:0/1781802921 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:44.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb473400640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb47406c070 0x7fb4741f7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:44.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb46be00640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb474146180 0x7fb474152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:44.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb473e00640 1 -- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb47406c070 msgr2=0x7fb4741f7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:44.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb473e00640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb47406c070 0x7fb4741f7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb473e00640 1 -- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb474146180 msgr2=0x7fb474152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:44.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb473e00640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb474146180 0x7fb474152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb473e00640 1 -- 172.21.15.37:0/1781802921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4741538f0 con 0x7fb47415ce90 2024-05-30T06:55:44.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb473e00640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb47415ce90 0x7fb4740b2410 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00efc0 tx=0x7fb46c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:44.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb46b400640 1 -- 172.21.15.37:0/1781802921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c018030 con 0x7fb47415ce90 2024-05-30T06:55:44.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb46b400640 1 -- 172.21.15.37:0/1781802921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb46c00cde0 con 0x7fb47415ce90 2024-05-30T06:55:44.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb47a600640 1 -- 172.21.15.37:0/1781802921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb474153b90 con 0x7fb47415ce90 2024-05-30T06:55:44.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb46b400640 1 -- 172.21.15.37:0/1781802921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c003bc0 con 0x7fb47415ce90 2024-05-30T06:55:44.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb47a600640 1 -- 172.21.15.37:0/1781802921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb474159980 con 0x7fb47415ce90 2024-05-30T06:55:44.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.629+0000 7fb47a600640 1 -- 172.21.15.37:0/1781802921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb474153f80 con 0x7fb47415ce90 2024-05-30T06:55:44.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.633+0000 7fb46b400640 1 -- 172.21.15.37:0/1781802921 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fb46c01b070 con 0x7fb47415ce90 2024-05-30T06:55:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.633+0000 7fb46b400640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb4500698e0 0x7fb45006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.633+0000 7fb46b400640 1 -- 172.21.15.37:0/1781802921 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fb46c086530 con 0x7fb47415ce90 2024-05-30T06:55:44.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.633+0000 7fb473400640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb4500698e0 0x7fb45006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:44.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.633+0000 7fb473400640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb4500698e0 0x7fb45006bda0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb4640ad000 tx=0x7fb4640a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:44.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.637+0000 7fb46b400640 1 -- 172.21.15.37:0/1781802921 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb46c022070 con 0x7fb47415ce90 2024-05-30T06:55:44.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.837+0000 7fb47a600640 1 -- 172.21.15.37:0/1781802921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb474068b20 con 0x7fb47415ce90 2024-05-30T06:55:44.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.841+0000 7fb46b400640 1 -- 172.21.15.37:0/1781802921 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5180 (secure 0 0 0) 0x7fb46c010040 con 0x7fb47415ce90 2024-05-30T06:55:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:55:44.842 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":64,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/667666714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":667666714},{"type":"v1","addr":"172.21.15.105:6836","nonce":667666714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/748743640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":748743640},{"type":"v1","addr":"172.21.15.37:6835","nonce":748743640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/527055184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":527055184},{"type":"v1","addr":"172.21.15.105:6837","nonce":527055184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:55:34.327016+0000","modified":"2024-05-30T06:55:37.340047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8538":{"gid":8538,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/1190106206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1190106206},{"type":"v1","addr":"172.21.15.37:6834","nonce":1190106206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8538,"qdb_cluster":[8538]},"id":7}]} 2024-05-30T06:55:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 64 2024-05-30T06:55:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.841+0000 7fb47a600640 1 -- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb4500698e0 msgr2=0x7fb45006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.841+0000 7fb47a600640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb4500698e0 0x7fb45006bda0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb4640ad000 tx=0x7fb4640a6000 comp rx=0 tx=0).stop 2024-05-30T06:55:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.841+0000 7fb47a600640 1 -- 172.21.15.37:0/1781802921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb47415ce90 msgr2=0x7fb4740b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.841+0000 7fb47a600640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb47415ce90 0x7fb4740b2410 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00efc0 tx=0x7fb46c009f90 comp rx=0 tx=0).stop 2024-05-30T06:55:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.841+0000 7fb47a600640 1 -- 172.21.15.37:0/1781802921 shutdown_connections 2024-05-30T06:55:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.841+0000 7fb47a600640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb47415ce90 0x7fb4740b2410 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.841+0000 7fb47a600640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb4500698e0 0x7fb45006bda0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.841+0000 7fb47a600640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb474146180 0x7fb474152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.841+0000 7fb47a600640 1 --2- 172.21.15.37:0/1781802921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb47406c070 0x7fb4741f7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.841+0000 7fb47a600640 1 -- 172.21.15.37:0/1781802921 >> 172.21.15.37:0/1781802921 conn(0x7fb4740b6a60 msgr2=0x7fb47406fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.841+0000 7fb47a600640 1 -- 172.21.15.37:0/1781802921 shutdown_connections 2024-05-30T06:55:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:44.841+0000 7fb47a600640 1 -- 172.21.15.37:0/1781802921 wait complete. 2024-05-30T06:55:45.265 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T06:55:34.327016+0000', 'modified': '2024-05-30T06:55:37.340047+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8538}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8538': {'gid': 8538, 'name': 'c', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6834/1190106206', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 1190106206}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 1190106206}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8538, 'qdb_cluster': [8538]} 2024-05-30T06:55:45.266 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T06:55:45.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-30T06:55:45.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.409+0000 7fd920000640 1 Processor -- start 2024-05-30T06:55:45.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.409+0000 7fd920000640 1 -- start start 2024-05-30T06:55:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.409+0000 7fd920000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd91815c650 0x7fd9180d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd920000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd9180b2890 0x7fd9180d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd920000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9180b3f40 con 0x7fd91815ca30 2024-05-30T06:55:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd920000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd9180cce80 con 0x7fd91815c650 2024-05-30T06:55:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd920000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd9180b2ec0 con 0x7fd9180b2890 2024-05-30T06:55:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd91d600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd91815c650 0x7fd9180d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd91cc00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd91815ca30 0x7fd9180b2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47432/0 (socket says 172.21.15.37:47432) 2024-05-30T06:55:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd91cc00640 1 -- 172.21.15.37:0/1134097282 learned_addr learned my addr 172.21.15.37:0/1134097282 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd91e000640 1 --2- 172.21.15.37:0/1134097282 >> v2:172.21.15.105:3300/0 conn(0x7fd9180b2890 0x7fd9180d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd91d600640 1 -- 172.21.15.37:0/1134097282 >> v2:172.21.15.105:3300/0 conn(0x7fd9180b2890 msgr2=0x7fd9180d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd91d600640 1 --2- 172.21.15.37:0/1134097282 >> v2:172.21.15.105:3300/0 conn(0x7fd9180b2890 0x7fd9180d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd91d600640 1 -- 172.21.15.37:0/1134097282 >> v1:172.21.15.37:6789/0 conn(0x7fd91815ca30 legacy=0x7fd9180b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd91d600640 1 -- 172.21.15.37:0/1134097282 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9180b3180 con 0x7fd91815c650 2024-05-30T06:55:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd917e00640 1 -- 172.21.15.37:0/1134097282 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122776453 0 0) 0x7fd9180b3f40 con 0x7fd91815ca30 2024-05-30T06:55:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd91d600640 1 --2- 172.21.15.37:0/1134097282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd91815c650 0x7fd9180d09e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fd9180b5210 tx=0x7fd90c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbf699b8c62cf0b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd917e00640 1 -- 172.21.15.37:0/1134097282 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0b5070 con 0x7fd91815c650 2024-05-30T06:55:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd917e00640 1 -- 172.21.15.37:0/1134097282 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c0a8970 con 0x7fd91815c650 2024-05-30T06:55:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.413+0000 7fd917e00640 1 -- 172.21.15.37:0/1134097282 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0a8d40 con 0x7fd91815c650 2024-05-30T06:55:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 -- 172.21.15.37:0/1134097282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd91815c650 msgr2=0x7fd9180d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 --2- 172.21.15.37:0/1134097282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd91815c650 0x7fd9180d09e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fd9180b5210 tx=0x7fd90c01ec70 comp rx=0 tx=0).stop 2024-05-30T06:55:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 -- 172.21.15.37:0/1134097282 shutdown_connections 2024-05-30T06:55:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 --2- 172.21.15.37:0/1134097282 >> v2:172.21.15.105:3300/0 conn(0x7fd9180b2890 0x7fd9180d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 --2- 172.21.15.37:0/1134097282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd91815c650 0x7fd9180d09e0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 -- 172.21.15.37:0/1134097282 >> 172.21.15.37:0/1134097282 conn(0x7fd9180b4130 msgr2=0x7fd9180b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 -- 172.21.15.37:0/1134097282 shutdown_connections 2024-05-30T06:55:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 -- 172.21.15.37:0/1134097282 wait complete. 2024-05-30T06:55:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 Processor -- start 2024-05-30T06:55:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 -- start start 2024-05-30T06:55:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9180b2890 0x7fd91815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd91815c650 0x7fd918157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd91815ca30 0x7fd9181f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd9180b3a20 con 0x7fd91815ca30 2024-05-30T06:55:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9180b3740 con 0x7fd91815c650 2024-05-30T06:55:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd920000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9180af410 con 0x7fd9180b2890 2024-05-30T06:55:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd91e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd91815ca30 0x7fd9181f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd91e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd91815ca30 0x7fd9181f79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45120/0 (socket says 172.21.15.37:45120) 2024-05-30T06:55:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd91e000640 1 -- 172.21.15.37:0/921374654 learned_addr learned my addr 172.21.15.37:0/921374654 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd91cc00640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd91815c650 0x7fd918157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd91d600640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9180b2890 0x7fd91815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd91e000640 1 -- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9180b2890 msgr2=0x7fd91815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd91e000640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9180b2890 0x7fd91815ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd91e000640 1 -- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd91815c650 msgr2=0x7fd918157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd91e000640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd91815c650 0x7fd918157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.417+0000 7fd91e000640 1 -- 172.21.15.37:0/921374654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9181f8230 con 0x7fd91815ca30 2024-05-30T06:55:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.421+0000 7fd91e000640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd91815ca30 0x7fd9181f79b0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fd910007e40 tx=0x7fd91000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.421+0000 7fd915600640 1 -- 172.21.15.37:0/921374654 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd910014620 con 0x7fd91815ca30 2024-05-30T06:55:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.421+0000 7fd915600640 1 -- 172.21.15.37:0/921374654 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd910019070 con 0x7fd91815ca30 2024-05-30T06:55:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.421+0000 7fd915600640 1 -- 172.21.15.37:0/921374654 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd910014a20 con 0x7fd91815ca30 2024-05-30T06:55:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.421+0000 7fd920000640 1 -- 172.21.15.37:0/921374654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9181f8510 con 0x7fd91815ca30 2024-05-30T06:55:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.421+0000 7fd920000640 1 -- 172.21.15.37:0/921374654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9180c96f0 con 0x7fd91815ca30 2024-05-30T06:55:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.421+0000 7fd915600640 1 -- 172.21.15.37:0/921374654 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fd910014bc0 con 0x7fd91815ca30 2024-05-30T06:55:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.421+0000 7fd915600640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd8f8069910 0x7fd8f806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.421+0000 7fd915600640 1 -- 172.21.15.37:0/921374654 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fd910086310 con 0x7fd91815ca30 2024-05-30T06:55:45.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.421+0000 7fd91d600640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd8f8069910 0x7fd8f806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.421+0000 7fd9234ed000 1 Processor -- start 2024-05-30T06:55:45.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 -- start start 2024-05-30T06:55:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91d600640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd8f8069910 0x7fd8f806bdd0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0b2000 tx=0x7fd90c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77120 0x55c678a77500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77a40 0x55c678a2a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a2a650 0x55c678a2aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c67887b420 con 0x55c678a77120 2024-05-30T06:55:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c678815bf0 con 0x55c678a77a40 2024-05-30T06:55:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55c6788773e0 con 0x55c678a2a650 2024-05-30T06:55:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77120 0x55c678a77500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77120 0x55c678a77500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45122/0 (socket says 172.21.15.37:45122) 2024-05-30T06:55:45.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91d600640 1 -- 172.21.15.37:0/4078269683 learned_addr learned my addr 172.21.15.37:0/4078269683 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91cc00640 1 --2- 172.21.15.37:0/4078269683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77a40 0x55c678a2a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91d600640 1 -- 172.21.15.37:0/4078269683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a2a650 msgr2=0x55c678a2aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91e000640 1 --2- 172.21.15.37:0/4078269683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a2a650 0x55c678a2aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91d600640 1 --2- 172.21.15.37:0/4078269683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a2a650 0x55c678a2aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91d600640 1 -- 172.21.15.37:0/4078269683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77a40 msgr2=0x55c678a2a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91d600640 1 --2- 172.21.15.37:0/4078269683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77a40 0x55c678a2a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91d600640 1 -- 172.21.15.37:0/4078269683 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c678923450 con 0x55c678a77120 2024-05-30T06:55:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91cc00640 1 --2- 172.21.15.37:0/4078269683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77a40 0x55c678a2a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91e000640 1 --2- 172.21.15.37:0/4078269683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a2a650 0x55c678a2aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd91d600640 1 --2- 172.21.15.37:0/4078269683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77120 0x55c678a77500 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fd90c008010 tx=0x7fd90c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d15edcbe1293fe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd90a000640 1 -- 172.21.15.37:0/4078269683 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0cc070 con 0x55c678a77120 2024-05-30T06:55:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd90a000640 1 -- 172.21.15.37:0/4078269683 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c0b6040 con 0x55c678a77120 2024-05-30T06:55:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd90a000640 1 -- 172.21.15.37:0/4078269683 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0b0700 con 0x55c678a77120 2024-05-30T06:55:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 -- 172.21.15.37:0/4078269683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77120 msgr2=0x55c678a77500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 --2- 172.21.15.37:0/4078269683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77120 0x55c678a77500 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fd90c008010 tx=0x7fd90c004740 comp rx=0 tx=0).stop 2024-05-30T06:55:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 -- 172.21.15.37:0/4078269683 shutdown_connections 2024-05-30T06:55:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 --2- 172.21.15.37:0/4078269683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a2a650 0x55c678a2aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 --2- 172.21.15.37:0/4078269683 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77a40 0x55c678a2a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 --2- 172.21.15.37:0/4078269683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77120 0x55c678a77500 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 -- 172.21.15.37:0/4078269683 >> 172.21.15.37:0/4078269683 conn(0x55c678a57ec0 msgr2=0x55c678a5a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 -- 172.21.15.37:0/4078269683 shutdown_connections 2024-05-30T06:55:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 -- 172.21.15.37:0/4078269683 wait complete. 2024-05-30T06:55:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 -- start start 2024-05-30T06:55:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.425+0000 7fd9234ed000 1 Processor -- start 2024-05-30T06:55:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a2a650 0x55c678a2fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a77120 0x55c678a30080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77a40 0x55c678a305c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c67881bec0 con 0x55c678a2a650 2024-05-30T06:55:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c6788fc120 con 0x55c678a77a40 2024-05-30T06:55:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55c678886350 con 0x55c678a77120 2024-05-30T06:55:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 10 client.0 _ll_register_callbacks cb 0x55c6788584d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:55:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd91d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a2a650 0x55c678a2fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd91d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a2a650 0x55c678a2fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45132/0 (socket says 172.21.15.37:45132) 2024-05-30T06:55:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd91d600640 1 -- 172.21.15.37:0/3194105321 learned_addr learned my addr 172.21.15.37:0/3194105321 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd91e000640 1 --2- 172.21.15.37:0/3194105321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77a40 0x55c678a305c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd91cc00640 1 --2- 172.21.15.37:0/3194105321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a77120 0x55c678a30080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd91d600640 1 -- 172.21.15.37:0/3194105321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a77120 msgr2=0x55c678a30080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd91d600640 1 --2- 172.21.15.37:0/3194105321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a77120 0x55c678a30080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd91d600640 1 -- 172.21.15.37:0/3194105321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77a40 msgr2=0x55c678a305c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd91d600640 1 --2- 172.21.15.37:0/3194105321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77a40 0x55c678a305c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd91d600640 1 -- 172.21.15.37:0/3194105321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6788c0f80 con 0x55c678a2a650 2024-05-30T06:55:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd91d600640 1 --2- 172.21.15.37:0/3194105321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a2a650 0x55c678a2fb40 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fd90c008010 tx=0x7fd90c01d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c79badf85d0c1f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd8fea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:55:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd8fea00640 1 -- 172.21.15.37:0/3194105321 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0d5060 con 0x55c678a2a650 2024-05-30T06:55:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd8fea00640 1 -- 172.21.15.37:0/3194105321 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fd90c0b0be0 con 0x55c678a2a650 2024-05-30T06:55:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 1 -- 172.21.15.37:0/3194105321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd90c0b6040 con 0x55c678a2a650 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd8fea00640 1 -- 172.21.15.37:0/3194105321 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7fd90c0db050 con 0x55c678a2a650 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 10 client.8703 fetch_fsmap learned FSMap version 64 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 1 -- 172.21.15.37:0/3194105321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) -- 0x55c678854f00 con 0x55c678a2a650 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd8fea00640 1 -- 172.21.15.37:0/3194105321 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c0b6040 con 0x55c678a2a650 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd8fea00640 1 -- 172.21.15.37:0/3194105321 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 64) ==== 3494+0+0 (secure 0 0 0) 0x7fd90c0de020 con 0x55c678a2a650 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 10 client.8703 fetch_fsmap finished waiting for FSMap version 64 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 10 client.8703 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 20 client.8703 populate_metadata read hostname 'smithi037' 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 1 --2- 172.21.15.37:0/3194105321 >> [v2:172.21.15.37:6832/1190106206,v1:172.21.15.37:6834/1190106206] conn(0x55c678a863c0 0x55c678a887b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 4 client.8703 mds_command: new command op to 8538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd9234ed000 1 -- 172.21.15.37:0/3194105321 --> [v2:172.21.15.37:6832/1190106206,v1:172.21.15.37:6834/1190106206] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c678814bc0 con 0x55c678a863c0 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd91cc00640 1 --2- 172.21.15.37:0/3194105321 >> [v2:172.21.15.37:6832/1190106206,v1:172.21.15.37:6834/1190106206] conn(0x55c678a863c0 0x55c678a887b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd91cc00640 1 --2- 172.21.15.37:0/3194105321 >> [v2:172.21.15.37:6832/1190106206,v1:172.21.15.37:6834/1190106206] conn(0x55c678a863c0 0x55c678a887b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dc81be6c2200872 server_cookie=b21407bdb9c33ac7 in_seq=0 out_seq=0 2024-05-30T06:55:45.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.429+0000 7fd8fea00640 10 client.8703 ms_handle_connect on v2:172.21.15.37:6832/1190106206 2024-05-30T06:55:45.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd8fea00640 1 -- 172.21.15.37:0/3194105321 <== mds.0 v2:172.21.15.37:6832/1190106206 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c678814bc0 con 0x55c678a863c0 2024-05-30T06:55:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd8fea00640 10 client.8703 handle_command_reply: tid=0 2024-05-30T06:55:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd9234ed000 1 client.8703 shutdown 2024-05-30T06:55:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd9234ed000 1 -- 172.21.15.37:0/3194105321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a2a650 msgr2=0x55c678a2fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd9234ed000 1 --2- 172.21.15.37:0/3194105321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a2a650 0x55c678a2fb40 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fd90c008010 tx=0x7fd90c01d4b0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd9234ed000 1 -- 172.21.15.37:0/3194105321 shutdown_connections 2024-05-30T06:55:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd9234ed000 1 --2- 172.21.15.37:0/3194105321 >> [v2:172.21.15.37:6832/1190106206,v1:172.21.15.37:6834/1190106206] conn(0x55c678a863c0 0x55c678a887b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd9234ed000 1 --2- 172.21.15.37:0/3194105321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77a40 0x55c678a305c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd9234ed000 1 --2- 172.21.15.37:0/3194105321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a77120 0x55c678a30080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd9234ed000 1 --2- 172.21.15.37:0/3194105321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a2a650 0x55c678a2fb40 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd8fea00640 0 client.8703 ms_handle_reset on v2:172.21.15.37:6832/1190106206 2024-05-30T06:55:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd9234ed000 1 -- 172.21.15.37:0/3194105321 >> 172.21.15.37:0/3194105321 conn(0x55c678a57ec0 msgr2=0x55c678a5a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:45.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd9234ed000 1 -- 172.21.15.37:0/3194105321 shutdown_connections 2024-05-30T06:55:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd9234ed000 1 -- 172.21.15.37:0/3194105321 wait complete. 2024-05-30T06:55:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.433+0000 7fd9234ed000 20 client.8703 trim_cache size 0 max 16384 2024-05-30T06:55:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.449+0000 7fd9234ed000 1 Processor -- start 2024-05-30T06:55:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.449+0000 7fd9234ed000 1 -- start start 2024-05-30T06:55:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.449+0000 7fd9234ed000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a2a650 0x55c678a29810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a77120 0x55c678a29d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 0x55c678a887b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd9181ffd90 con 0x55c678a77a40 2024-05-30T06:55:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9180cb2a0 con 0x55c678a2a650 2024-05-30T06:55:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9180cb8f0 con 0x55c678a77120 2024-05-30T06:55:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd91e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 0x55c678a887b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd91e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 0x55c678a887b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45142/0 (socket says 172.21.15.37:45142) 2024-05-30T06:55:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd91e000640 1 -- 172.21.15.37:0/2430545975 learned_addr learned my addr 172.21.15.37:0/2430545975 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd91e000640 1 -- 172.21.15.37:0/2430545975 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a77120 msgr2=0x55c678a29d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd91e000640 1 --2- 172.21.15.37:0/2430545975 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a77120 0x55c678a29d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd91e000640 1 -- 172.21.15.37:0/2430545975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a2a650 msgr2=0x55c678a29810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd91e000640 1 --2- 172.21.15.37:0/2430545975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a2a650 0x55c678a29810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd91e000640 1 -- 172.21.15.37:0/2430545975 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c678801e80 con 0x55c678a77a40 2024-05-30T06:55:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd91e000640 1 --2- 172.21.15.37:0/2430545975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 0x55c678a887b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fd910053c80 tx=0x7fd91005e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9baca9525ac8ff4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd909600640 1 -- 172.21.15.37:0/2430545975 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd910084070 con 0x55c678a77a40 2024-05-30T06:55:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd909600640 1 -- 172.21.15.37:0/2430545975 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd91005bbd0 con 0x55c678a77a40 2024-05-30T06:55:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd909600640 1 -- 172.21.15.37:0/2430545975 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd910060400 con 0x55c678a77a40 2024-05-30T06:55:45.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 -- 172.21.15.37:0/2430545975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 msgr2=0x55c678a887b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 --2- 172.21.15.37:0/2430545975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 0x55c678a887b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fd910053c80 tx=0x7fd91005e040 comp rx=0 tx=0).stop 2024-05-30T06:55:45.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 -- 172.21.15.37:0/2430545975 shutdown_connections 2024-05-30T06:55:45.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 --2- 172.21.15.37:0/2430545975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 0x55c678a887b0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 --2- 172.21.15.37:0/2430545975 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a77120 0x55c678a29d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 --2- 172.21.15.37:0/2430545975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a2a650 0x55c678a29810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 -- 172.21.15.37:0/2430545975 >> 172.21.15.37:0/2430545975 conn(0x55c678a57ec0 msgr2=0x55c678a29100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 -- 172.21.15.37:0/2430545975 shutdown_connections 2024-05-30T06:55:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 -- 172.21.15.37:0/2430545975 wait complete. 2024-05-30T06:55:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 -- start start 2024-05-30T06:55:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 Processor -- start 2024-05-30T06:55:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a2a650 0x55c678a8b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77120 0x55c678aa2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 0x55c678aa2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c67887a730 con 0x55c678a77a40 2024-05-30T06:55:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55c6788479e0 con 0x55c678a77120 2024-05-30T06:55:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55c67887fa50 con 0x55c678a2a650 2024-05-30T06:55:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd9234ed000 10 client.0 _ll_register_callbacks cb 0x7fd90c0ca070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:55:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd91e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 0x55c678aa2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd91e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 0x55c678aa2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45144/0 (socket says 172.21.15.37:45144) 2024-05-30T06:55:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.453+0000 7fd91e000640 1 -- 172.21.15.37:0/3231691448 learned_addr learned my addr 172.21.15.37:0/3231691448 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd91d600640 1 --2- 172.21.15.37:0/3231691448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a2a650 0x55c678a8b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd91cc00640 1 --2- 172.21.15.37:0/3231691448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77120 0x55c678aa2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd91e000640 1 -- 172.21.15.37:0/3231691448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a2a650 msgr2=0x55c678a8b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd91e000640 1 --2- 172.21.15.37:0/3231691448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a2a650 0x55c678a8b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd91e000640 1 -- 172.21.15.37:0/3231691448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77120 msgr2=0x55c678aa2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd91e000640 1 --2- 172.21.15.37:0/3231691448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77120 0x55c678aa2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd91e000640 1 -- 172.21.15.37:0/3231691448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c678843b30 con 0x55c678a77a40 2024-05-30T06:55:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd91e000640 1 --2- 172.21.15.37:0/3231691448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 0x55c678aa2880 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fd91000e9b0 tx=0x7fd91005a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa54ae51b1b22c9e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:45.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd8fea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:55:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd8fea00640 1 -- 172.21.15.37:0/3231691448 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd910084040 con 0x55c678a77a40 2024-05-30T06:55:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd9234ed000 1 -- 172.21.15.37:0/3231691448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd91005bbd0 con 0x55c678a77a40 2024-05-30T06:55:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd8fea00640 1 -- 172.21.15.37:0/3231691448 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fd910077d80 con 0x55c678a77a40 2024-05-30T06:55:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd8fea00640 1 -- 172.21.15.37:0/3231691448 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7fd91007e050 con 0x55c678a77a40 2024-05-30T06:55:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd9234ed000 10 client.8709 fetch_fsmap learned FSMap version 64 2024-05-30T06:55:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd9234ed000 1 -- 172.21.15.37:0/3231691448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) -- 0x55c6788fc5b0 con 0x55c678a77a40 2024-05-30T06:55:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd8fea00640 1 -- 172.21.15.37:0/3231691448 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd91005bbd0 con 0x55c678a77a40 2024-05-30T06:55:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd8fea00640 1 -- 172.21.15.37:0/3231691448 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 64) ==== 3494+0+0 (secure 0 0 0) 0x7fd9100865e0 con 0x55c678a77a40 2024-05-30T06:55:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd9234ed000 10 client.8709 fetch_fsmap finished waiting for FSMap version 64 2024-05-30T06:55:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd9234ed000 10 client.8709 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd9234ed000 20 client.8709 populate_metadata read hostname 'smithi037' 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd9234ed000 1 --2- 172.21.15.37:0/3231691448 >> [v2:172.21.15.37:6832/1190106206,v1:172.21.15.37:6834/1190106206] conn(0x55c678aa2dc0 0x55c678ae5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd9234ed000 4 client.8709 mds_command: new command op to 8538 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd9234ed000 1 -- 172.21.15.37:0/3231691448 --> [v2:172.21.15.37:6832/1190106206,v1:172.21.15.37:6834/1190106206] -- command(tid 0: {"prefix": "status"}) -- 0x55c678888e40 con 0x55c678aa2dc0 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd91d600640 1 --2- 172.21.15.37:0/3231691448 >> [v2:172.21.15.37:6832/1190106206,v1:172.21.15.37:6834/1190106206] conn(0x55c678aa2dc0 0x55c678ae5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd91d600640 1 --2- 172.21.15.37:0/3231691448 >> [v2:172.21.15.37:6832/1190106206,v1:172.21.15.37:6834/1190106206] conn(0x55c678aa2dc0 0x55c678ae5fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fb8e63f29462395 server_cookie=ba6d7a5ae944bbb9 in_seq=0 out_seq=0 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.457+0000 7fd8fea00640 10 client.8709 ms_handle_connect on v2:172.21.15.37:6832/1190106206 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd8fea00640 1 -- 172.21.15.37:0/3231691448 <== mds.0 v2:172.21.15.37:6832/1190106206 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c678888e40 con 0x55c678aa2dc0 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd8fea00640 10 client.8709 handle_command_reply: tid=0 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd9234ed000 1 client.8709 shutdown 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd9234ed000 1 -- 172.21.15.37:0/3231691448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 msgr2=0x55c678aa2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd9234ed000 1 --2- 172.21.15.37:0/3231691448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 0x55c678aa2880 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fd91000e9b0 tx=0x7fd91005a070 comp rx=0 tx=0).stop 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd9234ed000 1 -- 172.21.15.37:0/3231691448 shutdown_connections 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd9234ed000 1 --2- 172.21.15.37:0/3231691448 >> [v2:172.21.15.37:6832/1190106206,v1:172.21.15.37:6834/1190106206] conn(0x55c678aa2dc0 0x55c678ae5fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd9234ed000 1 --2- 172.21.15.37:0/3231691448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c678a77a40 0x55c678aa2880 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd9234ed000 1 --2- 172.21.15.37:0/3231691448 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55c678a77120 0x55c678aa2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd9234ed000 1 --2- 172.21.15.37:0/3231691448 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55c678a2a650 0x55c678a8b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd8fea00640 0 client.8709 ms_handle_reset on v2:172.21.15.37:6832/1190106206 2024-05-30T06:55:45.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd9234ed000 1 -- 172.21.15.37:0/3231691448 >> 172.21.15.37:0/3231691448 conn(0x55c678a57ec0 msgr2=0x55c678a29810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:45.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd9234ed000 1 -- 172.21.15.37:0/3231691448 shutdown_connections 2024-05-30T06:55:45.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd9234ed000 1 -- 172.21.15.37:0/3231691448 wait complete. 2024-05-30T06:55:45.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd9234ed000 20 client.8709 trim_cache size 0 max 16384 2024-05-30T06:55:45.464 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:55:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:55:45.464 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-30T06:55:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8538, 2024-05-30T06:55:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-30T06:55:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-30T06:55:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-30T06:55:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.543366079, 2024-05-30T06:55:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 64, 2024-05-30T06:55:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 102, 2024-05-30T06:55:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 102, 2024-05-30T06:55:45.465 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 15.394622849999999 2024-05-30T06:55:45.465 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:55:45.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd920000640 1 -- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd8f8069910 msgr2=0x7fd8f806bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd920000640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd8f8069910 0x7fd8f806bdd0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0b2000 tx=0x7fd90c008040 comp rx=0 tx=0).stop 2024-05-30T06:55:45.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd920000640 1 -- 172.21.15.37:0/921374654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd91815ca30 msgr2=0x7fd9181f79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd920000640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd91815ca30 0x7fd9181f79b0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fd910007e40 tx=0x7fd91000e4b0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd920000640 1 -- 172.21.15.37:0/921374654 shutdown_connections 2024-05-30T06:55:45.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd920000640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd91815ca30 0x7fd9181f79b0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd920000640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd8f8069910 0x7fd8f806bdd0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd920000640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd91815c650 0x7fd918157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd920000640 1 --2- 172.21.15.37:0/921374654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9180b2890 0x7fd91815ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd920000640 1 -- 172.21.15.37:0/921374654 >> 172.21.15.37:0/921374654 conn(0x7fd9180b4130 msgr2=0x7fd918075440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd920000640 1 -- 172.21.15.37:0/921374654 shutdown_connections 2024-05-30T06:55:45.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.461+0000 7fd920000640 1 -- 172.21.15.37:0/921374654 wait complete. 2024-05-30T06:55:45.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T06:55:45.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.621+0000 7f228a400640 1 Processor -- start 2024-05-30T06:55:45.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.621+0000 7f228a400640 1 -- start start 2024-05-30T06:55:45.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.621+0000 7f228a400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f228406f9a0 0x7f22840b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.621+0000 7f228a400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f22840b2ec0 0x7f22840cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.621+0000 7f228a400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228415c8f0 con 0x7f2284155e60 2024-05-30T06:55:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.621+0000 7f228a400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f22840ccff0 con 0x7f22840b2ec0 2024-05-30T06:55:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.621+0000 7f228a400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f22840ccc80 con 0x7f228406f9a0 2024-05-30T06:55:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.621+0000 7f2283e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f22840b2ec0 0x7f22840cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.621+0000 7f2283e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f22840b2ec0 0x7f22840cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45146/0 (socket says 172.21.15.37:45146) 2024-05-30T06:55:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.621+0000 7f2283e00640 1 -- 172.21.15.37:0/3549200318 learned_addr learned my addr 172.21.15.37:0/3549200318 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.621+0000 7f227aa00640 1 --2- 172.21.15.37:0/3549200318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f228406f9a0 0x7f22840b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.621+0000 7f2283e00640 1 -- 172.21.15.37:0/3549200318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f228406f9a0 msgr2=0x7f22840b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.621+0000 7f2283e00640 1 --2- 172.21.15.37:0/3549200318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f228406f9a0 0x7f22840b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f2283e00640 1 -- 172.21.15.37:0/3549200318 >> v1:172.21.15.105:6789/0 conn(0x7f2284155e60 legacy=0x7f22840cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f2283e00640 1 -- 172.21.15.37:0/3549200318 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228415cbd0 con 0x7f22840b2ec0 2024-05-30T06:55:45.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f2283e00640 1 --2- 172.21.15.37:0/3549200318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22840b2ec0 0x7f22840cd480 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f227c00d150 tx=0x7f227c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1671c26db360d679 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:45.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f2282a00640 1 -- 172.21.15.37:0/3549200318 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c00b2d0 con 0x7f22840b2ec0 2024-05-30T06:55:45.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f2282a00640 1 -- 172.21.15.37:0/3549200318 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c00b470 con 0x7f22840b2ec0 2024-05-30T06:55:45.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f2282a00640 1 -- 172.21.15.37:0/3549200318 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0a7c30 con 0x7f22840b2ec0 2024-05-30T06:55:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f228a400640 1 -- 172.21.15.37:0/3549200318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22840b2ec0 msgr2=0x7f22840cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f228a400640 1 --2- 172.21.15.37:0/3549200318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22840b2ec0 0x7f22840cd480 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f227c00d150 tx=0x7f227c01ec30 comp rx=0 tx=0).stop 2024-05-30T06:55:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f228a400640 1 -- 172.21.15.37:0/3549200318 shutdown_connections 2024-05-30T06:55:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f228a400640 1 --2- 172.21.15.37:0/3549200318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22840b2ec0 0x7f22840cd480 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f228a400640 1 --2- 172.21.15.37:0/3549200318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f228406f9a0 0x7f22840b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f228a400640 1 -- 172.21.15.37:0/3549200318 >> 172.21.15.37:0/3549200318 conn(0x7f22840b23a0 msgr2=0x7f22840b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f228a400640 1 -- 172.21.15.37:0/3549200318 shutdown_connections 2024-05-30T06:55:45.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.625+0000 7f228a400640 1 -- 172.21.15.37:0/3549200318 wait complete. 2024-05-30T06:55:45.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f228a400640 1 Processor -- start 2024-05-30T06:55:45.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f228a400640 1 -- start start 2024-05-30T06:55:45.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f228a400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f228406f9a0 0x7f2284156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f228a400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22840b2ec0 0x7f22841528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f228a400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2284155e60 0x7f228415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f228a400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f228406ec60 con 0x7f228406f9a0 2024-05-30T06:55:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f228a400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f228406eae0 con 0x7f22840b2ec0 2024-05-30T06:55:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f228a400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f228406ede0 con 0x7f2284155e60 2024-05-30T06:55:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f2283400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f228406f9a0 0x7f2284156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f2283400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f228406f9a0 0x7f2284156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45150/0 (socket says 172.21.15.37:45150) 2024-05-30T06:55:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f2283400640 1 -- 172.21.15.37:0/3854052617 learned_addr learned my addr 172.21.15.37:0/3854052617 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f227aa00640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22840b2ec0 0x7f22841528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f2283e00640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2284155e60 0x7f228415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f2283400640 1 -- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2284155e60 msgr2=0x7f228415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f2283400640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2284155e60 0x7f228415ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f2283400640 1 -- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22840b2ec0 msgr2=0x7f22841528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f2283400640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22840b2ec0 0x7f22841528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f2283400640 1 -- 172.21.15.37:0/3854052617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2284157460 con 0x7f228406f9a0 2024-05-30T06:55:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f2283400640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f228406f9a0 0x7f2284156ba0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f227400c370 tx=0x7f227400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f227be00640 1 -- 172.21.15.37:0/3854052617 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22740052d0 con 0x7f228406f9a0 2024-05-30T06:55:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f227be00640 1 -- 172.21.15.37:0/3854052617 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2274005470 con 0x7f228406f9a0 2024-05-30T06:55:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f227be00640 1 -- 172.21.15.37:0/3854052617 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2274007260 con 0x7f228406f9a0 2024-05-30T06:55:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f228a400640 1 -- 172.21.15.37:0/3854052617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2284157740 con 0x7f228406f9a0 2024-05-30T06:55:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.629+0000 7f228a400640 1 -- 172.21.15.37:0/3854052617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2284157d00 con 0x7f228406f9a0 2024-05-30T06:55:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.633+0000 7f228a400640 1 -- 172.21.15.37:0/3854052617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2284068b20 con 0x7f228406f9a0 2024-05-30T06:55:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.633+0000 7f227be00640 1 -- 172.21.15.37:0/3854052617 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f2274007400 con 0x7f228406f9a0 2024-05-30T06:55:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.633+0000 7f227be00640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22600698e0 0x7f226006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:45.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.633+0000 7f227be00640 1 -- 172.21.15.37:0/3854052617 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f2274084ef0 con 0x7f228406f9a0 2024-05-30T06:55:45.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.633+0000 7f227aa00640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22600698e0 0x7f226006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:45.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.633+0000 7f227aa00640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22600698e0 0x7f226006bda0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f228406fe20 tx=0x7f226c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:45.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.637+0000 7f227be00640 1 -- 172.21.15.37:0/3854052617 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f227408e020 con 0x7f228406f9a0 2024-05-30T06:55:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f228a400640 1 -- 172.21.15.37:0/3854052617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2284072fb0 con 0x7f228406f9a0 2024-05-30T06:55:45.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f227be00640 1 -- 172.21.15.37:0/3854052617 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v64) ==== 53+0+73 (secure 0 0 0) 0x7f22740564b0 con 0x7f228406f9a0 2024-05-30T06:55:45.842 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T06:55:45.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f228a400640 1 -- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22600698e0 msgr2=0x7f226006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f228a400640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22600698e0 0x7f226006bda0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f228406fe20 tx=0x7f226c009190 comp rx=0 tx=0).stop 2024-05-30T06:55:45.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f228a400640 1 -- 172.21.15.37:0/3854052617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f228406f9a0 msgr2=0x7f2284156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:45.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f228a400640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f228406f9a0 0x7f2284156ba0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f227400c370 tx=0x7f227400c830 comp rx=0 tx=0).stop 2024-05-30T06:55:45.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f228a400640 1 -- 172.21.15.37:0/3854052617 shutdown_connections 2024-05-30T06:55:45.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f228a400640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2284155e60 0x7f228415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f228a400640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22600698e0 0x7f226006bda0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f228a400640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22840b2ec0 0x7f22841528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f228a400640 1 --2- 172.21.15.37:0/3854052617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f228406f9a0 0x7f2284156ba0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:45.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f228a400640 1 -- 172.21.15.37:0/3854052617 >> 172.21.15.37:0/3854052617 conn(0x7f22840b23a0 msgr2=0x7f22840cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:45.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f228a400640 1 -- 172.21.15.37:0/3854052617 shutdown_connections 2024-05-30T06:55:45.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:45.841+0000 7f228a400640 1 -- 172.21.15.37:0/3854052617 wait complete. 2024-05-30T06:55:45.863 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-30T06:55:45.863 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T06:55:45.863 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-30T06:55:45.863 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T06:55:45.863 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T06:55:45.863 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-30T06:55:45.863 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-30T06:55:45.864 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T06:55:45.864 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:55:45.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:55:45.864 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-30T06:55:45.873 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:55:45.873 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:55:45.873 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:55:45.873 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:55:45.874 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-30T06:55:45.874 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:55:45.874 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:55:45.874 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:55:45.874 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-30T06:55:45.874 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T06:55:45.874 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:55:45.874 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-30T06:55:45.874 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T06:55:45.874 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41658sec preferred_lft 41658sec 2024-05-30T06:55:45.874 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-05-30T06:55:45.874 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:55:45.875 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:55:45.875 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:55:45.875 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-30T06:55:45.875 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:55:45.875 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:55:45.875 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-30T06:55:45.875 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T06:55:45.875 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:30:63:12:21 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:55:45.875 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T06:55:45.875 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:55:45.875 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:55:45.875 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T06:55:45.876 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T06:55:45.876 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:55:45.876 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T06:55:45.876 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:55:45.876 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:55:45.876 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T06:55:45.876 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T06:55:45.876 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:55:45.876 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:55:45.876 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T06:55:45.876 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T06:55:45.876 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:55:45.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:55:45.877 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T06:55:45.942 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-30T06:55:45.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:55:45.944 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-30T06:55:45.998 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-30T06:55:45.998 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T06:55:45.998 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T06:55:45.998 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T06:55:45.998 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T06:55:45.998 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T06:55:45.999 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:55:45.999 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:55:45.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T06:55:45.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T06:55:45.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T06:55:45.999 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:55:46.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:55:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:55:46.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:55:46.142 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T06:55:46.154 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T06:55:46.154 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T06:55:46.155 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:55:46.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:55:46.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-30T06:55:46.216 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:55:46.217 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T06:55:46.269 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:55:46.269 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:55:46.269 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:55:46.320 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T06:55:46.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:55:46.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:55:46.414 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:55:46.414 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:55:46.426 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:55:46.426 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:55:46.427 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-05-30T06:55:46.427 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@393250aa-2b42-4955-adf1-f790b8ba4d8c.cephfs=/ 2024-05-30T06:55:46.427 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-05-30T06:55:46.430 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T06:55:46.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:55:46.431 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:55:46.451 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:55:46.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:55:46.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:55:46.556 INFO:teuthology.orchestra.run.smithi037.stdout:client8718 2024-05-30T06:55:46.557 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:55:46.557 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:55:46.566 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T06:55:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed76a00640 1 Processor -- start 2024-05-30T06:55:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed76a00640 1 -- start start 2024-05-30T06:55:46.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed76a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fed70072e60 0x7fed700cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed76a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed701601a0 con 0x7fed70159490 2024-05-30T06:55:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed76a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed700d06e0 con 0x7fed700702d0 2024-05-30T06:55:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed76a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fed70162800 con 0x7fed70072e60 2024-05-30T06:55:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fed70159490 0x7fed70072750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47442/0 (socket says 172.21.15.37:47442) 2024-05-30T06:55:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6fe00640 1 -- 172.21.15.37:0/1554993126 learned_addr learned my addr 172.21.15.37:0/1554993126 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed67400640 1 --2- 172.21.15.37:0/1554993126 >> v2:172.21.15.105:3300/0 conn(0x7fed70072e60 0x7fed700cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566377852 0 0) 0x7fed701601a0 con 0x7fed70159490 2024-05-30T06:55:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed54003530 con 0x7fed70159490 2024-05-30T06:55:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1883008996 0 0) 0x7fed700d06e0 con 0x7fed700702d0 2024-05-30T06:55:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed701601a0 con 0x7fed700702d0 2024-05-30T06:55:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 682842450 0 0) 0x7fed54003530 con 0x7fed70159490 2024-05-30T06:55:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 >> v2:172.21.15.105:3300/0 conn(0x7fed70072e60 msgr2=0x7fed700cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 --2- 172.21.15.37:0/1554993126 >> v2:172.21.15.105:3300/0 conn(0x7fed70072e60 0x7fed700cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 >> v1:172.21.15.105:6789/0 conn(0x7fed700702d0 legacy=0x7fed700cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed70162a50 con 0x7fed70159490 2024-05-30T06:55:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fed60001680 con 0x7fed70159490 2024-05-30T06:55:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed67400640 1 --2- 172.21.15.37:0/1554993126 >> v2:172.21.15.105:3300/0 conn(0x7fed70072e60 0x7fed700cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:55:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 >> v1:172.21.15.37:6789/0 conn(0x7fed70159490 legacy=0x7fed70072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 --2- 172.21.15.37:0/1554993126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed54003b50 0x7fed54003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 --2- 172.21.15.37:0/1554993126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed54004810 0x7fed54004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 --2- 172.21.15.37:0/1554993126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed54005240 0x7fed5400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed70162800 con 0x7fed54004810 2024-05-30T06:55:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed5400c1a0 con 0x7fed54005240 2024-05-30T06:55:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fed5400c3a0 con 0x7fed54003b50 2024-05-30T06:55:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed67400640 1 --2- 172.21.15.37:0/1554993126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed54004810 0x7fed54004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed74a00640 1 --2- 172.21.15.37:0/1554993126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed54005240 0x7fed5400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed6fe00640 1 --2- 172.21.15.37:0/1554993126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed54003b50 0x7fed54003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed67400640 1 -- 172.21.15.37:0/1554993126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed54003b50 msgr2=0x7fed54003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed67400640 1 --2- 172.21.15.37:0/1554993126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed54003b50 0x7fed54003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed67400640 1 -- 172.21.15.37:0/1554993126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed54005240 msgr2=0x7fed5400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed67400640 1 --2- 172.21.15.37:0/1554993126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed54005240 0x7fed5400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed67400640 1 -- 172.21.15.37:0/1554993126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed54003530 con 0x7fed54004810 2024-05-30T06:55:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed74a00640 1 --2- 172.21.15.37:0/1554993126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed54005240 0x7fed5400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.752+0000 7fed74a00640 1 -- 172.21.15.37:0/1554993126 reap_dead start 2024-05-30T06:55:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.756+0000 7fed67400640 1 --2- 172.21.15.37:0/1554993126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed54004810 0x7fed54004c90 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fed58009c80 tx=0x7fed5801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417e21527983e17a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.756+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58009880 con 0x7fed54004810 2024-05-30T06:55:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.756+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed58004020 con 0x7fed54004810 2024-05-30T06:55:46.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.756+0000 7fed6f400640 1 -- 172.21.15.37:0/1554993126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed58004430 con 0x7fed54004810 2024-05-30T06:55:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.756+0000 7fed76a00640 1 -- 172.21.15.37:0/1554993126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed54004810 msgr2=0x7fed54004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.756+0000 7fed76a00640 1 --2- 172.21.15.37:0/1554993126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed54004810 0x7fed54004c90 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fed58009c80 tx=0x7fed5801cbd0 comp rx=0 tx=0).stop 2024-05-30T06:55:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.756+0000 7fed76a00640 1 -- 172.21.15.37:0/1554993126 shutdown_connections 2024-05-30T06:55:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.756+0000 7fed76a00640 1 --2- 172.21.15.37:0/1554993126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed54004810 0x7fed54004c90 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.756+0000 7fed76a00640 1 -- 172.21.15.37:0/1554993126 >> 172.21.15.37:0/1554993126 conn(0x7fed700d0d50 msgr2=0x7fed700d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.756+0000 7fed76a00640 1 -- 172.21.15.37:0/1554993126 shutdown_connections 2024-05-30T06:55:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.756+0000 7fed76a00640 1 -- 172.21.15.37:0/1554993126 wait complete. 2024-05-30T06:55:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed76a00640 1 Processor -- start 2024-05-30T06:55:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed76a00640 1 -- start start 2024-05-30T06:55:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed76a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed54004810 0x7fed70146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed76a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed700b5900 0x7fed70159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed76a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed70148690 0x7fed700aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed76a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed7015f9a0 con 0x7fed70148690 2024-05-30T06:55:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed76a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed70163720 con 0x7fed700b5900 2024-05-30T06:55:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed76a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fed7015fb20 con 0x7fed54004810 2024-05-30T06:55:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed74a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed70148690 0x7fed700aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed74a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed70148690 0x7fed700aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45170/0 (socket says 172.21.15.37:45170) 2024-05-30T06:55:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed74a00640 1 -- 172.21.15.37:0/390507025 learned_addr learned my addr 172.21.15.37:0/390507025 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed6fe00640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed54004810 0x7fed70146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed67400640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed700b5900 0x7fed70159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed74a00640 1 -- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed54004810 msgr2=0x7fed70146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed74a00640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed54004810 0x7fed70146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed74a00640 1 -- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed700b5900 msgr2=0x7fed70159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed74a00640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed700b5900 0x7fed70159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed74a00640 1 -- 172.21.15.37:0/390507025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed70148f90 con 0x7fed70148690 2024-05-30T06:55:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed74a00640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed70148690 0x7fed700aedf0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fed70073b50 tx=0x7fed6800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed6cc00640 1 -- 172.21.15.37:0/390507025 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68019070 con 0x7fed70148690 2024-05-30T06:55:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed6cc00640 1 -- 172.21.15.37:0/390507025 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed68006b60 con 0x7fed70148690 2024-05-30T06:55:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed6cc00640 1 -- 172.21.15.37:0/390507025 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68003980 con 0x7fed70148690 2024-05-30T06:55:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed76a00640 1 -- 172.21.15.37:0/390507025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed70149270 con 0x7fed70148690 2024-05-30T06:55:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.760+0000 7fed76a00640 1 -- 172.21.15.37:0/390507025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7015baa0 con 0x7fed70148690 2024-05-30T06:55:46.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.764+0000 7fed76a00640 1 -- 172.21.15.37:0/390507025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed70068d40 con 0x7fed70148690 2024-05-30T06:55:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.764+0000 7fed6cc00640 1 -- 172.21.15.37:0/390507025 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fed6801c070 con 0x7fed70148690 2024-05-30T06:55:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.764+0000 7fed6cc00640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed4c0698e0 0x7fed4c06bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:46.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.764+0000 7fed6cc00640 1 -- 172.21.15.37:0/390507025 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fed68084d00 con 0x7fed70148690 2024-05-30T06:55:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.764+0000 7fed6fe00640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed4c0698e0 0x7fed4c06bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:46.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.764+0000 7fed6fe00640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed4c0698e0 0x7fed4c06bda0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fed700758b0 tx=0x7fed60007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:46.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.768+0000 7fed6cc00640 1 -- 172.21.15.37:0/390507025 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed680562c0 con 0x7fed70148690 2024-05-30T06:55:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:46.972+0000 7fed76a00640 1 -- 172.21.15.37:0/390507025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fed70067d20 con 0x7fed70148690 2024-05-30T06:55:47.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.468+0000 7fed6cc00640 1 -- 172.21.15.37:0/390507025 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v65) ==== 136+0+0 (secure 0 0 0) 0x7fed6805a5c0 con 0x7fed70148690 2024-05-30T06:55:47.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.472+0000 7fed76a00640 1 -- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed4c0698e0 msgr2=0x7fed4c06bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:47.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.472+0000 7fed76a00640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed4c0698e0 0x7fed4c06bda0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fed700758b0 tx=0x7fed60007040 comp rx=0 tx=0).stop 2024-05-30T06:55:47.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.472+0000 7fed76a00640 1 -- 172.21.15.37:0/390507025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed70148690 msgr2=0x7fed700aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:47.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.472+0000 7fed76a00640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed70148690 0x7fed700aedf0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fed70073b50 tx=0x7fed6800eb90 comp rx=0 tx=0).stop 2024-05-30T06:55:47.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.472+0000 7fed76a00640 1 -- 172.21.15.37:0/390507025 shutdown_connections 2024-05-30T06:55:47.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.472+0000 7fed76a00640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed70148690 0x7fed700aedf0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:47.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.472+0000 7fed76a00640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fed4c0698e0 0x7fed4c06bda0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:47.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.472+0000 7fed76a00640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed700b5900 0x7fed70159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:47.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.472+0000 7fed76a00640 1 --2- 172.21.15.37:0/390507025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed54004810 0x7fed70146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:47.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.472+0000 7fed76a00640 1 -- 172.21.15.37:0/390507025 >> 172.21.15.37:0/390507025 conn(0x7fed700d0d50 msgr2=0x7fed7015cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:47.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.472+0000 7fed76a00640 1 -- 172.21.15.37:0/390507025 shutdown_connections 2024-05-30T06:55:47.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.472+0000 7fed76a00640 1 -- 172.21.15.37:0/390507025 wait complete. 2024-05-30T06:55:47.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:55:47.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0fff400640 1 Processor -- start 2024-05-30T06:55:47.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0fff400640 1 -- start start 2024-05-30T06:55:47.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0fff400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0ff815d7e0 0x7f0ff806e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:47.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0fff400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff8142030 con 0x7f0ff815d350 2024-05-30T06:55:47.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0fff400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ff8142310 con 0x7f0ff80b59d0 2024-05-30T06:55:47.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0fff400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0ff81425f0 con 0x7f0ff815d7e0 2024-05-30T06:55:47.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0fefe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0ff815d350 0x7f0ff806df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48890/0 (socket says 172.21.15.37:48890) 2024-05-30T06:55:47.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0fefe00640 1 -- 172.21.15.37:0/585376561 learned_addr learned my addr 172.21.15.37:0/585376561 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:47.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0ffd400640 1 --2- 172.21.15.37:0/585376561 >> v2:172.21.15.105:3300/0 conn(0x7f0ff815d7e0 0x7f0ff806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:47.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0ff7e00640 1 -- 172.21.15.37:0/585376561 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 58868730 0 0) 0x7f0ff8142030 con 0x7f0ff815d350 2024-05-30T06:55:47.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0ff7e00640 1 -- 172.21.15.37:0/585376561 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fdc003530 con 0x7f0ff815d350 2024-05-30T06:55:47.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0ffd400640 1 -- 172.21.15.37:0/585376561 >> v1:172.21.15.105:6789/0 conn(0x7f0ff80b59d0 legacy=0x7f0ff80b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:47.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0ffd400640 1 -- 172.21.15.37:0/585376561 >> v1:172.21.15.37:6789/0 conn(0x7f0ff815d350 legacy=0x7f0ff806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:47.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.644+0000 7f0ffd400640 1 -- 172.21.15.37:0/585376561 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff81428d0 con 0x7f0ff815d7e0 2024-05-30T06:55:47.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.648+0000 7f0ffd400640 1 --2- 172.21.15.37:0/585376561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff815d7e0 0x7f0ff806e660 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009dc0 tx=0x7f0ff001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd1fe73d9e90b32c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:47.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.648+0000 7f0ff7e00640 1 -- 172.21.15.37:0/585376561 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00b2070 con 0x7f0ff815d7e0 2024-05-30T06:55:47.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.648+0000 7f0ff7e00640 1 -- 172.21.15.37:0/585376561 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff00a5920 con 0x7f0ff815d7e0 2024-05-30T06:55:47.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.648+0000 7f0ff7e00640 1 -- 172.21.15.37:0/585376561 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00a5cf0 con 0x7f0ff815d7e0 2024-05-30T06:55:47.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.648+0000 7f0fff400640 1 -- 172.21.15.37:0/585376561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff815d7e0 msgr2=0x7f0ff806e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:47.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.648+0000 7f0fff400640 1 --2- 172.21.15.37:0/585376561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff815d7e0 0x7f0ff806e660 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009dc0 tx=0x7f0ff001c950 comp rx=0 tx=0).stop 2024-05-30T06:55:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.648+0000 7f0fff400640 1 -- 172.21.15.37:0/585376561 shutdown_connections 2024-05-30T06:55:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.648+0000 7f0fff400640 1 --2- 172.21.15.37:0/585376561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff815d7e0 0x7f0ff806e660 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.648+0000 7f0fff400640 1 -- 172.21.15.37:0/585376561 >> 172.21.15.37:0/585376561 conn(0x7f0ff806bf60 msgr2=0x7f0ff80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.648+0000 7f0fff400640 1 -- 172.21.15.37:0/585376561 shutdown_connections 2024-05-30T06:55:47.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.648+0000 7f0fff400640 1 -- 172.21.15.37:0/585376561 wait complete. 2024-05-30T06:55:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0fff400640 1 Processor -- start 2024-05-30T06:55:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0fff400640 1 -- start start 2024-05-30T06:55:47.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0fff400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ff80b59d0 0x7f0ff80b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:47.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0fff400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff815d350 0x7f0ff8152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:47.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0fff400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff815d7e0 0x7f0ff8153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:47.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0fff400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff8141d70 con 0x7f0ff815d7e0 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0fff400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff8141bf0 con 0x7f0ff815d350 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0fff400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0ff816ae40 con 0x7f0ff80b59d0 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0ffd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff815d7e0 0x7f0ff8153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0ffd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff815d7e0 0x7f0ff8153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43132/0 (socket says 172.21.15.37:43132) 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0ffd400640 1 -- 172.21.15.37:0/861894740 learned_addr learned my addr 172.21.15.37:0/861894740 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0fefe00640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff815d350 0x7f0ff8152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0ffca00640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ff80b59d0 0x7f0ff80b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0ffd400640 1 -- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ff80b59d0 msgr2=0x7f0ff80b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0ffd400640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ff80b59d0 0x7f0ff80b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0ffd400640 1 -- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff815d350 msgr2=0x7f0ff8152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0ffd400640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff815d350 0x7f0ff8152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0ffd400640 1 -- 172.21.15.37:0/861894740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff81381b0 con 0x7f0ff815d7e0 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0fefe00640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff815d350 0x7f0ff8152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:47.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0ffd400640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff815d7e0 0x7f0ff8153d00 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f0ff001a580 tx=0x7f0ff00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:47.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0ff5600640 1 -- 172.21.15.37:0/861894740 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00b2050 con 0x7f0ff815d7e0 2024-05-30T06:55:47.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0fff400640 1 -- 172.21.15.37:0/861894740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff815b360 con 0x7f0ff815d7e0 2024-05-30T06:55:47.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0ff5600640 1 -- 172.21.15.37:0/861894740 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff00be070 con 0x7f0ff815d7e0 2024-05-30T06:55:47.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0ff5600640 1 -- 172.21.15.37:0/861894740 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00ada50 con 0x7f0ff815d7e0 2024-05-30T06:55:47.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0fff400640 1 -- 172.21.15.37:0/861894740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff815b920 con 0x7f0ff815d7e0 2024-05-30T06:55:47.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.652+0000 7f0fff400640 1 -- 172.21.15.37:0/861894740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff8068bc0 con 0x7f0ff815d7e0 2024-05-30T06:55:47.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.656+0000 7f0ff5600640 1 -- 172.21.15.37:0/861894740 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f0ff00adbf0 con 0x7f0ff815d7e0 2024-05-30T06:55:47.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.656+0000 7f0ff5600640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0fd40698e0 0x7f0fd406bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:47.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.656+0000 7f0ff5600640 1 -- 172.21.15.37:0/861894740 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f0ff0120ce0 con 0x7f0ff815d7e0 2024-05-30T06:55:47.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.656+0000 7f0ffca00640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0fd40698e0 0x7f0fd406bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:47.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.656+0000 7f0ffca00640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0fd40698e0 0x7f0fd406bda0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80015b0 tx=0x7f0fe8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:47.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.660+0000 7f0ff5600640 1 -- 172.21.15.37:0/861894740 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0ff0016540 con 0x7f0ff815d7e0 2024-05-30T06:55:47.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.844+0000 7f0fff400640 1 -- 172.21.15.37:0/861894740 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f0ff8168400 con 0x7f0fd40698e0 2024-05-30T06:55:47.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.844+0000 7f0ff5600640 1 -- 172.21.15.37:0/861894740 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f0ff8168400 con 0x7f0fd40698e0 2024-05-30T06:55:47.848 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:55:47.849 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:55:47.849 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:55:47.849 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:55:47.849 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:55:47.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.848+0000 7f0fff400640 1 -- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0fd40698e0 msgr2=0x7f0fd406bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:47.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.848+0000 7f0fff400640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0fd40698e0 0x7f0fd406bda0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0fe80015b0 tx=0x7f0fe8009040 comp rx=0 tx=0).stop 2024-05-30T06:55:47.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.848+0000 7f0fff400640 1 -- 172.21.15.37:0/861894740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff815d7e0 msgr2=0x7f0ff8153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:47.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.848+0000 7f0fff400640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff815d7e0 0x7f0ff8153d00 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f0ff001a580 tx=0x7f0ff00196f0 comp rx=0 tx=0).stop 2024-05-30T06:55:47.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.848+0000 7f0fff400640 1 -- 172.21.15.37:0/861894740 shutdown_connections 2024-05-30T06:55:47.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.848+0000 7f0fff400640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ff815d7e0 0x7f0ff8153d00 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:47.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.848+0000 7f0fff400640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0fd40698e0 0x7f0fd406bda0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:47.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.848+0000 7f0fff400640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ff815d350 0x7f0ff8152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:47.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.848+0000 7f0fff400640 1 --2- 172.21.15.37:0/861894740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ff80b59d0 0x7f0ff80b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:47.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.848+0000 7f0fff400640 1 -- 172.21.15.37:0/861894740 >> 172.21.15.37:0/861894740 conn(0x7f0ff806bf60 msgr2=0x7f0ff80aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:47.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.848+0000 7f0fff400640 1 -- 172.21.15.37:0/861894740 shutdown_connections 2024-05-30T06:55:47.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:47.848+0000 7f0fff400640 1 -- 172.21.15.37:0/861894740 wait complete. 2024-05-30T06:55:47.869 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:55:48.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.008+0000 7f28f6600640 1 Processor -- start 2024-05-30T06:55:48.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28f6600640 1 -- start start 2024-05-30T06:55:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28f6600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28f0072510 0x7f28f0141be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28f6600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f28f015d770 0x7f28f0142120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28f6600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28f0142660 con 0x7f28f015d390 2024-05-30T06:55:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28f6600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f28f006de40 con 0x7f28f0072510 2024-05-30T06:55:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28f6600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f28f0142900 con 0x7f28f015d770 2024-05-30T06:55:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28e7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28f0072510 0x7f28f0141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28f5200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f28f015d390 0x7f28f0071e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48898/0 (socket says 172.21.15.37:48898) 2024-05-30T06:55:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28f5200640 1 -- 172.21.15.37:0/3782745424 learned_addr learned my addr 172.21.15.37:0/3782745424 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28f5c00640 1 --2- 172.21.15.37:0/3782745424 >> v2:172.21.15.105:3300/0 conn(0x7f28f015d770 0x7f28f0142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28e7e00640 1 -- 172.21.15.37:0/3782745424 >> v2:172.21.15.105:3300/0 conn(0x7f28f015d770 msgr2=0x7f28f0142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28e7e00640 1 --2- 172.21.15.37:0/3782745424 >> v2:172.21.15.105:3300/0 conn(0x7f28f015d770 0x7f28f0142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28e7e00640 1 -- 172.21.15.37:0/3782745424 >> v1:172.21.15.37:6789/0 conn(0x7f28f015d390 legacy=0x7f28f0071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28e7e00640 1 -- 172.21.15.37:0/3782745424 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f013fd50 con 0x7f28f0072510 2024-05-30T06:55:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.012+0000 7f28efe00640 1 -- 172.21.15.37:0/3782745424 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1075515871 0 0) 0x7f28f0142660 con 0x7f28f015d390 2024-05-30T06:55:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28e7e00640 1 --2- 172.21.15.37:0/3782745424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28f0072510 0x7f28f0141be0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f28f015ca80 tx=0x7f28d801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e682b2dd85c819 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28efe00640 1 -- 172.21.15.37:0/3782745424 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d80b0070 con 0x7f28f0072510 2024-05-30T06:55:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28efe00640 1 -- 172.21.15.37:0/3782745424 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d80ab600 con 0x7f28f0072510 2024-05-30T06:55:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28efe00640 1 -- 172.21.15.37:0/3782745424 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d80ab9d0 con 0x7f28f0072510 2024-05-30T06:55:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28f6600640 1 -- 172.21.15.37:0/3782745424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28f0072510 msgr2=0x7f28f0141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28f6600640 1 --2- 172.21.15.37:0/3782745424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28f0072510 0x7f28f0141be0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f28f015ca80 tx=0x7f28d801c3f0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28f6600640 1 -- 172.21.15.37:0/3782745424 shutdown_connections 2024-05-30T06:55:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28f6600640 1 --2- 172.21.15.37:0/3782745424 >> v2:172.21.15.105:3300/0 conn(0x7f28f015d770 0x7f28f0142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28f6600640 1 --2- 172.21.15.37:0/3782745424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28f0072510 0x7f28f0141be0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28f6600640 1 -- 172.21.15.37:0/3782745424 >> 172.21.15.37:0/3782745424 conn(0x7f28f0067d60 msgr2=0x7f28f006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28f6600640 1 -- 172.21.15.37:0/3782745424 shutdown_connections 2024-05-30T06:55:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28f6600640 1 -- 172.21.15.37:0/3782745424 wait complete. 2024-05-30T06:55:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28f6600640 1 Processor -- start 2024-05-30T06:55:48.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.016+0000 7f28f6600640 1 -- start start 2024-05-30T06:55:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f6600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28f0072510 0x7f28f013e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f6600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28f015d390 0x7f28f0159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f6600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28f015d770 0x7f28f0155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f6600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f28f006fb80 con 0x7f28f0072510 2024-05-30T06:55:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f6600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28f006fa00 con 0x7f28f015d390 2024-05-30T06:55:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f6600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f28f006fd00 con 0x7f28f015d770 2024-05-30T06:55:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28f0072510 0x7f28f013e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28f0072510 0x7f28f013e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43142/0 (socket says 172.21.15.37:43142) 2024-05-30T06:55:48.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f5200640 1 -- 172.21.15.37:0/4262320984 learned_addr learned my addr 172.21.15.37:0/4262320984 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f5c00640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28f015d770 0x7f28f0155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28e7e00640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28f015d390 0x7f28f0159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f5200640 1 -- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28f015d770 msgr2=0x7f28f0155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f5200640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28f015d770 0x7f28f0155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f5200640 1 -- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28f015d390 msgr2=0x7f28f0159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f5200640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28f015d390 0x7f28f0159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f5200640 1 -- 172.21.15.37:0/4262320984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f0157c60 con 0x7f28f0072510 2024-05-30T06:55:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28e7e00640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28f015d390 0x7f28f0159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f5c00640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28f015d770 0x7f28f0155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:55:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f5200640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28f0072510 0x7f28f013e9e0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f28e000c550 tx=0x7f28e000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28ed600640 1 -- 172.21.15.37:0/4262320984 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e0017070 con 0x7f28f0072510 2024-05-30T06:55:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28ed600640 1 -- 172.21.15.37:0/4262320984 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e0005d10 con 0x7f28f0072510 2024-05-30T06:55:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f6600640 1 -- 172.21.15.37:0/4262320984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f0157f40 con 0x7f28f0072510 2024-05-30T06:55:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28ed600640 1 -- 172.21.15.37:0/4262320984 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e0007330 con 0x7f28f0072510 2024-05-30T06:55:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f6600640 1 -- 172.21.15.37:0/4262320984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f0158500 con 0x7f28f0072510 2024-05-30T06:55:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28f6600640 1 -- 172.21.15.37:0/4262320984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f0068700 con 0x7f28f0072510 2024-05-30T06:55:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.020+0000 7f28ed600640 1 -- 172.21.15.37:0/4262320984 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f28e001a070 con 0x7f28f0072510 2024-05-30T06:55:48.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.024+0000 7f28ed600640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f28cc0698e0 0x7f28cc06bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.024+0000 7f28ed600640 1 -- 172.21.15.37:0/4262320984 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f28e0084f30 con 0x7f28f0072510 2024-05-30T06:55:48.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.024+0000 7f28e7e00640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f28cc0698e0 0x7f28cc06bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.024+0000 7f28e7e00640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f28cc0698e0 0x7f28cc06bda0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f28d80ad000 tx=0x7f28d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.028+0000 7f28ed600640 1 -- 172.21.15.37:0/4262320984 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f28e008f080 con 0x7f28f0072510 2024-05-30T06:55:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.192+0000 7f28f6600640 1 -- 172.21.15.37:0/4262320984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f28f0072e60 con 0x7f28f0072510 2024-05-30T06:55:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.192+0000 7f28ed600640 1 -- 172.21.15.37:0/4262320984 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f28e0056b40 con 0x7f28f0072510 2024-05-30T06:55:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.196+0000 7f28f6600640 1 -- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f28cc0698e0 msgr2=0x7f28cc06bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.196+0000 7f28f6600640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f28cc0698e0 0x7f28cc06bda0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f28d80ad000 tx=0x7f28d8008040 comp rx=0 tx=0).stop 2024-05-30T06:55:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.196+0000 7f28f6600640 1 -- 172.21.15.37:0/4262320984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28f0072510 msgr2=0x7f28f013e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.196+0000 7f28f6600640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28f0072510 0x7f28f013e9e0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f28e000c550 tx=0x7f28e000ca10 comp rx=0 tx=0).stop 2024-05-30T06:55:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.196+0000 7f28f6600640 1 -- 172.21.15.37:0/4262320984 shutdown_connections 2024-05-30T06:55:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.196+0000 7f28f6600640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28f015d770 0x7f28f0155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.196+0000 7f28f6600640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f28cc0698e0 0x7f28cc06bda0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.196+0000 7f28f6600640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28f015d390 0x7f28f0159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.196+0000 7f28f6600640 1 --2- 172.21.15.37:0/4262320984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28f0072510 0x7f28f013e9e0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.196+0000 7f28f6600640 1 -- 172.21.15.37:0/4262320984 >> 172.21.15.37:0/4262320984 conn(0x7f28f0067d60 msgr2=0x7f28f01417e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.196+0000 7f28f6600640 1 -- 172.21.15.37:0/4262320984 shutdown_connections 2024-05-30T06:55:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.196+0000 7f28f6600640 1 -- 172.21.15.37:0/4262320984 wait complete. 2024-05-30T06:55:48.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T06:55:48.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f956a200640 1 Processor -- start 2024-05-30T06:55:48.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f956a200640 1 -- start start 2024-05-30T06:55:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f956a200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95640ced10 0x7f956406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f956a200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956415d4e0 0x7f95640b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f956a200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956415db00 con 0x7f95640b59d0 2024-05-30T06:55:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f956a200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f956406df50 con 0x7f95640ced10 2024-05-30T06:55:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f956a200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f956406e7d0 con 0x7f956415d4e0 2024-05-30T06:55:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f9563400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95640ced10 0x7f956406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f9563400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95640ced10 0x7f956406ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43154/0 (socket says 172.21.15.37:43154) 2024-05-30T06:55:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f9563400640 1 -- 172.21.15.37:0/2921917865 learned_addr learned my addr 172.21.15.37:0/2921917865 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f9563e00640 1 --2- 172.21.15.37:0/2921917865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956415d4e0 0x7f95640b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f9563400640 1 -- 172.21.15.37:0/2921917865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956415d4e0 msgr2=0x7f95640b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f9563400640 1 --2- 172.21.15.37:0/2921917865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956415d4e0 0x7f95640b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f9563400640 1 -- 172.21.15.37:0/2921917865 >> v1:172.21.15.105:6789/0 conn(0x7f95640b59d0 legacy=0x7f956415cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.360+0000 7f9563400640 1 -- 172.21.15.37:0/2921917865 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956406e180 con 0x7f95640ced10 2024-05-30T06:55:48.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.364+0000 7f9563400640 1 --2- 172.21.15.37:0/2921917865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95640ced10 0x7f956406ec60 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f9554009870 tx=0x7f955401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc24c173b1a77ef server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:48.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.364+0000 7f9562a00640 1 -- 172.21.15.37:0/2921917865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95540b2070 con 0x7f95640ced10 2024-05-30T06:55:48.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.364+0000 7f9562a00640 1 -- 172.21.15.37:0/2921917865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95540a9070 con 0x7f95640ced10 2024-05-30T06:55:48.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.364+0000 7f9562a00640 1 -- 172.21.15.37:0/2921917865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95540ad880 con 0x7f95640ced10 2024-05-30T06:55:48.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.364+0000 7f956a200640 1 -- 172.21.15.37:0/2921917865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95640ced10 msgr2=0x7f956406ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.364+0000 7f956a200640 1 --2- 172.21.15.37:0/2921917865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95640ced10 0x7f956406ec60 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f9554009870 tx=0x7f955401c560 comp rx=0 tx=0).stop 2024-05-30T06:55:48.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.364+0000 7f956a200640 1 -- 172.21.15.37:0/2921917865 shutdown_connections 2024-05-30T06:55:48.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.364+0000 7f956a200640 1 --2- 172.21.15.37:0/2921917865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f956415d4e0 0x7f95640b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.364+0000 7f956a200640 1 --2- 172.21.15.37:0/2921917865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95640ced10 0x7f956406ec60 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.364+0000 7f956a200640 1 -- 172.21.15.37:0/2921917865 >> 172.21.15.37:0/2921917865 conn(0x7f956406bf60 msgr2=0x7f95640b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:48.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.364+0000 7f956a200640 1 -- 172.21.15.37:0/2921917865 shutdown_connections 2024-05-30T06:55:48.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.364+0000 7f956a200640 1 -- 172.21.15.37:0/2921917865 wait complete. 2024-05-30T06:55:48.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f956a200640 1 Processor -- start 2024-05-30T06:55:48.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f956a200640 1 -- start start 2024-05-30T06:55:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f956a200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95640b59d0 0x7f9564154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f956a200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95640ced10 0x7f956413dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f956a200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956415d4e0 0x7f95641525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f956a200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f956415ead0 con 0x7f95640b59d0 2024-05-30T06:55:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f956a200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f956415e950 con 0x7f956415d4e0 2024-05-30T06:55:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f956a200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9564169450 con 0x7f95640ced10 2024-05-30T06:55:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f9563400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95640b59d0 0x7f9564154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f9563400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95640b59d0 0x7f9564154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43166/0 (socket says 172.21.15.37:43166) 2024-05-30T06:55:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f9563400640 1 -- 172.21.15.37:0/3219271385 learned_addr learned my addr 172.21.15.37:0/3219271385 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f9563e00640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956415d4e0 0x7f95641525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f955aa00640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95640ced10 0x7f956413dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f9563400640 1 -- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95640ced10 msgr2=0x7f956413dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f9563400640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95640ced10 0x7f956413dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f9563400640 1 -- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956415d4e0 msgr2=0x7f95641525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f9563400640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956415d4e0 0x7f95641525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f9563400640 1 -- 172.21.15.37:0/3219271385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f956414bb40 con 0x7f95640b59d0 2024-05-30T06:55:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f9563400640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95640b59d0 0x7f9564154090 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f95540b0040 tx=0x7f955401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:48.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f955be00640 1 -- 172.21.15.37:0/3219271385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95540bc020 con 0x7f95640b59d0 2024-05-30T06:55:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f955be00640 1 -- 172.21.15.37:0/3219271385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95540b8420 con 0x7f95640b59d0 2024-05-30T06:55:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f956a200640 1 -- 172.21.15.37:0/3219271385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956414be20 con 0x7f95640b59d0 2024-05-30T06:55:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.368+0000 7f955be00640 1 -- 172.21.15.37:0/3219271385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95540b2040 con 0x7f95640b59d0 2024-05-30T06:55:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.372+0000 7f956a200640 1 -- 172.21.15.37:0/3219271385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956414c3e0 con 0x7f95640b59d0 2024-05-30T06:55:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.372+0000 7f956a200640 1 -- 172.21.15.37:0/3219271385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f956414c5e0 con 0x7f95640b59d0 2024-05-30T06:55:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.372+0000 7f955be00640 1 -- 172.21.15.37:0/3219271385 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f95540bf020 con 0x7f95640b59d0 2024-05-30T06:55:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.372+0000 7f955be00640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95400698e0 0x7f954006bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.372+0000 7f955be00640 1 -- 172.21.15.37:0/3219271385 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f955411fba0 con 0x7f95640b59d0 2024-05-30T06:55:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.372+0000 7f955aa00640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95400698e0 0x7f954006bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.376+0000 7f955aa00640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95400698e0 0x7f954006bda0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f956414efb0 tx=0x7f954c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:48.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.376+0000 7f955be00640 1 -- 172.21.15.37:0/3219271385 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f956414c5e0 con 0x7f95640b59d0 2024-05-30T06:55:48.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.568+0000 7f956a200640 1 -- 172.21.15.37:0/3219271385 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f9564068d40 con 0x7f95400698e0 2024-05-30T06:55:48.582 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:48.583+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:48.582 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:48.583+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:48.582 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:48.583+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:48.582 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:48.583+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:48.582 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:55:48.583+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:55:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.612+0000 7f955be00640 1 -- 172.21.15.37:0/3219271385 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9564068d40 con 0x7f95400698e0 2024-05-30T06:55:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.616+0000 7f956a200640 1 -- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95400698e0 msgr2=0x7f954006bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.616+0000 7f956a200640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95400698e0 0x7f954006bda0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f956414efb0 tx=0x7f954c009040 comp rx=0 tx=0).stop 2024-05-30T06:55:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.616+0000 7f956a200640 1 -- 172.21.15.37:0/3219271385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95640b59d0 msgr2=0x7f9564154090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.616+0000 7f956a200640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95640b59d0 0x7f9564154090 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f95540b0040 tx=0x7f955401ada0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.616+0000 7f956a200640 1 -- 172.21.15.37:0/3219271385 shutdown_connections 2024-05-30T06:55:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.616+0000 7f956a200640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f95400698e0 0x7f954006bda0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.616+0000 7f956a200640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f956415d4e0 0x7f95641525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.616+0000 7f956a200640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95640ced10 0x7f956413dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.616+0000 7f956a200640 1 --2- 172.21.15.37:0/3219271385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95640b59d0 0x7f9564154090 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.616+0000 7f956a200640 1 -- 172.21.15.37:0/3219271385 >> 172.21.15.37:0/3219271385 conn(0x7f956406bf60 msgr2=0x7f956415f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.616+0000 7f956a200640 1 -- 172.21.15.37:0/3219271385 shutdown_connections 2024-05-30T06:55:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.616+0000 7f956a200640 1 -- 172.21.15.37:0/3219271385 wait complete. 2024-05-30T06:55:48.637 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:55:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6dae200640 1 Processor -- start 2024-05-30T06:55:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6dae200640 1 -- start start 2024-05-30T06:55:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6dae200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6da806f770 0x7f6da8166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6dae200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6da815f310 con 0x7f6da80cd440 2024-05-30T06:55:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6dae200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6da815f5f0 con 0x7f6da8155da0 2024-05-30T06:55:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6dae200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6da80b4760 con 0x7f6da806f770 2024-05-30T06:55:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6da80cd440 0x7f6da806f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48908/0 (socket says 172.21.15.37:48908) 2024-05-30T06:55:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6a00640 1 -- 172.21.15.37:0/2295456892 learned_addr learned my addr 172.21.15.37:0/2295456892 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da7e00640 1 --2- 172.21.15.37:0/2295456892 >> v2:172.21.15.105:3300/0 conn(0x7f6da806f770 0x7f6da8166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235524411 0 0) 0x7f6da815f310 con 0x7f6da80cd440 2024-05-30T06:55:48.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d8c005740 con 0x7f6da80cd440 2024-05-30T06:55:48.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2498887718 0 0) 0x7f6d8c005740 con 0x7f6da80cd440 2024-05-30T06:55:48.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 >> v2:172.21.15.105:3300/0 conn(0x7f6da806f770 msgr2=0x7f6da8166570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:48.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 --2- 172.21.15.37:0/2295456892 >> v2:172.21.15.105:3300/0 conn(0x7f6da806f770 0x7f6da8166570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 >> v1:172.21.15.105:6789/0 conn(0x7f6da8155da0 legacy=0x7f6da80cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da815f8d0 con 0x7f6da80cd440 2024-05-30T06:55:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f6d94001680 con 0x7f6da80cd440 2024-05-30T06:55:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 >> v1:172.21.15.37:6789/0 conn(0x7f6da80cd440 legacy=0x7f6da806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 --2- 172.21.15.37:0/2295456892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d8c005bd0 0x7f6d8c005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 --2- 172.21.15.37:0/2295456892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d8c006a20 0x7f6d8c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 --2- 172.21.15.37:0/2295456892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d8c007500 0x7f6d8c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c00e3a0 con 0x7f6d8c007500 2024-05-30T06:55:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c00e550 con 0x7f6d8c006a20 2024-05-30T06:55:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6d8c00e750 con 0x7f6d8c005bd0 2024-05-30T06:55:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da7e00640 1 --2- 172.21.15.37:0/2295456892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d8c007500 0x7f6d8c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da7400640 1 --2- 172.21.15.37:0/2295456892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d8c005bd0 0x7f6d8c005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6a00640 1 --2- 172.21.15.37:0/2295456892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d8c006a20 0x7f6d8c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da7e00640 1 -- 172.21.15.37:0/2295456892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d8c005bd0 msgr2=0x7f6d8c005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:48.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da7e00640 1 --2- 172.21.15.37:0/2295456892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d8c005bd0 0x7f6d8c005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da7e00640 1 -- 172.21.15.37:0/2295456892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d8c006a20 msgr2=0x7f6d8c006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:48.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da7e00640 1 --2- 172.21.15.37:0/2295456892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d8c006a20 0x7f6d8c006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da7e00640 1 -- 172.21.15.37:0/2295456892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8c005740 con 0x7f6d8c007500 2024-05-30T06:55:48.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.780+0000 7f6da6a00640 1 --2- 172.21.15.37:0/2295456892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d8c006a20 0x7f6d8c006ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:48.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.784+0000 7f6da7e00640 1 -- 172.21.15.37:0/2295456892 reap_dead start 2024-05-30T06:55:48.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.784+0000 7f6da7e00640 1 --2- 172.21.15.37:0/2295456892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d8c007500 0x7f6d8c00dbe0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f6da8070100 tx=0x7f6da001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47d9b3fd2c314c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:48.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.784+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da00b2070 con 0x7f6d8c007500 2024-05-30T06:55:48.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.784+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da00a5910 con 0x7f6d8c007500 2024-05-30T06:55:48.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.784+0000 7f6da6000640 1 -- 172.21.15.37:0/2295456892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da0009c10 con 0x7f6d8c007500 2024-05-30T06:55:48.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.784+0000 7f6dae200640 1 -- 172.21.15.37:0/2295456892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d8c007500 msgr2=0x7f6d8c00dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.784+0000 7f6dae200640 1 --2- 172.21.15.37:0/2295456892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d8c007500 0x7f6d8c00dbe0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f6da8070100 tx=0x7f6da001cc20 comp rx=0 tx=0).stop 2024-05-30T06:55:48.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.784+0000 7f6dae200640 1 -- 172.21.15.37:0/2295456892 shutdown_connections 2024-05-30T06:55:48.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.784+0000 7f6dae200640 1 --2- 172.21.15.37:0/2295456892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d8c007500 0x7f6d8c00dbe0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.784+0000 7f6dae200640 1 -- 172.21.15.37:0/2295456892 >> 172.21.15.37:0/2295456892 conn(0x7f6da806bf60 msgr2=0x7f6da80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:48.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.784+0000 7f6dae200640 1 -- 172.21.15.37:0/2295456892 shutdown_connections 2024-05-30T06:55:48.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.784+0000 7f6dae200640 1 -- 172.21.15.37:0/2295456892 wait complete. 2024-05-30T06:55:48.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6dae200640 1 Processor -- start 2024-05-30T06:55:48.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6dae200640 1 -- start start 2024-05-30T06:55:48.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6dae200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d8c007500 0x7f6da814ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6dae200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da80af9c0 0x7f6da81540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6dae200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da814f000 0x7f6da814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6dae200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6da806f3f0 con 0x7f6da814f000 2024-05-30T06:55:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6dae200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6da806f270 con 0x7f6d8c007500 2024-05-30T06:55:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6dae200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6da806f570 con 0x7f6da80af9c0 2024-05-30T06:55:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6da7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da814f000 0x7f6da814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6da7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da814f000 0x7f6da814f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43188/0 (socket says 172.21.15.37:43188) 2024-05-30T06:55:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6da7e00640 1 -- 172.21.15.37:0/4194591658 learned_addr learned my addr 172.21.15.37:0/4194591658 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6da7e00640 1 -- 172.21.15.37:0/4194591658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da80af9c0 msgr2=0x7f6da81540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6da7e00640 1 --2- 172.21.15.37:0/4194591658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da80af9c0 0x7f6da81540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6da7e00640 1 -- 172.21.15.37:0/4194591658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d8c007500 msgr2=0x7f6da814ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6da7e00640 1 --2- 172.21.15.37:0/4194591658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d8c007500 0x7f6da814ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6da7e00640 1 -- 172.21.15.37:0/4194591658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da80b0120 con 0x7f6da814f000 2024-05-30T06:55:48.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6da7e00640 1 --2- 172.21.15.37:0/4194591658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da814f000 0x7f6da814f480 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f6da001d4c0 tx=0x7f6da0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:48.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6d9f400640 1 -- 172.21.15.37:0/4194591658 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da00be070 con 0x7f6da814f000 2024-05-30T06:55:48.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6d9f400640 1 -- 172.21.15.37:0/4194591658 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da00ad440 con 0x7f6da814f000 2024-05-30T06:55:48.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6dae200640 1 -- 172.21.15.37:0/4194591658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da8150600 con 0x7f6da814f000 2024-05-30T06:55:48.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6d9f400640 1 -- 172.21.15.37:0/4194591658 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da00b2040 con 0x7f6da814f000 2024-05-30T06:55:48.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.788+0000 7f6dae200640 1 -- 172.21.15.37:0/4194591658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da8150bc0 con 0x7f6da814f000 2024-05-30T06:55:48.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.792+0000 7f6dae200640 1 -- 172.21.15.37:0/4194591658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da8068bc0 con 0x7f6da814f000 2024-05-30T06:55:48.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.792+0000 7f6d9f400640 1 -- 172.21.15.37:0/4194591658 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7f6da00c1070 con 0x7f6da814f000 2024-05-30T06:55:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.792+0000 7f6d9f400640 1 --2- 172.21.15.37:0/4194591658 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d88069910 0x7f6d8806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.792+0000 7f6d9f400640 1 -- 172.21.15.37:0/4194591658 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f6da011f900 con 0x7f6da814f000 2024-05-30T06:55:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.792+0000 7f6da7400640 1 --2- 172.21.15.37:0/4194591658 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d88069910 0x7f6d8806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:48.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.792+0000 7f6da7400640 1 --2- 172.21.15.37:0/4194591658 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d88069910 0x7f6d8806bdd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6d98001060 tx=0x7f6d98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:48.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.796+0000 7f6d9f400640 1 -- 172.21.15.37:0/4194591658 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6da0016930 con 0x7f6da814f000 2024-05-30T06:55:48.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:48.992+0000 7f6dae200640 1 -- 172.21.15.37:0/4194591658 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f6da8151210 con 0x7f6d88069910 2024-05-30T06:55:49.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.000+0000 7f6d9f400640 1 -- 172.21.15.37:0/4194591658 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f6da8151210 con 0x7f6d88069910 2024-05-30T06:55:49.003 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa 2024-05-30T06:55:49.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.000+0000 7f6dae200640 1 -- 172.21.15.37:0/4194591658 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d88069910 msgr2=0x7f6d8806bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:49.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.000+0000 7f6dae200640 1 --2- 172.21.15.37:0/4194591658 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d88069910 0x7f6d8806bdd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6d98001060 tx=0x7f6d98009040 comp rx=0 tx=0).stop 2024-05-30T06:55:49.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.000+0000 7f6dae200640 1 -- 172.21.15.37:0/4194591658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da814f000 msgr2=0x7f6da814f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:49.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.000+0000 7f6dae200640 1 --2- 172.21.15.37:0/4194591658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da814f000 0x7f6da814f480 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f6da001d4c0 tx=0x7f6da0009750 comp rx=0 tx=0).stop 2024-05-30T06:55:49.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.000+0000 7f6dae200640 1 -- 172.21.15.37:0/4194591658 shutdown_connections 2024-05-30T06:55:49.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.000+0000 7f6dae200640 1 --2- 172.21.15.37:0/4194591658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da814f000 0x7f6da814f480 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.000+0000 7f6dae200640 1 --2- 172.21.15.37:0/4194591658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6da80af9c0 0x7f6da81540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.000+0000 7f6dae200640 1 --2- 172.21.15.37:0/4194591658 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d88069910 0x7f6d8806bdd0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.000+0000 7f6dae200640 1 --2- 172.21.15.37:0/4194591658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d8c007500 0x7f6da814ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.000+0000 7f6dae200640 1 -- 172.21.15.37:0/4194591658 >> 172.21.15.37:0/4194591658 conn(0x7f6da806bf60 msgr2=0x7f6da80cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.004+0000 7f6dae200640 1 -- 172.21.15.37:0/4194591658 shutdown_connections 2024-05-30T06:55:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.004+0000 7f6dae200640 1 -- 172.21.15.37:0/4194591658 wait complete. 2024-05-30T06:55:49.024 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:55:49.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.164+0000 7fa695200640 1 Processor -- start 2024-05-30T06:55:49.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.164+0000 7fa695200640 1 -- start start 2024-05-30T06:55:49.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa695200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa690158e00 0x7fa6900b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:49.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa695200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa690071410 con 0x7fa69006c070 2024-05-30T06:55:49.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa695200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa690162980 con 0x7fa6901624a0 2024-05-30T06:55:49.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa695200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa6900b4790 con 0x7fa690158e00 2024-05-30T06:55:49.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68e800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa69006c070 0x7fa6900b4c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48918/0 (socket says 172.21.15.37:48918) 2024-05-30T06:55:49.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68e800640 1 -- 172.21.15.37:0/3212541635 learned_addr learned my addr 172.21.15.37:0/3212541635 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:55:49.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575293801 0 0) 0x7fa690071410 con 0x7fa69006c070 2024-05-30T06:55:49.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa674003530 con 0x7fa69006c070 2024-05-30T06:55:49.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68de00640 1 --2- 172.21.15.37:0/3212541635 >> v2:172.21.15.105:3300/0 conn(0x7fa690158e00 0x7fa6900b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:49.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2759714909 0 0) 0x7fa674003530 con 0x7fa69006c070 2024-05-30T06:55:49.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 >> v2:172.21.15.105:3300/0 conn(0x7fa690158e00 msgr2=0x7fa6900b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:49.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 --2- 172.21.15.37:0/3212541635 >> v2:172.21.15.105:3300/0 conn(0x7fa690158e00 0x7fa6900b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 >> v1:172.21.15.105:6789/0 conn(0x7fa6901624a0 legacy=0x7fa69006b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:49.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa690162c60 con 0x7fa69006c070 2024-05-30T06:55:49.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fa688001680 con 0x7fa69006c070 2024-05-30T06:55:49.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 >> v1:172.21.15.37:6789/0 conn(0x7fa69006c070 legacy=0x7fa6900b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:49.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 --2- 172.21.15.37:0/3212541635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6740039c0 0x7fa674003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:49.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 --2- 172.21.15.37:0/3212541635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa674004810 0x7fa674004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:49.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 --2- 172.21.15.37:0/3212541635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6740051d0 0x7fa67400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:49.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa6900b4790 con 0x7fa6740051d0 2024-05-30T06:55:49.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa67400c0a0 con 0x7fa6740039c0 2024-05-30T06:55:49.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa67400c2a0 con 0x7fa674004810 2024-05-30T06:55:49.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68e800640 1 --2- 172.21.15.37:0/3212541635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6740051d0 0x7fa67400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:49.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68de00640 1 --2- 172.21.15.37:0/3212541635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6740039c0 0x7fa674003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:49.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa685400640 1 --2- 172.21.15.37:0/3212541635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa674004810 0x7fa674004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:49.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68e800640 1 -- 172.21.15.37:0/3212541635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa674004810 msgr2=0x7fa674004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:49.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68e800640 1 --2- 172.21.15.37:0/3212541635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa674004810 0x7fa674004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68e800640 1 -- 172.21.15.37:0/3212541635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6740039c0 msgr2=0x7fa674003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:55:49.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68e800640 1 --2- 172.21.15.37:0/3212541635 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6740039c0 0x7fa674003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa68e800640 1 -- 172.21.15.37:0/3212541635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa674003530 con 0x7fa6740051d0 2024-05-30T06:55:49.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.168+0000 7fa685400640 1 --2- 172.21.15.37:0/3212541635 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa674004810 0x7fa674004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:55:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.172+0000 7fa68e800640 1 -- 172.21.15.37:0/3212541635 reap_dead start 2024-05-30T06:55:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.172+0000 7fa68e800640 1 --2- 172.21.15.37:0/3212541635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6740051d0 0x7fa67400b9d0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa6900b44c0 tx=0x7fa68801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8183296f8e20591f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:49.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.172+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688007d00 con 0x7fa6740051d0 2024-05-30T06:55:49.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.172+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6880a5b20 con 0x7fa6740051d0 2024-05-30T06:55:49.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.172+0000 7fa68d400640 1 -- 172.21.15.37:0/3212541635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6880058e0 con 0x7fa6740051d0 2024-05-30T06:55:49.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.172+0000 7fa695200640 1 -- 172.21.15.37:0/3212541635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6740051d0 msgr2=0x7fa67400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:49.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.172+0000 7fa695200640 1 --2- 172.21.15.37:0/3212541635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6740051d0 0x7fa67400b9d0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa6900b44c0 tx=0x7fa68801cc00 comp rx=0 tx=0).stop 2024-05-30T06:55:49.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.172+0000 7fa695200640 1 -- 172.21.15.37:0/3212541635 shutdown_connections 2024-05-30T06:55:49.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.172+0000 7fa695200640 1 --2- 172.21.15.37:0/3212541635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6740051d0 0x7fa67400b9d0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.172+0000 7fa695200640 1 -- 172.21.15.37:0/3212541635 >> 172.21.15.37:0/3212541635 conn(0x7fa69006f110 msgr2=0x7fa69006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:49.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.172+0000 7fa695200640 1 -- 172.21.15.37:0/3212541635 shutdown_connections 2024-05-30T06:55:49.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.172+0000 7fa695200640 1 -- 172.21.15.37:0/3212541635 wait complete. 2024-05-30T06:55:49.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.172+0000 7fa695200640 1 Processor -- start 2024-05-30T06:55:49.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa695200640 1 -- start start 2024-05-30T06:55:49.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa695200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6740051d0 0x7fa6900cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa695200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6900cc2f0 0x7fa69013ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa695200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69014d290 0x7fa69015ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa695200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa6901591e0 con 0x7fa69014d290 2024-05-30T06:55:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa695200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa690163220 con 0x7fa6900cc2f0 2024-05-30T06:55:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa695200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa690159360 con 0x7fa6740051d0 2024-05-30T06:55:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa68e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69014d290 0x7fa69015ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa68e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69014d290 0x7fa69015ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43212/0 (socket says 172.21.15.37:43212) 2024-05-30T06:55:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa68e800640 1 -- 172.21.15.37:0/1862889006 learned_addr learned my addr 172.21.15.37:0/1862889006 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:55:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa685400640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6900cc2f0 0x7fa69013ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa68de00640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6740051d0 0x7fa6900cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa68e800640 1 -- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6740051d0 msgr2=0x7fa6900cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa68e800640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6740051d0 0x7fa6900cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa68e800640 1 -- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6900cc2f0 msgr2=0x7fa69013ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:49.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa68e800640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6900cc2f0 0x7fa69013ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa68e800640 1 -- 172.21.15.37:0/1862889006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa690140450 con 0x7fa69014d290 2024-05-30T06:55:49.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa68e800640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69014d290 0x7fa69015ba90 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa68801d4a0 tx=0x7fa674005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa686a00640 1 -- 172.21.15.37:0/1862889006 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6880b7070 con 0x7fa69014d290 2024-05-30T06:55:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa686a00640 1 -- 172.21.15.37:0/1862889006 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa688000ee0 con 0x7fa69014d290 2024-05-30T06:55:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa686a00640 1 -- 172.21.15.37:0/1862889006 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688004bf0 con 0x7fa69014d290 2024-05-30T06:55:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa695200640 1 -- 172.21.15.37:0/1862889006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6900ccb20 con 0x7fa69014d290 2024-05-30T06:55:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa695200640 1 -- 172.21.15.37:0/1862889006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6900cd0e0 con 0x7fa69014d290 2024-05-30T06:55:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.176+0000 7fa695200640 1 -- 172.21.15.37:0/1862889006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa690068bc0 con 0x7fa69014d290 2024-05-30T06:55:49.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.180+0000 7fa686a00640 1 -- 172.21.15.37:0/1862889006 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) ==== 89925+0+0 (secure 0 0 0) 0x7fa6880ba070 con 0x7fa69014d290 2024-05-30T06:55:49.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.180+0000 7fa686a00640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa66c069940 0x7fa66c06be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:55:49.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.180+0000 7fa686a00640 1 -- 172.21.15.37:0/1862889006 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fa68811ed50 con 0x7fa69014d290 2024-05-30T06:55:49.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.180+0000 7fa68de00640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa66c069940 0x7fa66c06be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:55:49.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.180+0000 7fa68de00640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa66c069940 0x7fa66c06be00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa680014450 tx=0x7fa68000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:55:49.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.184+0000 7fa686a00640 1 -- 172.21.15.37:0/1862889006 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa688016910 con 0x7fa69014d290 2024-05-30T06:55:49.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.372+0000 7fa695200640 1 -- 172.21.15.37:0/1862889006 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fa6901585c0 con 0x7fa66c069940 2024-05-30T06:55:49.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.380+0000 7fa686a00640 1 -- 172.21.15.37:0/1862889006 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fa6901585c0 con 0x7fa66c069940 2024-05-30T06:55:49.383 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa 2024-05-30T06:55:49.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.380+0000 7fa695200640 1 -- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa66c069940 msgr2=0x7fa66c06be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:49.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.380+0000 7fa695200640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa66c069940 0x7fa66c06be00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa680014450 tx=0x7fa68000b040 comp rx=0 tx=0).stop 2024-05-30T06:55:49.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.380+0000 7fa695200640 1 -- 172.21.15.37:0/1862889006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69014d290 msgr2=0x7fa69015ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:55:49.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.380+0000 7fa695200640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69014d290 0x7fa69015ba90 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa68801d4a0 tx=0x7fa674005840 comp rx=0 tx=0).stop 2024-05-30T06:55:49.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.380+0000 7fa695200640 1 -- 172.21.15.37:0/1862889006 shutdown_connections 2024-05-30T06:55:49.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.380+0000 7fa695200640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69014d290 0x7fa69015ba90 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.380+0000 7fa695200640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa66c069940 0x7fa66c06be00 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.380+0000 7fa695200640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6900cc2f0 0x7fa69013ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.380+0000 7fa695200640 1 --2- 172.21.15.37:0/1862889006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6740051d0 0x7fa6900cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:55:49.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.380+0000 7fa695200640 1 -- 172.21.15.37:0/1862889006 >> 172.21.15.37:0/1862889006 conn(0x7fa69006f110 msgr2=0x7fa690156690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:55:49.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.380+0000 7fa695200640 1 -- 172.21.15.37:0/1862889006 shutdown_connections 2024-05-30T06:55:49.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:55:49.380+0000 7fa695200640 1 -- 172.21.15.37:0/1862889006 wait complete. 2024-05-30T06:55:49.405 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa 2024-05-30T06:55:49.405 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:55:49.405 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:55:49.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:55:49.414 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:55:58.000 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:55:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:55:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.52805 s, 126 MB/s 2024-05-30T06:55:58.002 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:55:58.002 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:55:58.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:55:58.011 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:56:05.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:56:05.574 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:56:06.530 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:56:06.530 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:56:06.530 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.46434 s, 127 MB/s 2024-05-30T06:56:06.531 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:56:06.531 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:56:06.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:56:06.540 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:56:15.074 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:56:15.075 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:56:15.075 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.4847 s, 127 MB/s 2024-05-30T06:56:15.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T06:56:15.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e9e00640 1 Processor -- start 2024-05-30T06:56:15.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e9e00640 1 -- start start 2024-05-30T06:56:15.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e9e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2e415c780 0x7fc2e40b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:15.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e9e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc2e409b570 0x7fc2e40af410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:15.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e9e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2e40b2cb0 con 0x7fc2e409aa60 2024-05-30T06:56:15.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e9e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e40b38c0 con 0x7fc2e409b570 2024-05-30T06:56:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e9e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e40b2f90 con 0x7fc2e415c780 2024-05-30T06:56:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc2e409b570 0x7fc2e40af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc2e409b570 0x7fc2e40af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54286/0 (socket says 172.21.15.37:54286) 2024-05-30T06:56:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e3400640 1 -- 172.21.15.37:0/1392937096 learned_addr learned my addr 172.21.15.37:0/1392937096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e2a00640 1 --2- 172.21.15.37:0/1392937096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2e415c780 0x7fc2e40b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e3400640 1 -- 172.21.15.37:0/1392937096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2e415c780 msgr2=0x7fc2e40b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e3400640 1 --2- 172.21.15.37:0/1392937096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2e415c780 0x7fc2e40b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e3400640 1 -- 172.21.15.37:0/1392937096 >> v1:172.21.15.37:6789/0 conn(0x7fc2e409aa60 legacy=0x7fc2e409ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.220+0000 7fc2e3400640 1 -- 172.21.15.37:0/1392937096 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e40b3270 con 0x7fc2e409b570 2024-05-30T06:56:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.224+0000 7fc2e3400640 1 --2- 172.21.15.37:0/1392937096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e409b570 0x7fc2e40af410 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009870 tx=0x7fc2dc01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bc31400b9cc314 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.224+0000 7fc2e2000640 1 -- 172.21.15.37:0/1392937096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0ab650 con 0x7fc2e409b570 2024-05-30T06:56:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.224+0000 7fc2e2000640 1 -- 172.21.15.37:0/1392937096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2dc0b0070 con 0x7fc2e409b570 2024-05-30T06:56:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.224+0000 7fc2e2000640 1 -- 172.21.15.37:0/1392937096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0aba10 con 0x7fc2e409b570 2024-05-30T06:56:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.224+0000 7fc2e9e00640 1 -- 172.21.15.37:0/1392937096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e409b570 msgr2=0x7fc2e40af410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.224+0000 7fc2e9e00640 1 --2- 172.21.15.37:0/1392937096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e409b570 0x7fc2e40af410 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009870 tx=0x7fc2dc01c530 comp rx=0 tx=0).stop 2024-05-30T06:56:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.224+0000 7fc2e9e00640 1 -- 172.21.15.37:0/1392937096 shutdown_connections 2024-05-30T06:56:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.224+0000 7fc2e9e00640 1 --2- 172.21.15.37:0/1392937096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e409b570 0x7fc2e40af410 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.224+0000 7fc2e9e00640 1 --2- 172.21.15.37:0/1392937096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2e415c780 0x7fc2e40b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.224+0000 7fc2e9e00640 1 -- 172.21.15.37:0/1392937096 >> 172.21.15.37:0/1392937096 conn(0x7fc2e40d26a0 msgr2=0x7fc2e40d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.224+0000 7fc2e9e00640 1 -- 172.21.15.37:0/1392937096 shutdown_connections 2024-05-30T06:56:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.224+0000 7fc2e9e00640 1 -- 172.21.15.37:0/1392937096 wait complete. 2024-05-30T06:56:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e9e00640 1 Processor -- start 2024-05-30T06:56:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e9e00640 1 -- start start 2024-05-30T06:56:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e409aa60 0x7fc2e4154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e9e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2e409b570 0x7fc2e4160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e9e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2e415c780 0x7fc2e4160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e9e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e40b02e0 con 0x7fc2e409aa60 2024-05-30T06:56:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e9e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e40b0160 con 0x7fc2e409b570 2024-05-30T06:56:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e9e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e41696b0 con 0x7fc2e415c780 2024-05-30T06:56:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e409aa60 0x7fc2e4154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e409aa60 0x7fc2e4154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54292/0 (socket says 172.21.15.37:54292) 2024-05-30T06:56:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e2a00640 1 -- 172.21.15.37:0/4195491479 learned_addr learned my addr 172.21.15.37:0/4195491479 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e3400640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2e415c780 0x7fc2e4160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2da000640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2e409b570 0x7fc2e4160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e2a00640 1 -- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2e415c780 msgr2=0x7fc2e4160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e2a00640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2e415c780 0x7fc2e4160840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e2a00640 1 -- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2e409b570 msgr2=0x7fc2e4160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e2a00640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2e409b570 0x7fc2e4160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e2a00640 1 -- 172.21.15.37:0/4195491479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e4155090 con 0x7fc2e409aa60 2024-05-30T06:56:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2da000640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2e409b570 0x7fc2e4160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:56:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e2a00640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e409aa60 0x7fc2e4154b50 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400e8a0 tx=0x7fc2d400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2dbe00640 1 -- 172.21.15.37:0/4195491479 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4017070 con 0x7fc2e409aa60 2024-05-30T06:56:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2dbe00640 1 -- 172.21.15.37:0/4195491479 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d400c940 con 0x7fc2e409aa60 2024-05-30T06:56:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e9e00640 1 -- 172.21.15.37:0/4195491479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e415e770 con 0x7fc2e409aa60 2024-05-30T06:56:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2dbe00640 1 -- 172.21.15.37:0/4195491479 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400ccf0 con 0x7fc2e409aa60 2024-05-30T06:56:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e9e00640 1 -- 172.21.15.37:0/4195491479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e415ed30 con 0x7fc2e409aa60 2024-05-30T06:56:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.228+0000 7fc2e9e00640 1 -- 172.21.15.37:0/4195491479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e4068d40 con 0x7fc2e409aa60 2024-05-30T06:56:15.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.232+0000 7fc2dbe00640 1 -- 172.21.15.37:0/4195491479 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) ==== 89976+0+0 (secure 0 0 0) 0x7fc2d401a070 con 0x7fc2e409aa60 2024-05-30T06:56:15.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.232+0000 7fc2dbe00640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc2c0069970 0x7fc2c006be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:15.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.232+0000 7fc2dbe00640 1 -- 172.21.15.37:0/4195491479 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fc2d4085970 con 0x7fc2e409aa60 2024-05-30T06:56:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.232+0000 7fc2da000640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc2c0069970 0x7fc2c006be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:15.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.232+0000 7fc2da000640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc2c0069970 0x7fc2c006be30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40c5ef0 tx=0x7fc2cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:15.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.236+0000 7fc2dbe00640 1 -- 172.21.15.37:0/4195491479 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc2d4085e10 con 0x7fc2e409aa60 2024-05-30T06:56:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.432+0000 7fc2e9e00640 1 -- 172.21.15.37:0/4195491479 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7fc2e40cf790 con 0x7fc2c0069970 2024-05-30T06:56:15.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.444+0000 7fc2dbe00640 1 -- 172.21.15.37:0/4195491479 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc2e40cf790 con 0x7fc2c0069970 2024-05-30T06:56:15.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.444+0000 7fc2e9e00640 1 -- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc2c0069970 msgr2=0x7fc2c006be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:15.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.444+0000 7fc2e9e00640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc2c0069970 0x7fc2c006be30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40c5ef0 tx=0x7fc2cc009040 comp rx=0 tx=0).stop 2024-05-30T06:56:15.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.444+0000 7fc2e9e00640 1 -- 172.21.15.37:0/4195491479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e409aa60 msgr2=0x7fc2e4154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:15.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.444+0000 7fc2e9e00640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e409aa60 0x7fc2e4154b50 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400e8a0 tx=0x7fc2d400eca0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.444+0000 7fc2e9e00640 1 -- 172.21.15.37:0/4195491479 shutdown_connections 2024-05-30T06:56:15.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.444+0000 7fc2e9e00640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2e415c780 0x7fc2e4160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.444+0000 7fc2e9e00640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc2c0069970 0x7fc2c006be30 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.444+0000 7fc2e9e00640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2e409b570 0x7fc2e4160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.444+0000 7fc2e9e00640 1 --2- 172.21.15.37:0/4195491479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e409aa60 0x7fc2e4154b50 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.444+0000 7fc2e9e00640 1 -- 172.21.15.37:0/4195491479 >> 172.21.15.37:0/4195491479 conn(0x7fc2e40d26a0 msgr2=0x7fc2e409ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:15.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.448+0000 7fc2e9e00640 1 -- 172.21.15.37:0/4195491479 shutdown_connections 2024-05-30T06:56:15.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.448+0000 7fc2e9e00640 1 -- 172.21.15.37:0/4195491479 wait complete. 2024-05-30T06:56:15.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:56:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa354a00640 1 Processor -- start 2024-05-30T06:56:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa354a00640 1 -- start start 2024-05-30T06:56:15.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa354a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa350144c00 0x7fa35006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:15.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa354a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa350144fe0 0x7fa35006f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:15.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa354a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa35015f2b0 0x7fa35015f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:15.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa354a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa3500b3bf0 con 0x7fa350144c00 2024-05-30T06:56:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa354a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa3500d01d0 con 0x7fa35015f2b0 2024-05-30T06:56:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa354a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa3500cfd40 con 0x7fa350144fe0 2024-05-30T06:56:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa34f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa350144c00 0x7fa35006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa34f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa350144c00 0x7fa35006ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54300/0 (socket says 172.21.15.37:54300) 2024-05-30T06:56:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa34f400640 1 -- 172.21.15.37:0/4212710424 learned_addr learned my addr 172.21.15.37:0/4212710424 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa34ea00640 1 --2- 172.21.15.37:0/4212710424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa350144fe0 0x7fa35006f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa34fe00640 1 --2- 172.21.15.37:0/4212710424 >> v2:172.21.15.105:3300/0 conn(0x7fa35015f2b0 0x7fa35015f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa34f400640 1 -- 172.21.15.37:0/4212710424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa350144fe0 msgr2=0x7fa35006f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa34f400640 1 --2- 172.21.15.37:0/4212710424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa350144fe0 0x7fa35006f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa34f400640 1 -- 172.21.15.37:0/4212710424 >> v2:172.21.15.105:3300/0 conn(0x7fa35015f2b0 msgr2=0x7fa35015f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa34f400640 1 --2- 172.21.15.37:0/4212710424 >> v2:172.21.15.105:3300/0 conn(0x7fa35015f2b0 0x7fa35015f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.612+0000 7fa34f400640 1 -- 172.21.15.37:0/4212710424 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3500cf430 con 0x7fa350144c00 2024-05-30T06:56:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.616+0000 7fa34f400640 1 --2- 172.21.15.37:0/4212710424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa350144c00 0x7fa35006ef50 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fa350070110 tx=0x7fa34001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfef40b70949bfad server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.616+0000 7fa34e000640 1 -- 172.21.15.37:0/4212710424 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3400b0070 con 0x7fa350144c00 2024-05-30T06:56:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.616+0000 7fa34e000640 1 -- 172.21.15.37:0/4212710424 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3400ab600 con 0x7fa350144c00 2024-05-30T06:56:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.616+0000 7fa34e000640 1 -- 172.21.15.37:0/4212710424 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3400ab9d0 con 0x7fa350144c00 2024-05-30T06:56:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.616+0000 7fa354a00640 1 -- 172.21.15.37:0/4212710424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa350144c00 msgr2=0x7fa35006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.616+0000 7fa354a00640 1 --2- 172.21.15.37:0/4212710424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa350144c00 0x7fa35006ef50 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fa350070110 tx=0x7fa34001c460 comp rx=0 tx=0).stop 2024-05-30T06:56:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.616+0000 7fa354a00640 1 -- 172.21.15.37:0/4212710424 shutdown_connections 2024-05-30T06:56:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.616+0000 7fa354a00640 1 --2- 172.21.15.37:0/4212710424 >> v2:172.21.15.105:3300/0 conn(0x7fa35015f2b0 0x7fa35015f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.616+0000 7fa354a00640 1 --2- 172.21.15.37:0/4212710424 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa350144fe0 0x7fa35006f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.616+0000 7fa354a00640 1 --2- 172.21.15.37:0/4212710424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa350144c00 0x7fa35006ef50 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.616+0000 7fa354a00640 1 -- 172.21.15.37:0/4212710424 >> 172.21.15.37:0/4212710424 conn(0x7fa350067d60 msgr2=0x7fa35006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.616+0000 7fa354a00640 1 -- 172.21.15.37:0/4212710424 shutdown_connections 2024-05-30T06:56:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.616+0000 7fa354a00640 1 -- 172.21.15.37:0/4212710424 wait complete. 2024-05-30T06:56:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa354a00640 1 Processor -- start 2024-05-30T06:56:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa354a00640 1 -- start start 2024-05-30T06:56:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa354a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa350144c00 0x7fa350166ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa354a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa350144fe0 0x7fa35013db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa354a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa35015f2b0 0x7fa35006de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa354a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa35015c3f0 con 0x7fa350144c00 2024-05-30T06:56:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa354a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa35015c270 con 0x7fa35015f2b0 2024-05-30T06:56:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa354a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa35015c570 con 0x7fa350144fe0 2024-05-30T06:56:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa34f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa350144c00 0x7fa350166ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa34f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa350144c00 0x7fa350166ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54310/0 (socket says 172.21.15.37:54310) 2024-05-30T06:56:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa34f400640 1 -- 172.21.15.37:0/2520353753 learned_addr learned my addr 172.21.15.37:0/2520353753 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa34fe00640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa35015f2b0 0x7fa35006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa34ea00640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa350144fe0 0x7fa35013db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa34f400640 1 -- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa350144fe0 msgr2=0x7fa35013db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa34f400640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa350144fe0 0x7fa35013db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa34f400640 1 -- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa35015f2b0 msgr2=0x7fa35006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa34f400640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa35015f2b0 0x7fa35006de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa34f400640 1 -- 172.21.15.37:0/2520353753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa350166530 con 0x7fa350144c00 2024-05-30T06:56:15.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa34ea00640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa350144fe0 0x7fa35013db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:56:15.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa34f400640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa350144c00 0x7fa350166ff0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa34001cd00 tx=0x7fa340019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa347400640 1 -- 172.21.15.37:0/2520353753 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3400b0040 con 0x7fa350144c00 2024-05-30T06:56:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa347400640 1 -- 172.21.15.37:0/2520353753 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3400b9070 con 0x7fa350144c00 2024-05-30T06:56:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa354a00640 1 -- 172.21.15.37:0/2520353753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa350165220 con 0x7fa350144c00 2024-05-30T06:56:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa347400640 1 -- 172.21.15.37:0/2520353753 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3400b4680 con 0x7fa350144c00 2024-05-30T06:56:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.620+0000 7fa354a00640 1 -- 172.21.15.37:0/2520353753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa350166ad0 con 0x7fa350144c00 2024-05-30T06:56:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.624+0000 7fa354a00640 1 -- 172.21.15.37:0/2520353753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa350068700 con 0x7fa350144c00 2024-05-30T06:56:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.624+0000 7fa347400640 1 -- 172.21.15.37:0/2520353753 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) ==== 89976+0+0 (secure 0 0 0) 0x7fa3400b4820 con 0x7fa350144c00 2024-05-30T06:56:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.624+0000 7fa347400640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa330069970 0x7fa33006be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.624+0000 7fa347400640 1 -- 172.21.15.37:0/2520353753 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fa34011f0d0 con 0x7fa350144c00 2024-05-30T06:56:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.624+0000 7fa34ea00640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa330069970 0x7fa33006be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.624+0000 7fa34ea00640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa330069970 0x7fa33006be30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa350141810 tx=0x7fa33c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.628+0000 7fa347400640 1 -- 172.21.15.37:0/2520353753 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa340016110 con 0x7fa350144c00 2024-05-30T06:56:15.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.816+0000 7fa354a00640 1 -- 172.21.15.37:0/2520353753 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7fa350068ab0 con 0x7fa330069970 2024-05-30T06:56:15.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.824+0000 7fa347400640 1 -- 172.21.15.37:0/2520353753 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7fa350068ab0 con 0x7fa330069970 2024-05-30T06:56:15.825 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa 2024-05-30T06:56:15.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.824+0000 7fa354a00640 1 -- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa330069970 msgr2=0x7fa33006be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:15.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.824+0000 7fa354a00640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa330069970 0x7fa33006be30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa350141810 tx=0x7fa33c008040 comp rx=0 tx=0).stop 2024-05-30T06:56:15.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.824+0000 7fa354a00640 1 -- 172.21.15.37:0/2520353753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa350144c00 msgr2=0x7fa350166ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:15.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.824+0000 7fa354a00640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa350144c00 0x7fa350166ff0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa34001cd00 tx=0x7fa340019200 comp rx=0 tx=0).stop 2024-05-30T06:56:15.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.824+0000 7fa354a00640 1 -- 172.21.15.37:0/2520353753 shutdown_connections 2024-05-30T06:56:15.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.824+0000 7fa354a00640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa330069970 0x7fa33006be30 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.824+0000 7fa354a00640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa35015f2b0 0x7fa35006de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.824+0000 7fa354a00640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa350144fe0 0x7fa35013db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.824+0000 7fa354a00640 1 --2- 172.21.15.37:0/2520353753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa350144c00 0x7fa350166ff0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:15.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.824+0000 7fa354a00640 1 -- 172.21.15.37:0/2520353753 >> 172.21.15.37:0/2520353753 conn(0x7fa350067d60 msgr2=0x7fa3500cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:15.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.824+0000 7fa354a00640 1 -- 172.21.15.37:0/2520353753 shutdown_connections 2024-05-30T06:56:15.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:15.824+0000 7fa354a00640 1 -- 172.21.15.37:0/2520353753 wait complete. 2024-05-30T06:56:15.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:56:15.846 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa 2024-05-30T06:56:15.846 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:56:15.855 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa 2024-05-30T06:56:15.856 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3055190016" 2024-05-30T06:56:15.856 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:15.857 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 exp_size = 3221225472 2024-05-30T06:56:17.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:56:17.858 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa 2024-05-30T06:56:17.858 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:56:17.869 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa 2024-05-30T06:56:17.869 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3055190016" 2024-05-30T06:56:17.869 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:17.870 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 exp_size = 3221225472 2024-05-30T06:56:19.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:56:19.871 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa 2024-05-30T06:56:19.871 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:56:19.882 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa 2024-05-30T06:56:19.882 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3055190016" 2024-05-30T06:56:19.882 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:19.883 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 exp_size = 3221225472 2024-05-30T06:56:21.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:56:21.885 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa 2024-05-30T06:56:21.885 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:56:21.895 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa 2024-05-30T06:56:21.896 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T06:56:21.896 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:21.896 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T06:56:21.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 ss1clone1 2024-05-30T06:56:22.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff39d000640 1 Processor -- start 2024-05-30T06:56:22.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff39d000640 1 -- start start 2024-05-30T06:56:22.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff39d000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff3980b18a0 0x7ff39806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:22.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff39d000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3980d2fa0 con 0x7ff398070210 2024-05-30T06:56:22.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff39d000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3980d3280 con 0x7ff3980d0380 2024-05-30T06:56:22.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff39d000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff39809ba70 con 0x7ff3980b18a0 2024-05-30T06:56:22.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff397e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff398070210 0x7ff3980af350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49200/0 (socket says 172.21.15.37:49200) 2024-05-30T06:56:22.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff397e00640 1 -- 172.21.15.37:0/497625803 learned_addr learned my addr 172.21.15.37:0/497625803 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:56:22.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff38ea00640 1 --2- 172.21.15.37:0/497625803 >> v2:172.21.15.105:3300/0 conn(0x7ff3980b18a0 0x7ff39806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:22.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff396a00640 1 -- 172.21.15.37:0/497625803 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576693411 0 0) 0x7ff3980d2fa0 con 0x7ff398070210 2024-05-30T06:56:22.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff396a00640 1 -- 172.21.15.37:0/497625803 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff37c003530 con 0x7ff398070210 2024-05-30T06:56:22.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff396a00640 1 -- 172.21.15.37:0/497625803 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1661526395 0 0) 0x7ff37c003530 con 0x7ff398070210 2024-05-30T06:56:22.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff38ea00640 1 -- 172.21.15.37:0/497625803 >> v1:172.21.15.105:6789/0 conn(0x7ff3980d0380 legacy=0x7ff3980d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:22.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff38ea00640 1 -- 172.21.15.37:0/497625803 >> v1:172.21.15.37:6789/0 conn(0x7ff398070210 legacy=0x7ff3980af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:22.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.096+0000 7ff38ea00640 1 -- 172.21.15.37:0/497625803 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff398071cb0 con 0x7ff3980b18a0 2024-05-30T06:56:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.100+0000 7ff38ea00640 1 --2- 172.21.15.37:0/497625803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3980b18a0 0x7ff39806fcd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff3800097c0 tx=0x7ff38001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=befdd3cc98c3f15c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.100+0000 7ff396a00640 1 -- 172.21.15.37:0/497625803 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3800b0070 con 0x7ff3980b18a0 2024-05-30T06:56:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.100+0000 7ff396a00640 1 -- 172.21.15.37:0/497625803 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3800ab400 con 0x7ff3980b18a0 2024-05-30T06:56:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.100+0000 7ff396a00640 1 -- 172.21.15.37:0/497625803 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390001680 con 0x7ff3980b18a0 2024-05-30T06:56:22.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.100+0000 7ff39d000640 1 -- 172.21.15.37:0/497625803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3980b18a0 msgr2=0x7ff39806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:22.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.100+0000 7ff39d000640 1 --2- 172.21.15.37:0/497625803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3980b18a0 0x7ff39806fcd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff3800097c0 tx=0x7ff38001c380 comp rx=0 tx=0).stop 2024-05-30T06:56:22.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.100+0000 7ff39d000640 1 -- 172.21.15.37:0/497625803 shutdown_connections 2024-05-30T06:56:22.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.100+0000 7ff39d000640 1 --2- 172.21.15.37:0/497625803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3980b18a0 0x7ff39806fcd0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:22.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.100+0000 7ff39d000640 1 -- 172.21.15.37:0/497625803 >> 172.21.15.37:0/497625803 conn(0x7ff3980d2480 msgr2=0x7ff3980d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:22.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.100+0000 7ff39d000640 1 -- 172.21.15.37:0/497625803 shutdown_connections 2024-05-30T06:56:22.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.100+0000 7ff39d000640 1 -- 172.21.15.37:0/497625803 wait complete. 2024-05-30T06:56:22.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff39d000640 1 Processor -- start 2024-05-30T06:56:22.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff39d000640 1 -- start start 2024-05-30T06:56:22.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff39d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff398070210 0x7ff398150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:22.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff39d000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3980b18a0 0x7ff398152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff39d000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3980d0380 0x7ff398157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff39d000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff3980afa60 con 0x7ff398070210 2024-05-30T06:56:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff39d000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff398071940 con 0x7ff3980b18a0 2024-05-30T06:56:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff39d000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff398152620 con 0x7ff3980d0380 2024-05-30T06:56:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff397400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff398070210 0x7ff398150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff397400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff398070210 0x7ff398150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35422/0 (socket says 172.21.15.37:35422) 2024-05-30T06:56:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff397400640 1 -- 172.21.15.37:0/3023505011 learned_addr learned my addr 172.21.15.37:0/3023505011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff38ea00640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3980b18a0 0x7ff398152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff397e00640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3980d0380 0x7ff398157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff397400640 1 -- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3980d0380 msgr2=0x7ff398157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff397400640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3980d0380 0x7ff398157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff397400640 1 -- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3980b18a0 msgr2=0x7ff398152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff397400640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3980b18a0 0x7ff398152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff397400640 1 -- 172.21.15.37:0/3023505011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff398151a10 con 0x7ff398070210 2024-05-30T06:56:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff397e00640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3980d0380 0x7ff398157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:56:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff397400640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff398070210 0x7ff398150540 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ff38800c7d0 tx=0x7ff38800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff38fe00640 1 -- 172.21.15.37:0/3023505011 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388003b80 con 0x7ff398070210 2024-05-30T06:56:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff38fe00640 1 -- 172.21.15.37:0/3023505011 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff388003d20 con 0x7ff398070210 2024-05-30T06:56:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff39d000640 1 -- 172.21.15.37:0/3023505011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff398151cf0 con 0x7ff398070210 2024-05-30T06:56:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff38fe00640 1 -- 172.21.15.37:0/3023505011 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38800aa90 con 0x7ff398070210 2024-05-30T06:56:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff39d000640 1 -- 172.21.15.37:0/3023505011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3981522b0 con 0x7ff398070210 2024-05-30T06:56:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.104+0000 7ff39d000640 1 -- 172.21.15.37:0/3023505011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff398068ab0 con 0x7ff398070210 2024-05-30T06:56:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.108+0000 7ff38fe00640 1 -- 172.21.15.37:0/3023505011 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) ==== 89976+0+0 (secure 0 0 0) 0x7ff38800ac30 con 0x7ff398070210 2024-05-30T06:56:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.108+0000 7ff38fe00640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3740699a0 0x7ff37406be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.108+0000 7ff38fe00640 1 -- 172.21.15.37:0/3023505011 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7ff3880859a0 con 0x7ff398070210 2024-05-30T06:56:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.108+0000 7ff38ea00640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3740699a0 0x7ff37406be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.108+0000 7ff38ea00640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3740699a0 0x7ff37406be60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff3800ad000 tx=0x7ff3800a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:22.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.112+0000 7ff38fe00640 1 -- 172.21.15.37:0/3023505011 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff3880575a0 con 0x7ff398070210 2024-05-30T06:56:22.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.312+0000 7ff39d000640 1 -- 172.21.15.37:0/3023505011 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7ff39815e6f0 con 0x7ff3740699a0 2024-05-30T06:56:22.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.376+0000 7ff38fe00640 1 -- 172.21.15.37:0/3023505011 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff39815e6f0 con 0x7ff3740699a0 2024-05-30T06:56:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.380+0000 7ff39d000640 1 -- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3740699a0 msgr2=0x7ff37406be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.380+0000 7ff39d000640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3740699a0 0x7ff37406be60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff3800ad000 tx=0x7ff3800a6000 comp rx=0 tx=0).stop 2024-05-30T06:56:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.380+0000 7ff39d000640 1 -- 172.21.15.37:0/3023505011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff398070210 msgr2=0x7ff398150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:22.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.380+0000 7ff39d000640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff398070210 0x7ff398150540 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ff38800c7d0 tx=0x7ff38800cc90 comp rx=0 tx=0).stop 2024-05-30T06:56:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.380+0000 7ff39d000640 1 -- 172.21.15.37:0/3023505011 shutdown_connections 2024-05-30T06:56:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.380+0000 7ff39d000640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3980d0380 0x7ff398157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.380+0000 7ff39d000640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff3740699a0 0x7ff37406be60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.380+0000 7ff39d000640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3980b18a0 0x7ff398152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.380+0000 7ff39d000640 1 --2- 172.21.15.37:0/3023505011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff398070210 0x7ff398150540 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.380+0000 7ff39d000640 1 -- 172.21.15.37:0/3023505011 >> 172.21.15.37:0/3023505011 conn(0x7ff3980d2480 msgr2=0x7ff3980b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.380+0000 7ff39d000640 1 -- 172.21.15.37:0/3023505011 shutdown_connections 2024-05-30T06:56:22.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:22.380+0000 7ff39d000640 1 -- 172.21.15.37:0/3023505011 wait complete. 2024-05-30T06:56:22.383 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:56:22.382+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:56:22.383 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:56:22.382+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:56:22.383 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:56:22.382+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:56:22.383 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:56:22.382+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:56:22.383 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:56:22.382+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:56:22.402 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:56:22.402+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:56:22.402 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:56:22.402+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:56:22.402 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:56:22.402+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:56:22.402 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:56:22.402+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:56:22.402 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:56:22.402+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:56:23.403 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs ss1clone1 2024-05-30T06:56:23.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.556+0000 7f36fc000640 1 Processor -- start 2024-05-30T06:56:23.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.556+0000 7f36fc000640 1 -- start start 2024-05-30T06:56:23.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.556+0000 7f36fc000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f36f40b59d0 0x7f36f40b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:23.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.556+0000 7f36fc000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36f415d7e0 0x7f36f4160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:23.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.556+0000 7f36fc000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f40b62f0 con 0x7f36f415d350 2024-05-30T06:56:23.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.556+0000 7f36fc000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f36f4142030 con 0x7f36f415d7e0 2024-05-30T06:56:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.556+0000 7f36fc000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f36f4142310 con 0x7f36f40b59d0 2024-05-30T06:56:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.556+0000 7f36fa000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36f415d7e0 0x7f36f4160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.556+0000 7f36fa000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36f415d7e0 0x7f36f4160990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35432/0 (socket says 172.21.15.37:35432) 2024-05-30T06:56:23.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.556+0000 7f36fa000640 1 -- 172.21.15.37:0/1998165953 learned_addr learned my addr 172.21.15.37:0/1998165953 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:23.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.556+0000 7f36f9600640 1 --2- 172.21.15.37:0/1998165953 >> v2:172.21.15.105:3300/0 conn(0x7f36f40b59d0 0x7f36f40b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:23.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.560+0000 7f36fa000640 1 -- 172.21.15.37:0/1998165953 >> v2:172.21.15.105:3300/0 conn(0x7f36f40b59d0 msgr2=0x7f36f40b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:23.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.560+0000 7f36fa000640 1 --2- 172.21.15.37:0/1998165953 >> v2:172.21.15.105:3300/0 conn(0x7f36f40b59d0 0x7f36f40b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:23.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.560+0000 7f36fa000640 1 -- 172.21.15.37:0/1998165953 >> v1:172.21.15.105:6789/0 conn(0x7f36f415d350 legacy=0x7f36f4160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:23.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.560+0000 7f36fa000640 1 -- 172.21.15.37:0/1998165953 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f41425f0 con 0x7f36f415d7e0 2024-05-30T06:56:23.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.560+0000 7f36fa000640 1 --2- 172.21.15.37:0/1998165953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36f415d7e0 0x7f36f4160990 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009e50 tx=0x7f36ec01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820836494a295d06 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:23.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.560+0000 7f36f3e00640 1 -- 172.21.15.37:0/1998165953 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0b4070 con 0x7f36f415d7e0 2024-05-30T06:56:23.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.560+0000 7f36f3e00640 1 -- 172.21.15.37:0/1998165953 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ec0af400 con 0x7f36f415d7e0 2024-05-30T06:56:23.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.560+0000 7f36f3e00640 1 -- 172.21.15.37:0/1998165953 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0af7d0 con 0x7f36f415d7e0 2024-05-30T06:56:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.560+0000 7f36fc000640 1 -- 172.21.15.37:0/1998165953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36f415d7e0 msgr2=0x7f36f4160990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.560+0000 7f36fc000640 1 --2- 172.21.15.37:0/1998165953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36f415d7e0 0x7f36f4160990 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009e50 tx=0x7f36ec01f1e0 comp rx=0 tx=0).stop 2024-05-30T06:56:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 -- 172.21.15.37:0/1998165953 shutdown_connections 2024-05-30T06:56:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 --2- 172.21.15.37:0/1998165953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36f415d7e0 0x7f36f4160990 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 --2- 172.21.15.37:0/1998165953 >> v2:172.21.15.105:3300/0 conn(0x7f36f40b59d0 0x7f36f40b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 -- 172.21.15.37:0/1998165953 >> 172.21.15.37:0/1998165953 conn(0x7f36f406bf60 msgr2=0x7f36f40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:23.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 -- 172.21.15.37:0/1998165953 shutdown_connections 2024-05-30T06:56:23.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 -- 172.21.15.37:0/1998165953 wait complete. 2024-05-30T06:56:23.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 Processor -- start 2024-05-30T06:56:23.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 -- start start 2024-05-30T06:56:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36f40b59d0 0x7f36f413af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36f415d350 0x7f36f415f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36f415d7e0 0x7f36f413cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f36f413fe60 con 0x7f36f40b59d0 2024-05-30T06:56:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f36f413fce0 con 0x7f36f415d350 2024-05-30T06:56:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fc000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f36f40aff20 con 0x7f36f415d7e0 2024-05-30T06:56:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36f9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36f40b59d0 0x7f36f413af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36f9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36f40b59d0 0x7f36f413af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35440/0 (socket says 172.21.15.37:35440) 2024-05-30T06:56:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36f9600640 1 -- 172.21.15.37:0/963993942 learned_addr learned my addr 172.21.15.37:0/963993942 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36f8c00640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36f415d350 0x7f36f415f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36fa000640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36f415d7e0 0x7f36f413cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36f9600640 1 -- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36f415d7e0 msgr2=0x7f36f413cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36f9600640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36f415d7e0 0x7f36f413cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36f9600640 1 -- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36f415d350 msgr2=0x7f36f415f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36f9600640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36f415d350 0x7f36f415f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:23.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36f9600640 1 -- 172.21.15.37:0/963993942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f41f4db0 con 0x7f36f40b59d0 2024-05-30T06:56:23.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.564+0000 7f36f9600640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36f40b59d0 0x7f36f413af90 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f36e800d800 tx=0x7f36e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:23.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.568+0000 7f36f1600640 1 -- 172.21.15.37:0/963993942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e800b6c0 con 0x7f36f40b59d0 2024-05-30T06:56:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.568+0000 7f36f1600640 1 -- 172.21.15.37:0/963993942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e8019070 con 0x7f36f40b59d0 2024-05-30T06:56:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.568+0000 7f36f1600640 1 -- 172.21.15.37:0/963993942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e800bae0 con 0x7f36f40b59d0 2024-05-30T06:56:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.568+0000 7f36fc000640 1 -- 172.21.15.37:0/963993942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f41f50f0 con 0x7f36f40b59d0 2024-05-30T06:56:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.568+0000 7f36fc000640 1 -- 172.21.15.37:0/963993942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f41f5930 con 0x7f36f40b59d0 2024-05-30T06:56:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.568+0000 7f36fc000640 1 -- 172.21.15.37:0/963993942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f4068bc0 con 0x7f36f40b59d0 2024-05-30T06:56:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.568+0000 7f36f1600640 1 -- 172.21.15.37:0/963993942 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) ==== 89976+0+0 (secure 0 0 0) 0x7f36e800bc80 con 0x7f36f40b59d0 2024-05-30T06:56:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.568+0000 7f36f1600640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f36d4069970 0x7f36d406be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.568+0000 7f36f1600640 1 -- 172.21.15.37:0/963993942 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f36e8085f30 con 0x7f36f40b59d0 2024-05-30T06:56:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.568+0000 7f36f8c00640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f36d4069970 0x7f36d406be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.572+0000 7f36f8c00640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f36d4069970 0x7f36d406be30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f36e0001810 tx=0x7f36e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:23.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.572+0000 7f36f1600640 1 -- 172.21.15.37:0/963993942 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f36e808d030 con 0x7f36f40b59d0 2024-05-30T06:56:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.580+0000 7f36f1600640 1 -- 172.21.15.37:0/963993942 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7f36e8053b50 con 0x7f36f40b59d0 2024-05-30T06:56:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:23.780+0000 7f36fc000640 1 -- 172.21.15.37:0/963993942 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f36f40ad8d0 con 0x7f36d4069970 2024-05-30T06:56:25.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:25.164+0000 7f36f1600640 1 -- 172.21.15.37:0/963993942 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f36f40ad8d0 con 0x7f36d4069970 2024-05-30T06:56:25.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:25.168+0000 7f36fc000640 1 -- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f36d4069970 msgr2=0x7f36d406be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:25.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:25.168+0000 7f36fc000640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f36d4069970 0x7f36d406be30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f36e0001810 tx=0x7f36e0009040 comp rx=0 tx=0).stop 2024-05-30T06:56:25.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:25.168+0000 7f36fc000640 1 -- 172.21.15.37:0/963993942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36f40b59d0 msgr2=0x7f36f413af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:25.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:25.168+0000 7f36fc000640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36f40b59d0 0x7f36f413af90 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f36e800d800 tx=0x7f36e800dcc0 comp rx=0 tx=0).stop 2024-05-30T06:56:25.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:25.168+0000 7f36fc000640 1 -- 172.21.15.37:0/963993942 shutdown_connections 2024-05-30T06:56:25.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:25.168+0000 7f36fc000640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36f415d7e0 0x7f36f413cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:25.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:25.168+0000 7f36fc000640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f36d4069970 0x7f36d406be30 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:25.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:25.168+0000 7f36fc000640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36f415d350 0x7f36f415f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:25.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:25.168+0000 7f36fc000640 1 --2- 172.21.15.37:0/963993942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36f40b59d0 0x7f36f413af90 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:25.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:25.168+0000 7f36fc000640 1 -- 172.21.15.37:0/963993942 >> 172.21.15.37:0/963993942 conn(0x7f36f406bf60 msgr2=0x7f36f4140b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:25.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:25.168+0000 7f36fc000640 1 -- 172.21.15.37:0/963993942 shutdown_connections 2024-05-30T06:56:25.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:25.168+0000 7f36fc000640 1 -- 172.21.15.37:0/963993942 wait complete. 2024-05-30T06:56:30.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:56:30.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.340+0000 7fb551e00640 1 Processor -- start 2024-05-30T06:56:30.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.340+0000 7fb551e00640 1 -- start start 2024-05-30T06:56:30.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb551e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb54c09b170 0x7fb54c06cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:30.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb551e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb54c0d10f0 0x7fb54c0d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:30.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb551e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb54c15f970 con 0x7fb54c0b39f0 2024-05-30T06:56:30.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb551e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb54c0d0c60 con 0x7fb54c0d10f0 2024-05-30T06:56:30.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb551e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb54c15fc50 con 0x7fb54c09b170 2024-05-30T06:56:30.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb54b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb54c0d10f0 0x7fb54c0d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:30.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb54aa00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb54c0b39f0 0x7fb54c09aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54052/0 (socket says 172.21.15.37:54052) 2024-05-30T06:56:30.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb54aa00640 1 -- 172.21.15.37:0/2012617886 learned_addr learned my addr 172.21.15.37:0/2012617886 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:56:30.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb543e00640 1 --2- 172.21.15.37:0/2012617886 >> v2:172.21.15.105:3300/0 conn(0x7fb54c09b170 0x7fb54c06cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:30.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb54b400640 1 -- 172.21.15.37:0/2012617886 >> v2:172.21.15.105:3300/0 conn(0x7fb54c09b170 msgr2=0x7fb54c06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:30.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb54b400640 1 --2- 172.21.15.37:0/2012617886 >> v2:172.21.15.105:3300/0 conn(0x7fb54c09b170 0x7fb54c06cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb54b400640 1 -- 172.21.15.37:0/2012617886 >> v1:172.21.15.37:6789/0 conn(0x7fb54c0b39f0 legacy=0x7fb54c09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:30.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb54a000640 1 -- 172.21.15.37:0/2012617886 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4068862225 0 0) 0x7fb54c15f970 con 0x7fb54c0b39f0 2024-05-30T06:56:30.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb54b400640 1 -- 172.21.15.37:0/2012617886 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54c15ff30 con 0x7fb54c0d10f0 2024-05-30T06:56:30.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.344+0000 7fb543e00640 1 --2- 172.21.15.37:0/2012617886 >> v2:172.21.15.105:3300/0 conn(0x7fb54c09b170 0x7fb54c06cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:56:30.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb54b400640 1 --2- 172.21.15.37:0/2012617886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0d10f0 0x7fb54c0d1580 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0740a0 tx=0x7fb54401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7312da886948c33d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:30.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb54a000640 1 -- 172.21.15.37:0/2012617886 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5440b2070 con 0x7fb54c0d10f0 2024-05-30T06:56:30.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb54a000640 1 -- 172.21.15.37:0/2012617886 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5440a59e0 con 0x7fb54c0d10f0 2024-05-30T06:56:30.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb54a000640 1 -- 172.21.15.37:0/2012617886 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5440a5db0 con 0x7fb54c0d10f0 2024-05-30T06:56:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb551e00640 1 -- 172.21.15.37:0/2012617886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0d10f0 msgr2=0x7fb54c0d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb551e00640 1 --2- 172.21.15.37:0/2012617886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0d10f0 0x7fb54c0d1580 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0740a0 tx=0x7fb54401c900 comp rx=0 tx=0).stop 2024-05-30T06:56:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb551e00640 1 -- 172.21.15.37:0/2012617886 shutdown_connections 2024-05-30T06:56:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb551e00640 1 --2- 172.21.15.37:0/2012617886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0d10f0 0x7fb54c0d1580 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb551e00640 1 --2- 172.21.15.37:0/2012617886 >> v2:172.21.15.105:3300/0 conn(0x7fb54c09b170 0x7fb54c06cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb551e00640 1 -- 172.21.15.37:0/2012617886 >> 172.21.15.37:0/2012617886 conn(0x7fb54c0b4100 msgr2=0x7fb54c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb551e00640 1 -- 172.21.15.37:0/2012617886 shutdown_connections 2024-05-30T06:56:30.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb551e00640 1 -- 172.21.15.37:0/2012617886 wait complete. 2024-05-30T06:56:30.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb551e00640 1 Processor -- start 2024-05-30T06:56:30.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.348+0000 7fb551e00640 1 -- start start 2024-05-30T06:56:30.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb551e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb54c09b170 0x7fb54c15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:30.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb551e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0b39f0 0x7fb54c15a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:30.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb551e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c0d10f0 0x7fb54c1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:30.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb551e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c15e400 con 0x7fb54c0b39f0 2024-05-30T06:56:30.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb551e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c15e280 con 0x7fb54c0d10f0 2024-05-30T06:56:30.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb551e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb54c15e580 con 0x7fb54c09b170 2024-05-30T06:56:30.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb543e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0b39f0 0x7fb54c15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:30.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb543e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0b39f0 0x7fb54c15a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54558/0 (socket says 172.21.15.37:54558) 2024-05-30T06:56:30.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb543e00640 1 -- 172.21.15.37:0/1493158295 learned_addr learned my addr 172.21.15.37:0/1493158295 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:30.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb54b400640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c0d10f0 0x7fb54c1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:30.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb54aa00640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb54c09b170 0x7fb54c15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:30.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb543e00640 1 -- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb54c09b170 msgr2=0x7fb54c15dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:30.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb543e00640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb54c09b170 0x7fb54c15dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb543e00640 1 -- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c0d10f0 msgr2=0x7fb54c1563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:30.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb543e00640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c0d10f0 0x7fb54c1563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb543e00640 1 -- 172.21.15.37:0/1493158295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54c0c9930 con 0x7fb54c0b39f0 2024-05-30T06:56:30.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb54b400640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c0d10f0 0x7fb54c1563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:56:30.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb543e00640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0b39f0 0x7fb54c15a250 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb53400c7c0 tx=0x7fb53400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:30.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb543400640 1 -- 172.21.15.37:0/1493158295 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb534007a30 con 0x7fb54c0b39f0 2024-05-30T06:56:30.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb543400640 1 -- 172.21.15.37:0/1493158295 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb534007bd0 con 0x7fb54c0b39f0 2024-05-30T06:56:30.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb543400640 1 -- 172.21.15.37:0/1493158295 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5340113f0 con 0x7fb54c0b39f0 2024-05-30T06:56:30.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb551e00640 1 -- 172.21.15.37:0/1493158295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb54c0c9c10 con 0x7fb54c0b39f0 2024-05-30T06:56:30.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb551e00640 1 -- 172.21.15.37:0/1493158295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb54c1568f0 con 0x7fb54c0b39f0 2024-05-30T06:56:30.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb551e00640 1 -- 172.21.15.37:0/1493158295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb54c0c96c0 con 0x7fb54c0b39f0 2024-05-30T06:56:30.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.352+0000 7fb543400640 1 -- 172.21.15.37:0/1493158295 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7fb534011590 con 0x7fb54c0b39f0 2024-05-30T06:56:30.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.356+0000 7fb543400640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb528069a90 0x7fb52806bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:30.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.356+0000 7fb543400640 1 -- 172.21.15.37:0/1493158295 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fb534085950 con 0x7fb54c0b39f0 2024-05-30T06:56:30.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.356+0000 7fb54aa00640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb528069a90 0x7fb52806bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:30.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.356+0000 7fb54aa00640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb528069a90 0x7fb52806bf50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb53c000f70 tx=0x7fb53c007b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:30.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.360+0000 7fb543400640 1 -- 172.21.15.37:0/1493158295 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb534015020 con 0x7fb54c0b39f0 2024-05-30T06:56:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.580+0000 7fb551e00640 1 -- 172.21.15.37:0/1493158295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb54c0cc530 con 0x7fb54c0b39f0 2024-05-30T06:56:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.580+0000 7fb543400640 1 -- 172.21.15.37:0/1493158295 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2112 (secure 0 0 0) 0x7fb54c0cc530 con 0x7fb54c0b39f0 2024-05-30T06:56:30.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:30.585 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:56:30.585 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:56:30.585 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:56:30.585 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:56:30.585 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:56:30.585 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 884, 2024-05-30T06:56:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:56:30.587 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:56:30.587 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:56:30.587 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:56:30.587 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:30.587 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:56:30.587 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 102, 2024-05-30T06:56:30.587 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:56:30.587 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:56:30.587 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:56:30.587 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:56:30.587 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:56:30.587 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:56:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:56:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:56:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:56:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:56:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:56:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:56:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 799, 2024-05-30T06:56:30.589 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 3222069675, 2024-05-30T06:56:30.589 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 7340441600, 2024-05-30T06:56:30.589 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 765753671680, 2024-05-30T06:56:30.589 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:56:30.589 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 426, 2024-05-30T06:56:30.589 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 27612736, 2024-05-30T06:56:30.589 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:56:30.589 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 9 2024-05-30T06:56:30.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:30.589 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:56:30.589 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 65, 2024-05-30T06:56:30.589 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7, 2024-05-30T06:56:30.590 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:56:30.590 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:56:30.590 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:56:30.590 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:56:30.590 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:30.590 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 7, 2024-05-30T06:56:30.590 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:56:30.590 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:56:30.590 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:56:30.590 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 8538 2024-05-30T06:56:30.590 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:30.590 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:56:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:56:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:56:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:56:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:56:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:56:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:56:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:56:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:56:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:30.591 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:56:30.592 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 14, 2024-05-30T06:56:30.592 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:54:52.931035+0000", 2024-05-30T06:56:30.592 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:56:30.592 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:30.592 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:56:30.592 INFO:teuthology.orchestra.run.smithi037.stdout: "b75acea7-13d8-44df-a48a-31c3fb5462f9": { 2024-05-30T06:56:30.592 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 28.0 seconds before exiting (3s)\n [============================] ", 2024-05-30T06:56:30.592 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:56:30.592 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:56:30.592 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:30.592 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:30.592 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:56:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.584+0000 7fb551e00640 1 -- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb528069a90 msgr2=0x7fb52806bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.584+0000 7fb551e00640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb528069a90 0x7fb52806bf50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb53c000f70 tx=0x7fb53c007b80 comp rx=0 tx=0).stop 2024-05-30T06:56:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.584+0000 7fb551e00640 1 -- 172.21.15.37:0/1493158295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0b39f0 msgr2=0x7fb54c15a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.584+0000 7fb551e00640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0b39f0 0x7fb54c15a250 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb53400c7c0 tx=0x7fb53400cc80 comp rx=0 tx=0).stop 2024-05-30T06:56:30.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.584+0000 7fb551e00640 1 -- 172.21.15.37:0/1493158295 shutdown_connections 2024-05-30T06:56:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.584+0000 7fb551e00640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb528069a90 0x7fb52806bf50 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.584+0000 7fb551e00640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb54c0d10f0 0x7fb54c1563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.584+0000 7fb551e00640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0b39f0 0x7fb54c15a250 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.584+0000 7fb551e00640 1 --2- 172.21.15.37:0/1493158295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb54c09b170 0x7fb54c15dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.584+0000 7fb551e00640 1 -- 172.21.15.37:0/1493158295 >> 172.21.15.37:0/1493158295 conn(0x7fb54c0b4100 msgr2=0x7fb54c0b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.584+0000 7fb551e00640 1 -- 172.21.15.37:0/1493158295 shutdown_connections 2024-05-30T06:56:30.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.584+0000 7fb551e00640 1 -- 172.21.15.37:0/1493158295 wait complete. 2024-05-30T06:56:30.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:56:30.606 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -lh volumes/_nogroup/ss1clone1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa 2024-05-30T06:56:30.606 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:56:30.616 INFO:teuthology.orchestra.run.smithi037.stderr:ls: cannot access 'volumes/_nogroup/ss1clone1/2fc22948-7c02-4a95-b29c-c5b9bc94cfaa': No such file or directory 2024-05-30T06:56:30.616 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-30T06:56:30.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:56:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df4800640 1 Processor -- start 2024-05-30T06:56:30.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df4800640 1 -- start start 2024-05-30T06:56:30.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df4800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5dec0cd440 0x7f5dec06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:30.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df4800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dec06f5a0 0x7f5dec0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:30.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df4800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dec15f310 con 0x7f5dec155da0 2024-05-30T06:56:30.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df4800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5dec15f5f0 con 0x7f5dec0cd440 2024-05-30T06:56:30.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df4800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5dec15f8d0 con 0x7f5dec06f5a0 2024-05-30T06:56:30.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df1400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5dec0cd440 0x7f5dec06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:30.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df1400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5dec0cd440 0x7f5dec06f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54574/0 (socket says 172.21.15.37:54574) 2024-05-30T06:56:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df1400640 1 -- 172.21.15.37:0/2815375861 learned_addr learned my addr 172.21.15.37:0/2815375861 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df2800640 1 --2- 172.21.15.37:0/2815375861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dec06f5a0 0x7f5dec0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df1400640 1 -- 172.21.15.37:0/2815375861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dec06f5a0 msgr2=0x7f5dec0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df1400640 1 --2- 172.21.15.37:0/2815375861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dec06f5a0 0x7f5dec0b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df1400640 1 -- 172.21.15.37:0/2815375861 >> v1:172.21.15.105:6789/0 conn(0x7f5dec155da0 legacy=0x7f5dec0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df1400640 1 -- 172.21.15.37:0/2815375861 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec15fbb0 con 0x7f5dec0cd440 2024-05-30T06:56:30.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.804+0000 7f5df2800640 1 --2- 172.21.15.37:0/2815375861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dec06f5a0 0x7f5dec0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:56:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.808+0000 7f5df1400640 1 --2- 172.21.15.37:0/2815375861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec0cd440 0x7f5dec06f060 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009870 tx=0x7f5ddc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d968db01807ad1e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.808+0000 7f5df0a00640 1 -- 172.21.15.37:0/2815375861 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0b0070 con 0x7f5dec0cd440 2024-05-30T06:56:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.808+0000 7f5df0a00640 1 -- 172.21.15.37:0/2815375861 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ddc004230 con 0x7f5dec0cd440 2024-05-30T06:56:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.808+0000 7f5df0a00640 1 -- 172.21.15.37:0/2815375861 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc003620 con 0x7f5dec0cd440 2024-05-30T06:56:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.808+0000 7f5df4800640 1 -- 172.21.15.37:0/2815375861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec0cd440 msgr2=0x7f5dec06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.808+0000 7f5df4800640 1 --2- 172.21.15.37:0/2815375861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec0cd440 0x7f5dec06f060 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009870 tx=0x7f5ddc01c440 comp rx=0 tx=0).stop 2024-05-30T06:56:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.808+0000 7f5df4800640 1 -- 172.21.15.37:0/2815375861 shutdown_connections 2024-05-30T06:56:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.808+0000 7f5df4800640 1 --2- 172.21.15.37:0/2815375861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dec06f5a0 0x7f5dec0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.808+0000 7f5df4800640 1 --2- 172.21.15.37:0/2815375861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec0cd440 0x7f5dec06f060 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.808+0000 7f5df4800640 1 -- 172.21.15.37:0/2815375861 >> 172.21.15.37:0/2815375861 conn(0x7f5dec06bf60 msgr2=0x7f5dec0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.808+0000 7f5df4800640 1 -- 172.21.15.37:0/2815375861 shutdown_connections 2024-05-30T06:56:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.808+0000 7f5df4800640 1 -- 172.21.15.37:0/2815375861 wait complete. 2024-05-30T06:56:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.808+0000 7f5df4800640 1 Processor -- start 2024-05-30T06:56:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df4800640 1 -- start start 2024-05-30T06:56:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df4800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dec06f5a0 0x7f5dec151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df4800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dec155da0 0x7f5dec0b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df4800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec0b18c0 0x7f5dec158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df4800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec06f9b0 con 0x7f5dec0b18c0 2024-05-30T06:56:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df4800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec0b46f0 con 0x7f5dec06f5a0 2024-05-30T06:56:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df4800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5dec06df50 con 0x7f5dec155da0 2024-05-30T06:56:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec0b18c0 0x7f5dec158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec0b18c0 0x7f5dec158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54584/0 (socket says 172.21.15.37:54584) 2024-05-30T06:56:30.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df2800640 1 -- 172.21.15.37:0/610332294 learned_addr learned my addr 172.21.15.37:0/610332294 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:30.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df1400640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dec155da0 0x7f5dec0b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:30.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df1e00640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dec06f5a0 0x7f5dec151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:30.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df2800640 1 -- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dec155da0 msgr2=0x7f5dec0b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:30.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df2800640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dec155da0 0x7f5dec0b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df2800640 1 -- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dec06f5a0 msgr2=0x7f5dec151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df2800640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dec06f5a0 0x7f5dec151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df2800640 1 -- 172.21.15.37:0/610332294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dec15b920 con 0x7f5dec0b18c0 2024-05-30T06:56:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df1e00640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dec06f5a0 0x7f5dec151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:56:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df2800640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec0b18c0 0x7f5dec158690 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009ed0 tx=0x7f5de80085d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5de6000640 1 -- 172.21.15.37:0/610332294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de800b360 con 0x7f5dec0b18c0 2024-05-30T06:56:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5de6000640 1 -- 172.21.15.37:0/610332294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de8008c80 con 0x7f5dec0b18c0 2024-05-30T06:56:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5de6000640 1 -- 172.21.15.37:0/610332294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8003be0 con 0x7f5dec0b18c0 2024-05-30T06:56:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df4800640 1 -- 172.21.15.37:0/610332294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dec15bc00 con 0x7f5dec0b18c0 2024-05-30T06:56:30.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df4800640 1 -- 172.21.15.37:0/610332294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dec15c1c0 con 0x7f5dec0b18c0 2024-05-30T06:56:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.812+0000 7f5df4800640 1 -- 172.21.15.37:0/610332294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dec068bc0 con 0x7f5dec0b18c0 2024-05-30T06:56:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.816+0000 7f5de6000640 1 -- 172.21.15.37:0/610332294 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7f5de8004030 con 0x7f5dec0b18c0 2024-05-30T06:56:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.816+0000 7f5de6000640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dd0069ac0 0x7f5dd006bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.816+0000 7f5de6000640 1 -- 172.21.15.37:0/610332294 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f5de8085510 con 0x7f5dec0b18c0 2024-05-30T06:56:30.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.816+0000 7f5df1e00640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dd0069ac0 0x7f5dd006bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:30.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.816+0000 7f5df1e00640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dd0069ac0 0x7f5dd006bf80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5de0000f70 tx=0x7f5de0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:30.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:30.820+0000 7f5de6000640 1 -- 172.21.15.37:0/610332294 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5de8056ee0 con 0x7f5dec0b18c0 2024-05-30T06:56:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.012+0000 7f5df4800640 1 -- 172.21.15.37:0/610332294 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f5dec0b6790 con 0x7f5dd0069ac0 2024-05-30T06:56:31.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.012+0000 7f5de6000640 1 -- 172.21.15.37:0/610332294 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f5dec0b6790 con 0x7f5dd0069ac0 2024-05-30T06:56:31.017 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:56:31.017 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:31.017 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:56:31.017 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:31.017 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:56:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.016+0000 7f5df4800640 1 -- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dd0069ac0 msgr2=0x7f5dd006bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.016+0000 7f5df4800640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dd0069ac0 0x7f5dd006bf80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5de0000f70 tx=0x7f5de0009040 comp rx=0 tx=0).stop 2024-05-30T06:56:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.016+0000 7f5df4800640 1 -- 172.21.15.37:0/610332294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec0b18c0 msgr2=0x7f5dec158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.016+0000 7f5df4800640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec0b18c0 0x7f5dec158690 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009ed0 tx=0x7f5de80085d0 comp rx=0 tx=0).stop 2024-05-30T06:56:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.016+0000 7f5df4800640 1 -- 172.21.15.37:0/610332294 shutdown_connections 2024-05-30T06:56:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.016+0000 7f5df4800640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dec0b18c0 0x7f5dec158690 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.016+0000 7f5df4800640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dec155da0 0x7f5dec0b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.016+0000 7f5df4800640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5dd0069ac0 0x7f5dd006bf80 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.016+0000 7f5df4800640 1 --2- 172.21.15.37:0/610332294 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dec06f5a0 0x7f5dec151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.016+0000 7f5df4800640 1 -- 172.21.15.37:0/610332294 >> 172.21.15.37:0/610332294 conn(0x7f5dec06bf60 msgr2=0x7f5dec1652a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.016+0000 7f5df4800640 1 -- 172.21.15.37:0/610332294 shutdown_connections 2024-05-30T06:56:31.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.016+0000 7f5df4800640 1 -- 172.21.15.37:0/610332294 wait complete. 2024-05-30T06:56:31.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:56:31.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c6a000640 1 Processor -- start 2024-05-30T06:56:31.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c6a000640 1 -- start start 2024-05-30T06:56:31.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c6a000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2c6406f9a0 0x7f2c640b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:31.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c6a000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c6415c8f0 con 0x7f2c640b2ec0 2024-05-30T06:56:31.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c6a000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c640ccc80 con 0x7f2c64155e60 2024-05-30T06:56:31.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c6a000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2c640ccff0 con 0x7f2c6406f9a0 2024-05-30T06:56:31.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c63e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2c640b2ec0 0x7f2c640cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54068/0 (socket says 172.21.15.37:54068) 2024-05-30T06:56:31.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c63e00640 1 -- 172.21.15.37:0/1039070235 learned_addr learned my addr 172.21.15.37:0/1039070235 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:56:31.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c5be00640 1 --2- 172.21.15.37:0/1039070235 >> v2:172.21.15.105:3300/0 conn(0x7f2c6406f9a0 0x7f2c640b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:31.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c62a00640 1 -- 172.21.15.37:0/1039070235 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1107195235 0 0) 0x7f2c6415c8f0 con 0x7f2c640b2ec0 2024-05-30T06:56:31.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c62a00640 1 -- 172.21.15.37:0/1039070235 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c48003530 con 0x7f2c640b2ec0 2024-05-30T06:56:31.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c5be00640 1 -- 172.21.15.37:0/1039070235 >> v1:172.21.15.105:6789/0 conn(0x7f2c64155e60 legacy=0x7f2c640cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:31.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c5be00640 1 -- 172.21.15.37:0/1039070235 >> v1:172.21.15.37:6789/0 conn(0x7f2c640b2ec0 legacy=0x7f2c640cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:31.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.176+0000 7f2c5be00640 1 -- 172.21.15.37:0/1039070235 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6415cbd0 con 0x7f2c6406f9a0 2024-05-30T06:56:31.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.180+0000 7f2c5be00640 1 --2- 172.21.15.37:0/1039070235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c6406f9a0 0x7f2c640b36a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0097c0 tx=0x7f2c4c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23ace7624a62b038 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:31.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.180+0000 7f2c62a00640 1 -- 172.21.15.37:0/1039070235 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c0b0070 con 0x7f2c6406f9a0 2024-05-30T06:56:31.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.180+0000 7f2c62a00640 1 -- 172.21.15.37:0/1039070235 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4c0ab600 con 0x7f2c6406f9a0 2024-05-30T06:56:31.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.180+0000 7f2c62a00640 1 -- 172.21.15.37:0/1039070235 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c0ab9d0 con 0x7f2c6406f9a0 2024-05-30T06:56:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.180+0000 7f2c6a000640 1 -- 172.21.15.37:0/1039070235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c6406f9a0 msgr2=0x7f2c640b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.180+0000 7f2c6a000640 1 --2- 172.21.15.37:0/1039070235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c6406f9a0 0x7f2c640b36a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0097c0 tx=0x7f2c4c01c4a0 comp rx=0 tx=0).stop 2024-05-30T06:56:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.180+0000 7f2c6a000640 1 -- 172.21.15.37:0/1039070235 shutdown_connections 2024-05-30T06:56:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.180+0000 7f2c6a000640 1 --2- 172.21.15.37:0/1039070235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c6406f9a0 0x7f2c640b36a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.180+0000 7f2c6a000640 1 -- 172.21.15.37:0/1039070235 >> 172.21.15.37:0/1039070235 conn(0x7f2c640b23a0 msgr2=0x7f2c640b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:31.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.180+0000 7f2c6a000640 1 -- 172.21.15.37:0/1039070235 shutdown_connections 2024-05-30T06:56:31.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.180+0000 7f2c6a000640 1 -- 172.21.15.37:0/1039070235 wait complete. 2024-05-30T06:56:31.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c6a000640 1 Processor -- start 2024-05-30T06:56:31.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c6a000640 1 -- start start 2024-05-30T06:56:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c6a000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c6406f9a0 0x7f2c64154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c6a000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c640b2ec0 0x7f2c640b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c6a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c64155e60 0x7f2c64147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c6a000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c64169a00 con 0x7f2c64155e60 2024-05-30T06:56:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c6a000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c64169880 con 0x7f2c6406f9a0 2024-05-30T06:56:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c6a000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2c64169b80 con 0x7f2c640b2ec0 2024-05-30T06:56:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c63e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c64155e60 0x7f2c64147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c63e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c64155e60 0x7f2c64147d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54594/0 (socket says 172.21.15.37:54594) 2024-05-30T06:56:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c63e00640 1 -- 172.21.15.37:0/819393948 learned_addr learned my addr 172.21.15.37:0/819393948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c63400640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c6406f9a0 0x7f2c64154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:31.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c5be00640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c640b2ec0 0x7f2c640b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c63e00640 1 -- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c640b2ec0 msgr2=0x7f2c640b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c63e00640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c640b2ec0 0x7f2c640b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c63e00640 1 -- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c6406f9a0 msgr2=0x7f2c64154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c63e00640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c6406f9a0 0x7f2c64154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c63e00640 1 -- 172.21.15.37:0/819393948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c640cc7c0 con 0x7f2c64155e60 2024-05-30T06:56:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c63e00640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c64155e60 0x7f2c64147d60 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00cb40 tx=0x7f2c5c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c5b400640 1 -- 172.21.15.37:0/819393948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c017070 con 0x7f2c64155e60 2024-05-30T06:56:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c5b400640 1 -- 172.21.15.37:0/819393948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c5c00aca0 con 0x7f2c64155e60 2024-05-30T06:56:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c6a000640 1 -- 172.21.15.37:0/819393948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c64154a90 con 0x7f2c64155e60 2024-05-30T06:56:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c5b400640 1 -- 172.21.15.37:0/819393948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c012620 con 0x7f2c64155e60 2024-05-30T06:56:31.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c6a000640 1 -- 172.21.15.37:0/819393948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c64155050 con 0x7f2c64155e60 2024-05-30T06:56:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.184+0000 7f2c6a000640 1 -- 172.21.15.37:0/819393948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c64068b20 con 0x7f2c64155e60 2024-05-30T06:56:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.188+0000 7f2c5b400640 1 -- 172.21.15.37:0/819393948 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7f2c5c01a070 con 0x7f2c64155e60 2024-05-30T06:56:31.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.188+0000 7f2c5b400640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2c40069a90 0x7f2c4006bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:31.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.188+0000 7f2c5b400640 1 -- 172.21.15.37:0/819393948 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f2c5c085460 con 0x7f2c64155e60 2024-05-30T06:56:31.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.188+0000 7f2c63400640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2c40069a90 0x7f2c4006bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:31.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.188+0000 7f2c63400640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2c40069a90 0x7f2c4006bf50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2c54001770 tx=0x7f2c54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:31.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.192+0000 7f2c5b400640 1 -- 172.21.15.37:0/819393948 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2c5c056ed0 con 0x7f2c64155e60 2024-05-30T06:56:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.416+0000 7f2c6a000640 1 -- 172.21.15.37:0/819393948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2c6406f780 con 0x7f2c64155e60 2024-05-30T06:56:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.416+0000 7f2c5b400640 1 -- 172.21.15.37:0/819393948 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2112 (secure 0 0 0) 0x7f2c5c05b1d0 con 0x7f2c64155e60 2024-05-30T06:56:31.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:31.420 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:56:31.420 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:56:31.420 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:56:31.420 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:56:31.420 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:56:31.420 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:56:31.420 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:31.420 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:56:31.420 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:56:31.421 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:56:31.421 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:56:31.421 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:56:31.421 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:31.421 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:56:31.421 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:56:31.421 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:56:31.421 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:56:31.421 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:31.421 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 885, 2024-05-30T06:56:31.421 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:56:31.422 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:56:31.422 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:56:31.422 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:56:31.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:31.422 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:56:31.422 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 102, 2024-05-30T06:56:31.422 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:56:31.422 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:56:31.422 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:56:31.422 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:56:31.422 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:56:31.423 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:56:31.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:31.423 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:56:31.423 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:56:31.423 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:31.423 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:56:31.423 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:56:31.423 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:31.423 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:31.423 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:56:31.423 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:56:31.423 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 799, 2024-05-30T06:56:31.423 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 3222069675, 2024-05-30T06:56:31.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 7340441600, 2024-05-30T06:56:31.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 765753671680, 2024-05-30T06:56:31.424 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:56:31.424 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 426, 2024-05-30T06:56:31.424 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 27612736, 2024-05-30T06:56:31.424 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:56:31.424 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 9 2024-05-30T06:56:31.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:31.424 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:56:31.424 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 65, 2024-05-30T06:56:31.424 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7, 2024-05-30T06:56:31.424 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:56:31.425 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:56:31.425 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:56:31.425 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:56:31.425 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:31.425 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 7, 2024-05-30T06:56:31.425 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:56:31.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:56:31.425 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:56:31.425 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 8538 2024-05-30T06:56:31.425 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:31.425 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:31.425 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:56:31.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 14, 2024-05-30T06:56:31.426 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:54:52.931035+0000", 2024-05-30T06:56:31.427 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:56:31.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:31.427 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:56:31.427 INFO:teuthology.orchestra.run.smithi037.stdout: "b75acea7-13d8-44df-a48a-31c3fb5462f9": { 2024-05-30T06:56:31.427 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 28.0 seconds before exiting (3s)\n [============================] ", 2024-05-30T06:56:31.427 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:56:31.427 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:56:31.427 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:31.427 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:31.427 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:56:31.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.420+0000 7f2c6a000640 1 -- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2c40069a90 msgr2=0x7f2c4006bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:31.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.420+0000 7f2c6a000640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2c40069a90 0x7f2c4006bf50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2c54001770 tx=0x7f2c54009040 comp rx=0 tx=0).stop 2024-05-30T06:56:31.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.420+0000 7f2c6a000640 1 -- 172.21.15.37:0/819393948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c64155e60 msgr2=0x7f2c64147d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:31.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.420+0000 7f2c6a000640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c64155e60 0x7f2c64147d60 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00cb40 tx=0x7f2c5c00a060 comp rx=0 tx=0).stop 2024-05-30T06:56:31.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.420+0000 7f2c6a000640 1 -- 172.21.15.37:0/819393948 shutdown_connections 2024-05-30T06:56:31.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.420+0000 7f2c6a000640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c64155e60 0x7f2c64147d60 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:31.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.420+0000 7f2c6a000640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c640b2ec0 0x7f2c640b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:31.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.420+0000 7f2c6a000640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2c40069a90 0x7f2c4006bf50 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:31.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.420+0000 7f2c6a000640 1 --2- 172.21.15.37:0/819393948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c6406f9a0 0x7f2c64154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:31.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.420+0000 7f2c6a000640 1 -- 172.21.15.37:0/819393948 >> 172.21.15.37:0/819393948 conn(0x7f2c640b23a0 msgr2=0x7f2c640cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:31.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.420+0000 7f2c6a000640 1 -- 172.21.15.37:0/819393948 shutdown_connections 2024-05-30T06:56:31.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:31.420+0000 7f2c6a000640 1 -- 172.21.15.37:0/819393948 wait complete. 2024-05-30T06:56:35.629 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:56:35.633 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:56:36.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:56:36.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa3e00640 1 Processor -- start 2024-05-30T06:56:36.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa3e00640 1 -- start start 2024-05-30T06:56:36.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa9c0b55a0 0x7faa9c0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:36.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa3e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa9c15fb30 0x7faa9c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:36.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa3e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa9c162f70 con 0x7faa9c06d080 2024-05-30T06:56:36.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa3e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7faa9c0b5ec0 con 0x7faa9c0b55a0 2024-05-30T06:56:36.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa3e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa9c163210 con 0x7faa9c15fb30 2024-05-30T06:56:36.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa1400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa9c0b55a0 0x7faa9c0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:36.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa1400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa9c0b55a0 0x7faa9c0b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54608/0 (socket says 172.21.15.37:54608) 2024-05-30T06:56:36.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa1400640 1 -- 172.21.15.37:0/976429455 learned_addr learned my addr 172.21.15.37:0/976429455 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:36.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa1e00640 1 --2- 172.21.15.37:0/976429455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa9c15fb30 0x7faa9c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:36.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa1400640 1 -- 172.21.15.37:0/976429455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa9c15fb30 msgr2=0x7faa9c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:36.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa1400640 1 --2- 172.21.15.37:0/976429455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa9c15fb30 0x7faa9c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:36.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa1400640 1 -- 172.21.15.37:0/976429455 >> v1:172.21.15.105:6789/0 conn(0x7faa9c06d080 legacy=0x7faa9c0b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:36.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.592+0000 7faaa1400640 1 -- 172.21.15.37:0/976429455 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9c0b4040 con 0x7faa9c0b55a0 2024-05-30T06:56:36.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.596+0000 7faaa1400640 1 --2- 172.21.15.37:0/976429455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9c0b55a0 0x7faa9c0b5980 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7faa90009870 tx=0x7faa9001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40337a8d6698dc35 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:36.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.596+0000 7faa9be00640 1 -- 172.21.15.37:0/976429455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa900b1070 con 0x7faa9c0b55a0 2024-05-30T06:56:36.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.596+0000 7faa9be00640 1 -- 172.21.15.37:0/976429455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa900ac410 con 0x7faa9c0b55a0 2024-05-30T06:56:36.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.596+0000 7faa9be00640 1 -- 172.21.15.37:0/976429455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa900ac7e0 con 0x7faa9c0b55a0 2024-05-30T06:56:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.596+0000 7faaa3e00640 1 -- 172.21.15.37:0/976429455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9c0b55a0 msgr2=0x7faa9c0b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.596+0000 7faaa3e00640 1 --2- 172.21.15.37:0/976429455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9c0b55a0 0x7faa9c0b5980 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7faa90009870 tx=0x7faa9001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:56:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.596+0000 7faaa3e00640 1 -- 172.21.15.37:0/976429455 shutdown_connections 2024-05-30T06:56:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.596+0000 7faaa3e00640 1 --2- 172.21.15.37:0/976429455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa9c15fb30 0x7faa9c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.596+0000 7faaa3e00640 1 --2- 172.21.15.37:0/976429455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9c0b55a0 0x7faa9c0b5980 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.596+0000 7faaa3e00640 1 -- 172.21.15.37:0/976429455 >> 172.21.15.37:0/976429455 conn(0x7faa9c073680 msgr2=0x7faa9c06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.596+0000 7faaa3e00640 1 -- 172.21.15.37:0/976429455 shutdown_connections 2024-05-30T06:56:36.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.596+0000 7faaa3e00640 1 -- 172.21.15.37:0/976429455 wait complete. 2024-05-30T06:56:36.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa3e00640 1 Processor -- start 2024-05-30T06:56:36.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa3e00640 1 -- start start 2024-05-30T06:56:36.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa3e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa9c06d080 0x7faa9c161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:36.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa3e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa9c0b55a0 0x7faa9c06fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:36.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9c15fb30 0x7faa9c161b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa3e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c0b07c0 con 0x7faa9c15fb30 2024-05-30T06:56:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa3e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c0b0640 con 0x7faa9c06d080 2024-05-30T06:56:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa3e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa9c16be60 con 0x7faa9c0b55a0 2024-05-30T06:56:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9c15fb30 0x7faa9c161b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa1400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa9c06d080 0x7faa9c161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9c15fb30 0x7faa9c161b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54612/0 (socket says 172.21.15.37:54612) 2024-05-30T06:56:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa1e00640 1 -- 172.21.15.37:0/3606011028 learned_addr learned my addr 172.21.15.37:0/3606011028 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa0a00640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa9c0b55a0 0x7faa9c06fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa1e00640 1 -- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa9c0b55a0 msgr2=0x7faa9c06fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa1e00640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa9c0b55a0 0x7faa9c06fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa1e00640 1 -- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa9c06d080 msgr2=0x7faa9c161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:36.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa1e00640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa9c06d080 0x7faa9c161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa1e00640 1 -- 172.21.15.37:0/3606011028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9c150f80 con 0x7faa9c15fb30 2024-05-30T06:56:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa1400640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa9c06d080 0x7faa9c161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:56:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faaa1e00640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9c15fb30 0x7faa9c161b40 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7faa94007d20 tx=0x7faa9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:36.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faa99600640 1 -- 172.21.15.37:0/3606011028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94014420 con 0x7faa9c15fb30 2024-05-30T06:56:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.600+0000 7faa99600640 1 -- 172.21.15.37:0/3606011028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa94019070 con 0x7faa9c15fb30 2024-05-30T06:56:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.604+0000 7faa99600640 1 -- 172.21.15.37:0/3606011028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94014820 con 0x7faa9c15fb30 2024-05-30T06:56:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.604+0000 7faaa3e00640 1 -- 172.21.15.37:0/3606011028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9c151260 con 0x7faa9c15fb30 2024-05-30T06:56:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.604+0000 7faaa3e00640 1 -- 172.21.15.37:0/3606011028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa9c160b20 con 0x7faa9c15fb30 2024-05-30T06:56:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.604+0000 7faaa3e00640 1 -- 172.21.15.37:0/3606011028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa9c068b20 con 0x7faa9c15fb30 2024-05-30T06:56:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.604+0000 7faa99600640 1 -- 172.21.15.37:0/3606011028 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7faa940149c0 con 0x7faa9c15fb30 2024-05-30T06:56:36.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.604+0000 7faa99600640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faa7c069a90 0x7faa7c06bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.604+0000 7faa99600640 1 -- 172.21.15.37:0/3606011028 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7faa94085ed0 con 0x7faa9c15fb30 2024-05-30T06:56:36.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.604+0000 7faaa1400640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faa7c069a90 0x7faa7c06bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:36.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.608+0000 7faaa1400640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faa7c069a90 0x7faa7c06bf50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7faa900ae000 tx=0x7faa90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:36.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.608+0000 7faa99600640 1 -- 172.21.15.37:0/3606011028 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faa940578a0 con 0x7faa9c15fb30 2024-05-30T06:56:36.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.828+0000 7faaa3e00640 1 -- 172.21.15.37:0/3606011028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7faa9c06cc30 con 0x7faa9c15fb30 2024-05-30T06:56:36.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.828+0000 7faa99600640 1 -- 172.21.15.37:0/3606011028 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2562 (secure 0 0 0) 0x7faa9405bba0 con 0x7faa9c15fb30 2024-05-30T06:56:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:36.833 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:56:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:56:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:56:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:56:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:56:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:56:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:56:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:56:36.833 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:56:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:56:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:56:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:56:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:56:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:56:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:56:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 891, 2024-05-30T06:56:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:56:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:56:36.834 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 102, 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:36.835 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:56:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:56:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:56:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:56:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 797, 2024-05-30T06:56:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 3222149230, 2024-05-30T06:56:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 7344791552, 2024-05-30T06:56:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 765749321728, 2024-05-30T06:56:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:56:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 767, 2024-05-30T06:56:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 14843, 2024-05-30T06:56:36.836 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 5 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 65, 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7, 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 7, 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:56:36.837 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:56:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 8538 2024-05-30T06:56:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:56:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:56:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:56:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:56:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:56:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:56:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:56:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:56:36.838 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 15, 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:56:32.958320+0000", 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "daemons": { 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "summary": "", 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "c": { 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "start_epoch": 0, 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "start_stamp": "0.000000", 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 0, 2024-05-30T06:56:36.839 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T06:56:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": {}, 2024-05-30T06:56:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "task_status": {} 2024-05-30T06:56:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:56:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: "b75acea7-13d8-44df-a48a-31c3fb5462f9": { 2024-05-30T06:56:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 22.0 seconds before exiting (9s)\n [============================] ", 2024-05-30T06:56:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:56:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:56:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:36.841 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:36.841 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:56:36.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.832+0000 7faaa3e00640 1 -- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faa7c069a90 msgr2=0x7faa7c06bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:36.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.832+0000 7faaa3e00640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faa7c069a90 0x7faa7c06bf50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7faa900ae000 tx=0x7faa90008040 comp rx=0 tx=0).stop 2024-05-30T06:56:36.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.832+0000 7faaa3e00640 1 -- 172.21.15.37:0/3606011028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9c15fb30 msgr2=0x7faa9c161b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:36.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.832+0000 7faaa3e00640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9c15fb30 0x7faa9c161b40 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7faa94007d20 tx=0x7faa9400e4b0 comp rx=0 tx=0).stop 2024-05-30T06:56:36.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.832+0000 7faaa3e00640 1 -- 172.21.15.37:0/3606011028 shutdown_connections 2024-05-30T06:56:36.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.832+0000 7faaa3e00640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa9c15fb30 0x7faa9c161b40 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:36.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.832+0000 7faaa3e00640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa9c0b55a0 0x7faa9c06fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:36.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.832+0000 7faaa3e00640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7faa7c069a90 0x7faa7c06bf50 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:36.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.832+0000 7faaa3e00640 1 --2- 172.21.15.37:0/3606011028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa9c06d080 0x7faa9c161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:36.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.832+0000 7faaa3e00640 1 -- 172.21.15.37:0/3606011028 >> 172.21.15.37:0/3606011028 conn(0x7faa9c073680 msgr2=0x7faa9c157d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:36.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.832+0000 7faaa3e00640 1 -- 172.21.15.37:0/3606011028 shutdown_connections 2024-05-30T06:56:36.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:36.832+0000 7faaa3e00640 1 -- 172.21.15.37:0/3606011028 wait complete. 2024-05-30T06:56:41.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:56:42.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.004+0000 7ff176800640 1 Processor -- start 2024-05-30T06:56:42.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.004+0000 7ff176800640 1 -- start start 2024-05-30T06:56:42.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.004+0000 7ff176800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff17006e000 0x7ff1700ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:42.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.004+0000 7ff176800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff1700cee10 0x7ff17006f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:42.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.004+0000 7ff176800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1700cd120 con 0x7ff17015cd80 2024-05-30T06:56:42.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.004+0000 7ff176800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff1700a9530 con 0x7ff17006e000 2024-05-30T06:56:42.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.004+0000 7ff176800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff1700cd400 con 0x7ff1700cee10 2024-05-30T06:56:42.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.004+0000 7ff16f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff17006e000 0x7ff1700ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:42.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.004+0000 7ff166a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff17015cd80 0x7ff1700ce700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35322/0 (socket says 172.21.15.37:35322) 2024-05-30T06:56:42.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.004+0000 7ff166a00640 1 -- 172.21.15.37:0/2446273113 learned_addr learned my addr 172.21.15.37:0/2446273113 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:56:42.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.004+0000 7ff16fe00640 1 --2- 172.21.15.37:0/2446273113 >> v2:172.21.15.105:3300/0 conn(0x7ff1700cee10 0x7ff17006f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:42.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff16f400640 1 -- 172.21.15.37:0/2446273113 >> v2:172.21.15.105:3300/0 conn(0x7ff1700cee10 msgr2=0x7ff17006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:42.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff16f400640 1 --2- 172.21.15.37:0/2446273113 >> v2:172.21.15.105:3300/0 conn(0x7ff1700cee10 0x7ff17006f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:42.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff16f400640 1 -- 172.21.15.37:0/2446273113 >> v1:172.21.15.37:6789/0 conn(0x7ff17015cd80 legacy=0x7ff1700ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:42.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff16f400640 1 -- 172.21.15.37:0/2446273113 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1700cd6e0 con 0x7ff17006e000 2024-05-30T06:56:42.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff16f400640 1 --2- 172.21.15.37:0/2446273113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff17006e000 0x7ff1700ce1c0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7ff17006c7b0 tx=0x7ff16001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3571b177a0ae2d29 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:42.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff16ea00640 1 -- 172.21.15.37:0/2446273113 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1600b5070 con 0x7ff17006e000 2024-05-30T06:56:42.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff16ea00640 1 -- 172.21.15.37:0/2446273113 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1600a8970 con 0x7ff17006e000 2024-05-30T06:56:42.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff16ea00640 1 -- 172.21.15.37:0/2446273113 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1600a8d40 con 0x7ff17006e000 2024-05-30T06:56:42.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff176800640 1 -- 172.21.15.37:0/2446273113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff17006e000 msgr2=0x7ff1700ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:42.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff176800640 1 --2- 172.21.15.37:0/2446273113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff17006e000 0x7ff1700ce1c0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7ff17006c7b0 tx=0x7ff16001ec70 comp rx=0 tx=0).stop 2024-05-30T06:56:42.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff176800640 1 -- 172.21.15.37:0/2446273113 shutdown_connections 2024-05-30T06:56:42.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff176800640 1 --2- 172.21.15.37:0/2446273113 >> v2:172.21.15.105:3300/0 conn(0x7ff1700cee10 0x7ff17006f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:42.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff176800640 1 --2- 172.21.15.37:0/2446273113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff17006e000 0x7ff1700ce1c0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:42.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff176800640 1 -- 172.21.15.37:0/2446273113 >> 172.21.15.37:0/2446273113 conn(0x7ff1700b23a0 msgr2=0x7ff1700b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:42.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.008+0000 7ff176800640 1 -- 172.21.15.37:0/2446273113 shutdown_connections 2024-05-30T06:56:42.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff176800640 1 -- 172.21.15.37:0/2446273113 wait complete. 2024-05-30T06:56:42.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff176800640 1 Processor -- start 2024-05-30T06:56:42.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff176800640 1 -- start start 2024-05-30T06:56:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff176800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17006e000 0x7ff1701f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff176800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1700cee10 0x7ff170144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff176800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff17015cd80 0x7ff17013a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff176800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff17006f930 con 0x7ff1700cee10 2024-05-30T06:56:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff176800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff1700cdca0 con 0x7ff17015cd80 2024-05-30T06:56:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff176800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff17006fab0 con 0x7ff17006e000 2024-05-30T06:56:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff166a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1700cee10 0x7ff170144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff166a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1700cee10 0x7ff170144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58448/0 (socket says 172.21.15.37:58448) 2024-05-30T06:56:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff166a00640 1 -- 172.21.15.37:0/232067731 learned_addr learned my addr 172.21.15.37:0/232067731 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:42.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff16fe00640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff17015cd80 0x7ff17013a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:42.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff16f400640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17006e000 0x7ff1701f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:42.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff166a00640 1 -- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17006e000 msgr2=0x7ff1701f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:42.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff166a00640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17006e000 0x7ff1701f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:42.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff166a00640 1 -- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff17015cd80 msgr2=0x7ff17013a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:42.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff166a00640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff17015cd80 0x7ff17013a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:42.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff166a00640 1 -- 172.21.15.37:0/232067731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1701f5d20 con 0x7ff1700cee10 2024-05-30T06:56:42.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff16f400640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17006e000 0x7ff1701f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:56:42.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff16fe00640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff17015cd80 0x7ff17013a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:56:42.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff166a00640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1700cee10 0x7ff170144750 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ff15800c450 tx=0x7ff15800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:42.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.012+0000 7ff167e00640 1 -- 172.21.15.37:0/232067731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff158017070 con 0x7ff1700cee10 2024-05-30T06:56:42.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.016+0000 7ff167e00640 1 -- 172.21.15.37:0/232067731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff158005cf0 con 0x7ff1700cee10 2024-05-30T06:56:42.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.016+0000 7ff167e00640 1 -- 172.21.15.37:0/232067731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff158007290 con 0x7ff1700cee10 2024-05-30T06:56:42.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.016+0000 7ff176800640 1 -- 172.21.15.37:0/232067731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1701f5fa0 con 0x7ff1700cee10 2024-05-30T06:56:42.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.016+0000 7ff176800640 1 -- 172.21.15.37:0/232067731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1701f6560 con 0x7ff1700cee10 2024-05-30T06:56:42.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.016+0000 7ff176800640 1 -- 172.21.15.37:0/232067731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1701564e0 con 0x7ff1700cee10 2024-05-30T06:56:42.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.016+0000 7ff167e00640 1 -- 172.21.15.37:0/232067731 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7ff15801a070 con 0x7ff1700cee10 2024-05-30T06:56:42.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.016+0000 7ff167e00640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff14c069a90 0x7ff14c06bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:42.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.016+0000 7ff167e00640 1 -- 172.21.15.37:0/232067731 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7ff158084a50 con 0x7ff1700cee10 2024-05-30T06:56:42.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.016+0000 7ff16f400640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff14c069a90 0x7ff14c06bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:42.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.016+0000 7ff16f400640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff14c069a90 0x7ff14c06bf50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff1600b2000 tx=0x7ff1600aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:42.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.020+0000 7ff167e00640 1 -- 172.21.15.37:0/232067731 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff1701f5d20 con 0x7ff1700cee10 2024-05-30T06:56:42.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.244+0000 7ff176800640 1 -- 172.21.15.37:0/232067731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff1701f6730 con 0x7ff1700cee10 2024-05-30T06:56:42.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.244+0000 7ff167e00640 1 -- 172.21.15.37:0/232067731 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2109 (secure 0 0 0) 0x7ff1701f6730 con 0x7ff1700cee10 2024-05-30T06:56:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:42.249 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:56:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:56:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:56:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:56:42.249 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:56:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:56:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:56:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:56:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:56:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:56:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:56:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:56:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:56:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:56:42.250 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 896, 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 102, 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:56:42.251 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:56:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:56:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:56:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:56:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:56:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:56:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:56:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 797, 2024-05-30T06:56:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 3222170046, 2024-05-30T06:56:42.252 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 7344832512, 2024-05-30T06:56:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 765749280768, 2024-05-30T06:56:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:56:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 341, 2024-05-30T06:56:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 9469, 2024-05-30T06:56:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:56:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 2 2024-05-30T06:56:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:56:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 65, 2024-05-30T06:56:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7, 2024-05-30T06:56:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:56:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:56:42.253 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:56:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:56:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 7, 2024-05-30T06:56:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:56:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:56:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:56:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 8538 2024-05-30T06:56:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:56:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:56:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:56:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:56:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:56:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:56:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:56:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:56:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:56:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:56:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 16, 2024-05-30T06:56:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:56:40.960792+0000", 2024-05-30T06:56:42.255 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:56:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:56:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "b75acea7-13d8-44df-a48a-31c3fb5462f9": { 2024-05-30T06:56:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 16.0 seconds before exiting (15s)\n [============================] ", 2024-05-30T06:56:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:56:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:56:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:42.256 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:42.256 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:56:42.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.248+0000 7ff176800640 1 -- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff14c069a90 msgr2=0x7ff14c06bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:42.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.248+0000 7ff176800640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff14c069a90 0x7ff14c06bf50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff1600b2000 tx=0x7ff1600aa070 comp rx=0 tx=0).stop 2024-05-30T06:56:42.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.248+0000 7ff176800640 1 -- 172.21.15.37:0/232067731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1700cee10 msgr2=0x7ff170144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:42.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.248+0000 7ff176800640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1700cee10 0x7ff170144750 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ff15800c450 tx=0x7ff15800c910 comp rx=0 tx=0).stop 2024-05-30T06:56:42.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.248+0000 7ff176800640 1 -- 172.21.15.37:0/232067731 shutdown_connections 2024-05-30T06:56:42.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.248+0000 7ff176800640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff14c069a90 0x7ff14c06bf50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:42.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.248+0000 7ff176800640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff17015cd80 0x7ff17013a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:42.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.248+0000 7ff176800640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1700cee10 0x7ff170144750 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:42.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.248+0000 7ff176800640 1 --2- 172.21.15.37:0/232067731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff17006e000 0x7ff1701f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:42.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.248+0000 7ff176800640 1 -- 172.21.15.37:0/232067731 >> 172.21.15.37:0/232067731 conn(0x7ff1700b23a0 msgr2=0x7ff170142180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:42.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.248+0000 7ff176800640 1 -- 172.21.15.37:0/232067731 shutdown_connections 2024-05-30T06:56:42.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:42.248+0000 7ff176800640 1 -- 172.21.15.37:0/232067731 wait complete. 2024-05-30T06:56:47.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:56:47.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd064200640 1 Processor -- start 2024-05-30T06:56:47.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd064200640 1 -- start start 2024-05-30T06:56:47.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd064200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05c06d080 0x7fd05c0adec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:47.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd064200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05c0738d0 con 0x7fd05c15c990 2024-05-30T06:56:47.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd064200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd05c0735f0 con 0x7fd05c0d0840 2024-05-30T06:56:47.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd064200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd05c15cd70 con 0x7fd05c06d080 2024-05-30T06:56:47.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd061800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd05c15c990 0x7fd05c0cf930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39860/0 (socket says 172.21.15.37:39860) 2024-05-30T06:56:47.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd061800640 1 -- 172.21.15.37:0/855698499 learned_addr learned my addr 172.21.15.37:0/855698499 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:56:47.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd062200640 1 --2- 172.21.15.37:0/855698499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05c06d080 0x7fd05c0adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:47.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd05be00640 1 -- 172.21.15.37:0/855698499 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2267316382 0 0) 0x7fd05c0738d0 con 0x7fd05c15c990 2024-05-30T06:56:47.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd05be00640 1 -- 172.21.15.37:0/855698499 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd044003530 con 0x7fd05c15c990 2024-05-30T06:56:47.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd05be00640 1 -- 172.21.15.37:0/855698499 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680184881 0 0) 0x7fd05c0735f0 con 0x7fd05c0d0840 2024-05-30T06:56:47.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd05be00640 1 -- 172.21.15.37:0/855698499 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd05c0738d0 con 0x7fd05c0d0840 2024-05-30T06:56:47.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd062200640 1 -- 172.21.15.37:0/855698499 >> v1:172.21.15.105:6789/0 conn(0x7fd05c0d0840 legacy=0x7fd05c06c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:47.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd05be00640 1 -- 172.21.15.37:0/855698499 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3188402442 0 0) 0x7fd044003530 con 0x7fd05c15c990 2024-05-30T06:56:47.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd062200640 1 -- 172.21.15.37:0/855698499 >> v1:172.21.15.37:6789/0 conn(0x7fd05c15c990 legacy=0x7fd05c0cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:47.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.420+0000 7fd062200640 1 -- 172.21.15.37:0/855698499 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c0b4a70 con 0x7fd05c06d080 2024-05-30T06:56:47.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.424+0000 7fd062200640 1 --2- 172.21.15.37:0/855698499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05c06d080 0x7fd05c0adec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd054009dc0 tx=0x7fd05401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53cdb4707ccd1694 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:47.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.424+0000 7fd05be00640 1 -- 172.21.15.37:0/855698499 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0540b2070 con 0x7fd05c06d080 2024-05-30T06:56:47.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.424+0000 7fd05be00640 1 -- 172.21.15.37:0/855698499 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0540a55a0 con 0x7fd05c06d080 2024-05-30T06:56:47.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.424+0000 7fd05be00640 1 -- 172.21.15.37:0/855698499 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050001680 con 0x7fd05c06d080 2024-05-30T06:56:47.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.424+0000 7fd064200640 1 -- 172.21.15.37:0/855698499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05c06d080 msgr2=0x7fd05c0adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.424+0000 7fd064200640 1 --2- 172.21.15.37:0/855698499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05c06d080 0x7fd05c0adec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd054009dc0 tx=0x7fd05401c8b0 comp rx=0 tx=0).stop 2024-05-30T06:56:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.424+0000 7fd064200640 1 -- 172.21.15.37:0/855698499 shutdown_connections 2024-05-30T06:56:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.424+0000 7fd064200640 1 --2- 172.21.15.37:0/855698499 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05c06d080 0x7fd05c0adec0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.424+0000 7fd064200640 1 -- 172.21.15.37:0/855698499 >> 172.21.15.37:0/855698499 conn(0x7fd05c0ce6d0 msgr2=0x7fd05c072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.424+0000 7fd064200640 1 -- 172.21.15.37:0/855698499 shutdown_connections 2024-05-30T06:56:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.424+0000 7fd064200640 1 -- 172.21.15.37:0/855698499 wait complete. 2024-05-30T06:56:47.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd064200640 1 Processor -- start 2024-05-30T06:56:47.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd064200640 1 -- start start 2024-05-30T06:56:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd064200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd05c06d080 0x7fd05c14a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd064200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd05c0d0840 0x7fd05c152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd064200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05c15c990 0x7fd05c1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd064200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c0d0040 con 0x7fd05c06d080 2024-05-30T06:56:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd064200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c073280 con 0x7fd05c0d0840 2024-05-30T06:56:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd064200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd05c14e750 con 0x7fd05c15c990 2024-05-30T06:56:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd061800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd05c06d080 0x7fd05c14a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd061800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd05c06d080 0x7fd05c14a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39854/0 (socket says 172.21.15.37:39854) 2024-05-30T06:56:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd061800640 1 -- 172.21.15.37:0/3232111903 learned_addr learned my addr 172.21.15.37:0/3232111903 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd062200640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05c15c990 0x7fd05c1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd060e00640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd05c0d0840 0x7fd05c152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd061800640 1 -- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05c15c990 msgr2=0x7fd05c1530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd061800640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05c15c990 0x7fd05c1530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd061800640 1 -- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd05c0d0840 msgr2=0x7fd05c152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd061800640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd05c0d0840 0x7fd05c152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd061800640 1 -- 172.21.15.37:0/3232111903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c14ea30 con 0x7fd05c06d080 2024-05-30T06:56:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd061800640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd05c06d080 0x7fd05c14a770 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c730 tx=0x7fd05000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:47.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd059600640 1 -- 172.21.15.37:0/3232111903 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050017070 con 0x7fd05c06d080 2024-05-30T06:56:47.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd059600640 1 -- 172.21.15.37:0/3232111903 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd050005b00 con 0x7fd05c06d080 2024-05-30T06:56:47.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd059600640 1 -- 172.21.15.37:0/3232111903 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050007070 con 0x7fd05c06d080 2024-05-30T06:56:47.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd064200640 1 -- 172.21.15.37:0/3232111903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05c14ed10 con 0x7fd05c06d080 2024-05-30T06:56:47.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.428+0000 7fd064200640 1 -- 172.21.15.37:0/3232111903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05c14acb0 con 0x7fd05c06d080 2024-05-30T06:56:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.432+0000 7fd064200640 1 -- 172.21.15.37:0/3232111903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05c068b20 con 0x7fd05c06d080 2024-05-30T06:56:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.432+0000 7fd059600640 1 -- 172.21.15.37:0/3232111903 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7fd05001a070 con 0x7fd05c06d080 2024-05-30T06:56:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.432+0000 7fd059600640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd03c069a90 0x7fd03c06bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.432+0000 7fd059600640 1 -- 172.21.15.37:0/3232111903 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fd050084be0 con 0x7fd05c06d080 2024-05-30T06:56:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.432+0000 7fd060e00640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd03c069a90 0x7fd03c06bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.432+0000 7fd060e00640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd03c069a90 0x7fd03c06bf50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd05c15bed0 tx=0x7fd048009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:47.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.436+0000 7fd059600640 1 -- 172.21.15.37:0/3232111903 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd0500565b0 con 0x7fd05c06d080 2024-05-30T06:56:47.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd064200640 1 -- 172.21.15.37:0/3232111903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd05c067b70 con 0x7fd05c06d080 2024-05-30T06:56:47.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd059600640 1 -- 172.21.15.37:0/3232111903 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2078 (secure 0 0 0) 0x7fd05005a8b0 con 0x7fd05c06d080 2024-05-30T06:56:47.663 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:47.663 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:56:47.663 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:56:47.663 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:56:47.663 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:56:47.663 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:56:47.663 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:56:47.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:47.663 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:56:47.663 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:56:47.664 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:56:47.664 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:56:47.664 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:56:47.664 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:47.664 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:56:47.664 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:56:47.664 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:56:47.664 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:56:47.664 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:47.664 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 902, 2024-05-30T06:56:47.664 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:56:47.664 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:56:47.664 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:56:47.665 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:56:47.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:47.665 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:56:47.665 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 102, 2024-05-30T06:56:47.665 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:56:47.665 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:56:47.665 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:56:47.665 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:56:47.665 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:56:47.665 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:56:47.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:47.665 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:56:47.666 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:56:47.666 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:47.666 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:56:47.666 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:56:47.666 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:47.666 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:47.666 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:56:47.666 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:56:47.666 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 797, 2024-05-30T06:56:47.666 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 3222178196, 2024-05-30T06:56:47.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 7344848896, 2024-05-30T06:56:47.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 765749264384, 2024-05-30T06:56:47.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:56:47.667 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 2559, 2024-05-30T06:56:47.667 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:56:47.667 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:56:47.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:47.667 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:56:47.667 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 65, 2024-05-30T06:56:47.667 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7, 2024-05-30T06:56:47.667 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:56:47.667 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:56:47.668 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:56:47.668 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:56:47.668 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:47.668 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 7, 2024-05-30T06:56:47.668 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:56:47.668 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:56:47.668 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:56:47.668 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 8538 2024-05-30T06:56:47.668 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:47.668 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:47.668 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:56:47.668 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:56:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:56:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:56:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:56:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:56:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:56:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:56:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:56:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:56:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 16, 2024-05-30T06:56:47.669 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:56:40.960792+0000", 2024-05-30T06:56:47.670 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:56:47.670 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:47.670 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:56:47.670 INFO:teuthology.orchestra.run.smithi037.stdout: "b75acea7-13d8-44df-a48a-31c3fb5462f9": { 2024-05-30T06:56:47.670 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 10.0 seconds before exiting (21s)\n [============================] ", 2024-05-30T06:56:47.670 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:56:47.670 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:56:47.670 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:47.670 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:47.670 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:56:47.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd064200640 1 -- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd03c069a90 msgr2=0x7fd03c06bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:47.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd064200640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd03c069a90 0x7fd03c06bf50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd05c15bed0 tx=0x7fd048009040 comp rx=0 tx=0).stop 2024-05-30T06:56:47.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd064200640 1 -- 172.21.15.37:0/3232111903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd05c06d080 msgr2=0x7fd05c14a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:47.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd064200640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd05c06d080 0x7fd05c14a770 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fd05000c730 tx=0x7fd05000cbf0 comp rx=0 tx=0).stop 2024-05-30T06:56:47.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd064200640 1 -- 172.21.15.37:0/3232111903 shutdown_connections 2024-05-30T06:56:47.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd064200640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd05c15c990 0x7fd05c1530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:47.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd064200640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd03c069a90 0x7fd03c06bf50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:47.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd064200640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd05c0d0840 0x7fd05c152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:47.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd064200640 1 --2- 172.21.15.37:0/3232111903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd05c06d080 0x7fd05c14a770 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:47.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd064200640 1 -- 172.21.15.37:0/3232111903 >> 172.21.15.37:0/3232111903 conn(0x7fd05c0ce6d0 msgr2=0x7fd05c0b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:47.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd064200640 1 -- 172.21.15.37:0/3232111903 shutdown_connections 2024-05-30T06:56:47.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:47.660+0000 7fd064200640 1 -- 172.21.15.37:0/3232111903 wait complete. 2024-05-30T06:56:52.685 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:56:52.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e2c600640 1 Processor -- start 2024-05-30T06:56:52.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e2c600640 1 -- start start 2024-05-30T06:56:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e2c600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e240b5760 0x7f5e24166420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e2c600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e240af6f0 con 0x7f5e240b09c0 2024-05-30T06:56:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e2c600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e240af9d0 con 0x7f5e2415ec10 2024-05-30T06:56:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e2c600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5e240b0300 con 0x7f5e240b5760 2024-05-30T06:56:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e29200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5e240b09c0 0x7f5e240b5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39872/0 (socket says 172.21.15.37:39872) 2024-05-30T06:56:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e29200640 1 -- 172.21.15.37:0/4187206378 learned_addr learned my addr 172.21.15.37:0/4187206378 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:56:52.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e2a600640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e240b5760 0x7f5e24166420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:52.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2765267834 0 0) 0x7f5e240af6f0 con 0x7f5e240b09c0 2024-05-30T06:56:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e0c003530 con 0x7f5e240b09c0 2024-05-30T06:56:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380234313 0 0) 0x7f5e240af9d0 con 0x7f5e2415ec10 2024-05-30T06:56:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e240af6f0 con 0x7f5e2415ec10 2024-05-30T06:56:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1565643622 0 0) 0x7f5e0c003530 con 0x7f5e240b09c0 2024-05-30T06:56:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e240b5760 msgr2=0x7f5e24166420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e240b5760 0x7f5e24166420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 >> v1:172.21.15.105:6789/0 conn(0x7f5e2415ec10 legacy=0x7f5e240aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e240afcb0 con 0x7f5e240b09c0 2024-05-30T06:56:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f5e10001680 con 0x7f5e240b09c0 2024-05-30T06:56:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e2a600640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e240b5760 0x7f5e24166420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:56:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 >> v1:172.21.15.37:6789/0 conn(0x7f5e240b09c0 legacy=0x7f5e240b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e240b5760 0x7f5e0c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e0c0040c0 0x7f5e0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c004d50 0x7f5e0c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e240b0300 con 0x7f5e0c0040c0 2024-05-30T06:56:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c00ba80 con 0x7f5e0c004d50 2024-05-30T06:56:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5e0c00bc80 con 0x7f5e240b5760 2024-05-30T06:56:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e29200640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e0c0040c0 0x7f5e0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.836+0000 7f5e29c00640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e240b5760 0x7f5e0c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e2a600640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c004d50 0x7f5e0c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e29200640 1 -- 172.21.15.37:0/4187206378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e240b5760 msgr2=0x7f5e0c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e29200640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e240b5760 0x7f5e0c003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e29200640 1 -- 172.21.15.37:0/4187206378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c004d50 msgr2=0x7f5e0c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e29200640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c004d50 0x7f5e0c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e29200640 1 -- 172.21.15.37:0/4187206378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0c003530 con 0x7f5e0c0040c0 2024-05-30T06:56:52.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e2a600640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e0c004d50 0x7f5e0c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:56:52.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e29200640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e0c0040c0 0x7f5e0c004810 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000c160 tx=0x7f5e1001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b0ea4c4b0c5ec9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:52.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e10007cb0 con 0x7f5e0c0040c0 2024-05-30T06:56:52.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e100a9020 con 0x7f5e0c0040c0 2024-05-30T06:56:52.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e23e00640 1 -- 172.21.15.37:0/4187206378 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e10005b20 con 0x7f5e0c0040c0 2024-05-30T06:56:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e2c600640 1 -- 172.21.15.37:0/4187206378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e0c0040c0 msgr2=0x7f5e0c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e2c600640 1 --2- 172.21.15.37:0/4187206378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e0c0040c0 0x7f5e0c004810 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000c160 tx=0x7f5e1001cbc0 comp rx=0 tx=0).stop 2024-05-30T06:56:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e2a600640 1 -- 172.21.15.37:0/4187206378 reap_dead start 2024-05-30T06:56:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e2c600640 1 -- 172.21.15.37:0/4187206378 shutdown_connections 2024-05-30T06:56:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.840+0000 7f5e2c600640 1 -- 172.21.15.37:0/4187206378 >> 172.21.15.37:0/4187206378 conn(0x7f5e240b6a60 msgr2=0x7f5e240b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2c600640 1 -- 172.21.15.37:0/4187206378 shutdown_connections 2024-05-30T06:56:52.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2c600640 1 -- 172.21.15.37:0/4187206378 wait complete. 2024-05-30T06:56:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2c600640 1 Processor -- start 2024-05-30T06:56:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2c600640 1 -- start start 2024-05-30T06:56:52.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2c600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0040c0 0x7f5e24149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:52.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2c600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e2415abc0 0x7f5e24157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:52.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2c600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e241f7f00 0x7f5e241f8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:52.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2c600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2415eff0 con 0x7f5e241f7f00 2024-05-30T06:56:52.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2c600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5e240af400 con 0x7f5e2415abc0 2024-05-30T06:56:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2c600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5e240701a0 con 0x7f5e0c0040c0 2024-05-30T06:56:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2a600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e241f7f00 0x7f5e241f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2a600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e241f7f00 0x7f5e241f8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39874/0 (socket says 172.21.15.37:39874) 2024-05-30T06:56:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2a600640 1 -- 172.21.15.37:0/25143297 learned_addr learned my addr 172.21.15.37:0/25143297 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e29c00640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0040c0 0x7f5e24149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2a600640 1 -- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0040c0 msgr2=0x7f5e24149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e29200640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e2415abc0 0x7f5e24157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2a600640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0040c0 0x7f5e24149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2a600640 1 -- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e2415abc0 msgr2=0x7f5e24157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2a600640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e2415abc0 0x7f5e24157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2a600640 1 -- 172.21.15.37:0/25143297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e24149560 con 0x7f5e241f7f00 2024-05-30T06:56:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e29c00640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0040c0 0x7f5e24149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:56:52.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e29200640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e2415abc0 0x7f5e24157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:56:52.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.844+0000 7f5e2a600640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e241f7f00 0x7f5e241f8390 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f5e24072cf0 tx=0x7f5e1c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:52.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.848+0000 7f5e21600640 1 -- 172.21.15.37:0/25143297 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c011e10 con 0x7f5e241f7f00 2024-05-30T06:56:52.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.848+0000 7f5e21600640 1 -- 172.21.15.37:0/25143297 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e1c01c070 con 0x7f5e241f7f00 2024-05-30T06:56:52.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.848+0000 7f5e21600640 1 -- 172.21.15.37:0/25143297 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0166b0 con 0x7f5e241f7f00 2024-05-30T06:56:52.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.848+0000 7f5e2c600640 1 -- 172.21.15.37:0/25143297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2415cf50 con 0x7f5e241f7f00 2024-05-30T06:56:52.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.848+0000 7f5e2c600640 1 -- 172.21.15.37:0/25143297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2415d510 con 0x7f5e241f7f00 2024-05-30T06:56:52.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.848+0000 7f5e2c600640 1 -- 172.21.15.37:0/25143297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e24068b20 con 0x7f5e241f7f00 2024-05-30T06:56:52.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.848+0000 7f5e21600640 1 -- 172.21.15.37:0/25143297 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7f5e1c016850 con 0x7f5e241f7f00 2024-05-30T06:56:52.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.848+0000 7f5e21600640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e04069a90 0x7f5e0406bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:52.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.848+0000 7f5e21600640 1 -- 172.21.15.37:0/25143297 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f5e1c085fd0 con 0x7f5e241f7f00 2024-05-30T06:56:52.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.848+0000 7f5e29c00640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e04069a90 0x7f5e0406bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:52.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.852+0000 7f5e29c00640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e04069a90 0x7f5e0406bf50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5e241543f0 tx=0x7f5e18007120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:52.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:52.852+0000 7f5e21600640 1 -- 172.21.15.37:0/25143297 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5e1c057ff0 con 0x7f5e241f7f00 2024-05-30T06:56:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.076+0000 7f5e2c600640 1 -- 172.21.15.37:0/25143297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5e24157780 con 0x7f5e241f7f00 2024-05-30T06:56:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.076+0000 7f5e21600640 1 -- 172.21.15.37:0/25143297 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2077 (secure 0 0 0) 0x7f5e1c0578f0 con 0x7f5e241f7f00 2024-05-30T06:56:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:53.081 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:56:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:56:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:56:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:56:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:56:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:56:53.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:56:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:56:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:56:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:56:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:56:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:56:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:56:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:56:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:56:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:53.082 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 907, 2024-05-30T06:56:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:56:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:56:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:56:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:56:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:56:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 102, 2024-05-30T06:56:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:56:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:56:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:56:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:56:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:56:53.083 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:56:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:56:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:56:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:56:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:56:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:56:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:56:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 797, 2024-05-30T06:56:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 3222178196, 2024-05-30T06:56:53.084 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 7344848896, 2024-05-30T06:56:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 765749264384, 2024-05-30T06:56:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:56:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 2559, 2024-05-30T06:56:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:56:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:56:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:56:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 65, 2024-05-30T06:56:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7, 2024-05-30T06:56:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:56:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:56:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:56:53.085 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:56:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 7, 2024-05-30T06:56:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:56:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:56:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:56:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 8538 2024-05-30T06:56:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:56:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:56:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:56:53.086 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:56:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:56:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:56:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:56:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:56:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:56:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:56:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 16, 2024-05-30T06:56:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:56:40.960792+0000", 2024-05-30T06:56:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:56:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:53.087 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:56:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "b75acea7-13d8-44df-a48a-31c3fb5462f9": { 2024-05-30T06:56:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 6.0 seconds before exiting (25s)\n [============================] ", 2024-05-30T06:56:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:56:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:56:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:53.088 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:56:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.080+0000 7f5e2c600640 1 -- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e04069a90 msgr2=0x7f5e0406bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.080+0000 7f5e2c600640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e04069a90 0x7f5e0406bf50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5e241543f0 tx=0x7f5e18007120 comp rx=0 tx=0).stop 2024-05-30T06:56:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.080+0000 7f5e2c600640 1 -- 172.21.15.37:0/25143297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e241f7f00 msgr2=0x7f5e241f8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.080+0000 7f5e2c600640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e241f7f00 0x7f5e241f8390 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f5e24072cf0 tx=0x7f5e1c0115a0 comp rx=0 tx=0).stop 2024-05-30T06:56:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.080+0000 7f5e2c600640 1 -- 172.21.15.37:0/25143297 shutdown_connections 2024-05-30T06:56:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.080+0000 7f5e2c600640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e241f7f00 0x7f5e241f8390 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.080+0000 7f5e2c600640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e04069a90 0x7f5e0406bf50 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.080+0000 7f5e2c600640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e2415abc0 0x7f5e24157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.080+0000 7f5e2c600640 1 --2- 172.21.15.37:0/25143297 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e0c0040c0 0x7f5e24149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.080+0000 7f5e2c600640 1 -- 172.21.15.37:0/25143297 >> 172.21.15.37:0/25143297 conn(0x7f5e240b6a60 msgr2=0x7f5e240b5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.080+0000 7f5e2c600640 1 -- 172.21.15.37:0/25143297 shutdown_connections 2024-05-30T06:56:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:53.080+0000 7f5e2c600640 1 -- 172.21.15.37:0/25143297 wait complete. 2024-05-30T06:56:58.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:56:58.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.240+0000 7f59a1a00640 1 Processor -- start 2024-05-30T06:56:58.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.240+0000 7f59a1a00640 1 -- start start 2024-05-30T06:56:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f59a1a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f599c06f9a0 0x7f599c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f59a1a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f599c0b2ec0 0x7f599c0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f59a1a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599c15c8f0 con 0x7f599c155e60 2024-05-30T06:56:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f59a1a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f599c0ccff0 con 0x7f599c0b2ec0 2024-05-30T06:56:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f59a1a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f599c0ccc80 con 0x7f599c06f9a0 2024-05-30T06:56:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f599b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f599c0b2ec0 0x7f599c0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f599b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f599c0b2ec0 0x7f599c0cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42754/0 (socket says 172.21.15.37:42754) 2024-05-30T06:56:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f599b400640 1 -- 172.21.15.37:0/3086423505 learned_addr learned my addr 172.21.15.37:0/3086423505 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f5993e00640 1 --2- 172.21.15.37:0/3086423505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f599c06f9a0 0x7f599c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f599b400640 1 -- 172.21.15.37:0/3086423505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f599c06f9a0 msgr2=0x7f599c0b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f599b400640 1 --2- 172.21.15.37:0/3086423505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f599c06f9a0 0x7f599c0b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f599b400640 1 -- 172.21.15.37:0/3086423505 >> v1:172.21.15.37:6789/0 conn(0x7f599c155e60 legacy=0x7f599c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f599b400640 1 -- 172.21.15.37:0/3086423505 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c15cbd0 con 0x7f599c0b2ec0 2024-05-30T06:56:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.244+0000 7f5993e00640 1 --2- 172.21.15.37:0/3086423505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f599c06f9a0 0x7f599c0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:56:58.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f599b400640 1 --2- 172.21.15.37:0/3086423505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f599c0b2ec0 0x7f599c0cd480 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f599400d150 tx=0x7f599401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4665b6c4e5eeb11b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:58.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f599a000640 1 -- 172.21.15.37:0/3086423505 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599400b2d0 con 0x7f599c0b2ec0 2024-05-30T06:56:58.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f599a000640 1 -- 172.21.15.37:0/3086423505 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599400b470 con 0x7f599c0b2ec0 2024-05-30T06:56:58.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f599a000640 1 -- 172.21.15.37:0/3086423505 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59940a7c30 con 0x7f599c0b2ec0 2024-05-30T06:56:58.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f59a1a00640 1 -- 172.21.15.37:0/3086423505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f599c0b2ec0 msgr2=0x7f599c0cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:58.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f59a1a00640 1 --2- 172.21.15.37:0/3086423505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f599c0b2ec0 0x7f599c0cd480 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f599400d150 tx=0x7f599401ec30 comp rx=0 tx=0).stop 2024-05-30T06:56:58.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f59a1a00640 1 -- 172.21.15.37:0/3086423505 shutdown_connections 2024-05-30T06:56:58.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f59a1a00640 1 --2- 172.21.15.37:0/3086423505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f599c0b2ec0 0x7f599c0cd480 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f59a1a00640 1 --2- 172.21.15.37:0/3086423505 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f599c06f9a0 0x7f599c0b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f59a1a00640 1 -- 172.21.15.37:0/3086423505 >> 172.21.15.37:0/3086423505 conn(0x7f599c0b23a0 msgr2=0x7f599c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:58.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f59a1a00640 1 -- 172.21.15.37:0/3086423505 shutdown_connections 2024-05-30T06:56:58.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f59a1a00640 1 -- 172.21.15.37:0/3086423505 wait complete. 2024-05-30T06:56:58.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f59a1a00640 1 Processor -- start 2024-05-30T06:56:58.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.248+0000 7f59a1a00640 1 -- start start 2024-05-30T06:56:58.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f59a1a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f599c06f9a0 0x7f599c148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f59a1a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f599c0b2ec0 0x7f599c14f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f59a1a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f599c155e60 0x7f599c14e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f59a1a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f599c06ec60 con 0x7f599c155e60 2024-05-30T06:56:58.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f59a1a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f599c06eae0 con 0x7f599c0b2ec0 2024-05-30T06:56:58.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f59a1a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f599c06ede0 con 0x7f599c06f9a0 2024-05-30T06:56:58.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f599b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f599c155e60 0x7f599c14e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f599b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f599c155e60 0x7f599c14e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42768/0 (socket says 172.21.15.37:42768) 2024-05-30T06:56:58.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f599b400640 1 -- 172.21.15.37:0/890428554 learned_addr learned my addr 172.21.15.37:0/890428554 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:58.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f5993e00640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f599c0b2ec0 0x7f599c14f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f599aa00640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f599c06f9a0 0x7f599c148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f599b400640 1 -- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f599c06f9a0 msgr2=0x7f599c148b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:58.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f599b400640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f599c06f9a0 0x7f599c148b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f599b400640 1 -- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f599c0b2ec0 msgr2=0x7f599c14f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:58.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f599b400640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f599c0b2ec0 0x7f599c14f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f599b400640 1 -- 172.21.15.37:0/890428554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c165dc0 con 0x7f599c155e60 2024-05-30T06:56:58.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f599b400640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f599c155e60 0x7f599c14e820 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f599401c860 tx=0x7f599401b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:58.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f5992a00640 1 -- 172.21.15.37:0/890428554 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994009600 con 0x7f599c155e60 2024-05-30T06:56:58.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f5992a00640 1 -- 172.21.15.37:0/890428554 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59940097a0 con 0x7f599c155e60 2024-05-30T06:56:58.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f5992a00640 1 -- 172.21.15.37:0/890428554 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994009b90 con 0x7f599c155e60 2024-05-30T06:56:58.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f59a1a00640 1 -- 172.21.15.37:0/890428554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599c1660a0 con 0x7f599c155e60 2024-05-30T06:56:58.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f59a1a00640 1 -- 172.21.15.37:0/890428554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f599c1490d0 con 0x7f599c155e60 2024-05-30T06:56:58.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f59a1a00640 1 -- 172.21.15.37:0/890428554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599c068b20 con 0x7f599c155e60 2024-05-30T06:56:58.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.252+0000 7f5992a00640 1 -- 172.21.15.37:0/890428554 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7f59940c0030 con 0x7f599c155e60 2024-05-30T06:56:58.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.256+0000 7f5992a00640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5978069a90 0x7f597806bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.256+0000 7f5992a00640 1 -- 172.21.15.37:0/890428554 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f5994120850 con 0x7f599c155e60 2024-05-30T06:56:58.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.256+0000 7f599aa00640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5978069a90 0x7f597806bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.256+0000 7f599aa00640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5978069a90 0x7f597806bf50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f598c0015b0 tx=0x7f598c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:58.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.260+0000 7f5992a00640 1 -- 172.21.15.37:0/890428554 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f59940c7020 con 0x7f599c155e60 2024-05-30T06:56:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.484+0000 7f59a1a00640 1 -- 172.21.15.37:0/890428554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f599c15b4f0 con 0x7f599c155e60 2024-05-30T06:56:58.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.484+0000 7f5992a00640 1 -- 172.21.15.37:0/890428554 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1729 (secure 0 0 0) 0x7f5994018820 con 0x7f599c155e60 2024-05-30T06:56:58.487 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:58.487 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:56:58.487 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:56:58.487 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:56:58.488 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:56:58.488 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:56:58.488 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:56:58.488 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:58.488 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:56:58.488 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:56:58.488 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:56:58.488 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:56:58.488 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:56:58.488 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:58.488 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:56:58.489 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:56:58.489 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:56:58.489 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:56:58.489 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:58.489 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 912, 2024-05-30T06:56:58.489 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:56:58.489 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:56:58.489 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:56:58.489 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:56:58.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:58.489 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:56:58.489 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 102, 2024-05-30T06:56:58.489 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:56:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:56:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:56:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:56:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:56:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:56:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:56:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:56:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:56:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:56:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:58.490 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:56:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:56:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 797, 2024-05-30T06:56:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 3222178196, 2024-05-30T06:56:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 7344848896, 2024-05-30T06:56:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 765749264384, 2024-05-30T06:56:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280 2024-05-30T06:56:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:56:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 65, 2024-05-30T06:56:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7, 2024-05-30T06:56:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:56:58.491 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:56:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:56:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:56:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 7, 2024-05-30T06:56:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:56:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "c", 2024-05-30T06:56:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:56:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 8538 2024-05-30T06:56:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:56:58.492 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:56:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:56:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:56:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:56:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:56:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:56:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:56:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:56:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:56:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:56:58.493 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 16, 2024-05-30T06:56:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:56:40.960792+0000", 2024-05-30T06:56:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:56:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:58.494 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": {} 2024-05-30T06:56:58.494 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:56:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.484+0000 7f59a1a00640 1 -- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5978069a90 msgr2=0x7f597806bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.484+0000 7f59a1a00640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5978069a90 0x7f597806bf50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f598c0015b0 tx=0x7f598c009040 comp rx=0 tx=0).stop 2024-05-30T06:56:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.484+0000 7f59a1a00640 1 -- 172.21.15.37:0/890428554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f599c155e60 msgr2=0x7f599c14e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.484+0000 7f59a1a00640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f599c155e60 0x7f599c14e820 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f599401c860 tx=0x7f599401b9d0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.484+0000 7f59a1a00640 1 -- 172.21.15.37:0/890428554 shutdown_connections 2024-05-30T06:56:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.484+0000 7f59a1a00640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f599c155e60 0x7f599c14e820 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.484+0000 7f59a1a00640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5978069a90 0x7f597806bf50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.484+0000 7f59a1a00640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f599c0b2ec0 0x7f599c14f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.484+0000 7f59a1a00640 1 --2- 172.21.15.37:0/890428554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f599c06f9a0 0x7f599c148b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.484+0000 7f59a1a00640 1 -- 172.21.15.37:0/890428554 >> 172.21.15.37:0/890428554 conn(0x7f599c0b23a0 msgr2=0x7f599c0b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.488+0000 7f59a1a00640 1 -- 172.21.15.37:0/890428554 shutdown_connections 2024-05-30T06:56:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.488+0000 7f59a1a00640 1 -- 172.21.15.37:0/890428554 wait complete. 2024-05-30T06:56:58.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T06:56:58.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.648+0000 7f1ad1c00640 1 Processor -- start 2024-05-30T06:56:58.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.648+0000 7f1ad1c00640 1 -- start start 2024-05-30T06:56:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1ad1c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1acc06f770 0x7f1acc166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1ad1c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1acc15f310 con 0x7f1acc155da0 2024-05-30T06:56:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1ad1c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1acc15f5f0 con 0x7f1acc0cd440 2024-05-30T06:56:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1ad1c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1acc0b4760 con 0x7f1acc06f770 2024-05-30T06:56:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1acaa00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1acc155da0 0x7f1acc0cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34284/0 (socket says 172.21.15.37:34284) 2024-05-30T06:56:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1acaa00640 1 -- 172.21.15.37:0/3798032418 learned_addr learned my addr 172.21.15.37:0/3798032418 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:56:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1acb400640 1 --2- 172.21.15.37:0/3798032418 >> v2:172.21.15.105:3300/0 conn(0x7f1acc06f770 0x7f1acc166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239736590 0 0) 0x7f1acc15f310 con 0x7f1acc155da0 2024-05-30T06:56:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ab0003530 con 0x7f1acc155da0 2024-05-30T06:56:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2488157508 0 0) 0x7f1acc15f5f0 con 0x7f1acc0cd440 2024-05-30T06:56:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1acc15f310 con 0x7f1acc0cd440 2024-05-30T06:56:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4204866524 0 0) 0x7f1ab0003530 con 0x7f1acc155da0 2024-05-30T06:56:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 >> v2:172.21.15.105:3300/0 conn(0x7f1acc06f770 msgr2=0x7f1acc166570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 --2- 172.21.15.37:0/3798032418 >> v2:172.21.15.105:3300/0 conn(0x7f1acc06f770 0x7f1acc166570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 >> v1:172.21.15.105:6789/0 conn(0x7f1acc0cd440 legacy=0x7f1acc06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc15f8d0 con 0x7f1acc155da0 2024-05-30T06:56:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f1abc001680 con 0x7f1acc155da0 2024-05-30T06:56:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1acb400640 1 --2- 172.21.15.37:0/3798032418 >> v2:172.21.15.105:3300/0 conn(0x7f1acc06f770 0x7f1acc166570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:56:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 >> v1:172.21.15.37:6789/0 conn(0x7f1acc155da0 legacy=0x7f1acc0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 --2- 172.21.15.37:0/3798032418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab0003ba0 0x7f1ab0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 --2- 172.21.15.37:0/3798032418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab0004810 0x7f1ab0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 --2- 172.21.15.37:0/3798032418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab0005290 0x7f1ab000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab000c1a0 con 0x7f1ab0005290 2024-05-30T06:56:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab000c350 con 0x7f1ab0003ba0 2024-05-30T06:56:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab000c550 con 0x7f1ab0004810 2024-05-30T06:56:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1acb400640 1 --2- 172.21.15.37:0/3798032418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab0005290 0x7f1ab000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1ac2000640 1 --2- 172.21.15.37:0/3798032418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab0004810 0x7f1ab0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1acaa00640 1 --2- 172.21.15.37:0/3798032418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab0003ba0 0x7f1ab0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1acb400640 1 -- 172.21.15.37:0/3798032418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab0004810 msgr2=0x7f1ab0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1acb400640 1 --2- 172.21.15.37:0/3798032418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ab0004810 0x7f1ab0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1acb400640 1 -- 172.21.15.37:0/3798032418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab0003ba0 msgr2=0x7f1ab0003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1acb400640 1 --2- 172.21.15.37:0/3798032418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab0003ba0 0x7f1ab0003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1acb400640 1 -- 172.21.15.37:0/3798032418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab0003530 con 0x7f1ab0005290 2024-05-30T06:56:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.652+0000 7f1acaa00640 1 --2- 172.21.15.37:0/3798032418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab0003ba0 0x7f1ab0003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:56:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.656+0000 7f1acb400640 1 -- 172.21.15.37:0/3798032418 reap_dead start 2024-05-30T06:56:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.656+0000 7f1acb400640 1 --2- 172.21.15.37:0/3798032418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab0005290 0x7f1ab000b9d0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0cd0e0 tx=0x7f1ac401ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1ef936d07ca360 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.656+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4009de0 con 0x7f1ab0005290 2024-05-30T06:56:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.656+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac40a5c10 con 0x7f1ab0005290 2024-05-30T06:56:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.656+0000 7f1aca000640 1 -- 172.21.15.37:0/3798032418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac40039a0 con 0x7f1ab0005290 2024-05-30T06:56:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.656+0000 7f1ad1c00640 1 -- 172.21.15.37:0/3798032418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab0005290 msgr2=0x7f1ab000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.656+0000 7f1ad1c00640 1 --2- 172.21.15.37:0/3798032418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab0005290 0x7f1ab000b9d0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0cd0e0 tx=0x7f1ac401ce20 comp rx=0 tx=0).stop 2024-05-30T06:56:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.656+0000 7f1ad1c00640 1 -- 172.21.15.37:0/3798032418 shutdown_connections 2024-05-30T06:56:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.656+0000 7f1ad1c00640 1 --2- 172.21.15.37:0/3798032418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ab0005290 0x7f1ab000b9d0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.656+0000 7f1ad1c00640 1 -- 172.21.15.37:0/3798032418 >> 172.21.15.37:0/3798032418 conn(0x7f1acc06bf60 msgr2=0x7f1acc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.656+0000 7f1ad1c00640 1 -- 172.21.15.37:0/3798032418 shutdown_connections 2024-05-30T06:56:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.656+0000 7f1ad1c00640 1 -- 172.21.15.37:0/3798032418 wait complete. 2024-05-30T06:56:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.656+0000 7f1ad1c00640 1 Processor -- start 2024-05-30T06:56:58.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ad1c00640 1 -- start start 2024-05-30T06:56:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ad1c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab0005290 0x7f1acc1f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ad1c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1acc156290 0x7f1acc150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ad1c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1acc165e20 0x7f1acc15a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ad1c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc0cdce0 con 0x7f1acc156290 2024-05-30T06:56:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ad1c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc0cdb60 con 0x7f1ab0005290 2024-05-30T06:56:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ad1c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1acc0cde60 con 0x7f1acc165e20 2024-05-30T06:56:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ac2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1acc156290 0x7f1acc150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ac2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1acc156290 0x7f1acc150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42788/0 (socket says 172.21.15.37:42788) 2024-05-30T06:56:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ac2000640 1 -- 172.21.15.37:0/2880676266 learned_addr learned my addr 172.21.15.37:0/2880676266 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1acb400640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1acc165e20 0x7f1acc15a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1acaa00640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab0005290 0x7f1acc1f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ac2000640 1 -- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1acc165e20 msgr2=0x7f1acc15a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ac2000640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1acc165e20 0x7f1acc15a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ac2000640 1 -- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab0005290 msgr2=0x7f1acc1f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ac2000640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab0005290 0x7f1acc1f7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ac2000640 1 -- 172.21.15.37:0/2880676266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc156800 con 0x7f1acc156290 2024-05-30T06:56:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1acaa00640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab0005290 0x7f1acc1f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:56:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ac2000640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1acc156290 0x7f1acc150660 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400f770 tx=0x7f1ab400fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ac3400640 1 -- 172.21.15.37:0/2880676266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab40050d0 con 0x7f1acc156290 2024-05-30T06:56:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ac3400640 1 -- 172.21.15.37:0/2880676266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab4018070 con 0x7f1acc156290 2024-05-30T06:56:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ac3400640 1 -- 172.21.15.37:0/2880676266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab400d730 con 0x7f1acc156290 2024-05-30T06:56:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ad1c00640 1 -- 172.21.15.37:0/2880676266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1acc159620 con 0x7f1acc156290 2024-05-30T06:56:58.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ad1c00640 1 -- 172.21.15.37:0/2880676266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1acc159be0 con 0x7f1acc156290 2024-05-30T06:56:58.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.660+0000 7f1ad1c00640 1 -- 172.21.15.37:0/2880676266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1acc156b40 con 0x7f1acc156290 2024-05-30T06:56:58.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.664+0000 7f1ac3400640 1 -- 172.21.15.37:0/2880676266 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7f1ab400d8d0 con 0x7f1acc156290 2024-05-30T06:56:58.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.664+0000 7f1ac3400640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1aa8069a30 0x7f1aa806bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.664+0000 7f1ac3400640 1 -- 172.21.15.37:0/2880676266 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f1ab4085680 con 0x7f1acc156290 2024-05-30T06:56:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.664+0000 7f1acaa00640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1aa8069a30 0x7f1aa806bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:58.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.664+0000 7f1acaa00640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1aa8069a30 0x7f1aa806bef0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1abc000c10 tx=0x7f1abc001090 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:58.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.668+0000 7f1ac3400640 1 -- 172.21.15.37:0/2880676266 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ab40576a0 con 0x7f1acc156290 2024-05-30T06:56:58.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.856+0000 7f1ad1c00640 1 -- 172.21.15.37:0/2880676266 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1acc0b6790 con 0x7f1aa8069a30 2024-05-30T06:56:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.864+0000 7f1ac3400640 1 -- 172.21.15.37:0/2880676266 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+79 (secure 0 0 0) 0x7f1acc0b6790 con 0x7f1aa8069a30 2024-05-30T06:56:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:58.867 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:56:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sv1" 2024-05-30T06:56:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:56:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ss1clone1" 2024-05-30T06:56:58.867 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:58.868 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:56:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.864+0000 7f1ad1c00640 1 -- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1aa8069a30 msgr2=0x7f1aa806bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.864+0000 7f1ad1c00640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1aa8069a30 0x7f1aa806bef0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1abc000c10 tx=0x7f1abc001090 comp rx=0 tx=0).stop 2024-05-30T06:56:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.864+0000 7f1ad1c00640 1 -- 172.21.15.37:0/2880676266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1acc156290 msgr2=0x7f1acc150660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.864+0000 7f1ad1c00640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1acc156290 0x7f1acc150660 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400f770 tx=0x7f1ab400fc30 comp rx=0 tx=0).stop 2024-05-30T06:56:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.864+0000 7f1ad1c00640 1 -- 172.21.15.37:0/2880676266 shutdown_connections 2024-05-30T06:56:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.864+0000 7f1ad1c00640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1acc165e20 0x7f1acc15a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.864+0000 7f1ad1c00640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1acc156290 0x7f1acc150660 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.864+0000 7f1ad1c00640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1aa8069a30 0x7f1aa806bef0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.864+0000 7f1ad1c00640 1 --2- 172.21.15.37:0/2880676266 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ab0005290 0x7f1acc1f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.864+0000 7f1ad1c00640 1 -- 172.21.15.37:0/2880676266 >> 172.21.15.37:0/2880676266 conn(0x7f1acc06bf60 msgr2=0x7f1acc164710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.864+0000 7f1ad1c00640 1 -- 172.21.15.37:0/2880676266 shutdown_connections 2024-05-30T06:56:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:58.868+0000 7f1ad1c00640 1 -- 172.21.15.37:0/2880676266 wait complete. 2024-05-30T06:56:58.889 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T06:56:59.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd454a00640 1 Processor -- start 2024-05-30T06:56:59.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd454a00640 1 -- start start 2024-05-30T06:56:59.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd454a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd45015c780 0x7fd4500b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd454a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd45009b5a0 0x7fd4500af410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd454a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4500b2cb0 con 0x7fd45009aa60 2024-05-30T06:56:59.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd454a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd4500b38c0 con 0x7fd45009b5a0 2024-05-30T06:56:59.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd454a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd4500b2f90 con 0x7fd45015c780 2024-05-30T06:56:59.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd44e800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd45009b5a0 0x7fd4500af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd44e800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd45009b5a0 0x7fd4500af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42794/0 (socket says 172.21.15.37:42794) 2024-05-30T06:56:59.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd44e800640 1 -- 172.21.15.37:0/2124732754 learned_addr learned my addr 172.21.15.37:0/2124732754 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:59.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd44de00640 1 --2- 172.21.15.37:0/2124732754 >> v2:172.21.15.105:3300/0 conn(0x7fd45015c780 0x7fd4500b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd44e800640 1 -- 172.21.15.37:0/2124732754 >> v2:172.21.15.105:3300/0 conn(0x7fd45015c780 msgr2=0x7fd4500b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:59.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd44e800640 1 --2- 172.21.15.37:0/2124732754 >> v2:172.21.15.105:3300/0 conn(0x7fd45015c780 0x7fd4500b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd44e800640 1 -- 172.21.15.37:0/2124732754 >> v1:172.21.15.37:6789/0 conn(0x7fd45009aa60 legacy=0x7fd45009ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.032+0000 7fd44e800640 1 -- 172.21.15.37:0/2124732754 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4500b3270 con 0x7fd45009b5a0 2024-05-30T06:56:59.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.036+0000 7fd44e800640 1 --2- 172.21.15.37:0/2124732754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45009b5a0 0x7fd4500af410 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fd4500b51d0 tx=0x7fd44801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a43e2125473979 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:59.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.036+0000 7fd44d400640 1 -- 172.21.15.37:0/2124732754 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4480a57a0 con 0x7fd45009b5a0 2024-05-30T06:56:59.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.036+0000 7fd44d400640 1 -- 172.21.15.37:0/2124732754 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4480a5940 con 0x7fd45009b5a0 2024-05-30T06:56:59.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.036+0000 7fd44d400640 1 -- 172.21.15.37:0/2124732754 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4480a5d10 con 0x7fd45009b5a0 2024-05-30T06:56:59.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.036+0000 7fd454a00640 1 -- 172.21.15.37:0/2124732754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45009b5a0 msgr2=0x7fd4500af410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.036+0000 7fd454a00640 1 --2- 172.21.15.37:0/2124732754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45009b5a0 0x7fd4500af410 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fd4500b51d0 tx=0x7fd44801c9c0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.036+0000 7fd454a00640 1 -- 172.21.15.37:0/2124732754 shutdown_connections 2024-05-30T06:56:59.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.036+0000 7fd454a00640 1 --2- 172.21.15.37:0/2124732754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45009b5a0 0x7fd4500af410 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.036+0000 7fd454a00640 1 --2- 172.21.15.37:0/2124732754 >> v2:172.21.15.105:3300/0 conn(0x7fd45015c780 0x7fd4500b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.036+0000 7fd454a00640 1 -- 172.21.15.37:0/2124732754 >> 172.21.15.37:0/2124732754 conn(0x7fd4500d26a0 msgr2=0x7fd4500d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:59.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.036+0000 7fd454a00640 1 -- 172.21.15.37:0/2124732754 shutdown_connections 2024-05-30T06:56:59.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.036+0000 7fd454a00640 1 -- 172.21.15.37:0/2124732754 wait complete. 2024-05-30T06:56:59.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd454a00640 1 Processor -- start 2024-05-30T06:56:59.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd454a00640 1 -- start start 2024-05-30T06:56:59.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd454a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd45009aa60 0x7fd4500b8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd454a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd45009b5a0 0x7fd45006d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd454a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45015c780 0x7fd45015d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd454a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd4500b02e0 con 0x7fd45015c780 2024-05-30T06:56:59.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd454a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd4500b0160 con 0x7fd45009b5a0 2024-05-30T06:56:59.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd454a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd4501696b0 con 0x7fd45009aa60 2024-05-30T06:56:59.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd44e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45015c780 0x7fd45015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd44e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45015c780 0x7fd45015d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42802/0 (socket says 172.21.15.37:42802) 2024-05-30T06:56:59.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd44e800640 1 -- 172.21.15.37:0/1831485154 learned_addr learned my addr 172.21.15.37:0/1831485154 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:59.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd445400640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd45009b5a0 0x7fd45006d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd44de00640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd45009aa60 0x7fd4500b8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd44e800640 1 -- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd45009aa60 msgr2=0x7fd4500b8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd44e800640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd45009aa60 0x7fd4500b8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd44e800640 1 -- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd45009b5a0 msgr2=0x7fd45006d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd44e800640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd45009b5a0 0x7fd45006d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd44e800640 1 -- 172.21.15.37:0/1831485154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45006ded0 con 0x7fd45015c780 2024-05-30T06:56:59.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd445400640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd45009b5a0 0x7fd45006d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:56:59.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd44e800640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45015c780 0x7fd45015d880 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fd4480af040 tx=0x7fd448019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:59.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd446a00640 1 -- 172.21.15.37:0/1831485154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4480b8670 con 0x7fd45015c780 2024-05-30T06:56:59.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd446a00640 1 -- 172.21.15.37:0/1831485154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4480be070 con 0x7fd45015c780 2024-05-30T06:56:59.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd446a00640 1 -- 172.21.15.37:0/1831485154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4480b8a90 con 0x7fd45015c780 2024-05-30T06:56:59.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd454a00640 1 -- 172.21.15.37:0/1831485154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd45006e1b0 con 0x7fd45015c780 2024-05-30T06:56:59.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.040+0000 7fd454a00640 1 -- 172.21.15.37:0/1831485154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd450158b90 con 0x7fd45015c780 2024-05-30T06:56:59.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.044+0000 7fd454a00640 1 -- 172.21.15.37:0/1831485154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd450068d40 con 0x7fd45015c780 2024-05-30T06:56:59.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.044+0000 7fd446a00640 1 -- 172.21.15.37:0/1831485154 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7fd4480b8c30 con 0x7fd45015c780 2024-05-30T06:56:59.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.044+0000 7fd446a00640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd42c069a90 0x7fd42c06bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.044+0000 7fd446a00640 1 -- 172.21.15.37:0/1831485154 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fd448120890 con 0x7fd45015c780 2024-05-30T06:56:59.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.044+0000 7fd44de00640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd42c069a90 0x7fd42c06bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.044+0000 7fd44de00640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd42c069a90 0x7fd42c06bf50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd440009a50 tx=0x7fd440008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:59.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.048+0000 7fd446a00640 1 -- 172.21.15.37:0/1831485154 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd4480165e0 con 0x7fd45015c780 2024-05-30T06:56:59.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.240+0000 7fd454a00640 1 -- 172.21.15.37:0/1831485154 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd45009c080 con 0x7fd42c069a90 2024-05-30T06:56:59.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.256+0000 7fd446a00640 1 -- 172.21.15.37:0/1831485154 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd45009c080 con 0x7fd42c069a90 2024-05-30T06:56:59.259 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:59.259 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:56:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:56:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ss1" 2024-05-30T06:56:59.260 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:56:59.260 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:56:59.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.260+0000 7fd454a00640 1 -- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd42c069a90 msgr2=0x7fd42c06bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.260+0000 7fd454a00640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd42c069a90 0x7fd42c06bf50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd440009a50 tx=0x7fd440008040 comp rx=0 tx=0).stop 2024-05-30T06:56:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.260+0000 7fd454a00640 1 -- 172.21.15.37:0/1831485154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45015c780 msgr2=0x7fd45015d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.260+0000 7fd454a00640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45015c780 0x7fd45015d880 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fd4480af040 tx=0x7fd448019760 comp rx=0 tx=0).stop 2024-05-30T06:56:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.260+0000 7fd454a00640 1 -- 172.21.15.37:0/1831485154 shutdown_connections 2024-05-30T06:56:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.260+0000 7fd454a00640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd45015c780 0x7fd45015d880 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.260+0000 7fd454a00640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd42c069a90 0x7fd42c06bf50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.260+0000 7fd454a00640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd45009b5a0 0x7fd45006d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.260+0000 7fd454a00640 1 --2- 172.21.15.37:0/1831485154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd45009aa60 0x7fd4500b8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.260+0000 7fd454a00640 1 -- 172.21.15.37:0/1831485154 >> 172.21.15.37:0/1831485154 conn(0x7fd4500d26a0 msgr2=0x7fd45015b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.260+0000 7fd454a00640 1 -- 172.21.15.37:0/1831485154 shutdown_connections 2024-05-30T06:56:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.260+0000 7fd454a00640 1 -- 172.21.15.37:0/1831485154 wait complete. 2024-05-30T06:56:59.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T06:56:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.424+0000 7fc619400640 1 Processor -- start 2024-05-30T06:56:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.424+0000 7fc619400640 1 -- start start 2024-05-30T06:56:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc619400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc61415d350 0x7fc61406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc619400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc61415d7e0 0x7fc61406e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc619400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc614142030 con 0x7fc6140b59d0 2024-05-30T06:56:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc619400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc614142310 con 0x7fc61415d350 2024-05-30T06:56:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc619400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc6141425f0 con 0x7fc61415d7e0 2024-05-30T06:56:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc609e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc61415d350 0x7fc61406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc612800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc6140b59d0 0x7fc6140b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34312/0 (socket says 172.21.15.37:34312) 2024-05-30T06:56:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc612800640 1 -- 172.21.15.37:0/3420211642 learned_addr learned my addr 172.21.15.37:0/3420211642 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:56:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc613200640 1 --2- 172.21.15.37:0/3420211642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc61415d7e0 0x7fc61406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc609e00640 1 -- 172.21.15.37:0/3420211642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc61415d7e0 msgr2=0x7fc61406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc609e00640 1 --2- 172.21.15.37:0/3420211642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc61415d7e0 0x7fc61406e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc609e00640 1 -- 172.21.15.37:0/3420211642 >> v1:172.21.15.37:6789/0 conn(0x7fc6140b59d0 legacy=0x7fc6140b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc609e00640 1 -- 172.21.15.37:0/3420211642 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6141428d0 con 0x7fc61415d350 2024-05-30T06:56:59.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc611e00640 1 -- 172.21.15.37:0/3420211642 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038693197 0 0) 0x7fc614142030 con 0x7fc6140b59d0 2024-05-30T06:56:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.428+0000 7fc609e00640 1 --2- 172.21.15.37:0/3420211642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415d350 0x7fc61406df50 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0097f0 tx=0x7fc5fc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbb00716948e784 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc611e00640 1 -- 172.21.15.37:0/3420211642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0b5070 con 0x7fc61415d350 2024-05-30T06:56:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc611e00640 1 -- 172.21.15.37:0/3420211642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5fc0a8990 con 0x7fc61415d350 2024-05-30T06:56:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc611e00640 1 -- 172.21.15.37:0/3420211642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0a8d60 con 0x7fc61415d350 2024-05-30T06:56:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 -- 172.21.15.37:0/3420211642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415d350 msgr2=0x7fc61406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 --2- 172.21.15.37:0/3420211642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415d350 0x7fc61406df50 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0097f0 tx=0x7fc5fc01ec90 comp rx=0 tx=0).stop 2024-05-30T06:56:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 -- 172.21.15.37:0/3420211642 shutdown_connections 2024-05-30T06:56:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 --2- 172.21.15.37:0/3420211642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc61415d7e0 0x7fc61406e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 --2- 172.21.15.37:0/3420211642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415d350 0x7fc61406df50 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 -- 172.21.15.37:0/3420211642 >> 172.21.15.37:0/3420211642 conn(0x7fc61406bf60 msgr2=0x7fc6140b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 -- 172.21.15.37:0/3420211642 shutdown_connections 2024-05-30T06:56:59.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 -- 172.21.15.37:0/3420211642 wait complete. 2024-05-30T06:56:59.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 Processor -- start 2024-05-30T06:56:59.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 -- start start 2024-05-30T06:56:59.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140b59d0 0x7fc614154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc61415d350 0x7fc614151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415d7e0 0x7fc614138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140b00a0 con 0x7fc61415d7e0 2024-05-30T06:56:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140aff20 con 0x7fc61415d350 2024-05-30T06:56:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc619400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc61413f860 con 0x7fc6140b59d0 2024-05-30T06:56:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc613200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415d7e0 0x7fc614138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc613200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415d7e0 0x7fc614138ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42822/0 (socket says 172.21.15.37:42822) 2024-05-30T06:56:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc613200640 1 -- 172.21.15.37:0/895404252 learned_addr learned my addr 172.21.15.37:0/895404252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc612800640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140b59d0 0x7fc614154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc609e00640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc61415d350 0x7fc614151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc613200640 1 -- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140b59d0 msgr2=0x7fc614154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc613200640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140b59d0 0x7fc614154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc613200640 1 -- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc61415d350 msgr2=0x7fc614151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc613200640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc61415d350 0x7fc614151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc613200640 1 -- 172.21.15.37:0/895404252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc614141470 con 0x7fc61415d7e0 2024-05-30T06:56:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.432+0000 7fc609e00640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc61415d350 0x7fc614151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:56:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.436+0000 7fc613200640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415d7e0 0x7fc614138ae0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fc60c007e60 tx=0x7fc60c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.436+0000 7fc60b400640 1 -- 172.21.15.37:0/895404252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c014420 con 0x7fc61415d7e0 2024-05-30T06:56:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.436+0000 7fc60b400640 1 -- 172.21.15.37:0/895404252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60c019070 con 0x7fc61415d7e0 2024-05-30T06:56:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.436+0000 7fc60b400640 1 -- 172.21.15.37:0/895404252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c014820 con 0x7fc61415d7e0 2024-05-30T06:56:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.436+0000 7fc619400640 1 -- 172.21.15.37:0/895404252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6141531d0 con 0x7fc61415d7e0 2024-05-30T06:56:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.436+0000 7fc619400640 1 -- 172.21.15.37:0/895404252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6140b3630 con 0x7fc61415d7e0 2024-05-30T06:56:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.436+0000 7fc619400640 1 -- 172.21.15.37:0/895404252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc614068bc0 con 0x7fc61415d7e0 2024-05-30T06:56:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.436+0000 7fc60b400640 1 -- 172.21.15.37:0/895404252 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7fc60c0149c0 con 0x7fc61415d7e0 2024-05-30T06:56:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.436+0000 7fc60b400640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5f0069a90 0x7fc5f006bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.436+0000 7fc60b400640 1 -- 172.21.15.37:0/895404252 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7fc60c085f70 con 0x7fc61415d7e0 2024-05-30T06:56:59.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.436+0000 7fc612800640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5f0069a90 0x7fc5f006bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.440+0000 7fc612800640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5f0069a90 0x7fc5f006bf50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fc604000f70 tx=0x7fc604007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:59.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.440+0000 7fc60b400640 1 -- 172.21.15.37:0/895404252 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc60c058010 con 0x7fc61415d7e0 2024-05-30T06:56:59.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.636+0000 7fc619400640 1 -- 172.21.15.37:0/895404252 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc61406f0a0 con 0x7fc5f0069a90 2024-05-30T06:56:59.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.664+0000 7fc60b400640 1 -- 172.21.15.37:0/895404252 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc61406f0a0 con 0x7fc5f0069a90 2024-05-30T06:56:59.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:56:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.668+0000 7fc619400640 1 -- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5f0069a90 msgr2=0x7fc5f006bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.668+0000 7fc619400640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5f0069a90 0x7fc5f006bf50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fc604000f70 tx=0x7fc604007b60 comp rx=0 tx=0).stop 2024-05-30T06:56:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.668+0000 7fc619400640 1 -- 172.21.15.37:0/895404252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415d7e0 msgr2=0x7fc614138ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.668+0000 7fc619400640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415d7e0 0x7fc614138ae0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fc60c007e60 tx=0x7fc60c00e4b0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.668+0000 7fc619400640 1 -- 172.21.15.37:0/895404252 shutdown_connections 2024-05-30T06:56:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.668+0000 7fc619400640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415d7e0 0x7fc614138ae0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.668+0000 7fc619400640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5f0069a90 0x7fc5f006bf50 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.668+0000 7fc619400640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc61415d350 0x7fc614151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.668+0000 7fc619400640 1 --2- 172.21.15.37:0/895404252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140b59d0 0x7fc614154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.668+0000 7fc619400640 1 -- 172.21.15.37:0/895404252 >> 172.21.15.37:0/895404252 conn(0x7fc61406bf60 msgr2=0x7fc614140b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.668+0000 7fc619400640 1 -- 172.21.15.37:0/895404252 shutdown_connections 2024-05-30T06:56:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.668+0000 7fc619400640 1 -- 172.21.15.37:0/895404252 wait complete. 2024-05-30T06:56:59.691 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T06:56:59.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.832+0000 7f6d7ee00640 1 Processor -- start 2024-05-30T06:56:59.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.832+0000 7f6d7ee00640 1 -- start start 2024-05-30T06:56:59.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.832+0000 7f6d7ee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d780d0600 0x7f6d780cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.832+0000 7f6d7ee00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d780cffd0 0x7f6d780afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.832+0000 7f6d7ee00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d780af0d0 con 0x7f6d7815c9a0 2024-05-30T06:56:59.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.832+0000 7f6d7ee00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6d780ce000 con 0x7f6d780cffd0 2024-05-30T06:56:59.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.832+0000 7f6d7ee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6d780ce2e0 con 0x7f6d780d0600 2024-05-30T06:56:59.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.832+0000 7f6d7e400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d780cffd0 0x7f6d780afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.832+0000 7f6d7d000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6d7815c9a0 0x7f6d780d09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34326/0 (socket says 172.21.15.37:34326) 2024-05-30T06:56:59.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.832+0000 7f6d7d000640 1 -- 172.21.15.37:0/3172957383 learned_addr learned my addr 172.21.15.37:0/3172957383 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:56:59.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.832+0000 7f6d7e400640 1 --2- 172.21.15.37:0/3172957383 >> v2:172.21.15.37:3300/0 conn(0x7f6d780cffd0 0x7f6d780afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42828/0 (socket says 172.21.15.37:42828) 2024-05-30T06:56:59.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.832+0000 7f6d7da00640 1 --2- 172.21.15.37:0/3172957383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d780d0600 0x7f6d780cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d7e400640 1 -- 172.21.15.37:0/3172957383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d780d0600 msgr2=0x7f6d780cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:56:59.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d7e400640 1 --2- 172.21.15.37:0/3172957383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d780d0600 0x7f6d780cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d7e400640 1 -- 172.21.15.37:0/3172957383 >> v1:172.21.15.37:6789/0 conn(0x7f6d7815c9a0 legacy=0x7f6d780d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d7e400640 1 -- 172.21.15.37:0/3172957383 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d780af370 con 0x7f6d780cffd0 2024-05-30T06:56:59.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d7e400640 1 --2- 172.21.15.37:0/3172957383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cffd0 0x7f6d780afb70 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009dc0 tx=0x7f6d7001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1fc0d99ee0706 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:59.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d77e00640 1 -- 172.21.15.37:0/3172957383 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d700b2070 con 0x7f6d780cffd0 2024-05-30T06:56:59.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d77e00640 1 -- 172.21.15.37:0/3172957383 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d700a5910 con 0x7f6d780cffd0 2024-05-30T06:56:59.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d77e00640 1 -- 172.21.15.37:0/3172957383 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d700a5ce0 con 0x7f6d780cffd0 2024-05-30T06:56:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d7ee00640 1 -- 172.21.15.37:0/3172957383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cffd0 msgr2=0x7f6d780afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d7ee00640 1 --2- 172.21.15.37:0/3172957383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cffd0 0x7f6d780afb70 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009dc0 tx=0x7f6d7001c920 comp rx=0 tx=0).stop 2024-05-30T06:56:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d7ee00640 1 -- 172.21.15.37:0/3172957383 shutdown_connections 2024-05-30T06:56:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d7ee00640 1 --2- 172.21.15.37:0/3172957383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cffd0 0x7f6d780afb70 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d7ee00640 1 --2- 172.21.15.37:0/3172957383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d780d0600 0x7f6d780cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d7ee00640 1 -- 172.21.15.37:0/3172957383 >> 172.21.15.37:0/3172957383 conn(0x7f6d780b3ef0 msgr2=0x7f6d780b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:56:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.836+0000 7f6d7ee00640 1 -- 172.21.15.37:0/3172957383 shutdown_connections 2024-05-30T06:56:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7ee00640 1 -- 172.21.15.37:0/3172957383 wait complete. 2024-05-30T06:56:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7ee00640 1 Processor -- start 2024-05-30T06:56:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7ee00640 1 -- start start 2024-05-30T06:56:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7ee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cffd0 0x7f6d78164830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7ee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d780d0600 0x7f6d7815f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7ee00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d7815c9a0 0x7f6d78151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7ee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6d780b0c50 con 0x7f6d780cffd0 2024-05-30T06:56:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7ee00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6d780b0ad0 con 0x7f6d7815c9a0 2024-05-30T06:56:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7ee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6d780b0dd0 con 0x7f6d780d0600 2024-05-30T06:56:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cffd0 0x7f6d78164830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cffd0 0x7f6d78164830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42844/0 (socket says 172.21.15.37:42844) 2024-05-30T06:56:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7da00640 1 -- 172.21.15.37:0/293713976 learned_addr learned my addr 172.21.15.37:0/293713976 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:56:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7e400640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d7815c9a0 0x7f6d78151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7d000640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d780d0600 0x7f6d7815f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7da00640 1 -- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d780d0600 msgr2=0x7f6d7815f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7da00640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d780d0600 0x7f6d7815f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7da00640 1 -- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d7815c9a0 msgr2=0x7f6d78151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:56:59.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7da00640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d7815c9a0 0x7f6d78151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:56:59.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7da00640 1 -- 172.21.15.37:0/293713976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d780cced0 con 0x7f6d780cffd0 2024-05-30T06:56:59.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7d000640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d780d0600 0x7f6d7815f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:56:59.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7da00640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cffd0 0x7f6d78164830 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00d5f0 tx=0x7f6d6c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:59.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d75600640 1 -- 172.21.15.37:0/293713976 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0125f0 con 0x7f6d780cffd0 2024-05-30T06:56:59.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d75600640 1 -- 172.21.15.37:0/293713976 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d6c019070 con 0x7f6d780cffd0 2024-05-30T06:56:59.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d75600640 1 -- 172.21.15.37:0/293713976 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c0129b0 con 0x7f6d780cffd0 2024-05-30T06:56:59.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.840+0000 7f6d7ee00640 1 -- 172.21.15.37:0/293713976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d780b7e80 con 0x7f6d780cffd0 2024-05-30T06:56:59.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.844+0000 7f6d7ee00640 1 -- 172.21.15.37:0/293713976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d780b70c0 con 0x7f6d780cffd0 2024-05-30T06:56:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.844+0000 7f6d7ee00640 1 -- 172.21.15.37:0/293713976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d78068ab0 con 0x7f6d780cffd0 2024-05-30T06:56:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.844+0000 7f6d75600640 1 -- 172.21.15.37:0/293713976 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7f6d6c012b50 con 0x7f6d780cffd0 2024-05-30T06:56:59.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.844+0000 7f6d75600640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d58069ac0 0x7f6d5806bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:56:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.844+0000 7f6d75600640 1 -- 172.21.15.37:0/293713976 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f6d6c085a80 con 0x7f6d780cffd0 2024-05-30T06:56:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.844+0000 7f6d7d000640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d58069ac0 0x7f6d5806bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:56:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.844+0000 7f6d7d000640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d58069ac0 0x7f6d5806bf80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6d78070bf0 tx=0x7f6d64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:56:59.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:56:59.848+0000 7f6d75600640 1 -- 172.21.15.37:0/293713976 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6d6c057aa0 con 0x7f6d780cffd0 2024-05-30T06:57:00.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.044+0000 7f6d7ee00640 1 -- 172.21.15.37:0/293713976 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f6d780b80c0 con 0x7f6d58069ac0 2024-05-30T06:57:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.064+0000 7f6d75600640 1 -- 172.21.15.37:0/293713976 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6d64001c20 con 0x7f6d58069ac0 2024-05-30T06:57:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.068+0000 7f6d7ee00640 1 -- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d58069ac0 msgr2=0x7f6d5806bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.068+0000 7f6d7ee00640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d58069ac0 0x7f6d5806bf80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6d78070bf0 tx=0x7f6d64009040 comp rx=0 tx=0).stop 2024-05-30T06:57:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.068+0000 7f6d7ee00640 1 -- 172.21.15.37:0/293713976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cffd0 msgr2=0x7f6d78164830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.068+0000 7f6d7ee00640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cffd0 0x7f6d78164830 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00d5f0 tx=0x7f6d6c00dab0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.068+0000 7f6d7ee00640 1 -- 172.21.15.37:0/293713976 shutdown_connections 2024-05-30T06:57:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.068+0000 7f6d7ee00640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6d58069ac0 0x7f6d5806bf80 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.068+0000 7f6d7ee00640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d7815c9a0 0x7f6d78151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.068+0000 7f6d7ee00640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d780d0600 0x7f6d7815f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.068+0000 7f6d7ee00640 1 --2- 172.21.15.37:0/293713976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cffd0 0x7f6d78164830 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.068+0000 7f6d7ee00640 1 -- 172.21.15.37:0/293713976 >> 172.21.15.37:0/293713976 conn(0x7f6d780b3ef0 msgr2=0x7f6d78159070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.068+0000 7f6d7ee00640 1 -- 172.21.15.37:0/293713976 shutdown_connections 2024-05-30T06:57:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.068+0000 7f6d7ee00640 1 -- 172.21.15.37:0/293713976 wait complete. 2024-05-30T06:57:00.072 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:00.073+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:00.072 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:00.073+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:00.072 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:00.073+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:00.072 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:00.073+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:00.072 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:00.073+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:00.089 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:00.093+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:00.089 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:00.093+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:00.089 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:00.093+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:00.089 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:00.093+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:00.089 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:00.093+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:00.093 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs ss1clone1 2024-05-30T06:57:00.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.236+0000 7f1a7d200640 1 Processor -- start 2024-05-30T06:57:00.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.236+0000 7f1a7d200640 1 -- start start 2024-05-30T06:57:00.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a7d200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a781590c0 0x7f1a780cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:00.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a7d200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1a780cd400 0x7f1a780b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:00.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a7d200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a7815f230 con 0x7f1a780cde60 2024-05-30T06:57:00.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a7d200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7815f510 con 0x7f1a781590c0 2024-05-30T06:57:00.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a7d200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7815f7f0 con 0x7f1a780cd400 2024-05-30T06:57:00.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a75e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a781590c0 0x7f1a780cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:00.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a6d400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1a780cde60 0x7f1a7806f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34336/0 (socket says 172.21.15.37:34336) 2024-05-30T06:57:00.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a6d400640 1 -- 172.21.15.37:0/4219223260 learned_addr learned my addr 172.21.15.37:0/4219223260 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:00.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a76800640 1 --2- 172.21.15.37:0/4219223260 >> v2:172.21.15.105:3300/0 conn(0x7f1a780cd400 0x7f1a780b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:00.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a75400640 1 -- 172.21.15.37:0/4219223260 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059086495 0 0) 0x7f1a7815f230 con 0x7f1a780cde60 2024-05-30T06:57:00.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a75400640 1 -- 172.21.15.37:0/4219223260 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a5c003530 con 0x7f1a780cde60 2024-05-30T06:57:00.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a76800640 1 -- 172.21.15.37:0/4219223260 >> v2:172.21.15.37:3300/0 conn(0x7f1a781590c0 msgr2=0x7f1a780cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:00.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a76800640 1 --2- 172.21.15.37:0/4219223260 >> v2:172.21.15.37:3300/0 conn(0x7f1a781590c0 0x7f1a780cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a76800640 1 -- 172.21.15.37:0/4219223260 >> v1:172.21.15.37:6789/0 conn(0x7f1a780cde60 legacy=0x7f1a7806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:00.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.240+0000 7f1a76800640 1 -- 172.21.15.37:0/4219223260 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7815fad0 con 0x7f1a780cd400 2024-05-30T06:57:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a76800640 1 --2- 172.21.15.37:0/4219223260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a780cd400 0x7f1a780b3750 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1a780b2d30 tx=0x7f1a7001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed9db0dfe11b869f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a75400640 1 -- 172.21.15.37:0/4219223260 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a700b0070 con 0x7f1a780cd400 2024-05-30T06:57:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a75400640 1 -- 172.21.15.37:0/4219223260 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a700ab600 con 0x7f1a780cd400 2024-05-30T06:57:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a75400640 1 -- 172.21.15.37:0/4219223260 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a700ab9d0 con 0x7f1a780cd400 2024-05-30T06:57:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a7d200640 1 -- 172.21.15.37:0/4219223260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a780cd400 msgr2=0x7f1a780b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a7d200640 1 --2- 172.21.15.37:0/4219223260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a780cd400 0x7f1a780b3750 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1a780b2d30 tx=0x7f1a7001c360 comp rx=0 tx=0).stop 2024-05-30T06:57:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a7d200640 1 -- 172.21.15.37:0/4219223260 shutdown_connections 2024-05-30T06:57:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a7d200640 1 --2- 172.21.15.37:0/4219223260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a780cd400 0x7f1a780b3750 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a7d200640 1 --2- 172.21.15.37:0/4219223260 >> v2:172.21.15.37:3300/0 conn(0x7f1a781590c0 0x7f1a780cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a7d200640 1 -- 172.21.15.37:0/4219223260 >> 172.21.15.37:0/4219223260 conn(0x7f1a7806bf60 msgr2=0x7f1a780b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:00.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a7d200640 1 -- 172.21.15.37:0/4219223260 shutdown_connections 2024-05-30T06:57:00.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a7d200640 1 -- 172.21.15.37:0/4219223260 wait complete. 2024-05-30T06:57:00.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a7d200640 1 Processor -- start 2024-05-30T06:57:00.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.244+0000 7f1a7d200640 1 -- start start 2024-05-30T06:57:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a7d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a780cd400 0x7f1a7815cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a7d200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a780cde60 0x7f1a78158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a7d200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a781590c0 0x7f1a78141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a7d200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7806f8f0 con 0x7f1a780cd400 2024-05-30T06:57:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a7d200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7806f770 con 0x7f1a780cde60 2024-05-30T06:57:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a7d200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1a781684a0 con 0x7f1a781590c0 2024-05-30T06:57:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a75e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a780cd400 0x7f1a7815cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a75e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a780cd400 0x7f1a7815cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42868/0 (socket says 172.21.15.37:42868) 2024-05-30T06:57:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a75e00640 1 -- 172.21.15.37:0/3640829383 learned_addr learned my addr 172.21.15.37:0/3640829383 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a6d400640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a780cde60 0x7f1a78158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a76800640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a781590c0 0x7f1a78141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a75e00640 1 -- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a781590c0 msgr2=0x7f1a78141ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a75e00640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a781590c0 0x7f1a78141ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a75e00640 1 -- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a780cde60 msgr2=0x7f1a78158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a75e00640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a780cde60 0x7f1a78158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a75e00640 1 -- 172.21.15.37:0/3640829383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7815c0d0 con 0x7f1a780cd400 2024-05-30T06:57:00.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a75e00640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a780cd400 0x7f1a7815cff0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009d10 tx=0x7f1a6800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:00.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a6ea00640 1 -- 172.21.15.37:0/3640829383 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68018020 con 0x7f1a780cd400 2024-05-30T06:57:00.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a6ea00640 1 -- 172.21.15.37:0/3640829383 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a68014480 con 0x7f1a780cd400 2024-05-30T06:57:00.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a6ea00640 1 -- 172.21.15.37:0/3640829383 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68014830 con 0x7f1a780cd400 2024-05-30T06:57:00.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a7d200640 1 -- 172.21.15.37:0/3640829383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a7815c3b0 con 0x7f1a780cd400 2024-05-30T06:57:00.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a7d200640 1 -- 172.21.15.37:0/3640829383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a78158580 con 0x7f1a780cd400 2024-05-30T06:57:00.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.248+0000 7f1a7d200640 1 -- 172.21.15.37:0/3640829383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a78068d40 con 0x7f1a780cd400 2024-05-30T06:57:00.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.252+0000 7f1a6ea00640 1 -- 172.21.15.37:0/3640829383 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7f1a6801b020 con 0x7f1a780cd400 2024-05-30T06:57:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.252+0000 7f1a6ea00640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a54069a90 0x7f1a5406bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.252+0000 7f1a6ea00640 1 -- 172.21.15.37:0/3640829383 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5737+0+0 (secure 0 0 0) 0x7f1a680860d0 con 0x7f1a780cd400 2024-05-30T06:57:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.252+0000 7f1a6d400640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a54069a90 0x7f1a5406bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:00.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.252+0000 7f1a6d400640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a54069a90 0x7f1a5406bf50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1a780b1cd0 tx=0x7f1a60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.256+0000 7f1a6ea00640 1 -- 172.21.15.37:0/3640829383 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1a68022070 con 0x7f1a780cd400 2024-05-30T06:57:00.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.448+0000 7f1a7d200640 1 -- 172.21.15.37:0/3640829383 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "ss1clone1", "target": ["mon-mgr", ""]}) -- 0x7f1a7815d530 con 0x7f1a54069a90 2024-05-30T06:57:00.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.472+0000 7f1a6ea00640 1 -- 172.21.15.37:0/3640829383 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1a60001500 con 0x7f1a54069a90 2024-05-30T06:57:00.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.476+0000 7f1a7d200640 1 -- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a54069a90 msgr2=0x7f1a5406bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:00.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.476+0000 7f1a7d200640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a54069a90 0x7f1a5406bf50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1a780b1cd0 tx=0x7f1a60009040 comp rx=0 tx=0).stop 2024-05-30T06:57:00.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.476+0000 7f1a7d200640 1 -- 172.21.15.37:0/3640829383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a780cd400 msgr2=0x7f1a7815cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:00.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.476+0000 7f1a7d200640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a780cd400 0x7f1a7815cff0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009d10 tx=0x7f1a6800c490 comp rx=0 tx=0).stop 2024-05-30T06:57:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.476+0000 7f1a7d200640 1 -- 172.21.15.37:0/3640829383 shutdown_connections 2024-05-30T06:57:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.476+0000 7f1a7d200640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a781590c0 0x7f1a78141ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.476+0000 7f1a7d200640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a54069a90 0x7f1a5406bf50 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.476+0000 7f1a7d200640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a780cde60 0x7f1a78158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.476+0000 7f1a7d200640 1 --2- 172.21.15.37:0/3640829383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a780cd400 0x7f1a7815cff0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.476+0000 7f1a7d200640 1 -- 172.21.15.37:0/3640829383 >> 172.21.15.37:0/3640829383 conn(0x7f1a7806bf60 msgr2=0x7f1a780b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.476+0000 7f1a7d200640 1 -- 172.21.15.37:0/3640829383 shutdown_connections 2024-05-30T06:57:00.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00.476+0000 7f1a7d200640 1 -- 172.21.15.37:0/3640829383 wait complete. 2024-05-30T06:57:00.500 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T06:57:00.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:57:00.554 INFO:teuthology.orchestra.run.smithi037.stdout:2 2024-05-30T06:57:00.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:57:00.562 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:57:00.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:57:00.672 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:57:00.763 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:57:00.764 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:57:00.764 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:57:00.764 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:57:00.773 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:57:00.773 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:57:00.830 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:57:01.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb77ac00640 1 Processor -- start 2024-05-30T06:57:01.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb77ac00640 1 -- start start 2024-05-30T06:57:01.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb77ac00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7740b2e20 0x7fb774160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb77ac00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb7741609c0 0x7fb774160e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb77ac00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7740d0430 con 0x7fb7740cd280 2024-05-30T06:57:01.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb77ac00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb7740b3200 con 0x7fb7740b2e20 2024-05-30T06:57:01.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb77ac00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb7740d01e0 con 0x7fb7741609c0 2024-05-30T06:57:01.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb773e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7740b2e20 0x7fb774160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb773e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7740b2e20 0x7fb774160480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42876/0 (socket says 172.21.15.37:42876) 2024-05-30T06:57:01.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb773e00640 1 -- 172.21.15.37:0/385286238 learned_addr learned my addr 172.21.15.37:0/385286238 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:01.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb773400640 1 --2- 172.21.15.37:0/385286238 >> v2:172.21.15.105:3300/0 conn(0x7fb7741609c0 0x7fb774160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb773e00640 1 -- 172.21.15.37:0/385286238 >> v2:172.21.15.105:3300/0 conn(0x7fb7741609c0 msgr2=0x7fb774160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:01.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb773e00640 1 --2- 172.21.15.37:0/385286238 >> v2:172.21.15.105:3300/0 conn(0x7fb7741609c0 0x7fb774160e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb773e00640 1 -- 172.21.15.37:0/385286238 >> v1:172.21.15.105:6789/0 conn(0x7fb7740cd280 legacy=0x7fb7740cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.012+0000 7fb773e00640 1 -- 172.21.15.37:0/385286238 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7740d0710 con 0x7fb7740b2e20 2024-05-30T06:57:01.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.016+0000 7fb773e00640 1 --2- 172.21.15.37:0/385286238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7740b2e20 0x7fb774160480 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fb7740c5fe0 tx=0x7fb76401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f27ca6e5e2e857 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:01.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.016+0000 7fb772a00640 1 -- 172.21.15.37:0/385286238 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7640b1070 con 0x7fb7740b2e20 2024-05-30T06:57:01.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.016+0000 7fb772a00640 1 -- 172.21.15.37:0/385286238 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7640ac630 con 0x7fb7740b2e20 2024-05-30T06:57:01.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.016+0000 7fb772a00640 1 -- 172.21.15.37:0/385286238 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7640a8050 con 0x7fb7740b2e20 2024-05-30T06:57:01.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.016+0000 7fb77ac00640 1 -- 172.21.15.37:0/385286238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7740b2e20 msgr2=0x7fb774160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.016+0000 7fb77ac00640 1 --2- 172.21.15.37:0/385286238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7740b2e20 0x7fb774160480 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fb7740c5fe0 tx=0x7fb76401c520 comp rx=0 tx=0).stop 2024-05-30T06:57:01.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.016+0000 7fb77ac00640 1 -- 172.21.15.37:0/385286238 shutdown_connections 2024-05-30T06:57:01.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.016+0000 7fb77ac00640 1 --2- 172.21.15.37:0/385286238 >> v2:172.21.15.105:3300/0 conn(0x7fb7741609c0 0x7fb774160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.016+0000 7fb77ac00640 1 --2- 172.21.15.37:0/385286238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7740b2e20 0x7fb774160480 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.016+0000 7fb77ac00640 1 -- 172.21.15.37:0/385286238 >> 172.21.15.37:0/385286238 conn(0x7fb7740b4100 msgr2=0x7fb7740b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:01.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.016+0000 7fb77ac00640 1 -- 172.21.15.37:0/385286238 shutdown_connections 2024-05-30T06:57:01.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.016+0000 7fb77ac00640 1 -- 172.21.15.37:0/385286238 wait complete. 2024-05-30T06:57:01.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.016+0000 7fb77ac00640 1 Processor -- start 2024-05-30T06:57:01.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb77ac00640 1 -- start start 2024-05-30T06:57:01.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb77ac00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7740b2e20 0x7fb77415f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb77ac00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7740cd280 0x7fb7741594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb77ac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7741609c0 0x7fb774159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb77ac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb774169940 con 0x7fb7741609c0 2024-05-30T06:57:01.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb77ac00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb7741697c0 con 0x7fb7740cd280 2024-05-30T06:57:01.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb77ac00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb774169ac0 con 0x7fb7740b2e20 2024-05-30T06:57:01.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb778c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7741609c0 0x7fb774159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb778c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7741609c0 0x7fb774159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42888/0 (socket says 172.21.15.37:42888) 2024-05-30T06:57:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb778c00640 1 -- 172.21.15.37:0/908015671 learned_addr learned my addr 172.21.15.37:0/908015671 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb773e00640 1 --2- 172.21.15.37:0/908015671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7740b2e20 0x7fb77415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb773400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7740cd280 0x7fb7741594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb778c00640 1 -- 172.21.15.37:0/908015671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7740b2e20 msgr2=0x7fb77415f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb778c00640 1 --2- 172.21.15.37:0/908015671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7740b2e20 0x7fb77415f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb778c00640 1 -- 172.21.15.37:0/908015671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7740cd280 msgr2=0x7fb7741594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb778c00640 1 --2- 172.21.15.37:0/908015671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7740cd280 0x7fb7741594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb778c00640 1 -- 172.21.15.37:0/908015671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7740b5590 con 0x7fb7741609c0 2024-05-30T06:57:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb778c00640 1 --2- 172.21.15.37:0/908015671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7741609c0 0x7fb774159a10 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c730 tx=0x7fb76c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb76be00640 1 -- 172.21.15.37:0/908015671 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c003b80 con 0x7fb7741609c0 2024-05-30T06:57:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb76be00640 1 -- 172.21.15.37:0/908015671 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb76c003d20 con 0x7fb7741609c0 2024-05-30T06:57:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb76be00640 1 -- 172.21.15.37:0/908015671 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00aa30 con 0x7fb7741609c0 2024-05-30T06:57:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb77ac00640 1 -- 172.21.15.37:0/908015671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7740b5870 con 0x7fb7741609c0 2024-05-30T06:57:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb77ac00640 1 -- 172.21.15.37:0/908015671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7740b5e30 con 0x7fb7741609c0 2024-05-30T06:57:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.020+0000 7fb77ac00640 1 -- 172.21.15.37:0/908015671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb774068b20 con 0x7fb7741609c0 2024-05-30T06:57:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.024+0000 7fb76be00640 1 -- 172.21.15.37:0/908015671 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7fb76c00abd0 con 0x7fb7741609c0 2024-05-30T06:57:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.024+0000 7fb76be00640 1 --2- 172.21.15.37:0/908015671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb754069a90 0x7fb75406bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.024+0000 7fb76be00640 1 -- 172.21.15.37:0/908015671 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7fb76c0854c0 con 0x7fb7741609c0 2024-05-30T06:57:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.024+0000 7fb773e00640 1 --2- 172.21.15.37:0/908015671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb754069a90 0x7fb75406bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.024+0000 7fb773e00640 1 --2- 172.21.15.37:0/908015671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb754069a90 0x7fb75406bf50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb7640ae000 tx=0x7fb7640a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.028+0000 7fb76be00640 1 -- 172.21.15.37:0/908015671 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb76c056e90 con 0x7fb7741609c0 2024-05-30T06:57:01.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.192+0000 7fb77ac00640 1 -- 172.21.15.37:0/908015671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7740ce860 con 0x7fb7741609c0 2024-05-30T06:57:01.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.196+0000 7fb76be00640 1 -- 172.21.15.37:0/908015671 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16762 (secure 0 0 0) 0x7fb76c05b190 con 0x7fb7741609c0 2024-05-30T06:57:01.197 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:01.198 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":103,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:57:00.682415+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:55:32.713799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-05-30T06:55:33.276484+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:57:01.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.196+0000 7fb77ac00640 1 -- 172.21.15.37:0/908015671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb754069a90 msgr2=0x7fb75406bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.196+0000 7fb77ac00640 1 --2- 172.21.15.37:0/908015671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb754069a90 0x7fb75406bf50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb7640ae000 tx=0x7fb7640a7000 comp rx=0 tx=0).stop 2024-05-30T06:57:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.196+0000 7fb77ac00640 1 -- 172.21.15.37:0/908015671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7741609c0 msgr2=0x7fb774159a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.196+0000 7fb77ac00640 1 --2- 172.21.15.37:0/908015671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7741609c0 0x7fb774159a10 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c730 tx=0x7fb76c00cbf0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.196+0000 7fb77ac00640 1 -- 172.21.15.37:0/908015671 shutdown_connections 2024-05-30T06:57:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.196+0000 7fb77ac00640 1 --2- 172.21.15.37:0/908015671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7741609c0 0x7fb774159a10 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.196+0000 7fb77ac00640 1 --2- 172.21.15.37:0/908015671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb754069a90 0x7fb75406bf50 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.196+0000 7fb77ac00640 1 --2- 172.21.15.37:0/908015671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7740cd280 0x7fb7741594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.196+0000 7fb77ac00640 1 --2- 172.21.15.37:0/908015671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7740b2e20 0x7fb77415f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.196+0000 7fb77ac00640 1 -- 172.21.15.37:0/908015671 >> 172.21.15.37:0/908015671 conn(0x7fb7740b4100 msgr2=0x7fb774070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.196+0000 7fb77ac00640 1 -- 172.21.15.37:0/908015671 shutdown_connections 2024-05-30T06:57:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.196+0000 7fb77ac00640 1 -- 172.21.15.37:0/908015671 wait complete. 2024-05-30T06:57:01.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:55:32.713799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:55:33.276484+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 103, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:57:01.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:57:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.360+0000 7fd141a00640 1 Processor -- start 2024-05-30T06:57:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.360+0000 7fd141a00640 1 -- start start 2024-05-30T06:57:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd141a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd13c15e890 0x7fd13c15ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd141a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd13c0b63d0 0x7fd13c15f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd141a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd13c0b4160 0x7fd13c0b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd141a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd13c06e080 con 0x7fd13c0b4160 2024-05-30T06:57:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd141a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd13c15f6f0 con 0x7fd13c0b63d0 2024-05-30T06:57:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd141a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd13c0cf780 con 0x7fd13c15e890 2024-05-30T06:57:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd13b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd13c0b4160 0x7fd13c0b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd13b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd13c0b4160 0x7fd13c0b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42898/0 (socket says 172.21.15.37:42898) 2024-05-30T06:57:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd13b400640 1 -- 172.21.15.37:0/204982560 learned_addr learned my addr 172.21.15.37:0/204982560 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd132000640 1 --2- 172.21.15.37:0/204982560 >> v2:172.21.15.105:3300/0 conn(0x7fd13c0b63d0 0x7fd13c15f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd13aa00640 1 --2- 172.21.15.37:0/204982560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd13c15e890 0x7fd13c15ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd13b400640 1 -- 172.21.15.37:0/204982560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd13c15e890 msgr2=0x7fd13c15ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd13b400640 1 --2- 172.21.15.37:0/204982560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd13c15e890 0x7fd13c15ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd13b400640 1 -- 172.21.15.37:0/204982560 >> v2:172.21.15.105:3300/0 conn(0x7fd13c0b63d0 msgr2=0x7fd13c15f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd13b400640 1 --2- 172.21.15.37:0/204982560 >> v2:172.21.15.105:3300/0 conn(0x7fd13c0b63d0 0x7fd13c15f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.364+0000 7fd13b400640 1 -- 172.21.15.37:0/204982560 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13c0cfa40 con 0x7fd13c0b4160 2024-05-30T06:57:01.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd13b400640 1 --2- 172.21.15.37:0/204982560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0b4160 0x7fd13c0b45f0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd13c06c4c0 tx=0x7fd13401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c58d3cec63d34d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:01.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd13a000640 1 -- 172.21.15.37:0/204982560 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1340ab430 con 0x7fd13c0b4160 2024-05-30T06:57:01.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd13a000640 1 -- 172.21.15.37:0/204982560 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1340b0070 con 0x7fd13c0b4160 2024-05-30T06:57:01.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd13a000640 1 -- 172.21.15.37:0/204982560 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1340ab7f0 con 0x7fd13c0b4160 2024-05-30T06:57:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd141a00640 1 -- 172.21.15.37:0/204982560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0b4160 msgr2=0x7fd13c0b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd141a00640 1 --2- 172.21.15.37:0/204982560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0b4160 0x7fd13c0b45f0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd13c06c4c0 tx=0x7fd13401c4f0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd141a00640 1 -- 172.21.15.37:0/204982560 shutdown_connections 2024-05-30T06:57:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd141a00640 1 --2- 172.21.15.37:0/204982560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0b4160 0x7fd13c0b45f0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd141a00640 1 --2- 172.21.15.37:0/204982560 >> v2:172.21.15.105:3300/0 conn(0x7fd13c0b63d0 0x7fd13c15f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd141a00640 1 --2- 172.21.15.37:0/204982560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd13c15e890 0x7fd13c15ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd141a00640 1 -- 172.21.15.37:0/204982560 >> 172.21.15.37:0/204982560 conn(0x7fd13c06bf60 msgr2=0x7fd13c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:01.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd141a00640 1 -- 172.21.15.37:0/204982560 shutdown_connections 2024-05-30T06:57:01.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd141a00640 1 -- 172.21.15.37:0/204982560 wait complete. 2024-05-30T06:57:01.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd141a00640 1 Processor -- start 2024-05-30T06:57:01.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.368+0000 7fd141a00640 1 -- start start 2024-05-30T06:57:01.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd141a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0b4160 0x7fd13c149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd141a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd13c0b63d0 0x7fd13c151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd141a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd13c15e890 0x7fd13c1518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd141a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd13c0b5c60 con 0x7fd13c0b4160 2024-05-30T06:57:01.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd141a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd13c15b070 con 0x7fd13c0b63d0 2024-05-30T06:57:01.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd141a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd13c06f620 con 0x7fd13c15e890 2024-05-30T06:57:01.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd13aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0b4160 0x7fd13c149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd13aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0b4160 0x7fd13c149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42900/0 (socket says 172.21.15.37:42900) 2024-05-30T06:57:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd13aa00640 1 -- 172.21.15.37:0/3157431349 learned_addr learned my addr 172.21.15.37:0/3157431349 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd13b400640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd13c15e890 0x7fd13c1518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd132000640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd13c0b63d0 0x7fd13c151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd13aa00640 1 -- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd13c15e890 msgr2=0x7fd13c1518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd13aa00640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd13c15e890 0x7fd13c1518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd13aa00640 1 -- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd13c0b63d0 msgr2=0x7fd13c151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd13aa00640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd13c0b63d0 0x7fd13c151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd13aa00640 1 -- 172.21.15.37:0/3157431349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13c14a1e0 con 0x7fd13c0b4160 2024-05-30T06:57:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd13b400640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd13c15e890 0x7fd13c1518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:57:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd132000640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd13c0b63d0 0x7fd13c151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:57:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd13aa00640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0b4160 0x7fd13c149820 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fd12c007f20 tx=0x7fd12c00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd133400640 1 -- 172.21.15.37:0/3157431349 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c014620 con 0x7fd13c0b4160 2024-05-30T06:57:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd133400640 1 -- 172.21.15.37:0/3157431349 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd12c019070 con 0x7fd13c0b4160 2024-05-30T06:57:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd141a00640 1 -- 172.21.15.37:0/3157431349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd13c0b05e0 con 0x7fd13c0b4160 2024-05-30T06:57:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd133400640 1 -- 172.21.15.37:0/3157431349 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12c014a00 con 0x7fd13c0b4160 2024-05-30T06:57:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd141a00640 1 -- 172.21.15.37:0/3157431349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd13c14a4c0 con 0x7fd13c0b4160 2024-05-30T06:57:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd141a00640 1 -- 172.21.15.37:0/3157431349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd13c068bc0 con 0x7fd13c0b4160 2024-05-30T06:57:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.372+0000 7fd133400640 1 -- 172.21.15.37:0/3157431349 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7fd12c014ba0 con 0x7fd13c0b4160 2024-05-30T06:57:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.376+0000 7fd133400640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd118069a90 0x7fd11806bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.376+0000 7fd133400640 1 -- 172.21.15.37:0/3157431349 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7fd12c085ee0 con 0x7fd13c0b4160 2024-05-30T06:57:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.376+0000 7fd132000640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd118069a90 0x7fd11806bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.376+0000 7fd132000640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd118069a90 0x7fd11806bf50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd13c156120 tx=0x7fd124008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:01.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.380+0000 7fd133400640 1 -- 172.21.15.37:0/3157431349 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd12c0578b0 con 0x7fd13c0b4160 2024-05-30T06:57:01.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.544+0000 7fd141a00640 1 -- 172.21.15.37:0/3157431349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd13c14fd30 con 0x7fd13c0b4160 2024-05-30T06:57:01.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.544+0000 7fd133400640 1 -- 172.21.15.37:0/3157431349 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) ==== 93+0+10 (secure 0 0 0) 0x7fd12c05bbb0 con 0x7fd13c0b4160 2024-05-30T06:57:01.548 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:57:01.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.548+0000 7fd141a00640 1 -- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd118069a90 msgr2=0x7fd11806bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.548+0000 7fd141a00640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd118069a90 0x7fd11806bf50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd13c156120 tx=0x7fd124008040 comp rx=0 tx=0).stop 2024-05-30T06:57:01.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.548+0000 7fd141a00640 1 -- 172.21.15.37:0/3157431349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0b4160 msgr2=0x7fd13c149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.548+0000 7fd141a00640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0b4160 0x7fd13c149820 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fd12c007f20 tx=0x7fd12c00e570 comp rx=0 tx=0).stop 2024-05-30T06:57:01.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.548+0000 7fd141a00640 1 -- 172.21.15.37:0/3157431349 shutdown_connections 2024-05-30T06:57:01.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.548+0000 7fd141a00640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd13c15e890 0x7fd13c1518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.548+0000 7fd141a00640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd118069a90 0x7fd11806bf50 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.548+0000 7fd141a00640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd13c0b63d0 0x7fd13c151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.548+0000 7fd141a00640 1 --2- 172.21.15.37:0/3157431349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd13c0b4160 0x7fd13c149820 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.548+0000 7fd141a00640 1 -- 172.21.15.37:0/3157431349 >> 172.21.15.37:0/3157431349 conn(0x7fd13c06bf60 msgr2=0x7fd13c15b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:01.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.548+0000 7fd141a00640 1 -- 172.21.15.37:0/3157431349 shutdown_connections 2024-05-30T06:57:01.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.548+0000 7fd141a00640 1 -- 172.21.15.37:0/3157431349 wait complete. 2024-05-30T06:57:01.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:57:01.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.712+0000 7f47d2000640 1 Processor -- start 2024-05-30T06:57:01.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.712+0000 7f47d2000640 1 -- start start 2024-05-30T06:57:01.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.712+0000 7f47d2000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47cc155da0 0x7f47cc0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.712+0000 7f47d2000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47cc0cd440 0x7f47cc06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.712+0000 7f47d2000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47cc15f310 con 0x7f47cc06f5a0 2024-05-30T06:57:01.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.712+0000 7f47d2000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f47cc06fa10 con 0x7f47cc155da0 2024-05-30T06:57:01.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.712+0000 7f47d2000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f47cc0b4760 con 0x7f47cc0cd440 2024-05-30T06:57:01.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.712+0000 7f47cb400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47cc155da0 0x7f47cc0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.712+0000 7f47cbe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f47cc06f5a0 0x7f47cc0cf4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34346/0 (socket says 172.21.15.37:34346) 2024-05-30T06:57:01.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.712+0000 7f47cbe00640 1 -- 172.21.15.37:0/2157226300 learned_addr learned my addr 172.21.15.37:0/2157226300 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:01.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.712+0000 7f47c2a00640 1 --2- 172.21.15.37:0/2157226300 >> v2:172.21.15.105:3300/0 conn(0x7f47cc0cd440 0x7f47cc06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.712+0000 7f47cb400640 1 -- 172.21.15.37:0/2157226300 >> v2:172.21.15.105:3300/0 conn(0x7f47cc0cd440 msgr2=0x7f47cc06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:01.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.712+0000 7f47cb400640 1 --2- 172.21.15.37:0/2157226300 >> v2:172.21.15.105:3300/0 conn(0x7f47cc0cd440 0x7f47cc06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47cb400640 1 -- 172.21.15.37:0/2157226300 >> v1:172.21.15.37:6789/0 conn(0x7f47cc06f5a0 legacy=0x7f47cc0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47cb400640 1 -- 172.21.15.37:0/2157226300 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47cc15f5f0 con 0x7f47cc155da0 2024-05-30T06:57:01.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47c2a00640 1 --2- 172.21.15.37:0/2157226300 >> v2:172.21.15.105:3300/0 conn(0x7f47cc0cd440 0x7f47cc06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:01.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47caa00640 1 -- 172.21.15.37:0/2157226300 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4029097625 0 0) 0x7f47cc15f310 con 0x7f47cc06f5a0 2024-05-30T06:57:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47cb400640 1 --2- 172.21.15.37:0/2157226300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc155da0 0x7f47cc0cd950 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0b2f00 tx=0x7f47bc01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74368a7a00a234b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47caa00640 1 -- 172.21.15.37:0/2157226300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0b0070 con 0x7f47cc155da0 2024-05-30T06:57:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47caa00640 1 -- 172.21.15.37:0/2157226300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47bc0ab600 con 0x7f47cc155da0 2024-05-30T06:57:01.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47caa00640 1 -- 172.21.15.37:0/2157226300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0ab9d0 con 0x7f47cc155da0 2024-05-30T06:57:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47d2000640 1 -- 172.21.15.37:0/2157226300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc155da0 msgr2=0x7f47cc0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47d2000640 1 --2- 172.21.15.37:0/2157226300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc155da0 0x7f47cc0cd950 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0b2f00 tx=0x7f47bc01c360 comp rx=0 tx=0).stop 2024-05-30T06:57:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47d2000640 1 -- 172.21.15.37:0/2157226300 shutdown_connections 2024-05-30T06:57:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47d2000640 1 --2- 172.21.15.37:0/2157226300 >> v2:172.21.15.105:3300/0 conn(0x7f47cc0cd440 0x7f47cc06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47d2000640 1 --2- 172.21.15.37:0/2157226300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc155da0 0x7f47cc0cd950 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47d2000640 1 -- 172.21.15.37:0/2157226300 >> 172.21.15.37:0/2157226300 conn(0x7f47cc06bf60 msgr2=0x7f47cc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:01.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47d2000640 1 -- 172.21.15.37:0/2157226300 shutdown_connections 2024-05-30T06:57:01.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.716+0000 7f47d2000640 1 -- 172.21.15.37:0/2157226300 wait complete. 2024-05-30T06:57:01.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47d2000640 1 Processor -- start 2024-05-30T06:57:01.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47d2000640 1 -- start start 2024-05-30T06:57:01.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47d2000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47cc06f5a0 0x7f47cc15e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47d2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc155da0 0x7f47cc1571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47d2000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc15aa30 0x7f47cc157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47d2000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc0b4e20 con 0x7f47cc155da0 2024-05-30T06:57:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47d2000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47cc0b4ca0 con 0x7f47cc06f5a0 2024-05-30T06:57:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47d2000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47cc168580 con 0x7f47cc15aa30 2024-05-30T06:57:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47c2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc155da0 0x7f47cc1571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47c2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc155da0 0x7f47cc1571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42922/0 (socket says 172.21.15.37:42922) 2024-05-30T06:57:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47c2a00640 1 -- 172.21.15.37:0/2237642740 learned_addr learned my addr 172.21.15.37:0/2237642740 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47cb400640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47cc06f5a0 0x7f47cc15e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47cbe00640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc15aa30 0x7f47cc157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47c2a00640 1 -- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc15aa30 msgr2=0x7f47cc157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47c2a00640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc15aa30 0x7f47cc157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47c2a00640 1 -- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47cc06f5a0 msgr2=0x7f47cc15e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47c2a00640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47cc06f5a0 0x7f47cc15e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47c2a00640 1 -- 172.21.15.37:0/2237642740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47cc15b1d0 con 0x7f47cc155da0 2024-05-30T06:57:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47cbe00640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc15aa30 0x7f47cc157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:01.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47c2a00640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc155da0 0x7f47cc1571e0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e840 tx=0x7f47b400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47c3e00640 1 -- 172.21.15.37:0/2237642740 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4017070 con 0x7f47cc155da0 2024-05-30T06:57:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47c3e00640 1 -- 172.21.15.37:0/2237642740 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b400c8d0 con 0x7f47cc155da0 2024-05-30T06:57:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47c3e00640 1 -- 172.21.15.37:0/2237642740 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b400f040 con 0x7f47cc155da0 2024-05-30T06:57:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.720+0000 7f47d2000640 1 -- 172.21.15.37:0/2237642740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47cc15b4b0 con 0x7f47cc155da0 2024-05-30T06:57:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.724+0000 7f47d2000640 1 -- 172.21.15.37:0/2237642740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47cc15b790 con 0x7f47cc155da0 2024-05-30T06:57:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.724+0000 7f47d2000640 1 -- 172.21.15.37:0/2237642740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47cc068bc0 con 0x7f47cc155da0 2024-05-30T06:57:01.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.724+0000 7f47c3e00640 1 -- 172.21.15.37:0/2237642740 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) ==== 90078+0+0 (secure 0 0 0) 0x7f47b401a070 con 0x7f47cc155da0 2024-05-30T06:57:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.724+0000 7f47c3e00640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f47a8069a90 0x7f47a806bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.724+0000 7f47c3e00640 1 -- 172.21.15.37:0/2237642740 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7f47b40852f0 con 0x7f47cc155da0 2024-05-30T06:57:01.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.724+0000 7f47cb400640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f47a8069a90 0x7f47a806bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:01.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.728+0000 7f47cb400640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f47a8069a90 0x7f47a806bf50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0ad000 tx=0x7f47bc0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:01.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.728+0000 7f47c3e00640 1 -- 172.21.15.37:0/2237642740 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f47b4056cc0 con 0x7f47cc155da0 2024-05-30T06:57:01.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.804+0000 7f47c3e00640 1 -- 172.21.15.37:0/2237642740 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f47b4053330 con 0x7f47cc155da0 2024-05-30T06:57:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.900+0000 7f47d2000640 1 -- 172.21.15.37:0/2237642740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f47cc0b6790 con 0x7f47cc155da0 2024-05-30T06:57:01.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.900+0000 7f47c3e00640 1 -- 172.21.15.37:0/2237642740 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) ==== 104+0+11 (secure 0 0 0) 0x7f47b4074010 con 0x7f47cc155da0 2024-05-30T06:57:01.904 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:57:01.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.904+0000 7f47d2000640 1 -- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f47a8069a90 msgr2=0x7f47a806bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.904+0000 7f47d2000640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f47a8069a90 0x7f47a806bf50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0ad000 tx=0x7f47bc0a6000 comp rx=0 tx=0).stop 2024-05-30T06:57:01.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.904+0000 7f47d2000640 1 -- 172.21.15.37:0/2237642740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc155da0 msgr2=0x7f47cc1571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:01.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.904+0000 7f47d2000640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc155da0 0x7f47cc1571e0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e840 tx=0x7f47b400ed00 comp rx=0 tx=0).stop 2024-05-30T06:57:01.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.904+0000 7f47d2000640 1 -- 172.21.15.37:0/2237642740 shutdown_connections 2024-05-30T06:57:01.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.904+0000 7f47d2000640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47cc15aa30 0x7f47cc157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.904+0000 7f47d2000640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47cc155da0 0x7f47cc1571e0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.904+0000 7f47d2000640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f47a8069a90 0x7f47a806bf50 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.904+0000 7f47d2000640 1 --2- 172.21.15.37:0/2237642740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47cc06f5a0 0x7f47cc15e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:01.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.904+0000 7f47d2000640 1 -- 172.21.15.37:0/2237642740 >> 172.21.15.37:0/2237642740 conn(0x7f47cc06bf60 msgr2=0x7f47cc1534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:01.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.904+0000 7f47d2000640 1 -- 172.21.15.37:0/2237642740 shutdown_connections 2024-05-30T06:57:01.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:01.904+0000 7f47d2000640 1 -- 172.21.15.37:0/2237642740 wait complete. 2024-05-30T06:57:01.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:57:02.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.068+0000 7fa51a400640 1 Processor -- start 2024-05-30T06:57:02.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.068+0000 7fa51a400640 1 -- start start 2024-05-30T06:57:02.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.068+0000 7fa51a400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5140b59d0 0x7fa5140b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.068+0000 7fa51a400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa51415d350 0x7fa514160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.068+0000 7fa51a400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5140b62f0 con 0x7fa51415d7b0 2024-05-30T06:57:02.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.068+0000 7fa51a400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa514142030 con 0x7fa5140b59d0 2024-05-30T06:57:02.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.068+0000 7fa51a400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa514142310 con 0x7fa51415d350 2024-05-30T06:57:02.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.068+0000 7fa513e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa51415d7b0 0x7fa5141607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34358/0 (socket says 172.21.15.37:34358) 2024-05-30T06:57:02.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.068+0000 7fa513e00640 1 -- 172.21.15.37:0/2046905316 learned_addr learned my addr 172.21.15.37:0/2046905316 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:02.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.068+0000 7fa513400640 1 --2- 172.21.15.37:0/2046905316 >> v2:172.21.15.37:3300/0 conn(0x7fa5140b59d0 0x7fa5140b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.068+0000 7fa50be00640 1 --2- 172.21.15.37:0/2046905316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa51415d350 0x7fa514160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.068+0000 7fa512a00640 1 -- 172.21.15.37:0/2046905316 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1348968965 0 0) 0x7fa5140b62f0 con 0x7fa51415d7b0 2024-05-30T06:57:02.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa513400640 1 -- 172.21.15.37:0/2046905316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa51415d350 msgr2=0x7fa514160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:02.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa513400640 1 --2- 172.21.15.37:0/2046905316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa51415d350 0x7fa514160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa513400640 1 -- 172.21.15.37:0/2046905316 >> v1:172.21.15.37:6789/0 conn(0x7fa51415d7b0 legacy=0x7fa5141607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa513400640 1 -- 172.21.15.37:0/2046905316 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5141425f0 con 0x7fa5140b59d0 2024-05-30T06:57:02.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa50be00640 1 --2- 172.21.15.37:0/2046905316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa51415d350 0x7fa514160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:02.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa513400640 1 --2- 172.21.15.37:0/2046905316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5140b59d0 0x7fa5140b5db0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fa5040097c0 tx=0x7fa50401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d0eb9b4ef563d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:02.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa512a00640 1 -- 172.21.15.37:0/2046905316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5040b5070 con 0x7fa5140b59d0 2024-05-30T06:57:02.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa512a00640 1 -- 172.21.15.37:0/2046905316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5040a8990 con 0x7fa5140b59d0 2024-05-30T06:57:02.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa512a00640 1 -- 172.21.15.37:0/2046905316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5040a8d60 con 0x7fa5140b59d0 2024-05-30T06:57:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa51a400640 1 -- 172.21.15.37:0/2046905316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5140b59d0 msgr2=0x7fa5140b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa51a400640 1 --2- 172.21.15.37:0/2046905316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5140b59d0 0x7fa5140b5db0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fa5040097c0 tx=0x7fa50401ec90 comp rx=0 tx=0).stop 2024-05-30T06:57:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa51a400640 1 -- 172.21.15.37:0/2046905316 shutdown_connections 2024-05-30T06:57:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa51a400640 1 --2- 172.21.15.37:0/2046905316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa51415d350 0x7fa514160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa51a400640 1 --2- 172.21.15.37:0/2046905316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5140b59d0 0x7fa5140b5db0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.072+0000 7fa51a400640 1 -- 172.21.15.37:0/2046905316 >> 172.21.15.37:0/2046905316 conn(0x7fa51406bf60 msgr2=0x7fa5140b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa51a400640 1 -- 172.21.15.37:0/2046905316 shutdown_connections 2024-05-30T06:57:02.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa51a400640 1 -- 172.21.15.37:0/2046905316 wait complete. 2024-05-30T06:57:02.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa51a400640 1 Processor -- start 2024-05-30T06:57:02.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa51a400640 1 -- start start 2024-05-30T06:57:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa51a400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5140b59d0 0x7fa51415dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa51a400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51415d350 0x7fa51413af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa51a400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa51415d7b0 0x7fa5140ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa51a400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa51413fe60 con 0x7fa51415d350 2024-05-30T06:57:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa51a400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa51413fce0 con 0x7fa51415d7b0 2024-05-30T06:57:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa51a400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa5140aff20 con 0x7fa5140b59d0 2024-05-30T06:57:02.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa50be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51415d350 0x7fa51413af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa50be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51415d350 0x7fa51413af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42936/0 (socket says 172.21.15.37:42936) 2024-05-30T06:57:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa50be00640 1 -- 172.21.15.37:0/2765305372 learned_addr learned my addr 172.21.15.37:0/2765305372 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa513400640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5140b59d0 0x7fa51415dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa513e00640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa51415d7b0 0x7fa5140ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa50be00640 1 -- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5140b59d0 msgr2=0x7fa51415dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa50be00640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5140b59d0 0x7fa51415dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa50be00640 1 -- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa51415d7b0 msgr2=0x7fa5140ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa50be00640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa51415d7b0 0x7fa5140ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa50be00640 1 -- 172.21.15.37:0/2765305372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51415e460 con 0x7fa51415d350 2024-05-30T06:57:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.076+0000 7fa50be00640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51415d350 0x7fa51413af20 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00e810 tx=0x7fa4fc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.080+0000 7fa50b400640 1 -- 172.21.15.37:0/2765305372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc017070 con 0x7fa51415d350 2024-05-30T06:57:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.080+0000 7fa50b400640 1 -- 172.21.15.37:0/2765305372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4fc00c8d0 con 0x7fa51415d350 2024-05-30T06:57:02.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.080+0000 7fa50b400640 1 -- 172.21.15.37:0/2765305372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00f040 con 0x7fa51415d350 2024-05-30T06:57:02.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.080+0000 7fa51a400640 1 -- 172.21.15.37:0/2765305372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51415e740 con 0x7fa51415d350 2024-05-30T06:57:02.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.080+0000 7fa51a400640 1 -- 172.21.15.37:0/2765305372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51415ed00 con 0x7fa51415d350 2024-05-30T06:57:02.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.080+0000 7fa51a400640 1 -- 172.21.15.37:0/2765305372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa514068bc0 con 0x7fa51415d350 2024-05-30T06:57:02.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.080+0000 7fa50b400640 1 -- 172.21.15.37:0/2765305372 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fa4fc01a070 con 0x7fa51415d350 2024-05-30T06:57:02.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.080+0000 7fa50b400640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4f0069bb0 0x7fa4f006c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.080+0000 7fa50b400640 1 -- 172.21.15.37:0/2765305372 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7fa4fc0852a0 con 0x7fa51415d350 2024-05-30T06:57:02.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.080+0000 7fa513400640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4f0069bb0 0x7fa4f006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.084+0000 7fa513400640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4f0069bb0 0x7fa4f006c070 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa5040b2000 tx=0x7fa504008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.084+0000 7fa50b400640 1 -- 172.21.15.37:0/2765305372 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa4fc056d10 con 0x7fa51415d350 2024-05-30T06:57:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.248+0000 7fa51a400640 1 -- 172.21.15.37:0/2765305372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa5140b5f50 con 0x7fa51415d350 2024-05-30T06:57:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.248+0000 7fa50b400640 1 -- 172.21.15.37:0/2765305372 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) ==== 100+0+11 (secure 0 0 0) 0x7fa4fc05b010 con 0x7fa51415d350 2024-05-30T06:57:02.251 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:57:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.252+0000 7fa51a400640 1 -- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4f0069bb0 msgr2=0x7fa4f006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.252+0000 7fa51a400640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4f0069bb0 0x7fa4f006c070 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa5040b2000 tx=0x7fa504008040 comp rx=0 tx=0).stop 2024-05-30T06:57:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.252+0000 7fa51a400640 1 -- 172.21.15.37:0/2765305372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51415d350 msgr2=0x7fa51413af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.252+0000 7fa51a400640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51415d350 0x7fa51413af20 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00e810 tx=0x7fa4fc00ecd0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.252+0000 7fa51a400640 1 -- 172.21.15.37:0/2765305372 shutdown_connections 2024-05-30T06:57:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.252+0000 7fa51a400640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4f0069bb0 0x7fa4f006c070 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.252+0000 7fa51a400640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa51415d7b0 0x7fa5140ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.252+0000 7fa51a400640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51415d350 0x7fa51413af20 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.252+0000 7fa51a400640 1 --2- 172.21.15.37:0/2765305372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5140b59d0 0x7fa51415dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.252+0000 7fa51a400640 1 -- 172.21.15.37:0/2765305372 >> 172.21.15.37:0/2765305372 conn(0x7fa51406bf60 msgr2=0x7fa514160210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.252+0000 7fa51a400640 1 -- 172.21.15.37:0/2765305372 shutdown_connections 2024-05-30T06:57:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.252+0000 7fa51a400640 1 -- 172.21.15.37:0/2765305372 wait complete. 2024-05-30T06:57:02.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T06:57:02.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.412+0000 7fd927000640 1 Processor -- start 2024-05-30T06:57:02.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.412+0000 7fd927000640 1 -- start start 2024-05-30T06:57:02.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.412+0000 7fd927000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd92015d350 0x7fd92006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd927000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd92015d7e0 0x7fd92006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd927000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd920142030 con 0x7fd9200b59d0 2024-05-30T06:57:02.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd927000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd920142310 con 0x7fd92015d350 2024-05-30T06:57:02.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd927000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9201425f0 con 0x7fd92015d7e0 2024-05-30T06:57:02.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd91fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd9200b59d0 0x7fd9200b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34370/0 (socket says 172.21.15.37:34370) 2024-05-30T06:57:02.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd91fe00640 1 -- 172.21.15.37:0/2137891581 learned_addr learned my addr 172.21.15.37:0/2137891581 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:02.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd917e00640 1 --2- 172.21.15.37:0/2137891581 >> v2:172.21.15.105:3300/0 conn(0x7fd92015d350 0x7fd92006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd925000640 1 --2- 172.21.15.37:0/2137891581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd92015d7e0 0x7fd92006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd91f400640 1 -- 172.21.15.37:0/2137891581 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3219800881 0 0) 0x7fd920142030 con 0x7fd9200b59d0 2024-05-30T06:57:02.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd91f400640 1 -- 172.21.15.37:0/2137891581 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd904003530 con 0x7fd9200b59d0 2024-05-30T06:57:02.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd917e00640 1 -- 172.21.15.37:0/2137891581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd92015d7e0 msgr2=0x7fd92006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:02.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd917e00640 1 --2- 172.21.15.37:0/2137891581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd92015d7e0 0x7fd92006e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd917e00640 1 -- 172.21.15.37:0/2137891581 >> v1:172.21.15.37:6789/0 conn(0x7fd9200b59d0 legacy=0x7fd9200b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd917e00640 1 -- 172.21.15.37:0/2137891581 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9201428d0 con 0x7fd92015d350 2024-05-30T06:57:02.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.416+0000 7fd917e00640 1 --2- 172.21.15.37:0/2137891581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd92015d350 0x7fd92006df50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd9080097f0 tx=0x7fd90801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba51dfec41438c2c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:02.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd91f400640 1 -- 172.21.15.37:0/2137891581 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9080b5070 con 0x7fd92015d350 2024-05-30T06:57:02.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd91f400640 1 -- 172.21.15.37:0/2137891581 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9080a8990 con 0x7fd92015d350 2024-05-30T06:57:02.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd91f400640 1 -- 172.21.15.37:0/2137891581 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9080a8d60 con 0x7fd92015d350 2024-05-30T06:57:02.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 -- 172.21.15.37:0/2137891581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd92015d350 msgr2=0x7fd92006df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 --2- 172.21.15.37:0/2137891581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd92015d350 0x7fd92006df50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd9080097f0 tx=0x7fd90801ec90 comp rx=0 tx=0).stop 2024-05-30T06:57:02.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 -- 172.21.15.37:0/2137891581 shutdown_connections 2024-05-30T06:57:02.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 --2- 172.21.15.37:0/2137891581 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd92015d7e0 0x7fd92006e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 --2- 172.21.15.37:0/2137891581 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd92015d350 0x7fd92006df50 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 -- 172.21.15.37:0/2137891581 >> 172.21.15.37:0/2137891581 conn(0x7fd92006bf60 msgr2=0x7fd9200b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:02.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 -- 172.21.15.37:0/2137891581 shutdown_connections 2024-05-30T06:57:02.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 -- 172.21.15.37:0/2137891581 wait complete. 2024-05-30T06:57:02.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 Processor -- start 2024-05-30T06:57:02.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 -- start start 2024-05-30T06:57:02.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9200b59d0 0x7fd920139190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92015d350 0x7fd9200b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd92015d7e0 0x7fd92015b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd9200b00a0 con 0x7fd92015d350 2024-05-30T06:57:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9200aff20 con 0x7fd92015d7e0 2024-05-30T06:57:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd927000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd92013f860 con 0x7fd9200b59d0 2024-05-30T06:57:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd917e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92015d350 0x7fd9200b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd917e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92015d350 0x7fd9200b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42942/0 (socket says 172.21.15.37:42942) 2024-05-30T06:57:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd917e00640 1 -- 172.21.15.37:0/646563243 learned_addr learned my addr 172.21.15.37:0/646563243 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.420+0000 7fd91fe00640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9200b59d0 0x7fd920139190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd925000640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd92015d7e0 0x7fd92015b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd917e00640 1 -- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9200b59d0 msgr2=0x7fd920139190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd917e00640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9200b59d0 0x7fd920139190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd917e00640 1 -- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd92015d7e0 msgr2=0x7fd92015b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd917e00640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd92015d7e0 0x7fd92015b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd917e00640 1 -- 172.21.15.37:0/646563243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9200b41f0 con 0x7fd92015d350 2024-05-30T06:57:02.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd925000640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd92015d7e0 0x7fd92015b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:02.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd917e00640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92015d350 0x7fd9200b37c0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fd9080b3040 tx=0x7fd90801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:02.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd91cc00640 1 -- 172.21.15.37:0/646563243 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9080bf070 con 0x7fd92015d350 2024-05-30T06:57:02.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd91cc00640 1 -- 172.21.15.37:0/646563243 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9080b0640 con 0x7fd92015d350 2024-05-30T06:57:02.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd927000640 1 -- 172.21.15.37:0/646563243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9200b44d0 con 0x7fd92015d350 2024-05-30T06:57:02.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd91cc00640 1 -- 172.21.15.37:0/646563243 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9080b5040 con 0x7fd92015d350 2024-05-30T06:57:02.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd927000640 1 -- 172.21.15.37:0/646563243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9200b4a90 con 0x7fd92015d350 2024-05-30T06:57:02.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd927000640 1 -- 172.21.15.37:0/646563243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd920068bc0 con 0x7fd92015d350 2024-05-30T06:57:02.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.424+0000 7fd91cc00640 1 -- 172.21.15.37:0/646563243 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fd9080c2070 con 0x7fd92015d350 2024-05-30T06:57:02.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.428+0000 7fd91cc00640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd8fc069bb0 0x7fd8fc06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.428+0000 7fd91cc00640 1 -- 172.21.15.37:0/646563243 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7fd908121e40 con 0x7fd92015d350 2024-05-30T06:57:02.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.428+0000 7fd91fe00640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd8fc069bb0 0x7fd8fc06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.428+0000 7fd91fe00640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd8fc069bb0 0x7fd8fc06c070 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd910007fd0 tx=0x7fd910009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:02.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.432+0000 7fd91cc00640 1 -- 172.21.15.37:0/646563243 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd9080187f0 con 0x7fd92015d350 2024-05-30T06:57:02.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd927000640 1 -- 172.21.15.37:0/646563243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd92015cd60 con 0x7fd92015d350 2024-05-30T06:57:02.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd91cc00640 1 -- 172.21.15.37:0/646563243 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) ==== 80+0+0 (secure 0 0 0) 0x7fd9080f3780 con 0x7fd92015d350 2024-05-30T06:57:02.610 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-30T06:57:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd927000640 1 -- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd8fc069bb0 msgr2=0x7fd8fc06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd927000640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd8fc069bb0 0x7fd8fc06c070 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd910007fd0 tx=0x7fd910009040 comp rx=0 tx=0).stop 2024-05-30T06:57:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd927000640 1 -- 172.21.15.37:0/646563243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92015d350 msgr2=0x7fd9200b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd927000640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92015d350 0x7fd9200b37c0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fd9080b3040 tx=0x7fd90801ba30 comp rx=0 tx=0).stop 2024-05-30T06:57:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd927000640 1 -- 172.21.15.37:0/646563243 shutdown_connections 2024-05-30T06:57:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd927000640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd8fc069bb0 0x7fd8fc06c070 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd927000640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd92015d7e0 0x7fd92015b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd927000640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd92015d350 0x7fd9200b37c0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd927000640 1 --2- 172.21.15.37:0/646563243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9200b59d0 0x7fd920139190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd927000640 1 -- 172.21.15.37:0/646563243 >> 172.21.15.37:0/646563243 conn(0x7fd92006bf60 msgr2=0x7fd92006df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:02.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd927000640 1 -- 172.21.15.37:0/646563243 shutdown_connections 2024-05-30T06:57:02.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.608+0000 7fd927000640 1 -- 172.21.15.37:0/646563243 wait complete. 2024-05-30T06:57:02.632 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T06:57:02.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:57:02.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-30T06:57:02.684 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:57:02.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:57:02.685 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T06:57:02.712 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:57:02.712 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:57:02.712 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:57:02.721 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:57:02.722 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:57:02.722 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:57:02.722 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:57:02.761 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:57:02.761 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:57:02.761 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:57:02.761 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:57:02.776 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:57:02.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:57:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.943+0000 7efdfbe00640 1 Processor -- start 2024-05-30T06:57:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.943+0000 7efdfbe00640 1 -- start start 2024-05-30T06:57:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.943+0000 7efdfbe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efdfc06ca70 0x7efdfc06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.943+0000 7efdfbe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efdfc0ced80 0x7efdfc0cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.943+0000 7efdfbe00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdfc0b3c10 con 0x7efdfc15e7e0 2024-05-30T06:57:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.943+0000 7efdfbe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efdfc0b2520 con 0x7efdfc06ca70 2024-05-30T06:57:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.943+0000 7efdfbe00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7efdfc0cf710 con 0x7efdfc0ced80 2024-05-30T06:57:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.943+0000 7efdfa000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efdfc06ca70 0x7efdfc06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.943+0000 7efdfb400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efdfc0ced80 0x7efdfc0cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.943+0000 7efdfa000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efdfc06ca70 0x7efdfc06ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42956/0 (socket says 172.21.15.37:42956) 2024-05-30T06:57:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.943+0000 7efdfa000640 1 -- 172.21.15.37:0/2252883003 learned_addr learned my addr 172.21.15.37:0/2252883003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.947+0000 7efdfb400640 1 -- 172.21.15.37:0/2252883003 >> v2:172.21.15.37:3300/0 conn(0x7efdfc06ca70 msgr2=0x7efdfc06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.947+0000 7efdfb400640 1 --2- 172.21.15.37:0/2252883003 >> v2:172.21.15.37:3300/0 conn(0x7efdfc06ca70 0x7efdfc06ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.947+0000 7efdfb400640 1 -- 172.21.15.37:0/2252883003 >> v1:172.21.15.105:6789/0 conn(0x7efdfc15e7e0 legacy=0x7efdfc0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.947+0000 7efdfb400640 1 -- 172.21.15.37:0/2252883003 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc06d5e0 con 0x7efdfc0ced80 2024-05-30T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.947+0000 7efdfb400640 1 --2- 172.21.15.37:0/2252883003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0ced80 0x7efdfc0cf1d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0cfa20 tx=0x7efdf401c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c59802506722f64b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.947+0000 7efdf9600640 1 -- 172.21.15.37:0/2252883003 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf40b2070 con 0x7efdfc0ced80 2024-05-30T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.947+0000 7efdf9600640 1 -- 172.21.15.37:0/2252883003 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf40a57f0 con 0x7efdfc0ced80 2024-05-30T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.947+0000 7efdf9600640 1 -- 172.21.15.37:0/2252883003 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf40a5bc0 con 0x7efdfc0ced80 2024-05-30T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 -- 172.21.15.37:0/2252883003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0ced80 msgr2=0x7efdfc0cf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 --2- 172.21.15.37:0/2252883003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0ced80 0x7efdfc0cf1d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0cfa20 tx=0x7efdf401c930 comp rx=0 tx=0).stop 2024-05-30T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 -- 172.21.15.37:0/2252883003 shutdown_connections 2024-05-30T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 --2- 172.21.15.37:0/2252883003 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc0ced80 0x7efdfc0cf1d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 --2- 172.21.15.37:0/2252883003 >> v2:172.21.15.37:3300/0 conn(0x7efdfc06ca70 0x7efdfc06ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 -- 172.21.15.37:0/2252883003 >> 172.21.15.37:0/2252883003 conn(0x7efdfc0b3fe0 msgr2=0x7efdfc0b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 -- 172.21.15.37:0/2252883003 shutdown_connections 2024-05-30T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 -- 172.21.15.37:0/2252883003 wait complete. 2024-05-30T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 Processor -- start 2024-05-30T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 -- start start 2024-05-30T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc06ca70 0x7efdfc0af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0ced80 0x7efdfc152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdfc15e7e0 0x7efdfc0c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc15ebc0 con 0x7efdfc0ced80 2024-05-30T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc06dba0 con 0x7efdfc06ca70 2024-05-30T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfbe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efdfc0d1660 con 0x7efdfc15e7e0 2024-05-30T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0ced80 0x7efdfc152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0ced80 0x7efdfc152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42964/0 (socket says 172.21.15.37:42964) 2024-05-30T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfa000640 1 -- 172.21.15.37:0/3803310583 learned_addr learned my addr 172.21.15.37:0/3803310583 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfaa00640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc06ca70 0x7efdfc0af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.951+0000 7efdfb400640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdfc15e7e0 0x7efdfc0c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdfa000640 1 -- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdfc15e7e0 msgr2=0x7efdfc0c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdfa000640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdfc15e7e0 0x7efdfc0c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdfa000640 1 -- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc06ca70 msgr2=0x7efdfc0af300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdfa000640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc06ca70 0x7efdfc0af300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdfa000640 1 -- 172.21.15.37:0/3803310583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc158860 con 0x7efdfc0ced80 2024-05-30T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdfa000640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0ced80 0x7efdfc152a90 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7efde800e8c0 tx=0x7efde800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdf3400640 1 -- 172.21.15.37:0/3803310583 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde8017070 con 0x7efdfc0ced80 2024-05-30T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdf3400640 1 -- 172.21.15.37:0/3803310583 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde800c940 con 0x7efdfc0ced80 2024-05-30T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdfbe00640 1 -- 172.21.15.37:0/3803310583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdfc158b40 con 0x7efdfc0ced80 2024-05-30T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdf3400640 1 -- 172.21.15.37:0/3803310583 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde800cd30 con 0x7efdfc0ced80 2024-05-30T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdfbe00640 1 -- 172.21.15.37:0/3803310583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdfc159100 con 0x7efdfc0ced80 2024-05-30T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdfbe00640 1 -- 172.21.15.37:0/3803310583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdfc075580 con 0x7efdfc0ced80 2024-05-30T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdf3400640 1 -- 172.21.15.37:0/3803310583 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7efde801a070 con 0x7efdfc0ced80 2024-05-30T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.955+0000 7efdf3400640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efddc069bb0 0x7efddc06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.959+0000 7efdf3400640 1 -- 172.21.15.37:0/3803310583 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7efde8085a40 con 0x7efdfc0ced80 2024-05-30T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.959+0000 7efdfaa00640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efddc069bb0 0x7efddc06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.959+0000 7efdfaa00640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efddc069bb0 0x7efddc06c070 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7efdec001770 tx=0x7efdec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:02.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:02.959+0000 7efdf3400640 1 -- 172.21.15.37:0/3803310583 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efde8057410 con 0x7efdfc0ced80 2024-05-30T06:57:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.343+0000 7efdfbe00640 1 -- 172.21.15.37:0/3803310583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdfc0d2590 con 0x7efdfc0ced80 2024-05-30T06:57:03.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.347+0000 7efdf3400640 1 -- 172.21.15.37:0/3803310583 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5180 (secure 0 0 0) 0x7efde805b710 con 0x7efdfc0ced80 2024-05-30T06:57:03.350 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:03.350 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/667666714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":667666714},{"type":"v1","addr":"172.21.15.105:6836","nonce":667666714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/748743640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":748743640},{"type":"v1","addr":"172.21.15.37:6835","nonce":748743640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/527055184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":527055184},{"type":"v1","addr":"172.21.15.105:6837","nonce":527055184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:55:34.327016+0000","modified":"2024-05-30T06:55:37.340047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8538":{"gid":8538,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/1190106206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1190106206},{"type":"v1","addr":"172.21.15.37:6834","nonce":1190106206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8538,"qdb_cluster":[8538]},"id":7}]} 2024-05-30T06:57:03.350 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 65 2024-05-30T06:57:03.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.347+0000 7efdfbe00640 1 -- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efddc069bb0 msgr2=0x7efddc06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:03.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.347+0000 7efdfbe00640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efddc069bb0 0x7efddc06c070 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7efdec001770 tx=0x7efdec009040 comp rx=0 tx=0).stop 2024-05-30T06:57:03.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.347+0000 7efdfbe00640 1 -- 172.21.15.37:0/3803310583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0ced80 msgr2=0x7efdfc152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:03.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.347+0000 7efdfbe00640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0ced80 0x7efdfc152a90 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7efde800e8c0 tx=0x7efde800ed80 comp rx=0 tx=0).stop 2024-05-30T06:57:03.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.347+0000 7efdfbe00640 1 -- 172.21.15.37:0/3803310583 shutdown_connections 2024-05-30T06:57:03.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.347+0000 7efdfbe00640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdfc15e7e0 0x7efdfc0c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.347+0000 7efdfbe00640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0ced80 0x7efdfc152a90 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.347+0000 7efdfbe00640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efddc069bb0 0x7efddc06c070 secure :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7efdec001770 tx=0x7efdec009040 comp rx=0 tx=0).stop 2024-05-30T06:57:03.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.347+0000 7efdfbe00640 1 --2- 172.21.15.37:0/3803310583 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdfc06ca70 0x7efdfc0af300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.347+0000 7efdfbe00640 1 -- 172.21.15.37:0/3803310583 >> 172.21.15.37:0/3803310583 conn(0x7efdfc0b3fe0 msgr2=0x7efdfc070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:03.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.351+0000 7efdfbe00640 1 -- 172.21.15.37:0/3803310583 shutdown_connections 2024-05-30T06:57:03.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.351+0000 7efdfbe00640 1 -- 172.21.15.37:0/3803310583 wait complete. 2024-05-30T06:57:03.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:57:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f2102000640 1 Processor -- start 2024-05-30T06:57:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f2102000640 1 -- start start 2024-05-30T06:57:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f2102000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f20fc0ce8d0 0x7f20fc0ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f2102000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20fc0cd120 con 0x7f20fc15cd80 2024-05-30T06:57:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f2102000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20fc0cd400 con 0x7f20fc06e000 2024-05-30T06:57:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f2102000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f20fc0a9530 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f20f3e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f20fc15cd80 0x7f20fc06f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34380/0 (socket says 172.21.15.37:34380) 2024-05-30T06:57:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f20f3e00640 1 -- 172.21.15.37:0/1983376160 learned_addr learned my addr 172.21.15.37:0/1983376160 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f20fbe00640 1 --2- 172.21.15.37:0/1983376160 >> v2:172.21.15.105:3300/0 conn(0x7f20fc0ce8d0 0x7f20fc0ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f20faa00640 1 -- 172.21.15.37:0/1983376160 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382785136 0 0) 0x7f20fc0cd120 con 0x7f20fc15cd80 2024-05-30T06:57:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f20faa00640 1 -- 172.21.15.37:0/1983376160 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20e0003530 con 0x7f20fc15cd80 2024-05-30T06:57:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f20faa00640 1 -- 172.21.15.37:0/1983376160 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4238536095 0 0) 0x7f20fc0cd400 con 0x7f20fc06e000 2024-05-30T06:57:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f20faa00640 1 -- 172.21.15.37:0/1983376160 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20fc0cd120 con 0x7f20fc06e000 2024-05-30T06:57:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f20fbe00640 1 -- 172.21.15.37:0/1983376160 >> v1:172.21.15.105:6789/0 conn(0x7f20fc06e000 legacy=0x7f20fc0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f20fbe00640 1 -- 172.21.15.37:0/1983376160 >> v1:172.21.15.37:6789/0 conn(0x7f20fc15cd80 legacy=0x7f20fc06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:03.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.523+0000 7f20fbe00640 1 -- 172.21.15.37:0/1983376160 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20fc0cd6e0 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.527+0000 7f20fbe00640 1 --2- 172.21.15.37:0/1983376160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20fc0ce8d0 0x7f20fc0ced20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009d90 tx=0x7f20f401f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae94f2b22f41fdb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.527+0000 7f20faa00640 1 -- 172.21.15.37:0/1983376160 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f40b4070 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.527+0000 7f20faa00640 1 -- 172.21.15.37:0/1983376160 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f40af600 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.527+0000 7f20faa00640 1 -- 172.21.15.37:0/1983376160 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f40af9d0 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.527+0000 7f2102000640 1 -- 172.21.15.37:0/1983376160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20fc0ce8d0 msgr2=0x7f20fc0ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.527+0000 7f2102000640 1 --2- 172.21.15.37:0/1983376160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20fc0ce8d0 0x7f20fc0ced20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f20f4009d90 tx=0x7f20f401f150 comp rx=0 tx=0).stop 2024-05-30T06:57:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.527+0000 7f2102000640 1 -- 172.21.15.37:0/1983376160 shutdown_connections 2024-05-30T06:57:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.527+0000 7f2102000640 1 --2- 172.21.15.37:0/1983376160 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20fc0ce8d0 0x7f20fc0ced20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.527+0000 7f2102000640 1 -- 172.21.15.37:0/1983376160 >> 172.21.15.37:0/1983376160 conn(0x7f20fc0b23a0 msgr2=0x7f20fc0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.527+0000 7f2102000640 1 -- 172.21.15.37:0/1983376160 shutdown_connections 2024-05-30T06:57:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.527+0000 7f2102000640 1 -- 172.21.15.37:0/1983376160 wait complete. 2024-05-30T06:57:03.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f2102000640 1 Processor -- start 2024-05-30T06:57:03.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f2102000640 1 -- start start 2024-05-30T06:57:03.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f2102000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20fc06e000 0x7f20fc0adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:03.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f2102000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20fc0ce8d0 0x7f20fc1437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:03.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f2102000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20fc15cd80 0x7f20fc0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:03.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f2102000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc1673d0 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f2102000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20fc0cdca0 con 0x7f20fc15cd80 2024-05-30T06:57:03.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f2102000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f20fc167550 con 0x7f20fc06e000 2024-05-30T06:57:03.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20f3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20fc0ce8d0 0x7f20fc1437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:03.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20f3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20fc0ce8d0 0x7f20fc1437c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42980/0 (socket says 172.21.15.37:42980) 2024-05-30T06:57:03.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20f3e00640 1 -- 172.21.15.37:0/2408425504 learned_addr learned my addr 172.21.15.37:0/2408425504 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:03.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20fbe00640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20fc15cd80 0x7f20fc0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:03.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20fb400640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20fc06e000 0x7f20fc0adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:03.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20f3e00640 1 -- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20fc06e000 msgr2=0x7f20fc0adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:03.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20f3e00640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20fc06e000 0x7f20fc0adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20f3e00640 1 -- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20fc15cd80 msgr2=0x7f20fc0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:03.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20f3e00640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20fc15cd80 0x7f20fc0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20f3e00640 1 -- 172.21.15.37:0/2408425504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20fc0ae640 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20fb400640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20fc06e000 0x7f20fc0adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:03.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20f3e00640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20fc0ce8d0 0x7f20fc1437c0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f20e400c4f0 tx=0x7f20e400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:03.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20f3400640 1 -- 172.21.15.37:0/2408425504 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4017070 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20f3400640 1 -- 172.21.15.37:0/2408425504 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e4005cf0 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f20f3400640 1 -- 172.21.15.37:0/2408425504 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4007270 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f2102000640 1 -- 172.21.15.37:0/2408425504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20fc0ae920 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.531+0000 7f2102000640 1 -- 172.21.15.37:0/2408425504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20fc0b3a80 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.535+0000 7f2102000640 1 -- 172.21.15.37:0/2408425504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20fc068b20 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.535+0000 7f20f3400640 1 -- 172.21.15.37:0/2408425504 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f20e401a070 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.535+0000 7f20f3400640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20d8069bb0 0x7f20d806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:03.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.535+0000 7f20f3400640 1 -- 172.21.15.37:0/2408425504 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7f20e4084b30 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.535+0000 7f20fb400640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20d8069bb0 0x7f20d806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:03.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.535+0000 7f20fb400640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20d8069bb0 0x7f20d806c070 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0011f0 tx=0x7f20ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:03.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.539+0000 7f20f3400640 1 -- 172.21.15.37:0/2408425504 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f20e4056500 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.707+0000 7f2102000640 1 -- 172.21.15.37:0/2408425504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20fc0afae0 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.707+0000 7f20f3400640 1 -- 172.21.15.37:0/2408425504 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16762 (secure 0 0 0) 0x7f20e405a800 con 0x7f20fc0ce8d0 2024-05-30T06:57:03.711 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:03.711 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":103,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:57:00.682415+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:55:32.713799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-05-30T06:55:33.276484+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:57:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.707+0000 7f2102000640 1 -- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20d8069bb0 msgr2=0x7f20d806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:03.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.707+0000 7f2102000640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20d8069bb0 0x7f20d806c070 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0011f0 tx=0x7f20ec009040 comp rx=0 tx=0).stop 2024-05-30T06:57:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.707+0000 7f2102000640 1 -- 172.21.15.37:0/2408425504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20fc0ce8d0 msgr2=0x7f20fc1437c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.707+0000 7f2102000640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20fc0ce8d0 0x7f20fc1437c0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f20e400c4f0 tx=0x7f20e400c9b0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.707+0000 7f2102000640 1 -- 172.21.15.37:0/2408425504 shutdown_connections 2024-05-30T06:57:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.707+0000 7f2102000640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20d8069bb0 0x7f20d806c070 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.711+0000 7f2102000640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20fc15cd80 0x7f20fc0b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.711+0000 7f2102000640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20fc0ce8d0 0x7f20fc1437c0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.711+0000 7f2102000640 1 --2- 172.21.15.37:0/2408425504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20fc06e000 0x7f20fc0adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.711+0000 7f2102000640 1 -- 172.21.15.37:0/2408425504 >> 172.21.15.37:0/2408425504 conn(0x7f20fc0b23a0 msgr2=0x7f20fc144a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.711+0000 7f2102000640 1 -- 172.21.15.37:0/2408425504 shutdown_connections 2024-05-30T06:57:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.711+0000 7f2102000640 1 -- 172.21.15.37:0/2408425504 wait complete. 2024-05-30T06:57:03.733 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:55:32.713799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:55:33.276484+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 103, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:57:03.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:57:03.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef7ea00640 1 Processor -- start 2024-05-30T06:57:03.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef7ea00640 1 -- start start 2024-05-30T06:57:03.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef7ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef780d1dd0 0x7fef7809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:03.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef7ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef780d0850 0x7fef7809afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:03.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef7ea00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef780cea40 con 0x7fef780ce660 2024-05-30T06:57:03.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef7ea00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fef780d0d30 con 0x7fef780d1dd0 2024-05-30T06:57:03.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef7ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fef780d1010 con 0x7fef780d0850 2024-05-30T06:57:03.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef77e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fef780ce660 0x7fef7806d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34384/0 (socket says 172.21.15.37:34384) 2024-05-30T06:57:03.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef77e00640 1 -- 172.21.15.37:0/2652577133 learned_addr learned my addr 172.21.15.37:0/2652577133 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:03.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef6f400640 1 --2- 172.21.15.37:0/2652577133 >> v2:172.21.15.37:3300/0 conn(0x7fef780d1dd0 0x7fef7809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:03.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef7ca00640 1 --2- 172.21.15.37:0/2652577133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef780d0850 0x7fef7809afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:03.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef6f400640 1 -- 172.21.15.37:0/2652577133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef780d0850 msgr2=0x7fef7809afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:03.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef6f400640 1 --2- 172.21.15.37:0/2652577133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef780d0850 0x7fef7809afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef6f400640 1 -- 172.21.15.37:0/2652577133 >> v1:172.21.15.37:6789/0 conn(0x7fef780ce660 legacy=0x7fef7806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:03.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef6f400640 1 -- 172.21.15.37:0/2652577133 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef780d12f0 con 0x7fef780d1dd0 2024-05-30T06:57:03.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.875+0000 7fef77400640 1 -- 172.21.15.37:0/2652577133 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4015594139 0 0) 0x7fef780cea40 con 0x7fef780ce660 2024-05-30T06:57:03.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.879+0000 7fef6f400640 1 --2- 172.21.15.37:0/2652577133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef780d1dd0 0x7fef7809aa60 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fef600097c0 tx=0x7fef6001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362f807a787a8dca server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:03.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.879+0000 7fef77400640 1 -- 172.21.15.37:0/2652577133 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef600a7070 con 0x7fef780d1dd0 2024-05-30T06:57:03.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.879+0000 7fef77400640 1 -- 172.21.15.37:0/2652577133 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef600b0070 con 0x7fef780d1dd0 2024-05-30T06:57:03.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.879+0000 7fef77400640 1 -- 172.21.15.37:0/2652577133 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef600ab890 con 0x7fef780d1dd0 2024-05-30T06:57:03.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.879+0000 7fef7ea00640 1 -- 172.21.15.37:0/2652577133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef780d1dd0 msgr2=0x7fef7809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.879+0000 7fef7ea00640 1 --2- 172.21.15.37:0/2652577133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef780d1dd0 0x7fef7809aa60 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fef600097c0 tx=0x7fef6001c470 comp rx=0 tx=0).stop 2024-05-30T06:57:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.879+0000 7fef7ea00640 1 -- 172.21.15.37:0/2652577133 shutdown_connections 2024-05-30T06:57:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.879+0000 7fef7ea00640 1 --2- 172.21.15.37:0/2652577133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef780d0850 0x7fef7809afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.879+0000 7fef7ea00640 1 --2- 172.21.15.37:0/2652577133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef780d1dd0 0x7fef7809aa60 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.879+0000 7fef7ea00640 1 -- 172.21.15.37:0/2652577133 >> 172.21.15.37:0/2652577133 conn(0x7fef780b4100 msgr2=0x7fef780b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.879+0000 7fef7ea00640 1 -- 172.21.15.37:0/2652577133 shutdown_connections 2024-05-30T06:57:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.879+0000 7fef7ea00640 1 -- 172.21.15.37:0/2652577133 wait complete. 2024-05-30T06:57:03.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef7ea00640 1 Processor -- start 2024-05-30T06:57:03.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef7ea00640 1 -- start start 2024-05-30T06:57:03.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef7ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef780ce660 0x7fef780c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef7ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef780d0850 0x7fef78154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef7ea00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef780d1dd0 0x7fef7815d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef7ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef7815ec10 con 0x7fef780ce660 2024-05-30T06:57:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef7ea00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fef7815ea90 con 0x7fef780d1dd0 2024-05-30T06:57:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef7ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fef7815ed90 con 0x7fef780d0850 2024-05-30T06:57:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef77e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef780ce660 0x7fef780c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef77e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef780ce660 0x7fef780c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43008/0 (socket says 172.21.15.37:43008) 2024-05-30T06:57:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef77e00640 1 -- 172.21.15.37:0/1442227016 learned_addr learned my addr 172.21.15.37:0/1442227016 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef6f400640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef780d0850 0x7fef78154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef7ca00640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef780d1dd0 0x7fef7815d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef77e00640 1 -- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef780d0850 msgr2=0x7fef78154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef77e00640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef780d0850 0x7fef78154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef77e00640 1 -- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef780d1dd0 msgr2=0x7fef7815d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef77e00640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef780d1dd0 0x7fef7815d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef77e00640 1 -- 172.21.15.37:0/1442227016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef780c86b0 con 0x7fef780ce660 2024-05-30T06:57:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef77e00640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef780ce660 0x7fef780c8170 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c4b0 tx=0x7fef6800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef74c00640 1 -- 172.21.15.37:0/1442227016 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef68018070 con 0x7fef780ce660 2024-05-30T06:57:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef74c00640 1 -- 172.21.15.37:0/1442227016 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef68007500 con 0x7fef780ce660 2024-05-30T06:57:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef7ea00640 1 -- 172.21.15.37:0/1442227016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef78140f00 con 0x7fef780ce660 2024-05-30T06:57:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef74c00640 1 -- 172.21.15.37:0/1442227016 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef68004a30 con 0x7fef780ce660 2024-05-30T06:57:03.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.883+0000 7fef7ea00640 1 -- 172.21.15.37:0/1442227016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef781414c0 con 0x7fef780ce660 2024-05-30T06:57:03.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.887+0000 7fef7ea00640 1 -- 172.21.15.37:0/1442227016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef78068bc0 con 0x7fef780ce660 2024-05-30T06:57:03.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.887+0000 7fef74c00640 1 -- 172.21.15.37:0/1442227016 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fef6801b070 con 0x7fef780ce660 2024-05-30T06:57:03.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.887+0000 7fef74c00640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef54069bb0 0x7fef5406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:03.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.887+0000 7fef74c00640 1 -- 172.21.15.37:0/1442227016 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7fef680849d0 con 0x7fef780ce660 2024-05-30T06:57:03.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.887+0000 7fef6f400640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef54069bb0 0x7fef5406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:03.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.887+0000 7fef6f400640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef54069bb0 0x7fef5406c070 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fef600af000 tx=0x7fef600b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:03.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:03.891+0000 7fef74c00640 1 -- 172.21.15.37:0/1442227016 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fef680563a0 con 0x7fef780ce660 2024-05-30T06:57:04.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.055+0000 7fef7ea00640 1 -- 172.21.15.37:0/1442227016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fef780d2290 con 0x7fef780ce660 2024-05-30T06:57:04.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.055+0000 7fef74c00640 1 -- 172.21.15.37:0/1442227016 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) ==== 93+0+10 (secure 0 0 0) 0x7fef6805a6a0 con 0x7fef780ce660 2024-05-30T06:57:04.060 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:57:04.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.059+0000 7fef7ea00640 1 -- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef54069bb0 msgr2=0x7fef5406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.059+0000 7fef7ea00640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef54069bb0 0x7fef5406c070 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fef600af000 tx=0x7fef600b6040 comp rx=0 tx=0).stop 2024-05-30T06:57:04.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.059+0000 7fef7ea00640 1 -- 172.21.15.37:0/1442227016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef780ce660 msgr2=0x7fef780c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.059+0000 7fef7ea00640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef780ce660 0x7fef780c8170 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c4b0 tx=0x7fef6800c970 comp rx=0 tx=0).stop 2024-05-30T06:57:04.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.059+0000 7fef7ea00640 1 -- 172.21.15.37:0/1442227016 shutdown_connections 2024-05-30T06:57:04.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.059+0000 7fef7ea00640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef54069bb0 0x7fef5406c070 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.059+0000 7fef7ea00640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef780d1dd0 0x7fef7815d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.059+0000 7fef7ea00640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef780d0850 0x7fef78154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.059+0000 7fef7ea00640 1 --2- 172.21.15.37:0/1442227016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef780ce660 0x7fef780c8170 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.059+0000 7fef7ea00640 1 -- 172.21.15.37:0/1442227016 >> 172.21.15.37:0/1442227016 conn(0x7fef780b4100 msgr2=0x7fef780b6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:04.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.059+0000 7fef7ea00640 1 -- 172.21.15.37:0/1442227016 shutdown_connections 2024-05-30T06:57:04.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.059+0000 7fef7ea00640 1 -- 172.21.15.37:0/1442227016 wait complete. 2024-05-30T06:57:04.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:57:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18ee000640 1 Processor -- start 2024-05-30T06:57:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18ee000640 1 -- start start 2024-05-30T06:57:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18ee000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18e80d1db0 0x7f18e8160400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18ee000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e80d1290 con 0x7f18e8160940 2024-05-30T06:57:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18ee000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e80d09f0 con 0x7f18e815c9c0 2024-05-30T06:57:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18ee000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f18e80d0cd0 con 0x7f18e80d1db0 2024-05-30T06:57:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e7e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f18e8160940 0x7f18e806b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34386/0 (socket says 172.21.15.37:34386) 2024-05-30T06:57:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e7e00640 1 -- 172.21.15.37:0/1640850821 learned_addr learned my addr 172.21.15.37:0/1640850821 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:04.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18dfe00640 1 --2- 172.21.15.37:0/1640850821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18e80d1db0 0x7f18e8160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976351296 0 0) 0x7f18e80d1290 con 0x7f18e8160940 2024-05-30T06:57:04.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18cc003530 con 0x7f18e8160940 2024-05-30T06:57:04.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867818938 0 0) 0x7f18e80d09f0 con 0x7f18e815c9c0 2024-05-30T06:57:04.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18e80d1290 con 0x7f18e815c9c0 2024-05-30T06:57:04.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1592093220 0 0) 0x7f18cc003530 con 0x7f18e8160940 2024-05-30T06:57:04.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18e80d1db0 msgr2=0x7f18e8160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:04.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 --2- 172.21.15.37:0/1640850821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18e80d1db0 0x7f18e8160400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 >> v1:172.21.15.105:6789/0 conn(0x7f18e815c9c0 legacy=0x7f18e80ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e80d0fb0 con 0x7f18e8160940 2024-05-30T06:57:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f18e0001a00 con 0x7f18e8160940 2024-05-30T06:57:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 >> v1:172.21.15.37:6789/0 conn(0x7f18e8160940 legacy=0x7f18e806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 --2- 172.21.15.37:0/1640850821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18cc003b80 0x7f18cc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 --2- 172.21.15.37:0/1640850821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18cc004810 0x7f18cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 --2- 172.21.15.37:0/1640850821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18cc0051d0 0x7f18cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18e80d0cd0 con 0x7f18cc0051d0 2024-05-30T06:57:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc00c0a0 con 0x7f18cc003b80 2024-05-30T06:57:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.223+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f18cc00c2a0 con 0x7f18cc004810 2024-05-30T06:57:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.227+0000 7f18dfe00640 1 --2- 172.21.15.37:0/1640850821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18e80d1db0 0x7f18e8160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:57:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.227+0000 7f18e7e00640 1 --2- 172.21.15.37:0/1640850821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18cc0051d0 0x7f18cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.227+0000 7f18e7400640 1 --2- 172.21.15.37:0/1640850821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18cc003b80 0x7f18cc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.227+0000 7f18dfe00640 1 --2- 172.21.15.37:0/1640850821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18cc004810 0x7f18cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.227+0000 7f18e7e00640 1 -- 172.21.15.37:0/1640850821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18cc004810 msgr2=0x7f18cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.227+0000 7f18e7e00640 1 --2- 172.21.15.37:0/1640850821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18cc004810 0x7f18cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.227+0000 7f18e7e00640 1 -- 172.21.15.37:0/1640850821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18cc003b80 msgr2=0x7f18cc003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.227+0000 7f18e7e00640 1 --2- 172.21.15.37:0/1640850821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18cc003b80 0x7f18cc003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.227+0000 7f18e7e00640 1 -- 172.21.15.37:0/1640850821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc003530 con 0x7f18cc0051d0 2024-05-30T06:57:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.227+0000 7f18e7e00640 1 --2- 172.21.15.37:0/1640850821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18cc0051d0 0x7f18cc00b9d0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f18e000a720 tx=0x7f18e001d240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ac540014cc9cce server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.227+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e000a370 con 0x7f18cc0051d0 2024-05-30T06:57:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.227+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e00ad650 con 0x7f18cc0051d0 2024-05-30T06:57:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.227+0000 7f18e6a00640 1 -- 172.21.15.37:0/1640850821 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e00ada40 con 0x7f18cc0051d0 2024-05-30T06:57:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 -- 172.21.15.37:0/1640850821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18cc0051d0 msgr2=0x7f18cc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 --2- 172.21.15.37:0/1640850821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18cc0051d0 0x7f18cc00b9d0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f18e000a720 tx=0x7f18e001d240 comp rx=0 tx=0).stop 2024-05-30T06:57:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18e7e00640 1 -- 172.21.15.37:0/1640850821 reap_dead start 2024-05-30T06:57:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 -- 172.21.15.37:0/1640850821 shutdown_connections 2024-05-30T06:57:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 -- 172.21.15.37:0/1640850821 >> 172.21.15.37:0/1640850821 conn(0x7f18e809aa60 msgr2=0x7f18e80d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 -- 172.21.15.37:0/1640850821 shutdown_connections 2024-05-30T06:57:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 -- 172.21.15.37:0/1640850821 wait complete. 2024-05-30T06:57:04.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 Processor -- start 2024-05-30T06:57:04.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 -- start start 2024-05-30T06:57:04.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18cc0051d0 0x7f18e815f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e814dc10 0x7f18e814a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18e814d180 0x7f18e814d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f18e80ced30 con 0x7f18e814dc10 2024-05-30T06:57:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f18e80cebb0 con 0x7f18cc0051d0 2024-05-30T06:57:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18ee000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f18e80d0270 con 0x7f18e814d180 2024-05-30T06:57:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e814dc10 0x7f18e814a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e814dc10 0x7f18e814a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43026/0 (socket says 172.21.15.37:43026) 2024-05-30T06:57:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18dfe00640 1 -- 172.21.15.37:0/3397292093 learned_addr learned my addr 172.21.15.37:0/3397292093 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18e7400640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18cc0051d0 0x7f18e815f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18e7e00640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18e814d180 0x7f18e814d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18dfe00640 1 -- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18e814d180 msgr2=0x7f18e814d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18dfe00640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18e814d180 0x7f18e814d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18dfe00640 1 -- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18cc0051d0 msgr2=0x7f18e815f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18dfe00640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18cc0051d0 0x7f18e815f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18dfe00640 1 -- 172.21.15.37:0/3397292093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e814c3c0 con 0x7f18e814dc10 2024-05-30T06:57:04.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.231+0000 7f18e7400640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18cc0051d0 0x7f18e815f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:57:04.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.235+0000 7f18dfe00640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e814dc10 0x7f18e814a9a0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f18d00115f0 tx=0x7f18d0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.235+0000 7f18df400640 1 -- 172.21.15.37:0/3397292093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d0015870 con 0x7f18e814dc10 2024-05-30T06:57:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.235+0000 7f18df400640 1 -- 172.21.15.37:0/3397292093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18d0015a10 con 0x7f18e814dc10 2024-05-30T06:57:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.235+0000 7f18df400640 1 -- 172.21.15.37:0/3397292093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d0015e00 con 0x7f18e814dc10 2024-05-30T06:57:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.235+0000 7f18ee000640 1 -- 172.21.15.37:0/3397292093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e814c6a0 con 0x7f18e814dc10 2024-05-30T06:57:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.235+0000 7f18ee000640 1 -- 172.21.15.37:0/3397292093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e814cc60 con 0x7f18e814dc10 2024-05-30T06:57:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.235+0000 7f18ee000640 1 -- 172.21.15.37:0/3397292093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e8068bc0 con 0x7f18e814dc10 2024-05-30T06:57:04.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.235+0000 7f18df400640 1 -- 172.21.15.37:0/3397292093 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f18d001d400 con 0x7f18e814dc10 2024-05-30T06:57:04.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.235+0000 7f18df400640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18c4069be0 0x7f18c406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.235+0000 7f18df400640 1 -- 172.21.15.37:0/3397292093 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7f18d0085fe0 con 0x7f18e814dc10 2024-05-30T06:57:04.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.239+0000 7f18e7400640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18c4069be0 0x7f18c406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.239+0000 7f18e7400640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18c4069be0 0x7f18c406c0a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f18d8000c10 tx=0x7f18d8007cb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:04.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.243+0000 7f18df400640 1 -- 172.21.15.37:0/3397292093 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f18d0019030 con 0x7f18e814dc10 2024-05-30T06:57:04.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.403+0000 7f18ee000640 1 -- 172.21.15.37:0/3397292093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f18e806c4f0 con 0x7f18e814dc10 2024-05-30T06:57:04.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.407+0000 7f18df400640 1 -- 172.21.15.37:0/3397292093 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) ==== 104+0+11 (secure 0 0 0) 0x7f18d00579b0 con 0x7f18e814dc10 2024-05-30T06:57:04.409 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:57:04.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.407+0000 7f18ee000640 1 -- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18c4069be0 msgr2=0x7f18c406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.407+0000 7f18ee000640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18c4069be0 0x7f18c406c0a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f18d8000c10 tx=0x7f18d8007cb0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.407+0000 7f18ee000640 1 -- 172.21.15.37:0/3397292093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e814dc10 msgr2=0x7f18e814a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.407+0000 7f18ee000640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e814dc10 0x7f18e814a9a0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f18d00115f0 tx=0x7f18d0011ab0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.407+0000 7f18ee000640 1 -- 172.21.15.37:0/3397292093 shutdown_connections 2024-05-30T06:57:04.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.407+0000 7f18ee000640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f18e814d180 0x7f18e814d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.407+0000 7f18ee000640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e814dc10 0x7f18e814a9a0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.407+0000 7f18ee000640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f18c4069be0 0x7f18c406c0a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.407+0000 7f18ee000640 1 --2- 172.21.15.37:0/3397292093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18cc0051d0 0x7f18e815f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.407+0000 7f18ee000640 1 -- 172.21.15.37:0/3397292093 >> 172.21.15.37:0/3397292093 conn(0x7f18e809aa60 msgr2=0x7f18e80b4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:04.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.407+0000 7f18ee000640 1 -- 172.21.15.37:0/3397292093 shutdown_connections 2024-05-30T06:57:04.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.407+0000 7f18ee000640 1 -- 172.21.15.37:0/3397292093 wait complete. 2024-05-30T06:57:04.431 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:57:04.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.571+0000 7f12db400640 1 Processor -- start 2024-05-30T06:57:04.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.571+0000 7f12db400640 1 -- start start 2024-05-30T06:57:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.571+0000 7f12db400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12d41624a0 0x7f12d406b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.571+0000 7f12db400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d40b6130 con 0x7f12d406bea0 2024-05-30T06:57:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.571+0000 7f12db400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d4071410 con 0x7f12d4158e00 2024-05-30T06:57:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.571+0000 7f12db400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f12d406c310 con 0x7f12d41624a0 2024-05-30T06:57:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.571+0000 7f12d9400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f12d406bea0 0x7f12d40b4c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34398/0 (socket says 172.21.15.37:34398) 2024-05-30T06:57:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.575+0000 7f12d3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12d41624a0 0x7f12d406b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.575+0000 7f12d9400640 1 -- 172.21.15.37:0/3026960111 learned_addr learned my addr 172.21.15.37:0/3026960111 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:04.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.575+0000 7f12d3e00640 1 -- 172.21.15.37:0/3026960111 >> v1:172.21.15.105:6789/0 conn(0x7f12d4158e00 legacy=0x7f12d40b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.575+0000 7f12d3e00640 1 -- 172.21.15.37:0/3026960111 >> v1:172.21.15.37:6789/0 conn(0x7f12d406bea0 legacy=0x7f12d40b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.575+0000 7f12d3e00640 1 -- 172.21.15.37:0/3026960111 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d4162980 con 0x7f12d41624a0 2024-05-30T06:57:04.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.575+0000 7f12d3400640 1 -- 172.21.15.37:0/3026960111 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084220583 0 0) 0x7f12d40b6130 con 0x7f12d406bea0 2024-05-30T06:57:04.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.575+0000 7f12d3e00640 1 --2- 172.21.15.37:0/3026960111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d41624a0 0x7f12d406b960 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f12c00097c0 tx=0x7f12c001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e0b8141d28be01 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:04.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.575+0000 7f12d3400640 1 -- 172.21.15.37:0/3026960111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c00b0070 con 0x7f12d41624a0 2024-05-30T06:57:04.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.575+0000 7f12d3400640 1 -- 172.21.15.37:0/3026960111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c00ab600 con 0x7f12d41624a0 2024-05-30T06:57:04.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.575+0000 7f12d3400640 1 -- 172.21.15.37:0/3026960111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c00ab9d0 con 0x7f12d41624a0 2024-05-30T06:57:04.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 -- 172.21.15.37:0/3026960111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d41624a0 msgr2=0x7f12d406b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 --2- 172.21.15.37:0/3026960111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d41624a0 0x7f12d406b960 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f12c00097c0 tx=0x7f12c001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 -- 172.21.15.37:0/3026960111 shutdown_connections 2024-05-30T06:57:04.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 --2- 172.21.15.37:0/3026960111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d41624a0 0x7f12d406b960 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 -- 172.21.15.37:0/3026960111 >> 172.21.15.37:0/3026960111 conn(0x7f12d406f110 msgr2=0x7f12d406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:04.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 -- 172.21.15.37:0/3026960111 shutdown_connections 2024-05-30T06:57:04.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 -- 172.21.15.37:0/3026960111 wait complete. 2024-05-30T06:57:04.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 Processor -- start 2024-05-30T06:57:04.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 -- start start 2024-05-30T06:57:04.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12d406bea0 0x7f12d414a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12d4158e00 0x7f12d4159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d41624a0 0x7f12d4147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12d4159360 con 0x7f12d41624a0 2024-05-30T06:57:04.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f12d41591e0 con 0x7f12d406bea0 2024-05-30T06:57:04.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12db400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f12d416d060 con 0x7f12d4158e00 2024-05-30T06:57:04.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12d9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d41624a0 0x7f12d4147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12d9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d41624a0 0x7f12d4147b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43044/0 (socket says 172.21.15.37:43044) 2024-05-30T06:57:04.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12d9400640 1 -- 172.21.15.37:0/1364858517 learned_addr learned my addr 172.21.15.37:0/1364858517 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:04.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12d3e00640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12d4158e00 0x7f12d4159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12d8a00640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12d406bea0 0x7f12d414a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12d9400640 1 -- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12d4158e00 msgr2=0x7f12d4159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12d9400640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12d4158e00 0x7f12d4159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12d9400640 1 -- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12d406bea0 msgr2=0x7f12d414a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12d9400640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12d406bea0 0x7f12d414a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12d9400640 1 -- 172.21.15.37:0/1364858517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d415b8e0 con 0x7f12d41624a0 2024-05-30T06:57:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12d8a00640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12d406bea0 0x7f12d414a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.579+0000 7f12d9400640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d41624a0 0x7f12d4147b90 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00c7d0 tx=0x7f12cc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.583+0000 7f12d0c00640 1 -- 172.21.15.37:0/1364858517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12cc018070 con 0x7f12d41624a0 2024-05-30T06:57:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.583+0000 7f12d0c00640 1 -- 172.21.15.37:0/1364858517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12cc00a640 con 0x7f12d41624a0 2024-05-30T06:57:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.583+0000 7f12d0c00640 1 -- 172.21.15.37:0/1364858517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12cc00aa70 con 0x7f12d41624a0 2024-05-30T06:57:04.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.583+0000 7f12db400640 1 -- 172.21.15.37:0/1364858517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d415a840 con 0x7f12d41624a0 2024-05-30T06:57:04.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.583+0000 7f12db400640 1 -- 172.21.15.37:0/1364858517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d415ae00 con 0x7f12d41624a0 2024-05-30T06:57:04.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.583+0000 7f12db400640 1 -- 172.21.15.37:0/1364858517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12d4068bc0 con 0x7f12d41624a0 2024-05-30T06:57:04.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.583+0000 7f12d0c00640 1 -- 172.21.15.37:0/1364858517 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f12cc00ac10 con 0x7f12d41624a0 2024-05-30T06:57:04.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.583+0000 7f12d0c00640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f12b4069bb0 0x7f12b406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.583+0000 7f12d0c00640 1 -- 172.21.15.37:0/1364858517 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7f12cc084d80 con 0x7f12d41624a0 2024-05-30T06:57:04.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.583+0000 7f12d8a00640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f12b4069bb0 0x7f12b406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.587+0000 7f12d8a00640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f12b4069bb0 0x7f12b406c070 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f12d414a600 tx=0x7f12c8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:04.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.587+0000 7f12d0c00640 1 -- 172.21.15.37:0/1364858517 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12d415b8e0 con 0x7f12d41624a0 2024-05-30T06:57:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.755+0000 7f12db400640 1 -- 172.21.15.37:0/1364858517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f12d416a620 con 0x7f12d41624a0 2024-05-30T06:57:04.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.755+0000 7f12d0c00640 1 -- 172.21.15.37:0/1364858517 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) ==== 100+0+11 (secure 0 0 0) 0x7f12cc056750 con 0x7f12d41624a0 2024-05-30T06:57:04.760 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:57:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.759+0000 7f12db400640 1 -- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f12b4069bb0 msgr2=0x7f12b406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.759+0000 7f12db400640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f12b4069bb0 0x7f12b406c070 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f12d414a600 tx=0x7f12c8009040 comp rx=0 tx=0).stop 2024-05-30T06:57:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.759+0000 7f12db400640 1 -- 172.21.15.37:0/1364858517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d41624a0 msgr2=0x7f12d4147b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.759+0000 7f12db400640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d41624a0 0x7f12d4147b90 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00c7d0 tx=0x7f12cc00cc90 comp rx=0 tx=0).stop 2024-05-30T06:57:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.759+0000 7f12db400640 1 -- 172.21.15.37:0/1364858517 shutdown_connections 2024-05-30T06:57:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.759+0000 7f12db400640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d41624a0 0x7f12d4147b90 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.759+0000 7f12db400640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12d4158e00 0x7f12d4159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.759+0000 7f12db400640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f12b4069bb0 0x7f12b406c070 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.759+0000 7f12db400640 1 --2- 172.21.15.37:0/1364858517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12d406bea0 0x7f12d414a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.759+0000 7f12db400640 1 -- 172.21.15.37:0/1364858517 >> 172.21.15.37:0/1364858517 conn(0x7f12d406f110 msgr2=0x7f12d4161510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.759+0000 7f12db400640 1 -- 172.21.15.37:0/1364858517 shutdown_connections 2024-05-30T06:57:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.759+0000 7f12db400640 1 -- 172.21.15.37:0/1364858517 wait complete. 2024-05-30T06:57:04.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:57:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b83600640 1 Processor -- start 2024-05-30T06:57:04.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b83600640 1 -- start start 2024-05-30T06:57:04.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b83600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b7c15e930 0x7f9b7c09b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b83600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9b7c0d1240 0x7f9b7c1625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b83600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9b7c0d1660 0x7f9b7c162ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b83600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9b7c09bee0 con 0x7f9b7c0d1240 2024-05-30T06:57:04.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b83600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9b7c09abe0 con 0x7f9b7c0d1660 2024-05-30T06:57:04.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b83600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7c09aec0 con 0x7f9b7c15e930 2024-05-30T06:57:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b73e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9b7c0d1240 0x7f9b7c1625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b73e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9b7c0d1240 0x7f9b7c1625a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43058/0 (socket says 172.21.15.37:43058) 2024-05-30T06:57:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b73e00640 1 -- 172.21.15.37:0/3717164321 learned_addr learned my addr 172.21.15.37:0/3717164321 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b80c00640 1 --2- 172.21.15.37:0/3717164321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b7c15e930 0x7f9b7c09b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b81600640 1 --2- 172.21.15.37:0/3717164321 >> v2:172.21.15.105:3300/0 conn(0x7f9b7c0d1660 0x7f9b7c162ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b73e00640 1 -- 172.21.15.37:0/3717164321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b7c15e930 msgr2=0x7f9b7c09b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b73e00640 1 --2- 172.21.15.37:0/3717164321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b7c15e930 0x7f9b7c09b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b73e00640 1 -- 172.21.15.37:0/3717164321 >> v2:172.21.15.105:3300/0 conn(0x7f9b7c0d1660 msgr2=0x7f9b7c162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b73e00640 1 --2- 172.21.15.37:0/3717164321 >> v2:172.21.15.105:3300/0 conn(0x7f9b7c0d1660 0x7f9b7c162ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.919+0000 7f9b73e00640 1 -- 172.21.15.37:0/3717164321 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7c09b1a0 con 0x7f9b7c0d1240 2024-05-30T06:57:04.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.923+0000 7f9b73e00640 1 --2- 172.21.15.37:0/3717164321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b7c0d1240 0x7f9b7c1625a0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c0d0480 tx=0x7f9b6401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a22ae95ad6a163 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:04.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.923+0000 7f9b7be00640 1 -- 172.21.15.37:0/3717164321 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b640ab5f0 con 0x7f9b7c0d1240 2024-05-30T06:57:04.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.923+0000 7f9b7be00640 1 -- 172.21.15.37:0/3717164321 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b640b0070 con 0x7f9b7c0d1240 2024-05-30T06:57:04.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.923+0000 7f9b7be00640 1 -- 172.21.15.37:0/3717164321 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b640ab9b0 con 0x7f9b7c0d1240 2024-05-30T06:57:04.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.923+0000 7f9b83600640 1 -- 172.21.15.37:0/3717164321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b7c0d1240 msgr2=0x7f9b7c1625a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.923+0000 7f9b83600640 1 --2- 172.21.15.37:0/3717164321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b7c0d1240 0x7f9b7c1625a0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c0d0480 tx=0x7f9b6401c520 comp rx=0 tx=0).stop 2024-05-30T06:57:04.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.923+0000 7f9b83600640 1 -- 172.21.15.37:0/3717164321 shutdown_connections 2024-05-30T06:57:04.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.923+0000 7f9b83600640 1 --2- 172.21.15.37:0/3717164321 >> v2:172.21.15.105:3300/0 conn(0x7f9b7c0d1660 0x7f9b7c162ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.923+0000 7f9b83600640 1 --2- 172.21.15.37:0/3717164321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b7c0d1240 0x7f9b7c1625a0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.923+0000 7f9b83600640 1 --2- 172.21.15.37:0/3717164321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b7c15e930 0x7f9b7c09b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.923+0000 7f9b83600640 1 -- 172.21.15.37:0/3717164321 >> 172.21.15.37:0/3717164321 conn(0x7f9b7c0b4100 msgr2=0x7f9b7c0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:04.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.923+0000 7f9b83600640 1 -- 172.21.15.37:0/3717164321 shutdown_connections 2024-05-30T06:57:04.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.923+0000 7f9b83600640 1 -- 172.21.15.37:0/3717164321 wait complete. 2024-05-30T06:57:04.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b83600640 1 Processor -- start 2024-05-30T06:57:04.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b83600640 1 -- start start 2024-05-30T06:57:04.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b83600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b7c0d1240 0x7f9b7c0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b83600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b7c0d1660 0x7f9b7c14d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b83600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b7c15e930 0x7f9b7c14dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b83600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c0cd5f0 con 0x7f9b7c15e930 2024-05-30T06:57:04.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b83600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7c0cd470 con 0x7f9b7c0d1660 2024-05-30T06:57:04.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b83600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7c0cd770 con 0x7f9b7c0d1240 2024-05-30T06:57:04.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b81600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b7c15e930 0x7f9b7c14dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b81600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b7c15e930 0x7f9b7c14dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43072/0 (socket says 172.21.15.37:43072) 2024-05-30T06:57:04.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b81600640 1 -- 172.21.15.37:0/234995652 learned_addr learned my addr 172.21.15.37:0/234995652 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:04.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b80c00640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b7c0d1240 0x7f9b7c0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b73e00640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b7c0d1660 0x7f9b7c14d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b81600640 1 -- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b7c0d1240 msgr2=0x7f9b7c0703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b81600640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b7c0d1240 0x7f9b7c0703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b81600640 1 -- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b7c0d1660 msgr2=0x7f9b7c14d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:04.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b81600640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b7c0d1660 0x7f9b7c14d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:04.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b81600640 1 -- 172.21.15.37:0/234995652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7c1595d0 con 0x7f9b7c15e930 2024-05-30T06:57:04.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b81600640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b7c15e930 0x7f9b7c14dc00 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f9b74007d20 tx=0x7f9b7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:04.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b79600640 1 -- 172.21.15.37:0/234995652 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74014420 con 0x7f9b7c15e930 2024-05-30T06:57:04.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b79600640 1 -- 172.21.15.37:0/234995652 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b74019070 con 0x7f9b7c15e930 2024-05-30T06:57:04.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b83600640 1 -- 172.21.15.37:0/234995652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7c1598b0 con 0x7f9b7c15e930 2024-05-30T06:57:04.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b79600640 1 -- 172.21.15.37:0/234995652 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74014820 con 0x7f9b7c15e930 2024-05-30T06:57:04.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b83600640 1 -- 172.21.15.37:0/234995652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b7c159e70 con 0x7f9b7c15e930 2024-05-30T06:57:04.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.927+0000 7f9b83600640 1 -- 172.21.15.37:0/234995652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b7c068b20 con 0x7f9b7c15e930 2024-05-30T06:57:04.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.931+0000 7f9b79600640 1 -- 172.21.15.37:0/234995652 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f9b740149c0 con 0x7f9b7c15e930 2024-05-30T06:57:04.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.931+0000 7f9b79600640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9b58069bb0 0x7f9b5806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:04.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.931+0000 7f9b79600640 1 -- 172.21.15.37:0/234995652 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7f9b74085f20 con 0x7f9b7c15e930 2024-05-30T06:57:04.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.931+0000 7f9b80c00640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9b58069bb0 0x7f9b5806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:04.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.931+0000 7f9b80c00640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9b58069bb0 0x7f9b5806c070 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c007a60 tx=0x7f9b6c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:04.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:04.935+0000 7f9b79600640 1 -- 172.21.15.37:0/234995652 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9b74057860 con 0x7f9b7c15e930 2024-05-30T06:57:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.135+0000 7f9b83600640 1 -- 172.21.15.37:0/234995652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b7c0b4ee0 con 0x7f9b7c15e930 2024-05-30T06:57:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.135+0000 7f9b79600640 1 -- 172.21.15.37:0/234995652 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5180 (secure 0 0 0) 0x7f9b7405bb60 con 0x7f9b7c15e930 2024-05-30T06:57:05.139 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:05.140 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/667666714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":667666714},{"type":"v1","addr":"172.21.15.105:6836","nonce":667666714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/748743640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":748743640},{"type":"v1","addr":"172.21.15.37:6835","nonce":748743640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/527055184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":527055184},{"type":"v1","addr":"172.21.15.105:6837","nonce":527055184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:55:34.327016+0000","modified":"2024-05-30T06:55:37.340047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8538":{"gid":8538,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/1190106206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1190106206},{"type":"v1","addr":"172.21.15.37:6834","nonce":1190106206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8538,"qdb_cluster":[8538]},"id":7}]} 2024-05-30T06:57:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 65 2024-05-30T06:57:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.139+0000 7f9b83600640 1 -- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9b58069bb0 msgr2=0x7f9b5806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.139+0000 7f9b83600640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9b58069bb0 0x7f9b5806c070 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c007a60 tx=0x7f9b6c008040 comp rx=0 tx=0).stop 2024-05-30T06:57:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.139+0000 7f9b83600640 1 -- 172.21.15.37:0/234995652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b7c15e930 msgr2=0x7f9b7c14dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.139+0000 7f9b83600640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b7c15e930 0x7f9b7c14dc00 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f9b74007d20 tx=0x7f9b7400e4b0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.139+0000 7f9b83600640 1 -- 172.21.15.37:0/234995652 shutdown_connections 2024-05-30T06:57:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.139+0000 7f9b83600640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b7c15e930 0x7f9b7c14dc00 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.139+0000 7f9b83600640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9b58069bb0 0x7f9b5806c070 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.139+0000 7f9b83600640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9b7c0d1660 0x7f9b7c14d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.139+0000 7f9b83600640 1 --2- 172.21.15.37:0/234995652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9b7c0d1240 0x7f9b7c0703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.139+0000 7f9b83600640 1 -- 172.21.15.37:0/234995652 >> 172.21.15.37:0/234995652 conn(0x7f9b7c0b4100 msgr2=0x7f9b7c0b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.139+0000 7f9b83600640 1 -- 172.21.15.37:0/234995652 shutdown_connections 2024-05-30T06:57:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.139+0000 7f9b83600640 1 -- 172.21.15.37:0/234995652 wait complete. 2024-05-30T06:57:05.162 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:57:05.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa69b400640 1 Processor -- start 2024-05-30T06:57:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa69b400640 1 -- start start 2024-05-30T06:57:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa69b400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa69415cd80 0x7fa69406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa69b400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6940cd120 con 0x7fa69406e000 2024-05-30T06:57:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa69b400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6940cd400 con 0x7fa6940ce8d0 2024-05-30T06:57:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa69b400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa6940a9530 con 0x7fa69415cd80 2024-05-30T06:57:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa698a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa69406e000 0x7fa6940ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34400/0 (socket says 172.21.15.37:34400) 2024-05-30T06:57:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa698a00640 1 -- 172.21.15.37:0/1085526126 learned_addr learned my addr 172.21.15.37:0/1085526126 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa68be00640 1 --2- 172.21.15.37:0/1085526126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa69415cd80 0x7fa69406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa693e00640 1 -- 172.21.15.37:0/1085526126 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2844178584 0 0) 0x7fa6940cd120 con 0x7fa69406e000 2024-05-30T06:57:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa693e00640 1 -- 172.21.15.37:0/1085526126 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa678003530 con 0x7fa69406e000 2024-05-30T06:57:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa693e00640 1 -- 172.21.15.37:0/1085526126 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2649234096 0 0) 0x7fa6940cd400 con 0x7fa6940ce8d0 2024-05-30T06:57:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa693e00640 1 -- 172.21.15.37:0/1085526126 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6940cd120 con 0x7fa6940ce8d0 2024-05-30T06:57:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa68be00640 1 -- 172.21.15.37:0/1085526126 >> v1:172.21.15.105:6789/0 conn(0x7fa6940ce8d0 legacy=0x7fa6941663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa68be00640 1 -- 172.21.15.37:0/1085526126 >> v1:172.21.15.37:6789/0 conn(0x7fa69406e000 legacy=0x7fa6940ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.299+0000 7fa68be00640 1 -- 172.21.15.37:0/1085526126 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6940cd6e0 con 0x7fa69415cd80 2024-05-30T06:57:05.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.303+0000 7fa68be00640 1 --2- 172.21.15.37:0/1085526126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa69415cd80 0x7fa69406f3f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0097f0 tx=0x7fa67c01ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccdd87fd14a328c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.303+0000 7fa693e00640 1 -- 172.21.15.37:0/1085526126 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0b5070 con 0x7fa69415cd80 2024-05-30T06:57:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.303+0000 7fa693e00640 1 -- 172.21.15.37:0/1085526126 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67c0a89d0 con 0x7fa69415cd80 2024-05-30T06:57:05.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.303+0000 7fa693e00640 1 -- 172.21.15.37:0/1085526126 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0a8da0 con 0x7fa69415cd80 2024-05-30T06:57:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.303+0000 7fa69b400640 1 -- 172.21.15.37:0/1085526126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa69415cd80 msgr2=0x7fa69406f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.303+0000 7fa69b400640 1 --2- 172.21.15.37:0/1085526126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa69415cd80 0x7fa69406f3f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0097f0 tx=0x7fa67c01ecd0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.303+0000 7fa69b400640 1 -- 172.21.15.37:0/1085526126 shutdown_connections 2024-05-30T06:57:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.303+0000 7fa69b400640 1 --2- 172.21.15.37:0/1085526126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa69415cd80 0x7fa69406f3f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.303+0000 7fa69b400640 1 -- 172.21.15.37:0/1085526126 >> 172.21.15.37:0/1085526126 conn(0x7fa6940b23a0 msgr2=0x7fa6940b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.303+0000 7fa69b400640 1 -- 172.21.15.37:0/1085526126 shutdown_connections 2024-05-30T06:57:05.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.303+0000 7fa69b400640 1 -- 172.21.15.37:0/1085526126 wait complete. 2024-05-30T06:57:05.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa69b400640 1 Processor -- start 2024-05-30T06:57:05.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa69b400640 1 -- start start 2024-05-30T06:57:05.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa69b400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa69406e000 0x7fa69413ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:05.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa69b400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6940ce8d0 0x7fa69413f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:05.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa69b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69415cd80 0x7fa69413be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:05.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa69b400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa69406f930 con 0x7fa69415cd80 2024-05-30T06:57:05.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa69b400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa6940cdce0 con 0x7fa6940ce8d0 2024-05-30T06:57:05.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa69b400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa69406fab0 con 0x7fa69406e000 2024-05-30T06:57:05.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa699400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69415cd80 0x7fa69413be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:05.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa699400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69415cd80 0x7fa69413be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43080/0 (socket says 172.21.15.37:43080) 2024-05-30T06:57:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa699400640 1 -- 172.21.15.37:0/3455047196 learned_addr learned my addr 172.21.15.37:0/3455047196 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa698a00640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa69406e000 0x7fa69413ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa68be00640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6940ce8d0 0x7fa69413f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa699400640 1 -- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa69406e000 msgr2=0x7fa69413ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa699400640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa69406e000 0x7fa69413ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa699400640 1 -- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6940ce8d0 msgr2=0x7fa69413f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa699400640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6940ce8d0 0x7fa69413f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa699400640 1 -- 172.21.15.37:0/3455047196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6940b4ba0 con 0x7fa69415cd80 2024-05-30T06:57:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa699400640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69415cd80 0x7fa69413be10 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00c790 tx=0x7fa68c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa691600640 1 -- 172.21.15.37:0/3455047196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c003b80 con 0x7fa69415cd80 2024-05-30T06:57:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa691600640 1 -- 172.21.15.37:0/3455047196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68c003d20 con 0x7fa69415cd80 2024-05-30T06:57:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa691600640 1 -- 172.21.15.37:0/3455047196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c00aa50 con 0x7fa69415cd80 2024-05-30T06:57:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.307+0000 7fa69b400640 1 -- 172.21.15.37:0/3455047196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6940b4e80 con 0x7fa69415cd80 2024-05-30T06:57:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.311+0000 7fa69b400640 1 -- 172.21.15.37:0/3455047196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6940b5440 con 0x7fa69415cd80 2024-05-30T06:57:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.311+0000 7fa69b400640 1 -- 172.21.15.37:0/3455047196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa694068b20 con 0x7fa69415cd80 2024-05-30T06:57:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.311+0000 7fa691600640 1 -- 172.21.15.37:0/3455047196 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fa68c00abf0 con 0x7fa69415cd80 2024-05-30T06:57:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.311+0000 7fa691600640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa670069bb0 0x7fa67006c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.311+0000 7fa691600640 1 -- 172.21.15.37:0/3455047196 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7fa68c085640 con 0x7fa69415cd80 2024-05-30T06:57:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.311+0000 7fa698a00640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa670069bb0 0x7fa67006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.311+0000 7fa698a00640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa670069bb0 0x7fa67006c070 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa6840011f0 tx=0x7fa684007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:05.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.315+0000 7fa691600640 1 -- 172.21.15.37:0/3455047196 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa68c057010 con 0x7fa69415cd80 2024-05-30T06:57:05.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.479+0000 7fa69b400640 1 -- 172.21.15.37:0/3455047196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6940b0ec0 con 0x7fa69415cd80 2024-05-30T06:57:05.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.483+0000 7fa691600640 1 -- 172.21.15.37:0/3455047196 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16762 (secure 0 0 0) 0x7fa68c05b310 con 0x7fa69415cd80 2024-05-30T06:57:05.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:05.486 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":103,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:57:00.682415+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:55:32.713799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-05-30T06:55:33.276484+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:57:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.483+0000 7fa69b400640 1 -- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa670069bb0 msgr2=0x7fa67006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.483+0000 7fa69b400640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa670069bb0 0x7fa67006c070 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa6840011f0 tx=0x7fa684007d40 comp rx=0 tx=0).stop 2024-05-30T06:57:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.483+0000 7fa69b400640 1 -- 172.21.15.37:0/3455047196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69415cd80 msgr2=0x7fa69413be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.483+0000 7fa69b400640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69415cd80 0x7fa69413be10 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00c790 tx=0x7fa68c00cc50 comp rx=0 tx=0).stop 2024-05-30T06:57:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.483+0000 7fa69b400640 1 -- 172.21.15.37:0/3455047196 shutdown_connections 2024-05-30T06:57:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.483+0000 7fa69b400640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa69415cd80 0x7fa69413be10 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.483+0000 7fa69b400640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa670069bb0 0x7fa67006c070 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.483+0000 7fa69b400640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6940ce8d0 0x7fa69413f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.483+0000 7fa69b400640 1 --2- 172.21.15.37:0/3455047196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa69406e000 0x7fa69413ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.483+0000 7fa69b400640 1 -- 172.21.15.37:0/3455047196 >> 172.21.15.37:0/3455047196 conn(0x7fa6940b23a0 msgr2=0x7fa6940b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.483+0000 7fa69b400640 1 -- 172.21.15.37:0/3455047196 shutdown_connections 2024-05-30T06:57:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.483+0000 7fa69b400640 1 -- 172.21.15.37:0/3455047196 wait complete. 2024-05-30T06:57:05.507 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T06:57:05.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:57:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.643+0000 7f473c800640 1 Processor -- start 2024-05-30T06:57:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.643+0000 7f473c800640 1 -- start start 2024-05-30T06:57:05.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f473c800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f473406f9a0 0x7f47340b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f473c800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47340b2ec0 0x7f47340cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f473c800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473415c8f0 con 0x7f4734155e60 2024-05-30T06:57:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f473c800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f47340ccff0 con 0x7f473406f9a0 2024-05-30T06:57:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f473c800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f47340ccc80 con 0x7f47340b2ec0 2024-05-30T06:57:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f4739400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f473406f9a0 0x7f47340b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f4739400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f473406f9a0 0x7f47340b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43088/0 (socket says 172.21.15.37:43088) 2024-05-30T06:57:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f4739400640 1 -- 172.21.15.37:0/2090363324 learned_addr learned my addr 172.21.15.37:0/2090363324 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f473a800640 1 --2- 172.21.15.37:0/2090363324 >> v2:172.21.15.105:3300/0 conn(0x7f47340b2ec0 0x7f47340cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f4739400640 1 -- 172.21.15.37:0/2090363324 >> v2:172.21.15.105:3300/0 conn(0x7f47340b2ec0 msgr2=0x7f47340cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f4739400640 1 --2- 172.21.15.37:0/2090363324 >> v2:172.21.15.105:3300/0 conn(0x7f47340b2ec0 0x7f47340cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f4739400640 1 -- 172.21.15.37:0/2090363324 >> v1:172.21.15.105:6789/0 conn(0x7f4734155e60 legacy=0x7f47340cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f4739400640 1 -- 172.21.15.37:0/2090363324 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473415cbd0 con 0x7f473406f9a0 2024-05-30T06:57:05.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.647+0000 7f4739400640 1 --2- 172.21.15.37:0/2090363324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473406f9a0 0x7f47340b36a0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f47340718e0 tx=0x7f472401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b54ff3cc561540 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f4738a00640 1 -- 172.21.15.37:0/2090363324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240ab430 con 0x7f473406f9a0 2024-05-30T06:57:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f4738a00640 1 -- 172.21.15.37:0/2090363324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47240b0070 con 0x7f473406f9a0 2024-05-30T06:57:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f4738a00640 1 -- 172.21.15.37:0/2090363324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240ab7f0 con 0x7f473406f9a0 2024-05-30T06:57:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 -- 172.21.15.37:0/2090363324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473406f9a0 msgr2=0x7f47340b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 --2- 172.21.15.37:0/2090363324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473406f9a0 0x7f47340b36a0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f47340718e0 tx=0x7f472401c520 comp rx=0 tx=0).stop 2024-05-30T06:57:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 -- 172.21.15.37:0/2090363324 shutdown_connections 2024-05-30T06:57:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 --2- 172.21.15.37:0/2090363324 >> v2:172.21.15.105:3300/0 conn(0x7f47340b2ec0 0x7f47340cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 --2- 172.21.15.37:0/2090363324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f473406f9a0 0x7f47340b36a0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 -- 172.21.15.37:0/2090363324 >> 172.21.15.37:0/2090363324 conn(0x7f47340b23a0 msgr2=0x7f47340b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:05.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 -- 172.21.15.37:0/2090363324 shutdown_connections 2024-05-30T06:57:05.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 -- 172.21.15.37:0/2090363324 wait complete. 2024-05-30T06:57:05.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 Processor -- start 2024-05-30T06:57:05.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 -- start start 2024-05-30T06:57:05.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f473406f9a0 0x7f473414ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:05.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47340b2ec0 0x7f473414a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:05.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4734155e60 0x7f4734159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:05.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f473406ec60 con 0x7f47340b2ec0 2024-05-30T06:57:05.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f473406eae0 con 0x7f473406f9a0 2024-05-30T06:57:05.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473c800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f473406ede0 con 0x7f4734155e60 2024-05-30T06:57:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f4739400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47340b2ec0 0x7f473414a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f4739400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47340b2ec0 0x7f473414a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43104/0 (socket says 172.21.15.37:43104) 2024-05-30T06:57:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f4739400640 1 -- 172.21.15.37:0/3059068962 learned_addr learned my addr 172.21.15.37:0/3059068962 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f4739e00640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f473406f9a0 0x7f473414ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.651+0000 7f473a800640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4734155e60 0x7f4734159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f4739400640 1 -- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4734155e60 msgr2=0x7f4734159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f4739400640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4734155e60 0x7f4734159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f4739400640 1 -- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f473406f9a0 msgr2=0x7f473414ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f4739400640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f473406f9a0 0x7f473414ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f4739400640 1 -- 172.21.15.37:0/3059068962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4734157e00 con 0x7f47340b2ec0 2024-05-30T06:57:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f4739e00640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f473406f9a0 0x7f473414ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f473a800640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4734155e60 0x7f4734159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:05.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f4739400640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47340b2ec0 0x7f473414a0f0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f47240ad040 tx=0x7f472401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:05.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f472e000640 1 -- 172.21.15.37:0/3059068962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240be5f0 con 0x7f47340b2ec0 2024-05-30T06:57:05.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f472e000640 1 -- 172.21.15.37:0/3059068962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47240be7b0 con 0x7f47340b2ec0 2024-05-30T06:57:05.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f473c800640 1 -- 172.21.15.37:0/3059068962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47341580e0 con 0x7f47340b2ec0 2024-05-30T06:57:05.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f472e000640 1 -- 172.21.15.37:0/3059068962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240beba0 con 0x7f47340b2ec0 2024-05-30T06:57:05.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f473c800640 1 -- 172.21.15.37:0/3059068962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f473414a630 con 0x7f47340b2ec0 2024-05-30T06:57:05.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f473c800640 1 -- 172.21.15.37:0/3059068962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4734068b20 con 0x7f47340b2ec0 2024-05-30T06:57:05.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f472e000640 1 -- 172.21.15.37:0/3059068962 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f47240b43f0 con 0x7f47340b2ec0 2024-05-30T06:57:05.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.655+0000 7f472e000640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4718069be0 0x7f471806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:05.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.659+0000 7f472e000640 1 -- 172.21.15.37:0/3059068962 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7f47240a8070 con 0x7f47340b2ec0 2024-05-30T06:57:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.659+0000 7f4739e00640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4718069be0 0x7f471806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.659+0000 7f4739e00640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4718069be0 0x7f471806c0a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4728001670 tx=0x7f4728009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.663+0000 7f472e000640 1 -- 172.21.15.37:0/3059068962 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4724016110 con 0x7f47340b2ec0 2024-05-30T06:57:05.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:57:05.699 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:57:05.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.863+0000 7f473c800640 1 -- 172.21.15.37:0/3059068962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4734072fb0 con 0x7f47340b2ec0 2024-05-30T06:57:05.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.863+0000 7f472e000640 1 -- 172.21.15.37:0/3059068962 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5180 (secure 0 0 0) 0x7f47240f2040 con 0x7f47340b2ec0 2024-05-30T06:57:05.869 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:05.869 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/667666714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":667666714},{"type":"v1","addr":"172.21.15.105:6836","nonce":667666714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/748743640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":748743640},{"type":"v1","addr":"172.21.15.37:6835","nonce":748743640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/527055184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":527055184},{"type":"v1","addr":"172.21.15.105:6837","nonce":527055184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:55:34.327016+0000","modified":"2024-05-30T06:55:37.340047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8538":{"gid":8538,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/1190106206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1190106206},{"type":"v1","addr":"172.21.15.37:6834","nonce":1190106206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8538,"qdb_cluster":[8538]},"id":7}]} 2024-05-30T06:57:05.869 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 65 2024-05-30T06:57:05.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.867+0000 7f473c800640 1 -- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4718069be0 msgr2=0x7f471806c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.867+0000 7f473c800640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4718069be0 0x7f471806c0a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4728001670 tx=0x7f4728009040 comp rx=0 tx=0).stop 2024-05-30T06:57:05.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.867+0000 7f473c800640 1 -- 172.21.15.37:0/3059068962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47340b2ec0 msgr2=0x7f473414a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.867+0000 7f473c800640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47340b2ec0 0x7f473414a0f0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f47240ad040 tx=0x7f472401ad60 comp rx=0 tx=0).stop 2024-05-30T06:57:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.867+0000 7f473c800640 1 -- 172.21.15.37:0/3059068962 shutdown_connections 2024-05-30T06:57:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.867+0000 7f473c800640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4734155e60 0x7f4734159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.867+0000 7f473c800640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47340b2ec0 0x7f473414a0f0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.867+0000 7f473c800640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4718069be0 0x7f471806c0a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.867+0000 7f473c800640 1 --2- 172.21.15.37:0/3059068962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f473406f9a0 0x7f473414ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.867+0000 7f473c800640 1 -- 172.21.15.37:0/3059068962 >> 172.21.15.37:0/3059068962 conn(0x7f47340b23a0 msgr2=0x7f47340b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.867+0000 7f473c800640 1 -- 172.21.15.37:0/3059068962 shutdown_connections 2024-05-30T06:57:05.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:05.867+0000 7f473c800640 1 -- 172.21.15.37:0/3059068962 wait complete. 2024-05-30T06:57:05.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:57:06.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.027+0000 7fb57c400640 1 Processor -- start 2024-05-30T06:57:06.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.027+0000 7fb57c400640 1 -- start start 2024-05-30T06:57:06.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.027+0000 7fb57c400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb57406f9a0 0x7fb5740b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.027+0000 7fb57c400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb5740b2ec0 0x7fb5740cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.027+0000 7fb57c400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb57415c8f0 con 0x7fb574155e60 2024-05-30T06:57:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.027+0000 7fb57c400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb5740ccff0 con 0x7fb5740b2ec0 2024-05-30T06:57:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.027+0000 7fb57c400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb5740ccc80 con 0x7fb57406f9a0 2024-05-30T06:57:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.027+0000 7fb579a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb574155e60 0x7fb5740cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34410/0 (socket says 172.21.15.37:34410) 2024-05-30T06:57:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.031+0000 7fb579a00640 1 -- 172.21.15.37:0/1842666613 learned_addr learned my addr 172.21.15.37:0/1842666613 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.031+0000 7fb57a400640 1 --2- 172.21.15.37:0/1842666613 >> v2:172.21.15.37:3300/0 conn(0x7fb5740b2ec0 0x7fb5740cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.031+0000 7fb579000640 1 --2- 172.21.15.37:0/1842666613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb57406f9a0 0x7fb5740b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.031+0000 7fb573e00640 1 -- 172.21.15.37:0/1842666613 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920702087 0 0) 0x7fb57415c8f0 con 0x7fb574155e60 2024-05-30T06:57:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.031+0000 7fb573e00640 1 -- 172.21.15.37:0/1842666613 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb55c003530 con 0x7fb574155e60 2024-05-30T06:57:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.031+0000 7fb57a400640 1 -- 172.21.15.37:0/1842666613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb57406f9a0 msgr2=0x7fb5740b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:06.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.031+0000 7fb57a400640 1 --2- 172.21.15.37:0/1842666613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb57406f9a0 0x7fb5740b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.031+0000 7fb57a400640 1 -- 172.21.15.37:0/1842666613 >> v1:172.21.15.37:6789/0 conn(0x7fb574155e60 legacy=0x7fb5740cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.031+0000 7fb57a400640 1 -- 172.21.15.37:0/1842666613 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57415cbd0 con 0x7fb5740b2ec0 2024-05-30T06:57:06.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.031+0000 7fb57a400640 1 --2- 172.21.15.37:0/1842666613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5740b2ec0 0x7fb5740cd480 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009d90 tx=0x7fb56c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edb693ef24cc91 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:06.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.031+0000 7fb573e00640 1 -- 172.21.15.37:0/1842666613 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0b2070 con 0x7fb5740b2ec0 2024-05-30T06:57:06.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.031+0000 7fb573e00640 1 -- 172.21.15.37:0/1842666613 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb56c0a5940 con 0x7fb5740b2ec0 2024-05-30T06:57:06.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.031+0000 7fb573e00640 1 -- 172.21.15.37:0/1842666613 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0a5d10 con 0x7fb5740b2ec0 2024-05-30T06:57:06.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 -- 172.21.15.37:0/1842666613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5740b2ec0 msgr2=0x7fb5740cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 --2- 172.21.15.37:0/1842666613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5740b2ec0 0x7fb5740cd480 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009d90 tx=0x7fb56c01c970 comp rx=0 tx=0).stop 2024-05-30T06:57:06.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 -- 172.21.15.37:0/1842666613 shutdown_connections 2024-05-30T06:57:06.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 --2- 172.21.15.37:0/1842666613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5740b2ec0 0x7fb5740cd480 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 --2- 172.21.15.37:0/1842666613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb57406f9a0 0x7fb5740b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 -- 172.21.15.37:0/1842666613 >> 172.21.15.37:0/1842666613 conn(0x7fb5740b23a0 msgr2=0x7fb5740b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:06.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 -- 172.21.15.37:0/1842666613 shutdown_connections 2024-05-30T06:57:06.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 -- 172.21.15.37:0/1842666613 wait complete. 2024-05-30T06:57:06.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 Processor -- start 2024-05-30T06:57:06.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 -- start start 2024-05-30T06:57:06.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57406f9a0 0x7fb574157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5740b2ec0 0x7fb57414e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb574155e60 0x7fb57414eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5741689f0 con 0x7fb57406f9a0 2024-05-30T06:57:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb574168870 con 0x7fb5740b2ec0 2024-05-30T06:57:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57c400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb574168b70 con 0x7fb574155e60 2024-05-30T06:57:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb579a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57406f9a0 0x7fb574157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb579a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57406f9a0 0x7fb574157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43128/0 (socket says 172.21.15.37:43128) 2024-05-30T06:57:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb579a00640 1 -- 172.21.15.37:0/3274178873 learned_addr learned my addr 172.21.15.37:0/3274178873 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb57a400640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb574155e60 0x7fb57414eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb579000640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5740b2ec0 0x7fb57414e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb579a00640 1 -- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb574155e60 msgr2=0x7fb57414eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb579a00640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb574155e60 0x7fb57414eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb579a00640 1 -- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5740b2ec0 msgr2=0x7fb57414e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb579a00640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5740b2ec0 0x7fb57414e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb579a00640 1 -- 172.21.15.37:0/3274178873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb574156cf0 con 0x7fb57406f9a0 2024-05-30T06:57:06.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.035+0000 7fb579a00640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57406f9a0 0x7fb574157d90 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fb56800c3c0 tx=0x7fb56800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:06.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.039+0000 7fb571600640 1 -- 172.21.15.37:0/3274178873 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568017070 con 0x7fb57406f9a0 2024-05-30T06:57:06.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.039+0000 7fb571600640 1 -- 172.21.15.37:0/3274178873 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb568005cf0 con 0x7fb57406f9a0 2024-05-30T06:57:06.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.039+0000 7fb571600640 1 -- 172.21.15.37:0/3274178873 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5680072f0 con 0x7fb57406f9a0 2024-05-30T06:57:06.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.039+0000 7fb57c400640 1 -- 172.21.15.37:0/3274178873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb574156fd0 con 0x7fb57406f9a0 2024-05-30T06:57:06.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.039+0000 7fb57c400640 1 -- 172.21.15.37:0/3274178873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb574157590 con 0x7fb57406f9a0 2024-05-30T06:57:06.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.039+0000 7fb57c400640 1 -- 172.21.15.37:0/3274178873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb574068b20 con 0x7fb57406f9a0 2024-05-30T06:57:06.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.039+0000 7fb571600640 1 -- 172.21.15.37:0/3274178873 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fb56801a070 con 0x7fb57406f9a0 2024-05-30T06:57:06.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.039+0000 7fb571600640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb554069bb0 0x7fb55406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.039+0000 7fb571600640 1 -- 172.21.15.37:0/3274178873 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7fb568084b70 con 0x7fb57406f9a0 2024-05-30T06:57:06.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.039+0000 7fb579000640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb554069bb0 0x7fb55406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.043+0000 7fb579000640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb554069bb0 0x7fb55406c070 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb5741f8fc0 tx=0x7fb560008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:06.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.043+0000 7fb571600640 1 -- 172.21.15.37:0/3274178873 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb568056b90 con 0x7fb57406f9a0 2024-05-30T06:57:06.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb57c400640 1 -- 172.21.15.37:0/3274178873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb57415eb20 con 0x7fb57406f9a0 2024-05-30T06:57:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb571600640 1 -- 172.21.15.37:0/3274178873 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5180 (secure 0 0 0) 0x7fb568056490 con 0x7fb57406f9a0 2024-05-30T06:57:06.251 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:06.251 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":65,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/667666714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":667666714},{"type":"v1","addr":"172.21.15.105:6836","nonce":667666714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/748743640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":748743640},{"type":"v1","addr":"172.21.15.37:6835","nonce":748743640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/527055184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":527055184},{"type":"v1","addr":"172.21.15.105:6837","nonce":527055184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:55:34.327016+0000","modified":"2024-05-30T06:55:37.340047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8538},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8538":{"gid":8538,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/1190106206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1190106206},{"type":"v1","addr":"172.21.15.37:6834","nonce":1190106206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8538,"qdb_cluster":[8538]},"id":7}]} 2024-05-30T06:57:06.251 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 65 2024-05-30T06:57:06.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb57c400640 1 -- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb554069bb0 msgr2=0x7fb55406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb57c400640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb554069bb0 0x7fb55406c070 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb5741f8fc0 tx=0x7fb560008040 comp rx=0 tx=0).stop 2024-05-30T06:57:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb57c400640 1 -- 172.21.15.37:0/3274178873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57406f9a0 msgr2=0x7fb574157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb57c400640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57406f9a0 0x7fb574157d90 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fb56800c3c0 tx=0x7fb56800c880 comp rx=0 tx=0).stop 2024-05-30T06:57:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb57c400640 1 -- 172.21.15.37:0/3274178873 shutdown_connections 2024-05-30T06:57:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb57c400640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb574155e60 0x7fb57414eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb57c400640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb554069bb0 0x7fb55406c070 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb57c400640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5740b2ec0 0x7fb57414e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb57c400640 1 --2- 172.21.15.37:0/3274178873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57406f9a0 0x7fb574157d90 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb57c400640 1 -- 172.21.15.37:0/3274178873 >> 172.21.15.37:0/3274178873 conn(0x7fb5740b23a0 msgr2=0x7fb57415c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb57c400640 1 -- 172.21.15.37:0/3274178873 shutdown_connections 2024-05-30T06:57:06.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.247+0000 7fb57c400640 1 -- 172.21.15.37:0/3274178873 wait complete. 2024-05-30T06:57:06.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:57:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.407+0000 7f29d3e00640 1 Processor -- start 2024-05-30T06:57:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.407+0000 7f29d3e00640 1 -- start start 2024-05-30T06:57:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.411+0000 7f29d3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29d406b960 0x7f29d40b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.411+0000 7f29d3e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29d40b0cf0 con 0x7f29d40b25b0 2024-05-30T06:57:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.411+0000 7f29d3e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29d40b0fd0 con 0x7f29d40b3b20 2024-05-30T06:57:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.411+0000 7f29d3e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f29d40b12b0 con 0x7f29d406b960 2024-05-30T06:57:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.411+0000 7f29d3400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29d406b960 0x7f29d40b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.411+0000 7f29d2a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f29d40b25b0 0x7f29d415c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34422/0 (socket says 172.21.15.37:34422) 2024-05-30T06:57:06.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.411+0000 7f29d2a00640 1 -- 172.21.15.37:0/2235859667 learned_addr learned my addr 172.21.15.37:0/2235859667 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:06.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.411+0000 7f29d3400640 1 -- 172.21.15.37:0/2235859667 >> v1:172.21.15.105:6789/0 conn(0x7f29d40b3b20 legacy=0x7f29d40cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.411+0000 7f29d3400640 1 -- 172.21.15.37:0/2235859667 >> v1:172.21.15.37:6789/0 conn(0x7f29d40b25b0 legacy=0x7f29d415c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.411+0000 7f29d3400640 1 -- 172.21.15.37:0/2235859667 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d40b1590 con 0x7f29d406b960 2024-05-30T06:57:06.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.411+0000 7f29d2000640 1 -- 172.21.15.37:0/2235859667 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80293183 0 0) 0x7f29d40b0fd0 con 0x7f29d40b3b20 2024-05-30T06:57:06.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.415+0000 7f29d3400640 1 --2- 172.21.15.37:0/2235859667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29d406b960 0x7f29d40b1d90 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009d90 tx=0x7f29cc01c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c236fc65c7103d8b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:06.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.415+0000 7f29d2000640 1 -- 172.21.15.37:0/2235859667 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0b2070 con 0x7f29d406b960 2024-05-30T06:57:06.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.415+0000 7f29d2000640 1 -- 172.21.15.37:0/2235859667 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29cc0a57f0 con 0x7f29d406b960 2024-05-30T06:57:06.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.415+0000 7f29d2000640 1 -- 172.21.15.37:0/2235859667 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29cc0a5bc0 con 0x7f29d406b960 2024-05-30T06:57:06.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.415+0000 7f29d3e00640 1 -- 172.21.15.37:0/2235859667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29d406b960 msgr2=0x7f29d40b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.415+0000 7f29d3e00640 1 --2- 172.21.15.37:0/2235859667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29d406b960 0x7f29d40b1d90 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009d90 tx=0x7f29cc01c7d0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.415+0000 7f29d3e00640 1 -- 172.21.15.37:0/2235859667 shutdown_connections 2024-05-30T06:57:06.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.415+0000 7f29d3e00640 1 --2- 172.21.15.37:0/2235859667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29d406b960 0x7f29d40b1d90 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.415+0000 7f29d3e00640 1 -- 172.21.15.37:0/2235859667 >> 172.21.15.37:0/2235859667 conn(0x7f29d409aa60 msgr2=0x7f29d40b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:06.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.415+0000 7f29d3e00640 1 -- 172.21.15.37:0/2235859667 shutdown_connections 2024-05-30T06:57:06.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.415+0000 7f29d3e00640 1 -- 172.21.15.37:0/2235859667 wait complete. 2024-05-30T06:57:06.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.415+0000 7f29d3e00640 1 Processor -- start 2024-05-30T06:57:06.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.415+0000 7f29d3e00640 1 -- start start 2024-05-30T06:57:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29d3e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29d406b960 0x7f29d40c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29d3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29d40b25b0 0x7f29d4156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29d3e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29d40b3b20 0x7f29d406fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29d3e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f29d416ab80 con 0x7f29d40b25b0 2024-05-30T06:57:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29d3e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f29d416aa00 con 0x7f29d406b960 2024-05-30T06:57:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29d3e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f29d416ad00 con 0x7f29d40b3b20 2024-05-30T06:57:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29cbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29d40b25b0 0x7f29d4156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29cbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29d40b25b0 0x7f29d4156090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43144/0 (socket says 172.21.15.37:43144) 2024-05-30T06:57:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29cbe00640 1 -- 172.21.15.37:0/3864608859 learned_addr learned my addr 172.21.15.37:0/3864608859 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29d2a00640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29d406b960 0x7f29d40c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29d3400640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29d40b3b20 0x7f29d406fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29cbe00640 1 -- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29d40b3b20 msgr2=0x7f29d406fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29cbe00640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29d40b3b20 0x7f29d406fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29cbe00640 1 -- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29d406b960 msgr2=0x7f29d40c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29cbe00640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29d406b960 0x7f29d40c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29cbe00640 1 -- 172.21.15.37:0/3864608859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d40c80a0 con 0x7f29d40b25b0 2024-05-30T06:57:06.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29d2a00640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29d406b960 0x7f29d40c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:06.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29cbe00640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29d40b25b0 0x7f29d4156090 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00c3f0 tx=0x7f29bc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29cb400640 1 -- 172.21.15.37:0/3864608859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc017070 con 0x7f29d40b25b0 2024-05-30T06:57:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29cb400640 1 -- 172.21.15.37:0/3864608859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29bc003600 con 0x7f29d40b25b0 2024-05-30T06:57:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29cb400640 1 -- 172.21.15.37:0/3864608859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0039f0 con 0x7f29d40b25b0 2024-05-30T06:57:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29d3e00640 1 -- 172.21.15.37:0/3864608859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d40c6bb0 con 0x7f29d40b25b0 2024-05-30T06:57:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29d3e00640 1 -- 172.21.15.37:0/3864608859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d40c9110 con 0x7f29d40b25b0 2024-05-30T06:57:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29d3e00640 1 -- 172.21.15.37:0/3864608859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d40c8f00 con 0x7f29d40b25b0 2024-05-30T06:57:06.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.419+0000 7f29cb400640 1 -- 172.21.15.37:0/3864608859 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f29bc01a070 con 0x7f29d40b25b0 2024-05-30T06:57:06.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.423+0000 7f29cb400640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29b0069bb0 0x7f29b006c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.423+0000 7f29cb400640 1 -- 172.21.15.37:0/3864608859 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7f29bc084b60 con 0x7f29d40b25b0 2024-05-30T06:57:06.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.423+0000 7f29d2a00640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29b0069bb0 0x7f29b006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.423+0000 7f29d2a00640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29b0069bb0 0x7f29b006c070 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f29c4000f70 tx=0x7f29c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:06.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.427+0000 7f29cb400640 1 -- 172.21.15.37:0/3864608859 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f29d40c80a0 con 0x7f29d40b25b0 2024-05-30T06:57:06.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.591+0000 7f29d3e00640 1 -- 172.21.15.37:0/3864608859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29d40b73a0 con 0x7f29d40b25b0 2024-05-30T06:57:06.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.591+0000 7f29cb400640 1 -- 172.21.15.37:0/3864608859 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16762 (secure 0 0 0) 0x7f29bc056c20 con 0x7f29d40b25b0 2024-05-30T06:57:06.597 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:06.597 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":103,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:57:00.682415+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:55:32.713799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-05-30T06:55:33.276484+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":103,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:57:06.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.595+0000 7f29d3e00640 1 -- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29b0069bb0 msgr2=0x7f29b006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.595+0000 7f29d3e00640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29b0069bb0 0x7f29b006c070 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f29c4000f70 tx=0x7f29c4009040 comp rx=0 tx=0).stop 2024-05-30T06:57:06.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.595+0000 7f29d3e00640 1 -- 172.21.15.37:0/3864608859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29d40b25b0 msgr2=0x7f29d4156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.595+0000 7f29d3e00640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29d40b25b0 0x7f29d4156090 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00c3f0 tx=0x7f29bc00c8b0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.595+0000 7f29d3e00640 1 -- 172.21.15.37:0/3864608859 shutdown_connections 2024-05-30T06:57:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.595+0000 7f29d3e00640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29d40b3b20 0x7f29d406fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.595+0000 7f29d3e00640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29d40b25b0 0x7f29d4156090 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.595+0000 7f29d3e00640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29b0069bb0 0x7f29b006c070 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.595+0000 7f29d3e00640 1 --2- 172.21.15.37:0/3864608859 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29d406b960 0x7f29d40c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.595+0000 7f29d3e00640 1 -- 172.21.15.37:0/3864608859 >> 172.21.15.37:0/3864608859 conn(0x7f29d409aa60 msgr2=0x7f29d40aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.595+0000 7f29d3e00640 1 -- 172.21.15.37:0/3864608859 shutdown_connections 2024-05-30T06:57:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.595+0000 7f29d3e00640 1 -- 172.21.15.37:0/3864608859 wait complete. 2024-05-30T06:57:06.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T06:57:06.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9693800640 1 Processor -- start 2024-05-30T06:57:06.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9693800640 1 -- start start 2024-05-30T06:57:06.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9693800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f968c155da0 0x7f968c0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9693800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f968c15f310 con 0x7f968c0cd440 2024-05-30T06:57:06.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9693800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f968c15f5f0 con 0x7f968c06f770 2024-05-30T06:57:06.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9693800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f968c15f8d0 con 0x7f968c155da0 2024-05-30T06:57:06.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f968c0cd440 0x7f968c06f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34436/0 (socket says 172.21.15.37:34436) 2024-05-30T06:57:06.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968be00640 1 -- 172.21.15.37:0/4012919453 learned_addr learned my addr 172.21.15.37:0/4012919453 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:06.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9690e00640 1 --2- 172.21.15.37:0/4012919453 >> v2:172.21.15.105:3300/0 conn(0x7f968c155da0 0x7f968c0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013765196 0 0) 0x7f968c15f310 con 0x7f968c0cd440 2024-05-30T06:57:06.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9674003530 con 0x7f968c0cd440 2024-05-30T06:57:06.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3619211953 0 0) 0x7f9674003530 con 0x7f968c0cd440 2024-05-30T06:57:06.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 >> v2:172.21.15.105:3300/0 conn(0x7f968c155da0 msgr2=0x7f968c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:06.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 --2- 172.21.15.37:0/4012919453 >> v2:172.21.15.105:3300/0 conn(0x7f968c155da0 0x7f968c0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 >> v1:172.21.15.105:6789/0 conn(0x7f968c06f770 legacy=0x7f968c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c15fbb0 con 0x7f968c0cd440 2024-05-30T06:57:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f9678001680 con 0x7f968c0cd440 2024-05-30T06:57:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 >> v1:172.21.15.37:6789/0 conn(0x7f968c0cd440 legacy=0x7f968c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 --2- 172.21.15.37:0/4012919453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96740039c0 0x7f9674003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 --2- 172.21.15.37:0/4012919453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9674004810 0x7f9674004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 --2- 172.21.15.37:0/4012919453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96740052f0 0x7f967400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f968c15f8d0 con 0x7f96740052f0 2024-05-30T06:57:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f967400c1c0 con 0x7f96740039c0 2024-05-30T06:57:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f967400c3c0 con 0x7f9674004810 2024-05-30T06:57:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9691800640 1 --2- 172.21.15.37:0/4012919453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96740052f0 0x7f967400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9690e00640 1 --2- 172.21.15.37:0/4012919453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96740039c0 0x7f9674003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f968be00640 1 --2- 172.21.15.37:0/4012919453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9674004810 0x7f9674004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9691800640 1 -- 172.21.15.37:0/4012919453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9674004810 msgr2=0x7f9674004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:06.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9691800640 1 --2- 172.21.15.37:0/4012919453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9674004810 0x7f9674004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9691800640 1 -- 172.21.15.37:0/4012919453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96740039c0 msgr2=0x7f9674003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:06.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9691800640 1 --2- 172.21.15.37:0/4012919453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96740039c0 0x7f9674003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.759+0000 7f9691800640 1 -- 172.21.15.37:0/4012919453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9674003530 con 0x7f96740052f0 2024-05-30T06:57:06.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.763+0000 7f9691800640 1 -- 172.21.15.37:0/4012919453 reap_dead start 2024-05-30T06:57:06.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.763+0000 7f9691800640 1 --2- 172.21.15.37:0/4012919453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96740052f0 0x7f967400b9d0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f968c070100 tx=0x7f968401e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ebc04b0d8c50de server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:06.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.763+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684001a90 con 0x7f96740052f0 2024-05-30T06:57:06.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.763+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9684003b80 con 0x7f96740052f0 2024-05-30T06:57:06.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.763+0000 7f968b400640 1 -- 172.21.15.37:0/4012919453 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96840050d0 con 0x7f96740052f0 2024-05-30T06:57:06.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.763+0000 7f9693800640 1 -- 172.21.15.37:0/4012919453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96740052f0 msgr2=0x7f967400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.763+0000 7f9693800640 1 --2- 172.21.15.37:0/4012919453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96740052f0 0x7f967400b9d0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f968c070100 tx=0x7f968401e910 comp rx=0 tx=0).stop 2024-05-30T06:57:06.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.763+0000 7f9693800640 1 -- 172.21.15.37:0/4012919453 shutdown_connections 2024-05-30T06:57:06.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.763+0000 7f9693800640 1 --2- 172.21.15.37:0/4012919453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96740052f0 0x7f967400b9d0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.763+0000 7f9693800640 1 -- 172.21.15.37:0/4012919453 >> 172.21.15.37:0/4012919453 conn(0x7f968c06bf60 msgr2=0x7f968c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:06.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.763+0000 7f9693800640 1 -- 172.21.15.37:0/4012919453 shutdown_connections 2024-05-30T06:57:06.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.763+0000 7f9693800640 1 -- 172.21.15.37:0/4012919453 wait complete. 2024-05-30T06:57:06.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9693800640 1 Processor -- start 2024-05-30T06:57:06.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9693800640 1 -- start start 2024-05-30T06:57:06.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9693800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96740052f0 0x7f968c14ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9693800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f968c14e8c0 0x7f968c150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9693800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f968c15d820 0x7f968c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9693800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f968c0cdce0 con 0x7f96740052f0 2024-05-30T06:57:06.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9693800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f968c0cdb60 con 0x7f968c15d820 2024-05-30T06:57:06.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9693800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f968c0b3750 con 0x7f968c14e8c0 2024-05-30T06:57:06.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9690e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96740052f0 0x7f968c14ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9690e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96740052f0 0x7f968c14ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43164/0 (socket says 172.21.15.37:43164) 2024-05-30T06:57:06.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9690e00640 1 -- 172.21.15.37:0/4112695240 learned_addr learned my addr 172.21.15.37:0/4112695240 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:06.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f968be00640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f968c14e8c0 0x7f968c150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9691800640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f968c15d820 0x7f968c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9690e00640 1 -- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f968c14e8c0 msgr2=0x7f968c150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9690e00640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f968c14e8c0 0x7f968c150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9690e00640 1 -- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f968c15d820 msgr2=0x7f968c14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9690e00640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f968c15d820 0x7f968c14fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9690e00640 1 -- 172.21.15.37:0/4112695240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968c14ed40 con 0x7f96740052f0 2024-05-30T06:57:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9690e00640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96740052f0 0x7f968c14ef60 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f9680011990 tx=0x7f9680011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:06.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9688c00640 1 -- 172.21.15.37:0/4112695240 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968000fad0 con 0x7f96740052f0 2024-05-30T06:57:06.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9688c00640 1 -- 172.21.15.37:0/4112695240 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f968000fc70 con 0x7f96740052f0 2024-05-30T06:57:06.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9693800640 1 -- 172.21.15.37:0/4112695240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968c151130 con 0x7f96740052f0 2024-05-30T06:57:06.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9688c00640 1 -- 172.21.15.37:0/4112695240 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680014440 con 0x7f96740052f0 2024-05-30T06:57:06.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.767+0000 7f9693800640 1 -- 172.21.15.37:0/4112695240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968c15e880 con 0x7f96740052f0 2024-05-30T06:57:06.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.771+0000 7f9693800640 1 -- 172.21.15.37:0/4112695240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f968c068bc0 con 0x7f96740052f0 2024-05-30T06:57:06.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.771+0000 7f9688c00640 1 -- 172.21.15.37:0/4112695240 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f9680012040 con 0x7f96740052f0 2024-05-30T06:57:06.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.771+0000 7f9688c00640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f966c069bb0 0x7f966c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:06.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.771+0000 7f9688c00640 1 -- 172.21.15.37:0/4112695240 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5793+0+0 (secure 0 0 0) 0x7f9680085db0 con 0x7f96740052f0 2024-05-30T06:57:06.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.771+0000 7f968be00640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f966c069bb0 0x7f966c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:06.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.771+0000 7f968be00640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f966c069bb0 0x7f966c06c070 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f96780010f0 tx=0x7f9678007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:06.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.775+0000 7f9688c00640 1 -- 172.21.15.37:0/4112695240 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9680019030 con 0x7f96740052f0 2024-05-30T06:57:06.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.975+0000 7f9693800640 1 -- 172.21.15.37:0/4112695240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f968c0b6790 con 0x7f96740052f0 2024-05-30T06:57:06.980 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-30T06:57:06.975+0000 7fd1bb400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T06:57:06.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.979+0000 7f9688c00640 1 -- 172.21.15.37:0/4112695240 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v66) ==== 161+0+0 (secure 0 0 0) 0x7f96800576f0 con 0x7f96740052f0 2024-05-30T06:57:06.982 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T06:57:06.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.983+0000 7f9693800640 1 -- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f966c069bb0 msgr2=0x7f966c06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.983+0000 7f9693800640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f966c069bb0 0x7f966c06c070 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f96780010f0 tx=0x7f9678007040 comp rx=0 tx=0).stop 2024-05-30T06:57:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.983+0000 7f9693800640 1 -- 172.21.15.37:0/4112695240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96740052f0 msgr2=0x7f968c14ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.983+0000 7f9693800640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96740052f0 0x7f968c14ef60 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f9680011990 tx=0x7f9680011e50 comp rx=0 tx=0).stop 2024-05-30T06:57:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.983+0000 7f9693800640 1 -- 172.21.15.37:0/4112695240 shutdown_connections 2024-05-30T06:57:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.983+0000 7f9693800640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f966c069bb0 0x7f966c06c070 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.983+0000 7f9693800640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f968c15d820 0x7f968c14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.983+0000 7f9693800640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f968c14e8c0 0x7f968c150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.983+0000 7f9693800640 1 --2- 172.21.15.37:0/4112695240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96740052f0 0x7f968c14ef60 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.983+0000 7f9693800640 1 -- 172.21.15.37:0/4112695240 >> 172.21.15.37:0/4112695240 conn(0x7f968c06bf60 msgr2=0x7f968c154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.983+0000 7f9693800640 1 -- 172.21.15.37:0/4112695240 shutdown_connections 2024-05-30T06:57:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:06.983+0000 7f9693800640 1 -- 172.21.15.37:0/4112695240 wait complete. 2024-05-30T06:57:07.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T06:57:07.051 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-30T06:57:07.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.151+0000 7f5e9e600640 1 Processor -- start 2024-05-30T06:57:07.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.151+0000 7f5e9e600640 1 -- start start 2024-05-30T06:57:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.151+0000 7f5e9e600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5e980cd440 0x7f5e9806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.151+0000 7f5e9e600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e9806f5a0 0x7f5e980b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.151+0000 7f5e9e600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e9815f310 con 0x7f5e98155da0 2024-05-30T06:57:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.151+0000 7f5e9e600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5e9815f5f0 con 0x7f5e980cd440 2024-05-30T06:57:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.151+0000 7f5e9e600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5e9815f8d0 con 0x7f5e9806f5a0 2024-05-30T06:57:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.151+0000 7f5e97400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5e98155da0 0x7f5e980cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34448/0 (socket says 172.21.15.37:34448) 2024-05-30T06:57:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.151+0000 7f5e97400640 1 -- 172.21.15.37:0/2343450853 learned_addr learned my addr 172.21.15.37:0/2343450853 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.155+0000 7f5e8ea00640 1 --2- 172.21.15.37:0/2343450853 >> v2:172.21.15.105:3300/0 conn(0x7f5e980cd440 0x7f5e9806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.155+0000 7f5e97e00640 1 --2- 172.21.15.37:0/2343450853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e9806f5a0 0x7f5e980b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.155+0000 7f5e96a00640 1 -- 172.21.15.37:0/2343450853 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 556471765 0 0) 0x7f5e9815f310 con 0x7f5e98155da0 2024-05-30T06:57:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.155+0000 7f5e96a00640 1 -- 172.21.15.37:0/2343450853 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e7c005740 con 0x7f5e98155da0 2024-05-30T06:57:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.155+0000 7f5e8ea00640 1 -- 172.21.15.37:0/2343450853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e9806f5a0 msgr2=0x7f5e980b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.155+0000 7f5e8ea00640 1 --2- 172.21.15.37:0/2343450853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e9806f5a0 0x7f5e980b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:07.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.155+0000 7f5e8ea00640 1 -- 172.21.15.37:0/2343450853 >> v1:172.21.15.37:6789/0 conn(0x7f5e98155da0 legacy=0x7f5e980cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:07.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.155+0000 7f5e8ea00640 1 -- 172.21.15.37:0/2343450853 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9815fbb0 con 0x7f5e980cd440 2024-05-30T06:57:07.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.155+0000 7f5e8ea00640 1 --2- 172.21.15.37:0/2343450853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e980cd440 0x7f5e9806f060 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009d90 tx=0x7f5e8001c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=103fa4674386cebd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e96a00640 1 -- 172.21.15.37:0/2343450853 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e800b2070 con 0x7f5e980cd440 2024-05-30T06:57:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e96a00640 1 -- 172.21.15.37:0/2343450853 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e800a5820 con 0x7f5e980cd440 2024-05-30T06:57:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e96a00640 1 -- 172.21.15.37:0/2343450853 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e800a5bd0 con 0x7f5e980cd440 2024-05-30T06:57:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 -- 172.21.15.37:0/2343450853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e980cd440 msgr2=0x7f5e9806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 --2- 172.21.15.37:0/2343450853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e980cd440 0x7f5e9806f060 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009d90 tx=0x7f5e8001c850 comp rx=0 tx=0).stop 2024-05-30T06:57:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 -- 172.21.15.37:0/2343450853 shutdown_connections 2024-05-30T06:57:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 --2- 172.21.15.37:0/2343450853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e9806f5a0 0x7f5e980b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 --2- 172.21.15.37:0/2343450853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e980cd440 0x7f5e9806f060 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 -- 172.21.15.37:0/2343450853 >> 172.21.15.37:0/2343450853 conn(0x7f5e9806bf60 msgr2=0x7f5e980b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 -- 172.21.15.37:0/2343450853 shutdown_connections 2024-05-30T06:57:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 -- 172.21.15.37:0/2343450853 wait complete. 2024-05-30T06:57:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 Processor -- start 2024-05-30T06:57:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 -- start start 2024-05-30T06:57:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e9806f5a0 0x7f5e981fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e98155da0 0x7f5e981faa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e98158010 0x7f5e98158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9806f9b0 con 0x7f5e98155da0 2024-05-30T06:57:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5e980b46f0 con 0x7f5e98158010 2024-05-30T06:57:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e9e600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5e9806df50 con 0x7f5e9806f5a0 2024-05-30T06:57:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e8ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e98155da0 0x7f5e981faa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e8ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e98155da0 0x7f5e981faa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43174/0 (socket says 172.21.15.37:43174) 2024-05-30T06:57:07.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e8ea00640 1 -- 172.21.15.37:0/3307239055 learned_addr learned my addr 172.21.15.37:0/3307239055 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:07.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e97400640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e9806f5a0 0x7f5e981fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:07.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e97e00640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e98158010 0x7f5e98158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:07.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e8ea00640 1 -- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e9806f5a0 msgr2=0x7f5e981fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:07.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e8ea00640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e9806f5a0 0x7f5e981fa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:07.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e8ea00640 1 -- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e98158010 msgr2=0x7f5e98158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:07.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e8ea00640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e98158010 0x7f5e98158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:07.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.159+0000 7f5e8ea00640 1 -- 172.21.15.37:0/3307239055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e981f8130 con 0x7f5e98155da0 2024-05-30T06:57:07.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.163+0000 7f5e8ea00640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e98155da0 0x7f5e981faa00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f5e800b0040 tx=0x7f5e800195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:07.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.163+0000 7f5e8fe00640 1 -- 172.21.15.37:0/3307239055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e800b2050 con 0x7f5e98155da0 2024-05-30T06:57:07.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.163+0000 7f5e8fe00640 1 -- 172.21.15.37:0/3307239055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e800be070 con 0x7f5e98155da0 2024-05-30T06:57:07.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.163+0000 7f5e9e600640 1 -- 172.21.15.37:0/3307239055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e981f8410 con 0x7f5e98155da0 2024-05-30T06:57:07.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.163+0000 7f5e8fe00640 1 -- 172.21.15.37:0/3307239055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80009450 con 0x7f5e98155da0 2024-05-30T06:57:07.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.163+0000 7f5e9e600640 1 -- 172.21.15.37:0/3307239055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e981f89d0 con 0x7f5e98155da0 2024-05-30T06:57:07.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.163+0000 7f5e9e600640 1 -- 172.21.15.37:0/3307239055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e98068bc0 con 0x7f5e98155da0 2024-05-30T06:57:07.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.163+0000 7f5e8fe00640 1 -- 172.21.15.37:0/3307239055 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f5e800adc80 con 0x7f5e98155da0 2024-05-30T06:57:07.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.167+0000 7f5e8fe00640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e74069bb0 0x7f5e7406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:07.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.167+0000 7f5e8fe00640 1 -- 172.21.15.37:0/3307239055 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5851+0+0 (secure 0 0 0) 0x7f5e80120740 con 0x7f5e98155da0 2024-05-30T06:57:07.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.167+0000 7f5e97400640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e74069bb0 0x7f5e7406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:07.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.167+0000 7f5e97400640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e74069bb0 0x7f5e7406c070 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f5e88007fd0 tx=0x7f5e88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:07.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.171+0000 7f5e8fe00640 1 -- 172.21.15.37:0/3307239055 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5e80016560 con 0x7f5e98155da0 2024-05-30T06:57:07.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.371+0000 7f5e9e600640 1 -- 172.21.15.37:0/3307239055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5e9815aff0 con 0x7f5e98155da0 2024-05-30T06:57:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.979+0000 7f5e8fe00640 1 -- 172.21.15.37:0/3307239055 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v67) ==== 104+0+0 (secure 0 0 0) 0x7f5e800f21b0 con 0x7f5e98155da0 2024-05-30T06:57:07.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.983+0000 7f5e9e600640 1 -- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e74069bb0 msgr2=0x7f5e7406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:07.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.983+0000 7f5e9e600640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e74069bb0 0x7f5e7406c070 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f5e88007fd0 tx=0x7f5e88009040 comp rx=0 tx=0).stop 2024-05-30T06:57:07.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.983+0000 7f5e9e600640 1 -- 172.21.15.37:0/3307239055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e98155da0 msgr2=0x7f5e981faa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:07.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.983+0000 7f5e9e600640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e98155da0 0x7f5e981faa00 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f5e800b0040 tx=0x7f5e800195f0 comp rx=0 tx=0).stop 2024-05-30T06:57:07.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.983+0000 7f5e9e600640 1 -- 172.21.15.37:0/3307239055 shutdown_connections 2024-05-30T06:57:07.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.983+0000 7f5e9e600640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5e74069bb0 0x7f5e7406c070 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.983+0000 7f5e9e600640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e98158010 0x7f5e98158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.983+0000 7f5e9e600640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e98155da0 0x7f5e981faa00 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.983+0000 7f5e9e600640 1 --2- 172.21.15.37:0/3307239055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e9806f5a0 0x7f5e981fa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.983+0000 7f5e9e600640 1 -- 172.21.15.37:0/3307239055 >> 172.21.15.37:0/3307239055 conn(0x7f5e9806bf60 msgr2=0x7f5e9815a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.983+0000 7f5e9e600640 1 -- 172.21.15.37:0/3307239055 shutdown_connections 2024-05-30T06:57:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:07.983+0000 7f5e9e600640 1 -- 172.21.15.37:0/3307239055 wait complete. 2024-05-30T06:57:08.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T06:57:08.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.199+0000 7fa211a00640 1 Processor -- start 2024-05-30T06:57:08.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.199+0000 7fa211a00640 1 -- start start 2024-05-30T06:57:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.199+0000 7fa211a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa20c159490 0x7fa20c072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.199+0000 7fa211a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20c0702d0 0x7fa20c072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.199+0000 7fa211a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20c0d06e0 con 0x7fa20c15f190 2024-05-30T06:57:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.199+0000 7fa211a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa20c162800 con 0x7fa20c159490 2024-05-30T06:57:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.199+0000 7fa211a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa20c162a50 con 0x7fa20c0702d0 2024-05-30T06:57:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.199+0000 7fa20aa00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa20c159490 0x7fa20c072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.203+0000 7fa202000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20c0702d0 0x7fa20c072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.203+0000 7fa20b400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa20c15f190 0x7fa20c15f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:44242/0 (socket says 172.21.15.37:44242) 2024-05-30T06:57:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.203+0000 7fa20aa00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa20c159490 0x7fa20c072750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:52096/0 (socket says 172.21.15.37:52096) 2024-05-30T06:57:08.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.203+0000 7fa20b400640 1 -- 172.21.15.37:0/1423552595 learned_addr learned my addr 172.21.15.37:0/1423552595 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:08.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.203+0000 7fa20aa00640 1 -- 172.21.15.37:0/1423552595 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20c0702d0 msgr2=0x7fa20c072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:08.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.203+0000 7fa20aa00640 1 --2- 172.21.15.37:0/1423552595 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20c0702d0 0x7fa20c072c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:08.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.203+0000 7fa20aa00640 1 -- 172.21.15.37:0/1423552595 >> v1:172.21.15.105:6789/0 conn(0x7fa20c15f190 legacy=0x7fa20c15f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:08.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.203+0000 7fa20aa00640 1 -- 172.21.15.37:0/1423552595 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20c162d30 con 0x7fa20c159490 2024-05-30T06:57:08.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.203+0000 7fa202000640 1 --2- 172.21.15.37:0/1423552595 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20c0702d0 0x7fa20c072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:57:08.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.203+0000 7fa20aa00640 1 --2- 172.21.15.37:0/1423552595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20c159490 0x7fa20c072750 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0097c0 tx=0x7fa1fc01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=697a14bff5e9f3f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:08.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.203+0000 7fa20a000640 1 -- 172.21.15.37:0/1423552595 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0b0070 con 0x7fa20c159490 2024-05-30T06:57:08.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.203+0000 7fa20a000640 1 -- 172.21.15.37:0/1423552595 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc0ab600 con 0x7fa20c159490 2024-05-30T06:57:08.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.203+0000 7fa20a000640 1 -- 172.21.15.37:0/1423552595 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0ab9d0 con 0x7fa20c159490 2024-05-30T06:57:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 -- 172.21.15.37:0/1423552595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20c159490 msgr2=0x7fa20c072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 --2- 172.21.15.37:0/1423552595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20c159490 0x7fa20c072750 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0097c0 tx=0x7fa1fc01c380 comp rx=0 tx=0).stop 2024-05-30T06:57:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 -- 172.21.15.37:0/1423552595 shutdown_connections 2024-05-30T06:57:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 --2- 172.21.15.37:0/1423552595 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20c0702d0 0x7fa20c072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 --2- 172.21.15.37:0/1423552595 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20c159490 0x7fa20c072750 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 -- 172.21.15.37:0/1423552595 >> 172.21.15.37:0/1423552595 conn(0x7fa20c0d0d50 msgr2=0x7fa20c0d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 -- 172.21.15.37:0/1423552595 shutdown_connections 2024-05-30T06:57:08.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 -- 172.21.15.37:0/1423552595 wait complete. 2024-05-30T06:57:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 Processor -- start 2024-05-30T06:57:08.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 -- start start 2024-05-30T06:57:08.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20c0702d0 0x7fa20c13c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:08.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20c159490 0x7fa20c153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:08.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20c15f190 0x7fa20c156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:08.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c16bf30 con 0x7fa20c15f190 2024-05-30T06:57:08.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c16bdb0 con 0x7fa20c159490 2024-05-30T06:57:08.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa211a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa20c16c0b0 con 0x7fa20c0702d0 2024-05-30T06:57:08.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa20b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20c15f190 0x7fa20c156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:08.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa20b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20c15f190 0x7fa20c156970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46254/0 (socket says 172.21.15.37:46254) 2024-05-30T06:57:08.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa202000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20c159490 0x7fa20c153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:08.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa20aa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20c0702d0 0x7fa20c13c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:08.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa20b400640 1 -- 172.21.15.37:0/4059459759 learned_addr learned my addr 172.21.15.37:0/4059459759 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:08.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa20b400640 1 -- 172.21.15.37:0/4059459759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20c0702d0 msgr2=0x7fa20c13c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:08.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa20b400640 1 --2- 172.21.15.37:0/4059459759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20c0702d0 0x7fa20c13c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:08.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa20b400640 1 -- 172.21.15.37:0/4059459759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20c159490 msgr2=0x7fa20c153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:08.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa20b400640 1 --2- 172.21.15.37:0/4059459759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20c159490 0x7fa20c153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:08.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.207+0000 7fa20b400640 1 -- 172.21.15.37:0/4059459759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20c1571c0 con 0x7fa20c15f190 2024-05-30T06:57:08.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.211+0000 7fa20b400640 1 --2- 172.21.15.37:0/4059459759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20c15f190 0x7fa20c156970 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa20400ca80 tx=0x7fa20400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:08.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.211+0000 7fa203400640 1 -- 172.21.15.37:0/4059459759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204017070 con 0x7fa20c15f190 2024-05-30T06:57:08.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.211+0000 7fa203400640 1 -- 172.21.15.37:0/4059459759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa20400abd0 con 0x7fa20c15f190 2024-05-30T06:57:08.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.211+0000 7fa203400640 1 -- 172.21.15.37:0/4059459759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204012400 con 0x7fa20c15f190 2024-05-30T06:57:08.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.211+0000 7fa211a00640 1 -- 172.21.15.37:0/4059459759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20c1574a0 con 0x7fa20c15f190 2024-05-30T06:57:08.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.211+0000 7fa211a00640 1 -- 172.21.15.37:0/4059459759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa20c157a60 con 0x7fa20c15f190 2024-05-30T06:57:08.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.211+0000 7fa211a00640 1 -- 172.21.15.37:0/4059459759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa20c068d40 con 0x7fa20c15f190 2024-05-30T06:57:08.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.211+0000 7fa203400640 1 -- 172.21.15.37:0/4059459759 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fa20401a070 con 0x7fa20c15f190 2024-05-30T06:57:08.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.211+0000 7fa203400640 1 --2- 172.21.15.37:0/4059459759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1e8069bb0 0x7fa1e806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:08.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.211+0000 7fa203400640 1 -- 172.21.15.37:0/4059459759 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5851+0+0 (secure 0 0 0) 0x7fa2040853e0 con 0x7fa20c15f190 2024-05-30T06:57:08.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.211+0000 7fa20aa00640 1 --2- 172.21.15.37:0/4059459759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1e8069bb0 0x7fa1e806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:08.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.215+0000 7fa20aa00640 1 --2- 172.21.15.37:0/4059459759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1e8069bb0 0x7fa1e806c070 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0ad000 tx=0x7fa1fc0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:08.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.215+0000 7fa203400640 1 -- 172.21.15.37:0/4059459759 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa204056db0 con 0x7fa20c15f190 2024-05-30T06:57:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.383+0000 7fa211a00640 1 -- 172.21.15.37:0/4059459759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa20c067d20 con 0x7fa20c15f190 2024-05-30T06:57:08.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.983+0000 7fa203400640 1 -- 172.21.15.37:0/4059459759 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) ==== 181+0+0 (secure 0 0 0) 0x7fa20405b0b0 con 0x7fa20c15f190 2024-05-30T06:57:08.987 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-30T06:57:08.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.987+0000 7fa211a00640 1 -- 172.21.15.37:0/4059459759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1e8069bb0 msgr2=0x7fa1e806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:08.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.987+0000 7fa211a00640 1 --2- 172.21.15.37:0/4059459759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1e8069bb0 0x7fa1e806c070 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0ad000 tx=0x7fa1fc0a6000 comp rx=0 tx=0).stop 2024-05-30T06:57:08.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.987+0000 7fa211a00640 1 -- 172.21.15.37:0/4059459759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20c15f190 msgr2=0x7fa20c156970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:08.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.987+0000 7fa211a00640 1 --2- 172.21.15.37:0/4059459759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20c15f190 0x7fa20c156970 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa20400ca80 tx=0x7fa20400cf40 comp rx=0 tx=0).stop 2024-05-30T06:57:08.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.987+0000 7fa211a00640 1 -- 172.21.15.37:0/4059459759 shutdown_connections 2024-05-30T06:57:08.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.987+0000 7fa211a00640 1 --2- 172.21.15.37:0/4059459759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa20c15f190 0x7fa20c156970 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:08.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.987+0000 7fa211a00640 1 --2- 172.21.15.37:0/4059459759 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1e8069bb0 0x7fa1e806c070 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:08.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.987+0000 7fa211a00640 1 --2- 172.21.15.37:0/4059459759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa20c159490 0x7fa20c153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:08.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.987+0000 7fa211a00640 1 --2- 172.21.15.37:0/4059459759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa20c0702d0 0x7fa20c13c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:08.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.987+0000 7fa211a00640 1 -- 172.21.15.37:0/4059459759 >> 172.21.15.37:0/4059459759 conn(0x7fa20c0d0d50 msgr2=0x7fa20c0cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:08.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.987+0000 7fa211a00640 1 -- 172.21.15.37:0/4059459759 shutdown_connections 2024-05-30T06:57:08.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:08.987+0000 7fa211a00640 1 -- 172.21.15.37:0/4059459759 wait complete. 2024-05-30T06:57:09.014 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T06:57:09.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff543a00640 1 Processor -- start 2024-05-30T06:57:09.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff543a00640 1 -- start start 2024-05-30T06:57:09.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff543a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff53c159490 0x7ff53c072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:09.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff543a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff53c0702d0 0x7ff53c072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:09.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff543a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff53c0d06e0 con 0x7ff53c15f190 2024-05-30T06:57:09.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff543a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff53c162800 con 0x7ff53c159490 2024-05-30T06:57:09.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff543a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff53c162a50 con 0x7ff53c0702d0 2024-05-30T06:57:09.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff541a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff53c15f190 0x7ff53c15f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48876/0 (socket says 172.21.15.37:48876) 2024-05-30T06:57:09.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff541a00640 1 -- 172.21.15.37:0/738612590 learned_addr learned my addr 172.21.15.37:0/738612590 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:09.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53be00640 1 --2- 172.21.15.37:0/738612590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff53c0702d0 0x7ff53c072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:09.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff541000640 1 --2- 172.21.15.37:0/738612590 >> v2:172.21.15.105:3300/0 conn(0x7ff53c159490 0x7ff53c072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:09.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 457146790 0 0) 0x7ff53c0d06e0 con 0x7ff53c15f190 2024-05-30T06:57:09.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff524003530 con 0x7ff53c15f190 2024-05-30T06:57:09.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3602627023 0 0) 0x7ff524003530 con 0x7ff53c15f190 2024-05-30T06:57:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff53c0702d0 msgr2=0x7ff53c072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 --2- 172.21.15.37:0/738612590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff53c0702d0 0x7ff53c072c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 >> v2:172.21.15.105:3300/0 conn(0x7ff53c159490 msgr2=0x7ff53c072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 --2- 172.21.15.37:0/738612590 >> v2:172.21.15.105:3300/0 conn(0x7ff53c159490 0x7ff53c072750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53c162d30 con 0x7ff53c15f190 2024-05-30T06:57:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7ff534001a00 con 0x7ff53c15f190 2024-05-30T06:57:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 >> v1:172.21.15.37:6789/0 conn(0x7ff53c15f190 legacy=0x7ff53c15f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 --2- 172.21.15.37:0/738612590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff53c0702d0 0x7ff5240039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 --2- 172.21.15.37:0/738612590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff524003f40 0x7ff524004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 --2- 172.21.15.37:0/738612590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff524004d50 0x7ff5240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c162800 con 0x7ff524004d50 2024-05-30T06:57:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c162a50 con 0x7ff524003f40 2024-05-30T06:57:09.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.159+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff52400bab0 con 0x7ff53c0702d0 2024-05-30T06:57:09.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.163+0000 7ff541a00640 1 --2- 172.21.15.37:0/738612590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff524004d50 0x7ff5240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:09.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.163+0000 7ff541000640 1 --2- 172.21.15.37:0/738612590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff53c0702d0 0x7ff5240039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:09.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.163+0000 7ff53be00640 1 --2- 172.21.15.37:0/738612590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff524003f40 0x7ff524004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:09.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.163+0000 7ff541a00640 1 -- 172.21.15.37:0/738612590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff53c0702d0 msgr2=0x7ff5240039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:09.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.163+0000 7ff541a00640 1 --2- 172.21.15.37:0/738612590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff53c0702d0 0x7ff5240039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:09.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.163+0000 7ff541a00640 1 -- 172.21.15.37:0/738612590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff524003f40 msgr2=0x7ff524004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:09.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.163+0000 7ff541a00640 1 --2- 172.21.15.37:0/738612590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff524003f40 0x7ff524004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:09.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.163+0000 7ff541a00640 1 -- 172.21.15.37:0/738612590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff524003530 con 0x7ff524004d50 2024-05-30T06:57:09.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.163+0000 7ff541a00640 1 --2- 172.21.15.37:0/738612590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff524004d50 0x7ff5240051d0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7ff53400a8a0 tx=0x7ff53401d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b755180b8c37b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:09.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.163+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53400a4c0 con 0x7ff524004d50 2024-05-30T06:57:09.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.163+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5340ad650 con 0x7ff524004d50 2024-05-30T06:57:09.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.163+0000 7ff53b400640 1 -- 172.21.15.37:0/738612590 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5340ada80 con 0x7ff524004d50 2024-05-30T06:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 -- 172.21.15.37:0/738612590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff524004d50 msgr2=0x7ff5240051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 --2- 172.21.15.37:0/738612590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff524004d50 0x7ff5240051d0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7ff53400a8a0 tx=0x7ff53401d3c0 comp rx=0 tx=0).stop 2024-05-30T06:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff541a00640 1 -- 172.21.15.37:0/738612590 reap_dead start 2024-05-30T06:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 -- 172.21.15.37:0/738612590 shutdown_connections 2024-05-30T06:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 -- 172.21.15.37:0/738612590 >> 172.21.15.37:0/738612590 conn(0x7ff53c0d0d50 msgr2=0x7ff53c0d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 -- 172.21.15.37:0/738612590 shutdown_connections 2024-05-30T06:57:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 -- 172.21.15.37:0/738612590 wait complete. 2024-05-30T06:57:09.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 Processor -- start 2024-05-30T06:57:09.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 -- start start 2024-05-30T06:57:09.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff524004d50 0x7ff53c152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:09.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff53c144c70 0x7ff53c157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:09.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff53c153930 0x7ff53c15de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:09.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c0d0470 con 0x7ff524004d50 2024-05-30T06:57:09.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c163740 con 0x7ff53c153930 2024-05-30T06:57:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff543a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff53c0730a0 con 0x7ff53c144c70 2024-05-30T06:57:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff541000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff524004d50 0x7ff53c152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff541000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff524004d50 0x7ff53c152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46264/0 (socket says 172.21.15.37:46264) 2024-05-30T06:57:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff541000640 1 -- 172.21.15.37:0/1096561082 learned_addr learned my addr 172.21.15.37:0/1096561082 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff53be00640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff53c144c70 0x7ff53c157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff541a00640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff53c153930 0x7ff53c15de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff541000640 1 -- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff53c144c70 msgr2=0x7ff53c157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff541000640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff53c144c70 0x7ff53c157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff541000640 1 -- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff53c153930 msgr2=0x7ff53c15de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff541000640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff53c153930 0x7ff53c15de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff541000640 1 -- 172.21.15.37:0/1096561082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53c073990 con 0x7ff524004d50 2024-05-30T06:57:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.167+0000 7ff541a00640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff53c153930 0x7ff53c15de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.171+0000 7ff541000640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff524004d50 0x7ff53c152140 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7ff530011980 tx=0x7ff530011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.171+0000 7ff538c00640 1 -- 172.21.15.37:0/1096561082 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53000f9d0 con 0x7ff524004d50 2024-05-30T06:57:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.171+0000 7ff538c00640 1 -- 172.21.15.37:0/1096561082 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53000fb70 con 0x7ff524004d50 2024-05-30T06:57:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.171+0000 7ff543a00640 1 -- 172.21.15.37:0/1096561082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53c152890 con 0x7ff524004d50 2024-05-30T06:57:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.171+0000 7ff538c00640 1 -- 172.21.15.37:0/1096561082 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530014440 con 0x7ff524004d50 2024-05-30T06:57:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.171+0000 7ff543a00640 1 -- 172.21.15.37:0/1096561082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff53c152e50 con 0x7ff524004d50 2024-05-30T06:57:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.171+0000 7ff543a00640 1 -- 172.21.15.37:0/1096561082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff53c153570 con 0x7ff524004d50 2024-05-30T06:57:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.171+0000 7ff538c00640 1 -- 172.21.15.37:0/1096561082 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7ff530012040 con 0x7ff524004d50 2024-05-30T06:57:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.171+0000 7ff538c00640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff51c069be0 0x7ff51c06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.171+0000 7ff538c00640 1 -- 172.21.15.37:0/1096561082 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5413+0+0 (secure 0 0 0) 0x7ff530085cd0 con 0x7ff524004d50 2024-05-30T06:57:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.171+0000 7ff53be00640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff51c069be0 0x7ff51c06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:09.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.175+0000 7ff53be00640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff51c069be0 0x7ff51c06c0a0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff53c15cd40 tx=0x7ff528009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:09.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.175+0000 7ff538c00640 1 -- 172.21.15.37:0/1096561082 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff530019030 con 0x7ff524004d50 2024-05-30T06:57:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.339+0000 7ff543a00640 1 -- 172.21.15.37:0/1096561082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff53c068d40 con 0x7ff524004d50 2024-05-30T06:57:10.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.995+0000 7ff538c00640 1 -- 172.21.15.37:0/1096561082 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) ==== 169+0+0 (secure 0 0 0) 0x7ff530057cf0 con 0x7ff524004d50 2024-05-30T06:57:10.001 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-30T06:57:10.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.999+0000 7ff543a00640 1 -- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff51c069be0 msgr2=0x7ff51c06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:10.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.999+0000 7ff543a00640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff51c069be0 0x7ff51c06c0a0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff53c15cd40 tx=0x7ff528009190 comp rx=0 tx=0).stop 2024-05-30T06:57:10.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.999+0000 7ff543a00640 1 -- 172.21.15.37:0/1096561082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff524004d50 msgr2=0x7ff53c152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:10.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:09.999+0000 7ff543a00640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff524004d50 0x7ff53c152140 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7ff530011980 tx=0x7ff530011d80 comp rx=0 tx=0).stop 2024-05-30T06:57:10.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.003+0000 7ff543a00640 1 -- 172.21.15.37:0/1096561082 shutdown_connections 2024-05-30T06:57:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.003+0000 7ff543a00640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff51c069be0 0x7ff51c06c0a0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.003+0000 7ff543a00640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff53c153930 0x7ff53c15de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.003+0000 7ff543a00640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff53c144c70 0x7ff53c157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.003+0000 7ff543a00640 1 --2- 172.21.15.37:0/1096561082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff524004d50 0x7ff53c152140 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.003+0000 7ff543a00640 1 -- 172.21.15.37:0/1096561082 >> 172.21.15.37:0/1096561082 conn(0x7ff53c0d0d50 msgr2=0x7ff53c154d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.003+0000 7ff543a00640 1 -- 172.21.15.37:0/1096561082 shutdown_connections 2024-05-30T06:57:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.003+0000 7ff543a00640 1 -- 172.21.15.37:0/1096561082 wait complete. 2024-05-30T06:57:10.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T06:57:10.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.183+0000 7fc524000640 1 Processor -- start 2024-05-30T06:57:10.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.183+0000 7fc524000640 1 -- start start 2024-05-30T06:57:10.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc524000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc51c155da0 0x7fc51c0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:10.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc524000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc51c0cd440 0x7fc51c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:10.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc524000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c06f5a0 0x7fc51c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:10.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc524000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc51c15f310 con 0x7fc51c155da0 2024-05-30T06:57:10.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc524000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc51c15f5f0 con 0x7fc51c0cd440 2024-05-30T06:57:10.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc524000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc51c15f8d0 con 0x7fc51c06f5a0 2024-05-30T06:57:10.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc521600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc51c155da0 0x7fc51c0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:10.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc521600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc51c155da0 0x7fc51c0cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46280/0 (socket says 172.21.15.37:46280) 2024-05-30T06:57:10.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc521600640 1 -- 172.21.15.37:0/1594284136 learned_addr learned my addr 172.21.15.37:0/1594284136 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:10.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc520c00640 1 --2- 172.21.15.37:0/1594284136 >> v2:172.21.15.105:3300/0 conn(0x7fc51c0cd440 0x7fc51c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:10.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc522000640 1 --2- 172.21.15.37:0/1594284136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c06f5a0 0x7fc51c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:10.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc521600640 1 -- 172.21.15.37:0/1594284136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c06f5a0 msgr2=0x7fc51c0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:10.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc521600640 1 --2- 172.21.15.37:0/1594284136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c06f5a0 0x7fc51c0cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc521600640 1 -- 172.21.15.37:0/1594284136 >> v2:172.21.15.105:3300/0 conn(0x7fc51c0cd440 msgr2=0x7fc51c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:10.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc521600640 1 --2- 172.21.15.37:0/1594284136 >> v2:172.21.15.105:3300/0 conn(0x7fc51c0cd440 0x7fc51c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.187+0000 7fc521600640 1 -- 172.21.15.37:0/1594284136 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51c15fbb0 con 0x7fc51c155da0 2024-05-30T06:57:10.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc521600640 1 --2- 172.21.15.37:0/1594284136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c155da0 0x7fc51c0cd950 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0b2f00 tx=0x7fc51001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10822f8b642fe4b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:10.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc51be00640 1 -- 172.21.15.37:0/1594284136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5100b0070 con 0x7fc51c155da0 2024-05-30T06:57:10.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc51be00640 1 -- 172.21.15.37:0/1594284136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5100a4e50 con 0x7fc51c155da0 2024-05-30T06:57:10.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc51be00640 1 -- 172.21.15.37:0/1594284136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5100ab820 con 0x7fc51c155da0 2024-05-30T06:57:10.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc524000640 1 -- 172.21.15.37:0/1594284136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c155da0 msgr2=0x7fc51c0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:10.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc524000640 1 --2- 172.21.15.37:0/1594284136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c155da0 0x7fc51c0cd950 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0b2f00 tx=0x7fc51001c400 comp rx=0 tx=0).stop 2024-05-30T06:57:10.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc524000640 1 -- 172.21.15.37:0/1594284136 shutdown_connections 2024-05-30T06:57:10.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc524000640 1 --2- 172.21.15.37:0/1594284136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c06f5a0 0x7fc51c0cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc524000640 1 --2- 172.21.15.37:0/1594284136 >> v2:172.21.15.105:3300/0 conn(0x7fc51c0cd440 0x7fc51c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc524000640 1 --2- 172.21.15.37:0/1594284136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c155da0 0x7fc51c0cd950 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc524000640 1 -- 172.21.15.37:0/1594284136 >> 172.21.15.37:0/1594284136 conn(0x7fc51c06bf60 msgr2=0x7fc51c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:10.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc524000640 1 -- 172.21.15.37:0/1594284136 shutdown_connections 2024-05-30T06:57:10.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc524000640 1 -- 172.21.15.37:0/1594284136 wait complete. 2024-05-30T06:57:10.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc524000640 1 Processor -- start 2024-05-30T06:57:10.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.191+0000 7fc524000640 1 -- start start 2024-05-30T06:57:10.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc524000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c06f5a0 0x7fc51c165da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:10.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc524000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c155da0 0x7fc51c14fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:10.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc524000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51c13ba50 0x7fc51c157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:10.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc524000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c06e2e0 con 0x7fc51c06f5a0 2024-05-30T06:57:10.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc524000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c06e160 con 0x7fc51c13ba50 2024-05-30T06:57:10.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc524000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc51c06e460 con 0x7fc51c155da0 2024-05-30T06:57:10.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc521600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c06f5a0 0x7fc51c165da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:10.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc521600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c06f5a0 0x7fc51c165da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46294/0 (socket says 172.21.15.37:46294) 2024-05-30T06:57:10.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc521600640 1 -- 172.21.15.37:0/3118709492 learned_addr learned my addr 172.21.15.37:0/3118709492 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc522000640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51c13ba50 0x7fc51c157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc520c00640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c155da0 0x7fc51c14fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc521600640 1 -- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c155da0 msgr2=0x7fc51c14fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc521600640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c155da0 0x7fc51c14fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc521600640 1 -- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51c13ba50 msgr2=0x7fc51c157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc521600640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51c13ba50 0x7fc51c157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc521600640 1 -- 172.21.15.37:0/3118709492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51c13c550 con 0x7fc51c06f5a0 2024-05-30T06:57:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc520c00640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c155da0 0x7fc51c14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc522000640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51c13ba50 0x7fc51c157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc521600640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c06f5a0 0x7fc51c165da0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fc5100ae040 tx=0x7fc51001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc519600640 1 -- 172.21.15.37:0/3118709492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5100ba020 con 0x7fc51c06f5a0 2024-05-30T06:57:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc519600640 1 -- 172.21.15.37:0/3118709492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5100b6420 con 0x7fc51c06f5a0 2024-05-30T06:57:10.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc519600640 1 -- 172.21.15.37:0/3118709492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5100b0040 con 0x7fc51c06f5a0 2024-05-30T06:57:10.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc524000640 1 -- 172.21.15.37:0/3118709492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc51c13c830 con 0x7fc51c06f5a0 2024-05-30T06:57:10.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc524000640 1 -- 172.21.15.37:0/3118709492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc51c13cdf0 con 0x7fc51c06f5a0 2024-05-30T06:57:10.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.195+0000 7fc524000640 1 -- 172.21.15.37:0/3118709492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc51c068bc0 con 0x7fc51c06f5a0 2024-05-30T06:57:10.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.199+0000 7fc519600640 1 -- 172.21.15.37:0/3118709492 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fc5100bd020 con 0x7fc51c06f5a0 2024-05-30T06:57:10.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.199+0000 7fc519600640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc4fc069bb0 0x7fc4fc06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:10.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.199+0000 7fc519600640 1 -- 172.21.15.37:0/3118709492 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4999+0+0 (secure 0 0 0) 0x7fc51011f8c0 con 0x7fc51c06f5a0 2024-05-30T06:57:10.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.199+0000 7fc520c00640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc4fc069bb0 0x7fc4fc06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:10.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.199+0000 7fc520c00640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc4fc069bb0 0x7fc4fc06c070 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc51c15ef00 tx=0x7fc508008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:10.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.203+0000 7fc519600640 1 -- 172.21.15.37:0/3118709492 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc5100c4030 con 0x7fc51c06f5a0 2024-05-30T06:57:10.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.367+0000 7fc524000640 1 -- 172.21.15.37:0/3118709492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc51c0b6790 con 0x7fc51c06f5a0 2024-05-30T06:57:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.371+0000 7fc519600640 1 -- 172.21.15.37:0/3118709492 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7fc510016110 con 0x7fc51c06f5a0 2024-05-30T06:57:10.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.375+0000 7fc524000640 1 -- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc4fc069bb0 msgr2=0x7fc4fc06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:10.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.375+0000 7fc524000640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc4fc069bb0 0x7fc4fc06c070 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc51c15ef00 tx=0x7fc508008040 comp rx=0 tx=0).stop 2024-05-30T06:57:10.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.375+0000 7fc524000640 1 -- 172.21.15.37:0/3118709492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c06f5a0 msgr2=0x7fc51c165da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:10.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.375+0000 7fc524000640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c06f5a0 0x7fc51c165da0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fc5100ae040 tx=0x7fc51001ac40 comp rx=0 tx=0).stop 2024-05-30T06:57:10.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.375+0000 7fc524000640 1 -- 172.21.15.37:0/3118709492 shutdown_connections 2024-05-30T06:57:10.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.375+0000 7fc524000640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc4fc069bb0 0x7fc4fc06c070 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.375+0000 7fc524000640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51c13ba50 0x7fc51c157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.375+0000 7fc524000640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c155da0 0x7fc51c14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.375+0000 7fc524000640 1 --2- 172.21.15.37:0/3118709492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc51c06f5a0 0x7fc51c165da0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.375+0000 7fc524000640 1 -- 172.21.15.37:0/3118709492 >> 172.21.15.37:0/3118709492 conn(0x7fc51c06bf60 msgr2=0x7fc51c06e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:10.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.375+0000 7fc524000640 1 -- 172.21.15.37:0/3118709492 shutdown_connections 2024-05-30T06:57:10.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.375+0000 7fc524000640 1 -- 172.21.15.37:0/3118709492 wait complete. 2024-05-30T06:57:10.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_1_clone_is_cancelled' 2024-05-30T06:57:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.543+0000 7f3991400640 1 Processor -- start 2024-05-30T06:57:10.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.543+0000 7f3991400640 1 -- start start 2024-05-30T06:57:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.543+0000 7f3991400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c0ce8d0 0x7f398c0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.543+0000 7f3991400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c0cd120 con 0x7f398c06e000 2024-05-30T06:57:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.543+0000 7f3991400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c0cd400 con 0x7f398c15cd80 2024-05-30T06:57:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.543+0000 7f3991400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f398c0a9530 con 0x7f398c0ce8d0 2024-05-30T06:57:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.543+0000 7f398a800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f398c06e000 0x7f398c0ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48880/0 (socket says 172.21.15.37:48880) 2024-05-30T06:57:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.543+0000 7f398a800640 1 -- 172.21.15.37:0/632308755 learned_addr learned my addr 172.21.15.37:0/632308755 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.543+0000 7f398b200640 1 --2- 172.21.15.37:0/632308755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c0ce8d0 0x7f398c0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.547+0000 7f3989400640 1 -- 172.21.15.37:0/632308755 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4040167081 0 0) 0x7f398c0cd120 con 0x7f398c06e000 2024-05-30T06:57:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.547+0000 7f3989400640 1 -- 172.21.15.37:0/632308755 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3970003530 con 0x7f398c06e000 2024-05-30T06:57:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.547+0000 7f3989400640 1 -- 172.21.15.37:0/632308755 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 66953481 0 0) 0x7f398c0cd400 con 0x7f398c15cd80 2024-05-30T06:57:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.547+0000 7f3989400640 1 -- 172.21.15.37:0/632308755 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f398c0cd120 con 0x7f398c15cd80 2024-05-30T06:57:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.547+0000 7f398b200640 1 -- 172.21.15.37:0/632308755 >> v1:172.21.15.105:6789/0 conn(0x7f398c15cd80 legacy=0x7f398c06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.547+0000 7f398b200640 1 -- 172.21.15.37:0/632308755 >> v1:172.21.15.37:6789/0 conn(0x7f398c06e000 legacy=0x7f398c0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.547+0000 7f3989400640 1 -- 172.21.15.37:0/632308755 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3062148938 0 0) 0x7f3970003530 con 0x7f398c06e000 2024-05-30T06:57:10.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.547+0000 7f398b200640 1 -- 172.21.15.37:0/632308755 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c0cd6e0 con 0x7f398c0ce8d0 2024-05-30T06:57:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.547+0000 7f398b200640 1 --2- 172.21.15.37:0/632308755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c0ce8d0 0x7f398c0ced60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3984009dc0 tx=0x7f398401f0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=434c2bb26e620314 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.547+0000 7f3989400640 1 -- 172.21.15.37:0/632308755 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39840b5070 con 0x7f398c0ce8d0 2024-05-30T06:57:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.547+0000 7f3989400640 1 -- 172.21.15.37:0/632308755 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39840a8c30 con 0x7f398c0ce8d0 2024-05-30T06:57:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.547+0000 7f3989400640 1 -- 172.21.15.37:0/632308755 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c001680 con 0x7f398c0ce8d0 2024-05-30T06:57:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 -- 172.21.15.37:0/632308755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c0ce8d0 msgr2=0x7f398c0ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 --2- 172.21.15.37:0/632308755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c0ce8d0 0x7f398c0ced60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3984009dc0 tx=0x7f398401f0a0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 -- 172.21.15.37:0/632308755 shutdown_connections 2024-05-30T06:57:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 --2- 172.21.15.37:0/632308755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c0ce8d0 0x7f398c0ced60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 -- 172.21.15.37:0/632308755 >> 172.21.15.37:0/632308755 conn(0x7f398c0b23a0 msgr2=0x7f398c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 -- 172.21.15.37:0/632308755 shutdown_connections 2024-05-30T06:57:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 -- 172.21.15.37:0/632308755 wait complete. 2024-05-30T06:57:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 Processor -- start 2024-05-30T06:57:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 -- start start 2024-05-30T06:57:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c06e000 0x7f398c13c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f398c0ce8d0 0x7f398c13efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f398c15cd80 0x7f398c158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1673d0 con 0x7f398c0ce8d0 2024-05-30T06:57:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f398c0cdca0 con 0x7f398c15cd80 2024-05-30T06:57:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3991400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f398c167550 con 0x7f398c06e000 2024-05-30T06:57:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3989e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f398c0ce8d0 0x7f398c13efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3989e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f398c0ce8d0 0x7f398c13efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46306/0 (socket says 172.21.15.37:46306) 2024-05-30T06:57:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3989e00640 1 -- 172.21.15.37:0/80111206 learned_addr learned my addr 172.21.15.37:0/80111206 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f398a800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c06e000 0x7f398c13c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f398b200640 1 --2- 172.21.15.37:0/80111206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f398c15cd80 0x7f398c158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3989e00640 1 -- 172.21.15.37:0/80111206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c06e000 msgr2=0x7f398c13c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3989e00640 1 --2- 172.21.15.37:0/80111206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c06e000 0x7f398c13c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3989e00640 1 -- 172.21.15.37:0/80111206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f398c15cd80 msgr2=0x7f398c158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.551+0000 7f3989e00640 1 --2- 172.21.15.37:0/80111206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f398c15cd80 0x7f398c158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.555+0000 7f3989e00640 1 -- 172.21.15.37:0/80111206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c158e80 con 0x7f398c0ce8d0 2024-05-30T06:57:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.555+0000 7f3989e00640 1 --2- 172.21.15.37:0/80111206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f398c0ce8d0 0x7f398c13efd0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f397800c490 tx=0x7f397800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.555+0000 7f3982a00640 1 -- 172.21.15.37:0/80111206 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39780052d0 con 0x7f398c0ce8d0 2024-05-30T06:57:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.555+0000 7f3982a00640 1 -- 172.21.15.37:0/80111206 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3978005470 con 0x7f398c0ce8d0 2024-05-30T06:57:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.555+0000 7f3982a00640 1 -- 172.21.15.37:0/80111206 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3978012870 con 0x7f398c0ce8d0 2024-05-30T06:57:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.555+0000 7f3991400640 1 -- 172.21.15.37:0/80111206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398c15a880 con 0x7f398c0ce8d0 2024-05-30T06:57:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.555+0000 7f3991400640 1 -- 172.21.15.37:0/80111206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398c143da0 con 0x7f398c0ce8d0 2024-05-30T06:57:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.555+0000 7f3991400640 1 -- 172.21.15.37:0/80111206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f398c143fa0 con 0x7f398c0ce8d0 2024-05-30T06:57:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.555+0000 7f3982a00640 1 -- 172.21.15.37:0/80111206 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f3978012a10 con 0x7f398c0ce8d0 2024-05-30T06:57:10.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.555+0000 7f3982a00640 1 --2- 172.21.15.37:0/80111206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f396c069bb0 0x7f396c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:10.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.555+0000 7f3982a00640 1 -- 172.21.15.37:0/80111206 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4999+0+0 (secure 0 0 0) 0x7f3978085300 con 0x7f398c0ce8d0 2024-05-30T06:57:10.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.555+0000 7f398a800640 1 --2- 172.21.15.37:0/80111206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f396c069bb0 0x7f396c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:10.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.559+0000 7f398a800640 1 --2- 172.21.15.37:0/80111206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f396c069bb0 0x7f396c06c070 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f397c0011f0 tx=0x7f397c001680 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.563+0000 7f3982a00640 1 -- 172.21.15.37:0/80111206 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3978056cd0 con 0x7f398c0ce8d0 2024-05-30T06:57:10.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.783+0000 7f3991400640 1 -- 172.21.15.37:0/80111206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_1_clone_is_cancelled"]} v 0) -- 0x7f398c068b20 con 0x7f398c0ce8d0 2024-05-30T06:57:11.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.999+0000 7f3982a00640 1 -- 172.21.15.37:0/80111206 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_1_clone_is_cancelled"]}]=0 v683) ==== 161+0+0 (secure 0 0 0) 0x7f397805afd0 con 0x7f398c0ce8d0 2024-05-30T06:57:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.999+0000 7f3991400640 1 -- 172.21.15.37:0/80111206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f396c069bb0 msgr2=0x7f396c06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.999+0000 7f3991400640 1 --2- 172.21.15.37:0/80111206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f396c069bb0 0x7f396c06c070 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f397c0011f0 tx=0x7f397c001680 comp rx=0 tx=0).stop 2024-05-30T06:57:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.999+0000 7f3991400640 1 -- 172.21.15.37:0/80111206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f398c0ce8d0 msgr2=0x7f398c13efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.999+0000 7f3991400640 1 --2- 172.21.15.37:0/80111206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f398c0ce8d0 0x7f398c13efd0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f397800c490 tx=0x7f397800c950 comp rx=0 tx=0).stop 2024-05-30T06:57:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.999+0000 7f3991400640 1 -- 172.21.15.37:0/80111206 shutdown_connections 2024-05-30T06:57:11.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.999+0000 7f3991400640 1 --2- 172.21.15.37:0/80111206 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f396c069bb0 0x7f396c06c070 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.999+0000 7f3991400640 1 --2- 172.21.15.37:0/80111206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f398c15cd80 0x7f398c158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.999+0000 7f3991400640 1 --2- 172.21.15.37:0/80111206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f398c0ce8d0 0x7f398c13efd0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.999+0000 7f3991400640 1 --2- 172.21.15.37:0/80111206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c06e000 0x7f398c13c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.999+0000 7f3991400640 1 -- 172.21.15.37:0/80111206 >> 172.21.15.37:0/80111206 conn(0x7f398c0b23a0 msgr2=0x7f398c0b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:11.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.999+0000 7f3991400640 1 -- 172.21.15.37:0/80111206 shutdown_connections 2024-05-30T06:57:11.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:10.999+0000 7f3991400640 1 -- 172.21.15.37:0/80111206 wait complete. 2024-05-30T06:57:11.024 INFO:tasks.cephfs_test_runner:Test that the progress bar, that is printed for 1 ongoing clone job, is ... ok 2024-05-30T06:57:11.025 INFO:tasks.cephfs_test_runner:Starting test: test_when_3_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that progress bars, that printed for 3 ongoing clone jobs, are 2024-05-30T06:57:11.025 INFO:tasks.cephfs_test_runner:test_when_3_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T06:57:11.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:57:11.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd78be00640 1 Processor -- start 2024-05-30T06:57:11.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd78be00640 1 -- start start 2024-05-30T06:57:11.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd78be00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd7841462b0 0x7fd784160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd78be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7840cfdf0 0x7fd78415d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd78be00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd78415d850 con 0x7fd78415cdb0 2024-05-30T06:57:11.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd78be00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd78415db30 con 0x7fd7840cfdf0 2024-05-30T06:57:11.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd78be00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd784160590 con 0x7fd7841462b0 2024-05-30T06:57:11.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd789e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7840cfdf0 0x7fd78415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd788a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd78415cdb0 0x7fd7840cf6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48888/0 (socket says 172.21.15.37:48888) 2024-05-30T06:57:11.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd788a00640 1 -- 172.21.15.37:0/402727805 learned_addr learned my addr 172.21.15.37:0/402727805 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:11.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd789400640 1 --2- 172.21.15.37:0/402727805 >> v2:172.21.15.105:3300/0 conn(0x7fd7841462b0 0x7fd784160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd789e00640 1 -- 172.21.15.37:0/402727805 >> v2:172.21.15.105:3300/0 conn(0x7fd7841462b0 msgr2=0x7fd784160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:11.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd789e00640 1 --2- 172.21.15.37:0/402727805 >> v2:172.21.15.105:3300/0 conn(0x7fd7841462b0 0x7fd784160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd789e00640 1 -- 172.21.15.37:0/402727805 >> v1:172.21.15.37:6789/0 conn(0x7fd78415cdb0 legacy=0x7fd7840cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.163+0000 7fd789e00640 1 -- 172.21.15.37:0/402727805 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd784160870 con 0x7fd7840cfdf0 2024-05-30T06:57:11.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.167+0000 7fd789e00640 1 --2- 172.21.15.37:0/402727805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7840cfdf0 0x7fd78415d220 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009d90 tx=0x7fd77c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfa840051fa3f46 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:11.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.167+0000 7fd783e00640 1 -- 172.21.15.37:0/402727805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0b2070 con 0x7fd7840cfdf0 2024-05-30T06:57:11.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.167+0000 7fd783e00640 1 -- 172.21.15.37:0/402727805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77c0a58f0 con 0x7fd7840cfdf0 2024-05-30T06:57:11.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.167+0000 7fd783e00640 1 -- 172.21.15.37:0/402727805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0a5cc0 con 0x7fd7840cfdf0 2024-05-30T06:57:11.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.167+0000 7fd78be00640 1 -- 172.21.15.37:0/402727805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7840cfdf0 msgr2=0x7fd78415d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.167+0000 7fd78be00640 1 --2- 172.21.15.37:0/402727805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7840cfdf0 0x7fd78415d220 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009d90 tx=0x7fd77c01c850 comp rx=0 tx=0).stop 2024-05-30T06:57:11.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.167+0000 7fd78be00640 1 -- 172.21.15.37:0/402727805 shutdown_connections 2024-05-30T06:57:11.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.167+0000 7fd78be00640 1 --2- 172.21.15.37:0/402727805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7840cfdf0 0x7fd78415d220 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.167+0000 7fd78be00640 1 --2- 172.21.15.37:0/402727805 >> v2:172.21.15.105:3300/0 conn(0x7fd7841462b0 0x7fd784160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.167+0000 7fd78be00640 1 -- 172.21.15.37:0/402727805 >> 172.21.15.37:0/402727805 conn(0x7fd7840b3390 msgr2=0x7fd7840b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:11.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.167+0000 7fd78be00640 1 -- 172.21.15.37:0/402727805 shutdown_connections 2024-05-30T06:57:11.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.167+0000 7fd78be00640 1 -- 172.21.15.37:0/402727805 wait complete. 2024-05-30T06:57:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd78be00640 1 Processor -- start 2024-05-30T06:57:11.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd78be00640 1 -- start start 2024-05-30T06:57:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd78be00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7840cfdf0 0x7fd784142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd78be00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7841462b0 0x7fd7840c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd78be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78415cdb0 0x7fd7840c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd78be00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7840b4150 con 0x7fd78415cdb0 2024-05-30T06:57:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd78be00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd7840b3fd0 con 0x7fd7840cfdf0 2024-05-30T06:57:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd78be00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd7840ce050 con 0x7fd7841462b0 2024-05-30T06:57:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd789e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78415cdb0 0x7fd7840c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd789e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78415cdb0 0x7fd7840c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46328/0 (socket says 172.21.15.37:46328) 2024-05-30T06:57:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd789e00640 1 -- 172.21.15.37:0/687820942 learned_addr learned my addr 172.21.15.37:0/687820942 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd789400640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7840cfdf0 0x7fd784142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd788a00640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7841462b0 0x7fd7840c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd789e00640 1 -- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7841462b0 msgr2=0x7fd7840c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd789e00640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7841462b0 0x7fd7840c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd789e00640 1 -- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7840cfdf0 msgr2=0x7fd784142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd789e00640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7840cfdf0 0x7fd784142500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd789e00640 1 -- 172.21.15.37:0/687820942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7840c6910 con 0x7fd78415cdb0 2024-05-30T06:57:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd789e00640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78415cdb0 0x7fd7840c8890 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0b0040 tx=0x7fd77c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd781600640 1 -- 172.21.15.37:0/687820942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0b2050 con 0x7fd78415cdb0 2024-05-30T06:57:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd781600640 1 -- 172.21.15.37:0/687820942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77c0be070 con 0x7fd78415cdb0 2024-05-30T06:57:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd781600640 1 -- 172.21.15.37:0/687820942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0b9450 con 0x7fd78415cdb0 2024-05-30T06:57:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd78be00640 1 -- 172.21.15.37:0/687820942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7840c6bf0 con 0x7fd78415cdb0 2024-05-30T06:57:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.171+0000 7fd78be00640 1 -- 172.21.15.37:0/687820942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7840c71b0 con 0x7fd78415cdb0 2024-05-30T06:57:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.175+0000 7fd78be00640 1 -- 172.21.15.37:0/687820942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd784068b20 con 0x7fd78415cdb0 2024-05-30T06:57:11.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.175+0000 7fd781600640 1 -- 172.21.15.37:0/687820942 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fd77c0b95f0 con 0x7fd78415cdb0 2024-05-30T06:57:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.175+0000 7fd781600640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd764069be0 0x7fd76406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.175+0000 7fd781600640 1 -- 172.21.15.37:0/687820942 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4999+0+0 (secure 0 0 0) 0x7fd77c120e10 con 0x7fd78415cdb0 2024-05-30T06:57:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.175+0000 7fd789400640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd764069be0 0x7fd76406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.175+0000 7fd789400640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd764069be0 0x7fd76406c0a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd778007a60 tx=0x7fd778008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.179+0000 7fd781600640 1 -- 172.21.15.37:0/687820942 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd77c016480 con 0x7fd78415cdb0 2024-05-30T06:57:11.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.347+0000 7fd78be00640 1 -- 172.21.15.37:0/687820942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd78406c740 con 0x7fd78415cdb0 2024-05-30T06:57:11.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.347+0000 7fd781600640 1 -- 172.21.15.37:0/687820942 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+13106 (secure 0 0 0) 0x7fd77c0f29a0 con 0x7fd78415cdb0 2024-05-30T06:57:11.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:11.352 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":106,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:57:09.989285+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6834/1190106206":"2024-05-31T06:57:06.982785+0000","172.21.15.37:6832/1190106206":"2024-05-31T06:57:06.982785+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:57:11.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.351+0000 7fd78be00640 1 -- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd764069be0 msgr2=0x7fd76406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.351+0000 7fd78be00640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd764069be0 0x7fd76406c0a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd778007a60 tx=0x7fd778008040 comp rx=0 tx=0).stop 2024-05-30T06:57:11.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.351+0000 7fd78be00640 1 -- 172.21.15.37:0/687820942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78415cdb0 msgr2=0x7fd7840c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.351+0000 7fd78be00640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78415cdb0 0x7fd7840c8890 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0b0040 tx=0x7fd77c0195f0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.351+0000 7fd78be00640 1 -- 172.21.15.37:0/687820942 shutdown_connections 2024-05-30T06:57:11.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.351+0000 7fd78be00640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78415cdb0 0x7fd7840c8890 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.351+0000 7fd78be00640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7841462b0 0x7fd7840c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.351+0000 7fd78be00640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd764069be0 0x7fd76406c0a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.351+0000 7fd78be00640 1 --2- 172.21.15.37:0/687820942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7840cfdf0 0x7fd784142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.351+0000 7fd78be00640 1 -- 172.21.15.37:0/687820942 >> 172.21.15.37:0/687820942 conn(0x7fd7840b3390 msgr2=0x7fd784141550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:11.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.351+0000 7fd78be00640 1 -- 172.21.15.37:0/687820942 shutdown_connections 2024-05-30T06:57:11.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.351+0000 7fd78be00640 1 -- 172.21.15.37:0/687820942 wait complete. 2024-05-30T06:57:11.374 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:57:11.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:57:11.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef1b800640 1 Processor -- start 2024-05-30T06:57:11.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef1b800640 1 -- start start 2024-05-30T06:57:11.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef1b800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef14155da0 0x7fef140cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef1b800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140cd440 0x7fef1406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef1b800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1415f310 con 0x7fef1406f5a0 2024-05-30T06:57:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef1b800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fef140b4760 con 0x7fef14155da0 2024-05-30T06:57:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef1b800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fef1415f5f0 con 0x7fef140cd440 2024-05-30T06:57:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef18e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef14155da0 0x7fef140cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef18e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef14155da0 0x7fef140cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46342/0 (socket says 172.21.15.37:46342) 2024-05-30T06:57:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef18e00640 1 -- 172.21.15.37:0/2834835691 learned_addr learned my addr 172.21.15.37:0/2834835691 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef0be00640 1 --2- 172.21.15.37:0/2834835691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140cd440 0x7fef1406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef18e00640 1 -- 172.21.15.37:0/2834835691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140cd440 msgr2=0x7fef1406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef18e00640 1 --2- 172.21.15.37:0/2834835691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140cd440 0x7fef1406f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef18e00640 1 -- 172.21.15.37:0/2834835691 >> v1:172.21.15.105:6789/0 conn(0x7fef1406f5a0 legacy=0x7fef140cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef18e00640 1 -- 172.21.15.37:0/2834835691 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1415f8d0 con 0x7fef14155da0 2024-05-30T06:57:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.515+0000 7fef0be00640 1 --2- 172.21.15.37:0/2834835691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140cd440 0x7fef1406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:11.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.519+0000 7fef18e00640 1 --2- 172.21.15.37:0/2834835691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef14155da0 0x7fef140cd950 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fef04009870 tx=0x7fef0401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a878b90279947c39 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:11.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.519+0000 7fef13e00640 1 -- 172.21.15.37:0/2834835691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040b0070 con 0x7fef14155da0 2024-05-30T06:57:11.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.519+0000 7fef13e00640 1 -- 172.21.15.37:0/2834835691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef040a4e50 con 0x7fef14155da0 2024-05-30T06:57:11.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.519+0000 7fef13e00640 1 -- 172.21.15.37:0/2834835691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040ab820 con 0x7fef14155da0 2024-05-30T06:57:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.519+0000 7fef1b800640 1 -- 172.21.15.37:0/2834835691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef14155da0 msgr2=0x7fef140cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.519+0000 7fef1b800640 1 --2- 172.21.15.37:0/2834835691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef14155da0 0x7fef140cd950 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fef04009870 tx=0x7fef0401c400 comp rx=0 tx=0).stop 2024-05-30T06:57:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.519+0000 7fef1b800640 1 -- 172.21.15.37:0/2834835691 shutdown_connections 2024-05-30T06:57:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.519+0000 7fef1b800640 1 --2- 172.21.15.37:0/2834835691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140cd440 0x7fef1406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.519+0000 7fef1b800640 1 --2- 172.21.15.37:0/2834835691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef14155da0 0x7fef140cd950 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.519+0000 7fef1b800640 1 -- 172.21.15.37:0/2834835691 >> 172.21.15.37:0/2834835691 conn(0x7fef1406bf60 msgr2=0x7fef140b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.519+0000 7fef1b800640 1 -- 172.21.15.37:0/2834835691 shutdown_connections 2024-05-30T06:57:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef1b800640 1 -- 172.21.15.37:0/2834835691 wait complete. 2024-05-30T06:57:11.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef1b800640 1 Processor -- start 2024-05-30T06:57:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef1b800640 1 -- start start 2024-05-30T06:57:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef1b800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef1406f5a0 0x7fef14154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef1b800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef14155da0 0x7fef14158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef1b800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef14140b50 0x7fef14140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef1b800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef14168700 con 0x7fef14140b50 2024-05-30T06:57:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef1b800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fef14168580 con 0x7fef14155da0 2024-05-30T06:57:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef1b800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fef14168880 con 0x7fef1406f5a0 2024-05-30T06:57:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef19800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef14140b50 0x7fef14140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef19800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef14140b50 0x7fef14140fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46358/0 (socket says 172.21.15.37:46358) 2024-05-30T06:57:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef19800640 1 -- 172.21.15.37:0/861610575 learned_addr learned my addr 172.21.15.37:0/861610575 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef18e00640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef1406f5a0 0x7fef14154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef19800640 1 -- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef1406f5a0 msgr2=0x7fef14154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef0be00640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef14155da0 0x7fef14158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef19800640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef1406f5a0 0x7fef14154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef19800640 1 -- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef14155da0 msgr2=0x7fef14158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef19800640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef14155da0 0x7fef14158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef19800640 1 -- 172.21.15.37:0/861610575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef141663a0 con 0x7fef14140b50 2024-05-30T06:57:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef18e00640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef1406f5a0 0x7fef14154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef0be00640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef14155da0 0x7fef14158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef19800640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef14140b50 0x7fef14140fe0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c7b0 tx=0x7fef0c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef11600640 1 -- 172.21.15.37:0/861610575 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c004b70 con 0x7fef14140b50 2024-05-30T06:57:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef11600640 1 -- 172.21.15.37:0/861610575 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c004d10 con 0x7fef14140b50 2024-05-30T06:57:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef1b800640 1 -- 172.21.15.37:0/861610575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef14157d90 con 0x7fef14140b50 2024-05-30T06:57:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.523+0000 7fef11600640 1 -- 172.21.15.37:0/861610575 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c00aa90 con 0x7fef14140b50 2024-05-30T06:57:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.527+0000 7fef1b800640 1 -- 172.21.15.37:0/861610575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1415be90 con 0x7fef14140b50 2024-05-30T06:57:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.527+0000 7fef1b800640 1 -- 172.21.15.37:0/861610575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef14068bc0 con 0x7fef14140b50 2024-05-30T06:57:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.527+0000 7fef11600640 1 -- 172.21.15.37:0/861610575 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fef0c00ac30 con 0x7fef14140b50 2024-05-30T06:57:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.527+0000 7fef11600640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feef0069bb0 0x7feef006c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.527+0000 7fef11600640 1 -- 172.21.15.37:0/861610575 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4999+0+0 (secure 0 0 0) 0x7fef0c085a30 con 0x7fef14140b50 2024-05-30T06:57:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.527+0000 7fef18e00640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feef0069bb0 0x7feef006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.527+0000 7fef18e00640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feef0069bb0 0x7feef006c070 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fef040ad000 tx=0x7fef04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.531+0000 7fef11600640 1 -- 172.21.15.37:0/861610575 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fef0c020070 con 0x7fef14140b50 2024-05-30T06:57:11.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef1b800640 1 -- 172.21.15.37:0/861610575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fef14154ff0 con 0x7fef14140b50 2024-05-30T06:57:11.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef11600640 1 -- 172.21.15.37:0/861610575 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) ==== 93+0+10 (secure 0 0 0) 0x7fef0c057a50 con 0x7fef14140b50 2024-05-30T06:57:11.702 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:57:11.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef1b800640 1 -- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feef0069bb0 msgr2=0x7feef006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef1b800640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feef0069bb0 0x7feef006c070 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fef040ad000 tx=0x7fef04008040 comp rx=0 tx=0).stop 2024-05-30T06:57:11.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef1b800640 1 -- 172.21.15.37:0/861610575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef14140b50 msgr2=0x7fef14140fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef1b800640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef14140b50 0x7fef14140fe0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00c7b0 tx=0x7fef0c00cc70 comp rx=0 tx=0).stop 2024-05-30T06:57:11.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef1b800640 1 -- 172.21.15.37:0/861610575 shutdown_connections 2024-05-30T06:57:11.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef1b800640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef14140b50 0x7fef14140fe0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef1b800640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feef0069bb0 0x7feef006c070 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef1b800640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef14155da0 0x7fef14158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef1b800640 1 --2- 172.21.15.37:0/861610575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef1406f5a0 0x7fef14154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef1b800640 1 -- 172.21.15.37:0/861610575 >> 172.21.15.37:0/861610575 conn(0x7fef1406bf60 msgr2=0x7fef14071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:11.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef1b800640 1 -- 172.21.15.37:0/861610575 shutdown_connections 2024-05-30T06:57:11.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.699+0000 7fef1b800640 1 -- 172.21.15.37:0/861610575 wait complete. 2024-05-30T06:57:11.724 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_3_clones_are_cancelled' 2024-05-30T06:57:11.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.871+0000 7f3d29000640 1 Processor -- start 2024-05-30T06:57:11.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.871+0000 7f3d29000640 1 -- start start 2024-05-30T06:57:11.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d29000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d240b2e20 0x7f3d24160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d29000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3d241609c0 0x7f3d24160e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d29000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d240d0430 con 0x7f3d240cd280 2024-05-30T06:57:11.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d29000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3d240b3200 con 0x7f3d240b2e20 2024-05-30T06:57:11.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d29000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3d240d01e0 con 0x7f3d241609c0 2024-05-30T06:57:11.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d22800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3d240cd280 0x7f3d240cd6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48896/0 (socket says 172.21.15.37:48896) 2024-05-30T06:57:11.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d21e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d240b2e20 0x7f3d24160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d22800640 1 -- 172.21.15.37:0/3699989529 learned_addr learned my addr 172.21.15.37:0/3699989529 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:11.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d19400640 1 --2- 172.21.15.37:0/3699989529 >> v2:172.21.15.105:3300/0 conn(0x7f3d241609c0 0x7f3d24160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d21e00640 1 -- 172.21.15.37:0/3699989529 >> v2:172.21.15.105:3300/0 conn(0x7f3d241609c0 msgr2=0x7f3d24160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:11.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d21e00640 1 --2- 172.21.15.37:0/3699989529 >> v2:172.21.15.105:3300/0 conn(0x7f3d241609c0 0x7f3d24160e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d21e00640 1 -- 172.21.15.37:0/3699989529 >> v1:172.21.15.37:6789/0 conn(0x7f3d240cd280 legacy=0x7f3d240cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d21e00640 1 -- 172.21.15.37:0/3699989529 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d240d0710 con 0x7f3d240b2e20 2024-05-30T06:57:11.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d19400640 1 --2- 172.21.15.37:0/3699989529 >> v2:172.21.15.105:3300/0 conn(0x7f3d241609c0 0x7f3d24160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:11.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.875+0000 7f3d21e00640 1 --2- 172.21.15.37:0/3699989529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d240b2e20 0x7f3d24160480 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f3d240c5fe0 tx=0x7f3d1401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c4bd4d8fc3bb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:11.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d21400640 1 -- 172.21.15.37:0/3699989529 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d140b0070 con 0x7f3d240b2e20 2024-05-30T06:57:11.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d21400640 1 -- 172.21.15.37:0/3699989529 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d140ab600 con 0x7f3d240b2e20 2024-05-30T06:57:11.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d21400640 1 -- 172.21.15.37:0/3699989529 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d140ab9d0 con 0x7f3d240b2e20 2024-05-30T06:57:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 -- 172.21.15.37:0/3699989529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d240b2e20 msgr2=0x7f3d24160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 --2- 172.21.15.37:0/3699989529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d240b2e20 0x7f3d24160480 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f3d240c5fe0 tx=0x7f3d1401c480 comp rx=0 tx=0).stop 2024-05-30T06:57:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 -- 172.21.15.37:0/3699989529 shutdown_connections 2024-05-30T06:57:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 --2- 172.21.15.37:0/3699989529 >> v2:172.21.15.105:3300/0 conn(0x7f3d241609c0 0x7f3d24160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 --2- 172.21.15.37:0/3699989529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d240b2e20 0x7f3d24160480 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 -- 172.21.15.37:0/3699989529 >> 172.21.15.37:0/3699989529 conn(0x7f3d240b4100 msgr2=0x7f3d240b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 -- 172.21.15.37:0/3699989529 shutdown_connections 2024-05-30T06:57:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 -- 172.21.15.37:0/3699989529 wait complete. 2024-05-30T06:57:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 Processor -- start 2024-05-30T06:57:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 -- start start 2024-05-30T06:57:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d240b2e20 0x7f3d24158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d240cd280 0x7f3d24158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d241609c0 0x7f3d2415ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d24169940 con 0x7f3d240cd280 2024-05-30T06:57:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3d241697c0 con 0x7f3d241609c0 2024-05-30T06:57:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d29000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3d24169ac0 con 0x7f3d240b2e20 2024-05-30T06:57:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d19400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d240cd280 0x7f3d24158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d19400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d240cd280 0x7f3d24158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46384/0 (socket says 172.21.15.37:46384) 2024-05-30T06:57:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.879+0000 7f3d19400640 1 -- 172.21.15.37:0/3960420280 learned_addr learned my addr 172.21.15.37:0/3960420280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d19400640 1 -- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d240b2e20 msgr2=0x7f3d24158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d19400640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d240b2e20 0x7f3d24158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d19400640 1 -- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d241609c0 msgr2=0x7f3d2415ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d22800640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d241609c0 0x7f3d2415ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d19400640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d241609c0 0x7f3d2415ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d19400640 1 -- 172.21.15.37:0/3960420280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d240b5460 con 0x7f3d240cd280 2024-05-30T06:57:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d22800640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d241609c0 0x7f3d2415ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d19400640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d240cd280 0x7f3d24158980 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00e810 tx=0x7f3d0c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d1aa00640 1 -- 172.21.15.37:0/3960420280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c017070 con 0x7f3d240cd280 2024-05-30T06:57:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d1aa00640 1 -- 172.21.15.37:0/3960420280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0c00c870 con 0x7f3d240cd280 2024-05-30T06:57:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d1aa00640 1 -- 172.21.15.37:0/3960420280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c00f040 con 0x7f3d240cd280 2024-05-30T06:57:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d29000640 1 -- 172.21.15.37:0/3960420280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d2415f9c0 con 0x7f3d240cd280 2024-05-30T06:57:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d29000640 1 -- 172.21.15.37:0/3960420280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d2415ff80 con 0x7f3d240cd280 2024-05-30T06:57:11.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d29000640 1 -- 172.21.15.37:0/3960420280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d24068b20 con 0x7f3d240cd280 2024-05-30T06:57:11.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d1aa00640 1 -- 172.21.15.37:0/3960420280 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f3d0c01a070 con 0x7f3d240cd280 2024-05-30T06:57:11.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.883+0000 7f3d1aa00640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d00069bb0 0x7f3d0006c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:11.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.887+0000 7f3d1aa00640 1 -- 172.21.15.37:0/3960420280 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4999+0+0 (secure 0 0 0) 0x7f3d0c085310 con 0x7f3d240cd280 2024-05-30T06:57:11.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.887+0000 7f3d21e00640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d00069bb0 0x7f3d0006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:11.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.887+0000 7f3d21e00640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d00069bb0 0x7f3d0006c070 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3d140ad000 tx=0x7f3d14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:11.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:11.887+0000 7f3d1aa00640 1 -- 172.21.15.37:0/3960420280 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d0c0573d0 con 0x7f3d240cd280 2024-05-30T06:57:12.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:12.111+0000 7f3d29000640 1 -- 172.21.15.37:0/3960420280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_3_clones_are_cancelled"]} v 0) -- 0x7f3d240ce860 con 0x7f3d240cd280 2024-05-30T06:57:13.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.007+0000 7f3d1aa00640 1 -- 172.21.15.37:0/3960420280 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_3_clones_are_cancelled"]}]=0 v685) ==== 166+0+0 (secure 0 0 0) 0x7f3d0c056cd0 con 0x7f3d240cd280 2024-05-30T06:57:13.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.007+0000 7f3d29000640 1 -- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d00069bb0 msgr2=0x7f3d0006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.007+0000 7f3d29000640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d00069bb0 0x7f3d0006c070 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3d140ad000 tx=0x7f3d14008040 comp rx=0 tx=0).stop 2024-05-30T06:57:13.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.007+0000 7f3d29000640 1 -- 172.21.15.37:0/3960420280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d240cd280 msgr2=0x7f3d24158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.007+0000 7f3d29000640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d240cd280 0x7f3d24158980 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00e810 tx=0x7f3d0c00ecd0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.007+0000 7f3d29000640 1 -- 172.21.15.37:0/3960420280 shutdown_connections 2024-05-30T06:57:13.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.007+0000 7f3d29000640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d00069bb0 0x7f3d0006c070 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.007+0000 7f3d29000640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d241609c0 0x7f3d2415ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.007+0000 7f3d29000640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d240cd280 0x7f3d24158980 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.007+0000 7f3d29000640 1 --2- 172.21.15.37:0/3960420280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d240b2e20 0x7f3d24158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.007+0000 7f3d29000640 1 -- 172.21.15.37:0/3960420280 >> 172.21.15.37:0/3960420280 conn(0x7f3d240b4100 msgr2=0x7f3d24071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.007+0000 7f3d29000640 1 -- 172.21.15.37:0/3960420280 shutdown_connections 2024-05-30T06:57:13.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.007+0000 7f3d29000640 1 -- 172.21.15.37:0/3960420280 wait complete. 2024-05-30T06:57:13.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:57:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814f600640 1 Processor -- start 2024-05-30T06:57:13.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814f600640 1 -- start start 2024-05-30T06:57:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814f600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f814815c890 0x7f8148162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814f600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8148072e60 0x7f814806c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814f600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8148163020 con 0x7f814815f210 2024-05-30T06:57:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814f600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8148163300 con 0x7f814815c890 2024-05-30T06:57:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814f600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f81481635e0 con 0x7f8148072e60 2024-05-30T06:57:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814cc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f814815c890 0x7f8148162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814cc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f814815c890 0x7f8148162720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46398/0 (socket says 172.21.15.37:46398) 2024-05-30T06:57:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814cc00640 1 -- 172.21.15.37:0/1584192183 learned_addr learned my addr 172.21.15.37:0/1584192183 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814d600640 1 --2- 172.21.15.37:0/1584192183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8148072e60 0x7f814806c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814cc00640 1 -- 172.21.15.37:0/1584192183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8148072e60 msgr2=0x7f814806c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814cc00640 1 --2- 172.21.15.37:0/1584192183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8148072e60 0x7f814806c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814cc00640 1 -- 172.21.15.37:0/1584192183 >> v1:172.21.15.105:6789/0 conn(0x7f814815f210 legacy=0x7f8148072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814cc00640 1 -- 172.21.15.37:0/1584192183 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f814806ba00 con 0x7f814815c890 2024-05-30T06:57:13.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.183+0000 7f814d600640 1 --2- 172.21.15.37:0/1584192183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8148072e60 0x7f814806c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f814cc00640 1 --2- 172.21.15.37:0/1584192183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f814815c890 0x7f8148162720 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f813c009870 tx=0x7f813c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735efea575c60aed server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f8147400640 1 -- 172.21.15.37:0/1584192183 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c0b0070 con 0x7f814815c890 2024-05-30T06:57:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f8147400640 1 -- 172.21.15.37:0/1584192183 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813c0ab400 con 0x7f814815c890 2024-05-30T06:57:13.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f8147400640 1 -- 172.21.15.37:0/1584192183 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c0ab7d0 con 0x7f814815c890 2024-05-30T06:57:13.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f814f600640 1 -- 172.21.15.37:0/1584192183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f814815c890 msgr2=0x7f8148162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f814f600640 1 --2- 172.21.15.37:0/1584192183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f814815c890 0x7f8148162720 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f813c009870 tx=0x7f813c01c4d0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f814f600640 1 -- 172.21.15.37:0/1584192183 shutdown_connections 2024-05-30T06:57:13.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f814f600640 1 --2- 172.21.15.37:0/1584192183 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8148072e60 0x7f814806c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f814f600640 1 --2- 172.21.15.37:0/1584192183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f814815c890 0x7f8148162720 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f814f600640 1 -- 172.21.15.37:0/1584192183 >> 172.21.15.37:0/1584192183 conn(0x7f81480b2ac0 msgr2=0x7f81480b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:13.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f814f600640 1 -- 172.21.15.37:0/1584192183 shutdown_connections 2024-05-30T06:57:13.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f814f600640 1 -- 172.21.15.37:0/1584192183 wait complete. 2024-05-30T06:57:13.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f814f600640 1 Processor -- start 2024-05-30T06:57:13.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.187+0000 7f814f600640 1 -- start start 2024-05-30T06:57:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f814f600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8148072e60 0x7f8148166ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f814f600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f814815c890 0x7f8148168610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f814f600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814815f210 0x7f814815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f814f600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f814816be50 con 0x7f814815c890 2024-05-30T06:57:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f814f600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f814816bcd0 con 0x7f814815f210 2024-05-30T06:57:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f814f600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f814816bfd0 con 0x7f8148072e60 2024-05-30T06:57:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f8147e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f814815c890 0x7f8148168610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f8147e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f814815c890 0x7f8148168610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46400/0 (socket says 172.21.15.37:46400) 2024-05-30T06:57:13.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f8147e00640 1 -- 172.21.15.37:0/164371468 learned_addr learned my addr 172.21.15.37:0/164371468 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f814cc00640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8148072e60 0x7f8148166ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f814d600640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814815f210 0x7f814815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f8147e00640 1 -- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8148072e60 msgr2=0x7f8148166ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f8147e00640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8148072e60 0x7f8148166ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f8147e00640 1 -- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814815f210 msgr2=0x7f814815ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f8147e00640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814815f210 0x7f814815ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f8147e00640 1 -- 172.21.15.37:0/164371468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8148168b50 con 0x7f814815c890 2024-05-30T06:57:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f814d600640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814815f210 0x7f814815ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f8147e00640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f814815c890 0x7f8148168610 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f813400c370 tx=0x7f813400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f8144c00640 1 -- 172.21.15.37:0/164371468 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81340052d0 con 0x7f814815c890 2024-05-30T06:57:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f8144c00640 1 -- 172.21.15.37:0/164371468 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8134005470 con 0x7f814815c890 2024-05-30T06:57:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f8144c00640 1 -- 172.21.15.37:0/164371468 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134007260 con 0x7f814815c890 2024-05-30T06:57:13.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f814f600640 1 -- 172.21.15.37:0/164371468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8148168df0 con 0x7f814815c890 2024-05-30T06:57:13.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f814f600640 1 -- 172.21.15.37:0/164371468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81481693b0 con 0x7f814815c890 2024-05-30T06:57:13.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.191+0000 7f814f600640 1 -- 172.21.15.37:0/164371468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8148068bc0 con 0x7f814815c890 2024-05-30T06:57:13.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.195+0000 7f8144c00640 1 -- 172.21.15.37:0/164371468 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f8134007400 con 0x7f814815c890 2024-05-30T06:57:13.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.195+0000 7f8144c00640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8128069bb0 0x7f812806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.195+0000 7f8144c00640 1 -- 172.21.15.37:0/164371468 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4999+0+0 (secure 0 0 0) 0x7f8134084b40 con 0x7f814815c890 2024-05-30T06:57:13.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.195+0000 7f814cc00640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8128069bb0 0x7f812806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.195+0000 7f814cc00640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8128069bb0 0x7f812806c070 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f813c0ad000 tx=0x7f813c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:13.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.199+0000 7f8144c00640 1 -- 172.21.15.37:0/164371468 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f81340565b0 con 0x7f814815c890 2024-05-30T06:57:13.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.367+0000 7f814f600640 1 -- 172.21.15.37:0/164371468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8148067d90 con 0x7f814815c890 2024-05-30T06:57:13.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.371+0000 7f8144c00640 1 -- 172.21.15.37:0/164371468 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f813405a8b0 con 0x7f814815c890 2024-05-30T06:57:13.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.371+0000 7f814f600640 1 -- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8128069bb0 msgr2=0x7f812806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.371+0000 7f814f600640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8128069bb0 0x7f812806c070 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f813c0ad000 tx=0x7f813c0a6000 comp rx=0 tx=0).stop 2024-05-30T06:57:13.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.371+0000 7f814f600640 1 -- 172.21.15.37:0/164371468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f814815c890 msgr2=0x7f8148168610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.371+0000 7f814f600640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f814815c890 0x7f8148168610 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f813400c370 tx=0x7f813400c830 comp rx=0 tx=0).stop 2024-05-30T06:57:13.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.375+0000 7f814f600640 1 -- 172.21.15.37:0/164371468 shutdown_connections 2024-05-30T06:57:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.375+0000 7f814f600640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8128069bb0 0x7f812806c070 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.375+0000 7f814f600640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814815f210 0x7f814815ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.375+0000 7f814f600640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f814815c890 0x7f8148168610 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.375+0000 7f814f600640 1 --2- 172.21.15.37:0/164371468 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8148072e60 0x7f8148166ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.375+0000 7f814f600640 1 -- 172.21.15.37:0/164371468 >> 172.21.15.37:0/164371468 conn(0x7f81480b2ac0 msgr2=0x7f81480b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.375+0000 7f814f600640 1 -- 172.21.15.37:0/164371468 shutdown_connections 2024-05-30T06:57:13.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.375+0000 7f814f600640 1 -- 172.21.15.37:0/164371468 wait complete. 2024-05-30T06:57:13.397 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:57:13.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:57:13.479 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:57:13.528 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:57:13.528 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:57:13.528 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:57:13.537 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:57:13.537 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:57:13.537 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:57:13.581 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:57:13.581 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:57:13.581 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:57:13.589 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:57:13.590 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:57:13.590 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:57:13.633 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:57:13.633 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T06:57:13.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:57:13.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.771+0000 7ff7f5200640 1 Processor -- start 2024-05-30T06:57:13.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.771+0000 7ff7f5200640 1 -- start start 2024-05-30T06:57:13.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7f5200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f00b55a0 0x7ff7f00b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7f5200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff7f006d080 0x7ff7f00b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7f5200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7f0162f70 con 0x7ff7f00b4d80 2024-05-30T06:57:13.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7f5200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f00b5ec0 con 0x7ff7f006d080 2024-05-30T06:57:13.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7f5200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f0163210 con 0x7ff7f00b55a0 2024-05-30T06:57:13.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ee800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff7f00b4d80 0x7ff7f00aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48904/0 (socket says 172.21.15.37:48904) 2024-05-30T06:57:13.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ee800640 1 -- 172.21.15.37:0/2250707362 learned_addr learned my addr 172.21.15.37:0/2250707362 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:13.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7e7e00640 1 --2- 172.21.15.37:0/2250707362 >> v2:172.21.15.105:3300/0 conn(0x7ff7f006d080 0x7ff7f00b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ede00640 1 --2- 172.21.15.37:0/2250707362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f00b55a0 0x7ff7f00b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1087165517 0 0) 0x7ff7f0162f70 con 0x7ff7f00b4d80 2024-05-30T06:57:13.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7d4003530 con 0x7ff7f00b4d80 2024-05-30T06:57:13.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2958751289 0 0) 0x7ff7d4003530 con 0x7ff7f00b4d80 2024-05-30T06:57:13.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f00b55a0 msgr2=0x7ff7f00b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:13.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 --2- 172.21.15.37:0/2250707362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f00b55a0 0x7ff7f00b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 >> v2:172.21.15.105:3300/0 conn(0x7ff7f006d080 msgr2=0x7ff7f00b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:13.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 --2- 172.21.15.37:0/2250707362 >> v2:172.21.15.105:3300/0 conn(0x7ff7f006d080 0x7ff7f00b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f00b4040 con 0x7ff7f00b4d80 2024-05-30T06:57:13.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7ff7e8001a00 con 0x7ff7f00b4d80 2024-05-30T06:57:13.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 >> v1:172.21.15.37:6789/0 conn(0x7ff7f00b4d80 legacy=0x7ff7f00aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 --2- 172.21.15.37:0/2250707362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7d40039c0 0x7ff7d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 --2- 172.21.15.37:0/2250707362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d4004810 0x7ff7d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 --2- 172.21.15.37:0/2250707362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f00b55a0 0x7ff7d40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f00b5ec0 con 0x7ff7d40039c0 2024-05-30T06:57:13.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f0163210 con 0x7ff7d4004810 2024-05-30T06:57:13.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d400b9d0 con 0x7ff7f00b55a0 2024-05-30T06:57:13.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ede00640 1 --2- 172.21.15.37:0/2250707362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7d40039c0 0x7ff7d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7e7e00640 1 --2- 172.21.15.37:0/2250707362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d4004810 0x7ff7d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ee800640 1 --2- 172.21.15.37:0/2250707362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f00b55a0 0x7ff7d40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ede00640 1 -- 172.21.15.37:0/2250707362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f00b55a0 msgr2=0x7ff7d40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:13.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ede00640 1 --2- 172.21.15.37:0/2250707362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f00b55a0 0x7ff7d40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ede00640 1 -- 172.21.15.37:0/2250707362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d4004810 msgr2=0x7ff7d4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:13.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ede00640 1 --2- 172.21.15.37:0/2250707362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d4004810 0x7ff7d4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ede00640 1 -- 172.21.15.37:0/2250707362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d4003530 con 0x7ff7d40039c0 2024-05-30T06:57:13.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.775+0000 7ff7ee800640 1 --2- 172.21.15.37:0/2250707362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f00b55a0 0x7ff7d40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:13.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.779+0000 7ff7ede00640 1 --2- 172.21.15.37:0/2250707362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7d40039c0 0x7ff7d4003de0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009b10 tx=0x7ff7e001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f4336fd8eaf0a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:13.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.779+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00b2070 con 0x7ff7d40039c0 2024-05-30T06:57:13.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.779+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e00a5550 con 0x7ff7d40039c0 2024-05-30T06:57:13.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.779+0000 7ff7ed400640 1 -- 172.21.15.37:0/2250707362 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00096b0 con 0x7ff7d40039c0 2024-05-30T06:57:13.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.779+0000 7ff7f5200640 1 -- 172.21.15.37:0/2250707362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7d40039c0 msgr2=0x7ff7d4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.779+0000 7ff7f5200640 1 --2- 172.21.15.37:0/2250707362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7d40039c0 0x7ff7d4003de0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009b10 tx=0x7ff7e001ca40 comp rx=0 tx=0).stop 2024-05-30T06:57:13.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.779+0000 7ff7ee800640 1 -- 172.21.15.37:0/2250707362 reap_dead start 2024-05-30T06:57:13.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.779+0000 7ff7f5200640 1 -- 172.21.15.37:0/2250707362 shutdown_connections 2024-05-30T06:57:13.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.779+0000 7ff7f5200640 1 -- 172.21.15.37:0/2250707362 >> 172.21.15.37:0/2250707362 conn(0x7ff7f0073680 msgr2=0x7ff7f006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:13.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.779+0000 7ff7f5200640 1 -- 172.21.15.37:0/2250707362 shutdown_connections 2024-05-30T06:57:13.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.779+0000 7ff7f5200640 1 -- 172.21.15.37:0/2250707362 wait complete. 2024-05-30T06:57:13.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7f5200640 1 Processor -- start 2024-05-30T06:57:13.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7f5200640 1 -- start start 2024-05-30T06:57:13.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7f5200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d40039c0 0x7ff7f01680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7f5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f0166a90 0x7ff7f00c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7f5200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f01f89d0 0x7ff7f01f8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7f5200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f0067af0 con 0x7ff7f0166a90 2024-05-30T06:57:13.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7f5200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f0067970 con 0x7ff7d40039c0 2024-05-30T06:57:13.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7f5200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f00b5980 con 0x7ff7f01f89d0 2024-05-30T06:57:13.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7e7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f0166a90 0x7ff7f00c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7e7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f0166a90 0x7ff7f00c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46404/0 (socket says 172.21.15.37:46404) 2024-05-30T06:57:13.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7e7e00640 1 -- 172.21.15.37:0/3977716909 learned_addr learned my addr 172.21.15.37:0/3977716909 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7ee800640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f01f89d0 0x7ff7f01f8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7ede00640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d40039c0 0x7ff7f01680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7e7e00640 1 -- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f01f89d0 msgr2=0x7ff7f01f8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7e7e00640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f01f89d0 0x7ff7f01f8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7e7e00640 1 -- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d40039c0 msgr2=0x7ff7f01680d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7e7e00640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d40039c0 0x7ff7f01680d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7e7e00640 1 -- 172.21.15.37:0/3977716909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f0167030 con 0x7ff7f0166a90 2024-05-30T06:57:13.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7e7e00640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f0166a90 0x7ff7f00c5f10 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80119b0 tx=0x7ff7d8011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:13.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7e6000640 1 -- 172.21.15.37:0/3977716909 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8019070 con 0x7ff7f0166a90 2024-05-30T06:57:13.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7e6000640 1 -- 172.21.15.37:0/3977716909 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d8004240 con 0x7ff7f0166a90 2024-05-30T06:57:13.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7e6000640 1 -- 172.21.15.37:0/3977716909 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d800f8e0 con 0x7ff7f0166a90 2024-05-30T06:57:13.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7f5200640 1 -- 172.21.15.37:0/3977716909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f0167310 con 0x7ff7f0166a90 2024-05-30T06:57:13.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7f5200640 1 -- 172.21.15.37:0/3977716909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f01678d0 con 0x7ff7f0166a90 2024-05-30T06:57:13.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.783+0000 7ff7f5200640 1 -- 172.21.15.37:0/3977716909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f0068b20 con 0x7ff7f0166a90 2024-05-30T06:57:13.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.787+0000 7ff7e6000640 1 -- 172.21.15.37:0/3977716909 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7ff7d801c070 con 0x7ff7f0166a90 2024-05-30T06:57:13.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.787+0000 7ff7e6000640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7cc069be0 0x7ff7cc06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:13.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.787+0000 7ff7e6000640 1 -- 172.21.15.37:0/3977716909 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4999+0+0 (secure 0 0 0) 0x7ff7d8085c00 con 0x7ff7f0166a90 2024-05-30T06:57:13.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.787+0000 7ff7ede00640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7cc069be0 0x7ff7cc06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:13.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.787+0000 7ff7ede00640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7cc069be0 0x7ff7cc06c0a0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00af000 tx=0x7ff7e00046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:13.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.791+0000 7ff7e6000640 1 -- 172.21.15.37:0/3977716909 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff7d80575d0 con 0x7ff7f0166a90 2024-05-30T06:57:13.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7f5200640 1 -- 172.21.15.37:0/3977716909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7f00d0380 con 0x7ff7f0166a90 2024-05-30T06:57:13.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7e6000640 1 -- 172.21.15.37:0/3977716909 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+3866 (secure 0 0 0) 0x7ff7d805b8d0 con 0x7ff7f0166a90 2024-05-30T06:57:13.994 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:13.994 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":67,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7052,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/667666714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":667666714},{"type":"v1","addr":"172.21.15.105:6836","nonce":667666714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7963,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/748743640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":748743640},{"type":"v1","addr":"172.21.15.37:6835","nonce":748743640}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/527055184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":527055184},{"type":"v1","addr":"172.21.15.105:6837","nonce":527055184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":9033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1084282544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1084282544},{"type":"v1","addr":"172.21.15.37:6834","nonce":1084282544}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[]} 2024-05-30T06:57:13.994 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 67 2024-05-30T06:57:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7f5200640 1 -- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7cc069be0 msgr2=0x7ff7cc06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7f5200640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7cc069be0 0x7ff7cc06c0a0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff7e00af000 tx=0x7ff7e00046d0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7f5200640 1 -- 172.21.15.37:0/3977716909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f0166a90 msgr2=0x7ff7f00c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7f5200640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f0166a90 0x7ff7f00c5f10 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80119b0 tx=0x7ff7d8011e70 comp rx=0 tx=0).stop 2024-05-30T06:57:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7f5200640 1 -- 172.21.15.37:0/3977716909 shutdown_connections 2024-05-30T06:57:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7f5200640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7f01f89d0 0x7ff7f01f8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7f5200640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f0166a90 0x7ff7f00c5f10 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7f5200640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff7cc069be0 0x7ff7cc06c0a0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7f5200640 1 --2- 172.21.15.37:0/3977716909 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7d40039c0 0x7ff7f01680d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7f5200640 1 -- 172.21.15.37:0/3977716909 >> 172.21.15.37:0/3977716909 conn(0x7ff7f0073680 msgr2=0x7ff7f0161fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7f5200640 1 -- 172.21.15.37:0/3977716909 shutdown_connections 2024-05-30T06:57:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:13.991+0000 7ff7f5200640 1 -- 172.21.15.37:0/3977716909 wait complete. 2024-05-30T06:57:14.016 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T06:57:14.016 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T06:57:14.016 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T06:57:14.017 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:57:14.017 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T06:57:14.017 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T06:57:14.017 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T06:57:14.017 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:57:14.017 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T06:57:14.017 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T06:57:14.018 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T06:57:14.018 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:57:14.018 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T06:57:14.018 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T06:57:14.018 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T06:57:14.018 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:57:14.028 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T06:57:14.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T06:57:14.030 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T06:57:14.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T06:57:14.032 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T06:57:14.032 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T06:57:14.033 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T06:57:14.033 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T06:57:14.075 INFO:tasks.ceph.mds.a:Started 2024-05-30T06:57:14.075 DEBUG:teuthology.parallel:result is None 2024-05-30T06:57:14.077 INFO:tasks.ceph.mds.c:Started 2024-05-30T06:57:14.077 DEBUG:teuthology.parallel:result is None 2024-05-30T06:57:14.079 INFO:tasks.ceph.mds.d:Started 2024-05-30T06:57:14.079 DEBUG:teuthology.parallel:result is None 2024-05-30T06:57:14.081 INFO:tasks.ceph.mds.b:Started 2024-05-30T06:57:14.081 DEBUG:teuthology.parallel:result is None 2024-05-30T06:57:14.081 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T06:57:14.163 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-30T06:57:14.164 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-30T06:57:14.169 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-05-30T06:57:14.170 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-05-30T06:57:14.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f5403800640 1 Processor -- start 2024-05-30T06:57:14.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f5403800640 1 -- start start 2024-05-30T06:57:14.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f5403800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53fc0b59d0 0x7f53fc0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:14.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f5403800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f53fc15d350 0x7f53fc160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:14.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f5403800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53fc0b62f0 con 0x7f53fc15d7b0 2024-05-30T06:57:14.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f5403800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f53fc142030 con 0x7f53fc15d350 2024-05-30T06:57:14.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f5403800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f53fc142310 con 0x7f53fc0b59d0 2024-05-30T06:57:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f53f3e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f53fc15d350 0x7f53fc160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f5400e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53fc0b59d0 0x7f53fc0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f53f3e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f53fc15d350 0x7f53fc160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:52280/0 (socket says 172.21.15.37:52280) 2024-05-30T06:57:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f53f3e00640 1 -- 172.21.15.37:0/1493203863 learned_addr learned my addr 172.21.15.37:0/1493203863 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f53f3e00640 1 -- 172.21.15.37:0/1493203863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53fc0b59d0 msgr2=0x7f53fc0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f53f3e00640 1 --2- 172.21.15.37:0/1493203863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53fc0b59d0 0x7f53fc0b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f53f3e00640 1 -- 172.21.15.37:0/1493203863 >> v1:172.21.15.105:6789/0 conn(0x7f53fc15d7b0 legacy=0x7f53fc1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.227+0000 7f53f3e00640 1 -- 172.21.15.37:0/1493203863 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc1425f0 con 0x7f53fc15d350 2024-05-30T06:57:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.231+0000 7f53f3e00640 1 --2- 172.21.15.37:0/1493203863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53fc15d350 0x7f53fc160280 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009870 tx=0x7f53e401ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4299d3b7f7d2b9f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.231+0000 7f53fbe00640 1 -- 172.21.15.37:0/1493203863 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e40b5070 con 0x7f53fc15d350 2024-05-30T06:57:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.231+0000 7f53fbe00640 1 -- 172.21.15.37:0/1493203863 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e40a8a50 con 0x7f53fc15d350 2024-05-30T06:57:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.231+0000 7f53fbe00640 1 -- 172.21.15.37:0/1493203863 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e40a8e20 con 0x7f53fc15d350 2024-05-30T06:57:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.231+0000 7f5403800640 1 -- 172.21.15.37:0/1493203863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53fc15d350 msgr2=0x7f53fc160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.231+0000 7f5403800640 1 --2- 172.21.15.37:0/1493203863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53fc15d350 0x7f53fc160280 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009870 tx=0x7f53e401ed50 comp rx=0 tx=0).stop 2024-05-30T06:57:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.231+0000 7f5403800640 1 -- 172.21.15.37:0/1493203863 shutdown_connections 2024-05-30T06:57:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.231+0000 7f5403800640 1 --2- 172.21.15.37:0/1493203863 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53fc15d350 0x7f53fc160280 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.231+0000 7f5403800640 1 --2- 172.21.15.37:0/1493203863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53fc0b59d0 0x7f53fc0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.231+0000 7f5403800640 1 -- 172.21.15.37:0/1493203863 >> 172.21.15.37:0/1493203863 conn(0x7f53fc06bf60 msgr2=0x7f53fc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.231+0000 7f5403800640 1 -- 172.21.15.37:0/1493203863 shutdown_connections 2024-05-30T06:57:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.231+0000 7f5403800640 1 -- 172.21.15.37:0/1493203863 wait complete. 2024-05-30T06:57:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5403800640 1 Processor -- start 2024-05-30T06:57:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5403800640 1 -- start start 2024-05-30T06:57:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5403800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53fc0b59d0 0x7f53fc1572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5403800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53fc15d350 0x7f53fc0b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5403800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53fc15d7b0 0x7f53fc156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5403800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc13fe60 con 0x7f53fc15d350 2024-05-30T06:57:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5403800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc13fce0 con 0x7f53fc0b59d0 2024-05-30T06:57:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5403800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f53fc0aff20 con 0x7f53fc15d7b0 2024-05-30T06:57:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f53f3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53fc15d350 0x7f53fc0b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f53f3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53fc15d350 0x7f53fc0b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46446/0 (socket says 172.21.15.37:46446) 2024-05-30T06:57:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f53f3e00640 1 -- 172.21.15.37:0/3063404210 learned_addr learned my addr 172.21.15.37:0/3063404210 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5400e00640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53fc0b59d0 0x7f53fc1572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5401800640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53fc15d7b0 0x7f53fc156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f53f3e00640 1 -- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53fc15d7b0 msgr2=0x7f53fc156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f53f3e00640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53fc15d7b0 0x7f53fc156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f53f3e00640 1 -- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53fc0b59d0 msgr2=0x7f53fc1572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f53f3e00640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53fc0b59d0 0x7f53fc1572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f53f3e00640 1 -- 172.21.15.37:0/3063404210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc159bc0 con 0x7f53fc15d350 2024-05-30T06:57:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5400e00640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53fc0b59d0 0x7f53fc1572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f53f3e00640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53fc15d350 0x7f53fc0b1800 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f53e40b3040 tx=0x7f53e401baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f53f9600640 1 -- 172.21.15.37:0/3063404210 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e40b5040 con 0x7f53fc15d350 2024-05-30T06:57:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f53f9600640 1 -- 172.21.15.37:0/3063404210 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e40be070 con 0x7f53fc15d350 2024-05-30T06:57:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5403800640 1 -- 172.21.15.37:0/3063404210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53fc159ea0 con 0x7f53fc15d350 2024-05-30T06:57:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f53f9600640 1 -- 172.21.15.37:0/3063404210 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e40b0dd0 con 0x7f53fc15d350 2024-05-30T06:57:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5403800640 1 -- 172.21.15.37:0/3063404210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53fc157800 con 0x7f53fc15d350 2024-05-30T06:57:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.235+0000 7f5403800640 1 -- 172.21.15.37:0/3063404210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53fc068bc0 con 0x7f53fc15d350 2024-05-30T06:57:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.239+0000 7f53f9600640 1 -- 172.21.15.37:0/3063404210 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f53e40c3460 con 0x7f53fc15d350 2024-05-30T06:57:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.239+0000 7f53f9600640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f53d8069bb0 0x7f53d806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.239+0000 7f53f9600640 1 -- 172.21.15.37:0/3063404210 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 4999+0+0 (secure 0 0 0) 0x7f53e4123140 con 0x7f53fc15d350 2024-05-30T06:57:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.239+0000 7f5400e00640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f53d8069bb0 0x7f53d806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:14.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.239+0000 7f5400e00640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f53d8069bb0 0x7f53d806c070 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009b10 tx=0x7f53ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.243+0000 7f53f9600640 1 -- 172.21.15.37:0/3063404210 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f53e40188b0 con 0x7f53fc15d350 2024-05-30T06:57:14.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:14.419+0000 7f5403800640 1 -- 172.21.15.37:0/3063404210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f53fc15c8d0 con 0x7f53fc15d350 2024-05-30T06:57:15.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.023+0000 7f53f9600640 1 -- 172.21.15.37:0/3063404210 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v108) ==== 97+0+0 (secure 0 0 0) 0x7f53e40f5160 con 0x7f53fc15d350 2024-05-30T06:57:15.025 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-30T06:57:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.023+0000 7f5403800640 1 -- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f53d8069bb0 msgr2=0x7f53d806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.023+0000 7f5403800640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f53d8069bb0 0x7f53d806c070 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009b10 tx=0x7f53ec008040 comp rx=0 tx=0).stop 2024-05-30T06:57:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.023+0000 7f5403800640 1 -- 172.21.15.37:0/3063404210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53fc15d350 msgr2=0x7f53fc0b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.023+0000 7f5403800640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53fc15d350 0x7f53fc0b1800 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f53e40b3040 tx=0x7f53e401baf0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.023+0000 7f5403800640 1 -- 172.21.15.37:0/3063404210 shutdown_connections 2024-05-30T06:57:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.023+0000 7f5403800640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f53fc15d7b0 0x7f53fc156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.023+0000 7f5403800640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53fc15d350 0x7f53fc0b1800 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.023+0000 7f5403800640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f53d8069bb0 0x7f53d806c070 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.023+0000 7f5403800640 1 --2- 172.21.15.37:0/3063404210 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f53fc0b59d0 0x7f53fc1572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.023+0000 7f5403800640 1 -- 172.21.15.37:0/3063404210 >> 172.21.15.37:0/3063404210 conn(0x7f53fc06bf60 msgr2=0x7f53fc071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:15.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.023+0000 7f5403800640 1 -- 172.21.15.37:0/3063404210 shutdown_connections 2024-05-30T06:57:15.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.023+0000 7f5403800640 1 -- 172.21.15.37:0/3063404210 wait complete. 2024-05-30T06:57:15.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T06:57:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb38ea00640 1 Processor -- start 2024-05-30T06:57:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb38ea00640 1 -- start start 2024-05-30T06:57:15.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb38ea00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb3880b3b50 0x7fb38809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb38ea00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3880d1550 con 0x7fb388161fa0 2024-05-30T06:57:15.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb38ea00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3880cd660 con 0x7fb388162380 2024-05-30T06:57:15.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb38ea00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb3880cdcb0 con 0x7fb3880b3b50 2024-05-30T06:57:15.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb387e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb388161fa0 0x7fb38806ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48926/0 (socket says 172.21.15.37:48926) 2024-05-30T06:57:15.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb387e00640 1 -- 172.21.15.37:0/3923857860 learned_addr learned my addr 172.21.15.37:0/3923857860 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:15.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb38ca00640 1 --2- 172.21.15.37:0/3923857860 >> v2:172.21.15.105:3300/0 conn(0x7fb3880b3b50 0x7fb38809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb387400640 1 -- 172.21.15.37:0/3923857860 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1983658910 0 0) 0x7fb3880d1550 con 0x7fb388161fa0 2024-05-30T06:57:15.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb387400640 1 -- 172.21.15.37:0/3923857860 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb36c003530 con 0x7fb388161fa0 2024-05-30T06:57:15.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb387400640 1 -- 172.21.15.37:0/3923857860 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2661170127 0 0) 0x7fb3880cd660 con 0x7fb388162380 2024-05-30T06:57:15.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb387400640 1 -- 172.21.15.37:0/3923857860 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3880d1550 con 0x7fb388162380 2024-05-30T06:57:15.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb38ca00640 1 -- 172.21.15.37:0/3923857860 >> v1:172.21.15.105:6789/0 conn(0x7fb388162380 legacy=0x7fb3880d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb38ca00640 1 -- 172.21.15.37:0/3923857860 >> v1:172.21.15.37:6789/0 conn(0x7fb388161fa0 legacy=0x7fb38806ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb387400640 1 -- 172.21.15.37:0/3923857860 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 752186211 0 0) 0x7fb36c003530 con 0x7fb388161fa0 2024-05-30T06:57:15.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.191+0000 7fb38ca00640 1 -- 172.21.15.37:0/3923857860 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3880cd940 con 0x7fb3880b3b50 2024-05-30T06:57:15.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.195+0000 7fb38ca00640 1 --2- 172.21.15.37:0/3923857860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3880b3b50 0x7fb38809aa60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb3800097c0 tx=0x7fb38001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd24f3ef95852295 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.195+0000 7fb387400640 1 -- 172.21.15.37:0/3923857860 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3800b5070 con 0x7fb3880b3b50 2024-05-30T06:57:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.195+0000 7fb387400640 1 -- 172.21.15.37:0/3923857860 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3800a8990 con 0x7fb3880b3b50 2024-05-30T06:57:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.195+0000 7fb387400640 1 -- 172.21.15.37:0/3923857860 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3800a8d60 con 0x7fb3880b3b50 2024-05-30T06:57:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.195+0000 7fb38ea00640 1 -- 172.21.15.37:0/3923857860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3880b3b50 msgr2=0x7fb38809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.195+0000 7fb38ea00640 1 --2- 172.21.15.37:0/3923857860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3880b3b50 0x7fb38809aa60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb3800097c0 tx=0x7fb38001ec90 comp rx=0 tx=0).stop 2024-05-30T06:57:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.195+0000 7fb38ea00640 1 -- 172.21.15.37:0/3923857860 shutdown_connections 2024-05-30T06:57:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.195+0000 7fb38ea00640 1 --2- 172.21.15.37:0/3923857860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3880b3b50 0x7fb38809aa60 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.195+0000 7fb38ea00640 1 -- 172.21.15.37:0/3923857860 >> 172.21.15.37:0/3923857860 conn(0x7fb3880b4160 msgr2=0x7fb3880b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.195+0000 7fb38ea00640 1 -- 172.21.15.37:0/3923857860 shutdown_connections 2024-05-30T06:57:15.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.195+0000 7fb38ea00640 1 -- 172.21.15.37:0/3923857860 wait complete. 2024-05-30T06:57:15.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb38ea00640 1 Processor -- start 2024-05-30T06:57:15.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb38ea00640 1 -- start start 2024-05-30T06:57:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb38ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3880b3b50 0x7fb388154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb38ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb388161fa0 0x7fb38815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb38ea00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb388162380 0x7fb3881488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb38ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb38809b120 con 0x7fb3880b3b50 2024-05-30T06:57:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb38ea00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb38809afa0 con 0x7fb388162380 2024-05-30T06:57:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb38ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb38809b2a0 con 0x7fb388161fa0 2024-05-30T06:57:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb387e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3880b3b50 0x7fb388154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb387e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3880b3b50 0x7fb388154e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46450/0 (socket says 172.21.15.37:46450) 2024-05-30T06:57:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb387e00640 1 -- 172.21.15.37:0/469727149 learned_addr learned my addr 172.21.15.37:0/469727149 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb38ca00640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb388162380 0x7fb3881488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb387e00640 1 -- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb388161fa0 msgr2=0x7fb38815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb37f400640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb388161fa0 0x7fb38815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb387e00640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb388161fa0 0x7fb38815abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb387e00640 1 -- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb388162380 msgr2=0x7fb3881488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb387e00640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb388162380 0x7fb3881488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb387e00640 1 -- 172.21.15.37:0/469727149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38815b330 con 0x7fb3880b3b50 2024-05-30T06:57:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb38ca00640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb388162380 0x7fb3881488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb37f400640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb388161fa0 0x7fb38815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb387e00640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3880b3b50 0x7fb388154e60 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fb37800c470 tx=0x7fb37800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb384c00640 1 -- 172.21.15.37:0/469727149 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb378017070 con 0x7fb3880b3b50 2024-05-30T06:57:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb384c00640 1 -- 172.21.15.37:0/469727149 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb378005cf0 con 0x7fb3880b3b50 2024-05-30T06:57:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb384c00640 1 -- 172.21.15.37:0/469727149 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb378007290 con 0x7fb3880b3b50 2024-05-30T06:57:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb38ea00640 1 -- 172.21.15.37:0/469727149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb38815b610 con 0x7fb3880b3b50 2024-05-30T06:57:15.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.199+0000 7fb38ea00640 1 -- 172.21.15.37:0/469727149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb38815bbd0 con 0x7fb3880b3b50 2024-05-30T06:57:15.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.203+0000 7fb38ea00640 1 -- 172.21.15.37:0/469727149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb388069570 con 0x7fb3880b3b50 2024-05-30T06:57:15.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.203+0000 7fb384c00640 1 -- 172.21.15.37:0/469727149 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fb37801a070 con 0x7fb3880b3b50 2024-05-30T06:57:15.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.203+0000 7fb384c00640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb364069bb0 0x7fb36406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.203+0000 7fb384c00640 1 -- 172.21.15.37:0/469727149 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4913+0+0 (secure 0 0 0) 0x7fb378084be0 con 0x7fb3880b3b50 2024-05-30T06:57:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.203+0000 7fb37f400640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb364069bb0 0x7fb36406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.203+0000 7fb37f400640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb364069bb0 0x7fb36406c070 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb38814c4b0 tx=0x7fb370009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:15.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.207+0000 7fb384c00640 1 -- 172.21.15.37:0/469727149 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb378056c00 con 0x7fb3880b3b50 2024-05-30T06:57:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.431+0000 7fb38ea00640 1 -- 172.21.15.37:0/469727149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb388068b20 con 0x7fb3880b3b50 2024-05-30T06:57:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.431+0000 7fb384c00640 1 -- 172.21.15.37:0/469727149 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7fb378056500 con 0x7fb3880b3b50 2024-05-30T06:57:15.436 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:15.436 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:57:15.436 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-30T06:57:15.436 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.436 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-30T06:57:15.436 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmcRfnBBAAk60J/SRTolMhKoS8b8A9jQ==", 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmzScrERAAbIJ5somf+sguc6jEuR04zg==", 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:57:15.437 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:57:15.438 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.438 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.438 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.438 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-30T06:57:15.438 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm2jEhDBAAGKUYGtJznRYpt1LHlMOTrw==", 2024-05-30T06:57:15.438 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.438 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:57:15.438 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:57:15.438 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:57:15.438 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.438 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.439 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.439 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-30T06:57:15.439 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm95RdGBAAaaaNAKnr4Dtmu+L1NaMVbw==", 2024-05-30T06:57:15.439 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.439 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:57:15.439 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:57:15.439 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:57:15.439 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.439 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.439 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCFH1hmygxjHhAA1ee1eBP6dvsC0K9w+6d0OQ==", 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCIH1hmNJsBKRAAhns5CNodS7CKFU1Jg3PFCA==", 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:57:15.440 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:57:15.441 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.441 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.441 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.441 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-30T06:57:15.441 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCLH1hmlx5FNBAAn2Iann8U/uTZy0tFcFx04w==", 2024-05-30T06:57:15.441 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.441 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:57:15.441 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:57:15.441 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.441 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.442 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.442 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-30T06:57:15.442 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCPH1hmxJnxAhAAt5cEb3YVLDhkQD5WjLQuog==", 2024-05-30T06:57:15.442 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.442 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:57:15.442 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:57:15.442 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.442 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.442 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.442 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-30T06:57:15.442 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCUH1hmEn5cOBAAFzBuH8TO418e4obqTNeIXg==", 2024-05-30T06:57:15.442 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.443 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:57:15.443 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:57:15.443 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.443 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.443 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.443 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-30T06:57:15.443 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCYH1hmij3RCBAAHzQPoM1ClYGGEt6ly6ZrqQ==", 2024-05-30T06:57:15.443 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.443 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:57:15.443 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:57:15.444 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.444 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.444 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.444 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-30T06:57:15.444 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCbH1hmDqdpERAA46/Bs4B/xVjviQ1gNpNaaw==", 2024-05-30T06:57:15.444 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.444 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:57:15.444 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:57:15.444 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.444 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.444 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCeH1hmnrfVHRAAlqk48vSVw45YDCXWWb/MUA==", 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A==", 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:57:15.445 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2024-05-30T06:57:15.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T06:57:15.446 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.446 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.446 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-30T06:57:15.446 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmf8sdJhAATAP7EzLJxXXnXeEQL9fdpw==", 2024-05-30T06:57:15.446 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.446 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:57:15.446 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:57:15.446 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:57:15.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:57:15.446 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.447 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.447 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-30T06:57:15.447 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm1qB9IhAAszAwOgm2Igb1DM4diPC7ow==", 2024-05-30T06:57:15.447 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.447 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:57:15.447 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:57:15.447 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:57:15.447 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:57:15.447 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.447 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.447 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-30T06:57:15.448 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmY6AULBAAYNza0fpC3KO69ulNQaSldQ==", 2024-05-30T06:57:15.448 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.448 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:57:15.448 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:57:15.448 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:57:15.448 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:57:15.448 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.448 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.448 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-30T06:57:15.448 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmbSCrJBAAhn69RBUeyuaAMWiB3o7ByQ==", 2024-05-30T06:57:15.448 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.448 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:57:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:57:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:57:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-30T06:57:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmN/fjABAAdldbCncRiHy6RFEF9H7gnQ==", 2024-05-30T06:57:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:57:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:57:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:57:15.450 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:15.450 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-30T06:57:15.450 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmNdeSOBAA3V4vK0bNlWFoosV41f/ASQ==", 2024-05-30T06:57:15.450 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:57:15.450 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:57:15.450 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:57:15.450 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:57:15.450 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.450 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:15.450 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-30T06:57:15.450 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:57:15.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.435+0000 7fb38ea00640 1 -- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb364069bb0 msgr2=0x7fb36406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.435+0000 7fb38ea00640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb364069bb0 0x7fb36406c070 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb38814c4b0 tx=0x7fb370009040 comp rx=0 tx=0).stop 2024-05-30T06:57:15.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.435+0000 7fb38ea00640 1 -- 172.21.15.37:0/469727149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3880b3b50 msgr2=0x7fb388154e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.435+0000 7fb38ea00640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3880b3b50 0x7fb388154e60 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fb37800c470 tx=0x7fb37800c930 comp rx=0 tx=0).stop 2024-05-30T06:57:15.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.435+0000 7fb38ea00640 1 -- 172.21.15.37:0/469727149 shutdown_connections 2024-05-30T06:57:15.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.435+0000 7fb38ea00640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb364069bb0 0x7fb36406c070 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.435+0000 7fb38ea00640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb388162380 0x7fb3881488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.435+0000 7fb38ea00640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb388161fa0 0x7fb38815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.435+0000 7fb38ea00640 1 --2- 172.21.15.37:0/469727149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3880b3b50 0x7fb388154e60 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.435+0000 7fb38ea00640 1 -- 172.21.15.37:0/469727149 >> 172.21.15.37:0/469727149 conn(0x7fb3880b4160 msgr2=0x7fb388071880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:15.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.435+0000 7fb38ea00640 1 -- 172.21.15.37:0/469727149 shutdown_connections 2024-05-30T06:57:15.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.435+0000 7fb38ea00640 1 -- 172.21.15.37:0/469727149 wait complete. 2024-05-30T06:57:15.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:57:15.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fddef000640 1 Processor -- start 2024-05-30T06:57:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fddef000640 1 -- start start 2024-05-30T06:57:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fddef000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdde809aa60 0x7fdde809b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fddef000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdde80b1ed0 0x7fdde80cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fddef000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdde809bce0 con 0x7fdde80b35d0 2024-05-30T06:57:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fddef000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdde80d0380 con 0x7fdde80b1ed0 2024-05-30T06:57:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fddef000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdde80d0660 con 0x7fdde809aa60 2024-05-30T06:57:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fdde7400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdde80b35d0 0x7fdde809ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48938/0 (socket says 172.21.15.37:48938) 2024-05-30T06:57:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fdde7400640 1 -- 172.21.15.37:0/2762907023 learned_addr learned my addr 172.21.15.37:0/2762907023 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fdde7e00640 1 --2- 172.21.15.37:0/2762907023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdde809aa60 0x7fdde809b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fdded000640 1 --2- 172.21.15.37:0/2762907023 >> v2:172.21.15.105:3300/0 conn(0x7fdde80b1ed0 0x7fdde80cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fdde6a00640 1 -- 172.21.15.37:0/2762907023 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166004947 0 0) 0x7fddd4001120 con 0x7fdde80b35d0 2024-05-30T06:57:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fdde6a00640 1 -- 172.21.15.37:0/2762907023 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddcc003530 con 0x7fdde80b35d0 2024-05-30T06:57:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fdde7e00640 1 -- 172.21.15.37:0/2762907023 >> v2:172.21.15.105:3300/0 conn(0x7fdde80b1ed0 msgr2=0x7fdde80cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fdde7e00640 1 --2- 172.21.15.37:0/2762907023 >> v2:172.21.15.105:3300/0 conn(0x7fdde80b1ed0 0x7fdde80cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.595+0000 7fdde7e00640 1 -- 172.21.15.37:0/2762907023 >> v1:172.21.15.37:6789/0 conn(0x7fdde80b35d0 legacy=0x7fdde809ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fdde7e00640 1 -- 172.21.15.37:0/2762907023 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde80d0940 con 0x7fdde809aa60 2024-05-30T06:57:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fdded000640 1 --2- 172.21.15.37:0/2762907023 >> v2:172.21.15.105:3300/0 conn(0x7fdde80b1ed0 0x7fdde80cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:15.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fdde7e00640 1 --2- 172.21.15.37:0/2762907023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdde809aa60 0x7fdde809b7a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fddd80097c0 tx=0x7fddd801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79e9f1bc74551b49 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fdde6a00640 1 -- 172.21.15.37:0/2762907023 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd80b1070 con 0x7fdde809aa60 2024-05-30T06:57:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fdde6a00640 1 -- 172.21.15.37:0/2762907023 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd80a8050 con 0x7fdde809aa60 2024-05-30T06:57:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fdde6a00640 1 -- 172.21.15.37:0/2762907023 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd80ac860 con 0x7fdde809aa60 2024-05-30T06:57:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fddef000640 1 -- 172.21.15.37:0/2762907023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdde809aa60 msgr2=0x7fdde809b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fddef000640 1 --2- 172.21.15.37:0/2762907023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdde809aa60 0x7fdde809b7a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fddd80097c0 tx=0x7fddd801c3e0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fddef000640 1 -- 172.21.15.37:0/2762907023 shutdown_connections 2024-05-30T06:57:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fddef000640 1 --2- 172.21.15.37:0/2762907023 >> v2:172.21.15.105:3300/0 conn(0x7fdde80b1ed0 0x7fdde80cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fddef000640 1 --2- 172.21.15.37:0/2762907023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdde809aa60 0x7fdde809b7a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fddef000640 1 -- 172.21.15.37:0/2762907023 >> 172.21.15.37:0/2762907023 conn(0x7fdde80b4100 msgr2=0x7fdde80b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fddef000640 1 -- 172.21.15.37:0/2762907023 shutdown_connections 2024-05-30T06:57:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.599+0000 7fddef000640 1 -- 172.21.15.37:0/2762907023 wait complete. 2024-05-30T06:57:15.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fddef000640 1 Processor -- start 2024-05-30T06:57:15.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fddef000640 1 -- start start 2024-05-30T06:57:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fddef000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdde809aa60 0x7fdde8159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fddef000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde80b1ed0 0x7fdde809c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fddef000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdde80b35d0 0x7fdde815c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fddef000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdde80b3330 con 0x7fdde80b1ed0 2024-05-30T06:57:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fddef000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdde80b31b0 con 0x7fdde809aa60 2024-05-30T06:57:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fddef000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdde816a1e0 con 0x7fdde80b35d0 2024-05-30T06:57:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdde7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde80b1ed0 0x7fdde809c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdde7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde80b1ed0 0x7fdde809c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46452/0 (socket says 172.21.15.37:46452) 2024-05-30T06:57:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdde7400640 1 -- 172.21.15.37:0/3764070386 learned_addr learned my addr 172.21.15.37:0/3764070386 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdde7e00640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdde809aa60 0x7fdde8159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdded000640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdde80b35d0 0x7fdde815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdde7400640 1 -- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdde80b35d0 msgr2=0x7fdde815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdde7400640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdde80b35d0 0x7fdde815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdde7400640 1 -- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdde809aa60 msgr2=0x7fdde8159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdde7400640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdde809aa60 0x7fdde8159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdde7400640 1 -- 172.21.15.37:0/3764070386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde815b8e0 con 0x7fdde80b1ed0 2024-05-30T06:57:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdde7400640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde80b1ed0 0x7fdde809c4b0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c3f0 tx=0x7fddd400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdddfe00640 1 -- 172.21.15.37:0/3764070386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4017070 con 0x7fdde80b1ed0 2024-05-30T06:57:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdddfe00640 1 -- 172.21.15.37:0/3764070386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd4005cf0 con 0x7fdde80b1ed0 2024-05-30T06:57:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fddef000640 1 -- 172.21.15.37:0/3764070386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde815bbc0 con 0x7fdde80b1ed0 2024-05-30T06:57:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fdddfe00640 1 -- 172.21.15.37:0/3764070386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd40072f0 con 0x7fdde80b1ed0 2024-05-30T06:57:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.603+0000 7fddef000640 1 -- 172.21.15.37:0/3764070386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde815c180 con 0x7fdde80b1ed0 2024-05-30T06:57:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.607+0000 7fddef000640 1 -- 172.21.15.37:0/3764070386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde8068b20 con 0x7fdde80b1ed0 2024-05-30T06:57:15.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.607+0000 7fdddfe00640 1 -- 172.21.15.37:0/3764070386 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fddd401a070 con 0x7fdde80b1ed0 2024-05-30T06:57:15.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.607+0000 7fdddfe00640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fddc8069bb0 0x7fddc806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.607+0000 7fdddfe00640 1 -- 172.21.15.37:0/3764070386 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4913+0+0 (secure 0 0 0) 0x7fddd4084a40 con 0x7fdde80b1ed0 2024-05-30T06:57:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.607+0000 7fdde7e00640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fddc8069bb0 0x7fddc806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.607+0000 7fdde7e00640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fddc8069bb0 0x7fddc806c070 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fddd80ae000 tx=0x7fddd80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:15.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.611+0000 7fdddfe00640 1 -- 172.21.15.37:0/3764070386 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fddd408c030 con 0x7fdde80b1ed0 2024-05-30T06:57:15.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.775+0000 7fddef000640 1 -- 172.21.15.37:0/3764070386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdde80b8590 con 0x7fdde80b1ed0 2024-05-30T06:57:15.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.779+0000 7fdddfe00640 1 -- 172.21.15.37:0/3764070386 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) ==== 74+0+12977 (secure 0 0 0) 0x7fdde809bce0 con 0x7fdde80b1ed0 2024-05-30T06:57:15.782 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:15.782 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":110,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:57:15.036930+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:57:15.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.779+0000 7fddef000640 1 -- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fddc8069bb0 msgr2=0x7fddc806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.779+0000 7fddef000640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fddc8069bb0 0x7fddc806c070 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fddd80ae000 tx=0x7fddd80a7000 comp rx=0 tx=0).stop 2024-05-30T06:57:15.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.779+0000 7fddef000640 1 -- 172.21.15.37:0/3764070386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde80b1ed0 msgr2=0x7fdde809c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.779+0000 7fddef000640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde80b1ed0 0x7fdde809c4b0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c3f0 tx=0x7fddd400c8b0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.779+0000 7fddef000640 1 -- 172.21.15.37:0/3764070386 shutdown_connections 2024-05-30T06:57:15.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.779+0000 7fddef000640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdde80b35d0 0x7fdde815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.779+0000 7fddef000640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdde80b1ed0 0x7fdde809c4b0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.779+0000 7fddef000640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fddc8069bb0 0x7fddc806c070 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.779+0000 7fddef000640 1 --2- 172.21.15.37:0/3764070386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdde809aa60 0x7fdde8159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.779+0000 7fddef000640 1 -- 172.21.15.37:0/3764070386 >> 172.21.15.37:0/3764070386 conn(0x7fdde80b4100 msgr2=0x7fdde80af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:15.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.779+0000 7fddef000640 1 -- 172.21.15.37:0/3764070386 shutdown_connections 2024-05-30T06:57:15.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.779+0000 7fddef000640 1 -- 172.21.15.37:0/3764070386 wait complete. 2024-05-30T06:57:15.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:57:15.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:57:15.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6663c00640 1 Processor -- start 2024-05-30T06:57:15.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6663c00640 1 -- start start 2024-05-30T06:57:15.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6663c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f665c148520 0x7f665c15fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6663c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f665c0aeda0 0x7f665c0b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6663c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f665c0af5d0 con 0x7f665c0b5930 2024-05-30T06:57:15.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6663c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f665c0b5d80 con 0x7f665c148520 2024-05-30T06:57:15.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6663c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f665c0af8b0 con 0x7f665c0aeda0 2024-05-30T06:57:15.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6661200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f665c148520 0x7f665c15fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6661200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f665c148520 0x7f665c15fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46454/0 (socket says 172.21.15.37:46454) 2024-05-30T06:57:15.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6661200640 1 -- 172.21.15.37:0/2405738376 learned_addr learned my addr 172.21.15.37:0/2405738376 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:15.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6653e00640 1 --2- 172.21.15.37:0/2405738376 >> v2:172.21.15.105:3300/0 conn(0x7f665c0aeda0 0x7f665c0b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6661200640 1 -- 172.21.15.37:0/2405738376 >> v2:172.21.15.105:3300/0 conn(0x7f665c0aeda0 msgr2=0x7f665c0b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6661200640 1 --2- 172.21.15.37:0/2405738376 >> v2:172.21.15.105:3300/0 conn(0x7f665c0aeda0 0x7f665c0b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.943+0000 7f6661200640 1 -- 172.21.15.37:0/2405738376 >> v1:172.21.15.105:6789/0 conn(0x7f665c0b5930 legacy=0x7f665c162530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.947+0000 7f6661200640 1 -- 172.21.15.37:0/2405738376 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c0afb90 con 0x7f665c148520 2024-05-30T06:57:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.947+0000 7f6661200640 1 --2- 172.21.15.37:0/2405738376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c148520 0x7f665c15fa30 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f665c06cad0 tx=0x7f664c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcd5ef7f4f824f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.947+0000 7f665be00640 1 -- 172.21.15.37:0/2405738376 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c0aa610 con 0x7f665c148520 2024-05-30T06:57:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.947+0000 7f665be00640 1 -- 172.21.15.37:0/2405738376 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c0af070 con 0x7f665c148520 2024-05-30T06:57:15.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.947+0000 7f665be00640 1 -- 172.21.15.37:0/2405738376 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c0aa9d0 con 0x7f665c148520 2024-05-30T06:57:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.947+0000 7f6663c00640 1 -- 172.21.15.37:0/2405738376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c148520 msgr2=0x7f665c15fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.947+0000 7f6663c00640 1 --2- 172.21.15.37:0/2405738376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c148520 0x7f665c15fa30 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f665c06cad0 tx=0x7f664c01c4b0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.947+0000 7f6663c00640 1 -- 172.21.15.37:0/2405738376 shutdown_connections 2024-05-30T06:57:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.947+0000 7f6663c00640 1 --2- 172.21.15.37:0/2405738376 >> v2:172.21.15.105:3300/0 conn(0x7f665c0aeda0 0x7f665c0b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.947+0000 7f6663c00640 1 --2- 172.21.15.37:0/2405738376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c148520 0x7f665c15fa30 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.947+0000 7f6663c00640 1 -- 172.21.15.37:0/2405738376 >> 172.21.15.37:0/2405738376 conn(0x7f665c06b960 msgr2=0x7f665c06bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.947+0000 7f6663c00640 1 -- 172.21.15.37:0/2405738376 shutdown_connections 2024-05-30T06:57:15.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.947+0000 7f6663c00640 1 -- 172.21.15.37:0/2405738376 wait complete. 2024-05-30T06:57:15.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6663c00640 1 Processor -- start 2024-05-30T06:57:15.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6663c00640 1 -- start start 2024-05-30T06:57:15.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6663c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665c0aeda0 0x7f665c147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6663c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c0b5930 0x7f665c13bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6663c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665c148520 0x7f665c13c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6663c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f665c16ba50 con 0x7f665c0b5930 2024-05-30T06:57:15.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6663c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f665c16b8d0 con 0x7f665c0aeda0 2024-05-30T06:57:15.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6663c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f665c16bbd0 con 0x7f665c148520 2024-05-30T06:57:15.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6653e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c0b5930 0x7f665c13bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6653e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c0b5930 0x7f665c13bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46466/0 (socket says 172.21.15.37:46466) 2024-05-30T06:57:15.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6653e00640 1 -- 172.21.15.37:0/3108740346 learned_addr learned my addr 172.21.15.37:0/3108740346 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:15.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6653e00640 1 -- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665c148520 msgr2=0x7f665c13c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6653e00640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665c148520 0x7f665c13c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6653e00640 1 -- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665c0aeda0 msgr2=0x7f665c147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:15.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6661200640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665c0aeda0 0x7f665c147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6653e00640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665c0aeda0 0x7f665c147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:15.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6653e00640 1 -- 172.21.15.37:0/3108740346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c0ceba0 con 0x7f665c0b5930 2024-05-30T06:57:15.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6661200640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665c0aeda0 0x7f665c147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:15.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6653e00640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c0b5930 0x7f665c13bf80 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f664400d800 tx=0x7f664400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:15.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6659600640 1 -- 172.21.15.37:0/3108740346 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664400b6c0 con 0x7f665c0b5930 2024-05-30T06:57:15.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6659600640 1 -- 172.21.15.37:0/3108740346 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6644019070 con 0x7f665c0b5930 2024-05-30T06:57:15.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6659600640 1 -- 172.21.15.37:0/3108740346 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664400ba60 con 0x7f665c0b5930 2024-05-30T06:57:15.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6663c00640 1 -- 172.21.15.37:0/3108740346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665c159820 con 0x7f665c0b5930 2024-05-30T06:57:15.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.951+0000 7f6663c00640 1 -- 172.21.15.37:0/3108740346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665c159de0 con 0x7f665c0b5930 2024-05-30T06:57:15.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.955+0000 7f6663c00640 1 -- 172.21.15.37:0/3108740346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f665c068bc0 con 0x7f665c0b5930 2024-05-30T06:57:15.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.955+0000 7f6659600640 1 -- 172.21.15.37:0/3108740346 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f664400bc00 con 0x7f665c0b5930 2024-05-30T06:57:15.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.955+0000 7f6659600640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6638069bb0 0x7f663806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:15.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.955+0000 7f6659600640 1 -- 172.21.15.37:0/3108740346 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4913+0+0 (secure 0 0 0) 0x7f6644085ce0 con 0x7f665c0b5930 2024-05-30T06:57:15.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.955+0000 7f6661200640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6638069bb0 0x7f663806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:15.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.955+0000 7f6661200640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6638069bb0 0x7f663806c070 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f664c0ae000 tx=0x7f664c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:15.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:15.959+0000 7f6659600640 1 -- 172.21.15.37:0/3108740346 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6644057d00 con 0x7f665c0b5930 2024-05-30T06:57:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.127+0000 7f6663c00640 1 -- 172.21.15.37:0/3108740346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f665c0b4ee0 con 0x7f665c0b5930 2024-05-30T06:57:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.127+0000 7f6659600640 1 -- 172.21.15.37:0/3108740346 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) ==== 93+0+10 (secure 0 0 0) 0x7f6644057600 con 0x7f665c0b5930 2024-05-30T06:57:16.132 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:57:16.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.131+0000 7f6663c00640 1 -- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6638069bb0 msgr2=0x7f663806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:16.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.131+0000 7f6663c00640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6638069bb0 0x7f663806c070 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f664c0ae000 tx=0x7f664c008040 comp rx=0 tx=0).stop 2024-05-30T06:57:16.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.131+0000 7f6663c00640 1 -- 172.21.15.37:0/3108740346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c0b5930 msgr2=0x7f665c13bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.131+0000 7f6663c00640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c0b5930 0x7f665c13bf80 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f664400d800 tx=0x7f664400dcc0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.131+0000 7f6663c00640 1 -- 172.21.15.37:0/3108740346 shutdown_connections 2024-05-30T06:57:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.131+0000 7f6663c00640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665c148520 0x7f665c13c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.131+0000 7f6663c00640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f665c0b5930 0x7f665c13bf80 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.131+0000 7f6663c00640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6638069bb0 0x7f663806c070 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.131+0000 7f6663c00640 1 --2- 172.21.15.37:0/3108740346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665c0aeda0 0x7f665c147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.131+0000 7f6663c00640 1 -- 172.21.15.37:0/3108740346 >> 172.21.15.37:0/3108740346 conn(0x7f665c06b960 msgr2=0x7f665c15e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.131+0000 7f6663c00640 1 -- 172.21.15.37:0/3108740346 shutdown_connections 2024-05-30T06:57:16.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.131+0000 7f6663c00640 1 -- 172.21.15.37:0/3108740346 wait complete. 2024-05-30T06:57:16.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T06:57:16.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc79ea00640 1 Processor -- start 2024-05-30T06:57:16.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc79ea00640 1 -- start start 2024-05-30T06:57:16.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc79ea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7981482d0 0x7fc7980b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:16.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc79ea00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc7980af690 0x7fc79815ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:16.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc79ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc79815eed0 0x7fc79815f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:16.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc79ea00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc79806e860 con 0x7fc7981482d0 2024-05-30T06:57:16.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc79ea00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc798160440 con 0x7fc7980af690 2024-05-30T06:57:16.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc79ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc79815f8a0 con 0x7fc79815eed0 2024-05-30T06:57:16.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc797e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7981482d0 0x7fc7980b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:16.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc797e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7981482d0 0x7fc7980b2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46478/0 (socket says 172.21.15.37:46478) 2024-05-30T06:57:16.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc797e00640 1 -- 172.21.15.37:0/1869110717 learned_addr learned my addr 172.21.15.37:0/1869110717 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:16.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc79ca00640 1 --2- 172.21.15.37:0/1869110717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc79815eed0 0x7fc79815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:16.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc78fe00640 1 --2- 172.21.15.37:0/1869110717 >> v2:172.21.15.105:3300/0 conn(0x7fc7980af690 0x7fc79815ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:16.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc797e00640 1 -- 172.21.15.37:0/1869110717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc79815eed0 msgr2=0x7fc79815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:16.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc797e00640 1 --2- 172.21.15.37:0/1869110717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc79815eed0 0x7fc79815f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc797e00640 1 -- 172.21.15.37:0/1869110717 >> v2:172.21.15.105:3300/0 conn(0x7fc7980af690 msgr2=0x7fc79815ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:16.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc797e00640 1 --2- 172.21.15.37:0/1869110717 >> v2:172.21.15.105:3300/0 conn(0x7fc7980af690 0x7fc79815ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.291+0000 7fc797e00640 1 -- 172.21.15.37:0/1869110717 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7980afe30 con 0x7fc7981482d0 2024-05-30T06:57:16.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.295+0000 7fc797e00640 1 --2- 172.21.15.37:0/1869110717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7981482d0 0x7fc7980b2ec0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fc7980b5b70 tx=0x7fc78801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0276bfd57ab55c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:16.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.295+0000 7fc797400640 1 -- 172.21.15.37:0/1869110717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7880b0070 con 0x7fc7981482d0 2024-05-30T06:57:16.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.295+0000 7fc797400640 1 -- 172.21.15.37:0/1869110717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7880ab600 con 0x7fc7981482d0 2024-05-30T06:57:16.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.295+0000 7fc797400640 1 -- 172.21.15.37:0/1869110717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7880ab9d0 con 0x7fc7981482d0 2024-05-30T06:57:16.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.295+0000 7fc79ea00640 1 -- 172.21.15.37:0/1869110717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7981482d0 msgr2=0x7fc7980b2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:16.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.295+0000 7fc79ea00640 1 --2- 172.21.15.37:0/1869110717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7981482d0 0x7fc7980b2ec0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fc7980b5b70 tx=0x7fc78801c490 comp rx=0 tx=0).stop 2024-05-30T06:57:16.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.295+0000 7fc79ea00640 1 -- 172.21.15.37:0/1869110717 shutdown_connections 2024-05-30T06:57:16.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.295+0000 7fc79ea00640 1 --2- 172.21.15.37:0/1869110717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc79815eed0 0x7fc79815f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.295+0000 7fc79ea00640 1 --2- 172.21.15.37:0/1869110717 >> v2:172.21.15.105:3300/0 conn(0x7fc7980af690 0x7fc79815ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.295+0000 7fc79ea00640 1 --2- 172.21.15.37:0/1869110717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7981482d0 0x7fc7980b2ec0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.295+0000 7fc79ea00640 1 -- 172.21.15.37:0/1869110717 >> 172.21.15.37:0/1869110717 conn(0x7fc7980b23a0 msgr2=0x7fc7980b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:16.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.295+0000 7fc79ea00640 1 -- 172.21.15.37:0/1869110717 shutdown_connections 2024-05-30T06:57:16.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.295+0000 7fc79ea00640 1 -- 172.21.15.37:0/1869110717 wait complete. 2024-05-30T06:57:16.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ea00640 1 Processor -- start 2024-05-30T06:57:16.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ea00640 1 -- start start 2024-05-30T06:57:16.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7980af690 0x7fc79813eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:16.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ea00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7981482d0 0x7fc798145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:16.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79815eed0 0x7fc7980cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:16.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc79806f680 con 0x7fc79815eed0 2024-05-30T06:57:16.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ea00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc79806f500 con 0x7fc7981482d0 2024-05-30T06:57:16.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc79806f800 con 0x7fc7980af690 2024-05-30T06:57:16.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79815eed0 0x7fc7980cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:16.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79815eed0 0x7fc7980cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46480/0 (socket says 172.21.15.37:46480) 2024-05-30T06:57:16.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ca00640 1 -- 172.21.15.37:0/2058363215 learned_addr learned my addr 172.21.15.37:0/2058363215 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:16.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc78fe00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7981482d0 0x7fc798145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:16.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc797e00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7980af690 0x7fc79813eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:16.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ca00640 1 -- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7980af690 msgr2=0x7fc79813eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:16.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ca00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7980af690 0x7fc79813eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ca00640 1 -- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7981482d0 msgr2=0x7fc798145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:16.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ca00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7981482d0 0x7fc798145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ca00640 1 -- 172.21.15.37:0/2058363215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7981428a0 con 0x7fc79815eed0 2024-05-30T06:57:16.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ca00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79815eed0 0x7fc7980cde00 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fc790007e40 tx=0x7fc79000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:16.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc794c00640 1 -- 172.21.15.37:0/2058363215 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc790014620 con 0x7fc79815eed0 2024-05-30T06:57:16.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc794c00640 1 -- 172.21.15.37:0/2058363215 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc790019070 con 0x7fc79815eed0 2024-05-30T06:57:16.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ea00640 1 -- 172.21.15.37:0/2058363215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc79813ddc0 con 0x7fc79815eed0 2024-05-30T06:57:16.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc794c00640 1 -- 172.21.15.37:0/2058363215 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc790014a20 con 0x7fc79815eed0 2024-05-30T06:57:16.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.299+0000 7fc79ea00640 1 -- 172.21.15.37:0/2058363215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc79813e340 con 0x7fc79815eed0 2024-05-30T06:57:16.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.303+0000 7fc79ea00640 1 -- 172.21.15.37:0/2058363215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc798068b20 con 0x7fc79815eed0 2024-05-30T06:57:16.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.303+0000 7fc794c00640 1 -- 172.21.15.37:0/2058363215 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fc790014bc0 con 0x7fc79815eed0 2024-05-30T06:57:16.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.303+0000 7fc794c00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc774069bb0 0x7fc77406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:16.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.303+0000 7fc794c00640 1 -- 172.21.15.37:0/2058363215 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4913+0+0 (secure 0 0 0) 0x7fc790085f30 con 0x7fc79815eed0 2024-05-30T06:57:16.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.303+0000 7fc797e00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc774069bb0 0x7fc77406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:16.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.303+0000 7fc797e00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc774069bb0 0x7fc77406c070 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc7980b01e0 tx=0x7fc788009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:16.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.307+0000 7fc794c00640 1 -- 172.21.15.37:0/2058363215 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc790057900 con 0x7fc79815eed0 2024-05-30T06:57:16.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.479+0000 7fc79ea00640 1 -- 172.21.15.37:0/2058363215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc798072fb0 con 0x7fc79815eed0 2024-05-30T06:57:16.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.483+0000 7fc794c00640 1 -- 172.21.15.37:0/2058363215 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v110) ==== 84+0+65 (secure 0 0 0) 0x7fc79005bc00 con 0x7fc79815eed0 2024-05-30T06:57:16.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:57:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-30T06:57:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-30T06:57:16.486 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:57:16.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.483+0000 7fc79ea00640 1 -- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc774069bb0 msgr2=0x7fc77406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:16.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.483+0000 7fc79ea00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc774069bb0 0x7fc77406c070 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc7980b01e0 tx=0x7fc788009040 comp rx=0 tx=0).stop 2024-05-30T06:57:16.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.483+0000 7fc79ea00640 1 -- 172.21.15.37:0/2058363215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79815eed0 msgr2=0x7fc7980cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:16.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.483+0000 7fc79ea00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79815eed0 0x7fc7980cde00 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fc790007e40 tx=0x7fc79000e4b0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.483+0000 7fc79ea00640 1 -- 172.21.15.37:0/2058363215 shutdown_connections 2024-05-30T06:57:16.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.483+0000 7fc79ea00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc79815eed0 0x7fc7980cde00 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.483+0000 7fc79ea00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc774069bb0 0x7fc77406c070 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.483+0000 7fc79ea00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7981482d0 0x7fc798145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.483+0000 7fc79ea00640 1 --2- 172.21.15.37:0/2058363215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7980af690 0x7fc79813eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.483+0000 7fc79ea00640 1 -- 172.21.15.37:0/2058363215 >> 172.21.15.37:0/2058363215 conn(0x7fc7980b23a0 msgr2=0x7fc7980b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.483+0000 7fc79ea00640 1 -- 172.21.15.37:0/2058363215 shutdown_connections 2024-05-30T06:57:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.483+0000 7fc79ea00640 1 -- 172.21.15.37:0/2058363215 wait complete. 2024-05-30T06:57:16.506 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T06:57:16.506 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T06:57:16.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.647+0000 7fec6b000640 1 Processor -- start 2024-05-30T06:57:16.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.647+0000 7fec6b000640 1 -- start start 2024-05-30T06:57:16.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.647+0000 7fec6b000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fec641590c0 0x7fec640cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:16.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.647+0000 7fec6b000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec640cd400 0x7fec640b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.647+0000 7fec6b000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec6415f230 con 0x7fec640cde60 2024-05-30T06:57:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.647+0000 7fec6b000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fec6415f510 con 0x7fec641590c0 2024-05-30T06:57:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.647+0000 7fec6b000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fec6415f7f0 con 0x7fec640cd400 2024-05-30T06:57:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.647+0000 7fec63e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fec641590c0 0x7fec640cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.647+0000 7fec5b400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fec640cde60 0x7fec6406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48950/0 (socket says 172.21.15.37:48950) 2024-05-30T06:57:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.647+0000 7fec5b400640 1 -- 172.21.15.37:0/3982911167 learned_addr learned my addr 172.21.15.37:0/3982911167 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:16.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.647+0000 7fec69000640 1 --2- 172.21.15.37:0/3982911167 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec640cd400 0x7fec640b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec63e00640 1 -- 172.21.15.37:0/3982911167 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec640cd400 msgr2=0x7fec640b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec63e00640 1 --2- 172.21.15.37:0/3982911167 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec640cd400 0x7fec640b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec63e00640 1 -- 172.21.15.37:0/3982911167 >> v1:172.21.15.37:6789/0 conn(0x7fec640cde60 legacy=0x7fec6406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec63e00640 1 -- 172.21.15.37:0/3982911167 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6415fad0 con 0x7fec641590c0 2024-05-30T06:57:16.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec63400640 1 -- 172.21.15.37:0/3982911167 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089271470 0 0) 0x7fec6415f230 con 0x7fec640cde60 2024-05-30T06:57:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec63e00640 1 --2- 172.21.15.37:0/3982911167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec641590c0 0x7fec640cd920 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fec540097c0 tx=0x7fec5401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570bd76438a61070 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec63400640 1 -- 172.21.15.37:0/3982911167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec540b0070 con 0x7fec641590c0 2024-05-30T06:57:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec63400640 1 -- 172.21.15.37:0/3982911167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec540ab600 con 0x7fec641590c0 2024-05-30T06:57:16.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec63400640 1 -- 172.21.15.37:0/3982911167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec540ab9d0 con 0x7fec641590c0 2024-05-30T06:57:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec6b000640 1 -- 172.21.15.37:0/3982911167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec641590c0 msgr2=0x7fec640cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec6b000640 1 --2- 172.21.15.37:0/3982911167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec641590c0 0x7fec640cd920 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fec540097c0 tx=0x7fec5401c410 comp rx=0 tx=0).stop 2024-05-30T06:57:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec6b000640 1 -- 172.21.15.37:0/3982911167 shutdown_connections 2024-05-30T06:57:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec6b000640 1 --2- 172.21.15.37:0/3982911167 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec640cd400 0x7fec640b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec6b000640 1 --2- 172.21.15.37:0/3982911167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec641590c0 0x7fec640cd920 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec6b000640 1 -- 172.21.15.37:0/3982911167 >> 172.21.15.37:0/3982911167 conn(0x7fec6406bf60 msgr2=0x7fec640b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.651+0000 7fec6b000640 1 -- 172.21.15.37:0/3982911167 shutdown_connections 2024-05-30T06:57:16.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec6b000640 1 -- 172.21.15.37:0/3982911167 wait complete. 2024-05-30T06:57:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec6b000640 1 Processor -- start 2024-05-30T06:57:16.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec6b000640 1 -- start start 2024-05-30T06:57:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec6b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec640cd400 0x7fec64136e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec6b000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec640cde60 0x7fec6415bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec6b000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec641590c0 0x7fec64150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec6b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec6406f770 con 0x7fec640cd400 2024-05-30T06:57:16.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec6b000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec640b46b0 con 0x7fec641590c0 2024-05-30T06:57:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec6b000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fec6406f8f0 con 0x7fec640cde60 2024-05-30T06:57:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec63e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec640cd400 0x7fec64136e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec63e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec640cd400 0x7fec64136e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46492/0 (socket says 172.21.15.37:46492) 2024-05-30T06:57:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec63e00640 1 -- 172.21.15.37:0/1273048718 learned_addr learned my addr 172.21.15.37:0/1273048718 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec69000640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec641590c0 0x7fec64150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec5b400640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec640cde60 0x7fec6415bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec63e00640 1 -- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec640cde60 msgr2=0x7fec6415bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec63e00640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec640cde60 0x7fec6415bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec63e00640 1 -- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec641590c0 msgr2=0x7fec64150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec63e00640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec641590c0 0x7fec64150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec63e00640 1 -- 172.21.15.37:0/1273048718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec64137390 con 0x7fec640cd400 2024-05-30T06:57:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec69000640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec641590c0 0x7fec64150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:16.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec63e00640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec640cd400 0x7fec64136e50 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fec5401a040 tx=0x7fec5401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec60c00640 1 -- 172.21.15.37:0/1273048718 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec540b0050 con 0x7fec640cd400 2024-05-30T06:57:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec60c00640 1 -- 172.21.15.37:0/1273048718 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec540bc070 con 0x7fec640cd400 2024-05-30T06:57:16.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec6b000640 1 -- 172.21.15.37:0/1273048718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6414a000 con 0x7fec640cd400 2024-05-30T06:57:16.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.655+0000 7fec60c00640 1 -- 172.21.15.37:0/1273048718 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec540b5830 con 0x7fec640cd400 2024-05-30T06:57:16.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.659+0000 7fec6b000640 1 -- 172.21.15.37:0/1273048718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec6414a5c0 con 0x7fec640cd400 2024-05-30T06:57:16.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.659+0000 7fec6b000640 1 -- 172.21.15.37:0/1273048718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec64068d40 con 0x7fec640cd400 2024-05-30T06:57:16.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.659+0000 7fec60c00640 1 -- 172.21.15.37:0/1273048718 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fec540b59d0 con 0x7fec640cd400 2024-05-30T06:57:16.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.659+0000 7fec60c00640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec40069be0 0x7fec4006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:16.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.659+0000 7fec60c00640 1 -- 172.21.15.37:0/1273048718 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4913+0+0 (secure 0 0 0) 0x7fec5411ff50 con 0x7fec640cd400 2024-05-30T06:57:16.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.659+0000 7fec5b400640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec40069be0 0x7fec4006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:16.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.663+0000 7fec5b400640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec40069be0 0x7fec4006c0a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fec6415b7f0 tx=0x7fec4c007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:16.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.663+0000 7fec60c00640 1 -- 172.21.15.37:0/1273048718 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fec54016090 con 0x7fec640cd400 2024-05-30T06:57:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:16.831+0000 7fec6b000640 1 -- 172.21.15.37:0/1273048718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fec6415e970 con 0x7fec640cd400 2024-05-30T06:57:17.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.031+0000 7fec60c00640 1 -- 172.21.15.37:0/1273048718 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v111) ==== 138+0+0 (secure 0 0 0) 0x7fec540f2090 con 0x7fec640cd400 2024-05-30T06:57:17.034 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-30T06:57:17.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.035+0000 7fec6b000640 1 -- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec40069be0 msgr2=0x7fec4006c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:17.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.035+0000 7fec6b000640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec40069be0 0x7fec4006c0a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fec6415b7f0 tx=0x7fec4c007b60 comp rx=0 tx=0).stop 2024-05-30T06:57:17.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.035+0000 7fec6b000640 1 -- 172.21.15.37:0/1273048718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec640cd400 msgr2=0x7fec64136e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:17.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.035+0000 7fec6b000640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec640cd400 0x7fec64136e50 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fec5401a040 tx=0x7fec5401ac50 comp rx=0 tx=0).stop 2024-05-30T06:57:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.035+0000 7fec6b000640 1 -- 172.21.15.37:0/1273048718 shutdown_connections 2024-05-30T06:57:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.035+0000 7fec6b000640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec40069be0 0x7fec4006c0a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.035+0000 7fec6b000640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec641590c0 0x7fec64150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.035+0000 7fec6b000640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec640cde60 0x7fec6415bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.035+0000 7fec6b000640 1 --2- 172.21.15.37:0/1273048718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec640cd400 0x7fec64136e50 secure :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fec5401a040 tx=0x7fec5401ac50 comp rx=0 tx=0).stop 2024-05-30T06:57:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.035+0000 7fec6b000640 1 -- 172.21.15.37:0/1273048718 >> 172.21.15.37:0/1273048718 conn(0x7fec6406bf60 msgr2=0x7fec6406ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.035+0000 7fec6b000640 1 -- 172.21.15.37:0/1273048718 shutdown_connections 2024-05-30T06:57:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.035+0000 7fec6b000640 1 -- 172.21.15.37:0/1273048718 wait complete. 2024-05-30T06:57:17.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T06:57:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a77000640 1 Processor -- start 2024-05-30T06:57:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a77000640 1 -- start start 2024-05-30T06:57:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a77000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a7015e8b0 0x7f1a700cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a77000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1a7006d200 0x7f1a7006d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a77000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a70163350 con 0x7f1a7009aa60 2024-05-30T06:57:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a77000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7006db80 con 0x7f1a7015e8b0 2024-05-30T06:57:17.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a77000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1a700cfb30 con 0x7f1a7006d200 2024-05-30T06:57:17.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a6fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a7015e8b0 0x7f1a700cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:17.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a75000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1a7009aa60 0x7f1a7009ae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48956/0 (socket says 172.21.15.37:48956) 2024-05-30T06:57:17.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a75000640 1 -- 172.21.15.37:0/606394327 learned_addr learned my addr 172.21.15.37:0/606394327 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:17.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a6f400640 1 --2- 172.21.15.37:0/606394327 >> v2:172.21.15.105:3300/0 conn(0x7f1a7006d200 0x7f1a7006d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:17.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a6ea00640 1 -- 172.21.15.37:0/606394327 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 411565298 0 0) 0x7f1a70163350 con 0x7f1a7009aa60 2024-05-30T06:57:17.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a6ea00640 1 -- 172.21.15.37:0/606394327 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a54003530 con 0x7f1a7009aa60 2024-05-30T06:57:17.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a6fe00640 1 -- 172.21.15.37:0/606394327 >> v2:172.21.15.105:3300/0 conn(0x7f1a7006d200 msgr2=0x7f1a7006d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:17.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a6fe00640 1 --2- 172.21.15.37:0/606394327 >> v2:172.21.15.105:3300/0 conn(0x7f1a7006d200 0x7f1a7006d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:17.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a6fe00640 1 -- 172.21.15.37:0/606394327 >> v1:172.21.15.37:6789/0 conn(0x7f1a7009aa60 legacy=0x7f1a7009ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:17.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.207+0000 7f1a6fe00640 1 -- 172.21.15.37:0/606394327 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a701627d0 con 0x7f1a7015e8b0 2024-05-30T06:57:17.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.211+0000 7f1a6fe00640 1 --2- 172.21.15.37:0/606394327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a7015e8b0 0x7f1a700cf5f0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f1a700d25b0 tx=0x7f1a6001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf0fbab84743fa2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:17.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.211+0000 7f1a6ea00640 1 -- 172.21.15.37:0/606394327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a600b0070 con 0x7f1a7015e8b0 2024-05-30T06:57:17.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.211+0000 7f1a6ea00640 1 -- 172.21.15.37:0/606394327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a600ab600 con 0x7f1a7015e8b0 2024-05-30T06:57:17.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.211+0000 7f1a6ea00640 1 -- 172.21.15.37:0/606394327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a600ab9d0 con 0x7f1a7015e8b0 2024-05-30T06:57:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.211+0000 7f1a77000640 1 -- 172.21.15.37:0/606394327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a7015e8b0 msgr2=0x7f1a700cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.211+0000 7f1a77000640 1 --2- 172.21.15.37:0/606394327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a7015e8b0 0x7f1a700cf5f0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f1a700d25b0 tx=0x7f1a6001c480 comp rx=0 tx=0).stop 2024-05-30T06:57:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.211+0000 7f1a77000640 1 -- 172.21.15.37:0/606394327 shutdown_connections 2024-05-30T06:57:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.211+0000 7f1a77000640 1 --2- 172.21.15.37:0/606394327 >> v2:172.21.15.105:3300/0 conn(0x7f1a7006d200 0x7f1a7006d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.211+0000 7f1a77000640 1 --2- 172.21.15.37:0/606394327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a7015e8b0 0x7f1a700cf5f0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.211+0000 7f1a77000640 1 -- 172.21.15.37:0/606394327 >> 172.21.15.37:0/606394327 conn(0x7f1a700b4130 msgr2=0x7f1a700b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.211+0000 7f1a77000640 1 -- 172.21.15.37:0/606394327 shutdown_connections 2024-05-30T06:57:17.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.211+0000 7f1a77000640 1 -- 172.21.15.37:0/606394327 wait complete. 2024-05-30T06:57:17.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a77000640 1 Processor -- start 2024-05-30T06:57:17.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a77000640 1 -- start start 2024-05-30T06:57:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a77000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a7006d200 0x7f1a700c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a77000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a7009aa60 0x7f1a700c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a77000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a7015e8b0 0x7f1a700ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a77000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a70162480 con 0x7f1a7009aa60 2024-05-30T06:57:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a77000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7015ec90 con 0x7f1a7006d200 2024-05-30T06:57:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a77000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1a700cf050 con 0x7f1a7015e8b0 2024-05-30T06:57:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a6f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a7009aa60 0x7f1a700c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a6f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a7009aa60 0x7f1a700c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46510/0 (socket says 172.21.15.37:46510) 2024-05-30T06:57:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a6f400640 1 -- 172.21.15.37:0/2162958739 learned_addr learned my addr 172.21.15.37:0/2162958739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a6fe00640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a7006d200 0x7f1a700c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a75000640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a7015e8b0 0x7f1a700ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a6f400640 1 -- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a7015e8b0 msgr2=0x7f1a700ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a6f400640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a7015e8b0 0x7f1a700ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a6f400640 1 -- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a7006d200 msgr2=0x7f1a700c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a6f400640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a7006d200 0x7f1a700c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a6f400640 1 -- 172.21.15.37:0/2162958739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a700c7220 con 0x7f1a7009aa60 2024-05-30T06:57:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a6fe00640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a7006d200 0x7f1a700c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:57:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a6f400640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a7009aa60 0x7f1a700c9c80 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00e870 tx=0x7f1a5c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a67e00640 1 -- 172.21.15.37:0/2162958739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c017070 con 0x7f1a7009aa60 2024-05-30T06:57:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a67e00640 1 -- 172.21.15.37:0/2162958739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5c00c940 con 0x7f1a7009aa60 2024-05-30T06:57:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a77000640 1 -- 172.21.15.37:0/2162958739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a700c7500 con 0x7f1a7009aa60 2024-05-30T06:57:17.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a67e00640 1 -- 172.21.15.37:0/2162958739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00ccf0 con 0x7f1a7009aa60 2024-05-30T06:57:17.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.215+0000 7f1a77000640 1 -- 172.21.15.37:0/2162958739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a700c7ac0 con 0x7f1a7009aa60 2024-05-30T06:57:17.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.219+0000 7f1a77000640 1 -- 172.21.15.37:0/2162958739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a70068bc0 con 0x7f1a7009aa60 2024-05-30T06:57:17.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.219+0000 7f1a67e00640 1 -- 172.21.15.37:0/2162958739 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f1a5c01a070 con 0x7f1a7009aa60 2024-05-30T06:57:17.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.219+0000 7f1a67e00640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a50069bb0 0x7f1a5006c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:17.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.219+0000 7f1a67e00640 1 -- 172.21.15.37:0/2162958739 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5283+0+0 (secure 0 0 0) 0x7f1a5c085d00 con 0x7f1a7009aa60 2024-05-30T06:57:17.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.219+0000 7f1a6fe00640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a50069bb0 0x7f1a5006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:17.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.223+0000 7f1a6fe00640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a50069bb0 0x7f1a5006c070 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1a600ad000 tx=0x7f1a60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.223+0000 7f1a67e00640 1 -- 172.21.15.37:0/2162958739 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1a5c057810 con 0x7f1a7009aa60 2024-05-30T06:57:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:17.391+0000 7f1a77000640 1 -- 172.21.15.37:0/2162958739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1a700b46b0 con 0x7f1a7009aa60 2024-05-30T06:57:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.035+0000 7f1a67e00640 1 -- 172.21.15.37:0/2162958739 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v112) ==== 170+0+0 (secure 0 0 0) 0x7f1a5c05bb10 con 0x7f1a7009aa60 2024-05-30T06:57:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-30T06:57:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.039+0000 7f1a77000640 1 -- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a50069bb0 msgr2=0x7f1a5006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.039+0000 7f1a77000640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a50069bb0 0x7f1a5006c070 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1a600ad000 tx=0x7f1a60008040 comp rx=0 tx=0).stop 2024-05-30T06:57:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.039+0000 7f1a77000640 1 -- 172.21.15.37:0/2162958739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a7009aa60 msgr2=0x7f1a700c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.039+0000 7f1a77000640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a7009aa60 0x7f1a700c9c80 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00e870 tx=0x7f1a5c00ec70 comp rx=0 tx=0).stop 2024-05-30T06:57:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.039+0000 7f1a77000640 1 -- 172.21.15.37:0/2162958739 shutdown_connections 2024-05-30T06:57:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.039+0000 7f1a77000640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a7015e8b0 0x7f1a700ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.039+0000 7f1a77000640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a7009aa60 0x7f1a700c9c80 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.039+0000 7f1a77000640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1a50069bb0 0x7f1a5006c070 secure :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1a600ad000 tx=0x7f1a60008040 comp rx=0 tx=0).stop 2024-05-30T06:57:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.039+0000 7f1a77000640 1 --2- 172.21.15.37:0/2162958739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a7006d200 0x7f1a700c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.039+0000 7f1a77000640 1 -- 172.21.15.37:0/2162958739 >> 172.21.15.37:0/2162958739 conn(0x7f1a700b4130 msgr2=0x7f1a700702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.039+0000 7f1a77000640 1 -- 172.21.15.37:0/2162958739 shutdown_connections 2024-05-30T06:57:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.039+0000 7f1a77000640 1 -- 172.21.15.37:0/2162958739 wait complete. 2024-05-30T06:57:18.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T06:57:18.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.227+0000 7ff753800640 1 Processor -- start 2024-05-30T06:57:18.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.227+0000 7ff753800640 1 -- start start 2024-05-30T06:57:18.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.227+0000 7ff753800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff74c06f770 0x7ff74c166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:18.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.227+0000 7ff753800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff74c15f310 con 0x7ff74c0cd440 2024-05-30T06:57:18.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.227+0000 7ff753800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff74c15f5f0 con 0x7ff74c155da0 2024-05-30T06:57:18.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.227+0000 7ff753800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff74c0b4760 con 0x7ff74c06f770 2024-05-30T06:57:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.227+0000 7ff743e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff74c0cd440 0x7ff74c06f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39770/0 (socket says 172.21.15.37:39770) 2024-05-30T06:57:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.227+0000 7ff743e00640 1 -- 172.21.15.37:0/1245277208 learned_addr learned my addr 172.21.15.37:0/1245277208 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.227+0000 7ff751800640 1 --2- 172.21.15.37:0/1245277208 >> v2:172.21.15.105:3300/0 conn(0x7ff74c06f770 0x7ff74c166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.227+0000 7ff74be00640 1 -- 172.21.15.37:0/1245277208 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2992227075 0 0) 0x7ff74c15f310 con 0x7ff74c0cd440 2024-05-30T06:57:18.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff74be00640 1 -- 172.21.15.37:0/1245277208 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff730005740 con 0x7ff74c0cd440 2024-05-30T06:57:18.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff751800640 1 -- 172.21.15.37:0/1245277208 >> v1:172.21.15.105:6789/0 conn(0x7ff74c155da0 legacy=0x7ff74c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:18.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff74be00640 1 -- 172.21.15.37:0/1245277208 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2780283270 0 0) 0x7ff74c15f5f0 con 0x7ff74c155da0 2024-05-30T06:57:18.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff751800640 1 -- 172.21.15.37:0/1245277208 >> v1:172.21.15.37:6789/0 conn(0x7ff74c0cd440 legacy=0x7ff74c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:18.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff751800640 1 -- 172.21.15.37:0/1245277208 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74c15f8d0 con 0x7ff74c06f770 2024-05-30T06:57:18.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff751800640 1 --2- 172.21.15.37:0/1245277208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c06f770 0x7ff74c166570 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff744009d90 tx=0x7ff74401c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7ba2b145fdebb13 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:18.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff74be00640 1 -- 172.21.15.37:0/1245277208 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7440a6620 con 0x7ff74c06f770 2024-05-30T06:57:18.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff74be00640 1 -- 172.21.15.37:0/1245277208 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7440a67c0 con 0x7ff74c06f770 2024-05-30T06:57:18.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff74be00640 1 -- 172.21.15.37:0/1245277208 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7440a6b70 con 0x7ff74c06f770 2024-05-30T06:57:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff753800640 1 -- 172.21.15.37:0/1245277208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c06f770 msgr2=0x7ff74c166570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff753800640 1 --2- 172.21.15.37:0/1245277208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c06f770 0x7ff74c166570 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff744009d90 tx=0x7ff74401c850 comp rx=0 tx=0).stop 2024-05-30T06:57:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff753800640 1 -- 172.21.15.37:0/1245277208 shutdown_connections 2024-05-30T06:57:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff753800640 1 --2- 172.21.15.37:0/1245277208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c06f770 0x7ff74c166570 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.231+0000 7ff753800640 1 -- 172.21.15.37:0/1245277208 >> 172.21.15.37:0/1245277208 conn(0x7ff74c06bf60 msgr2=0x7ff74c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff753800640 1 -- 172.21.15.37:0/1245277208 shutdown_connections 2024-05-30T06:57:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff753800640 1 -- 172.21.15.37:0/1245277208 wait complete. 2024-05-30T06:57:18.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff753800640 1 Processor -- start 2024-05-30T06:57:18.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff753800640 1 -- start start 2024-05-30T06:57:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff753800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c06f770 0x7ff74c156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff753800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c155da0 0x7ff74c164710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff753800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c164c50 0x7ff74c15db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:18.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff753800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c06eb30 con 0x7ff74c06f770 2024-05-30T06:57:18.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff753800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff74c06e9b0 con 0x7ff74c164c50 2024-05-30T06:57:18.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff753800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff74c06ecb0 con 0x7ff74c155da0 2024-05-30T06:57:18.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff750e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c06f770 0x7ff74c156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:18.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff750e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c06f770 0x7ff74c156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55928/0 (socket says 172.21.15.37:55928) 2024-05-30T06:57:18.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff750e00640 1 -- 172.21.15.37:0/2412899956 learned_addr learned my addr 172.21.15.37:0/2412899956 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:18.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff743e00640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c155da0 0x7ff74c164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:18.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff751800640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c164c50 0x7ff74c15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:18.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff750e00640 1 -- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c155da0 msgr2=0x7ff74c164710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:18.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff750e00640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c155da0 0x7ff74c164710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:18.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff750e00640 1 -- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c164c50 msgr2=0x7ff74c15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:18.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff750e00640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c164c50 0x7ff74c15db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:18.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff750e00640 1 -- 172.21.15.37:0/2412899956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff74c158f30 con 0x7ff74c06f770 2024-05-30T06:57:18.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff750e00640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c06f770 0x7ff74c156c90 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c4b0 tx=0x7ff73c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:18.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff749600640 1 -- 172.21.15.37:0/2412899956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c005480 con 0x7ff74c06f770 2024-05-30T06:57:18.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff749600640 1 -- 172.21.15.37:0/2412899956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff73c003600 con 0x7ff74c06f770 2024-05-30T06:57:18.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.235+0000 7ff749600640 1 -- 172.21.15.37:0/2412899956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0039f0 con 0x7ff74c06f770 2024-05-30T06:57:18.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.239+0000 7ff753800640 1 -- 172.21.15.37:0/2412899956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff74c157410 con 0x7ff74c06f770 2024-05-30T06:57:18.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.239+0000 7ff753800640 1 -- 172.21.15.37:0/2412899956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff74c15d390 con 0x7ff74c06f770 2024-05-30T06:57:18.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.239+0000 7ff753800640 1 -- 172.21.15.37:0/2412899956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff74c068bc0 con 0x7ff74c06f770 2024-05-30T06:57:18.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.239+0000 7ff749600640 1 -- 172.21.15.37:0/2412899956 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7ff73c003b90 con 0x7ff74c06f770 2024-05-30T06:57:18.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.239+0000 7ff749600640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff728069bb0 0x7ff72806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:18.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.243+0000 7ff749600640 1 -- 172.21.15.37:0/2412899956 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5665+0+0 (secure 0 0 0) 0x7ff73c085da0 con 0x7ff74c06f770 2024-05-30T06:57:18.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.243+0000 7ff743e00640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff728069bb0 0x7ff72806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.243+0000 7ff743e00640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff728069bb0 0x7ff72806c070 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff734007fd0 tx=0x7ff734009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:18.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.243+0000 7ff749600640 1 -- 172.21.15.37:0/2412899956 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff73c0577f0 con 0x7ff74c06f770 2024-05-30T06:57:18.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:18.447+0000 7ff753800640 1 -- 172.21.15.37:0/2412899956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff74c0b6790 con 0x7ff74c06f770 2024-05-30T06:57:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.055+0000 7ff749600640 1 -- 172.21.15.37:0/2412899956 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v70) ==== 174+0+0 (secure 0 0 0) 0x7ff73c05baf0 con 0x7ff74c06f770 2024-05-30T06:57:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 16 and data pool 17 2024-05-30T06:57:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.059+0000 7ff753800640 1 -- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff728069bb0 msgr2=0x7ff72806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.059+0000 7ff753800640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff728069bb0 0x7ff72806c070 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff734007fd0 tx=0x7ff734009040 comp rx=0 tx=0).stop 2024-05-30T06:57:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.059+0000 7ff753800640 1 -- 172.21.15.37:0/2412899956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c06f770 msgr2=0x7ff74c156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.059+0000 7ff753800640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c06f770 0x7ff74c156c90 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c4b0 tx=0x7ff73c00c970 comp rx=0 tx=0).stop 2024-05-30T06:57:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.063+0000 7ff753800640 1 -- 172.21.15.37:0/2412899956 shutdown_connections 2024-05-30T06:57:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.063+0000 7ff753800640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff728069bb0 0x7ff72806c070 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.063+0000 7ff753800640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff74c164c50 0x7ff74c15db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.063+0000 7ff753800640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff74c155da0 0x7ff74c164710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.063+0000 7ff753800640 1 --2- 172.21.15.37:0/2412899956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff74c06f770 0x7ff74c156c90 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.063+0000 7ff753800640 1 -- 172.21.15.37:0/2412899956 >> 172.21.15.37:0/2412899956 conn(0x7ff74c06bf60 msgr2=0x7ff74c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.067+0000 7ff753800640 1 -- 172.21.15.37:0/2412899956 shutdown_connections 2024-05-30T06:57:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.067+0000 7ff753800640 1 -- 172.21.15.37:0/2412899956 wait complete. 2024-05-30T06:57:19.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:57:19.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.243+0000 7f52f5600640 1 Processor -- start 2024-05-30T06:57:19.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52f5600640 1 -- start start 2024-05-30T06:57:19.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52f5600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f0160b90 0x7f52f009aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52f5600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52f0160ff0 0x7f52f009afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52f5600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f00d0430 con 0x7f52f00b2e20 2024-05-30T06:57:19.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52f5600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f52f00b3200 con 0x7f52f0160ff0 2024-05-30T06:57:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52f5600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f52f00d01e0 con 0x7f52f0160b90 2024-05-30T06:57:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52ef400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52f0160ff0 0x7f52f009afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52eea00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f52f00b2e20 0x7f52f0160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39780/0 (socket says 172.21.15.37:39780) 2024-05-30T06:57:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52eea00640 1 -- 172.21.15.37:0/549752973 learned_addr learned my addr 172.21.15.37:0/549752973 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52e6000640 1 --2- 172.21.15.37:0/549752973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f0160b90 0x7f52f009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52ef400640 1 -- 172.21.15.37:0/549752973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f0160b90 msgr2=0x7f52f009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:19.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52ef400640 1 --2- 172.21.15.37:0/549752973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f0160b90 0x7f52f009aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52ef400640 1 -- 172.21.15.37:0/549752973 >> v1:172.21.15.37:6789/0 conn(0x7f52f00b2e20 legacy=0x7f52f0160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52ef400640 1 -- 172.21.15.37:0/549752973 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f00d0710 con 0x7f52f0160ff0 2024-05-30T06:57:19.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52ee000640 1 -- 172.21.15.37:0/549752973 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 456619915 0 0) 0x7f52f00d0430 con 0x7f52f00b2e20 2024-05-30T06:57:19.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.247+0000 7f52e6000640 1 --2- 172.21.15.37:0/549752973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f0160b90 0x7f52f009aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:19.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52ef400640 1 --2- 172.21.15.37:0/549752973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52f0160ff0 0x7f52f009afa0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f52e80097c0 tx=0x7f52e801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c3d946aecda0de server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:19.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52ee000640 1 -- 172.21.15.37:0/549752973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e80b2070 con 0x7f52f0160ff0 2024-05-30T06:57:19.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52ee000640 1 -- 172.21.15.37:0/549752973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e80ad640 con 0x7f52f0160ff0 2024-05-30T06:57:19.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52ee000640 1 -- 172.21.15.37:0/549752973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e80ada10 con 0x7f52f0160ff0 2024-05-30T06:57:19.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52f5600640 1 -- 172.21.15.37:0/549752973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52f0160ff0 msgr2=0x7f52f009afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52f5600640 1 --2- 172.21.15.37:0/549752973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52f0160ff0 0x7f52f009afa0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f52e80097c0 tx=0x7f52e801c4a0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52f5600640 1 -- 172.21.15.37:0/549752973 shutdown_connections 2024-05-30T06:57:19.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52f5600640 1 --2- 172.21.15.37:0/549752973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52f0160ff0 0x7f52f009afa0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52f5600640 1 --2- 172.21.15.37:0/549752973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f0160b90 0x7f52f009aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52f5600640 1 -- 172.21.15.37:0/549752973 >> 172.21.15.37:0/549752973 conn(0x7f52f00b4100 msgr2=0x7f52f00b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:19.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52f5600640 1 -- 172.21.15.37:0/549752973 shutdown_connections 2024-05-30T06:57:19.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52f5600640 1 -- 172.21.15.37:0/549752973 wait complete. 2024-05-30T06:57:19.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52f5600640 1 Processor -- start 2024-05-30T06:57:19.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.251+0000 7f52f5600640 1 -- start start 2024-05-30T06:57:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52f5600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f00b2e20 0x7f52f00c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52f5600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f0160b90 0x7f52f00c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52f5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52f0160ff0 0x7f52f014b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52f5600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52f00ce410 con 0x7f52f0160ff0 2024-05-30T06:57:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52f5600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f52f00ce290 con 0x7f52f0160b90 2024-05-30T06:57:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52f5600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f52f01697c0 con 0x7f52f00b2e20 2024-05-30T06:57:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52ef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52f0160ff0 0x7f52f014b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52ef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52f0160ff0 0x7f52f014b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55938/0 (socket says 172.21.15.37:55938) 2024-05-30T06:57:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52ef400640 1 -- 172.21.15.37:0/1579021494 learned_addr learned my addr 172.21.15.37:0/1579021494 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52eea00640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f00b2e20 0x7f52f00c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52e6000640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f0160b90 0x7f52f00c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52ef400640 1 -- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f00b2e20 msgr2=0x7f52f00c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52ef400640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f00b2e20 0x7f52f00c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52ef400640 1 -- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f0160b90 msgr2=0x7f52f00c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52ef400640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f0160b90 0x7f52f00c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52ef400640 1 -- 172.21.15.37:0/1579021494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f00c8140 con 0x7f52f0160ff0 2024-05-30T06:57:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52e6000640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f0160b90 0x7f52f00c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52eea00640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f00b2e20 0x7f52f00c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52ef400640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52f0160ff0 0x7f52f014b9c0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f52e80b0040 tx=0x7f52e8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52e7400640 1 -- 172.21.15.37:0/1579021494 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e80ba020 con 0x7f52f0160ff0 2024-05-30T06:57:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52e7400640 1 -- 172.21.15.37:0/1579021494 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e80b6410 con 0x7f52f0160ff0 2024-05-30T06:57:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52e7400640 1 -- 172.21.15.37:0/1579021494 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e80b2040 con 0x7f52f0160ff0 2024-05-30T06:57:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52f5600640 1 -- 172.21.15.37:0/1579021494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f00c6b60 con 0x7f52f0160ff0 2024-05-30T06:57:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52f5600640 1 -- 172.21.15.37:0/1579021494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f00c7120 con 0x7f52f0160ff0 2024-05-30T06:57:19.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52f5600640 1 -- 172.21.15.37:0/1579021494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f0068b20 con 0x7f52f0160ff0 2024-05-30T06:57:19.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.255+0000 7f52e7400640 1 -- 172.21.15.37:0/1579021494 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f52e80bd020 con 0x7f52f0160ff0 2024-05-30T06:57:19.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.259+0000 7f52e7400640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f52cc069bb0 0x7f52cc06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.259+0000 7f52e7400640 1 -- 172.21.15.37:0/1579021494 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5765+0+0 (secure 0 0 0) 0x7f52e811f730 con 0x7f52f0160ff0 2024-05-30T06:57:19.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.259+0000 7f52eea00640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f52cc069bb0 0x7f52cc06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.259+0000 7f52eea00640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f52cc069bb0 0x7f52cc06c070 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f52e00012f0 tx=0x7f52e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:19.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.263+0000 7f52e7400640 1 -- 172.21.15.37:0/1579021494 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f52e80c4030 con 0x7f52f0160ff0 2024-05-30T06:57:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.427+0000 7f52f5600640 1 -- 172.21.15.37:0/1579021494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52f00ce860 con 0x7f52f0160ff0 2024-05-30T06:57:19.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.431+0000 7f52e7400640 1 -- 172.21.15.37:0/1579021494 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16716 (secure 0 0 0) 0x7f52e8016090 con 0x7f52f0160ff0 2024-05-30T06:57:19.434 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:19.434 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":113,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:57:18.453256+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:57:16.849268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-05-30T06:57:17.405807+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:57:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.431+0000 7f52f5600640 1 -- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f52cc069bb0 msgr2=0x7f52cc06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.431+0000 7f52f5600640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f52cc069bb0 0x7f52cc06c070 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f52e00012f0 tx=0x7f52e0009040 comp rx=0 tx=0).stop 2024-05-30T06:57:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.431+0000 7f52f5600640 1 -- 172.21.15.37:0/1579021494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52f0160ff0 msgr2=0x7f52f014b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.431+0000 7f52f5600640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52f0160ff0 0x7f52f014b9c0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f52e80b0040 tx=0x7f52e8019240 comp rx=0 tx=0).stop 2024-05-30T06:57:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.431+0000 7f52f5600640 1 -- 172.21.15.37:0/1579021494 shutdown_connections 2024-05-30T06:57:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.431+0000 7f52f5600640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52f0160ff0 0x7f52f014b9c0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.431+0000 7f52f5600640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f52cc069bb0 0x7f52cc06c070 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.431+0000 7f52f5600640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52f0160b90 0x7f52f00c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.431+0000 7f52f5600640 1 --2- 172.21.15.37:0/1579021494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52f00b2e20 0x7f52f00c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.431+0000 7f52f5600640 1 -- 172.21.15.37:0/1579021494 >> 172.21.15.37:0/1579021494 conn(0x7f52f00b4100 msgr2=0x7f52f0166f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.431+0000 7f52f5600640 1 -- 172.21.15.37:0/1579021494 shutdown_connections 2024-05-30T06:57:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.431+0000 7f52f5600640 1 -- 172.21.15.37:0/1579021494 wait complete. 2024-05-30T06:57:19.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:57:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.591+0000 7f5da8600640 1 Processor -- start 2024-05-30T06:57:19.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.591+0000 7f5da8600640 1 -- start start 2024-05-30T06:57:19.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.591+0000 7f5da8600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5da015e930 0x7f5da009b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da8600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5da00d1240 0x7f5da01625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da8600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5da009abe0 con 0x7f5da00d1690 2024-05-30T06:57:19.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da8600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5da009bee0 con 0x7f5da015e930 2024-05-30T06:57:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da8600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5da009aec0 con 0x7f5da00d1240 2024-05-30T06:57:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da5c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5da015e930 0x7f5da009b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da6600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5da00d1690 0x7f5da00ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39784/0 (socket says 172.21.15.37:39784) 2024-05-30T06:57:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da6600640 1 -- 172.21.15.37:0/414417724 learned_addr learned my addr 172.21.15.37:0/414417724 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da5c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5da015e930 0x7f5da009b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55942/0 (socket says 172.21.15.37:55942) 2024-05-30T06:57:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da5200640 1 --2- 172.21.15.37:0/414417724 >> v2:172.21.15.105:3300/0 conn(0x7f5da00d1240 0x7f5da01625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da5c00640 1 -- 172.21.15.37:0/414417724 >> v2:172.21.15.105:3300/0 conn(0x7f5da00d1240 msgr2=0x7f5da01625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da5c00640 1 --2- 172.21.15.37:0/414417724 >> v2:172.21.15.105:3300/0 conn(0x7f5da00d1240 0x7f5da01625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da5c00640 1 -- 172.21.15.37:0/414417724 >> v1:172.21.15.37:6789/0 conn(0x7f5da00d1690 legacy=0x7f5da00ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da5c00640 1 -- 172.21.15.37:0/414417724 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da009b1a0 con 0x7f5da015e930 2024-05-30T06:57:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5da5c00640 1 --2- 172.21.15.37:0/414417724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da015e930 0x7f5da009b9a0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f5da0073320 tx=0x7f5d9401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3403ceea7bfc87f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.595+0000 7f5d9fe00640 1 -- 172.21.15.37:0/414417724 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d940b1070 con 0x7f5da015e930 2024-05-30T06:57:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5d9fe00640 1 -- 172.21.15.37:0/414417724 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d940ac5f0 con 0x7f5da015e930 2024-05-30T06:57:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5d9fe00640 1 -- 172.21.15.37:0/414417724 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d940ac9c0 con 0x7f5da015e930 2024-05-30T06:57:19.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 -- 172.21.15.37:0/414417724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da015e930 msgr2=0x7f5da009b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 --2- 172.21.15.37:0/414417724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da015e930 0x7f5da009b9a0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f5da0073320 tx=0x7f5d9401c480 comp rx=0 tx=0).stop 2024-05-30T06:57:19.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 -- 172.21.15.37:0/414417724 shutdown_connections 2024-05-30T06:57:19.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 --2- 172.21.15.37:0/414417724 >> v2:172.21.15.105:3300/0 conn(0x7f5da00d1240 0x7f5da01625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 --2- 172.21.15.37:0/414417724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da015e930 0x7f5da009b9a0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 -- 172.21.15.37:0/414417724 >> 172.21.15.37:0/414417724 conn(0x7f5da00b4100 msgr2=0x7f5da00b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:19.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 -- 172.21.15.37:0/414417724 shutdown_connections 2024-05-30T06:57:19.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 -- 172.21.15.37:0/414417724 wait complete. 2024-05-30T06:57:19.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 Processor -- start 2024-05-30T06:57:19.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 -- start start 2024-05-30T06:57:19.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da00d1240 0x7f5da00b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5da00d1690 0x7f5da00af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da015e930 0x7f5da00af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5da015ed10 con 0x7f5da00d1240 2024-05-30T06:57:19.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5da0162ef0 con 0x7f5da015e930 2024-05-30T06:57:19.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da8600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5da015ee90 con 0x7f5da00d1690 2024-05-30T06:57:19.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da5c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da00d1240 0x7f5da00b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da5c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da00d1240 0x7f5da00b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55958/0 (socket says 172.21.15.37:55958) 2024-05-30T06:57:19.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da5c00640 1 -- 172.21.15.37:0/1287494598 learned_addr learned my addr 172.21.15.37:0/1287494598 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da5200640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5da00d1690 0x7f5da00af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da6600640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da015e930 0x7f5da00af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da5c00640 1 -- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5da00d1690 msgr2=0x7f5da00af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da5c00640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5da00d1690 0x7f5da00af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da5c00640 1 -- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da015e930 msgr2=0x7f5da00af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da5c00640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da015e930 0x7f5da00af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.599+0000 7f5da5c00640 1 -- 172.21.15.37:0/1287494598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da00b5500 con 0x7f5da00d1240 2024-05-30T06:57:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.603+0000 7f5da6600640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da015e930 0x7f5da00af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.603+0000 7f5da5c00640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da00d1240 0x7f5da00b5e70 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f5d9401ab30 tx=0x7f5d94019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.603+0000 7f5d9d600640 1 -- 172.21.15.37:0/1287494598 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d940b1040 con 0x7f5da00d1240 2024-05-30T06:57:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.603+0000 7f5d9d600640 1 -- 172.21.15.37:0/1287494598 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d940bb070 con 0x7f5da00d1240 2024-05-30T06:57:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.603+0000 7f5da8600640 1 -- 172.21.15.37:0/1287494598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da00b57e0 con 0x7f5da00d1240 2024-05-30T06:57:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.603+0000 7f5d9d600640 1 -- 172.21.15.37:0/1287494598 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94006e20 con 0x7f5da00d1240 2024-05-30T06:57:19.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.603+0000 7f5da8600640 1 -- 172.21.15.37:0/1287494598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da015d230 con 0x7f5da00d1240 2024-05-30T06:57:19.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.603+0000 7f5da8600640 1 -- 172.21.15.37:0/1287494598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da0068b20 con 0x7f5da00d1240 2024-05-30T06:57:19.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.603+0000 7f5d9d600640 1 -- 172.21.15.37:0/1287494598 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f5d940b5650 con 0x7f5da00d1240 2024-05-30T06:57:19.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.603+0000 7f5d9d600640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d80069bb0 0x7f5d8006c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.603+0000 7f5d9d600640 1 -- 172.21.15.37:0/1287494598 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5765+0+0 (secure 0 0 0) 0x7f5d9411f330 con 0x7f5da00d1240 2024-05-30T06:57:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.603+0000 7f5da5200640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d80069bb0 0x7f5d8006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.607+0000 7f5da5200640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d80069bb0 0x7f5d8006c070 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5da0151bb0 tx=0x7f5d8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.607+0000 7f5d9d600640 1 -- 172.21.15.37:0/1287494598 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5d940a9070 con 0x7f5da00d1240 2024-05-30T06:57:19.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.779+0000 7f5da8600640 1 -- 172.21.15.37:0/1287494598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5da006e350 con 0x7f5da00d1240 2024-05-30T06:57:19.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.779+0000 7f5d9d600640 1 -- 172.21.15.37:0/1287494598 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16716 (secure 0 0 0) 0x7f5d94016070 con 0x7f5da00d1240 2024-05-30T06:57:19.784 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:19.784 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":113,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:57:18.453256+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:57:16.849268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-05-30T06:57:17.405807+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:57:19.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.783+0000 7f5da8600640 1 -- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d80069bb0 msgr2=0x7f5d8006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.783+0000 7f5da8600640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d80069bb0 0x7f5d8006c070 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5da0151bb0 tx=0x7f5d8c008040 comp rx=0 tx=0).stop 2024-05-30T06:57:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.783+0000 7f5da8600640 1 -- 172.21.15.37:0/1287494598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da00d1240 msgr2=0x7f5da00b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.783+0000 7f5da8600640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da00d1240 0x7f5da00b5e70 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f5d9401ab30 tx=0x7f5d94019220 comp rx=0 tx=0).stop 2024-05-30T06:57:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.783+0000 7f5da8600640 1 -- 172.21.15.37:0/1287494598 shutdown_connections 2024-05-30T06:57:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.783+0000 7f5da8600640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5d80069bb0 0x7f5d8006c070 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.783+0000 7f5da8600640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5da015e930 0x7f5da00af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.783+0000 7f5da8600640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5da00d1690 0x7f5da00af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.783+0000 7f5da8600640 1 --2- 172.21.15.37:0/1287494598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da00d1240 0x7f5da00b5e70 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.783+0000 7f5da8600640 1 -- 172.21.15.37:0/1287494598 >> 172.21.15.37:0/1287494598 conn(0x7f5da00b4100 msgr2=0x7f5da01577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.783+0000 7f5da8600640 1 -- 172.21.15.37:0/1287494598 shutdown_connections 2024-05-30T06:57:19.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.783+0000 7f5da8600640 1 -- 172.21.15.37:0/1287494598 wait complete. 2024-05-30T06:57:19.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T06:57:19.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f3414e00640 1 Processor -- start 2024-05-30T06:57:19.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f3414e00640 1 -- start start 2024-05-30T06:57:19.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f3414e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f341015ea50 0x7f34100cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f3414e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f34100cd5f0 0x7f34100b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f3414e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f341009aff0 con 0x7f34100b2b80 2024-05-30T06:57:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f3414e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f34100b0bf0 con 0x7f341015ea50 2024-05-30T06:57:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f3414e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f341006bcd0 con 0x7f34100cd5f0 2024-05-30T06:57:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f340f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f341015ea50 0x7f34100cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f340f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f341015ea50 0x7f34100cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55974/0 (socket says 172.21.15.37:55974) 2024-05-30T06:57:19.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f340f400640 1 -- 172.21.15.37:0/831499559 learned_addr learned my addr 172.21.15.37:0/831499559 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:19.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f340fe00640 1 --2- 172.21.15.37:0/831499559 >> v2:172.21.15.105:3300/0 conn(0x7f34100cd5f0 0x7f34100b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f340f400640 1 -- 172.21.15.37:0/831499559 >> v2:172.21.15.105:3300/0 conn(0x7f34100cd5f0 msgr2=0x7f34100b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:19.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f340f400640 1 --2- 172.21.15.37:0/831499559 >> v2:172.21.15.105:3300/0 conn(0x7f34100cd5f0 0x7f34100b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f340f400640 1 -- 172.21.15.37:0/831499559 >> v1:172.21.15.105:6789/0 conn(0x7f34100b2b80 legacy=0x7f34100d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:19.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f340f400640 1 -- 172.21.15.37:0/831499559 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341006bfb0 con 0x7f341015ea50 2024-05-30T06:57:19.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.947+0000 7f340fe00640 1 --2- 172.21.15.37:0/831499559 >> v2:172.21.15.105:3300/0 conn(0x7f34100cd5f0 0x7f34100b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:19.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f340f400640 1 --2- 172.21.15.37:0/831499559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f341015ea50 0x7f34100cba60 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f341006e740 tx=0x7f340001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd474003cc5df036 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:19.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f340ea00640 1 -- 172.21.15.37:0/831499559 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34000a5860 con 0x7f341015ea50 2024-05-30T06:57:19.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f340ea00640 1 -- 172.21.15.37:0/831499559 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34000a5a00 con 0x7f341015ea50 2024-05-30T06:57:19.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f340ea00640 1 -- 172.21.15.37:0/831499559 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34000a5dd0 con 0x7f341015ea50 2024-05-30T06:57:19.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f3414e00640 1 -- 172.21.15.37:0/831499559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f341015ea50 msgr2=0x7f34100cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f3414e00640 1 --2- 172.21.15.37:0/831499559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f341015ea50 0x7f34100cba60 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f341006e740 tx=0x7f340001c980 comp rx=0 tx=0).stop 2024-05-30T06:57:19.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f3414e00640 1 -- 172.21.15.37:0/831499559 shutdown_connections 2024-05-30T06:57:19.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f3414e00640 1 --2- 172.21.15.37:0/831499559 >> v2:172.21.15.105:3300/0 conn(0x7f34100cd5f0 0x7f34100b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f3414e00640 1 --2- 172.21.15.37:0/831499559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f341015ea50 0x7f34100cba60 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f3414e00640 1 -- 172.21.15.37:0/831499559 >> 172.21.15.37:0/831499559 conn(0x7f341009aa60 msgr2=0x7f34100b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:19.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f3414e00640 1 -- 172.21.15.37:0/831499559 shutdown_connections 2024-05-30T06:57:19.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f3414e00640 1 -- 172.21.15.37:0/831499559 wait complete. 2024-05-30T06:57:19.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f3414e00640 1 Processor -- start 2024-05-30T06:57:19.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.951+0000 7f3414e00640 1 -- start start 2024-05-30T06:57:19.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3414e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34100b2b80 0x7f34101535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3414e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100cd5f0 0x7f3410153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3414e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015ea50 0x7f3410154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3414e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f341016b630 con 0x7f34100cd5f0 2024-05-30T06:57:19.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3414e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f341006b960 con 0x7f34100b2b80 2024-05-30T06:57:19.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3414e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f341016b7b0 con 0x7f341015ea50 2024-05-30T06:57:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3406a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100cd5f0 0x7f3410153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3406a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100cd5f0 0x7f3410153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55980/0 (socket says 172.21.15.37:55980) 2024-05-30T06:57:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3406a00640 1 -- 172.21.15.37:0/4115452856 learned_addr learned my addr 172.21.15.37:0/4115452856 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f340f400640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34100b2b80 0x7f34101535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f340fe00640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015ea50 0x7f3410154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3406a00640 1 -- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015ea50 msgr2=0x7f3410154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3406a00640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015ea50 0x7f3410154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3406a00640 1 -- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34100b2b80 msgr2=0x7f34101535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3406a00640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34100b2b80 0x7f34101535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3406a00640 1 -- 172.21.15.37:0/4115452856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3410160ef0 con 0x7f34100cd5f0 2024-05-30T06:57:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f340fe00640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015ea50 0x7f3410154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:19.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3406a00640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100cd5f0 0x7f3410153b30 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f33f800b3e0 tx=0x7f33f800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3407e00640 1 -- 172.21.15.37:0/4115452856 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8015020 con 0x7f34100cd5f0 2024-05-30T06:57:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3407e00640 1 -- 172.21.15.37:0/4115452856 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f8011830 con 0x7f34100cd5f0 2024-05-30T06:57:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3414e00640 1 -- 172.21.15.37:0/4115452856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34101611d0 con 0x7f34100cd5f0 2024-05-30T06:57:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3407e00640 1 -- 172.21.15.37:0/4115452856 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8011c60 con 0x7f34100cd5f0 2024-05-30T06:57:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3414e00640 1 -- 172.21.15.37:0/4115452856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3410161a70 con 0x7f34100cd5f0 2024-05-30T06:57:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3414e00640 1 -- 172.21.15.37:0/4115452856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34101615c0 con 0x7f34100cd5f0 2024-05-30T06:57:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.955+0000 7f3407e00640 1 -- 172.21.15.37:0/4115452856 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f33f8018020 con 0x7f34100cd5f0 2024-05-30T06:57:19.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.959+0000 7f3407e00640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33ec069bb0 0x7f33ec06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:19.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.959+0000 7f3407e00640 1 -- 172.21.15.37:0/4115452856 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5765+0+0 (secure 0 0 0) 0x7f33f8085390 con 0x7f34100cd5f0 2024-05-30T06:57:19.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.959+0000 7f340f400640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33ec069bb0 0x7f33ec06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.959+0000 7f340f400640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33ec069bb0 0x7f33ec06c070 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f34000ae000 tx=0x7f34000a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:19.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:19.963+0000 7f3407e00640 1 -- 172.21.15.37:0/4115452856 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f33f801f030 con 0x7f34100cd5f0 2024-05-30T06:57:20.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:20.167+0000 7f3414e00640 1 -- 172.21.15.37:0/4115452856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3410068ab0 con 0x7f34100cd5f0 2024-05-30T06:57:21.033 INFO:tasks.ceph.mds.a.smithi037.stderr:2024-05-30T06:57:21.027+0000 7f903ae00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T06:57:21.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.067+0000 7f3407e00640 1 -- 172.21.15.37:0/4115452856 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) ==== 118+0+0 (secure 0 0 0) 0x7f33f80573b0 con 0x7f34100cd5f0 2024-05-30T06:57:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.071+0000 7f3414e00640 1 -- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33ec069bb0 msgr2=0x7f33ec06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.071+0000 7f3414e00640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33ec069bb0 0x7f33ec06c070 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f34000ae000 tx=0x7f34000a7070 comp rx=0 tx=0).stop 2024-05-30T06:57:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.071+0000 7f3414e00640 1 -- 172.21.15.37:0/4115452856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100cd5f0 msgr2=0x7f3410153b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.071+0000 7f3414e00640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100cd5f0 0x7f3410153b30 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f33f800b3e0 tx=0x7f33f800b8a0 comp rx=0 tx=0).stop 2024-05-30T06:57:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.071+0000 7f3414e00640 1 -- 172.21.15.37:0/4115452856 shutdown_connections 2024-05-30T06:57:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.071+0000 7f3414e00640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f341015ea50 0x7f3410154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.071+0000 7f3414e00640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34100cd5f0 0x7f3410153b30 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.071+0000 7f3414e00640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f33ec069bb0 0x7f33ec06c070 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:21.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.071+0000 7f3414e00640 1 --2- 172.21.15.37:0/4115452856 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34100b2b80 0x7f34101535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:21.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.071+0000 7f3414e00640 1 -- 172.21.15.37:0/4115452856 >> 172.21.15.37:0/4115452856 conn(0x7f341009aa60 msgr2=0x7f34100cc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:21.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.071+0000 7f3414e00640 1 -- 172.21.15.37:0/4115452856 shutdown_connections 2024-05-30T06:57:21.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.071+0000 7f3414e00640 1 -- 172.21.15.37:0/4115452856 wait complete. 2024-05-30T06:57:21.098 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T06:57:21.098 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T06:57:21.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.243+0000 7fcded200640 1 Processor -- start 2024-05-30T06:57:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.243+0000 7fcded200640 1 -- start start 2024-05-30T06:57:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.243+0000 7fcded200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcde80d0600 0x7fcde80cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.243+0000 7fcded200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcde815c9a0 0x7fcde80d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.243+0000 7fcded200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde80af0d0 con 0x7fcde80cffd0 2024-05-30T06:57:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.243+0000 7fcded200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcde80d0f20 con 0x7fcde815c9a0 2024-05-30T06:57:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.243+0000 7fcded200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcde80ce000 con 0x7fcde80d0600 2024-05-30T06:57:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.243+0000 7fcde7e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcde80cffd0 0x7fcde809aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39800/0 (socket says 172.21.15.37:39800) 2024-05-30T06:57:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.243+0000 7fcde7e00640 1 -- 172.21.15.37:0/875411587 learned_addr learned my addr 172.21.15.37:0/875411587 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.247+0000 7fcddfe00640 1 --2- 172.21.15.37:0/875411587 >> v2:172.21.15.105:3300/0 conn(0x7fcde815c9a0 0x7fcde80d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.247+0000 7fcde7400640 1 --2- 172.21.15.37:0/875411587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcde80d0600 0x7fcde80cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.247+0000 7fcde6a00640 1 -- 172.21.15.37:0/875411587 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548218007 0 0) 0x7fcde80af0d0 con 0x7fcde80cffd0 2024-05-30T06:57:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.247+0000 7fcde6a00640 1 -- 172.21.15.37:0/875411587 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdcc003530 con 0x7fcde80cffd0 2024-05-30T06:57:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.247+0000 7fcddfe00640 1 -- 172.21.15.37:0/875411587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcde80d0600 msgr2=0x7fcde80cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.247+0000 7fcddfe00640 1 --2- 172.21.15.37:0/875411587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcde80d0600 0x7fcde80cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.247+0000 7fcddfe00640 1 -- 172.21.15.37:0/875411587 >> v1:172.21.15.37:6789/0 conn(0x7fcde80cffd0 legacy=0x7fcde809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.247+0000 7fcddfe00640 1 -- 172.21.15.37:0/875411587 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde80ce2e0 con 0x7fcde815c9a0 2024-05-30T06:57:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.247+0000 7fcde7400640 1 --2- 172.21.15.37:0/875411587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcde80d0600 0x7fcde80cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:57:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.247+0000 7fcddfe00640 1 --2- 172.21.15.37:0/875411587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcde815c9a0 0x7fcde80d09e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00097f0 tx=0x7fcdd001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=321eca5fbe765676 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcde6a00640 1 -- 172.21.15.37:0/875411587 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00a7070 con 0x7fcde815c9a0 2024-05-30T06:57:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcde6a00640 1 -- 172.21.15.37:0/875411587 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd00b0070 con 0x7fcde815c9a0 2024-05-30T06:57:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcde6a00640 1 -- 172.21.15.37:0/875411587 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00ab870 con 0x7fcde815c9a0 2024-05-30T06:57:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 -- 172.21.15.37:0/875411587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcde815c9a0 msgr2=0x7fcde80d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 --2- 172.21.15.37:0/875411587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcde815c9a0 0x7fcde80d09e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00097f0 tx=0x7fcdd001c470 comp rx=0 tx=0).stop 2024-05-30T06:57:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 -- 172.21.15.37:0/875411587 shutdown_connections 2024-05-30T06:57:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 --2- 172.21.15.37:0/875411587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcde815c9a0 0x7fcde80d09e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 --2- 172.21.15.37:0/875411587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcde80d0600 0x7fcde80cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 -- 172.21.15.37:0/875411587 >> 172.21.15.37:0/875411587 conn(0x7fcde80b3ef0 msgr2=0x7fcde80b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 -- 172.21.15.37:0/875411587 shutdown_connections 2024-05-30T06:57:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 -- 172.21.15.37:0/875411587 wait complete. 2024-05-30T06:57:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 Processor -- start 2024-05-30T06:57:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 -- start start 2024-05-30T06:57:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcde80cffd0 0x7fcde814b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcde80d0600 0x7fcde8164f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcde815c9a0 0x7fcde815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcde81694b0 con 0x7fcde80d0600 2024-05-30T06:57:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8169330 con 0x7fcde815c9a0 2024-05-30T06:57:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcded200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcde8169630 con 0x7fcde80cffd0 2024-05-30T06:57:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcddfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcde80d0600 0x7fcde8164f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcddfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcde80d0600 0x7fcde8164f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55988/0 (socket says 172.21.15.37:55988) 2024-05-30T06:57:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcddfe00640 1 -- 172.21.15.37:0/3586138465 learned_addr learned my addr 172.21.15.37:0/3586138465 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcde7e00640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcde815c9a0 0x7fcde815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.251+0000 7fcde7400640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcde80cffd0 0x7fcde814b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.255+0000 7fcddfe00640 1 -- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcde80cffd0 msgr2=0x7fcde814b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.255+0000 7fcddfe00640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcde80cffd0 0x7fcde814b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.255+0000 7fcddfe00640 1 -- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcde815c9a0 msgr2=0x7fcde815abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.255+0000 7fcddfe00640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcde815c9a0 0x7fcde815abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.255+0000 7fcddfe00640 1 -- 172.21.15.37:0/3586138465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde8159b40 con 0x7fcde80d0600 2024-05-30T06:57:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.255+0000 7fcddfe00640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcde80d0600 0x7fcde8164f20 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00ad040 tx=0x7fcdd0019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.255+0000 7fcddf400640 1 -- 172.21.15.37:0/3586138465 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0003820 con 0x7fcde80d0600 2024-05-30T06:57:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.255+0000 7fcddf400640 1 -- 172.21.15.37:0/3586138465 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd00039c0 con 0x7fcde80d0600 2024-05-30T06:57:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.255+0000 7fcddf400640 1 -- 172.21.15.37:0/3586138465 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0003d90 con 0x7fcde80d0600 2024-05-30T06:57:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.255+0000 7fcded200640 1 -- 172.21.15.37:0/3586138465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde8159e20 con 0x7fcde80d0600 2024-05-30T06:57:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.255+0000 7fcded200640 1 -- 172.21.15.37:0/3586138465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde815a3e0 con 0x7fcde80d0600 2024-05-30T06:57:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.255+0000 7fcded200640 1 -- 172.21.15.37:0/3586138465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde8068ab0 con 0x7fcde80d0600 2024-05-30T06:57:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.255+0000 7fcddf400640 1 -- 172.21.15.37:0/3586138465 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fcdd00c3060 con 0x7fcde80d0600 2024-05-30T06:57:21.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.259+0000 7fcddf400640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcdc4069bb0 0x7fcdc406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:21.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.259+0000 7fcddf400640 1 -- 172.21.15.37:0/3586138465 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7fcdd011f360 con 0x7fcde80d0600 2024-05-30T06:57:21.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.259+0000 7fcde7400640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcdc4069bb0 0x7fcdc406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.259+0000 7fcde7400640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcdc4069bb0 0x7fcdc406c070 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009a50 tx=0x7fcdd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.263+0000 7fcddf400640 1 -- 172.21.15.37:0/3586138465 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcdd0016090 con 0x7fcde80d0600 2024-05-30T06:57:21.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:21.463+0000 7fcded200640 1 -- 172.21.15.37:0/3586138465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fcde80ce930 con 0x7fcde80d0600 2024-05-30T06:57:22.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.071+0000 7fcddf400640 1 -- 172.21.15.37:0/3586138465 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) ==== 122+0+0 (secure 0 0 0) 0x7fcdd00f0d30 con 0x7fcde80d0600 2024-05-30T06:57:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.071+0000 7fcded200640 1 -- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcdc4069bb0 msgr2=0x7fcdc406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.071+0000 7fcded200640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcdc4069bb0 0x7fcdc406c070 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009a50 tx=0x7fcdd8008040 comp rx=0 tx=0).stop 2024-05-30T06:57:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.071+0000 7fcded200640 1 -- 172.21.15.37:0/3586138465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcde80d0600 msgr2=0x7fcde8164f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.071+0000 7fcded200640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcde80d0600 0x7fcde8164f20 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00ad040 tx=0x7fcdd0019210 comp rx=0 tx=0).stop 2024-05-30T06:57:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.071+0000 7fcded200640 1 -- 172.21.15.37:0/3586138465 shutdown_connections 2024-05-30T06:57:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.071+0000 7fcded200640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcdc4069bb0 0x7fcdc406c070 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.071+0000 7fcded200640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcde815c9a0 0x7fcde815abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.071+0000 7fcded200640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcde80d0600 0x7fcde8164f20 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.071+0000 7fcded200640 1 --2- 172.21.15.37:0/3586138465 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcde80cffd0 0x7fcde814b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.071+0000 7fcded200640 1 -- 172.21.15.37:0/3586138465 >> 172.21.15.37:0/3586138465 conn(0x7fcde80b3ef0 msgr2=0x7fcde80b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.071+0000 7fcded200640 1 -- 172.21.15.37:0/3586138465 shutdown_connections 2024-05-30T06:57:22.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.071+0000 7fcded200640 1 -- 172.21.15.37:0/3586138465 wait complete. 2024-05-30T06:57:22.100 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T06:57:22.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:57:22.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e2000640 1 Processor -- start 2024-05-30T06:57:22.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e2000640 1 -- start start 2024-05-30T06:57:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e2000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc0dc161fc0 0x7fc0dc0d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e2000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc0dc0cd1c0 0x7fc0dc162570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e2000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0dc06dc60 con 0x7fc0dc06d480 2024-05-30T06:57:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e2000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc0dc0d10c0 con 0x7fc0dc161fc0 2024-05-30T06:57:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e2000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc0dc0d0790 con 0x7fc0dc0cd1c0 2024-05-30T06:57:22.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e0c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc0dc161fc0 0x7fc0dc0d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e0c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc0dc161fc0 0x7fc0dc0d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55992/0 (socket says 172.21.15.37:55992) 2024-05-30T06:57:22.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e0c00640 1 -- 172.21.15.37:0/572535430 learned_addr learned my addr 172.21.15.37:0/572535430 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:22.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e1600640 1 --2- 172.21.15.37:0/572535430 >> v2:172.21.15.105:3300/0 conn(0x7fc0dc0cd1c0 0x7fc0dc162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e0c00640 1 -- 172.21.15.37:0/572535430 >> v2:172.21.15.105:3300/0 conn(0x7fc0dc0cd1c0 msgr2=0x7fc0dc162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:22.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e0c00640 1 --2- 172.21.15.37:0/572535430 >> v2:172.21.15.105:3300/0 conn(0x7fc0dc0cd1c0 0x7fc0dc162570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e0c00640 1 -- 172.21.15.37:0/572535430 >> v1:172.21.15.105:6789/0 conn(0x7fc0dc06d480 legacy=0x7fc0dc0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:22.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.243+0000 7fc0e0c00640 1 -- 172.21.15.37:0/572535430 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc0d0a70 con 0x7fc0dc161fc0 2024-05-30T06:57:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.247+0000 7fc0e0c00640 1 --2- 172.21.15.37:0/572535430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc161fc0 0x7fc0dc0d1550 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc073a10 tx=0x7fc0d001c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28dd040268f11d70 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.247+0000 7fc0db400640 1 -- 172.21.15.37:0/572535430 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00b0070 con 0x7fc0dc161fc0 2024-05-30T06:57:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.247+0000 7fc0db400640 1 -- 172.21.15.37:0/572535430 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d00ab600 con 0x7fc0dc161fc0 2024-05-30T06:57:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.247+0000 7fc0db400640 1 -- 172.21.15.37:0/572535430 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00ab9d0 con 0x7fc0dc161fc0 2024-05-30T06:57:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.247+0000 7fc0e2000640 1 -- 172.21.15.37:0/572535430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc161fc0 msgr2=0x7fc0dc0d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.247+0000 7fc0e2000640 1 --2- 172.21.15.37:0/572535430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc161fc0 0x7fc0dc0d1550 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc073a10 tx=0x7fc0d001c220 comp rx=0 tx=0).stop 2024-05-30T06:57:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.247+0000 7fc0e2000640 1 -- 172.21.15.37:0/572535430 shutdown_connections 2024-05-30T06:57:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.247+0000 7fc0e2000640 1 --2- 172.21.15.37:0/572535430 >> v2:172.21.15.105:3300/0 conn(0x7fc0dc0cd1c0 0x7fc0dc162570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.247+0000 7fc0e2000640 1 --2- 172.21.15.37:0/572535430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc161fc0 0x7fc0dc0d1550 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.247+0000 7fc0e2000640 1 -- 172.21.15.37:0/572535430 >> 172.21.15.37:0/572535430 conn(0x7fc0dc0b3f50 msgr2=0x7fc0dc0b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.247+0000 7fc0e2000640 1 -- 172.21.15.37:0/572535430 shutdown_connections 2024-05-30T06:57:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.247+0000 7fc0e2000640 1 -- 172.21.15.37:0/572535430 wait complete. 2024-05-30T06:57:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e2000640 1 Processor -- start 2024-05-30T06:57:22.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e2000640 1 -- start start 2024-05-30T06:57:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e2000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0dc06d480 0x7fc0dc14f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e2000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0dc0cd1c0 0x7fc0dc1565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc161fc0 0x7fc0dc156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e2000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc16b8b0 con 0x7fc0dc161fc0 2024-05-30T06:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e2000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc0dc0cd7e0 con 0x7fc0dc0cd1c0 2024-05-30T06:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e2000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc0dc16ba30 con 0x7fc0dc06d480 2024-05-30T06:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e1600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc161fc0 0x7fc0dc156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e1600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc161fc0 0x7fc0dc156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56000/0 (socket says 172.21.15.37:56000) 2024-05-30T06:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e1600640 1 -- 172.21.15.37:0/542828022 learned_addr learned my addr 172.21.15.37:0/542828022 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e0c00640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0dc06d480 0x7fc0dc14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0dbe00640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0dc0cd1c0 0x7fc0dc1565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e1600640 1 -- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0dc06d480 msgr2=0x7fc0dc14f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e1600640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0dc06d480 0x7fc0dc14f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e1600640 1 -- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0dc0cd1c0 msgr2=0x7fc0dc1565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e1600640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0dc0cd1c0 0x7fc0dc1565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e1600640 1 -- 172.21.15.37:0/542828022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0dc159ad0 con 0x7fc0dc161fc0 2024-05-30T06:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e1600640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc161fc0 0x7fc0dc156b10 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4007e40 tx=0x7fc0d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0d8c00640 1 -- 172.21.15.37:0/542828022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4014620 con 0x7fc0dc161fc0 2024-05-30T06:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0d8c00640 1 -- 172.21.15.37:0/542828022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d4019070 con 0x7fc0dc161fc0 2024-05-30T06:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0d8c00640 1 -- 172.21.15.37:0/542828022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d4014a20 con 0x7fc0dc161fc0 2024-05-30T06:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e2000640 1 -- 172.21.15.37:0/542828022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0dc157450 con 0x7fc0dc161fc0 2024-05-30T06:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e2000640 1 -- 172.21.15.37:0/542828022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0dc157a10 con 0x7fc0dc161fc0 2024-05-30T06:57:22.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.251+0000 7fc0e2000640 1 -- 172.21.15.37:0/542828022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0dc157c10 con 0x7fc0dc161fc0 2024-05-30T06:57:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.255+0000 7fc0d8c00640 1 -- 172.21.15.37:0/542828022 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fc0d4014bc0 con 0x7fc0dc161fc0 2024-05-30T06:57:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.255+0000 7fc0d8c00640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0bc069be0 0x7fc0bc06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.255+0000 7fc0d8c00640 1 -- 172.21.15.37:0/542828022 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7fc0d4085f50 con 0x7fc0dc161fc0 2024-05-30T06:57:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.255+0000 7fc0e0c00640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0bc069be0 0x7fc0bc06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.255+0000 7fc0e0c00640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0bc069be0 0x7fc0bc06c0a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00ad000 tx=0x7fc0d00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.259+0000 7fc0d8c00640 1 -- 172.21.15.37:0/542828022 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc0dc157c10 con 0x7fc0dc161fc0 2024-05-30T06:57:22.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.459+0000 7fc0e2000640 1 -- 172.21.15.37:0/542828022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0dc068ab0 con 0x7fc0dc161fc0 2024-05-30T06:57:22.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.463+0000 7fc0d8c00640 1 -- 172.21.15.37:0/542828022 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5189 (secure 0 0 0) 0x7fc0d4057920 con 0x7fc0dc161fc0 2024-05-30T06:57:22.465 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:22.465 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3908783351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3908783351},{"type":"v1","addr":"172.21.15.105:6836","nonce":3908783351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":8473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2654517585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2654517585},{"type":"v1","addr":"172.21.15.105:6837","nonce":2654517585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":9117,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3433994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3433994777},{"type":"v1","addr":"172.21.15.37:6833","nonce":3433994777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:57:18.453221+0000","modified":"2024-05-30T06:57:21.469705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9120":{"gid":9120,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1475971506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1475971506},{"type":"v1","addr":"172.21.15.37:6835","nonce":1475971506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9120,"qdb_cluster":[9120]},"id":8}]} 2024-05-30T06:57:22.466 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 74 2024-05-30T06:57:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.463+0000 7fc0e2000640 1 -- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0bc069be0 msgr2=0x7fc0bc06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.463+0000 7fc0e2000640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0bc069be0 0x7fc0bc06c0a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc0d00ad000 tx=0x7fc0d00a6000 comp rx=0 tx=0).stop 2024-05-30T06:57:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.463+0000 7fc0e2000640 1 -- 172.21.15.37:0/542828022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc161fc0 msgr2=0x7fc0dc156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.463+0000 7fc0e2000640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc161fc0 0x7fc0dc156b10 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4007e40 tx=0x7fc0d400e4b0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.463+0000 7fc0e2000640 1 -- 172.21.15.37:0/542828022 shutdown_connections 2024-05-30T06:57:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.463+0000 7fc0e2000640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc161fc0 0x7fc0dc156b10 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.463+0000 7fc0e2000640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc0bc069be0 0x7fc0bc06c0a0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.463+0000 7fc0e2000640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0dc0cd1c0 0x7fc0dc1565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.463+0000 7fc0e2000640 1 --2- 172.21.15.37:0/542828022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0dc06d480 0x7fc0dc14f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.463+0000 7fc0e2000640 1 -- 172.21.15.37:0/542828022 >> 172.21.15.37:0/542828022 conn(0x7fc0dc0b3f50 msgr2=0x7fc0dc074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.463+0000 7fc0e2000640 1 -- 172.21.15.37:0/542828022 shutdown_connections 2024-05-30T06:57:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.463+0000 7fc0e2000640 1 -- 172.21.15.37:0/542828022 wait complete. 2024-05-30T06:57:22.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:57:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.623+0000 7f57bc000640 1 Processor -- start 2024-05-30T06:57:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.623+0000 7f57bc000640 1 -- start start 2024-05-30T06:57:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57bc000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57b415ce90 0x7f57b406b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57bc000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f57b406bea0 0x7f57b4166490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57bc000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b40b07a0 con 0x7f57b4146180 2024-05-30T06:57:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57bc000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f57b40ae850 con 0x7f57b406bea0 2024-05-30T06:57:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57bc000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f57b40b0a80 con 0x7f57b415ce90 2024-05-30T06:57:22.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57ba000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f57b406bea0 0x7f57b4166490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57b9600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f57b4146180 0x7f57b40b6030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39802/0 (socket says 172.21.15.37:39802) 2024-05-30T06:57:22.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57b9600640 1 -- 172.21.15.37:0/3633182276 learned_addr learned my addr 172.21.15.37:0/3633182276 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:22.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57b8c00640 1 --2- 172.21.15.37:0/3633182276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57b415ce90 0x7f57b406b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57ba000640 1 -- 172.21.15.37:0/3633182276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57b415ce90 msgr2=0x7f57b406b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:22.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57ba000640 1 --2- 172.21.15.37:0/3633182276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57b415ce90 0x7f57b406b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57ba000640 1 -- 172.21.15.37:0/3633182276 >> v1:172.21.15.37:6789/0 conn(0x7f57b4146180 legacy=0x7f57b40b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57ba000640 1 -- 172.21.15.37:0/3633182276 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b40b0d60 con 0x7f57b406bea0 2024-05-30T06:57:22.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.627+0000 7f57b8c00640 1 --2- 172.21.15.37:0/3633182276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57b415ce90 0x7f57b406b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:22.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57ba000640 1 --2- 172.21.15.37:0/3633182276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b406bea0 0x7f57b4166490 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009d90 tx=0x7f57ac01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd99eb6a91f9a433 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:22.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57b3e00640 1 -- 172.21.15.37:0/3633182276 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0b2070 con 0x7f57b406bea0 2024-05-30T06:57:22.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57b3e00640 1 -- 172.21.15.37:0/3633182276 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57ac0a58b0 con 0x7f57b406bea0 2024-05-30T06:57:22.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57b3e00640 1 -- 172.21.15.37:0/3633182276 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0a5c80 con 0x7f57b406bea0 2024-05-30T06:57:22.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 -- 172.21.15.37:0/3633182276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b406bea0 msgr2=0x7f57b4166490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 --2- 172.21.15.37:0/3633182276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b406bea0 0x7f57b4166490 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009d90 tx=0x7f57ac01c8e0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 -- 172.21.15.37:0/3633182276 shutdown_connections 2024-05-30T06:57:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 --2- 172.21.15.37:0/3633182276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b406bea0 0x7f57b4166490 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 --2- 172.21.15.37:0/3633182276 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57b415ce90 0x7f57b406b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 -- 172.21.15.37:0/3633182276 >> 172.21.15.37:0/3633182276 conn(0x7f57b40b6a60 msgr2=0x7f57b40b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 -- 172.21.15.37:0/3633182276 shutdown_connections 2024-05-30T06:57:22.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 -- 172.21.15.37:0/3633182276 wait complete. 2024-05-30T06:57:22.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 Processor -- start 2024-05-30T06:57:22.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 -- start start 2024-05-30T06:57:22.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b406bea0 0x7f57b4138af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57b4146180 0x7f57b413d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57b415ce90 0x7f57b4144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57b4169370 con 0x7f57b406bea0 2024-05-30T06:57:22.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f57b41691f0 con 0x7f57b4146180 2024-05-30T06:57:22.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.631+0000 7f57bc000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f57b41694f0 con 0x7f57b415ce90 2024-05-30T06:57:22.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b406bea0 0x7f57b4138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b406bea0 0x7f57b4138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56022/0 (socket says 172.21.15.37:56022) 2024-05-30T06:57:22.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b9600640 1 -- 172.21.15.37:0/3597253132 learned_addr learned my addr 172.21.15.37:0/3597253132 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:22.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b8c00640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57b4146180 0x7f57b413d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57ba000640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57b415ce90 0x7f57b4144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b9600640 1 -- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57b415ce90 msgr2=0x7f57b4144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b9600640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57b415ce90 0x7f57b4144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b9600640 1 -- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57b4146180 msgr2=0x7f57b413d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b9600640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57b4146180 0x7f57b413d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b9600640 1 -- 172.21.15.37:0/3597253132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b4139700 con 0x7f57b406bea0 2024-05-30T06:57:22.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b9600640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b406bea0 0x7f57b4138af0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f57a800c450 tx=0x7f57a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b1600640 1 -- 172.21.15.37:0/3597253132 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8017070 con 0x7f57b406bea0 2024-05-30T06:57:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b1600640 1 -- 172.21.15.37:0/3597253132 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a8005cf0 con 0x7f57b406bea0 2024-05-30T06:57:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57bc000640 1 -- 172.21.15.37:0/3597253132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b41581a0 con 0x7f57b406bea0 2024-05-30T06:57:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b1600640 1 -- 172.21.15.37:0/3597253132 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8007290 con 0x7f57b406bea0 2024-05-30T06:57:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57bc000640 1 -- 172.21.15.37:0/3597253132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b4158760 con 0x7f57b406bea0 2024-05-30T06:57:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57bc000640 1 -- 172.21.15.37:0/3597253132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b4068b20 con 0x7f57b406bea0 2024-05-30T06:57:22.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.635+0000 7f57b1600640 1 -- 172.21.15.37:0/3597253132 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f57a801a070 con 0x7f57b406bea0 2024-05-30T06:57:22.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.639+0000 7f57b1600640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5794069be0 0x7f579406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.639+0000 7f57b1600640 1 -- 172.21.15.37:0/3597253132 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f57a8084a60 con 0x7f57b406bea0 2024-05-30T06:57:22.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.639+0000 7f57b8c00640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5794069be0 0x7f579406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.639+0000 7f57b8c00640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5794069be0 0x7f579406c0a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f57b413d4f0 tx=0x7f57a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:22.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.643+0000 7f57b1600640 1 -- 172.21.15.37:0/3597253132 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f57a8056430 con 0x7f57b406bea0 2024-05-30T06:57:22.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.811+0000 7f57bc000640 1 -- 172.21.15.37:0/3597253132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57b4166390 con 0x7f57b406bea0 2024-05-30T06:57:22.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.811+0000 7f57b1600640 1 -- 172.21.15.37:0/3597253132 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+16703 (secure 0 0 0) 0x7f57a805a730 con 0x7f57b406bea0 2024-05-30T06:57:22.816 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:22.816 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":114,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:57:20.060951+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:57:16.849268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-05-30T06:57:17.405807+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:57:22.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.815+0000 7f57bc000640 1 -- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5794069be0 msgr2=0x7f579406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.815+0000 7f57bc000640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5794069be0 0x7f579406c0a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f57b413d4f0 tx=0x7f57a0008040 comp rx=0 tx=0).stop 2024-05-30T06:57:22.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.815+0000 7f57bc000640 1 -- 172.21.15.37:0/3597253132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b406bea0 msgr2=0x7f57b4138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.815+0000 7f57bc000640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b406bea0 0x7f57b4138af0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f57a800c450 tx=0x7f57a800c910 comp rx=0 tx=0).stop 2024-05-30T06:57:22.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.815+0000 7f57bc000640 1 -- 172.21.15.37:0/3597253132 shutdown_connections 2024-05-30T06:57:22.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.815+0000 7f57bc000640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57b415ce90 0x7f57b4144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.815+0000 7f57bc000640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5794069be0 0x7f579406c0a0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.815+0000 7f57bc000640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57b4146180 0x7f57b413d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.815+0000 7f57bc000640 1 --2- 172.21.15.37:0/3597253132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57b406bea0 0x7f57b4138af0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.815+0000 7f57bc000640 1 -- 172.21.15.37:0/3597253132 >> 172.21.15.37:0/3597253132 conn(0x7f57b40b6a60 msgr2=0x7f57b4141cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:22.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.815+0000 7f57bc000640 1 -- 172.21.15.37:0/3597253132 shutdown_connections 2024-05-30T06:57:22.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.815+0000 7f57bc000640 1 -- 172.21.15.37:0/3597253132 wait complete. 2024-05-30T06:57:22.838 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-30T06:57:22.838 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:57:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.975+0000 7fa568e00640 1 Processor -- start 2024-05-30T06:57:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.975+0000 7fa568e00640 1 -- start start 2024-05-30T06:57:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa568e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa56406f8a0 0x7fa56415cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa568e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5640cd340 0x7fa5641662c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa568e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5640adf40 con 0x7fa5640af1e0 2024-05-30T06:57:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa568e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa5640ae220 con 0x7fa5640cd340 2024-05-30T06:57:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa568e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa5640ae500 con 0x7fa56406f8a0 2024-05-30T06:57:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa562800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5640cd340 0x7fa5641662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa562800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5640cd340 0x7fa5641662c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56028/0 (socket says 172.21.15.37:56028) 2024-05-30T06:57:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa562800640 1 -- 172.21.15.37:0/3788168631 learned_addr learned my addr 172.21.15.37:0/3788168631 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa55be00640 1 --2- 172.21.15.37:0/3788168631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa56406f8a0 0x7fa56415cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa562800640 1 -- 172.21.15.37:0/3788168631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa56406f8a0 msgr2=0x7fa56415cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa562800640 1 --2- 172.21.15.37:0/3788168631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa56406f8a0 0x7fa56415cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa562800640 1 -- 172.21.15.37:0/3788168631 >> v1:172.21.15.105:6789/0 conn(0x7fa5640af1e0 legacy=0x7fa5640af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa562800640 1 -- 172.21.15.37:0/3788168631 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5640ae7e0 con 0x7fa5640cd340 2024-05-30T06:57:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa55be00640 1 --2- 172.21.15.37:0/3788168631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa56406f8a0 0x7fa56415cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa562800640 1 --2- 172.21.15.37:0/3788168631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5640cd340 0x7fa5641662c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009e50 tx=0x7fa55c01c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacd50d00fb698ed server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:22.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa561400640 1 -- 172.21.15.37:0/3788168631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0a4cb0 con 0x7fa5640cd340 2024-05-30T06:57:22.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.979+0000 7fa561400640 1 -- 172.21.15.37:0/3788168631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55c0a4e50 con 0x7fa5640cd340 2024-05-30T06:57:22.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa561400640 1 -- 172.21.15.37:0/3788168631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0ac610 con 0x7fa5640cd340 2024-05-30T06:57:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 -- 172.21.15.37:0/3788168631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5640cd340 msgr2=0x7fa5641662c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 --2- 172.21.15.37:0/3788168631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5640cd340 0x7fa5641662c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009e50 tx=0x7fa55c01c5f0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 -- 172.21.15.37:0/3788168631 shutdown_connections 2024-05-30T06:57:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 --2- 172.21.15.37:0/3788168631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5640cd340 0x7fa5641662c0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 --2- 172.21.15.37:0/3788168631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa56406f8a0 0x7fa56415cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 -- 172.21.15.37:0/3788168631 >> 172.21.15.37:0/3788168631 conn(0x7fa564073680 msgr2=0x7fa56406b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 -- 172.21.15.37:0/3788168631 shutdown_connections 2024-05-30T06:57:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 -- 172.21.15.37:0/3788168631 wait complete. 2024-05-30T06:57:22.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 Processor -- start 2024-05-30T06:57:22.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 -- start start 2024-05-30T06:57:22.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa56406f8a0 0x7fa564158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5640af1e0 0x7fa564165820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5640cd340 0x7fa5640cf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa564169bd0 con 0x7fa5640cd340 2024-05-30T06:57:22.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa564169a50 con 0x7fa56406f8a0 2024-05-30T06:57:22.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa568e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa564169d50 con 0x7fa5640af1e0 2024-05-30T06:57:22.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa562800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5640cd340 0x7fa5640cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa562800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5640cd340 0x7fa5640cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56038/0 (socket says 172.21.15.37:56038) 2024-05-30T06:57:22.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa562800640 1 -- 172.21.15.37:0/53243393 learned_addr learned my addr 172.21.15.37:0/53243393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:22.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa561e00640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa56406f8a0 0x7fa564158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa55be00640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5640af1e0 0x7fa564165820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa562800640 1 -- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5640af1e0 msgr2=0x7fa564165820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa562800640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5640af1e0 0x7fa564165820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa562800640 1 -- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa56406f8a0 msgr2=0x7fa564158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa562800640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa56406f8a0 0x7fa564158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.983+0000 7fa562800640 1 -- 172.21.15.37:0/53243393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5641644c0 con 0x7fa5640cd340 2024-05-30T06:57:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.987+0000 7fa562800640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5640cd340 0x7fa5640cf680 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0ae040 tx=0x7fa55c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.987+0000 7fa55a000640 1 -- 172.21.15.37:0/53243393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0bc030 con 0x7fa5640cd340 2024-05-30T06:57:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.987+0000 7fa55a000640 1 -- 172.21.15.37:0/53243393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55c0b5420 con 0x7fa5640cd340 2024-05-30T06:57:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.987+0000 7fa55a000640 1 -- 172.21.15.37:0/53243393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c0a4cb0 con 0x7fa5640cd340 2024-05-30T06:57:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.987+0000 7fa568e00640 1 -- 172.21.15.37:0/53243393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa564164780 con 0x7fa5640cd340 2024-05-30T06:57:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.987+0000 7fa568e00640 1 -- 172.21.15.37:0/53243393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa564164d40 con 0x7fa5640cd340 2024-05-30T06:57:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.987+0000 7fa568e00640 1 -- 172.21.15.37:0/53243393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa564068b20 con 0x7fa5640cd340 2024-05-30T06:57:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.987+0000 7fa55a000640 1 -- 172.21.15.37:0/53243393 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fa55c0bf070 con 0x7fa5640cd340 2024-05-30T06:57:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.987+0000 7fa55a000640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa540069bb0 0x7fa54006c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.987+0000 7fa55a000640 1 -- 172.21.15.37:0/53243393 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7fa55c11f2a0 con 0x7fa5640cd340 2024-05-30T06:57:22.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.987+0000 7fa561e00640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa540069bb0 0x7fa54006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:22.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.991+0000 7fa561e00640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa540069bb0 0x7fa54006c070 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa554001770 tx=0x7fa554009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:22.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:22.991+0000 7fa55a000640 1 -- 172.21.15.37:0/53243393 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa55c0c6020 con 0x7fa5640cd340 2024-05-30T06:57:23.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.155+0000 7fa568e00640 1 -- 172.21.15.37:0/53243393 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa5640b08f0 con 0x7fa540069bb0 2024-05-30T06:57:23.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.167+0000 7fa55a000640 1 -- 172.21.15.37:0/53243393 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247105 (secure 0 0 0) 0x7fa5640b08f0 con 0x7fa540069bb0 2024-05-30T06:57:23.169 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:23.171 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:57:23.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.167+0000 7fa568e00640 1 -- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa540069bb0 msgr2=0x7fa54006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.167+0000 7fa568e00640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa540069bb0 0x7fa54006c070 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa554001770 tx=0x7fa554009040 comp rx=0 tx=0).stop 2024-05-30T06:57:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.167+0000 7fa568e00640 1 -- 172.21.15.37:0/53243393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5640cd340 msgr2=0x7fa5640cf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.167+0000 7fa568e00640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5640cd340 0x7fa5640cf680 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0ae040 tx=0x7fa55c0196b0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.167+0000 7fa568e00640 1 -- 172.21.15.37:0/53243393 shutdown_connections 2024-05-30T06:57:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.167+0000 7fa568e00640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5640cd340 0x7fa5640cf680 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.167+0000 7fa568e00640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5640af1e0 0x7fa564165820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.167+0000 7fa568e00640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa540069bb0 0x7fa54006c070 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.167+0000 7fa568e00640 1 --2- 172.21.15.37:0/53243393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa56406f8a0 0x7fa564158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.167+0000 7fa568e00640 1 -- 172.21.15.37:0/53243393 >> 172.21.15.37:0/53243393 conn(0x7fa564073680 msgr2=0x7fa56415f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.167+0000 7fa568e00640 1 -- 172.21.15.37:0/53243393 shutdown_connections 2024-05-30T06:57:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.167+0000 7fa568e00640 1 -- 172.21.15.37:0/53243393 wait complete. 2024-05-30T06:57:23.191 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":569,"stamp":"2024-05-30T06:57:22.971320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":873164,"kb_used_data":11992,"kb_used_omap":12,"kb_used_meta":861043,"kb_avail":754101556,"statfs":{"total":773094113280,"available":772199993344,"internally_reserved":0,"allocated":12279808,"data_stored":6010876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":881708592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.930294"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.058541+0000","last_change":"2024-05-30T06:57:18.058541+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.058541+0000","last_undegraded":"2024-05-30T06:57:18.058541+0000","last_fullsized":"2024-05-30T06:57:18.058541+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050299+0000","last_change":"2024-05-30T06:57:18.050299+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050299+0000","last_undegraded":"2024-05-30T06:57:18.050299+0000","last_fullsized":"2024-05-30T06:57:18.050299+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.060020+0000","last_change":"2024-05-30T06:57:18.060020+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.060020+0000","last_undegraded":"2024-05-30T06:57:18.060020+0000","last_fullsized":"2024-05-30T06:57:18.060020+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056676+0000","last_change":"2024-05-30T06:57:18.056676+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056676+0000","last_undegraded":"2024-05-30T06:57:18.056676+0000","last_fullsized":"2024-05-30T06:57:18.056676+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.043649+0000","last_change":"2024-05-30T06:57:18.043649+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.043649+0000","last_undegraded":"2024-05-30T06:57:18.043649+0000","last_fullsized":"2024-05-30T06:57:18.043649+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053062+0000","last_change":"2024-05-30T06:57:18.053062+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053062+0000","last_undegraded":"2024-05-30T06:57:18.053062+0000","last_fullsized":"2024-05-30T06:57:18.053062+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.047532+0000","last_change":"2024-05-30T06:57:18.047532+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.047532+0000","last_undegraded":"2024-05-30T06:57:18.047532+0000","last_fullsized":"2024-05-30T06:57:18.047532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055958+0000","last_change":"2024-05-30T06:57:18.055958+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055958+0000","last_undegraded":"2024-05-30T06:57:18.055958+0000","last_fullsized":"2024-05-30T06:57:18.055958+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055512+0000","last_change":"2024-05-30T06:57:18.055512+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055512+0000","last_undegraded":"2024-05-30T06:57:18.055512+0000","last_fullsized":"2024-05-30T06:57:18.055512+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054891+0000","last_change":"2024-05-30T06:57:18.054891+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054891+0000","last_undegraded":"2024-05-30T06:57:18.054891+0000","last_fullsized":"2024-05-30T06:57:18.054891+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051576+0000","last_change":"2024-05-30T06:57:18.051576+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051576+0000","last_undegraded":"2024-05-30T06:57:18.051576+0000","last_fullsized":"2024-05-30T06:57:18.051576+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055925+0000","last_change":"2024-05-30T06:57:18.055925+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055925+0000","last_undegraded":"2024-05-30T06:57:18.055925+0000","last_fullsized":"2024-05-30T06:57:18.055925+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056014+0000","last_change":"2024-05-30T06:57:18.056014+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056014+0000","last_undegraded":"2024-05-30T06:57:18.056014+0000","last_fullsized":"2024-05-30T06:57:18.056014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.060488+0000","last_change":"2024-05-30T06:57:18.060488+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.060488+0000","last_undegraded":"2024-05-30T06:57:18.060488+0000","last_fullsized":"2024-05-30T06:57:18.060488+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053019+0000","last_change":"2024-05-30T06:57:18.053019+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053019+0000","last_undegraded":"2024-05-30T06:57:18.053019+0000","last_fullsized":"2024-05-30T06:57:18.053019+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053105+0000","last_change":"2024-05-30T06:57:18.053105+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053105+0000","last_undegraded":"2024-05-30T06:57:18.053105+0000","last_fullsized":"2024-05-30T06:57:18.053105+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052523+0000","last_change":"2024-05-30T06:57:18.052523+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052523+0000","last_undegraded":"2024-05-30T06:57:18.052523+0000","last_fullsized":"2024-05-30T06:57:18.052523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055005+0000","last_change":"2024-05-30T06:57:18.055005+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055005+0000","last_undegraded":"2024-05-30T06:57:18.055005+0000","last_fullsized":"2024-05-30T06:57:18.055005+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.059570+0000","last_change":"2024-05-30T06:57:18.059570+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.059570+0000","last_undegraded":"2024-05-30T06:57:18.059570+0000","last_fullsized":"2024-05-30T06:57:18.059570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051075+0000","last_change":"2024-05-30T06:57:18.051075+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051075+0000","last_undegraded":"2024-05-30T06:57:18.051075+0000","last_fullsized":"2024-05-30T06:57:18.051075+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052332+0000","last_change":"2024-05-30T06:57:18.052332+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052332+0000","last_undegraded":"2024-05-30T06:57:18.052332+0000","last_fullsized":"2024-05-30T06:57:18.052332+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054332+0000","last_change":"2024-05-30T06:57:18.054332+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054332+0000","last_undegraded":"2024-05-30T06:57:18.054332+0000","last_fullsized":"2024-05-30T06:57:18.054332+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049936+0000","last_change":"2024-05-30T06:57:18.049936+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049936+0000","last_undegraded":"2024-05-30T06:57:18.049936+0000","last_fullsized":"2024-05-30T06:57:18.049936+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050317+0000","last_change":"2024-05-30T06:57:18.050317+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050317+0000","last_undegraded":"2024-05-30T06:57:18.050317+0000","last_fullsized":"2024-05-30T06:57:18.050317+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052099+0000","last_change":"2024-05-30T06:57:18.052099+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052099+0000","last_undegraded":"2024-05-30T06:57:18.052099+0000","last_fullsized":"2024-05-30T06:57:18.052099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053556+0000","last_change":"2024-05-30T06:57:18.053556+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053556+0000","last_undegraded":"2024-05-30T06:57:18.053556+0000","last_fullsized":"2024-05-30T06:57:18.053556+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055296+0000","last_change":"2024-05-30T06:57:18.055296+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055296+0000","last_undegraded":"2024-05-30T06:57:18.055296+0000","last_fullsized":"2024-05-30T06:57:18.055296+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050350+0000","last_change":"2024-05-30T06:57:18.050350+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050350+0000","last_undegraded":"2024-05-30T06:57:18.050350+0000","last_fullsized":"2024-05-30T06:57:18.050350+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053855+0000","last_change":"2024-05-30T06:57:18.053855+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053855+0000","last_undegraded":"2024-05-30T06:57:18.053855+0000","last_fullsized":"2024-05-30T06:57:18.053855+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.047532+0000","last_change":"2024-05-30T06:57:18.047532+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.047532+0000","last_undegraded":"2024-05-30T06:57:18.047532+0000","last_fullsized":"2024-05-30T06:57:18.047532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051865+0000","last_change":"2024-05-30T06:57:18.051865+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051865+0000","last_undegraded":"2024-05-30T06:57:18.051865+0000","last_fullsized":"2024-05-30T06:57:18.051865+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053436+0000","last_change":"2024-05-30T06:57:18.053436+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053436+0000","last_undegraded":"2024-05-30T06:57:18.053436+0000","last_fullsized":"2024-05-30T06:57:18.053436+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055532+0000","last_change":"2024-05-30T06:57:18.055532+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055532+0000","last_undegraded":"2024-05-30T06:57:18.055532+0000","last_fullsized":"2024-05-30T06:57:18.055532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065817+0000","last_change":"2024-05-30T06:57:18.064919+0000","last_active":"2024-05-30T06:57:18.065817+0000","last_peered":"2024-05-30T06:57:18.065817+0000","last_clean":"2024-05-30T06:57:18.065817+0000","last_became_active":"2024-05-30T06:57:18.064658+0000","last_became_peered":"2024-05-30T06:57:18.064658+0000","last_unstale":"2024-05-30T06:57:18.065817+0000","last_undegraded":"2024-05-30T06:57:18.065817+0000","last_fullsized":"2024-05-30T06:57:18.065817+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:07:02.051446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053271+0000","last_change":"2024-05-30T06:57:18.053271+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053271+0000","last_undegraded":"2024-05-30T06:57:18.053271+0000","last_fullsized":"2024-05-30T06:57:18.053271+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.069248+0000","last_change":"2024-05-30T06:57:18.068587+0000","last_active":"2024-05-30T06:57:18.069248+0000","last_peered":"2024-05-30T06:57:18.069248+0000","last_clean":"2024-05-30T06:57:18.069248+0000","last_became_active":"2024-05-30T06:57:18.068278+0000","last_became_peered":"2024-05-30T06:57:18.068278+0000","last_unstale":"2024-05-30T06:57:18.069248+0000","last_undegraded":"2024-05-30T06:57:18.069248+0000","last_fullsized":"2024-05-30T06:57:18.069248+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:41:46.001101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054501+0000","last_change":"2024-05-30T06:57:18.054501+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054501+0000","last_undegraded":"2024-05-30T06:57:18.054501+0000","last_fullsized":"2024-05-30T06:57:18.054501+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.069013+0000","last_change":"2024-05-30T06:57:18.068473+0000","last_active":"2024-05-30T06:57:18.069013+0000","last_peered":"2024-05-30T06:57:18.069013+0000","last_clean":"2024-05-30T06:57:18.069013+0000","last_became_active":"2024-05-30T06:57:18.067152+0000","last_became_peered":"2024-05-30T06:57:18.067152+0000","last_unstale":"2024-05-30T06:57:18.069013+0000","last_undegraded":"2024-05-30T06:57:18.069013+0000","last_fullsized":"2024-05-30T06:57:18.069013+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:18:56.976311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.057090+0000","last_change":"2024-05-30T06:57:18.057090+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.057090+0000","last_undegraded":"2024-05-30T06:57:18.057090+0000","last_fullsized":"2024-05-30T06:57:18.057090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.066089+0000","last_change":"2024-05-30T06:57:18.062798+0000","last_active":"2024-05-30T06:57:18.066089+0000","last_peered":"2024-05-30T06:57:18.066089+0000","last_clean":"2024-05-30T06:57:18.066089+0000","last_became_active":"2024-05-30T06:57:18.062422+0000","last_became_peered":"2024-05-30T06:57:18.062422+0000","last_unstale":"2024-05-30T06:57:18.066089+0000","last_undegraded":"2024-05-30T06:57:18.066089+0000","last_fullsized":"2024-05-30T06:57:18.066089+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:13:56.674922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050851+0000","last_change":"2024-05-30T06:57:18.050851+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050851+0000","last_undegraded":"2024-05-30T06:57:18.050851+0000","last_fullsized":"2024-05-30T06:57:18.050851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065506+0000","last_change":"2024-05-30T06:57:18.064096+0000","last_active":"2024-05-30T06:57:18.065506+0000","last_peered":"2024-05-30T06:57:18.065506+0000","last_clean":"2024-05-30T06:57:18.065506+0000","last_became_active":"2024-05-30T06:57:18.063824+0000","last_became_peered":"2024-05-30T06:57:18.063824+0000","last_unstale":"2024-05-30T06:57:18.065506+0000","last_undegraded":"2024-05-30T06:57:18.065506+0000","last_fullsized":"2024-05-30T06:57:18.065506+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:49:55.172715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053430+0000","last_change":"2024-05-30T06:57:18.053430+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053430+0000","last_undegraded":"2024-05-30T06:57:18.053430+0000","last_fullsized":"2024-05-30T06:57:18.053430+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061632+0000","last_change":"2024-05-30T06:57:18.057527+0000","last_active":"2024-05-30T06:57:18.061632+0000","last_peered":"2024-05-30T06:57:18.061632+0000","last_clean":"2024-05-30T06:57:18.061632+0000","last_became_active":"2024-05-30T06:57:18.057148+0000","last_became_peered":"2024-05-30T06:57:18.057148+0000","last_unstale":"2024-05-30T06:57:18.061632+0000","last_undegraded":"2024-05-30T06:57:18.061632+0000","last_fullsized":"2024-05-30T06:57:18.061632+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:24:27.985268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052236+0000","last_change":"2024-05-30T06:57:18.052236+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052236+0000","last_undegraded":"2024-05-30T06:57:18.052236+0000","last_fullsized":"2024-05-30T06:57:18.052236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.057753+0000","last_change":"2024-05-30T06:57:18.054715+0000","last_active":"2024-05-30T06:57:18.057753+0000","last_peered":"2024-05-30T06:57:18.057753+0000","last_clean":"2024-05-30T06:57:18.057753+0000","last_became_active":"2024-05-30T06:57:18.054397+0000","last_became_peered":"2024-05-30T06:57:18.054397+0000","last_unstale":"2024-05-30T06:57:18.057753+0000","last_undegraded":"2024-05-30T06:57:18.057753+0000","last_fullsized":"2024-05-30T06:57:18.057753+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:08:26.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048081+0000","last_change":"2024-05-30T06:57:18.048081+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048081+0000","last_undegraded":"2024-05-30T06:57:18.048081+0000","last_fullsized":"2024-05-30T06:57:18.048081+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067054+0000","last_change":"2024-05-30T06:57:18.062207+0000","last_active":"2024-05-30T06:57:18.067054+0000","last_peered":"2024-05-30T06:57:18.067054+0000","last_clean":"2024-05-30T06:57:18.067054+0000","last_became_active":"2024-05-30T06:57:18.061886+0000","last_became_peered":"2024-05-30T06:57:18.061886+0000","last_unstale":"2024-05-30T06:57:18.067054+0000","last_undegraded":"2024-05-30T06:57:18.067054+0000","last_fullsized":"2024-05-30T06:57:18.067054+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:24:27.985268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048481+0000","last_change":"2024-05-30T06:57:18.048481+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048481+0000","last_undegraded":"2024-05-30T06:57:18.048481+0000","last_fullsized":"2024-05-30T06:57:18.048481+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068323+0000","last_change":"2024-05-30T06:57:18.063301+0000","last_active":"2024-05-30T06:57:18.068323+0000","last_peered":"2024-05-30T06:57:18.068323+0000","last_clean":"2024-05-30T06:57:18.068323+0000","last_became_active":"2024-05-30T06:57:18.063018+0000","last_became_peered":"2024-05-30T06:57:18.063018+0000","last_unstale":"2024-05-30T06:57:18.068323+0000","last_undegraded":"2024-05-30T06:57:18.068323+0000","last_fullsized":"2024-05-30T06:57:18.068323+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:58:26.774587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050522+0000","last_change":"2024-05-30T06:57:18.050522+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050522+0000","last_undegraded":"2024-05-30T06:57:18.050522+0000","last_fullsized":"2024-05-30T06:57:18.050522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067505+0000","last_change":"2024-05-30T06:57:18.064721+0000","last_active":"2024-05-30T06:57:18.067505+0000","last_peered":"2024-05-30T06:57:18.067505+0000","last_clean":"2024-05-30T06:57:18.067505+0000","last_became_active":"2024-05-30T06:57:18.064369+0000","last_became_peered":"2024-05-30T06:57:18.064369+0000","last_unstale":"2024-05-30T06:57:18.067505+0000","last_undegraded":"2024-05-30T06:57:18.067505+0000","last_fullsized":"2024-05-30T06:57:18.067505+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:14.166437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049897+0000","last_change":"2024-05-30T06:57:18.049897+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049897+0000","last_undegraded":"2024-05-30T06:57:18.049897+0000","last_fullsized":"2024-05-30T06:57:18.049897+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068921+0000","last_change":"2024-05-30T06:57:18.068132+0000","last_active":"2024-05-30T06:57:18.068921+0000","last_peered":"2024-05-30T06:57:18.068921+0000","last_clean":"2024-05-30T06:57:18.068921+0000","last_became_active":"2024-05-30T06:57:18.067200+0000","last_became_peered":"2024-05-30T06:57:18.067200+0000","last_unstale":"2024-05-30T06:57:18.068921+0000","last_undegraded":"2024-05-30T06:57:18.068921+0000","last_fullsized":"2024-05-30T06:57:18.068921+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:38:05.820026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048002+0000","last_change":"2024-05-30T06:57:18.048002+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048002+0000","last_undegraded":"2024-05-30T06:57:18.048002+0000","last_fullsized":"2024-05-30T06:57:18.048002+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.060224+0000","last_change":"2024-05-30T06:57:18.056997+0000","last_active":"2024-05-30T06:57:18.060224+0000","last_peered":"2024-05-30T06:57:18.060224+0000","last_clean":"2024-05-30T06:57:18.060224+0000","last_became_active":"2024-05-30T06:57:18.056285+0000","last_became_peered":"2024-05-30T06:57:18.056285+0000","last_unstale":"2024-05-30T06:57:18.060224+0000","last_undegraded":"2024-05-30T06:57:18.060224+0000","last_fullsized":"2024-05-30T06:57:18.060224+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:55:21.778886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049712+0000","last_change":"2024-05-30T06:57:18.049712+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049712+0000","last_undegraded":"2024-05-30T06:57:18.049712+0000","last_fullsized":"2024-05-30T06:57:18.049712+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.066754+0000","last_change":"2024-05-30T06:57:18.063576+0000","last_active":"2024-05-30T06:57:18.066754+0000","last_peered":"2024-05-30T06:57:18.066754+0000","last_clean":"2024-05-30T06:57:18.066754+0000","last_became_active":"2024-05-30T06:57:18.063292+0000","last_became_peered":"2024-05-30T06:57:18.063292+0000","last_unstale":"2024-05-30T06:57:18.066754+0000","last_undegraded":"2024-05-30T06:57:18.066754+0000","last_fullsized":"2024-05-30T06:57:18.066754+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:39:46.184728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049737+0000","last_change":"2024-05-30T06:57:18.049737+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049737+0000","last_undegraded":"2024-05-30T06:57:18.049737+0000","last_fullsized":"2024-05-30T06:57:18.049737+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062747+0000","last_change":"2024-05-30T06:57:18.061114+0000","last_active":"2024-05-30T06:57:18.062747+0000","last_peered":"2024-05-30T06:57:18.062747+0000","last_clean":"2024-05-30T06:57:18.062747+0000","last_became_active":"2024-05-30T06:57:18.060826+0000","last_became_peered":"2024-05-30T06:57:18.060826+0000","last_unstale":"2024-05-30T06:57:18.062747+0000","last_undegraded":"2024-05-30T06:57:18.062747+0000","last_fullsized":"2024-05-30T06:57:18.062747+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:08:26.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050182+0000","last_change":"2024-05-30T06:57:18.050182+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050182+0000","last_undegraded":"2024-05-30T06:57:18.050182+0000","last_fullsized":"2024-05-30T06:57:18.050182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.059213+0000","last_change":"2024-05-30T06:57:18.057392+0000","last_active":"2024-05-30T06:57:18.059213+0000","last_peered":"2024-05-30T06:57:18.059213+0000","last_clean":"2024-05-30T06:57:18.059213+0000","last_became_active":"2024-05-30T06:57:18.057040+0000","last_became_peered":"2024-05-30T06:57:18.057040+0000","last_unstale":"2024-05-30T06:57:18.059213+0000","last_undegraded":"2024-05-30T06:57:18.059213+0000","last_fullsized":"2024-05-30T06:57:18.059213+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:21:07.814279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.044366+0000","last_change":"2024-05-30T06:57:18.044366+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.044366+0000","last_undegraded":"2024-05-30T06:57:18.044366+0000","last_fullsized":"2024-05-30T06:57:18.044366+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.066901+0000","last_change":"2024-05-30T06:57:18.061898+0000","last_active":"2024-05-30T06:57:18.066901+0000","last_peered":"2024-05-30T06:57:18.066901+0000","last_clean":"2024-05-30T06:57:18.066901+0000","last_became_active":"2024-05-30T06:57:18.061632+0000","last_became_peered":"2024-05-30T06:57:18.061632+0000","last_unstale":"2024-05-30T06:57:18.066901+0000","last_undegraded":"2024-05-30T06:57:18.066901+0000","last_fullsized":"2024-05-30T06:57:18.066901+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:36.022823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056076+0000","last_change":"2024-05-30T06:57:18.056076+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056076+0000","last_undegraded":"2024-05-30T06:57:18.056076+0000","last_fullsized":"2024-05-30T06:57:18.056076+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.058485+0000","last_change":"2024-05-30T06:57:18.053358+0000","last_active":"2024-05-30T06:57:18.058485+0000","last_peered":"2024-05-30T06:57:18.058485+0000","last_clean":"2024-05-30T06:57:18.058485+0000","last_became_active":"2024-05-30T06:57:18.053073+0000","last_became_peered":"2024-05-30T06:57:18.053073+0000","last_unstale":"2024-05-30T06:57:18.058485+0000","last_undegraded":"2024-05-30T06:57:18.058485+0000","last_fullsized":"2024-05-30T06:57:18.058485+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:22.810583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.057989+0000","last_change":"2024-05-30T06:57:18.057989+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.057989+0000","last_undegraded":"2024-05-30T06:57:18.057989+0000","last_fullsized":"2024-05-30T06:57:18.057989+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065376+0000","last_change":"2024-05-30T06:57:18.062817+0000","last_active":"2024-05-30T06:57:18.065376+0000","last_peered":"2024-05-30T06:57:18.065376+0000","last_clean":"2024-05-30T06:57:18.065376+0000","last_became_active":"2024-05-30T06:57:18.062547+0000","last_became_peered":"2024-05-30T06:57:18.062547+0000","last_unstale":"2024-05-30T06:57:18.065376+0000","last_undegraded":"2024-05-30T06:57:18.065376+0000","last_fullsized":"2024-05-30T06:57:18.065376+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:23:31.504618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056626+0000","last_change":"2024-05-30T06:57:18.056626+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056626+0000","last_undegraded":"2024-05-30T06:57:18.056626+0000","last_fullsized":"2024-05-30T06:57:18.056626+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062345+0000","last_change":"2024-05-30T06:57:18.060235+0000","last_active":"2024-05-30T06:57:18.062345+0000","last_peered":"2024-05-30T06:57:18.062345+0000","last_clean":"2024-05-30T06:57:18.062345+0000","last_became_active":"2024-05-30T06:57:18.059883+0000","last_became_peered":"2024-05-30T06:57:18.059883+0000","last_unstale":"2024-05-30T06:57:18.062345+0000","last_undegraded":"2024-05-30T06:57:18.062345+0000","last_fullsized":"2024-05-30T06:57:18.062345+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:51:57.117092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056827+0000","last_change":"2024-05-30T06:57:18.056827+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056827+0000","last_undegraded":"2024-05-30T06:57:18.056827+0000","last_fullsized":"2024-05-30T06:57:18.056827+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.064962+0000","last_change":"2024-05-30T06:57:18.061015+0000","last_active":"2024-05-30T06:57:18.064962+0000","last_peered":"2024-05-30T06:57:18.064962+0000","last_clean":"2024-05-30T06:57:18.064962+0000","last_became_active":"2024-05-30T06:57:18.060726+0000","last_became_peered":"2024-05-30T06:57:18.060726+0000","last_unstale":"2024-05-30T06:57:18.064962+0000","last_undegraded":"2024-05-30T06:57:18.064962+0000","last_fullsized":"2024-05-30T06:57:18.064962+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:38:49.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052489+0000","last_change":"2024-05-30T06:57:18.052489+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052489+0000","last_undegraded":"2024-05-30T06:57:18.052489+0000","last_fullsized":"2024-05-30T06:57:18.052489+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.060610+0000","last_change":"2024-05-30T06:57:18.058579+0000","last_active":"2024-05-30T06:57:18.060610+0000","last_peered":"2024-05-30T06:57:18.060610+0000","last_clean":"2024-05-30T06:57:18.060610+0000","last_became_active":"2024-05-30T06:57:18.057970+0000","last_became_peered":"2024-05-30T06:57:18.057970+0000","last_unstale":"2024-05-30T06:57:18.060610+0000","last_undegraded":"2024-05-30T06:57:18.060610+0000","last_fullsized":"2024-05-30T06:57:18.060610+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:55:46.481052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055523+0000","last_change":"2024-05-30T06:57:18.055523+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055523+0000","last_undegraded":"2024-05-30T06:57:18.055523+0000","last_fullsized":"2024-05-30T06:57:18.055523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065122+0000","last_change":"2024-05-30T06:57:18.061904+0000","last_active":"2024-05-30T06:57:18.065122+0000","last_peered":"2024-05-30T06:57:18.065122+0000","last_clean":"2024-05-30T06:57:18.065122+0000","last_became_active":"2024-05-30T06:57:18.060839+0000","last_became_peered":"2024-05-30T06:57:18.060839+0000","last_unstale":"2024-05-30T06:57:18.065122+0000","last_undegraded":"2024-05-30T06:57:18.065122+0000","last_fullsized":"2024-05-30T06:57:18.065122+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:33:05.885862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048691+0000","last_change":"2024-05-30T06:57:18.048691+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048691+0000","last_undegraded":"2024-05-30T06:57:18.048691+0000","last_fullsized":"2024-05-30T06:57:18.048691+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067084+0000","last_change":"2024-05-30T06:57:18.064064+0000","last_active":"2024-05-30T06:57:18.067084+0000","last_peered":"2024-05-30T06:57:18.067084+0000","last_clean":"2024-05-30T06:57:18.067084+0000","last_became_active":"2024-05-30T06:57:18.060291+0000","last_became_peered":"2024-05-30T06:57:18.060291+0000","last_unstale":"2024-05-30T06:57:18.067084+0000","last_undegraded":"2024-05-30T06:57:18.067084+0000","last_fullsized":"2024-05-30T06:57:18.067084+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:01.866877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051388+0000","last_change":"2024-05-30T06:57:18.051388+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051388+0000","last_undegraded":"2024-05-30T06:57:18.051388+0000","last_fullsized":"2024-05-30T06:57:18.051388+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061310+0000","last_change":"2024-05-30T06:57:18.057816+0000","last_active":"2024-05-30T06:57:18.061310+0000","last_peered":"2024-05-30T06:57:18.061310+0000","last_clean":"2024-05-30T06:57:18.061310+0000","last_became_active":"2024-05-30T06:57:18.057548+0000","last_became_peered":"2024-05-30T06:57:18.057548+0000","last_unstale":"2024-05-30T06:57:18.061310+0000","last_undegraded":"2024-05-30T06:57:18.061310+0000","last_fullsized":"2024-05-30T06:57:18.061310+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:01.866877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053014+0000","last_change":"2024-05-30T06:57:18.053014+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053014+0000","last_undegraded":"2024-05-30T06:57:18.053014+0000","last_fullsized":"2024-05-30T06:57:18.053014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062153+0000","last_change":"2024-05-30T06:57:18.057904+0000","last_active":"2024-05-30T06:57:18.062153+0000","last_peered":"2024-05-30T06:57:18.062153+0000","last_clean":"2024-05-30T06:57:18.062153+0000","last_became_active":"2024-05-30T06:57:18.057652+0000","last_became_peered":"2024-05-30T06:57:18.057652+0000","last_unstale":"2024-05-30T06:57:18.062153+0000","last_undegraded":"2024-05-30T06:57:18.062153+0000","last_fullsized":"2024-05-30T06:57:18.062153+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:46:06.371031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052327+0000","last_change":"2024-05-30T06:57:18.052327+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052327+0000","last_undegraded":"2024-05-30T06:57:18.052327+0000","last_fullsized":"2024-05-30T06:57:18.052327+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068901+0000","last_change":"2024-05-30T06:57:18.067628+0000","last_active":"2024-05-30T06:57:18.068901+0000","last_peered":"2024-05-30T06:57:18.068901+0000","last_clean":"2024-05-30T06:57:18.068901+0000","last_became_active":"2024-05-30T06:57:18.067352+0000","last_became_peered":"2024-05-30T06:57:18.067352+0000","last_unstale":"2024-05-30T06:57:18.068901+0000","last_undegraded":"2024-05-30T06:57:18.068901+0000","last_fullsized":"2024-05-30T06:57:18.068901+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:14.166437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050895+0000","last_change":"2024-05-30T06:57:18.050895+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050895+0000","last_undegraded":"2024-05-30T06:57:18.050895+0000","last_fullsized":"2024-05-30T06:57:18.050895+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067858+0000","last_change":"2024-05-30T06:57:18.065886+0000","last_active":"2024-05-30T06:57:18.067858+0000","last_peered":"2024-05-30T06:57:18.067858+0000","last_clean":"2024-05-30T06:57:18.067858+0000","last_became_active":"2024-05-30T06:57:18.065476+0000","last_became_peered":"2024-05-30T06:57:18.065476+0000","last_unstale":"2024-05-30T06:57:18.067858+0000","last_undegraded":"2024-05-30T06:57:18.067858+0000","last_fullsized":"2024-05-30T06:57:18.067858+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:34:13.007613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050243+0000","last_change":"2024-05-30T06:57:18.050243+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050243+0000","last_undegraded":"2024-05-30T06:57:18.050243+0000","last_fullsized":"2024-05-30T06:57:18.050243+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061717+0000","last_change":"2024-05-30T06:57:18.056395+0000","last_active":"2024-05-30T06:57:18.061717+0000","last_peered":"2024-05-30T06:57:18.061717+0000","last_clean":"2024-05-30T06:57:18.061717+0000","last_became_active":"2024-05-30T06:57:18.056128+0000","last_became_peered":"2024-05-30T06:57:18.056128+0000","last_unstale":"2024-05-30T06:57:18.061717+0000","last_undegraded":"2024-05-30T06:57:18.061717+0000","last_fullsized":"2024-05-30T06:57:18.061717+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:24:45.283856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052816+0000","last_change":"2024-05-30T06:57:18.052816+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052816+0000","last_undegraded":"2024-05-30T06:57:18.052816+0000","last_fullsized":"2024-05-30T06:57:18.052816+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062459+0000","last_change":"2024-05-30T06:57:18.061248+0000","last_active":"2024-05-30T06:57:18.062459+0000","last_peered":"2024-05-30T06:57:18.062459+0000","last_clean":"2024-05-30T06:57:18.062459+0000","last_became_active":"2024-05-30T06:57:18.060853+0000","last_became_peered":"2024-05-30T06:57:18.060853+0000","last_unstale":"2024-05-30T06:57:18.062459+0000","last_undegraded":"2024-05-30T06:57:18.062459+0000","last_fullsized":"2024-05-30T06:57:18.062459+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:23:31.504618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054978+0000","last_change":"2024-05-30T06:57:18.054978+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054978+0000","last_undegraded":"2024-05-30T06:57:18.054978+0000","last_fullsized":"2024-05-30T06:57:18.054978+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.063829+0000","last_change":"2024-05-30T06:57:18.061791+0000","last_active":"2024-05-30T06:57:18.063829+0000","last_peered":"2024-05-30T06:57:18.063829+0000","last_clean":"2024-05-30T06:57:18.063829+0000","last_became_active":"2024-05-30T06:57:18.060245+0000","last_became_peered":"2024-05-30T06:57:18.060245+0000","last_unstale":"2024-05-30T06:57:18.063829+0000","last_undegraded":"2024-05-30T06:57:18.063829+0000","last_fullsized":"2024-05-30T06:57:18.063829+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:05:40.598386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051448+0000","last_change":"2024-05-30T06:57:18.051448+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051448+0000","last_undegraded":"2024-05-30T06:57:18.051448+0000","last_fullsized":"2024-05-30T06:57:18.051448+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068887+0000","last_change":"2024-05-30T06:57:18.067970+0000","last_active":"2024-05-30T06:57:18.068887+0000","last_peered":"2024-05-30T06:57:18.068887+0000","last_clean":"2024-05-30T06:57:18.068887+0000","last_became_active":"2024-05-30T06:57:18.067035+0000","last_became_peered":"2024-05-30T06:57:18.067035+0000","last_unstale":"2024-05-30T06:57:18.068887+0000","last_undegraded":"2024-05-30T06:57:18.068887+0000","last_fullsized":"2024-05-30T06:57:18.068887+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:34:13.007613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049877+0000","last_change":"2024-05-30T06:57:18.049877+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049877+0000","last_undegraded":"2024-05-30T06:57:18.049877+0000","last_fullsized":"2024-05-30T06:57:18.049877+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061295+0000","last_change":"2024-05-30T06:57:18.059661+0000","last_active":"2024-05-30T06:57:18.061295+0000","last_peered":"2024-05-30T06:57:18.061295+0000","last_clean":"2024-05-30T06:57:18.061295+0000","last_became_active":"2024-05-30T06:57:18.059346+0000","last_became_peered":"2024-05-30T06:57:18.059346+0000","last_unstale":"2024-05-30T06:57:18.061295+0000","last_undegraded":"2024-05-30T06:57:18.061295+0000","last_fullsized":"2024-05-30T06:57:18.061295+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:32:03.097835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":346,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062685+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:57:18.062685+0000","last_peered":"2024-05-30T06:57:18.062685+0000","last_clean":"2024-05-30T06:57:18.062685+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:57:18.062685+0000","last_undegraded":"2024-05-30T06:57:18.062685+0000","last_fullsized":"2024-05-30T06:57:18.062685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123284,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248556,"statfs":{"total":96636764160,"available":96510521344,"internally_reserved":0,"allocated":1974272,"data_stored":1190970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126876,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244964,"statfs":{"total":96636764160,"available":96506843136,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76880,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294960,"statfs":{"total":96636764160,"available":96558039040,"internally_reserved":0,"allocated":1380352,"data_stored":600602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86620,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94285220,"statfs":{"total":96636764160,"available":96548065280,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144912,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226928,"statfs":{"total":96636764160,"available":96488374272,"internally_reserved":0,"allocated":1380352,"data_stored":600602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":146995655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575034,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144928,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226912,"statfs":{"total":96636764160,"available":96488357888,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104672,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94267168,"statfs":{"total":96636764160,"available":96529580032,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64992,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306848,"statfs":{"total":96636764160,"available":96570212352,"internally_reserved":0,"allocated":1974272,"data_stored":1190970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:57:23.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:57:23.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff71ce00640 1 Processor -- start 2024-05-30T06:57:23.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff71ce00640 1 -- start start 2024-05-30T06:57:23.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff71ce00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7180b2ec0 0x7ff7180b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff71ce00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff71815c8f0 con 0x7ff71806f9a0 2024-05-30T06:57:23.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff71ce00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7180ccc80 con 0x7ff718155e60 2024-05-30T06:57:23.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff71ce00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff7180ccff0 con 0x7ff7180b2ec0 2024-05-30T06:57:23.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff70fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff71806f9a0 0x7ff7180cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39804/0 (socket says 172.21.15.37:39804) 2024-05-30T06:57:23.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff70fe00640 1 -- 172.21.15.37:0/697720358 learned_addr learned my addr 172.21.15.37:0/697720358 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:23.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff716800640 1 --2- 172.21.15.37:0/697720358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7180b2ec0 0x7ff7180b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff715400640 1 -- 172.21.15.37:0/697720358 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675546538 0 0) 0x7ff71815c8f0 con 0x7ff71806f9a0 2024-05-30T06:57:23.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff715400640 1 -- 172.21.15.37:0/697720358 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6fc003530 con 0x7ff71806f9a0 2024-05-30T06:57:23.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff715400640 1 -- 172.21.15.37:0/697720358 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1310941190 0 0) 0x7ff7180ccc80 con 0x7ff718155e60 2024-05-30T06:57:23.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff715400640 1 -- 172.21.15.37:0/697720358 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff71815c8f0 con 0x7ff718155e60 2024-05-30T06:57:23.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff716800640 1 -- 172.21.15.37:0/697720358 >> v1:172.21.15.105:6789/0 conn(0x7ff718155e60 legacy=0x7ff7180cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff716800640 1 -- 172.21.15.37:0/697720358 >> v1:172.21.15.37:6789/0 conn(0x7ff71806f9a0 legacy=0x7ff7180cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff715400640 1 -- 172.21.15.37:0/697720358 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3767105840 0 0) 0x7ff6fc003530 con 0x7ff71806f9a0 2024-05-30T06:57:23.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.375+0000 7ff716800640 1 -- 172.21.15.37:0/697720358 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71815cbd0 con 0x7ff7180b2ec0 2024-05-30T06:57:23.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.383+0000 7ff716800640 1 --2- 172.21.15.37:0/697720358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7180b2ec0 0x7ff7180b36a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff710009dc0 tx=0x7ff71001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61f8c12c9cefe7f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:23.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.383+0000 7ff715400640 1 -- 172.21.15.37:0/697720358 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7100b2070 con 0x7ff7180b2ec0 2024-05-30T06:57:23.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.383+0000 7ff715400640 1 -- 172.21.15.37:0/697720358 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7100a5920 con 0x7ff7180b2ec0 2024-05-30T06:57:23.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.383+0000 7ff715400640 1 -- 172.21.15.37:0/697720358 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7100a5cf0 con 0x7ff7180b2ec0 2024-05-30T06:57:23.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.383+0000 7ff71ce00640 1 -- 172.21.15.37:0/697720358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7180b2ec0 msgr2=0x7ff7180b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.383+0000 7ff71ce00640 1 --2- 172.21.15.37:0/697720358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7180b2ec0 0x7ff7180b36a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff710009dc0 tx=0x7ff71001c990 comp rx=0 tx=0).stop 2024-05-30T06:57:23.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.383+0000 7ff71ce00640 1 -- 172.21.15.37:0/697720358 shutdown_connections 2024-05-30T06:57:23.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.383+0000 7ff71ce00640 1 --2- 172.21.15.37:0/697720358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7180b2ec0 0x7ff7180b36a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.383+0000 7ff71ce00640 1 -- 172.21.15.37:0/697720358 >> 172.21.15.37:0/697720358 conn(0x7ff7180b23a0 msgr2=0x7ff7180b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:23.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.383+0000 7ff71ce00640 1 -- 172.21.15.37:0/697720358 shutdown_connections 2024-05-30T06:57:23.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.383+0000 7ff71ce00640 1 -- 172.21.15.37:0/697720358 wait complete. 2024-05-30T06:57:23.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff71ce00640 1 Processor -- start 2024-05-30T06:57:23.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff71ce00640 1 -- start start 2024-05-30T06:57:23.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff71ce00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff71806f9a0 0x7ff718159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff71ce00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7180b2ec0 0x7ff7181581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff71ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff718155e60 0x7ff7181586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff71ce00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff718169a00 con 0x7ff718155e60 2024-05-30T06:57:23.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff71ce00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff718169880 con 0x7ff7180b2ec0 2024-05-30T06:57:23.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff71ce00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff718169b80 con 0x7ff71806f9a0 2024-05-30T06:57:23.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff716800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff718155e60 0x7ff7181586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff716800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff718155e60 0x7ff7181586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56048/0 (socket says 172.21.15.37:56048) 2024-05-30T06:57:23.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff716800640 1 -- 172.21.15.37:0/232306259 learned_addr learned my addr 172.21.15.37:0/232306259 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:23.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff715e00640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff71806f9a0 0x7ff718159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff70fe00640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7180b2ec0 0x7ff7181581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff716800640 1 -- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff71806f9a0 msgr2=0x7ff718159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff716800640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff71806f9a0 0x7ff718159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff716800640 1 -- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7180b2ec0 msgr2=0x7ff7181581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff716800640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7180b2ec0 0x7ff7181581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff716800640 1 -- 172.21.15.37:0/232306259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7180cc440 con 0x7ff718155e60 2024-05-30T06:57:23.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff716800640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff718155e60 0x7ff7181586e0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7ff7100b0040 tx=0x7ff710019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:23.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff70e000640 1 -- 172.21.15.37:0/232306259 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7100b2050 con 0x7ff718155e60 2024-05-30T06:57:23.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff70e000640 1 -- 172.21.15.37:0/232306259 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7100be070 con 0x7ff718155e60 2024-05-30T06:57:23.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff70e000640 1 -- 172.21.15.37:0/232306259 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710009450 con 0x7ff718155e60 2024-05-30T06:57:23.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff71ce00640 1 -- 172.21.15.37:0/232306259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff718158cc0 con 0x7ff718155e60 2024-05-30T06:57:23.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff71ce00640 1 -- 172.21.15.37:0/232306259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7180cc0f0 con 0x7ff718155e60 2024-05-30T06:57:23.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff71ce00640 1 -- 172.21.15.37:0/232306259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff718068b20 con 0x7ff718155e60 2024-05-30T06:57:23.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff70e000640 1 -- 172.21.15.37:0/232306259 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7ff7100adce0 con 0x7ff718155e60 2024-05-30T06:57:23.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff70e000640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff6f4069bb0 0x7ff6f406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff70e000640 1 -- 172.21.15.37:0/232306259 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7ff710120a10 con 0x7ff718155e60 2024-05-30T06:57:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff715e00640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff6f4069bb0 0x7ff6f406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.387+0000 7ff715e00640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff6f4069bb0 0x7ff6f406c070 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff7080011f0 tx=0x7ff708009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:23.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.395+0000 7ff70e000640 1 -- 172.21.15.37:0/232306259 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff710016580 con 0x7ff718155e60 2024-05-30T06:57:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.551+0000 7ff71ce00640 1 -- 172.21.15.37:0/232306259 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff7180b20e0 con 0x7ff6f4069bb0 2024-05-30T06:57:23.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.563+0000 7ff70e000640 1 -- 172.21.15.37:0/232306259 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247105 (secure 0 0 0) 0x7ff7180b20e0 con 0x7ff6f4069bb0 2024-05-30T06:57:23.565 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:57:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.563+0000 7ff71ce00640 1 -- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff6f4069bb0 msgr2=0x7ff6f406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.563+0000 7ff71ce00640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff6f4069bb0 0x7ff6f406c070 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff7080011f0 tx=0x7ff708009040 comp rx=0 tx=0).stop 2024-05-30T06:57:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.563+0000 7ff71ce00640 1 -- 172.21.15.37:0/232306259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff718155e60 msgr2=0x7ff7181586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.563+0000 7ff71ce00640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff718155e60 0x7ff7181586e0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7ff7100b0040 tx=0x7ff710019730 comp rx=0 tx=0).stop 2024-05-30T06:57:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.563+0000 7ff71ce00640 1 -- 172.21.15.37:0/232306259 shutdown_connections 2024-05-30T06:57:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.563+0000 7ff71ce00640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff718155e60 0x7ff7181586e0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.563+0000 7ff71ce00640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff6f4069bb0 0x7ff6f406c070 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.563+0000 7ff71ce00640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7180b2ec0 0x7ff7181581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.563+0000 7ff71ce00640 1 --2- 172.21.15.37:0/232306259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff71806f9a0 0x7ff718159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.563+0000 7ff71ce00640 1 -- 172.21.15.37:0/232306259 >> 172.21.15.37:0/232306259 conn(0x7ff7180b23a0 msgr2=0x7ff7180cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.563+0000 7ff71ce00640 1 -- 172.21.15.37:0/232306259 shutdown_connections 2024-05-30T06:57:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.563+0000 7ff71ce00640 1 -- 172.21.15.37:0/232306259 wait complete. 2024-05-30T06:57:23.586 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":569,"stamp":"2024-05-30T06:57:22.971320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":873164,"kb_used_data":11992,"kb_used_omap":12,"kb_used_meta":861043,"kb_avail":754101556,"statfs":{"total":773094113280,"available":772199993344,"internally_reserved":0,"allocated":12279808,"data_stored":6010876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":881708592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.930294"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.058541+0000","last_change":"2024-05-30T06:57:18.058541+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.058541+0000","last_undegraded":"2024-05-30T06:57:18.058541+0000","last_fullsized":"2024-05-30T06:57:18.058541+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050299+0000","last_change":"2024-05-30T06:57:18.050299+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050299+0000","last_undegraded":"2024-05-30T06:57:18.050299+0000","last_fullsized":"2024-05-30T06:57:18.050299+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.060020+0000","last_change":"2024-05-30T06:57:18.060020+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.060020+0000","last_undegraded":"2024-05-30T06:57:18.060020+0000","last_fullsized":"2024-05-30T06:57:18.060020+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056676+0000","last_change":"2024-05-30T06:57:18.056676+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056676+0000","last_undegraded":"2024-05-30T06:57:18.056676+0000","last_fullsized":"2024-05-30T06:57:18.056676+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.043649+0000","last_change":"2024-05-30T06:57:18.043649+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.043649+0000","last_undegraded":"2024-05-30T06:57:18.043649+0000","last_fullsized":"2024-05-30T06:57:18.043649+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053062+0000","last_change":"2024-05-30T06:57:18.053062+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053062+0000","last_undegraded":"2024-05-30T06:57:18.053062+0000","last_fullsized":"2024-05-30T06:57:18.053062+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.047532+0000","last_change":"2024-05-30T06:57:18.047532+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.047532+0000","last_undegraded":"2024-05-30T06:57:18.047532+0000","last_fullsized":"2024-05-30T06:57:18.047532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055958+0000","last_change":"2024-05-30T06:57:18.055958+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055958+0000","last_undegraded":"2024-05-30T06:57:18.055958+0000","last_fullsized":"2024-05-30T06:57:18.055958+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055512+0000","last_change":"2024-05-30T06:57:18.055512+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055512+0000","last_undegraded":"2024-05-30T06:57:18.055512+0000","last_fullsized":"2024-05-30T06:57:18.055512+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054891+0000","last_change":"2024-05-30T06:57:18.054891+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054891+0000","last_undegraded":"2024-05-30T06:57:18.054891+0000","last_fullsized":"2024-05-30T06:57:18.054891+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051576+0000","last_change":"2024-05-30T06:57:18.051576+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051576+0000","last_undegraded":"2024-05-30T06:57:18.051576+0000","last_fullsized":"2024-05-30T06:57:18.051576+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055925+0000","last_change":"2024-05-30T06:57:18.055925+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055925+0000","last_undegraded":"2024-05-30T06:57:18.055925+0000","last_fullsized":"2024-05-30T06:57:18.055925+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056014+0000","last_change":"2024-05-30T06:57:18.056014+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056014+0000","last_undegraded":"2024-05-30T06:57:18.056014+0000","last_fullsized":"2024-05-30T06:57:18.056014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.060488+0000","last_change":"2024-05-30T06:57:18.060488+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.060488+0000","last_undegraded":"2024-05-30T06:57:18.060488+0000","last_fullsized":"2024-05-30T06:57:18.060488+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053019+0000","last_change":"2024-05-30T06:57:18.053019+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053019+0000","last_undegraded":"2024-05-30T06:57:18.053019+0000","last_fullsized":"2024-05-30T06:57:18.053019+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053105+0000","last_change":"2024-05-30T06:57:18.053105+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053105+0000","last_undegraded":"2024-05-30T06:57:18.053105+0000","last_fullsized":"2024-05-30T06:57:18.053105+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052523+0000","last_change":"2024-05-30T06:57:18.052523+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052523+0000","last_undegraded":"2024-05-30T06:57:18.052523+0000","last_fullsized":"2024-05-30T06:57:18.052523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055005+0000","last_change":"2024-05-30T06:57:18.055005+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055005+0000","last_undegraded":"2024-05-30T06:57:18.055005+0000","last_fullsized":"2024-05-30T06:57:18.055005+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.059570+0000","last_change":"2024-05-30T06:57:18.059570+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.059570+0000","last_undegraded":"2024-05-30T06:57:18.059570+0000","last_fullsized":"2024-05-30T06:57:18.059570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051075+0000","last_change":"2024-05-30T06:57:18.051075+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051075+0000","last_undegraded":"2024-05-30T06:57:18.051075+0000","last_fullsized":"2024-05-30T06:57:18.051075+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052332+0000","last_change":"2024-05-30T06:57:18.052332+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052332+0000","last_undegraded":"2024-05-30T06:57:18.052332+0000","last_fullsized":"2024-05-30T06:57:18.052332+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054332+0000","last_change":"2024-05-30T06:57:18.054332+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054332+0000","last_undegraded":"2024-05-30T06:57:18.054332+0000","last_fullsized":"2024-05-30T06:57:18.054332+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049936+0000","last_change":"2024-05-30T06:57:18.049936+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049936+0000","last_undegraded":"2024-05-30T06:57:18.049936+0000","last_fullsized":"2024-05-30T06:57:18.049936+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050317+0000","last_change":"2024-05-30T06:57:18.050317+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050317+0000","last_undegraded":"2024-05-30T06:57:18.050317+0000","last_fullsized":"2024-05-30T06:57:18.050317+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052099+0000","last_change":"2024-05-30T06:57:18.052099+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052099+0000","last_undegraded":"2024-05-30T06:57:18.052099+0000","last_fullsized":"2024-05-30T06:57:18.052099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053556+0000","last_change":"2024-05-30T06:57:18.053556+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053556+0000","last_undegraded":"2024-05-30T06:57:18.053556+0000","last_fullsized":"2024-05-30T06:57:18.053556+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055296+0000","last_change":"2024-05-30T06:57:18.055296+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055296+0000","last_undegraded":"2024-05-30T06:57:18.055296+0000","last_fullsized":"2024-05-30T06:57:18.055296+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050350+0000","last_change":"2024-05-30T06:57:18.050350+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050350+0000","last_undegraded":"2024-05-30T06:57:18.050350+0000","last_fullsized":"2024-05-30T06:57:18.050350+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053855+0000","last_change":"2024-05-30T06:57:18.053855+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053855+0000","last_undegraded":"2024-05-30T06:57:18.053855+0000","last_fullsized":"2024-05-30T06:57:18.053855+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.047532+0000","last_change":"2024-05-30T06:57:18.047532+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.047532+0000","last_undegraded":"2024-05-30T06:57:18.047532+0000","last_fullsized":"2024-05-30T06:57:18.047532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051865+0000","last_change":"2024-05-30T06:57:18.051865+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051865+0000","last_undegraded":"2024-05-30T06:57:18.051865+0000","last_fullsized":"2024-05-30T06:57:18.051865+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053436+0000","last_change":"2024-05-30T06:57:18.053436+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053436+0000","last_undegraded":"2024-05-30T06:57:18.053436+0000","last_fullsized":"2024-05-30T06:57:18.053436+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055532+0000","last_change":"2024-05-30T06:57:18.055532+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055532+0000","last_undegraded":"2024-05-30T06:57:18.055532+0000","last_fullsized":"2024-05-30T06:57:18.055532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065817+0000","last_change":"2024-05-30T06:57:18.064919+0000","last_active":"2024-05-30T06:57:18.065817+0000","last_peered":"2024-05-30T06:57:18.065817+0000","last_clean":"2024-05-30T06:57:18.065817+0000","last_became_active":"2024-05-30T06:57:18.064658+0000","last_became_peered":"2024-05-30T06:57:18.064658+0000","last_unstale":"2024-05-30T06:57:18.065817+0000","last_undegraded":"2024-05-30T06:57:18.065817+0000","last_fullsized":"2024-05-30T06:57:18.065817+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:07:02.051446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053271+0000","last_change":"2024-05-30T06:57:18.053271+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053271+0000","last_undegraded":"2024-05-30T06:57:18.053271+0000","last_fullsized":"2024-05-30T06:57:18.053271+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.069248+0000","last_change":"2024-05-30T06:57:18.068587+0000","last_active":"2024-05-30T06:57:18.069248+0000","last_peered":"2024-05-30T06:57:18.069248+0000","last_clean":"2024-05-30T06:57:18.069248+0000","last_became_active":"2024-05-30T06:57:18.068278+0000","last_became_peered":"2024-05-30T06:57:18.068278+0000","last_unstale":"2024-05-30T06:57:18.069248+0000","last_undegraded":"2024-05-30T06:57:18.069248+0000","last_fullsized":"2024-05-30T06:57:18.069248+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:41:46.001101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054501+0000","last_change":"2024-05-30T06:57:18.054501+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054501+0000","last_undegraded":"2024-05-30T06:57:18.054501+0000","last_fullsized":"2024-05-30T06:57:18.054501+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.069013+0000","last_change":"2024-05-30T06:57:18.068473+0000","last_active":"2024-05-30T06:57:18.069013+0000","last_peered":"2024-05-30T06:57:18.069013+0000","last_clean":"2024-05-30T06:57:18.069013+0000","last_became_active":"2024-05-30T06:57:18.067152+0000","last_became_peered":"2024-05-30T06:57:18.067152+0000","last_unstale":"2024-05-30T06:57:18.069013+0000","last_undegraded":"2024-05-30T06:57:18.069013+0000","last_fullsized":"2024-05-30T06:57:18.069013+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:18:56.976311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.057090+0000","last_change":"2024-05-30T06:57:18.057090+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.057090+0000","last_undegraded":"2024-05-30T06:57:18.057090+0000","last_fullsized":"2024-05-30T06:57:18.057090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.066089+0000","last_change":"2024-05-30T06:57:18.062798+0000","last_active":"2024-05-30T06:57:18.066089+0000","last_peered":"2024-05-30T06:57:18.066089+0000","last_clean":"2024-05-30T06:57:18.066089+0000","last_became_active":"2024-05-30T06:57:18.062422+0000","last_became_peered":"2024-05-30T06:57:18.062422+0000","last_unstale":"2024-05-30T06:57:18.066089+0000","last_undegraded":"2024-05-30T06:57:18.066089+0000","last_fullsized":"2024-05-30T06:57:18.066089+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:13:56.674922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050851+0000","last_change":"2024-05-30T06:57:18.050851+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050851+0000","last_undegraded":"2024-05-30T06:57:18.050851+0000","last_fullsized":"2024-05-30T06:57:18.050851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065506+0000","last_change":"2024-05-30T06:57:18.064096+0000","last_active":"2024-05-30T06:57:18.065506+0000","last_peered":"2024-05-30T06:57:18.065506+0000","last_clean":"2024-05-30T06:57:18.065506+0000","last_became_active":"2024-05-30T06:57:18.063824+0000","last_became_peered":"2024-05-30T06:57:18.063824+0000","last_unstale":"2024-05-30T06:57:18.065506+0000","last_undegraded":"2024-05-30T06:57:18.065506+0000","last_fullsized":"2024-05-30T06:57:18.065506+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:49:55.172715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053430+0000","last_change":"2024-05-30T06:57:18.053430+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053430+0000","last_undegraded":"2024-05-30T06:57:18.053430+0000","last_fullsized":"2024-05-30T06:57:18.053430+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061632+0000","last_change":"2024-05-30T06:57:18.057527+0000","last_active":"2024-05-30T06:57:18.061632+0000","last_peered":"2024-05-30T06:57:18.061632+0000","last_clean":"2024-05-30T06:57:18.061632+0000","last_became_active":"2024-05-30T06:57:18.057148+0000","last_became_peered":"2024-05-30T06:57:18.057148+0000","last_unstale":"2024-05-30T06:57:18.061632+0000","last_undegraded":"2024-05-30T06:57:18.061632+0000","last_fullsized":"2024-05-30T06:57:18.061632+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:24:27.985268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052236+0000","last_change":"2024-05-30T06:57:18.052236+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052236+0000","last_undegraded":"2024-05-30T06:57:18.052236+0000","last_fullsized":"2024-05-30T06:57:18.052236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.057753+0000","last_change":"2024-05-30T06:57:18.054715+0000","last_active":"2024-05-30T06:57:18.057753+0000","last_peered":"2024-05-30T06:57:18.057753+0000","last_clean":"2024-05-30T06:57:18.057753+0000","last_became_active":"2024-05-30T06:57:18.054397+0000","last_became_peered":"2024-05-30T06:57:18.054397+0000","last_unstale":"2024-05-30T06:57:18.057753+0000","last_undegraded":"2024-05-30T06:57:18.057753+0000","last_fullsized":"2024-05-30T06:57:18.057753+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:08:26.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048081+0000","last_change":"2024-05-30T06:57:18.048081+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048081+0000","last_undegraded":"2024-05-30T06:57:18.048081+0000","last_fullsized":"2024-05-30T06:57:18.048081+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067054+0000","last_change":"2024-05-30T06:57:18.062207+0000","last_active":"2024-05-30T06:57:18.067054+0000","last_peered":"2024-05-30T06:57:18.067054+0000","last_clean":"2024-05-30T06:57:18.067054+0000","last_became_active":"2024-05-30T06:57:18.061886+0000","last_became_peered":"2024-05-30T06:57:18.061886+0000","last_unstale":"2024-05-30T06:57:18.067054+0000","last_undegraded":"2024-05-30T06:57:18.067054+0000","last_fullsized":"2024-05-30T06:57:18.067054+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:24:27.985268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048481+0000","last_change":"2024-05-30T06:57:18.048481+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048481+0000","last_undegraded":"2024-05-30T06:57:18.048481+0000","last_fullsized":"2024-05-30T06:57:18.048481+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068323+0000","last_change":"2024-05-30T06:57:18.063301+0000","last_active":"2024-05-30T06:57:18.068323+0000","last_peered":"2024-05-30T06:57:18.068323+0000","last_clean":"2024-05-30T06:57:18.068323+0000","last_became_active":"2024-05-30T06:57:18.063018+0000","last_became_peered":"2024-05-30T06:57:18.063018+0000","last_unstale":"2024-05-30T06:57:18.068323+0000","last_undegraded":"2024-05-30T06:57:18.068323+0000","last_fullsized":"2024-05-30T06:57:18.068323+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:58:26.774587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050522+0000","last_change":"2024-05-30T06:57:18.050522+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050522+0000","last_undegraded":"2024-05-30T06:57:18.050522+0000","last_fullsized":"2024-05-30T06:57:18.050522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067505+0000","last_change":"2024-05-30T06:57:18.064721+0000","last_active":"2024-05-30T06:57:18.067505+0000","last_peered":"2024-05-30T06:57:18.067505+0000","last_clean":"2024-05-30T06:57:18.067505+0000","last_became_active":"2024-05-30T06:57:18.064369+0000","last_became_peered":"2024-05-30T06:57:18.064369+0000","last_unstale":"2024-05-30T06:57:18.067505+0000","last_undegraded":"2024-05-30T06:57:18.067505+0000","last_fullsized":"2024-05-30T06:57:18.067505+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:14.166437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049897+0000","last_change":"2024-05-30T06:57:18.049897+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049897+0000","last_undegraded":"2024-05-30T06:57:18.049897+0000","last_fullsized":"2024-05-30T06:57:18.049897+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068921+0000","last_change":"2024-05-30T06:57:18.068132+0000","last_active":"2024-05-30T06:57:18.068921+0000","last_peered":"2024-05-30T06:57:18.068921+0000","last_clean":"2024-05-30T06:57:18.068921+0000","last_became_active":"2024-05-30T06:57:18.067200+0000","last_became_peered":"2024-05-30T06:57:18.067200+0000","last_unstale":"2024-05-30T06:57:18.068921+0000","last_undegraded":"2024-05-30T06:57:18.068921+0000","last_fullsized":"2024-05-30T06:57:18.068921+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:38:05.820026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048002+0000","last_change":"2024-05-30T06:57:18.048002+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048002+0000","last_undegraded":"2024-05-30T06:57:18.048002+0000","last_fullsized":"2024-05-30T06:57:18.048002+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.060224+0000","last_change":"2024-05-30T06:57:18.056997+0000","last_active":"2024-05-30T06:57:18.060224+0000","last_peered":"2024-05-30T06:57:18.060224+0000","last_clean":"2024-05-30T06:57:18.060224+0000","last_became_active":"2024-05-30T06:57:18.056285+0000","last_became_peered":"2024-05-30T06:57:18.056285+0000","last_unstale":"2024-05-30T06:57:18.060224+0000","last_undegraded":"2024-05-30T06:57:18.060224+0000","last_fullsized":"2024-05-30T06:57:18.060224+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:55:21.778886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049712+0000","last_change":"2024-05-30T06:57:18.049712+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049712+0000","last_undegraded":"2024-05-30T06:57:18.049712+0000","last_fullsized":"2024-05-30T06:57:18.049712+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.066754+0000","last_change":"2024-05-30T06:57:18.063576+0000","last_active":"2024-05-30T06:57:18.066754+0000","last_peered":"2024-05-30T06:57:18.066754+0000","last_clean":"2024-05-30T06:57:18.066754+0000","last_became_active":"2024-05-30T06:57:18.063292+0000","last_became_peered":"2024-05-30T06:57:18.063292+0000","last_unstale":"2024-05-30T06:57:18.066754+0000","last_undegraded":"2024-05-30T06:57:18.066754+0000","last_fullsized":"2024-05-30T06:57:18.066754+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:39:46.184728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049737+0000","last_change":"2024-05-30T06:57:18.049737+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049737+0000","last_undegraded":"2024-05-30T06:57:18.049737+0000","last_fullsized":"2024-05-30T06:57:18.049737+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062747+0000","last_change":"2024-05-30T06:57:18.061114+0000","last_active":"2024-05-30T06:57:18.062747+0000","last_peered":"2024-05-30T06:57:18.062747+0000","last_clean":"2024-05-30T06:57:18.062747+0000","last_became_active":"2024-05-30T06:57:18.060826+0000","last_became_peered":"2024-05-30T06:57:18.060826+0000","last_unstale":"2024-05-30T06:57:18.062747+0000","last_undegraded":"2024-05-30T06:57:18.062747+0000","last_fullsized":"2024-05-30T06:57:18.062747+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:08:26.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050182+0000","last_change":"2024-05-30T06:57:18.050182+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050182+0000","last_undegraded":"2024-05-30T06:57:18.050182+0000","last_fullsized":"2024-05-30T06:57:18.050182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.059213+0000","last_change":"2024-05-30T06:57:18.057392+0000","last_active":"2024-05-30T06:57:18.059213+0000","last_peered":"2024-05-30T06:57:18.059213+0000","last_clean":"2024-05-30T06:57:18.059213+0000","last_became_active":"2024-05-30T06:57:18.057040+0000","last_became_peered":"2024-05-30T06:57:18.057040+0000","last_unstale":"2024-05-30T06:57:18.059213+0000","last_undegraded":"2024-05-30T06:57:18.059213+0000","last_fullsized":"2024-05-30T06:57:18.059213+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:21:07.814279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.044366+0000","last_change":"2024-05-30T06:57:18.044366+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.044366+0000","last_undegraded":"2024-05-30T06:57:18.044366+0000","last_fullsized":"2024-05-30T06:57:18.044366+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.066901+0000","last_change":"2024-05-30T06:57:18.061898+0000","last_active":"2024-05-30T06:57:18.066901+0000","last_peered":"2024-05-30T06:57:18.066901+0000","last_clean":"2024-05-30T06:57:18.066901+0000","last_became_active":"2024-05-30T06:57:18.061632+0000","last_became_peered":"2024-05-30T06:57:18.061632+0000","last_unstale":"2024-05-30T06:57:18.066901+0000","last_undegraded":"2024-05-30T06:57:18.066901+0000","last_fullsized":"2024-05-30T06:57:18.066901+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:36.022823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056076+0000","last_change":"2024-05-30T06:57:18.056076+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056076+0000","last_undegraded":"2024-05-30T06:57:18.056076+0000","last_fullsized":"2024-05-30T06:57:18.056076+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.058485+0000","last_change":"2024-05-30T06:57:18.053358+0000","last_active":"2024-05-30T06:57:18.058485+0000","last_peered":"2024-05-30T06:57:18.058485+0000","last_clean":"2024-05-30T06:57:18.058485+0000","last_became_active":"2024-05-30T06:57:18.053073+0000","last_became_peered":"2024-05-30T06:57:18.053073+0000","last_unstale":"2024-05-30T06:57:18.058485+0000","last_undegraded":"2024-05-30T06:57:18.058485+0000","last_fullsized":"2024-05-30T06:57:18.058485+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:22.810583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.057989+0000","last_change":"2024-05-30T06:57:18.057989+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.057989+0000","last_undegraded":"2024-05-30T06:57:18.057989+0000","last_fullsized":"2024-05-30T06:57:18.057989+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065376+0000","last_change":"2024-05-30T06:57:18.062817+0000","last_active":"2024-05-30T06:57:18.065376+0000","last_peered":"2024-05-30T06:57:18.065376+0000","last_clean":"2024-05-30T06:57:18.065376+0000","last_became_active":"2024-05-30T06:57:18.062547+0000","last_became_peered":"2024-05-30T06:57:18.062547+0000","last_unstale":"2024-05-30T06:57:18.065376+0000","last_undegraded":"2024-05-30T06:57:18.065376+0000","last_fullsized":"2024-05-30T06:57:18.065376+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:23:31.504618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056626+0000","last_change":"2024-05-30T06:57:18.056626+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056626+0000","last_undegraded":"2024-05-30T06:57:18.056626+0000","last_fullsized":"2024-05-30T06:57:18.056626+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062345+0000","last_change":"2024-05-30T06:57:18.060235+0000","last_active":"2024-05-30T06:57:18.062345+0000","last_peered":"2024-05-30T06:57:18.062345+0000","last_clean":"2024-05-30T06:57:18.062345+0000","last_became_active":"2024-05-30T06:57:18.059883+0000","last_became_peered":"2024-05-30T06:57:18.059883+0000","last_unstale":"2024-05-30T06:57:18.062345+0000","last_undegraded":"2024-05-30T06:57:18.062345+0000","last_fullsized":"2024-05-30T06:57:18.062345+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:51:57.117092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056827+0000","last_change":"2024-05-30T06:57:18.056827+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056827+0000","last_undegraded":"2024-05-30T06:57:18.056827+0000","last_fullsized":"2024-05-30T06:57:18.056827+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.064962+0000","last_change":"2024-05-30T06:57:18.061015+0000","last_active":"2024-05-30T06:57:18.064962+0000","last_peered":"2024-05-30T06:57:18.064962+0000","last_clean":"2024-05-30T06:57:18.064962+0000","last_became_active":"2024-05-30T06:57:18.060726+0000","last_became_peered":"2024-05-30T06:57:18.060726+0000","last_unstale":"2024-05-30T06:57:18.064962+0000","last_undegraded":"2024-05-30T06:57:18.064962+0000","last_fullsized":"2024-05-30T06:57:18.064962+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:38:49.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052489+0000","last_change":"2024-05-30T06:57:18.052489+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052489+0000","last_undegraded":"2024-05-30T06:57:18.052489+0000","last_fullsized":"2024-05-30T06:57:18.052489+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.060610+0000","last_change":"2024-05-30T06:57:18.058579+0000","last_active":"2024-05-30T06:57:18.060610+0000","last_peered":"2024-05-30T06:57:18.060610+0000","last_clean":"2024-05-30T06:57:18.060610+0000","last_became_active":"2024-05-30T06:57:18.057970+0000","last_became_peered":"2024-05-30T06:57:18.057970+0000","last_unstale":"2024-05-30T06:57:18.060610+0000","last_undegraded":"2024-05-30T06:57:18.060610+0000","last_fullsized":"2024-05-30T06:57:18.060610+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:55:46.481052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055523+0000","last_change":"2024-05-30T06:57:18.055523+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055523+0000","last_undegraded":"2024-05-30T06:57:18.055523+0000","last_fullsized":"2024-05-30T06:57:18.055523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065122+0000","last_change":"2024-05-30T06:57:18.061904+0000","last_active":"2024-05-30T06:57:18.065122+0000","last_peered":"2024-05-30T06:57:18.065122+0000","last_clean":"2024-05-30T06:57:18.065122+0000","last_became_active":"2024-05-30T06:57:18.060839+0000","last_became_peered":"2024-05-30T06:57:18.060839+0000","last_unstale":"2024-05-30T06:57:18.065122+0000","last_undegraded":"2024-05-30T06:57:18.065122+0000","last_fullsized":"2024-05-30T06:57:18.065122+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:33:05.885862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048691+0000","last_change":"2024-05-30T06:57:18.048691+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048691+0000","last_undegraded":"2024-05-30T06:57:18.048691+0000","last_fullsized":"2024-05-30T06:57:18.048691+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067084+0000","last_change":"2024-05-30T06:57:18.064064+0000","last_active":"2024-05-30T06:57:18.067084+0000","last_peered":"2024-05-30T06:57:18.067084+0000","last_clean":"2024-05-30T06:57:18.067084+0000","last_became_active":"2024-05-30T06:57:18.060291+0000","last_became_peered":"2024-05-30T06:57:18.060291+0000","last_unstale":"2024-05-30T06:57:18.067084+0000","last_undegraded":"2024-05-30T06:57:18.067084+0000","last_fullsized":"2024-05-30T06:57:18.067084+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:01.866877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051388+0000","last_change":"2024-05-30T06:57:18.051388+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051388+0000","last_undegraded":"2024-05-30T06:57:18.051388+0000","last_fullsized":"2024-05-30T06:57:18.051388+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061310+0000","last_change":"2024-05-30T06:57:18.057816+0000","last_active":"2024-05-30T06:57:18.061310+0000","last_peered":"2024-05-30T06:57:18.061310+0000","last_clean":"2024-05-30T06:57:18.061310+0000","last_became_active":"2024-05-30T06:57:18.057548+0000","last_became_peered":"2024-05-30T06:57:18.057548+0000","last_unstale":"2024-05-30T06:57:18.061310+0000","last_undegraded":"2024-05-30T06:57:18.061310+0000","last_fullsized":"2024-05-30T06:57:18.061310+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:01.866877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053014+0000","last_change":"2024-05-30T06:57:18.053014+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053014+0000","last_undegraded":"2024-05-30T06:57:18.053014+0000","last_fullsized":"2024-05-30T06:57:18.053014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062153+0000","last_change":"2024-05-30T06:57:18.057904+0000","last_active":"2024-05-30T06:57:18.062153+0000","last_peered":"2024-05-30T06:57:18.062153+0000","last_clean":"2024-05-30T06:57:18.062153+0000","last_became_active":"2024-05-30T06:57:18.057652+0000","last_became_peered":"2024-05-30T06:57:18.057652+0000","last_unstale":"2024-05-30T06:57:18.062153+0000","last_undegraded":"2024-05-30T06:57:18.062153+0000","last_fullsized":"2024-05-30T06:57:18.062153+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:46:06.371031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052327+0000","last_change":"2024-05-30T06:57:18.052327+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052327+0000","last_undegraded":"2024-05-30T06:57:18.052327+0000","last_fullsized":"2024-05-30T06:57:18.052327+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068901+0000","last_change":"2024-05-30T06:57:18.067628+0000","last_active":"2024-05-30T06:57:18.068901+0000","last_peered":"2024-05-30T06:57:18.068901+0000","last_clean":"2024-05-30T06:57:18.068901+0000","last_became_active":"2024-05-30T06:57:18.067352+0000","last_became_peered":"2024-05-30T06:57:18.067352+0000","last_unstale":"2024-05-30T06:57:18.068901+0000","last_undegraded":"2024-05-30T06:57:18.068901+0000","last_fullsized":"2024-05-30T06:57:18.068901+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:14.166437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050895+0000","last_change":"2024-05-30T06:57:18.050895+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050895+0000","last_undegraded":"2024-05-30T06:57:18.050895+0000","last_fullsized":"2024-05-30T06:57:18.050895+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067858+0000","last_change":"2024-05-30T06:57:18.065886+0000","last_active":"2024-05-30T06:57:18.067858+0000","last_peered":"2024-05-30T06:57:18.067858+0000","last_clean":"2024-05-30T06:57:18.067858+0000","last_became_active":"2024-05-30T06:57:18.065476+0000","last_became_peered":"2024-05-30T06:57:18.065476+0000","last_unstale":"2024-05-30T06:57:18.067858+0000","last_undegraded":"2024-05-30T06:57:18.067858+0000","last_fullsized":"2024-05-30T06:57:18.067858+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:34:13.007613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050243+0000","last_change":"2024-05-30T06:57:18.050243+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050243+0000","last_undegraded":"2024-05-30T06:57:18.050243+0000","last_fullsized":"2024-05-30T06:57:18.050243+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061717+0000","last_change":"2024-05-30T06:57:18.056395+0000","last_active":"2024-05-30T06:57:18.061717+0000","last_peered":"2024-05-30T06:57:18.061717+0000","last_clean":"2024-05-30T06:57:18.061717+0000","last_became_active":"2024-05-30T06:57:18.056128+0000","last_became_peered":"2024-05-30T06:57:18.056128+0000","last_unstale":"2024-05-30T06:57:18.061717+0000","last_undegraded":"2024-05-30T06:57:18.061717+0000","last_fullsized":"2024-05-30T06:57:18.061717+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:24:45.283856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052816+0000","last_change":"2024-05-30T06:57:18.052816+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052816+0000","last_undegraded":"2024-05-30T06:57:18.052816+0000","last_fullsized":"2024-05-30T06:57:18.052816+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062459+0000","last_change":"2024-05-30T06:57:18.061248+0000","last_active":"2024-05-30T06:57:18.062459+0000","last_peered":"2024-05-30T06:57:18.062459+0000","last_clean":"2024-05-30T06:57:18.062459+0000","last_became_active":"2024-05-30T06:57:18.060853+0000","last_became_peered":"2024-05-30T06:57:18.060853+0000","last_unstale":"2024-05-30T06:57:18.062459+0000","last_undegraded":"2024-05-30T06:57:18.062459+0000","last_fullsized":"2024-05-30T06:57:18.062459+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:23:31.504618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054978+0000","last_change":"2024-05-30T06:57:18.054978+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054978+0000","last_undegraded":"2024-05-30T06:57:18.054978+0000","last_fullsized":"2024-05-30T06:57:18.054978+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.063829+0000","last_change":"2024-05-30T06:57:18.061791+0000","last_active":"2024-05-30T06:57:18.063829+0000","last_peered":"2024-05-30T06:57:18.063829+0000","last_clean":"2024-05-30T06:57:18.063829+0000","last_became_active":"2024-05-30T06:57:18.060245+0000","last_became_peered":"2024-05-30T06:57:18.060245+0000","last_unstale":"2024-05-30T06:57:18.063829+0000","last_undegraded":"2024-05-30T06:57:18.063829+0000","last_fullsized":"2024-05-30T06:57:18.063829+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:05:40.598386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051448+0000","last_change":"2024-05-30T06:57:18.051448+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051448+0000","last_undegraded":"2024-05-30T06:57:18.051448+0000","last_fullsized":"2024-05-30T06:57:18.051448+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068887+0000","last_change":"2024-05-30T06:57:18.067970+0000","last_active":"2024-05-30T06:57:18.068887+0000","last_peered":"2024-05-30T06:57:18.068887+0000","last_clean":"2024-05-30T06:57:18.068887+0000","last_became_active":"2024-05-30T06:57:18.067035+0000","last_became_peered":"2024-05-30T06:57:18.067035+0000","last_unstale":"2024-05-30T06:57:18.068887+0000","last_undegraded":"2024-05-30T06:57:18.068887+0000","last_fullsized":"2024-05-30T06:57:18.068887+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:34:13.007613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049877+0000","last_change":"2024-05-30T06:57:18.049877+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049877+0000","last_undegraded":"2024-05-30T06:57:18.049877+0000","last_fullsized":"2024-05-30T06:57:18.049877+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061295+0000","last_change":"2024-05-30T06:57:18.059661+0000","last_active":"2024-05-30T06:57:18.061295+0000","last_peered":"2024-05-30T06:57:18.061295+0000","last_clean":"2024-05-30T06:57:18.061295+0000","last_became_active":"2024-05-30T06:57:18.059346+0000","last_became_peered":"2024-05-30T06:57:18.059346+0000","last_unstale":"2024-05-30T06:57:18.061295+0000","last_undegraded":"2024-05-30T06:57:18.061295+0000","last_fullsized":"2024-05-30T06:57:18.061295+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:32:03.097835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":346,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062685+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:57:18.062685+0000","last_peered":"2024-05-30T06:57:18.062685+0000","last_clean":"2024-05-30T06:57:18.062685+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:57:18.062685+0000","last_undegraded":"2024-05-30T06:57:18.062685+0000","last_fullsized":"2024-05-30T06:57:18.062685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123284,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248556,"statfs":{"total":96636764160,"available":96510521344,"internally_reserved":0,"allocated":1974272,"data_stored":1190970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126876,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244964,"statfs":{"total":96636764160,"available":96506843136,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76880,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294960,"statfs":{"total":96636764160,"available":96558039040,"internally_reserved":0,"allocated":1380352,"data_stored":600602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86620,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94285220,"statfs":{"total":96636764160,"available":96548065280,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144912,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226928,"statfs":{"total":96636764160,"available":96488374272,"internally_reserved":0,"allocated":1380352,"data_stored":600602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":146995655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575034,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144928,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226912,"statfs":{"total":96636764160,"available":96488357888,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104672,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94267168,"statfs":{"total":96636764160,"available":96529580032,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64992,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306848,"statfs":{"total":96636764160,"available":96570212352,"internally_reserved":0,"allocated":1974272,"data_stored":1190970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:57:23.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:57:23.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.767+0000 7f0329c00640 1 Processor -- start 2024-05-30T06:57:23.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.767+0000 7f0329c00640 1 -- start start 2024-05-30T06:57:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0329c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0324155e60 0x7f03240b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0329c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f03240b2ec0 0x7f03240cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0329c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032415c8f0 con 0x7f032406f9a0 2024-05-30T06:57:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0329c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f03240ccff0 con 0x7f03240b2ec0 2024-05-30T06:57:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0329c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f03240ccc80 con 0x7f0324155e60 2024-05-30T06:57:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f031be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f032406f9a0 0x7f03240cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39810/0 (socket says 172.21.15.37:39810) 2024-05-30T06:57:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f031be00640 1 -- 172.21.15.37:0/321248537 learned_addr learned my addr 172.21.15.37:0/321248537 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:23.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0323400640 1 --2- 172.21.15.37:0/321248537 >> v2:172.21.15.105:3300/0 conn(0x7f03240b2ec0 0x7f03240cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 724981755 0 0) 0x7f032415c8f0 con 0x7f032406f9a0 2024-05-30T06:57:23.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322a00640 1 --2- 172.21.15.37:0/321248537 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0324155e60 0x7f03240b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0308003530 con 0x7f032406f9a0 2024-05-30T06:57:23.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 189599004 0 0) 0x7f0308003530 con 0x7f032406f9a0 2024-05-30T06:57:23.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0324155e60 msgr2=0x7f03240b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:23.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 --2- 172.21.15.37:0/321248537 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0324155e60 0x7f03240b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 >> v2:172.21.15.105:3300/0 conn(0x7f03240b2ec0 msgr2=0x7f03240cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:23.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 --2- 172.21.15.37:0/321248537 >> v2:172.21.15.105:3300/0 conn(0x7f03240b2ec0 0x7f03240cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032415cbd0 con 0x7f032406f9a0 2024-05-30T06:57:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f030c001680 con 0x7f032406f9a0 2024-05-30T06:57:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 >> v1:172.21.15.37:6789/0 conn(0x7f032406f9a0 legacy=0x7f03240cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 --2- 172.21.15.37:0/321248537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03080039c0 0x7f0308003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 --2- 172.21.15.37:0/321248537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0308004810 0x7f0308004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 --2- 172.21.15.37:0/321248537 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0324155e60 0x7f03080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03240ccff0 con 0x7f03080039c0 2024-05-30T06:57:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f03240ccc80 con 0x7f0308004810 2024-05-30T06:57:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f030800b9d0 con 0x7f0324155e60 2024-05-30T06:57:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322a00640 1 --2- 172.21.15.37:0/321248537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03080039c0 0x7f0308003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f031be00640 1 --2- 172.21.15.37:0/321248537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0308004810 0x7f0308004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0323400640 1 --2- 172.21.15.37:0/321248537 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0324155e60 0x7f03080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322a00640 1 -- 172.21.15.37:0/321248537 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0324155e60 msgr2=0x7f03080051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322a00640 1 --2- 172.21.15.37:0/321248537 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0324155e60 0x7f03080051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322a00640 1 -- 172.21.15.37:0/321248537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0308004810 msgr2=0x7f0308004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:23.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322a00640 1 --2- 172.21.15.37:0/321248537 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0308004810 0x7f0308004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322a00640 1 -- 172.21.15.37:0/321248537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0308003530 con 0x7f03080039c0 2024-05-30T06:57:23.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322a00640 1 --2- 172.21.15.37:0/321248537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03080039c0 0x7f0308003de0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f0314009ae0 tx=0x7f031401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b98c4f2e6f207ac server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:23.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03140096b0 con 0x7f03080039c0 2024-05-30T06:57:23.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03140a9470 con 0x7f03080039c0 2024-05-30T06:57:23.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0322000640 1 -- 172.21.15.37:0/321248537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03140a9860 con 0x7f03080039c0 2024-05-30T06:57:23.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0329c00640 1 -- 172.21.15.37:0/321248537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03080039c0 msgr2=0x7f0308003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0329c00640 1 --2- 172.21.15.37:0/321248537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03080039c0 0x7f0308003de0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f0314009ae0 tx=0x7f031401ca70 comp rx=0 tx=0).stop 2024-05-30T06:57:23.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0323400640 1 -- 172.21.15.37:0/321248537 reap_dead start 2024-05-30T06:57:23.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0329c00640 1 -- 172.21.15.37:0/321248537 shutdown_connections 2024-05-30T06:57:23.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0329c00640 1 -- 172.21.15.37:0/321248537 >> 172.21.15.37:0/321248537 conn(0x7f03240b23a0 msgr2=0x7f03240b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:23.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0329c00640 1 -- 172.21.15.37:0/321248537 shutdown_connections 2024-05-30T06:57:23.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0329c00640 1 -- 172.21.15.37:0/321248537 wait complete. 2024-05-30T06:57:23.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.771+0000 7f0329c00640 1 Processor -- start 2024-05-30T06:57:23.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f0329c00640 1 -- start start 2024-05-30T06:57:23.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f0329c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03080039c0 0x7f032415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f0329c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03240b0510 0x7f0324143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f0329c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f032415d880 0x7f032415dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f0329c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03241667d0 con 0x7f03240b0510 2024-05-30T06:57:23.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f0329c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0324166650 con 0x7f032415d880 2024-05-30T06:57:23.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f0329c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0324166950 con 0x7f03080039c0 2024-05-30T06:57:23.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f031be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03240b0510 0x7f0324143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f031be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03240b0510 0x7f0324143dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56078/0 (socket says 172.21.15.37:56078) 2024-05-30T06:57:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f031be00640 1 -- 172.21.15.37:0/1703722075 learned_addr learned my addr 172.21.15.37:0/1703722075 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f0323400640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f032415d880 0x7f032415dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f0322a00640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03080039c0 0x7f032415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f031be00640 1 -- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03080039c0 msgr2=0x7f032415a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f031be00640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03080039c0 0x7f032415a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f031be00640 1 -- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f032415d880 msgr2=0x7f032415dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f031be00640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f032415d880 0x7f032415dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f031be00640 1 -- 172.21.15.37:0/1703722075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03240b0a80 con 0x7f03240b0510 2024-05-30T06:57:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f031be00640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03240b0510 0x7f0324143dd0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f030c007310 tx=0x7f030c0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f031aa00640 1 -- 172.21.15.37:0/1703722075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c007e40 con 0x7f03240b0510 2024-05-30T06:57:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f031aa00640 1 -- 172.21.15.37:0/1703722075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f030c018070 con 0x7f03240b0510 2024-05-30T06:57:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f031aa00640 1 -- 172.21.15.37:0/1703722075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f030c00fc00 con 0x7f03240b0510 2024-05-30T06:57:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f0329c00640 1 -- 172.21.15.37:0/1703722075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03240b0d60 con 0x7f03240b0510 2024-05-30T06:57:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f0329c00640 1 -- 172.21.15.37:0/1703722075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03240b1320 con 0x7f03240b0510 2024-05-30T06:57:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.775+0000 7f0329c00640 1 -- 172.21.15.37:0/1703722075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0324068b20 con 0x7f03240b0510 2024-05-30T06:57:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.779+0000 7f031aa00640 1 -- 172.21.15.37:0/1703722075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f030c01d460 con 0x7f03240b0510 2024-05-30T06:57:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.779+0000 7f031aa00640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0300069be0 0x7f030006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.779+0000 7f031aa00640 1 -- 172.21.15.37:0/1703722075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f030c085710 con 0x7f03240b0510 2024-05-30T06:57:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.779+0000 7f0322a00640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0300069be0 0x7f030006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.779+0000 7f0322a00640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0300069be0 0x7f030006c0a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f03140ae000 tx=0x7f03140046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.783+0000 7f031aa00640 1 -- 172.21.15.37:0/1703722075 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f030c057180 con 0x7f03240b0510 2024-05-30T06:57:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.947+0000 7f0329c00640 1 -- 172.21.15.37:0/1703722075 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03240cd620 con 0x7f0300069be0 2024-05-30T06:57:23.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.955+0000 7f031aa00640 1 -- 172.21.15.37:0/1703722075 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247105 (secure 0 0 0) 0x7f03140fd560 con 0x7f0300069be0 2024-05-30T06:57:23.959 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:57:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.955+0000 7f0329c00640 1 -- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0300069be0 msgr2=0x7f030006c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.955+0000 7f0329c00640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0300069be0 0x7f030006c0a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f03140ae000 tx=0x7f03140046d0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.955+0000 7f0329c00640 1 -- 172.21.15.37:0/1703722075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03240b0510 msgr2=0x7f0324143dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.955+0000 7f0329c00640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03240b0510 0x7f0324143dd0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f030c007310 tx=0x7f030c0077d0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.955+0000 7f0329c00640 1 -- 172.21.15.37:0/1703722075 shutdown_connections 2024-05-30T06:57:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.955+0000 7f0329c00640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0300069be0 0x7f030006c0a0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.955+0000 7f0329c00640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f032415d880 0x7f032415dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.955+0000 7f0329c00640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03240b0510 0x7f0324143dd0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.955+0000 7f0329c00640 1 --2- 172.21.15.37:0/1703722075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03080039c0 0x7f032415a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.955+0000 7f0329c00640 1 -- 172.21.15.37:0/1703722075 >> 172.21.15.37:0/1703722075 conn(0x7f03240b23a0 msgr2=0x7f03240ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.955+0000 7f0329c00640 1 -- 172.21.15.37:0/1703722075 shutdown_connections 2024-05-30T06:57:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:23.955+0000 7f0329c00640 1 -- 172.21.15.37:0/1703722075 wait complete. 2024-05-30T06:57:23.979 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":569,"stamp":"2024-05-30T06:57:22.971320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":873164,"kb_used_data":11992,"kb_used_omap":12,"kb_used_meta":861043,"kb_avail":754101556,"statfs":{"total":773094113280,"available":772199993344,"internally_reserved":0,"allocated":12279808,"data_stored":6010876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":881708592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.930294"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.058541+0000","last_change":"2024-05-30T06:57:18.058541+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.058541+0000","last_undegraded":"2024-05-30T06:57:18.058541+0000","last_fullsized":"2024-05-30T06:57:18.058541+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050299+0000","last_change":"2024-05-30T06:57:18.050299+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050299+0000","last_undegraded":"2024-05-30T06:57:18.050299+0000","last_fullsized":"2024-05-30T06:57:18.050299+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.060020+0000","last_change":"2024-05-30T06:57:18.060020+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.060020+0000","last_undegraded":"2024-05-30T06:57:18.060020+0000","last_fullsized":"2024-05-30T06:57:18.060020+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056676+0000","last_change":"2024-05-30T06:57:18.056676+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056676+0000","last_undegraded":"2024-05-30T06:57:18.056676+0000","last_fullsized":"2024-05-30T06:57:18.056676+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.043649+0000","last_change":"2024-05-30T06:57:18.043649+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.043649+0000","last_undegraded":"2024-05-30T06:57:18.043649+0000","last_fullsized":"2024-05-30T06:57:18.043649+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053062+0000","last_change":"2024-05-30T06:57:18.053062+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053062+0000","last_undegraded":"2024-05-30T06:57:18.053062+0000","last_fullsized":"2024-05-30T06:57:18.053062+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.047532+0000","last_change":"2024-05-30T06:57:18.047532+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.047532+0000","last_undegraded":"2024-05-30T06:57:18.047532+0000","last_fullsized":"2024-05-30T06:57:18.047532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055958+0000","last_change":"2024-05-30T06:57:18.055958+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055958+0000","last_undegraded":"2024-05-30T06:57:18.055958+0000","last_fullsized":"2024-05-30T06:57:18.055958+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055512+0000","last_change":"2024-05-30T06:57:18.055512+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055512+0000","last_undegraded":"2024-05-30T06:57:18.055512+0000","last_fullsized":"2024-05-30T06:57:18.055512+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054891+0000","last_change":"2024-05-30T06:57:18.054891+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054891+0000","last_undegraded":"2024-05-30T06:57:18.054891+0000","last_fullsized":"2024-05-30T06:57:18.054891+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051576+0000","last_change":"2024-05-30T06:57:18.051576+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051576+0000","last_undegraded":"2024-05-30T06:57:18.051576+0000","last_fullsized":"2024-05-30T06:57:18.051576+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055925+0000","last_change":"2024-05-30T06:57:18.055925+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055925+0000","last_undegraded":"2024-05-30T06:57:18.055925+0000","last_fullsized":"2024-05-30T06:57:18.055925+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056014+0000","last_change":"2024-05-30T06:57:18.056014+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056014+0000","last_undegraded":"2024-05-30T06:57:18.056014+0000","last_fullsized":"2024-05-30T06:57:18.056014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.060488+0000","last_change":"2024-05-30T06:57:18.060488+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.060488+0000","last_undegraded":"2024-05-30T06:57:18.060488+0000","last_fullsized":"2024-05-30T06:57:18.060488+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053019+0000","last_change":"2024-05-30T06:57:18.053019+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053019+0000","last_undegraded":"2024-05-30T06:57:18.053019+0000","last_fullsized":"2024-05-30T06:57:18.053019+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053105+0000","last_change":"2024-05-30T06:57:18.053105+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053105+0000","last_undegraded":"2024-05-30T06:57:18.053105+0000","last_fullsized":"2024-05-30T06:57:18.053105+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052523+0000","last_change":"2024-05-30T06:57:18.052523+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052523+0000","last_undegraded":"2024-05-30T06:57:18.052523+0000","last_fullsized":"2024-05-30T06:57:18.052523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055005+0000","last_change":"2024-05-30T06:57:18.055005+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055005+0000","last_undegraded":"2024-05-30T06:57:18.055005+0000","last_fullsized":"2024-05-30T06:57:18.055005+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.059570+0000","last_change":"2024-05-30T06:57:18.059570+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.059570+0000","last_undegraded":"2024-05-30T06:57:18.059570+0000","last_fullsized":"2024-05-30T06:57:18.059570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051075+0000","last_change":"2024-05-30T06:57:18.051075+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051075+0000","last_undegraded":"2024-05-30T06:57:18.051075+0000","last_fullsized":"2024-05-30T06:57:18.051075+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052332+0000","last_change":"2024-05-30T06:57:18.052332+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052332+0000","last_undegraded":"2024-05-30T06:57:18.052332+0000","last_fullsized":"2024-05-30T06:57:18.052332+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054332+0000","last_change":"2024-05-30T06:57:18.054332+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054332+0000","last_undegraded":"2024-05-30T06:57:18.054332+0000","last_fullsized":"2024-05-30T06:57:18.054332+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049936+0000","last_change":"2024-05-30T06:57:18.049936+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049936+0000","last_undegraded":"2024-05-30T06:57:18.049936+0000","last_fullsized":"2024-05-30T06:57:18.049936+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050317+0000","last_change":"2024-05-30T06:57:18.050317+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050317+0000","last_undegraded":"2024-05-30T06:57:18.050317+0000","last_fullsized":"2024-05-30T06:57:18.050317+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052099+0000","last_change":"2024-05-30T06:57:18.052099+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052099+0000","last_undegraded":"2024-05-30T06:57:18.052099+0000","last_fullsized":"2024-05-30T06:57:18.052099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053556+0000","last_change":"2024-05-30T06:57:18.053556+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053556+0000","last_undegraded":"2024-05-30T06:57:18.053556+0000","last_fullsized":"2024-05-30T06:57:18.053556+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055296+0000","last_change":"2024-05-30T06:57:18.055296+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055296+0000","last_undegraded":"2024-05-30T06:57:18.055296+0000","last_fullsized":"2024-05-30T06:57:18.055296+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050350+0000","last_change":"2024-05-30T06:57:18.050350+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050350+0000","last_undegraded":"2024-05-30T06:57:18.050350+0000","last_fullsized":"2024-05-30T06:57:18.050350+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053855+0000","last_change":"2024-05-30T06:57:18.053855+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053855+0000","last_undegraded":"2024-05-30T06:57:18.053855+0000","last_fullsized":"2024-05-30T06:57:18.053855+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.047532+0000","last_change":"2024-05-30T06:57:18.047532+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.047532+0000","last_undegraded":"2024-05-30T06:57:18.047532+0000","last_fullsized":"2024-05-30T06:57:18.047532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051865+0000","last_change":"2024-05-30T06:57:18.051865+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051865+0000","last_undegraded":"2024-05-30T06:57:18.051865+0000","last_fullsized":"2024-05-30T06:57:18.051865+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053436+0000","last_change":"2024-05-30T06:57:18.053436+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053436+0000","last_undegraded":"2024-05-30T06:57:18.053436+0000","last_fullsized":"2024-05-30T06:57:18.053436+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055532+0000","last_change":"2024-05-30T06:57:18.055532+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055532+0000","last_undegraded":"2024-05-30T06:57:18.055532+0000","last_fullsized":"2024-05-30T06:57:18.055532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065817+0000","last_change":"2024-05-30T06:57:18.064919+0000","last_active":"2024-05-30T06:57:18.065817+0000","last_peered":"2024-05-30T06:57:18.065817+0000","last_clean":"2024-05-30T06:57:18.065817+0000","last_became_active":"2024-05-30T06:57:18.064658+0000","last_became_peered":"2024-05-30T06:57:18.064658+0000","last_unstale":"2024-05-30T06:57:18.065817+0000","last_undegraded":"2024-05-30T06:57:18.065817+0000","last_fullsized":"2024-05-30T06:57:18.065817+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:07:02.051446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053271+0000","last_change":"2024-05-30T06:57:18.053271+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053271+0000","last_undegraded":"2024-05-30T06:57:18.053271+0000","last_fullsized":"2024-05-30T06:57:18.053271+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.069248+0000","last_change":"2024-05-30T06:57:18.068587+0000","last_active":"2024-05-30T06:57:18.069248+0000","last_peered":"2024-05-30T06:57:18.069248+0000","last_clean":"2024-05-30T06:57:18.069248+0000","last_became_active":"2024-05-30T06:57:18.068278+0000","last_became_peered":"2024-05-30T06:57:18.068278+0000","last_unstale":"2024-05-30T06:57:18.069248+0000","last_undegraded":"2024-05-30T06:57:18.069248+0000","last_fullsized":"2024-05-30T06:57:18.069248+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:41:46.001101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054501+0000","last_change":"2024-05-30T06:57:18.054501+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054501+0000","last_undegraded":"2024-05-30T06:57:18.054501+0000","last_fullsized":"2024-05-30T06:57:18.054501+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.069013+0000","last_change":"2024-05-30T06:57:18.068473+0000","last_active":"2024-05-30T06:57:18.069013+0000","last_peered":"2024-05-30T06:57:18.069013+0000","last_clean":"2024-05-30T06:57:18.069013+0000","last_became_active":"2024-05-30T06:57:18.067152+0000","last_became_peered":"2024-05-30T06:57:18.067152+0000","last_unstale":"2024-05-30T06:57:18.069013+0000","last_undegraded":"2024-05-30T06:57:18.069013+0000","last_fullsized":"2024-05-30T06:57:18.069013+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:18:56.976311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.057090+0000","last_change":"2024-05-30T06:57:18.057090+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.057090+0000","last_undegraded":"2024-05-30T06:57:18.057090+0000","last_fullsized":"2024-05-30T06:57:18.057090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.066089+0000","last_change":"2024-05-30T06:57:18.062798+0000","last_active":"2024-05-30T06:57:18.066089+0000","last_peered":"2024-05-30T06:57:18.066089+0000","last_clean":"2024-05-30T06:57:18.066089+0000","last_became_active":"2024-05-30T06:57:18.062422+0000","last_became_peered":"2024-05-30T06:57:18.062422+0000","last_unstale":"2024-05-30T06:57:18.066089+0000","last_undegraded":"2024-05-30T06:57:18.066089+0000","last_fullsized":"2024-05-30T06:57:18.066089+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:13:56.674922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050851+0000","last_change":"2024-05-30T06:57:18.050851+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050851+0000","last_undegraded":"2024-05-30T06:57:18.050851+0000","last_fullsized":"2024-05-30T06:57:18.050851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065506+0000","last_change":"2024-05-30T06:57:18.064096+0000","last_active":"2024-05-30T06:57:18.065506+0000","last_peered":"2024-05-30T06:57:18.065506+0000","last_clean":"2024-05-30T06:57:18.065506+0000","last_became_active":"2024-05-30T06:57:18.063824+0000","last_became_peered":"2024-05-30T06:57:18.063824+0000","last_unstale":"2024-05-30T06:57:18.065506+0000","last_undegraded":"2024-05-30T06:57:18.065506+0000","last_fullsized":"2024-05-30T06:57:18.065506+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:49:55.172715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053430+0000","last_change":"2024-05-30T06:57:18.053430+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053430+0000","last_undegraded":"2024-05-30T06:57:18.053430+0000","last_fullsized":"2024-05-30T06:57:18.053430+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061632+0000","last_change":"2024-05-30T06:57:18.057527+0000","last_active":"2024-05-30T06:57:18.061632+0000","last_peered":"2024-05-30T06:57:18.061632+0000","last_clean":"2024-05-30T06:57:18.061632+0000","last_became_active":"2024-05-30T06:57:18.057148+0000","last_became_peered":"2024-05-30T06:57:18.057148+0000","last_unstale":"2024-05-30T06:57:18.061632+0000","last_undegraded":"2024-05-30T06:57:18.061632+0000","last_fullsized":"2024-05-30T06:57:18.061632+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:24:27.985268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052236+0000","last_change":"2024-05-30T06:57:18.052236+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052236+0000","last_undegraded":"2024-05-30T06:57:18.052236+0000","last_fullsized":"2024-05-30T06:57:18.052236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.057753+0000","last_change":"2024-05-30T06:57:18.054715+0000","last_active":"2024-05-30T06:57:18.057753+0000","last_peered":"2024-05-30T06:57:18.057753+0000","last_clean":"2024-05-30T06:57:18.057753+0000","last_became_active":"2024-05-30T06:57:18.054397+0000","last_became_peered":"2024-05-30T06:57:18.054397+0000","last_unstale":"2024-05-30T06:57:18.057753+0000","last_undegraded":"2024-05-30T06:57:18.057753+0000","last_fullsized":"2024-05-30T06:57:18.057753+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:08:26.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048081+0000","last_change":"2024-05-30T06:57:18.048081+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048081+0000","last_undegraded":"2024-05-30T06:57:18.048081+0000","last_fullsized":"2024-05-30T06:57:18.048081+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067054+0000","last_change":"2024-05-30T06:57:18.062207+0000","last_active":"2024-05-30T06:57:18.067054+0000","last_peered":"2024-05-30T06:57:18.067054+0000","last_clean":"2024-05-30T06:57:18.067054+0000","last_became_active":"2024-05-30T06:57:18.061886+0000","last_became_peered":"2024-05-30T06:57:18.061886+0000","last_unstale":"2024-05-30T06:57:18.067054+0000","last_undegraded":"2024-05-30T06:57:18.067054+0000","last_fullsized":"2024-05-30T06:57:18.067054+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:24:27.985268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048481+0000","last_change":"2024-05-30T06:57:18.048481+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048481+0000","last_undegraded":"2024-05-30T06:57:18.048481+0000","last_fullsized":"2024-05-30T06:57:18.048481+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068323+0000","last_change":"2024-05-30T06:57:18.063301+0000","last_active":"2024-05-30T06:57:18.068323+0000","last_peered":"2024-05-30T06:57:18.068323+0000","last_clean":"2024-05-30T06:57:18.068323+0000","last_became_active":"2024-05-30T06:57:18.063018+0000","last_became_peered":"2024-05-30T06:57:18.063018+0000","last_unstale":"2024-05-30T06:57:18.068323+0000","last_undegraded":"2024-05-30T06:57:18.068323+0000","last_fullsized":"2024-05-30T06:57:18.068323+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:58:26.774587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050522+0000","last_change":"2024-05-30T06:57:18.050522+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050522+0000","last_undegraded":"2024-05-30T06:57:18.050522+0000","last_fullsized":"2024-05-30T06:57:18.050522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067505+0000","last_change":"2024-05-30T06:57:18.064721+0000","last_active":"2024-05-30T06:57:18.067505+0000","last_peered":"2024-05-30T06:57:18.067505+0000","last_clean":"2024-05-30T06:57:18.067505+0000","last_became_active":"2024-05-30T06:57:18.064369+0000","last_became_peered":"2024-05-30T06:57:18.064369+0000","last_unstale":"2024-05-30T06:57:18.067505+0000","last_undegraded":"2024-05-30T06:57:18.067505+0000","last_fullsized":"2024-05-30T06:57:18.067505+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:14.166437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049897+0000","last_change":"2024-05-30T06:57:18.049897+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049897+0000","last_undegraded":"2024-05-30T06:57:18.049897+0000","last_fullsized":"2024-05-30T06:57:18.049897+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068921+0000","last_change":"2024-05-30T06:57:18.068132+0000","last_active":"2024-05-30T06:57:18.068921+0000","last_peered":"2024-05-30T06:57:18.068921+0000","last_clean":"2024-05-30T06:57:18.068921+0000","last_became_active":"2024-05-30T06:57:18.067200+0000","last_became_peered":"2024-05-30T06:57:18.067200+0000","last_unstale":"2024-05-30T06:57:18.068921+0000","last_undegraded":"2024-05-30T06:57:18.068921+0000","last_fullsized":"2024-05-30T06:57:18.068921+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:38:05.820026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048002+0000","last_change":"2024-05-30T06:57:18.048002+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048002+0000","last_undegraded":"2024-05-30T06:57:18.048002+0000","last_fullsized":"2024-05-30T06:57:18.048002+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.060224+0000","last_change":"2024-05-30T06:57:18.056997+0000","last_active":"2024-05-30T06:57:18.060224+0000","last_peered":"2024-05-30T06:57:18.060224+0000","last_clean":"2024-05-30T06:57:18.060224+0000","last_became_active":"2024-05-30T06:57:18.056285+0000","last_became_peered":"2024-05-30T06:57:18.056285+0000","last_unstale":"2024-05-30T06:57:18.060224+0000","last_undegraded":"2024-05-30T06:57:18.060224+0000","last_fullsized":"2024-05-30T06:57:18.060224+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:55:21.778886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049712+0000","last_change":"2024-05-30T06:57:18.049712+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049712+0000","last_undegraded":"2024-05-30T06:57:18.049712+0000","last_fullsized":"2024-05-30T06:57:18.049712+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.066754+0000","last_change":"2024-05-30T06:57:18.063576+0000","last_active":"2024-05-30T06:57:18.066754+0000","last_peered":"2024-05-30T06:57:18.066754+0000","last_clean":"2024-05-30T06:57:18.066754+0000","last_became_active":"2024-05-30T06:57:18.063292+0000","last_became_peered":"2024-05-30T06:57:18.063292+0000","last_unstale":"2024-05-30T06:57:18.066754+0000","last_undegraded":"2024-05-30T06:57:18.066754+0000","last_fullsized":"2024-05-30T06:57:18.066754+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:39:46.184728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049737+0000","last_change":"2024-05-30T06:57:18.049737+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049737+0000","last_undegraded":"2024-05-30T06:57:18.049737+0000","last_fullsized":"2024-05-30T06:57:18.049737+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062747+0000","last_change":"2024-05-30T06:57:18.061114+0000","last_active":"2024-05-30T06:57:18.062747+0000","last_peered":"2024-05-30T06:57:18.062747+0000","last_clean":"2024-05-30T06:57:18.062747+0000","last_became_active":"2024-05-30T06:57:18.060826+0000","last_became_peered":"2024-05-30T06:57:18.060826+0000","last_unstale":"2024-05-30T06:57:18.062747+0000","last_undegraded":"2024-05-30T06:57:18.062747+0000","last_fullsized":"2024-05-30T06:57:18.062747+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:08:26.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050182+0000","last_change":"2024-05-30T06:57:18.050182+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050182+0000","last_undegraded":"2024-05-30T06:57:18.050182+0000","last_fullsized":"2024-05-30T06:57:18.050182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.059213+0000","last_change":"2024-05-30T06:57:18.057392+0000","last_active":"2024-05-30T06:57:18.059213+0000","last_peered":"2024-05-30T06:57:18.059213+0000","last_clean":"2024-05-30T06:57:18.059213+0000","last_became_active":"2024-05-30T06:57:18.057040+0000","last_became_peered":"2024-05-30T06:57:18.057040+0000","last_unstale":"2024-05-30T06:57:18.059213+0000","last_undegraded":"2024-05-30T06:57:18.059213+0000","last_fullsized":"2024-05-30T06:57:18.059213+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:21:07.814279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.044366+0000","last_change":"2024-05-30T06:57:18.044366+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.044366+0000","last_undegraded":"2024-05-30T06:57:18.044366+0000","last_fullsized":"2024-05-30T06:57:18.044366+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.066901+0000","last_change":"2024-05-30T06:57:18.061898+0000","last_active":"2024-05-30T06:57:18.066901+0000","last_peered":"2024-05-30T06:57:18.066901+0000","last_clean":"2024-05-30T06:57:18.066901+0000","last_became_active":"2024-05-30T06:57:18.061632+0000","last_became_peered":"2024-05-30T06:57:18.061632+0000","last_unstale":"2024-05-30T06:57:18.066901+0000","last_undegraded":"2024-05-30T06:57:18.066901+0000","last_fullsized":"2024-05-30T06:57:18.066901+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:36.022823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056076+0000","last_change":"2024-05-30T06:57:18.056076+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056076+0000","last_undegraded":"2024-05-30T06:57:18.056076+0000","last_fullsized":"2024-05-30T06:57:18.056076+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.058485+0000","last_change":"2024-05-30T06:57:18.053358+0000","last_active":"2024-05-30T06:57:18.058485+0000","last_peered":"2024-05-30T06:57:18.058485+0000","last_clean":"2024-05-30T06:57:18.058485+0000","last_became_active":"2024-05-30T06:57:18.053073+0000","last_became_peered":"2024-05-30T06:57:18.053073+0000","last_unstale":"2024-05-30T06:57:18.058485+0000","last_undegraded":"2024-05-30T06:57:18.058485+0000","last_fullsized":"2024-05-30T06:57:18.058485+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:22.810583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.057989+0000","last_change":"2024-05-30T06:57:18.057989+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.057989+0000","last_undegraded":"2024-05-30T06:57:18.057989+0000","last_fullsized":"2024-05-30T06:57:18.057989+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065376+0000","last_change":"2024-05-30T06:57:18.062817+0000","last_active":"2024-05-30T06:57:18.065376+0000","last_peered":"2024-05-30T06:57:18.065376+0000","last_clean":"2024-05-30T06:57:18.065376+0000","last_became_active":"2024-05-30T06:57:18.062547+0000","last_became_peered":"2024-05-30T06:57:18.062547+0000","last_unstale":"2024-05-30T06:57:18.065376+0000","last_undegraded":"2024-05-30T06:57:18.065376+0000","last_fullsized":"2024-05-30T06:57:18.065376+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:23:31.504618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056626+0000","last_change":"2024-05-30T06:57:18.056626+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056626+0000","last_undegraded":"2024-05-30T06:57:18.056626+0000","last_fullsized":"2024-05-30T06:57:18.056626+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062345+0000","last_change":"2024-05-30T06:57:18.060235+0000","last_active":"2024-05-30T06:57:18.062345+0000","last_peered":"2024-05-30T06:57:18.062345+0000","last_clean":"2024-05-30T06:57:18.062345+0000","last_became_active":"2024-05-30T06:57:18.059883+0000","last_became_peered":"2024-05-30T06:57:18.059883+0000","last_unstale":"2024-05-30T06:57:18.062345+0000","last_undegraded":"2024-05-30T06:57:18.062345+0000","last_fullsized":"2024-05-30T06:57:18.062345+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:51:57.117092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056827+0000","last_change":"2024-05-30T06:57:18.056827+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056827+0000","last_undegraded":"2024-05-30T06:57:18.056827+0000","last_fullsized":"2024-05-30T06:57:18.056827+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.064962+0000","last_change":"2024-05-30T06:57:18.061015+0000","last_active":"2024-05-30T06:57:18.064962+0000","last_peered":"2024-05-30T06:57:18.064962+0000","last_clean":"2024-05-30T06:57:18.064962+0000","last_became_active":"2024-05-30T06:57:18.060726+0000","last_became_peered":"2024-05-30T06:57:18.060726+0000","last_unstale":"2024-05-30T06:57:18.064962+0000","last_undegraded":"2024-05-30T06:57:18.064962+0000","last_fullsized":"2024-05-30T06:57:18.064962+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:38:49.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052489+0000","last_change":"2024-05-30T06:57:18.052489+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052489+0000","last_undegraded":"2024-05-30T06:57:18.052489+0000","last_fullsized":"2024-05-30T06:57:18.052489+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.060610+0000","last_change":"2024-05-30T06:57:18.058579+0000","last_active":"2024-05-30T06:57:18.060610+0000","last_peered":"2024-05-30T06:57:18.060610+0000","last_clean":"2024-05-30T06:57:18.060610+0000","last_became_active":"2024-05-30T06:57:18.057970+0000","last_became_peered":"2024-05-30T06:57:18.057970+0000","last_unstale":"2024-05-30T06:57:18.060610+0000","last_undegraded":"2024-05-30T06:57:18.060610+0000","last_fullsized":"2024-05-30T06:57:18.060610+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:55:46.481052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055523+0000","last_change":"2024-05-30T06:57:18.055523+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055523+0000","last_undegraded":"2024-05-30T06:57:18.055523+0000","last_fullsized":"2024-05-30T06:57:18.055523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065122+0000","last_change":"2024-05-30T06:57:18.061904+0000","last_active":"2024-05-30T06:57:18.065122+0000","last_peered":"2024-05-30T06:57:18.065122+0000","last_clean":"2024-05-30T06:57:18.065122+0000","last_became_active":"2024-05-30T06:57:18.060839+0000","last_became_peered":"2024-05-30T06:57:18.060839+0000","last_unstale":"2024-05-30T06:57:18.065122+0000","last_undegraded":"2024-05-30T06:57:18.065122+0000","last_fullsized":"2024-05-30T06:57:18.065122+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:33:05.885862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048691+0000","last_change":"2024-05-30T06:57:18.048691+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048691+0000","last_undegraded":"2024-05-30T06:57:18.048691+0000","last_fullsized":"2024-05-30T06:57:18.048691+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067084+0000","last_change":"2024-05-30T06:57:18.064064+0000","last_active":"2024-05-30T06:57:18.067084+0000","last_peered":"2024-05-30T06:57:18.067084+0000","last_clean":"2024-05-30T06:57:18.067084+0000","last_became_active":"2024-05-30T06:57:18.060291+0000","last_became_peered":"2024-05-30T06:57:18.060291+0000","last_unstale":"2024-05-30T06:57:18.067084+0000","last_undegraded":"2024-05-30T06:57:18.067084+0000","last_fullsized":"2024-05-30T06:57:18.067084+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:01.866877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051388+0000","last_change":"2024-05-30T06:57:18.051388+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051388+0000","last_undegraded":"2024-05-30T06:57:18.051388+0000","last_fullsized":"2024-05-30T06:57:18.051388+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061310+0000","last_change":"2024-05-30T06:57:18.057816+0000","last_active":"2024-05-30T06:57:18.061310+0000","last_peered":"2024-05-30T06:57:18.061310+0000","last_clean":"2024-05-30T06:57:18.061310+0000","last_became_active":"2024-05-30T06:57:18.057548+0000","last_became_peered":"2024-05-30T06:57:18.057548+0000","last_unstale":"2024-05-30T06:57:18.061310+0000","last_undegraded":"2024-05-30T06:57:18.061310+0000","last_fullsized":"2024-05-30T06:57:18.061310+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:01.866877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053014+0000","last_change":"2024-05-30T06:57:18.053014+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053014+0000","last_undegraded":"2024-05-30T06:57:18.053014+0000","last_fullsized":"2024-05-30T06:57:18.053014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062153+0000","last_change":"2024-05-30T06:57:18.057904+0000","last_active":"2024-05-30T06:57:18.062153+0000","last_peered":"2024-05-30T06:57:18.062153+0000","last_clean":"2024-05-30T06:57:18.062153+0000","last_became_active":"2024-05-30T06:57:18.057652+0000","last_became_peered":"2024-05-30T06:57:18.057652+0000","last_unstale":"2024-05-30T06:57:18.062153+0000","last_undegraded":"2024-05-30T06:57:18.062153+0000","last_fullsized":"2024-05-30T06:57:18.062153+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:46:06.371031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052327+0000","last_change":"2024-05-30T06:57:18.052327+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052327+0000","last_undegraded":"2024-05-30T06:57:18.052327+0000","last_fullsized":"2024-05-30T06:57:18.052327+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068901+0000","last_change":"2024-05-30T06:57:18.067628+0000","last_active":"2024-05-30T06:57:18.068901+0000","last_peered":"2024-05-30T06:57:18.068901+0000","last_clean":"2024-05-30T06:57:18.068901+0000","last_became_active":"2024-05-30T06:57:18.067352+0000","last_became_peered":"2024-05-30T06:57:18.067352+0000","last_unstale":"2024-05-30T06:57:18.068901+0000","last_undegraded":"2024-05-30T06:57:18.068901+0000","last_fullsized":"2024-05-30T06:57:18.068901+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:14.166437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050895+0000","last_change":"2024-05-30T06:57:18.050895+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050895+0000","last_undegraded":"2024-05-30T06:57:18.050895+0000","last_fullsized":"2024-05-30T06:57:18.050895+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067858+0000","last_change":"2024-05-30T06:57:18.065886+0000","last_active":"2024-05-30T06:57:18.067858+0000","last_peered":"2024-05-30T06:57:18.067858+0000","last_clean":"2024-05-30T06:57:18.067858+0000","last_became_active":"2024-05-30T06:57:18.065476+0000","last_became_peered":"2024-05-30T06:57:18.065476+0000","last_unstale":"2024-05-30T06:57:18.067858+0000","last_undegraded":"2024-05-30T06:57:18.067858+0000","last_fullsized":"2024-05-30T06:57:18.067858+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:34:13.007613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050243+0000","last_change":"2024-05-30T06:57:18.050243+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050243+0000","last_undegraded":"2024-05-30T06:57:18.050243+0000","last_fullsized":"2024-05-30T06:57:18.050243+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061717+0000","last_change":"2024-05-30T06:57:18.056395+0000","last_active":"2024-05-30T06:57:18.061717+0000","last_peered":"2024-05-30T06:57:18.061717+0000","last_clean":"2024-05-30T06:57:18.061717+0000","last_became_active":"2024-05-30T06:57:18.056128+0000","last_became_peered":"2024-05-30T06:57:18.056128+0000","last_unstale":"2024-05-30T06:57:18.061717+0000","last_undegraded":"2024-05-30T06:57:18.061717+0000","last_fullsized":"2024-05-30T06:57:18.061717+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:24:45.283856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052816+0000","last_change":"2024-05-30T06:57:18.052816+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052816+0000","last_undegraded":"2024-05-30T06:57:18.052816+0000","last_fullsized":"2024-05-30T06:57:18.052816+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062459+0000","last_change":"2024-05-30T06:57:18.061248+0000","last_active":"2024-05-30T06:57:18.062459+0000","last_peered":"2024-05-30T06:57:18.062459+0000","last_clean":"2024-05-30T06:57:18.062459+0000","last_became_active":"2024-05-30T06:57:18.060853+0000","last_became_peered":"2024-05-30T06:57:18.060853+0000","last_unstale":"2024-05-30T06:57:18.062459+0000","last_undegraded":"2024-05-30T06:57:18.062459+0000","last_fullsized":"2024-05-30T06:57:18.062459+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:23:31.504618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054978+0000","last_change":"2024-05-30T06:57:18.054978+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054978+0000","last_undegraded":"2024-05-30T06:57:18.054978+0000","last_fullsized":"2024-05-30T06:57:18.054978+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.063829+0000","last_change":"2024-05-30T06:57:18.061791+0000","last_active":"2024-05-30T06:57:18.063829+0000","last_peered":"2024-05-30T06:57:18.063829+0000","last_clean":"2024-05-30T06:57:18.063829+0000","last_became_active":"2024-05-30T06:57:18.060245+0000","last_became_peered":"2024-05-30T06:57:18.060245+0000","last_unstale":"2024-05-30T06:57:18.063829+0000","last_undegraded":"2024-05-30T06:57:18.063829+0000","last_fullsized":"2024-05-30T06:57:18.063829+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:05:40.598386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051448+0000","last_change":"2024-05-30T06:57:18.051448+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051448+0000","last_undegraded":"2024-05-30T06:57:18.051448+0000","last_fullsized":"2024-05-30T06:57:18.051448+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068887+0000","last_change":"2024-05-30T06:57:18.067970+0000","last_active":"2024-05-30T06:57:18.068887+0000","last_peered":"2024-05-30T06:57:18.068887+0000","last_clean":"2024-05-30T06:57:18.068887+0000","last_became_active":"2024-05-30T06:57:18.067035+0000","last_became_peered":"2024-05-30T06:57:18.067035+0000","last_unstale":"2024-05-30T06:57:18.068887+0000","last_undegraded":"2024-05-30T06:57:18.068887+0000","last_fullsized":"2024-05-30T06:57:18.068887+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:34:13.007613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049877+0000","last_change":"2024-05-30T06:57:18.049877+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049877+0000","last_undegraded":"2024-05-30T06:57:18.049877+0000","last_fullsized":"2024-05-30T06:57:18.049877+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061295+0000","last_change":"2024-05-30T06:57:18.059661+0000","last_active":"2024-05-30T06:57:18.061295+0000","last_peered":"2024-05-30T06:57:18.061295+0000","last_clean":"2024-05-30T06:57:18.061295+0000","last_became_active":"2024-05-30T06:57:18.059346+0000","last_became_peered":"2024-05-30T06:57:18.059346+0000","last_unstale":"2024-05-30T06:57:18.061295+0000","last_undegraded":"2024-05-30T06:57:18.061295+0000","last_fullsized":"2024-05-30T06:57:18.061295+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:32:03.097835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":346,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062685+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:57:18.062685+0000","last_peered":"2024-05-30T06:57:18.062685+0000","last_clean":"2024-05-30T06:57:18.062685+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:57:18.062685+0000","last_undegraded":"2024-05-30T06:57:18.062685+0000","last_fullsized":"2024-05-30T06:57:18.062685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123284,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248556,"statfs":{"total":96636764160,"available":96510521344,"internally_reserved":0,"allocated":1974272,"data_stored":1190970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126876,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244964,"statfs":{"total":96636764160,"available":96506843136,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76880,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294960,"statfs":{"total":96636764160,"available":96558039040,"internally_reserved":0,"allocated":1380352,"data_stored":600602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86620,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94285220,"statfs":{"total":96636764160,"available":96548065280,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144912,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226928,"statfs":{"total":96636764160,"available":96488374272,"internally_reserved":0,"allocated":1380352,"data_stored":600602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":146995655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575034,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144928,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226912,"statfs":{"total":96636764160,"available":96488357888,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104672,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94267168,"statfs":{"total":96636764160,"available":96529580032,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64992,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306848,"statfs":{"total":96636764160,"available":96570212352,"internally_reserved":0,"allocated":1974272,"data_stored":1190970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:57:23.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3f is not active+clean 2024-05-30T06:57:23.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.058541+0000', 'last_change': '2024-05-30T06:57:18.058541+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.058541+0000', 'last_undegraded': '2024-05-30T06:57:18.058541+0000', 'last_fullsized': '2024-05-30T06:57:18.058541+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3e is not active+clean 2024-05-30T06:57:23.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.050299+0000', 'last_change': '2024-05-30T06:57:18.050299+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.050299+0000', 'last_undegraded': '2024-05-30T06:57:18.050299+0000', 'last_fullsized': '2024-05-30T06:57:18.050299+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:57:23.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3d is not active+clean 2024-05-30T06:57:23.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.060020+0000', 'last_change': '2024-05-30T06:57:18.060020+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.060020+0000', 'last_undegraded': '2024-05-30T06:57:18.060020+0000', 'last_fullsized': '2024-05-30T06:57:18.060020+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:57:23.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3c is not active+clean 2024-05-30T06:57:23.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.056676+0000', 'last_change': '2024-05-30T06:57:18.056676+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.056676+0000', 'last_undegraded': '2024-05-30T06:57:18.056676+0000', 'last_fullsized': '2024-05-30T06:57:18.056676+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3b is not active+clean 2024-05-30T06:57:23.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.043649+0000', 'last_change': '2024-05-30T06:57:18.043649+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.043649+0000', 'last_undegraded': '2024-05-30T06:57:18.043649+0000', 'last_fullsized': '2024-05-30T06:57:18.043649+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:57:23.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3a is not active+clean 2024-05-30T06:57:23.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.053062+0000', 'last_change': '2024-05-30T06:57:18.053062+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.053062+0000', 'last_undegraded': '2024-05-30T06:57:18.053062+0000', 'last_fullsized': '2024-05-30T06:57:18.053062+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:57:23.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.39 is not active+clean 2024-05-30T06:57:23.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.047532+0000', 'last_change': '2024-05-30T06:57:18.047532+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.047532+0000', 'last_undegraded': '2024-05-30T06:57:18.047532+0000', 'last_fullsized': '2024-05-30T06:57:18.047532+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:57:23.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.38 is not active+clean 2024-05-30T06:57:23.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.055958+0000', 'last_change': '2024-05-30T06:57:18.055958+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.055958+0000', 'last_undegraded': '2024-05-30T06:57:18.055958+0000', 'last_fullsized': '2024-05-30T06:57:18.055958+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:57:23.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.37 is not active+clean 2024-05-30T06:57:23.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.055512+0000', 'last_change': '2024-05-30T06:57:18.055512+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.055512+0000', 'last_undegraded': '2024-05-30T06:57:18.055512+0000', 'last_fullsized': '2024-05-30T06:57:18.055512+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.36 is not active+clean 2024-05-30T06:57:23.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.054891+0000', 'last_change': '2024-05-30T06:57:18.054891+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.054891+0000', 'last_undegraded': '2024-05-30T06:57:18.054891+0000', 'last_fullsized': '2024-05-30T06:57:18.054891+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.35 is not active+clean 2024-05-30T06:57:23.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.051576+0000', 'last_change': '2024-05-30T06:57:18.051576+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.051576+0000', 'last_undegraded': '2024-05-30T06:57:18.051576+0000', 'last_fullsized': '2024-05-30T06:57:18.051576+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:57:23.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.34 is not active+clean 2024-05-30T06:57:23.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.055925+0000', 'last_change': '2024-05-30T06:57:18.055925+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.055925+0000', 'last_undegraded': '2024-05-30T06:57:18.055925+0000', 'last_fullsized': '2024-05-30T06:57:18.055925+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.33 is not active+clean 2024-05-30T06:57:23.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.056014+0000', 'last_change': '2024-05-30T06:57:18.056014+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.056014+0000', 'last_undegraded': '2024-05-30T06:57:18.056014+0000', 'last_fullsized': '2024-05-30T06:57:18.056014+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:57:23.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.32 is not active+clean 2024-05-30T06:57:23.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.060488+0000', 'last_change': '2024-05-30T06:57:18.060488+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.060488+0000', 'last_undegraded': '2024-05-30T06:57:18.060488+0000', 'last_fullsized': '2024-05-30T06:57:18.060488+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:57:23.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.31 is not active+clean 2024-05-30T06:57:23.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.053019+0000', 'last_change': '2024-05-30T06:57:18.053019+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.053019+0000', 'last_undegraded': '2024-05-30T06:57:18.053019+0000', 'last_fullsized': '2024-05-30T06:57:18.053019+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:57:23.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.30 is not active+clean 2024-05-30T06:57:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.053105+0000', 'last_change': '2024-05-30T06:57:18.053105+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.053105+0000', 'last_undegraded': '2024-05-30T06:57:18.053105+0000', 'last_fullsized': '2024-05-30T06:57:18.053105+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2f is not active+clean 2024-05-30T06:57:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.052523+0000', 'last_change': '2024-05-30T06:57:18.052523+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.052523+0000', 'last_undegraded': '2024-05-30T06:57:18.052523+0000', 'last_fullsized': '2024-05-30T06:57:18.052523+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:57:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2e is not active+clean 2024-05-30T06:57:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.055005+0000', 'last_change': '2024-05-30T06:57:18.055005+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.055005+0000', 'last_undegraded': '2024-05-30T06:57:18.055005+0000', 'last_fullsized': '2024-05-30T06:57:18.055005+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:57:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2d is not active+clean 2024-05-30T06:57:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.059570+0000', 'last_change': '2024-05-30T06:57:18.059570+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.059570+0000', 'last_undegraded': '2024-05-30T06:57:18.059570+0000', 'last_fullsized': '2024-05-30T06:57:18.059570+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:57:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2c is not active+clean 2024-05-30T06:57:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.051075+0000', 'last_change': '2024-05-30T06:57:18.051075+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.051075+0000', 'last_undegraded': '2024-05-30T06:57:18.051075+0000', 'last_fullsized': '2024-05-30T06:57:18.051075+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:57:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2b is not active+clean 2024-05-30T06:57:23.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.052332+0000', 'last_change': '2024-05-30T06:57:18.052332+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.052332+0000', 'last_undegraded': '2024-05-30T06:57:18.052332+0000', 'last_fullsized': '2024-05-30T06:57:18.052332+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:57:23.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2a is not active+clean 2024-05-30T06:57:23.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.054332+0000', 'last_change': '2024-05-30T06:57:18.054332+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.054332+0000', 'last_undegraded': '2024-05-30T06:57:18.054332+0000', 'last_fullsized': '2024-05-30T06:57:18.054332+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:57:23.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.29 is not active+clean 2024-05-30T06:57:23.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.049936+0000', 'last_change': '2024-05-30T06:57:18.049936+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.049936+0000', 'last_undegraded': '2024-05-30T06:57:18.049936+0000', 'last_fullsized': '2024-05-30T06:57:18.049936+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:57:23.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.28 is not active+clean 2024-05-30T06:57:23.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.050317+0000', 'last_change': '2024-05-30T06:57:18.050317+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.050317+0000', 'last_undegraded': '2024-05-30T06:57:18.050317+0000', 'last_fullsized': '2024-05-30T06:57:18.050317+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:57:23.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.27 is not active+clean 2024-05-30T06:57:23.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.052099+0000', 'last_change': '2024-05-30T06:57:18.052099+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.052099+0000', 'last_undegraded': '2024-05-30T06:57:18.052099+0000', 'last_fullsized': '2024-05-30T06:57:18.052099+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:57:23.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.26 is not active+clean 2024-05-30T06:57:23.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.053556+0000', 'last_change': '2024-05-30T06:57:18.053556+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.053556+0000', 'last_undegraded': '2024-05-30T06:57:18.053556+0000', 'last_fullsized': '2024-05-30T06:57:18.053556+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.25 is not active+clean 2024-05-30T06:57:23.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.055296+0000', 'last_change': '2024-05-30T06:57:18.055296+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.055296+0000', 'last_undegraded': '2024-05-30T06:57:18.055296+0000', 'last_fullsized': '2024-05-30T06:57:18.055296+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:57:23.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.24 is not active+clean 2024-05-30T06:57:23.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.050350+0000', 'last_change': '2024-05-30T06:57:18.050350+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.050350+0000', 'last_undegraded': '2024-05-30T06:57:18.050350+0000', 'last_fullsized': '2024-05-30T06:57:18.050350+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:57:23.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.23 is not active+clean 2024-05-30T06:57:23.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.053855+0000', 'last_change': '2024-05-30T06:57:18.053855+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.053855+0000', 'last_undegraded': '2024-05-30T06:57:18.053855+0000', 'last_fullsized': '2024-05-30T06:57:18.053855+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:57:23.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.22 is not active+clean 2024-05-30T06:57:23.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.047532+0000', 'last_change': '2024-05-30T06:57:18.047532+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.047532+0000', 'last_undegraded': '2024-05-30T06:57:18.047532+0000', 'last_fullsized': '2024-05-30T06:57:18.047532+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:57:23.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.21 is not active+clean 2024-05-30T06:57:23.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.051865+0000', 'last_change': '2024-05-30T06:57:18.051865+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.051865+0000', 'last_undegraded': '2024-05-30T06:57:18.051865+0000', 'last_fullsized': '2024-05-30T06:57:18.051865+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.20 is not active+clean 2024-05-30T06:57:23.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.053436+0000', 'last_change': '2024-05-30T06:57:18.053436+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.053436+0000', 'last_undegraded': '2024-05-30T06:57:18.053436+0000', 'last_fullsized': '2024-05-30T06:57:18.053436+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:57:23.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1e is not active+clean 2024-05-30T06:57:23.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.055532+0000', 'last_change': '2024-05-30T06:57:18.055532+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.055532+0000', 'last_undegraded': '2024-05-30T06:57:18.055532+0000', 'last_fullsized': '2024-05-30T06:57:18.055532+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:57:23.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1f is not active+clean 2024-05-30T06:57:23.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.053271+0000', 'last_change': '2024-05-30T06:57:18.053271+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.053271+0000', 'last_undegraded': '2024-05-30T06:57:18.053271+0000', 'last_fullsized': '2024-05-30T06:57:18.053271+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:57:23.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1c is not active+clean 2024-05-30T06:57:23.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.054501+0000', 'last_change': '2024-05-30T06:57:18.054501+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.054501+0000', 'last_undegraded': '2024-05-30T06:57:18.054501+0000', 'last_fullsized': '2024-05-30T06:57:18.054501+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:57:23.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1d is not active+clean 2024-05-30T06:57:23.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.057090+0000', 'last_change': '2024-05-30T06:57:18.057090+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.057090+0000', 'last_undegraded': '2024-05-30T06:57:18.057090+0000', 'last_fullsized': '2024-05-30T06:57:18.057090+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:57:23.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1a is not active+clean 2024-05-30T06:57:23.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.050851+0000', 'last_change': '2024-05-30T06:57:18.050851+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.050851+0000', 'last_undegraded': '2024-05-30T06:57:18.050851+0000', 'last_fullsized': '2024-05-30T06:57:18.050851+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1b is not active+clean 2024-05-30T06:57:23.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.053430+0000', 'last_change': '2024-05-30T06:57:18.053430+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.053430+0000', 'last_undegraded': '2024-05-30T06:57:18.053430+0000', 'last_fullsized': '2024-05-30T06:57:18.053430+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:57:23.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.18 is not active+clean 2024-05-30T06:57:23.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.052236+0000', 'last_change': '2024-05-30T06:57:18.052236+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.052236+0000', 'last_undegraded': '2024-05-30T06:57:18.052236+0000', 'last_fullsized': '2024-05-30T06:57:18.052236+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.19 is not active+clean 2024-05-30T06:57:23.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.048081+0000', 'last_change': '2024-05-30T06:57:18.048081+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.048081+0000', 'last_undegraded': '2024-05-30T06:57:18.048081+0000', 'last_fullsized': '2024-05-30T06:57:18.048081+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:57:23.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.16 is not active+clean 2024-05-30T06:57:23.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.048481+0000', 'last_change': '2024-05-30T06:57:18.048481+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.048481+0000', 'last_undegraded': '2024-05-30T06:57:18.048481+0000', 'last_fullsized': '2024-05-30T06:57:18.048481+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:57:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.17 is not active+clean 2024-05-30T06:57:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.050522+0000', 'last_change': '2024-05-30T06:57:18.050522+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.050522+0000', 'last_undegraded': '2024-05-30T06:57:18.050522+0000', 'last_fullsized': '2024-05-30T06:57:18.050522+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:57:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.14 is not active+clean 2024-05-30T06:57:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.049897+0000', 'last_change': '2024-05-30T06:57:18.049897+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.049897+0000', 'last_undegraded': '2024-05-30T06:57:18.049897+0000', 'last_fullsized': '2024-05-30T06:57:18.049897+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:57:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.15 is not active+clean 2024-05-30T06:57:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.048002+0000', 'last_change': '2024-05-30T06:57:18.048002+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.048002+0000', 'last_undegraded': '2024-05-30T06:57:18.048002+0000', 'last_fullsized': '2024-05-30T06:57:18.048002+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-30T06:57:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.12 is not active+clean 2024-05-30T06:57:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.049712+0000', 'last_change': '2024-05-30T06:57:18.049712+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.049712+0000', 'last_undegraded': '2024-05-30T06:57:18.049712+0000', 'last_fullsized': '2024-05-30T06:57:18.049712+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:57:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.13 is not active+clean 2024-05-30T06:57:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.049737+0000', 'last_change': '2024-05-30T06:57:18.049737+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.049737+0000', 'last_undegraded': '2024-05-30T06:57:18.049737+0000', 'last_fullsized': '2024-05-30T06:57:18.049737+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:57:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.11 is not active+clean 2024-05-30T06:57:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.050182+0000', 'last_change': '2024-05-30T06:57:18.050182+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.050182+0000', 'last_undegraded': '2024-05-30T06:57:18.050182+0000', 'last_fullsized': '2024-05-30T06:57:18.050182+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:57:23.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.e is not active+clean 2024-05-30T06:57:23.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.044366+0000', 'last_change': '2024-05-30T06:57:18.044366+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.044366+0000', 'last_undegraded': '2024-05-30T06:57:18.044366+0000', 'last_fullsized': '2024-05-30T06:57:18.044366+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-30T06:57:23.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.f is not active+clean 2024-05-30T06:57:23.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.056076+0000', 'last_change': '2024-05-30T06:57:18.056076+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.056076+0000', 'last_undegraded': '2024-05-30T06:57:18.056076+0000', 'last_fullsized': '2024-05-30T06:57:18.056076+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-30T06:57:23.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.c is not active+clean 2024-05-30T06:57:23.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.057989+0000', 'last_change': '2024-05-30T06:57:18.057989+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.057989+0000', 'last_undegraded': '2024-05-30T06:57:18.057989+0000', 'last_fullsized': '2024-05-30T06:57:18.057989+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:57:23.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.d is not active+clean 2024-05-30T06:57:23.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.056626+0000', 'last_change': '2024-05-30T06:57:18.056626+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.056626+0000', 'last_undegraded': '2024-05-30T06:57:18.056626+0000', 'last_fullsized': '2024-05-30T06:57:18.056626+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:57:23.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.a is not active+clean 2024-05-30T06:57:23.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.056827+0000', 'last_change': '2024-05-30T06:57:18.056827+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.056827+0000', 'last_undegraded': '2024-05-30T06:57:18.056827+0000', 'last_fullsized': '2024-05-30T06:57:18.056827+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:57:23.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.b is not active+clean 2024-05-30T06:57:23.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.052489+0000', 'last_change': '2024-05-30T06:57:18.052489+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.052489+0000', 'last_undegraded': '2024-05-30T06:57:18.052489+0000', 'last_fullsized': '2024-05-30T06:57:18.052489+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.8 is not active+clean 2024-05-30T06:57:23.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.055523+0000', 'last_change': '2024-05-30T06:57:18.055523+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.055523+0000', 'last_undegraded': '2024-05-30T06:57:18.055523+0000', 'last_fullsized': '2024-05-30T06:57:18.055523+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:57:23.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.9 is not active+clean 2024-05-30T06:57:23.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.048691+0000', 'last_change': '2024-05-30T06:57:18.048691+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.048691+0000', 'last_undegraded': '2024-05-30T06:57:18.048691+0000', 'last_fullsized': '2024-05-30T06:57:18.048691+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:57:23.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.6 is not active+clean 2024-05-30T06:57:23.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.051388+0000', 'last_change': '2024-05-30T06:57:18.051388+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.051388+0000', 'last_undegraded': '2024-05-30T06:57:18.051388+0000', 'last_fullsized': '2024-05-30T06:57:18.051388+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:57:23.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.7 is not active+clean 2024-05-30T06:57:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.053014+0000', 'last_change': '2024-05-30T06:57:18.053014+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.053014+0000', 'last_undegraded': '2024-05-30T06:57:18.053014+0000', 'last_fullsized': '2024-05-30T06:57:18.053014+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.4 is not active+clean 2024-05-30T06:57:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.052327+0000', 'last_change': '2024-05-30T06:57:18.052327+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.052327+0000', 'last_undegraded': '2024-05-30T06:57:18.052327+0000', 'last_fullsized': '2024-05-30T06:57:18.052327+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.5 is not active+clean 2024-05-30T06:57:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.050895+0000', 'last_change': '2024-05-30T06:57:18.050895+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.050895+0000', 'last_undegraded': '2024-05-30T06:57:18.050895+0000', 'last_fullsized': '2024-05-30T06:57:18.050895+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-30T06:57:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2 is not active+clean 2024-05-30T06:57:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.050243+0000', 'last_change': '2024-05-30T06:57:18.050243+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.050243+0000', 'last_undegraded': '2024-05-30T06:57:18.050243+0000', 'last_fullsized': '2024-05-30T06:57:18.050243+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:57:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3 is not active+clean 2024-05-30T06:57:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.052816+0000', 'last_change': '2024-05-30T06:57:18.052816+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.052816+0000', 'last_undegraded': '2024-05-30T06:57:18.052816+0000', 'last_fullsized': '2024-05-30T06:57:18.052816+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-30T06:57:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.0 is not active+clean 2024-05-30T06:57:23.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.054978+0000', 'last_change': '2024-05-30T06:57:18.054978+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.054978+0000', 'last_undegraded': '2024-05-30T06:57:18.054978+0000', 'last_fullsized': '2024-05-30T06:57:18.054978+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-30T06:57:23.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1 is not active+clean 2024-05-30T06:57:23.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.051448+0000', 'last_change': '2024-05-30T06:57:18.051448+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.051448+0000', 'last_undegraded': '2024-05-30T06:57:18.051448+0000', 'last_fullsized': '2024-05-30T06:57:18.051448+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-30T06:57:23.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.10 is not active+clean 2024-05-30T06:57:23.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-05-30T06:57:18.049877+0000', 'last_change': '2024-05-30T06:57:18.049877+0000', 'last_active': '2024-05-30T06:57:18.036610+0000', 'last_peered': '2024-05-30T06:57:18.036610+0000', 'last_clean': '2024-05-30T06:57:18.036610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-30T06:57:18.049877+0000', 'last_undegraded': '2024-05-30T06:57:18.049877+0000', 'last_fullsized': '2024-05-30T06:57:18.049877+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'last_clean_scrub_stamp': '2024-05-30T06:57:18.036610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-30T06:57:23.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-30T06:57:24.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.163+0000 7f3921e00640 1 Processor -- start 2024-05-30T06:57:24.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.163+0000 7f3921e00640 1 -- start start 2024-05-30T06:57:24.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f391c15e930 0x7f391c09b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:24.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f391c0d1240 0x7f391c1625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:24.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f391c0d1690 0x7f391c162ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:24.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f391c09bee0 con 0x7f391c15e930 2024-05-30T06:57:24.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f391c09abe0 con 0x7f391c0d1240 2024-05-30T06:57:24.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f391c09aec0 con 0x7f391c0d1690 2024-05-30T06:57:24.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f391aa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f391c15e930 0x7f391c09b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:24.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f391aa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f391c15e930 0x7f391c09b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56084/0 (socket says 172.21.15.37:56084) 2024-05-30T06:57:24.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f391aa00640 1 -- 172.21.15.37:0/85306356 learned_addr learned my addr 172.21.15.37:0/85306356 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:24.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3912000640 1 --2- 172.21.15.37:0/85306356 >> v2:172.21.15.105:3300/0 conn(0x7f391c0d1240 0x7f391c1625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:24.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f391b400640 1 --2- 172.21.15.37:0/85306356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f391c0d1690 0x7f391c162ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:24.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f391aa00640 1 -- 172.21.15.37:0/85306356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f391c0d1690 msgr2=0x7f391c162ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:24.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f391aa00640 1 --2- 172.21.15.37:0/85306356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f391c0d1690 0x7f391c162ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f391aa00640 1 -- 172.21.15.37:0/85306356 >> v2:172.21.15.105:3300/0 conn(0x7f391c0d1240 msgr2=0x7f391c1625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:24.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f391aa00640 1 --2- 172.21.15.37:0/85306356 >> v2:172.21.15.105:3300/0 conn(0x7f391c0d1240 0x7f391c1625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f391aa00640 1 -- 172.21.15.37:0/85306356 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391c09b1a0 con 0x7f391c15e930 2024-05-30T06:57:24.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3912000640 1 --2- 172.21.15.37:0/85306356 >> v2:172.21.15.105:3300/0 conn(0x7f391c0d1240 0x7f391c1625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:24.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f391aa00640 1 --2- 172.21.15.37:0/85306356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f391c15e930 0x7f391c09b9a0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f391c073320 tx=0x7f390c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb640c9bdd634d18 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:24.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f391a000640 1 -- 172.21.15.37:0/85306356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c0b0070 con 0x7f391c15e930 2024-05-30T06:57:24.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f391a000640 1 -- 172.21.15.37:0/85306356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390c0ab600 con 0x7f391c15e930 2024-05-30T06:57:24.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f391a000640 1 -- 172.21.15.37:0/85306356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c0ab9d0 con 0x7f391c15e930 2024-05-30T06:57:24.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 -- 172.21.15.37:0/85306356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f391c15e930 msgr2=0x7f391c09b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:24.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 --2- 172.21.15.37:0/85306356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f391c15e930 0x7f391c09b9a0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f391c073320 tx=0x7f390c01c490 comp rx=0 tx=0).stop 2024-05-30T06:57:24.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 -- 172.21.15.37:0/85306356 shutdown_connections 2024-05-30T06:57:24.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 --2- 172.21.15.37:0/85306356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f391c0d1690 0x7f391c162ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 --2- 172.21.15.37:0/85306356 >> v2:172.21.15.105:3300/0 conn(0x7f391c0d1240 0x7f391c1625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 --2- 172.21.15.37:0/85306356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f391c15e930 0x7f391c09b9a0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 -- 172.21.15.37:0/85306356 >> 172.21.15.37:0/85306356 conn(0x7f391c0b4100 msgr2=0x7f391c0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:24.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 -- 172.21.15.37:0/85306356 shutdown_connections 2024-05-30T06:57:24.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 -- 172.21.15.37:0/85306356 wait complete. 2024-05-30T06:57:24.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 Processor -- start 2024-05-30T06:57:24.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 -- start start 2024-05-30T06:57:24.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.167+0000 7f3921e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f391c0d1240 0x7f391c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:24.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3921e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f391c0d1690 0x7f391c14cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:24.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3921e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f391c15e930 0x7f391c0b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:24.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3921e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f391c0cd5f0 con 0x7f391c0d1240 2024-05-30T06:57:24.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3921e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f391c0cd470 con 0x7f391c15e930 2024-05-30T06:57:24.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3921e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f391c0cd770 con 0x7f391c0d1690 2024-05-30T06:57:24.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f391aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f391c0d1240 0x7f391c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:24.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f391aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f391c0d1240 0x7f391c155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56092/0 (socket says 172.21.15.37:56092) 2024-05-30T06:57:24.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f391aa00640 1 -- 172.21.15.37:0/117276208 learned_addr learned my addr 172.21.15.37:0/117276208 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:24.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3912000640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f391c0d1690 0x7f391c14cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:24.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f391b400640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f391c15e930 0x7f391c0b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:24.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f391aa00640 1 -- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f391c0d1690 msgr2=0x7f391c14cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:24.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f391aa00640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f391c0d1690 0x7f391c14cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f391aa00640 1 -- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f391c15e930 msgr2=0x7f391c0b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:24.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f391aa00640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f391c15e930 0x7f391c0b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f391aa00640 1 -- 172.21.15.37:0/117276208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391c14cab0 con 0x7f391c0d1240 2024-05-30T06:57:24.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3912000640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f391c0d1690 0x7f391c14cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:24.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f391b400640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f391c15e930 0x7f391c0b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:24.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f391aa00640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f391c0d1240 0x7f391c155d00 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f390c0ae040 tx=0x7f390c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:24.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3913e00640 1 -- 172.21.15.37:0/117276208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c0b0040 con 0x7f391c0d1240 2024-05-30T06:57:24.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3913e00640 1 -- 172.21.15.37:0/117276208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390c0b4640 con 0x7f391c0d1240 2024-05-30T06:57:24.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3913e00640 1 -- 172.21.15.37:0/117276208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390c0b4a30 con 0x7f391c0d1240 2024-05-30T06:57:24.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3921e00640 1 -- 172.21.15.37:0/117276208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f391c14d560 con 0x7f391c0d1240 2024-05-30T06:57:24.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3921e00640 1 -- 172.21.15.37:0/117276208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f391c14db20 con 0x7f391c0d1240 2024-05-30T06:57:24.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3921e00640 1 -- 172.21.15.37:0/117276208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391c068b20 con 0x7f391c0d1240 2024-05-30T06:57:24.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.171+0000 7f3913e00640 1 -- 172.21.15.37:0/117276208 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f390c0ab4c0 con 0x7f391c0d1240 2024-05-30T06:57:24.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.175+0000 7f3913e00640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f38f8069bb0 0x7f38f806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:24.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.175+0000 7f3913e00640 1 -- 172.21.15.37:0/117276208 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f390c11f370 con 0x7f391c0d1240 2024-05-30T06:57:24.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.175+0000 7f3912000640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f38f8069bb0 0x7f38f806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:24.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.175+0000 7f3912000640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f38f8069bb0 0x7f38f806c070 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f391c0b8140 tx=0x7f3904008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:24.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.179+0000 7f3913e00640 1 -- 172.21.15.37:0/117276208 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f390c016110 con 0x7f391c0d1240 2024-05-30T06:57:24.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.399+0000 7f3921e00640 1 -- 172.21.15.37:0/117276208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f391c06e350 con 0x7f391c0d1240 2024-05-30T06:57:24.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.403+0000 7f3913e00640 1 -- 172.21.15.37:0/117276208 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1036 (secure 0 0 0) 0x7f390c0ba2b0 con 0x7f391c0d1240 2024-05-30T06:57:24.406 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:24.406 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":938,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":114,"num_osds":8,"num_up_osds":8,"osd_up_since":1717051317,"num_in_osds":8,"osd_in_since":1717051308,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":894119936,"bytes_avail":772199993344,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":74,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":9120}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2024-05-30T06:56:40.960792+0000","services":{}},"progress_events":{}} 2024-05-30T06:57:24.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.403+0000 7f3921e00640 1 -- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f38f8069bb0 msgr2=0x7f38f806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:24.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.403+0000 7f3921e00640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f38f8069bb0 0x7f38f806c070 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f391c0b8140 tx=0x7f3904008040 comp rx=0 tx=0).stop 2024-05-30T06:57:24.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.403+0000 7f3921e00640 1 -- 172.21.15.37:0/117276208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f391c0d1240 msgr2=0x7f391c155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:24.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.403+0000 7f3921e00640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f391c0d1240 0x7f391c155d00 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f390c0ae040 tx=0x7f390c019230 comp rx=0 tx=0).stop 2024-05-30T06:57:24.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.403+0000 7f3921e00640 1 -- 172.21.15.37:0/117276208 shutdown_connections 2024-05-30T06:57:24.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.403+0000 7f3921e00640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f38f8069bb0 0x7f38f806c070 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.403+0000 7f3921e00640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f391c15e930 0x7f391c0b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.403+0000 7f3921e00640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f391c0d1690 0x7f391c14cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.403+0000 7f3921e00640 1 --2- 172.21.15.37:0/117276208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f391c0d1240 0x7f391c155d00 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.403+0000 7f3921e00640 1 -- 172.21.15.37:0/117276208 >> 172.21.15.37:0/117276208 conn(0x7f391c0b4100 msgr2=0x7f391c071970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:24.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.403+0000 7f3921e00640 1 -- 172.21.15.37:0/117276208 shutdown_connections 2024-05-30T06:57:24.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.403+0000 7f3921e00640 1 -- 172.21.15.37:0/117276208 wait complete. 2024-05-30T06:57:24.426 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-05-30T06:57:24.427 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:57:24.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.567+0000 7f0de9000640 1 Processor -- start 2024-05-30T06:57:24.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.567+0000 7f0de9000640 1 -- start start 2024-05-30T06:57:24.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.567+0000 7f0de9000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0de415ed50 0x7f0de40c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:24.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.567+0000 7f0de9000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0de40c7f20 con 0x7f0de409aa60 2024-05-30T06:57:24.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0de40c8200 con 0x7f0de40d02b0 2024-05-30T06:57:24.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0de40c9500 con 0x7f0de415ed50 2024-05-30T06:57:24.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de2800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0de409aa60 0x7f0de409aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39814/0 (socket says 172.21.15.37:39814) 2024-05-30T06:57:24.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de2800640 1 -- 172.21.15.37:0/704183731 learned_addr learned my addr 172.21.15.37:0/704183731 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:24.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de1e00640 1 --2- 172.21.15.37:0/704183731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0de415ed50 0x7f0de40c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:24.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de1400640 1 -- 172.21.15.37:0/704183731 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458844741 0 0) 0x7f0de40c7f20 con 0x7f0de409aa60 2024-05-30T06:57:24.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de1400640 1 -- 172.21.15.37:0/704183731 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dc8003530 con 0x7f0de409aa60 2024-05-30T06:57:24.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de1400640 1 -- 172.21.15.37:0/704183731 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 393012158 0 0) 0x7f0de40c8200 con 0x7f0de40d02b0 2024-05-30T06:57:24.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de1400640 1 -- 172.21.15.37:0/704183731 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0de40c7f20 con 0x7f0de40d02b0 2024-05-30T06:57:24.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de1e00640 1 -- 172.21.15.37:0/704183731 >> v1:172.21.15.105:6789/0 conn(0x7f0de40d02b0 legacy=0x7f0de40d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:24.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de1e00640 1 -- 172.21.15.37:0/704183731 >> v1:172.21.15.37:6789/0 conn(0x7f0de409aa60 legacy=0x7f0de409aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:24.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de1400640 1 -- 172.21.15.37:0/704183731 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3251767892 0 0) 0x7f0dc8003530 con 0x7f0de409aa60 2024-05-30T06:57:24.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de1e00640 1 -- 172.21.15.37:0/704183731 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de40c84e0 con 0x7f0de415ed50 2024-05-30T06:57:24.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de1e00640 1 --2- 172.21.15.37:0/704183731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0de415ed50 0x7f0de40c8fc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40097f0 tx=0x7f0dd401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e4a1d01ce451b5c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:24.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de1400640 1 -- 172.21.15.37:0/704183731 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40b0070 con 0x7f0de415ed50 2024-05-30T06:57:24.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de1400640 1 -- 172.21.15.37:0/704183731 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd40ab400 con 0x7f0de415ed50 2024-05-30T06:57:24.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de1400640 1 -- 172.21.15.37:0/704183731 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc001a00 con 0x7f0de415ed50 2024-05-30T06:57:24.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 -- 172.21.15.37:0/704183731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0de415ed50 msgr2=0x7f0de40c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:24.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 --2- 172.21.15.37:0/704183731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0de415ed50 0x7f0de40c8fc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40097f0 tx=0x7f0dd401c400 comp rx=0 tx=0).stop 2024-05-30T06:57:24.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 -- 172.21.15.37:0/704183731 shutdown_connections 2024-05-30T06:57:24.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 --2- 172.21.15.37:0/704183731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0de415ed50 0x7f0de40c8fc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 -- 172.21.15.37:0/704183731 >> 172.21.15.37:0/704183731 conn(0x7f0de40d26e0 msgr2=0x7f0de40d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 -- 172.21.15.37:0/704183731 shutdown_connections 2024-05-30T06:57:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 -- 172.21.15.37:0/704183731 wait complete. 2024-05-30T06:57:24.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 Processor -- start 2024-05-30T06:57:24.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 -- start start 2024-05-30T06:57:24.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0de409aa60 0x7f0de4152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:24.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0de40d02b0 0x7f0de4161940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:24.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0de415ed50 0x7f0de4155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:24.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0de40c7c50 con 0x7f0de40d02b0 2024-05-30T06:57:24.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0de40c7ad0 con 0x7f0de415ed50 2024-05-30T06:57:24.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.571+0000 7f0de9000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0de416cb30 con 0x7f0de409aa60 2024-05-30T06:57:24.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0ddbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0de40d02b0 0x7f0de4161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:24.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0ddbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0de40d02b0 0x7f0de4161940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56104/0 (socket says 172.21.15.37:56104) 2024-05-30T06:57:24.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0de1e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0de409aa60 0x7f0de4152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:24.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0ddbe00640 1 -- 172.21.15.37:0/410492114 learned_addr learned my addr 172.21.15.37:0/410492114 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:24.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0de2800640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0de415ed50 0x7f0de4155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0ddbe00640 1 -- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0de409aa60 msgr2=0x7f0de4152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0ddbe00640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0de409aa60 0x7f0de4152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0ddbe00640 1 -- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0de415ed50 msgr2=0x7f0de4155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0ddbe00640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0de415ed50 0x7f0de4155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0ddbe00640 1 -- 172.21.15.37:0/410492114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de409c7c0 con 0x7f0de40d02b0 2024-05-30T06:57:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0de1e00640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0de409aa60 0x7f0de4152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:57:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0ddbe00640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0de40d02b0 0x7f0de4161940 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00c460 tx=0x7f0dcc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0dda000640 1 -- 172.21.15.37:0/410492114 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0052d0 con 0x7f0de40d02b0 2024-05-30T06:57:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0dda000640 1 -- 172.21.15.37:0/410492114 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dcc005490 con 0x7f0de40d02b0 2024-05-30T06:57:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0de9000640 1 -- 172.21.15.37:0/410492114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de409caa0 con 0x7f0de40d02b0 2024-05-30T06:57:24.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0dda000640 1 -- 172.21.15.37:0/410492114 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc012850 con 0x7f0de40d02b0 2024-05-30T06:57:24.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0de9000640 1 -- 172.21.15.37:0/410492114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de409d060 con 0x7f0de40d02b0 2024-05-30T06:57:24.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0de9000640 1 -- 172.21.15.37:0/410492114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de4068b20 con 0x7f0de40d02b0 2024-05-30T06:57:24.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.579+0000 7f0dda000640 1 -- 172.21.15.37:0/410492114 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f0dcc0129f0 con 0x7f0de40d02b0 2024-05-30T06:57:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.583+0000 7f0dda000640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0dc0069bb0 0x7f0dc006c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.583+0000 7f0dda000640 1 -- 172.21.15.37:0/410492114 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f0dcc085260 con 0x7f0de40d02b0 2024-05-30T06:57:24.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.583+0000 7f0de1e00640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0dc0069bb0 0x7f0dc006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:24.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.583+0000 7f0de1e00640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0dc0069bb0 0x7f0dc006c070 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40ad000 tx=0x7f0dd40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:24.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.587+0000 7f0dda000640 1 -- 172.21.15.37:0/410492114 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0dcc056c30 con 0x7f0de40d02b0 2024-05-30T06:57:24.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.747+0000 7f0de9000640 1 -- 172.21.15.37:0/410492114 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0de409d230 con 0x7f0dc0069bb0 2024-05-30T06:57:24.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.751+0000 7f0dda000640 1 -- 172.21.15.37:0/410492114 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247105 (secure 0 0 0) 0x7f0de409d230 con 0x7f0dc0069bb0 2024-05-30T06:57:24.755 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:24.756 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:57:24.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.755+0000 7f0de9000640 1 -- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0dc0069bb0 msgr2=0x7f0dc006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:24.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.755+0000 7f0de9000640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0dc0069bb0 0x7f0dc006c070 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40ad000 tx=0x7f0dd40a6000 comp rx=0 tx=0).stop 2024-05-30T06:57:24.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.755+0000 7f0de9000640 1 -- 172.21.15.37:0/410492114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0de40d02b0 msgr2=0x7f0de4161940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:24.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.755+0000 7f0de9000640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0de40d02b0 0x7f0de4161940 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00c460 tx=0x7f0dcc00c920 comp rx=0 tx=0).stop 2024-05-30T06:57:24.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.755+0000 7f0de9000640 1 -- 172.21.15.37:0/410492114 shutdown_connections 2024-05-30T06:57:24.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.755+0000 7f0de9000640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0dc0069bb0 0x7f0dc006c070 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.755+0000 7f0de9000640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0de415ed50 0x7f0de4155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.755+0000 7f0de9000640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0de40d02b0 0x7f0de4161940 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.755+0000 7f0de9000640 1 --2- 172.21.15.37:0/410492114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0de409aa60 0x7f0de4152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:24.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.755+0000 7f0de9000640 1 -- 172.21.15.37:0/410492114 >> 172.21.15.37:0/410492114 conn(0x7f0de40d26e0 msgr2=0x7f0de4153650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:24.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.755+0000 7f0de9000640 1 -- 172.21.15.37:0/410492114 shutdown_connections 2024-05-30T06:57:24.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:24.755+0000 7f0de9000640 1 -- 172.21.15.37:0/410492114 wait complete. 2024-05-30T06:57:24.777 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":569,"stamp":"2024-05-30T06:57:22.971320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":873164,"kb_used_data":11992,"kb_used_omap":12,"kb_used_meta":861043,"kb_avail":754101556,"statfs":{"total":773094113280,"available":772199993344,"internally_reserved":0,"allocated":12279808,"data_stored":6010876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":881708592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.930294"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.058541+0000","last_change":"2024-05-30T06:57:18.058541+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.058541+0000","last_undegraded":"2024-05-30T06:57:18.058541+0000","last_fullsized":"2024-05-30T06:57:18.058541+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050299+0000","last_change":"2024-05-30T06:57:18.050299+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050299+0000","last_undegraded":"2024-05-30T06:57:18.050299+0000","last_fullsized":"2024-05-30T06:57:18.050299+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.060020+0000","last_change":"2024-05-30T06:57:18.060020+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.060020+0000","last_undegraded":"2024-05-30T06:57:18.060020+0000","last_fullsized":"2024-05-30T06:57:18.060020+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056676+0000","last_change":"2024-05-30T06:57:18.056676+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056676+0000","last_undegraded":"2024-05-30T06:57:18.056676+0000","last_fullsized":"2024-05-30T06:57:18.056676+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.043649+0000","last_change":"2024-05-30T06:57:18.043649+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.043649+0000","last_undegraded":"2024-05-30T06:57:18.043649+0000","last_fullsized":"2024-05-30T06:57:18.043649+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053062+0000","last_change":"2024-05-30T06:57:18.053062+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053062+0000","last_undegraded":"2024-05-30T06:57:18.053062+0000","last_fullsized":"2024-05-30T06:57:18.053062+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.047532+0000","last_change":"2024-05-30T06:57:18.047532+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.047532+0000","last_undegraded":"2024-05-30T06:57:18.047532+0000","last_fullsized":"2024-05-30T06:57:18.047532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055958+0000","last_change":"2024-05-30T06:57:18.055958+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055958+0000","last_undegraded":"2024-05-30T06:57:18.055958+0000","last_fullsized":"2024-05-30T06:57:18.055958+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055512+0000","last_change":"2024-05-30T06:57:18.055512+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055512+0000","last_undegraded":"2024-05-30T06:57:18.055512+0000","last_fullsized":"2024-05-30T06:57:18.055512+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054891+0000","last_change":"2024-05-30T06:57:18.054891+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054891+0000","last_undegraded":"2024-05-30T06:57:18.054891+0000","last_fullsized":"2024-05-30T06:57:18.054891+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051576+0000","last_change":"2024-05-30T06:57:18.051576+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051576+0000","last_undegraded":"2024-05-30T06:57:18.051576+0000","last_fullsized":"2024-05-30T06:57:18.051576+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055925+0000","last_change":"2024-05-30T06:57:18.055925+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055925+0000","last_undegraded":"2024-05-30T06:57:18.055925+0000","last_fullsized":"2024-05-30T06:57:18.055925+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056014+0000","last_change":"2024-05-30T06:57:18.056014+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056014+0000","last_undegraded":"2024-05-30T06:57:18.056014+0000","last_fullsized":"2024-05-30T06:57:18.056014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.060488+0000","last_change":"2024-05-30T06:57:18.060488+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.060488+0000","last_undegraded":"2024-05-30T06:57:18.060488+0000","last_fullsized":"2024-05-30T06:57:18.060488+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053019+0000","last_change":"2024-05-30T06:57:18.053019+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053019+0000","last_undegraded":"2024-05-30T06:57:18.053019+0000","last_fullsized":"2024-05-30T06:57:18.053019+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053105+0000","last_change":"2024-05-30T06:57:18.053105+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053105+0000","last_undegraded":"2024-05-30T06:57:18.053105+0000","last_fullsized":"2024-05-30T06:57:18.053105+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052523+0000","last_change":"2024-05-30T06:57:18.052523+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052523+0000","last_undegraded":"2024-05-30T06:57:18.052523+0000","last_fullsized":"2024-05-30T06:57:18.052523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055005+0000","last_change":"2024-05-30T06:57:18.055005+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055005+0000","last_undegraded":"2024-05-30T06:57:18.055005+0000","last_fullsized":"2024-05-30T06:57:18.055005+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.059570+0000","last_change":"2024-05-30T06:57:18.059570+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.059570+0000","last_undegraded":"2024-05-30T06:57:18.059570+0000","last_fullsized":"2024-05-30T06:57:18.059570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051075+0000","last_change":"2024-05-30T06:57:18.051075+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051075+0000","last_undegraded":"2024-05-30T06:57:18.051075+0000","last_fullsized":"2024-05-30T06:57:18.051075+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052332+0000","last_change":"2024-05-30T06:57:18.052332+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052332+0000","last_undegraded":"2024-05-30T06:57:18.052332+0000","last_fullsized":"2024-05-30T06:57:18.052332+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054332+0000","last_change":"2024-05-30T06:57:18.054332+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054332+0000","last_undegraded":"2024-05-30T06:57:18.054332+0000","last_fullsized":"2024-05-30T06:57:18.054332+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049936+0000","last_change":"2024-05-30T06:57:18.049936+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049936+0000","last_undegraded":"2024-05-30T06:57:18.049936+0000","last_fullsized":"2024-05-30T06:57:18.049936+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050317+0000","last_change":"2024-05-30T06:57:18.050317+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050317+0000","last_undegraded":"2024-05-30T06:57:18.050317+0000","last_fullsized":"2024-05-30T06:57:18.050317+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052099+0000","last_change":"2024-05-30T06:57:18.052099+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052099+0000","last_undegraded":"2024-05-30T06:57:18.052099+0000","last_fullsized":"2024-05-30T06:57:18.052099+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053556+0000","last_change":"2024-05-30T06:57:18.053556+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053556+0000","last_undegraded":"2024-05-30T06:57:18.053556+0000","last_fullsized":"2024-05-30T06:57:18.053556+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055296+0000","last_change":"2024-05-30T06:57:18.055296+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055296+0000","last_undegraded":"2024-05-30T06:57:18.055296+0000","last_fullsized":"2024-05-30T06:57:18.055296+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050350+0000","last_change":"2024-05-30T06:57:18.050350+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050350+0000","last_undegraded":"2024-05-30T06:57:18.050350+0000","last_fullsized":"2024-05-30T06:57:18.050350+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053855+0000","last_change":"2024-05-30T06:57:18.053855+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053855+0000","last_undegraded":"2024-05-30T06:57:18.053855+0000","last_fullsized":"2024-05-30T06:57:18.053855+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.047532+0000","last_change":"2024-05-30T06:57:18.047532+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.047532+0000","last_undegraded":"2024-05-30T06:57:18.047532+0000","last_fullsized":"2024-05-30T06:57:18.047532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051865+0000","last_change":"2024-05-30T06:57:18.051865+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051865+0000","last_undegraded":"2024-05-30T06:57:18.051865+0000","last_fullsized":"2024-05-30T06:57:18.051865+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053436+0000","last_change":"2024-05-30T06:57:18.053436+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053436+0000","last_undegraded":"2024-05-30T06:57:18.053436+0000","last_fullsized":"2024-05-30T06:57:18.053436+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055532+0000","last_change":"2024-05-30T06:57:18.055532+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055532+0000","last_undegraded":"2024-05-30T06:57:18.055532+0000","last_fullsized":"2024-05-30T06:57:18.055532+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065817+0000","last_change":"2024-05-30T06:57:18.064919+0000","last_active":"2024-05-30T06:57:18.065817+0000","last_peered":"2024-05-30T06:57:18.065817+0000","last_clean":"2024-05-30T06:57:18.065817+0000","last_became_active":"2024-05-30T06:57:18.064658+0000","last_became_peered":"2024-05-30T06:57:18.064658+0000","last_unstale":"2024-05-30T06:57:18.065817+0000","last_undegraded":"2024-05-30T06:57:18.065817+0000","last_fullsized":"2024-05-30T06:57:18.065817+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:07:02.051446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053271+0000","last_change":"2024-05-30T06:57:18.053271+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053271+0000","last_undegraded":"2024-05-30T06:57:18.053271+0000","last_fullsized":"2024-05-30T06:57:18.053271+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.069248+0000","last_change":"2024-05-30T06:57:18.068587+0000","last_active":"2024-05-30T06:57:18.069248+0000","last_peered":"2024-05-30T06:57:18.069248+0000","last_clean":"2024-05-30T06:57:18.069248+0000","last_became_active":"2024-05-30T06:57:18.068278+0000","last_became_peered":"2024-05-30T06:57:18.068278+0000","last_unstale":"2024-05-30T06:57:18.069248+0000","last_undegraded":"2024-05-30T06:57:18.069248+0000","last_fullsized":"2024-05-30T06:57:18.069248+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:41:46.001101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054501+0000","last_change":"2024-05-30T06:57:18.054501+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054501+0000","last_undegraded":"2024-05-30T06:57:18.054501+0000","last_fullsized":"2024-05-30T06:57:18.054501+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.069013+0000","last_change":"2024-05-30T06:57:18.068473+0000","last_active":"2024-05-30T06:57:18.069013+0000","last_peered":"2024-05-30T06:57:18.069013+0000","last_clean":"2024-05-30T06:57:18.069013+0000","last_became_active":"2024-05-30T06:57:18.067152+0000","last_became_peered":"2024-05-30T06:57:18.067152+0000","last_unstale":"2024-05-30T06:57:18.069013+0000","last_undegraded":"2024-05-30T06:57:18.069013+0000","last_fullsized":"2024-05-30T06:57:18.069013+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:18:56.976311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.057090+0000","last_change":"2024-05-30T06:57:18.057090+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.057090+0000","last_undegraded":"2024-05-30T06:57:18.057090+0000","last_fullsized":"2024-05-30T06:57:18.057090+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.066089+0000","last_change":"2024-05-30T06:57:18.062798+0000","last_active":"2024-05-30T06:57:18.066089+0000","last_peered":"2024-05-30T06:57:18.066089+0000","last_clean":"2024-05-30T06:57:18.066089+0000","last_became_active":"2024-05-30T06:57:18.062422+0000","last_became_peered":"2024-05-30T06:57:18.062422+0000","last_unstale":"2024-05-30T06:57:18.066089+0000","last_undegraded":"2024-05-30T06:57:18.066089+0000","last_fullsized":"2024-05-30T06:57:18.066089+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:13:56.674922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050851+0000","last_change":"2024-05-30T06:57:18.050851+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050851+0000","last_undegraded":"2024-05-30T06:57:18.050851+0000","last_fullsized":"2024-05-30T06:57:18.050851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065506+0000","last_change":"2024-05-30T06:57:18.064096+0000","last_active":"2024-05-30T06:57:18.065506+0000","last_peered":"2024-05-30T06:57:18.065506+0000","last_clean":"2024-05-30T06:57:18.065506+0000","last_became_active":"2024-05-30T06:57:18.063824+0000","last_became_peered":"2024-05-30T06:57:18.063824+0000","last_unstale":"2024-05-30T06:57:18.065506+0000","last_undegraded":"2024-05-30T06:57:18.065506+0000","last_fullsized":"2024-05-30T06:57:18.065506+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:49:55.172715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053430+0000","last_change":"2024-05-30T06:57:18.053430+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053430+0000","last_undegraded":"2024-05-30T06:57:18.053430+0000","last_fullsized":"2024-05-30T06:57:18.053430+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061632+0000","last_change":"2024-05-30T06:57:18.057527+0000","last_active":"2024-05-30T06:57:18.061632+0000","last_peered":"2024-05-30T06:57:18.061632+0000","last_clean":"2024-05-30T06:57:18.061632+0000","last_became_active":"2024-05-30T06:57:18.057148+0000","last_became_peered":"2024-05-30T06:57:18.057148+0000","last_unstale":"2024-05-30T06:57:18.061632+0000","last_undegraded":"2024-05-30T06:57:18.061632+0000","last_fullsized":"2024-05-30T06:57:18.061632+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:24:27.985268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052236+0000","last_change":"2024-05-30T06:57:18.052236+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052236+0000","last_undegraded":"2024-05-30T06:57:18.052236+0000","last_fullsized":"2024-05-30T06:57:18.052236+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.057753+0000","last_change":"2024-05-30T06:57:18.054715+0000","last_active":"2024-05-30T06:57:18.057753+0000","last_peered":"2024-05-30T06:57:18.057753+0000","last_clean":"2024-05-30T06:57:18.057753+0000","last_became_active":"2024-05-30T06:57:18.054397+0000","last_became_peered":"2024-05-30T06:57:18.054397+0000","last_unstale":"2024-05-30T06:57:18.057753+0000","last_undegraded":"2024-05-30T06:57:18.057753+0000","last_fullsized":"2024-05-30T06:57:18.057753+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:08:26.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048081+0000","last_change":"2024-05-30T06:57:18.048081+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048081+0000","last_undegraded":"2024-05-30T06:57:18.048081+0000","last_fullsized":"2024-05-30T06:57:18.048081+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067054+0000","last_change":"2024-05-30T06:57:18.062207+0000","last_active":"2024-05-30T06:57:18.067054+0000","last_peered":"2024-05-30T06:57:18.067054+0000","last_clean":"2024-05-30T06:57:18.067054+0000","last_became_active":"2024-05-30T06:57:18.061886+0000","last_became_peered":"2024-05-30T06:57:18.061886+0000","last_unstale":"2024-05-30T06:57:18.067054+0000","last_undegraded":"2024-05-30T06:57:18.067054+0000","last_fullsized":"2024-05-30T06:57:18.067054+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:24:27.985268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048481+0000","last_change":"2024-05-30T06:57:18.048481+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048481+0000","last_undegraded":"2024-05-30T06:57:18.048481+0000","last_fullsized":"2024-05-30T06:57:18.048481+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068323+0000","last_change":"2024-05-30T06:57:18.063301+0000","last_active":"2024-05-30T06:57:18.068323+0000","last_peered":"2024-05-30T06:57:18.068323+0000","last_clean":"2024-05-30T06:57:18.068323+0000","last_became_active":"2024-05-30T06:57:18.063018+0000","last_became_peered":"2024-05-30T06:57:18.063018+0000","last_unstale":"2024-05-30T06:57:18.068323+0000","last_undegraded":"2024-05-30T06:57:18.068323+0000","last_fullsized":"2024-05-30T06:57:18.068323+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:58:26.774587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050522+0000","last_change":"2024-05-30T06:57:18.050522+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050522+0000","last_undegraded":"2024-05-30T06:57:18.050522+0000","last_fullsized":"2024-05-30T06:57:18.050522+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067505+0000","last_change":"2024-05-30T06:57:18.064721+0000","last_active":"2024-05-30T06:57:18.067505+0000","last_peered":"2024-05-30T06:57:18.067505+0000","last_clean":"2024-05-30T06:57:18.067505+0000","last_became_active":"2024-05-30T06:57:18.064369+0000","last_became_peered":"2024-05-30T06:57:18.064369+0000","last_unstale":"2024-05-30T06:57:18.067505+0000","last_undegraded":"2024-05-30T06:57:18.067505+0000","last_fullsized":"2024-05-30T06:57:18.067505+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:14.166437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049897+0000","last_change":"2024-05-30T06:57:18.049897+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049897+0000","last_undegraded":"2024-05-30T06:57:18.049897+0000","last_fullsized":"2024-05-30T06:57:18.049897+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068921+0000","last_change":"2024-05-30T06:57:18.068132+0000","last_active":"2024-05-30T06:57:18.068921+0000","last_peered":"2024-05-30T06:57:18.068921+0000","last_clean":"2024-05-30T06:57:18.068921+0000","last_became_active":"2024-05-30T06:57:18.067200+0000","last_became_peered":"2024-05-30T06:57:18.067200+0000","last_unstale":"2024-05-30T06:57:18.068921+0000","last_undegraded":"2024-05-30T06:57:18.068921+0000","last_fullsized":"2024-05-30T06:57:18.068921+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:38:05.820026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048002+0000","last_change":"2024-05-30T06:57:18.048002+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048002+0000","last_undegraded":"2024-05-30T06:57:18.048002+0000","last_fullsized":"2024-05-30T06:57:18.048002+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.060224+0000","last_change":"2024-05-30T06:57:18.056997+0000","last_active":"2024-05-30T06:57:18.060224+0000","last_peered":"2024-05-30T06:57:18.060224+0000","last_clean":"2024-05-30T06:57:18.060224+0000","last_became_active":"2024-05-30T06:57:18.056285+0000","last_became_peered":"2024-05-30T06:57:18.056285+0000","last_unstale":"2024-05-30T06:57:18.060224+0000","last_undegraded":"2024-05-30T06:57:18.060224+0000","last_fullsized":"2024-05-30T06:57:18.060224+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:55:21.778886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049712+0000","last_change":"2024-05-30T06:57:18.049712+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049712+0000","last_undegraded":"2024-05-30T06:57:18.049712+0000","last_fullsized":"2024-05-30T06:57:18.049712+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.066754+0000","last_change":"2024-05-30T06:57:18.063576+0000","last_active":"2024-05-30T06:57:18.066754+0000","last_peered":"2024-05-30T06:57:18.066754+0000","last_clean":"2024-05-30T06:57:18.066754+0000","last_became_active":"2024-05-30T06:57:18.063292+0000","last_became_peered":"2024-05-30T06:57:18.063292+0000","last_unstale":"2024-05-30T06:57:18.066754+0000","last_undegraded":"2024-05-30T06:57:18.066754+0000","last_fullsized":"2024-05-30T06:57:18.066754+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:39:46.184728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049737+0000","last_change":"2024-05-30T06:57:18.049737+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049737+0000","last_undegraded":"2024-05-30T06:57:18.049737+0000","last_fullsized":"2024-05-30T06:57:18.049737+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062747+0000","last_change":"2024-05-30T06:57:18.061114+0000","last_active":"2024-05-30T06:57:18.062747+0000","last_peered":"2024-05-30T06:57:18.062747+0000","last_clean":"2024-05-30T06:57:18.062747+0000","last_became_active":"2024-05-30T06:57:18.060826+0000","last_became_peered":"2024-05-30T06:57:18.060826+0000","last_unstale":"2024-05-30T06:57:18.062747+0000","last_undegraded":"2024-05-30T06:57:18.062747+0000","last_fullsized":"2024-05-30T06:57:18.062747+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:08:26.456626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050182+0000","last_change":"2024-05-30T06:57:18.050182+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050182+0000","last_undegraded":"2024-05-30T06:57:18.050182+0000","last_fullsized":"2024-05-30T06:57:18.050182+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.059213+0000","last_change":"2024-05-30T06:57:18.057392+0000","last_active":"2024-05-30T06:57:18.059213+0000","last_peered":"2024-05-30T06:57:18.059213+0000","last_clean":"2024-05-30T06:57:18.059213+0000","last_became_active":"2024-05-30T06:57:18.057040+0000","last_became_peered":"2024-05-30T06:57:18.057040+0000","last_unstale":"2024-05-30T06:57:18.059213+0000","last_undegraded":"2024-05-30T06:57:18.059213+0000","last_fullsized":"2024-05-30T06:57:18.059213+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:21:07.814279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.044366+0000","last_change":"2024-05-30T06:57:18.044366+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.044366+0000","last_undegraded":"2024-05-30T06:57:18.044366+0000","last_fullsized":"2024-05-30T06:57:18.044366+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.066901+0000","last_change":"2024-05-30T06:57:18.061898+0000","last_active":"2024-05-30T06:57:18.066901+0000","last_peered":"2024-05-30T06:57:18.066901+0000","last_clean":"2024-05-30T06:57:18.066901+0000","last_became_active":"2024-05-30T06:57:18.061632+0000","last_became_peered":"2024-05-30T06:57:18.061632+0000","last_unstale":"2024-05-30T06:57:18.066901+0000","last_undegraded":"2024-05-30T06:57:18.066901+0000","last_fullsized":"2024-05-30T06:57:18.066901+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:36.022823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056076+0000","last_change":"2024-05-30T06:57:18.056076+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056076+0000","last_undegraded":"2024-05-30T06:57:18.056076+0000","last_fullsized":"2024-05-30T06:57:18.056076+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.058485+0000","last_change":"2024-05-30T06:57:18.053358+0000","last_active":"2024-05-30T06:57:18.058485+0000","last_peered":"2024-05-30T06:57:18.058485+0000","last_clean":"2024-05-30T06:57:18.058485+0000","last_became_active":"2024-05-30T06:57:18.053073+0000","last_became_peered":"2024-05-30T06:57:18.053073+0000","last_unstale":"2024-05-30T06:57:18.058485+0000","last_undegraded":"2024-05-30T06:57:18.058485+0000","last_fullsized":"2024-05-30T06:57:18.058485+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:22.810583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.057989+0000","last_change":"2024-05-30T06:57:18.057989+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.057989+0000","last_undegraded":"2024-05-30T06:57:18.057989+0000","last_fullsized":"2024-05-30T06:57:18.057989+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065376+0000","last_change":"2024-05-30T06:57:18.062817+0000","last_active":"2024-05-30T06:57:18.065376+0000","last_peered":"2024-05-30T06:57:18.065376+0000","last_clean":"2024-05-30T06:57:18.065376+0000","last_became_active":"2024-05-30T06:57:18.062547+0000","last_became_peered":"2024-05-30T06:57:18.062547+0000","last_unstale":"2024-05-30T06:57:18.065376+0000","last_undegraded":"2024-05-30T06:57:18.065376+0000","last_fullsized":"2024-05-30T06:57:18.065376+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:23:31.504618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056626+0000","last_change":"2024-05-30T06:57:18.056626+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056626+0000","last_undegraded":"2024-05-30T06:57:18.056626+0000","last_fullsized":"2024-05-30T06:57:18.056626+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062345+0000","last_change":"2024-05-30T06:57:18.060235+0000","last_active":"2024-05-30T06:57:18.062345+0000","last_peered":"2024-05-30T06:57:18.062345+0000","last_clean":"2024-05-30T06:57:18.062345+0000","last_became_active":"2024-05-30T06:57:18.059883+0000","last_became_peered":"2024-05-30T06:57:18.059883+0000","last_unstale":"2024-05-30T06:57:18.062345+0000","last_undegraded":"2024-05-30T06:57:18.062345+0000","last_fullsized":"2024-05-30T06:57:18.062345+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:51:57.117092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.056827+0000","last_change":"2024-05-30T06:57:18.056827+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.056827+0000","last_undegraded":"2024-05-30T06:57:18.056827+0000","last_fullsized":"2024-05-30T06:57:18.056827+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.064962+0000","last_change":"2024-05-30T06:57:18.061015+0000","last_active":"2024-05-30T06:57:18.064962+0000","last_peered":"2024-05-30T06:57:18.064962+0000","last_clean":"2024-05-30T06:57:18.064962+0000","last_became_active":"2024-05-30T06:57:18.060726+0000","last_became_peered":"2024-05-30T06:57:18.060726+0000","last_unstale":"2024-05-30T06:57:18.064962+0000","last_undegraded":"2024-05-30T06:57:18.064962+0000","last_fullsized":"2024-05-30T06:57:18.064962+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:38:49.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052489+0000","last_change":"2024-05-30T06:57:18.052489+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052489+0000","last_undegraded":"2024-05-30T06:57:18.052489+0000","last_fullsized":"2024-05-30T06:57:18.052489+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.060610+0000","last_change":"2024-05-30T06:57:18.058579+0000","last_active":"2024-05-30T06:57:18.060610+0000","last_peered":"2024-05-30T06:57:18.060610+0000","last_clean":"2024-05-30T06:57:18.060610+0000","last_became_active":"2024-05-30T06:57:18.057970+0000","last_became_peered":"2024-05-30T06:57:18.057970+0000","last_unstale":"2024-05-30T06:57:18.060610+0000","last_undegraded":"2024-05-30T06:57:18.060610+0000","last_fullsized":"2024-05-30T06:57:18.060610+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:55:46.481052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.055523+0000","last_change":"2024-05-30T06:57:18.055523+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.055523+0000","last_undegraded":"2024-05-30T06:57:18.055523+0000","last_fullsized":"2024-05-30T06:57:18.055523+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.065122+0000","last_change":"2024-05-30T06:57:18.061904+0000","last_active":"2024-05-30T06:57:18.065122+0000","last_peered":"2024-05-30T06:57:18.065122+0000","last_clean":"2024-05-30T06:57:18.065122+0000","last_became_active":"2024-05-30T06:57:18.060839+0000","last_became_peered":"2024-05-30T06:57:18.060839+0000","last_unstale":"2024-05-30T06:57:18.065122+0000","last_undegraded":"2024-05-30T06:57:18.065122+0000","last_fullsized":"2024-05-30T06:57:18.065122+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:33:05.885862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.048691+0000","last_change":"2024-05-30T06:57:18.048691+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.048691+0000","last_undegraded":"2024-05-30T06:57:18.048691+0000","last_fullsized":"2024-05-30T06:57:18.048691+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067084+0000","last_change":"2024-05-30T06:57:18.064064+0000","last_active":"2024-05-30T06:57:18.067084+0000","last_peered":"2024-05-30T06:57:18.067084+0000","last_clean":"2024-05-30T06:57:18.067084+0000","last_became_active":"2024-05-30T06:57:18.060291+0000","last_became_peered":"2024-05-30T06:57:18.060291+0000","last_unstale":"2024-05-30T06:57:18.067084+0000","last_undegraded":"2024-05-30T06:57:18.067084+0000","last_fullsized":"2024-05-30T06:57:18.067084+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:01.866877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051388+0000","last_change":"2024-05-30T06:57:18.051388+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051388+0000","last_undegraded":"2024-05-30T06:57:18.051388+0000","last_fullsized":"2024-05-30T06:57:18.051388+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061310+0000","last_change":"2024-05-30T06:57:18.057816+0000","last_active":"2024-05-30T06:57:18.061310+0000","last_peered":"2024-05-30T06:57:18.061310+0000","last_clean":"2024-05-30T06:57:18.061310+0000","last_became_active":"2024-05-30T06:57:18.057548+0000","last_became_peered":"2024-05-30T06:57:18.057548+0000","last_unstale":"2024-05-30T06:57:18.061310+0000","last_undegraded":"2024-05-30T06:57:18.061310+0000","last_fullsized":"2024-05-30T06:57:18.061310+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:01.866877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.053014+0000","last_change":"2024-05-30T06:57:18.053014+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.053014+0000","last_undegraded":"2024-05-30T06:57:18.053014+0000","last_fullsized":"2024-05-30T06:57:18.053014+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062153+0000","last_change":"2024-05-30T06:57:18.057904+0000","last_active":"2024-05-30T06:57:18.062153+0000","last_peered":"2024-05-30T06:57:18.062153+0000","last_clean":"2024-05-30T06:57:18.062153+0000","last_became_active":"2024-05-30T06:57:18.057652+0000","last_became_peered":"2024-05-30T06:57:18.057652+0000","last_unstale":"2024-05-30T06:57:18.062153+0000","last_undegraded":"2024-05-30T06:57:18.062153+0000","last_fullsized":"2024-05-30T06:57:18.062153+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:46:06.371031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052327+0000","last_change":"2024-05-30T06:57:18.052327+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052327+0000","last_undegraded":"2024-05-30T06:57:18.052327+0000","last_fullsized":"2024-05-30T06:57:18.052327+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068901+0000","last_change":"2024-05-30T06:57:18.067628+0000","last_active":"2024-05-30T06:57:18.068901+0000","last_peered":"2024-05-30T06:57:18.068901+0000","last_clean":"2024-05-30T06:57:18.068901+0000","last_became_active":"2024-05-30T06:57:18.067352+0000","last_became_peered":"2024-05-30T06:57:18.067352+0000","last_unstale":"2024-05-30T06:57:18.068901+0000","last_undegraded":"2024-05-30T06:57:18.068901+0000","last_fullsized":"2024-05-30T06:57:18.068901+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:14.166437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050895+0000","last_change":"2024-05-30T06:57:18.050895+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050895+0000","last_undegraded":"2024-05-30T06:57:18.050895+0000","last_fullsized":"2024-05-30T06:57:18.050895+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.067858+0000","last_change":"2024-05-30T06:57:18.065886+0000","last_active":"2024-05-30T06:57:18.067858+0000","last_peered":"2024-05-30T06:57:18.067858+0000","last_clean":"2024-05-30T06:57:18.067858+0000","last_became_active":"2024-05-30T06:57:18.065476+0000","last_became_peered":"2024-05-30T06:57:18.065476+0000","last_unstale":"2024-05-30T06:57:18.067858+0000","last_undegraded":"2024-05-30T06:57:18.067858+0000","last_fullsized":"2024-05-30T06:57:18.067858+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:34:13.007613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.050243+0000","last_change":"2024-05-30T06:57:18.050243+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.050243+0000","last_undegraded":"2024-05-30T06:57:18.050243+0000","last_fullsized":"2024-05-30T06:57:18.050243+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061717+0000","last_change":"2024-05-30T06:57:18.056395+0000","last_active":"2024-05-30T06:57:18.061717+0000","last_peered":"2024-05-30T06:57:18.061717+0000","last_clean":"2024-05-30T06:57:18.061717+0000","last_became_active":"2024-05-30T06:57:18.056128+0000","last_became_peered":"2024-05-30T06:57:18.056128+0000","last_unstale":"2024-05-30T06:57:18.061717+0000","last_undegraded":"2024-05-30T06:57:18.061717+0000","last_fullsized":"2024-05-30T06:57:18.061717+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:24:45.283856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.052816+0000","last_change":"2024-05-30T06:57:18.052816+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.052816+0000","last_undegraded":"2024-05-30T06:57:18.052816+0000","last_fullsized":"2024-05-30T06:57:18.052816+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062459+0000","last_change":"2024-05-30T06:57:18.061248+0000","last_active":"2024-05-30T06:57:18.062459+0000","last_peered":"2024-05-30T06:57:18.062459+0000","last_clean":"2024-05-30T06:57:18.062459+0000","last_became_active":"2024-05-30T06:57:18.060853+0000","last_became_peered":"2024-05-30T06:57:18.060853+0000","last_unstale":"2024-05-30T06:57:18.062459+0000","last_undegraded":"2024-05-30T06:57:18.062459+0000","last_fullsized":"2024-05-30T06:57:18.062459+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:23:31.504618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.054978+0000","last_change":"2024-05-30T06:57:18.054978+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.054978+0000","last_undegraded":"2024-05-30T06:57:18.054978+0000","last_fullsized":"2024-05-30T06:57:18.054978+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.063829+0000","last_change":"2024-05-30T06:57:18.061791+0000","last_active":"2024-05-30T06:57:18.063829+0000","last_peered":"2024-05-30T06:57:18.063829+0000","last_clean":"2024-05-30T06:57:18.063829+0000","last_became_active":"2024-05-30T06:57:18.060245+0000","last_became_peered":"2024-05-30T06:57:18.060245+0000","last_unstale":"2024-05-30T06:57:18.063829+0000","last_undegraded":"2024-05-30T06:57:18.063829+0000","last_fullsized":"2024-05-30T06:57:18.063829+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:05:40.598386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.051448+0000","last_change":"2024-05-30T06:57:18.051448+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.051448+0000","last_undegraded":"2024-05-30T06:57:18.051448+0000","last_fullsized":"2024-05-30T06:57:18.051448+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.068887+0000","last_change":"2024-05-30T06:57:18.067970+0000","last_active":"2024-05-30T06:57:18.068887+0000","last_peered":"2024-05-30T06:57:18.068887+0000","last_clean":"2024-05-30T06:57:18.068887+0000","last_became_active":"2024-05-30T06:57:18.067035+0000","last_became_peered":"2024-05-30T06:57:18.067035+0000","last_unstale":"2024-05-30T06:57:18.068887+0000","last_undegraded":"2024-05-30T06:57:18.068887+0000","last_fullsized":"2024-05-30T06:57:18.068887+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:34:13.007613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-05-30T06:57:18.049877+0000","last_change":"2024-05-30T06:57:18.049877+0000","last_active":"2024-05-30T06:57:18.036610+0000","last_peered":"2024-05-30T06:57:18.036610+0000","last_clean":"2024-05-30T06:57:18.036610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-30T06:57:18.049877+0000","last_undegraded":"2024-05-30T06:57:18.049877+0000","last_fullsized":"2024-05-30T06:57:18.049877+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.061295+0000","last_change":"2024-05-30T06:57:18.059661+0000","last_active":"2024-05-30T06:57:18.061295+0000","last_peered":"2024-05-30T06:57:18.061295+0000","last_clean":"2024-05-30T06:57:18.061295+0000","last_became_active":"2024-05-30T06:57:18.059346+0000","last_became_peered":"2024-05-30T06:57:18.059346+0000","last_unstale":"2024-05-30T06:57:18.061295+0000","last_undegraded":"2024-05-30T06:57:18.061295+0000","last_fullsized":"2024-05-30T06:57:18.061295+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:32:03.097835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":346,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-05-30T06:57:18.062685+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:57:18.062685+0000","last_peered":"2024-05-30T06:57:18.062685+0000","last_clean":"2024-05-30T06:57:18.062685+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:57:18.062685+0000","last_undegraded":"2024-05-30T06:57:18.062685+0000","last_fullsized":"2024-05-30T06:57:18.062685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123284,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248556,"statfs":{"total":96636764160,"available":96510521344,"internally_reserved":0,"allocated":1974272,"data_stored":1190970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126876,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244964,"statfs":{"total":96636764160,"available":96506843136,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76880,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294960,"statfs":{"total":96636764160,"available":96558039040,"internally_reserved":0,"allocated":1380352,"data_stored":600602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575035,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86620,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94285220,"statfs":{"total":96636764160,"available":96548065280,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144912,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226928,"statfs":{"total":96636764160,"available":96488374272,"internally_reserved":0,"allocated":1380352,"data_stored":600602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":146995655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575034,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144928,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226912,"statfs":{"total":96636764160,"available":96488357888,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104672,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94267168,"statfs":{"total":96636764160,"available":96529580032,"internally_reserved":0,"allocated":1392640,"data_stored":606933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64992,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306848,"statfs":{"total":96636764160,"available":96570212352,"internally_reserved":0,"allocated":1974272,"data_stored":1190970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:57:27.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:57:27.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f19a6200640 1 Processor -- start 2024-05-30T06:57:27.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f19a6200640 1 -- start start 2024-05-30T06:57:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f19a6200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19a015cd80 0x7f19a006f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f19a6200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f19a00ce8d0 0x7f19a00ced20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:27.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f19a6200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19a00cd120 con 0x7f19a006e000 2024-05-30T06:57:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f19a6200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f19a00a9530 con 0x7f19a015cd80 2024-05-30T06:57:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f19a6200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f19a00cd400 con 0x7f19a00ce8d0 2024-05-30T06:57:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f1996a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19a015cd80 0x7f19a006f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f1996a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19a015cd80 0x7f19a006f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53810/0 (socket says 172.21.15.37:53810) 2024-05-30T06:57:27.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f1996a00640 1 -- 172.21.15.37:0/2781599510 learned_addr learned my addr 172.21.15.37:0/2781599510 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f199fe00640 1 --2- 172.21.15.37:0/2781599510 >> v2:172.21.15.105:3300/0 conn(0x7f19a00ce8d0 0x7f19a00ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f1996a00640 1 -- 172.21.15.37:0/2781599510 >> v2:172.21.15.105:3300/0 conn(0x7f19a00ce8d0 msgr2=0x7f19a00ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f1996a00640 1 --2- 172.21.15.37:0/2781599510 >> v2:172.21.15.105:3300/0 conn(0x7f19a00ce8d0 0x7f19a00ced20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f1996a00640 1 -- 172.21.15.37:0/2781599510 >> v1:172.21.15.105:6789/0 conn(0x7f19a006e000 legacy=0x7f19a00ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:27.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.935+0000 7f1996a00640 1 -- 172.21.15.37:0/2781599510 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a00cd6e0 con 0x7f19a015cd80 2024-05-30T06:57:27.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.939+0000 7f1996a00640 1 --2- 172.21.15.37:0/2781599510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a015cd80 0x7f19a006f3f0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f19a006c7b0 tx=0x7f198801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd770514ac08a45 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:27.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.939+0000 7f199ea00640 1 -- 172.21.15.37:0/2781599510 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19880b5070 con 0x7f19a015cd80 2024-05-30T06:57:27.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.939+0000 7f199ea00640 1 -- 172.21.15.37:0/2781599510 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19880a89d0 con 0x7f19a015cd80 2024-05-30T06:57:27.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.939+0000 7f199ea00640 1 -- 172.21.15.37:0/2781599510 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19880a8da0 con 0x7f19a015cd80 2024-05-30T06:57:27.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.939+0000 7f19a6200640 1 -- 172.21.15.37:0/2781599510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a015cd80 msgr2=0x7f19a006f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:27.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.939+0000 7f19a6200640 1 --2- 172.21.15.37:0/2781599510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a015cd80 0x7f19a006f3f0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f19a006c7b0 tx=0x7f198801ecd0 comp rx=0 tx=0).stop 2024-05-30T06:57:27.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.939+0000 7f19a6200640 1 -- 172.21.15.37:0/2781599510 shutdown_connections 2024-05-30T06:57:27.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.939+0000 7f19a6200640 1 --2- 172.21.15.37:0/2781599510 >> v2:172.21.15.105:3300/0 conn(0x7f19a00ce8d0 0x7f19a00ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:27.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.939+0000 7f19a6200640 1 --2- 172.21.15.37:0/2781599510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a015cd80 0x7f19a006f3f0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:27.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.939+0000 7f19a6200640 1 -- 172.21.15.37:0/2781599510 >> 172.21.15.37:0/2781599510 conn(0x7f19a00b23a0 msgr2=0x7f19a00b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:27.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.939+0000 7f19a6200640 1 -- 172.21.15.37:0/2781599510 shutdown_connections 2024-05-30T06:57:27.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.939+0000 7f19a6200640 1 -- 172.21.15.37:0/2781599510 wait complete. 2024-05-30T06:57:27.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f19a6200640 1 Processor -- start 2024-05-30T06:57:27.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f19a6200640 1 -- start start 2024-05-30T06:57:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f19a6200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19a006e000 0x7f19a013f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f19a6200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00ce8d0 0x7f19a00aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f19a6200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19a015cd80 0x7f19a00af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f19a6200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f19a006f930 con 0x7f19a00ce8d0 2024-05-30T06:57:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f19a6200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f19a00cdca0 con 0x7f19a015cd80 2024-05-30T06:57:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f19a6200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f19a006fab0 con 0x7f19a006e000 2024-05-30T06:57:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f1996a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00ce8d0 0x7f19a00aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:27.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f1996a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00ce8d0 0x7f19a00aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53820/0 (socket says 172.21.15.37:53820) 2024-05-30T06:57:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f1996a00640 1 -- 172.21.15.37:0/3515466643 learned_addr learned my addr 172.21.15.37:0/3515466643 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f199f400640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19a006e000 0x7f19a013f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f199fe00640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19a015cd80 0x7f19a00af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f1996a00640 1 -- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19a006e000 msgr2=0x7f19a013f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f1996a00640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19a006e000 0x7f19a013f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f1996a00640 1 -- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19a015cd80 msgr2=0x7f19a00af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f1996a00640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19a015cd80 0x7f19a00af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f1996a00640 1 -- 172.21.15.37:0/3515466643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a013e000 con 0x7f19a00ce8d0 2024-05-30T06:57:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f199f400640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19a006e000 0x7f19a013f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f199fe00640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19a015cd80 0x7f19a00af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f1996a00640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00ce8d0 0x7f19a00aeb20 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f19880b3040 tx=0x7f198801ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f1997e00640 1 -- 172.21.15.37:0/3515466643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19880c0070 con 0x7f19a00ce8d0 2024-05-30T06:57:27.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f1997e00640 1 -- 172.21.15.37:0/3515466643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19880b0a50 con 0x7f19a00ce8d0 2024-05-30T06:57:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f1997e00640 1 -- 172.21.15.37:0/3515466643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19880b5070 con 0x7f19a00ce8d0 2024-05-30T06:57:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f19a6200640 1 -- 172.21.15.37:0/3515466643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a013e2e0 con 0x7f19a00ce8d0 2024-05-30T06:57:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.943+0000 7f19a6200640 1 -- 172.21.15.37:0/3515466643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a013e8a0 con 0x7f19a00ce8d0 2024-05-30T06:57:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.947+0000 7f19a6200640 1 -- 172.21.15.37:0/3515466643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a013f5e0 con 0x7f19a00ce8d0 2024-05-30T06:57:27.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.947+0000 7f1997e00640 1 -- 172.21.15.37:0/3515466643 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f19880ba3e0 con 0x7f19a00ce8d0 2024-05-30T06:57:27.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.947+0000 7f1997e00640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f197c069bb0 0x7f197c06c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:27.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.947+0000 7f1997e00640 1 -- 172.21.15.37:0/3515466643 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f1988122a50 con 0x7f19a00ce8d0 2024-05-30T06:57:27.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.947+0000 7f199f400640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f197c069bb0 0x7f197c06c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:27.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.947+0000 7f199f400640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f197c069bb0 0x7f197c06c070 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f19900098b0 tx=0x7f1990008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:27.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:27.951+0000 7f1997e00640 1 -- 172.21.15.37:0/3515466643 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f198812d080 con 0x7f19a00ce8d0 2024-05-30T06:57:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.115+0000 7f19a6200640 1 -- 172.21.15.37:0/3515466643 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19a0068b20 con 0x7f197c069bb0 2024-05-30T06:57:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.119+0000 7f1997e00640 1 -- 172.21.15.37:0/3515466643 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252498 (secure 0 0 0) 0x7f19a0068b20 con 0x7f197c069bb0 2024-05-30T06:57:28.123 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:57:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.123+0000 7f19a6200640 1 -- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f197c069bb0 msgr2=0x7f197c06c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.123+0000 7f19a6200640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f197c069bb0 0x7f197c06c070 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f19900098b0 tx=0x7f1990008040 comp rx=0 tx=0).stop 2024-05-30T06:57:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.123+0000 7f19a6200640 1 -- 172.21.15.37:0/3515466643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00ce8d0 msgr2=0x7f19a00aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.123+0000 7f19a6200640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00ce8d0 0x7f19a00aeb20 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f19880b3040 tx=0x7f198801ba70 comp rx=0 tx=0).stop 2024-05-30T06:57:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.123+0000 7f19a6200640 1 -- 172.21.15.37:0/3515466643 shutdown_connections 2024-05-30T06:57:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.123+0000 7f19a6200640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f197c069bb0 0x7f197c06c070 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.123+0000 7f19a6200640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19a015cd80 0x7f19a00af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.123+0000 7f19a6200640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a00ce8d0 0x7f19a00aeb20 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.123+0000 7f19a6200640 1 --2- 172.21.15.37:0/3515466643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19a006e000 0x7f19a013f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.123+0000 7f19a6200640 1 -- 172.21.15.37:0/3515466643 >> 172.21.15.37:0/3515466643 conn(0x7f19a00b23a0 msgr2=0x7f19a0074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.123+0000 7f19a6200640 1 -- 172.21.15.37:0/3515466643 shutdown_connections 2024-05-30T06:57:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.123+0000 7f19a6200640 1 -- 172.21.15.37:0/3515466643 wait complete. 2024-05-30T06:57:28.143 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":571,"stamp":"2024-05-30T06:57:26.972575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":877624,"kb_used_data":12296,"kb_used_omap":12,"kb_used_meta":865203,"kb_avail":754097096,"statfs":{"total":773094113280,"available":772195426304,"internally_reserved":0,"allocated":12591104,"data_stored":6146516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":885968432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002259"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784436+0000","last_change":"2024-05-30T06:57:19.070972+0000","last_active":"2024-05-30T06:57:20.784436+0000","last_peered":"2024-05-30T06:57:20.784436+0000","last_clean":"2024-05-30T06:57:20.784436+0000","last_became_active":"2024-05-30T06:57:19.069730+0000","last_became_peered":"2024-05-30T06:57:19.069730+0000","last_unstale":"2024-05-30T06:57:20.784436+0000","last_undegraded":"2024-05-30T06:57:20.784436+0000","last_fullsized":"2024-05-30T06:57:20.784436+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:04:24.989461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074774+0000","last_change":"2024-05-30T06:57:19.074491+0000","last_active":"2024-05-30T06:57:20.074774+0000","last_peered":"2024-05-30T06:57:20.074774+0000","last_clean":"2024-05-30T06:57:20.074774+0000","last_became_active":"2024-05-30T06:57:19.074171+0000","last_became_peered":"2024-05-30T06:57:19.074171+0000","last_unstale":"2024-05-30T06:57:20.074774+0000","last_undegraded":"2024-05-30T06:57:20.074774+0000","last_fullsized":"2024-05-30T06:57:20.074774+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:19:10.096913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.785741+0000","last_change":"2024-05-30T06:57:19.085806+0000","last_active":"2024-05-30T06:57:20.785741+0000","last_peered":"2024-05-30T06:57:20.785741+0000","last_clean":"2024-05-30T06:57:20.785741+0000","last_became_active":"2024-05-30T06:57:19.085472+0000","last_became_peered":"2024-05-30T06:57:19.085472+0000","last_unstale":"2024-05-30T06:57:20.785741+0000","last_undegraded":"2024-05-30T06:57:20.785741+0000","last_fullsized":"2024-05-30T06:57:20.785741+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:17:23.179460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783181+0000","last_change":"2024-05-30T06:57:19.069182+0000","last_active":"2024-05-30T06:57:20.783181+0000","last_peered":"2024-05-30T06:57:20.783181+0000","last_clean":"2024-05-30T06:57:20.783181+0000","last_became_active":"2024-05-30T06:57:19.068908+0000","last_became_peered":"2024-05-30T06:57:19.068908+0000","last_unstale":"2024-05-30T06:57:20.783181+0000","last_undegraded":"2024-05-30T06:57:20.783181+0000","last_fullsized":"2024-05-30T06:57:20.783181+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:00:32.598745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783045+0000","last_change":"2024-05-30T06:57:19.075714+0000","last_active":"2024-05-30T06:57:20.783045+0000","last_peered":"2024-05-30T06:57:20.783045+0000","last_clean":"2024-05-30T06:57:20.783045+0000","last_became_active":"2024-05-30T06:57:19.075414+0000","last_became_peered":"2024-05-30T06:57:19.075414+0000","last_unstale":"2024-05-30T06:57:20.783045+0000","last_undegraded":"2024-05-30T06:57:20.783045+0000","last_fullsized":"2024-05-30T06:57:20.783045+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:23:30.449060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783902+0000","last_change":"2024-05-30T06:57:19.079554+0000","last_active":"2024-05-30T06:57:20.783902+0000","last_peered":"2024-05-30T06:57:20.783902+0000","last_clean":"2024-05-30T06:57:20.783902+0000","last_became_active":"2024-05-30T06:57:19.079241+0000","last_became_peered":"2024-05-30T06:57:19.079241+0000","last_unstale":"2024-05-30T06:57:20.783902+0000","last_undegraded":"2024-05-30T06:57:20.783902+0000","last_fullsized":"2024-05-30T06:57:20.783902+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:13:17.621146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074239+0000","last_change":"2024-05-30T06:57:19.072912+0000","last_active":"2024-05-30T06:57:20.074239+0000","last_peered":"2024-05-30T06:57:20.074239+0000","last_clean":"2024-05-30T06:57:20.074239+0000","last_became_active":"2024-05-30T06:57:19.072295+0000","last_became_peered":"2024-05-30T06:57:19.072295+0000","last_unstale":"2024-05-30T06:57:20.074239+0000","last_undegraded":"2024-05-30T06:57:20.074239+0000","last_fullsized":"2024-05-30T06:57:20.074239+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:44:57.633073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.785576+0000","last_change":"2024-05-30T06:57:19.080924+0000","last_active":"2024-05-30T06:57:20.785576+0000","last_peered":"2024-05-30T06:57:20.785576+0000","last_clean":"2024-05-30T06:57:20.785576+0000","last_became_active":"2024-05-30T06:57:19.080518+0000","last_became_peered":"2024-05-30T06:57:19.080518+0000","last_unstale":"2024-05-30T06:57:20.785576+0000","last_undegraded":"2024-05-30T06:57:20.785576+0000","last_fullsized":"2024-05-30T06:57:20.785576+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:27:48.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784488+0000","last_change":"2024-05-30T06:57:19.065636+0000","last_active":"2024-05-30T06:57:20.784488+0000","last_peered":"2024-05-30T06:57:20.784488+0000","last_clean":"2024-05-30T06:57:20.784488+0000","last_became_active":"2024-05-30T06:57:19.064761+0000","last_became_peered":"2024-05-30T06:57:19.064761+0000","last_unstale":"2024-05-30T06:57:20.784488+0000","last_undegraded":"2024-05-30T06:57:20.784488+0000","last_fullsized":"2024-05-30T06:57:20.784488+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:09:10.608505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784311+0000","last_change":"2024-05-30T06:57:19.083991+0000","last_active":"2024-05-30T06:57:20.784311+0000","last_peered":"2024-05-30T06:57:20.784311+0000","last_clean":"2024-05-30T06:57:20.784311+0000","last_became_active":"2024-05-30T06:57:19.083502+0000","last_became_peered":"2024-05-30T06:57:19.083502+0000","last_unstale":"2024-05-30T06:57:20.784311+0000","last_undegraded":"2024-05-30T06:57:20.784311+0000","last_fullsized":"2024-05-30T06:57:20.784311+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:53.895321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074503+0000","last_change":"2024-05-30T06:57:19.069379+0000","last_active":"2024-05-30T06:57:20.074503+0000","last_peered":"2024-05-30T06:57:20.074503+0000","last_clean":"2024-05-30T06:57:20.074503+0000","last_became_active":"2024-05-30T06:57:19.069096+0000","last_became_peered":"2024-05-30T06:57:19.069096+0000","last_unstale":"2024-05-30T06:57:20.074503+0000","last_undegraded":"2024-05-30T06:57:20.074503+0000","last_fullsized":"2024-05-30T06:57:20.074503+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:29:59.952441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783292+0000","last_change":"2024-05-30T06:57:19.075955+0000","last_active":"2024-05-30T06:57:20.783292+0000","last_peered":"2024-05-30T06:57:20.783292+0000","last_clean":"2024-05-30T06:57:20.783292+0000","last_became_active":"2024-05-30T06:57:19.075629+0000","last_became_peered":"2024-05-30T06:57:19.075629+0000","last_unstale":"2024-05-30T06:57:20.783292+0000","last_undegraded":"2024-05-30T06:57:20.783292+0000","last_fullsized":"2024-05-30T06:57:20.783292+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:40:05.104396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.785863+0000","last_change":"2024-05-30T06:57:19.087178+0000","last_active":"2024-05-30T06:57:20.785863+0000","last_peered":"2024-05-30T06:57:20.785863+0000","last_clean":"2024-05-30T06:57:20.785863+0000","last_became_active":"2024-05-30T06:57:19.086920+0000","last_became_peered":"2024-05-30T06:57:19.086920+0000","last_unstale":"2024-05-30T06:57:20.785863+0000","last_undegraded":"2024-05-30T06:57:20.785863+0000","last_fullsized":"2024-05-30T06:57:20.785863+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:00:32.598745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.785683+0000","last_change":"2024-05-30T06:57:19.080049+0000","last_active":"2024-05-30T06:57:20.785683+0000","last_peered":"2024-05-30T06:57:20.785683+0000","last_clean":"2024-05-30T06:57:20.785683+0000","last_became_active":"2024-05-30T06:57:19.079784+0000","last_became_peered":"2024-05-30T06:57:19.079784+0000","last_unstale":"2024-05-30T06:57:20.785683+0000","last_undegraded":"2024-05-30T06:57:20.785683+0000","last_fullsized":"2024-05-30T06:57:20.785683+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:18:31.973210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783802+0000","last_change":"2024-05-30T06:57:19.075257+0000","last_active":"2024-05-30T06:57:20.783802+0000","last_peered":"2024-05-30T06:57:20.783802+0000","last_clean":"2024-05-30T06:57:20.783802+0000","last_became_active":"2024-05-30T06:57:19.074379+0000","last_became_peered":"2024-05-30T06:57:19.074379+0000","last_unstale":"2024-05-30T06:57:20.783802+0000","last_undegraded":"2024-05-30T06:57:20.783802+0000","last_fullsized":"2024-05-30T06:57:20.783802+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:36:59.728836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783023+0000","last_change":"2024-05-30T06:57:19.074046+0000","last_active":"2024-05-30T06:57:20.783023+0000","last_peered":"2024-05-30T06:57:20.783023+0000","last_clean":"2024-05-30T06:57:20.783023+0000","last_became_active":"2024-05-30T06:57:19.073696+0000","last_became_peered":"2024-05-30T06:57:19.073696+0000","last_unstale":"2024-05-30T06:57:20.783023+0000","last_undegraded":"2024-05-30T06:57:20.783023+0000","last_fullsized":"2024-05-30T06:57:20.783023+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:10:56.860642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074936+0000","last_change":"2024-05-30T06:57:19.072004+0000","last_active":"2024-05-30T06:57:20.074936+0000","last_peered":"2024-05-30T06:57:20.074936+0000","last_clean":"2024-05-30T06:57:20.074936+0000","last_became_active":"2024-05-30T06:57:19.071633+0000","last_became_peered":"2024-05-30T06:57:19.071633+0000","last_unstale":"2024-05-30T06:57:20.074936+0000","last_undegraded":"2024-05-30T06:57:20.074936+0000","last_fullsized":"2024-05-30T06:57:20.074936+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:15:40.790334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.084775+0000","last_change":"2024-05-30T06:57:19.071641+0000","last_active":"2024-05-30T06:57:20.084775+0000","last_peered":"2024-05-30T06:57:20.084775+0000","last_clean":"2024-05-30T06:57:20.084775+0000","last_became_active":"2024-05-30T06:57:19.071375+0000","last_became_peered":"2024-05-30T06:57:19.071375+0000","last_unstale":"2024-05-30T06:57:20.084775+0000","last_undegraded":"2024-05-30T06:57:20.084775+0000","last_fullsized":"2024-05-30T06:57:20.084775+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:44:37.030352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.786017+0000","last_change":"2024-05-30T06:57:19.084821+0000","last_active":"2024-05-30T06:57:20.786017+0000","last_peered":"2024-05-30T06:57:20.786017+0000","last_clean":"2024-05-30T06:57:20.786017+0000","last_became_active":"2024-05-30T06:57:19.084535+0000","last_became_peered":"2024-05-30T06:57:19.084535+0000","last_unstale":"2024-05-30T06:57:20.786017+0000","last_undegraded":"2024-05-30T06:57:20.786017+0000","last_fullsized":"2024-05-30T06:57:20.786017+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:13:13.605002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074622+0000","last_change":"2024-05-30T06:57:19.080105+0000","last_active":"2024-05-30T06:57:20.074622+0000","last_peered":"2024-05-30T06:57:20.074622+0000","last_clean":"2024-05-30T06:57:20.074622+0000","last_became_active":"2024-05-30T06:57:19.079842+0000","last_became_peered":"2024-05-30T06:57:19.079842+0000","last_unstale":"2024-05-30T06:57:20.074622+0000","last_undegraded":"2024-05-30T06:57:20.074622+0000","last_fullsized":"2024-05-30T06:57:20.074622+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:09.584069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074578+0000","last_change":"2024-05-30T06:57:19.078990+0000","last_active":"2024-05-30T06:57:20.074578+0000","last_peered":"2024-05-30T06:57:20.074578+0000","last_clean":"2024-05-30T06:57:20.074578+0000","last_became_active":"2024-05-30T06:57:19.078371+0000","last_became_peered":"2024-05-30T06:57:19.078371+0000","last_unstale":"2024-05-30T06:57:20.074578+0000","last_undegraded":"2024-05-30T06:57:20.074578+0000","last_fullsized":"2024-05-30T06:57:20.074578+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:34.879323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.070312+0000","last_change":"2024-05-30T06:57:19.074128+0000","last_active":"2024-05-30T06:57:20.070312+0000","last_peered":"2024-05-30T06:57:20.070312+0000","last_clean":"2024-05-30T06:57:20.070312+0000","last_became_active":"2024-05-30T06:57:19.072919+0000","last_became_peered":"2024-05-30T06:57:19.072919+0000","last_unstale":"2024-05-30T06:57:20.070312+0000","last_undegraded":"2024-05-30T06:57:20.070312+0000","last_fullsized":"2024-05-30T06:57:20.070312+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:27:48.677902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074006+0000","last_change":"2024-05-30T06:57:19.076690+0000","last_active":"2024-05-30T06:57:20.074006+0000","last_peered":"2024-05-30T06:57:20.074006+0000","last_clean":"2024-05-30T06:57:20.074006+0000","last_became_active":"2024-05-30T06:57:19.076369+0000","last_became_peered":"2024-05-30T06:57:19.076369+0000","last_unstale":"2024-05-30T06:57:20.074006+0000","last_undegraded":"2024-05-30T06:57:20.074006+0000","last_fullsized":"2024-05-30T06:57:20.074006+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:21:13.289970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.069999+0000","last_change":"2024-05-30T06:57:19.080511+0000","last_active":"2024-05-30T06:57:20.069999+0000","last_peered":"2024-05-30T06:57:20.069999+0000","last_clean":"2024-05-30T06:57:20.069999+0000","last_became_active":"2024-05-30T06:57:19.077943+0000","last_became_peered":"2024-05-30T06:57:19.077943+0000","last_unstale":"2024-05-30T06:57:20.069999+0000","last_undegraded":"2024-05-30T06:57:20.069999+0000","last_fullsized":"2024-05-30T06:57:20.069999+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:35:15.951145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.075035+0000","last_change":"2024-05-30T06:57:19.071913+0000","last_active":"2024-05-30T06:57:20.075035+0000","last_peered":"2024-05-30T06:57:20.075035+0000","last_clean":"2024-05-30T06:57:20.075035+0000","last_became_active":"2024-05-30T06:57:19.071239+0000","last_became_peered":"2024-05-30T06:57:19.071239+0000","last_unstale":"2024-05-30T06:57:20.075035+0000","last_undegraded":"2024-05-30T06:57:20.075035+0000","last_fullsized":"2024-05-30T06:57:20.075035+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T06:58:22.944667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784486+0000","last_change":"2024-05-30T06:57:19.069595+0000","last_active":"2024-05-30T06:57:20.784486+0000","last_peered":"2024-05-30T06:57:20.784486+0000","last_clean":"2024-05-30T06:57:20.784486+0000","last_became_active":"2024-05-30T06:57:19.068355+0000","last_became_peered":"2024-05-30T06:57:19.068355+0000","last_unstale":"2024-05-30T06:57:20.784486+0000","last_undegraded":"2024-05-30T06:57:20.784486+0000","last_fullsized":"2024-05-30T06:57:20.784486+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:41:04.722367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784431+0000","last_change":"2024-05-30T06:57:19.080928+0000","last_active":"2024-05-30T06:57:20.784431+0000","last_peered":"2024-05-30T06:57:20.784431+0000","last_clean":"2024-05-30T06:57:20.784431+0000","last_became_active":"2024-05-30T06:57:19.080666+0000","last_became_peered":"2024-05-30T06:57:19.080666+0000","last_unstale":"2024-05-30T06:57:20.784431+0000","last_undegraded":"2024-05-30T06:57:20.784431+0000","last_fullsized":"2024-05-30T06:57:20.784431+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:28:45.940412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.070702+0000","last_change":"2024-05-30T06:57:19.061211+0000","last_active":"2024-05-30T06:57:20.070702+0000","last_peered":"2024-05-30T06:57:20.070702+0000","last_clean":"2024-05-30T06:57:20.070702+0000","last_became_active":"2024-05-30T06:57:19.060896+0000","last_became_peered":"2024-05-30T06:57:19.060896+0000","last_unstale":"2024-05-30T06:57:20.070702+0000","last_undegraded":"2024-05-30T06:57:20.070702+0000","last_fullsized":"2024-05-30T06:57:20.070702+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:53:22.866055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.073993+0000","last_change":"2024-05-30T06:57:19.079212+0000","last_active":"2024-05-30T06:57:20.073993+0000","last_peered":"2024-05-30T06:57:20.073993+0000","last_clean":"2024-05-30T06:57:20.073993+0000","last_became_active":"2024-05-30T06:57:19.078741+0000","last_became_peered":"2024-05-30T06:57:19.078741+0000","last_unstale":"2024-05-30T06:57:20.073993+0000","last_undegraded":"2024-05-30T06:57:20.073993+0000","last_fullsized":"2024-05-30T06:57:20.073993+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:38:06.827555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.075567+0000","last_change":"2024-05-30T06:57:19.065764+0000","last_active":"2024-05-30T06:57:20.075567+0000","last_peered":"2024-05-30T06:57:20.075567+0000","last_clean":"2024-05-30T06:57:20.075567+0000","last_became_active":"2024-05-30T06:57:19.065526+0000","last_became_peered":"2024-05-30T06:57:19.065526+0000","last_unstale":"2024-05-30T06:57:20.075567+0000","last_undegraded":"2024-05-30T06:57:20.075567+0000","last_fullsized":"2024-05-30T06:57:20.075567+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:46:07.378560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783443+0000","last_change":"2024-05-30T06:57:19.069311+0000","last_active":"2024-05-30T06:57:20.783443+0000","last_peered":"2024-05-30T06:57:20.783443+0000","last_clean":"2024-05-30T06:57:20.783443+0000","last_became_active":"2024-05-30T06:57:19.068702+0000","last_became_peered":"2024-05-30T06:57:19.068702+0000","last_unstale":"2024-05-30T06:57:20.783443+0000","last_undegraded":"2024-05-30T06:57:20.783443+0000","last_fullsized":"2024-05-30T06:57:20.783443+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:40:29.736101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.782917+0000","last_change":"2024-05-30T06:57:19.068413+0000","last_active":"2024-05-30T06:57:20.782917+0000","last_peered":"2024-05-30T06:57:20.782917+0000","last_clean":"2024-05-30T06:57:20.782917+0000","last_became_active":"2024-05-30T06:57:19.068114+0000","last_became_peered":"2024-05-30T06:57:19.068114+0000","last_unstale":"2024-05-30T06:57:20.782917+0000","last_undegraded":"2024-05-30T06:57:20.782917+0000","last_fullsized":"2024-05-30T06:57:20.782917+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:50:42.582208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784748+0000","last_change":"2024-05-30T06:57:19.078270+0000","last_active":"2024-05-30T06:57:20.784748+0000","last_peered":"2024-05-30T06:57:20.784748+0000","last_clean":"2024-05-30T06:57:20.784748+0000","last_became_active":"2024-05-30T06:57:19.077976+0000","last_became_peered":"2024-05-30T06:57:19.077976+0000","last_unstale":"2024-05-30T06:57:20.784748+0000","last_undegraded":"2024-05-30T06:57:20.784748+0000","last_fullsized":"2024-05-30T06:57:20.784748+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:24:46.291385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"113'4","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.075050+0000","last_change":"2024-05-30T06:57:18.064919+0000","last_active":"2024-05-30T06:57:20.075050+0000","last_peered":"2024-05-30T06:57:20.075050+0000","last_clean":"2024-05-30T06:57:20.075050+0000","last_became_active":"2024-05-30T06:57:18.064658+0000","last_became_peered":"2024-05-30T06:57:18.064658+0000","last_unstale":"2024-05-30T06:57:20.075050+0000","last_undegraded":"2024-05-30T06:57:20.075050+0000","last_fullsized":"2024-05-30T06:57:20.075050+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:04:44.951340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.085001+0000","last_change":"2024-05-30T06:57:19.081775+0000","last_active":"2024-05-30T06:57:20.085001+0000","last_peered":"2024-05-30T06:57:20.085001+0000","last_clean":"2024-05-30T06:57:20.085001+0000","last_became_active":"2024-05-30T06:57:19.081293+0000","last_became_peered":"2024-05-30T06:57:19.081293+0000","last_unstale":"2024-05-30T06:57:20.085001+0000","last_undegraded":"2024-05-30T06:57:20.085001+0000","last_fullsized":"2024-05-30T06:57:20.085001+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:50:02.874406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.785942+0000","last_change":"2024-05-30T06:57:18.068587+0000","last_active":"2024-05-30T06:57:20.785942+0000","last_peered":"2024-05-30T06:57:20.785942+0000","last_clean":"2024-05-30T06:57:20.785942+0000","last_became_active":"2024-05-30T06:57:18.068278+0000","last_became_peered":"2024-05-30T06:57:18.068278+0000","last_unstale":"2024-05-30T06:57:20.785942+0000","last_undegraded":"2024-05-30T06:57:20.785942+0000","last_fullsized":"2024-05-30T06:57:20.785942+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:29:58.944912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784195+0000","last_change":"2024-05-30T06:57:19.086265+0000","last_active":"2024-05-30T06:57:20.784195+0000","last_peered":"2024-05-30T06:57:20.784195+0000","last_clean":"2024-05-30T06:57:20.784195+0000","last_became_active":"2024-05-30T06:57:19.085904+0000","last_became_peered":"2024-05-30T06:57:19.085904+0000","last_unstale":"2024-05-30T06:57:20.784195+0000","last_undegraded":"2024-05-30T06:57:20.784195+0000","last_fullsized":"2024-05-30T06:57:20.784195+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:51:34.587423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783566+0000","last_change":"2024-05-30T06:57:18.068473+0000","last_active":"2024-05-30T06:57:20.783566+0000","last_peered":"2024-05-30T06:57:20.783566+0000","last_clean":"2024-05-30T06:57:20.783566+0000","last_became_active":"2024-05-30T06:57:18.067152+0000","last_became_peered":"2024-05-30T06:57:18.067152+0000","last_unstale":"2024-05-30T06:57:20.783566+0000","last_undegraded":"2024-05-30T06:57:20.783566+0000","last_fullsized":"2024-05-30T06:57:20.783566+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:36:58.721307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.786027+0000","last_change":"2024-05-30T06:57:19.087687+0000","last_active":"2024-05-30T06:57:20.786027+0000","last_peered":"2024-05-30T06:57:20.786027+0000","last_clean":"2024-05-30T06:57:20.786027+0000","last_became_active":"2024-05-30T06:57:19.087380+0000","last_became_peered":"2024-05-30T06:57:19.087380+0000","last_unstale":"2024-05-30T06:57:20.786027+0000","last_undegraded":"2024-05-30T06:57:20.786027+0000","last_fullsized":"2024-05-30T06:57:20.786027+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:10:56.860642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783298+0000","last_change":"2024-05-30T06:57:18.062798+0000","last_active":"2024-05-30T06:57:20.783298+0000","last_peered":"2024-05-30T06:57:20.783298+0000","last_clean":"2024-05-30T06:57:20.783298+0000","last_became_active":"2024-05-30T06:57:18.062422+0000","last_became_peered":"2024-05-30T06:57:18.062422+0000","last_unstale":"2024-05-30T06:57:20.783298+0000","last_undegraded":"2024-05-30T06:57:20.783298+0000","last_fullsized":"2024-05-30T06:57:20.783298+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:50:41.574680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783257+0000","last_change":"2024-05-30T06:57:19.062856+0000","last_active":"2024-05-30T06:57:20.783257+0000","last_peered":"2024-05-30T06:57:20.783257+0000","last_clean":"2024-05-30T06:57:20.783257+0000","last_became_active":"2024-05-30T06:57:19.062591+0000","last_became_peered":"2024-05-30T06:57:19.062591+0000","last_unstale":"2024-05-30T06:57:20.783257+0000","last_undegraded":"2024-05-30T06:57:20.783257+0000","last_fullsized":"2024-05-30T06:57:20.783257+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:07.816849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074359+0000","last_change":"2024-05-30T06:57:18.064096+0000","last_active":"2024-05-30T06:57:20.074359+0000","last_peered":"2024-05-30T06:57:20.074359+0000","last_clean":"2024-05-30T06:57:20.074359+0000","last_became_active":"2024-05-30T06:57:18.063824+0000","last_became_peered":"2024-05-30T06:57:18.063824+0000","last_unstale":"2024-05-30T06:57:20.074359+0000","last_undegraded":"2024-05-30T06:57:20.074359+0000","last_fullsized":"2024-05-30T06:57:20.074359+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:45:20.982230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074200+0000","last_change":"2024-05-30T06:57:19.073485+0000","last_active":"2024-05-30T06:57:20.074200+0000","last_peered":"2024-05-30T06:57:20.074200+0000","last_clean":"2024-05-30T06:57:20.074200+0000","last_became_active":"2024-05-30T06:57:19.073127+0000","last_became_peered":"2024-05-30T06:57:19.073127+0000","last_unstale":"2024-05-30T06:57:20.074200+0000","last_undegraded":"2024-05-30T06:57:20.074200+0000","last_fullsized":"2024-05-30T06:57:20.074200+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:45:34.749814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.070406+0000","last_change":"2024-05-30T06:57:18.057527+0000","last_active":"2024-05-30T06:57:20.070406+0000","last_peered":"2024-05-30T06:57:20.070406+0000","last_clean":"2024-05-30T06:57:20.070406+0000","last_became_active":"2024-05-30T06:57:18.057148+0000","last_became_peered":"2024-05-30T06:57:18.057148+0000","last_unstale":"2024-05-30T06:57:20.070406+0000","last_undegraded":"2024-05-30T06:57:20.070406+0000","last_fullsized":"2024-05-30T06:57:20.070406+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:23:17.956088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.782844+0000","last_change":"2024-05-30T06:57:19.070029+0000","last_active":"2024-05-30T06:57:20.782844+0000","last_peered":"2024-05-30T06:57:20.782844+0000","last_clean":"2024-05-30T06:57:20.782844+0000","last_became_active":"2024-05-30T06:57:19.069732+0000","last_became_peered":"2024-05-30T06:57:19.069732+0000","last_unstale":"2024-05-30T06:57:20.782844+0000","last_undegraded":"2024-05-30T06:57:20.782844+0000","last_fullsized":"2024-05-30T06:57:20.782844+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:49:15.516815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.073993+0000","last_change":"2024-05-30T06:57:18.054715+0000","last_active":"2024-05-30T06:57:20.073993+0000","last_peered":"2024-05-30T06:57:20.073993+0000","last_clean":"2024-05-30T06:57:20.073993+0000","last_became_active":"2024-05-30T06:57:18.054397+0000","last_became_peered":"2024-05-30T06:57:18.054397+0000","last_unstale":"2024-05-30T06:57:20.073993+0000","last_undegraded":"2024-05-30T06:57:20.073993+0000","last_fullsized":"2024-05-30T06:57:20.073993+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:38:32.320486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074081+0000","last_change":"2024-05-30T06:57:19.073129+0000","last_active":"2024-05-30T06:57:20.074081+0000","last_peered":"2024-05-30T06:57:20.074081+0000","last_clean":"2024-05-30T06:57:20.074081+0000","last_became_active":"2024-05-30T06:57:19.072654+0000","last_became_peered":"2024-05-30T06:57:19.072654+0000","last_unstale":"2024-05-30T06:57:20.074081+0000","last_undegraded":"2024-05-30T06:57:20.074081+0000","last_fullsized":"2024-05-30T06:57:20.074081+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:17:31.397227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.782978+0000","last_change":"2024-05-30T06:57:18.062207+0000","last_active":"2024-05-30T06:57:20.782978+0000","last_peered":"2024-05-30T06:57:20.782978+0000","last_clean":"2024-05-30T06:57:20.782978+0000","last_became_active":"2024-05-30T06:57:18.061886+0000","last_became_peered":"2024-05-30T06:57:18.061886+0000","last_unstale":"2024-05-30T06:57:20.782978+0000","last_undegraded":"2024-05-30T06:57:20.782978+0000","last_fullsized":"2024-05-30T06:57:20.782978+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:21:12.282442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074950+0000","last_change":"2024-05-30T06:57:19.082626+0000","last_active":"2024-05-30T06:57:20.074950+0000","last_peered":"2024-05-30T06:57:20.074950+0000","last_clean":"2024-05-30T06:57:20.074950+0000","last_became_active":"2024-05-30T06:57:19.082318+0000","last_became_peered":"2024-05-30T06:57:19.082318+0000","last_unstale":"2024-05-30T06:57:20.074950+0000","last_undegraded":"2024-05-30T06:57:20.074950+0000","last_fullsized":"2024-05-30T06:57:20.074950+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:34:11.043088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783606+0000","last_change":"2024-05-30T06:57:18.063301+0000","last_active":"2024-05-30T06:57:20.783606+0000","last_peered":"2024-05-30T06:57:20.783606+0000","last_clean":"2024-05-30T06:57:20.783606+0000","last_became_active":"2024-05-30T06:57:18.063018+0000","last_became_peered":"2024-05-30T06:57:18.063018+0000","last_unstale":"2024-05-30T06:57:20.783606+0000","last_undegraded":"2024-05-30T06:57:20.783606+0000","last_fullsized":"2024-05-30T06:57:20.783606+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:46:55.306343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.085013+0000","last_change":"2024-05-30T06:57:19.077964+0000","last_active":"2024-05-30T06:57:20.085013+0000","last_peered":"2024-05-30T06:57:20.085013+0000","last_clean":"2024-05-30T06:57:20.085013+0000","last_became_active":"2024-05-30T06:57:19.077664+0000","last_became_peered":"2024-05-30T06:57:19.077664+0000","last_unstale":"2024-05-30T06:57:20.085013+0000","last_undegraded":"2024-05-30T06:57:20.085013+0000","last_fullsized":"2024-05-30T06:57:20.085013+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:37:15.173966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.070708+0000","last_change":"2024-05-30T06:57:18.064721+0000","last_active":"2024-05-30T06:57:20.070708+0000","last_peered":"2024-05-30T06:57:20.070708+0000","last_clean":"2024-05-30T06:57:20.070708+0000","last_became_active":"2024-05-30T06:57:18.064369+0000","last_became_peered":"2024-05-30T06:57:18.064369+0000","last_unstale":"2024-05-30T06:57:20.070708+0000","last_undegraded":"2024-05-30T06:57:20.070708+0000","last_fullsized":"2024-05-30T06:57:20.070708+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:38:05.820026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.070838+0000","last_change":"2024-05-30T06:57:19.070965+0000","last_active":"2024-05-30T06:57:20.070838+0000","last_peered":"2024-05-30T06:57:20.070838+0000","last_clean":"2024-05-30T06:57:20.070838+0000","last_became_active":"2024-05-30T06:57:19.070618+0000","last_became_peered":"2024-05-30T06:57:19.070618+0000","last_unstale":"2024-05-30T06:57:20.070838+0000","last_undegraded":"2024-05-30T06:57:20.070838+0000","last_fullsized":"2024-05-30T06:57:20.070838+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:18:31.973210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"113'3","reported_seq":17,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784178+0000","last_change":"2024-05-30T06:57:18.068132+0000","last_active":"2024-05-30T06:57:20.784178+0000","last_peered":"2024-05-30T06:57:20.784178+0000","last_clean":"2024-05-30T06:57:20.784178+0000","last_became_active":"2024-05-30T06:57:18.067200+0000","last_became_peered":"2024-05-30T06:57:18.067200+0000","last_unstale":"2024-05-30T06:57:20.784178+0000","last_undegraded":"2024-05-30T06:57:20.784178+0000","last_fullsized":"2024-05-30T06:57:20.784178+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:29:58.944912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074820+0000","last_change":"2024-05-30T06:57:19.080229+0000","last_active":"2024-05-30T06:57:20.074820+0000","last_peered":"2024-05-30T06:57:20.074820+0000","last_clean":"2024-05-30T06:57:20.074820+0000","last_became_active":"2024-05-30T06:57:19.079919+0000","last_became_peered":"2024-05-30T06:57:19.079919+0000","last_unstale":"2024-05-30T06:57:20.074820+0000","last_undegraded":"2024-05-30T06:57:20.074820+0000","last_fullsized":"2024-05-30T06:57:20.074820+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:46:47.516926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"113'6","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784093+0000","last_change":"2024-05-30T06:57:18.056997+0000","last_active":"2024-05-30T06:57:20.784093+0000","last_peered":"2024-05-30T06:57:20.784093+0000","last_clean":"2024-05-30T06:57:20.784093+0000","last_became_active":"2024-05-30T06:57:18.056285+0000","last_became_peered":"2024-05-30T06:57:18.056285+0000","last_unstale":"2024-05-30T06:57:20.784093+0000","last_undegraded":"2024-05-30T06:57:20.784093+0000","last_fullsized":"2024-05-30T06:57:20.784093+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:19:09.089384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.070380+0000","last_change":"2024-05-30T06:57:19.062442+0000","last_active":"2024-05-30T06:57:20.070380+0000","last_peered":"2024-05-30T06:57:20.070380+0000","last_clean":"2024-05-30T06:57:20.070380+0000","last_became_active":"2024-05-30T06:57:19.062149+0000","last_became_peered":"2024-05-30T06:57:19.062149+0000","last_unstale":"2024-05-30T06:57:20.070380+0000","last_undegraded":"2024-05-30T06:57:20.070380+0000","last_fullsized":"2024-05-30T06:57:20.070380+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:57:34.989579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784798+0000","last_change":"2024-05-30T06:57:18.063576+0000","last_active":"2024-05-30T06:57:20.784798+0000","last_peered":"2024-05-30T06:57:20.784798+0000","last_clean":"2024-05-30T06:57:20.784798+0000","last_became_active":"2024-05-30T06:57:18.063292+0000","last_became_peered":"2024-05-30T06:57:18.063292+0000","last_unstale":"2024-05-30T06:57:20.784798+0000","last_undegraded":"2024-05-30T06:57:20.784798+0000","last_fullsized":"2024-05-30T06:57:20.784798+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:49:22.810583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.070632+0000","last_change":"2024-05-30T06:57:19.074791+0000","last_active":"2024-05-30T06:57:20.070632+0000","last_peered":"2024-05-30T06:57:20.070632+0000","last_clean":"2024-05-30T06:57:20.070632+0000","last_became_active":"2024-05-30T06:57:19.074518+0000","last_became_peered":"2024-05-30T06:57:19.074518+0000","last_unstale":"2024-05-30T06:57:20.070632+0000","last_undegraded":"2024-05-30T06:57:20.070632+0000","last_fullsized":"2024-05-30T06:57:20.070632+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:17:23.179460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.084794+0000","last_change":"2024-05-30T06:57:18.061114+0000","last_active":"2024-05-30T06:57:20.084794+0000","last_peered":"2024-05-30T06:57:20.084794+0000","last_clean":"2024-05-30T06:57:20.084794+0000","last_became_active":"2024-05-30T06:57:18.060826+0000","last_became_peered":"2024-05-30T06:57:18.060826+0000","last_unstale":"2024-05-30T06:57:20.084794+0000","last_undegraded":"2024-05-30T06:57:20.084794+0000","last_fullsized":"2024-05-30T06:57:20.084794+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:13:09.781880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.070025+0000","last_change":"2024-05-30T06:57:19.067480+0000","last_active":"2024-05-30T06:57:20.070025+0000","last_peered":"2024-05-30T06:57:20.070025+0000","last_clean":"2024-05-30T06:57:20.070025+0000","last_became_active":"2024-05-30T06:57:19.062558+0000","last_became_peered":"2024-05-30T06:57:19.062558+0000","last_unstale":"2024-05-30T06:57:20.070025+0000","last_undegraded":"2024-05-30T06:57:20.070025+0000","last_fullsized":"2024-05-30T06:57:20.070025+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:55:39.035326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"113'8","reported_seq":22,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.782629+0000","last_change":"2024-05-30T06:57:18.057392+0000","last_active":"2024-05-30T06:57:20.782629+0000","last_peered":"2024-05-30T06:57:20.782629+0000","last_clean":"2024-05-30T06:57:20.782629+0000","last_became_active":"2024-05-30T06:57:18.057040+0000","last_became_peered":"2024-05-30T06:57:18.057040+0000","last_unstale":"2024-05-30T06:57:20.782629+0000","last_undegraded":"2024-05-30T06:57:20.782629+0000","last_fullsized":"2024-05-30T06:57:20.782629+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:46:38.498160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783844+0000","last_change":"2024-05-30T06:57:19.077146+0000","last_active":"2024-05-30T06:57:20.783844+0000","last_peered":"2024-05-30T06:57:20.783844+0000","last_clean":"2024-05-30T06:57:20.783844+0000","last_became_active":"2024-05-30T06:57:19.076877+0000","last_became_peered":"2024-05-30T06:57:19.076877+0000","last_unstale":"2024-05-30T06:57:20.783844+0000","last_undegraded":"2024-05-30T06:57:20.783844+0000","last_fullsized":"2024-05-30T06:57:20.783844+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:24:46.291385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784680+0000","last_change":"2024-05-30T06:57:18.061898+0000","last_active":"2024-05-30T06:57:20.784680+0000","last_peered":"2024-05-30T06:57:20.784680+0000","last_clean":"2024-05-30T06:57:20.784680+0000","last_became_active":"2024-05-30T06:57:18.061632+0000","last_became_peered":"2024-05-30T06:57:18.061632+0000","last_unstale":"2024-05-30T06:57:20.784680+0000","last_undegraded":"2024-05-30T06:57:20.784680+0000","last_fullsized":"2024-05-30T06:57:20.784680+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:55:38.027797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784711+0000","last_change":"2024-05-30T06:57:19.080710+0000","last_active":"2024-05-30T06:57:20.784711+0000","last_peered":"2024-05-30T06:57:20.784711+0000","last_clean":"2024-05-30T06:57:20.784711+0000","last_became_active":"2024-05-30T06:57:19.080411+0000","last_became_peered":"2024-05-30T06:57:19.080411+0000","last_unstale":"2024-05-30T06:57:20.784711+0000","last_undegraded":"2024-05-30T06:57:20.784711+0000","last_fullsized":"2024-05-30T06:57:20.784711+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:23:30.449060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783948+0000","last_change":"2024-05-30T06:57:18.053358+0000","last_active":"2024-05-30T06:57:20.783948+0000","last_peered":"2024-05-30T06:57:20.783948+0000","last_clean":"2024-05-30T06:57:20.783948+0000","last_became_active":"2024-05-30T06:57:18.053073+0000","last_became_peered":"2024-05-30T06:57:18.053073+0000","last_unstale":"2024-05-30T06:57:20.783948+0000","last_undegraded":"2024-05-30T06:57:20.783948+0000","last_fullsized":"2024-05-30T06:57:20.783948+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:13:16.613617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.785818+0000","last_change":"2024-05-30T06:57:19.086582+0000","last_active":"2024-05-30T06:57:20.785818+0000","last_peered":"2024-05-30T06:57:20.785818+0000","last_clean":"2024-05-30T06:57:20.785818+0000","last_became_active":"2024-05-30T06:57:19.086301+0000","last_became_peered":"2024-05-30T06:57:19.086301+0000","last_unstale":"2024-05-30T06:57:20.785818+0000","last_undegraded":"2024-05-30T06:57:20.785818+0000","last_fullsized":"2024-05-30T06:57:20.785818+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:53:22.866055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.084826+0000","last_change":"2024-05-30T06:57:18.062817+0000","last_active":"2024-05-30T06:57:20.084826+0000","last_peered":"2024-05-30T06:57:20.084826+0000","last_clean":"2024-05-30T06:57:20.084826+0000","last_became_active":"2024-05-30T06:57:18.062547+0000","last_became_peered":"2024-05-30T06:57:18.062547+0000","last_unstale":"2024-05-30T06:57:20.084826+0000","last_undegraded":"2024-05-30T06:57:20.084826+0000","last_fullsized":"2024-05-30T06:57:20.084826+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:38:32.320486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.786205+0000","last_change":"2024-05-30T06:57:19.083760+0000","last_active":"2024-05-30T06:57:20.786205+0000","last_peered":"2024-05-30T06:57:20.786205+0000","last_clean":"2024-05-30T06:57:20.786205+0000","last_became_active":"2024-05-30T06:57:19.083476+0000","last_became_peered":"2024-05-30T06:57:19.083476+0000","last_unstale":"2024-05-30T06:57:20.786205+0000","last_undegraded":"2024-05-30T06:57:20.786205+0000","last_fullsized":"2024-05-30T06:57:20.786205+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:07.816849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.075088+0000","last_change":"2024-05-30T06:57:18.060235+0000","last_active":"2024-05-30T06:57:20.075088+0000","last_peered":"2024-05-30T06:57:20.075088+0000","last_clean":"2024-05-30T06:57:20.075088+0000","last_became_active":"2024-05-30T06:57:18.059883+0000","last_became_peered":"2024-05-30T06:57:18.059883+0000","last_unstale":"2024-05-30T06:57:20.075088+0000","last_undegraded":"2024-05-30T06:57:20.075088+0000","last_fullsized":"2024-05-30T06:57:20.075088+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:46:21.977536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.786030+0000","last_change":"2024-05-30T06:57:19.085852+0000","last_active":"2024-05-30T06:57:20.786030+0000","last_peered":"2024-05-30T06:57:20.786030+0000","last_clean":"2024-05-30T06:57:20.786030+0000","last_became_active":"2024-05-30T06:57:19.085579+0000","last_became_peered":"2024-05-30T06:57:19.085579+0000","last_unstale":"2024-05-30T06:57:20.786030+0000","last_undegraded":"2024-05-30T06:57:20.786030+0000","last_fullsized":"2024-05-30T06:57:20.786030+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:47:20.266600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784486+0000","last_change":"2024-05-30T06:57:18.061015+0000","last_active":"2024-05-30T06:57:20.784486+0000","last_peered":"2024-05-30T06:57:20.784486+0000","last_clean":"2024-05-30T06:57:20.784486+0000","last_became_active":"2024-05-30T06:57:18.060726+0000","last_became_peered":"2024-05-30T06:57:18.060726+0000","last_unstale":"2024-05-30T06:57:20.784486+0000","last_undegraded":"2024-05-30T06:57:20.784486+0000","last_fullsized":"2024-05-30T06:57:20.784486+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:21:07.814279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783075+0000","last_change":"2024-05-30T06:57:19.078013+0000","last_active":"2024-05-30T06:57:20.783075+0000","last_peered":"2024-05-30T06:57:20.783075+0000","last_clean":"2024-05-30T06:57:20.783075+0000","last_became_active":"2024-05-30T06:57:19.077423+0000","last_became_peered":"2024-05-30T06:57:19.077423+0000","last_unstale":"2024-05-30T06:57:20.783075+0000","last_undegraded":"2024-05-30T06:57:20.783075+0000","last_fullsized":"2024-05-30T06:57:20.783075+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:47:20.266600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.782767+0000","last_change":"2024-05-30T06:57:18.058579+0000","last_active":"2024-05-30T06:57:20.782767+0000","last_peered":"2024-05-30T06:57:20.782767+0000","last_clean":"2024-05-30T06:57:20.782767+0000","last_became_active":"2024-05-30T06:57:18.057970+0000","last_became_peered":"2024-05-30T06:57:18.057970+0000","last_unstale":"2024-05-30T06:57:20.782767+0000","last_undegraded":"2024-05-30T06:57:20.782767+0000","last_fullsized":"2024-05-30T06:57:20.782767+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:27:22.892961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.785662+0000","last_change":"2024-05-30T06:57:19.086137+0000","last_active":"2024-05-30T06:57:20.785662+0000","last_peered":"2024-05-30T06:57:20.785662+0000","last_clean":"2024-05-30T06:57:20.785662+0000","last_became_active":"2024-05-30T06:57:19.085640+0000","last_became_peered":"2024-05-30T06:57:19.085640+0000","last_unstale":"2024-05-30T06:57:20.785662+0000","last_undegraded":"2024-05-30T06:57:20.785662+0000","last_fullsized":"2024-05-30T06:57:20.785662+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:57:34.989579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783780+0000","last_change":"2024-05-30T06:57:18.061904+0000","last_active":"2024-05-30T06:57:20.783780+0000","last_peered":"2024-05-30T06:57:20.783780+0000","last_clean":"2024-05-30T06:57:20.783780+0000","last_became_active":"2024-05-30T06:57:18.060839+0000","last_became_peered":"2024-05-30T06:57:18.060839+0000","last_unstale":"2024-05-30T06:57:20.783780+0000","last_undegraded":"2024-05-30T06:57:20.783780+0000","last_fullsized":"2024-05-30T06:57:20.783780+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:05:40.598386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.070064+0000","last_change":"2024-05-30T06:57:19.070767+0000","last_active":"2024-05-30T06:57:20.070064+0000","last_peered":"2024-05-30T06:57:20.070064+0000","last_clean":"2024-05-30T06:57:20.070064+0000","last_became_active":"2024-05-30T06:57:19.063133+0000","last_became_peered":"2024-05-30T06:57:19.063133+0000","last_unstale":"2024-05-30T06:57:20.070064+0000","last_undegraded":"2024-05-30T06:57:20.070064+0000","last_fullsized":"2024-05-30T06:57:20.070064+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:01:30.426681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783099+0000","last_change":"2024-05-30T06:57:18.064064+0000","last_active":"2024-05-30T06:57:20.783099+0000","last_peered":"2024-05-30T06:57:20.783099+0000","last_clean":"2024-05-30T06:57:20.783099+0000","last_became_active":"2024-05-30T06:57:18.060291+0000","last_became_peered":"2024-05-30T06:57:18.060291+0000","last_unstale":"2024-05-30T06:57:20.783099+0000","last_undegraded":"2024-05-30T06:57:20.783099+0000","last_fullsized":"2024-05-30T06:57:20.783099+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:23:17.956088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.084787+0000","last_change":"2024-05-30T06:57:19.078119+0000","last_active":"2024-05-30T06:57:20.084787+0000","last_peered":"2024-05-30T06:57:20.084787+0000","last_clean":"2024-05-30T06:57:20.084787+0000","last_became_active":"2024-05-30T06:57:19.077778+0000","last_became_peered":"2024-05-30T06:57:19.077778+0000","last_unstale":"2024-05-30T06:57:20.084787+0000","last_undegraded":"2024-05-30T06:57:20.084787+0000","last_fullsized":"2024-05-30T06:57:20.084787+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:24:28.992796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.071092+0000","last_change":"2024-05-30T06:57:18.057816+0000","last_active":"2024-05-30T06:57:20.071092+0000","last_peered":"2024-05-30T06:57:20.071092+0000","last_clean":"2024-05-30T06:57:20.071092+0000","last_became_active":"2024-05-30T06:57:18.057548+0000","last_became_peered":"2024-05-30T06:57:18.057548+0000","last_unstale":"2024-05-30T06:57:20.071092+0000","last_undegraded":"2024-05-30T06:57:20.071092+0000","last_fullsized":"2024-05-30T06:57:20.071092+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:21:12.282442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784648+0000","last_change":"2024-05-30T06:57:19.076511+0000","last_active":"2024-05-30T06:57:20.784648+0000","last_peered":"2024-05-30T06:57:20.784648+0000","last_clean":"2024-05-30T06:57:20.784648+0000","last_became_active":"2024-05-30T06:57:19.076047+0000","last_became_peered":"2024-05-30T06:57:19.076047+0000","last_unstale":"2024-05-30T06:57:20.784648+0000","last_undegraded":"2024-05-30T06:57:20.784648+0000","last_fullsized":"2024-05-30T06:57:20.784648+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:48:53.961460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"114'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.084997+0000","last_change":"2024-05-30T06:57:18.057904+0000","last_active":"2024-05-30T06:57:20.084997+0000","last_peered":"2024-05-30T06:57:20.084997+0000","last_clean":"2024-05-30T06:57:20.084997+0000","last_became_active":"2024-05-30T06:57:18.057652+0000","last_became_peered":"2024-05-30T06:57:18.057652+0000","last_unstale":"2024-05-30T06:57:20.084997+0000","last_undegraded":"2024-05-30T06:57:20.084997+0000","last_fullsized":"2024-05-30T06:57:20.084997+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:22:51.217255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783802+0000","last_change":"2024-05-30T06:57:19.067660+0000","last_active":"2024-05-30T06:57:20.783802+0000","last_peered":"2024-05-30T06:57:20.783802+0000","last_clean":"2024-05-30T06:57:20.783802+0000","last_became_active":"2024-05-30T06:57:19.067349+0000","last_became_peered":"2024-05-30T06:57:19.067349+0000","last_unstale":"2024-05-30T06:57:20.783802+0000","last_undegraded":"2024-05-30T06:57:20.783802+0000","last_fullsized":"2024-05-30T06:57:20.783802+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:15:03.795361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.784182+0000","last_change":"2024-05-30T06:57:18.067628+0000","last_active":"2024-05-30T06:57:20.784182+0000","last_peered":"2024-05-30T06:57:20.784182+0000","last_clean":"2024-05-30T06:57:20.784182+0000","last_became_active":"2024-05-30T06:57:18.067352+0000","last_became_peered":"2024-05-30T06:57:18.067352+0000","last_unstale":"2024-05-30T06:57:20.784182+0000","last_undegraded":"2024-05-30T06:57:20.784182+0000","last_fullsized":"2024-05-30T06:57:20.784182+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:34:33.871794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.085145+0000","last_change":"2024-05-30T06:57:19.077417+0000","last_active":"2024-05-30T06:57:20.085145+0000","last_peered":"2024-05-30T06:57:20.085145+0000","last_clean":"2024-05-30T06:57:20.085145+0000","last_became_active":"2024-05-30T06:57:19.077075+0000","last_became_peered":"2024-05-30T06:57:19.077075+0000","last_unstale":"2024-05-30T06:57:20.085145+0000","last_undegraded":"2024-05-30T06:57:20.085145+0000","last_fullsized":"2024-05-30T06:57:20.085145+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:34:14.015142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.070986+0000","last_change":"2024-05-30T06:57:18.065886+0000","last_active":"2024-05-30T06:57:20.070986+0000","last_peered":"2024-05-30T06:57:20.070986+0000","last_clean":"2024-05-30T06:57:20.070986+0000","last_became_active":"2024-05-30T06:57:18.065476+0000","last_became_peered":"2024-05-30T06:57:18.065476+0000","last_unstale":"2024-05-30T06:57:20.070986+0000","last_undegraded":"2024-05-30T06:57:20.070986+0000","last_fullsized":"2024-05-30T06:57:20.070986+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:45:33.742285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074067+0000","last_change":"2024-05-30T06:57:19.065139+0000","last_active":"2024-05-30T06:57:20.074067+0000","last_peered":"2024-05-30T06:57:20.074067+0000","last_clean":"2024-05-30T06:57:20.074067+0000","last_became_active":"2024-05-30T06:57:19.064851+0000","last_became_peered":"2024-05-30T06:57:19.064851+0000","last_unstale":"2024-05-30T06:57:20.074067+0000","last_undegraded":"2024-05-30T06:57:20.074067+0000","last_fullsized":"2024-05-30T06:57:20.074067+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:23:18.963617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074508+0000","last_change":"2024-05-30T06:57:18.056395+0000","last_active":"2024-05-30T06:57:20.074508+0000","last_peered":"2024-05-30T06:57:20.074508+0000","last_clean":"2024-05-30T06:57:20.074508+0000","last_became_active":"2024-05-30T06:57:18.056128+0000","last_became_peered":"2024-05-30T06:57:18.056128+0000","last_unstale":"2024-05-30T06:57:20.074508+0000","last_undegraded":"2024-05-30T06:57:20.074508+0000","last_fullsized":"2024-05-30T06:57:20.074508+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:41:15.145086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074393+0000","last_change":"2024-05-30T06:57:19.086422+0000","last_active":"2024-05-30T06:57:20.074393+0000","last_peered":"2024-05-30T06:57:20.074393+0000","last_clean":"2024-05-30T06:57:20.074393+0000","last_became_active":"2024-05-30T06:57:19.086060+0000","last_became_peered":"2024-05-30T06:57:19.086060+0000","last_unstale":"2024-05-30T06:57:20.074393+0000","last_undegraded":"2024-05-30T06:57:20.074393+0000","last_fullsized":"2024-05-30T06:57:20.074393+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:41:47.008630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.074183+0000","last_change":"2024-05-30T06:57:18.061248+0000","last_active":"2024-05-30T06:57:20.074183+0000","last_peered":"2024-05-30T06:57:20.074183+0000","last_clean":"2024-05-30T06:57:20.074183+0000","last_became_active":"2024-05-30T06:57:18.060853+0000","last_became_peered":"2024-05-30T06:57:18.060853+0000","last_unstale":"2024-05-30T06:57:20.074183+0000","last_undegraded":"2024-05-30T06:57:20.074183+0000","last_fullsized":"2024-05-30T06:57:20.074183+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:13:09.781880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.785851+0000","last_change":"2024-05-30T06:57:19.079411+0000","last_active":"2024-05-30T06:57:20.785851+0000","last_peered":"2024-05-30T06:57:20.785851+0000","last_clean":"2024-05-30T06:57:20.785851+0000","last_became_active":"2024-05-30T06:57:19.079142+0000","last_became_peered":"2024-05-30T06:57:19.079142+0000","last_unstale":"2024-05-30T06:57:20.785851+0000","last_undegraded":"2024-05-30T06:57:20.785851+0000","last_fullsized":"2024-05-30T06:57:20.785851+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:49:15.516815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.782602+0000","last_change":"2024-05-30T06:57:18.061791+0000","last_active":"2024-05-30T06:57:20.782602+0000","last_peered":"2024-05-30T06:57:20.782602+0000","last_clean":"2024-05-30T06:57:20.782602+0000","last_became_active":"2024-05-30T06:57:18.060245+0000","last_became_peered":"2024-05-30T06:57:18.060245+0000","last_unstale":"2024-05-30T06:57:20.782602+0000","last_undegraded":"2024-05-30T06:57:20.782602+0000","last_fullsized":"2024-05-30T06:57:20.782602+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:40:37.329707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.782928+0000","last_change":"2024-05-30T06:57:19.071235+0000","last_active":"2024-05-30T06:57:20.782928+0000","last_peered":"2024-05-30T06:57:20.782928+0000","last_clean":"2024-05-30T06:57:20.782928+0000","last_became_active":"2024-05-30T06:57:19.069295+0000","last_became_peered":"2024-05-30T06:57:19.069295+0000","last_unstale":"2024-05-30T06:57:20.782928+0000","last_undegraded":"2024-05-30T06:57:20.782928+0000","last_fullsized":"2024-05-30T06:57:20.782928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:13:13.605002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.783147+0000","last_change":"2024-05-30T06:57:18.067970+0000","last_active":"2024-05-30T06:57:20.783147+0000","last_peered":"2024-05-30T06:57:20.783147+0000","last_clean":"2024-05-30T06:57:20.783147+0000","last_became_active":"2024-05-30T06:57:18.067035+0000","last_became_peered":"2024-05-30T06:57:18.067035+0000","last_unstale":"2024-05-30T06:57:20.783147+0000","last_undegraded":"2024-05-30T06:57:20.783147+0000","last_fullsized":"2024-05-30T06:57:20.783147+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:45:33.742285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.070059+0000","last_change":"2024-05-30T06:57:19.078201+0000","last_active":"2024-05-30T06:57:20.070059+0000","last_peered":"2024-05-30T06:57:20.070059+0000","last_clean":"2024-05-30T06:57:20.070059+0000","last_became_active":"2024-05-30T06:57:19.077591+0000","last_became_peered":"2024-05-30T06:57:19.077591+0000","last_unstale":"2024-05-30T06:57:20.070059+0000","last_undegraded":"2024-05-30T06:57:20.070059+0000","last_fullsized":"2024-05-30T06:57:20.070059+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:18.036610+0000","last_clean_scrub_stamp":"2024-05-30T06:57:18.036610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:16:19.698174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.075208+0000","last_change":"2024-05-30T06:57:18.059661+0000","last_active":"2024-05-30T06:57:20.075208+0000","last_peered":"2024-05-30T06:57:20.075208+0000","last_clean":"2024-05-30T06:57:20.075208+0000","last_became_active":"2024-05-30T06:57:18.059346+0000","last_became_peered":"2024-05-30T06:57:18.059346+0000","last_unstale":"2024-05-30T06:57:20.075208+0000","last_undegraded":"2024-05-30T06:57:20.075208+0000","last_fullsized":"2024-05-30T06:57:20.075208+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:57:17.029081+0000","last_clean_scrub_stamp":"2024-05-30T06:57:17.029081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:17:50.747740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":350,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-05-30T06:57:20.786031+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:57:20.786031+0000","last_peered":"2024-05-30T06:57:20.786031+0000","last_clean":"2024-05-30T06:57:20.786031+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:57:20.786031+0000","last_undegraded":"2024-05-30T06:57:20.786031+0000","last_fullsized":"2024-05-30T06:57:20.786031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123328,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94248512,"statfs":{"total":96636764160,"available":96510476288,"internally_reserved":0,"allocated":2019328,"data_stored":1211104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":124254666},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126912,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244928,"statfs":{"total":96636764160,"available":96506806272,"internally_reserved":0,"allocated":1421312,"data_stored":620190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":128514502},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76924,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":75518,"kb_avail":94294916,"statfs":{"total":96636764160,"available":96557993984,"internally_reserved":0,"allocated":1425408,"data_stored":620724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77330885},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":86652,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94285188,"statfs":{"total":96636764160,"available":96548032512,"internally_reserved":0,"allocated":1417216,"data_stored":620120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575036,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144964,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226876,"statfs":{"total":96636764160,"available":96488321024,"internally_reserved":0,"allocated":1433600,"data_stored":621802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":146995655},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144948,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226892,"statfs":{"total":96636764160,"available":96488337408,"internally_reserved":0,"allocated":1417216,"data_stored":620120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108860,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94262980,"statfs":{"total":96636764160,"available":96525291520,"internally_reserved":0,"allocated":1425408,"data_stored":620244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65036,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94306804,"statfs":{"total":96636764160,"available":96570167296,"internally_reserved":0,"allocated":2031616,"data_stored":1212212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:57:28.147 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-30T06:57:28.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T06:57:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.331+0000 7fe913c00640 1 Processor -- start 2024-05-30T06:57:28.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.331+0000 7fe913c00640 1 -- start start 2024-05-30T06:57:28.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.331+0000 7fe913c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe90c15c890 0x7fe90c162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe913c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe90c15f210 0x7fe90c072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe913c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe90c0cec10 0x7fe90c072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe913c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe90c163020 con 0x7fe90c0cec10 2024-05-30T06:57:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe913c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe90c163300 con 0x7fe90c15f210 2024-05-30T06:57:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe913c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe90c1635e0 con 0x7fe90c15c890 2024-05-30T06:57:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe911c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe90c0cec10 0x7fe90c072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe911c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe90c0cec10 0x7fe90c072c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53836/0 (socket says 172.21.15.37:53836) 2024-05-30T06:57:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe911c00640 1 -- 172.21.15.37:0/16773848 learned_addr learned my addr 172.21.15.37:0/16773848 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe911200640 1 --2- 172.21.15.37:0/16773848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe90c15c890 0x7fe90c162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe903e00640 1 --2- 172.21.15.37:0/16773848 >> v2:172.21.15.105:3300/0 conn(0x7fe90c15f210 0x7fe90c072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe911c00640 1 -- 172.21.15.37:0/16773848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe90c15c890 msgr2=0x7fe90c162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe911c00640 1 --2- 172.21.15.37:0/16773848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe90c15c890 0x7fe90c162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe911c00640 1 -- 172.21.15.37:0/16773848 >> v2:172.21.15.105:3300/0 conn(0x7fe90c15f210 msgr2=0x7fe90c072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe911c00640 1 --2- 172.21.15.37:0/16773848 >> v2:172.21.15.105:3300/0 conn(0x7fe90c15f210 0x7fe90c072750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe911c00640 1 -- 172.21.15.37:0/16773848 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90c06ba00 con 0x7fe90c0cec10 2024-05-30T06:57:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe911c00640 1 --2- 172.21.15.37:0/16773848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c0cec10 0x7fe90c072c90 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fe90c072350 tx=0x7fe90401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eca7ca764541cee server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe90be00640 1 -- 172.21.15.37:0/16773848 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9040a55e0 con 0x7fe90c0cec10 2024-05-30T06:57:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe90be00640 1 -- 172.21.15.37:0/16773848 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9040a5780 con 0x7fe90c0cec10 2024-05-30T06:57:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.335+0000 7fe90be00640 1 -- 172.21.15.37:0/16773848 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9040a5b50 con 0x7fe90c0cec10 2024-05-30T06:57:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 -- 172.21.15.37:0/16773848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c0cec10 msgr2=0x7fe90c072c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 --2- 172.21.15.37:0/16773848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c0cec10 0x7fe90c072c90 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fe90c072350 tx=0x7fe90401c960 comp rx=0 tx=0).stop 2024-05-30T06:57:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 -- 172.21.15.37:0/16773848 shutdown_connections 2024-05-30T06:57:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 --2- 172.21.15.37:0/16773848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c0cec10 0x7fe90c072c90 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 --2- 172.21.15.37:0/16773848 >> v2:172.21.15.105:3300/0 conn(0x7fe90c15f210 0x7fe90c072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 --2- 172.21.15.37:0/16773848 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe90c15c890 0x7fe90c162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 -- 172.21.15.37:0/16773848 >> 172.21.15.37:0/16773848 conn(0x7fe90c0b2ac0 msgr2=0x7fe90c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 -- 172.21.15.37:0/16773848 shutdown_connections 2024-05-30T06:57:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 -- 172.21.15.37:0/16773848 wait complete. 2024-05-30T06:57:28.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 Processor -- start 2024-05-30T06:57:28.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 -- start start 2024-05-30T06:57:28.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe90c0cec10 0x7fe90c0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe90c15c890 0x7fe90c156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c15f210 0x7fe90c0ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c06cda0 con 0x7fe90c15f210 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c06cc20 con 0x7fe90c15c890 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe913c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe90c06cf20 con 0x7fe90c0cec10 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe911c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c15f210 0x7fe90c0ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe911c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c15f210 0x7fe90c0ae560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53842/0 (socket says 172.21.15.37:53842) 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe911c00640 1 -- 172.21.15.37:0/2671504030 learned_addr learned my addr 172.21.15.37:0/2671504030 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe911200640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe90c0cec10 0x7fe90c0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe903e00640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe90c15c890 0x7fe90c156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe911c00640 1 -- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe90c0cec10 msgr2=0x7fe90c0b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe911c00640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe90c0cec10 0x7fe90c0b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe911c00640 1 -- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe90c15c890 msgr2=0x7fe90c156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe911c00640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe90c15c890 0x7fe90c156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.339+0000 7fe911c00640 1 -- 172.21.15.37:0/2671504030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90c0adda0 con 0x7fe90c15f210 2024-05-30T06:57:28.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.343+0000 7fe911c00640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c15f210 0x7fe90c0ae560 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fe90401b010 tx=0x7fe904019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:28.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.343+0000 7fe909600640 1 -- 172.21.15.37:0/2671504030 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9040bc020 con 0x7fe90c15f210 2024-05-30T06:57:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.343+0000 7fe909600640 1 -- 172.21.15.37:0/2671504030 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9040b8880 con 0x7fe90c15f210 2024-05-30T06:57:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.343+0000 7fe909600640 1 -- 172.21.15.37:0/2671504030 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9040a55e0 con 0x7fe90c15f210 2024-05-30T06:57:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.343+0000 7fe913c00640 1 -- 172.21.15.37:0/2671504030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90c0b4dd0 con 0x7fe90c15f210 2024-05-30T06:57:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.343+0000 7fe913c00640 1 -- 172.21.15.37:0/2671504030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe90c0b5390 con 0x7fe90c15f210 2024-05-30T06:57:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.343+0000 7fe913c00640 1 -- 172.21.15.37:0/2671504030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe90c068bc0 con 0x7fe90c15f210 2024-05-30T06:57:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.343+0000 7fe909600640 1 -- 172.21.15.37:0/2671504030 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fe9040bf020 con 0x7fe90c15f210 2024-05-30T06:57:28.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.347+0000 7fe909600640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe8e8069be0 0x7fe8e806c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:28.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.347+0000 7fe909600640 1 -- 172.21.15.37:0/2671504030 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7fe904120320 con 0x7fe90c15f210 2024-05-30T06:57:28.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.347+0000 7fe911200640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe8e8069be0 0x7fe8e806c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:28.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.347+0000 7fe911200640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe8e8069be0 0x7fe8e806c0a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc0045f0 tx=0x7fe8fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.351+0000 7fe909600640 1 -- 172.21.15.37:0/2671504030 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe9040165e0 con 0x7fe90c15f210 2024-05-30T06:57:28.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.571+0000 7fe913c00640 1 -- 172.21.15.37:0/2671504030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe90c067d90 con 0x7fe90c15f210 2024-05-30T06:57:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.575+0000 7fe909600640 1 -- 172.21.15.37:0/2671504030 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7fe9040f1c70 con 0x7fe90c15f210 2024-05-30T06:57:28.573 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-30T06:57:28.573 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A== 2024-05-30T06:57:28.573 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-30T06:57:28.573 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-30T06:57:28.573 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T06:57:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-30T06:57:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.575+0000 7fe913c00640 1 -- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe8e8069be0 msgr2=0x7fe8e806c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.575+0000 7fe913c00640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe8e8069be0 0x7fe8e806c0a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc0045f0 tx=0x7fe8fc008040 comp rx=0 tx=0).stop 2024-05-30T06:57:28.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.575+0000 7fe913c00640 1 -- 172.21.15.37:0/2671504030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c15f210 msgr2=0x7fe90c0ae560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.575+0000 7fe913c00640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c15f210 0x7fe90c0ae560 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fe90401b010 tx=0x7fe904019700 comp rx=0 tx=0).stop 2024-05-30T06:57:28.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.575+0000 7fe913c00640 1 -- 172.21.15.37:0/2671504030 shutdown_connections 2024-05-30T06:57:28.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.575+0000 7fe913c00640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90c15f210 0x7fe90c0ae560 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.575+0000 7fe913c00640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe8e8069be0 0x7fe8e806c0a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.575+0000 7fe913c00640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe90c15c890 0x7fe90c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.575+0000 7fe913c00640 1 --2- 172.21.15.37:0/2671504030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe90c0cec10 0x7fe90c0b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.575+0000 7fe913c00640 1 -- 172.21.15.37:0/2671504030 >> 172.21.15.37:0/2671504030 conn(0x7fe90c0b2ac0 msgr2=0x7fe90c0b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:28.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.575+0000 7fe913c00640 1 -- 172.21.15.37:0/2671504030 shutdown_connections 2024-05-30T06:57:28.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.575+0000 7fe913c00640 1 -- 172.21.15.37:0/2671504030 wait complete. 2024-05-30T06:57:28.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:57:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.735+0000 7fc987200640 1 Processor -- start 2024-05-30T06:57:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.735+0000 7fc987200640 1 -- start start 2024-05-30T06:57:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.735+0000 7fc987200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9880d16d0 0x7fc9880b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.735+0000 7fc987200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9880d05b0 con 0x7fc9880d32b0 2024-05-30T06:57:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.735+0000 7fc987200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9880d24f0 con 0x7fc98815e8d0 2024-05-30T06:57:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.735+0000 7fc987200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc9880d22a0 con 0x7fc9880d16d0 2024-05-30T06:57:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.739+0000 7fc97fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc9880d32b0 0x7fc9880d0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42086/0 (socket says 172.21.15.37:42086) 2024-05-30T06:57:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.739+0000 7fc97fe00640 1 -- 172.21.15.37:0/1084334633 learned_addr learned my addr 172.21.15.37:0/1084334633 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.739+0000 7fc986800640 1 --2- 172.21.15.37:0/1084334633 >> v2:172.21.15.37:3300/0 conn(0x7fc9880d16d0 0x7fc9880b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:28.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.739+0000 7fc986800640 1 -- 172.21.15.37:0/1084334633 >> v1:172.21.15.105:6789/0 conn(0x7fc98815e8d0 legacy=0x7fc9880cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.739+0000 7fc986800640 1 -- 172.21.15.37:0/1084334633 >> v1:172.21.15.37:6789/0 conn(0x7fc9880d32b0 legacy=0x7fc9880d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.739+0000 7fc986800640 1 -- 172.21.15.37:0/1084334633 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9880d27d0 con 0x7fc9880d16d0 2024-05-30T06:57:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.739+0000 7fc986800640 1 --2- 172.21.15.37:0/1084334633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9880d16d0 0x7fc9880b7520 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fc980009d90 tx=0x7fc98001c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b316bcb6e726f6ca server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.739+0000 7fc985400640 1 -- 172.21.15.37:0/1084334633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800b2070 con 0x7fc9880d16d0 2024-05-30T06:57:28.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.739+0000 7fc985400640 1 -- 172.21.15.37:0/1084334633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9800a57d0 con 0x7fc9880d16d0 2024-05-30T06:57:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.739+0000 7fc985400640 1 -- 172.21.15.37:0/1084334633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9800a5ba0 con 0x7fc9880d16d0 2024-05-30T06:57:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 -- 172.21.15.37:0/1084334633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9880d16d0 msgr2=0x7fc9880b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 --2- 172.21.15.37:0/1084334633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9880d16d0 0x7fc9880b7520 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fc980009d90 tx=0x7fc98001c820 comp rx=0 tx=0).stop 2024-05-30T06:57:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 -- 172.21.15.37:0/1084334633 shutdown_connections 2024-05-30T06:57:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 --2- 172.21.15.37:0/1084334633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9880d16d0 0x7fc9880b7520 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 -- 172.21.15.37:0/1084334633 >> 172.21.15.37:0/1084334633 conn(0x7fc98808bff0 msgr2=0x7fc9880d46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 -- 172.21.15.37:0/1084334633 shutdown_connections 2024-05-30T06:57:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 -- 172.21.15.37:0/1084334633 wait complete. 2024-05-30T06:57:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 Processor -- start 2024-05-30T06:57:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 -- start start 2024-05-30T06:57:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9880d16d0 0x7fc988155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9880d32b0 0x7fc9880c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc98815e8d0 0x7fc988160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9880d5540 con 0x7fc9880d16d0 2024-05-30T06:57:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc9880d53c0 con 0x7fc98815e8d0 2024-05-30T06:57:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc987200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc98816c800 con 0x7fc9880d32b0 2024-05-30T06:57:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc985e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9880d16d0 0x7fc988155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc985e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9880d16d0 0x7fc988155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53860/0 (socket says 172.21.15.37:53860) 2024-05-30T06:57:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc985e00640 1 -- 172.21.15.37:0/2628493066 learned_addr learned my addr 172.21.15.37:0/2628493066 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc97fe00640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9880d32b0 0x7fc9880c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.743+0000 7fc986800640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc98815e8d0 0x7fc988160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc985e00640 1 -- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9880d32b0 msgr2=0x7fc9880c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc985e00640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9880d32b0 0x7fc9880c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc985e00640 1 -- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc98815e8d0 msgr2=0x7fc988160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc985e00640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc98815e8d0 0x7fc988160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc985e00640 1 -- 172.21.15.37:0/2628493066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9880c8a80 con 0x7fc9880d16d0 2024-05-30T06:57:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc985e00640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9880d16d0 0x7fc988155440 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fc97800c500 tx=0x7fc97800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc97e000640 1 -- 172.21.15.37:0/2628493066 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978016020 con 0x7fc9880d16d0 2024-05-30T06:57:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc97e000640 1 -- 172.21.15.37:0/2628493066 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc978005220 con 0x7fc9880d16d0 2024-05-30T06:57:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc97e000640 1 -- 172.21.15.37:0/2628493066 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978007030 con 0x7fc9880d16d0 2024-05-30T06:57:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc987200640 1 -- 172.21.15.37:0/2628493066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9880c8d60 con 0x7fc9880d16d0 2024-05-30T06:57:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc987200640 1 -- 172.21.15.37:0/2628493066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9880c9320 con 0x7fc9880d16d0 2024-05-30T06:57:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc987200640 1 -- 172.21.15.37:0/2628493066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc988068ab0 con 0x7fc9880d16d0 2024-05-30T06:57:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc97e000640 1 -- 172.21.15.37:0/2628493066 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fc9780071f0 con 0x7fc9880d16d0 2024-05-30T06:57:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc97e000640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc964069be0 0x7fc96406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.747+0000 7fc97e000640 1 -- 172.21.15.37:0/2628493066 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7fc9780850e0 con 0x7fc9880d16d0 2024-05-30T06:57:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.751+0000 7fc97fe00640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc964069be0 0x7fc96406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.751+0000 7fc97fe00640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc964069be0 0x7fc96406c0a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc9880ce9a0 tx=0x7fc970009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:28.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.751+0000 7fc97e000640 1 -- 172.21.15.37:0/2628493066 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc978020020 con 0x7fc9880d16d0 2024-05-30T06:57:28.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.951+0000 7fc987200640 1 -- 172.21.15.37:0/2628493066 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9880b9d00 con 0x7fc9880d16d0 2024-05-30T06:57:28.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.951+0000 7fc97e000640 1 -- 172.21.15.37:0/2628493066 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5189 (secure 0 0 0) 0x7fc978056a30 con 0x7fc9880d16d0 2024-05-30T06:57:28.952 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:28.952 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3908783351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3908783351},{"type":"v1","addr":"172.21.15.105:6836","nonce":3908783351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":8473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2654517585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2654517585},{"type":"v1","addr":"172.21.15.105:6837","nonce":2654517585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":9117,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3433994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3433994777},{"type":"v1","addr":"172.21.15.37:6833","nonce":3433994777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:57:18.453221+0000","modified":"2024-05-30T06:57:21.469705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9120":{"gid":9120,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1475971506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1475971506},{"type":"v1","addr":"172.21.15.37:6835","nonce":1475971506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9120,"qdb_cluster":[9120]},"id":8}]} 2024-05-30T06:57:28.952 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 74 2024-05-30T06:57:28.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.955+0000 7fc987200640 1 -- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc964069be0 msgr2=0x7fc96406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.955+0000 7fc987200640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc964069be0 0x7fc96406c0a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc9880ce9a0 tx=0x7fc970009040 comp rx=0 tx=0).stop 2024-05-30T06:57:28.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.955+0000 7fc987200640 1 -- 172.21.15.37:0/2628493066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9880d16d0 msgr2=0x7fc988155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:28.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.955+0000 7fc987200640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9880d16d0 0x7fc988155440 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fc97800c500 tx=0x7fc97800c9c0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.955+0000 7fc987200640 1 -- 172.21.15.37:0/2628493066 shutdown_connections 2024-05-30T06:57:28.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.955+0000 7fc987200640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc964069be0 0x7fc96406c0a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.955+0000 7fc987200640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc98815e8d0 0x7fc988160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.955+0000 7fc987200640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9880d32b0 0x7fc9880c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.955+0000 7fc987200640 1 --2- 172.21.15.37:0/2628493066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9880d16d0 0x7fc988155440 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:28.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.955+0000 7fc987200640 1 -- 172.21.15.37:0/2628493066 >> 172.21.15.37:0/2628493066 conn(0x7fc98808bff0 msgr2=0x7fc98806cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:28.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.955+0000 7fc987200640 1 -- 172.21.15.37:0/2628493066 shutdown_connections 2024-05-30T06:57:28.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:28.955+0000 7fc987200640 1 -- 172.21.15.37:0/2628493066 wait complete. 2024-05-30T06:57:29.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T06:57:18.453221+0000', 'modified': '2024-05-30T06:57:21.469705+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9120}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9120': {'gid': 9120, 'name': 'a', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/1475971506', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 1475971506}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 1475971506}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9120, 'qdb_cluster': [9120]} 2024-05-30T06:57:29.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T06:57:29.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-05-30T06:57:29.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.519+0000 7f68a6000640 1 Processor -- start 2024-05-30T06:57:29.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.519+0000 7f68a6000640 1 -- start start 2024-05-30T06:57:29.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.523+0000 7f68a6000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f68a00cd440 0x7f68a006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.523+0000 7f68a6000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f68a006f5a0 0x7f68a00b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.523+0000 7f68a6000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a015f310 con 0x7f68a0155da0 2024-05-30T06:57:29.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.523+0000 7f68a6000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f68a006fa10 con 0x7f68a006f5a0 2024-05-30T06:57:29.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.523+0000 7f68a6000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f68a015f5f0 con 0x7f68a00cd440 2024-05-30T06:57:29.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.523+0000 7f689fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f68a006f5a0 0x7f68a00b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.523+0000 7f689fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f68a006f5a0 0x7f68a00b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53876/0 (socket says 172.21.15.37:53876) 2024-05-30T06:57:29.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.523+0000 7f689fe00640 1 -- 172.21.15.37:0/3311252479 learned_addr learned my addr 172.21.15.37:0/3311252479 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:29.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.523+0000 7f6897e00640 1 --2- 172.21.15.37:0/3311252479 >> v2:172.21.15.105:3300/0 conn(0x7f68a00cd440 0x7f68a006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.523+0000 7f689fe00640 1 -- 172.21.15.37:0/3311252479 >> v2:172.21.15.105:3300/0 conn(0x7f68a00cd440 msgr2=0x7f68a006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.523+0000 7f689fe00640 1 --2- 172.21.15.37:0/3311252479 >> v2:172.21.15.105:3300/0 conn(0x7f68a00cd440 0x7f68a006f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.523+0000 7f689fe00640 1 -- 172.21.15.37:0/3311252479 >> v1:172.21.15.105:6789/0 conn(0x7f68a0155da0 legacy=0x7f68a00cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.523+0000 7f689fe00640 1 -- 172.21.15.37:0/3311252479 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a015f8d0 con 0x7f68a006f5a0 2024-05-30T06:57:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f689fe00640 1 --2- 172.21.15.37:0/3311252479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a006f5a0 0x7f68a00b3750 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f68a00b2f00 tx=0x7f689801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ed626019f5e8eb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f689ea00640 1 -- 172.21.15.37:0/3311252479 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68980a5550 con 0x7f68a006f5a0 2024-05-30T06:57:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f689ea00640 1 -- 172.21.15.37:0/3311252479 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68980a56f0 con 0x7f68a006f5a0 2024-05-30T06:57:29.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f689ea00640 1 -- 172.21.15.37:0/3311252479 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68980a5ac0 con 0x7f68a006f5a0 2024-05-30T06:57:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f68a6000640 1 -- 172.21.15.37:0/3311252479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a006f5a0 msgr2=0x7f68a00b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f68a6000640 1 --2- 172.21.15.37:0/3311252479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a006f5a0 0x7f68a00b3750 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f68a00b2f00 tx=0x7f689801c890 comp rx=0 tx=0).stop 2024-05-30T06:57:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f68a6000640 1 -- 172.21.15.37:0/3311252479 shutdown_connections 2024-05-30T06:57:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f68a6000640 1 --2- 172.21.15.37:0/3311252479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a006f5a0 0x7f68a00b3750 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f68a6000640 1 --2- 172.21.15.37:0/3311252479 >> v2:172.21.15.105:3300/0 conn(0x7f68a00cd440 0x7f68a006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f68a6000640 1 -- 172.21.15.37:0/3311252479 >> 172.21.15.37:0/3311252479 conn(0x7f68a006bf60 msgr2=0x7f68a00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f68a6000640 1 -- 172.21.15.37:0/3311252479 shutdown_connections 2024-05-30T06:57:29.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f68a6000640 1 -- 172.21.15.37:0/3311252479 wait complete. 2024-05-30T06:57:29.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f68a6000640 1 Processor -- start 2024-05-30T06:57:29.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.527+0000 7f68a6000640 1 -- start start 2024-05-30T06:57:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f68a6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a006f5a0 0x7f68a014b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f68a6000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a0155da0 0x7f68a0168d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f68a6000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a014fd10 0x7f68a01501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f68a6000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68a0166570 con 0x7f68a006f5a0 2024-05-30T06:57:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f68a6000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68a00b46b0 con 0x7f68a014fd10 2024-05-30T06:57:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f68a6000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68a01666f0 con 0x7f68a0155da0 2024-05-30T06:57:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f689f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a006f5a0 0x7f68a014b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f689f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a006f5a0 0x7f68a014b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53890/0 (socket says 172.21.15.37:53890) 2024-05-30T06:57:29.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f689f400640 1 -- 172.21.15.37:0/1996768231 learned_addr learned my addr 172.21.15.37:0/1996768231 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:29.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f6897e00640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a0155da0 0x7f68a0168d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f689fe00640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a014fd10 0x7f68a01501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f689f400640 1 -- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a0155da0 msgr2=0x7f68a0168d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f689f400640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a0155da0 0x7f68a0168d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f689f400640 1 -- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a014fd10 msgr2=0x7f68a01501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f689f400640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a014fd10 0x7f68a01501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f689f400640 1 -- 172.21.15.37:0/1996768231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a014c200 con 0x7f68a006f5a0 2024-05-30T06:57:29.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f689f400640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a006f5a0 0x7f68a014b700 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f689000b410 tx=0x7f689000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:29.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f6897400640 1 -- 172.21.15.37:0/1996768231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6890015030 con 0x7f68a006f5a0 2024-05-30T06:57:29.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f6897400640 1 -- 172.21.15.37:0/1996768231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6890004020 con 0x7f68a006f5a0 2024-05-30T06:57:29.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f6897400640 1 -- 172.21.15.37:0/1996768231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6890004450 con 0x7f68a006f5a0 2024-05-30T06:57:29.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f68a6000640 1 -- 172.21.15.37:0/1996768231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a014c4e0 con 0x7f68a006f5a0 2024-05-30T06:57:29.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f68a6000640 1 -- 172.21.15.37:0/1996768231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a014caa0 con 0x7f68a006f5a0 2024-05-30T06:57:29.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.531+0000 7f6897400640 1 -- 172.21.15.37:0/1996768231 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f6890018070 con 0x7f68a006f5a0 2024-05-30T06:57:29.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f6897400640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f687c069be0 0x7f687c06c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f6897400640 1 -- 172.21.15.37:0/1996768231 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f6890085210 con 0x7f68a006f5a0 2024-05-30T06:57:29.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 Processor -- start 2024-05-30T06:57:29.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 -- start start 2024-05-30T06:57:29.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f6897e00640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f687c069be0 0x7f687c06c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7120 0x558a8b5e7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b59a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 0x558a8b59aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558a8b3eb420 con 0x558a8b5e7a40 2024-05-30T06:57:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558a8b385bf0 con 0x558a8b59a650 2024-05-30T06:57:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x558a8b3e73e0 con 0x558a8b5e7120 2024-05-30T06:57:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f6897e00640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f687c069be0 0x7f687c06c0a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f68a01fac70 tx=0x7f6888008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f6897e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b59a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f6897e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b59a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53906/0 (socket says 172.21.15.37:53906) 2024-05-30T06:57:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f6897e00640 1 -- 172.21.15.37:0/1313493817 learned_addr learned my addr 172.21.15.37:0/1313493817 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f689f400640 1 --2- 172.21.15.37:0/1313493817 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7120 0x558a8b5e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f689fe00640 1 --2- 172.21.15.37:0/1313493817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 0x558a8b59aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f6897e00640 1 -- 172.21.15.37:0/1313493817 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7120 msgr2=0x558a8b5e7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f6897e00640 1 --2- 172.21.15.37:0/1313493817 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7120 0x558a8b5e7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f6897e00640 1 -- 172.21.15.37:0/1313493817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 msgr2=0x558a8b59aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f6897e00640 1 --2- 172.21.15.37:0/1313493817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 0x558a8b59aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f6897e00640 1 -- 172.21.15.37:0/1313493817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a8b493450 con 0x558a8b5e7a40 2024-05-30T06:57:29.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f6897e00640 1 --2- 172.21.15.37:0/1313493817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b59a110 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f6888010b50 tx=0x7f6888013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e024429b589449da server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:29.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f688fe00640 1 -- 172.21.15.37:0/1313493817 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688801c050 con 0x558a8b5e7a40 2024-05-30T06:57:29.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f688fe00640 1 -- 172.21.15.37:0/1313493817 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6888026070 con 0x558a8b5e7a40 2024-05-30T06:57:29.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f688fe00640 1 -- 172.21.15.37:0/1313493817 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888016e10 con 0x558a8b5e7a40 2024-05-30T06:57:29.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 -- 172.21.15.37:0/1313493817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 msgr2=0x558a8b59a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 --2- 172.21.15.37:0/1313493817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b59a110 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f6888010b50 tx=0x7f6888013000 comp rx=0 tx=0).stop 2024-05-30T06:57:29.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 -- 172.21.15.37:0/1313493817 shutdown_connections 2024-05-30T06:57:29.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 --2- 172.21.15.37:0/1313493817 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 0x558a8b59aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 --2- 172.21.15.37:0/1313493817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b59a110 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 --2- 172.21.15.37:0/1313493817 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7120 0x558a8b5e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 -- 172.21.15.37:0/1313493817 >> 172.21.15.37:0/1313493817 conn(0x558a8b5c7ec0 msgr2=0x558a8b5ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:29.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 -- 172.21.15.37:0/1313493817 shutdown_connections 2024-05-30T06:57:29.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.535+0000 7f68a942f000 1 -- 172.21.15.37:0/1313493817 wait complete. 2024-05-30T06:57:29.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 1 -- start start 2024-05-30T06:57:29.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 1 Processor -- start 2024-05-30T06:57:29.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b59a650 0x558a8b5e68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b5e7120 0x558a8b59fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b5a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558a8b38bec0 con 0x558a8b5e7a40 2024-05-30T06:57:29.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558a8b46c120 con 0x558a8b5e7120 2024-05-30T06:57:29.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x558a8b3f6350 con 0x558a8b59a650 2024-05-30T06:57:29.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 10 client.0 _ll_register_callbacks cb 0x558a8b3c84d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:57:29.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f689fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b5a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f689fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b5a00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53910/0 (socket says 172.21.15.37:53910) 2024-05-30T06:57:29.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f689fe00640 1 -- 172.21.15.37:0/2709774508 learned_addr learned my addr 172.21.15.37:0/2709774508 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:29.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f689f400640 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b59a650 0x558a8b5e68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f6897e00640 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b5e7120 0x558a8b59fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f689fe00640 1 -- 172.21.15.37:0/2709774508 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b59a650 msgr2=0x558a8b5e68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f689fe00640 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b59a650 0x558a8b5e68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f689fe00640 1 -- 172.21.15.37:0/2709774508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b5e7120 msgr2=0x558a8b59fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f689fe00640 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b5e7120 0x558a8b59fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f689fe00640 1 -- 172.21.15.37:0/2709774508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a8b430f80 con 0x558a8b5e7a40 2024-05-30T06:57:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f6897e00640 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b5e7120 0x558a8b59fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f689fe00640 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b5a00c0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f689801a4c0 tx=0x7f6898004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1386ef89b194efed server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f688cc00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:57:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f688cc00640 1 -- 172.21.15.37:0/2709774508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68980a58d0 con 0x558a8b5e7a40 2024-05-30T06:57:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f688cc00640 1 -- 172.21.15.37:0/2709774508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f68980c2b10 con 0x558a8b5e7a40 2024-05-30T06:57:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 1 -- 172.21.15.37:0/2709774508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6888026070 con 0x558a8b5e7a40 2024-05-30T06:57:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f688cc00640 1 -- 172.21.15.37:0/2709774508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f68980c2d10 con 0x558a8b5e7a40 2024-05-30T06:57:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 10 client.9285 fetch_fsmap learned FSMap version 74 2024-05-30T06:57:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 1 -- 172.21.15.37:0/2709774508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x558a8b3c4f00 con 0x558a8b5e7a40 2024-05-30T06:57:29.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f688cc00640 1 -- 172.21.15.37:0/2709774508 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6888026070 con 0x558a8b5e7a40 2024-05-30T06:57:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f688cc00640 1 -- 172.21.15.37:0/2709774508 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f68980c9050 con 0x558a8b5e7a40 2024-05-30T06:57:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 10 client.9285 fetch_fsmap finished waiting for FSMap version 74 2024-05-30T06:57:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 10 client.9285 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-30T06:57:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 20 client.9285 populate_metadata read hostname 'smithi037' 2024-05-30T06:57:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.37:6834/1475971506,v1:172.21.15.37:6835/1475971506] conn(0x558a8b5f6890 0x558a8b5f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 4 client.9285 mds_command: new command op to 9120 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T06:57:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f68a942f000 1 -- 172.21.15.37:0/2709774508 --> [v2:172.21.15.37:6834/1475971506,v1:172.21.15.37:6835/1475971506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a8b384bc0 con 0x558a8b5f6890 2024-05-30T06:57:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.539+0000 7f689f400640 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.37:6834/1475971506,v1:172.21.15.37:6835/1475971506] conn(0x558a8b5f6890 0x558a8b5f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f689f400640 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.37:6834/1475971506,v1:172.21.15.37:6835/1475971506] conn(0x558a8b5f6890 0x558a8b5f8c80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=216a602497f31da0 server_cookie=37da9e4d8434277e in_seq=0 out_seq=0 2024-05-30T06:57:29.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f688cc00640 10 client.9285 ms_handle_connect on v2:172.21.15.37:6834/1475971506 2024-05-30T06:57:29.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f688cc00640 1 -- 172.21.15.37:0/2709774508 <== mds.0 v2:172.21.15.37:6834/1475971506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558a8b384bc0 con 0x558a8b5f6890 2024-05-30T06:57:29.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f688cc00640 10 client.9285 handle_command_reply: tid=0 2024-05-30T06:57:29.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f68a942f000 1 client.9285 shutdown 2024-05-30T06:57:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f68a942f000 1 -- 172.21.15.37:0/2709774508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 msgr2=0x558a8b5a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f68a942f000 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b5a00c0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f689801a4c0 tx=0x7f6898004a50 comp rx=0 tx=0).stop 2024-05-30T06:57:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f68a942f000 1 -- 172.21.15.37:0/2709774508 shutdown_connections 2024-05-30T06:57:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f68a942f000 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.37:6834/1475971506,v1:172.21.15.37:6835/1475971506] conn(0x558a8b5f6890 0x558a8b5f8c80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f68a942f000 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b5a00c0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f68a942f000 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b5e7120 0x558a8b59fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f688cc00640 0 client.9285 ms_handle_reset on v2:172.21.15.37:6834/1475971506 2024-05-30T06:57:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f68a942f000 1 --2- 172.21.15.37:0/2709774508 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b59a650 0x558a8b5e68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f68a942f000 1 -- 172.21.15.37:0/2709774508 >> 172.21.15.37:0/2709774508 conn(0x558a8b5c7ec0 msgr2=0x558a8b5ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f68a942f000 1 -- 172.21.15.37:0/2709774508 shutdown_connections 2024-05-30T06:57:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f68a942f000 1 -- 172.21.15.37:0/2709774508 wait complete. 2024-05-30T06:57:29.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.543+0000 7f68a942f000 20 client.9285 trim_cache size 0 max 16384 2024-05-30T06:57:29.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.559+0000 7f68a942f000 1 Processor -- start 2024-05-30T06:57:29.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.559+0000 7f68a942f000 1 -- start start 2024-05-30T06:57:29.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 0x558a8b599100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7120 0x558a8b599640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b5f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68a0202f60 con 0x558a8b5e7a40 2024-05-30T06:57:29.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68a0168040 con 0x558a8b59a650 2024-05-30T06:57:29.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68a0151c50 con 0x558a8b5e7120 2024-05-30T06:57:29.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f689fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b5f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f689fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b5f8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53914/0 (socket says 172.21.15.37:53914) 2024-05-30T06:57:29.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f689fe00640 1 -- 172.21.15.37:0/242245279 learned_addr learned my addr 172.21.15.37:0/242245279 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f689f400640 1 --2- 172.21.15.37:0/242245279 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 0x558a8b599100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f6897e00640 1 --2- 172.21.15.37:0/242245279 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7120 0x558a8b599640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f689fe00640 1 -- 172.21.15.37:0/242245279 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7120 msgr2=0x558a8b599640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f689fe00640 1 --2- 172.21.15.37:0/242245279 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7120 0x558a8b599640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f689fe00640 1 -- 172.21.15.37:0/242245279 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 msgr2=0x558a8b599100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f689fe00640 1 --2- 172.21.15.37:0/242245279 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 0x558a8b599100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f689fe00640 1 -- 172.21.15.37:0/242245279 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a8b371e80 con 0x558a8b5e7a40 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f689f400640 1 --2- 172.21.15.37:0/242245279 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 0x558a8b599100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f689fe00640 1 --2- 172.21.15.37:0/242245279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b5f8c80 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f6898004b00 tx=0x7f68980a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e937e2ef06c9dc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f688f400640 1 -- 172.21.15.37:0/242245279 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68980a58d0 con 0x558a8b5e7a40 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f688f400640 1 -- 172.21.15.37:0/242245279 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68980a5a90 con 0x558a8b5e7a40 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f688f400640 1 -- 172.21.15.37:0/242245279 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6898003be0 con 0x558a8b5e7a40 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 -- 172.21.15.37:0/242245279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 msgr2=0x558a8b5f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 --2- 172.21.15.37:0/242245279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b5f8c80 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f6898004b00 tx=0x7f68980a7000 comp rx=0 tx=0).stop 2024-05-30T06:57:29.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 -- 172.21.15.37:0/242245279 shutdown_connections 2024-05-30T06:57:29.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 --2- 172.21.15.37:0/242245279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7a40 0x558a8b5f8c80 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 --2- 172.21.15.37:0/242245279 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7120 0x558a8b599640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 --2- 172.21.15.37:0/242245279 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 0x558a8b599100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 -- 172.21.15.37:0/242245279 >> 172.21.15.37:0/242245279 conn(0x558a8b5c7ec0 msgr2=0x558a8b5e5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:29.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 -- 172.21.15.37:0/242245279 shutdown_connections 2024-05-30T06:57:29.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 -- 172.21.15.37:0/242245279 wait complete. 2024-05-30T06:57:29.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 -- start start 2024-05-30T06:57:29.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.563+0000 7f68a942f000 1 Processor -- start 2024-05-30T06:57:29.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 0x558a8b5fb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7120 0x558a8b612810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7a40 0x558a8b612d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558a8b3ea730 con 0x558a8b5e7120 2024-05-30T06:57:29.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x558a8b3b79e0 con 0x558a8b59a650 2024-05-30T06:57:29.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x558a8b3efa50 con 0x558a8b5e7a40 2024-05-30T06:57:29.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 10 client.0 _ll_register_callbacks cb 0x7f6898009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:57:29.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f6897e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7120 0x558a8b612810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f6897e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7120 0x558a8b612810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53922/0 (socket says 172.21.15.37:53922) 2024-05-30T06:57:29.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f6897e00640 1 -- 172.21.15.37:0/2767189062 learned_addr learned my addr 172.21.15.37:0/2767189062 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:29.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f689f400640 1 --2- 172.21.15.37:0/2767189062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 0x558a8b5fb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f689fe00640 1 --2- 172.21.15.37:0/2767189062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7a40 0x558a8b612d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f6897e00640 1 -- 172.21.15.37:0/2767189062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7a40 msgr2=0x558a8b612d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f6897e00640 1 --2- 172.21.15.37:0/2767189062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7a40 0x558a8b612d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f6897e00640 1 -- 172.21.15.37:0/2767189062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 msgr2=0x558a8b5fb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f6897e00640 1 --2- 172.21.15.37:0/2767189062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 0x558a8b5fb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f6897e00640 1 -- 172.21.15.37:0/2767189062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a8b3b3b30 con 0x558a8b5e7120 2024-05-30T06:57:29.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f6897e00640 1 --2- 172.21.15.37:0/2767189062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7120 0x558a8b612810 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f6888007840 tx=0x7f6888004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be7a9c3fcd7b31d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:29.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f688cc00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:57:29.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f688cc00640 1 -- 172.21.15.37:0/2767189062 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888005fc0 con 0x558a8b5e7120 2024-05-30T06:57:29.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f688cc00640 1 -- 172.21.15.37:0/2767189062 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f6888036b30 con 0x558a8b5e7120 2024-05-30T06:57:29.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 -- 172.21.15.37:0/2767189062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558a8b3f8e40 con 0x558a8b5e7120 2024-05-30T06:57:29.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f688cc00640 1 -- 172.21.15.37:0/2767189062 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7f688801c020 con 0x558a8b5e7120 2024-05-30T06:57:29.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 10 client.9291 fetch_fsmap learned FSMap version 74 2024-05-30T06:57:29.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 -- 172.21.15.37:0/2767189062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x558a8b46c5b0 con 0x558a8b5e7120 2024-05-30T06:57:29.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f688cc00640 1 -- 172.21.15.37:0/2767189062 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558a8b3f8e40 con 0x558a8b5e7120 2024-05-30T06:57:29.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f688cc00640 1 -- 172.21.15.37:0/2767189062 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 74) ==== 3494+0+0 (secure 0 0 0) 0x7f6888033020 con 0x558a8b5e7120 2024-05-30T06:57:29.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 10 client.9291 fetch_fsmap finished waiting for FSMap version 74 2024-05-30T06:57:29.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 10 client.9291 resolve_mds: resolved name 'a' to daemon mds.a 2024-05-30T06:57:29.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 20 client.9291 populate_metadata read hostname 'smithi037' 2024-05-30T06:57:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 --2- 172.21.15.37:0/2767189062 >> [v2:172.21.15.37:6834/1475971506,v1:172.21.15.37:6835/1475971506] conn(0x558a8b656480 0x558a8b656860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 4 client.9291 mds_command: new command op to 9120 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T06:57:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 -- 172.21.15.37:0/2767189062 --> [v2:172.21.15.37:6834/1475971506,v1:172.21.15.37:6835/1475971506] -- command(tid 0: {"prefix": "status"}) -- 0x558a8b3f2cb0 con 0x558a8b656480 2024-05-30T06:57:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f689f400640 1 --2- 172.21.15.37:0/2767189062 >> [v2:172.21.15.37:6834/1475971506,v1:172.21.15.37:6835/1475971506] conn(0x558a8b656480 0x558a8b656860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f689f400640 1 --2- 172.21.15.37:0/2767189062 >> [v2:172.21.15.37:6834/1475971506,v1:172.21.15.37:6835/1475971506] conn(0x558a8b656480 0x558a8b656860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d32d1b67a0134b85 server_cookie=befe8b3af6d64128 in_seq=0 out_seq=0 2024-05-30T06:57:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f688cc00640 10 client.9291 ms_handle_connect on v2:172.21.15.37:6834/1475971506 2024-05-30T06:57:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f688cc00640 1 -- 172.21.15.37:0/2767189062 <== mds.0 v2:172.21.15.37:6834/1475971506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558a8b3f2cb0 con 0x558a8b656480 2024-05-30T06:57:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f688cc00640 10 client.9291 handle_command_reply: tid=0 2024-05-30T06:57:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 client.9291 shutdown 2024-05-30T06:57:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 -- 172.21.15.37:0/2767189062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7120 msgr2=0x558a8b612810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 --2- 172.21.15.37:0/2767189062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7120 0x558a8b612810 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f6888007840 tx=0x7f6888004740 comp rx=0 tx=0).stop 2024-05-30T06:57:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 -- 172.21.15.37:0/2767189062 shutdown_connections 2024-05-30T06:57:29.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 --2- 172.21.15.37:0/2767189062 >> [v2:172.21.15.37:6834/1475971506,v1:172.21.15.37:6835/1475971506] conn(0x558a8b656480 0x558a8b656860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 --2- 172.21.15.37:0/2767189062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x558a8b5e7a40 0x558a8b612d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 --2- 172.21.15.37:0/2767189062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a8b5e7120 0x558a8b612810 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 --2- 172.21.15.37:0/2767189062 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x558a8b59a650 0x558a8b5fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f688cc00640 0 client.9291 ms_handle_reset on v2:172.21.15.37:6834/1475971506 2024-05-30T06:57:29.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 -- 172.21.15.37:0/2767189062 >> 172.21.15.37:0/2767189062 conn(0x558a8b5c7ec0 msgr2=0x558a8b599100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:29.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 -- 172.21.15.37:0/2767189062 shutdown_connections 2024-05-30T06:57:29.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 1 -- 172.21.15.37:0/2767189062 wait complete. 2024-05-30T06:57:29.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a942f000 20 client.9291 trim_cache size 0 max 16384 2024-05-30T06:57:29.572 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:57:29.572 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:57:29.573 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-30T06:57:29.573 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9120, 2024-05-30T06:57:29.573 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-30T06:57:29.573 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-30T06:57:29.573 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-30T06:57:29.573 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.505926257, 2024-05-30T06:57:29.573 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 74, 2024-05-30T06:57:29.573 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 114, 2024-05-30T06:57:29.573 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 114, 2024-05-30T06:57:29.573 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 15.397924593000001 2024-05-30T06:57:29.573 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:57:29.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a6000640 1 -- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f687c069be0 msgr2=0x7f687c06c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.567+0000 7f68a6000640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f687c069be0 0x7f687c06c0a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f68a01fac70 tx=0x7f6888008040 comp rx=0 tx=0).stop 2024-05-30T06:57:29.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.571+0000 7f68a6000640 1 -- 172.21.15.37:0/1996768231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a006f5a0 msgr2=0x7f68a014b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.571+0000 7f68a6000640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a006f5a0 0x7f68a014b700 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f689000b410 tx=0x7f689000b8d0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.571+0000 7f68a6000640 1 -- 172.21.15.37:0/1996768231 shutdown_connections 2024-05-30T06:57:29.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.571+0000 7f68a6000640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f687c069be0 0x7f687c06c0a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.571+0000 7f68a6000640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a014fd10 0x7f68a01501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.571+0000 7f68a6000640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a0155da0 0x7f68a0168d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.571+0000 7f68a6000640 1 --2- 172.21.15.37:0/1996768231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68a006f5a0 0x7f68a014b700 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.571+0000 7f68a6000640 1 -- 172.21.15.37:0/1996768231 >> 172.21.15.37:0/1996768231 conn(0x7f68a006bf60 msgr2=0x7f68a006e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.571+0000 7f68a6000640 1 -- 172.21.15.37:0/1996768231 shutdown_connections 2024-05-30T06:57:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.571+0000 7f68a6000640 1 -- 172.21.15.37:0/1996768231 wait complete. 2024-05-30T06:57:29.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T06:57:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.731+0000 7f1ecea00640 1 Processor -- start 2024-05-30T06:57:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.731+0000 7f1ecea00640 1 -- start start 2024-05-30T06:57:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.731+0000 7f1ecea00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1ec80b55a0 0x7f1ec80b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.731+0000 7f1ecea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ec815fb30 0x7f1ec80aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.731+0000 7f1ecea00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec8162f70 con 0x7f1ec806d080 2024-05-30T06:57:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.731+0000 7f1ecea00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1ec80b5ec0 con 0x7f1ec80b55a0 2024-05-30T06:57:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.731+0000 7f1ecea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec8163210 con 0x7f1ec815fb30 2024-05-30T06:57:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.731+0000 7f1ebf400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1ec806d080 0x7f1ec80b4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42102/0 (socket says 172.21.15.37:42102) 2024-05-30T06:57:29.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.731+0000 7f1ebf400640 1 -- 172.21.15.37:0/602565613 learned_addr learned my addr 172.21.15.37:0/602565613 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:29.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.731+0000 7f1ec7e00640 1 --2- 172.21.15.37:0/602565613 >> v2:172.21.15.105:3300/0 conn(0x7f1ec80b55a0 0x7f1ec80b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.731+0000 7f1ecca00640 1 --2- 172.21.15.37:0/602565613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ec815fb30 0x7f1ec80aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.731+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2419657145 0 0) 0x7f1ec8162f70 con 0x7f1ec806d080 2024-05-30T06:57:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1eac003530 con 0x7f1ec806d080 2024-05-30T06:57:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3034329295 0 0) 0x7f1eac003530 con 0x7f1ec806d080 2024-05-30T06:57:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ec815fb30 msgr2=0x7f1ec80aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 --2- 172.21.15.37:0/602565613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ec815fb30 0x7f1ec80aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 >> v2:172.21.15.105:3300/0 conn(0x7f1ec80b55a0 msgr2=0x7f1ec80b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 --2- 172.21.15.37:0/602565613 >> v2:172.21.15.105:3300/0 conn(0x7f1ec80b55a0 0x7f1ec80b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec80b4040 con 0x7f1ec806d080 2024-05-30T06:57:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f1eb8001680 con 0x7f1ec806d080 2024-05-30T06:57:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7e00640 1 --2- 172.21.15.37:0/602565613 >> v2:172.21.15.105:3300/0 conn(0x7f1ec80b55a0 0x7f1ec80b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:57:29.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 >> v1:172.21.15.37:6789/0 conn(0x7f1ec806d080 legacy=0x7f1ec80b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 --2- 172.21.15.37:0/602565613 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eac0039c0 0x7f1eac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 --2- 172.21.15.37:0/602565613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac004810 0x7f1eac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 --2- 172.21.15.37:0/602565613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ec815fb30 0x7f1eac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec80b5ec0 con 0x7f1eac004810 2024-05-30T06:57:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8163210 con 0x7f1eac0039c0 2024-05-30T06:57:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1eac00b9d0 con 0x7f1ec815fb30 2024-05-30T06:57:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ebf400640 1 --2- 172.21.15.37:0/602565613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac004810 0x7f1eac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7e00640 1 --2- 172.21.15.37:0/602565613 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eac0039c0 0x7f1eac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ecca00640 1 --2- 172.21.15.37:0/602565613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ec815fb30 0x7f1eac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ebf400640 1 -- 172.21.15.37:0/602565613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ec815fb30 msgr2=0x7f1eac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ebf400640 1 --2- 172.21.15.37:0/602565613 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ec815fb30 0x7f1eac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ebf400640 1 -- 172.21.15.37:0/602565613 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eac0039c0 msgr2=0x7f1eac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:29.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ebf400640 1 --2- 172.21.15.37:0/602565613 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eac0039c0 0x7f1eac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ebf400640 1 -- 172.21.15.37:0/602565613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eac003530 con 0x7f1eac004810 2024-05-30T06:57:29.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ec7e00640 1 --2- 172.21.15.37:0/602565613 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1eac0039c0 0x7f1eac003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:29.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.735+0000 7f1ebf400640 1 --2- 172.21.15.37:0/602565613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac004810 0x7f1eac004c90 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f1ec806d4c0 tx=0x7f1eb801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c3da4c0155bedd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8007d80 con 0x7f1eac004810 2024-05-30T06:57:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb80a9020 con 0x7f1eac004810 2024-05-30T06:57:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ec7400640 1 -- 172.21.15.37:0/602565613 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8005b00 con 0x7f1eac004810 2024-05-30T06:57:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 -- 172.21.15.37:0/602565613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac004810 msgr2=0x7f1eac004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 --2- 172.21.15.37:0/602565613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac004810 0x7f1eac004c90 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f1ec806d4c0 tx=0x7f1eb801cc30 comp rx=0 tx=0).stop 2024-05-30T06:57:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecca00640 1 -- 172.21.15.37:0/602565613 reap_dead start 2024-05-30T06:57:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 -- 172.21.15.37:0/602565613 shutdown_connections 2024-05-30T06:57:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 -- 172.21.15.37:0/602565613 >> 172.21.15.37:0/602565613 conn(0x7f1ec8073680 msgr2=0x7f1ec806b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 -- 172.21.15.37:0/602565613 shutdown_connections 2024-05-30T06:57:29.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 -- 172.21.15.37:0/602565613 wait complete. 2024-05-30T06:57:29.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 Processor -- start 2024-05-30T06:57:29.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 -- start start 2024-05-30T06:57:29.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac004810 0x7f1ec8163450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ec81fb930 0x7f1ec8141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec8158830 0x7f1ec8158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec81697c0 con 0x7f1eac004810 2024-05-30T06:57:29.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8169640 con 0x7f1ec8158830 2024-05-30T06:57:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec8169940 con 0x7f1ec81fb930 2024-05-30T06:57:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ec7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac004810 0x7f1ec8163450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ec7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac004810 0x7f1ec8163450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53944/0 (socket says 172.21.15.37:53944) 2024-05-30T06:57:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ec7e00640 1 -- 172.21.15.37:0/2955981381 learned_addr learned my addr 172.21.15.37:0/2955981381 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ebf400640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ec81fb930 0x7f1ec8141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.739+0000 7f1ecca00640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec8158830 0x7f1ec8158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ec7e00640 1 -- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ec81fb930 msgr2=0x7f1ec8141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ec7e00640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ec81fb930 0x7f1ec8141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ec7e00640 1 -- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec8158830 msgr2=0x7f1ec8158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ec7e00640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec8158830 0x7f1ec8158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ec7e00640 1 -- 172.21.15.37:0/2955981381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec81f79d0 con 0x7f1eac004810 2024-05-30T06:57:29.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ec7e00640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac004810 0x7f1ec8163450 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0004660 tx=0x7f1eb0011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:29.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ec4c00640 1 -- 172.21.15.37:0/2955981381 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0009e60 con 0x7f1eac004810 2024-05-30T06:57:29.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ec4c00640 1 -- 172.21.15.37:0/2955981381 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb000fbd0 con 0x7f1eac004810 2024-05-30T06:57:29.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ec4c00640 1 -- 172.21.15.37:0/2955981381 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0015460 con 0x7f1eac004810 2024-05-30T06:57:29.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ecea00640 1 -- 172.21.15.37:0/2955981381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec8141e90 con 0x7f1eac004810 2024-05-30T06:57:29.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ecea00640 1 -- 172.21.15.37:0/2955981381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec81f7c90 con 0x7f1eac004810 2024-05-30T06:57:29.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ecea00640 1 -- 172.21.15.37:0/2955981381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec8068b20 con 0x7f1eac004810 2024-05-30T06:57:29.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ec4c00640 1 -- 172.21.15.37:0/2955981381 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f1eb0015600 con 0x7f1eac004810 2024-05-30T06:57:29.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.743+0000 7f1ec4c00640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1ea4069be0 0x7f1ea406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:29.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.747+0000 7f1ec4c00640 1 -- 172.21.15.37:0/2955981381 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f1eb00860d0 con 0x7f1eac004810 2024-05-30T06:57:29.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.747+0000 7f1ebf400640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1ea4069be0 0x7f1ea406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:29.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.747+0000 7f1ebf400640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1ea4069be0 0x7f1ea406c0a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80aa000 tx=0x7f1eb8001a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:29.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.747+0000 7f1ec4c00640 1 -- 172.21.15.37:0/2955981381 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1eb0019030 con 0x7f1eac004810 2024-05-30T06:57:29.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ecea00640 1 -- 172.21.15.37:0/2955981381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1ec815e510 con 0x7f1eac004810 2024-05-30T06:57:29.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ec4c00640 1 -- 172.21.15.37:0/2955981381 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) ==== 53+0+73 (secure 0 0 0) 0x7f1eb0057aa0 con 0x7f1eac004810 2024-05-30T06:57:29.954 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T06:57:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ecea00640 1 -- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1ea4069be0 msgr2=0x7f1ea406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ecea00640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1ea4069be0 0x7f1ea406c0a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1eb80aa000 tx=0x7f1eb8001a50 comp rx=0 tx=0).stop 2024-05-30T06:57:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ecea00640 1 -- 172.21.15.37:0/2955981381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac004810 msgr2=0x7f1ec8163450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ecea00640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac004810 0x7f1ec8163450 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0004660 tx=0x7f1eb0011d60 comp rx=0 tx=0).stop 2024-05-30T06:57:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ecea00640 1 -- 172.21.15.37:0/2955981381 shutdown_connections 2024-05-30T06:57:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ecea00640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1ea4069be0 0x7f1ea406c0a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ecea00640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ec8158830 0x7f1ec8158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ecea00640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ec81fb930 0x7f1ec8141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ecea00640 1 --2- 172.21.15.37:0/2955981381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1eac004810 0x7f1ec8163450 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ecea00640 1 -- 172.21.15.37:0/2955981381 >> 172.21.15.37:0/2955981381 conn(0x7f1ec8073680 msgr2=0x7f1ec806fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ecea00640 1 -- 172.21.15.37:0/2955981381 shutdown_connections 2024-05-30T06:57:29.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:29.955+0000 7f1ecea00640 1 -- 172.21.15.37:0/2955981381 wait complete. 2024-05-30T06:57:29.975 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-30T06:57:29.975 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T06:57:29.975 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-30T06:57:29.975 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T06:57:29.975 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T06:57:29.975 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-30T06:57:29.975 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-30T06:57:29.975 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T06:57:29.975 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:57:29.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:57:29.976 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-30T06:57:29.985 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:57:29.985 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:57:29.985 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:57:29.985 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:57:29.985 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-30T06:57:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:57:29.986 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:57:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:57:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-30T06:57:29.986 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T06:57:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:57:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-30T06:57:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T06:57:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41554sec preferred_lft 41554sec 2024-05-30T06:57:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-05-30T06:57:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:57:29.986 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:57:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:30:63:12:21 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T06:57:29.987 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:57:29.988 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:57:29.988 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T06:57:29.988 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T06:57:29.988 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:57:29.988 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:57:29.988 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T06:57:29.988 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T06:57:29.988 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:57:29.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:57:29.988 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T06:57:30.047 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-30T06:57:30.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:57:30.049 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-30T06:57:30.102 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-30T06:57:30.102 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T06:57:30.102 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T06:57:30.102 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T06:57:30.102 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T06:57:30.102 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T06:57:30.103 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:57:30.103 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:57:30.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T06:57:30.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T06:57:30.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T06:57:30.103 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:57:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:57:30.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:57:30.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:57:30.241 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T06:57:30.250 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T06:57:30.250 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T06:57:30.251 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:57:30.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:57:30.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-30T06:57:30.312 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:57:30.312 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T06:57:30.360 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:57:30.360 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:57:30.360 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:57:30.408 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T06:57:30.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:57:30.408 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:57:30.497 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:57:30.497 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:57:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:57:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:57:30.510 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-05-30T06:57:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@393250aa-2b42-4955-adf1-f790b8ba4d8c.cephfs=/ 2024-05-30T06:57:30.511 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-05-30T06:57:30.515 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T06:57:30.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:57:30.515 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:57:30.535 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:57:30.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:57:30.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:57:30.645 INFO:teuthology.orchestra.run.smithi037.stdout:client7535 2024-05-30T06:57:30.645 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:57:30.645 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:57:30.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T06:57:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.839+0000 7f161e600640 1 Processor -- start 2024-05-30T06:57:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.839+0000 7f161e600640 1 -- start start 2024-05-30T06:57:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f161e600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1618159490 0x7f1618072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f161e600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1618072c90 0x7f16180cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f161e600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16180730a0 con 0x7f16180702d0 2024-05-30T06:57:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f161e600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1618162800 con 0x7f1618159490 2024-05-30T06:57:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f161e600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f16180d06e0 con 0x7f1618072c90 2024-05-30T06:57:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f1617400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1618159490 0x7f1618072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f1617400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1618159490 0x7f1618072750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53946/0 (socket says 172.21.15.37:53946) 2024-05-30T06:57:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f1617400640 1 -- 172.21.15.37:0/3324638924 learned_addr learned my addr 172.21.15.37:0/3324638924 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f1617e00640 1 --2- 172.21.15.37:0/3324638924 >> v2:172.21.15.105:3300/0 conn(0x7f1618072c90 0x7f16180cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f1617400640 1 -- 172.21.15.37:0/3324638924 >> v2:172.21.15.105:3300/0 conn(0x7f1618072c90 msgr2=0x7f16180cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f1617400640 1 --2- 172.21.15.37:0/3324638924 >> v2:172.21.15.105:3300/0 conn(0x7f1618072c90 0x7f16180cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:30.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f1617400640 1 -- 172.21.15.37:0/3324638924 >> v1:172.21.15.105:6789/0 conn(0x7f16180702d0 legacy=0x7f161815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:30.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f1617400640 1 -- 172.21.15.37:0/3324638924 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1618162a50 con 0x7f1618159490 2024-05-30T06:57:30.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f1617400640 1 --2- 172.21.15.37:0/3324638924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1618159490 0x7f1618072750 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f16180d0d20 tx=0x7f160801c1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7817566eaad104 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:30.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.843+0000 7f1616a00640 1 -- 172.21.15.37:0/3324638924 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16080b0070 con 0x7f1618159490 2024-05-30T06:57:30.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f1616a00640 1 -- 172.21.15.37:0/3324638924 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16080ab600 con 0x7f1618159490 2024-05-30T06:57:30.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f1616a00640 1 -- 172.21.15.37:0/3324638924 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1618163740 con 0x7f1618159490 2024-05-30T06:57:30.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 -- 172.21.15.37:0/3324638924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1618159490 msgr2=0x7f1618072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:30.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 --2- 172.21.15.37:0/3324638924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1618159490 0x7f1618072750 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f16180d0d20 tx=0x7f160801c1c0 comp rx=0 tx=0).stop 2024-05-30T06:57:30.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 -- 172.21.15.37:0/3324638924 shutdown_connections 2024-05-30T06:57:30.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 --2- 172.21.15.37:0/3324638924 >> v2:172.21.15.105:3300/0 conn(0x7f1618072c90 0x7f16180cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:30.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 --2- 172.21.15.37:0/3324638924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1618159490 0x7f1618072750 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:30.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 -- 172.21.15.37:0/3324638924 >> 172.21.15.37:0/3324638924 conn(0x7f16180d0d50 msgr2=0x7f16180d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:30.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 -- 172.21.15.37:0/3324638924 shutdown_connections 2024-05-30T06:57:30.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 -- 172.21.15.37:0/3324638924 wait complete. 2024-05-30T06:57:30.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 Processor -- start 2024-05-30T06:57:30.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 -- start start 2024-05-30T06:57:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f16180702d0 0x7f16180b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1618072c90 0x7f16181506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1618159490 0x7f1618150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f161816bf30 con 0x7f1618159490 2024-05-30T06:57:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f161816bdb0 con 0x7f1618072c90 2024-05-30T06:57:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f161e600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f161816c0b0 con 0x7f16180702d0 2024-05-30T06:57:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f1617e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1618159490 0x7f1618150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f1617e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1618159490 0x7f1618150bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53960/0 (socket says 172.21.15.37:53960) 2024-05-30T06:57:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f1617e00640 1 -- 172.21.15.37:0/2583586392 learned_addr learned my addr 172.21.15.37:0/2583586392 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f1617400640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f16180702d0 0x7f16180b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f160ea00640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1618072c90 0x7f16181506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f1617e00640 1 -- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f16180702d0 msgr2=0x7f16180b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f1617e00640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f16180702d0 0x7f16180b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f1617e00640 1 -- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1618072c90 msgr2=0x7f16181506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f1617e00640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1618072c90 0x7f16181506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f1617e00640 1 -- 172.21.15.37:0/2583586392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16181512c0 con 0x7f1618159490 2024-05-30T06:57:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.847+0000 7f160ea00640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1618072c90 0x7f16181506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.851+0000 7f1617e00640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1618159490 0x7f1618150bf0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f1610007e40 tx=0x7f161000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.851+0000 7f160fe00640 1 -- 172.21.15.37:0/2583586392 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610014620 con 0x7f1618159490 2024-05-30T06:57:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.851+0000 7f161e600640 1 -- 172.21.15.37:0/2583586392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16181515a0 con 0x7f1618159490 2024-05-30T06:57:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.851+0000 7f161e600640 1 -- 172.21.15.37:0/2583586392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16180b0d40 con 0x7f1618159490 2024-05-30T06:57:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.851+0000 7f160fe00640 1 -- 172.21.15.37:0/2583586392 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1610019070 con 0x7f1618159490 2024-05-30T06:57:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.851+0000 7f160fe00640 1 -- 172.21.15.37:0/2583586392 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16100149c0 con 0x7f1618159490 2024-05-30T06:57:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.851+0000 7f161e600640 1 -- 172.21.15.37:0/2583586392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f00052a0 con 0x7f1618159490 2024-05-30T06:57:30.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.851+0000 7f160fe00640 1 -- 172.21.15.37:0/2583586392 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f1610014b60 con 0x7f1618159490 2024-05-30T06:57:30.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.851+0000 7f160fe00640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f15f4069bb0 0x7f15f406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:30.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.855+0000 7f160fe00640 1 -- 172.21.15.37:0/2583586392 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f1610086ef0 con 0x7f1618159490 2024-05-30T06:57:30.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.855+0000 7f1617400640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f15f4069bb0 0x7f15f406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:30.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.855+0000 7f1617400640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f15f4069bb0 0x7f15f406c070 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f16080ad000 tx=0x7f1608008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:30.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:30.855+0000 7f160fe00640 1 -- 172.21.15.37:0/2583586392 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1610058f10 con 0x7f1618159490 2024-05-30T06:57:31.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.055+0000 7f161e600640 1 -- 172.21.15.37:0/2583586392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f15f0005590 con 0x7f1618159490 2024-05-30T06:57:31.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.583+0000 7f160fe00640 1 -- 172.21.15.37:0/2583586392 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v75) ==== 136+0+0 (secure 0 0 0) 0x7f1610058810 con 0x7f1618159490 2024-05-30T06:57:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.583+0000 7f161e600640 1 -- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f15f4069bb0 msgr2=0x7f15f406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.583+0000 7f161e600640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f15f4069bb0 0x7f15f406c070 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f16080ad000 tx=0x7f1608008040 comp rx=0 tx=0).stop 2024-05-30T06:57:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.583+0000 7f161e600640 1 -- 172.21.15.37:0/2583586392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1618159490 msgr2=0x7f1618150bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.583+0000 7f161e600640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1618159490 0x7f1618150bf0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f1610007e40 tx=0x7f161000e4b0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.587+0000 7f161e600640 1 -- 172.21.15.37:0/2583586392 shutdown_connections 2024-05-30T06:57:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.587+0000 7f161e600640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1618159490 0x7f1618150bf0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.587+0000 7f161e600640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f15f4069bb0 0x7f15f406c070 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.587+0000 7f161e600640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1618072c90 0x7f16181506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.587+0000 7f161e600640 1 --2- 172.21.15.37:0/2583586392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f16180702d0 0x7f16180b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.587+0000 7f161e600640 1 -- 172.21.15.37:0/2583586392 >> 172.21.15.37:0/2583586392 conn(0x7f16180d0d50 msgr2=0x7f161806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.587+0000 7f161e600640 1 -- 172.21.15.37:0/2583586392 shutdown_connections 2024-05-30T06:57:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.587+0000 7f161e600640 1 -- 172.21.15.37:0/2583586392 wait complete. 2024-05-30T06:57:31.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:57:31.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f257d400640 1 Processor -- start 2024-05-30T06:57:31.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f257d400640 1 -- start start 2024-05-30T06:57:31.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f257d400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257809aa60 0x7f257806cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:31.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f257d400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f257809ae40 0x7f257815f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:31.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f257d400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f257815fed0 0x7f25781626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:31.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f257d400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f257806d380 con 0x7f257815fed0 2024-05-30T06:57:31.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f257d400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f257806d660 con 0x7f257809ae40 2024-05-30T06:57:31.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f257d400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f257806d940 con 0x7f257809aa60 2024-05-30T06:57:31.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f2577200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f257815fed0 0x7f25781626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:31.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f2577200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f257815fed0 0x7f25781626f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53968/0 (socket says 172.21.15.37:53968) 2024-05-30T06:57:31.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f2577200640 1 -- 172.21.15.37:0/424239453 learned_addr learned my addr 172.21.15.37:0/424239453 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:31.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f2576800640 1 --2- 172.21.15.37:0/424239453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257809aa60 0x7f257806cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:31.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f256fe00640 1 --2- 172.21.15.37:0/424239453 >> v2:172.21.15.105:3300/0 conn(0x7f257809ae40 0x7f257815f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:31.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f2577200640 1 -- 172.21.15.37:0/424239453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257809aa60 msgr2=0x7f257806cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:31.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f2577200640 1 --2- 172.21.15.37:0/424239453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257809aa60 0x7f257806cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f2577200640 1 -- 172.21.15.37:0/424239453 >> v2:172.21.15.105:3300/0 conn(0x7f257809ae40 msgr2=0x7f257815f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:31.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f2577200640 1 --2- 172.21.15.37:0/424239453 >> v2:172.21.15.105:3300/0 conn(0x7f257809ae40 0x7f257815f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f2577200640 1 -- 172.21.15.37:0/424239453 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257806dc20 con 0x7f257815fed0 2024-05-30T06:57:31.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f256fe00640 1 --2- 172.21.15.37:0/424239453 >> v2:172.21.15.105:3300/0 conn(0x7f257809ae40 0x7f257815f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:31.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.751+0000 7f2576800640 1 --2- 172.21.15.37:0/424239453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257809aa60 0x7f257806cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:31.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.755+0000 7f2577200640 1 --2- 172.21.15.37:0/424239453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257815fed0 0x7f25781626f0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f25780697b0 tx=0x7f257001c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8156b45bc15d4529 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:31.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.755+0000 7f2575e00640 1 -- 172.21.15.37:0/424239453 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25700ac020 con 0x7f257815fed0 2024-05-30T06:57:31.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.755+0000 7f2575e00640 1 -- 172.21.15.37:0/424239453 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25700a6440 con 0x7f257815fed0 2024-05-30T06:57:31.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.755+0000 7f2575e00640 1 -- 172.21.15.37:0/424239453 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25700a6810 con 0x7f257815fed0 2024-05-30T06:57:31.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.755+0000 7f257d400640 1 -- 172.21.15.37:0/424239453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257815fed0 msgr2=0x7f25781626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:31.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.755+0000 7f257d400640 1 --2- 172.21.15.37:0/424239453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257815fed0 0x7f25781626f0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f25780697b0 tx=0x7f257001c6a0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.755+0000 7f257d400640 1 -- 172.21.15.37:0/424239453 shutdown_connections 2024-05-30T06:57:31.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.755+0000 7f257d400640 1 --2- 172.21.15.37:0/424239453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257815fed0 0x7f25781626f0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.755+0000 7f257d400640 1 --2- 172.21.15.37:0/424239453 >> v2:172.21.15.105:3300/0 conn(0x7f257809ae40 0x7f257815f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.755+0000 7f257d400640 1 --2- 172.21.15.37:0/424239453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257809aa60 0x7f257806cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.755+0000 7f257d400640 1 -- 172.21.15.37:0/424239453 >> 172.21.15.37:0/424239453 conn(0x7f25780b4190 msgr2=0x7f25780b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:31.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.755+0000 7f257d400640 1 -- 172.21.15.37:0/424239453 shutdown_connections 2024-05-30T06:57:31.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.755+0000 7f257d400640 1 -- 172.21.15.37:0/424239453 wait complete. 2024-05-30T06:57:31.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f257d400640 1 Processor -- start 2024-05-30T06:57:31.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f257d400640 1 -- start start 2024-05-30T06:57:31.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f257d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257809aa60 0x7f257815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:31.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f257d400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257809ae40 0x7f257814f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:31.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f257d400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f257815fed0 0x7f2578150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:31.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f257d400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f25780d11a0 con 0x7f257809aa60 2024-05-30T06:57:31.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f257d400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f25780d1020 con 0x7f257815fed0 2024-05-30T06:57:31.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f257d400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f25780d1320 con 0x7f257809ae40 2024-05-30T06:57:31.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f2576800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257809aa60 0x7f257815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:31.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f2576800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257809aa60 0x7f257815cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53984/0 (socket says 172.21.15.37:53984) 2024-05-30T06:57:31.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f2576800640 1 -- 172.21.15.37:0/3852334514 learned_addr learned my addr 172.21.15.37:0/3852334514 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:31.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f256fe00640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257809ae40 0x7f257814f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:31.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f2577200640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f257815fed0 0x7f2578150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:31.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f2576800640 1 -- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257809ae40 msgr2=0x7f257814f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:31.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f2576800640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257809ae40 0x7f257814f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f2576800640 1 -- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f257815fed0 msgr2=0x7f2578150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:31.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f2576800640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f257815fed0 0x7f2578150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f2576800640 1 -- 172.21.15.37:0/3852334514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25781525a0 con 0x7f257809aa60 2024-05-30T06:57:31.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f2576800640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257809aa60 0x7f257815cf90 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f256800c7c0 tx=0x7f256800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:31.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f256ea00640 1 -- 172.21.15.37:0/3852334514 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2568015070 con 0x7f257809aa60 2024-05-30T06:57:31.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f256ea00640 1 -- 172.21.15.37:0/3852334514 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2568007a30 con 0x7f257809aa60 2024-05-30T06:57:31.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f256ea00640 1 -- 172.21.15.37:0/3852334514 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2568007e00 con 0x7f257809aa60 2024-05-30T06:57:31.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f257d400640 1 -- 172.21.15.37:0/3852334514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2578152880 con 0x7f257809aa60 2024-05-30T06:57:31.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.759+0000 7f257d400640 1 -- 172.21.15.37:0/3852334514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2578152e40 con 0x7f257809aa60 2024-05-30T06:57:31.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.763+0000 7f257d400640 1 -- 172.21.15.37:0/3852334514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2578068bc0 con 0x7f257809aa60 2024-05-30T06:57:31.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.763+0000 7f256ea00640 1 -- 172.21.15.37:0/3852334514 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f2568018070 con 0x7f257809aa60 2024-05-30T06:57:31.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.763+0000 7f256ea00640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2554069bb0 0x7f255406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:31.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.763+0000 7f256ea00640 1 -- 172.21.15.37:0/3852334514 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f25680856b0 con 0x7f257809aa60 2024-05-30T06:57:31.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.763+0000 7f256fe00640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2554069bb0 0x7f255406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:31.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.763+0000 7f256fe00640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2554069bb0 0x7f255406c070 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f257806c5b0 tx=0x7f2560008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:31.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.767+0000 7f256ea00640 1 -- 172.21.15.37:0/3852334514 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2568056ff0 con 0x7f257809aa60 2024-05-30T06:57:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.955+0000 7f257d400640 1 -- 172.21.15.37:0/3852334514 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f2578162a10 con 0x7f2554069bb0 2024-05-30T06:57:31.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.955+0000 7f256ea00640 1 -- 172.21.15.37:0/3852334514 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f2578162a10 con 0x7f2554069bb0 2024-05-30T06:57:31.955 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:57:31.956 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:57:31.956 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:57:31.956 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:57:31.956 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:57:31.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.959+0000 7f257d400640 1 -- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2554069bb0 msgr2=0x7f255406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:31.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.959+0000 7f257d400640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2554069bb0 0x7f255406c070 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f257806c5b0 tx=0x7f2560008040 comp rx=0 tx=0).stop 2024-05-30T06:57:31.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.959+0000 7f257d400640 1 -- 172.21.15.37:0/3852334514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257809aa60 msgr2=0x7f257815cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:31.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.959+0000 7f257d400640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257809aa60 0x7f257815cf90 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f256800c7c0 tx=0x7f256800cc80 comp rx=0 tx=0).stop 2024-05-30T06:57:31.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.959+0000 7f257d400640 1 -- 172.21.15.37:0/3852334514 shutdown_connections 2024-05-30T06:57:31.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.959+0000 7f257d400640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2554069bb0 0x7f255406c070 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.959+0000 7f257d400640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f257815fed0 0x7f2578150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.959+0000 7f257d400640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f257809ae40 0x7f257814f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.959+0000 7f257d400640 1 --2- 172.21.15.37:0/3852334514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f257809aa60 0x7f257815cf90 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:31.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.959+0000 7f257d400640 1 -- 172.21.15.37:0/3852334514 >> 172.21.15.37:0/3852334514 conn(0x7f25780b4190 msgr2=0x7f25780b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:31.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.959+0000 7f257d400640 1 -- 172.21.15.37:0/3852334514 shutdown_connections 2024-05-30T06:57:31.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:31.959+0000 7f257d400640 1 -- 172.21.15.37:0/3852334514 wait complete. 2024-05-30T06:57:31.978 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:57:32.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa59d000640 1 Processor -- start 2024-05-30T06:57:32.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa59d000640 1 -- start start 2024-05-30T06:57:32.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa59d000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa59815f210 0x7fa598072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa59d000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5980cec10 0x7fa598072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa59d000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa598163020 con 0x7fa59815c890 2024-05-30T06:57:32.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa59d000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa598163300 con 0x7fa5980cec10 2024-05-30T06:57:32.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa59d000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa5981635e0 con 0x7fa59815f210 2024-05-30T06:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa596800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5980cec10 0x7fa598072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa596800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5980cec10 0x7fa598072c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53988/0 (socket says 172.21.15.37:53988) 2024-05-30T06:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa596800640 1 -- 172.21.15.37:0/524254892 learned_addr learned my addr 172.21.15.37:0/524254892 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa595400640 1 --2- 172.21.15.37:0/524254892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa59815f210 0x7fa598072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa596800640 1 -- 172.21.15.37:0/524254892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa59815f210 msgr2=0x7fa598072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa596800640 1 --2- 172.21.15.37:0/524254892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa59815f210 0x7fa598072750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa596800640 1 -- 172.21.15.37:0/524254892 >> v1:172.21.15.105:6789/0 conn(0x7fa59815c890 legacy=0x7fa598162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.123+0000 7fa596800640 1 -- 172.21.15.37:0/524254892 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59806ba00 con 0x7fa5980cec10 2024-05-30T06:57:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.127+0000 7fa596800640 1 --2- 172.21.15.37:0/524254892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5980cec10 0x7fa598072c90 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fa590009e50 tx=0x7fa59001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29413e4d4fbe16df server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.127+0000 7fa594a00640 1 -- 172.21.15.37:0/524254892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5900a5660 con 0x7fa5980cec10 2024-05-30T06:57:32.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.127+0000 7fa594a00640 1 -- 172.21.15.37:0/524254892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5900a5800 con 0x7fa5980cec10 2024-05-30T06:57:32.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.127+0000 7fa594a00640 1 -- 172.21.15.37:0/524254892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5900a5bd0 con 0x7fa5980cec10 2024-05-30T06:57:32.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.127+0000 7fa59d000640 1 -- 172.21.15.37:0/524254892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5980cec10 msgr2=0x7fa598072c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.127+0000 7fa59d000640 1 --2- 172.21.15.37:0/524254892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5980cec10 0x7fa598072c90 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fa590009e50 tx=0x7fa59001c9a0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.127+0000 7fa59d000640 1 -- 172.21.15.37:0/524254892 shutdown_connections 2024-05-30T06:57:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.127+0000 7fa59d000640 1 --2- 172.21.15.37:0/524254892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5980cec10 0x7fa598072c90 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.127+0000 7fa59d000640 1 --2- 172.21.15.37:0/524254892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa59815f210 0x7fa598072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.127+0000 7fa59d000640 1 -- 172.21.15.37:0/524254892 >> 172.21.15.37:0/524254892 conn(0x7fa5980b2ac0 msgr2=0x7fa5980b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.127+0000 7fa59d000640 1 -- 172.21.15.37:0/524254892 shutdown_connections 2024-05-30T06:57:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.127+0000 7fa59d000640 1 -- 172.21.15.37:0/524254892 wait complete. 2024-05-30T06:57:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.127+0000 7fa59d000640 1 Processor -- start 2024-05-30T06:57:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa59d000640 1 -- start start 2024-05-30T06:57:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa59d000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5980cec10 0x7fa5981560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa59d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa59815c890 0x7fa59815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa59d000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa59815f210 0x7fa59815e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa59d000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa59806cda0 con 0x7fa59815c890 2024-05-30T06:57:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa59d000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa59806cc20 con 0x7fa5980cec10 2024-05-30T06:57:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa59d000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa59806cf20 con 0x7fa59815f210 2024-05-30T06:57:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa595400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa59815c890 0x7fa59815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa595400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa59815c890 0x7fa59815a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53994/0 (socket says 172.21.15.37:53994) 2024-05-30T06:57:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa595400640 1 -- 172.21.15.37:0/1630183110 learned_addr learned my addr 172.21.15.37:0/1630183110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa595e00640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5980cec10 0x7fa5981560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa596800640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa59815f210 0x7fa59815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa595400640 1 -- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa59815f210 msgr2=0x7fa59815e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa595400640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa59815f210 0x7fa59815e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa595400640 1 -- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5980cec10 msgr2=0x7fa5981560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa595400640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5980cec10 0x7fa5981560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa595400640 1 -- 172.21.15.37:0/1630183110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa598157760 con 0x7fa59815c890 2024-05-30T06:57:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa595e00640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5980cec10 0x7fa5981560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa595400640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa59815c890 0x7fa59815a070 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fa58400d7d0 tx=0x7fa58400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa58e000640 1 -- 172.21.15.37:0/1630183110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58400b6c0 con 0x7fa59815c890 2024-05-30T06:57:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa58e000640 1 -- 172.21.15.37:0/1630183110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa584019070 con 0x7fa59815c890 2024-05-30T06:57:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa58e000640 1 -- 172.21.15.37:0/1630183110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58400baa0 con 0x7fa59815c890 2024-05-30T06:57:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa59d000640 1 -- 172.21.15.37:0/1630183110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5981566c0 con 0x7fa59815c890 2024-05-30T06:57:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa59d000640 1 -- 172.21.15.37:0/1630183110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa598156c80 con 0x7fa59815c890 2024-05-30T06:57:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.131+0000 7fa59d000640 1 -- 172.21.15.37:0/1630183110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa598068bc0 con 0x7fa59815c890 2024-05-30T06:57:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.135+0000 7fa58e000640 1 -- 172.21.15.37:0/1630183110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7fa58400bc40 con 0x7fa59815c890 2024-05-30T06:57:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.135+0000 7fa58e000640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa578069bb0 0x7fa57806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.135+0000 7fa58e000640 1 -- 172.21.15.37:0/1630183110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7fa584085bf0 con 0x7fa59815c890 2024-05-30T06:57:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.135+0000 7fa595e00640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa578069bb0 0x7fa57806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.135+0000 7fa595e00640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa578069bb0 0x7fa57806c070 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa588001670 tx=0x7fa588009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:32.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.139+0000 7fa58e000640 1 -- 172.21.15.37:0/1630183110 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa584057cb0 con 0x7fa59815c890 2024-05-30T06:57:32.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.303+0000 7fa59d000640 1 -- 172.21.15.37:0/1630183110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa598067d90 con 0x7fa59815c890 2024-05-30T06:57:32.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.303+0000 7fa58e000640 1 -- 172.21.15.37:0/1630183110 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7fa5840575b0 con 0x7fa59815c890 2024-05-30T06:57:32.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.307+0000 7fa59d000640 1 -- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa578069bb0 msgr2=0x7fa57806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.307+0000 7fa59d000640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa578069bb0 0x7fa57806c070 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa588001670 tx=0x7fa588009040 comp rx=0 tx=0).stop 2024-05-30T06:57:32.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.307+0000 7fa59d000640 1 -- 172.21.15.37:0/1630183110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa59815c890 msgr2=0x7fa59815a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.307+0000 7fa59d000640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa59815c890 0x7fa59815a070 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fa58400d7d0 tx=0x7fa58400dc90 comp rx=0 tx=0).stop 2024-05-30T06:57:32.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.307+0000 7fa59d000640 1 -- 172.21.15.37:0/1630183110 shutdown_connections 2024-05-30T06:57:32.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.307+0000 7fa59d000640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa59815f210 0x7fa59815e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.307+0000 7fa59d000640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa59815c890 0x7fa59815a070 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.307+0000 7fa59d000640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa578069bb0 0x7fa57806c070 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.307+0000 7fa59d000640 1 --2- 172.21.15.37:0/1630183110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5980cec10 0x7fa5981560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.307+0000 7fa59d000640 1 -- 172.21.15.37:0/1630183110 >> 172.21.15.37:0/1630183110 conn(0x7fa5980b2ac0 msgr2=0x7fa5980cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:32.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.307+0000 7fa59d000640 1 -- 172.21.15.37:0/1630183110 shutdown_connections 2024-05-30T06:57:32.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.307+0000 7fa59d000640 1 -- 172.21.15.37:0/1630183110 wait complete. 2024-05-30T06:57:32.325 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T06:57:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.471+0000 7f9938000640 1 Processor -- start 2024-05-30T06:57:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.471+0000 7f9938000640 1 -- start start 2024-05-30T06:57:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.471+0000 7f9938000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99300ced10 0x7f993006ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.471+0000 7f9938000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99300b59d0 0x7f99300b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.471+0000 7f9938000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f993015db00 con 0x7f993015cdd0 2024-05-30T06:57:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.471+0000 7f9938000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f993006df50 con 0x7f99300b59d0 2024-05-30T06:57:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.471+0000 7f9938000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f99300b6370 con 0x7f99300ced10 2024-05-30T06:57:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.471+0000 7f9934c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99300b59d0 0x7f99300b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.471+0000 7f9934c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99300b59d0 0x7f99300b5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54004/0 (socket says 172.21.15.37:54004) 2024-05-30T06:57:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.471+0000 7f9936000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f993015cdd0 0x7f993015d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42108/0 (socket says 172.21.15.37:42108) 2024-05-30T06:57:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.471+0000 7f9934c00640 1 -- 172.21.15.37:0/4086244829 learned_addr learned my addr 172.21.15.37:0/4086244829 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.471+0000 7f9935600640 1 --2- 172.21.15.37:0/4086244829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99300ced10 0x7f993006ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.471+0000 7f992fe00640 1 -- 172.21.15.37:0/4086244829 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96328548 0 0) 0x7f993015db00 con 0x7f993015cdd0 2024-05-30T06:57:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f992fe00640 1 -- 172.21.15.37:0/4086244829 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9918003530 con 0x7f993015cdd0 2024-05-30T06:57:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9934c00640 1 -- 172.21.15.37:0/4086244829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99300ced10 msgr2=0x7f993006ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9934c00640 1 --2- 172.21.15.37:0/4086244829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99300ced10 0x7f993006ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9934c00640 1 -- 172.21.15.37:0/4086244829 >> v1:172.21.15.37:6789/0 conn(0x7f993015cdd0 legacy=0x7f993015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9934c00640 1 -- 172.21.15.37:0/4086244829 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993006e180 con 0x7f99300b59d0 2024-05-30T06:57:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9935600640 1 --2- 172.21.15.37:0/4086244829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99300ced10 0x7f993006ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:32.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9934c00640 1 --2- 172.21.15.37:0/4086244829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99300b59d0 0x7f99300b5e30 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f991c009870 tx=0x7f991c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6df0fd46197ce3b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:32.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f992fe00640 1 -- 172.21.15.37:0/4086244829 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c0a7070 con 0x7f99300b59d0 2024-05-30T06:57:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f992fe00640 1 -- 172.21.15.37:0/4086244829 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f991c0b0070 con 0x7f99300b59d0 2024-05-30T06:57:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f992fe00640 1 -- 172.21.15.37:0/4086244829 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c0ab890 con 0x7f99300b59d0 2024-05-30T06:57:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9938000640 1 -- 172.21.15.37:0/4086244829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99300b59d0 msgr2=0x7f99300b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9938000640 1 --2- 172.21.15.37:0/4086244829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99300b59d0 0x7f99300b5e30 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f991c009870 tx=0x7f991c01c560 comp rx=0 tx=0).stop 2024-05-30T06:57:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9938000640 1 -- 172.21.15.37:0/4086244829 shutdown_connections 2024-05-30T06:57:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9938000640 1 --2- 172.21.15.37:0/4086244829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99300b59d0 0x7f99300b5e30 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9938000640 1 --2- 172.21.15.37:0/4086244829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99300ced10 0x7f993006ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9938000640 1 -- 172.21.15.37:0/4086244829 >> 172.21.15.37:0/4086244829 conn(0x7f993006bf60 msgr2=0x7f99300b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9938000640 1 -- 172.21.15.37:0/4086244829 shutdown_connections 2024-05-30T06:57:32.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.475+0000 7f9938000640 1 -- 172.21.15.37:0/4086244829 wait complete. 2024-05-30T06:57:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9938000640 1 Processor -- start 2024-05-30T06:57:32.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9938000640 1 -- start start 2024-05-30T06:57:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9938000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99300b59d0 0x7f99300a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9938000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99300ced10 0x7f9930143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9938000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f993015cdd0 0x7f99300af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9938000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f993015ea50 con 0x7f99300b59d0 2024-05-30T06:57:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9938000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f993015e8d0 con 0x7f993015cdd0 2024-05-30T06:57:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9938000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f99301447e0 con 0x7f99300ced10 2024-05-30T06:57:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9935600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99300b59d0 0x7f99300a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9935600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99300b59d0 0x7f99300a9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54014/0 (socket says 172.21.15.37:54014) 2024-05-30T06:57:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9935600640 1 -- 172.21.15.37:0/3313320251 learned_addr learned my addr 172.21.15.37:0/3313320251 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9936000640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f993015cdd0 0x7f99300af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9934c00640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99300ced10 0x7f9930143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9935600640 1 -- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99300ced10 msgr2=0x7f9930143d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9935600640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99300ced10 0x7f9930143d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9935600640 1 -- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f993015cdd0 msgr2=0x7f99300af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9935600640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f993015cdd0 0x7f99300af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9935600640 1 -- 172.21.15.37:0/3313320251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9930144ac0 con 0x7f99300b59d0 2024-05-30T06:57:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f9935600640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99300b59d0 0x7f99300a9db0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f992400e810 tx=0x7f992400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.479+0000 7f992d600640 1 -- 172.21.15.37:0/3313320251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9924017070 con 0x7f99300b59d0 2024-05-30T06:57:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.483+0000 7f992d600640 1 -- 172.21.15.37:0/3313320251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992400c8d0 con 0x7f99300b59d0 2024-05-30T06:57:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.483+0000 7f9938000640 1 -- 172.21.15.37:0/3313320251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9930141ea0 con 0x7f99300b59d0 2024-05-30T06:57:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.483+0000 7f992d600640 1 -- 172.21.15.37:0/3313320251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992400f040 con 0x7f99300b59d0 2024-05-30T06:57:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.483+0000 7f9938000640 1 -- 172.21.15.37:0/3313320251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99300aa2f0 con 0x7f99300b59d0 2024-05-30T06:57:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.483+0000 7f9938000640 1 -- 172.21.15.37:0/3313320251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9930141c90 con 0x7f99300b59d0 2024-05-30T06:57:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.483+0000 7f992d600640 1 -- 172.21.15.37:0/3313320251 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f992401a070 con 0x7f99300b59d0 2024-05-30T06:57:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.483+0000 7f992d600640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9910069be0 0x7f991006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.483+0000 7f992d600640 1 -- 172.21.15.37:0/3313320251 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f9924085480 con 0x7f99300b59d0 2024-05-30T06:57:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.483+0000 7f9934c00640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9910069be0 0x7f991006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.487+0000 7f9934c00640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9910069be0 0x7f991006c0a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f991c0af000 tx=0x7f991c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.487+0000 7f992d600640 1 -- 172.21.15.37:0/3313320251 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9924057410 con 0x7f99300b59d0 2024-05-30T06:57:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.675+0000 7f9938000640 1 -- 172.21.15.37:0/3313320251 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f9930068d40 con 0x7f9910069be0 2024-05-30T06:57:32.685 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:32.688+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:32.685 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:32.688+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:32.686 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:32.688+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:32.686 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:32.688+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:32.686 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:57:32.688+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:57:32.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.715+0000 7f992d600640 1 -- 172.21.15.37:0/3313320251 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9930068d40 con 0x7f9910069be0 2024-05-30T06:57:32.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.719+0000 7f9938000640 1 -- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9910069be0 msgr2=0x7f991006c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.719+0000 7f9938000640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9910069be0 0x7f991006c0a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f991c0af000 tx=0x7f991c0a7000 comp rx=0 tx=0).stop 2024-05-30T06:57:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.719+0000 7f9938000640 1 -- 172.21.15.37:0/3313320251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99300b59d0 msgr2=0x7f99300a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.719+0000 7f9938000640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99300b59d0 0x7f99300a9db0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f992400e810 tx=0x7f992400ecd0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.719+0000 7f9938000640 1 -- 172.21.15.37:0/3313320251 shutdown_connections 2024-05-30T06:57:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.719+0000 7f9938000640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9910069be0 0x7f991006c0a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.719+0000 7f9938000640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f993015cdd0 0x7f99300af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.719+0000 7f9938000640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99300ced10 0x7f9930143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.719+0000 7f9938000640 1 --2- 172.21.15.37:0/3313320251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99300b59d0 0x7f99300a9db0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.719+0000 7f9938000640 1 -- 172.21.15.37:0/3313320251 >> 172.21.15.37:0/3313320251 conn(0x7f993006bf60 msgr2=0x7f9930156300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.719+0000 7f9938000640 1 -- 172.21.15.37:0/3313320251 shutdown_connections 2024-05-30T06:57:32.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.719+0000 7f9938000640 1 -- 172.21.15.37:0/3313320251 wait complete. 2024-05-30T06:57:32.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:57:32.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.883+0000 7f1de1400640 1 Processor -- start 2024-05-30T06:57:32.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.883+0000 7f1de1400640 1 -- start start 2024-05-30T06:57:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.883+0000 7f1de1400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ddc155da0 0x7f1ddc0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1de1400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ddc0cd440 0x7f1ddc06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1de1400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1ddc06f5a0 0x7f1ddc0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1de1400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1ddc15f310 con 0x7f1ddc0cd440 2024-05-30T06:57:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1de1400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1ddc15f5f0 con 0x7f1ddc06f5a0 2024-05-30T06:57:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1de1400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1ddc15f8d0 con 0x7f1ddc155da0 2024-05-30T06:57:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dd1e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ddc0cd440 0x7f1ddc06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dd1e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1ddc0cd440 0x7f1ddc06f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54026/0 (socket says 172.21.15.37:54026) 2024-05-30T06:57:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dd1e00640 1 -- 172.21.15.37:0/1739248454 learned_addr learned my addr 172.21.15.37:0/1739248454 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dda800640 1 --2- 172.21.15.37:0/1739248454 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ddc155da0 0x7f1ddc0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1ddb200640 1 --2- 172.21.15.37:0/1739248454 >> v2:172.21.15.105:3300/0 conn(0x7f1ddc06f5a0 0x7f1ddc0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dd1e00640 1 -- 172.21.15.37:0/1739248454 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ddc155da0 msgr2=0x7f1ddc0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dd1e00640 1 --2- 172.21.15.37:0/1739248454 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ddc155da0 0x7f1ddc0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dd1e00640 1 -- 172.21.15.37:0/1739248454 >> v2:172.21.15.105:3300/0 conn(0x7f1ddc06f5a0 msgr2=0x7f1ddc0cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dd1e00640 1 --2- 172.21.15.37:0/1739248454 >> v2:172.21.15.105:3300/0 conn(0x7f1ddc06f5a0 0x7f1ddc0cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dd1e00640 1 -- 172.21.15.37:0/1739248454 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ddc15fbb0 con 0x7f1ddc0cd440 2024-05-30T06:57:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dda800640 1 --2- 172.21.15.37:0/1739248454 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ddc155da0 0x7f1ddc0cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:32.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dd1e00640 1 --2- 172.21.15.37:0/1739248454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ddc0cd440 0x7f1ddc06f060 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0cd0c0 tx=0x7f1dc401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49787d3664e86737 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:32.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dd9e00640 1 -- 172.21.15.37:0/1739248454 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40a5550 con 0x7f1ddc0cd440 2024-05-30T06:57:32.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dd9e00640 1 -- 172.21.15.37:0/1739248454 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc40a56f0 con 0x7f1ddc0cd440 2024-05-30T06:57:32.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.887+0000 7f1dd9e00640 1 -- 172.21.15.37:0/1739248454 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40a5ac0 con 0x7f1ddc0cd440 2024-05-30T06:57:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 -- 172.21.15.37:0/1739248454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ddc0cd440 msgr2=0x7f1ddc06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 --2- 172.21.15.37:0/1739248454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ddc0cd440 0x7f1ddc06f060 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0cd0c0 tx=0x7f1dc401c8d0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 -- 172.21.15.37:0/1739248454 shutdown_connections 2024-05-30T06:57:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 --2- 172.21.15.37:0/1739248454 >> v2:172.21.15.105:3300/0 conn(0x7f1ddc06f5a0 0x7f1ddc0cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 --2- 172.21.15.37:0/1739248454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ddc0cd440 0x7f1ddc06f060 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 --2- 172.21.15.37:0/1739248454 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ddc155da0 0x7f1ddc0cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 -- 172.21.15.37:0/1739248454 >> 172.21.15.37:0/1739248454 conn(0x7f1ddc06bf60 msgr2=0x7f1ddc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 -- 172.21.15.37:0/1739248454 shutdown_connections 2024-05-30T06:57:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 -- 172.21.15.37:0/1739248454 wait complete. 2024-05-30T06:57:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 Processor -- start 2024-05-30T06:57:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 -- start start 2024-05-30T06:57:32.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ddc06f5a0 0x7f1ddc167c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ddc155da0 0x7f1ddc1651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ddc165730 0x7f1ddc154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc06e2e0 con 0x7f1ddc06f5a0 2024-05-30T06:57:32.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc06e160 con 0x7f1ddc155da0 2024-05-30T06:57:32.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1de1400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1ddc06e460 con 0x7f1ddc165730 2024-05-30T06:57:32.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1dda800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ddc06f5a0 0x7f1ddc167c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1dda800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ddc06f5a0 0x7f1ddc167c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54032/0 (socket says 172.21.15.37:54032) 2024-05-30T06:57:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1dda800640 1 -- 172.21.15.37:0/1748830912 learned_addr learned my addr 172.21.15.37:0/1748830912 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1ddb200640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ddc165730 0x7f1ddc154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1dd1e00640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ddc155da0 0x7f1ddc1651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1dda800640 1 -- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ddc165730 msgr2=0x7f1ddc154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1dda800640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ddc165730 0x7f1ddc154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1dda800640 1 -- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ddc155da0 msgr2=0x7f1ddc1651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1dda800640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ddc155da0 0x7f1ddc1651f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1dda800640 1 -- 172.21.15.37:0/1748830912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ddc165bd0 con 0x7f1ddc06f5a0 2024-05-30T06:57:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1ddb200640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ddc165730 0x7f1ddc154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.891+0000 7f1dd1e00640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ddc155da0 0x7f1ddc1651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:57:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.895+0000 7f1dda800640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ddc06f5a0 0x7f1ddc167c90 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00d800 tx=0x7f1dcc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:32.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.895+0000 7f1dd3400640 1 -- 172.21.15.37:0/1748830912 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc018020 con 0x7f1ddc06f5a0 2024-05-30T06:57:32.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.895+0000 7f1dd3400640 1 -- 172.21.15.37:0/1748830912 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dcc0096c0 con 0x7f1ddc06f5a0 2024-05-30T06:57:32.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.895+0000 7f1dd3400640 1 -- 172.21.15.37:0/1748830912 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc009ab0 con 0x7f1ddc06f5a0 2024-05-30T06:57:32.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.895+0000 7f1de1400640 1 -- 172.21.15.37:0/1748830912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ddc165eb0 con 0x7f1ddc06f5a0 2024-05-30T06:57:32.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.895+0000 7f1de1400640 1 -- 172.21.15.37:0/1748830912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ddc166750 con 0x7f1ddc06f5a0 2024-05-30T06:57:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.895+0000 7f1de1400640 1 -- 172.21.15.37:0/1748830912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ddc068bc0 con 0x7f1ddc06f5a0 2024-05-30T06:57:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.895+0000 7f1dd3400640 1 -- 172.21.15.37:0/1748830912 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f1dcc01b020 con 0x7f1ddc06f5a0 2024-05-30T06:57:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.895+0000 7f1dd3400640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1db8069bb0 0x7f1db806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.895+0000 7f1dd3400640 1 -- 172.21.15.37:0/1748830912 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f1dcc085d40 con 0x7f1ddc06f5a0 2024-05-30T06:57:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.895+0000 7f1dd1e00640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1db8069bb0 0x7f1db806c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.899+0000 7f1dd1e00640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1db8069bb0 0x7f1db806c070 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40ae000 tx=0x7f1dc40a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:32.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:32.899+0000 7f1dd3400640 1 -- 172.21.15.37:0/1748830912 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1dcc022020 con 0x7f1ddc06f5a0 2024-05-30T06:57:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.091+0000 7f1de1400640 1 -- 172.21.15.37:0/1748830912 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f1ddc0b6790 con 0x7f1db8069bb0 2024-05-30T06:57:33.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.099+0000 7f1dd3400640 1 -- 172.21.15.37:0/1748830912 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f1ddc0b6790 con 0x7f1db8069bb0 2024-05-30T06:57:33.098 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274 2024-05-30T06:57:33.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.099+0000 7f1de1400640 1 -- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1db8069bb0 msgr2=0x7f1db806c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:33.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.099+0000 7f1de1400640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1db8069bb0 0x7f1db806c070 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40ae000 tx=0x7f1dc40a7070 comp rx=0 tx=0).stop 2024-05-30T06:57:33.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.099+0000 7f1de1400640 1 -- 172.21.15.37:0/1748830912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ddc06f5a0 msgr2=0x7f1ddc167c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:33.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.099+0000 7f1de1400640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ddc06f5a0 0x7f1ddc167c90 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00d800 tx=0x7f1dcc00dcc0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.099+0000 7f1de1400640 1 -- 172.21.15.37:0/1748830912 shutdown_connections 2024-05-30T06:57:33.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.099+0000 7f1de1400640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1ddc165730 0x7f1ddc154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.099+0000 7f1de1400640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1db8069bb0 0x7f1db806c070 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.099+0000 7f1de1400640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1ddc155da0 0x7f1ddc1651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.099+0000 7f1de1400640 1 --2- 172.21.15.37:0/1748830912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ddc06f5a0 0x7f1ddc167c90 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.099+0000 7f1de1400640 1 -- 172.21.15.37:0/1748830912 >> 172.21.15.37:0/1748830912 conn(0x7f1ddc06bf60 msgr2=0x7f1ddc0b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:33.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.099+0000 7f1de1400640 1 -- 172.21.15.37:0/1748830912 shutdown_connections 2024-05-30T06:57:33.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.099+0000 7f1de1400640 1 -- 172.21.15.37:0/1748830912 wait complete. 2024-05-30T06:57:33.119 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:57:33.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f0727a00640 1 Processor -- start 2024-05-30T06:57:33.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f0727a00640 1 -- start start 2024-05-30T06:57:33.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f0727a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f072015d350 0x7f072006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:33.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f0727a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f072015d7e0 0x7f072006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:33.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f0727a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0720142030 con 0x7f07200b59d0 2024-05-30T06:57:33.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f0727a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0720142310 con 0x7f072015d350 2024-05-30T06:57:33.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f0727a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f07201425f0 con 0x7f072015d7e0 2024-05-30T06:57:33.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f071fe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f072015d350 0x7f072006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:33.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f071fe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f072015d350 0x7f072006df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:43716/0 (socket says 172.21.15.37:43716) 2024-05-30T06:57:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f0725000640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f07200b59d0 0x7f07200b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:38690/0 (socket says 172.21.15.37:38690) 2024-05-30T06:57:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f071fe00640 1 -- 172.21.15.37:0/3682309343 learned_addr learned my addr 172.21.15.37:0/3682309343 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f0725a00640 1 --2- 172.21.15.37:0/3682309343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f072015d7e0 0x7f072006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f071fe00640 1 -- 172.21.15.37:0/3682309343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f072015d7e0 msgr2=0x7f072006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f071fe00640 1 --2- 172.21.15.37:0/3682309343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f072015d7e0 0x7f072006e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f071fe00640 1 -- 172.21.15.37:0/3682309343 >> v1:172.21.15.105:6789/0 conn(0x7f07200b59d0 legacy=0x7f07200b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f071fe00640 1 -- 172.21.15.37:0/3682309343 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07201428d0 con 0x7f072015d350 2024-05-30T06:57:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.263+0000 7f0725a00640 1 --2- 172.21.15.37:0/3682309343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f072015d7e0 0x7f072006e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:57:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.267+0000 7f071fe00640 1 --2- 172.21.15.37:0/3682309343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f072015d350 0x7f072006df50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f070c0098a0 tx=0x7f070c01ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b35a88f92c5ee9b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.267+0000 7f071f400640 1 -- 172.21.15.37:0/3682309343 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c0b5070 con 0x7f072015d350 2024-05-30T06:57:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.267+0000 7f071f400640 1 -- 172.21.15.37:0/3682309343 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c0a8a30 con 0x7f072015d350 2024-05-30T06:57:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.267+0000 7f071f400640 1 -- 172.21.15.37:0/3682309343 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c0a8e00 con 0x7f072015d350 2024-05-30T06:57:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.267+0000 7f0727a00640 1 -- 172.21.15.37:0/3682309343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f072015d350 msgr2=0x7f072006df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:33.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.267+0000 7f0727a00640 1 --2- 172.21.15.37:0/3682309343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f072015d350 0x7f072006df50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f070c0098a0 tx=0x7f070c01ed30 comp rx=0 tx=0).stop 2024-05-30T06:57:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.267+0000 7f0727a00640 1 -- 172.21.15.37:0/3682309343 shutdown_connections 2024-05-30T06:57:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.267+0000 7f0727a00640 1 --2- 172.21.15.37:0/3682309343 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f072015d7e0 0x7f072006e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.267+0000 7f0727a00640 1 --2- 172.21.15.37:0/3682309343 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f072015d350 0x7f072006df50 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.267+0000 7f0727a00640 1 -- 172.21.15.37:0/3682309343 >> 172.21.15.37:0/3682309343 conn(0x7f072006bf60 msgr2=0x7f07200b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.267+0000 7f0727a00640 1 -- 172.21.15.37:0/3682309343 shutdown_connections 2024-05-30T06:57:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.267+0000 7f0727a00640 1 -- 172.21.15.37:0/3682309343 wait complete. 2024-05-30T06:57:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0727a00640 1 Processor -- start 2024-05-30T06:57:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0727a00640 1 -- start start 2024-05-30T06:57:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0727a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07200b59d0 0x7f0720159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0727a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f072015d350 0x7f07200b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0727a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f072015d7e0 0x7f072015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0727a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f07200b00a0 con 0x7f072015d7e0 2024-05-30T06:57:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0727a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f07200aff20 con 0x7f07200b59d0 2024-05-30T06:57:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0727a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f072013f860 con 0x7f072015d350 2024-05-30T06:57:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0725a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f072015d7e0 0x7f072015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0725a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f072015d7e0 0x7f072015b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54044/0 (socket says 172.21.15.37:54044) 2024-05-30T06:57:33.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0725a00640 1 -- 172.21.15.37:0/440698631 learned_addr learned my addr 172.21.15.37:0/440698631 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:33.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0725000640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07200b59d0 0x7f0720159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:33.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f071fe00640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f072015d350 0x7f07200b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0725a00640 1 -- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f072015d350 msgr2=0x7f07200b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0725a00640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f072015d350 0x7f07200b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0725a00640 1 -- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07200b59d0 msgr2=0x7f0720159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0725a00640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07200b59d0 0x7f0720159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0725a00640 1 -- 172.21.15.37:0/440698631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072015a2b0 con 0x7f072015d7e0 2024-05-30T06:57:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0725a00640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f072015d7e0 0x7f072015b680 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f071800efc0 tx=0x7f0718009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f071cc00640 1 -- 172.21.15.37:0/440698631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718018030 con 0x7f072015d7e0 2024-05-30T06:57:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f071cc00640 1 -- 172.21.15.37:0/440698631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071800cde0 con 0x7f072015d7e0 2024-05-30T06:57:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f071cc00640 1 -- 172.21.15.37:0/440698631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718003bc0 con 0x7f072015d7e0 2024-05-30T06:57:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0727a00640 1 -- 172.21.15.37:0/440698631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072015a8c0 con 0x7f072015d7e0 2024-05-30T06:57:33.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.271+0000 7f0727a00640 1 -- 172.21.15.37:0/440698631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072015ae80 con 0x7f072015d7e0 2024-05-30T06:57:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.275+0000 7f0727a00640 1 -- 172.21.15.37:0/440698631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0720068bc0 con 0x7f072015d7e0 2024-05-30T06:57:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.275+0000 7f071cc00640 1 -- 172.21.15.37:0/440698631 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) ==== 90180+0+0 (secure 0 0 0) 0x7f071801b070 con 0x7f072015d7e0 2024-05-30T06:57:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.275+0000 7f071cc00640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0700069bb0 0x7f070006c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.275+0000 7f071cc00640 1 -- 172.21.15.37:0/440698631 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5765+0+0 (secure 0 0 0) 0x7f07180860e0 con 0x7f072015d7e0 2024-05-30T06:57:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.275+0000 7f0725000640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0700069bb0 0x7f070006c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.275+0000 7f0725000640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0700069bb0 0x7f070006c070 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0714000f70 tx=0x7f0714007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:33.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.279+0000 7f071cc00640 1 -- 172.21.15.37:0/440698631 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0718022070 con 0x7f072015d7e0 2024-05-30T06:57:33.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.471+0000 7f0727a00640 1 -- 172.21.15.37:0/440698631 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f072006f0a0 con 0x7f0700069bb0 2024-05-30T06:57:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.475+0000 7f071cc00640 1 -- 172.21.15.37:0/440698631 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f072006f0a0 con 0x7f0700069bb0 2024-05-30T06:57:33.475 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274 2024-05-30T06:57:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.479+0000 7f0727a00640 1 -- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0700069bb0 msgr2=0x7f070006c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.479+0000 7f0727a00640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0700069bb0 0x7f070006c070 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0714000f70 tx=0x7f0714007e90 comp rx=0 tx=0).stop 2024-05-30T06:57:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.479+0000 7f0727a00640 1 -- 172.21.15.37:0/440698631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f072015d7e0 msgr2=0x7f072015b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.479+0000 7f0727a00640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f072015d7e0 0x7f072015b680 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f071800efc0 tx=0x7f0718009f90 comp rx=0 tx=0).stop 2024-05-30T06:57:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.479+0000 7f0727a00640 1 -- 172.21.15.37:0/440698631 shutdown_connections 2024-05-30T06:57:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.479+0000 7f0727a00640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f072015d7e0 0x7f072015b680 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.479+0000 7f0727a00640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f072015d350 0x7f07200b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.479+0000 7f0727a00640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0700069bb0 0x7f070006c070 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.479+0000 7f0727a00640 1 --2- 172.21.15.37:0/440698631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07200b59d0 0x7f0720159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.479+0000 7f0727a00640 1 -- 172.21.15.37:0/440698631 >> 172.21.15.37:0/440698631 conn(0x7f072006bf60 msgr2=0x7f0720071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:33.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.479+0000 7f0727a00640 1 -- 172.21.15.37:0/440698631 shutdown_connections 2024-05-30T06:57:33.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:33.479+0000 7f0727a00640 1 -- 172.21.15.37:0/440698631 wait complete. 2024-05-30T06:57:33.496 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274 2024-05-30T06:57:33.496 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:57:33.496 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:57:33.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:57:33.505 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:57:35.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:57:35.751 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:57:41.818 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:57:41.818 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:57:41.819 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.25311 s, 130 MB/s 2024-05-30T06:57:41.820 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:57:41.820 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:57:41.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:57:41.829 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:57:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:57:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:57:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.57302 s, 125 MB/s 2024-05-30T06:57:50.456 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:57:50.456 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:57:50.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:57:50.467 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:57:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:57:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:57:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.55206 s, 126 MB/s 2024-05-30T06:57:59.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T06:57:59.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.219+0000 7f29ee400640 1 Processor -- start 2024-05-30T06:57:59.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.219+0000 7f29ee400640 1 -- start start 2024-05-30T06:57:59.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.219+0000 7f29ee400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e80cd400 0x7f29e806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.219+0000 7f29ee400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e80ce030 con 0x7f29e81590c0 2024-05-30T06:57:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.219+0000 7f29ee400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e815f230 con 0x7f29e806f5a0 2024-05-30T06:57:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.219+0000 7f29ee400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f29e815f510 con 0x7f29e80cd400 2024-05-30T06:57:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.219+0000 7f29e7400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f29e81590c0 0x7f29e80cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44314/0 (socket says 172.21.15.37:44314) 2024-05-30T06:57:59.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.219+0000 7f29e7400640 1 -- 172.21.15.37:0/267759822 learned_addr learned my addr 172.21.15.37:0/267759822 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.219+0000 7f29dfe00640 1 --2- 172.21.15.37:0/267759822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e80cd400 0x7f29e806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 181186023 0 0) 0x7f29e80ce030 con 0x7f29e81590c0 2024-05-30T06:57:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29cc003530 con 0x7f29e81590c0 2024-05-30T06:57:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3616384741 0 0) 0x7f29e815f230 con 0x7f29e806f5a0 2024-05-30T06:57:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29e80ce030 con 0x7f29e806f5a0 2024-05-30T06:57:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2631618366 0 0) 0x7f29cc003530 con 0x7f29e81590c0 2024-05-30T06:57:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e80cd400 msgr2=0x7f29e806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 --2- 172.21.15.37:0/267759822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e80cd400 0x7f29e806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 >> v1:172.21.15.105:6789/0 conn(0x7f29e806f5a0 legacy=0x7f29e80b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e815f7f0 con 0x7f29e81590c0 2024-05-30T06:57:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f29d8001680 con 0x7f29e81590c0 2024-05-30T06:57:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29dfe00640 1 --2- 172.21.15.37:0/267759822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e80cd400 0x7f29e806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:57:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 >> v1:172.21.15.37:6789/0 conn(0x7f29e81590c0 legacy=0x7f29e80cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 --2- 172.21.15.37:0/267759822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc003b80 0x7f29cc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 --2- 172.21.15.37:0/267759822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29cc004810 0x7f29cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 --2- 172.21.15.37:0/267759822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e80cd400 0x7f29cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f29e815f510 con 0x7f29cc004810 2024-05-30T06:57:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc00dcc0 con 0x7f29cc003b80 2024-05-30T06:57:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f29cc00dec0 con 0x7f29e80cd400 2024-05-30T06:57:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29dfe00640 1 --2- 172.21.15.37:0/267759822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29cc004810 0x7f29cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e7400640 1 --2- 172.21.15.37:0/267759822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc003b80 0x7f29cc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29e7e00640 1 --2- 172.21.15.37:0/267759822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e80cd400 0x7f29cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29dfe00640 1 -- 172.21.15.37:0/267759822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e80cd400 msgr2=0x7f29cc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29dfe00640 1 --2- 172.21.15.37:0/267759822 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e80cd400 0x7f29cc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29dfe00640 1 -- 172.21.15.37:0/267759822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc003b80 msgr2=0x7f29cc003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29dfe00640 1 --2- 172.21.15.37:0/267759822 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc003b80 0x7f29cc003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.223+0000 7f29dfe00640 1 -- 172.21.15.37:0/267759822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29cc003530 con 0x7f29cc004810 2024-05-30T06:57:59.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29dfe00640 1 --2- 172.21.15.37:0/267759822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29cc004810 0x7f29cc004c90 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f29e815cc80 tx=0x7f29d001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf7a68a83d1c32c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:59.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d00b2070 con 0x7f29cc004810 2024-05-30T06:57:59.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d00a5630 con 0x7f29cc004810 2024-05-30T06:57:59.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29e6a00640 1 -- 172.21.15.37:0/267759822 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0009880 con 0x7f29cc004810 2024-05-30T06:57:59.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 -- 172.21.15.37:0/267759822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29cc004810 msgr2=0x7f29cc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:59.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 --2- 172.21.15.37:0/267759822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29cc004810 0x7f29cc004c90 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f29e815cc80 tx=0x7f29d001cb90 comp rx=0 tx=0).stop 2024-05-30T06:57:59.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29e7e00640 1 -- 172.21.15.37:0/267759822 reap_dead start 2024-05-30T06:57:59.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 -- 172.21.15.37:0/267759822 shutdown_connections 2024-05-30T06:57:59.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 -- 172.21.15.37:0/267759822 >> 172.21.15.37:0/267759822 conn(0x7f29e806bf60 msgr2=0x7f29e80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:59.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 -- 172.21.15.37:0/267759822 shutdown_connections 2024-05-30T06:57:59.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 -- 172.21.15.37:0/267759822 wait complete. 2024-05-30T06:57:59.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 Processor -- start 2024-05-30T06:57:59.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 -- start start 2024-05-30T06:57:59.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc004810 0x7f29e8147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e8148940 0x7f29e81527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e8152ce0 0x7f29e8153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f29e806df50 con 0x7f29e8148940 2024-05-30T06:57:59.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f29e806f9b0 con 0x7f29cc004810 2024-05-30T06:57:59.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29ee400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f29e806e0d0 con 0x7f29e8152ce0 2024-05-30T06:57:59.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e8148940 0x7f29e81527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e8148940 0x7f29e81527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34648/0 (socket says 172.21.15.37:34648) 2024-05-30T06:57:59.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29dfe00640 1 -- 172.21.15.37:0/2184294797 learned_addr learned my addr 172.21.15.37:0/2184294797 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:59.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29e7e00640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e8152ce0 0x7f29e8153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.227+0000 7f29e7400640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc004810 0x7f29e8147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29dfe00640 1 -- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e8152ce0 msgr2=0x7f29e8153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:59.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29dfe00640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e8152ce0 0x7f29e8153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29dfe00640 1 -- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc004810 msgr2=0x7f29e8147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:59.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29dfe00640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc004810 0x7f29e8147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29dfe00640 1 -- 172.21.15.37:0/2184294797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e8154e40 con 0x7f29e8148940 2024-05-30T06:57:59.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29dfe00640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e8148940 0x7f29e81527a0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f29d0098390 tx=0x7f29cc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:59.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29df400640 1 -- 172.21.15.37:0/2184294797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d00b2040 con 0x7f29e8148940 2024-05-30T06:57:59.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29df400640 1 -- 172.21.15.37:0/2184294797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d0009400 con 0x7f29e8148940 2024-05-30T06:57:59.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29df400640 1 -- 172.21.15.37:0/2184294797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d0009880 con 0x7f29e8148940 2024-05-30T06:57:59.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29ee400640 1 -- 172.21.15.37:0/2184294797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e8155120 con 0x7f29e8148940 2024-05-30T06:57:59.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29ee400640 1 -- 172.21.15.37:0/2184294797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e81556e0 con 0x7f29e8148940 2024-05-30T06:57:59.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29ee400640 1 -- 172.21.15.37:0/2184294797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e8068d40 con 0x7f29e8148940 2024-05-30T06:57:59.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29df400640 1 -- 172.21.15.37:0/2184294797 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 41) ==== 90231+0+0 (secure 0 0 0) 0x7f29d0004260 con 0x7f29e8148940 2024-05-30T06:57:59.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.231+0000 7f29df400640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29c4069c40 0x7f29c406c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.235+0000 7f29df400640 1 -- 172.21.15.37:0/2184294797 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f29d011ee30 con 0x7f29e8148940 2024-05-30T06:57:59.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.235+0000 7f29e7400640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29c4069c40 0x7f29c406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.235+0000 7f29e7400640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29c4069c40 0x7f29c406c100 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f29d8001210 tx=0x7f29d8001e60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:59.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.239+0000 7f29df400640 1 -- 172.21.15.37:0/2184294797 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f29d00168a0 con 0x7f29e8148940 2024-05-30T06:57:59.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.431+0000 7f29ee400640 1 -- 172.21.15.37:0/2184294797 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f29e814b650 con 0x7f29c4069c40 2024-05-30T06:57:59.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.447+0000 7f29df400640 1 -- 172.21.15.37:0/2184294797 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f29e814b650 con 0x7f29c4069c40 2024-05-30T06:57:59.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.447+0000 7f29ee400640 1 -- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29c4069c40 msgr2=0x7f29c406c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:59.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.447+0000 7f29ee400640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29c4069c40 0x7f29c406c100 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f29d8001210 tx=0x7f29d8001e60 comp rx=0 tx=0).stop 2024-05-30T06:57:59.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.447+0000 7f29ee400640 1 -- 172.21.15.37:0/2184294797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e8148940 msgr2=0x7f29e81527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:59.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.447+0000 7f29ee400640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e8148940 0x7f29e81527a0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f29d0098390 tx=0x7f29cc005840 comp rx=0 tx=0).stop 2024-05-30T06:57:59.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.447+0000 7f29ee400640 1 -- 172.21.15.37:0/2184294797 shutdown_connections 2024-05-30T06:57:59.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.447+0000 7f29ee400640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29e8152ce0 0x7f29e8153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.447+0000 7f29ee400640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e8148940 0x7f29e81527a0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.447+0000 7f29ee400640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f29c4069c40 0x7f29c406c100 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.447+0000 7f29ee400640 1 --2- 172.21.15.37:0/2184294797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29cc004810 0x7f29e8147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.447+0000 7f29ee400640 1 -- 172.21.15.37:0/2184294797 >> 172.21.15.37:0/2184294797 conn(0x7f29e806bf60 msgr2=0x7f29e8160c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:59.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.447+0000 7f29ee400640 1 -- 172.21.15.37:0/2184294797 shutdown_connections 2024-05-30T06:57:59.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.447+0000 7f29ee400640 1 -- 172.21.15.37:0/2184294797 wait complete. 2024-05-30T06:57:59.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:57:59.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f2469600640 1 Processor -- start 2024-05-30T06:57:59.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f2469600640 1 -- start start 2024-05-30T06:57:59.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f2469600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f246409b800 0x7f246406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f2469600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f246406dcf0 0x7f246409aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f2469600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24640d0840 con 0x7f246415ebc0 2024-05-30T06:57:59.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f2469600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f246409bce0 con 0x7f246406dcf0 2024-05-30T06:57:59.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f2469600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f24640d0ae0 con 0x7f246409b800 2024-05-30T06:57:59.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f2462a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f246415ebc0 0x7f24640d15c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44326/0 (socket says 172.21.15.37:44326) 2024-05-30T06:57:59.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f2462a00640 1 -- 172.21.15.37:0/878822921 learned_addr learned my addr 172.21.15.37:0/878822921 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:57:59.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f245a000640 1 --2- 172.21.15.37:0/878822921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f246409b800 0x7f246406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f2463400640 1 --2- 172.21.15.37:0/878822921 >> v2:172.21.15.105:3300/0 conn(0x7f246406dcf0 0x7f246409aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f2462000640 1 -- 172.21.15.37:0/878822921 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913947569 0 0) 0x7f24640d0840 con 0x7f246415ebc0 2024-05-30T06:57:59.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f2462000640 1 -- 172.21.15.37:0/878822921 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2448003530 con 0x7f246415ebc0 2024-05-30T06:57:59.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f245a000640 1 -- 172.21.15.37:0/878822921 >> v2:172.21.15.105:3300/0 conn(0x7f246406dcf0 msgr2=0x7f246409aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:57:59.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f245a000640 1 --2- 172.21.15.37:0/878822921 >> v2:172.21.15.105:3300/0 conn(0x7f246406dcf0 0x7f246409aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f245a000640 1 -- 172.21.15.37:0/878822921 >> v1:172.21.15.37:6789/0 conn(0x7f246415ebc0 legacy=0x7f24640d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:59.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f245a000640 1 -- 172.21.15.37:0/878822921 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24640d0dc0 con 0x7f246409b800 2024-05-30T06:57:59.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.611+0000 7f2463400640 1 --2- 172.21.15.37:0/878822921 >> v2:172.21.15.105:3300/0 conn(0x7f246406dcf0 0x7f246409aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:57:59.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.615+0000 7f245a000640 1 --2- 172.21.15.37:0/878822921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f246409b800 0x7f246406d7b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f244c0097c0 tx=0x7f244c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dded75edaa0054ee server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:59.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.615+0000 7f2462000640 1 -- 172.21.15.37:0/878822921 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c0b0070 con 0x7f246409b800 2024-05-30T06:57:59.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.615+0000 7f2462000640 1 -- 172.21.15.37:0/878822921 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f244c0ab600 con 0x7f246409b800 2024-05-30T06:57:59.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.615+0000 7f2462000640 1 -- 172.21.15.37:0/878822921 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c0ab9d0 con 0x7f246409b800 2024-05-30T06:57:59.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.615+0000 7f2469600640 1 -- 172.21.15.37:0/878822921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f246409b800 msgr2=0x7f246406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:59.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.615+0000 7f2469600640 1 --2- 172.21.15.37:0/878822921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f246409b800 0x7f246406d7b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f244c0097c0 tx=0x7f244c01c4a0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.615+0000 7f2469600640 1 -- 172.21.15.37:0/878822921 shutdown_connections 2024-05-30T06:57:59.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.615+0000 7f2469600640 1 --2- 172.21.15.37:0/878822921 >> v2:172.21.15.105:3300/0 conn(0x7f246406dcf0 0x7f246409aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.615+0000 7f2469600640 1 --2- 172.21.15.37:0/878822921 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f246409b800 0x7f246406d7b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.615+0000 7f2469600640 1 -- 172.21.15.37:0/878822921 >> 172.21.15.37:0/878822921 conn(0x7f24640b4060 msgr2=0x7f24640b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:59.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.615+0000 7f2469600640 1 -- 172.21.15.37:0/878822921 shutdown_connections 2024-05-30T06:57:59.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.615+0000 7f2469600640 1 -- 172.21.15.37:0/878822921 wait complete. 2024-05-30T06:57:59.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2469600640 1 Processor -- start 2024-05-30T06:57:59.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2469600640 1 -- start start 2024-05-30T06:57:59.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2469600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f246406dcf0 0x7f24640cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2469600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f246409b800 0x7f24640cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2469600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f246415ebc0 0x7f24640cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2469600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f246409b3b0 con 0x7f246406dcf0 2024-05-30T06:57:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2469600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f24640cd5e0 con 0x7f246415ebc0 2024-05-30T06:57:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2469600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f246416ba70 con 0x7f246409b800 2024-05-30T06:57:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2462a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f246406dcf0 0x7f24640cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2462a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f246406dcf0 0x7f24640cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34656/0 (socket says 172.21.15.37:34656) 2024-05-30T06:57:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2462a00640 1 -- 172.21.15.37:0/1281099899 learned_addr learned my addr 172.21.15.37:0/1281099899 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:57:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f245a000640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f246409b800 0x7f24640cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2463400640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f246415ebc0 0x7f24640cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2462a00640 1 -- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f246409b800 msgr2=0x7f24640cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2462a00640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f246409b800 0x7f24640cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2462a00640 1 -- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f246415ebc0 msgr2=0x7f24640cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2462a00640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f246415ebc0 0x7f24640cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2462a00640 1 -- 172.21.15.37:0/1281099899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24640b4790 con 0x7f246406dcf0 2024-05-30T06:57:59.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2462a00640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f246406dcf0 0x7f24640cad70 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f245400c480 tx=0x7f245400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f245b400640 1 -- 172.21.15.37:0/1281099899 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454017070 con 0x7f246406dcf0 2024-05-30T06:57:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f245b400640 1 -- 172.21.15.37:0/1281099899 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2454005cf0 con 0x7f246406dcf0 2024-05-30T06:57:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2469600640 1 -- 172.21.15.37:0/1281099899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24641fb7a0 con 0x7f246406dcf0 2024-05-30T06:57:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f245b400640 1 -- 172.21.15.37:0/1281099899 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454007290 con 0x7f246406dcf0 2024-05-30T06:57:59.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.619+0000 7f2469600640 1 -- 172.21.15.37:0/1281099899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24641fbd60 con 0x7f246406dcf0 2024-05-30T06:57:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.623+0000 7f2469600640 1 -- 172.21.15.37:0/1281099899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2464068bc0 con 0x7f246406dcf0 2024-05-30T06:57:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.623+0000 7f245b400640 1 -- 172.21.15.37:0/1281099899 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 41) ==== 90231+0+0 (secure 0 0 0) 0x7f245401a070 con 0x7f246406dcf0 2024-05-30T06:57:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.623+0000 7f245b400640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2440069c40 0x7f244006c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:57:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.623+0000 7f245b400640 1 -- 172.21.15.37:0/1281099899 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f2454084bd0 con 0x7f246406dcf0 2024-05-30T06:57:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.623+0000 7f245a000640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2440069c40 0x7f244006c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:57:59.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.623+0000 7f245a000640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2440069c40 0x7f244006c100 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f244c0ad000 tx=0x7f244c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:57:59.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.627+0000 7f245b400640 1 -- 172.21.15.37:0/1281099899 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f24540565a0 con 0x7f246406dcf0 2024-05-30T06:57:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.823+0000 7f2469600640 1 -- 172.21.15.37:0/1281099899 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f2464158130 con 0x7f2440069c40 2024-05-30T06:57:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.827+0000 7f245b400640 1 -- 172.21.15.37:0/1281099899 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f2464158130 con 0x7f2440069c40 2024-05-30T06:57:59.828 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274 2024-05-30T06:57:59.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.831+0000 7f2469600640 1 -- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2440069c40 msgr2=0x7f244006c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.831+0000 7f2469600640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2440069c40 0x7f244006c100 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f244c0ad000 tx=0x7f244c008040 comp rx=0 tx=0).stop 2024-05-30T06:57:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.831+0000 7f2469600640 1 -- 172.21.15.37:0/1281099899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f246406dcf0 msgr2=0x7f24640cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:57:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.831+0000 7f2469600640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f246406dcf0 0x7f24640cad70 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f245400c480 tx=0x7f245400c940 comp rx=0 tx=0).stop 2024-05-30T06:57:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.831+0000 7f2469600640 1 -- 172.21.15.37:0/1281099899 shutdown_connections 2024-05-30T06:57:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.831+0000 7f2469600640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2440069c40 0x7f244006c100 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.831+0000 7f2469600640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f246415ebc0 0x7f24640cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.831+0000 7f2469600640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f246409b800 0x7f24640cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.831+0000 7f2469600640 1 --2- 172.21.15.37:0/1281099899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f246406dcf0 0x7f24640cad70 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:57:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.831+0000 7f2469600640 1 -- 172.21.15.37:0/1281099899 >> 172.21.15.37:0/1281099899 conn(0x7f24640b4060 msgr2=0x7f246415ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:57:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.831+0000 7f2469600640 1 -- 172.21.15.37:0/1281099899 shutdown_connections 2024-05-30T06:57:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:57:59.831+0000 7f2469600640 1 -- 172.21.15.37:0/1281099899 wait complete. 2024-05-30T06:57:59.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:57:59.851 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274 2024-05-30T06:57:59.851 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:57:59.861 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274 2024-05-30T06:57:59.861 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3055190016" 2024-05-30T06:57:59.861 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:57:59.862 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 exp_size = 3221225472 2024-05-30T06:58:01.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:58:01.863 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274 2024-05-30T06:58:01.863 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:58:01.873 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274 2024-05-30T06:58:01.874 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3055190016" 2024-05-30T06:58:01.874 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:01.875 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 exp_size = 3221225472 2024-05-30T06:58:03.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:58:03.876 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274 2024-05-30T06:58:03.876 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:58:03.886 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274 2024-05-30T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3055190016" 2024-05-30T06:58:03.887 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:03.888 INFO:tasks.cephfs.test_volumes:r_size = 3055190016 exp_size = 3221225472 2024-05-30T06:58:05.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:58:05.824 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:58:05.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:58:05.889 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274 2024-05-30T06:58:05.889 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:58:05.899 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/b1a204a6-dd76-4d32-9276-71a832793274 2024-05-30T06:58:05.899 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T06:58:05.899 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:05.900 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T06:58:05.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone44121 2024-05-30T06:58:06.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.095+0000 7fdba4e00640 1 Processor -- start 2024-05-30T06:58:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.095+0000 7fdba4e00640 1 -- start start 2024-05-30T06:58:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.099+0000 7fdba4e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdba006e290 0x7fdba00d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.099+0000 7fdba4e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba00cd980 con 0x7fdba009acc0 2024-05-30T06:58:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.099+0000 7fdba4e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba00cdc60 con 0x7fdba009b0a0 2024-05-30T06:58:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.099+0000 7fdba4e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdba00ce590 con 0x7fdba006e290 2024-05-30T06:58:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.099+0000 7fdb9fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdba006e290 0x7fdba00d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.099+0000 7fdb9fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdba006e290 0x7fdba00d1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34672/0 (socket says 172.21.15.37:34672) 2024-05-30T06:58:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.099+0000 7fdb9fe00640 1 -- 172.21.15.37:0/2002604292 learned_addr learned my addr 172.21.15.37:0/2002604292 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:06.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.099+0000 7fdb9fe00640 1 -- 172.21.15.37:0/2002604292 >> v1:172.21.15.105:6789/0 conn(0x7fdba009b0a0 legacy=0x7fdba015e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:06.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.099+0000 7fdb9fe00640 1 -- 172.21.15.37:0/2002604292 >> v1:172.21.15.37:6789/0 conn(0x7fdba009acc0 legacy=0x7fdba006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:06.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.099+0000 7fdb9fe00640 1 -- 172.21.15.37:0/2002604292 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba00cdf40 con 0x7fdba006e290 2024-05-30T06:58:06.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.103+0000 7fdb9fe00640 1 --2- 172.21.15.37:0/2002604292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba006e290 0x7fdba00d1140 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009e50 tx=0x7fdb9801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f31d354e3a2b99 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:06.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.103+0000 7fdb9ea00640 1 -- 172.21.15.37:0/2002604292 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb980b4070 con 0x7fdba006e290 2024-05-30T06:58:06.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.103+0000 7fdb9ea00640 1 -- 172.21.15.37:0/2002604292 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb980af400 con 0x7fdba006e290 2024-05-30T06:58:06.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.103+0000 7fdb9ea00640 1 -- 172.21.15.37:0/2002604292 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb980af7d0 con 0x7fdba006e290 2024-05-30T06:58:06.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.103+0000 7fdba4e00640 1 -- 172.21.15.37:0/2002604292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba006e290 msgr2=0x7fdba00d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:06.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.103+0000 7fdba4e00640 1 --2- 172.21.15.37:0/2002604292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba006e290 0x7fdba00d1140 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009e50 tx=0x7fdb9801f210 comp rx=0 tx=0).stop 2024-05-30T06:58:06.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.103+0000 7fdba4e00640 1 -- 172.21.15.37:0/2002604292 shutdown_connections 2024-05-30T06:58:06.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.103+0000 7fdba4e00640 1 --2- 172.21.15.37:0/2002604292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba006e290 0x7fdba00d1140 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:06.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.103+0000 7fdba4e00640 1 -- 172.21.15.37:0/2002604292 >> 172.21.15.37:0/2002604292 conn(0x7fdba00b3ef0 msgr2=0x7fdba00b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:06.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.103+0000 7fdba4e00640 1 -- 172.21.15.37:0/2002604292 shutdown_connections 2024-05-30T06:58:06.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.103+0000 7fdba4e00640 1 -- 172.21.15.37:0/2002604292 wait complete. 2024-05-30T06:58:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.103+0000 7fdba4e00640 1 Processor -- start 2024-05-30T06:58:06.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.103+0000 7fdba4e00640 1 -- start start 2024-05-30T06:58:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdba4e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdba006e290 0x7fdba0154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:06.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdba4e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba009acc0 0x7fdba009f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdba4e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdba009b0a0 0x7fdba009dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdba4e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdba00cea20 con 0x7fdba009acc0 2024-05-30T06:58:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdba4e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdba006d7c0 con 0x7fdba006e290 2024-05-30T06:58:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdba4e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdba009cf40 con 0x7fdba009b0a0 2024-05-30T06:58:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb97e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba009acc0 0x7fdba009f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb97e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba009acc0 0x7fdba009f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34682/0 (socket says 172.21.15.37:34682) 2024-05-30T06:58:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb97e00640 1 -- 172.21.15.37:0/1460914539 learned_addr learned my addr 172.21.15.37:0/1460914539 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb9f400640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdba006e290 0x7fdba0154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb9fe00640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdba009b0a0 0x7fdba009dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb97e00640 1 -- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdba009b0a0 msgr2=0x7fdba009dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:06.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb97e00640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdba009b0a0 0x7fdba009dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb97e00640 1 -- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdba006e290 msgr2=0x7fdba0154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb97e00640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdba006e290 0x7fdba0154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb97e00640 1 -- 172.21.15.37:0/1460914539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba009d220 con 0x7fdba009acc0 2024-05-30T06:58:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb9fe00640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdba009b0a0 0x7fdba009dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb9f400640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdba006e290 0x7fdba0154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb97e00640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba009acc0 0x7fdba009f9b0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fdb8800c500 tx=0x7fdb8800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb97400640 1 -- 172.21.15.37:0/1460914539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88016020 con 0x7fdba009acc0 2024-05-30T06:58:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb97400640 1 -- 172.21.15.37:0/1460914539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb88005220 con 0x7fdba009acc0 2024-05-30T06:58:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb97400640 1 -- 172.21.15.37:0/1460914539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb88007030 con 0x7fdba009acc0 2024-05-30T06:58:06.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdba4e00640 1 -- 172.21.15.37:0/1460914539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba009d500 con 0x7fdba009acc0 2024-05-30T06:58:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdba4e00640 1 -- 172.21.15.37:0/1460914539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba0154cc0 con 0x7fdba009acc0 2024-05-30T06:58:06.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdba4e00640 1 -- 172.21.15.37:0/1460914539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba0068ab0 con 0x7fdba009acc0 2024-05-30T06:58:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.107+0000 7fdb97400640 1 -- 172.21.15.37:0/1460914539 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 41) ==== 90231+0+0 (secure 0 0 0) 0x7fdb880071d0 con 0x7fdba009acc0 2024-05-30T06:58:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.111+0000 7fdb97400640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb7c069c90 0x7fdb7c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.111+0000 7fdb97400640 1 -- 172.21.15.37:0/1460914539 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7fdb88085210 con 0x7fdba009acc0 2024-05-30T06:58:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.111+0000 7fdb9f400640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb7c069c90 0x7fdb7c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:06.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.111+0000 7fdb9f400640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb7c069c90 0x7fdb7c06c150 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fdb90000f70 tx=0x7fdb90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:06.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.115+0000 7fdb97400640 1 -- 172.21.15.37:0/1460914539 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdb88020020 con 0x7fdba009acc0 2024-05-30T06:58:06.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.315+0000 7fdba4e00640 1 -- 172.21.15.37:0/1460914539 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone44121", "target": ["mon-mgr", ""]}) -- 0x7fdba00b4c50 con 0x7fdb7c069c90 2024-05-30T06:58:06.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.375+0000 7fdb97400640 1 -- 172.21.15.37:0/1460914539 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdba00b4c50 con 0x7fdb7c069c90 2024-05-30T06:58:06.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.379+0000 7fdba4e00640 1 -- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb7c069c90 msgr2=0x7fdb7c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:06.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.379+0000 7fdba4e00640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb7c069c90 0x7fdb7c06c150 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fdb90000f70 tx=0x7fdb90009040 comp rx=0 tx=0).stop 2024-05-30T06:58:06.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.379+0000 7fdba4e00640 1 -- 172.21.15.37:0/1460914539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba009acc0 msgr2=0x7fdba009f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:06.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.379+0000 7fdba4e00640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba009acc0 0x7fdba009f9b0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fdb8800c500 tx=0x7fdb8800c9c0 comp rx=0 tx=0).stop 2024-05-30T06:58:06.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.379+0000 7fdba4e00640 1 -- 172.21.15.37:0/1460914539 shutdown_connections 2024-05-30T06:58:06.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.379+0000 7fdba4e00640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdba009b0a0 0x7fdba009dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:06.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.379+0000 7fdba4e00640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdba009acc0 0x7fdba009f9b0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:06.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.379+0000 7fdba4e00640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb7c069c90 0x7fdb7c06c150 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:06.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.379+0000 7fdba4e00640 1 --2- 172.21.15.37:0/1460914539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdba006e290 0x7fdba0154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:06.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.379+0000 7fdba4e00640 1 -- 172.21.15.37:0/1460914539 >> 172.21.15.37:0/1460914539 conn(0x7fdba00b3ef0 msgr2=0x7fdba00ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:06.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.379+0000 7fdba4e00640 1 -- 172.21.15.37:0/1460914539 shutdown_connections 2024-05-30T06:58:06.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.379+0000 7fdba4e00640 1 -- 172.21.15.37:0/1460914539 wait complete. 2024-05-30T06:58:06.381 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:06.380+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:06.381 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:06.380+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:06.381 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:06.380+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:06.381 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:06.380+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:06.381 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:06.380+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:06.396 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:06.396+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:06.396 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:06.396+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:06.396 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:06.396+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:06.396 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:06.396+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:06.396 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:06.396+0000 7f0052000640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:06.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone44122 2024-05-30T06:58:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b2c00640 1 Processor -- start 2024-05-30T06:58:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b2c00640 1 -- start start 2024-05-30T06:58:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b2c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95ac09b0a0 0x7f95ac06e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b2c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f95ac0d1140 0x7f95ac0cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b2c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ac0cd980 con 0x7f95ac09acc0 2024-05-30T06:58:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b2c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f95ac0ce590 con 0x7f95ac09b0a0 2024-05-30T06:58:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b2c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f95ac0cd730 con 0x7f95ac0d1140 2024-05-30T06:58:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b0e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95ac09b0a0 0x7f95ac06e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b0e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95ac09b0a0 0x7f95ac06e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34692/0 (socket says 172.21.15.37:34692) 2024-05-30T06:58:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b0e00640 1 -- 172.21.15.37:0/2218185935 learned_addr learned my addr 172.21.15.37:0/2218185935 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b2200640 1 --2- 172.21.15.37:0/2218185935 >> v2:172.21.15.105:3300/0 conn(0x7f95ac0d1140 0x7f95ac0cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b0e00640 1 -- 172.21.15.37:0/2218185935 >> v2:172.21.15.105:3300/0 conn(0x7f95ac0d1140 msgr2=0x7f95ac0cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b0e00640 1 --2- 172.21.15.37:0/2218185935 >> v2:172.21.15.105:3300/0 conn(0x7f95ac0d1140 0x7f95ac0cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b0e00640 1 -- 172.21.15.37:0/2218185935 >> v1:172.21.15.105:6789/0 conn(0x7f95ac09acc0 legacy=0x7f95ac06db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.551+0000 7f95b0e00640 1 -- 172.21.15.37:0/2218185935 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ac0cdc60 con 0x7f95ac09b0a0 2024-05-30T06:58:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.555+0000 7f95b0e00640 1 --2- 172.21.15.37:0/2218185935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95ac09b0a0 0x7f95ac06e290 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0692c0 tx=0x7f959801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e9bd952f955d75 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.555+0000 7f95abe00640 1 -- 172.21.15.37:0/2218185935 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95980b5070 con 0x7f95ac09b0a0 2024-05-30T06:58:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.555+0000 7f95abe00640 1 -- 172.21.15.37:0/2218185935 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95980a8a10 con 0x7f95ac09b0a0 2024-05-30T06:58:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.555+0000 7f95abe00640 1 -- 172.21.15.37:0/2218185935 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95980a8de0 con 0x7f95ac09b0a0 2024-05-30T06:58:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.555+0000 7f95b2c00640 1 -- 172.21.15.37:0/2218185935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95ac09b0a0 msgr2=0x7f95ac06e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.555+0000 7f95b2c00640 1 --2- 172.21.15.37:0/2218185935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95ac09b0a0 0x7f95ac06e290 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0692c0 tx=0x7f959801ed10 comp rx=0 tx=0).stop 2024-05-30T06:58:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.555+0000 7f95b2c00640 1 -- 172.21.15.37:0/2218185935 shutdown_connections 2024-05-30T06:58:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.555+0000 7f95b2c00640 1 --2- 172.21.15.37:0/2218185935 >> v2:172.21.15.105:3300/0 conn(0x7f95ac0d1140 0x7f95ac0cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.555+0000 7f95b2c00640 1 --2- 172.21.15.37:0/2218185935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95ac09b0a0 0x7f95ac06e290 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.555+0000 7f95b2c00640 1 -- 172.21.15.37:0/2218185935 >> 172.21.15.37:0/2218185935 conn(0x7f95ac0b3ef0 msgr2=0x7f95ac0b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:06.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.555+0000 7f95b2c00640 1 -- 172.21.15.37:0/2218185935 shutdown_connections 2024-05-30T06:58:06.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.555+0000 7f95b2c00640 1 -- 172.21.15.37:0/2218185935 wait complete. 2024-05-30T06:58:06.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2c00640 1 Processor -- start 2024-05-30T06:58:06.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2c00640 1 -- start start 2024-05-30T06:58:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95ac09acc0 0x7f95ac15a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95ac09b0a0 0x7f95ac156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95ac0d1140 0x7f95ac156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac0d1570 con 0x7f95ac0d1140 2024-05-30T06:58:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac0ce220 con 0x7f95ac09b0a0 2024-05-30T06:58:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f95ac0cea20 con 0x7f95ac09acc0 2024-05-30T06:58:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95ac0d1140 0x7f95ac156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95ac0d1140 0x7f95ac156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34696/0 (socket says 172.21.15.37:34696) 2024-05-30T06:58:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2200640 1 -- 172.21.15.37:0/3801231177 learned_addr learned my addr 172.21.15.37:0/3801231177 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b0e00640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95ac09b0a0 0x7f95ac156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b1800640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95ac09acc0 0x7f95ac15a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:06.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2200640 1 -- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95ac09acc0 msgr2=0x7f95ac15a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:06.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2200640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95ac09acc0 0x7f95ac15a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:06.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2200640 1 -- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95ac09b0a0 msgr2=0x7f95ac156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:06.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2200640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95ac09b0a0 0x7f95ac156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:06.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2200640 1 -- 172.21.15.37:0/3801231177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ac15e990 con 0x7f95ac0d1140 2024-05-30T06:58:06.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b1800640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95ac09acc0 0x7f95ac15a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:06.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2200640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95ac0d1140 0x7f95ac156650 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009dd0 tx=0x7f95a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:06.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95a9600640 1 -- 172.21.15.37:0/3801231177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4018020 con 0x7f95ac0d1140 2024-05-30T06:58:06.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95a9600640 1 -- 172.21.15.37:0/3801231177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a4014480 con 0x7f95ac0d1140 2024-05-30T06:58:06.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95a9600640 1 -- 172.21.15.37:0/3801231177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4014870 con 0x7f95ac0d1140 2024-05-30T06:58:06.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2c00640 1 -- 172.21.15.37:0/3801231177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ac15ec70 con 0x7f95ac0d1140 2024-05-30T06:58:06.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.559+0000 7f95b2c00640 1 -- 172.21.15.37:0/3801231177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ac15bd00 con 0x7f95ac0d1140 2024-05-30T06:58:06.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.563+0000 7f95b2c00640 1 -- 172.21.15.37:0/3801231177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95ac068ab0 con 0x7f95ac0d1140 2024-05-30T06:58:06.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.563+0000 7f95a9600640 1 -- 172.21.15.37:0/3801231177 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 41) ==== 90231+0+0 (secure 0 0 0) 0x7f95a401b020 con 0x7f95ac0d1140 2024-05-30T06:58:06.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.563+0000 7f95a9600640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f958c069c40 0x7f958c06c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:06.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.563+0000 7f95a9600640 1 -- 172.21.15.37:0/3801231177 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f95a4086290 con 0x7f95ac0d1140 2024-05-30T06:58:06.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.563+0000 7f95b1800640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f958c069c40 0x7f958c06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:06.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.563+0000 7f95b1800640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f958c069c40 0x7f958c06c100 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f95a0001670 tx=0x7f95a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:06.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.567+0000 7f95a9600640 1 -- 172.21.15.37:0/3801231177 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f95a4022070 con 0x7f95ac0d1140 2024-05-30T06:58:06.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:06.767+0000 7f95b2c00640 1 -- 172.21.15.37:0/3801231177 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone44122", "target": ["mon-mgr", ""]}) -- 0x7f95ac071820 con 0x7f958c069c40 2024-05-30T06:58:07.381 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:07.384+0000 7efff4400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:07.382 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:07.384+0000 7efff4400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:07.382 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:07.384+0000 7efff4400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:07.382 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:07.384+0000 7efff4400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:07.382 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:07.384+0000 7efff4400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.475+0000 7f95a9600640 1 -- 172.21.15.37:0/3801231177 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f95ac071820 con 0x7f958c069c40 2024-05-30T06:58:07.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.479+0000 7f95b2c00640 1 -- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f958c069c40 msgr2=0x7f958c06c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:07.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.479+0000 7f95b2c00640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f958c069c40 0x7f958c06c100 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f95a0001670 tx=0x7f95a0009040 comp rx=0 tx=0).stop 2024-05-30T06:58:07.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.479+0000 7f95b2c00640 1 -- 172.21.15.37:0/3801231177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95ac0d1140 msgr2=0x7f95ac156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:07.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.479+0000 7f95b2c00640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95ac0d1140 0x7f95ac156650 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009dd0 tx=0x7f95a400c490 comp rx=0 tx=0).stop 2024-05-30T06:58:07.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.479+0000 7f95b2c00640 1 -- 172.21.15.37:0/3801231177 shutdown_connections 2024-05-30T06:58:07.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.479+0000 7f95b2c00640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95ac0d1140 0x7f95ac156650 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:07.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.479+0000 7f95b2c00640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f958c069c40 0x7f958c06c100 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:07.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.479+0000 7f95b2c00640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f95ac09b0a0 0x7f95ac156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:07.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.479+0000 7f95b2c00640 1 --2- 172.21.15.37:0/3801231177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f95ac09acc0 0x7f95ac15a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:07.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.479+0000 7f95b2c00640 1 -- 172.21.15.37:0/3801231177 >> 172.21.15.37:0/3801231177 conn(0x7f95ac0b3ef0 msgr2=0x7f95ac0b5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:07.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.479+0000 7f95b2c00640 1 -- 172.21.15.37:0/3801231177 shutdown_connections 2024-05-30T06:58:07.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.479+0000 7f95b2c00640 1 -- 172.21.15.37:0/3801231177 wait complete. 2024-05-30T06:58:07.486 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:07.488+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:07.486 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:07.488+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:07.486 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:07.488+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:07.486 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:07.488+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:07.486 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:07.488+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:07.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone44123 2024-05-30T06:58:07.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.747+0000 7f3598200640 1 Processor -- start 2024-05-30T06:58:07.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.747+0000 7f3598200640 1 -- start start 2024-05-30T06:58:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.747+0000 7f3598200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3590158e00 0x7f35900b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.747+0000 7f3598200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359006c070 0x7f35900b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.747+0000 7f3598200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3590071410 con 0x7f35901624a0 2024-05-30T06:58:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.747+0000 7f3598200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f35900b4790 con 0x7f3590158e00 2024-05-30T06:58:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.747+0000 7f3598200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3590162980 con 0x7f359006c070 2024-05-30T06:58:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.747+0000 7f3594e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f35901624a0 0x7f359006b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:58930/0 (socket says 172.21.15.37:58930) 2024-05-30T06:58:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.747+0000 7f3594e00640 1 -- 172.21.15.37:0/1164161168 learned_addr learned my addr 172.21.15.37:0/1164161168 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.747+0000 7f3595800640 1 --2- 172.21.15.37:0/1164161168 >> v2:172.21.15.105:3300/0 conn(0x7f3590158e00 0x7f35900b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.751+0000 7f3596200640 1 --2- 172.21.15.37:0/1164161168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359006c070 0x7f35900b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.751+0000 7f3596200640 1 -- 172.21.15.37:0/1164161168 >> v2:172.21.15.105:3300/0 conn(0x7f3590158e00 msgr2=0x7f35900b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.751+0000 7f3596200640 1 --2- 172.21.15.37:0/1164161168 >> v2:172.21.15.105:3300/0 conn(0x7f3590158e00 0x7f35900b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.751+0000 7f3596200640 1 -- 172.21.15.37:0/1164161168 >> v1:172.21.15.105:6789/0 conn(0x7f35901624a0 legacy=0x7f359006b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:07.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.751+0000 7f3596200640 1 -- 172.21.15.37:0/1164161168 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3590162c60 con 0x7f359006c070 2024-05-30T06:58:07.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.755+0000 7f3596200640 1 --2- 172.21.15.37:0/1164161168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359006c070 0x7f35900b4c20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f35900b4910 tx=0x7f358801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2ecfd04ddfd251c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:07.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.759+0000 7f358fe00640 1 -- 172.21.15.37:0/1164161168 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35880b2070 con 0x7f359006c070 2024-05-30T06:58:07.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.759+0000 7f358fe00640 1 -- 172.21.15.37:0/1164161168 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35880a58f0 con 0x7f359006c070 2024-05-30T06:58:07.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.759+0000 7f358fe00640 1 -- 172.21.15.37:0/1164161168 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35880a5cc0 con 0x7f359006c070 2024-05-30T06:58:07.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.759+0000 7f3598200640 1 -- 172.21.15.37:0/1164161168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359006c070 msgr2=0x7f35900b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:07.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.759+0000 7f3598200640 1 --2- 172.21.15.37:0/1164161168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359006c070 0x7f35900b4c20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f35900b4910 tx=0x7f358801c920 comp rx=0 tx=0).stop 2024-05-30T06:58:07.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.759+0000 7f3598200640 1 -- 172.21.15.37:0/1164161168 shutdown_connections 2024-05-30T06:58:07.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.759+0000 7f3598200640 1 --2- 172.21.15.37:0/1164161168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359006c070 0x7f35900b4c20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:07.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.759+0000 7f3598200640 1 --2- 172.21.15.37:0/1164161168 >> v2:172.21.15.105:3300/0 conn(0x7f3590158e00 0x7f35900b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:07.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.759+0000 7f3598200640 1 -- 172.21.15.37:0/1164161168 >> 172.21.15.37:0/1164161168 conn(0x7f359006f110 msgr2=0x7f359006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:07.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.759+0000 7f3598200640 1 -- 172.21.15.37:0/1164161168 shutdown_connections 2024-05-30T06:58:07.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.759+0000 7f3598200640 1 -- 172.21.15.37:0/1164161168 wait complete. 2024-05-30T06:58:07.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.763+0000 7f3598200640 1 Processor -- start 2024-05-30T06:58:07.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.763+0000 7f3598200640 1 -- start start 2024-05-30T06:58:07.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3598200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359006c070 0x7f35900cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:07.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3598200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3590158e00 0x7f35900caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:07.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3598200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35901624a0 0x7f359014d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:07.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3598200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3590159360 con 0x7f35901624a0 2024-05-30T06:58:07.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3598200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f35901591e0 con 0x7f359006c070 2024-05-30T06:58:07.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3598200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f35900b5f60 con 0x7f3590158e00 2024-05-30T06:58:07.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3596200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35901624a0 0x7f359014d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:07.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3596200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35901624a0 0x7f359014d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59626/0 (socket says 172.21.15.37:59626) 2024-05-30T06:58:07.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3596200640 1 -- 172.21.15.37:0/1884487735 learned_addr learned my addr 172.21.15.37:0/1884487735 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:07.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3594e00640 1 --2- 172.21.15.37:0/1884487735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3590158e00 0x7f35900caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:07.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3596200640 1 -- 172.21.15.37:0/1884487735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3590158e00 msgr2=0x7f35900caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:07.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3596200640 1 --2- 172.21.15.37:0/1884487735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3590158e00 0x7f35900caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:07.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3596200640 1 -- 172.21.15.37:0/1884487735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359006c070 msgr2=0x7f35900cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:07.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3596200640 1 --2- 172.21.15.37:0/1884487735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359006c070 0x7f35900cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:07.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3596200640 1 -- 172.21.15.37:0/1884487735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359014b750 con 0x7f35901624a0 2024-05-30T06:58:07.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3596200640 1 --2- 172.21.15.37:0/1884487735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35901624a0 0x7f359014d870 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f35880b0040 tx=0x7f35880196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:07.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f358d600640 1 -- 172.21.15.37:0/1884487735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35880b2040 con 0x7f35901624a0 2024-05-30T06:58:07.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f358d600640 1 -- 172.21.15.37:0/1884487735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35880bf070 con 0x7f35901624a0 2024-05-30T06:58:07.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f358d600640 1 -- 172.21.15.37:0/1884487735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35880b8890 con 0x7f35901624a0 2024-05-30T06:58:07.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3598200640 1 -- 172.21.15.37:0/1884487735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359014ba30 con 0x7f35901624a0 2024-05-30T06:58:07.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3598200640 1 -- 172.21.15.37:0/1884487735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359014bff0 con 0x7f35901624a0 2024-05-30T06:58:07.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.767+0000 7f3598200640 1 -- 172.21.15.37:0/1884487735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3590068bc0 con 0x7f35901624a0 2024-05-30T06:58:07.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.771+0000 7f358d600640 1 -- 172.21.15.37:0/1884487735 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 41) ==== 90231+0+0 (secure 0 0 0) 0x7f35880b8a30 con 0x7f35901624a0 2024-05-30T06:58:07.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.771+0000 7f358d600640 1 --2- 172.21.15.37:0/1884487735 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3570069c40 0x7f357006c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:07.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.771+0000 7f358d600640 1 -- 172.21.15.37:0/1884487735 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f3588120890 con 0x7f35901624a0 2024-05-30T06:58:07.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.775+0000 7f358d600640 1 -- 172.21.15.37:0/1884487735 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3588016540 con 0x7f35901624a0 2024-05-30T06:58:07.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.779+0000 7f3595800640 1 --2- 172.21.15.37:0/1884487735 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3570069c40 0x7f357006c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:07.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.795+0000 7f3595800640 1 --2- 172.21.15.37:0/1884487735 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3570069c40 0x7f357006c100 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3584006aa0 tx=0x7f3584006a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:07.839+0000 7f358d600640 1 -- 172.21.15.37:0/1884487735 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 42) ==== 90333+0+0 (secure 0 0 0) 0x7f35880ee8c0 con 0x7f35901624a0 2024-05-30T06:58:08.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.083+0000 7f3598200640 1 -- 172.21.15.37:0/1884487735 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone44123", "target": ["mon-mgr", ""]}) -- 0x7f359015e740 con 0x7f3570069c40 2024-05-30T06:58:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.723+0000 7f358d600640 1 -- 172.21.15.37:0/1884487735 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f359015e740 con 0x7f3570069c40 2024-05-30T06:58:08.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.727+0000 7f3598200640 1 -- 172.21.15.37:0/1884487735 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3570069c40 msgr2=0x7f357006c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:08.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.727+0000 7f3598200640 1 --2- 172.21.15.37:0/1884487735 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3570069c40 0x7f357006c100 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3584006aa0 tx=0x7f3584006a30 comp rx=0 tx=0).stop 2024-05-30T06:58:08.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.727+0000 7f3598200640 1 -- 172.21.15.37:0/1884487735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35901624a0 msgr2=0x7f359014d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:08.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.727+0000 7f3598200640 1 --2- 172.21.15.37:0/1884487735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35901624a0 0x7f359014d870 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f35880b0040 tx=0x7f35880196c0 comp rx=0 tx=0).stop 2024-05-30T06:58:08.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.727+0000 7f3598200640 1 -- 172.21.15.37:0/1884487735 shutdown_connections 2024-05-30T06:58:08.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.727+0000 7f3598200640 1 --2- 172.21.15.37:0/1884487735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35901624a0 0x7f359014d870 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:08.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.727+0000 7f3598200640 1 --2- 172.21.15.37:0/1884487735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3590158e00 0x7f35900caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:08.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.727+0000 7f3598200640 1 --2- 172.21.15.37:0/1884487735 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3570069c40 0x7f357006c100 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:08.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.727+0000 7f3598200640 1 --2- 172.21.15.37:0/1884487735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359006c070 0x7f35900cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:08.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.727+0000 7f3598200640 1 -- 172.21.15.37:0/1884487735 >> 172.21.15.37:0/1884487735 conn(0x7f359006f110 msgr2=0x7f359006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:08.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.731+0000 7f3598200640 1 -- 172.21.15.37:0/1884487735 shutdown_connections 2024-05-30T06:58:08.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:08.731+0000 7f3598200640 1 -- 172.21.15.37:0/1884487735 wait complete. 2024-05-30T06:58:08.745 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:08.748+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:08.745 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:08.748+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:08.745 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:08.748+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:08.745 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:08.748+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:08.745 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:08.748+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:09.756 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone44121 2024-05-30T06:58:10.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.007+0000 7f86c1c00640 1 Processor -- start 2024-05-30T06:58:10.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.007+0000 7f86c1c00640 1 -- start start 2024-05-30T06:58:10.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.011+0000 7f86c1c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86bc15b780 0x7f86bc072fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:10.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.011+0000 7f86c1c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f86bc073510 0x7f86bc0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:10.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.011+0000 7f86c1c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86bc073970 con 0x7f86bc0ce910 2024-05-30T06:58:10.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.011+0000 7f86c1c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f86bc0b4be0 con 0x7f86bc15b780 2024-05-30T06:58:10.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.011+0000 7f86c1c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f86bc0b4ec0 con 0x7f86bc073510 2024-05-30T06:58:10.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.011+0000 7f86baa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86bc15b780 0x7f86bc072fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:10.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.011+0000 7f86baa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86bc15b780 0x7f86bc072fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59630/0 (socket says 172.21.15.37:59630) 2024-05-30T06:58:10.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.011+0000 7f86baa00640 1 -- 172.21.15.37:0/3149372001 learned_addr learned my addr 172.21.15.37:0/3149372001 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:10.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.011+0000 7f86baa00640 1 -- 172.21.15.37:0/3149372001 >> v2:172.21.15.105:3300/0 conn(0x7f86bc073510 msgr2=0x7f86bc0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:10.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.011+0000 7f86baa00640 1 --2- 172.21.15.37:0/3149372001 >> v2:172.21.15.105:3300/0 conn(0x7f86bc073510 0x7f86bc0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:10.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.011+0000 7f86baa00640 1 -- 172.21.15.37:0/3149372001 >> v1:172.21.15.105:6789/0 conn(0x7f86bc0ce910 legacy=0x7f86bc070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:10.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.011+0000 7f86baa00640 1 -- 172.21.15.37:0/3149372001 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86bc0b51a0 con 0x7f86bc15b780 2024-05-30T06:58:10.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86baa00640 1 --2- 172.21.15.37:0/3149372001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86bc15b780 0x7f86bc072fd0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f86bc071b80 tx=0x7f86ac01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146869b35445bef9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:10.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86ba000640 1 -- 172.21.15.37:0/3149372001 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0a5590 con 0x7f86bc15b780 2024-05-30T06:58:10.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86ba000640 1 -- 172.21.15.37:0/3149372001 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ac0a5730 con 0x7f86bc15b780 2024-05-30T06:58:10.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86ba000640 1 -- 172.21.15.37:0/3149372001 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0a5b00 con 0x7f86bc15b780 2024-05-30T06:58:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86c1c00640 1 -- 172.21.15.37:0/3149372001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86bc15b780 msgr2=0x7f86bc072fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86c1c00640 1 --2- 172.21.15.37:0/3149372001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86bc15b780 0x7f86bc072fd0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f86bc071b80 tx=0x7f86ac01c9b0 comp rx=0 tx=0).stop 2024-05-30T06:58:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86c1c00640 1 -- 172.21.15.37:0/3149372001 shutdown_connections 2024-05-30T06:58:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86c1c00640 1 --2- 172.21.15.37:0/3149372001 >> v2:172.21.15.105:3300/0 conn(0x7f86bc073510 0x7f86bc0ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:10.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86c1c00640 1 --2- 172.21.15.37:0/3149372001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86bc15b780 0x7f86bc072fd0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:10.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86c1c00640 1 -- 172.21.15.37:0/3149372001 >> 172.21.15.37:0/3149372001 conn(0x7f86bc06f110 msgr2=0x7f86bc06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:10.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86c1c00640 1 -- 172.21.15.37:0/3149372001 shutdown_connections 2024-05-30T06:58:10.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86c1c00640 1 -- 172.21.15.37:0/3149372001 wait complete. 2024-05-30T06:58:10.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86c1c00640 1 Processor -- start 2024-05-30T06:58:10.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.015+0000 7f86c1c00640 1 -- start start 2024-05-30T06:58:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86c1c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86bc073510 0x7f86bc147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86c1c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86bc0ce910 0x7f86bc15dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86c1c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86bc15b780 0x7f86bc15e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86c1c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc0ceec0 con 0x7f86bc0ce910 2024-05-30T06:58:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86c1c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc0ced40 con 0x7f86bc073510 2024-05-30T06:58:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86c1c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f86bc168160 con 0x7f86bc15b780 2024-05-30T06:58:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86b2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86bc0ce910 0x7f86bc15dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86b2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86bc0ce910 0x7f86bc15dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59646/0 (socket says 172.21.15.37:59646) 2024-05-30T06:58:10.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86b2000640 1 -- 172.21.15.37:0/2778559400 learned_addr learned my addr 172.21.15.37:0/2778559400 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86b2000640 1 -- 172.21.15.37:0/2778559400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86bc15b780 msgr2=0x7f86bc15e530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T06:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86b2000640 1 --2- 172.21.15.37:0/2778559400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86bc15b780 0x7f86bc15e530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86b2000640 1 -- 172.21.15.37:0/2778559400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86bc073510 msgr2=0x7f86bc147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86b2000640 1 --2- 172.21.15.37:0/2778559400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86bc073510 0x7f86bc147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86b2000640 1 -- 172.21.15.37:0/2778559400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86bc14ae60 con 0x7f86bc0ce910 2024-05-30T06:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86b2000640 1 --2- 172.21.15.37:0/2778559400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86bc0ce910 0x7f86bc15dff0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f86a400b550 tx=0x7f86a400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86b3400640 1 -- 172.21.15.37:0/2778559400 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4014070 con 0x7f86bc0ce910 2024-05-30T06:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86b3400640 1 -- 172.21.15.37:0/2778559400 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86a4010890 con 0x7f86bc0ce910 2024-05-30T06:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86c1c00640 1 -- 172.21.15.37:0/2778559400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86bc159140 con 0x7f86bc0ce910 2024-05-30T06:58:10.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86b3400640 1 -- 172.21.15.37:0/2778559400 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4010c80 con 0x7f86bc0ce910 2024-05-30T06:58:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86c1c00640 1 -- 172.21.15.37:0/2778559400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86bc159700 con 0x7f86bc0ce910 2024-05-30T06:58:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.019+0000 7f86c1c00640 1 -- 172.21.15.37:0/2778559400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86bc068bc0 con 0x7f86bc0ce910 2024-05-30T06:58:10.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.023+0000 7f86b3400640 1 -- 172.21.15.37:0/2778559400 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7f86a4017070 con 0x7f86bc0ce910 2024-05-30T06:58:10.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.023+0000 7f86b3400640 1 --2- 172.21.15.37:0/2778559400 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8698069f10 0x7f869806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:10.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.023+0000 7f86b3400640 1 -- 172.21.15.37:0/2778559400 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f86a40855c0 con 0x7f86bc0ce910 2024-05-30T06:58:10.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.027+0000 7f86b3400640 1 -- 172.21.15.37:0/2778559400 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f86bc14ae60 con 0x7f86bc0ce910 2024-05-30T06:58:10.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.031+0000 7f86baa00640 1 --2- 172.21.15.37:0/2778559400 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8698069f10 0x7f869806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:10.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.035+0000 7f86baa00640 1 --2- 172.21.15.37:0/2778559400 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8698069f10 0x7f869806c3d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0ae000 tx=0x7f86ac004ac0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:10.359+0000 7f86c1c00640 1 -- 172.21.15.37:0/2778559400 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone44121", "target": ["mon-mgr", ""]}) -- 0x7f86bc0b6300 con 0x7f8698069f10 2024-05-30T06:58:11.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.255+0000 7f86b3400640 1 -- 172.21.15.37:0/2778559400 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f86bc0b6300 con 0x7f8698069f10 2024-05-30T06:58:11.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.259+0000 7f86c1c00640 1 -- 172.21.15.37:0/2778559400 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8698069f10 msgr2=0x7f869806c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:11.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.259+0000 7f86c1c00640 1 --2- 172.21.15.37:0/2778559400 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8698069f10 0x7f869806c3d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0ae000 tx=0x7f86ac004ac0 comp rx=0 tx=0).stop 2024-05-30T06:58:11.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.259+0000 7f86c1c00640 1 -- 172.21.15.37:0/2778559400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86bc0ce910 msgr2=0x7f86bc15dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:11.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.259+0000 7f86c1c00640 1 --2- 172.21.15.37:0/2778559400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86bc0ce910 0x7f86bc15dff0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f86a400b550 tx=0x7f86a400ba10 comp rx=0 tx=0).stop 2024-05-30T06:58:11.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.263+0000 7f86c1c00640 1 -- 172.21.15.37:0/2778559400 shutdown_connections 2024-05-30T06:58:11.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.263+0000 7f86c1c00640 1 --2- 172.21.15.37:0/2778559400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86bc15b780 0x7f86bc15e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:11.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.263+0000 7f86c1c00640 1 --2- 172.21.15.37:0/2778559400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86bc0ce910 0x7f86bc15dff0 secure :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f86a400b550 tx=0x7f86a400ba10 comp rx=0 tx=0).stop 2024-05-30T06:58:11.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.263+0000 7f86c1c00640 1 --2- 172.21.15.37:0/2778559400 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8698069f10 0x7f869806c3d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:11.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.263+0000 7f86c1c00640 1 --2- 172.21.15.37:0/2778559400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86bc073510 0x7f86bc147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:11.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.263+0000 7f86c1c00640 1 -- 172.21.15.37:0/2778559400 >> 172.21.15.37:0/2778559400 conn(0x7f86bc06f110 msgr2=0x7f86bc1576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:11.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.267+0000 7f86c1c00640 1 -- 172.21.15.37:0/2778559400 shutdown_connections 2024-05-30T06:58:11.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.267+0000 7f86c1c00640 1 -- 172.21.15.37:0/2778559400 wait complete. 2024-05-30T06:58:11.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone44122 2024-05-30T06:58:11.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.547+0000 7f4141200640 1 Processor -- start 2024-05-30T06:58:11.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.551+0000 7f4141200640 1 -- start start 2024-05-30T06:58:11.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.551+0000 7f4141200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f413c145f60 0x7f413c15d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:11.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.551+0000 7f4141200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f413c06b960 0x7f413c06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:11.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.551+0000 7f4141200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f413c0d0be0 con 0x7f413c073060 2024-05-30T06:58:11.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.551+0000 7f4141200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f413c06c310 con 0x7f413c06b960 2024-05-30T06:58:11.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.551+0000 7f4141200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f413c0d09a0 con 0x7f413c145f60 2024-05-30T06:58:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.551+0000 7f413a800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f413c06b960 0x7f413c06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.551+0000 7f413a800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f413c06b960 0x7f413c06bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59658/0 (socket says 172.21.15.37:59658) 2024-05-30T06:58:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.551+0000 7f413a800640 1 -- 172.21.15.37:0/4197865646 learned_addr learned my addr 172.21.15.37:0/4197865646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:11.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.551+0000 7f4139e00640 1 --2- 172.21.15.37:0/4197865646 >> v2:172.21.15.105:3300/0 conn(0x7f413c145f60 0x7f413c15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:11.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.555+0000 7f413a800640 1 -- 172.21.15.37:0/4197865646 >> v2:172.21.15.105:3300/0 conn(0x7f413c145f60 msgr2=0x7f413c15d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:11.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.555+0000 7f413a800640 1 --2- 172.21.15.37:0/4197865646 >> v2:172.21.15.105:3300/0 conn(0x7f413c145f60 0x7f413c15d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:11.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.555+0000 7f413a800640 1 -- 172.21.15.37:0/4197865646 >> v1:172.21.15.105:6789/0 conn(0x7f413c073060 legacy=0x7f413c0d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:11.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.555+0000 7f413a800640 1 -- 172.21.15.37:0/4197865646 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413c0d0ec0 con 0x7f413c06b960 2024-05-30T06:58:11.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.555+0000 7f4139e00640 1 --2- 172.21.15.37:0/4197865646 >> v2:172.21.15.105:3300/0 conn(0x7f413c145f60 0x7f413c15d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:58:11.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.559+0000 7f413a800640 1 --2- 172.21.15.37:0/4197865646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c06b960 0x7f413c06bdd0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f413c070220 tx=0x7f413401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5340135fdaac943 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:11.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.559+0000 7f4138a00640 1 -- 172.21.15.37:0/4197865646 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41340a57d0 con 0x7f413c06b960 2024-05-30T06:58:11.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.559+0000 7f4138a00640 1 -- 172.21.15.37:0/4197865646 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41340a5970 con 0x7f413c06b960 2024-05-30T06:58:11.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.559+0000 7f4138a00640 1 -- 172.21.15.37:0/4197865646 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41340a5d40 con 0x7f413c06b960 2024-05-30T06:58:11.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.559+0000 7f4141200640 1 -- 172.21.15.37:0/4197865646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c06b960 msgr2=0x7f413c06bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:11.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.559+0000 7f4141200640 1 --2- 172.21.15.37:0/4197865646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c06b960 0x7f413c06bdd0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f413c070220 tx=0x7f413401c9f0 comp rx=0 tx=0).stop 2024-05-30T06:58:11.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.559+0000 7f4141200640 1 -- 172.21.15.37:0/4197865646 shutdown_connections 2024-05-30T06:58:11.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.559+0000 7f4141200640 1 --2- 172.21.15.37:0/4197865646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c06b960 0x7f413c06bdd0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:11.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.559+0000 7f4141200640 1 --2- 172.21.15.37:0/4197865646 >> v2:172.21.15.105:3300/0 conn(0x7f413c145f60 0x7f413c15d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:11.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.559+0000 7f4141200640 1 -- 172.21.15.37:0/4197865646 >> 172.21.15.37:0/4197865646 conn(0x7f413c0b31a0 msgr2=0x7f413c0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:11.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.559+0000 7f4141200640 1 -- 172.21.15.37:0/4197865646 shutdown_connections 2024-05-30T06:58:11.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.559+0000 7f4141200640 1 -- 172.21.15.37:0/4197865646 wait complete. 2024-05-30T06:58:11.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.563+0000 7f4141200640 1 Processor -- start 2024-05-30T06:58:11.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.563+0000 7f4141200640 1 -- start start 2024-05-30T06:58:11.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.563+0000 7f4141200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f413c06b960 0x7f413c144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:11.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.563+0000 7f4141200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f413c073060 0x7f413c0b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:11.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.563+0000 7f4141200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c145f60 0x7f413c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:11.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.563+0000 7f4141200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f413c070e00 con 0x7f413c145f60 2024-05-30T06:58:11.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.563+0000 7f4141200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f413c0d11a0 con 0x7f413c073060 2024-05-30T06:58:11.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.563+0000 7f4141200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f413c070f80 con 0x7f413c06b960 2024-05-30T06:58:11.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f413a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c145f60 0x7f413c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:11.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f413a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c145f60 0x7f413c0b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59672/0 (socket says 172.21.15.37:59672) 2024-05-30T06:58:11.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f413a800640 1 -- 172.21.15.37:0/2114698488 learned_addr learned my addr 172.21.15.37:0/2114698488 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:11.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f4139e00640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f413c06b960 0x7f413c144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f4139400640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f413c073060 0x7f413c0b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f413a800640 1 -- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f413c06b960 msgr2=0x7f413c144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f413a800640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f413c06b960 0x7f413c144700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f413a800640 1 -- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f413c073060 msgr2=0x7f413c0b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f413a800640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f413c073060 0x7f413c0b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f413a800640 1 -- 172.21.15.37:0/2114698488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413c144c40 con 0x7f413c145f60 2024-05-30T06:58:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f4139400640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f413c073060 0x7f413c0b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:58:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f413a800640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c145f60 0x7f413c0b4e40 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f41340af040 tx=0x7f4134019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f4132000640 1 -- 172.21.15.37:0/2114698488 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41340b8670 con 0x7f413c145f60 2024-05-30T06:58:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f4132000640 1 -- 172.21.15.37:0/2114698488 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41340be070 con 0x7f413c145f60 2024-05-30T06:58:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f4132000640 1 -- 172.21.15.37:0/2114698488 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41340b8a90 con 0x7f413c145f60 2024-05-30T06:58:11.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f4141200640 1 -- 172.21.15.37:0/2114698488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413c144ef0 con 0x7f413c145f60 2024-05-30T06:58:11.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.567+0000 7f4141200640 1 -- 172.21.15.37:0/2114698488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f413c1454b0 con 0x7f413c145f60 2024-05-30T06:58:11.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.571+0000 7f4141200640 1 -- 172.21.15.37:0/2114698488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f413c068bc0 con 0x7f413c145f60 2024-05-30T06:58:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.571+0000 7f4132000640 1 -- 172.21.15.37:0/2114698488 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7f41340b8c30 con 0x7f413c145f60 2024-05-30T06:58:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.575+0000 7f4132000640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f411c069f60 0x7f411c06c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.579+0000 7f4132000640 1 -- 172.21.15.37:0/2114698488 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f4134120820 con 0x7f413c145f60 2024-05-30T06:58:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.579+0000 7f4139e00640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f411c069f60 0x7f411c06c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:11.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.583+0000 7f4139e00640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f411c069f60 0x7f411c06c420 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4128009580 tx=0x7f4128008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:11.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.583+0000 7f4132000640 1 -- 172.21.15.37:0/2114698488 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f41340165e0 con 0x7f413c145f60 2024-05-30T06:58:11.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:11.931+0000 7f4141200640 1 -- 172.21.15.37:0/2114698488 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone44122", "target": ["mon-mgr", ""]}) -- 0x7f413c071900 con 0x7f411c069f60 2024-05-30T06:58:12.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.355+0000 7f4132000640 1 -- 172.21.15.37:0/2114698488 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f413c071900 con 0x7f411c069f60 2024-05-30T06:58:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.359+0000 7f4141200640 1 -- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f411c069f60 msgr2=0x7f411c06c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.359+0000 7f4141200640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f411c069f60 0x7f411c06c420 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4128009580 tx=0x7f4128008040 comp rx=0 tx=0).stop 2024-05-30T06:58:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.359+0000 7f4141200640 1 -- 172.21.15.37:0/2114698488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c145f60 msgr2=0x7f413c0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.359+0000 7f4141200640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c145f60 0x7f413c0b4e40 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f41340af040 tx=0x7f4134019790 comp rx=0 tx=0).stop 2024-05-30T06:58:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.363+0000 7f4141200640 1 -- 172.21.15.37:0/2114698488 shutdown_connections 2024-05-30T06:58:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.363+0000 7f4141200640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c145f60 0x7f413c0b4e40 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.363+0000 7f4141200640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f411c069f60 0x7f411c06c420 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.363+0000 7f4141200640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f413c073060 0x7f413c0b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.363+0000 7f4141200640 1 --2- 172.21.15.37:0/2114698488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f413c06b960 0x7f413c144700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.363+0000 7f4141200640 1 -- 172.21.15.37:0/2114698488 >> 172.21.15.37:0/2114698488 conn(0x7f413c0b31a0 msgr2=0x7f413c13f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.363+0000 7f4141200640 1 -- 172.21.15.37:0/2114698488 shutdown_connections 2024-05-30T06:58:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.363+0000 7f4141200640 1 -- 172.21.15.37:0/2114698488 wait complete. 2024-05-30T06:58:12.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone44123 2024-05-30T06:58:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.587+0000 7fcec6000640 1 Processor -- start 2024-05-30T06:58:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.587+0000 7fcec6000640 1 -- start start 2024-05-30T06:58:12.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcec6000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcec00b5860 0x7fcec0166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:12.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcec6000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec015beb0 con 0x7fcec015ba70 2024-05-30T06:58:12.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcec6000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec00aed20 con 0x7fcec015b690 2024-05-30T06:58:12.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcec6000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcec00af000 con 0x7fcec00b5860 2024-05-30T06:58:12.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fceb7e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcec015ba70 0x7fcec00b5150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53390/0 (socket says 172.21.15.37:53390) 2024-05-30T06:58:12.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fceb7e00640 1 -- 172.21.15.37:0/3909209554 learned_addr learned my addr 172.21.15.37:0/3909209554 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:12.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2722030101 0 0) 0x7fcea8001120 con 0x7fcec015ba70 2024-05-30T06:58:12.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcea4005740 con 0x7fcec015ba70 2024-05-30T06:58:12.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 27207917 0 0) 0x7fcea4005740 con 0x7fcec015ba70 2024-05-30T06:58:12.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 >> v2:172.21.15.105:3300/0 conn(0x7fcec00b5860 msgr2=0x7fcec0166230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:12.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 --2- 172.21.15.37:0/3909209554 >> v2:172.21.15.105:3300/0 conn(0x7fcec00b5860 0x7fcec0166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:12.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 >> v1:172.21.15.105:6789/0 conn(0x7fcec015b690 legacy=0x7fcec00b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:12.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec00af2e0 con 0x7fcec015ba70 2024-05-30T06:58:12.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fcea8001850 con 0x7fcec015ba70 2024-05-30T06:58:12.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 >> v1:172.21.15.37:6789/0 conn(0x7fcec015ba70 legacy=0x7fcec00b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:12.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 --2- 172.21.15.37:0/3909209554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcea4005bd0 0x7fcea4005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 --2- 172.21.15.37:0/3909209554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea4006a20 0x7fcea4006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 --2- 172.21.15.37:0/3909209554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea4007500 0x7fcea400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcec00af000 con 0x7fcea4007500 2024-05-30T06:58:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcea400e400 con 0x7fcea4005bd0 2024-05-30T06:58:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcea400e600 con 0x7fcea4006a20 2024-05-30T06:58:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcec5600640 1 --2- 172.21.15.37:0/3909209554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea4007500 0x7fcea400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcec5600640 1 -- 172.21.15.37:0/3909209554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea4006a20 msgr2=0x7fcea4006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:12.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcec5600640 1 --2- 172.21.15.37:0/3909209554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea4006a20 0x7fcea4006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcec5600640 1 -- 172.21.15.37:0/3909209554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcea4005bd0 msgr2=0x7fcea4005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcec5600640 1 --2- 172.21.15.37:0/3909209554 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcea4005bd0 0x7fcea4005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.591+0000 7fcec5600640 1 -- 172.21.15.37:0/3909209554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea4005740 con 0x7fcea4007500 2024-05-30T06:58:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.595+0000 7fcec5600640 1 -- 172.21.15.37:0/3909209554 reap_dead start 2024-05-30T06:58:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.595+0000 7fcec5600640 1 --2- 172.21.15.37:0/3909209554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea4007500 0x7fcea400dbe0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009c70 tx=0x7fceb801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5df9ace7ee774e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.595+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8006e60 con 0x7fcea4007500 2024-05-30T06:58:12.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.595+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb80a5c60 con 0x7fcea4007500 2024-05-30T06:58:12.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.595+0000 7fcebfe00640 1 -- 172.21.15.37:0/3909209554 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8003bc0 con 0x7fcea4007500 2024-05-30T06:58:12.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.599+0000 7fcec6000640 1 -- 172.21.15.37:0/3909209554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea4007500 msgr2=0x7fcea400dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:12.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.599+0000 7fcec6000640 1 --2- 172.21.15.37:0/3909209554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea4007500 0x7fcea400dbe0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009c70 tx=0x7fceb801cc50 comp rx=0 tx=0).stop 2024-05-30T06:58:12.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.599+0000 7fcec6000640 1 -- 172.21.15.37:0/3909209554 shutdown_connections 2024-05-30T06:58:12.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.599+0000 7fcec6000640 1 --2- 172.21.15.37:0/3909209554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea4007500 0x7fcea400dbe0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:12.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.599+0000 7fcec6000640 1 -- 172.21.15.37:0/3909209554 >> 172.21.15.37:0/3909209554 conn(0x7fcec006d4f0 msgr2=0x7fcec009aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:12.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.599+0000 7fcec6000640 1 -- 172.21.15.37:0/3909209554 shutdown_connections 2024-05-30T06:58:12.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.599+0000 7fcec6000640 1 -- 172.21.15.37:0/3909209554 wait complete. 2024-05-30T06:58:12.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.599+0000 7fcec6000640 1 Processor -- start 2024-05-30T06:58:12.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.599+0000 7fcec6000640 1 -- start start 2024-05-30T06:58:12.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea4007500 0x7fcec014cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:12.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec6000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec0155ca0 0x7fcec015a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:12.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec6000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcec0156120 0x7fcec015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:12.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec6000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcec00b4860 con 0x7fcea4007500 2024-05-30T06:58:12.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec6000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcec00af8a0 con 0x7fcec0156120 2024-05-30T06:58:12.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec6000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcec00ae940 con 0x7fcec0155ca0 2024-05-30T06:58:12.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea4007500 0x7fcec014cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:12.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea4007500 0x7fcec014cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59690/0 (socket says 172.21.15.37:59690) 2024-05-30T06:58:12.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec4c00640 1 -- 172.21.15.37:0/2671453150 learned_addr learned my addr 172.21.15.37:0/2671453150 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:12.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fceb7e00640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec0155ca0 0x7fcec015a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:12.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec5600640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcec0156120 0x7fcec015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:12.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec4c00640 1 -- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec0155ca0 msgr2=0x7fcec015a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:12.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec4c00640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec0155ca0 0x7fcec015a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec4c00640 1 -- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcec0156120 msgr2=0x7fcec015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec4c00640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcec0156120 0x7fcec015a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec4c00640 1 -- 172.21.15.37:0/2671453150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec01f3970 con 0x7fcea4007500 2024-05-30T06:58:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec4c00640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea4007500 0x7fcec014cca0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fceb000c410 tx=0x7fceb000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fceb7e00640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec0155ca0 0x7fcec015a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcebd600640 1 -- 172.21.15.37:0/2671453150 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb0017070 con 0x7fcea4007500 2024-05-30T06:58:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcebd600640 1 -- 172.21.15.37:0/2671453150 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb0003600 con 0x7fcea4007500 2024-05-30T06:58:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcebd600640 1 -- 172.21.15.37:0/2671453150 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb00039d0 con 0x7fcea4007500 2024-05-30T06:58:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec6000640 1 -- 172.21.15.37:0/2671453150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec01f3c50 con 0x7fcea4007500 2024-05-30T06:58:12.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.603+0000 7fcec6000640 1 -- 172.21.15.37:0/2671453150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec01f4210 con 0x7fcea4007500 2024-05-30T06:58:12.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.607+0000 7fcec6000640 1 -- 172.21.15.37:0/2671453150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec0075580 con 0x7fcea4007500 2024-05-30T06:58:12.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.607+0000 7fcebd600640 1 -- 172.21.15.37:0/2671453150 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7fceb001a070 con 0x7fcea4007500 2024-05-30T06:58:12.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.607+0000 7fcebd600640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce9c069f00 0x7fce9c06c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:12.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.607+0000 7fcebd600640 1 -- 172.21.15.37:0/2671453150 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7fceb0084c40 con 0x7fcea4007500 2024-05-30T06:58:12.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.611+0000 7fcebd600640 1 -- 172.21.15.37:0/2671453150 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fceb0056ce0 con 0x7fcea4007500 2024-05-30T06:58:12.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.615+0000 7fceb7e00640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce9c069f00 0x7fce9c06c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:12.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.619+0000 7fceb7e00640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce9c069f00 0x7fce9c06c3c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000fc0 tx=0x7fcea8001d80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:12.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:12.935+0000 7fcec6000640 1 -- 172.21.15.37:0/2671453150 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone44123", "target": ["mon-mgr", ""]}) -- 0x7fcec0073ff0 con 0x7fce9c069f00 2024-05-30T06:58:13.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:13.087+0000 7fcebd600640 1 -- 172.21.15.37:0/2671453150 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcec0073ff0 con 0x7fce9c069f00 2024-05-30T06:58:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:13.087+0000 7fcec6000640 1 -- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce9c069f00 msgr2=0x7fce9c06c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:13.087+0000 7fcec6000640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce9c069f00 0x7fce9c06c3c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000fc0 tx=0x7fcea8001d80 comp rx=0 tx=0).stop 2024-05-30T06:58:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:13.087+0000 7fcec6000640 1 -- 172.21.15.37:0/2671453150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea4007500 msgr2=0x7fcec014cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:13.087+0000 7fcec6000640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea4007500 0x7fcec014cca0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fceb000c410 tx=0x7fceb000c8d0 comp rx=0 tx=0).stop 2024-05-30T06:58:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:13.087+0000 7fcec6000640 1 -- 172.21.15.37:0/2671453150 shutdown_connections 2024-05-30T06:58:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:13.087+0000 7fcec6000640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fce9c069f00 0x7fce9c06c3c0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:13.087+0000 7fcec6000640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcec0156120 0x7fcec015a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:13.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:13.087+0000 7fcec6000640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec0155ca0 0x7fcec015a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:13.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:13.087+0000 7fcec6000640 1 --2- 172.21.15.37:0/2671453150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea4007500 0x7fcec014cca0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:13.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:13.087+0000 7fcec6000640 1 -- 172.21.15.37:0/2671453150 >> 172.21.15.37:0/2671453150 conn(0x7fcec006d4f0 msgr2=0x7fcec006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:13.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:13.087+0000 7fcec6000640 1 -- 172.21.15.37:0/2671453150 shutdown_connections 2024-05-30T06:58:13.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:13.087+0000 7fcec6000640 1 -- 172.21.15.37:0/2671453150 wait complete. 2024-05-30T06:58:18.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:58:18.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.259+0000 7fd88ca00640 1 Processor -- start 2024-05-30T06:58:18.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.259+0000 7fd88ca00640 1 -- start start 2024-05-30T06:58:18.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd88ca00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd88806b960 0x7fd88815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd88ca00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd8880cd2a0 0x7fd8880b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd88ca00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd888160580 con 0x7fd88806bd40 2024-05-30T06:58:18.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd88ca00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd8880b3fd0 con 0x7fd88806b960 2024-05-30T06:58:18.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd88ca00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd888160860 con 0x7fd8880cd2a0 2024-05-30T06:58:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd885e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd88806b960 0x7fd88815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd886800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd88806bd40 0x7fd8880cf0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58990/0 (socket says 172.21.15.37:58990) 2024-05-30T06:58:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd886800640 1 -- 172.21.15.37:0/3301284687 learned_addr learned my addr 172.21.15.37:0/3301284687 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd87d400640 1 --2- 172.21.15.37:0/3301284687 >> v2:172.21.15.105:3300/0 conn(0x7fd8880cd2a0 0x7fd8880b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd885e00640 1 -- 172.21.15.37:0/3301284687 >> v2:172.21.15.105:3300/0 conn(0x7fd8880cd2a0 msgr2=0x7fd8880b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd885e00640 1 --2- 172.21.15.37:0/3301284687 >> v2:172.21.15.105:3300/0 conn(0x7fd8880cd2a0 0x7fd8880b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd885e00640 1 -- 172.21.15.37:0/3301284687 >> v1:172.21.15.37:6789/0 conn(0x7fd88806bd40 legacy=0x7fd8880cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd885e00640 1 -- 172.21.15.37:0/3301284687 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd888160b40 con 0x7fd88806b960 2024-05-30T06:58:18.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.263+0000 7fd885400640 1 -- 172.21.15.37:0/3301284687 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678316743 0 0) 0x7fd888160580 con 0x7fd88806bd40 2024-05-30T06:58:18.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd885e00640 1 --2- 172.21.15.37:0/3301284687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd88806b960 0x7fd88815cdf0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fd888073440 tx=0x7fd87801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2206391285019d0c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:18.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd885400640 1 -- 172.21.15.37:0/3301284687 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8780b0070 con 0x7fd88806b960 2024-05-30T06:58:18.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd885400640 1 -- 172.21.15.37:0/3301284687 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8780ab600 con 0x7fd88806b960 2024-05-30T06:58:18.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd885400640 1 -- 172.21.15.37:0/3301284687 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8780ab9d0 con 0x7fd88806b960 2024-05-30T06:58:18.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd88ca00640 1 -- 172.21.15.37:0/3301284687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd88806b960 msgr2=0x7fd88815cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd88ca00640 1 --2- 172.21.15.37:0/3301284687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd88806b960 0x7fd88815cdf0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fd888073440 tx=0x7fd87801c450 comp rx=0 tx=0).stop 2024-05-30T06:58:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd88ca00640 1 -- 172.21.15.37:0/3301284687 shutdown_connections 2024-05-30T06:58:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd88ca00640 1 --2- 172.21.15.37:0/3301284687 >> v2:172.21.15.105:3300/0 conn(0x7fd8880cd2a0 0x7fd8880b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd88ca00640 1 --2- 172.21.15.37:0/3301284687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd88806b960 0x7fd88815cdf0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd88ca00640 1 -- 172.21.15.37:0/3301284687 >> 172.21.15.37:0/3301284687 conn(0x7fd88809aa60 msgr2=0x7fd8880b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd88ca00640 1 -- 172.21.15.37:0/3301284687 shutdown_connections 2024-05-30T06:58:18.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd88ca00640 1 -- 172.21.15.37:0/3301284687 wait complete. 2024-05-30T06:58:18.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd88ca00640 1 Processor -- start 2024-05-30T06:58:18.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.267+0000 7fd88ca00640 1 -- start start 2024-05-30T06:58:18.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd88ca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd88806b960 0x7fd88815b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd88ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd88806bd40 0x7fd888152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd88ca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8880cd2a0 0x7fd88806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd88ca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd88815a800 con 0x7fd88806bd40 2024-05-30T06:58:18.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd88ca00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd88815a680 con 0x7fd8880cd2a0 2024-05-30T06:58:18.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd88ca00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd888169780 con 0x7fd88806b960 2024-05-30T06:58:18.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd87d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd88806bd40 0x7fd888152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd87d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd88806bd40 0x7fd888152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58912/0 (socket says 172.21.15.37:58912) 2024-05-30T06:58:18.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd87d400640 1 -- 172.21.15.37:0/2291265797 learned_addr learned my addr 172.21.15.37:0/2291265797 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:18.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd885e00640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd88806b960 0x7fd88815b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd886800640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8880cd2a0 0x7fd88806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd87d400640 1 -- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd88806b960 msgr2=0x7fd88815b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:18.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd87d400640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd88806b960 0x7fd88815b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd87d400640 1 -- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8880cd2a0 msgr2=0x7fd88806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:18.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd87d400640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8880cd2a0 0x7fd88806fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd87d400640 1 -- 172.21.15.37:0/2291265797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88815c740 con 0x7fd88806bd40 2024-05-30T06:58:18.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd885e00640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd88806b960 0x7fd88815b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:18.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd87d400640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd88806bd40 0x7fd888152600 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fd87000d620 tx=0x7fd87000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:18.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd87ea00640 1 -- 172.21.15.37:0/2291265797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87000b620 con 0x7fd88806bd40 2024-05-30T06:58:18.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd87ea00640 1 -- 172.21.15.37:0/2291265797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd870019070 con 0x7fd88806bd40 2024-05-30T06:58:18.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd88ca00640 1 -- 172.21.15.37:0/2291265797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd88815b6a0 con 0x7fd88806bd40 2024-05-30T06:58:18.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd87ea00640 1 -- 172.21.15.37:0/2291265797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd87000b9e0 con 0x7fd88806bd40 2024-05-30T06:58:18.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd88ca00640 1 -- 172.21.15.37:0/2291265797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd88815bc60 con 0x7fd88806bd40 2024-05-30T06:58:18.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd88ca00640 1 -- 172.21.15.37:0/2291265797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd888068b20 con 0x7fd88806bd40 2024-05-30T06:58:18.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.271+0000 7fd87ea00640 1 -- 172.21.15.37:0/2291265797 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7fd87000bb80 con 0x7fd88806bd40 2024-05-30T06:58:18.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.275+0000 7fd87ea00640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd864069f40 0x7fd86406c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.275+0000 7fd87ea00640 1 -- 172.21.15.37:0/2291265797 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7fd870085c50 con 0x7fd88806bd40 2024-05-30T06:58:18.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.275+0000 7fd885e00640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd864069f40 0x7fd86406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.275+0000 7fd885e00640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd864069f40 0x7fd86406c400 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd8780ad000 tx=0x7fd878008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:18.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.279+0000 7fd87ea00640 1 -- 172.21.15.37:0/2291265797 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd870057d10 con 0x7fd88806bd40 2024-05-30T06:58:18.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.499+0000 7fd88ca00640 1 -- 172.21.15.37:0/2291265797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd88806c490 con 0x7fd88806bd40 2024-05-30T06:58:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.503+0000 7fd87ea00640 1 -- 172.21.15.37:0/2291265797 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2576 (secure 0 0 0) 0x7fd870057610 con 0x7fd88806bd40 2024-05-30T06:58:18.501 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:18.501 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:58:18.501 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:58:18.502 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:58:18.502 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:58:18.502 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:58:18.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:58:18.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:18.502 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:58:18.502 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:58:18.502 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:58:18.502 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:58:18.502 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:58:18.502 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:18.502 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:58:18.503 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:58:18.503 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:58:18.503 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:58:18.503 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:18.503 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 992, 2024-05-30T06:58:18.503 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:58:18.503 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:58:18.503 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:58:18.503 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:58:18.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:18.503 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:58:18.504 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 116, 2024-05-30T06:58:18.504 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:58:18.504 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:58:18.504 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:58:18.504 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:58:18.504 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:58:18.504 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:58:18.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:18.504 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:58:18.504 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:58:18.504 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:18.504 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:58:18.504 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:58:18.505 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:18.505 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:18.505 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:58:18.505 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:58:18.505 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1774, 2024-05-30T06:58:18.505 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 7282554219, 2024-05-30T06:58:18.505 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 15490035712, 2024-05-30T06:58:18.505 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 757604077568, 2024-05-30T06:58:18.505 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:58:18.505 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 342414489, 2024-05-30T06:58:18.505 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 338263916, 2024-05-30T06:58:18.505 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 84, 2024-05-30T06:58:18.505 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 94 2024-05-30T06:58:18.506 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:18.506 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:58:18.506 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:58:18.506 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8, 2024-05-30T06:58:18.506 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:58:18.506 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:58:18.506 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:58:18.506 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:58:18.506 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:18.506 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 8, 2024-05-30T06:58:18.506 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:58:18.506 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:58:18.506 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:58:18.507 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9120 2024-05-30T06:58:18.507 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:18.507 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:18.507 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:58:18.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:18.507 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:58:18.507 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:58:18.507 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:58:18.507 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:58:18.507 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:58:18.507 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:58:18.507 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:58:18.507 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:18.508 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:58:18.508 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:18.508 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:58:18.508 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 19, 2024-05-30T06:58:18.508 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:58:16.987070+0000", 2024-05-30T06:58:18.508 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-05-30T06:58:18.508 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-05-30T06:58:18.508 INFO:teuthology.orchestra.run.smithi037.stdout: "daemons": { 2024-05-30T06:58:18.508 INFO:teuthology.orchestra.run.smithi037.stdout: "summary": "", 2024-05-30T06:58:18.508 INFO:teuthology.orchestra.run.smithi037.stdout: "a": { 2024-05-30T06:58:18.508 INFO:teuthology.orchestra.run.smithi037.stdout: "start_epoch": 0, 2024-05-30T06:58:18.508 INFO:teuthology.orchestra.run.smithi037.stdout: "start_stamp": "0.000000", 2024-05-30T06:58:18.508 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 0, 2024-05-30T06:58:18.509 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T06:58:18.509 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": {}, 2024-05-30T06:58:18.509 INFO:teuthology.orchestra.run.smithi037.stdout: "task_status": {} 2024-05-30T06:58:18.509 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:18.509 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:18.509 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:18.509 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:18.509 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:18.509 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:58:18.509 INFO:teuthology.orchestra.run.smithi037.stdout: "009dbaae-3bd5-474a-bd56-040066fd8c8f": { 2024-05-30T06:58:18.509 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 28.0 seconds before exiting (8s)\n [============================] ", 2024-05-30T06:58:18.509 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:58:18.509 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:58:18.510 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:18.510 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:18.510 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:58:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.503+0000 7fd88ca00640 1 -- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd864069f40 msgr2=0x7fd86406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.503+0000 7fd88ca00640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd864069f40 0x7fd86406c400 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd8780ad000 tx=0x7fd878008040 comp rx=0 tx=0).stop 2024-05-30T06:58:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.503+0000 7fd88ca00640 1 -- 172.21.15.37:0/2291265797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd88806bd40 msgr2=0x7fd888152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.503+0000 7fd88ca00640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd88806bd40 0x7fd888152600 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fd87000d620 tx=0x7fd87000dae0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.503+0000 7fd88ca00640 1 -- 172.21.15.37:0/2291265797 shutdown_connections 2024-05-30T06:58:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.503+0000 7fd88ca00640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd864069f40 0x7fd86406c400 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.503+0000 7fd88ca00640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8880cd2a0 0x7fd88806fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.503+0000 7fd88ca00640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd88806bd40 0x7fd888152600 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.503+0000 7fd88ca00640 1 --2- 172.21.15.37:0/2291265797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd88806b960 0x7fd88815b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.503+0000 7fd88ca00640 1 -- 172.21.15.37:0/2291265797 >> 172.21.15.37:0/2291265797 conn(0x7fd88809aa60 msgr2=0x7fd888153720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.503+0000 7fd88ca00640 1 -- 172.21.15.37:0/2291265797 shutdown_connections 2024-05-30T06:58:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.503+0000 7fd88ca00640 1 -- 172.21.15.37:0/2291265797 wait complete. 2024-05-30T06:58:18.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:58:18.523 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -lh volumes/_nogroup/subvol_clone44121/b1a204a6-dd76-4d32-9276-71a832793274 2024-05-30T06:58:18.523 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:58:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:ls: cannot access 'volumes/_nogroup/subvol_clone44121/b1a204a6-dd76-4d32-9276-71a832793274': No such file or directory 2024-05-30T06:58:18.533 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-30T06:58:18.534 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:58:18.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa87cc00640 1 Processor -- start 2024-05-30T06:58:18.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa87cc00640 1 -- start start 2024-05-30T06:58:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa87cc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa87815c9a0 0x7fa8780cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa87cc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8780cffd0 0x7fa8780afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa87cc00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8780af0d0 con 0x7fa8780d0600 2024-05-30T06:58:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa87cc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa8780ce000 con 0x7fa87815c9a0 2024-05-30T06:58:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa87cc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8780ce2e0 con 0x7fa8780cffd0 2024-05-30T06:58:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa877400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa8780d0600 0x7fa8780d09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58998/0 (socket says 172.21.15.37:58998) 2024-05-30T06:58:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa877400640 1 -- 172.21.15.37:0/494469650 learned_addr learned my addr 172.21.15.37:0/494469650 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876a00640 1 --2- 172.21.15.37:0/494469650 >> v2:172.21.15.105:3300/0 conn(0x7fa87815c9a0 0x7fa8780cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa877e00640 1 --2- 172.21.15.37:0/494469650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8780cffd0 0x7fa8780afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438381133 0 0) 0x7fa8780af0d0 con 0x7fa8780d0600 2024-05-30T06:58:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa85c003530 con 0x7fa8780d0600 2024-05-30T06:58:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2888493304 0 0) 0x7fa85c003530 con 0x7fa8780d0600 2024-05-30T06:58:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8780cffd0 msgr2=0x7fa8780afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 --2- 172.21.15.37:0/494469650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8780cffd0 0x7fa8780afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 >> v2:172.21.15.105:3300/0 conn(0x7fa87815c9a0 msgr2=0x7fa8780cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 --2- 172.21.15.37:0/494469650 >> v2:172.21.15.105:3300/0 conn(0x7fa87815c9a0 0x7fa8780cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8780af370 con 0x7fa8780d0600 2024-05-30T06:58:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fa8680016a0 con 0x7fa8780d0600 2024-05-30T06:58:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa877e00640 1 --2- 172.21.15.37:0/494469650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8780cffd0 0x7fa8780afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:58:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 >> v1:172.21.15.37:6789/0 conn(0x7fa8780d0600 legacy=0x7fa8780d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 --2- 172.21.15.37:0/494469650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa85c0039c0 0x7fa85c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 --2- 172.21.15.37:0/494469650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa85c0043b0 0x7fa85c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 --2- 172.21.15.37:0/494469650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa85c004f00 0x7fa85c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8780ce000 con 0x7fa85c004f00 2024-05-30T06:58:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8780ce2e0 con 0x7fa85c0043b0 2024-05-30T06:58:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa85c00bf10 con 0x7fa85c0039c0 2024-05-30T06:58:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa877e00640 1 --2- 172.21.15.37:0/494469650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa85c004f00 0x7fa85c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa877400640 1 --2- 172.21.15.37:0/494469650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa85c0039c0 0x7fa85c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa876a00640 1 --2- 172.21.15.37:0/494469650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa85c0043b0 0x7fa85c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa877e00640 1 -- 172.21.15.37:0/494469650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa85c0039c0 msgr2=0x7fa85c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:18.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.719+0000 7fa877e00640 1 --2- 172.21.15.37:0/494469650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa85c0039c0 0x7fa85c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa877e00640 1 -- 172.21.15.37:0/494469650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa85c0043b0 msgr2=0x7fa85c004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:18.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa877e00640 1 --2- 172.21.15.37:0/494469650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa85c0043b0 0x7fa85c004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa877e00640 1 -- 172.21.15.37:0/494469650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85c003530 con 0x7fa85c004f00 2024-05-30T06:58:18.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa877e00640 1 --2- 172.21.15.37:0/494469650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa85c004f00 0x7fa85c00b9d0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fa8780d0480 tx=0x7fa87001cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a67b69f3484918 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870009d60 con 0x7fa85c004f00 2024-05-30T06:58:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8700a5d50 con 0x7fa85c004f00 2024-05-30T06:58:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa876000640 1 -- 172.21.15.37:0/494469650 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870003bc0 con 0x7fa85c004f00 2024-05-30T06:58:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa87cc00640 1 -- 172.21.15.37:0/494469650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa85c004f00 msgr2=0x7fa85c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa87cc00640 1 --2- 172.21.15.37:0/494469650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa85c004f00 0x7fa85c00b9d0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fa8780d0480 tx=0x7fa87001cd00 comp rx=0 tx=0).stop 2024-05-30T06:58:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa877e00640 1 -- 172.21.15.37:0/494469650 reap_dead start 2024-05-30T06:58:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa87cc00640 1 -- 172.21.15.37:0/494469650 shutdown_connections 2024-05-30T06:58:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa87cc00640 1 -- 172.21.15.37:0/494469650 >> 172.21.15.37:0/494469650 conn(0x7fa8780b3ef0 msgr2=0x7fa8780b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa87cc00640 1 -- 172.21.15.37:0/494469650 shutdown_connections 2024-05-30T06:58:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.723+0000 7fa87cc00640 1 -- 172.21.15.37:0/494469650 wait complete. 2024-05-30T06:58:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa87cc00640 1 Processor -- start 2024-05-30T06:58:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa87cc00640 1 -- start start 2024-05-30T06:58:18.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa87cc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa85c004f00 0x7fa878153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa87cc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8780c8730 0x7fa8780cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa87cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8780c8bb0 0x7fa8780cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa87cc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa87809bd80 con 0x7fa8780c8bb0 2024-05-30T06:58:18.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa87cc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa87809bc00 con 0x7fa85c004f00 2024-05-30T06:58:18.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa87cc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8780afb70 con 0x7fa8780c8730 2024-05-30T06:58:18.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa877e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8780c8bb0 0x7fa8780cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa877e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8780c8bb0 0x7fa8780cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58936/0 (socket says 172.21.15.37:58936) 2024-05-30T06:58:18.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa877e00640 1 -- 172.21.15.37:0/3013923331 learned_addr learned my addr 172.21.15.37:0/3013923331 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:18.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa876a00640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8780c8730 0x7fa8780cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa877400640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa85c004f00 0x7fa878153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa877e00640 1 -- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8780c8730 msgr2=0x7fa8780cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa877e00640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8780c8730 0x7fa8780cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa877e00640 1 -- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa85c004f00 msgr2=0x7fa878153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa877e00640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa85c004f00 0x7fa878153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa877e00640 1 -- 172.21.15.37:0/3013923331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8780b6f50 con 0x7fa8780c8bb0 2024-05-30T06:58:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa877400640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa85c004f00 0x7fa878153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa877e00640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8780c8bb0 0x7fa8780cba20 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fa8700af040 tx=0x7fa870009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa86f400640 1 -- 172.21.15.37:0/3013923331 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870009d60 con 0x7fa8780c8bb0 2024-05-30T06:58:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa86f400640 1 -- 172.21.15.37:0/3013923331 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8700bd070 con 0x7fa8780c8bb0 2024-05-30T06:58:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa87cc00640 1 -- 172.21.15.37:0/3013923331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8780b7230 con 0x7fa8780c8bb0 2024-05-30T06:58:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa86f400640 1 -- 172.21.15.37:0/3013923331 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870003e60 con 0x7fa8780c8bb0 2024-05-30T06:58:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.727+0000 7fa87cc00640 1 -- 172.21.15.37:0/3013923331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87809c4a0 con 0x7fa8780c8bb0 2024-05-30T06:58:18.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.731+0000 7fa87cc00640 1 -- 172.21.15.37:0/3013923331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa878068ab0 con 0x7fa8780c8bb0 2024-05-30T06:58:18.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.731+0000 7fa86f400640 1 -- 172.21.15.37:0/3013923331 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7fa8700c2460 con 0x7fa8780c8bb0 2024-05-30T06:58:18.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.731+0000 7fa86f400640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa858069f40 0x7fa85806c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:18.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.731+0000 7fa86f400640 1 -- 172.21.15.37:0/3013923331 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7fa870120db0 con 0x7fa8780c8bb0 2024-05-30T06:58:18.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.731+0000 7fa877400640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa858069f40 0x7fa85806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:18.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.735+0000 7fa877400640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa858069f40 0x7fa85806c400 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa868001060 tx=0x7fa868009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:18.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.735+0000 7fa86f400640 1 -- 172.21.15.37:0/3013923331 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa870016a50 con 0x7fa8780c8bb0 2024-05-30T06:58:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.927+0000 7fa87cc00640 1 -- 172.21.15.37:0/3013923331 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fa8780ce930 con 0x7fa858069f40 2024-05-30T06:58:18.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.927+0000 7fa86f400640 1 -- 172.21.15.37:0/3013923331 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fa8780ce930 con 0x7fa858069f40 2024-05-30T06:58:18.928 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:58:18.928 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:18.928 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:58:18.928 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:18.928 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:58:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.931+0000 7fa87cc00640 1 -- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa858069f40 msgr2=0x7fa85806c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.931+0000 7fa87cc00640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa858069f40 0x7fa85806c400 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa868001060 tx=0x7fa868009040 comp rx=0 tx=0).stop 2024-05-30T06:58:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.931+0000 7fa87cc00640 1 -- 172.21.15.37:0/3013923331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8780c8bb0 msgr2=0x7fa8780cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.931+0000 7fa87cc00640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8780c8bb0 0x7fa8780cba20 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fa8700af040 tx=0x7fa870009750 comp rx=0 tx=0).stop 2024-05-30T06:58:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.931+0000 7fa87cc00640 1 -- 172.21.15.37:0/3013923331 shutdown_connections 2024-05-30T06:58:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.931+0000 7fa87cc00640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8780c8bb0 0x7fa8780cba20 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.931+0000 7fa87cc00640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8780c8730 0x7fa8780cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.931+0000 7fa87cc00640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa858069f40 0x7fa85806c400 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.931+0000 7fa87cc00640 1 --2- 172.21.15.37:0/3013923331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa85c004f00 0x7fa878153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.931+0000 7fa87cc00640 1 -- 172.21.15.37:0/3013923331 >> 172.21.15.37:0/3013923331 conn(0x7fa8780b3ef0 msgr2=0x7fa8780b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.931+0000 7fa87cc00640 1 -- 172.21.15.37:0/3013923331 shutdown_connections 2024-05-30T06:58:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:18.931+0000 7fa87cc00640 1 -- 172.21.15.37:0/3013923331 wait complete. 2024-05-30T06:58:18.950 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:58:19.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f2317000640 1 Processor -- start 2024-05-30T06:58:19.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f2317000640 1 -- start start 2024-05-30T06:58:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f2317000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f231015e930 0x7f231009b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f2317000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f23100d1240 0x7f23101625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f2317000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f231009abe0 con 0x7f23100d1660 2024-05-30T06:58:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f2317000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f231009bee0 con 0x7f23100d1240 2024-05-30T06:58:19.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f2317000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f231009aec0 con 0x7f231015e930 2024-05-30T06:58:19.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f2315000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f23100d1660 0x7f23100ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59004/0 (socket says 172.21.15.37:59004) 2024-05-30T06:58:19.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f2315000640 1 -- 172.21.15.37:0/2350754620 learned_addr learned my addr 172.21.15.37:0/2350754620 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:19.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f230f400640 1 --2- 172.21.15.37:0/2350754620 >> v2:172.21.15.105:3300/0 conn(0x7f23100d1240 0x7f23101625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:19.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f230fe00640 1 --2- 172.21.15.37:0/2350754620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f231015e930 0x7f231009b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f230ea00640 1 -- 172.21.15.37:0/2350754620 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4110354379 0 0) 0x7f231009abe0 con 0x7f23100d1660 2024-05-30T06:58:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f230ea00640 1 -- 172.21.15.37:0/2350754620 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22f4003530 con 0x7f23100d1660 2024-05-30T06:58:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f230fe00640 1 -- 172.21.15.37:0/2350754620 >> v2:172.21.15.105:3300/0 conn(0x7f23100d1240 msgr2=0x7f23101625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f230fe00640 1 --2- 172.21.15.37:0/2350754620 >> v2:172.21.15.105:3300/0 conn(0x7f23100d1240 0x7f23101625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f230fe00640 1 -- 172.21.15.37:0/2350754620 >> v1:172.21.15.37:6789/0 conn(0x7f23100d1660 legacy=0x7f23100ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f230fe00640 1 -- 172.21.15.37:0/2350754620 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231009b1a0 con 0x7f231015e930 2024-05-30T06:58:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.095+0000 7f230f400640 1 --2- 172.21.15.37:0/2350754620 >> v2:172.21.15.105:3300/0 conn(0x7f23100d1240 0x7f23101625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:58:19.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.099+0000 7f230fe00640 1 --2- 172.21.15.37:0/2350754620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f231015e930 0x7f231009b9a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f23000097c0 tx=0x7f230001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5757c23fa7c646b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:19.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.099+0000 7f230ea00640 1 -- 172.21.15.37:0/2350754620 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23000b1070 con 0x7f231015e930 2024-05-30T06:58:19.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.099+0000 7f230ea00640 1 -- 172.21.15.37:0/2350754620 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23000ac410 con 0x7f231015e930 2024-05-30T06:58:19.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.099+0000 7f230ea00640 1 -- 172.21.15.37:0/2350754620 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23000ac7e0 con 0x7f231015e930 2024-05-30T06:58:19.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.099+0000 7f2317000640 1 -- 172.21.15.37:0/2350754620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f231015e930 msgr2=0x7f231009b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:19.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.099+0000 7f2317000640 1 --2- 172.21.15.37:0/2350754620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f231015e930 0x7f231009b9a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f23000097c0 tx=0x7f230001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:58:19.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.099+0000 7f2317000640 1 -- 172.21.15.37:0/2350754620 shutdown_connections 2024-05-30T06:58:19.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.099+0000 7f2317000640 1 --2- 172.21.15.37:0/2350754620 >> v2:172.21.15.105:3300/0 conn(0x7f23100d1240 0x7f23101625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:19.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.099+0000 7f2317000640 1 --2- 172.21.15.37:0/2350754620 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f231015e930 0x7f231009b9a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:19.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.099+0000 7f2317000640 1 -- 172.21.15.37:0/2350754620 >> 172.21.15.37:0/2350754620 conn(0x7f23100b4100 msgr2=0x7f23100b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:19.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.099+0000 7f2317000640 1 -- 172.21.15.37:0/2350754620 shutdown_connections 2024-05-30T06:58:19.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.099+0000 7f2317000640 1 -- 172.21.15.37:0/2350754620 wait complete. 2024-05-30T06:58:19.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2317000640 1 Processor -- start 2024-05-30T06:58:19.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2317000640 1 -- start start 2024-05-30T06:58:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2317000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23100d1240 0x7f23100b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2317000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23100d1660 0x7f23101fb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2317000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f231015e930 0x7f23101fbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2317000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f231015ed10 con 0x7f231015e930 2024-05-30T06:58:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2317000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2310162ef0 con 0x7f23100d1660 2024-05-30T06:58:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2317000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f231015ee90 con 0x7f23100d1240 2024-05-30T06:58:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2315000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f231015e930 0x7f23101fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2315000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f231015e930 0x7f23101fbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58940/0 (socket says 172.21.15.37:58940) 2024-05-30T06:58:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2315000640 1 -- 172.21.15.37:0/1870144794 learned_addr learned my addr 172.21.15.37:0/1870144794 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f230f400640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23100d1660 0x7f23101fb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f230fe00640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23100d1240 0x7f23100b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2315000640 1 -- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23100d1240 msgr2=0x7f23100b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2315000640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23100d1240 0x7f23100b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2315000640 1 -- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23100d1660 msgr2=0x7f23101fb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2315000640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23100d1660 0x7f23101fb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2315000640 1 -- 172.21.15.37:0/1870144794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231015c300 con 0x7f231015e930 2024-05-30T06:58:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2315000640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f231015e930 0x7f23101fbd40 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f230800ca80 tx=0x7f230800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2307e00640 1 -- 172.21.15.37:0/1870144794 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308017070 con 0x7f231015e930 2024-05-30T06:58:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2307e00640 1 -- 172.21.15.37:0/1870144794 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230800ac30 con 0x7f231015e930 2024-05-30T06:58:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2317000640 1 -- 172.21.15.37:0/1870144794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231015c5e0 con 0x7f231015e930 2024-05-30T06:58:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2307e00640 1 -- 172.21.15.37:0/1870144794 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308012400 con 0x7f231015e930 2024-05-30T06:58:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.103+0000 7f2317000640 1 -- 172.21.15.37:0/1870144794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f231015cba0 con 0x7f231015e930 2024-05-30T06:58:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.107+0000 7f2317000640 1 -- 172.21.15.37:0/1870144794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23100b7b40 con 0x7f231015e930 2024-05-30T06:58:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.107+0000 7f2307e00640 1 -- 172.21.15.37:0/1870144794 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7f230801a070 con 0x7f231015e930 2024-05-30T06:58:19.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.107+0000 7f2307e00640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22f0069f40 0x7f22f006c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:19.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.107+0000 7f2307e00640 1 -- 172.21.15.37:0/1870144794 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f2308085570 con 0x7f231015e930 2024-05-30T06:58:19.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.107+0000 7f230fe00640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22f0069f40 0x7f22f006c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.107+0000 7f230fe00640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22f0069f40 0x7f22f006c400 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f23000ae000 tx=0x7f23000a6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:19.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.111+0000 7f2307e00640 1 -- 172.21.15.37:0/1870144794 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f23100b7b40 con 0x7f231015e930 2024-05-30T06:58:19.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2317000640 1 -- 172.21.15.37:0/1870144794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2310068b20 con 0x7f231015e930 2024-05-30T06:58:19.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2307e00640 1 -- 172.21.15.37:0/1870144794 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2577 (secure 0 0 0) 0x7f2308056f40 con 0x7f231015e930 2024-05-30T06:58:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:19.343 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:58:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:58:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:58:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:58:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:58:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:58:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:58:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:58:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:58:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:58:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:58:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:58:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:58:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:58:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:58:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 993, 2024-05-30T06:58:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:58:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:58:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:58:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:58:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:58:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 116, 2024-05-30T06:58:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:58:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:58:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:58:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:58:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:58:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:58:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:58:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:58:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:58:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:58:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:58:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:58:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1767, 2024-05-30T06:58:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 7282593598, 2024-05-30T06:58:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 15590801408, 2024-05-30T06:58:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 757503311872, 2024-05-30T06:58:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:58:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 342419250, 2024-05-30T06:58:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 338272463, 2024-05-30T06:58:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 84, 2024-05-30T06:58:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 96 2024-05-30T06:58:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:58:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:58:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8, 2024-05-30T06:58:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:58:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:58:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:58:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:58:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 8, 2024-05-30T06:58:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:58:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:58:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:58:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9120 2024-05-30T06:58:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:58:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:58:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:58:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:58:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:58:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:58:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:58:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:58:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:58:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:58:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 19, 2024-05-30T06:58:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:58:16.987070+0000", 2024-05-30T06:58:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-05-30T06:58:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-05-30T06:58:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "daemons": { 2024-05-30T06:58:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "summary": "", 2024-05-30T06:58:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "a": { 2024-05-30T06:58:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "start_epoch": 0, 2024-05-30T06:58:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "start_stamp": "0.000000", 2024-05-30T06:58:19.351 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 0, 2024-05-30T06:58:19.351 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T06:58:19.351 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": {}, 2024-05-30T06:58:19.351 INFO:teuthology.orchestra.run.smithi037.stdout: "task_status": {} 2024-05-30T06:58:19.351 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:19.351 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:19.351 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:19.351 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:19.351 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:19.351 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:58:19.351 INFO:teuthology.orchestra.run.smithi037.stdout: "009dbaae-3bd5-474a-bd56-040066fd8c8f": { 2024-05-30T06:58:19.351 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 26.0 seconds before exiting (10s)\n [============================] ", 2024-05-30T06:58:19.351 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:58:19.352 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:58:19.352 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:19.352 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:19.352 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:58:19.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2317000640 1 -- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22f0069f40 msgr2=0x7f22f006c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:19.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2317000640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22f0069f40 0x7f22f006c400 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f23000ae000 tx=0x7f23000a6040 comp rx=0 tx=0).stop 2024-05-30T06:58:19.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2317000640 1 -- 172.21.15.37:0/1870144794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f231015e930 msgr2=0x7f23101fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:19.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2317000640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f231015e930 0x7f23101fbd40 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f230800ca80 tx=0x7f230800cf40 comp rx=0 tx=0).stop 2024-05-30T06:58:19.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2317000640 1 -- 172.21.15.37:0/1870144794 shutdown_connections 2024-05-30T06:58:19.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2317000640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f231015e930 0x7f23101fbd40 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:19.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2317000640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f22f0069f40 0x7f22f006c400 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:19.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2317000640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23100d1660 0x7f23101fb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:19.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2317000640 1 --2- 172.21.15.37:0/1870144794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23100d1240 0x7f23100b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:19.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2317000640 1 -- 172.21.15.37:0/1870144794 >> 172.21.15.37:0/1870144794 conn(0x7f23100b4100 msgr2=0x7f2310158100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:19.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2317000640 1 -- 172.21.15.37:0/1870144794 shutdown_connections 2024-05-30T06:58:19.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:19.343+0000 7f2317000640 1 -- 172.21.15.37:0/1870144794 wait complete. 2024-05-30T06:58:24.366 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:58:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.515+0000 7faa1c000640 1 Processor -- start 2024-05-30T06:58:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.515+0000 7faa1c000640 1 -- start start 2024-05-30T06:58:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.515+0000 7faa1c000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa14155e60 0x7faa140b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.515+0000 7faa1c000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa1406f9a0 0x7faa140cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.515+0000 7faa1c000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa1415c8f0 con 0x7faa140b2ec0 2024-05-30T06:58:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.515+0000 7faa1c000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7faa140ccff0 con 0x7faa14155e60 2024-05-30T06:58:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.515+0000 7faa1c000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa140ccc80 con 0x7faa1406f9a0 2024-05-30T06:58:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.515+0000 7faa19600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa14155e60 0x7faa140b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.515+0000 7faa19600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa14155e60 0x7faa140b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58948/0 (socket says 172.21.15.37:58948) 2024-05-30T06:58:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.515+0000 7faa19600640 1 -- 172.21.15.37:0/2849307384 learned_addr learned my addr 172.21.15.37:0/2849307384 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.515+0000 7faa1a000640 1 --1- 172.21.15.37:0/2849307384 >> v1:172.21.15.37:6789/0 conn(0x7faa140b2ec0 0x7faa140cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59006/0 (socket says 172.21.15.37:59006) 2024-05-30T06:58:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.519+0000 7faa18c00640 1 --2- 172.21.15.37:0/2849307384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa1406f9a0 0x7faa140cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.519+0000 7faa19600640 1 -- 172.21.15.37:0/2849307384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa1406f9a0 msgr2=0x7faa140cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.519+0000 7faa19600640 1 --2- 172.21.15.37:0/2849307384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa1406f9a0 0x7faa140cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.519+0000 7faa19600640 1 -- 172.21.15.37:0/2849307384 >> v1:172.21.15.37:6789/0 conn(0x7faa140b2ec0 legacy=0x7faa140cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.519+0000 7faa19600640 1 -- 172.21.15.37:0/2849307384 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1415cbd0 con 0x7faa14155e60 2024-05-30T06:58:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.519+0000 7faa13e00640 1 -- 172.21.15.37:0/2849307384 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 519493612 0 0) 0x7faa1415c8f0 con 0x7faa140b2ec0 2024-05-30T06:58:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.519+0000 7faa19600640 1 --2- 172.21.15.37:0/2849307384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa14155e60 0x7faa140b36a0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7faa08009870 tx=0x7faa0801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427abf8b0780c9f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.519+0000 7faa13e00640 1 -- 172.21.15.37:0/2849307384 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080ab430 con 0x7faa14155e60 2024-05-30T06:58:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.519+0000 7faa13e00640 1 -- 172.21.15.37:0/2849307384 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa080b0070 con 0x7faa14155e60 2024-05-30T06:58:24.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.519+0000 7faa13e00640 1 -- 172.21.15.37:0/2849307384 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080ab7f0 con 0x7faa14155e60 2024-05-30T06:58:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 -- 172.21.15.37:0/2849307384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa14155e60 msgr2=0x7faa140b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 --2- 172.21.15.37:0/2849307384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa14155e60 0x7faa140b36a0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7faa08009870 tx=0x7faa0801c560 comp rx=0 tx=0).stop 2024-05-30T06:58:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 -- 172.21.15.37:0/2849307384 shutdown_connections 2024-05-30T06:58:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 --2- 172.21.15.37:0/2849307384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa1406f9a0 0x7faa140cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 --2- 172.21.15.37:0/2849307384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa14155e60 0x7faa140b36a0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 -- 172.21.15.37:0/2849307384 >> 172.21.15.37:0/2849307384 conn(0x7faa140b23a0 msgr2=0x7faa140b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 -- 172.21.15.37:0/2849307384 shutdown_connections 2024-05-30T06:58:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 -- 172.21.15.37:0/2849307384 wait complete. 2024-05-30T06:58:24.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 Processor -- start 2024-05-30T06:58:24.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 -- start start 2024-05-30T06:58:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1406f9a0 0x7faa141576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa140b2ec0 0x7faa1414d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa14155e60 0x7faa1415a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa1406ea10 con 0x7faa1406f9a0 2024-05-30T06:58:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faa1406e890 con 0x7faa14155e60 2024-05-30T06:58:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1c000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faa1406eb90 con 0x7faa140b2ec0 2024-05-30T06:58:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa19600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1406f9a0 0x7faa141576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa19600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1406f9a0 0x7faa141576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58958/0 (socket says 172.21.15.37:58958) 2024-05-30T06:58:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa19600640 1 -- 172.21.15.37:0/113888549 learned_addr learned my addr 172.21.15.37:0/113888549 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa18c00640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa140b2ec0 0x7faa1414d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa19600640 1 -- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa140b2ec0 msgr2=0x7faa1414d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa19600640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa140b2ec0 0x7faa1414d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa19600640 1 -- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa14155e60 msgr2=0x7faa1415a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1a000640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa14155e60 0x7faa1415a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa19600640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa14155e60 0x7faa1415a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa19600640 1 -- 172.21.15.37:0/113888549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa14157c00 con 0x7faa1406f9a0 2024-05-30T06:58:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa18c00640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa140b2ec0 0x7faa1414d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:58:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa1a000640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa14155e60 0x7faa1415a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:58:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.523+0000 7faa19600640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1406f9a0 0x7faa141576c0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7faa080ad040 tx=0x7faa08019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.527+0000 7faa11600640 1 -- 172.21.15.37:0/113888549 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080b4420 con 0x7faa1406f9a0 2024-05-30T06:58:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.527+0000 7faa11600640 1 -- 172.21.15.37:0/113888549 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa080b45c0 con 0x7faa1406f9a0 2024-05-30T06:58:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.527+0000 7faa11600640 1 -- 172.21.15.37:0/113888549 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080b47b0 con 0x7faa1406f9a0 2024-05-30T06:58:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.527+0000 7faa1c000640 1 -- 172.21.15.37:0/113888549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa14156620 con 0x7faa1406f9a0 2024-05-30T06:58:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.527+0000 7faa1c000640 1 -- 172.21.15.37:0/113888549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa14156be0 con 0x7faa1406f9a0 2024-05-30T06:58:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.527+0000 7faa1c000640 1 -- 172.21.15.37:0/113888549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa14068b20 con 0x7faa1406f9a0 2024-05-30T06:58:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.527+0000 7faa11600640 1 -- 172.21.15.37:0/113888549 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7faa080bd020 con 0x7faa1406f9a0 2024-05-30T06:58:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.527+0000 7faa11600640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa9f4069f10 0x7fa9f406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.527+0000 7faa11600640 1 -- 172.21.15.37:0/113888549 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7faa0811ee00 con 0x7faa1406f9a0 2024-05-30T06:58:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.527+0000 7faa18c00640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa9f4069f10 0x7fa9f406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.531+0000 7faa18c00640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa9f4069f10 0x7fa9f406c3d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7faa1406fe20 tx=0x7faa00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.531+0000 7faa11600640 1 -- 172.21.15.37:0/113888549 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faa080c4020 con 0x7faa1406f9a0 2024-05-30T06:58:24.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa1c000640 1 -- 172.21.15.37:0/113888549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7faa140cd480 con 0x7faa1406f9a0 2024-05-30T06:58:24.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa11600640 1 -- 172.21.15.37:0/113888549 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2577 (secure 0 0 0) 0x7faa08016150 con 0x7faa1406f9a0 2024-05-30T06:58:24.758 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:24.758 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:58:24.759 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:58:24.759 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:58:24.759 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:58:24.759 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:58:24.759 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:58:24.759 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:24.759 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:58:24.759 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:58:24.759 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:58:24.759 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:58:24.759 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:58:24.759 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:24.760 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:58:24.760 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:58:24.760 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:58:24.760 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:58:24.760 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:24.760 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 999, 2024-05-30T06:58:24.760 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:58:24.760 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:58:24.760 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:58:24.760 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:58:24.760 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:24.760 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:58:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 116, 2024-05-30T06:58:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:58:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:58:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:58:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:58:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:58:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:58:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:58:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:58:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:58:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:58:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:58:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:58:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1767, 2024-05-30T06:58:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 7282593598, 2024-05-30T06:58:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 15590801408, 2024-05-30T06:58:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 757503311872, 2024-05-30T06:58:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:58:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 261007549, 2024-05-30T06:58:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 265575996, 2024-05-30T06:58:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 64, 2024-05-30T06:58:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 73 2024-05-30T06:58:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:58:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:58:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8, 2024-05-30T06:58:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:58:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:58:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:58:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:58:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 8, 2024-05-30T06:58:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:58:24.764 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:58:24.764 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:58:24.764 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9120 2024-05-30T06:58:24.764 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:24.764 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:24.764 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:58:24.764 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:24.764 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:58:24.764 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:58:24.764 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:58:24.764 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:58:24.764 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:58:24.765 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:58:24.765 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:58:24.765 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:24.765 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:58:24.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:24.765 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:58:24.765 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 19, 2024-05-30T06:58:24.765 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:58:16.987070+0000", 2024-05-30T06:58:24.766 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-05-30T06:58:24.766 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-05-30T06:58:24.766 INFO:teuthology.orchestra.run.smithi037.stdout: "daemons": { 2024-05-30T06:58:24.766 INFO:teuthology.orchestra.run.smithi037.stdout: "summary": "", 2024-05-30T06:58:24.766 INFO:teuthology.orchestra.run.smithi037.stdout: "a": { 2024-05-30T06:58:24.766 INFO:teuthology.orchestra.run.smithi037.stdout: "start_epoch": 0, 2024-05-30T06:58:24.766 INFO:teuthology.orchestra.run.smithi037.stdout: "start_stamp": "0.000000", 2024-05-30T06:58:24.766 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 0, 2024-05-30T06:58:24.766 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T06:58:24.766 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": {}, 2024-05-30T06:58:24.766 INFO:teuthology.orchestra.run.smithi037.stdout: "task_status": {} 2024-05-30T06:58:24.766 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:24.767 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:24.767 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:24.767 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:24.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:24.767 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:58:24.767 INFO:teuthology.orchestra.run.smithi037.stdout: "009dbaae-3bd5-474a-bd56-040066fd8c8f": { 2024-05-30T06:58:24.767 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 22.0 seconds before exiting (14s)\n [============================] ", 2024-05-30T06:58:24.767 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:58:24.767 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:58:24.767 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:24.767 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:24.767 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:58:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa1c000640 1 -- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa9f4069f10 msgr2=0x7fa9f406c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa1c000640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa9f4069f10 0x7fa9f406c3d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7faa1406fe20 tx=0x7faa00008040 comp rx=0 tx=0).stop 2024-05-30T06:58:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa1c000640 1 -- 172.21.15.37:0/113888549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1406f9a0 msgr2=0x7faa141576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa1c000640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1406f9a0 0x7faa141576c0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7faa080ad040 tx=0x7faa08019300 comp rx=0 tx=0).stop 2024-05-30T06:58:24.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa1c000640 1 -- 172.21.15.37:0/113888549 shutdown_connections 2024-05-30T06:58:24.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa1c000640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa9f4069f10 0x7fa9f406c3d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:24.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa1c000640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faa14155e60 0x7faa1415a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:24.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa1c000640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faa140b2ec0 0x7faa1414d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:24.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa1c000640 1 --2- 172.21.15.37:0/113888549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1406f9a0 0x7faa141576c0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:24.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa1c000640 1 -- 172.21.15.37:0/113888549 >> 172.21.15.37:0/113888549 conn(0x7faa140b23a0 msgr2=0x7faa140b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:24.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa1c000640 1 -- 172.21.15.37:0/113888549 shutdown_connections 2024-05-30T06:58:24.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:24.758+0000 7faa1c000640 1 -- 172.21.15.37:0/113888549 wait complete. 2024-05-30T06:58:29.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:58:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9018800640 1 Processor -- start 2024-05-30T06:58:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9018800640 1 -- start start 2024-05-30T06:58:29.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9018800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100b2e20 0x7f9010160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:29.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9018800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90101609c0 0x7f9010160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:29.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9018800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f90100cd280 0x7f90100cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:29.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9018800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f90100b3200 con 0x7f90101609c0 2024-05-30T06:58:29.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9018800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f90100d01e0 con 0x7f90100cd280 2024-05-30T06:58:29.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9018800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f90100b33a0 con 0x7f90100b2e20 2024-05-30T06:58:29.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9015400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90101609c0 0x7f9010160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:29.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9015400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90101609c0 0x7f9010160e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53346/0 (socket says 172.21.15.37:53346) 2024-05-30T06:58:29.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9015400640 1 -- 172.21.15.37:0/2384205487 learned_addr learned my addr 172.21.15.37:0/2384205487 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:29.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9015400640 1 -- 172.21.15.37:0/2384205487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100b2e20 msgr2=0x7f9010160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:29.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9015400640 1 --2- 172.21.15.37:0/2384205487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100b2e20 0x7f9010160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:29.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9015400640 1 -- 172.21.15.37:0/2384205487 >> v2:172.21.15.105:3300/0 conn(0x7f90100cd280 msgr2=0x7f90100cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:29.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9015400640 1 --2- 172.21.15.37:0/2384205487 >> v2:172.21.15.105:3300/0 conn(0x7f90100cd280 0x7f90100cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:29.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.934+0000 7f9015400640 1 -- 172.21.15.37:0/2384205487 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90100d0430 con 0x7f90101609c0 2024-05-30T06:58:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.938+0000 7f9015400640 1 --2- 172.21.15.37:0/2384205487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90101609c0 0x7f9010160e20 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f9000009870 tx=0x7f900001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fe6bb89aaced1a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.938+0000 7f9014a00640 1 -- 172.21.15.37:0/2384205487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90000aa610 con 0x7f90101609c0 2024-05-30T06:58:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.938+0000 7f9014a00640 1 -- 172.21.15.37:0/2384205487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90000af070 con 0x7f90101609c0 2024-05-30T06:58:29.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.938+0000 7f9014a00640 1 -- 172.21.15.37:0/2384205487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90000aa9d0 con 0x7f90101609c0 2024-05-30T06:58:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.938+0000 7f9018800640 1 -- 172.21.15.37:0/2384205487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90101609c0 msgr2=0x7f9010160e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.938+0000 7f9018800640 1 --2- 172.21.15.37:0/2384205487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90101609c0 0x7f9010160e20 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f9000009870 tx=0x7f900001c4f0 comp rx=0 tx=0).stop 2024-05-30T06:58:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.938+0000 7f9018800640 1 -- 172.21.15.37:0/2384205487 shutdown_connections 2024-05-30T06:58:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.938+0000 7f9018800640 1 --2- 172.21.15.37:0/2384205487 >> v2:172.21.15.105:3300/0 conn(0x7f90100cd280 0x7f90100cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.938+0000 7f9018800640 1 --2- 172.21.15.37:0/2384205487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90101609c0 0x7f9010160e20 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.938+0000 7f9018800640 1 --2- 172.21.15.37:0/2384205487 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100b2e20 0x7f9010160480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.938+0000 7f9018800640 1 -- 172.21.15.37:0/2384205487 >> 172.21.15.37:0/2384205487 conn(0x7f90100b4100 msgr2=0x7f90100b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.938+0000 7f9018800640 1 -- 172.21.15.37:0/2384205487 shutdown_connections 2024-05-30T06:58:29.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.938+0000 7f9018800640 1 -- 172.21.15.37:0/2384205487 wait complete. 2024-05-30T06:58:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9018800640 1 Processor -- start 2024-05-30T06:58:29.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9018800640 1 -- start start 2024-05-30T06:58:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9018800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90100b2e20 0x7f9010157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9018800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100cd280 0x7f901015af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9018800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90101609c0 0x7f9010165f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9018800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f901009aa60 con 0x7f90100b2e20 2024-05-30T06:58:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9018800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90100cee40 con 0x7f90101609c0 2024-05-30T06:58:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9018800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f901009abe0 con 0x7f90100cd280 2024-05-30T06:58:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9015e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90100b2e20 0x7f9010157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9015e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90100b2e20 0x7f9010157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53352/0 (socket says 172.21.15.37:53352) 2024-05-30T06:58:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9015e00640 1 -- 172.21.15.37:0/1348078318 learned_addr learned my addr 172.21.15.37:0/1348078318 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9015e00640 1 -- 172.21.15.37:0/1348078318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100cd280 msgr2=0x7f901015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:29.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9015e00640 1 --2- 172.21.15.37:0/1348078318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100cd280 0x7f901015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:29.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9015e00640 1 -- 172.21.15.37:0/1348078318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90101609c0 msgr2=0x7f9010165f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:29.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9015e00640 1 --2- 172.21.15.37:0/1348078318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90101609c0 0x7f9010165f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:29.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9015e00640 1 -- 172.21.15.37:0/1348078318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90100b72b0 con 0x7f90100b2e20 2024-05-30T06:58:29.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9015e00640 1 --2- 172.21.15.37:0/1348078318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90100b2e20 0x7f9010157d10 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f900400b580 tx=0x7f900400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:29.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f900a000640 1 -- 172.21.15.37:0/1348078318 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004014070 con 0x7f90100b2e20 2024-05-30T06:58:29.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f900a000640 1 -- 172.21.15.37:0/1348078318 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9004010890 con 0x7f90100b2e20 2024-05-30T06:58:29.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f900a000640 1 -- 172.21.15.37:0/1348078318 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004010c80 con 0x7f90100b2e20 2024-05-30T06:58:29.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9018800640 1 -- 172.21.15.37:0/1348078318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90100b6210 con 0x7f90100b2e20 2024-05-30T06:58:29.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9018800640 1 -- 172.21.15.37:0/1348078318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90100b67d0 con 0x7f90100b2e20 2024-05-30T06:58:29.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.942+0000 7f9018800640 1 -- 172.21.15.37:0/1348078318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9010068b20 con 0x7f90100b2e20 2024-05-30T06:58:29.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.946+0000 7f900a000640 1 -- 172.21.15.37:0/1348078318 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7f9004017070 con 0x7f90100b2e20 2024-05-30T06:58:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.946+0000 7f900a000640 1 --2- 172.21.15.37:0/1348078318 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ff4069f10 0x7f8ff406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.946+0000 7f900a000640 1 -- 172.21.15.37:0/1348078318 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f9004085770 con 0x7f90100b2e20 2024-05-30T06:58:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.946+0000 7f9015400640 1 --2- 172.21.15.37:0/1348078318 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ff4069f10 0x7f8ff406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.946+0000 7f9015400640 1 --2- 172.21.15.37:0/1348078318 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ff4069f10 0x7f8ff406c3d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f90000ae000 tx=0x7f9000004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:29.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:29.950+0000 7f900a000640 1 -- 172.21.15.37:0/1348078318 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9004057710 con 0x7f90100b2e20 2024-05-30T06:58:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.182+0000 7f9018800640 1 -- 172.21.15.37:0/1348078318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f90100ce860 con 0x7f90100b2e20 2024-05-30T06:58:30.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.182+0000 7f900a000640 1 -- 172.21.15.37:0/1348078318 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2112 (secure 0 0 0) 0x7f9004010e20 con 0x7f90100b2e20 2024-05-30T06:58:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:30.185 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:58:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:58:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:58:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:58:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:58:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:58:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:58:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:58:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:58:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:58:30.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:58:30.186 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:30.186 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:58:30.186 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:58:30.186 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:58:30.186 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:58:30.186 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:30.186 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 1004, 2024-05-30T06:58:30.186 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:58:30.186 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:58:30.186 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:58:30.186 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:58:30.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:30.187 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:58:30.187 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 116, 2024-05-30T06:58:30.187 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:58:30.187 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:58:30.187 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:58:30.187 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:58:30.187 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:58:30.187 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:58:30.187 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:30.187 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:58:30.187 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:58:30.187 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:30.187 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:58:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:58:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:58:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:58:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1767, 2024-05-30T06:58:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 7282629603, 2024-05-30T06:58:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 15590875136, 2024-05-30T06:58:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 757503238144, 2024-05-30T06:58:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:58:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 426, 2024-05-30T06:58:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 7421, 2024-05-30T06:58:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:58:30.189 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 3 2024-05-30T06:58:30.189 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:30.189 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:58:30.189 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:58:30.189 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8, 2024-05-30T06:58:30.189 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:58:30.189 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:58:30.189 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:58:30.189 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:58:30.189 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:30.189 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 8, 2024-05-30T06:58:30.189 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:58:30.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:58:30.190 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:58:30.190 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9120 2024-05-30T06:58:30.190 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:30.190 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:30.190 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:58:30.190 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:30.190 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:58:30.190 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:58:30.190 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:58:30.190 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:58:30.190 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:58:30.190 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:58:30.190 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:58:26.990011+0000", 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: "009dbaae-3bd5-474a-bd56-040066fd8c8f": { 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 16.0 seconds before exiting (20s)\n [============================] ", 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:58:30.191 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:30.192 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:30.192 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:58:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.186+0000 7f9018800640 1 -- 172.21.15.37:0/1348078318 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ff4069f10 msgr2=0x7f8ff406c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.186+0000 7f9018800640 1 --2- 172.21.15.37:0/1348078318 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ff4069f10 0x7f8ff406c3d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f90000ae000 tx=0x7f9000004740 comp rx=0 tx=0).stop 2024-05-30T06:58:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.186+0000 7f9018800640 1 -- 172.21.15.37:0/1348078318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90100b2e20 msgr2=0x7f9010157d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.186+0000 7f9018800640 1 --2- 172.21.15.37:0/1348078318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90100b2e20 0x7f9010157d10 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f900400b580 tx=0x7f900400ba40 comp rx=0 tx=0).stop 2024-05-30T06:58:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.186+0000 7f9018800640 1 -- 172.21.15.37:0/1348078318 shutdown_connections 2024-05-30T06:58:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.186+0000 7f9018800640 1 --2- 172.21.15.37:0/1348078318 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ff4069f10 0x7f8ff406c3d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.186+0000 7f9018800640 1 --2- 172.21.15.37:0/1348078318 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90101609c0 0x7f9010165f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.186+0000 7f9018800640 1 --2- 172.21.15.37:0/1348078318 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90100cd280 0x7f901015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.186+0000 7f9018800640 1 --2- 172.21.15.37:0/1348078318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90100b2e20 0x7f9010157d10 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.186+0000 7f9018800640 1 -- 172.21.15.37:0/1348078318 >> 172.21.15.37:0/1348078318 conn(0x7f90100b4100 msgr2=0x7f9010166e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.186+0000 7f9018800640 1 -- 172.21.15.37:0/1348078318 shutdown_connections 2024-05-30T06:58:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:30.186+0000 7f9018800640 1 -- 172.21.15.37:0/1348078318 wait complete. 2024-05-30T06:58:35.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:58:35.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.358+0000 7f1dcd600640 1 Processor -- start 2024-05-30T06:58:35.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.358+0000 7f1dcd600640 1 -- start start 2024-05-30T06:58:35.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.358+0000 7f1dcd600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1dc806b960 0x7f1dc806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:35.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.358+0000 7f1dcd600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dc80b6030 con 0x7f1dc8147790 2024-05-30T06:58:35.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.358+0000 7f1dcd600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dc80b62d0 con 0x7f1dc80b45d0 2024-05-30T06:58:35.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.358+0000 7f1dcd600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1dc806c310 con 0x7f1dc806b960 2024-05-30T06:58:35.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.358+0000 7f1dc6a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1dc8147790 0x7f1dc80ae520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:59206/0 (socket says 172.21.15.37:59206) 2024-05-30T06:58:35.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.358+0000 7f1dc6a00640 1 -- 172.21.15.37:0/4187325166 learned_addr learned my addr 172.21.15.37:0/4187325166 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:35.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.358+0000 7f1dc7400640 1 --2- 172.21.15.37:0/4187325166 >> v2:172.21.15.37:3300/0 conn(0x7f1dc806b960 0x7f1dc806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:35.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.358+0000 7f1dc7400640 1 -- 172.21.15.37:0/4187325166 >> v1:172.21.15.105:6789/0 conn(0x7f1dc80b45d0 legacy=0x7f1dc8070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:35.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.358+0000 7f1dc7400640 1 -- 172.21.15.37:0/4187325166 >> v1:172.21.15.37:6789/0 conn(0x7f1dc8147790 legacy=0x7f1dc80ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:35.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.358+0000 7f1dc7400640 1 -- 172.21.15.37:0/4187325166 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc80b65b0 con 0x7f1dc806b960 2024-05-30T06:58:35.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.362+0000 7f1dc7400640 1 --2- 172.21.15.37:0/4187325166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc806b960 0x7f1dc806bdd0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00097c0 tx=0x7f1dc001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0ea43046441a27 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:35.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.362+0000 7f1dc6000640 1 -- 172.21.15.37:0/4187325166 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00b0070 con 0x7f1dc806b960 2024-05-30T06:58:35.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.362+0000 7f1dc6000640 1 -- 172.21.15.37:0/4187325166 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc00ab600 con 0x7f1dc806b960 2024-05-30T06:58:35.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.362+0000 7f1dc6000640 1 -- 172.21.15.37:0/4187325166 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc00a4e60 con 0x7f1dc806b960 2024-05-30T06:58:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.362+0000 7f1dcd600640 1 -- 172.21.15.37:0/4187325166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc806b960 msgr2=0x7f1dc806bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.362+0000 7f1dcd600640 1 --2- 172.21.15.37:0/4187325166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc806b960 0x7f1dc806bdd0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f1dc00097c0 tx=0x7f1dc001c3d0 comp rx=0 tx=0).stop 2024-05-30T06:58:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.362+0000 7f1dcd600640 1 -- 172.21.15.37:0/4187325166 shutdown_connections 2024-05-30T06:58:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.362+0000 7f1dcd600640 1 --2- 172.21.15.37:0/4187325166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc806b960 0x7f1dc806bdd0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.362+0000 7f1dcd600640 1 -- 172.21.15.37:0/4187325166 >> 172.21.15.37:0/4187325166 conn(0x7f1dc80b6a60 msgr2=0x7f1dc80b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.362+0000 7f1dcd600640 1 -- 172.21.15.37:0/4187325166 shutdown_connections 2024-05-30T06:58:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.362+0000 7f1dcd600640 1 -- 172.21.15.37:0/4187325166 wait complete. 2024-05-30T06:58:35.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dcd600640 1 Processor -- start 2024-05-30T06:58:35.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dcd600640 1 -- start start 2024-05-30T06:58:35.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dcd600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc806b960 0x7f1dc80b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:35.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dcd600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc80b45d0 0x7f1dc815e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:35.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dcd600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc8147790 0x7f1dc813e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:35.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dcd600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc816c5e0 con 0x7f1dc80b45d0 2024-05-30T06:58:35.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dcd600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc8070240 con 0x7f1dc8147790 2024-05-30T06:58:35.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dcd600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc816c760 con 0x7f1dc806b960 2024-05-30T06:58:35.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dbe000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc80b45d0 0x7f1dc815e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:35.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dbe000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc80b45d0 0x7f1dc815e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53374/0 (socket says 172.21.15.37:53374) 2024-05-30T06:58:35.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dbe000640 1 -- 172.21.15.37:0/2412777612 learned_addr learned my addr 172.21.15.37:0/2412777612 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:35.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dc7400640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc8147790 0x7f1dc813e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:35.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dc6a00640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc806b960 0x7f1dc80b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:35.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dbe000640 1 -- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc806b960 msgr2=0x7f1dc80b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:35.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dbe000640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc806b960 0x7f1dc80b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:35.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dbe000640 1 -- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc8147790 msgr2=0x7f1dc813e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:35.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dbe000640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc8147790 0x7f1dc813e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:35.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dbe000640 1 -- 172.21.15.37:0/2412777612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc80b3fb0 con 0x7f1dc80b45d0 2024-05-30T06:58:35.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dc6a00640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc806b960 0x7f1dc80b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:35.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dbe000640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc80b45d0 0x7f1dc815e670 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f1db000b440 tx=0x7f1db000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dbf400640 1 -- 172.21.15.37:0/2412777612 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0015020 con 0x7f1dc80b45d0 2024-05-30T06:58:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dbf400640 1 -- 172.21.15.37:0/2412777612 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db0011890 con 0x7f1dc80b45d0 2024-05-30T06:58:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dbf400640 1 -- 172.21.15.37:0/2412777612 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0011c80 con 0x7f1dc80b45d0 2024-05-30T06:58:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dcd600640 1 -- 172.21.15.37:0/2412777612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc80b1c60 con 0x7f1dc80b45d0 2024-05-30T06:58:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dcd600640 1 -- 172.21.15.37:0/2412777612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc80b2220 con 0x7f1dc80b45d0 2024-05-30T06:58:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.366+0000 7f1dcd600640 1 -- 172.21.15.37:0/2412777612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc806da00 con 0x7f1dc80b45d0 2024-05-30T06:58:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.370+0000 7f1dbf400640 1 -- 172.21.15.37:0/2412777612 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7f1db0018020 con 0x7f1dc80b45d0 2024-05-30T06:58:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.370+0000 7f1dbf400640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1da4069f40 0x7f1da406c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.370+0000 7f1dbf400640 1 -- 172.21.15.37:0/2412777612 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f1db0085610 con 0x7f1dc80b45d0 2024-05-30T06:58:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.370+0000 7f1dc6a00640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1da4069f40 0x7f1da406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.370+0000 7f1dc6a00640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1da4069f40 0x7f1da406c400 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1db80012f0 tx=0x7f1db8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:35.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.374+0000 7f1dbf400640 1 -- 172.21.15.37:0/2412777612 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1db001f030 con 0x7f1dc80b45d0 2024-05-30T06:58:35.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dcd600640 1 -- 172.21.15.37:0/2412777612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1dc8068b20 con 0x7f1dc80b45d0 2024-05-30T06:58:35.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dbf400640 1 -- 172.21.15.37:0/2412777612 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2081 (secure 0 0 0) 0x7f1db000d040 con 0x7f1dc80b45d0 2024-05-30T06:58:35.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:35.598 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:58:35.599 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:58:35.599 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:58:35.599 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:58:35.599 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:58:35.599 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:58:35.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:35.599 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:58:35.599 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:58:35.599 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:58:35.599 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:58:35.599 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:58:35.599 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 1009, 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 116, 2024-05-30T06:58:35.600 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:35.601 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:58:35.602 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:58:35.602 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1767, 2024-05-30T06:58:35.602 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 7282633537, 2024-05-30T06:58:35.602 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 15590883328, 2024-05-30T06:58:35.602 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 757503229952, 2024-05-30T06:58:35.602 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:58:35.602 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 3582, 2024-05-30T06:58:35.602 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:58:35.602 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:58:35.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:35.602 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:58:35.602 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:58:35.602 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8, 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 8, 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9120 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:58:35.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:58:26.990011+0000", 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:58:35.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:35.605 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:58:35.605 INFO:teuthology.orchestra.run.smithi037.stdout: "009dbaae-3bd5-474a-bd56-040066fd8c8f": { 2024-05-30T06:58:35.605 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 10.0 seconds before exiting (26s)\n [============================] ", 2024-05-30T06:58:35.605 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:58:35.605 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:58:35.605 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:35.605 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:35.605 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:58:35.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dcd600640 1 -- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1da4069f40 msgr2=0x7f1da406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:35.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dcd600640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1da4069f40 0x7f1da406c400 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1db80012f0 tx=0x7f1db8009040 comp rx=0 tx=0).stop 2024-05-30T06:58:35.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dcd600640 1 -- 172.21.15.37:0/2412777612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc80b45d0 msgr2=0x7f1dc815e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:35.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dcd600640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc80b45d0 0x7f1dc815e670 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f1db000b440 tx=0x7f1db000b900 comp rx=0 tx=0).stop 2024-05-30T06:58:35.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dcd600640 1 -- 172.21.15.37:0/2412777612 shutdown_connections 2024-05-30T06:58:35.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dcd600640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1da4069f40 0x7f1da406c400 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:35.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dcd600640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1dc8147790 0x7f1dc813e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:35.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dcd600640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dc80b45d0 0x7f1dc815e670 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:35.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dcd600640 1 --2- 172.21.15.37:0/2412777612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1dc806b960 0x7f1dc80b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:35.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dcd600640 1 -- 172.21.15.37:0/2412777612 >> 172.21.15.37:0/2412777612 conn(0x7f1dc80b6a60 msgr2=0x7f1dc81423e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:35.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dcd600640 1 -- 172.21.15.37:0/2412777612 shutdown_connections 2024-05-30T06:58:35.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:35.598+0000 7f1dcd600640 1 -- 172.21.15.37:0/2412777612 wait complete. 2024-05-30T06:58:35.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:58:35.882 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:58:40.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:58:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.770+0000 7f3711a00640 1 Processor -- start 2024-05-30T06:58:40.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.770+0000 7f3711a00640 1 -- start start 2024-05-30T06:58:40.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f3711a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f370c1605d0 0x7f370c0b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:40.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f3711a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f370c15fee0 0x7f370c160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:40.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f3711a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f370c0cdda0 con 0x7f370c1609b0 2024-05-30T06:58:40.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f3711a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f370c0ce080 con 0x7f370c15fee0 2024-05-30T06:58:40.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f3711a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f370c09ac00 con 0x7f370c1605d0 2024-05-30T06:58:40.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f3711000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f370c15fee0 0x7f370c160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:40.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f3703e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f370c1609b0 0x7f370c15f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47108/0 (socket says 172.21.15.37:47108) 2024-05-30T06:58:40.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f3703e00640 1 -- 172.21.15.37:0/4057582348 learned_addr learned my addr 172.21.15.37:0/4057582348 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:40.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f370be00640 1 --2- 172.21.15.37:0/4057582348 >> v2:172.21.15.105:3300/0 conn(0x7f370c1605d0 0x7f370c0b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:40.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f3711000640 1 -- 172.21.15.37:0/4057582348 >> v2:172.21.15.105:3300/0 conn(0x7f370c1605d0 msgr2=0x7f370c0b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:40.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f3711000640 1 --2- 172.21.15.37:0/4057582348 >> v2:172.21.15.105:3300/0 conn(0x7f370c1605d0 0x7f370c0b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:40.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f3711000640 1 -- 172.21.15.37:0/4057582348 >> v1:172.21.15.37:6789/0 conn(0x7f370c1609b0 legacy=0x7f370c15f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:40.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f3711000640 1 -- 172.21.15.37:0/4057582348 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370c09aee0 con 0x7f370c15fee0 2024-05-30T06:58:40.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f370b400640 1 -- 172.21.15.37:0/4057582348 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 817533798 0 0) 0x7f370c0cdda0 con 0x7f370c1609b0 2024-05-30T06:58:40.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.774+0000 7f3711000640 1 --2- 172.21.15.37:0/4057582348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c15fee0 0x7f370c160e10 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f370c06f780 tx=0x7f370401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d548263d95fb7c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:40.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f370b400640 1 -- 172.21.15.37:0/4057582348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37040b2070 con 0x7f370c15fee0 2024-05-30T06:58:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f370b400640 1 -- 172.21.15.37:0/4057582348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37040a57f0 con 0x7f370c15fee0 2024-05-30T06:58:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f370b400640 1 -- 172.21.15.37:0/4057582348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37040a5bc0 con 0x7f370c15fee0 2024-05-30T06:58:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 -- 172.21.15.37:0/4057582348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c15fee0 msgr2=0x7f370c160e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 --2- 172.21.15.37:0/4057582348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c15fee0 0x7f370c160e10 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f370c06f780 tx=0x7f370401c930 comp rx=0 tx=0).stop 2024-05-30T06:58:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 -- 172.21.15.37:0/4057582348 shutdown_connections 2024-05-30T06:58:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 --2- 172.21.15.37:0/4057582348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c15fee0 0x7f370c160e10 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 --2- 172.21.15.37:0/4057582348 >> v2:172.21.15.105:3300/0 conn(0x7f370c1605d0 0x7f370c0b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 -- 172.21.15.37:0/4057582348 >> 172.21.15.37:0/4057582348 conn(0x7f370c0b3f50 msgr2=0x7f370c0b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 -- 172.21.15.37:0/4057582348 shutdown_connections 2024-05-30T06:58:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 -- 172.21.15.37:0/4057582348 wait complete. 2024-05-30T06:58:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 Processor -- start 2024-05-30T06:58:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 -- start start 2024-05-30T06:58:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f370c15fee0 0x7f370c0c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f370c1605d0 0x7f370c15c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c1609b0 0x7f370c0c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f370c1696b0 con 0x7f370c1609b0 2024-05-30T06:58:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f370c09be20 con 0x7f370c15fee0 2024-05-30T06:58:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f370c169830 con 0x7f370c1605d0 2024-05-30T06:58:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c1609b0 0x7f370c0c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c1609b0 0x7f370c0c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38002/0 (socket says 172.21.15.37:38002) 2024-05-30T06:58:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.778+0000 7f3711000640 1 -- 172.21.15.37:0/831016841 learned_addr learned my addr 172.21.15.37:0/831016841 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f370be00640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f370c15fee0 0x7f370c0c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3703e00640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f370c1605d0 0x7f370c15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3711000640 1 -- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f370c1605d0 msgr2=0x7f370c15c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3711000640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f370c1605d0 0x7f370c15c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3711000640 1 -- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f370c15fee0 msgr2=0x7f370c0c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3711000640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f370c15fee0 0x7f370c0c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3711000640 1 -- 172.21.15.37:0/831016841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370c0c8420 con 0x7f370c1609b0 2024-05-30T06:58:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f370be00640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f370c15fee0 0x7f370c0c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:58:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3703e00640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f370c1605d0 0x7f370c15c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:58:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3711000640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c1609b0 0x7f370c0c7a60 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f37040b0040 tx=0x7f37040196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3708c00640 1 -- 172.21.15.37:0/831016841 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37040b2050 con 0x7f370c1609b0 2024-05-30T06:58:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3708c00640 1 -- 172.21.15.37:0/831016841 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37040be070 con 0x7f370c1609b0 2024-05-30T06:58:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3708c00640 1 -- 172.21.15.37:0/831016841 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37040ada90 con 0x7f370c1609b0 2024-05-30T06:58:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3711a00640 1 -- 172.21.15.37:0/831016841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370c0c60d0 con 0x7f370c1609b0 2024-05-30T06:58:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3711a00640 1 -- 172.21.15.37:0/831016841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f370c15acd0 con 0x7f370c1609b0 2024-05-30T06:58:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3711a00640 1 -- 172.21.15.37:0/831016841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f370c068ab0 con 0x7f370c1609b0 2024-05-30T06:58:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3708c00640 1 -- 172.21.15.37:0/831016841 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7f37040a5670 con 0x7f370c1609b0 2024-05-30T06:58:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3708c00640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f36e8069f10 0x7f36e806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.782+0000 7f3708c00640 1 -- 172.21.15.37:0/831016841 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f3704120a30 con 0x7f370c1609b0 2024-05-30T06:58:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.786+0000 7f370be00640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f36e8069f10 0x7f36e806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:40.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.786+0000 7f370be00640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f36e8069f10 0x7f36e806c3d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f370c15ce80 tx=0x7f36fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:40.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:40.790+0000 7f3708c00640 1 -- 172.21.15.37:0/831016841 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3704016520 con 0x7f370c1609b0 2024-05-30T06:58:41.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.014+0000 7f3711a00640 1 -- 172.21.15.37:0/831016841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f370c15f200 con 0x7f370c1609b0 2024-05-30T06:58:41.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.014+0000 7f3708c00640 1 -- 172.21.15.37:0/831016841 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2079 (secure 0 0 0) 0x7f37040f2b70 con 0x7f370c1609b0 2024-05-30T06:58:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:41.016 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:58:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:58:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:58:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:58:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:58:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:58:41.016 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 1015, 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:58:41.017 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:58:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:58:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:58:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:58:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 116, 2024-05-30T06:58:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:58:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:58:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:58:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:58:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:58:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:58:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:41.018 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:58:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:58:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:58:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:58:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:58:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:58:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1767, 2024-05-30T06:58:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 7282633537, 2024-05-30T06:58:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 15590883328, 2024-05-30T06:58:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 757503229952, 2024-05-30T06:58:41.019 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 426, 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8, 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 8, 2024-05-30T06:58:41.020 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9120 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:58:41.021 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:58:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:58:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:58:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-05-30T06:58:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:58:26.990011+0000", 2024-05-30T06:58:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:58:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T06:58:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "009dbaae-3bd5-474a-bd56-040066fd8c8f": { 2024-05-30T06:58:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 6.0 seconds before exiting (30s)\n [============================] ", 2024-05-30T06:58:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T06:58:41.022 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T06:58:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:41.023 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:41.023 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:58:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.018+0000 7f3711a00640 1 -- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f36e8069f10 msgr2=0x7f36e806c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.018+0000 7f3711a00640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f36e8069f10 0x7f36e806c3d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f370c15ce80 tx=0x7f36fc008040 comp rx=0 tx=0).stop 2024-05-30T06:58:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.018+0000 7f3711a00640 1 -- 172.21.15.37:0/831016841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c1609b0 msgr2=0x7f370c0c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.018+0000 7f3711a00640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c1609b0 0x7f370c0c7a60 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f37040b0040 tx=0x7f37040196d0 comp rx=0 tx=0).stop 2024-05-30T06:58:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.018+0000 7f3711a00640 1 -- 172.21.15.37:0/831016841 shutdown_connections 2024-05-30T06:58:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.018+0000 7f3711a00640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c1609b0 0x7f370c0c7a60 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.018+0000 7f3711a00640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f370c1605d0 0x7f370c15c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.018+0000 7f3711a00640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f36e8069f10 0x7f36e806c3d0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.018+0000 7f3711a00640 1 --2- 172.21.15.37:0/831016841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f370c15fee0 0x7f370c0c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.018+0000 7f3711a00640 1 -- 172.21.15.37:0/831016841 >> 172.21.15.37:0/831016841 conn(0x7f370c0b3f50 msgr2=0x7f370c15e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:41.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.018+0000 7f3711a00640 1 -- 172.21.15.37:0/831016841 shutdown_connections 2024-05-30T06:58:41.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:41.018+0000 7f3711a00640 1 -- 172.21.15.37:0/831016841 wait complete. 2024-05-30T06:58:46.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T06:58:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f055b000640 1 Processor -- start 2024-05-30T06:58:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f055b000640 1 -- start start 2024-05-30T06:58:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f055b000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f055409b9a0 0x7f05541625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f055b000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0554162ae0 0x7f05540ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f055b000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055409abe0 con 0x7f055415e930 2024-05-30T06:58:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f055b000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0554162f50 con 0x7f0554162ae0 2024-05-30T06:58:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f055b000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f055409aec0 con 0x7f055409b9a0 2024-05-30T06:58:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f0553e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f055415e930 0x7f05540d1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47110/0 (socket says 172.21.15.37:47110) 2024-05-30T06:58:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f0553e00640 1 -- 172.21.15.37:0/3242630824 learned_addr learned my addr 172.21.15.37:0/3242630824 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f0559000640 1 --2- 172.21.15.37:0/3242630824 >> v2:172.21.15.37:3300/0 conn(0x7f0554162ae0 0x7f05540ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f0559000640 1 -- 172.21.15.37:0/3242630824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f055409b9a0 msgr2=0x7f05541625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f0553400640 1 -- 172.21.15.37:0/3242630824 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233977251 0 0) 0x7f055409abe0 con 0x7f055415e930 2024-05-30T06:58:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f054b400640 1 --2- 172.21.15.37:0/3242630824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f055409b9a0 0x7f05541625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f0559000640 1 --2- 172.21.15.37:0/3242630824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f055409b9a0 0x7f05541625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f0559000640 1 -- 172.21.15.37:0/3242630824 >> v1:172.21.15.37:6789/0 conn(0x7f055415e930 legacy=0x7f05540d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f0559000640 1 -- 172.21.15.37:0/3242630824 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055409b1a0 con 0x7f0554162ae0 2024-05-30T06:58:46.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.194+0000 7f054b400640 1 --2- 172.21.15.37:0/3242630824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f055409b9a0 0x7f05541625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:58:46.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.198+0000 7f0559000640 1 --2- 172.21.15.37:0/3242630824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554162ae0 0x7f05540ccc60 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f054c0097c0 tx=0x7f054c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbabb8e19f41e506 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.198+0000 7f0553400640 1 -- 172.21.15.37:0/3242630824 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c0b2070 con 0x7f0554162ae0 2024-05-30T06:58:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.198+0000 7f0553400640 1 -- 172.21.15.37:0/3242630824 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054c0ad640 con 0x7f0554162ae0 2024-05-30T06:58:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.198+0000 7f0553400640 1 -- 172.21.15.37:0/3242630824 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c0ada10 con 0x7f0554162ae0 2024-05-30T06:58:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.198+0000 7f055b000640 1 -- 172.21.15.37:0/3242630824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554162ae0 msgr2=0x7f05540ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.198+0000 7f055b000640 1 --2- 172.21.15.37:0/3242630824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554162ae0 0x7f05540ccc60 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f054c0097c0 tx=0x7f054c01c4a0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.198+0000 7f055b000640 1 -- 172.21.15.37:0/3242630824 shutdown_connections 2024-05-30T06:58:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.198+0000 7f055b000640 1 --2- 172.21.15.37:0/3242630824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554162ae0 0x7f05540ccc60 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.198+0000 7f055b000640 1 --2- 172.21.15.37:0/3242630824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f055409b9a0 0x7f05541625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.198+0000 7f055b000640 1 -- 172.21.15.37:0/3242630824 >> 172.21.15.37:0/3242630824 conn(0x7f05540b4100 msgr2=0x7f05540b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:46.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.198+0000 7f055b000640 1 -- 172.21.15.37:0/3242630824 shutdown_connections 2024-05-30T06:58:46.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.198+0000 7f055b000640 1 -- 172.21.15.37:0/3242630824 wait complete. 2024-05-30T06:58:46.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f055b000640 1 Processor -- start 2024-05-30T06:58:46.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f055b000640 1 -- start start 2024-05-30T06:58:46.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f055b000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f055409b9a0 0x7f05540b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f055b000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f055415e930 0x7f055415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f055b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554162ae0 0x7f0554150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f055b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f055406ddc0 con 0x7f0554162ae0 2024-05-30T06:58:46.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f055b000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f055406dc40 con 0x7f055415e930 2024-05-30T06:58:46.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f055b000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f055415ed10 con 0x7f055409b9a0 2024-05-30T06:58:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f0559000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554162ae0 0x7f0554150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f0559000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554162ae0 0x7f0554150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38006/0 (socket says 172.21.15.37:38006) 2024-05-30T06:58:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f0559000640 1 -- 172.21.15.37:0/3557991850 learned_addr learned my addr 172.21.15.37:0/3557991850 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f0559000640 1 -- 172.21.15.37:0/3557991850 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f055409b9a0 msgr2=0x7f05540b7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f0559000640 1 --2- 172.21.15.37:0/3557991850 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f055409b9a0 0x7f05540b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f0559000640 1 -- 172.21.15.37:0/3557991850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f055415e930 msgr2=0x7f055415a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f0559000640 1 --2- 172.21.15.37:0/3557991850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f055415e930 0x7f055415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f0559000640 1 -- 172.21.15.37:0/3557991850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05540af3a0 con 0x7f0554162ae0 2024-05-30T06:58:46.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f0559000640 1 --2- 172.21.15.37:0/3557991850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554162ae0 0x7f0554150560 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f054c0b0040 tx=0x7f054c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:46.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f0550c00640 1 -- 172.21.15.37:0/3557991850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c0b2040 con 0x7f0554162ae0 2024-05-30T06:58:46.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f0550c00640 1 -- 172.21.15.37:0/3557991850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054c0bc070 con 0x7f0554162ae0 2024-05-30T06:58:46.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f055b000640 1 -- 172.21.15.37:0/3557991850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055415d7c0 con 0x7f0554162ae0 2024-05-30T06:58:46.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f0550c00640 1 -- 172.21.15.37:0/3557991850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c0b6650 con 0x7f0554162ae0 2024-05-30T06:58:46.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f055b000640 1 -- 172.21.15.37:0/3557991850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f055415dd80 con 0x7f0554162ae0 2024-05-30T06:58:46.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.202+0000 7f055b000640 1 -- 172.21.15.37:0/3557991850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05540af570 con 0x7f0554162ae0 2024-05-30T06:58:46.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.206+0000 7f0550c00640 1 -- 172.21.15.37:0/3557991850 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7f054c0b67f0 con 0x7f0554162ae0 2024-05-30T06:58:46.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.206+0000 7f0550c00640 1 --2- 172.21.15.37:0/3557991850 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0530069f10 0x7f053006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.206+0000 7f0550c00640 1 -- 172.21.15.37:0/3557991850 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f054c11fa10 con 0x7f0554162ae0 2024-05-30T06:58:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.206+0000 7f0553e00640 1 --2- 172.21.15.37:0/3557991850 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0530069f10 0x7f053006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.206+0000 7f0553e00640 1 --2- 172.21.15.37:0/3557991850 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0530069f10 0x7f053006c3d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f05440015a0 tx=0x7f0544007970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:46.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.210+0000 7f0550c00640 1 -- 172.21.15.37:0/3557991850 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f054c016090 con 0x7f0554162ae0 2024-05-30T06:58:46.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.434+0000 7f055b000640 1 -- 172.21.15.37:0/3557991850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f0554068b20 con 0x7f0554162ae0 2024-05-30T06:58:46.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.434+0000 7f0550c00640 1 -- 172.21.15.37:0/3557991850 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1825 (secure 0 0 0) 0x7f054c0f1b50 con 0x7f0554162ae0 2024-05-30T06:58:46.435 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:46.436 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:58:46.436 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:58:46.436 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T06:58:46.436 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T06:58:46.436 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T06:58:46.436 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T06:58:46.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:46.436 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T06:58:46.436 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T06:58:46.436 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T06:58:46.436 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T06:58:46.436 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T06:58:46.436 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:46.437 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T06:58:46.437 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T06:58:46.437 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T06:58:46.437 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T06:58:46.437 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:46.437 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 1020, 2024-05-30T06:58:46.437 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T06:58:46.437 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T06:58:46.437 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T06:58:46.437 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T06:58:46.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:46.437 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T06:58:46.438 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 116, 2024-05-30T06:58:46.438 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T06:58:46.438 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T06:58:46.438 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T06:58:46.438 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T06:58:46.438 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T06:58:46.438 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T06:58:46.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:46.438 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T06:58:46.438 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T06:58:46.438 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:46.438 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 1767, 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 7282633537, 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 15590883328, 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 757503229952, 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 426, 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T06:58:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T06:58:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 75, 2024-05-30T06:58:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8, 2024-05-30T06:58:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T06:58:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T06:58:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T06:58:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T06:58:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 8, 2024-05-30T06:58:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T06:58:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "a", 2024-05-30T06:58:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T06:58:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9120 2024-05-30T06:58:46.441 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:46.441 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:46.441 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T06:58:46.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:46.441 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T06:58:46.441 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T06:58:46.441 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T06:58:46.441 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T06:58:46.441 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T06:58:46.441 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T06:58:46.441 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T06:58:46.441 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T06:58:46.441 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:58:46.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:46.442 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T06:58:46.442 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 20, 2024-05-30T06:58:46.442 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T06:58:26.990011+0000", 2024-05-30T06:58:46.442 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T06:58:46.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:46.442 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": {} 2024-05-30T06:58:46.442 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:58:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.438+0000 7f055b000640 1 -- 172.21.15.37:0/3557991850 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0530069f10 msgr2=0x7f053006c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.438+0000 7f055b000640 1 --2- 172.21.15.37:0/3557991850 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0530069f10 0x7f053006c3d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f05440015a0 tx=0x7f0544007970 comp rx=0 tx=0).stop 2024-05-30T06:58:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.438+0000 7f055b000640 1 -- 172.21.15.37:0/3557991850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554162ae0 msgr2=0x7f0554150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.438+0000 7f055b000640 1 --2- 172.21.15.37:0/3557991850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554162ae0 0x7f0554150560 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f054c0b0040 tx=0x7f054c019240 comp rx=0 tx=0).stop 2024-05-30T06:58:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.438+0000 7f055b000640 1 -- 172.21.15.37:0/3557991850 shutdown_connections 2024-05-30T06:58:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.438+0000 7f055b000640 1 --2- 172.21.15.37:0/3557991850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0554162ae0 0x7f0554150560 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.438+0000 7f055b000640 1 --2- 172.21.15.37:0/3557991850 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0530069f10 0x7f053006c3d0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.438+0000 7f055b000640 1 --2- 172.21.15.37:0/3557991850 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f055415e930 0x7f055415a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.438+0000 7f055b000640 1 --2- 172.21.15.37:0/3557991850 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f055409b9a0 0x7f05540b7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.438+0000 7f055b000640 1 -- 172.21.15.37:0/3557991850 >> 172.21.15.37:0/3557991850 conn(0x7f05540b4100 msgr2=0x7f0554074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.438+0000 7f055b000640 1 -- 172.21.15.37:0/3557991850 shutdown_connections 2024-05-30T06:58:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.438+0000 7f055b000640 1 -- 172.21.15.37:0/3557991850 wait complete. 2024-05-30T06:58:46.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T06:58:46.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.598+0000 7f3ea5600640 1 Processor -- start 2024-05-30T06:58:46.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.598+0000 7f3ea5600640 1 -- start start 2024-05-30T06:58:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3ea5600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ea00b59d0 0x7f3ea00b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3ea5600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea01610a0 con 0x7f3ea015d350 2024-05-30T06:58:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3ea5600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea00b62f0 con 0x7f3ea015d7b0 2024-05-30T06:58:46.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3ea5600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea0142030 con 0x7f3ea00b59d0 2024-05-30T06:58:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e96000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3ea015d350 0x7f3ea0160280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47118/0 (socket says 172.21.15.37:47118) 2024-05-30T06:58:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e96000640 1 -- 172.21.15.37:0/2265716564 learned_addr learned my addr 172.21.15.37:0/2265716564 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9ea00640 1 --2- 172.21.15.37:0/2265716564 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ea00b59d0 0x7f3ea00b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3411870086 0 0) 0x7f3ea01610a0 con 0x7f3ea015d350 2024-05-30T06:58:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e84003530 con 0x7f3ea015d350 2024-05-30T06:58:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3362490635 0 0) 0x7f3e84003530 con 0x7f3ea015d350 2024-05-30T06:58:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ea00b59d0 msgr2=0x7f3ea00b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 --2- 172.21.15.37:0/2265716564 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ea00b59d0 0x7f3ea00b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 >> v1:172.21.15.105:6789/0 conn(0x7f3ea015d7b0 legacy=0x7f3ea0160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea0142310 con 0x7f3ea015d350 2024-05-30T06:58:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f3e88001680 con 0x7f3ea015d350 2024-05-30T06:58:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 >> v1:172.21.15.37:6789/0 conn(0x7f3ea015d350 legacy=0x7f3ea0160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 --2- 172.21.15.37:0/2265716564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e840039f0 0x7f3e84003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 --2- 172.21.15.37:0/2265716564 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ea00b59d0 0x7f3e84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 --2- 172.21.15.37:0/2265716564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e84004d50 0x7f3e840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea0142030 con 0x7f3e840039f0 2024-05-30T06:58:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8400bb10 con 0x7f3e84004d50 2024-05-30T06:58:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8400bd10 con 0x7f3ea00b59d0 2024-05-30T06:58:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9ea00640 1 --2- 172.21.15.37:0/2265716564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e840039f0 0x7f3e84003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e96000640 1 --2- 172.21.15.37:0/2265716564 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ea00b59d0 0x7f3e84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9f400640 1 --2- 172.21.15.37:0/2265716564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e84004d50 0x7f3e840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9ea00640 1 -- 172.21.15.37:0/2265716564 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ea00b59d0 msgr2=0x7f3e84004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9ea00640 1 --2- 172.21.15.37:0/2265716564 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ea00b59d0 0x7f3e84004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9ea00640 1 -- 172.21.15.37:0/2265716564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e84004d50 msgr2=0x7f3e840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9ea00640 1 --2- 172.21.15.37:0/2265716564 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e84004d50 0x7f3e840051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.602+0000 7f3e9ea00640 1 -- 172.21.15.37:0/2265716564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e84003530 con 0x7f3e840039f0 2024-05-30T06:58:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.606+0000 7f3e9ea00640 1 --2- 172.21.15.37:0/2265716564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e840039f0 0x7f3e84003e10 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009ab0 tx=0x7f3e9001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920f9ba8b52c9992 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.606+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900b2070 con 0x7f3e840039f0 2024-05-30T06:58:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.606+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e900a5530 con 0x7f3e840039f0 2024-05-30T06:58:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.606+0000 7f3e9e000640 1 -- 172.21.15.37:0/2265716564 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900096b0 con 0x7f3e840039f0 2024-05-30T06:58:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.606+0000 7f3ea5600640 1 -- 172.21.15.37:0/2265716564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e840039f0 msgr2=0x7f3e84003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.606+0000 7f3ea5600640 1 --2- 172.21.15.37:0/2265716564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e840039f0 0x7f3e84003e10 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009ab0 tx=0x7f3e9001ca50 comp rx=0 tx=0).stop 2024-05-30T06:58:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.606+0000 7f3e9f400640 1 -- 172.21.15.37:0/2265716564 reap_dead start 2024-05-30T06:58:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.606+0000 7f3ea5600640 1 -- 172.21.15.37:0/2265716564 shutdown_connections 2024-05-30T06:58:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.606+0000 7f3ea5600640 1 -- 172.21.15.37:0/2265716564 >> 172.21.15.37:0/2265716564 conn(0x7f3ea006bf60 msgr2=0x7f3ea00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.606+0000 7f3ea5600640 1 -- 172.21.15.37:0/2265716564 shutdown_connections 2024-05-30T06:58:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.606+0000 7f3ea5600640 1 -- 172.21.15.37:0/2265716564 wait complete. 2024-05-30T06:58:46.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3ea5600640 1 Processor -- start 2024-05-30T06:58:46.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3ea5600640 1 -- start start 2024-05-30T06:58:46.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3ea5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e840039f0 0x7f3ea00ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3ea5600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ea00aefa0 0x7f3ea00b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3ea5600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ea0156890 0x7f3ea014a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3ea5600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea013fce0 con 0x7f3e840039f0 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3ea5600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea01428d0 con 0x7f3ea0156890 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3ea5600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea013fe60 con 0x7f3ea00aefa0 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e9ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e840039f0 0x7f3ea00ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e9ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e840039f0 0x7f3ea00ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38032/0 (socket says 172.21.15.37:38032) 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e9ea00640 1 -- 172.21.15.37:0/2216600585 learned_addr learned my addr 172.21.15.37:0/2216600585 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e9f400640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ea0156890 0x7f3ea014a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e96000640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ea00aefa0 0x7f3ea00b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e9ea00640 1 -- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ea00aefa0 msgr2=0x7f3ea00b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e9ea00640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ea00aefa0 0x7f3ea00b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e9ea00640 1 -- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ea0156890 msgr2=0x7f3ea014a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e9ea00640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ea0156890 0x7f3ea014a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e9ea00640 1 -- 172.21.15.37:0/2216600585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea00b57f0 con 0x7f3e840039f0 2024-05-30T06:58:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e9f400640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ea0156890 0x7f3ea014a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e9ea00640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e840039f0 0x7f3ea00ad8d0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f3e9001c880 tx=0x7f3e84005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e97400640 1 -- 172.21.15.37:0/2216600585 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900b2040 con 0x7f3e840039f0 2024-05-30T06:58:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e97400640 1 -- 172.21.15.37:0/2216600585 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9000f000 con 0x7f3e840039f0 2024-05-30T06:58:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3ea5600640 1 -- 172.21.15.37:0/2216600585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea00adf00 con 0x7f3e840039f0 2024-05-30T06:58:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3e97400640 1 -- 172.21.15.37:0/2216600585 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e900096b0 con 0x7f3e840039f0 2024-05-30T06:58:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3ea5600640 1 -- 172.21.15.37:0/2216600585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea00ae4c0 con 0x7f3e840039f0 2024-05-30T06:58:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.610+0000 7f3ea5600640 1 -- 172.21.15.37:0/2216600585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea0068bc0 con 0x7f3e840039f0 2024-05-30T06:58:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.614+0000 7f3e97400640 1 -- 172.21.15.37:0/2216600585 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7f3e900c0060 con 0x7f3e840039f0 2024-05-30T06:58:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.614+0000 7f3e97400640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e7c069f10 0x7f3e7c06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.614+0000 7f3e97400640 1 -- 172.21.15.37:0/2216600585 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f3e9011f1a0 con 0x7f3e840039f0 2024-05-30T06:58:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.614+0000 7f3e96000640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e7c069f10 0x7f3e7c06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.614+0000 7f3e96000640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e7c069f10 0x7f3e7c06c3d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3ea01f7b90 tx=0x7f3e88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.618+0000 7f3e97400640 1 -- 172.21.15.37:0/2216600585 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3ea00b57f0 con 0x7f3e840039f0 2024-05-30T06:58:46.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.810+0000 7f3ea5600640 1 -- 172.21.15.37:0/2216600585 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3ea015cb70 con 0x7f3e7c069f10 2024-05-30T06:58:46.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.818+0000 7f3e97400640 1 -- 172.21.15.37:0/2216600585 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+185 (secure 0 0 0) 0x7f3ea015cb70 con 0x7f3e7c069f10 2024-05-30T06:58:46.818 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:58:46.818 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:46.818 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sv1" 2024-05-30T06:58:46.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:46.818 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:46.818 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone44122" 2024-05-30T06:58:46.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:46.818 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:46.818 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone44121" 2024-05-30T06:58:46.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:58:46.818 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:46.819 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone44123" 2024-05-30T06:58:46.819 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:58:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.818+0000 7f3ea5600640 1 -- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e7c069f10 msgr2=0x7f3e7c06c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.818+0000 7f3ea5600640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e7c069f10 0x7f3e7c06c3d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3ea01f7b90 tx=0x7f3e88009040 comp rx=0 tx=0).stop 2024-05-30T06:58:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.818+0000 7f3ea5600640 1 -- 172.21.15.37:0/2216600585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e840039f0 msgr2=0x7f3ea00ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.818+0000 7f3ea5600640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e840039f0 0x7f3ea00ad8d0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f3e9001c880 tx=0x7f3e84005840 comp rx=0 tx=0).stop 2024-05-30T06:58:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.818+0000 7f3ea5600640 1 -- 172.21.15.37:0/2216600585 shutdown_connections 2024-05-30T06:58:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.818+0000 7f3ea5600640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e7c069f10 0x7f3e7c06c3d0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.818+0000 7f3ea5600640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ea0156890 0x7f3ea014a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.818+0000 7f3ea5600640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ea00aefa0 0x7f3ea00b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.818+0000 7f3ea5600640 1 --2- 172.21.15.37:0/2216600585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e840039f0 0x7f3ea00ad8d0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.818+0000 7f3ea5600640 1 -- 172.21.15.37:0/2216600585 >> 172.21.15.37:0/2216600585 conn(0x7f3ea006bf60 msgr2=0x7f3ea0071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.818+0000 7f3ea5600640 1 -- 172.21.15.37:0/2216600585 shutdown_connections 2024-05-30T06:58:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.818+0000 7f3ea5600640 1 -- 172.21.15.37:0/2216600585 wait complete. 2024-05-30T06:58:46.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T06:58:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.982+0000 7f5cda000640 1 Processor -- start 2024-05-30T06:58:46.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.982+0000 7f5cda000640 1 -- start start 2024-05-30T06:58:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.986+0000 7f5cda000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd40ced10 0x7f5cd406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.986+0000 7f5cda000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cd40b59d0 0x7f5cd40b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.986+0000 7f5cda000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd415db00 con 0x7f5cd415cdd0 2024-05-30T06:58:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.986+0000 7f5cda000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5cd406df50 con 0x7f5cd40b59d0 2024-05-30T06:58:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.986+0000 7f5cda000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd40b6370 con 0x7f5cd40ced10 2024-05-30T06:58:46.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.986+0000 7f5ccaa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cd40b59d0 0x7f5cd40b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.986+0000 7f5cd3e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5cd415cdd0 0x7f5cd415d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47128/0 (socket says 172.21.15.37:47128) 2024-05-30T06:58:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.986+0000 7f5cd3e00640 1 -- 172.21.15.37:0/14486314 learned_addr learned my addr 172.21.15.37:0/14486314 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.986+0000 7f5ccaa00640 1 -- 172.21.15.37:0/14486314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd40ced10 msgr2=0x7f5cd406ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.986+0000 7f5ccaa00640 1 --2- 172.21.15.37:0/14486314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd40ced10 0x7f5cd406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.986+0000 7f5ccaa00640 1 -- 172.21.15.37:0/14486314 >> v1:172.21.15.37:6789/0 conn(0x7f5cd415cdd0 legacy=0x7f5cd415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.986+0000 7f5ccaa00640 1 -- 172.21.15.37:0/14486314 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd406e180 con 0x7f5cd40b59d0 2024-05-30T06:58:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.986+0000 7f5cd2a00640 1 -- 172.21.15.37:0/14486314 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4264622073 0 0) 0x7f5cd415db00 con 0x7f5cd415cdd0 2024-05-30T06:58:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5ccaa00640 1 --2- 172.21.15.37:0/14486314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40b59d0 0x7f5cd40b5e30 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0097c0 tx=0x7f5cbc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30fd592bce0684c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cd2a00640 1 -- 172.21.15.37:0/14486314 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc0b1070 con 0x7f5cd40b59d0 2024-05-30T06:58:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cd2a00640 1 -- 172.21.15.37:0/14486314 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cbc0ac410 con 0x7f5cd40b59d0 2024-05-30T06:58:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cd2a00640 1 -- 172.21.15.37:0/14486314 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc0ac7e0 con 0x7f5cd40b59d0 2024-05-30T06:58:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 -- 172.21.15.37:0/14486314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40b59d0 msgr2=0x7f5cd40b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 --2- 172.21.15.37:0/14486314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40b59d0 0x7f5cd40b5e30 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc0097c0 tx=0x7f5cbc01c4a0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 -- 172.21.15.37:0/14486314 shutdown_connections 2024-05-30T06:58:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 --2- 172.21.15.37:0/14486314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40b59d0 0x7f5cd40b5e30 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 --2- 172.21.15.37:0/14486314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd40ced10 0x7f5cd406ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 -- 172.21.15.37:0/14486314 >> 172.21.15.37:0/14486314 conn(0x7f5cd406bf60 msgr2=0x7f5cd40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 -- 172.21.15.37:0/14486314 shutdown_connections 2024-05-30T06:58:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 -- 172.21.15.37:0/14486314 wait complete. 2024-05-30T06:58:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 Processor -- start 2024-05-30T06:58:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 -- start start 2024-05-30T06:58:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cd40b59d0 0x7f5cd413b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd40ced10 0x7f5cd413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd415cdd0 0x7f5cd41539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd415ea50 con 0x7f5cd415cdd0 2024-05-30T06:58:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd415e8d0 con 0x7f5cd40b59d0 2024-05-30T06:58:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cda000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd413c390 con 0x7f5cd40ced10 2024-05-30T06:58:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.990+0000 7f5cd3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd415cdd0 0x7f5cd41539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5cd3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd415cdd0 0x7f5cd41539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38044/0 (socket says 172.21.15.37:38044) 2024-05-30T06:58:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5cd3e00640 1 -- 172.21.15.37:0/2961195084 learned_addr learned my addr 172.21.15.37:0/2961195084 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5ccaa00640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd40ced10 0x7f5cd413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5cd3400640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cd40b59d0 0x7f5cd413b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5cd3e00640 1 -- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd40ced10 msgr2=0x7f5cd413b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5cd3e00640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd40ced10 0x7f5cd413b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5cd3e00640 1 -- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cd40b59d0 msgr2=0x7f5cd413b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5cd3e00640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cd40b59d0 0x7f5cd413b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5cd3e00640 1 -- 172.21.15.37:0/2961195084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd413c670 con 0x7f5cd415cdd0 2024-05-30T06:58:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5cd3e00640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd415cdd0 0x7f5cd41539f0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00c3e0 tx=0x7f5ccc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5ccbe00640 1 -- 172.21.15.37:0/2961195084 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0074e0 con 0x7f5cd415cdd0 2024-05-30T06:58:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5ccbe00640 1 -- 172.21.15.37:0/2961195084 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc0047f0 con 0x7f5cd415cdd0 2024-05-30T06:58:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5ccbe00640 1 -- 172.21.15.37:0/2961195084 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc004be0 con 0x7f5cd415cdd0 2024-05-30T06:58:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5cda000640 1 -- 172.21.15.37:0/2961195084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd413c950 con 0x7f5cd415cdd0 2024-05-30T06:58:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5cda000640 1 -- 172.21.15.37:0/2961195084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd413cf10 con 0x7f5cd415cdd0 2024-05-30T06:58:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5cda000640 1 -- 172.21.15.37:0/2961195084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd4068d40 con 0x7f5cd415cdd0 2024-05-30T06:58:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5ccbe00640 1 -- 172.21.15.37:0/2961195084 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7f5ccc011070 con 0x7f5cd415cdd0 2024-05-30T06:58:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.994+0000 7f5ccbe00640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5cb0069f10 0x7f5cb006c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.998+0000 7f5ccbe00640 1 -- 172.21.15.37:0/2961195084 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f5ccc085390 con 0x7f5cd415cdd0 2024-05-30T06:58:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.998+0000 7f5cd3400640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5cb0069f10 0x7f5cb006c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.998+0000 7f5cd3400640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5cb0069f10 0x7f5cb006c3d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4162660 tx=0x7f5cc400d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:47.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:46.998+0000 7f5ccbe00640 1 -- 172.21.15.37:0/2961195084 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5ccc056d60 con 0x7f5cd415cdd0 2024-05-30T06:58:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.198+0000 7f5cda000640 1 -- 172.21.15.37:0/2961195084 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5cd415fd70 con 0x7f5cb0069f10 2024-05-30T06:58:47.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.210+0000 7f5ccbe00640 1 -- 172.21.15.37:0/2961195084 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5cd415fd70 con 0x7f5cb0069f10 2024-05-30T06:58:47.213 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:47.213 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:58:47.213 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:58:47.213 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ss1" 2024-05-30T06:58:47.213 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:58:47.213 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:58:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.214+0000 7f5cda000640 1 -- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5cb0069f10 msgr2=0x7f5cb006c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.214+0000 7f5cda000640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5cb0069f10 0x7f5cb006c3d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4162660 tx=0x7f5cc400d040 comp rx=0 tx=0).stop 2024-05-30T06:58:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.214+0000 7f5cda000640 1 -- 172.21.15.37:0/2961195084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd415cdd0 msgr2=0x7f5cd41539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.214+0000 7f5cda000640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd415cdd0 0x7f5cd41539f0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00c3e0 tx=0x7f5ccc00c8a0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.214+0000 7f5cda000640 1 -- 172.21.15.37:0/2961195084 shutdown_connections 2024-05-30T06:58:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.214+0000 7f5cda000640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd415cdd0 0x7f5cd41539f0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.214+0000 7f5cda000640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd40ced10 0x7f5cd413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.214+0000 7f5cda000640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5cb0069f10 0x7f5cb006c3d0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.214+0000 7f5cda000640 1 --2- 172.21.15.37:0/2961195084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cd40b59d0 0x7f5cd413b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.214+0000 7f5cda000640 1 -- 172.21.15.37:0/2961195084 >> 172.21.15.37:0/2961195084 conn(0x7f5cd406bf60 msgr2=0x7f5cd415d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.214+0000 7f5cda000640 1 -- 172.21.15.37:0/2961195084 shutdown_connections 2024-05-30T06:58:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.214+0000 7f5cda000640 1 -- 172.21.15.37:0/2961195084 wait complete. 2024-05-30T06:58:47.235 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T06:58:47.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.378+0000 7fb09de00640 1 Processor -- start 2024-05-30T06:58:47.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.378+0000 7fb09de00640 1 -- start start 2024-05-30T06:58:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.382+0000 7fb09de00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb09815ebc0 0x7fb0980d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.382+0000 7fb09de00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb09809aa60 0x7fb09809ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.382+0000 7fb09de00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb09809b3b0 con 0x7fb09809b800 2024-05-30T06:58:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.382+0000 7fb09de00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb0980d0840 con 0x7fb09809aa60 2024-05-30T06:58:47.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.382+0000 7fb09de00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb09806dec0 con 0x7fb09815ebc0 2024-05-30T06:58:47.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.382+0000 7fb097400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb09809aa60 0x7fb09809ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:47.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.382+0000 7fb097400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb09809aa60 0x7fb09809ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58420/0 (socket says 172.21.15.37:58420) 2024-05-30T06:58:47.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.382+0000 7fb097400640 1 -- 172.21.15.37:0/1515367535 learned_addr learned my addr 172.21.15.37:0/1515367535 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:47.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.382+0000 7fb096a00640 1 --2- 172.21.15.37:0/1515367535 >> v2:172.21.15.105:3300/0 conn(0x7fb09815ebc0 0x7fb0980d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:47.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.382+0000 7fb097400640 1 -- 172.21.15.37:0/1515367535 >> v2:172.21.15.105:3300/0 conn(0x7fb09815ebc0 msgr2=0x7fb0980d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:47.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.382+0000 7fb097400640 1 --2- 172.21.15.37:0/1515367535 >> v2:172.21.15.105:3300/0 conn(0x7fb09815ebc0 0x7fb0980d15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.382+0000 7fb097400640 1 -- 172.21.15.37:0/1515367535 >> v1:172.21.15.105:6789/0 conn(0x7fb09809b800 legacy=0x7fb09806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:47.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.382+0000 7fb097400640 1 -- 172.21.15.37:0/1515367535 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb09809bce0 con 0x7fb09809aa60 2024-05-30T06:58:47.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb097400640 1 --2- 172.21.15.37:0/1515367535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb09809aa60 0x7fb09809ae70 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fb098073610 tx=0x7fb09001c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70ad18d725fcaf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:47.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb096000640 1 -- 172.21.15.37:0/1515367535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0900a5580 con 0x7fb09809aa60 2024-05-30T06:58:47.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb096000640 1 -- 172.21.15.37:0/1515367535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0900a5720 con 0x7fb09809aa60 2024-05-30T06:58:47.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb096000640 1 -- 172.21.15.37:0/1515367535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0900a5af0 con 0x7fb09809aa60 2024-05-30T06:58:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb09de00640 1 -- 172.21.15.37:0/1515367535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb09809aa60 msgr2=0x7fb09809ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb09de00640 1 --2- 172.21.15.37:0/1515367535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb09809aa60 0x7fb09809ae70 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fb098073610 tx=0x7fb09001c7d0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb09de00640 1 -- 172.21.15.37:0/1515367535 shutdown_connections 2024-05-30T06:58:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb09de00640 1 --2- 172.21.15.37:0/1515367535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb09809aa60 0x7fb09809ae70 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb09de00640 1 --2- 172.21.15.37:0/1515367535 >> v2:172.21.15.105:3300/0 conn(0x7fb09815ebc0 0x7fb0980d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb09de00640 1 -- 172.21.15.37:0/1515367535 >> 172.21.15.37:0/1515367535 conn(0x7fb0980b4060 msgr2=0x7fb0980b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb09de00640 1 -- 172.21.15.37:0/1515367535 shutdown_connections 2024-05-30T06:58:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb09de00640 1 -- 172.21.15.37:0/1515367535 wait complete. 2024-05-30T06:58:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb09de00640 1 Processor -- start 2024-05-30T06:58:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.386+0000 7fb09de00640 1 -- start start 2024-05-30T06:58:47.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb09de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb09809aa60 0x7fb098155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:47.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb09de00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb09809b800 0x7fb098156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:47.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb09de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb09815ebc0 0x7fb0980c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:47.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb09de00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb0980d1b00 con 0x7fb09815ebc0 2024-05-30T06:58:47.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb09de00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb09815efa0 con 0x7fb09809b800 2024-05-30T06:58:47.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb09de00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb0980b0440 con 0x7fb09809aa60 2024-05-30T06:58:47.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb097400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb09815ebc0 0x7fb0980c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:47.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb097400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb09815ebc0 0x7fb0980c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58436/0 (socket says 172.21.15.37:58436) 2024-05-30T06:58:47.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb097400640 1 -- 172.21.15.37:0/3708962807 learned_addr learned my addr 172.21.15.37:0/3708962807 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:47.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb096a00640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb09809aa60 0x7fb098155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:47.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb08fe00640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb09809b800 0x7fb098156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:47.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb097400640 1 -- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb09809aa60 msgr2=0x7fb098155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:47.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb097400640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb09809aa60 0x7fb098155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb097400640 1 -- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb09809b800 msgr2=0x7fb098156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:47.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb097400640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb09809b800 0x7fb098156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb097400640 1 -- 172.21.15.37:0/3708962807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0980b0720 con 0x7fb09815ebc0 2024-05-30T06:58:47.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb097400640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb09815ebc0 0x7fb0980c61e0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fb0900af040 tx=0x7fb090019570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:47.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb08f400640 1 -- 172.21.15.37:0/3708962807 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090009510 con 0x7fb09815ebc0 2024-05-30T06:58:47.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb08f400640 1 -- 172.21.15.37:0/3708962807 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0900be070 con 0x7fb09815ebc0 2024-05-30T06:58:47.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb08f400640 1 -- 172.21.15.37:0/3708962807 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0900b88d0 con 0x7fb09815ebc0 2024-05-30T06:58:47.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb09de00640 1 -- 172.21.15.37:0/3708962807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0980b0a00 con 0x7fb09815ebc0 2024-05-30T06:58:47.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb09de00640 1 -- 172.21.15.37:0/3708962807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0980ca3d0 con 0x7fb09815ebc0 2024-05-30T06:58:47.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb09de00640 1 -- 172.21.15.37:0/3708962807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb098068bc0 con 0x7fb09815ebc0 2024-05-30T06:58:47.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.390+0000 7fb08f400640 1 -- 172.21.15.37:0/3708962807 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7fb0900b8a70 con 0x7fb09815ebc0 2024-05-30T06:58:47.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.394+0000 7fb08f400640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb074069f10 0x7fb07406c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:47.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.394+0000 7fb08f400640 1 -- 172.21.15.37:0/3708962807 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7fb090120890 con 0x7fb09815ebc0 2024-05-30T06:58:47.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.394+0000 7fb096a00640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb074069f10 0x7fb07406c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:47.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.394+0000 7fb096a00640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb074069f10 0x7fb07406c3d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb08800b9d0 tx=0x7fb088008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.398+0000 7fb08f400640 1 -- 172.21.15.37:0/3708962807 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb09809b3b0 con 0x7fb09815ebc0 2024-05-30T06:58:47.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.590+0000 7fb09de00640 1 -- 172.21.15.37:0/3708962807 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb098158190 con 0x7fb074069f10 2024-05-30T06:58:47.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.618+0000 7fb08f400640 1 -- 172.21.15.37:0/3708962807 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb098158190 con 0x7fb074069f10 2024-05-30T06:58:47.620 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:47.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.622+0000 7fb09de00640 1 -- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb074069f10 msgr2=0x7fb07406c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:47.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.622+0000 7fb09de00640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb074069f10 0x7fb07406c3d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb08800b9d0 tx=0x7fb088008040 comp rx=0 tx=0).stop 2024-05-30T06:58:47.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.622+0000 7fb09de00640 1 -- 172.21.15.37:0/3708962807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb09815ebc0 msgr2=0x7fb0980c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:47.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.622+0000 7fb09de00640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb09815ebc0 0x7fb0980c61e0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fb0900af040 tx=0x7fb090019570 comp rx=0 tx=0).stop 2024-05-30T06:58:47.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.622+0000 7fb09de00640 1 -- 172.21.15.37:0/3708962807 shutdown_connections 2024-05-30T06:58:47.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.622+0000 7fb09de00640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb09815ebc0 0x7fb0980c61e0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.622+0000 7fb09de00640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb074069f10 0x7fb07406c3d0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.622+0000 7fb09de00640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb09809b800 0x7fb098156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.622+0000 7fb09de00640 1 --2- 172.21.15.37:0/3708962807 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb09809aa60 0x7fb098155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.622+0000 7fb09de00640 1 -- 172.21.15.37:0/3708962807 >> 172.21.15.37:0/3708962807 conn(0x7fb0980b4060 msgr2=0x7fb0980b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:47.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.622+0000 7fb09de00640 1 -- 172.21.15.37:0/3708962807 shutdown_connections 2024-05-30T06:58:47.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.622+0000 7fb09de00640 1 -- 172.21.15.37:0/3708962807 wait complete. 2024-05-30T06:58:47.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs sv1 2024-05-30T06:58:47.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b61800640 1 Processor -- start 2024-05-30T06:58:47.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b61800640 1 -- start start 2024-05-30T06:58:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b61800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b5c0cd440 0x7f7b5c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b61800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7b5c06f5a0 0x7f7b5c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b61800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b5c15f310 con 0x7f7b5c155da0 2024-05-30T06:58:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b61800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7b5c06fa10 con 0x7f7b5c0cd440 2024-05-30T06:58:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b61800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7b5c15f5f0 con 0x7f7b5c06f5a0 2024-05-30T06:58:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b5aa00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7b5c155da0 0x7f7b5c0cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56072/0 (socket says 172.21.15.37:56072) 2024-05-30T06:58:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b5aa00640 1 -- 172.21.15.37:0/3529308636 learned_addr learned my addr 172.21.15.37:0/3529308636 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:47.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b53e00640 1 --2- 172.21.15.37:0/3529308636 >> v2:172.21.15.37:3300/0 conn(0x7f7b5c0cd440 0x7f7b5c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b5b400640 1 --2- 172.21.15.37:0/3529308636 >> v2:172.21.15.105:3300/0 conn(0x7f7b5c06f5a0 0x7f7b5c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b5a000640 1 -- 172.21.15.37:0/3529308636 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1758644369 0 0) 0x7f7b5c15f310 con 0x7f7b5c155da0 2024-05-30T06:58:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b5a000640 1 -- 172.21.15.37:0/3529308636 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b40003530 con 0x7f7b5c155da0 2024-05-30T06:58:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b53e00640 1 -- 172.21.15.37:0/3529308636 >> v2:172.21.15.105:3300/0 conn(0x7f7b5c06f5a0 msgr2=0x7f7b5c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b53e00640 1 --2- 172.21.15.37:0/3529308636 >> v2:172.21.15.105:3300/0 conn(0x7f7b5c06f5a0 0x7f7b5c0b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b53e00640 1 -- 172.21.15.37:0/3529308636 >> v1:172.21.15.37:6789/0 conn(0x7f7b5c155da0 legacy=0x7f7b5c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b53e00640 1 -- 172.21.15.37:0/3529308636 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5c15f8d0 con 0x7f7b5c0cd440 2024-05-30T06:58:47.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.786+0000 7f7b5b400640 1 --2- 172.21.15.37:0/3529308636 >> v2:172.21.15.105:3300/0 conn(0x7f7b5c06f5a0 0x7f7b5c0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:47.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.790+0000 7f7b53e00640 1 --2- 172.21.15.37:0/3529308636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c0cd440 0x7f7b5c06f060 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0b6600 tx=0x7f7b4401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb024426b78b7be2 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:47.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.790+0000 7f7b5a000640 1 -- 172.21.15.37:0/3529308636 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b440b0070 con 0x7f7b5c0cd440 2024-05-30T06:58:47.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.790+0000 7f7b5a000640 1 -- 172.21.15.37:0/3529308636 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b440ab600 con 0x7f7b5c0cd440 2024-05-30T06:58:47.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.790+0000 7f7b5a000640 1 -- 172.21.15.37:0/3529308636 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b440ab9d0 con 0x7f7b5c0cd440 2024-05-30T06:58:47.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.790+0000 7f7b61800640 1 -- 172.21.15.37:0/3529308636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c0cd440 msgr2=0x7f7b5c06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:47.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.790+0000 7f7b61800640 1 --2- 172.21.15.37:0/3529308636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c0cd440 0x7f7b5c06f060 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0b6600 tx=0x7f7b4401c360 comp rx=0 tx=0).stop 2024-05-30T06:58:47.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.790+0000 7f7b61800640 1 -- 172.21.15.37:0/3529308636 shutdown_connections 2024-05-30T06:58:47.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.790+0000 7f7b61800640 1 --2- 172.21.15.37:0/3529308636 >> v2:172.21.15.105:3300/0 conn(0x7f7b5c06f5a0 0x7f7b5c0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.790+0000 7f7b61800640 1 --2- 172.21.15.37:0/3529308636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c0cd440 0x7f7b5c06f060 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.790+0000 7f7b61800640 1 -- 172.21.15.37:0/3529308636 >> 172.21.15.37:0/3529308636 conn(0x7f7b5c06bf60 msgr2=0x7f7b5c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:47.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.790+0000 7f7b61800640 1 -- 172.21.15.37:0/3529308636 shutdown_connections 2024-05-30T06:58:47.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.790+0000 7f7b61800640 1 -- 172.21.15.37:0/3529308636 wait complete. 2024-05-30T06:58:47.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b61800640 1 Processor -- start 2024-05-30T06:58:47.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b61800640 1 -- start start 2024-05-30T06:58:47.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b61800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b5c06f5a0 0x7f7b5c1f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:47.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b61800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c155da0 0x7f7b5c156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:47.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b61800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c1567d0 0x7f7b5c0b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:47.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b61800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c168580 con 0x7f7b5c155da0 2024-05-30T06:58:47.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b61800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c0b46f0 con 0x7f7b5c1567d0 2024-05-30T06:58:47.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b61800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7b5c168700 con 0x7f7b5c06f5a0 2024-05-30T06:58:47.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b53e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c155da0 0x7f7b5c156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:47.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b53e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c155da0 0x7f7b5c156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58448/0 (socket says 172.21.15.37:58448) 2024-05-30T06:58:47.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b53e00640 1 -- 172.21.15.37:0/1947197695 learned_addr learned my addr 172.21.15.37:0/1947197695 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:47.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b5b400640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c1567d0 0x7f7b5c0b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:47.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b5aa00640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b5c06f5a0 0x7f7b5c1f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:47.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b53e00640 1 -- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b5c06f5a0 msgr2=0x7f7b5c1f6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:47.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b53e00640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b5c06f5a0 0x7f7b5c1f6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b53e00640 1 -- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c1567d0 msgr2=0x7f7b5c0b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:47.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b53e00640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c1567d0 0x7f7b5c0b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:47.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b53e00640 1 -- 172.21.15.37:0/1947197695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5c0b0180 con 0x7f7b5c155da0 2024-05-30T06:58:47.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b5b400640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c1567d0 0x7f7b5c0b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:47.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b53e00640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c155da0 0x7f7b5c156290 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f7b440ae040 tx=0x7f7b44019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:47.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b52a00640 1 -- 172.21.15.37:0/1947197695 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b440b0040 con 0x7f7b5c155da0 2024-05-30T06:58:47.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b52a00640 1 -- 172.21.15.37:0/1947197695 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b440b9070 con 0x7f7b5c155da0 2024-05-30T06:58:47.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b52a00640 1 -- 172.21.15.37:0/1947197695 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b440b4690 con 0x7f7b5c155da0 2024-05-30T06:58:47.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b61800640 1 -- 172.21.15.37:0/1947197695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5c0b0460 con 0x7f7b5c155da0 2024-05-30T06:58:47.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b61800640 1 -- 172.21.15.37:0/1947197695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b5c0b0a20 con 0x7f7b5c155da0 2024-05-30T06:58:47.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.794+0000 7f7b61800640 1 -- 172.21.15.37:0/1947197695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b5c068bc0 con 0x7f7b5c155da0 2024-05-30T06:58:47.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.798+0000 7f7b52a00640 1 -- 172.21.15.37:0/1947197695 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7f7b440b4830 con 0x7f7b5c155da0 2024-05-30T06:58:47.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.798+0000 7f7b52a00640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b38069f10 0x7f7b3806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:47.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.798+0000 7f7b52a00640 1 -- 172.21.15.37:0/1947197695 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f7b4411f720 con 0x7f7b5c155da0 2024-05-30T06:58:47.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.798+0000 7f7b5aa00640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b38069f10 0x7f7b3806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:47.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.798+0000 7f7b5aa00640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b38069f10 0x7f7b3806c3d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c005890 tx=0x7f7b4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:47.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.802+0000 7f7b52a00640 1 -- 172.21.15.37:0/1947197695 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b44016070 con 0x7f7b5c155da0 2024-05-30T06:58:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:47.994+0000 7f7b61800640 1 -- 172.21.15.37:0/1947197695 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f7b5c0aff30 con 0x7f7b38069f10 2024-05-30T06:58:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.014+0000 7f7b52a00640 1 -- 172.21.15.37:0/1947197695 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7b5c0aff30 con 0x7f7b38069f10 2024-05-30T06:58:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.018+0000 7f7b61800640 1 -- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b38069f10 msgr2=0x7f7b3806c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.018+0000 7f7b61800640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b38069f10 0x7f7b3806c3d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c005890 tx=0x7f7b4c009040 comp rx=0 tx=0).stop 2024-05-30T06:58:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.018+0000 7f7b61800640 1 -- 172.21.15.37:0/1947197695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c155da0 msgr2=0x7f7b5c156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.018+0000 7f7b61800640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c155da0 0x7f7b5c156290 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f7b440ae040 tx=0x7f7b44019100 comp rx=0 tx=0).stop 2024-05-30T06:58:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.018+0000 7f7b61800640 1 -- 172.21.15.37:0/1947197695 shutdown_connections 2024-05-30T06:58:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.018+0000 7f7b61800640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7b38069f10 0x7f7b3806c3d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.018+0000 7f7b61800640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b5c1567d0 0x7f7b5c0b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.018+0000 7f7b61800640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b5c155da0 0x7f7b5c156290 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.018+0000 7f7b61800640 1 --2- 172.21.15.37:0/1947197695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b5c06f5a0 0x7f7b5c1f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.018+0000 7f7b61800640 1 -- 172.21.15.37:0/1947197695 >> 172.21.15.37:0/1947197695 conn(0x7f7b5c06bf60 msgr2=0x7f7b5c06df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.018+0000 7f7b61800640 1 -- 172.21.15.37:0/1947197695 shutdown_connections 2024-05-30T06:58:48.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.018+0000 7f7b61800640 1 -- 172.21.15.37:0/1947197695 wait complete. 2024-05-30T06:58:48.020 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:48.019+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:48.020 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:48.019+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:48.020 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:48.019+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:48.021 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:48.019+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:48.021 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:48.019+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:48.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone44122 2024-05-30T06:58:48.039 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:48.039+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:48.039 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:48.039+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:48.039 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:48.039+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:48.039 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:48.039+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:48.039 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:58:48.039+0000 7f004ee00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:58:48.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.186+0000 7f0a9f600640 1 Processor -- start 2024-05-30T06:58:48.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.186+0000 7f0a9f600640 1 -- start start 2024-05-30T06:58:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9f600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a98159490 0x7f0a98072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9f600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a980702d0 0x7f0a98072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9f600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0a9815f190 0x7f0a9815f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9f600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0a98162800 con 0x7f0a98159490 2024-05-30T06:58:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9f600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0a980d06e0 con 0x7f0a9815f190 2024-05-30T06:58:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9f600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0a98162a50 con 0x7f0a980702d0 2024-05-30T06:58:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9cc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a98159490 0x7f0a98072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9cc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a98159490 0x7f0a98072750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58464/0 (socket says 172.21.15.37:58464) 2024-05-30T06:58:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9cc00640 1 -- 172.21.15.37:0/3862323272 learned_addr learned my addr 172.21.15.37:0/3862323272 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a97e00640 1 --2- 172.21.15.37:0/3862323272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a980702d0 0x7f0a98072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9d600640 1 --2- 172.21.15.37:0/3862323272 >> v2:172.21.15.105:3300/0 conn(0x7f0a9815f190 0x7f0a9815f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9cc00640 1 -- 172.21.15.37:0/3862323272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a980702d0 msgr2=0x7f0a98072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9cc00640 1 --2- 172.21.15.37:0/3862323272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a980702d0 0x7f0a98072c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9cc00640 1 -- 172.21.15.37:0/3862323272 >> v2:172.21.15.105:3300/0 conn(0x7f0a9815f190 msgr2=0x7f0a9815f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9cc00640 1 --2- 172.21.15.37:0/3862323272 >> v2:172.21.15.105:3300/0 conn(0x7f0a9815f190 0x7f0a9815f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.190+0000 7f0a9cc00640 1 -- 172.21.15.37:0/3862323272 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a98162d30 con 0x7f0a98159490 2024-05-30T06:58:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9cc00640 1 --2- 172.21.15.37:0/3862323272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a98159490 0x7f0a98072750 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f0a9809ef30 tx=0x7f0a8c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24d2b5d6782da25 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a97400640 1 -- 172.21.15.37:0/3862323272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0b0070 con 0x7f0a98159490 2024-05-30T06:58:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a97400640 1 -- 172.21.15.37:0/3862323272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a8c0ab600 con 0x7f0a98159490 2024-05-30T06:58:48.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a97400640 1 -- 172.21.15.37:0/3862323272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0ab9d0 con 0x7f0a98159490 2024-05-30T06:58:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 -- 172.21.15.37:0/3862323272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a98159490 msgr2=0x7f0a98072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 --2- 172.21.15.37:0/3862323272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a98159490 0x7f0a98072750 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f0a9809ef30 tx=0x7f0a8c01c3a0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 -- 172.21.15.37:0/3862323272 shutdown_connections 2024-05-30T06:58:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 --2- 172.21.15.37:0/3862323272 >> v2:172.21.15.105:3300/0 conn(0x7f0a9815f190 0x7f0a9815f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 --2- 172.21.15.37:0/3862323272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a980702d0 0x7f0a98072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 --2- 172.21.15.37:0/3862323272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a98159490 0x7f0a98072750 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 -- 172.21.15.37:0/3862323272 >> 172.21.15.37:0/3862323272 conn(0x7f0a980d0d50 msgr2=0x7f0a980d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 -- 172.21.15.37:0/3862323272 shutdown_connections 2024-05-30T06:58:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 -- 172.21.15.37:0/3862323272 wait complete. 2024-05-30T06:58:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 Processor -- start 2024-05-30T06:58:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 -- start start 2024-05-30T06:58:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a980702d0 0x7f0a9815e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a98159490 0x7f0a981426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9815f190 0x7f0a9815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a980cf830 con 0x7f0a9815f190 2024-05-30T06:58:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0a980cf6b0 con 0x7f0a98159490 2024-05-30T06:58:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9f600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0a980cf9b0 con 0x7f0a980702d0 2024-05-30T06:58:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9815f190 0x7f0a9815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9815f190 0x7f0a9815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58478/0 (socket says 172.21.15.37:58478) 2024-05-30T06:58:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.194+0000 7f0a9d600640 1 -- 172.21.15.37:0/153969646 learned_addr learned my addr 172.21.15.37:0/153969646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a97e00640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a98159490 0x7f0a981426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a9d600640 1 -- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a980702d0 msgr2=0x7f0a9815e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a9cc00640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a980702d0 0x7f0a9815e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a9d600640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a980702d0 0x7f0a9815e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a9d600640 1 -- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a98159490 msgr2=0x7f0a981426e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a9d600640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a98159490 0x7f0a981426e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a9d600640 1 -- 172.21.15.37:0/153969646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a98067b50 con 0x7f0a9815f190 2024-05-30T06:58:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a97e00640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a98159490 0x7f0a981426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:58:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a9cc00640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a980702d0 0x7f0a9815e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:58:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a9d600640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9815f190 0x7f0a9815c9b0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f0a90007e90 tx=0x7f0a9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a94c00640 1 -- 172.21.15.37:0/153969646 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90014420 con 0x7f0a9815f190 2024-05-30T06:58:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a94c00640 1 -- 172.21.15.37:0/153969646 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a90019070 con 0x7f0a9815f190 2024-05-30T06:58:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a94c00640 1 -- 172.21.15.37:0/153969646 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90014800 con 0x7f0a9815f190 2024-05-30T06:58:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a9f600640 1 -- 172.21.15.37:0/153969646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9815d2e0 con 0x7f0a9815f190 2024-05-30T06:58:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a9f600640 1 -- 172.21.15.37:0/153969646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9815d8a0 con 0x7f0a9815f190 2024-05-30T06:58:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a9f600640 1 -- 172.21.15.37:0/153969646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a98068d40 con 0x7f0a9815f190 2024-05-30T06:58:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a94c00640 1 -- 172.21.15.37:0/153969646 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7f0a900149a0 con 0x7f0a9815f190 2024-05-30T06:58:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.198+0000 7f0a94c00640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a78069f40 0x7f0a7806c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.202+0000 7f0a94c00640 1 -- 172.21.15.37:0/153969646 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f0a90086160 con 0x7f0a9815f190 2024-05-30T06:58:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.202+0000 7f0a9cc00640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a78069f40 0x7f0a7806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.202+0000 7f0a9cc00640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a78069f40 0x7f0a7806c400 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0ad000 tx=0x7f0a8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.202+0000 7f0a94c00640 1 -- 172.21.15.37:0/153969646 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a90058180 con 0x7f0a9815f190 2024-05-30T06:58:48.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.394+0000 7f0a9f600640 1 -- 172.21.15.37:0/153969646 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone44122", "target": ["mon-mgr", ""]}) -- 0x7f0a98067d20 con 0x7f0a78069f40 2024-05-30T06:58:48.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.418+0000 7f0a94c00640 1 -- 172.21.15.37:0/153969646 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0a98067d20 con 0x7f0a78069f40 2024-05-30T06:58:48.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.418+0000 7f0a9f600640 1 -- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a78069f40 msgr2=0x7f0a7806c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.418+0000 7f0a9f600640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a78069f40 0x7f0a7806c400 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0ad000 tx=0x7f0a8c008040 comp rx=0 tx=0).stop 2024-05-30T06:58:48.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.418+0000 7f0a9f600640 1 -- 172.21.15.37:0/153969646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9815f190 msgr2=0x7f0a9815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.418+0000 7f0a9f600640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9815f190 0x7f0a9815c9b0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f0a90007e90 tx=0x7f0a9000e4b0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.418+0000 7f0a9f600640 1 -- 172.21.15.37:0/153969646 shutdown_connections 2024-05-30T06:58:48.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.418+0000 7f0a9f600640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9815f190 0x7f0a9815c9b0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.418+0000 7f0a9f600640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0a78069f40 0x7f0a7806c400 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.418+0000 7f0a9f600640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a98159490 0x7f0a981426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.418+0000 7f0a9f600640 1 --2- 172.21.15.37:0/153969646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a980702d0 0x7f0a9815e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.418+0000 7f0a9f600640 1 -- 172.21.15.37:0/153969646 >> 172.21.15.37:0/153969646 conn(0x7f0a980d0d50 msgr2=0x7f0a980b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:48.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.418+0000 7f0a9f600640 1 -- 172.21.15.37:0/153969646 shutdown_connections 2024-05-30T06:58:48.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.418+0000 7f0a9f600640 1 -- 172.21.15.37:0/153969646 wait complete. 2024-05-30T06:58:48.444 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone44121 2024-05-30T06:58:48.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde52800640 1 Processor -- start 2024-05-30T06:58:48.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde52800640 1 -- start start 2024-05-30T06:58:48.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde52800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde4c15fcd0 0x7fde4c0d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde52800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fde4c0d0560 0x7fde4c0d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde52800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde4c09b5a0 con 0x7fde4c0b2370 2024-05-30T06:58:48.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde52800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fde4c09b880 con 0x7fde4c15fcd0 2024-05-30T06:58:48.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde52800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fde4c09bb60 con 0x7fde4c0d0560 2024-05-30T06:58:48.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde51400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde4c15fcd0 0x7fde4c0d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde51400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde4c15fcd0 0x7fde4c0d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58490/0 (socket says 172.21.15.37:58490) 2024-05-30T06:58:48.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde51400640 1 -- 172.21.15.37:0/2118139631 learned_addr learned my addr 172.21.15.37:0/2118139631 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:48.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde50a00640 1 --2- 172.21.15.37:0/2118139631 >> v2:172.21.15.105:3300/0 conn(0x7fde4c0d0560 0x7fde4c0d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde51400640 1 -- 172.21.15.37:0/2118139631 >> v2:172.21.15.105:3300/0 conn(0x7fde4c0d0560 msgr2=0x7fde4c0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:48.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde51400640 1 --2- 172.21.15.37:0/2118139631 >> v2:172.21.15.105:3300/0 conn(0x7fde4c0d0560 0x7fde4c0d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde51400640 1 -- 172.21.15.37:0/2118139631 >> v1:172.21.15.37:6789/0 conn(0x7fde4c0b2370 legacy=0x7fde4c0b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde51400640 1 -- 172.21.15.37:0/2118139631 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4c0b1e50 con 0x7fde4c15fcd0 2024-05-30T06:58:48.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.590+0000 7fde4be00640 1 -- 172.21.15.37:0/2118139631 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1821934053 0 0) 0x7fde4c09b5a0 con 0x7fde4c0b2370 2024-05-30T06:58:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde51400640 1 --2- 172.21.15.37:0/2118139631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde4c15fcd0 0x7fde4c0d0020 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fde4c073150 tx=0x7fde4001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58797a51bcb6b30e server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde4be00640 1 -- 172.21.15.37:0/2118139631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde400b1070 con 0x7fde4c15fcd0 2024-05-30T06:58:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde4be00640 1 -- 172.21.15.37:0/2118139631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde400ac600 con 0x7fde4c15fcd0 2024-05-30T06:58:48.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde4be00640 1 -- 172.21.15.37:0/2118139631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde400ac9d0 con 0x7fde4c15fcd0 2024-05-30T06:58:48.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde52800640 1 -- 172.21.15.37:0/2118139631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde4c15fcd0 msgr2=0x7fde4c0d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde52800640 1 --2- 172.21.15.37:0/2118139631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde4c15fcd0 0x7fde4c0d0020 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fde4c073150 tx=0x7fde4001c490 comp rx=0 tx=0).stop 2024-05-30T06:58:48.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde52800640 1 -- 172.21.15.37:0/2118139631 shutdown_connections 2024-05-30T06:58:48.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde52800640 1 --2- 172.21.15.37:0/2118139631 >> v2:172.21.15.105:3300/0 conn(0x7fde4c0d0560 0x7fde4c0d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde52800640 1 --2- 172.21.15.37:0/2118139631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde4c15fcd0 0x7fde4c0d0020 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde52800640 1 -- 172.21.15.37:0/2118139631 >> 172.21.15.37:0/2118139631 conn(0x7fde4c0b3f40 msgr2=0x7fde4c0b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:48.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde52800640 1 -- 172.21.15.37:0/2118139631 shutdown_connections 2024-05-30T06:58:48.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde52800640 1 -- 172.21.15.37:0/2118139631 wait complete. 2024-05-30T06:58:48.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde52800640 1 Processor -- start 2024-05-30T06:58:48.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.594+0000 7fde52800640 1 -- start start 2024-05-30T06:58:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde52800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde4c0b2370 0x7fde4c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde52800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4c0d0560 0x7fde4c155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde52800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4c15fcd0 0x7fde4c1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde52800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1695a0 con 0x7fde4c0b2370 2024-05-30T06:58:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde52800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c169420 con 0x7fde4c15fcd0 2024-05-30T06:58:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde52800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fde4c169720 con 0x7fde4c0d0560 2024-05-30T06:58:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde51400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde4c0b2370 0x7fde4c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde51400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde4c0b2370 0x7fde4c15d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58498/0 (socket says 172.21.15.37:58498) 2024-05-30T06:58:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde51400640 1 -- 172.21.15.37:0/2295676825 learned_addr learned my addr 172.21.15.37:0/2295676825 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde51e00640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4c15fcd0 0x7fde4c1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde50a00640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4c0d0560 0x7fde4c155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde51400640 1 -- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4c0d0560 msgr2=0x7fde4c155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde51400640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4c0d0560 0x7fde4c155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde51400640 1 -- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4c15fcd0 msgr2=0x7fde4c1565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde51400640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4c15fcd0 0x7fde4c1565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde51400640 1 -- 172.21.15.37:0/2295676825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4c159790 con 0x7fde4c0b2370 2024-05-30T06:58:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde51e00640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4c15fcd0 0x7fde4c1565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde51400640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde4c0b2370 0x7fde4c15d140 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fde400af040 tx=0x7fde4001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde49600640 1 -- 172.21.15.37:0/2295676825 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde400b1040 con 0x7fde4c0b2370 2024-05-30T06:58:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde49600640 1 -- 172.21.15.37:0/2295676825 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde40004030 con 0x7fde4c0b2370 2024-05-30T06:58:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde49600640 1 -- 172.21.15.37:0/2295676825 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde400043e0 con 0x7fde4c0b2370 2024-05-30T06:58:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde52800640 1 -- 172.21.15.37:0/2295676825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4c15abe0 con 0x7fde4c0b2370 2024-05-30T06:58:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde52800640 1 -- 172.21.15.37:0/2295676825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde4c166090 con 0x7fde4c0b2370 2024-05-30T06:58:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde52800640 1 -- 172.21.15.37:0/2295676825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde4c068ab0 con 0x7fde4c0b2370 2024-05-30T06:58:48.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.598+0000 7fde49600640 1 -- 172.21.15.37:0/2295676825 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7fde40003620 con 0x7fde4c0b2370 2024-05-30T06:58:48.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.602+0000 7fde49600640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fde2c069f10 0x7fde2c06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.602+0000 7fde49600640 1 -- 172.21.15.37:0/2295676825 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7fde4011fed0 con 0x7fde4c0b2370 2024-05-30T06:58:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.602+0000 7fde50a00640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fde2c069f10 0x7fde2c06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.602+0000 7fde50a00640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fde2c069f10 0x7fde2c06c3d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0b12b0 tx=0x7fde38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.606+0000 7fde49600640 1 -- 172.21.15.37:0/2295676825 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fde40016110 con 0x7fde4c0b2370 2024-05-30T06:58:48.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.794+0000 7fde52800640 1 -- 172.21.15.37:0/2295676825 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone44121", "target": ["mon-mgr", ""]}) -- 0x7fde4c15d680 con 0x7fde2c069f10 2024-05-30T06:58:48.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.818+0000 7fde49600640 1 -- 172.21.15.37:0/2295676825 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fde4c15d680 con 0x7fde2c069f10 2024-05-30T06:58:48.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.818+0000 7fde52800640 1 -- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fde2c069f10 msgr2=0x7fde2c06c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.818+0000 7fde52800640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fde2c069f10 0x7fde2c06c3d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0b12b0 tx=0x7fde38008040 comp rx=0 tx=0).stop 2024-05-30T06:58:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.818+0000 7fde52800640 1 -- 172.21.15.37:0/2295676825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde4c0b2370 msgr2=0x7fde4c15d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.818+0000 7fde52800640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde4c0b2370 0x7fde4c15d140 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fde400af040 tx=0x7fde4001acd0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.818+0000 7fde52800640 1 -- 172.21.15.37:0/2295676825 shutdown_connections 2024-05-30T06:58:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.818+0000 7fde52800640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fde2c069f10 0x7fde2c06c3d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.818+0000 7fde52800640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4c15fcd0 0x7fde4c1565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.818+0000 7fde52800640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4c0d0560 0x7fde4c155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.818+0000 7fde52800640 1 --2- 172.21.15.37:0/2295676825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde4c0b2370 0x7fde4c15d140 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.818+0000 7fde52800640 1 -- 172.21.15.37:0/2295676825 >> 172.21.15.37:0/2295676825 conn(0x7fde4c0b3f40 msgr2=0x7fde4c074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.818+0000 7fde52800640 1 -- 172.21.15.37:0/2295676825 shutdown_connections 2024-05-30T06:58:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.818+0000 7fde52800640 1 -- 172.21.15.37:0/2295676825 wait complete. 2024-05-30T06:58:48.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone44123 2024-05-30T06:58:48.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f5971c00640 1 Processor -- start 2024-05-30T06:58:48.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f5971c00640 1 -- start start 2024-05-30T06:58:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f5971c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f596c1590c0 0x7f596c0cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f5971c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596c0cd400 0x7f596c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f5971c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596c15f230 con 0x7f596c0cde60 2024-05-30T06:58:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f5971c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f596c15f510 con 0x7f596c1590c0 2024-05-30T06:58:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f5971c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f596c15f7f0 con 0x7f596c0cd400 2024-05-30T06:58:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f596aa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f596c1590c0 0x7f596c0cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f596a000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f596c0cde60 0x7f596c06f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56094/0 (socket says 172.21.15.37:56094) 2024-05-30T06:58:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f596a000640 1 -- 172.21.15.37:0/1133093099 learned_addr learned my addr 172.21.15.37:0/1133093099 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:48.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f596aa00640 1 -- 172.21.15.37:0/1133093099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596c0cd400 msgr2=0x7f596c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:48.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f596aa00640 1 --2- 172.21.15.37:0/1133093099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596c0cd400 0x7f596c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f596aa00640 1 -- 172.21.15.37:0/1133093099 >> v1:172.21.15.37:6789/0 conn(0x7f596c0cde60 legacy=0x7f596c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.986+0000 7f596aa00640 1 -- 172.21.15.37:0/1133093099 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c15fad0 con 0x7f596c1590c0 2024-05-30T06:58:48.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.990+0000 7f596aa00640 1 --2- 172.21.15.37:0/1133093099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c1590c0 0x7f596c0cd920 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f595c0097c0 tx=0x7f595c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606d8391e9fd27b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:48.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.990+0000 7f5969600640 1 -- 172.21.15.37:0/1133093099 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c0b0070 con 0x7f596c1590c0 2024-05-30T06:58:48.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.990+0000 7f5969600640 1 -- 172.21.15.37:0/1133093099 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f595c0ab600 con 0x7f596c1590c0 2024-05-30T06:58:48.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.990+0000 7f5969600640 1 -- 172.21.15.37:0/1133093099 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c0ab9d0 con 0x7f596c1590c0 2024-05-30T06:58:48.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.990+0000 7f5971c00640 1 -- 172.21.15.37:0/1133093099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c1590c0 msgr2=0x7f596c0cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.990+0000 7f5971c00640 1 --2- 172.21.15.37:0/1133093099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c1590c0 0x7f596c0cd920 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f595c0097c0 tx=0x7f595c01c410 comp rx=0 tx=0).stop 2024-05-30T06:58:48.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.990+0000 7f5971c00640 1 -- 172.21.15.37:0/1133093099 shutdown_connections 2024-05-30T06:58:48.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.990+0000 7f5971c00640 1 --2- 172.21.15.37:0/1133093099 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596c0cd400 0x7f596c0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.990+0000 7f5971c00640 1 --2- 172.21.15.37:0/1133093099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c1590c0 0x7f596c0cd920 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.990+0000 7f5971c00640 1 -- 172.21.15.37:0/1133093099 >> 172.21.15.37:0/1133093099 conn(0x7f596c06bf60 msgr2=0x7f596c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:48.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.990+0000 7f5971c00640 1 -- 172.21.15.37:0/1133093099 shutdown_connections 2024-05-30T06:58:48.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.990+0000 7f5971c00640 1 -- 172.21.15.37:0/1133093099 wait complete. 2024-05-30T06:58:48.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.990+0000 7f5971c00640 1 Processor -- start 2024-05-30T06:58:48.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f5971c00640 1 -- start start 2024-05-30T06:58:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f5971c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596c0cd400 0x7f596c14de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f5971c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f596c0cde60 0x7f596c137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f5971c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c1590c0 0x7f596c148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f5971c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f596c06f8f0 con 0x7f596c1590c0 2024-05-30T06:58:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f5971c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f596c06f770 con 0x7f596c0cde60 2024-05-30T06:58:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f5971c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f596c1684a0 con 0x7f596c0cd400 2024-05-30T06:58:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f596b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c1590c0 0x7f596c148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f596b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c1590c0 0x7f596c148340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58524/0 (socket says 172.21.15.37:58524) 2024-05-30T06:58:48.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f596b400640 1 -- 172.21.15.37:0/1493510539 learned_addr learned my addr 172.21.15.37:0/1493510539 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:48.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f596aa00640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596c0cd400 0x7f596c14de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f596a000640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f596c0cde60 0x7f596c137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f596b400640 1 -- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596c0cd400 msgr2=0x7f596c14de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f596b400640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596c0cd400 0x7f596c14de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f596b400640 1 -- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f596c0cde60 msgr2=0x7f596c137ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:48.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f596b400640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f596c0cde60 0x7f596c137ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:48.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f596b400640 1 -- 172.21.15.37:0/1493510539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c14e3f0 con 0x7f596c1590c0 2024-05-30T06:58:48.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f596a000640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f596c0cde60 0x7f596c137ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:48.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f596b400640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c1590c0 0x7f596c148340 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f596400b9e0 tx=0x7f596400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:48.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f5962a00640 1 -- 172.21.15.37:0/1493510539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964019070 con 0x7f596c1590c0 2024-05-30T06:58:48.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f5962a00640 1 -- 172.21.15.37:0/1493510539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f596400cb40 con 0x7f596c1590c0 2024-05-30T06:58:48.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f5962a00640 1 -- 172.21.15.37:0/1493510539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964014440 con 0x7f596c1590c0 2024-05-30T06:58:48.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f5971c00640 1 -- 172.21.15.37:0/1493510539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c14e6d0 con 0x7f596c1590c0 2024-05-30T06:58:48.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f5971c00640 1 -- 172.21.15.37:0/1493510539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c14ec90 con 0x7f596c1590c0 2024-05-30T06:58:48.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.994+0000 7f5971c00640 1 -- 172.21.15.37:0/1493510539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f596c068d40 con 0x7f596c1590c0 2024-05-30T06:58:48.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.998+0000 7f5962a00640 1 -- 172.21.15.37:0/1493510539 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7f596401c070 con 0x7f596c1590c0 2024-05-30T06:58:48.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.998+0000 7f5962a00640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f594c069f10 0x7f594c06c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:48.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.998+0000 7f5962a00640 1 -- 172.21.15.37:0/1493510539 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f5964085570 con 0x7f596c1590c0 2024-05-30T06:58:48.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.998+0000 7f596aa00640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f594c069f10 0x7f594c06c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:48.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:48.998+0000 7f596aa00640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f594c069f10 0x7f594c06c3d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f595c0ad000 tx=0x7f595c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:49.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.002+0000 7f5962a00640 1 -- 172.21.15.37:0/1493510539 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5964056f40 con 0x7f596c1590c0 2024-05-30T06:58:49.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.194+0000 7f5971c00640 1 -- 172.21.15.37:0/1493510539 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone44123", "target": ["mon-mgr", ""]}) -- 0x7f596c0b31b0 con 0x7f594c069f10 2024-05-30T06:58:49.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.214+0000 7f5962a00640 1 -- 172.21.15.37:0/1493510539 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f596c0b31b0 con 0x7f594c069f10 2024-05-30T06:58:49.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.214+0000 7f5971c00640 1 -- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f594c069f10 msgr2=0x7f594c06c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:49.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.214+0000 7f5971c00640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f594c069f10 0x7f594c06c3d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f595c0ad000 tx=0x7f595c0a6000 comp rx=0 tx=0).stop 2024-05-30T06:58:49.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.214+0000 7f5971c00640 1 -- 172.21.15.37:0/1493510539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c1590c0 msgr2=0x7f596c148340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:49.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.214+0000 7f5971c00640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c1590c0 0x7f596c148340 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f596400b9e0 tx=0x7f596400bea0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.218+0000 7f5971c00640 1 -- 172.21.15.37:0/1493510539 shutdown_connections 2024-05-30T06:58:49.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.218+0000 7f5971c00640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c1590c0 0x7f596c148340 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.218+0000 7f5971c00640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f594c069f10 0x7f594c06c3d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.218+0000 7f5971c00640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f596c0cde60 0x7f596c137ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.218+0000 7f5971c00640 1 --2- 172.21.15.37:0/1493510539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f596c0cd400 0x7f596c14de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.218+0000 7f5971c00640 1 -- 172.21.15.37:0/1493510539 >> 172.21.15.37:0/1493510539 conn(0x7f596c06bf60 msgr2=0x7f596c14ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:49.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.218+0000 7f5971c00640 1 -- 172.21.15.37:0/1493510539 shutdown_connections 2024-05-30T06:58:49.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.218+0000 7f5971c00640 1 -- 172.21.15.37:0/1493510539 wait complete. 2024-05-30T06:58:49.238 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-05-30T06:58:49.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:58:49.292 INFO:teuthology.orchestra.run.smithi037.stdout:2 2024-05-30T06:58:49.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:58:49.299 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:58:49.300 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:58:49.371 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:58:49.483 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:58:49.484 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:58:49.484 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:58:49.484 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:58:49.493 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:58:49.493 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:58:49.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:58:49.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.726+0000 7f2e0d400640 1 Processor -- start 2024-05-30T06:58:49.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.726+0000 7f2e0d400640 1 -- start start 2024-05-30T06:58:49.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.730+0000 7f2e0d400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2e08155e60 0x7f2e080b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:49.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.730+0000 7f2e0d400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e0806f9a0 0x7f2e080cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.730+0000 7f2e0d400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e0815c8f0 con 0x7f2e080b2ec0 2024-05-30T06:58:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.730+0000 7f2e0d400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2e080ccff0 con 0x7f2e0806f9a0 2024-05-30T06:58:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.730+0000 7f2e0d400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2e080ccc80 con 0x7f2e08155e60 2024-05-30T06:58:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.730+0000 7f2dfde00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e0806f9a0 0x7f2e080cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.730+0000 7f2dfde00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e0806f9a0 0x7f2e080cf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58526/0 (socket says 172.21.15.37:58526) 2024-05-30T06:58:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.730+0000 7f2dfde00640 1 -- 172.21.15.37:0/3461355370 learned_addr learned my addr 172.21.15.37:0/3461355370 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.730+0000 7f2e06800640 1 --2- 172.21.15.37:0/3461355370 >> v2:172.21.15.105:3300/0 conn(0x7f2e08155e60 0x7f2e080b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.730+0000 7f2dfde00640 1 -- 172.21.15.37:0/3461355370 >> v2:172.21.15.105:3300/0 conn(0x7f2e08155e60 msgr2=0x7f2e080b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.730+0000 7f2dfde00640 1 --2- 172.21.15.37:0/3461355370 >> v2:172.21.15.105:3300/0 conn(0x7f2e08155e60 0x7f2e080b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.730+0000 7f2dfde00640 1 -- 172.21.15.37:0/3461355370 >> v1:172.21.15.105:6789/0 conn(0x7f2e080b2ec0 legacy=0x7f2e080cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.730+0000 7f2dfde00640 1 -- 172.21.15.37:0/3461355370 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0815cbd0 con 0x7f2e0806f9a0 2024-05-30T06:58:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2dfde00640 1 --2- 172.21.15.37:0/3461355370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0806f9a0 0x7f2e080cf660 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f2e08073930 tx=0x7f2df001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1658e560f313499d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:49.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2e05e00640 1 -- 172.21.15.37:0/3461355370 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df00b1070 con 0x7f2e0806f9a0 2024-05-30T06:58:49.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2e05e00640 1 -- 172.21.15.37:0/3461355370 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df00ac410 con 0x7f2e0806f9a0 2024-05-30T06:58:49.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2e05e00640 1 -- 172.21.15.37:0/3461355370 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df00ac7e0 con 0x7f2e0806f9a0 2024-05-30T06:58:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2e0d400640 1 -- 172.21.15.37:0/3461355370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0806f9a0 msgr2=0x7f2e080cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2e0d400640 1 --2- 172.21.15.37:0/3461355370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0806f9a0 0x7f2e080cf660 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f2e08073930 tx=0x7f2df001c4e0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2e0d400640 1 -- 172.21.15.37:0/3461355370 shutdown_connections 2024-05-30T06:58:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2e0d400640 1 --2- 172.21.15.37:0/3461355370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0806f9a0 0x7f2e080cf660 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2e0d400640 1 --2- 172.21.15.37:0/3461355370 >> v2:172.21.15.105:3300/0 conn(0x7f2e08155e60 0x7f2e080b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2e0d400640 1 -- 172.21.15.37:0/3461355370 >> 172.21.15.37:0/3461355370 conn(0x7f2e080b23a0 msgr2=0x7f2e080b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2e0d400640 1 -- 172.21.15.37:0/3461355370 shutdown_connections 2024-05-30T06:58:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2e0d400640 1 -- 172.21.15.37:0/3461355370 wait complete. 2024-05-30T06:58:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2e0d400640 1 Processor -- start 2024-05-30T06:58:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.734+0000 7f2e0d400640 1 -- start start 2024-05-30T06:58:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e0d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0806f9a0 0x7f2e0814df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e0d400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e080b2ec0 0x7f2e08150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e0d400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e08155e60 0x7f2e0815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e0d400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2e08166a20 con 0x7f2e0806f9a0 2024-05-30T06:58:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e0d400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2e081668a0 con 0x7f2e08155e60 2024-05-30T06:58:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e0d400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2e08166ba0 con 0x7f2e080b2ec0 2024-05-30T06:58:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e06800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0806f9a0 0x7f2e0814df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e06800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0806f9a0 0x7f2e0814df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58528/0 (socket says 172.21.15.37:58528) 2024-05-30T06:58:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e06800640 1 -- 172.21.15.37:0/52195082 learned_addr learned my addr 172.21.15.37:0/52195082 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e07200640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e08155e60 0x7f2e0815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2dfde00640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e080b2ec0 0x7f2e08150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e06800640 1 -- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e080b2ec0 msgr2=0x7f2e08150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e06800640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e080b2ec0 0x7f2e08150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e06800640 1 -- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e08155e60 msgr2=0x7f2e0815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e06800640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e08155e60 0x7f2e0815ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e06800640 1 -- 172.21.15.37:0/52195082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0814e6a0 con 0x7f2e0806f9a0 2024-05-30T06:58:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e06800640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0806f9a0 0x7f2e0814df30 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f2df8007e40 tx=0x7f2df800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2dff400640 1 -- 172.21.15.37:0/52195082 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8014620 con 0x7f2e0806f9a0 2024-05-30T06:58:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2dff400640 1 -- 172.21.15.37:0/52195082 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df8019070 con 0x7f2e0806f9a0 2024-05-30T06:58:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2dff400640 1 -- 172.21.15.37:0/52195082 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8014a00 con 0x7f2e0806f9a0 2024-05-30T06:58:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e0d400640 1 -- 172.21.15.37:0/52195082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0814e980 con 0x7f2e0806f9a0 2024-05-30T06:58:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e0d400640 1 -- 172.21.15.37:0/52195082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e08167100 con 0x7f2e0806f9a0 2024-05-30T06:58:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2e0d400640 1 -- 172.21.15.37:0/52195082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e08068b20 con 0x7f2e0806f9a0 2024-05-30T06:58:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.738+0000 7f2dff400640 1 -- 172.21.15.37:0/52195082 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) ==== 90486+0+0 (secure 0 0 0) 0x7f2df8014ba0 con 0x7f2e0806f9a0 2024-05-30T06:58:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.742+0000 7f2dff400640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2de4069f40 0x7f2de406c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.742+0000 7f2dff400640 1 -- 172.21.15.37:0/52195082 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5823+0+0 (secure 0 0 0) 0x7f2df8086160 con 0x7f2e0806f9a0 2024-05-30T06:58:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.742+0000 7f2dfde00640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2de4069f40 0x7f2de406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.742+0000 7f2dfde00640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2de4069f40 0x7f2de406c400 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f2df00ae000 tx=0x7f2df0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:49.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.746+0000 7f2dff400640 1 -- 172.21.15.37:0/52195082 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2df8058180 con 0x7f2e0806f9a0 2024-05-30T06:58:49.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.834+0000 7f2dff400640 1 -- 172.21.15.37:0/52195082 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f2df80bde70 con 0x7f2e0806f9a0 2024-05-30T06:58:49.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.918+0000 7f2e0d400640 1 -- 172.21.15.37:0/52195082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e08072fb0 con 0x7f2e0806f9a0 2024-05-30T06:58:49.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.918+0000 7f2dff400640 1 -- 172.21.15.37:0/52195082 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16968 (secure 0 0 0) 0x7f2df805e590 con 0x7f2e0806f9a0 2024-05-30T06:58:49.919 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:49.919 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":117,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:58:49.820117+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:57:16.849268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-05-30T06:57:17.405807+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.5","mappings":[{"from":0,"to":2}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:58:49.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.922+0000 7f2e0d400640 1 -- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2de4069f40 msgr2=0x7f2de406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.922+0000 7f2e0d400640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2de4069f40 0x7f2de406c400 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f2df00ae000 tx=0x7f2df0008040 comp rx=0 tx=0).stop 2024-05-30T06:58:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.922+0000 7f2e0d400640 1 -- 172.21.15.37:0/52195082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0806f9a0 msgr2=0x7f2e0814df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.922+0000 7f2e0d400640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0806f9a0 0x7f2e0814df30 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f2df8007e40 tx=0x7f2df800e4b0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.922+0000 7f2e0d400640 1 -- 172.21.15.37:0/52195082 shutdown_connections 2024-05-30T06:58:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.922+0000 7f2e0d400640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2de4069f40 0x7f2de406c400 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.922+0000 7f2e0d400640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e08155e60 0x7f2e0815ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.922+0000 7f2e0d400640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e080b2ec0 0x7f2e08150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.922+0000 7f2e0d400640 1 --2- 172.21.15.37:0/52195082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e0806f9a0 0x7f2e0814df30 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.922+0000 7f2e0d400640 1 -- 172.21.15.37:0/52195082 >> 172.21.15.37:0/52195082 conn(0x7f2e080b23a0 msgr2=0x7f2e080b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.922+0000 7f2e0d400640 1 -- 172.21.15.37:0/52195082 shutdown_connections 2024-05-30T06:58:49.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:49.922+0000 7f2e0d400640 1 -- 172.21.15.37:0/52195082 wait complete. 2024-05-30T06:58:49.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:57:16.849268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:57:17.405807+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 117, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:58:49.942 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:58:50.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f9802800640 1 Processor -- start 2024-05-30T06:58:50.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f9802800640 1 -- start start 2024-05-30T06:58:50.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f9802800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97fc09b800 0x7f97fc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f9802800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f97fc06dcf0 0x7f97fc09aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f9802800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97fc0d0840 con 0x7f97fc15ebc0 2024-05-30T06:58:50.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f9802800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f97fc09bce0 con 0x7f97fc09b800 2024-05-30T06:58:50.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f9802800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f97fc0d0ae0 con 0x7f97fc06dcf0 2024-05-30T06:58:50.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f97f2a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97fc09b800 0x7f97fc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:50.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f97f2a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f97fc09b800 0x7f97fc06d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58540/0 (socket says 172.21.15.37:58540) 2024-05-30T06:58:50.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f97f2a00640 1 -- 172.21.15.37:0/1566964372 learned_addr learned my addr 172.21.15.37:0/1566964372 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:50.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f97fbe00640 1 --2- 172.21.15.37:0/1566964372 >> v2:172.21.15.105:3300/0 conn(0x7f97fc06dcf0 0x7f97fc09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:50.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f97f2a00640 1 -- 172.21.15.37:0/1566964372 >> v2:172.21.15.105:3300/0 conn(0x7f97fc06dcf0 msgr2=0x7f97fc09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:50.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f97f2a00640 1 --2- 172.21.15.37:0/1566964372 >> v2:172.21.15.105:3300/0 conn(0x7f97fc06dcf0 0x7f97fc09aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f97f2a00640 1 -- 172.21.15.37:0/1566964372 >> v1:172.21.15.105:6789/0 conn(0x7f97fc15ebc0 legacy=0x7f97fc0d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:50.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f97f2a00640 1 -- 172.21.15.37:0/1566964372 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc0d0dc0 con 0x7f97fc09b800 2024-05-30T06:58:50.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.098+0000 7f97fbe00640 1 --2- 172.21.15.37:0/1566964372 >> v2:172.21.15.105:3300/0 conn(0x7f97fc06dcf0 0x7f97fc09aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:50.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.102+0000 7f97f2a00640 1 --2- 172.21.15.37:0/1566964372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc09b800 0x7f97fc06d7b0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0cefa0 tx=0x7f97e401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83431e1d49d1dd91 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:50.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.102+0000 7f97faa00640 1 -- 172.21.15.37:0/1566964372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e40b0070 con 0x7f97fc09b800 2024-05-30T06:58:50.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.102+0000 7f97faa00640 1 -- 172.21.15.37:0/1566964372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e40ab600 con 0x7f97fc09b800 2024-05-30T06:58:50.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.102+0000 7f97faa00640 1 -- 172.21.15.37:0/1566964372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e40ab9d0 con 0x7f97fc09b800 2024-05-30T06:58:50.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.102+0000 7f9802800640 1 -- 172.21.15.37:0/1566964372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc09b800 msgr2=0x7f97fc06d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:50.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.102+0000 7f9802800640 1 --2- 172.21.15.37:0/1566964372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc09b800 0x7f97fc06d7b0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0cefa0 tx=0x7f97e401c520 comp rx=0 tx=0).stop 2024-05-30T06:58:50.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.102+0000 7f9802800640 1 -- 172.21.15.37:0/1566964372 shutdown_connections 2024-05-30T06:58:50.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.102+0000 7f9802800640 1 --2- 172.21.15.37:0/1566964372 >> v2:172.21.15.105:3300/0 conn(0x7f97fc06dcf0 0x7f97fc09aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.102+0000 7f9802800640 1 --2- 172.21.15.37:0/1566964372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc09b800 0x7f97fc06d7b0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.102+0000 7f9802800640 1 -- 172.21.15.37:0/1566964372 >> 172.21.15.37:0/1566964372 conn(0x7f97fc0b4060 msgr2=0x7f97fc0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:50.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.102+0000 7f9802800640 1 -- 172.21.15.37:0/1566964372 shutdown_connections 2024-05-30T06:58:50.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.102+0000 7f9802800640 1 -- 172.21.15.37:0/1566964372 wait complete. 2024-05-30T06:58:50.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f9802800640 1 Processor -- start 2024-05-30T06:58:50.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f9802800640 1 -- start start 2024-05-30T06:58:50.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f9802800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97fc06dcf0 0x7f97fc150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f9802800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc09b800 0x7f97fc153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f9802800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97fc15ebc0 0x7f97fc0b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f9802800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc09b3b0 con 0x7f97fc09b800 2024-05-30T06:58:50.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f9802800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc0cd5e0 con 0x7f97fc06dcf0 2024-05-30T06:58:50.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f9802800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc16ba70 con 0x7f97fc15ebc0 2024-05-30T06:58:50.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97f2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc09b800 0x7f97fc153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:50.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97f2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc09b800 0x7f97fc153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58554/0 (socket says 172.21.15.37:58554) 2024-05-30T06:58:50.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97f2a00640 1 -- 172.21.15.37:0/1325308111 learned_addr learned my addr 172.21.15.37:0/1325308111 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:50.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97fb400640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97fc06dcf0 0x7f97fc150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:50.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97fbe00640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97fc15ebc0 0x7f97fc0b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:50.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97f2a00640 1 -- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97fc15ebc0 msgr2=0x7f97fc0b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:50.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97f2a00640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97fc15ebc0 0x7f97fc0b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97f2a00640 1 -- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97fc06dcf0 msgr2=0x7f97fc150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:50.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97f2a00640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97fc06dcf0 0x7f97fc150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97f2a00640 1 -- 172.21.15.37:0/1325308111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc151c30 con 0x7f97fc09b800 2024-05-30T06:58:50.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97fbe00640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97fc15ebc0 0x7f97fc0b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:50.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97f2a00640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc09b800 0x7f97fc153df0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f97e401ca00 tx=0x7f97e40192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97f3e00640 1 -- 172.21.15.37:0/1325308111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e40bb070 con 0x7f97fc09b800 2024-05-30T06:58:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97f3e00640 1 -- 172.21.15.37:0/1325308111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e40b4630 con 0x7f97fc09b800 2024-05-30T06:58:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f97f3e00640 1 -- 172.21.15.37:0/1325308111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e40b0040 con 0x7f97fc09b800 2024-05-30T06:58:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f9802800640 1 -- 172.21.15.37:0/1325308111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc15c320 con 0x7f97fc09b800 2024-05-30T06:58:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f9802800640 1 -- 172.21.15.37:0/1325308111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc151670 con 0x7f97fc09b800 2024-05-30T06:58:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.106+0000 7f9802800640 1 -- 172.21.15.37:0/1325308111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc068bc0 con 0x7f97fc09b800 2024-05-30T06:58:50.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.110+0000 7f97f3e00640 1 -- 172.21.15.37:0/1325308111 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f97e40ab4c0 con 0x7f97fc09b800 2024-05-30T06:58:50.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.110+0000 7f97f3e00640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97d806a030 0x7f97d806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.110+0000 7f97f3e00640 1 -- 172.21.15.37:0/1325308111 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7f97e411ea00 con 0x7f97fc09b800 2024-05-30T06:58:50.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.110+0000 7f97fb400640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97d806a030 0x7f97d806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:50.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.110+0000 7f97fb400640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97d806a030 0x7f97d806c4f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f97ec001810 tx=0x7f97ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:50.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.114+0000 7f97f3e00640 1 -- 172.21.15.37:0/1325308111 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f97e4016110 con 0x7f97fc09b800 2024-05-30T06:58:50.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.414+0000 7f9802800640 1 -- 172.21.15.37:0/1325308111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f97fc0b20c0 con 0x7f97fc09b800 2024-05-30T06:58:50.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.418+0000 7f97f3e00640 1 -- 172.21.15.37:0/1325308111 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) ==== 93+0+10 (secure 0 0 0) 0x7f97e40f03d0 con 0x7f97fc09b800 2024-05-30T06:58:50.418 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:58:50.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.422+0000 7f9802800640 1 -- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97d806a030 msgr2=0x7f97d806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:50.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.422+0000 7f9802800640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97d806a030 0x7f97d806c4f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f97ec001810 tx=0x7f97ec009040 comp rx=0 tx=0).stop 2024-05-30T06:58:50.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.422+0000 7f9802800640 1 -- 172.21.15.37:0/1325308111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc09b800 msgr2=0x7f97fc153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:50.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.422+0000 7f9802800640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc09b800 0x7f97fc153df0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f97e401ca00 tx=0x7f97e40192c0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.422+0000 7f9802800640 1 -- 172.21.15.37:0/1325308111 shutdown_connections 2024-05-30T06:58:50.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.422+0000 7f9802800640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97fc15ebc0 0x7f97fc0b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.422+0000 7f9802800640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97fc09b800 0x7f97fc153df0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.422+0000 7f9802800640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f97d806a030 0x7f97d806c4f0 secure :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f97ec001810 tx=0x7f97ec009040 comp rx=0 tx=0).stop 2024-05-30T06:58:50.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.422+0000 7f9802800640 1 --2- 172.21.15.37:0/1325308111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97fc06dcf0 0x7f97fc150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.422+0000 7f9802800640 1 -- 172.21.15.37:0/1325308111 >> 172.21.15.37:0/1325308111 conn(0x7f97fc0b4060 msgr2=0x7f97fc074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:50.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.422+0000 7f9802800640 1 -- 172.21.15.37:0/1325308111 shutdown_connections 2024-05-30T06:58:50.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.422+0000 7f9802800640 1 -- 172.21.15.37:0/1325308111 wait complete. 2024-05-30T06:58:50.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:58:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.646+0000 7f75e1200640 1 Processor -- start 2024-05-30T06:58:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.646+0000 7f75e1200640 1 -- start start 2024-05-30T06:58:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75e1200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75dc15ebc0 0x7f75dc0d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75e1200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f75dc09aa60 0x7f75dc09aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75e1200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75dc0d0840 con 0x7f75dc09b800 2024-05-30T06:58:50.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75e1200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f75dc09b410 con 0x7f75dc09aa60 2024-05-30T06:58:50.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75e1200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f75dc06dec0 con 0x7f75dc15ebc0 2024-05-30T06:58:50.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75da800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f75dc09aa60 0x7f75dc09aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:50.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75d9e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75dc15ebc0 0x7f75dc0d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:50.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75d1400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f75dc09b800 0x7f75dc06d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:58362/0 (socket says 172.21.15.37:58362) 2024-05-30T06:58:50.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75d1400640 1 -- 172.21.15.37:0/991309412 learned_addr learned my addr 172.21.15.37:0/991309412 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:50.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75d9e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75dc15ebc0 0x7f75dc0d15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:47204/0 (socket says 172.21.15.37:47204) 2024-05-30T06:58:50.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75da800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f75dc09aa60 0x7f75dc09aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:33028/0 (socket says 172.21.15.37:33028) 2024-05-30T06:58:50.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75da800640 1 -- 172.21.15.37:0/991309412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75dc15ebc0 msgr2=0x7f75dc0d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:50.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75da800640 1 --2- 172.21.15.37:0/991309412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75dc15ebc0 0x7f75dc0d15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75da800640 1 -- 172.21.15.37:0/991309412 >> v1:172.21.15.105:6789/0 conn(0x7f75dc09b800 legacy=0x7f75dc06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:50.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75da800640 1 -- 172.21.15.37:0/991309412 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75dc09bce0 con 0x7f75dc09aa60 2024-05-30T06:58:50.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75d9e00640 1 --2- 172.21.15.37:0/991309412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75dc15ebc0 0x7f75dc0d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:58:50.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.650+0000 7f75d9400640 1 -- 172.21.15.37:0/991309412 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 355216790 0 0) 0x7f75dc0d0840 con 0x7f75dc09b800 2024-05-30T06:58:50.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75da800640 1 --2- 172.21.15.37:0/991309412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75dc09aa60 0x7f75dc09aed0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f75d40097c0 tx=0x7f75d401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7b5c368dd8ca51b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:50.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75d9400640 1 -- 172.21.15.37:0/991309412 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d40b2070 con 0x7f75dc09aa60 2024-05-30T06:58:50.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75d9400640 1 -- 172.21.15.37:0/991309412 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d40ad640 con 0x7f75dc09aa60 2024-05-30T06:58:50.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75d9400640 1 -- 172.21.15.37:0/991309412 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d40ada10 con 0x7f75dc09aa60 2024-05-30T06:58:50.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75e1200640 1 -- 172.21.15.37:0/991309412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75dc09aa60 msgr2=0x7f75dc09aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:50.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75e1200640 1 --2- 172.21.15.37:0/991309412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75dc09aa60 0x7f75dc09aed0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f75d40097c0 tx=0x7f75d401c4a0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75e1200640 1 -- 172.21.15.37:0/991309412 shutdown_connections 2024-05-30T06:58:50.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75e1200640 1 --2- 172.21.15.37:0/991309412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75dc09aa60 0x7f75dc09aed0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75e1200640 1 --2- 172.21.15.37:0/991309412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75dc15ebc0 0x7f75dc0d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75e1200640 1 -- 172.21.15.37:0/991309412 >> 172.21.15.37:0/991309412 conn(0x7f75dc0b4060 msgr2=0x7f75dc0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:50.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75e1200640 1 -- 172.21.15.37:0/991309412 shutdown_connections 2024-05-30T06:58:50.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75e1200640 1 -- 172.21.15.37:0/991309412 wait complete. 2024-05-30T06:58:50.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75e1200640 1 Processor -- start 2024-05-30T06:58:50.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.654+0000 7f75e1200640 1 -- start start 2024-05-30T06:58:50.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75e1200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75dc09aa60 0x7f75dc15de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75e1200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75dc09b800 0x7f75dc0c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75e1200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75dc15ebc0 0x7f75dc1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75e1200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc0d1b00 con 0x7f75dc09aa60 2024-05-30T06:58:50.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75e1200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc15efa0 con 0x7f75dc15ebc0 2024-05-30T06:58:50.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75e1200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f75dc0c7070 con 0x7f75dc09b800 2024-05-30T06:58:50.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75dc09aa60 0x7f75dc15de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:50.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75dc09aa60 0x7f75dc15de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58568/0 (socket says 172.21.15.37:58568) 2024-05-30T06:58:50.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d9e00640 1 -- 172.21.15.37:0/296392029 learned_addr learned my addr 172.21.15.37:0/296392029 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:50.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d1400640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75dc09b800 0x7f75dc0c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:50.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75da800640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75dc15ebc0 0x7f75dc1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:50.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d9e00640 1 -- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75dc09b800 msgr2=0x7f75dc0c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:50.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d9e00640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75dc09b800 0x7f75dc0c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d9e00640 1 -- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75dc15ebc0 msgr2=0x7f75dc1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:50.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d9e00640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75dc15ebc0 0x7f75dc1596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d9e00640 1 -- 172.21.15.37:0/296392029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75dc0c6d90 con 0x7f75dc09aa60 2024-05-30T06:58:50.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d9e00640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75dc09aa60 0x7f75dc15de40 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00efc0 tx=0x7f75cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:50.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d2a00640 1 -- 172.21.15.37:0/296392029 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc018020 con 0x7f75dc09aa60 2024-05-30T06:58:50.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d2a00640 1 -- 172.21.15.37:0/296392029 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75cc014680 con 0x7f75dc09aa60 2024-05-30T06:58:50.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d2a00640 1 -- 172.21.15.37:0/296392029 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc014a50 con 0x7f75dc09aa60 2024-05-30T06:58:50.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75e1200640 1 -- 172.21.15.37:0/296392029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75dc15d360 con 0x7f75dc09aa60 2024-05-30T06:58:50.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75e1200640 1 -- 172.21.15.37:0/296392029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75dc15e380 con 0x7f75dc09aa60 2024-05-30T06:58:50.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75e1200640 1 -- 172.21.15.37:0/296392029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75dc068bc0 con 0x7f75dc09aa60 2024-05-30T06:58:50.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.658+0000 7f75d2a00640 1 -- 172.21.15.37:0/296392029 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f75cc01b020 con 0x7f75dc09aa60 2024-05-30T06:58:50.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.662+0000 7f75d2a00640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f75b806a030 0x7f75b806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.662+0000 7f75d2a00640 1 -- 172.21.15.37:0/296392029 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7f75cc0866b0 con 0x7f75dc09aa60 2024-05-30T06:58:50.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.662+0000 7f75d1400640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f75b806a030 0x7f75b806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:50.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.662+0000 7f75d1400640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f75b806a030 0x7f75b806c4f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f75dc14d8f0 tx=0x7f75c4007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:50.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.666+0000 7f75d2a00640 1 -- 172.21.15.37:0/296392029 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f75cc022030 con 0x7f75dc09aa60 2024-05-30T06:58:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.830+0000 7f75e1200640 1 -- 172.21.15.37:0/296392029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f75dc0706c0 con 0x7f75dc09aa60 2024-05-30T06:58:50.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.830+0000 7f75d2a00640 1 -- 172.21.15.37:0/296392029 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) ==== 104+0+11 (secure 0 0 0) 0x7f75cc010040 con 0x7f75dc09aa60 2024-05-30T06:58:50.833 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:58:50.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.834+0000 7f75e1200640 1 -- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f75b806a030 msgr2=0x7f75b806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:50.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.834+0000 7f75e1200640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f75b806a030 0x7f75b806c4f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f75dc14d8f0 tx=0x7f75c4007d60 comp rx=0 tx=0).stop 2024-05-30T06:58:50.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.834+0000 7f75e1200640 1 -- 172.21.15.37:0/296392029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75dc09aa60 msgr2=0x7f75dc15de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:50.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.834+0000 7f75e1200640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75dc09aa60 0x7f75dc15de40 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f75cc00efc0 tx=0x7f75cc00c490 comp rx=0 tx=0).stop 2024-05-30T06:58:50.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.834+0000 7f75e1200640 1 -- 172.21.15.37:0/296392029 shutdown_connections 2024-05-30T06:58:50.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.834+0000 7f75e1200640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f75b806a030 0x7f75b806c4f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.834+0000 7f75e1200640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75dc15ebc0 0x7f75dc1596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.834+0000 7f75e1200640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75dc09b800 0x7f75dc0c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.834+0000 7f75e1200640 1 --2- 172.21.15.37:0/296392029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75dc09aa60 0x7f75dc15de40 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:50.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.834+0000 7f75e1200640 1 -- 172.21.15.37:0/296392029 >> 172.21.15.37:0/296392029 conn(0x7f75dc0b4060 msgr2=0x7f75dc0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:50.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.834+0000 7f75e1200640 1 -- 172.21.15.37:0/296392029 shutdown_connections 2024-05-30T06:58:50.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.834+0000 7f75e1200640 1 -- 172.21.15.37:0/296392029 wait complete. 2024-05-30T06:58:50.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:58:50.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1c000640 1 Processor -- start 2024-05-30T06:58:50.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1c000640 1 -- start start 2024-05-30T06:58:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1c000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f140b63d0 0x7f7f1415f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1c000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f1406e510 0x7f7f1406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1c000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f140cf780 con 0x7f7f1415e890 2024-05-30T06:58:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1c000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7f1406e080 con 0x7f7f1406e510 2024-05-30T06:58:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1c000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7f140cfa40 con 0x7f7f140b63d0 2024-05-30T06:58:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1a000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f1406e510 0x7f7f1406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1a000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f1406e510 0x7f7f1406e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58576/0 (socket says 172.21.15.37:58576) 2024-05-30T06:58:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1a000640 1 -- 172.21.15.37:0/4153025254 learned_addr learned my addr 172.21.15.37:0/4153025254 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f18c00640 1 --2- 172.21.15.37:0/4153025254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f140b63d0 0x7f7f1415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1a000640 1 -- 172.21.15.37:0/4153025254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f140b63d0 msgr2=0x7f7f1415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1a000640 1 --2- 172.21.15.37:0/4153025254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f140b63d0 0x7f7f1415f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1a000640 1 -- 172.21.15.37:0/4153025254 >> v1:172.21.15.105:6789/0 conn(0x7f7f1415e890 legacy=0x7f7f1415ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f1a000640 1 -- 172.21.15.37:0/4153025254 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f140cfd20 con 0x7f7f1406e510 2024-05-30T06:58:51.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:50.998+0000 7f7f13e00640 1 -- 172.21.15.37:0/4153025254 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2912868753 0 0) 0x7f7f140cf780 con 0x7f7f1415e890 2024-05-30T06:58:51.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.002+0000 7f7f1a000640 1 --2- 172.21.15.37:0/4153025254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1406e510 0x7f7f1406e9a0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009e50 tx=0x7f7f0c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b440ed07d4126266 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.002+0000 7f7f13e00640 1 -- 172.21.15.37:0/4153025254 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0a57e0 con 0x7f7f1406e510 2024-05-30T06:58:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.002+0000 7f7f13e00640 1 -- 172.21.15.37:0/4153025254 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f0c0a5980 con 0x7f7f1406e510 2024-05-30T06:58:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.002+0000 7f7f13e00640 1 -- 172.21.15.37:0/4153025254 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0a5d50 con 0x7f7f1406e510 2024-05-30T06:58:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.002+0000 7f7f1c000640 1 -- 172.21.15.37:0/4153025254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1406e510 msgr2=0x7f7f1406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.002+0000 7f7f1c000640 1 --2- 172.21.15.37:0/4153025254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1406e510 0x7f7f1406e9a0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009e50 tx=0x7f7f0c01ca00 comp rx=0 tx=0).stop 2024-05-30T06:58:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.002+0000 7f7f1c000640 1 -- 172.21.15.37:0/4153025254 shutdown_connections 2024-05-30T06:58:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.002+0000 7f7f1c000640 1 --2- 172.21.15.37:0/4153025254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1406e510 0x7f7f1406e9a0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.002+0000 7f7f1c000640 1 --2- 172.21.15.37:0/4153025254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f140b63d0 0x7f7f1415f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.002+0000 7f7f1c000640 1 -- 172.21.15.37:0/4153025254 >> 172.21.15.37:0/4153025254 conn(0x7f7f1406bf60 msgr2=0x7f7f140b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:51.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.002+0000 7f7f1c000640 1 -- 172.21.15.37:0/4153025254 shutdown_connections 2024-05-30T06:58:51.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.002+0000 7f7f1c000640 1 -- 172.21.15.37:0/4153025254 wait complete. 2024-05-30T06:58:51.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.002+0000 7f7f1c000640 1 Processor -- start 2024-05-30T06:58:51.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1c000640 1 -- start start 2024-05-30T06:58:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1c000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f1406e510 0x7f7f1413ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1c000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f140b63d0 0x7f7f14154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1c000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1415e890 0x7f7f140b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1c000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1406f060 con 0x7f7f1415e890 2024-05-30T06:58:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1c000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1406eee0 con 0x7f7f1406e510 2024-05-30T06:58:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1c000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7f1406f1e0 con 0x7f7f140b63d0 2024-05-30T06:58:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1415e890 0x7f7f140b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1415e890 0x7f7f140b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58584/0 (socket says 172.21.15.37:58584) 2024-05-30T06:58:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1a000640 1 -- 172.21.15.37:0/3385994344 learned_addr learned my addr 172.21.15.37:0/3385994344 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f18c00640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f140b63d0 0x7f7f14154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f19600640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f1406e510 0x7f7f1413ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1a000640 1 -- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f140b63d0 msgr2=0x7f7f14154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1a000640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f140b63d0 0x7f7f14154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1a000640 1 -- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f1406e510 msgr2=0x7f7f1413ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1a000640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f1406e510 0x7f7f1413ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1a000640 1 -- 172.21.15.37:0/3385994344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f1413f470 con 0x7f7f1415e890 2024-05-30T06:58:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1a000640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1415e890 0x7f7f140b1ca0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0af040 tx=0x7f7f0c0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f11600640 1 -- 172.21.15.37:0/3385994344 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0b8670 con 0x7f7f1415e890 2024-05-30T06:58:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f11600640 1 -- 172.21.15.37:0/3385994344 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f0c0be070 con 0x7f7f1415e890 2024-05-30T06:58:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f11600640 1 -- 172.21.15.37:0/3385994344 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0b8a70 con 0x7f7f1415e890 2024-05-30T06:58:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1c000640 1 -- 172.21.15.37:0/3385994344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f140b0c00 con 0x7f7f1415e890 2024-05-30T06:58:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1c000640 1 -- 172.21.15.37:0/3385994344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f140b11c0 con 0x7f7f1415e890 2024-05-30T06:58:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.006+0000 7f7f1c000640 1 -- 172.21.15.37:0/3385994344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f14068bc0 con 0x7f7f1415e890 2024-05-30T06:58:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.010+0000 7f7f11600640 1 -- 172.21.15.37:0/3385994344 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f7f0c0b8c10 con 0x7f7f1415e890 2024-05-30T06:58:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.010+0000 7f7f11600640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ef406a030 0x7f7ef406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.010+0000 7f7f11600640 1 -- 172.21.15.37:0/3385994344 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7f7f0c1209f0 con 0x7f7f1415e890 2024-05-30T06:58:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.010+0000 7f7f19600640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ef406a030 0x7f7ef406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.010+0000 7f7f19600640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ef406a030 0x7f7ef406c4f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7f08007fd0 tx=0x7f7f08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.014+0000 7f7f11600640 1 -- 172.21.15.37:0/3385994344 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7f0c016620 con 0x7f7f1415e890 2024-05-30T06:58:51.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.214+0000 7f7f1c000640 1 -- 172.21.15.37:0/3385994344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7f140b61b0 con 0x7f7f1415e890 2024-05-30T06:58:51.218 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:58:51.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.218+0000 7f7f11600640 1 -- 172.21.15.37:0/3385994344 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) ==== 100+0+11 (secure 0 0 0) 0x7f7f0c0f2340 con 0x7f7f1415e890 2024-05-30T06:58:51.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.222+0000 7f7f1c000640 1 -- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ef406a030 msgr2=0x7f7ef406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:51.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.222+0000 7f7f1c000640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ef406a030 0x7f7ef406c4f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7f08007fd0 tx=0x7f7f08009040 comp rx=0 tx=0).stop 2024-05-30T06:58:51.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.222+0000 7f7f1c000640 1 -- 172.21.15.37:0/3385994344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1415e890 msgr2=0x7f7f140b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:51.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.222+0000 7f7f1c000640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1415e890 0x7f7f140b1ca0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0af040 tx=0x7f7f0c0197a0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.222+0000 7f7f1c000640 1 -- 172.21.15.37:0/3385994344 shutdown_connections 2024-05-30T06:58:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.222+0000 7f7f1c000640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1415e890 0x7f7f140b1ca0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.222+0000 7f7f1c000640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f140b63d0 0x7f7f14154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.222+0000 7f7f1c000640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7ef406a030 0x7f7ef406c4f0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.222+0000 7f7f1c000640 1 --2- 172.21.15.37:0/3385994344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f1406e510 0x7f7f1413ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.222+0000 7f7f1c000640 1 -- 172.21.15.37:0/3385994344 >> 172.21.15.37:0/3385994344 conn(0x7f7f1406bf60 msgr2=0x7f7f1415ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.222+0000 7f7f1c000640 1 -- 172.21.15.37:0/3385994344 shutdown_connections 2024-05-30T06:58:51.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.222+0000 7f7f1c000640 1 -- 172.21.15.37:0/3385994344 wait complete. 2024-05-30T06:58:51.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T06:58:51.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.494+0000 7fdb84e00640 1 Processor -- start 2024-05-30T06:58:51.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.494+0000 7fdb84e00640 1 -- start start 2024-05-30T06:58:51.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.494+0000 7fdb84e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb800b59d0 0x7fdb800b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.494+0000 7fdb84e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdb8015d350 0x7fdb80160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.494+0000 7fdb84e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb8015d7e0 0x7fdb801607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.494+0000 7fdb84e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdb800b62f0 con 0x7fdb800b59d0 2024-05-30T06:58:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.494+0000 7fdb84e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdb80142030 con 0x7fdb8015d350 2024-05-30T06:58:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.494+0000 7fdb84e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb80142310 con 0x7fdb8015d7e0 2024-05-30T06:58:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.494+0000 7fdb7e800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb8015d7e0 0x7fdb801607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:51.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.494+0000 7fdb7e800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb8015d7e0 0x7fdb801607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:47252/0 (socket says 172.21.15.37:47252) 2024-05-30T06:58:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.494+0000 7fdb7e800640 1 -- 172.21.15.37:0/3281457106 learned_addr learned my addr 172.21.15.37:0/3281457106 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.494+0000 7fdb7d400640 1 --2- 172.21.15.37:0/3281457106 >> v2:172.21.15.105:3300/0 conn(0x7fdb8015d350 0x7fdb80160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.494+0000 7fdb7de00640 1 --2- 172.21.15.37:0/3281457106 >> v2:172.21.15.37:3300/0 conn(0x7fdb800b59d0 0x7fdb800b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.498+0000 7fdb7e800640 1 -- 172.21.15.37:0/3281457106 >> v2:172.21.15.105:3300/0 conn(0x7fdb8015d350 msgr2=0x7fdb80160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.498+0000 7fdb7e800640 1 --2- 172.21.15.37:0/3281457106 >> v2:172.21.15.105:3300/0 conn(0x7fdb8015d350 0x7fdb80160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.498+0000 7fdb7e800640 1 -- 172.21.15.37:0/3281457106 >> v2:172.21.15.37:3300/0 conn(0x7fdb800b59d0 msgr2=0x7fdb800b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.498+0000 7fdb7e800640 1 --2- 172.21.15.37:0/3281457106 >> v2:172.21.15.37:3300/0 conn(0x7fdb800b59d0 0x7fdb800b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.498+0000 7fdb7e800640 1 -- 172.21.15.37:0/3281457106 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb801425f0 con 0x7fdb8015d7e0 2024-05-30T06:58:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.502+0000 7fdb7e800640 1 --2- 172.21.15.37:0/3281457106 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb8015d7e0 0x7fdb801607c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdb78009e50 tx=0x7fdb7801f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2642a366a8e159ac server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:51.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.502+0000 7fdb7ca00640 1 -- 172.21.15.37:0/3281457106 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb780b4070 con 0x7fdb8015d7e0 2024-05-30T06:58:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.502+0000 7fdb7ca00640 1 -- 172.21.15.37:0/3281457106 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb780af400 con 0x7fdb8015d7e0 2024-05-30T06:58:51.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.502+0000 7fdb7ca00640 1 -- 172.21.15.37:0/3281457106 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb780af7d0 con 0x7fdb8015d7e0 2024-05-30T06:58:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.502+0000 7fdb84e00640 1 -- 172.21.15.37:0/3281457106 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb8015d7e0 msgr2=0x7fdb801607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.502+0000 7fdb84e00640 1 --2- 172.21.15.37:0/3281457106 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb8015d7e0 0x7fdb801607c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdb78009e50 tx=0x7fdb7801f1e0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.502+0000 7fdb84e00640 1 -- 172.21.15.37:0/3281457106 shutdown_connections 2024-05-30T06:58:51.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.502+0000 7fdb84e00640 1 --2- 172.21.15.37:0/3281457106 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb8015d7e0 0x7fdb801607c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.502+0000 7fdb84e00640 1 --2- 172.21.15.37:0/3281457106 >> v2:172.21.15.105:3300/0 conn(0x7fdb8015d350 0x7fdb80160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.502+0000 7fdb84e00640 1 --2- 172.21.15.37:0/3281457106 >> v2:172.21.15.37:3300/0 conn(0x7fdb800b59d0 0x7fdb800b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.502+0000 7fdb84e00640 1 -- 172.21.15.37:0/3281457106 >> 172.21.15.37:0/3281457106 conn(0x7fdb8006bf60 msgr2=0x7fdb800b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.502+0000 7fdb84e00640 1 -- 172.21.15.37:0/3281457106 shutdown_connections 2024-05-30T06:58:51.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.502+0000 7fdb84e00640 1 -- 172.21.15.37:0/3281457106 wait complete. 2024-05-30T06:58:51.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.506+0000 7fdb84e00640 1 Processor -- start 2024-05-30T06:58:51.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.506+0000 7fdb84e00640 1 -- start start 2024-05-30T06:58:51.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.506+0000 7fdb84e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb800b59d0 0x7fdb8013d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:51.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.506+0000 7fdb84e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb8015d350 0x7fdb80156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:51.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.506+0000 7fdb84e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb8015d7e0 0x7fdb801566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:51.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.506+0000 7fdb84e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8013fe60 con 0x7fdb8015d7e0 2024-05-30T06:58:51.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.506+0000 7fdb84e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8013fce0 con 0x7fdb8015d350 2024-05-30T06:58:51.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.506+0000 7fdb84e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb800aff20 con 0x7fdb800b59d0 2024-05-30T06:58:51.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.506+0000 7fdb7d400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb8015d350 0x7fdb80156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:51.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.506+0000 7fdb7d400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb8015d350 0x7fdb80156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:33068/0 (socket says 172.21.15.37:33068) 2024-05-30T06:58:51.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb7d400640 1 -- 172.21.15.37:0/3251787330 learned_addr learned my addr 172.21.15.37:0/3251787330 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:51.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb7de00640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb800b59d0 0x7fdb8013d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:51.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb7d400640 1 -- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb800b59d0 msgr2=0x7fdb8013d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:51.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb7e800640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb8015d7e0 0x7fdb801566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:51.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb7d400640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb800b59d0 0x7fdb8013d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb7d400640 1 -- 172.21.15.37:0/3251787330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb8015d7e0 msgr2=0x7fdb801566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:51.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb7d400640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb8015d7e0 0x7fdb801566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb7d400640 1 -- 172.21.15.37:0/3251787330 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb80154b60 con 0x7fdb8015d350 2024-05-30T06:58:51.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb7de00640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb800b59d0 0x7fdb8013d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:58:51.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb7d400640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb8015d350 0x7fdb80156180 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000e960 tx=0x7fdb7000ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:51.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb76000640 1 -- 172.21.15.37:0/3251787330 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb70017070 con 0x7fdb8015d350 2024-05-30T06:58:51.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb76000640 1 -- 172.21.15.37:0/3251787330 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7000ca00 con 0x7fdb8015d350 2024-05-30T06:58:51.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb7e800640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb8015d7e0 0x7fdb801566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:58:51.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb76000640 1 -- 172.21.15.37:0/3251787330 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7000cdb0 con 0x7fdb8015d350 2024-05-30T06:58:51.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb84e00640 1 -- 172.21.15.37:0/3251787330 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb80154e40 con 0x7fdb8015d350 2024-05-30T06:58:51.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb84e00640 1 -- 172.21.15.37:0/3251787330 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb80155400 con 0x7fdb8015d350 2024-05-30T06:58:51.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.510+0000 7fdb84e00640 1 -- 172.21.15.37:0/3251787330 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb80068bc0 con 0x7fdb8015d350 2024-05-30T06:58:51.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.514+0000 7fdb76000640 1 -- 172.21.15.37:0/3251787330 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fdb7001a070 con 0x7fdb8015d350 2024-05-30T06:58:51.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.514+0000 7fdb76000640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb6006a060 0x7fdb6006c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:51.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.514+0000 7fdb76000640 1 -- 172.21.15.37:0/3251787330 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7fdb70085c60 con 0x7fdb8015d350 2024-05-30T06:58:51.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.518+0000 7fdb7de00640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb6006a060 0x7fdb6006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:51.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.518+0000 7fdb7de00640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb6006a060 0x7fdb6006c520 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdb801f7ea0 tx=0x7fdb6c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:51.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.522+0000 7fdb76000640 1 -- 172.21.15.37:0/3251787330 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdb700576b0 con 0x7fdb8015d350 2024-05-30T06:58:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.754+0000 7fdb84e00640 1 -- 172.21.15.37:0/3251787330 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdb8006f0a0 con 0x7fdb8015d350 2024-05-30T06:58:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.754+0000 7fdb76000640 1 -- 172.21.15.37:0/3251787330 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v117) ==== 80+0+0 (secure 0 0 0) 0x7fdb7005b9b0 con 0x7fdb8015d350 2024-05-30T06:58:51.756 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-30T06:58:51.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.758+0000 7fdb84e00640 1 -- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb6006a060 msgr2=0x7fdb6006c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:51.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.758+0000 7fdb84e00640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb6006a060 0x7fdb6006c520 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdb801f7ea0 tx=0x7fdb6c009190 comp rx=0 tx=0).stop 2024-05-30T06:58:51.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.758+0000 7fdb84e00640 1 -- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb8015d350 msgr2=0x7fdb80156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:51.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.758+0000 7fdb84e00640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb8015d350 0x7fdb80156180 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000e960 tx=0x7fdb7000ee20 comp rx=0 tx=0).stop 2024-05-30T06:58:51.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.758+0000 7fdb84e00640 1 -- 172.21.15.37:0/3251787330 shutdown_connections 2024-05-30T06:58:51.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.758+0000 7fdb84e00640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb8015d7e0 0x7fdb801566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.758+0000 7fdb84e00640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdb6006a060 0x7fdb6006c520 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.758+0000 7fdb84e00640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb8015d350 0x7fdb80156180 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.758+0000 7fdb84e00640 1 --2- 172.21.15.37:0/3251787330 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb800b59d0 0x7fdb8013d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:51.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.758+0000 7fdb84e00640 1 -- 172.21.15.37:0/3251787330 >> 172.21.15.37:0/3251787330 conn(0x7fdb8006bf60 msgr2=0x7fdb80140930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:51.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.758+0000 7fdb84e00640 1 -- 172.21.15.37:0/3251787330 shutdown_connections 2024-05-30T06:58:51.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:51.758+0000 7fdb84e00640 1 -- 172.21.15.37:0/3251787330 wait complete. 2024-05-30T06:58:51.778 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T06:58:51.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:58:51.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-30T06:58:51.831 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T06:58:51.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:58:51.832 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T06:58:51.851 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:58:51.851 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:58:51.851 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:58:51.863 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:58:51.863 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:58:51.863 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:58:51.863 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:58:51.901 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:58:51.901 INFO:tasks.cephfs.mount:Terminating background process 2024-05-30T06:58:51.901 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:58:51.901 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:58:51.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:58:51.912 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:58:52.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef1a200640 1 Processor -- start 2024-05-30T06:58:52.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef1a200640 1 -- start start 2024-05-30T06:58:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef1a200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140b2e20 0x7fef14160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef1a200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fef1409ba70 0x7fef14160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef1a200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef140d0430 con 0x7fef141609c0 2024-05-30T06:58:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef1a200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fef140b3200 con 0x7fef1409ba70 2024-05-30T06:58:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef1a200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fef140d01e0 con 0x7fef140b2e20 2024-05-30T06:58:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef12a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fef141609c0 0x7fef140cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56098/0 (socket says 172.21.15.37:56098) 2024-05-30T06:58:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef12a00640 1 -- 172.21.15.37:0/1847909806 learned_addr learned my addr 172.21.15.37:0/1847909806 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef13400640 1 --2- 172.21.15.37:0/1847909806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140b2e20 0x7fef14160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef13e00640 1 --2- 172.21.15.37:0/1847909806 >> v2:172.21.15.105:3300/0 conn(0x7fef1409ba70 0x7fef14160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef12000640 1 -- 172.21.15.37:0/1847909806 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3947294016 0 0) 0x7fef140d0430 con 0x7fef141609c0 2024-05-30T06:58:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef12000640 1 -- 172.21.15.37:0/1847909806 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feef8003530 con 0x7fef141609c0 2024-05-30T06:58:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef13400640 1 -- 172.21.15.37:0/1847909806 >> v2:172.21.15.105:3300/0 conn(0x7fef1409ba70 msgr2=0x7fef14160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef13400640 1 --2- 172.21.15.37:0/1847909806 >> v2:172.21.15.105:3300/0 conn(0x7fef1409ba70 0x7fef14160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef13400640 1 -- 172.21.15.37:0/1847909806 >> v1:172.21.15.37:6789/0 conn(0x7fef141609c0 legacy=0x7fef140cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef13400640 1 -- 172.21.15.37:0/1847909806 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef140d0710 con 0x7fef140b2e20 2024-05-30T06:58:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.086+0000 7fef13e00640 1 --2- 172.21.15.37:0/1847909806 >> v2:172.21.15.105:3300/0 conn(0x7fef1409ba70 0x7fef14160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:58:52.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.090+0000 7fef13400640 1 --2- 172.21.15.37:0/1847909806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140b2e20 0x7fef14160480 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fef040097c0 tx=0x7fef0401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b41ccf10ce4c53db server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:52.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.090+0000 7fef12000640 1 -- 172.21.15.37:0/1847909806 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040b2070 con 0x7fef140b2e20 2024-05-30T06:58:52.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.090+0000 7fef12000640 1 -- 172.21.15.37:0/1847909806 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef040ad640 con 0x7fef140b2e20 2024-05-30T06:58:52.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.090+0000 7fef12000640 1 -- 172.21.15.37:0/1847909806 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040ad9f0 con 0x7fef140b2e20 2024-05-30T06:58:52.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.090+0000 7fef1a200640 1 -- 172.21.15.37:0/1847909806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140b2e20 msgr2=0x7fef14160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.090+0000 7fef1a200640 1 --2- 172.21.15.37:0/1847909806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140b2e20 0x7fef14160480 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fef040097c0 tx=0x7fef0401c4a0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.090+0000 7fef1a200640 1 -- 172.21.15.37:0/1847909806 shutdown_connections 2024-05-30T06:58:52.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.090+0000 7fef1a200640 1 --2- 172.21.15.37:0/1847909806 >> v2:172.21.15.105:3300/0 conn(0x7fef1409ba70 0x7fef14160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.090+0000 7fef1a200640 1 --2- 172.21.15.37:0/1847909806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140b2e20 0x7fef14160480 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.090+0000 7fef1a200640 1 -- 172.21.15.37:0/1847909806 >> 172.21.15.37:0/1847909806 conn(0x7fef140b4100 msgr2=0x7fef140b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:52.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.090+0000 7fef1a200640 1 -- 172.21.15.37:0/1847909806 shutdown_connections 2024-05-30T06:58:52.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.090+0000 7fef1a200640 1 -- 172.21.15.37:0/1847909806 wait complete. 2024-05-30T06:58:52.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.090+0000 7fef1a200640 1 Processor -- start 2024-05-30T06:58:52.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef1a200640 1 -- start start 2024-05-30T06:58:52.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef1a200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef1409ba70 0x7fef141560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef1a200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140b2e20 0x7fef1415b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef1a200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef141609c0 0x7fef141585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef1a200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef140ce320 con 0x7fef1409ba70 2024-05-30T06:58:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef1a200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fef140ce1a0 con 0x7fef141609c0 2024-05-30T06:58:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef1a200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fef1415cb40 con 0x7fef140b2e20 2024-05-30T06:58:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef13400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef1409ba70 0x7fef141560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef12a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140b2e20 0x7fef1415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef13400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef1409ba70 0x7fef141560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58612/0 (socket says 172.21.15.37:58612) 2024-05-30T06:58:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef13400640 1 -- 172.21.15.37:0/2181653365 learned_addr learned my addr 172.21.15.37:0/2181653365 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef13e00640 1 --2- 172.21.15.37:0/2181653365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef141609c0 0x7fef141585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef13400640 1 -- 172.21.15.37:0/2181653365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140b2e20 msgr2=0x7fef1415b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef13400640 1 --2- 172.21.15.37:0/2181653365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140b2e20 0x7fef1415b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef13400640 1 -- 172.21.15.37:0/2181653365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef141609c0 msgr2=0x7fef141585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef13400640 1 --2- 172.21.15.37:0/2181653365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef141609c0 0x7fef141585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef13400640 1 -- 172.21.15.37:0/2181653365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1415bf30 con 0x7fef1409ba70 2024-05-30T06:58:52.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef13400640 1 --2- 172.21.15.37:0/2181653365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef1409ba70 0x7fef141560b0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fef040b0040 tx=0x7fef04019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:52.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef0b400640 1 -- 172.21.15.37:0/2181653365 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef040b2040 con 0x7fef1409ba70 2024-05-30T06:58:52.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef0b400640 1 -- 172.21.15.37:0/2181653365 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef040ad440 con 0x7fef1409ba70 2024-05-30T06:58:52.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef0b400640 1 -- 172.21.15.37:0/2181653365 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef04006e20 con 0x7fef1409ba70 2024-05-30T06:58:52.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef1a200640 1 -- 172.21.15.37:0/2181653365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1415c210 con 0x7fef1409ba70 2024-05-30T06:58:52.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef1a200640 1 -- 172.21.15.37:0/2181653365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1415c7d0 con 0x7fef1409ba70 2024-05-30T06:58:52.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.094+0000 7fef1a200640 1 -- 172.21.15.37:0/2181653365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef14068b20 con 0x7fef1409ba70 2024-05-30T06:58:52.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.098+0000 7fef0b400640 1 -- 172.21.15.37:0/2181653365 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fef040bf030 con 0x7fef1409ba70 2024-05-30T06:58:52.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.098+0000 7fef0b400640 1 --2- 172.21.15.37:0/2181653365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feef406a030 0x7feef406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.098+0000 7fef0b400640 1 -- 172.21.15.37:0/2181653365 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7fef0411ef70 con 0x7fef1409ba70 2024-05-30T06:58:52.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.098+0000 7fef12a00640 1 --2- 172.21.15.37:0/2181653365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feef406a030 0x7feef406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.098+0000 7fef12a00640 1 --2- 172.21.15.37:0/2181653365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feef406a030 0x7feef406c4f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fef00007fd0 tx=0x7fef00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:52.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.102+0000 7fef0b400640 1 -- 172.21.15.37:0/2181653365 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fef040c6020 con 0x7fef1409ba70 2024-05-30T06:58:52.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef1a200640 1 -- 172.21.15.37:0/2181653365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef140b2460 con 0x7fef1409ba70 2024-05-30T06:58:52.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef0b400640 1 -- 172.21.15.37:0/2181653365 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5189 (secure 0 0 0) 0x7fef04016090 con 0x7fef1409ba70 2024-05-30T06:58:52.303 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:52.303 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3908783351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3908783351},{"type":"v1","addr":"172.21.15.105:6836","nonce":3908783351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":8473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2654517585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2654517585},{"type":"v1","addr":"172.21.15.105:6837","nonce":2654517585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":9117,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3433994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3433994777},{"type":"v1","addr":"172.21.15.37:6833","nonce":3433994777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:57:18.453221+0000","modified":"2024-05-30T06:57:21.469705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9120":{"gid":9120,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1475971506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1475971506},{"type":"v1","addr":"172.21.15.37:6835","nonce":1475971506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9120,"qdb_cluster":[9120]},"id":8}]} 2024-05-30T06:58:52.303 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 75 2024-05-30T06:58:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef1a200640 1 -- 172.21.15.37:0/2181653365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feef406a030 msgr2=0x7feef406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef1a200640 1 --2- 172.21.15.37:0/2181653365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feef406a030 0x7feef406c4f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fef00007fd0 tx=0x7fef00009040 comp rx=0 tx=0).stop 2024-05-30T06:58:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef1a200640 1 -- 172.21.15.37:0/2181653365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef1409ba70 msgr2=0x7fef141560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef1a200640 1 --2- 172.21.15.37:0/2181653365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef1409ba70 0x7fef141560b0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fef040b0040 tx=0x7fef04019240 comp rx=0 tx=0).stop 2024-05-30T06:58:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef1a200640 1 -- 172.21.15.37:0/2181653365 shutdown_connections 2024-05-30T06:58:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef1a200640 1 --2- 172.21.15.37:0/2181653365 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feef406a030 0x7feef406c4f0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef1a200640 1 --2- 172.21.15.37:0/2181653365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef141609c0 0x7fef141585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef1a200640 1 --2- 172.21.15.37:0/2181653365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef140b2e20 0x7fef1415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef1a200640 1 --2- 172.21.15.37:0/2181653365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef1409ba70 0x7fef141560b0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef1a200640 1 -- 172.21.15.37:0/2181653365 >> 172.21.15.37:0/2181653365 conn(0x7fef140b4100 msgr2=0x7fef1415fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:52.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef1a200640 1 -- 172.21.15.37:0/2181653365 shutdown_connections 2024-05-30T06:58:52.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.302+0000 7fef1a200640 1 -- 172.21.15.37:0/2181653365 wait complete. 2024-05-30T06:58:52.324 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:58:52.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedf4000640 1 Processor -- start 2024-05-30T06:58:52.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedf4000640 1 -- start start 2024-05-30T06:58:52.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedf4000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fedec163d80 0x7fedec166170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedf4000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0cd170 con 0x7fedec0afbf0 2024-05-30T06:58:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedf4000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0cd450 con 0x7fedec15ec60 2024-05-30T06:58:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedf4000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fedec06fb40 con 0x7fedec163d80 2024-05-30T06:58:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedf0c00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fedec0afbf0 0x7fedec15ab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56114/0 (socket says 172.21.15.37:56114) 2024-05-30T06:58:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedf0c00640 1 -- 172.21.15.37:0/3660252109 learned_addr learned my addr 172.21.15.37:0/3660252109 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedf2000640 1 --2- 172.21.15.37:0/3660252109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fedec163d80 0x7fedec166170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedebe00640 1 -- 172.21.15.37:0/3660252109 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590359814 0 0) 0x7fedec0cd170 con 0x7fedec0afbf0 2024-05-30T06:58:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedebe00640 1 -- 172.21.15.37:0/3660252109 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedd4003530 con 0x7fedec0afbf0 2024-05-30T06:58:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedebe00640 1 -- 172.21.15.37:0/3660252109 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996264656 0 0) 0x7fedec0cd450 con 0x7fedec15ec60 2024-05-30T06:58:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedebe00640 1 -- 172.21.15.37:0/3660252109 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedec0cd170 con 0x7fedec15ec60 2024-05-30T06:58:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedf2000640 1 -- 172.21.15.37:0/3660252109 >> v1:172.21.15.105:6789/0 conn(0x7fedec15ec60 legacy=0x7fedec15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedebe00640 1 -- 172.21.15.37:0/3660252109 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2093632787 0 0) 0x7fedd4003530 con 0x7fedec0afbf0 2024-05-30T06:58:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedf2000640 1 -- 172.21.15.37:0/3660252109 >> v1:172.21.15.37:6789/0 conn(0x7fedec0afbf0 legacy=0x7fedec15ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.466+0000 7fedf2000640 1 -- 172.21.15.37:0/3660252109 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec06f340 con 0x7fedec163d80 2024-05-30T06:58:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.470+0000 7fedf2000640 1 --2- 172.21.15.37:0/3660252109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fedec163d80 0x7fedec166170 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fede4009dc0 tx=0x7fede401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5ad3e360aec54be server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.470+0000 7fedebe00640 1 -- 172.21.15.37:0/3660252109 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede40ac070 con 0x7fedec163d80 2024-05-30T06:58:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.470+0000 7fedebe00640 1 -- 172.21.15.37:0/3660252109 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede40a6480 con 0x7fedec163d80 2024-05-30T06:58:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.470+0000 7fedebe00640 1 -- 172.21.15.37:0/3660252109 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd8001680 con 0x7fedec163d80 2024-05-30T06:58:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.470+0000 7fedf4000640 1 -- 172.21.15.37:0/3660252109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fedec163d80 msgr2=0x7fedec166170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.470+0000 7fedf4000640 1 --2- 172.21.15.37:0/3660252109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fedec163d80 0x7fedec166170 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fede4009dc0 tx=0x7fede401c8b0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.470+0000 7fedf4000640 1 -- 172.21.15.37:0/3660252109 shutdown_connections 2024-05-30T06:58:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.470+0000 7fedf4000640 1 --2- 172.21.15.37:0/3660252109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fedec163d80 0x7fedec166170 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.470+0000 7fedf4000640 1 -- 172.21.15.37:0/3660252109 >> 172.21.15.37:0/3660252109 conn(0x7fedec0b23a0 msgr2=0x7fedec0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.470+0000 7fedf4000640 1 -- 172.21.15.37:0/3660252109 shutdown_connections 2024-05-30T06:58:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.470+0000 7fedf4000640 1 -- 172.21.15.37:0/3660252109 wait complete. 2024-05-30T06:58:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf4000640 1 Processor -- start 2024-05-30T06:58:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf4000640 1 -- start start 2024-05-30T06:58:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf4000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fedec0afbf0 0x7fedec14c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf4000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec15ec60 0x7fedec159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf4000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedec163d80 0x7fedec074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf4000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fedec0cfd70 con 0x7fedec15ec60 2024-05-30T06:58:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf4000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fedec06f6b0 con 0x7fedec163d80 2024-05-30T06:58:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf4000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fedec0cfef0 con 0x7fedec0afbf0 2024-05-30T06:58:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf0c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec15ec60 0x7fedec159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf0c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec15ec60 0x7fedec159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58618/0 (socket says 172.21.15.37:58618) 2024-05-30T06:58:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf0c00640 1 -- 172.21.15.37:0/1760335932 learned_addr learned my addr 172.21.15.37:0/1760335932 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf2000640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedec163d80 0x7fedec074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf1600640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fedec0afbf0 0x7fedec14c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf0c00640 1 -- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fedec0afbf0 msgr2=0x7fedec14c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf0c00640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fedec0afbf0 0x7fedec14c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf0c00640 1 -- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedec163d80 msgr2=0x7fedec074cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf0c00640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedec163d80 0x7fedec074cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf0c00640 1 -- 172.21.15.37:0/1760335932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec151c10 con 0x7fedec15ec60 2024-05-30T06:58:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf0c00640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec15ec60 0x7fedec159db0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fedd800c600 tx=0x7fedd800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fede9600640 1 -- 172.21.15.37:0/1760335932 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd8017070 con 0x7fedec15ec60 2024-05-30T06:58:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fede9600640 1 -- 172.21.15.37:0/1760335932 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd8005cf0 con 0x7fedec15ec60 2024-05-30T06:58:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fede9600640 1 -- 172.21.15.37:0/1760335932 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd80072b0 con 0x7fedec15ec60 2024-05-30T06:58:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf4000640 1 -- 172.21.15.37:0/1760335932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedec151370 con 0x7fedec15ec60 2024-05-30T06:58:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf4000640 1 -- 172.21.15.37:0/1760335932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedec151930 con 0x7fedec15ec60 2024-05-30T06:58:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.474+0000 7fedf4000640 1 -- 172.21.15.37:0/1760335932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedec068b20 con 0x7fedec15ec60 2024-05-30T06:58:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.478+0000 7fede9600640 1 -- 172.21.15.37:0/1760335932 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fedd801a070 con 0x7fedec15ec60 2024-05-30T06:58:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.478+0000 7fede9600640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fedcc06a060 0x7fedcc06c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.478+0000 7fede9600640 1 -- 172.21.15.37:0/1760335932 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7fedd8084de0 con 0x7fedec15ec60 2024-05-30T06:58:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.478+0000 7fedf1600640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fedcc06a060 0x7fedcc06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.478+0000 7fedf1600640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fedcc06a060 0x7fedcc06c520 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fede00011f0 tx=0x7fede0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:52.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.482+0000 7fede9600640 1 -- 172.21.15.37:0/1760335932 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fedd80567b0 con 0x7fedec15ec60 2024-05-30T06:58:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.650+0000 7fedf4000640 1 -- 172.21.15.37:0/1760335932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fedec0cd340 con 0x7fedec15ec60 2024-05-30T06:58:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.650+0000 7fede9600640 1 -- 172.21.15.37:0/1760335932 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16968 (secure 0 0 0) 0x7fedd805aab0 con 0x7fedec15ec60 2024-05-30T06:58:52.652 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:52.652 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":117,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:58:49.820117+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:57:16.849268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-05-30T06:57:17.405807+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.5","mappings":[{"from":0,"to":2}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:58:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.654+0000 7fedf4000640 1 -- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fedcc06a060 msgr2=0x7fedcc06c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.654+0000 7fedf4000640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fedcc06a060 0x7fedcc06c520 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fede00011f0 tx=0x7fede0009040 comp rx=0 tx=0).stop 2024-05-30T06:58:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.654+0000 7fedf4000640 1 -- 172.21.15.37:0/1760335932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec15ec60 msgr2=0x7fedec159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.654+0000 7fedf4000640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec15ec60 0x7fedec159db0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fedd800c600 tx=0x7fedd800cac0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.654+0000 7fedf4000640 1 -- 172.21.15.37:0/1760335932 shutdown_connections 2024-05-30T06:58:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.654+0000 7fedf4000640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fedcc06a060 0x7fedcc06c520 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.654+0000 7fedf4000640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fedec163d80 0x7fedec074cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.654+0000 7fedf4000640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedec15ec60 0x7fedec159db0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.654+0000 7fedf4000640 1 --2- 172.21.15.37:0/1760335932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fedec0afbf0 0x7fedec14c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.654+0000 7fedf4000640 1 -- 172.21.15.37:0/1760335932 >> 172.21.15.37:0/1760335932 conn(0x7fedec0b23a0 msgr2=0x7fedec0b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:52.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.654+0000 7fedf4000640 1 -- 172.21.15.37:0/1760335932 shutdown_connections 2024-05-30T06:58:52.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.654+0000 7fedf4000640 1 -- 172.21.15.37:0/1760335932 wait complete. 2024-05-30T06:58:52.673 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:57:16.849268+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:57:17.405807+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 117, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:58:52.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:58:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.814+0000 7fe073800640 1 Processor -- start 2024-05-30T06:58:52.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.814+0000 7fe073800640 1 -- start start 2024-05-30T06:58:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe073800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe06c155da0 0x7fe06c0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe073800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe06c15f310 con 0x7fe06c0cd440 2024-05-30T06:58:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe073800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe06c15f5f0 con 0x7fe06c06f770 2024-05-30T06:58:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe073800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe06c15f8d0 con 0x7fe06c155da0 2024-05-30T06:58:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe063e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe06c0cd440 0x7fe06c06f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56120/0 (socket says 172.21.15.37:56120) 2024-05-30T06:58:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe063e00640 1 -- 172.21.15.37:0/1936468041 learned_addr learned my addr 172.21.15.37:0/1936468041 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe070e00640 1 --2- 172.21.15.37:0/1936468041 >> v2:172.21.15.105:3300/0 conn(0x7fe06c155da0 0x7fe06c0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe06be00640 1 -- 172.21.15.37:0/1936468041 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1274506959 0 0) 0x7fe06c15f310 con 0x7fe06c0cd440 2024-05-30T06:58:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe06be00640 1 -- 172.21.15.37:0/1936468041 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe050005740 con 0x7fe06c0cd440 2024-05-30T06:58:52.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe06be00640 1 -- 172.21.15.37:0/1936468041 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 843277469 0 0) 0x7fe06c15f5f0 con 0x7fe06c06f770 2024-05-30T06:58:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe06be00640 1 -- 172.21.15.37:0/1936468041 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe06c15f310 con 0x7fe06c06f770 2024-05-30T06:58:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe070e00640 1 -- 172.21.15.37:0/1936468041 >> v1:172.21.15.105:6789/0 conn(0x7fe06c06f770 legacy=0x7fe06c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe070e00640 1 -- 172.21.15.37:0/1936468041 >> v1:172.21.15.37:6789/0 conn(0x7fe06c0cd440 legacy=0x7fe06c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.818+0000 7fe070e00640 1 -- 172.21.15.37:0/1936468041 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06c15fbb0 con 0x7fe06c155da0 2024-05-30T06:58:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.822+0000 7fe070e00640 1 --2- 172.21.15.37:0/1936468041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c155da0 0x7fe06c0cd950 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0097c0 tx=0x7fe05c01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4de4247a42a05d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.822+0000 7fe06be00640 1 -- 172.21.15.37:0/1936468041 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0b0070 con 0x7fe06c155da0 2024-05-30T06:58:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.822+0000 7fe06be00640 1 -- 172.21.15.37:0/1936468041 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe05c0ab600 con 0x7fe06c155da0 2024-05-30T06:58:52.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.822+0000 7fe06be00640 1 -- 172.21.15.37:0/1936468041 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c0ab9d0 con 0x7fe06c155da0 2024-05-30T06:58:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.822+0000 7fe073800640 1 -- 172.21.15.37:0/1936468041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c155da0 msgr2=0x7fe06c0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.822+0000 7fe073800640 1 --2- 172.21.15.37:0/1936468041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c155da0 0x7fe06c0cd950 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0097c0 tx=0x7fe05c01c380 comp rx=0 tx=0).stop 2024-05-30T06:58:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.822+0000 7fe073800640 1 -- 172.21.15.37:0/1936468041 shutdown_connections 2024-05-30T06:58:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.822+0000 7fe073800640 1 --2- 172.21.15.37:0/1936468041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c155da0 0x7fe06c0cd950 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.822+0000 7fe073800640 1 -- 172.21.15.37:0/1936468041 >> 172.21.15.37:0/1936468041 conn(0x7fe06c06bf60 msgr2=0x7fe06c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.822+0000 7fe073800640 1 -- 172.21.15.37:0/1936468041 shutdown_connections 2024-05-30T06:58:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.822+0000 7fe073800640 1 -- 172.21.15.37:0/1936468041 wait complete. 2024-05-30T06:58:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.822+0000 7fe073800640 1 Processor -- start 2024-05-30T06:58:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.822+0000 7fe073800640 1 -- start start 2024-05-30T06:58:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe073800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c06f770 0x7fe06c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe073800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe06c155da0 0x7fe06c13f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe073800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c15af70 0x7fe06c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe073800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c06e320 con 0x7fe06c155da0 2024-05-30T06:58:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe073800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c06e1a0 con 0x7fe06c06f770 2024-05-30T06:58:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe073800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe06c06e4a0 con 0x7fe06c15af70 2024-05-30T06:58:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe063e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe06c155da0 0x7fe06c13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe063e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe06c155da0 0x7fe06c13f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58626/0 (socket says 172.21.15.37:58626) 2024-05-30T06:58:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe063e00640 1 -- 172.21.15.37:0/1039675418 learned_addr learned my addr 172.21.15.37:0/1039675418 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe070e00640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c06f770 0x7fe06c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe071800640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c15af70 0x7fe06c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe063e00640 1 -- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c15af70 msgr2=0x7fe06c154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe063e00640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c15af70 0x7fe06c154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe063e00640 1 -- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c06f770 msgr2=0x7fe06c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe063e00640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c06f770 0x7fe06c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe063e00640 1 -- 172.21.15.37:0/1039675418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06c1673b0 con 0x7fe06c155da0 2024-05-30T06:58:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe063e00640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe06c155da0 0x7fe06c13f060 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fe05400c500 tx=0x7fe05400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe069600640 1 -- 172.21.15.37:0/1039675418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe054017070 con 0x7fe06c155da0 2024-05-30T06:58:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe069600640 1 -- 172.21.15.37:0/1039675418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe054005cf0 con 0x7fe06c155da0 2024-05-30T06:58:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe073800640 1 -- 172.21.15.37:0/1039675418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe06c1525b0 con 0x7fe06c155da0 2024-05-30T06:58:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe069600640 1 -- 172.21.15.37:0/1039675418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe054007330 con 0x7fe06c155da0 2024-05-30T06:58:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe073800640 1 -- 172.21.15.37:0/1039675418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe06c152b70 con 0x7fe06c155da0 2024-05-30T06:58:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe073800640 1 -- 172.21.15.37:0/1039675418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe06c068bc0 con 0x7fe06c155da0 2024-05-30T06:58:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.826+0000 7fe069600640 1 -- 172.21.15.37:0/1039675418 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fe05401a070 con 0x7fe06c155da0 2024-05-30T06:58:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.830+0000 7fe069600640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe04806a030 0x7fe04806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.830+0000 7fe069600640 1 -- 172.21.15.37:0/1039675418 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7fe054084d40 con 0x7fe06c155da0 2024-05-30T06:58:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.830+0000 7fe070e00640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe04806a030 0x7fe04806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.830+0000 7fe070e00640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe04806a030 0x7fe04806c4f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0ad000 tx=0x7fe05c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:52.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.834+0000 7fe069600640 1 -- 172.21.15.37:0/1039675418 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe054056710 con 0x7fe06c155da0 2024-05-30T06:58:53.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.998+0000 7fe073800640 1 -- 172.21.15.37:0/1039675418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe06c15ad50 con 0x7fe06c155da0 2024-05-30T06:58:53.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:52.998+0000 7fe069600640 1 -- 172.21.15.37:0/1039675418 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) ==== 93+0+10 (secure 0 0 0) 0x7fe05405aa10 con 0x7fe06c155da0 2024-05-30T06:58:53.001 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:58:53.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.002+0000 7fe073800640 1 -- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe04806a030 msgr2=0x7fe04806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.002+0000 7fe073800640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe04806a030 0x7fe04806c4f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe05c0ad000 tx=0x7fe05c008040 comp rx=0 tx=0).stop 2024-05-30T06:58:53.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.002+0000 7fe073800640 1 -- 172.21.15.37:0/1039675418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe06c155da0 msgr2=0x7fe06c13f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.002+0000 7fe073800640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe06c155da0 0x7fe06c13f060 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fe05400c500 tx=0x7fe05400c9c0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.002+0000 7fe073800640 1 -- 172.21.15.37:0/1039675418 shutdown_connections 2024-05-30T06:58:53.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.002+0000 7fe073800640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe06c15af70 0x7fe06c154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.002+0000 7fe073800640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe06c155da0 0x7fe06c13f060 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.002+0000 7fe073800640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe04806a030 0x7fe04806c4f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.002+0000 7fe073800640 1 --2- 172.21.15.37:0/1039675418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe06c06f770 0x7fe06c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.002+0000 7fe073800640 1 -- 172.21.15.37:0/1039675418 >> 172.21.15.37:0/1039675418 conn(0x7fe06c06bf60 msgr2=0x7fe06c0b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:53.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.002+0000 7fe073800640 1 -- 172.21.15.37:0/1039675418 shutdown_connections 2024-05-30T06:58:53.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.002+0000 7fe073800640 1 -- 172.21.15.37:0/1039675418 wait complete. 2024-05-30T06:58:53.021 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T06:58:53.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.162+0000 7f04a2200640 1 Processor -- start 2024-05-30T06:58:53.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.162+0000 7f04a2200640 1 -- start start 2024-05-30T06:58:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f04a2200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f049c15f210 0x7f049c072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f04a2200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f049c0cec10 0x7f049c072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f04a2200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f049c163020 con 0x7f049c15c890 2024-05-30T06:58:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f04a2200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f049c163300 con 0x7f049c0cec10 2024-05-30T06:58:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f04a2200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f049c1635e0 con 0x7f049c15f210 2024-05-30T06:58:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049b400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f049c15c890 0x7f049c162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56124/0 (socket says 172.21.15.37:56124) 2024-05-30T06:58:53.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049b400640 1 -- 172.21.15.37:0/2585343702 learned_addr learned my addr 172.21.15.37:0/2585343702 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f0492a00640 1 --2- 172.21.15.37:0/2585343702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f049c15f210 0x7f049c072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049be00640 1 --2- 172.21.15.37:0/2585343702 >> v2:172.21.15.105:3300/0 conn(0x7f049c0cec10 0x7f049c072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1663742099 0 0) 0x7f049c163020 con 0x7f049c15c890 2024-05-30T06:58:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0480003530 con 0x7f049c15c890 2024-05-30T06:58:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4106980413 0 0) 0x7f0480003530 con 0x7f049c15c890 2024-05-30T06:58:53.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f049c15f210 msgr2=0x7f049c072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 --2- 172.21.15.37:0/2585343702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f049c15f210 0x7f049c072750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 >> v2:172.21.15.105:3300/0 conn(0x7f049c0cec10 msgr2=0x7f049c072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 --2- 172.21.15.37:0/2585343702 >> v2:172.21.15.105:3300/0 conn(0x7f049c0cec10 0x7f049c072c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c06ba00 con 0x7f049c15c890 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f048c001680 con 0x7f049c15c890 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 >> v1:172.21.15.37:6789/0 conn(0x7f049c15c890 legacy=0x7f049c162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 --2- 172.21.15.37:0/2585343702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04800039c0 0x7f0480003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 --2- 172.21.15.37:0/2585343702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0480004810 0x7f0480004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 --2- 172.21.15.37:0/2585343702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f049c15f210 0x7f04800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f049c163300 con 0x7f04800039c0 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1635e0 con 0x7f0480004810 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f048000b9d0 con 0x7f049c15f210 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049b400640 1 --2- 172.21.15.37:0/2585343702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04800039c0 0x7f0480003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f0492a00640 1 --2- 172.21.15.37:0/2585343702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0480004810 0x7f0480004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049be00640 1 --2- 172.21.15.37:0/2585343702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f049c15f210 0x7f04800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049b400640 1 -- 172.21.15.37:0/2585343702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f049c15f210 msgr2=0x7f04800051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049b400640 1 --2- 172.21.15.37:0/2585343702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f049c15f210 0x7f04800051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049b400640 1 -- 172.21.15.37:0/2585343702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0480004810 msgr2=0x7f0480004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049b400640 1 --2- 172.21.15.37:0/2585343702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0480004810 0x7f0480004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.166+0000 7f049b400640 1 -- 172.21.15.37:0/2585343702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0480003530 con 0x7f04800039c0 2024-05-30T06:58:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.170+0000 7f049b400640 1 --2- 172.21.15.37:0/2585343702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04800039c0 0x7f0480003de0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f048c00c270 tx=0x7f048c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c55aea48929f45 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.170+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c007d40 con 0x7f04800039c0 2024-05-30T06:58:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.170+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c0a9020 con 0x7f04800039c0 2024-05-30T06:58:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.170+0000 7f049aa00640 1 -- 172.21.15.37:0/2585343702 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c005ae0 con 0x7f04800039c0 2024-05-30T06:58:53.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.170+0000 7f04a2200640 1 -- 172.21.15.37:0/2585343702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04800039c0 msgr2=0x7f0480003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.170+0000 7f04a2200640 1 --2- 172.21.15.37:0/2585343702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04800039c0 0x7f0480003de0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f048c00c270 tx=0x7f048c01cca0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.170+0000 7f049be00640 1 -- 172.21.15.37:0/2585343702 reap_dead start 2024-05-30T06:58:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.170+0000 7f04a2200640 1 -- 172.21.15.37:0/2585343702 shutdown_connections 2024-05-30T06:58:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.170+0000 7f04a2200640 1 -- 172.21.15.37:0/2585343702 >> 172.21.15.37:0/2585343702 conn(0x7f049c0b2ac0 msgr2=0x7f049c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.170+0000 7f04a2200640 1 -- 172.21.15.37:0/2585343702 shutdown_connections 2024-05-30T06:58:53.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.170+0000 7f04a2200640 1 -- 172.21.15.37:0/2585343702 wait complete. 2024-05-30T06:58:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f04a2200640 1 Processor -- start 2024-05-30T06:58:53.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f04a2200640 1 -- start start 2024-05-30T06:58:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f04a2200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04800039c0 0x7f049c14b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f04a2200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f049c157410 0x7f049c160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f04a2200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f049c1605d0 0x7f049c15a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f04a2200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f049c06cda0 con 0x7f04800039c0 2024-05-30T06:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f04a2200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f049c06cc20 con 0x7f049c157410 2024-05-30T06:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f04a2200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f049c06cf20 con 0x7f049c1605d0 2024-05-30T06:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f049b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04800039c0 0x7f049c14b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f049b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04800039c0 0x7f049c14b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58648/0 (socket says 172.21.15.37:58648) 2024-05-30T06:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f049b400640 1 -- 172.21.15.37:0/3581560352 learned_addr learned my addr 172.21.15.37:0/3581560352 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f049be00640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f049c1605d0 0x7f049c15a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f0492a00640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f049c157410 0x7f049c160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f049b400640 1 -- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f049c1605d0 msgr2=0x7f049c15a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f049b400640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f049c1605d0 0x7f049c15a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f049b400640 1 -- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f049c157410 msgr2=0x7f049c160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f049b400640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f049c157410 0x7f049c160090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f049b400640 1 -- 172.21.15.37:0/3581560352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c1578b0 con 0x7f04800039c0 2024-05-30T06:58:53.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f0492a00640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f049c157410 0x7f049c160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:58:53.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f049b400640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04800039c0 0x7f049c14b4c0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f048c007040 tx=0x7f0480005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:53.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f0493e00640 1 -- 172.21.15.37:0/3581560352 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c001c80 con 0x7f04800039c0 2024-05-30T06:58:53.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f0493e00640 1 -- 172.21.15.37:0/3581560352 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c0072f0 con 0x7f04800039c0 2024-05-30T06:58:53.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f04a2200640 1 -- 172.21.15.37:0/3581560352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049c157b90 con 0x7f04800039c0 2024-05-30T06:58:53.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f0493e00640 1 -- 172.21.15.37:0/3581560352 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c0076e0 con 0x7f04800039c0 2024-05-30T06:58:53.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f04a2200640 1 -- 172.21.15.37:0/3581560352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049c158150 con 0x7f04800039c0 2024-05-30T06:58:53.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.174+0000 7f04a2200640 1 -- 172.21.15.37:0/3581560352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f049c068bc0 con 0x7f04800039c0 2024-05-30T06:58:53.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.178+0000 7f0493e00640 1 -- 172.21.15.37:0/3581560352 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f048c0a56a0 con 0x7f04800039c0 2024-05-30T06:58:53.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.178+0000 7f0493e00640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f047806a060 0x7f047806c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.178+0000 7f0493e00640 1 -- 172.21.15.37:0/3581560352 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7f048c11f2a0 con 0x7f04800039c0 2024-05-30T06:58:53.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.178+0000 7f0492a00640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f047806a060 0x7f047806c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.178+0000 7f0492a00640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f047806a060 0x7f047806c520 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f049c161920 tx=0x7f0484008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:53.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.182+0000 7f0493e00640 1 -- 172.21.15.37:0/3581560352 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f048c0169b0 con 0x7f04800039c0 2024-05-30T06:58:53.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.346+0000 7f04a2200640 1 -- 172.21.15.37:0/3581560352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f049c067d90 con 0x7f04800039c0 2024-05-30T06:58:53.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.346+0000 7f0493e00640 1 -- 172.21.15.37:0/3581560352 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) ==== 104+0+11 (secure 0 0 0) 0x7f048c0f1230 con 0x7f04800039c0 2024-05-30T06:58:53.347 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T06:58:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.350+0000 7f04a2200640 1 -- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f047806a060 msgr2=0x7f047806c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.350+0000 7f04a2200640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f047806a060 0x7f047806c520 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f049c161920 tx=0x7f0484008040 comp rx=0 tx=0).stop 2024-05-30T06:58:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.350+0000 7f04a2200640 1 -- 172.21.15.37:0/3581560352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04800039c0 msgr2=0x7f049c14b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.350+0000 7f04a2200640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04800039c0 0x7f049c14b4c0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f048c007040 tx=0x7f0480005840 comp rx=0 tx=0).stop 2024-05-30T06:58:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.350+0000 7f04a2200640 1 -- 172.21.15.37:0/3581560352 shutdown_connections 2024-05-30T06:58:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.350+0000 7f04a2200640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f049c1605d0 0x7f049c15a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.350+0000 7f04a2200640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f047806a060 0x7f047806c520 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.350+0000 7f04a2200640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f049c157410 0x7f049c160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.350+0000 7f04a2200640 1 --2- 172.21.15.37:0/3581560352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04800039c0 0x7f049c14b4c0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.350+0000 7f04a2200640 1 -- 172.21.15.37:0/3581560352 >> 172.21.15.37:0/3581560352 conn(0x7f049c0b2ac0 msgr2=0x7f049c15deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.350+0000 7f04a2200640 1 -- 172.21.15.37:0/3581560352 shutdown_connections 2024-05-30T06:58:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.350+0000 7f04a2200640 1 -- 172.21.15.37:0/3581560352 wait complete. 2024-05-30T06:58:53.369 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T06:58:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f88a00640 1 Processor -- start 2024-05-30T06:58:53.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f88a00640 1 -- start start 2024-05-30T06:58:53.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f88a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f8415f210 0x7f1f84072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f88a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f840cec10 0x7f1f84072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f88a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f84163020 con 0x7f1f8415c890 2024-05-30T06:58:53.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f88a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1f84163300 con 0x7f1f8415f210 2024-05-30T06:58:53.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f88a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1f841635e0 con 0x7f1f840cec10 2024-05-30T06:58:53.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f7be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f8415f210 0x7f1f84072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f7be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1f8415f210 0x7f1f84072750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58650/0 (socket says 172.21.15.37:58650) 2024-05-30T06:58:53.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f7be00640 1 -- 172.21.15.37:0/2827335621 learned_addr learned my addr 172.21.15.37:0/2827335621 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:53.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f82800640 1 --2- 172.21.15.37:0/2827335621 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f840cec10 0x7f1f84072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f7be00640 1 -- 172.21.15.37:0/2827335621 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f840cec10 msgr2=0x7f1f84072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:53.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f7be00640 1 --2- 172.21.15.37:0/2827335621 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f840cec10 0x7f1f84072c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f7be00640 1 -- 172.21.15.37:0/2827335621 >> v1:172.21.15.105:6789/0 conn(0x7f1f8415c890 legacy=0x7f1f84162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.514+0000 7f1f7be00640 1 -- 172.21.15.37:0/2827335621 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8406ba00 con 0x7f1f8415f210 2024-05-30T06:58:53.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f7be00640 1 --2- 172.21.15.37:0/2827335621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8415f210 0x7f1f84072750 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009870 tx=0x7f1f6c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8200f7601319a59 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:53.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f81400640 1 -- 172.21.15.37:0/2827335621 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0b0070 con 0x7f1f8415f210 2024-05-30T06:58:53.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f81400640 1 -- 172.21.15.37:0/2827335621 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6c0ab600 con 0x7f1f8415f210 2024-05-30T06:58:53.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f81400640 1 -- 172.21.15.37:0/2827335621 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0ab9d0 con 0x7f1f8415f210 2024-05-30T06:58:53.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f88a00640 1 -- 172.21.15.37:0/2827335621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8415f210 msgr2=0x7f1f84072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f88a00640 1 --2- 172.21.15.37:0/2827335621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8415f210 0x7f1f84072750 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009870 tx=0x7f1f6c01c4d0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f88a00640 1 -- 172.21.15.37:0/2827335621 shutdown_connections 2024-05-30T06:58:53.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f88a00640 1 --2- 172.21.15.37:0/2827335621 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f840cec10 0x7f1f84072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f88a00640 1 --2- 172.21.15.37:0/2827335621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8415f210 0x7f1f84072750 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f88a00640 1 -- 172.21.15.37:0/2827335621 >> 172.21.15.37:0/2827335621 conn(0x7f1f840b2ac0 msgr2=0x7f1f840b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:53.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f88a00640 1 -- 172.21.15.37:0/2827335621 shutdown_connections 2024-05-30T06:58:53.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f88a00640 1 -- 172.21.15.37:0/2827335621 wait complete. 2024-05-30T06:58:53.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f88a00640 1 Processor -- start 2024-05-30T06:58:53.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.518+0000 7f1f88a00640 1 -- start start 2024-05-30T06:58:53.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f88a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f840cec10 0x7f1f841544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f88a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8415c890 0x7f1f84158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f88a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f8415f210 0x7f1f841616b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f88a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8406cde0 con 0x7f1f8415c890 2024-05-30T06:58:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f88a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8406cc60 con 0x7f1f8415f210 2024-05-30T06:58:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f88a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8406cf60 con 0x7f1f840cec10 2024-05-30T06:58:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f7be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8415c890 0x7f1f84158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f7be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8415c890 0x7f1f84158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58658/0 (socket says 172.21.15.37:58658) 2024-05-30T06:58:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f7be00640 1 -- 172.21.15.37:0/3800002809 learned_addr learned my addr 172.21.15.37:0/3800002809 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f81e00640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f840cec10 0x7f1f841544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f82800640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f8415f210 0x7f1f841616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f7be00640 1 -- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f840cec10 msgr2=0x7f1f841544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f7be00640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f840cec10 0x7f1f841544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f7be00640 1 -- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f8415f210 msgr2=0x7f1f841616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f7be00640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f8415f210 0x7f1f841616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f7be00640 1 -- 172.21.15.37:0/3800002809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f841581b0 con 0x7f1f8415c890 2024-05-30T06:58:53.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f7be00640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8415c890 0x7f1f84158ee0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c01ab80 tx=0x7f1f6c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f7a000640 1 -- 172.21.15.37:0/3800002809 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0ba020 con 0x7f1f8415c890 2024-05-30T06:58:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f7a000640 1 -- 172.21.15.37:0/3800002809 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6c0aa7d0 con 0x7f1f8415c890 2024-05-30T06:58:53.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f88a00640 1 -- 172.21.15.37:0/3800002809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f84158450 con 0x7f1f8415c890 2024-05-30T06:58:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f7a000640 1 -- 172.21.15.37:0/3800002809 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0b0040 con 0x7f1f8415c890 2024-05-30T06:58:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f88a00640 1 -- 172.21.15.37:0/3800002809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f840b2f40 con 0x7f1f8415c890 2024-05-30T06:58:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.522+0000 7f1f88a00640 1 -- 172.21.15.37:0/3800002809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f84068bc0 con 0x7f1f8415c890 2024-05-30T06:58:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.526+0000 7f1f7a000640 1 -- 172.21.15.37:0/3800002809 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f1f6c0bd020 con 0x7f1f8415c890 2024-05-30T06:58:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.526+0000 7f1f7a000640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1f6006a030 0x7f1f6006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.526+0000 7f1f7a000640 1 -- 172.21.15.37:0/3800002809 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7f1f6c11fe10 con 0x7f1f8415c890 2024-05-30T06:58:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.526+0000 7f1f81e00640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1f6006a030 0x7f1f6006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.526+0000 7f1f81e00640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1f6006a030 0x7f1f6006c4f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1f840d0af0 tx=0x7f1f74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.530+0000 7f1f7a000640 1 -- 172.21.15.37:0/3800002809 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f6c0c4030 con 0x7f1f8415c890 2024-05-30T06:58:53.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.694+0000 7f1f88a00640 1 -- 172.21.15.37:0/3800002809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1f840afdc0 con 0x7f1f8415c890 2024-05-30T06:58:53.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.698+0000 7f1f7a000640 1 -- 172.21.15.37:0/3800002809 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) ==== 100+0+11 (secure 0 0 0) 0x7f1f6c016150 con 0x7f1f8415c890 2024-05-30T06:58:53.697 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T06:58:53.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.698+0000 7f1f88a00640 1 -- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1f6006a030 msgr2=0x7f1f6006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.698+0000 7f1f88a00640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1f6006a030 0x7f1f6006c4f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1f840d0af0 tx=0x7f1f74009040 comp rx=0 tx=0).stop 2024-05-30T06:58:53.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.698+0000 7f1f88a00640 1 -- 172.21.15.37:0/3800002809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8415c890 msgr2=0x7f1f84158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.698+0000 7f1f88a00640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8415c890 0x7f1f84158ee0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c01ab80 tx=0x7f1f6c019270 comp rx=0 tx=0).stop 2024-05-30T06:58:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.698+0000 7f1f88a00640 1 -- 172.21.15.37:0/3800002809 shutdown_connections 2024-05-30T06:58:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.698+0000 7f1f88a00640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f1f6006a030 0x7f1f6006c4f0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.698+0000 7f1f88a00640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f8415f210 0x7f1f841616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.698+0000 7f1f88a00640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8415c890 0x7f1f84158ee0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.698+0000 7f1f88a00640 1 --2- 172.21.15.37:0/3800002809 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f840cec10 0x7f1f841544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.698+0000 7f1f88a00640 1 -- 172.21.15.37:0/3800002809 >> 172.21.15.37:0/3800002809 conn(0x7f1f840b2ac0 msgr2=0x7f1f840cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.698+0000 7f1f88a00640 1 -- 172.21.15.37:0/3800002809 shutdown_connections 2024-05-30T06:58:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.698+0000 7f1f88a00640 1 -- 172.21.15.37:0/3800002809 wait complete. 2024-05-30T06:58:53.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:58:53.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.858+0000 7f367ba00640 1 Processor -- start 2024-05-30T06:58:53.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.862+0000 7f367ba00640 1 -- start start 2024-05-30T06:58:53.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.862+0000 7f367ba00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f367406b960 0x7f367415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.862+0000 7f367ba00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3674160580 con 0x7f36740b3a90 2024-05-30T06:58:53.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.862+0000 7f367ba00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3674160860 con 0x7f36740cd2a0 2024-05-30T06:58:53.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.862+0000 7f367ba00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3674160b40 con 0x7f367406b960 2024-05-30T06:58:53.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.862+0000 7f3679a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f36740b3a90 0x7f36740d0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56130/0 (socket says 172.21.15.37:56130) 2024-05-30T06:58:53.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.862+0000 7f3679a00640 1 -- 172.21.15.37:0/3764568100 learned_addr learned my addr 172.21.15.37:0/3764568100 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:53.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.862+0000 7f3679000640 1 --2- 172.21.15.37:0/3764568100 >> v2:172.21.15.105:3300/0 conn(0x7f367406b960 0x7f367415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.862+0000 7f3673e00640 1 -- 172.21.15.37:0/3764568100 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2096964557 0 0) 0x7f3674160580 con 0x7f36740b3a90 2024-05-30T06:58:53.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.862+0000 7f3673e00640 1 -- 172.21.15.37:0/3764568100 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3658003530 con 0x7f36740b3a90 2024-05-30T06:58:53.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.862+0000 7f3679000640 1 -- 172.21.15.37:0/3764568100 >> v1:172.21.15.105:6789/0 conn(0x7f36740cd2a0 legacy=0x7f367406bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.862+0000 7f3679000640 1 -- 172.21.15.37:0/3764568100 >> v1:172.21.15.37:6789/0 conn(0x7f36740b3a90 legacy=0x7f36740d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.862+0000 7f3679000640 1 -- 172.21.15.37:0/3764568100 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3674160e20 con 0x7f367406b960 2024-05-30T06:58:53.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.866+0000 7f3679000640 1 --2- 172.21.15.37:0/3764568100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f367406b960 0x7f367415cdf0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f36640097c0 tx=0x7f366401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bd1d7798bec25de server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:53.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.866+0000 7f3673e00640 1 -- 172.21.15.37:0/3764568100 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640aa5f0 con 0x7f367406b960 2024-05-30T06:58:53.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.866+0000 7f3673e00640 1 -- 172.21.15.37:0/3764568100 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36640af070 con 0x7f367406b960 2024-05-30T06:58:53.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.866+0000 7f3673e00640 1 -- 172.21.15.37:0/3764568100 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640aa9b0 con 0x7f367406b960 2024-05-30T06:58:53.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.866+0000 7f367ba00640 1 -- 172.21.15.37:0/3764568100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f367406b960 msgr2=0x7f367415cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.866+0000 7f367ba00640 1 --2- 172.21.15.37:0/3764568100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f367406b960 0x7f367415cdf0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f36640097c0 tx=0x7f366401c470 comp rx=0 tx=0).stop 2024-05-30T06:58:53.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.866+0000 7f367ba00640 1 -- 172.21.15.37:0/3764568100 shutdown_connections 2024-05-30T06:58:53.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.866+0000 7f367ba00640 1 --2- 172.21.15.37:0/3764568100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f367406b960 0x7f367415cdf0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.866+0000 7f367ba00640 1 -- 172.21.15.37:0/3764568100 >> 172.21.15.37:0/3764568100 conn(0x7f367409aa60 msgr2=0x7f36740b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:53.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f367ba00640 1 -- 172.21.15.37:0/3764568100 shutdown_connections 2024-05-30T06:58:53.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f367ba00640 1 -- 172.21.15.37:0/3764568100 wait complete. 2024-05-30T06:58:53.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f367ba00640 1 Processor -- start 2024-05-30T06:58:53.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f367ba00640 1 -- start start 2024-05-30T06:58:53.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f367ba00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367406b960 0x7f36740b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f367ba00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36740b3a90 0x7f3674158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f367ba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36740cd2a0 0x7f3674151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f367ba00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f367416a910 con 0x7f367406b960 2024-05-30T06:58:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f367ba00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f367416a790 con 0x7f36740b3a90 2024-05-30T06:58:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f367ba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f367416aa90 con 0x7f36740cd2a0 2024-05-30T06:58:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f3679000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367406b960 0x7f36740b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f3679000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367406b960 0x7f36740b6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58672/0 (socket says 172.21.15.37:58672) 2024-05-30T06:58:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f3679000640 1 -- 172.21.15.37:0/2321003523 learned_addr learned my addr 172.21.15.37:0/2321003523 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f366be00640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36740b3a90 0x7f3674158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f3679a00640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36740cd2a0 0x7f3674151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f3679000640 1 -- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36740cd2a0 msgr2=0x7f3674151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f3679000640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36740cd2a0 0x7f3674151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f3679000640 1 -- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36740b3a90 msgr2=0x7f3674158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:53.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f3679000640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36740b3a90 0x7f3674158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:53.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f3679000640 1 -- 172.21.15.37:0/2321003523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36740b71f0 con 0x7f367406b960 2024-05-30T06:58:53.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f3679000640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367406b960 0x7f36740b6cb0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f36640097c0 tx=0x7f366401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:53.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f3671600640 1 -- 172.21.15.37:0/2321003523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640be410 con 0x7f367406b960 2024-05-30T06:58:53.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f3671600640 1 -- 172.21.15.37:0/2321003523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36640be5d0 con 0x7f367406b960 2024-05-30T06:58:53.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f367ba00640 1 -- 172.21.15.37:0/2321003523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36740c85f0 con 0x7f367406b960 2024-05-30T06:58:53.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f3671600640 1 -- 172.21.15.37:0/2321003523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640be9c0 con 0x7f367406b960 2024-05-30T06:58:53.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.870+0000 7f367ba00640 1 -- 172.21.15.37:0/2321003523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36740b2cc0 con 0x7f367406b960 2024-05-30T06:58:53.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.874+0000 7f367ba00640 1 -- 172.21.15.37:0/2321003523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3674068b20 con 0x7f367406b960 2024-05-30T06:58:53.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.874+0000 7f3671600640 1 -- 172.21.15.37:0/2321003523 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f36640bc020 con 0x7f367406b960 2024-05-30T06:58:53.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.874+0000 7f3671600640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f365006a030 0x7f365006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:53.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.874+0000 7f3671600640 1 -- 172.21.15.37:0/2321003523 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7f366411fd20 con 0x7f367406b960 2024-05-30T06:58:53.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.874+0000 7f366be00640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f365006a030 0x7f365006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:53.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.874+0000 7f366be00640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f365006a030 0x7f365006c4f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3674156a70 tx=0x7f365c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:53.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:53.878+0000 7f3671600640 1 -- 172.21.15.37:0/2321003523 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3664016090 con 0x7f367406b960 2024-05-30T06:58:54.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.078+0000 7f367ba00640 1 -- 172.21.15.37:0/2321003523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f367406c490 con 0x7f367406b960 2024-05-30T06:58:54.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.078+0000 7f3671600640 1 -- 172.21.15.37:0/2321003523 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5189 (secure 0 0 0) 0x7f36640f1de0 con 0x7f367406b960 2024-05-30T06:58:54.081 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:54.081 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3908783351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3908783351},{"type":"v1","addr":"172.21.15.105:6836","nonce":3908783351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":8473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2654517585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2654517585},{"type":"v1","addr":"172.21.15.105:6837","nonce":2654517585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":9117,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3433994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3433994777},{"type":"v1","addr":"172.21.15.37:6833","nonce":3433994777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:57:18.453221+0000","modified":"2024-05-30T06:57:21.469705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9120":{"gid":9120,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1475971506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1475971506},{"type":"v1","addr":"172.21.15.37:6835","nonce":1475971506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9120,"qdb_cluster":[9120]},"id":8}]} 2024-05-30T06:58:54.081 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 75 2024-05-30T06:58:54.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.082+0000 7f367ba00640 1 -- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f365006a030 msgr2=0x7f365006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.082+0000 7f367ba00640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f365006a030 0x7f365006c4f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3674156a70 tx=0x7f365c009040 comp rx=0 tx=0).stop 2024-05-30T06:58:54.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.082+0000 7f367ba00640 1 -- 172.21.15.37:0/2321003523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367406b960 msgr2=0x7f36740b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.082+0000 7f367ba00640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367406b960 0x7f36740b6cb0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f36640097c0 tx=0x7f366401acb0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.082+0000 7f367ba00640 1 -- 172.21.15.37:0/2321003523 shutdown_connections 2024-05-30T06:58:54.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.082+0000 7f367ba00640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36740cd2a0 0x7f3674151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.082+0000 7f367ba00640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f365006a030 0x7f365006c4f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.082+0000 7f367ba00640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f36740b3a90 0x7f3674158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.082+0000 7f367ba00640 1 --2- 172.21.15.37:0/2321003523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367406b960 0x7f36740b6cb0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.082+0000 7f367ba00640 1 -- 172.21.15.37:0/2321003523 >> 172.21.15.37:0/2321003523 conn(0x7f367409aa60 msgr2=0x7f367415c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:54.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.082+0000 7f367ba00640 1 -- 172.21.15.37:0/2321003523 shutdown_connections 2024-05-30T06:58:54.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.082+0000 7f367ba00640 1 -- 172.21.15.37:0/2321003523 wait complete. 2024-05-30T06:58:54.102 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:58:54.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.246+0000 7f3d87400640 1 Processor -- start 2024-05-30T06:58:54.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.246+0000 7f3d87400640 1 -- start start 2024-05-30T06:58:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.250+0000 7f3d87400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3d80160b90 0x7f3d8009aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.250+0000 7f3d87400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d80161020 0x7f3d8009afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.250+0000 7f3d87400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d800d0430 con 0x7f3d800b2e20 2024-05-30T06:58:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.250+0000 7f3d87400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3d800b3200 con 0x7f3d80161020 2024-05-30T06:58:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.250+0000 7f3d87400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3d800d01e0 con 0x7f3d80160b90 2024-05-30T06:58:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.250+0000 7f3d85400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d80161020 0x7f3d8009afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.250+0000 7f3d85400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d80161020 0x7f3d8009afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58684/0 (socket says 172.21.15.37:58684) 2024-05-30T06:58:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.250+0000 7f3d85400640 1 -- 172.21.15.37:0/1041525217 learned_addr learned my addr 172.21.15.37:0/1041525217 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.250+0000 7f3d77e00640 1 --2- 172.21.15.37:0/1041525217 >> v2:172.21.15.105:3300/0 conn(0x7f3d80160b90 0x7f3d8009aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.250+0000 7f3d85400640 1 -- 172.21.15.37:0/1041525217 >> v2:172.21.15.105:3300/0 conn(0x7f3d80160b90 msgr2=0x7f3d8009aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:54.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.250+0000 7f3d85400640 1 --2- 172.21.15.37:0/1041525217 >> v2:172.21.15.105:3300/0 conn(0x7f3d80160b90 0x7f3d8009aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.250+0000 7f3d85400640 1 -- 172.21.15.37:0/1041525217 >> v1:172.21.15.105:6789/0 conn(0x7f3d800b2e20 legacy=0x7f3d80160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.250+0000 7f3d85400640 1 -- 172.21.15.37:0/1041525217 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d800d0710 con 0x7f3d80161020 2024-05-30T06:58:54.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d85400640 1 --2- 172.21.15.37:0/1041525217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d80161020 0x7f3d8009afa0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f3d800c5fe0 tx=0x7f3d7801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3493e63ee193848 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:54.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d7fe00640 1 -- 172.21.15.37:0/1041525217 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d780a57a0 con 0x7f3d80161020 2024-05-30T06:58:54.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d7fe00640 1 -- 172.21.15.37:0/1041525217 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d780a5940 con 0x7f3d80161020 2024-05-30T06:58:54.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d7fe00640 1 -- 172.21.15.37:0/1041525217 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d780a5d10 con 0x7f3d80161020 2024-05-30T06:58:54.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 -- 172.21.15.37:0/1041525217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d80161020 msgr2=0x7f3d8009afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 --2- 172.21.15.37:0/1041525217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d80161020 0x7f3d8009afa0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f3d800c5fe0 tx=0x7f3d7801c9f0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 -- 172.21.15.37:0/1041525217 shutdown_connections 2024-05-30T06:58:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 --2- 172.21.15.37:0/1041525217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d80161020 0x7f3d8009afa0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 --2- 172.21.15.37:0/1041525217 >> v2:172.21.15.105:3300/0 conn(0x7f3d80160b90 0x7f3d8009aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 -- 172.21.15.37:0/1041525217 >> 172.21.15.37:0/1041525217 conn(0x7f3d800b4100 msgr2=0x7f3d800b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 -- 172.21.15.37:0/1041525217 shutdown_connections 2024-05-30T06:58:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 -- 172.21.15.37:0/1041525217 wait complete. 2024-05-30T06:58:54.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 Processor -- start 2024-05-30T06:58:54.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 -- start start 2024-05-30T06:58:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d800b2e20 0x7f3d8006e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d80160b90 0x7f3d80154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d80161020 0x7f3d8006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d800ce410 con 0x7f3d800b2e20 2024-05-30T06:58:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3d800ce290 con 0x7f3d80160b90 2024-05-30T06:58:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.254+0000 7f3d87400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3d801697c0 con 0x7f3d80161020 2024-05-30T06:58:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d84a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d800b2e20 0x7f3d8006e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d84a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d800b2e20 0x7f3d8006e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58698/0 (socket says 172.21.15.37:58698) 2024-05-30T06:58:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d84a00640 1 -- 172.21.15.37:0/1260706882 learned_addr learned my addr 172.21.15.37:0/1260706882 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d77e00640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d80160b90 0x7f3d80154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d85400640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d80161020 0x7f3d8006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d84a00640 1 -- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d80161020 msgr2=0x7f3d8006ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d84a00640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d80161020 0x7f3d8006ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d84a00640 1 -- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d80160b90 msgr2=0x7f3d80154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d84a00640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d80160b90 0x7f3d80154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d84a00640 1 -- 172.21.15.37:0/1260706882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8006d530 con 0x7f3d800b2e20 2024-05-30T06:58:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d77e00640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d80160b90 0x7f3d80154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:54.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d84a00640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d800b2e20 0x7f3d8006e5d0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000c3a0 tx=0x7f3d7000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d7d600640 1 -- 172.21.15.37:0/1260706882 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d700052d0 con 0x7f3d800b2e20 2024-05-30T06:58:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d7d600640 1 -- 172.21.15.37:0/1260706882 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d70005470 con 0x7f3d800b2e20 2024-05-30T06:58:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d7d600640 1 -- 172.21.15.37:0/1260706882 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70007260 con 0x7f3d800b2e20 2024-05-30T06:58:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d87400640 1 -- 172.21.15.37:0/1260706882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8006d810 con 0x7f3d800b2e20 2024-05-30T06:58:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d87400640 1 -- 172.21.15.37:0/1260706882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8006ddd0 con 0x7f3d800b2e20 2024-05-30T06:58:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d87400640 1 -- 172.21.15.37:0/1260706882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d80068b20 con 0x7f3d800b2e20 2024-05-30T06:58:54.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.258+0000 7f3d7d600640 1 -- 172.21.15.37:0/1260706882 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f3d70007400 con 0x7f3d800b2e20 2024-05-30T06:58:54.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.262+0000 7f3d7d600640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d5c06a030 0x7f3d5c06c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.262+0000 7f3d7d600640 1 -- 172.21.15.37:0/1260706882 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7f3d70084d00 con 0x7f3d800b2e20 2024-05-30T06:58:54.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.262+0000 7f3d77e00640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d5c06a030 0x7f3d5c06c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.262+0000 7f3d77e00640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d5c06a030 0x7f3d5c06c4f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3d800a0680 tx=0x7f3d68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:54.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.266+0000 7f3d7d600640 1 -- 172.21.15.37:0/1260706882 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d70056750 con 0x7f3d800b2e20 2024-05-30T06:58:54.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.426+0000 7f3d87400640 1 -- 172.21.15.37:0/1260706882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d800ce860 con 0x7f3d800b2e20 2024-05-30T06:58:54.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.430+0000 7f3d7d600640 1 -- 172.21.15.37:0/1260706882 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16968 (secure 0 0 0) 0x7f3d7005aa50 con 0x7f3d800b2e20 2024-05-30T06:58:54.430 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:54.430 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":117,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:58:49.820117+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:57:16.849268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-05-30T06:57:17.405807+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.5","mappings":[{"from":0,"to":2}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:58:54.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.430+0000 7f3d87400640 1 -- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d5c06a030 msgr2=0x7f3d5c06c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.430+0000 7f3d87400640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d5c06a030 0x7f3d5c06c4f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3d800a0680 tx=0x7f3d68008040 comp rx=0 tx=0).stop 2024-05-30T06:58:54.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.430+0000 7f3d87400640 1 -- 172.21.15.37:0/1260706882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d800b2e20 msgr2=0x7f3d8006e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.430+0000 7f3d87400640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d800b2e20 0x7f3d8006e5d0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000c3a0 tx=0x7f3d7000c860 comp rx=0 tx=0).stop 2024-05-30T06:58:54.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.430+0000 7f3d87400640 1 -- 172.21.15.37:0/1260706882 shutdown_connections 2024-05-30T06:58:54.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.430+0000 7f3d87400640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d80161020 0x7f3d8006ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.430+0000 7f3d87400640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3d5c06a030 0x7f3d5c06c4f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.430+0000 7f3d87400640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d80160b90 0x7f3d80154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.430+0000 7f3d87400640 1 --2- 172.21.15.37:0/1260706882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d800b2e20 0x7f3d8006e5d0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.430+0000 7f3d87400640 1 -- 172.21.15.37:0/1260706882 >> 172.21.15.37:0/1260706882 conn(0x7f3d800b4100 msgr2=0x7f3d80074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:54.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.430+0000 7f3d87400640 1 -- 172.21.15.37:0/1260706882 shutdown_connections 2024-05-30T06:58:54.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.430+0000 7f3d87400640 1 -- 172.21.15.37:0/1260706882 wait complete. 2024-05-30T06:58:54.452 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T06:58:54.452 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:58:54.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.594+0000 7faba9600640 1 Processor -- start 2024-05-30T06:58:54.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.594+0000 7faba9600640 1 -- start start 2024-05-30T06:58:54.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.594+0000 7faba9600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faba406f870 0x7faba406fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.594+0000 7faba9600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba40b6680 con 0x7faba40ae330 2024-05-30T06:58:54.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.594+0000 7faba9600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba41478f0 con 0x7faba4147510 2024-05-30T06:58:54.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.594+0000 7faba9600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7faba406f3e0 con 0x7faba406f870 2024-05-30T06:58:54.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.594+0000 7fab9b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faba406f870 0x7faba406fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.594+0000 7faba8c00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faba40ae330 0x7faba406b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56142/0 (socket says 172.21.15.37:56142) 2024-05-30T06:58:54.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.594+0000 7fab9b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faba406f870 0x7faba406fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58714/0 (socket says 172.21.15.37:58714) 2024-05-30T06:58:54.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.594+0000 7faba8c00640 1 -- 172.21.15.37:0/2126813026 learned_addr learned my addr 172.21.15.37:0/2126813026 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:54.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.594+0000 7fab9b400640 1 -- 172.21.15.37:0/2126813026 >> v1:172.21.15.105:6789/0 conn(0x7faba4147510 legacy=0x7faba40708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.594+0000 7fab9b400640 1 -- 172.21.15.37:0/2126813026 >> v1:172.21.15.37:6789/0 conn(0x7faba40ae330 legacy=0x7faba406b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.594+0000 7fab9b400640 1 -- 172.21.15.37:0/2126813026 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba40b60e0 con 0x7faba406f870 2024-05-30T06:58:54.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.598+0000 7fab9b400640 1 --2- 172.21.15.37:0/2126813026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba406f870 0x7faba406fc50 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009d90 tx=0x7fab8c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957362fdbf04fc44 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:54.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.598+0000 7faba3400640 1 -- 172.21.15.37:0/2126813026 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0b2070 con 0x7faba406f870 2024-05-30T06:58:54.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.598+0000 7faba3400640 1 -- 172.21.15.37:0/2126813026 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8c0a5920 con 0x7faba406f870 2024-05-30T06:58:54.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.598+0000 7faba3400640 1 -- 172.21.15.37:0/2126813026 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0a5cf0 con 0x7faba406f870 2024-05-30T06:58:54.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.598+0000 7faba9600640 1 -- 172.21.15.37:0/2126813026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba406f870 msgr2=0x7faba406fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.598+0000 7faba9600640 1 --2- 172.21.15.37:0/2126813026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba406f870 0x7faba406fc50 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009d90 tx=0x7fab8c01c970 comp rx=0 tx=0).stop 2024-05-30T06:58:54.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.598+0000 7faba9600640 1 -- 172.21.15.37:0/2126813026 shutdown_connections 2024-05-30T06:58:54.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.598+0000 7faba9600640 1 --2- 172.21.15.37:0/2126813026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba406f870 0x7faba406fc50 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.598+0000 7faba9600640 1 -- 172.21.15.37:0/2126813026 >> 172.21.15.37:0/2126813026 conn(0x7faba409aa60 msgr2=0x7faba40b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:54.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.598+0000 7faba9600640 1 -- 172.21.15.37:0/2126813026 shutdown_connections 2024-05-30T06:58:54.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.598+0000 7faba9600640 1 -- 172.21.15.37:0/2126813026 wait complete. 2024-05-30T06:58:54.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.598+0000 7faba9600640 1 Processor -- start 2024-05-30T06:58:54.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.598+0000 7faba9600640 1 -- start start 2024-05-30T06:58:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba9600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faba406f870 0x7faba40af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba40ae330 0x7faba40b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba9600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faba4147510 0x7faba415cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba9600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faba40b5db0 con 0x7faba40ae330 2024-05-30T06:58:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba9600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faba40b45e0 con 0x7faba4147510 2024-05-30T06:58:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba9600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faba406c070 con 0x7faba406f870 2024-05-30T06:58:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7fab9b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba40ae330 0x7faba40b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7fab9b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba40ae330 0x7faba40b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58720/0 (socket says 172.21.15.37:58720) 2024-05-30T06:58:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7fab9b400640 1 -- 172.21.15.37:0/2485997103 learned_addr learned my addr 172.21.15.37:0/2485997103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba8c00640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faba4147510 0x7faba415cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba3e00640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faba406f870 0x7faba40af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7fab9b400640 1 -- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faba406f870 msgr2=0x7faba40af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7fab9b400640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faba406f870 0x7faba40af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7fab9b400640 1 -- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faba4147510 msgr2=0x7faba415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7fab9b400640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faba4147510 0x7faba415cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7fab9b400640 1 -- 172.21.15.37:0/2485997103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba40ae8b0 con 0x7faba40ae330 2024-05-30T06:58:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba8c00640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faba4147510 0x7faba415cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7fab9b400640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba40ae330 0x7faba40b1c20 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0b0040 tx=0x7fab8c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba0c00640 1 -- 172.21.15.37:0/2485997103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0b2050 con 0x7faba40ae330 2024-05-30T06:58:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba0c00640 1 -- 172.21.15.37:0/2485997103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8c0be070 con 0x7faba40ae330 2024-05-30T06:58:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba0c00640 1 -- 172.21.15.37:0/2485997103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0adb90 con 0x7faba40ae330 2024-05-30T06:58:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba9600640 1 -- 172.21.15.37:0/2485997103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba40aeb90 con 0x7faba40ae330 2024-05-30T06:58:54.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba9600640 1 -- 172.21.15.37:0/2485997103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba40af150 con 0x7faba40ae330 2024-05-30T06:58:54.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.602+0000 7faba9600640 1 -- 172.21.15.37:0/2485997103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba4075580 con 0x7faba40ae330 2024-05-30T06:58:54.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.606+0000 7faba0c00640 1 -- 172.21.15.37:0/2485997103 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fab8c0c3460 con 0x7faba40ae330 2024-05-30T06:58:54.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.606+0000 7faba0c00640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fab8006a030 0x7fab8006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.606+0000 7faba0c00640 1 -- 172.21.15.37:0/2485997103 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7fab8c120ec0 con 0x7faba40ae330 2024-05-30T06:58:54.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.606+0000 7faba3e00640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fab8006a030 0x7fab8006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.606+0000 7faba3e00640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fab8006a030 0x7fab8006c4f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fab94000f70 tx=0x7fab94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:54.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.610+0000 7faba0c00640 1 -- 172.21.15.37:0/2485997103 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fab8c016560 con 0x7faba40ae330 2024-05-30T06:58:54.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.806+0000 7faba9600640 1 -- 172.21.15.37:0/2485997103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faba406c530 con 0x7faba40ae330 2024-05-30T06:58:54.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.810+0000 7faba0c00640 1 -- 172.21.15.37:0/2485997103 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5189 (secure 0 0 0) 0x7fab8c0f2f80 con 0x7faba40ae330 2024-05-30T06:58:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:54.809 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3908783351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3908783351},{"type":"v1","addr":"172.21.15.105:6836","nonce":3908783351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":8473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2654517585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2654517585},{"type":"v1","addr":"172.21.15.105:6837","nonce":2654517585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":9117,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3433994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3433994777},{"type":"v1","addr":"172.21.15.37:6833","nonce":3433994777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:57:18.453221+0000","modified":"2024-05-30T06:57:21.469705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9120":{"gid":9120,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1475971506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1475971506},{"type":"v1","addr":"172.21.15.37:6835","nonce":1475971506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9120,"qdb_cluster":[9120]},"id":8}]} 2024-05-30T06:58:54.810 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 75 2024-05-30T06:58:54.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.810+0000 7faba9600640 1 -- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fab8006a030 msgr2=0x7fab8006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.810+0000 7faba9600640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fab8006a030 0x7fab8006c4f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fab94000f70 tx=0x7fab94009040 comp rx=0 tx=0).stop 2024-05-30T06:58:54.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.810+0000 7faba9600640 1 -- 172.21.15.37:0/2485997103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba40ae330 msgr2=0x7faba40b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.810+0000 7faba9600640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba40ae330 0x7faba40b1c20 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0b0040 tx=0x7fab8c019710 comp rx=0 tx=0).stop 2024-05-30T06:58:54.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.810+0000 7faba9600640 1 -- 172.21.15.37:0/2485997103 shutdown_connections 2024-05-30T06:58:54.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.810+0000 7faba9600640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fab8006a030 0x7fab8006c4f0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.810+0000 7faba9600640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faba4147510 0x7faba415cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.810+0000 7faba9600640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba40ae330 0x7faba40b1c20 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.810+0000 7faba9600640 1 --2- 172.21.15.37:0/2485997103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faba406f870 0x7faba40af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.810+0000 7faba9600640 1 -- 172.21.15.37:0/2485997103 >> 172.21.15.37:0/2485997103 conn(0x7faba409aa60 msgr2=0x7faba409eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:54.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.810+0000 7faba9600640 1 -- 172.21.15.37:0/2485997103 shutdown_connections 2024-05-30T06:58:54.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.810+0000 7faba9600640 1 -- 172.21.15.37:0/2485997103 wait complete. 2024-05-30T06:58:54.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:58:54.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.970+0000 7fc789600640 1 Processor -- start 2024-05-30T06:58:54.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.970+0000 7fc789600640 1 -- start start 2024-05-30T06:58:54.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.970+0000 7fc789600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc78415ed50 0x7fc7840c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.970+0000 7fc789600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc78409aa60 0x7fc78409aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc789600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7840c7f20 con 0x7fc7840d02b0 2024-05-30T06:58:54.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc789600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc7840c9500 con 0x7fc78409aa60 2024-05-30T06:58:54.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc789600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc78415f130 con 0x7fc78415ed50 2024-05-30T06:58:54.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc77a000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc7840d02b0 0x7fc7840d0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56144/0 (socket says 172.21.15.37:56144) 2024-05-30T06:58:54.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc77a000640 1 -- 172.21.15.37:0/3576475150 learned_addr learned my addr 172.21.15.37:0/3576475150 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:54.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc782a00640 1 --2- 172.21.15.37:0/3576475150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc78415ed50 0x7fc7840c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc783400640 1 --2- 172.21.15.37:0/3576475150 >> v2:172.21.15.105:3300/0 conn(0x7fc78409aa60 0x7fc78409aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc782000640 1 -- 172.21.15.37:0/3576475150 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 62077135 0 0) 0x7fc7840c7f20 con 0x7fc7840d02b0 2024-05-30T06:58:54.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc782000640 1 -- 172.21.15.37:0/3576475150 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc768003530 con 0x7fc7840d02b0 2024-05-30T06:58:54.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc782000640 1 -- 172.21.15.37:0/3576475150 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2674698943 0 0) 0x7fc768003530 con 0x7fc7840d02b0 2024-05-30T06:58:54.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc782a00640 1 -- 172.21.15.37:0/3576475150 >> v2:172.21.15.105:3300/0 conn(0x7fc78409aa60 msgr2=0x7fc78409aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:54.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc782a00640 1 --2- 172.21.15.37:0/3576475150 >> v2:172.21.15.105:3300/0 conn(0x7fc78409aa60 0x7fc78409aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc782a00640 1 -- 172.21.15.37:0/3576475150 >> v1:172.21.15.37:6789/0 conn(0x7fc7840d02b0 legacy=0x7fc7840d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.974+0000 7fc782a00640 1 -- 172.21.15.37:0/3576475150 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7840c8200 con 0x7fc78415ed50 2024-05-30T06:58:54.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc782a00640 1 --2- 172.21.15.37:0/3576475150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc78415ed50 0x7fc7840c8fc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc7740097c0 tx=0x7fc77401c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70da02ff2e8f16b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc782000640 1 -- 172.21.15.37:0/3576475150 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7740b0070 con 0x7fc78415ed50 2024-05-30T06:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc782000640 1 -- 172.21.15.37:0/3576475150 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7740ab400 con 0x7fc78415ed50 2024-05-30T06:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc782000640 1 -- 172.21.15.37:0/3576475150 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c001680 con 0x7fc78415ed50 2024-05-30T06:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 -- 172.21.15.37:0/3576475150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc78415ed50 msgr2=0x7fc7840c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 --2- 172.21.15.37:0/3576475150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc78415ed50 0x7fc7840c8fc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc7740097c0 tx=0x7fc77401c390 comp rx=0 tx=0).stop 2024-05-30T06:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 -- 172.21.15.37:0/3576475150 shutdown_connections 2024-05-30T06:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 --2- 172.21.15.37:0/3576475150 >> v2:172.21.15.105:3300/0 conn(0x7fc78409aa60 0x7fc78409aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 --2- 172.21.15.37:0/3576475150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc78415ed50 0x7fc7840c8fc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 -- 172.21.15.37:0/3576475150 >> 172.21.15.37:0/3576475150 conn(0x7fc7840d26e0 msgr2=0x7fc7840d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:54.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 -- 172.21.15.37:0/3576475150 shutdown_connections 2024-05-30T06:58:54.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 -- 172.21.15.37:0/3576475150 wait complete. 2024-05-30T06:58:54.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 Processor -- start 2024-05-30T06:58:54.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 -- start start 2024-05-30T06:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc78409aa60 0x7fc784156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7840d02b0 0x7fc7840b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc78415ed50 0x7fc7841570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7840c7ad0 con 0x7fc7840d02b0 2024-05-30T06:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc7840d0e20 con 0x7fc78409aa60 2024-05-30T06:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc789600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc7840c7c50 con 0x7fc78415ed50 2024-05-30T06:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.978+0000 7fc77a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7840d02b0 0x7fc7840b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7840d02b0 0x7fc7840b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58732/0 (socket says 172.21.15.37:58732) 2024-05-30T06:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77a000640 1 -- 172.21.15.37:0/3707890906 learned_addr learned my addr 172.21.15.37:0/3707890906 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:54.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc783400640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc78415ed50 0x7fc7841570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc782a00640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc78409aa60 0x7fc784156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77a000640 1 -- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc78415ed50 msgr2=0x7fc7841570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77a000640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc78415ed50 0x7fc7841570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77a000640 1 -- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc78409aa60 msgr2=0x7fc784156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:54.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77a000640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc78409aa60 0x7fc784156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:54.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77a000640 1 -- 172.21.15.37:0/3707890906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78409e2c0 con 0x7fc7840d02b0 2024-05-30T06:58:54.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77a000640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7840d02b0 0x7fc7840b2d50 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0017f0 tx=0x7fc76c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:54.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77b400640 1 -- 172.21.15.37:0/3707890906 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c005ae0 con 0x7fc7840d02b0 2024-05-30T06:58:54.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77b400640 1 -- 172.21.15.37:0/3707890906 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76c005ca0 con 0x7fc7840d02b0 2024-05-30T06:58:54.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc789600640 1 -- 172.21.15.37:0/3707890906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc78409da20 con 0x7fc7840d02b0 2024-05-30T06:58:54.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77b400640 1 -- 172.21.15.37:0/3707890906 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0072b0 con 0x7fc7840d02b0 2024-05-30T06:58:54.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc789600640 1 -- 172.21.15.37:0/3707890906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc78409dfe0 con 0x7fc7840d02b0 2024-05-30T06:58:54.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc789600640 1 -- 172.21.15.37:0/3707890906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc784068b20 con 0x7fc7840d02b0 2024-05-30T06:58:54.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77b400640 1 -- 172.21.15.37:0/3707890906 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fc76c007450 con 0x7fc7840d02b0 2024-05-30T06:58:54.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77b400640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc76006a030 0x7fc76006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.982+0000 7fc77b400640 1 -- 172.21.15.37:0/3707890906 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7fc76c085740 con 0x7fc7840d02b0 2024-05-30T06:58:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.986+0000 7fc782a00640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc76006a030 0x7fc76006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.986+0000 7fc782a00640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc76006a030 0x7fc76006c4f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc7740ad000 tx=0x7fc7740a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:54.986+0000 7fc77b400640 1 -- 172.21.15.37:0/3707890906 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc76c010300 con 0x7fc7840d02b0 2024-05-30T06:58:55.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc789600640 1 -- 172.21.15.37:0/3707890906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7840d3420 con 0x7fc7840d02b0 2024-05-30T06:58:55.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc77b400640 1 -- 172.21.15.37:0/3707890906 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5189 (secure 0 0 0) 0x7fc76c057760 con 0x7fc7840d02b0 2024-05-30T06:58:55.194 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:55.194 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":75,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3908783351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3908783351},{"type":"v1","addr":"172.21.15.105:6836","nonce":3908783351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":8473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2654517585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2654517585},{"type":"v1","addr":"172.21.15.105:6837","nonce":2654517585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":9117,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3433994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3433994777},{"type":"v1","addr":"172.21.15.37:6833","nonce":3433994777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:57:18.453221+0000","modified":"2024-05-30T06:57:21.469705+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9120":{"gid":9120,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/1475971506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1475971506},{"type":"v1","addr":"172.21.15.37:6835","nonce":1475971506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9120,"qdb_cluster":[9120]},"id":8}]} 2024-05-30T06:58:55.195 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 75 2024-05-30T06:58:55.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc789600640 1 -- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc76006a030 msgr2=0x7fc76006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc789600640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc76006a030 0x7fc76006c4f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc7740ad000 tx=0x7fc7740a6000 comp rx=0 tx=0).stop 2024-05-30T06:58:55.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc789600640 1 -- 172.21.15.37:0/3707890906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7840d02b0 msgr2=0x7fc7840b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc789600640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7840d02b0 0x7fc7840b2d50 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0017f0 tx=0x7fc76c00cbe0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc789600640 1 -- 172.21.15.37:0/3707890906 shutdown_connections 2024-05-30T06:58:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc789600640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc78415ed50 0x7fc7841570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc789600640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7840d02b0 0x7fc7840b2d50 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc789600640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc76006a030 0x7fc76006c4f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc789600640 1 --2- 172.21.15.37:0/3707890906 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc78409aa60 0x7fc784156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc789600640 1 -- 172.21.15.37:0/3707890906 >> 172.21.15.37:0/3707890906 conn(0x7fc7840d26e0 msgr2=0x7fc7840b6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc789600640 1 -- 172.21.15.37:0/3707890906 shutdown_connections 2024-05-30T06:58:55.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.194+0000 7fc789600640 1 -- 172.21.15.37:0/3707890906 wait complete. 2024-05-30T06:58:55.216 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:58:55.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.354+0000 7f9cad400640 1 Processor -- start 2024-05-30T06:58:55.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.354+0000 7f9cad400640 1 -- start start 2024-05-30T06:58:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9cad400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9ca806f9a0 0x7f9ca80b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9cad400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ca80b2ec0 0x7f9ca80cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9cad400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca815c8f0 con 0x7f9ca8155e60 2024-05-30T06:58:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9cad400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca80ccff0 con 0x7f9ca806f9a0 2024-05-30T06:58:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9cad400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca80ccc80 con 0x7f9ca80b2ec0 2024-05-30T06:58:55.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9c9fe00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9ca806f9a0 0x7f9ca80b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:55.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9ca6800640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f9ca8155e60 0x7f9ca80cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:58448/0 (socket says 172.21.15.37:58448) 2024-05-30T06:58:55.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9ca6800640 1 -- 172.21.15.37:0/36081506 learned_addr learned my addr 172.21.15.37:0/36081506 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:55.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9ca7200640 1 --2- 172.21.15.37:0/36081506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ca80b2ec0 0x7f9ca80cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:55.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9ca5e00640 1 -- 172.21.15.37:0/36081506 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1990406915 0 0) 0x7f9ca815c8f0 con 0x7f9ca8155e60 2024-05-30T06:58:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9ca5e00640 1 -- 172.21.15.37:0/36081506 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c8c003530 con 0x7f9ca8155e60 2024-05-30T06:58:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9c9fe00640 1 -- 172.21.15.37:0/36081506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ca80b2ec0 msgr2=0x7f9ca80cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9c9fe00640 1 --2- 172.21.15.37:0/36081506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ca80b2ec0 0x7f9ca80cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9c9fe00640 1 -- 172.21.15.37:0/36081506 >> v1:172.21.15.105:6789/0 conn(0x7f9ca8155e60 legacy=0x7f9ca80cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.358+0000 7f9c9fe00640 1 -- 172.21.15.37:0/36081506 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca815cbd0 con 0x7f9ca806f9a0 2024-05-30T06:58:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9c9fe00640 1 --2- 172.21.15.37:0/36081506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ca806f9a0 0x7f9ca80b36a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9c900097c0 tx=0x7f9c9001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdab62a02705c5b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9ca5e00640 1 -- 172.21.15.37:0/36081506 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c900b1070 con 0x7f9ca806f9a0 2024-05-30T06:58:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9ca5e00640 1 -- 172.21.15.37:0/36081506 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c900ac410 con 0x7f9ca806f9a0 2024-05-30T06:58:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9ca5e00640 1 -- 172.21.15.37:0/36081506 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c900ac7e0 con 0x7f9ca806f9a0 2024-05-30T06:58:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9cad400640 1 -- 172.21.15.37:0/36081506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ca806f9a0 msgr2=0x7f9ca80b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9cad400640 1 --2- 172.21.15.37:0/36081506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ca806f9a0 0x7f9ca80b36a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9c900097c0 tx=0x7f9c9001c4a0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9cad400640 1 -- 172.21.15.37:0/36081506 shutdown_connections 2024-05-30T06:58:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9cad400640 1 --2- 172.21.15.37:0/36081506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ca80b2ec0 0x7f9ca80cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9cad400640 1 --2- 172.21.15.37:0/36081506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ca806f9a0 0x7f9ca80b36a0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9cad400640 1 -- 172.21.15.37:0/36081506 >> 172.21.15.37:0/36081506 conn(0x7f9ca80b23a0 msgr2=0x7f9ca80b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9cad400640 1 -- 172.21.15.37:0/36081506 shutdown_connections 2024-05-30T06:58:55.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9cad400640 1 -- 172.21.15.37:0/36081506 wait complete. 2024-05-30T06:58:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9cad400640 1 Processor -- start 2024-05-30T06:58:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.362+0000 7f9cad400640 1 -- start start 2024-05-30T06:58:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9cad400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca806f9a0 0x7f9ca80b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9cad400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ca80b2ec0 0x7f9ca8143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9cad400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ca8155e60 0x7f9ca814c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9cad400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca806ec20 con 0x7f9ca806f9a0 2024-05-30T06:58:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9cad400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca806eaa0 con 0x7f9ca8155e60 2024-05-30T06:58:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9cad400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca806eda0 con 0x7f9ca80b2ec0 2024-05-30T06:58:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9ca6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca806f9a0 0x7f9ca80b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9ca6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca806f9a0 0x7f9ca80b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58748/0 (socket says 172.21.15.37:58748) 2024-05-30T06:58:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9ca6800640 1 -- 172.21.15.37:0/404554608 learned_addr learned my addr 172.21.15.37:0/404554608 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9ca7200640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ca8155e60 0x7f9ca814c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9c9fe00640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ca80b2ec0 0x7f9ca8143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9ca6800640 1 -- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ca80b2ec0 msgr2=0x7f9ca8143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9ca6800640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ca80b2ec0 0x7f9ca8143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9ca6800640 1 -- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ca8155e60 msgr2=0x7f9ca814c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9ca6800640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ca8155e60 0x7f9ca814c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9ca6800640 1 -- 172.21.15.37:0/404554608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca81444b0 con 0x7f9ca806f9a0 2024-05-30T06:58:55.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9ca6800640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca806f9a0 0x7f9ca80b1e60 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800c3c0 tx=0x7f9c9800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:55.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9c9ea00640 1 -- 172.21.15.37:0/404554608 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98017070 con 0x7f9ca806f9a0 2024-05-30T06:58:55.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9c9ea00640 1 -- 172.21.15.37:0/404554608 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c98005cf0 con 0x7f9ca806f9a0 2024-05-30T06:58:55.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9cad400640 1 -- 172.21.15.37:0/404554608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca80b1bd0 con 0x7f9ca806f9a0 2024-05-30T06:58:55.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9c9ea00640 1 -- 172.21.15.37:0/404554608 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c980072f0 con 0x7f9ca806f9a0 2024-05-30T06:58:55.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9cad400640 1 -- 172.21.15.37:0/404554608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca8169870 con 0x7f9ca806f9a0 2024-05-30T06:58:55.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.366+0000 7f9cad400640 1 -- 172.21.15.37:0/404554608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca8068b20 con 0x7f9ca806f9a0 2024-05-30T06:58:55.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.370+0000 7f9c9ea00640 1 -- 172.21.15.37:0/404554608 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f9c9801a070 con 0x7f9ca806f9a0 2024-05-30T06:58:55.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.370+0000 7f9c9ea00640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9c8406a060 0x7f9c8406c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:55.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.370+0000 7f9c9ea00640 1 -- 172.21.15.37:0/404554608 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7f9c98084bc0 con 0x7f9ca806f9a0 2024-05-30T06:58:55.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.370+0000 7f9c9fe00640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9c8406a060 0x7f9c8406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.370+0000 7f9c9fe00640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9c8406a060 0x7f9c8406c520 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9c900ae000 tx=0x7f9c90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.374+0000 7f9c9ea00640 1 -- 172.21.15.37:0/404554608 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c98056630 con 0x7f9ca806f9a0 2024-05-30T06:58:55.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.542+0000 7f9cad400640 1 -- 172.21.15.37:0/404554608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ca814e360 con 0x7f9ca806f9a0 2024-05-30T06:58:55.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.542+0000 7f9c9ea00640 1 -- 172.21.15.37:0/404554608 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16968 (secure 0 0 0) 0x7f9c9805a930 con 0x7f9ca806f9a0 2024-05-30T06:58:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:58:55.544 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":117,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:58:49.820117+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:57:16.849268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-05-30T06:57:17.405807+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.5","mappings":[{"from":0,"to":2}]},{"pgid":"17.34","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:58:55.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.542+0000 7f9cad400640 1 -- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9c8406a060 msgr2=0x7f9c8406c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.542+0000 7f9cad400640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9c8406a060 0x7f9c8406c520 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9c900ae000 tx=0x7f9c90008040 comp rx=0 tx=0).stop 2024-05-30T06:58:55.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.542+0000 7f9cad400640 1 -- 172.21.15.37:0/404554608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca806f9a0 msgr2=0x7f9ca80b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.542+0000 7f9cad400640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca806f9a0 0x7f9ca80b1e60 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f9c9800c3c0 tx=0x7f9c9800c880 comp rx=0 tx=0).stop 2024-05-30T06:58:55.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.546+0000 7f9cad400640 1 -- 172.21.15.37:0/404554608 shutdown_connections 2024-05-30T06:58:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.546+0000 7f9cad400640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f9c8406a060 0x7f9c8406c520 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.546+0000 7f9cad400640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ca8155e60 0x7f9ca814c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.546+0000 7f9cad400640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ca80b2ec0 0x7f9ca8143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.546+0000 7f9cad400640 1 --2- 172.21.15.37:0/404554608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca806f9a0 0x7f9ca80b1e60 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.546+0000 7f9cad400640 1 -- 172.21.15.37:0/404554608 >> 172.21.15.37:0/404554608 conn(0x7f9ca80b23a0 msgr2=0x7f9ca80b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.546+0000 7f9cad400640 1 -- 172.21.15.37:0/404554608 shutdown_connections 2024-05-30T06:58:55.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.546+0000 7f9cad400640 1 -- 172.21.15.37:0/404554608 wait complete. 2024-05-30T06:58:55.566 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-30T06:58:55.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.706+0000 7f436de00640 1 Processor -- start 2024-05-30T06:58:55.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.706+0000 7f436de00640 1 -- start start 2024-05-30T06:58:55.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.706+0000 7f436de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436815d350 0x7f436806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:55.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.706+0000 7f436de00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f436815d7b0 0x7f436806e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:55.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.706+0000 7f436de00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4368142030 con 0x7f43680b59d0 2024-05-30T06:58:55.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.706+0000 7f436de00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4368142310 con 0x7f436815d7b0 2024-05-30T06:58:55.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.706+0000 7f436de00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f43681425f0 con 0x7f436815d350 2024-05-30T06:58:55.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.706+0000 7f4367400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f436815d7b0 0x7f436806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:55.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.706+0000 7f4367400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f436815d7b0 0x7f436806e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58754/0 (socket says 172.21.15.37:58754) 2024-05-30T06:58:55.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.706+0000 7f4367400640 1 -- 172.21.15.37:0/2198348304 learned_addr learned my addr 172.21.15.37:0/2198348304 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:55.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.706+0000 7f435e000640 1 --2- 172.21.15.37:0/2198348304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436815d350 0x7f436806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:55.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.710+0000 7f4367400640 1 -- 172.21.15.37:0/2198348304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436815d350 msgr2=0x7f436806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:55.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.710+0000 7f4367400640 1 --2- 172.21.15.37:0/2198348304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436815d350 0x7f436806df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.710+0000 7f4367400640 1 -- 172.21.15.37:0/2198348304 >> v1:172.21.15.105:6789/0 conn(0x7f43680b59d0 legacy=0x7f43680b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.710+0000 7f4367400640 1 -- 172.21.15.37:0/2198348304 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43681428d0 con 0x7f436815d7b0 2024-05-30T06:58:55.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.710+0000 7f4367400640 1 --2- 172.21.15.37:0/2198348304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d7b0 0x7f436806e490 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f4360009870 tx=0x7f436001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9ccdbd169bd255 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:55.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.710+0000 7f4366000640 1 -- 172.21.15.37:0/2198348304 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43600b5070 con 0x7f436815d7b0 2024-05-30T06:58:55.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.710+0000 7f4366000640 1 -- 172.21.15.37:0/2198348304 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43600a8a50 con 0x7f436815d7b0 2024-05-30T06:58:55.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.710+0000 7f4366000640 1 -- 172.21.15.37:0/2198348304 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43600a8e20 con 0x7f436815d7b0 2024-05-30T06:58:55.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 -- 172.21.15.37:0/2198348304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d7b0 msgr2=0x7f436806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 --2- 172.21.15.37:0/2198348304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d7b0 0x7f436806e490 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f4360009870 tx=0x7f436001ed50 comp rx=0 tx=0).stop 2024-05-30T06:58:55.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 -- 172.21.15.37:0/2198348304 shutdown_connections 2024-05-30T06:58:55.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 --2- 172.21.15.37:0/2198348304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d7b0 0x7f436806e490 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 --2- 172.21.15.37:0/2198348304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436815d350 0x7f436806df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 -- 172.21.15.37:0/2198348304 >> 172.21.15.37:0/2198348304 conn(0x7f436806bf60 msgr2=0x7f43680b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 -- 172.21.15.37:0/2198348304 shutdown_connections 2024-05-30T06:58:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 -- 172.21.15.37:0/2198348304 wait complete. 2024-05-30T06:58:55.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 Processor -- start 2024-05-30T06:58:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 -- start start 2024-05-30T06:58:55.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680b59d0 0x7f43680b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:55.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436815d350 0x7f4368156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:55.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d7b0 0x7f4368136ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:55.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f43680b00a0 con 0x7f436815d7b0 2024-05-30T06:58:55.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f43680aff20 con 0x7f43680b59d0 2024-05-30T06:58:55.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f436de00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f436813f860 con 0x7f436815d350 2024-05-30T06:58:55.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f4367400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d7b0 0x7f4368136ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:55.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f4367400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d7b0 0x7f4368136ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58770/0 (socket says 172.21.15.37:58770) 2024-05-30T06:58:55.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f4367400640 1 -- 172.21.15.37:0/15446681 learned_addr learned my addr 172.21.15.37:0/15446681 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f4366a00640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680b59d0 0x7f43680b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f435e000640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436815d350 0x7f4368156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f4367400640 1 -- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436815d350 msgr2=0x7f4368156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f4367400640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436815d350 0x7f4368156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f4367400640 1 -- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680b59d0 msgr2=0x7f43680b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f4367400640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680b59d0 0x7f43680b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f4367400640 1 -- 172.21.15.37:0/15446681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43680b4730 con 0x7f436815d7b0 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f435e000640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436815d350 0x7f4368156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.714+0000 7f4367400640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d7b0 0x7f4368136ff0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f4360009870 tx=0x7f436001baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.718+0000 7f435fe00640 1 -- 172.21.15.37:0/15446681 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43600b5040 con 0x7f436815d7b0 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.718+0000 7f435fe00640 1 -- 172.21.15.37:0/15446681 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43600be070 con 0x7f436815d7b0 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.718+0000 7f435fe00640 1 -- 172.21.15.37:0/15446681 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43600b0cf0 con 0x7f436815d7b0 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.718+0000 7f436de00640 1 -- 172.21.15.37:0/15446681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43680b4a10 con 0x7f436815d7b0 2024-05-30T06:58:55.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.718+0000 7f436de00640 1 -- 172.21.15.37:0/15446681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4368138d90 con 0x7f436815d7b0 2024-05-30T06:58:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.718+0000 7f436de00640 1 -- 172.21.15.37:0/15446681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43680b4f30 con 0x7f436815d7b0 2024-05-30T06:58:55.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.718+0000 7f435fe00640 1 -- 172.21.15.37:0/15446681 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f43600c3460 con 0x7f436815d7b0 2024-05-30T06:58:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.718+0000 7f435fe00640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f434406a060 0x7f434406c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.718+0000 7f435fe00640 1 -- 172.21.15.37:0/15446681 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5879+0+0 (secure 0 0 0) 0x7f43601231b0 con 0x7f436815d7b0 2024-05-30T06:58:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.718+0000 7f4366a00640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f434406a060 0x7f434406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:55.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.722+0000 7f4366a00640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f434406a060 0x7f434406c520 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f436815fe90 tx=0x7f4358009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:55.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.722+0000 7f435fe00640 1 -- 172.21.15.37:0/15446681 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f43680b4f30 con 0x7f436815d7b0 2024-05-30T06:58:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.926+0000 7f436de00640 1 -- 172.21.15.37:0/15446681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4368138f60 con 0x7f436815d7b0 2024-05-30T06:58:55.925 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-05-30T06:58:55.926+0000 7fd1bb400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-30T06:58:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.926+0000 7f435fe00640 1 -- 172.21.15.37:0/15446681 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v76) ==== 161+0+0 (secure 0 0 0) 0x7f43600188b0 con 0x7f436815d7b0 2024-05-30T06:58:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-30T06:58:55.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.930+0000 7f436de00640 1 -- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f434406a060 msgr2=0x7f434406c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.930+0000 7f436de00640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f434406a060 0x7f434406c520 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f436815fe90 tx=0x7f4358009040 comp rx=0 tx=0).stop 2024-05-30T06:58:55.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.930+0000 7f436de00640 1 -- 172.21.15.37:0/15446681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d7b0 msgr2=0x7f4368136ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:55.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.930+0000 7f436de00640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d7b0 0x7f4368136ff0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f4360009870 tx=0x7f436001baf0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.930+0000 7f436de00640 1 -- 172.21.15.37:0/15446681 shutdown_connections 2024-05-30T06:58:55.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.930+0000 7f436de00640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d7b0 0x7f4368136ff0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.930+0000 7f436de00640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f436815d350 0x7f4368156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.930+0000 7f436de00640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f434406a060 0x7f434406c520 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.930+0000 7f436de00640 1 --2- 172.21.15.37:0/15446681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43680b59d0 0x7f43680b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:55.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.930+0000 7f436de00640 1 -- 172.21.15.37:0/15446681 >> 172.21.15.37:0/15446681 conn(0x7f436806bf60 msgr2=0x7f436813da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:55.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.930+0000 7f436de00640 1 -- 172.21.15.37:0/15446681 shutdown_connections 2024-05-30T06:58:55.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:55.930+0000 7f436de00640 1 -- 172.21.15.37:0/15446681 wait complete. 2024-05-30T06:58:55.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-30T06:58:56.001 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-30T06:58:56.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c15e00640 1 Processor -- start 2024-05-30T06:58:56.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c15e00640 1 -- start start 2024-05-30T06:58:56.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c15e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c10155da0 0x7f2c100cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:56.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c15e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c1006f770 0x7f2c100b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:56.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c15e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1015f310 con 0x7f2c100cd440 2024-05-30T06:58:56.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c15e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2c1015f5f0 con 0x7f2c1006f770 2024-05-30T06:58:56.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c15e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1015f8d0 con 0x7f2c10155da0 2024-05-30T06:58:56.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c0e000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2c100cd440 0x7f2c1006f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56158/0 (socket says 172.21.15.37:56158) 2024-05-30T06:58:56.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c0f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c1006f770 0x7f2c100b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:56.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c0e000640 1 -- 172.21.15.37:0/2945224587 learned_addr learned my addr 172.21.15.37:0/2945224587 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:56.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c0ea00640 1 --2- 172.21.15.37:0/2945224587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c10155da0 0x7f2c100cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:56.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c0f400640 1 -- 172.21.15.37:0/2945224587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c10155da0 msgr2=0x7f2c100cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:56.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c0f400640 1 --2- 172.21.15.37:0/2945224587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c10155da0 0x7f2c100cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:56.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c0f400640 1 -- 172.21.15.37:0/2945224587 >> v1:172.21.15.37:6789/0 conn(0x7f2c100cd440 legacy=0x7f2c1006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:56.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c0d600640 1 -- 172.21.15.37:0/2945224587 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530284976 0 0) 0x7f2c1015f310 con 0x7f2c100cd440 2024-05-30T06:58:56.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.102+0000 7f2c0f400640 1 -- 172.21.15.37:0/2945224587 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1015fbb0 con 0x7f2c1006f770 2024-05-30T06:58:56.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.106+0000 7f2c0f400640 1 --2- 172.21.15.37:0/2945224587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1006f770 0x7f2c100b3750 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009d90 tx=0x7f2c0801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b76c4cc1737fec server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:56.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.106+0000 7f2c0d600640 1 -- 172.21.15.37:0/2945224587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c080b2070 con 0x7f2c1006f770 2024-05-30T06:58:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.106+0000 7f2c0d600640 1 -- 172.21.15.37:0/2945224587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c080a5710 con 0x7f2c1006f770 2024-05-30T06:58:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.106+0000 7f2c0d600640 1 -- 172.21.15.37:0/2945224587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c080a5ae0 con 0x7f2c1006f770 2024-05-30T06:58:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.106+0000 7f2c15e00640 1 -- 172.21.15.37:0/2945224587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1006f770 msgr2=0x7f2c100b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.106+0000 7f2c15e00640 1 --2- 172.21.15.37:0/2945224587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1006f770 0x7f2c100b3750 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009d90 tx=0x7f2c0801c850 comp rx=0 tx=0).stop 2024-05-30T06:58:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.106+0000 7f2c15e00640 1 -- 172.21.15.37:0/2945224587 shutdown_connections 2024-05-30T06:58:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.106+0000 7f2c15e00640 1 --2- 172.21.15.37:0/2945224587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1006f770 0x7f2c100b3750 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.106+0000 7f2c15e00640 1 --2- 172.21.15.37:0/2945224587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c10155da0 0x7f2c100cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.106+0000 7f2c15e00640 1 -- 172.21.15.37:0/2945224587 >> 172.21.15.37:0/2945224587 conn(0x7f2c1006bf60 msgr2=0x7f2c100b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.106+0000 7f2c15e00640 1 -- 172.21.15.37:0/2945224587 shutdown_connections 2024-05-30T06:58:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.106+0000 7f2c15e00640 1 -- 172.21.15.37:0/2945224587 wait complete. 2024-05-30T06:58:56.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.106+0000 7f2c15e00640 1 Processor -- start 2024-05-30T06:58:56.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c15e00640 1 -- start start 2024-05-30T06:58:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c15e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c1006f770 0x7f2c101f6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c15e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c10155da0 0x7f2c1015a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c15e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c100b0f60 0x7f2c1015ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c15e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c10168580 con 0x7f2c100b0f60 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c15e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c100b46b0 con 0x7f2c1006f770 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c15e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2c10168700 con 0x7f2c10155da0 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c0f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c100b0f60 0x7f2c1015ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c0f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c100b0f60 0x7f2c1015ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58798/0 (socket says 172.21.15.37:58798) 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c0f400640 1 -- 172.21.15.37:0/4143794764 learned_addr learned my addr 172.21.15.37:0/4143794764 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c0e000640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c10155da0 0x7f2c1015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c0ea00640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c1006f770 0x7f2c101f6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c0f400640 1 -- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c10155da0 msgr2=0x7f2c1015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c0f400640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c10155da0 0x7f2c1015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c0f400640 1 -- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c1006f770 msgr2=0x7f2c101f6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c0f400640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c1006f770 0x7f2c101f6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:56.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c0f400640 1 -- 172.21.15.37:0/4143794764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c10157ab0 con 0x7f2c100b0f60 2024-05-30T06:58:56.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c0e000640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c10155da0 0x7f2c1015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:56.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c0f400640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c100b0f60 0x7f2c1015ad70 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f2c080b0040 tx=0x7f2c080195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:56.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c07400640 1 -- 172.21.15.37:0/4143794764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c080b2050 con 0x7f2c100b0f60 2024-05-30T06:58:56.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c07400640 1 -- 172.21.15.37:0/4143794764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c080be070 con 0x7f2c100b0f60 2024-05-30T06:58:56.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c15e00640 1 -- 172.21.15.37:0/4143794764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c10157d90 con 0x7f2c100b0f60 2024-05-30T06:58:56.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c07400640 1 -- 172.21.15.37:0/4143794764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c080ad890 con 0x7f2c100b0f60 2024-05-30T06:58:56.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c15e00640 1 -- 172.21.15.37:0/4143794764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c10158350 con 0x7f2c100b0f60 2024-05-30T06:58:56.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.110+0000 7f2c15e00640 1 -- 172.21.15.37:0/4143794764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c10068bc0 con 0x7f2c100b0f60 2024-05-30T06:58:56.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.114+0000 7f2c07400640 1 -- 172.21.15.37:0/4143794764 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f2c080ada30 con 0x7f2c100b0f60 2024-05-30T06:58:56.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.114+0000 7f2c07400640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bf006a030 0x7f2bf006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:56.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.114+0000 7f2c07400640 1 -- 172.21.15.37:0/4143794764 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5937+0+0 (secure 0 0 0) 0x7f2c08120920 con 0x7f2c100b0f60 2024-05-30T06:58:56.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.114+0000 7f2c0ea00640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bf006a030 0x7f2bf006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:56.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.114+0000 7f2c0ea00640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bf006a030 0x7f2bf006c4f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009ac0 tx=0x7f2c00009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:56.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.118+0000 7f2c07400640 1 -- 172.21.15.37:0/4143794764 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2c08016560 con 0x7f2c100b0f60 2024-05-30T06:58:56.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.318+0000 7f2c15e00640 1 -- 172.21.15.37:0/4143794764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2c1015ed50 con 0x7f2c100b0f60 2024-05-30T06:58:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.930+0000 7f2c07400640 1 -- 172.21.15.37:0/4143794764 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v77) ==== 104+0+0 (secure 0 0 0) 0x7f2c080f2b20 con 0x7f2c100b0f60 2024-05-30T06:58:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.934+0000 7f2c15e00640 1 -- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bf006a030 msgr2=0x7f2bf006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.934+0000 7f2c15e00640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bf006a030 0x7f2bf006c4f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009ac0 tx=0x7f2c00009190 comp rx=0 tx=0).stop 2024-05-30T06:58:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.934+0000 7f2c15e00640 1 -- 172.21.15.37:0/4143794764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c100b0f60 msgr2=0x7f2c1015ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.934+0000 7f2c15e00640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c100b0f60 0x7f2c1015ad70 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f2c080b0040 tx=0x7f2c080195f0 comp rx=0 tx=0).stop 2024-05-30T06:58:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.934+0000 7f2c15e00640 1 -- 172.21.15.37:0/4143794764 shutdown_connections 2024-05-30T06:58:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.934+0000 7f2c15e00640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c100b0f60 0x7f2c1015ad70 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.934+0000 7f2c15e00640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c10155da0 0x7f2c1015a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.934+0000 7f2c15e00640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bf006a030 0x7f2bf006c4f0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.934+0000 7f2c15e00640 1 --2- 172.21.15.37:0/4143794764 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c1006f770 0x7f2c101f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.934+0000 7f2c15e00640 1 -- 172.21.15.37:0/4143794764 >> 172.21.15.37:0/4143794764 conn(0x7f2c1006bf60 msgr2=0x7f2c1006ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.934+0000 7f2c15e00640 1 -- 172.21.15.37:0/4143794764 shutdown_connections 2024-05-30T06:58:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:56.934+0000 7f2c15e00640 1 -- 172.21.15.37:0/4143794764 wait complete. 2024-05-30T06:58:56.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-30T06:58:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c7200640 1 Processor -- start 2024-05-30T06:58:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c7200640 1 -- start start 2024-05-30T06:58:57.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c7200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f40c015e970 0x7f40c006ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:57.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c7200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f40c00730d0 0x7f40c00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:57.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c7200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40c00b53e0 con 0x7f40c006f8c0 2024-05-30T06:58:57.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c7200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f40c006d380 con 0x7f40c015e970 2024-05-30T06:58:57.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c7200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f40c00b3bb0 con 0x7f40c00730d0 2024-05-30T06:58:57.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c5e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f40c015e970 0x7f40c006ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c6800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f40c006f8c0 0x7f40c006fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56174/0 (socket says 172.21.15.37:56174) 2024-05-30T06:58:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c6800640 1 -- 172.21.15.37:0/3583066432 learned_addr learned my addr 172.21.15.37:0/3583066432 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c5400640 1 --2- 172.21.15.37:0/3583066432 >> v2:172.21.15.105:3300/0 conn(0x7f40c00730d0 0x7f40c00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c5e00640 1 -- 172.21.15.37:0/3583066432 >> v2:172.21.15.105:3300/0 conn(0x7f40c00730d0 msgr2=0x7f40c00b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c5e00640 1 --2- 172.21.15.37:0/3583066432 >> v2:172.21.15.105:3300/0 conn(0x7f40c00730d0 0x7f40c00b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c5e00640 1 -- 172.21.15.37:0/3583066432 >> v1:172.21.15.37:6789/0 conn(0x7f40c006f8c0 legacy=0x7f40c006fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c5e00640 1 -- 172.21.15.37:0/3583066432 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c00b3e00 con 0x7f40c015e970 2024-05-30T06:58:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.106+0000 7f40c4a00640 1 -- 172.21.15.37:0/3583066432 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228583133 0 0) 0x7f40bc0014a0 con 0x7f40c006f8c0 2024-05-30T06:58:57.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c5e00640 1 --2- 172.21.15.37:0/3583066432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40c015e970 0x7f40c006ce40 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f40c006de10 tx=0x7f40b401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113e1884427f3724 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:57.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c4a00640 1 -- 172.21.15.37:0/3583066432 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b40b0070 con 0x7f40c015e970 2024-05-30T06:58:57.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c4a00640 1 -- 172.21.15.37:0/3583066432 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b40ab600 con 0x7f40c015e970 2024-05-30T06:58:57.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c4a00640 1 -- 172.21.15.37:0/3583066432 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b40ab9d0 con 0x7f40c015e970 2024-05-30T06:58:57.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c7200640 1 -- 172.21.15.37:0/3583066432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40c015e970 msgr2=0x7f40c006ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:57.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c7200640 1 --2- 172.21.15.37:0/3583066432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40c015e970 0x7f40c006ce40 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f40c006de10 tx=0x7f40b401c480 comp rx=0 tx=0).stop 2024-05-30T06:58:57.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c7200640 1 -- 172.21.15.37:0/3583066432 shutdown_connections 2024-05-30T06:58:57.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c7200640 1 --2- 172.21.15.37:0/3583066432 >> v2:172.21.15.105:3300/0 conn(0x7f40c00730d0 0x7f40c00b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:57.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c7200640 1 --2- 172.21.15.37:0/3583066432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40c015e970 0x7f40c006ce40 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:57.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c7200640 1 -- 172.21.15.37:0/3583066432 >> 172.21.15.37:0/3583066432 conn(0x7f40c00d0b80 msgr2=0x7f40c00d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:57.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c7200640 1 -- 172.21.15.37:0/3583066432 shutdown_connections 2024-05-30T06:58:57.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c7200640 1 -- 172.21.15.37:0/3583066432 wait complete. 2024-05-30T06:58:57.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c7200640 1 Processor -- start 2024-05-30T06:58:57.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.110+0000 7f40c7200640 1 -- start start 2024-05-30T06:58:57.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c7200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40c006f8c0 0x7f40c01526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:57.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c7200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40c00730d0 0x7f40c015b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:57.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c7200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40c015e970 0x7f40c015d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:57.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c7200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40c00cf3f0 con 0x7f40c006f8c0 2024-05-30T06:58:57.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c7200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f40c00cf270 con 0x7f40c00730d0 2024-05-30T06:58:57.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c7200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f40c00cf570 con 0x7f40c015e970 2024-05-30T06:58:57.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40c006f8c0 0x7f40c01526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:57.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40c006f8c0 0x7f40c01526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58812/0 (socket says 172.21.15.37:58812) 2024-05-30T06:58:57.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c5e00640 1 -- 172.21.15.37:0/3715800087 learned_addr learned my addr 172.21.15.37:0/3715800087 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:57.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c5400640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40c00730d0 0x7f40c015b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c6800640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40c015e970 0x7f40c015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c5e00640 1 -- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40c015e970 msgr2=0x7f40c015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c5e00640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40c015e970 0x7f40c015d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c5e00640 1 -- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40c00730d0 msgr2=0x7f40c015b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c5e00640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40c00730d0 0x7f40c015b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c5e00640 1 -- 172.21.15.37:0/3715800087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c0161ea0 con 0x7f40c006f8c0 2024-05-30T06:58:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c5400640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40c00730d0 0x7f40c015b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:58:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c6800640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40c015e970 0x7f40c015d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:58:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c5e00640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40c006f8c0 0x7f40c01526e0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f40b40ae040 tx=0x7f40b401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40ba000640 1 -- 172.21.15.37:0/3715800087 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b40b0050 con 0x7f40c006f8c0 2024-05-30T06:58:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40ba000640 1 -- 172.21.15.37:0/3715800087 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b40bc070 con 0x7f40c006f8c0 2024-05-30T06:58:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40ba000640 1 -- 172.21.15.37:0/3715800087 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b40b5870 con 0x7f40c006f8c0 2024-05-30T06:58:57.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c7200640 1 -- 172.21.15.37:0/3715800087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c0161bc0 con 0x7f40c006f8c0 2024-05-30T06:58:57.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c7200640 1 -- 172.21.15.37:0/3715800087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c0153b30 con 0x7f40c006f8c0 2024-05-30T06:58:57.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40c7200640 1 -- 172.21.15.37:0/3715800087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c0068ab0 con 0x7f40c006f8c0 2024-05-30T06:58:57.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.114+0000 7f40ba000640 1 -- 172.21.15.37:0/3715800087 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f40b40b5a10 con 0x7f40c006f8c0 2024-05-30T06:58:57.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.118+0000 7f40ba000640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40a406a030 0x7f40a406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:57.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.118+0000 7f40ba000640 1 -- 172.21.15.37:0/3715800087 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5937+0+0 (secure 0 0 0) 0x7f40b4120280 con 0x7f40c006f8c0 2024-05-30T06:58:57.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.118+0000 7f40c5400640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40a406a030 0x7f40a406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:57.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.118+0000 7f40c5400640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40a406a030 0x7f40a406c4f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f40c00b60c0 tx=0x7f40b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:57.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.122+0000 7f40ba000640 1 -- 172.21.15.37:0/3715800087 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f40b4016070 con 0x7f40c006f8c0 2024-05-30T06:58:57.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.286+0000 7f40c7200640 1 -- 172.21.15.37:0/3715800087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f40c006d510 con 0x7f40c006f8c0 2024-05-30T06:58:57.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.934+0000 7f40ba000640 1 -- 172.21.15.37:0/3715800087 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v119) ==== 181+0+0 (secure 0 0 0) 0x7f40b40f22a0 con 0x7f40c006f8c0 2024-05-30T06:58:57.935 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-05-30T06:58:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.938+0000 7f40c7200640 1 -- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40a406a030 msgr2=0x7f40a406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.938+0000 7f40c7200640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40a406a030 0x7f40a406c4f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f40c00b60c0 tx=0x7f40b0008040 comp rx=0 tx=0).stop 2024-05-30T06:58:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.938+0000 7f40c7200640 1 -- 172.21.15.37:0/3715800087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40c006f8c0 msgr2=0x7f40c01526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.938+0000 7f40c7200640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40c006f8c0 0x7f40c01526e0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f40b40ae040 tx=0x7f40b401acc0 comp rx=0 tx=0).stop 2024-05-30T06:58:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.938+0000 7f40c7200640 1 -- 172.21.15.37:0/3715800087 shutdown_connections 2024-05-30T06:58:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.938+0000 7f40c7200640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f40c015e970 0x7f40c015d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.938+0000 7f40c7200640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f40a406a030 0x7f40a406c4f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:57.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.938+0000 7f40c7200640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f40c00730d0 0x7f40c015b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:57.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.938+0000 7f40c7200640 1 --2- 172.21.15.37:0/3715800087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40c006f8c0 0x7f40c01526e0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:57.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.938+0000 7f40c7200640 1 -- 172.21.15.37:0/3715800087 >> 172.21.15.37:0/3715800087 conn(0x7f40c00d0b80 msgr2=0x7f40c00b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:57.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.938+0000 7f40c7200640 1 -- 172.21.15.37:0/3715800087 shutdown_connections 2024-05-30T06:58:57.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:57.938+0000 7f40c7200640 1 -- 172.21.15.37:0/3715800087 wait complete. 2024-05-30T06:58:57.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-30T06:58:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.114+0000 7f7acd400640 1 Processor -- start 2024-05-30T06:58:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.114+0000 7f7acd400640 1 -- start start 2024-05-30T06:58:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.114+0000 7f7acd400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ac80cd400 0x7f7ac806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.114+0000 7f7acd400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7ac806f5a0 0x7f7ac80b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.118+0000 7f7acd400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac80ce030 con 0x7f7ac81590c0 2024-05-30T06:58:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.118+0000 7f7acd400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac815f230 con 0x7f7ac80cd400 2024-05-30T06:58:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.118+0000 7f7acd400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac815f510 con 0x7f7ac806f5a0 2024-05-30T06:58:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.118+0000 7f7abde00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ac80cd400 0x7f7ac806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.118+0000 7f7abde00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ac80cd400 0x7f7ac806f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35690/0 (socket says 172.21.15.37:35690) 2024-05-30T06:58:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.118+0000 7f7abde00640 1 -- 172.21.15.37:0/517491551 learned_addr learned my addr 172.21.15.37:0/517491551 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:58.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.118+0000 7f7ac7200640 1 --2- 172.21.15.37:0/517491551 >> v2:172.21.15.105:3300/0 conn(0x7f7ac806f5a0 0x7f7ac80b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.118+0000 7f7abde00640 1 -- 172.21.15.37:0/517491551 >> v2:172.21.15.105:3300/0 conn(0x7f7ac806f5a0 msgr2=0x7f7ac80b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.118+0000 7f7abde00640 1 --2- 172.21.15.37:0/517491551 >> v2:172.21.15.105:3300/0 conn(0x7f7ac806f5a0 0x7f7ac80b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.118+0000 7f7abde00640 1 -- 172.21.15.37:0/517491551 >> v1:172.21.15.105:6789/0 conn(0x7f7ac81590c0 legacy=0x7f7ac80cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.118+0000 7f7abde00640 1 -- 172.21.15.37:0/517491551 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac815f7f0 con 0x7f7ac80cd400 2024-05-30T06:58:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.118+0000 7f7abde00640 1 --2- 172.21.15.37:0/517491551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80cd400 0x7f7ac806f060 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80b2d30 tx=0x7f7ab001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a456fc4405ca5f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:58.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.118+0000 7f7ac5e00640 1 -- 172.21.15.37:0/517491551 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00b0070 con 0x7f7ac80cd400 2024-05-30T06:58:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7ac5e00640 1 -- 172.21.15.37:0/517491551 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab00ab600 con 0x7f7ac80cd400 2024-05-30T06:58:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7ac5e00640 1 -- 172.21.15.37:0/517491551 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00ab9d0 con 0x7f7ac80cd400 2024-05-30T06:58:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 -- 172.21.15.37:0/517491551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80cd400 msgr2=0x7f7ac806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 --2- 172.21.15.37:0/517491551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80cd400 0x7f7ac806f060 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80b2d30 tx=0x7f7ab001c400 comp rx=0 tx=0).stop 2024-05-30T06:58:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 -- 172.21.15.37:0/517491551 shutdown_connections 2024-05-30T06:58:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 --2- 172.21.15.37:0/517491551 >> v2:172.21.15.105:3300/0 conn(0x7f7ac806f5a0 0x7f7ac80b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 --2- 172.21.15.37:0/517491551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac80cd400 0x7f7ac806f060 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 -- 172.21.15.37:0/517491551 >> 172.21.15.37:0/517491551 conn(0x7f7ac806bf60 msgr2=0x7f7ac80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 -- 172.21.15.37:0/517491551 shutdown_connections 2024-05-30T06:58:58.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 -- 172.21.15.37:0/517491551 wait complete. 2024-05-30T06:58:58.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 Processor -- start 2024-05-30T06:58:58.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 -- start start 2024-05-30T06:58:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac806f5a0 0x7f7ac8144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ac80cd400 0x7f7ac81f7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ac81590c0 0x7f7ac8150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac81684a0 con 0x7f7ac806f5a0 2024-05-30T06:58:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac806f9b0 con 0x7f7ac81590c0 2024-05-30T06:58:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7acd400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac8168620 con 0x7f7ac80cd400 2024-05-30T06:58:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7ac6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac806f5a0 0x7f7ac8144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7ac6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac806f5a0 0x7f7ac8144fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35700/0 (socket says 172.21.15.37:35700) 2024-05-30T06:58:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7ac6800640 1 -- 172.21.15.37:0/3420792285 learned_addr learned my addr 172.21.15.37:0/3420792285 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:58.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7ac7200640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ac81590c0 0x7f7ac8150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7abde00640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ac80cd400 0x7f7ac81f7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7ac6800640 1 -- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ac80cd400 msgr2=0x7f7ac81f7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7ac6800640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ac80cd400 0x7f7ac81f7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7ac6800640 1 -- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ac81590c0 msgr2=0x7f7ac8150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7ac6800640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ac81590c0 0x7f7ac8150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7ac6800640 1 -- 172.21.15.37:0/3420792285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac81454e0 con 0x7f7ac806f5a0 2024-05-30T06:58:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.122+0000 7f7ac7200640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ac81590c0 0x7f7ac8150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:58.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.126+0000 7f7ac6800640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac806f5a0 0x7f7ac8144fa0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800c370 tx=0x7f7ab800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.126+0000 7f7abf400640 1 -- 172.21.15.37:0/3420792285 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab80052d0 con 0x7f7ac806f5a0 2024-05-30T06:58:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.126+0000 7f7abf400640 1 -- 172.21.15.37:0/3420792285 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab8005470 con 0x7f7ac806f5a0 2024-05-30T06:58:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.126+0000 7f7abf400640 1 -- 172.21.15.37:0/3420792285 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8007260 con 0x7f7ac806f5a0 2024-05-30T06:58:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.126+0000 7f7acd400640 1 -- 172.21.15.37:0/3420792285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac814fdb0 con 0x7f7ac806f5a0 2024-05-30T06:58:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.126+0000 7f7acd400640 1 -- 172.21.15.37:0/3420792285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac8150370 con 0x7f7ac806f5a0 2024-05-30T06:58:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.126+0000 7f7acd400640 1 -- 172.21.15.37:0/3420792285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac8068d40 con 0x7f7ac806f5a0 2024-05-30T06:58:58.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.126+0000 7f7abf400640 1 -- 172.21.15.37:0/3420792285 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f7ab8007400 con 0x7f7ac806f5a0 2024-05-30T06:58:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.126+0000 7f7abf400640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7aa406a030 0x7f7aa406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:58.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.126+0000 7f7abf400640 1 -- 172.21.15.37:0/3420792285 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5499+0+0 (secure 0 0 0) 0x7f7ab8084cd0 con 0x7f7ac806f5a0 2024-05-30T06:58:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.130+0000 7f7abde00640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7aa406a030 0x7f7aa406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:58.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.130+0000 7f7abde00640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7aa406a030 0x7f7aa406c4f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00ad000 tx=0x7f7ab0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.134+0000 7f7abf400640 1 -- 172.21.15.37:0/3420792285 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7ab8056740 con 0x7f7ac806f5a0 2024-05-30T06:58:58.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.298+0000 7f7acd400640 1 -- 172.21.15.37:0/3420792285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7ac8152990 con 0x7f7ac806f5a0 2024-05-30T06:58:58.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.942+0000 7f7abf400640 1 -- 172.21.15.37:0/3420792285 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v120) ==== 169+0+0 (secure 0 0 0) 0x7f7ab805aa40 con 0x7f7ac806f5a0 2024-05-30T06:58:58.944 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-05-30T06:58:58.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.946+0000 7f7acd400640 1 -- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7aa406a030 msgr2=0x7f7aa406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:58.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.946+0000 7f7acd400640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7aa406a030 0x7f7aa406c4f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00ad000 tx=0x7f7ab0008040 comp rx=0 tx=0).stop 2024-05-30T06:58:58.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.946+0000 7f7acd400640 1 -- 172.21.15.37:0/3420792285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac806f5a0 msgr2=0x7f7ac8144fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:58.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.946+0000 7f7acd400640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac806f5a0 0x7f7ac8144fa0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800c370 tx=0x7f7ab800c830 comp rx=0 tx=0).stop 2024-05-30T06:58:58.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.946+0000 7f7acd400640 1 -- 172.21.15.37:0/3420792285 shutdown_connections 2024-05-30T06:58:58.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.946+0000 7f7acd400640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f7aa406a030 0x7f7aa406c4f0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:58.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.946+0000 7f7acd400640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ac81590c0 0x7f7ac8150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:58.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.946+0000 7f7acd400640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ac80cd400 0x7f7ac81f7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:58.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.946+0000 7f7acd400640 1 --2- 172.21.15.37:0/3420792285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ac806f5a0 0x7f7ac8144fa0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:58.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.946+0000 7f7acd400640 1 -- 172.21.15.37:0/3420792285 >> 172.21.15.37:0/3420792285 conn(0x7f7ac806bf60 msgr2=0x7f7ac814e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:58.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.946+0000 7f7acd400640 1 -- 172.21.15.37:0/3420792285 shutdown_connections 2024-05-30T06:58:58.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:58.946+0000 7f7acd400640 1 -- 172.21.15.37:0/3420792285 wait complete. 2024-05-30T06:58:58.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-30T06:58:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.130+0000 7f59c1000640 1 Processor -- start 2024-05-30T06:58:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.130+0000 7f59c1000640 1 -- start start 2024-05-30T06:58:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.134+0000 7f59c1000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59bc072e60 0x7f59bc06c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.134+0000 7f59c1000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59bc163020 con 0x7f59bc15c890 2024-05-30T06:58:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.134+0000 7f59c1000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59bc163300 con 0x7f59bc15f210 2024-05-30T06:58:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.134+0000 7f59c1000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f59bc1635e0 con 0x7f59bc072e60 2024-05-30T06:58:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.134+0000 7f59ba800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59bc072e60 0x7f59bc06c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.134+0000 7f59b9e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f59bc15c890 0x7f59bc162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47364/0 (socket says 172.21.15.37:47364) 2024-05-30T06:58:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.134+0000 7f59b9e00640 1 -- 172.21.15.37:0/3357981071 learned_addr learned my addr 172.21.15.37:0/3357981071 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:58:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.134+0000 7f59ba800640 1 -- 172.21.15.37:0/3357981071 >> v1:172.21.15.105:6789/0 conn(0x7f59bc15f210 legacy=0x7f59bc072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.134+0000 7f59ba800640 1 -- 172.21.15.37:0/3357981071 >> v1:172.21.15.37:6789/0 conn(0x7f59bc15c890 legacy=0x7f59bc162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.134+0000 7f59ba800640 1 -- 172.21.15.37:0/3357981071 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59bc06ba00 con 0x7f59bc072e60 2024-05-30T06:58:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.134+0000 7f59b9400640 1 -- 172.21.15.37:0/3357981071 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1473712057 0 0) 0x7f59bc163020 con 0x7f59bc15c890 2024-05-30T06:58:59.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.134+0000 7f59ba800640 1 --2- 172.21.15.37:0/3357981071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59bc072e60 0x7f59bc06c200 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009d90 tx=0x7f59b401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf201b5ead60585 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59b9400640 1 -- 172.21.15.37:0/3357981071 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b40b2070 con 0x7f59bc072e60 2024-05-30T06:58:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59b9400640 1 -- 172.21.15.37:0/3357981071 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b40a5560 con 0x7f59bc072e60 2024-05-30T06:58:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59b9400640 1 -- 172.21.15.37:0/3357981071 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b40a5930 con 0x7f59bc072e60 2024-05-30T06:58:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 -- 172.21.15.37:0/3357981071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59bc072e60 msgr2=0x7f59bc06c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 --2- 172.21.15.37:0/3357981071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59bc072e60 0x7f59bc06c200 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009d90 tx=0x7f59b401c8a0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 -- 172.21.15.37:0/3357981071 shutdown_connections 2024-05-30T06:58:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 --2- 172.21.15.37:0/3357981071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59bc072e60 0x7f59bc06c200 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 -- 172.21.15.37:0/3357981071 >> 172.21.15.37:0/3357981071 conn(0x7f59bc0b2ac0 msgr2=0x7f59bc0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:59.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 -- 172.21.15.37:0/3357981071 shutdown_connections 2024-05-30T06:58:59.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 -- 172.21.15.37:0/3357981071 wait complete. 2024-05-30T06:58:59.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 Processor -- start 2024-05-30T06:58:59.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 -- start start 2024-05-30T06:58:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59bc072e60 0x7f59bc0aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:59.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59bc15c890 0x7f59bc16a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59bc15f210 0x7f59bc158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc16ce60 con 0x7f59bc15c890 2024-05-30T06:58:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc16cce0 con 0x7f59bc072e60 2024-05-30T06:58:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.138+0000 7f59c1000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f59bc16cfe0 con 0x7f59bc15f210 2024-05-30T06:58:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59bc15c890 0x7f59bc16a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59bc15c890 0x7f59bc16a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35718/0 (socket says 172.21.15.37:35718) 2024-05-30T06:58:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b1400640 1 -- 172.21.15.37:0/1645228467 learned_addr learned my addr 172.21.15.37:0/1645228467 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b9e00640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59bc072e60 0x7f59bc0aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59ba800640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59bc15f210 0x7f59bc158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b1400640 1 -- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59bc15f210 msgr2=0x7f59bc158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:59.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b1400640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59bc15f210 0x7f59bc158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b1400640 1 -- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59bc072e60 msgr2=0x7f59bc0aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b1400640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59bc072e60 0x7f59bc0aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b1400640 1 -- 172.21.15.37:0/1645228467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59bc159520 con 0x7f59bc15c890 2024-05-30T06:58:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b9e00640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59bc072e60 0x7f59bc0aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:58:59.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b1400640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59bc15c890 0x7f59bc16a480 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f59a400b440 tx=0x7f59a400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b2a00640 1 -- 172.21.15.37:0/1645228467 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a4015020 con 0x7f59bc15c890 2024-05-30T06:58:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b2a00640 1 -- 172.21.15.37:0/1645228467 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a4011890 con 0x7f59bc15c890 2024-05-30T06:58:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b2a00640 1 -- 172.21.15.37:0/1645228467 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a4011c80 con 0x7f59bc15c890 2024-05-30T06:58:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59c1000640 1 -- 172.21.15.37:0/1645228467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59bc159800 con 0x7f59bc15c890 2024-05-30T06:58:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59c1000640 1 -- 172.21.15.37:0/1645228467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59bc159dc0 con 0x7f59bc15c890 2024-05-30T06:58:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59c1000640 1 -- 172.21.15.37:0/1645228467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59bc0af1c0 con 0x7f59bc15c890 2024-05-30T06:58:59.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.142+0000 7f59b2a00640 1 -- 172.21.15.37:0/1645228467 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f59a4018020 con 0x7f59bc15c890 2024-05-30T06:58:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.146+0000 7f59b2a00640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f599806a030 0x7f599806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.146+0000 7f59b2a00640 1 -- 172.21.15.37:0/1645228467 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5027+0+0 (secure 0 0 0) 0x7f59a40856f0 con 0x7f59bc15c890 2024-05-30T06:58:59.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.146+0000 7f59b9e00640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f599806a030 0x7f599806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:59.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.146+0000 7f59b9e00640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f599806a030 0x7f599806c4f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f59ac007fd0 tx=0x7f59ac007c20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:59.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.150+0000 7f59b2a00640 1 -- 172.21.15.37:0/1645228467 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f59bc0af1c0 con 0x7f59bc15c890 2024-05-30T06:58:59.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.314+0000 7f59c1000640 1 -- 172.21.15.37:0/1645228467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f59bc0afdf0 con 0x7f59bc15c890 2024-05-30T06:58:59.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.318+0000 7f59b2a00640 1 -- 172.21.15.37:0/1645228467 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) ==== 104+0+0 (secure 0 0 0) 0x7f59a401f030 con 0x7f59bc15c890 2024-05-30T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.318+0000 7f59c1000640 1 -- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f599806a030 msgr2=0x7f599806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.318+0000 7f59c1000640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f599806a030 0x7f599806c4f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f59ac007fd0 tx=0x7f59ac007c20 comp rx=0 tx=0).stop 2024-05-30T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.318+0000 7f59c1000640 1 -- 172.21.15.37:0/1645228467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59bc15c890 msgr2=0x7f59bc16a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.318+0000 7f59c1000640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59bc15c890 0x7f59bc16a480 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f59a400b440 tx=0x7f59a400b900 comp rx=0 tx=0).stop 2024-05-30T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.318+0000 7f59c1000640 1 -- 172.21.15.37:0/1645228467 shutdown_connections 2024-05-30T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.318+0000 7f59c1000640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f59bc15f210 0x7f59bc158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.318+0000 7f59c1000640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59bc15c890 0x7f59bc16a480 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.318+0000 7f59c1000640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f599806a030 0x7f599806c4f0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.318+0000 7f59c1000640 1 --2- 172.21.15.37:0/1645228467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59bc072e60 0x7f59bc0aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.318+0000 7f59c1000640 1 -- 172.21.15.37:0/1645228467 >> 172.21.15.37:0/1645228467 conn(0x7f59bc0b2ac0 msgr2=0x7f59bc15bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.318+0000 7f59c1000640 1 -- 172.21.15.37:0/1645228467 shutdown_connections 2024-05-30T06:58:59.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.318+0000 7f59c1000640 1 -- 172.21.15.37:0/1645228467 wait complete. 2024-05-30T06:58:59.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_3_clones_are_cancelled' 2024-05-30T06:58:59.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.478+0000 7f0620200640 1 Processor -- start 2024-05-30T06:58:59.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.478+0000 7f0620200640 1 -- start start 2024-05-30T06:58:59.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f0620200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0618155e60 0x7f06180b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:59.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f0620200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06180b2ec0 0x7f06180cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:59.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f0620200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f061815c8f0 con 0x7f061806f9a0 2024-05-30T06:58:59.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f0620200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f06180ccff0 con 0x7f0618155e60 2024-05-30T06:58:59.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f0620200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f06180ccc80 con 0x7f06180b2ec0 2024-05-30T06:58:59.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f061d800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0618155e60 0x7f06180b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:59.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f061d800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0618155e60 0x7f06180b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35732/0 (socket says 172.21.15.37:35732) 2024-05-30T06:58:59.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f061d800640 1 -- 172.21.15.37:0/1268795975 learned_addr learned my addr 172.21.15.37:0/1268795975 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:59.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f061e200640 1 --2- 172.21.15.37:0/1268795975 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06180b2ec0 0x7f06180cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:59.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f061d800640 1 -- 172.21.15.37:0/1268795975 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06180b2ec0 msgr2=0x7f06180cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:59.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f061d800640 1 --2- 172.21.15.37:0/1268795975 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06180b2ec0 0x7f06180cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f061d800640 1 -- 172.21.15.37:0/1268795975 >> v1:172.21.15.105:6789/0 conn(0x7f061806f9a0 legacy=0x7f06180cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:58:59.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f061d800640 1 -- 172.21.15.37:0/1268795975 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f061815cbd0 con 0x7f0618155e60 2024-05-30T06:58:59.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.482+0000 7f061d800640 1 --2- 172.21.15.37:0/1268795975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618155e60 0x7f06180b36a0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f060c009870 tx=0x7f060c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9995f995a4145072 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:59.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0617e00640 1 -- 172.21.15.37:0/1268795975 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c0ab5f0 con 0x7f0618155e60 2024-05-30T06:58:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0617e00640 1 -- 172.21.15.37:0/1268795975 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f060c0b0070 con 0x7f0618155e60 2024-05-30T06:58:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0617e00640 1 -- 172.21.15.37:0/1268795975 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c0ab9b0 con 0x7f0618155e60 2024-05-30T06:58:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 -- 172.21.15.37:0/1268795975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618155e60 msgr2=0x7f06180b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 --2- 172.21.15.37:0/1268795975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618155e60 0x7f06180b36a0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f060c009870 tx=0x7f060c01c520 comp rx=0 tx=0).stop 2024-05-30T06:58:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 -- 172.21.15.37:0/1268795975 shutdown_connections 2024-05-30T06:58:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 --2- 172.21.15.37:0/1268795975 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06180b2ec0 0x7f06180cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 --2- 172.21.15.37:0/1268795975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618155e60 0x7f06180b36a0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 -- 172.21.15.37:0/1268795975 >> 172.21.15.37:0/1268795975 conn(0x7f06180b23a0 msgr2=0x7f06180b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 -- 172.21.15.37:0/1268795975 shutdown_connections 2024-05-30T06:58:59.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 -- 172.21.15.37:0/1268795975 wait complete. 2024-05-30T06:58:59.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 Processor -- start 2024-05-30T06:58:59.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 -- start start 2024-05-30T06:58:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f061806f9a0 0x7f0618145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06180b2ec0 0x7f0618149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0618155e60 0x7f0618144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f06181689f0 con 0x7f06180b2ec0 2024-05-30T06:58:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0618168870 con 0x7f0618155e60 2024-05-30T06:58:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f0620200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0618168b70 con 0x7f061806f9a0 2024-05-30T06:58:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f061ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06180b2ec0 0x7f0618149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f061ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06180b2ec0 0x7f0618149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35744/0 (socket says 172.21.15.37:35744) 2024-05-30T06:58:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f061ce00640 1 -- 172.21.15.37:0/2053003797 learned_addr learned my addr 172.21.15.37:0/2053003797 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:58:59.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.486+0000 7f061d800640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f061806f9a0 0x7f0618145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f061e200640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0618155e60 0x7f0618144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f061ce00640 1 -- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f061806f9a0 msgr2=0x7f0618145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f061ce00640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f061806f9a0 0x7f0618145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f061ce00640 1 -- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0618155e60 msgr2=0x7f0618144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f061ce00640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0618155e60 0x7f0618144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f061ce00640 1 -- 172.21.15.37:0/2053003797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0618145760 con 0x7f06180b2ec0 2024-05-30T06:58:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f061ce00640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06180b2ec0 0x7f0618149720 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f060400c450 tx=0x7f060400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f0615600640 1 -- 172.21.15.37:0/2053003797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604012830 con 0x7f06180b2ec0 2024-05-30T06:58:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f0615600640 1 -- 172.21.15.37:0/2053003797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0604017070 con 0x7f06180b2ec0 2024-05-30T06:58:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f0615600640 1 -- 172.21.15.37:0/2053003797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604012c30 con 0x7f06180b2ec0 2024-05-30T06:58:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f0620200640 1 -- 172.21.15.37:0/2053003797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0618145a40 con 0x7f06180b2ec0 2024-05-30T06:58:59.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f0620200640 1 -- 172.21.15.37:0/2053003797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0618146000 con 0x7f06180b2ec0 2024-05-30T06:58:59.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f0620200640 1 -- 172.21.15.37:0/2053003797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0618068b20 con 0x7f06180b2ec0 2024-05-30T06:58:59.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f0615600640 1 -- 172.21.15.37:0/2053003797 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f060401c460 con 0x7f06180b2ec0 2024-05-30T06:58:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f0615600640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f05f806a030 0x7f05f806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:58:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.490+0000 7f0615600640 1 -- 172.21.15.37:0/2053003797 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5027+0+0 (secure 0 0 0) 0x7f0604085620 con 0x7f06180b2ec0 2024-05-30T06:58:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.494+0000 7f061d800640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f05f806a030 0x7f05f806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:58:59.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.494+0000 7f061d800640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f05f806a030 0x7f05f806c4f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f060c0af000 tx=0x7f060c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:58:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.498+0000 7f0615600640 1 -- 172.21.15.37:0/2053003797 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0604056ff0 con 0x7f06180b2ec0 2024-05-30T06:58:59.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.718+0000 7f0620200640 1 -- 172.21.15.37:0/2053003797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_3_clones_are_cancelled"]} v 0) -- 0x7f06180cc940 con 0x7f06180b2ec0 2024-05-30T06:58:59.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.950+0000 7f0615600640 1 -- 172.21.15.37:0/2053003797 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_3_clones_are_cancelled"]}]=0 v764) ==== 163+0+0 (secure 0 0 0) 0x7f060405b2f0 con 0x7f06180b2ec0 2024-05-30T06:58:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.954+0000 7f0620200640 1 -- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f05f806a030 msgr2=0x7f05f806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.954+0000 7f0620200640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f05f806a030 0x7f05f806c4f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f060c0af000 tx=0x7f060c0a7000 comp rx=0 tx=0).stop 2024-05-30T06:58:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.954+0000 7f0620200640 1 -- 172.21.15.37:0/2053003797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06180b2ec0 msgr2=0x7f0618149720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:58:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.954+0000 7f0620200640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06180b2ec0 0x7f0618149720 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f060400c450 tx=0x7f060400c910 comp rx=0 tx=0).stop 2024-05-30T06:58:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.954+0000 7f0620200640 1 -- 172.21.15.37:0/2053003797 shutdown_connections 2024-05-30T06:58:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.954+0000 7f0620200640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f05f806a030 0x7f05f806c4f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.954+0000 7f0620200640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0618155e60 0x7f0618144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.954+0000 7f0620200640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06180b2ec0 0x7f0618149720 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.954+0000 7f0620200640 1 --2- 172.21.15.37:0/2053003797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f061806f9a0 0x7f0618145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:58:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.954+0000 7f0620200640 1 -- 172.21.15.37:0/2053003797 >> 172.21.15.37:0/2053003797 conn(0x7f06180b23a0 msgr2=0x7f06180b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:58:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.954+0000 7f0620200640 1 -- 172.21.15.37:0/2053003797 shutdown_connections 2024-05-30T06:58:59.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:58:59.954+0000 7f0620200640 1 -- 172.21.15.37:0/2053003797 wait complete. 2024-05-30T06:58:59.976 INFO:tasks.cephfs_test_runner:Test that progress bars, that printed for 3 ongoing clone jobs, are ... ok 2024-05-30T06:58:59.976 INFO:tasks.cephfs_test_runner:Starting test: test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) Test that both the progress bars, that are printed for all 7 clone 2024-05-30T06:58:59.976 INFO:tasks.cephfs_test_runner:test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T06:58:59.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:59:00.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f1422800640 1 Processor -- start 2024-05-30T06:59:00.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f1422800640 1 -- start start 2024-05-30T06:59:00.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f1422800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f141c06f9a0 0x7f141c0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f1422800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f141c0b2ec0 0x7f141c0cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f1422800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141c15c8f0 con 0x7f141c155e60 2024-05-30T06:59:00.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f1422800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f141c0ccff0 con 0x7f141c06f9a0 2024-05-30T06:59:00.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f1422800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f141c0ccc80 con 0x7f141c0b2ec0 2024-05-30T06:59:00.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f1413e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f141c06f9a0 0x7f141c0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f141b400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f141c155e60 0x7f141c0cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47368/0 (socket says 172.21.15.37:47368) 2024-05-30T06:59:00.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f141b400640 1 -- 172.21.15.37:0/463969172 learned_addr learned my addr 172.21.15.37:0/463969172 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:00.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f141be00640 1 --2- 172.21.15.37:0/463969172 >> v2:172.21.15.105:3300/0 conn(0x7f141c0b2ec0 0x7f141c0cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f1413e00640 1 -- 172.21.15.37:0/463969172 >> v2:172.21.15.105:3300/0 conn(0x7f141c0b2ec0 msgr2=0x7f141c0cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:00.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f1413e00640 1 --2- 172.21.15.37:0/463969172 >> v2:172.21.15.105:3300/0 conn(0x7f141c0b2ec0 0x7f141c0cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f1413e00640 1 -- 172.21.15.37:0/463969172 >> v1:172.21.15.37:6789/0 conn(0x7f141c155e60 legacy=0x7f141c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.118+0000 7f1413e00640 1 -- 172.21.15.37:0/463969172 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141c15cbd0 con 0x7f141c06f9a0 2024-05-30T06:59:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.122+0000 7f1413e00640 1 --2- 172.21.15.37:0/463969172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c06f9a0 0x7f141c0b36a0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f141c0718e0 tx=0x7f140401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e941f65e2e271292 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.122+0000 7f141aa00640 1 -- 172.21.15.37:0/463969172 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14040b1070 con 0x7f141c06f9a0 2024-05-30T06:59:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.122+0000 7f141aa00640 1 -- 172.21.15.37:0/463969172 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14040ac5f0 con 0x7f141c06f9a0 2024-05-30T06:59:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.122+0000 7f141aa00640 1 -- 172.21.15.37:0/463969172 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14040ac9c0 con 0x7f141c06f9a0 2024-05-30T06:59:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.122+0000 7f1422800640 1 -- 172.21.15.37:0/463969172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c06f9a0 msgr2=0x7f141c0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.122+0000 7f1422800640 1 --2- 172.21.15.37:0/463969172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c06f9a0 0x7f141c0b36a0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f141c0718e0 tx=0x7f140401c480 comp rx=0 tx=0).stop 2024-05-30T06:59:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.122+0000 7f1422800640 1 -- 172.21.15.37:0/463969172 shutdown_connections 2024-05-30T06:59:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.122+0000 7f1422800640 1 --2- 172.21.15.37:0/463969172 >> v2:172.21.15.105:3300/0 conn(0x7f141c0b2ec0 0x7f141c0cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.122+0000 7f1422800640 1 --2- 172.21.15.37:0/463969172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c06f9a0 0x7f141c0b36a0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.122+0000 7f1422800640 1 -- 172.21.15.37:0/463969172 >> 172.21.15.37:0/463969172 conn(0x7f141c0b23a0 msgr2=0x7f141c0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.122+0000 7f1422800640 1 -- 172.21.15.37:0/463969172 shutdown_connections 2024-05-30T06:59:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.122+0000 7f1422800640 1 -- 172.21.15.37:0/463969172 wait complete. 2024-05-30T06:59:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1422800640 1 Processor -- start 2024-05-30T06:59:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1422800640 1 -- start start 2024-05-30T06:59:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1422800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c06f9a0 0x7f141c1507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1422800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f141c0b2ec0 0x7f141c157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1422800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f141c155e60 0x7f141c157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1422800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f141c1689f0 con 0x7f141c06f9a0 2024-05-30T06:59:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1422800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f141c168870 con 0x7f141c0b2ec0 2024-05-30T06:59:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1422800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f141c168b70 con 0x7f141c155e60 2024-05-30T06:59:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f141b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c06f9a0 0x7f141c1507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f141b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c06f9a0 0x7f141c1507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35770/0 (socket says 172.21.15.37:35770) 2024-05-30T06:59:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f141b400640 1 -- 172.21.15.37:0/1926668418 learned_addr learned my addr 172.21.15.37:0/1926668418 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f141be00640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f141c155e60 0x7f141c157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1413e00640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f141c0b2ec0 0x7f141c157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f141b400640 1 -- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f141c155e60 msgr2=0x7f141c157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f141b400640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f141c155e60 0x7f141c157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f141b400640 1 -- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f141c0b2ec0 msgr2=0x7f141c157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f141b400640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f141c0b2ec0 0x7f141c157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f141b400640 1 -- 172.21.15.37:0/1926668418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141c1585e0 con 0x7f141c06f9a0 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1413e00640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f141c0b2ec0 0x7f141c157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f141be00640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f141c155e60 0x7f141c157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f141b400640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c06f9a0 0x7f141c1507c0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f140c00c3a0 tx=0x7f140c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1413400640 1 -- 172.21.15.37:0/1926668418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c017070 con 0x7f141c06f9a0 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1413400640 1 -- 172.21.15.37:0/1926668418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f140c005cf0 con 0x7f141c06f9a0 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1413400640 1 -- 172.21.15.37:0/1926668418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c0072f0 con 0x7f141c06f9a0 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1422800640 1 -- 172.21.15.37:0/1926668418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141c1588c0 con 0x7f141c06f9a0 2024-05-30T06:59:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1422800640 1 -- 172.21.15.37:0/1926668418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f141c158e80 con 0x7f141c06f9a0 2024-05-30T06:59:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.126+0000 7f1422800640 1 -- 172.21.15.37:0/1926668418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f141c068b20 con 0x7f141c06f9a0 2024-05-30T06:59:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.130+0000 7f1413400640 1 -- 172.21.15.37:0/1926668418 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f140c01a070 con 0x7f141c06f9a0 2024-05-30T06:59:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.130+0000 7f1413400640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f13f806a030 0x7f13f806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.130+0000 7f1413400640 1 -- 172.21.15.37:0/1926668418 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5027+0+0 (secure 0 0 0) 0x7f140c084c30 con 0x7f141c06f9a0 2024-05-30T06:59:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.130+0000 7f1413e00640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f13f806a030 0x7f13f806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.130+0000 7f1413e00640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f13f806a030 0x7f13f806c4f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f14040ae000 tx=0x7f14040a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.134+0000 7f1413400640 1 -- 172.21.15.37:0/1926668418 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f140c056cd0 con 0x7f141c06f9a0 2024-05-30T06:59:00.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.310+0000 7f1422800640 1 -- 172.21.15.37:0/1926668418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f141c075440 con 0x7f141c06f9a0 2024-05-30T06:59:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.314+0000 7f1413400640 1 -- 172.21.15.37:0/1926668418 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+13151 (secure 0 0 0) 0x7f140c0565d0 con 0x7f141c06f9a0 2024-05-30T06:59:00.314 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:00.314 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":120,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:58:58.937902+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/1475971506":"2024-05-31T06:58:55.928174+0000","172.21.15.37:6834/1475971506":"2024-05-31T06:58:55.928174+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:59:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.314+0000 7f1422800640 1 -- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f13f806a030 msgr2=0x7f13f806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.314+0000 7f1422800640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f13f806a030 0x7f13f806c4f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f14040ae000 tx=0x7f14040a7000 comp rx=0 tx=0).stop 2024-05-30T06:59:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.314+0000 7f1422800640 1 -- 172.21.15.37:0/1926668418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c06f9a0 msgr2=0x7f141c1507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.314+0000 7f1422800640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c06f9a0 0x7f141c1507c0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f140c00c3a0 tx=0x7f140c00c860 comp rx=0 tx=0).stop 2024-05-30T06:59:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.314+0000 7f1422800640 1 -- 172.21.15.37:0/1926668418 shutdown_connections 2024-05-30T06:59:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.314+0000 7f1422800640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f141c155e60 0x7f141c157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.314+0000 7f1422800640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f13f806a030 0x7f13f806c4f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.314+0000 7f1422800640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f141c0b2ec0 0x7f141c157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.314+0000 7f1422800640 1 --2- 172.21.15.37:0/1926668418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c06f9a0 0x7f141c1507c0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.314+0000 7f1422800640 1 -- 172.21.15.37:0/1926668418 >> 172.21.15.37:0/1926668418 conn(0x7f141c0b23a0 msgr2=0x7f141c0b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.314+0000 7f1422800640 1 -- 172.21.15.37:0/1926668418 shutdown_connections 2024-05-30T06:59:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.314+0000 7f1422800640 1 -- 172.21.15.37:0/1926668418 wait complete. 2024-05-30T06:59:00.336 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:59:00.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:59:00.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.478+0000 7fe32a800640 1 Processor -- start 2024-05-30T06:59:00.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.478+0000 7fe32a800640 1 -- start start 2024-05-30T06:59:00.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe32a800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32415c9a0 0x7fe3240cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe32a800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe3240cffd0 0x7fe3240afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe32a800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3240af0d0 con 0x7fe3240d0600 2024-05-30T06:59:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe32a800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe3240ce000 con 0x7fe3240cffd0 2024-05-30T06:59:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe32a800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe3240ce2e0 con 0x7fe32415c9a0 2024-05-30T06:59:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe328a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32415c9a0 0x7fe3240cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe328a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32415c9a0 0x7fe3240cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:33054/0 (socket says 172.21.15.37:33054) 2024-05-30T06:59:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe329400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fe3240d0600 0x7fe3240d09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:58948/0 (socket says 172.21.15.37:58948) 2024-05-30T06:59:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe328a00640 1 -- 172.21.15.37:0/3791197275 learned_addr learned my addr 172.21.15.37:0/3791197275 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:00.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe329e00640 1 --2- 172.21.15.37:0/3791197275 >> v2:172.21.15.105:3300/0 conn(0x7fe3240cffd0 0x7fe3240afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe328a00640 1 -- 172.21.15.37:0/3791197275 >> v2:172.21.15.105:3300/0 conn(0x7fe3240cffd0 msgr2=0x7fe3240afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:00.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe328a00640 1 --2- 172.21.15.37:0/3791197275 >> v2:172.21.15.105:3300/0 conn(0x7fe3240cffd0 0x7fe3240afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe328a00640 1 -- 172.21.15.37:0/3791197275 >> v1:172.21.15.105:6789/0 conn(0x7fe3240d0600 legacy=0x7fe3240d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe328a00640 1 -- 172.21.15.37:0/3791197275 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3240af370 con 0x7fe32415c9a0 2024-05-30T06:59:00.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.482+0000 7fe323e00640 1 -- 172.21.15.37:0/3791197275 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604021591 0 0) 0x7fe3240af0d0 con 0x7fe3240d0600 2024-05-30T06:59:00.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe328a00640 1 --2- 172.21.15.37:0/3791197275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32415c9a0 0x7fe3240cd9d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe3100098a0 tx=0x7fe31001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a205abfe3ca964ce server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:00.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe323e00640 1 -- 172.21.15.37:0/3791197275 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100ab640 con 0x7fe32415c9a0 2024-05-30T06:59:00.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe323e00640 1 -- 172.21.15.37:0/3791197275 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3100b0070 con 0x7fe32415c9a0 2024-05-30T06:59:00.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe323e00640 1 -- 172.21.15.37:0/3791197275 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100aba00 con 0x7fe32415c9a0 2024-05-30T06:59:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 -- 172.21.15.37:0/3791197275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32415c9a0 msgr2=0x7fe3240cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 --2- 172.21.15.37:0/3791197275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32415c9a0 0x7fe3240cd9d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe3100098a0 tx=0x7fe31001c510 comp rx=0 tx=0).stop 2024-05-30T06:59:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 -- 172.21.15.37:0/3791197275 shutdown_connections 2024-05-30T06:59:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 --2- 172.21.15.37:0/3791197275 >> v2:172.21.15.105:3300/0 conn(0x7fe3240cffd0 0x7fe3240afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 --2- 172.21.15.37:0/3791197275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe32415c9a0 0x7fe3240cd9d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 -- 172.21.15.37:0/3791197275 >> 172.21.15.37:0/3791197275 conn(0x7fe3240b3ef0 msgr2=0x7fe3240b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:00.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 -- 172.21.15.37:0/3791197275 shutdown_connections 2024-05-30T06:59:00.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 -- 172.21.15.37:0/3791197275 wait complete. 2024-05-30T06:59:00.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 Processor -- start 2024-05-30T06:59:00.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 -- start start 2024-05-30T06:59:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3240cffd0 0x7fe32415de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3240d0600 0x7fe3241569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe32415c9a0 0x7fe3240cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3240b0c50 con 0x7fe3240d0600 2024-05-30T06:59:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe3240b0ad0 con 0x7fe32415c9a0 2024-05-30T06:59:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.486+0000 7fe32a800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe3240b0dd0 con 0x7fe3240cffd0 2024-05-30T06:59:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe328a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3240d0600 0x7fe3241569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe328a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3240d0600 0x7fe3241569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35782/0 (socket says 172.21.15.37:35782) 2024-05-30T06:59:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe328a00640 1 -- 172.21.15.37:0/1773508806 learned_addr learned my addr 172.21.15.37:0/1773508806 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe329e00640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe32415c9a0 0x7fe3240cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe329400640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3240cffd0 0x7fe32415de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe328a00640 1 -- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3240cffd0 msgr2=0x7fe32415de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe328a00640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3240cffd0 0x7fe32415de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe328a00640 1 -- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe32415c9a0 msgr2=0x7fe3240cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe328a00640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe32415c9a0 0x7fe3240cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe328a00640 1 -- 172.21.15.37:0/1773508806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3240cc2e0 con 0x7fe3240d0600 2024-05-30T06:59:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe328a00640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3240d0600 0x7fe3241569d0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fe31001a140 tx=0x7fe3100192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:00.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe321600640 1 -- 172.21.15.37:0/1773508806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100abe40 con 0x7fe3240d0600 2024-05-30T06:59:00.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe321600640 1 -- 172.21.15.37:0/1773508806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe310004020 con 0x7fe3240d0600 2024-05-30T06:59:00.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe321600640 1 -- 172.21.15.37:0/1773508806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100043d0 con 0x7fe3240d0600 2024-05-30T06:59:00.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe32a800640 1 -- 172.21.15.37:0/1773508806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32415e480 con 0x7fe3240d0600 2024-05-30T06:59:00.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe32a800640 1 -- 172.21.15.37:0/1773508806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32415ea40 con 0x7fe3240d0600 2024-05-30T06:59:00.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe32a800640 1 -- 172.21.15.37:0/1773508806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe324068ab0 con 0x7fe3240d0600 2024-05-30T06:59:00.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.490+0000 7fe321600640 1 -- 172.21.15.37:0/1773508806 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fe310003620 con 0x7fe3240d0600 2024-05-30T06:59:00.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.494+0000 7fe321600640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe30406a060 0x7fe30406c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.494+0000 7fe321600640 1 -- 172.21.15.37:0/1773508806 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5027+0+0 (secure 0 0 0) 0x7fe31011fd80 con 0x7fe3240d0600 2024-05-30T06:59:00.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.494+0000 7fe329400640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe30406a060 0x7fe30406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.494+0000 7fe329400640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe30406a060 0x7fe30406c520 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe318000f70 tx=0x7fe318007e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:00.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.498+0000 7fe321600640 1 -- 172.21.15.37:0/1773508806 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe310016130 con 0x7fe3240d0600 2024-05-30T06:59:00.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.662+0000 7fe32a800640 1 -- 172.21.15.37:0/1773508806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe3240ce930 con 0x7fe3240d0600 2024-05-30T06:59:00.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.662+0000 7fe321600640 1 -- 172.21.15.37:0/1773508806 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v120) ==== 93+0+10 (secure 0 0 0) 0x7fe3100f17f0 con 0x7fe3240d0600 2024-05-30T06:59:00.663 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.662+0000 7fe32a800640 1 -- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe30406a060 msgr2=0x7fe30406c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.662+0000 7fe32a800640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe30406a060 0x7fe30406c520 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe318000f70 tx=0x7fe318007e10 comp rx=0 tx=0).stop 2024-05-30T06:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.662+0000 7fe32a800640 1 -- 172.21.15.37:0/1773508806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3240d0600 msgr2=0x7fe3241569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.662+0000 7fe32a800640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3240d0600 0x7fe3241569d0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fe31001a140 tx=0x7fe3100192b0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.662+0000 7fe32a800640 1 -- 172.21.15.37:0/1773508806 shutdown_connections 2024-05-30T06:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.662+0000 7fe32a800640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe30406a060 0x7fe30406c520 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.662+0000 7fe32a800640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe32415c9a0 0x7fe3240cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.662+0000 7fe32a800640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3240d0600 0x7fe3241569d0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.662+0000 7fe32a800640 1 --2- 172.21.15.37:0/1773508806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3240cffd0 0x7fe32415de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.662+0000 7fe32a800640 1 -- 172.21.15.37:0/1773508806 >> 172.21.15.37:0/1773508806 conn(0x7fe3240b3ef0 msgr2=0x7fe3240b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:00.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.666+0000 7fe32a800640 1 -- 172.21.15.37:0/1773508806 shutdown_connections 2024-05-30T06:59:00.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.666+0000 7fe32a800640 1 -- 172.21.15.37:0/1773508806 wait complete. 2024-05-30T06:59:00.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_7_clones_are_cancelled' 2024-05-30T06:59:00.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feafba00640 1 Processor -- start 2024-05-30T06:59:00.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feafba00640 1 -- start start 2024-05-30T06:59:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feafba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaf415eb50 0x7feaf40d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feafba00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feaf40cfd50 0x7feaf40b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feafba00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaf40d3280 con 0x7feaf40ba290 2024-05-30T06:59:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feafba00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7feaf415ef30 con 0x7feaf40cfd50 2024-05-30T06:59:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feafba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feaf40d3500 con 0x7feaf415eb50 2024-05-30T06:59:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feaf9a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feaf40cfd50 0x7feaf40b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feaf9000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaf415eb50 0x7feaf40d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feaf9a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feaf40cfd50 0x7feaf40b7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59152/0 (socket says 172.21.15.37:59152) 2024-05-30T06:59:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feaf9a00640 1 -- 172.21.15.37:0/2898296348 learned_addr learned my addr 172.21.15.37:0/2898296348 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feaf9a00640 1 -- 172.21.15.37:0/2898296348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaf415eb50 msgr2=0x7feaf40d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feaf9a00640 1 --2- 172.21.15.37:0/2898296348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaf415eb50 0x7feaf40d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feaf9a00640 1 -- 172.21.15.37:0/2898296348 >> v1:172.21.15.105:6789/0 conn(0x7feaf40ba290 legacy=0x7feaf40cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.826+0000 7feaf9a00640 1 -- 172.21.15.37:0/2898296348 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf40d37e0 con 0x7feaf40cfd50 2024-05-30T06:59:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.830+0000 7feaf9a00640 1 --2- 172.21.15.37:0/2898296348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaf40cfd50 0x7feaf40b7aa0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7feaec009870 tx=0x7feaec01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=622b3678fd5f56eb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.830+0000 7feaf3e00640 1 -- 172.21.15.37:0/2898296348 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec0a95f0 con 0x7feaf40cfd50 2024-05-30T06:59:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.830+0000 7feaf3e00640 1 -- 172.21.15.37:0/2898296348 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaec0a9790 con 0x7feaf40cfd50 2024-05-30T06:59:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.830+0000 7feaf3e00640 1 -- 172.21.15.37:0/2898296348 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec0a9b60 con 0x7feaf40cfd50 2024-05-30T06:59:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.830+0000 7feafba00640 1 -- 172.21.15.37:0/2898296348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaf40cfd50 msgr2=0x7feaf40b7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.830+0000 7feafba00640 1 --2- 172.21.15.37:0/2898296348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaf40cfd50 0x7feaf40b7aa0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7feaec009870 tx=0x7feaec01c530 comp rx=0 tx=0).stop 2024-05-30T06:59:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.830+0000 7feafba00640 1 -- 172.21.15.37:0/2898296348 shutdown_connections 2024-05-30T06:59:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.830+0000 7feafba00640 1 --2- 172.21.15.37:0/2898296348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaf40cfd50 0x7feaf40b7aa0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.830+0000 7feafba00640 1 --2- 172.21.15.37:0/2898296348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaf415eb50 0x7feaf40d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.830+0000 7feafba00640 1 -- 172.21.15.37:0/2898296348 >> 172.21.15.37:0/2898296348 conn(0x7feaf40d13f0 msgr2=0x7feaf40d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.830+0000 7feafba00640 1 -- 172.21.15.37:0/2898296348 shutdown_connections 2024-05-30T06:59:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.830+0000 7feafba00640 1 -- 172.21.15.37:0/2898296348 wait complete. 2024-05-30T06:59:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feafba00640 1 Processor -- start 2024-05-30T06:59:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feafba00640 1 -- start start 2024-05-30T06:59:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feafba00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaf40ba290 0x7feaf40cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feafba00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feaf40cfd50 0x7feaf4161920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feafba00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaf415eb50 0x7feaf40c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feafba00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feaf40b87f0 con 0x7feaf40cfd50 2024-05-30T06:59:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feafba00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feaf40d45a0 con 0x7feaf415eb50 2024-05-30T06:59:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feafba00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feaf40b8970 con 0x7feaf40ba290 2024-05-30T06:59:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feaf40cfd50 0x7feaf4161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feaf40cfd50 0x7feaf4161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35798/0 (socket says 172.21.15.37:35798) 2024-05-30T06:59:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaebe00640 1 -- 172.21.15.37:0/1771259243 learned_addr learned my addr 172.21.15.37:0/1771259243 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaf9a00640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaf415eb50 0x7feaf40c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaf9000640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaf40ba290 0x7feaf40cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaebe00640 1 -- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaf40ba290 msgr2=0x7feaf40cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaebe00640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaf40ba290 0x7feaf40cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaebe00640 1 -- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaf415eb50 msgr2=0x7feaf40c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaebe00640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaf415eb50 0x7feaf40c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaebe00640 1 -- 172.21.15.37:0/1771259243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf40ce0c0 con 0x7feaf40cfd50 2024-05-30T06:59:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaf9a00640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaf415eb50 0x7feaf40c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:59:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaebe00640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feaf40cfd50 0x7feaf4161920 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c420 tx=0x7feadc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaf1600640 1 -- 172.21.15.37:0/1771259243 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc0052d0 con 0x7feaf40cfd50 2024-05-30T06:59:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaf1600640 1 -- 172.21.15.37:0/1771259243 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feadc005470 con 0x7feaf40cfd50 2024-05-30T06:59:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feaf1600640 1 -- 172.21.15.37:0/1771259243 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc007260 con 0x7feaf40cfd50 2024-05-30T06:59:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feafba00640 1 -- 172.21.15.37:0/1771259243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf40ce3a0 con 0x7feaf40cfd50 2024-05-30T06:59:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.834+0000 7feafba00640 1 -- 172.21.15.37:0/1771259243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf40ce960 con 0x7feaf40cfd50 2024-05-30T06:59:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.838+0000 7feafba00640 1 -- 172.21.15.37:0/1771259243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf4068b20 con 0x7feaf40cfd50 2024-05-30T06:59:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.838+0000 7feaf1600640 1 -- 172.21.15.37:0/1771259243 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7feadc007400 con 0x7feaf40cfd50 2024-05-30T06:59:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.838+0000 7feaf1600640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fead006a030 0x7fead006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.838+0000 7feaf1600640 1 -- 172.21.15.37:0/1771259243 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5027+0+0 (secure 0 0 0) 0x7feadc084df0 con 0x7feaf40cfd50 2024-05-30T06:59:00.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.838+0000 7feaf9000640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fead006a030 0x7fead006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:00.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.838+0000 7feaf9000640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fead006a030 0x7fead006c4f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7feae4011340 tx=0x7feae400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:00.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:00.842+0000 7feaf1600640 1 -- 172.21.15.37:0/1771259243 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feaf40d3280 con 0x7feaf40cfd50 2024-05-30T06:59:01.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.070+0000 7feafba00640 1 -- 172.21.15.37:0/1771259243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_7_clones_are_cancelled"]} v 0) -- 0x7feaf4153820 con 0x7feaf40cfd50 2024-05-30T06:59:01.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.962+0000 7feaf1600640 1 -- 172.21.15.37:0/1771259243 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestCloneProgressReporter.test_when_7_clones_are_cancelled"]}]=0 v766) ==== 166+0+0 (secure 0 0 0) 0x7feadc0567c0 con 0x7feaf40cfd50 2024-05-30T06:59:01.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.962+0000 7feafba00640 1 -- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fead006a030 msgr2=0x7fead006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:01.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.962+0000 7feafba00640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fead006a030 0x7fead006c4f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7feae4011340 tx=0x7feae400b040 comp rx=0 tx=0).stop 2024-05-30T06:59:01.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.962+0000 7feafba00640 1 -- 172.21.15.37:0/1771259243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feaf40cfd50 msgr2=0x7feaf4161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:01.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.962+0000 7feafba00640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feaf40cfd50 0x7feaf4161920 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c420 tx=0x7feadc00c8e0 comp rx=0 tx=0).stop 2024-05-30T06:59:01.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.962+0000 7feafba00640 1 -- 172.21.15.37:0/1771259243 shutdown_connections 2024-05-30T06:59:01.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.962+0000 7feafba00640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fead006a030 0x7fead006c4f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:01.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.962+0000 7feafba00640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feaf415eb50 0x7feaf40c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:01.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.962+0000 7feafba00640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feaf40cfd50 0x7feaf4161920 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:01.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.962+0000 7feafba00640 1 --2- 172.21.15.37:0/1771259243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaf40ba290 0x7feaf40cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:01.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.962+0000 7feafba00640 1 -- 172.21.15.37:0/1771259243 >> 172.21.15.37:0/1771259243 conn(0x7feaf40d13f0 msgr2=0x7feaf40b8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:01.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.962+0000 7feafba00640 1 -- 172.21.15.37:0/1771259243 shutdown_connections 2024-05-30T06:59:01.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:01.966+0000 7feafba00640 1 -- 172.21.15.37:0/1771259243 wait complete. 2024-05-30T06:59:01.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:59:02.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84b0000640 1 Processor -- start 2024-05-30T06:59:02.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84b0000640 1 -- start start 2024-05-30T06:59:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84b0000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f84a815d350 0x7f84a806df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84b0000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84a815d7e0 0x7f84a806e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:02.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84b0000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84a8142030 con 0x7f84a80b59d0 2024-05-30T06:59:02.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84b0000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f84a8142310 con 0x7f84a815d350 2024-05-30T06:59:02.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84b0000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f84a81425f0 con 0x7f84a815d7e0 2024-05-30T06:59:02.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84acc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f84a815d350 0x7f84a806df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:02.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84ae000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84a815d7e0 0x7f84a806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:02.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84acc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f84a815d350 0x7f84a806df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59168/0 (socket says 172.21.15.37:59168) 2024-05-30T06:59:02.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84acc00640 1 -- 172.21.15.37:0/2728141240 learned_addr learned my addr 172.21.15.37:0/2728141240 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:02.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84acc00640 1 -- 172.21.15.37:0/2728141240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84a815d7e0 msgr2=0x7f84a806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:02.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84acc00640 1 --2- 172.21.15.37:0/2728141240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84a815d7e0 0x7f84a806e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84acc00640 1 -- 172.21.15.37:0/2728141240 >> v1:172.21.15.105:6789/0 conn(0x7f84a80b59d0 legacy=0x7f84a80b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:02.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84acc00640 1 -- 172.21.15.37:0/2728141240 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a81428d0 con 0x7f84a815d350 2024-05-30T06:59:02.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.138+0000 7f84ae000640 1 --2- 172.21.15.37:0/2728141240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84a815d7e0 0x7f84a806e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:59:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.142+0000 7f84acc00640 1 --2- 172.21.15.37:0/2728141240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84a815d350 0x7f84a806df50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f84940098a0 tx=0x7f849401ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b94de946eee78eca server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:02.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.142+0000 7f84a7e00640 1 -- 172.21.15.37:0/2728141240 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84940b5070 con 0x7f84a815d350 2024-05-30T06:59:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.142+0000 7f84a7e00640 1 -- 172.21.15.37:0/2728141240 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84940a8a30 con 0x7f84a815d350 2024-05-30T06:59:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.142+0000 7f84a7e00640 1 -- 172.21.15.37:0/2728141240 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84940a8e00 con 0x7f84a815d350 2024-05-30T06:59:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.142+0000 7f84b0000640 1 -- 172.21.15.37:0/2728141240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84a815d350 msgr2=0x7f84a806df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:02.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.142+0000 7f84b0000640 1 --2- 172.21.15.37:0/2728141240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84a815d350 0x7f84a806df50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f84940098a0 tx=0x7f849401ed30 comp rx=0 tx=0).stop 2024-05-30T06:59:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.142+0000 7f84b0000640 1 -- 172.21.15.37:0/2728141240 shutdown_connections 2024-05-30T06:59:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.142+0000 7f84b0000640 1 --2- 172.21.15.37:0/2728141240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84a815d7e0 0x7f84a806e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.142+0000 7f84b0000640 1 --2- 172.21.15.37:0/2728141240 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84a815d350 0x7f84a806df50 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.142+0000 7f84b0000640 1 -- 172.21.15.37:0/2728141240 >> 172.21.15.37:0/2728141240 conn(0x7f84a806bf60 msgr2=0x7f84a80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.142+0000 7f84b0000640 1 -- 172.21.15.37:0/2728141240 shutdown_connections 2024-05-30T06:59:02.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.142+0000 7f84b0000640 1 -- 172.21.15.37:0/2728141240 wait complete. 2024-05-30T06:59:02.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84b0000640 1 Processor -- start 2024-05-30T06:59:02.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84b0000640 1 -- start start 2024-05-30T06:59:02.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84b0000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84a80b59d0 0x7f84a81572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:02.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84b0000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84a815d350 0x7f84a80b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:02.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84b0000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84a815d7e0 0x7f84a812fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:02.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84b0000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f84a80b00a0 con 0x7f84a815d7e0 2024-05-30T06:59:02.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84b0000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f84a80aff20 con 0x7f84a80b59d0 2024-05-30T06:59:02.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84b0000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f84a813f860 con 0x7f84a815d350 2024-05-30T06:59:02.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84ae000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84a815d7e0 0x7f84a812fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:02.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84ae000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84a815d7e0 0x7f84a812fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35806/0 (socket says 172.21.15.37:35806) 2024-05-30T06:59:02.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84ae000640 1 -- 172.21.15.37:0/2908810022 learned_addr learned my addr 172.21.15.37:0/2908810022 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:02.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84acc00640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84a815d350 0x7f84a80b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:02.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84ad600640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84a80b59d0 0x7f84a81572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:02.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84ae000640 1 -- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84a815d350 msgr2=0x7f84a80b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:02.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84ae000640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84a815d350 0x7f84a80b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84ae000640 1 -- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84a80b59d0 msgr2=0x7f84a81572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:02.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84ae000640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84a80b59d0 0x7f84a81572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84ae000640 1 -- 172.21.15.37:0/2908810022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a80b4220 con 0x7f84a815d7e0 2024-05-30T06:59:02.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84ae000640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84a815d7e0 0x7f84a812fc50 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009f00 tx=0x7f84a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:02.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84a5600640 1 -- 172.21.15.37:0/2908810022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a0018030 con 0x7f84a815d7e0 2024-05-30T06:59:02.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84a5600640 1 -- 172.21.15.37:0/2908810022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a000ce50 con 0x7f84a815d7e0 2024-05-30T06:59:02.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84b0000640 1 -- 172.21.15.37:0/2908810022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a80b4500 con 0x7f84a815d7e0 2024-05-30T06:59:02.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84a5600640 1 -- 172.21.15.37:0/2908810022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a0003bc0 con 0x7f84a815d7e0 2024-05-30T06:59:02.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.146+0000 7f84b0000640 1 -- 172.21.15.37:0/2908810022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a80b4ac0 con 0x7f84a815d7e0 2024-05-30T06:59:02.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.150+0000 7f84b0000640 1 -- 172.21.15.37:0/2908810022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a8068bc0 con 0x7f84a815d7e0 2024-05-30T06:59:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.150+0000 7f84a5600640 1 -- 172.21.15.37:0/2908810022 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f84a001b070 con 0x7f84a815d7e0 2024-05-30T06:59:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.150+0000 7f84a5600640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f848806a030 0x7f848806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:02.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.150+0000 7f84a5600640 1 -- 172.21.15.37:0/2908810022 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5027+0+0 (secure 0 0 0) 0x7f84a0086290 con 0x7f84a815d7e0 2024-05-30T06:59:02.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.150+0000 7f84ad600640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f848806a030 0x7f848806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:02.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.150+0000 7f84ad600640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f848806a030 0x7f848806c4f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f849c001770 tx=0x7f849c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:02.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.154+0000 7f84a5600640 1 -- 172.21.15.37:0/2908810022 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f84a0010040 con 0x7f84a815d7e0 2024-05-30T06:59:02.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.322+0000 7f84b0000640 1 -- 172.21.15.37:0/2908810022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f84a806f0a0 con 0x7f84a815d7e0 2024-05-30T06:59:02.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.326+0000 7f84a5600640 1 -- 172.21.15.37:0/2908810022 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f84a0057c60 con 0x7f84a815d7e0 2024-05-30T06:59:02.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.330+0000 7f84b0000640 1 -- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f848806a030 msgr2=0x7f848806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:02.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.330+0000 7f84b0000640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f848806a030 0x7f848806c4f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f849c001770 tx=0x7f849c009040 comp rx=0 tx=0).stop 2024-05-30T06:59:02.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.330+0000 7f84b0000640 1 -- 172.21.15.37:0/2908810022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84a815d7e0 msgr2=0x7f84a812fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:02.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.330+0000 7f84b0000640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84a815d7e0 0x7f84a812fc50 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009f00 tx=0x7f84a000c490 comp rx=0 tx=0).stop 2024-05-30T06:59:02.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.330+0000 7f84b0000640 1 -- 172.21.15.37:0/2908810022 shutdown_connections 2024-05-30T06:59:02.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.330+0000 7f84b0000640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84a815d7e0 0x7f84a812fc50 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.330+0000 7f84b0000640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84a815d350 0x7f84a80b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.330+0000 7f84b0000640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f848806a030 0x7f848806c4f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.330+0000 7f84b0000640 1 --2- 172.21.15.37:0/2908810022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84a80b59d0 0x7f84a81572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.330+0000 7f84b0000640 1 -- 172.21.15.37:0/2908810022 >> 172.21.15.37:0/2908810022 conn(0x7f84a806bf60 msgr2=0x7f84a80b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:02.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.330+0000 7f84b0000640 1 -- 172.21.15.37:0/2908810022 shutdown_connections 2024-05-30T06:59:02.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.330+0000 7f84b0000640 1 -- 172.21.15.37:0/2908810022 wait complete. 2024-05-30T06:59:02.351 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-05-30T06:59:02.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:59:02.435 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-30T06:59:02.536 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-05-30T06:59:02.536 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:59:02.536 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:59:02.546 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:59:02.546 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:59:02.546 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:59:02.555 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:59:02.556 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:59:02.556 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:59:02.597 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T06:59:02.597 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T06:59:02.597 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:59:02.609 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T06:59:02.609 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-30T06:59:02.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:59:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565c00640 1 Processor -- start 2024-05-30T06:59:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565c00640 1 -- start start 2024-05-30T06:59:02.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f356006c970 0x7f356006cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:02.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f35600731c0 0x7f35601601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:02.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f35600cd220 0x7f3560160730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:02.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f356006d290 con 0x7f35600cd220 2024-05-30T06:59:02.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f356015cec0 con 0x7f35600731c0 2024-05-30T06:59:02.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f356015d1a0 con 0x7f356006c970 2024-05-30T06:59:02.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f35600cd220 0x7f3560160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:02.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f35600cd220 0x7f3560160730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35814/0 (socket says 172.21.15.37:35814) 2024-05-30T06:59:02.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565200640 1 -- 172.21.15.37:0/3217768708 learned_addr learned my addr 172.21.15.37:0/3217768708 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565200640 1 -- 172.21.15.37:0/3217768708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f356006c970 msgr2=0x7f356006cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565200640 1 --2- 172.21.15.37:0/3217768708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f356006c970 0x7f356006cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565200640 1 -- 172.21.15.37:0/3217768708 >> v2:172.21.15.105:3300/0 conn(0x7f35600731c0 msgr2=0x7f35601601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565200640 1 --2- 172.21.15.37:0/3217768708 >> v2:172.21.15.105:3300/0 conn(0x7f35600731c0 0x7f35601601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.782+0000 7f3565200640 1 -- 172.21.15.37:0/3217768708 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356015d480 con 0x7f35600cd220 2024-05-30T06:59:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f3565200640 1 --2- 172.21.15.37:0/3217768708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35600cd220 0x7f3560160730 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f356006e480 tx=0x7f355801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d510f0e3c22db8f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f355ea00640 1 -- 172.21.15.37:0/3217768708 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580a5780 con 0x7f35600cd220 2024-05-30T06:59:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f355ea00640 1 -- 172.21.15.37:0/3217768708 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35580a5920 con 0x7f35600cd220 2024-05-30T06:59:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f355ea00640 1 -- 172.21.15.37:0/3217768708 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580a5cf0 con 0x7f35600cd220 2024-05-30T06:59:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f3565c00640 1 -- 172.21.15.37:0/3217768708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35600cd220 msgr2=0x7f3560160730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f3565c00640 1 --2- 172.21.15.37:0/3217768708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35600cd220 0x7f3560160730 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f356006e480 tx=0x7f355801c9f0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f3565c00640 1 -- 172.21.15.37:0/3217768708 shutdown_connections 2024-05-30T06:59:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f3565c00640 1 --2- 172.21.15.37:0/3217768708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35600cd220 0x7f3560160730 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f3565c00640 1 --2- 172.21.15.37:0/3217768708 >> v2:172.21.15.105:3300/0 conn(0x7f35600731c0 0x7f35601601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f3565c00640 1 --2- 172.21.15.37:0/3217768708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f356006c970 0x7f356006cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f3565c00640 1 -- 172.21.15.37:0/3217768708 >> 172.21.15.37:0/3217768708 conn(0x7f35600ce4f0 msgr2=0x7f35600725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f3565c00640 1 -- 172.21.15.37:0/3217768708 shutdown_connections 2024-05-30T06:59:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f3565c00640 1 -- 172.21.15.37:0/3217768708 wait complete. 2024-05-30T06:59:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f3565c00640 1 Processor -- start 2024-05-30T06:59:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.786+0000 7f3565c00640 1 -- start start 2024-05-30T06:59:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f356006c970 0x7f356013c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35600731c0 0x7f356015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35600cd220 0x7f3560155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3560067cd0 con 0x7f35600cd220 2024-05-30T06:59:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3560161080 con 0x7f356006c970 2024-05-30T06:59:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f35600cf2b0 con 0x7f35600731c0 2024-05-30T06:59:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35600cd220 0x7f3560155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35600cd220 0x7f3560155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35828/0 (socket says 172.21.15.37:35828) 2024-05-30T06:59:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565200640 1 -- 172.21.15.37:0/50156549 learned_addr learned my addr 172.21.15.37:0/50156549 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f355fe00640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f356006c970 0x7f356013c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f355f400640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35600731c0 0x7f356015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565200640 1 -- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35600731c0 msgr2=0x7f356015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565200640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35600731c0 0x7f356015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565200640 1 -- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f356006c970 msgr2=0x7f356013c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565200640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f356006c970 0x7f356013c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565200640 1 -- 172.21.15.37:0/50156549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3560156fa0 con 0x7f35600cd220 2024-05-30T06:59:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f355f400640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35600731c0 0x7f356015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f355fe00640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f356006c970 0x7f356013c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565200640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35600cd220 0x7f3560155ea0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f35580af040 tx=0x7f3558019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3557e00640 1 -- 172.21.15.37:0/50156549 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580bc070 con 0x7f35600cd220 2024-05-30T06:59:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3557e00640 1 -- 172.21.15.37:0/50156549 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35580b8440 con 0x7f35600cd220 2024-05-30T06:59:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3557e00640 1 -- 172.21.15.37:0/50156549 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3558009270 con 0x7f35600cd220 2024-05-30T06:59:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565c00640 1 -- 172.21.15.37:0/50156549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3560157280 con 0x7f35600cd220 2024-05-30T06:59:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565c00640 1 -- 172.21.15.37:0/50156549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3560157840 con 0x7f35600cd220 2024-05-30T06:59:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.790+0000 7f3565c00640 1 -- 172.21.15.37:0/50156549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3560075580 con 0x7f35600cd220 2024-05-30T06:59:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.794+0000 7f3557e00640 1 -- 172.21.15.37:0/50156549 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f35580bf070 con 0x7f35600cd220 2024-05-30T06:59:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.794+0000 7f3557e00640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f354006a060 0x7f354006c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.794+0000 7f3557e00640 1 -- 172.21.15.37:0/50156549 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5027+0+0 (secure 0 0 0) 0x7f3558120130 con 0x7f35600cd220 2024-05-30T06:59:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.794+0000 7f355fe00640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f354006a060 0x7f354006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.794+0000 7f355fe00640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f354006a060 0x7f354006c520 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3550006fd0 tx=0x7f3550008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:02.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.798+0000 7f3557e00640 1 -- 172.21.15.37:0/50156549 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f35580c6070 con 0x7f35600cd220 2024-05-30T06:59:02.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.994+0000 7f3565c00640 1 -- 172.21.15.37:0/50156549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35600678a0 con 0x7f35600cd220 2024-05-30T06:59:02.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.994+0000 7f3557e00640 1 -- 172.21.15.37:0/50156549 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+3875 (secure 0 0 0) 0x7f35580165e0 con 0x7f35600cd220 2024-05-30T06:59:02.996 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:02.996 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":77,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3908783351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3908783351},{"type":"v1","addr":"172.21.15.105:6836","nonce":3908783351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":8473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6837/2654517585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2654517585},{"type":"v1","addr":"172.21.15.105:6837","nonce":2654517585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":9117,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3433994777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3433994777},{"type":"v1","addr":"172.21.15.37:6833","nonce":3433994777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":9639,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2540177635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2540177635},{"type":"v1","addr":"172.21.15.37:6835","nonce":2540177635}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[]} 2024-05-30T06:59:02.996 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 77 2024-05-30T06:59:02.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.998+0000 7f3565c00640 1 -- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f354006a060 msgr2=0x7f354006c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:02.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.998+0000 7f3565c00640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f354006a060 0x7f354006c520 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f3550006fd0 tx=0x7f3550008040 comp rx=0 tx=0).stop 2024-05-30T06:59:02.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.998+0000 7f3565c00640 1 -- 172.21.15.37:0/50156549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35600cd220 msgr2=0x7f3560155ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:02.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.998+0000 7f3565c00640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35600cd220 0x7f3560155ea0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f35580af040 tx=0x7f3558019790 comp rx=0 tx=0).stop 2024-05-30T06:59:02.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.998+0000 7f3565c00640 1 -- 172.21.15.37:0/50156549 shutdown_connections 2024-05-30T06:59:02.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.998+0000 7f3565c00640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35600cd220 0x7f3560155ea0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.998+0000 7f3565c00640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f35600731c0 0x7f356015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.998+0000 7f3565c00640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f354006a060 0x7f354006c520 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.998+0000 7f3565c00640 1 --2- 172.21.15.37:0/50156549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f356006c970 0x7f356013c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:02.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.998+0000 7f3565c00640 1 -- 172.21.15.37:0/50156549 >> 172.21.15.37:0/50156549 conn(0x7f35600ce4f0 msgr2=0x7f35600b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:02.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.998+0000 7f3565c00640 1 -- 172.21.15.37:0/50156549 shutdown_connections 2024-05-30T06:59:02.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:02.998+0000 7f3565c00640 1 -- 172.21.15.37:0/50156549 wait complete. 2024-05-30T06:59:03.017 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-30T06:59:03.017 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-30T06:59:03.017 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T06:59:03.017 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:59:03.017 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-30T06:59:03.017 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-30T06:59:03.018 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T06:59:03.018 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:59:03.018 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-30T06:59:03.018 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-30T06:59:03.018 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T06:59:03.018 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:59:03.018 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-30T06:59:03.018 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-30T06:59:03.019 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T06:59:03.019 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T06:59:03.028 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T06:59:03.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-30T06:59:03.031 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T06:59:03.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-30T06:59:03.034 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T06:59:03.034 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-30T06:59:03.034 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T06:59:03.035 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-30T06:59:03.079 INFO:tasks.ceph.mds.a:Started 2024-05-30T06:59:03.079 DEBUG:teuthology.parallel:result is None 2024-05-30T06:59:03.080 INFO:tasks.ceph.mds.d:Started 2024-05-30T06:59:03.080 DEBUG:teuthology.parallel:result is None 2024-05-30T06:59:03.081 INFO:tasks.ceph.mds.b:Started 2024-05-30T06:59:03.081 DEBUG:teuthology.parallel:result is None 2024-05-30T06:59:03.081 INFO:tasks.ceph.mds.c:Started 2024-05-30T06:59:03.082 DEBUG:teuthology.parallel:result is None 2024-05-30T06:59:03.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-30T06:59:03.165 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2024-05-30T06:59:03.167 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2024-05-30T06:59:03.171 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-05-30T06:59:03.171 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-05-30T06:59:03.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.226+0000 7fada0000640 1 Processor -- start 2024-05-30T06:59:03.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.226+0000 7fada0000640 1 -- start start 2024-05-30T06:59:03.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fada0000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fad9815d7e0 0x7fad9806e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:03.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fada0000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad98142030 con 0x7fad9815d350 2024-05-30T06:59:03.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fada0000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad98142310 con 0x7fad980b59d0 2024-05-30T06:59:03.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fada0000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fad981425f0 con 0x7fad9815d7e0 2024-05-30T06:59:03.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fad9cc00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fad9815d350 0x7fad9806df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47388/0 (socket says 172.21.15.37:47388) 2024-05-30T06:59:03.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fad9cc00640 1 -- 172.21.15.37:0/252292237 learned_addr learned my addr 172.21.15.37:0/252292237 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fad9e000640 1 --2- 172.21.15.37:0/252292237 >> v2:172.21.15.105:3300/0 conn(0x7fad9815d7e0 0x7fad9806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fad97e00640 1 -- 172.21.15.37:0/252292237 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3753274440 0 0) 0x7fad98142030 con 0x7fad9815d350 2024-05-30T06:59:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fad97e00640 1 -- 172.21.15.37:0/252292237 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad80003530 con 0x7fad9815d350 2024-05-30T06:59:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fad97e00640 1 -- 172.21.15.37:0/252292237 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064329241 0 0) 0x7fad98142310 con 0x7fad980b59d0 2024-05-30T06:59:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fad97e00640 1 -- 172.21.15.37:0/252292237 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad98142030 con 0x7fad980b59d0 2024-05-30T06:59:03.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fad9e000640 1 -- 172.21.15.37:0/252292237 >> v1:172.21.15.105:6789/0 conn(0x7fad980b59d0 legacy=0x7fad980b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fad9e000640 1 -- 172.21.15.37:0/252292237 >> v1:172.21.15.37:6789/0 conn(0x7fad9815d350 legacy=0x7fad9806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:03.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.230+0000 7fad9e000640 1 -- 172.21.15.37:0/252292237 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad981428d0 con 0x7fad9815d7e0 2024-05-30T06:59:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.234+0000 7fad9e000640 1 --2- 172.21.15.37:0/252292237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815d7e0 0x7fad9806e660 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fad90009dc0 tx=0x7fad9001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb549c5f127d3184 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.234+0000 7fad97e00640 1 -- 172.21.15.37:0/252292237 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad900b2070 con 0x7fad9815d7e0 2024-05-30T06:59:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.234+0000 7fad97e00640 1 -- 172.21.15.37:0/252292237 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad900a5920 con 0x7fad9815d7e0 2024-05-30T06:59:03.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.234+0000 7fad97e00640 1 -- 172.21.15.37:0/252292237 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad900a5cf0 con 0x7fad9815d7e0 2024-05-30T06:59:03.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.234+0000 7fada0000640 1 -- 172.21.15.37:0/252292237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815d7e0 msgr2=0x7fad9806e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:03.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.234+0000 7fada0000640 1 --2- 172.21.15.37:0/252292237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815d7e0 0x7fad9806e660 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fad90009dc0 tx=0x7fad9001c950 comp rx=0 tx=0).stop 2024-05-30T06:59:03.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.234+0000 7fada0000640 1 -- 172.21.15.37:0/252292237 shutdown_connections 2024-05-30T06:59:03.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.234+0000 7fada0000640 1 --2- 172.21.15.37:0/252292237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815d7e0 0x7fad9806e660 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:03.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.234+0000 7fada0000640 1 -- 172.21.15.37:0/252292237 >> 172.21.15.37:0/252292237 conn(0x7fad9806bf60 msgr2=0x7fad980b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:03.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.234+0000 7fada0000640 1 -- 172.21.15.37:0/252292237 shutdown_connections 2024-05-30T06:59:03.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.234+0000 7fada0000640 1 -- 172.21.15.37:0/252292237 wait complete. 2024-05-30T06:59:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.234+0000 7fada0000640 1 Processor -- start 2024-05-30T06:59:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.234+0000 7fada0000640 1 -- start start 2024-05-30T06:59:03.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fada0000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad980b59d0 0x7fad980ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:03.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fada0000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad9815d350 0x7fad980b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:03.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fada0000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815d7e0 0x7fad98152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:03.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fada0000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad98141d70 con 0x7fad9815d350 2024-05-30T06:59:03.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fada0000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad98141bf0 con 0x7fad9815d7e0 2024-05-30T06:59:03.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fada0000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad9816ae40 con 0x7fad980b59d0 2024-05-30T06:59:03.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad9cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad9815d350 0x7fad980b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:03.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad9cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad9815d350 0x7fad980b0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35870/0 (socket says 172.21.15.37:35870) 2024-05-30T06:59:03.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad9cc00640 1 -- 172.21.15.37:0/389320500 learned_addr learned my addr 172.21.15.37:0/389320500 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:03.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad9e000640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815d7e0 0x7fad98152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:03.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad9d600640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad980b59d0 0x7fad980ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:03.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad9cc00640 1 -- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad980b59d0 msgr2=0x7fad980ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:03.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad9cc00640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad980b59d0 0x7fad980ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:03.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad9cc00640 1 -- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815d7e0 msgr2=0x7fad98152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:03.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad9cc00640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815d7e0 0x7fad98152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:03.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad9cc00640 1 -- 172.21.15.37:0/389320500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad980ae210 con 0x7fad9815d350 2024-05-30T06:59:03.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad9cc00640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad9815d350 0x7fad980b0390 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fad8400c450 tx=0x7fad8400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:03.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad95600640 1 -- 172.21.15.37:0/389320500 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84017070 con 0x7fad9815d350 2024-05-30T06:59:03.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad95600640 1 -- 172.21.15.37:0/389320500 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad84005cf0 con 0x7fad9815d350 2024-05-30T06:59:03.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fada0000640 1 -- 172.21.15.37:0/389320500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad980ae4f0 con 0x7fad9815d350 2024-05-30T06:59:03.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad95600640 1 -- 172.21.15.37:0/389320500 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84007310 con 0x7fad9815d350 2024-05-30T06:59:03.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fada0000640 1 -- 172.21.15.37:0/389320500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad980aeab0 con 0x7fad9815d350 2024-05-30T06:59:03.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fada0000640 1 -- 172.21.15.37:0/389320500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad98068bc0 con 0x7fad9815d350 2024-05-30T06:59:03.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.238+0000 7fad95600640 1 -- 172.21.15.37:0/389320500 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fad8401a070 con 0x7fad9815d350 2024-05-30T06:59:03.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.242+0000 7fad95600640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad7806a060 0x7fad7806c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:03.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.242+0000 7fad95600640 1 -- 172.21.15.37:0/389320500 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5027+0+0 (secure 0 0 0) 0x7fad84084cb0 con 0x7fad9815d350 2024-05-30T06:59:03.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.242+0000 7fad9d600640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad7806a060 0x7fad7806c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:03.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.242+0000 7fad9d600640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad7806a060 0x7fad7806c520 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fad980b5820 tx=0x7fad8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:03.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.246+0000 7fad95600640 1 -- 172.21.15.37:0/389320500 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fad84056680 con 0x7fad9815d350 2024-05-30T06:59:03.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.418+0000 7fada0000640 1 -- 172.21.15.37:0/389320500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fad9806f0a0 con 0x7fad9815d350 2024-05-30T06:59:03.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.978+0000 7fad95600640 1 -- 172.21.15.37:0/389320500 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v122) ==== 97+0+0 (secure 0 0 0) 0x7fad8405a980 con 0x7fad9815d350 2024-05-30T06:59:03.979 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2024-05-30T06:59:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.982+0000 7fada0000640 1 -- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad7806a060 msgr2=0x7fad7806c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.982+0000 7fada0000640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad7806a060 0x7fad7806c520 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fad980b5820 tx=0x7fad8c009040 comp rx=0 tx=0).stop 2024-05-30T06:59:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.982+0000 7fada0000640 1 -- 172.21.15.37:0/389320500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad9815d350 msgr2=0x7fad980b0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.982+0000 7fada0000640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad9815d350 0x7fad980b0390 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fad8400c450 tx=0x7fad8400c910 comp rx=0 tx=0).stop 2024-05-30T06:59:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.982+0000 7fada0000640 1 -- 172.21.15.37:0/389320500 shutdown_connections 2024-05-30T06:59:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.982+0000 7fada0000640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fad7806a060 0x7fad7806c520 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.982+0000 7fada0000640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815d7e0 0x7fad98152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.982+0000 7fada0000640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad9815d350 0x7fad980b0390 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.982+0000 7fada0000640 1 --2- 172.21.15.37:0/389320500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad980b59d0 0x7fad980ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.982+0000 7fada0000640 1 -- 172.21.15.37:0/389320500 >> 172.21.15.37:0/389320500 conn(0x7fad9806bf60 msgr2=0x7fad98074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:03.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.982+0000 7fada0000640 1 -- 172.21.15.37:0/389320500 shutdown_connections 2024-05-30T06:59:03.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:03.982+0000 7fada0000640 1 -- 172.21.15.37:0/389320500 wait complete. 2024-05-30T06:59:04.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-30T06:59:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.150+0000 7f20e1e00640 1 Processor -- start 2024-05-30T06:59:04.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.150+0000 7f20e1e00640 1 -- start start 2024-05-30T06:59:04.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.150+0000 7f20e1e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20dc06e000 0x7f20dc0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.150+0000 7f20e1e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f20dc0cee10 0x7f20dc06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.150+0000 7f20e1e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20dc0cd120 con 0x7f20dc15cd80 2024-05-30T06:59:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.150+0000 7f20e1e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f20dc0a9530 con 0x7f20dc06e000 2024-05-30T06:59:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.150+0000 7f20e1e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f20dc0cd400 con 0x7f20dc0cee10 2024-05-30T06:59:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.150+0000 7f20d2000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f20dc15cd80 0x7f20dc0ce700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47390/0 (socket says 172.21.15.37:47390) 2024-05-30T06:59:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.150+0000 7f20d2000640 1 -- 172.21.15.37:0/3236371539 learned_addr learned my addr 172.21.15.37:0/3236371539 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.150+0000 7f20daa00640 1 --2- 172.21.15.37:0/3236371539 >> v2:172.21.15.37:3300/0 conn(0x7f20dc06e000 0x7f20dc0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.154+0000 7f20db400640 1 --2- 172.21.15.37:0/3236371539 >> v2:172.21.15.105:3300/0 conn(0x7f20dc0cee10 0x7f20dc06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.154+0000 7f20daa00640 1 -- 172.21.15.37:0/3236371539 >> v2:172.21.15.105:3300/0 conn(0x7f20dc0cee10 msgr2=0x7f20dc06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.154+0000 7f20daa00640 1 --2- 172.21.15.37:0/3236371539 >> v2:172.21.15.105:3300/0 conn(0x7f20dc0cee10 0x7f20dc06f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.154+0000 7f20daa00640 1 -- 172.21.15.37:0/3236371539 >> v1:172.21.15.37:6789/0 conn(0x7f20dc15cd80 legacy=0x7f20dc0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.154+0000 7f20daa00640 1 -- 172.21.15.37:0/3236371539 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc0cd6e0 con 0x7f20dc06e000 2024-05-30T06:59:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.154+0000 7f20db400640 1 --2- 172.21.15.37:0/3236371539 >> v2:172.21.15.105:3300/0 conn(0x7f20dc0cee10 0x7f20dc06f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.154+0000 7f20da000640 1 -- 172.21.15.37:0/3236371539 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1319607137 0 0) 0x7f20dc0cd120 con 0x7f20dc15cd80 2024-05-30T06:59:04.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.154+0000 7f20daa00640 1 --2- 172.21.15.37:0/3236371539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc06e000 0x7f20dc0ce1c0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f20dc06c7b0 tx=0x7f20cc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3d55010a3cd63b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:04.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.154+0000 7f20da000640 1 -- 172.21.15.37:0/3236371539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0b5070 con 0x7f20dc06e000 2024-05-30T06:59:04.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.154+0000 7f20da000640 1 -- 172.21.15.37:0/3236371539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20cc0a8970 con 0x7f20dc06e000 2024-05-30T06:59:04.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.154+0000 7f20da000640 1 -- 172.21.15.37:0/3236371539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0a8d40 con 0x7f20dc06e000 2024-05-30T06:59:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 -- 172.21.15.37:0/3236371539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc06e000 msgr2=0x7f20dc0ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 --2- 172.21.15.37:0/3236371539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc06e000 0x7f20dc0ce1c0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f20dc06c7b0 tx=0x7f20cc01ec70 comp rx=0 tx=0).stop 2024-05-30T06:59:04.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 -- 172.21.15.37:0/3236371539 shutdown_connections 2024-05-30T06:59:04.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 --2- 172.21.15.37:0/3236371539 >> v2:172.21.15.105:3300/0 conn(0x7f20dc0cee10 0x7f20dc06f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 --2- 172.21.15.37:0/3236371539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc06e000 0x7f20dc0ce1c0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 -- 172.21.15.37:0/3236371539 >> 172.21.15.37:0/3236371539 conn(0x7f20dc0b23a0 msgr2=0x7f20dc0b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:04.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 -- 172.21.15.37:0/3236371539 shutdown_connections 2024-05-30T06:59:04.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 -- 172.21.15.37:0/3236371539 wait complete. 2024-05-30T06:59:04.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 Processor -- start 2024-05-30T06:59:04.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 -- start start 2024-05-30T06:59:04.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc06e000 0x7f20dc13bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20dc0cee10 0x7f20dc1546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc15cd80 0x7f20dc153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc06f930 con 0x7f20dc06e000 2024-05-30T06:59:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc0cdca0 con 0x7f20dc15cd80 2024-05-30T06:59:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20e1e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f20dc06fab0 con 0x7f20dc0cee10 2024-05-30T06:59:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20daa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc06e000 0x7f20dc13bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20daa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc06e000 0x7f20dc13bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35874/0 (socket says 172.21.15.37:35874) 2024-05-30T06:59:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20daa00640 1 -- 172.21.15.37:0/2437073346 learned_addr learned my addr 172.21.15.37:0/2437073346 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20d2000640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20dc0cee10 0x7f20dc1546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20db400640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc15cd80 0x7f20dc153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20daa00640 1 -- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20dc0cee10 msgr2=0x7f20dc1546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20daa00640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20dc0cee10 0x7f20dc1546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20daa00640 1 -- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc15cd80 msgr2=0x7f20dc153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20daa00640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc15cd80 0x7f20dc153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.158+0000 7f20daa00640 1 -- 172.21.15.37:0/2437073346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc152cf0 con 0x7f20dc06e000 2024-05-30T06:59:04.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.162+0000 7f20daa00640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc06e000 0x7f20dc13bf80 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f20cc01c8a0 tx=0x7f20cc01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.162+0000 7f20d3e00640 1 -- 172.21.15.37:0/2437073346 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0c0070 con 0x7f20dc06e000 2024-05-30T06:59:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.162+0000 7f20d3e00640 1 -- 172.21.15.37:0/2437073346 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20cc004230 con 0x7f20dc06e000 2024-05-30T06:59:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.162+0000 7f20d3e00640 1 -- 172.21.15.37:0/2437073346 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc0b5040 con 0x7f20dc06e000 2024-05-30T06:59:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.162+0000 7f20e1e00640 1 -- 172.21.15.37:0/2437073346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20dc152fd0 con 0x7f20dc06e000 2024-05-30T06:59:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.162+0000 7f20e1e00640 1 -- 172.21.15.37:0/2437073346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20dc15dfc0 con 0x7f20dc06e000 2024-05-30T06:59:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.162+0000 7f20e1e00640 1 -- 172.21.15.37:0/2437073346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20dc068b20 con 0x7f20dc06e000 2024-05-30T06:59:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.162+0000 7f20d3e00640 1 -- 172.21.15.37:0/2437073346 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f20cc003620 con 0x7f20dc06e000 2024-05-30T06:59:04.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.162+0000 7f20d3e00640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20b806a030 0x7f20b806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.162+0000 7f20d3e00640 1 -- 172.21.15.37:0/2437073346 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4941+0+0 (secure 0 0 0) 0x7f20cc1221f0 con 0x7f20dc06e000 2024-05-30T06:59:04.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.162+0000 7f20d2000640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20b806a030 0x7f20b806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.166+0000 7f20d2000640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20b806a030 0x7f20b806c4f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f20dc1565f0 tx=0x7f20c4001770 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:04.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.166+0000 7f20d3e00640 1 -- 172.21.15.37:0/2437073346 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f20cc0187d0 con 0x7f20dc06e000 2024-05-30T06:59:04.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.390+0000 7f20e1e00640 1 -- 172.21.15.37:0/2437073346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f20dc0b1c80 con 0x7f20dc06e000 2024-05-30T06:59:04.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.394+0000 7f20d3e00640 1 -- 172.21.15.37:0/2437073346 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7f20cc0f3bc0 con 0x7f20dc06e000 2024-05-30T06:59:04.394 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:04.394 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:59:04.394 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2024-05-30T06:59:04.394 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.394 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2024-05-30T06:59:04.394 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmcRfnBBAAk60J/SRTolMhKoS8b8A9jQ==", 2024-05-30T06:59:04.394 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.394 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:59:04.394 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:59:04.394 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:59:04.395 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.395 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.395 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.395 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.395 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2024-05-30T06:59:04.395 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmzScrERAAbIJ5somf+sguc6jEuR04zg==", 2024-05-30T06:59:04.395 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.395 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:59:04.395 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:59:04.395 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:59:04.395 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.395 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.395 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.396 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.396 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2024-05-30T06:59:04.396 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm2jEhDBAAGKUYGtJznRYpt1LHlMOTrw==", 2024-05-30T06:59:04.396 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.396 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:59:04.396 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:59:04.396 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:59:04.396 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.396 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.396 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.396 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.396 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2024-05-30T06:59:04.396 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm95RdGBAAaaaNAKnr4Dtmu+L1NaMVbw==", 2024-05-30T06:59:04.397 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.397 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:59:04.397 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:59:04.397 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:59:04.397 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.397 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.397 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.397 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.397 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2024-05-30T06:59:04.397 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCFH1hmygxjHhAA1ee1eBP6dvsC0K9w+6d0OQ==", 2024-05-30T06:59:04.397 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.397 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:59:04.397 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:59:04.398 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.398 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.398 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.398 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2024-05-30T06:59:04.398 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCIH1hmNJsBKRAAhns5CNodS7CKFU1Jg3PFCA==", 2024-05-30T06:59:04.398 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.398 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:59:04.398 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:59:04.398 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.398 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.398 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.399 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2024-05-30T06:59:04.399 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCLH1hmlx5FNBAAn2Iann8U/uTZy0tFcFx04w==", 2024-05-30T06:59:04.399 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.399 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:59:04.399 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:59:04.399 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.399 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.399 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.399 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.399 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2024-05-30T06:59:04.399 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCPH1hmxJnxAhAAt5cEb3YVLDhkQD5WjLQuog==", 2024-05-30T06:59:04.399 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.399 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCUH1hmEn5cOBAAFzBuH8TO418e4obqTNeIXg==", 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.400 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.401 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2024-05-30T06:59:04.401 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCYH1hmij3RCBAAHzQPoM1ClYGGEt6ly6ZrqQ==", 2024-05-30T06:59:04.401 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.401 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:59:04.401 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:59:04.401 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.401 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.401 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.401 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.401 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2024-05-30T06:59:04.401 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCbH1hmDqdpERAA46/Bs4B/xVjviQ1gNpNaaw==", 2024-05-30T06:59:04.401 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.401 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCeH1hmnrfVHRAAlqk48vSVw45YDCXWWb/MUA==", 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.402 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2024-05-30T06:59:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A==", 2024-05-30T06:59:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:59:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2024-05-30T06:59:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-05-30T06:59:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2024-05-30T06:59:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmf8sdJhAATAP7EzLJxXXnXeEQL9fdpw==", 2024-05-30T06:59:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.403 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hm1qB9IhAAszAwOgm2Igb1DM4diPC7ow==", 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:59:04.404 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.405 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.405 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.405 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2024-05-30T06:59:04.405 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmY6AULBAAYNza0fpC3KO69ulNQaSldQ==", 2024-05-30T06:59:04.405 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.405 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2024-05-30T06:59:04.405 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2024-05-30T06:59:04.405 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2024-05-30T06:59:04.405 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2024-05-30T06:59:04.405 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.406 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.406 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.406 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2024-05-30T06:59:04.406 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmbSCrJBAAhn69RBUeyuaAMWiB3o7ByQ==", 2024-05-30T06:59:04.406 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.406 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:59:04.406 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2024-05-30T06:59:04.406 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2024-05-30T06:59:04.406 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.406 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.406 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.406 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCCH1hmN/fjABAAdldbCncRiHy6RFEF9H7gnQ==", 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQCBH1hmNdeSOBAA3V4vK0bNlWFoosV41f/ASQ==", 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2024-05-30T06:59:04.407 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2024-05-30T06:59:04.408 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2024-05-30T06:59:04.408 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.408 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:04.408 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-05-30T06:59:04.408 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:59:04.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.394+0000 7f20e1e00640 1 -- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20b806a030 msgr2=0x7f20b806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.394+0000 7f20e1e00640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20b806a030 0x7f20b806c4f0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f20dc1565f0 tx=0x7f20c4001770 comp rx=0 tx=0).stop 2024-05-30T06:59:04.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.394+0000 7f20e1e00640 1 -- 172.21.15.37:0/2437073346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc06e000 msgr2=0x7f20dc13bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.394+0000 7f20e1e00640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc06e000 0x7f20dc13bf80 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f20cc01c8a0 tx=0x7f20cc01ba10 comp rx=0 tx=0).stop 2024-05-30T06:59:04.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.394+0000 7f20e1e00640 1 -- 172.21.15.37:0/2437073346 shutdown_connections 2024-05-30T06:59:04.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.394+0000 7f20e1e00640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20b806a030 0x7f20b806c4f0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.394+0000 7f20e1e00640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20dc15cd80 0x7f20dc153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.394+0000 7f20e1e00640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20dc0cee10 0x7f20dc1546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.394+0000 7f20e1e00640 1 --2- 172.21.15.37:0/2437073346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20dc06e000 0x7f20dc13bf80 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.394+0000 7f20e1e00640 1 -- 172.21.15.37:0/2437073346 >> 172.21.15.37:0/2437073346 conn(0x7f20dc0b23a0 msgr2=0x7f20dc142010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:04.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.394+0000 7f20e1e00640 1 -- 172.21.15.37:0/2437073346 shutdown_connections 2024-05-30T06:59:04.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.394+0000 7f20e1e00640 1 -- 172.21.15.37:0/2437073346 wait complete. 2024-05-30T06:59:04.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:59:04.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.554+0000 7fbe03c00640 1 Processor -- start 2024-05-30T06:59:04.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.554+0000 7fbe03c00640 1 -- start start 2024-05-30T06:59:04.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbe03c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdfc06cea0 0x7fbdfc15f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbe03c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdfc15f970 con 0x7fbdfc0b39f0 2024-05-30T06:59:04.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbe03c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdfc15fc50 con 0x7fbdfc09b170 2024-05-30T06:59:04.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbe03c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbdfc0d0c60 con 0x7fbdfc06cea0 2024-05-30T06:59:04.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbe01200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbdfc0b39f0 0x7fbdfc09aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47400/0 (socket says 172.21.15.37:47400) 2024-05-30T06:59:04.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbe01200640 1 -- 172.21.15.37:0/2529560447 learned_addr learned my addr 172.21.15.37:0/2529560447 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:04.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbe01c00640 1 --2- 172.21.15.37:0/2529560447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdfc06cea0 0x7fbdfc15f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbdfbe00640 1 -- 172.21.15.37:0/2529560447 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 747553626 0 0) 0x7fbdfc15f970 con 0x7fbdfc0b39f0 2024-05-30T06:59:04.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbdfbe00640 1 -- 172.21.15.37:0/2529560447 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbde0003530 con 0x7fbdfc0b39f0 2024-05-30T06:59:04.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbdfbe00640 1 -- 172.21.15.37:0/2529560447 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2461135600 0 0) 0x7fbdfc15fc50 con 0x7fbdfc09b170 2024-05-30T06:59:04.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbdfbe00640 1 -- 172.21.15.37:0/2529560447 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdfc15f970 con 0x7fbdfc09b170 2024-05-30T06:59:04.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbdfbe00640 1 -- 172.21.15.37:0/2529560447 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3815478372 0 0) 0x7fbde0003530 con 0x7fbdfc0b39f0 2024-05-30T06:59:04.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbe01c00640 1 -- 172.21.15.37:0/2529560447 >> v1:172.21.15.105:6789/0 conn(0x7fbdfc09b170 legacy=0x7fbdfc0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbe01c00640 1 -- 172.21.15.37:0/2529560447 >> v1:172.21.15.37:6789/0 conn(0x7fbdfc0b39f0 legacy=0x7fbdfc09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.558+0000 7fbe01c00640 1 -- 172.21.15.37:0/2529560447 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdfc15ff30 con 0x7fbdfc06cea0 2024-05-30T06:59:04.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe01c00640 1 --2- 172.21.15.37:0/2529560447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdfc06cea0 0x7fbdfc15f290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009dc0 tx=0x7fbdf401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c843fb08ad26b7b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:04.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbdfbe00640 1 -- 172.21.15.37:0/2529560447 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40b2070 con 0x7fbdfc06cea0 2024-05-30T06:59:04.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbdfbe00640 1 -- 172.21.15.37:0/2529560447 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf40a5600 con 0x7fbdfc06cea0 2024-05-30T06:59:04.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbdfbe00640 1 -- 172.21.15.37:0/2529560447 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec001680 con 0x7fbdfc06cea0 2024-05-30T06:59:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 -- 172.21.15.37:0/2529560447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdfc06cea0 msgr2=0x7fbdfc15f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 --2- 172.21.15.37:0/2529560447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdfc06cea0 0x7fbdfc15f290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009dc0 tx=0x7fbdf401c8b0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 -- 172.21.15.37:0/2529560447 shutdown_connections 2024-05-30T06:59:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 --2- 172.21.15.37:0/2529560447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdfc06cea0 0x7fbdfc15f290 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 -- 172.21.15.37:0/2529560447 >> 172.21.15.37:0/2529560447 conn(0x7fbdfc0b4100 msgr2=0x7fbdfc0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 -- 172.21.15.37:0/2529560447 shutdown_connections 2024-05-30T06:59:04.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 -- 172.21.15.37:0/2529560447 wait complete. 2024-05-30T06:59:04.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 Processor -- start 2024-05-30T06:59:04.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 -- start start 2024-05-30T06:59:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdfc06cea0 0x7fbdfc154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdfc09b170 0x7fbdfc0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbdfc0b39f0 0x7fbdfc0b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbdfc16cb90 con 0x7fbdfc09b170 2024-05-30T06:59:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbdfc16ca10 con 0x7fbdfc0b39f0 2024-05-30T06:59:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.562+0000 7fbe03c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbdfc16cd10 con 0x7fbdfc06cea0 2024-05-30T06:59:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbdf3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdfc09b170 0x7fbdfc0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbdf3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdfc09b170 0x7fbdfc0b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35890/0 (socket says 172.21.15.37:35890) 2024-05-30T06:59:04.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbdf3e00640 1 -- 172.21.15.37:0/2792654967 learned_addr learned my addr 172.21.15.37:0/2792654967 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:04.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbe01c00640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbdfc0b39f0 0x7fbdfc0b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbe01200640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdfc06cea0 0x7fbdfc154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbdf3e00640 1 -- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdfc06cea0 msgr2=0x7fbdfc154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbdf3e00640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdfc06cea0 0x7fbdfc154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbdf3e00640 1 -- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbdfc0b39f0 msgr2=0x7fbdfc0b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbdf3e00640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbdfc0b39f0 0x7fbdfc0b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbdf3e00640 1 -- 172.21.15.37:0/2792654967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdfc156f90 con 0x7fbdfc09b170 2024-05-30T06:59:04.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbdf3e00640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdfc09b170 0x7fbdfc0b0a10 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fbde400c430 tx=0x7fbde400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:04.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbdf9600640 1 -- 172.21.15.37:0/2792654967 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde4017070 con 0x7fbdfc09b170 2024-05-30T06:59:04.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbdf9600640 1 -- 172.21.15.37:0/2792654967 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde40052f0 con 0x7fbdfc09b170 2024-05-30T06:59:04.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbdf9600640 1 -- 172.21.15.37:0/2792654967 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde4003840 con 0x7fbdfc09b170 2024-05-30T06:59:04.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbe03c00640 1 -- 172.21.15.37:0/2792654967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdfc157270 con 0x7fbdfc09b170 2024-05-30T06:59:04.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbe03c00640 1 -- 172.21.15.37:0/2792654967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdfc0b0210 con 0x7fbdfc09b170 2024-05-30T06:59:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbe03c00640 1 -- 172.21.15.37:0/2792654967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdfc068b20 con 0x7fbdfc09b170 2024-05-30T06:59:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.566+0000 7fbdf9600640 1 -- 172.21.15.37:0/2792654967 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fbde401a070 con 0x7fbdfc09b170 2024-05-30T06:59:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.570+0000 7fbdf9600640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbdd806a030 0x7fbdd806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.570+0000 7fbdf9600640 1 -- 172.21.15.37:0/2792654967 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4941+0+0 (secure 0 0 0) 0x7fbde4084c40 con 0x7fbdfc09b170 2024-05-30T06:59:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.570+0000 7fbe01200640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbdd806a030 0x7fbdd806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.570+0000 7fbe01200640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbdd806a030 0x7fbdd806c4f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0011f0 tx=0x7fbdec0016a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:04.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.574+0000 7fbdf9600640 1 -- 172.21.15.37:0/2792654967 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbde40566b0 con 0x7fbdfc09b170 2024-05-30T06:59:04.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.738+0000 7fbe03c00640 1 -- 172.21.15.37:0/2792654967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbdfc0b8590 con 0x7fbdfc09b170 2024-05-30T06:59:04.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.738+0000 7fbdf9600640 1 -- 172.21.15.37:0/2792654967 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) ==== 74+0+13022 (secure 0 0 0) 0x7fbde405a9b0 con 0x7fbdfc09b170 2024-05-30T06:59:04.740 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:04.740 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":124,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:59:03.989037+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:59:04.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.742+0000 7fbe03c00640 1 -- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbdd806a030 msgr2=0x7fbdd806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.742+0000 7fbe03c00640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbdd806a030 0x7fbdd806c4f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0011f0 tx=0x7fbdec0016a0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.742+0000 7fbe03c00640 1 -- 172.21.15.37:0/2792654967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdfc09b170 msgr2=0x7fbdfc0b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.742+0000 7fbe03c00640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdfc09b170 0x7fbdfc0b0a10 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fbde400c430 tx=0x7fbde400c8f0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.742+0000 7fbe03c00640 1 -- 172.21.15.37:0/2792654967 shutdown_connections 2024-05-30T06:59:04.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.742+0000 7fbe03c00640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbdd806a030 0x7fbdd806c4f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.742+0000 7fbe03c00640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbdfc0b39f0 0x7fbdfc0b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.742+0000 7fbe03c00640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdfc09b170 0x7fbdfc0b0a10 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.742+0000 7fbe03c00640 1 --2- 172.21.15.37:0/2792654967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbdfc06cea0 0x7fbdfc154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.742+0000 7fbe03c00640 1 -- 172.21.15.37:0/2792654967 >> 172.21.15.37:0/2792654967 conn(0x7fbdfc0b4100 msgr2=0x7fbdfc0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:04.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.742+0000 7fbe03c00640 1 -- 172.21.15.37:0/2792654967 shutdown_connections 2024-05-30T06:59:04.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.742+0000 7fbe03c00640 1 -- 172.21.15.37:0/2792654967 wait complete. 2024-05-30T06:59:04.762 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T06:59:04.762 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T06:59:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03f2200640 1 Processor -- start 2024-05-30T06:59:04.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03f2200640 1 -- start start 2024-05-30T06:59:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03f2200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec06f770 0x7f03ec166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03f2200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ec15f310 con 0x7f03ec0cd440 2024-05-30T06:59:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03f2200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03ec15f5f0 con 0x7f03ec155da0 2024-05-30T06:59:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03f2200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f03ec0b4760 con 0x7f03ec06f770 2024-05-30T06:59:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03e2a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f03ec0cd440 0x7f03ec06f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47406/0 (socket says 172.21.15.37:47406) 2024-05-30T06:59:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03e2a00640 1 -- 172.21.15.37:0/4285643232 learned_addr learned my addr 172.21.15.37:0/4285643232 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03ebe00640 1 --2- 172.21.15.37:0/4285643232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec06f770 0x7f03ec166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 150297225 0 0) 0x7f03ec15f310 con 0x7f03ec0cd440 2024-05-30T06:59:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03d0003530 con 0x7f03ec0cd440 2024-05-30T06:59:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441356342 0 0) 0x7f03ec15f5f0 con 0x7f03ec155da0 2024-05-30T06:59:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03ec15f310 con 0x7f03ec155da0 2024-05-30T06:59:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1032956201 0 0) 0x7f03d0003530 con 0x7f03ec0cd440 2024-05-30T06:59:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec06f770 msgr2=0x7f03ec166570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03eaa00640 1 --2- 172.21.15.37:0/4285643232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec06f770 0x7f03ec166570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.906+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 >> v1:172.21.15.105:6789/0 conn(0x7f03ec155da0 legacy=0x7f03ec0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec15f8d0 con 0x7f03ec0cd440 2024-05-30T06:59:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f03dc001680 con 0x7f03ec0cd440 2024-05-30T06:59:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 >> v1:172.21.15.37:6789/0 conn(0x7f03ec0cd440 legacy=0x7f03ec06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03eaa00640 1 --2- 172.21.15.37:0/4285643232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec06f770 0x7f03d0003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03eaa00640 1 --2- 172.21.15.37:0/4285643232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00040e0 0x7f03d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03eaa00640 1 --2- 172.21.15.37:0/4285643232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03d0004d50 0x7f03d00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03d000bbb0 con 0x7f03d00040e0 2024-05-30T06:59:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f03d000bd60 con 0x7f03d0004d50 2024-05-30T06:59:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f03d000bf60 con 0x7f03ec06f770 2024-05-30T06:59:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03e2a00640 1 --2- 172.21.15.37:0/4285643232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00040e0 0x7f03d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03eb400640 1 --2- 172.21.15.37:0/4285643232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec06f770 0x7f03d0003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03ebe00640 1 --2- 172.21.15.37:0/4285643232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03d0004d50 0x7f03d00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03e2a00640 1 -- 172.21.15.37:0/4285643232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec06f770 msgr2=0x7f03d0003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03e2a00640 1 --2- 172.21.15.37:0/4285643232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec06f770 0x7f03d0003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03e2a00640 1 -- 172.21.15.37:0/4285643232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03d0004d50 msgr2=0x7f03d00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03e2a00640 1 --2- 172.21.15.37:0/4285643232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03d0004d50 0x7f03d00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03e2a00640 1 -- 172.21.15.37:0/4285643232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d0003530 con 0x7f03d00040e0 2024-05-30T06:59:04.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03e2a00640 1 --2- 172.21.15.37:0/4285643232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00040e0 0x7f03d0004810 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f03dc007c90 tx=0x7f03dc01ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4e171ba2688175 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:04.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc007cd0 con 0x7f03d00040e0 2024-05-30T06:59:04.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03dc0ab020 con 0x7f03d00040e0 2024-05-30T06:59:04.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.910+0000 7f03eaa00640 1 -- 172.21.15.37:0/4285643232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc005ae0 con 0x7f03d00040e0 2024-05-30T06:59:04.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 -- 172.21.15.37:0/4285643232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00040e0 msgr2=0x7f03d0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 --2- 172.21.15.37:0/4285643232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d00040e0 0x7f03d0004810 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f03dc007c90 tx=0x7f03dc01ee10 comp rx=0 tx=0).stop 2024-05-30T06:59:04.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03ebe00640 1 -- 172.21.15.37:0/4285643232 reap_dead start 2024-05-30T06:59:04.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 -- 172.21.15.37:0/4285643232 shutdown_connections 2024-05-30T06:59:04.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 -- 172.21.15.37:0/4285643232 >> 172.21.15.37:0/4285643232 conn(0x7f03ec06bf60 msgr2=0x7f03ec0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:04.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 -- 172.21.15.37:0/4285643232 shutdown_connections 2024-05-30T06:59:04.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 -- 172.21.15.37:0/4285643232 wait complete. 2024-05-30T06:59:04.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 Processor -- start 2024-05-30T06:59:04.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 -- start start 2024-05-30T06:59:04.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03d00040e0 0x7f03ec1f6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec1f6fb0 0x7f03ec0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec0cb910 0x7f03ec157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec06eaf0 con 0x7f03ec1f6fb0 2024-05-30T06:59:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f03ec06e970 con 0x7f03d00040e0 2024-05-30T06:59:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03f2200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f03ec06ec70 con 0x7f03ec0cb910 2024-05-30T06:59:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec1f6fb0 0x7f03ec0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03e2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec1f6fb0 0x7f03ec0cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35904/0 (socket says 172.21.15.37:35904) 2024-05-30T06:59:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03e2a00640 1 -- 172.21.15.37:0/3540123587 learned_addr learned my addr 172.21.15.37:0/3540123587 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03ebe00640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec0cb910 0x7f03ec157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03eb400640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03d00040e0 0x7f03ec1f6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03e2a00640 1 -- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec0cb910 msgr2=0x7f03ec157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03e2a00640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec0cb910 0x7f03ec157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03e2a00640 1 -- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03d00040e0 msgr2=0x7f03ec1f6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03e2a00640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03d00040e0 0x7f03ec1f6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03e2a00640 1 -- 172.21.15.37:0/3540123587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ec0ccbc0 con 0x7f03ec1f6fb0 2024-05-30T06:59:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03ebe00640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec0cb910 0x7f03ec157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.914+0000 7f03eb400640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03d00040e0 0x7f03ec1f6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.918+0000 7f03e2a00640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec1f6fb0 0x7f03ec0cb3d0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f03dc007040 tx=0x7f03d0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.918+0000 7f03e3e00640 1 -- 172.21.15.37:0/3540123587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc007cd0 con 0x7f03ec1f6fb0 2024-05-30T06:59:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.918+0000 7f03e3e00640 1 -- 172.21.15.37:0/3540123587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03dc001480 con 0x7f03ec1f6fb0 2024-05-30T06:59:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.918+0000 7f03f2200640 1 -- 172.21.15.37:0/3540123587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03ec1fa920 con 0x7f03ec1f6fb0 2024-05-30T06:59:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.918+0000 7f03e3e00640 1 -- 172.21.15.37:0/3540123587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc001c10 con 0x7f03ec1f6fb0 2024-05-30T06:59:04.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.918+0000 7f03f2200640 1 -- 172.21.15.37:0/3540123587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03ec1faee0 con 0x7f03ec1f6fb0 2024-05-30T06:59:04.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.918+0000 7f03f2200640 1 -- 172.21.15.37:0/3540123587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03ec068bc0 con 0x7f03ec1f6fb0 2024-05-30T06:59:04.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.918+0000 7f03e3e00640 1 -- 172.21.15.37:0/3540123587 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f03dc0a79f0 con 0x7f03ec1f6fb0 2024-05-30T06:59:04.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.918+0000 7f03e3e00640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f03c806a030 0x7f03c806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:04.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.918+0000 7f03e3e00640 1 -- 172.21.15.37:0/3540123587 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4941+0+0 (secure 0 0 0) 0x7f03dc11f460 con 0x7f03ec1f6fb0 2024-05-30T06:59:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.918+0000 7f03eb400640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f03c806a030 0x7f03c806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:04.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.922+0000 7f03eb400640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f03c806a030 0x7f03c806c4f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f03d40010f0 tx=0x7f03d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:04.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:04.922+0000 7f03e3e00640 1 -- 172.21.15.37:0/3540123587 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f03dc018b20 con 0x7f03ec1f6fb0 2024-05-30T06:59:05.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.090+0000 7f03f2200640 1 -- 172.21.15.37:0/3540123587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f03ec0b6790 con 0x7f03ec1f6fb0 2024-05-30T06:59:05.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.090+0000 7f03e3e00640 1 -- 172.21.15.37:0/3540123587 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v124) ==== 93+0+10 (secure 0 0 0) 0x7f03dc0c0340 con 0x7f03ec1f6fb0 2024-05-30T06:59:05.092 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T06:59:05.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.094+0000 7f03f2200640 1 -- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f03c806a030 msgr2=0x7f03c806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.094+0000 7f03f2200640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f03c806a030 0x7f03c806c4f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f03d40010f0 tx=0x7f03d4009040 comp rx=0 tx=0).stop 2024-05-30T06:59:05.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.094+0000 7f03f2200640 1 -- 172.21.15.37:0/3540123587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec1f6fb0 msgr2=0x7f03ec0cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.094+0000 7f03f2200640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec1f6fb0 0x7f03ec0cb3d0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f03dc007040 tx=0x7f03d0005840 comp rx=0 tx=0).stop 2024-05-30T06:59:05.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.094+0000 7f03f2200640 1 -- 172.21.15.37:0/3540123587 shutdown_connections 2024-05-30T06:59:05.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.094+0000 7f03f2200640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03ec0cb910 0x7f03ec157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.094+0000 7f03f2200640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec1f6fb0 0x7f03ec0cb3d0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.094+0000 7f03f2200640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f03c806a030 0x7f03c806c4f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.094+0000 7f03f2200640 1 --2- 172.21.15.37:0/3540123587 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03d00040e0 0x7f03ec1f6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.094+0000 7f03f2200640 1 -- 172.21.15.37:0/3540123587 >> 172.21.15.37:0/3540123587 conn(0x7f03ec06bf60 msgr2=0x7f03ec15a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:05.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.094+0000 7f03f2200640 1 -- 172.21.15.37:0/3540123587 shutdown_connections 2024-05-30T06:59:05.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.094+0000 7f03f2200640 1 -- 172.21.15.37:0/3540123587 wait complete. 2024-05-30T06:59:05.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-30T06:59:05.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8269800640 1 Processor -- start 2024-05-30T06:59:05.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8269800640 1 -- start start 2024-05-30T06:59:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8269800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f82640b2e20 0x7f8264160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8269800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82640d0430 con 0x7f826409ba70 2024-05-30T06:59:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8269800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82640d0710 con 0x7f82641609c0 2024-05-30T06:59:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8269800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f82640b3200 con 0x7f82640b2e20 2024-05-30T06:59:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8263400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f826409ba70 0x7f82640cd990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47412/0 (socket says 172.21.15.37:47412) 2024-05-30T06:59:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8263400640 1 -- 172.21.15.37:0/3848767832 learned_addr learned my addr 172.21.15.37:0/3848767832 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262a00640 1 --2- 172.21.15.37:0/3848767832 >> v2:172.21.15.105:3300/0 conn(0x7f82640b2e20 0x7f8264160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610232567 0 0) 0x7f82640d0430 con 0x7f826409ba70 2024-05-30T06:59:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8248003530 con 0x7f826409ba70 2024-05-30T06:59:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1305315431 0 0) 0x7f8248003530 con 0x7f826409ba70 2024-05-30T06:59:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 >> v2:172.21.15.105:3300/0 conn(0x7f82640b2e20 msgr2=0x7f8264160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 --2- 172.21.15.37:0/3848767832 >> v2:172.21.15.105:3300/0 conn(0x7f82640b2e20 0x7f8264160480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 >> v1:172.21.15.105:6789/0 conn(0x7f82641609c0 legacy=0x7f82640cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82640b35f0 con 0x7f826409ba70 2024-05-30T06:59:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f825c001a00 con 0x7f826409ba70 2024-05-30T06:59:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 >> v1:172.21.15.37:6789/0 conn(0x7f826409ba70 legacy=0x7f82640cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 --2- 172.21.15.37:0/3848767832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82480039c0 0x7f8248003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 --2- 172.21.15.37:0/3848767832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8248004810 0x7f8248004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 --2- 172.21.15.37:0/3848767832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82480051d0 0x7f824800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82640b3200 con 0x7f82480051d0 2024-05-30T06:59:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f824800c070 con 0x7f82480039c0 2024-05-30T06:59:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f824800c270 con 0x7f8248004810 2024-05-30T06:59:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8262a00640 1 --2- 172.21.15.37:0/3848767832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82480039c0 0x7f8248003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8263400640 1 --2- 172.21.15.37:0/3848767832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82480051d0 0x7f824800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f825be00640 1 --2- 172.21.15.37:0/3848767832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8248004810 0x7f8248004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8263400640 1 -- 172.21.15.37:0/3848767832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8248004810 msgr2=0x7f8248004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8263400640 1 --2- 172.21.15.37:0/3848767832 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8248004810 0x7f8248004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8263400640 1 -- 172.21.15.37:0/3848767832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82480039c0 msgr2=0x7f8248003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8263400640 1 --2- 172.21.15.37:0/3848767832 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82480039c0 0x7f8248003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.254+0000 7f8263400640 1 -- 172.21.15.37:0/3848767832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8248003530 con 0x7f82480051d0 2024-05-30T06:59:05.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.258+0000 7f8263400640 1 -- 172.21.15.37:0/3848767832 reap_dead start 2024-05-30T06:59:05.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.258+0000 7f8263400640 1 --2- 172.21.15.37:0/3848767832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82480051d0 0x7f824800b9d0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f825c00a920 tx=0x7f825c01d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd6057558ac7c9d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:05.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.258+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c00a4c0 con 0x7f82480051d0 2024-05-30T06:59:05.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.258+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825c0ac640 con 0x7f82480051d0 2024-05-30T06:59:05.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.258+0000 7f8262000640 1 -- 172.21.15.37:0/3848767832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c0aca30 con 0x7f82480051d0 2024-05-30T06:59:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.258+0000 7f8269800640 1 -- 172.21.15.37:0/3848767832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82480051d0 msgr2=0x7f824800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.258+0000 7f8269800640 1 --2- 172.21.15.37:0/3848767832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82480051d0 0x7f824800b9d0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f825c00a920 tx=0x7f825c01d440 comp rx=0 tx=0).stop 2024-05-30T06:59:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.258+0000 7f8269800640 1 -- 172.21.15.37:0/3848767832 shutdown_connections 2024-05-30T06:59:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.258+0000 7f8269800640 1 --2- 172.21.15.37:0/3848767832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82480051d0 0x7f824800b9d0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.258+0000 7f8269800640 1 -- 172.21.15.37:0/3848767832 >> 172.21.15.37:0/3848767832 conn(0x7f82640b4100 msgr2=0x7f82640b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.258+0000 7f8269800640 1 -- 172.21.15.37:0/3848767832 shutdown_connections 2024-05-30T06:59:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.258+0000 7f8269800640 1 -- 172.21.15.37:0/3848767832 wait complete. 2024-05-30T06:59:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8269800640 1 Processor -- start 2024-05-30T06:59:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8269800640 1 -- start start 2024-05-30T06:59:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8269800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82480051d0 0x7f82640cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8269800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8264155a40 0x7f8264071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8269800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8264071760 0x7f82640c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8269800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82640cee40 con 0x7f8264071760 2024-05-30T06:59:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8269800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82640b33a0 con 0x7f8264155a40 2024-05-30T06:59:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8269800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f82640d01e0 con 0x7f82480051d0 2024-05-30T06:59:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8263400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8264071760 0x7f82640c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8263400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8264071760 0x7f82640c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35924/0 (socket says 172.21.15.37:35924) 2024-05-30T06:59:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8263400640 1 -- 172.21.15.37:0/2800222608 learned_addr learned my addr 172.21.15.37:0/2800222608 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8262a00640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82480051d0 0x7f82640cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f825be00640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8264155a40 0x7f8264071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8263400640 1 -- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82480051d0 msgr2=0x7f82640cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8263400640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82480051d0 0x7f82640cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8263400640 1 -- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8264155a40 msgr2=0x7f8264071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8263400640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8264155a40 0x7f8264071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8263400640 1 -- 172.21.15.37:0/2800222608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82640b5840 con 0x7f8264071760 2024-05-30T06:59:05.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8262a00640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82480051d0 0x7f82640cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:59:05.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8263400640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8264071760 0x7f82640c96e0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f825c01d270 tx=0x7f8248005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:05.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f825aa00640 1 -- 172.21.15.37:0/2800222608 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c004d70 con 0x7f8264071760 2024-05-30T06:59:05.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f825aa00640 1 -- 172.21.15.37:0/2800222608 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f825c0017c0 con 0x7f8264071760 2024-05-30T06:59:05.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f825aa00640 1 -- 172.21.15.37:0/2800222608 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f825c0ac7f0 con 0x7f8264071760 2024-05-30T06:59:05.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8269800640 1 -- 172.21.15.37:0/2800222608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82640b5b20 con 0x7f8264071760 2024-05-30T06:59:05.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.262+0000 7f8269800640 1 -- 172.21.15.37:0/2800222608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82640b60e0 con 0x7f8264071760 2024-05-30T06:59:05.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.266+0000 7f8269800640 1 -- 172.21.15.37:0/2800222608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8264068b20 con 0x7f8264071760 2024-05-30T06:59:05.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.266+0000 7f825aa00640 1 -- 172.21.15.37:0/2800222608 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f825c0ac990 con 0x7f8264071760 2024-05-30T06:59:05.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.266+0000 7f825aa00640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f824006a030 0x7f824006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.266+0000 7f825aa00640 1 -- 172.21.15.37:0/2800222608 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4941+0+0 (secure 0 0 0) 0x7f825c11f5e0 con 0x7f8264071760 2024-05-30T06:59:05.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.266+0000 7f8262a00640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f824006a030 0x7f824006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.266+0000 7f8262a00640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f824006a030 0x7f824006c4f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8254009eb0 tx=0x7f8254009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:05.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.270+0000 7f825aa00640 1 -- 172.21.15.37:0/2800222608 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f825c017150 con 0x7f8264071760 2024-05-30T06:59:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f8269800640 1 -- 172.21.15.37:0/2800222608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f82640d0ea0 con 0x7f8264071760 2024-05-30T06:59:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f825aa00640 1 -- 172.21.15.37:0/2800222608 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v124) ==== 84+0+65 (secure 0 0 0) 0x7f825c0f0f20 con 0x7f8264071760 2024-05-30T06:59:05.442 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:05.443 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:59:05.443 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:05.443 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-05-30T06:59:05.443 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-05-30T06:59:05.443 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:05.443 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:59:05.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f8269800640 1 -- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f824006a030 msgr2=0x7f824006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f8269800640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f824006a030 0x7f824006c4f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f8254009eb0 tx=0x7f8254009190 comp rx=0 tx=0).stop 2024-05-30T06:59:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f8269800640 1 -- 172.21.15.37:0/2800222608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8264071760 msgr2=0x7f82640c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f8269800640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8264071760 0x7f82640c96e0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f825c01d270 tx=0x7f8248005840 comp rx=0 tx=0).stop 2024-05-30T06:59:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f8269800640 1 -- 172.21.15.37:0/2800222608 shutdown_connections 2024-05-30T06:59:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f8269800640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8264071760 0x7f82640c96e0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f8269800640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f824006a030 0x7f824006c4f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f8269800640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8264155a40 0x7f8264071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f8269800640 1 --2- 172.21.15.37:0/2800222608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82480051d0 0x7f82640cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f8269800640 1 -- 172.21.15.37:0/2800222608 >> 172.21.15.37:0/2800222608 conn(0x7f82640b4100 msgr2=0x7f82640c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f8269800640 1 -- 172.21.15.37:0/2800222608 shutdown_connections 2024-05-30T06:59:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.442+0000 7f8269800640 1 -- 172.21.15.37:0/2800222608 wait complete. 2024-05-30T06:59:05.464 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-30T06:59:05.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-30T06:59:05.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbdca00640 1 Processor -- start 2024-05-30T06:59:05.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbdca00640 1 -- start start 2024-05-30T06:59:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbdca00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdbd80b25d0 0x7fdbd809b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbdca00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbd80af410 0x7fdbd80af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbdca00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd80b2a00 con 0x7fdbd815c780 2024-05-30T06:59:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbdca00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdbd80b38c0 con 0x7fdbd80af410 2024-05-30T06:59:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbdca00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdbd80b2cb0 con 0x7fdbd80b25d0 2024-05-30T06:59:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbd6800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbd80af410 0x7fdbd80af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbd6800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbd80af410 0x7fdbd80af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35936/0 (socket says 172.21.15.37:35936) 2024-05-30T06:59:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbd6800640 1 -- 172.21.15.37:0/2266851977 learned_addr learned my addr 172.21.15.37:0/2266851977 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:05.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbcd400640 1 --2- 172.21.15.37:0/2266851977 >> v2:172.21.15.105:3300/0 conn(0x7fdbd80b25d0 0x7fdbd809b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbd6800640 1 -- 172.21.15.37:0/2266851977 >> v2:172.21.15.105:3300/0 conn(0x7fdbd80b25d0 msgr2=0x7fdbd809b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:05.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbd6800640 1 --2- 172.21.15.37:0/2266851977 >> v2:172.21.15.105:3300/0 conn(0x7fdbd80b25d0 0x7fdbd809b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbd6800640 1 -- 172.21.15.37:0/2266851977 >> v1:172.21.15.105:6789/0 conn(0x7fdbd815c780 legacy=0x7fdbd809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.610+0000 7fdbd6800640 1 -- 172.21.15.37:0/2266851977 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd80b2f90 con 0x7fdbd80af410 2024-05-30T06:59:05.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbd6800640 1 --2- 172.21.15.37:0/2266851977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbd80af410 0x7fdbd80af850 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80740e0 tx=0x7fdbd001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29d17224442c000 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:05.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbd5400640 1 -- 172.21.15.37:0/2266851977 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00a5880 con 0x7fdbd80af410 2024-05-30T06:59:05.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbd5400640 1 -- 172.21.15.37:0/2266851977 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd00a5a20 con 0x7fdbd80af410 2024-05-30T06:59:05.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbd5400640 1 -- 172.21.15.37:0/2266851977 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00a5df0 con 0x7fdbd80af410 2024-05-30T06:59:05.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbdca00640 1 -- 172.21.15.37:0/2266851977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbd80af410 msgr2=0x7fdbd80af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbdca00640 1 --2- 172.21.15.37:0/2266851977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbd80af410 0x7fdbd80af850 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80740e0 tx=0x7fdbd001c9c0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbdca00640 1 -- 172.21.15.37:0/2266851977 shutdown_connections 2024-05-30T06:59:05.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbdca00640 1 --2- 172.21.15.37:0/2266851977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbd80af410 0x7fdbd80af850 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbdca00640 1 --2- 172.21.15.37:0/2266851977 >> v2:172.21.15.105:3300/0 conn(0x7fdbd80b25d0 0x7fdbd809b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbdca00640 1 -- 172.21.15.37:0/2266851977 >> 172.21.15.37:0/2266851977 conn(0x7fdbd80d26a0 msgr2=0x7fdbd80d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:05.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbdca00640 1 -- 172.21.15.37:0/2266851977 shutdown_connections 2024-05-30T06:59:05.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbdca00640 1 -- 172.21.15.37:0/2266851977 wait complete. 2024-05-30T06:59:05.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbdca00640 1 Processor -- start 2024-05-30T06:59:05.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.614+0000 7fdbdca00640 1 -- start start 2024-05-30T06:59:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbdca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbd80af410 0x7fdbd814eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbdca00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbd80b25d0 0x7fdbd8164e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbdca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbd815c780 0x7fdbd81653b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbdca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd80b3eb0 con 0x7fdbd815c780 2024-05-30T06:59:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbdca00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd80b3d30 con 0x7fdbd80b25d0 2024-05-30T06:59:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbdca00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdbd809b6b0 con 0x7fdbd80af410 2024-05-30T06:59:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbd6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbd815c780 0x7fdbd81653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbd6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbd815c780 0x7fdbd81653b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35940/0 (socket says 172.21.15.37:35940) 2024-05-30T06:59:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbd6800640 1 -- 172.21.15.37:0/820916827 learned_addr learned my addr 172.21.15.37:0/820916827 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbcd400640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbd80b25d0 0x7fdbd8164e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbd5e00640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbd80af410 0x7fdbd814eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbd6800640 1 -- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbd80af410 msgr2=0x7fdbd814eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbd6800640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbd80af410 0x7fdbd814eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbd6800640 1 -- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbd80b25d0 msgr2=0x7fdbd8164e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbd6800640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbd80b25d0 0x7fdbd8164e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbd6800640 1 -- 172.21.15.37:0/820916827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd8156cb0 con 0x7fdbd815c780 2024-05-30T06:59:05.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbd6800640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbd815c780 0x7fdbd81653b0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fdbd001a5f0 tx=0x7fdbd0019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbcea00640 1 -- 172.21.15.37:0/820916827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00bc020 con 0x7fdbd815c780 2024-05-30T06:59:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbcea00640 1 -- 172.21.15.37:0/820916827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd00b8670 con 0x7fdbd815c780 2024-05-30T06:59:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbcea00640 1 -- 172.21.15.37:0/820916827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd00b8a40 con 0x7fdbd815c780 2024-05-30T06:59:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbdca00640 1 -- 172.21.15.37:0/820916827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd806d480 con 0x7fdbd815c780 2024-05-30T06:59:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbdca00640 1 -- 172.21.15.37:0/820916827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd806da40 con 0x7fdbd815c780 2024-05-30T06:59:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.618+0000 7fdbdca00640 1 -- 172.21.15.37:0/820916827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd8068d40 con 0x7fdbd815c780 2024-05-30T06:59:05.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.622+0000 7fdbcea00640 1 -- 172.21.15.37:0/820916827 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fdbd00bf020 con 0x7fdbd815c780 2024-05-30T06:59:05.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.622+0000 7fdbcea00640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdbb406a030 0x7fdbb406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:05.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.622+0000 7fdbcea00640 1 -- 172.21.15.37:0/820916827 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4941+0+0 (secure 0 0 0) 0x7fdbd0120920 con 0x7fdbd815c780 2024-05-30T06:59:05.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.622+0000 7fdbd5e00640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdbb406a030 0x7fdbb406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:05.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.622+0000 7fdbd5e00640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdbb406a030 0x7fdbb406c4f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8007fd0 tx=0x7fdbc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:05.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.626+0000 7fdbcea00640 1 -- 172.21.15.37:0/820916827 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdbd00c6030 con 0x7fdbd815c780 2024-05-30T06:59:05.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.790+0000 7fdbdca00640 1 -- 172.21.15.37:0/820916827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdbd80701d0 con 0x7fdbd815c780 2024-05-30T06:59:05.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:59:05.938 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:59:05.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.982+0000 7fdbcea00640 1 -- 172.21.15.37:0/820916827 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v125) ==== 138+0+0 (secure 0 0 0) 0x7fdbd00165e0 con 0x7fdbd815c780 2024-05-30T06:59:05.983 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-05-30T06:59:05.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.986+0000 7fdbdca00640 1 -- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdbb406a030 msgr2=0x7fdbb406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.986+0000 7fdbdca00640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdbb406a030 0x7fdbb406c4f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8007fd0 tx=0x7fdbc8009040 comp rx=0 tx=0).stop 2024-05-30T06:59:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.986+0000 7fdbdca00640 1 -- 172.21.15.37:0/820916827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbd815c780 msgr2=0x7fdbd81653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.986+0000 7fdbdca00640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbd815c780 0x7fdbd81653b0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fdbd001a5f0 tx=0x7fdbd0019760 comp rx=0 tx=0).stop 2024-05-30T06:59:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.986+0000 7fdbdca00640 1 -- 172.21.15.37:0/820916827 shutdown_connections 2024-05-30T06:59:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.986+0000 7fdbdca00640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbd815c780 0x7fdbd81653b0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.986+0000 7fdbdca00640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdbb406a030 0x7fdbb406c4f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.986+0000 7fdbdca00640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbd80b25d0 0x7fdbd8164e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.986+0000 7fdbdca00640 1 --2- 172.21.15.37:0/820916827 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbd80af410 0x7fdbd814eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.986+0000 7fdbdca00640 1 -- 172.21.15.37:0/820916827 >> 172.21.15.37:0/820916827 conn(0x7fdbd80d26a0 msgr2=0x7fdbd80d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.986+0000 7fdbdca00640 1 -- 172.21.15.37:0/820916827 shutdown_connections 2024-05-30T06:59:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:05.986+0000 7fdbdca00640 1 -- 172.21.15.37:0/820916827 wait complete. 2024-05-30T06:59:06.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-30T06:59:06.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.202+0000 7f3bfa200640 1 Processor -- start 2024-05-30T06:59:06.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.202+0000 7f3bfa200640 1 -- start start 2024-05-30T06:59:06.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.202+0000 7f3bfa200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bf415d350 0x7f3bf406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:06.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.202+0000 7f3bfa200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3bf415d7b0 0x7f3bf406e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:06.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.202+0000 7f3bfa200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf4142030 con 0x7f3bf40b59d0 2024-05-30T06:59:06.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.202+0000 7f3bfa200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf4142310 con 0x7f3bf415d7b0 2024-05-30T06:59:06.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.202+0000 7f3bfa200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf41425f0 con 0x7f3bf415d350 2024-05-30T06:59:06.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.202+0000 7f3bf3e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3bf415d7b0 0x7f3bf406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:06.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.202+0000 7f3beaa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bf415d350 0x7f3bf406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:06.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.202+0000 7f3bf3400640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3bf40b59d0 0x7f3bf40b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:59038/0 (socket says 172.21.15.37:59038) 2024-05-30T06:59:06.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.202+0000 7f3bf3e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3bf415d7b0 0x7f3bf406e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59314/0 (socket says 172.21.15.37:59314) 2024-05-30T06:59:06.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.202+0000 7f3bf3400640 1 -- 172.21.15.37:0/3862882801 learned_addr learned my addr 172.21.15.37:0/3862882801 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:06.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.202+0000 7f3beaa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bf415d350 0x7f3bf406df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:33224/0 (socket says 172.21.15.37:33224) 2024-05-30T06:59:06.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.206+0000 7f3bf3e00640 1 -- 172.21.15.37:0/3862882801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bf415d350 msgr2=0x7f3bf406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:06.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.206+0000 7f3bf3e00640 1 --2- 172.21.15.37:0/3862882801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bf415d350 0x7f3bf406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:06.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.206+0000 7f3bf3e00640 1 -- 172.21.15.37:0/3862882801 >> v1:172.21.15.105:6789/0 conn(0x7f3bf40b59d0 legacy=0x7f3bf40b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:06.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.206+0000 7f3bf3e00640 1 -- 172.21.15.37:0/3862882801 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf41428d0 con 0x7f3bf415d7b0 2024-05-30T06:59:06.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.206+0000 7f3beaa00640 1 --2- 172.21.15.37:0/3862882801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bf415d350 0x7f3bf406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:59:06.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.206+0000 7f3bf3e00640 1 --2- 172.21.15.37:0/3862882801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf415d7b0 0x7f3bf406e490 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0097c0 tx=0x7f3bec01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=322449701012411b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.206+0000 7f3bf2a00640 1 -- 172.21.15.37:0/3862882801 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0b0070 con 0x7f3bf415d7b0 2024-05-30T06:59:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.206+0000 7f3bf2a00640 1 -- 172.21.15.37:0/3862882801 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bec0ab600 con 0x7f3bf415d7b0 2024-05-30T06:59:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.206+0000 7f3bf2a00640 1 -- 172.21.15.37:0/3862882801 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0ab9d0 con 0x7f3bf415d7b0 2024-05-30T06:59:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 -- 172.21.15.37:0/3862882801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf415d7b0 msgr2=0x7f3bf406e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 --2- 172.21.15.37:0/3862882801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf415d7b0 0x7f3bf406e490 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0097c0 tx=0x7f3bec01c3c0 comp rx=0 tx=0).stop 2024-05-30T06:59:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 -- 172.21.15.37:0/3862882801 shutdown_connections 2024-05-30T06:59:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 --2- 172.21.15.37:0/3862882801 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf415d7b0 0x7f3bf406e490 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 --2- 172.21.15.37:0/3862882801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bf415d350 0x7f3bf406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:06.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 -- 172.21.15.37:0/3862882801 >> 172.21.15.37:0/3862882801 conn(0x7f3bf406bf60 msgr2=0x7f3bf40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:06.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 -- 172.21.15.37:0/3862882801 shutdown_connections 2024-05-30T06:59:06.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 -- 172.21.15.37:0/3862882801 wait complete. 2024-05-30T06:59:06.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 Processor -- start 2024-05-30T06:59:06.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 -- start start 2024-05-30T06:59:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf40b59d0 0x7f3bf41f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf415d350 0x7f3bf40b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bf415d7b0 0x7f3bf4136d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf40b00a0 con 0x7f3bf415d350 2024-05-30T06:59:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf40aff20 con 0x7f3bf40b59d0 2024-05-30T06:59:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bfa200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf413f860 con 0x7f3bf415d7b0 2024-05-30T06:59:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3beaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf415d350 0x7f3bf40b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3beaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf415d350 0x7f3bf40b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35944/0 (socket says 172.21.15.37:35944) 2024-05-30T06:59:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3beaa00640 1 -- 172.21.15.37:0/396085008 learned_addr learned my addr 172.21.15.37:0/396085008 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bf3400640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf40b59d0 0x7f3bf41f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3bf3e00640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bf415d7b0 0x7f3bf4136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:06.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3beaa00640 1 -- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bf415d7b0 msgr2=0x7f3bf4136d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3beaa00640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bf415d7b0 0x7f3bf4136d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3beaa00640 1 -- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf40b59d0 msgr2=0x7f3bf41f7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3beaa00640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf40b59d0 0x7f3bf41f7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:06.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.210+0000 7f3beaa00640 1 -- 172.21.15.37:0/396085008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf415dd80 con 0x7f3bf415d350 2024-05-30T06:59:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.214+0000 7f3beaa00640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf415d350 0x7f3bf40b1c70 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00e980 tx=0x7f3bdc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.214+0000 7f3bebe00640 1 -- 172.21.15.37:0/396085008 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc017070 con 0x7f3bf415d350 2024-05-30T06:59:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.214+0000 7f3bebe00640 1 -- 172.21.15.37:0/396085008 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bdc00ca00 con 0x7f3bf415d350 2024-05-30T06:59:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.214+0000 7f3bfa200640 1 -- 172.21.15.37:0/396085008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf415e060 con 0x7f3bf415d350 2024-05-30T06:59:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.214+0000 7f3bebe00640 1 -- 172.21.15.37:0/396085008 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc00cdd0 con 0x7f3bf415d350 2024-05-30T06:59:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.214+0000 7f3bfa200640 1 -- 172.21.15.37:0/396085008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf415e620 con 0x7f3bf415d350 2024-05-30T06:59:06.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.214+0000 7f3bfa200640 1 -- 172.21.15.37:0/396085008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf4068bc0 con 0x7f3bf415d350 2024-05-30T06:59:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.214+0000 7f3bebe00640 1 -- 172.21.15.37:0/396085008 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f3bdc01a070 con 0x7f3bf415d350 2024-05-30T06:59:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.214+0000 7f3bebe00640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3bd006a060 0x7f3bd006c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:06.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.214+0000 7f3bebe00640 1 -- 172.21.15.37:0/396085008 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5311+0+0 (secure 0 0 0) 0x7f3bdc085fb0 con 0x7f3bf415d350 2024-05-30T06:59:06.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.218+0000 7f3bf3400640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3bd006a060 0x7f3bd006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:06.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.218+0000 7f3bf3400640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3bd006a060 0x7f3bd006c520 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f3be4002240 tx=0x7f3be400c190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:06.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.218+0000 7f3bebe00640 1 -- 172.21.15.37:0/396085008 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3bdc057970 con 0x7f3bf415d350 2024-05-30T06:59:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.382+0000 7f3bfa200640 1 -- 172.21.15.37:0/396085008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3bf406f0a0 con 0x7f3bf415d350 2024-05-30T06:59:06.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.994+0000 7f3bebe00640 1 -- 172.21.15.37:0/396085008 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v126) ==== 170+0+0 (secure 0 0 0) 0x7f3bdc05bc70 con 0x7f3bf415d350 2024-05-30T06:59:06.995 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-05-30T06:59:06.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.998+0000 7f3bfa200640 1 -- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3bd006a060 msgr2=0x7f3bd006c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:06.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.998+0000 7f3bfa200640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3bd006a060 0x7f3bd006c520 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f3be4002240 tx=0x7f3be400c190 comp rx=0 tx=0).stop 2024-05-30T06:59:06.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.998+0000 7f3bfa200640 1 -- 172.21.15.37:0/396085008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf415d350 msgr2=0x7f3bf40b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:06.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.998+0000 7f3bfa200640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf415d350 0x7f3bf40b1c70 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00e980 tx=0x7f3bdc00ee40 comp rx=0 tx=0).stop 2024-05-30T06:59:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.998+0000 7f3bfa200640 1 -- 172.21.15.37:0/396085008 shutdown_connections 2024-05-30T06:59:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.998+0000 7f3bfa200640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3bf415d7b0 0x7f3bf4136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.998+0000 7f3bfa200640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf415d350 0x7f3bf40b1c70 secure :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00e980 tx=0x7f3bdc00ee40 comp rx=0 tx=0).stop 2024-05-30T06:59:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.998+0000 7f3bfa200640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3bd006a060 0x7f3bd006c520 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.998+0000 7f3bfa200640 1 --2- 172.21.15.37:0/396085008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3bf40b59d0 0x7f3bf41f7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.998+0000 7f3bfa200640 1 -- 172.21.15.37:0/396085008 >> 172.21.15.37:0/396085008 conn(0x7f3bf406bf60 msgr2=0x7f3bf40ad8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:07.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:06.998+0000 7f3bfa200640 1 -- 172.21.15.37:0/396085008 shutdown_connections 2024-05-30T06:59:07.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.002+0000 7f3bfa200640 1 -- 172.21.15.37:0/396085008 wait complete. 2024-05-30T06:59:07.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-30T06:59:07.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.190+0000 7f3b62e00640 1 Processor -- start 2024-05-30T06:59:07.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.190+0000 7f3b62e00640 1 -- start start 2024-05-30T06:59:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.190+0000 7f3b62e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b5c15c890 0x7f3b5c162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.190+0000 7f3b62e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c163020 con 0x7f3b5c072e60 2024-05-30T06:59:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.190+0000 7f3b62e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5c163300 con 0x7f3b5c15f210 2024-05-30T06:59:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.190+0000 7f3b62e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3b5c1635e0 con 0x7f3b5c15c890 2024-05-30T06:59:07.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.190+0000 7f3b5be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b5c15c890 0x7f3b5c162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.190+0000 7f3b60e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3b5c072e60 0x7f3b5c06c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47416/0 (socket says 172.21.15.37:47416) 2024-05-30T06:59:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.190+0000 7f3b60e00640 1 -- 172.21.15.37:0/3252783450 learned_addr learned my addr 172.21.15.37:0/3252783450 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.190+0000 7f3b5be00640 1 -- 172.21.15.37:0/3252783450 >> v1:172.21.15.105:6789/0 conn(0x7f3b5c15f210 legacy=0x7f3b5c072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.190+0000 7f3b5be00640 1 -- 172.21.15.37:0/3252783450 >> v1:172.21.15.37:6789/0 conn(0x7f3b5c072e60 legacy=0x7f3b5c06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.190+0000 7f3b5b400640 1 -- 172.21.15.37:0/3252783450 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 40366875 0 0) 0x7f3b5c163020 con 0x7f3b5c072e60 2024-05-30T06:59:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.190+0000 7f3b5be00640 1 -- 172.21.15.37:0/3252783450 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c06ba00 con 0x7f3b5c15c890 2024-05-30T06:59:07.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.194+0000 7f3b5be00640 1 --2- 172.21.15.37:0/3252783450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c15c890 0x7f3b5c162720 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0097c0 tx=0x7f3b4c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562a438308c4ebd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:07.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.194+0000 7f3b5b400640 1 -- 172.21.15.37:0/3252783450 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0b0070 con 0x7f3b5c15c890 2024-05-30T06:59:07.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.194+0000 7f3b5b400640 1 -- 172.21.15.37:0/3252783450 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4c0ab600 con 0x7f3b5c15c890 2024-05-30T06:59:07.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.194+0000 7f3b5b400640 1 -- 172.21.15.37:0/3252783450 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0ab9d0 con 0x7f3b5c15c890 2024-05-30T06:59:07.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.194+0000 7f3b62e00640 1 -- 172.21.15.37:0/3252783450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c15c890 msgr2=0x7f3b5c162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:07.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.194+0000 7f3b62e00640 1 --2- 172.21.15.37:0/3252783450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c15c890 0x7f3b5c162720 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0097c0 tx=0x7f3b4c01c3d0 comp rx=0 tx=0).stop 2024-05-30T06:59:07.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.194+0000 7f3b62e00640 1 -- 172.21.15.37:0/3252783450 shutdown_connections 2024-05-30T06:59:07.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.194+0000 7f3b62e00640 1 --2- 172.21.15.37:0/3252783450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c15c890 0x7f3b5c162720 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:07.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.194+0000 7f3b62e00640 1 -- 172.21.15.37:0/3252783450 >> 172.21.15.37:0/3252783450 conn(0x7f3b5c0b2ac0 msgr2=0x7f3b5c0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:07.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.194+0000 7f3b62e00640 1 -- 172.21.15.37:0/3252783450 shutdown_connections 2024-05-30T06:59:07.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.194+0000 7f3b62e00640 1 -- 172.21.15.37:0/3252783450 wait complete. 2024-05-30T06:59:07.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b62e00640 1 Processor -- start 2024-05-30T06:59:07.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b62e00640 1 -- start start 2024-05-30T06:59:07.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b62e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c072e60 0x7f3b5c155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:07.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b62e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c15c890 0x7f3b5c155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:07.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b62e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c15f210 0x7f3b5c0b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:07.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b62e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c16ce60 con 0x7f3b5c072e60 2024-05-30T06:59:07.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b62e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5c16cce0 con 0x7f3b5c15f210 2024-05-30T06:59:07.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b62e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5c16cfe0 con 0x7f3b5c15c890 2024-05-30T06:59:07.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b5be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c072e60 0x7f3b5c155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:07.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b5be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c072e60 0x7f3b5c155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35968/0 (socket says 172.21.15.37:35968) 2024-05-30T06:59:07.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b5be00640 1 -- 172.21.15.37:0/503133568 learned_addr learned my addr 172.21.15.37:0/503133568 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:07.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b60e00640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c15f210 0x7f3b5c0b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:07.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b53400640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c15c890 0x7f3b5c155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:07.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b5be00640 1 -- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c15c890 msgr2=0x7f3b5c155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:07.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b5be00640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c15c890 0x7f3b5c155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:07.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b5be00640 1 -- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c15f210 msgr2=0x7f3b5c0b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:07.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b5be00640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c15f210 0x7f3b5c0b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:07.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b5be00640 1 -- 172.21.15.37:0/503133568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5c154e60 con 0x7f3b5c072e60 2024-05-30T06:59:07.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b60e00640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c15f210 0x7f3b5c0b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:07.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b5be00640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c072e60 0x7f3b5c155600 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0ae040 tx=0x7f3b4c01ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:07.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b58c00640 1 -- 172.21.15.37:0/503133568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0b0050 con 0x7f3b5c072e60 2024-05-30T06:59:07.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b58c00640 1 -- 172.21.15.37:0/503133568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4c0bc070 con 0x7f3b5c072e60 2024-05-30T06:59:07.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b62e00640 1 -- 172.21.15.37:0/503133568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b5c0b3a10 con 0x7f3b5c072e60 2024-05-30T06:59:07.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b58c00640 1 -- 172.21.15.37:0/503133568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0aac40 con 0x7f3b5c072e60 2024-05-30T06:59:07.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b62e00640 1 -- 172.21.15.37:0/503133568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b5c157650 con 0x7f3b5c072e60 2024-05-30T06:59:07.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.198+0000 7f3b62e00640 1 -- 172.21.15.37:0/503133568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5c068bc0 con 0x7f3b5c072e60 2024-05-30T06:59:07.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.202+0000 7f3b58c00640 1 -- 172.21.15.37:0/503133568 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f3b4c0c1460 con 0x7f3b5c072e60 2024-05-30T06:59:07.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.202+0000 7f3b58c00640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b3806a030 0x7f3b3806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:07.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.202+0000 7f3b58c00640 1 -- 172.21.15.37:0/503133568 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5693+0+0 (secure 0 0 0) 0x7f3b4c120eb0 con 0x7f3b5c072e60 2024-05-30T06:59:07.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.202+0000 7f3b53400640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b3806a030 0x7f3b3806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:07.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.202+0000 7f3b53400640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b3806a030 0x7f3b3806c4f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c15c2b0 tx=0x7f3b44009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:07.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.206+0000 7f3b58c00640 1 -- 172.21.15.37:0/503133568 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3b4c016050 con 0x7f3b5c072e60 2024-05-30T06:59:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.406+0000 7f3b62e00640 1 -- 172.21.15.37:0/503133568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3b5c0b5ba0 con 0x7f3b5c072e60 2024-05-30T06:59:07.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:07.998+0000 7f3b58c00640 1 -- 172.21.15.37:0/503133568 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v80) ==== 174+0+0 (secure 0 0 0) 0x7f3b4c0f2f50 con 0x7f3b5c072e60 2024-05-30T06:59:07.997 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 18 and data pool 19 2024-05-30T06:59:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.002+0000 7f3b62e00640 1 -- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b3806a030 msgr2=0x7f3b3806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.002+0000 7f3b62e00640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b3806a030 0x7f3b3806c4f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c15c2b0 tx=0x7f3b44009060 comp rx=0 tx=0).stop 2024-05-30T06:59:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.002+0000 7f3b62e00640 1 -- 172.21.15.37:0/503133568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c072e60 msgr2=0x7f3b5c155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.002+0000 7f3b62e00640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c072e60 0x7f3b5c155600 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0ae040 tx=0x7f3b4c01ac10 comp rx=0 tx=0).stop 2024-05-30T06:59:08.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.002+0000 7f3b62e00640 1 -- 172.21.15.37:0/503133568 shutdown_connections 2024-05-30T06:59:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.002+0000 7f3b62e00640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3b3806a030 0x7f3b3806c4f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.002+0000 7f3b62e00640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b5c15f210 0x7f3b5c0b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.002+0000 7f3b62e00640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b5c15c890 0x7f3b5c155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.002+0000 7f3b62e00640 1 --2- 172.21.15.37:0/503133568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b5c072e60 0x7f3b5c155600 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.002+0000 7f3b62e00640 1 -- 172.21.15.37:0/503133568 >> 172.21.15.37:0/503133568 conn(0x7f3b5c0b2ac0 msgr2=0x7f3b5c15e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.002+0000 7f3b62e00640 1 -- 172.21.15.37:0/503133568 shutdown_connections 2024-05-30T06:59:08.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.002+0000 7f3b62e00640 1 -- 172.21.15.37:0/503133568 wait complete. 2024-05-30T06:59:08.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:59:08.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12c6400640 1 Processor -- start 2024-05-30T06:59:08.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12c6400640 1 -- start start 2024-05-30T06:59:08.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12c6400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12c015e930 0x7f12c009b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12c6400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f12c00d1240 0x7f12c01625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12c6400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12c00d1660 0x7f12c0162ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12c6400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f12c009bee0 con 0x7f12c00d1660 2024-05-30T06:59:08.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12c6400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f12c009abe0 con 0x7f12c00d1240 2024-05-30T06:59:08.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12c6400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f12c009aec0 con 0x7f12c015e930 2024-05-30T06:59:08.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12bfe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12c00d1660 0x7f12c0162ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12bfe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12c00d1660 0x7f12c0162ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48168/0 (socket says 172.21.15.37:48168) 2024-05-30T06:59:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12bfe00640 1 -- 172.21.15.37:0/718225138 learned_addr learned my addr 172.21.15.37:0/718225138 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12bfe00640 1 -- 172.21.15.37:0/718225138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12c015e930 msgr2=0x7f12c009b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12bfe00640 1 --2- 172.21.15.37:0/718225138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12c015e930 0x7f12c009b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12bfe00640 1 -- 172.21.15.37:0/718225138 >> v2:172.21.15.105:3300/0 conn(0x7f12c00d1240 msgr2=0x7f12c01625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12bfe00640 1 --2- 172.21.15.37:0/718225138 >> v2:172.21.15.105:3300/0 conn(0x7f12c00d1240 0x7f12c01625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.190+0000 7f12bfe00640 1 -- 172.21.15.37:0/718225138 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c009b1a0 con 0x7f12c00d1660 2024-05-30T06:59:08.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.194+0000 7f12bfe00640 1 --2- 172.21.15.37:0/718225138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00d1660 0x7f12c0162ae0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f12c0073350 tx=0x7f12b801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381f7802d382f6bc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:08.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.194+0000 7f12bea00640 1 -- 172.21.15.37:0/718225138 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b80a5670 con 0x7f12c00d1660 2024-05-30T06:59:08.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.194+0000 7f12bea00640 1 -- 172.21.15.37:0/718225138 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b80a5810 con 0x7f12c00d1660 2024-05-30T06:59:08.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.194+0000 7f12bea00640 1 -- 172.21.15.37:0/718225138 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b80a5be0 con 0x7f12c00d1660 2024-05-30T06:59:08.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.194+0000 7f12c6400640 1 -- 172.21.15.37:0/718225138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00d1660 msgr2=0x7f12c0162ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.194+0000 7f12c6400640 1 --2- 172.21.15.37:0/718225138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00d1660 0x7f12c0162ae0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f12c0073350 tx=0x7f12b801c9f0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.194+0000 7f12c6400640 1 -- 172.21.15.37:0/718225138 shutdown_connections 2024-05-30T06:59:08.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.194+0000 7f12c6400640 1 --2- 172.21.15.37:0/718225138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00d1660 0x7f12c0162ae0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.194+0000 7f12c6400640 1 --2- 172.21.15.37:0/718225138 >> v2:172.21.15.105:3300/0 conn(0x7f12c00d1240 0x7f12c01625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.194+0000 7f12c6400640 1 --2- 172.21.15.37:0/718225138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12c015e930 0x7f12c009b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.194+0000 7f12c6400640 1 -- 172.21.15.37:0/718225138 >> 172.21.15.37:0/718225138 conn(0x7f12c00b4100 msgr2=0x7f12c00b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:08.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.194+0000 7f12c6400640 1 -- 172.21.15.37:0/718225138 shutdown_connections 2024-05-30T06:59:08.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.194+0000 7f12c6400640 1 -- 172.21.15.37:0/718225138 wait complete. 2024-05-30T06:59:08.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12c6400640 1 Processor -- start 2024-05-30T06:59:08.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12c6400640 1 -- start start 2024-05-30T06:59:08.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12c6400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12c00d1240 0x7f12c014f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12c6400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00d1660 0x7f12c014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12c6400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12c015e930 0x7f12c006ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12c6400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12c00cd5f0 con 0x7f12c00d1660 2024-05-30T06:59:08.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12c6400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f12c00cd470 con 0x7f12c00d1240 2024-05-30T06:59:08.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12c6400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f12c00cd770 con 0x7f12c015e930 2024-05-30T06:59:08.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12b7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00d1660 0x7f12c014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12bf400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12c00d1240 0x7f12c014f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12b7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00d1660 0x7f12c014fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48176/0 (socket says 172.21.15.37:48176) 2024-05-30T06:59:08.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12b7e00640 1 -- 172.21.15.37:0/635336386 learned_addr learned my addr 172.21.15.37:0/635336386 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:08.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12bfe00640 1 --2- 172.21.15.37:0/635336386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12c015e930 0x7f12c006ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12b7e00640 1 -- 172.21.15.37:0/635336386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12c015e930 msgr2=0x7f12c006ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12b7e00640 1 --2- 172.21.15.37:0/635336386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12c015e930 0x7f12c006ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12b7e00640 1 -- 172.21.15.37:0/635336386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12c00d1240 msgr2=0x7f12c014f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12b7e00640 1 --2- 172.21.15.37:0/635336386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12c00d1240 0x7f12c014f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12b7e00640 1 -- 172.21.15.37:0/635336386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c0156cf0 con 0x7f12c00d1660 2024-05-30T06:59:08.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12b7e00640 1 --2- 172.21.15.37:0/635336386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00d1660 0x7f12c014fcb0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f12a800b580 tx=0x7f12a800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:08.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12b7400640 1 -- 172.21.15.37:0/635336386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8014070 con 0x7f12c00d1660 2024-05-30T06:59:08.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12b7400640 1 -- 172.21.15.37:0/635336386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a8010890 con 0x7f12c00d1660 2024-05-30T06:59:08.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12b7400640 1 -- 172.21.15.37:0/635336386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8010c80 con 0x7f12c00d1660 2024-05-30T06:59:08.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12c6400640 1 -- 172.21.15.37:0/635336386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c0150690 con 0x7f12c00d1660 2024-05-30T06:59:08.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12c6400640 1 -- 172.21.15.37:0/635336386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c0150c50 con 0x7f12c00d1660 2024-05-30T06:59:08.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.198+0000 7f12c6400640 1 -- 172.21.15.37:0/635336386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c0068b20 con 0x7f12c00d1660 2024-05-30T06:59:08.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.202+0000 7f12b7400640 1 -- 172.21.15.37:0/635336386 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f12a8017070 con 0x7f12c00d1660 2024-05-30T06:59:08.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.202+0000 7f12b7400640 1 --2- 172.21.15.37:0/635336386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f129c06a030 0x7f129c06c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.202+0000 7f12b7400640 1 -- 172.21.15.37:0/635336386 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5793+0+0 (secure 0 0 0) 0x7f12a8085720 con 0x7f12c00d1660 2024-05-30T06:59:08.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.202+0000 7f12bf400640 1 --2- 172.21.15.37:0/635336386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f129c06a030 0x7f129c06c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.202+0000 7f12bf400640 1 --2- 172.21.15.37:0/635336386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f129c06a030 0x7f129c06c4f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f12b00098f0 tx=0x7f12b0006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:08.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.206+0000 7f12b7400640 1 -- 172.21.15.37:0/635336386 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12a8057070 con 0x7f12c00d1660 2024-05-30T06:59:08.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.370+0000 7f12c6400640 1 -- 172.21.15.37:0/635336386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12c006e350 con 0x7f12c00d1660 2024-05-30T06:59:08.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.374+0000 7f12b7400640 1 -- 172.21.15.37:0/635336386 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) ==== 74+0+16813 (secure 0 0 0) 0x7f12a8010e20 con 0x7f12c00d1660 2024-05-30T06:59:08.374 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:08.374 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":127,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:59:07.409426+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:59:05.805744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-05-30T06:59:06.396391+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:59:08.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.374+0000 7f12c6400640 1 -- 172.21.15.37:0/635336386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f129c06a030 msgr2=0x7f129c06c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.374+0000 7f12c6400640 1 --2- 172.21.15.37:0/635336386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f129c06a030 0x7f129c06c4f0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f12b00098f0 tx=0x7f12b0006f90 comp rx=0 tx=0).stop 2024-05-30T06:59:08.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.374+0000 7f12c6400640 1 -- 172.21.15.37:0/635336386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00d1660 msgr2=0x7f12c014fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.374+0000 7f12c6400640 1 --2- 172.21.15.37:0/635336386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00d1660 0x7f12c014fcb0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f12a800b580 tx=0x7f12a800ba40 comp rx=0 tx=0).stop 2024-05-30T06:59:08.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.374+0000 7f12c6400640 1 -- 172.21.15.37:0/635336386 shutdown_connections 2024-05-30T06:59:08.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.374+0000 7f12c6400640 1 --2- 172.21.15.37:0/635336386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12c015e930 0x7f12c006ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.374+0000 7f12c6400640 1 --2- 172.21.15.37:0/635336386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12c00d1660 0x7f12c014fcb0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.374+0000 7f12c6400640 1 --2- 172.21.15.37:0/635336386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f129c06a030 0x7f129c06c4f0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.374+0000 7f12c6400640 1 --2- 172.21.15.37:0/635336386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12c00d1240 0x7f12c014f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.374+0000 7f12c6400640 1 -- 172.21.15.37:0/635336386 >> 172.21.15.37:0/635336386 conn(0x7f12c00b4100 msgr2=0x7f12c00b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.374+0000 7f12c6400640 1 -- 172.21.15.37:0/635336386 shutdown_connections 2024-05-30T06:59:08.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.374+0000 7f12c6400640 1 -- 172.21.15.37:0/635336386 wait complete. 2024-05-30T06:59:08.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:59:08.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.534+0000 7f1495200640 1 Processor -- start 2024-05-30T06:59:08.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.534+0000 7f1495200640 1 -- start start 2024-05-30T06:59:08.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f1495200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f149006f9a0 0x7f14900b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f1495200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14900b2ec0 0x7f14900cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f1495200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149015c8f0 con 0x7f1490155e60 2024-05-30T06:59:08.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f1495200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f14900ccff0 con 0x7f149006f9a0 2024-05-30T06:59:08.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f1495200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f14900ccc80 con 0x7f14900b2ec0 2024-05-30T06:59:08.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f1487e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f149006f9a0 0x7f14900b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f148de00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1490155e60 0x7f14900cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48006/0 (socket says 172.21.15.37:48006) 2024-05-30T06:59:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f148de00640 1 -- 172.21.15.37:0/670976010 learned_addr learned my addr 172.21.15.37:0/670976010 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f148e800640 1 --2- 172.21.15.37:0/670976010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14900b2ec0 0x7f14900cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f1487e00640 1 -- 172.21.15.37:0/670976010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14900b2ec0 msgr2=0x7f14900cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f1487e00640 1 --2- 172.21.15.37:0/670976010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14900b2ec0 0x7f14900cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f1487e00640 1 -- 172.21.15.37:0/670976010 >> v1:172.21.15.37:6789/0 conn(0x7f1490155e60 legacy=0x7f14900cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f1487e00640 1 -- 172.21.15.37:0/670976010 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149015cbd0 con 0x7f149006f9a0 2024-05-30T06:59:08.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.538+0000 7f148d400640 1 -- 172.21.15.37:0/670976010 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4162363610 0 0) 0x7f149015c8f0 con 0x7f1490155e60 2024-05-30T06:59:08.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f1487e00640 1 --2- 172.21.15.37:0/670976010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f149006f9a0 0x7f14900b36a0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f14780097c0 tx=0x7f147801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ca6c906c141bf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:08.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f148d400640 1 -- 172.21.15.37:0/670976010 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14780b1070 con 0x7f149006f9a0 2024-05-30T06:59:08.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f148d400640 1 -- 172.21.15.37:0/670976010 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14780ac410 con 0x7f149006f9a0 2024-05-30T06:59:08.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f148d400640 1 -- 172.21.15.37:0/670976010 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14780ac7e0 con 0x7f149006f9a0 2024-05-30T06:59:08.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f1495200640 1 -- 172.21.15.37:0/670976010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f149006f9a0 msgr2=0x7f14900b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f1495200640 1 --2- 172.21.15.37:0/670976010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f149006f9a0 0x7f14900b36a0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f14780097c0 tx=0x7f147801c4a0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f1495200640 1 -- 172.21.15.37:0/670976010 shutdown_connections 2024-05-30T06:59:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f1495200640 1 --2- 172.21.15.37:0/670976010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14900b2ec0 0x7f14900cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f1495200640 1 --2- 172.21.15.37:0/670976010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f149006f9a0 0x7f14900b36a0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f1495200640 1 -- 172.21.15.37:0/670976010 >> 172.21.15.37:0/670976010 conn(0x7f14900b23a0 msgr2=0x7f14900b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f1495200640 1 -- 172.21.15.37:0/670976010 shutdown_connections 2024-05-30T06:59:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f1495200640 1 -- 172.21.15.37:0/670976010 wait complete. 2024-05-30T06:59:08.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f1495200640 1 Processor -- start 2024-05-30T06:59:08.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.542+0000 7f1495200640 1 -- start start 2024-05-30T06:59:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1495200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f149006f9a0 0x7f1490151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1495200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14900b2ec0 0x7f14901588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1495200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490155e60 0x7f149015d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1495200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f14901689f0 con 0x7f1490155e60 2024-05-30T06:59:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1495200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1490168870 con 0x7f149006f9a0 2024-05-30T06:59:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1495200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1490168b70 con 0x7f14900b2ec0 2024-05-30T06:59:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f148e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490155e60 0x7f149015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f148de00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f149006f9a0 0x7f1490151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f148e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490155e60 0x7f149015d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48190/0 (socket says 172.21.15.37:48190) 2024-05-30T06:59:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f148e800640 1 -- 172.21.15.37:0/1524664412 learned_addr learned my addr 172.21.15.37:0/1524664412 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1487e00640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14900b2ec0 0x7f14901588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f148e800640 1 -- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14900b2ec0 msgr2=0x7f14901588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f148e800640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14900b2ec0 0x7f14901588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f148e800640 1 -- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f149006f9a0 msgr2=0x7f1490151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f148e800640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f149006f9a0 0x7f1490151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f148e800640 1 -- 172.21.15.37:0/1524664412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1490151e60 con 0x7f1490155e60 2024-05-30T06:59:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f148de00640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f149006f9a0 0x7f1490151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:59:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f148e800640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490155e60 0x7f149015d030 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f1488007e40 tx=0x7f148800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1486000640 1 -- 172.21.15.37:0/1524664412 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1488014620 con 0x7f1490155e60 2024-05-30T06:59:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1486000640 1 -- 172.21.15.37:0/1524664412 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1488019070 con 0x7f1490155e60 2024-05-30T06:59:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1486000640 1 -- 172.21.15.37:0/1524664412 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1488014a20 con 0x7f1490155e60 2024-05-30T06:59:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1495200640 1 -- 172.21.15.37:0/1524664412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1490157890 con 0x7f1490155e60 2024-05-30T06:59:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1495200640 1 -- 172.21.15.37:0/1524664412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14901580d0 con 0x7f1490155e60 2024-05-30T06:59:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1495200640 1 -- 172.21.15.37:0/1524664412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1490068b20 con 0x7f1490155e60 2024-05-30T06:59:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.546+0000 7f1486000640 1 -- 172.21.15.37:0/1524664412 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f1488014bc0 con 0x7f1490155e60 2024-05-30T06:59:08.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.550+0000 7f1486000640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f146c06a060 0x7f146c06c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.550+0000 7f1486000640 1 -- 172.21.15.37:0/1524664412 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5793+0+0 (secure 0 0 0) 0x7f1488086040 con 0x7f1490155e60 2024-05-30T06:59:08.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.550+0000 7f148de00640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f146c06a060 0x7f146c06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.550+0000 7f148de00640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f146c06a060 0x7f146c06c520 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1480000f70 tx=0x7f1480007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:08.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.554+0000 7f1486000640 1 -- 172.21.15.37:0/1524664412 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1490157890 con 0x7f1490155e60 2024-05-30T06:59:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.718+0000 7f1495200640 1 -- 172.21.15.37:0/1524664412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1490152790 con 0x7f1490155e60 2024-05-30T06:59:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.722+0000 7f1486000640 1 -- 172.21.15.37:0/1524664412 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) ==== 74+0+16813 (secure 0 0 0) 0x7f1490151e60 con 0x7f1490155e60 2024-05-30T06:59:08.722 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:08.722 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":127,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:59:07.409426+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:59:05.805744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-05-30T06:59:06.396391+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:59:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.722+0000 7f1495200640 1 -- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f146c06a060 msgr2=0x7f146c06c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.722+0000 7f1495200640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f146c06a060 0x7f146c06c520 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1480000f70 tx=0x7f1480007df0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.722+0000 7f1495200640 1 -- 172.21.15.37:0/1524664412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490155e60 msgr2=0x7f149015d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.722+0000 7f1495200640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490155e60 0x7f149015d030 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f1488007e40 tx=0x7f148800e4b0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.722+0000 7f1495200640 1 -- 172.21.15.37:0/1524664412 shutdown_connections 2024-05-30T06:59:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.722+0000 7f1495200640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1490155e60 0x7f149015d030 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.722+0000 7f1495200640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14900b2ec0 0x7f14901588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.722+0000 7f1495200640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f146c06a060 0x7f146c06c520 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.722+0000 7f1495200640 1 --2- 172.21.15.37:0/1524664412 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f149006f9a0 0x7f1490151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.722+0000 7f1495200640 1 -- 172.21.15.37:0/1524664412 >> 172.21.15.37:0/1524664412 conn(0x7f14900b23a0 msgr2=0x7f149015e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.722+0000 7f1495200640 1 -- 172.21.15.37:0/1524664412 shutdown_connections 2024-05-30T06:59:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.722+0000 7f1495200640 1 -- 172.21.15.37:0/1524664412 wait complete. 2024-05-30T06:59:08.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-30T06:59:08.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe353800640 1 Processor -- start 2024-05-30T06:59:08.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe353800640 1 -- start start 2024-05-30T06:59:08.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe353800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe34c155da0 0x7fe34c0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe353800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c06f770 0x7fe34c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe353800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34c15f310 con 0x7fe34c0cd440 2024-05-30T06:59:08.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe353800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe34c15f5f0 con 0x7fe34c155da0 2024-05-30T06:59:08.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe353800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe34c15f8d0 con 0x7fe34c06f770 2024-05-30T06:59:08.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe350e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe34c155da0 0x7fe34c0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe350e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe34c155da0 0x7fe34c0cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48200/0 (socket says 172.21.15.37:48200) 2024-05-30T06:59:08.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe350e00640 1 -- 172.21.15.37:0/2539436992 learned_addr learned my addr 172.21.15.37:0/2539436992 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:08.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe351800640 1 --2- 172.21.15.37:0/2539436992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c06f770 0x7fe34c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe350e00640 1 -- 172.21.15.37:0/2539436992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c06f770 msgr2=0x7fe34c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:08.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe350e00640 1 --2- 172.21.15.37:0/2539436992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c06f770 0x7fe34c0b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe350e00640 1 -- 172.21.15.37:0/2539436992 >> v1:172.21.15.105:6789/0 conn(0x7fe34c0cd440 legacy=0x7fe34c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.886+0000 7fe350e00640 1 -- 172.21.15.37:0/2539436992 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34c15fbb0 con 0x7fe34c155da0 2024-05-30T06:59:08.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.890+0000 7fe350e00640 1 --2- 172.21.15.37:0/2539436992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34c155da0 0x7fe34c0cd950 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fe340009870 tx=0x7fe34001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e84945f0a75ece server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:08.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.890+0000 7fe34b400640 1 -- 172.21.15.37:0/2539436992 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3400b0070 con 0x7fe34c155da0 2024-05-30T06:59:08.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.890+0000 7fe34b400640 1 -- 172.21.15.37:0/2539436992 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3400ab600 con 0x7fe34c155da0 2024-05-30T06:59:08.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.890+0000 7fe34b400640 1 -- 172.21.15.37:0/2539436992 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3400ab9d0 con 0x7fe34c155da0 2024-05-30T06:59:08.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.890+0000 7fe353800640 1 -- 172.21.15.37:0/2539436992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34c155da0 msgr2=0x7fe34c0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.890+0000 7fe353800640 1 --2- 172.21.15.37:0/2539436992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34c155da0 0x7fe34c0cd950 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fe340009870 tx=0x7fe34001c440 comp rx=0 tx=0).stop 2024-05-30T06:59:08.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.890+0000 7fe353800640 1 -- 172.21.15.37:0/2539436992 shutdown_connections 2024-05-30T06:59:08.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.890+0000 7fe353800640 1 --2- 172.21.15.37:0/2539436992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c06f770 0x7fe34c0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.890+0000 7fe353800640 1 --2- 172.21.15.37:0/2539436992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34c155da0 0x7fe34c0cd950 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.890+0000 7fe353800640 1 -- 172.21.15.37:0/2539436992 >> 172.21.15.37:0/2539436992 conn(0x7fe34c06bf60 msgr2=0x7fe34c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:08.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.890+0000 7fe353800640 1 -- 172.21.15.37:0/2539436992 shutdown_connections 2024-05-30T06:59:08.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.890+0000 7fe353800640 1 -- 172.21.15.37:0/2539436992 wait complete. 2024-05-30T06:59:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe353800640 1 Processor -- start 2024-05-30T06:59:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe353800640 1 -- start start 2024-05-30T06:59:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe353800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c06f770 0x7fe34c154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe353800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe34c155da0 0x7fe34c14ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe353800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34c14ae70 0x7fe34c14cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe353800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c166570 con 0x7fe34c14ae70 2024-05-30T06:59:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe353800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c0b46b0 con 0x7fe34c155da0 2024-05-30T06:59:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe353800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe34c1666f0 con 0x7fe34c06f770 2024-05-30T06:59:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe351800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34c14ae70 0x7fe34c14cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe351800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34c14ae70 0x7fe34c14cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48216/0 (socket says 172.21.15.37:48216) 2024-05-30T06:59:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe351800640 1 -- 172.21.15.37:0/2673421212 learned_addr learned my addr 172.21.15.37:0/2673421212 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe350e00640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c06f770 0x7fe34c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe34be00640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe34c155da0 0x7fe34c14ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe351800640 1 -- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c06f770 msgr2=0x7fe34c154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe351800640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c06f770 0x7fe34c154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe351800640 1 -- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe34c155da0 msgr2=0x7fe34c14ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe351800640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe34c155da0 0x7fe34c14ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe351800640 1 -- 172.21.15.37:0/2673421212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34c153500 con 0x7fe34c14ae70 2024-05-30T06:59:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe351800640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34c14ae70 0x7fe34c14cf80 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fe34400efc0 tx=0x7fe34400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe348c00640 1 -- 172.21.15.37:0/2673421212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344018020 con 0x7fe34c14ae70 2024-05-30T06:59:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe348c00640 1 -- 172.21.15.37:0/2673421212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe344014480 con 0x7fe34c14ae70 2024-05-30T06:59:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe348c00640 1 -- 172.21.15.37:0/2673421212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344014870 con 0x7fe34c14ae70 2024-05-30T06:59:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe353800640 1 -- 172.21.15.37:0/2673421212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34c152460 con 0x7fe34c14ae70 2024-05-30T06:59:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.894+0000 7fe353800640 1 -- 172.21.15.37:0/2673421212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34c152a20 con 0x7fe34c14ae70 2024-05-30T06:59:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.898+0000 7fe353800640 1 -- 172.21.15.37:0/2673421212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe34c068bc0 con 0x7fe34c14ae70 2024-05-30T06:59:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.898+0000 7fe348c00640 1 -- 172.21.15.37:0/2673421212 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fe34401b020 con 0x7fe34c14ae70 2024-05-30T06:59:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.898+0000 7fe348c00640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe32c06a030 0x7fe32c06c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.898+0000 7fe348c00640 1 -- 172.21.15.37:0/2673421212 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5793+0+0 (secure 0 0 0) 0x7fe344086680 con 0x7fe34c14ae70 2024-05-30T06:59:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.898+0000 7fe350e00640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe32c06a030 0x7fe32c06c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.898+0000 7fe350e00640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe32c06a030 0x7fe32c06c4f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe3400ad000 tx=0x7fe340008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:08.902+0000 7fe348c00640 1 -- 172.21.15.37:0/2673421212 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe344022030 con 0x7fe34c14ae70 2024-05-30T06:59:09.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:09.106+0000 7fe353800640 1 -- 172.21.15.37:0/2673421212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe34c072900 con 0x7fe34c14ae70 2024-05-30T06:59:09.985 INFO:tasks.ceph.mds.d.smithi105.stderr:2024-05-30T06:59:09.986+0000 7fb85ee00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-30T06:59:10.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.030+0000 7fe348c00640 1 -- 172.21.15.37:0/2673421212 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) ==== 118+0+0 (secure 0 0 0) 0x7fe344010040 con 0x7fe34c14ae70 2024-05-30T06:59:10.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.030+0000 7fe353800640 1 -- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe32c06a030 msgr2=0x7fe32c06c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:10.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.030+0000 7fe353800640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe32c06a030 0x7fe32c06c4f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe3400ad000 tx=0x7fe340008040 comp rx=0 tx=0).stop 2024-05-30T06:59:10.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.030+0000 7fe353800640 1 -- 172.21.15.37:0/2673421212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34c14ae70 msgr2=0x7fe34c14cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:10.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.030+0000 7fe353800640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34c14ae70 0x7fe34c14cf80 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fe34400efc0 tx=0x7fe34400c490 comp rx=0 tx=0).stop 2024-05-30T06:59:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.034+0000 7fe353800640 1 -- 172.21.15.37:0/2673421212 shutdown_connections 2024-05-30T06:59:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.034+0000 7fe353800640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe34c14ae70 0x7fe34c14cf80 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.034+0000 7fe353800640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe32c06a030 0x7fe32c06c4f0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.034+0000 7fe353800640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe34c155da0 0x7fe34c14ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.034+0000 7fe353800640 1 --2- 172.21.15.37:0/2673421212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c06f770 0x7fe34c154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.034+0000 7fe353800640 1 -- 172.21.15.37:0/2673421212 >> 172.21.15.37:0/2673421212 conn(0x7fe34c06bf60 msgr2=0x7fe34c159bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.034+0000 7fe353800640 1 -- 172.21.15.37:0/2673421212 shutdown_connections 2024-05-30T06:59:10.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.034+0000 7fe353800640 1 -- 172.21.15.37:0/2673421212 wait complete. 2024-05-30T06:59:10.056 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-30T06:59:10.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-30T06:59:10.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.206+0000 7fe5a8200640 1 Processor -- start 2024-05-30T06:59:10.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.206+0000 7fe5a8200640 1 -- start start 2024-05-30T06:59:10.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.206+0000 7fe5a8200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe5a015d350 0x7fe5a006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:10.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.206+0000 7fe5a8200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5a0142030 con 0x7fe5a00b59d0 2024-05-30T06:59:10.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.206+0000 7fe5a8200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5a0142310 con 0x7fe5a015d7e0 2024-05-30T06:59:10.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.206+0000 7fe5a8200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe5a01425f0 con 0x7fe5a015d350 2024-05-30T06:59:10.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.206+0000 7fe5a5800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe5a00b59d0 0x7fe5a00b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48022/0 (socket says 172.21.15.37:48022) 2024-05-30T06:59:10.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.206+0000 7fe5a5800640 1 -- 172.21.15.37:0/1817776888 learned_addr learned my addr 172.21.15.37:0/1817776888 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:10.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe5a4e00640 1 --2- 172.21.15.37:0/1817776888 >> v2:172.21.15.105:3300/0 conn(0x7fe5a015d350 0x7fe5a006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:10.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4064162268 0 0) 0x7fe5a0142030 con 0x7fe5a00b59d0 2024-05-30T06:59:10.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe588003530 con 0x7fe5a00b59d0 2024-05-30T06:59:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2132580662 0 0) 0x7fe588003530 con 0x7fe5a00b59d0 2024-05-30T06:59:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 >> v2:172.21.15.105:3300/0 conn(0x7fe5a015d350 msgr2=0x7fe5a006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 --2- 172.21.15.37:0/1817776888 >> v2:172.21.15.105:3300/0 conn(0x7fe5a015d350 0x7fe5a006df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 >> v1:172.21.15.105:6789/0 conn(0x7fe5a015d7e0 legacy=0x7fe5a006e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a01428d0 con 0x7fe5a00b59d0 2024-05-30T06:59:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fe594001680 con 0x7fe5a00b59d0 2024-05-30T06:59:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 >> v1:172.21.15.37:6789/0 conn(0x7fe5a00b59d0 legacy=0x7fe5a00b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 --2- 172.21.15.37:0/1817776888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5880039f0 0x7fe588003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 --2- 172.21.15.37:0/1817776888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe588004810 0x7fe588004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 --2- 172.21.15.37:0/1817776888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5880051d0 0x7fe58800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a01425f0 con 0x7fe5880039f0 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe58800c0a0 con 0x7fe5880051d0 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe58800c2a0 con 0x7fe588004810 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe5a5800640 1 --2- 172.21.15.37:0/1817776888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5880039f0 0x7fe588003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe5a6200640 1 --2- 172.21.15.37:0/1817776888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5880051d0 0x7fe58800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe5a4e00640 1 --2- 172.21.15.37:0/1817776888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe588004810 0x7fe588004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe5a5800640 1 -- 172.21.15.37:0/1817776888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe588004810 msgr2=0x7fe588004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe5a5800640 1 --2- 172.21.15.37:0/1817776888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe588004810 0x7fe588004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe5a5800640 1 -- 172.21.15.37:0/1817776888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5880051d0 msgr2=0x7fe58800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe5a5800640 1 --2- 172.21.15.37:0/1817776888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5880051d0 0x7fe58800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe5a5800640 1 -- 172.21.15.37:0/1817776888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe588003530 con 0x7fe5880039f0 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe5a6200640 1 --2- 172.21.15.37:0/1817776888 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5880051d0 0x7fe58800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe5a4e00640 1 --2- 172.21.15.37:0/1817776888 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe588004810 0x7fe588004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:10.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.210+0000 7fe5a6200640 1 -- 172.21.15.37:0/1817776888 reap_dead start 2024-05-30T06:59:10.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a5800640 1 --2- 172.21.15.37:0/1817776888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5880039f0 0x7fe588003e10 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fe59400c210 tx=0x7fe59401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15264040aff02d23 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:10.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594007d40 con 0x7fe5880039f0 2024-05-30T06:59:10.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5940a9070 con 0x7fe5880039f0 2024-05-30T06:59:10.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe59fe00640 1 -- 172.21.15.37:0/1817776888 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594005d80 con 0x7fe5880039f0 2024-05-30T06:59:10.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 -- 172.21.15.37:0/1817776888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5880039f0 msgr2=0x7fe588003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:10.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 --2- 172.21.15.37:0/1817776888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5880039f0 0x7fe588003e10 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fe59400c210 tx=0x7fe59401cca0 comp rx=0 tx=0).stop 2024-05-30T06:59:10.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 -- 172.21.15.37:0/1817776888 shutdown_connections 2024-05-30T06:59:10.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 --2- 172.21.15.37:0/1817776888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5880039f0 0x7fe588003e10 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:10.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 -- 172.21.15.37:0/1817776888 >> 172.21.15.37:0/1817776888 conn(0x7fe5a006bf60 msgr2=0x7fe5a00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:10.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 -- 172.21.15.37:0/1817776888 shutdown_connections 2024-05-30T06:59:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 -- 172.21.15.37:0/1817776888 wait complete. 2024-05-30T06:59:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 Processor -- start 2024-05-30T06:59:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 -- start start 2024-05-30T06:59:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5880039f0 0x7fe5a01f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5a00ae7e0 0x7fe5a01f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a01583c0 0x7fe5a0158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a013f9e0 con 0x7fe5a01583c0 2024-05-30T06:59:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a013f860 con 0x7fe5880039f0 2024-05-30T06:59:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a8200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a0141bf0 con 0x7fe5a00ae7e0 2024-05-30T06:59:10.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a6200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a01583c0 0x7fe5a0158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:10.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a6200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a01583c0 0x7fe5a0158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48240/0 (socket says 172.21.15.37:48240) 2024-05-30T06:59:10.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.214+0000 7fe5a6200640 1 -- 172.21.15.37:0/3344599092 learned_addr learned my addr 172.21.15.37:0/3344599092 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:10.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe5a5800640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5880039f0 0x7fe5a01f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:10.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe5a4e00640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5a00ae7e0 0x7fe5a01f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:10.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe5a6200640 1 -- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5a00ae7e0 msgr2=0x7fe5a01f7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:10.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe5a6200640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5a00ae7e0 0x7fe5a01f7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:10.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe5a6200640 1 -- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5880039f0 msgr2=0x7fe5a01f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:10.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe5a6200640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5880039f0 0x7fe5a01f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:10.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe5a6200640 1 -- 172.21.15.37:0/3344599092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a00b37c0 con 0x7fe5a01583c0 2024-05-30T06:59:10.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe5a6200640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a01583c0 0x7fe5a0158840 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fe5a006c700 tx=0x7fe59800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:10.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe59d600640 1 -- 172.21.15.37:0/3344599092 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598003980 con 0x7fe5a01583c0 2024-05-30T06:59:10.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe59d600640 1 -- 172.21.15.37:0/3344599092 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe598018070 con 0x7fe5a01583c0 2024-05-30T06:59:10.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe59d600640 1 -- 172.21.15.37:0/3344599092 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598003d40 con 0x7fe5a01583c0 2024-05-30T06:59:10.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe5a8200640 1 -- 172.21.15.37:0/3344599092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a01f8020 con 0x7fe5a01583c0 2024-05-30T06:59:10.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe5a8200640 1 -- 172.21.15.37:0/3344599092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a01f85e0 con 0x7fe5a01583c0 2024-05-30T06:59:10.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe5a8200640 1 -- 172.21.15.37:0/3344599092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a0068bc0 con 0x7fe5a01583c0 2024-05-30T06:59:10.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.218+0000 7fe59d600640 1 -- 172.21.15.37:0/3344599092 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fe5980050d0 con 0x7fe5a01583c0 2024-05-30T06:59:10.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.222+0000 7fe59d600640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe58006a060 0x7fe58006c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:10.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.222+0000 7fe59d600640 1 -- 172.21.15.37:0/3344599092 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7fe598084de0 con 0x7fe5a01583c0 2024-05-30T06:59:10.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.222+0000 7fe5a5800640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe58006a060 0x7fe58006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:10.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.222+0000 7fe5a5800640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe58006a060 0x7fe58006c520 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe5940ab000 tx=0x7fe5940b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:10.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.226+0000 7fe59d600640 1 -- 172.21.15.37:0/3344599092 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe598021020 con 0x7fe5a01583c0 2024-05-30T06:59:10.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:10.426+0000 7fe5a8200640 1 -- 172.21.15.37:0/3344599092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe5a006f0a0 con 0x7fe5a01583c0 2024-05-30T06:59:11.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.038+0000 7fe59d600640 1 -- 172.21.15.37:0/3344599092 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) ==== 122+0+0 (secure 0 0 0) 0x7fe5980567b0 con 0x7fe5a01583c0 2024-05-30T06:59:11.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.042+0000 7fe5a8200640 1 -- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe58006a060 msgr2=0x7fe58006c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.042+0000 7fe5a8200640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe58006a060 0x7fe58006c520 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe5940ab000 tx=0x7fe5940b1040 comp rx=0 tx=0).stop 2024-05-30T06:59:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.042+0000 7fe5a8200640 1 -- 172.21.15.37:0/3344599092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a01583c0 msgr2=0x7fe5a0158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.042+0000 7fe5a8200640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a01583c0 0x7fe5a0158840 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fe5a006c700 tx=0x7fe59800eb90 comp rx=0 tx=0).stop 2024-05-30T06:59:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.042+0000 7fe5a8200640 1 -- 172.21.15.37:0/3344599092 shutdown_connections 2024-05-30T06:59:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.042+0000 7fe5a8200640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5a01583c0 0x7fe5a0158840 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.042+0000 7fe5a8200640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5a00ae7e0 0x7fe5a01f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.042+0000 7fe5a8200640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe58006a060 0x7fe58006c520 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.042+0000 7fe5a8200640 1 --2- 172.21.15.37:0/3344599092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5880039f0 0x7fe5a01f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.042+0000 7fe5a8200640 1 -- 172.21.15.37:0/3344599092 >> 172.21.15.37:0/3344599092 conn(0x7fe5a006bf60 msgr2=0x7fe5a015c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.042+0000 7fe5a8200640 1 -- 172.21.15.37:0/3344599092 shutdown_connections 2024-05-30T06:59:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.042+0000 7fe5a8200640 1 -- 172.21.15.37:0/3344599092 wait complete. 2024-05-30T06:59:11.066 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-30T06:59:11.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:59:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.210+0000 7f8cf5e00640 1 Processor -- start 2024-05-30T06:59:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.210+0000 7f8cf5e00640 1 -- start start 2024-05-30T06:59:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.214+0000 7f8cf5e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8cf0155e60 0x7f8cf00b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.214+0000 7f8cf5e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8cf006f9a0 0x7f8cf00cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.214+0000 7f8cf5e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf015c8f0 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.214+0000 7f8cf5e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8cf00ccff0 con 0x7f8cf0155e60 2024-05-30T06:59:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.214+0000 7f8cf5e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8cf00ccc80 con 0x7f8cf006f9a0 2024-05-30T06:59:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.214+0000 7f8ceea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8cf0155e60 0x7f8cf00b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.214+0000 7f8ceea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8cf0155e60 0x7f8cf00b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48242/0 (socket says 172.21.15.37:48242) 2024-05-30T06:59:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.214+0000 7f8ceea00640 1 -- 172.21.15.37:0/572244965 learned_addr learned my addr 172.21.15.37:0/572244965 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.214+0000 7f8ceea00640 1 -- 172.21.15.37:0/572244965 >> v2:172.21.15.105:3300/0 conn(0x7f8cf006f9a0 msgr2=0x7f8cf00cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.214+0000 7f8ceea00640 1 --2- 172.21.15.37:0/572244965 >> v2:172.21.15.105:3300/0 conn(0x7f8cf006f9a0 0x7f8cf00cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.214+0000 7f8ceea00640 1 -- 172.21.15.37:0/572244965 >> v1:172.21.15.105:6789/0 conn(0x7f8cf00b2ec0 legacy=0x7f8cf00cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.214+0000 7f8ceea00640 1 -- 172.21.15.37:0/572244965 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf015cbd0 con 0x7f8cf0155e60 2024-05-30T06:59:11.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8ceea00640 1 --2- 172.21.15.37:0/572244965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0155e60 0x7f8cf00b36a0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f8cf006e820 tx=0x7f8ce001ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa411affa7b852a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:11.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cee000640 1 -- 172.21.15.37:0/572244965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00b4070 con 0x7f8cf0155e60 2024-05-30T06:59:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cee000640 1 -- 172.21.15.37:0/572244965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ce00a7b50 con 0x7f8cf0155e60 2024-05-30T06:59:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cee000640 1 -- 172.21.15.37:0/572244965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce00af440 con 0x7f8cf0155e60 2024-05-30T06:59:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 -- 172.21.15.37:0/572244965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0155e60 msgr2=0x7f8cf00b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 --2- 172.21.15.37:0/572244965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0155e60 0x7f8cf00b36a0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f8cf006e820 tx=0x7f8ce001ebb0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 -- 172.21.15.37:0/572244965 shutdown_connections 2024-05-30T06:59:11.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 --2- 172.21.15.37:0/572244965 >> v2:172.21.15.105:3300/0 conn(0x7f8cf006f9a0 0x7f8cf00cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 --2- 172.21.15.37:0/572244965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf0155e60 0x7f8cf00b36a0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 -- 172.21.15.37:0/572244965 >> 172.21.15.37:0/572244965 conn(0x7f8cf00b23a0 msgr2=0x7f8cf00b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:11.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 -- 172.21.15.37:0/572244965 shutdown_connections 2024-05-30T06:59:11.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 -- 172.21.15.37:0/572244965 wait complete. 2024-05-30T06:59:11.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 Processor -- start 2024-05-30T06:59:11.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 -- start start 2024-05-30T06:59:11.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cf006f9a0 0x7f8cf014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf00b2ec0 0x7f8cf013ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cf0155e60 0x7f8cf0148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf006ec60 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf006eae0 con 0x7f8cf0155e60 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.218+0000 7f8cf5e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf006ede0 con 0x7f8cf006f9a0 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ce7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf00b2ec0 0x7f8cf013ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ce7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf00b2ec0 0x7f8cf013ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48248/0 (socket says 172.21.15.37:48248) 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ce7e00640 1 -- 172.21.15.37:0/851912795 learned_addr learned my addr 172.21.15.37:0/851912795 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8cef400640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cf0155e60 0x7f8cf0148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ceea00640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cf006f9a0 0x7f8cf014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ce7e00640 1 -- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cf006f9a0 msgr2=0x7f8cf014f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ce7e00640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cf006f9a0 0x7f8cf014f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ce7e00640 1 -- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cf0155e60 msgr2=0x7f8cf0148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ce7e00640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cf0155e60 0x7f8cf0148e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ce7e00640 1 -- 172.21.15.37:0/851912795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf01502b0 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ce7e00640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf00b2ec0 0x7f8cf013ade0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800b550 tx=0x7f8cd800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ce7400640 1 -- 172.21.15.37:0/851912795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8014070 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ce7400640 1 -- 172.21.15.37:0/851912795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd8010890 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ce7400640 1 -- 172.21.15.37:0/851912795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8010c80 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8cf5e00640 1 -- 172.21.15.37:0/851912795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf0150590 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8cf5e00640 1 -- 172.21.15.37:0/851912795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf0150b50 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8cf5e00640 1 -- 172.21.15.37:0/851912795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf0068b20 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.222+0000 7f8ce7400640 1 -- 172.21.15.37:0/851912795 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f8cd8017070 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.226+0000 7f8ce7400640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ccc06a030 0x7f8ccc06c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.226+0000 7f8ce7400640 1 -- 172.21.15.37:0/851912795 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7f8cd80856f0 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.226+0000 7f8ceea00640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ccc06a030 0x7f8ccc06c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.226+0000 7f8ceea00640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ccc06a030 0x7f8ccc06c4f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00b1000 tx=0x7f8ce00a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:11.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.230+0000 7f8ce7400640 1 -- 172.21.15.37:0/851912795 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8cd80570c0 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8cf5e00640 1 -- 172.21.15.37:0/851912795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cf0072fb0 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8ce7400640 1 -- 172.21.15.37:0/851912795 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5189 (secure 0 0 0) 0x7f8cd8010e20 con 0x7f8cf00b2ec0 2024-05-30T06:59:11.434 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:11.435 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3965296503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3965296503},{"type":"v1","addr":"172.21.15.105:6836","nonce":3965296503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1640764612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1640764612},{"type":"v1","addr":"172.21.15.37:6835","nonce":1640764612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":9720,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4045040277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4045040277},{"type":"v1","addr":"172.21.15.37:6834","nonce":4045040277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:59:07.409391+0000","modified":"2024-05-30T06:59:10.430545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9729":{"gid":9729,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2587102255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2587102255},{"type":"v1","addr":"172.21.15.105:6837","nonce":2587102255}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9729,"qdb_cluster":[9729]},"id":9}]} 2024-05-30T06:59:11.435 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 84 2024-05-30T06:59:11.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8cf5e00640 1 -- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ccc06a030 msgr2=0x7f8ccc06c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8cf5e00640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ccc06a030 0x7f8ccc06c4f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00b1000 tx=0x7f8ce00a9070 comp rx=0 tx=0).stop 2024-05-30T06:59:11.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8cf5e00640 1 -- 172.21.15.37:0/851912795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf00b2ec0 msgr2=0x7f8cf013ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8cf5e00640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf00b2ec0 0x7f8cf013ade0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800b550 tx=0x7f8cd800ba10 comp rx=0 tx=0).stop 2024-05-30T06:59:11.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8cf5e00640 1 -- 172.21.15.37:0/851912795 shutdown_connections 2024-05-30T06:59:11.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8cf5e00640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ccc06a030 0x7f8ccc06c4f0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8cf5e00640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8cf0155e60 0x7f8cf0148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8cf5e00640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cf00b2ec0 0x7f8cf013ade0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8cf5e00640 1 --2- 172.21.15.37:0/851912795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cf006f9a0 0x7f8cf014f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8cf5e00640 1 -- 172.21.15.37:0/851912795 >> 172.21.15.37:0/851912795 conn(0x7f8cf00b23a0 msgr2=0x7f8cf014e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:11.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8cf5e00640 1 -- 172.21.15.37:0/851912795 shutdown_connections 2024-05-30T06:59:11.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.434+0000 7f8cf5e00640 1 -- 172.21.15.37:0/851912795 wait complete. 2024-05-30T06:59:11.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T06:59:11.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.594+0000 7f82dac00640 1 Processor -- start 2024-05-30T06:59:11.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.594+0000 7f82dac00640 1 -- start start 2024-05-30T06:59:11.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82dac00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82d406f9a0 0x7f82d40b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82dac00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f82d40b2ec0 0x7f82d40cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82dac00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d415c8f0 con 0x7f82d4155e60 2024-05-30T06:59:11.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82dac00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f82d40ccff0 con 0x7f82d40b2ec0 2024-05-30T06:59:11.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82dac00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f82d40ccc80 con 0x7f82d406f9a0 2024-05-30T06:59:11.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82d8c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f82d40b2ec0 0x7f82d40cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82d3e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f82d4155e60 0x7f82d40cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48038/0 (socket says 172.21.15.37:48038) 2024-05-30T06:59:11.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82d3e00640 1 -- 172.21.15.37:0/4236797368 learned_addr learned my addr 172.21.15.37:0/4236797368 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:11.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82cbe00640 1 --2- 172.21.15.37:0/4236797368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82d406f9a0 0x7f82d40b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82d8c00640 1 -- 172.21.15.37:0/4236797368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82d406f9a0 msgr2=0x7f82d40b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:11.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82d8c00640 1 --2- 172.21.15.37:0/4236797368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82d406f9a0 0x7f82d40b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82d8c00640 1 -- 172.21.15.37:0/4236797368 >> v1:172.21.15.37:6789/0 conn(0x7f82d4155e60 legacy=0x7f82d40cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82d3400640 1 -- 172.21.15.37:0/4236797368 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493573837 0 0) 0x7f82d415c8f0 con 0x7f82d4155e60 2024-05-30T06:59:11.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.598+0000 7f82d8c00640 1 -- 172.21.15.37:0/4236797368 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d415cbd0 con 0x7f82d40b2ec0 2024-05-30T06:59:11.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82d8c00640 1 --2- 172.21.15.37:0/4236797368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d40b2ec0 0x7f82d40cd480 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009d90 tx=0x7f82cc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de95acdc6ebc420b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:11.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82d3400640 1 -- 172.21.15.37:0/4236797368 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0b2070 con 0x7f82d40b2ec0 2024-05-30T06:59:11.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82d3400640 1 -- 172.21.15.37:0/4236797368 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc0a5940 con 0x7f82d40b2ec0 2024-05-30T06:59:11.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82d3400640 1 -- 172.21.15.37:0/4236797368 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0a5d10 con 0x7f82d40b2ec0 2024-05-30T06:59:11.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 -- 172.21.15.37:0/4236797368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d40b2ec0 msgr2=0x7f82d40cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 --2- 172.21.15.37:0/4236797368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d40b2ec0 0x7f82d40cd480 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009d90 tx=0x7f82cc01c970 comp rx=0 tx=0).stop 2024-05-30T06:59:11.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 -- 172.21.15.37:0/4236797368 shutdown_connections 2024-05-30T06:59:11.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 --2- 172.21.15.37:0/4236797368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d40b2ec0 0x7f82d40cd480 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 --2- 172.21.15.37:0/4236797368 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82d406f9a0 0x7f82d40b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 -- 172.21.15.37:0/4236797368 >> 172.21.15.37:0/4236797368 conn(0x7f82d40b23a0 msgr2=0x7f82d40b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:11.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 -- 172.21.15.37:0/4236797368 shutdown_connections 2024-05-30T06:59:11.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 -- 172.21.15.37:0/4236797368 wait complete. 2024-05-30T06:59:11.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 Processor -- start 2024-05-30T06:59:11.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 -- start start 2024-05-30T06:59:11.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82d406f9a0 0x7f82d4071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d40b2ec0 0x7f82d40724e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d4155e60 0x7f82d415d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82d41689f0 con 0x7f82d4155e60 2024-05-30T06:59:11.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82d4168870 con 0x7f82d40b2ec0 2024-05-30T06:59:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.602+0000 7f82dac00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f82d4168b70 con 0x7f82d406f9a0 2024-05-30T06:59:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82d8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d4155e60 0x7f82d415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82d8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d4155e60 0x7f82d415d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48278/0 (socket says 172.21.15.37:48278) 2024-05-30T06:59:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82d8c00640 1 -- 172.21.15.37:0/2696047388 learned_addr learned my addr 172.21.15.37:0/2696047388 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82d3e00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82d406f9a0 0x7f82d4071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82cbe00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d40b2ec0 0x7f82d40724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82d8c00640 1 -- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82d406f9a0 msgr2=0x7f82d4071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82d8c00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82d406f9a0 0x7f82d4071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82d8c00640 1 -- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d40b2ec0 msgr2=0x7f82d40724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82d8c00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d40b2ec0 0x7f82d40724e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82d8c00640 1 -- 172.21.15.37:0/2696047388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d40b0d80 con 0x7f82d4155e60 2024-05-30T06:59:11.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82d8c00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d4155e60 0x7f82d415d630 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0b0040 tx=0x7f82cc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:11.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82d0c00640 1 -- 172.21.15.37:0/2696047388 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0b2050 con 0x7f82d4155e60 2024-05-30T06:59:11.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82d0c00640 1 -- 172.21.15.37:0/2696047388 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc0b3040 con 0x7f82d4155e60 2024-05-30T06:59:11.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82d0c00640 1 -- 172.21.15.37:0/2696047388 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0ad870 con 0x7f82d4155e60 2024-05-30T06:59:11.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82dac00640 1 -- 172.21.15.37:0/2696047388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d40b1060 con 0x7f82d4155e60 2024-05-30T06:59:11.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82dac00640 1 -- 172.21.15.37:0/2696047388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d40b1620 con 0x7f82d4155e60 2024-05-30T06:59:11.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.606+0000 7f82dac00640 1 -- 172.21.15.37:0/2696047388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d4068b20 con 0x7f82d4155e60 2024-05-30T06:59:11.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.610+0000 7f82d0c00640 1 -- 172.21.15.37:0/2696047388 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f82cc0c0020 con 0x7f82d4155e60 2024-05-30T06:59:11.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.610+0000 7f82d0c00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f82b006a030 0x7f82b006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.610+0000 7f82d0c00640 1 -- 172.21.15.37:0/2696047388 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7f82cc120900 con 0x7f82d4155e60 2024-05-30T06:59:11.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.610+0000 7f82d3e00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f82b006a030 0x7f82b006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.610+0000 7f82d3e00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f82b006a030 0x7f82b006c4f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f82c4000f70 tx=0x7f82c4007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:11.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.614+0000 7f82d0c00640 1 -- 172.21.15.37:0/2696047388 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f82cc0c7020 con 0x7f82d4155e60 2024-05-30T06:59:11.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.778+0000 7f82dac00640 1 -- 172.21.15.37:0/2696047388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82d4072fb0 con 0x7f82d4155e60 2024-05-30T06:59:11.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.778+0000 7f82d0c00640 1 -- 172.21.15.37:0/2696047388 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16800 (secure 0 0 0) 0x7f82cc016560 con 0x7f82d4155e60 2024-05-30T06:59:11.780 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:11.781 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":128,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:59:08.999711+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:59:05.805744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-05-30T06:59:06.396391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T06:59:11.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.782+0000 7f82dac00640 1 -- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f82b006a030 msgr2=0x7f82b006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.782+0000 7f82dac00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f82b006a030 0x7f82b006c4f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f82c4000f70 tx=0x7f82c4007df0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.782+0000 7f82dac00640 1 -- 172.21.15.37:0/2696047388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d4155e60 msgr2=0x7f82d415d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.782+0000 7f82dac00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d4155e60 0x7f82d415d630 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0b0040 tx=0x7f82cc019710 comp rx=0 tx=0).stop 2024-05-30T06:59:11.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.782+0000 7f82dac00640 1 -- 172.21.15.37:0/2696047388 shutdown_connections 2024-05-30T06:59:11.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.782+0000 7f82dac00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82d4155e60 0x7f82d415d630 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.782+0000 7f82dac00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f82b006a030 0x7f82b006c4f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.782+0000 7f82dac00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82d40b2ec0 0x7f82d40724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.782+0000 7f82dac00640 1 --2- 172.21.15.37:0/2696047388 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82d406f9a0 0x7f82d4071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.782+0000 7f82dac00640 1 -- 172.21.15.37:0/2696047388 >> 172.21.15.37:0/2696047388 conn(0x7f82d40b23a0 msgr2=0x7f82d415f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:11.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.782+0000 7f82dac00640 1 -- 172.21.15.37:0/2696047388 shutdown_connections 2024-05-30T06:59:11.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.782+0000 7f82dac00640 1 -- 172.21.15.37:0/2696047388 wait complete. 2024-05-30T06:59:11.803 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-30T06:59:11.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:59:11.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.942+0000 7fd338400640 1 Processor -- start 2024-05-30T06:59:11.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.942+0000 7fd338400640 1 -- start start 2024-05-30T06:59:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.942+0000 7fd338400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33015fb30 0x7fd3300b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.942+0000 7fd338400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd330162f70 con 0x7fd33006d080 2024-05-30T06:59:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.942+0000 7fd338400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd330163210 con 0x7fd3300b55a0 2024-05-30T06:59:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.942+0000 7fd338400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd3300b4040 con 0x7fd33015fb30 2024-05-30T06:59:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd336400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd33006d080 0x7fd3300aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48054/0 (socket says 172.21.15.37:48054) 2024-05-30T06:59:11.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd336400640 1 -- 172.21.15.37:0/3546812273 learned_addr learned my addr 172.21.15.37:0/3546812273 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd335000640 1 --2- 172.21.15.37:0/3546812273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33015fb30 0x7fd3300b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3818204858 0 0) 0x7fd330162f70 con 0x7fd33006d080 2024-05-30T06:59:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd318003530 con 0x7fd33006d080 2024-05-30T06:59:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3506111493 0 0) 0x7fd330163210 con 0x7fd3300b55a0 2024-05-30T06:59:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd330162f70 con 0x7fd3300b55a0 2024-05-30T06:59:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3027470140 0 0) 0x7fd318003530 con 0x7fd33006d080 2024-05-30T06:59:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33015fb30 msgr2=0x7fd3300b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:11.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 --2- 172.21.15.37:0/3546812273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33015fb30 0x7fd3300b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 >> v1:172.21.15.105:6789/0 conn(0x7fd3300b55a0 legacy=0x7fd3300b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3300b4320 con 0x7fd33006d080 2024-05-30T06:59:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fd328001980 con 0x7fd33006d080 2024-05-30T06:59:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 >> v1:172.21.15.37:6789/0 conn(0x7fd33006d080 legacy=0x7fd3300aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 --2- 172.21.15.37:0/3546812273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd318003b80 0x7fd318003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 --2- 172.21.15.37:0/3546812273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd318004810 0x7fd318004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 --2- 172.21.15.37:0/3546812273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33015fb30 0x7fd318005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3300b4040 con 0x7fd318003b80 2024-05-30T06:59:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd31800bb60 con 0x7fd318004810 2024-05-30T06:59:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd31800bd30 con 0x7fd33015fb30 2024-05-30T06:59:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd335a00640 1 --2- 172.21.15.37:0/3546812273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd318003b80 0x7fd318003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd335000640 1 --2- 172.21.15.37:0/3546812273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd318004810 0x7fd318004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd336400640 1 --2- 172.21.15.37:0/3546812273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33015fb30 0x7fd318005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd335a00640 1 -- 172.21.15.37:0/3546812273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33015fb30 msgr2=0x7fd318005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:11.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd335a00640 1 --2- 172.21.15.37:0/3546812273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33015fb30 0x7fd318005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd335a00640 1 -- 172.21.15.37:0/3546812273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd318004810 msgr2=0x7fd318004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:11.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd335a00640 1 --2- 172.21.15.37:0/3546812273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd318004810 0x7fd318004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd335a00640 1 -- 172.21.15.37:0/3546812273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd318003530 con 0x7fd318003b80 2024-05-30T06:59:11.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.946+0000 7fd336400640 1 --2- 172.21.15.37:0/3546812273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33015fb30 0x7fd318005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.950+0000 7fd335a00640 1 --2- 172.21.15.37:0/3546812273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd318003b80 0x7fd318003f80 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fd324001900 tx=0x7fd32401c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eda7020b287bb07 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.950+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3240af070 con 0x7fd318003b80 2024-05-30T06:59:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.950+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3240052f0 con 0x7fd318003b80 2024-05-30T06:59:11.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.950+0000 7fd32fe00640 1 -- 172.21.15.37:0/3546812273 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324001520 con 0x7fd318003b80 2024-05-30T06:59:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.950+0000 7fd338400640 1 -- 172.21.15.37:0/3546812273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd318003b80 msgr2=0x7fd318003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.950+0000 7fd338400640 1 --2- 172.21.15.37:0/3546812273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd318003b80 0x7fd318003f80 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fd324001900 tx=0x7fd32401c580 comp rx=0 tx=0).stop 2024-05-30T06:59:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.950+0000 7fd336400640 1 -- 172.21.15.37:0/3546812273 reap_dead start 2024-05-30T06:59:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.950+0000 7fd338400640 1 -- 172.21.15.37:0/3546812273 shutdown_connections 2024-05-30T06:59:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.950+0000 7fd338400640 1 -- 172.21.15.37:0/3546812273 >> 172.21.15.37:0/3546812273 conn(0x7fd330073680 msgr2=0x7fd33006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.950+0000 7fd338400640 1 -- 172.21.15.37:0/3546812273 shutdown_connections 2024-05-30T06:59:11.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.950+0000 7fd338400640 1 -- 172.21.15.37:0/3546812273 wait complete. 2024-05-30T06:59:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.950+0000 7fd338400640 1 Processor -- start 2024-05-30T06:59:11.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.950+0000 7fd338400640 1 -- start start 2024-05-30T06:59:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd338400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd318003b80 0x7fd3301626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd338400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3301484c0 0x7fd330147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd338400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd330149ad0 0x7fd330149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd338400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd33016a9e0 con 0x7fd330149ad0 2024-05-30T06:59:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd338400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd33016a860 con 0x7fd318003b80 2024-05-30T06:59:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd338400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd33016ab60 con 0x7fd3301484c0 2024-05-30T06:59:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd336400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd330149ad0 0x7fd330149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd336400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd330149ad0 0x7fd330149f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48282/0 (socket says 172.21.15.37:48282) 2024-05-30T06:59:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd336400640 1 -- 172.21.15.37:0/3756829219 learned_addr learned my addr 172.21.15.37:0/3756829219 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:11.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd335a00640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd318003b80 0x7fd3301626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd335000640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3301484c0 0x7fd330147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd336400640 1 -- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3301484c0 msgr2=0x7fd330147b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd336400640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3301484c0 0x7fd330147b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd336400640 1 -- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd318003b80 msgr2=0x7fd3301626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd336400640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd318003b80 0x7fd3301626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd336400640 1 -- 172.21.15.37:0/3756829219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd330162c30 con 0x7fd330149ad0 2024-05-30T06:59:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd335000640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3301484c0 0x7fd330147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:59:11.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd336400640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd330149ad0 0x7fd330149f80 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fd330160040 tx=0x7fd328007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd32d600640 1 -- 172.21.15.37:0/3756829219 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32800e9c0 con 0x7fd330149ad0 2024-05-30T06:59:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd32d600640 1 -- 172.21.15.37:0/3756829219 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32800eb60 con 0x7fd330149ad0 2024-05-30T06:59:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd338400640 1 -- 172.21.15.37:0/3756829219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd330148a30 con 0x7fd330149ad0 2024-05-30T06:59:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd32d600640 1 -- 172.21.15.37:0/3756829219 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32800ed50 con 0x7fd330149ad0 2024-05-30T06:59:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd338400640 1 -- 172.21.15.37:0/3756829219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd330148ff0 con 0x7fd330149ad0 2024-05-30T06:59:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd338400640 1 -- 172.21.15.37:0/3756829219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd330068b20 con 0x7fd330149ad0 2024-05-30T06:59:11.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.954+0000 7fd32d600640 1 -- 172.21.15.37:0/3756829219 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fd32801a020 con 0x7fd330149ad0 2024-05-30T06:59:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.958+0000 7fd32d600640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd31006a0b0 0x7fd31006c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.958+0000 7fd32d600640 1 -- 172.21.15.37:0/3756829219 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7fd3280851e0 con 0x7fd330149ad0 2024-05-30T06:59:11.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.958+0000 7fd335a00640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd31006a0b0 0x7fd31006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:11.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.958+0000 7fd335a00640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd31006a0b0 0x7fd31006c570 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd3240ac000 tx=0x7fd3240a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:11.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:11.962+0000 7fd32d600640 1 -- 172.21.15.37:0/3756829219 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd328021020 con 0x7fd330149ad0 2024-05-30T06:59:12.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.122+0000 7fd338400640 1 -- 172.21.15.37:0/3756829219 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd330169640 con 0x7fd31006a0b0 2024-05-30T06:59:12.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.130+0000 7fd32d600640 1 -- 172.21.15.37:0/3756829219 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252437 (secure 0 0 0) 0x7fd330169640 con 0x7fd31006a0b0 2024-05-30T06:59:12.136 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:12.138 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:59:12.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.134+0000 7fd338400640 1 -- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd31006a0b0 msgr2=0x7fd31006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.134+0000 7fd338400640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd31006a0b0 0x7fd31006c570 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd3240ac000 tx=0x7fd3240a7000 comp rx=0 tx=0).stop 2024-05-30T06:59:12.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.134+0000 7fd338400640 1 -- 172.21.15.37:0/3756829219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd330149ad0 msgr2=0x7fd330149f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.134+0000 7fd338400640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd330149ad0 0x7fd330149f80 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fd330160040 tx=0x7fd328007b10 comp rx=0 tx=0).stop 2024-05-30T06:59:12.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.134+0000 7fd338400640 1 -- 172.21.15.37:0/3756829219 shutdown_connections 2024-05-30T06:59:12.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.134+0000 7fd338400640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd330149ad0 0x7fd330149f80 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.134+0000 7fd338400640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3301484c0 0x7fd330147b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.134+0000 7fd338400640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd31006a0b0 0x7fd31006c570 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.134+0000 7fd338400640 1 --2- 172.21.15.37:0/3756829219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd318003b80 0x7fd3301626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.134+0000 7fd338400640 1 -- 172.21.15.37:0/3756829219 >> 172.21.15.37:0/3756829219 conn(0x7fd330073680 msgr2=0x7fd330074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:12.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.134+0000 7fd338400640 1 -- 172.21.15.37:0/3756829219 shutdown_connections 2024-05-30T06:59:12.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.134+0000 7fd338400640 1 -- 172.21.15.37:0/3756829219 wait complete. 2024-05-30T06:59:12.155 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":637,"stamp":"2024-05-30T06:59:11.001445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1013592,"kb_used_data":13588,"kb_used_omap":12,"kb_used_meta":999859,"kb_avail":753961128,"statfs":{"total":773094113280,"available":772056195072,"internally_reserved":0,"allocated":13914112,"data_stored":6751105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1023856176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.011152"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.028609+0000","last_change":"2024-05-30T06:59:08.024160+0000","last_active":"2024-05-30T06:59:08.028609+0000","last_peered":"2024-05-30T06:59:08.028609+0000","last_clean":"2024-05-30T06:59:08.028609+0000","last_became_active":"2024-05-30T06:59:08.023564+0000","last_became_peered":"2024-05-30T06:59:08.023564+0000","last_unstale":"2024-05-30T06:59:08.028609+0000","last_undegraded":"2024-05-30T06:59:08.028609+0000","last_fullsized":"2024-05-30T06:59:08.028609+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:31:48.902149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.018818+0000","last_change":"2024-05-30T06:59:08.017254+0000","last_active":"2024-05-30T06:59:08.018818+0000","last_peered":"2024-05-30T06:59:08.018818+0000","last_clean":"2024-05-30T06:59:08.018818+0000","last_became_active":"2024-05-30T06:59:08.016947+0000","last_became_peered":"2024-05-30T06:59:08.016947+0000","last_unstale":"2024-05-30T06:59:08.018818+0000","last_undegraded":"2024-05-30T06:59:08.018818+0000","last_fullsized":"2024-05-30T06:59:08.018818+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:55:11.815763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.032976+0000","last_change":"2024-05-30T06:59:08.031486+0000","last_active":"2024-05-30T06:59:08.032976+0000","last_peered":"2024-05-30T06:59:08.032976+0000","last_clean":"2024-05-30T06:59:08.032976+0000","last_became_active":"2024-05-30T06:59:08.030677+0000","last_became_peered":"2024-05-30T06:59:08.030677+0000","last_unstale":"2024-05-30T06:59:08.032976+0000","last_undegraded":"2024-05-30T06:59:08.032976+0000","last_fullsized":"2024-05-30T06:59:08.032976+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:45:20.303693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.039662+0000","last_change":"2024-05-30T06:59:08.038710+0000","last_active":"2024-05-30T06:59:08.039662+0000","last_peered":"2024-05-30T06:59:08.039662+0000","last_clean":"2024-05-30T06:59:08.039662+0000","last_became_active":"2024-05-30T06:59:08.038437+0000","last_became_peered":"2024-05-30T06:59:08.038437+0000","last_unstale":"2024-05-30T06:59:08.039662+0000","last_undegraded":"2024-05-30T06:59:08.039662+0000","last_fullsized":"2024-05-30T06:59:08.039662+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:57:27.985034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.047007+0000","last_change":"2024-05-30T06:59:08.046184+0000","last_active":"2024-05-30T06:59:08.047007+0000","last_peered":"2024-05-30T06:59:08.047007+0000","last_clean":"2024-05-30T06:59:08.047007+0000","last_became_active":"2024-05-30T06:59:08.045942+0000","last_became_peered":"2024-05-30T06:59:08.045942+0000","last_unstale":"2024-05-30T06:59:08.047007+0000","last_undegraded":"2024-05-30T06:59:08.047007+0000","last_fullsized":"2024-05-30T06:59:08.047007+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:15.909838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.032839+0000","last_change":"2024-05-30T06:59:08.029771+0000","last_active":"2024-05-30T06:59:08.032839+0000","last_peered":"2024-05-30T06:59:08.032839+0000","last_clean":"2024-05-30T06:59:08.032839+0000","last_became_active":"2024-05-30T06:59:08.029463+0000","last_became_peered":"2024-05-30T06:59:08.029463+0000","last_unstale":"2024-05-30T06:59:08.032839+0000","last_undegraded":"2024-05-30T06:59:08.032839+0000","last_fullsized":"2024-05-30T06:59:08.032839+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:07:33.590130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.037682+0000","last_change":"2024-05-30T06:59:08.035845+0000","last_active":"2024-05-30T06:59:08.037682+0000","last_peered":"2024-05-30T06:59:08.037682+0000","last_clean":"2024-05-30T06:59:08.037682+0000","last_became_active":"2024-05-30T06:59:08.035526+0000","last_became_peered":"2024-05-30T06:59:08.035526+0000","last_unstale":"2024-05-30T06:59:08.037682+0000","last_undegraded":"2024-05-30T06:59:08.037682+0000","last_fullsized":"2024-05-30T06:59:08.037682+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:45:54.252002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.037915+0000","last_change":"2024-05-30T06:59:08.035483+0000","last_active":"2024-05-30T06:59:08.037915+0000","last_peered":"2024-05-30T06:59:08.037915+0000","last_clean":"2024-05-30T06:59:08.037915+0000","last_became_active":"2024-05-30T06:59:08.034842+0000","last_became_peered":"2024-05-30T06:59:08.034842+0000","last_unstale":"2024-05-30T06:59:08.037915+0000","last_undegraded":"2024-05-30T06:59:08.037915+0000","last_fullsized":"2024-05-30T06:59:08.037915+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:33:33.050213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045628+0000","last_change":"2024-05-30T06:59:08.044693+0000","last_active":"2024-05-30T06:59:08.045628+0000","last_peered":"2024-05-30T06:59:08.045628+0000","last_clean":"2024-05-30T06:59:08.045628+0000","last_became_active":"2024-05-30T06:59:08.044276+0000","last_became_peered":"2024-05-30T06:59:08.044276+0000","last_unstale":"2024-05-30T06:59:08.045628+0000","last_undegraded":"2024-05-30T06:59:08.045628+0000","last_fullsized":"2024-05-30T06:59:08.045628+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:52.294346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.018293+0000","last_change":"2024-05-30T06:59:08.016455+0000","last_active":"2024-05-30T06:59:08.018293+0000","last_peered":"2024-05-30T06:59:08.018293+0000","last_clean":"2024-05-30T06:59:08.018293+0000","last_became_active":"2024-05-30T06:59:08.016161+0000","last_became_peered":"2024-05-30T06:59:08.016161+0000","last_unstale":"2024-05-30T06:59:08.018293+0000","last_undegraded":"2024-05-30T06:59:08.018293+0000","last_fullsized":"2024-05-30T06:59:08.018293+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:19:12.129168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.023791+0000","last_change":"2024-05-30T06:59:08.022034+0000","last_active":"2024-05-30T06:59:08.023791+0000","last_peered":"2024-05-30T06:59:08.023791+0000","last_clean":"2024-05-30T06:59:08.023791+0000","last_became_active":"2024-05-30T06:59:08.021772+0000","last_became_peered":"2024-05-30T06:59:08.021772+0000","last_unstale":"2024-05-30T06:59:08.023791+0000","last_undegraded":"2024-05-30T06:59:08.023791+0000","last_fullsized":"2024-05-30T06:59:08.023791+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:08:08.594337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045308+0000","last_change":"2024-05-30T06:59:08.044094+0000","last_active":"2024-05-30T06:59:08.045308+0000","last_peered":"2024-05-30T06:59:08.045308+0000","last_clean":"2024-05-30T06:59:08.045308+0000","last_became_active":"2024-05-30T06:59:08.043835+0000","last_became_peered":"2024-05-30T06:59:08.043835+0000","last_unstale":"2024-05-30T06:59:08.045308+0000","last_undegraded":"2024-05-30T06:59:08.045308+0000","last_fullsized":"2024-05-30T06:59:08.045308+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:34:54.814161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.027456+0000","last_change":"2024-05-30T06:59:08.025217+0000","last_active":"2024-05-30T06:59:08.027456+0000","last_peered":"2024-05-30T06:59:08.027456+0000","last_clean":"2024-05-30T06:59:08.027456+0000","last_became_active":"2024-05-30T06:59:08.024478+0000","last_became_peered":"2024-05-30T06:59:08.024478+0000","last_unstale":"2024-05-30T06:59:08.027456+0000","last_undegraded":"2024-05-30T06:59:08.027456+0000","last_fullsized":"2024-05-30T06:59:08.027456+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:20:59.046621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.024535+0000","last_change":"2024-05-30T06:59:08.022376+0000","last_active":"2024-05-30T06:59:08.024535+0000","last_peered":"2024-05-30T06:59:08.024535+0000","last_clean":"2024-05-30T06:59:08.024535+0000","last_became_active":"2024-05-30T06:59:08.022058+0000","last_became_peered":"2024-05-30T06:59:08.022058+0000","last_unstale":"2024-05-30T06:59:08.024535+0000","last_undegraded":"2024-05-30T06:59:08.024535+0000","last_fullsized":"2024-05-30T06:59:08.024535+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:20:20.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.030021+0000","last_change":"2024-05-30T06:59:08.027564+0000","last_active":"2024-05-30T06:59:08.030021+0000","last_peered":"2024-05-30T06:59:08.030021+0000","last_clean":"2024-05-30T06:59:08.030021+0000","last_became_active":"2024-05-30T06:59:08.027303+0000","last_became_peered":"2024-05-30T06:59:08.027303+0000","last_unstale":"2024-05-30T06:59:08.030021+0000","last_undegraded":"2024-05-30T06:59:08.030021+0000","last_fullsized":"2024-05-30T06:59:08.030021+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:17:29.740042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.030665+0000","last_change":"2024-05-30T06:59:08.023401+0000","last_active":"2024-05-30T06:59:08.030665+0000","last_peered":"2024-05-30T06:59:08.030665+0000","last_clean":"2024-05-30T06:59:08.030665+0000","last_became_active":"2024-05-30T06:59:08.022914+0000","last_became_peered":"2024-05-30T06:59:08.022914+0000","last_unstale":"2024-05-30T06:59:08.030665+0000","last_undegraded":"2024-05-30T06:59:08.030665+0000","last_fullsized":"2024-05-30T06:59:08.030665+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:56:25.088778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.030630+0000","last_change":"2024-05-30T06:59:08.024708+0000","last_active":"2024-05-30T06:59:08.030630+0000","last_peered":"2024-05-30T06:59:08.030630+0000","last_clean":"2024-05-30T06:59:08.030630+0000","last_became_active":"2024-05-30T06:59:08.024445+0000","last_became_peered":"2024-05-30T06:59:08.024445+0000","last_unstale":"2024-05-30T06:59:08.030630+0000","last_undegraded":"2024-05-30T06:59:08.030630+0000","last_fullsized":"2024-05-30T06:59:08.030630+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:51:04.988561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.028419+0000","last_change":"2024-05-30T06:59:08.023258+0000","last_active":"2024-05-30T06:59:08.028419+0000","last_peered":"2024-05-30T06:59:08.028419+0000","last_clean":"2024-05-30T06:59:08.028419+0000","last_became_active":"2024-05-30T06:59:08.017709+0000","last_became_peered":"2024-05-30T06:59:08.017709+0000","last_unstale":"2024-05-30T06:59:08.028419+0000","last_undegraded":"2024-05-30T06:59:08.028419+0000","last_fullsized":"2024-05-30T06:59:08.028419+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:13.314661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.029886+0000","last_change":"2024-05-30T06:59:08.026237+0000","last_active":"2024-05-30T06:59:08.029886+0000","last_peered":"2024-05-30T06:59:08.029886+0000","last_clean":"2024-05-30T06:59:08.029886+0000","last_became_active":"2024-05-30T06:59:08.025981+0000","last_became_peered":"2024-05-30T06:59:08.025981+0000","last_unstale":"2024-05-30T06:59:08.029886+0000","last_undegraded":"2024-05-30T06:59:08.029886+0000","last_fullsized":"2024-05-30T06:59:08.029886+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:34.693941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.020125+0000","last_change":"2024-05-30T06:59:08.018790+0000","last_active":"2024-05-30T06:59:08.020125+0000","last_peered":"2024-05-30T06:59:08.020125+0000","last_clean":"2024-05-30T06:59:08.020125+0000","last_became_active":"2024-05-30T06:59:08.015033+0000","last_became_peered":"2024-05-30T06:59:08.015033+0000","last_unstale":"2024-05-30T06:59:08.020125+0000","last_undegraded":"2024-05-30T06:59:08.020125+0000","last_fullsized":"2024-05-30T06:59:08.020125+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:30:30.629687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.047021+0000","last_change":"2024-05-30T06:59:08.046183+0000","last_active":"2024-05-30T06:59:08.047021+0000","last_peered":"2024-05-30T06:59:08.047021+0000","last_clean":"2024-05-30T06:59:08.047021+0000","last_became_active":"2024-05-30T06:59:08.045891+0000","last_became_peered":"2024-05-30T06:59:08.045891+0000","last_unstale":"2024-05-30T06:59:08.047021+0000","last_undegraded":"2024-05-30T06:59:08.047021+0000","last_fullsized":"2024-05-30T06:59:08.047021+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:23.377454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.024343+0000","last_change":"2024-05-30T06:59:08.019956+0000","last_active":"2024-05-30T06:59:08.024343+0000","last_peered":"2024-05-30T06:59:08.024343+0000","last_clean":"2024-05-30T06:59:08.024343+0000","last_became_active":"2024-05-30T06:59:08.019670+0000","last_became_peered":"2024-05-30T06:59:08.019670+0000","last_unstale":"2024-05-30T06:59:08.024343+0000","last_undegraded":"2024-05-30T06:59:08.024343+0000","last_fullsized":"2024-05-30T06:59:08.024343+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:23.377454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045238+0000","last_change":"2024-05-30T06:59:08.044096+0000","last_active":"2024-05-30T06:59:08.045238+0000","last_peered":"2024-05-30T06:59:08.045238+0000","last_clean":"2024-05-30T06:59:08.045238+0000","last_became_active":"2024-05-30T06:59:08.043786+0000","last_became_peered":"2024-05-30T06:59:08.043786+0000","last_unstale":"2024-05-30T06:59:08.045238+0000","last_undegraded":"2024-05-30T06:59:08.045238+0000","last_fullsized":"2024-05-30T06:59:08.045238+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:11:55.774410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.023620+0000","last_change":"2024-05-30T06:59:08.022594+0000","last_active":"2024-05-30T06:59:08.023620+0000","last_peered":"2024-05-30T06:59:08.023620+0000","last_clean":"2024-05-30T06:59:08.023620+0000","last_became_active":"2024-05-30T06:59:08.022293+0000","last_became_peered":"2024-05-30T06:59:08.022293+0000","last_unstale":"2024-05-30T06:59:08.023620+0000","last_undegraded":"2024-05-30T06:59:08.023620+0000","last_fullsized":"2024-05-30T06:59:08.023620+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:05:26.527928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.039949+0000","last_change":"2024-05-30T06:59:08.038685+0000","last_active":"2024-05-30T06:59:08.039949+0000","last_peered":"2024-05-30T06:59:08.039949+0000","last_clean":"2024-05-30T06:59:08.039949+0000","last_became_active":"2024-05-30T06:59:08.038414+0000","last_became_peered":"2024-05-30T06:59:08.038414+0000","last_unstale":"2024-05-30T06:59:08.039949+0000","last_undegraded":"2024-05-30T06:59:08.039949+0000","last_fullsized":"2024-05-30T06:59:08.039949+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:49:09.216308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.031621+0000","last_change":"2024-05-30T06:59:08.027380+0000","last_active":"2024-05-30T06:59:08.031621+0000","last_peered":"2024-05-30T06:59:08.031621+0000","last_clean":"2024-05-30T06:59:08.031621+0000","last_became_active":"2024-05-30T06:59:08.027113+0000","last_became_peered":"2024-05-30T06:59:08.027113+0000","last_unstale":"2024-05-30T06:59:08.031621+0000","last_undegraded":"2024-05-30T06:59:08.031621+0000","last_fullsized":"2024-05-30T06:59:08.031621+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:49:32.634774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.030263+0000","last_change":"2024-05-30T06:59:08.024951+0000","last_active":"2024-05-30T06:59:08.030263+0000","last_peered":"2024-05-30T06:59:08.030263+0000","last_clean":"2024-05-30T06:59:08.030263+0000","last_became_active":"2024-05-30T06:59:08.024354+0000","last_became_peered":"2024-05-30T06:59:08.024354+0000","last_unstale":"2024-05-30T06:59:08.030263+0000","last_undegraded":"2024-05-30T06:59:08.030263+0000","last_fullsized":"2024-05-30T06:59:08.030263+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:58.533777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.043369+0000","last_change":"2024-05-30T06:59:08.033925+0000","last_active":"2024-05-30T06:59:08.043369+0000","last_peered":"2024-05-30T06:59:08.043369+0000","last_clean":"2024-05-30T06:59:08.043369+0000","last_became_active":"2024-05-30T06:59:08.033552+0000","last_became_peered":"2024-05-30T06:59:08.033552+0000","last_unstale":"2024-05-30T06:59:08.043369+0000","last_undegraded":"2024-05-30T06:59:08.043369+0000","last_fullsized":"2024-05-30T06:59:08.043369+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:42:53.672075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.034089+0000","last_change":"2024-05-30T06:59:08.033338+0000","last_active":"2024-05-30T06:59:08.034089+0000","last_peered":"2024-05-30T06:59:08.034089+0000","last_clean":"2024-05-30T06:59:08.034089+0000","last_became_active":"2024-05-30T06:59:08.032376+0000","last_became_peered":"2024-05-30T06:59:08.032376+0000","last_unstale":"2024-05-30T06:59:08.034089+0000","last_undegraded":"2024-05-30T06:59:08.034089+0000","last_fullsized":"2024-05-30T06:59:08.034089+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:37:04.900853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.033718+0000","last_change":"2024-05-30T06:59:08.032860+0000","last_active":"2024-05-30T06:59:08.033718+0000","last_peered":"2024-05-30T06:59:08.033718+0000","last_clean":"2024-05-30T06:59:08.033718+0000","last_became_active":"2024-05-30T06:59:08.032457+0000","last_became_peered":"2024-05-30T06:59:08.032457+0000","last_unstale":"2024-05-30T06:59:08.033718+0000","last_undegraded":"2024-05-30T06:59:08.033718+0000","last_fullsized":"2024-05-30T06:59:08.033718+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:38.643085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.042544+0000","last_change":"2024-05-30T06:59:08.039799+0000","last_active":"2024-05-30T06:59:08.042544+0000","last_peered":"2024-05-30T06:59:08.042544+0000","last_clean":"2024-05-30T06:59:08.042544+0000","last_became_active":"2024-05-30T06:59:08.039524+0000","last_became_peered":"2024-05-30T06:59:08.039524+0000","last_unstale":"2024-05-30T06:59:08.042544+0000","last_undegraded":"2024-05-30T06:59:08.042544+0000","last_fullsized":"2024-05-30T06:59:08.042544+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:07:33.988552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.029514+0000","last_change":"2024-05-30T06:59:08.025201+0000","last_active":"2024-05-30T06:59:08.029514+0000","last_peered":"2024-05-30T06:59:08.029514+0000","last_clean":"2024-05-30T06:59:08.029514+0000","last_became_active":"2024-05-30T06:59:08.023719+0000","last_became_peered":"2024-05-30T06:59:08.023719+0000","last_unstale":"2024-05-30T06:59:08.029514+0000","last_undegraded":"2024-05-30T06:59:08.029514+0000","last_fullsized":"2024-05-30T06:59:08.029514+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:35:10.022749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.028398+0000","last_change":"2024-05-30T06:59:08.022581+0000","last_active":"2024-05-30T06:59:08.028398+0000","last_peered":"2024-05-30T06:59:08.028398+0000","last_clean":"2024-05-30T06:59:08.028398+0000","last_became_active":"2024-05-30T06:59:08.017322+0000","last_became_peered":"2024-05-30T06:59:08.017322+0000","last_unstale":"2024-05-30T06:59:08.028398+0000","last_undegraded":"2024-05-30T06:59:08.028398+0000","last_fullsized":"2024-05-30T06:59:08.028398+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:43.846702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"127'4","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.041073+0000","last_change":"2024-05-30T06:59:07.025645+0000","last_active":"2024-05-30T06:59:08.041073+0000","last_peered":"2024-05-30T06:59:08.041073+0000","last_clean":"2024-05-30T06:59:08.041073+0000","last_became_active":"2024-05-30T06:59:07.025401+0000","last_became_peered":"2024-05-30T06:59:07.025401+0000","last_unstale":"2024-05-30T06:59:08.041073+0000","last_undegraded":"2024-05-30T06:59:08.041073+0000","last_fullsized":"2024-05-30T06:59:08.041073+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:12.308444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.041176+0000","last_change":"2024-05-30T06:59:08.037515+0000","last_active":"2024-05-30T06:59:08.041176+0000","last_peered":"2024-05-30T06:59:08.041176+0000","last_clean":"2024-05-30T06:59:08.041176+0000","last_became_active":"2024-05-30T06:59:08.037242+0000","last_became_peered":"2024-05-30T06:59:08.037242+0000","last_unstale":"2024-05-30T06:59:08.041176+0000","last_undegraded":"2024-05-30T06:59:08.041176+0000","last_fullsized":"2024-05-30T06:59:08.041176+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:33:50.003182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"127'1","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.038627+0000","last_change":"2024-05-30T06:59:07.028000+0000","last_active":"2024-05-30T06:59:08.038627+0000","last_peered":"2024-05-30T06:59:08.038627+0000","last_clean":"2024-05-30T06:59:08.038627+0000","last_became_active":"2024-05-30T06:59:07.027686+0000","last_became_peered":"2024-05-30T06:59:07.027686+0000","last_unstale":"2024-05-30T06:59:08.038627+0000","last_undegraded":"2024-05-30T06:59:08.038627+0000","last_fullsized":"2024-05-30T06:59:08.038627+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:22:41.838812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.041467+0000","last_change":"2024-05-30T06:59:08.039191+0000","last_active":"2024-05-30T06:59:08.041467+0000","last_peered":"2024-05-30T06:59:08.041467+0000","last_clean":"2024-05-30T06:59:08.041467+0000","last_became_active":"2024-05-30T06:59:08.038891+0000","last_became_peered":"2024-05-30T06:59:08.038891+0000","last_unstale":"2024-05-30T06:59:08.041467+0000","last_undegraded":"2024-05-30T06:59:08.041467+0000","last_fullsized":"2024-05-30T06:59:08.041467+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:49:46.450533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"127'2","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.027912+0000","last_change":"2024-05-30T06:59:07.021128+0000","last_active":"2024-05-30T06:59:08.027912+0000","last_peered":"2024-05-30T06:59:08.027912+0000","last_clean":"2024-05-30T06:59:08.027912+0000","last_became_active":"2024-05-30T06:59:07.020820+0000","last_became_peered":"2024-05-30T06:59:07.020820+0000","last_unstale":"2024-05-30T06:59:08.027912+0000","last_undegraded":"2024-05-30T06:59:08.027912+0000","last_fullsized":"2024-05-30T06:59:08.027912+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:01:56.813502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.040967+0000","last_change":"2024-05-30T06:59:08.033837+0000","last_active":"2024-05-30T06:59:08.040967+0000","last_peered":"2024-05-30T06:59:08.040967+0000","last_clean":"2024-05-30T06:59:08.040967+0000","last_became_active":"2024-05-30T06:59:08.033506+0000","last_became_peered":"2024-05-30T06:59:08.033506+0000","last_unstale":"2024-05-30T06:59:08.040967+0000","last_undegraded":"2024-05-30T06:59:08.040967+0000","last_fullsized":"2024-05-30T06:59:08.040967+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:56:25.088778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"127'2","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.028207+0000","last_change":"2024-05-30T06:59:07.025478+0000","last_active":"2024-05-30T06:59:08.028207+0000","last_peered":"2024-05-30T06:59:08.028207+0000","last_clean":"2024-05-30T06:59:08.028207+0000","last_became_active":"2024-05-30T06:59:07.025201+0000","last_became_peered":"2024-05-30T06:59:07.025201+0000","last_unstale":"2024-05-30T06:59:08.028207+0000","last_undegraded":"2024-05-30T06:59:08.028207+0000","last_fullsized":"2024-05-30T06:59:08.028207+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:37:03.894636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.024744+0000","last_change":"2024-05-30T06:59:08.022157+0000","last_active":"2024-05-30T06:59:08.024744+0000","last_peered":"2024-05-30T06:59:08.024744+0000","last_clean":"2024-05-30T06:59:08.024744+0000","last_became_active":"2024-05-30T06:59:08.017121+0000","last_became_peered":"2024-05-30T06:59:08.017121+0000","last_unstale":"2024-05-30T06:59:08.024744+0000","last_undegraded":"2024-05-30T06:59:08.024744+0000","last_fullsized":"2024-05-30T06:59:08.024744+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:59.888055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"127'1","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.014901+0000","last_change":"2024-05-30T06:59:07.026285+0000","last_active":"2024-05-30T06:59:08.014901+0000","last_peered":"2024-05-30T06:59:08.014901+0000","last_clean":"2024-05-30T06:59:08.014901+0000","last_became_active":"2024-05-30T06:59:07.025467+0000","last_became_peered":"2024-05-30T06:59:07.025467+0000","last_unstale":"2024-05-30T06:59:08.014901+0000","last_undegraded":"2024-05-30T06:59:08.014901+0000","last_fullsized":"2024-05-30T06:59:08.014901+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:37.636868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.025843+0000","last_change":"2024-05-30T06:59:08.022678+0000","last_active":"2024-05-30T06:59:08.025843+0000","last_peered":"2024-05-30T06:59:08.025843+0000","last_clean":"2024-05-30T06:59:08.025843+0000","last_became_active":"2024-05-30T06:59:08.022387+0000","last_became_peered":"2024-05-30T06:59:08.022387+0000","last_unstale":"2024-05-30T06:59:08.025843+0000","last_undegraded":"2024-05-30T06:59:08.025843+0000","last_fullsized":"2024-05-30T06:59:08.025843+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:21:24.557259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"127'1","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.021807+0000","last_change":"2024-05-30T06:59:07.020549+0000","last_active":"2024-05-30T06:59:08.021807+0000","last_peered":"2024-05-30T06:59:08.021807+0000","last_clean":"2024-05-30T06:59:08.021807+0000","last_became_active":"2024-05-30T06:59:07.020278+0000","last_became_peered":"2024-05-30T06:59:07.020278+0000","last_unstale":"2024-05-30T06:59:08.021807+0000","last_undegraded":"2024-05-30T06:59:08.021807+0000","last_fullsized":"2024-05-30T06:59:08.021807+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:33:45.564464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.038029+0000","last_change":"2024-05-30T06:59:08.035741+0000","last_active":"2024-05-30T06:59:08.038029+0000","last_peered":"2024-05-30T06:59:08.038029+0000","last_clean":"2024-05-30T06:59:08.038029+0000","last_became_active":"2024-05-30T06:59:08.035015+0000","last_became_peered":"2024-05-30T06:59:08.035015+0000","last_unstale":"2024-05-30T06:59:08.038029+0000","last_undegraded":"2024-05-30T06:59:08.038029+0000","last_fullsized":"2024-05-30T06:59:08.038029+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:14:49.671311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.013224+0000","last_change":"2024-05-30T06:59:07.015142+0000","last_active":"2024-05-30T06:59:08.013224+0000","last_peered":"2024-05-30T06:59:08.013224+0000","last_clean":"2024-05-30T06:59:08.013224+0000","last_became_active":"2024-05-30T06:59:07.013998+0000","last_became_peered":"2024-05-30T06:59:07.013998+0000","last_unstale":"2024-05-30T06:59:08.013224+0000","last_undegraded":"2024-05-30T06:59:08.013224+0000","last_fullsized":"2024-05-30T06:59:08.013224+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:07:17.296567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.013704+0000","last_change":"2024-05-30T06:59:08.012136+0000","last_active":"2024-05-30T06:59:08.013704+0000","last_peered":"2024-05-30T06:59:08.013704+0000","last_clean":"2024-05-30T06:59:08.013704+0000","last_became_active":"2024-05-30T06:59:08.011821+0000","last_became_peered":"2024-05-30T06:59:08.011821+0000","last_unstale":"2024-05-30T06:59:08.013704+0000","last_undegraded":"2024-05-30T06:59:08.013704+0000","last_fullsized":"2024-05-30T06:59:08.013704+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:29:37.627610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.002687+0000","last_change":"2024-05-30T06:59:07.018234+0000","last_active":"2024-05-30T06:59:08.002687+0000","last_peered":"2024-05-30T06:59:08.002687+0000","last_clean":"2024-05-30T06:59:08.002687+0000","last_became_active":"2024-05-30T06:59:07.017948+0000","last_became_peered":"2024-05-30T06:59:07.017948+0000","last_unstale":"2024-05-30T06:59:08.002687+0000","last_undegraded":"2024-05-30T06:59:08.002687+0000","last_fullsized":"2024-05-30T06:59:08.002687+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:58.214120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.027421+0000","last_change":"2024-05-30T06:59:08.024166+0000","last_active":"2024-05-30T06:59:08.027421+0000","last_peered":"2024-05-30T06:59:08.027421+0000","last_clean":"2024-05-30T06:59:08.027421+0000","last_became_active":"2024-05-30T06:59:08.023873+0000","last_became_peered":"2024-05-30T06:59:08.023873+0000","last_unstale":"2024-05-30T06:59:08.027421+0000","last_undegraded":"2024-05-30T06:59:08.027421+0000","last_fullsized":"2024-05-30T06:59:08.027421+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:36:23.829031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.014539+0000","last_change":"2024-05-30T06:59:07.024511+0000","last_active":"2024-05-30T06:59:08.014539+0000","last_peered":"2024-05-30T06:59:08.014539+0000","last_clean":"2024-05-30T06:59:08.014539+0000","last_became_active":"2024-05-30T06:59:07.024244+0000","last_became_peered":"2024-05-30T06:59:07.024244+0000","last_unstale":"2024-05-30T06:59:08.014539+0000","last_undegraded":"2024-05-30T06:59:08.014539+0000","last_fullsized":"2024-05-30T06:59:08.014539+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:55.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.039487+0000","last_change":"2024-05-30T06:59:08.025397+0000","last_active":"2024-05-30T06:59:08.039487+0000","last_peered":"2024-05-30T06:59:08.039487+0000","last_clean":"2024-05-30T06:59:08.039487+0000","last_became_active":"2024-05-30T06:59:08.023906+0000","last_became_peered":"2024-05-30T06:59:08.023906+0000","last_unstale":"2024-05-30T06:59:08.039487+0000","last_undegraded":"2024-05-30T06:59:08.039487+0000","last_fullsized":"2024-05-30T06:59:08.039487+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:06:13.939169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.010090+0000","last_change":"2024-05-30T06:59:07.014122+0000","last_active":"2024-05-30T06:59:08.010090+0000","last_peered":"2024-05-30T06:59:08.010090+0000","last_clean":"2024-05-30T06:59:08.010090+0000","last_became_active":"2024-05-30T06:59:07.013813+0000","last_became_peered":"2024-05-30T06:59:07.013813+0000","last_unstale":"2024-05-30T06:59:08.010090+0000","last_undegraded":"2024-05-30T06:59:08.010090+0000","last_fullsized":"2024-05-30T06:59:08.010090+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:50.599472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.042318+0000","last_change":"2024-05-30T06:59:08.039459+0000","last_active":"2024-05-30T06:59:08.042318+0000","last_peered":"2024-05-30T06:59:08.042318+0000","last_clean":"2024-05-30T06:59:08.042318+0000","last_became_active":"2024-05-30T06:59:08.039187+0000","last_became_peered":"2024-05-30T06:59:08.039187+0000","last_unstale":"2024-05-30T06:59:08.042318+0000","last_undegraded":"2024-05-30T06:59:08.042318+0000","last_fullsized":"2024-05-30T06:59:08.042318+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:18:16.991239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"127'3","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.034187+0000","last_change":"2024-05-30T06:59:07.023207+0000","last_active":"2024-05-30T06:59:08.034187+0000","last_peered":"2024-05-30T06:59:08.034187+0000","last_clean":"2024-05-30T06:59:08.034187+0000","last_became_active":"2024-05-30T06:59:07.022910+0000","last_became_peered":"2024-05-30T06:59:07.022910+0000","last_unstale":"2024-05-30T06:59:08.034187+0000","last_undegraded":"2024-05-30T06:59:08.034187+0000","last_fullsized":"2024-05-30T06:59:08.034187+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:02:20.542236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.042357+0000","last_change":"2024-05-30T06:59:08.039689+0000","last_active":"2024-05-30T06:59:08.042357+0000","last_peered":"2024-05-30T06:59:08.042357+0000","last_clean":"2024-05-30T06:59:08.042357+0000","last_became_active":"2024-05-30T06:59:08.039393+0000","last_became_peered":"2024-05-30T06:59:08.039393+0000","last_unstale":"2024-05-30T06:59:08.042357+0000","last_undegraded":"2024-05-30T06:59:08.042357+0000","last_fullsized":"2024-05-30T06:59:08.042357+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:01:57.819719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"127'6","reported_seq":18,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045260+0000","last_change":"2024-05-30T06:59:07.014432+0000","last_active":"2024-05-30T06:59:08.045260+0000","last_peered":"2024-05-30T06:59:08.045260+0000","last_clean":"2024-05-30T06:59:08.045260+0000","last_became_active":"2024-05-30T06:59:07.014000+0000","last_became_peered":"2024-05-30T06:59:07.014000+0000","last_unstale":"2024-05-30T06:59:08.045260+0000","last_undegraded":"2024-05-30T06:59:08.045260+0000","last_fullsized":"2024-05-30T06:59:08.045260+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:10:36.275003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.027272+0000","last_change":"2024-05-30T06:59:08.022261+0000","last_active":"2024-05-30T06:59:08.027272+0000","last_peered":"2024-05-30T06:59:08.027272+0000","last_clean":"2024-05-30T06:59:08.027272+0000","last_became_active":"2024-05-30T06:59:08.022009+0000","last_became_peered":"2024-05-30T06:59:08.022009+0000","last_unstale":"2024-05-30T06:59:08.027272+0000","last_undegraded":"2024-05-30T06:59:08.027272+0000","last_fullsized":"2024-05-30T06:59:08.027272+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:43:35.958337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.008421+0000","last_change":"2024-05-30T06:59:07.013707+0000","last_active":"2024-05-30T06:59:08.008421+0000","last_peered":"2024-05-30T06:59:08.008421+0000","last_clean":"2024-05-30T06:59:08.008421+0000","last_became_active":"2024-05-30T06:59:07.013181+0000","last_became_peered":"2024-05-30T06:59:07.013181+0000","last_unstale":"2024-05-30T06:59:08.008421+0000","last_undegraded":"2024-05-30T06:59:08.008421+0000","last_fullsized":"2024-05-30T06:59:08.008421+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:47:22.693305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.031344+0000","last_change":"2024-05-30T06:59:08.030108+0000","last_active":"2024-05-30T06:59:08.031344+0000","last_peered":"2024-05-30T06:59:08.031344+0000","last_clean":"2024-05-30T06:59:08.031344+0000","last_became_active":"2024-05-30T06:59:08.029134+0000","last_became_peered":"2024-05-30T06:59:08.029134+0000","last_unstale":"2024-05-30T06:59:08.031344+0000","last_undegraded":"2024-05-30T06:59:08.031344+0000","last_fullsized":"2024-05-30T06:59:08.031344+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:15:02.554710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.003598+0000","last_change":"2024-05-30T06:59:07.022390+0000","last_active":"2024-05-30T06:59:08.003598+0000","last_peered":"2024-05-30T06:59:08.003598+0000","last_clean":"2024-05-30T06:59:08.003598+0000","last_became_active":"2024-05-30T06:59:07.022101+0000","last_became_peered":"2024-05-30T06:59:07.022101+0000","last_unstale":"2024-05-30T06:59:08.003598+0000","last_undegraded":"2024-05-30T06:59:08.003598+0000","last_fullsized":"2024-05-30T06:59:08.003598+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:18.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045706+0000","last_change":"2024-05-30T06:59:08.044660+0000","last_active":"2024-05-30T06:59:08.045706+0000","last_peered":"2024-05-30T06:59:08.045706+0000","last_clean":"2024-05-30T06:59:08.045706+0000","last_became_active":"2024-05-30T06:59:08.044058+0000","last_became_peered":"2024-05-30T06:59:08.044058+0000","last_unstale":"2024-05-30T06:59:08.045706+0000","last_undegraded":"2024-05-30T06:59:08.045706+0000","last_fullsized":"2024-05-30T06:59:08.045706+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:55:03.939782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"127'8","reported_seq":20,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.037051+0000","last_change":"2024-05-30T06:59:07.015902+0000","last_active":"2024-05-30T06:59:08.037051+0000","last_peered":"2024-05-30T06:59:08.037051+0000","last_clean":"2024-05-30T06:59:08.037051+0000","last_became_active":"2024-05-30T06:59:07.015593+0000","last_became_peered":"2024-05-30T06:59:07.015593+0000","last_unstale":"2024-05-30T06:59:08.037051+0000","last_undegraded":"2024-05-30T06:59:08.037051+0000","last_fullsized":"2024-05-30T06:59:08.037051+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:14:30.382452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.042079+0000","last_change":"2024-05-30T06:59:08.036882+0000","last_active":"2024-05-30T06:59:08.042079+0000","last_peered":"2024-05-30T06:59:08.042079+0000","last_clean":"2024-05-30T06:59:08.042079+0000","last_became_active":"2024-05-30T06:59:08.036615+0000","last_became_peered":"2024-05-30T06:59:08.036615+0000","last_unstale":"2024-05-30T06:59:08.042079+0000","last_undegraded":"2024-05-30T06:59:08.042079+0000","last_fullsized":"2024-05-30T06:59:08.042079+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:50.944964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"127'1","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.023372+0000","last_change":"2024-05-30T06:59:07.019419+0000","last_active":"2024-05-30T06:59:08.023372+0000","last_peered":"2024-05-30T06:59:08.023372+0000","last_clean":"2024-05-30T06:59:08.023372+0000","last_became_active":"2024-05-30T06:59:07.019026+0000","last_became_peered":"2024-05-30T06:59:07.019026+0000","last_unstale":"2024-05-30T06:59:08.023372+0000","last_undegraded":"2024-05-30T06:59:08.023372+0000","last_fullsized":"2024-05-30T06:59:08.023372+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:42:17.679592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045607+0000","last_change":"2024-05-30T06:59:08.041567+0000","last_active":"2024-05-30T06:59:08.045607+0000","last_peered":"2024-05-30T06:59:08.045607+0000","last_clean":"2024-05-30T06:59:08.045607+0000","last_became_active":"2024-05-30T06:59:08.039259+0000","last_became_peered":"2024-05-30T06:59:08.039259+0000","last_unstale":"2024-05-30T06:59:08.045607+0000","last_undegraded":"2024-05-30T06:59:08.045607+0000","last_fullsized":"2024-05-30T06:59:08.045607+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:50:42.911168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"127'2","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.030478+0000","last_change":"2024-05-30T06:59:07.020027+0000","last_active":"2024-05-30T06:59:08.030478+0000","last_peered":"2024-05-30T06:59:08.030478+0000","last_clean":"2024-05-30T06:59:08.030478+0000","last_became_active":"2024-05-30T06:59:07.019702+0000","last_became_peered":"2024-05-30T06:59:07.019702+0000","last_unstale":"2024-05-30T06:59:08.030478+0000","last_undegraded":"2024-05-30T06:59:08.030478+0000","last_fullsized":"2024-05-30T06:59:08.030478+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:49:45.444316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.031653+0000","last_change":"2024-05-30T06:59:08.026623+0000","last_active":"2024-05-30T06:59:08.031653+0000","last_peered":"2024-05-30T06:59:08.031653+0000","last_clean":"2024-05-30T06:59:08.031653+0000","last_became_active":"2024-05-30T06:59:08.026370+0000","last_became_peered":"2024-05-30T06:59:08.026370+0000","last_unstale":"2024-05-30T06:59:08.031653+0000","last_undegraded":"2024-05-30T06:59:08.031653+0000","last_fullsized":"2024-05-30T06:59:08.031653+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:22:01.142504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"127'1","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.031177+0000","last_change":"2024-05-30T06:59:07.018086+0000","last_active":"2024-05-30T06:59:08.031177+0000","last_peered":"2024-05-30T06:59:08.031177+0000","last_clean":"2024-05-30T06:59:08.031177+0000","last_became_active":"2024-05-30T06:59:07.017740+0000","last_became_peered":"2024-05-30T06:59:07.017740+0000","last_unstale":"2024-05-30T06:59:08.031177+0000","last_undegraded":"2024-05-30T06:59:08.031177+0000","last_fullsized":"2024-05-30T06:59:08.031177+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:16.444618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.018251+0000","last_change":"2024-05-30T06:59:08.015660+0000","last_active":"2024-05-30T06:59:08.018251+0000","last_peered":"2024-05-30T06:59:08.018251+0000","last_clean":"2024-05-30T06:59:08.018251+0000","last_became_active":"2024-05-30T06:59:08.015370+0000","last_became_peered":"2024-05-30T06:59:08.015370+0000","last_unstale":"2024-05-30T06:59:08.018251+0000","last_undegraded":"2024-05-30T06:59:08.018251+0000","last_fullsized":"2024-05-30T06:59:08.018251+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:59:23.939287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.015013+0000","last_change":"2024-05-30T06:59:07.024249+0000","last_active":"2024-05-30T06:59:08.015013+0000","last_peered":"2024-05-30T06:59:08.015013+0000","last_clean":"2024-05-30T06:59:08.015013+0000","last_became_active":"2024-05-30T06:59:07.023895+0000","last_became_peered":"2024-05-30T06:59:07.023895+0000","last_unstale":"2024-05-30T06:59:08.015013+0000","last_undegraded":"2024-05-30T06:59:08.015013+0000","last_fullsized":"2024-05-30T06:59:08.015013+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:16:51.738852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.031780+0000","last_change":"2024-05-30T06:59:08.029322+0000","last_active":"2024-05-30T06:59:08.031780+0000","last_peered":"2024-05-30T06:59:08.031780+0000","last_clean":"2024-05-30T06:59:08.031780+0000","last_became_active":"2024-05-30T06:59:08.028959+0000","last_became_peered":"2024-05-30T06:59:08.028959+0000","last_unstale":"2024-05-30T06:59:08.031780+0000","last_undegraded":"2024-05-30T06:59:08.031780+0000","last_fullsized":"2024-05-30T06:59:08.031780+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:00:11.894375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"127'2","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.037269+0000","last_change":"2024-05-30T06:59:07.019458+0000","last_active":"2024-05-30T06:59:08.037269+0000","last_peered":"2024-05-30T06:59:08.037269+0000","last_clean":"2024-05-30T06:59:08.037269+0000","last_became_active":"2024-05-30T06:59:07.019186+0000","last_became_peered":"2024-05-30T06:59:07.019186+0000","last_unstale":"2024-05-30T06:59:08.037269+0000","last_undegraded":"2024-05-30T06:59:08.037269+0000","last_fullsized":"2024-05-30T06:59:08.037269+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:53.047887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.037715+0000","last_change":"2024-05-30T06:59:08.035291+0000","last_active":"2024-05-30T06:59:08.037715+0000","last_peered":"2024-05-30T06:59:08.037715+0000","last_clean":"2024-05-30T06:59:08.037715+0000","last_became_active":"2024-05-30T06:59:08.034951+0000","last_became_peered":"2024-05-30T06:59:08.034951+0000","last_unstale":"2024-05-30T06:59:08.037715+0000","last_undegraded":"2024-05-30T06:59:08.037715+0000","last_fullsized":"2024-05-30T06:59:08.037715+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:45:27.954419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.010807+0000","last_change":"2024-05-30T06:59:07.016536+0000","last_active":"2024-05-30T06:59:08.010807+0000","last_peered":"2024-05-30T06:59:08.010807+0000","last_clean":"2024-05-30T06:59:08.010807+0000","last_became_active":"2024-05-30T06:59:07.016202+0000","last_became_peered":"2024-05-30T06:59:07.016202+0000","last_unstale":"2024-05-30T06:59:08.010807+0000","last_undegraded":"2024-05-30T06:59:08.010807+0000","last_fullsized":"2024-05-30T06:59:08.010807+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:47:15.001802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.025059+0000","last_change":"2024-05-30T06:59:08.022686+0000","last_active":"2024-05-30T06:59:08.025059+0000","last_peered":"2024-05-30T06:59:08.025059+0000","last_clean":"2024-05-30T06:59:08.025059+0000","last_became_active":"2024-05-30T06:59:08.022436+0000","last_became_peered":"2024-05-30T06:59:08.022436+0000","last_unstale":"2024-05-30T06:59:08.025059+0000","last_undegraded":"2024-05-30T06:59:08.025059+0000","last_fullsized":"2024-05-30T06:59:08.025059+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:51:04.466523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.010122+0000","last_change":"2024-05-30T06:59:07.017333+0000","last_active":"2024-05-30T06:59:08.010122+0000","last_peered":"2024-05-30T06:59:08.010122+0000","last_clean":"2024-05-30T06:59:08.010122+0000","last_became_active":"2024-05-30T06:59:07.017037+0000","last_became_peered":"2024-05-30T06:59:07.017037+0000","last_unstale":"2024-05-30T06:59:08.010122+0000","last_undegraded":"2024-05-30T06:59:08.010122+0000","last_fullsized":"2024-05-30T06:59:08.010122+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:18:59.328569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.042523+0000","last_change":"2024-05-30T06:59:08.038802+0000","last_active":"2024-05-30T06:59:08.042523+0000","last_peered":"2024-05-30T06:59:08.042523+0000","last_clean":"2024-05-30T06:59:08.042523+0000","last_became_active":"2024-05-30T06:59:08.038486+0000","last_became_peered":"2024-05-30T06:59:08.038486+0000","last_unstale":"2024-05-30T06:59:08.042523+0000","last_undegraded":"2024-05-30T06:59:08.042523+0000","last_fullsized":"2024-05-30T06:59:08.042523+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:52:22.042222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.014658+0000","last_change":"2024-05-30T06:59:07.018462+0000","last_active":"2024-05-30T06:59:08.014658+0000","last_peered":"2024-05-30T06:59:08.014658+0000","last_clean":"2024-05-30T06:59:08.014658+0000","last_became_active":"2024-05-30T06:59:07.017946+0000","last_became_peered":"2024-05-30T06:59:07.017946+0000","last_unstale":"2024-05-30T06:59:08.014658+0000","last_undegraded":"2024-05-30T06:59:08.014658+0000","last_fullsized":"2024-05-30T06:59:08.014658+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:18:15.985022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.029906+0000","last_change":"2024-05-30T06:59:08.025933+0000","last_active":"2024-05-30T06:59:08.029906+0000","last_peered":"2024-05-30T06:59:08.029906+0000","last_clean":"2024-05-30T06:59:08.029906+0000","last_became_active":"2024-05-30T06:59:08.025557+0000","last_became_peered":"2024-05-30T06:59:08.025557+0000","last_unstale":"2024-05-30T06:59:08.029906+0000","last_undegraded":"2024-05-30T06:59:08.029906+0000","last_fullsized":"2024-05-30T06:59:08.029906+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:13:00.482109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"127'2","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.040360+0000","last_change":"2024-05-30T06:59:07.020218+0000","last_active":"2024-05-30T06:59:08.040360+0000","last_peered":"2024-05-30T06:59:08.040360+0000","last_clean":"2024-05-30T06:59:08.040360+0000","last_became_active":"2024-05-30T06:59:07.018769+0000","last_became_peered":"2024-05-30T06:59:07.018769+0000","last_unstale":"2024-05-30T06:59:08.040360+0000","last_undegraded":"2024-05-30T06:59:08.040360+0000","last_fullsized":"2024-05-30T06:59:08.040360+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:06.907108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.033725+0000","last_change":"2024-05-30T06:59:08.032992+0000","last_active":"2024-05-30T06:59:08.033725+0000","last_peered":"2024-05-30T06:59:08.033725+0000","last_clean":"2024-05-30T06:59:08.033725+0000","last_became_active":"2024-05-30T06:59:08.032647+0000","last_became_peered":"2024-05-30T06:59:08.032647+0000","last_unstale":"2024-05-30T06:59:08.033725+0000","last_undegraded":"2024-05-30T06:59:08.033725+0000","last_fullsized":"2024-05-30T06:59:08.033725+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:59.220337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.027323+0000","last_change":"2024-05-30T06:59:07.021143+0000","last_active":"2024-05-30T06:59:08.027323+0000","last_peered":"2024-05-30T06:59:08.027323+0000","last_clean":"2024-05-30T06:59:08.027323+0000","last_became_active":"2024-05-30T06:59:07.020771+0000","last_became_peered":"2024-05-30T06:59:07.020771+0000","last_unstale":"2024-05-30T06:59:08.027323+0000","last_undegraded":"2024-05-30T06:59:08.027323+0000","last_fullsized":"2024-05-30T06:59:08.027323+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:42.840485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.039971+0000","last_change":"2024-05-30T06:59:08.038746+0000","last_active":"2024-05-30T06:59:08.039971+0000","last_peered":"2024-05-30T06:59:08.039971+0000","last_clean":"2024-05-30T06:59:08.039971+0000","last_became_active":"2024-05-30T06:59:08.038465+0000","last_became_peered":"2024-05-30T06:59:08.038465+0000","last_unstale":"2024-05-30T06:59:08.039971+0000","last_undegraded":"2024-05-30T06:59:08.039971+0000","last_fullsized":"2024-05-30T06:59:08.039971+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:02:21.548452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.003166+0000","last_change":"2024-05-30T06:59:07.019355+0000","last_active":"2024-05-30T06:59:08.003166+0000","last_peered":"2024-05-30T06:59:08.003166+0000","last_clean":"2024-05-30T06:59:08.003166+0000","last_became_active":"2024-05-30T06:59:07.019061+0000","last_became_peered":"2024-05-30T06:59:07.019061+0000","last_unstale":"2024-05-30T06:59:08.003166+0000","last_undegraded":"2024-05-30T06:59:08.003166+0000","last_fullsized":"2024-05-30T06:59:08.003166+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:57:26.978817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.038059+0000","last_change":"2024-05-30T06:59:08.032170+0000","last_active":"2024-05-30T06:59:08.038059+0000","last_peered":"2024-05-30T06:59:08.038059+0000","last_clean":"2024-05-30T06:59:08.038059+0000","last_became_active":"2024-05-30T06:59:08.030918+0000","last_became_peered":"2024-05-30T06:59:08.030918+0000","last_unstale":"2024-05-30T06:59:08.038059+0000","last_undegraded":"2024-05-30T06:59:08.038059+0000","last_fullsized":"2024-05-30T06:59:08.038059+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:19.437357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.015407+0000","last_change":"2024-05-30T06:59:07.020348+0000","last_active":"2024-05-30T06:59:08.015407+0000","last_peered":"2024-05-30T06:59:08.015407+0000","last_clean":"2024-05-30T06:59:08.015407+0000","last_became_active":"2024-05-30T06:59:07.019991+0000","last_became_peered":"2024-05-30T06:59:07.019991+0000","last_unstale":"2024-05-30T06:59:08.015407+0000","last_undegraded":"2024-05-30T06:59:08.015407+0000","last_fullsized":"2024-05-30T06:59:08.015407+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:07:32.982335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.041063+0000","last_change":"2024-05-30T06:59:08.038690+0000","last_active":"2024-05-30T06:59:08.041063+0000","last_peered":"2024-05-30T06:59:08.041063+0000","last_clean":"2024-05-30T06:59:08.041063+0000","last_became_active":"2024-05-30T06:59:08.038380+0000","last_became_peered":"2024-05-30T06:59:08.038380+0000","last_unstale":"2024-05-30T06:59:08.041063+0000","last_undegraded":"2024-05-30T06:59:08.041063+0000","last_fullsized":"2024-05-30T06:59:08.041063+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:49:32.634774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.003485+0000","last_change":"2024-05-30T06:59:07.023295+0000","last_active":"2024-05-30T06:59:08.003485+0000","last_peered":"2024-05-30T06:59:08.003485+0000","last_clean":"2024-05-30T06:59:08.003485+0000","last_became_active":"2024-05-30T06:59:07.022933+0000","last_became_peered":"2024-05-30T06:59:07.022933+0000","last_unstale":"2024-05-30T06:59:08.003485+0000","last_undegraded":"2024-05-30T06:59:08.003485+0000","last_fullsized":"2024-05-30T06:59:08.003485+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:07.641666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045348+0000","last_change":"2024-05-30T06:59:08.037751+0000","last_active":"2024-05-30T06:59:08.045348+0000","last_peered":"2024-05-30T06:59:08.045348+0000","last_clean":"2024-05-30T06:59:08.045348+0000","last_became_active":"2024-05-30T06:59:08.037505+0000","last_became_peered":"2024-05-30T06:59:08.037505+0000","last_unstale":"2024-05-30T06:59:08.045348+0000","last_undegraded":"2024-05-30T06:59:08.045348+0000","last_fullsized":"2024-05-30T06:59:08.045348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:10:59.558212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.022919+0000","last_change":"2024-05-30T06:59:07.025942+0000","last_active":"2024-05-30T06:59:08.022919+0000","last_peered":"2024-05-30T06:59:08.022919+0000","last_clean":"2024-05-30T06:59:08.022919+0000","last_became_active":"2024-05-30T06:59:07.025651+0000","last_became_peered":"2024-05-30T06:59:07.025651+0000","last_unstale":"2024-05-30T06:59:08.022919+0000","last_undegraded":"2024-05-30T06:59:08.022919+0000","last_fullsized":"2024-05-30T06:59:08.022919+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:21:41.065697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.028598+0000","last_change":"2024-05-30T06:59:08.023176+0000","last_active":"2024-05-30T06:59:08.028598+0000","last_peered":"2024-05-30T06:59:08.028598+0000","last_clean":"2024-05-30T06:59:08.028598+0000","last_became_active":"2024-05-30T06:59:08.022036+0000","last_became_peered":"2024-05-30T06:59:08.022036+0000","last_unstale":"2024-05-30T06:59:08.028598+0000","last_undegraded":"2024-05-30T06:59:08.028598+0000","last_fullsized":"2024-05-30T06:59:08.028598+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:21:42.071914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.009997+0000","last_change":"2024-05-30T06:59:07.012244+0000","last_active":"2024-05-30T06:59:08.009997+0000","last_peered":"2024-05-30T06:59:08.009997+0000","last_clean":"2024-05-30T06:59:08.009997+0000","last_became_active":"2024-05-30T06:59:07.011981+0000","last_became_peered":"2024-05-30T06:59:07.011981+0000","last_unstale":"2024-05-30T06:59:08.009997+0000","last_undegraded":"2024-05-30T06:59:08.009997+0000","last_fullsized":"2024-05-30T06:59:08.009997+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:45:53.245785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.037082+0000","last_change":"2024-05-30T06:59:08.036367+0000","last_active":"2024-05-30T06:59:08.037082+0000","last_peered":"2024-05-30T06:59:08.037082+0000","last_clean":"2024-05-30T06:59:08.037082+0000","last_became_active":"2024-05-30T06:59:08.035993+0000","last_became_peered":"2024-05-30T06:59:08.035993+0000","last_unstale":"2024-05-30T06:59:08.037082+0000","last_undegraded":"2024-05-30T06:59:08.037082+0000","last_fullsized":"2024-05-30T06:59:08.037082+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:12:45.810350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.019254+0000","last_change":"2024-05-30T06:59:07.018219+0000","last_active":"2024-05-30T06:59:08.019254+0000","last_peered":"2024-05-30T06:59:08.019254+0000","last_clean":"2024-05-30T06:59:08.019254+0000","last_became_active":"2024-05-30T06:59:07.017622+0000","last_became_peered":"2024-05-30T06:59:07.017622+0000","last_unstale":"2024-05-30T06:59:08.019254+0000","last_undegraded":"2024-05-30T06:59:08.019254+0000","last_fullsized":"2024-05-30T06:59:08.019254+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:14.903621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.041042+0000","last_change":"2024-05-30T06:59:08.034173+0000","last_active":"2024-05-30T06:59:08.041042+0000","last_peered":"2024-05-30T06:59:08.041042+0000","last_clean":"2024-05-30T06:59:08.041042+0000","last_became_active":"2024-05-30T06:59:08.033874+0000","last_became_peered":"2024-05-30T06:59:08.033874+0000","last_unstale":"2024-05-30T06:59:08.041042+0000","last_undegraded":"2024-05-30T06:59:08.041042+0000","last_fullsized":"2024-05-30T06:59:08.041042+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:22:01.142504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"127'2","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.038651+0000","last_change":"2024-05-30T06:59:07.027441+0000","last_active":"2024-05-30T06:59:08.038651+0000","last_peered":"2024-05-30T06:59:08.038651+0000","last_clean":"2024-05-30T06:59:08.038651+0000","last_became_active":"2024-05-30T06:59:07.027219+0000","last_became_peered":"2024-05-30T06:59:07.027219+0000","last_unstale":"2024-05-30T06:59:08.038651+0000","last_undegraded":"2024-05-30T06:59:08.038651+0000","last_fullsized":"2024-05-30T06:59:08.038651+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:58.881839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":374,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.021389+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:59:08.021389+0000","last_peered":"2024-05-30T06:59:08.021389+0000","last_clean":"2024-05-30T06:59:08.021389+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:59:08.021389+0000","last_undegraded":"2024-05-30T06:59:08.021389+0000","last_fullsized":"2024-05-30T06:59:08.021389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575057,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127668,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244172,"statfs":{"total":96636764160,"available":96506032128,"internally_reserved":0,"allocated":2203648,"data_stored":1289246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575058,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131244,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240596,"statfs":{"total":96636764160,"available":96502370304,"internally_reserved":0,"allocated":1597440,"data_stored":698240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575058,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64616,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94307224,"statfs":{"total":96636764160,"available":96570597376,"internally_reserved":0,"allocated":1593344,"data_stored":696740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145120,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226720,"statfs":{"total":96636764160,"available":96488161280,"internally_reserved":0,"allocated":1589248,"data_stored":696698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575057,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149284,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94222556,"statfs":{"total":96636764160,"available":96483897344,"internally_reserved":0,"allocated":1593344,"data_stored":696788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":151255495},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575056,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145104,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226736,"statfs":{"total":96636764160,"available":96488177664,"internally_reserved":0,"allocated":1572864,"data_stored":689769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575058,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145120,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226720,"statfs":{"total":96636764160,"available":96488161280,"internally_reserved":0,"allocated":1585152,"data_stored":696628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575058,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105436,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94266404,"statfs":{"total":96636764160,"available":96528797696,"internally_reserved":0,"allocated":2179072,"data_stored":1286996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:59:12.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T06:59:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.334+0000 7f088ea00640 1 Processor -- start 2024-05-30T06:59:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.334+0000 7f088ea00640 1 -- start start 2024-05-30T06:59:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.338+0000 7f088ea00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f08880b2ec0 0x7f08880b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.338+0000 7f088ea00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088815c8f0 con 0x7f0888155e60 2024-05-30T06:59:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.338+0000 7f088ea00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08880ccc80 con 0x7f088806f9a0 2024-05-30T06:59:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.338+0000 7f088ea00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f08880ccff0 con 0x7f08880b2ec0 2024-05-30T06:59:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.338+0000 7f0887e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0888155e60 0x7f08880cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48070/0 (socket says 172.21.15.37:48070) 2024-05-30T06:59:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.338+0000 7f0887e00640 1 -- 172.21.15.37:0/439607755 learned_addr learned my addr 172.21.15.37:0/439607755 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.338+0000 7f088ca00640 1 --2- 172.21.15.37:0/439607755 >> v2:172.21.15.105:3300/0 conn(0x7f08880b2ec0 0x7f08880b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.338+0000 7f0887400640 1 -- 172.21.15.37:0/439607755 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794064314 0 0) 0x7f088815c8f0 con 0x7f0888155e60 2024-05-30T06:59:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.338+0000 7f0887400640 1 -- 172.21.15.37:0/439607755 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f086c003530 con 0x7f0888155e60 2024-05-30T06:59:12.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.338+0000 7f088ca00640 1 -- 172.21.15.37:0/439607755 >> v1:172.21.15.105:6789/0 conn(0x7f088806f9a0 legacy=0x7f08880cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.338+0000 7f0887400640 1 -- 172.21.15.37:0/439607755 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2105838989 0 0) 0x7f086c003530 con 0x7f0888155e60 2024-05-30T06:59:12.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.338+0000 7f088ca00640 1 -- 172.21.15.37:0/439607755 >> v1:172.21.15.37:6789/0 conn(0x7f0888155e60 legacy=0x7f08880cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.338+0000 7f088ca00640 1 -- 172.21.15.37:0/439607755 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088815cbd0 con 0x7f08880b2ec0 2024-05-30T06:59:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.342+0000 7f088ca00640 1 --2- 172.21.15.37:0/439607755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08880b2ec0 0x7f08880b36a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f08800097c0 tx=0x7f088001c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf29d0a6a7de968d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.342+0000 7f0887400640 1 -- 172.21.15.37:0/439607755 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08800b0070 con 0x7f08880b2ec0 2024-05-30T06:59:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.342+0000 7f0887400640 1 -- 172.21.15.37:0/439607755 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08800ab400 con 0x7f08880b2ec0 2024-05-30T06:59:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.342+0000 7f0887400640 1 -- 172.21.15.37:0/439607755 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878001680 con 0x7f08880b2ec0 2024-05-30T06:59:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.342+0000 7f088ea00640 1 -- 172.21.15.37:0/439607755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08880b2ec0 msgr2=0x7f08880b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.342+0000 7f088ea00640 1 --2- 172.21.15.37:0/439607755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08880b2ec0 0x7f08880b36a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f08800097c0 tx=0x7f088001c270 comp rx=0 tx=0).stop 2024-05-30T06:59:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.342+0000 7f088ea00640 1 -- 172.21.15.37:0/439607755 shutdown_connections 2024-05-30T06:59:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.342+0000 7f088ea00640 1 --2- 172.21.15.37:0/439607755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08880b2ec0 0x7f08880b36a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.342+0000 7f088ea00640 1 -- 172.21.15.37:0/439607755 >> 172.21.15.37:0/439607755 conn(0x7f08880b23a0 msgr2=0x7f08880b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.342+0000 7f088ea00640 1 -- 172.21.15.37:0/439607755 shutdown_connections 2024-05-30T06:59:12.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.342+0000 7f088ea00640 1 -- 172.21.15.37:0/439607755 wait complete. 2024-05-30T06:59:12.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.342+0000 7f088ea00640 1 Processor -- start 2024-05-30T06:59:12.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.342+0000 7f088ea00640 1 -- start start 2024-05-30T06:59:12.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ea00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f088806f9a0 0x7f088814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:12.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ea00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08880b2ec0 0x7f08881547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:12.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888155e60 0x7f0888158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:12.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f088806ea10 con 0x7f0888155e60 2024-05-30T06:59:12.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ea00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f088806e890 con 0x7f088806f9a0 2024-05-30T06:59:12.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ea00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f088806eb90 con 0x7f08880b2ec0 2024-05-30T06:59:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888155e60 0x7f0888158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888155e60 0x7f0888158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48292/0 (socket says 172.21.15.37:48292) 2024-05-30T06:59:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ca00640 1 -- 172.21.15.37:0/1241639872 learned_addr learned my addr 172.21.15.37:0/1241639872 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f0887e00640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f088806f9a0 0x7f088814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f087f400640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08880b2ec0 0x7f08881547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ca00640 1 -- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08880b2ec0 msgr2=0x7f08881547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ca00640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08880b2ec0 0x7f08881547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ca00640 1 -- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f088806f9a0 msgr2=0x7f088814f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ca00640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f088806f9a0 0x7f088814f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ca00640 1 -- 172.21.15.37:0/1241639872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08881527a0 con 0x7f0888155e60 2024-05-30T06:59:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ca00640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888155e60 0x7f0888158410 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f08800ae040 tx=0x7f088001aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f0884c00640 1 -- 172.21.15.37:0/1241639872 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08800bb020 con 0x7f0888155e60 2024-05-30T06:59:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f0884c00640 1 -- 172.21.15.37:0/1241639872 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08800b1040 con 0x7f0888155e60 2024-05-30T06:59:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ea00640 1 -- 172.21.15.37:0/1241639872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0888152a80 con 0x7f0888155e60 2024-05-30T06:59:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f0884c00640 1 -- 172.21.15.37:0/1241639872 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08800b0050 con 0x7f0888155e60 2024-05-30T06:59:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ea00640 1 -- 172.21.15.37:0/1241639872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0888153040 con 0x7f0888155e60 2024-05-30T06:59:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.346+0000 7f088ea00640 1 -- 172.21.15.37:0/1241639872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0888068b20 con 0x7f0888155e60 2024-05-30T06:59:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.350+0000 7f0884c00640 1 -- 172.21.15.37:0/1241639872 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f08800be070 con 0x7f0888155e60 2024-05-30T06:59:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.350+0000 7f0884c00640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f086406a030 0x7f086406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.350+0000 7f0884c00640 1 -- 172.21.15.37:0/1241639872 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7f088011f060 con 0x7f0888155e60 2024-05-30T06:59:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.350+0000 7f0887e00640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f086406a030 0x7f086406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.350+0000 7f0887e00640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f086406a030 0x7f086406c4f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f0878001ec0 tx=0x7f0878001d90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:12.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.354+0000 7f0884c00640 1 -- 172.21.15.37:0/1241639872 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0880015fb0 con 0x7f0888155e60 2024-05-30T06:59:12.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.514+0000 7f088ea00640 1 -- 172.21.15.37:0/1241639872 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08881f36e0 con 0x7f086406a030 2024-05-30T06:59:12.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.522+0000 7f0884c00640 1 -- 172.21.15.37:0/1241639872 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252437 (secure 0 0 0) 0x7f087800f820 con 0x7f086406a030 2024-05-30T06:59:12.527 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:12.528 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T06:59:12.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.526+0000 7f088ea00640 1 -- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f086406a030 msgr2=0x7f086406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.526+0000 7f088ea00640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f086406a030 0x7f086406c4f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f0878001ec0 tx=0x7f0878001d90 comp rx=0 tx=0).stop 2024-05-30T06:59:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.526+0000 7f088ea00640 1 -- 172.21.15.37:0/1241639872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888155e60 msgr2=0x7f0888158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.526+0000 7f088ea00640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888155e60 0x7f0888158410 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f08800ae040 tx=0x7f088001aab0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.526+0000 7f088ea00640 1 -- 172.21.15.37:0/1241639872 shutdown_connections 2024-05-30T06:59:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.526+0000 7f088ea00640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0888155e60 0x7f0888158410 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.526+0000 7f088ea00640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08880b2ec0 0x7f08881547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.526+0000 7f088ea00640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f086406a030 0x7f086406c4f0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.526+0000 7f088ea00640 1 --2- 172.21.15.37:0/1241639872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f088806f9a0 0x7f088814f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.526+0000 7f088ea00640 1 -- 172.21.15.37:0/1241639872 >> 172.21.15.37:0/1241639872 conn(0x7f08880b23a0 msgr2=0x7f088815bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.526+0000 7f088ea00640 1 -- 172.21.15.37:0/1241639872 shutdown_connections 2024-05-30T06:59:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.526+0000 7f088ea00640 1 -- 172.21.15.37:0/1241639872 wait complete. 2024-05-30T06:59:12.547 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":637,"stamp":"2024-05-30T06:59:11.001445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1013592,"kb_used_data":13588,"kb_used_omap":12,"kb_used_meta":999859,"kb_avail":753961128,"statfs":{"total":773094113280,"available":772056195072,"internally_reserved":0,"allocated":13914112,"data_stored":6751105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1023856176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.011152"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.028609+0000","last_change":"2024-05-30T06:59:08.024160+0000","last_active":"2024-05-30T06:59:08.028609+0000","last_peered":"2024-05-30T06:59:08.028609+0000","last_clean":"2024-05-30T06:59:08.028609+0000","last_became_active":"2024-05-30T06:59:08.023564+0000","last_became_peered":"2024-05-30T06:59:08.023564+0000","last_unstale":"2024-05-30T06:59:08.028609+0000","last_undegraded":"2024-05-30T06:59:08.028609+0000","last_fullsized":"2024-05-30T06:59:08.028609+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:31:48.902149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.018818+0000","last_change":"2024-05-30T06:59:08.017254+0000","last_active":"2024-05-30T06:59:08.018818+0000","last_peered":"2024-05-30T06:59:08.018818+0000","last_clean":"2024-05-30T06:59:08.018818+0000","last_became_active":"2024-05-30T06:59:08.016947+0000","last_became_peered":"2024-05-30T06:59:08.016947+0000","last_unstale":"2024-05-30T06:59:08.018818+0000","last_undegraded":"2024-05-30T06:59:08.018818+0000","last_fullsized":"2024-05-30T06:59:08.018818+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:55:11.815763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.032976+0000","last_change":"2024-05-30T06:59:08.031486+0000","last_active":"2024-05-30T06:59:08.032976+0000","last_peered":"2024-05-30T06:59:08.032976+0000","last_clean":"2024-05-30T06:59:08.032976+0000","last_became_active":"2024-05-30T06:59:08.030677+0000","last_became_peered":"2024-05-30T06:59:08.030677+0000","last_unstale":"2024-05-30T06:59:08.032976+0000","last_undegraded":"2024-05-30T06:59:08.032976+0000","last_fullsized":"2024-05-30T06:59:08.032976+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:45:20.303693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.039662+0000","last_change":"2024-05-30T06:59:08.038710+0000","last_active":"2024-05-30T06:59:08.039662+0000","last_peered":"2024-05-30T06:59:08.039662+0000","last_clean":"2024-05-30T06:59:08.039662+0000","last_became_active":"2024-05-30T06:59:08.038437+0000","last_became_peered":"2024-05-30T06:59:08.038437+0000","last_unstale":"2024-05-30T06:59:08.039662+0000","last_undegraded":"2024-05-30T06:59:08.039662+0000","last_fullsized":"2024-05-30T06:59:08.039662+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:57:27.985034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.047007+0000","last_change":"2024-05-30T06:59:08.046184+0000","last_active":"2024-05-30T06:59:08.047007+0000","last_peered":"2024-05-30T06:59:08.047007+0000","last_clean":"2024-05-30T06:59:08.047007+0000","last_became_active":"2024-05-30T06:59:08.045942+0000","last_became_peered":"2024-05-30T06:59:08.045942+0000","last_unstale":"2024-05-30T06:59:08.047007+0000","last_undegraded":"2024-05-30T06:59:08.047007+0000","last_fullsized":"2024-05-30T06:59:08.047007+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:15.909838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.032839+0000","last_change":"2024-05-30T06:59:08.029771+0000","last_active":"2024-05-30T06:59:08.032839+0000","last_peered":"2024-05-30T06:59:08.032839+0000","last_clean":"2024-05-30T06:59:08.032839+0000","last_became_active":"2024-05-30T06:59:08.029463+0000","last_became_peered":"2024-05-30T06:59:08.029463+0000","last_unstale":"2024-05-30T06:59:08.032839+0000","last_undegraded":"2024-05-30T06:59:08.032839+0000","last_fullsized":"2024-05-30T06:59:08.032839+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:07:33.590130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.037682+0000","last_change":"2024-05-30T06:59:08.035845+0000","last_active":"2024-05-30T06:59:08.037682+0000","last_peered":"2024-05-30T06:59:08.037682+0000","last_clean":"2024-05-30T06:59:08.037682+0000","last_became_active":"2024-05-30T06:59:08.035526+0000","last_became_peered":"2024-05-30T06:59:08.035526+0000","last_unstale":"2024-05-30T06:59:08.037682+0000","last_undegraded":"2024-05-30T06:59:08.037682+0000","last_fullsized":"2024-05-30T06:59:08.037682+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:45:54.252002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.037915+0000","last_change":"2024-05-30T06:59:08.035483+0000","last_active":"2024-05-30T06:59:08.037915+0000","last_peered":"2024-05-30T06:59:08.037915+0000","last_clean":"2024-05-30T06:59:08.037915+0000","last_became_active":"2024-05-30T06:59:08.034842+0000","last_became_peered":"2024-05-30T06:59:08.034842+0000","last_unstale":"2024-05-30T06:59:08.037915+0000","last_undegraded":"2024-05-30T06:59:08.037915+0000","last_fullsized":"2024-05-30T06:59:08.037915+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:33:33.050213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045628+0000","last_change":"2024-05-30T06:59:08.044693+0000","last_active":"2024-05-30T06:59:08.045628+0000","last_peered":"2024-05-30T06:59:08.045628+0000","last_clean":"2024-05-30T06:59:08.045628+0000","last_became_active":"2024-05-30T06:59:08.044276+0000","last_became_peered":"2024-05-30T06:59:08.044276+0000","last_unstale":"2024-05-30T06:59:08.045628+0000","last_undegraded":"2024-05-30T06:59:08.045628+0000","last_fullsized":"2024-05-30T06:59:08.045628+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:26:52.294346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.018293+0000","last_change":"2024-05-30T06:59:08.016455+0000","last_active":"2024-05-30T06:59:08.018293+0000","last_peered":"2024-05-30T06:59:08.018293+0000","last_clean":"2024-05-30T06:59:08.018293+0000","last_became_active":"2024-05-30T06:59:08.016161+0000","last_became_peered":"2024-05-30T06:59:08.016161+0000","last_unstale":"2024-05-30T06:59:08.018293+0000","last_undegraded":"2024-05-30T06:59:08.018293+0000","last_fullsized":"2024-05-30T06:59:08.018293+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:19:12.129168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.023791+0000","last_change":"2024-05-30T06:59:08.022034+0000","last_active":"2024-05-30T06:59:08.023791+0000","last_peered":"2024-05-30T06:59:08.023791+0000","last_clean":"2024-05-30T06:59:08.023791+0000","last_became_active":"2024-05-30T06:59:08.021772+0000","last_became_peered":"2024-05-30T06:59:08.021772+0000","last_unstale":"2024-05-30T06:59:08.023791+0000","last_undegraded":"2024-05-30T06:59:08.023791+0000","last_fullsized":"2024-05-30T06:59:08.023791+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:08:08.594337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045308+0000","last_change":"2024-05-30T06:59:08.044094+0000","last_active":"2024-05-30T06:59:08.045308+0000","last_peered":"2024-05-30T06:59:08.045308+0000","last_clean":"2024-05-30T06:59:08.045308+0000","last_became_active":"2024-05-30T06:59:08.043835+0000","last_became_peered":"2024-05-30T06:59:08.043835+0000","last_unstale":"2024-05-30T06:59:08.045308+0000","last_undegraded":"2024-05-30T06:59:08.045308+0000","last_fullsized":"2024-05-30T06:59:08.045308+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:34:54.814161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.027456+0000","last_change":"2024-05-30T06:59:08.025217+0000","last_active":"2024-05-30T06:59:08.027456+0000","last_peered":"2024-05-30T06:59:08.027456+0000","last_clean":"2024-05-30T06:59:08.027456+0000","last_became_active":"2024-05-30T06:59:08.024478+0000","last_became_peered":"2024-05-30T06:59:08.024478+0000","last_unstale":"2024-05-30T06:59:08.027456+0000","last_undegraded":"2024-05-30T06:59:08.027456+0000","last_fullsized":"2024-05-30T06:59:08.027456+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:20:59.046621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.024535+0000","last_change":"2024-05-30T06:59:08.022376+0000","last_active":"2024-05-30T06:59:08.024535+0000","last_peered":"2024-05-30T06:59:08.024535+0000","last_clean":"2024-05-30T06:59:08.024535+0000","last_became_active":"2024-05-30T06:59:08.022058+0000","last_became_peered":"2024-05-30T06:59:08.022058+0000","last_unstale":"2024-05-30T06:59:08.024535+0000","last_undegraded":"2024-05-30T06:59:08.024535+0000","last_fullsized":"2024-05-30T06:59:08.024535+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:20:20.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.030021+0000","last_change":"2024-05-30T06:59:08.027564+0000","last_active":"2024-05-30T06:59:08.030021+0000","last_peered":"2024-05-30T06:59:08.030021+0000","last_clean":"2024-05-30T06:59:08.030021+0000","last_became_active":"2024-05-30T06:59:08.027303+0000","last_became_peered":"2024-05-30T06:59:08.027303+0000","last_unstale":"2024-05-30T06:59:08.030021+0000","last_undegraded":"2024-05-30T06:59:08.030021+0000","last_fullsized":"2024-05-30T06:59:08.030021+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:17:29.740042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.030665+0000","last_change":"2024-05-30T06:59:08.023401+0000","last_active":"2024-05-30T06:59:08.030665+0000","last_peered":"2024-05-30T06:59:08.030665+0000","last_clean":"2024-05-30T06:59:08.030665+0000","last_became_active":"2024-05-30T06:59:08.022914+0000","last_became_peered":"2024-05-30T06:59:08.022914+0000","last_unstale":"2024-05-30T06:59:08.030665+0000","last_undegraded":"2024-05-30T06:59:08.030665+0000","last_fullsized":"2024-05-30T06:59:08.030665+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:56:25.088778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.030630+0000","last_change":"2024-05-30T06:59:08.024708+0000","last_active":"2024-05-30T06:59:08.030630+0000","last_peered":"2024-05-30T06:59:08.030630+0000","last_clean":"2024-05-30T06:59:08.030630+0000","last_became_active":"2024-05-30T06:59:08.024445+0000","last_became_peered":"2024-05-30T06:59:08.024445+0000","last_unstale":"2024-05-30T06:59:08.030630+0000","last_undegraded":"2024-05-30T06:59:08.030630+0000","last_fullsized":"2024-05-30T06:59:08.030630+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:51:04.988561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.028419+0000","last_change":"2024-05-30T06:59:08.023258+0000","last_active":"2024-05-30T06:59:08.028419+0000","last_peered":"2024-05-30T06:59:08.028419+0000","last_clean":"2024-05-30T06:59:08.028419+0000","last_became_active":"2024-05-30T06:59:08.017709+0000","last_became_peered":"2024-05-30T06:59:08.017709+0000","last_unstale":"2024-05-30T06:59:08.028419+0000","last_undegraded":"2024-05-30T06:59:08.028419+0000","last_fullsized":"2024-05-30T06:59:08.028419+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:13.314661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.029886+0000","last_change":"2024-05-30T06:59:08.026237+0000","last_active":"2024-05-30T06:59:08.029886+0000","last_peered":"2024-05-30T06:59:08.029886+0000","last_clean":"2024-05-30T06:59:08.029886+0000","last_became_active":"2024-05-30T06:59:08.025981+0000","last_became_peered":"2024-05-30T06:59:08.025981+0000","last_unstale":"2024-05-30T06:59:08.029886+0000","last_undegraded":"2024-05-30T06:59:08.029886+0000","last_fullsized":"2024-05-30T06:59:08.029886+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:34.693941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.020125+0000","last_change":"2024-05-30T06:59:08.018790+0000","last_active":"2024-05-30T06:59:08.020125+0000","last_peered":"2024-05-30T06:59:08.020125+0000","last_clean":"2024-05-30T06:59:08.020125+0000","last_became_active":"2024-05-30T06:59:08.015033+0000","last_became_peered":"2024-05-30T06:59:08.015033+0000","last_unstale":"2024-05-30T06:59:08.020125+0000","last_undegraded":"2024-05-30T06:59:08.020125+0000","last_fullsized":"2024-05-30T06:59:08.020125+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:30:30.629687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.047021+0000","last_change":"2024-05-30T06:59:08.046183+0000","last_active":"2024-05-30T06:59:08.047021+0000","last_peered":"2024-05-30T06:59:08.047021+0000","last_clean":"2024-05-30T06:59:08.047021+0000","last_became_active":"2024-05-30T06:59:08.045891+0000","last_became_peered":"2024-05-30T06:59:08.045891+0000","last_unstale":"2024-05-30T06:59:08.047021+0000","last_undegraded":"2024-05-30T06:59:08.047021+0000","last_fullsized":"2024-05-30T06:59:08.047021+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:23.377454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.024343+0000","last_change":"2024-05-30T06:59:08.019956+0000","last_active":"2024-05-30T06:59:08.024343+0000","last_peered":"2024-05-30T06:59:08.024343+0000","last_clean":"2024-05-30T06:59:08.024343+0000","last_became_active":"2024-05-30T06:59:08.019670+0000","last_became_peered":"2024-05-30T06:59:08.019670+0000","last_unstale":"2024-05-30T06:59:08.024343+0000","last_undegraded":"2024-05-30T06:59:08.024343+0000","last_fullsized":"2024-05-30T06:59:08.024343+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:23.377454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045238+0000","last_change":"2024-05-30T06:59:08.044096+0000","last_active":"2024-05-30T06:59:08.045238+0000","last_peered":"2024-05-30T06:59:08.045238+0000","last_clean":"2024-05-30T06:59:08.045238+0000","last_became_active":"2024-05-30T06:59:08.043786+0000","last_became_peered":"2024-05-30T06:59:08.043786+0000","last_unstale":"2024-05-30T06:59:08.045238+0000","last_undegraded":"2024-05-30T06:59:08.045238+0000","last_fullsized":"2024-05-30T06:59:08.045238+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:11:55.774410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.023620+0000","last_change":"2024-05-30T06:59:08.022594+0000","last_active":"2024-05-30T06:59:08.023620+0000","last_peered":"2024-05-30T06:59:08.023620+0000","last_clean":"2024-05-30T06:59:08.023620+0000","last_became_active":"2024-05-30T06:59:08.022293+0000","last_became_peered":"2024-05-30T06:59:08.022293+0000","last_unstale":"2024-05-30T06:59:08.023620+0000","last_undegraded":"2024-05-30T06:59:08.023620+0000","last_fullsized":"2024-05-30T06:59:08.023620+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:05:26.527928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.039949+0000","last_change":"2024-05-30T06:59:08.038685+0000","last_active":"2024-05-30T06:59:08.039949+0000","last_peered":"2024-05-30T06:59:08.039949+0000","last_clean":"2024-05-30T06:59:08.039949+0000","last_became_active":"2024-05-30T06:59:08.038414+0000","last_became_peered":"2024-05-30T06:59:08.038414+0000","last_unstale":"2024-05-30T06:59:08.039949+0000","last_undegraded":"2024-05-30T06:59:08.039949+0000","last_fullsized":"2024-05-30T06:59:08.039949+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:49:09.216308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.031621+0000","last_change":"2024-05-30T06:59:08.027380+0000","last_active":"2024-05-30T06:59:08.031621+0000","last_peered":"2024-05-30T06:59:08.031621+0000","last_clean":"2024-05-30T06:59:08.031621+0000","last_became_active":"2024-05-30T06:59:08.027113+0000","last_became_peered":"2024-05-30T06:59:08.027113+0000","last_unstale":"2024-05-30T06:59:08.031621+0000","last_undegraded":"2024-05-30T06:59:08.031621+0000","last_fullsized":"2024-05-30T06:59:08.031621+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:49:32.634774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.030263+0000","last_change":"2024-05-30T06:59:08.024951+0000","last_active":"2024-05-30T06:59:08.030263+0000","last_peered":"2024-05-30T06:59:08.030263+0000","last_clean":"2024-05-30T06:59:08.030263+0000","last_became_active":"2024-05-30T06:59:08.024354+0000","last_became_peered":"2024-05-30T06:59:08.024354+0000","last_unstale":"2024-05-30T06:59:08.030263+0000","last_undegraded":"2024-05-30T06:59:08.030263+0000","last_fullsized":"2024-05-30T06:59:08.030263+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:58.533777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.043369+0000","last_change":"2024-05-30T06:59:08.033925+0000","last_active":"2024-05-30T06:59:08.043369+0000","last_peered":"2024-05-30T06:59:08.043369+0000","last_clean":"2024-05-30T06:59:08.043369+0000","last_became_active":"2024-05-30T06:59:08.033552+0000","last_became_peered":"2024-05-30T06:59:08.033552+0000","last_unstale":"2024-05-30T06:59:08.043369+0000","last_undegraded":"2024-05-30T06:59:08.043369+0000","last_fullsized":"2024-05-30T06:59:08.043369+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:42:53.672075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.034089+0000","last_change":"2024-05-30T06:59:08.033338+0000","last_active":"2024-05-30T06:59:08.034089+0000","last_peered":"2024-05-30T06:59:08.034089+0000","last_clean":"2024-05-30T06:59:08.034089+0000","last_became_active":"2024-05-30T06:59:08.032376+0000","last_became_peered":"2024-05-30T06:59:08.032376+0000","last_unstale":"2024-05-30T06:59:08.034089+0000","last_undegraded":"2024-05-30T06:59:08.034089+0000","last_fullsized":"2024-05-30T06:59:08.034089+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:37:04.900853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.033718+0000","last_change":"2024-05-30T06:59:08.032860+0000","last_active":"2024-05-30T06:59:08.033718+0000","last_peered":"2024-05-30T06:59:08.033718+0000","last_clean":"2024-05-30T06:59:08.033718+0000","last_became_active":"2024-05-30T06:59:08.032457+0000","last_became_peered":"2024-05-30T06:59:08.032457+0000","last_unstale":"2024-05-30T06:59:08.033718+0000","last_undegraded":"2024-05-30T06:59:08.033718+0000","last_fullsized":"2024-05-30T06:59:08.033718+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:38.643085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.042544+0000","last_change":"2024-05-30T06:59:08.039799+0000","last_active":"2024-05-30T06:59:08.042544+0000","last_peered":"2024-05-30T06:59:08.042544+0000","last_clean":"2024-05-30T06:59:08.042544+0000","last_became_active":"2024-05-30T06:59:08.039524+0000","last_became_peered":"2024-05-30T06:59:08.039524+0000","last_unstale":"2024-05-30T06:59:08.042544+0000","last_undegraded":"2024-05-30T06:59:08.042544+0000","last_fullsized":"2024-05-30T06:59:08.042544+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:07:33.988552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.029514+0000","last_change":"2024-05-30T06:59:08.025201+0000","last_active":"2024-05-30T06:59:08.029514+0000","last_peered":"2024-05-30T06:59:08.029514+0000","last_clean":"2024-05-30T06:59:08.029514+0000","last_became_active":"2024-05-30T06:59:08.023719+0000","last_became_peered":"2024-05-30T06:59:08.023719+0000","last_unstale":"2024-05-30T06:59:08.029514+0000","last_undegraded":"2024-05-30T06:59:08.029514+0000","last_fullsized":"2024-05-30T06:59:08.029514+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:35:10.022749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.028398+0000","last_change":"2024-05-30T06:59:08.022581+0000","last_active":"2024-05-30T06:59:08.028398+0000","last_peered":"2024-05-30T06:59:08.028398+0000","last_clean":"2024-05-30T06:59:08.028398+0000","last_became_active":"2024-05-30T06:59:08.017322+0000","last_became_peered":"2024-05-30T06:59:08.017322+0000","last_unstale":"2024-05-30T06:59:08.028398+0000","last_undegraded":"2024-05-30T06:59:08.028398+0000","last_fullsized":"2024-05-30T06:59:08.028398+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:43.846702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"127'4","reported_seq":16,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.041073+0000","last_change":"2024-05-30T06:59:07.025645+0000","last_active":"2024-05-30T06:59:08.041073+0000","last_peered":"2024-05-30T06:59:08.041073+0000","last_clean":"2024-05-30T06:59:08.041073+0000","last_became_active":"2024-05-30T06:59:07.025401+0000","last_became_peered":"2024-05-30T06:59:07.025401+0000","last_unstale":"2024-05-30T06:59:08.041073+0000","last_undegraded":"2024-05-30T06:59:08.041073+0000","last_fullsized":"2024-05-30T06:59:08.041073+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:12.308444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.041176+0000","last_change":"2024-05-30T06:59:08.037515+0000","last_active":"2024-05-30T06:59:08.041176+0000","last_peered":"2024-05-30T06:59:08.041176+0000","last_clean":"2024-05-30T06:59:08.041176+0000","last_became_active":"2024-05-30T06:59:08.037242+0000","last_became_peered":"2024-05-30T06:59:08.037242+0000","last_unstale":"2024-05-30T06:59:08.041176+0000","last_undegraded":"2024-05-30T06:59:08.041176+0000","last_fullsized":"2024-05-30T06:59:08.041176+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:33:50.003182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"127'1","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.038627+0000","last_change":"2024-05-30T06:59:07.028000+0000","last_active":"2024-05-30T06:59:08.038627+0000","last_peered":"2024-05-30T06:59:08.038627+0000","last_clean":"2024-05-30T06:59:08.038627+0000","last_became_active":"2024-05-30T06:59:07.027686+0000","last_became_peered":"2024-05-30T06:59:07.027686+0000","last_unstale":"2024-05-30T06:59:08.038627+0000","last_undegraded":"2024-05-30T06:59:08.038627+0000","last_fullsized":"2024-05-30T06:59:08.038627+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:22:41.838812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.041467+0000","last_change":"2024-05-30T06:59:08.039191+0000","last_active":"2024-05-30T06:59:08.041467+0000","last_peered":"2024-05-30T06:59:08.041467+0000","last_clean":"2024-05-30T06:59:08.041467+0000","last_became_active":"2024-05-30T06:59:08.038891+0000","last_became_peered":"2024-05-30T06:59:08.038891+0000","last_unstale":"2024-05-30T06:59:08.041467+0000","last_undegraded":"2024-05-30T06:59:08.041467+0000","last_fullsized":"2024-05-30T06:59:08.041467+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:49:46.450533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"127'2","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.027912+0000","last_change":"2024-05-30T06:59:07.021128+0000","last_active":"2024-05-30T06:59:08.027912+0000","last_peered":"2024-05-30T06:59:08.027912+0000","last_clean":"2024-05-30T06:59:08.027912+0000","last_became_active":"2024-05-30T06:59:07.020820+0000","last_became_peered":"2024-05-30T06:59:07.020820+0000","last_unstale":"2024-05-30T06:59:08.027912+0000","last_undegraded":"2024-05-30T06:59:08.027912+0000","last_fullsized":"2024-05-30T06:59:08.027912+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:01:56.813502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.040967+0000","last_change":"2024-05-30T06:59:08.033837+0000","last_active":"2024-05-30T06:59:08.040967+0000","last_peered":"2024-05-30T06:59:08.040967+0000","last_clean":"2024-05-30T06:59:08.040967+0000","last_became_active":"2024-05-30T06:59:08.033506+0000","last_became_peered":"2024-05-30T06:59:08.033506+0000","last_unstale":"2024-05-30T06:59:08.040967+0000","last_undegraded":"2024-05-30T06:59:08.040967+0000","last_fullsized":"2024-05-30T06:59:08.040967+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:56:25.088778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"127'2","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.028207+0000","last_change":"2024-05-30T06:59:07.025478+0000","last_active":"2024-05-30T06:59:08.028207+0000","last_peered":"2024-05-30T06:59:08.028207+0000","last_clean":"2024-05-30T06:59:08.028207+0000","last_became_active":"2024-05-30T06:59:07.025201+0000","last_became_peered":"2024-05-30T06:59:07.025201+0000","last_unstale":"2024-05-30T06:59:08.028207+0000","last_undegraded":"2024-05-30T06:59:08.028207+0000","last_fullsized":"2024-05-30T06:59:08.028207+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:37:03.894636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.024744+0000","last_change":"2024-05-30T06:59:08.022157+0000","last_active":"2024-05-30T06:59:08.024744+0000","last_peered":"2024-05-30T06:59:08.024744+0000","last_clean":"2024-05-30T06:59:08.024744+0000","last_became_active":"2024-05-30T06:59:08.017121+0000","last_became_peered":"2024-05-30T06:59:08.017121+0000","last_unstale":"2024-05-30T06:59:08.024744+0000","last_undegraded":"2024-05-30T06:59:08.024744+0000","last_fullsized":"2024-05-30T06:59:08.024744+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:59.888055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"127'1","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.014901+0000","last_change":"2024-05-30T06:59:07.026285+0000","last_active":"2024-05-30T06:59:08.014901+0000","last_peered":"2024-05-30T06:59:08.014901+0000","last_clean":"2024-05-30T06:59:08.014901+0000","last_became_active":"2024-05-30T06:59:07.025467+0000","last_became_peered":"2024-05-30T06:59:07.025467+0000","last_unstale":"2024-05-30T06:59:08.014901+0000","last_undegraded":"2024-05-30T06:59:08.014901+0000","last_fullsized":"2024-05-30T06:59:08.014901+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:37.636868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.025843+0000","last_change":"2024-05-30T06:59:08.022678+0000","last_active":"2024-05-30T06:59:08.025843+0000","last_peered":"2024-05-30T06:59:08.025843+0000","last_clean":"2024-05-30T06:59:08.025843+0000","last_became_active":"2024-05-30T06:59:08.022387+0000","last_became_peered":"2024-05-30T06:59:08.022387+0000","last_unstale":"2024-05-30T06:59:08.025843+0000","last_undegraded":"2024-05-30T06:59:08.025843+0000","last_fullsized":"2024-05-30T06:59:08.025843+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:21:24.557259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"127'1","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.021807+0000","last_change":"2024-05-30T06:59:07.020549+0000","last_active":"2024-05-30T06:59:08.021807+0000","last_peered":"2024-05-30T06:59:08.021807+0000","last_clean":"2024-05-30T06:59:08.021807+0000","last_became_active":"2024-05-30T06:59:07.020278+0000","last_became_peered":"2024-05-30T06:59:07.020278+0000","last_unstale":"2024-05-30T06:59:08.021807+0000","last_undegraded":"2024-05-30T06:59:08.021807+0000","last_fullsized":"2024-05-30T06:59:08.021807+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:33:45.564464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.038029+0000","last_change":"2024-05-30T06:59:08.035741+0000","last_active":"2024-05-30T06:59:08.038029+0000","last_peered":"2024-05-30T06:59:08.038029+0000","last_clean":"2024-05-30T06:59:08.038029+0000","last_became_active":"2024-05-30T06:59:08.035015+0000","last_became_peered":"2024-05-30T06:59:08.035015+0000","last_unstale":"2024-05-30T06:59:08.038029+0000","last_undegraded":"2024-05-30T06:59:08.038029+0000","last_fullsized":"2024-05-30T06:59:08.038029+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:14:49.671311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.013224+0000","last_change":"2024-05-30T06:59:07.015142+0000","last_active":"2024-05-30T06:59:08.013224+0000","last_peered":"2024-05-30T06:59:08.013224+0000","last_clean":"2024-05-30T06:59:08.013224+0000","last_became_active":"2024-05-30T06:59:07.013998+0000","last_became_peered":"2024-05-30T06:59:07.013998+0000","last_unstale":"2024-05-30T06:59:08.013224+0000","last_undegraded":"2024-05-30T06:59:08.013224+0000","last_fullsized":"2024-05-30T06:59:08.013224+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:07:17.296567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.013704+0000","last_change":"2024-05-30T06:59:08.012136+0000","last_active":"2024-05-30T06:59:08.013704+0000","last_peered":"2024-05-30T06:59:08.013704+0000","last_clean":"2024-05-30T06:59:08.013704+0000","last_became_active":"2024-05-30T06:59:08.011821+0000","last_became_peered":"2024-05-30T06:59:08.011821+0000","last_unstale":"2024-05-30T06:59:08.013704+0000","last_undegraded":"2024-05-30T06:59:08.013704+0000","last_fullsized":"2024-05-30T06:59:08.013704+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:29:37.627610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.002687+0000","last_change":"2024-05-30T06:59:07.018234+0000","last_active":"2024-05-30T06:59:08.002687+0000","last_peered":"2024-05-30T06:59:08.002687+0000","last_clean":"2024-05-30T06:59:08.002687+0000","last_became_active":"2024-05-30T06:59:07.017948+0000","last_became_peered":"2024-05-30T06:59:07.017948+0000","last_unstale":"2024-05-30T06:59:08.002687+0000","last_undegraded":"2024-05-30T06:59:08.002687+0000","last_fullsized":"2024-05-30T06:59:08.002687+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:58.214120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.027421+0000","last_change":"2024-05-30T06:59:08.024166+0000","last_active":"2024-05-30T06:59:08.027421+0000","last_peered":"2024-05-30T06:59:08.027421+0000","last_clean":"2024-05-30T06:59:08.027421+0000","last_became_active":"2024-05-30T06:59:08.023873+0000","last_became_peered":"2024-05-30T06:59:08.023873+0000","last_unstale":"2024-05-30T06:59:08.027421+0000","last_undegraded":"2024-05-30T06:59:08.027421+0000","last_fullsized":"2024-05-30T06:59:08.027421+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:36:23.829031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.014539+0000","last_change":"2024-05-30T06:59:07.024511+0000","last_active":"2024-05-30T06:59:08.014539+0000","last_peered":"2024-05-30T06:59:08.014539+0000","last_clean":"2024-05-30T06:59:08.014539+0000","last_became_active":"2024-05-30T06:59:07.024244+0000","last_became_peered":"2024-05-30T06:59:07.024244+0000","last_unstale":"2024-05-30T06:59:08.014539+0000","last_undegraded":"2024-05-30T06:59:08.014539+0000","last_fullsized":"2024-05-30T06:59:08.014539+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:55.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.039487+0000","last_change":"2024-05-30T06:59:08.025397+0000","last_active":"2024-05-30T06:59:08.039487+0000","last_peered":"2024-05-30T06:59:08.039487+0000","last_clean":"2024-05-30T06:59:08.039487+0000","last_became_active":"2024-05-30T06:59:08.023906+0000","last_became_peered":"2024-05-30T06:59:08.023906+0000","last_unstale":"2024-05-30T06:59:08.039487+0000","last_undegraded":"2024-05-30T06:59:08.039487+0000","last_fullsized":"2024-05-30T06:59:08.039487+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:06:13.939169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.010090+0000","last_change":"2024-05-30T06:59:07.014122+0000","last_active":"2024-05-30T06:59:08.010090+0000","last_peered":"2024-05-30T06:59:08.010090+0000","last_clean":"2024-05-30T06:59:08.010090+0000","last_became_active":"2024-05-30T06:59:07.013813+0000","last_became_peered":"2024-05-30T06:59:07.013813+0000","last_unstale":"2024-05-30T06:59:08.010090+0000","last_undegraded":"2024-05-30T06:59:08.010090+0000","last_fullsized":"2024-05-30T06:59:08.010090+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:50.599472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.042318+0000","last_change":"2024-05-30T06:59:08.039459+0000","last_active":"2024-05-30T06:59:08.042318+0000","last_peered":"2024-05-30T06:59:08.042318+0000","last_clean":"2024-05-30T06:59:08.042318+0000","last_became_active":"2024-05-30T06:59:08.039187+0000","last_became_peered":"2024-05-30T06:59:08.039187+0000","last_unstale":"2024-05-30T06:59:08.042318+0000","last_undegraded":"2024-05-30T06:59:08.042318+0000","last_fullsized":"2024-05-30T06:59:08.042318+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:18:16.991239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"127'3","reported_seq":15,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.034187+0000","last_change":"2024-05-30T06:59:07.023207+0000","last_active":"2024-05-30T06:59:08.034187+0000","last_peered":"2024-05-30T06:59:08.034187+0000","last_clean":"2024-05-30T06:59:08.034187+0000","last_became_active":"2024-05-30T06:59:07.022910+0000","last_became_peered":"2024-05-30T06:59:07.022910+0000","last_unstale":"2024-05-30T06:59:08.034187+0000","last_undegraded":"2024-05-30T06:59:08.034187+0000","last_fullsized":"2024-05-30T06:59:08.034187+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:02:20.542236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.042357+0000","last_change":"2024-05-30T06:59:08.039689+0000","last_active":"2024-05-30T06:59:08.042357+0000","last_peered":"2024-05-30T06:59:08.042357+0000","last_clean":"2024-05-30T06:59:08.042357+0000","last_became_active":"2024-05-30T06:59:08.039393+0000","last_became_peered":"2024-05-30T06:59:08.039393+0000","last_unstale":"2024-05-30T06:59:08.042357+0000","last_undegraded":"2024-05-30T06:59:08.042357+0000","last_fullsized":"2024-05-30T06:59:08.042357+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:01:57.819719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"127'6","reported_seq":18,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045260+0000","last_change":"2024-05-30T06:59:07.014432+0000","last_active":"2024-05-30T06:59:08.045260+0000","last_peered":"2024-05-30T06:59:08.045260+0000","last_clean":"2024-05-30T06:59:08.045260+0000","last_became_active":"2024-05-30T06:59:07.014000+0000","last_became_peered":"2024-05-30T06:59:07.014000+0000","last_unstale":"2024-05-30T06:59:08.045260+0000","last_undegraded":"2024-05-30T06:59:08.045260+0000","last_fullsized":"2024-05-30T06:59:08.045260+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:10:36.275003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.027272+0000","last_change":"2024-05-30T06:59:08.022261+0000","last_active":"2024-05-30T06:59:08.027272+0000","last_peered":"2024-05-30T06:59:08.027272+0000","last_clean":"2024-05-30T06:59:08.027272+0000","last_became_active":"2024-05-30T06:59:08.022009+0000","last_became_peered":"2024-05-30T06:59:08.022009+0000","last_unstale":"2024-05-30T06:59:08.027272+0000","last_undegraded":"2024-05-30T06:59:08.027272+0000","last_fullsized":"2024-05-30T06:59:08.027272+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:43:35.958337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.008421+0000","last_change":"2024-05-30T06:59:07.013707+0000","last_active":"2024-05-30T06:59:08.008421+0000","last_peered":"2024-05-30T06:59:08.008421+0000","last_clean":"2024-05-30T06:59:08.008421+0000","last_became_active":"2024-05-30T06:59:07.013181+0000","last_became_peered":"2024-05-30T06:59:07.013181+0000","last_unstale":"2024-05-30T06:59:08.008421+0000","last_undegraded":"2024-05-30T06:59:08.008421+0000","last_fullsized":"2024-05-30T06:59:08.008421+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:47:22.693305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.031344+0000","last_change":"2024-05-30T06:59:08.030108+0000","last_active":"2024-05-30T06:59:08.031344+0000","last_peered":"2024-05-30T06:59:08.031344+0000","last_clean":"2024-05-30T06:59:08.031344+0000","last_became_active":"2024-05-30T06:59:08.029134+0000","last_became_peered":"2024-05-30T06:59:08.029134+0000","last_unstale":"2024-05-30T06:59:08.031344+0000","last_undegraded":"2024-05-30T06:59:08.031344+0000","last_fullsized":"2024-05-30T06:59:08.031344+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:15:02.554710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.003598+0000","last_change":"2024-05-30T06:59:07.022390+0000","last_active":"2024-05-30T06:59:08.003598+0000","last_peered":"2024-05-30T06:59:08.003598+0000","last_clean":"2024-05-30T06:59:08.003598+0000","last_became_active":"2024-05-30T06:59:07.022101+0000","last_became_peered":"2024-05-30T06:59:07.022101+0000","last_unstale":"2024-05-30T06:59:08.003598+0000","last_undegraded":"2024-05-30T06:59:08.003598+0000","last_fullsized":"2024-05-30T06:59:08.003598+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:18.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045706+0000","last_change":"2024-05-30T06:59:08.044660+0000","last_active":"2024-05-30T06:59:08.045706+0000","last_peered":"2024-05-30T06:59:08.045706+0000","last_clean":"2024-05-30T06:59:08.045706+0000","last_became_active":"2024-05-30T06:59:08.044058+0000","last_became_peered":"2024-05-30T06:59:08.044058+0000","last_unstale":"2024-05-30T06:59:08.045706+0000","last_undegraded":"2024-05-30T06:59:08.045706+0000","last_fullsized":"2024-05-30T06:59:08.045706+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:55:03.939782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"127'8","reported_seq":20,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.037051+0000","last_change":"2024-05-30T06:59:07.015902+0000","last_active":"2024-05-30T06:59:08.037051+0000","last_peered":"2024-05-30T06:59:08.037051+0000","last_clean":"2024-05-30T06:59:08.037051+0000","last_became_active":"2024-05-30T06:59:07.015593+0000","last_became_peered":"2024-05-30T06:59:07.015593+0000","last_unstale":"2024-05-30T06:59:08.037051+0000","last_undegraded":"2024-05-30T06:59:08.037051+0000","last_fullsized":"2024-05-30T06:59:08.037051+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:14:30.382452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.042079+0000","last_change":"2024-05-30T06:59:08.036882+0000","last_active":"2024-05-30T06:59:08.042079+0000","last_peered":"2024-05-30T06:59:08.042079+0000","last_clean":"2024-05-30T06:59:08.042079+0000","last_became_active":"2024-05-30T06:59:08.036615+0000","last_became_peered":"2024-05-30T06:59:08.036615+0000","last_unstale":"2024-05-30T06:59:08.042079+0000","last_undegraded":"2024-05-30T06:59:08.042079+0000","last_fullsized":"2024-05-30T06:59:08.042079+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:15:50.944964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"127'1","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.023372+0000","last_change":"2024-05-30T06:59:07.019419+0000","last_active":"2024-05-30T06:59:08.023372+0000","last_peered":"2024-05-30T06:59:08.023372+0000","last_clean":"2024-05-30T06:59:08.023372+0000","last_became_active":"2024-05-30T06:59:07.019026+0000","last_became_peered":"2024-05-30T06:59:07.019026+0000","last_unstale":"2024-05-30T06:59:08.023372+0000","last_undegraded":"2024-05-30T06:59:08.023372+0000","last_fullsized":"2024-05-30T06:59:08.023372+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:42:17.679592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045607+0000","last_change":"2024-05-30T06:59:08.041567+0000","last_active":"2024-05-30T06:59:08.045607+0000","last_peered":"2024-05-30T06:59:08.045607+0000","last_clean":"2024-05-30T06:59:08.045607+0000","last_became_active":"2024-05-30T06:59:08.039259+0000","last_became_peered":"2024-05-30T06:59:08.039259+0000","last_unstale":"2024-05-30T06:59:08.045607+0000","last_undegraded":"2024-05-30T06:59:08.045607+0000","last_fullsized":"2024-05-30T06:59:08.045607+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:50:42.911168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"127'2","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.030478+0000","last_change":"2024-05-30T06:59:07.020027+0000","last_active":"2024-05-30T06:59:08.030478+0000","last_peered":"2024-05-30T06:59:08.030478+0000","last_clean":"2024-05-30T06:59:08.030478+0000","last_became_active":"2024-05-30T06:59:07.019702+0000","last_became_peered":"2024-05-30T06:59:07.019702+0000","last_unstale":"2024-05-30T06:59:08.030478+0000","last_undegraded":"2024-05-30T06:59:08.030478+0000","last_fullsized":"2024-05-30T06:59:08.030478+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:49:45.444316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.031653+0000","last_change":"2024-05-30T06:59:08.026623+0000","last_active":"2024-05-30T06:59:08.031653+0000","last_peered":"2024-05-30T06:59:08.031653+0000","last_clean":"2024-05-30T06:59:08.031653+0000","last_became_active":"2024-05-30T06:59:08.026370+0000","last_became_peered":"2024-05-30T06:59:08.026370+0000","last_unstale":"2024-05-30T06:59:08.031653+0000","last_undegraded":"2024-05-30T06:59:08.031653+0000","last_fullsized":"2024-05-30T06:59:08.031653+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:22:01.142504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"127'1","reported_seq":13,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.031177+0000","last_change":"2024-05-30T06:59:07.018086+0000","last_active":"2024-05-30T06:59:08.031177+0000","last_peered":"2024-05-30T06:59:08.031177+0000","last_clean":"2024-05-30T06:59:08.031177+0000","last_became_active":"2024-05-30T06:59:07.017740+0000","last_became_peered":"2024-05-30T06:59:07.017740+0000","last_unstale":"2024-05-30T06:59:08.031177+0000","last_undegraded":"2024-05-30T06:59:08.031177+0000","last_fullsized":"2024-05-30T06:59:08.031177+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:16.444618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.018251+0000","last_change":"2024-05-30T06:59:08.015660+0000","last_active":"2024-05-30T06:59:08.018251+0000","last_peered":"2024-05-30T06:59:08.018251+0000","last_clean":"2024-05-30T06:59:08.018251+0000","last_became_active":"2024-05-30T06:59:08.015370+0000","last_became_peered":"2024-05-30T06:59:08.015370+0000","last_unstale":"2024-05-30T06:59:08.018251+0000","last_undegraded":"2024-05-30T06:59:08.018251+0000","last_fullsized":"2024-05-30T06:59:08.018251+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:59:23.939287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.015013+0000","last_change":"2024-05-30T06:59:07.024249+0000","last_active":"2024-05-30T06:59:08.015013+0000","last_peered":"2024-05-30T06:59:08.015013+0000","last_clean":"2024-05-30T06:59:08.015013+0000","last_became_active":"2024-05-30T06:59:07.023895+0000","last_became_peered":"2024-05-30T06:59:07.023895+0000","last_unstale":"2024-05-30T06:59:08.015013+0000","last_undegraded":"2024-05-30T06:59:08.015013+0000","last_fullsized":"2024-05-30T06:59:08.015013+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:16:51.738852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.031780+0000","last_change":"2024-05-30T06:59:08.029322+0000","last_active":"2024-05-30T06:59:08.031780+0000","last_peered":"2024-05-30T06:59:08.031780+0000","last_clean":"2024-05-30T06:59:08.031780+0000","last_became_active":"2024-05-30T06:59:08.028959+0000","last_became_peered":"2024-05-30T06:59:08.028959+0000","last_unstale":"2024-05-30T06:59:08.031780+0000","last_undegraded":"2024-05-30T06:59:08.031780+0000","last_fullsized":"2024-05-30T06:59:08.031780+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:00:11.894375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"127'2","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.037269+0000","last_change":"2024-05-30T06:59:07.019458+0000","last_active":"2024-05-30T06:59:08.037269+0000","last_peered":"2024-05-30T06:59:08.037269+0000","last_clean":"2024-05-30T06:59:08.037269+0000","last_became_active":"2024-05-30T06:59:07.019186+0000","last_became_peered":"2024-05-30T06:59:07.019186+0000","last_unstale":"2024-05-30T06:59:08.037269+0000","last_undegraded":"2024-05-30T06:59:08.037269+0000","last_fullsized":"2024-05-30T06:59:08.037269+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:53.047887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.037715+0000","last_change":"2024-05-30T06:59:08.035291+0000","last_active":"2024-05-30T06:59:08.037715+0000","last_peered":"2024-05-30T06:59:08.037715+0000","last_clean":"2024-05-30T06:59:08.037715+0000","last_became_active":"2024-05-30T06:59:08.034951+0000","last_became_peered":"2024-05-30T06:59:08.034951+0000","last_unstale":"2024-05-30T06:59:08.037715+0000","last_undegraded":"2024-05-30T06:59:08.037715+0000","last_fullsized":"2024-05-30T06:59:08.037715+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:45:27.954419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.010807+0000","last_change":"2024-05-30T06:59:07.016536+0000","last_active":"2024-05-30T06:59:08.010807+0000","last_peered":"2024-05-30T06:59:08.010807+0000","last_clean":"2024-05-30T06:59:08.010807+0000","last_became_active":"2024-05-30T06:59:07.016202+0000","last_became_peered":"2024-05-30T06:59:07.016202+0000","last_unstale":"2024-05-30T06:59:08.010807+0000","last_undegraded":"2024-05-30T06:59:08.010807+0000","last_fullsized":"2024-05-30T06:59:08.010807+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:47:15.001802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.025059+0000","last_change":"2024-05-30T06:59:08.022686+0000","last_active":"2024-05-30T06:59:08.025059+0000","last_peered":"2024-05-30T06:59:08.025059+0000","last_clean":"2024-05-30T06:59:08.025059+0000","last_became_active":"2024-05-30T06:59:08.022436+0000","last_became_peered":"2024-05-30T06:59:08.022436+0000","last_unstale":"2024-05-30T06:59:08.025059+0000","last_undegraded":"2024-05-30T06:59:08.025059+0000","last_fullsized":"2024-05-30T06:59:08.025059+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:51:04.466523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.010122+0000","last_change":"2024-05-30T06:59:07.017333+0000","last_active":"2024-05-30T06:59:08.010122+0000","last_peered":"2024-05-30T06:59:08.010122+0000","last_clean":"2024-05-30T06:59:08.010122+0000","last_became_active":"2024-05-30T06:59:07.017037+0000","last_became_peered":"2024-05-30T06:59:07.017037+0000","last_unstale":"2024-05-30T06:59:08.010122+0000","last_undegraded":"2024-05-30T06:59:08.010122+0000","last_fullsized":"2024-05-30T06:59:08.010122+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:18:59.328569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.042523+0000","last_change":"2024-05-30T06:59:08.038802+0000","last_active":"2024-05-30T06:59:08.042523+0000","last_peered":"2024-05-30T06:59:08.042523+0000","last_clean":"2024-05-30T06:59:08.042523+0000","last_became_active":"2024-05-30T06:59:08.038486+0000","last_became_peered":"2024-05-30T06:59:08.038486+0000","last_unstale":"2024-05-30T06:59:08.042523+0000","last_undegraded":"2024-05-30T06:59:08.042523+0000","last_fullsized":"2024-05-30T06:59:08.042523+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:52:22.042222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.014658+0000","last_change":"2024-05-30T06:59:07.018462+0000","last_active":"2024-05-30T06:59:08.014658+0000","last_peered":"2024-05-30T06:59:08.014658+0000","last_clean":"2024-05-30T06:59:08.014658+0000","last_became_active":"2024-05-30T06:59:07.017946+0000","last_became_peered":"2024-05-30T06:59:07.017946+0000","last_unstale":"2024-05-30T06:59:08.014658+0000","last_undegraded":"2024-05-30T06:59:08.014658+0000","last_fullsized":"2024-05-30T06:59:08.014658+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:18:15.985022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.029906+0000","last_change":"2024-05-30T06:59:08.025933+0000","last_active":"2024-05-30T06:59:08.029906+0000","last_peered":"2024-05-30T06:59:08.029906+0000","last_clean":"2024-05-30T06:59:08.029906+0000","last_became_active":"2024-05-30T06:59:08.025557+0000","last_became_peered":"2024-05-30T06:59:08.025557+0000","last_unstale":"2024-05-30T06:59:08.029906+0000","last_undegraded":"2024-05-30T06:59:08.029906+0000","last_fullsized":"2024-05-30T06:59:08.029906+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:13:00.482109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"127'2","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.040360+0000","last_change":"2024-05-30T06:59:07.020218+0000","last_active":"2024-05-30T06:59:08.040360+0000","last_peered":"2024-05-30T06:59:08.040360+0000","last_clean":"2024-05-30T06:59:08.040360+0000","last_became_active":"2024-05-30T06:59:07.018769+0000","last_became_peered":"2024-05-30T06:59:07.018769+0000","last_unstale":"2024-05-30T06:59:08.040360+0000","last_undegraded":"2024-05-30T06:59:08.040360+0000","last_fullsized":"2024-05-30T06:59:08.040360+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:06.907108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.033725+0000","last_change":"2024-05-30T06:59:08.032992+0000","last_active":"2024-05-30T06:59:08.033725+0000","last_peered":"2024-05-30T06:59:08.033725+0000","last_clean":"2024-05-30T06:59:08.033725+0000","last_became_active":"2024-05-30T06:59:08.032647+0000","last_became_peered":"2024-05-30T06:59:08.032647+0000","last_unstale":"2024-05-30T06:59:08.033725+0000","last_undegraded":"2024-05-30T06:59:08.033725+0000","last_fullsized":"2024-05-30T06:59:08.033725+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:59.220337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.027323+0000","last_change":"2024-05-30T06:59:07.021143+0000","last_active":"2024-05-30T06:59:08.027323+0000","last_peered":"2024-05-30T06:59:08.027323+0000","last_clean":"2024-05-30T06:59:08.027323+0000","last_became_active":"2024-05-30T06:59:07.020771+0000","last_became_peered":"2024-05-30T06:59:07.020771+0000","last_unstale":"2024-05-30T06:59:08.027323+0000","last_undegraded":"2024-05-30T06:59:08.027323+0000","last_fullsized":"2024-05-30T06:59:08.027323+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:42.840485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.039971+0000","last_change":"2024-05-30T06:59:08.038746+0000","last_active":"2024-05-30T06:59:08.039971+0000","last_peered":"2024-05-30T06:59:08.039971+0000","last_clean":"2024-05-30T06:59:08.039971+0000","last_became_active":"2024-05-30T06:59:08.038465+0000","last_became_peered":"2024-05-30T06:59:08.038465+0000","last_unstale":"2024-05-30T06:59:08.039971+0000","last_undegraded":"2024-05-30T06:59:08.039971+0000","last_fullsized":"2024-05-30T06:59:08.039971+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:02:21.548452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.003166+0000","last_change":"2024-05-30T06:59:07.019355+0000","last_active":"2024-05-30T06:59:08.003166+0000","last_peered":"2024-05-30T06:59:08.003166+0000","last_clean":"2024-05-30T06:59:08.003166+0000","last_became_active":"2024-05-30T06:59:07.019061+0000","last_became_peered":"2024-05-30T06:59:07.019061+0000","last_unstale":"2024-05-30T06:59:08.003166+0000","last_undegraded":"2024-05-30T06:59:08.003166+0000","last_fullsized":"2024-05-30T06:59:08.003166+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:57:26.978817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.038059+0000","last_change":"2024-05-30T06:59:08.032170+0000","last_active":"2024-05-30T06:59:08.038059+0000","last_peered":"2024-05-30T06:59:08.038059+0000","last_clean":"2024-05-30T06:59:08.038059+0000","last_became_active":"2024-05-30T06:59:08.030918+0000","last_became_peered":"2024-05-30T06:59:08.030918+0000","last_unstale":"2024-05-30T06:59:08.038059+0000","last_undegraded":"2024-05-30T06:59:08.038059+0000","last_fullsized":"2024-05-30T06:59:08.038059+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:24:19.437357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.015407+0000","last_change":"2024-05-30T06:59:07.020348+0000","last_active":"2024-05-30T06:59:08.015407+0000","last_peered":"2024-05-30T06:59:08.015407+0000","last_clean":"2024-05-30T06:59:08.015407+0000","last_became_active":"2024-05-30T06:59:07.019991+0000","last_became_peered":"2024-05-30T06:59:07.019991+0000","last_unstale":"2024-05-30T06:59:08.015407+0000","last_undegraded":"2024-05-30T06:59:08.015407+0000","last_fullsized":"2024-05-30T06:59:08.015407+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:07:32.982335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.041063+0000","last_change":"2024-05-30T06:59:08.038690+0000","last_active":"2024-05-30T06:59:08.041063+0000","last_peered":"2024-05-30T06:59:08.041063+0000","last_clean":"2024-05-30T06:59:08.041063+0000","last_became_active":"2024-05-30T06:59:08.038380+0000","last_became_peered":"2024-05-30T06:59:08.038380+0000","last_unstale":"2024-05-30T06:59:08.041063+0000","last_undegraded":"2024-05-30T06:59:08.041063+0000","last_fullsized":"2024-05-30T06:59:08.041063+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:49:32.634774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.003485+0000","last_change":"2024-05-30T06:59:07.023295+0000","last_active":"2024-05-30T06:59:08.003485+0000","last_peered":"2024-05-30T06:59:08.003485+0000","last_clean":"2024-05-30T06:59:08.003485+0000","last_became_active":"2024-05-30T06:59:07.022933+0000","last_became_peered":"2024-05-30T06:59:07.022933+0000","last_unstale":"2024-05-30T06:59:08.003485+0000","last_undegraded":"2024-05-30T06:59:08.003485+0000","last_fullsized":"2024-05-30T06:59:08.003485+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:07.641666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.045348+0000","last_change":"2024-05-30T06:59:08.037751+0000","last_active":"2024-05-30T06:59:08.045348+0000","last_peered":"2024-05-30T06:59:08.045348+0000","last_clean":"2024-05-30T06:59:08.045348+0000","last_became_active":"2024-05-30T06:59:08.037505+0000","last_became_peered":"2024-05-30T06:59:08.037505+0000","last_unstale":"2024-05-30T06:59:08.045348+0000","last_undegraded":"2024-05-30T06:59:08.045348+0000","last_fullsized":"2024-05-30T06:59:08.045348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:10:59.558212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.022919+0000","last_change":"2024-05-30T06:59:07.025942+0000","last_active":"2024-05-30T06:59:08.022919+0000","last_peered":"2024-05-30T06:59:08.022919+0000","last_clean":"2024-05-30T06:59:08.022919+0000","last_became_active":"2024-05-30T06:59:07.025651+0000","last_became_peered":"2024-05-30T06:59:07.025651+0000","last_unstale":"2024-05-30T06:59:08.022919+0000","last_undegraded":"2024-05-30T06:59:08.022919+0000","last_fullsized":"2024-05-30T06:59:08.022919+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:21:41.065697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.028598+0000","last_change":"2024-05-30T06:59:08.023176+0000","last_active":"2024-05-30T06:59:08.028598+0000","last_peered":"2024-05-30T06:59:08.028598+0000","last_clean":"2024-05-30T06:59:08.028598+0000","last_became_active":"2024-05-30T06:59:08.022036+0000","last_became_peered":"2024-05-30T06:59:08.022036+0000","last_unstale":"2024-05-30T06:59:08.028598+0000","last_undegraded":"2024-05-30T06:59:08.028598+0000","last_fullsized":"2024-05-30T06:59:08.028598+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:21:42.071914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.009997+0000","last_change":"2024-05-30T06:59:07.012244+0000","last_active":"2024-05-30T06:59:08.009997+0000","last_peered":"2024-05-30T06:59:08.009997+0000","last_clean":"2024-05-30T06:59:08.009997+0000","last_became_active":"2024-05-30T06:59:07.011981+0000","last_became_peered":"2024-05-30T06:59:07.011981+0000","last_unstale":"2024-05-30T06:59:08.009997+0000","last_undegraded":"2024-05-30T06:59:08.009997+0000","last_fullsized":"2024-05-30T06:59:08.009997+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:45:53.245785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.037082+0000","last_change":"2024-05-30T06:59:08.036367+0000","last_active":"2024-05-30T06:59:08.037082+0000","last_peered":"2024-05-30T06:59:08.037082+0000","last_clean":"2024-05-30T06:59:08.037082+0000","last_became_active":"2024-05-30T06:59:08.035993+0000","last_became_peered":"2024-05-30T06:59:08.035993+0000","last_unstale":"2024-05-30T06:59:08.037082+0000","last_undegraded":"2024-05-30T06:59:08.037082+0000","last_fullsized":"2024-05-30T06:59:08.037082+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:12:45.810350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.019254+0000","last_change":"2024-05-30T06:59:07.018219+0000","last_active":"2024-05-30T06:59:08.019254+0000","last_peered":"2024-05-30T06:59:08.019254+0000","last_clean":"2024-05-30T06:59:08.019254+0000","last_became_active":"2024-05-30T06:59:07.017622+0000","last_became_peered":"2024-05-30T06:59:07.017622+0000","last_unstale":"2024-05-30T06:59:08.019254+0000","last_undegraded":"2024-05-30T06:59:08.019254+0000","last_fullsized":"2024-05-30T06:59:08.019254+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:14.903621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.041042+0000","last_change":"2024-05-30T06:59:08.034173+0000","last_active":"2024-05-30T06:59:08.041042+0000","last_peered":"2024-05-30T06:59:08.041042+0000","last_clean":"2024-05-30T06:59:08.041042+0000","last_became_active":"2024-05-30T06:59:08.033874+0000","last_became_peered":"2024-05-30T06:59:08.033874+0000","last_unstale":"2024-05-30T06:59:08.041042+0000","last_undegraded":"2024-05-30T06:59:08.041042+0000","last_fullsized":"2024-05-30T06:59:08.041042+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:22:01.142504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"127'2","reported_seq":14,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.038651+0000","last_change":"2024-05-30T06:59:07.027441+0000","last_active":"2024-05-30T06:59:08.038651+0000","last_peered":"2024-05-30T06:59:08.038651+0000","last_clean":"2024-05-30T06:59:08.038651+0000","last_became_active":"2024-05-30T06:59:07.027219+0000","last_became_peered":"2024-05-30T06:59:07.027219+0000","last_unstale":"2024-05-30T06:59:08.038651+0000","last_undegraded":"2024-05-30T06:59:08.038651+0000","last_fullsized":"2024-05-30T06:59:08.038651+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:58.881839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":374,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-05-30T06:59:08.021389+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:59:08.021389+0000","last_peered":"2024-05-30T06:59:08.021389+0000","last_clean":"2024-05-30T06:59:08.021389+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:59:08.021389+0000","last_undegraded":"2024-05-30T06:59:08.021389+0000","last_fullsized":"2024-05-30T06:59:08.021389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575057,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127668,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":125502,"kb_avail":94244172,"statfs":{"total":96636764160,"available":96506032128,"internally_reserved":0,"allocated":2203648,"data_stored":1289246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":128514506},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575058,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131244,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94240596,"statfs":{"total":96636764160,"available":96502370304,"internally_reserved":0,"allocated":1597440,"data_stored":698240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575058,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64616,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94307224,"statfs":{"total":96636764160,"available":96570597376,"internally_reserved":0,"allocated":1593344,"data_stored":696740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64551365},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145120,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226720,"statfs":{"total":96636764160,"available":96488161280,"internally_reserved":0,"allocated":1589248,"data_stored":696698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575057,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149284,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94222556,"statfs":{"total":96636764160,"available":96483897344,"internally_reserved":0,"allocated":1593344,"data_stored":696788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":151255495},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575056,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145104,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226736,"statfs":{"total":96636764160,"available":96488177664,"internally_reserved":0,"allocated":1572864,"data_stored":689769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575058,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145120,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94226720,"statfs":{"total":96636764160,"available":96488161280,"internally_reserved":0,"allocated":1585152,"data_stored":696628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575058,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105436,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94266404,"statfs":{"total":96636764160,"available":96528797696,"internally_reserved":0,"allocated":2179072,"data_stored":1286996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T06:59:12.551 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-30T06:59:12.551 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-30T06:59:12.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.734+0000 7fec81400640 1 Processor -- start 2024-05-30T06:59:12.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.734+0000 7fec81400640 1 -- start start 2024-05-30T06:59:12.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.734+0000 7fec81400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fec7c06c070 0x7fec7c15fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:12.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.734+0000 7fec81400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec7c0b6130 con 0x7fec7c158e00 2024-05-30T06:59:12.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.734+0000 7fec81400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec7c071410 con 0x7fec7c1624a0 2024-05-30T06:59:12.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.734+0000 7fec81400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fec7c0b4790 con 0x7fec7c06c070 2024-05-30T06:59:12.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.738+0000 7fec7a800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fec7c158e00 0x7fec7c0b5a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48084/0 (socket says 172.21.15.37:48084) 2024-05-30T06:59:12.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.738+0000 7fec7a800640 1 -- 172.21.15.37:0/3946818025 learned_addr learned my addr 172.21.15.37:0/3946818025 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:12.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.738+0000 7fec7b200640 1 --2- 172.21.15.37:0/3946818025 >> v2:172.21.15.37:3300/0 conn(0x7fec7c06c070 0x7fec7c15fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:12.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.738+0000 7fec79e00640 1 -- 172.21.15.37:0/3946818025 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732537712 0 0) 0x7fec7c0b6130 con 0x7fec7c158e00 2024-05-30T06:59:12.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.738+0000 7fec79e00640 1 -- 172.21.15.37:0/3946818025 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec60003530 con 0x7fec7c158e00 2024-05-30T06:59:12.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.738+0000 7fec79e00640 1 -- 172.21.15.37:0/3946818025 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1186027969 0 0) 0x7fec7c071410 con 0x7fec7c1624a0 2024-05-30T06:59:12.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.738+0000 7fec7b200640 1 -- 172.21.15.37:0/3946818025 >> v1:172.21.15.105:6789/0 conn(0x7fec7c1624a0 legacy=0x7fec7c06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.738+0000 7fec7b200640 1 -- 172.21.15.37:0/3946818025 >> v1:172.21.15.37:6789/0 conn(0x7fec7c158e00 legacy=0x7fec7c0b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.738+0000 7fec7b200640 1 -- 172.21.15.37:0/3946818025 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c162980 con 0x7fec7c06c070 2024-05-30T06:59:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.738+0000 7fec7b200640 1 --2- 172.21.15.37:0/3946818025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7c06c070 0x7fec7c15fa90 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0b4910 tx=0x7fec7401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ef012762b0ea84 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:12.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.738+0000 7fec79e00640 1 -- 172.21.15.37:0/3946818025 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec740b2070 con 0x7fec7c06c070 2024-05-30T06:59:12.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.738+0000 7fec79e00640 1 -- 172.21.15.37:0/3946818025 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec740a58f0 con 0x7fec7c06c070 2024-05-30T06:59:12.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.738+0000 7fec79e00640 1 -- 172.21.15.37:0/3946818025 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec740a5cc0 con 0x7fec7c06c070 2024-05-30T06:59:12.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 -- 172.21.15.37:0/3946818025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7c06c070 msgr2=0x7fec7c15fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 --2- 172.21.15.37:0/3946818025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7c06c070 0x7fec7c15fa90 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0b4910 tx=0x7fec7401c920 comp rx=0 tx=0).stop 2024-05-30T06:59:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 -- 172.21.15.37:0/3946818025 shutdown_connections 2024-05-30T06:59:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 --2- 172.21.15.37:0/3946818025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7c06c070 0x7fec7c15fa90 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 -- 172.21.15.37:0/3946818025 >> 172.21.15.37:0/3946818025 conn(0x7fec7c06f110 msgr2=0x7fec7c06f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 -- 172.21.15.37:0/3946818025 shutdown_connections 2024-05-30T06:59:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 -- 172.21.15.37:0/3946818025 wait complete. 2024-05-30T06:59:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 Processor -- start 2024-05-30T06:59:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 -- start start 2024-05-30T06:59:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7c06c070 0x7fec7c0caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec7c158e00 0x7fec7c0cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7c1624a0 0x7fec7c0cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c159360 con 0x7fec7c1624a0 2024-05-30T06:59:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c1591e0 con 0x7fec7c158e00 2024-05-30T06:59:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec81400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fec7c16c850 con 0x7fec7c06c070 2024-05-30T06:59:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec7b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7c1624a0 0x7fec7c0cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec7b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7c1624a0 0x7fec7c0cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48312/0 (socket says 172.21.15.37:48312) 2024-05-30T06:59:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec7b200640 1 -- 172.21.15.37:0/720705295 learned_addr learned my addr 172.21.15.37:0/720705295 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec71e00640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec7c158e00 0x7fec7c0cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.742+0000 7fec7a800640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7c06c070 0x7fec7c0caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec7b200640 1 -- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7c06c070 msgr2=0x7fec7c0caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec7b200640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7c06c070 0x7fec7c0caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec7b200640 1 -- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec7c158e00 msgr2=0x7fec7c0cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec7b200640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec7c158e00 0x7fec7c0cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec7b200640 1 -- 172.21.15.37:0/720705295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c146c50 con 0x7fec7c1624a0 2024-05-30T06:59:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec71e00640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec7c158e00 0x7fec7c0cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec7b200640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7c1624a0 0x7fec7c0cc9c0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fec7401a550 tx=0x7fec740196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec73400640 1 -- 172.21.15.37:0/720705295 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec740c0070 con 0x7fec7c1624a0 2024-05-30T06:59:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec73400640 1 -- 172.21.15.37:0/720705295 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec74003ba0 con 0x7fec7c1624a0 2024-05-30T06:59:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec81400640 1 -- 172.21.15.37:0/720705295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7c146ec0 con 0x7fec7c1624a0 2024-05-30T06:59:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec73400640 1 -- 172.21.15.37:0/720705295 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec740b2040 con 0x7fec7c1624a0 2024-05-30T06:59:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec81400640 1 -- 172.21.15.37:0/720705295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7c14c290 con 0x7fec7c1624a0 2024-05-30T06:59:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec81400640 1 -- 172.21.15.37:0/720705295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7c068bc0 con 0x7fec7c1624a0 2024-05-30T06:59:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.746+0000 7fec73400640 1 -- 172.21.15.37:0/720705295 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fec740c3070 con 0x7fec7c1624a0 2024-05-30T06:59:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.750+0000 7fec73400640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec5806a060 0x7fec5806c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.750+0000 7fec73400640 1 -- 172.21.15.37:0/720705295 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7fec7411fd10 con 0x7fec7c1624a0 2024-05-30T06:59:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.750+0000 7fec7a800640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec5806a060 0x7fec5806c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.750+0000 7fec7a800640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec5806a060 0x7fec5806c520 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fec6c005890 tx=0x7fec6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.754+0000 7fec73400640 1 -- 172.21.15.37:0/720705295 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fec74016540 con 0x7fec7c1624a0 2024-05-30T06:59:12.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.978+0000 7fec81400640 1 -- 172.21.15.37:0/720705295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fec7c070a20 con 0x7fec7c1624a0 2024-05-30T06:59:12.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.978+0000 7fec73400640 1 -- 172.21.15.37:0/720705295 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7fec740f1cb0 con 0x7fec7c1624a0 2024-05-30T06:59:12.980 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-05-30T06:59:12.980 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCCH1hmqnI6HBAASNKo5fSxbVMDb8NdR7l85A== 2024-05-30T06:59:12.980 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2024-05-30T06:59:12.980 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2024-05-30T06:59:12.980 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-30T06:59:12.980 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2024-05-30T06:59:12.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.982+0000 7fec81400640 1 -- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec5806a060 msgr2=0x7fec5806c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.982+0000 7fec81400640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec5806a060 0x7fec5806c520 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fec6c005890 tx=0x7fec6c009040 comp rx=0 tx=0).stop 2024-05-30T06:59:12.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.982+0000 7fec81400640 1 -- 172.21.15.37:0/720705295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7c1624a0 msgr2=0x7fec7c0cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:12.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.982+0000 7fec81400640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7c1624a0 0x7fec7c0cc9c0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fec7401a550 tx=0x7fec740196c0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.982+0000 7fec81400640 1 -- 172.21.15.37:0/720705295 shutdown_connections 2024-05-30T06:59:12.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.982+0000 7fec81400640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7c1624a0 0x7fec7c0cc9c0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.982+0000 7fec81400640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec5806a060 0x7fec5806c520 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.982+0000 7fec81400640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec7c158e00 0x7fec7c0cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.982+0000 7fec81400640 1 --2- 172.21.15.37:0/720705295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7c06c070 0x7fec7c0caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:12.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.982+0000 7fec81400640 1 -- 172.21.15.37:0/720705295 >> 172.21.15.37:0/720705295 conn(0x7fec7c06f110 msgr2=0x7fec7c0b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:12.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.982+0000 7fec81400640 1 -- 172.21.15.37:0/720705295 shutdown_connections 2024-05-30T06:59:12.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:12.982+0000 7fec81400640 1 -- 172.21.15.37:0/720705295 wait complete. 2024-05-30T06:59:13.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T06:59:13.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.142+0000 7fc61b600640 1 Processor -- start 2024-05-30T06:59:13.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.142+0000 7fc61b600640 1 -- start start 2024-05-30T06:59:13.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc61b600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140b55a0 0x7fc6140b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc61b600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc614162f70 con 0x7fc61406d080 2024-05-30T06:59:13.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc61b600640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6140b5ec0 con 0x7fc61415fb30 2024-05-30T06:59:13.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc61b600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc614163210 con 0x7fc6140b55a0 2024-05-30T06:59:13.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc61406d080 0x7fc6140b4840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48096/0 (socket says 172.21.15.37:48096) 2024-05-30T06:59:13.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613e00640 1 -- 172.21.15.37:0/2603624498 learned_addr learned my addr 172.21.15.37:0/2603624498 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:13.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc618c00640 1 --2- 172.21.15.37:0/2603624498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140b55a0 0x7fc6140b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2398937406 0 0) 0x7fc614162f70 con 0x7fc61406d080 2024-05-30T06:59:13.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5fc003530 con 0x7fc61406d080 2024-05-30T06:59:13.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1614937873 0 0) 0x7fc5fc003530 con 0x7fc61406d080 2024-05-30T06:59:13.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140b55a0 msgr2=0x7fc6140b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:13.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 --2- 172.21.15.37:0/2603624498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140b55a0 0x7fc6140b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 >> v1:172.21.15.105:6789/0 conn(0x7fc61415fb30 legacy=0x7fc6140aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6140b4040 con 0x7fc61406d080 2024-05-30T06:59:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fc600001680 con 0x7fc61406d080 2024-05-30T06:59:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 >> v1:172.21.15.37:6789/0 conn(0x7fc61406d080 legacy=0x7fc6140b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 --2- 172.21.15.37:0/2603624498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140b55a0 0x7fc5fc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 --2- 172.21.15.37:0/2603624498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5fc003f30 0x7fc5fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 --2- 172.21.15.37:0/2603624498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5fc004d50 0x7fc5fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc614163210 con 0x7fc5fc003f30 2024-05-30T06:59:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc5fc00bae0 con 0x7fc5fc004d50 2024-05-30T06:59:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc5fc00bce0 con 0x7fc6140b55a0 2024-05-30T06:59:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613e00640 1 --2- 172.21.15.37:0/2603624498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5fc003f30 0x7fc5fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc618c00640 1 --2- 172.21.15.37:0/2603624498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140b55a0 0x7fc5fc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc619600640 1 --2- 172.21.15.37:0/2603624498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5fc004d50 0x7fc5fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613e00640 1 -- 172.21.15.37:0/2603624498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140b55a0 msgr2=0x7fc5fc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613e00640 1 --2- 172.21.15.37:0/2603624498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140b55a0 0x7fc5fc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613e00640 1 -- 172.21.15.37:0/2603624498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5fc004d50 msgr2=0x7fc5fc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613e00640 1 --2- 172.21.15.37:0/2603624498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5fc004d50 0x7fc5fc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.146+0000 7fc613e00640 1 -- 172.21.15.37:0/2603624498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5fc003530 con 0x7fc5fc003f30 2024-05-30T06:59:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.150+0000 7fc613e00640 1 --2- 172.21.15.37:0/2603624498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5fc003f30 0x7fc5fc004810 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c210 tx=0x7fc60001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad4655771460cb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.150+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600007d40 con 0x7fc5fc003f30 2024-05-30T06:59:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.150+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6000a9070 con 0x7fc5fc003f30 2024-05-30T06:59:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.150+0000 7fc613400640 1 -- 172.21.15.37:0/2603624498 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6000a5e00 con 0x7fc5fc003f30 2024-05-30T06:59:13.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.150+0000 7fc61b600640 1 -- 172.21.15.37:0/2603624498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5fc003f30 msgr2=0x7fc5fc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.150+0000 7fc61b600640 1 --2- 172.21.15.37:0/2603624498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5fc003f30 0x7fc5fc004810 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c210 tx=0x7fc60001cc60 comp rx=0 tx=0).stop 2024-05-30T06:59:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.150+0000 7fc619600640 1 -- 172.21.15.37:0/2603624498 reap_dead start 2024-05-30T06:59:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.150+0000 7fc61b600640 1 -- 172.21.15.37:0/2603624498 shutdown_connections 2024-05-30T06:59:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.150+0000 7fc61b600640 1 -- 172.21.15.37:0/2603624498 >> 172.21.15.37:0/2603624498 conn(0x7fc614073680 msgr2=0x7fc61406b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.150+0000 7fc61b600640 1 -- 172.21.15.37:0/2603624498 shutdown_connections 2024-05-30T06:59:13.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.150+0000 7fc61b600640 1 -- 172.21.15.37:0/2603624498 wait complete. 2024-05-30T06:59:13.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.150+0000 7fc61b600640 1 Processor -- start 2024-05-30T06:59:13.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc61b600640 1 -- start start 2024-05-30T06:59:13.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc61b600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5fc003f30 0x7fc6141f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc61b600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415cca0 0x7fc61414d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc61b600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140c6c50 0x7fc6140c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc61b600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140b50d0 con 0x7fc61415cca0 2024-05-30T06:59:13.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc61b600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140b4f50 con 0x7fc5fc003f30 2024-05-30T06:59:13.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc61b600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc6140b0640 con 0x7fc6140c6c50 2024-05-30T06:59:13.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc613e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415cca0 0x7fc61414d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc613e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415cca0 0x7fc61414d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48336/0 (socket says 172.21.15.37:48336) 2024-05-30T06:59:13.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc613e00640 1 -- 172.21.15.37:0/705953563 learned_addr learned my addr 172.21.15.37:0/705953563 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:13.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc618c00640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5fc003f30 0x7fc6141f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc619600640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140c6c50 0x7fc6140c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc613e00640 1 -- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140c6c50 msgr2=0x7fc6140c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc613e00640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140c6c50 0x7fc6140c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc613e00640 1 -- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5fc003f30 msgr2=0x7fc6141f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc613e00640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5fc003f30 0x7fc6141f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc613e00640 1 -- 172.21.15.37:0/705953563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61415d4f0 con 0x7fc61415cca0 2024-05-30T06:59:13.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc613e00640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415cca0 0x7fc61414d650 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fc60001ca90 tx=0x7fc5fc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:13.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc610c00640 1 -- 172.21.15.37:0/705953563 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600007d40 con 0x7fc61415cca0 2024-05-30T06:59:13.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc610c00640 1 -- 172.21.15.37:0/705953563 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6000047f0 con 0x7fc61415cca0 2024-05-30T06:59:13.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc61b600640 1 -- 172.21.15.37:0/705953563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61415d7d0 con 0x7fc61415cca0 2024-05-30T06:59:13.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc610c00640 1 -- 172.21.15.37:0/705953563 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600004ba0 con 0x7fc61415cca0 2024-05-30T06:59:13.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc61b600640 1 -- 172.21.15.37:0/705953563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61415dd90 con 0x7fc61415cca0 2024-05-30T06:59:13.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.154+0000 7fc61b600640 1 -- 172.21.15.37:0/705953563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc614068b20 con 0x7fc61415cca0 2024-05-30T06:59:13.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.158+0000 7fc610c00640 1 -- 172.21.15.37:0/705953563 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fc600007090 con 0x7fc61415cca0 2024-05-30T06:59:13.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.158+0000 7fc610c00640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5f406a030 0x7fc5f406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.158+0000 7fc610c00640 1 -- 172.21.15.37:0/705953563 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7fc60011f6f0 con 0x7fc61415cca0 2024-05-30T06:59:13.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.158+0000 7fc618c00640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5f406a030 0x7fc5f406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.158+0000 7fc618c00640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5f406a030 0x7fc5f406c4f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc608009b20 tx=0x7fc608008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:13.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.162+0000 7fc610c00640 1 -- 172.21.15.37:0/705953563 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc600016970 con 0x7fc61415cca0 2024-05-30T06:59:13.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.362+0000 7fc61b600640 1 -- 172.21.15.37:0/705953563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc614075570 con 0x7fc61415cca0 2024-05-30T06:59:13.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.362+0000 7fc610c00640 1 -- 172.21.15.37:0/705953563 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5189 (secure 0 0 0) 0x7fc6000f1710 con 0x7fc61415cca0 2024-05-30T06:59:13.364 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:13.364 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3965296503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3965296503},{"type":"v1","addr":"172.21.15.105:6836","nonce":3965296503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1640764612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1640764612},{"type":"v1","addr":"172.21.15.37:6835","nonce":1640764612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":9720,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4045040277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4045040277},{"type":"v1","addr":"172.21.15.37:6834","nonce":4045040277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:59:07.409391+0000","modified":"2024-05-30T06:59:10.430545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9729":{"gid":9729,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2587102255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2587102255},{"type":"v1","addr":"172.21.15.105:6837","nonce":2587102255}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9729,"qdb_cluster":[9729]},"id":9}]} 2024-05-30T06:59:13.364 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 84 2024-05-30T06:59:13.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.366+0000 7fc61b600640 1 -- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5f406a030 msgr2=0x7fc5f406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.366+0000 7fc61b600640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5f406a030 0x7fc5f406c4f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc608009b20 tx=0x7fc608008040 comp rx=0 tx=0).stop 2024-05-30T06:59:13.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.366+0000 7fc61b600640 1 -- 172.21.15.37:0/705953563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415cca0 msgr2=0x7fc61414d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.366+0000 7fc61b600640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415cca0 0x7fc61414d650 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fc60001ca90 tx=0x7fc5fc005840 comp rx=0 tx=0).stop 2024-05-30T06:59:13.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.366+0000 7fc61b600640 1 -- 172.21.15.37:0/705953563 shutdown_connections 2024-05-30T06:59:13.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.366+0000 7fc61b600640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6140c6c50 0x7fc6140c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.366+0000 7fc61b600640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61415cca0 0x7fc61414d650 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.366+0000 7fc61b600640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc5f406a030 0x7fc5f406c4f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.366+0000 7fc61b600640 1 --2- 172.21.15.37:0/705953563 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5fc003f30 0x7fc6141f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.366+0000 7fc61b600640 1 -- 172.21.15.37:0/705953563 >> 172.21.15.37:0/705953563 conn(0x7fc614073680 msgr2=0x7fc614158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:13.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.366+0000 7fc61b600640 1 -- 172.21.15.37:0/705953563 shutdown_connections 2024-05-30T06:59:13.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.366+0000 7fc61b600640 1 -- 172.21.15.37:0/705953563 wait complete. 2024-05-30T06:59:13.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-30T06:59:07.409391+0000', 'modified': '2024-05-30T06:59:10.430545+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9729}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9729': {'gid': 9729, 'name': 'd', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6837/2587102255', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6835', 'nonce': 2587102255}, {'type': 'v1', 'addr': '172.21.15.105:6837', 'nonce': 2587102255}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9729, 'qdb_cluster': [9729]} 2024-05-30T06:59:13.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-30T06:59:13.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-30T06:59:13.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.930+0000 7fef5d000640 1 Processor -- start 2024-05-30T06:59:13.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.930+0000 7fef5d000640 1 -- start start 2024-05-30T06:59:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.934+0000 7fef5d000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef58162e70 0x7fef580cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.934+0000 7fef5d000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef58163250 0x7fef581636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.934+0000 7fef5d000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef58164190 con 0x7fef581668a0 2024-05-30T06:59:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.934+0000 7fef5d000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fef5806f8e0 con 0x7fef58162e70 2024-05-30T06:59:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.934+0000 7fef5d000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fef5806ecd0 con 0x7fef58163250 2024-05-30T06:59:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.934+0000 7fef55e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef58162e70 0x7fef580cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.934+0000 7fef55e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef58162e70 0x7fef580cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48350/0 (socket says 172.21.15.37:48350) 2024-05-30T06:59:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.934+0000 7fef55e00640 1 -- 172.21.15.37:0/2810190677 learned_addr learned my addr 172.21.15.37:0/2810190677 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.934+0000 7fef4fe00640 1 --2- 172.21.15.37:0/2810190677 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef58163250 0x7fef581636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.934+0000 7fef55e00640 1 -- 172.21.15.37:0/2810190677 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef58163250 msgr2=0x7fef581636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.934+0000 7fef55e00640 1 --2- 172.21.15.37:0/2810190677 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef58163250 0x7fef581636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.934+0000 7fef55e00640 1 -- 172.21.15.37:0/2810190677 >> v1:172.21.15.105:6789/0 conn(0x7fef581668a0 legacy=0x7fef58166d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.934+0000 7fef55e00640 1 -- 172.21.15.37:0/2810190677 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5806efb0 con 0x7fef58162e70 2024-05-30T06:59:13.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef55e00640 1 --2- 172.21.15.37:0/2810190677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef58162e70 0x7fef580cc8b0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fef48009870 tx=0x7fef4801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d737959827a1b4d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:13.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef55400640 1 -- 172.21.15.37:0/2810190677 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef480aa600 con 0x7fef58162e70 2024-05-30T06:59:13.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef55400640 1 -- 172.21.15.37:0/2810190677 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef480af070 con 0x7fef58162e70 2024-05-30T06:59:13.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef55400640 1 -- 172.21.15.37:0/2810190677 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef480aa9c0 con 0x7fef58162e70 2024-05-30T06:59:13.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 -- 172.21.15.37:0/2810190677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef58162e70 msgr2=0x7fef580cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 --2- 172.21.15.37:0/2810190677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef58162e70 0x7fef580cc8b0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fef48009870 tx=0x7fef4801c4a0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 -- 172.21.15.37:0/2810190677 shutdown_connections 2024-05-30T06:59:13.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 --2- 172.21.15.37:0/2810190677 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef58163250 0x7fef581636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 --2- 172.21.15.37:0/2810190677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef58162e70 0x7fef580cc8b0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 -- 172.21.15.37:0/2810190677 >> 172.21.15.37:0/2810190677 conn(0x7fef5806bf60 msgr2=0x7fef580b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:13.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 -- 172.21.15.37:0/2810190677 shutdown_connections 2024-05-30T06:59:13.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 -- 172.21.15.37:0/2810190677 wait complete. 2024-05-30T06:59:13.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 Processor -- start 2024-05-30T06:59:13.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 -- start start 2024-05-30T06:59:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef58162e70 0x7fef5814f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef58163250 0x7fef5814cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef581668a0 0x7fef58155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef580ccdf0 con 0x7fef581668a0 2024-05-30T06:59:13.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fef5806e960 con 0x7fef58163250 2024-05-30T06:59:13.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef5d000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fef580ccf70 con 0x7fef58162e70 2024-05-30T06:59:13.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef56800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef581668a0 0x7fef58155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef56800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef581668a0 0x7fef58155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48352/0 (socket says 172.21.15.37:48352) 2024-05-30T06:59:13.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.938+0000 7fef56800640 1 -- 172.21.15.37:0/1559682884 learned_addr learned my addr 172.21.15.37:0/1559682884 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:13.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef55e00640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef58162e70 0x7fef5814f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef4fe00640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef58163250 0x7fef5814cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef56800640 1 -- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef58162e70 msgr2=0x7fef5814f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef56800640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef58162e70 0x7fef5814f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef56800640 1 -- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef58163250 msgr2=0x7fef5814cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef56800640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef58163250 0x7fef5814cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef56800640 1 -- 172.21.15.37:0/1559682884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5814d450 con 0x7fef581668a0 2024-05-30T06:59:13.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef56800640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef581668a0 0x7fef58155680 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fef5000c770 tx=0x7fef5000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:13.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef4e000640 1 -- 172.21.15.37:0/1559682884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef50003b80 con 0x7fef581668a0 2024-05-30T06:59:13.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef4e000640 1 -- 172.21.15.37:0/1559682884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef50003d20 con 0x7fef581668a0 2024-05-30T06:59:13.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef4e000640 1 -- 172.21.15.37:0/1559682884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5000aa90 con 0x7fef581668a0 2024-05-30T06:59:13.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef5d000640 1 -- 172.21.15.37:0/1559682884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef58155bc0 con 0x7fef581668a0 2024-05-30T06:59:13.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef5d000640 1 -- 172.21.15.37:0/1559682884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef5814fc00 con 0x7fef581668a0 2024-05-30T06:59:13.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.942+0000 7fef4e000640 1 -- 172.21.15.37:0/1559682884 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fef5000ac30 con 0x7fef581668a0 2024-05-30T06:59:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef4e000640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef3406a030 0x7fef3406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef4e000640 1 -- 172.21.15.37:0/1559682884 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7fef50085670 con 0x7fef581668a0 2024-05-30T06:59:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef55e00640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef3406a030 0x7fef3406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 Processor -- start 2024-05-30T06:59:13.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 -- start start 2024-05-30T06:59:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef55e00640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef3406a030 0x7fef3406c4f0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fef480ae000 tx=0x7fef480a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3c120 0x55d716f3c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3ca40 0x55d716eef110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716eef650 0x55d716eefa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d716d40420 con 0x55d716f3c120 2024-05-30T06:59:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d716cdabf0 con 0x55d716eef650 2024-05-30T06:59:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55d716d3c3e0 con 0x55d716f3ca40 2024-05-30T06:59:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef55e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3c120 0x55d716f3c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef55e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3c120 0x55d716f3c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48360/0 (socket says 172.21.15.37:48360) 2024-05-30T06:59:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef55e00640 1 -- 172.21.15.37:0/118022608 learned_addr learned my addr 172.21.15.37:0/118022608 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef56800640 1 --2- 172.21.15.37:0/118022608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716eef650 0x55d716eefa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef4fe00640 1 --2- 172.21.15.37:0/118022608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3ca40 0x55d716eef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef55e00640 1 -- 172.21.15.37:0/118022608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3ca40 msgr2=0x55d716eef110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef55e00640 1 --2- 172.21.15.37:0/118022608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3ca40 0x55d716eef110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef55e00640 1 -- 172.21.15.37:0/118022608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716eef650 msgr2=0x55d716eefa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef55e00640 1 --2- 172.21.15.37:0/118022608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716eef650 0x55d716eefa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef55e00640 1 -- 172.21.15.37:0/118022608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d716de8450 con 0x55d716f3c120 2024-05-30T06:59:13.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef55e00640 1 --2- 172.21.15.37:0/118022608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3c120 0x55d716f3c500 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fef48000c10 tx=0x7fef48004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd689ee3898fcbdc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:13.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef46a00640 1 -- 172.21.15.37:0/118022608 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef480c8630 con 0x55d716f3c120 2024-05-30T06:59:13.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef46a00640 1 -- 172.21.15.37:0/118022608 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef480af040 con 0x55d716f3c120 2024-05-30T06:59:13.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef46a00640 1 -- 172.21.15.37:0/118022608 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef480c89f0 con 0x55d716f3c120 2024-05-30T06:59:13.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 -- 172.21.15.37:0/118022608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3c120 msgr2=0x55d716f3c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 --2- 172.21.15.37:0/118022608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3c120 0x55d716f3c500 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fef48000c10 tx=0x7fef48004740 comp rx=0 tx=0).stop 2024-05-30T06:59:13.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 -- 172.21.15.37:0/118022608 shutdown_connections 2024-05-30T06:59:13.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 --2- 172.21.15.37:0/118022608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716eef650 0x55d716eefa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 --2- 172.21.15.37:0/118022608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3ca40 0x55d716eef110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 --2- 172.21.15.37:0/118022608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3c120 0x55d716f3c500 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 -- 172.21.15.37:0/118022608 >> 172.21.15.37:0/118022608 conn(0x55d716f1cec0 msgr2=0x55d716f1f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 -- 172.21.15.37:0/118022608 shutdown_connections 2024-05-30T06:59:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.946+0000 7fef60493000 1 -- 172.21.15.37:0/118022608 wait complete. 2024-05-30T06:59:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 1 -- start start 2024-05-30T06:59:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 1 Processor -- start 2024-05-30T06:59:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 0x55d716ef4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3c120 0x55d716ef5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3ca40 0x55d716ef5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d716ce0ec0 con 0x55d716eef650 2024-05-30T06:59:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d716dc1120 con 0x55d716f3ca40 2024-05-30T06:59:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55d716d4b350 con 0x55d716f3c120 2024-05-30T06:59:13.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 10 client.0 _ll_register_callbacks cb 0x55d716d1d4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:59:13.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef55e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 0x55d716ef4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef55e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 0x55d716ef4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48366/0 (socket says 172.21.15.37:48366) 2024-05-30T06:59:13.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef55e00640 1 -- 172.21.15.37:0/3478356497 learned_addr learned my addr 172.21.15.37:0/3478356497 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:13.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef4fe00640 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3c120 0x55d716ef5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef56800640 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3ca40 0x55d716ef5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef55e00640 1 -- 172.21.15.37:0/3478356497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3c120 msgr2=0x55d716ef5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:13.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef55e00640 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3c120 0x55d716ef5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef55e00640 1 -- 172.21.15.37:0/3478356497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3ca40 msgr2=0x55d716ef5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:13.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef55e00640 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3ca40 0x55d716ef5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef55e00640 1 -- 172.21.15.37:0/3478356497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d716d85f80 con 0x55d716eef650 2024-05-30T06:59:13.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef4fe00640 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3c120 0x55d716ef5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:13.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef55e00640 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 0x55d716ef4b00 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fef4801c980 tx=0x7fef4801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fbe0b9bcd09ca5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:13.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef3b400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:59:13.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef3b400640 1 -- 172.21.15.37:0/3478356497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef480d6060 con 0x55d716eef650 2024-05-30T06:59:13.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef3b400640 1 -- 172.21.15.37:0/3478356497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7fef48004040 con 0x55d716eef650 2024-05-30T06:59:13.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 1 -- 172.21.15.37:0/3478356497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef480af040 con 0x55d716eef650 2024-05-30T06:59:13.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef3b400640 1 -- 172.21.15.37:0/3478356497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fef480dc050 con 0x55d716eef650 2024-05-30T06:59:13.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 10 client.9861 fetch_fsmap learned FSMap version 84 2024-05-30T06:59:13.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 1 -- 172.21.15.37:0/3478356497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55d716d19f00 con 0x55d716eef650 2024-05-30T06:59:13.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef3b400640 1 -- 172.21.15.37:0/3478356497 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef480af040 con 0x55d716eef650 2024-05-30T06:59:13.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef3b400640 1 -- 172.21.15.37:0/3478356497 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 84) ==== 3494+0+0 (secure 0 0 0) 0x7fef480df020 con 0x55d716eef650 2024-05-30T06:59:13.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 10 client.9861 fetch_fsmap finished waiting for FSMap version 84 2024-05-30T06:59:13.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 10 client.9861 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-30T06:59:13.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 20 client.9861 populate_metadata read hostname 'smithi037' 2024-05-30T06:59:13.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.105:6835/2587102255,v1:172.21.15.105:6837/2587102255] conn(0x55d716ef6230 0x55d716f4d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 4 client.9861 mds_command: new command op to 9729 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-30T06:59:13.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef60493000 1 -- 172.21.15.37:0/3478356497 --> [v2:172.21.15.105:6835/2587102255,v1:172.21.15.105:6837/2587102255] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d716cd9bc0 con 0x55d716ef6230 2024-05-30T06:59:13.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.950+0000 7fef4fe00640 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.105:6835/2587102255,v1:172.21.15.105:6837/2587102255] conn(0x55d716ef6230 0x55d716f4d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef4fe00640 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.105:6835/2587102255,v1:172.21.15.105:6837/2587102255] conn(0x55d716ef6230 0x55d716f4d3d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2792f6f9a4ddbc83 server_cookie=980675e440346909 in_seq=0 out_seq=0 2024-05-30T06:59:13.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef3b400640 10 client.9861 ms_handle_connect on v2:172.21.15.105:6835/2587102255 2024-05-30T06:59:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef3b400640 1 -- 172.21.15.37:0/3478356497 <== mds.0 v2:172.21.15.105:6835/2587102255 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d716cd9bc0 con 0x55d716ef6230 2024-05-30T06:59:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef3b400640 10 client.9861 handle_command_reply: tid=0 2024-05-30T06:59:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef60493000 1 client.9861 shutdown 2024-05-30T06:59:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef60493000 1 -- 172.21.15.37:0/3478356497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 msgr2=0x55d716ef4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef60493000 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 0x55d716ef4b00 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fef4801c980 tx=0x7fef4801ace0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef60493000 1 -- 172.21.15.37:0/3478356497 shutdown_connections 2024-05-30T06:59:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef60493000 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3ca40 0x55d716ef5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef60493000 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3c120 0x55d716ef5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef60493000 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.105:6835/2587102255,v1:172.21.15.105:6837/2587102255] conn(0x55d716ef6230 0x55d716f4d3d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef60493000 1 --2- 172.21.15.37:0/3478356497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 0x55d716ef4b00 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef3b400640 0 client.9861 ms_handle_reset on v2:172.21.15.105:6835/2587102255 2024-05-30T06:59:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef60493000 1 -- 172.21.15.37:0/3478356497 >> 172.21.15.37:0/3478356497 conn(0x55d716f1cec0 msgr2=0x55d716f1f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:13.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef60493000 1 -- 172.21.15.37:0/3478356497 shutdown_connections 2024-05-30T06:59:13.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef60493000 1 -- 172.21.15.37:0/3478356497 wait complete. 2024-05-30T06:59:13.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.954+0000 7fef60493000 20 client.9861 trim_cache size 0 max 16384 2024-05-30T06:59:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.970+0000 7fef60493000 1 Processor -- start 2024-05-30T06:59:13.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 -- start start 2024-05-30T06:59:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 0x55d716f3b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3c120 0x55d716f3b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3ca40 0x55d716f4d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef58207ba0 con 0x55d716eef650 2024-05-30T06:59:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fef5814dd40 con 0x55d716f3c120 2024-05-30T06:59:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fef5814e390 con 0x55d716f3ca40 2024-05-30T06:59:13.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef55e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 0x55d716f3b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef55e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 0x55d716f3b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48370/0 (socket says 172.21.15.37:48370) 2024-05-30T06:59:13.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef55e00640 1 -- 172.21.15.37:0/3543029592 learned_addr learned my addr 172.21.15.37:0/3543029592 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:13.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef55e00640 1 -- 172.21.15.37:0/3543029592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3ca40 msgr2=0x55d716f4d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:13.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef55e00640 1 --2- 172.21.15.37:0/3543029592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3ca40 0x55d716f4d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef55e00640 1 -- 172.21.15.37:0/3543029592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3c120 msgr2=0x55d716f3b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:13.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef55e00640 1 --2- 172.21.15.37:0/3543029592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3c120 0x55d716f3b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef55e00640 1 -- 172.21.15.37:0/3543029592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d716cc6e80 con 0x55d716eef650 2024-05-30T06:59:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef55e00640 1 --2- 172.21.15.37:0/3543029592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 0x55d716f3b1e0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fef48097f70 tx=0x7fef4800b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659a18d639426052 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef46000640 1 -- 172.21.15.37:0/3543029592 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef480e5070 con 0x55d716eef650 2024-05-30T06:59:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef46000640 1 -- 172.21.15.37:0/3543029592 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef480af070 con 0x55d716eef650 2024-05-30T06:59:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef46000640 1 -- 172.21.15.37:0/3543029592 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef480d1680 con 0x55d716eef650 2024-05-30T06:59:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 -- 172.21.15.37:0/3543029592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 msgr2=0x55d716f3b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 --2- 172.21.15.37:0/3543029592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 0x55d716f3b1e0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fef48097f70 tx=0x7fef4800b050 comp rx=0 tx=0).stop 2024-05-30T06:59:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 -- 172.21.15.37:0/3543029592 shutdown_connections 2024-05-30T06:59:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 --2- 172.21.15.37:0/3543029592 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716f3ca40 0x55d716f4d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 --2- 172.21.15.37:0/3543029592 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3c120 0x55d716f3b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 --2- 172.21.15.37:0/3543029592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716eef650 0x55d716f3b1e0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 -- 172.21.15.37:0/3543029592 >> 172.21.15.37:0/3543029592 conn(0x55d716f1cec0 msgr2=0x55d716eee770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 -- 172.21.15.37:0/3543029592 shutdown_connections 2024-05-30T06:59:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 -- 172.21.15.37:0/3543029592 wait complete. 2024-05-30T06:59:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 -- start start 2024-05-30T06:59:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.974+0000 7fef60493000 1 Processor -- start 2024-05-30T06:59:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716eef650 0x55d716f4fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3c120 0x55d716f66f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3ca40 0x55d716f674a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d716d3f730 con 0x55d716f3ca40 2024-05-30T06:59:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55d716d0c9e0 con 0x55d716f3c120 2024-05-30T06:59:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55d716d44a50 con 0x55d716eef650 2024-05-30T06:59:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 10 client.0 _ll_register_callbacks cb 0x7fef480aa5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-30T06:59:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef56800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3ca40 0x55d716f674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef56800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3ca40 0x55d716f674a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48386/0 (socket says 172.21.15.37:48386) 2024-05-30T06:59:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef56800640 1 -- 172.21.15.37:0/687220473 learned_addr learned my addr 172.21.15.37:0/687220473 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef4fe00640 1 --2- 172.21.15.37:0/687220473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3c120 0x55d716f66f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef55e00640 1 --2- 172.21.15.37:0/687220473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716eef650 0x55d716f4fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef56800640 1 -- 172.21.15.37:0/687220473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716eef650 msgr2=0x55d716f4fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef56800640 1 --2- 172.21.15.37:0/687220473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716eef650 0x55d716f4fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef56800640 1 -- 172.21.15.37:0/687220473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3c120 msgr2=0x55d716f66f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef56800640 1 --2- 172.21.15.37:0/687220473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3c120 0x55d716f66f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef56800640 1 -- 172.21.15.37:0/687220473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d716d08b30 con 0x55d716f3ca40 2024-05-30T06:59:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef56800640 1 --2- 172.21.15.37:0/687220473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3ca40 0x55d716f674a0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fef50086540 tx=0x7fef50056d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ef6260848c83aa server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef3b400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-05-30T06:59:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef3b400640 1 -- 172.21.15.37:0/687220473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5005b3e0 con 0x55d716f3ca40 2024-05-30T06:59:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef3b400640 1 -- 172.21.15.37:0/687220473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7fef50056530 con 0x55d716f3ca40 2024-05-30T06:59:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 -- 172.21.15.37:0/687220473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef480af070 con 0x55d716f3ca40 2024-05-30T06:59:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef3b400640 1 -- 172.21.15.37:0/687220473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fef50074050 con 0x55d716f3ca40 2024-05-30T06:59:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 10 client.9867 fetch_fsmap learned FSMap version 84 2024-05-30T06:59:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 -- 172.21.15.37:0/687220473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55d716dc15b0 con 0x55d716f3ca40 2024-05-30T06:59:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef3b400640 1 -- 172.21.15.37:0/687220473 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef480af070 con 0x55d716f3ca40 2024-05-30T06:59:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef3b400640 1 -- 172.21.15.37:0/687220473 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 84) ==== 3494+0+0 (secure 0 0 0) 0x7fef50052e30 con 0x55d716f3ca40 2024-05-30T06:59:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 10 client.9867 fetch_fsmap finished waiting for FSMap version 84 2024-05-30T06:59:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 10 client.9867 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-30T06:59:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 20 client.9867 populate_metadata read hostname 'smithi037' 2024-05-30T06:59:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 --2- 172.21.15.37:0/687220473 >> [v2:172.21.15.105:6835/2587102255,v1:172.21.15.105:6837/2587102255] conn(0x55d716fab200 0x55d716fab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 4 client.9867 mds_command: new command op to 9729 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-30T06:59:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 -- 172.21.15.37:0/687220473 --> [v2:172.21.15.105:6835/2587102255,v1:172.21.15.105:6837/2587102255] -- command(tid 0: {"prefix": "status"}) -- 0x55d716d4de40 con 0x55d716fab200 2024-05-30T06:59:13.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef55e00640 1 --2- 172.21.15.37:0/687220473 >> [v2:172.21.15.105:6835/2587102255,v1:172.21.15.105:6837/2587102255] conn(0x55d716fab200 0x55d716fab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef55e00640 1 --2- 172.21.15.37:0/687220473 >> [v2:172.21.15.105:6835/2587102255,v1:172.21.15.105:6837/2587102255] conn(0x55d716fab200 0x55d716fab5e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3368199ea1343b58 server_cookie=d3f732d9c47daaee in_seq=0 out_seq=0 2024-05-30T06:59:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef3b400640 10 client.9867 ms_handle_connect on v2:172.21.15.105:6835/2587102255 2024-05-30T06:59:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef3b400640 1 -- 172.21.15.37:0/687220473 <== mds.0 v2:172.21.15.105:6835/2587102255 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55d716d4de40 con 0x55d716fab200 2024-05-30T06:59:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef3b400640 10 client.9867 handle_command_reply: tid=0 2024-05-30T06:59:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 client.9867 shutdown 2024-05-30T06:59:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 -- 172.21.15.37:0/687220473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3ca40 msgr2=0x55d716f674a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 --2- 172.21.15.37:0/687220473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3ca40 0x55d716f674a0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fef50086540 tx=0x7fef50056d10 comp rx=0 tx=0).stop 2024-05-30T06:59:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 -- 172.21.15.37:0/687220473 shutdown_connections 2024-05-30T06:59:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 --2- 172.21.15.37:0/687220473 >> [v2:172.21.15.105:6835/2587102255,v1:172.21.15.105:6837/2587102255] conn(0x55d716fab200 0x55d716fab5e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 --2- 172.21.15.37:0/687220473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d716f3ca40 0x55d716f674a0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 --2- 172.21.15.37:0/687220473 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55d716f3c120 0x55d716f66f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 --2- 172.21.15.37:0/687220473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55d716eef650 0x55d716f4fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef3b400640 0 client.9867 ms_handle_reset on v2:172.21.15.105:6835/2587102255 2024-05-30T06:59:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 -- 172.21.15.37:0/687220473 >> 172.21.15.37:0/687220473 conn(0x55d716f1cec0 msgr2=0x55d716f3a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 -- 172.21.15.37:0/687220473 shutdown_connections 2024-05-30T06:59:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.978+0000 7fef60493000 1 -- 172.21.15.37:0/687220473 wait complete. 2024-05-30T06:59:13.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.982+0000 7fef60493000 20 client.9867 trim_cache size 0 max 16384 2024-05-30T06:59:13.985 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T06:59:13.985 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T06:59:13.985 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-05-30T06:59:13.985 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9729, 2024-05-30T06:59:13.985 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-05-30T06:59:13.985 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-05-30T06:59:13.985 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-05-30T06:59:13.985 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 5.9820544489999996, 2024-05-30T06:59:13.985 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 84, 2024-05-30T06:59:13.985 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 128, 2024-05-30T06:59:13.986 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 128, 2024-05-30T06:59:13.986 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 10.805156928000001 2024-05-30T06:59:13.986 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T06:59:13.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.982+0000 7fef5d000640 1 -- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef3406a030 msgr2=0x7fef3406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.982+0000 7fef5d000640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef3406a030 0x7fef3406c4f0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fef480ae000 tx=0x7fef480a7000 comp rx=0 tx=0).stop 2024-05-30T06:59:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.982+0000 7fef5d000640 1 -- 172.21.15.37:0/1559682884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef581668a0 msgr2=0x7fef58155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.982+0000 7fef5d000640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef581668a0 0x7fef58155680 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fef5000c770 tx=0x7fef5000cc30 comp rx=0 tx=0).stop 2024-05-30T06:59:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.982+0000 7fef5d000640 1 -- 172.21.15.37:0/1559682884 shutdown_connections 2024-05-30T06:59:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.982+0000 7fef5d000640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef581668a0 0x7fef58155680 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.982+0000 7fef5d000640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fef3406a030 0x7fef3406c4f0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.982+0000 7fef5d000640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fef58163250 0x7fef5814cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.982+0000 7fef5d000640 1 --2- 172.21.15.37:0/1559682884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fef58162e70 0x7fef5814f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.982+0000 7fef5d000640 1 -- 172.21.15.37:0/1559682884 >> 172.21.15.37:0/1559682884 conn(0x7fef5806bf60 msgr2=0x7fef5806df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.982+0000 7fef5d000640 1 -- 172.21.15.37:0/1559682884 shutdown_connections 2024-05-30T06:59:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:13.982+0000 7fef5d000640 1 -- 172.21.15.37:0/1559682884 wait complete. 2024-05-30T06:59:14.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-30T06:59:14.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39f3c00640 1 Processor -- start 2024-05-30T06:59:14.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39f3c00640 1 -- start start 2024-05-30T06:59:14.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39f3c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f39ec15e930 0x7f39ec09b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:14.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39f3c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39ec0d1240 0x7f39ec1625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:14.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39f3c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39ec09abe0 con 0x7f39ec0d1690 2024-05-30T06:59:14.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39f3c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f39ec09bee0 con 0x7f39ec0d1240 2024-05-30T06:59:14.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39f3c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f39ec09aec0 con 0x7f39ec15e930 2024-05-30T06:59:14.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39e3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39ec0d1240 0x7f39ec1625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:14.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39e3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39ec0d1240 0x7f39ec1625a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48390/0 (socket says 172.21.15.37:48390) 2024-05-30T06:59:14.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39e3e00640 1 -- 172.21.15.37:0/814258631 learned_addr learned my addr 172.21.15.37:0/814258631 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:14.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39f1200640 1 --2- 172.21.15.37:0/814258631 >> v2:172.21.15.105:3300/0 conn(0x7f39ec15e930 0x7f39ec09b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:14.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39e3e00640 1 -- 172.21.15.37:0/814258631 >> v2:172.21.15.105:3300/0 conn(0x7f39ec15e930 msgr2=0x7f39ec09b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:14.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39e3e00640 1 --2- 172.21.15.37:0/814258631 >> v2:172.21.15.105:3300/0 conn(0x7f39ec15e930 0x7f39ec09b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:14.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39e3e00640 1 -- 172.21.15.37:0/814258631 >> v1:172.21.15.105:6789/0 conn(0x7f39ec0d1690 legacy=0x7f39ec0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:14.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.142+0000 7f39e3e00640 1 -- 172.21.15.37:0/814258631 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ec09b1a0 con 0x7f39ec0d1240 2024-05-30T06:59:14.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.146+0000 7f39e3e00640 1 --2- 172.21.15.37:0/814258631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39ec0d1240 0x7f39ec1625a0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f39ec06ff70 tx=0x7f39d401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbc8c768062a273 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:14.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.146+0000 7f39ebe00640 1 -- 172.21.15.37:0/814258631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d40ab430 con 0x7f39ec0d1240 2024-05-30T06:59:14.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.146+0000 7f39ebe00640 1 -- 172.21.15.37:0/814258631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d40b0070 con 0x7f39ec0d1240 2024-05-30T06:59:14.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.146+0000 7f39ebe00640 1 -- 172.21.15.37:0/814258631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d40ab7f0 con 0x7f39ec0d1240 2024-05-30T06:59:14.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.146+0000 7f39f3c00640 1 -- 172.21.15.37:0/814258631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39ec0d1240 msgr2=0x7f39ec1625a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:14.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.146+0000 7f39f3c00640 1 --2- 172.21.15.37:0/814258631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39ec0d1240 0x7f39ec1625a0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f39ec06ff70 tx=0x7f39d401c520 comp rx=0 tx=0).stop 2024-05-30T06:59:14.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.146+0000 7f39f3c00640 1 -- 172.21.15.37:0/814258631 shutdown_connections 2024-05-30T06:59:14.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.146+0000 7f39f3c00640 1 --2- 172.21.15.37:0/814258631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39ec0d1240 0x7f39ec1625a0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:14.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.146+0000 7f39f3c00640 1 --2- 172.21.15.37:0/814258631 >> v2:172.21.15.105:3300/0 conn(0x7f39ec15e930 0x7f39ec09b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:14.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.146+0000 7f39f3c00640 1 -- 172.21.15.37:0/814258631 >> 172.21.15.37:0/814258631 conn(0x7f39ec0b4100 msgr2=0x7f39ec0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:14.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.146+0000 7f39f3c00640 1 -- 172.21.15.37:0/814258631 shutdown_connections 2024-05-30T06:59:14.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.146+0000 7f39f3c00640 1 -- 172.21.15.37:0/814258631 wait complete. 2024-05-30T06:59:14.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f3c00640 1 Processor -- start 2024-05-30T06:59:14.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f3c00640 1 -- start start 2024-05-30T06:59:14.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f3c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39ec0d1240 0x7f39ec15d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:14.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f3c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39ec0d1690 0x7f39ec1fbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:14.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f3c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39ec15e930 0x7f39ec1fc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:14.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f3c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec15ed10 con 0x7f39ec0d1240 2024-05-30T06:59:14.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f3c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39ec162ef0 con 0x7f39ec0d1690 2024-05-30T06:59:14.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f3c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39ec15ee90 con 0x7f39ec15e930 2024-05-30T06:59:14.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f1200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39ec0d1240 0x7f39ec15d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:14.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f1200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39ec0d1240 0x7f39ec15d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48394/0 (socket says 172.21.15.37:48394) 2024-05-30T06:59:14.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f1200640 1 -- 172.21.15.37:0/2534635154 learned_addr learned my addr 172.21.15.37:0/2534635154 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:14.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f1c00640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39ec15e930 0x7f39ec1fc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39e3e00640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39ec0d1690 0x7f39ec1fbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f1200640 1 -- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39ec15e930 msgr2=0x7f39ec1fc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f1200640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39ec15e930 0x7f39ec1fc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f1200640 1 -- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39ec0d1690 msgr2=0x7f39ec1fbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f1200640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39ec0d1690 0x7f39ec1fbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f1200640 1 -- 172.21.15.37:0/2534635154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ec15b030 con 0x7f39ec0d1240 2024-05-30T06:59:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f1c00640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39ec15e930 0x7f39ec1fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f1200640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39ec0d1240 0x7f39ec15d0e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00e930 tx=0x7f39dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39e9600640 1 -- 172.21.15.37:0/2534635154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc017070 con 0x7f39ec0d1240 2024-05-30T06:59:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39e9600640 1 -- 172.21.15.37:0/2534635154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc00ca00 con 0x7f39ec0d1240 2024-05-30T06:59:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39e9600640 1 -- 172.21.15.37:0/2534635154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc00cdb0 con 0x7f39ec0d1240 2024-05-30T06:59:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f3c00640 1 -- 172.21.15.37:0/2534635154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ec15b310 con 0x7f39ec0d1240 2024-05-30T06:59:14.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f3c00640 1 -- 172.21.15.37:0/2534635154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ec15b8d0 con 0x7f39ec0d1240 2024-05-30T06:59:14.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.150+0000 7f39f3c00640 1 -- 172.21.15.37:0/2534635154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39ec068b20 con 0x7f39ec0d1240 2024-05-30T06:59:14.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.154+0000 7f39e9600640 1 -- 172.21.15.37:0/2534635154 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f39dc01a070 con 0x7f39ec0d1240 2024-05-30T06:59:14.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.154+0000 7f39e9600640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f39c806a060 0x7f39c806c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:14.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.154+0000 7f39e9600640 1 -- 172.21.15.37:0/2534635154 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7f39dc085c80 con 0x7f39ec0d1240 2024-05-30T06:59:14.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.154+0000 7f39e3e00640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f39c806a060 0x7f39c806c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:14.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.154+0000 7f39e3e00640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f39c806a060 0x7f39c806c520 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f39d40af000 tx=0x7f39d40a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:14.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.158+0000 7f39e9600640 1 -- 172.21.15.37:0/2534635154 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39dc057710 con 0x7f39ec0d1240 2024-05-30T06:59:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39f3c00640 1 -- 172.21.15.37:0/2534635154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f39ec0b3eb0 con 0x7f39ec0d1240 2024-05-30T06:59:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39e9600640 1 -- 172.21.15.37:0/2534635154 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) ==== 53+0+73 (secure 0 0 0) 0x7f39dc05ba10 con 0x7f39ec0d1240 2024-05-30T06:59:14.362 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-30T06:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39f3c00640 1 -- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f39c806a060 msgr2=0x7f39c806c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39f3c00640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f39c806a060 0x7f39c806c520 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f39d40af000 tx=0x7f39d40a7000 comp rx=0 tx=0).stop 2024-05-30T06:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39f3c00640 1 -- 172.21.15.37:0/2534635154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39ec0d1240 msgr2=0x7f39ec15d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39f3c00640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39ec0d1240 0x7f39ec15d0e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00e930 tx=0x7f39dc00edf0 comp rx=0 tx=0).stop 2024-05-30T06:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39f3c00640 1 -- 172.21.15.37:0/2534635154 shutdown_connections 2024-05-30T06:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39f3c00640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39ec15e930 0x7f39ec1fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39f3c00640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f39c806a060 0x7f39c806c520 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39f3c00640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39ec0d1690 0x7f39ec1fbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39f3c00640 1 --2- 172.21.15.37:0/2534635154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39ec0d1240 0x7f39ec15d0e0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39f3c00640 1 -- 172.21.15.37:0/2534635154 >> 172.21.15.37:0/2534635154 conn(0x7f39ec0b4100 msgr2=0x7f39ec070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39f3c00640 1 -- 172.21.15.37:0/2534635154 shutdown_connections 2024-05-30T06:59:14.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14.362+0000 7f39f3c00640 1 -- 172.21.15.37:0/2534635154 wait complete. 2024-05-30T06:59:14.383 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-30T06:59:14.383 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-30T06:59:14.383 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-05-30T06:59:14.384 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-30T06:59:14.384 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-30T06:59:14.384 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-30T06:59:14.384 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-30T06:59:14.384 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-30T06:59:14.384 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:59:14.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:59:14.385 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-05-30T06:59:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-30T06:59:14.395 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-30T06:59:14.395 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-05-30T06:59:14.395 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:59:14.395 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-05-30T06:59:14.395 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:59:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41450sec preferred_lft 41450sec 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-30T06:59:14.396 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:30:63:12:21 brd ff:ff:ff:ff:ff:ff 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T06:59:14.397 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-05-30T06:59:14.398 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:59:14.398 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-30T06:59:14.398 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T06:59:14.398 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-05-30T06:59:14.398 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-05-30T06:59:14.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:59:14.398 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-30T06:59:14.455 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-05-30T06:59:14.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:59:14.457 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-05-30T06:59:14.510 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-05-30T06:59:14.510 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-30T06:59:14.510 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-30T06:59:14.510 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-30T06:59:14.510 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-30T06:59:14.510 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-30T06:59:14.510 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-30T06:59:14.511 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-05-30T06:59:14.511 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-30T06:59:14.511 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-30T06:59:14.511 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-30T06:59:14.511 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-05-30T06:59:14.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-30T06:59:14.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:59:14.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:59:14.653 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T06:59:14.661 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T06:59:14.662 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T06:59:14.662 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:59:14.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:59:14.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-05-30T06:59:14.724 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:59:14.724 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-30T06:59:14.773 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-30T06:59:14.773 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-30T06:59:14.773 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:59:14.828 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-30T06:59:14.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:59:14.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:59:14.921 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:59:14.921 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:59:14.937 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-30T06:59:14.937 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-30T06:59:14.937 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-05-30T06:59:14.937 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with new device syntax: 0@393250aa-2b42-4955-adf1-f790b8ba4d8c.cephfs=/ 2024-05-30T06:59:14.937 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.37:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-05-30T06:59:14.942 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-30T06:59:14.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:59:14.942 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-30T06:59:14.962 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-30T06:59:15.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-30T06:59:15.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-30T06:59:15.073 INFO:teuthology.orchestra.run.smithi037.stdout:client9121 2024-05-30T06:59:15.073 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:59:15.073 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:59:15.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-05-30T06:59:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd72c800640 1 Processor -- start 2024-05-30T06:59:15.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd72c800640 1 -- start start 2024-05-30T06:59:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd72c800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7241590c0 0x7fd7240cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:15.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd72c800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7240cde60 0x7fd72406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd72c800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd72415f230 con 0x7fd7240cd400 2024-05-30T06:59:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd72c800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd72415f510 con 0x7fd7240cde60 2024-05-30T06:59:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd72c800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd72415f7f0 con 0x7fd7241590c0 2024-05-30T06:59:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd72a800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd7240cd400 0x7fd7240cf4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48106/0 (socket says 172.21.15.37:48106) 2024-05-30T06:59:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd72a800640 1 -- 172.21.15.37:0/908014826 learned_addr learned my addr 172.21.15.37:0/908014826 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd729400640 1 --2- 172.21.15.37:0/908014826 >> v2:172.21.15.37:3300/0 conn(0x7fd7240cde60 0x7fd72406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd729e00640 1 --2- 172.21.15.37:0/908014826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7241590c0 0x7fd7240cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd729400640 1 -- 172.21.15.37:0/908014826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7241590c0 msgr2=0x7fd7240cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd729400640 1 --2- 172.21.15.37:0/908014826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7241590c0 0x7fd7240cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:15.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd729400640 1 -- 172.21.15.37:0/908014826 >> v1:172.21.15.37:6789/0 conn(0x7fd7240cd400 legacy=0x7fd7240cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:15.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd729400640 1 -- 172.21.15.37:0/908014826 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72415fad0 con 0x7fd7240cde60 2024-05-30T06:59:15.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.270+0000 7fd728a00640 1 -- 172.21.15.37:0/908014826 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2087418190 0 0) 0x7fd72415f230 con 0x7fd7240cd400 2024-05-30T06:59:15.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd729400640 1 --2- 172.21.15.37:0/908014826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7240cde60 0x7fd72406f060 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fd71400ba60 tx=0x7fd71401ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4867569dcf6a98a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:15.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd728a00640 1 -- 172.21.15.37:0/908014826 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7140b4070 con 0x7fd7240cde60 2024-05-30T06:59:15.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd728a00640 1 -- 172.21.15.37:0/908014826 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7140a7920 con 0x7fd7240cde60 2024-05-30T06:59:15.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd728a00640 1 -- 172.21.15.37:0/908014826 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7140a7cf0 con 0x7fd7240cde60 2024-05-30T06:59:15.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd72c800640 1 -- 172.21.15.37:0/908014826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7240cde60 msgr2=0x7fd72406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:15.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd72c800640 1 --2- 172.21.15.37:0/908014826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7240cde60 0x7fd72406f060 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fd71400ba60 tx=0x7fd71401ea50 comp rx=0 tx=0).stop 2024-05-30T06:59:15.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd72c800640 1 -- 172.21.15.37:0/908014826 shutdown_connections 2024-05-30T06:59:15.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd72c800640 1 --2- 172.21.15.37:0/908014826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7240cde60 0x7fd72406f060 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:15.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd72c800640 1 --2- 172.21.15.37:0/908014826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7241590c0 0x7fd7240cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:15.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd72c800640 1 -- 172.21.15.37:0/908014826 >> 172.21.15.37:0/908014826 conn(0x7fd72406bf60 msgr2=0x7fd7240b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:15.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd72c800640 1 -- 172.21.15.37:0/908014826 shutdown_connections 2024-05-30T06:59:15.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd72c800640 1 -- 172.21.15.37:0/908014826 wait complete. 2024-05-30T06:59:15.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd72c800640 1 Processor -- start 2024-05-30T06:59:15.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.274+0000 7fd72c800640 1 -- start start 2024-05-30T06:59:15.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72c800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7240cd400 0x7fd724144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:15.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72c800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7240cde60 0x7fd72414b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:15.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72c800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7241590c0 0x7fd72412fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:15.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72c800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd72406e320 con 0x7fd7241590c0 2024-05-30T06:59:15.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72c800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd72406e1a0 con 0x7fd7240cde60 2024-05-30T06:59:15.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72c800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd72406e4a0 con 0x7fd7240cd400 2024-05-30T06:59:15.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7241590c0 0x7fd72412fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:15.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7241590c0 0x7fd72412fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48398/0 (socket says 172.21.15.37:48398) 2024-05-30T06:59:15.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72a800640 1 -- 172.21.15.37:0/2817019771 learned_addr learned my addr 172.21.15.37:0/2817019771 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:15.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd729e00640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7240cd400 0x7fd724144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:15.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd729400640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7240cde60 0x7fd72414b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:15.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72a800640 1 -- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7240cd400 msgr2=0x7fd724144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:15.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72a800640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7240cd400 0x7fd724144c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:15.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72a800640 1 -- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7240cde60 msgr2=0x7fd72414b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:15.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72a800640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7240cde60 0x7fd72414b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:15.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72a800640 1 -- 172.21.15.37:0/2817019771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72414bf60 con 0x7fd7241590c0 2024-05-30T06:59:15.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72a800640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7241590c0 0x7fd72412fbd0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c7d0 tx=0x7fd72000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:15.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd71e000640 1 -- 172.21.15.37:0/2817019771 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720018070 con 0x7fd7241590c0 2024-05-30T06:59:15.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd71e000640 1 -- 172.21.15.37:0/2817019771 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd72000a640 con 0x7fd7241590c0 2024-05-30T06:59:15.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd71e000640 1 -- 172.21.15.37:0/2817019771 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72000aa70 con 0x7fd7241590c0 2024-05-30T06:59:15.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72c800640 1 -- 172.21.15.37:0/2817019771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72414c240 con 0x7fd7241590c0 2024-05-30T06:59:15.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72c800640 1 -- 172.21.15.37:0/2817019771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd72414c800 con 0x7fd7241590c0 2024-05-30T06:59:15.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.278+0000 7fd72c800640 1 -- 172.21.15.37:0/2817019771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd724068d40 con 0x7fd7241590c0 2024-05-30T06:59:15.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.282+0000 7fd71e000640 1 -- 172.21.15.37:0/2817019771 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7fd72001b070 con 0x7fd7241590c0 2024-05-30T06:59:15.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.282+0000 7fd71e000640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd70806a030 0x7fd70806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:15.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.282+0000 7fd71e000640 1 -- 172.21.15.37:0/2817019771 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7fd720084ed0 con 0x7fd7241590c0 2024-05-30T06:59:15.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.282+0000 7fd729e00640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd70806a030 0x7fd70806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:15.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.282+0000 7fd729e00640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd70806a030 0x7fd70806c4f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd718009ac0 tx=0x7fd718009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:15.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.286+0000 7fd71e000640 1 -- 172.21.15.37:0/2817019771 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd7200568a0 con 0x7fd7241590c0 2024-05-30T06:59:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:15.490+0000 7fd72c800640 1 -- 172.21.15.37:0/2817019771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fd72415e800 con 0x7fd7241590c0 2024-05-30T06:59:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.062+0000 7fd71e000640 1 -- 172.21.15.37:0/2817019771 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v85) ==== 136+0+0 (secure 0 0 0) 0x7fd72005aba0 con 0x7fd7241590c0 2024-05-30T06:59:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.062+0000 7fd72c800640 1 -- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd70806a030 msgr2=0x7fd70806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.062+0000 7fd72c800640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd70806a030 0x7fd70806c4f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd718009ac0 tx=0x7fd718009190 comp rx=0 tx=0).stop 2024-05-30T06:59:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.062+0000 7fd72c800640 1 -- 172.21.15.37:0/2817019771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7241590c0 msgr2=0x7fd72412fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.062+0000 7fd72c800640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7241590c0 0x7fd72412fbd0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c7d0 tx=0x7fd72000cc90 comp rx=0 tx=0).stop 2024-05-30T06:59:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.062+0000 7fd72c800640 1 -- 172.21.15.37:0/2817019771 shutdown_connections 2024-05-30T06:59:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.062+0000 7fd72c800640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7241590c0 0x7fd72412fbd0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.062+0000 7fd72c800640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd70806a030 0x7fd70806c4f0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.062+0000 7fd72c800640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7240cde60 0x7fd72414b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.062+0000 7fd72c800640 1 --2- 172.21.15.37:0/2817019771 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7240cd400 0x7fd724144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.062+0000 7fd72c800640 1 -- 172.21.15.37:0/2817019771 >> 172.21.15.37:0/2817019771 conn(0x7fd72406bf60 msgr2=0x7fd72414df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.062+0000 7fd72c800640 1 -- 172.21.15.37:0/2817019771 shutdown_connections 2024-05-30T06:59:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.062+0000 7fd72c800640 1 -- 172.21.15.37:0/2817019771 wait complete. 2024-05-30T06:59:16.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T06:59:16.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f804a000640 1 Processor -- start 2024-05-30T06:59:16.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f804a000640 1 -- start start 2024-05-30T06:59:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f804a000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8044144c00 0x7f804406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f804a000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8044144fe0 0x7f804406f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f804a000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f804415f2b0 0x7f804415f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f804a000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f80440b3bf0 con 0x7f8044144fe0 2024-05-30T06:59:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f804a000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f80440d01d0 con 0x7f804415f2b0 2024-05-30T06:59:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f804a000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f80440cfd40 con 0x7f8044144c00 2024-05-30T06:59:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f803be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8044144fe0 0x7f804406f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f803be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8044144fe0 0x7f804406f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48410/0 (socket says 172.21.15.37:48410) 2024-05-30T06:59:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f803be00640 1 -- 172.21.15.37:0/357815380 learned_addr learned my addr 172.21.15.37:0/357815380 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f8049600640 1 --2- 172.21.15.37:0/357815380 >> v2:172.21.15.105:3300/0 conn(0x7f804415f2b0 0x7f804415f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f8048c00640 1 --2- 172.21.15.37:0/357815380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8044144c00 0x7f804406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f803be00640 1 -- 172.21.15.37:0/357815380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8044144c00 msgr2=0x7f804406ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f803be00640 1 --2- 172.21.15.37:0/357815380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8044144c00 0x7f804406ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f803be00640 1 -- 172.21.15.37:0/357815380 >> v2:172.21.15.105:3300/0 conn(0x7f804415f2b0 msgr2=0x7f804415f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f803be00640 1 --2- 172.21.15.37:0/357815380 >> v2:172.21.15.105:3300/0 conn(0x7f804415f2b0 0x7f804415f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f803be00640 1 -- 172.21.15.37:0/357815380 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80440cf430 con 0x7f8044144fe0 2024-05-30T06:59:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.230+0000 7f8049600640 1 --2- 172.21.15.37:0/357815380 >> v2:172.21.15.105:3300/0 conn(0x7f804415f2b0 0x7f804415f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:16.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.234+0000 7f803be00640 1 --2- 172.21.15.37:0/357815380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8044144fe0 0x7f804406f490 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f8044070110 tx=0x7f802c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b78065fbc004c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:16.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.234+0000 7f8043e00640 1 -- 172.21.15.37:0/357815380 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c0b0070 con 0x7f8044144fe0 2024-05-30T06:59:16.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.234+0000 7f8043e00640 1 -- 172.21.15.37:0/357815380 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f802c0ab600 con 0x7f8044144fe0 2024-05-30T06:59:16.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.234+0000 7f8043e00640 1 -- 172.21.15.37:0/357815380 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c0ab9d0 con 0x7f8044144fe0 2024-05-30T06:59:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.234+0000 7f804a000640 1 -- 172.21.15.37:0/357815380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8044144fe0 msgr2=0x7f804406f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.234+0000 7f804a000640 1 --2- 172.21.15.37:0/357815380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8044144fe0 0x7f804406f490 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f8044070110 tx=0x7f802c01c460 comp rx=0 tx=0).stop 2024-05-30T06:59:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.234+0000 7f804a000640 1 -- 172.21.15.37:0/357815380 shutdown_connections 2024-05-30T06:59:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.234+0000 7f804a000640 1 --2- 172.21.15.37:0/357815380 >> v2:172.21.15.105:3300/0 conn(0x7f804415f2b0 0x7f804415f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.234+0000 7f804a000640 1 --2- 172.21.15.37:0/357815380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8044144fe0 0x7f804406f490 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.234+0000 7f804a000640 1 --2- 172.21.15.37:0/357815380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8044144c00 0x7f804406ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.234+0000 7f804a000640 1 -- 172.21.15.37:0/357815380 >> 172.21.15.37:0/357815380 conn(0x7f8044067d60 msgr2=0x7f804406b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.234+0000 7f804a000640 1 -- 172.21.15.37:0/357815380 shutdown_connections 2024-05-30T06:59:16.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.234+0000 7f804a000640 1 -- 172.21.15.37:0/357815380 wait complete. 2024-05-30T06:59:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f804a000640 1 Processor -- start 2024-05-30T06:59:16.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f804a000640 1 -- start start 2024-05-30T06:59:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f804a000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8044144c00 0x7f804415d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f804a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8044144fe0 0x7f804415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f804a000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f804415f2b0 0x7f8044136040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f804a000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f804415c3f0 con 0x7f8044144fe0 2024-05-30T06:59:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f804a000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f804415c270 con 0x7f804415f2b0 2024-05-30T06:59:16.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f804a000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f804415c570 con 0x7f8044144c00 2024-05-30T06:59:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f803be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8044144fe0 0x7f804415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f803be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8044144fe0 0x7f804415a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48426/0 (socket says 172.21.15.37:48426) 2024-05-30T06:59:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f803be00640 1 -- 172.21.15.37:0/2530837769 learned_addr learned my addr 172.21.15.37:0/2530837769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f803be00640 1 -- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8044144c00 msgr2=0x7f804415d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f8048c00640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8044144c00 0x7f804415d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f8049600640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f804415f2b0 0x7f8044136040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f803be00640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8044144c00 0x7f804415d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f803be00640 1 -- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f804415f2b0 msgr2=0x7f8044136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f803be00640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f804415f2b0 0x7f8044136040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f803be00640 1 -- 172.21.15.37:0/2530837769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8044136580 con 0x7f8044144fe0 2024-05-30T06:59:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f8048c00640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8044144c00 0x7f804415d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:59:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f8049600640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f804415f2b0 0x7f8044136040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:59:16.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f803be00640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8044144fe0 0x7f804415a9a0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f802c0ae040 tx=0x7f802c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:16.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f8041600640 1 -- 172.21.15.37:0/2530837769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c0b9070 con 0x7f8044144fe0 2024-05-30T06:59:16.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f8041600640 1 -- 172.21.15.37:0/2530837769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f802c0b4400 con 0x7f8044144fe0 2024-05-30T06:59:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f8041600640 1 -- 172.21.15.37:0/2530837769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c0b0040 con 0x7f8044144fe0 2024-05-30T06:59:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f804a000640 1 -- 172.21.15.37:0/2530837769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f804415dd50 con 0x7f8044144fe0 2024-05-30T06:59:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f804a000640 1 -- 172.21.15.37:0/2530837769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f804415e310 con 0x7f8044144fe0 2024-05-30T06:59:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.238+0000 7f804a000640 1 -- 172.21.15.37:0/2530837769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8044068ab0 con 0x7f8044144fe0 2024-05-30T06:59:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.242+0000 7f8041600640 1 -- 172.21.15.37:0/2530837769 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f802c0bc070 con 0x7f8044144fe0 2024-05-30T06:59:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.242+0000 7f8041600640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f802006a030 0x7f802006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.242+0000 7f8041600640 1 -- 172.21.15.37:0/2530837769 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7f802c11e860 con 0x7f8044144fe0 2024-05-30T06:59:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.242+0000 7f8048c00640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f802006a030 0x7f802006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.242+0000 7f8048c00640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f802006a030 0x7f802006c4f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f80340097c0 tx=0x7f8034008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:16.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.246+0000 7f8041600640 1 -- 172.21.15.37:0/2530837769 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f802c016110 con 0x7f8044144fe0 2024-05-30T06:59:16.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.434+0000 7f804a000640 1 -- 172.21.15.37:0/2530837769 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f8044072460 con 0x7f802006a030 2024-05-30T06:59:16.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.434+0000 7f8041600640 1 -- 172.21.15.37:0/2530837769 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f8044072460 con 0x7f802006a030 2024-05-30T06:59:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T06:59:16.437 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T06:59:16.437 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T06:59:16.437 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T06:59:16.437 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T06:59:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.438+0000 7f804a000640 1 -- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f802006a030 msgr2=0x7f802006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.438+0000 7f804a000640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f802006a030 0x7f802006c4f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f80340097c0 tx=0x7f8034008040 comp rx=0 tx=0).stop 2024-05-30T06:59:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.438+0000 7f804a000640 1 -- 172.21.15.37:0/2530837769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8044144fe0 msgr2=0x7f804415a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.438+0000 7f804a000640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8044144fe0 0x7f804415a9a0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f802c0ae040 tx=0x7f802c019200 comp rx=0 tx=0).stop 2024-05-30T06:59:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.438+0000 7f804a000640 1 -- 172.21.15.37:0/2530837769 shutdown_connections 2024-05-30T06:59:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.438+0000 7f804a000640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f802006a030 0x7f802006c4f0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.438+0000 7f804a000640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f804415f2b0 0x7f8044136040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.438+0000 7f804a000640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8044144fe0 0x7f804415a9a0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.438+0000 7f804a000640 1 --2- 172.21.15.37:0/2530837769 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8044144c00 0x7f804415d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.438+0000 7f804a000640 1 -- 172.21.15.37:0/2530837769 >> 172.21.15.37:0/2530837769 conn(0x7f8044067d60 msgr2=0x7f8044074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.438+0000 7f804a000640 1 -- 172.21.15.37:0/2530837769 shutdown_connections 2024-05-30T06:59:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.438+0000 7f804a000640 1 -- 172.21.15.37:0/2530837769 wait complete. 2024-05-30T06:59:16.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-30T06:59:16.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.602+0000 7f2be8e00640 1 Processor -- start 2024-05-30T06:59:16.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.602+0000 7f2be8e00640 1 -- start start 2024-05-30T06:59:16.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.602+0000 7f2be8e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2be4155da0 0x7f2be40cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.602+0000 7f2be8e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2be406f770 0x7f2be40b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.602+0000 7f2be8e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2be415f310 con 0x7f2be40cd440 2024-05-30T06:59:16.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.602+0000 7f2be8e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2be415f5f0 con 0x7f2be4155da0 2024-05-30T06:59:16.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.602+0000 7f2be8e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2be415f8d0 con 0x7f2be406f770 2024-05-30T06:59:16.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.606+0000 7f2be1e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2be4155da0 0x7f2be40cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.606+0000 7f2be1e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2be4155da0 0x7f2be40cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48434/0 (socket says 172.21.15.37:48434) 2024-05-30T06:59:16.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.606+0000 7f2be1e00640 1 -- 172.21.15.37:0/1951745538 learned_addr learned my addr 172.21.15.37:0/1951745538 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:16.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.606+0000 7f2be2800640 1 --2- 172.21.15.37:0/1951745538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2be406f770 0x7f2be40b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.606+0000 7f2be1e00640 1 -- 172.21.15.37:0/1951745538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2be406f770 msgr2=0x7f2be40b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:16.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.606+0000 7f2be1e00640 1 --2- 172.21.15.37:0/1951745538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2be406f770 0x7f2be40b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.606+0000 7f2be1e00640 1 -- 172.21.15.37:0/1951745538 >> v1:172.21.15.105:6789/0 conn(0x7f2be40cd440 legacy=0x7f2be406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.606+0000 7f2be1e00640 1 -- 172.21.15.37:0/1951745538 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be415fbb0 con 0x7f2be4155da0 2024-05-30T06:59:16.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.606+0000 7f2be1e00640 1 --2- 172.21.15.37:0/1951745538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be4155da0 0x7f2be40cd950 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009870 tx=0x7f2bd401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56ff75b3df520d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:16.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.606+0000 7f2be1400640 1 -- 172.21.15.37:0/1951745538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40b0070 con 0x7f2be4155da0 2024-05-30T06:59:16.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.606+0000 7f2be1400640 1 -- 172.21.15.37:0/1951745538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd40ab600 con 0x7f2be4155da0 2024-05-30T06:59:16.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.606+0000 7f2be1400640 1 -- 172.21.15.37:0/1951745538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40ab9d0 con 0x7f2be4155da0 2024-05-30T06:59:16.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 -- 172.21.15.37:0/1951745538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be4155da0 msgr2=0x7f2be40cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 --2- 172.21.15.37:0/1951745538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be4155da0 0x7f2be40cd950 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009870 tx=0x7f2bd401c440 comp rx=0 tx=0).stop 2024-05-30T06:59:16.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 -- 172.21.15.37:0/1951745538 shutdown_connections 2024-05-30T06:59:16.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 --2- 172.21.15.37:0/1951745538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2be406f770 0x7f2be40b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 --2- 172.21.15.37:0/1951745538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be4155da0 0x7f2be40cd950 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 -- 172.21.15.37:0/1951745538 >> 172.21.15.37:0/1951745538 conn(0x7f2be406bf60 msgr2=0x7f2be40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:16.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 -- 172.21.15.37:0/1951745538 shutdown_connections 2024-05-30T06:59:16.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 -- 172.21.15.37:0/1951745538 wait complete. 2024-05-30T06:59:16.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 Processor -- start 2024-05-30T06:59:16.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 -- start start 2024-05-30T06:59:16.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2be406f770 0x7f2be41691f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2be4155da0 0x7f2be414dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be41684e0 0x7f2be41537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2be4166570 con 0x7f2be41684e0 2024-05-30T06:59:16.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2be40b46b0 con 0x7f2be4155da0 2024-05-30T06:59:16.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be8e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2be41666f0 con 0x7f2be406f770 2024-05-30T06:59:16.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be41684e0 0x7f2be41537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be1e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2be406f770 0x7f2be41691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be1e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2be406f770 0x7f2be41691f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:59916/0 (socket says 172.21.15.37:59916) 2024-05-30T06:59:16.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be41684e0 0x7f2be41537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48438/0 (socket says 172.21.15.37:48438) 2024-05-30T06:59:16.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be1e00640 1 -- 172.21.15.37:0/1132057271 learned_addr learned my addr 172.21.15.37:0/1132057271 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:16.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2bd9400640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2be4155da0 0x7f2be414dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be1e00640 1 -- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2be4155da0 msgr2=0x7f2be414dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be1e00640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2be4155da0 0x7f2be414dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be1e00640 1 -- 172.21.15.37:0/1132057271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be41684e0 msgr2=0x7f2be41537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be1e00640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be41684e0 0x7f2be41537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be1e00640 1 -- 172.21.15.37:0/1132057271 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be414e380 con 0x7f2be406f770 2024-05-30T06:59:16.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.610+0000 7f2be2800640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be41684e0 0x7f2be41537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:59:16.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.614+0000 7f2be1e00640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2be406f770 0x7f2be41691f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40ae040 tx=0x7f2bd40191e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:16.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.614+0000 7f2bdaa00640 1 -- 172.21.15.37:0/1132057271 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40b0040 con 0x7f2be406f770 2024-05-30T06:59:16.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.614+0000 7f2bdaa00640 1 -- 172.21.15.37:0/1132057271 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd40b9070 con 0x7f2be406f770 2024-05-30T06:59:16.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.614+0000 7f2bdaa00640 1 -- 172.21.15.37:0/1132057271 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40b4660 con 0x7f2be406f770 2024-05-30T06:59:16.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.614+0000 7f2be8e00640 1 -- 172.21.15.37:0/1132057271 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be4167720 con 0x7f2be406f770 2024-05-30T06:59:16.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.614+0000 7f2be8e00640 1 -- 172.21.15.37:0/1132057271 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be4167ce0 con 0x7f2be406f770 2024-05-30T06:59:16.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.614+0000 7f2be8e00640 1 -- 172.21.15.37:0/1132057271 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be4068bc0 con 0x7f2be406f770 2024-05-30T06:59:16.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.614+0000 7f2bdaa00640 1 -- 172.21.15.37:0/1132057271 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f2bd40b4800 con 0x7f2be406f770 2024-05-30T06:59:16.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.614+0000 7f2bdaa00640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bc006a060 0x7f2bc006c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.614+0000 7f2bdaa00640 1 -- 172.21.15.37:0/1132057271 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7f2bd411fe10 con 0x7f2be406f770 2024-05-30T06:59:16.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.614+0000 7f2bd9400640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bc006a060 0x7f2bc006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.618+0000 7f2bd9400640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bc006a060 0x7f2bc006c520 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2be4151040 tx=0x7f2bcc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:16.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.618+0000 7f2bdaa00640 1 -- 172.21.15.37:0/1132057271 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2bd4016150 con 0x7f2be406f770 2024-05-30T06:59:16.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.786+0000 7f2be8e00640 1 -- 172.21.15.37:0/1132057271 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f2be40b6790 con 0x7f2be406f770 2024-05-30T06:59:16.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.786+0000 7f2bdaa00640 1 -- 172.21.15.37:0/1132057271 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f2bd40f1860 con 0x7f2be406f770 2024-05-30T06:59:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.790+0000 7f2be8e00640 1 -- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bc006a060 msgr2=0x7f2bc006c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.790+0000 7f2be8e00640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bc006a060 0x7f2bc006c520 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2be4151040 tx=0x7f2bcc009040 comp rx=0 tx=0).stop 2024-05-30T06:59:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.790+0000 7f2be8e00640 1 -- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2be406f770 msgr2=0x7f2be41691f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.790+0000 7f2be8e00640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2be406f770 0x7f2be41691f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40ae040 tx=0x7f2bd40191e0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.790+0000 7f2be8e00640 1 -- 172.21.15.37:0/1132057271 shutdown_connections 2024-05-30T06:59:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.790+0000 7f2be8e00640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2be41684e0 0x7f2be41537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.790+0000 7f2be8e00640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2bc006a060 0x7f2bc006c520 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.790+0000 7f2be8e00640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2be4155da0 0x7f2be414dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.790+0000 7f2be8e00640 1 --2- 172.21.15.37:0/1132057271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2be406f770 0x7f2be41691f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.790+0000 7f2be8e00640 1 -- 172.21.15.37:0/1132057271 >> 172.21.15.37:0/1132057271 conn(0x7f2be406bf60 msgr2=0x7f2be40b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:16.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.790+0000 7f2be8e00640 1 -- 172.21.15.37:0/1132057271 shutdown_connections 2024-05-30T06:59:16.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.790+0000 7f2be8e00640 1 -- 172.21.15.37:0/1132057271 wait complete. 2024-05-30T06:59:16.810 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_no_wait false 2024-05-30T06:59:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb95000640 1 Processor -- start 2024-05-30T06:59:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb95000640 1 -- start start 2024-05-30T06:59:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb95000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb900cd440 0x7ffb9006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb95000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffb9006f5a0 0x7ffb900b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb95000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb9015f310 con 0x7ffb90155da0 2024-05-30T06:59:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb95000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ffb9015f5f0 con 0x7ffb9006f5a0 2024-05-30T06:59:16.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb95000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffb9015f8d0 con 0x7ffb900cd440 2024-05-30T06:59:16.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb87e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb900cd440 0x7ffb9006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb8de00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ffb90155da0 0x7ffb900cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47786/0 (socket says 172.21.15.37:47786) 2024-05-30T06:59:16.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb8de00640 1 -- 172.21.15.37:0/3401045200 learned_addr learned my addr 172.21.15.37:0/3401045200 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:16.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb8e800640 1 --2- 172.21.15.37:0/3401045200 >> v2:172.21.15.105:3300/0 conn(0x7ffb9006f5a0 0x7ffb900b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb8d400640 1 -- 172.21.15.37:0/3401045200 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 412109758 0 0) 0x7ffb9015f310 con 0x7ffb90155da0 2024-05-30T06:59:16.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb8d400640 1 -- 172.21.15.37:0/3401045200 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb74003530 con 0x7ffb90155da0 2024-05-30T06:59:16.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb87e00640 1 -- 172.21.15.37:0/3401045200 >> v2:172.21.15.105:3300/0 conn(0x7ffb9006f5a0 msgr2=0x7ffb900b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:16.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb87e00640 1 --2- 172.21.15.37:0/3401045200 >> v2:172.21.15.105:3300/0 conn(0x7ffb9006f5a0 0x7ffb900b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb87e00640 1 -- 172.21.15.37:0/3401045200 >> v1:172.21.15.105:6789/0 conn(0x7ffb90155da0 legacy=0x7ffb900cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb87e00640 1 -- 172.21.15.37:0/3401045200 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9015fbb0 con 0x7ffb900cd440 2024-05-30T06:59:16.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.954+0000 7ffb8e800640 1 --2- 172.21.15.37:0/3401045200 >> v2:172.21.15.105:3300/0 conn(0x7ffb9006f5a0 0x7ffb900b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:59:16.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.958+0000 7ffb87e00640 1 --2- 172.21.15.37:0/3401045200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb900cd440 0x7ffb9006f060 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb780097c0 tx=0x7ffb7801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1b68eb669cfb9cc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:16.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.958+0000 7ffb8d400640 1 -- 172.21.15.37:0/3401045200 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb780b0070 con 0x7ffb900cd440 2024-05-30T06:59:16.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.958+0000 7ffb8d400640 1 -- 172.21.15.37:0/3401045200 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb780ab600 con 0x7ffb900cd440 2024-05-30T06:59:16.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.958+0000 7ffb8d400640 1 -- 172.21.15.37:0/3401045200 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb780ab9d0 con 0x7ffb900cd440 2024-05-30T06:59:16.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.958+0000 7ffb95000640 1 -- 172.21.15.37:0/3401045200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb900cd440 msgr2=0x7ffb9006f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.958+0000 7ffb95000640 1 --2- 172.21.15.37:0/3401045200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb900cd440 0x7ffb9006f060 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb780097c0 tx=0x7ffb7801c380 comp rx=0 tx=0).stop 2024-05-30T06:59:16.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.958+0000 7ffb95000640 1 -- 172.21.15.37:0/3401045200 shutdown_connections 2024-05-30T06:59:16.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.958+0000 7ffb95000640 1 --2- 172.21.15.37:0/3401045200 >> v2:172.21.15.105:3300/0 conn(0x7ffb9006f5a0 0x7ffb900b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.958+0000 7ffb95000640 1 --2- 172.21.15.37:0/3401045200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb900cd440 0x7ffb9006f060 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.958+0000 7ffb95000640 1 -- 172.21.15.37:0/3401045200 >> 172.21.15.37:0/3401045200 conn(0x7ffb9006bf60 msgr2=0x7ffb900b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:16.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.958+0000 7ffb95000640 1 -- 172.21.15.37:0/3401045200 shutdown_connections 2024-05-30T06:59:16.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.958+0000 7ffb95000640 1 -- 172.21.15.37:0/3401045200 wait complete. 2024-05-30T06:59:16.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb95000640 1 Processor -- start 2024-05-30T06:59:16.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb95000640 1 -- start start 2024-05-30T06:59:16.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb95000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb9006f5a0 0x7ffb90162cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb95000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb90155da0 0x7ffb9014e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb95000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9006ea60 0x7ffb90160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb95000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9006f9b0 con 0x7ffb9006ea60 2024-05-30T06:59:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb95000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffb900b46b0 con 0x7ffb9006f5a0 2024-05-30T06:59:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb95000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffb90168580 con 0x7ffb90155da0 2024-05-30T06:59:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb8e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9006ea60 0x7ffb90160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb8e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9006ea60 0x7ffb90160330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48454/0 (socket says 172.21.15.37:48454) 2024-05-30T06:59:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb8e800640 1 -- 172.21.15.37:0/2316291659 learned_addr learned my addr 172.21.15.37:0/2316291659 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb87e00640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb90155da0 0x7ffb9014e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb8de00640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb9006f5a0 0x7ffb90162cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb8e800640 1 -- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb90155da0 msgr2=0x7ffb9014e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb8e800640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb90155da0 0x7ffb9014e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb8e800640 1 -- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb9006f5a0 msgr2=0x7ffb90162cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb8e800640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb9006f5a0 0x7ffb90162cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:16.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb8e800640 1 -- 172.21.15.37:0/2316291659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb900b18a0 con 0x7ffb9006ea60 2024-05-30T06:59:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb8e800640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9006ea60 0x7ffb90160330 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009f00 tx=0x7ffb8800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb86000640 1 -- 172.21.15.37:0/2316291659 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88018030 con 0x7ffb9006ea60 2024-05-30T06:59:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb86000640 1 -- 172.21.15.37:0/2316291659 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb8800ce50 con 0x7ffb9006ea60 2024-05-30T06:59:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb86000640 1 -- 172.21.15.37:0/2316291659 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb88003bc0 con 0x7ffb9006ea60 2024-05-30T06:59:16.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb95000640 1 -- 172.21.15.37:0/2316291659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb9014ee50 con 0x7ffb9006ea60 2024-05-30T06:59:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.962+0000 7ffb95000640 1 -- 172.21.15.37:0/2316291659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb90157620 con 0x7ffb9006ea60 2024-05-30T06:59:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.966+0000 7ffb95000640 1 -- 172.21.15.37:0/2316291659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb90068bc0 con 0x7ffb9006ea60 2024-05-30T06:59:16.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.966+0000 7ffb86000640 1 -- 172.21.15.37:0/2316291659 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7ffb8801b070 con 0x7ffb9006ea60 2024-05-30T06:59:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.966+0000 7ffb86000640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffb6c06a060 0x7ffb6c06c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.966+0000 7ffb86000640 1 -- 172.21.15.37:0/2316291659 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7ffb880862c0 con 0x7ffb9006ea60 2024-05-30T06:59:16.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.966+0000 7ffb8de00640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffb6c06a060 0x7ffb6c06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:16.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.966+0000 7ffb8de00640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffb6c06a060 0x7ffb6c06c520 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ffb800011f0 tx=0x7ffb80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:16.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:16.970+0000 7ffb86000640 1 -- 172.21.15.37:0/2316291659 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffb88022070 con 0x7ffb9006ea60 2024-05-30T06:59:17.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.138+0000 7ffb95000640 1 -- 172.21.15.37:0/2316291659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}] v 0) -- 0x7ffb9006f380 con 0x7ffb9006ea60 2024-05-30T06:59:17.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.142+0000 7ffb86000640 1 -- 172.21.15.37:0/2316291659 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_no_wait}]=0 v29)=0 v29) ==== 136+0+0 (secure 0 0 0) 0x7ffb88010040 con 0x7ffb9006ea60 2024-05-30T06:59:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.142+0000 7ffb95000640 1 -- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffb6c06a060 msgr2=0x7ffb6c06c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.142+0000 7ffb95000640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffb6c06a060 0x7ffb6c06c520 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7ffb800011f0 tx=0x7ffb80009040 comp rx=0 tx=0).stop 2024-05-30T06:59:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.142+0000 7ffb95000640 1 -- 172.21.15.37:0/2316291659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9006ea60 msgr2=0x7ffb90160330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.142+0000 7ffb95000640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9006ea60 0x7ffb90160330 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009f00 tx=0x7ffb8800c490 comp rx=0 tx=0).stop 2024-05-30T06:59:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.142+0000 7ffb95000640 1 -- 172.21.15.37:0/2316291659 shutdown_connections 2024-05-30T06:59:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.142+0000 7ffb95000640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb9006ea60 0x7ffb90160330 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.142+0000 7ffb95000640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb90155da0 0x7ffb9014e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.142+0000 7ffb95000640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ffb6c06a060 0x7ffb6c06c520 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.142+0000 7ffb95000640 1 --2- 172.21.15.37:0/2316291659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb9006f5a0 0x7ffb90162cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.142+0000 7ffb95000640 1 -- 172.21.15.37:0/2316291659 >> 172.21.15.37:0/2316291659 conn(0x7ffb9006bf60 msgr2=0x7ffb90074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:17.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.142+0000 7ffb95000640 1 -- 172.21.15.37:0/2316291659 shutdown_connections 2024-05-30T06:59:17.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.142+0000 7ffb95000640 1 -- 172.21.15.37:0/2316291659 wait complete. 2024-05-30T06:59:17.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv1 --mode=777 2024-05-30T06:59:17.167 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:17.166+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:17.167 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:17.166+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:17.167 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:17.166+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:17.167 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:17.166+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:17.167 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:17.166+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:17.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f8096000640 1 Processor -- start 2024-05-30T06:59:17.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f8096000640 1 -- start start 2024-05-30T06:59:17.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f8096000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f809015eac0 0x7f809015eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f8096000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f80900731d0 0x7f8090072370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f8096000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80900728b0 0x7f8090162610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f8096000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f809015ffc0 con 0x7f809015eac0 2024-05-30T06:59:17.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f8096000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f809015f720 con 0x7f80900731d0 2024-05-30T06:59:17.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f8096000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f809015fa00 con 0x7f80900728b0 2024-05-30T06:59:17.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f808f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f809015eac0 0x7f809015eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:17.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f808f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f809015eac0 0x7f809015eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48470/0 (socket says 172.21.15.37:48470) 2024-05-30T06:59:17.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f808f400640 1 -- 172.21.15.37:0/1277664829 learned_addr learned my addr 172.21.15.37:0/1277664829 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:17.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f8086a00640 1 --2- 172.21.15.37:0/1277664829 >> v2:172.21.15.105:3300/0 conn(0x7f80900731d0 0x7f8090072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:17.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f808fe00640 1 --2- 172.21.15.37:0/1277664829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80900728b0 0x7f8090162610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:17.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f808f400640 1 -- 172.21.15.37:0/1277664829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80900728b0 msgr2=0x7f8090162610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:17.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f808f400640 1 --2- 172.21.15.37:0/1277664829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80900728b0 0x7f8090162610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f808f400640 1 -- 172.21.15.37:0/1277664829 >> v2:172.21.15.105:3300/0 conn(0x7f80900731d0 msgr2=0x7f8090072370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:17.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f808f400640 1 --2- 172.21.15.37:0/1277664829 >> v2:172.21.15.105:3300/0 conn(0x7f80900731d0 0x7f8090072370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f808f400640 1 -- 172.21.15.37:0/1277664829 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809015fce0 con 0x7f809015eac0 2024-05-30T06:59:17.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.310+0000 7f808fe00640 1 --2- 172.21.15.37:0/1277664829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80900728b0 0x7f8090162610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:59:17.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.314+0000 7f808f400640 1 --2- 172.21.15.37:0/1277664829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f809015eac0 0x7f809015eea0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f80900b56c0 tx=0x7f808001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2914c1cb7f63fdd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:17.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.314+0000 7f808ea00640 1 -- 172.21.15.37:0/1277664829 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80800b0070 con 0x7f809015eac0 2024-05-30T06:59:17.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.314+0000 7f808ea00640 1 -- 172.21.15.37:0/1277664829 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80800ab600 con 0x7f809015eac0 2024-05-30T06:59:17.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.314+0000 7f808ea00640 1 -- 172.21.15.37:0/1277664829 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80800ab9d0 con 0x7f809015eac0 2024-05-30T06:59:17.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.314+0000 7f8096000640 1 -- 172.21.15.37:0/1277664829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f809015eac0 msgr2=0x7f809015eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.314+0000 7f8096000640 1 --2- 172.21.15.37:0/1277664829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f809015eac0 0x7f809015eea0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f80900b56c0 tx=0x7f808001c260 comp rx=0 tx=0).stop 2024-05-30T06:59:17.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.314+0000 7f8096000640 1 -- 172.21.15.37:0/1277664829 shutdown_connections 2024-05-30T06:59:17.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.314+0000 7f8096000640 1 --2- 172.21.15.37:0/1277664829 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80900728b0 0x7f8090162610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.314+0000 7f8096000640 1 --2- 172.21.15.37:0/1277664829 >> v2:172.21.15.105:3300/0 conn(0x7f80900731d0 0x7f8090072370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.314+0000 7f8096000640 1 --2- 172.21.15.37:0/1277664829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f809015eac0 0x7f809015eea0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.314+0000 7f8096000640 1 -- 172.21.15.37:0/1277664829 >> 172.21.15.37:0/1277664829 conn(0x7f80900d09a0 msgr2=0x7f80900d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:17.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.314+0000 7f8096000640 1 -- 172.21.15.37:0/1277664829 shutdown_connections 2024-05-30T06:59:17.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.314+0000 7f8096000640 1 -- 172.21.15.37:0/1277664829 wait complete. 2024-05-30T06:59:17.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8096000640 1 Processor -- start 2024-05-30T06:59:17.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8096000640 1 -- start start 2024-05-30T06:59:17.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8096000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80900728b0 0x7f8090148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8096000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80900731d0 0x7f80900cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8096000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f809015eac0 0x7f80901531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8096000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f809006ec10 con 0x7f80900731d0 2024-05-30T06:59:17.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8096000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f809006ea90 con 0x7f80900728b0 2024-05-30T06:59:17.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8096000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f809006ed90 con 0x7f809015eac0 2024-05-30T06:59:17.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8086a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80900731d0 0x7f80900cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8086a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80900731d0 0x7f80900cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48474/0 (socket says 172.21.15.37:48474) 2024-05-30T06:59:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8086a00640 1 -- 172.21.15.37:0/515772112 learned_addr learned my addr 172.21.15.37:0/515772112 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f808f400640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80900728b0 0x7f8090148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f808fe00640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f809015eac0 0x7f80901531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8086a00640 1 -- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f809015eac0 msgr2=0x7f80901531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8086a00640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f809015eac0 0x7f80901531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8086a00640 1 -- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80900728b0 msgr2=0x7f8090148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8086a00640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80900728b0 0x7f8090148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8086a00640 1 -- 172.21.15.37:0/515772112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80900cd5b0 con 0x7f80900731d0 2024-05-30T06:59:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f808fe00640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f809015eac0 0x7f80901531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8086a00640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80900731d0 0x7f80900cef60 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f807800d800 tx=0x7f807800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8087e00640 1 -- 172.21.15.37:0/515772112 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807800b6c0 con 0x7f80900731d0 2024-05-30T06:59:17.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8087e00640 1 -- 172.21.15.37:0/515772112 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8078019070 con 0x7f80900731d0 2024-05-30T06:59:17.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8087e00640 1 -- 172.21.15.37:0/515772112 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807800ba60 con 0x7f80900731d0 2024-05-30T06:59:17.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8096000640 1 -- 172.21.15.37:0/515772112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80900cd890 con 0x7f80900731d0 2024-05-30T06:59:17.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8096000640 1 -- 172.21.15.37:0/515772112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80900cde50 con 0x7f80900731d0 2024-05-30T06:59:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.318+0000 7f8096000640 1 -- 172.21.15.37:0/515772112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8090068d40 con 0x7f80900731d0 2024-05-30T06:59:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.322+0000 7f8087e00640 1 -- 172.21.15.37:0/515772112 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f807800bc00 con 0x7f80900731d0 2024-05-30T06:59:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.322+0000 7f8087e00640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f806c06a030 0x7f806c06c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.322+0000 7f8087e00640 1 -- 172.21.15.37:0/515772112 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7f8078085d80 con 0x7f80900731d0 2024-05-30T06:59:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.322+0000 7f808f400640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f806c06a030 0x7f806c06c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:17.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.322+0000 7f808f400640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f806c06a030 0x7f806c06c4f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f80800ad000 tx=0x7f8080008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.326+0000 7f8087e00640 1 -- 172.21.15.37:0/515772112 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8078057da0 con 0x7f80900731d0 2024-05-30T06:59:17.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.514+0000 7f8096000640 1 -- 172.21.15.37:0/515772112 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv1", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f80900d1550 con 0x7f806c06a030 2024-05-30T06:59:17.526 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:17.526+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:17.526 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:17.526+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:17.526 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:17.526+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:17.526 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:17.526+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:17.527 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:17.526+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:17.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.558+0000 7f8087e00640 1 -- 172.21.15.37:0/515772112 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f80900d1550 con 0x7f806c06a030 2024-05-30T06:59:17.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.562+0000 7f8096000640 1 -- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f806c06a030 msgr2=0x7f806c06c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.562+0000 7f8096000640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f806c06a030 0x7f806c06c4f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f80800ad000 tx=0x7f8080008040 comp rx=0 tx=0).stop 2024-05-30T06:59:17.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.562+0000 7f8096000640 1 -- 172.21.15.37:0/515772112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80900731d0 msgr2=0x7f80900cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.562+0000 7f8096000640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80900731d0 0x7f80900cef60 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f807800d800 tx=0x7f807800dcc0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.562+0000 7f8096000640 1 -- 172.21.15.37:0/515772112 shutdown_connections 2024-05-30T06:59:17.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.562+0000 7f8096000640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f809015eac0 0x7f80901531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.562+0000 7f8096000640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80900731d0 0x7f80900cef60 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.562+0000 7f8096000640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f806c06a030 0x7f806c06c4f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.562+0000 7f8096000640 1 --2- 172.21.15.37:0/515772112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80900728b0 0x7f8090148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.562+0000 7f8096000640 1 -- 172.21.15.37:0/515772112 >> 172.21.15.37:0/515772112 conn(0x7f80900d09a0 msgr2=0x7f8090154650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:17.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.562+0000 7f8096000640 1 -- 172.21.15.37:0/515772112 shutdown_connections 2024-05-30T06:59:17.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.562+0000 7f8096000640 1 -- 172.21.15.37:0/515772112 wait complete. 2024-05-30T06:59:17.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:59:17.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efc01400640 1 Processor -- start 2024-05-30T06:59:17.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efc01400640 1 -- start start 2024-05-30T06:59:17.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efc01400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efbfc0cd440 0x7efbfc06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efc01400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbfc15f310 con 0x7efbfc06f5a0 2024-05-30T06:59:17.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efc01400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbfc15f5f0 con 0x7efbfc155da0 2024-05-30T06:59:17.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efc01400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efbfc15f8d0 con 0x7efbfc0cd440 2024-05-30T06:59:17.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbfb200640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efbfc06f5a0 0x7efbfc0b3750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52814/0 (socket says 172.21.15.37:52814) 2024-05-30T06:59:17.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbfb200640 1 -- 172.21.15.37:0/863632013 learned_addr learned my addr 172.21.15.37:0/863632013 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:17.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf1e00640 1 --2- 172.21.15.37:0/863632013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efbfc0cd440 0x7efbfc06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2522534013 0 0) 0x7efbfc15f310 con 0x7efbfc06f5a0 2024-05-30T06:59:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbe0005740 con 0x7efbfc06f5a0 2024-05-30T06:59:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530777300 0 0) 0x7efbfc15f5f0 con 0x7efbfc155da0 2024-05-30T06:59:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbfc15f310 con 0x7efbfc155da0 2024-05-30T06:59:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3646968875 0 0) 0x7efbe0005740 con 0x7efbfc06f5a0 2024-05-30T06:59:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efbfc0cd440 msgr2=0x7efbfc06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 --2- 172.21.15.37:0/863632013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efbfc0cd440 0x7efbfc06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 >> v1:172.21.15.105:6789/0 conn(0x7efbfc155da0 legacy=0x7efbfc0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc15fbb0 con 0x7efbfc06f5a0 2024-05-30T06:59:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7efbf4001a00 con 0x7efbfc06f5a0 2024-05-30T06:59:17.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 >> v1:172.21.15.37:6789/0 conn(0x7efbfc06f5a0 legacy=0x7efbfc0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 --2- 172.21.15.37:0/863632013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efbe0005d90 0x7efbe0006170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 --2- 172.21.15.37:0/863632013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbe0006a20 0x7efbe0006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 --2- 172.21.15.37:0/863632013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbe00073e0 0x7efbe000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc15f8d0 con 0x7efbe00073e0 2024-05-30T06:59:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efbe000e200 con 0x7efbe0006a20 2024-05-30T06:59:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efbe000e400 con 0x7efbe0005d90 2024-05-30T06:59:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbfb200640 1 --2- 172.21.15.37:0/863632013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbe00073e0 0x7efbe000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbfa800640 1 --2- 172.21.15.37:0/863632013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efbe0005d90 0x7efbe0006170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbf1e00640 1 --2- 172.21.15.37:0/863632013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbe0006a20 0x7efbe0006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbfb200640 1 -- 172.21.15.37:0/863632013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efbe0005d90 msgr2=0x7efbe0006170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbfb200640 1 --2- 172.21.15.37:0/863632013 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efbe0005d90 0x7efbe0006170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbfb200640 1 -- 172.21.15.37:0/863632013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbe0006a20 msgr2=0x7efbe0006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:17.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbfb200640 1 --2- 172.21.15.37:0/863632013 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbe0006a20 0x7efbe0006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.726+0000 7efbfb200640 1 -- 172.21.15.37:0/863632013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbe0005740 con 0x7efbe00073e0 2024-05-30T06:59:17.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.730+0000 7efbfb200640 1 --2- 172.21.15.37:0/863632013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbe00073e0 0x7efbe000dbe0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7efbf400a7f0 tx=0x7efbf401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d083b4c9ad2475 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:17.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.730+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf400a410 con 0x7efbe00073e0 2024-05-30T06:59:17.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.730+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf40ad630 con 0x7efbe00073e0 2024-05-30T06:59:17.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.730+0000 7efbf9e00640 1 -- 172.21.15.37:0/863632013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf40ada60 con 0x7efbe00073e0 2024-05-30T06:59:17.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.730+0000 7efc01400640 1 -- 172.21.15.37:0/863632013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbe00073e0 msgr2=0x7efbe000dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.730+0000 7efc01400640 1 --2- 172.21.15.37:0/863632013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbe00073e0 0x7efbe000dbe0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7efbf400a7f0 tx=0x7efbf401d300 comp rx=0 tx=0).stop 2024-05-30T06:59:17.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.730+0000 7efbfb200640 1 -- 172.21.15.37:0/863632013 reap_dead start 2024-05-30T06:59:17.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.730+0000 7efc01400640 1 -- 172.21.15.37:0/863632013 shutdown_connections 2024-05-30T06:59:17.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.730+0000 7efc01400640 1 -- 172.21.15.37:0/863632013 >> 172.21.15.37:0/863632013 conn(0x7efbfc06bf60 msgr2=0x7efbfc0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:17.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.730+0000 7efc01400640 1 -- 172.21.15.37:0/863632013 shutdown_connections 2024-05-30T06:59:17.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.730+0000 7efc01400640 1 -- 172.21.15.37:0/863632013 wait complete. 2024-05-30T06:59:17.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efc01400640 1 Processor -- start 2024-05-30T06:59:17.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efc01400640 1 -- start start 2024-05-30T06:59:17.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efc01400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbe00073e0 0x7efbfc142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efc01400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbfc145aa0 0x7efbfc0c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efc01400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efbfc0cc730 0x7efbfc151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efc01400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc06e970 con 0x7efbe00073e0 2024-05-30T06:59:17.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efc01400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc06fa10 con 0x7efbfc145aa0 2024-05-30T06:59:17.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efc01400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efbfc06eaf0 con 0x7efbfc0cc730 2024-05-30T06:59:17.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efbfa800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbe00073e0 0x7efbfc142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:17.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efbfa800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbe00073e0 0x7efbfc142570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59596/0 (socket says 172.21.15.37:59596) 2024-05-30T06:59:17.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efbfa800640 1 -- 172.21.15.37:0/373649615 learned_addr learned my addr 172.21.15.37:0/373649615 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:17.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efbfa800640 1 -- 172.21.15.37:0/373649615 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efbfc0cc730 msgr2=0x7efbfc151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efbfa800640 1 --2- 172.21.15.37:0/373649615 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efbfc0cc730 0x7efbfc151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efbfa800640 1 -- 172.21.15.37:0/373649615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbfc145aa0 msgr2=0x7efbfc0c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efbfa800640 1 --2- 172.21.15.37:0/373649615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbfc145aa0 0x7efbfc0c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efbfa800640 1 -- 172.21.15.37:0/373649615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc142ab0 con 0x7efbe00073e0 2024-05-30T06:59:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efbfa800640 1 --2- 172.21.15.37:0/373649615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbe00073e0 0x7efbfc142570 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7efbec00f7a0 tx=0x7efbec00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efbf3400640 1 -- 172.21.15.37:0/373649615 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec00fe50 con 0x7efbe00073e0 2024-05-30T06:59:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efbf3400640 1 -- 172.21.15.37:0/373649615 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbec018070 con 0x7efbe00073e0 2024-05-30T06:59:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efc01400640 1 -- 172.21.15.37:0/373649615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbfc0cb690 con 0x7efbe00073e0 2024-05-30T06:59:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efbf3400640 1 -- 172.21.15.37:0/373649615 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec00d6b0 con 0x7efbe00073e0 2024-05-30T06:59:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efc01400640 1 -- 172.21.15.37:0/373649615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbfc0cbc50 con 0x7efbe00073e0 2024-05-30T06:59:17.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.734+0000 7efc01400640 1 -- 172.21.15.37:0/373649615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbfc068bc0 con 0x7efbe00073e0 2024-05-30T06:59:17.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.738+0000 7efbf3400640 1 -- 172.21.15.37:0/373649615 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7efbec00d850 con 0x7efbe00073e0 2024-05-30T06:59:17.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.738+0000 7efbf3400640 1 --2- 172.21.15.37:0/373649615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efbd806a060 0x7efbd806c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.738+0000 7efbf3400640 1 -- 172.21.15.37:0/373649615 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7efbec085850 con 0x7efbe00073e0 2024-05-30T06:59:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.738+0000 7efbf1e00640 1 --2- 172.21.15.37:0/373649615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efbd806a060 0x7efbd806c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.738+0000 7efbf1e00640 1 --2- 172.21.15.37:0/373649615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efbd806a060 0x7efbd806c520 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efbfc1fad60 tx=0x7efbe40095f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:17.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.742+0000 7efbf3400640 1 -- 172.21.15.37:0/373649615 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efbec057870 con 0x7efbe00073e0 2024-05-30T06:59:17.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.938+0000 7efc01400640 1 -- 172.21.15.37:0/373649615 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7efbfc0b6790 con 0x7efbd806a060 2024-05-30T06:59:17.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.942+0000 7efbf3400640 1 -- 172.21.15.37:0/373649615 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7efbfc0b6790 con 0x7efbd806a060 2024-05-30T06:59:17.944 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a 2024-05-30T06:59:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.946+0000 7efc01400640 1 -- 172.21.15.37:0/373649615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efbd806a060 msgr2=0x7efbd806c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.946+0000 7efc01400640 1 --2- 172.21.15.37:0/373649615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efbd806a060 0x7efbd806c520 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7efbfc1fad60 tx=0x7efbe40095f0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.946+0000 7efc01400640 1 -- 172.21.15.37:0/373649615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbe00073e0 msgr2=0x7efbfc142570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.946+0000 7efc01400640 1 --2- 172.21.15.37:0/373649615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbe00073e0 0x7efbfc142570 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7efbec00f7a0 tx=0x7efbec00fc60 comp rx=0 tx=0).stop 2024-05-30T06:59:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.946+0000 7efc01400640 1 -- 172.21.15.37:0/373649615 shutdown_connections 2024-05-30T06:59:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.946+0000 7efc01400640 1 --2- 172.21.15.37:0/373649615 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efbfc0cc730 0x7efbfc151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.946+0000 7efc01400640 1 --2- 172.21.15.37:0/373649615 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efbd806a060 0x7efbd806c520 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.946+0000 7efc01400640 1 --2- 172.21.15.37:0/373649615 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efbfc145aa0 0x7efbfc0c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.946+0000 7efc01400640 1 --2- 172.21.15.37:0/373649615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbe00073e0 0x7efbfc142570 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:17.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.946+0000 7efc01400640 1 -- 172.21.15.37:0/373649615 >> 172.21.15.37:0/373649615 conn(0x7efbfc06bf60 msgr2=0x7efbfc159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:17.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.946+0000 7efc01400640 1 -- 172.21.15.37:0/373649615 shutdown_connections 2024-05-30T06:59:17.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:17.946+0000 7efc01400640 1 -- 172.21.15.37:0/373649615 wait complete. 2024-05-30T06:59:17.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:59:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.106+0000 7f5933c00640 1 Processor -- start 2024-05-30T06:59:18.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.106+0000 7f5933c00640 1 -- start start 2024-05-30T06:59:18.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5933c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f592c155da0 0x7f592c0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:18.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5933c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f592c0cd440 0x7f592c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:18.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5933c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f592c06f5a0 0x7f592c0cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:18.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5933c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f592c15f310 con 0x7f592c06f5a0 2024-05-30T06:59:18.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5933c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f592c15f5f0 con 0x7f592c0cd440 2024-05-30T06:59:18.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5933c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f592c15f8d0 con 0x7f592c155da0 2024-05-30T06:59:18.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5931c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f592c06f5a0 0x7f592c0cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5931c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f592c06f5a0 0x7f592c0cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59598/0 (socket says 172.21.15.37:59598) 2024-05-30T06:59:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5931c00640 1 -- 172.21.15.37:0/2873246791 learned_addr learned my addr 172.21.15.37:0/2873246791 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5931200640 1 --2- 172.21.15.37:0/2873246791 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f592c155da0 0x7f592c0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5923e00640 1 --2- 172.21.15.37:0/2873246791 >> v2:172.21.15.105:3300/0 conn(0x7f592c0cd440 0x7f592c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5931c00640 1 -- 172.21.15.37:0/2873246791 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f592c155da0 msgr2=0x7f592c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5931c00640 1 --2- 172.21.15.37:0/2873246791 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f592c155da0 0x7f592c0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5931c00640 1 -- 172.21.15.37:0/2873246791 >> v2:172.21.15.105:3300/0 conn(0x7f592c0cd440 msgr2=0x7f592c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5931c00640 1 --2- 172.21.15.37:0/2873246791 >> v2:172.21.15.105:3300/0 conn(0x7f592c0cd440 0x7f592c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.110+0000 7f5931c00640 1 -- 172.21.15.37:0/2873246791 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592c15fbb0 con 0x7f592c06f5a0 2024-05-30T06:59:18.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f5931c00640 1 --2- 172.21.15.37:0/2873246791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592c06f5a0 0x7f592c0cf4e0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f592c06c610 tx=0x7f592401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c0f8c24116854f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:18.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f592be00640 1 -- 172.21.15.37:0/2873246791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59240a5550 con 0x7f592c06f5a0 2024-05-30T06:59:18.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f592be00640 1 -- 172.21.15.37:0/2873246791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59240a56f0 con 0x7f592c06f5a0 2024-05-30T06:59:18.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f592be00640 1 -- 172.21.15.37:0/2873246791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59240a5ac0 con 0x7f592c06f5a0 2024-05-30T06:59:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f5933c00640 1 -- 172.21.15.37:0/2873246791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592c06f5a0 msgr2=0x7f592c0cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f5933c00640 1 --2- 172.21.15.37:0/2873246791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592c06f5a0 0x7f592c0cf4e0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f592c06c610 tx=0x7f592401c8d0 comp rx=0 tx=0).stop 2024-05-30T06:59:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f5933c00640 1 -- 172.21.15.37:0/2873246791 shutdown_connections 2024-05-30T06:59:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f5933c00640 1 --2- 172.21.15.37:0/2873246791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592c06f5a0 0x7f592c0cf4e0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f5933c00640 1 --2- 172.21.15.37:0/2873246791 >> v2:172.21.15.105:3300/0 conn(0x7f592c0cd440 0x7f592c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f5933c00640 1 --2- 172.21.15.37:0/2873246791 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f592c155da0 0x7f592c0cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f5933c00640 1 -- 172.21.15.37:0/2873246791 >> 172.21.15.37:0/2873246791 conn(0x7f592c06bf60 msgr2=0x7f592c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f5933c00640 1 -- 172.21.15.37:0/2873246791 shutdown_connections 2024-05-30T06:59:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f5933c00640 1 -- 172.21.15.37:0/2873246791 wait complete. 2024-05-30T06:59:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f5933c00640 1 Processor -- start 2024-05-30T06:59:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.114+0000 7f5933c00640 1 -- start start 2024-05-30T06:59:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5933c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f592c06f5a0 0x7f592c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5933c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f592c155da0 0x7f592c14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5933c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592c15cd20 0x7f592c1657c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5933c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f592c0b3ae0 con 0x7f592c15cd20 2024-05-30T06:59:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5933c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f592c0b3960 con 0x7f592c06f5a0 2024-05-30T06:59:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5933c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f592c0b3c60 con 0x7f592c155da0 2024-05-30T06:59:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5931c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592c15cd20 0x7f592c1657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5931c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592c15cd20 0x7f592c1657c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59602/0 (socket says 172.21.15.37:59602) 2024-05-30T06:59:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5931c00640 1 -- 172.21.15.37:0/3706059340 learned_addr learned my addr 172.21.15.37:0/3706059340 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5923e00640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f592c155da0 0x7f592c14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5931200640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f592c06f5a0 0x7f592c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:18.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5931c00640 1 -- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f592c155da0 msgr2=0x7f592c14d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:18.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5931c00640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f592c155da0 0x7f592c14d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:18.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5931c00640 1 -- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f592c06f5a0 msgr2=0x7f592c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:18.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5931c00640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f592c06f5a0 0x7f592c15dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:18.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5931c00640 1 -- 172.21.15.37:0/3706059340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592c15e4d0 con 0x7f592c15cd20 2024-05-30T06:59:18.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5923e00640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f592c155da0 0x7f592c14d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:18.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5931c00640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592c15cd20 0x7f592c1657c0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f59240af040 tx=0x7f5924019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:18.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5929600640 1 -- 172.21.15.37:0/3706059340 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59240bc020 con 0x7f592c15cd20 2024-05-30T06:59:18.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5929600640 1 -- 172.21.15.37:0/3706059340 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59240b8670 con 0x7f592c15cd20 2024-05-30T06:59:18.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5929600640 1 -- 172.21.15.37:0/3706059340 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5924009510 con 0x7f592c15cd20 2024-05-30T06:59:18.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5933c00640 1 -- 172.21.15.37:0/3706059340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592c15e7b0 con 0x7f592c15cd20 2024-05-30T06:59:18.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5933c00640 1 -- 172.21.15.37:0/3706059340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f592c15e0e0 con 0x7f592c15cd20 2024-05-30T06:59:18.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.118+0000 7f5933c00640 1 -- 172.21.15.37:0/3706059340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f592c068bc0 con 0x7f592c15cd20 2024-05-30T06:59:18.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.122+0000 7f5929600640 1 -- 172.21.15.37:0/3706059340 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) ==== 90588+0+0 (secure 0 0 0) 0x7f59240bf020 con 0x7f592c15cd20 2024-05-30T06:59:18.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.122+0000 7f5929600640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f590806a060 0x7f590806c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:18.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.122+0000 7f5929600640 1 -- 172.21.15.37:0/3706059340 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7f5924120470 con 0x7f592c15cd20 2024-05-30T06:59:18.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.122+0000 7f5931200640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f590806a060 0x7f590806c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:18.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.122+0000 7f5931200640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f590806a060 0x7f590806c520 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f591c0079c0 tx=0x7f591c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:18.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.126+0000 7f5929600640 1 -- 172.21.15.37:0/3706059340 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f59240c6070 con 0x7f592c15cd20 2024-05-30T06:59:18.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.318+0000 7f5933c00640 1 -- 172.21.15.37:0/3706059340 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f592c072460 con 0x7f590806a060 2024-05-30T06:59:18.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.322+0000 7f5929600640 1 -- 172.21.15.37:0/3706059340 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f592c072460 con 0x7f590806a060 2024-05-30T06:59:18.325 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a 2024-05-30T06:59:18.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.326+0000 7f5933c00640 1 -- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f590806a060 msgr2=0x7f590806c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:18.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.326+0000 7f5933c00640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f590806a060 0x7f590806c520 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f591c0079c0 tx=0x7f591c008040 comp rx=0 tx=0).stop 2024-05-30T06:59:18.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.326+0000 7f5933c00640 1 -- 172.21.15.37:0/3706059340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592c15cd20 msgr2=0x7f592c1657c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:18.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.326+0000 7f5933c00640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592c15cd20 0x7f592c1657c0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f59240af040 tx=0x7f5924019670 comp rx=0 tx=0).stop 2024-05-30T06:59:18.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.326+0000 7f5933c00640 1 -- 172.21.15.37:0/3706059340 shutdown_connections 2024-05-30T06:59:18.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.326+0000 7f5933c00640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592c15cd20 0x7f592c1657c0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:18.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.326+0000 7f5933c00640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f592c155da0 0x7f592c14d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:18.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.326+0000 7f5933c00640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f590806a060 0x7f590806c520 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:18.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.326+0000 7f5933c00640 1 --2- 172.21.15.37:0/3706059340 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f592c06f5a0 0x7f592c15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:18.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.326+0000 7f5933c00640 1 -- 172.21.15.37:0/3706059340 >> 172.21.15.37:0/3706059340 conn(0x7f592c06bf60 msgr2=0x7f592c0affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:18.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.326+0000 7f5933c00640 1 -- 172.21.15.37:0/3706059340 shutdown_connections 2024-05-30T06:59:18.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:18.326+0000 7f5933c00640 1 -- 172.21.15.37:0/3706059340 wait complete. 2024-05-30T06:59:18.346 DEBUG:tasks.cephfs.test_volumes:filling subvolume sv1 with 3 files each 1024MB size under directory volumes/_nogroup/sv1/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a 2024-05-30T06:59:18.347 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:59:18.347 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:59:18.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:59:18.357 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a/subvolume_file.0 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:59:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:59:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:59:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.46427 s, 127 MB/s 2024-05-30T06:59:26.887 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:59:26.887 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:59:26.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:59:26.896 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a/subvolume_file.1 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:59:35.338 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:59:35.338 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:59:35.338 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.39157 s, 128 MB/s 2024-05-30T06:59:35.339 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T06:59:35.339 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T06:59:35.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:59:35.349 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/sv1/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a/subvolume_file.2 bs=1M conv=fdatasync count=1024 seek=0) 2024-05-30T06:59:36.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:59:36.003 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T06:59:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records in 2024-05-30T06:59:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:1024+0 records out 2024-05-30T06:59:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.39705 s, 128 MB/s 2024-05-30T06:59:43.801 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs sv1 ss1 2024-05-30T06:59:43.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.946+0000 7f70d7400640 1 Processor -- start 2024-05-30T06:59:43.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.946+0000 7f70d7400640 1 -- start start 2024-05-30T06:59:43.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.946+0000 7f70d7400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f70d01590c0 0x7f70d00cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:43.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.946+0000 7f70d7400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70d00cd400 0x7f70d00b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:43.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.946+0000 7f70d7400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70d015f230 con 0x7f70d00cde60 2024-05-30T06:59:43.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.946+0000 7f70d7400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f70d015f510 con 0x7f70d00cd400 2024-05-30T06:59:43.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.946+0000 7f70d7400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f70d015f7f0 con 0x7f70d01590c0 2024-05-30T06:59:43.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.950+0000 7f70d5400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70d00cd400 0x7f70d00b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:43.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.950+0000 7f70d5400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70d00cd400 0x7f70d00b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47938/0 (socket says 172.21.15.37:47938) 2024-05-30T06:59:43.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.950+0000 7f70d5400640 1 -- 172.21.15.37:0/3820186928 learned_addr learned my addr 172.21.15.37:0/3820186928 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:43.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.950+0000 7f70d4a00640 1 --2- 172.21.15.37:0/3820186928 >> v2:172.21.15.105:3300/0 conn(0x7f70d01590c0 0x7f70d00cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:43.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.950+0000 7f70d5400640 1 -- 172.21.15.37:0/3820186928 >> v2:172.21.15.105:3300/0 conn(0x7f70d01590c0 msgr2=0x7f70d00cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:43.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.950+0000 7f70d5400640 1 --2- 172.21.15.37:0/3820186928 >> v2:172.21.15.105:3300/0 conn(0x7f70d01590c0 0x7f70d00cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:43.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.950+0000 7f70d5400640 1 -- 172.21.15.37:0/3820186928 >> v1:172.21.15.105:6789/0 conn(0x7f70d00cde60 legacy=0x7f70d006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:43.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.950+0000 7f70d5400640 1 -- 172.21.15.37:0/3820186928 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d015fad0 con 0x7f70d00cd400 2024-05-30T06:59:43.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.950+0000 7f70d5400640 1 --2- 172.21.15.37:0/3820186928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70d00cd400 0x7f70d00b3750 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f70d006fbb0 tx=0x7f70c801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cd573116fbab57 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:43.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.950+0000 7f70cfe00640 1 -- 172.21.15.37:0/3820186928 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c80a5590 con 0x7f70d00cd400 2024-05-30T06:59:43.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.950+0000 7f70cfe00640 1 -- 172.21.15.37:0/3820186928 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c80a5730 con 0x7f70d00cd400 2024-05-30T06:59:43.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.950+0000 7f70cfe00640 1 -- 172.21.15.37:0/3820186928 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c80a5b00 con 0x7f70d00cd400 2024-05-30T06:59:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 -- 172.21.15.37:0/3820186928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70d00cd400 msgr2=0x7f70d00b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 --2- 172.21.15.37:0/3820186928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70d00cd400 0x7f70d00b3750 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f70d006fbb0 tx=0x7f70c801c8d0 comp rx=0 tx=0).stop 2024-05-30T06:59:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 -- 172.21.15.37:0/3820186928 shutdown_connections 2024-05-30T06:59:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 --2- 172.21.15.37:0/3820186928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70d00cd400 0x7f70d00b3750 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:43.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 --2- 172.21.15.37:0/3820186928 >> v2:172.21.15.105:3300/0 conn(0x7f70d01590c0 0x7f70d00cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 -- 172.21.15.37:0/3820186928 >> 172.21.15.37:0/3820186928 conn(0x7f70d006bf60 msgr2=0x7f70d00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 -- 172.21.15.37:0/3820186928 shutdown_connections 2024-05-30T06:59:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 -- 172.21.15.37:0/3820186928 wait complete. 2024-05-30T06:59:43.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 Processor -- start 2024-05-30T06:59:43.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 -- start start 2024-05-30T06:59:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70d00cd400 0x7f70d014bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70d00cde60 0x7f70d0149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:43.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70d01590c0 0x7f70d014d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70d006f8f0 con 0x7f70d00cd400 2024-05-30T06:59:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f70d006f770 con 0x7f70d00cde60 2024-05-30T06:59:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d7400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f70d01684a0 con 0x7f70d01590c0 2024-05-30T06:59:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70d00cd400 0x7f70d014bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70d00cd400 0x7f70d014bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47946/0 (socket says 172.21.15.37:47946) 2024-05-30T06:59:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d4a00640 1 -- 172.21.15.37:0/569159744 learned_addr learned my addr 172.21.15.37:0/569159744 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70c7e00640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70d00cde60 0x7f70d0149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d5400640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70d01590c0 0x7f70d014d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d4a00640 1 -- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70d01590c0 msgr2=0x7f70d014d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d4a00640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70d01590c0 0x7f70d014d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d4a00640 1 -- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70d00cde60 msgr2=0x7f70d0149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d4a00640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70d00cde60 0x7f70d0149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:43.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d4a00640 1 -- 172.21.15.37:0/569159744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d014c4a0 con 0x7f70d00cd400 2024-05-30T06:59:43.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.954+0000 7f70d4a00640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70d00cd400 0x7f70d014bec0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f70c000e8a0 tx=0x7f70c000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:43.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.958+0000 7f70cd600640 1 -- 172.21.15.37:0/569159744 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c0017070 con 0x7f70d00cd400 2024-05-30T06:59:43.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.958+0000 7f70cd600640 1 -- 172.21.15.37:0/569159744 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70c000c940 con 0x7f70d00cd400 2024-05-30T06:59:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.958+0000 7f70cd600640 1 -- 172.21.15.37:0/569159744 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70c000ccf0 con 0x7f70d00cd400 2024-05-30T06:59:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.958+0000 7f70d7400640 1 -- 172.21.15.37:0/569159744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d014c780 con 0x7f70d00cd400 2024-05-30T06:59:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.958+0000 7f70d7400640 1 -- 172.21.15.37:0/569159744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d014cd40 con 0x7f70d00cd400 2024-05-30T06:59:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.958+0000 7f70d7400640 1 -- 172.21.15.37:0/569159744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d0068d40 con 0x7f70d00cd400 2024-05-30T06:59:43.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.958+0000 7f70cd600640 1 -- 172.21.15.37:0/569159744 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 45) ==== 90690+0+0 (secure 0 0 0) 0x7f70c001a070 con 0x7f70d00cd400 2024-05-30T06:59:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.958+0000 7f70cd600640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac06a150 0x7f70ac06c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.958+0000 7f70cd600640 1 -- 172.21.15.37:0/569159744 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7f70c0085bb0 con 0x7f70d00cd400 2024-05-30T06:59:43.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.958+0000 7f70c7e00640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac06a150 0x7f70ac06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:43.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.962+0000 7f70c7e00640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac06a150 0x7f70ac06c610 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f70d0166160 tx=0x7f70b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:43.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:43.962+0000 7f70cd600640 1 -- 172.21.15.37:0/569159744 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f70c0057580 con 0x7f70d00cd400 2024-05-30T06:59:44.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.158+0000 7f70d7400640 1 -- 172.21.15.37:0/569159744 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""]}) -- 0x7f70d00b31b0 con 0x7f70ac06a150 2024-05-30T06:59:44.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.170+0000 7f70cd600640 1 -- 172.21.15.37:0/569159744 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f70d00b31b0 con 0x7f70ac06a150 2024-05-30T06:59:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.170+0000 7f70d7400640 1 -- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac06a150 msgr2=0x7f70ac06c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.170+0000 7f70d7400640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac06a150 0x7f70ac06c610 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f70d0166160 tx=0x7f70b8009040 comp rx=0 tx=0).stop 2024-05-30T06:59:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.170+0000 7f70d7400640 1 -- 172.21.15.37:0/569159744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70d00cd400 msgr2=0x7f70d014bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.170+0000 7f70d7400640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70d00cd400 0x7f70d014bec0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f70c000e8a0 tx=0x7f70c000eca0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.170+0000 7f70d7400640 1 -- 172.21.15.37:0/569159744 shutdown_connections 2024-05-30T06:59:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.170+0000 7f70d7400640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f70d01590c0 0x7f70d014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.170+0000 7f70d7400640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f70ac06a150 0x7f70ac06c610 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.170+0000 7f70d7400640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f70d00cde60 0x7f70d0149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.170+0000 7f70d7400640 1 --2- 172.21.15.37:0/569159744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70d00cd400 0x7f70d014bec0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.170+0000 7f70d7400640 1 -- 172.21.15.37:0/569159744 >> 172.21.15.37:0/569159744 conn(0x7f70d006bf60 msgr2=0x7f70d015dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.170+0000 7f70d7400640 1 -- 172.21.15.37:0/569159744 shutdown_connections 2024-05-30T06:59:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.170+0000 7f70d7400640 1 -- 172.21.15.37:0/569159744 wait complete. 2024-05-30T06:59:44.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv1 2024-05-30T06:59:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.334+0000 7f9322400640 1 Processor -- start 2024-05-30T06:59:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.334+0000 7f9322400640 1 -- start start 2024-05-30T06:59:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.338+0000 7f9322400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f931c0b59d0 0x7f931c0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.338+0000 7f9322400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f931c15d7e0 0x7f931c160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.338+0000 7f9322400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931c0b62f0 con 0x7f931c15d350 2024-05-30T06:59:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.338+0000 7f9322400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f931c142030 con 0x7f931c15d7e0 2024-05-30T06:59:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.338+0000 7f9322400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f931c142310 con 0x7f931c0b59d0 2024-05-30T06:59:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.338+0000 7f931be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f931c15d7e0 0x7f931c160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.338+0000 7f931be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f931c15d7e0 0x7f931c160990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47956/0 (socket says 172.21.15.37:47956) 2024-05-30T06:59:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.338+0000 7f931be00640 1 -- 172.21.15.37:0/2853436514 learned_addr learned my addr 172.21.15.37:0/2853436514 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:44.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.338+0000 7f931b400640 1 --2- 172.21.15.37:0/2853436514 >> v2:172.21.15.105:3300/0 conn(0x7f931c0b59d0 0x7f931c0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:44.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.338+0000 7f931be00640 1 -- 172.21.15.37:0/2853436514 >> v2:172.21.15.105:3300/0 conn(0x7f931c0b59d0 msgr2=0x7f931c0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:44.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.338+0000 7f931be00640 1 --2- 172.21.15.37:0/2853436514 >> v2:172.21.15.105:3300/0 conn(0x7f931c0b59d0 0x7f931c0b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.338+0000 7f931be00640 1 -- 172.21.15.37:0/2853436514 >> v1:172.21.15.105:6789/0 conn(0x7f931c15d350 legacy=0x7f931c160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:44.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.338+0000 7f931be00640 1 -- 172.21.15.37:0/2853436514 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c1425f0 con 0x7f931c15d7e0 2024-05-30T06:59:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f931be00640 1 --2- 172.21.15.37:0/2853436514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f931c15d7e0 0x7f931c160990 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f9314009e50 tx=0x7f931401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5359d2190eafb5f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f931aa00640 1 -- 172.21.15.37:0/2853436514 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93140b4070 con 0x7f931c15d7e0 2024-05-30T06:59:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f931aa00640 1 -- 172.21.15.37:0/2853436514 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93140af400 con 0x7f931c15d7e0 2024-05-30T06:59:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f931aa00640 1 -- 172.21.15.37:0/2853436514 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93140af7d0 con 0x7f931c15d7e0 2024-05-30T06:59:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 -- 172.21.15.37:0/2853436514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f931c15d7e0 msgr2=0x7f931c160990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 --2- 172.21.15.37:0/2853436514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f931c15d7e0 0x7f931c160990 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f9314009e50 tx=0x7f931401f1e0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 -- 172.21.15.37:0/2853436514 shutdown_connections 2024-05-30T06:59:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 --2- 172.21.15.37:0/2853436514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f931c15d7e0 0x7f931c160990 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 --2- 172.21.15.37:0/2853436514 >> v2:172.21.15.105:3300/0 conn(0x7f931c0b59d0 0x7f931c0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 -- 172.21.15.37:0/2853436514 >> 172.21.15.37:0/2853436514 conn(0x7f931c06bf60 msgr2=0x7f931c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 -- 172.21.15.37:0/2853436514 shutdown_connections 2024-05-30T06:59:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 -- 172.21.15.37:0/2853436514 wait complete. 2024-05-30T06:59:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 Processor -- start 2024-05-30T06:59:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 -- start start 2024-05-30T06:59:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f931c0b59d0 0x7f931c0b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f931c15d350 0x7f931c13e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f931c15d7e0 0x7f931c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f931c13fe60 con 0x7f931c15d350 2024-05-30T06:59:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f931c13fce0 con 0x7f931c0b59d0 2024-05-30T06:59:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.342+0000 7f9322400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f931c0aff20 con 0x7f931c15d7e0 2024-05-30T06:59:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9313e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f931c15d350 0x7f931c13e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f931b400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f931c0b59d0 0x7f931c0b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9313e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f931c15d350 0x7f931c13e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47966/0 (socket says 172.21.15.37:47966) 2024-05-30T06:59:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9313e00640 1 -- 172.21.15.37:0/1077223233 learned_addr learned my addr 172.21.15.37:0/1077223233 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f931be00640 1 --2- 172.21.15.37:0/1077223233 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f931c15d7e0 0x7f931c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9313e00640 1 -- 172.21.15.37:0/1077223233 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f931c15d7e0 msgr2=0x7f931c15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9313e00640 1 --2- 172.21.15.37:0/1077223233 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f931c15d7e0 0x7f931c15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9313e00640 1 -- 172.21.15.37:0/1077223233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f931c0b59d0 msgr2=0x7f931c0b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9313e00640 1 --2- 172.21.15.37:0/1077223233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f931c0b59d0 0x7f931c0b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9313e00640 1 -- 172.21.15.37:0/1077223233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c15f090 con 0x7f931c15d350 2024-05-30T06:59:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9313e00640 1 --2- 172.21.15.37:0/1077223233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f931c15d350 0x7f931c13e2e0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f930400c420 tx=0x7f930400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9313400640 1 -- 172.21.15.37:0/1077223233 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93040052d0 con 0x7f931c15d350 2024-05-30T06:59:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9313400640 1 -- 172.21.15.37:0/1077223233 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9304005470 con 0x7f931c15d350 2024-05-30T06:59:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9313400640 1 -- 172.21.15.37:0/1077223233 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304007260 con 0x7f931c15d350 2024-05-30T06:59:44.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9322400640 1 -- 172.21.15.37:0/1077223233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931c15f370 con 0x7f931c15d350 2024-05-30T06:59:44.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9322400640 1 -- 172.21.15.37:0/1077223233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f931c15f930 con 0x7f931c15d350 2024-05-30T06:59:44.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9322400640 1 -- 172.21.15.37:0/1077223233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f931c15fd10 con 0x7f931c15d350 2024-05-30T06:59:44.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.346+0000 7f9313400640 1 -- 172.21.15.37:0/1077223233 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 45) ==== 90690+0+0 (secure 0 0 0) 0x7f9304007400 con 0x7f931c15d350 2024-05-30T06:59:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.350+0000 7f9313400640 1 --2- 172.21.15.37:0/1077223233 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f92f806a150 0x7f92f806c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.350+0000 7f9313400640 1 -- 172.21.15.37:0/1077223233 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7f9304084dc0 con 0x7f931c15d350 2024-05-30T06:59:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.350+0000 7f931b400640 1 --2- 172.21.15.37:0/1077223233 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f92f806a150 0x7f92f806c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.350+0000 7f931b400640 1 --2- 172.21.15.37:0/1077223233 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f92f806a150 0x7f92f806c610 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f930c007a60 tx=0x7f930c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.354+0000 7f9313400640 1 -- 172.21.15.37:0/1077223233 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9304056830 con 0x7f931c15d350 2024-05-30T06:59:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.542+0000 7f9322400640 1 -- 172.21.15.37:0/1077223233 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""]}) -- 0x7f931c154090 con 0x7f92f806a150 2024-05-30T06:59:44.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.546+0000 7f9313400640 1 -- 172.21.15.37:0/1077223233 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+59 (secure 0 0 0) 0x7f931c154090 con 0x7f92f806a150 2024-05-30T06:59:44.549 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/_nogroup/sv1/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a 2024-05-30T06:59:44.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.550+0000 7f9322400640 1 -- 172.21.15.37:0/1077223233 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f92f806a150 msgr2=0x7f92f806c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:44.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.550+0000 7f9322400640 1 --2- 172.21.15.37:0/1077223233 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f92f806a150 0x7f92f806c610 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f930c007a60 tx=0x7f930c008040 comp rx=0 tx=0).stop 2024-05-30T06:59:44.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.550+0000 7f9322400640 1 -- 172.21.15.37:0/1077223233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f931c15d350 msgr2=0x7f931c13e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:44.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.550+0000 7f9322400640 1 --2- 172.21.15.37:0/1077223233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f931c15d350 0x7f931c13e2e0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f930400c420 tx=0x7f930400c8e0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.550+0000 7f9322400640 1 -- 172.21.15.37:0/1077223233 shutdown_connections 2024-05-30T06:59:44.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.550+0000 7f9322400640 1 --2- 172.21.15.37:0/1077223233 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f931c15d7e0 0x7f931c15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.550+0000 7f9322400640 1 --2- 172.21.15.37:0/1077223233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f931c15d350 0x7f931c13e2e0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.550+0000 7f9322400640 1 --2- 172.21.15.37:0/1077223233 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f92f806a150 0x7f92f806c610 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.550+0000 7f9322400640 1 --2- 172.21.15.37:0/1077223233 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f931c0b59d0 0x7f931c0b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:44.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.550+0000 7f9322400640 1 -- 172.21.15.37:0/1077223233 >> 172.21.15.37:0/1077223233 conn(0x7f931c06bf60 msgr2=0x7f931c071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:44.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.550+0000 7f9322400640 1 -- 172.21.15.37:0/1077223233 shutdown_connections 2024-05-30T06:59:44.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:44.550+0000 7f9322400640 1 -- 172.21.15.37:0/1077223233 wait complete. 2024-05-30T06:59:44.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:59:44.571 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a 2024-05-30T06:59:44.571 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:59:44.580 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a 2024-05-30T06:59:44.580 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3013705728" 2024-05-30T06:59:44.580 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:44.581 INFO:tasks.cephfs.test_volumes:r_size = 3013705728 exp_size = 3221225472 2024-05-30T06:59:46.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:59:46.582 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a 2024-05-30T06:59:46.582 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:59:46.594 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a 2024-05-30T06:59:46.594 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3013705728" 2024-05-30T06:59:46.594 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:46.595 INFO:tasks.cephfs.test_volumes:r_size = 3013705728 exp_size = 3221225472 2024-05-30T06:59:48.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T06:59:48.596 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr -n ceph.dir.rbytes volumes/_nogroup/sv1/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a 2024-05-30T06:59:48.596 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T06:59:48.607 INFO:teuthology.orchestra.run.smithi037.stdout:# file: volumes/_nogroup/sv1/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a 2024-05-30T06:59:48.607 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.rbytes="3221225472" 2024-05-30T06:59:48.607 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T06:59:48.608 INFO:tasks.cephfs.test_volumes:r_size = 3221225472 exp_size = 3221225472 2024-05-30T06:59:48.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone52191 2024-05-30T06:59:48.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.814+0000 7fd748800640 1 Processor -- start 2024-05-30T06:59:48.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.814+0000 7fd748800640 1 -- start start 2024-05-30T06:59:48.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.814+0000 7fd748800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd74015d350 0x7fd74006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:48.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.814+0000 7fd748800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd74015d7e0 0x7fd74006e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:48.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.814+0000 7fd748800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd740142030 con 0x7fd7400b59d0 2024-05-30T06:59:48.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.814+0000 7fd748800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd740142310 con 0x7fd74015d350 2024-05-30T06:59:48.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.814+0000 7fd748800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd7401425f0 con 0x7fd74015d7e0 2024-05-30T06:59:48.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.818+0000 7fd746800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd74015d7e0 0x7fd74006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:48.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.818+0000 7fd745400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd74015d350 0x7fd74006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:48.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.818+0000 7fd746800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd74015d7e0 0x7fd74006e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:37444/0 (socket says 172.21.15.37:37444) 2024-05-30T06:59:48.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.818+0000 7fd746800640 1 -- 172.21.15.37:0/3409618738 learned_addr learned my addr 172.21.15.37:0/3409618738 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:48.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.818+0000 7fd746800640 1 -- 172.21.15.37:0/3409618738 >> v2:172.21.15.105:3300/0 conn(0x7fd74015d350 msgr2=0x7fd74006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:48.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.818+0000 7fd746800640 1 --2- 172.21.15.37:0/3409618738 >> v2:172.21.15.105:3300/0 conn(0x7fd74015d350 0x7fd74006df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:48.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.818+0000 7fd746800640 1 -- 172.21.15.37:0/3409618738 >> v1:172.21.15.105:6789/0 conn(0x7fd7400b59d0 legacy=0x7fd7400b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:48.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.818+0000 7fd746800640 1 -- 172.21.15.37:0/3409618738 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7401428d0 con 0x7fd74015d7e0 2024-05-30T06:59:48.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.818+0000 7fd746800640 1 --2- 172.21.15.37:0/3409618738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd74015d7e0 0x7fd74006e490 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009e80 tx=0x7fd73c01f200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=787bc8c82b88674a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd744a00640 1 -- 172.21.15.37:0/3409618738 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0b4070 con 0x7fd74015d7e0 2024-05-30T06:59:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd744a00640 1 -- 172.21.15.37:0/3409618738 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73c0af400 con 0x7fd74015d7e0 2024-05-30T06:59:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd744a00640 1 -- 172.21.15.37:0/3409618738 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0af7d0 con 0x7fd74015d7e0 2024-05-30T06:59:48.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 -- 172.21.15.37:0/3409618738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd74015d7e0 msgr2=0x7fd74006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:48.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 --2- 172.21.15.37:0/3409618738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd74015d7e0 0x7fd74006e490 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009e80 tx=0x7fd73c01f200 comp rx=0 tx=0).stop 2024-05-30T06:59:48.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 -- 172.21.15.37:0/3409618738 shutdown_connections 2024-05-30T06:59:48.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 --2- 172.21.15.37:0/3409618738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd74015d7e0 0x7fd74006e490 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:48.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 --2- 172.21.15.37:0/3409618738 >> v2:172.21.15.105:3300/0 conn(0x7fd74015d350 0x7fd74006df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:48.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 -- 172.21.15.37:0/3409618738 >> 172.21.15.37:0/3409618738 conn(0x7fd74006bf60 msgr2=0x7fd7400b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:48.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 -- 172.21.15.37:0/3409618738 shutdown_connections 2024-05-30T06:59:48.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 -- 172.21.15.37:0/3409618738 wait complete. 2024-05-30T06:59:48.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 Processor -- start 2024-05-30T06:59:48.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 -- start start 2024-05-30T06:59:48.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7400b59d0 0x7fd740156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:48.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd74015d350 0x7fd740152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:48.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74015d7e0 0x7fd7400b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:48.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7400b00a0 con 0x7fd74015d7e0 2024-05-30T06:59:48.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd7400aff20 con 0x7fd7400b59d0 2024-05-30T06:59:48.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd748800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd74013f860 con 0x7fd74015d350 2024-05-30T06:59:48.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd746800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74015d7e0 0x7fd7400b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:48.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd746800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74015d7e0 0x7fd7400b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42814/0 (socket says 172.21.15.37:42814) 2024-05-30T06:59:48.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd746800640 1 -- 172.21.15.37:0/319440353 learned_addr learned my addr 172.21.15.37:0/319440353 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:48.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd745400640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd74015d350 0x7fd740152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:48.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.822+0000 7fd745e00640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7400b59d0 0x7fd740156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:48.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd746800640 1 -- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd74015d350 msgr2=0x7fd740152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:48.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd746800640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd74015d350 0x7fd740152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:48.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd746800640 1 -- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7400b59d0 msgr2=0x7fd740156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:48.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd746800640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7400b59d0 0x7fd740156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:48.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd746800640 1 -- 172.21.15.37:0/319440353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74015bdf0 con 0x7fd74015d7e0 2024-05-30T06:59:48.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd746800640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74015d7e0 0x7fd7400b3a40 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0b2040 tx=0x7fd73c01bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:48.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd73a000640 1 -- 172.21.15.37:0/319440353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0b4040 con 0x7fd74015d7e0 2024-05-30T06:59:48.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd73a000640 1 -- 172.21.15.37:0/319440353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd73c0c1070 con 0x7fd74015d7e0 2024-05-30T06:59:48.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd748800640 1 -- 172.21.15.37:0/319440353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74015c0d0 con 0x7fd74015d7e0 2024-05-30T06:59:48.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd73a000640 1 -- 172.21.15.37:0/319440353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73c009510 con 0x7fd74015d7e0 2024-05-30T06:59:48.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd748800640 1 -- 172.21.15.37:0/319440353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7400b48f0 con 0x7fd74015d7e0 2024-05-30T06:59:48.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd748800640 1 -- 172.21.15.37:0/319440353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd740068bc0 con 0x7fd74015d7e0 2024-05-30T06:59:48.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd73a000640 1 -- 172.21.15.37:0/319440353 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 45) ==== 90690+0+0 (secure 0 0 0) 0x7fd73c0b7070 con 0x7fd74015d7e0 2024-05-30T06:59:48.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd73a000640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd72406a150 0x7fd72406c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.826+0000 7fd73a000640 1 -- 172.21.15.37:0/319440353 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7fd73c123950 con 0x7fd74015d7e0 2024-05-30T06:59:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.830+0000 7fd745e00640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd72406a150 0x7fd72406c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:48.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.830+0000 7fd745e00640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd72406a150 0x7fd72406c610 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd740141690 tx=0x7fd734009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:48.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:48.834+0000 7fd73a000640 1 -- 172.21.15.37:0/319440353 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd73c018d60 con 0x7fd74015d7e0 2024-05-30T06:59:49.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.026+0000 7fd748800640 1 -- 172.21.15.37:0/319440353 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone52191", "target": ["mon-mgr", ""]}) -- 0x7fd74006f0a0 con 0x7fd72406a150 2024-05-30T06:59:49.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.090+0000 7fd73a000640 1 -- 172.21.15.37:0/319440353 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd74006f0a0 con 0x7fd72406a150 2024-05-30T06:59:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.090+0000 7fd748800640 1 -- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd72406a150 msgr2=0x7fd72406c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.090+0000 7fd748800640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd72406a150 0x7fd72406c610 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd740141690 tx=0x7fd734009040 comp rx=0 tx=0).stop 2024-05-30T06:59:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.090+0000 7fd748800640 1 -- 172.21.15.37:0/319440353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74015d7e0 msgr2=0x7fd7400b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.090+0000 7fd748800640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74015d7e0 0x7fd7400b3a40 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0b2040 tx=0x7fd73c01bfa0 comp rx=0 tx=0).stop 2024-05-30T06:59:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.090+0000 7fd748800640 1 -- 172.21.15.37:0/319440353 shutdown_connections 2024-05-30T06:59:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.090+0000 7fd748800640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd74015d7e0 0x7fd7400b3a40 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.090+0000 7fd748800640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd74015d350 0x7fd740152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:49.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.090+0000 7fd748800640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd72406a150 0x7fd72406c610 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:49.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.090+0000 7fd748800640 1 --2- 172.21.15.37:0/319440353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7400b59d0 0x7fd740156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:49.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.090+0000 7fd748800640 1 -- 172.21.15.37:0/319440353 >> 172.21.15.37:0/319440353 conn(0x7fd74006bf60 msgr2=0x7fd740071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:49.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.094+0000 7fd748800640 1 -- 172.21.15.37:0/319440353 shutdown_connections 2024-05-30T06:59:49.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.094+0000 7fd748800640 1 -- 172.21.15.37:0/319440353 wait complete. 2024-05-30T06:59:49.094 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:49.098+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:49.094 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:49.098+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:49.094 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:49.098+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:49.094 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:49.098+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:49.095 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:49.098+0000 7f0053400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:49.110 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:49.114+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:49.110 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:49.114+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:49.110 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:49.114+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:49.110 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:49.114+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:49.111 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:49.114+0000 7f0052a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:49.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone52192 2024-05-30T06:59:49.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.262+0000 7f04a5a00640 1 Processor -- start 2024-05-30T06:59:49.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.262+0000 7f04a5a00640 1 -- start start 2024-05-30T06:59:49.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.262+0000 7f04a5a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f04a0144c00 0x7f04a006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:49.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.262+0000 7f04a5a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04a015f9c0 0x7f04a006f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:49.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.262+0000 7f04a5a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a00cf430 con 0x7f04a0144fe0 2024-05-30T06:59:49.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.262+0000 7f04a5a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f04a00b3bf0 con 0x7f04a0144c00 2024-05-30T06:59:49.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.262+0000 7f04a5a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f04a0072e10 con 0x7f04a015f9c0 2024-05-30T06:59:49.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.262+0000 7f0497e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f04a0144fe0 0x7f04a015f2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41634/0 (socket says 172.21.15.37:41634) 2024-05-30T06:59:49.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.262+0000 7f0497e00640 1 -- 172.21.15.37:0/2440885195 learned_addr learned my addr 172.21.15.37:0/2440885195 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:49.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.262+0000 7f049fe00640 1 --2- 172.21.15.37:0/2440885195 >> v2:172.21.15.105:3300/0 conn(0x7f04a0144c00 0x7f04a006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:49.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.262+0000 7f04a5000640 1 --2- 172.21.15.37:0/2440885195 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04a015f9c0 0x7f04a006f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:49.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.266+0000 7f049f400640 1 -- 172.21.15.37:0/2440885195 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341797612 0 0) 0x7f04a00cf430 con 0x7f04a0144fe0 2024-05-30T06:59:49.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.266+0000 7f049f400640 1 -- 172.21.15.37:0/2440885195 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0484003530 con 0x7f04a0144fe0 2024-05-30T06:59:49.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.266+0000 7f04a5000640 1 -- 172.21.15.37:0/2440885195 >> v2:172.21.15.105:3300/0 conn(0x7f04a0144c00 msgr2=0x7f04a006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:49.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.266+0000 7f04a5000640 1 --2- 172.21.15.37:0/2440885195 >> v2:172.21.15.105:3300/0 conn(0x7f04a0144c00 0x7f04a006ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:49.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.266+0000 7f04a5000640 1 -- 172.21.15.37:0/2440885195 >> v1:172.21.15.37:6789/0 conn(0x7f04a0144fe0 legacy=0x7f04a015f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:49.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.266+0000 7f04a5000640 1 -- 172.21.15.37:0/2440885195 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a00cf6f0 con 0x7f04a015f9c0 2024-05-30T06:59:49.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.266+0000 7f049fe00640 1 --2- 172.21.15.37:0/2440885195 >> v2:172.21.15.105:3300/0 conn(0x7f04a0144c00 0x7f04a006ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T06:59:49.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.266+0000 7f04a5000640 1 --2- 172.21.15.37:0/2440885195 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04a015f9c0 0x7f04a006f490 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0498009d90 tx=0x7f049801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8957555d642bdfb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:49.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.266+0000 7f049f400640 1 -- 172.21.15.37:0/2440885195 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04980b2070 con 0x7f04a015f9c0 2024-05-30T06:59:49.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.266+0000 7f049f400640 1 -- 172.21.15.37:0/2440885195 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04980a5940 con 0x7f04a015f9c0 2024-05-30T06:59:49.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.266+0000 7f049f400640 1 -- 172.21.15.37:0/2440885195 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04980a5d10 con 0x7f04a015f9c0 2024-05-30T06:59:49.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 -- 172.21.15.37:0/2440885195 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04a015f9c0 msgr2=0x7f04a006f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:49.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 --2- 172.21.15.37:0/2440885195 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04a015f9c0 0x7f04a006f490 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0498009d90 tx=0x7f049801c970 comp rx=0 tx=0).stop 2024-05-30T06:59:49.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 -- 172.21.15.37:0/2440885195 shutdown_connections 2024-05-30T06:59:49.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 --2- 172.21.15.37:0/2440885195 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04a015f9c0 0x7f04a006f490 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:49.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 --2- 172.21.15.37:0/2440885195 >> v2:172.21.15.105:3300/0 conn(0x7f04a0144c00 0x7f04a006ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:49.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 -- 172.21.15.37:0/2440885195 >> 172.21.15.37:0/2440885195 conn(0x7f04a0067d60 msgr2=0x7f04a006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:49.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 -- 172.21.15.37:0/2440885195 shutdown_connections 2024-05-30T06:59:49.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 -- 172.21.15.37:0/2440885195 wait complete. 2024-05-30T06:59:49.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 Processor -- start 2024-05-30T06:59:49.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 -- start start 2024-05-30T06:59:49.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04a0144c00 0x7f04a013f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:49.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a0144fe0 0x7f04a00aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:49.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04a015f9c0 0x7f04a015cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:49.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f04a00729a0 con 0x7f04a0144fe0 2024-05-30T06:59:49.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0072820 con 0x7f04a015f9c0 2024-05-30T06:59:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f04a0072b20 con 0x7f04a0144c00 2024-05-30T06:59:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f0497e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a0144fe0 0x7f04a00aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f0497e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a0144fe0 0x7f04a00aa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42816/0 (socket says 172.21.15.37:42816) 2024-05-30T06:59:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f0497e00640 1 -- 172.21.15.37:0/1450473973 learned_addr learned my addr 172.21.15.37:0/1450473973 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f04a5000640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04a015f9c0 0x7f04a015cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f049fe00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04a0144c00 0x7f04a013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f0497e00640 1 -- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04a0144c00 msgr2=0x7f04a013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f0497e00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04a0144c00 0x7f04a013f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f0497e00640 1 -- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04a015f9c0 msgr2=0x7f04a015cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f0497e00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04a015f9c0 0x7f04a015cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f0497e00640 1 -- 172.21.15.37:0/1450473973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a00aacc0 con 0x7f04a0144fe0 2024-05-30T06:59:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.270+0000 7f049fe00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04a0144c00 0x7f04a013f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:49.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.274+0000 7f0497e00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a0144fe0 0x7f04a00aa3c0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f048800c4d0 tx=0x7f048800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.274+0000 7f049cc00640 1 -- 172.21.15.37:0/1450473973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488017070 con 0x7f04a0144fe0 2024-05-30T06:59:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.274+0000 7f049cc00640 1 -- 172.21.15.37:0/1450473973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0488005cf0 con 0x7f04a0144fe0 2024-05-30T06:59:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.274+0000 7f049cc00640 1 -- 172.21.15.37:0/1450473973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488007270 con 0x7f04a0144fe0 2024-05-30T06:59:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.274+0000 7f04a5a00640 1 -- 172.21.15.37:0/1450473973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a0142870 con 0x7f04a0144fe0 2024-05-30T06:59:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.274+0000 7f04a5a00640 1 -- 172.21.15.37:0/1450473973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a0142e30 con 0x7f04a0144fe0 2024-05-30T06:59:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.274+0000 7f04a5a00640 1 -- 172.21.15.37:0/1450473973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a0068700 con 0x7f04a0144fe0 2024-05-30T06:59:49.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.274+0000 7f049cc00640 1 -- 172.21.15.37:0/1450473973 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 46) ==== 90792+0+0 (secure 0 0 0) 0x7f048801a070 con 0x7f04a0144fe0 2024-05-30T06:59:49.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.274+0000 7f049cc00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f047c06a2a0 0x7f047c06c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:49.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.274+0000 7f049cc00640 1 -- 172.21.15.37:0/1450473973 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7f0488084cd0 con 0x7f04a0144fe0 2024-05-30T06:59:49.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.278+0000 7f049fe00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f047c06a2a0 0x7f047c06c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:49.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.278+0000 7f049fe00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f047c06a2a0 0x7f047c06c760 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f04a00aa370 tx=0x7f0490008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:49.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.282+0000 7f049cc00640 1 -- 172.21.15.37:0/1450473973 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f04880566a0 con 0x7f04a0144fe0 2024-05-30T06:59:49.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:49.474+0000 7f04a5a00640 1 -- 172.21.15.37:0/1450473973 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone52192", "target": ["mon-mgr", ""]}) -- 0x7f04a01401c0 con 0x7f047c06a2a0 2024-05-30T06:59:50.095 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:50.098+0000 7effc2e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:50.095 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:50.098+0000 7effc2e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:50.095 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:50.098+0000 7effc2e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:50.095 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:50.098+0000 7effc2e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:50.095 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:50.098+0000 7effc2e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:50.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.202+0000 7f049cc00640 1 -- 172.21.15.37:0/1450473973 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f04a01401c0 con 0x7f047c06a2a0 2024-05-30T06:59:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.202+0000 7f04a5a00640 1 -- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f047c06a2a0 msgr2=0x7f047c06c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.202+0000 7f04a5a00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f047c06a2a0 0x7f047c06c760 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f04a00aa370 tx=0x7f0490008040 comp rx=0 tx=0).stop 2024-05-30T06:59:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.202+0000 7f04a5a00640 1 -- 172.21.15.37:0/1450473973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a0144fe0 msgr2=0x7f04a00aa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.202+0000 7f04a5a00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a0144fe0 0x7f04a00aa3c0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f048800c4d0 tx=0x7f048800c990 comp rx=0 tx=0).stop 2024-05-30T06:59:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.202+0000 7f04a5a00640 1 -- 172.21.15.37:0/1450473973 shutdown_connections 2024-05-30T06:59:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.202+0000 7f04a5a00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f047c06a2a0 0x7f047c06c760 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.202+0000 7f04a5a00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04a015f9c0 0x7f04a015cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.202+0000 7f04a5a00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04a0144fe0 0x7f04a00aa3c0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.202+0000 7f04a5a00640 1 --2- 172.21.15.37:0/1450473973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04a0144c00 0x7f04a013f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.202+0000 7f04a5a00640 1 -- 172.21.15.37:0/1450473973 >> 172.21.15.37:0/1450473973 conn(0x7f04a0067d60 msgr2=0x7f04a006de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.202+0000 7f04a5a00640 1 -- 172.21.15.37:0/1450473973 shutdown_connections 2024-05-30T06:59:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.202+0000 7f04a5a00640 1 -- 172.21.15.37:0/1450473973 wait complete. 2024-05-30T06:59:50.227 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone52193 2024-05-30T06:59:50.235 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:50.238+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:50.235 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:50.238+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:50.235 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:50.238+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:50.235 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:50.238+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:50.235 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:50.238+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:50.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa462800640 1 Processor -- start 2024-05-30T06:59:50.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa462800640 1 -- start start 2024-05-30T06:59:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa462800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa45c0b59d0 0x7fa45c0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa462800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa45c15d7e0 0x7fa45c160990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa462800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa45c0b62f0 con 0x7fa45c15d350 2024-05-30T06:59:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa462800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa45c142030 con 0x7fa45c15d7e0 2024-05-30T06:59:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa462800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa45c142310 con 0x7fa45c0b59d0 2024-05-30T06:59:50.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa45be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa45c15d7e0 0x7fa45c160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:50.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa45be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa45c15d7e0 0x7fa45c160990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42824/0 (socket says 172.21.15.37:42824) 2024-05-30T06:59:50.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa45be00640 1 -- 172.21.15.37:0/795835285 learned_addr learned my addr 172.21.15.37:0/795835285 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:50.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa45b400640 1 --2- 172.21.15.37:0/795835285 >> v2:172.21.15.105:3300/0 conn(0x7fa45c0b59d0 0x7fa45c0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:50.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa45be00640 1 -- 172.21.15.37:0/795835285 >> v2:172.21.15.105:3300/0 conn(0x7fa45c0b59d0 msgr2=0x7fa45c0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:50.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa45be00640 1 --2- 172.21.15.37:0/795835285 >> v2:172.21.15.105:3300/0 conn(0x7fa45c0b59d0 0x7fa45c0b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:50.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa45be00640 1 -- 172.21.15.37:0/795835285 >> v1:172.21.15.105:6789/0 conn(0x7fa45c15d350 legacy=0x7fa45c160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:50.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.454+0000 7fa45be00640 1 -- 172.21.15.37:0/795835285 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45c1425f0 con 0x7fa45c15d7e0 2024-05-30T06:59:50.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.458+0000 7fa45be00640 1 --2- 172.21.15.37:0/795835285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa45c15d7e0 0x7fa45c160990 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fa454009e50 tx=0x7fa45401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7e61268640d54c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:50.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.458+0000 7fa45aa00640 1 -- 172.21.15.37:0/795835285 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4540b4070 con 0x7fa45c15d7e0 2024-05-30T06:59:50.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.458+0000 7fa45aa00640 1 -- 172.21.15.37:0/795835285 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4540af400 con 0x7fa45c15d7e0 2024-05-30T06:59:50.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.458+0000 7fa45aa00640 1 -- 172.21.15.37:0/795835285 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4540af7d0 con 0x7fa45c15d7e0 2024-05-30T06:59:50.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.458+0000 7fa462800640 1 -- 172.21.15.37:0/795835285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa45c15d7e0 msgr2=0x7fa45c160990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:50.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.458+0000 7fa462800640 1 --2- 172.21.15.37:0/795835285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa45c15d7e0 0x7fa45c160990 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fa454009e50 tx=0x7fa45401f1e0 comp rx=0 tx=0).stop 2024-05-30T06:59:50.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.458+0000 7fa462800640 1 -- 172.21.15.37:0/795835285 shutdown_connections 2024-05-30T06:59:50.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.458+0000 7fa462800640 1 --2- 172.21.15.37:0/795835285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa45c15d7e0 0x7fa45c160990 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:50.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.458+0000 7fa462800640 1 --2- 172.21.15.37:0/795835285 >> v2:172.21.15.105:3300/0 conn(0x7fa45c0b59d0 0x7fa45c0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:50.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.458+0000 7fa462800640 1 -- 172.21.15.37:0/795835285 >> 172.21.15.37:0/795835285 conn(0x7fa45c06bf60 msgr2=0x7fa45c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:50.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.458+0000 7fa462800640 1 -- 172.21.15.37:0/795835285 shutdown_connections 2024-05-30T06:59:50.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.458+0000 7fa462800640 1 -- 172.21.15.37:0/795835285 wait complete. 2024-05-30T06:59:50.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa462800640 1 Processor -- start 2024-05-30T06:59:50.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa462800640 1 -- start start 2024-05-30T06:59:50.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa462800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa45c0b59d0 0x7fa45c1f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:50.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa462800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa45c15d350 0x7fa45c1402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:50.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa462800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45c15d7e0 0x7fa45c140830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:50.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa462800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c13fe60 con 0x7fa45c15d350 2024-05-30T06:59:50.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa462800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c13fce0 con 0x7fa45c15d7e0 2024-05-30T06:59:50.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa462800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa45c0aff20 con 0x7fa45c0b59d0 2024-05-30T06:59:50.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa452a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa45c15d350 0x7fa45c1402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:50.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa452a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa45c15d350 0x7fa45c1402f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42836/0 (socket says 172.21.15.37:42836) 2024-05-30T06:59:50.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa452a00640 1 -- 172.21.15.37:0/2488019767 learned_addr learned my addr 172.21.15.37:0/2488019767 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:50.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa45be00640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45c15d7e0 0x7fa45c140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:50.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa45b400640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa45c0b59d0 0x7fa45c1f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:50.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.462+0000 7fa452a00640 1 -- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa45c0b59d0 msgr2=0x7fa45c1f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:50.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.466+0000 7fa452a00640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa45c0b59d0 0x7fa45c1f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:50.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.466+0000 7fa452a00640 1 -- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45c15d7e0 msgr2=0x7fa45c140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:50.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.466+0000 7fa452a00640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45c15d7e0 0x7fa45c140830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:50.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.466+0000 7fa452a00640 1 -- 172.21.15.37:0/2488019767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45c15bac0 con 0x7fa45c15d350 2024-05-30T06:59:50.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.466+0000 7fa45be00640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45c15d7e0 0x7fa45c140830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:50.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.466+0000 7fa45b400640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa45c0b59d0 0x7fa45c1f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:59:50.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.466+0000 7fa452a00640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa45c15d350 0x7fa45c1402f0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c420 tx=0x7fa44400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:50.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.466+0000 7fa453e00640 1 -- 172.21.15.37:0/2488019767 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4440052d0 con 0x7fa45c15d350 2024-05-30T06:59:50.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.466+0000 7fa453e00640 1 -- 172.21.15.37:0/2488019767 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa444005470 con 0x7fa45c15d350 2024-05-30T06:59:50.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.466+0000 7fa453e00640 1 -- 172.21.15.37:0/2488019767 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444007260 con 0x7fa45c15d350 2024-05-30T06:59:50.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.466+0000 7fa462800640 1 -- 172.21.15.37:0/2488019767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa45c15bda0 con 0x7fa45c15d350 2024-05-30T06:59:50.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.466+0000 7fa462800640 1 -- 172.21.15.37:0/2488019767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa45c15c360 con 0x7fa45c15d350 2024-05-30T06:59:50.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.466+0000 7fa462800640 1 -- 172.21.15.37:0/2488019767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa45c15c560 con 0x7fa45c15d350 2024-05-30T06:59:50.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.470+0000 7fa453e00640 1 -- 172.21.15.37:0/2488019767 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 46) ==== 90792+0+0 (secure 0 0 0) 0x7fa444007400 con 0x7fa45c15d350 2024-05-30T06:59:50.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.470+0000 7fa453e00640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa43806a270 0x7fa43806c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:50.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.470+0000 7fa453e00640 1 -- 172.21.15.37:0/2488019767 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7fa444084f70 con 0x7fa45c15d350 2024-05-30T06:59:50.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.470+0000 7fa45b400640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa43806a270 0x7fa43806c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:50.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.474+0000 7fa453e00640 1 -- 172.21.15.37:0/2488019767 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa45c15c560 con 0x7fa45c15d350 2024-05-30T06:59:50.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.478+0000 7fa45b400640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa43806a270 0x7fa43806c730 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009840 tx=0x7fa44c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:50.810+0000 7fa462800640 1 -- 172.21.15.37:0/2488019767 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone52193", "target": ["mon-mgr", ""]}) -- 0x7fa45c156f60 con 0x7fa43806a270 2024-05-30T06:59:51.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.353+0000 7fa453e00640 1 -- 172.21.15.37:0/2488019767 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 47) ==== 90894+0+0 (secure 0 0 0) 0x7fa444052f00 con 0x7fa45c15d350 2024-05-30T06:59:51.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.393+0000 7fa453e00640 1 -- 172.21.15.37:0/2488019767 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa45c156f60 con 0x7fa43806a270 2024-05-30T06:59:51.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.397+0000 7fa462800640 1 -- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa43806a270 msgr2=0x7fa43806c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:51.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.397+0000 7fa462800640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa43806a270 0x7fa43806c730 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009840 tx=0x7fa44c008040 comp rx=0 tx=0).stop 2024-05-30T06:59:51.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.397+0000 7fa462800640 1 -- 172.21.15.37:0/2488019767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa45c15d350 msgr2=0x7fa45c1402f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:51.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.397+0000 7fa462800640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa45c15d350 0x7fa45c1402f0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c420 tx=0x7fa44400c8e0 comp rx=0 tx=0).stop 2024-05-30T06:59:51.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.397+0000 7fa462800640 1 -- 172.21.15.37:0/2488019767 shutdown_connections 2024-05-30T06:59:51.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.397+0000 7fa462800640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa43806a270 0x7fa43806c730 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:51.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.397+0000 7fa462800640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45c15d7e0 0x7fa45c140830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:51.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.397+0000 7fa462800640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa45c15d350 0x7fa45c1402f0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:51.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.397+0000 7fa462800640 1 --2- 172.21.15.37:0/2488019767 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa45c0b59d0 0x7fa45c1f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:51.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.397+0000 7fa462800640 1 -- 172.21.15.37:0/2488019767 >> 172.21.15.37:0/2488019767 conn(0x7fa45c06bf60 msgr2=0x7fa45c1601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:51.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.397+0000 7fa462800640 1 -- 172.21.15.37:0/2488019767 shutdown_connections 2024-05-30T06:59:51.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.397+0000 7fa462800640 1 -- 172.21.15.37:0/2488019767 wait complete. 2024-05-30T06:59:51.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone52194 2024-05-30T06:59:51.441 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:51.446+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:51.442 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:51.446+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:51.442 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:51.446+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:51.442 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:51.446+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:51.442 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T06:59:51.446+0000 7f0053e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T06:59:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.645+0000 7f99cb800640 1 Processor -- start 2024-05-30T06:59:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.645+0000 7f99cb800640 1 -- start start 2024-05-30T06:59:51.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99cb800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f99c4162e70 0x7f99c40cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99cb800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99c4163250 0x7f99c41636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99cb800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99c41668a0 0x7f99c4166cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99cb800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f99c406f8e0 con 0x7f99c4163250 2024-05-30T06:59:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99cb800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f99c4164190 con 0x7f99c4162e70 2024-05-30T06:59:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99cb800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f99c406ecd0 con 0x7f99c41668a0 2024-05-30T06:59:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99c3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99c4163250 0x7f99c41636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99c3e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99c4163250 0x7f99c41636d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42838/0 (socket says 172.21.15.37:42838) 2024-05-30T06:59:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99c3e00640 1 -- 172.21.15.37:0/1685113490 learned_addr learned my addr 172.21.15.37:0/1685113490 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99c3e00640 1 -- 172.21.15.37:0/1685113490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99c41668a0 msgr2=0x7f99c4166cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99c3e00640 1 --2- 172.21.15.37:0/1685113490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99c41668a0 0x7f99c4166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99c3e00640 1 -- 172.21.15.37:0/1685113490 >> v2:172.21.15.105:3300/0 conn(0x7f99c4162e70 msgr2=0x7f99c40cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99c3e00640 1 --2- 172.21.15.37:0/1685113490 >> v2:172.21.15.105:3300/0 conn(0x7f99c4162e70 0x7f99c40cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.649+0000 7f99c3e00640 1 -- 172.21.15.37:0/1685113490 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c406efb0 con 0x7f99c4163250 2024-05-30T06:59:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.653+0000 7f99c3e00640 1 --2- 172.21.15.37:0/1685113490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c4163250 0x7f99c41636d0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f99c4073360 tx=0x7f99b001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57b832ca9d677b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.653+0000 7f99c3400640 1 -- 172.21.15.37:0/1685113490 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b00ab620 con 0x7f99c4163250 2024-05-30T06:59:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.653+0000 7f99c3400640 1 -- 172.21.15.37:0/1685113490 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b00b0070 con 0x7f99c4163250 2024-05-30T06:59:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.653+0000 7f99c3400640 1 -- 172.21.15.37:0/1685113490 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b00ab9e0 con 0x7f99c4163250 2024-05-30T06:59:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.653+0000 7f99cb800640 1 -- 172.21.15.37:0/1685113490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c4163250 msgr2=0x7f99c41636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.653+0000 7f99cb800640 1 --2- 172.21.15.37:0/1685113490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c4163250 0x7f99c41636d0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f99c4073360 tx=0x7f99b001c460 comp rx=0 tx=0).stop 2024-05-30T06:59:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.653+0000 7f99cb800640 1 -- 172.21.15.37:0/1685113490 shutdown_connections 2024-05-30T06:59:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.653+0000 7f99cb800640 1 --2- 172.21.15.37:0/1685113490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99c41668a0 0x7f99c4166cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.653+0000 7f99cb800640 1 --2- 172.21.15.37:0/1685113490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c4163250 0x7f99c41636d0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.653+0000 7f99cb800640 1 --2- 172.21.15.37:0/1685113490 >> v2:172.21.15.105:3300/0 conn(0x7f99c4162e70 0x7f99c40cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.653+0000 7f99cb800640 1 -- 172.21.15.37:0/1685113490 >> 172.21.15.37:0/1685113490 conn(0x7f99c406bf60 msgr2=0x7f99c40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.653+0000 7f99cb800640 1 -- 172.21.15.37:0/1685113490 shutdown_connections 2024-05-30T06:59:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.653+0000 7f99cb800640 1 -- 172.21.15.37:0/1685113490 wait complete. 2024-05-30T06:59:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99cb800640 1 Processor -- start 2024-05-30T06:59:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99cb800640 1 -- start start 2024-05-30T06:59:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99cb800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99c4162e70 0x7f99c414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99cb800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c4163250 0x7f99c4150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99cb800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99c41668a0 0x7f99c4150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99cb800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f99c406e960 con 0x7f99c4163250 2024-05-30T06:59:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99cb800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f99c4163c10 con 0x7f99c4162e70 2024-05-30T06:59:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99cb800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f99c40ccdf0 con 0x7f99c41668a0 2024-05-30T06:59:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99c3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c4163250 0x7f99c4150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99c3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c4163250 0x7f99c4150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42854/0 (socket says 172.21.15.37:42854) 2024-05-30T06:59:51.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99c3e00640 1 -- 172.21.15.37:0/2652117314 learned_addr learned my addr 172.21.15.37:0/2652117314 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:51.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99c3e00640 1 -- 172.21.15.37:0/2652117314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99c41668a0 msgr2=0x7f99c4150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:51.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99c3e00640 1 --2- 172.21.15.37:0/2652117314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99c41668a0 0x7f99c4150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:51.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99c3e00640 1 -- 172.21.15.37:0/2652117314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99c4162e70 msgr2=0x7f99c414f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:51.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99c3e00640 1 --2- 172.21.15.37:0/2652117314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99c4162e70 0x7f99c414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:51.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99c3e00640 1 -- 172.21.15.37:0/2652117314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c40ccb20 con 0x7f99c4163250 2024-05-30T06:59:51.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99c3e00640 1 --2- 172.21.15.37:0/2652117314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c4163250 0x7f99c4150970 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f99b00ad040 tx=0x7f99b001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:51.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99c0c00640 1 -- 172.21.15.37:0/2652117314 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b00abd10 con 0x7f99c4163250 2024-05-30T06:59:51.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99cb800640 1 -- 172.21.15.37:0/2652117314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c40b4680 con 0x7f99c4163250 2024-05-30T06:59:51.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99c0c00640 1 -- 172.21.15.37:0/2652117314 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b00be3f0 con 0x7f99c4163250 2024-05-30T06:59:51.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99c0c00640 1 -- 172.21.15.37:0/2652117314 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b00be7a0 con 0x7f99c4163250 2024-05-30T06:59:51.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.657+0000 7f99cb800640 1 -- 172.21.15.37:0/2652117314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c40b4c20 con 0x7f99c4163250 2024-05-30T06:59:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.661+0000 7f99cb800640 1 -- 172.21.15.37:0/2652117314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c4068bc0 con 0x7f99c4163250 2024-05-30T06:59:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.661+0000 7f99c0c00640 1 -- 172.21.15.37:0/2652117314 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 47) ==== 90894+0+0 (secure 0 0 0) 0x7f99b00b43f0 con 0x7f99c4163250 2024-05-30T06:59:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.665+0000 7f99c0c00640 1 --2- 172.21.15.37:0/2652117314 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f99a406a3c0 0x7f99a406c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:51.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.665+0000 7f99c0c00640 1 -- 172.21.15.37:0/2652117314 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7f99b011fd40 con 0x7f99c4163250 2024-05-30T06:59:51.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.665+0000 7f99c8e00640 1 --2- 172.21.15.37:0/2652117314 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f99a406a3c0 0x7f99a406c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:51.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.669+0000 7f99c8e00640 1 --2- 172.21.15.37:0/2652117314 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f99a406a3c0 0x7f99a406c880 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009690 tx=0x7f99b8006c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:51.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:51.669+0000 7f99c0c00640 1 -- 172.21.15.37:0/2652117314 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f99b00c4060 con 0x7f99c4163250 2024-05-30T06:59:52.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.033+0000 7f99cb800640 1 -- 172.21.15.37:0/2652117314 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone52194", "target": ["mon-mgr", ""]}) -- 0x7f99c40b30b0 con 0x7f99a406a3c0 2024-05-30T06:59:52.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.597+0000 7f99c0c00640 1 -- 172.21.15.37:0/2652117314 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f99c40b30b0 con 0x7f99a406a3c0 2024-05-30T06:59:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.601+0000 7f99cb800640 1 -- 172.21.15.37:0/2652117314 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f99a406a3c0 msgr2=0x7f99a406c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.601+0000 7f99cb800640 1 --2- 172.21.15.37:0/2652117314 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f99a406a3c0 0x7f99a406c880 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009690 tx=0x7f99b8006c00 comp rx=0 tx=0).stop 2024-05-30T06:59:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.601+0000 7f99cb800640 1 -- 172.21.15.37:0/2652117314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c4163250 msgr2=0x7f99c4150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.601+0000 7f99cb800640 1 --2- 172.21.15.37:0/2652117314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c4163250 0x7f99c4150970 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f99b00ad040 tx=0x7f99b001aca0 comp rx=0 tx=0).stop 2024-05-30T06:59:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.601+0000 7f99cb800640 1 -- 172.21.15.37:0/2652117314 shutdown_connections 2024-05-30T06:59:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.601+0000 7f99cb800640 1 --2- 172.21.15.37:0/2652117314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99c41668a0 0x7f99c4150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.601+0000 7f99cb800640 1 --2- 172.21.15.37:0/2652117314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c4163250 0x7f99c4150970 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:52.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.601+0000 7f99cb800640 1 --2- 172.21.15.37:0/2652117314 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f99a406a3c0 0x7f99a406c880 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:52.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.601+0000 7f99cb800640 1 --2- 172.21.15.37:0/2652117314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99c4162e70 0x7f99c414f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:52.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.601+0000 7f99cb800640 1 -- 172.21.15.37:0/2652117314 >> 172.21.15.37:0/2652117314 conn(0x7f99c406bf60 msgr2=0x7f99c40b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:52.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.605+0000 7f99cb800640 1 -- 172.21.15.37:0/2652117314 shutdown_connections 2024-05-30T06:59:52.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.605+0000 7f99cb800640 1 -- 172.21.15.37:0/2652117314 wait complete. 2024-05-30T06:59:52.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone52195 2024-05-30T06:59:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6cd5600640 1 Processor -- start 2024-05-30T06:59:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6cd5600640 1 -- start start 2024-05-30T06:59:52.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6cd5600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6cd015d390 0x7f6cd0071e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:52.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6cd5600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6cd01422f0 0x7f6cd0072340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:52.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6cd5600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cd0142900 con 0x7f6cd015d770 2024-05-30T06:59:52.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6cd5600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6cd006de40 con 0x7f6cd015d390 2024-05-30T06:59:52.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6cd5600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd013fd50 con 0x7f6cd01422f0 2024-05-30T06:59:52.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6cc7e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6cd015d770 0x7f6cd0141be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41636/0 (socket says 172.21.15.37:41636) 2024-05-30T06:59:52.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6cc7e00640 1 -- 172.21.15.37:0/3169950951 learned_addr learned my addr 172.21.15.37:0/3169950951 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T06:59:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4201439987 0 0) 0x7f6cd0142900 con 0x7f6cd015d770 2024-05-30T06:59:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cb4003530 con 0x7f6cd015d770 2024-05-30T06:59:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6ccfe00640 1 --2- 172.21.15.37:0/3169950951 >> v2:172.21.15.105:3300/0 conn(0x7f6cd015d390 0x7f6cd0071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6cd4c00640 1 --2- 172.21.15.37:0/3169950951 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6cd01422f0 0x7f6cd0072340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2764629343 0 0) 0x7f6cb4003530 con 0x7f6cd015d770 2024-05-30T06:59:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6cd01422f0 msgr2=0x7f6cd0072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6ccf400640 1 --2- 172.21.15.37:0/3169950951 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6cd01422f0 0x7f6cd0072340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 >> v2:172.21.15.105:3300/0 conn(0x7f6cd015d390 msgr2=0x7f6cd0071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6ccf400640 1 --2- 172.21.15.37:0/3169950951 >> v2:172.21.15.105:3300/0 conn(0x7f6cd015d390 0x7f6cd0071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd0140030 con 0x7f6cd015d770 2024-05-30T06:59:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f6cb8001680 con 0x7f6cd015d770 2024-05-30T06:59:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 >> v1:172.21.15.37:6789/0 conn(0x7f6cd015d770 legacy=0x7f6cd0141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6ccf400640 1 --2- 172.21.15.37:0/3169950951 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6cb40039c0 0x7f6cb4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.909+0000 7f6ccf400640 1 --2- 172.21.15.37:0/3169950951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cb4004810 0x7f6cb4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.913+0000 7f6ccf400640 1 --2- 172.21.15.37:0/3169950951 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cb40051d0 0x7f6cb400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.913+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd013fd50 con 0x7f6cb4004810 2024-05-30T06:59:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.913+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb400c020 con 0x7f6cb40051d0 2024-05-30T06:59:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.913+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6cb400c220 con 0x7f6cb40039c0 2024-05-30T06:59:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.913+0000 7f6cc7e00640 1 --2- 172.21.15.37:0/3169950951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cb4004810 0x7f6cb4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.913+0000 7f6cd4c00640 1 --2- 172.21.15.37:0/3169950951 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cb40051d0 0x7f6cb400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.913+0000 7f6cc7e00640 1 -- 172.21.15.37:0/3169950951 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6cb40039c0 msgr2=0x7f6cb4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.913+0000 7f6cc7e00640 1 --2- 172.21.15.37:0/3169950951 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6cb40039c0 0x7f6cb4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.913+0000 7f6cc7e00640 1 -- 172.21.15.37:0/3169950951 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cb40051d0 msgr2=0x7f6cb400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.913+0000 7f6cc7e00640 1 --2- 172.21.15.37:0/3169950951 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cb40051d0 0x7f6cb400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.913+0000 7f6cc7e00640 1 -- 172.21.15.37:0/3169950951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb4003530 con 0x7f6cb4004810 2024-05-30T06:59:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.917+0000 7f6cc7e00640 1 --2- 172.21.15.37:0/3169950951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cb4004810 0x7f6cb4004c90 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c240 tx=0x7f6cb801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd7d61ebef7893d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.917+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8007d40 con 0x7f6cb4004810 2024-05-30T06:59:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.917+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb80a9020 con 0x7f6cb4004810 2024-05-30T06:59:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.917+0000 7f6ccf400640 1 -- 172.21.15.37:0/3169950951 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8005ae0 con 0x7f6cb4004810 2024-05-30T06:59:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.921+0000 7f6cd5600640 1 -- 172.21.15.37:0/3169950951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cb4004810 msgr2=0x7f6cb4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.921+0000 7f6cd5600640 1 --2- 172.21.15.37:0/3169950951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cb4004810 0x7f6cb4004c90 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c240 tx=0x7f6cb801cca0 comp rx=0 tx=0).stop 2024-05-30T06:59:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.921+0000 7f6cd4c00640 1 -- 172.21.15.37:0/3169950951 reap_dead start 2024-05-30T06:59:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.921+0000 7f6cd5600640 1 -- 172.21.15.37:0/3169950951 shutdown_connections 2024-05-30T06:59:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.921+0000 7f6cd5600640 1 -- 172.21.15.37:0/3169950951 >> 172.21.15.37:0/3169950951 conn(0x7f6cd0067d60 msgr2=0x7f6cd006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.921+0000 7f6cd5600640 1 -- 172.21.15.37:0/3169950951 shutdown_connections 2024-05-30T06:59:52.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.921+0000 7f6cd5600640 1 -- 172.21.15.37:0/3169950951 wait complete. 2024-05-30T06:59:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.921+0000 7f6cd5600640 1 Processor -- start 2024-05-30T06:59:52.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.921+0000 7f6cd5600640 1 -- start start 2024-05-30T06:59:52.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cd5600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6cb4004810 0x7f6cd0161180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:52.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cd5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cd00b4ee0 0x7f6cd0162d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:52.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cd5600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0152230 0x7f6cd01526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cd5600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd006fb80 con 0x7f6cd00b4ee0 2024-05-30T06:59:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cd5600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6cd006fa00 con 0x7f6cd0152230 2024-05-30T06:59:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cd5600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6cd006fd00 con 0x7f6cb4004810 2024-05-30T06:59:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cc7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cd00b4ee0 0x7f6cd0162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cc7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cd00b4ee0 0x7f6cd0162d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42864/0 (socket says 172.21.15.37:42864) 2024-05-30T06:59:52.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cc7e00640 1 -- 172.21.15.37:0/2923044030 learned_addr learned my addr 172.21.15.37:0/2923044030 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:52.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6ccfe00640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6cb4004810 0x7f6cd0161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:52.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cd4c00640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0152230 0x7f6cd01526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:52.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cc7e00640 1 -- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6cb4004810 msgr2=0x7f6cd0161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:52.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cc7e00640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6cb4004810 0x7f6cd0161180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:52.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cc7e00640 1 -- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0152230 msgr2=0x7f6cd01526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:52.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cc7e00640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0152230 0x7f6cd01526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:52.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cc7e00640 1 -- 172.21.15.37:0/2923044030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cd0161840 con 0x7f6cd00b4ee0 2024-05-30T06:59:52.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cc7e00640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cd00b4ee0 0x7f6cd0162d90 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8007040 tx=0x7f6cb4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:52.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.925+0000 7f6cd4c00640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0152230 0x7f6cd01526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T06:59:52.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.929+0000 7f6cccc00640 1 -- 172.21.15.37:0/2923044030 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8004cc0 con 0x7f6cd00b4ee0 2024-05-30T06:59:52.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.929+0000 7f6cccc00640 1 -- 172.21.15.37:0/2923044030 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb80070d0 con 0x7f6cd00b4ee0 2024-05-30T06:59:52.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.929+0000 7f6cccc00640 1 -- 172.21.15.37:0/2923044030 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8004e60 con 0x7f6cd00b4ee0 2024-05-30T06:59:52.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.929+0000 7f6cd5600640 1 -- 172.21.15.37:0/2923044030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cd0161b20 con 0x7f6cd00b4ee0 2024-05-30T06:59:52.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.929+0000 7f6cd5600640 1 -- 172.21.15.37:0/2923044030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cd01620e0 con 0x7f6cd00b4ee0 2024-05-30T06:59:52.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.929+0000 7f6cd5600640 1 -- 172.21.15.37:0/2923044030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd0068700 con 0x7f6cd00b4ee0 2024-05-30T06:59:52.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.929+0000 7f6cccc00640 1 -- 172.21.15.37:0/2923044030 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 47) ==== 90894+0+0 (secure 0 0 0) 0x7f6cb80074a0 con 0x7f6cd00b4ee0 2024-05-30T06:59:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.933+0000 7f6cccc00640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6cac06a390 0x7f6cac06c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.933+0000 7f6cccc00640 1 -- 172.21.15.37:0/2923044030 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5793+0+0 (secure 0 0 0) 0x7f6cb811f050 con 0x7f6cd00b4ee0 2024-05-30T06:59:52.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.937+0000 7f6ccfe00640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6cac06a390 0x7f6cac06c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:52.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.941+0000 7f6cccc00640 1 -- 172.21.15.37:0/2923044030 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6cb80bf030 con 0x7f6cd00b4ee0 2024-05-30T06:59:52.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:52.941+0000 7f6ccfe00640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6cac06a390 0x7f6cac06c850 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0006aa0 tx=0x7f6cc0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:53.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:53.261+0000 7f6cd5600640 1 -- 172.21.15.37:0/2923044030 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone52195", "target": ["mon-mgr", ""]}) -- 0x7f6cd0068ab0 con 0x7f6cac06a390 2024-05-30T06:59:53.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:53.413+0000 7f6cccc00640 1 -- 172.21.15.37:0/2923044030 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 48) ==== 90945+0+0 (secure 0 0 0) 0x7f6cb80ecfe0 con 0x7f6cd00b4ee0 2024-05-30T06:59:54.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.217+0000 7f6cccc00640 1 -- 172.21.15.37:0/2923044030 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6cd0068ab0 con 0x7f6cac06a390 2024-05-30T06:59:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.221+0000 7f6cd5600640 1 -- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6cac06a390 msgr2=0x7f6cac06c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.221+0000 7f6cd5600640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6cac06a390 0x7f6cac06c850 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0006aa0 tx=0x7f6cc0008040 comp rx=0 tx=0).stop 2024-05-30T06:59:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.221+0000 7f6cd5600640 1 -- 172.21.15.37:0/2923044030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cd00b4ee0 msgr2=0x7f6cd0162d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.221+0000 7f6cd5600640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cd00b4ee0 0x7f6cd0162d90 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8007040 tx=0x7f6cb4005840 comp rx=0 tx=0).stop 2024-05-30T06:59:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.221+0000 7f6cd5600640 1 -- 172.21.15.37:0/2923044030 shutdown_connections 2024-05-30T06:59:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.221+0000 7f6cd5600640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f6cac06a390 0x7f6cac06c850 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.221+0000 7f6cd5600640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6cd0152230 0x7f6cd01526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.221+0000 7f6cd5600640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cd00b4ee0 0x7f6cd0162d90 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.221+0000 7f6cd5600640 1 --2- 172.21.15.37:0/2923044030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6cb4004810 0x7f6cd0161180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.221+0000 7f6cd5600640 1 -- 172.21.15.37:0/2923044030 >> 172.21.15.37:0/2923044030 conn(0x7f6cd0067d60 msgr2=0x7f6cd0141790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.221+0000 7f6cd5600640 1 -- 172.21.15.37:0/2923044030 shutdown_connections 2024-05-30T06:59:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.221+0000 7f6cd5600640 1 -- 172.21.15.37:0/2923044030 wait complete. 2024-05-30T06:59:54.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone52196 2024-05-30T06:59:54.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.401+0000 7f0981e00640 1 Processor -- start 2024-05-30T06:59:54.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.401+0000 7f0981e00640 1 -- start start 2024-05-30T06:59:54.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.401+0000 7f0981e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097c15c9c0 0x7f097c0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:54.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.401+0000 7f0981e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f097c0d1db0 0x7f097c160400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:54.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.401+0000 7f0981e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f097c0ce9e0 0x7f097c160940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:54.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.401+0000 7f0981e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f097c0d1290 con 0x7f097c0ce9e0 2024-05-30T06:59:54.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.401+0000 7f0981e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f097c0d09f0 con 0x7f097c0d1db0 2024-05-30T06:59:54.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.401+0000 7f0981e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f097c0d0cd0 con 0x7f097c15c9c0 2024-05-30T06:59:54.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.401+0000 7f097b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f097c0ce9e0 0x7f097c160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:54.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.401+0000 7f097aa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097c15c9c0 0x7f097c0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:54.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.401+0000 7f097b400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f097c0ce9e0 0x7f097c160940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42874/0 (socket says 172.21.15.37:42874) 2024-05-30T06:59:54.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.401+0000 7f097b400640 1 -- 172.21.15.37:0/3060011094 learned_addr learned my addr 172.21.15.37:0/3060011094 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:54.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.401+0000 7f097a000640 1 --2- 172.21.15.37:0/3060011094 >> v2:172.21.15.105:3300/0 conn(0x7f097c0d1db0 0x7f097c160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:54.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f097b400640 1 -- 172.21.15.37:0/3060011094 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097c15c9c0 msgr2=0x7f097c0ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:54.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f097b400640 1 --2- 172.21.15.37:0/3060011094 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097c15c9c0 0x7f097c0ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:54.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f097b400640 1 -- 172.21.15.37:0/3060011094 >> v2:172.21.15.105:3300/0 conn(0x7f097c0d1db0 msgr2=0x7f097c160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:54.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f097b400640 1 --2- 172.21.15.37:0/3060011094 >> v2:172.21.15.105:3300/0 conn(0x7f097c0d1db0 0x7f097c160400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:54.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f097b400640 1 -- 172.21.15.37:0/3060011094 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097c0d0fb0 con 0x7f097c0ce9e0 2024-05-30T06:59:54.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f097b400640 1 --2- 172.21.15.37:0/3060011094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c0ce9e0 0x7f097c160940 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f097c09b190 tx=0x7f097401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9490a3d675a88370 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:54.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f0979600640 1 -- 172.21.15.37:0/3060011094 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09740a55e0 con 0x7f097c0ce9e0 2024-05-30T06:59:54.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f0979600640 1 -- 172.21.15.37:0/3060011094 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09740a5780 con 0x7f097c0ce9e0 2024-05-30T06:59:54.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f0979600640 1 -- 172.21.15.37:0/3060011094 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09740a5b50 con 0x7f097c0ce9e0 2024-05-30T06:59:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f0981e00640 1 -- 172.21.15.37:0/3060011094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c0ce9e0 msgr2=0x7f097c160940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f0981e00640 1 --2- 172.21.15.37:0/3060011094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c0ce9e0 0x7f097c160940 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f097c09b190 tx=0x7f097401c960 comp rx=0 tx=0).stop 2024-05-30T06:59:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f0981e00640 1 -- 172.21.15.37:0/3060011094 shutdown_connections 2024-05-30T06:59:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f0981e00640 1 --2- 172.21.15.37:0/3060011094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c0ce9e0 0x7f097c160940 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f0981e00640 1 --2- 172.21.15.37:0/3060011094 >> v2:172.21.15.105:3300/0 conn(0x7f097c0d1db0 0x7f097c160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f0981e00640 1 --2- 172.21.15.37:0/3060011094 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097c15c9c0 0x7f097c0ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.405+0000 7f0981e00640 1 -- 172.21.15.37:0/3060011094 >> 172.21.15.37:0/3060011094 conn(0x7f097c09aa60 msgr2=0x7f097c0d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:54.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.409+0000 7f0981e00640 1 -- 172.21.15.37:0/3060011094 shutdown_connections 2024-05-30T06:59:54.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.409+0000 7f0981e00640 1 -- 172.21.15.37:0/3060011094 wait complete. 2024-05-30T06:59:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.409+0000 7f0981e00640 1 Processor -- start 2024-05-30T06:59:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.409+0000 7f0981e00640 1 -- start start 2024-05-30T06:59:54.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f0981e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c0ce9e0 0x7f097c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:54.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f0981e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097c0d1db0 0x7f097c15b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:54.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f0981e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097c15c9c0 0x7f097c0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f0981e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f097c0cf3e0 con 0x7f097c0ce9e0 2024-05-30T06:59:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f0981e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f097c0cf260 con 0x7f097c0d1db0 2024-05-30T06:59:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f0981e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f097c0cf560 con 0x7f097c15c9c0 2024-05-30T06:59:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f097aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c0ce9e0 0x7f097c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f097aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c0ce9e0 0x7f097c0b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42888/0 (socket says 172.21.15.37:42888) 2024-05-30T06:59:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f097aa00640 1 -- 172.21.15.37:0/672181404 learned_addr learned my addr 172.21.15.37:0/672181404 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f097b400640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097c15c9c0 0x7f097c0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:54.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f097a000640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097c0d1db0 0x7f097c15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f097aa00640 1 -- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097c15c9c0 msgr2=0x7f097c0703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f097aa00640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097c15c9c0 0x7f097c0703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f097aa00640 1 -- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097c0d1db0 msgr2=0x7f097c15b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f097aa00640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097c0d1db0 0x7f097c15b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f097aa00640 1 -- 172.21.15.37:0/672181404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097c06f320 con 0x7f097c0ce9e0 2024-05-30T06:59:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f097b400640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097c15c9c0 0x7f097c0703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T06:59:54.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f097aa00640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c0ce9e0 0x7f097c0b6260 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f096c00e870 tx=0x7f096c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:54.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f0973400640 1 -- 172.21.15.37:0/672181404 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096c017070 con 0x7f097c0ce9e0 2024-05-30T06:59:54.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f0973400640 1 -- 172.21.15.37:0/672181404 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f096c00c940 con 0x7f097c0ce9e0 2024-05-30T06:59:54.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f0973400640 1 -- 172.21.15.37:0/672181404 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096c00ccf0 con 0x7f097c0ce9e0 2024-05-30T06:59:54.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f0981e00640 1 -- 172.21.15.37:0/672181404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f097c06f600 con 0x7f097c0ce9e0 2024-05-30T06:59:54.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.413+0000 7f0981e00640 1 -- 172.21.15.37:0/672181404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f097c06fbc0 con 0x7f097c0ce9e0 2024-05-30T06:59:54.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.417+0000 7f0981e00640 1 -- 172.21.15.37:0/672181404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f097c068bc0 con 0x7f097c0ce9e0 2024-05-30T06:59:54.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.421+0000 7f0973400640 1 -- 172.21.15.37:0/672181404 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 48) ==== 90945+0+0 (secure 0 0 0) 0x7f096c01a070 con 0x7f097c0ce9e0 2024-05-30T06:59:54.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.421+0000 7f0973400640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f095c06a470 0x7f095c06c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:54.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.421+0000 7f0973400640 1 -- 172.21.15.37:0/672181404 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f096c085f50 con 0x7f097c0ce9e0 2024-05-30T06:59:54.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.421+0000 7f097a000640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f095c06a470 0x7f095c06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:54.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.421+0000 7f097a000640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f095c06a470 0x7f095c06c930 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f097c153090 tx=0x7f0968009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:54.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.425+0000 7f0973400640 1 -- 172.21.15.37:0/672181404 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f096c057aa0 con 0x7f097c0ce9e0 2024-05-30T06:59:54.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:54.789+0000 7f0981e00640 1 -- 172.21.15.37:0/672181404 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone52196", "target": ["mon-mgr", ""]}) -- 0x7f097c0b7400 con 0x7f095c06a470 2024-05-30T06:59:56.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.193+0000 7f0973400640 1 -- 172.21.15.37:0/672181404 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f097c0b7400 con 0x7f095c06a470 2024-05-30T06:59:56.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.197+0000 7f0981e00640 1 -- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f095c06a470 msgr2=0x7f095c06c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:56.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.197+0000 7f0981e00640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f095c06a470 0x7f095c06c930 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f097c153090 tx=0x7f0968009190 comp rx=0 tx=0).stop 2024-05-30T06:59:56.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.197+0000 7f0981e00640 1 -- 172.21.15.37:0/672181404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c0ce9e0 msgr2=0x7f097c0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:56.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.197+0000 7f0981e00640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c0ce9e0 0x7f097c0b6260 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f096c00e870 tx=0x7f096c00ec70 comp rx=0 tx=0).stop 2024-05-30T06:59:56.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.197+0000 7f0981e00640 1 -- 172.21.15.37:0/672181404 shutdown_connections 2024-05-30T06:59:56.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.197+0000 7f0981e00640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f097c15c9c0 0x7f097c0703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:56.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.197+0000 7f0981e00640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f095c06a470 0x7f095c06c930 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:56.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.197+0000 7f0981e00640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f097c0d1db0 0x7f097c15b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:56.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.197+0000 7f0981e00640 1 --2- 172.21.15.37:0/672181404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f097c0ce9e0 0x7f097c0b6260 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:56.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.197+0000 7f0981e00640 1 -- 172.21.15.37:0/672181404 >> 172.21.15.37:0/672181404 conn(0x7f097c09aa60 msgr2=0x7f097c0b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:56.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.197+0000 7f0981e00640 1 -- 172.21.15.37:0/672181404 shutdown_connections 2024-05-30T06:59:56.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.197+0000 7f0981e00640 1 -- 172.21.15.37:0/672181404 wait complete. 2024-05-30T06:59:56.243 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs sv1 ss1 subvol_clone52197 2024-05-30T06:59:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.501+0000 7f20dfa00640 1 Processor -- start 2024-05-30T06:59:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.501+0000 7f20dfa00640 1 -- start start 2024-05-30T06:59:56.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20dfa00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f20d815ebc0 0x7f20d80d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:56.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20dfa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20d809b800 0x7f20d806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20dfa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d806dcf0 0x7f20d809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20dfa00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f20d80d0840 con 0x7f20d809b800 2024-05-30T06:59:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20dfa00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f20d809bce0 con 0x7f20d815ebc0 2024-05-30T06:59:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20dfa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f20d80d0ae0 con 0x7f20d806dcf0 2024-05-30T06:59:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20d7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20d809b800 0x7f20d806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20d7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f20d809b800 0x7f20d806d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42894/0 (socket says 172.21.15.37:42894) 2024-05-30T06:59:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20d7e00640 1 -- 172.21.15.37:0/3240341892 learned_addr learned my addr 172.21.15.37:0/3240341892 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20d7e00640 1 -- 172.21.15.37:0/3240341892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d806dcf0 msgr2=0x7f20d809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T06:59:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20d7e00640 1 --2- 172.21.15.37:0/3240341892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d806dcf0 0x7f20d809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20d7e00640 1 -- 172.21.15.37:0/3240341892 >> v2:172.21.15.105:3300/0 conn(0x7f20d815ebc0 msgr2=0x7f20d80d15c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T06:59:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20d7e00640 1 --2- 172.21.15.37:0/3240341892 >> v2:172.21.15.105:3300/0 conn(0x7f20d815ebc0 0x7f20d80d15c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.505+0000 7f20d7e00640 1 -- 172.21.15.37:0/3240341892 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d80d0dc0 con 0x7f20d809b800 2024-05-30T06:59:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.513+0000 7f20d7e00640 1 --2- 172.21.15.37:0/3240341892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d809b800 0x7f20d806d7b0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f20d8073610 tx=0x7f20c401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3716518c582f33eb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.513+0000 7f20d7400640 1 -- 172.21.15.37:0/3240341892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c40b0070 con 0x7f20d809b800 2024-05-30T06:59:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.513+0000 7f20d7400640 1 -- 172.21.15.37:0/3240341892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c40ab600 con 0x7f20d809b800 2024-05-30T06:59:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.513+0000 7f20d7400640 1 -- 172.21.15.37:0/3240341892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c40b0070 con 0x7f20d809b800 2024-05-30T06:59:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.513+0000 7f20dfa00640 1 -- 172.21.15.37:0/3240341892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d809b800 msgr2=0x7f20d806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.513+0000 7f20dfa00640 1 --2- 172.21.15.37:0/3240341892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d809b800 0x7f20d806d7b0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f20d8073610 tx=0x7f20c401c540 comp rx=0 tx=0).stop 2024-05-30T06:59:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.517+0000 7f20dfa00640 1 -- 172.21.15.37:0/3240341892 shutdown_connections 2024-05-30T06:59:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.517+0000 7f20dfa00640 1 --2- 172.21.15.37:0/3240341892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d806dcf0 0x7f20d809aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.517+0000 7f20dfa00640 1 --2- 172.21.15.37:0/3240341892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d809b800 0x7f20d806d7b0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.517+0000 7f20dfa00640 1 --2- 172.21.15.37:0/3240341892 >> v2:172.21.15.105:3300/0 conn(0x7f20d815ebc0 0x7f20d80d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.517+0000 7f20dfa00640 1 -- 172.21.15.37:0/3240341892 >> 172.21.15.37:0/3240341892 conn(0x7f20d80b4060 msgr2=0x7f20d80b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.517+0000 7f20dfa00640 1 -- 172.21.15.37:0/3240341892 shutdown_connections 2024-05-30T06:59:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.517+0000 7f20dfa00640 1 -- 172.21.15.37:0/3240341892 wait complete. 2024-05-30T06:59:56.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.521+0000 7f20dfa00640 1 Processor -- start 2024-05-30T06:59:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.521+0000 7f20dfa00640 1 -- start start 2024-05-30T06:59:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20dfa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d806dcf0 0x7f20d8158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20dfa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d809b800 0x7f20d8157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20dfa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d815ebc0 0x7f20d80c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20dfa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20d80cd550 con 0x7f20d809b800 2024-05-30T06:59:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20dfa00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20d80cd3d0 con 0x7f20d806dcf0 2024-05-30T06:59:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20dfa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f20d8162730 con 0x7f20d815ebc0 2024-05-30T06:59:56.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20d7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d809b800 0x7f20d8157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:56.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20dda00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d815ebc0 0x7f20d80c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:56.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20dda00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d815ebc0 0x7f20d80c7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:37592/0 (socket says 172.21.15.37:37592) 2024-05-30T06:59:56.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20dda00640 1 -- 172.21.15.37:0/605334803 learned_addr learned my addr 172.21.15.37:0/605334803 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T06:59:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20d7e00640 1 -- 172.21.15.37:0/605334803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d815ebc0 msgr2=0x7f20d80c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20d7e00640 1 --2- 172.21.15.37:0/605334803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d815ebc0 0x7f20d80c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20d7e00640 1 -- 172.21.15.37:0/605334803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d806dcf0 msgr2=0x7f20d8158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20d7e00640 1 --2- 172.21.15.37:0/605334803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d806dcf0 0x7f20d8158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20d7e00640 1 -- 172.21.15.37:0/605334803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d81576b0 con 0x7f20d809b800 2024-05-30T06:59:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20d7e00640 1 --2- 172.21.15.37:0/605334803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d809b800 0x7f20d8157170 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f20c40ab000 tx=0x7f20c40192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:56.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.525+0000 7f20d4c00640 1 -- 172.21.15.37:0/605334803 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c40b0040 con 0x7f20d809b800 2024-05-30T06:59:56.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.529+0000 7f20d4c00640 1 -- 172.21.15.37:0/605334803 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c40bb070 con 0x7f20d809b800 2024-05-30T06:59:56.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.529+0000 7f20d4c00640 1 -- 172.21.15.37:0/605334803 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c40abdb0 con 0x7f20d809b800 2024-05-30T06:59:56.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.529+0000 7f20dfa00640 1 -- 172.21.15.37:0/605334803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d80b5b60 con 0x7f20d809b800 2024-05-30T06:59:56.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.529+0000 7f20dfa00640 1 -- 172.21.15.37:0/605334803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d8157980 con 0x7f20d809b800 2024-05-30T06:59:56.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.533+0000 7f20d4c00640 1 -- 172.21.15.37:0/605334803 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 48) ==== 90945+0+0 (secure 0 0 0) 0x7f20c4003620 con 0x7f20d809b800 2024-05-30T06:59:56.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.533+0000 7f20d4c00640 1 --2- 172.21.15.37:0/605334803 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20b806a420 0x7f20b806c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T06:59:56.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.533+0000 7f20d4c00640 1 -- 172.21.15.37:0/605334803 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f20c4120020 con 0x7f20d809b800 2024-05-30T06:59:56.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.537+0000 7f20dfa00640 1 -- 172.21.15.37:0/605334803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d8068bc0 con 0x7f20d809b800 2024-05-30T06:59:56.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.545+0000 7f20d4c00640 1 -- 172.21.15.37:0/605334803 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f20c4016130 con 0x7f20d809b800 2024-05-30T06:59:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.561+0000 7f20dd000640 1 --2- 172.21.15.37:0/605334803 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20b806a420 0x7f20b806c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T06:59:56.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.581+0000 7f20dd000640 1 --2- 172.21.15.37:0/605334803 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20b806a420 0x7f20b806c8e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f20d815c750 tx=0x7f20cc006bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T06:59:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:56.897+0000 7f20dfa00640 1 -- 172.21.15.37:0/605334803 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target_sub_name": "subvol_clone52197", "target": ["mon-mgr", ""]}) -- 0x7f20d80713e0 con 0x7f20b806a420 2024-05-30T06:59:57.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:57.765+0000 7f20d4c00640 1 -- 172.21.15.37:0/605334803 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f20d80713e0 con 0x7f20b806a420 2024-05-30T06:59:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:57.765+0000 7f20dfa00640 1 -- 172.21.15.37:0/605334803 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20b806a420 msgr2=0x7f20b806c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:57.765+0000 7f20dfa00640 1 --2- 172.21.15.37:0/605334803 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20b806a420 0x7f20b806c8e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f20d815c750 tx=0x7f20cc006bb0 comp rx=0 tx=0).stop 2024-05-30T06:59:57.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:57.765+0000 7f20dfa00640 1 -- 172.21.15.37:0/605334803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d809b800 msgr2=0x7f20d8157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T06:59:57.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:57.765+0000 7f20dfa00640 1 --2- 172.21.15.37:0/605334803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d809b800 0x7f20d8157170 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f20c40ab000 tx=0x7f20c40192e0 comp rx=0 tx=0).stop 2024-05-30T06:59:57.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:57.765+0000 7f20dfa00640 1 -- 172.21.15.37:0/605334803 shutdown_connections 2024-05-30T06:59:57.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:57.765+0000 7f20dfa00640 1 --2- 172.21.15.37:0/605334803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d815ebc0 0x7f20d80c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:57.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:57.765+0000 7f20dfa00640 1 --2- 172.21.15.37:0/605334803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20d809b800 0x7f20d8157170 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:57.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:57.765+0000 7f20dfa00640 1 --2- 172.21.15.37:0/605334803 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f20b806a420 0x7f20b806c8e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:57.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:57.765+0000 7f20dfa00640 1 --2- 172.21.15.37:0/605334803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d806dcf0 0x7f20d8158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T06:59:57.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:57.765+0000 7f20dfa00640 1 -- 172.21.15.37:0/605334803 >> 172.21.15.37:0/605334803 conn(0x7f20d80b4060 msgr2=0x7f20d8074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T06:59:57.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:57.765+0000 7f20dfa00640 1 -- 172.21.15.37:0/605334803 shutdown_connections 2024-05-30T06:59:57.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T06:59:57.765+0000 7f20dfa00640 1 -- 172.21.15.37:0/605334803 wait complete. 2024-05-30T07:00:02.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone52191 2024-05-30T07:00:03.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.045+0000 7f6971600640 1 Processor -- start 2024-05-30T07:00:03.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.045+0000 7f6971600640 1 -- start start 2024-05-30T07:00:03.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.045+0000 7f6971600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f696c0cd440 0x7f696c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:03.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.049+0000 7f6971600640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f696c06f5a0 0x7f696c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:03.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.049+0000 7f6971600640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f696c15f310 con 0x7f696c155da0 2024-05-30T07:00:03.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.049+0000 7f6971600640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f696c06fa10 con 0x7f696c0cd440 2024-05-30T07:00:03.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.049+0000 7f6971600640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f696c15f5f0 con 0x7f696c06f5a0 2024-05-30T07:00:03.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.049+0000 7f696aa00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f696c155da0 0x7f696c0cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42800/0 (socket says 172.21.15.37:42800) 2024-05-30T07:00:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.049+0000 7f696aa00640 1 -- 172.21.15.37:0/2702389457 learned_addr learned my addr 172.21.15.37:0/2702389457 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:00:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.049+0000 7f696a000640 1 --2- 172.21.15.37:0/2702389457 >> v2:172.21.15.37:3300/0 conn(0x7f696c0cd440 0x7f696c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.049+0000 7f696b400640 1 --2- 172.21.15.37:0/2702389457 >> v2:172.21.15.105:3300/0 conn(0x7f696c06f5a0 0x7f696c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.049+0000 7f696a000640 1 -- 172.21.15.37:0/2702389457 >> v2:172.21.15.105:3300/0 conn(0x7f696c06f5a0 msgr2=0x7f696c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.049+0000 7f696a000640 1 --2- 172.21.15.37:0/2702389457 >> v2:172.21.15.105:3300/0 conn(0x7f696c06f5a0 0x7f696c0b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.049+0000 7f696a000640 1 -- 172.21.15.37:0/2702389457 >> v1:172.21.15.37:6789/0 conn(0x7f696c155da0 legacy=0x7f696c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:03.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.049+0000 7f696a000640 1 -- 172.21.15.37:0/2702389457 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696c15f8d0 con 0x7f696c0cd440 2024-05-30T07:00:03.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.049+0000 7f6969600640 1 -- 172.21.15.37:0/2702389457 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 699006552 0 0) 0x7f696c15f310 con 0x7f696c155da0 2024-05-30T07:00:03.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.053+0000 7f696a000640 1 --2- 172.21.15.37:0/2702389457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f696c0cd440 0x7f696c06f060 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f696c0b6600 tx=0x7f695801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60fe4d4a2b39a74 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:03.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.053+0000 7f6969600640 1 -- 172.21.15.37:0/2702389457 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69580b0070 con 0x7f696c0cd440 2024-05-30T07:00:03.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.053+0000 7f6969600640 1 -- 172.21.15.37:0/2702389457 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69580ab600 con 0x7f696c0cd440 2024-05-30T07:00:03.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.053+0000 7f6969600640 1 -- 172.21.15.37:0/2702389457 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69580ab9d0 con 0x7f696c0cd440 2024-05-30T07:00:03.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.053+0000 7f6971600640 1 -- 172.21.15.37:0/2702389457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f696c0cd440 msgr2=0x7f696c06f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:03.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.053+0000 7f6971600640 1 --2- 172.21.15.37:0/2702389457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f696c0cd440 0x7f696c06f060 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f696c0b6600 tx=0x7f695801c360 comp rx=0 tx=0).stop 2024-05-30T07:00:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.053+0000 7f6971600640 1 -- 172.21.15.37:0/2702389457 shutdown_connections 2024-05-30T07:00:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.053+0000 7f6971600640 1 --2- 172.21.15.37:0/2702389457 >> v2:172.21.15.105:3300/0 conn(0x7f696c06f5a0 0x7f696c0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.053+0000 7f6971600640 1 --2- 172.21.15.37:0/2702389457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f696c0cd440 0x7f696c06f060 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.053+0000 7f6971600640 1 -- 172.21.15.37:0/2702389457 >> 172.21.15.37:0/2702389457 conn(0x7f696c06bf60 msgr2=0x7f696c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.053+0000 7f6971600640 1 -- 172.21.15.37:0/2702389457 shutdown_connections 2024-05-30T07:00:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.053+0000 7f6971600640 1 -- 172.21.15.37:0/2702389457 wait complete. 2024-05-30T07:00:03.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.057+0000 7f6971600640 1 Processor -- start 2024-05-30T07:00:03.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.057+0000 7f6971600640 1 -- start start 2024-05-30T07:00:03.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f6971600640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f696c06f5a0 0x7f696c158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:03.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f6971600640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f696c155da0 0x7f696c147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:03.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f6971600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f696c148700 0x7f696c157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:03.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f6971600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f696c168580 con 0x7f696c148700 2024-05-30T07:00:03.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f6971600640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f696c0b46f0 con 0x7f696c06f5a0 2024-05-30T07:00:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f6971600640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f696c168700 con 0x7f696c155da0 2024-05-30T07:00:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f696b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f696c148700 0x7f696c157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f696b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f696c148700 0x7f696c157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43564/0 (socket says 172.21.15.37:43564) 2024-05-30T07:00:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f696b400640 1 -- 172.21.15.37:0/40514557 learned_addr learned my addr 172.21.15.37:0/40514557 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f696a000640 1 --2- 172.21.15.37:0/40514557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f696c155da0 0x7f696c147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f696b400640 1 -- 172.21.15.37:0/40514557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f696c155da0 msgr2=0x7f696c147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f696b400640 1 --2- 172.21.15.37:0/40514557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f696c155da0 0x7f696c147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f696b400640 1 -- 172.21.15.37:0/40514557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f696c06f5a0 msgr2=0x7f696c158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f696b400640 1 --2- 172.21.15.37:0/40514557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f696c06f5a0 0x7f696c158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f696b400640 1 -- 172.21.15.37:0/40514557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696c14aeb0 con 0x7f696c148700 2024-05-30T07:00:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f696b400640 1 --2- 172.21.15.37:0/40514557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f696c148700 0x7f696c157520 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f6964007360 tx=0x7f6964007760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f6962a00640 1 -- 172.21.15.37:0/40514557 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696401f070 con 0x7f696c148700 2024-05-30T07:00:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f6971600640 1 -- 172.21.15.37:0/40514557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696c148510 con 0x7f696c148700 2024-05-30T07:00:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f6962a00640 1 -- 172.21.15.37:0/40514557 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f696401a410 con 0x7f696c148700 2024-05-30T07:00:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f6962a00640 1 -- 172.21.15.37:0/40514557 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696401a7e0 con 0x7f696c148700 2024-05-30T07:00:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.061+0000 7f6971600640 1 -- 172.21.15.37:0/40514557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f696c14c5f0 con 0x7f696c148700 2024-05-30T07:00:03.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.065+0000 7f6971600640 1 -- 172.21.15.37:0/40514557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f696c0b6790 con 0x7f696c148700 2024-05-30T07:00:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.069+0000 7f6962a00640 1 -- 172.21.15.37:0/40514557 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 48) ==== 90945+0+0 (secure 0 0 0) 0x7f6964022070 con 0x7f696c148700 2024-05-30T07:00:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.069+0000 7f6962a00640 1 --2- 172.21.15.37:0/40514557 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f694c06a450 0x7f694c06c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.069+0000 7f6962a00640 1 -- 172.21.15.37:0/40514557 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f6964089fa0 con 0x7f696c148700 2024-05-30T07:00:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.077+0000 7f6962a00640 1 -- 172.21.15.37:0/40514557 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6964029020 con 0x7f696c148700 2024-05-30T07:00:03.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.133+0000 7f696aa00640 1 --2- 172.21.15.37:0/40514557 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f694c06a450 0x7f694c06c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:03.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.165+0000 7f696aa00640 1 --2- 172.21.15.37:0/40514557 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f694c06a450 0x7f694c06c910 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f695c007fd0 tx=0x7f695c007920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:03.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:03.437+0000 7f6971600640 1 -- 172.21.15.37:0/40514557 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone52191", "target": ["mon-mgr", ""]}) -- 0x7f696c153560 con 0x7f694c06a450 2024-05-30T07:00:03.504 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:03.506+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:03.505 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:03.506+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:03.505 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:03.506+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:03.505 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:03.506+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:03.505 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:03.506+0000 7f004c600640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:04.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.577+0000 7f6962a00640 1 -- 172.21.15.37:0/40514557 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f696c153560 con 0x7f694c06a450 2024-05-30T07:00:04.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.585+0000 7f6971600640 1 -- 172.21.15.37:0/40514557 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f694c06a450 msgr2=0x7f694c06c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:04.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.585+0000 7f6971600640 1 --2- 172.21.15.37:0/40514557 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f694c06a450 0x7f694c06c910 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f695c007fd0 tx=0x7f695c007920 comp rx=0 tx=0).stop 2024-05-30T07:00:04.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.585+0000 7f6971600640 1 -- 172.21.15.37:0/40514557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f696c148700 msgr2=0x7f696c157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:04.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.585+0000 7f6971600640 1 --2- 172.21.15.37:0/40514557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f696c148700 0x7f696c157520 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f6964007360 tx=0x7f6964007760 comp rx=0 tx=0).stop 2024-05-30T07:00:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.585+0000 7f6971600640 1 -- 172.21.15.37:0/40514557 shutdown_connections 2024-05-30T07:00:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.585+0000 7f6971600640 1 --2- 172.21.15.37:0/40514557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f696c148700 0x7f696c157520 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.585+0000 7f6971600640 1 --2- 172.21.15.37:0/40514557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f696c155da0 0x7f696c147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.585+0000 7f6971600640 1 --2- 172.21.15.37:0/40514557 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f694c06a450 0x7f694c06c910 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.585+0000 7f6971600640 1 --2- 172.21.15.37:0/40514557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f696c06f5a0 0x7f696c158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.585+0000 7f6971600640 1 -- 172.21.15.37:0/40514557 >> 172.21.15.37:0/40514557 conn(0x7f696c06bf60 msgr2=0x7f696c0aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.585+0000 7f6971600640 1 -- 172.21.15.37:0/40514557 shutdown_connections 2024-05-30T07:00:04.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.585+0000 7f6971600640 1 -- 172.21.15.37:0/40514557 wait complete. 2024-05-30T07:00:04.631 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone52192 2024-05-30T07:00:04.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.881+0000 7fdf06400640 1 Processor -- start 2024-05-30T07:00:04.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.881+0000 7fdf06400640 1 -- start start 2024-05-30T07:00:04.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.885+0000 7fdf06400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf00162e70 0x7fdf000cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:04.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.885+0000 7fdf06400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf00163250 0x7fdf001636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.885+0000 7fdf06400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf00164190 con 0x7fdf001668a0 2024-05-30T07:00:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.885+0000 7fdf06400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0006f8e0 con 0x7fdf00163250 2024-05-30T07:00:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.885+0000 7fdf06400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0006ecd0 con 0x7fdf00162e70 2024-05-30T07:00:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.885+0000 7fdefea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf00163250 0x7fdf001636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.885+0000 7fdefea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf00163250 0x7fdf001636d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43580/0 (socket says 172.21.15.37:43580) 2024-05-30T07:00:04.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.885+0000 7fdefea00640 1 -- 172.21.15.37:0/3141817196 learned_addr learned my addr 172.21.15.37:0/3141817196 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.885+0000 7fdefea00640 1 -- 172.21.15.37:0/3141817196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf00162e70 msgr2=0x7fdf000cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.885+0000 7fdefea00640 1 --2- 172.21.15.37:0/3141817196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf00162e70 0x7fdf000cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:04.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.885+0000 7fdefea00640 1 -- 172.21.15.37:0/3141817196 >> v1:172.21.15.105:6789/0 conn(0x7fdf001668a0 legacy=0x7fdf00166d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:04.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.885+0000 7fdefea00640 1 -- 172.21.15.37:0/3141817196 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0006efb0 con 0x7fdf00163250 2024-05-30T07:00:04.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.889+0000 7fdefea00640 1 --2- 172.21.15.37:0/3141817196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00163250 0x7fdf001636d0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009870 tx=0x7fdeec01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d6beb371ab524b server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:04.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.889+0000 7fdefe000640 1 -- 172.21.15.37:0/3141817196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0ab620 con 0x7fdf00163250 2024-05-30T07:00:04.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.889+0000 7fdefe000640 1 -- 172.21.15.37:0/3141817196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeec0b0070 con 0x7fdf00163250 2024-05-30T07:00:04.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.889+0000 7fdefe000640 1 -- 172.21.15.37:0/3141817196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0ab9e0 con 0x7fdf00163250 2024-05-30T07:00:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.889+0000 7fdf06400640 1 -- 172.21.15.37:0/3141817196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00163250 msgr2=0x7fdf001636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.889+0000 7fdf06400640 1 --2- 172.21.15.37:0/3141817196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00163250 0x7fdf001636d0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009870 tx=0x7fdeec01c460 comp rx=0 tx=0).stop 2024-05-30T07:00:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.889+0000 7fdf06400640 1 -- 172.21.15.37:0/3141817196 shutdown_connections 2024-05-30T07:00:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.889+0000 7fdf06400640 1 --2- 172.21.15.37:0/3141817196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00163250 0x7fdf001636d0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.889+0000 7fdf06400640 1 --2- 172.21.15.37:0/3141817196 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf00162e70 0x7fdf000cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.889+0000 7fdf06400640 1 -- 172.21.15.37:0/3141817196 >> 172.21.15.37:0/3141817196 conn(0x7fdf0006bf60 msgr2=0x7fdf000b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.889+0000 7fdf06400640 1 -- 172.21.15.37:0/3141817196 shutdown_connections 2024-05-30T07:00:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.889+0000 7fdf06400640 1 -- 172.21.15.37:0/3141817196 wait complete. 2024-05-30T07:00:04.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdf06400640 1 Processor -- start 2024-05-30T07:00:04.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdf06400640 1 -- start start 2024-05-30T07:00:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdf06400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00162e70 0x7fdf00150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdf06400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf00163250 0x7fdf001556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdf06400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf001668a0 0x7fdf00156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdf06400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdf000ccdf0 con 0x7fdf00162e70 2024-05-30T07:00:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdf06400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0006e960 con 0x7fdf001668a0 2024-05-30T07:00:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdf06400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdf000ccf70 con 0x7fdf00163250 2024-05-30T07:00:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdeff400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00162e70 0x7fdf00150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:04.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdeff400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00162e70 0x7fdf00150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43596/0 (socket says 172.21.15.37:43596) 2024-05-30T07:00:04.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdeff400640 1 -- 172.21.15.37:0/751226972 learned_addr learned my addr 172.21.15.37:0/751226972 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:04.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdeffe00640 1 --2- 172.21.15.37:0/751226972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf001668a0 0x7fdf00156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdeff400640 1 -- 172.21.15.37:0/751226972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf00163250 msgr2=0x7fdf001556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdeff400640 1 --2- 172.21.15.37:0/751226972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdf00163250 0x7fdf001556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdeff400640 1 -- 172.21.15.37:0/751226972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf001668a0 msgr2=0x7fdf00156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdeff400640 1 --2- 172.21.15.37:0/751226972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdf001668a0 0x7fdf00156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdeff400640 1 -- 172.21.15.37:0/751226972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf00151280 con 0x7fdf00162e70 2024-05-30T07:00:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdeff400640 1 --2- 172.21.15.37:0/751226972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf00162e70 0x7fdf00150ca0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fdef000b580 tx=0x7fdef000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdef7400640 1 -- 172.21.15.37:0/751226972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0014070 con 0x7fdf00162e70 2024-05-30T07:00:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdef7400640 1 -- 172.21.15.37:0/751226972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef0010890 con 0x7fdf00162e70 2024-05-30T07:00:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdef7400640 1 -- 172.21.15.37:0/751226972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0010c80 con 0x7fdf00162e70 2024-05-30T07:00:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdf06400640 1 -- 172.21.15.37:0/751226972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf00151560 con 0x7fdf00162e70 2024-05-30T07:00:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.893+0000 7fdf06400640 1 -- 172.21.15.37:0/751226972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf00151b20 con 0x7fdf00162e70 2024-05-30T07:00:04.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.897+0000 7fdf06400640 1 -- 172.21.15.37:0/751226972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf00068bc0 con 0x7fdf00162e70 2024-05-30T07:00:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.897+0000 7fdef7400640 1 -- 172.21.15.37:0/751226972 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 48) ==== 90945+0+0 (secure 0 0 0) 0x7fdef0017070 con 0x7fdf00162e70 2024-05-30T07:00:04.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.901+0000 7fdef7400640 1 --2- 172.21.15.37:0/751226972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdee006a420 0x7fdee006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:04.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.901+0000 7fdef7400640 1 -- 172.21.15.37:0/751226972 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fdef00858f0 con 0x7fdf00162e70 2024-05-30T07:00:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.905+0000 7fdefea00640 1 --2- 172.21.15.37:0/751226972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdee006a420 0x7fdee006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:04.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.905+0000 7fdef7400640 1 -- 172.21.15.37:0/751226972 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdef0057930 con 0x7fdf00162e70 2024-05-30T07:00:04.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:04.913+0000 7fdefea00640 1 --2- 172.21.15.37:0/751226972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdee006a420 0x7fdee006c8e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0af000 tx=0x7fdeec004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:05.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.281+0000 7fdf06400640 1 -- 172.21.15.37:0/751226972 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone52192", "target": ["mon-mgr", ""]}) -- 0x7fdf000b30b0 con 0x7fdee006a420 2024-05-30T07:00:05.556 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:05.558+0000 7f004c600640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T07:00:05.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.565+0000 7fdef7400640 1 -- 172.21.15.37:0/751226972 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7fdf000b30b0 con 0x7fdee006a420 2024-05-30T07:00:05.566 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T07:00:05.578 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T07:00:05.578 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone52193 2024-05-30T07:00:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.817+0000 7fe2e8a00640 1 Processor -- start 2024-05-30T07:00:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.817+0000 7fe2e8a00640 1 -- start start 2024-05-30T07:00:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.821+0000 7fe2e8a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e40cef30 0x7fe2e40cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.821+0000 7fe2e8a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2e406ca70 0x7fe2e40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.821+0000 7fe2e8a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2e40cf850 con 0x7fe2e40b34a0 2024-05-30T07:00:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.821+0000 7fe2e8a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe2e406d450 con 0x7fe2e406ca70 2024-05-30T07:00:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.821+0000 7fe2e8a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e406d730 con 0x7fe2e40cef30 2024-05-30T07:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.821+0000 7fe2e2800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2e406ca70 0x7fe2e40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.821+0000 7fe2e2800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2e406ca70 0x7fe2e40d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43602/0 (socket says 172.21.15.37:43602) 2024-05-30T07:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.821+0000 7fe2e2800640 1 -- 172.21.15.37:0/3080622010 learned_addr learned my addr 172.21.15.37:0/3080622010 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.821+0000 7fe2e2800640 1 -- 172.21.15.37:0/3080622010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e40cef30 msgr2=0x7fe2e40cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.821+0000 7fe2e2800640 1 --2- 172.21.15.37:0/3080622010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e40cef30 0x7fe2e40cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.821+0000 7fe2e2800640 1 -- 172.21.15.37:0/3080622010 >> v1:172.21.15.105:6789/0 conn(0x7fe2e40b34a0 legacy=0x7fe2e40ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.821+0000 7fe2e2800640 1 -- 172.21.15.37:0/3080622010 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e406da10 con 0x7fe2e406ca70 2024-05-30T07:00:05.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.825+0000 7fe2e2800640 1 --2- 172.21.15.37:0/3080622010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e406ca70 0x7fe2e40d0f20 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc009e50 tx=0x7fe2dc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3547ed54353d91e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.825+0000 7fe2e0a00640 1 -- 172.21.15.37:0/3080622010 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0a57d0 con 0x7fe2e406ca70 2024-05-30T07:00:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.825+0000 7fe2e0a00640 1 -- 172.21.15.37:0/3080622010 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2dc0a5970 con 0x7fe2e406ca70 2024-05-30T07:00:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.825+0000 7fe2e0a00640 1 -- 172.21.15.37:0/3080622010 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0a5d40 con 0x7fe2e406ca70 2024-05-30T07:00:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.825+0000 7fe2e8a00640 1 -- 172.21.15.37:0/3080622010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e406ca70 msgr2=0x7fe2e40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:05.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.829+0000 7fe2e8a00640 1 --2- 172.21.15.37:0/3080622010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e406ca70 0x7fe2e40d0f20 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc009e50 tx=0x7fe2dc01c930 comp rx=0 tx=0).stop 2024-05-30T07:00:05.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.829+0000 7fe2e8a00640 1 -- 172.21.15.37:0/3080622010 shutdown_connections 2024-05-30T07:00:05.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.829+0000 7fe2e8a00640 1 --2- 172.21.15.37:0/3080622010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e406ca70 0x7fe2e40d0f20 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:05.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.829+0000 7fe2e8a00640 1 --2- 172.21.15.37:0/3080622010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e40cef30 0x7fe2e40cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:05.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.829+0000 7fe2e8a00640 1 -- 172.21.15.37:0/3080622010 >> 172.21.15.37:0/3080622010 conn(0x7fe2e40b4130 msgr2=0x7fe2e40b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:05.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.829+0000 7fe2e8a00640 1 -- 172.21.15.37:0/3080622010 shutdown_connections 2024-05-30T07:00:05.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.829+0000 7fe2e8a00640 1 -- 172.21.15.37:0/3080622010 wait complete. 2024-05-30T07:00:05.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.829+0000 7fe2e8a00640 1 Processor -- start 2024-05-30T07:00:05.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.829+0000 7fe2e8a00640 1 -- start start 2024-05-30T07:00:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.833+0000 7fe2e8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e406ca70 0x7fe2e414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.833+0000 7fe2e8a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e40cef30 0x7fe2e4154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.833+0000 7fe2e8a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e414ed40 0x7fe2e4150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.833+0000 7fe2e8a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e416b6a0 con 0x7fe2e406ca70 2024-05-30T07:00:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.833+0000 7fe2e8a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e416b520 con 0x7fe2e40cef30 2024-05-30T07:00:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.833+0000 7fe2e8a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e416b820 con 0x7fe2e414ed40 2024-05-30T07:00:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.833+0000 7fe2e1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e406ca70 0x7fe2e414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.833+0000 7fe2e1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e406ca70 0x7fe2e414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43612/0 (socket says 172.21.15.37:43612) 2024-05-30T07:00:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.833+0000 7fe2e1e00640 1 -- 172.21.15.37:0/2395523019 learned_addr learned my addr 172.21.15.37:0/2395523019 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:05.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.837+0000 7fe2e1400640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e40cef30 0x7fe2e4154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:05.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.837+0000 7fe2e1e00640 1 -- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e414ed40 msgr2=0x7fe2e4150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:05.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.837+0000 7fe2e1e00640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e414ed40 0x7fe2e4150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:05.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.837+0000 7fe2e1e00640 1 -- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e40cef30 msgr2=0x7fe2e4154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.837+0000 7fe2e1e00640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e40cef30 0x7fe2e4154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.837+0000 7fe2e1e00640 1 -- 172.21.15.37:0/2395523019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e4155730 con 0x7fe2e406ca70 2024-05-30T07:00:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.837+0000 7fe2e1400640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e40cef30 0x7fe2e4154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.837+0000 7fe2e1e00640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e406ca70 0x7fe2e414e490 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400b410 tx=0x7fe2d400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.837+0000 7fe2da000640 1 -- 172.21.15.37:0/2395523019 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4015020 con 0x7fe2e406ca70 2024-05-30T07:00:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.837+0000 7fe2da000640 1 -- 172.21.15.37:0/2395523019 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d4011830 con 0x7fe2e406ca70 2024-05-30T07:00:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.837+0000 7fe2da000640 1 -- 172.21.15.37:0/2395523019 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4011c20 con 0x7fe2e406ca70 2024-05-30T07:00:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.837+0000 7fe2e8a00640 1 -- 172.21.15.37:0/2395523019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e4155a10 con 0x7fe2e406ca70 2024-05-30T07:00:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.837+0000 7fe2e8a00640 1 -- 172.21.15.37:0/2395523019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e4155fd0 con 0x7fe2e406ca70 2024-05-30T07:00:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.841+0000 7fe2e8a00640 1 -- 172.21.15.37:0/2395523019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e4075580 con 0x7fe2e406ca70 2024-05-30T07:00:05.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.841+0000 7fe2da000640 1 -- 172.21.15.37:0/2395523019 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 48) ==== 90945+0+0 (secure 0 0 0) 0x7fe2d4018020 con 0x7fe2e406ca70 2024-05-30T07:00:05.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.841+0000 7fe2da000640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2c406a470 0x7fe2c406c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:05.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.845+0000 7fe2da000640 1 -- 172.21.15.37:0/2395523019 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fe2d4085a10 con 0x7fe2e406ca70 2024-05-30T07:00:05.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.845+0000 7fe2e1400640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2c406a470 0x7fe2c406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:05.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.849+0000 7fe2da000640 1 -- 172.21.15.37:0/2395523019 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe2d408e030 con 0x7fe2e406ca70 2024-05-30T07:00:05.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:05.857+0000 7fe2e1400640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2c406a470 0x7fe2c406c930 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4150be0 tx=0x7fe2d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:06.049 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T07:00:06.053 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T07:00:06.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:06.121+0000 7fe2da000640 1 -- 172.21.15.37:0/2395523019 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 49) ==== 90996+0+0 (secure 0 0 0) 0x7fe2d4053a20 con 0x7fe2e406ca70 2024-05-30T07:00:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:06.185+0000 7fe2e8a00640 1 -- 172.21.15.37:0/2395523019 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone52193", "target": ["mon-mgr", ""]}) -- 0x7fe2e409c0f0 con 0x7fe2c406a470 2024-05-30T07:00:07.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.541+0000 7fe2da000640 1 -- 172.21.15.37:0/2395523019 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe2e409c0f0 con 0x7fe2c406a470 2024-05-30T07:00:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.549+0000 7fe2e8a00640 1 -- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2c406a470 msgr2=0x7fe2c406c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.549+0000 7fe2e8a00640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2c406a470 0x7fe2c406c930 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4150be0 tx=0x7fe2d0008040 comp rx=0 tx=0).stop 2024-05-30T07:00:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.549+0000 7fe2e8a00640 1 -- 172.21.15.37:0/2395523019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e406ca70 msgr2=0x7fe2e414e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.549+0000 7fe2e8a00640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e406ca70 0x7fe2e414e490 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400b410 tx=0x7fe2d400b8d0 comp rx=0 tx=0).stop 2024-05-30T07:00:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.549+0000 7fe2e8a00640 1 -- 172.21.15.37:0/2395523019 shutdown_connections 2024-05-30T07:00:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.549+0000 7fe2e8a00640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2e414ed40 0x7fe2e4150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.549+0000 7fe2e8a00640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe2c406a470 0x7fe2c406c930 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.549+0000 7fe2e8a00640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2e40cef30 0x7fe2e4154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.549+0000 7fe2e8a00640 1 --2- 172.21.15.37:0/2395523019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e406ca70 0x7fe2e414e490 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.549+0000 7fe2e8a00640 1 -- 172.21.15.37:0/2395523019 >> 172.21.15.37:0/2395523019 conn(0x7fe2e40b4130 msgr2=0x7fe2e41538e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.549+0000 7fe2e8a00640 1 -- 172.21.15.37:0/2395523019 shutdown_connections 2024-05-30T07:00:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.549+0000 7fe2e8a00640 1 -- 172.21.15.37:0/2395523019 wait complete. 2024-05-30T07:00:07.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone52194 2024-05-30T07:00:07.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.825+0000 7f5674c00640 1 Processor -- start 2024-05-30T07:00:07.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.825+0000 7f5674c00640 1 -- start start 2024-05-30T07:00:07.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f5674c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56700b59d0 0x7f56700b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:07.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f5674c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56701610a0 con 0x7f567015d350 2024-05-30T07:00:07.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f5674c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56700b62f0 con 0x7f567015d7b0 2024-05-30T07:00:07.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f5674c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5670142030 con 0x7f56700b59d0 2024-05-30T07:00:07.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f5667e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f567015d350 0x7f5670160280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52362/0 (socket says 172.21.15.37:52362) 2024-05-30T07:00:07.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f5667e00640 1 -- 172.21.15.37:0/1168674740 learned_addr learned my addr 172.21.15.37:0/1168674740 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:00:07.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 337407994 0 0) 0x7f56701610a0 con 0x7f567015d350 2024-05-30T07:00:07.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5654003530 con 0x7f567015d350 2024-05-30T07:00:07.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 238446005 0 0) 0x7f5654003530 con 0x7f567015d350 2024-05-30T07:00:07.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56700b59d0 msgr2=0x7f56700b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:07.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 --2- 172.21.15.37:0/1168674740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56700b59d0 0x7f56700b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:07.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 >> v1:172.21.15.105:6789/0 conn(0x7f567015d7b0 legacy=0x7f5670160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:07.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5670142310 con 0x7f567015d350 2024-05-30T07:00:07.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f5658001680 con 0x7f567015d350 2024-05-30T07:00:07.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 >> v1:172.21.15.37:6789/0 conn(0x7f567015d350 legacy=0x7f5670160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:07.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 --2- 172.21.15.37:0/1168674740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56540039f0 0x7f5654003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:07.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 --2- 172.21.15.37:0/1168674740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56700b59d0 0x7f5654004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:07.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 --2- 172.21.15.37:0/1168674740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5654004dc0 0x7f5654005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:07.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5670142030 con 0x7f56540039f0 2024-05-30T07:00:07.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f565400bc70 con 0x7f5654004dc0 2024-05-30T07:00:07.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f565400be70 con 0x7f56700b59d0 2024-05-30T07:00:07.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566de00640 1 --2- 172.21.15.37:0/1168674740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56540039f0 0x7f5654003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:07.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566de00640 1 -- 172.21.15.37:0/1168674740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56700b59d0 msgr2=0x7f5654004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:07.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566de00640 1 --2- 172.21.15.37:0/1168674740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56700b59d0 0x7f5654004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:07.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566de00640 1 -- 172.21.15.37:0/1168674740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5654004dc0 msgr2=0x7f5654005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:07.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566de00640 1 --2- 172.21.15.37:0/1168674740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5654004dc0 0x7f5654005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:07.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.829+0000 7f566de00640 1 -- 172.21.15.37:0/1168674740 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5654003530 con 0x7f56540039f0 2024-05-30T07:00:07.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.833+0000 7f566de00640 1 --2- 172.21.15.37:0/1168674740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56540039f0 0x7f5654003df0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f5660009860 tx=0x7f566001c2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa891b0ff47dbebe server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.833+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56600b0070 con 0x7f56540039f0 2024-05-30T07:00:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.833+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56600ab620 con 0x7f56540039f0 2024-05-30T07:00:07.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.833+0000 7f566d400640 1 -- 172.21.15.37:0/1168674740 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660009460 con 0x7f56540039f0 2024-05-30T07:00:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.837+0000 7f5674c00640 1 -- 172.21.15.37:0/1168674740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56540039f0 msgr2=0x7f5654003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.837+0000 7f5674c00640 1 --2- 172.21.15.37:0/1168674740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56540039f0 0x7f5654003df0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f5660009860 tx=0x7f566001c2c0 comp rx=0 tx=0).stop 2024-05-30T07:00:07.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.837+0000 7f566e800640 1 -- 172.21.15.37:0/1168674740 reap_dead start 2024-05-30T07:00:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.837+0000 7f5674c00640 1 -- 172.21.15.37:0/1168674740 shutdown_connections 2024-05-30T07:00:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.837+0000 7f5674c00640 1 -- 172.21.15.37:0/1168674740 >> 172.21.15.37:0/1168674740 conn(0x7f567006bf60 msgr2=0x7f56700b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.837+0000 7f5674c00640 1 -- 172.21.15.37:0/1168674740 shutdown_connections 2024-05-30T07:00:07.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.837+0000 7f5674c00640 1 -- 172.21.15.37:0/1168674740 wait complete. 2024-05-30T07:00:07.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.837+0000 7f5674c00640 1 Processor -- start 2024-05-30T07:00:07.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.837+0000 7f5674c00640 1 -- start start 2024-05-30T07:00:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5674c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56540039f0 0x7f56701572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5674c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f567013e3d0 0x7f5670160470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5674c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56701565e0 0x7f5670156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5674c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f567013fce0 con 0x7f567013e3d0 2024-05-30T07:00:07.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5674c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f56701428d0 con 0x7f56701565e0 2024-05-30T07:00:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5674c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f567013fe60 con 0x7f56540039f0 2024-05-30T07:00:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5667e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f567013e3d0 0x7f5670160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5667e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f567013e3d0 0x7f5670160470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57350/0 (socket says 172.21.15.37:57350) 2024-05-30T07:00:07.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5667e00640 1 -- 172.21.15.37:0/2559973865 learned_addr learned my addr 172.21.15.37:0/2559973865 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5667e00640 1 -- 172.21.15.37:0/2559973865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56540039f0 msgr2=0x7f56701572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f566e800640 1 --2- 172.21.15.37:0/2559973865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56701565e0 0x7f5670156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5667e00640 1 --2- 172.21.15.37:0/2559973865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f56540039f0 0x7f56701572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:07.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5667e00640 1 -- 172.21.15.37:0/2559973865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56701565e0 msgr2=0x7f5670156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5667e00640 1 --2- 172.21.15.37:0/2559973865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56701565e0 0x7f5670156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5667e00640 1 -- 172.21.15.37:0/2559973865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5670159aa0 con 0x7f567013e3d0 2024-05-30T07:00:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f566e800640 1 --2- 172.21.15.37:0/2559973865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56701565e0 0x7f5670156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5667e00640 1 --2- 172.21.15.37:0/2559973865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f567013e3d0 0x7f5670160470 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f565800f440 tx=0x7f565800f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5666000640 1 -- 172.21.15.37:0/2559973865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565801b070 con 0x7f567013e3d0 2024-05-30T07:00:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5666000640 1 -- 172.21.15.37:0/2559973865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5658007d00 con 0x7f567013e3d0 2024-05-30T07:00:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5666000640 1 -- 172.21.15.37:0/2559973865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565800a310 con 0x7f567013e3d0 2024-05-30T07:00:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5674c00640 1 -- 172.21.15.37:0/2559973865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5670159d80 con 0x7f567013e3d0 2024-05-30T07:00:07.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5674c00640 1 -- 172.21.15.37:0/2559973865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567015a340 con 0x7f567013e3d0 2024-05-30T07:00:07.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.841+0000 7f5674c00640 1 -- 172.21.15.37:0/2559973865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5670068bc0 con 0x7f567013e3d0 2024-05-30T07:00:07.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.845+0000 7f5666000640 1 -- 172.21.15.37:0/2559973865 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) ==== 90996+0+0 (secure 0 0 0) 0x7f565801e070 con 0x7f567013e3d0 2024-05-30T07:00:07.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.845+0000 7f5666000640 1 --2- 172.21.15.37:0/2559973865 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f564c06a4e0 0x7f564c06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.849+0000 7f5666000640 1 -- 172.21.15.37:0/2559973865 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f5658087d00 con 0x7f567013e3d0 2024-05-30T07:00:07.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.857+0000 7f5666000640 1 -- 172.21.15.37:0/2559973865 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5658059e10 con 0x7f567013e3d0 2024-05-30T07:00:07.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.865+0000 7f566de00640 1 --2- 172.21.15.37:0/2559973865 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f564c06a4e0 0x7f564c06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:07.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:07.881+0000 7f566de00640 1 --2- 172.21.15.37:0/2559973865 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f564c06a4e0 0x7f564c06c9a0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f56600ad000 tx=0x7f56600047e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:08.145+0000 7f5674c00640 1 -- 172.21.15.37:0/2559973865 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone52194", "target": ["mon-mgr", ""]}) -- 0x7f5670156fb0 con 0x7f564c06a4e0 2024-05-30T07:00:09.406 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:09.409+0000 7f004c600640 -1 mgr.server reply reply (22) Invalid argument cannot cancel -- clone finished (check clone status) 2024-05-30T07:00:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.405+0000 7f5666000640 1 -- 172.21.15.37:0/2559973865 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -22 cannot cancel -- clone finished (check clone status)) ==== 60+0+0 (secure 0 0 0) 0x7f56600ab480 con 0x7f564c06a4e0 2024-05-30T07:00:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: cannot cancel -- clone finished (check clone status) 2024-05-30T07:00:09.421 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-30T07:00:09.422 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone52195 2024-05-30T07:00:09.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.657+0000 7fcb68a00640 1 Processor -- start 2024-05-30T07:00:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.657+0000 7fcb68a00640 1 -- start start 2024-05-30T07:00:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb68a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcb640d0600 0x7fcb640cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb68a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb640cffd0 0x7fcb640afb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb68a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb640af0d0 con 0x7fcb6415c9a0 2024-05-30T07:00:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb68a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcb640ce000 con 0x7fcb640d0600 2024-05-30T07:00:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb68a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcb640ce2e0 con 0x7fcb640cffd0 2024-05-30T07:00:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcb6415c9a0 0x7fcb640d09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52376/0 (socket says 172.21.15.37:52376) 2024-05-30T07:00:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61e00640 1 -- 172.21.15.37:0/2083093954 learned_addr learned my addr 172.21.15.37:0/2083093954 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:00:09.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 307236572 0 0) 0x7fcb640af0d0 con 0x7fcb6415c9a0 2024-05-30T07:00:09.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb48003530 con 0x7fcb6415c9a0 2024-05-30T07:00:09.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb63200640 1 --2- 172.21.15.37:0/2083093954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb640cffd0 0x7fcb640afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:09.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb62800640 1 --2- 172.21.15.37:0/2083093954 >> v2:172.21.15.105:3300/0 conn(0x7fcb640d0600 0x7fcb640cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:09.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 964089408 0 0) 0x7fcb48003530 con 0x7fcb6415c9a0 2024-05-30T07:00:09.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb640cffd0 msgr2=0x7fcb640afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:09.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 --2- 172.21.15.37:0/2083093954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb640cffd0 0x7fcb640afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 >> v2:172.21.15.105:3300/0 conn(0x7fcb640d0600 msgr2=0x7fcb640cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 --2- 172.21.15.37:0/2083093954 >> v2:172.21.15.105:3300/0 conn(0x7fcb640d0600 0x7fcb640cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb640af370 con 0x7fcb6415c9a0 2024-05-30T07:00:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fcb500016a0 con 0x7fcb6415c9a0 2024-05-30T07:00:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 >> v1:172.21.15.37:6789/0 conn(0x7fcb6415c9a0 legacy=0x7fcb640d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 --2- 172.21.15.37:0/2083093954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb480039c0 0x7fcb48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:09.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 --2- 172.21.15.37:0/2083093954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb640cffd0 0x7fcb48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:09.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 --2- 172.21.15.37:0/2083093954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb48004d50 0x7fcb480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:09.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb640ce000 con 0x7fcb48004d50 2024-05-30T07:00:09.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcb640ce2e0 con 0x7fcb480039c0 2024-05-30T07:00:09.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4800bbe0 con 0x7fcb640cffd0 2024-05-30T07:00:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.661+0000 7fcb63200640 1 --2- 172.21.15.37:0/2083093954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb48004d50 0x7fcb480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.665+0000 7fcb61e00640 1 --2- 172.21.15.37:0/2083093954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb640cffd0 0x7fcb48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.665+0000 7fcb63200640 1 -- 172.21.15.37:0/2083093954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb640cffd0 msgr2=0x7fcb48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.665+0000 7fcb63200640 1 --2- 172.21.15.37:0/2083093954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb640cffd0 0x7fcb48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.665+0000 7fcb63200640 1 -- 172.21.15.37:0/2083093954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb480039c0 msgr2=0x7fcb48003de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-30T07:00:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.665+0000 7fcb63200640 1 --2- 172.21.15.37:0/2083093954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb480039c0 0x7fcb48003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.665+0000 7fcb63200640 1 -- 172.21.15.37:0/2083093954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb48003530 con 0x7fcb48004d50 2024-05-30T07:00:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.665+0000 7fcb61e00640 1 --2- 172.21.15.37:0/2083093954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb640cffd0 0x7fcb48004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.669+0000 7fcb63200640 1 --2- 172.21.15.37:0/2083093954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb48004d50 0x7fcb480051d0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c007330 tx=0x7fcb5c01ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194b5538dc667e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.669+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0b2070 con 0x7fcb48004d50 2024-05-30T07:00:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.669+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb5c0a5d20 con 0x7fcb48004d50 2024-05-30T07:00:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.669+0000 7fcb61400640 1 -- 172.21.15.37:0/2083093954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c009be0 con 0x7fcb48004d50 2024-05-30T07:00:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.669+0000 7fcb68a00640 1 -- 172.21.15.37:0/2083093954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb48004d50 msgr2=0x7fcb480051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.669+0000 7fcb68a00640 1 --2- 172.21.15.37:0/2083093954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb48004d50 0x7fcb480051d0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c007330 tx=0x7fcb5c01ce20 comp rx=0 tx=0).stop 2024-05-30T07:00:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.669+0000 7fcb63200640 1 -- 172.21.15.37:0/2083093954 reap_dead start 2024-05-30T07:00:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.669+0000 7fcb68a00640 1 -- 172.21.15.37:0/2083093954 shutdown_connections 2024-05-30T07:00:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.669+0000 7fcb68a00640 1 -- 172.21.15.37:0/2083093954 >> 172.21.15.37:0/2083093954 conn(0x7fcb640b3ef0 msgr2=0x7fcb640b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.669+0000 7fcb68a00640 1 -- 172.21.15.37:0/2083093954 shutdown_connections 2024-05-30T07:00:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.669+0000 7fcb68a00640 1 -- 172.21.15.37:0/2083093954 wait complete. 2024-05-30T07:00:09.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb68a00640 1 Processor -- start 2024-05-30T07:00:09.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb68a00640 1 -- start start 2024-05-30T07:00:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb68a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb48004d50 0x7fcb640c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb68a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb641f47e0 0x7fcb640b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb68a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb640ca230 0x7fcb640ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb68a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6409bd80 con 0x7fcb641f47e0 2024-05-30T07:00:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb68a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6409bc00 con 0x7fcb640ca230 2024-05-30T07:00:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb68a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcb640afb70 con 0x7fcb48004d50 2024-05-30T07:00:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb61e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb641f47e0 0x7fcb640b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb61e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb641f47e0 0x7fcb640b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57364/0 (socket says 172.21.15.37:57364) 2024-05-30T07:00:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb61e00640 1 -- 172.21.15.37:0/2019957260 learned_addr learned my addr 172.21.15.37:0/2019957260 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb61e00640 1 -- 172.21.15.37:0/2019957260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb48004d50 msgr2=0x7fcb640c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb61e00640 1 --2- 172.21.15.37:0/2019957260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb48004d50 0x7fcb640c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb61e00640 1 -- 172.21.15.37:0/2019957260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb640ca230 msgr2=0x7fcb640ca6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-30T07:00:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb61e00640 1 --2- 172.21.15.37:0/2019957260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb640ca230 0x7fcb640ca6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb61e00640 1 -- 172.21.15.37:0/2019957260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb641f4cc0 con 0x7fcb641f47e0 2024-05-30T07:00:09.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb61e00640 1 --2- 172.21.15.37:0/2019957260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb641f47e0 0x7fcb640b6e10 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fcb50007fd0 tx=0x7fcb5000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb5aa00640 1 -- 172.21.15.37:0/2019957260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb50019070 con 0x7fcb641f47e0 2024-05-30T07:00:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb5aa00640 1 -- 172.21.15.37:0/2019957260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb500074e0 con 0x7fcb641f47e0 2024-05-30T07:00:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb5aa00640 1 -- 172.21.15.37:0/2019957260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb500049f0 con 0x7fcb641f47e0 2024-05-30T07:00:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb68a00640 1 -- 172.21.15.37:0/2019957260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb641f4fa0 con 0x7fcb641f47e0 2024-05-30T07:00:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.673+0000 7fcb68a00640 1 -- 172.21.15.37:0/2019957260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb641f5560 con 0x7fcb641f47e0 2024-05-30T07:00:09.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.677+0000 7fcb68a00640 1 -- 172.21.15.37:0/2019957260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb64068ab0 con 0x7fcb641f47e0 2024-05-30T07:00:09.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.677+0000 7fcb5aa00640 1 -- 172.21.15.37:0/2019957260 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) ==== 90996+0+0 (secure 0 0 0) 0x7fcb5001c070 con 0x7fcb641f47e0 2024-05-30T07:00:09.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.677+0000 7fcb5aa00640 1 --2- 172.21.15.37:0/2019957260 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcb4406a4b0 0x7fcb4406c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:09.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.677+0000 7fcb5aa00640 1 -- 172.21.15.37:0/2019957260 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fcb50085680 con 0x7fcb641f47e0 2024-05-30T07:00:09.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.685+0000 7fcb62800640 1 --2- 172.21.15.37:0/2019957260 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcb4406a4b0 0x7fcb4406c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:09.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.685+0000 7fcb5aa00640 1 -- 172.21.15.37:0/2019957260 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcb500576a0 con 0x7fcb641f47e0 2024-05-30T07:00:09.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.693+0000 7fcb62800640 1 --2- 172.21.15.37:0/2019957260 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcb4406a4b0 0x7fcb4406c970 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400a810 tx=0x7fcb54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:09.989+0000 7fcb68a00640 1 -- 172.21.15.37:0/2019957260 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone52195", "target": ["mon-mgr", ""]}) -- 0x7fcb6409b9e0 con 0x7fcb4406a4b0 2024-05-30T07:00:11.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.301+0000 7fcb5aa00640 1 -- 172.21.15.37:0/2019957260 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcb6409b9e0 con 0x7fcb4406a4b0 2024-05-30T07:00:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.305+0000 7fcb68a00640 1 -- 172.21.15.37:0/2019957260 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcb4406a4b0 msgr2=0x7fcb4406c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.305+0000 7fcb68a00640 1 --2- 172.21.15.37:0/2019957260 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcb4406a4b0 0x7fcb4406c970 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400a810 tx=0x7fcb54008040 comp rx=0 tx=0).stop 2024-05-30T07:00:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.305+0000 7fcb68a00640 1 -- 172.21.15.37:0/2019957260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb641f47e0 msgr2=0x7fcb640b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.305+0000 7fcb68a00640 1 --2- 172.21.15.37:0/2019957260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb641f47e0 0x7fcb640b6e10 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fcb50007fd0 tx=0x7fcb5000dd40 comp rx=0 tx=0).stop 2024-05-30T07:00:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.305+0000 7fcb68a00640 1 -- 172.21.15.37:0/2019957260 shutdown_connections 2024-05-30T07:00:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.305+0000 7fcb68a00640 1 --2- 172.21.15.37:0/2019957260 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcb4406a4b0 0x7fcb4406c970 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.305+0000 7fcb68a00640 1 --2- 172.21.15.37:0/2019957260 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb640ca230 0x7fcb640ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.305+0000 7fcb68a00640 1 --2- 172.21.15.37:0/2019957260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb641f47e0 0x7fcb640b6e10 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.305+0000 7fcb68a00640 1 --2- 172.21.15.37:0/2019957260 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb48004d50 0x7fcb640c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.305+0000 7fcb68a00640 1 -- 172.21.15.37:0/2019957260 >> 172.21.15.37:0/2019957260 conn(0x7fcb640b3ef0 msgr2=0x7fcb64070350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:11.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.305+0000 7fcb68a00640 1 -- 172.21.15.37:0/2019957260 shutdown_connections 2024-05-30T07:00:11.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.305+0000 7fcb68a00640 1 -- 172.21.15.37:0/2019957260 wait complete. 2024-05-30T07:00:11.339 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone52196 2024-05-30T07:00:11.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.561+0000 7fdcd7e00640 1 Processor -- start 2024-05-30T07:00:11.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.561+0000 7fdcd7e00640 1 -- start start 2024-05-30T07:00:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.565+0000 7fdcd7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdcd00b0570 0x7fdcd00cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.565+0000 7fdcd7e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdcd006b960 0x7fdcd006bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.565+0000 7fdcd7e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd00d0860 con 0x7fdcd015eb80 2024-05-30T07:00:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.565+0000 7fdcd7e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdcd006c310 con 0x7fdcd00b0570 2024-05-30T07:00:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.565+0000 7fdcd7e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd0162580 con 0x7fdcd006b960 2024-05-30T07:00:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.565+0000 7fdcd4a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdcd00b0570 0x7fdcd00cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.565+0000 7fdcd4a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdcd00b0570 0x7fdcd00cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57378/0 (socket says 172.21.15.37:57378) 2024-05-30T07:00:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.565+0000 7fdcd4a00640 1 -- 172.21.15.37:0/3845601147 learned_addr learned my addr 172.21.15.37:0/3845601147 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.565+0000 7fdcd5e00640 1 --2- 172.21.15.37:0/3845601147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdcd006b960 0x7fdcd006bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.565+0000 7fdcd4a00640 1 -- 172.21.15.37:0/3845601147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdcd006b960 msgr2=0x7fdcd006bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.565+0000 7fdcd4a00640 1 --2- 172.21.15.37:0/3845601147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdcd006b960 0x7fdcd006bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.565+0000 7fdcd4a00640 1 -- 172.21.15.37:0/3845601147 >> v1:172.21.15.105:6789/0 conn(0x7fdcd015eb80 legacy=0x7fdcd00ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.565+0000 7fdcd4a00640 1 -- 172.21.15.37:0/3845601147 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd00d0b00 con 0x7fdcd00b0570 2024-05-30T07:00:11.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.569+0000 7fdcd4a00640 1 --2- 172.21.15.37:0/3845601147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcd00b0570 0x7fdcd00cbb70 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0098a0 tx=0x7fdcbc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34514acab900b08 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:11.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.569+0000 7fdccfe00640 1 -- 172.21.15.37:0/3845601147 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0b1070 con 0x7fdcd00b0570 2024-05-30T07:00:11.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.569+0000 7fdccfe00640 1 -- 172.21.15.37:0/3845601147 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcbc0ac630 con 0x7fdcd00b0570 2024-05-30T07:00:11.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.569+0000 7fdccfe00640 1 -- 172.21.15.37:0/3845601147 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0a8050 con 0x7fdcd00b0570 2024-05-30T07:00:11.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.569+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3845601147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcd00b0570 msgr2=0x7fdcd00cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:11.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.569+0000 7fdcd7e00640 1 --2- 172.21.15.37:0/3845601147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcd00b0570 0x7fdcd00cbb70 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0098a0 tx=0x7fdcbc01c500 comp rx=0 tx=0).stop 2024-05-30T07:00:11.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.569+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3845601147 shutdown_connections 2024-05-30T07:00:11.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.569+0000 7fdcd7e00640 1 --2- 172.21.15.37:0/3845601147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdcd006b960 0x7fdcd006bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:11.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.569+0000 7fdcd7e00640 1 --2- 172.21.15.37:0/3845601147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcd00b0570 0x7fdcd00cbb70 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:11.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.569+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3845601147 >> 172.21.15.37:0/3845601147 conn(0x7fdcd0073450 msgr2=0x7fdcd009aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.569+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3845601147 shutdown_connections 2024-05-30T07:00:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.569+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3845601147 wait complete. 2024-05-30T07:00:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd7e00640 1 Processor -- start 2024-05-30T07:00:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd7e00640 1 -- start start 2024-05-30T07:00:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd7e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcd006b960 0x7fdcd00c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd7e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdcd00b0570 0x7fdcd00ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcd015eb80 0x7fdcd00cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd7e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd01633a0 con 0x7fdcd015eb80 2024-05-30T07:00:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd7e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd0163220 con 0x7fdcd006b960 2024-05-30T07:00:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd7e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd016b900 con 0x7fdcd00b0570 2024-05-30T07:00:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcd015eb80 0x7fdcd00cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcd015eb80 0x7fdcd00cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57390/0 (socket says 172.21.15.37:57390) 2024-05-30T07:00:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd5e00640 1 -- 172.21.15.37:0/3321917990 learned_addr learned my addr 172.21.15.37:0/3321917990 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd5e00640 1 -- 172.21.15.37:0/3321917990 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdcd00b0570 msgr2=0x7fdcd00ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd5e00640 1 --2- 172.21.15.37:0/3321917990 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdcd00b0570 0x7fdcd00ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd5e00640 1 -- 172.21.15.37:0/3321917990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcd006b960 msgr2=0x7fdcd00c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd5e00640 1 --2- 172.21.15.37:0/3321917990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcd006b960 0x7fdcd00c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd5e00640 1 -- 172.21.15.37:0/3321917990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd00c91a0 con 0x7fdcd015eb80 2024-05-30T07:00:11.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdcd5e00640 1 --2- 172.21.15.37:0/3321917990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcd015eb80 0x7fdcd00cabf0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8007e90 tx=0x7fdcc800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:11.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdccd600640 1 -- 172.21.15.37:0/3321917990 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8014420 con 0x7fdcd015eb80 2024-05-30T07:00:11.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdccd600640 1 -- 172.21.15.37:0/3321917990 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc8019070 con 0x7fdcd015eb80 2024-05-30T07:00:11.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.573+0000 7fdccd600640 1 -- 172.21.15.37:0/3321917990 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8014800 con 0x7fdcd015eb80 2024-05-30T07:00:11.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.577+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3321917990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd00c9480 con 0x7fdcd015eb80 2024-05-30T07:00:11.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.577+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3321917990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd01571b0 con 0x7fdcd015eb80 2024-05-30T07:00:11.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.577+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3321917990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcd0156fa0 con 0x7fdcd015eb80 2024-05-30T07:00:11.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.577+0000 7fdccd600640 1 -- 172.21.15.37:0/3321917990 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) ==== 90996+0+0 (secure 0 0 0) 0x7fdcc80149a0 con 0x7fdcd015eb80 2024-05-30T07:00:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.581+0000 7fdccd600640 1 --2- 172.21.15.37:0/3321917990 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdcb006a4b0 0x7fdcb006c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.581+0000 7fdccd600640 1 -- 172.21.15.37:0/3321917990 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fdcc80862e0 con 0x7fdcd015eb80 2024-05-30T07:00:11.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.585+0000 7fdcd5400640 1 --2- 172.21.15.37:0/3321917990 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdcb006a4b0 0x7fdcb006c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:11.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.593+0000 7fdccd600640 1 -- 172.21.15.37:0/3321917990 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdcc8011260 con 0x7fdcd015eb80 2024-05-30T07:00:11.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.605+0000 7fdcd5400640 1 --2- 172.21.15.37:0/3321917990 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdcb006a4b0 0x7fdcb006c970 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00b19d0 tx=0x7fdcc4006bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:11.925+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3321917990 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone52196", "target": ["mon-mgr", ""]}) -- 0x7fdcd0075580 con 0x7fdcb006a4b0 2024-05-30T07:00:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.309+0000 7fdccd600640 1 -- 172.21.15.37:0/3321917990 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdcd0075580 con 0x7fdcb006a4b0 2024-05-30T07:00:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.313+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3321917990 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdcb006a4b0 msgr2=0x7fdcb006c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.313+0000 7fdcd7e00640 1 --2- 172.21.15.37:0/3321917990 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdcb006a4b0 0x7fdcb006c970 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00b19d0 tx=0x7fdcc4006bb0 comp rx=0 tx=0).stop 2024-05-30T07:00:12.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.313+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3321917990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcd015eb80 msgr2=0x7fdcd00cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.313+0000 7fdcd7e00640 1 --2- 172.21.15.37:0/3321917990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcd015eb80 0x7fdcd00cabf0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8007e90 tx=0x7fdcc800e4b0 comp rx=0 tx=0).stop 2024-05-30T07:00:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.313+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3321917990 shutdown_connections 2024-05-30T07:00:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.313+0000 7fdcd7e00640 1 --2- 172.21.15.37:0/3321917990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcd015eb80 0x7fdcd00cabf0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.313+0000 7fdcd7e00640 1 --2- 172.21.15.37:0/3321917990 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdcd00b0570 0x7fdcd00ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.313+0000 7fdcd7e00640 1 --2- 172.21.15.37:0/3321917990 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdcb006a4b0 0x7fdcb006c970 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.313+0000 7fdcd7e00640 1 --2- 172.21.15.37:0/3321917990 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdcd006b960 0x7fdcd00c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.313+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3321917990 >> 172.21.15.37:0/3321917990 conn(0x7fdcd0073450 msgr2=0x7fdcd00b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.313+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3321917990 shutdown_connections 2024-05-30T07:00:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.313+0000 7fdcd7e00640 1 -- 172.21.15.37:0/3321917990 wait complete. 2024-05-30T07:00:12.349 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone cancel cephfs subvol_clone52197 2024-05-30T07:00:12.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.549+0000 7fe35bc00640 1 Processor -- start 2024-05-30T07:00:12.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.549+0000 7fe35bc00640 1 -- start start 2024-05-30T07:00:12.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe35bc00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe35415e8b0 0x7fe3540cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:12.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe35bc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe35406d200 0x7fe35406d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:12.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe35bc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe354163350 con 0x7fe35409aa60 2024-05-30T07:00:12.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe35bc00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe35406db80 con 0x7fe35415e8b0 2024-05-30T07:00:12.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe35bc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe3540cfb30 con 0x7fe35406d200 2024-05-30T07:00:12.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe353e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe35406d200 0x7fe35406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:12.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe359200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe35415e8b0 0x7fe3540cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:12.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe359c00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fe35409aa60 0x7fe35409aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47240/0 (socket says 172.21.15.37:47240) 2024-05-30T07:00:12.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe359c00640 1 -- 172.21.15.37:0/3036665973 learned_addr learned my addr 172.21.15.37:0/3036665973 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:00:12.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe359200640 1 -- 172.21.15.37:0/3036665973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe35406d200 msgr2=0x7fe35406d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:12.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe359200640 1 --2- 172.21.15.37:0/3036665973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe35406d200 0x7fe35406d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:12.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe359200640 1 -- 172.21.15.37:0/3036665973 >> v1:172.21.15.105:6789/0 conn(0x7fe35409aa60 legacy=0x7fe35409aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:12.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe359200640 1 -- 172.21.15.37:0/3036665973 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3541627d0 con 0x7fe35415e8b0 2024-05-30T07:00:12.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.553+0000 7fe353e00640 1 --2- 172.21.15.37:0/3036665973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe35406d200 0x7fe35406d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T07:00:12.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe359200640 1 --2- 172.21.15.37:0/3036665973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415e8b0 0x7fe3540cf5f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe3480097c0 tx=0x7fe34801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56d452853f9b8ac1 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:12.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe353400640 1 -- 172.21.15.37:0/3036665973 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3480b2070 con 0x7fe35415e8b0 2024-05-30T07:00:12.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe353400640 1 -- 172.21.15.37:0/3036665973 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3480ad640 con 0x7fe35415e8b0 2024-05-30T07:00:12.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe353400640 1 -- 172.21.15.37:0/3036665973 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3480ada10 con 0x7fe35415e8b0 2024-05-30T07:00:12.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe35bc00640 1 -- 172.21.15.37:0/3036665973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415e8b0 msgr2=0x7fe3540cf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:12.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe35bc00640 1 --2- 172.21.15.37:0/3036665973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415e8b0 0x7fe3540cf5f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe3480097c0 tx=0x7fe34801c4a0 comp rx=0 tx=0).stop 2024-05-30T07:00:12.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe35bc00640 1 -- 172.21.15.37:0/3036665973 shutdown_connections 2024-05-30T07:00:12.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe35bc00640 1 --2- 172.21.15.37:0/3036665973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe35406d200 0x7fe35406d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:12.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe35bc00640 1 --2- 172.21.15.37:0/3036665973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415e8b0 0x7fe3540cf5f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:12.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe35bc00640 1 -- 172.21.15.37:0/3036665973 >> 172.21.15.37:0/3036665973 conn(0x7fe3540b4130 msgr2=0x7fe3540b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:12.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe35bc00640 1 -- 172.21.15.37:0/3036665973 shutdown_connections 2024-05-30T07:00:12.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe35bc00640 1 -- 172.21.15.37:0/3036665973 wait complete. 2024-05-30T07:00:12.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe35bc00640 1 Processor -- start 2024-05-30T07:00:12.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.557+0000 7fe35bc00640 1 -- start start 2024-05-30T07:00:12.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe35bc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe35406d200 0x7fe354152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:12.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe35bc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35409aa60 0x7fe354151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:12.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe35bc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415e8b0 0x7fe3540cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:12.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe35bc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe354162480 con 0x7fe35409aa60 2024-05-30T07:00:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe35bc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe35415ec90 con 0x7fe35415e8b0 2024-05-30T07:00:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe35bc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe3540cf050 con 0x7fe35406d200 2024-05-30T07:00:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe353e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35409aa60 0x7fe354151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe359200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe35406d200 0x7fe354152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe359c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415e8b0 0x7fe3540cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe353e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35409aa60 0x7fe354151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57394/0 (socket says 172.21.15.37:57394) 2024-05-30T07:00:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe359200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe35406d200 0x7fe354152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:38938/0 (socket says 172.21.15.37:38938) 2024-05-30T07:00:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe353e00640 1 -- 172.21.15.37:0/893671949 learned_addr learned my addr 172.21.15.37:0/893671949 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:12.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe353e00640 1 -- 172.21.15.37:0/893671949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe35406d200 msgr2=0x7fe354152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:12.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe353e00640 1 --2- 172.21.15.37:0/893671949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe35406d200 0x7fe354152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:12.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe353e00640 1 -- 172.21.15.37:0/893671949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415e8b0 msgr2=0x7fe3540cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:12.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe353e00640 1 --2- 172.21.15.37:0/893671949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415e8b0 0x7fe3540cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:12.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe353e00640 1 -- 172.21.15.37:0/893671949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe354154d70 con 0x7fe35409aa60 2024-05-30T07:00:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe353e00640 1 --2- 172.21.15.37:0/893671949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35409aa60 0x7fe354151170 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fe34000e980 tx=0x7fe34000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe350c00640 1 -- 172.21.15.37:0/893671949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340017070 con 0x7fe35409aa60 2024-05-30T07:00:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe350c00640 1 -- 172.21.15.37:0/893671949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34000ca00 con 0x7fe35409aa60 2024-05-30T07:00:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe35bc00640 1 -- 172.21.15.37:0/893671949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe354155050 con 0x7fe35409aa60 2024-05-30T07:00:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe350c00640 1 -- 172.21.15.37:0/893671949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34000cdd0 con 0x7fe35409aa60 2024-05-30T07:00:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.561+0000 7fe35bc00640 1 -- 172.21.15.37:0/893671949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3540af6f0 con 0x7fe35409aa60 2024-05-30T07:00:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.565+0000 7fe35bc00640 1 -- 172.21.15.37:0/893671949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe354068bc0 con 0x7fe35409aa60 2024-05-30T07:00:12.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.565+0000 7fe350c00640 1 -- 172.21.15.37:0/893671949 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) ==== 90996+0+0 (secure 0 0 0) 0x7fe34001a070 con 0x7fe35409aa60 2024-05-30T07:00:12.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.565+0000 7fe350c00640 1 --2- 172.21.15.37:0/893671949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe33406a4e0 0x7fe33406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:12.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.565+0000 7fe350c00640 1 -- 172.21.15.37:0/893671949 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fe340085c80 con 0x7fe35409aa60 2024-05-30T07:00:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.569+0000 7fe359200640 1 --2- 172.21.15.37:0/893671949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe33406a4e0 0x7fe33406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:12.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.573+0000 7fe359200640 1 --2- 172.21.15.37:0/893671949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe33406a4e0 0x7fe33406c9a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe3480af000 tx=0x7fe348008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:12.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.573+0000 7fe350c00640 1 -- 172.21.15.37:0/893671949 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe340057690 con 0x7fe35409aa60 2024-05-30T07:00:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:12.857+0000 7fe35bc00640 1 -- 172.21.15.37:0/893671949 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs clone cancel", "vol_name": "cephfs", "clone_name": "subvol_clone52197", "target": ["mon-mgr", ""]}) -- 0x7fe3540b85a0 con 0x7fe33406a4e0 2024-05-30T07:00:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.001+0000 7fe350c00640 1 -- 172.21.15.37:0/893671949 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe3540b85a0 con 0x7fe33406a4e0 2024-05-30T07:00:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.005+0000 7fe35bc00640 1 -- 172.21.15.37:0/893671949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe33406a4e0 msgr2=0x7fe33406c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.005+0000 7fe35bc00640 1 --2- 172.21.15.37:0/893671949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe33406a4e0 0x7fe33406c9a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe3480af000 tx=0x7fe348008040 comp rx=0 tx=0).stop 2024-05-30T07:00:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.005+0000 7fe35bc00640 1 -- 172.21.15.37:0/893671949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35409aa60 msgr2=0x7fe354151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.005+0000 7fe35bc00640 1 --2- 172.21.15.37:0/893671949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35409aa60 0x7fe354151170 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7fe34000e980 tx=0x7fe34000ee40 comp rx=0 tx=0).stop 2024-05-30T07:00:13.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.005+0000 7fe35bc00640 1 -- 172.21.15.37:0/893671949 shutdown_connections 2024-05-30T07:00:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.005+0000 7fe35bc00640 1 --2- 172.21.15.37:0/893671949 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fe33406a4e0 0x7fe33406c9a0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.005+0000 7fe35bc00640 1 --2- 172.21.15.37:0/893671949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415e8b0 0x7fe3540cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.005+0000 7fe35bc00640 1 --2- 172.21.15.37:0/893671949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35409aa60 0x7fe354151170 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.005+0000 7fe35bc00640 1 --2- 172.21.15.37:0/893671949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe35406d200 0x7fe354152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.005+0000 7fe35bc00640 1 -- 172.21.15.37:0/893671949 >> 172.21.15.37:0/893671949 conn(0x7fe3540b4130 msgr2=0x7fe3540b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.005+0000 7fe35bc00640 1 -- 172.21.15.37:0/893671949 shutdown_connections 2024-05-30T07:00:13.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.005+0000 7fe35bc00640 1 -- 172.21.15.37:0/893671949 wait complete. 2024-05-30T07:00:13.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T07:00:13.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.165+0000 7fa846400640 1 Processor -- start 2024-05-30T07:00:13.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.165+0000 7fa846400640 1 -- start start 2024-05-30T07:00:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa846400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa840155e60 0x7fa8400b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa846400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8400b2ec0 0x7fa8400cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa846400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84015c8f0 con 0x7fa84006f9a0 2024-05-30T07:00:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa846400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa8400ccff0 con 0x7fa840155e60 2024-05-30T07:00:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa846400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8400ccc80 con 0x7fa8400b2ec0 2024-05-30T07:00:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa83ea00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa84006f9a0 0x7fa8400cf660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52386/0 (socket says 172.21.15.37:52386) 2024-05-30T07:00:13.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa83ea00640 1 -- 172.21.15.37:0/732456968 learned_addr learned my addr 172.21.15.37:0/732456968 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:00:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa83fe00640 1 --2- 172.21.15.37:0/732456968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8400b2ec0 0x7fa8400cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa83f400640 1 --2- 172.21.15.37:0/732456968 >> v2:172.21.15.105:3300/0 conn(0x7fa840155e60 0x7fa8400b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa83e000640 1 -- 172.21.15.37:0/732456968 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014186032 0 0) 0x7fa84015c8f0 con 0x7fa84006f9a0 2024-05-30T07:00:13.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa83e000640 1 -- 172.21.15.37:0/732456968 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa824003530 con 0x7fa84006f9a0 2024-05-30T07:00:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa83f400640 1 -- 172.21.15.37:0/732456968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8400b2ec0 msgr2=0x7fa8400cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa83f400640 1 --2- 172.21.15.37:0/732456968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8400b2ec0 0x7fa8400cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa83f400640 1 -- 172.21.15.37:0/732456968 >> v1:172.21.15.37:6789/0 conn(0x7fa84006f9a0 legacy=0x7fa8400cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa83e000640 1 -- 172.21.15.37:0/732456968 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2698963958 0 0) 0x7fa824003530 con 0x7fa84006f9a0 2024-05-30T07:00:13.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.169+0000 7fa83f400640 1 -- 172.21.15.37:0/732456968 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84015cbd0 con 0x7fa840155e60 2024-05-30T07:00:13.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa83f400640 1 --2- 172.21.15.37:0/732456968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa840155e60 0x7fa8400b36a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa8300097c0 tx=0x7fa83001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b25918b9257d8ea server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa83e000640 1 -- 172.21.15.37:0/732456968 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8300b0070 con 0x7fa840155e60 2024-05-30T07:00:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa83e000640 1 -- 172.21.15.37:0/732456968 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8300ab400 con 0x7fa840155e60 2024-05-30T07:00:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa83e000640 1 -- 172.21.15.37:0/732456968 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c001680 con 0x7fa840155e60 2024-05-30T07:00:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa846400640 1 -- 172.21.15.37:0/732456968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa840155e60 msgr2=0x7fa8400b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa846400640 1 --2- 172.21.15.37:0/732456968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa840155e60 0x7fa8400b36a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa8300097c0 tx=0x7fa83001c3c0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa846400640 1 -- 172.21.15.37:0/732456968 shutdown_connections 2024-05-30T07:00:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa846400640 1 --2- 172.21.15.37:0/732456968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8400b2ec0 0x7fa8400cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa846400640 1 --2- 172.21.15.37:0/732456968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa840155e60 0x7fa8400b36a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa846400640 1 -- 172.21.15.37:0/732456968 >> 172.21.15.37:0/732456968 conn(0x7fa8400b23a0 msgr2=0x7fa8400b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa846400640 1 -- 172.21.15.37:0/732456968 shutdown_connections 2024-05-30T07:00:13.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa846400640 1 -- 172.21.15.37:0/732456968 wait complete. 2024-05-30T07:00:13.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa846400640 1 Processor -- start 2024-05-30T07:00:13.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.173+0000 7fa846400640 1 -- start start 2024-05-30T07:00:13.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa846400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa84006f9a0 0x7fa84014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:13.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa846400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8400b2ec0 0x7fa840145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:13.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa846400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840155e60 0x7fa84014ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:13.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa846400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa84006ea10 con 0x7fa840155e60 2024-05-30T07:00:13.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa846400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa84006e890 con 0x7fa8400b2ec0 2024-05-30T07:00:13.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa846400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa84006eb90 con 0x7fa84006f9a0 2024-05-30T07:00:13.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa83fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840155e60 0x7fa84014ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa83ea00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8400b2ec0 0x7fa840145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa83f400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa84006f9a0 0x7fa84014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa83fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840155e60 0x7fa84014ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57398/0 (socket says 172.21.15.37:57398) 2024-05-30T07:00:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa83fe00640 1 -- 172.21.15.37:0/1644983671 learned_addr learned my addr 172.21.15.37:0/1644983671 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa83fe00640 1 -- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa84006f9a0 msgr2=0x7fa84014c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa83fe00640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa84006f9a0 0x7fa84014c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa83fe00640 1 -- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8400b2ec0 msgr2=0x7fa840145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa83fe00640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8400b2ec0 0x7fa840145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa83fe00640 1 -- 172.21.15.37:0/1644983671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84014dd60 con 0x7fa840155e60 2024-05-30T07:00:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa83f400640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa84006f9a0 0x7fa84014c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T07:00:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa83ea00640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8400b2ec0 0x7fa840145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T07:00:13.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa83fe00640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840155e60 0x7fa84014ee00 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fa83800efc0 tx=0x7fa83800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:13.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa837400640 1 -- 172.21.15.37:0/1644983671 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838018020 con 0x7fa840155e60 2024-05-30T07:00:13.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa837400640 1 -- 172.21.15.37:0/1644983671 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa838014480 con 0x7fa840155e60 2024-05-30T07:00:13.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa837400640 1 -- 172.21.15.37:0/1644983671 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa838014870 con 0x7fa840155e60 2024-05-30T07:00:13.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa846400640 1 -- 172.21.15.37:0/1644983671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa84014e040 con 0x7fa840155e60 2024-05-30T07:00:13.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa846400640 1 -- 172.21.15.37:0/1644983671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa84014e600 con 0x7fa840155e60 2024-05-30T07:00:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.177+0000 7fa846400640 1 -- 172.21.15.37:0/1644983671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa840068b20 con 0x7fa840155e60 2024-05-30T07:00:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.181+0000 7fa837400640 1 -- 172.21.15.37:0/1644983671 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) ==== 90996+0+0 (secure 0 0 0) 0x7fa83801b020 con 0x7fa840155e60 2024-05-30T07:00:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.181+0000 7fa837400640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa82006a4b0 0x7fa82006c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:13.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.181+0000 7fa837400640 1 -- 172.21.15.37:0/1644983671 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fa838086820 con 0x7fa840155e60 2024-05-30T07:00:13.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.181+0000 7fa83f400640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa82006a4b0 0x7fa82006c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:13.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.181+0000 7fa83f400640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa82006a4b0 0x7fa82006c970 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa8300ad000 tx=0x7fa830008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:13.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.185+0000 7fa837400640 1 -- 172.21.15.37:0/1644983671 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa838022030 con 0x7fa840155e60 2024-05-30T07:00:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.405+0000 7fa846400640 1 -- 172.21.15.37:0/1644983671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa84015c3f0 con 0x7fa840155e60 2024-05-30T07:00:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.409+0000 7fa837400640 1 -- 172.21.15.37:0/1644983671 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2874 (secure 0 0 0) 0x7fa838010040 con 0x7fa840155e60 2024-05-30T07:00:13.410 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:13.410 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:00:13.410 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T07:00:13.410 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T07:00:13.410 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T07:00:13.410 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T07:00:13.410 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T07:00:13.410 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:13.410 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T07:00:13.411 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T07:00:13.411 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T07:00:13.411 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T07:00:13.411 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T07:00:13.411 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:13.411 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T07:00:13.411 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T07:00:13.411 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T07:00:13.411 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T07:00:13.411 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:13.411 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 1107, 2024-05-30T07:00:13.411 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T07:00:13.412 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T07:00:13.412 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T07:00:13.412 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T07:00:13.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:13.412 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T07:00:13.412 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 130, 2024-05-30T07:00:13.412 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T07:00:13.412 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T07:00:13.412 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T07:00:13.412 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T07:00:13.412 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T07:00:13.412 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T07:00:13.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:13.413 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T07:00:13.413 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T07:00:13.413 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:13.413 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T07:00:13.413 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T07:00:13.413 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:13.413 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:13.413 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T07:00:13.413 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T07:00:13.413 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4106, 2024-05-30T07:00:13.413 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 17047516428, 2024-05-30T07:00:13.413 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 34747326464, 2024-05-30T07:00:13.414 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 738346786816, 2024-05-30T07:00:13.414 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T07:00:13.414 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 640263199, 2024-05-30T07:00:13.414 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 637864171, 2024-05-30T07:00:13.414 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 154, 2024-05-30T07:00:13.414 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 166 2024-05-30T07:00:13.414 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:13.414 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T07:00:13.414 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 85, 2024-05-30T07:00:13.414 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9, 2024-05-30T07:00:13.415 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T07:00:13.415 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T07:00:13.415 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T07:00:13.415 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T07:00:13.415 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:13.415 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 9, 2024-05-30T07:00:13.415 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T07:00:13.415 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "d", 2024-05-30T07:00:13.415 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T07:00:13.415 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9729 2024-05-30T07:00:13.415 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:13.415 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:13.415 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T07:00:13.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:13.416 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T07:00:13.416 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T07:00:13.416 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T07:00:13.416 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T07:00:13.416 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T07:00:13.416 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T07:00:13.416 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T07:00:13.416 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:13.416 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:13.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:13.416 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T07:00:13.416 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 21, 2024-05-30T07:00:13.417 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T07:00:05.024539+0000", 2024-05-30T07:00:13.417 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-05-30T07:00:13.417 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-05-30T07:00:13.417 INFO:teuthology.orchestra.run.smithi037.stdout: "daemons": { 2024-05-30T07:00:13.417 INFO:teuthology.orchestra.run.smithi037.stdout: "summary": "", 2024-05-30T07:00:13.417 INFO:teuthology.orchestra.run.smithi037.stdout: "d": { 2024-05-30T07:00:13.417 INFO:teuthology.orchestra.run.smithi037.stdout: "start_epoch": 0, 2024-05-30T07:00:13.417 INFO:teuthology.orchestra.run.smithi037.stdout: "start_stamp": "0.000000", 2024-05-30T07:00:13.417 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 0, 2024-05-30T07:00:13.417 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "(unrecognized address family 0)/0", 2024-05-30T07:00:13.417 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": {}, 2024-05-30T07:00:13.417 INFO:teuthology.orchestra.run.smithi037.stdout: "task_status": {} 2024-05-30T07:00:13.417 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:13.418 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:13.418 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:13.418 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:13.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:13.418 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T07:00:13.418 INFO:teuthology.orchestra.run.smithi037.stdout: "19e12098-76d5-4ad1-9a9e-8c1702cf320b": { 2024-05-30T07:00:13.418 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "3 ongoing+pending clones; Avg progress is 35.33% (15s)\n [=========...................] (remaining: 27s)", 2024-05-30T07:00:13.418 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.35330000519752502, 2024-05-30T07:00:13.418 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:13.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:13.419 INFO:teuthology.orchestra.run.smithi037.stdout: "ebf69c16-08d6-4852-b378-0e327d1911a9": { 2024-05-30T07:00:13.419 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "3 ongoing clones; Avg progress is 35.33% (21s)\n [=========...................] (remaining: 39s)", 2024-05-30T07:00:13.419 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 0.35330000519752502, 2024-05-30T07:00:13.419 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:13.419 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:13.419 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:13.419 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:00:13.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.409+0000 7fa846400640 1 -- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa82006a4b0 msgr2=0x7fa82006c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:13.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.409+0000 7fa846400640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa82006a4b0 0x7fa82006c970 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fa8300ad000 tx=0x7fa830008040 comp rx=0 tx=0).stop 2024-05-30T07:00:13.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.409+0000 7fa846400640 1 -- 172.21.15.37:0/1644983671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840155e60 msgr2=0x7fa84014ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:13.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.409+0000 7fa846400640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840155e60 0x7fa84014ee00 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fa83800efc0 tx=0x7fa83800c490 comp rx=0 tx=0).stop 2024-05-30T07:00:13.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.409+0000 7fa846400640 1 -- 172.21.15.37:0/1644983671 shutdown_connections 2024-05-30T07:00:13.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.409+0000 7fa846400640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa840155e60 0x7fa84014ee00 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.409+0000 7fa846400640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa82006a4b0 0x7fa82006c970 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.409+0000 7fa846400640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8400b2ec0 0x7fa840145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.409+0000 7fa846400640 1 --2- 172.21.15.37:0/1644983671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa84006f9a0 0x7fa84014c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:13.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.409+0000 7fa846400640 1 -- 172.21.15.37:0/1644983671 >> 172.21.15.37:0/1644983671 conn(0x7fa8400b23a0 msgr2=0x7fa840074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:13.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.409+0000 7fa846400640 1 -- 172.21.15.37:0/1644983671 shutdown_connections 2024-05-30T07:00:13.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:13.409+0000 7fa846400640 1 -- 172.21.15.37:0/1644983671 wait complete. 2024-05-30T07:00:15.433 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T07:00:15.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f396aa00640 1 Processor -- start 2024-05-30T07:00:15.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f396aa00640 1 -- start start 2024-05-30T07:00:15.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f396aa00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3964146180 0x7f39640b6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:15.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f396aa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f396415ce90 0x7f396406b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:15.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f396aa00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39640b07a0 con 0x7f39640b6570 2024-05-30T07:00:15.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f396aa00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f39640ae850 con 0x7f3964146180 2024-05-30T07:00:15.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f396aa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39640b0a80 con 0x7f396415ce90 2024-05-30T07:00:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f395b400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f396415ce90 0x7f396406b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f3963e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3964146180 0x7f39640b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f395b400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f396415ce90 0x7f396406b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:38960/0 (socket says 172.21.15.37:38960) 2024-05-30T07:00:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f395b400640 1 -- 172.21.15.37:0/4227355153 learned_addr learned my addr 172.21.15.37:0/4227355153 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f3968a00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f39640b6570 0x7f39640b4ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47250/0 (socket says 172.21.15.37:47250) 2024-05-30T07:00:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f3963e00640 1 -- 172.21.15.37:0/4227355153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f396415ce90 msgr2=0x7f396406b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f3963e00640 1 --2- 172.21.15.37:0/4227355153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f396415ce90 0x7f396406b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f3963e00640 1 -- 172.21.15.37:0/4227355153 >> v1:172.21.15.105:6789/0 conn(0x7f39640b6570 legacy=0x7f39640b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f3963e00640 1 -- 172.21.15.37:0/4227355153 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39640b0d60 con 0x7f3964146180 2024-05-30T07:00:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f3963400640 1 -- 172.21.15.37:0/4227355153 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172845048 0 0) 0x7f39640b07a0 con 0x7f39640b6570 2024-05-30T07:00:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.585+0000 7f395b400640 1 --2- 172.21.15.37:0/4227355153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f396415ce90 0x7f396406b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T07:00:15.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.589+0000 7f3963e00640 1 --2- 172.21.15.37:0/4227355153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3964146180 0x7f39640b6030 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f39540097c0 tx=0x7f395401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25a694c6a0493ecc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:15.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.589+0000 7f3963400640 1 -- 172.21.15.37:0/4227355153 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39540b0070 con 0x7f3964146180 2024-05-30T07:00:15.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.589+0000 7f3963400640 1 -- 172.21.15.37:0/4227355153 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39540ab600 con 0x7f3964146180 2024-05-30T07:00:15.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.589+0000 7f3963400640 1 -- 172.21.15.37:0/4227355153 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39540ab9d0 con 0x7f3964146180 2024-05-30T07:00:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.589+0000 7f396aa00640 1 -- 172.21.15.37:0/4227355153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3964146180 msgr2=0x7f39640b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.589+0000 7f396aa00640 1 --2- 172.21.15.37:0/4227355153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3964146180 0x7f39640b6030 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f39540097c0 tx=0x7f395401c410 comp rx=0 tx=0).stop 2024-05-30T07:00:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.589+0000 7f396aa00640 1 -- 172.21.15.37:0/4227355153 shutdown_connections 2024-05-30T07:00:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.589+0000 7f396aa00640 1 --2- 172.21.15.37:0/4227355153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f396415ce90 0x7f396406b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.589+0000 7f396aa00640 1 --2- 172.21.15.37:0/4227355153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3964146180 0x7f39640b6030 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.589+0000 7f396aa00640 1 -- 172.21.15.37:0/4227355153 >> 172.21.15.37:0/4227355153 conn(0x7f39640b6a60 msgr2=0x7f39640b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.589+0000 7f396aa00640 1 -- 172.21.15.37:0/4227355153 shutdown_connections 2024-05-30T07:00:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.589+0000 7f396aa00640 1 -- 172.21.15.37:0/4227355153 wait complete. 2024-05-30T07:00:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f396aa00640 1 Processor -- start 2024-05-30T07:00:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f396aa00640 1 -- start start 2024-05-30T07:00:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f396aa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39640b6570 0x7f396413b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f396aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964146180 0x7f39641370b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f396aa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f396415ce90 0x7f3964143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f396aa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39641696c0 con 0x7f3964146180 2024-05-30T07:00:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f396aa00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f396406c2b0 con 0x7f39640b6570 2024-05-30T07:00:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f396aa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3964169840 con 0x7f396415ce90 2024-05-30T07:00:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f395b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964146180 0x7f39641370b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f395b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964146180 0x7f39641370b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57408/0 (socket says 172.21.15.37:57408) 2024-05-30T07:00:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f395b400640 1 -- 172.21.15.37:0/1260651962 learned_addr learned my addr 172.21.15.37:0/1260651962 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:15.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f3963e00640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39640b6570 0x7f396413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:15.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f3968a00640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f396415ce90 0x7f3964143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:15.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f395b400640 1 -- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f396415ce90 msgr2=0x7f3964143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:15.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f395b400640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f396415ce90 0x7f3964143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:15.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f395b400640 1 -- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39640b6570 msgr2=0x7f396413b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:15.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f395b400640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39640b6570 0x7f396413b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:15.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f395b400640 1 -- 172.21.15.37:0/1260651962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396413a430 con 0x7f3964146180 2024-05-30T07:00:15.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f3968a00640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f396415ce90 0x7f3964143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:00:15.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f395b400640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964146180 0x7f39641370b0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f394c00e9a0 tx=0x7f394c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:15.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f3960c00640 1 -- 172.21.15.37:0/1260651962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c017070 con 0x7f3964146180 2024-05-30T07:00:15.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f3960c00640 1 -- 172.21.15.37:0/1260651962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f394c00ca00 con 0x7f3964146180 2024-05-30T07:00:15.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f3960c00640 1 -- 172.21.15.37:0/1260651962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c00cdb0 con 0x7f3964146180 2024-05-30T07:00:15.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f396aa00640 1 -- 172.21.15.37:0/1260651962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396413bdf0 con 0x7f3964146180 2024-05-30T07:00:15.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.593+0000 7f396aa00640 1 -- 172.21.15.37:0/1260651962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3964156ff0 con 0x7f3964146180 2024-05-30T07:00:15.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.597+0000 7f396aa00640 1 -- 172.21.15.37:0/1260651962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3964068b20 con 0x7f3964146180 2024-05-30T07:00:15.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.597+0000 7f3960c00640 1 -- 172.21.15.37:0/1260651962 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) ==== 90996+0+0 (secure 0 0 0) 0x7f394c01a070 con 0x7f3964146180 2024-05-30T07:00:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.597+0000 7f3960c00640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f394006a4b0 0x7f394006c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.597+0000 7f3960c00640 1 -- 172.21.15.37:0/1260651962 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f394c085d20 con 0x7f3964146180 2024-05-30T07:00:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.597+0000 7f3963e00640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f394006a4b0 0x7f394006c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.597+0000 7f3963e00640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f394006a4b0 0x7f394006c970 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f39540ad000 tx=0x7f39540a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:15.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.601+0000 7f3960c00640 1 -- 172.21.15.37:0/1260651962 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f394c0576f0 con 0x7f3964146180 2024-05-30T07:00:15.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f396aa00640 1 -- 172.21.15.37:0/1260651962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f3964158370 con 0x7f3964146180 2024-05-30T07:00:15.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f3960c00640 1 -- 172.21.15.37:0/1260651962 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2381 (secure 0 0 0) 0x7f394c05b9f0 con 0x7f3964146180 2024-05-30T07:00:15.834 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:15.834 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:00:15.834 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T07:00:15.834 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T07:00:15.834 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T07:00:15.834 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T07:00:15.834 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T07:00:15.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:15.835 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T07:00:15.835 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T07:00:15.835 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T07:00:15.835 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T07:00:15.835 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T07:00:15.835 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:15.835 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T07:00:15.835 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T07:00:15.835 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T07:00:15.835 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T07:00:15.836 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:15.836 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 1110, 2024-05-30T07:00:15.836 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T07:00:15.836 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T07:00:15.836 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T07:00:15.836 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T07:00:15.836 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:15.836 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T07:00:15.836 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 130, 2024-05-30T07:00:15.836 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T07:00:15.836 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T07:00:15.837 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T07:00:15.837 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T07:00:15.837 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T07:00:15.837 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T07:00:15.837 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:15.837 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T07:00:15.837 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T07:00:15.837 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:15.837 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T07:00:15.837 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T07:00:15.837 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:15.838 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:15.838 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T07:00:15.838 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T07:00:15.838 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4826, 2024-05-30T07:00:15.838 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 20067720762, 2024-05-30T07:00:15.838 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 41278017536, 2024-05-30T07:00:15.838 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 731816095744, 2024-05-30T07:00:15.838 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T07:00:15.838 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 886542121, 2024-05-30T07:00:15.838 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 889409823, 2024-05-30T07:00:15.838 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 215, 2024-05-30T07:00:15.839 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 235 2024-05-30T07:00:15.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:15.839 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T07:00:15.839 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 85, 2024-05-30T07:00:15.839 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9, 2024-05-30T07:00:15.839 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T07:00:15.839 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T07:00:15.839 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T07:00:15.839 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T07:00:15.839 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:15.840 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 9, 2024-05-30T07:00:15.840 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T07:00:15.840 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "d", 2024-05-30T07:00:15.840 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T07:00:15.840 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9729 2024-05-30T07:00:15.840 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:15.840 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:15.840 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T07:00:15.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:15.840 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T07:00:15.840 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T07:00:15.841 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T07:00:15.841 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T07:00:15.841 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T07:00:15.841 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T07:00:15.841 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T07:00:15.841 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:15.841 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:15.841 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:15.841 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T07:00:15.841 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 22, 2024-05-30T07:00:15.841 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T07:00:15.031680+0000", 2024-05-30T07:00:15.842 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:15.842 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:15.842 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T07:00:15.842 INFO:teuthology.orchestra.run.smithi037.stdout: "19e12098-76d5-4ad1-9a9e-8c1702cf320b": { 2024-05-30T07:00:15.842 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 29.0 seconds before exiting (17s)\n [============================] ", 2024-05-30T07:00:15.842 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:15.842 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:15.842 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:15.842 INFO:teuthology.orchestra.run.smithi037.stdout: "ebf69c16-08d6-4852-b378-0e327d1911a9": { 2024-05-30T07:00:15.842 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 29.0 seconds before exiting (23s)\n [============================] ", 2024-05-30T07:00:15.842 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:15.843 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:15.843 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:15.843 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:15.843 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:00:15.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f396aa00640 1 -- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f394006a4b0 msgr2=0x7f394006c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:15.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f396aa00640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f394006a4b0 0x7f394006c970 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f39540ad000 tx=0x7f39540a6000 comp rx=0 tx=0).stop 2024-05-30T07:00:15.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f396aa00640 1 -- 172.21.15.37:0/1260651962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964146180 msgr2=0x7f39641370b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:15.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f396aa00640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964146180 0x7f39641370b0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f394c00e9a0 tx=0x7f394c00ee60 comp rx=0 tx=0).stop 2024-05-30T07:00:15.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f396aa00640 1 -- 172.21.15.37:0/1260651962 shutdown_connections 2024-05-30T07:00:15.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f396aa00640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f396415ce90 0x7f3964143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:15.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f396aa00640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964146180 0x7f39641370b0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:15.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f396aa00640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f394006a4b0 0x7f394006c970 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f396aa00640 1 --2- 172.21.15.37:0/1260651962 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39640b6570 0x7f396413b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f396aa00640 1 -- 172.21.15.37:0/1260651962 >> 172.21.15.37:0/1260651962 conn(0x7f39640b6a60 msgr2=0x7f39640b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f396aa00640 1 -- 172.21.15.37:0/1260651962 shutdown_connections 2024-05-30T07:00:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:15.833+0000 7f396aa00640 1 -- 172.21.15.37:0/1260651962 wait complete. 2024-05-30T07:00:15.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:00:15.855 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -lh volumes/_nogroup/subvol_clone52191/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a 2024-05-30T07:00:15.856 DEBUG:teuthology.orchestra.run.smithi037:> ) 2024-05-30T07:00:15.867 INFO:teuthology.orchestra.run.smithi037.stderr:ls: cannot access 'volumes/_nogroup/subvol_clone52191/e8f54342-ed10-4b83-bd4f-6fbcadbbb19a': No such file or directory 2024-05-30T07:00:15.867 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-30T07:00:15.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-05-30T07:00:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.049+0000 7f268ac00640 1 Processor -- start 2024-05-30T07:00:16.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.049+0000 7f268ac00640 1 -- start start 2024-05-30T07:00:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.049+0000 7f268ac00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f26840cffd0 0x7f26840cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.049+0000 7f268ac00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26840af0d0 con 0x7f26840d0600 2024-05-30T07:00:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.049+0000 7f268ac00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26840ce000 con 0x7f268415c9a0 2024-05-30T07:00:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.049+0000 7f268ac00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f26840ce2e0 con 0x7f26840cffd0 2024-05-30T07:00:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.049+0000 7f268a200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f26840cffd0 0x7f26840cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.049+0000 7f2689800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f26840d0600 0x7f26840d09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52394/0 (socket says 172.21.15.37:52394) 2024-05-30T07:00:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.049+0000 7f2689800640 1 -- 172.21.15.37:0/2094400828 learned_addr learned my addr 172.21.15.37:0/2094400828 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:00:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.049+0000 7f268a200640 1 -- 172.21.15.37:0/2094400828 >> v1:172.21.15.105:6789/0 conn(0x7f268415c9a0 legacy=0x7f26840afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.049+0000 7f268a200640 1 -- 172.21.15.37:0/2094400828 >> v1:172.21.15.37:6789/0 conn(0x7f26840d0600 legacy=0x7f26840d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.049+0000 7f268a200640 1 -- 172.21.15.37:0/2094400828 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26840af370 con 0x7f26840cffd0 2024-05-30T07:00:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.053+0000 7f268a200640 1 --2- 172.21.15.37:0/2094400828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26840cffd0 0x7f26840cd9d0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f267c009d90 tx=0x7f267c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284329fc01e6c371 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.053+0000 7f2683e00640 1 -- 172.21.15.37:0/2094400828 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0b2070 con 0x7f26840cffd0 2024-05-30T07:00:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.053+0000 7f2683e00640 1 -- 172.21.15.37:0/2094400828 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267c0a5930 con 0x7f26840cffd0 2024-05-30T07:00:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.053+0000 7f2683e00640 1 -- 172.21.15.37:0/2094400828 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0a5d00 con 0x7f26840cffd0 2024-05-30T07:00:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.053+0000 7f268ac00640 1 -- 172.21.15.37:0/2094400828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26840cffd0 msgr2=0x7f26840cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.053+0000 7f268ac00640 1 --2- 172.21.15.37:0/2094400828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26840cffd0 0x7f26840cd9d0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f267c009d90 tx=0x7f267c01c940 comp rx=0 tx=0).stop 2024-05-30T07:00:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.053+0000 7f268ac00640 1 -- 172.21.15.37:0/2094400828 shutdown_connections 2024-05-30T07:00:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.053+0000 7f268ac00640 1 --2- 172.21.15.37:0/2094400828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26840cffd0 0x7f26840cd9d0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.053+0000 7f268ac00640 1 -- 172.21.15.37:0/2094400828 >> 172.21.15.37:0/2094400828 conn(0x7f26840b3ef0 msgr2=0x7f26840b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.053+0000 7f268ac00640 1 -- 172.21.15.37:0/2094400828 shutdown_connections 2024-05-30T07:00:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.053+0000 7f268ac00640 1 -- 172.21.15.37:0/2094400828 wait complete. 2024-05-30T07:00:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268ac00640 1 Processor -- start 2024-05-30T07:00:16.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268ac00640 1 -- start start 2024-05-30T07:00:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268ac00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840cffd0 0x7f26841516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268ac00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26840d0600 0x7f2684167950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268ac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268415c9a0 0x7f2684071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268ac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26840b0e20 con 0x7f268415c9a0 2024-05-30T07:00:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268ac00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f26840b0ca0 con 0x7f26840d0600 2024-05-30T07:00:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268ac00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f268416a340 con 0x7f26840cffd0 2024-05-30T07:00:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268a200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268415c9a0 0x7f2684071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268a200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268415c9a0 0x7f2684071360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57426/0 (socket says 172.21.15.37:57426) 2024-05-30T07:00:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268a200640 1 -- 172.21.15.37:0/385834956 learned_addr learned my addr 172.21.15.37:0/385834956 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f2689800640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840cffd0 0x7f26841516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f2688e00640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26840d0600 0x7f2684167950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268a200640 1 -- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840cffd0 msgr2=0x7f26841516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268a200640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840cffd0 0x7f26841516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268a200640 1 -- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26840d0600 msgr2=0x7f2684167950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268a200640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26840d0600 0x7f2684167950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268a200640 1 -- 172.21.15.37:0/385834956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26840b5270 con 0x7f268415c9a0 2024-05-30T07:00:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f2689800640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840cffd0 0x7f26841516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f2688e00640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26840d0600 0x7f2684167950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268a200640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268415c9a0 0x7f2684071360 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f267c0b0040 tx=0x7f267c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f2681600640 1 -- 172.21.15.37:0/385834956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0b2050 con 0x7f268415c9a0 2024-05-30T07:00:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f2681600640 1 -- 172.21.15.37:0/385834956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f267c0be070 con 0x7f268415c9a0 2024-05-30T07:00:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f2681600640 1 -- 172.21.15.37:0/385834956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c0adaf0 con 0x7f268415c9a0 2024-05-30T07:00:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268ac00640 1 -- 172.21.15.37:0/385834956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26840b5550 con 0x7f268415c9a0 2024-05-30T07:00:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.057+0000 7f268ac00640 1 -- 172.21.15.37:0/385834956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26840b5b10 con 0x7f268415c9a0 2024-05-30T07:00:16.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.061+0000 7f268ac00640 1 -- 172.21.15.37:0/385834956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2684068ab0 con 0x7f268415c9a0 2024-05-30T07:00:16.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.061+0000 7f2681600640 1 -- 172.21.15.37:0/385834956 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) ==== 90996+0+0 (secure 0 0 0) 0x7f267c0adc90 con 0x7f268415c9a0 2024-05-30T07:00:16.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.061+0000 7f2681600640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f266406a4b0 0x7f266406c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:16.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.061+0000 7f2681600640 1 -- 172.21.15.37:0/385834956 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f267c120e50 con 0x7f268415c9a0 2024-05-30T07:00:16.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.061+0000 7f2689800640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f266406a4b0 0x7f266406c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.061+0000 7f2689800640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f266406a4b0 0x7f266406c970 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2678005890 tx=0x7f2678009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:16.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.065+0000 7f2681600640 1 -- 172.21.15.37:0/385834956 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f267c016560 con 0x7f268415c9a0 2024-05-30T07:00:16.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.257+0000 7f268ac00640 1 -- 172.21.15.37:0/385834956 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f26840ce930 con 0x7f266406a4b0 2024-05-30T07:00:16.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.257+0000 7f2681600640 1 -- 172.21.15.37:0/385834956 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f26840ce930 con 0x7f266406a4b0 2024-05-30T07:00:16.259 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T07:00:16.259 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:16.259 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2024-05-30T07:00:16.259 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:16.259 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T07:00:16.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.257+0000 7f268ac00640 1 -- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f266406a4b0 msgr2=0x7f266406c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:16.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.257+0000 7f268ac00640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f266406a4b0 0x7f266406c970 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2678005890 tx=0x7f2678009040 comp rx=0 tx=0).stop 2024-05-30T07:00:16.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.257+0000 7f268ac00640 1 -- 172.21.15.37:0/385834956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268415c9a0 msgr2=0x7f2684071360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:16.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.257+0000 7f268ac00640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268415c9a0 0x7f2684071360 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f267c0b0040 tx=0x7f267c0196e0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.261+0000 7f268ac00640 1 -- 172.21.15.37:0/385834956 shutdown_connections 2024-05-30T07:00:16.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.261+0000 7f268ac00640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f268415c9a0 0x7f2684071360 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.261+0000 7f268ac00640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f266406a4b0 0x7f266406c970 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.261+0000 7f268ac00640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26840d0600 0x7f2684167950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.261+0000 7f268ac00640 1 --2- 172.21.15.37:0/385834956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840cffd0 0x7f26841516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.261+0000 7f268ac00640 1 -- 172.21.15.37:0/385834956 >> 172.21.15.37:0/385834956 conn(0x7f26840b3ef0 msgr2=0x7f26840b72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:16.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.261+0000 7f268ac00640 1 -- 172.21.15.37:0/385834956 shutdown_connections 2024-05-30T07:00:16.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.261+0000 7f268ac00640 1 -- 172.21.15.37:0/385834956 wait complete. 2024-05-30T07:00:16.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T07:00:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbcef200640 1 Processor -- start 2024-05-30T07:00:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbcef200640 1 -- start start 2024-05-30T07:00:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbcef200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce806e000 0x7fbce80ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbcef200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbce80cee10 0x7fbce806f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbcef200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbce80cd120 con 0x7fbce815cd80 2024-05-30T07:00:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbcef200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbce80a9530 con 0x7fbce80cee10 2024-05-30T07:00:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbcef200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbce80cd400 con 0x7fbce806e000 2024-05-30T07:00:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbce7e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce806e000 0x7fbce80ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbced200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbce80cee10 0x7fbce806f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbce7e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce806e000 0x7fbce80ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:38982/0 (socket says 172.21.15.37:38982) 2024-05-30T07:00:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbce7e00640 1 -- 172.21.15.37:0/3342875820 learned_addr learned my addr 172.21.15.37:0/3342875820 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbce7400640 1 --1- 172.21.15.37:0/3342875820 >> v1:172.21.15.105:6789/0 conn(0x7fbce815cd80 0x7fbce80ce700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:47272/0 (socket says 172.21.15.37:47272) 2024-05-30T07:00:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbce7e00640 1 -- 172.21.15.37:0/3342875820 >> v2:172.21.15.105:3300/0 conn(0x7fbce80cee10 msgr2=0x7fbce806f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbce7e00640 1 --2- 172.21.15.37:0/3342875820 >> v2:172.21.15.105:3300/0 conn(0x7fbce80cee10 0x7fbce806f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbce7e00640 1 -- 172.21.15.37:0/3342875820 >> v1:172.21.15.105:6789/0 conn(0x7fbce815cd80 legacy=0x7fbce80ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbce7e00640 1 -- 172.21.15.37:0/3342875820 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce80cd6e0 con 0x7fbce806e000 2024-05-30T07:00:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.421+0000 7fbced200640 1 --2- 172.21.15.37:0/3342875820 >> v2:172.21.15.105:3300/0 conn(0x7fbce80cee10 0x7fbce806f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T07:00:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.425+0000 7fbce7e00640 1 --2- 172.21.15.37:0/3342875820 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce806e000 0x7fbce80ce1c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009870 tx=0x7fbcd801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d84c7735a71e85f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.425+0000 7fbce6a00640 1 -- 172.21.15.37:0/3342875820 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80b5070 con 0x7fbce806e000 2024-05-30T07:00:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.425+0000 7fbce6a00640 1 -- 172.21.15.37:0/3342875820 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd80a8a50 con 0x7fbce806e000 2024-05-30T07:00:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.425+0000 7fbce6a00640 1 -- 172.21.15.37:0/3342875820 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80a8e20 con 0x7fbce806e000 2024-05-30T07:00:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.425+0000 7fbcef200640 1 -- 172.21.15.37:0/3342875820 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce806e000 msgr2=0x7fbce80ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.425+0000 7fbcef200640 1 --2- 172.21.15.37:0/3342875820 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce806e000 0x7fbce80ce1c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8009870 tx=0x7fbcd801ed50 comp rx=0 tx=0).stop 2024-05-30T07:00:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.425+0000 7fbcef200640 1 -- 172.21.15.37:0/3342875820 shutdown_connections 2024-05-30T07:00:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.425+0000 7fbcef200640 1 --2- 172.21.15.37:0/3342875820 >> v2:172.21.15.105:3300/0 conn(0x7fbce80cee10 0x7fbce806f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.425+0000 7fbcef200640 1 --2- 172.21.15.37:0/3342875820 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce806e000 0x7fbce80ce1c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.425+0000 7fbcef200640 1 -- 172.21.15.37:0/3342875820 >> 172.21.15.37:0/3342875820 conn(0x7fbce80b23a0 msgr2=0x7fbce80b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.425+0000 7fbcef200640 1 -- 172.21.15.37:0/3342875820 shutdown_connections 2024-05-30T07:00:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.425+0000 7fbcef200640 1 -- 172.21.15.37:0/3342875820 wait complete. 2024-05-30T07:00:16.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcef200640 1 Processor -- start 2024-05-30T07:00:16.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcef200640 1 -- start start 2024-05-30T07:00:16.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcef200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce806e000 0x7fbce8144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:16.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcef200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbce80cee10 0x7fbce8159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:16.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcef200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce815cd80 0x7fbce80b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:16.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcef200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbce806f930 con 0x7fbce80cee10 2024-05-30T07:00:16.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcef200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbce80cdca0 con 0x7fbce815cd80 2024-05-30T07:00:16.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcef200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbce806fab0 con 0x7fbce806e000 2024-05-30T07:00:16.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbce7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbce80cee10 0x7fbce8159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:16.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbce7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbce80cee10 0x7fbce8159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57440/0 (socket says 172.21.15.37:57440) 2024-05-30T07:00:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbce7400640 1 -- 172.21.15.37:0/1063979295 learned_addr learned my addr 172.21.15.37:0/1063979295 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbce7e00640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce806e000 0x7fbce8144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbced200640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce815cd80 0x7fbce80b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbce7400640 1 -- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce806e000 msgr2=0x7fbce8144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbce7400640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce806e000 0x7fbce8144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbce7400640 1 -- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce815cd80 msgr2=0x7fbce80b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbce7400640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce815cd80 0x7fbce80b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbce7400640 1 -- 172.21.15.37:0/1063979295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce8143d10 con 0x7fbce80cee10 2024-05-30T07:00:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbce7400640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbce80cee10 0x7fbce8159bc0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c420 tx=0x7fbcd400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcdfe00640 1 -- 172.21.15.37:0/1063979295 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40074e0 con 0x7fbce80cee10 2024-05-30T07:00:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcdfe00640 1 -- 172.21.15.37:0/1063979295 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd4007680 con 0x7fbce80cee10 2024-05-30T07:00:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcdfe00640 1 -- 172.21.15.37:0/1063979295 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4004a30 con 0x7fbce80cee10 2024-05-30T07:00:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcef200640 1 -- 172.21.15.37:0/1063979295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce8144050 con 0x7fbce80cee10 2024-05-30T07:00:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcef200640 1 -- 172.21.15.37:0/1063979295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce8144890 con 0x7fbce80cee10 2024-05-30T07:00:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.429+0000 7fbcef200640 1 -- 172.21.15.37:0/1063979295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce8068b20 con 0x7fbce80cee10 2024-05-30T07:00:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.433+0000 7fbcdfe00640 1 -- 172.21.15.37:0/1063979295 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) ==== 90996+0+0 (secure 0 0 0) 0x7fbcd401a020 con 0x7fbce80cee10 2024-05-30T07:00:16.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.433+0000 7fbcdfe00640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbcc806a4b0 0x7fbcc806c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.433+0000 7fbcdfe00640 1 -- 172.21.15.37:0/1063979295 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fbcd40852c0 con 0x7fbce80cee10 2024-05-30T07:00:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.433+0000 7fbce7e00640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbcc806a4b0 0x7fbcc806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.433+0000 7fbce7e00640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbcc806a4b0 0x7fbcc806c970 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80b2000 tx=0x7fbcd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.437+0000 7fbcdfe00640 1 -- 172.21.15.37:0/1063979295 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbce8144050 con 0x7fbce80cee10 2024-05-30T07:00:16.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcef200640 1 -- 172.21.15.37:0/1063979295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fbce8145350 con 0x7fbce80cee10 2024-05-30T07:00:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcdfe00640 1 -- 172.21.15.37:0/1063979295 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2381 (secure 0 0 0) 0x7fbcd4057380 con 0x7fbce80cee10 2024-05-30T07:00:16.674 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:16.674 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:00:16.674 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T07:00:16.674 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T07:00:16.674 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T07:00:16.675 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T07:00:16.675 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T07:00:16.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:16.675 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T07:00:16.675 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T07:00:16.675 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T07:00:16.675 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T07:00:16.675 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T07:00:16.675 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:16.675 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T07:00:16.675 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T07:00:16.675 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T07:00:16.676 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T07:00:16.676 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:16.676 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 1111, 2024-05-30T07:00:16.676 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T07:00:16.676 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T07:00:16.676 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T07:00:16.676 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T07:00:16.676 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:16.676 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T07:00:16.676 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 130, 2024-05-30T07:00:16.676 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T07:00:16.677 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T07:00:16.677 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T07:00:16.677 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T07:00:16.677 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T07:00:16.677 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T07:00:16.677 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:16.677 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T07:00:16.677 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T07:00:16.677 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:16.677 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T07:00:16.677 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T07:00:16.677 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:16.677 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:16.678 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T07:00:16.678 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T07:00:16.678 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4826, 2024-05-30T07:00:16.678 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 20067720762, 2024-05-30T07:00:16.678 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 41278017536, 2024-05-30T07:00:16.678 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 731816095744, 2024-05-30T07:00:16.678 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T07:00:16.678 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 886542121, 2024-05-30T07:00:16.678 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 889409823, 2024-05-30T07:00:16.678 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 215, 2024-05-30T07:00:16.679 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 235 2024-05-30T07:00:16.679 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:16.679 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T07:00:16.679 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 85, 2024-05-30T07:00:16.679 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9, 2024-05-30T07:00:16.679 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T07:00:16.679 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T07:00:16.679 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T07:00:16.679 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T07:00:16.679 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:16.679 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 9, 2024-05-30T07:00:16.679 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T07:00:16.680 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "d", 2024-05-30T07:00:16.680 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T07:00:16.680 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9729 2024-05-30T07:00:16.680 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:16.680 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:16.680 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T07:00:16.680 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:16.680 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T07:00:16.680 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T07:00:16.680 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T07:00:16.680 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T07:00:16.680 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 22, 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T07:00:15.031680+0000", 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: "19e12098-76d5-4ad1-9a9e-8c1702cf320b": { 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 29.0 seconds before exiting (17s)\n [============================] ", 2024-05-30T07:00:16.681 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:16.682 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:16.682 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:16.682 INFO:teuthology.orchestra.run.smithi037.stdout: "ebf69c16-08d6-4852-b378-0e327d1911a9": { 2024-05-30T07:00:16.682 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 29.0 seconds before exiting (23s)\n [============================] ", 2024-05-30T07:00:16.682 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:16.682 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:16.682 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:16.682 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:16.682 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:00:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcef200640 1 -- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbcc806a4b0 msgr2=0x7fbcc806c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcef200640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbcc806a4b0 0x7fbcc806c970 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80b2000 tx=0x7fbcd8008040 comp rx=0 tx=0).stop 2024-05-30T07:00:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcef200640 1 -- 172.21.15.37:0/1063979295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbce80cee10 msgr2=0x7fbce8159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcef200640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbce80cee10 0x7fbce8159bc0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c420 tx=0x7fbcd400c8e0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcef200640 1 -- 172.21.15.37:0/1063979295 shutdown_connections 2024-05-30T07:00:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcef200640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbcc806a4b0 0x7fbcc806c970 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcef200640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce815cd80 0x7fbce80b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcef200640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbce80cee10 0x7fbce8159bc0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcef200640 1 --2- 172.21.15.37:0/1063979295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce806e000 0x7fbce8144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcef200640 1 -- 172.21.15.37:0/1063979295 >> 172.21.15.37:0/1063979295 conn(0x7fbce80b23a0 msgr2=0x7fbce8074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcef200640 1 -- 172.21.15.37:0/1063979295 shutdown_connections 2024-05-30T07:00:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:16.673+0000 7fbcef200640 1 -- 172.21.15.37:0/1063979295 wait complete. 2024-05-30T07:00:21.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T07:00:21.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.833+0000 7fdb0e400640 1 Processor -- start 2024-05-30T07:00:21.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.833+0000 7fdb0e400640 1 -- start start 2024-05-30T07:00:21.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdb0e400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb0806e000 0x7fdb080ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:21.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdb0e400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb0815cd80 0x7fdb080ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:21.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdb0e400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb080cd120 con 0x7fdb080cec40 2024-05-30T07:00:21.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdb0e400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdb080a9530 con 0x7fdb0806e000 2024-05-30T07:00:21.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdb0e400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb080cd400 con 0x7fdb0815cd80 2024-05-30T07:00:21.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdb07400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb0806e000 0x7fdb080ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:21.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdb07400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb0806e000 0x7fdb080ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40230/0 (socket says 172.21.15.37:40230) 2024-05-30T07:00:21.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdb07400640 1 -- 172.21.15.37:0/1386568688 learned_addr learned my addr 172.21.15.37:0/1386568688 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:21.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdafea00640 1 --2- 172.21.15.37:0/1386568688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb0815cd80 0x7fdb080ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:21.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdb07400640 1 -- 172.21.15.37:0/1386568688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb0815cd80 msgr2=0x7fdb080ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:21.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdb07400640 1 --2- 172.21.15.37:0/1386568688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb0815cd80 0x7fdb080ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:21.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdb07400640 1 -- 172.21.15.37:0/1386568688 >> v1:172.21.15.105:6789/0 conn(0x7fdb080cec40 legacy=0x7fdb0806e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:21.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdb07400640 1 -- 172.21.15.37:0/1386568688 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb080cd6e0 con 0x7fdb0806e000 2024-05-30T07:00:21.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.837+0000 7fdafea00640 1 --2- 172.21.15.37:0/1386568688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb0815cd80 0x7fdb080ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:21.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb07400640 1 --2- 172.21.15.37:0/1386568688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0806e000 0x7fdb080ce1c0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8009870 tx=0x7fdaf801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd4bbc24f949917 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:21.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb06a00640 1 -- 172.21.15.37:0/1386568688 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80b5070 con 0x7fdb0806e000 2024-05-30T07:00:21.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb06a00640 1 -- 172.21.15.37:0/1386568688 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf80a8a50 con 0x7fdb0806e000 2024-05-30T07:00:21.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb06a00640 1 -- 172.21.15.37:0/1386568688 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80a8e20 con 0x7fdb0806e000 2024-05-30T07:00:21.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb0e400640 1 -- 172.21.15.37:0/1386568688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0806e000 msgr2=0x7fdb080ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:21.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb0e400640 1 --2- 172.21.15.37:0/1386568688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0806e000 0x7fdb080ce1c0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8009870 tx=0x7fdaf801ed50 comp rx=0 tx=0).stop 2024-05-30T07:00:21.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb0e400640 1 -- 172.21.15.37:0/1386568688 shutdown_connections 2024-05-30T07:00:21.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb0e400640 1 --2- 172.21.15.37:0/1386568688 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb0815cd80 0x7fdb080ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:21.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb0e400640 1 --2- 172.21.15.37:0/1386568688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0806e000 0x7fdb080ce1c0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:21.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb0e400640 1 -- 172.21.15.37:0/1386568688 >> 172.21.15.37:0/1386568688 conn(0x7fdb080b23a0 msgr2=0x7fdb080b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:21.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb0e400640 1 -- 172.21.15.37:0/1386568688 shutdown_connections 2024-05-30T07:00:21.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb0e400640 1 -- 172.21.15.37:0/1386568688 wait complete. 2024-05-30T07:00:21.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb0e400640 1 Processor -- start 2024-05-30T07:00:21.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.841+0000 7fdb0e400640 1 -- start start 2024-05-30T07:00:21.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb0e400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0806e000 0x7fdb0813be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:21.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb0e400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb080cec40 0x7fdb0815d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:21.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb0e400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb0815cd80 0x7fdb0815de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb0e400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb080cf0a0 con 0x7fdb0806e000 2024-05-30T07:00:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb0e400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdb080cdca0 con 0x7fdb0815cd80 2024-05-30T07:00:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb0e400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb081663c0 con 0x7fdb080cec40 2024-05-30T07:00:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb07400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0806e000 0x7fdb0813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb07400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0806e000 0x7fdb0813be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40246/0 (socket says 172.21.15.37:40246) 2024-05-30T07:00:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb07400640 1 -- 172.21.15.37:0/2045579650 learned_addr learned my addr 172.21.15.37:0/2045579650 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdafea00640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb080cec40 0x7fdb0815d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb07e00640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb0815cd80 0x7fdb0815de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb07400640 1 -- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb080cec40 msgr2=0x7fdb0815d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb07400640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb080cec40 0x7fdb0815d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb07400640 1 -- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb0815cd80 msgr2=0x7fdb0815de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb07400640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb0815cd80 0x7fdb0815de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:21.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb07400640 1 -- 172.21.15.37:0/2045579650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0815a880 con 0x7fdb0806e000 2024-05-30T07:00:21.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb07400640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0806e000 0x7fdb0813be80 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80b3040 tx=0x7fdaf801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:21.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdaffe00640 1 -- 172.21.15.37:0/2045579650 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80c0070 con 0x7fdb0806e000 2024-05-30T07:00:21.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdaffe00640 1 -- 172.21.15.37:0/2045579650 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf80ae790 con 0x7fdb0806e000 2024-05-30T07:00:21.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdaffe00640 1 -- 172.21.15.37:0/2045579650 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80b5070 con 0x7fdb0806e000 2024-05-30T07:00:21.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb0e400640 1 -- 172.21.15.37:0/2045579650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0815ab60 con 0x7fdb0806e000 2024-05-30T07:00:21.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb0e400640 1 -- 172.21.15.37:0/2045579650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb0815b120 con 0x7fdb0806e000 2024-05-30T07:00:21.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdb0e400640 1 -- 172.21.15.37:0/2045579650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb08068b20 con 0x7fdb0806e000 2024-05-30T07:00:21.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.845+0000 7fdaffe00640 1 -- 172.21.15.37:0/2045579650 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 50) ==== 90945+0+0 (secure 0 0 0) 0x7fdaf80b9070 con 0x7fdb0806e000 2024-05-30T07:00:21.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.849+0000 7fdaffe00640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdae406a420 0x7fdae406c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:21.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.849+0000 7fdaffe00640 1 -- 172.21.15.37:0/2045579650 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fdaf81231d0 con 0x7fdb0806e000 2024-05-30T07:00:21.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.849+0000 7fdafea00640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdae406a420 0x7fdae406c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:21.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.849+0000 7fdafea00640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdae406a420 0x7fdae406c8e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fdb0815d360 tx=0x7fdaf0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:21.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:21.853+0000 7fdaffe00640 1 -- 172.21.15.37:0/2045579650 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdaf80188b0 con 0x7fdb0806e000 2024-05-30T07:00:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.077+0000 7fdb0e400640 1 -- 172.21.15.37:0/2045579650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fdb080b2fd0 con 0x7fdb0806e000 2024-05-30T07:00:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.077+0000 7fdaffe00640 1 -- 172.21.15.37:0/2045579650 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2379 (secure 0 0 0) 0x7fdaf80f5e20 con 0x7fdb0806e000 2024-05-30T07:00:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:22.080 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:00:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T07:00:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T07:00:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T07:00:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T07:00:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T07:00:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T07:00:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T07:00:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T07:00:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T07:00:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T07:00:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T07:00:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T07:00:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T07:00:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T07:00:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 1116, 2024-05-30T07:00:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T07:00:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T07:00:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T07:00:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T07:00:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T07:00:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 130, 2024-05-30T07:00:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T07:00:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T07:00:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4819, 2024-05-30T07:00:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 20067774253, 2024-05-30T07:00:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 41294835712, 2024-05-30T07:00:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 731799277568, 2024-05-30T07:00:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T07:00:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 246310099, 2024-05-30T07:00:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 251583017, 2024-05-30T07:00:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 60, 2024-05-30T07:00:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 71 2024-05-30T07:00:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T07:00:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 85, 2024-05-30T07:00:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9, 2024-05-30T07:00:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T07:00:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T07:00:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T07:00:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T07:00:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 9, 2024-05-30T07:00:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T07:00:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "d", 2024-05-30T07:00:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T07:00:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9729 2024-05-30T07:00:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T07:00:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T07:00:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T07:00:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T07:00:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T07:00:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T07:00:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T07:00:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T07:00:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T07:00:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 22, 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T07:00:15.031680+0000", 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "19e12098-76d5-4ad1-9a9e-8c1702cf320b": { 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 23.0 seconds before exiting (23s)\n [============================] ", 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "ebf69c16-08d6-4852-b378-0e327d1911a9": { 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 23.0 seconds before exiting (29s)\n [============================] ", 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:22.088 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:22.088 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:00:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.081+0000 7fdb0e400640 1 -- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdae406a420 msgr2=0x7fdae406c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.081+0000 7fdb0e400640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdae406a420 0x7fdae406c8e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fdb0815d360 tx=0x7fdaf0008040 comp rx=0 tx=0).stop 2024-05-30T07:00:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.081+0000 7fdb0e400640 1 -- 172.21.15.37:0/2045579650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0806e000 msgr2=0x7fdb0813be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.081+0000 7fdb0e400640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0806e000 0x7fdb0813be80 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80b3040 tx=0x7fdaf801baf0 comp rx=0 tx=0).stop 2024-05-30T07:00:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.081+0000 7fdb0e400640 1 -- 172.21.15.37:0/2045579650 shutdown_connections 2024-05-30T07:00:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.081+0000 7fdb0e400640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fdae406a420 0x7fdae406c8e0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.081+0000 7fdb0e400640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb0815cd80 0x7fdb0815de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.081+0000 7fdb0e400640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb080cec40 0x7fdb0815d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.081+0000 7fdb0e400640 1 --2- 172.21.15.37:0/2045579650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb0806e000 0x7fdb0813be80 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.081+0000 7fdb0e400640 1 -- 172.21.15.37:0/2045579650 >> 172.21.15.37:0/2045579650 conn(0x7fdb080b23a0 msgr2=0x7fdb08142230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.081+0000 7fdb0e400640 1 -- 172.21.15.37:0/2045579650 shutdown_connections 2024-05-30T07:00:22.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:22.081+0000 7fdb0e400640 1 -- 172.21.15.37:0/2045579650 wait complete. 2024-05-30T07:00:27.102 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T07:00:27.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.253+0000 7fa8f8a00640 1 Processor -- start 2024-05-30T07:00:27.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.253+0000 7fa8f8a00640 1 -- start start 2024-05-30T07:00:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f8a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa8f41605d0 0x7fa8f40b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f8a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8f41609b0 0x7fa8f4160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f8a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8f415f7d0 0x7fa8f415fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f8a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f40cdda0 con 0x7fa8f415f7d0 2024-05-30T07:00:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f8a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f40ce080 con 0x7fa8f41605d0 2024-05-30T07:00:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f8a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f409ac00 con 0x7fa8f41609b0 2024-05-30T07:00:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f3200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8f415f7d0 0x7fa8f415fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f3200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8f415f7d0 0x7fa8f415fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40250/0 (socket says 172.21.15.37:40250) 2024-05-30T07:00:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f3200640 1 -- 172.21.15.37:0/1455337483 learned_addr learned my addr 172.21.15.37:0/1455337483 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8e9e00640 1 --2- 172.21.15.37:0/1455337483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8f41609b0 0x7fa8f4160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f2800640 1 --2- 172.21.15.37:0/1455337483 >> v2:172.21.15.105:3300/0 conn(0x7fa8f41605d0 0x7fa8f40b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f3200640 1 -- 172.21.15.37:0/1455337483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8f41609b0 msgr2=0x7fa8f4160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f3200640 1 --2- 172.21.15.37:0/1455337483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8f41609b0 0x7fa8f4160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f3200640 1 -- 172.21.15.37:0/1455337483 >> v2:172.21.15.105:3300/0 conn(0x7fa8f41605d0 msgr2=0x7fa8f40b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f3200640 1 --2- 172.21.15.37:0/1455337483 >> v2:172.21.15.105:3300/0 conn(0x7fa8f41605d0 0x7fa8f40b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f3200640 1 -- 172.21.15.37:0/1455337483 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f409aee0 con 0x7fa8f415f7d0 2024-05-30T07:00:27.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8f2800640 1 --2- 172.21.15.37:0/1455337483 >> v2:172.21.15.105:3300/0 conn(0x7fa8f41605d0 0x7fa8f40b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:27.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.257+0000 7fa8e9e00640 1 --2- 172.21.15.37:0/1455337483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8f41609b0 0x7fa8f4160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:27.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f3200640 1 --2- 172.21.15.37:0/1455337483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f415f7d0 0x7fa8f415fc80 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fa8f406f780 tx=0x7fa8ec01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130893c3e41857d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:27.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f1e00640 1 -- 172.21.15.37:0/1455337483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0b0070 con 0x7fa8f415f7d0 2024-05-30T07:00:27.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f1e00640 1 -- 172.21.15.37:0/1455337483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ec0ab600 con 0x7fa8f415f7d0 2024-05-30T07:00:27.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f1e00640 1 -- 172.21.15.37:0/1455337483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0ab9d0 con 0x7fa8f415f7d0 2024-05-30T07:00:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 -- 172.21.15.37:0/1455337483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f415f7d0 msgr2=0x7fa8f415fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 --2- 172.21.15.37:0/1455337483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f415f7d0 0x7fa8f415fc80 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fa8f406f780 tx=0x7fa8ec01c520 comp rx=0 tx=0).stop 2024-05-30T07:00:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 -- 172.21.15.37:0/1455337483 shutdown_connections 2024-05-30T07:00:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 --2- 172.21.15.37:0/1455337483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f415f7d0 0x7fa8f415fc80 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:27.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 --2- 172.21.15.37:0/1455337483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8f41609b0 0x7fa8f4160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 --2- 172.21.15.37:0/1455337483 >> v2:172.21.15.105:3300/0 conn(0x7fa8f41605d0 0x7fa8f40b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 -- 172.21.15.37:0/1455337483 >> 172.21.15.37:0/1455337483 conn(0x7fa8f40b3f50 msgr2=0x7fa8f40b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 -- 172.21.15.37:0/1455337483 shutdown_connections 2024-05-30T07:00:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 -- 172.21.15.37:0/1455337483 wait complete. 2024-05-30T07:00:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 Processor -- start 2024-05-30T07:00:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 -- start start 2024-05-30T07:00:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f415f7d0 0x7fa8f41518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8f41605d0 0x7fa8f40b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8f41609b0 0x7fa8f40b6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f40d0030 con 0x7fa8f415f7d0 2024-05-30T07:00:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f409be20 con 0x7fa8f41605d0 2024-05-30T07:00:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.261+0000 7fa8f8a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f40d01b0 con 0x7fa8f41609b0 2024-05-30T07:00:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8f2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f415f7d0 0x7fa8f41518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8f2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f415f7d0 0x7fa8f41518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40258/0 (socket says 172.21.15.37:40258) 2024-05-30T07:00:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8f3200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8f41609b0 0x7fa8f40b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:27.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8f2800640 1 -- 172.21.15.37:0/357017403 learned_addr learned my addr 172.21.15.37:0/357017403 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:27.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8e9e00640 1 --2- 172.21.15.37:0/357017403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8f41605d0 0x7fa8f40b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8f2800640 1 -- 172.21.15.37:0/357017403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8f41609b0 msgr2=0x7fa8f40b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8f2800640 1 --2- 172.21.15.37:0/357017403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8f41609b0 0x7fa8f40b6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8f2800640 1 -- 172.21.15.37:0/357017403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8f41605d0 msgr2=0x7fa8f40b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8f2800640 1 --2- 172.21.15.37:0/357017403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8f41605d0 0x7fa8f40b5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8f2800640 1 -- 172.21.15.37:0/357017403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f4151e20 con 0x7fa8f415f7d0 2024-05-30T07:00:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8f2800640 1 --2- 172.21.15.37:0/357017403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f415f7d0 0x7fa8f41518e0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400c7c0 tx=0x7fa8e400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8eb400640 1 -- 172.21.15.37:0/357017403 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4007a30 con 0x7fa8f415f7d0 2024-05-30T07:00:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8eb400640 1 -- 172.21.15.37:0/357017403 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e4007bd0 con 0x7fa8f415f7d0 2024-05-30T07:00:27.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8eb400640 1 -- 172.21.15.37:0/357017403 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e40113f0 con 0x7fa8f415f7d0 2024-05-30T07:00:27.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8f8a00640 1 -- 172.21.15.37:0/357017403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f40c60b0 con 0x7fa8f415f7d0 2024-05-30T07:00:27.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8f8a00640 1 -- 172.21.15.37:0/357017403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f40c6650 con 0x7fa8f415f7d0 2024-05-30T07:00:27.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8f8a00640 1 -- 172.21.15.37:0/357017403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f4068ab0 con 0x7fa8f415f7d0 2024-05-30T07:00:27.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.265+0000 7fa8eb400640 1 -- 172.21.15.37:0/357017403 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 50) ==== 90945+0+0 (secure 0 0 0) 0x7fa8e4011590 con 0x7fa8f415f7d0 2024-05-30T07:00:27.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.269+0000 7fa8eb400640 1 --2- 172.21.15.37:0/357017403 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8d006a420 0x7fa8d006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:27.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.269+0000 7fa8eb400640 1 -- 172.21.15.37:0/357017403 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fa8e4085c50 con 0x7fa8f415f7d0 2024-05-30T07:00:27.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.269+0000 7fa8e9e00640 1 --2- 172.21.15.37:0/357017403 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8d006a420 0x7fa8d006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:27.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.269+0000 7fa8e9e00640 1 --2- 172.21.15.37:0/357017403 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8d006a420 0x7fa8d006c8e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40ccab0 tx=0x7fa8dc0077c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:27.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.273+0000 7fa8eb400640 1 -- 172.21.15.37:0/357017403 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa8e4015020 con 0x7fa8f415f7d0 2024-05-30T07:00:27.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.501+0000 7fa8f8a00640 1 -- 172.21.15.37:0/357017403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa8f415b5c0 con 0x7fa8f415f7d0 2024-05-30T07:00:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.501+0000 7fa8eb400640 1 -- 172.21.15.37:0/357017403 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2366 (secure 0 0 0) 0x7fa8e4057620 con 0x7fa8f415f7d0 2024-05-30T07:00:27.504 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:27.504 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:00:27.504 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T07:00:27.505 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T07:00:27.505 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T07:00:27.505 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T07:00:27.505 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T07:00:27.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:27.505 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T07:00:27.505 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T07:00:27.505 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T07:00:27.505 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T07:00:27.505 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T07:00:27.505 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:27.506 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T07:00:27.506 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T07:00:27.506 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T07:00:27.506 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T07:00:27.506 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:27.506 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 1121, 2024-05-30T07:00:27.506 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T07:00:27.506 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T07:00:27.506 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T07:00:27.506 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T07:00:27.506 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:27.506 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T07:00:27.507 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 130, 2024-05-30T07:00:27.507 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T07:00:27.507 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T07:00:27.507 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T07:00:27.507 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T07:00:27.507 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T07:00:27.507 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T07:00:27.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:27.507 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T07:00:27.507 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T07:00:27.507 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:27.507 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T07:00:27.507 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4819, 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 20067778328, 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 41294897152, 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 731799216128, 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: "read_bytes_sec": 426, 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 5886, 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 2 2024-05-30T07:00:27.508 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:27.509 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T07:00:27.509 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 85, 2024-05-30T07:00:27.509 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9, 2024-05-30T07:00:27.509 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T07:00:27.509 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T07:00:27.509 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T07:00:27.509 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T07:00:27.509 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:27.509 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 9, 2024-05-30T07:00:27.509 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T07:00:27.509 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "d", 2024-05-30T07:00:27.509 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T07:00:27.510 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9729 2024-05-30T07:00:27.510 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:27.510 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:27.510 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T07:00:27.510 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:27.510 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T07:00:27.510 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T07:00:27.510 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T07:00:27.510 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T07:00:27.510 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T07:00:27.510 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T07:00:27.510 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T07:00:27.510 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:27.511 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:27.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:27.511 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T07:00:27.511 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 22, 2024-05-30T07:00:27.511 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T07:00:15.031680+0000", 2024-05-30T07:00:27.511 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:27.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:27.511 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T07:00:27.511 INFO:teuthology.orchestra.run.smithi037.stdout: "19e12098-76d5-4ad1-9a9e-8c1702cf320b": { 2024-05-30T07:00:27.511 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 17.0 seconds before exiting (29s)\n [============================] ", 2024-05-30T07:00:27.511 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:27.511 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:27.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:27.512 INFO:teuthology.orchestra.run.smithi037.stdout: "ebf69c16-08d6-4852-b378-0e327d1911a9": { 2024-05-30T07:00:27.512 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 17.0 seconds before exiting (35s)\n [============================] ", 2024-05-30T07:00:27.512 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:27.512 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:27.512 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:27.512 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:27.512 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:00:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.505+0000 7fa8f8a00640 1 -- 172.21.15.37:0/357017403 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8d006a420 msgr2=0x7fa8d006c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.505+0000 7fa8f8a00640 1 --2- 172.21.15.37:0/357017403 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8d006a420 0x7fa8d006c8e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40ccab0 tx=0x7fa8dc0077c0 comp rx=0 tx=0).stop 2024-05-30T07:00:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.505+0000 7fa8f8a00640 1 -- 172.21.15.37:0/357017403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f415f7d0 msgr2=0x7fa8f41518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.505+0000 7fa8f8a00640 1 --2- 172.21.15.37:0/357017403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f415f7d0 0x7fa8f41518e0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400c7c0 tx=0x7fa8e400cc80 comp rx=0 tx=0).stop 2024-05-30T07:00:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.505+0000 7fa8f8a00640 1 -- 172.21.15.37:0/357017403 shutdown_connections 2024-05-30T07:00:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.505+0000 7fa8f8a00640 1 --2- 172.21.15.37:0/357017403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa8f41609b0 0x7fa8f40b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.505+0000 7fa8f8a00640 1 --2- 172.21.15.37:0/357017403 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa8d006a420 0x7fa8d006c8e0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.505+0000 7fa8f8a00640 1 --2- 172.21.15.37:0/357017403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa8f41605d0 0x7fa8f40b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.505+0000 7fa8f8a00640 1 --2- 172.21.15.37:0/357017403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8f415f7d0 0x7fa8f41518e0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.505+0000 7fa8f8a00640 1 -- 172.21.15.37:0/357017403 >> 172.21.15.37:0/357017403 conn(0x7fa8f40b3f50 msgr2=0x7fa8f415bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.505+0000 7fa8f8a00640 1 -- 172.21.15.37:0/357017403 shutdown_connections 2024-05-30T07:00:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:27.505+0000 7fa8f8a00640 1 -- 172.21.15.37:0/357017403 wait complete. 2024-05-30T07:00:32.528 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T07:00:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.677+0000 7efef8c00640 1 Processor -- start 2024-05-30T07:00:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.677+0000 7efef8c00640 1 -- start start 2024-05-30T07:00:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef8c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40d1550 0x7efef40ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef8c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efef40ccff0 0x7efef4162570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef8c00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efef40d19b0 con 0x7efef4161fc0 2024-05-30T07:00:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef8c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7efef40d10c0 con 0x7efef40ccff0 2024-05-30T07:00:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef8c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efef406dc60 con 0x7efef40d1550 2024-05-30T07:00:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef3400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efef4161fc0 0x7efef406d480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41002/0 (socket says 172.21.15.37:41002) 2024-05-30T07:00:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef3400640 1 -- 172.21.15.37:0/1191056230 learned_addr learned my addr 172.21.15.37:0/1191056230 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:00:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef3e00640 1 --2- 172.21.15.37:0/1191056230 >> v2:172.21.15.105:3300/0 conn(0x7efef40ccff0 0x7efef4162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efeeaa00640 1 --2- 172.21.15.37:0/1191056230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40d1550 0x7efef40ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1879535986 0 0) 0x7efef40d19b0 con 0x7efef4161fc0 2024-05-30T07:00:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efed8003530 con 0x7efef4161fc0 2024-05-30T07:00:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4232633697 0 0) 0x7efed8003530 con 0x7efef4161fc0 2024-05-30T07:00:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40d1550 msgr2=0x7efef40ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 --2- 172.21.15.37:0/1191056230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40d1550 0x7efef40ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 >> v2:172.21.15.105:3300/0 conn(0x7efef40ccff0 msgr2=0x7efef4162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 --2- 172.21.15.37:0/1191056230 >> v2:172.21.15.105:3300/0 conn(0x7efef40ccff0 0x7efef4162570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef40d0790 con 0x7efef4161fc0 2024-05-30T07:00:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7efee4001680 con 0x7efef4161fc0 2024-05-30T07:00:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 >> v1:172.21.15.37:6789/0 conn(0x7efef4161fc0 legacy=0x7efef406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 --2- 172.21.15.37:0/1191056230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40d1550 0x7efed80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 --2- 172.21.15.37:0/1191056230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8003f40 0x7efed8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 --2- 172.21.15.37:0/1191056230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed8004d50 0x7efed80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efef40d10c0 con 0x7efed8004d50 2024-05-30T07:00:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efef406dc60 con 0x7efed8003f40 2024-05-30T07:00:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efed800b9d0 con 0x7efef40d1550 2024-05-30T07:00:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef3e00640 1 --2- 172.21.15.37:0/1191056230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed8004d50 0x7efed80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:32.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efeeaa00640 1 --2- 172.21.15.37:0/1191056230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8003f40 0x7efed8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:32.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef3400640 1 --2- 172.21.15.37:0/1191056230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40d1550 0x7efed80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:32.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef3e00640 1 -- 172.21.15.37:0/1191056230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40d1550 msgr2=0x7efed80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:32.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef3e00640 1 --2- 172.21.15.37:0/1191056230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40d1550 0x7efed80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:32.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef3e00640 1 -- 172.21.15.37:0/1191056230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8003f40 msgr2=0x7efed8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:32.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef3e00640 1 --2- 172.21.15.37:0/1191056230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8003f40 0x7efed8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:32.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.681+0000 7efef3e00640 1 -- 172.21.15.37:0/1191056230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed8003530 con 0x7efed8004d50 2024-05-30T07:00:32.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.685+0000 7efef3e00640 1 --2- 172.21.15.37:0/1191056230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed8004d50 0x7efed80051d0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7efeec009fc0 tx=0x7efeec01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4d4ba73a111447 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:32.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.685+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec0b2070 con 0x7efed8004d50 2024-05-30T07:00:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.685+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeec0a5cd0 con 0x7efed8004d50 2024-05-30T07:00:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.685+0000 7efef2a00640 1 -- 172.21.15.37:0/1191056230 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec009c10 con 0x7efed8004d50 2024-05-30T07:00:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.685+0000 7efef8c00640 1 -- 172.21.15.37:0/1191056230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed8004d50 msgr2=0x7efed80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.685+0000 7efef8c00640 1 --2- 172.21.15.37:0/1191056230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed8004d50 0x7efed80051d0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7efeec009fc0 tx=0x7efeec01cc60 comp rx=0 tx=0).stop 2024-05-30T07:00:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.685+0000 7efef3e00640 1 -- 172.21.15.37:0/1191056230 reap_dead start 2024-05-30T07:00:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.685+0000 7efef8c00640 1 -- 172.21.15.37:0/1191056230 shutdown_connections 2024-05-30T07:00:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.685+0000 7efef8c00640 1 -- 172.21.15.37:0/1191056230 >> 172.21.15.37:0/1191056230 conn(0x7efef40b3f50 msgr2=0x7efef40b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.685+0000 7efef8c00640 1 -- 172.21.15.37:0/1191056230 shutdown_connections 2024-05-30T07:00:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.685+0000 7efef8c00640 1 -- 172.21.15.37:0/1191056230 wait complete. 2024-05-30T07:00:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.685+0000 7efef8c00640 1 Processor -- start 2024-05-30T07:00:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efef8c00640 1 -- start start 2024-05-30T07:00:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efef8c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8004d50 0x7efef409efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efef8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efef409c350 0x7efef4150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efef8c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40711d0 0x7efef4071650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efef8c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efef40cd480 con 0x7efef409c350 2024-05-30T07:00:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efef8c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efef40d0d50 con 0x7efed8004d50 2024-05-30T07:00:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efef8c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efef40cd600 con 0x7efef40711d0 2024-05-30T07:00:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efeeaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efef409c350 0x7efef4150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efeeaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efef409c350 0x7efef4150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60688/0 (socket says 172.21.15.37:60688) 2024-05-30T07:00:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efeeaa00640 1 -- 172.21.15.37:0/1954942329 learned_addr learned my addr 172.21.15.37:0/1954942329 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efef3400640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8004d50 0x7efef409efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efef3e00640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40711d0 0x7efef4071650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efeeaa00640 1 -- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40711d0 msgr2=0x7efef4071650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efeeaa00640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40711d0 0x7efef4071650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efeeaa00640 1 -- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8004d50 msgr2=0x7efef409efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efeeaa00640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8004d50 0x7efef409efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efeeaa00640 1 -- 172.21.15.37:0/1954942329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efef415cf80 con 0x7efef409c350 2024-05-30T07:00:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efef3e00640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40711d0 0x7efef4071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efeeaa00640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efef409c350 0x7efef4150840 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7efedc011960 tx=0x7efedc011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efeebe00640 1 -- 172.21.15.37:0/1954942329 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc00faf0 con 0x7efef409c350 2024-05-30T07:00:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efeebe00640 1 -- 172.21.15.37:0/1954942329 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efedc00fc90 con 0x7efef409c350 2024-05-30T07:00:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efef8c00640 1 -- 172.21.15.37:0/1954942329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efef409f630 con 0x7efef409c350 2024-05-30T07:00:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efeebe00640 1 -- 172.21.15.37:0/1954942329 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc014440 con 0x7efef409c350 2024-05-30T07:00:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efef8c00640 1 -- 172.21.15.37:0/1954942329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efef409fbf0 con 0x7efef409c350 2024-05-30T07:00:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.689+0000 7efef8c00640 1 -- 172.21.15.37:0/1954942329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef4068ab0 con 0x7efef409c350 2024-05-30T07:00:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.693+0000 7efeebe00640 1 -- 172.21.15.37:0/1954942329 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 50) ==== 90945+0+0 (secure 0 0 0) 0x7efedc012040 con 0x7efef409c350 2024-05-30T07:00:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.693+0000 7efeebe00640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efed006a450 0x7efed006c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.693+0000 7efeebe00640 1 -- 172.21.15.37:0/1954942329 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7efedc086090 con 0x7efef409c350 2024-05-30T07:00:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.693+0000 7efef3400640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efed006a450 0x7efed006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.693+0000 7efef3400640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efed006a450 0x7efed006c910 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7efee4001640 tx=0x7efee4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:32.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.697+0000 7efeebe00640 1 -- 172.21.15.37:0/1954942329 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efedc019030 con 0x7efef409c350 2024-05-30T07:00:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.921+0000 7efef8c00640 1 -- 172.21.15.37:0/1954942329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7efef40d1ef0 con 0x7efef409c350 2024-05-30T07:00:32.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.921+0000 7efeebe00640 1 -- 172.21.15.37:0/1954942329 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2335 (secure 0 0 0) 0x7efedc057b00 con 0x7efef409c350 2024-05-30T07:00:32.924 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:32.925 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:00:32.925 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T07:00:32.925 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T07:00:32.925 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T07:00:32.925 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T07:00:32.925 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T07:00:32.925 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:32.925 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T07:00:32.925 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T07:00:32.925 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T07:00:32.926 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T07:00:32.926 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T07:00:32.926 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:32.926 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T07:00:32.926 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T07:00:32.926 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T07:00:32.926 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T07:00:32.926 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:32.926 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 1127, 2024-05-30T07:00:32.926 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T07:00:32.927 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T07:00:32.927 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T07:00:32.927 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T07:00:32.927 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:32.927 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T07:00:32.927 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 130, 2024-05-30T07:00:32.927 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T07:00:32.927 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T07:00:32.927 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T07:00:32.927 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T07:00:32.928 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T07:00:32.928 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T07:00:32.928 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:32.928 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T07:00:32.928 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T07:00:32.928 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:32.928 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T07:00:32.928 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T07:00:32.928 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:32.928 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:32.928 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T07:00:32.928 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T07:00:32.928 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4819, 2024-05-30T07:00:32.929 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 20067792103, 2024-05-30T07:00:32.929 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 41294913536, 2024-05-30T07:00:32.929 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 731799199744, 2024-05-30T07:00:32.929 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T07:00:32.929 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 1706, 2024-05-30T07:00:32.929 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T07:00:32.929 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T07:00:32.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:32.929 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T07:00:32.929 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 85, 2024-05-30T07:00:32.929 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9, 2024-05-30T07:00:32.929 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T07:00:32.930 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T07:00:32.930 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T07:00:32.930 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T07:00:32.930 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:32.930 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 9, 2024-05-30T07:00:32.930 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T07:00:32.930 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "d", 2024-05-30T07:00:32.930 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T07:00:32.930 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9729 2024-05-30T07:00:32.930 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:32.930 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:32.931 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T07:00:32.931 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:32.931 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T07:00:32.931 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T07:00:32.931 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T07:00:32.931 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T07:00:32.931 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T07:00:32.931 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T07:00:32.931 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T07:00:32.931 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:32.931 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:32.931 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:32.932 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T07:00:32.932 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 22, 2024-05-30T07:00:32.932 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T07:00:15.031680+0000", 2024-05-30T07:00:32.932 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:32.932 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:32.932 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T07:00:32.932 INFO:teuthology.orchestra.run.smithi037.stdout: "19e12098-76d5-4ad1-9a9e-8c1702cf320b": { 2024-05-30T07:00:32.932 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 13.0 seconds before exiting (33s)\n [============================] ", 2024-05-30T07:00:32.932 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:32.932 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:32.932 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:32.932 INFO:teuthology.orchestra.run.smithi037.stdout: "ebf69c16-08d6-4852-b378-0e327d1911a9": { 2024-05-30T07:00:32.933 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 13.0 seconds before exiting (39s)\n [============================] ", 2024-05-30T07:00:32.933 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:32.933 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:32.933 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:32.933 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:32.933 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:00:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.925+0000 7efef8c00640 1 -- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efed006a450 msgr2=0x7efed006c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.925+0000 7efef8c00640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efed006a450 0x7efed006c910 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7efee4001640 tx=0x7efee4009040 comp rx=0 tx=0).stop 2024-05-30T07:00:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.925+0000 7efef8c00640 1 -- 172.21.15.37:0/1954942329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efef409c350 msgr2=0x7efef4150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.925+0000 7efef8c00640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efef409c350 0x7efef4150840 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7efedc011960 tx=0x7efedc011e20 comp rx=0 tx=0).stop 2024-05-30T07:00:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.925+0000 7efef8c00640 1 -- 172.21.15.37:0/1954942329 shutdown_connections 2024-05-30T07:00:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.925+0000 7efef8c00640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efef40711d0 0x7efef4071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.925+0000 7efef8c00640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efef409c350 0x7efef4150840 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.925+0000 7efef8c00640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efed006a450 0x7efed006c910 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.925+0000 7efef8c00640 1 --2- 172.21.15.37:0/1954942329 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed8004d50 0x7efef409efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.925+0000 7efef8c00640 1 -- 172.21.15.37:0/1954942329 >> 172.21.15.37:0/1954942329 conn(0x7efef40b3f50 msgr2=0x7efef40cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.925+0000 7efef8c00640 1 -- 172.21.15.37:0/1954942329 shutdown_connections 2024-05-30T07:00:32.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:32.925+0000 7efef8c00640 1 -- 172.21.15.37:0/1954942329 wait complete. 2024-05-30T07:00:36.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T07:00:36.512 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T07:00:37.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T07:00:38.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.097+0000 7fc77b200640 1 Processor -- start 2024-05-30T07:00:38.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.097+0000 7fc77b200640 1 -- start start 2024-05-30T07:00:38.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc77b200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774155e60 0x7fc7740b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:38.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc77b200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7740b2ec0 0x7fc7740cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc77b200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77415c8f0 con 0x7fc77406f9a0 2024-05-30T07:00:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc77b200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc7740ccff0 con 0x7fc7740b2ec0 2024-05-30T07:00:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc77b200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc7740ccc80 con 0x7fc774155e60 2024-05-30T07:00:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc779200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7740b2ec0 0x7fc7740cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc779200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7740b2ec0 0x7fc7740cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53660/0 (socket says 172.21.15.37:53660) 2024-05-30T07:00:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc779200640 1 -- 172.21.15.37:0/2094704687 learned_addr learned my addr 172.21.15.37:0/2094704687 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc773e00640 1 --2- 172.21.15.37:0/2094704687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774155e60 0x7fc7740b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc779200640 1 -- 172.21.15.37:0/2094704687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774155e60 msgr2=0x7fc7740b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc779200640 1 --2- 172.21.15.37:0/2094704687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774155e60 0x7fc7740b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc779200640 1 -- 172.21.15.37:0/2094704687 >> v1:172.21.15.105:6789/0 conn(0x7fc77406f9a0 legacy=0x7fc7740cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:38.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc779200640 1 -- 172.21.15.37:0/2094704687 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77415cbd0 con 0x7fc7740b2ec0 2024-05-30T07:00:38.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.101+0000 7fc779200640 1 --2- 172.21.15.37:0/2094704687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7740b2ec0 0x7fc7740cd480 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009e50 tx=0x7fc76c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12052aac5a54ef80 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc773400640 1 -- 172.21.15.37:0/2094704687 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0a5780 con 0x7fc7740b2ec0 2024-05-30T07:00:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc773400640 1 -- 172.21.15.37:0/2094704687 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76c0a5920 con 0x7fc7740b2ec0 2024-05-30T07:00:38.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc773400640 1 -- 172.21.15.37:0/2094704687 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c0a5cf0 con 0x7fc7740b2ec0 2024-05-30T07:00:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 -- 172.21.15.37:0/2094704687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7740b2ec0 msgr2=0x7fc7740cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 --2- 172.21.15.37:0/2094704687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7740b2ec0 0x7fc7740cd480 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009e50 tx=0x7fc76c01c9f0 comp rx=0 tx=0).stop 2024-05-30T07:00:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 -- 172.21.15.37:0/2094704687 shutdown_connections 2024-05-30T07:00:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 --2- 172.21.15.37:0/2094704687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7740b2ec0 0x7fc7740cd480 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 --2- 172.21.15.37:0/2094704687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774155e60 0x7fc7740b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 -- 172.21.15.37:0/2094704687 >> 172.21.15.37:0/2094704687 conn(0x7fc7740b23a0 msgr2=0x7fc7740b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 -- 172.21.15.37:0/2094704687 shutdown_connections 2024-05-30T07:00:38.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 -- 172.21.15.37:0/2094704687 wait complete. 2024-05-30T07:00:38.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 Processor -- start 2024-05-30T07:00:38.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 -- start start 2024-05-30T07:00:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77406f9a0 0x7fc77414abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7740b2ec0 0x7fc77415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774155e60 0x7fc77415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc774166a20 con 0x7fc77406f9a0 2024-05-30T07:00:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741668a0 con 0x7fc7740b2ec0 2024-05-30T07:00:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc77b200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc774166ba0 con 0x7fc774155e60 2024-05-30T07:00:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc773e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77406f9a0 0x7fc77414abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc773e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77406f9a0 0x7fc77414abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53676/0 (socket says 172.21.15.37:53676) 2024-05-30T07:00:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc773e00640 1 -- 172.21.15.37:0/838483492 learned_addr learned my addr 172.21.15.37:0/838483492 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc76be00640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7740b2ec0 0x7fc77415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.105+0000 7fc779200640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774155e60 0x7fc77415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc773e00640 1 -- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774155e60 msgr2=0x7fc77415a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc773e00640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774155e60 0x7fc77415a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc773e00640 1 -- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7740b2ec0 msgr2=0x7fc77415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc773e00640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7740b2ec0 0x7fc77415a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc773e00640 1 -- 172.21.15.37:0/838483492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7741556a0 con 0x7fc77406f9a0 2024-05-30T07:00:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc773e00640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77406f9a0 0x7fc77414abb0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fc76400d620 tx=0x7fc76400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc770c00640 1 -- 172.21.15.37:0/838483492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76400b620 con 0x7fc77406f9a0 2024-05-30T07:00:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc770c00640 1 -- 172.21.15.37:0/838483492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc764019070 con 0x7fc77406f9a0 2024-05-30T07:00:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc770c00640 1 -- 172.21.15.37:0/838483492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76400b9e0 con 0x7fc77406f9a0 2024-05-30T07:00:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc77b200640 1 -- 172.21.15.37:0/838483492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77414be30 con 0x7fc77406f9a0 2024-05-30T07:00:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc77b200640 1 -- 172.21.15.37:0/838483492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc77414c3f0 con 0x7fc77406f9a0 2024-05-30T07:00:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc77b200640 1 -- 172.21.15.37:0/838483492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc774068b20 con 0x7fc77406f9a0 2024-05-30T07:00:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc770c00640 1 -- 172.21.15.37:0/838483492 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 50) ==== 90945+0+0 (secure 0 0 0) 0x7fc76400bb80 con 0x7fc77406f9a0 2024-05-30T07:00:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc770c00640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc75006a420 0x7fc75006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.109+0000 7fc770c00640 1 -- 172.21.15.37:0/838483492 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fc764085da0 con 0x7fc77406f9a0 2024-05-30T07:00:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.113+0000 7fc76be00640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc75006a420 0x7fc75006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.113+0000 7fc76be00640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc75006a420 0x7fc75006c8e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc774154000 tx=0x7fc75c007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.117+0000 7fc770c00640 1 -- 172.21.15.37:0/838483492 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc764057770 con 0x7fc77406f9a0 2024-05-30T07:00:38.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.337+0000 7fc77b200640 1 -- 172.21.15.37:0/838483492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc774072fb0 con 0x7fc77406f9a0 2024-05-30T07:00:38.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.337+0000 7fc770c00640 1 -- 172.21.15.37:0/838483492 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2333 (secure 0 0 0) 0x7fc76405ba70 con 0x7fc77406f9a0 2024-05-30T07:00:38.340 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:38.340 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:00:38.341 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T07:00:38.341 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T07:00:38.341 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T07:00:38.341 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T07:00:38.341 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T07:00:38.341 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:38.341 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T07:00:38.341 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T07:00:38.341 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T07:00:38.341 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T07:00:38.341 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T07:00:38.341 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:38.341 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T07:00:38.342 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T07:00:38.342 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T07:00:38.342 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T07:00:38.342 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:38.342 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 1132, 2024-05-30T07:00:38.342 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T07:00:38.342 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T07:00:38.342 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T07:00:38.342 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T07:00:38.342 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:38.342 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 130, 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T07:00:38.343 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:38.344 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:38.344 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T07:00:38.344 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T07:00:38.344 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4819, 2024-05-30T07:00:38.344 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 20067792103, 2024-05-30T07:00:38.344 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 41294929920, 2024-05-30T07:00:38.344 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 731799183360, 2024-05-30T07:00:38.344 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T07:00:38.344 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 1364, 2024-05-30T07:00:38.344 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T07:00:38.344 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T07:00:38.344 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:38.344 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T07:00:38.345 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 85, 2024-05-30T07:00:38.345 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9, 2024-05-30T07:00:38.345 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T07:00:38.345 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T07:00:38.345 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T07:00:38.345 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T07:00:38.345 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:38.345 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 9, 2024-05-30T07:00:38.345 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T07:00:38.345 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "d", 2024-05-30T07:00:38.345 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T07:00:38.345 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9729 2024-05-30T07:00:38.345 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:38.346 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:38.346 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T07:00:38.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:38.346 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T07:00:38.346 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T07:00:38.346 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T07:00:38.346 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T07:00:38.346 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T07:00:38.346 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T07:00:38.346 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T07:00:38.346 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:38.346 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:38.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T07:00:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 22, 2024-05-30T07:00:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T07:00:15.031680+0000", 2024-05-30T07:00:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T07:00:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: "19e12098-76d5-4ad1-9a9e-8c1702cf320b": { 2024-05-30T07:00:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 7.0 seconds before exiting (39s)\n [============================] ", 2024-05-30T07:00:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: "ebf69c16-08d6-4852-b378-0e327d1911a9": { 2024-05-30T07:00:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 7.0 seconds before exiting (45s)\n [============================] ", 2024-05-30T07:00:38.348 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:38.348 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:38.348 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:38.348 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:38.348 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:00:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.341+0000 7fc77b200640 1 -- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc75006a420 msgr2=0x7fc75006c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.341+0000 7fc77b200640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc75006a420 0x7fc75006c8e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc774154000 tx=0x7fc75c007e40 comp rx=0 tx=0).stop 2024-05-30T07:00:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.341+0000 7fc77b200640 1 -- 172.21.15.37:0/838483492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77406f9a0 msgr2=0x7fc77414abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.341+0000 7fc77b200640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77406f9a0 0x7fc77414abb0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fc76400d620 tx=0x7fc76400dae0 comp rx=0 tx=0).stop 2024-05-30T07:00:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.341+0000 7fc77b200640 1 -- 172.21.15.37:0/838483492 shutdown_connections 2024-05-30T07:00:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.341+0000 7fc77b200640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc774155e60 0x7fc77415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.341+0000 7fc77b200640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc75006a420 0x7fc75006c8e0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.341+0000 7fc77b200640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7740b2ec0 0x7fc77415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.341+0000 7fc77b200640 1 --2- 172.21.15.37:0/838483492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc77406f9a0 0x7fc77414abb0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:38.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.341+0000 7fc77b200640 1 -- 172.21.15.37:0/838483492 >> 172.21.15.37:0/838483492 conn(0x7fc7740b23a0 msgr2=0x7fc77415bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:38.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.341+0000 7fc77b200640 1 -- 172.21.15.37:0/838483492 shutdown_connections 2024-05-30T07:00:38.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:38.341+0000 7fc77b200640 1 -- 172.21.15.37:0/838483492 wait complete. 2024-05-30T07:00:43.362 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T07:00:43.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.513+0000 7f706c000640 1 Processor -- start 2024-05-30T07:00:43.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.513+0000 7f706c000640 1 -- start start 2024-05-30T07:00:43.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.517+0000 7f706c000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7064070dc0 0x7f70640b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:43.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.517+0000 7f706c000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f706406b960 0x7f706406be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:43.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.517+0000 7f706c000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70640aec30 con 0x7f7064162080 2024-05-30T07:00:43.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.517+0000 7f706c000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f70640b67f0 con 0x7f706406b960 2024-05-30T07:00:43.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.517+0000 7f706c000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f70640b07e0 con 0x7f7064070dc0 2024-05-30T07:00:43.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.517+0000 7f706a000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f706406b960 0x7f706406be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:43.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.517+0000 7f706a000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f706406b960 0x7f706406be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53692/0 (socket says 172.21.15.37:53692) 2024-05-30T07:00:43.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.517+0000 7f706a000640 1 -- 172.21.15.37:0/3552706850 learned_addr learned my addr 172.21.15.37:0/3552706850 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:43.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.517+0000 7f7068c00640 1 --2- 172.21.15.37:0/3552706850 >> v2:172.21.15.105:3300/0 conn(0x7f7064070dc0 0x7f70640b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:43.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.517+0000 7f706a000640 1 -- 172.21.15.37:0/3552706850 >> v2:172.21.15.105:3300/0 conn(0x7f7064070dc0 msgr2=0x7f70640b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:43.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.517+0000 7f706a000640 1 --2- 172.21.15.37:0/3552706850 >> v2:172.21.15.105:3300/0 conn(0x7f7064070dc0 0x7f70640b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:43.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.517+0000 7f706a000640 1 -- 172.21.15.37:0/3552706850 >> v1:172.21.15.105:6789/0 conn(0x7f7064162080 legacy=0x7f70640ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:43.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.517+0000 7f706a000640 1 -- 172.21.15.37:0/3552706850 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70640b6510 con 0x7f706406b960 2024-05-30T07:00:43.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f706a000640 1 --2- 172.21.15.37:0/3552706850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f706406b960 0x7f706406be10 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f70640b5bc0 tx=0x7f705c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f7b153b757fc04 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:43.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f7063e00640 1 -- 172.21.15.37:0/3552706850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c0aa400 con 0x7f706406b960 2024-05-30T07:00:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f7063e00640 1 -- 172.21.15.37:0/3552706850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f705c0af070 con 0x7f706406b960 2024-05-30T07:00:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f7063e00640 1 -- 172.21.15.37:0/3552706850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705c0aa7c0 con 0x7f706406b960 2024-05-30T07:00:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f706c000640 1 -- 172.21.15.37:0/3552706850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f706406b960 msgr2=0x7f706406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f706c000640 1 --2- 172.21.15.37:0/3552706850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f706406b960 0x7f706406be10 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f70640b5bc0 tx=0x7f705c01c960 comp rx=0 tx=0).stop 2024-05-30T07:00:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f706c000640 1 -- 172.21.15.37:0/3552706850 shutdown_connections 2024-05-30T07:00:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f706c000640 1 --2- 172.21.15.37:0/3552706850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f706406b960 0x7f706406be10 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f706c000640 1 --2- 172.21.15.37:0/3552706850 >> v2:172.21.15.105:3300/0 conn(0x7f7064070dc0 0x7f70640b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f706c000640 1 -- 172.21.15.37:0/3552706850 >> 172.21.15.37:0/3552706850 conn(0x7f70640b6a60 msgr2=0x7f70640b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f706c000640 1 -- 172.21.15.37:0/3552706850 shutdown_connections 2024-05-30T07:00:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f706c000640 1 -- 172.21.15.37:0/3552706850 wait complete. 2024-05-30T07:00:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f706c000640 1 Processor -- start 2024-05-30T07:00:43.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.521+0000 7f706c000640 1 -- start start 2024-05-30T07:00:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f706c000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f706406b960 0x7f70640cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f706c000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064070dc0 0x7f706415e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f706c000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7064162080 0x7f706415b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f706c000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f706416b940 con 0x7f7064070dc0 2024-05-30T07:00:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f706c000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f706416b7c0 con 0x7f706406b960 2024-05-30T07:00:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f706c000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f706416bac0 con 0x7f7064162080 2024-05-30T07:00:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7068c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064070dc0 0x7f706415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7068c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064070dc0 0x7f706415e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53708/0 (socket says 172.21.15.37:53708) 2024-05-30T07:00:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7068c00640 1 -- 172.21.15.37:0/3323318864 learned_addr learned my addr 172.21.15.37:0/3323318864 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7068c00640 1 -- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7064162080 msgr2=0x7f706415b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f706a000640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7064162080 0x7f706415b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7069600640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f706406b960 0x7f70640cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7068c00640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7064162080 0x7f706415b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7068c00640 1 -- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f706406b960 msgr2=0x7f70640cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7068c00640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f706406b960 0x7f70640cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7068c00640 1 -- 172.21.15.37:0/3323318864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7064158c20 con 0x7f7064070dc0 2024-05-30T07:00:43.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f706a000640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7064162080 0x7f706415b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:43.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7069600640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f706406b960 0x7f70640cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:43.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7068c00640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064070dc0 0x7f706415e230 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f705000d5f0 tx=0x7f705000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:43.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7061600640 1 -- 172.21.15.37:0/3323318864 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70500125f0 con 0x7f7064070dc0 2024-05-30T07:00:43.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7061600640 1 -- 172.21.15.37:0/3323318864 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7050019070 con 0x7f7064070dc0 2024-05-30T07:00:43.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7061600640 1 -- 172.21.15.37:0/3323318864 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70500129b0 con 0x7f7064070dc0 2024-05-30T07:00:43.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f706c000640 1 -- 172.21.15.37:0/3323318864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7064158f00 con 0x7f7064070dc0 2024-05-30T07:00:43.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f706c000640 1 -- 172.21.15.37:0/3323318864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f706415ec40 con 0x7f7064070dc0 2024-05-30T07:00:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f706c000640 1 -- 172.21.15.37:0/3323318864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70641590d0 con 0x7f7064070dc0 2024-05-30T07:00:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.525+0000 7f7061600640 1 -- 172.21.15.37:0/3323318864 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 50) ==== 90945+0+0 (secure 0 0 0) 0x7f7050012b50 con 0x7f7064070dc0 2024-05-30T07:00:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.529+0000 7f7061600640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f704406a450 0x7f704406c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.529+0000 7f7061600640 1 -- 172.21.15.37:0/3323318864 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f7050085e90 con 0x7f7064070dc0 2024-05-30T07:00:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.529+0000 7f7069600640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f704406a450 0x7f704406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.529+0000 7f7069600640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f704406a450 0x7f704406c910 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f70580016f0 tx=0x7f7058009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:43.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.533+0000 7f7061600640 1 -- 172.21.15.37:0/3323318864 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7050057eb0 con 0x7f7064070dc0 2024-05-30T07:00:43.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.757+0000 7f706c000640 1 -- 172.21.15.37:0/3323318864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7064068b20 con 0x7f7064070dc0 2024-05-30T07:00:43.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.757+0000 7f7061600640 1 -- 172.21.15.37:0/3323318864 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+2332 (secure 0 0 0) 0x7f70500577b0 con 0x7f7064070dc0 2024-05-30T07:00:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:43.761 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:00:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T07:00:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T07:00:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T07:00:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T07:00:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T07:00:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T07:00:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T07:00:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T07:00:43.761 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T07:00:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T07:00:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T07:00:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T07:00:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T07:00:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T07:00:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 1138, 2024-05-30T07:00:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T07:00:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T07:00:43.762 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 130, 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:43.763 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T07:00:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T07:00:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T07:00:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T07:00:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4819, 2024-05-30T07:00:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 20067794709, 2024-05-30T07:00:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 41294929920, 2024-05-30T07:00:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 731799183360, 2024-05-30T07:00:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T07:00:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 255, 2024-05-30T07:00:43.764 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T07:00:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T07:00:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T07:00:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 85, 2024-05-30T07:00:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9, 2024-05-30T07:00:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T07:00:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T07:00:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T07:00:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T07:00:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:43.765 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 9, 2024-05-30T07:00:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T07:00:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "d", 2024-05-30T07:00:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T07:00:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9729 2024-05-30T07:00:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T07:00:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T07:00:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T07:00:43.766 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T07:00:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T07:00:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T07:00:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T07:00:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T07:00:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T07:00:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 22, 2024-05-30T07:00:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T07:00:15.031680+0000", 2024-05-30T07:00:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:43.767 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": { 2024-05-30T07:00:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "19e12098-76d5-4ad1-9a9e-8c1702cf320b": { 2024-05-30T07:00:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "No pending clones left, waiting 1.0 seconds before exiting (45s)\n [============================] ", 2024-05-30T07:00:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "ebf69c16-08d6-4852-b378-0e327d1911a9": { 2024-05-30T07:00:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "All cloning finished, waiting 1.0 seconds before exiting (52s)\n [============================] ", 2024-05-30T07:00:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": 1, 2024-05-30T07:00:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: "add_to_ceph_s": true 2024-05-30T07:00:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:43.768 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:43.768 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:00:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.761+0000 7f706c000640 1 -- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f704406a450 msgr2=0x7f704406c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.761+0000 7f706c000640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f704406a450 0x7f704406c910 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f70580016f0 tx=0x7f7058009040 comp rx=0 tx=0).stop 2024-05-30T07:00:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.761+0000 7f706c000640 1 -- 172.21.15.37:0/3323318864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064070dc0 msgr2=0x7f706415e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.761+0000 7f706c000640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064070dc0 0x7f706415e230 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f705000d5f0 tx=0x7f705000dab0 comp rx=0 tx=0).stop 2024-05-30T07:00:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.761+0000 7f706c000640 1 -- 172.21.15.37:0/3323318864 shutdown_connections 2024-05-30T07:00:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.761+0000 7f706c000640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7064162080 0x7f706415b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.761+0000 7f706c000640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7064070dc0 0x7f706415e230 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.761+0000 7f706c000640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f704406a450 0x7f704406c910 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.761+0000 7f706c000640 1 --2- 172.21.15.37:0/3323318864 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f706406b960 0x7f70640cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.761+0000 7f706c000640 1 -- 172.21.15.37:0/3323318864 >> 172.21.15.37:0/3323318864 conn(0x7f70640b6a60 msgr2=0x7f7064158370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.761+0000 7f706c000640 1 -- 172.21.15.37:0/3323318864 shutdown_connections 2024-05-30T07:00:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:43.761+0000 7f706c000640 1 -- 172.21.15.37:0/3323318864 wait complete. 2024-05-30T07:00:48.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format json-pretty 2024-05-30T07:00:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.933+0000 7f665f400640 1 Processor -- start 2024-05-30T07:00:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.933+0000 7f665f400640 1 -- start start 2024-05-30T07:00:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665f400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665815c760 0x7f66580ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f66580cd270 0x7f66580d1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665f400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f665815cb40 0x7f66580d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665f400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f66580d1760 con 0x7f66580cd270 2024-05-30T07:00:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665f400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f66580d0b50 con 0x7f665815cb40 2024-05-30T07:00:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665f400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f66580d0e30 con 0x7f665815c760 2024-05-30T07:00:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f664fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f66580cd270 0x7f66580d1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665d400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f665815cb40 0x7f66580d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665ca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665815c760 0x7f66580ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665d400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f665815cb40 0x7f66580d2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:52696/0 (socket says 172.21.15.37:52696) 2024-05-30T07:00:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665ca00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665815c760 0x7f66580ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.37:37398/0 (socket says 172.21.15.37:37398) 2024-05-30T07:00:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665ca00640 1 -- 172.21.15.37:0/1364486384 learned_addr learned my addr 172.21.15.37:0/1364486384 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f664fe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f66580cd270 0x7f66580d1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45720/0 (socket says 172.21.15.37:45720) 2024-05-30T07:00:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665d400640 1 -- 172.21.15.37:0/1364486384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665815c760 msgr2=0x7f66580ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665d400640 1 --2- 172.21.15.37:0/1364486384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665815c760 0x7f66580ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665d400640 1 -- 172.21.15.37:0/1364486384 >> v2:172.21.15.37:3300/0 conn(0x7f66580cd270 msgr2=0x7f66580d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665d400640 1 --2- 172.21.15.37:0/1364486384 >> v2:172.21.15.37:3300/0 conn(0x7f66580cd270 0x7f66580d1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665d400640 1 -- 172.21.15.37:0/1364486384 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66580d1110 con 0x7f665815cb40 2024-05-30T07:00:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.937+0000 7f665ca00640 1 --2- 172.21.15.37:0/1364486384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665815c760 0x7f66580ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T07:00:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f665d400640 1 --2- 172.21.15.37:0/1364486384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665815cb40 0x7f66580d2130 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f66580736a0 tx=0x7f665001f110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3c10648bc05f1ad server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f6657e00640 1 -- 172.21.15.37:0/1364486384 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66500b5070 con 0x7f665815cb40 2024-05-30T07:00:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f6657e00640 1 -- 172.21.15.37:0/1364486384 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66500b0440 con 0x7f665815cb40 2024-05-30T07:00:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f6657e00640 1 -- 172.21.15.37:0/1364486384 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66500b0810 con 0x7f665815cb40 2024-05-30T07:00:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f665f400640 1 -- 172.21.15.37:0/1364486384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665815cb40 msgr2=0x7f66580d2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f665f400640 1 --2- 172.21.15.37:0/1364486384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665815cb40 0x7f66580d2130 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f66580736a0 tx=0x7f665001f110 comp rx=0 tx=0).stop 2024-05-30T07:00:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f665f400640 1 -- 172.21.15.37:0/1364486384 shutdown_connections 2024-05-30T07:00:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f665f400640 1 --2- 172.21.15.37:0/1364486384 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665815cb40 0x7f66580d2130 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f665f400640 1 --2- 172.21.15.37:0/1364486384 >> v2:172.21.15.37:3300/0 conn(0x7f66580cd270 0x7f66580d1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f665f400640 1 --2- 172.21.15.37:0/1364486384 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665815c760 0x7f66580ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f665f400640 1 -- 172.21.15.37:0/1364486384 >> 172.21.15.37:0/1364486384 conn(0x7f66580d26e0 msgr2=0x7f66580d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f665f400640 1 -- 172.21.15.37:0/1364486384 shutdown_connections 2024-05-30T07:00:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f665f400640 1 -- 172.21.15.37:0/1364486384 wait complete. 2024-05-30T07:00:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f665f400640 1 Processor -- start 2024-05-30T07:00:48.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f665f400640 1 -- start start 2024-05-30T07:00:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.941+0000 7f665f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66580cd270 0x7f66581e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665f400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665815c760 0x7f665815f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665f400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665815cb40 0x7f66581e5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665f400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f665809b850 con 0x7f66580cd270 2024-05-30T07:00:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665f400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66580d0800 con 0x7f665815c760 2024-05-30T07:00:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665f400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f665809b9d0 con 0x7f665815cb40 2024-05-30T07:00:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66580cd270 0x7f66581e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66580cd270 0x7f66581e6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45730/0 (socket says 172.21.15.37:45730) 2024-05-30T07:00:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665ca00640 1 -- 172.21.15.37:0/1785544555 learned_addr learned my addr 172.21.15.37:0/1785544555 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f664fe00640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665815c760 0x7f665815f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665d400640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665815cb40 0x7f66581e5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665ca00640 1 -- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665815cb40 msgr2=0x7f66581e5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665ca00640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665815cb40 0x7f66581e5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665ca00640 1 -- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665815c760 msgr2=0x7f665815f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665ca00640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665815c760 0x7f665815f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665ca00640 1 -- 172.21.15.37:0/1785544555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6658153750 con 0x7f66580cd270 2024-05-30T07:00:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665d400640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665815cb40 0x7f66581e5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665ca00640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66580cd270 0x7f66581e6e80 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f664800ea00 tx=0x7f664800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f6655600640 1 -- 172.21.15.37:0/1785544555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648017070 con 0x7f66580cd270 2024-05-30T07:00:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f6655600640 1 -- 172.21.15.37:0/1785544555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664800ca60 con 0x7f66580cd270 2024-05-30T07:00:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665f400640 1 -- 172.21.15.37:0/1785544555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665815fca0 con 0x7f66580cd270 2024-05-30T07:00:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f6655600640 1 -- 172.21.15.37:0/1785544555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664800ce10 con 0x7f66580cd270 2024-05-30T07:00:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665f400640 1 -- 172.21.15.37:0/1785544555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665815f240 con 0x7f66580cd270 2024-05-30T07:00:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f665f400640 1 -- 172.21.15.37:0/1785544555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6658068b20 con 0x7f66580cd270 2024-05-30T07:00:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.945+0000 7f6655600640 1 -- 172.21.15.37:0/1785544555 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 50) ==== 90945+0+0 (secure 0 0 0) 0x7f664801a070 con 0x7f66580cd270 2024-05-30T07:00:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.949+0000 7f6655600640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f663406a420 0x7f663406c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.949+0000 7f6655600640 1 -- 172.21.15.37:0/1785544555 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f6648085970 con 0x7f66580cd270 2024-05-30T07:00:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.949+0000 7f664fe00640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f663406a420 0x7f663406c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.949+0000 7f664fe00640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f663406a420 0x7f663406c8e0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f66580b7ee0 tx=0x7f6640008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:48.953+0000 7f6655600640 1 -- 172.21.15.37:0/1785544555 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6648057990 con 0x7f66580cd270 2024-05-30T07:00:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.177+0000 7f665f400640 1 -- 172.21.15.37:0/1785544555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f66580753f0 con 0x7f66580cd270 2024-05-30T07:00:49.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.177+0000 7f6655600640 1 -- 172.21.15.37:0/1785544555 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1826 (secure 0 0 0) 0x7f6648057290 con 0x7f66580cd270 2024-05-30T07:00:49.180 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:49.180 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:00:49.180 INFO:teuthology.orchestra.run.smithi037.stdout: "fsid": "393250aa-2b42-4955-adf1-f790b8ba4d8c", 2024-05-30T07:00:49.180 INFO:teuthology.orchestra.run.smithi037.stdout: "health": { 2024-05-30T07:00:49.180 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_OK", 2024-05-30T07:00:49.180 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {}, 2024-05-30T07:00:49.180 INFO:teuthology.orchestra.run.smithi037.stdout: "mutes": [] 2024-05-30T07:00:49.180 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.180 INFO:teuthology.orchestra.run.smithi037.stdout: "election_epoch": 4, 2024-05-30T07:00:49.180 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum": [ 2024-05-30T07:00:49.180 INFO:teuthology.orchestra.run.smithi037.stdout: 0, 2024-05-30T07:00:49.181 INFO:teuthology.orchestra.run.smithi037.stdout: 1, 2024-05-30T07:00:49.181 INFO:teuthology.orchestra.run.smithi037.stdout: 2 2024-05-30T07:00:49.181 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:49.181 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_names": [ 2024-05-30T07:00:49.181 INFO:teuthology.orchestra.run.smithi037.stdout: "a", 2024-05-30T07:00:49.181 INFO:teuthology.orchestra.run.smithi037.stdout: "b", 2024-05-30T07:00:49.181 INFO:teuthology.orchestra.run.smithi037.stdout: "c" 2024-05-30T07:00:49.181 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:49.181 INFO:teuthology.orchestra.run.smithi037.stdout: "quorum_age": 1143, 2024-05-30T07:00:49.181 INFO:teuthology.orchestra.run.smithi037.stdout: "monmap": { 2024-05-30T07:00:49.181 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 1, 2024-05-30T07:00:49.181 INFO:teuthology.orchestra.run.smithi037.stdout: "min_mon_release_name": "squid", 2024-05-30T07:00:49.181 INFO:teuthology.orchestra.run.smithi037.stdout: "num_mons": 3 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap": { 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 130, 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: "num_osds": 8, 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: "num_up_osds": 8, 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_up_since": 1717051317, 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: "num_in_osds": 8, 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_in_since": 1717051308, 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: "num_remapped_pgs": 0 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap": { 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: "pgs_by_state": [ 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:49.182 INFO:teuthology.orchestra.run.smithi037.stdout: "state_name": "active+clean", 2024-05-30T07:00:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: "count": 97 2024-05-30T07:00:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pgs": 97, 2024-05-30T07:00:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: "num_pools": 3, 2024-05-30T07:00:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: "num_objects": 4819, 2024-05-30T07:00:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: "data_bytes": 20067794709, 2024-05-30T07:00:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_used": 41294929920, 2024-05-30T07:00:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_avail": 731799183360, 2024-05-30T07:00:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: "bytes_total": 773094113280, 2024-05-30T07:00:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: "write_bytes_sec": 255, 2024-05-30T07:00:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: "read_op_per_sec": 0, 2024-05-30T07:00:49.183 INFO:teuthology.orchestra.run.smithi037.stdout: "write_op_per_sec": 0 2024-05-30T07:00:49.184 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.184 INFO:teuthology.orchestra.run.smithi037.stdout: "fsmap": { 2024-05-30T07:00:49.184 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 85, 2024-05-30T07:00:49.184 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9, 2024-05-30T07:00:49.184 INFO:teuthology.orchestra.run.smithi037.stdout: "up": 1, 2024-05-30T07:00:49.184 INFO:teuthology.orchestra.run.smithi037.stdout: "in": 1, 2024-05-30T07:00:49.184 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1, 2024-05-30T07:00:49.184 INFO:teuthology.orchestra.run.smithi037.stdout: "by_rank": [ 2024-05-30T07:00:49.184 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:49.184 INFO:teuthology.orchestra.run.smithi037.stdout: "filesystem_id": 9, 2024-05-30T07:00:49.184 INFO:teuthology.orchestra.run.smithi037.stdout: "rank": 0, 2024-05-30T07:00:49.184 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "d", 2024-05-30T07:00:49.184 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "up:active", 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 9729 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: "up:standby": 3 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: "mgrmap": { 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: "num_standbys": 1, 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-05-30T07:00:49.185 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:49.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.186 INFO:teuthology.orchestra.run.smithi037.stdout: "servicemap": { 2024-05-30T07:00:49.186 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 22, 2024-05-30T07:00:49.186 INFO:teuthology.orchestra.run.smithi037.stdout: "modified": "2024-05-30T07:00:15.031680+0000", 2024-05-30T07:00:49.186 INFO:teuthology.orchestra.run.smithi037.stdout: "services": {} 2024-05-30T07:00:49.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.186 INFO:teuthology.orchestra.run.smithi037.stdout: "progress_events": {} 2024-05-30T07:00:49.186 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:00:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.181+0000 7f665f400640 1 -- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f663406a420 msgr2=0x7f663406c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.181+0000 7f665f400640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f663406a420 0x7f663406c8e0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f66580b7ee0 tx=0x7f6640008040 comp rx=0 tx=0).stop 2024-05-30T07:00:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.181+0000 7f665f400640 1 -- 172.21.15.37:0/1785544555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66580cd270 msgr2=0x7f66581e6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.181+0000 7f665f400640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66580cd270 0x7f66581e6e80 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f664800ea00 tx=0x7f664800eec0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.181+0000 7f665f400640 1 -- 172.21.15.37:0/1785544555 shutdown_connections 2024-05-30T07:00:49.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.181+0000 7f665f400640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f665815cb40 0x7f66581e5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.181+0000 7f665f400640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f663406a420 0x7f663406c8e0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.181+0000 7f665f400640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f665815c760 0x7f665815f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.181+0000 7f665f400640 1 --2- 172.21.15.37:0/1785544555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66580cd270 0x7f66581e6e80 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.181+0000 7f665f400640 1 -- 172.21.15.37:0/1785544555 >> 172.21.15.37:0/1785544555 conn(0x7f66580d26e0 msgr2=0x7f66580cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:49.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.181+0000 7f665f400640 1 -- 172.21.15.37:0/1785544555 shutdown_connections 2024-05-30T07:00:49.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.181+0000 7f665f400640 1 -- 172.21.15.37:0/1785544555 wait complete. 2024-05-30T07:00:49.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs --format json 2024-05-30T07:00:49.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.341+0000 7f75cb400640 1 Processor -- start 2024-05-30T07:00:49.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.341+0000 7f75cb400640 1 -- start start 2024-05-30T07:00:49.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75cb400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75c406f770 0x7f75c4166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75cb400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c415f310 con 0x7f75c4155da0 2024-05-30T07:00:49.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75cb400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c415f5f0 con 0x7f75c40cd440 2024-05-30T07:00:49.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75cb400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f75c40b4760 con 0x7f75c406f770 2024-05-30T07:00:49.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c8a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f75c4155da0 0x7f75c40cd950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45350/0 (socket says 172.21.15.37:45350) 2024-05-30T07:00:49.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c8a00640 1 -- 172.21.15.37:0/1562486070 learned_addr learned my addr 172.21.15.37:0/1562486070 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:00:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c9400640 1 --2- 172.21.15.37:0/1562486070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75c406f770 0x7f75c4166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1221004988 0 0) 0x7f75c415f310 con 0x7f75c4155da0 2024-05-30T07:00:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75a8005740 con 0x7f75c4155da0 2024-05-30T07:00:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1322518018 0 0) 0x7f75c415f5f0 con 0x7f75c40cd440 2024-05-30T07:00:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75c415f310 con 0x7f75c40cd440 2024-05-30T07:00:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3389792904 0 0) 0x7f75a8005740 con 0x7f75c4155da0 2024-05-30T07:00:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75c406f770 msgr2=0x7f75c4166570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 --2- 172.21.15.37:0/1562486070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75c406f770 0x7f75c4166570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 >> v1:172.21.15.105:6789/0 conn(0x7f75c40cd440 legacy=0x7f75c406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c415f8d0 con 0x7f75c4155da0 2024-05-30T07:00:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f75b4001680 con 0x7f75c4155da0 2024-05-30T07:00:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 >> v1:172.21.15.37:6789/0 conn(0x7f75c4155da0 legacy=0x7f75c40cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 --2- 172.21.15.37:0/1562486070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75c406f770 0x7f75a8005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 --2- 172.21.15.37:0/1562486070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a80062f0 0x7f75a8006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 --2- 172.21.15.37:0/1562486070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a8006f60 0x7f75a80073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75a800ddc0 con 0x7f75a8006f60 2024-05-30T07:00:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f75a800df70 con 0x7f75a80062f0 2024-05-30T07:00:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f75a800e170 con 0x7f75c406f770 2024-05-30T07:00:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c9400640 1 --2- 172.21.15.37:0/1562486070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a8006f60 0x7f75a80073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c8a00640 1 --2- 172.21.15.37:0/1562486070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75c406f770 0x7f75a8005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75bbe00640 1 --2- 172.21.15.37:0/1562486070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a80062f0 0x7f75a8006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c9400640 1 -- 172.21.15.37:0/1562486070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75c406f770 msgr2=0x7f75a8005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c9400640 1 --2- 172.21.15.37:0/1562486070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75c406f770 0x7f75a8005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c9400640 1 -- 172.21.15.37:0/1562486070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a80062f0 msgr2=0x7f75a8006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c9400640 1 --2- 172.21.15.37:0/1562486070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a80062f0 0x7f75a8006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.345+0000 7f75c9400640 1 -- 172.21.15.37:0/1562486070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a8005740 con 0x7f75a8006f60 2024-05-30T07:00:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.349+0000 7f75c9400640 1 --2- 172.21.15.37:0/1562486070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a8006f60 0x7f75a80073e0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f75c4071ca0 tx=0x7f75bc01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88cf6d4db0e698c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.349+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0b2070 con 0x7f75a8006f60 2024-05-30T07:00:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.349+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75bc0a58d0 con 0x7f75a8006f60 2024-05-30T07:00:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.349+0000 7f75c3e00640 1 -- 172.21.15.37:0/1562486070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc009c10 con 0x7f75a8006f60 2024-05-30T07:00:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.349+0000 7f75cb400640 1 -- 172.21.15.37:0/1562486070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a8006f60 msgr2=0x7f75a80073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.349+0000 7f75cb400640 1 --2- 172.21.15.37:0/1562486070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a8006f60 0x7f75a80073e0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f75c4071ca0 tx=0x7f75bc01cbe0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.349+0000 7f75c9400640 1 -- 172.21.15.37:0/1562486070 reap_dead start 2024-05-30T07:00:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.349+0000 7f75cb400640 1 -- 172.21.15.37:0/1562486070 shutdown_connections 2024-05-30T07:00:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.349+0000 7f75cb400640 1 -- 172.21.15.37:0/1562486070 >> 172.21.15.37:0/1562486070 conn(0x7f75c406bf60 msgr2=0x7f75c40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.349+0000 7f75cb400640 1 -- 172.21.15.37:0/1562486070 shutdown_connections 2024-05-30T07:00:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.349+0000 7f75cb400640 1 -- 172.21.15.37:0/1562486070 wait complete. 2024-05-30T07:00:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75cb400640 1 Processor -- start 2024-05-30T07:00:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75cb400640 1 -- start start 2024-05-30T07:00:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75cb400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a8006f60 0x7f75c4150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75cb400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75c40ae2e0 0x7f75c41526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75cb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c4152bf0 0x7f75c415d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75cb400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75c406eaf0 con 0x7f75c4152bf0 2024-05-30T07:00:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75cb400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f75c406e970 con 0x7f75a8006f60 2024-05-30T07:00:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75cb400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f75c406ec70 con 0x7f75c40ae2e0 2024-05-30T07:00:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75c9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c4152bf0 0x7f75c415d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75c9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c4152bf0 0x7f75c415d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45748/0 (socket says 172.21.15.37:45748) 2024-05-30T07:00:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75c9400640 1 -- 172.21.15.37:0/3847320081 learned_addr learned my addr 172.21.15.37:0/3847320081 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75bbe00640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75c40ae2e0 0x7f75c41526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75c8a00640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a8006f60 0x7f75c4150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75c9400640 1 -- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75c40ae2e0 msgr2=0x7f75c41526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75c9400640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75c40ae2e0 0x7f75c41526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75c9400640 1 -- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a8006f60 msgr2=0x7f75c4150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75c9400640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a8006f60 0x7f75c4150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75c9400640 1 -- 172.21.15.37:0/3847320081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c4150690 con 0x7f75c4152bf0 2024-05-30T07:00:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75c9400640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c4152bf0 0x7f75c415d050 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0b0040 tx=0x7f75bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75c1600640 1 -- 172.21.15.37:0/3847320081 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0bc070 con 0x7f75c4152bf0 2024-05-30T07:00:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75c1600640 1 -- 172.21.15.37:0/3847320081 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75bc0a56d0 con 0x7f75c4152bf0 2024-05-30T07:00:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75c1600640 1 -- 172.21.15.37:0/3847320081 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0b2040 con 0x7f75c4152bf0 2024-05-30T07:00:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75cb400640 1 -- 172.21.15.37:0/3847320081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c40ae7c0 con 0x7f75c4152bf0 2024-05-30T07:00:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75cb400640 1 -- 172.21.15.37:0/3847320081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c40aed80 con 0x7f75c4152bf0 2024-05-30T07:00:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.353+0000 7f75cb400640 1 -- 172.21.15.37:0/3847320081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c4068bc0 con 0x7f75c4152bf0 2024-05-30T07:00:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.357+0000 7f75c1600640 1 -- 172.21.15.37:0/3847320081 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 50) ==== 90945+0+0 (secure 0 0 0) 0x7f75bc0ad660 con 0x7f75c4152bf0 2024-05-30T07:00:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.357+0000 7f75c1600640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f75a006a420 0x7f75a006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.357+0000 7f75c1600640 1 -- 172.21.15.37:0/3847320081 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f75bc11f2b0 con 0x7f75c4152bf0 2024-05-30T07:00:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.357+0000 7f75c8a00640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f75a006a420 0x7f75a006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.357+0000 7f75c8a00640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f75a006a420 0x7f75a006c8e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f75b4000c10 tx=0x7f75b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.361+0000 7f75c1600640 1 -- 172.21.15.37:0/3847320081 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f75bc0168f0 con 0x7f75c4152bf0 2024-05-30T07:00:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.549+0000 7f75cb400640 1 -- 172.21.15.37:0/3847320081 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75c40af980 con 0x7f75a006a420 2024-05-30T07:00:49.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.561+0000 7f75c1600640 1 -- 172.21.15.37:0/3847320081 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+381 (secure 0 0 0) 0x7f75c40af980 con 0x7f75a006a420 2024-05-30T07:00:49.560 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:49.560 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T07:00:49.560 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:49.560 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone52192" 2024-05-30T07:00:49.560 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.560 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:49.560 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sv1" 2024-05-30T07:00:49.560 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.560 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:49.560 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone52194" 2024-05-30T07:00:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone52191" 2024-05-30T07:00:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone52195" 2024-05-30T07:00:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone52197" 2024-05-30T07:00:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone52193" 2024-05-30T07:00:49.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-05-30T07:00:49.562 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:49.562 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subvol_clone52196" 2024-05-30T07:00:49.562 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:49.562 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T07:00:49.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.561+0000 7f75cb400640 1 -- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f75a006a420 msgr2=0x7f75a006c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.561+0000 7f75cb400640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f75a006a420 0x7f75a006c8e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f75b4000c10 tx=0x7f75b4009040 comp rx=0 tx=0).stop 2024-05-30T07:00:49.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.561+0000 7f75cb400640 1 -- 172.21.15.37:0/3847320081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c4152bf0 msgr2=0x7f75c415d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.561+0000 7f75cb400640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c4152bf0 0x7f75c415d050 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0b0040 tx=0x7f75bc009750 comp rx=0 tx=0).stop 2024-05-30T07:00:49.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.561+0000 7f75cb400640 1 -- 172.21.15.37:0/3847320081 shutdown_connections 2024-05-30T07:00:49.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.561+0000 7f75cb400640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c4152bf0 0x7f75c415d050 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.561+0000 7f75cb400640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75c40ae2e0 0x7f75c41526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.561+0000 7f75cb400640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f75a006a420 0x7f75a006c8e0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.561+0000 7f75cb400640 1 --2- 172.21.15.37:0/3847320081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75a8006f60 0x7f75c4150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.561+0000 7f75cb400640 1 -- 172.21.15.37:0/3847320081 >> 172.21.15.37:0/3847320081 conn(0x7f75c406bf60 msgr2=0x7f75c4154f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:49.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.561+0000 7f75cb400640 1 -- 172.21.15.37:0/3847320081 shutdown_connections 2024-05-30T07:00:49.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.561+0000 7f75cb400640 1 -- 172.21.15.37:0/3847320081 wait complete. 2024-05-30T07:00:49.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm --force cephfs subvol_clone52192 2024-05-30T07:00:49.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc79200640 1 Processor -- start 2024-05-30T07:00:49.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc79200640 1 -- start start 2024-05-30T07:00:49.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc79200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcc7415eb60 0x7fcc7406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc79200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc740b15c0 0x7fcc740cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc79200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc7409bba0 con 0x7fcc740cf460 2024-05-30T07:00:49.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc79200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcc7409ab00 con 0x7fcc740b15c0 2024-05-30T07:00:49.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc79200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcc7409ade0 con 0x7fcc7415eb60 2024-05-30T07:00:49.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc6be00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc740b15c0 0x7fcc740cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc72800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcc740cf460 0x7fcc741625a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45358/0 (socket says 172.21.15.37:45358) 2024-05-30T07:00:49.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc72800640 1 -- 172.21.15.37:0/1598182689 learned_addr learned my addr 172.21.15.37:0/1598182689 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:00:49.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc71e00640 1 --2- 172.21.15.37:0/1598182689 >> v2:172.21.15.105:3300/0 conn(0x7fcc7415eb60 0x7fcc7406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc6be00640 1 -- 172.21.15.37:0/1598182689 >> v2:172.21.15.105:3300/0 conn(0x7fcc7415eb60 msgr2=0x7fcc7406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:49.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc6be00640 1 --2- 172.21.15.37:0/1598182689 >> v2:172.21.15.105:3300/0 conn(0x7fcc7415eb60 0x7fcc7406d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc6be00640 1 -- 172.21.15.37:0/1598182689 >> v1:172.21.15.37:6789/0 conn(0x7fcc740cf460 legacy=0x7fcc741625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.725+0000 7fcc6be00640 1 -- 172.21.15.37:0/1598182689 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7409b0c0 con 0x7fcc740b15c0 2024-05-30T07:00:49.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.729+0000 7fcc6be00640 1 --2- 172.21.15.37:0/1598182689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc740b15c0 0x7fcc740cef20 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fcc740b8730 tx=0x7fcc5c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda6842187c225e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.729+0000 7fcc71400640 1 -- 172.21.15.37:0/1598182689 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0b0070 con 0x7fcc740b15c0 2024-05-30T07:00:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.729+0000 7fcc71400640 1 -- 172.21.15.37:0/1598182689 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5c0ab600 con 0x7fcc740b15c0 2024-05-30T07:00:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.729+0000 7fcc71400640 1 -- 172.21.15.37:0/1598182689 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0ab9d0 con 0x7fcc740b15c0 2024-05-30T07:00:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.729+0000 7fcc79200640 1 -- 172.21.15.37:0/1598182689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc740b15c0 msgr2=0x7fcc740cef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.729+0000 7fcc79200640 1 --2- 172.21.15.37:0/1598182689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc740b15c0 0x7fcc740cef20 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fcc740b8730 tx=0x7fcc5c01c480 comp rx=0 tx=0).stop 2024-05-30T07:00:49.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.729+0000 7fcc79200640 1 -- 172.21.15.37:0/1598182689 shutdown_connections 2024-05-30T07:00:49.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.729+0000 7fcc79200640 1 --2- 172.21.15.37:0/1598182689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc740b15c0 0x7fcc740cef20 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.729+0000 7fcc79200640 1 --2- 172.21.15.37:0/1598182689 >> v2:172.21.15.105:3300/0 conn(0x7fcc7415eb60 0x7fcc7406d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.729+0000 7fcc79200640 1 -- 172.21.15.37:0/1598182689 >> 172.21.15.37:0/1598182689 conn(0x7fcc740d26a0 msgr2=0x7fcc740d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:49.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.729+0000 7fcc79200640 1 -- 172.21.15.37:0/1598182689 shutdown_connections 2024-05-30T07:00:49.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.729+0000 7fcc79200640 1 -- 172.21.15.37:0/1598182689 wait complete. 2024-05-30T07:00:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc79200640 1 Processor -- start 2024-05-30T07:00:49.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc79200640 1 -- start start 2024-05-30T07:00:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc79200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc740b15c0 0x7fcc74147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc79200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc740cf460 0x7fcc7415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc79200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc7415eb60 0x7fcc74157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc79200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc740d1800 con 0x7fcc740cf460 2024-05-30T07:00:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc79200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc740d1680 con 0x7fcc740b15c0 2024-05-30T07:00:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc79200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcc7416b8e0 con 0x7fcc7415eb60 2024-05-30T07:00:49.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc6be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc740cf460 0x7fcc7415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc6be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc740cf460 0x7fcc7415dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45768/0 (socket says 172.21.15.37:45768) 2024-05-30T07:00:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc6be00640 1 -- 172.21.15.37:0/2345731534 learned_addr learned my addr 172.21.15.37:0/2345731534 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc71e00640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc740b15c0 0x7fcc74147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc72800640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc7415eb60 0x7fcc74157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc6be00640 1 -- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc7415eb60 msgr2=0x7fcc74157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc6be00640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc7415eb60 0x7fcc74157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc6be00640 1 -- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc740b15c0 msgr2=0x7fcc74147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc6be00640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc740b15c0 0x7fcc74147a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc6be00640 1 -- 172.21.15.37:0/2345731534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc74156390 con 0x7fcc740cf460 2024-05-30T07:00:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc72800640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc7415eb60 0x7fcc74157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:49.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc6be00640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc740cf460 0x7fcc7415dc20 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0ae040 tx=0x7fcc5c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc6a000640 1 -- 172.21.15.37:0/2345731534 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0b0050 con 0x7fcc740cf460 2024-05-30T07:00:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc6a000640 1 -- 172.21.15.37:0/2345731534 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5c0bc070 con 0x7fcc740cf460 2024-05-30T07:00:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc79200640 1 -- 172.21.15.37:0/2345731534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc74156630 con 0x7fcc740cf460 2024-05-30T07:00:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc6a000640 1 -- 172.21.15.37:0/2345731534 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0b5830 con 0x7fcc740cf460 2024-05-30T07:00:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc79200640 1 -- 172.21.15.37:0/2345731534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc7415e320 con 0x7fcc740cf460 2024-05-30T07:00:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.733+0000 7fcc79200640 1 -- 172.21.15.37:0/2345731534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc74068d40 con 0x7fcc740cf460 2024-05-30T07:00:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.737+0000 7fcc6a000640 1 -- 172.21.15.37:0/2345731534 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 50) ==== 90945+0+0 (secure 0 0 0) 0x7fcc5c0b59d0 con 0x7fcc740cf460 2024-05-30T07:00:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.737+0000 7fcc6a000640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc5006a450 0x7fcc5006c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.737+0000 7fcc6a000640 1 -- 172.21.15.37:0/2345731534 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fcc5c120260 con 0x7fcc740cf460 2024-05-30T07:00:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.737+0000 7fcc71e00640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc5006a450 0x7fcc5006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.737+0000 7fcc71e00640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc5006a450 0x7fcc5006c910 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400b9d0 tx=0x7fcc64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.741+0000 7fcc6a000640 1 -- 172.21.15.37:0/2345731534 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcc5c016070 con 0x7fcc740cf460 2024-05-30T07:00:49.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.929+0000 7fcc79200640 1 -- 172.21.15.37:0/2345731534 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "force": true, "vol_name": "cephfs", "sub_name": "subvol_clone52192", "target": ["mon-mgr", ""]}) -- 0x7fcc74157160 con 0x7fcc5006a450 2024-05-30T07:00:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.953+0000 7fcc6a000640 1 -- 172.21.15.37:0/2345731534 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcc74157160 con 0x7fcc5006a450 2024-05-30T07:00:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.957+0000 7fcc79200640 1 -- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc5006a450 msgr2=0x7fcc5006c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.957+0000 7fcc79200640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc5006a450 0x7fcc5006c910 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400b9d0 tx=0x7fcc64008040 comp rx=0 tx=0).stop 2024-05-30T07:00:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.957+0000 7fcc79200640 1 -- 172.21.15.37:0/2345731534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc740cf460 msgr2=0x7fcc7415dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.957+0000 7fcc79200640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc740cf460 0x7fcc7415dc20 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0ae040 tx=0x7fcc5c01acc0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.957+0000 7fcc79200640 1 -- 172.21.15.37:0/2345731534 shutdown_connections 2024-05-30T07:00:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.957+0000 7fcc79200640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc7415eb60 0x7fcc74157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.957+0000 7fcc79200640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc740cf460 0x7fcc7415dc20 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.957+0000 7fcc79200640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcc5006a450 0x7fcc5006c910 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.957+0000 7fcc79200640 1 --2- 172.21.15.37:0/2345731534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc740b15c0 0x7fcc74147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.957+0000 7fcc79200640 1 -- 172.21.15.37:0/2345731534 >> 172.21.15.37:0/2345731534 conn(0x7fcc740d26a0 msgr2=0x7fcc740709d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.957+0000 7fcc79200640 1 -- 172.21.15.37:0/2345731534 shutdown_connections 2024-05-30T07:00:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:49.957+0000 7fcc79200640 1 -- 172.21.15.37:0/2345731534 wait complete. 2024-05-30T07:00:49.960 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:49.961+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:49.960 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:49.961+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:49.960 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:49.961+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:49.960 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:49.961+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:49.960 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:49.961+0000 7f0050200640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:49.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs sv1 --format json 2024-05-30T07:00:49.978 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:49.981+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:49.978 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:49.981+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:49.978 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:49.981+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:49.978 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:49.981+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:49.978 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:49.981+0000 7f004e400640 -1 client.0 error registering admin socket command: (17) File exists 2024-05-30T07:00:50.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.121+0000 7fa219e00640 1 Processor -- start 2024-05-30T07:00:50.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.121+0000 7fa219e00640 1 -- start start 2024-05-30T07:00:50.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.121+0000 7fa219e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2140cd400 0x7fa21406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:50.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.121+0000 7fa219e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa21406f5a0 0x7fa2140b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:50.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa219e00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2140ce030 con 0x7fa2141590c0 2024-05-30T07:00:50.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa219e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa21415f230 con 0x7fa2140cd400 2024-05-30T07:00:50.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa219e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa21415f510 con 0x7fa21406f5a0 2024-05-30T07:00:50.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa212a00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa2141590c0 0x7fa2140cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45364/0 (socket says 172.21.15.37:45364) 2024-05-30T07:00:50.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa212a00640 1 -- 172.21.15.37:0/867992732 learned_addr learned my addr 172.21.15.37:0/867992732 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:00:50.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa20a000640 1 --2- 172.21.15.37:0/867992732 >> v2:172.21.15.37:3300/0 conn(0x7fa2140cd400 0x7fa21406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:50.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa213400640 1 --2- 172.21.15.37:0/867992732 >> v2:172.21.15.105:3300/0 conn(0x7fa21406f5a0 0x7fa2140b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:50.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa20a000640 1 -- 172.21.15.37:0/867992732 >> v2:172.21.15.105:3300/0 conn(0x7fa21406f5a0 msgr2=0x7fa2140b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:50.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa20a000640 1 --2- 172.21.15.37:0/867992732 >> v2:172.21.15.105:3300/0 conn(0x7fa21406f5a0 0x7fa2140b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:50.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa20a000640 1 -- 172.21.15.37:0/867992732 >> v1:172.21.15.37:6789/0 conn(0x7fa2141590c0 legacy=0x7fa2140cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:50.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa20a000640 1 -- 172.21.15.37:0/867992732 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21415f7f0 con 0x7fa2140cd400 2024-05-30T07:00:50.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa212000640 1 -- 172.21.15.37:0/867992732 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1912198090 0 0) 0x7fa2140ce030 con 0x7fa2141590c0 2024-05-30T07:00:50.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa213400640 1 --2- 172.21.15.37:0/867992732 >> v2:172.21.15.105:3300/0 conn(0x7fa21406f5a0 0x7fa2140b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:50.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa20a000640 1 --2- 172.21.15.37:0/867992732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2140cd400 0x7fa21406f060 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fa2140b2d30 tx=0x7fa1fc01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd41c2edfbfa597 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa212000640 1 -- 172.21.15.37:0/867992732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0b0070 con 0x7fa2140cd400 2024-05-30T07:00:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa212000640 1 -- 172.21.15.37:0/867992732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc0ab600 con 0x7fa2140cd400 2024-05-30T07:00:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.125+0000 7fa212000640 1 -- 172.21.15.37:0/867992732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0ab9d0 con 0x7fa2140cd400 2024-05-30T07:00:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 -- 172.21.15.37:0/867992732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2140cd400 msgr2=0x7fa21406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 --2- 172.21.15.37:0/867992732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2140cd400 0x7fa21406f060 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fa2140b2d30 tx=0x7fa1fc01c360 comp rx=0 tx=0).stop 2024-05-30T07:00:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 -- 172.21.15.37:0/867992732 shutdown_connections 2024-05-30T07:00:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 --2- 172.21.15.37:0/867992732 >> v2:172.21.15.105:3300/0 conn(0x7fa21406f5a0 0x7fa2140b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:50.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 --2- 172.21.15.37:0/867992732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2140cd400 0x7fa21406f060 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:50.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 -- 172.21.15.37:0/867992732 >> 172.21.15.37:0/867992732 conn(0x7fa21406bf60 msgr2=0x7fa2140b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:50.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 -- 172.21.15.37:0/867992732 shutdown_connections 2024-05-30T07:00:50.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 -- 172.21.15.37:0/867992732 wait complete. 2024-05-30T07:00:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 Processor -- start 2024-05-30T07:00:50.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 -- start start 2024-05-30T07:00:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa21406f5a0 0x7fa21415b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2140cd400 0x7fa214159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:50.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2141590c0 0x7fa21415d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2141684a0 con 0x7fa21406f5a0 2024-05-30T07:00:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa21406f9b0 con 0x7fa2140cd400 2024-05-30T07:00:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa219e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa214168620 con 0x7fa2141590c0 2024-05-30T07:00:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa212a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa21406f5a0 0x7fa21415b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa212a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa21406f5a0 0x7fa21415b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45784/0 (socket says 172.21.15.37:45784) 2024-05-30T07:00:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa212a00640 1 -- 172.21.15.37:0/317356248 learned_addr learned my addr 172.21.15.37:0/317356248 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa20a000640 1 --2- 172.21.15.37:0/317356248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2140cd400 0x7fa214159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa212a00640 1 -- 172.21.15.37:0/317356248 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2141590c0 msgr2=0x7fa21415d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa212a00640 1 --2- 172.21.15.37:0/317356248 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2141590c0 0x7fa21415d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa212a00640 1 -- 172.21.15.37:0/317356248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2140cd400 msgr2=0x7fa214159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa212a00640 1 --2- 172.21.15.37:0/317356248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2140cd400 0x7fa214159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:50.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.129+0000 7fa212a00640 1 -- 172.21.15.37:0/317356248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21415a1b0 con 0x7fa21406f5a0 2024-05-30T07:00:50.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.133+0000 7fa212a00640 1 --2- 172.21.15.37:0/317356248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa21406f5a0 0x7fa21415b250 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fa20400c480 tx=0x7fa20400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:50.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.133+0000 7fa20be00640 1 -- 172.21.15.37:0/317356248 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204018070 con 0x7fa21406f5a0 2024-05-30T07:00:50.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.133+0000 7fa20be00640 1 -- 172.21.15.37:0/317356248 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa204007500 con 0x7fa21406f5a0 2024-05-30T07:00:50.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.133+0000 7fa219e00640 1 -- 172.21.15.37:0/317356248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa21415a490 con 0x7fa21406f5a0 2024-05-30T07:00:50.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.133+0000 7fa20be00640 1 -- 172.21.15.37:0/317356248 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa204004a30 con 0x7fa21406f5a0 2024-05-30T07:00:50.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.133+0000 7fa219e00640 1 -- 172.21.15.37:0/317356248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa21415aa50 con 0x7fa21406f5a0 2024-05-30T07:00:50.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.133+0000 7fa219e00640 1 -- 172.21.15.37:0/317356248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa214068d40 con 0x7fa21406f5a0 2024-05-30T07:00:50.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.133+0000 7fa20be00640 1 -- 172.21.15.37:0/317356248 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 50) ==== 90945+0+0 (secure 0 0 0) 0x7fa20401b070 con 0x7fa21406f5a0 2024-05-30T07:00:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.133+0000 7fa20be00640 1 --2- 172.21.15.37:0/317356248 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1f006a420 0x7fa1f006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.133+0000 7fa20be00640 1 -- 172.21.15.37:0/317356248 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fa204084df0 con 0x7fa21406f5a0 2024-05-30T07:00:50.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.133+0000 7fa20a000640 1 --2- 172.21.15.37:0/317356248 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1f006a420 0x7fa1f006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:50.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.137+0000 7fa20a000640 1 --2- 172.21.15.37:0/317356248 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1f006a420 0x7fa1f006c8e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0ad000 tx=0x7fa1fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:50.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.137+0000 7fa20be00640 1 -- 172.21.15.37:0/317356248 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa204056e10 con 0x7fa21406f5a0 2024-05-30T07:00:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:50.333+0000 7fa219e00640 1 -- 172.21.15.37:0/317356248 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "sv1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa21414fcb0 con 0x7fa1f006a420 2024-05-30T07:00:51.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.021+0000 7fa20be00640 1 -- 172.21.15.37:0/317356248 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa21414fcb0 con 0x7fa1f006a420 2024-05-30T07:00:51.023 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:51.023 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-05-30T07:00:51.023 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-05-30T07:00:51.024 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ss1" 2024-05-30T07:00:51.024 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-05-30T07:00:51.024 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-05-30T07:00:51.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.025+0000 7fa219e00640 1 -- 172.21.15.37:0/317356248 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1f006a420 msgr2=0x7fa1f006c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:51.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.025+0000 7fa219e00640 1 --2- 172.21.15.37:0/317356248 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1f006a420 0x7fa1f006c8e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0ad000 tx=0x7fa1fc008040 comp rx=0 tx=0).stop 2024-05-30T07:00:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.025+0000 7fa219e00640 1 -- 172.21.15.37:0/317356248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa21406f5a0 msgr2=0x7fa21415b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.025+0000 7fa219e00640 1 --2- 172.21.15.37:0/317356248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa21406f5a0 0x7fa21415b250 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fa20400c480 tx=0x7fa20400c940 comp rx=0 tx=0).stop 2024-05-30T07:00:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.025+0000 7fa219e00640 1 -- 172.21.15.37:0/317356248 shutdown_connections 2024-05-30T07:00:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.025+0000 7fa219e00640 1 --2- 172.21.15.37:0/317356248 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2141590c0 0x7fa21415d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.025+0000 7fa219e00640 1 --2- 172.21.15.37:0/317356248 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa1f006a420 0x7fa1f006c8e0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.025+0000 7fa219e00640 1 --2- 172.21.15.37:0/317356248 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa2140cd400 0x7fa214159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.025+0000 7fa219e00640 1 --2- 172.21.15.37:0/317356248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa21406f5a0 0x7fa21415b250 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.025+0000 7fa219e00640 1 -- 172.21.15.37:0/317356248 >> 172.21.15.37:0/317356248 conn(0x7fa21406bf60 msgr2=0x7fa2140b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.025+0000 7fa219e00640 1 -- 172.21.15.37:0/317356248 shutdown_connections 2024-05-30T07:00:51.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.025+0000 7fa219e00640 1 -- 172.21.15.37:0/317356248 wait complete. 2024-05-30T07:00:51.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T07:00:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd500400640 1 Processor -- start 2024-05-30T07:00:51.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd500400640 1 -- start start 2024-05-30T07:00:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd500400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd4f80ce660 0x7fd4f806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd500400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f80d1dd0 0x7fd4f809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd500400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4f80d0850 0x7fd4f809afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd500400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f80cea40 con 0x7fd4f80d0850 2024-05-30T07:00:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd500400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd4f80d0d30 con 0x7fd4f80ce660 2024-05-30T07:00:51.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd500400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f80d1010 con 0x7fd4f80d1dd0 2024-05-30T07:00:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd4fe400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4f80d0850 0x7fd4f809afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd4fe400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd4f80d0850 0x7fd4f809afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45792/0 (socket says 172.21.15.37:45792) 2024-05-30T07:00:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd4fe400640 1 -- 172.21.15.37:0/2095559148 learned_addr learned my addr 172.21.15.37:0/2095559148 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd4fda00640 1 --2- 172.21.15.37:0/2095559148 >> v2:172.21.15.105:3300/0 conn(0x7fd4f80ce660 0x7fd4f806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd4fd000640 1 --2- 172.21.15.37:0/2095559148 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f80d1dd0 0x7fd4f809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd4fe400640 1 -- 172.21.15.37:0/2095559148 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f80d1dd0 msgr2=0x7fd4f809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd4fe400640 1 --2- 172.21.15.37:0/2095559148 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f80d1dd0 0x7fd4f809aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd4fe400640 1 -- 172.21.15.37:0/2095559148 >> v2:172.21.15.105:3300/0 conn(0x7fd4f80ce660 msgr2=0x7fd4f806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd4fe400640 1 --2- 172.21.15.37:0/2095559148 >> v2:172.21.15.105:3300/0 conn(0x7fd4f80ce660 0x7fd4f806d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd4fe400640 1 -- 172.21.15.37:0/2095559148 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f80d12f0 con 0x7fd4f80d0850 2024-05-30T07:00:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd4fd000640 1 --2- 172.21.15.37:0/2095559148 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f80d1dd0 0x7fd4f809aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:00:51.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.201+0000 7fd4fda00640 1 --2- 172.21.15.37:0/2095559148 >> v2:172.21.15.105:3300/0 conn(0x7fd4f80ce660 0x7fd4f806d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:00:51.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.205+0000 7fd4fe400640 1 --2- 172.21.15.37:0/2095559148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4f80d0850 0x7fd4f809afa0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8073db0 tx=0x7fd4f001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673392bcb9009217 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:51.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.205+0000 7fd4f7e00640 1 -- 172.21.15.37:0/2095559148 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f00a5840 con 0x7fd4f80d0850 2024-05-30T07:00:51.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.205+0000 7fd4f7e00640 1 -- 172.21.15.37:0/2095559148 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f00a59e0 con 0x7fd4f80d0850 2024-05-30T07:00:51.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.205+0000 7fd4f7e00640 1 -- 172.21.15.37:0/2095559148 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f00a5db0 con 0x7fd4f80d0850 2024-05-30T07:00:51.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.205+0000 7fd500400640 1 -- 172.21.15.37:0/2095559148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4f80d0850 msgr2=0x7fd4f809afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:51.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.205+0000 7fd500400640 1 --2- 172.21.15.37:0/2095559148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4f80d0850 0x7fd4f809afa0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8073db0 tx=0x7fd4f001c9c0 comp rx=0 tx=0).stop 2024-05-30T07:00:51.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.205+0000 7fd500400640 1 -- 172.21.15.37:0/2095559148 shutdown_connections 2024-05-30T07:00:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.205+0000 7fd500400640 1 --2- 172.21.15.37:0/2095559148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4f80d0850 0x7fd4f809afa0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.205+0000 7fd500400640 1 --2- 172.21.15.37:0/2095559148 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f80d1dd0 0x7fd4f809aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.205+0000 7fd500400640 1 --2- 172.21.15.37:0/2095559148 >> v2:172.21.15.105:3300/0 conn(0x7fd4f80ce660 0x7fd4f806d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.205+0000 7fd500400640 1 -- 172.21.15.37:0/2095559148 >> 172.21.15.37:0/2095559148 conn(0x7fd4f80b4100 msgr2=0x7fd4f80b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.205+0000 7fd500400640 1 -- 172.21.15.37:0/2095559148 shutdown_connections 2024-05-30T07:00:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.205+0000 7fd500400640 1 -- 172.21.15.37:0/2095559148 wait complete. 2024-05-30T07:00:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd500400640 1 Processor -- start 2024-05-30T07:00:51.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd500400640 1 -- start start 2024-05-30T07:00:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd500400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f80ce660 0x7fd4f81526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd500400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4f80d0850 0x7fd4f814fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd500400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f80d1dd0 0x7fd4f8150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd500400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f815ea90 con 0x7fd4f80d0850 2024-05-30T07:00:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd500400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f806cc70 con 0x7fd4f80d1dd0 2024-05-30T07:00:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd500400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f815ec10 con 0x7fd4f80ce660 2024-05-30T07:00:51.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd4fd000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4f80d0850 0x7fd4f814fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd4fd000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4f80d0850 0x7fd4f814fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45794/0 (socket says 172.21.15.37:45794) 2024-05-30T07:00:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd4fd000640 1 -- 172.21.15.37:0/1486227651 learned_addr learned my addr 172.21.15.37:0/1486227651 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd4fd000640 1 -- 172.21.15.37:0/1486227651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f80ce660 msgr2=0x7fd4f81526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd4fd000640 1 --2- 172.21.15.37:0/1486227651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f80ce660 0x7fd4f81526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd4fe400640 1 --2- 172.21.15.37:0/1486227651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f80d1dd0 0x7fd4f8150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd4fd000640 1 -- 172.21.15.37:0/1486227651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f80d1dd0 msgr2=0x7fd4f8150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd4fd000640 1 --2- 172.21.15.37:0/1486227651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f80d1dd0 0x7fd4f8150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:51.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd4fd000640 1 -- 172.21.15.37:0/1486227651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f814f130 con 0x7fd4f80d0850 2024-05-30T07:00:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd4fd000640 1 --2- 172.21.15.37:0/1486227651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4f80d0850 0x7fd4f814fbd0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400d830 tx=0x7fd4e400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd4f5600640 1 -- 172.21.15.37:0/1486227651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400b6c0 con 0x7fd4f80d0850 2024-05-30T07:00:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd4f5600640 1 -- 172.21.15.37:0/1486227651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e4019070 con 0x7fd4f80d0850 2024-05-30T07:00:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd500400640 1 -- 172.21.15.37:0/1486227651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f814d6b0 con 0x7fd4f80d0850 2024-05-30T07:00:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd4f5600640 1 -- 172.21.15.37:0/1486227651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400baa0 con 0x7fd4f80d0850 2024-05-30T07:00:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.209+0000 7fd500400640 1 -- 172.21.15.37:0/1486227651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f814dc70 con 0x7fd4f80d0850 2024-05-30T07:00:51.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.213+0000 7fd500400640 1 -- 172.21.15.37:0/1486227651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f8068bc0 con 0x7fd4f80d0850 2024-05-30T07:00:51.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.213+0000 7fd4f5600640 1 -- 172.21.15.37:0/1486227651 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 50) ==== 90945+0+0 (secure 0 0 0) 0x7fd4e401e460 con 0x7fd4f80d0850 2024-05-30T07:00:51.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.213+0000 7fd4f5600640 1 --2- 172.21.15.37:0/1486227651 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd4d806a420 0x7fd4d806c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:51.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.213+0000 7fd4f5600640 1 -- 172.21.15.37:0/1486227651 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fd4e40860d0 con 0x7fd4f80d0850 2024-05-30T07:00:51.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.213+0000 7fd4fda00640 1 --2- 172.21.15.37:0/1486227651 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd4d806a420 0x7fd4d806c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:51.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.213+0000 7fd4fda00640 1 --2- 172.21.15.37:0/1486227651 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd4d806a420 0x7fd4d806c8e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec006f10 tx=0x7fd4ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:51.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.217+0000 7fd4f5600640 1 -- 172.21.15.37:0/1486227651 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd4e40580f0 con 0x7fd4f80d0850 2024-05-30T07:00:51.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.413+0000 7fd500400640 1 -- 172.21.15.37:0/1486227651 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4f815e060 con 0x7fd4d806a420 2024-05-30T07:00:51.419 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:51.421+0000 7f004c600640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T07:00:51.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:51.417+0000 7fd4f5600640 1 -- 172.21.15.37:0/1486227651 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7fd4f815e060 con 0x7fd4d806a420 2024-05-30T07:00:51.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:51.420 INFO:teuthology.orchestra.run.smithi037.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T07:00:51.429 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T07:00:53.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T07:00:53.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.585+0000 7f19e5c00640 1 Processor -- start 2024-05-30T07:00:53.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.585+0000 7f19e5c00640 1 -- start start 2024-05-30T07:00:53.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19e5c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19e015c890 0x7f19e0162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:53.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19e5c00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f19e015f210 0x7f19e0072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:53.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19e5c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19e00cec10 0x7f19e0072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:53.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19e5c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f19e0163020 con 0x7f19e015c890 2024-05-30T07:00:53.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19e5c00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f19e0163300 con 0x7f19e015f210 2024-05-30T07:00:53.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19e5c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f19e01635e0 con 0x7f19e00cec10 2024-05-30T07:00:53.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19dea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19e015c890 0x7f19e0162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:53.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19dea00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19e015c890 0x7f19e0162720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45808/0 (socket says 172.21.15.37:45808) 2024-05-30T07:00:53.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19dea00640 1 -- 172.21.15.37:0/3073453432 learned_addr learned my addr 172.21.15.37:0/3073453432 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:53.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19d6000640 1 --2- 172.21.15.37:0/3073453432 >> v2:172.21.15.105:3300/0 conn(0x7f19e015f210 0x7f19e0072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:53.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19df400640 1 --2- 172.21.15.37:0/3073453432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19e00cec10 0x7f19e0072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:53.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19dea00640 1 -- 172.21.15.37:0/3073453432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19e00cec10 msgr2=0x7f19e0072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:53.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19dea00640 1 --2- 172.21.15.37:0/3073453432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19e00cec10 0x7f19e0072c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:53.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19dea00640 1 -- 172.21.15.37:0/3073453432 >> v2:172.21.15.105:3300/0 conn(0x7f19e015f210 msgr2=0x7f19e0072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:53.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19dea00640 1 --2- 172.21.15.37:0/3073453432 >> v2:172.21.15.105:3300/0 conn(0x7f19e015f210 0x7f19e0072750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:53.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.589+0000 7f19dea00640 1 -- 172.21.15.37:0/3073453432 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e006ba00 con 0x7f19e015c890 2024-05-30T07:00:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19dea00640 1 --2- 172.21.15.37:0/3073453432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19e015c890 0x7f19e0162720 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f19e00b6290 tx=0x7f19d001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0297e1227846917 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19de000640 1 -- 172.21.15.37:0/3073453432 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d00a55e0 con 0x7f19e015c890 2024-05-30T07:00:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19de000640 1 -- 172.21.15.37:0/3073453432 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19d00a5780 con 0x7f19e015c890 2024-05-30T07:00:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19de000640 1 -- 172.21.15.37:0/3073453432 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d00a5b50 con 0x7f19e015c890 2024-05-30T07:00:53.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 -- 172.21.15.37:0/3073453432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19e015c890 msgr2=0x7f19e0162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:53.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 --2- 172.21.15.37:0/3073453432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19e015c890 0x7f19e0162720 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f19e00b6290 tx=0x7f19d001c960 comp rx=0 tx=0).stop 2024-05-30T07:00:53.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 -- 172.21.15.37:0/3073453432 shutdown_connections 2024-05-30T07:00:53.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 --2- 172.21.15.37:0/3073453432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19e00cec10 0x7f19e0072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:53.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 --2- 172.21.15.37:0/3073453432 >> v2:172.21.15.105:3300/0 conn(0x7f19e015f210 0x7f19e0072750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:53.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 --2- 172.21.15.37:0/3073453432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19e015c890 0x7f19e0162720 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:53.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 -- 172.21.15.37:0/3073453432 >> 172.21.15.37:0/3073453432 conn(0x7f19e00b2ac0 msgr2=0x7f19e00b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:53.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 -- 172.21.15.37:0/3073453432 shutdown_connections 2024-05-30T07:00:53.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 -- 172.21.15.37:0/3073453432 wait complete. 2024-05-30T07:00:53.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 Processor -- start 2024-05-30T07:00:53.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 -- start start 2024-05-30T07:00:53.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19e00cec10 0x7f19e0153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:53.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19e015c890 0x7f19e00b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:53.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19e015f210 0x7f19e015f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:53.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f19e006cda0 con 0x7f19e015c890 2024-05-30T07:00:53.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f19e006cc20 con 0x7f19e00cec10 2024-05-30T07:00:53.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.593+0000 7f19e5c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f19e006cf20 con 0x7f19e015f210 2024-05-30T07:00:53.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19d6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19e015c890 0x7f19e00b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:53.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19d6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19e015c890 0x7f19e00b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45824/0 (socket says 172.21.15.37:45824) 2024-05-30T07:00:53.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19d6000640 1 -- 172.21.15.37:0/3158894078 learned_addr learned my addr 172.21.15.37:0/3158894078 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19df400640 1 --2- 172.21.15.37:0/3158894078 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19e015f210 0x7f19e015f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19dea00640 1 --2- 172.21.15.37:0/3158894078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19e00cec10 0x7f19e0153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19d6000640 1 -- 172.21.15.37:0/3158894078 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19e015f210 msgr2=0x7f19e015f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19d6000640 1 --2- 172.21.15.37:0/3158894078 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19e015f210 0x7f19e015f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19d6000640 1 -- 172.21.15.37:0/3158894078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19e00cec10 msgr2=0x7f19e0153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19d6000640 1 --2- 172.21.15.37:0/3158894078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19e00cec10 0x7f19e0153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19d6000640 1 -- 172.21.15.37:0/3158894078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e00b0510 con 0x7f19e015c890 2024-05-30T07:00:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19d6000640 1 --2- 172.21.15.37:0/3158894078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19e015c890 0x7f19e00b2ea0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f19c800d830 tx=0x7f19c800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19d7400640 1 -- 172.21.15.37:0/3158894078 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c800b6c0 con 0x7f19e015c890 2024-05-30T07:00:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19d7400640 1 -- 172.21.15.37:0/3158894078 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c8019070 con 0x7f19e015c890 2024-05-30T07:00:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19d7400640 1 -- 172.21.15.37:0/3158894078 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c800ba60 con 0x7f19e015c890 2024-05-30T07:00:53.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19e5c00640 1 -- 172.21.15.37:0/3158894078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e00b33e0 con 0x7f19e015c890 2024-05-30T07:00:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19e5c00640 1 -- 172.21.15.37:0/3158894078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e01597a0 con 0x7f19e015c890 2024-05-30T07:00:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19e5c00640 1 -- 172.21.15.37:0/3158894078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e0068bc0 con 0x7f19e015c890 2024-05-30T07:00:53.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.597+0000 7f19d7400640 1 -- 172.21.15.37:0/3158894078 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f19c801e460 con 0x7f19e015c890 2024-05-30T07:00:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.601+0000 7f19d7400640 1 --2- 172.21.15.37:0/3158894078 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f19bc06a540 0x7f19bc06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.601+0000 7f19d7400640 1 -- 172.21.15.37:0/3158894078 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f19c80860d0 con 0x7f19e015c890 2024-05-30T07:00:53.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.601+0000 7f19dea00640 1 --2- 172.21.15.37:0/3158894078 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f19bc06a540 0x7f19bc06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:53.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.601+0000 7f19dea00640 1 --2- 172.21.15.37:0/3158894078 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f19bc06a540 0x7f19bc06ca00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f19d00ae000 tx=0x7f19d00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:53.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.605+0000 7f19d7400640 1 -- 172.21.15.37:0/3158894078 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f19c8057aa0 con 0x7f19e015c890 2024-05-30T07:00:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.801+0000 7f19e5c00640 1 -- 172.21.15.37:0/3158894078 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19e0161f60 con 0x7f19bc06a540 2024-05-30T07:00:53.808 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:53.809+0000 7f004c600640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T07:00:53.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:53.805+0000 7f19d7400640 1 -- 172.21.15.37:0/3158894078 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7f19e0161f60 con 0x7f19bc06a540 2024-05-30T07:00:53.809 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:53.809 INFO:teuthology.orchestra.run.smithi037.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T07:00:53.818 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T07:00:55.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T07:00:55.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.977+0000 7f4dc0000640 1 Processor -- start 2024-05-30T07:00:55.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.977+0000 7f4dc0000640 1 -- start start 2024-05-30T07:00:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.977+0000 7f4dc0000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4db8162ba0 0x7f4db80afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.977+0000 7f4dc0000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4db80b36c0 0x7f4db8147680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.977+0000 7f4dc0000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4db80b5f70 con 0x7f4db80cfeb0 2024-05-30T07:00:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.977+0000 7f4dc0000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4db80b3b50 con 0x7f4db80b36c0 2024-05-30T07:00:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.977+0000 7f4dc0000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4db80b67a0 con 0x7f4db8162ba0 2024-05-30T07:00:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.977+0000 7f4dbd600640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4db80cfeb0 0x7f4db8162490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45366/0 (socket says 172.21.15.37:45366) 2024-05-30T07:00:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.977+0000 7f4dbd600640 1 -- 172.21.15.37:0/2909068527 learned_addr learned my addr 172.21.15.37:0/2909068527 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:00:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.977+0000 7f4dbe000640 1 --2- 172.21.15.37:0/2909068527 >> v2:172.21.15.37:3300/0 conn(0x7f4db80b36c0 0x7f4db8147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:55.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.977+0000 7f4dbcc00640 1 --2- 172.21.15.37:0/2909068527 >> v2:172.21.15.105:3300/0 conn(0x7f4db8162ba0 0x7f4db80afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.977+0000 7f4db7e00640 1 -- 172.21.15.37:0/2909068527 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3072438047 0 0) 0x7f4db80b5f70 con 0x7f4db80cfeb0 2024-05-30T07:00:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.977+0000 7f4dbe000640 1 -- 172.21.15.37:0/2909068527 >> v2:172.21.15.105:3300/0 conn(0x7f4db8162ba0 msgr2=0x7f4db80afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4dbe000640 1 --2- 172.21.15.37:0/2909068527 >> v2:172.21.15.105:3300/0 conn(0x7f4db8162ba0 0x7f4db80afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4dbe000640 1 -- 172.21.15.37:0/2909068527 >> v1:172.21.15.37:6789/0 conn(0x7f4db80cfeb0 legacy=0x7f4db8162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4dbe000640 1 -- 172.21.15.37:0/2909068527 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db80b61e0 con 0x7f4db80b36c0 2024-05-30T07:00:55.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4dbcc00640 1 --2- 172.21.15.37:0/2909068527 >> v2:172.21.15.105:3300/0 conn(0x7f4db8162ba0 0x7f4db80afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4dbe000640 1 --2- 172.21.15.37:0/2909068527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db80b36c0 0x7f4db8147680 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f4db80b3080 tx=0x7f4db001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d6dd72eb6e3866 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4db7e00640 1 -- 172.21.15.37:0/2909068527 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db00b2070 con 0x7f4db80b36c0 2024-05-30T07:00:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4db7e00640 1 -- 172.21.15.37:0/2909068527 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db00a5870 con 0x7f4db80b36c0 2024-05-30T07:00:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4db7e00640 1 -- 172.21.15.37:0/2909068527 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db00a5c40 con 0x7f4db80b36c0 2024-05-30T07:00:55.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4dc0000640 1 -- 172.21.15.37:0/2909068527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db80b36c0 msgr2=0x7f4db8147680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:55.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4dc0000640 1 --2- 172.21.15.37:0/2909068527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db80b36c0 0x7f4db8147680 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f4db80b3080 tx=0x7f4db001c8a0 comp rx=0 tx=0).stop 2024-05-30T07:00:55.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4dc0000640 1 -- 172.21.15.37:0/2909068527 shutdown_connections 2024-05-30T07:00:55.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4dc0000640 1 --2- 172.21.15.37:0/2909068527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db80b36c0 0x7f4db8147680 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:55.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4dc0000640 1 --2- 172.21.15.37:0/2909068527 >> v2:172.21.15.105:3300/0 conn(0x7f4db8162ba0 0x7f4db80afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:55.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4dc0000640 1 -- 172.21.15.37:0/2909068527 >> 172.21.15.37:0/2909068527 conn(0x7f4db806bf60 msgr2=0x7f4db80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:55.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4dc0000640 1 -- 172.21.15.37:0/2909068527 shutdown_connections 2024-05-30T07:00:55.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.981+0000 7f4dc0000640 1 -- 172.21.15.37:0/2909068527 wait complete. 2024-05-30T07:00:55.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dc0000640 1 Processor -- start 2024-05-30T07:00:55.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dc0000640 1 -- start start 2024-05-30T07:00:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dc0000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4db80b36c0 0x7f4db8141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dc0000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db80cfeb0 0x7f4db815dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dc0000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4db8162ba0 0x7f4db80afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dc0000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4db80ae4a0 con 0x7f4db80cfeb0 2024-05-30T07:00:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dc0000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4db80ae320 con 0x7f4db80b36c0 2024-05-30T07:00:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dc0000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4db80ae620 con 0x7f4db8162ba0 2024-05-30T07:00:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dbcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db80cfeb0 0x7f4db815dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dbcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db80cfeb0 0x7f4db815dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45838/0 (socket says 172.21.15.37:45838) 2024-05-30T07:00:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dbcc00640 1 -- 172.21.15.37:0/734500533 learned_addr learned my addr 172.21.15.37:0/734500533 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dbd600640 1 --2- 172.21.15.37:0/734500533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4db80b36c0 0x7f4db8141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dbe000640 1 --2- 172.21.15.37:0/734500533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4db8162ba0 0x7f4db80afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dbcc00640 1 -- 172.21.15.37:0/734500533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4db8162ba0 msgr2=0x7f4db80afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dbcc00640 1 --2- 172.21.15.37:0/734500533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4db8162ba0 0x7f4db80afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dbcc00640 1 -- 172.21.15.37:0/734500533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4db80b36c0 msgr2=0x7f4db8141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dbcc00640 1 --2- 172.21.15.37:0/734500533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4db80b36c0 0x7f4db8141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dbcc00640 1 -- 172.21.15.37:0/734500533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db8140b20 con 0x7f4db80cfeb0 2024-05-30T07:00:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dbcc00640 1 --2- 172.21.15.37:0/734500533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db80cfeb0 0x7f4db815dc40 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f4da400c7f0 tx=0x7f4da400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:55.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4db5600640 1 -- 172.21.15.37:0/734500533 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4015070 con 0x7f4db80cfeb0 2024-05-30T07:00:55.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4db5600640 1 -- 172.21.15.37:0/734500533 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da4007820 con 0x7f4db80cfeb0 2024-05-30T07:00:55.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4db5600640 1 -- 172.21.15.37:0/734500533 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da4007c30 con 0x7f4db80cfeb0 2024-05-30T07:00:55.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dc0000640 1 -- 172.21.15.37:0/734500533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db8140e00 con 0x7f4db80cfeb0 2024-05-30T07:00:55.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.985+0000 7f4dc0000640 1 -- 172.21.15.37:0/734500533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db81413c0 con 0x7f4db80cfeb0 2024-05-30T07:00:55.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.989+0000 7f4dc0000640 1 -- 172.21.15.37:0/734500533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4db8068bc0 con 0x7f4db80cfeb0 2024-05-30T07:00:55.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.989+0000 7f4db5600640 1 -- 172.21.15.37:0/734500533 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f4da4018070 con 0x7f4db80cfeb0 2024-05-30T07:00:55.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.989+0000 7f4db5600640 1 --2- 172.21.15.37:0/734500533 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4d9806a540 0x7f4d9806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:55.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.989+0000 7f4db5600640 1 -- 172.21.15.37:0/734500533 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f4da4085bc0 con 0x7f4db80cfeb0 2024-05-30T07:00:55.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.989+0000 7f4dbd600640 1 --2- 172.21.15.37:0/734500533 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4d9806a540 0x7f4d9806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:55.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.993+0000 7f4dbd600640 1 --2- 172.21.15.37:0/734500533 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f4d9806a540 0x7f4d9806ca00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4dac000f70 tx=0x7f4dac007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:55.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:55.993+0000 7f4db5600640 1 -- 172.21.15.37:0/734500533 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4da4057be0 con 0x7f4db80cfeb0 2024-05-30T07:00:56.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:56.189+0000 7f4dc0000640 1 -- 172.21.15.37:0/734500533 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4db80adb80 con 0x7f4d9806a540 2024-05-30T07:00:56.198 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:56.201+0000 7f004c600640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T07:00:56.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:56.197+0000 7f4db5600640 1 -- 172.21.15.37:0/734500533 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7f4db80adb80 con 0x7f4d9806a540 2024-05-30T07:00:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:56.199 INFO:teuthology.orchestra.run.smithi037.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T07:00:56.208 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T07:00:58.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T07:00:58.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.365+0000 7f4982800640 1 Processor -- start 2024-05-30T07:00:58.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.365+0000 7f4982800640 1 -- start start 2024-05-30T07:00:58.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.365+0000 7f4982800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f497c15d350 0x7f497c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.365+0000 7f4982800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497c142030 con 0x7f497c0b59d0 2024-05-30T07:00:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.365+0000 7f4982800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497c142310 con 0x7f497c15d7b0 2024-05-30T07:00:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.365+0000 7f4982800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f497c1425f0 con 0x7f497c15d350 2024-05-30T07:00:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497b400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f497c0b59d0 0x7f497c0b5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53008/0 (socket says 172.21.15.37:53008) 2024-05-30T07:00:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497b400640 1 -- 172.21.15.37:0/2806434421 learned_addr learned my addr 172.21.15.37:0/2806434421 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:00:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f4973e00640 1 --2- 172.21.15.37:0/2806434421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f497c15d350 0x7f497c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1184766176 0 0) 0x7f497c142030 con 0x7f497c0b59d0 2024-05-30T07:00:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4960003530 con 0x7f497c0b59d0 2024-05-30T07:00:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153187112 0 0) 0x7f497c142310 con 0x7f497c15d7b0 2024-05-30T07:00:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f497c142030 con 0x7f497c15d7b0 2024-05-30T07:00:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2383558968 0 0) 0x7f4960003530 con 0x7f497c0b59d0 2024-05-30T07:00:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f497c15d350 msgr2=0x7f497c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 --2- 172.21.15.37:0/2806434421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f497c15d350 0x7f497c06df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 >> v1:172.21.15.105:6789/0 conn(0x7f497c15d7b0 legacy=0x7f497c06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c1428d0 con 0x7f497c0b59d0 2024-05-30T07:00:58.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f496c001680 con 0x7f497c0b59d0 2024-05-30T07:00:58.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 >> v1:172.21.15.37:6789/0 conn(0x7f497c0b59d0 legacy=0x7f497c0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:58.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 --2- 172.21.15.37:0/2806434421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4960003b80 0x7f4960003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:58.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 --2- 172.21.15.37:0/2806434421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4960004810 0x7f4960004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:58.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 --2- 172.21.15.37:0/2806434421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49600051d0 0x7f496000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:58.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1425f0 con 0x7f4960003b80 2024-05-30T07:00:58.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f496000bf40 con 0x7f49600051d0 2024-05-30T07:00:58.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f496000c140 con 0x7f4960004810 2024-05-30T07:00:58.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f4973e00640 1 --2- 172.21.15.37:0/2806434421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f497c15d350 0x7f497c06df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T07:00:58.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497b400640 1 --2- 172.21.15.37:0/2806434421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4960003b80 0x7f4960003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:58.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497be00640 1 --2- 172.21.15.37:0/2806434421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49600051d0 0x7f496000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:58.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f4973e00640 1 --2- 172.21.15.37:0/2806434421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4960004810 0x7f4960004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:58.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497b400640 1 -- 172.21.15.37:0/2806434421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4960004810 msgr2=0x7f4960004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:58.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497b400640 1 --2- 172.21.15.37:0/2806434421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4960004810 0x7f4960004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:58.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497b400640 1 -- 172.21.15.37:0/2806434421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49600051d0 msgr2=0x7f496000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:00:58.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497b400640 1 --2- 172.21.15.37:0/2806434421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f49600051d0 0x7f496000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:58.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.369+0000 7f497b400640 1 -- 172.21.15.37:0/2806434421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4960003530 con 0x7f4960003b80 2024-05-30T07:00:58.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.373+0000 7f497b400640 1 --2- 172.21.15.37:0/2806434421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4960003b80 0x7f4960003f80 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f496c00c1c0 tx=0x7f496c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b6d6e5f6d58e40 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:58.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.373+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c007cd0 con 0x7f4960003b80 2024-05-30T07:00:58.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.373+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496c0a9020 con 0x7f4960003b80 2024-05-30T07:00:58.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.373+0000 7f497aa00640 1 -- 172.21.15.37:0/2806434421 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c0a5b60 con 0x7f4960003b80 2024-05-30T07:00:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.373+0000 7f4982800640 1 -- 172.21.15.37:0/2806434421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4960003b80 msgr2=0x7f4960003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.373+0000 7f4982800640 1 --2- 172.21.15.37:0/2806434421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4960003b80 0x7f4960003f80 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f496c00c1c0 tx=0x7f496c01cc20 comp rx=0 tx=0).stop 2024-05-30T07:00:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.373+0000 7f497be00640 1 -- 172.21.15.37:0/2806434421 reap_dead start 2024-05-30T07:00:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.373+0000 7f4982800640 1 -- 172.21.15.37:0/2806434421 shutdown_connections 2024-05-30T07:00:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.373+0000 7f4982800640 1 -- 172.21.15.37:0/2806434421 >> 172.21.15.37:0/2806434421 conn(0x7f497c06bf60 msgr2=0x7f497c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:00:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.373+0000 7f4982800640 1 -- 172.21.15.37:0/2806434421 shutdown_connections 2024-05-30T07:00:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.373+0000 7f4982800640 1 -- 172.21.15.37:0/2806434421 wait complete. 2024-05-30T07:00:58.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.373+0000 7f4982800640 1 Processor -- start 2024-05-30T07:00:58.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.373+0000 7f4982800640 1 -- start start 2024-05-30T07:00:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4982800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4960003b80 0x7f497c1f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4982800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f497c0b37c0 0x7f497c14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4982800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f497c14d680 0x7f497c156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4982800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f497c0b00a0 con 0x7f4960003b80 2024-05-30T07:00:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4982800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f497c0aff20 con 0x7f497c14d680 2024-05-30T07:00:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4982800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f497c13f860 con 0x7f497c0b37c0 2024-05-30T07:00:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f497b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4960003b80 0x7f497c1f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f497b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4960003b80 0x7f497c1f89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55556/0 (socket says 172.21.15.37:55556) 2024-05-30T07:00:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f497b400640 1 -- 172.21.15.37:0/832634987 learned_addr learned my addr 172.21.15.37:0/832634987 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:00:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4973e00640 1 --2- 172.21.15.37:0/832634987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f497c0b37c0 0x7f497c14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f497be00640 1 --2- 172.21.15.37:0/832634987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f497c14d680 0x7f497c156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f497b400640 1 -- 172.21.15.37:0/832634987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f497c0b37c0 msgr2=0x7f497c14d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f497b400640 1 --2- 172.21.15.37:0/832634987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f497c0b37c0 0x7f497c14d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f497b400640 1 -- 172.21.15.37:0/832634987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f497c14d680 msgr2=0x7f497c156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:00:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f497b400640 1 --2- 172.21.15.37:0/832634987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f497c14d680 0x7f497c156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:00:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f497b400640 1 -- 172.21.15.37:0/832634987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c0b41d0 con 0x7f4960003b80 2024-05-30T07:00:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4973e00640 1 --2- 172.21.15.37:0/832634987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f497c0b37c0 0x7f497c14d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f497be00640 1 --2- 172.21.15.37:0/832634987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f497c14d680 0x7f497c156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:00:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f497b400640 1 --2- 172.21.15.37:0/832634987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4960003b80 0x7f497c1f89c0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f496c0ab040 tx=0x7f4960005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4973400640 1 -- 172.21.15.37:0/832634987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c001c20 con 0x7f4960003b80 2024-05-30T07:00:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4973400640 1 -- 172.21.15.37:0/832634987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496c0b3070 con 0x7f4960003b80 2024-05-30T07:00:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4973400640 1 -- 172.21.15.37:0/832634987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c004e60 con 0x7f4960003b80 2024-05-30T07:00:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4982800640 1 -- 172.21.15.37:0/832634987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497c0b44b0 con 0x7f4960003b80 2024-05-30T07:00:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4982800640 1 -- 172.21.15.37:0/832634987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497c1f84a0 con 0x7f4960003b80 2024-05-30T07:00:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4982800640 1 -- 172.21.15.37:0/832634987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f497c1f7fb0 con 0x7f4960003b80 2024-05-30T07:00:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.377+0000 7f4973400640 1 -- 172.21.15.37:0/832634987 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f496c0070d0 con 0x7f4960003b80 2024-05-30T07:00:58.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.381+0000 7f4973400640 1 --2- 172.21.15.37:0/832634987 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f495806a540 0x7f495806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:00:58.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.381+0000 7f4973400640 1 -- 172.21.15.37:0/832634987 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f496c11f160 con 0x7f4960003b80 2024-05-30T07:00:58.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.381+0000 7f4973e00640 1 --2- 172.21.15.37:0/832634987 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f495806a540 0x7f495806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:00:58.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.381+0000 7f4973e00640 1 --2- 172.21.15.37:0/832634987 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f495806a540 0x7f495806ca00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f497c1f7f10 tx=0x7f4964008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:00:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.385+0000 7f4973400640 1 -- 172.21.15.37:0/832634987 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f496c0be070 con 0x7f4960003b80 2024-05-30T07:00:58.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.581+0000 7f4982800640 1 -- 172.21.15.37:0/832634987 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f497c06f0a0 con 0x7f495806a540 2024-05-30T07:00:58.588 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:00:58.589+0000 7f004c600640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T07:00:58.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:00:58.585+0000 7f4973400640 1 -- 172.21.15.37:0/832634987 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7f497c06f0a0 con 0x7f495806a540 2024-05-30T07:00:58.589 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:00:58.589 INFO:teuthology.orchestra.run.smithi037.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T07:00:58.597 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T07:01:00.598 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T07:01:00.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.753+0000 7fee4a000640 1 Processor -- start 2024-05-30T07:01:00.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.753+0000 7fee4a000640 1 -- start start 2024-05-30T07:01:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee4a000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee440b59d0 0x7fee440b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee4a000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fee4415d350 0x7fee44160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee4a000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4415d7e0 0x7fee441607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee4a000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fee440b62f0 con 0x7fee440b59d0 2024-05-30T07:01:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee4a000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fee44142030 con 0x7fee4415d350 2024-05-30T07:01:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee4a000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fee44142310 con 0x7fee4415d7e0 2024-05-30T07:01:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee43400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee440b59d0 0x7fee440b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee43400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee440b59d0 0x7fee440b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55560/0 (socket says 172.21.15.37:55560) 2024-05-30T07:01:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee43400640 1 -- 172.21.15.37:0/571431141 learned_addr learned my addr 172.21.15.37:0/571431141 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee43e00640 1 --2- 172.21.15.37:0/571431141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4415d7e0 0x7fee441607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee3aa00640 1 --2- 172.21.15.37:0/571431141 >> v2:172.21.15.105:3300/0 conn(0x7fee4415d350 0x7fee44160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee43400640 1 -- 172.21.15.37:0/571431141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4415d7e0 msgr2=0x7fee441607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee43400640 1 --2- 172.21.15.37:0/571431141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4415d7e0 0x7fee441607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee43400640 1 -- 172.21.15.37:0/571431141 >> v2:172.21.15.105:3300/0 conn(0x7fee4415d350 msgr2=0x7fee44160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee43400640 1 --2- 172.21.15.37:0/571431141 >> v2:172.21.15.105:3300/0 conn(0x7fee4415d350 0x7fee44160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.757+0000 7fee43400640 1 -- 172.21.15.37:0/571431141 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee441425f0 con 0x7fee440b59d0 2024-05-30T07:01:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee43400640 1 --2- 172.21.15.37:0/571431141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee440b59d0 0x7fee440b5db0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fee34009e50 tx=0x7fee3401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebb5868006796e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:00.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee42a00640 1 -- 172.21.15.37:0/571431141 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee340b4070 con 0x7fee440b59d0 2024-05-30T07:01:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee42a00640 1 -- 172.21.15.37:0/571431141 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee340af400 con 0x7fee440b59d0 2024-05-30T07:01:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee42a00640 1 -- 172.21.15.37:0/571431141 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee340af7d0 con 0x7fee440b59d0 2024-05-30T07:01:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee4a000640 1 -- 172.21.15.37:0/571431141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee440b59d0 msgr2=0x7fee440b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee4a000640 1 --2- 172.21.15.37:0/571431141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee440b59d0 0x7fee440b5db0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fee34009e50 tx=0x7fee3401f1e0 comp rx=0 tx=0).stop 2024-05-30T07:01:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee4a000640 1 -- 172.21.15.37:0/571431141 shutdown_connections 2024-05-30T07:01:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee4a000640 1 --2- 172.21.15.37:0/571431141 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4415d7e0 0x7fee441607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee4a000640 1 --2- 172.21.15.37:0/571431141 >> v2:172.21.15.105:3300/0 conn(0x7fee4415d350 0x7fee44160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee4a000640 1 --2- 172.21.15.37:0/571431141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee440b59d0 0x7fee440b5db0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee4a000640 1 -- 172.21.15.37:0/571431141 >> 172.21.15.37:0/571431141 conn(0x7fee4406bf60 msgr2=0x7fee440b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee4a000640 1 -- 172.21.15.37:0/571431141 shutdown_connections 2024-05-30T07:01:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee4a000640 1 -- 172.21.15.37:0/571431141 wait complete. 2024-05-30T07:01:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee4a000640 1 Processor -- start 2024-05-30T07:01:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee4a000640 1 -- start start 2024-05-30T07:01:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee4a000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee440b59d0 0x7fee4415f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.761+0000 7fee4a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee4415d350 0x7fee441f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee4a000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4415d7e0 0x7fee441f8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee4a000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee4413fe60 con 0x7fee4415d350 2024-05-30T07:01:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee4a000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee4413fce0 con 0x7fee440b59d0 2024-05-30T07:01:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee4a000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fee440aff20 con 0x7fee4415d7e0 2024-05-30T07:01:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee3aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee4415d350 0x7fee441f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee3aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee4415d350 0x7fee441f44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55574/0 (socket says 172.21.15.37:55574) 2024-05-30T07:01:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee3aa00640 1 -- 172.21.15.37:0/636340797 learned_addr learned my addr 172.21.15.37:0/636340797 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee43e00640 1 --2- 172.21.15.37:0/636340797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4415d7e0 0x7fee441f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee43400640 1 --2- 172.21.15.37:0/636340797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee440b59d0 0x7fee4415f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee3aa00640 1 -- 172.21.15.37:0/636340797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4415d7e0 msgr2=0x7fee441f8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee3aa00640 1 --2- 172.21.15.37:0/636340797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4415d7e0 0x7fee441f8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee3aa00640 1 -- 172.21.15.37:0/636340797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee440b59d0 msgr2=0x7fee4415f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee3aa00640 1 --2- 172.21.15.37:0/636340797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee440b59d0 0x7fee4415f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee3aa00640 1 -- 172.21.15.37:0/636340797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee441f49f0 con 0x7fee4415d350 2024-05-30T07:01:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee3aa00640 1 --2- 172.21.15.37:0/636340797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee4415d350 0x7fee441f44b0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fee2c00d800 tx=0x7fee2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee3be00640 1 -- 172.21.15.37:0/636340797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c018020 con 0x7fee4415d350 2024-05-30T07:01:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee3be00640 1 -- 172.21.15.37:0/636340797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee2c0096a0 con 0x7fee4415d350 2024-05-30T07:01:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee4a000640 1 -- 172.21.15.37:0/636340797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee441f4c90 con 0x7fee4415d350 2024-05-30T07:01:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee3be00640 1 -- 172.21.15.37:0/636340797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c009a50 con 0x7fee4415d350 2024-05-30T07:01:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee4a000640 1 -- 172.21.15.37:0/636340797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee441f5250 con 0x7fee4415d350 2024-05-30T07:01:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee4a000640 1 -- 172.21.15.37:0/636340797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee44068bc0 con 0x7fee4415d350 2024-05-30T07:01:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.765+0000 7fee3be00640 1 -- 172.21.15.37:0/636340797 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7fee2c01b020 con 0x7fee4415d350 2024-05-30T07:01:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.769+0000 7fee3be00640 1 --2- 172.21.15.37:0/636340797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee2006a540 0x7fee2006ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.769+0000 7fee3be00640 1 -- 172.21.15.37:0/636340797 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fee2c085fd0 con 0x7fee4415d350 2024-05-30T07:01:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.769+0000 7fee43400640 1 --2- 172.21.15.37:0/636340797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee2006a540 0x7fee2006ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.769+0000 7fee43400640 1 --2- 172.21.15.37:0/636340797 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fee2006a540 0x7fee2006ca00 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fee340b1000 tx=0x7fee340aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:00.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.773+0000 7fee3be00640 1 -- 172.21.15.37:0/636340797 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fee2c022020 con 0x7fee4415d350 2024-05-30T07:01:00.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.965+0000 7fee4a000640 1 -- 172.21.15.37:0/636340797 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee440725b0 con 0x7fee2006a540 2024-05-30T07:01:00.975 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:01:00.977+0000 7f004c600640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T07:01:00.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:00.973+0000 7fee3be00640 1 -- 172.21.15.37:0/636340797 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7fee440725b0 con 0x7fee2006a540 2024-05-30T07:01:00.976 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:01:00.976 INFO:teuthology.orchestra.run.smithi037.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T07:01:00.985 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T07:01:02.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T07:01:03.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.141+0000 7f3ebd200640 1 Processor -- start 2024-05-30T07:01:03.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.141+0000 7f3ebd200640 1 -- start start 2024-05-30T07:01:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3ebd200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3eb809b170 0x7f3eb80af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3ebd200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb809bb80 con 0x7f3eb815c870 2024-05-30T07:01:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3ebd200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eb80cd340 con 0x7f3eb80d03c0 2024-05-30T07:01:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3ebd200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3eb80cd110 con 0x7f3eb809b170 2024-05-30T07:01:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3eb5e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3eb815c870 0x7f3eb80cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53014/0 (socket says 172.21.15.37:53014) 2024-05-30T07:01:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3eb5e00640 1 -- 172.21.15.37:0/976145666 learned_addr learned my addr 172.21.15.37:0/976145666 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3eb6800640 1 --2- 172.21.15.37:0/976145666 >> v2:172.21.15.105:3300/0 conn(0x7f3eb809b170 0x7f3eb80af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3eb5400640 1 -- 172.21.15.37:0/976145666 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530848594 0 0) 0x7f3eb809bb80 con 0x7f3eb815c870 2024-05-30T07:01:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3eb5400640 1 -- 172.21.15.37:0/976145666 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e9c003530 con 0x7f3eb815c870 2024-05-30T07:01:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3eb5400640 1 -- 172.21.15.37:0/976145666 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562390514 0 0) 0x7f3eb80cd340 con 0x7f3eb80d03c0 2024-05-30T07:01:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3eb5400640 1 -- 172.21.15.37:0/976145666 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3eb809bb80 con 0x7f3eb80d03c0 2024-05-30T07:01:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3eb6800640 1 -- 172.21.15.37:0/976145666 >> v1:172.21.15.105:6789/0 conn(0x7f3eb80d03c0 legacy=0x7f3eb809aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3eb5400640 1 -- 172.21.15.37:0/976145666 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2191752298 0 0) 0x7f3e9c003530 con 0x7f3eb815c870 2024-05-30T07:01:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3eb6800640 1 -- 172.21.15.37:0/976145666 >> v1:172.21.15.37:6789/0 conn(0x7f3eb815c870 legacy=0x7f3eb80cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.145+0000 7f3eb6800640 1 -- 172.21.15.37:0/976145666 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb80cd620 con 0x7f3eb809b170 2024-05-30T07:01:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.149+0000 7f3eb6800640 1 --2- 172.21.15.37:0/976145666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb809b170 0x7f3eb80af1e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009d90 tx=0x7f3eb001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5956051e577d788d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.149+0000 7f3eb5400640 1 -- 172.21.15.37:0/976145666 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00b2070 con 0x7f3eb809b170 2024-05-30T07:01:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.149+0000 7f3eb5400640 1 -- 172.21.15.37:0/976145666 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb00a5830 con 0x7f3eb809b170 2024-05-30T07:01:03.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.149+0000 7f3eb5400640 1 -- 172.21.15.37:0/976145666 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00a5c00 con 0x7f3eb809b170 2024-05-30T07:01:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.149+0000 7f3ebd200640 1 -- 172.21.15.37:0/976145666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb809b170 msgr2=0x7f3eb80af1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.149+0000 7f3ebd200640 1 --2- 172.21.15.37:0/976145666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb809b170 0x7f3eb80af1e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009d90 tx=0x7f3eb001c970 comp rx=0 tx=0).stop 2024-05-30T07:01:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.149+0000 7f3ebd200640 1 -- 172.21.15.37:0/976145666 shutdown_connections 2024-05-30T07:01:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.149+0000 7f3ebd200640 1 --2- 172.21.15.37:0/976145666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb809b170 0x7f3eb80af1e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.149+0000 7f3ebd200640 1 -- 172.21.15.37:0/976145666 >> 172.21.15.37:0/976145666 conn(0x7f3eb80b4060 msgr2=0x7f3eb80b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.149+0000 7f3ebd200640 1 -- 172.21.15.37:0/976145666 shutdown_connections 2024-05-30T07:01:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.149+0000 7f3ebd200640 1 -- 172.21.15.37:0/976145666 wait complete. 2024-05-30T07:01:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.149+0000 7f3ebd200640 1 Processor -- start 2024-05-30T07:01:03.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.149+0000 7f3ebd200640 1 -- start start 2024-05-30T07:01:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3ebd200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3eb809b170 0x7f3eb80b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3ebd200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb80d03c0 0x7f3eb8157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3ebd200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eb815c870 0x7f3eb80caac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3ebd200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb80cd990 con 0x7f3eb815c870 2024-05-30T07:01:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3ebd200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3eb809be60 con 0x7f3eb80d03c0 2024-05-30T07:01:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3ebd200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3eb80ce530 con 0x7f3eb809b170 2024-05-30T07:01:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eb6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eb815c870 0x7f3eb80caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eb6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eb815c870 0x7f3eb80caac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55580/0 (socket says 172.21.15.37:55580) 2024-05-30T07:01:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eb6800640 1 -- 172.21.15.37:0/4104189295 learned_addr learned my addr 172.21.15.37:0/4104189295 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:03.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eafe00640 1 --2- 172.21.15.37:0/4104189295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb80d03c0 0x7f3eb8157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eb5e00640 1 --2- 172.21.15.37:0/4104189295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3eb809b170 0x7f3eb80b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eb6800640 1 -- 172.21.15.37:0/4104189295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3eb809b170 msgr2=0x7f3eb80b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eb6800640 1 --2- 172.21.15.37:0/4104189295 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3eb809b170 0x7f3eb80b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eb6800640 1 -- 172.21.15.37:0/4104189295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb80d03c0 msgr2=0x7f3eb8157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eb6800640 1 --2- 172.21.15.37:0/4104189295 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3eb80d03c0 0x7f3eb8157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eb6800640 1 -- 172.21.15.37:0/4104189295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eb80b6bc0 con 0x7f3eb815c870 2024-05-30T07:01:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eb6800640 1 --2- 172.21.15.37:0/4104189295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eb815c870 0x7f3eb80caac0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00b0040 tx=0x7f3eb0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eae000640 1 -- 172.21.15.37:0/4104189295 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00b2040 con 0x7f3eb815c870 2024-05-30T07:01:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eae000640 1 -- 172.21.15.37:0/4104189295 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb00039a0 con 0x7f3eb815c870 2024-05-30T07:01:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3ebd200640 1 -- 172.21.15.37:0/4104189295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eb80b6ea0 con 0x7f3eb815c870 2024-05-30T07:01:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eae000640 1 -- 172.21.15.37:0/4104189295 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0003dd0 con 0x7f3eb815c870 2024-05-30T07:01:03.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3ebd200640 1 -- 172.21.15.37:0/4104189295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eb80b7460 con 0x7f3eb815c870 2024-05-30T07:01:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3ebd200640 1 -- 172.21.15.37:0/4104189295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eb8068bc0 con 0x7f3eb815c870 2024-05-30T07:01:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.153+0000 7f3eae000640 1 -- 172.21.15.37:0/4104189295 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f3eb00c2060 con 0x7f3eb815c870 2024-05-30T07:01:03.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.157+0000 7f3eae000640 1 --2- 172.21.15.37:0/4104189295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e9406a570 0x7f3e9406ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:03.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.157+0000 7f3eae000640 1 -- 172.21.15.37:0/4104189295 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f3eb011fe20 con 0x7f3eb815c870 2024-05-30T07:01:03.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.157+0000 7f3eb5e00640 1 --2- 172.21.15.37:0/4104189295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e9406a570 0x7f3e9406ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:03.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.157+0000 7f3eb5e00640 1 --2- 172.21.15.37:0/4104189295 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3e9406a570 0x7f3e9406ca30 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8005890 tx=0x7f3ea8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:03.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.161+0000 7f3eae000640 1 -- 172.21.15.37:0/4104189295 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3eb0016560 con 0x7f3eb815c870 2024-05-30T07:01:03.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.357+0000 7f3ebd200640 1 -- 172.21.15.37:0/4104189295 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3eb80c5e50 con 0x7f3e9406a570 2024-05-30T07:01:03.366 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:01:03.369+0000 7f004c600640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T07:01:03.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:03.365+0000 7f3eae000640 1 -- 172.21.15.37:0/4104189295 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7f3eb80c5e50 con 0x7f3e9406a570 2024-05-30T07:01:03.367 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:01:03.368 INFO:teuthology.orchestra.run.smithi037.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T07:01:03.376 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T07:01:05.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T07:01:05.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.533+0000 7f901f000640 1 Processor -- start 2024-05-30T07:01:05.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.533+0000 7f901f000640 1 -- start start 2024-05-30T07:01:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.537+0000 7f901f000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f901806f770 0x7f9018166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.537+0000 7f901f000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f901815f310 con 0x7f90180cd440 2024-05-30T07:01:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.537+0000 7f901f000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f901815f5f0 con 0x7f9018155da0 2024-05-30T07:01:05.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.537+0000 7f901f000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f90180b4760 con 0x7f901806f770 2024-05-30T07:01:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.537+0000 7f901d000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f901806f770 0x7f9018166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.537+0000 7f900f400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f90180cd440 0x7f901806f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53024/0 (socket says 172.21.15.37:53024) 2024-05-30T07:01:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.537+0000 7f900f400640 1 -- 172.21.15.37:0/655905586 learned_addr learned my addr 172.21.15.37:0/655905586 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.537+0000 7f901d000640 1 -- 172.21.15.37:0/655905586 >> v1:172.21.15.105:6789/0 conn(0x7f9018155da0 legacy=0x7f90180cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:05.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.537+0000 7f901d000640 1 -- 172.21.15.37:0/655905586 >> v1:172.21.15.37:6789/0 conn(0x7f90180cd440 legacy=0x7f901806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:05.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.537+0000 7f901d000640 1 -- 172.21.15.37:0/655905586 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901815f8d0 con 0x7f901806f770 2024-05-30T07:01:05.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.537+0000 7f9017400640 1 -- 172.21.15.37:0/655905586 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418180684 0 0) 0x7f901815f310 con 0x7f90180cd440 2024-05-30T07:01:05.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901d000640 1 --2- 172.21.15.37:0/655905586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806f770 0x7f9018166570 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f9010009d90 tx=0x7f901001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5729d8899c230dc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f9017400640 1 -- 172.21.15.37:0/655905586 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90100b2070 con 0x7f901806f770 2024-05-30T07:01:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f9017400640 1 -- 172.21.15.37:0/655905586 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90100a5710 con 0x7f901806f770 2024-05-30T07:01:05.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f9017400640 1 -- 172.21.15.37:0/655905586 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90100a5ae0 con 0x7f901806f770 2024-05-30T07:01:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 -- 172.21.15.37:0/655905586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806f770 msgr2=0x7f9018166570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 --2- 172.21.15.37:0/655905586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806f770 0x7f9018166570 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f9010009d90 tx=0x7f901001c850 comp rx=0 tx=0).stop 2024-05-30T07:01:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 -- 172.21.15.37:0/655905586 shutdown_connections 2024-05-30T07:01:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 --2- 172.21.15.37:0/655905586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f901806f770 0x7f9018166570 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 -- 172.21.15.37:0/655905586 >> 172.21.15.37:0/655905586 conn(0x7f901806bf60 msgr2=0x7f90180b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 -- 172.21.15.37:0/655905586 shutdown_connections 2024-05-30T07:01:05.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 -- 172.21.15.37:0/655905586 wait complete. 2024-05-30T07:01:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 Processor -- start 2024-05-30T07:01:05.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 -- start start 2024-05-30T07:01:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f901806f770 0x7f9018154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9018155da0 0x7f901814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f901815c710 0x7f901814f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9018169a70 con 0x7f9018155da0 2024-05-30T07:01:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90181698f0 con 0x7f901806f770 2024-05-30T07:01:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f901f000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9018169bf0 con 0x7f901815c710 2024-05-30T07:01:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.541+0000 7f900f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9018155da0 0x7f901814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f900f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9018155da0 0x7f901814ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55602/0 (socket says 172.21.15.37:55602) 2024-05-30T07:01:05.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f900f400640 1 -- 172.21.15.37:0/654922917 learned_addr learned my addr 172.21.15.37:0/654922917 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f9017e00640 1 --2- 172.21.15.37:0/654922917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f901806f770 0x7f9018154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f901d000640 1 --2- 172.21.15.37:0/654922917 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f901815c710 0x7f901814f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f900f400640 1 -- 172.21.15.37:0/654922917 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f901815c710 msgr2=0x7f901814f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f900f400640 1 --2- 172.21.15.37:0/654922917 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f901815c710 0x7f901814f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f900f400640 1 -- 172.21.15.37:0/654922917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f901806f770 msgr2=0x7f9018154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f900f400640 1 --2- 172.21.15.37:0/654922917 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f901806f770 0x7f9018154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f900f400640 1 -- 172.21.15.37:0/654922917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901815ef10 con 0x7f9018155da0 2024-05-30T07:01:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f900f400640 1 --2- 172.21.15.37:0/654922917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9018155da0 0x7f901814ec20 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f900000c4a0 tx=0x7f900000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f9014c00640 1 -- 172.21.15.37:0/654922917 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000018070 con 0x7f9018155da0 2024-05-30T07:01:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f9014c00640 1 -- 172.21.15.37:0/654922917 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90000074e0 con 0x7f9018155da0 2024-05-30T07:01:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f9014c00640 1 -- 172.21.15.37:0/654922917 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000004a30 con 0x7f9018155da0 2024-05-30T07:01:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f901f000640 1 -- 172.21.15.37:0/654922917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90181564e0 con 0x7f9018155da0 2024-05-30T07:01:05.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f901f000640 1 -- 172.21.15.37:0/654922917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9018156aa0 con 0x7f9018155da0 2024-05-30T07:01:05.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f901f000640 1 -- 172.21.15.37:0/654922917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9018068bc0 con 0x7f9018155da0 2024-05-30T07:01:05.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.545+0000 7f9014c00640 1 -- 172.21.15.37:0/654922917 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f9000004bd0 con 0x7f9018155da0 2024-05-30T07:01:05.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.549+0000 7f9014c00640 1 --2- 172.21.15.37:0/654922917 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ff406a540 0x7f8ff406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:05.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.549+0000 7f9014c00640 1 -- 172.21.15.37:0/654922917 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f9000084ed0 con 0x7f9018155da0 2024-05-30T07:01:05.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.549+0000 7f9017e00640 1 --2- 172.21.15.37:0/654922917 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ff406a540 0x7f8ff406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:05.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.549+0000 7f9017e00640 1 --2- 172.21.15.37:0/654922917 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f8ff406a540 0x7f8ff406ca00 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9008000f70 tx=0x7f9008009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:05.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.553+0000 7f9014c00640 1 -- 172.21.15.37:0/654922917 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9000056ef0 con 0x7f9018155da0 2024-05-30T07:01:05.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.745+0000 7f901f000640 1 -- 172.21.15.37:0/654922917 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90180b6790 con 0x7f8ff406a540 2024-05-30T07:01:05.755 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:01:05.757+0000 7f004c600640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T07:01:05.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:05.753+0000 7f9014c00640 1 -- 172.21.15.37:0/654922917 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7f90180b6790 con 0x7f8ff406a540 2024-05-30T07:01:05.755 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:01:05.756 INFO:teuthology.orchestra.run.smithi037.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T07:01:05.765 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T07:01:06.577 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T07:01:06.580 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T07:01:07.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T07:01:07.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c4400640 1 Processor -- start 2024-05-30T07:01:07.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c4400640 1 -- start start 2024-05-30T07:01:07.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c4400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f30bc0d03c0 0x7f30bc09aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:07.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c4400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30bc0b14b0 0x7f30bc09afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:07.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c4400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30bc09bb80 con 0x7f30bc15c870 2024-05-30T07:01:07.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c4400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f30bc0cd110 con 0x7f30bc0d03c0 2024-05-30T07:01:07.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c4400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f30bc09be60 con 0x7f30bc0b14b0 2024-05-30T07:01:07.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c1000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f30bc0d03c0 0x7f30bc09aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:07.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c1000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f30bc0d03c0 0x7f30bc09aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55676/0 (socket says 172.21.15.37:55676) 2024-05-30T07:01:07.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c1000640 1 -- 172.21.15.37:0/3296301691 learned_addr learned my addr 172.21.15.37:0/3296301691 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:07.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c2400640 1 --2- 172.21.15.37:0/3296301691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30bc0b14b0 0x7f30bc09afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:07.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c1000640 1 -- 172.21.15.37:0/3296301691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30bc0b14b0 msgr2=0x7f30bc09afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:07.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c1000640 1 --2- 172.21.15.37:0/3296301691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30bc0b14b0 0x7f30bc09afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:07.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c1000640 1 -- 172.21.15.37:0/3296301691 >> v1:172.21.15.105:6789/0 conn(0x7f30bc15c870 legacy=0x7f30bc0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:07.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c1000640 1 -- 172.21.15.37:0/3296301691 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc0cd340 con 0x7f30bc0d03c0 2024-05-30T07:01:07.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.925+0000 7f30c2400640 1 --2- 172.21.15.37:0/3296301691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30bc0b14b0 0x7f30bc09afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:07.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30c1000640 1 --2- 172.21.15.37:0/3296301691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30bc0d03c0 0x7f30bc09aa60 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009870 tx=0x7f30a801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9b5b7bd0ba59cb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:07.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30bbe00640 1 -- 172.21.15.37:0/3296301691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a80b2070 con 0x7f30bc0d03c0 2024-05-30T07:01:07.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30bbe00640 1 -- 172.21.15.37:0/3296301691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a80a9070 con 0x7f30bc0d03c0 2024-05-30T07:01:07.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30bbe00640 1 -- 172.21.15.37:0/3296301691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a80ad880 con 0x7f30bc0d03c0 2024-05-30T07:01:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30c4400640 1 -- 172.21.15.37:0/3296301691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30bc0d03c0 msgr2=0x7f30bc09aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30c4400640 1 --2- 172.21.15.37:0/3296301691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30bc0d03c0 0x7f30bc09aa60 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009870 tx=0x7f30a801c560 comp rx=0 tx=0).stop 2024-05-30T07:01:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30c4400640 1 -- 172.21.15.37:0/3296301691 shutdown_connections 2024-05-30T07:01:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30c4400640 1 --2- 172.21.15.37:0/3296301691 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30bc0b14b0 0x7f30bc09afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30c4400640 1 --2- 172.21.15.37:0/3296301691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30bc0d03c0 0x7f30bc09aa60 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30c4400640 1 -- 172.21.15.37:0/3296301691 >> 172.21.15.37:0/3296301691 conn(0x7f30bc0b4060 msgr2=0x7f30bc0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30c4400640 1 -- 172.21.15.37:0/3296301691 shutdown_connections 2024-05-30T07:01:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30c4400640 1 -- 172.21.15.37:0/3296301691 wait complete. 2024-05-30T07:01:07.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30c4400640 1 Processor -- start 2024-05-30T07:01:07.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.929+0000 7f30c4400640 1 -- start start 2024-05-30T07:01:07.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c4400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30bc0b14b0 0x7f30bc0b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:07.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c4400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30bc0d03c0 0x7f30bc0c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:07.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c4400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30bc15c870 0x7f30bc0c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:07.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c4400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc169800 con 0x7f30bc15c870 2024-05-30T07:01:07.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c4400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc0ce530 con 0x7f30bc0d03c0 2024-05-30T07:01:07.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c4400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f30bc169980 con 0x7f30bc0b14b0 2024-05-30T07:01:07.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c2400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30bc15c870 0x7f30bc0c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:07.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c2400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30bc15c870 0x7f30bc0c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55678/0 (socket says 172.21.15.37:55678) 2024-05-30T07:01:07.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c2400640 1 -- 172.21.15.37:0/2556370354 learned_addr learned my addr 172.21.15.37:0/2556370354 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:07.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c1000640 1 --2- 172.21.15.37:0/2556370354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30bc0d03c0 0x7f30bc0c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c1a00640 1 --2- 172.21.15.37:0/2556370354 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30bc0b14b0 0x7f30bc0b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c2400640 1 -- 172.21.15.37:0/2556370354 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30bc0b14b0 msgr2=0x7f30bc0b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c2400640 1 --2- 172.21.15.37:0/2556370354 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30bc0b14b0 0x7f30bc0b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c2400640 1 -- 172.21.15.37:0/2556370354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30bc0d03c0 msgr2=0x7f30bc0c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c2400640 1 --2- 172.21.15.37:0/2556370354 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30bc0d03c0 0x7f30bc0c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c2400640 1 -- 172.21.15.37:0/2556370354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc0cca80 con 0x7f30bc15c870 2024-05-30T07:01:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c2400640 1 --2- 172.21.15.37:0/2556370354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30bc15c870 0x7f30bc0c8440 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7f30b4007e70 tx=0x7f30b400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30b9600640 1 -- 172.21.15.37:0/2556370354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b401a070 con 0x7f30bc15c870 2024-05-30T07:01:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30b9600640 1 -- 172.21.15.37:0/2556370354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b4003bc0 con 0x7f30bc15c870 2024-05-30T07:01:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c4400640 1 -- 172.21.15.37:0/2556370354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30bc0c6dc0 con 0x7f30bc15c870 2024-05-30T07:01:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30b9600640 1 -- 172.21.15.37:0/2556370354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b4004030 con 0x7f30bc15c870 2024-05-30T07:01:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c4400640 1 -- 172.21.15.37:0/2556370354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30bc0c7380 con 0x7f30bc15c870 2024-05-30T07:01:07.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.933+0000 7f30c4400640 1 -- 172.21.15.37:0/2556370354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30bc068bc0 con 0x7f30bc15c870 2024-05-30T07:01:07.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.937+0000 7f30b9600640 1 -- 172.21.15.37:0/2556370354 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f30b401d070 con 0x7f30bc15c870 2024-05-30T07:01:07.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.937+0000 7f30b9600640 1 --2- 172.21.15.37:0/2556370354 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f309c06a540 0x7f309c06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.937+0000 7f30b9600640 1 -- 172.21.15.37:0/2556370354 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f30b4085d20 con 0x7f30bc15c870 2024-05-30T07:01:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.937+0000 7f30c1a00640 1 --2- 172.21.15.37:0/2556370354 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f309c06a540 0x7f309c06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.937+0000 7f30c1a00640 1 --2- 172.21.15.37:0/2556370354 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f309c06a540 0x7f309c06ca00 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f30b0000f70 tx=0x7f30b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:07.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:07.941+0000 7f30b9600640 1 -- 172.21.15.37:0/2556370354 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f30b4010070 con 0x7f30bc15c870 2024-05-30T07:01:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:08.141+0000 7f30c4400640 1 -- 172.21.15.37:0/2556370354 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30bc0b0fa0 con 0x7f309c06a540 2024-05-30T07:01:08.149 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:01:08.153+0000 7f004c600640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T07:01:08.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:08.149+0000 7f30b9600640 1 -- 172.21.15.37:0/2556370354 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7f30bc0b0fa0 con 0x7f309c06a540 2024-05-30T07:01:08.150 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:01:08.150 INFO:teuthology.orchestra.run.smithi037.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T07:01:08.158 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T07:01:10.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T07:01:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.317+0000 7f2e3aa00640 1 Processor -- start 2024-05-30T07:01:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.317+0000 7f2e3aa00640 1 -- start start 2024-05-30T07:01:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e3aa00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e340b59d0 0x7f2e340b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e3aa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3415d350 0x7f2e34160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e3aa00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2e3415d7b0 0x7f2e341607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e3aa00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2e340b62f0 con 0x7f2e340b59d0 2024-05-30T07:01:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e3aa00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2e34142030 con 0x7f2e3415d7b0 2024-05-30T07:01:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e3aa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2e34142310 con 0x7f2e3415d350 2024-05-30T07:01:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e33e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e340b59d0 0x7f2e340b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e33e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2e340b59d0 0x7f2e340b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55684/0 (socket says 172.21.15.37:55684) 2024-05-30T07:01:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e33e00640 1 -- 172.21.15.37:0/4144408390 learned_addr learned my addr 172.21.15.37:0/4144408390 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e38a00640 1 --2- 172.21.15.37:0/4144408390 >> v2:172.21.15.105:3300/0 conn(0x7f2e3415d7b0 0x7f2e341607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e2be00640 1 --2- 172.21.15.37:0/4144408390 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3415d350 0x7f2e34160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e33e00640 1 -- 172.21.15.37:0/4144408390 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3415d350 msgr2=0x7f2e34160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e33e00640 1 --2- 172.21.15.37:0/4144408390 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3415d350 0x7f2e34160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e33e00640 1 -- 172.21.15.37:0/4144408390 >> v2:172.21.15.105:3300/0 conn(0x7f2e3415d7b0 msgr2=0x7f2e341607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e33e00640 1 --2- 172.21.15.37:0/4144408390 >> v2:172.21.15.105:3300/0 conn(0x7f2e3415d7b0 0x7f2e341607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e33e00640 1 -- 172.21.15.37:0/4144408390 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e341425f0 con 0x7f2e340b59d0 2024-05-30T07:01:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e38a00640 1 --2- 172.21.15.37:0/4144408390 >> v2:172.21.15.105:3300/0 conn(0x7f2e3415d7b0 0x7f2e341607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:01:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e2be00640 1 --2- 172.21.15.37:0/4144408390 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3415d350 0x7f2e34160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:01:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.321+0000 7f2e33e00640 1 --2- 172.21.15.37:0/4144408390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e340b59d0 0x7f2e340b5db0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f2e3415a7d0 tx=0x7f2e2401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14194f00c2f4482 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e33400640 1 -- 172.21.15.37:0/4144408390 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e240b5070 con 0x7f2e340b59d0 2024-05-30T07:01:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e33400640 1 -- 172.21.15.37:0/4144408390 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e240a89d0 con 0x7f2e340b59d0 2024-05-30T07:01:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e33400640 1 -- 172.21.15.37:0/4144408390 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e240a8da0 con 0x7f2e340b59d0 2024-05-30T07:01:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 -- 172.21.15.37:0/4144408390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e340b59d0 msgr2=0x7f2e340b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 --2- 172.21.15.37:0/4144408390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e340b59d0 0x7f2e340b5db0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f2e3415a7d0 tx=0x7f2e2401ed10 comp rx=0 tx=0).stop 2024-05-30T07:01:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 -- 172.21.15.37:0/4144408390 shutdown_connections 2024-05-30T07:01:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 --2- 172.21.15.37:0/4144408390 >> v2:172.21.15.105:3300/0 conn(0x7f2e3415d7b0 0x7f2e341607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 --2- 172.21.15.37:0/4144408390 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3415d350 0x7f2e34160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 --2- 172.21.15.37:0/4144408390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e340b59d0 0x7f2e340b5db0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 -- 172.21.15.37:0/4144408390 >> 172.21.15.37:0/4144408390 conn(0x7f2e3406bf60 msgr2=0x7f2e340b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 -- 172.21.15.37:0/4144408390 shutdown_connections 2024-05-30T07:01:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 -- 172.21.15.37:0/4144408390 wait complete. 2024-05-30T07:01:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 Processor -- start 2024-05-30T07:01:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 -- start start 2024-05-30T07:01:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e340b59d0 0x7f2e341f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3415d350 0x7f2e34156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3415d7b0 0x7f2e3415b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3413fe60 con 0x7f2e340b59d0 2024-05-30T07:01:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3413fce0 con 0x7f2e3415d350 2024-05-30T07:01:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e3aa00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2e340aff20 con 0x7f2e3415d7b0 2024-05-30T07:01:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e33e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e340b59d0 0x7f2e341f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e33e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e340b59d0 0x7f2e341f3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55688/0 (socket says 172.21.15.37:55688) 2024-05-30T07:01:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e33e00640 1 -- 172.21.15.37:0/1169329913 learned_addr learned my addr 172.21.15.37:0/1169329913 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e2be00640 1 --2- 172.21.15.37:0/1169329913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3415d350 0x7f2e34156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.325+0000 7f2e38a00640 1 --2- 172.21.15.37:0/1169329913 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3415d7b0 0x7f2e3415b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e33e00640 1 -- 172.21.15.37:0/1169329913 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3415d7b0 msgr2=0x7f2e3415b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e33e00640 1 --2- 172.21.15.37:0/1169329913 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3415d7b0 0x7f2e3415b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e33e00640 1 -- 172.21.15.37:0/1169329913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3415d350 msgr2=0x7f2e34156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e33e00640 1 --2- 172.21.15.37:0/1169329913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3415d350 0x7f2e34156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e33e00640 1 -- 172.21.15.37:0/1169329913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3415bdb0 con 0x7f2e340b59d0 2024-05-30T07:01:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e38a00640 1 --2- 172.21.15.37:0/1169329913 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e3415d7b0 0x7f2e3415b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e2be00640 1 --2- 172.21.15.37:0/1169329913 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e3415d350 0x7f2e34156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e33e00640 1 --2- 172.21.15.37:0/1169329913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e340b59d0 0x7f2e341f3520 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f2e240b3040 tx=0x7f2e2401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e30c00640 1 -- 172.21.15.37:0/1169329913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e240c0070 con 0x7f2e340b59d0 2024-05-30T07:01:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e30c00640 1 -- 172.21.15.37:0/1169329913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e240b08c0 con 0x7f2e340b59d0 2024-05-30T07:01:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e3aa00640 1 -- 172.21.15.37:0/1169329913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3413b910 con 0x7f2e340b59d0 2024-05-30T07:01:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e30c00640 1 -- 172.21.15.37:0/1169329913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e240b5040 con 0x7f2e340b59d0 2024-05-30T07:01:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e3aa00640 1 -- 172.21.15.37:0/1169329913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3413bed0 con 0x7f2e340b59d0 2024-05-30T07:01:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e3aa00640 1 -- 172.21.15.37:0/1169329913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e34068bc0 con 0x7f2e340b59d0 2024-05-30T07:01:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e30c00640 1 -- 172.21.15.37:0/1169329913 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f2e240c3070 con 0x7f2e340b59d0 2024-05-30T07:01:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e30c00640 1 --2- 172.21.15.37:0/1169329913 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2e1006a540 0x7f2e1006ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e30c00640 1 -- 172.21.15.37:0/1169329913 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f2e24122ab0 con 0x7f2e340b59d0 2024-05-30T07:01:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.329+0000 7f2e2be00640 1 --2- 172.21.15.37:0/1169329913 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2e1006a540 0x7f2e1006ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.333+0000 7f2e2be00640 1 --2- 172.21.15.37:0/1169329913 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f2e1006a540 0x7f2e1006ca00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2e3415c2c0 tx=0x7f2e1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.333+0000 7f2e30c00640 1 -- 172.21.15.37:0/1169329913 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2e24018870 con 0x7f2e340b59d0 2024-05-30T07:01:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.537+0000 7f2e3aa00640 1 -- 172.21.15.37:0/1169329913 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "force": true, "vol_name": "cephfs", "sub_name": "sv1", "snap_name": "ss1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e340b3230 con 0x7f2e1006a540 2024-05-30T07:01:10.545 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-05-30T07:01:10.548+0000 7f004c600640 -1 mgr.server reply reply (11) Resource temporarily unavailable snapshot 'ss1' has pending clones 2024-05-30T07:01:10.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:10.545+0000 7f2e30c00640 1 -- 172.21.15.37:0/1169329913 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: -11 snapshot 'ss1' has pending clones) ==== 41+0+0 (secure 0 0 0) 0x7f2e340b3230 con 0x7f2e1006a540 2024-05-30T07:01:10.545 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:01:10.546 INFO:teuthology.orchestra.run.smithi037.stderr:Error EAGAIN: snapshot 'ss1' has pending clones 2024-05-30T07:01:10.554 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-05-30T07:01:10.558 INFO:tasks.cephfs_test_runner:Test that both the progress bars, that are printed for all 7 clone ... ERROR 2024-05-30T07:01:10.558 INFO:tasks.cephfs_test_runner: 2024-05-30T07:01:10.558 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner:ERROR: test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner:Test that both the progress bars, that are printed for all 7 clone 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks/cephfs/test_volumes.py", line 7795, in tearDown 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner: self.loop_cmd_if_eagain('fs subvolume snapshot rm --force ' 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks/cephfs/test_volumes.py", line 7749, in loop_cmd_if_eagain 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner: raise RuntimeError(f'This cmd failed 10 times: {cmdargs}') 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner:RuntimeError: This cmd failed 10 times: fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner: 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner:Ran 8 tests in 1109.654s 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner: 2024-05-30T07:01:10.559 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-05-30T07:01:10.560 INFO:tasks.cephfs_test_runner: 2024-05-30T07:01:10.560 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-30T07:01:10.560 INFO:tasks.cephfs_test_runner:ERROR: test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T07:01:10.560 INFO:tasks.cephfs_test_runner:Test that both the progress bars, that are printed for all 7 clone 2024-05-30T07:01:10.560 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-30T07:01:10.560 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-30T07:01:10.560 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks/cephfs/test_volumes.py", line 7795, in tearDown 2024-05-30T07:01:10.560 INFO:tasks.cephfs_test_runner: self.loop_cmd_if_eagain('fs subvolume snapshot rm --force ' 2024-05-30T07:01:10.560 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks/cephfs/test_volumes.py", line 7749, in loop_cmd_if_eagain 2024-05-30T07:01:10.560 INFO:tasks.cephfs_test_runner: raise RuntimeError(f'This cmd failed 10 times: {cmdargs}') 2024-05-30T07:01:10.560 INFO:tasks.cephfs_test_runner:RuntimeError: This cmd failed 10 times: fs subvolume snapshot rm --force --format json cephfs sv1 ss1 2024-05-30T07:01:10.560 INFO:tasks.cephfs_test_runner: 2024-05-30T07:01:10.561 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T07:01:10.747 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=65a25681882242838764e904aab13f9c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_9ed025fbf4406fb54980a0647506b15895b6d863/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter) 2024-05-30T07:01:10.749 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-30T07:01:10.758 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-30T07:01:10.772 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-30T07:01:10.772 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T07:01:10.772 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T07:01:10.787 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T07:01:10.787 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T07:01:10.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T07:01:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b21200640 1 Processor -- start 2024-05-30T07:01:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b21200640 1 -- start start 2024-05-30T07:01:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b21200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0b1c09b9a0 0x7f0b1c1625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b21200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b1c162f00 con 0x7f0b1c162ae0 2024-05-30T07:01:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b21200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b1c09abe0 con 0x7f0b1c15e930 2024-05-30T07:01:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b21200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0b1c09aec0 con 0x7f0b1c09b9a0 2024-05-30T07:01:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b19e00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f0b1c15e930 0x7f0b1c0d1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:48766/0 (socket says 172.21.15.37:48766) 2024-05-30T07:01:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b19e00640 1 -- 172.21.15.37:0/2942133639 learned_addr learned my addr 172.21.15.37:0/2942133639 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:11.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b1a800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0b1c162ae0 0x7f0b1c0ccc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40996/0 (socket says 172.21.15.37:40996) 2024-05-30T07:01:11.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b13e00640 1 --2- 172.21.15.37:0/2942133639 >> v2:172.21.15.105:3300/0 conn(0x7f0b1c09b9a0 0x7f0b1c1625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b19400640 1 -- 172.21.15.37:0/2942133639 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2764941234 0 0) 0x7f0b1c162f00 con 0x7f0b1c162ae0 2024-05-30T07:01:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b19400640 1 -- 172.21.15.37:0/2942133639 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b00003530 con 0x7f0b1c162ae0 2024-05-30T07:01:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b19400640 1 -- 172.21.15.37:0/2942133639 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3659702351 0 0) 0x7f0b1c09abe0 con 0x7f0b1c15e930 2024-05-30T07:01:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b19400640 1 -- 172.21.15.37:0/2942133639 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b1c162f00 con 0x7f0b1c15e930 2024-05-30T07:01:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b13e00640 1 -- 172.21.15.37:0/2942133639 >> v1:172.21.15.105:6789/0 conn(0x7f0b1c15e930 legacy=0x7f0b1c0d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b13e00640 1 -- 172.21.15.37:0/2942133639 >> v1:172.21.15.37:6789/0 conn(0x7f0b1c162ae0 legacy=0x7f0b1c0ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.029+0000 7f0b13e00640 1 -- 172.21.15.37:0/2942133639 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1c09b1a0 con 0x7f0b1c09b9a0 2024-05-30T07:01:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.033+0000 7f0b13e00640 1 --2- 172.21.15.37:0/2942133639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c09b9a0 0x7f0b1c1625a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f0b040097c0 tx=0x7f0b0401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62a28e2a31be438f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.033+0000 7f0b19400640 1 -- 172.21.15.37:0/2942133639 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b040b1070 con 0x7f0b1c09b9a0 2024-05-30T07:01:11.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.033+0000 7f0b19400640 1 -- 172.21.15.37:0/2942133639 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b040ac5f0 con 0x7f0b1c09b9a0 2024-05-30T07:01:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.033+0000 7f0b19400640 1 -- 172.21.15.37:0/2942133639 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b040ac9c0 con 0x7f0b1c09b9a0 2024-05-30T07:01:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.033+0000 7f0b21200640 1 -- 172.21.15.37:0/2942133639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c09b9a0 msgr2=0x7f0b1c1625a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.033+0000 7f0b21200640 1 --2- 172.21.15.37:0/2942133639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c09b9a0 0x7f0b1c1625a0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f0b040097c0 tx=0x7f0b0401c4a0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.033+0000 7f0b21200640 1 -- 172.21.15.37:0/2942133639 shutdown_connections 2024-05-30T07:01:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.033+0000 7f0b21200640 1 --2- 172.21.15.37:0/2942133639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c09b9a0 0x7f0b1c1625a0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.033+0000 7f0b21200640 1 -- 172.21.15.37:0/2942133639 >> 172.21.15.37:0/2942133639 conn(0x7f0b1c0b4100 msgr2=0x7f0b1c0b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:11.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.033+0000 7f0b21200640 1 -- 172.21.15.37:0/2942133639 shutdown_connections 2024-05-30T07:01:11.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.033+0000 7f0b21200640 1 -- 172.21.15.37:0/2942133639 wait complete. 2024-05-30T07:01:11.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b21200640 1 Processor -- start 2024-05-30T07:01:11.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b21200640 1 -- start start 2024-05-30T07:01:11.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b21200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b1c09b9a0 0x7f0b1c0b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b21200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c15e930 0x7f0b1c155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b21200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1c162ae0 0x7f0b1c0b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b21200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c06dc40 con 0x7f0b1c162ae0 2024-05-30T07:01:11.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b21200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1c0cd780 con 0x7f0b1c15e930 2024-05-30T07:01:11.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b21200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0b1c06ddc0 con 0x7f0b1c09b9a0 2024-05-30T07:01:11.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b1a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1c162ae0 0x7f0b1c0b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b1a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1c162ae0 0x7f0b1c0b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55704/0 (socket says 172.21.15.37:55704) 2024-05-30T07:01:11.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b1a800640 1 -- 172.21.15.37:0/461750417 learned_addr learned my addr 172.21.15.37:0/461750417 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:11.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b13e00640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c15e930 0x7f0b1c155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b19e00640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b1c09b9a0 0x7f0b1c0b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b1a800640 1 -- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b1c09b9a0 msgr2=0x7f0b1c0b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b1a800640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b1c09b9a0 0x7f0b1c0b79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b1a800640 1 -- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c15e930 msgr2=0x7f0b1c155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b1a800640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c15e930 0x7f0b1c155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b1a800640 1 -- 172.21.15.37:0/461750417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b1c1561a0 con 0x7f0b1c162ae0 2024-05-30T07:01:11.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b1a800640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1c162ae0 0x7f0b1c0b2fc0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400c7b0 tx=0x7f0b1400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:11.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b12000640 1 -- 172.21.15.37:0/461750417 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b14017070 con 0x7f0b1c162ae0 2024-05-30T07:01:11.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b12000640 1 -- 172.21.15.37:0/461750417 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b1400a640 con 0x7f0b1c162ae0 2024-05-30T07:01:11.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b21200640 1 -- 172.21.15.37:0/461750417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1c0b6220 con 0x7f0b1c162ae0 2024-05-30T07:01:11.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b12000640 1 -- 172.21.15.37:0/461750417 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400a9f0 con 0x7f0b1c162ae0 2024-05-30T07:01:11.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b21200640 1 -- 172.21.15.37:0/461750417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b1c0b71f0 con 0x7f0b1c162ae0 2024-05-30T07:01:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.037+0000 7f0b21200640 1 -- 172.21.15.37:0/461750417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b1c068b20 con 0x7f0b1c162ae0 2024-05-30T07:01:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.041+0000 7f0b12000640 1 -- 172.21.15.37:0/461750417 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f0b1401a070 con 0x7f0b1c162ae0 2024-05-30T07:01:11.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.041+0000 7f0b12000640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0af806a540 0x7f0af806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.041+0000 7f0b12000640 1 -- 172.21.15.37:0/461750417 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f0b140850d0 con 0x7f0b1c162ae0 2024-05-30T07:01:11.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.041+0000 7f0b19e00640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0af806a540 0x7f0af806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.041+0000 7f0b19e00640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0af806a540 0x7f0af806ca00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c000f70 tx=0x7f0b0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:11.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.045+0000 7f0b12000640 1 -- 172.21.15.37:0/461750417 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b14056aa0 con 0x7f0b1c162ae0 2024-05-30T07:01:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.209+0000 7f0b21200640 1 -- 172.21.15.37:0/461750417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b1c06e350 con 0x7f0b1c162ae0 2024-05-30T07:01:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.213+0000 7f0b12000640 1 -- 172.21.15.37:0/461750417 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16842 (secure 0 0 0) 0x7f0b1405ada0 con 0x7f0b1c162ae0 2024-05-30T07:01:11.214 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:01:11.214 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":130,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:59:54.404205+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:59:05.805744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-05-30T06:59:06.396391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.26","mappings":[{"from":2,"to":0}]},{"pgid":"19.3c","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T07:01:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.213+0000 7f0b21200640 1 -- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0af806a540 msgr2=0x7f0af806ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.213+0000 7f0b21200640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0af806a540 0x7f0af806ca00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c000f70 tx=0x7f0b0c009040 comp rx=0 tx=0).stop 2024-05-30T07:01:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.213+0000 7f0b21200640 1 -- 172.21.15.37:0/461750417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1c162ae0 msgr2=0x7f0b1c0b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.213+0000 7f0b21200640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1c162ae0 0x7f0b1c0b2fc0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400c7b0 tx=0x7f0b1400cc70 comp rx=0 tx=0).stop 2024-05-30T07:01:11.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.213+0000 7f0b21200640 1 -- 172.21.15.37:0/461750417 shutdown_connections 2024-05-30T07:01:11.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.213+0000 7f0b21200640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b1c162ae0 0x7f0b1c0b2fc0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.213+0000 7f0b21200640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0af806a540 0x7f0af806ca00 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.213+0000 7f0b21200640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b1c15e930 0x7f0b1c155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.213+0000 7f0b21200640 1 --2- 172.21.15.37:0/461750417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b1c09b9a0 0x7f0b1c0b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.213+0000 7f0b21200640 1 -- 172.21.15.37:0/461750417 >> 172.21.15.37:0/461750417 conn(0x7f0b1c0b4100 msgr2=0x7f0b1c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.213+0000 7f0b21200640 1 -- 172.21.15.37:0/461750417 shutdown_connections 2024-05-30T07:01:11.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.213+0000 7f0b21200640 1 -- 172.21.15.37:0/461750417 wait complete. 2024-05-30T07:01:11.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-30T06:41:58.665774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-30T06:59:05.805744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2024-05-30T06:59:06.396391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-30T07:01:11.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-30T07:01:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c70c00640 1 Processor -- start 2024-05-30T07:01:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c70c00640 1 -- start start 2024-05-30T07:01:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c70c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c6c15ebc0 0x7f5c6c0d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c70c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c6c09b800 0x7f5c6c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c70c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c6c0d0840 con 0x7f5c6c06dcf0 2024-05-30T07:01:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c70c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5c6c09bce0 con 0x7f5c6c15ebc0 2024-05-30T07:01:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c70c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5c6c0d0ae0 con 0x7f5c6c09b800 2024-05-30T07:01:11.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c69e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c6c15ebc0 0x7f5c6c0d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c69e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c6c15ebc0 0x7f5c6c0d15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55716/0 (socket says 172.21.15.37:55716) 2024-05-30T07:01:11.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c69e00640 1 -- 172.21.15.37:0/2871425023 learned_addr learned my addr 172.21.15.37:0/2871425023 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:11.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c61400640 1 --2- 172.21.15.37:0/2871425023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c6c09b800 0x7f5c6c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c69e00640 1 -- 172.21.15.37:0/2871425023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c6c09b800 msgr2=0x7f5c6c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:11.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c69e00640 1 --2- 172.21.15.37:0/2871425023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c6c09b800 0x7f5c6c06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c69e00640 1 -- 172.21.15.37:0/2871425023 >> v1:172.21.15.105:6789/0 conn(0x7f5c6c06dcf0 legacy=0x7f5c6c09aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:11.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c69e00640 1 -- 172.21.15.37:0/2871425023 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6c0d0dc0 con 0x7f5c6c15ebc0 2024-05-30T07:01:11.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.381+0000 7f5c61400640 1 --2- 172.21.15.37:0/2871425023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c6c09b800 0x7f5c6c06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:01:11.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.385+0000 7f5c69e00640 1 --2- 172.21.15.37:0/2871425023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6c15ebc0 0x7f5c6c0d15c0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009870 tx=0x7f5c5c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611d22e87b4a7aeb server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.385+0000 7f5c69400640 1 -- 172.21.15.37:0/2871425023 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c0b0070 con 0x7f5c6c15ebc0 2024-05-30T07:01:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.385+0000 7f5c69400640 1 -- 172.21.15.37:0/2871425023 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c5c0ab600 con 0x7f5c6c15ebc0 2024-05-30T07:01:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.385+0000 7f5c69400640 1 -- 172.21.15.37:0/2871425023 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c0ab9d0 con 0x7f5c6c15ebc0 2024-05-30T07:01:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.385+0000 7f5c70c00640 1 -- 172.21.15.37:0/2871425023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6c15ebc0 msgr2=0x7f5c6c0d15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.385+0000 7f5c70c00640 1 --2- 172.21.15.37:0/2871425023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6c15ebc0 0x7f5c6c0d15c0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009870 tx=0x7f5c5c01c520 comp rx=0 tx=0).stop 2024-05-30T07:01:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.385+0000 7f5c70c00640 1 -- 172.21.15.37:0/2871425023 shutdown_connections 2024-05-30T07:01:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.385+0000 7f5c70c00640 1 --2- 172.21.15.37:0/2871425023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c6c09b800 0x7f5c6c06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.385+0000 7f5c70c00640 1 --2- 172.21.15.37:0/2871425023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6c15ebc0 0x7f5c6c0d15c0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.385+0000 7f5c70c00640 1 -- 172.21.15.37:0/2871425023 >> 172.21.15.37:0/2871425023 conn(0x7f5c6c0b4060 msgr2=0x7f5c6c0b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.385+0000 7f5c70c00640 1 -- 172.21.15.37:0/2871425023 shutdown_connections 2024-05-30T07:01:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.385+0000 7f5c70c00640 1 -- 172.21.15.37:0/2871425023 wait complete. 2024-05-30T07:01:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c70c00640 1 Processor -- start 2024-05-30T07:01:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c70c00640 1 -- start start 2024-05-30T07:01:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c70c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c6c06dcf0 0x7f5c6c14c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c70c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6c09b800 0x7f5c6c0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c70c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c6c15ebc0 0x7f5c6c15c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c70c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c09b2f0 con 0x7f5c6c09b800 2024-05-30T07:01:11.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c70c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c09b170 con 0x7f5c6c06dcf0 2024-05-30T07:01:11.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c70c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5c6c0cd3d0 con 0x7f5c6c15ebc0 2024-05-30T07:01:11.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c61400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6c09b800 0x7f5c6c0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c61400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6c09b800 0x7f5c6c0b1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55720/0 (socket says 172.21.15.37:55720) 2024-05-30T07:01:11.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c61400640 1 -- 172.21.15.37:0/2997843650 learned_addr learned my addr 172.21.15.37:0/2997843650 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:11.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c69e00640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c6c06dcf0 0x7f5c6c14c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c6a800640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c6c15ebc0 0x7f5c6c15c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c61400640 1 -- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c6c15ebc0 msgr2=0x7f5c6c15c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c61400640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c6c15ebc0 0x7f5c6c15c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c61400640 1 -- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c6c06dcf0 msgr2=0x7f5c6c14c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c61400640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c6c06dcf0 0x7f5c6c14c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c61400640 1 -- 172.21.15.37:0/2997843650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6c158dc0 con 0x7f5c6c09b800 2024-05-30T07:01:11.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c61400640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6c09b800 0x7f5c6c0b1240 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400cf90 tx=0x7f5c5400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:11.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c62a00640 1 -- 172.21.15.37:0/2997843650 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5401a070 con 0x7f5c6c09b800 2024-05-30T07:01:11.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c62a00640 1 -- 172.21.15.37:0/2997843650 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c5400d840 con 0x7f5c6c09b800 2024-05-30T07:01:11.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c62a00640 1 -- 172.21.15.37:0/2997843650 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c5400dc10 con 0x7f5c6c09b800 2024-05-30T07:01:11.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c70c00640 1 -- 172.21.15.37:0/2997843650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6c1590a0 con 0x7f5c6c09b800 2024-05-30T07:01:11.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c70c00640 1 -- 172.21.15.37:0/2997843650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c6c159660 con 0x7f5c6c09b800 2024-05-30T07:01:11.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.389+0000 7f5c70c00640 1 -- 172.21.15.37:0/2997843650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c6c068bc0 con 0x7f5c6c09b800 2024-05-30T07:01:11.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.393+0000 7f5c62a00640 1 -- 172.21.15.37:0/2997843650 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f5c5401d070 con 0x7f5c6c09b800 2024-05-30T07:01:11.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.393+0000 7f5c62a00640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5c4806a540 0x7f5c4806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.393+0000 7f5c62a00640 1 -- 172.21.15.37:0/2997843650 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f5c54086300 con 0x7f5c6c09b800 2024-05-30T07:01:11.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.393+0000 7f5c69e00640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5c4806a540 0x7f5c4806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.393+0000 7f5c69e00640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5c4806a540 0x7f5c4806ca00 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0ad000 tx=0x7f5c5c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:11.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.397+0000 7f5c62a00640 1 -- 172.21.15.37:0/2997843650 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5c54057cd0 con 0x7f5c6c09b800 2024-05-30T07:01:11.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.561+0000 7f5c70c00640 1 -- 172.21.15.37:0/2997843650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5c6c0b1eb0 con 0x7f5c6c09b800 2024-05-30T07:01:11.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.561+0000 7f5c62a00640 1 -- 172.21.15.37:0/2997843650 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v130) ==== 93+0+10 (secure 0 0 0) 0x7f5c5405bfd0 con 0x7f5c6c09b800 2024-05-30T07:01:11.565 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-05-30T07:01:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.565+0000 7f5c70c00640 1 -- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5c4806a540 msgr2=0x7f5c4806ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.565+0000 7f5c70c00640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5c4806a540 0x7f5c4806ca00 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0ad000 tx=0x7f5c5c0a6000 comp rx=0 tx=0).stop 2024-05-30T07:01:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.565+0000 7f5c70c00640 1 -- 172.21.15.37:0/2997843650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6c09b800 msgr2=0x7f5c6c0b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.565+0000 7f5c70c00640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6c09b800 0x7f5c6c0b1240 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400cf90 tx=0x7f5c5400a7d0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.565+0000 7f5c70c00640 1 -- 172.21.15.37:0/2997843650 shutdown_connections 2024-05-30T07:01:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.565+0000 7f5c70c00640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c6c15ebc0 0x7f5c6c15c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.565+0000 7f5c70c00640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6c09b800 0x7f5c6c0b1240 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.565+0000 7f5c70c00640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f5c4806a540 0x7f5c4806ca00 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.565+0000 7f5c70c00640 1 --2- 172.21.15.37:0/2997843650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c6c06dcf0 0x7f5c6c14c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.565+0000 7f5c70c00640 1 -- 172.21.15.37:0/2997843650 >> 172.21.15.37:0/2997843650 conn(0x7f5c6c0b4060 msgr2=0x7f5c6c157cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.565+0000 7f5c70c00640 1 -- 172.21.15.37:0/2997843650 shutdown_connections 2024-05-30T07:01:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.565+0000 7f5c70c00640 1 -- 172.21.15.37:0/2997843650 wait complete. 2024-05-30T07:01:11.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-30T07:01:11.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6264000640 1 Processor -- start 2024-05-30T07:01:11.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6264000640 1 -- start start 2024-05-30T07:01:11.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6264000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f625c0b59d0 0x7f625c0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6264000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f625c15d350 0x7f625c160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6264000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f625c0b62f0 con 0x7f625c15d7b0 2024-05-30T07:01:11.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6264000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f625c142030 con 0x7f625c15d350 2024-05-30T07:01:11.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6264000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f625c142310 con 0x7f625c0b59d0 2024-05-30T07:01:11.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6260c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f625c15d350 0x7f625c160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6262000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f625c15d7b0 0x7f625c1607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41000/0 (socket says 172.21.15.37:41000) 2024-05-30T07:01:11.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6262000640 1 -- 172.21.15.37:0/2384012587 learned_addr learned my addr 172.21.15.37:0/2384012587 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:11.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6261600640 1 --2- 172.21.15.37:0/2384012587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f625c0b59d0 0x7f625c0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6260c00640 1 -- 172.21.15.37:0/2384012587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f625c0b59d0 msgr2=0x7f625c0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:11.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6260c00640 1 --2- 172.21.15.37:0/2384012587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f625c0b59d0 0x7f625c0b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6260c00640 1 -- 172.21.15.37:0/2384012587 >> v1:172.21.15.37:6789/0 conn(0x7f625c15d7b0 legacy=0x7f625c1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.729+0000 7f6260c00640 1 -- 172.21.15.37:0/2384012587 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c1425f0 con 0x7f625c15d350 2024-05-30T07:01:11.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.733+0000 7f6260c00640 1 --2- 172.21.15.37:0/2384012587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f625c15d350 0x7f625c160280 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f62480097c0 tx=0x7f624801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9412e83c7efc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:11.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.733+0000 7f625be00640 1 -- 172.21.15.37:0/2384012587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62480b5070 con 0x7f625c15d350 2024-05-30T07:01:11.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.733+0000 7f625be00640 1 -- 172.21.15.37:0/2384012587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62480a8990 con 0x7f625c15d350 2024-05-30T07:01:11.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.733+0000 7f625be00640 1 -- 172.21.15.37:0/2384012587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62480a8d60 con 0x7f625c15d350 2024-05-30T07:01:11.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.733+0000 7f6264000640 1 -- 172.21.15.37:0/2384012587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f625c15d350 msgr2=0x7f625c160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.733+0000 7f6264000640 1 --2- 172.21.15.37:0/2384012587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f625c15d350 0x7f625c160280 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f62480097c0 tx=0x7f624801ec90 comp rx=0 tx=0).stop 2024-05-30T07:01:11.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.733+0000 7f6264000640 1 -- 172.21.15.37:0/2384012587 shutdown_connections 2024-05-30T07:01:11.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.733+0000 7f6264000640 1 --2- 172.21.15.37:0/2384012587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f625c15d350 0x7f625c160280 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.733+0000 7f6264000640 1 --2- 172.21.15.37:0/2384012587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f625c0b59d0 0x7f625c0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.733+0000 7f6264000640 1 -- 172.21.15.37:0/2384012587 >> 172.21.15.37:0/2384012587 conn(0x7f625c06bf60 msgr2=0x7f625c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:11.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.733+0000 7f6264000640 1 -- 172.21.15.37:0/2384012587 shutdown_connections 2024-05-30T07:01:11.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.733+0000 7f6264000640 1 -- 172.21.15.37:0/2384012587 wait complete. 2024-05-30T07:01:11.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6264000640 1 Processor -- start 2024-05-30T07:01:11.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6264000640 1 -- start start 2024-05-30T07:01:11.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6264000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f625c0b59d0 0x7f625c1572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6264000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f625c15d350 0x7f625c0b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6264000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f625c15d7b0 0x7f625c156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6264000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f625c13fe60 con 0x7f625c15d7b0 2024-05-30T07:01:11.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6264000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f625c13fce0 con 0x7f625c0b59d0 2024-05-30T07:01:11.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6264000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f625c0aff20 con 0x7f625c15d350 2024-05-30T07:01:11.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6262000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f625c15d7b0 0x7f625c156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6262000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f625c15d7b0 0x7f625c156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55744/0 (socket says 172.21.15.37:55744) 2024-05-30T07:01:11.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6262000640 1 -- 172.21.15.37:0/1300282332 learned_addr learned my addr 172.21.15.37:0/1300282332 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:11.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6260c00640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f625c15d350 0x7f625c0b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6261600640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f625c0b59d0 0x7f625c1572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6262000640 1 -- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f625c15d350 msgr2=0x7f625c0b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6262000640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f625c15d350 0x7f625c0b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6262000640 1 -- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f625c0b59d0 msgr2=0x7f625c1572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6262000640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f625c0b59d0 0x7f625c1572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6262000640 1 -- 172.21.15.37:0/1300282332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c159bc0 con 0x7f625c15d7b0 2024-05-30T07:01:11.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6262000640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f625c15d7b0 0x7f625c156490 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f625400cbf0 tx=0x7f625400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:11.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6259600640 1 -- 172.21.15.37:0/1300282332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6254017070 con 0x7f625c15d7b0 2024-05-30T07:01:11.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6259600640 1 -- 172.21.15.37:0/1300282332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625400ad40 con 0x7f625c15d7b0 2024-05-30T07:01:11.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6259600640 1 -- 172.21.15.37:0/1300282332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6254012600 con 0x7f625c15d7b0 2024-05-30T07:01:11.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6264000640 1 -- 172.21.15.37:0/1300282332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625c159ea0 con 0x7f625c15d7b0 2024-05-30T07:01:11.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6264000640 1 -- 172.21.15.37:0/1300282332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625c157800 con 0x7f625c15d7b0 2024-05-30T07:01:11.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.737+0000 7f6264000640 1 -- 172.21.15.37:0/1300282332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f625c068bc0 con 0x7f625c15d7b0 2024-05-30T07:01:11.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.741+0000 7f6259600640 1 -- 172.21.15.37:0/1300282332 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f625401a070 con 0x7f625c15d7b0 2024-05-30T07:01:11.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.741+0000 7f6259600640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f623c06a540 0x7f623c06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:11.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.741+0000 7f6259600640 1 -- 172.21.15.37:0/1300282332 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f6254085820 con 0x7f625c15d7b0 2024-05-30T07:01:11.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.741+0000 7f6261600640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f623c06a540 0x7f623c06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:11.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.741+0000 7f6261600640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f623c06a540 0x7f623c06ca00 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f625000b930 tx=0x7f6250008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:11.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.745+0000 7f6259600640 1 -- 172.21.15.37:0/1300282332 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6254091080 con 0x7f625c15d7b0 2024-05-30T07:01:11.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.909+0000 7f6264000640 1 -- 172.21.15.37:0/1300282332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f625c15c8d0 con 0x7f625c15d7b0 2024-05-30T07:01:11.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.909+0000 7f6259600640 1 -- 172.21.15.37:0/1300282332 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v130) ==== 104+0+11 (secure 0 0 0) 0x7f62540571f0 con 0x7f625c15d7b0 2024-05-30T07:01:11.912 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-05-30T07:01:11.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.913+0000 7f6264000640 1 -- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f623c06a540 msgr2=0x7f623c06ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.913+0000 7f6264000640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f623c06a540 0x7f623c06ca00 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f625000b930 tx=0x7f6250008040 comp rx=0 tx=0).stop 2024-05-30T07:01:11.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.913+0000 7f6264000640 1 -- 172.21.15.37:0/1300282332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f625c15d7b0 msgr2=0x7f625c156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:11.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.913+0000 7f6264000640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f625c15d7b0 0x7f625c156490 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f625400cbf0 tx=0x7f625400a430 comp rx=0 tx=0).stop 2024-05-30T07:01:11.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.913+0000 7f6264000640 1 -- 172.21.15.37:0/1300282332 shutdown_connections 2024-05-30T07:01:11.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.913+0000 7f6264000640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f625c15d7b0 0x7f625c156490 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.913+0000 7f6264000640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f625c15d350 0x7f625c0b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.913+0000 7f6264000640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f623c06a540 0x7f623c06ca00 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.913+0000 7f6264000640 1 --2- 172.21.15.37:0/1300282332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f625c0b59d0 0x7f625c1572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:11.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.913+0000 7f6264000640 1 -- 172.21.15.37:0/1300282332 >> 172.21.15.37:0/1300282332 conn(0x7f625c06bf60 msgr2=0x7f625c071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:11.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.913+0000 7f6264000640 1 -- 172.21.15.37:0/1300282332 shutdown_connections 2024-05-30T07:01:11.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:11.913+0000 7f6264000640 1 -- 172.21.15.37:0/1300282332 wait complete. 2024-05-30T07:01:11.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-30T07:01:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0788800640 1 Processor -- start 2024-05-30T07:01:12.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0788800640 1 -- start start 2024-05-30T07:01:12.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0788800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b0920 0x7f07800704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:12.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0788800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f078006c070 0x7f07800cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:12.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0788800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0780070eb0 con 0x7f0780070a10 2024-05-30T07:01:12.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0788800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0780162500 con 0x7f078006c070 2024-05-30T07:01:12.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0788800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f078006ef70 con 0x7f07800b0920 2024-05-30T07:01:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0786800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f078006c070 0x7f07800cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0785400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0780070a10 0x7f078006b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41008/0 (socket says 172.21.15.37:41008) 2024-05-30T07:01:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0785400640 1 -- 172.21.15.37:0/3722738261 learned_addr learned my addr 172.21.15.37:0/3722738261 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0785e00640 1 --2- 172.21.15.37:0/3722738261 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b0920 0x7f07800704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0786800640 1 -- 172.21.15.37:0/3722738261 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b0920 msgr2=0x7f07800704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0786800640 1 --2- 172.21.15.37:0/3722738261 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b0920 0x7f07800704d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0786800640 1 -- 172.21.15.37:0/3722738261 >> v1:172.21.15.37:6789/0 conn(0x7f0780070a10 legacy=0x7f078006b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:12.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0786800640 1 -- 172.21.15.37:0/3722738261 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078006f250 con 0x7f078006c070 2024-05-30T07:01:12.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.077+0000 7f0784a00640 1 -- 172.21.15.37:0/3722738261 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153856848 0 0) 0x7f0780070eb0 con 0x7f0780070a10 2024-05-30T07:01:12.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.081+0000 7f0786800640 1 --2- 172.21.15.37:0/3722738261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078006c070 0x7f07800cd660 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f077c009d90 tx=0x7f077c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c44814bda1a51a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:12.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.081+0000 7f0784a00640 1 -- 172.21.15.37:0/3722738261 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c0b4070 con 0x7f078006c070 2024-05-30T07:01:12.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.081+0000 7f0784a00640 1 -- 172.21.15.37:0/3722738261 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f077c0af600 con 0x7f078006c070 2024-05-30T07:01:12.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.081+0000 7f0784a00640 1 -- 172.21.15.37:0/3722738261 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c0af9d0 con 0x7f078006c070 2024-05-30T07:01:12.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.081+0000 7f0788800640 1 -- 172.21.15.37:0/3722738261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078006c070 msgr2=0x7f07800cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.081+0000 7f0788800640 1 --2- 172.21.15.37:0/3722738261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078006c070 0x7f07800cd660 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f077c009d90 tx=0x7f077c01f150 comp rx=0 tx=0).stop 2024-05-30T07:01:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.081+0000 7f0788800640 1 -- 172.21.15.37:0/3722738261 shutdown_connections 2024-05-30T07:01:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.081+0000 7f0788800640 1 --2- 172.21.15.37:0/3722738261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f078006c070 0x7f07800cd660 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.081+0000 7f0788800640 1 --2- 172.21.15.37:0/3722738261 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b0920 0x7f07800704d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.081+0000 7f0788800640 1 -- 172.21.15.37:0/3722738261 >> 172.21.15.37:0/3722738261 conn(0x7f078009aa60 msgr2=0x7f07800d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.081+0000 7f0788800640 1 -- 172.21.15.37:0/3722738261 shutdown_connections 2024-05-30T07:01:12.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.081+0000 7f0788800640 1 -- 172.21.15.37:0/3722738261 wait complete. 2024-05-30T07:01:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0788800640 1 Processor -- start 2024-05-30T07:01:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0788800640 1 -- start start 2024-05-30T07:01:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0788800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f078006c070 0x7f07800b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0788800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0780070a10 0x7f07801574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0788800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b0920 0x7f0780157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0788800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f07800d21b0 con 0x7f07800b0920 2024-05-30T07:01:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0788800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f078006f810 con 0x7f0780070a10 2024-05-30T07:01:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0788800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f07800d2330 con 0x7f078006c070 2024-05-30T07:01:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0786800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b0920 0x7f0780157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0786800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b0920 0x7f0780157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55774/0 (socket says 172.21.15.37:55774) 2024-05-30T07:01:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0786800640 1 -- 172.21.15.37:0/2278723619 learned_addr learned my addr 172.21.15.37:0/2278723619 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0785e00640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f078006c070 0x7f07800b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0785400640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0780070a10 0x7f07801574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0786800640 1 -- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f078006c070 msgr2=0x7f07800b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0786800640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f078006c070 0x7f07800b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0786800640 1 -- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0780070a10 msgr2=0x7f07801574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0786800640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0780070a10 0x7f07801574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0786800640 1 -- 172.21.15.37:0/2278723619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07800c5e80 con 0x7f07800b0920 2024-05-30T07:01:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0785400640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0780070a10 0x7f07801574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0786800640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b0920 0x7f0780157a20 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f077c0b2040 tx=0x7f077c01bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f077a000640 1 -- 172.21.15.37:0/2278723619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c0b4040 con 0x7f07800b0920 2024-05-30T07:01:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f077a000640 1 -- 172.21.15.37:0/2278723619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f077c0c1070 con 0x7f07800b0920 2024-05-30T07:01:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f077a000640 1 -- 172.21.15.37:0/2278723619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c009450 con 0x7f07800b0920 2024-05-30T07:01:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0788800640 1 -- 172.21.15.37:0/2278723619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07800c6160 con 0x7f07800b0920 2024-05-30T07:01:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0788800640 1 -- 172.21.15.37:0/2278723619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07800c6720 con 0x7f07800b0920 2024-05-30T07:01:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.085+0000 7f0788800640 1 -- 172.21.15.37:0/2278723619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0780068bc0 con 0x7f07800b0920 2024-05-30T07:01:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.089+0000 7f077a000640 1 -- 172.21.15.37:0/2278723619 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f077c0ba6b0 con 0x7f07800b0920 2024-05-30T07:01:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.089+0000 7f077a000640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f076406a540 0x7f076406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.089+0000 7f077a000640 1 -- 172.21.15.37:0/2278723619 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f077c1244d0 con 0x7f07800b0920 2024-05-30T07:01:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.089+0000 7f0785e00640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f076406a540 0x7f076406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.089+0000 7f0785e00640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f076406a540 0x7f076406ca00 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0774009ac0 tx=0x7f0774009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.093+0000 7f077a000640 1 -- 172.21.15.37:0/2278723619 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f077c018cb0 con 0x7f07800b0920 2024-05-30T07:01:12.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f0788800640 1 -- 172.21.15.37:0/2278723619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f07800af5b0 con 0x7f07800b0920 2024-05-30T07:01:12.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f077a000640 1 -- 172.21.15.37:0/2278723619 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v130) ==== 100+0+11 (secure 0 0 0) 0x7f077c0f64f0 con 0x7f07800b0920 2024-05-30T07:01:12.262 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-05-30T07:01:12.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f0788800640 1 -- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f076406a540 msgr2=0x7f076406ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:12.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f0788800640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f076406a540 0x7f076406ca00 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0774009ac0 tx=0x7f0774009190 comp rx=0 tx=0).stop 2024-05-30T07:01:12.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f0788800640 1 -- 172.21.15.37:0/2278723619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b0920 msgr2=0x7f0780157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:12.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f0788800640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b0920 0x7f0780157a20 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f077c0b2040 tx=0x7f077c01bef0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f0788800640 1 -- 172.21.15.37:0/2278723619 shutdown_connections 2024-05-30T07:01:12.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f0788800640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07800b0920 0x7f0780157a20 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f0788800640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f076406a540 0x7f076406ca00 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f0788800640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0780070a10 0x7f07801574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f0788800640 1 --2- 172.21.15.37:0/2278723619 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f078006c070 0x7f07800b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f0788800640 1 -- 172.21.15.37:0/2278723619 >> 172.21.15.37:0/2278723619 conn(0x7f078009aa60 msgr2=0x7f078006b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:12.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f0788800640 1 -- 172.21.15.37:0/2278723619 shutdown_connections 2024-05-30T07:01:12.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.261+0000 7f0788800640 1 -- 172.21.15.37:0/2278723619 wait complete. 2024-05-30T07:01:12.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-30T07:01:12.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec76800640 1 Processor -- start 2024-05-30T07:01:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec76800640 1 -- start start 2024-05-30T07:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec76800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fec7015e8b0 0x7fec700cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec76800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7006d200 0x7fec7006d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec76800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec70163350 con 0x7fec7009aa60 2024-05-30T07:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec76800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fec7006db80 con 0x7fec7015e8b0 2024-05-30T07:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec76800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fec700cfb30 con 0x7fec7006d200 2024-05-30T07:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec6fe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fec7009aa60 0x7fec7009aed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41020/0 (socket says 172.21.15.37:41020) 2024-05-30T07:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec6fe00640 1 -- 172.21.15.37:0/2769551025 learned_addr learned my addr 172.21.15.37:0/2769551025 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec66a00640 1 --2- 172.21.15.37:0/2769551025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7006d200 0x7fec7006d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec6f400640 1 --2- 172.21.15.37:0/2769551025 >> v2:172.21.15.105:3300/0 conn(0x7fec7015e8b0 0x7fec700cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec6ea00640 1 -- 172.21.15.37:0/2769551025 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469580982 0 0) 0x7fec70163350 con 0x7fec7009aa60 2024-05-30T07:01:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec6ea00640 1 -- 172.21.15.37:0/2769551025 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec54003530 con 0x7fec7009aa60 2024-05-30T07:01:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec6ea00640 1 -- 172.21.15.37:0/2769551025 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 42158143 0 0) 0x7fec54003530 con 0x7fec7009aa60 2024-05-30T07:01:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec66a00640 1 -- 172.21.15.37:0/2769551025 >> v2:172.21.15.105:3300/0 conn(0x7fec7015e8b0 msgr2=0x7fec700cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec66a00640 1 --2- 172.21.15.37:0/2769551025 >> v2:172.21.15.105:3300/0 conn(0x7fec7015e8b0 0x7fec700cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec66a00640 1 -- 172.21.15.37:0/2769551025 >> v1:172.21.15.37:6789/0 conn(0x7fec7009aa60 legacy=0x7fec7009aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.425+0000 7fec66a00640 1 -- 172.21.15.37:0/2769551025 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec701627d0 con 0x7fec7006d200 2024-05-30T07:01:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.429+0000 7fec66a00640 1 --2- 172.21.15.37:0/2769551025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7006d200 0x7fec7006d640 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fec580097c0 tx=0x7fec5801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c295814ac07cb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.429+0000 7fec6ea00640 1 -- 172.21.15.37:0/2769551025 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec580b0070 con 0x7fec7006d200 2024-05-30T07:01:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.429+0000 7fec6ea00640 1 -- 172.21.15.37:0/2769551025 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec580ab400 con 0x7fec7006d200 2024-05-30T07:01:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.429+0000 7fec6ea00640 1 -- 172.21.15.37:0/2769551025 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec68001a00 con 0x7fec7006d200 2024-05-30T07:01:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.429+0000 7fec76800640 1 -- 172.21.15.37:0/2769551025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7006d200 msgr2=0x7fec7006d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.429+0000 7fec76800640 1 --2- 172.21.15.37:0/2769551025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7006d200 0x7fec7006d640 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fec580097c0 tx=0x7fec5801c3c0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 -- 172.21.15.37:0/2769551025 shutdown_connections 2024-05-30T07:01:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 --2- 172.21.15.37:0/2769551025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7006d200 0x7fec7006d640 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 --2- 172.21.15.37:0/2769551025 >> v2:172.21.15.105:3300/0 conn(0x7fec7015e8b0 0x7fec700cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 -- 172.21.15.37:0/2769551025 >> 172.21.15.37:0/2769551025 conn(0x7fec700b4130 msgr2=0x7fec700b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 -- 172.21.15.37:0/2769551025 shutdown_connections 2024-05-30T07:01:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 -- 172.21.15.37:0/2769551025 wait complete. 2024-05-30T07:01:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 Processor -- start 2024-05-30T07:01:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 -- start start 2024-05-30T07:01:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7006d200 0x7fec7015d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec7009aa60 0x7fec7014d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7015e8b0 0x7fec70149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec70162480 con 0x7fec7006d200 2024-05-30T07:01:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec7015ec90 con 0x7fec7009aa60 2024-05-30T07:01:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec76800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fec700cf050 con 0x7fec7015e8b0 2024-05-30T07:01:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec6f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7006d200 0x7fec7015d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:12.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec6f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7006d200 0x7fec7015d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55788/0 (socket says 172.21.15.37:55788) 2024-05-30T07:01:12.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec6f400640 1 -- 172.21.15.37:0/2200432659 learned_addr learned my addr 172.21.15.37:0/2200432659 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:12.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec6fe00640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7015e8b0 0x7fec70149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:12.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec66a00640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec7009aa60 0x7fec7014d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:12.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec6f400640 1 -- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7015e8b0 msgr2=0x7fec70149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:12.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec6f400640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7015e8b0 0x7fec70149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec6f400640 1 -- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec7009aa60 msgr2=0x7fec7014d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:12.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec6f400640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec7009aa60 0x7fec7014d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec6f400640 1 -- 172.21.15.37:0/2200432659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7014ddc0 con 0x7fec7006d200 2024-05-30T07:01:12.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec6fe00640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7015e8b0 0x7fec70149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:12.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.433+0000 7fec6f400640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7006d200 0x7fec7015d820 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fec6000e8a0 tx=0x7fec6000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:12.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.437+0000 7fec67e00640 1 -- 172.21.15.37:0/2200432659 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60017070 con 0x7fec7006d200 2024-05-30T07:01:12.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.437+0000 7fec67e00640 1 -- 172.21.15.37:0/2200432659 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec6000c940 con 0x7fec7006d200 2024-05-30T07:01:12.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.437+0000 7fec67e00640 1 -- 172.21.15.37:0/2200432659 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6000ccf0 con 0x7fec7006d200 2024-05-30T07:01:12.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.437+0000 7fec76800640 1 -- 172.21.15.37:0/2200432659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7015ca60 con 0x7fec7006d200 2024-05-30T07:01:12.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.437+0000 7fec76800640 1 -- 172.21.15.37:0/2200432659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7015d020 con 0x7fec7006d200 2024-05-30T07:01:12.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.437+0000 7fec76800640 1 -- 172.21.15.37:0/2200432659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec70068bc0 con 0x7fec7006d200 2024-05-30T07:01:12.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.437+0000 7fec67e00640 1 -- 172.21.15.37:0/2200432659 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7fec6001a070 con 0x7fec7006d200 2024-05-30T07:01:12.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.437+0000 7fec67e00640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec4c06a570 0x7fec4c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:12.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.441+0000 7fec67e00640 1 -- 172.21.15.37:0/2200432659 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fec60086200 con 0x7fec7006d200 2024-05-30T07:01:12.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.441+0000 7fec66a00640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec4c06a570 0x7fec4c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.441+0000 7fec66a00640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec4c06a570 0x7fec4c06ca30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fec580ad000 tx=0x7fec580a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.441+0000 7fec67e00640 1 -- 172.21.15.37:0/2200432659 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fec600582a0 con 0x7fec7006d200 2024-05-30T07:01:12.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec76800640 1 -- 172.21.15.37:0/2200432659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fec701695f0 con 0x7fec7006d200 2024-05-30T07:01:12.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec67e00640 1 -- 172.21.15.37:0/2200432659 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v130) ==== 80+0+0 (secure 0 0 0) 0x7fec60057ba0 con 0x7fec7006d200 2024-05-30T07:01:12.626 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2024-05-30T07:01:12.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec76800640 1 -- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec4c06a570 msgr2=0x7fec4c06ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:12.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec76800640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec4c06a570 0x7fec4c06ca30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fec580ad000 tx=0x7fec580a6000 comp rx=0 tx=0).stop 2024-05-30T07:01:12.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec76800640 1 -- 172.21.15.37:0/2200432659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7006d200 msgr2=0x7fec7015d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:12.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec76800640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7006d200 0x7fec7015d820 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7fec6000e8a0 tx=0x7fec6000eca0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec76800640 1 -- 172.21.15.37:0/2200432659 shutdown_connections 2024-05-30T07:01:12.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec76800640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec7015e8b0 0x7fec70149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec76800640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fec4c06a570 0x7fec4c06ca30 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec76800640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec7009aa60 0x7fec7014d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec76800640 1 --2- 172.21.15.37:0/2200432659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec7006d200 0x7fec7015d820 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:12.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec76800640 1 -- 172.21.15.37:0/2200432659 >> 172.21.15.37:0/2200432659 conn(0x7fec700b4130 msgr2=0x7fec70161140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:12.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec76800640 1 -- 172.21.15.37:0/2200432659 shutdown_connections 2024-05-30T07:01:12.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:12.625+0000 7fec76800640 1 -- 172.21.15.37:0/2200432659 wait complete. 2024-05-30T07:01:12.648 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-30T07:01:12.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:12.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-30T07:01:12.706 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T07:01:12.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:12.707 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-30T07:01:12.721 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-05-30T07:01:12.721 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T07:01:12.772 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353388k,nr_inodes=4088347,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4409 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-30T07:01:12.773 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T07:01:12.773 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T07:01:12.782 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T07:01:12.782 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-05-30T07:01:12.782 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-30T07:01:12.832 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3182 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-30T07:01:12.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:12.833 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T07:01:12.842 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-30T07:01:12.842 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-30T07:01:12.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:12.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-30T07:01:12.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:12.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-30T07:01:12.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:12.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-05-30T07:01:13.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:13.138 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-05-30T07:01:13.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:13.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-05-30T07:01:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2024-05-30T07:01:13.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T07:01:13.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:13.213 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-05-30T07:01:13.223 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-30T07:01:13.223 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-30T07:01:13.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:13.225 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-30T07:01:13.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:13.297 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-30T07:01:13.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:13.369 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-05-30T07:01:13.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:13.575 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-05-30T07:01:13.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-30T07:01:13.584 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-05-30T07:01:13.649 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2024-05-30T07:01:13.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T07:01:13.652 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-30T07:01:13.661 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-30T07:01:13.662 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T07:01:13.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7abe00640 1 Processor -- start 2024-05-30T07:01:13.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7abe00640 1 -- start start 2024-05-30T07:01:13.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7abe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7a40b2e20 0x7fb7a4160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:13.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7abe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7a409ba70 0x7fb7a4160e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:13.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7abe00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a40d0430 con 0x7fb7a41609c0 2024-05-30T07:01:13.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7abe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb7a40b3200 con 0x7fb7a40b2e20 2024-05-30T07:01:13.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7abe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a40d01e0 con 0x7fb7a409ba70 2024-05-30T07:01:13.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7a9400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7a40b2e20 0x7fb7a4160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:13.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7a9400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7a40b2e20 0x7fb7a4160480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55798/0 (socket says 172.21.15.37:55798) 2024-05-30T07:01:13.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7a9400640 1 -- 172.21.15.37:0/2172388881 learned_addr learned my addr 172.21.15.37:0/2172388881 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:13.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7a9e00640 1 --2- 172.21.15.37:0/2172388881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7a409ba70 0x7fb7a4160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:13.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7a9400640 1 -- 172.21.15.37:0/2172388881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7a409ba70 msgr2=0x7fb7a4160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:13.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7a9400640 1 --2- 172.21.15.37:0/2172388881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7a409ba70 0x7fb7a4160e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:13.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7a9400640 1 -- 172.21.15.37:0/2172388881 >> v1:172.21.15.105:6789/0 conn(0x7fb7a41609c0 legacy=0x7fb7a40cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:13.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.805+0000 7fb7a9400640 1 -- 172.21.15.37:0/2172388881 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a40d0710 con 0x7fb7a40b2e20 2024-05-30T07:01:13.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.809+0000 7fb7a9400640 1 --2- 172.21.15.37:0/2172388881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7a40b2e20 0x7fb7a4160480 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fb798009870 tx=0x7fb79801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd4453072c69311 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:13.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.809+0000 7fb7a3e00640 1 -- 172.21.15.37:0/2172388881 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7980ab650 con 0x7fb7a40b2e20 2024-05-30T07:01:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.809+0000 7fb7a3e00640 1 -- 172.21.15.37:0/2172388881 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7980b0070 con 0x7fb7a40b2e20 2024-05-30T07:01:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.809+0000 7fb7a3e00640 1 -- 172.21.15.37:0/2172388881 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7980aba10 con 0x7fb7a40b2e20 2024-05-30T07:01:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.809+0000 7fb7abe00640 1 -- 172.21.15.37:0/2172388881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7a40b2e20 msgr2=0x7fb7a4160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.809+0000 7fb7abe00640 1 --2- 172.21.15.37:0/2172388881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7a40b2e20 0x7fb7a4160480 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fb798009870 tx=0x7fb79801c560 comp rx=0 tx=0).stop 2024-05-30T07:01:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.809+0000 7fb7abe00640 1 -- 172.21.15.37:0/2172388881 shutdown_connections 2024-05-30T07:01:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.809+0000 7fb7abe00640 1 --2- 172.21.15.37:0/2172388881 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7a409ba70 0x7fb7a4160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:13.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.809+0000 7fb7abe00640 1 --2- 172.21.15.37:0/2172388881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7a40b2e20 0x7fb7a4160480 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.809+0000 7fb7abe00640 1 -- 172.21.15.37:0/2172388881 >> 172.21.15.37:0/2172388881 conn(0x7fb7a40b4100 msgr2=0x7fb7a40b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.809+0000 7fb7abe00640 1 -- 172.21.15.37:0/2172388881 shutdown_connections 2024-05-30T07:01:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.809+0000 7fb7abe00640 1 -- 172.21.15.37:0/2172388881 wait complete. 2024-05-30T07:01:13.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7abe00640 1 Processor -- start 2024-05-30T07:01:13.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7abe00640 1 -- start start 2024-05-30T07:01:13.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7abe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7a409ba70 0x7fb7a4155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:13.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7abe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7a40b2e20 0x7fb7a415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:13.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7abe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7a41609c0 0x7fb7a415f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:13.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7abe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a40ce320 con 0x7fb7a40b2e20 2024-05-30T07:01:13.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7abe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a40ce1a0 con 0x7fb7a41609c0 2024-05-30T07:01:13.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7abe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a415abd0 con 0x7fb7a409ba70 2024-05-30T07:01:13.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7a40b2e20 0x7fb7a415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:13.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7a40b2e20 0x7fb7a415af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55814/0 (socket says 172.21.15.37:55814) 2024-05-30T07:01:13.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a8a00640 1 -- 172.21.15.37:0/2398700410 learned_addr learned my addr 172.21.15.37:0/2398700410 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:13.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a9400640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7a409ba70 0x7fb7a4155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:13.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a9e00640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7a41609c0 0x7fb7a415f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:13.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a8a00640 1 -- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7a409ba70 msgr2=0x7fb7a4155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:13.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a8a00640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7a409ba70 0x7fb7a4155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:13.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a8a00640 1 -- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7a41609c0 msgr2=0x7fb7a415f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:13.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a8a00640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7a41609c0 0x7fb7a415f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:13.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a8a00640 1 -- 172.21.15.37:0/2398700410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a4159e10 con 0x7fb7a40b2e20 2024-05-30T07:01:13.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a8a00640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7a40b2e20 0x7fb7a415af60 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fb79000c370 tx=0x7fb79000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:13.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a1600640 1 -- 172.21.15.37:0/2398700410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7900052d0 con 0x7fb7a40b2e20 2024-05-30T07:01:13.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a1600640 1 -- 172.21.15.37:0/2398700410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb790005470 con 0x7fb7a40b2e20 2024-05-30T07:01:13.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7a1600640 1 -- 172.21.15.37:0/2398700410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790007260 con 0x7fb7a40b2e20 2024-05-30T07:01:13.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7abe00640 1 -- 172.21.15.37:0/2398700410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a415a0f0 con 0x7fb7a40b2e20 2024-05-30T07:01:13.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7abe00640 1 -- 172.21.15.37:0/2398700410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a415a6b0 con 0x7fb7a40b2e20 2024-05-30T07:01:13.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.813+0000 7fb7abe00640 1 -- 172.21.15.37:0/2398700410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a4068b20 con 0x7fb7a40b2e20 2024-05-30T07:01:13.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.817+0000 7fb7a1600640 1 -- 172.21.15.37:0/2398700410 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7fb790007400 con 0x7fb7a40b2e20 2024-05-30T07:01:13.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.817+0000 7fb7a1600640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb78406a540 0x7fb78406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:13.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.817+0000 7fb7a1600640 1 -- 172.21.15.37:0/2398700410 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fb790084fc0 con 0x7fb7a40b2e20 2024-05-30T07:01:13.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.817+0000 7fb7a9400640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb78406a540 0x7fb78406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:13.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.817+0000 7fb7a9400640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb78406a540 0x7fb78406ca00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb7980af000 tx=0x7fb7980a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:13.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.821+0000 7fb7a1600640 1 -- 172.21.15.37:0/2398700410 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb790056900 con 0x7fb7a40b2e20 2024-05-30T07:01:13.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.985+0000 7fb7abe00640 1 -- 172.21.15.37:0/2398700410 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7a40ce860 con 0x7fb78406a540 2024-05-30T07:01:13.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.993+0000 7fb7a1600640 1 -- 172.21.15.37:0/2398700410 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254778 (secure 0 0 0) 0x7fb7a40ce860 con 0x7fb78406a540 2024-05-30T07:01:13.996 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:01:13.997 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T07:01:13.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.997+0000 7fb7abe00640 1 -- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb78406a540 msgr2=0x7fb78406ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.997+0000 7fb7abe00640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb78406a540 0x7fb78406ca00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb7980af000 tx=0x7fb7980a7000 comp rx=0 tx=0).stop 2024-05-30T07:01:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.997+0000 7fb7abe00640 1 -- 172.21.15.37:0/2398700410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7a40b2e20 msgr2=0x7fb7a415af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.997+0000 7fb7abe00640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7a40b2e20 0x7fb7a415af60 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fb79000c370 tx=0x7fb79000c830 comp rx=0 tx=0).stop 2024-05-30T07:01:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.997+0000 7fb7abe00640 1 -- 172.21.15.37:0/2398700410 shutdown_connections 2024-05-30T07:01:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.997+0000 7fb7abe00640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fb78406a540 0x7fb78406ca00 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.997+0000 7fb7abe00640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7a41609c0 0x7fb7a415f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.997+0000 7fb7abe00640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7a40b2e20 0x7fb7a415af60 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.997+0000 7fb7abe00640 1 --2- 172.21.15.37:0/2398700410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7a409ba70 0x7fb7a4155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.997+0000 7fb7abe00640 1 -- 172.21.15.37:0/2398700410 >> 172.21.15.37:0/2398700410 conn(0x7fb7a40b4100 msgr2=0x7fb7a4074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:14.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.997+0000 7fb7abe00640 1 -- 172.21.15.37:0/2398700410 shutdown_connections 2024-05-30T07:01:14.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:13.997+0000 7fb7abe00640 1 -- 172.21.15.37:0/2398700410 wait complete. 2024-05-30T07:01:14.016 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":700,"stamp":"2024-05-30T07:01:13.047497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16846623248,"num_objects":4050,"num_object_clones":1,"num_object_copies":8100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4050,"num_whiteouts":1,"num_read":4244,"num_read_kb":16560313,"num_write":6389,"num_write_kb":19599609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6314,"ondisk_log_size":6314,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":34039888,"kb_used_data":32916368,"kb_used_omap":12,"kb_used_meta":1123443,"kb_avail":720934832,"statfs":{"total":773094113280,"available":738237267968,"internally_reserved":0,"allocated":33706360832,"data_stored":33698968000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1150406192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003227"},"pg_stats":[{"pgid":"19.3f","version":"130'77","reported_seq":166,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.506911+0000","last_change":"2024-05-30T06:59:08.024160+0000","last_active":"2024-05-30T07:00:52.506911+0000","last_peered":"2024-05-30T07:00:52.506911+0000","last_clean":"2024-05-30T07:00:52.506911+0000","last_became_active":"2024-05-30T06:59:08.023564+0000","last_became_peered":"2024-05-30T06:59:08.023564+0000","last_unstale":"2024-05-30T07:00:52.506911+0000","last_undegraded":"2024-05-30T07:00:52.506911+0000","last_fullsized":"2024-05-30T07:00:52.506911+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:49:09.216308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":77,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"130'93","reported_seq":177,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.498880+0000","last_change":"2024-05-30T06:59:08.017254+0000","last_active":"2024-05-30T07:00:52.498880+0000","last_peered":"2024-05-30T07:00:52.498880+0000","last_clean":"2024-05-30T07:00:52.498880+0000","last_became_active":"2024-05-30T06:59:08.016947+0000","last_became_peered":"2024-05-30T06:59:08.016947+0000","last_unstale":"2024-05-30T07:00:52.498880+0000","last_undegraded":"2024-05-30T07:00:52.498880+0000","last_fullsized":"2024-05-30T07:00:52.498880+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:06:13.939169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":93,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"130'100","reported_seq":184,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.515911+0000","last_change":"2024-05-30T06:59:08.031486+0000","last_active":"2024-05-30T07:00:52.515911+0000","last_peered":"2024-05-30T07:00:52.515911+0000","last_clean":"2024-05-30T07:00:52.515911+0000","last_became_active":"2024-05-30T06:59:08.030677+0000","last_became_peered":"2024-05-30T06:59:08.030677+0000","last_unstale":"2024-05-30T07:00:52.515911+0000","last_undegraded":"2024-05-30T07:00:52.515911+0000","last_fullsized":"2024-05-30T07:00:52.515911+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:59:41.592123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":68,"num_read_kb":262148,"num_write":100,"num_write_kb":323587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"130'83","reported_seq":142,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.494948+0000","last_change":"2024-05-30T06:59:55.853693+0000","last_active":"2024-05-30T07:00:52.494948+0000","last_peered":"2024-05-30T07:00:52.494948+0000","last_clean":"2024-05-30T07:00:52.494948+0000","last_became_active":"2024-05-30T06:59:54.418117+0000","last_became_peered":"2024-05-30T06:59:54.418117+0000","last_unstale":"2024-05-30T07:00:52.494948+0000","last_undegraded":"2024-05-30T07:00:52.494948+0000","last_fullsized":"2024-05-30T07:00:52.494948+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:14:21.375372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":176129,"num_write":83,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3b","version":"130'68","reported_seq":125,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.474175+0000","last_change":"2024-05-30T06:59:08.046184+0000","last_active":"2024-05-30T07:00:52.474175+0000","last_peered":"2024-05-30T07:00:52.474175+0000","last_clean":"2024-05-30T07:00:52.474175+0000","last_became_active":"2024-05-30T06:59:08.045942+0000","last_became_peered":"2024-05-30T06:59:08.045942+0000","last_unstale":"2024-05-30T07:00:52.474175+0000","last_undegraded":"2024-05-30T07:00:52.474175+0000","last_fullsized":"2024-05-30T07:00:52.474175+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:27:44.098848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":41,"num_read_kb":167936,"num_write":68,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"130'99","reported_seq":201,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.366734+0000","last_change":"2024-05-30T06:59:08.029771+0000","last_active":"2024-05-30T07:00:52.366734+0000","last_peered":"2024-05-30T07:00:52.366734+0000","last_clean":"2024-05-30T07:00:52.366734+0000","last_became_active":"2024-05-30T06:59:08.029463+0000","last_became_peered":"2024-05-30T06:59:08.029463+0000","last_unstale":"2024-05-30T07:00:52.366734+0000","last_undegraded":"2024-05-30T07:00:52.366734+0000","last_fullsized":"2024-05-30T07:00:52.366734+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:13.314661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":99,"num_write_kb":344065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"130'75","reported_seq":139,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.367424+0000","last_change":"2024-05-30T06:59:08.035845+0000","last_active":"2024-05-30T07:00:52.367424+0000","last_peered":"2024-05-30T07:00:52.367424+0000","last_clean":"2024-05-30T07:00:52.367424+0000","last_became_active":"2024-05-30T06:59:08.035526+0000","last_became_peered":"2024-05-30T06:59:08.035526+0000","last_unstale":"2024-05-30T07:00:52.367424+0000","last_undegraded":"2024-05-30T07:00:52.367424+0000","last_fullsized":"2024-05-30T07:00:52.367424+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:19:00.334786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":48,"num_read_kb":196608,"num_write":75,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"130'88","reported_seq":157,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.491373+0000","last_change":"2024-05-30T06:59:08.035483+0000","last_active":"2024-05-30T07:00:52.491373+0000","last_peered":"2024-05-30T07:00:52.491373+0000","last_clean":"2024-05-30T07:00:52.491373+0000","last_became_active":"2024-05-30T06:59:08.034842+0000","last_became_peered":"2024-05-30T06:59:08.034842+0000","last_unstale":"2024-05-30T07:00:52.491373+0000","last_undegraded":"2024-05-30T07:00:52.491373+0000","last_fullsized":"2024-05-30T07:00:52.491373+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:07:18.302784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":53,"num_read_kb":217088,"num_write":88,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"130'89","reported_seq":157,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.439457+0000","last_change":"2024-05-30T06:59:08.044693+0000","last_active":"2024-05-30T07:00:52.439457+0000","last_peered":"2024-05-30T07:00:52.439457+0000","last_clean":"2024-05-30T07:00:52.439457+0000","last_became_active":"2024-05-30T06:59:08.044276+0000","last_became_peered":"2024-05-30T06:59:08.044276+0000","last_unstale":"2024-05-30T07:00:52.439457+0000","last_undegraded":"2024-05-30T07:00:52.439457+0000","last_fullsized":"2024-05-30T07:00:52.439457+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:14:17.604408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269764,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":52,"num_read_kb":208897,"num_write":89,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"130'65","reported_seq":144,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.422414+0000","last_change":"2024-05-30T06:59:08.016455+0000","last_active":"2024-05-30T07:00:52.422414+0000","last_peered":"2024-05-30T07:00:52.422414+0000","last_clean":"2024-05-30T07:00:52.422414+0000","last_became_active":"2024-05-30T06:59:08.016161+0000","last_became_peered":"2024-05-30T06:59:08.016161+0000","last_unstale":"2024-05-30T07:00:52.422414+0000","last_undegraded":"2024-05-30T07:00:52.422414+0000","last_fullsized":"2024-05-30T07:00:52.422414+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:50:42.911168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":65,"num_write_kb":225280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"130'100","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.488290+0000","last_change":"2024-05-30T06:59:08.022034+0000","last_active":"2024-05-30T07:00:52.488290+0000","last_peered":"2024-05-30T07:00:52.488290+0000","last_clean":"2024-05-30T07:00:52.488290+0000","last_became_active":"2024-05-30T06:59:08.021772+0000","last_became_peered":"2024-05-30T06:59:08.021772+0000","last_unstale":"2024-05-30T07:00:52.488290+0000","last_undegraded":"2024-05-30T07:00:52.488290+0000","last_fullsized":"2024-05-30T07:00:52.488290+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:41:37.594639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":100,"num_read_kb":409600,"num_write":100,"num_write_kb":356352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"130'80","reported_seq":194,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.503819+0000","last_change":"2024-05-30T06:59:08.044094+0000","last_active":"2024-05-30T07:00:52.503819+0000","last_peered":"2024-05-30T07:00:52.503819+0000","last_clean":"2024-05-30T07:00:52.503819+0000","last_became_active":"2024-05-30T06:59:08.043835+0000","last_became_peered":"2024-05-30T06:59:08.043835+0000","last_unstale":"2024-05-30T07:00:52.503819+0000","last_undegraded":"2024-05-30T07:00:52.503819+0000","last_fullsized":"2024-05-30T07:00:52.503819+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:16:54.524337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":98,"num_read_kb":385028,"num_write":80,"num_write_kb":278529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"130'84","reported_seq":184,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.432364+0000","last_change":"2024-05-30T06:59:08.025217+0000","last_active":"2024-05-30T07:00:52.432364+0000","last_peered":"2024-05-30T07:00:52.432364+0000","last_clean":"2024-05-30T07:00:52.432364+0000","last_became_active":"2024-05-30T06:59:08.024478+0000","last_became_peered":"2024-05-30T06:59:08.024478+0000","last_unstale":"2024-05-30T07:00:52.432364+0000","last_undegraded":"2024-05-30T07:00:52.432364+0000","last_fullsized":"2024-05-30T07:00:52.432364+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:29:37.627610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":84,"num_read_kb":335874,"num_write":84,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"130'83","reported_seq":162,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.506927+0000","last_change":"2024-05-30T06:59:08.022376+0000","last_active":"2024-05-30T07:00:52.506927+0000","last_peered":"2024-05-30T07:00:52.506927+0000","last_clean":"2024-05-30T07:00:52.506927+0000","last_became_active":"2024-05-30T06:59:08.022058+0000","last_became_peered":"2024-05-30T06:59:08.022058+0000","last_unstale":"2024-05-30T07:00:52.506927+0000","last_undegraded":"2024-05-30T07:00:52.506927+0000","last_fullsized":"2024-05-30T07:00:52.506927+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:22:42.845029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":63,"num_read_kb":249858,"num_write":83,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"130'75","reported_seq":122,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.352230+0000","last_change":"2024-05-30T06:59:08.027564+0000","last_active":"2024-05-30T07:00:52.352230+0000","last_peered":"2024-05-30T07:00:52.352230+0000","last_clean":"2024-05-30T07:00:52.352230+0000","last_became_active":"2024-05-30T06:59:08.027303+0000","last_became_peered":"2024-05-30T06:59:08.027303+0000","last_unstale":"2024-05-30T07:00:52.352230+0000","last_undegraded":"2024-05-30T07:00:52.352230+0000","last_fullsized":"2024-05-30T07:00:52.352230+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:59:23.939287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":31,"num_read_kb":126976,"num_write":75,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"130'84","reported_seq":152,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.496905+0000","last_change":"2024-05-30T06:59:08.023401+0000","last_active":"2024-05-30T07:00:52.496905+0000","last_peered":"2024-05-30T07:00:52.496905+0000","last_clean":"2024-05-30T07:00:52.496905+0000","last_became_active":"2024-05-30T06:59:08.022914+0000","last_became_peered":"2024-05-30T06:59:08.022914+0000","last_unstale":"2024-05-30T07:00:52.496905+0000","last_undegraded":"2024-05-30T07:00:52.496905+0000","last_fullsized":"2024-05-30T07:00:52.496905+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:52:22.042222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":52,"num_read_kb":212992,"num_write":84,"num_write_kb":278528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"130'72","reported_seq":131,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.463163+0000","last_change":"2024-05-30T06:59:08.024708+0000","last_active":"2024-05-30T07:00:52.463163+0000","last_peered":"2024-05-30T07:00:52.463163+0000","last_clean":"2024-05-30T07:00:52.463163+0000","last_became_active":"2024-05-30T06:59:08.024445+0000","last_became_peered":"2024-05-30T06:59:08.024445+0000","last_unstale":"2024-05-30T07:00:52.463163+0000","last_undegraded":"2024-05-30T07:00:52.463163+0000","last_fullsized":"2024-05-30T07:00:52.463163+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:47:16.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":176128,"num_write":72,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"130'94","reported_seq":199,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.442856+0000","last_change":"2024-05-30T06:59:08.023258+0000","last_active":"2024-05-30T07:00:52.442856+0000","last_peered":"2024-05-30T07:00:52.442856+0000","last_clean":"2024-05-30T07:00:52.442856+0000","last_became_active":"2024-05-30T06:59:08.017709+0000","last_became_peered":"2024-05-30T06:59:08.017709+0000","last_unstale":"2024-05-30T07:00:52.442856+0000","last_undegraded":"2024-05-30T07:00:52.442856+0000","last_fullsized":"2024-05-30T07:00:52.442856+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:15.909838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":89,"num_read_kb":364544,"num_write":94,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"130'94","reported_seq":181,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.480060+0000","last_change":"2024-05-30T06:59:08.026237+0000","last_active":"2024-05-30T07:00:52.480060+0000","last_peered":"2024-05-30T07:00:52.480060+0000","last_clean":"2024-05-30T07:00:52.480060+0000","last_became_active":"2024-05-30T06:59:08.025981+0000","last_became_peered":"2024-05-30T06:59:08.025981+0000","last_unstale":"2024-05-30T07:00:52.480060+0000","last_undegraded":"2024-05-30T07:00:52.480060+0000","last_fullsized":"2024-05-30T07:00:52.480060+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:08:22.095245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":71,"num_read_kb":278531,"num_write":94,"num_write_kb":335873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"130'84","reported_seq":161,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.422359+0000","last_change":"2024-05-30T06:59:08.018790+0000","last_active":"2024-05-30T07:00:52.422359+0000","last_peered":"2024-05-30T07:00:52.422359+0000","last_clean":"2024-05-30T07:00:52.422359+0000","last_became_active":"2024-05-30T06:59:08.015033+0000","last_became_peered":"2024-05-30T06:59:08.015033+0000","last_unstale":"2024-05-30T07:00:52.422359+0000","last_undegraded":"2024-05-30T07:00:52.422359+0000","last_fullsized":"2024-05-30T07:00:52.422359+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:01:57.819719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":61,"num_read_kb":241666,"num_write":83,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"130'100","reported_seq":207,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.451815+0000","last_change":"2024-05-30T06:59:08.046183+0000","last_active":"2024-05-30T07:00:52.451815+0000","last_peered":"2024-05-30T07:00:52.451815+0000","last_clean":"2024-05-30T07:00:52.451815+0000","last_became_active":"2024-05-30T06:59:08.045891+0000","last_became_peered":"2024-05-30T06:59:08.045891+0000","last_unstale":"2024-05-30T07:00:52.451815+0000","last_undegraded":"2024-05-30T07:00:52.451815+0000","last_fullsized":"2024-05-30T07:00:52.451815+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:52:32.696164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":91,"num_read_kb":368641,"num_write":100,"num_write_kb":344066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"130'83","reported_seq":155,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.440845+0000","last_change":"2024-05-30T06:59:08.019956+0000","last_active":"2024-05-30T07:00:52.440845+0000","last_peered":"2024-05-30T07:00:52.440845+0000","last_clean":"2024-05-30T07:00:52.440845+0000","last_became_active":"2024-05-30T06:59:08.019670+0000","last_became_peered":"2024-05-30T06:59:08.019670+0000","last_unstale":"2024-05-30T07:00:52.440845+0000","last_undegraded":"2024-05-30T07:00:52.440845+0000","last_fullsized":"2024-05-30T07:00:52.440845+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:52:32.696164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":56,"num_read_kb":225281,"num_write":82,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"130'98","reported_seq":169,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.440422+0000","last_change":"2024-05-30T06:59:08.044096+0000","last_active":"2024-05-30T07:00:52.440422+0000","last_peered":"2024-05-30T07:00:52.440422+0000","last_clean":"2024-05-30T07:00:52.440422+0000","last_became_active":"2024-05-30T06:59:08.043786+0000","last_became_peered":"2024-05-30T06:59:08.043786+0000","last_unstale":"2024-05-30T07:00:52.440422+0000","last_undegraded":"2024-05-30T07:00:52.440422+0000","last_fullsized":"2024-05-30T07:00:52.440422+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:51:04.988561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":97,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"130'85","reported_seq":157,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.451401+0000","last_change":"2024-05-30T06:59:08.022594+0000","last_active":"2024-05-30T07:00:52.451401+0000","last_peered":"2024-05-30T07:00:52.451401+0000","last_clean":"2024-05-30T07:00:52.451401+0000","last_became_active":"2024-05-30T06:59:08.022293+0000","last_became_peered":"2024-05-30T06:59:08.022293+0000","last_unstale":"2024-05-30T07:00:52.451401+0000","last_undegraded":"2024-05-30T07:00:52.451401+0000","last_fullsized":"2024-05-30T07:00:52.451401+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:27:44.098848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":56,"num_read_kb":212996,"num_write":85,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"130'92","reported_seq":172,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.465900+0000","last_change":"2024-05-30T06:59:08.038685+0000","last_active":"2024-05-30T07:00:52.465900+0000","last_peered":"2024-05-30T07:00:52.465900+0000","last_clean":"2024-05-30T07:00:52.465900+0000","last_became_active":"2024-05-30T06:59:08.038414+0000","last_became_peered":"2024-05-30T06:59:08.038414+0000","last_unstale":"2024-05-30T07:00:52.465900+0000","last_undegraded":"2024-05-30T07:00:52.465900+0000","last_fullsized":"2024-05-30T07:00:52.465900+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:15:35.587906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":64,"num_read_kb":258049,"num_write":92,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"130'84","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.474185+0000","last_change":"2024-05-30T06:59:56.500807+0000","last_active":"2024-05-30T07:00:52.474185+0000","last_peered":"2024-05-30T07:00:52.474185+0000","last_clean":"2024-05-30T07:00:52.474185+0000","last_became_active":"2024-05-30T06:59:54.423066+0000","last_became_peered":"2024-05-30T06:59:54.423066+0000","last_unstale":"2024-05-30T07:00:52.474185+0000","last_undegraded":"2024-05-30T07:00:52.474185+0000","last_fullsized":"2024-05-30T07:00:52.474185+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:54:28.187315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":83,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"130'96","reported_seq":177,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.484611+0000","last_change":"2024-05-30T06:59:08.024951+0000","last_active":"2024-05-30T07:00:52.484611+0000","last_peered":"2024-05-30T07:00:52.484611+0000","last_clean":"2024-05-30T07:00:52.484611+0000","last_became_active":"2024-05-30T06:59:08.024354+0000","last_became_peered":"2024-05-30T06:59:08.024354+0000","last_unstale":"2024-05-30T07:00:52.484611+0000","last_undegraded":"2024-05-30T07:00:52.484611+0000","last_fullsized":"2024-05-30T07:00:52.484611+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:51:04.466523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":96,"num_write_kb":331776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"130'90","reported_seq":139,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.483923+0000","last_change":"2024-05-30T06:59:08.033925+0000","last_active":"2024-05-30T07:00:52.483923+0000","last_peered":"2024-05-30T07:00:52.483923+0000","last_clean":"2024-05-30T07:00:52.483923+0000","last_became_active":"2024-05-30T06:59:08.033552+0000","last_became_peered":"2024-05-30T06:59:08.033552+0000","last_unstale":"2024-05-30T07:00:52.483923+0000","last_undegraded":"2024-05-30T07:00:52.483923+0000","last_fullsized":"2024-05-30T07:00:52.483923+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:15:35.587906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":33,"num_read_kb":135168,"num_write":90,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"130'97","reported_seq":183,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.491951+0000","last_change":"2024-05-30T06:59:08.033338+0000","last_active":"2024-05-30T07:00:52.491951+0000","last_peered":"2024-05-30T07:00:52.491951+0000","last_clean":"2024-05-30T07:00:52.491951+0000","last_became_active":"2024-05-30T06:59:08.032376+0000","last_became_peered":"2024-05-30T06:59:08.032376+0000","last_unstale":"2024-05-30T07:00:52.491951+0000","last_undegraded":"2024-05-30T07:00:52.491951+0000","last_fullsized":"2024-05-30T07:00:52.491951+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:19:12.129168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":70,"num_read_kb":286720,"num_write":97,"num_write_kb":323585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"130'92","reported_seq":172,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.493486+0000","last_change":"2024-05-30T06:59:08.032860+0000","last_active":"2024-05-30T07:00:52.493486+0000","last_peered":"2024-05-30T07:00:52.493486+0000","last_clean":"2024-05-30T07:00:52.493486+0000","last_became_active":"2024-05-30T06:59:08.032457+0000","last_became_peered":"2024-05-30T06:59:08.032457+0000","last_unstale":"2024-05-30T07:00:52.493486+0000","last_undegraded":"2024-05-30T07:00:52.493486+0000","last_fullsized":"2024-05-30T07:00:52.493486+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:08.647882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":92,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"130'82","reported_seq":191,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.462021+0000","last_change":"2024-05-30T06:59:08.039799+0000","last_active":"2024-05-30T07:00:52.462021+0000","last_peered":"2024-05-30T07:00:52.462021+0000","last_clean":"2024-05-30T07:00:52.462021+0000","last_became_active":"2024-05-30T06:59:08.039524+0000","last_became_peered":"2024-05-30T06:59:08.039524+0000","last_unstale":"2024-05-30T07:00:52.462021+0000","last_undegraded":"2024-05-30T07:00:52.462021+0000","last_fullsized":"2024-05-30T07:00:52.462021+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:32:19.058834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":93,"num_read_kb":380928,"num_write":82,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"130'87","reported_seq":176,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.499465+0000","last_change":"2024-05-30T06:59:08.025201+0000","last_active":"2024-05-30T07:00:52.499465+0000","last_peered":"2024-05-30T07:00:52.499465+0000","last_clean":"2024-05-30T07:00:52.499465+0000","last_became_active":"2024-05-30T06:59:08.023719+0000","last_became_peered":"2024-05-30T06:59:08.023719+0000","last_unstale":"2024-05-30T07:00:52.499465+0000","last_undegraded":"2024-05-30T07:00:52.499465+0000","last_fullsized":"2024-05-30T07:00:52.499465+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:51.605688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":73,"num_read_kb":290818,"num_write":87,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"130'71","reported_seq":132,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.502714+0000","last_change":"2024-05-30T06:59:08.022581+0000","last_active":"2024-05-30T07:00:52.502714+0000","last_peered":"2024-05-30T07:00:52.502714+0000","last_clean":"2024-05-30T07:00:52.502714+0000","last_became_active":"2024-05-30T06:59:08.017322+0000","last_became_peered":"2024-05-30T06:59:08.017322+0000","last_unstale":"2024-05-30T07:00:52.502714+0000","last_undegraded":"2024-05-30T07:00:52.502714+0000","last_fullsized":"2024-05-30T07:00:52.502714+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:23.377454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192938245,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":44,"num_read_kb":180224,"num_write":71,"num_write_kb":237569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"127'4","reported_seq":22,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419989+0000","last_change":"2024-05-30T06:59:07.025645+0000","last_active":"2024-05-30T06:59:54.419989+0000","last_peered":"2024-05-30T06:59:54.419989+0000","last_clean":"2024-05-30T06:59:54.419989+0000","last_became_active":"2024-05-30T06:59:07.025401+0000","last_became_peered":"2024-05-30T06:59:07.025401+0000","last_unstale":"2024-05-30T06:59:54.419989+0000","last_undegraded":"2024-05-30T06:59:54.419989+0000","last_fullsized":"2024-05-30T06:59:54.419989+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:12.308444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"130'96","reported_seq":181,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.448896+0000","last_change":"2024-05-30T06:59:08.037515+0000","last_active":"2024-05-30T07:00:52.448896+0000","last_peered":"2024-05-30T07:00:52.448896+0000","last_clean":"2024-05-30T07:00:52.448896+0000","last_became_active":"2024-05-30T06:59:08.037242+0000","last_became_peered":"2024-05-30T06:59:08.037242+0000","last_unstale":"2024-05-30T07:00:52.448896+0000","last_undegraded":"2024-05-30T07:00:52.448896+0000","last_fullsized":"2024-05-30T07:00:52.448896+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:21:24.557259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":69,"num_read_kb":266244,"num_write":96,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"127'1","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418391+0000","last_change":"2024-05-30T06:59:07.028000+0000","last_active":"2024-05-30T06:59:54.418391+0000","last_peered":"2024-05-30T06:59:54.418391+0000","last_clean":"2024-05-30T06:59:54.418391+0000","last_became_active":"2024-05-30T06:59:07.027686+0000","last_became_peered":"2024-05-30T06:59:07.027686+0000","last_unstale":"2024-05-30T06:59:54.418391+0000","last_undegraded":"2024-05-30T06:59:54.418391+0000","last_fullsized":"2024-05-30T06:59:54.418391+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:22:41.838812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"130'88","reported_seq":174,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.340623+0000","last_change":"2024-05-30T06:59:08.039191+0000","last_active":"2024-05-30T07:00:52.340623+0000","last_peered":"2024-05-30T07:00:52.340623+0000","last_clean":"2024-05-30T07:00:52.340623+0000","last_became_active":"2024-05-30T06:59:08.038891+0000","last_became_peered":"2024-05-30T06:59:08.038891+0000","last_unstale":"2024-05-30T07:00:52.340623+0000","last_undegraded":"2024-05-30T07:00:52.340623+0000","last_fullsized":"2024-05-30T07:00:52.340623+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:08:22.095245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075589,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":70,"num_read_kb":278530,"num_write":88,"num_write_kb":290818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"128'3","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414411+0000","last_change":"2024-05-30T06:59:07.021128+0000","last_active":"2024-05-30T06:59:54.414411+0000","last_peered":"2024-05-30T06:59:54.414411+0000","last_clean":"2024-05-30T06:59:54.414411+0000","last_became_active":"2024-05-30T06:59:07.020820+0000","last_became_peered":"2024-05-30T06:59:07.020820+0000","last_unstale":"2024-05-30T06:59:54.414411+0000","last_undegraded":"2024-05-30T06:59:54.414411+0000","last_fullsized":"2024-05-30T06:59:54.414411+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:01:56.813502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"130'111","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.499234+0000","last_change":"2024-05-30T06:59:08.033837+0000","last_active":"2024-05-30T07:00:52.499234+0000","last_peered":"2024-05-30T07:00:52.499234+0000","last_clean":"2024-05-30T07:00:52.499234+0000","last_became_active":"2024-05-30T06:59:08.033506+0000","last_became_peered":"2024-05-30T06:59:08.033506+0000","last_unstale":"2024-05-30T07:00:52.499234+0000","last_undegraded":"2024-05-30T07:00:52.499234+0000","last_fullsized":"2024-05-30T07:00:52.499234+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:41:37.594639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":87,"num_read_kb":356352,"num_write":111,"num_write_kb":364544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"127'2","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.485359+0000","last_change":"2024-05-30T06:59:07.025478+0000","last_active":"2024-05-30T06:59:54.485359+0000","last_peered":"2024-05-30T06:59:54.485359+0000","last_clean":"2024-05-30T06:59:54.485359+0000","last_became_active":"2024-05-30T06:59:07.025201+0000","last_became_peered":"2024-05-30T06:59:07.025201+0000","last_unstale":"2024-05-30T06:59:54.485359+0000","last_undegraded":"2024-05-30T06:59:54.485359+0000","last_fullsized":"2024-05-30T06:59:54.485359+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:37:03.894636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"130'91","reported_seq":162,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.515252+0000","last_change":"2024-05-30T06:59:08.022157+0000","last_active":"2024-05-30T07:00:52.515252+0000","last_peered":"2024-05-30T07:00:52.515252+0000","last_clean":"2024-05-30T07:00:52.515252+0000","last_became_active":"2024-05-30T06:59:08.017121+0000","last_became_peered":"2024-05-30T06:59:08.017121+0000","last_unstale":"2024-05-30T07:00:52.515252+0000","last_undegraded":"2024-05-30T07:00:52.515252+0000","last_fullsized":"2024-05-30T07:00:52.515252+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:18:16.991239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":91,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.484877+0000","last_change":"2024-05-30T06:59:07.026285+0000","last_active":"2024-05-30T06:59:54.484877+0000","last_peered":"2024-05-30T06:59:54.484877+0000","last_clean":"2024-05-30T06:59:54.484877+0000","last_became_active":"2024-05-30T06:59:07.025467+0000","last_became_peered":"2024-05-30T06:59:07.025467+0000","last_unstale":"2024-05-30T06:59:54.484877+0000","last_undegraded":"2024-05-30T06:59:54.484877+0000","last_fullsized":"2024-05-30T06:59:54.484877+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:37.636868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"130'89","reported_seq":196,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.476545+0000","last_change":"2024-05-30T06:59:08.022678+0000","last_active":"2024-05-30T07:00:52.476545+0000","last_peered":"2024-05-30T07:00:52.476545+0000","last_clean":"2024-05-30T07:00:52.476545+0000","last_became_active":"2024-05-30T06:59:08.022387+0000","last_became_peered":"2024-05-30T06:59:08.022387+0000","last_unstale":"2024-05-30T07:00:52.476545+0000","last_undegraded":"2024-05-30T07:00:52.476545+0000","last_fullsized":"2024-05-30T07:00:52.476545+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:30:30.629687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":91,"num_read_kb":372736,"num_write":89,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417948+0000","last_change":"2024-05-30T06:59:07.020549+0000","last_active":"2024-05-30T06:59:54.417948+0000","last_peered":"2024-05-30T06:59:54.417948+0000","last_clean":"2024-05-30T06:59:54.417948+0000","last_became_active":"2024-05-30T06:59:07.020278+0000","last_became_peered":"2024-05-30T06:59:07.020278+0000","last_unstale":"2024-05-30T06:59:54.417948+0000","last_undegraded":"2024-05-30T06:59:54.417948+0000","last_fullsized":"2024-05-30T06:59:54.417948+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:33:45.564464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"130'82","reported_seq":168,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.483472+0000","last_change":"2024-05-30T06:59:08.035741+0000","last_active":"2024-05-30T07:00:52.483472+0000","last_peered":"2024-05-30T07:00:52.483472+0000","last_clean":"2024-05-30T07:00:52.483472+0000","last_became_active":"2024-05-30T06:59:08.035015+0000","last_became_peered":"2024-05-30T06:59:08.035015+0000","last_unstale":"2024-05-30T07:00:52.483472+0000","last_undegraded":"2024-05-30T07:00:52.483472+0000","last_fullsized":"2024-05-30T07:00:52.483472+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:31:05.904917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":70,"num_read_kb":286720,"num_write":82,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417507+0000","last_change":"2024-05-30T06:59:07.015142+0000","last_active":"2024-05-30T06:59:54.417507+0000","last_peered":"2024-05-30T06:59:54.417507+0000","last_clean":"2024-05-30T06:59:54.417507+0000","last_became_active":"2024-05-30T06:59:07.013998+0000","last_became_peered":"2024-05-30T06:59:07.013998+0000","last_unstale":"2024-05-30T06:59:54.417507+0000","last_undegraded":"2024-05-30T06:59:54.417507+0000","last_fullsized":"2024-05-30T06:59:54.417507+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:07:17.296567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"130'85","reported_seq":165,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.463536+0000","last_change":"2024-05-30T06:59:08.012136+0000","last_active":"2024-05-30T07:00:52.463536+0000","last_peered":"2024-05-30T07:00:52.463536+0000","last_clean":"2024-05-30T07:00:52.463536+0000","last_became_active":"2024-05-30T06:59:08.011821+0000","last_became_peered":"2024-05-30T06:59:08.011821+0000","last_unstale":"2024-05-30T07:00:52.463536+0000","last_undegraded":"2024-05-30T07:00:52.463536+0000","last_fullsized":"2024-05-30T07:00:52.463536+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:42:18.685808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":85,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.479813+0000","last_change":"2024-05-30T06:59:07.018234+0000","last_active":"2024-05-30T06:59:54.479813+0000","last_peered":"2024-05-30T06:59:54.479813+0000","last_clean":"2024-05-30T06:59:54.479813+0000","last_became_active":"2024-05-30T06:59:07.017948+0000","last_became_peered":"2024-05-30T06:59:07.017948+0000","last_unstale":"2024-05-30T06:59:54.479813+0000","last_undegraded":"2024-05-30T06:59:54.479813+0000","last_fullsized":"2024-05-30T06:59:54.479813+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:58.214120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"130'74","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.458195+0000","last_change":"2024-05-30T06:59:08.024166+0000","last_active":"2024-05-30T07:00:52.458195+0000","last_peered":"2024-05-30T07:00:52.458195+0000","last_clean":"2024-05-30T07:00:52.458195+0000","last_became_active":"2024-05-30T06:59:08.023873+0000","last_became_peered":"2024-05-30T06:59:08.023873+0000","last_unstale":"2024-05-30T07:00:52.458195+0000","last_undegraded":"2024-05-30T07:00:52.458195+0000","last_fullsized":"2024-05-30T07:00:52.458195+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:15:02.554710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":74,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"128'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418561+0000","last_change":"2024-05-30T06:59:07.024511+0000","last_active":"2024-05-30T06:59:54.418561+0000","last_peered":"2024-05-30T06:59:54.418561+0000","last_clean":"2024-05-30T06:59:54.418561+0000","last_became_active":"2024-05-30T06:59:07.024244+0000","last_became_peered":"2024-05-30T06:59:07.024244+0000","last_unstale":"2024-05-30T06:59:54.418561+0000","last_undegraded":"2024-05-30T06:59:54.418561+0000","last_fullsized":"2024-05-30T06:59:54.418561+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:55.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"130'72","reported_seq":128,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.434383+0000","last_change":"2024-05-30T06:59:08.025397+0000","last_active":"2024-05-30T07:00:52.434383+0000","last_peered":"2024-05-30T07:00:52.434383+0000","last_clean":"2024-05-30T07:00:52.434383+0000","last_became_active":"2024-05-30T06:59:08.023906+0000","last_became_peered":"2024-05-30T06:59:08.023906+0000","last_unstale":"2024-05-30T07:00:52.434383+0000","last_undegraded":"2024-05-30T07:00:52.434383+0000","last_fullsized":"2024-05-30T07:00:52.434383+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:34.458628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230686900,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":40,"num_read_kb":159745,"num_write":72,"num_write_kb":258049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418997+0000","last_change":"2024-05-30T06:59:07.014122+0000","last_active":"2024-05-30T06:59:54.418997+0000","last_peered":"2024-05-30T06:59:54.418997+0000","last_clean":"2024-05-30T06:59:54.418997+0000","last_became_active":"2024-05-30T06:59:07.013813+0000","last_became_peered":"2024-05-30T06:59:07.013813+0000","last_unstale":"2024-05-30T06:59:54.418997+0000","last_undegraded":"2024-05-30T06:59:54.418997+0000","last_fullsized":"2024-05-30T06:59:54.418997+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:50.599472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"130'78","reported_seq":174,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.503992+0000","last_change":"2024-05-30T06:59:08.039459+0000","last_active":"2024-05-30T07:00:52.503992+0000","last_peered":"2024-05-30T07:00:52.503992+0000","last_clean":"2024-05-30T07:00:52.503992+0000","last_became_active":"2024-05-30T06:59:08.039187+0000","last_became_peered":"2024-05-30T06:59:08.039187+0000","last_unstale":"2024-05-30T07:00:52.503992+0000","last_undegraded":"2024-05-30T07:00:52.503992+0000","last_fullsized":"2024-05-30T07:00:52.503992+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:33:34.546284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":77,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"130'24","reported_seq":42,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.159062+0000","last_change":"2024-05-30T06:59:07.023207+0000","last_active":"2024-05-30T07:00:52.159062+0000","last_peered":"2024-05-30T07:00:52.159062+0000","last_clean":"2024-05-30T07:00:52.159062+0000","last_became_active":"2024-05-30T06:59:07.022910+0000","last_became_peered":"2024-05-30T06:59:07.022910+0000","last_unstale":"2024-05-30T07:00:52.159062+0000","last_undegraded":"2024-05-30T07:00:52.159062+0000","last_fullsized":"2024-05-30T07:00:52.159062+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:02:20.542236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"130'84","reported_seq":166,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.394215+0000","last_change":"2024-05-30T06:59:08.039689+0000","last_active":"2024-05-30T07:00:52.394215+0000","last_peered":"2024-05-30T07:00:52.394215+0000","last_clean":"2024-05-30T07:00:52.394215+0000","last_became_active":"2024-05-30T06:59:08.039393+0000","last_became_peered":"2024-05-30T06:59:08.039393+0000","last_unstale":"2024-05-30T07:00:52.394215+0000","last_undegraded":"2024-05-30T07:00:52.394215+0000","last_fullsized":"2024-05-30T07:00:52.394215+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:00:59.299956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":66,"num_read_kb":253956,"num_write":82,"num_write_kb":278530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"130'436","reported_seq":454,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:58.198089+0000","last_change":"2024-05-30T06:59:07.014432+0000","last_active":"2024-05-30T07:00:58.198089+0000","last_peered":"2024-05-30T07:00:58.198089+0000","last_clean":"2024-05-30T07:00:58.198089+0000","last_became_active":"2024-05-30T06:59:07.014000+0000","last_became_peered":"2024-05-30T06:59:07.014000+0000","last_unstale":"2024-05-30T07:00:58.198089+0000","last_undegraded":"2024-05-30T07:00:58.198089+0000","last_fullsized":"2024-05-30T07:00:58.198089+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:10:36.275003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1700724,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":1804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"130'97","reported_seq":163,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.483361+0000","last_change":"2024-05-30T06:59:08.022261+0000","last_active":"2024-05-30T07:00:52.483361+0000","last_peered":"2024-05-30T07:00:52.483361+0000","last_clean":"2024-05-30T07:00:52.483361+0000","last_became_active":"2024-05-30T06:59:08.022009+0000","last_became_peered":"2024-05-30T06:59:08.022009+0000","last_unstale":"2024-05-30T07:00:52.483361+0000","last_undegraded":"2024-05-30T07:00:52.483361+0000","last_fullsized":"2024-05-30T07:00:52.483361+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:20:20.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":50,"num_read_kb":200705,"num_write":97,"num_write_kb":327681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417486+0000","last_change":"2024-05-30T06:59:07.013707+0000","last_active":"2024-05-30T06:59:54.417486+0000","last_peered":"2024-05-30T06:59:54.417486+0000","last_clean":"2024-05-30T06:59:54.417486+0000","last_became_active":"2024-05-30T06:59:07.013181+0000","last_became_peered":"2024-05-30T06:59:07.013181+0000","last_unstale":"2024-05-30T06:59:54.417486+0000","last_undegraded":"2024-05-30T06:59:54.417486+0000","last_fullsized":"2024-05-30T06:59:54.417486+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:47:22.693305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"130'79","reported_seq":154,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.417583+0000","last_change":"2024-05-30T06:59:08.030108+0000","last_active":"2024-05-30T07:00:52.417583+0000","last_peered":"2024-05-30T07:00:52.417583+0000","last_clean":"2024-05-30T07:00:52.417583+0000","last_became_active":"2024-05-30T06:59:08.029134+0000","last_became_peered":"2024-05-30T06:59:08.029134+0000","last_unstale":"2024-05-30T07:00:52.417583+0000","last_undegraded":"2024-05-30T07:00:52.417583+0000","last_fullsized":"2024-05-30T07:00:52.417583+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:56.766557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":79,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.480128+0000","last_change":"2024-05-30T06:59:07.022390+0000","last_active":"2024-05-30T06:59:54.480128+0000","last_peered":"2024-05-30T06:59:54.480128+0000","last_clean":"2024-05-30T06:59:54.480128+0000","last_became_active":"2024-05-30T06:59:07.022101+0000","last_became_peered":"2024-05-30T06:59:07.022101+0000","last_unstale":"2024-05-30T06:59:54.480128+0000","last_undegraded":"2024-05-30T06:59:54.480128+0000","last_fullsized":"2024-05-30T06:59:54.480128+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:18.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"130'105","reported_seq":185,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.448633+0000","last_change":"2024-05-30T06:59:08.044660+0000","last_active":"2024-05-30T07:00:52.448633+0000","last_peered":"2024-05-30T07:00:52.448633+0000","last_clean":"2024-05-30T07:00:52.448633+0000","last_became_active":"2024-05-30T06:59:08.044058+0000","last_became_peered":"2024-05-30T06:59:08.044058+0000","last_unstale":"2024-05-30T07:00:52.448633+0000","last_undegraded":"2024-05-30T07:00:52.448633+0000","last_fullsized":"2024-05-30T07:00:52.448633+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:49:32.544053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301990149,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":105,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"127'8","reported_seq":26,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.460852+0000","last_change":"2024-05-30T06:59:07.015902+0000","last_active":"2024-05-30T06:59:54.460852+0000","last_peered":"2024-05-30T06:59:54.460852+0000","last_clean":"2024-05-30T06:59:54.460852+0000","last_became_active":"2024-05-30T06:59:07.015593+0000","last_became_peered":"2024-05-30T06:59:07.015593+0000","last_unstale":"2024-05-30T06:59:54.460852+0000","last_undegraded":"2024-05-30T06:59:54.460852+0000","last_fullsized":"2024-05-30T06:59:54.460852+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:14:30.382452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"130'68","reported_seq":107,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.508664+0000","last_change":"2024-05-30T06:59:08.036882+0000","last_active":"2024-05-30T07:00:52.508664+0000","last_peered":"2024-05-30T07:00:52.508664+0000","last_clean":"2024-05-30T07:00:52.508664+0000","last_became_active":"2024-05-30T06:59:08.036615+0000","last_became_peered":"2024-05-30T06:59:08.036615+0000","last_unstale":"2024-05-30T07:00:52.508664+0000","last_undegraded":"2024-05-30T07:00:52.508664+0000","last_fullsized":"2024-05-30T07:00:52.508664+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:17.450834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":23,"num_read_kb":94208,"num_write":68,"num_write_kb":237568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418585+0000","last_change":"2024-05-30T06:59:07.019419+0000","last_active":"2024-05-30T06:59:54.418585+0000","last_peered":"2024-05-30T06:59:54.418585+0000","last_clean":"2024-05-30T06:59:54.418585+0000","last_became_active":"2024-05-30T06:59:07.019026+0000","last_became_peered":"2024-05-30T06:59:07.019026+0000","last_unstale":"2024-05-30T06:59:54.418585+0000","last_undegraded":"2024-05-30T06:59:54.418585+0000","last_fullsized":"2024-05-30T06:59:54.418585+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:42:17.679592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"130'98","reported_seq":191,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.459795+0000","last_change":"2024-05-30T06:59:08.041567+0000","last_active":"2024-05-30T07:00:52.459795+0000","last_peered":"2024-05-30T07:00:52.459795+0000","last_clean":"2024-05-30T07:00:52.459795+0000","last_became_active":"2024-05-30T06:59:08.039259+0000","last_became_peered":"2024-05-30T06:59:08.039259+0000","last_unstale":"2024-05-30T07:00:52.459795+0000","last_undegraded":"2024-05-30T07:00:52.459795+0000","last_fullsized":"2024-05-30T07:00:52.459795+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:37:27.648210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":77,"num_read_kb":315392,"num_write":98,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"127'2","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414287+0000","last_change":"2024-05-30T06:59:07.020027+0000","last_active":"2024-05-30T06:59:54.414287+0000","last_peered":"2024-05-30T06:59:54.414287+0000","last_clean":"2024-05-30T06:59:54.414287+0000","last_became_active":"2024-05-30T06:59:07.019702+0000","last_became_peered":"2024-05-30T06:59:07.019702+0000","last_unstale":"2024-05-30T06:59:54.414287+0000","last_undegraded":"2024-05-30T06:59:54.414287+0000","last_fullsized":"2024-05-30T06:59:54.414287+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:49:45.444316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"130'72","reported_seq":147,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.507440+0000","last_change":"2024-05-30T06:59:08.026623+0000","last_active":"2024-05-30T07:00:52.507440+0000","last_peered":"2024-05-30T07:00:52.507440+0000","last_clean":"2024-05-30T07:00:52.507440+0000","last_became_active":"2024-05-30T06:59:08.026370+0000","last_became_peered":"2024-05-30T06:59:08.026370+0000","last_unstale":"2024-05-30T07:00:52.507440+0000","last_undegraded":"2024-05-30T07:00:52.507440+0000","last_fullsized":"2024-05-30T07:00:52.507440+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:07:33.988552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":59,"num_read_kb":225284,"num_write":72,"num_write_kb":233475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417939+0000","last_change":"2024-05-30T06:59:07.018086+0000","last_active":"2024-05-30T06:59:54.417939+0000","last_peered":"2024-05-30T06:59:54.417939+0000","last_clean":"2024-05-30T06:59:54.417939+0000","last_became_active":"2024-05-30T06:59:07.017740+0000","last_became_peered":"2024-05-30T06:59:07.017740+0000","last_unstale":"2024-05-30T06:59:54.417939+0000","last_undegraded":"2024-05-30T06:59:54.417939+0000","last_fullsized":"2024-05-30T06:59:54.417939+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:16.444618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"130'87","reported_seq":178,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.498056+0000","last_change":"2024-05-30T06:59:08.015660+0000","last_active":"2024-05-30T07:00:52.498056+0000","last_peered":"2024-05-30T07:00:52.498056+0000","last_clean":"2024-05-30T07:00:52.498056+0000","last_became_active":"2024-05-30T06:59:08.015370+0000","last_became_peered":"2024-05-30T06:59:08.015370+0000","last_unstale":"2024-05-30T07:00:52.498056+0000","last_undegraded":"2024-05-30T07:00:52.498056+0000","last_fullsized":"2024-05-30T07:00:52.498056+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:10:59.558212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":87,"num_write_kb":299008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418143+0000","last_change":"2024-05-30T06:59:07.024249+0000","last_active":"2024-05-30T06:59:54.418143+0000","last_peered":"2024-05-30T06:59:54.418143+0000","last_clean":"2024-05-30T06:59:54.418143+0000","last_became_active":"2024-05-30T06:59:07.023895+0000","last_became_peered":"2024-05-30T06:59:07.023895+0000","last_unstale":"2024-05-30T06:59:54.418143+0000","last_undegraded":"2024-05-30T06:59:54.418143+0000","last_fullsized":"2024-05-30T06:59:54.418143+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:16:51.738852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"130'98","reported_seq":192,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.471161+0000","last_change":"2024-05-30T06:59:08.029322+0000","last_active":"2024-05-30T07:00:52.471161+0000","last_peered":"2024-05-30T07:00:52.471161+0000","last_clean":"2024-05-30T07:00:52.471161+0000","last_became_active":"2024-05-30T06:59:08.028959+0000","last_became_peered":"2024-05-30T06:59:08.028959+0000","last_unstale":"2024-05-30T07:00:52.471161+0000","last_undegraded":"2024-05-30T07:00:52.471161+0000","last_fullsized":"2024-05-30T07:00:52.471161+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:19.376389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":98,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"128'3","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418435+0000","last_change":"2024-05-30T06:59:07.019458+0000","last_active":"2024-05-30T06:59:54.418435+0000","last_peered":"2024-05-30T06:59:54.418435+0000","last_clean":"2024-05-30T06:59:54.418435+0000","last_became_active":"2024-05-30T06:59:07.019186+0000","last_became_peered":"2024-05-30T06:59:07.019186+0000","last_unstale":"2024-05-30T06:59:54.418435+0000","last_undegraded":"2024-05-30T06:59:54.418435+0000","last_fullsized":"2024-05-30T06:59:54.418435+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:53.047887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"130'90","reported_seq":170,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.412258+0000","last_change":"2024-05-30T06:59:08.035291+0000","last_active":"2024-05-30T07:00:52.412258+0000","last_peered":"2024-05-30T07:00:52.412258+0000","last_clean":"2024-05-30T07:00:52.412258+0000","last_became_active":"2024-05-30T06:59:08.034951+0000","last_became_peered":"2024-05-30T06:59:08.034951+0000","last_unstale":"2024-05-30T07:00:52.412258+0000","last_undegraded":"2024-05-30T07:00:52.412258+0000","last_fullsized":"2024-05-30T07:00:52.412258+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:21:42.071914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018629,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":245764,"num_write":90,"num_write_kb":315394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418019+0000","last_change":"2024-05-30T06:59:07.016536+0000","last_active":"2024-05-30T06:59:54.418019+0000","last_peered":"2024-05-30T06:59:54.418019+0000","last_clean":"2024-05-30T06:59:54.418019+0000","last_became_active":"2024-05-30T06:59:07.016202+0000","last_became_peered":"2024-05-30T06:59:07.016202+0000","last_unstale":"2024-05-30T06:59:54.418019+0000","last_undegraded":"2024-05-30T06:59:54.418019+0000","last_fullsized":"2024-05-30T06:59:54.418019+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:47:15.001802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"130'102","reported_seq":164,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.450963+0000","last_change":"2024-05-30T06:59:08.022686+0000","last_active":"2024-05-30T07:00:52.450963+0000","last_peered":"2024-05-30T07:00:52.450963+0000","last_clean":"2024-05-30T07:00:52.450963+0000","last_became_active":"2024-05-30T06:59:08.022436+0000","last_became_peered":"2024-05-30T06:59:08.022436+0000","last_unstale":"2024-05-30T07:00:52.450963+0000","last_undegraded":"2024-05-30T07:00:52.450963+0000","last_fullsized":"2024-05-30T07:00:52.450963+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:54.054104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":46,"num_read_kb":180226,"num_write":102,"num_write_kb":352257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417252+0000","last_change":"2024-05-30T06:59:07.017333+0000","last_active":"2024-05-30T06:59:54.417252+0000","last_peered":"2024-05-30T06:59:54.417252+0000","last_clean":"2024-05-30T06:59:54.417252+0000","last_became_active":"2024-05-30T06:59:07.017037+0000","last_became_peered":"2024-05-30T06:59:07.017037+0000","last_unstale":"2024-05-30T06:59:54.417252+0000","last_undegraded":"2024-05-30T06:59:54.417252+0000","last_fullsized":"2024-05-30T06:59:54.417252+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:18:59.328569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"130'76","reported_seq":152,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.505115+0000","last_change":"2024-05-30T06:59:08.038802+0000","last_active":"2024-05-30T07:00:52.505115+0000","last_peered":"2024-05-30T07:00:52.505115+0000","last_clean":"2024-05-30T07:00:52.505115+0000","last_became_active":"2024-05-30T06:59:08.038486+0000","last_became_peered":"2024-05-30T06:59:08.038486+0000","last_unstale":"2024-05-30T07:00:52.505115+0000","last_undegraded":"2024-05-30T07:00:52.505115+0000","last_fullsized":"2024-05-30T07:00:52.505115+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:34.693941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":60,"num_read_kb":245760,"num_write":76,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"130'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414047+0000","last_change":"2024-05-30T06:59:07.018462+0000","last_active":"2024-05-30T06:59:54.414047+0000","last_peered":"2024-05-30T06:59:54.414047+0000","last_clean":"2024-05-30T06:59:54.414047+0000","last_became_active":"2024-05-30T06:59:07.017946+0000","last_became_peered":"2024-05-30T06:59:07.017946+0000","last_unstale":"2024-05-30T06:59:54.414047+0000","last_undegraded":"2024-05-30T06:59:54.414047+0000","last_fullsized":"2024-05-30T06:59:54.414047+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:18:15.985022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"130'100","reported_seq":152,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.486103+0000","last_change":"2024-05-30T06:59:08.025933+0000","last_active":"2024-05-30T07:00:52.486103+0000","last_peered":"2024-05-30T07:00:52.486103+0000","last_clean":"2024-05-30T07:00:52.486103+0000","last_became_active":"2024-05-30T06:59:08.025557+0000","last_became_peered":"2024-05-30T06:59:08.025557+0000","last_unstale":"2024-05-30T07:00:52.486103+0000","last_undegraded":"2024-05-30T07:00:52.486103+0000","last_fullsized":"2024-05-30T07:00:52.486103+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:59.888055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":100,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"127'2","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417721+0000","last_change":"2024-05-30T06:59:07.020218+0000","last_active":"2024-05-30T06:59:54.417721+0000","last_peered":"2024-05-30T06:59:54.417721+0000","last_clean":"2024-05-30T06:59:54.417721+0000","last_became_active":"2024-05-30T06:59:07.018769+0000","last_became_peered":"2024-05-30T06:59:07.018769+0000","last_unstale":"2024-05-30T06:59:54.417721+0000","last_undegraded":"2024-05-30T06:59:54.417721+0000","last_fullsized":"2024-05-30T06:59:54.417721+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:06.907108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"130'90","reported_seq":185,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.417790+0000","last_change":"2024-05-30T06:59:08.032992+0000","last_active":"2024-05-30T07:00:52.417790+0000","last_peered":"2024-05-30T07:00:52.417790+0000","last_clean":"2024-05-30T07:00:52.417790+0000","last_became_active":"2024-05-30T06:59:08.032647+0000","last_became_peered":"2024-05-30T06:59:08.032647+0000","last_unstale":"2024-05-30T07:00:52.417790+0000","last_undegraded":"2024-05-30T07:00:52.417790+0000","last_fullsized":"2024-05-30T07:00:52.417790+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:12:45.810350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":79,"num_read_kb":323584,"num_write":90,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"130'34","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:51.049562+0000","last_change":"2024-05-30T06:59:07.021143+0000","last_active":"2024-05-30T07:00:51.049562+0000","last_peered":"2024-05-30T07:00:51.049562+0000","last_clean":"2024-05-30T07:00:51.049562+0000","last_became_active":"2024-05-30T06:59:07.020771+0000","last_became_peered":"2024-05-30T06:59:07.020771+0000","last_unstale":"2024-05-30T07:00:51.049562+0000","last_undegraded":"2024-05-30T07:00:51.049562+0000","last_fullsized":"2024-05-30T07:00:51.049562+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:42.840485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"130'84","reported_seq":192,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.513036+0000","last_change":"2024-05-30T06:59:08.038746+0000","last_active":"2024-05-30T07:00:52.513036+0000","last_peered":"2024-05-30T07:00:52.513036+0000","last_clean":"2024-05-30T07:00:52.513036+0000","last_became_active":"2024-05-30T06:59:08.038465+0000","last_became_peered":"2024-05-30T06:59:08.038465+0000","last_unstale":"2024-05-30T07:00:52.513036+0000","last_undegraded":"2024-05-30T07:00:52.513036+0000","last_fullsized":"2024-05-30T07:00:52.513036+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:42:53.672075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":92,"num_read_kb":376832,"num_write":84,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.483446+0000","last_change":"2024-05-30T06:59:07.019355+0000","last_active":"2024-05-30T06:59:54.483446+0000","last_peered":"2024-05-30T06:59:54.483446+0000","last_clean":"2024-05-30T06:59:54.483446+0000","last_became_active":"2024-05-30T06:59:07.019061+0000","last_became_peered":"2024-05-30T06:59:07.019061+0000","last_unstale":"2024-05-30T06:59:54.483446+0000","last_undegraded":"2024-05-30T06:59:54.483446+0000","last_fullsized":"2024-05-30T06:59:54.483446+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:57:26.978817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"130'98","reported_seq":162,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.490857+0000","last_change":"2024-05-30T06:59:08.032170+0000","last_active":"2024-05-30T07:00:52.490857+0000","last_peered":"2024-05-30T07:00:52.490857+0000","last_clean":"2024-05-30T07:00:52.490857+0000","last_became_active":"2024-05-30T06:59:08.030918+0000","last_became_peered":"2024-05-30T06:59:08.030918+0000","last_unstale":"2024-05-30T07:00:52.490857+0000","last_undegraded":"2024-05-30T07:00:52.490857+0000","last_fullsized":"2024-05-30T07:00:52.490857+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:33:46.570680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247464319,"num_objects":62,"num_object_clones":1,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":1,"num_read":49,"num_read_kb":200704,"num_write":96,"num_write_kb":307203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414573+0000","last_change":"2024-05-30T06:59:07.020348+0000","last_active":"2024-05-30T06:59:54.414573+0000","last_peered":"2024-05-30T06:59:54.414573+0000","last_clean":"2024-05-30T06:59:54.414573+0000","last_became_active":"2024-05-30T06:59:07.019991+0000","last_became_peered":"2024-05-30T06:59:07.019991+0000","last_unstale":"2024-05-30T06:59:54.414573+0000","last_undegraded":"2024-05-30T06:59:54.414573+0000","last_fullsized":"2024-05-30T06:59:54.414573+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:07:32.982335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"130'100","reported_seq":173,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.487557+0000","last_change":"2024-05-30T06:59:08.038690+0000","last_active":"2024-05-30T07:00:52.487557+0000","last_peered":"2024-05-30T07:00:52.487557+0000","last_clean":"2024-05-30T07:00:52.487557+0000","last_became_active":"2024-05-30T06:59:08.038380+0000","last_became_peered":"2024-05-30T06:59:08.038380+0000","last_unstale":"2024-05-30T07:00:52.487557+0000","last_undegraded":"2024-05-30T07:00:52.487557+0000","last_fullsized":"2024-05-30T07:00:52.487557+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:05:26.527928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":100,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.484996+0000","last_change":"2024-05-30T06:59:07.023295+0000","last_active":"2024-05-30T06:59:54.484996+0000","last_peered":"2024-05-30T06:59:54.484996+0000","last_clean":"2024-05-30T06:59:54.484996+0000","last_became_active":"2024-05-30T06:59:07.022933+0000","last_became_peered":"2024-05-30T06:59:07.022933+0000","last_unstale":"2024-05-30T06:59:54.484996+0000","last_undegraded":"2024-05-30T06:59:54.484996+0000","last_fullsized":"2024-05-30T06:59:54.484996+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:07.641666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"130'115","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.504340+0000","last_change":"2024-05-30T06:59:08.037751+0000","last_active":"2024-05-30T07:00:52.504340+0000","last_peered":"2024-05-30T07:00:52.504340+0000","last_clean":"2024-05-30T07:00:52.504340+0000","last_became_active":"2024-05-30T06:59:08.037505+0000","last_became_peered":"2024-05-30T06:59:08.037505+0000","last_unstale":"2024-05-30T07:00:52.504340+0000","last_undegraded":"2024-05-30T07:00:52.504340+0000","last_fullsized":"2024-05-30T07:00:52.504340+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:16.400946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":86,"num_read_kb":335876,"num_write":115,"num_write_kb":393217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419655+0000","last_change":"2024-05-30T06:59:07.025942+0000","last_active":"2024-05-30T06:59:54.419655+0000","last_peered":"2024-05-30T06:59:54.419655+0000","last_clean":"2024-05-30T06:59:54.419655+0000","last_became_active":"2024-05-30T06:59:07.025651+0000","last_became_peered":"2024-05-30T06:59:07.025651+0000","last_unstale":"2024-05-30T06:59:54.419655+0000","last_undegraded":"2024-05-30T06:59:54.419655+0000","last_fullsized":"2024-05-30T06:59:54.419655+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:21:41.065697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"130'97","reported_seq":187,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.501306+0000","last_change":"2024-05-30T06:59:08.023176+0000","last_active":"2024-05-30T07:00:52.501306+0000","last_peered":"2024-05-30T07:00:52.501306+0000","last_clean":"2024-05-30T07:00:52.501306+0000","last_became_active":"2024-05-30T06:59:08.022036+0000","last_became_peered":"2024-05-30T06:59:08.022036+0000","last_unstale":"2024-05-30T07:00:52.501306+0000","last_undegraded":"2024-05-30T07:00:52.501306+0000","last_fullsized":"2024-05-30T07:00:52.501306+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:49:46.450533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":97,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"130'30","reported_seq":77,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.150321+0000","last_change":"2024-05-30T06:59:07.012244+0000","last_active":"2024-05-30T07:00:52.150321+0000","last_peered":"2024-05-30T07:00:52.150321+0000","last_clean":"2024-05-30T07:00:52.150321+0000","last_became_active":"2024-05-30T06:59:07.011981+0000","last_became_peered":"2024-05-30T06:59:07.011981+0000","last_unstale":"2024-05-30T07:00:52.150321+0000","last_undegraded":"2024-05-30T07:00:52.150321+0000","last_fullsized":"2024-05-30T07:00:52.150321+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:45:53.245785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4755,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":29,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"130'113","reported_seq":207,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.483948+0000","last_change":"2024-05-30T06:59:08.036367+0000","last_active":"2024-05-30T07:00:52.483948+0000","last_peered":"2024-05-30T07:00:52.483948+0000","last_clean":"2024-05-30T07:00:52.483948+0000","last_became_active":"2024-05-30T06:59:08.035993+0000","last_became_peered":"2024-05-30T06:59:08.035993+0000","last_unstale":"2024-05-30T07:00:52.483948+0000","last_undegraded":"2024-05-30T07:00:52.483948+0000","last_fullsized":"2024-05-30T07:00:52.483948+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:16:52.745068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":113,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414433+0000","last_change":"2024-05-30T06:59:07.018219+0000","last_active":"2024-05-30T06:59:54.414433+0000","last_peered":"2024-05-30T06:59:54.414433+0000","last_clean":"2024-05-30T06:59:54.414433+0000","last_became_active":"2024-05-30T06:59:07.017622+0000","last_became_peered":"2024-05-30T06:59:07.017622+0000","last_unstale":"2024-05-30T06:59:54.414433+0000","last_undegraded":"2024-05-30T06:59:54.414433+0000","last_fullsized":"2024-05-30T06:59:54.414433+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:14.903621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"130'77","reported_seq":143,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.494131+0000","last_change":"2024-05-30T06:59:08.034173+0000","last_active":"2024-05-30T07:00:52.494131+0000","last_peered":"2024-05-30T07:00:52.494131+0000","last_clean":"2024-05-30T07:00:52.494131+0000","last_became_active":"2024-05-30T06:59:08.033874+0000","last_became_peered":"2024-05-30T06:59:08.033874+0000","last_unstale":"2024-05-30T07:00:52.494131+0000","last_undegraded":"2024-05-30T07:00:52.494131+0000","last_fullsized":"2024-05-30T07:00:52.494131+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:08:08.594337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":50,"num_read_kb":204800,"num_write":77,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"127'2","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419780+0000","last_change":"2024-05-30T06:59:07.027441+0000","last_active":"2024-05-30T06:59:54.419780+0000","last_peered":"2024-05-30T06:59:54.419780+0000","last_clean":"2024-05-30T06:59:54.419780+0000","last_became_active":"2024-05-30T06:59:07.027219+0000","last_became_peered":"2024-05-30T06:59:07.027219+0000","last_unstale":"2024-05-30T06:59:54.419780+0000","last_undegraded":"2024-05-30T06:59:54.419780+0000","last_fullsized":"2024-05-30T06:59:54.419780+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:58.881839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":381,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419731+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:59:54.419731+0000","last_peered":"2024-05-30T06:59:54.419731+0000","last_clean":"2024-05-30T06:59:54.419731+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:59:54.419731+0000","last_undegraded":"2024-05-30T06:59:54.419731+0000","last_fullsized":"2024-05-30T06:59:54.419731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":16844326603,"num_objects":4025,"num_object_clones":1,"num_object_copies":8050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4025,"num_whiteouts":1,"num_read":4099,"num_read_kb":16560184,"num_write":5631,"num_write_kb":19595307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33688715264,"data_stored":33688653206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5640,"ondisk_log_size":5640,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1706277,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":599,"num_write_kb":1886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3481600,"data_stored":3412554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":557,"ondisk_log_size":557,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575081,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3725524,"kb_used_data":3608332,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":90646316,"statfs":{"total":96636764160,"available":92821827584,"internally_reserved":0,"allocated":3694931968,"data_stored":3693994699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575082,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4680980,"kb_used_data":4545740,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":89690860,"statfs":{"total":96636764160,"available":91843440640,"internally_reserved":0,"allocated":4654837760,"data_stored":4653904457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575082,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3581648,"kb_used_data":3442248,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":90790192,"statfs":{"total":96636764160,"available":92969156608,"internally_reserved":0,"allocated":3524861952,"data_stored":3523931494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575081,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5183308,"kb_used_data":5035588,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":89188532,"statfs":{"total":96636764160,"available":91329056768,"internally_reserved":0,"allocated":5156442112,"data_stored":5155515779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575081,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4103504,"kb_used_data":3946056,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":90268336,"statfs":{"total":96636764160,"available":92434776064,"internally_reserved":0,"allocated":4040761344,"data_stored":4039835296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":161216967},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575080,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5367432,"kb_used_data":5232192,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":89004408,"statfs":{"total":96636764160,"available":91140513792,"internally_reserved":0,"allocated":5357764608,"data_stored":5356842395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575082,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3856184,"kb_used_data":3708464,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90515656,"statfs":{"total":96636764160,"available":92688031744,"internally_reserved":0,"allocated":3797467136,"data_stored":3796560308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575082,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3541308,"kb_used_data":3397748,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":90830532,"statfs":{"total":96636764160,"available":93010464768,"internally_reserved":0,"allocated":3479293952,"data_stored":3478383572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1720320,"data_stored":1705479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1724416,"data_stored":1701362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3477078016,"data_stored":3477078016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3795845120,"data_stored":3795845120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5356134400,"data_stored":5356126591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4039122944,"data_stored":4039115193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5154816000,"data_stored":5154800521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3523231744,"data_stored":3523216194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4651495424,"data_stored":4651483790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3690991616,"data_stored":3690987781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T07:01:14.020 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T07:01:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.201+0000 7f50d7000640 1 Processor -- start 2024-05-30T07:01:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.201+0000 7f50d7000640 1 -- start start 2024-05-30T07:01:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.201+0000 7f50d7000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50d0070260 0x7f50d00cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.201+0000 7f50d7000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50d0070a90 con 0x7f50d00cd4d0 2024-05-30T07:01:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.201+0000 7f50d7000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50d0070d70 con 0x7f50d006b960 2024-05-30T07:01:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.201+0000 7f50d7000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f50d00706a0 con 0x7f50d0070260 2024-05-30T07:01:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.201+0000 7f50cf400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50d0070260 0x7f50d00cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.201+0000 7f50cfe00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f50d00cd4d0 0x7f50d00ce860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41028/0 (socket says 172.21.15.37:41028) 2024-05-30T07:01:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.201+0000 7f50cfe00640 1 -- 172.21.15.37:0/2670262417 learned_addr learned my addr 172.21.15.37:0/2670262417 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.201+0000 7f50cf400640 1 -- 172.21.15.37:0/2670262417 >> v1:172.21.15.105:6789/0 conn(0x7f50d006b960 legacy=0x7f50d0162730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.201+0000 7f50cf400640 1 -- 172.21.15.37:0/2670262417 >> v1:172.21.15.37:6789/0 conn(0x7f50d00cd4d0 legacy=0x7f50d00ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.201+0000 7f50cf400640 1 -- 172.21.15.37:0/2670262417 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d00ce060 con 0x7f50d0070260 2024-05-30T07:01:14.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.205+0000 7f50cf400640 1 --2- 172.21.15.37:0/2670262417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d0070260 0x7f50d00cf0f0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0097c0 tx=0x7f50bc01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f999188ffdd69bc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.205+0000 7f50cea00640 1 -- 172.21.15.37:0/2670262417 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0b0070 con 0x7f50d0070260 2024-05-30T07:01:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.205+0000 7f50cea00640 1 -- 172.21.15.37:0/2670262417 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50bc0ab600 con 0x7f50d0070260 2024-05-30T07:01:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.205+0000 7f50cea00640 1 -- 172.21.15.37:0/2670262417 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0ab9d0 con 0x7f50d0070260 2024-05-30T07:01:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.205+0000 7f50d7000640 1 -- 172.21.15.37:0/2670262417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d0070260 msgr2=0x7f50d00cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.205+0000 7f50d7000640 1 --2- 172.21.15.37:0/2670262417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d0070260 0x7f50d00cf0f0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0097c0 tx=0x7f50bc01c380 comp rx=0 tx=0).stop 2024-05-30T07:01:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.205+0000 7f50d7000640 1 -- 172.21.15.37:0/2670262417 shutdown_connections 2024-05-30T07:01:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.205+0000 7f50d7000640 1 --2- 172.21.15.37:0/2670262417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d0070260 0x7f50d00cf0f0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.205+0000 7f50d7000640 1 -- 172.21.15.37:0/2670262417 >> 172.21.15.37:0/2670262417 conn(0x7f50d009aa60 msgr2=0x7f50d00b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.205+0000 7f50d7000640 1 -- 172.21.15.37:0/2670262417 shutdown_connections 2024-05-30T07:01:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.205+0000 7f50d7000640 1 -- 172.21.15.37:0/2670262417 wait complete. 2024-05-30T07:01:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50d7000640 1 Processor -- start 2024-05-30T07:01:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50d7000640 1 -- start start 2024-05-30T07:01:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50d7000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50d006b960 0x7f50d00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50d7000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d0070260 0x7f50d00caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50d7000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d00cd4d0 0x7f50d014a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50d7000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50d016d500 con 0x7f50d0070260 2024-05-30T07:01:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50d7000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f50d0071050 con 0x7f50d006b960 2024-05-30T07:01:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50d7000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f50d016d680 con 0x7f50d00cd4d0 2024-05-30T07:01:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50cf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d0070260 0x7f50d00caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50cf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d0070260 0x7f50d00caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55830/0 (socket says 172.21.15.37:55830) 2024-05-30T07:01:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50cf400640 1 -- 172.21.15.37:0/3550511851 learned_addr learned my addr 172.21.15.37:0/3550511851 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50cfe00640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50d006b960 0x7f50d00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50d5000640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d00cd4d0 0x7f50d014a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50cf400640 1 -- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d00cd4d0 msgr2=0x7f50d014a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50cf400640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d00cd4d0 0x7f50d014a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50cf400640 1 -- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50d006b960 msgr2=0x7f50d00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50cf400640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50d006b960 0x7f50d00b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50cf400640 1 -- 172.21.15.37:0/3550511851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d00b52f0 con 0x7f50d0070260 2024-05-30T07:01:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50cf400640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d0070260 0x7f50d00caf10 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0097c0 tx=0x7f50bc019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50c7e00640 1 -- 172.21.15.37:0/3550511851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0b8020 con 0x7f50d0070260 2024-05-30T07:01:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50c7e00640 1 -- 172.21.15.37:0/3550511851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50bc0aa950 con 0x7f50d0070260 2024-05-30T07:01:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50c7e00640 1 -- 172.21.15.37:0/3550511851 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0b0040 con 0x7f50d0070260 2024-05-30T07:01:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50d7000640 1 -- 172.21.15.37:0/3550511851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d00b55d0 con 0x7f50d0070260 2024-05-30T07:01:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50d7000640 1 -- 172.21.15.37:0/3550511851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d00c8970 con 0x7f50d0070260 2024-05-30T07:01:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.209+0000 7f50d7000640 1 -- 172.21.15.37:0/3550511851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d00c84c0 con 0x7f50d0070260 2024-05-30T07:01:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.213+0000 7f50c7e00640 1 -- 172.21.15.37:0/3550511851 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f50bc0bb020 con 0x7f50d0070260 2024-05-30T07:01:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.213+0000 7f50c7e00640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f50b006a540 0x7f50b006ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.213+0000 7f50c7e00640 1 -- 172.21.15.37:0/3550511851 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f50bc11fb00 con 0x7f50d0070260 2024-05-30T07:01:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.213+0000 7f50cfe00640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f50b006a540 0x7f50b006ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.213+0000 7f50cfe00640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f50b006a540 0x7f50b006ca00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f50c0005890 tx=0x7f50c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:14.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.217+0000 7f50c7e00640 1 -- 172.21.15.37:0/3550511851 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f50bc0c2030 con 0x7f50d0070260 2024-05-30T07:01:14.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.377+0000 7f50d7000640 1 -- 172.21.15.37:0/3550511851 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50d0068b20 con 0x7f50b006a540 2024-05-30T07:01:14.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.385+0000 7f50c7e00640 1 -- 172.21.15.37:0/3550511851 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254778 (secure 0 0 0) 0x7f50d0068b20 con 0x7f50b006a540 2024-05-30T07:01:14.389 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:01:14.390 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T07:01:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.389+0000 7f50d7000640 1 -- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f50b006a540 msgr2=0x7f50b006ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.389+0000 7f50d7000640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f50b006a540 0x7f50b006ca00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f50c0005890 tx=0x7f50c0009040 comp rx=0 tx=0).stop 2024-05-30T07:01:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.389+0000 7f50d7000640 1 -- 172.21.15.37:0/3550511851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d0070260 msgr2=0x7f50d00caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.389+0000 7f50d7000640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d0070260 0x7f50d00caf10 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0097c0 tx=0x7f50bc019120 comp rx=0 tx=0).stop 2024-05-30T07:01:14.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.389+0000 7f50d7000640 1 -- 172.21.15.37:0/3550511851 shutdown_connections 2024-05-30T07:01:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.389+0000 7f50d7000640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50d00cd4d0 0x7f50d014a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.389+0000 7f50d7000640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d0070260 0x7f50d00caf10 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.389+0000 7f50d7000640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f50b006a540 0x7f50b006ca00 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.389+0000 7f50d7000640 1 --2- 172.21.15.37:0/3550511851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50d006b960 0x7f50d00b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.389+0000 7f50d7000640 1 -- 172.21.15.37:0/3550511851 >> 172.21.15.37:0/3550511851 conn(0x7f50d009aa60 msgr2=0x7f50d00b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.389+0000 7f50d7000640 1 -- 172.21.15.37:0/3550511851 shutdown_connections 2024-05-30T07:01:14.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.389+0000 7f50d7000640 1 -- 172.21.15.37:0/3550511851 wait complete. 2024-05-30T07:01:14.410 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":700,"stamp":"2024-05-30T07:01:13.047497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16846623248,"num_objects":4050,"num_object_clones":1,"num_object_copies":8100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4050,"num_whiteouts":1,"num_read":4244,"num_read_kb":16560313,"num_write":6389,"num_write_kb":19599609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6314,"ondisk_log_size":6314,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":34039888,"kb_used_data":32916368,"kb_used_omap":12,"kb_used_meta":1123443,"kb_avail":720934832,"statfs":{"total":773094113280,"available":738237267968,"internally_reserved":0,"allocated":33706360832,"data_stored":33698968000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1150406192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003227"},"pg_stats":[{"pgid":"19.3f","version":"130'77","reported_seq":166,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.506911+0000","last_change":"2024-05-30T06:59:08.024160+0000","last_active":"2024-05-30T07:00:52.506911+0000","last_peered":"2024-05-30T07:00:52.506911+0000","last_clean":"2024-05-30T07:00:52.506911+0000","last_became_active":"2024-05-30T06:59:08.023564+0000","last_became_peered":"2024-05-30T06:59:08.023564+0000","last_unstale":"2024-05-30T07:00:52.506911+0000","last_undegraded":"2024-05-30T07:00:52.506911+0000","last_fullsized":"2024-05-30T07:00:52.506911+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:49:09.216308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":77,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"130'93","reported_seq":177,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.498880+0000","last_change":"2024-05-30T06:59:08.017254+0000","last_active":"2024-05-30T07:00:52.498880+0000","last_peered":"2024-05-30T07:00:52.498880+0000","last_clean":"2024-05-30T07:00:52.498880+0000","last_became_active":"2024-05-30T06:59:08.016947+0000","last_became_peered":"2024-05-30T06:59:08.016947+0000","last_unstale":"2024-05-30T07:00:52.498880+0000","last_undegraded":"2024-05-30T07:00:52.498880+0000","last_fullsized":"2024-05-30T07:00:52.498880+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:06:13.939169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":93,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"130'100","reported_seq":184,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.515911+0000","last_change":"2024-05-30T06:59:08.031486+0000","last_active":"2024-05-30T07:00:52.515911+0000","last_peered":"2024-05-30T07:00:52.515911+0000","last_clean":"2024-05-30T07:00:52.515911+0000","last_became_active":"2024-05-30T06:59:08.030677+0000","last_became_peered":"2024-05-30T06:59:08.030677+0000","last_unstale":"2024-05-30T07:00:52.515911+0000","last_undegraded":"2024-05-30T07:00:52.515911+0000","last_fullsized":"2024-05-30T07:00:52.515911+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:59:41.592123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":68,"num_read_kb":262148,"num_write":100,"num_write_kb":323587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"130'83","reported_seq":142,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.494948+0000","last_change":"2024-05-30T06:59:55.853693+0000","last_active":"2024-05-30T07:00:52.494948+0000","last_peered":"2024-05-30T07:00:52.494948+0000","last_clean":"2024-05-30T07:00:52.494948+0000","last_became_active":"2024-05-30T06:59:54.418117+0000","last_became_peered":"2024-05-30T06:59:54.418117+0000","last_unstale":"2024-05-30T07:00:52.494948+0000","last_undegraded":"2024-05-30T07:00:52.494948+0000","last_fullsized":"2024-05-30T07:00:52.494948+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:14:21.375372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":176129,"num_write":83,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3b","version":"130'68","reported_seq":125,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.474175+0000","last_change":"2024-05-30T06:59:08.046184+0000","last_active":"2024-05-30T07:00:52.474175+0000","last_peered":"2024-05-30T07:00:52.474175+0000","last_clean":"2024-05-30T07:00:52.474175+0000","last_became_active":"2024-05-30T06:59:08.045942+0000","last_became_peered":"2024-05-30T06:59:08.045942+0000","last_unstale":"2024-05-30T07:00:52.474175+0000","last_undegraded":"2024-05-30T07:00:52.474175+0000","last_fullsized":"2024-05-30T07:00:52.474175+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:27:44.098848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":41,"num_read_kb":167936,"num_write":68,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"130'99","reported_seq":201,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.366734+0000","last_change":"2024-05-30T06:59:08.029771+0000","last_active":"2024-05-30T07:00:52.366734+0000","last_peered":"2024-05-30T07:00:52.366734+0000","last_clean":"2024-05-30T07:00:52.366734+0000","last_became_active":"2024-05-30T06:59:08.029463+0000","last_became_peered":"2024-05-30T06:59:08.029463+0000","last_unstale":"2024-05-30T07:00:52.366734+0000","last_undegraded":"2024-05-30T07:00:52.366734+0000","last_fullsized":"2024-05-30T07:00:52.366734+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:13.314661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":99,"num_write_kb":344065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"130'75","reported_seq":139,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.367424+0000","last_change":"2024-05-30T06:59:08.035845+0000","last_active":"2024-05-30T07:00:52.367424+0000","last_peered":"2024-05-30T07:00:52.367424+0000","last_clean":"2024-05-30T07:00:52.367424+0000","last_became_active":"2024-05-30T06:59:08.035526+0000","last_became_peered":"2024-05-30T06:59:08.035526+0000","last_unstale":"2024-05-30T07:00:52.367424+0000","last_undegraded":"2024-05-30T07:00:52.367424+0000","last_fullsized":"2024-05-30T07:00:52.367424+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:19:00.334786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":48,"num_read_kb":196608,"num_write":75,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"130'88","reported_seq":157,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.491373+0000","last_change":"2024-05-30T06:59:08.035483+0000","last_active":"2024-05-30T07:00:52.491373+0000","last_peered":"2024-05-30T07:00:52.491373+0000","last_clean":"2024-05-30T07:00:52.491373+0000","last_became_active":"2024-05-30T06:59:08.034842+0000","last_became_peered":"2024-05-30T06:59:08.034842+0000","last_unstale":"2024-05-30T07:00:52.491373+0000","last_undegraded":"2024-05-30T07:00:52.491373+0000","last_fullsized":"2024-05-30T07:00:52.491373+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:07:18.302784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":53,"num_read_kb":217088,"num_write":88,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"130'89","reported_seq":157,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.439457+0000","last_change":"2024-05-30T06:59:08.044693+0000","last_active":"2024-05-30T07:00:52.439457+0000","last_peered":"2024-05-30T07:00:52.439457+0000","last_clean":"2024-05-30T07:00:52.439457+0000","last_became_active":"2024-05-30T06:59:08.044276+0000","last_became_peered":"2024-05-30T06:59:08.044276+0000","last_unstale":"2024-05-30T07:00:52.439457+0000","last_undegraded":"2024-05-30T07:00:52.439457+0000","last_fullsized":"2024-05-30T07:00:52.439457+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:14:17.604408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269764,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":52,"num_read_kb":208897,"num_write":89,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"130'65","reported_seq":144,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.422414+0000","last_change":"2024-05-30T06:59:08.016455+0000","last_active":"2024-05-30T07:00:52.422414+0000","last_peered":"2024-05-30T07:00:52.422414+0000","last_clean":"2024-05-30T07:00:52.422414+0000","last_became_active":"2024-05-30T06:59:08.016161+0000","last_became_peered":"2024-05-30T06:59:08.016161+0000","last_unstale":"2024-05-30T07:00:52.422414+0000","last_undegraded":"2024-05-30T07:00:52.422414+0000","last_fullsized":"2024-05-30T07:00:52.422414+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:50:42.911168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":65,"num_write_kb":225280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"130'100","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.488290+0000","last_change":"2024-05-30T06:59:08.022034+0000","last_active":"2024-05-30T07:00:52.488290+0000","last_peered":"2024-05-30T07:00:52.488290+0000","last_clean":"2024-05-30T07:00:52.488290+0000","last_became_active":"2024-05-30T06:59:08.021772+0000","last_became_peered":"2024-05-30T06:59:08.021772+0000","last_unstale":"2024-05-30T07:00:52.488290+0000","last_undegraded":"2024-05-30T07:00:52.488290+0000","last_fullsized":"2024-05-30T07:00:52.488290+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:41:37.594639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":100,"num_read_kb":409600,"num_write":100,"num_write_kb":356352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"130'80","reported_seq":194,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.503819+0000","last_change":"2024-05-30T06:59:08.044094+0000","last_active":"2024-05-30T07:00:52.503819+0000","last_peered":"2024-05-30T07:00:52.503819+0000","last_clean":"2024-05-30T07:00:52.503819+0000","last_became_active":"2024-05-30T06:59:08.043835+0000","last_became_peered":"2024-05-30T06:59:08.043835+0000","last_unstale":"2024-05-30T07:00:52.503819+0000","last_undegraded":"2024-05-30T07:00:52.503819+0000","last_fullsized":"2024-05-30T07:00:52.503819+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:16:54.524337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":98,"num_read_kb":385028,"num_write":80,"num_write_kb":278529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"130'84","reported_seq":184,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.432364+0000","last_change":"2024-05-30T06:59:08.025217+0000","last_active":"2024-05-30T07:00:52.432364+0000","last_peered":"2024-05-30T07:00:52.432364+0000","last_clean":"2024-05-30T07:00:52.432364+0000","last_became_active":"2024-05-30T06:59:08.024478+0000","last_became_peered":"2024-05-30T06:59:08.024478+0000","last_unstale":"2024-05-30T07:00:52.432364+0000","last_undegraded":"2024-05-30T07:00:52.432364+0000","last_fullsized":"2024-05-30T07:00:52.432364+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:29:37.627610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":84,"num_read_kb":335874,"num_write":84,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"130'83","reported_seq":162,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.506927+0000","last_change":"2024-05-30T06:59:08.022376+0000","last_active":"2024-05-30T07:00:52.506927+0000","last_peered":"2024-05-30T07:00:52.506927+0000","last_clean":"2024-05-30T07:00:52.506927+0000","last_became_active":"2024-05-30T06:59:08.022058+0000","last_became_peered":"2024-05-30T06:59:08.022058+0000","last_unstale":"2024-05-30T07:00:52.506927+0000","last_undegraded":"2024-05-30T07:00:52.506927+0000","last_fullsized":"2024-05-30T07:00:52.506927+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:22:42.845029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":63,"num_read_kb":249858,"num_write":83,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"130'75","reported_seq":122,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.352230+0000","last_change":"2024-05-30T06:59:08.027564+0000","last_active":"2024-05-30T07:00:52.352230+0000","last_peered":"2024-05-30T07:00:52.352230+0000","last_clean":"2024-05-30T07:00:52.352230+0000","last_became_active":"2024-05-30T06:59:08.027303+0000","last_became_peered":"2024-05-30T06:59:08.027303+0000","last_unstale":"2024-05-30T07:00:52.352230+0000","last_undegraded":"2024-05-30T07:00:52.352230+0000","last_fullsized":"2024-05-30T07:00:52.352230+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:59:23.939287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":31,"num_read_kb":126976,"num_write":75,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"130'84","reported_seq":152,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.496905+0000","last_change":"2024-05-30T06:59:08.023401+0000","last_active":"2024-05-30T07:00:52.496905+0000","last_peered":"2024-05-30T07:00:52.496905+0000","last_clean":"2024-05-30T07:00:52.496905+0000","last_became_active":"2024-05-30T06:59:08.022914+0000","last_became_peered":"2024-05-30T06:59:08.022914+0000","last_unstale":"2024-05-30T07:00:52.496905+0000","last_undegraded":"2024-05-30T07:00:52.496905+0000","last_fullsized":"2024-05-30T07:00:52.496905+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:52:22.042222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":52,"num_read_kb":212992,"num_write":84,"num_write_kb":278528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"130'72","reported_seq":131,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.463163+0000","last_change":"2024-05-30T06:59:08.024708+0000","last_active":"2024-05-30T07:00:52.463163+0000","last_peered":"2024-05-30T07:00:52.463163+0000","last_clean":"2024-05-30T07:00:52.463163+0000","last_became_active":"2024-05-30T06:59:08.024445+0000","last_became_peered":"2024-05-30T06:59:08.024445+0000","last_unstale":"2024-05-30T07:00:52.463163+0000","last_undegraded":"2024-05-30T07:00:52.463163+0000","last_fullsized":"2024-05-30T07:00:52.463163+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:47:16.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":176128,"num_write":72,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"130'94","reported_seq":199,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.442856+0000","last_change":"2024-05-30T06:59:08.023258+0000","last_active":"2024-05-30T07:00:52.442856+0000","last_peered":"2024-05-30T07:00:52.442856+0000","last_clean":"2024-05-30T07:00:52.442856+0000","last_became_active":"2024-05-30T06:59:08.017709+0000","last_became_peered":"2024-05-30T06:59:08.017709+0000","last_unstale":"2024-05-30T07:00:52.442856+0000","last_undegraded":"2024-05-30T07:00:52.442856+0000","last_fullsized":"2024-05-30T07:00:52.442856+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:15.909838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":89,"num_read_kb":364544,"num_write":94,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"130'94","reported_seq":181,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.480060+0000","last_change":"2024-05-30T06:59:08.026237+0000","last_active":"2024-05-30T07:00:52.480060+0000","last_peered":"2024-05-30T07:00:52.480060+0000","last_clean":"2024-05-30T07:00:52.480060+0000","last_became_active":"2024-05-30T06:59:08.025981+0000","last_became_peered":"2024-05-30T06:59:08.025981+0000","last_unstale":"2024-05-30T07:00:52.480060+0000","last_undegraded":"2024-05-30T07:00:52.480060+0000","last_fullsized":"2024-05-30T07:00:52.480060+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:08:22.095245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":71,"num_read_kb":278531,"num_write":94,"num_write_kb":335873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"130'84","reported_seq":161,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.422359+0000","last_change":"2024-05-30T06:59:08.018790+0000","last_active":"2024-05-30T07:00:52.422359+0000","last_peered":"2024-05-30T07:00:52.422359+0000","last_clean":"2024-05-30T07:00:52.422359+0000","last_became_active":"2024-05-30T06:59:08.015033+0000","last_became_peered":"2024-05-30T06:59:08.015033+0000","last_unstale":"2024-05-30T07:00:52.422359+0000","last_undegraded":"2024-05-30T07:00:52.422359+0000","last_fullsized":"2024-05-30T07:00:52.422359+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:01:57.819719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":61,"num_read_kb":241666,"num_write":83,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"130'100","reported_seq":207,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.451815+0000","last_change":"2024-05-30T06:59:08.046183+0000","last_active":"2024-05-30T07:00:52.451815+0000","last_peered":"2024-05-30T07:00:52.451815+0000","last_clean":"2024-05-30T07:00:52.451815+0000","last_became_active":"2024-05-30T06:59:08.045891+0000","last_became_peered":"2024-05-30T06:59:08.045891+0000","last_unstale":"2024-05-30T07:00:52.451815+0000","last_undegraded":"2024-05-30T07:00:52.451815+0000","last_fullsized":"2024-05-30T07:00:52.451815+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:52:32.696164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":91,"num_read_kb":368641,"num_write":100,"num_write_kb":344066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"130'83","reported_seq":155,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.440845+0000","last_change":"2024-05-30T06:59:08.019956+0000","last_active":"2024-05-30T07:00:52.440845+0000","last_peered":"2024-05-30T07:00:52.440845+0000","last_clean":"2024-05-30T07:00:52.440845+0000","last_became_active":"2024-05-30T06:59:08.019670+0000","last_became_peered":"2024-05-30T06:59:08.019670+0000","last_unstale":"2024-05-30T07:00:52.440845+0000","last_undegraded":"2024-05-30T07:00:52.440845+0000","last_fullsized":"2024-05-30T07:00:52.440845+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:52:32.696164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":56,"num_read_kb":225281,"num_write":82,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"130'98","reported_seq":169,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.440422+0000","last_change":"2024-05-30T06:59:08.044096+0000","last_active":"2024-05-30T07:00:52.440422+0000","last_peered":"2024-05-30T07:00:52.440422+0000","last_clean":"2024-05-30T07:00:52.440422+0000","last_became_active":"2024-05-30T06:59:08.043786+0000","last_became_peered":"2024-05-30T06:59:08.043786+0000","last_unstale":"2024-05-30T07:00:52.440422+0000","last_undegraded":"2024-05-30T07:00:52.440422+0000","last_fullsized":"2024-05-30T07:00:52.440422+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:51:04.988561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":97,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"130'85","reported_seq":157,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.451401+0000","last_change":"2024-05-30T06:59:08.022594+0000","last_active":"2024-05-30T07:00:52.451401+0000","last_peered":"2024-05-30T07:00:52.451401+0000","last_clean":"2024-05-30T07:00:52.451401+0000","last_became_active":"2024-05-30T06:59:08.022293+0000","last_became_peered":"2024-05-30T06:59:08.022293+0000","last_unstale":"2024-05-30T07:00:52.451401+0000","last_undegraded":"2024-05-30T07:00:52.451401+0000","last_fullsized":"2024-05-30T07:00:52.451401+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:27:44.098848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":56,"num_read_kb":212996,"num_write":85,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"130'92","reported_seq":172,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.465900+0000","last_change":"2024-05-30T06:59:08.038685+0000","last_active":"2024-05-30T07:00:52.465900+0000","last_peered":"2024-05-30T07:00:52.465900+0000","last_clean":"2024-05-30T07:00:52.465900+0000","last_became_active":"2024-05-30T06:59:08.038414+0000","last_became_peered":"2024-05-30T06:59:08.038414+0000","last_unstale":"2024-05-30T07:00:52.465900+0000","last_undegraded":"2024-05-30T07:00:52.465900+0000","last_fullsized":"2024-05-30T07:00:52.465900+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:15:35.587906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":64,"num_read_kb":258049,"num_write":92,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"130'84","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.474185+0000","last_change":"2024-05-30T06:59:56.500807+0000","last_active":"2024-05-30T07:00:52.474185+0000","last_peered":"2024-05-30T07:00:52.474185+0000","last_clean":"2024-05-30T07:00:52.474185+0000","last_became_active":"2024-05-30T06:59:54.423066+0000","last_became_peered":"2024-05-30T06:59:54.423066+0000","last_unstale":"2024-05-30T07:00:52.474185+0000","last_undegraded":"2024-05-30T07:00:52.474185+0000","last_fullsized":"2024-05-30T07:00:52.474185+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:54:28.187315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":83,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"130'96","reported_seq":177,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.484611+0000","last_change":"2024-05-30T06:59:08.024951+0000","last_active":"2024-05-30T07:00:52.484611+0000","last_peered":"2024-05-30T07:00:52.484611+0000","last_clean":"2024-05-30T07:00:52.484611+0000","last_became_active":"2024-05-30T06:59:08.024354+0000","last_became_peered":"2024-05-30T06:59:08.024354+0000","last_unstale":"2024-05-30T07:00:52.484611+0000","last_undegraded":"2024-05-30T07:00:52.484611+0000","last_fullsized":"2024-05-30T07:00:52.484611+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:51:04.466523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":96,"num_write_kb":331776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"130'90","reported_seq":139,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.483923+0000","last_change":"2024-05-30T06:59:08.033925+0000","last_active":"2024-05-30T07:00:52.483923+0000","last_peered":"2024-05-30T07:00:52.483923+0000","last_clean":"2024-05-30T07:00:52.483923+0000","last_became_active":"2024-05-30T06:59:08.033552+0000","last_became_peered":"2024-05-30T06:59:08.033552+0000","last_unstale":"2024-05-30T07:00:52.483923+0000","last_undegraded":"2024-05-30T07:00:52.483923+0000","last_fullsized":"2024-05-30T07:00:52.483923+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:15:35.587906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":33,"num_read_kb":135168,"num_write":90,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"130'97","reported_seq":183,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.491951+0000","last_change":"2024-05-30T06:59:08.033338+0000","last_active":"2024-05-30T07:00:52.491951+0000","last_peered":"2024-05-30T07:00:52.491951+0000","last_clean":"2024-05-30T07:00:52.491951+0000","last_became_active":"2024-05-30T06:59:08.032376+0000","last_became_peered":"2024-05-30T06:59:08.032376+0000","last_unstale":"2024-05-30T07:00:52.491951+0000","last_undegraded":"2024-05-30T07:00:52.491951+0000","last_fullsized":"2024-05-30T07:00:52.491951+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:19:12.129168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":70,"num_read_kb":286720,"num_write":97,"num_write_kb":323585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"130'92","reported_seq":172,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.493486+0000","last_change":"2024-05-30T06:59:08.032860+0000","last_active":"2024-05-30T07:00:52.493486+0000","last_peered":"2024-05-30T07:00:52.493486+0000","last_clean":"2024-05-30T07:00:52.493486+0000","last_became_active":"2024-05-30T06:59:08.032457+0000","last_became_peered":"2024-05-30T06:59:08.032457+0000","last_unstale":"2024-05-30T07:00:52.493486+0000","last_undegraded":"2024-05-30T07:00:52.493486+0000","last_fullsized":"2024-05-30T07:00:52.493486+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:08.647882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":92,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"130'82","reported_seq":191,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.462021+0000","last_change":"2024-05-30T06:59:08.039799+0000","last_active":"2024-05-30T07:00:52.462021+0000","last_peered":"2024-05-30T07:00:52.462021+0000","last_clean":"2024-05-30T07:00:52.462021+0000","last_became_active":"2024-05-30T06:59:08.039524+0000","last_became_peered":"2024-05-30T06:59:08.039524+0000","last_unstale":"2024-05-30T07:00:52.462021+0000","last_undegraded":"2024-05-30T07:00:52.462021+0000","last_fullsized":"2024-05-30T07:00:52.462021+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:32:19.058834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":93,"num_read_kb":380928,"num_write":82,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"130'87","reported_seq":176,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.499465+0000","last_change":"2024-05-30T06:59:08.025201+0000","last_active":"2024-05-30T07:00:52.499465+0000","last_peered":"2024-05-30T07:00:52.499465+0000","last_clean":"2024-05-30T07:00:52.499465+0000","last_became_active":"2024-05-30T06:59:08.023719+0000","last_became_peered":"2024-05-30T06:59:08.023719+0000","last_unstale":"2024-05-30T07:00:52.499465+0000","last_undegraded":"2024-05-30T07:00:52.499465+0000","last_fullsized":"2024-05-30T07:00:52.499465+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:51.605688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":73,"num_read_kb":290818,"num_write":87,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"130'71","reported_seq":132,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.502714+0000","last_change":"2024-05-30T06:59:08.022581+0000","last_active":"2024-05-30T07:00:52.502714+0000","last_peered":"2024-05-30T07:00:52.502714+0000","last_clean":"2024-05-30T07:00:52.502714+0000","last_became_active":"2024-05-30T06:59:08.017322+0000","last_became_peered":"2024-05-30T06:59:08.017322+0000","last_unstale":"2024-05-30T07:00:52.502714+0000","last_undegraded":"2024-05-30T07:00:52.502714+0000","last_fullsized":"2024-05-30T07:00:52.502714+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:23.377454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192938245,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":44,"num_read_kb":180224,"num_write":71,"num_write_kb":237569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"127'4","reported_seq":22,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419989+0000","last_change":"2024-05-30T06:59:07.025645+0000","last_active":"2024-05-30T06:59:54.419989+0000","last_peered":"2024-05-30T06:59:54.419989+0000","last_clean":"2024-05-30T06:59:54.419989+0000","last_became_active":"2024-05-30T06:59:07.025401+0000","last_became_peered":"2024-05-30T06:59:07.025401+0000","last_unstale":"2024-05-30T06:59:54.419989+0000","last_undegraded":"2024-05-30T06:59:54.419989+0000","last_fullsized":"2024-05-30T06:59:54.419989+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:12.308444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"130'96","reported_seq":181,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.448896+0000","last_change":"2024-05-30T06:59:08.037515+0000","last_active":"2024-05-30T07:00:52.448896+0000","last_peered":"2024-05-30T07:00:52.448896+0000","last_clean":"2024-05-30T07:00:52.448896+0000","last_became_active":"2024-05-30T06:59:08.037242+0000","last_became_peered":"2024-05-30T06:59:08.037242+0000","last_unstale":"2024-05-30T07:00:52.448896+0000","last_undegraded":"2024-05-30T07:00:52.448896+0000","last_fullsized":"2024-05-30T07:00:52.448896+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:21:24.557259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":69,"num_read_kb":266244,"num_write":96,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"127'1","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418391+0000","last_change":"2024-05-30T06:59:07.028000+0000","last_active":"2024-05-30T06:59:54.418391+0000","last_peered":"2024-05-30T06:59:54.418391+0000","last_clean":"2024-05-30T06:59:54.418391+0000","last_became_active":"2024-05-30T06:59:07.027686+0000","last_became_peered":"2024-05-30T06:59:07.027686+0000","last_unstale":"2024-05-30T06:59:54.418391+0000","last_undegraded":"2024-05-30T06:59:54.418391+0000","last_fullsized":"2024-05-30T06:59:54.418391+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:22:41.838812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"130'88","reported_seq":174,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.340623+0000","last_change":"2024-05-30T06:59:08.039191+0000","last_active":"2024-05-30T07:00:52.340623+0000","last_peered":"2024-05-30T07:00:52.340623+0000","last_clean":"2024-05-30T07:00:52.340623+0000","last_became_active":"2024-05-30T06:59:08.038891+0000","last_became_peered":"2024-05-30T06:59:08.038891+0000","last_unstale":"2024-05-30T07:00:52.340623+0000","last_undegraded":"2024-05-30T07:00:52.340623+0000","last_fullsized":"2024-05-30T07:00:52.340623+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:08:22.095245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075589,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":70,"num_read_kb":278530,"num_write":88,"num_write_kb":290818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"128'3","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414411+0000","last_change":"2024-05-30T06:59:07.021128+0000","last_active":"2024-05-30T06:59:54.414411+0000","last_peered":"2024-05-30T06:59:54.414411+0000","last_clean":"2024-05-30T06:59:54.414411+0000","last_became_active":"2024-05-30T06:59:07.020820+0000","last_became_peered":"2024-05-30T06:59:07.020820+0000","last_unstale":"2024-05-30T06:59:54.414411+0000","last_undegraded":"2024-05-30T06:59:54.414411+0000","last_fullsized":"2024-05-30T06:59:54.414411+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:01:56.813502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"130'111","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.499234+0000","last_change":"2024-05-30T06:59:08.033837+0000","last_active":"2024-05-30T07:00:52.499234+0000","last_peered":"2024-05-30T07:00:52.499234+0000","last_clean":"2024-05-30T07:00:52.499234+0000","last_became_active":"2024-05-30T06:59:08.033506+0000","last_became_peered":"2024-05-30T06:59:08.033506+0000","last_unstale":"2024-05-30T07:00:52.499234+0000","last_undegraded":"2024-05-30T07:00:52.499234+0000","last_fullsized":"2024-05-30T07:00:52.499234+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:41:37.594639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":87,"num_read_kb":356352,"num_write":111,"num_write_kb":364544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"127'2","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.485359+0000","last_change":"2024-05-30T06:59:07.025478+0000","last_active":"2024-05-30T06:59:54.485359+0000","last_peered":"2024-05-30T06:59:54.485359+0000","last_clean":"2024-05-30T06:59:54.485359+0000","last_became_active":"2024-05-30T06:59:07.025201+0000","last_became_peered":"2024-05-30T06:59:07.025201+0000","last_unstale":"2024-05-30T06:59:54.485359+0000","last_undegraded":"2024-05-30T06:59:54.485359+0000","last_fullsized":"2024-05-30T06:59:54.485359+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:37:03.894636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"130'91","reported_seq":162,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.515252+0000","last_change":"2024-05-30T06:59:08.022157+0000","last_active":"2024-05-30T07:00:52.515252+0000","last_peered":"2024-05-30T07:00:52.515252+0000","last_clean":"2024-05-30T07:00:52.515252+0000","last_became_active":"2024-05-30T06:59:08.017121+0000","last_became_peered":"2024-05-30T06:59:08.017121+0000","last_unstale":"2024-05-30T07:00:52.515252+0000","last_undegraded":"2024-05-30T07:00:52.515252+0000","last_fullsized":"2024-05-30T07:00:52.515252+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:18:16.991239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":91,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.484877+0000","last_change":"2024-05-30T06:59:07.026285+0000","last_active":"2024-05-30T06:59:54.484877+0000","last_peered":"2024-05-30T06:59:54.484877+0000","last_clean":"2024-05-30T06:59:54.484877+0000","last_became_active":"2024-05-30T06:59:07.025467+0000","last_became_peered":"2024-05-30T06:59:07.025467+0000","last_unstale":"2024-05-30T06:59:54.484877+0000","last_undegraded":"2024-05-30T06:59:54.484877+0000","last_fullsized":"2024-05-30T06:59:54.484877+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:37.636868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"130'89","reported_seq":196,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.476545+0000","last_change":"2024-05-30T06:59:08.022678+0000","last_active":"2024-05-30T07:00:52.476545+0000","last_peered":"2024-05-30T07:00:52.476545+0000","last_clean":"2024-05-30T07:00:52.476545+0000","last_became_active":"2024-05-30T06:59:08.022387+0000","last_became_peered":"2024-05-30T06:59:08.022387+0000","last_unstale":"2024-05-30T07:00:52.476545+0000","last_undegraded":"2024-05-30T07:00:52.476545+0000","last_fullsized":"2024-05-30T07:00:52.476545+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:30:30.629687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":91,"num_read_kb":372736,"num_write":89,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417948+0000","last_change":"2024-05-30T06:59:07.020549+0000","last_active":"2024-05-30T06:59:54.417948+0000","last_peered":"2024-05-30T06:59:54.417948+0000","last_clean":"2024-05-30T06:59:54.417948+0000","last_became_active":"2024-05-30T06:59:07.020278+0000","last_became_peered":"2024-05-30T06:59:07.020278+0000","last_unstale":"2024-05-30T06:59:54.417948+0000","last_undegraded":"2024-05-30T06:59:54.417948+0000","last_fullsized":"2024-05-30T06:59:54.417948+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:33:45.564464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"130'82","reported_seq":168,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.483472+0000","last_change":"2024-05-30T06:59:08.035741+0000","last_active":"2024-05-30T07:00:52.483472+0000","last_peered":"2024-05-30T07:00:52.483472+0000","last_clean":"2024-05-30T07:00:52.483472+0000","last_became_active":"2024-05-30T06:59:08.035015+0000","last_became_peered":"2024-05-30T06:59:08.035015+0000","last_unstale":"2024-05-30T07:00:52.483472+0000","last_undegraded":"2024-05-30T07:00:52.483472+0000","last_fullsized":"2024-05-30T07:00:52.483472+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:31:05.904917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":70,"num_read_kb":286720,"num_write":82,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417507+0000","last_change":"2024-05-30T06:59:07.015142+0000","last_active":"2024-05-30T06:59:54.417507+0000","last_peered":"2024-05-30T06:59:54.417507+0000","last_clean":"2024-05-30T06:59:54.417507+0000","last_became_active":"2024-05-30T06:59:07.013998+0000","last_became_peered":"2024-05-30T06:59:07.013998+0000","last_unstale":"2024-05-30T06:59:54.417507+0000","last_undegraded":"2024-05-30T06:59:54.417507+0000","last_fullsized":"2024-05-30T06:59:54.417507+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:07:17.296567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"130'85","reported_seq":165,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.463536+0000","last_change":"2024-05-30T06:59:08.012136+0000","last_active":"2024-05-30T07:00:52.463536+0000","last_peered":"2024-05-30T07:00:52.463536+0000","last_clean":"2024-05-30T07:00:52.463536+0000","last_became_active":"2024-05-30T06:59:08.011821+0000","last_became_peered":"2024-05-30T06:59:08.011821+0000","last_unstale":"2024-05-30T07:00:52.463536+0000","last_undegraded":"2024-05-30T07:00:52.463536+0000","last_fullsized":"2024-05-30T07:00:52.463536+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:42:18.685808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":85,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.479813+0000","last_change":"2024-05-30T06:59:07.018234+0000","last_active":"2024-05-30T06:59:54.479813+0000","last_peered":"2024-05-30T06:59:54.479813+0000","last_clean":"2024-05-30T06:59:54.479813+0000","last_became_active":"2024-05-30T06:59:07.017948+0000","last_became_peered":"2024-05-30T06:59:07.017948+0000","last_unstale":"2024-05-30T06:59:54.479813+0000","last_undegraded":"2024-05-30T06:59:54.479813+0000","last_fullsized":"2024-05-30T06:59:54.479813+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:58.214120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"130'74","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.458195+0000","last_change":"2024-05-30T06:59:08.024166+0000","last_active":"2024-05-30T07:00:52.458195+0000","last_peered":"2024-05-30T07:00:52.458195+0000","last_clean":"2024-05-30T07:00:52.458195+0000","last_became_active":"2024-05-30T06:59:08.023873+0000","last_became_peered":"2024-05-30T06:59:08.023873+0000","last_unstale":"2024-05-30T07:00:52.458195+0000","last_undegraded":"2024-05-30T07:00:52.458195+0000","last_fullsized":"2024-05-30T07:00:52.458195+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:15:02.554710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":74,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"128'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418561+0000","last_change":"2024-05-30T06:59:07.024511+0000","last_active":"2024-05-30T06:59:54.418561+0000","last_peered":"2024-05-30T06:59:54.418561+0000","last_clean":"2024-05-30T06:59:54.418561+0000","last_became_active":"2024-05-30T06:59:07.024244+0000","last_became_peered":"2024-05-30T06:59:07.024244+0000","last_unstale":"2024-05-30T06:59:54.418561+0000","last_undegraded":"2024-05-30T06:59:54.418561+0000","last_fullsized":"2024-05-30T06:59:54.418561+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:55.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"130'72","reported_seq":128,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.434383+0000","last_change":"2024-05-30T06:59:08.025397+0000","last_active":"2024-05-30T07:00:52.434383+0000","last_peered":"2024-05-30T07:00:52.434383+0000","last_clean":"2024-05-30T07:00:52.434383+0000","last_became_active":"2024-05-30T06:59:08.023906+0000","last_became_peered":"2024-05-30T06:59:08.023906+0000","last_unstale":"2024-05-30T07:00:52.434383+0000","last_undegraded":"2024-05-30T07:00:52.434383+0000","last_fullsized":"2024-05-30T07:00:52.434383+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:34.458628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230686900,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":40,"num_read_kb":159745,"num_write":72,"num_write_kb":258049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418997+0000","last_change":"2024-05-30T06:59:07.014122+0000","last_active":"2024-05-30T06:59:54.418997+0000","last_peered":"2024-05-30T06:59:54.418997+0000","last_clean":"2024-05-30T06:59:54.418997+0000","last_became_active":"2024-05-30T06:59:07.013813+0000","last_became_peered":"2024-05-30T06:59:07.013813+0000","last_unstale":"2024-05-30T06:59:54.418997+0000","last_undegraded":"2024-05-30T06:59:54.418997+0000","last_fullsized":"2024-05-30T06:59:54.418997+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:50.599472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"130'78","reported_seq":174,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.503992+0000","last_change":"2024-05-30T06:59:08.039459+0000","last_active":"2024-05-30T07:00:52.503992+0000","last_peered":"2024-05-30T07:00:52.503992+0000","last_clean":"2024-05-30T07:00:52.503992+0000","last_became_active":"2024-05-30T06:59:08.039187+0000","last_became_peered":"2024-05-30T06:59:08.039187+0000","last_unstale":"2024-05-30T07:00:52.503992+0000","last_undegraded":"2024-05-30T07:00:52.503992+0000","last_fullsized":"2024-05-30T07:00:52.503992+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:33:34.546284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":77,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"130'24","reported_seq":42,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.159062+0000","last_change":"2024-05-30T06:59:07.023207+0000","last_active":"2024-05-30T07:00:52.159062+0000","last_peered":"2024-05-30T07:00:52.159062+0000","last_clean":"2024-05-30T07:00:52.159062+0000","last_became_active":"2024-05-30T06:59:07.022910+0000","last_became_peered":"2024-05-30T06:59:07.022910+0000","last_unstale":"2024-05-30T07:00:52.159062+0000","last_undegraded":"2024-05-30T07:00:52.159062+0000","last_fullsized":"2024-05-30T07:00:52.159062+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:02:20.542236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"130'84","reported_seq":166,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.394215+0000","last_change":"2024-05-30T06:59:08.039689+0000","last_active":"2024-05-30T07:00:52.394215+0000","last_peered":"2024-05-30T07:00:52.394215+0000","last_clean":"2024-05-30T07:00:52.394215+0000","last_became_active":"2024-05-30T06:59:08.039393+0000","last_became_peered":"2024-05-30T06:59:08.039393+0000","last_unstale":"2024-05-30T07:00:52.394215+0000","last_undegraded":"2024-05-30T07:00:52.394215+0000","last_fullsized":"2024-05-30T07:00:52.394215+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:00:59.299956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":66,"num_read_kb":253956,"num_write":82,"num_write_kb":278530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"130'436","reported_seq":454,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:58.198089+0000","last_change":"2024-05-30T06:59:07.014432+0000","last_active":"2024-05-30T07:00:58.198089+0000","last_peered":"2024-05-30T07:00:58.198089+0000","last_clean":"2024-05-30T07:00:58.198089+0000","last_became_active":"2024-05-30T06:59:07.014000+0000","last_became_peered":"2024-05-30T06:59:07.014000+0000","last_unstale":"2024-05-30T07:00:58.198089+0000","last_undegraded":"2024-05-30T07:00:58.198089+0000","last_fullsized":"2024-05-30T07:00:58.198089+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:10:36.275003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1700724,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":1804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"130'97","reported_seq":163,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.483361+0000","last_change":"2024-05-30T06:59:08.022261+0000","last_active":"2024-05-30T07:00:52.483361+0000","last_peered":"2024-05-30T07:00:52.483361+0000","last_clean":"2024-05-30T07:00:52.483361+0000","last_became_active":"2024-05-30T06:59:08.022009+0000","last_became_peered":"2024-05-30T06:59:08.022009+0000","last_unstale":"2024-05-30T07:00:52.483361+0000","last_undegraded":"2024-05-30T07:00:52.483361+0000","last_fullsized":"2024-05-30T07:00:52.483361+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:20:20.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":50,"num_read_kb":200705,"num_write":97,"num_write_kb":327681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417486+0000","last_change":"2024-05-30T06:59:07.013707+0000","last_active":"2024-05-30T06:59:54.417486+0000","last_peered":"2024-05-30T06:59:54.417486+0000","last_clean":"2024-05-30T06:59:54.417486+0000","last_became_active":"2024-05-30T06:59:07.013181+0000","last_became_peered":"2024-05-30T06:59:07.013181+0000","last_unstale":"2024-05-30T06:59:54.417486+0000","last_undegraded":"2024-05-30T06:59:54.417486+0000","last_fullsized":"2024-05-30T06:59:54.417486+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:47:22.693305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"130'79","reported_seq":154,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.417583+0000","last_change":"2024-05-30T06:59:08.030108+0000","last_active":"2024-05-30T07:00:52.417583+0000","last_peered":"2024-05-30T07:00:52.417583+0000","last_clean":"2024-05-30T07:00:52.417583+0000","last_became_active":"2024-05-30T06:59:08.029134+0000","last_became_peered":"2024-05-30T06:59:08.029134+0000","last_unstale":"2024-05-30T07:00:52.417583+0000","last_undegraded":"2024-05-30T07:00:52.417583+0000","last_fullsized":"2024-05-30T07:00:52.417583+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:56.766557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":79,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.480128+0000","last_change":"2024-05-30T06:59:07.022390+0000","last_active":"2024-05-30T06:59:54.480128+0000","last_peered":"2024-05-30T06:59:54.480128+0000","last_clean":"2024-05-30T06:59:54.480128+0000","last_became_active":"2024-05-30T06:59:07.022101+0000","last_became_peered":"2024-05-30T06:59:07.022101+0000","last_unstale":"2024-05-30T06:59:54.480128+0000","last_undegraded":"2024-05-30T06:59:54.480128+0000","last_fullsized":"2024-05-30T06:59:54.480128+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:18.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"130'105","reported_seq":185,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.448633+0000","last_change":"2024-05-30T06:59:08.044660+0000","last_active":"2024-05-30T07:00:52.448633+0000","last_peered":"2024-05-30T07:00:52.448633+0000","last_clean":"2024-05-30T07:00:52.448633+0000","last_became_active":"2024-05-30T06:59:08.044058+0000","last_became_peered":"2024-05-30T06:59:08.044058+0000","last_unstale":"2024-05-30T07:00:52.448633+0000","last_undegraded":"2024-05-30T07:00:52.448633+0000","last_fullsized":"2024-05-30T07:00:52.448633+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:49:32.544053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301990149,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":105,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"127'8","reported_seq":26,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.460852+0000","last_change":"2024-05-30T06:59:07.015902+0000","last_active":"2024-05-30T06:59:54.460852+0000","last_peered":"2024-05-30T06:59:54.460852+0000","last_clean":"2024-05-30T06:59:54.460852+0000","last_became_active":"2024-05-30T06:59:07.015593+0000","last_became_peered":"2024-05-30T06:59:07.015593+0000","last_unstale":"2024-05-30T06:59:54.460852+0000","last_undegraded":"2024-05-30T06:59:54.460852+0000","last_fullsized":"2024-05-30T06:59:54.460852+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:14:30.382452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"130'68","reported_seq":107,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.508664+0000","last_change":"2024-05-30T06:59:08.036882+0000","last_active":"2024-05-30T07:00:52.508664+0000","last_peered":"2024-05-30T07:00:52.508664+0000","last_clean":"2024-05-30T07:00:52.508664+0000","last_became_active":"2024-05-30T06:59:08.036615+0000","last_became_peered":"2024-05-30T06:59:08.036615+0000","last_unstale":"2024-05-30T07:00:52.508664+0000","last_undegraded":"2024-05-30T07:00:52.508664+0000","last_fullsized":"2024-05-30T07:00:52.508664+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:17.450834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":23,"num_read_kb":94208,"num_write":68,"num_write_kb":237568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418585+0000","last_change":"2024-05-30T06:59:07.019419+0000","last_active":"2024-05-30T06:59:54.418585+0000","last_peered":"2024-05-30T06:59:54.418585+0000","last_clean":"2024-05-30T06:59:54.418585+0000","last_became_active":"2024-05-30T06:59:07.019026+0000","last_became_peered":"2024-05-30T06:59:07.019026+0000","last_unstale":"2024-05-30T06:59:54.418585+0000","last_undegraded":"2024-05-30T06:59:54.418585+0000","last_fullsized":"2024-05-30T06:59:54.418585+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:42:17.679592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"130'98","reported_seq":191,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.459795+0000","last_change":"2024-05-30T06:59:08.041567+0000","last_active":"2024-05-30T07:00:52.459795+0000","last_peered":"2024-05-30T07:00:52.459795+0000","last_clean":"2024-05-30T07:00:52.459795+0000","last_became_active":"2024-05-30T06:59:08.039259+0000","last_became_peered":"2024-05-30T06:59:08.039259+0000","last_unstale":"2024-05-30T07:00:52.459795+0000","last_undegraded":"2024-05-30T07:00:52.459795+0000","last_fullsized":"2024-05-30T07:00:52.459795+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:37:27.648210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":77,"num_read_kb":315392,"num_write":98,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"127'2","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414287+0000","last_change":"2024-05-30T06:59:07.020027+0000","last_active":"2024-05-30T06:59:54.414287+0000","last_peered":"2024-05-30T06:59:54.414287+0000","last_clean":"2024-05-30T06:59:54.414287+0000","last_became_active":"2024-05-30T06:59:07.019702+0000","last_became_peered":"2024-05-30T06:59:07.019702+0000","last_unstale":"2024-05-30T06:59:54.414287+0000","last_undegraded":"2024-05-30T06:59:54.414287+0000","last_fullsized":"2024-05-30T06:59:54.414287+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:49:45.444316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"130'72","reported_seq":147,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.507440+0000","last_change":"2024-05-30T06:59:08.026623+0000","last_active":"2024-05-30T07:00:52.507440+0000","last_peered":"2024-05-30T07:00:52.507440+0000","last_clean":"2024-05-30T07:00:52.507440+0000","last_became_active":"2024-05-30T06:59:08.026370+0000","last_became_peered":"2024-05-30T06:59:08.026370+0000","last_unstale":"2024-05-30T07:00:52.507440+0000","last_undegraded":"2024-05-30T07:00:52.507440+0000","last_fullsized":"2024-05-30T07:00:52.507440+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:07:33.988552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":59,"num_read_kb":225284,"num_write":72,"num_write_kb":233475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417939+0000","last_change":"2024-05-30T06:59:07.018086+0000","last_active":"2024-05-30T06:59:54.417939+0000","last_peered":"2024-05-30T06:59:54.417939+0000","last_clean":"2024-05-30T06:59:54.417939+0000","last_became_active":"2024-05-30T06:59:07.017740+0000","last_became_peered":"2024-05-30T06:59:07.017740+0000","last_unstale":"2024-05-30T06:59:54.417939+0000","last_undegraded":"2024-05-30T06:59:54.417939+0000","last_fullsized":"2024-05-30T06:59:54.417939+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:16.444618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"130'87","reported_seq":178,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.498056+0000","last_change":"2024-05-30T06:59:08.015660+0000","last_active":"2024-05-30T07:00:52.498056+0000","last_peered":"2024-05-30T07:00:52.498056+0000","last_clean":"2024-05-30T07:00:52.498056+0000","last_became_active":"2024-05-30T06:59:08.015370+0000","last_became_peered":"2024-05-30T06:59:08.015370+0000","last_unstale":"2024-05-30T07:00:52.498056+0000","last_undegraded":"2024-05-30T07:00:52.498056+0000","last_fullsized":"2024-05-30T07:00:52.498056+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:10:59.558212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":87,"num_write_kb":299008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418143+0000","last_change":"2024-05-30T06:59:07.024249+0000","last_active":"2024-05-30T06:59:54.418143+0000","last_peered":"2024-05-30T06:59:54.418143+0000","last_clean":"2024-05-30T06:59:54.418143+0000","last_became_active":"2024-05-30T06:59:07.023895+0000","last_became_peered":"2024-05-30T06:59:07.023895+0000","last_unstale":"2024-05-30T06:59:54.418143+0000","last_undegraded":"2024-05-30T06:59:54.418143+0000","last_fullsized":"2024-05-30T06:59:54.418143+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:16:51.738852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"130'98","reported_seq":192,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.471161+0000","last_change":"2024-05-30T06:59:08.029322+0000","last_active":"2024-05-30T07:00:52.471161+0000","last_peered":"2024-05-30T07:00:52.471161+0000","last_clean":"2024-05-30T07:00:52.471161+0000","last_became_active":"2024-05-30T06:59:08.028959+0000","last_became_peered":"2024-05-30T06:59:08.028959+0000","last_unstale":"2024-05-30T07:00:52.471161+0000","last_undegraded":"2024-05-30T07:00:52.471161+0000","last_fullsized":"2024-05-30T07:00:52.471161+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:19.376389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":98,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"128'3","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418435+0000","last_change":"2024-05-30T06:59:07.019458+0000","last_active":"2024-05-30T06:59:54.418435+0000","last_peered":"2024-05-30T06:59:54.418435+0000","last_clean":"2024-05-30T06:59:54.418435+0000","last_became_active":"2024-05-30T06:59:07.019186+0000","last_became_peered":"2024-05-30T06:59:07.019186+0000","last_unstale":"2024-05-30T06:59:54.418435+0000","last_undegraded":"2024-05-30T06:59:54.418435+0000","last_fullsized":"2024-05-30T06:59:54.418435+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:53.047887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"130'90","reported_seq":170,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.412258+0000","last_change":"2024-05-30T06:59:08.035291+0000","last_active":"2024-05-30T07:00:52.412258+0000","last_peered":"2024-05-30T07:00:52.412258+0000","last_clean":"2024-05-30T07:00:52.412258+0000","last_became_active":"2024-05-30T06:59:08.034951+0000","last_became_peered":"2024-05-30T06:59:08.034951+0000","last_unstale":"2024-05-30T07:00:52.412258+0000","last_undegraded":"2024-05-30T07:00:52.412258+0000","last_fullsized":"2024-05-30T07:00:52.412258+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:21:42.071914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018629,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":245764,"num_write":90,"num_write_kb":315394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418019+0000","last_change":"2024-05-30T06:59:07.016536+0000","last_active":"2024-05-30T06:59:54.418019+0000","last_peered":"2024-05-30T06:59:54.418019+0000","last_clean":"2024-05-30T06:59:54.418019+0000","last_became_active":"2024-05-30T06:59:07.016202+0000","last_became_peered":"2024-05-30T06:59:07.016202+0000","last_unstale":"2024-05-30T06:59:54.418019+0000","last_undegraded":"2024-05-30T06:59:54.418019+0000","last_fullsized":"2024-05-30T06:59:54.418019+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:47:15.001802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"130'102","reported_seq":164,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.450963+0000","last_change":"2024-05-30T06:59:08.022686+0000","last_active":"2024-05-30T07:00:52.450963+0000","last_peered":"2024-05-30T07:00:52.450963+0000","last_clean":"2024-05-30T07:00:52.450963+0000","last_became_active":"2024-05-30T06:59:08.022436+0000","last_became_peered":"2024-05-30T06:59:08.022436+0000","last_unstale":"2024-05-30T07:00:52.450963+0000","last_undegraded":"2024-05-30T07:00:52.450963+0000","last_fullsized":"2024-05-30T07:00:52.450963+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:54.054104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":46,"num_read_kb":180226,"num_write":102,"num_write_kb":352257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417252+0000","last_change":"2024-05-30T06:59:07.017333+0000","last_active":"2024-05-30T06:59:54.417252+0000","last_peered":"2024-05-30T06:59:54.417252+0000","last_clean":"2024-05-30T06:59:54.417252+0000","last_became_active":"2024-05-30T06:59:07.017037+0000","last_became_peered":"2024-05-30T06:59:07.017037+0000","last_unstale":"2024-05-30T06:59:54.417252+0000","last_undegraded":"2024-05-30T06:59:54.417252+0000","last_fullsized":"2024-05-30T06:59:54.417252+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:18:59.328569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"130'76","reported_seq":152,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.505115+0000","last_change":"2024-05-30T06:59:08.038802+0000","last_active":"2024-05-30T07:00:52.505115+0000","last_peered":"2024-05-30T07:00:52.505115+0000","last_clean":"2024-05-30T07:00:52.505115+0000","last_became_active":"2024-05-30T06:59:08.038486+0000","last_became_peered":"2024-05-30T06:59:08.038486+0000","last_unstale":"2024-05-30T07:00:52.505115+0000","last_undegraded":"2024-05-30T07:00:52.505115+0000","last_fullsized":"2024-05-30T07:00:52.505115+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:34.693941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":60,"num_read_kb":245760,"num_write":76,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"130'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414047+0000","last_change":"2024-05-30T06:59:07.018462+0000","last_active":"2024-05-30T06:59:54.414047+0000","last_peered":"2024-05-30T06:59:54.414047+0000","last_clean":"2024-05-30T06:59:54.414047+0000","last_became_active":"2024-05-30T06:59:07.017946+0000","last_became_peered":"2024-05-30T06:59:07.017946+0000","last_unstale":"2024-05-30T06:59:54.414047+0000","last_undegraded":"2024-05-30T06:59:54.414047+0000","last_fullsized":"2024-05-30T06:59:54.414047+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:18:15.985022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"130'100","reported_seq":152,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.486103+0000","last_change":"2024-05-30T06:59:08.025933+0000","last_active":"2024-05-30T07:00:52.486103+0000","last_peered":"2024-05-30T07:00:52.486103+0000","last_clean":"2024-05-30T07:00:52.486103+0000","last_became_active":"2024-05-30T06:59:08.025557+0000","last_became_peered":"2024-05-30T06:59:08.025557+0000","last_unstale":"2024-05-30T07:00:52.486103+0000","last_undegraded":"2024-05-30T07:00:52.486103+0000","last_fullsized":"2024-05-30T07:00:52.486103+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:59.888055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":100,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"127'2","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417721+0000","last_change":"2024-05-30T06:59:07.020218+0000","last_active":"2024-05-30T06:59:54.417721+0000","last_peered":"2024-05-30T06:59:54.417721+0000","last_clean":"2024-05-30T06:59:54.417721+0000","last_became_active":"2024-05-30T06:59:07.018769+0000","last_became_peered":"2024-05-30T06:59:07.018769+0000","last_unstale":"2024-05-30T06:59:54.417721+0000","last_undegraded":"2024-05-30T06:59:54.417721+0000","last_fullsized":"2024-05-30T06:59:54.417721+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:06.907108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"130'90","reported_seq":185,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.417790+0000","last_change":"2024-05-30T06:59:08.032992+0000","last_active":"2024-05-30T07:00:52.417790+0000","last_peered":"2024-05-30T07:00:52.417790+0000","last_clean":"2024-05-30T07:00:52.417790+0000","last_became_active":"2024-05-30T06:59:08.032647+0000","last_became_peered":"2024-05-30T06:59:08.032647+0000","last_unstale":"2024-05-30T07:00:52.417790+0000","last_undegraded":"2024-05-30T07:00:52.417790+0000","last_fullsized":"2024-05-30T07:00:52.417790+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:12:45.810350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":79,"num_read_kb":323584,"num_write":90,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"130'34","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:51.049562+0000","last_change":"2024-05-30T06:59:07.021143+0000","last_active":"2024-05-30T07:00:51.049562+0000","last_peered":"2024-05-30T07:00:51.049562+0000","last_clean":"2024-05-30T07:00:51.049562+0000","last_became_active":"2024-05-30T06:59:07.020771+0000","last_became_peered":"2024-05-30T06:59:07.020771+0000","last_unstale":"2024-05-30T07:00:51.049562+0000","last_undegraded":"2024-05-30T07:00:51.049562+0000","last_fullsized":"2024-05-30T07:00:51.049562+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:42.840485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"130'84","reported_seq":192,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.513036+0000","last_change":"2024-05-30T06:59:08.038746+0000","last_active":"2024-05-30T07:00:52.513036+0000","last_peered":"2024-05-30T07:00:52.513036+0000","last_clean":"2024-05-30T07:00:52.513036+0000","last_became_active":"2024-05-30T06:59:08.038465+0000","last_became_peered":"2024-05-30T06:59:08.038465+0000","last_unstale":"2024-05-30T07:00:52.513036+0000","last_undegraded":"2024-05-30T07:00:52.513036+0000","last_fullsized":"2024-05-30T07:00:52.513036+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:42:53.672075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":92,"num_read_kb":376832,"num_write":84,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.483446+0000","last_change":"2024-05-30T06:59:07.019355+0000","last_active":"2024-05-30T06:59:54.483446+0000","last_peered":"2024-05-30T06:59:54.483446+0000","last_clean":"2024-05-30T06:59:54.483446+0000","last_became_active":"2024-05-30T06:59:07.019061+0000","last_became_peered":"2024-05-30T06:59:07.019061+0000","last_unstale":"2024-05-30T06:59:54.483446+0000","last_undegraded":"2024-05-30T06:59:54.483446+0000","last_fullsized":"2024-05-30T06:59:54.483446+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:57:26.978817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"130'98","reported_seq":162,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.490857+0000","last_change":"2024-05-30T06:59:08.032170+0000","last_active":"2024-05-30T07:00:52.490857+0000","last_peered":"2024-05-30T07:00:52.490857+0000","last_clean":"2024-05-30T07:00:52.490857+0000","last_became_active":"2024-05-30T06:59:08.030918+0000","last_became_peered":"2024-05-30T06:59:08.030918+0000","last_unstale":"2024-05-30T07:00:52.490857+0000","last_undegraded":"2024-05-30T07:00:52.490857+0000","last_fullsized":"2024-05-30T07:00:52.490857+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:33:46.570680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247464319,"num_objects":62,"num_object_clones":1,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":1,"num_read":49,"num_read_kb":200704,"num_write":96,"num_write_kb":307203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414573+0000","last_change":"2024-05-30T06:59:07.020348+0000","last_active":"2024-05-30T06:59:54.414573+0000","last_peered":"2024-05-30T06:59:54.414573+0000","last_clean":"2024-05-30T06:59:54.414573+0000","last_became_active":"2024-05-30T06:59:07.019991+0000","last_became_peered":"2024-05-30T06:59:07.019991+0000","last_unstale":"2024-05-30T06:59:54.414573+0000","last_undegraded":"2024-05-30T06:59:54.414573+0000","last_fullsized":"2024-05-30T06:59:54.414573+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:07:32.982335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"130'100","reported_seq":173,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.487557+0000","last_change":"2024-05-30T06:59:08.038690+0000","last_active":"2024-05-30T07:00:52.487557+0000","last_peered":"2024-05-30T07:00:52.487557+0000","last_clean":"2024-05-30T07:00:52.487557+0000","last_became_active":"2024-05-30T06:59:08.038380+0000","last_became_peered":"2024-05-30T06:59:08.038380+0000","last_unstale":"2024-05-30T07:00:52.487557+0000","last_undegraded":"2024-05-30T07:00:52.487557+0000","last_fullsized":"2024-05-30T07:00:52.487557+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:05:26.527928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":100,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.484996+0000","last_change":"2024-05-30T06:59:07.023295+0000","last_active":"2024-05-30T06:59:54.484996+0000","last_peered":"2024-05-30T06:59:54.484996+0000","last_clean":"2024-05-30T06:59:54.484996+0000","last_became_active":"2024-05-30T06:59:07.022933+0000","last_became_peered":"2024-05-30T06:59:07.022933+0000","last_unstale":"2024-05-30T06:59:54.484996+0000","last_undegraded":"2024-05-30T06:59:54.484996+0000","last_fullsized":"2024-05-30T06:59:54.484996+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:07.641666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"130'115","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.504340+0000","last_change":"2024-05-30T06:59:08.037751+0000","last_active":"2024-05-30T07:00:52.504340+0000","last_peered":"2024-05-30T07:00:52.504340+0000","last_clean":"2024-05-30T07:00:52.504340+0000","last_became_active":"2024-05-30T06:59:08.037505+0000","last_became_peered":"2024-05-30T06:59:08.037505+0000","last_unstale":"2024-05-30T07:00:52.504340+0000","last_undegraded":"2024-05-30T07:00:52.504340+0000","last_fullsized":"2024-05-30T07:00:52.504340+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:16.400946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":86,"num_read_kb":335876,"num_write":115,"num_write_kb":393217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419655+0000","last_change":"2024-05-30T06:59:07.025942+0000","last_active":"2024-05-30T06:59:54.419655+0000","last_peered":"2024-05-30T06:59:54.419655+0000","last_clean":"2024-05-30T06:59:54.419655+0000","last_became_active":"2024-05-30T06:59:07.025651+0000","last_became_peered":"2024-05-30T06:59:07.025651+0000","last_unstale":"2024-05-30T06:59:54.419655+0000","last_undegraded":"2024-05-30T06:59:54.419655+0000","last_fullsized":"2024-05-30T06:59:54.419655+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:21:41.065697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"130'97","reported_seq":187,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.501306+0000","last_change":"2024-05-30T06:59:08.023176+0000","last_active":"2024-05-30T07:00:52.501306+0000","last_peered":"2024-05-30T07:00:52.501306+0000","last_clean":"2024-05-30T07:00:52.501306+0000","last_became_active":"2024-05-30T06:59:08.022036+0000","last_became_peered":"2024-05-30T06:59:08.022036+0000","last_unstale":"2024-05-30T07:00:52.501306+0000","last_undegraded":"2024-05-30T07:00:52.501306+0000","last_fullsized":"2024-05-30T07:00:52.501306+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:49:46.450533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":97,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"130'30","reported_seq":77,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.150321+0000","last_change":"2024-05-30T06:59:07.012244+0000","last_active":"2024-05-30T07:00:52.150321+0000","last_peered":"2024-05-30T07:00:52.150321+0000","last_clean":"2024-05-30T07:00:52.150321+0000","last_became_active":"2024-05-30T06:59:07.011981+0000","last_became_peered":"2024-05-30T06:59:07.011981+0000","last_unstale":"2024-05-30T07:00:52.150321+0000","last_undegraded":"2024-05-30T07:00:52.150321+0000","last_fullsized":"2024-05-30T07:00:52.150321+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:45:53.245785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4755,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":29,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"130'113","reported_seq":207,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.483948+0000","last_change":"2024-05-30T06:59:08.036367+0000","last_active":"2024-05-30T07:00:52.483948+0000","last_peered":"2024-05-30T07:00:52.483948+0000","last_clean":"2024-05-30T07:00:52.483948+0000","last_became_active":"2024-05-30T06:59:08.035993+0000","last_became_peered":"2024-05-30T06:59:08.035993+0000","last_unstale":"2024-05-30T07:00:52.483948+0000","last_undegraded":"2024-05-30T07:00:52.483948+0000","last_fullsized":"2024-05-30T07:00:52.483948+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:16:52.745068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":113,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414433+0000","last_change":"2024-05-30T06:59:07.018219+0000","last_active":"2024-05-30T06:59:54.414433+0000","last_peered":"2024-05-30T06:59:54.414433+0000","last_clean":"2024-05-30T06:59:54.414433+0000","last_became_active":"2024-05-30T06:59:07.017622+0000","last_became_peered":"2024-05-30T06:59:07.017622+0000","last_unstale":"2024-05-30T06:59:54.414433+0000","last_undegraded":"2024-05-30T06:59:54.414433+0000","last_fullsized":"2024-05-30T06:59:54.414433+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:14.903621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"130'77","reported_seq":143,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.494131+0000","last_change":"2024-05-30T06:59:08.034173+0000","last_active":"2024-05-30T07:00:52.494131+0000","last_peered":"2024-05-30T07:00:52.494131+0000","last_clean":"2024-05-30T07:00:52.494131+0000","last_became_active":"2024-05-30T06:59:08.033874+0000","last_became_peered":"2024-05-30T06:59:08.033874+0000","last_unstale":"2024-05-30T07:00:52.494131+0000","last_undegraded":"2024-05-30T07:00:52.494131+0000","last_fullsized":"2024-05-30T07:00:52.494131+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:08:08.594337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":50,"num_read_kb":204800,"num_write":77,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"127'2","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419780+0000","last_change":"2024-05-30T06:59:07.027441+0000","last_active":"2024-05-30T06:59:54.419780+0000","last_peered":"2024-05-30T06:59:54.419780+0000","last_clean":"2024-05-30T06:59:54.419780+0000","last_became_active":"2024-05-30T06:59:07.027219+0000","last_became_peered":"2024-05-30T06:59:07.027219+0000","last_unstale":"2024-05-30T06:59:54.419780+0000","last_undegraded":"2024-05-30T06:59:54.419780+0000","last_fullsized":"2024-05-30T06:59:54.419780+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:58.881839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":381,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419731+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:59:54.419731+0000","last_peered":"2024-05-30T06:59:54.419731+0000","last_clean":"2024-05-30T06:59:54.419731+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:59:54.419731+0000","last_undegraded":"2024-05-30T06:59:54.419731+0000","last_fullsized":"2024-05-30T06:59:54.419731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":16844326603,"num_objects":4025,"num_object_clones":1,"num_object_copies":8050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4025,"num_whiteouts":1,"num_read":4099,"num_read_kb":16560184,"num_write":5631,"num_write_kb":19595307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33688715264,"data_stored":33688653206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5640,"ondisk_log_size":5640,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1706277,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":599,"num_write_kb":1886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3481600,"data_stored":3412554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":557,"ondisk_log_size":557,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575081,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3725524,"kb_used_data":3608332,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":90646316,"statfs":{"total":96636764160,"available":92821827584,"internally_reserved":0,"allocated":3694931968,"data_stored":3693994699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575082,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4680980,"kb_used_data":4545740,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":89690860,"statfs":{"total":96636764160,"available":91843440640,"internally_reserved":0,"allocated":4654837760,"data_stored":4653904457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575082,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3581648,"kb_used_data":3442248,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":90790192,"statfs":{"total":96636764160,"available":92969156608,"internally_reserved":0,"allocated":3524861952,"data_stored":3523931494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575081,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5183308,"kb_used_data":5035588,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":89188532,"statfs":{"total":96636764160,"available":91329056768,"internally_reserved":0,"allocated":5156442112,"data_stored":5155515779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575081,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4103504,"kb_used_data":3946056,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":90268336,"statfs":{"total":96636764160,"available":92434776064,"internally_reserved":0,"allocated":4040761344,"data_stored":4039835296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":161216967},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575080,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5367432,"kb_used_data":5232192,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":89004408,"statfs":{"total":96636764160,"available":91140513792,"internally_reserved":0,"allocated":5357764608,"data_stored":5356842395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575082,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3856184,"kb_used_data":3708464,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90515656,"statfs":{"total":96636764160,"available":92688031744,"internally_reserved":0,"allocated":3797467136,"data_stored":3796560308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575082,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3541308,"kb_used_data":3397748,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":90830532,"statfs":{"total":96636764160,"available":93010464768,"internally_reserved":0,"allocated":3479293952,"data_stored":3478383572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1720320,"data_stored":1705479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1724416,"data_stored":1701362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3477078016,"data_stored":3477078016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3795845120,"data_stored":3795845120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5356134400,"data_stored":5356126591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4039122944,"data_stored":4039115193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5154816000,"data_stored":5154800521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3523231744,"data_stored":3523216194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4651495424,"data_stored":4651483790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3690991616,"data_stored":3690987781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T07:01:14.414 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-30T07:01:14.414 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T07:01:14.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd55c000640 1 Processor -- start 2024-05-30T07:01:14.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd55c000640 1 -- start start 2024-05-30T07:01:14.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd55c000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd5541460f0 0x7fd5540afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd55c000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd55415cc70 0x7fd5540b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd55c000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd55406c750 con 0x7fd55406b960 2024-05-30T07:01:14.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd55c000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd5540b4540 con 0x7fd5541460f0 2024-05-30T07:01:14.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd55c000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd5541464d0 con 0x7fd55415cc70 2024-05-30T07:01:14.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd559600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd5541460f0 0x7fd5540afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd559600640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd5541460f0 0x7fd5540afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55844/0 (socket says 172.21.15.37:55844) 2024-05-30T07:01:14.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd559600640 1 -- 172.21.15.37:0/2257193460 learned_addr learned my addr 172.21.15.37:0/2257193460 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:14.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd558c00640 1 --2- 172.21.15.37:0/2257193460 >> v2:172.21.15.105:3300/0 conn(0x7fd55415cc70 0x7fd5540b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd559600640 1 -- 172.21.15.37:0/2257193460 >> v2:172.21.15.105:3300/0 conn(0x7fd55415cc70 msgr2=0x7fd5540b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:14.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd559600640 1 --2- 172.21.15.37:0/2257193460 >> v2:172.21.15.105:3300/0 conn(0x7fd55415cc70 0x7fd5540b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd559600640 1 -- 172.21.15.37:0/2257193460 >> v1:172.21.15.105:6789/0 conn(0x7fd55406b960 legacy=0x7fd554160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:14.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd559600640 1 -- 172.21.15.37:0/2257193460 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5540b0850 con 0x7fd5541460f0 2024-05-30T07:01:14.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.593+0000 7fd558c00640 1 --2- 172.21.15.37:0/2257193460 >> v2:172.21.15.105:3300/0 conn(0x7fd55415cc70 0x7fd5540b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:01:14.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.597+0000 7fd559600640 1 --2- 172.21.15.37:0/2257193460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5541460f0 0x7fd5540afcc0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fd554071b30 tx=0x7fd54801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33aff15179592e60 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:14.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.597+0000 7fd553e00640 1 -- 172.21.15.37:0/2257193460 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5480aa610 con 0x7fd5541460f0 2024-05-30T07:01:14.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.597+0000 7fd553e00640 1 -- 172.21.15.37:0/2257193460 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5480af070 con 0x7fd5541460f0 2024-05-30T07:01:14.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.597+0000 7fd553e00640 1 -- 172.21.15.37:0/2257193460 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5480aa9d0 con 0x7fd5541460f0 2024-05-30T07:01:14.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.597+0000 7fd55c000640 1 -- 172.21.15.37:0/2257193460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5541460f0 msgr2=0x7fd5540afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.597+0000 7fd55c000640 1 --2- 172.21.15.37:0/2257193460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5541460f0 0x7fd5540afcc0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7fd554071b30 tx=0x7fd54801c4b0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.597+0000 7fd55c000640 1 -- 172.21.15.37:0/2257193460 shutdown_connections 2024-05-30T07:01:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.597+0000 7fd55c000640 1 --2- 172.21.15.37:0/2257193460 >> v2:172.21.15.105:3300/0 conn(0x7fd55415cc70 0x7fd5540b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.597+0000 7fd55c000640 1 --2- 172.21.15.37:0/2257193460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5541460f0 0x7fd5540afcc0 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.597+0000 7fd55c000640 1 -- 172.21.15.37:0/2257193460 >> 172.21.15.37:0/2257193460 conn(0x7fd5540b6a60 msgr2=0x7fd5540b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.597+0000 7fd55c000640 1 -- 172.21.15.37:0/2257193460 shutdown_connections 2024-05-30T07:01:14.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.597+0000 7fd55c000640 1 -- 172.21.15.37:0/2257193460 wait complete. 2024-05-30T07:01:14.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.597+0000 7fd55c000640 1 Processor -- start 2024-05-30T07:01:14.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55c000640 1 -- start start 2024-05-30T07:01:14.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55c000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55406b960 0x7fd5541fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55c000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5541460f0 0x7fd554165a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55c000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55415cc70 0x7fd554070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55c000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd5541693d0 con 0x7fd55415cc70 2024-05-30T07:01:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55c000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd55406c1b0 con 0x7fd55406b960 2024-05-30T07:01:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55c000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd554169550 con 0x7fd5541460f0 2024-05-30T07:01:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55415cc70 0x7fd554070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55415cc70 0x7fd554070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55848/0 (socket says 172.21.15.37:55848) 2024-05-30T07:01:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55a000640 1 -- 172.21.15.37:0/1701692386 learned_addr learned my addr 172.21.15.37:0/1701692386 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd559600640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55406b960 0x7fd5541fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd558c00640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5541460f0 0x7fd554165a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55a000640 1 -- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5541460f0 msgr2=0x7fd554165a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55a000640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5541460f0 0x7fd554165a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55a000640 1 -- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55406b960 msgr2=0x7fd5541fb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55a000640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55406b960 0x7fd5541fb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55a000640 1 -- 172.21.15.37:0/1701692386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55406f190 con 0x7fd55415cc70 2024-05-30T07:01:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd559600640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55406b960 0x7fd5541fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:01:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd558c00640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5541460f0 0x7fd554165a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:01:14.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55a000640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55415cc70 0x7fd554070800 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00c780 tx=0x7fd54c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:14.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd551600640 1 -- 172.21.15.37:0/1701692386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c004b70 con 0x7fd55415cc70 2024-05-30T07:01:14.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd551600640 1 -- 172.21.15.37:0/1701692386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd54c004d10 con 0x7fd55415cc70 2024-05-30T07:01:14.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd551600640 1 -- 172.21.15.37:0/1701692386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00aa90 con 0x7fd55415cc70 2024-05-30T07:01:14.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55c000640 1 -- 172.21.15.37:0/1701692386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5541fb9e0 con 0x7fd55415cc70 2024-05-30T07:01:14.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55c000640 1 -- 172.21.15.37:0/1701692386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd55409d870 con 0x7fd55415cc70 2024-05-30T07:01:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.601+0000 7fd55c000640 1 -- 172.21.15.37:0/1701692386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd554068b20 con 0x7fd55415cc70 2024-05-30T07:01:14.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.605+0000 7fd551600640 1 -- 172.21.15.37:0/1701692386 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7fd54c00ac30 con 0x7fd55415cc70 2024-05-30T07:01:14.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.605+0000 7fd551600640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd53406a570 0x7fd53406ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.605+0000 7fd551600640 1 -- 172.21.15.37:0/1701692386 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fd54c086530 con 0x7fd55415cc70 2024-05-30T07:01:14.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.605+0000 7fd559600640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd53406a570 0x7fd53406ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.605+0000 7fd559600640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd53406a570 0x7fd53406ca30 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fd5480ae000 tx=0x7fd548008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:14.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.609+0000 7fd551600640 1 -- 172.21.15.37:0/1701692386 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd54c020070 con 0x7fd55415cc70 2024-05-30T07:01:14.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.769+0000 7fd55c000640 1 -- 172.21.15.37:0/1701692386 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd55413c9b0 con 0x7fd53406a570 2024-05-30T07:01:14.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.773+0000 7fd551600640 1 -- 172.21.15.37:0/1701692386 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254778 (secure 0 0 0) 0x7fd55413c9b0 con 0x7fd53406a570 2024-05-30T07:01:14.779 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:01:14.781 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T07:01:14.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.777+0000 7fd55c000640 1 -- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd53406a570 msgr2=0x7fd53406ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.777+0000 7fd55c000640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd53406a570 0x7fd53406ca30 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fd5480ae000 tx=0x7fd548008040 comp rx=0 tx=0).stop 2024-05-30T07:01:14.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.777+0000 7fd55c000640 1 -- 172.21.15.37:0/1701692386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55415cc70 msgr2=0x7fd554070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.777+0000 7fd55c000640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55415cc70 0x7fd554070800 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00c780 tx=0x7fd54c00cc40 comp rx=0 tx=0).stop 2024-05-30T07:01:14.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.777+0000 7fd55c000640 1 -- 172.21.15.37:0/1701692386 shutdown_connections 2024-05-30T07:01:14.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.777+0000 7fd55c000640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd55415cc70 0x7fd554070800 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.777+0000 7fd55c000640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5541460f0 0x7fd554165a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.777+0000 7fd55c000640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd53406a570 0x7fd53406ca30 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.777+0000 7fd55c000640 1 --2- 172.21.15.37:0/1701692386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55406b960 0x7fd5541fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.777+0000 7fd55c000640 1 -- 172.21.15.37:0/1701692386 >> 172.21.15.37:0/1701692386 conn(0x7fd5540b6a60 msgr2=0x7fd5540b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:14.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.777+0000 7fd55c000640 1 -- 172.21.15.37:0/1701692386 shutdown_connections 2024-05-30T07:01:14.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.777+0000 7fd55c000640 1 -- 172.21.15.37:0/1701692386 wait complete. 2024-05-30T07:01:14.800 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":700,"stamp":"2024-05-30T07:01:13.047497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16846623248,"num_objects":4050,"num_object_clones":1,"num_object_copies":8100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4050,"num_whiteouts":1,"num_read":4244,"num_read_kb":16560313,"num_write":6389,"num_write_kb":19599609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6314,"ondisk_log_size":6314,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":34039888,"kb_used_data":32916368,"kb_used_omap":12,"kb_used_meta":1123443,"kb_avail":720934832,"statfs":{"total":773094113280,"available":738237267968,"internally_reserved":0,"allocated":33706360832,"data_stored":33698968000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1150406192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003227"},"pg_stats":[{"pgid":"19.3f","version":"130'77","reported_seq":166,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.506911+0000","last_change":"2024-05-30T06:59:08.024160+0000","last_active":"2024-05-30T07:00:52.506911+0000","last_peered":"2024-05-30T07:00:52.506911+0000","last_clean":"2024-05-30T07:00:52.506911+0000","last_became_active":"2024-05-30T06:59:08.023564+0000","last_became_peered":"2024-05-30T06:59:08.023564+0000","last_unstale":"2024-05-30T07:00:52.506911+0000","last_undegraded":"2024-05-30T07:00:52.506911+0000","last_fullsized":"2024-05-30T07:00:52.506911+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:49:09.216308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":77,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"130'93","reported_seq":177,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.498880+0000","last_change":"2024-05-30T06:59:08.017254+0000","last_active":"2024-05-30T07:00:52.498880+0000","last_peered":"2024-05-30T07:00:52.498880+0000","last_clean":"2024-05-30T07:00:52.498880+0000","last_became_active":"2024-05-30T06:59:08.016947+0000","last_became_peered":"2024-05-30T06:59:08.016947+0000","last_unstale":"2024-05-30T07:00:52.498880+0000","last_undegraded":"2024-05-30T07:00:52.498880+0000","last_fullsized":"2024-05-30T07:00:52.498880+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:06:13.939169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":93,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"130'100","reported_seq":184,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.515911+0000","last_change":"2024-05-30T06:59:08.031486+0000","last_active":"2024-05-30T07:00:52.515911+0000","last_peered":"2024-05-30T07:00:52.515911+0000","last_clean":"2024-05-30T07:00:52.515911+0000","last_became_active":"2024-05-30T06:59:08.030677+0000","last_became_peered":"2024-05-30T06:59:08.030677+0000","last_unstale":"2024-05-30T07:00:52.515911+0000","last_undegraded":"2024-05-30T07:00:52.515911+0000","last_fullsized":"2024-05-30T07:00:52.515911+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:59:41.592123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":68,"num_read_kb":262148,"num_write":100,"num_write_kb":323587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"130'83","reported_seq":142,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.494948+0000","last_change":"2024-05-30T06:59:55.853693+0000","last_active":"2024-05-30T07:00:52.494948+0000","last_peered":"2024-05-30T07:00:52.494948+0000","last_clean":"2024-05-30T07:00:52.494948+0000","last_became_active":"2024-05-30T06:59:54.418117+0000","last_became_peered":"2024-05-30T06:59:54.418117+0000","last_unstale":"2024-05-30T07:00:52.494948+0000","last_undegraded":"2024-05-30T07:00:52.494948+0000","last_fullsized":"2024-05-30T07:00:52.494948+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:14:21.375372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":176129,"num_write":83,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3b","version":"130'68","reported_seq":125,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.474175+0000","last_change":"2024-05-30T06:59:08.046184+0000","last_active":"2024-05-30T07:00:52.474175+0000","last_peered":"2024-05-30T07:00:52.474175+0000","last_clean":"2024-05-30T07:00:52.474175+0000","last_became_active":"2024-05-30T06:59:08.045942+0000","last_became_peered":"2024-05-30T06:59:08.045942+0000","last_unstale":"2024-05-30T07:00:52.474175+0000","last_undegraded":"2024-05-30T07:00:52.474175+0000","last_fullsized":"2024-05-30T07:00:52.474175+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:27:44.098848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":41,"num_read_kb":167936,"num_write":68,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"130'99","reported_seq":201,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.366734+0000","last_change":"2024-05-30T06:59:08.029771+0000","last_active":"2024-05-30T07:00:52.366734+0000","last_peered":"2024-05-30T07:00:52.366734+0000","last_clean":"2024-05-30T07:00:52.366734+0000","last_became_active":"2024-05-30T06:59:08.029463+0000","last_became_peered":"2024-05-30T06:59:08.029463+0000","last_unstale":"2024-05-30T07:00:52.366734+0000","last_undegraded":"2024-05-30T07:00:52.366734+0000","last_fullsized":"2024-05-30T07:00:52.366734+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:13.314661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":99,"num_write_kb":344065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"130'75","reported_seq":139,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.367424+0000","last_change":"2024-05-30T06:59:08.035845+0000","last_active":"2024-05-30T07:00:52.367424+0000","last_peered":"2024-05-30T07:00:52.367424+0000","last_clean":"2024-05-30T07:00:52.367424+0000","last_became_active":"2024-05-30T06:59:08.035526+0000","last_became_peered":"2024-05-30T06:59:08.035526+0000","last_unstale":"2024-05-30T07:00:52.367424+0000","last_undegraded":"2024-05-30T07:00:52.367424+0000","last_fullsized":"2024-05-30T07:00:52.367424+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:19:00.334786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":48,"num_read_kb":196608,"num_write":75,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"130'88","reported_seq":157,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.491373+0000","last_change":"2024-05-30T06:59:08.035483+0000","last_active":"2024-05-30T07:00:52.491373+0000","last_peered":"2024-05-30T07:00:52.491373+0000","last_clean":"2024-05-30T07:00:52.491373+0000","last_became_active":"2024-05-30T06:59:08.034842+0000","last_became_peered":"2024-05-30T06:59:08.034842+0000","last_unstale":"2024-05-30T07:00:52.491373+0000","last_undegraded":"2024-05-30T07:00:52.491373+0000","last_fullsized":"2024-05-30T07:00:52.491373+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:07:18.302784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":53,"num_read_kb":217088,"num_write":88,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"130'89","reported_seq":157,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.439457+0000","last_change":"2024-05-30T06:59:08.044693+0000","last_active":"2024-05-30T07:00:52.439457+0000","last_peered":"2024-05-30T07:00:52.439457+0000","last_clean":"2024-05-30T07:00:52.439457+0000","last_became_active":"2024-05-30T06:59:08.044276+0000","last_became_peered":"2024-05-30T06:59:08.044276+0000","last_unstale":"2024-05-30T07:00:52.439457+0000","last_undegraded":"2024-05-30T07:00:52.439457+0000","last_fullsized":"2024-05-30T07:00:52.439457+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:14:17.604408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269764,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":52,"num_read_kb":208897,"num_write":89,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"130'65","reported_seq":144,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.422414+0000","last_change":"2024-05-30T06:59:08.016455+0000","last_active":"2024-05-30T07:00:52.422414+0000","last_peered":"2024-05-30T07:00:52.422414+0000","last_clean":"2024-05-30T07:00:52.422414+0000","last_became_active":"2024-05-30T06:59:08.016161+0000","last_became_peered":"2024-05-30T06:59:08.016161+0000","last_unstale":"2024-05-30T07:00:52.422414+0000","last_undegraded":"2024-05-30T07:00:52.422414+0000","last_fullsized":"2024-05-30T07:00:52.422414+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:50:42.911168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":65,"num_write_kb":225280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"130'100","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.488290+0000","last_change":"2024-05-30T06:59:08.022034+0000","last_active":"2024-05-30T07:00:52.488290+0000","last_peered":"2024-05-30T07:00:52.488290+0000","last_clean":"2024-05-30T07:00:52.488290+0000","last_became_active":"2024-05-30T06:59:08.021772+0000","last_became_peered":"2024-05-30T06:59:08.021772+0000","last_unstale":"2024-05-30T07:00:52.488290+0000","last_undegraded":"2024-05-30T07:00:52.488290+0000","last_fullsized":"2024-05-30T07:00:52.488290+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:41:37.594639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":100,"num_read_kb":409600,"num_write":100,"num_write_kb":356352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"130'80","reported_seq":194,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.503819+0000","last_change":"2024-05-30T06:59:08.044094+0000","last_active":"2024-05-30T07:00:52.503819+0000","last_peered":"2024-05-30T07:00:52.503819+0000","last_clean":"2024-05-30T07:00:52.503819+0000","last_became_active":"2024-05-30T06:59:08.043835+0000","last_became_peered":"2024-05-30T06:59:08.043835+0000","last_unstale":"2024-05-30T07:00:52.503819+0000","last_undegraded":"2024-05-30T07:00:52.503819+0000","last_fullsized":"2024-05-30T07:00:52.503819+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:16:54.524337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":98,"num_read_kb":385028,"num_write":80,"num_write_kb":278529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"130'84","reported_seq":184,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.432364+0000","last_change":"2024-05-30T06:59:08.025217+0000","last_active":"2024-05-30T07:00:52.432364+0000","last_peered":"2024-05-30T07:00:52.432364+0000","last_clean":"2024-05-30T07:00:52.432364+0000","last_became_active":"2024-05-30T06:59:08.024478+0000","last_became_peered":"2024-05-30T06:59:08.024478+0000","last_unstale":"2024-05-30T07:00:52.432364+0000","last_undegraded":"2024-05-30T07:00:52.432364+0000","last_fullsized":"2024-05-30T07:00:52.432364+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:29:37.627610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":84,"num_read_kb":335874,"num_write":84,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"130'83","reported_seq":162,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.506927+0000","last_change":"2024-05-30T06:59:08.022376+0000","last_active":"2024-05-30T07:00:52.506927+0000","last_peered":"2024-05-30T07:00:52.506927+0000","last_clean":"2024-05-30T07:00:52.506927+0000","last_became_active":"2024-05-30T06:59:08.022058+0000","last_became_peered":"2024-05-30T06:59:08.022058+0000","last_unstale":"2024-05-30T07:00:52.506927+0000","last_undegraded":"2024-05-30T07:00:52.506927+0000","last_fullsized":"2024-05-30T07:00:52.506927+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:22:42.845029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":63,"num_read_kb":249858,"num_write":83,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"130'75","reported_seq":122,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.352230+0000","last_change":"2024-05-30T06:59:08.027564+0000","last_active":"2024-05-30T07:00:52.352230+0000","last_peered":"2024-05-30T07:00:52.352230+0000","last_clean":"2024-05-30T07:00:52.352230+0000","last_became_active":"2024-05-30T06:59:08.027303+0000","last_became_peered":"2024-05-30T06:59:08.027303+0000","last_unstale":"2024-05-30T07:00:52.352230+0000","last_undegraded":"2024-05-30T07:00:52.352230+0000","last_fullsized":"2024-05-30T07:00:52.352230+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:59:23.939287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":31,"num_read_kb":126976,"num_write":75,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"130'84","reported_seq":152,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.496905+0000","last_change":"2024-05-30T06:59:08.023401+0000","last_active":"2024-05-30T07:00:52.496905+0000","last_peered":"2024-05-30T07:00:52.496905+0000","last_clean":"2024-05-30T07:00:52.496905+0000","last_became_active":"2024-05-30T06:59:08.022914+0000","last_became_peered":"2024-05-30T06:59:08.022914+0000","last_unstale":"2024-05-30T07:00:52.496905+0000","last_undegraded":"2024-05-30T07:00:52.496905+0000","last_fullsized":"2024-05-30T07:00:52.496905+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:52:22.042222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":52,"num_read_kb":212992,"num_write":84,"num_write_kb":278528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"130'72","reported_seq":131,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.463163+0000","last_change":"2024-05-30T06:59:08.024708+0000","last_active":"2024-05-30T07:00:52.463163+0000","last_peered":"2024-05-30T07:00:52.463163+0000","last_clean":"2024-05-30T07:00:52.463163+0000","last_became_active":"2024-05-30T06:59:08.024445+0000","last_became_peered":"2024-05-30T06:59:08.024445+0000","last_unstale":"2024-05-30T07:00:52.463163+0000","last_undegraded":"2024-05-30T07:00:52.463163+0000","last_fullsized":"2024-05-30T07:00:52.463163+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:47:16.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":176128,"num_write":72,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"130'94","reported_seq":199,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.442856+0000","last_change":"2024-05-30T06:59:08.023258+0000","last_active":"2024-05-30T07:00:52.442856+0000","last_peered":"2024-05-30T07:00:52.442856+0000","last_clean":"2024-05-30T07:00:52.442856+0000","last_became_active":"2024-05-30T06:59:08.017709+0000","last_became_peered":"2024-05-30T06:59:08.017709+0000","last_unstale":"2024-05-30T07:00:52.442856+0000","last_undegraded":"2024-05-30T07:00:52.442856+0000","last_fullsized":"2024-05-30T07:00:52.442856+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:15.909838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":89,"num_read_kb":364544,"num_write":94,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"130'94","reported_seq":181,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.480060+0000","last_change":"2024-05-30T06:59:08.026237+0000","last_active":"2024-05-30T07:00:52.480060+0000","last_peered":"2024-05-30T07:00:52.480060+0000","last_clean":"2024-05-30T07:00:52.480060+0000","last_became_active":"2024-05-30T06:59:08.025981+0000","last_became_peered":"2024-05-30T06:59:08.025981+0000","last_unstale":"2024-05-30T07:00:52.480060+0000","last_undegraded":"2024-05-30T07:00:52.480060+0000","last_fullsized":"2024-05-30T07:00:52.480060+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:08:22.095245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":71,"num_read_kb":278531,"num_write":94,"num_write_kb":335873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"130'84","reported_seq":161,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.422359+0000","last_change":"2024-05-30T06:59:08.018790+0000","last_active":"2024-05-30T07:00:52.422359+0000","last_peered":"2024-05-30T07:00:52.422359+0000","last_clean":"2024-05-30T07:00:52.422359+0000","last_became_active":"2024-05-30T06:59:08.015033+0000","last_became_peered":"2024-05-30T06:59:08.015033+0000","last_unstale":"2024-05-30T07:00:52.422359+0000","last_undegraded":"2024-05-30T07:00:52.422359+0000","last_fullsized":"2024-05-30T07:00:52.422359+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:01:57.819719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":61,"num_read_kb":241666,"num_write":83,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"130'100","reported_seq":207,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.451815+0000","last_change":"2024-05-30T06:59:08.046183+0000","last_active":"2024-05-30T07:00:52.451815+0000","last_peered":"2024-05-30T07:00:52.451815+0000","last_clean":"2024-05-30T07:00:52.451815+0000","last_became_active":"2024-05-30T06:59:08.045891+0000","last_became_peered":"2024-05-30T06:59:08.045891+0000","last_unstale":"2024-05-30T07:00:52.451815+0000","last_undegraded":"2024-05-30T07:00:52.451815+0000","last_fullsized":"2024-05-30T07:00:52.451815+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:52:32.696164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":91,"num_read_kb":368641,"num_write":100,"num_write_kb":344066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"130'83","reported_seq":155,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.440845+0000","last_change":"2024-05-30T06:59:08.019956+0000","last_active":"2024-05-30T07:00:52.440845+0000","last_peered":"2024-05-30T07:00:52.440845+0000","last_clean":"2024-05-30T07:00:52.440845+0000","last_became_active":"2024-05-30T06:59:08.019670+0000","last_became_peered":"2024-05-30T06:59:08.019670+0000","last_unstale":"2024-05-30T07:00:52.440845+0000","last_undegraded":"2024-05-30T07:00:52.440845+0000","last_fullsized":"2024-05-30T07:00:52.440845+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:52:32.696164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":56,"num_read_kb":225281,"num_write":82,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"130'98","reported_seq":169,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.440422+0000","last_change":"2024-05-30T06:59:08.044096+0000","last_active":"2024-05-30T07:00:52.440422+0000","last_peered":"2024-05-30T07:00:52.440422+0000","last_clean":"2024-05-30T07:00:52.440422+0000","last_became_active":"2024-05-30T06:59:08.043786+0000","last_became_peered":"2024-05-30T06:59:08.043786+0000","last_unstale":"2024-05-30T07:00:52.440422+0000","last_undegraded":"2024-05-30T07:00:52.440422+0000","last_fullsized":"2024-05-30T07:00:52.440422+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:51:04.988561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":97,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"130'85","reported_seq":157,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.451401+0000","last_change":"2024-05-30T06:59:08.022594+0000","last_active":"2024-05-30T07:00:52.451401+0000","last_peered":"2024-05-30T07:00:52.451401+0000","last_clean":"2024-05-30T07:00:52.451401+0000","last_became_active":"2024-05-30T06:59:08.022293+0000","last_became_peered":"2024-05-30T06:59:08.022293+0000","last_unstale":"2024-05-30T07:00:52.451401+0000","last_undegraded":"2024-05-30T07:00:52.451401+0000","last_fullsized":"2024-05-30T07:00:52.451401+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:27:44.098848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":56,"num_read_kb":212996,"num_write":85,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"130'92","reported_seq":172,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.465900+0000","last_change":"2024-05-30T06:59:08.038685+0000","last_active":"2024-05-30T07:00:52.465900+0000","last_peered":"2024-05-30T07:00:52.465900+0000","last_clean":"2024-05-30T07:00:52.465900+0000","last_became_active":"2024-05-30T06:59:08.038414+0000","last_became_peered":"2024-05-30T06:59:08.038414+0000","last_unstale":"2024-05-30T07:00:52.465900+0000","last_undegraded":"2024-05-30T07:00:52.465900+0000","last_fullsized":"2024-05-30T07:00:52.465900+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:15:35.587906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":64,"num_read_kb":258049,"num_write":92,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"130'84","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.474185+0000","last_change":"2024-05-30T06:59:56.500807+0000","last_active":"2024-05-30T07:00:52.474185+0000","last_peered":"2024-05-30T07:00:52.474185+0000","last_clean":"2024-05-30T07:00:52.474185+0000","last_became_active":"2024-05-30T06:59:54.423066+0000","last_became_peered":"2024-05-30T06:59:54.423066+0000","last_unstale":"2024-05-30T07:00:52.474185+0000","last_undegraded":"2024-05-30T07:00:52.474185+0000","last_fullsized":"2024-05-30T07:00:52.474185+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:54:28.187315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":83,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"130'96","reported_seq":177,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.484611+0000","last_change":"2024-05-30T06:59:08.024951+0000","last_active":"2024-05-30T07:00:52.484611+0000","last_peered":"2024-05-30T07:00:52.484611+0000","last_clean":"2024-05-30T07:00:52.484611+0000","last_became_active":"2024-05-30T06:59:08.024354+0000","last_became_peered":"2024-05-30T06:59:08.024354+0000","last_unstale":"2024-05-30T07:00:52.484611+0000","last_undegraded":"2024-05-30T07:00:52.484611+0000","last_fullsized":"2024-05-30T07:00:52.484611+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:51:04.466523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":96,"num_write_kb":331776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"130'90","reported_seq":139,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.483923+0000","last_change":"2024-05-30T06:59:08.033925+0000","last_active":"2024-05-30T07:00:52.483923+0000","last_peered":"2024-05-30T07:00:52.483923+0000","last_clean":"2024-05-30T07:00:52.483923+0000","last_became_active":"2024-05-30T06:59:08.033552+0000","last_became_peered":"2024-05-30T06:59:08.033552+0000","last_unstale":"2024-05-30T07:00:52.483923+0000","last_undegraded":"2024-05-30T07:00:52.483923+0000","last_fullsized":"2024-05-30T07:00:52.483923+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:15:35.587906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":33,"num_read_kb":135168,"num_write":90,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"130'97","reported_seq":183,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.491951+0000","last_change":"2024-05-30T06:59:08.033338+0000","last_active":"2024-05-30T07:00:52.491951+0000","last_peered":"2024-05-30T07:00:52.491951+0000","last_clean":"2024-05-30T07:00:52.491951+0000","last_became_active":"2024-05-30T06:59:08.032376+0000","last_became_peered":"2024-05-30T06:59:08.032376+0000","last_unstale":"2024-05-30T07:00:52.491951+0000","last_undegraded":"2024-05-30T07:00:52.491951+0000","last_fullsized":"2024-05-30T07:00:52.491951+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:19:12.129168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":70,"num_read_kb":286720,"num_write":97,"num_write_kb":323585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"130'92","reported_seq":172,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.493486+0000","last_change":"2024-05-30T06:59:08.032860+0000","last_active":"2024-05-30T07:00:52.493486+0000","last_peered":"2024-05-30T07:00:52.493486+0000","last_clean":"2024-05-30T07:00:52.493486+0000","last_became_active":"2024-05-30T06:59:08.032457+0000","last_became_peered":"2024-05-30T06:59:08.032457+0000","last_unstale":"2024-05-30T07:00:52.493486+0000","last_undegraded":"2024-05-30T07:00:52.493486+0000","last_fullsized":"2024-05-30T07:00:52.493486+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:08.647882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":92,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"130'82","reported_seq":191,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.462021+0000","last_change":"2024-05-30T06:59:08.039799+0000","last_active":"2024-05-30T07:00:52.462021+0000","last_peered":"2024-05-30T07:00:52.462021+0000","last_clean":"2024-05-30T07:00:52.462021+0000","last_became_active":"2024-05-30T06:59:08.039524+0000","last_became_peered":"2024-05-30T06:59:08.039524+0000","last_unstale":"2024-05-30T07:00:52.462021+0000","last_undegraded":"2024-05-30T07:00:52.462021+0000","last_fullsized":"2024-05-30T07:00:52.462021+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:32:19.058834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":93,"num_read_kb":380928,"num_write":82,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"130'87","reported_seq":176,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.499465+0000","last_change":"2024-05-30T06:59:08.025201+0000","last_active":"2024-05-30T07:00:52.499465+0000","last_peered":"2024-05-30T07:00:52.499465+0000","last_clean":"2024-05-30T07:00:52.499465+0000","last_became_active":"2024-05-30T06:59:08.023719+0000","last_became_peered":"2024-05-30T06:59:08.023719+0000","last_unstale":"2024-05-30T07:00:52.499465+0000","last_undegraded":"2024-05-30T07:00:52.499465+0000","last_fullsized":"2024-05-30T07:00:52.499465+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:51.605688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":73,"num_read_kb":290818,"num_write":87,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"130'71","reported_seq":132,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.502714+0000","last_change":"2024-05-30T06:59:08.022581+0000","last_active":"2024-05-30T07:00:52.502714+0000","last_peered":"2024-05-30T07:00:52.502714+0000","last_clean":"2024-05-30T07:00:52.502714+0000","last_became_active":"2024-05-30T06:59:08.017322+0000","last_became_peered":"2024-05-30T06:59:08.017322+0000","last_unstale":"2024-05-30T07:00:52.502714+0000","last_undegraded":"2024-05-30T07:00:52.502714+0000","last_fullsized":"2024-05-30T07:00:52.502714+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:52:23.377454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192938245,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":44,"num_read_kb":180224,"num_write":71,"num_write_kb":237569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"127'4","reported_seq":22,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419989+0000","last_change":"2024-05-30T06:59:07.025645+0000","last_active":"2024-05-30T06:59:54.419989+0000","last_peered":"2024-05-30T06:59:54.419989+0000","last_clean":"2024-05-30T06:59:54.419989+0000","last_became_active":"2024-05-30T06:59:07.025401+0000","last_became_peered":"2024-05-30T06:59:07.025401+0000","last_unstale":"2024-05-30T06:59:54.419989+0000","last_undegraded":"2024-05-30T06:59:54.419989+0000","last_fullsized":"2024-05-30T06:59:54.419989+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:12.308444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"130'96","reported_seq":181,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.448896+0000","last_change":"2024-05-30T06:59:08.037515+0000","last_active":"2024-05-30T07:00:52.448896+0000","last_peered":"2024-05-30T07:00:52.448896+0000","last_clean":"2024-05-30T07:00:52.448896+0000","last_became_active":"2024-05-30T06:59:08.037242+0000","last_became_peered":"2024-05-30T06:59:08.037242+0000","last_unstale":"2024-05-30T07:00:52.448896+0000","last_undegraded":"2024-05-30T07:00:52.448896+0000","last_fullsized":"2024-05-30T07:00:52.448896+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:21:24.557259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":69,"num_read_kb":266244,"num_write":96,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"127'1","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418391+0000","last_change":"2024-05-30T06:59:07.028000+0000","last_active":"2024-05-30T06:59:54.418391+0000","last_peered":"2024-05-30T06:59:54.418391+0000","last_clean":"2024-05-30T06:59:54.418391+0000","last_became_active":"2024-05-30T06:59:07.027686+0000","last_became_peered":"2024-05-30T06:59:07.027686+0000","last_unstale":"2024-05-30T06:59:54.418391+0000","last_undegraded":"2024-05-30T06:59:54.418391+0000","last_fullsized":"2024-05-30T06:59:54.418391+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:22:41.838812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"130'88","reported_seq":174,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.340623+0000","last_change":"2024-05-30T06:59:08.039191+0000","last_active":"2024-05-30T07:00:52.340623+0000","last_peered":"2024-05-30T07:00:52.340623+0000","last_clean":"2024-05-30T07:00:52.340623+0000","last_became_active":"2024-05-30T06:59:08.038891+0000","last_became_peered":"2024-05-30T06:59:08.038891+0000","last_unstale":"2024-05-30T07:00:52.340623+0000","last_undegraded":"2024-05-30T07:00:52.340623+0000","last_fullsized":"2024-05-30T07:00:52.340623+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:08:22.095245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075589,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":70,"num_read_kb":278530,"num_write":88,"num_write_kb":290818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"128'3","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414411+0000","last_change":"2024-05-30T06:59:07.021128+0000","last_active":"2024-05-30T06:59:54.414411+0000","last_peered":"2024-05-30T06:59:54.414411+0000","last_clean":"2024-05-30T06:59:54.414411+0000","last_became_active":"2024-05-30T06:59:07.020820+0000","last_became_peered":"2024-05-30T06:59:07.020820+0000","last_unstale":"2024-05-30T06:59:54.414411+0000","last_undegraded":"2024-05-30T06:59:54.414411+0000","last_fullsized":"2024-05-30T06:59:54.414411+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:01:56.813502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"130'111","reported_seq":214,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.499234+0000","last_change":"2024-05-30T06:59:08.033837+0000","last_active":"2024-05-30T07:00:52.499234+0000","last_peered":"2024-05-30T07:00:52.499234+0000","last_clean":"2024-05-30T07:00:52.499234+0000","last_became_active":"2024-05-30T06:59:08.033506+0000","last_became_peered":"2024-05-30T06:59:08.033506+0000","last_unstale":"2024-05-30T07:00:52.499234+0000","last_undegraded":"2024-05-30T07:00:52.499234+0000","last_fullsized":"2024-05-30T07:00:52.499234+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:41:37.594639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":87,"num_read_kb":356352,"num_write":111,"num_write_kb":364544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"127'2","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.485359+0000","last_change":"2024-05-30T06:59:07.025478+0000","last_active":"2024-05-30T06:59:54.485359+0000","last_peered":"2024-05-30T06:59:54.485359+0000","last_clean":"2024-05-30T06:59:54.485359+0000","last_became_active":"2024-05-30T06:59:07.025201+0000","last_became_peered":"2024-05-30T06:59:07.025201+0000","last_unstale":"2024-05-30T06:59:54.485359+0000","last_undegraded":"2024-05-30T06:59:54.485359+0000","last_fullsized":"2024-05-30T06:59:54.485359+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:37:03.894636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"130'91","reported_seq":162,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.515252+0000","last_change":"2024-05-30T06:59:08.022157+0000","last_active":"2024-05-30T07:00:52.515252+0000","last_peered":"2024-05-30T07:00:52.515252+0000","last_clean":"2024-05-30T07:00:52.515252+0000","last_became_active":"2024-05-30T06:59:08.017121+0000","last_became_peered":"2024-05-30T06:59:08.017121+0000","last_unstale":"2024-05-30T07:00:52.515252+0000","last_undegraded":"2024-05-30T07:00:52.515252+0000","last_fullsized":"2024-05-30T07:00:52.515252+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:18:16.991239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":91,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.484877+0000","last_change":"2024-05-30T06:59:07.026285+0000","last_active":"2024-05-30T06:59:54.484877+0000","last_peered":"2024-05-30T06:59:54.484877+0000","last_clean":"2024-05-30T06:59:54.484877+0000","last_became_active":"2024-05-30T06:59:07.025467+0000","last_became_peered":"2024-05-30T06:59:07.025467+0000","last_unstale":"2024-05-30T06:59:54.484877+0000","last_undegraded":"2024-05-30T06:59:54.484877+0000","last_fullsized":"2024-05-30T06:59:54.484877+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:37.636868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"130'89","reported_seq":196,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.476545+0000","last_change":"2024-05-30T06:59:08.022678+0000","last_active":"2024-05-30T07:00:52.476545+0000","last_peered":"2024-05-30T07:00:52.476545+0000","last_clean":"2024-05-30T07:00:52.476545+0000","last_became_active":"2024-05-30T06:59:08.022387+0000","last_became_peered":"2024-05-30T06:59:08.022387+0000","last_unstale":"2024-05-30T07:00:52.476545+0000","last_undegraded":"2024-05-30T07:00:52.476545+0000","last_fullsized":"2024-05-30T07:00:52.476545+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:30:30.629687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":91,"num_read_kb":372736,"num_write":89,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417948+0000","last_change":"2024-05-30T06:59:07.020549+0000","last_active":"2024-05-30T06:59:54.417948+0000","last_peered":"2024-05-30T06:59:54.417948+0000","last_clean":"2024-05-30T06:59:54.417948+0000","last_became_active":"2024-05-30T06:59:07.020278+0000","last_became_peered":"2024-05-30T06:59:07.020278+0000","last_unstale":"2024-05-30T06:59:54.417948+0000","last_undegraded":"2024-05-30T06:59:54.417948+0000","last_fullsized":"2024-05-30T06:59:54.417948+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:33:45.564464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"130'82","reported_seq":168,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.483472+0000","last_change":"2024-05-30T06:59:08.035741+0000","last_active":"2024-05-30T07:00:52.483472+0000","last_peered":"2024-05-30T07:00:52.483472+0000","last_clean":"2024-05-30T07:00:52.483472+0000","last_became_active":"2024-05-30T06:59:08.035015+0000","last_became_peered":"2024-05-30T06:59:08.035015+0000","last_unstale":"2024-05-30T07:00:52.483472+0000","last_undegraded":"2024-05-30T07:00:52.483472+0000","last_fullsized":"2024-05-30T07:00:52.483472+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:31:05.904917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":70,"num_read_kb":286720,"num_write":82,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417507+0000","last_change":"2024-05-30T06:59:07.015142+0000","last_active":"2024-05-30T06:59:54.417507+0000","last_peered":"2024-05-30T06:59:54.417507+0000","last_clean":"2024-05-30T06:59:54.417507+0000","last_became_active":"2024-05-30T06:59:07.013998+0000","last_became_peered":"2024-05-30T06:59:07.013998+0000","last_unstale":"2024-05-30T06:59:54.417507+0000","last_undegraded":"2024-05-30T06:59:54.417507+0000","last_fullsized":"2024-05-30T06:59:54.417507+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:07:17.296567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"130'85","reported_seq":165,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.463536+0000","last_change":"2024-05-30T06:59:08.012136+0000","last_active":"2024-05-30T07:00:52.463536+0000","last_peered":"2024-05-30T07:00:52.463536+0000","last_clean":"2024-05-30T07:00:52.463536+0000","last_became_active":"2024-05-30T06:59:08.011821+0000","last_became_peered":"2024-05-30T06:59:08.011821+0000","last_unstale":"2024-05-30T07:00:52.463536+0000","last_undegraded":"2024-05-30T07:00:52.463536+0000","last_fullsized":"2024-05-30T07:00:52.463536+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:42:18.685808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":85,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.479813+0000","last_change":"2024-05-30T06:59:07.018234+0000","last_active":"2024-05-30T06:59:54.479813+0000","last_peered":"2024-05-30T06:59:54.479813+0000","last_clean":"2024-05-30T06:59:54.479813+0000","last_became_active":"2024-05-30T06:59:07.017948+0000","last_became_peered":"2024-05-30T06:59:07.017948+0000","last_unstale":"2024-05-30T06:59:54.479813+0000","last_undegraded":"2024-05-30T06:59:54.479813+0000","last_fullsized":"2024-05-30T06:59:54.479813+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:06:58.214120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"130'74","reported_seq":126,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.458195+0000","last_change":"2024-05-30T06:59:08.024166+0000","last_active":"2024-05-30T07:00:52.458195+0000","last_peered":"2024-05-30T07:00:52.458195+0000","last_clean":"2024-05-30T07:00:52.458195+0000","last_became_active":"2024-05-30T06:59:08.023873+0000","last_became_peered":"2024-05-30T06:59:08.023873+0000","last_unstale":"2024-05-30T07:00:52.458195+0000","last_undegraded":"2024-05-30T07:00:52.458195+0000","last_fullsized":"2024-05-30T07:00:52.458195+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:15:02.554710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":74,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"128'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418561+0000","last_change":"2024-05-30T06:59:07.024511+0000","last_active":"2024-05-30T06:59:54.418561+0000","last_peered":"2024-05-30T06:59:54.418561+0000","last_clean":"2024-05-30T06:59:54.418561+0000","last_became_active":"2024-05-30T06:59:07.024244+0000","last_became_peered":"2024-05-30T06:59:07.024244+0000","last_unstale":"2024-05-30T06:59:54.418561+0000","last_undegraded":"2024-05-30T06:59:54.418561+0000","last_fullsized":"2024-05-30T06:59:54.418561+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:55.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"130'72","reported_seq":128,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.434383+0000","last_change":"2024-05-30T06:59:08.025397+0000","last_active":"2024-05-30T07:00:52.434383+0000","last_peered":"2024-05-30T07:00:52.434383+0000","last_clean":"2024-05-30T07:00:52.434383+0000","last_became_active":"2024-05-30T06:59:08.023906+0000","last_became_peered":"2024-05-30T06:59:08.023906+0000","last_unstale":"2024-05-30T07:00:52.434383+0000","last_undegraded":"2024-05-30T07:00:52.434383+0000","last_fullsized":"2024-05-30T07:00:52.434383+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:34.458628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230686900,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":40,"num_read_kb":159745,"num_write":72,"num_write_kb":258049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418997+0000","last_change":"2024-05-30T06:59:07.014122+0000","last_active":"2024-05-30T06:59:54.418997+0000","last_peered":"2024-05-30T06:59:54.418997+0000","last_clean":"2024-05-30T06:59:54.418997+0000","last_became_active":"2024-05-30T06:59:07.013813+0000","last_became_peered":"2024-05-30T06:59:07.013813+0000","last_unstale":"2024-05-30T06:59:54.418997+0000","last_undegraded":"2024-05-30T06:59:54.418997+0000","last_fullsized":"2024-05-30T06:59:54.418997+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:50.599472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"130'78","reported_seq":174,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.503992+0000","last_change":"2024-05-30T06:59:08.039459+0000","last_active":"2024-05-30T07:00:52.503992+0000","last_peered":"2024-05-30T07:00:52.503992+0000","last_clean":"2024-05-30T07:00:52.503992+0000","last_became_active":"2024-05-30T06:59:08.039187+0000","last_became_peered":"2024-05-30T06:59:08.039187+0000","last_unstale":"2024-05-30T07:00:52.503992+0000","last_undegraded":"2024-05-30T07:00:52.503992+0000","last_fullsized":"2024-05-30T07:00:52.503992+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:33:34.546284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":77,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"130'24","reported_seq":42,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.159062+0000","last_change":"2024-05-30T06:59:07.023207+0000","last_active":"2024-05-30T07:00:52.159062+0000","last_peered":"2024-05-30T07:00:52.159062+0000","last_clean":"2024-05-30T07:00:52.159062+0000","last_became_active":"2024-05-30T06:59:07.022910+0000","last_became_peered":"2024-05-30T06:59:07.022910+0000","last_unstale":"2024-05-30T07:00:52.159062+0000","last_undegraded":"2024-05-30T07:00:52.159062+0000","last_fullsized":"2024-05-30T07:00:52.159062+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:02:20.542236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"130'84","reported_seq":166,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.394215+0000","last_change":"2024-05-30T06:59:08.039689+0000","last_active":"2024-05-30T07:00:52.394215+0000","last_peered":"2024-05-30T07:00:52.394215+0000","last_clean":"2024-05-30T07:00:52.394215+0000","last_became_active":"2024-05-30T06:59:08.039393+0000","last_became_peered":"2024-05-30T06:59:08.039393+0000","last_unstale":"2024-05-30T07:00:52.394215+0000","last_undegraded":"2024-05-30T07:00:52.394215+0000","last_fullsized":"2024-05-30T07:00:52.394215+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:00:59.299956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":66,"num_read_kb":253956,"num_write":82,"num_write_kb":278530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"130'436","reported_seq":454,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:58.198089+0000","last_change":"2024-05-30T06:59:07.014432+0000","last_active":"2024-05-30T07:00:58.198089+0000","last_peered":"2024-05-30T07:00:58.198089+0000","last_clean":"2024-05-30T07:00:58.198089+0000","last_became_active":"2024-05-30T06:59:07.014000+0000","last_became_peered":"2024-05-30T06:59:07.014000+0000","last_unstale":"2024-05-30T07:00:58.198089+0000","last_undegraded":"2024-05-30T07:00:58.198089+0000","last_fullsized":"2024-05-30T07:00:58.198089+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:10:36.275003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1700724,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":1804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"130'97","reported_seq":163,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.483361+0000","last_change":"2024-05-30T06:59:08.022261+0000","last_active":"2024-05-30T07:00:52.483361+0000","last_peered":"2024-05-30T07:00:52.483361+0000","last_clean":"2024-05-30T07:00:52.483361+0000","last_became_active":"2024-05-30T06:59:08.022009+0000","last_became_peered":"2024-05-30T06:59:08.022009+0000","last_unstale":"2024-05-30T07:00:52.483361+0000","last_undegraded":"2024-05-30T07:00:52.483361+0000","last_fullsized":"2024-05-30T07:00:52.483361+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:20:20.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":50,"num_read_kb":200705,"num_write":97,"num_write_kb":327681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417486+0000","last_change":"2024-05-30T06:59:07.013707+0000","last_active":"2024-05-30T06:59:54.417486+0000","last_peered":"2024-05-30T06:59:54.417486+0000","last_clean":"2024-05-30T06:59:54.417486+0000","last_became_active":"2024-05-30T06:59:07.013181+0000","last_became_peered":"2024-05-30T06:59:07.013181+0000","last_unstale":"2024-05-30T06:59:54.417486+0000","last_undegraded":"2024-05-30T06:59:54.417486+0000","last_fullsized":"2024-05-30T06:59:54.417486+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:47:22.693305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"130'79","reported_seq":154,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.417583+0000","last_change":"2024-05-30T06:59:08.030108+0000","last_active":"2024-05-30T07:00:52.417583+0000","last_peered":"2024-05-30T07:00:52.417583+0000","last_clean":"2024-05-30T07:00:52.417583+0000","last_became_active":"2024-05-30T06:59:08.029134+0000","last_became_peered":"2024-05-30T06:59:08.029134+0000","last_unstale":"2024-05-30T07:00:52.417583+0000","last_undegraded":"2024-05-30T07:00:52.417583+0000","last_fullsized":"2024-05-30T07:00:52.417583+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:56.766557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":79,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.480128+0000","last_change":"2024-05-30T06:59:07.022390+0000","last_active":"2024-05-30T06:59:54.480128+0000","last_peered":"2024-05-30T06:59:54.480128+0000","last_clean":"2024-05-30T06:59:54.480128+0000","last_became_active":"2024-05-30T06:59:07.022101+0000","last_became_peered":"2024-05-30T06:59:07.022101+0000","last_unstale":"2024-05-30T06:59:54.480128+0000","last_undegraded":"2024-05-30T06:59:54.480128+0000","last_fullsized":"2024-05-30T06:59:54.480128+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:18.370173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"130'105","reported_seq":185,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.448633+0000","last_change":"2024-05-30T06:59:08.044660+0000","last_active":"2024-05-30T07:00:52.448633+0000","last_peered":"2024-05-30T07:00:52.448633+0000","last_clean":"2024-05-30T07:00:52.448633+0000","last_became_active":"2024-05-30T06:59:08.044058+0000","last_became_peered":"2024-05-30T06:59:08.044058+0000","last_unstale":"2024-05-30T07:00:52.448633+0000","last_undegraded":"2024-05-30T07:00:52.448633+0000","last_fullsized":"2024-05-30T07:00:52.448633+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:49:32.544053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301990149,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":105,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"127'8","reported_seq":26,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.460852+0000","last_change":"2024-05-30T06:59:07.015902+0000","last_active":"2024-05-30T06:59:54.460852+0000","last_peered":"2024-05-30T06:59:54.460852+0000","last_clean":"2024-05-30T06:59:54.460852+0000","last_became_active":"2024-05-30T06:59:07.015593+0000","last_became_peered":"2024-05-30T06:59:07.015593+0000","last_unstale":"2024-05-30T06:59:54.460852+0000","last_undegraded":"2024-05-30T06:59:54.460852+0000","last_fullsized":"2024-05-30T06:59:54.460852+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:14:30.382452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"130'68","reported_seq":107,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.508664+0000","last_change":"2024-05-30T06:59:08.036882+0000","last_active":"2024-05-30T07:00:52.508664+0000","last_peered":"2024-05-30T07:00:52.508664+0000","last_clean":"2024-05-30T07:00:52.508664+0000","last_became_active":"2024-05-30T06:59:08.036615+0000","last_became_peered":"2024-05-30T06:59:08.036615+0000","last_unstale":"2024-05-30T07:00:52.508664+0000","last_undegraded":"2024-05-30T07:00:52.508664+0000","last_fullsized":"2024-05-30T07:00:52.508664+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:17.450834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":23,"num_read_kb":94208,"num_write":68,"num_write_kb":237568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418585+0000","last_change":"2024-05-30T06:59:07.019419+0000","last_active":"2024-05-30T06:59:54.418585+0000","last_peered":"2024-05-30T06:59:54.418585+0000","last_clean":"2024-05-30T06:59:54.418585+0000","last_became_active":"2024-05-30T06:59:07.019026+0000","last_became_peered":"2024-05-30T06:59:07.019026+0000","last_unstale":"2024-05-30T06:59:54.418585+0000","last_undegraded":"2024-05-30T06:59:54.418585+0000","last_fullsized":"2024-05-30T06:59:54.418585+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:42:17.679592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"130'98","reported_seq":191,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.459795+0000","last_change":"2024-05-30T06:59:08.041567+0000","last_active":"2024-05-30T07:00:52.459795+0000","last_peered":"2024-05-30T07:00:52.459795+0000","last_clean":"2024-05-30T07:00:52.459795+0000","last_became_active":"2024-05-30T06:59:08.039259+0000","last_became_peered":"2024-05-30T06:59:08.039259+0000","last_unstale":"2024-05-30T07:00:52.459795+0000","last_undegraded":"2024-05-30T07:00:52.459795+0000","last_fullsized":"2024-05-30T07:00:52.459795+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:37:27.648210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":77,"num_read_kb":315392,"num_write":98,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"127'2","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414287+0000","last_change":"2024-05-30T06:59:07.020027+0000","last_active":"2024-05-30T06:59:54.414287+0000","last_peered":"2024-05-30T06:59:54.414287+0000","last_clean":"2024-05-30T06:59:54.414287+0000","last_became_active":"2024-05-30T06:59:07.019702+0000","last_became_peered":"2024-05-30T06:59:07.019702+0000","last_unstale":"2024-05-30T06:59:54.414287+0000","last_undegraded":"2024-05-30T06:59:54.414287+0000","last_fullsized":"2024-05-30T06:59:54.414287+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:49:45.444316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"130'72","reported_seq":147,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.507440+0000","last_change":"2024-05-30T06:59:08.026623+0000","last_active":"2024-05-30T07:00:52.507440+0000","last_peered":"2024-05-30T07:00:52.507440+0000","last_clean":"2024-05-30T07:00:52.507440+0000","last_became_active":"2024-05-30T06:59:08.026370+0000","last_became_peered":"2024-05-30T06:59:08.026370+0000","last_unstale":"2024-05-30T07:00:52.507440+0000","last_undegraded":"2024-05-30T07:00:52.507440+0000","last_fullsized":"2024-05-30T07:00:52.507440+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:07:33.988552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":59,"num_read_kb":225284,"num_write":72,"num_write_kb":233475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417939+0000","last_change":"2024-05-30T06:59:07.018086+0000","last_active":"2024-05-30T06:59:54.417939+0000","last_peered":"2024-05-30T06:59:54.417939+0000","last_clean":"2024-05-30T06:59:54.417939+0000","last_became_active":"2024-05-30T06:59:07.017740+0000","last_became_peered":"2024-05-30T06:59:07.017740+0000","last_unstale":"2024-05-30T06:59:54.417939+0000","last_undegraded":"2024-05-30T06:59:54.417939+0000","last_fullsized":"2024-05-30T06:59:54.417939+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:16.444618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"130'87","reported_seq":178,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.498056+0000","last_change":"2024-05-30T06:59:08.015660+0000","last_active":"2024-05-30T07:00:52.498056+0000","last_peered":"2024-05-30T07:00:52.498056+0000","last_clean":"2024-05-30T07:00:52.498056+0000","last_became_active":"2024-05-30T06:59:08.015370+0000","last_became_peered":"2024-05-30T06:59:08.015370+0000","last_unstale":"2024-05-30T07:00:52.498056+0000","last_undegraded":"2024-05-30T07:00:52.498056+0000","last_fullsized":"2024-05-30T07:00:52.498056+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:10:59.558212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":87,"num_write_kb":299008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418143+0000","last_change":"2024-05-30T06:59:07.024249+0000","last_active":"2024-05-30T06:59:54.418143+0000","last_peered":"2024-05-30T06:59:54.418143+0000","last_clean":"2024-05-30T06:59:54.418143+0000","last_became_active":"2024-05-30T06:59:07.023895+0000","last_became_peered":"2024-05-30T06:59:07.023895+0000","last_unstale":"2024-05-30T06:59:54.418143+0000","last_undegraded":"2024-05-30T06:59:54.418143+0000","last_fullsized":"2024-05-30T06:59:54.418143+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:16:51.738852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"130'98","reported_seq":192,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.471161+0000","last_change":"2024-05-30T06:59:08.029322+0000","last_active":"2024-05-30T07:00:52.471161+0000","last_peered":"2024-05-30T07:00:52.471161+0000","last_clean":"2024-05-30T07:00:52.471161+0000","last_became_active":"2024-05-30T06:59:08.028959+0000","last_became_peered":"2024-05-30T06:59:08.028959+0000","last_unstale":"2024-05-30T07:00:52.471161+0000","last_undegraded":"2024-05-30T07:00:52.471161+0000","last_fullsized":"2024-05-30T07:00:52.471161+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:03:19.376389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":98,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"128'3","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418435+0000","last_change":"2024-05-30T06:59:07.019458+0000","last_active":"2024-05-30T06:59:54.418435+0000","last_peered":"2024-05-30T06:59:54.418435+0000","last_clean":"2024-05-30T06:59:54.418435+0000","last_became_active":"2024-05-30T06:59:07.019186+0000","last_became_peered":"2024-05-30T06:59:07.019186+0000","last_unstale":"2024-05-30T06:59:54.418435+0000","last_undegraded":"2024-05-30T06:59:54.418435+0000","last_fullsized":"2024-05-30T06:59:54.418435+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:53.047887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"130'90","reported_seq":170,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.412258+0000","last_change":"2024-05-30T06:59:08.035291+0000","last_active":"2024-05-30T07:00:52.412258+0000","last_peered":"2024-05-30T07:00:52.412258+0000","last_clean":"2024-05-30T07:00:52.412258+0000","last_became_active":"2024-05-30T06:59:08.034951+0000","last_became_peered":"2024-05-30T06:59:08.034951+0000","last_unstale":"2024-05-30T07:00:52.412258+0000","last_undegraded":"2024-05-30T07:00:52.412258+0000","last_fullsized":"2024-05-30T07:00:52.412258+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:21:42.071914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018629,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":245764,"num_write":90,"num_write_kb":315394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418019+0000","last_change":"2024-05-30T06:59:07.016536+0000","last_active":"2024-05-30T06:59:54.418019+0000","last_peered":"2024-05-30T06:59:54.418019+0000","last_clean":"2024-05-30T06:59:54.418019+0000","last_became_active":"2024-05-30T06:59:07.016202+0000","last_became_peered":"2024-05-30T06:59:07.016202+0000","last_unstale":"2024-05-30T06:59:54.418019+0000","last_undegraded":"2024-05-30T06:59:54.418019+0000","last_fullsized":"2024-05-30T06:59:54.418019+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:47:15.001802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"130'102","reported_seq":164,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.450963+0000","last_change":"2024-05-30T06:59:08.022686+0000","last_active":"2024-05-30T07:00:52.450963+0000","last_peered":"2024-05-30T07:00:52.450963+0000","last_clean":"2024-05-30T07:00:52.450963+0000","last_became_active":"2024-05-30T06:59:08.022436+0000","last_became_peered":"2024-05-30T06:59:08.022436+0000","last_unstale":"2024-05-30T07:00:52.450963+0000","last_undegraded":"2024-05-30T07:00:52.450963+0000","last_fullsized":"2024-05-30T07:00:52.450963+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:54.054104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":46,"num_read_kb":180226,"num_write":102,"num_write_kb":352257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417252+0000","last_change":"2024-05-30T06:59:07.017333+0000","last_active":"2024-05-30T06:59:54.417252+0000","last_peered":"2024-05-30T06:59:54.417252+0000","last_clean":"2024-05-30T06:59:54.417252+0000","last_became_active":"2024-05-30T06:59:07.017037+0000","last_became_peered":"2024-05-30T06:59:07.017037+0000","last_unstale":"2024-05-30T06:59:54.417252+0000","last_undegraded":"2024-05-30T06:59:54.417252+0000","last_fullsized":"2024-05-30T06:59:54.417252+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:18:59.328569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"130'76","reported_seq":152,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.505115+0000","last_change":"2024-05-30T06:59:08.038802+0000","last_active":"2024-05-30T07:00:52.505115+0000","last_peered":"2024-05-30T07:00:52.505115+0000","last_clean":"2024-05-30T07:00:52.505115+0000","last_became_active":"2024-05-30T06:59:08.038486+0000","last_became_peered":"2024-05-30T06:59:08.038486+0000","last_unstale":"2024-05-30T07:00:52.505115+0000","last_undegraded":"2024-05-30T07:00:52.505115+0000","last_fullsized":"2024-05-30T07:00:52.505115+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:34.693941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":60,"num_read_kb":245760,"num_write":76,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"130'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414047+0000","last_change":"2024-05-30T06:59:07.018462+0000","last_active":"2024-05-30T06:59:54.414047+0000","last_peered":"2024-05-30T06:59:54.414047+0000","last_clean":"2024-05-30T06:59:54.414047+0000","last_became_active":"2024-05-30T06:59:07.017946+0000","last_became_peered":"2024-05-30T06:59:07.017946+0000","last_unstale":"2024-05-30T06:59:54.414047+0000","last_undegraded":"2024-05-30T06:59:54.414047+0000","last_fullsized":"2024-05-30T06:59:54.414047+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:18:15.985022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"130'100","reported_seq":152,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.486103+0000","last_change":"2024-05-30T06:59:08.025933+0000","last_active":"2024-05-30T07:00:52.486103+0000","last_peered":"2024-05-30T07:00:52.486103+0000","last_clean":"2024-05-30T07:00:52.486103+0000","last_became_active":"2024-05-30T06:59:08.025557+0000","last_became_peered":"2024-05-30T06:59:08.025557+0000","last_unstale":"2024-05-30T07:00:52.486103+0000","last_undegraded":"2024-05-30T07:00:52.486103+0000","last_fullsized":"2024-05-30T07:00:52.486103+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:59.888055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":100,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"127'2","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417721+0000","last_change":"2024-05-30T06:59:07.020218+0000","last_active":"2024-05-30T06:59:54.417721+0000","last_peered":"2024-05-30T06:59:54.417721+0000","last_clean":"2024-05-30T06:59:54.417721+0000","last_became_active":"2024-05-30T06:59:07.018769+0000","last_became_peered":"2024-05-30T06:59:07.018769+0000","last_unstale":"2024-05-30T06:59:54.417721+0000","last_undegraded":"2024-05-30T06:59:54.417721+0000","last_fullsized":"2024-05-30T06:59:54.417721+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:25:06.907108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"130'90","reported_seq":185,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.417790+0000","last_change":"2024-05-30T06:59:08.032992+0000","last_active":"2024-05-30T07:00:52.417790+0000","last_peered":"2024-05-30T07:00:52.417790+0000","last_clean":"2024-05-30T07:00:52.417790+0000","last_became_active":"2024-05-30T06:59:08.032647+0000","last_became_peered":"2024-05-30T06:59:08.032647+0000","last_unstale":"2024-05-30T07:00:52.417790+0000","last_undegraded":"2024-05-30T07:00:52.417790+0000","last_fullsized":"2024-05-30T07:00:52.417790+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:12:45.810350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":79,"num_read_kb":323584,"num_write":90,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"130'34","reported_seq":52,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:51.049562+0000","last_change":"2024-05-30T06:59:07.021143+0000","last_active":"2024-05-30T07:00:51.049562+0000","last_peered":"2024-05-30T07:00:51.049562+0000","last_clean":"2024-05-30T07:00:51.049562+0000","last_became_active":"2024-05-30T06:59:07.020771+0000","last_became_peered":"2024-05-30T06:59:07.020771+0000","last_unstale":"2024-05-30T07:00:51.049562+0000","last_undegraded":"2024-05-30T07:00:51.049562+0000","last_fullsized":"2024-05-30T07:00:51.049562+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:42.840485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"130'84","reported_seq":192,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.513036+0000","last_change":"2024-05-30T06:59:08.038746+0000","last_active":"2024-05-30T07:00:52.513036+0000","last_peered":"2024-05-30T07:00:52.513036+0000","last_clean":"2024-05-30T07:00:52.513036+0000","last_became_active":"2024-05-30T06:59:08.038465+0000","last_became_peered":"2024-05-30T06:59:08.038465+0000","last_unstale":"2024-05-30T07:00:52.513036+0000","last_undegraded":"2024-05-30T07:00:52.513036+0000","last_fullsized":"2024-05-30T07:00:52.513036+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:42:53.672075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":92,"num_read_kb":376832,"num_write":84,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.483446+0000","last_change":"2024-05-30T06:59:07.019355+0000","last_active":"2024-05-30T06:59:54.483446+0000","last_peered":"2024-05-30T06:59:54.483446+0000","last_clean":"2024-05-30T06:59:54.483446+0000","last_became_active":"2024-05-30T06:59:07.019061+0000","last_became_peered":"2024-05-30T06:59:07.019061+0000","last_unstale":"2024-05-30T06:59:54.483446+0000","last_undegraded":"2024-05-30T06:59:54.483446+0000","last_fullsized":"2024-05-30T06:59:54.483446+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:57:26.978817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"130'98","reported_seq":162,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.490857+0000","last_change":"2024-05-30T06:59:08.032170+0000","last_active":"2024-05-30T07:00:52.490857+0000","last_peered":"2024-05-30T07:00:52.490857+0000","last_clean":"2024-05-30T07:00:52.490857+0000","last_became_active":"2024-05-30T06:59:08.030918+0000","last_became_peered":"2024-05-30T06:59:08.030918+0000","last_unstale":"2024-05-30T07:00:52.490857+0000","last_undegraded":"2024-05-30T07:00:52.490857+0000","last_fullsized":"2024-05-30T07:00:52.490857+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:33:46.570680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247464319,"num_objects":62,"num_object_clones":1,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":1,"num_read":49,"num_read_kb":200704,"num_write":96,"num_write_kb":307203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414573+0000","last_change":"2024-05-30T06:59:07.020348+0000","last_active":"2024-05-30T06:59:54.414573+0000","last_peered":"2024-05-30T06:59:54.414573+0000","last_clean":"2024-05-30T06:59:54.414573+0000","last_became_active":"2024-05-30T06:59:07.019991+0000","last_became_peered":"2024-05-30T06:59:07.019991+0000","last_unstale":"2024-05-30T06:59:54.414573+0000","last_undegraded":"2024-05-30T06:59:54.414573+0000","last_fullsized":"2024-05-30T06:59:54.414573+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:07:32.982335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"130'100","reported_seq":173,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.487557+0000","last_change":"2024-05-30T06:59:08.038690+0000","last_active":"2024-05-30T07:00:52.487557+0000","last_peered":"2024-05-30T07:00:52.487557+0000","last_clean":"2024-05-30T07:00:52.487557+0000","last_became_active":"2024-05-30T06:59:08.038380+0000","last_became_peered":"2024-05-30T06:59:08.038380+0000","last_unstale":"2024-05-30T07:00:52.487557+0000","last_undegraded":"2024-05-30T07:00:52.487557+0000","last_fullsized":"2024-05-30T07:00:52.487557+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:05:26.527928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":100,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.484996+0000","last_change":"2024-05-30T06:59:07.023295+0000","last_active":"2024-05-30T06:59:54.484996+0000","last_peered":"2024-05-30T06:59:54.484996+0000","last_clean":"2024-05-30T06:59:54.484996+0000","last_became_active":"2024-05-30T06:59:07.022933+0000","last_became_peered":"2024-05-30T06:59:07.022933+0000","last_unstale":"2024-05-30T06:59:54.484996+0000","last_undegraded":"2024-05-30T06:59:54.484996+0000","last_fullsized":"2024-05-30T06:59:54.484996+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:18:07.641666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"130'115","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.504340+0000","last_change":"2024-05-30T06:59:08.037751+0000","last_active":"2024-05-30T07:00:52.504340+0000","last_peered":"2024-05-30T07:00:52.504340+0000","last_clean":"2024-05-30T07:00:52.504340+0000","last_became_active":"2024-05-30T06:59:08.037505+0000","last_became_peered":"2024-05-30T06:59:08.037505+0000","last_unstale":"2024-05-30T07:00:52.504340+0000","last_undegraded":"2024-05-30T07:00:52.504340+0000","last_fullsized":"2024-05-30T07:00:52.504340+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:16.400946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":86,"num_read_kb":335876,"num_write":115,"num_write_kb":393217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419655+0000","last_change":"2024-05-30T06:59:07.025942+0000","last_active":"2024-05-30T06:59:54.419655+0000","last_peered":"2024-05-30T06:59:54.419655+0000","last_clean":"2024-05-30T06:59:54.419655+0000","last_became_active":"2024-05-30T06:59:07.025651+0000","last_became_peered":"2024-05-30T06:59:07.025651+0000","last_unstale":"2024-05-30T06:59:54.419655+0000","last_undegraded":"2024-05-30T06:59:54.419655+0000","last_fullsized":"2024-05-30T06:59:54.419655+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:21:41.065697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"130'97","reported_seq":187,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.501306+0000","last_change":"2024-05-30T06:59:08.023176+0000","last_active":"2024-05-30T07:00:52.501306+0000","last_peered":"2024-05-30T07:00:52.501306+0000","last_clean":"2024-05-30T07:00:52.501306+0000","last_became_active":"2024-05-30T06:59:08.022036+0000","last_became_peered":"2024-05-30T06:59:08.022036+0000","last_unstale":"2024-05-30T07:00:52.501306+0000","last_undegraded":"2024-05-30T07:00:52.501306+0000","last_fullsized":"2024-05-30T07:00:52.501306+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:49:46.450533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":97,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"130'30","reported_seq":77,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.150321+0000","last_change":"2024-05-30T06:59:07.012244+0000","last_active":"2024-05-30T07:00:52.150321+0000","last_peered":"2024-05-30T07:00:52.150321+0000","last_clean":"2024-05-30T07:00:52.150321+0000","last_became_active":"2024-05-30T06:59:07.011981+0000","last_became_peered":"2024-05-30T06:59:07.011981+0000","last_unstale":"2024-05-30T07:00:52.150321+0000","last_undegraded":"2024-05-30T07:00:52.150321+0000","last_fullsized":"2024-05-30T07:00:52.150321+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:45:53.245785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4755,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":29,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"130'113","reported_seq":207,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.483948+0000","last_change":"2024-05-30T06:59:08.036367+0000","last_active":"2024-05-30T07:00:52.483948+0000","last_peered":"2024-05-30T07:00:52.483948+0000","last_clean":"2024-05-30T07:00:52.483948+0000","last_became_active":"2024-05-30T06:59:08.035993+0000","last_became_peered":"2024-05-30T06:59:08.035993+0000","last_unstale":"2024-05-30T07:00:52.483948+0000","last_undegraded":"2024-05-30T07:00:52.483948+0000","last_fullsized":"2024-05-30T07:00:52.483948+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:16:52.745068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":113,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414433+0000","last_change":"2024-05-30T06:59:07.018219+0000","last_active":"2024-05-30T06:59:54.414433+0000","last_peered":"2024-05-30T06:59:54.414433+0000","last_clean":"2024-05-30T06:59:54.414433+0000","last_became_active":"2024-05-30T06:59:07.017622+0000","last_became_peered":"2024-05-30T06:59:07.017622+0000","last_unstale":"2024-05-30T06:59:54.414433+0000","last_undegraded":"2024-05-30T06:59:54.414433+0000","last_fullsized":"2024-05-30T06:59:54.414433+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:50:14.903621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"130'77","reported_seq":143,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.494131+0000","last_change":"2024-05-30T06:59:08.034173+0000","last_active":"2024-05-30T07:00:52.494131+0000","last_peered":"2024-05-30T07:00:52.494131+0000","last_clean":"2024-05-30T07:00:52.494131+0000","last_became_active":"2024-05-30T06:59:08.033874+0000","last_became_peered":"2024-05-30T06:59:08.033874+0000","last_unstale":"2024-05-30T07:00:52.494131+0000","last_undegraded":"2024-05-30T07:00:52.494131+0000","last_fullsized":"2024-05-30T07:00:52.494131+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:08:08.594337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":50,"num_read_kb":204800,"num_write":77,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"127'2","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419780+0000","last_change":"2024-05-30T06:59:07.027441+0000","last_active":"2024-05-30T06:59:54.419780+0000","last_peered":"2024-05-30T06:59:54.419780+0000","last_clean":"2024-05-30T06:59:54.419780+0000","last_became_active":"2024-05-30T06:59:07.027219+0000","last_became_peered":"2024-05-30T06:59:07.027219+0000","last_unstale":"2024-05-30T06:59:54.419780+0000","last_undegraded":"2024-05-30T06:59:54.419780+0000","last_fullsized":"2024-05-30T06:59:54.419780+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:58.881839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":381,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419731+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:59:54.419731+0000","last_peered":"2024-05-30T06:59:54.419731+0000","last_clean":"2024-05-30T06:59:54.419731+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:59:54.419731+0000","last_undegraded":"2024-05-30T06:59:54.419731+0000","last_fullsized":"2024-05-30T06:59:54.419731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":16844326603,"num_objects":4025,"num_object_clones":1,"num_object_copies":8050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4025,"num_whiteouts":1,"num_read":4099,"num_read_kb":16560184,"num_write":5631,"num_write_kb":19595307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33688715264,"data_stored":33688653206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5640,"ondisk_log_size":5640,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1706277,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":599,"num_write_kb":1886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3481600,"data_stored":3412554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":557,"ondisk_log_size":557,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575081,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3725524,"kb_used_data":3608332,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":90646316,"statfs":{"total":96636764160,"available":92821827584,"internally_reserved":0,"allocated":3694931968,"data_stored":3693994699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575082,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4680980,"kb_used_data":4545740,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":89690860,"statfs":{"total":96636764160,"available":91843440640,"internally_reserved":0,"allocated":4654837760,"data_stored":4653904457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575082,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3581648,"kb_used_data":3442248,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":90790192,"statfs":{"total":96636764160,"available":92969156608,"internally_reserved":0,"allocated":3524861952,"data_stored":3523931494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575081,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5183308,"kb_used_data":5035588,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":89188532,"statfs":{"total":96636764160,"available":91329056768,"internally_reserved":0,"allocated":5156442112,"data_stored":5155515779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575081,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4103504,"kb_used_data":3946056,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":90268336,"statfs":{"total":96636764160,"available":92434776064,"internally_reserved":0,"allocated":4040761344,"data_stored":4039835296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":161216967},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575080,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5367432,"kb_used_data":5232192,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":89004408,"statfs":{"total":96636764160,"available":91140513792,"internally_reserved":0,"allocated":5357764608,"data_stored":5356842395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575082,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3856184,"kb_used_data":3708464,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90515656,"statfs":{"total":96636764160,"available":92688031744,"internally_reserved":0,"allocated":3797467136,"data_stored":3796560308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575082,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3541308,"kb_used_data":3397748,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":90830532,"statfs":{"total":96636764160,"available":93010464768,"internally_reserved":0,"allocated":3479293952,"data_stored":3478383572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1720320,"data_stored":1705479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1724416,"data_stored":1701362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3477078016,"data_stored":3477078016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3795845120,"data_stored":3795845120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5356134400,"data_stored":5356126591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4039122944,"data_stored":4039115193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5154816000,"data_stored":5154800521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3523231744,"data_stored":3523216194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4651495424,"data_stored":4651483790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3690991616,"data_stored":3690987781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T07:01:14.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-30T07:01:14.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f8938000640 1 Processor -- start 2024-05-30T07:01:14.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f8938000640 1 -- start start 2024-05-30T07:01:14.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f8938000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f893006e000 0x7f89300ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f8938000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89300cd120 con 0x7f89300cee10 2024-05-30T07:01:14.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f8938000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89300cd400 con 0x7f893015cd80 2024-05-30T07:01:14.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f8938000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f89300a9530 con 0x7f893006e000 2024-05-30T07:01:14.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f8936000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f89300cee10 0x7f893006f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41038/0 (socket says 172.21.15.37:41038) 2024-05-30T07:01:14.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f8936000640 1 -- 172.21.15.37:0/898003518 learned_addr learned my addr 172.21.15.37:0/898003518 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:14.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f8935600640 1 --2- 172.21.15.37:0/898003518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f893006e000 0x7f89300ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f892fe00640 1 -- 172.21.15.37:0/898003518 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3408729445 0 0) 0x7f89300cd120 con 0x7f89300cee10 2024-05-30T07:01:14.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f892fe00640 1 -- 172.21.15.37:0/898003518 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8918003530 con 0x7f89300cee10 2024-05-30T07:01:14.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f8935600640 1 -- 172.21.15.37:0/898003518 >> v1:172.21.15.105:6789/0 conn(0x7f893015cd80 legacy=0x7f89300ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f8935600640 1 -- 172.21.15.37:0/898003518 >> v1:172.21.15.37:6789/0 conn(0x7f89300cee10 legacy=0x7f893006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f892fe00640 1 -- 172.21.15.37:0/898003518 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 124722165 0 0) 0x7f8918003530 con 0x7f89300cee10 2024-05-30T07:01:14.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.985+0000 7f8935600640 1 -- 172.21.15.37:0/898003518 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89300cd6e0 con 0x7f893006e000 2024-05-30T07:01:14.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.989+0000 7f8935600640 1 --2- 172.21.15.37:0/898003518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f893006e000 0x7f89300ce1c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f89240097f0 tx=0x7f892401ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec6a076898746258 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:14.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.989+0000 7f892fe00640 1 -- 172.21.15.37:0/898003518 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89240b5070 con 0x7f893006e000 2024-05-30T07:01:14.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.989+0000 7f892fe00640 1 -- 172.21.15.37:0/898003518 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89240a8670 con 0x7f893006e000 2024-05-30T07:01:14.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.989+0000 7f892fe00640 1 -- 172.21.15.37:0/898003518 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8928001a00 con 0x7f893006e000 2024-05-30T07:01:14.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.989+0000 7f8938000640 1 -- 172.21.15.37:0/898003518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f893006e000 msgr2=0x7f89300ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.989+0000 7f8938000640 1 --2- 172.21.15.37:0/898003518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f893006e000 0x7f89300ce1c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f89240097f0 tx=0x7f892401ebf0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.989+0000 7f8938000640 1 -- 172.21.15.37:0/898003518 shutdown_connections 2024-05-30T07:01:14.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.989+0000 7f8938000640 1 --2- 172.21.15.37:0/898003518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f893006e000 0x7f89300ce1c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.989+0000 7f8938000640 1 -- 172.21.15.37:0/898003518 >> 172.21.15.37:0/898003518 conn(0x7f89300b23a0 msgr2=0x7f89300b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.989+0000 7f8938000640 1 -- 172.21.15.37:0/898003518 shutdown_connections 2024-05-30T07:01:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.989+0000 7f8938000640 1 -- 172.21.15.37:0/898003518 wait complete. 2024-05-30T07:01:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8938000640 1 Processor -- start 2024-05-30T07:01:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8938000640 1 -- start start 2024-05-30T07:01:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8938000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893006e000 0x7f8930141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8938000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89300cee10 0x7f89301f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8938000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f893015cd80 0x7f8930164f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8938000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f89301673d0 con 0x7f893006e000 2024-05-30T07:01:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8938000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f89300cdca0 con 0x7f89300cee10 2024-05-30T07:01:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8938000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8930167550 con 0x7f893015cd80 2024-05-30T07:01:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8935600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893006e000 0x7f8930141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8935600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893006e000 0x7f8930141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55864/0 (socket says 172.21.15.37:55864) 2024-05-30T07:01:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8935600640 1 -- 172.21.15.37:0/339085824 learned_addr learned my addr 172.21.15.37:0/339085824 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8935600640 1 -- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f893015cd80 msgr2=0x7f8930164f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8935600640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f893015cd80 0x7f8930164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8935600640 1 -- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89300cee10 msgr2=0x7f89301f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8934c00640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89300cee10 0x7f89301f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8935600640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89300cee10 0x7f89301f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8935600640 1 -- 172.21.15.37:0/339085824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8930142360 con 0x7f893006e000 2024-05-30T07:01:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8934c00640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89300cee10 0x7f89301f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:01:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8935600640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893006e000 0x7f8930141e20 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f89240b3040 tx=0x7f892401b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f892d600640 1 -- 172.21.15.37:0/339085824 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89240b5040 con 0x7f893006e000 2024-05-30T07:01:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f892d600640 1 -- 172.21.15.37:0/339085824 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89240a98b0 con 0x7f893006e000 2024-05-30T07:01:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f892d600640 1 -- 172.21.15.37:0/339085824 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89240a9c60 con 0x7f893006e000 2024-05-30T07:01:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8938000640 1 -- 172.21.15.37:0/339085824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89301436d0 con 0x7f893006e000 2024-05-30T07:01:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8938000640 1 -- 172.21.15.37:0/339085824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8930143c90 con 0x7f893006e000 2024-05-30T07:01:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.993+0000 7f8938000640 1 -- 172.21.15.37:0/339085824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8930068b20 con 0x7f893006e000 2024-05-30T07:01:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.997+0000 7f892d600640 1 -- 172.21.15.37:0/339085824 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f89240c2030 con 0x7f893006e000 2024-05-30T07:01:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.997+0000 7f892d600640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f891006a540 0x7f891006ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.997+0000 7f892d600640 1 -- 172.21.15.37:0/339085824 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f8924122660 con 0x7f893006e000 2024-05-30T07:01:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.997+0000 7f8934c00640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f891006a540 0x7f891006ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:14.997+0000 7f8934c00640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f891006a540 0x7f891006ca00 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8930139790 tx=0x7f891c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.001+0000 7f892d600640 1 -- 172.21.15.37:0/339085824 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f89240c9020 con 0x7f893006e000 2024-05-30T07:01:15.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.169+0000 7f8938000640 1 -- 172.21.15.37:0/339085824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f893006f6a0 con 0x7f893006e000 2024-05-30T07:01:15.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.169+0000 7f892d600640 1 -- 172.21.15.37:0/339085824 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16842 (secure 0 0 0) 0x7f8924018750 con 0x7f893006e000 2024-05-30T07:01:15.171 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:01:15.172 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":130,"fsid":"393250aa-2b42-4955-adf1-f790b8ba4d8c","created":"2024-05-30T06:41:45.641364+0000","modified":"2024-05-30T06:59:54.404205+0000","last_up_change":"2024-05-30T06:41:57.975437+0000","last_in_change":"2024-05-30T06:41:48.364349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-30T06:41:58.665774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-05-30T06:59:05.805744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-05-30T06:59:06.396391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7d9265cc-51a9-4bb9-a791-a7f42216685f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6801","nonce":1733943679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6803","nonce":1733943679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6807","nonce":1733943679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1733943679},{"type":"v1","addr":"172.21.15.37:6805","nonce":1733943679}]},"public_addr":"172.21.15.37:6801/1733943679","cluster_addr":"172.21.15.37:6803/1733943679","heartbeat_back_addr":"172.21.15.37:6807/1733943679","heartbeat_front_addr":"172.21.15.37:6805/1733943679","state":["exists","up"]},{"osd":1,"uuid":"b0f10b2e-13c9-4fbb-bdd1-3faae769d9fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6809","nonce":2386979500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6811","nonce":2386979500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6815","nonce":2386979500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2386979500},{"type":"v1","addr":"172.21.15.37:6813","nonce":2386979500}]},"public_addr":"172.21.15.37:6809/2386979500","cluster_addr":"172.21.15.37:6811/2386979500","heartbeat_back_addr":"172.21.15.37:6815/2386979500","heartbeat_front_addr":"172.21.15.37:6813/2386979500","state":["exists","up"]},{"osd":2,"uuid":"606f08ec-cad4-404f-a19d-e815cd5f631b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6822","nonce":2792170181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6826","nonce":2792170181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6831","nonce":2792170181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2792170181},{"type":"v1","addr":"172.21.15.37:6829","nonce":2792170181}]},"public_addr":"172.21.15.37:6822/2792170181","cluster_addr":"172.21.15.37:6826/2792170181","heartbeat_back_addr":"172.21.15.37:6831/2792170181","heartbeat_front_addr":"172.21.15.37:6829/2792170181","state":["exists","up"]},{"osd":3,"uuid":"940a004d-18ba-4e27-ba3d-8c5e9880099a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6817","nonce":409363430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6819","nonce":409363430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6827","nonce":409363430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":409363430},{"type":"v1","addr":"172.21.15.37:6823","nonce":409363430}]},"public_addr":"172.21.15.37:6817/409363430","cluster_addr":"172.21.15.37:6819/409363430","heartbeat_back_addr":"172.21.15.37:6827/409363430","heartbeat_front_addr":"172.21.15.37:6823/409363430","state":["exists","up"]},{"osd":4,"uuid":"64901865-0e8d-4da6-92d6-42e5ee643071","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6801","nonce":700801319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6803","nonce":700801319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6807","nonce":700801319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":700801319},{"type":"v1","addr":"172.21.15.105:6805","nonce":700801319}]},"public_addr":"172.21.15.105:6801/700801319","cluster_addr":"172.21.15.105:6803/700801319","heartbeat_back_addr":"172.21.15.105:6807/700801319","heartbeat_front_addr":"172.21.15.105:6805/700801319","state":["exists","up"]},{"osd":5,"uuid":"faa3858b-7d23-487a-983c-126643838d76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6809","nonce":2549616191}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6811","nonce":2549616191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6815","nonce":2549616191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":2549616191},{"type":"v1","addr":"172.21.15.105:6813","nonce":2549616191}]},"public_addr":"172.21.15.105:6809/2549616191","cluster_addr":"172.21.15.105:6811/2549616191","heartbeat_back_addr":"172.21.15.105:6815/2549616191","heartbeat_front_addr":"172.21.15.105:6813/2549616191","state":["exists","up"]},{"osd":6,"uuid":"ed48d033-1dc8-4b7b-9450-2f03dd492dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6818","nonce":2790478860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6822","nonce":2790478860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6830","nonce":2790478860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2790478860},{"type":"v1","addr":"172.21.15.105:6826","nonce":2790478860}]},"public_addr":"172.21.15.105:6818/2790478860","cluster_addr":"172.21.15.105:6822/2790478860","heartbeat_back_addr":"172.21.15.105:6830/2790478860","heartbeat_front_addr":"172.21.15.105:6826/2790478860","state":["exists","up"]},{"osd":7,"uuid":"785ed1bd-614f-420c-8d7e-d71aa396af96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6817","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6819","nonce":4038189667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6821","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6823","nonce":4038189667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6829","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6831","nonce":4038189667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6825","nonce":4038189667},{"type":"v1","addr":"172.21.15.105:6827","nonce":4038189667}]},"public_addr":"172.21.15.105:6819/4038189667","cluster_addr":"172.21.15.105:6823/4038189667","heartbeat_back_addr":"172.21.15.105:6831/4038189667","heartbeat_front_addr":"172.21.15.105:6827/4038189667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.031024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.124808+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.047407+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.032041+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:53.933305+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.039082+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.159690+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-30T06:41:54.198610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.26","mappings":[{"from":2,"to":0}]},{"pgid":"19.3c","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":9,"snaps":[{"begin":2,"length":2}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-30T07:01:15.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.173+0000 7f8938000640 1 -- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f891006a540 msgr2=0x7f891006ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:15.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.173+0000 7f8938000640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f891006a540 0x7f891006ca00 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8930139790 tx=0x7f891c009040 comp rx=0 tx=0).stop 2024-05-30T07:01:15.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.173+0000 7f8938000640 1 -- 172.21.15.37:0/339085824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893006e000 msgr2=0x7f8930141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:15.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.173+0000 7f8938000640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893006e000 0x7f8930141e20 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f89240b3040 tx=0x7f892401b990 comp rx=0 tx=0).stop 2024-05-30T07:01:15.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.173+0000 7f8938000640 1 -- 172.21.15.37:0/339085824 shutdown_connections 2024-05-30T07:01:15.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.173+0000 7f8938000640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f893015cd80 0x7f8930164f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:15.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.173+0000 7f8938000640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f891006a540 0x7f891006ca00 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:15.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.173+0000 7f8938000640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89300cee10 0x7f89301f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:15.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.173+0000 7f8938000640 1 --2- 172.21.15.37:0/339085824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f893006e000 0x7f8930141e20 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:15.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.173+0000 7f8938000640 1 -- 172.21.15.37:0/339085824 >> 172.21.15.37:0/339085824 conn(0x7f89300b23a0 msgr2=0x7f893015e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:15.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.173+0000 7f8938000640 1 -- 172.21.15.37:0/339085824 shutdown_connections 2024-05-30T07:01:15.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:15.173+0000 7f8938000640 1 -- 172.21.15.37:0/339085824 wait complete. 2024-05-30T07:01:16.194 INFO:tasks.ceph:Scrubbing osd.0 2024-05-30T07:01:16.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-30T07:01:16.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.348+0000 7feb35a00640 1 Processor -- start 2024-05-30T07:01:16.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.348+0000 7feb35a00640 1 -- start start 2024-05-30T07:01:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb35a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feb300ced10 0x7feb3006ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb35a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feb3015d4e0 0x7feb300b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb35a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3015db00 con 0x7feb300b59d0 2024-05-30T07:01:16.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb35a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7feb3006df50 con 0x7feb3015d4e0 2024-05-30T07:01:16.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb35a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7feb3006e7d0 con 0x7feb300ced10 2024-05-30T07:01:16.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb2f400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7feb3015d4e0 0x7feb300b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb26000640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7feb300b59d0 0x7feb3015cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41042/0 (socket says 172.21.15.37:41042) 2024-05-30T07:01:16.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb26000640 1 -- 172.21.15.37:0/1922414005 learned_addr learned my addr 172.21.15.37:0/1922414005 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:16.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb2ea00640 1 --2- 172.21.15.37:0/1922414005 >> v2:172.21.15.105:3300/0 conn(0x7feb300ced10 0x7feb3006ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb2f400640 1 -- 172.21.15.37:0/1922414005 >> v2:172.21.15.105:3300/0 conn(0x7feb300ced10 msgr2=0x7feb3006ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb2f400640 1 --2- 172.21.15.37:0/1922414005 >> v2:172.21.15.105:3300/0 conn(0x7feb300ced10 0x7feb3006ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb2f400640 1 -- 172.21.15.37:0/1922414005 >> v1:172.21.15.37:6789/0 conn(0x7feb300b59d0 legacy=0x7feb3015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb2f400640 1 -- 172.21.15.37:0/1922414005 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3006e180 con 0x7feb3015d4e0 2024-05-30T07:01:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.352+0000 7feb2f400640 1 --2- 172.21.15.37:0/1922414005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb3015d4e0 0x7feb300b5e60 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7feb300b2e60 tx=0x7feb2801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b187e259da3af7f server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb2e000640 1 -- 172.21.15.37:0/1922414005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb280b2070 con 0x7feb3015d4e0 2024-05-30T07:01:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb2e000640 1 -- 172.21.15.37:0/1922414005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb280a5900 con 0x7feb3015d4e0 2024-05-30T07:01:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb2e000640 1 -- 172.21.15.37:0/1922414005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb280a5cd0 con 0x7feb3015d4e0 2024-05-30T07:01:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 -- 172.21.15.37:0/1922414005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb3015d4e0 msgr2=0x7feb300b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 --2- 172.21.15.37:0/1922414005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb3015d4e0 0x7feb300b5e60 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7feb300b2e60 tx=0x7feb2801c930 comp rx=0 tx=0).stop 2024-05-30T07:01:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 -- 172.21.15.37:0/1922414005 shutdown_connections 2024-05-30T07:01:16.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 --2- 172.21.15.37:0/1922414005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb3015d4e0 0x7feb300b5e60 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 --2- 172.21.15.37:0/1922414005 >> v2:172.21.15.105:3300/0 conn(0x7feb300ced10 0x7feb3006ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 -- 172.21.15.37:0/1922414005 >> 172.21.15.37:0/1922414005 conn(0x7feb3006bf60 msgr2=0x7feb300b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:16.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 -- 172.21.15.37:0/1922414005 shutdown_connections 2024-05-30T07:01:16.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 -- 172.21.15.37:0/1922414005 wait complete. 2024-05-30T07:01:16.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 Processor -- start 2024-05-30T07:01:16.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 -- start start 2024-05-30T07:01:16.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb300b59d0 0x7feb3014c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb300ced10 0x7feb30151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb3015d4e0 0x7feb301516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feb3015ea50 con 0x7feb300ced10 2024-05-30T07:01:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feb3015e8d0 con 0x7feb3015d4e0 2024-05-30T07:01:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb35a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feb3014f7c0 con 0x7feb300b59d0 2024-05-30T07:01:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.356+0000 7feb26000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb300ced10 0x7feb30151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb26000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb300ced10 0x7feb30151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55874/0 (socket says 172.21.15.37:55874) 2024-05-30T07:01:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb26000640 1 -- 172.21.15.37:0/229001830 learned_addr learned my addr 172.21.15.37:0/229001830 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb2ea00640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb300b59d0 0x7feb3014c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb2f400640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb3015d4e0 0x7feb301516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb26000640 1 -- 172.21.15.37:0/229001830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb300b59d0 msgr2=0x7feb3014c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb26000640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb300b59d0 0x7feb3014c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb26000640 1 -- 172.21.15.37:0/229001830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb3015d4e0 msgr2=0x7feb301516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb26000640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb3015d4e0 0x7feb301516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb26000640 1 -- 172.21.15.37:0/229001830 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3014fa30 con 0x7feb300ced10 2024-05-30T07:01:16.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb26000640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb300ced10 0x7feb30151160 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7feb1800c450 tx=0x7feb1800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:16.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb27400640 1 -- 172.21.15.37:0/229001830 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb18017070 con 0x7feb300ced10 2024-05-30T07:01:16.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb27400640 1 -- 172.21.15.37:0/229001830 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb18005cf0 con 0x7feb300ced10 2024-05-30T07:01:16.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb35a00640 1 -- 172.21.15.37:0/229001830 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3014fd10 con 0x7feb300ced10 2024-05-30T07:01:16.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb27400640 1 -- 172.21.15.37:0/229001830 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb18007290 con 0x7feb300ced10 2024-05-30T07:01:16.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb35a00640 1 -- 172.21.15.37:0/229001830 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb3014da60 con 0x7feb300ced10 2024-05-30T07:01:16.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb35a00640 1 -- 172.21.15.37:0/229001830 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb30068d40 con 0x7feb300ced10 2024-05-30T07:01:16.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb27400640 1 -- 172.21.15.37:0/229001830 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7feb1801a070 con 0x7feb300ced10 2024-05-30T07:01:16.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.360+0000 7feb27400640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feb0c06a540 0x7feb0c06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.364+0000 7feb27400640 1 -- 172.21.15.37:0/229001830 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7feb18084da0 con 0x7feb300ced10 2024-05-30T07:01:16.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.364+0000 7feb27400640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] conn(0x7feb0c072920 0x7feb0c074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.364+0000 7feb27400640 1 -- 172.21.15.37:0/229001830 --> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb18013e50 con 0x7feb0c072920 2024-05-30T07:01:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.364+0000 7feb27400640 1 -- 172.21.15.37:0/229001830 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7feb18091050 con 0x7feb300ced10 2024-05-30T07:01:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.364+0000 7feb2ea00640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feb0c06a540 0x7feb0c06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.364+0000 7feb2f400640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] conn(0x7feb0c072920 0x7feb0c074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.364+0000 7feb2ea00640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feb0c06a540 0x7feb0c06ca00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7feb20007a60 tx=0x7feb20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.364+0000 7feb2f400640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] conn(0x7feb0c072920 0x7feb0c074dc0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:16.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.364+0000 7feb27400640 1 -- 172.21.15.37:0/229001830 <== osd.0 v2:172.21.15.37:6800/1733943679 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb18013e50 con 0x7feb0c072920 2024-05-30T07:01:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.376+0000 7feb35a00640 1 -- 172.21.15.37:0/229001830 --> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7feb3014fee0 con 0x7feb0c072920 2024-05-30T07:01:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.376+0000 7feb27400640 1 -- 172.21.15.37:0/229001830 <== osd.0 v2:172.21.15.37:6800/1733943679 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7feb3014fee0 con 0x7feb0c072920 2024-05-30T07:01:16.381 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:01:16.381 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T07:01:16.381 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:01:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.376+0000 7feb35a00640 1 -- 172.21.15.37:0/229001830 >> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] conn(0x7feb0c072920 msgr2=0x7feb0c074dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.376+0000 7feb35a00640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.37:6800/1733943679,v1:172.21.15.37:6801/1733943679] conn(0x7feb0c072920 0x7feb0c074dc0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.380+0000 7feb35a00640 1 -- 172.21.15.37:0/229001830 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feb0c06a540 msgr2=0x7feb0c06ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.380+0000 7feb35a00640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7feb0c06a540 0x7feb0c06ca00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7feb20007a60 tx=0x7feb20008040 comp rx=0 tx=0).stop 2024-05-30T07:01:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.380+0000 7feb35a00640 1 -- 172.21.15.37:0/229001830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb300ced10 msgr2=0x7feb30151160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.380+0000 7feb35a00640 1 --2- 172.21.15.37:0/229001830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb300ced10 0x7feb30151160 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7feb1800c450 tx=0x7feb1800c910 comp rx=0 tx=0).stop 2024-05-30T07:01:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.380+0000 7feb2f400640 1 -- 172.21.15.37:0/229001830 reap_dead start 2024-05-30T07:01:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.380+0000 7feb35a00640 1 -- 172.21.15.37:0/229001830 shutdown_connections 2024-05-30T07:01:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.380+0000 7feb35a00640 1 -- 172.21.15.37:0/229001830 >> 172.21.15.37:0/229001830 conn(0x7feb3006bf60 msgr2=0x7feb30156440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.380+0000 7feb35a00640 1 -- 172.21.15.37:0/229001830 shutdown_connections 2024-05-30T07:01:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.380+0000 7feb35a00640 1 -- 172.21.15.37:0/229001830 wait complete. 2024-05-30T07:01:16.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-30T07:01:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.536+0000 7f02c5200640 1 Processor -- start 2024-05-30T07:01:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.536+0000 7f02c5200640 1 -- start start 2024-05-30T07:01:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.540+0000 7f02c5200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f02c00cfeb0 0x7f02c00afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.540+0000 7f02c5200640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f02c0162ba0 0x7f02c0147680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.540+0000 7f02c5200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c00b5f70 con 0x7f02c00b36c0 2024-05-30T07:01:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.540+0000 7f02c5200640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f02c00b3b50 con 0x7f02c0162ba0 2024-05-30T07:01:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.540+0000 7f02c5200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f02c00b67a0 con 0x7f02c00cfeb0 2024-05-30T07:01:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.540+0000 7f02be800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f02c0162ba0 0x7f02c0147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.540+0000 7f02be800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f02c0162ba0 0x7f02c0147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55888/0 (socket says 172.21.15.37:55888) 2024-05-30T07:01:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.540+0000 7f02be800640 1 -- 172.21.15.37:0/7365247 learned_addr learned my addr 172.21.15.37:0/7365247 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.540+0000 7f02bde00640 1 --2- 172.21.15.37:0/7365247 >> v2:172.21.15.105:3300/0 conn(0x7f02c00cfeb0 0x7f02c00afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.540+0000 7f02be800640 1 -- 172.21.15.37:0/7365247 >> v2:172.21.15.105:3300/0 conn(0x7f02c00cfeb0 msgr2=0x7f02c00afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.540+0000 7f02be800640 1 --2- 172.21.15.37:0/7365247 >> v2:172.21.15.105:3300/0 conn(0x7f02c00cfeb0 0x7f02c00afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.540+0000 7f02be800640 1 -- 172.21.15.37:0/7365247 >> v1:172.21.15.105:6789/0 conn(0x7f02c00b36c0 legacy=0x7f02c0162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.540+0000 7f02be800640 1 -- 172.21.15.37:0/7365247 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c00b61e0 con 0x7f02c0162ba0 2024-05-30T07:01:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02be800640 1 --2- 172.21.15.37:0/7365247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c0162ba0 0x7f02c0147680 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f02c006fee0 tx=0x7f02b801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764642102421dc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02bd400640 1 -- 172.21.15.37:0/7365247 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b80a5730 con 0x7f02c0162ba0 2024-05-30T07:01:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02bd400640 1 -- 172.21.15.37:0/7365247 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b80a58d0 con 0x7f02c0162ba0 2024-05-30T07:01:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02bd400640 1 -- 172.21.15.37:0/7365247 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b80a5ca0 con 0x7f02c0162ba0 2024-05-30T07:01:16.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 -- 172.21.15.37:0/7365247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c0162ba0 msgr2=0x7f02c0147680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 --2- 172.21.15.37:0/7365247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c0162ba0 0x7f02c0147680 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f02c006fee0 tx=0x7f02b801c960 comp rx=0 tx=0).stop 2024-05-30T07:01:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 -- 172.21.15.37:0/7365247 shutdown_connections 2024-05-30T07:01:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 --2- 172.21.15.37:0/7365247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c0162ba0 0x7f02c0147680 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 --2- 172.21.15.37:0/7365247 >> v2:172.21.15.105:3300/0 conn(0x7f02c00cfeb0 0x7f02c00afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 -- 172.21.15.37:0/7365247 >> 172.21.15.37:0/7365247 conn(0x7f02c006bf60 msgr2=0x7f02c00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 -- 172.21.15.37:0/7365247 shutdown_connections 2024-05-30T07:01:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 -- 172.21.15.37:0/7365247 wait complete. 2024-05-30T07:01:16.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 Processor -- start 2024-05-30T07:01:16.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 -- start start 2024-05-30T07:01:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c00b36c0 0x7f02c01619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c00cfeb0 0x7f02c013def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02c0162ba0 0x7f02c013e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02c00ae4a0 con 0x7f02c00b36c0 2024-05-30T07:01:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02c00ae320 con 0x7f02c0162ba0 2024-05-30T07:01:16.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.544+0000 7f02c5200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f02c00ae620 con 0x7f02c00cfeb0 2024-05-30T07:01:16.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02bde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c00b36c0 0x7f02c01619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02bde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c00b36c0 0x7f02c01619e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55900/0 (socket says 172.21.15.37:55900) 2024-05-30T07:01:16.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02bde00640 1 -- 172.21.15.37:0/1800250466 learned_addr learned my addr 172.21.15.37:0/1800250466 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:16.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02b7e00640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c00cfeb0 0x7f02c013def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02be800640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02c0162ba0 0x7f02c013e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02bde00640 1 -- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c00cfeb0 msgr2=0x7f02c013def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02bde00640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c00cfeb0 0x7f02c013def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02bde00640 1 -- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02c0162ba0 msgr2=0x7f02c013e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02bde00640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02c0162ba0 0x7f02c013e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02bde00640 1 -- 172.21.15.37:0/1800250466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c0161f20 con 0x7f02c00b36c0 2024-05-30T07:01:16.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02b7e00640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c00cfeb0 0x7f02c013def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:16.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02bde00640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c00b36c0 0x7f02c01619e0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f02b000d800 tx=0x7f02b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:16.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02b6000640 1 -- 172.21.15.37:0/1800250466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b000b6c0 con 0x7f02c00b36c0 2024-05-30T07:01:16.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02b6000640 1 -- 172.21.15.37:0/1800250466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b0019070 con 0x7f02c00b36c0 2024-05-30T07:01:16.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02b6000640 1 -- 172.21.15.37:0/1800250466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b000ba60 con 0x7f02c00b36c0 2024-05-30T07:01:16.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02c5200640 1 -- 172.21.15.37:0/1800250466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c00b0210 con 0x7f02c00b36c0 2024-05-30T07:01:16.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02c5200640 1 -- 172.21.15.37:0/1800250466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c00b07d0 con 0x7f02c00b36c0 2024-05-30T07:01:16.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02c5200640 1 -- 172.21.15.37:0/1800250466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c0068bc0 con 0x7f02c00b36c0 2024-05-30T07:01:16.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.548+0000 7f02b6000640 1 -- 172.21.15.37:0/1800250466 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f02b000bc00 con 0x7f02c00b36c0 2024-05-30T07:01:16.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.552+0000 7f02b6000640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f029c06a540 0x7f029c06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.552+0000 7f02b6000640 1 -- 172.21.15.37:0/1800250466 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f02b00869e0 con 0x7f02c00b36c0 2024-05-30T07:01:16.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.552+0000 7f02b7e00640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f029c06a540 0x7f029c06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.552+0000 7f02b7e00640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f029c06a540 0x7f029c06ca00 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f02c01fae70 tx=0x7f02a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:16.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.552+0000 7f02b6000640 1 -- 172.21.15.37:0/1800250466 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f02b0058a80 con 0x7f02c00b36c0 2024-05-30T07:01:16.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.716+0000 7f02c5200640 1 -- 172.21.15.37:0/1800250466 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f02c00adb80 con 0x7f029c06a540 2024-05-30T07:01:16.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.716+0000 7f02b6000640 1 -- 172.21.15.37:0/1800250466 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f02c00adb80 con 0x7f029c06a540 2024-05-30T07:01:16.720 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2024-05-30T07:01:16.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.720+0000 7f02c5200640 1 -- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f029c06a540 msgr2=0x7f029c06ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.720+0000 7f02c5200640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f029c06a540 0x7f029c06ca00 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f02c01fae70 tx=0x7f02a8009040 comp rx=0 tx=0).stop 2024-05-30T07:01:16.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.720+0000 7f02c5200640 1 -- 172.21.15.37:0/1800250466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c00b36c0 msgr2=0x7f02c01619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.720+0000 7f02c5200640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c00b36c0 0x7f02c01619e0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f02b000d800 tx=0x7f02b000dcc0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.720+0000 7f02c5200640 1 -- 172.21.15.37:0/1800250466 shutdown_connections 2024-05-30T07:01:16.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.720+0000 7f02c5200640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f029c06a540 0x7f029c06ca00 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.720+0000 7f02c5200640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02c0162ba0 0x7f02c013e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.720+0000 7f02c5200640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02c00cfeb0 0x7f02c013def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.720+0000 7f02c5200640 1 --2- 172.21.15.37:0/1800250466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02c00b36c0 0x7f02c01619e0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.720+0000 7f02c5200640 1 -- 172.21.15.37:0/1800250466 >> 172.21.15.37:0/1800250466 conn(0x7f02c006bf60 msgr2=0x7f02c015cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:16.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.720+0000 7f02c5200640 1 -- 172.21.15.37:0/1800250466 shutdown_connections 2024-05-30T07:01:16.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.720+0000 7f02c5200640 1 -- 172.21.15.37:0/1800250466 wait complete. 2024-05-30T07:01:16.742 INFO:tasks.ceph:Scrubbing osd.1 2024-05-30T07:01:16.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-30T07:01:16.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f3640a00640 1 Processor -- start 2024-05-30T07:01:16.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f3640a00640 1 -- start start 2024-05-30T07:01:16.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f3640a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f363c0ced10 0x7f363c06ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f3640a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f363c15d4e0 0x7f363c0b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f3640a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f363c15db00 con 0x7f363c0b59d0 2024-05-30T07:01:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f3640a00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f363c06df50 con 0x7f363c15d4e0 2024-05-30T07:01:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f3640a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f363c0b6370 con 0x7f363c0ced10 2024-05-30T07:01:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f363a800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f363c15d4e0 0x7f363c0b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f3631400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f363c0b59d0 0x7f363c15cdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41048/0 (socket says 172.21.15.37:41048) 2024-05-30T07:01:16.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f3631400640 1 -- 172.21.15.37:0/2576592935 learned_addr learned my addr 172.21.15.37:0/2576592935 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:16.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f3639e00640 1 --2- 172.21.15.37:0/2576592935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f363c0ced10 0x7f363c06ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f363a800640 1 -- 172.21.15.37:0/2576592935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f363c0ced10 msgr2=0x7f363c06ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:16.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f363a800640 1 --2- 172.21.15.37:0/2576592935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f363c0ced10 0x7f363c06ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f363a800640 1 -- 172.21.15.37:0/2576592935 >> v1:172.21.15.37:6789/0 conn(0x7f363c0b59d0 legacy=0x7f363c15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f363a800640 1 -- 172.21.15.37:0/2576592935 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363c06e180 con 0x7f363c15d4e0 2024-05-30T07:01:16.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.884+0000 7f3639400640 1 -- 172.21.15.37:0/2576592935 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3662716188 0 0) 0x7f363c15db00 con 0x7f363c0b59d0 2024-05-30T07:01:16.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.888+0000 7f363a800640 1 --2- 172.21.15.37:0/2576592935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c15d4e0 0x7f363c0b5e30 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f3634009d90 tx=0x7f363401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37c08c69a5b864c server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:16.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.888+0000 7f3639400640 1 -- 172.21.15.37:0/2576592935 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36340b2070 con 0x7f363c15d4e0 2024-05-30T07:01:16.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.888+0000 7f3639400640 1 -- 172.21.15.37:0/2576592935 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36340a5940 con 0x7f363c15d4e0 2024-05-30T07:01:16.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.888+0000 7f3639400640 1 -- 172.21.15.37:0/2576592935 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36340a5d10 con 0x7f363c15d4e0 2024-05-30T07:01:16.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.888+0000 7f3640a00640 1 -- 172.21.15.37:0/2576592935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c15d4e0 msgr2=0x7f363c0b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.888+0000 7f3640a00640 1 --2- 172.21.15.37:0/2576592935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c15d4e0 0x7f363c0b5e30 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f3634009d90 tx=0x7f363401c970 comp rx=0 tx=0).stop 2024-05-30T07:01:16.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.888+0000 7f3640a00640 1 -- 172.21.15.37:0/2576592935 shutdown_connections 2024-05-30T07:01:16.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.888+0000 7f3640a00640 1 --2- 172.21.15.37:0/2576592935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c15d4e0 0x7f363c0b5e30 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.888+0000 7f3640a00640 1 --2- 172.21.15.37:0/2576592935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f363c0ced10 0x7f363c06ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.888+0000 7f3640a00640 1 -- 172.21.15.37:0/2576592935 >> 172.21.15.37:0/2576592935 conn(0x7f363c06bf60 msgr2=0x7f363c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:16.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.888+0000 7f3640a00640 1 -- 172.21.15.37:0/2576592935 shutdown_connections 2024-05-30T07:01:16.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.888+0000 7f3640a00640 1 -- 172.21.15.37:0/2576592935 wait complete. 2024-05-30T07:01:16.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3640a00640 1 Processor -- start 2024-05-30T07:01:16.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3640a00640 1 -- start start 2024-05-30T07:01:16.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3640a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f363c0b59d0 0x7f363c141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3640a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f363c0ced10 0x7f363c0a9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3640a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c15d4e0 0x7f363c0a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3640a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f363c15ea50 con 0x7f363c15d4e0 2024-05-30T07:01:16.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3640a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f363c15e8d0 con 0x7f363c0b59d0 2024-05-30T07:01:16.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3640a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f363c0b5100 con 0x7f363c0ced10 2024-05-30T07:01:16.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f363a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c15d4e0 0x7f363c0a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f363a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c15d4e0 0x7f363c0a9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55928/0 (socket says 172.21.15.37:55928) 2024-05-30T07:01:16.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f363a800640 1 -- 172.21.15.37:0/3128715256 learned_addr learned my addr 172.21.15.37:0/3128715256 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:16.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f363a800640 1 -- 172.21.15.37:0/3128715256 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f363c0ced10 msgr2=0x7f363c0a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f363a800640 1 --2- 172.21.15.37:0/3128715256 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f363c0ced10 0x7f363c0a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f363a800640 1 -- 172.21.15.37:0/3128715256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f363c0b59d0 msgr2=0x7f363c141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f363a800640 1 --2- 172.21.15.37:0/3128715256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f363c0b59d0 0x7f363c141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f363a800640 1 -- 172.21.15.37:0/3128715256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363c141cc0 con 0x7f363c15d4e0 2024-05-30T07:01:16.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f363a800640 1 --2- 172.21.15.37:0/3128715256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c15d4e0 0x7f363c0a9b40 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f36340b0040 tx=0x7f3634019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:16.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3632a00640 1 -- 172.21.15.37:0/3128715256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36340bd020 con 0x7f363c15d4e0 2024-05-30T07:01:16.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3632a00640 1 -- 172.21.15.37:0/3128715256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36340b8670 con 0x7f363c15d4e0 2024-05-30T07:01:16.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3632a00640 1 -- 172.21.15.37:0/3128715256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36340b2040 con 0x7f363c15d4e0 2024-05-30T07:01:16.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3640a00640 1 -- 172.21.15.37:0/3128715256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363c141fa0 con 0x7f363c15d4e0 2024-05-30T07:01:16.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3640a00640 1 -- 172.21.15.37:0/3128715256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f363c142560 con 0x7f363c15d4e0 2024-05-30T07:01:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.892+0000 7f3640a00640 1 -- 172.21.15.37:0/3128715256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f363c068d40 con 0x7f363c15d4e0 2024-05-30T07:01:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.896+0000 7f3632a00640 1 -- 172.21.15.37:0/3128715256 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f36340c0020 con 0x7f363c15d4e0 2024-05-30T07:01:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.896+0000 7f3632a00640 1 --2- 172.21.15.37:0/3128715256 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f361806a540 0x7f361806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.896+0000 7f3632a00640 1 -- 172.21.15.37:0/3128715256 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f36341210e0 con 0x7f363c15d4e0 2024-05-30T07:01:16.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.896+0000 7f3632a00640 1 --2- 172.21.15.37:0/3128715256 >> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] conn(0x7f36180728c0 0x7f3618074d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:16.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.896+0000 7f3632a00640 1 -- 172.21.15.37:0/3128715256 --> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3618075430 con 0x7f36180728c0 2024-05-30T07:01:16.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.896+0000 7f3632a00640 1 -- 172.21.15.37:0/3128715256 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f36341221d0 con 0x7f363c15d4e0 2024-05-30T07:01:16.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.896+0000 7f3639e00640 1 --2- 172.21.15.37:0/3128715256 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f361806a540 0x7f361806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.896+0000 7f3631400640 1 --2- 172.21.15.37:0/3128715256 >> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] conn(0x7f36180728c0 0x7f3618074d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:16.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.896+0000 7f3631400640 1 --2- 172.21.15.37:0/3128715256 >> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] conn(0x7f36180728c0 0x7f3618074d60 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.896+0000 7f3639e00640 1 --2- 172.21.15.37:0/3128715256 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f361806a540 0x7f361806ca00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f362c0098f0 tx=0x7f362c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:16.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.896+0000 7f3632a00640 1 -- 172.21.15.37:0/3128715256 <== osd.1 v2:172.21.15.37:6808/2386979500 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3618075430 con 0x7f36180728c0 2024-05-30T07:01:16.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.912+0000 7f3640a00640 1 -- 172.21.15.37:0/3128715256 --> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f363c15b9d0 con 0x7f36180728c0 2024-05-30T07:01:16.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.912+0000 7f3632a00640 1 -- 172.21.15.37:0/3128715256 <== osd.1 v2:172.21.15.37:6808/2386979500 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f363c15b9d0 con 0x7f36180728c0 2024-05-30T07:01:16.914 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:01:16.914 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T07:01:16.914 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:01:16.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.912+0000 7f3640a00640 1 -- 172.21.15.37:0/3128715256 >> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] conn(0x7f36180728c0 msgr2=0x7f3618074d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.912+0000 7f3640a00640 1 --2- 172.21.15.37:0/3128715256 >> [v2:172.21.15.37:6808/2386979500,v1:172.21.15.37:6809/2386979500] conn(0x7f36180728c0 0x7f3618074d60 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:16.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.912+0000 7f3640a00640 1 -- 172.21.15.37:0/3128715256 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f361806a540 msgr2=0x7f361806ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.912+0000 7f3640a00640 1 --2- 172.21.15.37:0/3128715256 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f361806a540 0x7f361806ca00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f362c0098f0 tx=0x7f362c008040 comp rx=0 tx=0).stop 2024-05-30T07:01:16.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.912+0000 7f3640a00640 1 -- 172.21.15.37:0/3128715256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c15d4e0 msgr2=0x7f363c0a9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:16.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.912+0000 7f3640a00640 1 --2- 172.21.15.37:0/3128715256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363c15d4e0 0x7f363c0a9b40 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f36340b0040 tx=0x7f3634019710 comp rx=0 tx=0).stop 2024-05-30T07:01:16.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.912+0000 7f363a800640 1 -- 172.21.15.37:0/3128715256 reap_dead start 2024-05-30T07:01:16.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.912+0000 7f3640a00640 1 -- 172.21.15.37:0/3128715256 shutdown_connections 2024-05-30T07:01:16.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.912+0000 7f3640a00640 1 -- 172.21.15.37:0/3128715256 >> 172.21.15.37:0/3128715256 conn(0x7f363c06bf60 msgr2=0x7f363c15c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:16.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.912+0000 7f3640a00640 1 -- 172.21.15.37:0/3128715256 shutdown_connections 2024-05-30T07:01:16.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:16.912+0000 7f3640a00640 1 -- 172.21.15.37:0/3128715256 wait complete. 2024-05-30T07:01:16.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-30T07:01:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.072+0000 7f552ee00640 1 Processor -- start 2024-05-30T07:01:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.072+0000 7f552ee00640 1 -- start start 2024-05-30T07:01:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f552ee00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f552815c650 0x7f55280d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f552ee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55280b2890 0x7f55280d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f552ee00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55280b3f40 con 0x7f552815ca30 2024-05-30T07:01:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f552ee00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f55280cce80 con 0x7f552815c650 2024-05-30T07:01:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f552ee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f55280b2ec0 con 0x7f55280b2890 2024-05-30T07:01:17.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f5527e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f552815c650 0x7f55280d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f552ce00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55280b2890 0x7f55280d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f551fe00640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f552815ca30 0x7f55280b2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.37:48838/0 (socket says 172.21.15.37:48838) 2024-05-30T07:01:17.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f551fe00640 1 -- 172.21.15.37:0/2487885912 learned_addr learned my addr 172.21.15.37:0/2487885912 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:17.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f5527e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f552815c650 0x7f55280d09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.37:59218/0 (socket says 172.21.15.37:59218) 2024-05-30T07:01:17.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f5527e00640 1 -- 172.21.15.37:0/2487885912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55280b2890 msgr2=0x7f55280d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:17.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f5527e00640 1 --2- 172.21.15.37:0/2487885912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55280b2890 0x7f55280d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f5527e00640 1 -- 172.21.15.37:0/2487885912 >> v1:172.21.15.105:6789/0 conn(0x7f552815ca30 legacy=0x7f55280b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f5527e00640 1 -- 172.21.15.37:0/2487885912 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55280b3180 con 0x7f552815c650 2024-05-30T07:01:17.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f5527400640 1 -- 172.21.15.37:0/2487885912 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924927042 0 0) 0x7f55280b3f40 con 0x7f552815ca30 2024-05-30T07:01:17.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.076+0000 7f552ce00640 1 --2- 172.21.15.37:0/2487885912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55280b2890 0x7f55280d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T07:01:17.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f5527e00640 1 --2- 172.21.15.37:0/2487885912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f552815c650 0x7f55280d09e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f55180097c0 tx=0x7f551801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e97cf6f0f080764d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f5527400640 1 -- 172.21.15.37:0/2487885912 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55180b5070 con 0x7f552815c650 2024-05-30T07:01:17.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f5527400640 1 -- 172.21.15.37:0/2487885912 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55180a8990 con 0x7f552815c650 2024-05-30T07:01:17.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f5527400640 1 -- 172.21.15.37:0/2487885912 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55180a8d60 con 0x7f552815c650 2024-05-30T07:01:17.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f552ee00640 1 -- 172.21.15.37:0/2487885912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f552815c650 msgr2=0x7f55280d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f552ee00640 1 --2- 172.21.15.37:0/2487885912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f552815c650 0x7f55280d09e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f55180097c0 tx=0x7f551801ec90 comp rx=0 tx=0).stop 2024-05-30T07:01:17.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f552ee00640 1 -- 172.21.15.37:0/2487885912 shutdown_connections 2024-05-30T07:01:17.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f552ee00640 1 --2- 172.21.15.37:0/2487885912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55280b2890 0x7f55280d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f552ee00640 1 --2- 172.21.15.37:0/2487885912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f552815c650 0x7f55280d09e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f552ee00640 1 -- 172.21.15.37:0/2487885912 >> 172.21.15.37:0/2487885912 conn(0x7f55280b4130 msgr2=0x7f55280b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:17.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f552ee00640 1 -- 172.21.15.37:0/2487885912 shutdown_connections 2024-05-30T07:01:17.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f552ee00640 1 -- 172.21.15.37:0/2487885912 wait complete. 2024-05-30T07:01:17.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f552ee00640 1 Processor -- start 2024-05-30T07:01:17.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.080+0000 7f552ee00640 1 -- start start 2024-05-30T07:01:17.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ee00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55280b2890 0x7f55280c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ee00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f552815c650 0x7f5528157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f552815ca30 0x7f55280ce820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55280b3a20 con 0x7f552815ca30 2024-05-30T07:01:17.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ee00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f55280b3740 con 0x7f552815c650 2024-05-30T07:01:17.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ee00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f55280af410 con 0x7f55280b2890 2024-05-30T07:01:17.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f552815ca30 0x7f55280ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f552815ca30 0x7f55280ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55930/0 (socket says 172.21.15.37:55930) 2024-05-30T07:01:17.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ce00640 1 -- 172.21.15.37:0/3409371131 learned_addr learned my addr 172.21.15.37:0/3409371131 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:17.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f5527e00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55280b2890 0x7f55280c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f551fe00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f552815c650 0x7f5528157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ce00640 1 -- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55280b2890 msgr2=0x7f55280c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ce00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55280b2890 0x7f55280c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ce00640 1 -- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f552815c650 msgr2=0x7f5528157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ce00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f552815c650 0x7f5528157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ce00640 1 -- 172.21.15.37:0/3409371131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55280b7990 con 0x7f552815ca30 2024-05-30T07:01:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f5527e00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55280b2890 0x7f55280c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:01:17.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ce00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f552815ca30 0x7f55280ce820 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f552000efc0 tx=0x7f5520009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f5524c00640 1 -- 172.21.15.37:0/3409371131 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520018030 con 0x7f552815ca30 2024-05-30T07:01:17.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f5524c00640 1 -- 172.21.15.37:0/3409371131 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552000cde0 con 0x7f552815ca30 2024-05-30T07:01:17.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f5524c00640 1 -- 172.21.15.37:0/3409371131 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520003bc0 con 0x7f552815ca30 2024-05-30T07:01:17.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ee00640 1 -- 172.21.15.37:0/3409371131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55280c9df0 con 0x7f552815ca30 2024-05-30T07:01:17.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ee00640 1 -- 172.21.15.37:0/3409371131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55280ca3b0 con 0x7f552815ca30 2024-05-30T07:01:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f552ee00640 1 -- 172.21.15.37:0/3409371131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5528068bc0 con 0x7f552815ca30 2024-05-30T07:01:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.084+0000 7f5524c00640 1 -- 172.21.15.37:0/3409371131 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f552001b070 con 0x7f552815ca30 2024-05-30T07:01:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.088+0000 7f5524c00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f550406a540 0x7f550406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.088+0000 7f5524c00640 1 -- 172.21.15.37:0/3409371131 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f55200864a0 con 0x7f552815ca30 2024-05-30T07:01:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.088+0000 7f5527e00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f550406a540 0x7f550406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.088+0000 7f5527e00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f550406a540 0x7f550406ca00 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f55180b2000 tx=0x7f55180aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.092+0000 7f5524c00640 1 -- 172.21.15.37:0/3409371131 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5520022070 con 0x7f552815ca30 2024-05-30T07:01:17.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.256+0000 7f552ee00640 1 -- 172.21.15.37:0/3409371131 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f55280c5880 con 0x7f550406a540 2024-05-30T07:01:17.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.256+0000 7f5524c00640 1 -- 172.21.15.37:0/3409371131 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f55280c5880 con 0x7f550406a540 2024-05-30T07:01:17.260 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2024-05-30T07:01:17.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.260+0000 7f552ee00640 1 -- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f550406a540 msgr2=0x7f550406ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.260+0000 7f552ee00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f550406a540 0x7f550406ca00 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f55180b2000 tx=0x7f55180aa070 comp rx=0 tx=0).stop 2024-05-30T07:01:17.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.260+0000 7f552ee00640 1 -- 172.21.15.37:0/3409371131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f552815ca30 msgr2=0x7f55280ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.260+0000 7f552ee00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f552815ca30 0x7f55280ce820 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f552000efc0 tx=0x7f5520009f90 comp rx=0 tx=0).stop 2024-05-30T07:01:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.260+0000 7f552ee00640 1 -- 172.21.15.37:0/3409371131 shutdown_connections 2024-05-30T07:01:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.260+0000 7f552ee00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f552815ca30 0x7f55280ce820 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.260+0000 7f552ee00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f550406a540 0x7f550406ca00 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.260+0000 7f552ee00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f552815c650 0x7f5528157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.260+0000 7f552ee00640 1 --2- 172.21.15.37:0/3409371131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55280b2890 0x7f55280c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.260+0000 7f552ee00640 1 -- 172.21.15.37:0/3409371131 >> 172.21.15.37:0/3409371131 conn(0x7f55280b4130 msgr2=0x7f5528075440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.260+0000 7f552ee00640 1 -- 172.21.15.37:0/3409371131 shutdown_connections 2024-05-30T07:01:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.260+0000 7f552ee00640 1 -- 172.21.15.37:0/3409371131 wait complete. 2024-05-30T07:01:17.282 INFO:tasks.ceph:Scrubbing osd.2 2024-05-30T07:01:17.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-30T07:01:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.424+0000 7fbb6b200640 1 Processor -- start 2024-05-30T07:01:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.424+0000 7fbb6b200640 1 -- start start 2024-05-30T07:01:17.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.424+0000 7fbb6b200640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbb6406ef30 0x7fbb6406f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.424+0000 7fbb6b200640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb64072e30 con 0x7fbb640cd080 2024-05-30T07:01:17.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.424+0000 7fbb6b200640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb640cdc60 con 0x7fbb64144f00 2024-05-30T07:01:17.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.424+0000 7fbb6b200640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbb6406f8d0 con 0x7fbb6406ef30 2024-05-30T07:01:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.424+0000 7fbb6a800640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbb640cd080 0x7fbb6415ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56296/0 (socket says 172.21.15.37:56296) 2024-05-30T07:01:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.424+0000 7fbb6a800640 1 -- 172.21.15.37:0/3651601478 learned_addr learned my addr 172.21.15.37:0/3651601478 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.428+0000 7fbb69400640 1 --2- 172.21.15.37:0/3651601478 >> v2:172.21.15.105:3300/0 conn(0x7fbb6406ef30 0x7fbb6406f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.428+0000 7fbb68a00640 1 -- 172.21.15.37:0/3651601478 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086769091 0 0) 0x7fbb600014a0 con 0x7fbb640cd080 2024-05-30T07:01:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.428+0000 7fbb68a00640 1 -- 172.21.15.37:0/3651601478 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb4c003530 con 0x7fbb640cd080 2024-05-30T07:01:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.428+0000 7fbb68a00640 1 -- 172.21.15.37:0/3651601478 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 478775115 0 0) 0x7fbb640cdc60 con 0x7fbb64144f00 2024-05-30T07:01:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.428+0000 7fbb68a00640 1 -- 172.21.15.37:0/3651601478 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb600014a0 con 0x7fbb64144f00 2024-05-30T07:01:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.428+0000 7fbb69400640 1 -- 172.21.15.37:0/3651601478 >> v1:172.21.15.105:6789/0 conn(0x7fbb64144f00 legacy=0x7fbb640b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.428+0000 7fbb69400640 1 -- 172.21.15.37:0/3651601478 >> v1:172.21.15.37:6789/0 conn(0x7fbb640cd080 legacy=0x7fbb6415ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.428+0000 7fbb69400640 1 -- 172.21.15.37:0/3651601478 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb640b3b50 con 0x7fbb6406ef30 2024-05-30T07:01:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.428+0000 7fbb69400640 1 --2- 172.21.15.37:0/3651601478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb6406ef30 0x7fbb6406f390 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbb540097c0 tx=0x7fbb5401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=931d974faafdcded server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.428+0000 7fbb68a00640 1 -- 172.21.15.37:0/3651601478 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb540b1070 con 0x7fbb6406ef30 2024-05-30T07:01:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.428+0000 7fbb68a00640 1 -- 172.21.15.37:0/3651601478 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb540a8050 con 0x7fbb6406ef30 2024-05-30T07:01:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.428+0000 7fbb68a00640 1 -- 172.21.15.37:0/3651601478 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb540ac840 con 0x7fbb6406ef30 2024-05-30T07:01:17.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 -- 172.21.15.37:0/3651601478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb6406ef30 msgr2=0x7fbb6406f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 --2- 172.21.15.37:0/3651601478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb6406ef30 0x7fbb6406f390 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbb540097c0 tx=0x7fbb5401c3e0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 -- 172.21.15.37:0/3651601478 shutdown_connections 2024-05-30T07:01:17.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 --2- 172.21.15.37:0/3651601478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb6406ef30 0x7fbb6406f390 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 -- 172.21.15.37:0/3651601478 >> 172.21.15.37:0/3651601478 conn(0x7fbb640b2120 msgr2=0x7fbb640b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:17.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 -- 172.21.15.37:0/3651601478 shutdown_connections 2024-05-30T07:01:17.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 -- 172.21.15.37:0/3651601478 wait complete. 2024-05-30T07:01:17.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 Processor -- start 2024-05-30T07:01:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 -- start start 2024-05-30T07:01:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb6406ef30 0x7fbb64138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb640cd080 0x7fbb640b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb64144f00 0x7fbb64154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb640cd8a0 con 0x7fbb640cd080 2024-05-30T07:01:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6415c5a0 con 0x7fbb6406ef30 2024-05-30T07:01:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6b200640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbb640cda20 con 0x7fbb64144f00 2024-05-30T07:01:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb69400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb640cd080 0x7fbb640b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb69400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb640cd080 0x7fbb640b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43294/0 (socket says 172.21.15.37:43294) 2024-05-30T07:01:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb69400640 1 -- 172.21.15.37:0/2196472651 learned_addr learned my addr 172.21.15.37:0/2196472651 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb69e00640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb6406ef30 0x7fbb64138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6a800640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb64144f00 0x7fbb64154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb69400640 1 -- 172.21.15.37:0/2196472651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb64144f00 msgr2=0x7fbb64154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb69400640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb64144f00 0x7fbb64154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb69400640 1 -- 172.21.15.37:0/2196472651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb6406ef30 msgr2=0x7fbb64138aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb69400640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb6406ef30 0x7fbb64138aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb69400640 1 -- 172.21.15.37:0/2196472651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6413c820 con 0x7fbb640cd080 2024-05-30T07:01:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb6a800640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb64144f00 0x7fbb64154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:01:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.432+0000 7fbb69e00640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb6406ef30 0x7fbb64138aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb69400640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb640cd080 0x7fbb640b1470 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fbb54018ff0 tx=0x7fbb54019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb5e000640 1 -- 172.21.15.37:0/2196472651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb540b1040 con 0x7fbb640cd080 2024-05-30T07:01:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb5e000640 1 -- 172.21.15.37:0/2196472651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb540036a0 con 0x7fbb640cd080 2024-05-30T07:01:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb5e000640 1 -- 172.21.15.37:0/2196472651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54003a50 con 0x7fbb640cd080 2024-05-30T07:01:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb6b200640 1 -- 172.21.15.37:0/2196472651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6415ab60 con 0x7fbb640cd080 2024-05-30T07:01:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb6b200640 1 -- 172.21.15.37:0/2196472651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6415b120 con 0x7fbb640cd080 2024-05-30T07:01:17.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb6b200640 1 -- 172.21.15.37:0/2196472651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb64068ab0 con 0x7fbb640cd080 2024-05-30T07:01:17.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb5e000640 1 -- 172.21.15.37:0/2196472651 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7fbb540bc030 con 0x7fbb640cd080 2024-05-30T07:01:17.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb5e000640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb4806a540 0x7fbb4806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb5e000640 1 -- 172.21.15.37:0/2196472651 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fbb5411fe00 con 0x7fbb640cd080 2024-05-30T07:01:17.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb5e000640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] conn(0x7fbb480728c0 0x7fbb48074d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb5e000640 1 -- 172.21.15.37:0/2196472651 --> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb54008eb0 con 0x7fbb480728c0 2024-05-30T07:01:17.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb5e000640 1 -- 172.21.15.37:0/2196472651 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7fbb54120ef0 con 0x7fbb640cd080 2024-05-30T07:01:17.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb6a800640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] conn(0x7fbb480728c0 0x7fbb48074d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.436+0000 7fbb69e00640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb4806a540 0x7fbb4806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.440+0000 7fbb6a800640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] conn(0x7fbb480728c0 0x7fbb48074d60 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.440+0000 7fbb69e00640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb4806a540 0x7fbb4806ca00 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fbb580016a0 tx=0x7fbb58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.440+0000 7fbb5e000640 1 -- 172.21.15.37:0/2196472651 <== osd.2 v2:172.21.15.37:6820/2792170181 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbb54008eb0 con 0x7fbb480728c0 2024-05-30T07:01:17.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.452+0000 7fbb6b200640 1 -- 172.21.15.37:0/2196472651 --> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbb640b1250 con 0x7fbb480728c0 2024-05-30T07:01:17.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.452+0000 7fbb5e000640 1 -- 172.21.15.37:0/2196472651 <== osd.2 v2:172.21.15.37:6820/2792170181 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbb640b1250 con 0x7fbb480728c0 2024-05-30T07:01:17.456 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:01:17.456 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T07:01:17.456 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:01:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.452+0000 7fbb6b200640 1 -- 172.21.15.37:0/2196472651 >> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] conn(0x7fbb480728c0 msgr2=0x7fbb48074d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.452+0000 7fbb6b200640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.37:6820/2792170181,v1:172.21.15.37:6822/2792170181] conn(0x7fbb480728c0 0x7fbb48074d60 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.452+0000 7fbb6b200640 1 -- 172.21.15.37:0/2196472651 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb4806a540 msgr2=0x7fbb4806ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.452+0000 7fbb6b200640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fbb4806a540 0x7fbb4806ca00 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fbb580016a0 tx=0x7fbb58009040 comp rx=0 tx=0).stop 2024-05-30T07:01:17.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.452+0000 7fbb6b200640 1 -- 172.21.15.37:0/2196472651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb640cd080 msgr2=0x7fbb640b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.452+0000 7fbb6b200640 1 --2- 172.21.15.37:0/2196472651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb640cd080 0x7fbb640b1470 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fbb54018ff0 tx=0x7fbb54019180 comp rx=0 tx=0).stop 2024-05-30T07:01:17.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.452+0000 7fbb6a800640 1 -- 172.21.15.37:0/2196472651 reap_dead start 2024-05-30T07:01:17.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.452+0000 7fbb6b200640 1 -- 172.21.15.37:0/2196472651 shutdown_connections 2024-05-30T07:01:17.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.452+0000 7fbb6b200640 1 -- 172.21.15.37:0/2196472651 >> 172.21.15.37:0/2196472651 conn(0x7fbb640b2120 msgr2=0x7fbb640cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:17.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.452+0000 7fbb6b200640 1 -- 172.21.15.37:0/2196472651 shutdown_connections 2024-05-30T07:01:17.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.452+0000 7fbb6b200640 1 -- 172.21.15.37:0/2196472651 wait complete. 2024-05-30T07:01:17.474 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-30T07:01:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.612+0000 7f8690400640 1 Processor -- start 2024-05-30T07:01:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.612+0000 7f8690400640 1 -- start start 2024-05-30T07:01:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f8690400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868815c650 0x7f86880d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f8690400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f868815ca30 0x7f86880d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f8690400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86880b2180 0x7f86880b2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f8690400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f86880cce80 con 0x7f86880b2180 2024-05-30T07:01:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f8690400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f86880b3f40 con 0x7f868815ca30 2024-05-30T07:01:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f8690400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f86880b2ec0 con 0x7f868815c650 2024-05-30T07:01:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f868e400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86880b2180 0x7f86880b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f868e400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86880b2180 0x7f86880b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43310/0 (socket says 172.21.15.37:43310) 2024-05-30T07:01:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f868e400640 1 -- 172.21.15.37:0/1367430444 learned_addr learned my addr 172.21.15.37:0/1367430444 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f868da00640 1 --2- 172.21.15.37:0/1367430444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868815c650 0x7f86880d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f868d000640 1 --2- 172.21.15.37:0/1367430444 >> v2:172.21.15.105:3300/0 conn(0x7f868815ca30 0x7f86880d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f868e400640 1 -- 172.21.15.37:0/1367430444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868815c650 msgr2=0x7f86880d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f868e400640 1 --2- 172.21.15.37:0/1367430444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868815c650 0x7f86880d09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f868e400640 1 -- 172.21.15.37:0/1367430444 >> v2:172.21.15.105:3300/0 conn(0x7f868815ca30 msgr2=0x7f86880d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f868e400640 1 --2- 172.21.15.37:0/1367430444 >> v2:172.21.15.105:3300/0 conn(0x7f868815ca30 0x7f86880d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f868e400640 1 -- 172.21.15.37:0/1367430444 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86880b3180 con 0x7f86880b2180 2024-05-30T07:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.616+0000 7f868d000640 1 --2- 172.21.15.37:0/1367430444 >> v2:172.21.15.105:3300/0 conn(0x7f868815ca30 0x7f86880d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:17.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f868e400640 1 --2- 172.21.15.37:0/1367430444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86880b2180 0x7f86880b2610 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f86880d3630 tx=0x7f868001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bf23ddd69e14ee server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8687e00640 1 -- 172.21.15.37:0/1367430444 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86800b4070 con 0x7f86880b2180 2024-05-30T07:01:17.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8687e00640 1 -- 172.21.15.37:0/1367430444 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86800af400 con 0x7f86880b2180 2024-05-30T07:01:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8687e00640 1 -- 172.21.15.37:0/1367430444 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86800af7d0 con 0x7f86880b2180 2024-05-30T07:01:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8690400640 1 -- 172.21.15.37:0/1367430444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86880b2180 msgr2=0x7f86880b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8690400640 1 --2- 172.21.15.37:0/1367430444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86880b2180 0x7f86880b2610 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f86880d3630 tx=0x7f868001f1e0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8690400640 1 -- 172.21.15.37:0/1367430444 shutdown_connections 2024-05-30T07:01:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8690400640 1 --2- 172.21.15.37:0/1367430444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86880b2180 0x7f86880b2610 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8690400640 1 --2- 172.21.15.37:0/1367430444 >> v2:172.21.15.105:3300/0 conn(0x7f868815ca30 0x7f86880d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8690400640 1 --2- 172.21.15.37:0/1367430444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868815c650 0x7f86880d09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8690400640 1 -- 172.21.15.37:0/1367430444 >> 172.21.15.37:0/1367430444 conn(0x7f86880b4130 msgr2=0x7f86880b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8690400640 1 -- 172.21.15.37:0/1367430444 shutdown_connections 2024-05-30T07:01:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8690400640 1 -- 172.21.15.37:0/1367430444 wait complete. 2024-05-30T07:01:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8690400640 1 Processor -- start 2024-05-30T07:01:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.620+0000 7f8690400640 1 -- start start 2024-05-30T07:01:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f8690400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86880b2180 0x7f868815f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f8690400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f868815c650 0x7f868815ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f8690400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868815ca30 0x7f8688155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f8690400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f86880b3a20 con 0x7f86880b2180 2024-05-30T07:01:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f8690400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86880b3740 con 0x7f868815c650 2024-05-30T07:01:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f8690400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f86880b2b50 con 0x7f868815ca30 2024-05-30T07:01:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f868da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86880b2180 0x7f868815f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f868da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86880b2180 0x7f868815f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43322/0 (socket says 172.21.15.37:43322) 2024-05-30T07:01:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f868da00640 1 -- 172.21.15.37:0/435426542 learned_addr learned my addr 172.21.15.37:0/435426542 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f868d000640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f868815c650 0x7f868815ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f868e400640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868815ca30 0x7f8688155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f868da00640 1 -- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868815ca30 msgr2=0x7f8688155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f868da00640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868815ca30 0x7f8688155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f868da00640 1 -- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f868815c650 msgr2=0x7f868815ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f868da00640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f868815c650 0x7f868815ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f868da00640 1 -- 172.21.15.37:0/435426542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86880cc480 con 0x7f86880b2180 2024-05-30T07:01:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f868da00640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86880b2180 0x7f868815f1f0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f867c00e8e0 tx=0x7f867c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f8685600640 1 -- 172.21.15.37:0/435426542 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c017070 con 0x7f86880b2180 2024-05-30T07:01:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f8685600640 1 -- 172.21.15.37:0/435426542 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f867c00ca00 con 0x7f86880b2180 2024-05-30T07:01:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f8685600640 1 -- 172.21.15.37:0/435426542 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c00cdd0 con 0x7f86880b2180 2024-05-30T07:01:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f8690400640 1 -- 172.21.15.37:0/435426542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86880ca2b0 con 0x7f86880b2180 2024-05-30T07:01:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f8690400640 1 -- 172.21.15.37:0/435426542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f868815d7f0 con 0x7f86880b2180 2024-05-30T07:01:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f8690400640 1 -- 172.21.15.37:0/435426542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8688068bc0 con 0x7f86880b2180 2024-05-30T07:01:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.624+0000 7f8685600640 1 -- 172.21.15.37:0/435426542 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f867c01a070 con 0x7f86880b2180 2024-05-30T07:01:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.628+0000 7f8685600640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f866806a540 0x7f866806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.628+0000 7f8685600640 1 -- 172.21.15.37:0/435426542 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f867c085b20 con 0x7f86880b2180 2024-05-30T07:01:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.628+0000 7f868d000640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f866806a540 0x7f866806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.628+0000 7f868d000640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f866806a540 0x7f866806ca00 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f868806df70 tx=0x7f8674008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.632+0000 7f8685600640 1 -- 172.21.15.37:0/435426542 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f867c057be0 con 0x7f86880b2180 2024-05-30T07:01:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8690400640 1 -- 172.21.15.37:0/435426542 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f86880b1f60 con 0x7f866806a540 2024-05-30T07:01:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8685600640 1 -- 172.21.15.37:0/435426542 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f86880b1f60 con 0x7f866806a540 2024-05-30T07:01:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2024-05-30T07:01:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8690400640 1 -- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f866806a540 msgr2=0x7f866806ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8690400640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f866806a540 0x7f866806ca00 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f868806df70 tx=0x7f8674008040 comp rx=0 tx=0).stop 2024-05-30T07:01:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8690400640 1 -- 172.21.15.37:0/435426542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86880b2180 msgr2=0x7f868815f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8690400640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86880b2180 0x7f868815f1f0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f867c00e8e0 tx=0x7f867c00eda0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8690400640 1 -- 172.21.15.37:0/435426542 shutdown_connections 2024-05-30T07:01:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8690400640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f868815ca30 0x7f8688155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8690400640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f866806a540 0x7f866806ca00 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8690400640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f868815c650 0x7f868815ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8690400640 1 --2- 172.21.15.37:0/435426542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86880b2180 0x7f868815f1f0 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8690400640 1 -- 172.21.15.37:0/435426542 >> 172.21.15.37:0/435426542 conn(0x7f86880b4130 msgr2=0x7f8688075440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8690400640 1 -- 172.21.15.37:0/435426542 shutdown_connections 2024-05-30T07:01:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.796+0000 7f8690400640 1 -- 172.21.15.37:0/435426542 wait complete. 2024-05-30T07:01:17.821 INFO:tasks.ceph:Scrubbing osd.3 2024-05-30T07:01:17.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-30T07:01:17.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb73800640 1 Processor -- start 2024-05-30T07:01:17.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb73800640 1 -- start start 2024-05-30T07:01:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb73800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb6c159490 0x7fcb6c072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb73800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcb6c0702d0 0x7fcb6c072c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb73800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6c0d06e0 con 0x7fcb6c15f190 2024-05-30T07:01:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb73800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6c162800 con 0x7fcb6c159490 2024-05-30T07:01:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb73800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6c162a50 con 0x7fcb6c0702d0 2024-05-30T07:01:17.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb70e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb6c159490 0x7fcb6c072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb70e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb6c159490 0x7fcb6c072750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43336/0 (socket says 172.21.15.37:43336) 2024-05-30T07:01:17.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb70e00640 1 -- 172.21.15.37:0/1886793588 learned_addr learned my addr 172.21.15.37:0/1886793588 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:17.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb6be00640 1 --2- 172.21.15.37:0/1886793588 >> v2:172.21.15.105:3300/0 conn(0x7fcb6c0702d0 0x7fcb6c072c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb70e00640 1 -- 172.21.15.37:0/1886793588 >> v2:172.21.15.105:3300/0 conn(0x7fcb6c0702d0 msgr2=0x7fcb6c072c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:17.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb70e00640 1 --2- 172.21.15.37:0/1886793588 >> v2:172.21.15.105:3300/0 conn(0x7fcb6c0702d0 0x7fcb6c072c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb70e00640 1 -- 172.21.15.37:0/1886793588 >> v1:172.21.15.105:6789/0 conn(0x7fcb6c15f190 legacy=0x7fcb6c15f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:17.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb70e00640 1 -- 172.21.15.37:0/1886793588 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c162d30 con 0x7fcb6c159490 2024-05-30T07:01:17.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.964+0000 7fcb6be00640 1 --2- 172.21.15.37:0/1886793588 >> v2:172.21.15.105:3300/0 conn(0x7fcb6c0702d0 0x7fcb6c072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:01:17.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.968+0000 7fcb70e00640 1 --2- 172.21.15.37:0/1886793588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c159490 0x7fcb6c072750 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0d0d20 tx=0x7fcb6001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24dd69b8f51ae397 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.968+0000 7fcb6b400640 1 -- 172.21.15.37:0/1886793588 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb600b0070 con 0x7fcb6c159490 2024-05-30T07:01:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.968+0000 7fcb6b400640 1 -- 172.21.15.37:0/1886793588 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb600ab600 con 0x7fcb6c159490 2024-05-30T07:01:17.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.968+0000 7fcb6b400640 1 -- 172.21.15.37:0/1886793588 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb600ab9d0 con 0x7fcb6c159490 2024-05-30T07:01:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.968+0000 7fcb73800640 1 -- 172.21.15.37:0/1886793588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c159490 msgr2=0x7fcb6c072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.968+0000 7fcb73800640 1 --2- 172.21.15.37:0/1886793588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c159490 0x7fcb6c072750 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0d0d20 tx=0x7fcb6001c3a0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.968+0000 7fcb73800640 1 -- 172.21.15.37:0/1886793588 shutdown_connections 2024-05-30T07:01:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.968+0000 7fcb73800640 1 --2- 172.21.15.37:0/1886793588 >> v2:172.21.15.105:3300/0 conn(0x7fcb6c0702d0 0x7fcb6c072c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.968+0000 7fcb73800640 1 --2- 172.21.15.37:0/1886793588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c159490 0x7fcb6c072750 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.968+0000 7fcb73800640 1 -- 172.21.15.37:0/1886793588 >> 172.21.15.37:0/1886793588 conn(0x7fcb6c0d0d50 msgr2=0x7fcb6c0d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:17.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.968+0000 7fcb73800640 1 -- 172.21.15.37:0/1886793588 shutdown_connections 2024-05-30T07:01:17.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.968+0000 7fcb73800640 1 -- 172.21.15.37:0/1886793588 wait complete. 2024-05-30T07:01:17.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb73800640 1 Processor -- start 2024-05-30T07:01:17.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb73800640 1 -- start start 2024-05-30T07:01:17.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb73800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb6c0702d0 0x7fcb6c142640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb73800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb6c159490 0x7fcb6c154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb73800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c15f190 0x7fcb6c154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb73800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c16bf30 con 0x7fcb6c15f190 2024-05-30T07:01:17.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb73800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c16bdb0 con 0x7fcb6c159490 2024-05-30T07:01:17.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb73800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6c16c0b0 con 0x7fcb6c0702d0 2024-05-30T07:01:17.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb71800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c15f190 0x7fcb6c154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb71800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c15f190 0x7fcb6c154f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43348/0 (socket says 172.21.15.37:43348) 2024-05-30T07:01:17.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb71800640 1 -- 172.21.15.37:0/3574710376 learned_addr learned my addr 172.21.15.37:0/3574710376 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:17.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb6be00640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb6c159490 0x7fcb6c154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb70e00640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb6c0702d0 0x7fcb6c142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb71800640 1 -- 172.21.15.37:0/3574710376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb6c0702d0 msgr2=0x7fcb6c142640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb71800640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcb6c0702d0 0x7fcb6c142640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb71800640 1 -- 172.21.15.37:0/3574710376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb6c159490 msgr2=0x7fcb6c154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:17.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb71800640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcb6c159490 0x7fcb6c154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:17.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb71800640 1 -- 172.21.15.37:0/3574710376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c157f70 con 0x7fcb6c15f190 2024-05-30T07:01:17.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb71800640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c15f190 0x7fcb6c154f40 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c7b0 tx=0x7fcb6400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb68c00640 1 -- 172.21.15.37:0/3574710376 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64004b70 con 0x7fcb6c15f190 2024-05-30T07:01:17.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb68c00640 1 -- 172.21.15.37:0/3574710376 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb64004d10 con 0x7fcb6c15f190 2024-05-30T07:01:17.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb73800640 1 -- 172.21.15.37:0/3574710376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c158250 con 0x7fcb6c15f190 2024-05-30T07:01:17.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb68c00640 1 -- 172.21.15.37:0/3574710376 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6400aa90 con 0x7fcb6c15f190 2024-05-30T07:01:17.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb73800640 1 -- 172.21.15.37:0/3574710376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6c152820 con 0x7fcb6c15f190 2024-05-30T07:01:17.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.972+0000 7fcb73800640 1 -- 172.21.15.37:0/3574710376 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcb6c158490 con 0x7fcb6c15f190 2024-05-30T07:01:17.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.976+0000 7fcb68c00640 1 -- 172.21.15.37:0/3574710376 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7fcb6400ac30 con 0x7fcb6c15f190 2024-05-30T07:01:17.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.976+0000 7fcb68c00640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcb4c06a540 0x7fcb4c06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.976+0000 7fcb68c00640 1 -- 172.21.15.37:0/3574710376 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fcb64085dc0 con 0x7fcb6c15f190 2024-05-30T07:01:17.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.976+0000 7fcb68c00640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] conn(0x7fcb4c0728c0 0x7fcb4c074d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:17.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.976+0000 7fcb68c00640 1 -- 172.21.15.37:0/3574710376 --> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb64010e50 con 0x7fcb4c0728c0 2024-05-30T07:01:17.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.976+0000 7fcb68c00640 1 -- 172.21.15.37:0/3574710376 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7fcb64092050 con 0x7fcb6c15f190 2024-05-30T07:01:17.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.976+0000 7fcb70e00640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcb4c06a540 0x7fcb4c06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.976+0000 7fcb6be00640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] conn(0x7fcb4c0728c0 0x7fcb4c074d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:17.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.976+0000 7fcb6be00640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] conn(0x7fcb4c0728c0 0x7fcb4c074d60 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.976+0000 7fcb70e00640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcb4c06a540 0x7fcb4c06ca00 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fcb600ad000 tx=0x7fcb600a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:17.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.976+0000 7fcb68c00640 1 -- 172.21.15.37:0/3574710376 <== osd.3 v2:172.21.15.37:6816/409363430 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb64010e50 con 0x7fcb4c0728c0 2024-05-30T07:01:17.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.992+0000 7fcb73800640 1 -- 172.21.15.37:0/3574710376 --> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcb6c068d40 con 0x7fcb4c0728c0 2024-05-30T07:01:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.992+0000 7fcb68c00640 1 -- 172.21.15.37:0/3574710376 <== osd.3 v2:172.21.15.37:6816/409363430 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcb6c068d40 con 0x7fcb4c0728c0 2024-05-30T07:01:18.026 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:01:18.026 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T07:01:18.027 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:01:18.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.992+0000 7fcb73800640 1 -- 172.21.15.37:0/3574710376 >> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] conn(0x7fcb4c0728c0 msgr2=0x7fcb4c074d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.992+0000 7fcb73800640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.37:6816/409363430,v1:172.21.15.37:6817/409363430] conn(0x7fcb4c0728c0 0x7fcb4c074d60 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.992+0000 7fcb73800640 1 -- 172.21.15.37:0/3574710376 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcb4c06a540 msgr2=0x7fcb4c06ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.992+0000 7fcb73800640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fcb4c06a540 0x7fcb4c06ca00 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fcb600ad000 tx=0x7fcb600a6000 comp rx=0 tx=0).stop 2024-05-30T07:01:18.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.992+0000 7fcb73800640 1 -- 172.21.15.37:0/3574710376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c15f190 msgr2=0x7fcb6c154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.992+0000 7fcb73800640 1 --2- 172.21.15.37:0/3574710376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb6c15f190 0x7fcb6c154f40 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c7b0 tx=0x7fcb6400cc70 comp rx=0 tx=0).stop 2024-05-30T07:01:18.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.992+0000 7fcb71800640 1 -- 172.21.15.37:0/3574710376 reap_dead start 2024-05-30T07:01:18.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.992+0000 7fcb73800640 1 -- 172.21.15.37:0/3574710376 shutdown_connections 2024-05-30T07:01:18.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.992+0000 7fcb73800640 1 -- 172.21.15.37:0/3574710376 >> 172.21.15.37:0/3574710376 conn(0x7fcb6c0d0d50 msgr2=0x7fcb6c0b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:18.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.992+0000 7fcb73800640 1 -- 172.21.15.37:0/3574710376 shutdown_connections 2024-05-30T07:01:18.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:17.992+0000 7fcb73800640 1 -- 172.21.15.37:0/3574710376 wait complete. 2024-05-30T07:01:18.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-30T07:01:18.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.168+0000 7efcf0000640 1 Processor -- start 2024-05-30T07:01:18.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.168+0000 7efcf0000640 1 -- start start 2024-05-30T07:01:18.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efcf0000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efce815c890 0x7efce8162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efcf0000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efce8072e60 0x7efce806c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efcf0000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce8163020 con 0x7efce815f210 2024-05-30T07:01:18.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efcf0000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efce8163300 con 0x7efce8072e60 2024-05-30T07:01:18.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efcf0000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efce81635e0 con 0x7efce815c890 2024-05-30T07:01:18.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efcee000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efce8072e60 0x7efce806c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efcee000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efce8072e60 0x7efce806c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43356/0 (socket says 172.21.15.37:43356) 2024-05-30T07:01:18.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efcee000640 1 -- 172.21.15.37:0/3170373203 learned_addr learned my addr 172.21.15.37:0/3170373203 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:18.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efcecc00640 1 --1- 172.21.15.37:0/3170373203 >> v1:172.21.15.37:6789/0 conn(0x7efce815f210 0x7efce8072750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56310/0 (socket says 172.21.15.37:56310) 2024-05-30T07:01:18.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efced600640 1 --2- 172.21.15.37:0/3170373203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efce815c890 0x7efce8162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efcee000640 1 -- 172.21.15.37:0/3170373203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efce815c890 msgr2=0x7efce8162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:18.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efcee000640 1 --2- 172.21.15.37:0/3170373203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efce815c890 0x7efce8162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efcee000640 1 -- 172.21.15.37:0/3170373203 >> v1:172.21.15.37:6789/0 conn(0x7efce815f210 legacy=0x7efce8072750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.172+0000 7efcee000640 1 -- 172.21.15.37:0/3170373203 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce806ba00 con 0x7efce8072e60 2024-05-30T07:01:18.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efcee000640 1 --2- 172.21.15.37:0/3170373203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce8072e60 0x7efce806c200 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7efce0009e50 tx=0x7efce001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17218c9f5aa89dfc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:18.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efce7e00640 1 -- 172.21.15.37:0/3170373203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce00090d0 con 0x7efce8072e60 2024-05-30T07:01:18.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efce7e00640 1 -- 172.21.15.37:0/3170373203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce00a5660 con 0x7efce8072e60 2024-05-30T07:01:18.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efce7e00640 1 -- 172.21.15.37:0/3170373203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0009270 con 0x7efce8072e60 2024-05-30T07:01:18.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efcf0000640 1 -- 172.21.15.37:0/3170373203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce8072e60 msgr2=0x7efce806c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efcf0000640 1 --2- 172.21.15.37:0/3170373203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce8072e60 0x7efce806c200 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7efce0009e50 tx=0x7efce001c9a0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efcf0000640 1 -- 172.21.15.37:0/3170373203 shutdown_connections 2024-05-30T07:01:18.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efcf0000640 1 --2- 172.21.15.37:0/3170373203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce8072e60 0x7efce806c200 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efcf0000640 1 --2- 172.21.15.37:0/3170373203 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efce815c890 0x7efce8162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efcf0000640 1 -- 172.21.15.37:0/3170373203 >> 172.21.15.37:0/3170373203 conn(0x7efce80b2ac0 msgr2=0x7efce80b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:18.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efcf0000640 1 -- 172.21.15.37:0/3170373203 shutdown_connections 2024-05-30T07:01:18.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efcf0000640 1 -- 172.21.15.37:0/3170373203 wait complete. 2024-05-30T07:01:18.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efcf0000640 1 Processor -- start 2024-05-30T07:01:18.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.176+0000 7efcf0000640 1 -- start start 2024-05-30T07:01:18.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcf0000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efce8072e60 0x7efce815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcf0000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efce815c890 0x7efce8152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcf0000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce815f210 0x7efce81532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcf0000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efce816be50 con 0x7efce815f210 2024-05-30T07:01:18.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcf0000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efce816bcd0 con 0x7efce815c890 2024-05-30T07:01:18.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcf0000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efce816bfd0 con 0x7efce8072e60 2024-05-30T07:01:18.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcee000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce815f210 0x7efce81532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcee000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce815f210 0x7efce81532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43358/0 (socket says 172.21.15.37:43358) 2024-05-30T07:01:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcee000640 1 -- 172.21.15.37:0/2619191194 learned_addr learned my addr 172.21.15.37:0/2619191194 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcecc00640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efce815c890 0x7efce8152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efced600640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efce8072e60 0x7efce815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcee000640 1 -- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efce8072e60 msgr2=0x7efce815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcee000640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efce8072e60 0x7efce815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcee000640 1 -- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efce815c890 msgr2=0x7efce8152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcee000640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efce815c890 0x7efce8152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcee000640 1 -- 172.21.15.37:0/2619191194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce8153b00 con 0x7efce815f210 2024-05-30T07:01:18.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcee000640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce815f210 0x7efce81532b0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7efce001a5d0 tx=0x7efce0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:18.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efce5600640 1 -- 172.21.15.37:0/2619191194 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce00bc030 con 0x7efce815f210 2024-05-30T07:01:18.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efce5600640 1 -- 172.21.15.37:0/2619191194 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce00b8680 con 0x7efce815f210 2024-05-30T07:01:18.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efce5600640 1 -- 172.21.15.37:0/2619191194 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0009510 con 0x7efce815f210 2024-05-30T07:01:18.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcf0000640 1 -- 172.21.15.37:0/2619191194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce8153de0 con 0x7efce815f210 2024-05-30T07:01:18.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcf0000640 1 -- 172.21.15.37:0/2619191194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce81543a0 con 0x7efce815f210 2024-05-30T07:01:18.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efcf0000640 1 -- 172.21.15.37:0/2619191194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce8068bc0 con 0x7efce815f210 2024-05-30T07:01:18.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.180+0000 7efce5600640 1 -- 172.21.15.37:0/2619191194 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7efce00bf070 con 0x7efce815f210 2024-05-30T07:01:18.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.184+0000 7efce5600640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efcc806a540 0x7efcc806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.184+0000 7efce5600640 1 -- 172.21.15.37:0/2619191194 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7efce0120510 con 0x7efce815f210 2024-05-30T07:01:18.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.184+0000 7efced600640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efcc806a540 0x7efcc806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.184+0000 7efced600640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efcc806a540 0x7efcc806ca00 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009af0 tx=0x7efcdc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:18.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.188+0000 7efce5600640 1 -- 172.21.15.37:0/2619191194 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efce00c7020 con 0x7efce815f210 2024-05-30T07:01:18.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.348+0000 7efcf0000640 1 -- 172.21.15.37:0/2619191194 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7efce8067d90 con 0x7efcc806a540 2024-05-30T07:01:18.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.352+0000 7efce5600640 1 -- 172.21.15.37:0/2619191194 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efce8067d90 con 0x7efcc806a540 2024-05-30T07:01:18.353 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2024-05-30T07:01:18.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.352+0000 7efcf0000640 1 -- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efcc806a540 msgr2=0x7efcc806ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.352+0000 7efcf0000640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efcc806a540 0x7efcc806ca00 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009af0 tx=0x7efcdc008040 comp rx=0 tx=0).stop 2024-05-30T07:01:18.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.352+0000 7efcf0000640 1 -- 172.21.15.37:0/2619191194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce815f210 msgr2=0x7efce81532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.352+0000 7efcf0000640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce815f210 0x7efce81532b0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7efce001a5d0 tx=0x7efce0019740 comp rx=0 tx=0).stop 2024-05-30T07:01:18.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.352+0000 7efcf0000640 1 -- 172.21.15.37:0/2619191194 shutdown_connections 2024-05-30T07:01:18.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.352+0000 7efcf0000640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efce815f210 0x7efce81532b0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.352+0000 7efcf0000640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7efcc806a540 0x7efcc806ca00 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.352+0000 7efcf0000640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efce815c890 0x7efce8152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.352+0000 7efcf0000640 1 --2- 172.21.15.37:0/2619191194 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efce8072e60 0x7efce815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.352+0000 7efcf0000640 1 -- 172.21.15.37:0/2619191194 >> 172.21.15.37:0/2619191194 conn(0x7efce80b2ac0 msgr2=0x7efce815e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:18.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.352+0000 7efcf0000640 1 -- 172.21.15.37:0/2619191194 shutdown_connections 2024-05-30T07:01:18.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.352+0000 7efcf0000640 1 -- 172.21.15.37:0/2619191194 wait complete. 2024-05-30T07:01:18.375 INFO:tasks.ceph:Scrubbing osd.4 2024-05-30T07:01:18.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-30T07:01:18.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.516+0000 7ff87c800640 1 Processor -- start 2024-05-30T07:01:18.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.516+0000 7ff87c800640 1 -- start start 2024-05-30T07:01:18.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.520+0000 7ff87c800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff874159490 0x7ff874072750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.520+0000 7ff87c800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8740730a0 con 0x7ff8740702d0 2024-05-30T07:01:18.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.520+0000 7ff87c800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8740d06e0 con 0x7ff874072c90 2024-05-30T07:01:18.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.520+0000 7ff87c800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff874162800 con 0x7ff874159490 2024-05-30T07:01:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.520+0000 7ff879400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff8740702d0 0x7ff87415f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56322/0 (socket says 172.21.15.37:56322) 2024-05-30T07:01:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.520+0000 7ff879400640 1 -- 172.21.15.37:0/457767983 learned_addr learned my addr 172.21.15.37:0/457767983 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.520+0000 7ff879e00640 1 --2- 172.21.15.37:0/457767983 >> v2:172.21.15.105:3300/0 conn(0x7ff874159490 0x7ff874072750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.520+0000 7ff878a00640 1 -- 172.21.15.37:0/457767983 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1777664735 0 0) 0x7ff864001120 con 0x7ff8740702d0 2024-05-30T07:01:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.520+0000 7ff878a00640 1 -- 172.21.15.37:0/457767983 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff85c003530 con 0x7ff8740702d0 2024-05-30T07:01:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.520+0000 7ff879e00640 1 -- 172.21.15.37:0/457767983 >> v1:172.21.15.105:6789/0 conn(0x7ff874072c90 legacy=0x7ff8740cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.520+0000 7ff878a00640 1 -- 172.21.15.37:0/457767983 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1909387889 0 0) 0x7ff85c003530 con 0x7ff8740702d0 2024-05-30T07:01:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.520+0000 7ff879e00640 1 -- 172.21.15.37:0/457767983 >> v1:172.21.15.37:6789/0 conn(0x7ff8740702d0 legacy=0x7ff87415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.520+0000 7ff879e00640 1 -- 172.21.15.37:0/457767983 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff874162a50 con 0x7ff874159490 2024-05-30T07:01:18.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.524+0000 7ff879e00640 1 --2- 172.21.15.37:0/457767983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff874159490 0x7ff874072750 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff868009740 tx=0x7ff86801be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc476f1e1a85dab3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:18.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.524+0000 7ff878a00640 1 -- 172.21.15.37:0/457767983 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874163740 con 0x7ff874159490 2024-05-30T07:01:18.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.524+0000 7ff878a00640 1 -- 172.21.15.37:0/457767983 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8680ae070 con 0x7ff874159490 2024-05-30T07:01:18.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.524+0000 7ff878a00640 1 -- 172.21.15.37:0/457767983 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff864001870 con 0x7ff874159490 2024-05-30T07:01:18.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.524+0000 7ff87c800640 1 -- 172.21.15.37:0/457767983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff874159490 msgr2=0x7ff874072750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.524+0000 7ff87c800640 1 --2- 172.21.15.37:0/457767983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff874159490 0x7ff874072750 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff868009740 tx=0x7ff86801be40 comp rx=0 tx=0).stop 2024-05-30T07:01:18.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.524+0000 7ff87c800640 1 -- 172.21.15.37:0/457767983 shutdown_connections 2024-05-30T07:01:18.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.524+0000 7ff87c800640 1 --2- 172.21.15.37:0/457767983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff874159490 0x7ff874072750 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.524+0000 7ff87c800640 1 -- 172.21.15.37:0/457767983 >> 172.21.15.37:0/457767983 conn(0x7ff8740d0d50 msgr2=0x7ff8740d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.524+0000 7ff87c800640 1 -- 172.21.15.37:0/457767983 shutdown_connections 2024-05-30T07:01:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.524+0000 7ff87c800640 1 -- 172.21.15.37:0/457767983 wait complete. 2024-05-30T07:01:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.524+0000 7ff87c800640 1 Processor -- start 2024-05-30T07:01:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.524+0000 7ff87c800640 1 -- start start 2024-05-30T07:01:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87c800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8740702d0 0x7ff8741581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87c800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff874072c90 0x7ff874156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87c800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff874159490 0x7ff87414e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87c800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff87416db60 con 0x7ff874159490 2024-05-30T07:01:18.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87c800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff87416d9e0 con 0x7ff8740702d0 2024-05-30T07:01:18.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87c800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff87416dce0 con 0x7ff874072c90 2024-05-30T07:01:18.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff874159490 0x7ff87414e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff874159490 0x7ff87414e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43370/0 (socket says 172.21.15.37:43370) 2024-05-30T07:01:18.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87a800640 1 -- 172.21.15.37:0/3547885360 learned_addr learned my addr 172.21.15.37:0/3547885360 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff879400640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff874072c90 0x7ff874156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff879e00640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8740702d0 0x7ff8741581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87a800640 1 -- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff874072c90 msgr2=0x7ff874156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87a800640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff874072c90 0x7ff874156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87a800640 1 -- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8740702d0 msgr2=0x7ff8741581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87a800640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff8740702d0 0x7ff8741581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87a800640 1 -- 172.21.15.37:0/3547885360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff874150890 con 0x7ff874159490 2024-05-30T07:01:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87a800640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff874159490 0x7ff87414e8f0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7ff87000c8a0 tx=0x7ff87000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff86e000640 1 -- 172.21.15.37:0/3547885360 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff870017070 con 0x7ff874159490 2024-05-30T07:01:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff86e000640 1 -- 172.21.15.37:0/3547885360 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff870003db0 con 0x7ff874159490 2024-05-30T07:01:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff86e000640 1 -- 172.21.15.37:0/3547885360 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8700052b0 con 0x7ff874159490 2024-05-30T07:01:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87c800640 1 -- 172.21.15.37:0/3547885360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff874150b70 con 0x7ff874159490 2024-05-30T07:01:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87c800640 1 -- 172.21.15.37:0/3547885360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff874151130 con 0x7ff874159490 2024-05-30T07:01:18.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.528+0000 7ff87c800640 1 -- 172.21.15.37:0/3547885360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff874068d40 con 0x7ff874159490 2024-05-30T07:01:18.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.532+0000 7ff86e000640 1 -- 172.21.15.37:0/3547885360 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7ff87001a070 con 0x7ff874159490 2024-05-30T07:01:18.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.532+0000 7ff86e000640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff85806a540 0x7ff85806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.532+0000 7ff86e000640 1 -- 172.21.15.37:0/3547885360 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7ff8700859e0 con 0x7ff874159490 2024-05-30T07:01:18.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.532+0000 7ff86e000640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] conn(0x7ff8580728c0 0x7ff858074d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.532+0000 7ff86e000640 1 -- 172.21.15.37:0/3547885360 --> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff858075430 con 0x7ff8580728c0 2024-05-30T07:01:18.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.532+0000 7ff86e000640 1 -- 172.21.15.37:0/3547885360 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7ff870086f70 con 0x7ff874159490 2024-05-30T07:01:18.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.532+0000 7ff879e00640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff85806a540 0x7ff85806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.532+0000 7ff879400640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] conn(0x7ff8580728c0 0x7ff858074d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.532+0000 7ff879e00640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff85806a540 0x7ff85806ca00 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff8680ad000 tx=0x7ff8680a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:18.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.532+0000 7ff879400640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] conn(0x7ff8580728c0 0x7ff858074d60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:18.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.536+0000 7ff86e000640 1 -- 172.21.15.37:0/3547885360 <== osd.4 v2:172.21.15.105:6800/700801319 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff858075430 con 0x7ff8580728c0 2024-05-30T07:01:18.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.548+0000 7ff87c800640 1 -- 172.21.15.37:0/3547885360 --> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff87406cf60 con 0x7ff8580728c0 2024-05-30T07:01:18.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.548+0000 7ff86e000640 1 -- 172.21.15.37:0/3547885360 <== osd.4 v2:172.21.15.105:6800/700801319 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff87406cf60 con 0x7ff8580728c0 2024-05-30T07:01:18.551 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:01:18.551 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T07:01:18.551 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:01:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.548+0000 7ff87c800640 1 -- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] conn(0x7ff8580728c0 msgr2=0x7ff858074d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.548+0000 7ff87c800640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:6800/700801319,v1:172.21.15.105:6801/700801319] conn(0x7ff8580728c0 0x7ff858074d60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.548+0000 7ff87c800640 1 -- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff85806a540 msgr2=0x7ff85806ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.548+0000 7ff87c800640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7ff85806a540 0x7ff85806ca00 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff8680ad000 tx=0x7ff8680a6000 comp rx=0 tx=0).stop 2024-05-30T07:01:18.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.548+0000 7ff87c800640 1 -- 172.21.15.37:0/3547885360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff874159490 msgr2=0x7ff87414e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.548+0000 7ff87c800640 1 --2- 172.21.15.37:0/3547885360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff874159490 0x7ff87414e8f0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7ff87000c8a0 tx=0x7ff87000cd60 comp rx=0 tx=0).stop 2024-05-30T07:01:18.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.548+0000 7ff87a800640 1 -- 172.21.15.37:0/3547885360 reap_dead start 2024-05-30T07:01:18.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.548+0000 7ff87c800640 1 -- 172.21.15.37:0/3547885360 shutdown_connections 2024-05-30T07:01:18.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.548+0000 7ff87c800640 1 -- 172.21.15.37:0/3547885360 >> 172.21.15.37:0/3547885360 conn(0x7ff8740d0d50 msgr2=0x7ff87415d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:18.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.548+0000 7ff87c800640 1 -- 172.21.15.37:0/3547885360 shutdown_connections 2024-05-30T07:01:18.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.548+0000 7ff87c800640 1 -- 172.21.15.37:0/3547885360 wait complete. 2024-05-30T07:01:18.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-30T07:01:18.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f363bc00640 1 Processor -- start 2024-05-30T07:01:18.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f363bc00640 1 -- start start 2024-05-30T07:01:18.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f363bc00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f363415d350 0x7f363406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f363bc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f363415d7e0 0x7f363406e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f363bc00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3634142030 con 0x7f36340b59d0 2024-05-30T07:01:18.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f363bc00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3634142310 con 0x7f363415d350 2024-05-30T07:01:18.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f363bc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f36341425f0 con 0x7f363415d7e0 2024-05-30T07:01:18.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f3633e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f363415d350 0x7f363406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f3633e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f363415d350 0x7f363406df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43376/0 (socket says 172.21.15.37:43376) 2024-05-30T07:01:18.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f3633e00640 1 -- 172.21.15.37:0/1878675113 learned_addr learned my addr 172.21.15.37:0/1878675113 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:18.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f3639c00640 1 --2- 172.21.15.37:0/1878675113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f363415d7e0 0x7f363406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f3633400640 1 -- 172.21.15.37:0/1878675113 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2930529695 0 0) 0x7f3634142030 con 0x7f36340b59d0 2024-05-30T07:01:18.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f3633e00640 1 -- 172.21.15.37:0/1878675113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f363415d7e0 msgr2=0x7f363406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:18.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f3633e00640 1 --2- 172.21.15.37:0/1878675113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f363415d7e0 0x7f363406e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f3633e00640 1 -- 172.21.15.37:0/1878675113 >> v1:172.21.15.105:6789/0 conn(0x7f36340b59d0 legacy=0x7f36340b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.712+0000 7f3633e00640 1 -- 172.21.15.37:0/1878675113 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36341428d0 con 0x7f363415d350 2024-05-30T07:01:18.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f3633e00640 1 --2- 172.21.15.37:0/1878675113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363415d350 0x7f363406df50 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f36200098a0 tx=0x7f362001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4b572c9b6553d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:18.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f3633400640 1 -- 172.21.15.37:0/1878675113 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36200b5070 con 0x7f363415d350 2024-05-30T07:01:18.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f3633400640 1 -- 172.21.15.37:0/1878675113 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36200a8a30 con 0x7f363415d350 2024-05-30T07:01:18.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f3633400640 1 -- 172.21.15.37:0/1878675113 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36200a8e00 con 0x7f363415d350 2024-05-30T07:01:18.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f363bc00640 1 -- 172.21.15.37:0/1878675113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363415d350 msgr2=0x7f363406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f363bc00640 1 --2- 172.21.15.37:0/1878675113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363415d350 0x7f363406df50 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f36200098a0 tx=0x7f362001ed30 comp rx=0 tx=0).stop 2024-05-30T07:01:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f363bc00640 1 -- 172.21.15.37:0/1878675113 shutdown_connections 2024-05-30T07:01:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f363bc00640 1 --2- 172.21.15.37:0/1878675113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f363415d7e0 0x7f363406e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f363bc00640 1 --2- 172.21.15.37:0/1878675113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363415d350 0x7f363406df50 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f363bc00640 1 -- 172.21.15.37:0/1878675113 >> 172.21.15.37:0/1878675113 conn(0x7f363406bf60 msgr2=0x7f36340b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f363bc00640 1 -- 172.21.15.37:0/1878675113 shutdown_connections 2024-05-30T07:01:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f363bc00640 1 -- 172.21.15.37:0/1878675113 wait complete. 2024-05-30T07:01:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f363bc00640 1 Processor -- start 2024-05-30T07:01:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.716+0000 7f363bc00640 1 -- start start 2024-05-30T07:01:18.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f363bc00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36340b59d0 0x7f363413eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f363bc00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f363415d350 0x7f36341572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f363bc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363415d7e0 0x7f3634152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f363bc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f36340b00a0 con 0x7f363415d7e0 2024-05-30T07:01:18.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f363bc00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f36340aff20 con 0x7f363415d350 2024-05-30T07:01:18.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f363bc00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f363413f860 con 0x7f36340b59d0 2024-05-30T07:01:18.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3639c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363415d7e0 0x7f3634152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3639c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363415d7e0 0x7f3634152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43384/0 (socket says 172.21.15.37:43384) 2024-05-30T07:01:18.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3639c00640 1 -- 172.21.15.37:0/3798722924 learned_addr learned my addr 172.21.15.37:0/3798722924 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:18.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3633e00640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f363415d350 0x7f36341572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3639200640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36340b59d0 0x7f363413eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3639c00640 1 -- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36340b59d0 msgr2=0x7f363413eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3639c00640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36340b59d0 0x7f363413eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3639c00640 1 -- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f363415d350 msgr2=0x7f36341572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3639c00640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f363415d350 0x7f36341572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3639c00640 1 -- 172.21.15.37:0/3798722924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3634157800 con 0x7f363415d7e0 2024-05-30T07:01:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3633e00640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f363415d350 0x7f36341572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3639c00640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363415d7e0 0x7f3634152800 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f362c00efc0 tx=0x7f362c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3630c00640 1 -- 172.21.15.37:0/3798722924 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c018020 con 0x7f363415d7e0 2024-05-30T07:01:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3630c00640 1 -- 172.21.15.37:0/3798722924 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c014480 con 0x7f363415d7e0 2024-05-30T07:01:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f3630c00640 1 -- 172.21.15.37:0/3798722924 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c014870 con 0x7f363415d7e0 2024-05-30T07:01:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f363bc00640 1 -- 172.21.15.37:0/3798722924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3634157ab0 con 0x7f363415d7e0 2024-05-30T07:01:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f363bc00640 1 -- 172.21.15.37:0/3798722924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3634158070 con 0x7f363415d7e0 2024-05-30T07:01:18.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.720+0000 7f363bc00640 1 -- 172.21.15.37:0/3798722924 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3634068bc0 con 0x7f363415d7e0 2024-05-30T07:01:18.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.724+0000 7f3630c00640 1 -- 172.21.15.37:0/3798722924 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f362c01b020 con 0x7f363415d7e0 2024-05-30T07:01:18.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.724+0000 7f3630c00640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f361406a570 0x7f361406ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:18.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.724+0000 7f3630c00640 1 -- 172.21.15.37:0/3798722924 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f362c0865e0 con 0x7f363415d7e0 2024-05-30T07:01:18.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.724+0000 7f3639200640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f361406a570 0x7f361406ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:18.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.724+0000 7f3639200640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f361406a570 0x7f361406ca30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3628000f70 tx=0x7f3628009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.728+0000 7f3630c00640 1 -- 172.21.15.37:0/3798722924 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f362c022070 con 0x7f363415d7e0 2024-05-30T07:01:18.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.896+0000 7f363bc00640 1 -- 172.21.15.37:0/3798722924 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f36340b5e50 con 0x7f361406a570 2024-05-30T07:01:18.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.896+0000 7f3630c00640 1 -- 172.21.15.37:0/3798722924 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f36340b5e50 con 0x7f361406a570 2024-05-30T07:01:18.900 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 4 to deep-scrub 2024-05-30T07:01:18.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.900+0000 7f363bc00640 1 -- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f361406a570 msgr2=0x7f361406ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.900+0000 7f363bc00640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f361406a570 0x7f361406ca30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f3628000f70 tx=0x7f3628009040 comp rx=0 tx=0).stop 2024-05-30T07:01:18.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.900+0000 7f363bc00640 1 -- 172.21.15.37:0/3798722924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363415d7e0 msgr2=0x7f3634152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:18.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.900+0000 7f363bc00640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363415d7e0 0x7f3634152800 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f362c00efc0 tx=0x7f362c00c490 comp rx=0 tx=0).stop 2024-05-30T07:01:18.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.900+0000 7f363bc00640 1 -- 172.21.15.37:0/3798722924 shutdown_connections 2024-05-30T07:01:18.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.900+0000 7f363bc00640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f363415d7e0 0x7f3634152800 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.900+0000 7f363bc00640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f361406a570 0x7f361406ca30 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.900+0000 7f363bc00640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f363415d350 0x7f36341572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.900+0000 7f363bc00640 1 --2- 172.21.15.37:0/3798722924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f36340b59d0 0x7f363413eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:18.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.900+0000 7f363bc00640 1 -- 172.21.15.37:0/3798722924 >> 172.21.15.37:0/3798722924 conn(0x7f363406bf60 msgr2=0x7f3634160210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:18.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.900+0000 7f363bc00640 1 -- 172.21.15.37:0/3798722924 shutdown_connections 2024-05-30T07:01:18.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:18.900+0000 7f363bc00640 1 -- 172.21.15.37:0/3798722924 wait complete. 2024-05-30T07:01:18.920 INFO:tasks.ceph:Scrubbing osd.5 2024-05-30T07:01:18.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-30T07:01:19.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.064+0000 7f0fb9800640 1 Processor -- start 2024-05-30T07:01:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.064+0000 7f0fb9800640 1 -- start start 2024-05-30T07:01:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.064+0000 7f0fb9800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0fb415eb60 0x7f0fb406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.064+0000 7f0fb9800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fb40b15c0 0x7f0fb40cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.064+0000 7f0fb9800640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb409bba0 con 0x7f0fb40cf460 2024-05-30T07:01:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.064+0000 7f0fb9800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0fb409ab00 con 0x7f0fb415eb60 2024-05-30T07:01:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.064+0000 7f0fb9800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb409ade0 con 0x7f0fb40b15c0 2024-05-30T07:01:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.064+0000 7f0fb2a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0fb415eb60 0x7f0fb406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.064+0000 7f0fb2a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0fb415eb60 0x7f0fb406d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43390/0 (socket says 172.21.15.37:43390) 2024-05-30T07:01:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.064+0000 7f0fb2a00640 1 -- 172.21.15.37:0/752112426 learned_addr learned my addr 172.21.15.37:0/752112426 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.068+0000 7f0faa000640 1 --2- 172.21.15.37:0/752112426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fb40b15c0 0x7f0fb40cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.068+0000 7f0fb2a00640 1 -- 172.21.15.37:0/752112426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fb40b15c0 msgr2=0x7f0fb40cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.068+0000 7f0fb2a00640 1 --2- 172.21.15.37:0/752112426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fb40b15c0 0x7f0fb40cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.068+0000 7f0fb2a00640 1 -- 172.21.15.37:0/752112426 >> v1:172.21.15.37:6789/0 conn(0x7f0fb40cf460 legacy=0x7f0fb41625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.068+0000 7f0fb2a00640 1 -- 172.21.15.37:0/752112426 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb409b0c0 con 0x7f0fb415eb60 2024-05-30T07:01:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.068+0000 7f0fb2a00640 1 --2- 172.21.15.37:0/752112426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb415eb60 0x7f0fb406d480 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009870 tx=0x7f0f9c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2ec58a549e8cc server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.068+0000 7f0fb2000640 1 -- 172.21.15.37:0/752112426 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0b0070 con 0x7f0fb415eb60 2024-05-30T07:01:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.068+0000 7f0fb2000640 1 -- 172.21.15.37:0/752112426 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f9c0ab600 con 0x7f0fb415eb60 2024-05-30T07:01:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.068+0000 7f0fb2000640 1 -- 172.21.15.37:0/752112426 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0ab9d0 con 0x7f0fb415eb60 2024-05-30T07:01:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.068+0000 7f0fb9800640 1 -- 172.21.15.37:0/752112426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb415eb60 msgr2=0x7f0fb406d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.068+0000 7f0fb9800640 1 --2- 172.21.15.37:0/752112426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb415eb60 0x7f0fb406d480 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009870 tx=0x7f0f9c01c560 comp rx=0 tx=0).stop 2024-05-30T07:01:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 -- 172.21.15.37:0/752112426 shutdown_connections 2024-05-30T07:01:19.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 --2- 172.21.15.37:0/752112426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fb40b15c0 0x7f0fb40cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 --2- 172.21.15.37:0/752112426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb415eb60 0x7f0fb406d480 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 -- 172.21.15.37:0/752112426 >> 172.21.15.37:0/752112426 conn(0x7f0fb40d26a0 msgr2=0x7f0fb40d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 -- 172.21.15.37:0/752112426 shutdown_connections 2024-05-30T07:01:19.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 -- 172.21.15.37:0/752112426 wait complete. 2024-05-30T07:01:19.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 Processor -- start 2024-05-30T07:01:19.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 -- start start 2024-05-30T07:01:19.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb40b15c0 0x7f0fb4159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fb40cf460 0x7f0fb41566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fb415eb60 0x7f0fb40c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb40d1800 con 0x7f0fb40b15c0 2024-05-30T07:01:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb40d1680 con 0x7f0fb415eb60 2024-05-30T07:01:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb9800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb416b8e0 con 0x7f0fb40cf460 2024-05-30T07:01:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb40b15c0 0x7f0fb4159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb40b15c0 0x7f0fb4159ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43394/0 (socket says 172.21.15.37:43394) 2024-05-30T07:01:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb2a00640 1 -- 172.21.15.37:0/1631117712 learned_addr learned my addr 172.21.15.37:0/1631117712 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0faa000640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fb40cf460 0x7f0fb41566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb3400640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fb415eb60 0x7f0fb40c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb2a00640 1 -- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fb40cf460 msgr2=0x7f0fb41566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb2a00640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fb40cf460 0x7f0fb41566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb2a00640 1 -- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fb415eb60 msgr2=0x7f0fb40c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb2a00640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fb415eb60 0x7f0fb40c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb2a00640 1 -- 172.21.15.37:0/1631117712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb40b02b0 con 0x7f0fb40b15c0 2024-05-30T07:01:19.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fb2a00640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb40b15c0 0x7f0fb4159ae0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0ae040 tx=0x7f0f9c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fab400640 1 -- 172.21.15.37:0/1631117712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0ba020 con 0x7f0fb40b15c0 2024-05-30T07:01:19.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fab400640 1 -- 172.21.15.37:0/1631117712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f9c0b6620 con 0x7f0fb40b15c0 2024-05-30T07:01:19.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.072+0000 7f0fab400640 1 -- 172.21.15.37:0/1631117712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0b0040 con 0x7f0fb40b15c0 2024-05-30T07:01:19.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.076+0000 7f0fb9800640 1 -- 172.21.15.37:0/1631117712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb40b0590 con 0x7f0fb40b15c0 2024-05-30T07:01:19.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.076+0000 7f0fb9800640 1 -- 172.21.15.37:0/1631117712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb40c79f0 con 0x7f0fb40b15c0 2024-05-30T07:01:19.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.076+0000 7f0fb9800640 1 -- 172.21.15.37:0/1631117712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0fb4068d40 con 0x7f0fb40b15c0 2024-05-30T07:01:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.076+0000 7f0fab400640 1 -- 172.21.15.37:0/1631117712 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f0f9c0bd020 con 0x7f0fb40b15c0 2024-05-30T07:01:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.076+0000 7f0fab400640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0f9006a540 0x7f0f9006ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.076+0000 7f0fab400640 1 -- 172.21.15.37:0/1631117712 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f0f9c11fd10 con 0x7f0fb40b15c0 2024-05-30T07:01:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.076+0000 7f0fab400640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] conn(0x7f0f900728c0 0x7f0f90074d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.076+0000 7f0fab400640 1 -- 172.21.15.37:0/1631117712 --> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f9c0044a0 con 0x7f0f900728c0 2024-05-30T07:01:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.076+0000 7f0fab400640 1 -- 172.21.15.37:0/1631117712 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f0f9c121150 con 0x7f0fb40b15c0 2024-05-30T07:01:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.076+0000 7f0faa000640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0f9006a540 0x7f0f9006ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.076+0000 7f0fb3400640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] conn(0x7f0f900728c0 0x7f0f90074d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.080+0000 7f0fb3400640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] conn(0x7f0f900728c0 0x7f0f90074d60 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.080+0000 7f0faa000640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0f9006a540 0x7f0f9006ca00 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0fb41698a0 tx=0x7f0fa4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.080+0000 7f0fab400640 1 -- 172.21.15.37:0/1631117712 <== osd.5 v2:172.21.15.105:6808/2549616191 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0f9c0044a0 con 0x7f0f900728c0 2024-05-30T07:01:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.092+0000 7f0fb9800640 1 -- 172.21.15.37:0/1631117712 --> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0fb40d30a0 con 0x7f0f900728c0 2024-05-30T07:01:19.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.092+0000 7f0fab400640 1 -- 172.21.15.37:0/1631117712 <== osd.5 v2:172.21.15.105:6808/2549616191 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0fb40d30a0 con 0x7f0f900728c0 2024-05-30T07:01:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:01:19.096 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T07:01:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:01:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.092+0000 7f0fb9800640 1 -- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] conn(0x7f0f900728c0 msgr2=0x7f0f90074d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.092+0000 7f0fb9800640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:6808/2549616191,v1:172.21.15.105:6809/2549616191] conn(0x7f0f900728c0 0x7f0f90074d60 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.092+0000 7f0fb9800640 1 -- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0f9006a540 msgr2=0x7f0f9006ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.092+0000 7f0fb9800640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f0f9006a540 0x7f0f9006ca00 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0fb41698a0 tx=0x7f0fa4008040 comp rx=0 tx=0).stop 2024-05-30T07:01:19.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.092+0000 7f0fb9800640 1 -- 172.21.15.37:0/1631117712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb40b15c0 msgr2=0x7f0fb4159ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.092+0000 7f0fb9800640 1 --2- 172.21.15.37:0/1631117712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb40b15c0 0x7f0fb4159ae0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0ae040 tx=0x7f0f9c01ada0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.092+0000 7f0fb3400640 1 -- 172.21.15.37:0/1631117712 reap_dead start 2024-05-30T07:01:19.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.092+0000 7f0fb9800640 1 -- 172.21.15.37:0/1631117712 shutdown_connections 2024-05-30T07:01:19.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.092+0000 7f0fb9800640 1 -- 172.21.15.37:0/1631117712 >> 172.21.15.37:0/1631117712 conn(0x7f0fb40d26a0 msgr2=0x7f0fb40715d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:19.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.092+0000 7f0fb9800640 1 -- 172.21.15.37:0/1631117712 shutdown_connections 2024-05-30T07:01:19.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.092+0000 7f0fb9800640 1 -- 172.21.15.37:0/1631117712 wait complete. 2024-05-30T07:01:19.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-30T07:01:19.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.252+0000 7fd1ebe00640 1 Processor -- start 2024-05-30T07:01:19.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.252+0000 7fd1ebe00640 1 -- start start 2024-05-30T07:01:19.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1ebe00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1e40cd440 0x7fd1e406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1ebe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1e406f5a0 0x7fd1e40b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1ebe00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e415f310 con 0x7fd1e4155da0 2024-05-30T07:01:19.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1ebe00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd1e415f5f0 con 0x7fd1e40cd440 2024-05-30T07:01:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1ebe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e415f8d0 con 0x7fd1e406f5a0 2024-05-30T07:01:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1e8a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1e40cd440 0x7fd1e406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1e8a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1e40cd440 0x7fd1e406f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43402/0 (socket says 172.21.15.37:43402) 2024-05-30T07:01:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1e8a00640 1 -- 172.21.15.37:0/3377387885 learned_addr learned my addr 172.21.15.37:0/3377387885 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:19.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1e9e00640 1 --2- 172.21.15.37:0/3377387885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1e406f5a0 0x7fd1e40b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1e8a00640 1 -- 172.21.15.37:0/3377387885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1e406f5a0 msgr2=0x7fd1e40b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1e8a00640 1 --2- 172.21.15.37:0/3377387885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1e406f5a0 0x7fd1e40b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1e8a00640 1 -- 172.21.15.37:0/3377387885 >> v1:172.21.15.105:6789/0 conn(0x7fd1e4155da0 legacy=0x7fd1e40cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1e8a00640 1 -- 172.21.15.37:0/3377387885 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e415fbb0 con 0x7fd1e40cd440 2024-05-30T07:01:19.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.256+0000 7fd1e9e00640 1 --2- 172.21.15.37:0/3377387885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1e406f5a0 0x7fd1e40b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:19.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1e8a00640 1 --2- 172.21.15.37:0/3377387885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e40cd440 0x7fd1e406f060 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009870 tx=0x7fd1d001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c369bb9f9796338a server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1e3e00640 1 -- 172.21.15.37:0/3377387885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00b0070 con 0x7fd1e40cd440 2024-05-30T07:01:19.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1e3e00640 1 -- 172.21.15.37:0/3377387885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d0004230 con 0x7fd1e40cd440 2024-05-30T07:01:19.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1e3e00640 1 -- 172.21.15.37:0/3377387885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0003620 con 0x7fd1e40cd440 2024-05-30T07:01:19.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3377387885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e40cd440 msgr2=0x7fd1e406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1ebe00640 1 --2- 172.21.15.37:0/3377387885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e40cd440 0x7fd1e406f060 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009870 tx=0x7fd1d001c440 comp rx=0 tx=0).stop 2024-05-30T07:01:19.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3377387885 shutdown_connections 2024-05-30T07:01:19.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1ebe00640 1 --2- 172.21.15.37:0/3377387885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1e406f5a0 0x7fd1e40b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1ebe00640 1 --2- 172.21.15.37:0/3377387885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e40cd440 0x7fd1e406f060 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3377387885 >> 172.21.15.37:0/3377387885 conn(0x7fd1e406bf60 msgr2=0x7fd1e40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:19.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3377387885 shutdown_connections 2024-05-30T07:01:19.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3377387885 wait complete. 2024-05-30T07:01:19.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1ebe00640 1 Processor -- start 2024-05-30T07:01:19.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.260+0000 7fd1ebe00640 1 -- start start 2024-05-30T07:01:19.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1ebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e406f5a0 0x7fd1e4144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1ebe00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1e4155da0 0x7fd1e4150600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1ebe00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1e4159db0 0x7fd1e415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1ebe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e406f9b0 con 0x7fd1e406f5a0 2024-05-30T07:01:19.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1ebe00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e40b46f0 con 0x7fd1e4155da0 2024-05-30T07:01:19.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1ebe00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e4168580 con 0x7fd1e4159db0 2024-05-30T07:01:19.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e406f5a0 0x7fd1e4144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e406f5a0 0x7fd1e4144e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43408/0 (socket says 172.21.15.37:43408) 2024-05-30T07:01:19.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e9400640 1 -- 172.21.15.37:0/3795832471 learned_addr learned my addr 172.21.15.37:0/3795832471 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:19.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e8a00640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1e4155da0 0x7fd1e4150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e9e00640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1e4159db0 0x7fd1e415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e9400640 1 -- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1e4159db0 msgr2=0x7fd1e415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e9400640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1e4159db0 0x7fd1e415a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e9400640 1 -- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1e4155da0 msgr2=0x7fd1e4150600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e9400640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1e4155da0 0x7fd1e4150600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e9400640 1 -- 172.21.15.37:0/3795832471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e415ead0 con 0x7fd1e406f5a0 2024-05-30T07:01:19.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e9400640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e406f5a0 0x7fd1e4144e00 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800c3a0 tx=0x7fd1d800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e1600640 1 -- 172.21.15.37:0/3795832471 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80052d0 con 0x7fd1e406f5a0 2024-05-30T07:01:19.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e1600640 1 -- 172.21.15.37:0/3795832471 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1d8005470 con 0x7fd1e406f5a0 2024-05-30T07:01:19.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e1600640 1 -- 172.21.15.37:0/3795832471 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8007260 con 0x7fd1e406f5a0 2024-05-30T07:01:19.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3795832471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e414fb20 con 0x7fd1e406f5a0 2024-05-30T07:01:19.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3795832471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e41500e0 con 0x7fd1e406f5a0 2024-05-30T07:01:19.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3795832471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e4068bc0 con 0x7fd1e406f5a0 2024-05-30T07:01:19.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.264+0000 7fd1e1600640 1 -- 172.21.15.37:0/3795832471 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7fd1d8007400 con 0x7fd1e406f5a0 2024-05-30T07:01:19.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.268+0000 7fd1e1600640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1c406a540 0x7fd1c406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.268+0000 7fd1e1600640 1 -- 172.21.15.37:0/3795832471 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fd1d8084f50 con 0x7fd1e406f5a0 2024-05-30T07:01:19.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.268+0000 7fd1e8a00640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1c406a540 0x7fd1c406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.268+0000 7fd1e8a00640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1c406a540 0x7fd1c406ca00 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00ad000 tx=0x7fd1d00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.272+0000 7fd1e1600640 1 -- 172.21.15.37:0/3795832471 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd1d8056920 con 0x7fd1e406f5a0 2024-05-30T07:01:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3795832471 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fd1e40b63e0 con 0x7fd1c406a540 2024-05-30T07:01:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1e1600640 1 -- 172.21.15.37:0/3795832471 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd1e40b63e0 con 0x7fd1c406a540 2024-05-30T07:01:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 5 to deep-scrub 2024-05-30T07:01:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1c406a540 msgr2=0x7fd1c406ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1ebe00640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1c406a540 0x7fd1c406ca00 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00ad000 tx=0x7fd1d00a6000 comp rx=0 tx=0).stop 2024-05-30T07:01:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3795832471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e406f5a0 msgr2=0x7fd1e4144e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1ebe00640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e406f5a0 0x7fd1e4144e00 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800c3a0 tx=0x7fd1d800c860 comp rx=0 tx=0).stop 2024-05-30T07:01:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3795832471 shutdown_connections 2024-05-30T07:01:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1ebe00640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd1e4159db0 0x7fd1e415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1ebe00640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fd1c406a540 0x7fd1c406ca00 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1ebe00640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd1e4155da0 0x7fd1e4150600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1ebe00640 1 --2- 172.21.15.37:0/3795832471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1e406f5a0 0x7fd1e4144e00 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3795832471 >> 172.21.15.37:0/3795832471 conn(0x7fd1e406bf60 msgr2=0x7fd1e4074cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3795832471 shutdown_connections 2024-05-30T07:01:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.436+0000 7fd1ebe00640 1 -- 172.21.15.37:0/3795832471 wait complete. 2024-05-30T07:01:19.461 INFO:tasks.ceph:Scrubbing osd.6 2024-05-30T07:01:19.461 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-30T07:01:19.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc394c00640 1 Processor -- start 2024-05-30T07:01:19.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc394c00640 1 -- start start 2024-05-30T07:01:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc394c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc39015c780 0x7fc3900b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc394c00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc39009aa60 0x7fc39009ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc394c00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3900b2cb0 con 0x7fc39009b3a0 2024-05-30T07:01:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc394c00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc3900b38c0 con 0x7fc39009aa60 2024-05-30T07:01:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc394c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc3900b2f90 con 0x7fc39015c780 2024-05-30T07:01:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc387e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc39009aa60 0x7fc39009ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc387e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc39009aa60 0x7fc39009ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43422/0 (socket says 172.21.15.37:43422) 2024-05-30T07:01:19.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc387e00640 1 -- 172.21.15.37:0/1199470064 learned_addr learned my addr 172.21.15.37:0/1199470064 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:19.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc38de00640 1 --2- 172.21.15.37:0/1199470064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc39015c780 0x7fc3900b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc387e00640 1 -- 172.21.15.37:0/1199470064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc39015c780 msgr2=0x7fc3900b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:19.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc387e00640 1 --2- 172.21.15.37:0/1199470064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc39015c780 0x7fc3900b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc387e00640 1 -- 172.21.15.37:0/1199470064 >> v1:172.21.15.105:6789/0 conn(0x7fc39009b3a0 legacy=0x7fc390160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc387e00640 1 -- 172.21.15.37:0/1199470064 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3900b3270 con 0x7fc39009aa60 2024-05-30T07:01:19.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.604+0000 7fc38de00640 1 --2- 172.21.15.37:0/1199470064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc39015c780 0x7fc3900b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-30T07:01:19.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.608+0000 7fc387e00640 1 --2- 172.21.15.37:0/1199470064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39009aa60 0x7fc39009ae60 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fc3900b5250 tx=0x7fc37801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2222bc6da4772677 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.608+0000 7fc38d400640 1 -- 172.21.15.37:0/1199470064 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3780b2070 con 0x7fc39009aa60 2024-05-30T07:01:19.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.608+0000 7fc38d400640 1 -- 172.21.15.37:0/1199470064 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3780ad640 con 0x7fc39009aa60 2024-05-30T07:01:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.608+0000 7fc38d400640 1 -- 172.21.15.37:0/1199470064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3780ada10 con 0x7fc39009aa60 2024-05-30T07:01:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.608+0000 7fc394c00640 1 -- 172.21.15.37:0/1199470064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39009aa60 msgr2=0x7fc39009ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.608+0000 7fc394c00640 1 --2- 172.21.15.37:0/1199470064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39009aa60 0x7fc39009ae60 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fc3900b5250 tx=0x7fc37801c4e0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.608+0000 7fc394c00640 1 -- 172.21.15.37:0/1199470064 shutdown_connections 2024-05-30T07:01:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.608+0000 7fc394c00640 1 --2- 172.21.15.37:0/1199470064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39009aa60 0x7fc39009ae60 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.608+0000 7fc394c00640 1 --2- 172.21.15.37:0/1199470064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc39015c780 0x7fc3900b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.608+0000 7fc394c00640 1 -- 172.21.15.37:0/1199470064 >> 172.21.15.37:0/1199470064 conn(0x7fc3900d26a0 msgr2=0x7fc3900d2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.608+0000 7fc394c00640 1 -- 172.21.15.37:0/1199470064 shutdown_connections 2024-05-30T07:01:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.608+0000 7fc394c00640 1 -- 172.21.15.37:0/1199470064 wait complete. 2024-05-30T07:01:19.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.608+0000 7fc394c00640 1 Processor -- start 2024-05-30T07:01:19.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc394c00640 1 -- start start 2024-05-30T07:01:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc394c00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc39009aa60 0x7fc390148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc394c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39009b3a0 0x7fc39015bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc394c00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc39015c780 0x7fc390159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc394c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3900b3eb0 con 0x7fc39009b3a0 2024-05-30T07:01:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc394c00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc3900b3d30 con 0x7fc39009aa60 2024-05-30T07:01:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc394c00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc3901696b0 con 0x7fc39015c780 2024-05-30T07:01:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc387e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39009b3a0 0x7fc39015bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc387e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39009b3a0 0x7fc39015bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43432/0 (socket says 172.21.15.37:43432) 2024-05-30T07:01:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc387e00640 1 -- 172.21.15.37:0/1943904689 learned_addr learned my addr 172.21.15.37:0/1943904689 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc38de00640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc39009aa60 0x7fc390148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc38e800640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc39015c780 0x7fc390159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc387e00640 1 -- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc39015c780 msgr2=0x7fc390159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc387e00640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc39015c780 0x7fc390159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc387e00640 1 -- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc39009aa60 msgr2=0x7fc390148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc387e00640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc39009aa60 0x7fc390148640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc387e00640 1 -- 172.21.15.37:0/1943904689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39014ec40 con 0x7fc39009b3a0 2024-05-30T07:01:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc387e00640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39009b3a0 0x7fc39015bd10 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fc37801cd80 tx=0x7fc378019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc386000640 1 -- 172.21.15.37:0/1943904689 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3780b2040 con 0x7fc39009b3a0 2024-05-30T07:01:19.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc386000640 1 -- 172.21.15.37:0/1943904689 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3780bb070 con 0x7fc39009b3a0 2024-05-30T07:01:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc394c00640 1 -- 172.21.15.37:0/1943904689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39014dba0 con 0x7fc39009b3a0 2024-05-30T07:01:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc386000640 1 -- 172.21.15.37:0/1943904689 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3780b68a0 con 0x7fc39009b3a0 2024-05-30T07:01:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc394c00640 1 -- 172.21.15.37:0/1943904689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc39014e160 con 0x7fc39009b3a0 2024-05-30T07:01:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.612+0000 7fc394c00640 1 -- 172.21.15.37:0/1943904689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc390068d40 con 0x7fc39009b3a0 2024-05-30T07:01:19.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.616+0000 7fc386000640 1 -- 172.21.15.37:0/1943904689 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7fc3780ad500 con 0x7fc39009b3a0 2024-05-30T07:01:19.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.616+0000 7fc386000640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc36c06a540 0x7fc36c06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.616+0000 7fc386000640 1 -- 172.21.15.37:0/1943904689 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fc37811fc80 con 0x7fc39009b3a0 2024-05-30T07:01:19.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.616+0000 7fc386000640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] conn(0x7fc36c072920 0x7fc36c074dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.616+0000 7fc386000640 1 -- 172.21.15.37:0/1943904689 --> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3780b4e50 con 0x7fc36c072920 2024-05-30T07:01:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.616+0000 7fc386000640 1 -- 172.21.15.37:0/1943904689 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7fc378120f10 con 0x7fc39009b3a0 2024-05-30T07:01:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.616+0000 7fc38de00640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc36c06a540 0x7fc36c06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.616+0000 7fc38e800640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] conn(0x7fc36c072920 0x7fc36c074dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.616+0000 7fc38de00640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc36c06a540 0x7fc36c06ca00 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc380006fd0 tx=0x7fc380008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.616+0000 7fc38e800640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] conn(0x7fc36c072920 0x7fc36c074dc0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.616+0000 7fc386000640 1 -- 172.21.15.37:0/1943904689 <== osd.6 v2:172.21.15.105:6816/2790478860 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3780b4e50 con 0x7fc36c072920 2024-05-30T07:01:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.632+0000 7fc394c00640 1 -- 172.21.15.37:0/1943904689 --> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc3900ccb40 con 0x7fc36c072920 2024-05-30T07:01:19.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.632+0000 7fc386000640 1 -- 172.21.15.37:0/1943904689 <== osd.6 v2:172.21.15.105:6816/2790478860 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc3900ccb40 con 0x7fc36c072920 2024-05-30T07:01:19.634 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:01:19.635 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T07:01:19.635 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:01:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.632+0000 7fc394c00640 1 -- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] conn(0x7fc36c072920 msgr2=0x7fc36c074dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.632+0000 7fc394c00640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:6816/2790478860,v1:172.21.15.105:6818/2790478860] conn(0x7fc36c072920 0x7fc36c074dc0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.632+0000 7fc394c00640 1 -- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc36c06a540 msgr2=0x7fc36c06ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.632+0000 7fc394c00640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fc36c06a540 0x7fc36c06ca00 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc380006fd0 tx=0x7fc380008040 comp rx=0 tx=0).stop 2024-05-30T07:01:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.632+0000 7fc394c00640 1 -- 172.21.15.37:0/1943904689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39009b3a0 msgr2=0x7fc39015bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.632+0000 7fc394c00640 1 --2- 172.21.15.37:0/1943904689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc39009b3a0 0x7fc39015bd10 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7fc37801cd80 tx=0x7fc378019280 comp rx=0 tx=0).stop 2024-05-30T07:01:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.632+0000 7fc38e800640 1 -- 172.21.15.37:0/1943904689 reap_dead start 2024-05-30T07:01:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.632+0000 7fc394c00640 1 -- 172.21.15.37:0/1943904689 shutdown_connections 2024-05-30T07:01:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.632+0000 7fc394c00640 1 -- 172.21.15.37:0/1943904689 >> 172.21.15.37:0/1943904689 conn(0x7fc3900d26a0 msgr2=0x7fc3900b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.632+0000 7fc394c00640 1 -- 172.21.15.37:0/1943904689 shutdown_connections 2024-05-30T07:01:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.632+0000 7fc394c00640 1 -- 172.21.15.37:0/1943904689 wait complete. 2024-05-30T07:01:19.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-30T07:01:19.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b8400640 1 Processor -- start 2024-05-30T07:01:19.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b8400640 1 -- start start 2024-05-30T07:01:19.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b8400640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f27b0163250 0x7f27b01636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b8400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27b00ce7d0 0x7f27b00cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b8400640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b00ccfc0 con 0x7f27b0162e70 2024-05-30T07:01:19.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b8400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f27b006f8e0 con 0x7f27b00ce7d0 2024-05-30T07:01:19.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b8400640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f27b0164190 con 0x7f27b0163250 2024-05-30T07:01:19.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b6400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27b00ce7d0 0x7f27b00cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b6400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27b00ce7d0 0x7f27b00cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43438/0 (socket says 172.21.15.37:43438) 2024-05-30T07:01:19.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b6400640 1 -- 172.21.15.37:0/801132931 learned_addr learned my addr 172.21.15.37:0/801132931 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:19.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b5000640 1 --2- 172.21.15.37:0/801132931 >> v2:172.21.15.105:3300/0 conn(0x7f27b0163250 0x7f27b01636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b6400640 1 -- 172.21.15.37:0/801132931 >> v2:172.21.15.105:3300/0 conn(0x7f27b0163250 msgr2=0x7f27b01636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:19.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b6400640 1 --2- 172.21.15.37:0/801132931 >> v2:172.21.15.105:3300/0 conn(0x7f27b0163250 0x7f27b01636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b6400640 1 -- 172.21.15.37:0/801132931 >> v1:172.21.15.105:6789/0 conn(0x7f27b0162e70 legacy=0x7f27b00cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.792+0000 7f27b6400640 1 -- 172.21.15.37:0/801132931 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b006ecd0 con 0x7f27b00ce7d0 2024-05-30T07:01:19.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.796+0000 7f27b6400640 1 --2- 172.21.15.37:0/801132931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b00ce7d0 0x7f27b00cebe0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f27b006c5e0 tx=0x7f27a801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d0c5438b4d5bcd server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.796+0000 7f27afe00640 1 -- 172.21.15.37:0/801132931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a80a57f0 con 0x7f27b00ce7d0 2024-05-30T07:01:19.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.796+0000 7f27afe00640 1 -- 172.21.15.37:0/801132931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a80a5990 con 0x7f27b00ce7d0 2024-05-30T07:01:19.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.796+0000 7f27afe00640 1 -- 172.21.15.37:0/801132931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a80a5d60 con 0x7f27b00ce7d0 2024-05-30T07:01:19.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.796+0000 7f27b8400640 1 -- 172.21.15.37:0/801132931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b00ce7d0 msgr2=0x7f27b00cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.796+0000 7f27b8400640 1 --2- 172.21.15.37:0/801132931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b00ce7d0 0x7f27b00cebe0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f27b006c5e0 tx=0x7f27a801c930 comp rx=0 tx=0).stop 2024-05-30T07:01:19.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.796+0000 7f27b8400640 1 -- 172.21.15.37:0/801132931 shutdown_connections 2024-05-30T07:01:19.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.796+0000 7f27b8400640 1 --2- 172.21.15.37:0/801132931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b00ce7d0 0x7f27b00cebe0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.796+0000 7f27b8400640 1 --2- 172.21.15.37:0/801132931 >> v2:172.21.15.105:3300/0 conn(0x7f27b0163250 0x7f27b01636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.796+0000 7f27b8400640 1 -- 172.21.15.37:0/801132931 >> 172.21.15.37:0/801132931 conn(0x7f27b006bf60 msgr2=0x7f27b00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:19.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.796+0000 7f27b8400640 1 -- 172.21.15.37:0/801132931 shutdown_connections 2024-05-30T07:01:19.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.796+0000 7f27b8400640 1 -- 172.21.15.37:0/801132931 wait complete. 2024-05-30T07:01:19.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b8400640 1 Processor -- start 2024-05-30T07:01:19.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b8400640 1 -- start start 2024-05-30T07:01:19.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b8400640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27b00ce7d0 0x7f27b0144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b8400640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b0162e70 0x7f27b0159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b8400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b0163250 0x7f27b015c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b8400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27b006e960 con 0x7f27b0163250 2024-05-30T07:01:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b8400640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27b0163c10 con 0x7f27b0162e70 2024-05-30T07:01:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b8400640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f27b016fc40 con 0x7f27b00ce7d0 2024-05-30T07:01:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b6400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b0163250 0x7f27b015c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b6400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b0163250 0x7f27b015c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43452/0 (socket says 172.21.15.37:43452) 2024-05-30T07:01:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b6400640 1 -- 172.21.15.37:0/3492747164 learned_addr learned my addr 172.21.15.37:0/3492747164 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b5000640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b0162e70 0x7f27b0159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b5a00640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27b00ce7d0 0x7f27b0144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b6400640 1 -- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27b00ce7d0 msgr2=0x7f27b0144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b6400640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27b00ce7d0 0x7f27b0144640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b6400640 1 -- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b0162e70 msgr2=0x7f27b0159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b6400640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b0162e70 0x7f27b0159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b6400640 1 -- 172.21.15.37:0/3492747164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b0075650 con 0x7f27b0163250 2024-05-30T07:01:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b5a00640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27b00ce7d0 0x7f27b0144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b6400640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b0163250 0x7f27b015c960 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f27a8019540 tx=0x7f27a80196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27ad600640 1 -- 172.21.15.37:0/3492747164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a80bc020 con 0x7f27b0163250 2024-05-30T07:01:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27ad600640 1 -- 172.21.15.37:0/3492747164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a80b8690 con 0x7f27b0163250 2024-05-30T07:01:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b8400640 1 -- 172.21.15.37:0/3492747164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b01624a0 con 0x7f27b0163250 2024-05-30T07:01:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27ad600640 1 -- 172.21.15.37:0/3492747164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a80b8a80 con 0x7f27b0163250 2024-05-30T07:01:19.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.800+0000 7f27b8400640 1 -- 172.21.15.37:0/3492747164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b015ab90 con 0x7f27b0163250 2024-05-30T07:01:19.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.804+0000 7f27b8400640 1 -- 172.21.15.37:0/3492747164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b0068bc0 con 0x7f27b0163250 2024-05-30T07:01:19.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.804+0000 7f27ad600640 1 -- 172.21.15.37:0/3492747164 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f27a80bf020 con 0x7f27b0163250 2024-05-30T07:01:19.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.804+0000 7f27ad600640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f279006a540 0x7f279006ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:19.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.804+0000 7f27ad600640 1 -- 172.21.15.37:0/3492747164 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f27a8120be0 con 0x7f27b0163250 2024-05-30T07:01:19.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.804+0000 7f27b5a00640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f279006a540 0x7f279006ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:19.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.804+0000 7f27b5a00640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f279006a540 0x7f279006ca00 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f27a4001710 tx=0x7f27a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:19.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.808+0000 7f27ad600640 1 -- 172.21.15.37:0/3492747164 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f27a80c6030 con 0x7f27b0163250 2024-05-30T07:01:19.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.972+0000 7f27b8400640 1 -- 172.21.15.37:0/3492747164 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f27b00b0a20 con 0x7f279006a540 2024-05-30T07:01:19.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.972+0000 7f27ad600640 1 -- 172.21.15.37:0/3492747164 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f27b00b0a20 con 0x7f279006a540 2024-05-30T07:01:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 6 to deep-scrub 2024-05-30T07:01:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.976+0000 7f27b8400640 1 -- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f279006a540 msgr2=0x7f279006ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.976+0000 7f27b8400640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f279006a540 0x7f279006ca00 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f27a4001710 tx=0x7f27a4009040 comp rx=0 tx=0).stop 2024-05-30T07:01:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.976+0000 7f27b8400640 1 -- 172.21.15.37:0/3492747164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b0163250 msgr2=0x7f27b015c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.976+0000 7f27b8400640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b0163250 0x7f27b015c960 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f27a8019540 tx=0x7f27a80196d0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.976+0000 7f27b8400640 1 -- 172.21.15.37:0/3492747164 shutdown_connections 2024-05-30T07:01:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.976+0000 7f27b8400640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b0163250 0x7f27b015c960 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.976+0000 7f27b8400640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f279006a540 0x7f279006ca00 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.976+0000 7f27b8400640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b0162e70 0x7f27b0159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.976+0000 7f27b8400640 1 --2- 172.21.15.37:0/3492747164 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27b00ce7d0 0x7f27b0144640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.976+0000 7f27b8400640 1 -- 172.21.15.37:0/3492747164 >> 172.21.15.37:0/3492747164 conn(0x7f27b006bf60 msgr2=0x7f27b00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.976+0000 7f27b8400640 1 -- 172.21.15.37:0/3492747164 shutdown_connections 2024-05-30T07:01:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:19.976+0000 7f27b8400640 1 -- 172.21.15.37:0/3492747164 wait complete. 2024-05-30T07:01:19.998 INFO:tasks.ceph:Scrubbing osd.7 2024-05-30T07:01:19.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-30T07:01:20.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.140+0000 7f9782000640 1 Processor -- start 2024-05-30T07:01:20.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.140+0000 7f9782000640 1 -- start start 2024-05-30T07:01:20.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.144+0000 7f9782000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f977c0b60e0 0x7f977c06ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.144+0000 7f9782000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f977c15db00 con 0x7f977c0ced10 2024-05-30T07:01:20.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.144+0000 7f9782000640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f977c06e180 con 0x7f977c15cdd0 2024-05-30T07:01:20.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.144+0000 7f9782000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f977c06df50 con 0x7f977c0b60e0 2024-05-30T07:01:20.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.144+0000 7f977b400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f977c0ced10 0x7f977c0b59d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56336/0 (socket says 172.21.15.37:56336) 2024-05-30T07:01:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.144+0000 7f9772a00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f977c0b60e0 0x7f977c06ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.144+0000 7f977b400640 1 -- 172.21.15.37:0/1332551310 learned_addr learned my addr 172.21.15.37:0/1332551310 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.144+0000 7f9772a00640 1 -- 172.21.15.37:0/1332551310 >> v1:172.21.15.105:6789/0 conn(0x7f977c15cdd0 legacy=0x7f977c15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.144+0000 7f9772a00640 1 -- 172.21.15.37:0/1332551310 >> v1:172.21.15.37:6789/0 conn(0x7f977c0ced10 legacy=0x7f977c0b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.144+0000 7f9772a00640 1 -- 172.21.15.37:0/1332551310 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977c06e460 con 0x7f977c0b60e0 2024-05-30T07:01:20.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.144+0000 7f977aa00640 1 -- 172.21.15.37:0/1332551310 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 207929438 0 0) 0x7f977c15db00 con 0x7f977c0ced10 2024-05-30T07:01:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.144+0000 7f9772a00640 1 --2- 172.21.15.37:0/1332551310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f977c0b60e0 0x7f977c06ec60 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f976c0097c0 tx=0x7f976c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502c116d39a92957 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f977aa00640 1 -- 172.21.15.37:0/1332551310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c0b0070 con 0x7f977c0b60e0 2024-05-30T07:01:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f977aa00640 1 -- 172.21.15.37:0/1332551310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f976c0ab600 con 0x7f977c0b60e0 2024-05-30T07:01:20.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f977aa00640 1 -- 172.21.15.37:0/1332551310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c0ab9d0 con 0x7f977c0b60e0 2024-05-30T07:01:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 -- 172.21.15.37:0/1332551310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f977c0b60e0 msgr2=0x7f977c06ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 --2- 172.21.15.37:0/1332551310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f977c0b60e0 0x7f977c06ec60 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f976c0097c0 tx=0x7f976c01c4a0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 -- 172.21.15.37:0/1332551310 shutdown_connections 2024-05-30T07:01:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 --2- 172.21.15.37:0/1332551310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f977c0b60e0 0x7f977c06ec60 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 -- 172.21.15.37:0/1332551310 >> 172.21.15.37:0/1332551310 conn(0x7f977c06bf60 msgr2=0x7f977c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 -- 172.21.15.37:0/1332551310 shutdown_connections 2024-05-30T07:01:20.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 -- 172.21.15.37:0/1332551310 wait complete. 2024-05-30T07:01:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 Processor -- start 2024-05-30T07:01:20.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 -- start start 2024-05-30T07:01:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f977c0b60e0 0x7f977c1614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f977c0ced10 0x7f977c153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f977c15cdd0 0x7f977c153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f977c15ea50 con 0x7f977c0b60e0 2024-05-30T07:01:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f977c15e8d0 con 0x7f977c15cdd0 2024-05-30T07:01:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9782000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f977c151070 con 0x7f977c0ced10 2024-05-30T07:01:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f977b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f977c0b60e0 0x7f977c1614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f977b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f977c0b60e0 0x7f977c1614a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43474/0 (socket says 172.21.15.37:43474) 2024-05-30T07:01:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f977b400640 1 -- 172.21.15.37:0/907855077 learned_addr learned my addr 172.21.15.37:0/907855077 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f9772a00640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f977c0ced10 0x7f977c153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f977be00640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f977c15cdd0 0x7f977c153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f977b400640 1 -- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f977c0ced10 msgr2=0x7f977c153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f977b400640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f977c0ced10 0x7f977c153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f977b400640 1 -- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f977c15cdd0 msgr2=0x7f977c153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f977b400640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f977c15cdd0 0x7f977c153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.148+0000 7f977b400640 1 -- 172.21.15.37:0/907855077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977c151350 con 0x7f977c0b60e0 2024-05-30T07:01:20.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f977b400640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f977c0b60e0 0x7f977c1614a0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f976400c4a0 tx=0x7f976400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f9773e00640 1 -- 172.21.15.37:0/907855077 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9764018070 con 0x7f977c0b60e0 2024-05-30T07:01:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f9773e00640 1 -- 172.21.15.37:0/907855077 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97640074e0 con 0x7f977c0b60e0 2024-05-30T07:01:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f9773e00640 1 -- 172.21.15.37:0/907855077 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9764004a30 con 0x7f977c0b60e0 2024-05-30T07:01:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f9782000640 1 -- 172.21.15.37:0/907855077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f977c151630 con 0x7f977c0b60e0 2024-05-30T07:01:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f9782000640 1 -- 172.21.15.37:0/907855077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f977c150be0 con 0x7f977c0b60e0 2024-05-30T07:01:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f9782000640 1 -- 172.21.15.37:0/907855077 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f977c068d40 con 0x7f977c0b60e0 2024-05-30T07:01:20.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f9773e00640 1 -- 172.21.15.37:0/907855077 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f976401b070 con 0x7f977c0b60e0 2024-05-30T07:01:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f9773e00640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f975806a540 0x7f975806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f9773e00640 1 -- 172.21.15.37:0/907855077 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f9764084d60 con 0x7f977c0b60e0 2024-05-30T07:01:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f9773e00640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] conn(0x7f97580728c0 0x7f9758074d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f9773e00640 1 -- 172.21.15.37:0/907855077 --> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f976401ee50 con 0x7f97580728c0 2024-05-30T07:01:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f9773e00640 1 -- 172.21.15.37:0/907855077 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=130) ==== 24+0+0 (secure 0 0 0) 0x7f9764091050 con 0x7f977c0b60e0 2024-05-30T07:01:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.152+0000 7f9772a00640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f975806a540 0x7f975806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.156+0000 7f977be00640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] conn(0x7f97580728c0 0x7f9758074d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.156+0000 7f9772a00640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f975806a540 0x7f975806ca00 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f976c0ad000 tx=0x7f976c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:20.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.156+0000 7f977be00640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] conn(0x7f97580728c0 0x7f9758074d60 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:20.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.156+0000 7f9773e00640 1 -- 172.21.15.37:0/907855077 <== osd.7 v2:172.21.15.105:6817/4038189667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f976401ee50 con 0x7f97580728c0 2024-05-30T07:01:20.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.168+0000 7f9782000640 1 -- 172.21.15.37:0/907855077 --> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f977c151d40 con 0x7f97580728c0 2024-05-30T07:01:20.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.168+0000 7f9773e00640 1 -- 172.21.15.37:0/907855077 <== osd.7 v2:172.21.15.105:6817/4038189667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f977c151d40 con 0x7f97580728c0 2024-05-30T07:01:20.172 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-05-30T07:01:20.172 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-30T07:01:20.173 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-05-30T07:01:20.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.168+0000 7f9782000640 1 -- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] conn(0x7f97580728c0 msgr2=0x7f9758074d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.168+0000 7f9782000640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:6817/4038189667,v1:172.21.15.105:6819/4038189667] conn(0x7f97580728c0 0x7f9758074d60 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.168+0000 7f9782000640 1 -- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f975806a540 msgr2=0x7f975806ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.168+0000 7f9782000640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f975806a540 0x7f975806ca00 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f976c0ad000 tx=0x7f976c008040 comp rx=0 tx=0).stop 2024-05-30T07:01:20.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.168+0000 7f9782000640 1 -- 172.21.15.37:0/907855077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f977c0b60e0 msgr2=0x7f977c1614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.168+0000 7f9782000640 1 --2- 172.21.15.37:0/907855077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f977c0b60e0 0x7f977c1614a0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f976400c4a0 tx=0x7f976400c960 comp rx=0 tx=0).stop 2024-05-30T07:01:20.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.168+0000 7f977be00640 1 -- 172.21.15.37:0/907855077 reap_dead start 2024-05-30T07:01:20.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.172+0000 7f9782000640 1 -- 172.21.15.37:0/907855077 shutdown_connections 2024-05-30T07:01:20.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.172+0000 7f9782000640 1 -- 172.21.15.37:0/907855077 >> 172.21.15.37:0/907855077 conn(0x7f977c06bf60 msgr2=0x7f977c15d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:20.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.172+0000 7f9782000640 1 -- 172.21.15.37:0/907855077 shutdown_connections 2024-05-30T07:01:20.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.172+0000 7f9782000640 1 -- 172.21.15.37:0/907855077 wait complete. 2024-05-30T07:01:20.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-30T07:01:20.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e7e00640 1 Processor -- start 2024-05-30T07:01:20.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e7e00640 1 -- start start 2024-05-30T07:01:20.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e7e00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa4e815eb00 0x7fa4e806b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e7e00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa4e80ccee0 0x7fa4e806bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e7e00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4e80cbe40 con 0x7fa4e80b0e50 2024-05-30T07:01:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e7e00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa4e80cc120 con 0x7fa4e80ccee0 2024-05-30T07:01:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e7e00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa4e80cc400 con 0x7fa4e815eb00 2024-05-30T07:01:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e6000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa4e80ccee0 0x7fa4e806bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e6000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa4e80ccee0 0x7fa4e806bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43478/0 (socket says 172.21.15.37:43478) 2024-05-30T07:01:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e6000640 1 -- 172.21.15.37:0/1580676846 learned_addr learned my addr 172.21.15.37:0/1580676846 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:20.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e6a00640 1 --2- 172.21.15.37:0/1580676846 >> v2:172.21.15.105:3300/0 conn(0x7fa4e815eb00 0x7fa4e806b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e6000640 1 -- 172.21.15.37:0/1580676846 >> v2:172.21.15.105:3300/0 conn(0x7fa4e815eb00 msgr2=0x7fa4e806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e6000640 1 --2- 172.21.15.37:0/1580676846 >> v2:172.21.15.105:3300/0 conn(0x7fa4e815eb00 0x7fa4e806b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e6000640 1 -- 172.21.15.37:0/1580676846 >> v1:172.21.15.105:6789/0 conn(0x7fa4e80b0e50 legacy=0x7fa4e80b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e6000640 1 -- 172.21.15.37:0/1580676846 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e80cc6e0 con 0x7fa4e80ccee0 2024-05-30T07:01:20.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.344+0000 7fa4e6a00640 1 --2- 172.21.15.37:0/1580676846 >> v2:172.21.15.105:3300/0 conn(0x7fa4e815eb00 0x7fa4e806b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.348+0000 7fa4e6000640 1 --2- 172.21.15.37:0/1580676846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80ccee0 0x7fa4e806bea0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80ceea0 tx=0x7fa4d401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862d96fe1d73f499 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:20.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.348+0000 7fa4e5600640 1 -- 172.21.15.37:0/1580676846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40b5070 con 0x7fa4e80ccee0 2024-05-30T07:01:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.348+0000 7fa4e5600640 1 -- 172.21.15.37:0/1580676846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d40a8a10 con 0x7fa4e80ccee0 2024-05-30T07:01:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.348+0000 7fa4e5600640 1 -- 172.21.15.37:0/1580676846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40a8de0 con 0x7fa4e80ccee0 2024-05-30T07:01:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.348+0000 7fa4e7e00640 1 -- 172.21.15.37:0/1580676846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80ccee0 msgr2=0x7fa4e806bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.348+0000 7fa4e7e00640 1 --2- 172.21.15.37:0/1580676846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80ccee0 0x7fa4e806bea0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80ceea0 tx=0x7fa4d401ed10 comp rx=0 tx=0).stop 2024-05-30T07:01:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.348+0000 7fa4e7e00640 1 -- 172.21.15.37:0/1580676846 shutdown_connections 2024-05-30T07:01:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.348+0000 7fa4e7e00640 1 --2- 172.21.15.37:0/1580676846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80ccee0 0x7fa4e806bea0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.348+0000 7fa4e7e00640 1 --2- 172.21.15.37:0/1580676846 >> v2:172.21.15.105:3300/0 conn(0x7fa4e815eb00 0x7fa4e806b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.348+0000 7fa4e7e00640 1 -- 172.21.15.37:0/1580676846 >> 172.21.15.37:0/1580676846 conn(0x7fa4e809aa60 msgr2=0x7fa4e80b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.348+0000 7fa4e7e00640 1 -- 172.21.15.37:0/1580676846 shutdown_connections 2024-05-30T07:01:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.348+0000 7fa4e7e00640 1 -- 172.21.15.37:0/1580676846 wait complete. 2024-05-30T07:01:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e7e00640 1 Processor -- start 2024-05-30T07:01:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e7e00640 1 -- start start 2024-05-30T07:01:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b0e50 0x7fa4e81f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e7e00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4e80ccee0 0x7fa4e80b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e7e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e815eb00 0x7fa4e815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e7e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e815eee0 con 0x7fa4e80b0e50 2024-05-30T07:01:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e7e00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e80cf1b0 con 0x7fa4e815eb00 2024-05-30T07:01:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e7e00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e80cba60 con 0x7fa4e80ccee0 2024-05-30T07:01:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b0e50 0x7fa4e81f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b0e50 0x7fa4e81f56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43494/0 (socket says 172.21.15.37:43494) 2024-05-30T07:01:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e6a00640 1 -- 172.21.15.37:0/4143750972 learned_addr learned my addr 172.21.15.37:0/4143750972 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e6000640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4e80ccee0 0x7fa4e80b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e7400640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e815eb00 0x7fa4e815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e6a00640 1 -- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4e80ccee0 msgr2=0x7fa4e80b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e6a00640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4e80ccee0 0x7fa4e80b61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e6a00640 1 -- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e815eb00 msgr2=0x7fa4e815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e6a00640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e815eb00 0x7fa4e815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e6a00640 1 -- 172.21.15.37:0/4143750972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e80c65c0 con 0x7fa4e80b0e50 2024-05-30T07:01:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e7400640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e815eb00 0x7fa4e815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e6000640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4e80ccee0 0x7fa4e80b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T07:01:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e6a00640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b0e50 0x7fa4e81f56b0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fa4d800e810 tx=0x7fa4d800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4df400640 1 -- 172.21.15.37:0/4143750972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8017070 con 0x7fa4e80b0e50 2024-05-30T07:01:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4df400640 1 -- 172.21.15.37:0/4143750972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d800c870 con 0x7fa4e80b0e50 2024-05-30T07:01:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e7e00640 1 -- 172.21.15.37:0/4143750972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e80c6860 con 0x7fa4e80b0e50 2024-05-30T07:01:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4df400640 1 -- 172.21.15.37:0/4143750972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d800f040 con 0x7fa4e80b0e50 2024-05-30T07:01:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.352+0000 7fa4e7e00640 1 -- 172.21.15.37:0/4143750972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e80c6e20 con 0x7fa4e80b0e50 2024-05-30T07:01:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.356+0000 7fa4e7e00640 1 -- 172.21.15.37:0/4143750972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e8068ab0 con 0x7fa4e80b0e50 2024-05-30T07:01:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.356+0000 7fa4df400640 1 -- 172.21.15.37:0/4143750972 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7fa4d801a070 con 0x7fa4e80b0e50 2024-05-30T07:01:20.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.356+0000 7fa4df400640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4c806a540 0x7fa4c806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.356+0000 7fa4df400640 1 -- 172.21.15.37:0/4143750972 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fa4d8085560 con 0x7fa4e80b0e50 2024-05-30T07:01:20.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.356+0000 7fa4e6000640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4c806a540 0x7fa4c806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.356+0000 7fa4e6000640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4c806a540 0x7fa4c806ca00 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40b2000 tx=0x7fa4d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.360+0000 7fa4df400640 1 -- 172.21.15.37:0/4143750972 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa4d8056fd0 con 0x7fa4e80b0e50 2024-05-30T07:01:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4e7e00640 1 -- 172.21.15.37:0/4143750972 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fa4e80b3680 con 0x7fa4c806a540 2024-05-30T07:01:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4df400640 1 -- 172.21.15.37:0/4143750972 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa4e80b3680 con 0x7fa4c806a540 2024-05-30T07:01:20.550 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 7 to deep-scrub 2024-05-30T07:01:20.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4e7e00640 1 -- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4c806a540 msgr2=0x7fa4c806ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4e7e00640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4c806a540 0x7fa4c806ca00 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40b2000 tx=0x7fa4d4009040 comp rx=0 tx=0).stop 2024-05-30T07:01:20.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4e7e00640 1 -- 172.21.15.37:0/4143750972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b0e50 msgr2=0x7fa4e81f56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4e7e00640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b0e50 0x7fa4e81f56b0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7fa4d800e810 tx=0x7fa4d800ecd0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4e7e00640 1 -- 172.21.15.37:0/4143750972 shutdown_connections 2024-05-30T07:01:20.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4e7e00640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fa4c806a540 0x7fa4c806ca00 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4e7e00640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4e815eb00 0x7fa4e815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4e7e00640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4e80ccee0 0x7fa4e80b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4e7e00640 1 --2- 172.21.15.37:0/4143750972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b0e50 0x7fa4e81f56b0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4e7e00640 1 -- 172.21.15.37:0/4143750972 >> 172.21.15.37:0/4143750972 conn(0x7fa4e809aa60 msgr2=0x7fa4e80b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:20.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4e7e00640 1 -- 172.21.15.37:0/4143750972 shutdown_connections 2024-05-30T07:01:20.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.548+0000 7fa4e7e00640 1 -- 172.21.15.37:0/4143750972 wait complete. 2024-05-30T07:01:20.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T07:01:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.728+0000 7f3f53000640 1 Processor -- start 2024-05-30T07:01:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.728+0000 7f3f53000640 1 -- start start 2024-05-30T07:01:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.732+0000 7f3f53000640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f4c0c8fc0 0x7f3f4c0d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.732+0000 7f3f53000640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3f4c09aa60 0x7f3f4c09aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.732+0000 7f3f53000640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f4c0c9450 con 0x7f3f4c15ed50 2024-05-30T07:01:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.732+0000 7f3f53000640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3f4c15f130 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.732+0000 7f3f53000640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3f4c0d0f00 con 0x7f3f4c09aa60 2024-05-30T07:01:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.732+0000 7f3f43400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f4c0c8fc0 0x7f3f4c0d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.732+0000 7f3f4be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3f4c15ed50 0x7f3f4c0d02b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56344/0 (socket says 172.21.15.37:56344) 2024-05-30T07:01:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.732+0000 7f3f4be00640 1 -- 172.21.15.37:0/2513797061 learned_addr learned my addr 172.21.15.37:0/2513797061 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.732+0000 7f3f51000640 1 --2- 172.21.15.37:0/2513797061 >> v2:172.21.15.105:3300/0 conn(0x7f3f4c09aa60 0x7f3f4c09aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.732+0000 7f3f43400640 1 -- 172.21.15.37:0/2513797061 >> v2:172.21.15.105:3300/0 conn(0x7f3f4c09aa60 msgr2=0x7f3f4c09aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.732+0000 7f3f43400640 1 --2- 172.21.15.37:0/2513797061 >> v2:172.21.15.105:3300/0 conn(0x7f3f4c09aa60 0x7f3f4c09aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.732+0000 7f3f43400640 1 -- 172.21.15.37:0/2513797061 >> v1:172.21.15.37:6789/0 conn(0x7f3f4c15ed50 legacy=0x7f3f4c0d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.732+0000 7f3f43400640 1 -- 172.21.15.37:0/2513797061 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c0c7f20 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f43400640 1 --2- 172.21.15.37:0/2513797061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0c8fc0 0x7f3f4c0d09c0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c073860 tx=0x7f3f3401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6157432fca9c6652 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f4b400640 1 -- 172.21.15.37:0/2513797061 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f340ab650 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f4b400640 1 -- 172.21.15.37:0/2513797061 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f340b0070 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f4b400640 1 -- 172.21.15.37:0/2513797061 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f340aba10 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 -- 172.21.15.37:0/2513797061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0c8fc0 msgr2=0x7f3f4c0d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 --2- 172.21.15.37:0/2513797061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0c8fc0 0x7f3f4c0d09c0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c073860 tx=0x7f3f3401c450 comp rx=0 tx=0).stop 2024-05-30T07:01:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 -- 172.21.15.37:0/2513797061 shutdown_connections 2024-05-30T07:01:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 --2- 172.21.15.37:0/2513797061 >> v2:172.21.15.105:3300/0 conn(0x7f3f4c09aa60 0x7f3f4c09aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 --2- 172.21.15.37:0/2513797061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0c8fc0 0x7f3f4c0d09c0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 -- 172.21.15.37:0/2513797061 >> 172.21.15.37:0/2513797061 conn(0x7f3f4c0d26e0 msgr2=0x7f3f4c0d2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 -- 172.21.15.37:0/2513797061 shutdown_connections 2024-05-30T07:01:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 -- 172.21.15.37:0/2513797061 wait complete. 2024-05-30T07:01:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 Processor -- start 2024-05-30T07:01:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 -- start start 2024-05-30T07:01:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f4c09aa60 0x7f3f4c09d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0c8fc0 0x7f3f4c0b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f4c15ed50 0x7f3f4c15fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c0c7ad0 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.736+0000 7f3f53000640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c0c8aa0 con 0x7f3f4c15ed50 2024-05-30T07:01:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f53000640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3f4c0c7c50 con 0x7f3f4c09aa60 2024-05-30T07:01:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f43400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0c8fc0 0x7f3f4c0b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f43400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0c8fc0 0x7f3f4c0b3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43516/0 (socket says 172.21.15.37:43516) 2024-05-30T07:01:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f43400640 1 -- 172.21.15.37:0/3303400566 learned_addr learned my addr 172.21.15.37:0/3303400566 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f4be00640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f4c09aa60 0x7f3f4c09d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f51000640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f4c15ed50 0x7f3f4c15fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f43400640 1 -- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f4c09aa60 msgr2=0x7f3f4c09d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f43400640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f4c09aa60 0x7f3f4c09d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f43400640 1 -- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f4c15ed50 msgr2=0x7f3f4c15fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f43400640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f4c15ed50 0x7f3f4c15fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f43400640 1 -- 172.21.15.37:0/3303400566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c0b4120 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f4be00640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f4c09aa60 0x7f3f4c09d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-30T07:01:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f43400640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0c8fc0 0x7f3f4c0b3be0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f3f340ad040 tx=0x7f3f3401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f48c00640 1 -- 172.21.15.37:0/3303400566 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f340bf610 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f48c00640 1 -- 172.21.15.37:0/3303400566 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f340bf7d0 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f53000640 1 -- 172.21.15.37:0/3303400566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c160510 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f48c00640 1 -- 172.21.15.37:0/3303400566 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f340bfbc0 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f53000640 1 -- 172.21.15.37:0/3303400566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c0b5430 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f53000640 1 -- 172.21.15.37:0/3303400566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4c068b20 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.740+0000 7f3f48c00640 1 -- 172.21.15.37:0/3303400566 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 51) ==== 91047+0+0 (secure 0 0 0) 0x7f3f340bd020 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.744+0000 7f3f48c00640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f2806a570 0x7f3f2806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.744+0000 7f3f48c00640 1 -- 172.21.15.37:0/3303400566 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f3f34120640 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.744+0000 7f3f4be00640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f2806a570 0x7f3f2806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.744+0000 7f3f4be00640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f2806a570 0x7f3f2806ca30 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c000f70 tx=0x7f3f3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:20.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.748+0000 7f3f48c00640 1 -- 172.21.15.37:0/3303400566 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3f34016070 con 0x7f3f4c0c8fc0 2024-05-30T07:01:20.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.912+0000 7f3f53000640 1 -- 172.21.15.37:0/3303400566 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3f4c0d3420 con 0x7f3f2806a570 2024-05-30T07:01:20.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.916+0000 7f3f48c00640 1 -- 172.21.15.37:0/3303400566 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253130 (secure 0 0 0) 0x7f3f4c0d3420 con 0x7f3f2806a570 2024-05-30T07:01:20.923 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:01:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T07:01:20.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.920+0000 7f3f53000640 1 -- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f2806a570 msgr2=0x7f3f2806ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.920+0000 7f3f53000640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f2806a570 0x7f3f2806ca30 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c000f70 tx=0x7f3f3c009040 comp rx=0 tx=0).stop 2024-05-30T07:01:20.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.920+0000 7f3f53000640 1 -- 172.21.15.37:0/3303400566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0c8fc0 msgr2=0x7f3f4c0b3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:20.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.920+0000 7f3f53000640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0c8fc0 0x7f3f4c0b3be0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f3f340ad040 tx=0x7f3f3401ac90 comp rx=0 tx=0).stop 2024-05-30T07:01:20.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.920+0000 7f3f53000640 1 -- 172.21.15.37:0/3303400566 shutdown_connections 2024-05-30T07:01:20.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.920+0000 7f3f53000640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f3f2806a570 0x7f3f2806ca30 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.920+0000 7f3f53000640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f4c15ed50 0x7f3f4c15fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.920+0000 7f3f53000640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0c8fc0 0x7f3f4c0b3be0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.920+0000 7f3f53000640 1 --2- 172.21.15.37:0/3303400566 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f4c09aa60 0x7f3f4c09d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:20.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.920+0000 7f3f53000640 1 -- 172.21.15.37:0/3303400566 >> 172.21.15.37:0/3303400566 conn(0x7f3f4c0d26e0 msgr2=0x7f3f4c15da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:20.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.920+0000 7f3f53000640 1 -- 172.21.15.37:0/3303400566 shutdown_connections 2024-05-30T07:01:20.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:20.920+0000 7f3f53000640 1 -- 172.21.15.37:0/3303400566 wait complete. 2024-05-30T07:01:20.943 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":703,"stamp":"2024-05-30T07:01:19.049058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16846623497,"num_objects":4050,"num_object_clones":1,"num_object_copies":8100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4050,"num_whiteouts":1,"num_read":4244,"num_read_kb":16560313,"num_write":6392,"num_write_kb":19599612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6817,"ondisk_log_size":6817,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":34039888,"kb_used_data":32916368,"kb_used_omap":12,"kb_used_meta":1123443,"kb_avail":720934832,"statfs":{"total":773094113280,"available":738237267968,"internally_reserved":0,"allocated":33706360832,"data_stored":33698968498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1150406192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003020"},"pg_stats":[{"pgid":"19.3f","version":"130'86","reported_seq":177,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:13.760246+0000","last_change":"2024-05-30T06:59:08.024160+0000","last_active":"2024-05-30T07:01:13.760246+0000","last_peered":"2024-05-30T07:01:13.760246+0000","last_clean":"2024-05-30T07:01:13.760246+0000","last_became_active":"2024-05-30T06:59:08.023564+0000","last_became_peered":"2024-05-30T06:59:08.023564+0000","last_unstale":"2024-05-30T07:01:13.760246+0000","last_undegraded":"2024-05-30T07:01:13.760246+0000","last_fullsized":"2024-05-30T07:01:13.760246+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":77,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"130'107","reported_seq":193,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:13.732018+0000","last_change":"2024-05-30T06:59:08.017254+0000","last_active":"2024-05-30T07:01:13.732018+0000","last_peered":"2024-05-30T07:01:13.732018+0000","last_clean":"2024-05-30T07:01:13.732018+0000","last_became_active":"2024-05-30T06:59:08.016947+0000","last_became_peered":"2024-05-30T06:59:08.016947+0000","last_unstale":"2024-05-30T07:01:13.732018+0000","last_undegraded":"2024-05-30T07:01:13.732018+0000","last_fullsized":"2024-05-30T07:01:13.732018+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":93,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"130'108","reported_seq":193,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.729377+0000","last_change":"2024-05-30T06:59:08.031486+0000","last_active":"2024-05-30T07:01:12.729377+0000","last_peered":"2024-05-30T07:01:12.729377+0000","last_clean":"2024-05-30T07:01:12.729377+0000","last_became_active":"2024-05-30T06:59:08.030677+0000","last_became_peered":"2024-05-30T06:59:08.030677+0000","last_unstale":"2024-05-30T07:01:12.729377+0000","last_undegraded":"2024-05-30T07:01:12.729377+0000","last_fullsized":"2024-05-30T07:01:12.729377+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:59:41.592123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":68,"num_read_kb":262148,"num_write":100,"num_write_kb":323587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"130'90","reported_seq":150,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.729994+0000","last_change":"2024-05-30T06:59:55.853693+0000","last_active":"2024-05-30T07:01:12.729994+0000","last_peered":"2024-05-30T07:01:12.729994+0000","last_clean":"2024-05-30T07:01:12.729994+0000","last_became_active":"2024-05-30T06:59:54.418117+0000","last_became_peered":"2024-05-30T06:59:54.418117+0000","last_unstale":"2024-05-30T07:01:12.729994+0000","last_undegraded":"2024-05-30T07:01:12.729994+0000","last_fullsized":"2024-05-30T07:01:12.729994+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":176129,"num_write":83,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3b","version":"130'72","reported_seq":129,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.706135+0000","last_change":"2024-05-30T06:59:08.046184+0000","last_active":"2024-05-30T07:01:12.706135+0000","last_peered":"2024-05-30T07:01:12.706135+0000","last_clean":"2024-05-30T07:01:12.706135+0000","last_became_active":"2024-05-30T06:59:08.045942+0000","last_became_peered":"2024-05-30T06:59:08.045942+0000","last_unstale":"2024-05-30T07:01:12.706135+0000","last_undegraded":"2024-05-30T07:01:12.706135+0000","last_fullsized":"2024-05-30T07:01:12.706135+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:27:44.098848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":41,"num_read_kb":167936,"num_write":68,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"130'108","reported_seq":210,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.724307+0000","last_change":"2024-05-30T06:59:08.029771+0000","last_active":"2024-05-30T07:01:12.724307+0000","last_peered":"2024-05-30T07:01:12.724307+0000","last_clean":"2024-05-30T07:01:12.724307+0000","last_became_active":"2024-05-30T06:59:08.029463+0000","last_became_peered":"2024-05-30T06:59:08.029463+0000","last_unstale":"2024-05-30T07:01:12.724307+0000","last_undegraded":"2024-05-30T07:01:12.724307+0000","last_fullsized":"2024-05-30T07:01:12.724307+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:13.314661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":99,"num_write_kb":344065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"130'89","reported_seq":153,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.731583+0000","last_change":"2024-05-30T06:59:08.035845+0000","last_active":"2024-05-30T07:01:12.731583+0000","last_peered":"2024-05-30T07:01:12.731583+0000","last_clean":"2024-05-30T07:01:12.731583+0000","last_became_active":"2024-05-30T06:59:08.035526+0000","last_became_peered":"2024-05-30T06:59:08.035526+0000","last_unstale":"2024-05-30T07:01:12.731583+0000","last_undegraded":"2024-05-30T07:01:12.731583+0000","last_fullsized":"2024-05-30T07:01:12.731583+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:19:00.334786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":48,"num_read_kb":196608,"num_write":75,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"130'95","reported_seq":164,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.724362+0000","last_change":"2024-05-30T06:59:08.035483+0000","last_active":"2024-05-30T07:01:12.724362+0000","last_peered":"2024-05-30T07:01:12.724362+0000","last_clean":"2024-05-30T07:01:12.724362+0000","last_became_active":"2024-05-30T06:59:08.034842+0000","last_became_peered":"2024-05-30T06:59:08.034842+0000","last_unstale":"2024-05-30T07:01:12.724362+0000","last_undegraded":"2024-05-30T07:01:12.724362+0000","last_fullsized":"2024-05-30T07:01:12.724362+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:07:18.302784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":53,"num_read_kb":217088,"num_write":88,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"130'97","reported_seq":165,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.721187+0000","last_change":"2024-05-30T06:59:08.044693+0000","last_active":"2024-05-30T07:01:12.721187+0000","last_peered":"2024-05-30T07:01:12.721187+0000","last_clean":"2024-05-30T07:01:12.721187+0000","last_became_active":"2024-05-30T06:59:08.044276+0000","last_became_peered":"2024-05-30T06:59:08.044276+0000","last_unstale":"2024-05-30T07:01:12.721187+0000","last_undegraded":"2024-05-30T07:01:12.721187+0000","last_fullsized":"2024-05-30T07:01:12.721187+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:14:17.604408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269764,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":52,"num_read_kb":208897,"num_write":89,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"130'71","reported_seq":151,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.716122+0000","last_change":"2024-05-30T06:59:08.016455+0000","last_active":"2024-05-30T07:01:12.716122+0000","last_peered":"2024-05-30T07:01:12.716122+0000","last_clean":"2024-05-30T07:01:12.716122+0000","last_became_active":"2024-05-30T06:59:08.016161+0000","last_became_peered":"2024-05-30T06:59:08.016161+0000","last_unstale":"2024-05-30T07:01:12.716122+0000","last_undegraded":"2024-05-30T07:01:12.716122+0000","last_fullsized":"2024-05-30T07:01:12.716122+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":65,"num_write_kb":225280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"130'109","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.714467+0000","last_change":"2024-05-30T06:59:08.022034+0000","last_active":"2024-05-30T07:01:12.714467+0000","last_peered":"2024-05-30T07:01:12.714467+0000","last_clean":"2024-05-30T07:01:12.714467+0000","last_became_active":"2024-05-30T06:59:08.021772+0000","last_became_peered":"2024-05-30T06:59:08.021772+0000","last_unstale":"2024-05-30T07:01:12.714467+0000","last_undegraded":"2024-05-30T07:01:12.714467+0000","last_fullsized":"2024-05-30T07:01:12.714467+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":100,"num_read_kb":409600,"num_write":100,"num_write_kb":356352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"130'83","reported_seq":197,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.709370+0000","last_change":"2024-05-30T06:59:08.044094+0000","last_active":"2024-05-30T07:01:12.709370+0000","last_peered":"2024-05-30T07:01:12.709370+0000","last_clean":"2024-05-30T07:01:12.709370+0000","last_became_active":"2024-05-30T06:59:08.043835+0000","last_became_peered":"2024-05-30T06:59:08.043835+0000","last_unstale":"2024-05-30T07:01:12.709370+0000","last_undegraded":"2024-05-30T07:01:12.709370+0000","last_fullsized":"2024-05-30T07:01:12.709370+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:16:54.524337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":98,"num_read_kb":385028,"num_write":80,"num_write_kb":278529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"130'89","reported_seq":190,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.729311+0000","last_change":"2024-05-30T06:59:08.025217+0000","last_active":"2024-05-30T07:01:12.729311+0000","last_peered":"2024-05-30T07:01:12.729311+0000","last_clean":"2024-05-30T07:01:12.729311+0000","last_became_active":"2024-05-30T06:59:08.024478+0000","last_became_peered":"2024-05-30T06:59:08.024478+0000","last_unstale":"2024-05-30T07:01:12.729311+0000","last_undegraded":"2024-05-30T07:01:12.729311+0000","last_fullsized":"2024-05-30T07:01:12.729311+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":84,"num_read_kb":335874,"num_write":84,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"130'91","reported_seq":171,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.714566+0000","last_change":"2024-05-30T06:59:08.022376+0000","last_active":"2024-05-30T07:01:12.714566+0000","last_peered":"2024-05-30T07:01:12.714566+0000","last_clean":"2024-05-30T07:01:12.714566+0000","last_became_active":"2024-05-30T06:59:08.022058+0000","last_became_peered":"2024-05-30T06:59:08.022058+0000","last_unstale":"2024-05-30T07:01:12.714566+0000","last_undegraded":"2024-05-30T07:01:12.714566+0000","last_fullsized":"2024-05-30T07:01:12.714566+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":63,"num_read_kb":249858,"num_write":83,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"130'84","reported_seq":132,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.727998+0000","last_change":"2024-05-30T06:59:08.027564+0000","last_active":"2024-05-30T07:01:12.727998+0000","last_peered":"2024-05-30T07:01:12.727998+0000","last_clean":"2024-05-30T07:01:12.727998+0000","last_became_active":"2024-05-30T06:59:08.027303+0000","last_became_peered":"2024-05-30T06:59:08.027303+0000","last_unstale":"2024-05-30T07:01:12.727998+0000","last_undegraded":"2024-05-30T07:01:12.727998+0000","last_fullsized":"2024-05-30T07:01:12.727998+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":31,"num_read_kb":126976,"num_write":75,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"130'91","reported_seq":160,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.712751+0000","last_change":"2024-05-30T06:59:08.023401+0000","last_active":"2024-05-30T07:01:12.712751+0000","last_peered":"2024-05-30T07:01:12.712751+0000","last_clean":"2024-05-30T07:01:12.712751+0000","last_became_active":"2024-05-30T06:59:08.022914+0000","last_became_peered":"2024-05-30T06:59:08.022914+0000","last_unstale":"2024-05-30T07:01:12.712751+0000","last_undegraded":"2024-05-30T07:01:12.712751+0000","last_fullsized":"2024-05-30T07:01:12.712751+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":52,"num_read_kb":212992,"num_write":84,"num_write_kb":278528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"130'78","reported_seq":137,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.720422+0000","last_change":"2024-05-30T06:59:08.024708+0000","last_active":"2024-05-30T07:01:12.720422+0000","last_peered":"2024-05-30T07:01:12.720422+0000","last_clean":"2024-05-30T07:01:12.720422+0000","last_became_active":"2024-05-30T06:59:08.024445+0000","last_became_peered":"2024-05-30T06:59:08.024445+0000","last_unstale":"2024-05-30T07:01:12.720422+0000","last_undegraded":"2024-05-30T07:01:12.720422+0000","last_fullsized":"2024-05-30T07:01:12.720422+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:47:16.008019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":176128,"num_write":72,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"130'105","reported_seq":211,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.725980+0000","last_change":"2024-05-30T06:59:08.023258+0000","last_active":"2024-05-30T07:01:12.725980+0000","last_peered":"2024-05-30T07:01:12.725980+0000","last_clean":"2024-05-30T07:01:12.725980+0000","last_became_active":"2024-05-30T06:59:08.017709+0000","last_became_peered":"2024-05-30T06:59:08.017709+0000","last_unstale":"2024-05-30T07:01:12.725980+0000","last_undegraded":"2024-05-30T07:01:12.725980+0000","last_fullsized":"2024-05-30T07:01:12.725980+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":89,"num_read_kb":364544,"num_write":94,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"130'101","reported_seq":189,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.724493+0000","last_change":"2024-05-30T06:59:08.026237+0000","last_active":"2024-05-30T07:01:12.724493+0000","last_peered":"2024-05-30T07:01:12.724493+0000","last_clean":"2024-05-30T07:01:12.724493+0000","last_became_active":"2024-05-30T06:59:08.025981+0000","last_became_peered":"2024-05-30T06:59:08.025981+0000","last_unstale":"2024-05-30T07:01:12.724493+0000","last_undegraded":"2024-05-30T07:01:12.724493+0000","last_fullsized":"2024-05-30T07:01:12.724493+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":71,"num_read_kb":278531,"num_write":94,"num_write_kb":335873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"130'95","reported_seq":173,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.716950+0000","last_change":"2024-05-30T06:59:08.018790+0000","last_active":"2024-05-30T07:01:12.716950+0000","last_peered":"2024-05-30T07:01:12.716950+0000","last_clean":"2024-05-30T07:01:12.716950+0000","last_became_active":"2024-05-30T06:59:08.015033+0000","last_became_peered":"2024-05-30T06:59:08.015033+0000","last_unstale":"2024-05-30T07:01:12.716950+0000","last_undegraded":"2024-05-30T07:01:12.716950+0000","last_fullsized":"2024-05-30T07:01:12.716950+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":61,"num_read_kb":241666,"num_write":83,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"130'110","reported_seq":217,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.733884+0000","last_change":"2024-05-30T06:59:08.046183+0000","last_active":"2024-05-30T07:01:12.733884+0000","last_peered":"2024-05-30T07:01:12.733884+0000","last_clean":"2024-05-30T07:01:12.733884+0000","last_became_active":"2024-05-30T06:59:08.045891+0000","last_became_peered":"2024-05-30T06:59:08.045891+0000","last_unstale":"2024-05-30T07:01:12.733884+0000","last_undegraded":"2024-05-30T07:01:12.733884+0000","last_fullsized":"2024-05-30T07:01:12.733884+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:52:32.696164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":91,"num_read_kb":368641,"num_write":100,"num_write_kb":344066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"130'89","reported_seq":162,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.713138+0000","last_change":"2024-05-30T06:59:08.019956+0000","last_active":"2024-05-30T07:01:12.713138+0000","last_peered":"2024-05-30T07:01:12.713138+0000","last_clean":"2024-05-30T07:01:12.713138+0000","last_became_active":"2024-05-30T06:59:08.019670+0000","last_became_peered":"2024-05-30T06:59:08.019670+0000","last_unstale":"2024-05-30T07:01:12.713138+0000","last_undegraded":"2024-05-30T07:01:12.713138+0000","last_fullsized":"2024-05-30T07:01:12.713138+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":56,"num_read_kb":225281,"num_write":82,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"130'106","reported_seq":177,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.727834+0000","last_change":"2024-05-30T06:59:08.044096+0000","last_active":"2024-05-30T07:01:12.727834+0000","last_peered":"2024-05-30T07:01:12.727834+0000","last_clean":"2024-05-30T07:01:12.727834+0000","last_became_active":"2024-05-30T06:59:08.043786+0000","last_became_peered":"2024-05-30T06:59:08.043786+0000","last_unstale":"2024-05-30T07:01:12.727834+0000","last_undegraded":"2024-05-30T07:01:12.727834+0000","last_fullsized":"2024-05-30T07:01:12.727834+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:51:04.988561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":97,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"130'93","reported_seq":167,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:16.723172+0000","last_change":"2024-05-30T06:59:08.022594+0000","last_active":"2024-05-30T07:01:16.723172+0000","last_peered":"2024-05-30T07:01:16.723172+0000","last_clean":"2024-05-30T07:01:16.723172+0000","last_became_active":"2024-05-30T06:59:08.022293+0000","last_became_peered":"2024-05-30T06:59:08.022293+0000","last_unstale":"2024-05-30T07:01:16.723172+0000","last_undegraded":"2024-05-30T07:01:16.723172+0000","last_fullsized":"2024-05-30T07:01:16.723172+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":56,"num_read_kb":212996,"num_write":85,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"130'102","reported_seq":184,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:17.262816+0000","last_change":"2024-05-30T06:59:08.038685+0000","last_active":"2024-05-30T07:01:17.262816+0000","last_peered":"2024-05-30T07:01:17.262816+0000","last_clean":"2024-05-30T07:01:17.262816+0000","last_became_active":"2024-05-30T06:59:08.038414+0000","last_became_peered":"2024-05-30T06:59:08.038414+0000","last_unstale":"2024-05-30T07:01:17.262816+0000","last_undegraded":"2024-05-30T07:01:17.262816+0000","last_fullsized":"2024-05-30T07:01:17.262816+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":64,"num_read_kb":258049,"num_write":92,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"130'92","reported_seq":220,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:18.356593+0000","last_change":"2024-05-30T06:59:56.500807+0000","last_active":"2024-05-30T07:01:18.356593+0000","last_peered":"2024-05-30T07:01:18.356593+0000","last_clean":"2024-05-30T07:01:18.356593+0000","last_became_active":"2024-05-30T06:59:54.423066+0000","last_became_peered":"2024-05-30T06:59:54.423066+0000","last_unstale":"2024-05-30T07:01:18.356593+0000","last_undegraded":"2024-05-30T07:01:18.356593+0000","last_fullsized":"2024-05-30T07:01:18.356593+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":83,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"130'101","reported_seq":184,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:17.801494+0000","last_change":"2024-05-30T06:59:08.024951+0000","last_active":"2024-05-30T07:01:17.801494+0000","last_peered":"2024-05-30T07:01:17.801494+0000","last_clean":"2024-05-30T07:01:17.801494+0000","last_became_active":"2024-05-30T06:59:08.024354+0000","last_became_peered":"2024-05-30T06:59:08.024354+0000","last_unstale":"2024-05-30T07:01:17.801494+0000","last_undegraded":"2024-05-30T07:01:17.801494+0000","last_fullsized":"2024-05-30T07:01:17.801494+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":96,"num_write_kb":331776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"130'95","reported_seq":145,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.714535+0000","last_change":"2024-05-30T06:59:08.033925+0000","last_active":"2024-05-30T07:01:12.714535+0000","last_peered":"2024-05-30T07:01:12.714535+0000","last_clean":"2024-05-30T07:01:12.714535+0000","last_became_active":"2024-05-30T06:59:08.033552+0000","last_became_peered":"2024-05-30T06:59:08.033552+0000","last_unstale":"2024-05-30T07:01:12.714535+0000","last_undegraded":"2024-05-30T07:01:12.714535+0000","last_fullsized":"2024-05-30T07:01:12.714535+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:15:35.587906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":33,"num_read_kb":135168,"num_write":90,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"130'104","reported_seq":192,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:13.760226+0000","last_change":"2024-05-30T06:59:08.033338+0000","last_active":"2024-05-30T07:01:13.760226+0000","last_peered":"2024-05-30T07:01:13.760226+0000","last_clean":"2024-05-30T07:01:13.760226+0000","last_became_active":"2024-05-30T06:59:08.032376+0000","last_became_peered":"2024-05-30T06:59:08.032376+0000","last_unstale":"2024-05-30T07:01:13.760226+0000","last_undegraded":"2024-05-30T07:01:13.760226+0000","last_fullsized":"2024-05-30T07:01:13.760226+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":70,"num_read_kb":286720,"num_write":97,"num_write_kb":323585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"130'103","reported_seq":185,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:13.760201+0000","last_change":"2024-05-30T06:59:08.032860+0000","last_active":"2024-05-30T07:01:13.760201+0000","last_peered":"2024-05-30T07:01:13.760201+0000","last_clean":"2024-05-30T07:01:13.760201+0000","last_became_active":"2024-05-30T06:59:08.032457+0000","last_became_peered":"2024-05-30T06:59:08.032457+0000","last_unstale":"2024-05-30T07:01:13.760201+0000","last_undegraded":"2024-05-30T07:01:13.760201+0000","last_fullsized":"2024-05-30T07:01:13.760201+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":92,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"130'93","reported_seq":203,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.733675+0000","last_change":"2024-05-30T06:59:08.039799+0000","last_active":"2024-05-30T07:01:12.733675+0000","last_peered":"2024-05-30T07:01:12.733675+0000","last_clean":"2024-05-30T07:01:12.733675+0000","last_became_active":"2024-05-30T06:59:08.039524+0000","last_became_peered":"2024-05-30T06:59:08.039524+0000","last_unstale":"2024-05-30T07:01:12.733675+0000","last_undegraded":"2024-05-30T07:01:12.733675+0000","last_fullsized":"2024-05-30T07:01:12.733675+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:32:19.058834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":93,"num_read_kb":380928,"num_write":82,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"130'97","reported_seq":187,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.728240+0000","last_change":"2024-05-30T06:59:08.025201+0000","last_active":"2024-05-30T07:01:12.728240+0000","last_peered":"2024-05-30T07:01:12.728240+0000","last_clean":"2024-05-30T07:01:12.728240+0000","last_became_active":"2024-05-30T06:59:08.023719+0000","last_became_peered":"2024-05-30T06:59:08.023719+0000","last_unstale":"2024-05-30T07:01:12.728240+0000","last_undegraded":"2024-05-30T07:01:12.728240+0000","last_fullsized":"2024-05-30T07:01:12.728240+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:51.605688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":73,"num_read_kb":290818,"num_write":87,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"130'75","reported_seq":137,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.715214+0000","last_change":"2024-05-30T06:59:08.022581+0000","last_active":"2024-05-30T07:01:12.715214+0000","last_peered":"2024-05-30T07:01:12.715214+0000","last_clean":"2024-05-30T07:01:12.715214+0000","last_became_active":"2024-05-30T06:59:08.017322+0000","last_became_peered":"2024-05-30T06:59:08.017322+0000","last_unstale":"2024-05-30T07:01:12.715214+0000","last_undegraded":"2024-05-30T07:01:12.715214+0000","last_fullsized":"2024-05-30T07:01:12.715214+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192938245,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":44,"num_read_kb":180224,"num_write":71,"num_write_kb":237569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"127'4","reported_seq":23,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.420040+0000","last_change":"2024-05-30T06:59:07.025645+0000","last_active":"2024-05-30T06:59:54.420040+0000","last_peered":"2024-05-30T06:59:54.420040+0000","last_clean":"2024-05-30T06:59:54.420040+0000","last_became_active":"2024-05-30T06:59:07.025401+0000","last_became_peered":"2024-05-30T06:59:07.025401+0000","last_unstale":"2024-05-30T06:59:54.420040+0000","last_undegraded":"2024-05-30T06:59:54.420040+0000","last_fullsized":"2024-05-30T06:59:54.420040+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:46:12.308444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"130'105","reported_seq":191,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.726787+0000","last_change":"2024-05-30T06:59:08.037515+0000","last_active":"2024-05-30T07:01:12.726787+0000","last_peered":"2024-05-30T07:01:12.726787+0000","last_clean":"2024-05-30T07:01:12.726787+0000","last_became_active":"2024-05-30T06:59:08.037242+0000","last_became_peered":"2024-05-30T06:59:08.037242+0000","last_unstale":"2024-05-30T07:01:12.726787+0000","last_undegraded":"2024-05-30T07:01:12.726787+0000","last_fullsized":"2024-05-30T07:01:12.726787+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:21:24.557259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":69,"num_read_kb":266244,"num_write":96,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"127'1","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418391+0000","last_change":"2024-05-30T06:59:07.028000+0000","last_active":"2024-05-30T06:59:54.418391+0000","last_peered":"2024-05-30T06:59:54.418391+0000","last_clean":"2024-05-30T06:59:54.418391+0000","last_became_active":"2024-05-30T06:59:07.027686+0000","last_became_peered":"2024-05-30T06:59:07.027686+0000","last_unstale":"2024-05-30T06:59:54.418391+0000","last_undegraded":"2024-05-30T06:59:54.418391+0000","last_fullsized":"2024-05-30T06:59:54.418391+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:22:41.838812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"130'95","reported_seq":181,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.731127+0000","last_change":"2024-05-30T06:59:08.039191+0000","last_active":"2024-05-30T07:01:12.731127+0000","last_peered":"2024-05-30T07:01:12.731127+0000","last_clean":"2024-05-30T07:01:12.731127+0000","last_became_active":"2024-05-30T06:59:08.038891+0000","last_became_peered":"2024-05-30T06:59:08.038891+0000","last_unstale":"2024-05-30T07:01:12.731127+0000","last_undegraded":"2024-05-30T07:01:12.731127+0000","last_fullsized":"2024-05-30T07:01:12.731127+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:08:22.095245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075589,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":70,"num_read_kb":278530,"num_write":88,"num_write_kb":290818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"128'3","reported_seq":22,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414459+0000","last_change":"2024-05-30T06:59:07.021128+0000","last_active":"2024-05-30T06:59:54.414459+0000","last_peered":"2024-05-30T06:59:54.414459+0000","last_clean":"2024-05-30T06:59:54.414459+0000","last_became_active":"2024-05-30T06:59:07.020820+0000","last_became_peered":"2024-05-30T06:59:07.020820+0000","last_unstale":"2024-05-30T06:59:54.414459+0000","last_undegraded":"2024-05-30T06:59:54.414459+0000","last_fullsized":"2024-05-30T06:59:54.414459+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"130'122","reported_seq":225,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.733414+0000","last_change":"2024-05-30T06:59:08.033837+0000","last_active":"2024-05-30T07:01:12.733414+0000","last_peered":"2024-05-30T07:01:12.733414+0000","last_clean":"2024-05-30T07:01:12.733414+0000","last_became_active":"2024-05-30T06:59:08.033506+0000","last_became_peered":"2024-05-30T06:59:08.033506+0000","last_unstale":"2024-05-30T07:01:12.733414+0000","last_undegraded":"2024-05-30T07:01:12.733414+0000","last_fullsized":"2024-05-30T07:01:12.733414+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:41:37.594639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":87,"num_read_kb":356352,"num_write":111,"num_write_kb":364544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"127'2","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.485401+0000","last_change":"2024-05-30T06:59:07.025478+0000","last_active":"2024-05-30T06:59:54.485401+0000","last_peered":"2024-05-30T06:59:54.485401+0000","last_clean":"2024-05-30T06:59:54.485401+0000","last_became_active":"2024-05-30T06:59:07.025201+0000","last_became_peered":"2024-05-30T06:59:07.025201+0000","last_unstale":"2024-05-30T06:59:54.485401+0000","last_undegraded":"2024-05-30T06:59:54.485401+0000","last_fullsized":"2024-05-30T06:59:54.485401+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"130'98","reported_seq":170,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.725299+0000","last_change":"2024-05-30T06:59:08.022157+0000","last_active":"2024-05-30T07:01:12.725299+0000","last_peered":"2024-05-30T07:01:12.725299+0000","last_clean":"2024-05-30T07:01:12.725299+0000","last_became_active":"2024-05-30T06:59:08.017121+0000","last_became_peered":"2024-05-30T06:59:08.017121+0000","last_unstale":"2024-05-30T07:01:12.725299+0000","last_undegraded":"2024-05-30T07:01:12.725299+0000","last_fullsized":"2024-05-30T07:01:12.725299+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":91,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"127'1","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.484935+0000","last_change":"2024-05-30T06:59:07.026285+0000","last_active":"2024-05-30T06:59:54.484935+0000","last_peered":"2024-05-30T06:59:54.484935+0000","last_clean":"2024-05-30T06:59:54.484935+0000","last_became_active":"2024-05-30T06:59:07.025467+0000","last_became_peered":"2024-05-30T06:59:07.025467+0000","last_unstale":"2024-05-30T06:59:54.484935+0000","last_undegraded":"2024-05-30T06:59:54.484935+0000","last_fullsized":"2024-05-30T06:59:54.484935+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"130'101","reported_seq":208,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.731235+0000","last_change":"2024-05-30T06:59:08.022678+0000","last_active":"2024-05-30T07:01:12.731235+0000","last_peered":"2024-05-30T07:01:12.731235+0000","last_clean":"2024-05-30T07:01:12.731235+0000","last_became_active":"2024-05-30T06:59:08.022387+0000","last_became_peered":"2024-05-30T06:59:08.022387+0000","last_unstale":"2024-05-30T07:01:12.731235+0000","last_undegraded":"2024-05-30T07:01:12.731235+0000","last_fullsized":"2024-05-30T07:01:12.731235+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:30:30.629687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":91,"num_read_kb":372736,"num_write":89,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"127'1","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417999+0000","last_change":"2024-05-30T06:59:07.020549+0000","last_active":"2024-05-30T06:59:54.417999+0000","last_peered":"2024-05-30T06:59:54.417999+0000","last_clean":"2024-05-30T06:59:54.417999+0000","last_became_active":"2024-05-30T06:59:07.020278+0000","last_became_peered":"2024-05-30T06:59:07.020278+0000","last_unstale":"2024-05-30T06:59:54.417999+0000","last_undegraded":"2024-05-30T06:59:54.417999+0000","last_fullsized":"2024-05-30T06:59:54.417999+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"130'89","reported_seq":175,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.723509+0000","last_change":"2024-05-30T06:59:08.035741+0000","last_active":"2024-05-30T07:01:12.723509+0000","last_peered":"2024-05-30T07:01:12.723509+0000","last_clean":"2024-05-30T07:01:12.723509+0000","last_became_active":"2024-05-30T06:59:08.035015+0000","last_became_peered":"2024-05-30T06:59:08.035015+0000","last_unstale":"2024-05-30T07:01:12.723509+0000","last_undegraded":"2024-05-30T07:01:12.723509+0000","last_fullsized":"2024-05-30T07:01:12.723509+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:31:05.904917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":70,"num_read_kb":286720,"num_write":82,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417507+0000","last_change":"2024-05-30T06:59:07.015142+0000","last_active":"2024-05-30T06:59:54.417507+0000","last_peered":"2024-05-30T06:59:54.417507+0000","last_clean":"2024-05-30T06:59:54.417507+0000","last_became_active":"2024-05-30T06:59:07.013998+0000","last_became_peered":"2024-05-30T06:59:07.013998+0000","last_unstale":"2024-05-30T06:59:54.417507+0000","last_undegraded":"2024-05-30T06:59:54.417507+0000","last_fullsized":"2024-05-30T06:59:54.417507+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:07:17.296567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"130'95","reported_seq":176,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.715653+0000","last_change":"2024-05-30T06:59:08.012136+0000","last_active":"2024-05-30T07:01:12.715653+0000","last_peered":"2024-05-30T07:01:12.715653+0000","last_clean":"2024-05-30T07:01:12.715653+0000","last_became_active":"2024-05-30T06:59:08.011821+0000","last_became_peered":"2024-05-30T06:59:08.011821+0000","last_unstale":"2024-05-30T07:01:12.715653+0000","last_undegraded":"2024-05-30T07:01:12.715653+0000","last_fullsized":"2024-05-30T07:01:12.715653+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":85,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":27,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:17.584010+0000","last_change":"2024-05-30T07:01:17.584030+0000","last_active":"2024-05-30T07:01:17.584010+0000","last_peered":"2024-05-30T07:01:17.584010+0000","last_clean":"2024-05-30T07:01:17.584010+0000","last_became_active":"2024-05-30T06:59:07.017948+0000","last_became_peered":"2024-05-30T06:59:07.017948+0000","last_unstale":"2024-05-30T07:01:17.584010+0000","last_undegraded":"2024-05-30T07:01:17.584010+0000","last_fullsized":"2024-05-30T07:01:17.584010+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:17.583932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:17.583932+0000","last_clean_scrub_stamp":"2024-05-30T07:01:17.583932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:49:26.605633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"130'85","reported_seq":138,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.716831+0000","last_change":"2024-05-30T06:59:08.024166+0000","last_active":"2024-05-30T07:01:12.716831+0000","last_peered":"2024-05-30T07:01:12.716831+0000","last_clean":"2024-05-30T07:01:12.716831+0000","last_became_active":"2024-05-30T06:59:08.023873+0000","last_became_peered":"2024-05-30T06:59:08.023873+0000","last_unstale":"2024-05-30T07:01:12.716831+0000","last_undegraded":"2024-05-30T07:01:12.716831+0000","last_fullsized":"2024-05-30T07:01:12.716831+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":74,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"128'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418561+0000","last_change":"2024-05-30T06:59:07.024511+0000","last_active":"2024-05-30T06:59:54.418561+0000","last_peered":"2024-05-30T06:59:54.418561+0000","last_clean":"2024-05-30T06:59:54.418561+0000","last_became_active":"2024-05-30T06:59:07.024244+0000","last_became_peered":"2024-05-30T06:59:07.024244+0000","last_unstale":"2024-05-30T06:59:54.418561+0000","last_undegraded":"2024-05-30T06:59:54.418561+0000","last_fullsized":"2024-05-30T06:59:54.418561+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:39:55.760340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"130'79","reported_seq":135,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.704532+0000","last_change":"2024-05-30T06:59:08.025397+0000","last_active":"2024-05-30T07:01:12.704532+0000","last_peered":"2024-05-30T07:01:12.704532+0000","last_clean":"2024-05-30T07:01:12.704532+0000","last_became_active":"2024-05-30T06:59:08.023906+0000","last_became_peered":"2024-05-30T06:59:08.023906+0000","last_unstale":"2024-05-30T07:01:12.704532+0000","last_undegraded":"2024-05-30T07:01:12.704532+0000","last_fullsized":"2024-05-30T07:01:12.704532+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:31:34.458628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230686900,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":40,"num_read_kb":159745,"num_write":72,"num_write_kb":258049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419039+0000","last_change":"2024-05-30T06:59:07.014122+0000","last_active":"2024-05-30T06:59:54.419039+0000","last_peered":"2024-05-30T06:59:54.419039+0000","last_clean":"2024-05-30T06:59:54.419039+0000","last_became_active":"2024-05-30T06:59:07.013813+0000","last_became_peered":"2024-05-30T06:59:07.013813+0000","last_unstale":"2024-05-30T06:59:54.419039+0000","last_undegraded":"2024-05-30T06:59:54.419039+0000","last_fullsized":"2024-05-30T06:59:54.419039+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"130'82","reported_seq":178,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.731436+0000","last_change":"2024-05-30T06:59:08.039459+0000","last_active":"2024-05-30T07:01:12.731436+0000","last_peered":"2024-05-30T07:01:12.731436+0000","last_clean":"2024-05-30T07:01:12.731436+0000","last_became_active":"2024-05-30T06:59:08.039187+0000","last_became_peered":"2024-05-30T06:59:08.039187+0000","last_unstale":"2024-05-30T07:01:12.731436+0000","last_undegraded":"2024-05-30T07:01:12.731436+0000","last_fullsized":"2024-05-30T07:01:12.731436+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:33:34.546284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":77,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"130'24","reported_seq":42,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:52.159062+0000","last_change":"2024-05-30T06:59:07.023207+0000","last_active":"2024-05-30T07:00:52.159062+0000","last_peered":"2024-05-30T07:00:52.159062+0000","last_clean":"2024-05-30T07:00:52.159062+0000","last_became_active":"2024-05-30T06:59:07.022910+0000","last_became_peered":"2024-05-30T06:59:07.022910+0000","last_unstale":"2024-05-30T07:00:52.159062+0000","last_undegraded":"2024-05-30T07:00:52.159062+0000","last_fullsized":"2024-05-30T07:00:52.159062+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:02:20.542236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"130'92","reported_seq":174,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.732416+0000","last_change":"2024-05-30T06:59:08.039689+0000","last_active":"2024-05-30T07:01:12.732416+0000","last_peered":"2024-05-30T07:01:12.732416+0000","last_clean":"2024-05-30T07:01:12.732416+0000","last_became_active":"2024-05-30T06:59:08.039393+0000","last_became_peered":"2024-05-30T06:59:08.039393+0000","last_unstale":"2024-05-30T07:01:12.732416+0000","last_undegraded":"2024-05-30T07:01:12.732416+0000","last_fullsized":"2024-05-30T07:01:12.732416+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:00:59.299956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":66,"num_read_kb":253956,"num_write":82,"num_write_kb":278530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"130'439","reported_seq":457,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.677285+0000","last_change":"2024-05-30T06:59:07.014432+0000","last_active":"2024-05-30T07:01:12.677285+0000","last_peered":"2024-05-30T07:01:12.677285+0000","last_clean":"2024-05-30T07:01:12.677285+0000","last_became_active":"2024-05-30T06:59:07.014000+0000","last_became_peered":"2024-05-30T06:59:07.014000+0000","last_unstale":"2024-05-30T07:01:12.677285+0000","last_undegraded":"2024-05-30T07:01:12.677285+0000","last_fullsized":"2024-05-30T07:01:12.677285+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:10:36.275003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1700973,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":438,"num_write_kb":1807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"130'103","reported_seq":170,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.714955+0000","last_change":"2024-05-30T06:59:08.022261+0000","last_active":"2024-05-30T07:01:12.714955+0000","last_peered":"2024-05-30T07:01:12.714955+0000","last_clean":"2024-05-30T07:01:12.714955+0000","last_became_active":"2024-05-30T06:59:08.022009+0000","last_became_peered":"2024-05-30T06:59:08.022009+0000","last_unstale":"2024-05-30T07:01:12.714955+0000","last_undegraded":"2024-05-30T07:01:12.714955+0000","last_fullsized":"2024-05-30T07:01:12.714955+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":50,"num_read_kb":200705,"num_write":97,"num_write_kb":327681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":27,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:18.206163+0000","last_change":"2024-05-30T07:01:18.206199+0000","last_active":"2024-05-30T07:01:18.206163+0000","last_peered":"2024-05-30T07:01:18.206163+0000","last_clean":"2024-05-30T07:01:18.206163+0000","last_became_active":"2024-05-30T06:59:07.013181+0000","last_became_peered":"2024-05-30T06:59:07.013181+0000","last_unstale":"2024-05-30T07:01:18.206163+0000","last_undegraded":"2024-05-30T07:01:18.206163+0000","last_fullsized":"2024-05-30T07:01:18.206163+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:18.206069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:18.206069+0000","last_clean_scrub_stamp":"2024-05-30T07:01:18.206069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:15:11.701860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"130'83","reported_seq":159,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.726381+0000","last_change":"2024-05-30T06:59:08.030108+0000","last_active":"2024-05-30T07:01:12.726381+0000","last_peered":"2024-05-30T07:01:12.726381+0000","last_clean":"2024-05-30T07:01:12.726381+0000","last_became_active":"2024-05-30T06:59:08.029134+0000","last_became_peered":"2024-05-30T06:59:08.029134+0000","last_unstale":"2024-05-30T07:01:12.726381+0000","last_undegraded":"2024-05-30T07:01:12.726381+0000","last_fullsized":"2024-05-30T07:01:12.726381+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":79,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.480170+0000","last_change":"2024-05-30T06:59:07.022390+0000","last_active":"2024-05-30T06:59:54.480170+0000","last_peered":"2024-05-30T06:59:54.480170+0000","last_clean":"2024-05-30T06:59:54.480170+0000","last_became_active":"2024-05-30T06:59:07.022101+0000","last_became_peered":"2024-05-30T06:59:07.022101+0000","last_unstale":"2024-05-30T06:59:54.480170+0000","last_undegraded":"2024-05-30T06:59:54.480170+0000","last_fullsized":"2024-05-30T06:59:54.480170+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"130'110","reported_seq":190,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.709795+0000","last_change":"2024-05-30T06:59:08.044660+0000","last_active":"2024-05-30T07:01:12.709795+0000","last_peered":"2024-05-30T07:01:12.709795+0000","last_clean":"2024-05-30T07:01:12.709795+0000","last_became_active":"2024-05-30T06:59:08.044058+0000","last_became_peered":"2024-05-30T06:59:08.044058+0000","last_unstale":"2024-05-30T07:01:12.709795+0000","last_undegraded":"2024-05-30T07:01:12.709795+0000","last_fullsized":"2024-05-30T07:01:12.709795+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:49:32.544053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301990149,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":105,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"127'8","reported_seq":26,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.460852+0000","last_change":"2024-05-30T06:59:07.015902+0000","last_active":"2024-05-30T06:59:54.460852+0000","last_peered":"2024-05-30T06:59:54.460852+0000","last_clean":"2024-05-30T06:59:54.460852+0000","last_became_active":"2024-05-30T06:59:07.015593+0000","last_became_peered":"2024-05-30T06:59:07.015593+0000","last_unstale":"2024-05-30T06:59:54.460852+0000","last_undegraded":"2024-05-30T06:59:54.460852+0000","last_fullsized":"2024-05-30T06:59:54.460852+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:14:30.382452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"130'72","reported_seq":111,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.697225+0000","last_change":"2024-05-30T06:59:08.036882+0000","last_active":"2024-05-30T07:01:12.697225+0000","last_peered":"2024-05-30T07:01:12.697225+0000","last_clean":"2024-05-30T07:01:12.697225+0000","last_became_active":"2024-05-30T06:59:08.036615+0000","last_became_peered":"2024-05-30T06:59:08.036615+0000","last_unstale":"2024-05-30T07:01:12.697225+0000","last_undegraded":"2024-05-30T07:01:12.697225+0000","last_fullsized":"2024-05-30T07:01:12.697225+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:17.450834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":23,"num_read_kb":94208,"num_write":68,"num_write_kb":237568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418585+0000","last_change":"2024-05-30T06:59:07.019419+0000","last_active":"2024-05-30T06:59:54.418585+0000","last_peered":"2024-05-30T06:59:54.418585+0000","last_clean":"2024-05-30T06:59:54.418585+0000","last_became_active":"2024-05-30T06:59:07.019026+0000","last_became_peered":"2024-05-30T06:59:07.019026+0000","last_unstale":"2024-05-30T06:59:54.418585+0000","last_undegraded":"2024-05-30T06:59:54.418585+0000","last_fullsized":"2024-05-30T06:59:54.418585+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:42:17.679592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"130'104","reported_seq":197,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.710513+0000","last_change":"2024-05-30T06:59:08.041567+0000","last_active":"2024-05-30T07:01:12.710513+0000","last_peered":"2024-05-30T07:01:12.710513+0000","last_clean":"2024-05-30T07:01:12.710513+0000","last_became_active":"2024-05-30T06:59:08.039259+0000","last_became_peered":"2024-05-30T06:59:08.039259+0000","last_unstale":"2024-05-30T07:01:12.710513+0000","last_undegraded":"2024-05-30T07:01:12.710513+0000","last_fullsized":"2024-05-30T07:01:12.710513+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:37:27.648210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":77,"num_read_kb":315392,"num_write":98,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"127'2","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.414344+0000","last_change":"2024-05-30T06:59:07.020027+0000","last_active":"2024-05-30T06:59:54.414344+0000","last_peered":"2024-05-30T06:59:54.414344+0000","last_clean":"2024-05-30T06:59:54.414344+0000","last_became_active":"2024-05-30T06:59:07.019702+0000","last_became_peered":"2024-05-30T06:59:07.019702+0000","last_unstale":"2024-05-30T06:59:54.414344+0000","last_undegraded":"2024-05-30T06:59:54.414344+0000","last_fullsized":"2024-05-30T06:59:54.414344+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"130'82","reported_seq":158,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.710405+0000","last_change":"2024-05-30T06:59:08.026623+0000","last_active":"2024-05-30T07:01:12.710405+0000","last_peered":"2024-05-30T07:01:12.710405+0000","last_clean":"2024-05-30T07:01:12.710405+0000","last_became_active":"2024-05-30T06:59:08.026370+0000","last_became_peered":"2024-05-30T06:59:08.026370+0000","last_unstale":"2024-05-30T07:01:12.710405+0000","last_undegraded":"2024-05-30T07:01:12.710405+0000","last_fullsized":"2024-05-30T07:01:12.710405+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":59,"num_read_kb":225284,"num_write":72,"num_write_kb":233475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"127'1","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.417939+0000","last_change":"2024-05-30T06:59:07.018086+0000","last_active":"2024-05-30T06:59:54.417939+0000","last_peered":"2024-05-30T06:59:54.417939+0000","last_clean":"2024-05-30T06:59:54.417939+0000","last_became_active":"2024-05-30T06:59:07.017740+0000","last_became_peered":"2024-05-30T06:59:07.017740+0000","last_unstale":"2024-05-30T06:59:54.417939+0000","last_undegraded":"2024-05-30T06:59:54.417939+0000","last_fullsized":"2024-05-30T06:59:54.417939+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:23:16.444618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"130'92","reported_seq":184,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.715542+0000","last_change":"2024-05-30T06:59:08.015660+0000","last_active":"2024-05-30T07:01:12.715542+0000","last_peered":"2024-05-30T07:01:12.715542+0000","last_clean":"2024-05-30T07:01:12.715542+0000","last_became_active":"2024-05-30T06:59:08.015370+0000","last_became_peered":"2024-05-30T06:59:08.015370+0000","last_unstale":"2024-05-30T07:01:12.715542+0000","last_undegraded":"2024-05-30T07:01:12.715542+0000","last_fullsized":"2024-05-30T07:01:12.715542+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":87,"num_write_kb":299008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418143+0000","last_change":"2024-05-30T06:59:07.024249+0000","last_active":"2024-05-30T06:59:54.418143+0000","last_peered":"2024-05-30T06:59:54.418143+0000","last_clean":"2024-05-30T06:59:54.418143+0000","last_became_active":"2024-05-30T06:59:07.023895+0000","last_became_peered":"2024-05-30T06:59:07.023895+0000","last_unstale":"2024-05-30T06:59:54.418143+0000","last_undegraded":"2024-05-30T06:59:54.418143+0000","last_fullsized":"2024-05-30T06:59:54.418143+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:16:51.738852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"130'102","reported_seq":198,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:17.801300+0000","last_change":"2024-05-30T06:59:08.029322+0000","last_active":"2024-05-30T07:01:17.801300+0000","last_peered":"2024-05-30T07:01:17.801300+0000","last_clean":"2024-05-30T07:01:17.801300+0000","last_became_active":"2024-05-30T06:59:08.028959+0000","last_became_peered":"2024-05-30T06:59:08.028959+0000","last_unstale":"2024-05-30T07:01:17.801300+0000","last_undegraded":"2024-05-30T07:01:17.801300+0000","last_fullsized":"2024-05-30T07:01:17.801300+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":98,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"128'3","reported_seq":21,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.418435+0000","last_change":"2024-05-30T06:59:07.019458+0000","last_active":"2024-05-30T06:59:54.418435+0000","last_peered":"2024-05-30T06:59:54.418435+0000","last_clean":"2024-05-30T06:59:54.418435+0000","last_became_active":"2024-05-30T06:59:07.019186+0000","last_became_peered":"2024-05-30T06:59:07.019186+0000","last_unstale":"2024-05-30T06:59:54.418435+0000","last_undegraded":"2024-05-30T06:59:54.418435+0000","last_fullsized":"2024-05-30T06:59:54.418435+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:41:53.047887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"130'98","reported_seq":178,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.731791+0000","last_change":"2024-05-30T06:59:08.035291+0000","last_active":"2024-05-30T07:01:12.731791+0000","last_peered":"2024-05-30T07:01:12.731791+0000","last_clean":"2024-05-30T07:01:12.731791+0000","last_became_active":"2024-05-30T06:59:08.034951+0000","last_became_peered":"2024-05-30T06:59:08.034951+0000","last_unstale":"2024-05-30T07:01:12.731791+0000","last_undegraded":"2024-05-30T07:01:12.731791+0000","last_fullsized":"2024-05-30T07:01:12.731791+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:21:42.071914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018629,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":245764,"num_write":90,"num_write_kb":315394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:18.356399+0000","last_change":"2024-05-30T06:59:07.016536+0000","last_active":"2024-05-30T07:01:18.356399+0000","last_peered":"2024-05-30T07:01:18.356399+0000","last_clean":"2024-05-30T07:01:18.356399+0000","last_became_active":"2024-05-30T06:59:07.016202+0000","last_became_peered":"2024-05-30T06:59:07.016202+0000","last_unstale":"2024-05-30T07:01:18.356399+0000","last_undegraded":"2024-05-30T07:01:18.356399+0000","last_fullsized":"2024-05-30T07:01:18.356399+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"130'113","reported_seq":177,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:17.262771+0000","last_change":"2024-05-30T06:59:08.022686+0000","last_active":"2024-05-30T07:01:17.262771+0000","last_peered":"2024-05-30T07:01:17.262771+0000","last_clean":"2024-05-30T07:01:17.262771+0000","last_became_active":"2024-05-30T06:59:08.022436+0000","last_became_peered":"2024-05-30T06:59:08.022436+0000","last_unstale":"2024-05-30T07:01:17.262771+0000","last_undegraded":"2024-05-30T07:01:17.262771+0000","last_fullsized":"2024-05-30T07:01:17.262771+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":46,"num_read_kb":180226,"num_write":102,"num_write_kb":352257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:18.356375+0000","last_change":"2024-05-30T06:59:07.017333+0000","last_active":"2024-05-30T07:01:18.356375+0000","last_peered":"2024-05-30T07:01:18.356375+0000","last_clean":"2024-05-30T07:01:18.356375+0000","last_became_active":"2024-05-30T06:59:07.017037+0000","last_became_peered":"2024-05-30T06:59:07.017037+0000","last_unstale":"2024-05-30T07:01:18.356375+0000","last_undegraded":"2024-05-30T07:01:18.356375+0000","last_fullsized":"2024-05-30T07:01:18.356375+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"130'87","reported_seq":164,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.733404+0000","last_change":"2024-05-30T06:59:08.038802+0000","last_active":"2024-05-30T07:01:12.733404+0000","last_peered":"2024-05-30T07:01:12.733404+0000","last_clean":"2024-05-30T07:01:12.733404+0000","last_became_active":"2024-05-30T06:59:08.038486+0000","last_became_peered":"2024-05-30T06:59:08.038486+0000","last_unstale":"2024-05-30T07:01:12.733404+0000","last_undegraded":"2024-05-30T07:01:12.733404+0000","last_fullsized":"2024-05-30T07:01:12.733404+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:00:34.693941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":60,"num_read_kb":245760,"num_write":76,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"130'1","reported_seq":29,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:18.603535+0000","last_change":"2024-05-30T07:01:18.603535+0000","last_active":"2024-05-30T07:01:18.603535+0000","last_peered":"2024-05-30T07:01:18.603535+0000","last_clean":"2024-05-30T07:01:18.603535+0000","last_became_active":"2024-05-30T06:59:07.017946+0000","last_became_peered":"2024-05-30T06:59:07.017946+0000","last_unstale":"2024-05-30T07:01:18.603535+0000","last_undegraded":"2024-05-30T07:01:18.603535+0000","last_fullsized":"2024-05-30T07:01:18.603535+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'1","last_scrub_stamp":"2024-05-30T07:01:18.603436+0000","last_deep_scrub":"130'1","last_deep_scrub_stamp":"2024-05-30T07:01:18.603436+0000","last_clean_scrub_stamp":"2024-05-30T07:01:18.603436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:00.138950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"130'109","reported_seq":162,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.730770+0000","last_change":"2024-05-30T06:59:08.025933+0000","last_active":"2024-05-30T07:01:12.730770+0000","last_peered":"2024-05-30T07:01:12.730770+0000","last_clean":"2024-05-30T07:01:12.730770+0000","last_became_active":"2024-05-30T06:59:08.025557+0000","last_became_peered":"2024-05-30T06:59:08.025557+0000","last_unstale":"2024-05-30T07:01:12.730770+0000","last_undegraded":"2024-05-30T07:01:12.730770+0000","last_fullsized":"2024-05-30T07:01:12.730770+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:59.888055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":100,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"127'2","reported_seq":22,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:17.801250+0000","last_change":"2024-05-30T06:59:07.020218+0000","last_active":"2024-05-30T07:01:17.801250+0000","last_peered":"2024-05-30T07:01:17.801250+0000","last_clean":"2024-05-30T07:01:17.801250+0000","last_became_active":"2024-05-30T06:59:07.018769+0000","last_became_peered":"2024-05-30T06:59:07.018769+0000","last_unstale":"2024-05-30T07:01:17.801250+0000","last_undegraded":"2024-05-30T07:01:17.801250+0000","last_fullsized":"2024-05-30T07:01:17.801250+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"130'98","reported_seq":195,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:17.801289+0000","last_change":"2024-05-30T06:59:08.032992+0000","last_active":"2024-05-30T07:01:17.801289+0000","last_peered":"2024-05-30T07:01:17.801289+0000","last_clean":"2024-05-30T07:01:17.801289+0000","last_became_active":"2024-05-30T06:59:08.032647+0000","last_became_peered":"2024-05-30T06:59:08.032647+0000","last_unstale":"2024-05-30T07:01:17.801289+0000","last_undegraded":"2024-05-30T07:01:17.801289+0000","last_fullsized":"2024-05-30T07:01:17.801289+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":79,"num_read_kb":323584,"num_write":90,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"130'34","reported_seq":53,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:00:53.049810+0000","last_change":"2024-05-30T06:59:07.021143+0000","last_active":"2024-05-30T07:00:53.049810+0000","last_peered":"2024-05-30T07:00:53.049810+0000","last_clean":"2024-05-30T07:00:53.049810+0000","last_became_active":"2024-05-30T06:59:07.020771+0000","last_became_peered":"2024-05-30T06:59:07.020771+0000","last_unstale":"2024-05-30T07:00:53.049810+0000","last_undegraded":"2024-05-30T07:00:53.049810+0000","last_fullsized":"2024-05-30T07:00:53.049810+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:36:42.840485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"130'91","reported_seq":201,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:13.731991+0000","last_change":"2024-05-30T06:59:08.038746+0000","last_active":"2024-05-30T07:01:13.731991+0000","last_peered":"2024-05-30T07:01:13.731991+0000","last_clean":"2024-05-30T07:01:13.731991+0000","last_became_active":"2024-05-30T06:59:08.038465+0000","last_became_peered":"2024-05-30T06:59:08.038465+0000","last_unstale":"2024-05-30T07:01:13.731991+0000","last_undegraded":"2024-05-30T07:01:13.731991+0000","last_fullsized":"2024-05-30T07:01:13.731991+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":92,"num_read_kb":376832,"num_write":84,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:18.564840+0000","last_change":"2024-05-30T07:01:18.564858+0000","last_active":"2024-05-30T07:01:18.564840+0000","last_peered":"2024-05-30T07:01:18.564840+0000","last_clean":"2024-05-30T07:01:18.564840+0000","last_became_active":"2024-05-30T06:59:07.019061+0000","last_became_peered":"2024-05-30T06:59:07.019061+0000","last_unstale":"2024-05-30T07:01:18.564840+0000","last_undegraded":"2024-05-30T07:01:18.564840+0000","last_fullsized":"2024-05-30T07:01:18.564840+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:18.564757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:18.564757+0000","last_clean_scrub_stamp":"2024-05-30T07:01:18.564757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:23:53.650353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"130'105","reported_seq":170,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.726058+0000","last_change":"2024-05-30T06:59:08.032170+0000","last_active":"2024-05-30T07:01:12.726058+0000","last_peered":"2024-05-30T07:01:12.726058+0000","last_clean":"2024-05-30T07:01:12.726058+0000","last_became_active":"2024-05-30T06:59:08.030918+0000","last_became_peered":"2024-05-30T06:59:08.030918+0000","last_unstale":"2024-05-30T07:01:12.726058+0000","last_undegraded":"2024-05-30T07:01:12.726058+0000","last_fullsized":"2024-05-30T07:01:12.726058+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:33:46.570680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247464319,"num_objects":62,"num_object_clones":1,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":1,"num_read":49,"num_read_kb":200704,"num_write":96,"num_write_kb":307203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:14.007352+0000","last_change":"2024-05-30T06:59:07.020348+0000","last_active":"2024-05-30T07:01:14.007352+0000","last_peered":"2024-05-30T07:01:14.007352+0000","last_clean":"2024-05-30T07:01:14.007352+0000","last_became_active":"2024-05-30T06:59:07.019991+0000","last_became_peered":"2024-05-30T06:59:07.019991+0000","last_unstale":"2024-05-30T07:01:14.007352+0000","last_undegraded":"2024-05-30T07:01:14.007352+0000","last_fullsized":"2024-05-30T07:01:14.007352+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"130'112","reported_seq":186,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.730781+0000","last_change":"2024-05-30T06:59:08.038690+0000","last_active":"2024-05-30T07:01:12.730781+0000","last_peered":"2024-05-30T07:01:12.730781+0000","last_clean":"2024-05-30T07:01:12.730781+0000","last_became_active":"2024-05-30T06:59:08.038380+0000","last_became_peered":"2024-05-30T06:59:08.038380+0000","last_unstale":"2024-05-30T07:01:12.730781+0000","last_undegraded":"2024-05-30T07:01:12.730781+0000","last_fullsized":"2024-05-30T07:01:12.730781+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:05:26.527928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":100,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:13.731980+0000","last_change":"2024-05-30T06:59:07.023295+0000","last_active":"2024-05-30T07:01:13.731980+0000","last_peered":"2024-05-30T07:01:13.731980+0000","last_clean":"2024-05-30T07:01:13.731980+0000","last_became_active":"2024-05-30T06:59:07.022933+0000","last_became_peered":"2024-05-30T06:59:07.022933+0000","last_unstale":"2024-05-30T07:01:13.731980+0000","last_undegraded":"2024-05-30T07:01:13.731980+0000","last_fullsized":"2024-05-30T07:01:13.731980+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"130'123","reported_seq":226,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.722308+0000","last_change":"2024-05-30T06:59:08.037751+0000","last_active":"2024-05-30T07:01:12.722308+0000","last_peered":"2024-05-30T07:01:12.722308+0000","last_clean":"2024-05-30T07:01:12.722308+0000","last_became_active":"2024-05-30T06:59:08.037505+0000","last_became_peered":"2024-05-30T06:59:08.037505+0000","last_unstale":"2024-05-30T07:01:12.722308+0000","last_undegraded":"2024-05-30T07:01:12.722308+0000","last_fullsized":"2024-05-30T07:01:12.722308+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:48:16.400946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":86,"num_read_kb":335876,"num_write":115,"num_write_kb":393217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":19,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419702+0000","last_change":"2024-05-30T06:59:07.025942+0000","last_active":"2024-05-30T06:59:54.419702+0000","last_peered":"2024-05-30T06:59:54.419702+0000","last_clean":"2024-05-30T06:59:54.419702+0000","last_became_active":"2024-05-30T06:59:07.025651+0000","last_became_peered":"2024-05-30T06:59:07.025651+0000","last_unstale":"2024-05-30T06:59:54.419702+0000","last_undegraded":"2024-05-30T06:59:54.419702+0000","last_fullsized":"2024-05-30T06:59:54.419702+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:21:41.065697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"130'102","reported_seq":193,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.726188+0000","last_change":"2024-05-30T06:59:08.023176+0000","last_active":"2024-05-30T07:01:12.726188+0000","last_peered":"2024-05-30T07:01:12.726188+0000","last_clean":"2024-05-30T07:01:12.726188+0000","last_became_active":"2024-05-30T06:59:08.022036+0000","last_became_peered":"2024-05-30T06:59:08.022036+0000","last_unstale":"2024-05-30T07:01:12.726188+0000","last_undegraded":"2024-05-30T07:01:12.726188+0000","last_fullsized":"2024-05-30T07:01:12.726188+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":97,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"130'30","reported_seq":79,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:13.732984+0000","last_change":"2024-05-30T06:59:07.012244+0000","last_active":"2024-05-30T07:01:13.732984+0000","last_peered":"2024-05-30T07:01:13.732984+0000","last_clean":"2024-05-30T07:01:13.732984+0000","last_became_active":"2024-05-30T06:59:07.011981+0000","last_became_peered":"2024-05-30T06:59:07.011981+0000","last_unstale":"2024-05-30T07:01:13.732984+0000","last_undegraded":"2024-05-30T07:01:13.732984+0000","last_fullsized":"2024-05-30T07:01:13.732984+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4755,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":29,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"130'120","reported_seq":216,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:13.731954+0000","last_change":"2024-05-30T06:59:08.036367+0000","last_active":"2024-05-30T07:01:13.731954+0000","last_peered":"2024-05-30T07:01:13.731954+0000","last_clean":"2024-05-30T07:01:13.731954+0000","last_became_active":"2024-05-30T06:59:08.035993+0000","last_became_peered":"2024-05-30T06:59:08.035993+0000","last_unstale":"2024-05-30T07:01:13.731954+0000","last_undegraded":"2024-05-30T07:01:13.731954+0000","last_fullsized":"2024-05-30T07:01:13.731954+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":113,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:17.630220+0000","last_change":"2024-05-30T07:01:17.630258+0000","last_active":"2024-05-30T07:01:17.630220+0000","last_peered":"2024-05-30T07:01:17.630220+0000","last_clean":"2024-05-30T07:01:17.630220+0000","last_became_active":"2024-05-30T06:59:07.017622+0000","last_became_peered":"2024-05-30T06:59:07.017622+0000","last_unstale":"2024-05-30T07:01:17.630220+0000","last_undegraded":"2024-05-30T07:01:17.630220+0000","last_fullsized":"2024-05-30T07:01:17.630220+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:17.630087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:17.630087+0000","last_clean_scrub_stamp":"2024-05-30T07:01:17.630087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:19:03.464667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"130'82","reported_seq":148,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:12.728859+0000","last_change":"2024-05-30T06:59:08.034173+0000","last_active":"2024-05-30T07:01:12.728859+0000","last_peered":"2024-05-30T07:01:12.728859+0000","last_clean":"2024-05-30T07:01:12.728859+0000","last_became_active":"2024-05-30T06:59:08.033874+0000","last_became_peered":"2024-05-30T06:59:08.033874+0000","last_unstale":"2024-05-30T07:01:12.728859+0000","last_undegraded":"2024-05-30T07:01:12.728859+0000","last_fullsized":"2024-05-30T07:01:12.728859+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:06.986318+0000","last_clean_scrub_stamp":"2024-05-30T06:59:06.986318+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:08:08.594337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":50,"num_read_kb":204800,"num_write":77,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"127'2","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419780+0000","last_change":"2024-05-30T06:59:07.027441+0000","last_active":"2024-05-30T06:59:54.419780+0000","last_peered":"2024-05-30T06:59:54.419780+0000","last_clean":"2024-05-30T06:59:54.419780+0000","last_became_active":"2024-05-30T06:59:07.027219+0000","last_became_peered":"2024-05-30T06:59:07.027219+0000","last_unstale":"2024-05-30T06:59:54.419780+0000","last_undegraded":"2024-05-30T06:59:54.419780+0000","last_fullsized":"2024-05-30T06:59:54.419780+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:59:05.980101+0000","last_clean_scrub_stamp":"2024-05-30T06:59:05.980101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:19:58.881839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":381,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T06:59:54.419731+0000","last_change":"2024-05-30T06:42:00.034644+0000","last_active":"2024-05-30T06:59:54.419731+0000","last_peered":"2024-05-30T06:59:54.419731+0000","last_clean":"2024-05-30T06:59:54.419731+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T06:59:54.419731+0000","last_undegraded":"2024-05-30T06:59:54.419731+0000","last_fullsized":"2024-05-30T06:59:54.419731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T06:41:58.977882+0000","last_clean_scrub_stamp":"2024-05-30T06:41:58.977882+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:53:25.195701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":16844326603,"num_objects":4025,"num_object_clones":1,"num_object_copies":8050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4025,"num_whiteouts":1,"num_read":4099,"num_read_kb":16560184,"num_write":5631,"num_write_kb":19595307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33688715264,"data_stored":33688653206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6140,"ondisk_log_size":6140,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1706526,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":602,"num_write_kb":1889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3481600,"data_stored":3413052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":560,"ondisk_log_size":560,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575083,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3725524,"kb_used_data":3608332,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":90646316,"statfs":{"total":96636764160,"available":92821827584,"internally_reserved":0,"allocated":3694931968,"data_stored":3693994948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":119994826},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575084,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4680980,"kb_used_data":4545740,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":89690860,"statfs":{"total":96636764160,"available":91843440640,"internally_reserved":0,"allocated":4654837760,"data_stored":4653904706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":138475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575084,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3581648,"kb_used_data":3442248,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":90790192,"statfs":{"total":96636764160,"available":92969156608,"internally_reserved":0,"allocated":3524861952,"data_stored":3523931494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575083,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5183308,"kb_used_data":5035588,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":89188532,"statfs":{"total":96636764160,"available":91329056768,"internally_reserved":0,"allocated":5156442112,"data_stored":5155515779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575083,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4103504,"kb_used_data":3946056,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":90268336,"statfs":{"total":96636764160,"available":92434776064,"internally_reserved":0,"allocated":4040761344,"data_stored":4039835296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":161216967},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575082,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5367432,"kb_used_data":5232192,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":89004408,"statfs":{"total":96636764160,"available":91140513792,"internally_reserved":0,"allocated":5357764608,"data_stored":5356842395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575084,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3856184,"kb_used_data":3708464,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90515656,"statfs":{"total":96636764160,"available":92688031744,"internally_reserved":0,"allocated":3797467136,"data_stored":3796560308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575084,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3541308,"kb_used_data":3397748,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":90830532,"statfs":{"total":96636764160,"available":93010464768,"internally_reserved":0,"allocated":3479293952,"data_stored":3478383572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1720320,"data_stored":1705728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1724416,"data_stored":1701611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3477078016,"data_stored":3477078016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3795845120,"data_stored":3795845120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5356134400,"data_stored":5356126591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4039122944,"data_stored":4039115193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5154816000,"data_stored":5154800521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3523231744,"data_stored":3523216194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4651495424,"data_stored":4651483790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3690991616,"data_stored":3690987781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T07:01:20.950 INFO:tasks.ceph:pgid 19.3f last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.950 INFO:tasks.ceph:pgid 19.3e last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.951 INFO:tasks.ceph:pgid 19.3d last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.951 INFO:tasks.ceph:pgid 19.3c last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.951 INFO:tasks.ceph:pgid 19.3b last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.951 INFO:tasks.ceph:pgid 19.3a last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.951 INFO:tasks.ceph:pgid 19.39 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.951 INFO:tasks.ceph:pgid 19.38 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.952 INFO:tasks.ceph:pgid 19.37 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.952 INFO:tasks.ceph:pgid 19.36 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.952 INFO:tasks.ceph:pgid 19.35 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.952 INFO:tasks.ceph:pgid 19.34 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.952 INFO:tasks.ceph:pgid 19.33 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.953 INFO:tasks.ceph:pgid 19.32 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.953 INFO:tasks.ceph:pgid 19.31 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.953 INFO:tasks.ceph:pgid 19.30 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.953 INFO:tasks.ceph:pgid 19.2f last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.953 INFO:tasks.ceph:pgid 19.2e last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.953 INFO:tasks.ceph:pgid 19.2d last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.954 INFO:tasks.ceph:pgid 19.2c last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.954 INFO:tasks.ceph:pgid 19.2b last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.954 INFO:tasks.ceph:pgid 19.2a last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.954 INFO:tasks.ceph:pgid 19.29 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.954 INFO:tasks.ceph:pgid 19.28 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.954 INFO:tasks.ceph:pgid 19.27 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.955 INFO:tasks.ceph:pgid 19.26 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.955 INFO:tasks.ceph:pgid 19.25 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.955 INFO:tasks.ceph:pgid 19.24 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.955 INFO:tasks.ceph:pgid 19.23 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.955 INFO:tasks.ceph:pgid 19.22 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.955 INFO:tasks.ceph:pgid 19.21 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.956 INFO:tasks.ceph:pgid 19.20 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.956 INFO:tasks.ceph:pgid 19.1e last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.956 INFO:tasks.ceph:pgid 18.1f last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.956 INFO:tasks.ceph:pgid 19.1f last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.956 INFO:tasks.ceph:pgid 18.1e last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.956 INFO:tasks.ceph:pgid 19.1c last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.957 INFO:tasks.ceph:pgid 18.1d last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.957 INFO:tasks.ceph:pgid 19.1d last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.957 INFO:tasks.ceph:pgid 18.1c last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.957 INFO:tasks.ceph:pgid 19.1a last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.957 INFO:tasks.ceph:pgid 18.1b last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.957 INFO:tasks.ceph:pgid 19.1b last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.958 INFO:tasks.ceph:pgid 18.1a last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.958 INFO:tasks.ceph:pgid 19.18 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.958 INFO:tasks.ceph:pgid 18.19 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.958 INFO:tasks.ceph:pgid 19.19 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.958 INFO:tasks.ceph:pgid 19.16 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.959 INFO:tasks.ceph:pgid 18.17 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.959 INFO:tasks.ceph:pgid 19.17 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.959 INFO:tasks.ceph:pgid 18.16 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.959 INFO:tasks.ceph:pgid 19.14 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.959 INFO:tasks.ceph:pgid 18.15 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.959 INFO:tasks.ceph:pgid 19.15 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.960 INFO:tasks.ceph:pgid 18.14 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.960 INFO:tasks.ceph:pgid 19.13 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.960 INFO:tasks.ceph:pgid 19.10 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.960 INFO:tasks.ceph:pgid 18.11 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.960 INFO:tasks.ceph:pgid 19.11 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.960 INFO:tasks.ceph:pgid 18.10 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.961 INFO:tasks.ceph:pgid 19.e last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.961 INFO:tasks.ceph:pgid 18.f last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.961 INFO:tasks.ceph:pgid 19.f last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.961 INFO:tasks.ceph:pgid 18.e last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.961 INFO:tasks.ceph:pgid 19.c last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.961 INFO:tasks.ceph:pgid 18.d last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.961 INFO:tasks.ceph:pgid 19.d last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.962 INFO:tasks.ceph:pgid 18.c last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.962 INFO:tasks.ceph:pgid 19.a last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.962 INFO:tasks.ceph:pgid 18.b last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.962 INFO:tasks.ceph:pgid 19.b last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.962 INFO:tasks.ceph:pgid 18.a last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.962 INFO:tasks.ceph:pgid 19.8 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.963 INFO:tasks.ceph:pgid 18.9 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.963 INFO:tasks.ceph:pgid 19.9 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.963 INFO:tasks.ceph:pgid 19.6 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.963 INFO:tasks.ceph:pgid 18.7 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.963 INFO:tasks.ceph:pgid 19.7 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.963 INFO:tasks.ceph:pgid 18.6 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.964 INFO:tasks.ceph:pgid 19.4 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.964 INFO:tasks.ceph:pgid 19.5 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.964 INFO:tasks.ceph:pgid 18.4 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.964 INFO:tasks.ceph:pgid 19.2 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.964 INFO:tasks.ceph:pgid 18.3 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.964 INFO:tasks.ceph:pgid 19.3 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.965 INFO:tasks.ceph:pgid 18.2 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.965 INFO:tasks.ceph:pgid 19.0 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.965 INFO:tasks.ceph:pgid 18.1 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.965 INFO:tasks.ceph:pgid 19.1 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.965 INFO:tasks.ceph:pgid 19.12 last_scrub_stamp 2024-05-30T06:59:06.986318+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=6, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.965 INFO:tasks.ceph:pgid 18.13 last_scrub_stamp 2024-05-30T06:59:05.980101+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=59, tm_sec=5, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.966 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-30T06:41:58.977882+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=6, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=151, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=30, tm_hour=7, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=151, tm_isdst=0) 2024-05-30T07:01:20.966 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-30T07:01:36.750 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T07:01:36.754 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T07:01:40.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-30T07:01:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6669a00640 1 Processor -- start 2024-05-30T07:01:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6669a00640 1 -- start start 2024-05-30T07:01:41.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6669a00640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f66641605d0 0x7f66640b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6669a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66640cdda0 con 0x7f66641609b0 2024-05-30T07:01:41.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6669a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66640ce080 con 0x7f666415fee0 2024-05-30T07:01:41.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6669a00640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f666409ac00 con 0x7f66641605d0 2024-05-30T07:01:41.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f665b400640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f66641609b0 0x7f666415f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60362/0 (socket says 172.21.15.37:60362) 2024-05-30T07:01:41.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f665b400640 1 -- 172.21.15.37:0/1939484224 learned_addr learned my addr 172.21.15.37:0/1939484224 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:41.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663e00640 1 --2- 172.21.15.37:0/1939484224 >> v2:172.21.15.105:3300/0 conn(0x7f66641605d0 0x7f66640b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1670554650 0 0) 0x7f66640cdda0 con 0x7f66641609b0 2024-05-30T07:01:41.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6648003530 con 0x7f66641609b0 2024-05-30T07:01:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3304395249 0 0) 0x7f6648003530 con 0x7f66641609b0 2024-05-30T07:01:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 >> v2:172.21.15.105:3300/0 conn(0x7f66641605d0 msgr2=0x7f66640b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 --2- 172.21.15.37:0/1939484224 >> v2:172.21.15.105:3300/0 conn(0x7f66641605d0 0x7f66640b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 >> v1:172.21.15.105:6789/0 conn(0x7f666415fee0 legacy=0x7f666409b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666409aee0 con 0x7f66641609b0 2024-05-30T07:01:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7f664c001680 con 0x7f66641609b0 2024-05-30T07:01:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 >> v1:172.21.15.37:6789/0 conn(0x7f66641609b0 legacy=0x7f666415f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 --2- 172.21.15.37:0/1939484224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66480039c0 0x7f6648003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 --2- 172.21.15.37:0/1939484224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6648004810 0x7f6648004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 --2- 172.21.15.37:0/1939484224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66480051d0 0x7f664800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f666409ac00 con 0x7f66480051d0 2024-05-30T07:01:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f664800c070 con 0x7f6648004810 2024-05-30T07:01:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f664800c270 con 0x7f66480039c0 2024-05-30T07:01:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6669000640 1 --2- 172.21.15.37:0/1939484224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66480051d0 0x7f664800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f665b400640 1 --2- 172.21.15.37:0/1939484224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6648004810 0x7f6648004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6663e00640 1 --2- 172.21.15.37:0/1939484224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66480039c0 0x7f6648003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6669000640 1 -- 172.21.15.37:0/1939484224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66480039c0 msgr2=0x7f6648003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6669000640 1 --2- 172.21.15.37:0/1939484224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66480039c0 0x7f6648003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6669000640 1 -- 172.21.15.37:0/1939484224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6648004810 msgr2=0x7f6648004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:41.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6669000640 1 --2- 172.21.15.37:0/1939484224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6648004810 0x7f6648004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.120+0000 7f6669000640 1 -- 172.21.15.37:0/1939484224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6648003530 con 0x7f66480051d0 2024-05-30T07:01:41.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.124+0000 7f6669000640 1 -- 172.21.15.37:0/1939484224 reap_dead start 2024-05-30T07:01:41.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.124+0000 7f6669000640 1 --2- 172.21.15.37:0/1939484224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66480051d0 0x7f664800b9d0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f665c001e40 tx=0x7f665c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef6268888dfb06d server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:41.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.124+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c001a90 con 0x7f66480051d0 2024-05-30T07:01:41.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.124+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665c003b80 con 0x7f66480051d0 2024-05-30T07:01:41.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.124+0000 7f6663400640 1 -- 172.21.15.37:0/1939484224 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c005020 con 0x7f66480051d0 2024-05-30T07:01:41.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.124+0000 7f6669a00640 1 -- 172.21.15.37:0/1939484224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66480051d0 msgr2=0x7f664800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.124+0000 7f6669a00640 1 --2- 172.21.15.37:0/1939484224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66480051d0 0x7f664800b9d0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f665c001e40 tx=0x7f665c01c760 comp rx=0 tx=0).stop 2024-05-30T07:01:41.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.124+0000 7f6669a00640 1 -- 172.21.15.37:0/1939484224 shutdown_connections 2024-05-30T07:01:41.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.124+0000 7f6669a00640 1 --2- 172.21.15.37:0/1939484224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66480051d0 0x7f664800b9d0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.124+0000 7f6669a00640 1 -- 172.21.15.37:0/1939484224 >> 172.21.15.37:0/1939484224 conn(0x7f66640b3f50 msgr2=0x7f66640b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:41.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.124+0000 7f6669a00640 1 -- 172.21.15.37:0/1939484224 shutdown_connections 2024-05-30T07:01:41.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.124+0000 7f6669a00640 1 -- 172.21.15.37:0/1939484224 wait complete. 2024-05-30T07:01:41.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6669a00640 1 Processor -- start 2024-05-30T07:01:41.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6669a00640 1 -- start start 2024-05-30T07:01:41.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6669a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66480051d0 0x7f666414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6669a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66640ca390 0x7f666415b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6669a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66640ca810 0x7f666415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6669a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6664160e10 con 0x7f66640ca390 2024-05-30T07:01:41.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6669a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66640cdba0 con 0x7f66480051d0 2024-05-30T07:01:41.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6669a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6664160f90 con 0x7f66640ca810 2024-05-30T07:01:41.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f665b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66640ca390 0x7f666415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f665b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66640ca390 0x7f666415b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37544/0 (socket says 172.21.15.37:37544) 2024-05-30T07:01:41.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f665b400640 1 -- 172.21.15.37:0/3031496953 learned_addr learned my addr 172.21.15.37:0/3031496953 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:41.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6663e00640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66480051d0 0x7f666414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6669000640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66640ca810 0x7f666415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f665b400640 1 -- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66640ca810 msgr2=0x7f666415b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f665b400640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66640ca810 0x7f666415b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f665b400640 1 -- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66480051d0 msgr2=0x7f666414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f665b400640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66480051d0 0x7f666414e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f665b400640 1 -- 172.21.15.37:0/3031496953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666414edf0 con 0x7f66640ca390 2024-05-30T07:01:41.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f665b400640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66640ca390 0x7f666415b290 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f664c0011f0 tx=0x7f664c007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:41.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6660c00640 1 -- 172.21.15.37:0/3031496953 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c00f9c0 con 0x7f66640ca390 2024-05-30T07:01:41.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6660c00640 1 -- 172.21.15.37:0/3031496953 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c018070 con 0x7f66640ca390 2024-05-30T07:01:41.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6669a00640 1 -- 172.21.15.37:0/3031496953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66640c95d0 con 0x7f66640ca390 2024-05-30T07:01:41.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6660c00640 1 -- 172.21.15.37:0/3031496953 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c00fdc0 con 0x7f66640ca390 2024-05-30T07:01:41.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.128+0000 7f6669a00640 1 -- 172.21.15.37:0/3031496953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66640c9b90 con 0x7f66640ca390 2024-05-30T07:01:41.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.132+0000 7f6669a00640 1 -- 172.21.15.37:0/3031496953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6664068ab0 con 0x7f66640ca390 2024-05-30T07:01:41.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.132+0000 7f6660c00640 1 -- 172.21.15.37:0/3031496953 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 53) ==== 90741+0+0 (secure 0 0 0) 0x7f664c01c410 con 0x7f66640ca390 2024-05-30T07:01:41.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.132+0000 7f6660c00640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f664006a210 0x7f664006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.132+0000 7f6660c00640 1 -- 172.21.15.37:0/3031496953 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f664c085500 con 0x7f66640ca390 2024-05-30T07:01:41.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.132+0000 7f6663e00640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f664006a210 0x7f664006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.132+0000 7f6663e00640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f664006a210 0x7f664006c6d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f6654009b60 tx=0x7f6654009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:41.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.136+0000 7f6660c00640 1 -- 172.21.15.37:0/3031496953 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f664c057520 con 0x7f66640ca390 2024-05-30T07:01:41.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.300+0000 7f6669a00640 1 -- 172.21.15.37:0/3031496953 --> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66640cf360 con 0x7f664006a210 2024-05-30T07:01:41.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.308+0000 7f6660c00640 1 -- 172.21.15.37:0/3031496953 <== mgr.4105 v2:172.21.15.105:6832/911132516 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+255767 (secure 0 0 0) 0x7f66640cf360 con 0x7f664006a210 2024-05-30T07:01:41.314 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:01:41.315 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-05-30T07:01:41.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.312+0000 7f6669a00640 1 -- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f664006a210 msgr2=0x7f664006c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.312+0000 7f6669a00640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f664006a210 0x7f664006c6d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f6654009b60 tx=0x7f6654009190 comp rx=0 tx=0).stop 2024-05-30T07:01:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.312+0000 7f6669a00640 1 -- 172.21.15.37:0/3031496953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66640ca390 msgr2=0x7f666415b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.312+0000 7f6669a00640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66640ca390 0x7f666415b290 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f664c0011f0 tx=0x7f664c007660 comp rx=0 tx=0).stop 2024-05-30T07:01:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.312+0000 7f6669a00640 1 -- 172.21.15.37:0/3031496953 shutdown_connections 2024-05-30T07:01:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.312+0000 7f6669a00640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66640ca810 0x7f666415b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.312+0000 7f6669a00640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66640ca390 0x7f666415b290 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.312+0000 7f6669a00640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f664006a210 0x7f664006c6d0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.312+0000 7f6669a00640 1 --2- 172.21.15.37:0/3031496953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66480051d0 0x7f666414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.312+0000 7f6669a00640 1 -- 172.21.15.37:0/3031496953 >> 172.21.15.37:0/3031496953 conn(0x7f66640b3f50 msgr2=0x7f66640b5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:41.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.312+0000 7f6669a00640 1 -- 172.21.15.37:0/3031496953 shutdown_connections 2024-05-30T07:01:41.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.312+0000 7f6669a00640 1 -- 172.21.15.37:0/3031496953 wait complete. 2024-05-30T07:01:41.334 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":714,"stamp":"2024-05-30T07:01:41.054531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16846624963,"num_objects":4050,"num_object_clones":1,"num_object_copies":8100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4050,"num_whiteouts":1,"num_read":4244,"num_read_kb":16560313,"num_write":6407,"num_write_kb":19599623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6005,"num_omap_keys":27,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13375,"ondisk_log_size":13375,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":34057936,"kb_used_data":32916368,"kb_used_omap":12,"kb_used_meta":1141491,"kb_avail":720916784,"statfs":{"total":773094113280,"available":738218786816,"internally_reserved":0,"allocated":33706360832,"data_stored":33698971430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1168887344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002980"},"pg_stats":[{"pgid":"19.3f","version":"130'182","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:22.550872+0000","last_change":"2024-05-30T07:01:21.631428+0000","last_active":"2024-05-30T07:01:22.550872+0000","last_peered":"2024-05-30T07:01:22.550872+0000","last_clean":"2024-05-30T07:01:22.550872+0000","last_became_active":"2024-05-30T06:59:08.023564+0000","last_became_peered":"2024-05-30T06:59:08.023564+0000","last_unstale":"2024-05-30T07:01:22.550872+0000","last_undegraded":"2024-05-30T07:01:22.550872+0000","last_fullsized":"2024-05-30T07:01:22.550872+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'159","last_scrub_stamp":"2024-05-30T07:01:21.631332+0000","last_deep_scrub":"130'159","last_deep_scrub_stamp":"2024-05-30T07:01:21.631332+0000","last_clean_scrub_stamp":"2024-05-30T07:01:21.631332+0000","objects_scrubbed":57,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:21:14.979800+0000","scrub_duration":355,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075328,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":77,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"130'216","reported_seq":312,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:27.343744+0000","last_change":"2024-05-30T07:01:27.343820+0000","last_active":"2024-05-30T07:01:27.343744+0000","last_peered":"2024-05-30T07:01:27.343744+0000","last_clean":"2024-05-30T07:01:27.343744+0000","last_became_active":"2024-05-30T06:59:08.016947+0000","last_became_peered":"2024-05-30T06:59:08.016947+0000","last_unstale":"2024-05-30T07:01:27.343744+0000","last_undegraded":"2024-05-30T07:01:27.343744+0000","last_fullsized":"2024-05-30T07:01:27.343744+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'216","last_scrub_stamp":"2024-05-30T07:01:27.343654+0000","last_deep_scrub":"130'216","last_deep_scrub_stamp":"2024-05-30T07:01:27.343654+0000","last_clean_scrub_stamp":"2024-05-30T07:01:27.343654+0000","objects_scrubbed":73,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:10:42.452581+0000","scrub_duration":819,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":68,"num_read_kb":278528,"num_write":93,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"130'212","reported_seq":308,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:23.521717+0000","last_change":"2024-05-30T07:01:23.521764+0000","last_active":"2024-05-30T07:01:23.521717+0000","last_peered":"2024-05-30T07:01:23.521717+0000","last_clean":"2024-05-30T07:01:23.521717+0000","last_became_active":"2024-05-30T06:59:08.030677+0000","last_became_peered":"2024-05-30T06:59:08.030677+0000","last_unstale":"2024-05-30T07:01:23.521717+0000","last_undegraded":"2024-05-30T07:01:23.521717+0000","last_fullsized":"2024-05-30T07:01:23.521717+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'212","last_scrub_stamp":"2024-05-30T07:01:23.521643+0000","last_deep_scrub":"130'212","last_deep_scrub_stamp":"2024-05-30T07:01:23.521643+0000","last_clean_scrub_stamp":"2024-05-30T07:01:23.521643+0000","objects_scrubbed":64,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:31:32.574393+0000","scrub_duration":547,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":68,"num_read_kb":262148,"num_write":100,"num_write_kb":323587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"130'185","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:27.107158+0000","last_change":"2024-05-30T07:01:27.107226+0000","last_active":"2024-05-30T07:01:27.107158+0000","last_peered":"2024-05-30T07:01:27.107158+0000","last_clean":"2024-05-30T07:01:27.107158+0000","last_became_active":"2024-05-30T06:59:54.418117+0000","last_became_peered":"2024-05-30T06:59:54.418117+0000","last_unstale":"2024-05-30T07:01:27.107158+0000","last_undegraded":"2024-05-30T07:01:27.107158+0000","last_fullsized":"2024-05-30T07:01:27.107158+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'185","last_scrub_stamp":"2024-05-30T07:01:27.107052+0000","last_deep_scrub":"130'185","last_deep_scrub_stamp":"2024-05-30T07:01:27.107052+0000","last_clean_scrub_stamp":"2024-05-30T07:01:27.107052+0000","objects_scrubbed":53,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:02:23.888500+0000","scrub_duration":591,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":44,"num_read_kb":176129,"num_write":83,"num_write_kb":274433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3b","version":"130'170","reported_seq":239,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:34.263178+0000","last_change":"2024-05-30T07:01:34.263178+0000","last_active":"2024-05-30T07:01:34.263178+0000","last_peered":"2024-05-30T07:01:34.263178+0000","last_clean":"2024-05-30T07:01:34.263178+0000","last_became_active":"2024-05-30T06:59:08.045942+0000","last_became_peered":"2024-05-30T06:59:08.045942+0000","last_unstale":"2024-05-30T07:01:34.263178+0000","last_undegraded":"2024-05-30T07:01:34.263178+0000","last_fullsized":"2024-05-30T07:01:34.263178+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'170","last_scrub_stamp":"2024-05-30T07:01:34.263043+0000","last_deep_scrub":"130'170","last_deep_scrub_stamp":"2024-05-30T07:01:34.263043+0000","last_clean_scrub_stamp":"2024-05-30T07:01:34.263043+0000","objects_scrubbed":56,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:57:48.462164+0000","scrub_duration":411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234881024,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":41,"num_read_kb":167936,"num_write":68,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"130'223","reported_seq":337,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:26.526203+0000","last_change":"2024-05-30T07:01:26.526203+0000","last_active":"2024-05-30T07:01:26.526203+0000","last_peered":"2024-05-30T07:01:26.526203+0000","last_clean":"2024-05-30T07:01:26.526203+0000","last_became_active":"2024-05-30T06:59:08.029463+0000","last_became_peered":"2024-05-30T06:59:08.029463+0000","last_unstale":"2024-05-30T07:01:26.526203+0000","last_undegraded":"2024-05-30T07:01:26.526203+0000","last_fullsized":"2024-05-30T07:01:26.526203+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'223","last_scrub_stamp":"2024-05-30T07:01:26.525992+0000","last_deep_scrub":"130'223","last_deep_scrub_stamp":"2024-05-30T07:01:26.525992+0000","last_clean_scrub_stamp":"2024-05-30T07:01:26.525992+0000","objects_scrubbed":71,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:14:47.669563+0000","scrub_duration":779,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":86,"num_read_kb":352256,"num_write":99,"num_write_kb":344065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"130'193","reported_seq":269,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:29.474280+0000","last_change":"2024-05-30T07:01:29.474353+0000","last_active":"2024-05-30T07:01:29.474280+0000","last_peered":"2024-05-30T07:01:29.474280+0000","last_clean":"2024-05-30T07:01:29.474280+0000","last_became_active":"2024-05-30T06:59:08.035526+0000","last_became_peered":"2024-05-30T06:59:08.035526+0000","last_unstale":"2024-05-30T07:01:29.474280+0000","last_undegraded":"2024-05-30T07:01:29.474280+0000","last_fullsized":"2024-05-30T07:01:29.474280+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'193","last_scrub_stamp":"2024-05-30T07:01:29.474186+0000","last_deep_scrub":"130'193","last_deep_scrub_stamp":"2024-05-30T07:01:29.474186+0000","last_clean_scrub_stamp":"2024-05-30T07:01:29.474186+0000","objects_scrubbed":59,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:32:25.398754+0000","scrub_duration":727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":48,"num_read_kb":196608,"num_write":75,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"130'180","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:24.755430+0000","last_change":"2024-05-30T07:01:24.755430+0000","last_active":"2024-05-30T07:01:24.755430+0000","last_peered":"2024-05-30T07:01:24.755430+0000","last_clean":"2024-05-30T07:01:24.755430+0000","last_became_active":"2024-05-30T06:59:08.034842+0000","last_became_peered":"2024-05-30T06:59:08.034842+0000","last_unstale":"2024-05-30T07:01:24.755430+0000","last_undegraded":"2024-05-30T07:01:24.755430+0000","last_fullsized":"2024-05-30T07:01:24.755430+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'180","last_scrub_stamp":"2024-05-30T07:01:24.755323+0000","last_deep_scrub":"130'180","last_deep_scrub_stamp":"2024-05-30T07:01:24.755323+0000","last_clean_scrub_stamp":"2024-05-30T07:01:24.755323+0000","objects_scrubbed":60,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:22:13.272288+0000","scrub_duration":815,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":53,"num_read_kb":217088,"num_write":88,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"130'202","reported_seq":282,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:31.528574+0000","last_change":"2024-05-30T07:01:31.528574+0000","last_active":"2024-05-30T07:01:31.528574+0000","last_peered":"2024-05-30T07:01:31.528574+0000","last_clean":"2024-05-30T07:01:31.528574+0000","last_became_active":"2024-05-30T06:59:08.044276+0000","last_became_peered":"2024-05-30T06:59:08.044276+0000","last_unstale":"2024-05-30T07:01:31.528574+0000","last_undegraded":"2024-05-30T07:01:31.528574+0000","last_fullsized":"2024-05-30T07:01:31.528574+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'202","last_scrub_stamp":"2024-05-30T07:01:31.528461+0000","last_deep_scrub":"130'202","last_deep_scrub_stamp":"2024-05-30T07:01:31.528461+0000","last_clean_scrub_stamp":"2024-05-30T07:01:31.528461+0000","objects_scrubbed":59,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:10:23.869950+0000","scrub_duration":495,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269764,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":52,"num_read_kb":208897,"num_write":89,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"130'151","reported_seq":241,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:25.938140+0000","last_change":"2024-05-30T07:01:25.938140+0000","last_active":"2024-05-30T07:01:25.938140+0000","last_peered":"2024-05-30T07:01:25.938140+0000","last_clean":"2024-05-30T07:01:25.938140+0000","last_became_active":"2024-05-30T06:59:08.016161+0000","last_became_peered":"2024-05-30T06:59:08.016161+0000","last_unstale":"2024-05-30T07:01:25.938140+0000","last_undegraded":"2024-05-30T07:01:25.938140+0000","last_fullsized":"2024-05-30T07:01:25.938140+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'151","last_scrub_stamp":"2024-05-30T07:01:25.938017+0000","last_deep_scrub":"130'151","last_deep_scrub_stamp":"2024-05-30T07:01:25.938017+0000","last_clean_scrub_stamp":"2024-05-30T07:01:25.938017+0000","objects_scrubbed":45,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:30:03.050547+0000","scrub_duration":411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188743680,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":63,"num_read_kb":258048,"num_write":65,"num_write_kb":225280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"130'217","reported_seq":345,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:24.564402+0000","last_change":"2024-05-30T07:01:24.564523+0000","last_active":"2024-05-30T07:01:24.564402+0000","last_peered":"2024-05-30T07:01:24.564402+0000","last_clean":"2024-05-30T07:01:24.564402+0000","last_became_active":"2024-05-30T06:59:08.021772+0000","last_became_peered":"2024-05-30T06:59:08.021772+0000","last_unstale":"2024-05-30T07:01:24.564402+0000","last_undegraded":"2024-05-30T07:01:24.564402+0000","last_fullsized":"2024-05-30T07:01:24.564402+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'217","last_scrub_stamp":"2024-05-30T07:01:24.564287+0000","last_deep_scrub":"130'217","last_deep_scrub_stamp":"2024-05-30T07:01:24.564287+0000","last_clean_scrub_stamp":"2024-05-30T07:01:24.564287+0000","objects_scrubbed":74,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:56:46.881690+0000","scrub_duration":955,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":100,"num_read_kb":409600,"num_write":100,"num_write_kb":356352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"130'176","reported_seq":302,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:28.779517+0000","last_change":"2024-05-30T07:01:28.779517+0000","last_active":"2024-05-30T07:01:28.779517+0000","last_peered":"2024-05-30T07:01:28.779517+0000","last_clean":"2024-05-30T07:01:28.779517+0000","last_became_active":"2024-05-30T06:59:08.043835+0000","last_became_peered":"2024-05-30T06:59:08.043835+0000","last_unstale":"2024-05-30T07:01:28.779517+0000","last_undegraded":"2024-05-30T07:01:28.779517+0000","last_fullsized":"2024-05-30T07:01:28.779517+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'176","last_scrub_stamp":"2024-05-30T07:01:28.779264+0000","last_deep_scrub":"130'176","last_deep_scrub_stamp":"2024-05-30T07:01:28.779264+0000","last_clean_scrub_stamp":"2024-05-30T07:01:28.779264+0000","objects_scrubbed":58,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:07:33.156363+0000","scrub_duration":795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":98,"num_read_kb":385028,"num_write":80,"num_write_kb":278529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"130'180","reported_seq":292,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:25.054142+0000","last_change":"2024-05-30T07:01:25.054142+0000","last_active":"2024-05-30T07:01:25.054142+0000","last_peered":"2024-05-30T07:01:25.054142+0000","last_clean":"2024-05-30T07:01:25.054142+0000","last_became_active":"2024-05-30T06:59:08.024478+0000","last_became_peered":"2024-05-30T06:59:08.024478+0000","last_unstale":"2024-05-30T07:01:25.054142+0000","last_undegraded":"2024-05-30T07:01:25.054142+0000","last_fullsized":"2024-05-30T07:01:25.054142+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'180","last_scrub_stamp":"2024-05-30T07:01:25.054002+0000","last_deep_scrub":"130'180","last_deep_scrub_stamp":"2024-05-30T07:01:25.054002+0000","last_clean_scrub_stamp":"2024-05-30T07:01:25.054002+0000","objects_scrubbed":60,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:58:43.156463+0000","scrub_duration":723,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":251658240,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":84,"num_read_kb":335874,"num_write":84,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"130'194","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:28.199815+0000","last_change":"2024-05-30T07:01:28.199815+0000","last_active":"2024-05-30T07:01:28.199815+0000","last_peered":"2024-05-30T07:01:28.199815+0000","last_clean":"2024-05-30T07:01:28.199815+0000","last_became_active":"2024-05-30T06:59:08.022058+0000","last_became_peered":"2024-05-30T06:59:08.022058+0000","last_unstale":"2024-05-30T07:01:28.199815+0000","last_undegraded":"2024-05-30T07:01:28.199815+0000","last_fullsized":"2024-05-30T07:01:28.199815+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'194","last_scrub_stamp":"2024-05-30T07:01:28.199569+0000","last_deep_scrub":"130'194","last_deep_scrub_stamp":"2024-05-30T07:01:28.199569+0000","last_clean_scrub_stamp":"2024-05-30T07:01:28.199569+0000","objects_scrubbed":67,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:03:20.513208+0000","scrub_duration":675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":63,"num_read_kb":249858,"num_write":83,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"130'181","reported_seq":240,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:25.876144+0000","last_change":"2024-05-30T07:01:25.876144+0000","last_active":"2024-05-30T07:01:25.876144+0000","last_peered":"2024-05-30T07:01:25.876144+0000","last_clean":"2024-05-30T07:01:25.876144+0000","last_became_active":"2024-05-30T06:59:08.027303+0000","last_became_peered":"2024-05-30T06:59:08.027303+0000","last_unstale":"2024-05-30T07:01:25.876144+0000","last_undegraded":"2024-05-30T07:01:25.876144+0000","last_fullsized":"2024-05-30T07:01:25.876144+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'181","last_scrub_stamp":"2024-05-30T07:01:25.875994+0000","last_deep_scrub":"130'181","last_deep_scrub_stamp":"2024-05-30T07:01:25.875994+0000","last_clean_scrub_stamp":"2024-05-30T07:01:25.875994+0000","objects_scrubbed":59,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:51:51.524450+0000","scrub_duration":559,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":31,"num_read_kb":126976,"num_write":75,"num_write_kb":274432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"130'183","reported_seq":263,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:29.404558+0000","last_change":"2024-05-30T07:01:29.404587+0000","last_active":"2024-05-30T07:01:29.404558+0000","last_peered":"2024-05-30T07:01:29.404558+0000","last_clean":"2024-05-30T07:01:29.404558+0000","last_became_active":"2024-05-30T06:59:08.022914+0000","last_became_peered":"2024-05-30T06:59:08.022914+0000","last_unstale":"2024-05-30T07:01:29.404558+0000","last_undegraded":"2024-05-30T07:01:29.404558+0000","last_fullsized":"2024-05-30T07:01:29.404558+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'183","last_scrub_stamp":"2024-05-30T07:01:29.404490+0000","last_deep_scrub":"130'183","last_deep_scrub_stamp":"2024-05-30T07:01:29.404490+0000","last_clean_scrub_stamp":"2024-05-30T07:01:29.404490+0000","objects_scrubbed":52,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:55:57.239393+0000","scrub_duration":619,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":52,"num_read_kb":212992,"num_write":84,"num_write_kb":278528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"130'163","reported_seq":234,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:23.323302+0000","last_change":"2024-05-30T07:01:23.323302+0000","last_active":"2024-05-30T07:01:23.323302+0000","last_peered":"2024-05-30T07:01:23.323302+0000","last_clean":"2024-05-30T07:01:23.323302+0000","last_became_active":"2024-05-30T06:59:08.024445+0000","last_became_peered":"2024-05-30T06:59:08.024445+0000","last_unstale":"2024-05-30T07:01:23.323302+0000","last_undegraded":"2024-05-30T07:01:23.323302+0000","last_fullsized":"2024-05-30T07:01:23.323302+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'163","last_scrub_stamp":"2024-05-30T07:01:23.323206+0000","last_deep_scrub":"130'163","last_deep_scrub_stamp":"2024-05-30T07:01:23.323206+0000","last_clean_scrub_stamp":"2024-05-30T07:01:23.323206+0000","objects_scrubbed":52,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:22:07.631846+0000","scrub_duration":523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":43,"num_read_kb":176128,"num_write":72,"num_write_kb":253952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"130'204","reported_seq":322,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:27.738012+0000","last_change":"2024-05-30T07:01:27.738012+0000","last_active":"2024-05-30T07:01:27.738012+0000","last_peered":"2024-05-30T07:01:27.738012+0000","last_clean":"2024-05-30T07:01:27.738012+0000","last_became_active":"2024-05-30T06:59:08.017709+0000","last_became_peered":"2024-05-30T06:59:08.017709+0000","last_unstale":"2024-05-30T07:01:27.738012+0000","last_undegraded":"2024-05-30T07:01:27.738012+0000","last_fullsized":"2024-05-30T07:01:27.738012+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'204","last_scrub_stamp":"2024-05-30T07:01:27.737858+0000","last_deep_scrub":"130'204","last_deep_scrub_stamp":"2024-05-30T07:01:27.737858+0000","last_clean_scrub_stamp":"2024-05-30T07:01:27.737858+0000","objects_scrubbed":76,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:46:41.557874+0000","scrub_duration":907,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":89,"num_read_kb":364544,"num_write":94,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"130'204","reported_seq":303,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:26.251511+0000","last_change":"2024-05-30T07:01:26.251602+0000","last_active":"2024-05-30T07:01:26.251511+0000","last_peered":"2024-05-30T07:01:26.251511+0000","last_clean":"2024-05-30T07:01:26.251511+0000","last_became_active":"2024-05-30T06:59:08.025981+0000","last_became_peered":"2024-05-30T06:59:08.025981+0000","last_unstale":"2024-05-30T07:01:26.251511+0000","last_undegraded":"2024-05-30T07:01:26.251511+0000","last_fullsized":"2024-05-30T07:01:26.251511+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'204","last_scrub_stamp":"2024-05-30T07:01:26.251429+0000","last_deep_scrub":"130'204","last_deep_scrub_stamp":"2024-05-30T07:01:26.251429+0000","last_clean_scrub_stamp":"2024-05-30T07:01:26.251429+0000","objects_scrubbed":72,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:36:26.398337+0000","scrub_duration":707,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":71,"num_read_kb":278531,"num_write":94,"num_write_kb":335873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"130'205","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:24.729069+0000","last_change":"2024-05-30T07:01:24.729145+0000","last_active":"2024-05-30T07:01:24.729069+0000","last_peered":"2024-05-30T07:01:24.729069+0000","last_clean":"2024-05-30T07:01:24.729069+0000","last_became_active":"2024-05-30T06:59:08.015033+0000","last_became_peered":"2024-05-30T06:59:08.015033+0000","last_unstale":"2024-05-30T07:01:24.729069+0000","last_undegraded":"2024-05-30T07:01:24.729069+0000","last_fullsized":"2024-05-30T07:01:24.729069+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'205","last_scrub_stamp":"2024-05-30T07:01:24.728972+0000","last_deep_scrub":"130'205","last_deep_scrub_stamp":"2024-05-30T07:01:24.728972+0000","last_clean_scrub_stamp":"2024-05-30T07:01:24.728972+0000","objects_scrubbed":65,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:46.863692+0000","scrub_duration":911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":61,"num_read_kb":241666,"num_write":83,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"130'218","reported_seq":337,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:35.339850+0000","last_change":"2024-05-30T07:01:35.339908+0000","last_active":"2024-05-30T07:01:35.339850+0000","last_peered":"2024-05-30T07:01:35.339850+0000","last_clean":"2024-05-30T07:01:35.339850+0000","last_became_active":"2024-05-30T06:59:08.045891+0000","last_became_peered":"2024-05-30T06:59:08.045891+0000","last_unstale":"2024-05-30T07:01:35.339850+0000","last_undegraded":"2024-05-30T07:01:35.339850+0000","last_fullsized":"2024-05-30T07:01:35.339850+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'218","last_scrub_stamp":"2024-05-30T07:01:35.339771+0000","last_deep_scrub":"130'218","last_deep_scrub_stamp":"2024-05-30T07:01:35.339771+0000","last_clean_scrub_stamp":"2024-05-30T07:01:35.339771+0000","objects_scrubbed":72,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:08:22.496263+0000","scrub_duration":519,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":91,"num_read_kb":368641,"num_write":100,"num_write_kb":344066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"130'189","reported_seq":273,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:23.244827+0000","last_change":"2024-05-30T07:01:23.244827+0000","last_active":"2024-05-30T07:01:23.244827+0000","last_peered":"2024-05-30T07:01:23.244827+0000","last_clean":"2024-05-30T07:01:23.244827+0000","last_became_active":"2024-05-30T06:59:08.019670+0000","last_became_peered":"2024-05-30T06:59:08.019670+0000","last_unstale":"2024-05-30T07:01:23.244827+0000","last_undegraded":"2024-05-30T07:01:23.244827+0000","last_fullsized":"2024-05-30T07:01:23.244827+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'189","last_scrub_stamp":"2024-05-30T07:01:23.244669+0000","last_deep_scrub":"130'189","last_deep_scrub_stamp":"2024-05-30T07:01:23.244669+0000","last_clean_scrub_stamp":"2024-05-30T07:01:23.244669+0000","objects_scrubbed":66,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:52:08.892596+0000","scrub_duration":667,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":56,"num_read_kb":225281,"num_write":82,"num_write_kb":299009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"130'220","reported_seq":304,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:29.859719+0000","last_change":"2024-05-30T07:01:29.859762+0000","last_active":"2024-05-30T07:01:29.859719+0000","last_peered":"2024-05-30T07:01:29.859719+0000","last_clean":"2024-05-30T07:01:29.859719+0000","last_became_active":"2024-05-30T06:59:08.043786+0000","last_became_peered":"2024-05-30T06:59:08.043786+0000","last_unstale":"2024-05-30T07:01:29.859719+0000","last_undegraded":"2024-05-30T07:01:29.859719+0000","last_fullsized":"2024-05-30T07:01:29.859719+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'220","last_scrub_stamp":"2024-05-30T07:01:29.859628+0000","last_deep_scrub":"130'220","last_deep_scrub_stamp":"2024-05-30T07:01:29.859628+0000","last_clean_scrub_stamp":"2024-05-30T07:01:29.859628+0000","objects_scrubbed":75,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:59:00.016392+0000","scrub_duration":855,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":314572800,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":97,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"130'203","reported_seq":287,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:25.266205+0000","last_change":"2024-05-30T07:01:25.266247+0000","last_active":"2024-05-30T07:01:25.266205+0000","last_peered":"2024-05-30T07:01:25.266205+0000","last_clean":"2024-05-30T07:01:25.266205+0000","last_became_active":"2024-05-30T06:59:08.022293+0000","last_became_peered":"2024-05-30T06:59:08.022293+0000","last_unstale":"2024-05-30T07:01:25.266205+0000","last_undegraded":"2024-05-30T07:01:25.266205+0000","last_fullsized":"2024-05-30T07:01:25.266205+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'203","last_scrub_stamp":"2024-05-30T07:01:25.266134+0000","last_deep_scrub":"130'203","last_deep_scrub_stamp":"2024-05-30T07:01:25.266134+0000","last_clean_scrub_stamp":"2024-05-30T07:01:25.266134+0000","objects_scrubbed":63,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:24:56.213328+0000","scrub_duration":703,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":56,"num_read_kb":212996,"num_write":85,"num_write_kb":294914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"130'207","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:32.003917+0000","last_change":"2024-05-30T07:01:32.003955+0000","last_active":"2024-05-30T07:01:32.003917+0000","last_peered":"2024-05-30T07:01:32.003917+0000","last_clean":"2024-05-30T07:01:32.003917+0000","last_became_active":"2024-05-30T06:59:08.038414+0000","last_became_peered":"2024-05-30T06:59:08.038414+0000","last_unstale":"2024-05-30T07:01:32.003917+0000","last_undegraded":"2024-05-30T07:01:32.003917+0000","last_fullsized":"2024-05-30T07:01:32.003917+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'207","last_scrub_stamp":"2024-05-30T07:01:32.003840+0000","last_deep_scrub":"130'207","last_deep_scrub_stamp":"2024-05-30T07:01:32.003840+0000","last_clean_scrub_stamp":"2024-05-30T07:01:32.003840+0000","objects_scrubbed":58,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:45:44.069242+0000","scrub_duration":399,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":64,"num_read_kb":258049,"num_write":92,"num_write_kb":303105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"130'200","reported_seq":338,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:31.269435+0000","last_change":"2024-05-30T07:01:31.269472+0000","last_active":"2024-05-30T07:01:31.269435+0000","last_peered":"2024-05-30T07:01:31.269435+0000","last_clean":"2024-05-30T07:01:31.269435+0000","last_became_active":"2024-05-30T06:59:54.423066+0000","last_became_peered":"2024-05-30T06:59:54.423066+0000","last_unstale":"2024-05-30T07:01:31.269435+0000","last_undegraded":"2024-05-30T07:01:31.269435+0000","last_fullsized":"2024-05-30T07:01:31.269435+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'200","last_scrub_stamp":"2024-05-30T07:01:31.269367+0000","last_deep_scrub":"130'200","last_deep_scrub_stamp":"2024-05-30T07:01:31.269367+0000","last_clean_scrub_stamp":"2024-05-30T07:01:31.269367+0000","objects_scrubbed":59,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:02:28.050815+0000","scrub_duration":539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":83,"num_write_kb":290816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"130'201","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:23.851278+0000","last_change":"2024-05-30T07:01:23.851604+0000","last_active":"2024-05-30T07:01:23.851278+0000","last_peered":"2024-05-30T07:01:23.851278+0000","last_clean":"2024-05-30T07:01:23.851278+0000","last_became_active":"2024-05-30T06:59:08.024354+0000","last_became_peered":"2024-05-30T06:59:08.024354+0000","last_unstale":"2024-05-30T07:01:23.851278+0000","last_undegraded":"2024-05-30T07:01:23.851278+0000","last_fullsized":"2024-05-30T07:01:23.851278+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'201","last_scrub_stamp":"2024-05-30T07:01:23.851131+0000","last_deep_scrub":"130'201","last_deep_scrub_stamp":"2024-05-30T07:01:23.851131+0000","last_clean_scrub_stamp":"2024-05-30T07:01:23.851131+0000","objects_scrubbed":66,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:48:30.179474+0000","scrub_duration":563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":65,"num_read_kb":266240,"num_write":96,"num_write_kb":331776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"130'188","reported_seq":249,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:27.702414+0000","last_change":"2024-05-30T07:01:27.702460+0000","last_active":"2024-05-30T07:01:27.702414+0000","last_peered":"2024-05-30T07:01:27.702414+0000","last_clean":"2024-05-30T07:01:27.702414+0000","last_became_active":"2024-05-30T06:59:08.033552+0000","last_became_peered":"2024-05-30T06:59:08.033552+0000","last_unstale":"2024-05-30T07:01:27.702414+0000","last_undegraded":"2024-05-30T07:01:27.702414+0000","last_fullsized":"2024-05-30T07:01:27.702414+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'188","last_scrub_stamp":"2024-05-30T07:01:27.702330+0000","last_deep_scrub":"130'188","last_deep_scrub_stamp":"2024-05-30T07:01:27.702330+0000","last_clean_scrub_stamp":"2024-05-30T07:01:27.702330+0000","objects_scrubbed":62,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:54:53.412176+0000","scrub_duration":747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":33,"num_read_kb":135168,"num_write":90,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"130'205","reported_seq":303,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:30.007450+0000","last_change":"2024-05-30T07:01:30.007562+0000","last_active":"2024-05-30T07:01:30.007450+0000","last_peered":"2024-05-30T07:01:30.007450+0000","last_clean":"2024-05-30T07:01:30.007450+0000","last_became_active":"2024-05-30T06:59:08.032376+0000","last_became_peered":"2024-05-30T06:59:08.032376+0000","last_unstale":"2024-05-30T07:01:30.007450+0000","last_undegraded":"2024-05-30T07:01:30.007450+0000","last_fullsized":"2024-05-30T07:01:30.007450+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'205","last_scrub_stamp":"2024-05-30T07:01:30.007283+0000","last_deep_scrub":"130'205","last_deep_scrub_stamp":"2024-05-30T07:01:30.007283+0000","last_clean_scrub_stamp":"2024-05-30T07:01:30.007283+0000","objects_scrubbed":63,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:07:49.548893+0000","scrub_duration":663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":70,"num_read_kb":286720,"num_write":97,"num_write_kb":323585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"130'194","reported_seq":286,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:28.043872+0000","last_change":"2024-05-30T07:01:28.043912+0000","last_active":"2024-05-30T07:01:28.043872+0000","last_peered":"2024-05-30T07:01:28.043872+0000","last_clean":"2024-05-30T07:01:28.043872+0000","last_became_active":"2024-05-30T06:59:08.032457+0000","last_became_peered":"2024-05-30T06:59:08.032457+0000","last_unstale":"2024-05-30T07:01:28.043872+0000","last_undegraded":"2024-05-30T07:01:28.043872+0000","last_fullsized":"2024-05-30T07:01:28.043872+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'194","last_scrub_stamp":"2024-05-30T07:01:28.043807+0000","last_deep_scrub":"130'194","last_deep_scrub_stamp":"2024-05-30T07:01:28.043807+0000","last_clean_scrub_stamp":"2024-05-30T07:01:28.043807+0000","objects_scrubbed":62,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:04:18.877208+0000","scrub_duration":695,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":92,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"130'208","reported_seq":329,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:33.237826+0000","last_change":"2024-05-30T07:01:33.237861+0000","last_active":"2024-05-30T07:01:33.237826+0000","last_peered":"2024-05-30T07:01:33.237826+0000","last_clean":"2024-05-30T07:01:33.237826+0000","last_became_active":"2024-05-30T06:59:08.039524+0000","last_became_peered":"2024-05-30T06:59:08.039524+0000","last_unstale":"2024-05-30T07:01:33.237826+0000","last_undegraded":"2024-05-30T07:01:33.237826+0000","last_fullsized":"2024-05-30T07:01:33.237826+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'208","last_scrub_stamp":"2024-05-30T07:01:33.237756+0000","last_deep_scrub":"130'208","last_deep_scrub_stamp":"2024-05-30T07:01:33.237756+0000","last_clean_scrub_stamp":"2024-05-30T07:01:33.237756+0000","objects_scrubbed":62,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:07:15.543246+0000","scrub_duration":411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260046848,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":93,"num_read_kb":380928,"num_write":82,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"130'208","reported_seq":309,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:24.672988+0000","last_change":"2024-05-30T07:01:24.673079+0000","last_active":"2024-05-30T07:01:24.672988+0000","last_peered":"2024-05-30T07:01:24.672988+0000","last_clean":"2024-05-30T07:01:24.672988+0000","last_became_active":"2024-05-30T06:59:08.023719+0000","last_became_peered":"2024-05-30T06:59:08.023719+0000","last_unstale":"2024-05-30T07:01:24.672988+0000","last_undegraded":"2024-05-30T07:01:24.672988+0000","last_fullsized":"2024-05-30T07:01:24.672988+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'208","last_scrub_stamp":"2024-05-30T07:01:24.672905+0000","last_deep_scrub":"130'208","last_deep_scrub_stamp":"2024-05-30T07:01:24.672905+0000","last_clean_scrub_stamp":"2024-05-30T07:01:24.672905+0000","objects_scrubbed":65,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:10:17.014394+0000","scrub_duration":875,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":73,"num_read_kb":290818,"num_write":87,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"130'166","reported_seq":237,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:28.364928+0000","last_change":"2024-05-30T07:01:28.365006+0000","last_active":"2024-05-30T07:01:28.364928+0000","last_peered":"2024-05-30T07:01:28.364928+0000","last_clean":"2024-05-30T07:01:28.364928+0000","last_became_active":"2024-05-30T06:59:08.017322+0000","last_became_peered":"2024-05-30T06:59:08.017322+0000","last_unstale":"2024-05-30T07:01:28.364928+0000","last_undegraded":"2024-05-30T07:01:28.364928+0000","last_fullsized":"2024-05-30T07:01:28.364928+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'166","last_scrub_stamp":"2024-05-30T07:01:28.364849+0000","last_deep_scrub":"130'166","last_deep_scrub_stamp":"2024-05-30T07:01:28.364849+0000","last_clean_scrub_stamp":"2024-05-30T07:01:28.364849+0000","objects_scrubbed":47,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:56:50.682252+0000","scrub_duration":583,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192938245,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":44,"num_read_kb":180224,"num_write":71,"num_write_kb":237569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"130'6","reported_seq":34,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:22.969010+0000","last_change":"2024-05-30T07:01:22.969032+0000","last_active":"2024-05-30T07:01:22.969010+0000","last_peered":"2024-05-30T07:01:22.969010+0000","last_clean":"2024-05-30T07:01:22.969010+0000","last_became_active":"2024-05-30T06:59:07.025401+0000","last_became_peered":"2024-05-30T06:59:07.025401+0000","last_unstale":"2024-05-30T07:01:22.969010+0000","last_undegraded":"2024-05-30T07:01:22.969010+0000","last_fullsized":"2024-05-30T07:01:22.969010+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'6","last_scrub_stamp":"2024-05-30T07:01:22.968933+0000","last_deep_scrub":"130'6","last_deep_scrub_stamp":"2024-05-30T07:01:22.968933+0000","last_clean_scrub_stamp":"2024-05-30T07:01:22.968933+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:56:32.752826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"130'202","reported_seq":299,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:27.654076+0000","last_change":"2024-05-30T07:01:27.654116+0000","last_active":"2024-05-30T07:01:27.654076+0000","last_peered":"2024-05-30T07:01:27.654076+0000","last_clean":"2024-05-30T07:01:27.654076+0000","last_became_active":"2024-05-30T06:59:08.037242+0000","last_became_peered":"2024-05-30T06:59:08.037242+0000","last_unstale":"2024-05-30T07:01:27.654076+0000","last_undegraded":"2024-05-30T07:01:27.654076+0000","last_fullsized":"2024-05-30T07:01:27.654076+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'202","last_scrub_stamp":"2024-05-30T07:01:27.654001+0000","last_deep_scrub":"130'202","last_deep_scrub_stamp":"2024-05-30T07:01:27.654001+0000","last_clean_scrub_stamp":"2024-05-30T07:01:27.654001+0000","objects_scrubbed":58,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:39:44.781199+0000","scrub_duration":715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":69,"num_read_kb":266244,"num_write":96,"num_write_kb":307202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"127'1","reported_seq":29,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:24.940934+0000","last_change":"2024-05-30T07:01:24.940996+0000","last_active":"2024-05-30T07:01:24.940934+0000","last_peered":"2024-05-30T07:01:24.940934+0000","last_clean":"2024-05-30T07:01:24.940934+0000","last_became_active":"2024-05-30T06:59:07.027686+0000","last_became_peered":"2024-05-30T06:59:07.027686+0000","last_unstale":"2024-05-30T07:01:24.940934+0000","last_undegraded":"2024-05-30T07:01:24.940934+0000","last_fullsized":"2024-05-30T07:01:24.940934+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"127'1","last_scrub_stamp":"2024-05-30T07:01:24.940778+0000","last_deep_scrub":"127'1","last_deep_scrub_stamp":"2024-05-30T07:01:24.940778+0000","last_clean_scrub_stamp":"2024-05-30T07:01:24.940778+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:10:26.548798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"130'196","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:30.359014+0000","last_change":"2024-05-30T07:01:30.359014+0000","last_active":"2024-05-30T07:01:30.359014+0000","last_peered":"2024-05-30T07:01:30.359014+0000","last_clean":"2024-05-30T07:01:30.359014+0000","last_became_active":"2024-05-30T06:59:08.038891+0000","last_became_peered":"2024-05-30T06:59:08.038891+0000","last_unstale":"2024-05-30T07:01:30.359014+0000","last_undegraded":"2024-05-30T07:01:30.359014+0000","last_fullsized":"2024-05-30T07:01:30.359014+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'196","last_scrub_stamp":"2024-05-30T07:01:30.358894+0000","last_deep_scrub":"130'196","last_deep_scrub_stamp":"2024-05-30T07:01:30.358894+0000","last_clean_scrub_stamp":"2024-05-30T07:01:30.358894+0000","objects_scrubbed":58,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:33:29.115627+0000","scrub_duration":543,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239075589,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":70,"num_read_kb":278530,"num_write":88,"num_write_kb":290818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"130'4","reported_seq":32,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:21.606391+0000","last_change":"2024-05-30T07:01:21.606391+0000","last_active":"2024-05-30T07:01:21.606391+0000","last_peered":"2024-05-30T07:01:21.606391+0000","last_clean":"2024-05-30T07:01:21.606391+0000","last_became_active":"2024-05-30T06:59:07.020820+0000","last_became_peered":"2024-05-30T06:59:07.020820+0000","last_unstale":"2024-05-30T07:01:21.606391+0000","last_undegraded":"2024-05-30T07:01:21.606391+0000","last_fullsized":"2024-05-30T07:01:21.606391+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'4","last_scrub_stamp":"2024-05-30T07:01:21.606296+0000","last_deep_scrub":"130'4","last_deep_scrub_stamp":"2024-05-30T07:01:21.606296+0000","last_clean_scrub_stamp":"2024-05-30T07:01:21.606296+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:17:19.907134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"130'224","reported_seq":339,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:26.687518+0000","last_change":"2024-05-30T07:01:26.687518+0000","last_active":"2024-05-30T07:01:26.687518+0000","last_peered":"2024-05-30T07:01:26.687518+0000","last_clean":"2024-05-30T07:01:26.687518+0000","last_became_active":"2024-05-30T06:59:08.033506+0000","last_became_peered":"2024-05-30T06:59:08.033506+0000","last_unstale":"2024-05-30T07:01:26.687518+0000","last_undegraded":"2024-05-30T07:01:26.687518+0000","last_fullsized":"2024-05-30T07:01:26.687518+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'224","last_scrub_stamp":"2024-05-30T07:01:26.687370+0000","last_deep_scrub":"130'224","last_deep_scrub_stamp":"2024-05-30T07:01:26.687370+0000","last_clean_scrub_stamp":"2024-05-30T07:01:26.687370+0000","objects_scrubbed":67,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:56:49.004774+0000","scrub_duration":759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":87,"num_read_kb":356352,"num_write":111,"num_write_kb":364544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"130'3","reported_seq":31,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:21.543786+0000","last_change":"2024-05-30T07:01:21.543786+0000","last_active":"2024-05-30T07:01:21.543786+0000","last_peered":"2024-05-30T07:01:21.543786+0000","last_clean":"2024-05-30T07:01:21.543786+0000","last_became_active":"2024-05-30T06:59:07.025201+0000","last_became_peered":"2024-05-30T06:59:07.025201+0000","last_unstale":"2024-05-30T07:01:21.543786+0000","last_undegraded":"2024-05-30T07:01:21.543786+0000","last_fullsized":"2024-05-30T07:01:21.543786+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'3","last_scrub_stamp":"2024-05-30T07:01:21.543589+0000","last_deep_scrub":"130'3","last_deep_scrub_stamp":"2024-05-30T07:01:21.543589+0000","last_clean_scrub_stamp":"2024-05-30T07:01:21.543589+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:54:36.599493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"130'206","reported_seq":289,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:25.465177+0000","last_change":"2024-05-30T07:01:25.465177+0000","last_active":"2024-05-30T07:01:25.465177+0000","last_peered":"2024-05-30T07:01:25.465177+0000","last_clean":"2024-05-30T07:01:25.465177+0000","last_became_active":"2024-05-30T06:59:08.017121+0000","last_became_peered":"2024-05-30T06:59:08.017121+0000","last_unstale":"2024-05-30T07:01:25.465177+0000","last_undegraded":"2024-05-30T07:01:25.465177+0000","last_fullsized":"2024-05-30T07:01:25.465177+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'206","last_scrub_stamp":"2024-05-30T07:01:25.465066+0000","last_deep_scrub":"130'206","last_deep_scrub_stamp":"2024-05-30T07:01:25.465066+0000","last_clean_scrub_stamp":"2024-05-30T07:01:25.465066+0000","objects_scrubbed":63,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:56:35.248960+0000","scrub_duration":663,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264241152,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":55,"num_read_kb":225280,"num_write":91,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"127'1","reported_seq":29,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:22.553517+0000","last_change":"2024-05-30T07:01:22.553517+0000","last_active":"2024-05-30T07:01:22.553517+0000","last_peered":"2024-05-30T07:01:22.553517+0000","last_clean":"2024-05-30T07:01:22.553517+0000","last_became_active":"2024-05-30T06:59:07.025467+0000","last_became_peered":"2024-05-30T06:59:07.025467+0000","last_unstale":"2024-05-30T07:01:22.553517+0000","last_undegraded":"2024-05-30T07:01:22.553517+0000","last_fullsized":"2024-05-30T07:01:22.553517+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"127'1","last_scrub_stamp":"2024-05-30T07:01:22.553424+0000","last_deep_scrub":"127'1","last_deep_scrub_stamp":"2024-05-30T07:01:22.553424+0000","last_clean_scrub_stamp":"2024-05-30T07:01:22.553424+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:04:13.386825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"130'199","reported_seq":319,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:22.546590+0000","last_change":"2024-05-30T07:01:22.470887+0000","last_active":"2024-05-30T07:01:22.546590+0000","last_peered":"2024-05-30T07:01:22.546590+0000","last_clean":"2024-05-30T07:01:22.546590+0000","last_became_active":"2024-05-30T06:59:08.022387+0000","last_became_peered":"2024-05-30T06:59:08.022387+0000","last_unstale":"2024-05-30T07:01:22.546590+0000","last_undegraded":"2024-05-30T07:01:22.546590+0000","last_fullsized":"2024-05-30T07:01:22.546590+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'190","last_scrub_stamp":"2024-05-30T07:01:22.470789+0000","last_deep_scrub":"130'190","last_deep_scrub_stamp":"2024-05-30T07:01:22.470789+0000","last_clean_scrub_stamp":"2024-05-30T07:01:22.470789+0000","objects_scrubbed":65,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:58:52.627553+0000","scrub_duration":671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":91,"num_read_kb":372736,"num_write":89,"num_write_kb":315392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"127'1","reported_seq":29,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:22.770645+0000","last_change":"2024-05-30T07:01:22.770645+0000","last_active":"2024-05-30T07:01:22.770645+0000","last_peered":"2024-05-30T07:01:22.770645+0000","last_clean":"2024-05-30T07:01:22.770645+0000","last_became_active":"2024-05-30T06:59:07.020278+0000","last_became_peered":"2024-05-30T06:59:07.020278+0000","last_unstale":"2024-05-30T07:01:22.770645+0000","last_undegraded":"2024-05-30T07:01:22.770645+0000","last_fullsized":"2024-05-30T07:01:22.770645+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"127'1","last_scrub_stamp":"2024-05-30T07:01:22.770477+0000","last_deep_scrub":"127'1","last_deep_scrub_stamp":"2024-05-30T07:01:22.770477+0000","last_clean_scrub_stamp":"2024-05-30T07:01:22.770477+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:58:55.979451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"130'196","reported_seq":294,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:25.574646+0000","last_change":"2024-05-30T07:01:25.574646+0000","last_active":"2024-05-30T07:01:25.574646+0000","last_peered":"2024-05-30T07:01:25.574646+0000","last_clean":"2024-05-30T07:01:25.574646+0000","last_became_active":"2024-05-30T06:59:08.035015+0000","last_became_peered":"2024-05-30T06:59:08.035015+0000","last_unstale":"2024-05-30T07:01:25.574646+0000","last_undegraded":"2024-05-30T07:01:25.574646+0000","last_fullsized":"2024-05-30T07:01:25.574646+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'196","last_scrub_stamp":"2024-05-30T07:01:25.574495+0000","last_deep_scrub":"130'196","last_deep_scrub_stamp":"2024-05-30T07:01:25.574495+0000","last_clean_scrub_stamp":"2024-05-30T07:01:25.574495+0000","objects_scrubbed":58,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:12:45.852875+0000","scrub_duration":587,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":70,"num_read_kb":286720,"num_write":82,"num_write_kb":286720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:19.872434+0000","last_change":"2024-05-30T07:01:19.872434+0000","last_active":"2024-05-30T07:01:19.872434+0000","last_peered":"2024-05-30T07:01:19.872434+0000","last_clean":"2024-05-30T07:01:19.872434+0000","last_became_active":"2024-05-30T06:59:07.013998+0000","last_became_peered":"2024-05-30T06:59:07.013998+0000","last_unstale":"2024-05-30T07:01:19.872434+0000","last_undegraded":"2024-05-30T07:01:19.872434+0000","last_fullsized":"2024-05-30T07:01:19.872434+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:19.872312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:19.872312+0000","last_clean_scrub_stamp":"2024-05-30T07:01:19.872312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:39:36.999510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"130'198","reported_seq":290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:24.244570+0000","last_change":"2024-05-30T07:01:24.244645+0000","last_active":"2024-05-30T07:01:24.244570+0000","last_peered":"2024-05-30T07:01:24.244570+0000","last_clean":"2024-05-30T07:01:24.244570+0000","last_became_active":"2024-05-30T06:59:08.011821+0000","last_became_peered":"2024-05-30T06:59:08.011821+0000","last_unstale":"2024-05-30T07:01:24.244570+0000","last_undegraded":"2024-05-30T07:01:24.244570+0000","last_fullsized":"2024-05-30T07:01:24.244570+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'198","last_scrub_stamp":"2024-05-30T07:01:24.244434+0000","last_deep_scrub":"130'198","last_deep_scrub_stamp":"2024-05-30T07:01:24.244434+0000","last_clean_scrub_stamp":"2024-05-30T07:01:24.244434+0000","objects_scrubbed":59,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:54:40.635571+0000","scrub_duration":715,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":64,"num_read_kb":253954,"num_write":85,"num_write_kb":290817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:17.584030+0000","last_change":"2024-05-30T07:01:17.584030+0000","last_active":"2024-05-30T07:01:17.584030+0000","last_peered":"2024-05-30T07:01:17.584030+0000","last_clean":"2024-05-30T07:01:17.584030+0000","last_became_active":"2024-05-30T06:59:07.017948+0000","last_became_peered":"2024-05-30T06:59:07.017948+0000","last_unstale":"2024-05-30T07:01:17.584030+0000","last_undegraded":"2024-05-30T07:01:17.584030+0000","last_fullsized":"2024-05-30T07:01:17.584030+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:17.583932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:17.583932+0000","last_clean_scrub_stamp":"2024-05-30T07:01:17.583932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:49:26.605633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"130'182","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:23.130839+0000","last_change":"2024-05-30T07:01:23.130839+0000","last_active":"2024-05-30T07:01:23.130839+0000","last_peered":"2024-05-30T07:01:23.130839+0000","last_clean":"2024-05-30T07:01:23.130839+0000","last_became_active":"2024-05-30T06:59:08.023873+0000","last_became_peered":"2024-05-30T06:59:08.023873+0000","last_unstale":"2024-05-30T07:01:23.130839+0000","last_undegraded":"2024-05-30T07:01:23.130839+0000","last_fullsized":"2024-05-30T07:01:23.130839+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'182","last_scrub_stamp":"2024-05-30T07:01:23.130685+0000","last_deep_scrub":"130'182","last_deep_scrub_stamp":"2024-05-30T07:01:23.130685+0000","last_clean_scrub_stamp":"2024-05-30T07:01:23.130685+0000","objects_scrubbed":52,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:32:46.774055+0000","scrub_duration":839,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":218103808,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":74,"num_write_kb":258048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"128'1","reported_seq":29,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:23.948449+0000","last_change":"2024-05-30T07:01:23.948449+0000","last_active":"2024-05-30T07:01:23.948449+0000","last_peered":"2024-05-30T07:01:23.948449+0000","last_clean":"2024-05-30T07:01:23.948449+0000","last_became_active":"2024-05-30T06:59:07.024244+0000","last_became_peered":"2024-05-30T06:59:07.024244+0000","last_unstale":"2024-05-30T07:01:23.948449+0000","last_undegraded":"2024-05-30T07:01:23.948449+0000","last_fullsized":"2024-05-30T07:01:23.948449+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'1","last_scrub_stamp":"2024-05-30T07:01:23.948322+0000","last_deep_scrub":"128'1","last_deep_scrub_stamp":"2024-05-30T07:01:23.948322+0000","last_clean_scrub_stamp":"2024-05-30T07:01:23.948322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:52:32.871842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"130'178","reported_seq":246,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:26.642109+0000","last_change":"2024-05-30T07:01:26.642109+0000","last_active":"2024-05-30T07:01:26.642109+0000","last_peered":"2024-05-30T07:01:26.642109+0000","last_clean":"2024-05-30T07:01:26.642109+0000","last_became_active":"2024-05-30T06:59:08.023906+0000","last_became_peered":"2024-05-30T06:59:08.023906+0000","last_unstale":"2024-05-30T07:01:26.642109+0000","last_undegraded":"2024-05-30T07:01:26.642109+0000","last_fullsized":"2024-05-30T07:01:26.642109+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'178","last_scrub_stamp":"2024-05-30T07:01:26.641987+0000","last_deep_scrub":"130'178","last_deep_scrub_stamp":"2024-05-30T07:01:26.641987+0000","last_clean_scrub_stamp":"2024-05-30T07:01:26.641987+0000","objects_scrubbed":56,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:02:54.349610+0000","scrub_duration":659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230686900,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":40,"num_read_kb":159745,"num_write":72,"num_write_kb":258049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:19.730979+0000","last_change":"2024-05-30T07:01:19.730979+0000","last_active":"2024-05-30T07:01:19.730979+0000","last_peered":"2024-05-30T07:01:19.730979+0000","last_clean":"2024-05-30T07:01:19.730979+0000","last_became_active":"2024-05-30T06:59:07.013813+0000","last_became_peered":"2024-05-30T06:59:07.013813+0000","last_unstale":"2024-05-30T07:01:19.730979+0000","last_undegraded":"2024-05-30T07:01:19.730979+0000","last_fullsized":"2024-05-30T07:01:19.730979+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:19.730883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:19.730883+0000","last_clean_scrub_stamp":"2024-05-30T07:01:19.730883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:51:21.710790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"130'180","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:31.427625+0000","last_change":"2024-05-30T07:01:31.427722+0000","last_active":"2024-05-30T07:01:31.427625+0000","last_peered":"2024-05-30T07:01:31.427625+0000","last_clean":"2024-05-30T07:01:31.427625+0000","last_became_active":"2024-05-30T06:59:08.039187+0000","last_became_peered":"2024-05-30T06:59:08.039187+0000","last_unstale":"2024-05-30T07:01:31.427625+0000","last_undegraded":"2024-05-30T07:01:31.427625+0000","last_fullsized":"2024-05-30T07:01:31.427625+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'180","last_scrub_stamp":"2024-05-30T07:01:31.427493+0000","last_deep_scrub":"130'180","last_deep_scrub_stamp":"2024-05-30T07:01:31.427493+0000","last_clean_scrub_stamp":"2024-05-30T07:01:31.427493+0000","objects_scrubbed":67,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:52:27.751648+0000","scrub_duration":603,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":80,"num_read_kb":327680,"num_write":77,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"130'25","reported_seq":53,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:21.951502+0000","last_change":"2024-05-30T07:01:21.951502+0000","last_active":"2024-05-30T07:01:21.951502+0000","last_peered":"2024-05-30T07:01:21.951502+0000","last_clean":"2024-05-30T07:01:21.951502+0000","last_became_active":"2024-05-30T06:59:07.022910+0000","last_became_peered":"2024-05-30T06:59:07.022910+0000","last_unstale":"2024-05-30T07:01:21.951502+0000","last_undegraded":"2024-05-30T07:01:21.951502+0000","last_fullsized":"2024-05-30T07:01:21.951502+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'25","last_scrub_stamp":"2024-05-30T07:01:21.951418+0000","last_deep_scrub":"130'25","last_deep_scrub_stamp":"2024-05-30T07:01:21.951418+0000","last_clean_scrub_stamp":"2024-05-30T07:01:21.951418+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:51:47.599875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"130'191","reported_seq":285,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:32.228716+0000","last_change":"2024-05-30T07:01:32.228716+0000","last_active":"2024-05-30T07:01:32.228716+0000","last_peered":"2024-05-30T07:01:32.228716+0000","last_clean":"2024-05-30T07:01:32.228716+0000","last_became_active":"2024-05-30T06:59:08.039393+0000","last_became_peered":"2024-05-30T06:59:08.039393+0000","last_unstale":"2024-05-30T07:01:32.228716+0000","last_undegraded":"2024-05-30T07:01:32.228716+0000","last_fullsized":"2024-05-30T07:01:32.228716+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'191","last_scrub_stamp":"2024-05-30T07:01:32.228586+0000","last_deep_scrub":"130'191","last_deep_scrub_stamp":"2024-05-30T07:01:32.228586+0000","last_clean_scrub_stamp":"2024-05-30T07:01:32.228586+0000","objects_scrubbed":58,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:54:52.600644+0000","scrub_duration":443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243269632,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":66,"num_read_kb":253956,"num_write":82,"num_write_kb":278530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"130'452","reported_seq":480,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:22.557722+0000","last_change":"2024-05-30T07:01:20.957764+0000","last_active":"2024-05-30T07:01:22.557722+0000","last_peered":"2024-05-30T07:01:22.557722+0000","last_clean":"2024-05-30T07:01:22.557722+0000","last_became_active":"2024-05-30T06:59:07.014000+0000","last_became_peered":"2024-05-30T06:59:07.014000+0000","last_unstale":"2024-05-30T07:01:22.557722+0000","last_undegraded":"2024-05-30T07:01:22.557722+0000","last_fullsized":"2024-05-30T07:01:22.557722+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'441","last_scrub_stamp":"2024-05-30T07:01:20.957652+0000","last_deep_scrub":"130'441","last_deep_scrub_stamp":"2024-05-30T07:01:20.957652+0000","last_clean_scrub_stamp":"2024-05-30T07:01:20.957652+0000","objects_scrubbed":4,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:19:17.244266+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702439,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":449,"num_write_kb":1818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"130'210","reported_seq":288,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:22.546780+0000","last_change":"2024-05-30T07:01:20.710401+0000","last_active":"2024-05-30T07:01:22.546780+0000","last_peered":"2024-05-30T07:01:22.546780+0000","last_clean":"2024-05-30T07:01:22.546780+0000","last_became_active":"2024-05-30T06:59:08.022009+0000","last_became_peered":"2024-05-30T06:59:08.022009+0000","last_unstale":"2024-05-30T07:01:22.546780+0000","last_undegraded":"2024-05-30T07:01:22.546780+0000","last_fullsized":"2024-05-30T07:01:22.546780+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'168","last_scrub_stamp":"2024-05-30T07:01:20.710269+0000","last_deep_scrub":"130'168","last_deep_scrub_stamp":"2024-05-30T07:01:20.710269+0000","last_clean_scrub_stamp":"2024-05-30T07:01:20.710269+0000","objects_scrubbed":65,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:48:07.975953+0000","scrub_duration":487,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":272629760,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":50,"num_read_kb":200705,"num_write":97,"num_write_kb":327681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:18.206199+0000","last_change":"2024-05-30T07:01:18.206199+0000","last_active":"2024-05-30T07:01:18.206199+0000","last_peered":"2024-05-30T07:01:18.206199+0000","last_clean":"2024-05-30T07:01:18.206199+0000","last_became_active":"2024-05-30T06:59:07.013181+0000","last_became_peered":"2024-05-30T06:59:07.013181+0000","last_unstale":"2024-05-30T07:01:18.206199+0000","last_undegraded":"2024-05-30T07:01:18.206199+0000","last_fullsized":"2024-05-30T07:01:18.206199+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:18.206069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:18.206069+0000","last_clean_scrub_stamp":"2024-05-30T07:01:18.206069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:15:11.701860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"130'172","reported_seq":259,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:30.059319+0000","last_change":"2024-05-30T07:01:30.059370+0000","last_active":"2024-05-30T07:01:30.059319+0000","last_peered":"2024-05-30T07:01:30.059319+0000","last_clean":"2024-05-30T07:01:30.059319+0000","last_became_active":"2024-05-30T06:59:08.029134+0000","last_became_peered":"2024-05-30T06:59:08.029134+0000","last_unstale":"2024-05-30T07:01:30.059319+0000","last_undegraded":"2024-05-30T07:01:30.059319+0000","last_fullsized":"2024-05-30T07:01:30.059319+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'172","last_scrub_stamp":"2024-05-30T07:01:30.059208+0000","last_deep_scrub":"130'172","last_deep_scrub_stamp":"2024-05-30T07:01:30.059208+0000","last_clean_scrub_stamp":"2024-05-30T07:01:30.059208+0000","objects_scrubbed":53,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:50:14.984079+0000","scrub_duration":535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":59,"num_read_kb":241664,"num_write":79,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:19.524115+0000","last_change":"2024-05-30T07:01:19.524115+0000","last_active":"2024-05-30T07:01:19.524115+0000","last_peered":"2024-05-30T07:01:19.524115+0000","last_clean":"2024-05-30T07:01:19.524115+0000","last_became_active":"2024-05-30T06:59:07.022101+0000","last_became_peered":"2024-05-30T06:59:07.022101+0000","last_unstale":"2024-05-30T07:01:19.524115+0000","last_undegraded":"2024-05-30T07:01:19.524115+0000","last_fullsized":"2024-05-30T07:01:19.524115+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:19.523992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:19.523992+0000","last_clean_scrub_stamp":"2024-05-30T07:01:19.523992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:38:56.384376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"130'226","reported_seq":318,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:30.644707+0000","last_change":"2024-05-30T07:01:30.644784+0000","last_active":"2024-05-30T07:01:30.644707+0000","last_peered":"2024-05-30T07:01:30.644707+0000","last_clean":"2024-05-30T07:01:30.644707+0000","last_became_active":"2024-05-30T06:59:08.044058+0000","last_became_peered":"2024-05-30T06:59:08.044058+0000","last_unstale":"2024-05-30T07:01:30.644707+0000","last_undegraded":"2024-05-30T07:01:30.644707+0000","last_fullsized":"2024-05-30T07:01:30.644707+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'226","last_scrub_stamp":"2024-05-30T07:01:30.644627+0000","last_deep_scrub":"130'226","last_deep_scrub_stamp":"2024-05-30T07:01:30.644627+0000","last_clean_scrub_stamp":"2024-05-30T07:01:30.644627+0000","objects_scrubbed":73,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:41:31.409693+0000","scrub_duration":599,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301990149,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":64,"num_read_kb":262144,"num_write":105,"num_write_kb":360449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"130'12","reported_seq":40,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:21.992752+0000","last_change":"2024-05-30T07:01:21.992752+0000","last_active":"2024-05-30T07:01:21.992752+0000","last_peered":"2024-05-30T07:01:21.992752+0000","last_clean":"2024-05-30T07:01:21.992752+0000","last_became_active":"2024-05-30T06:59:07.015593+0000","last_became_peered":"2024-05-30T06:59:07.015593+0000","last_unstale":"2024-05-30T07:01:21.992752+0000","last_undegraded":"2024-05-30T07:01:21.992752+0000","last_fullsized":"2024-05-30T07:01:21.992752+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'12","last_scrub_stamp":"2024-05-30T07:01:21.992664+0000","last_deep_scrub":"130'12","last_deep_scrub_stamp":"2024-05-30T07:01:21.992664+0000","last_clean_scrub_stamp":"2024-05-30T07:01:21.992664+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:23:10.918431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"130'156","reported_seq":206,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:26.532873+0000","last_change":"2024-05-30T07:01:26.532983+0000","last_active":"2024-05-30T07:01:26.532873+0000","last_peered":"2024-05-30T07:01:26.532873+0000","last_clean":"2024-05-30T07:01:26.532873+0000","last_became_active":"2024-05-30T06:59:08.036615+0000","last_became_peered":"2024-05-30T06:59:08.036615+0000","last_unstale":"2024-05-30T07:01:26.532873+0000","last_undegraded":"2024-05-30T07:01:26.532873+0000","last_fullsized":"2024-05-30T07:01:26.532873+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'156","last_scrub_stamp":"2024-05-30T07:01:26.532769+0000","last_deep_scrub":"130'156","last_deep_scrub_stamp":"2024-05-30T07:01:26.532769+0000","last_clean_scrub_stamp":"2024-05-30T07:01:26.532769+0000","objects_scrubbed":48,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:24:00.035413+0000","scrub_duration":555,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":23,"num_read_kb":94208,"num_write":68,"num_write_kb":237568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"130'2","reported_seq":30,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:19.955698+0000","last_change":"2024-05-30T07:01:19.955698+0000","last_active":"2024-05-30T07:01:19.955698+0000","last_peered":"2024-05-30T07:01:19.955698+0000","last_clean":"2024-05-30T07:01:19.955698+0000","last_became_active":"2024-05-30T06:59:07.019026+0000","last_became_peered":"2024-05-30T06:59:07.019026+0000","last_unstale":"2024-05-30T07:01:19.955698+0000","last_undegraded":"2024-05-30T07:01:19.955698+0000","last_fullsized":"2024-05-30T07:01:19.955698+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-05-30T07:01:19.955583+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-05-30T07:01:19.955583+0000","last_clean_scrub_stamp":"2024-05-30T07:01:19.955583+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:48:26.283926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"130'208","reported_seq":313,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:29.801110+0000","last_change":"2024-05-30T07:01:29.801207+0000","last_active":"2024-05-30T07:01:29.801110+0000","last_peered":"2024-05-30T07:01:29.801110+0000","last_clean":"2024-05-30T07:01:29.801110+0000","last_became_active":"2024-05-30T06:59:08.039259+0000","last_became_peered":"2024-05-30T06:59:08.039259+0000","last_unstale":"2024-05-30T07:01:29.801110+0000","last_undegraded":"2024-05-30T07:01:29.801110+0000","last_fullsized":"2024-05-30T07:01:29.801110+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'208","last_scrub_stamp":"2024-05-30T07:01:29.800997+0000","last_deep_scrub":"130'208","last_deep_scrub_stamp":"2024-05-30T07:01:29.800997+0000","last_clean_scrub_stamp":"2024-05-30T07:01:29.800997+0000","objects_scrubbed":72,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:35:57.360963+0000","scrub_duration":819,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":77,"num_read_kb":315392,"num_write":98,"num_write_kb":348160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"130'3","reported_seq":31,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:19.637654+0000","last_change":"2024-05-30T07:01:19.637654+0000","last_active":"2024-05-30T07:01:19.637654+0000","last_peered":"2024-05-30T07:01:19.637654+0000","last_clean":"2024-05-30T07:01:19.637654+0000","last_became_active":"2024-05-30T06:59:07.019702+0000","last_became_peered":"2024-05-30T06:59:07.019702+0000","last_unstale":"2024-05-30T07:01:19.637654+0000","last_undegraded":"2024-05-30T07:01:19.637654+0000","last_fullsized":"2024-05-30T07:01:19.637654+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'3","last_scrub_stamp":"2024-05-30T07:01:19.637530+0000","last_deep_scrub":"130'3","last_deep_scrub_stamp":"2024-05-30T07:01:19.637530+0000","last_clean_scrub_stamp":"2024-05-30T07:01:19.637530+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:41.772250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"130'175","reported_seq":261,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:30.172576+0000","last_change":"2024-05-30T07:01:30.172678+0000","last_active":"2024-05-30T07:01:30.172576+0000","last_peered":"2024-05-30T07:01:30.172576+0000","last_clean":"2024-05-30T07:01:30.172576+0000","last_became_active":"2024-05-30T06:59:08.026370+0000","last_became_peered":"2024-05-30T06:59:08.026370+0000","last_unstale":"2024-05-30T07:01:30.172576+0000","last_undegraded":"2024-05-30T07:01:30.172576+0000","last_fullsized":"2024-05-30T07:01:30.172576+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'175","last_scrub_stamp":"2024-05-30T07:01:30.172495+0000","last_deep_scrub":"130'175","last_deep_scrub_stamp":"2024-05-30T07:01:30.172495+0000","last_clean_scrub_stamp":"2024-05-30T07:01:30.172495+0000","objects_scrubbed":48,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:36:30.319403+0000","scrub_duration":403,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201326592,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":59,"num_read_kb":225284,"num_write":72,"num_write_kb":233475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"130'2","reported_seq":30,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:20.838960+0000","last_change":"2024-05-30T07:01:20.838960+0000","last_active":"2024-05-30T07:01:20.838960+0000","last_peered":"2024-05-30T07:01:20.838960+0000","last_clean":"2024-05-30T07:01:20.838960+0000","last_became_active":"2024-05-30T06:59:07.017740+0000","last_became_peered":"2024-05-30T06:59:07.017740+0000","last_unstale":"2024-05-30T07:01:20.838960+0000","last_undegraded":"2024-05-30T07:01:20.838960+0000","last_fullsized":"2024-05-30T07:01:20.838960+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'2","last_scrub_stamp":"2024-05-30T07:01:20.838839+0000","last_deep_scrub":"130'2","last_deep_scrub_stamp":"2024-05-30T07:01:20.838839+0000","last_clean_scrub_stamp":"2024-05-30T07:01:20.838839+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:07:25.215938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"130'192","reported_seq":295,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:25.206727+0000","last_change":"2024-05-30T07:01:25.206771+0000","last_active":"2024-05-30T07:01:25.206727+0000","last_peered":"2024-05-30T07:01:25.206727+0000","last_clean":"2024-05-30T07:01:25.206727+0000","last_became_active":"2024-05-30T06:59:08.015370+0000","last_became_peered":"2024-05-30T06:59:08.015370+0000","last_unstale":"2024-05-30T07:01:25.206727+0000","last_undegraded":"2024-05-30T07:01:25.206727+0000","last_fullsized":"2024-05-30T07:01:25.206727+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'192","last_scrub_stamp":"2024-05-30T07:01:25.206647+0000","last_deep_scrub":"130'192","last_deep_scrub_stamp":"2024-05-30T07:01:25.206647+0000","last_clean_scrub_stamp":"2024-05-30T07:01:25.206647+0000","objects_scrubbed":59,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T16:07:44.748256+0000","scrub_duration":699,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247463936,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":75,"num_read_kb":307200,"num_write":87,"num_write_kb":299008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:22.958615+0000","last_change":"2024-05-30T07:01:22.958615+0000","last_active":"2024-05-30T07:01:22.958615+0000","last_peered":"2024-05-30T07:01:22.958615+0000","last_clean":"2024-05-30T07:01:22.958615+0000","last_became_active":"2024-05-30T06:59:07.023895+0000","last_became_peered":"2024-05-30T06:59:07.023895+0000","last_unstale":"2024-05-30T07:01:22.958615+0000","last_undegraded":"2024-05-30T07:01:22.958615+0000","last_fullsized":"2024-05-30T07:01:22.958615+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:22.958515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:22.958515+0000","last_clean_scrub_stamp":"2024-05-30T07:01:22.958515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:20:32.963436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"130'216","reported_seq":322,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:27.142787+0000","last_change":"2024-05-30T07:01:27.142908+0000","last_active":"2024-05-30T07:01:27.142787+0000","last_peered":"2024-05-30T07:01:27.142787+0000","last_clean":"2024-05-30T07:01:27.142787+0000","last_became_active":"2024-05-30T06:59:08.028959+0000","last_became_peered":"2024-05-30T06:59:08.028959+0000","last_unstale":"2024-05-30T07:01:27.142787+0000","last_undegraded":"2024-05-30T07:01:27.142787+0000","last_fullsized":"2024-05-30T07:01:27.142787+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'216","last_scrub_stamp":"2024-05-30T07:01:27.142708+0000","last_deep_scrub":"130'216","last_deep_scrub_stamp":"2024-05-30T07:01:27.142708+0000","last_clean_scrub_stamp":"2024-05-30T07:01:27.142708+0000","objects_scrubbed":74,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:52:06.606923+0000","scrub_duration":807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":98,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"130'4","reported_seq":32,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:20.938910+0000","last_change":"2024-05-30T07:01:20.938910+0000","last_active":"2024-05-30T07:01:20.938910+0000","last_peered":"2024-05-30T07:01:20.938910+0000","last_clean":"2024-05-30T07:01:20.938910+0000","last_became_active":"2024-05-30T06:59:07.019186+0000","last_became_peered":"2024-05-30T06:59:07.019186+0000","last_unstale":"2024-05-30T07:01:20.938910+0000","last_undegraded":"2024-05-30T07:01:20.938910+0000","last_fullsized":"2024-05-30T07:01:20.938910+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'4","last_scrub_stamp":"2024-05-30T07:01:20.938803+0000","last_deep_scrub":"130'4","last_deep_scrub_stamp":"2024-05-30T07:01:20.938803+0000","last_clean_scrub_stamp":"2024-05-30T07:01:20.938803+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:58:39.041263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"130'206","reported_seq":298,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:28.561297+0000","last_change":"2024-05-30T07:01:28.561413+0000","last_active":"2024-05-30T07:01:28.561297+0000","last_peered":"2024-05-30T07:01:28.561297+0000","last_clean":"2024-05-30T07:01:28.561297+0000","last_became_active":"2024-05-30T06:59:08.034951+0000","last_became_peered":"2024-05-30T06:59:08.034951+0000","last_unstale":"2024-05-30T07:01:28.561297+0000","last_undegraded":"2024-05-30T07:01:28.561297+0000","last_fullsized":"2024-05-30T07:01:28.561297+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'206","last_scrub_stamp":"2024-05-30T07:01:28.561181+0000","last_deep_scrub":"130'206","last_deep_scrub_stamp":"2024-05-30T07:01:28.561181+0000","last_clean_scrub_stamp":"2024-05-30T07:01:28.561181+0000","objects_scrubbed":68,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:10.096695+0000","scrub_duration":851,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018629,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":64,"num_read_kb":245764,"num_write":90,"num_write_kb":315394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:20.723071+0000","last_change":"2024-05-30T07:01:20.723090+0000","last_active":"2024-05-30T07:01:20.723071+0000","last_peered":"2024-05-30T07:01:20.723071+0000","last_clean":"2024-05-30T07:01:20.723071+0000","last_became_active":"2024-05-30T06:59:07.016202+0000","last_became_peered":"2024-05-30T06:59:07.016202+0000","last_unstale":"2024-05-30T07:01:20.723071+0000","last_undegraded":"2024-05-30T07:01:20.723071+0000","last_fullsized":"2024-05-30T07:01:20.723071+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:20.723009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:20.723009+0000","last_clean_scrub_stamp":"2024-05-30T07:01:20.723009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:58:57.989348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"130'227","reported_seq":301,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:29.255569+0000","last_change":"2024-05-30T07:01:29.255665+0000","last_active":"2024-05-30T07:01:29.255569+0000","last_peered":"2024-05-30T07:01:29.255569+0000","last_clean":"2024-05-30T07:01:29.255569+0000","last_became_active":"2024-05-30T06:59:08.022436+0000","last_became_peered":"2024-05-30T06:59:08.022436+0000","last_unstale":"2024-05-30T07:01:29.255569+0000","last_undegraded":"2024-05-30T07:01:29.255569+0000","last_fullsized":"2024-05-30T07:01:29.255569+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'227","last_scrub_stamp":"2024-05-30T07:01:29.255451+0000","last_deep_scrub":"130'227","last_deep_scrub_stamp":"2024-05-30T07:01:29.255451+0000","last_clean_scrub_stamp":"2024-05-30T07:01:29.255451+0000","objects_scrubbed":72,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T09:30:20.831854+0000","scrub_duration":747,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":46,"num_read_kb":180226,"num_write":102,"num_write_kb":352257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:21.772384+0000","last_change":"2024-05-30T07:01:21.772402+0000","last_active":"2024-05-30T07:01:21.772384+0000","last_peered":"2024-05-30T07:01:21.772384+0000","last_clean":"2024-05-30T07:01:21.772384+0000","last_became_active":"2024-05-30T06:59:07.017037+0000","last_became_peered":"2024-05-30T06:59:07.017037+0000","last_unstale":"2024-05-30T07:01:21.772384+0000","last_undegraded":"2024-05-30T07:01:21.772384+0000","last_fullsized":"2024-05-30T07:01:21.772384+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:21.772303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:21.772303+0000","last_clean_scrub_stamp":"2024-05-30T07:01:21.772303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:59:07.021224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"130'182","reported_seq":270,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:29.495882+0000","last_change":"2024-05-30T07:01:29.495916+0000","last_active":"2024-05-30T07:01:29.495882+0000","last_peered":"2024-05-30T07:01:29.495882+0000","last_clean":"2024-05-30T07:01:29.495882+0000","last_became_active":"2024-05-30T06:59:08.038486+0000","last_became_peered":"2024-05-30T06:59:08.038486+0000","last_unstale":"2024-05-30T07:01:29.495882+0000","last_undegraded":"2024-05-30T07:01:29.495882+0000","last_fullsized":"2024-05-30T07:01:29.495882+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'182","last_scrub_stamp":"2024-05-30T07:01:29.495815+0000","last_deep_scrub":"130'182","last_deep_scrub_stamp":"2024-05-30T07:01:29.495815+0000","last_clean_scrub_stamp":"2024-05-30T07:01:29.495815+0000","objects_scrubbed":54,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:02:26.277263+0000","scrub_duration":671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":226492416,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":60,"num_read_kb":245760,"num_write":76,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"130'1","reported_seq":29,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:18.603535+0000","last_change":"2024-05-30T07:01:18.603535+0000","last_active":"2024-05-30T07:01:18.603535+0000","last_peered":"2024-05-30T07:01:18.603535+0000","last_clean":"2024-05-30T07:01:18.603535+0000","last_became_active":"2024-05-30T06:59:07.017946+0000","last_became_peered":"2024-05-30T06:59:07.017946+0000","last_unstale":"2024-05-30T07:01:18.603535+0000","last_undegraded":"2024-05-30T07:01:18.603535+0000","last_fullsized":"2024-05-30T07:01:18.603535+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'1","last_scrub_stamp":"2024-05-30T07:01:18.603436+0000","last_deep_scrub":"130'1","last_deep_scrub_stamp":"2024-05-30T07:01:18.603436+0000","last_clean_scrub_stamp":"2024-05-30T07:01:18.603436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:00.138950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"130'219","reported_seq":283,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:25.522184+0000","last_change":"2024-05-30T07:01:25.522253+0000","last_active":"2024-05-30T07:01:25.522184+0000","last_peered":"2024-05-30T07:01:25.522184+0000","last_clean":"2024-05-30T07:01:25.522184+0000","last_became_active":"2024-05-30T06:59:08.025557+0000","last_became_peered":"2024-05-30T06:59:08.025557+0000","last_unstale":"2024-05-30T07:01:25.522184+0000","last_undegraded":"2024-05-30T07:01:25.522184+0000","last_fullsized":"2024-05-30T07:01:25.522184+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'219","last_scrub_stamp":"2024-05-30T07:01:25.522114+0000","last_deep_scrub":"130'219","last_deep_scrub_stamp":"2024-05-30T07:01:25.522114+0000","last_clean_scrub_stamp":"2024-05-30T07:01:25.522114+0000","objects_scrubbed":72,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:03:49.570037+0000","scrub_duration":731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":36,"num_read_kb":147456,"num_write":100,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"130'3","reported_seq":31,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:19.196446+0000","last_change":"2024-05-30T07:01:19.196469+0000","last_active":"2024-05-30T07:01:19.196446+0000","last_peered":"2024-05-30T07:01:19.196446+0000","last_clean":"2024-05-30T07:01:19.196446+0000","last_became_active":"2024-05-30T06:59:07.018769+0000","last_became_peered":"2024-05-30T06:59:07.018769+0000","last_unstale":"2024-05-30T07:01:19.196446+0000","last_undegraded":"2024-05-30T07:01:19.196446+0000","last_fullsized":"2024-05-30T07:01:19.196446+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'3","last_scrub_stamp":"2024-05-30T07:01:19.196378+0000","last_deep_scrub":"130'3","last_deep_scrub_stamp":"2024-05-30T07:01:19.196378+0000","last_clean_scrub_stamp":"2024-05-30T07:01:19.196378+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:26:31.647417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"130'204","reported_seq":311,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:29.209928+0000","last_change":"2024-05-30T07:01:29.210025+0000","last_active":"2024-05-30T07:01:29.209928+0000","last_peered":"2024-05-30T07:01:29.209928+0000","last_clean":"2024-05-30T07:01:29.209928+0000","last_became_active":"2024-05-30T06:59:08.032647+0000","last_became_peered":"2024-05-30T06:59:08.032647+0000","last_unstale":"2024-05-30T07:01:29.209928+0000","last_undegraded":"2024-05-30T07:01:29.209928+0000","last_fullsized":"2024-05-30T07:01:29.209928+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'204","last_scrub_stamp":"2024-05-30T07:01:29.209820+0000","last_deep_scrub":"130'204","last_deep_scrub_stamp":"2024-05-30T07:01:29.209820+0000","last_clean_scrub_stamp":"2024-05-30T07:01:29.209820+0000","objects_scrubbed":68,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T17:54:45.600957+0000","scrub_duration":867,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":79,"num_read_kb":323584,"num_write":90,"num_write_kb":323584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"130'36","reported_seq":64,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:22.053497+0000","last_change":"2024-05-30T07:01:21.961850+0000","last_active":"2024-05-30T07:01:22.053497+0000","last_peered":"2024-05-30T07:01:22.053497+0000","last_clean":"2024-05-30T07:01:22.053497+0000","last_became_active":"2024-05-30T06:59:07.020771+0000","last_became_peered":"2024-05-30T06:59:07.020771+0000","last_unstale":"2024-05-30T07:01:22.053497+0000","last_undegraded":"2024-05-30T07:01:22.053497+0000","last_fullsized":"2024-05-30T07:01:22.053497+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'34","last_scrub_stamp":"2024-05-30T07:01:21.961708+0000","last_deep_scrub":"130'34","last_deep_scrub_stamp":"2024-05-30T07:01:21.961708+0000","last_clean_scrub_stamp":"2024-05-30T07:01:21.961708+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:20:44.096428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1005,"num_omap_keys":17,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"130'199","reported_seq":319,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:32.998561+0000","last_change":"2024-05-30T07:01:32.998612+0000","last_active":"2024-05-30T07:01:32.998561+0000","last_peered":"2024-05-30T07:01:32.998561+0000","last_clean":"2024-05-30T07:01:32.998561+0000","last_became_active":"2024-05-30T06:59:08.038465+0000","last_became_peered":"2024-05-30T06:59:08.038465+0000","last_unstale":"2024-05-30T07:01:32.998561+0000","last_undegraded":"2024-05-30T07:01:32.998561+0000","last_fullsized":"2024-05-30T07:01:32.998561+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'199","last_scrub_stamp":"2024-05-30T07:01:32.998487+0000","last_deep_scrub":"130'199","last_deep_scrub_stamp":"2024-05-30T07:01:32.998487+0000","last_clean_scrub_stamp":"2024-05-30T07:01:32.998487+0000","objects_scrubbed":68,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:08:47.895050+0000","scrub_duration":435,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285212672,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":92,"num_read_kb":376832,"num_write":84,"num_write_kb":307201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:18.564840+0000","last_change":"2024-05-30T07:01:18.564858+0000","last_active":"2024-05-30T07:01:18.564840+0000","last_peered":"2024-05-30T07:01:18.564840+0000","last_clean":"2024-05-30T07:01:18.564840+0000","last_became_active":"2024-05-30T06:59:07.019061+0000","last_became_peered":"2024-05-30T06:59:07.019061+0000","last_unstale":"2024-05-30T07:01:18.564840+0000","last_undegraded":"2024-05-30T07:01:18.564840+0000","last_fullsized":"2024-05-30T07:01:18.564840+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:18.564757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:18.564757+0000","last_clean_scrub_stamp":"2024-05-30T07:01:18.564757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:23:53.650353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"130'205","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:27.463817+0000","last_change":"2024-05-30T07:01:27.463870+0000","last_active":"2024-05-30T07:01:27.463817+0000","last_peered":"2024-05-30T07:01:27.463817+0000","last_clean":"2024-05-30T07:01:27.463817+0000","last_became_active":"2024-05-30T06:59:08.030918+0000","last_became_peered":"2024-05-30T06:59:08.030918+0000","last_unstale":"2024-05-30T07:01:27.463817+0000","last_undegraded":"2024-05-30T07:01:27.463817+0000","last_fullsized":"2024-05-30T07:01:27.463817+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'205","last_scrub_stamp":"2024-05-30T07:01:27.463720+0000","last_deep_scrub":"130'205","last_deep_scrub_stamp":"2024-05-30T07:01:27.463720+0000","last_clean_scrub_stamp":"2024-05-30T07:01:27.463720+0000","objects_scrubbed":62,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:19:13.298300+0000","scrub_duration":711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":247464319,"num_objects":62,"num_object_clones":1,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":1,"num_read":49,"num_read_kb":200704,"num_write":96,"num_write_kb":307203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:20.654576+0000","last_change":"2024-05-30T07:01:20.654612+0000","last_active":"2024-05-30T07:01:20.654576+0000","last_peered":"2024-05-30T07:01:20.654576+0000","last_clean":"2024-05-30T07:01:20.654576+0000","last_became_active":"2024-05-30T06:59:07.019991+0000","last_became_peered":"2024-05-30T06:59:07.019991+0000","last_unstale":"2024-05-30T07:01:20.654576+0000","last_undegraded":"2024-05-30T07:01:20.654576+0000","last_fullsized":"2024-05-30T07:01:20.654576+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:20.654486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:20.654486+0000","last_clean_scrub_stamp":"2024-05-30T07:01:20.654486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T11:56:30.438380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"130'226","reported_seq":313,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:28.855344+0000","last_change":"2024-05-30T07:01:28.855372+0000","last_active":"2024-05-30T07:01:28.855344+0000","last_peered":"2024-05-30T07:01:28.855344+0000","last_clean":"2024-05-30T07:01:28.855344+0000","last_became_active":"2024-05-30T06:59:08.038380+0000","last_became_peered":"2024-05-30T06:59:08.038380+0000","last_unstale":"2024-05-30T07:01:28.855344+0000","last_undegraded":"2024-05-30T07:01:28.855344+0000","last_fullsized":"2024-05-30T07:01:28.855344+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'226","last_scrub_stamp":"2024-05-30T07:01:28.855272+0000","last_deep_scrub":"130'226","last_deep_scrub_stamp":"2024-05-30T07:01:28.855272+0000","last_clean_scrub_stamp":"2024-05-30T07:01:28.855272+0000","objects_scrubbed":76,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T08:53:26.846919+0000","scrub_duration":1007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":57,"num_read_kb":233472,"num_write":100,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:20.547585+0000","last_change":"2024-05-30T07:01:20.547655+0000","last_active":"2024-05-30T07:01:20.547585+0000","last_peered":"2024-05-30T07:01:20.547585+0000","last_clean":"2024-05-30T07:01:20.547585+0000","last_became_active":"2024-05-30T06:59:07.022933+0000","last_became_peered":"2024-05-30T06:59:07.022933+0000","last_unstale":"2024-05-30T07:01:20.547585+0000","last_undegraded":"2024-05-30T07:01:20.547585+0000","last_fullsized":"2024-05-30T07:01:20.547585+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:20.547495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:20.547495+0000","last_clean_scrub_stamp":"2024-05-30T07:01:20.547495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T13:24:14.703681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"130'246","reported_seq":362,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:28.976681+0000","last_change":"2024-05-30T07:01:28.976745+0000","last_active":"2024-05-30T07:01:28.976681+0000","last_peered":"2024-05-30T07:01:28.976681+0000","last_clean":"2024-05-30T07:01:28.976681+0000","last_became_active":"2024-05-30T06:59:08.037505+0000","last_became_peered":"2024-05-30T06:59:08.037505+0000","last_unstale":"2024-05-30T07:01:28.976681+0000","last_undegraded":"2024-05-30T07:01:28.976681+0000","last_fullsized":"2024-05-30T07:01:28.976681+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'246","last_scrub_stamp":"2024-05-30T07:01:28.976540+0000","last_deep_scrub":"130'246","last_deep_scrub_stamp":"2024-05-30T07:01:28.976540+0000","last_clean_scrub_stamp":"2024-05-30T07:01:28.976540+0000","objects_scrubbed":79,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:43:59.584861+0000","scrub_duration":1035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":86,"num_read_kb":335876,"num_write":115,"num_write_kb":393217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:24.004635+0000","last_change":"2024-05-30T07:01:24.004660+0000","last_active":"2024-05-30T07:01:24.004635+0000","last_peered":"2024-05-30T07:01:24.004635+0000","last_clean":"2024-05-30T07:01:24.004635+0000","last_became_active":"2024-05-30T06:59:07.025651+0000","last_became_peered":"2024-05-30T06:59:07.025651+0000","last_unstale":"2024-05-30T07:01:24.004635+0000","last_undegraded":"2024-05-30T07:01:24.004635+0000","last_fullsized":"2024-05-30T07:01:24.004635+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:24.004484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:24.004484+0000","last_clean_scrub_stamp":"2024-05-30T07:01:24.004484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:40:49.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"130'212","reported_seq":313,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:26.562579+0000","last_change":"2024-05-30T07:01:26.562648+0000","last_active":"2024-05-30T07:01:26.562579+0000","last_peered":"2024-05-30T07:01:26.562579+0000","last_clean":"2024-05-30T07:01:26.562579+0000","last_became_active":"2024-05-30T06:59:08.022036+0000","last_became_peered":"2024-05-30T06:59:08.022036+0000","last_unstale":"2024-05-30T07:01:26.562579+0000","last_undegraded":"2024-05-30T07:01:26.562579+0000","last_fullsized":"2024-05-30T07:01:26.562579+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'212","last_scrub_stamp":"2024-05-30T07:01:26.562506+0000","last_deep_scrub":"130'212","last_deep_scrub_stamp":"2024-05-30T07:01:26.562506+0000","last_clean_scrub_stamp":"2024-05-30T07:01:26.562506+0000","objects_scrubbed":69,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T14:40:51.932053+0000","scrub_duration":779,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":73,"num_read_kb":299008,"num_write":97,"num_write_kb":339968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"130'30","reported_seq":87,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:18.775669+0000","last_change":"2024-05-30T07:01:18.775691+0000","last_active":"2024-05-30T07:01:18.775669+0000","last_peered":"2024-05-30T07:01:18.775669+0000","last_clean":"2024-05-30T07:01:18.775669+0000","last_became_active":"2024-05-30T06:59:07.011981+0000","last_became_peered":"2024-05-30T06:59:07.011981+0000","last_unstale":"2024-05-30T07:01:18.775669+0000","last_undegraded":"2024-05-30T07:01:18.775669+0000","last_fullsized":"2024-05-30T07:01:18.775669+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'30","last_scrub_stamp":"2024-05-30T07:01:18.775594+0000","last_deep_scrub":"130'30","last_deep_scrub_stamp":"2024-05-30T07:01:18.775594+0000","last_clean_scrub_stamp":"2024-05-30T07:01:18.775594+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:02:41.176158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4755,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":29,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"130'227","reported_seq":334,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:31.230924+0000","last_change":"2024-05-30T07:01:31.231000+0000","last_active":"2024-05-30T07:01:31.230924+0000","last_peered":"2024-05-30T07:01:31.230924+0000","last_clean":"2024-05-30T07:01:31.230924+0000","last_became_active":"2024-05-30T06:59:08.035993+0000","last_became_peered":"2024-05-30T06:59:08.035993+0000","last_unstale":"2024-05-30T07:01:31.230924+0000","last_undegraded":"2024-05-30T07:01:31.230924+0000","last_fullsized":"2024-05-30T07:01:31.230924+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'227","last_scrub_stamp":"2024-05-30T07:01:31.230842+0000","last_deep_scrub":"130'227","last_deep_scrub_stamp":"2024-05-30T07:01:31.230842+0000","last_clean_scrub_stamp":"2024-05-30T07:01:31.230842+0000","objects_scrubbed":79,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T07:56:52.431840+0000","scrub_duration":659,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331350016,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":78,"num_read_kb":319488,"num_write":113,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":28,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:17.630220+0000","last_change":"2024-05-30T07:01:17.630258+0000","last_active":"2024-05-30T07:01:17.630220+0000","last_peered":"2024-05-30T07:01:17.630220+0000","last_clean":"2024-05-30T07:01:17.630220+0000","last_became_active":"2024-05-30T06:59:07.017622+0000","last_became_peered":"2024-05-30T06:59:07.017622+0000","last_unstale":"2024-05-30T07:01:17.630220+0000","last_undegraded":"2024-05-30T07:01:17.630220+0000","last_fullsized":"2024-05-30T07:01:17.630220+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-30T07:01:17.630087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-30T07:01:17.630087+0000","last_clean_scrub_stamp":"2024-05-30T07:01:17.630087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T15:19:03.464667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"130'177","reported_seq":255,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:27.573685+0000","last_change":"2024-05-30T07:01:27.573685+0000","last_active":"2024-05-30T07:01:27.573685+0000","last_peered":"2024-05-30T07:01:27.573685+0000","last_clean":"2024-05-30T07:01:27.573685+0000","last_became_active":"2024-05-30T06:59:08.033874+0000","last_became_peered":"2024-05-30T06:59:08.033874+0000","last_unstale":"2024-05-30T07:01:27.573685+0000","last_undegraded":"2024-05-30T07:01:27.573685+0000","last_fullsized":"2024-05-30T07:01:27.573685+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'177","last_scrub_stamp":"2024-05-30T07:01:27.573545+0000","last_deep_scrub":"130'177","last_deep_scrub_stamp":"2024-05-30T07:01:27.573545+0000","last_clean_scrub_stamp":"2024-05-30T07:01:27.573545+0000","objects_scrubbed":53,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T12:55:55.408449+0000","scrub_duration":675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222298112,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":50,"num_read_kb":204800,"num_write":77,"num_write_kb":266240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"130'4","reported_seq":32,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:24.969502+0000","last_change":"2024-05-30T07:01:24.969502+0000","last_active":"2024-05-30T07:01:24.969502+0000","last_peered":"2024-05-30T07:01:24.969502+0000","last_clean":"2024-05-30T07:01:24.969502+0000","last_became_active":"2024-05-30T06:59:07.027219+0000","last_became_peered":"2024-05-30T06:59:07.027219+0000","last_unstale":"2024-05-30T07:01:24.969502+0000","last_undegraded":"2024-05-30T07:01:24.969502+0000","last_fullsized":"2024-05-30T07:01:24.969502+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'4","last_scrub_stamp":"2024-05-30T07:01:24.969385+0000","last_deep_scrub":"130'4","last_deep_scrub_stamp":"2024-05-30T07:01:24.969385+0000","last_clean_scrub_stamp":"2024-05-30T07:01:24.969385+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T18:52:10.617312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"130'119","reported_seq":392,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-05-30T07:01:20.998209+0000","last_change":"2024-05-30T07:01:20.998242+0000","last_active":"2024-05-30T07:01:20.998209+0000","last_peered":"2024-05-30T07:01:20.998209+0000","last_clean":"2024-05-30T07:01:20.998209+0000","last_became_active":"2024-05-30T06:42:00.031723+0000","last_became_peered":"2024-05-30T06:42:00.031723+0000","last_unstale":"2024-05-30T07:01:20.998209+0000","last_undegraded":"2024-05-30T07:01:20.998209+0000","last_fullsized":"2024-05-30T07:01:20.998209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"130'119","last_scrub_stamp":"2024-05-30T07:01:20.998131+0000","last_deep_scrub":"130'119","last_deep_scrub_stamp":"2024-05-30T07:01:20.998131+0000","last_clean_scrub_stamp":"2024-05-30T07:01:20.998131+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-31T10:17:02.533645+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":16844326603,"num_objects":4025,"num_object_clones":1,"num_object_copies":8050,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4025,"num_whiteouts":1,"num_read":4099,"num_read_kb":16560184,"num_write":5631,"num_write_kb":19595307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":134217728,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33688715264,"data_stored":33688653206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12665,"ondisk_log_size":12665,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1707992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":617,"num_write_kb":1900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6005,"num_omap_keys":27,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3481600,"data_stored":3415984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":591,"ondisk_log_size":591,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575087,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3747732,"kb_used_data":3608332,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":90624108,"statfs":{"total":96636764160,"available":92799086592,"internally_reserved":0,"allocated":3694931968,"data_stored":3693996414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":142735818},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575088,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4685140,"kb_used_data":4545740,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":89686700,"statfs":{"total":96636764160,"available":91839180800,"internally_reserved":0,"allocated":4654837760,"data_stored":4653906172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":142735814},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575088,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3585808,"kb_used_data":3442248,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":90786032,"statfs":{"total":96636764160,"available":92964896768,"internally_reserved":0,"allocated":3524861952,"data_stored":3523931494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575087,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5174988,"kb_used_data":5035588,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":89196852,"statfs":{"total":96636764160,"available":91337576448,"internally_reserved":0,"allocated":5156442112,"data_stored":5155515779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575087,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4103504,"kb_used_data":3946056,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":90268336,"statfs":{"total":96636764160,"available":92434776064,"internally_reserved":0,"allocated":4040761344,"data_stored":4039835296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":161216967},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575086,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5371592,"kb_used_data":5232192,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":89000248,"statfs":{"total":96636764160,"available":91136253952,"internally_reserved":0,"allocated":5357764608,"data_stored":5356842395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575088,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3843704,"kb_used_data":3708464,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":90528136,"statfs":{"total":96636764160,"available":92700811264,"internally_reserved":0,"allocated":3797467136,"data_stored":3796560308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575088,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3545468,"kb_used_data":3397748,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":90826372,"statfs":{"total":96636764160,"available":93006204928,"internally_reserved":0,"allocated":3479293952,"data_stored":3478383572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1720320,"data_stored":1707194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1724416,"data_stored":1703077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3477078016,"data_stored":3477078016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":3795845120,"data_stored":3795845120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5356134400,"data_stored":5356126591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4039122944,"data_stored":4039115193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5154816000,"data_stored":5154800521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3523231744,"data_stored":3523216194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4651495424,"data_stored":4651483790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3690991616,"data_stored":3690987781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-30T07:01:41.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-30T07:01:41.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.512+0000 7fac20a00640 1 Processor -- start 2024-05-30T07:01:41.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.512+0000 7fac20a00640 1 -- start start 2024-05-30T07:01:41.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac20a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c144fe0 0x7fac1c15f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac20a00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1c0cf430 con 0x7fac1c06f660 2024-05-30T07:01:41.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac20a00640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1c0cf6f0 con 0x7fac1c144c00 2024-05-30T07:01:41.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac20a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fac1c0b3bf0 con 0x7fac1c144fe0 2024-05-30T07:01:41.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1be00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fac1c06f660 0x7fac1c15f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60372/0 (socket says 172.21.15.37:60372) 2024-05-30T07:01:41.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1be00640 1 -- 172.21.15.37:0/3618904899 learned_addr learned my addr 172.21.15.37:0/3618904899 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-05-30T07:01:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1aa00640 1 --2- 172.21.15.37:0/3618904899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c144fe0 0x7fac1c15f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1129153080 0 0) 0x7fac1c0cf430 con 0x7fac1c06f660 2024-05-30T07:01:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac00005740 con 0x7fac1c06f660 2024-05-30T07:01:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353088660 0 0) 0x7fac1c0cf6f0 con 0x7fac1c144c00 2024-05-30T07:01:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac1c0cf430 con 0x7fac1c144c00 2024-05-30T07:01:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 731616131 0 0) 0x7fac00005740 con 0x7fac1c06f660 2024-05-30T07:01:41.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c144fe0 msgr2=0x7fac1c15f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:41.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 --2- 172.21.15.37:0/3618904899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c144fe0 0x7fac1c15f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 >> v1:172.21.15.105:6789/0 conn(0x7fac1c144c00 legacy=0x7fac1c06ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c0cf9d0 con 0x7fac1c06f660 2024-05-30T07:01:41.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 543690297 0 0) 0x7fac14001980 con 0x7fac1c06f660 2024-05-30T07:01:41.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1aa00640 1 --2- 172.21.15.37:0/3618904899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c144fe0 0x7fac1c15f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-30T07:01:41.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 >> v1:172.21.15.37:6789/0 conn(0x7fac1c06f660 legacy=0x7fac1c15f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 --2- 172.21.15.37:0/3618904899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac00005d90 0x7fac00006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 --2- 172.21.15.37:0/3618904899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c144fe0 0x7fac00006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 --2- 172.21.15.37:0/3618904899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac00006f60 0x7fac000073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fac0000dc90 con 0x7fac00006f60 2024-05-30T07:01:41.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fac0000de10 con 0x7fac00005d90 2024-05-30T07:01:41.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fac0000e010 con 0x7fac1c144fe0 2024-05-30T07:01:41.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1be00640 1 --2- 172.21.15.37:0/3618904899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac00006f60 0x7fac000073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1b400640 1 --2- 172.21.15.37:0/3618904899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac00005d90 0x7fac00006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1aa00640 1 --2- 172.21.15.37:0/3618904899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c144fe0 0x7fac00006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1be00640 1 -- 172.21.15.37:0/3618904899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c144fe0 msgr2=0x7fac00006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1be00640 1 --2- 172.21.15.37:0/3618904899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c144fe0 0x7fac00006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1be00640 1 -- 172.21.15.37:0/3618904899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac00005d90 msgr2=0x7fac00006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1be00640 1 --2- 172.21.15.37:0/3618904899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac00005d90 0x7fac00006190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.516+0000 7fac1be00640 1 -- 172.21.15.37:0/3618904899 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac00005740 con 0x7fac00006f60 2024-05-30T07:01:41.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.520+0000 7fac1be00640 1 --2- 172.21.15.37:0/3618904899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac00006f60 0x7fac000073e0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7fac1400a690 tx=0x7fac1401f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941ef009a5c8a2b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:41.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.520+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1400a2b0 con 0x7fac00006f60 2024-05-30T07:01:41.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.520+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac140b2070 con 0x7fac00006f60 2024-05-30T07:01:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.520+0000 7fac1a000640 1 -- 172.21.15.37:0/3618904899 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac140ad8a0 con 0x7fac00006f60 2024-05-30T07:01:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.520+0000 7fac20a00640 1 -- 172.21.15.37:0/3618904899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac00006f60 msgr2=0x7fac000073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.520+0000 7fac20a00640 1 --2- 172.21.15.37:0/3618904899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac00006f60 0x7fac000073e0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7fac1400a690 tx=0x7fac1401f900 comp rx=0 tx=0).stop 2024-05-30T07:01:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.520+0000 7fac1be00640 1 -- 172.21.15.37:0/3618904899 reap_dead start 2024-05-30T07:01:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.520+0000 7fac20a00640 1 -- 172.21.15.37:0/3618904899 shutdown_connections 2024-05-30T07:01:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.520+0000 7fac20a00640 1 -- 172.21.15.37:0/3618904899 >> 172.21.15.37:0/3618904899 conn(0x7fac1c067d60 msgr2=0x7fac1c06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.520+0000 7fac20a00640 1 -- 172.21.15.37:0/3618904899 shutdown_connections 2024-05-30T07:01:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.520+0000 7fac20a00640 1 -- 172.21.15.37:0/3618904899 wait complete. 2024-05-30T07:01:41.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.520+0000 7fac20a00640 1 Processor -- start 2024-05-30T07:01:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.520+0000 7fac20a00640 1 -- start start 2024-05-30T07:01:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac20a00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac1c1e5c00 0x7fac1c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac20a00640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c1e5fe0 0x7fac1c0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac20a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1c1f4580 0x7fac1c1f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac20a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c15f500 con 0x7fac1c1f4580 2024-05-30T07:01:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac20a00640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c0d01d0 con 0x7fac1c1e5c00 2024-05-30T07:01:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac20a00640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fac1c0b1810 con 0x7fac1c1e5fe0 2024-05-30T07:01:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac1be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1c1f4580 0x7fac1c1f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac1be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1c1f4580 0x7fac1c1f4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37562/0 (socket says 172.21.15.37:37562) 2024-05-30T07:01:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac1be00640 1 -- 172.21.15.37:0/3582963192 learned_addr learned my addr 172.21.15.37:0/3582963192 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac1aa00640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c1e5fe0 0x7fac1c0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac1b400640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac1c1e5c00 0x7fac1c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac1be00640 1 -- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c1e5fe0 msgr2=0x7fac1c0b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac1be00640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c1e5fe0 0x7fac1c0b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac1be00640 1 -- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac1c1e5c00 msgr2=0x7fac1c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac1be00640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac1c1e5c00 0x7fac1c0b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac1be00640 1 -- 172.21.15.37:0/3582963192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c0b1a80 con 0x7fac1c1f4580 2024-05-30T07:01:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac1be00640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1c1f4580 0x7fac1c1f4a00 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fac1400a690 tx=0x7fac00007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:41.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac13400640 1 -- 172.21.15.37:0/3582963192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac140011d0 con 0x7fac1c1f4580 2024-05-30T07:01:41.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac13400640 1 -- 172.21.15.37:0/3582963192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac140ba070 con 0x7fac1c1f4580 2024-05-30T07:01:41.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac13400640 1 -- 172.21.15.37:0/3582963192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac14001e30 con 0x7fac1c1f4580 2024-05-30T07:01:41.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac20a00640 1 -- 172.21.15.37:0/3582963192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1c0b1d60 con 0x7fac1c1f4580 2024-05-30T07:01:41.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac20a00640 1 -- 172.21.15.37:0/3582963192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1c0b2320 con 0x7fac1c1f4580 2024-05-30T07:01:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.524+0000 7fac20a00640 1 -- 172.21.15.37:0/3582963192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac1c072e10 con 0x7fac1c1f4580 2024-05-30T07:01:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.528+0000 7fac13400640 1 -- 172.21.15.37:0/3582963192 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 53) ==== 90741+0+0 (secure 0 0 0) 0x7fac140c5060 con 0x7fac1c1f4580 2024-05-30T07:01:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.528+0000 7fac13400640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabfc06a1e0 0x7fabfc06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.528+0000 7fac13400640 1 -- 172.21.15.37:0/3582963192 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7fac14122db0 con 0x7fac1c1f4580 2024-05-30T07:01:41.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.528+0000 7fac1b400640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabfc06a1e0 0x7fabfc06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.528+0000 7fac1b400640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabfc06a1e0 0x7fabfc06c6a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fac1c15ef80 tx=0x7fac0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:41.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.532+0000 7fac13400640 1 -- 172.21.15.37:0/3582963192 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fac1c072e10 con 0x7fac1c1f4580 2024-05-30T07:01:41.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.696+0000 7fac20a00640 1 -- 172.21.15.37:0/3582963192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fac1c0cd1f0 con 0x7fac1c1f4580 2024-05-30T07:01:41.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.700+0000 7fac13400640 1 -- 172.21.15.37:0/3582963192 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v30)=0 v30) ==== 123+0+0 (secure 0 0 0) 0x7fac14019610 con 0x7fac1c1f4580 2024-05-30T07:01:41.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.700+0000 7fac13400640 1 -- 172.21.15.37:0/3582963192 <== mon.0 v2:172.21.15.37:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fac140b2030 con 0x7fac1c1f4580 2024-05-30T07:01:41.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.704+0000 7fac20a00640 1 -- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabfc06a1e0 msgr2=0x7fabfc06c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.704+0000 7fac20a00640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabfc06a1e0 0x7fabfc06c6a0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fac1c15ef80 tx=0x7fac0c009040 comp rx=0 tx=0).stop 2024-05-30T07:01:41.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.704+0000 7fac20a00640 1 -- 172.21.15.37:0/3582963192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1c1f4580 msgr2=0x7fac1c1f4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.704+0000 7fac20a00640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1c1f4580 0x7fac1c1f4a00 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fac1400a690 tx=0x7fac00007a50 comp rx=0 tx=0).stop 2024-05-30T07:01:41.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.704+0000 7fac20a00640 1 -- 172.21.15.37:0/3582963192 shutdown_connections 2024-05-30T07:01:41.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.704+0000 7fac20a00640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1c1f4580 0x7fac1c1f4a00 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.704+0000 7fac20a00640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac1c1e5fe0 0x7fac1c0b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.704+0000 7fac20a00640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7fabfc06a1e0 0x7fabfc06c6a0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.704+0000 7fac20a00640 1 --2- 172.21.15.37:0/3582963192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac1c1e5c00 0x7fac1c0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.704+0000 7fac20a00640 1 -- 172.21.15.37:0/3582963192 >> 172.21.15.37:0/3582963192 conn(0x7fac1c067d60 msgr2=0x7fac1c06e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:41.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.704+0000 7fac20a00640 1 -- 172.21.15.37:0/3582963192 shutdown_connections 2024-05-30T07:01:41.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.704+0000 7fac20a00640 1 -- 172.21.15.37:0/3582963192 wait complete. 2024-05-30T07:01:41.725 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-30T07:01:41.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-30T07:01:41.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.864+0000 7f0738800640 1 Processor -- start 2024-05-30T07:01:41.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.864+0000 7f0738800640 1 -- start start 2024-05-30T07:01:41.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.864+0000 7f0738800640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f073015c8b0 0x7f07300cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.864+0000 7f0738800640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f073015cc90 0x7f073006f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.864+0000 7f0738800640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f073006e500 con 0x7f073006faa0 2024-05-30T07:01:41.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.864+0000 7f0738800640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f073006e7a0 con 0x7f073015cc90 2024-05-30T07:01:41.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.864+0000 7f0738800640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f073006ea80 con 0x7f073015c8b0 2024-05-30T07:01:41.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.864+0000 7f0735400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f073015cc90 0x7f073006f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.864+0000 7f0735400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f073015cc90 0x7f073006f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37566/0 (socket says 172.21.15.37:37566) 2024-05-30T07:01:41.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.864+0000 7f0735400640 1 -- 172.21.15.37:0/1492922197 learned_addr learned my addr 172.21.15.37:0/1492922197 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:41.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.868+0000 7f0735e00640 1 --2- 172.21.15.37:0/1492922197 >> v2:172.21.15.105:3300/0 conn(0x7f073015c8b0 0x7f07300cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.868+0000 7f0735400640 1 -- 172.21.15.37:0/1492922197 >> v2:172.21.15.105:3300/0 conn(0x7f073015c8b0 msgr2=0x7f07300cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-30T07:01:41.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.868+0000 7f0735400640 1 --2- 172.21.15.37:0/1492922197 >> v2:172.21.15.105:3300/0 conn(0x7f073015c8b0 0x7f07300cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.868+0000 7f0735400640 1 -- 172.21.15.37:0/1492922197 >> v1:172.21.15.105:6789/0 conn(0x7f073006faa0 legacy=0x7f0730160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.868+0000 7f0735400640 1 -- 172.21.15.37:0/1492922197 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073006ed60 con 0x7f073015cc90 2024-05-30T07:01:41.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.868+0000 7f0735400640 1 --2- 172.21.15.37:0/1492922197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073015cc90 0x7f073006f560 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f073006cbb0 tx=0x7f072001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99015fa6ee5a83c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:41.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.868+0000 7f0734a00640 1 -- 172.21.15.37:0/1492922197 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07200b0070 con 0x7f073015cc90 2024-05-30T07:01:41.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.868+0000 7f0734a00640 1 -- 172.21.15.37:0/1492922197 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f07200ab600 con 0x7f073015cc90 2024-05-30T07:01:41.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.868+0000 7f0734a00640 1 -- 172.21.15.37:0/1492922197 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07200ab9f0 con 0x7f073015cc90 2024-05-30T07:01:41.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 -- 172.21.15.37:0/1492922197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073015cc90 msgr2=0x7f073006f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 --2- 172.21.15.37:0/1492922197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073015cc90 0x7f073006f560 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f073006cbb0 tx=0x7f072001c490 comp rx=0 tx=0).stop 2024-05-30T07:01:41.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 -- 172.21.15.37:0/1492922197 shutdown_connections 2024-05-30T07:01:41.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 --2- 172.21.15.37:0/1492922197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073015cc90 0x7f073006f560 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 --2- 172.21.15.37:0/1492922197 >> v2:172.21.15.105:3300/0 conn(0x7f073015c8b0 0x7f07300cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 -- 172.21.15.37:0/1492922197 >> 172.21.15.37:0/1492922197 conn(0x7f07300b27b0 msgr2=0x7f07300b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:41.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 -- 172.21.15.37:0/1492922197 shutdown_connections 2024-05-30T07:01:41.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 -- 172.21.15.37:0/1492922197 wait complete. 2024-05-30T07:01:41.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 Processor -- start 2024-05-30T07:01:41.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 -- start start 2024-05-30T07:01:41.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f073006faa0 0x7f07300b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f073015c8b0 0x7f0730146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073015cc90 0x7f07301503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0730169760 con 0x7f073015cc90 2024-05-30T07:01:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f073015d330 con 0x7f073006faa0 2024-05-30T07:01:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0738800640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f07301698e0 con 0x7f073015c8b0 2024-05-30T07:01:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0736800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073015cc90 0x7f07301503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0735e00640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f073006faa0 0x7f07300b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0736800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073015cc90 0x7f07301503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37574/0 (socket says 172.21.15.37:37574) 2024-05-30T07:01:41.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0736800640 1 -- 172.21.15.37:0/3388534753 learned_addr learned my addr 172.21.15.37:0/3388534753 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-05-30T07:01:41.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0735400640 1 --2- 172.21.15.37:0/3388534753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f073015c8b0 0x7f0730146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0736800640 1 -- 172.21.15.37:0/3388534753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f073015c8b0 msgr2=0x7f0730146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0736800640 1 --2- 172.21.15.37:0/3388534753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f073015c8b0 0x7f0730146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0736800640 1 -- 172.21.15.37:0/3388534753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f073006faa0 msgr2=0x7f07300b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:41.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0736800640 1 --2- 172.21.15.37:0/3388534753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f073006faa0 0x7f07300b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:41.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0736800640 1 -- 172.21.15.37:0/3388534753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07300b4ba0 con 0x7f073015cc90 2024-05-30T07:01:41.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.872+0000 7f0736800640 1 --2- 172.21.15.37:0/3388534753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073015cc90 0x7f07301503e0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f072c00c7a0 tx=0x7f072c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:41.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.876+0000 7f072a000640 1 -- 172.21.15.37:0/3388534753 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c003b80 con 0x7f073015cc90 2024-05-30T07:01:41.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.876+0000 7f072a000640 1 -- 172.21.15.37:0/3388534753 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f072c003d20 con 0x7f073015cc90 2024-05-30T07:01:41.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.876+0000 7f072a000640 1 -- 172.21.15.37:0/3388534753 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c00aab0 con 0x7f073015cc90 2024-05-30T07:01:41.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.876+0000 7f0738800640 1 -- 172.21.15.37:0/3388534753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07300b4e80 con 0x7f073015cc90 2024-05-30T07:01:41.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.876+0000 7f0738800640 1 -- 172.21.15.37:0/3388534753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07300b5440 con 0x7f073015cc90 2024-05-30T07:01:41.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.876+0000 7f0738800640 1 -- 172.21.15.37:0/3388534753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0730068b20 con 0x7f073015cc90 2024-05-30T07:01:41.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.876+0000 7f072a000640 1 -- 172.21.15.37:0/3388534753 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 53) ==== 90741+0+0 (secure 0 0 0) 0x7f072c00ac50 con 0x7f073015cc90 2024-05-30T07:01:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.876+0000 7f072a000640 1 --2- 172.21.15.37:0/3388534753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f071406a1e0 0x7f071406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-30T07:01:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.876+0000 7f072a000640 1 -- 172.21.15.37:0/3388534753 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5851+0+0 (secure 0 0 0) 0x7f072c085870 con 0x7f073015cc90 2024-05-30T07:01:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.876+0000 7f0735e00640 1 --2- 172.21.15.37:0/3388534753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f071406a1e0 0x7f071406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-30T07:01:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.880+0000 7f0735e00640 1 --2- 172.21.15.37:0/3388534753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f071406a1e0 0x7f071406c6a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f0724009b60 tx=0x7f0724009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-30T07:01:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:41.880+0000 7f072a000640 1 -- 172.21.15.37:0/3388534753 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f072c0571b0 con 0x7f073015cc90 2024-05-30T07:01:42.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.080+0000 7f0738800640 1 -- 172.21.15.37:0/3388534753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07300b5fd0 con 0x7f073015cc90 2024-05-30T07:01:42.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.080+0000 7f072a000640 1 -- 172.21.15.37:0/3388534753 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5189 (secure 0 0 0) 0x7f072c05b4b0 con 0x7f073015cc90 2024-05-30T07:01:42.083 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-05-30T07:01:42.084 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7811,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6836/3965296503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3965296503},{"type":"v1","addr":"172.21.15.105:6836","nonce":3965296503}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":8980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1640764612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1640764612},{"type":"v1","addr":"172.21.15.37:6835","nonce":1640764612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79},{"gid":9720,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4045040277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4045040277},{"type":"v1","addr":"172.21.15.37:6834","nonce":4045040277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-30T06:59:07.409391+0000","modified":"2024-05-30T06:59:10.430545+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9729},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9729":{"gid":9729,"name":"d","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6837/2587102255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6835","nonce":2587102255},{"type":"v1","addr":"172.21.15.105:6837","nonce":2587102255}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9729,"qdb_cluster":[9729]},"id":9}]} 2024-05-30T07:01:42.084 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 85 2024-05-30T07:01:42.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.080+0000 7f0738800640 1 -- 172.21.15.37:0/3388534753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f071406a1e0 msgr2=0x7f071406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:42.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.080+0000 7f0738800640 1 --2- 172.21.15.37:0/3388534753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f071406a1e0 0x7f071406c6a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f0724009b60 tx=0x7f0724009190 comp rx=0 tx=0).stop 2024-05-30T07:01:42.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.080+0000 7f0738800640 1 -- 172.21.15.37:0/3388534753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073015cc90 msgr2=0x7f07301503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-30T07:01:42.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.080+0000 7f0738800640 1 --2- 172.21.15.37:0/3388534753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073015cc90 0x7f07301503e0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f072c00c7a0 tx=0x7f072c00cc60 comp rx=0 tx=0).stop 2024-05-30T07:01:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.080+0000 7f0738800640 1 -- 172.21.15.37:0/3388534753 shutdown_connections 2024-05-30T07:01:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.080+0000 7f0738800640 1 --2- 172.21.15.37:0/3388534753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f073015cc90 0x7f07301503e0 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.080+0000 7f0738800640 1 --2- 172.21.15.37:0/3388534753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f073015c8b0 0x7f0730146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.080+0000 7f0738800640 1 --2- 172.21.15.37:0/3388534753 >> [v2:172.21.15.105:6832/911132516,v1:172.21.15.105:6833/911132516] conn(0x7f071406a1e0 0x7f071406c6a0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.080+0000 7f0738800640 1 --2- 172.21.15.37:0/3388534753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f073006faa0 0x7f07300b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-30T07:01:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.080+0000 7f0738800640 1 -- 172.21.15.37:0/3388534753 >> 172.21.15.37:0/3388534753 conn(0x7f07300b27b0 msgr2=0x7f073015db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-30T07:01:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.084+0000 7f0738800640 1 -- 172.21.15.37:0/3388534753 shutdown_connections 2024-05-30T07:01:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-05-30T07:01:42.084+0000 7f0738800640 1 -- 172.21.15.37:0/3388534753 wait complete. 2024-05-30T07:01:42.105 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-30T07:01:42.105 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-30T07:01:42.105 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-30T07:01:42.105 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:01:42.117 INFO:tasks.ceph.mds.a:Stopped 2024-05-30T07:01:42.117 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-30T07:01:42.117 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:01:42.172 INFO:tasks.ceph.mds.c:Stopped 2024-05-30T07:01:42.172 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-30T07:01:42.172 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:01:42.185 INFO:tasks.ceph.mds.b:Stopped 2024-05-30T07:01:42.186 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-30T07:01:42.186 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:01:42.248 INFO:tasks.ceph.mds.d:Stopped 2024-05-30T07:01:42.248 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-30T07:01:42.249 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-30T07:01:42.249 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:01:45.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-05-30T07:01:48.351 INFO:tasks.ceph.osd.0:Stopped 2024-05-30T07:01:48.352 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-30T07:01:48.352 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:01:51.457 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-30T07:01:51.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-05-30T07:01:54.453 INFO:tasks.ceph.osd.1:Stopped 2024-05-30T07:01:54.454 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-30T07:01:54.454 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:01:54.551 INFO:tasks.ceph.osd.2:Stopped 2024-05-30T07:01:54.551 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-30T07:01:54.551 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:01:57.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-30T07:01:57.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-30T07:02:00.654 INFO:tasks.ceph.osd.3:Stopped 2024-05-30T07:02:00.654 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-30T07:02:00.654 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:02:00.743 INFO:tasks.ceph.osd.4:Stopped 2024-05-30T07:02:00.743 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-30T07:02:00.743 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:02:03.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-30T07:02:03.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-30T07:02:06.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T07:02:06.810 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T07:02:06.845 INFO:tasks.ceph.osd.5:Stopped 2024-05-30T07:02:06.846 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-30T07:02:06.846 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:02:08.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-30T07:02:08.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-30T07:02:12.947 INFO:tasks.ceph.osd.6:Stopped 2024-05-30T07:02:12.948 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-30T07:02:12.948 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:02:13.040 INFO:tasks.ceph.osd.7:Stopped 2024-05-30T07:02:13.040 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-30T07:02:13.041 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-30T07:02:13.041 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:02:13.098 INFO:tasks.ceph.mgr.y:Stopped 2024-05-30T07:02:13.098 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-30T07:02:13.098 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:02:13.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-05-30T07:02:13.981 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-30T07:02:19.200 INFO:tasks.ceph.mgr.x:Stopped 2024-05-30T07:02:19.201 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-30T07:02:19.201 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-30T07:02:19.201 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:02:19.226 INFO:tasks.ceph.mon.a:Stopped 2024-05-30T07:02:19.227 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-30T07:02:19.227 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:02:19.245 INFO:tasks.ceph.mon.b:Stopped 2024-05-30T07:02:19.246 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-30T07:02:19.246 INFO:teuthology.orchestra.run:waiting for 300 2024-05-30T07:02:19.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-05-30T07:02:19.307 INFO:tasks.ceph.mon.c:Stopped 2024-05-30T07:02:19.308 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-30T07:02:19.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-05-30T07:02:19.348 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T07:02:19.349 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-30T07:02:19.629 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T07:02:19.629 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-30T07:02:19.862 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T07:02:19.863 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-30T07:02:20.064 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T07:02:20.064 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-30T07:02:20.253 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi105.front.sepia.ceph.com 2024-05-30T07:02:20.253 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-30T07:02:20.524 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi105.front.sepia.ceph.com 2024-05-30T07:02:20.524 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-30T07:02:20.743 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi105.front.sepia.ceph.com 2024-05-30T07:02:20.743 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-30T07:02:20.944 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi105.front.sepia.ceph.com 2024-05-30T07:02:20.945 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-30T07:02:21.136 INFO:tasks.ceph:Archiving mon data... 2024-05-30T07:02:21.137 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027/data/mon.a.tgz 2024-05-30T07:02:21.138 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-05-30T07:02:21.147 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.4oMRPFu52k 2024-05-30T07:02:21.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4oMRPFu52k 2024-05-30T07:02:21.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.4oMRPFu52k 2024-05-30T07:02:21.585 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.4oMRPFu52k is 2MB 2024-05-30T07:02:21.672 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.4oMRPFu52k 2024-05-30T07:02:21.681 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027/data/mon.b.tgz 2024-05-30T07:02:21.681 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-05-30T07:02:21.690 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.uSXFVDNd4D 2024-05-30T07:02:21.690 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.uSXFVDNd4D 2024-05-30T07:02:22.058 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.uSXFVDNd4D 2024-05-30T07:02:22.131 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.uSXFVDNd4D is 2MB 2024-05-30T07:02:22.211 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.uSXFVDNd4D 2024-05-30T07:02:22.220 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027/data/mon.c.tgz 2024-05-30T07:02:22.220 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-05-30T07:02:22.271 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.A3pDTjseiK 2024-05-30T07:02:22.272 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.A3pDTjseiK 2024-05-30T07:02:22.634 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.A3pDTjseiK 2024-05-30T07:02:22.712 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.A3pDTjseiK is 2MB 2024-05-30T07:02:22.795 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.A3pDTjseiK 2024-05-30T07:02:22.804 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-30T07:02:22.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-30T07:02:22.808 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-30T07:02:22.877 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-30T07:02:22.915 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-30T07:02:22.915 INFO:tasks.ceph:Archiving crash dumps... 2024-05-30T07:02:22.916 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027/remote/smithi037/crash 2024-05-30T07:02:22.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-30T07:02:22.942 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027/remote/smithi105/crash 2024-05-30T07:02:22.943 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-30T07:02:22.973 INFO:tasks.ceph:Shutting down logrotate 2024-05-30T07:02:22.973 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T07:02:22.987 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-30T07:02:23.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-30T07:02:23.084 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-30T07:02:23.103 INFO:tasks.ceph:Compressing logs... 2024-05-30T07:02:23.103 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-30T07:02:23.135 DEBUG:teuthology.orchestra.run.smithi105:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-30T07:02:23.167 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51485.log 2024-05-30T07:02:23.168 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43958.log 2024-05-30T07:02:23.169 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45128.log 2024-05-30T07:02:23.169 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51485.log.gz 2024-05-30T07:02:23.170 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40983.log 2024-05-30T07:02:23.170 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43958.log.gz 2024-05-30T07:02:23.171 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46158.log 2024-05-30T07:02:23.171 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45128.log.gz 2024-05-30T07:02:23.171 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35681.log 2024-05-30T07:02:23.172 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40983.log.gz 2024-05-30T07:02:23.172 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50496.log 2024-05-30T07:02:23.172 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46158.log.gz 2024-05-30T07:02:23.173 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57157.log 2024-05-30T07:02:23.173 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35681.log.gz 2024-05-30T07:02:23.174 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34878.log 2024-05-30T07:02:23.175 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50496.log.gz 2024-05-30T07:02:23.175 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39935.log 2024-05-30T07:02:23.175 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57157.log.gz 2024-05-30T07:02:23.176 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46239.log 2024-05-30T07:02:23.176 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34878.log.gz 2024-05-30T07:02:23.176 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35395.log 2024-05-30T07:02:23.177 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39935.log.gz 2024-05-30T07:02:23.178 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40471.log 2024-05-30T07:02:23.178 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46239.log.gz 2024-05-30T07:02:23.178 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51694.log 2024-05-30T07:02:23.178 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35395.log.gz 2024-05-30T07:02:23.179 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36508.log 2024-05-30T07:02:23.179 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40471.log.gz 2024-05-30T07:02:23.180 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49435.log 2024-05-30T07:02:23.180 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51694.log.gz 2024-05-30T07:02:23.181 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28051.log 2024-05-30T07:02:23.181 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42671.log 2024-05-30T07:02:23.182 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36508.log.gz 2024-05-30T07:02:23.182 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55465.log 2024-05-30T07:02:23.184 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49435.log.gz 2024-05-30T07:02:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51730.log 2024-05-30T07:02:23.184 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42671.log.gz 2024-05-30T07:02:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55091.log 2024-05-30T07:02:23.185 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55465.log.gz 2024-05-30T07:02:23.185 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54180.log 2024-05-30T07:02:23.186 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28123.log 2024-05-30T07:02:23.186 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.28051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28195.log 2024-05-30T07:02:23.186 INFO:teuthology.orchestra.run.smithi105.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28051.log.gz 2024-05-30T07:02:23.186 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.28123.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-30T07:02:23.186 INFO:teuthology.orchestra.run.smithi105.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28123.log.gz 2024-05-30T07:02:23.186 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.28195.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-30T07:02:23.186 INFO:teuthology.orchestra.run.smithi105.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28195.log.gz 2024-05-30T07:02:23.186 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33923.log 2024-05-30T07:02:23.187 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28219.log 2024-05-30T07:02:23.187 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.3.33923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28147.log 2024-05-30T07:02:23.187 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33923.log.gz 2024-05-30T07:02:23.189 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.28219.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-30T07:02:23.190 INFO:teuthology.orchestra.run.smithi105.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28219.log.gz 2024-05-30T07:02:23.190 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.28147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28171.log 2024-05-30T07:02:23.190 INFO:teuthology.orchestra.run.smithi105.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.28147.log.gz 2024-05-30T07:02:23.190 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-30T07:02:23.190 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.28171.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-30T07:02:23.190 INFO:teuthology.orchestra.run.smithi105.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28171.log.gz 2024-05-30T07:02:23.193 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51730.log.gz 2024-05-30T07:02:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37406.log 2024-05-30T07:02:23.193 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55091.log.gz 2024-05-30T07:02:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48333.log 2024-05-30T07:02:23.193 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54180.log.gz 2024-05-30T07:02:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47017.log 2024-05-30T07:02:23.193 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37406.log.gz 2024-05-30T07:02:23.194 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40899.log 2024-05-30T07:02:23.194 INFO:teuthology.orchestra.run.smithi037.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48333.log.gz 2024-05-30T07:02:23.194 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54362.log 2024-05-30T07:02:23.194 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47017.log.gz 2024-05-30T07:02:23.194 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37324.log 2024-05-30T07:02:23.194 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40899.log.gz 2024-05-30T07:02:23.194 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44194.log 2024-05-30T07:02:23.195 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54362.log.gz 2024-05-30T07:02:23.195 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54310.log 2024-05-30T07:02:23.195 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37324.log.gz 2024-05-30T07:02:23.195 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42923.log 2024-05-30T07:02:23.195 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44194.log.gz 2024-05-30T07:02:23.195 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53125.log 2024-05-30T07:02:23.195 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54310.log.gz 2024-05-30T07:02:23.198 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-30T07:02:23.199 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-30T07:02:23.199 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-30T07:02:23.199 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28099.log 2024-05-30T07:02:23.199 INFO:teuthology.orchestra.run.smithi105.stderr: 92.2% -- replaced with /var/log/ceph/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-30T07:02:23.199 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-05-30T07:02:23.202 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42975.log 2024-05-30T07:02:23.202 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42923.log.gz 2024-05-30T07:02:23.202 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38324.log 2024-05-30T07:02:23.202 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53125.log.gz 2024-05-30T07:02:23.202 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48307.log 2024-05-30T07:02:23.202 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42975.log.gz 2024-05-30T07:02:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57261.log 2024-05-30T07:02:23.203 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38324.log.gz 2024-05-30T07:02:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56115.log 2024-05-30T07:02:23.203 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48307.log.gz 2024-05-30T07:02:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49013.log 2024-05-30T07:02:23.203 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57261.log.gz 2024-05-30T07:02:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53852.log 2024-05-30T07:02:23.203 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56115.log.gz 2024-05-30T07:02:23.203 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40957.log 2024-05-30T07:02:23.204 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49013.log.gz 2024-05-30T07:02:23.204 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44525.log 2024-05-30T07:02:23.204 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53852.log.gz 2024-05-30T07:02:23.204 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43672.log 2024-05-30T07:02:23.204 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40957.log.gz 2024-05-30T07:02:23.204 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50235.log 2024-05-30T07:02:23.206 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.28099.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-30T07:02:23.206 INFO:teuthology.orchestra.run.smithi105.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-30T07:02:23.206 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mds.b.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28099.log.gz 2024-05-30T07:02:23.209 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44525.log.gz 2024-05-30T07:02:23.209 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41737.log 2024-05-30T07:02:23.209 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43672.log.gz 2024-05-30T07:02:23.209 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36996.log 2024-05-30T07:02:23.209 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50235.log.gz 2024-05-30T07:02:23.209 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34435.log 2024-05-30T07:02:23.210 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41737.log.gz 2024-05-30T07:02:23.210 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55799.log 2024-05-30T07:02:23.210 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36996.log.gz 2024-05-30T07:02:23.210 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39909.log 2024-05-30T07:02:23.210 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34435.log.gz 2024-05-30T07:02:23.210 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55799.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-30T07:02:23.210 INFO:teuthology.orchestra.run.smithi037.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.55799.log.gz 2024-05-30T07:02:23.211 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45928.log 2024-05-30T07:02:23.211 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39909.log.gz 2024-05-30T07:02:23.211 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53458.log 2024-05-30T07:02:23.211 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40681.log 2024-05-30T07:02:23.212 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-30T07:02:23.212 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28075.log 2024-05-30T07:02:23.214 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45928.log.gz 2024-05-30T07:02:23.214 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45442.log 2024-05-30T07:02:23.215 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53458.log.gz 2024-05-30T07:02:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42241.log 2024-05-30T07:02:23.215 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40681.log.gz 2024-05-30T07:02:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36664.log 2024-05-30T07:02:23.215 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45442.log.gz 2024-05-30T07:02:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51080.log 2024-05-30T07:02:23.215 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42241.log.gz 2024-05-30T07:02:23.215 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43510.log 2024-05-30T07:02:23.216 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36664.log.gz 2024-05-30T07:02:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.51080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51080.log.gz 2024-05-30T07:02:23.216 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47579.log 2024-05-30T07:02:23.217 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.28075.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28075.log.gz 2024-05-30T07:02:23.217 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33819.log 2024-05-30T07:02:23.219 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50931.log 2024-05-30T07:02:23.219 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43510.log.gz 2024-05-30T07:02:23.219 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53668.log 2024-05-30T07:02:23.219 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47579.log.gz 2024-05-30T07:02:23.219 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50105.log 2024-05-30T07:02:23.219 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50931.log.gz 2024-05-30T07:02:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33574.log 2024-05-30T07:02:23.220 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53668.log.gz 2024-05-30T07:02:23.220 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49595.log 2024-05-30T07:02:23.221 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.1.33819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33819.log.gz 2024-05-30T07:02:23.222 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50105.log.gz 2024-05-30T07:02:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33574.log: 94.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-30T07:02:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55931.log 2024-05-30T07:02:23.222 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33574.log.gz 2024-05-30T07:02:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43344.log 2024-05-30T07:02:23.222 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49595.log.gz 2024-05-30T07:02:23.222 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52971.log 2024-05-30T07:02:23.223 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55931.log.gz 2024-05-30T07:02:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49897.log 2024-05-30T07:02:23.224 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43344.log.gz 2024-05-30T07:02:23.224 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40221.log 2024-05-30T07:02:23.225 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52971.log.gz 2024-05-30T07:02:23.225 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40288.log 2024-05-30T07:02:23.225 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49897.log.gz 2024-05-30T07:02:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52303.log 2024-05-30T07:02:23.226 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40221.log.gz 2024-05-30T07:02:23.226 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53956.log 2024-05-30T07:02:23.227 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40288.log.gz 2024-05-30T07:02:23.227 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56195.log 2024-05-30T07:02:23.227 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52303.log.gz 2024-05-30T07:02:23.228 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43084.log 2024-05-30T07:02:23.228 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53956.log.gz 2024-05-30T07:02:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51642.log 2024-05-30T07:02:23.229 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.56195.log.gz 2024-05-30T07:02:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48225.log 2024-05-30T07:02:23.229 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43084.log.gz 2024-05-30T07:02:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39601.log 2024-05-30T07:02:23.230 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51642.log.gz 2024-05-30T07:02:23.231 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47631.log 2024-05-30T07:02:23.231 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48225.log.gz 2024-05-30T07:02:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45336.log 2024-05-30T07:02:23.232 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39601.log.gz 2024-05-30T07:02:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53694.log 2024-05-30T07:02:23.233 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47631.log.gz 2024-05-30T07:02:23.233 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49793.log 2024-05-30T07:02:23.233 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45336.log.gz 2024-05-30T07:02:23.234 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52251.log 2024-05-30T07:02:23.234 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53694.log.gz 2024-05-30T07:02:23.235 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54564.log 2024-05-30T07:02:23.235 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49793.log.gz 2024-05-30T07:02:23.235 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42697.log 2024-05-30T07:02:23.236 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52251.log.gz 2024-05-30T07:02:23.236 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38522.log 2024-05-30T07:02:23.236 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54564.log.gz 2024-05-30T07:02:23.237 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39246.log 2024-05-30T07:02:23.238 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42697.log.gz 2024-05-30T07:02:23.238 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33313.log 2024-05-30T07:02:23.238 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38522.log.gz 2024-05-30T07:02:23.239 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52789.log 2024-05-30T07:02:23.239 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39246.log.gz 2024-05-30T07:02:23.239 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38782.log 2024-05-30T07:02:23.240 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33313.log.gz 2024-05-30T07:02:23.240 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55318.log 2024-05-30T07:02:23.240 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52789.log.gz 2024-05-30T07:02:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47365.log 2024-05-30T07:02:23.241 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38782.log.gz 2024-05-30T07:02:23.242 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.55318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42645.log 2024-05-30T07:02:23.242 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55318.log.gz 2024-05-30T07:02:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47365.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-30T07:02:23.243 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47365.log.gz 2024-05-30T07:02:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33760.log 2024-05-30T07:02:23.244 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42645.log.gz 2024-05-30T07:02:23.244 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42515.log 2024-05-30T07:02:23.244 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34223.log 2024-05-30T07:02:23.245 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33760.log.gz 2024-05-30T07:02:23.246 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38272.log 2024-05-30T07:02:23.246 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42515.log.gz 2024-05-30T07:02:23.246 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38574.log 2024-05-30T07:02:23.247 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34223.log.gz 2024-05-30T07:02:23.248 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45284.log 2024-05-30T07:02:23.248 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38272.log.gz 2024-05-30T07:02:23.248 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37728.log 2024-05-30T07:02:23.249 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38574.log.gz 2024-05-30T07:02:23.249 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34904.log 2024-05-30T07:02:23.249 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45284.log.gz 2024-05-30T07:02:23.250 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44220.log 2024-05-30T07:02:23.250 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37728.log.gz 2024-05-30T07:02:23.251 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46731.log 2024-05-30T07:02:23.251 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34904.log.gz 2024-05-30T07:02:23.252 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36879.log 2024-05-30T07:02:23.252 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44220.log.gz 2024-05-30T07:02:23.253 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40655.log 2024-05-30T07:02:23.253 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46731.log.gz 2024-05-30T07:02:23.254 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41314.log 2024-05-30T07:02:23.254 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36879.log.gz 2024-05-30T07:02:23.255 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35551.log 2024-05-30T07:02:23.255 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40655.log.gz 2024-05-30T07:02:23.255 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39328.log 2024-05-30T07:02:23.256 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41314.log.gz 2024-05-30T07:02:23.256 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41392.log 2024-05-30T07:02:23.257 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35551.log.gz 2024-05-30T07:02:23.257 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36742.log 2024-05-30T07:02:23.258 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39328.log.gz 2024-05-30T07:02:23.258 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35975.log 2024-05-30T07:02:23.258 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41392.log.gz 2024-05-30T07:02:23.259 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55387.log 2024-05-30T07:02:23.259 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36742.log.gz 2024-05-30T07:02:23.260 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44326.log 2024-05-30T07:02:23.260 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35975.log.gz 2024-05-30T07:02:23.261 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41191.log 2024-05-30T07:02:23.261 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55387.log.gz 2024-05-30T07:02:23.262 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47912.log 2024-05-30T07:02:23.262 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44326.log.gz 2024-05-30T07:02:23.262 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35915.log 2024-05-30T07:02:23.263 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41191.log.gz 2024-05-30T07:02:23.263 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37510.log 2024-05-30T07:02:23.263 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47912.log.gz 2024-05-30T07:02:23.264 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44443.log 2024-05-30T07:02:23.264 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35915.log.gz 2024-05-30T07:02:23.265 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34438.log 2024-05-30T07:02:23.265 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37510.log.gz 2024-05-30T07:02:23.266 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44443.log: gzip -5 --verbose 89.2% -- -- replaced with /var/log/ceph/ceph-client.admin.44443.log.gz /var/log/ceph/ceph-client.admin.50209.log 2024-05-30T07:02:23.266 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-30T07:02:23.267 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49301.log 2024-05-30T07:02:23.267 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34438.log.gz 2024-05-30T07:02:23.268 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39102.log 2024-05-30T07:02:23.268 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50209.log.gz 2024-05-30T07:02:23.268 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54206.log 2024-05-30T07:02:23.269 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49301.log.gz 2024-05-30T07:02:23.269 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39102.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39102.log.gzgzip 2024-05-30T07:02:23.270 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49491.log 2024-05-30T07:02:23.270 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47501.log 2024-05-30T07:02:23.271 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54206.log.gz 2024-05-30T07:02:23.271 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41262.log 2024-05-30T07:02:23.272 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49491.log.gz 2024-05-30T07:02:23.272 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55694.log 2024-05-30T07:02:23.272 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47501.log.gz 2024-05-30T07:02:23.273 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38246.log 2024-05-30T07:02:23.273 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41262.log.gz 2024-05-30T07:02:23.274 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36821.log 2024-05-30T07:02:23.274 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55694.log.gz 2024-05-30T07:02:23.275 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46913.log 2024-05-30T07:02:23.275 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38246.log.gz 2024-05-30T07:02:23.275 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47391.log 2024-05-30T07:02:23.275 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36821.log.gz 2024-05-30T07:02:23.276 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35341.log 2024-05-30T07:02:23.276 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46913.log.gz 2024-05-30T07:02:23.277 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47709.log 2024-05-30T07:02:23.278 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47391.log.gz 2024-05-30T07:02:23.278 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41653.log 2024-05-30T07:02:23.278 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35341.log.gz 2024-05-30T07:02:23.279 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49975.log 2024-05-30T07:02:23.279 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47709.log.gz 2024-05-30T07:02:23.279 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44551.log 2024-05-30T07:02:23.280 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41653.log.gz 2024-05-30T07:02:23.280 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39523.log 2024-05-30T07:02:23.281 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49975.log.gz 2024-05-30T07:02:23.281 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27781.log 2024-05-30T07:02:23.281 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44551.log.gz 2024-05-30T07:02:23.282 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43776.log 2024-05-30T07:02:23.282 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39523.log.gz 2024-05-30T07:02:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.27781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34212.log 2024-05-30T07:02:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43776.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.27781.log.gz 2024-05-30T07:02:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56689.log 2024-05-30T07:02:23.284 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43776.log.gz 2024-05-30T07:02:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50053.log 2024-05-30T07:02:23.285 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34212.log.gz 2024-05-30T07:02:23.286 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45258.log 2024-05-30T07:02:23.286 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50053.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56689.log.gz 2024-05-30T07:02:23.287 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41841.log 2024-05-30T07:02:23.287 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50053.log.gz 2024-05-30T07:02:23.287 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36188.log 2024-05-30T07:02:23.288 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45258.log.gz 2024-05-30T07:02:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47251.log 2024-05-30T07:02:23.289 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41841.log.gz 2024-05-30T07:02:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38490.log 2024-05-30T07:02:23.290 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36188.log.gz 2024-05-30T07:02:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54414.log 2024-05-30T07:02:23.290 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47251.log.gz 2024-05-30T07:02:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43318.log 2024-05-30T07:02:23.291 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38490.log.gz 2024-05-30T07:02:23.292 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50417.log 2024-05-30T07:02:23.292 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54414.log.gz 2024-05-30T07:02:23.293 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38985.log 2024-05-30T07:02:23.293 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43318.log.gz 2024-05-30T07:02:23.294 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38464.log 2024-05-30T07:02:23.294 INFO:teuthology.orchestra.run.smithi037.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50417.log.gz 2024-05-30T07:02:23.294 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39846.log 2024-05-30T07:02:23.295 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38985.log.gz 2024-05-30T07:02:23.295 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46265.log 2024-05-30T07:02:23.296 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38464.log.gz 2024-05-30T07:02:23.296 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42593.log 2024-05-30T07:02:23.297 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39846.log.gz 2024-05-30T07:02:23.297 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41867.log 2024-05-30T07:02:23.297 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46265.log.gz 2024-05-30T07:02:23.298 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46183.log 2024-05-30T07:02:23.298 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42593.log.gz 2024-05-30T07:02:23.299 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40873.log 2024-05-30T07:02:23.299 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41867.log.gz 2024-05-30T07:02:23.301 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50261.log 2024-05-30T07:02:23.301 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46183.log.gz 2024-05-30T07:02:23.301 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43406.log 2024-05-30T07:02:23.301 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40873.log.gz 2024-05-30T07:02:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33838.log 2024-05-30T07:02:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50261.log: /var/log/ceph/ceph-client.admin.43406.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50261.log.gz 2024-05-30T07:02:23.302 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39415.log 2024-05-30T07:02:23.302 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43406.log.gz 2024-05-30T07:02:23.303 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48671.log 2024-05-30T07:02:23.303 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33838.log.gz 2024-05-30T07:02:23.304 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45903.log 2024-05-30T07:02:23.304 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39415.log.gz 2024-05-30T07:02:23.305 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43802.log 2024-05-30T07:02:23.305 INFO:teuthology.orchestra.run.smithi037.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48671.log.gz 2024-05-30T07:02:23.306 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52945.log 2024-05-30T07:02:23.306 INFO:teuthology.orchestra.run.smithi037.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.45903.log.gz 2024-05-30T07:02:23.307 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44298.log 2024-05-30T07:02:23.307 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43802.log.gz 2024-05-30T07:02:23.307 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47657.log 2024-05-30T07:02:23.308 INFO:teuthology.orchestra.run.smithi037.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.52945.log.gz 2024-05-30T07:02:23.308 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52154.log 2024-05-30T07:02:23.309 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44298.log.gz 2024-05-30T07:02:23.309 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45852.log 2024-05-30T07:02:23.310 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47657.log.gz 2024-05-30T07:02:23.310 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35187.log 2024-05-30T07:02:23.311 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52154.log.gz 2024-05-30T07:02:23.311 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49709.log 2024-05-30T07:02:23.312 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45852.log.gz 2024-05-30T07:02:23.312 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.35187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35187.log.gz 2024-05-30T07:02:23.312 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38881.log 2024-05-30T07:02:23.313 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38907.log 2024-05-30T07:02:23.313 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49709.log.gz 2024-05-30T07:02:23.313 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51097.log 2024-05-30T07:02:23.314 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38881.log.gz 2024-05-30T07:02:23.314 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36321.log 2024-05-30T07:02:23.315 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38907.log.gz 2024-05-30T07:02:23.315 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51918.log 2024-05-30T07:02:23.315 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51097.log.gz 2024-05-30T07:02:23.316 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50827.log 2024-05-30T07:02:23.316 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36321.log.gz 2024-05-30T07:02:23.317 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51377.log 2024-05-30T07:02:23.317 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51918.log.gz 2024-05-30T07:02:23.317 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47964.log 2024-05-30T07:02:23.318 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50827.log.gz 2024-05-30T07:02:23.318 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36347.log 2024-05-30T07:02:23.318 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51377.log.gz 2024-05-30T07:02:23.319 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37754.log 2024-05-30T07:02:23.319 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47964.log.gz 2024-05-30T07:02:23.320 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56767.log 2024-05-30T07:02:23.320 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36347.log.gz 2024-05-30T07:02:23.321 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40603.log 2024-05-30T07:02:23.321 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37754.log.gz 2024-05-30T07:02:23.322 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46328.log 2024-05-30T07:02:23.322 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56767.log.gz 2024-05-30T07:02:23.322 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56871.log 2024-05-30T07:02:23.323 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40603.log.gz 2024-05-30T07:02:23.323 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55117.log 2024-05-30T07:02:23.323 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46328.log.gz 2024-05-30T07:02:23.324 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50801.log 2024-05-30T07:02:23.324 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56871.log.gz 2024-05-30T07:02:23.325 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56607.log 2024-05-30T07:02:23.325 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55117.log.gz/var/log/ceph/ceph-client.admin.50801.log: 2024-05-30T07:02:23.326 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33916.log 2024-05-30T07:02:23.326 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50801.log.gz 2024-05-30T07:02:23.327 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40795.log 2024-05-30T07:02:23.327 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56607.log.gz 2024-05-30T07:02:23.328 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45608.log 2024-05-30T07:02:23.328 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33916.log.gz 2024-05-30T07:02:23.328 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37925.log 2024-05-30T07:02:23.328 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40795.log.gz 2024-05-30T07:02:23.329 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45608.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-30T07:02:23.329 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45608.log.gz 2024-05-30T07:02:23.330 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50157.log 2024-05-30T07:02:23.330 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37925.log.gz 2024-05-30T07:02:23.331 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56897.log 2024-05-30T07:02:23.331 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47806.log 2024-05-30T07:02:23.332 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50157.log.gz 2024-05-30T07:02:23.332 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34215.log 2024-05-30T07:02:23.333 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56897.log.gz 2024-05-30T07:02:23.333 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41679.log 2024-05-30T07:02:23.334 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47806.log.gz 2024-05-30T07:02:23.334 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.34215.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49406.log 2024-05-30T07:02:23.335 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34215.log.gz 2024-05-30T07:02:23.336 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35367.log 2024-05-30T07:02:23.336 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41679.log.gz 2024-05-30T07:02:23.336 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49406.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49406.log.gz 2024-05-30T07:02:23.337 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49223.log 2024-05-30T07:02:23.337 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42949.log 2024-05-30T07:02:23.338 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35367.log.gz 2024-05-30T07:02:23.338 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41509.log 2024-05-30T07:02:23.339 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49223.log.gz 2024-05-30T07:02:23.339 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43110.log 2024-05-30T07:02:23.340 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42949.log.gz 2024-05-30T07:02:23.340 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53215.log 2024-05-30T07:02:23.341 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41509.log.gz 2024-05-30T07:02:23.341 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43985.log 2024-05-30T07:02:23.341 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43110.log.gz 2024-05-30T07:02:23.342 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49353.log 2024-05-30T07:02:23.343 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53215.log.gz 2024-05-30T07:02:23.343 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55039.log 2024-05-30T07:02:23.344 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43985.log.gz 2024-05-30T07:02:23.344 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49657.log 2024-05-30T07:02:23.345 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49353.log.gz 2024-05-30T07:02:23.345 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53365.log 2024-05-30T07:02:23.345 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55039.log.gz 2024-05-30T07:02:23.346 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49171.log 2024-05-30T07:02:23.346 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49657.log.gz 2024-05-30T07:02:23.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57131.log 2024-05-30T07:02:23.347 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53365.log.gz 2024-05-30T07:02:23.348 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45003.log 2024-05-30T07:02:23.348 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49171.log.gz 2024-05-30T07:02:23.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53241.log 2024-05-30T07:02:23.349 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57131.log.gz 2024-05-30T07:02:23.350 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48411.log 2024-05-30T07:02:23.350 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45003.log.gz 2024-05-30T07:02:23.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45390.log 2024-05-30T07:02:23.351 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53241.log.gz 2024-05-30T07:02:23.352 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48411.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48411.log.gz 2024-05-30T07:02:23.352 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34230.log 2024-05-30T07:02:23.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49117.log 2024-05-30T07:02:23.353 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45390.log.gz 2024-05-30T07:02:23.354 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34429.log 2024-05-30T07:02:23.354 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34230.log.gz 2024-05-30T07:02:23.355 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43292.log 2024-05-30T07:02:23.355 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49117.log.gz 2024-05-30T07:02:23.356 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51970.log 2024-05-30T07:02:23.356 INFO:teuthology.orchestra.run.smithi037.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34429.log.gz 2024-05-30T07:02:23.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52048.log 2024-05-30T07:02:23.357 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43292.log.gz 2024-05-30T07:02:23.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51970.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51970.log.gz 2024-05-30T07:02:23.358 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54590.log 2024-05-30T07:02:23.359 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53616.log 2024-05-30T07:02:23.359 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52048.log.gz 2024-05-30T07:02:23.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34425.log 2024-05-30T07:02:23.360 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54590.log.gz 2024-05-30T07:02:23.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38055.log 2024-05-30T07:02:23.361 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53616.log.gz 2024-05-30T07:02:23.362 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36560.log 2024-05-30T07:02:23.362 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34425.log.gz 2024-05-30T07:02:23.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46132.log 2024-05-30T07:02:23.363 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38055.log.gz 2024-05-30T07:02:23.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55558.log 2024-05-30T07:02:23.364 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36560.log.gz 2024-05-30T07:02:23.364 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45206.log 2024-05-30T07:02:23.365 INFO:teuthology.orchestra.run.smithi037.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46132.log.gz 2024-05-30T07:02:23.365 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54907.log 2024-05-30T07:02:23.366 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55558.log.gz 2024-05-30T07:02:23.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45206.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-30T07:02:23.367 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45206.log.gz 2024-05-30T07:02:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36136.log 2024-05-30T07:02:23.369 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54907.log.gz 2024-05-30T07:02:23.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33495.log 2024-05-30T07:02:23.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48146.log 2024-05-30T07:02:23.371 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36136.log.gz 2024-05-30T07:02:23.371 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41600.log 2024-05-30T07:02:23.371 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33495.log.gz 2024-05-30T07:02:23.372 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5/var/log/ceph/ceph-client.admin.48146.log: --verbose -- /var/log/ceph/ceph-client.admin.49379.log 2024-05-30T07:02:23.372 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48146.log.gz 2024-05-30T07:02:23.373 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54336.log 2024-05-30T07:02:23.373 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41600.log.gz 2024-05-30T07:02:23.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49379.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49379.log.gz 2024-05-30T07:02:23.374 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39677.log 2024-05-30T07:02:23.375 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46991.log 2024-05-30T07:02:23.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54336.log: 88.1%/var/log/ceph/ceph-client.admin.39677.log: -- replaced with /var/log/ceph/ceph-client.admin.54336.log.gz 2024-05-30T07:02:23.376 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35525.log 2024-05-30T07:02:23.376 INFO:teuthology.orchestra.run.smithi037.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.39677.log.gz 2024-05-30T07:02:23.377 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34204.log 2024-05-30T07:02:23.377 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46991.log.gz 2024-05-30T07:02:23.378 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54284.log 2024-05-30T07:02:23.379 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3%/var/log/ceph/ceph-client.admin.34204.log: -- replaced with /var/log/ceph/ceph-client.admin.35525.log.gz 2024-05-30T07:02:23.379 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50723.log 2024-05-30T07:02:23.380 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34204.log.gz 2024-05-30T07:02:23.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38438.log 2024-05-30T07:02:23.381 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54284.log.gz 2024-05-30T07:02:23.381 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.50723.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39167.log 2024-05-30T07:02:23.382 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50723.log.gz 2024-05-30T07:02:23.382 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50749.log 2024-05-30T07:02:23.383 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38438.log.gz 2024-05-30T07:02:23.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51325.log 2024-05-30T07:02:23.384 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39167.log.gz 2024-05-30T07:02:23.384 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5/var/log/ceph/ceph-client.admin.50749.log: --verbose -- /var/log/ceph/ceph-client.admin.33600.log 2024-05-30T07:02:23.385 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51325.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50749.log.gz 2024-05-30T07:02:23.386 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37263.log 2024-05-30T07:02:23.386 INFO:teuthology.orchestra.run.smithi037.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51325.log.gz 2024-05-30T07:02:23.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39741.log 2024-05-30T07:02:23.387 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33600.log.gz 2024-05-30T07:02:23.387 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.37263.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53904.log 2024-05-30T07:02:23.388 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37263.log.gz 2024-05-30T07:02:23.389 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51201.log 2024-05-30T07:02:23.389 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39741.log.gz 2024-05-30T07:02:23.390 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34222.log 2024-05-30T07:02:23.390 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53904.log.gz 2024-05-30T07:02:23.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55143.log 2024-05-30T07:02:23.391 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51201.log.gz 2024-05-30T07:02:23.392 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42101.log 2024-05-30T07:02:23.392 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34222.log.gz 2024-05-30T07:02:23.393 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44246.log 2024-05-30T07:02:23.393 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55143.log.gz 2024-05-30T07:02:23.394 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45180.log 2024-05-30T07:02:23.394 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44246.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42101.log.gz 2024-05-30T07:02:23.395 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35733.log 2024-05-30T07:02:23.395 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44246.log.gz 2024-05-30T07:02:23.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39575.log 2024-05-30T07:02:23.396 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45180.log.gz 2024-05-30T07:02:23.397 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5/var/log/ceph/ceph-client.admin.35733.log: --verbose -- /var/log/ceph/ceph-client.admin.38220.log 2024-05-30T07:02:23.397 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35733.log.gz 2024-05-30T07:02:23.398 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35629.log 2024-05-30T07:02:23.398 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39575.log.gz 2024-05-30T07:02:23.399 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49569.log 2024-05-30T07:02:23.399 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38220.log.gz 2024-05-30T07:02:23.400 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54877.log 2024-05-30T07:02:23.400 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35629.log: /var/log/ceph/ceph-client.admin.49569.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35629.log.gz 2024-05-30T07:02:23.401 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33708.log 2024-05-30T07:02:23.401 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49569.log.gz 2024-05-30T07:02:23.402 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51351.log 2024-05-30T07:02:23.402 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54877.log.gz 2024-05-30T07:02:23.403 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.33708.log: /var/log/ceph/ceph-client.admin.44655.log 2024-05-30T07:02:23.404 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33708.log.gz 2024-05-30T07:02:23.404 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34670.log 2024-05-30T07:02:23.405 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51351.log.gz 2024-05-30T07:02:23.406 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44655.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44655.log.gz 2024-05-30T07:02:23.406 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39193.log 2024-05-30T07:02:23.406 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38730.log 2024-05-30T07:02:23.407 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34670.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34670.log.gz 2024-05-30T07:02:23.408 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56633.log 2024-05-30T07:02:23.408 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39193.log.gz 2024-05-30T07:02:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55590.log 2024-05-30T07:02:23.409 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38730.log.gz 2024-05-30T07:02:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49621.log 2024-05-30T07:02:23.411 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56633.log.gz 2024-05-30T07:02:23.411 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45979.log 2024-05-30T07:02:23.411 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55590.log.gz 2024-05-30T07:02:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46599.log 2024-05-30T07:02:23.412 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49621.log.gz 2024-05-30T07:02:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46835.log 2024-05-30T07:02:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45979.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45979.log.gz 2024-05-30T07:02:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44856.log 2024-05-30T07:02:23.414 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46599.log.gz 2024-05-30T07:02:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42749.log 2024-05-30T07:02:23.415 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46835.log.gz 2024-05-30T07:02:23.416 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.0.44856.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56529.log 2024-05-30T07:02:23.416 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44856.log.gz 2024-05-30T07:02:23.417 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52511.log 2024-05-30T07:02:23.417 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42749.log.gz 2024-05-30T07:02:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55773.log 2024-05-30T07:02:23.419 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56529.log.gz 2024-05-30T07:02:23.419 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41626.log/var/log/ceph/ceph-client.admin.52511.log: 2024-05-30T07:02:23.419 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9%/var/log/ceph/ceph-client.admin.55773.log: -- replaced with /var/log/ceph/ceph-client.admin.52511.log.gz 2024-05-30T07:02:23.420 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45042.log 2024-05-30T07:02:23.420 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55773.log.gz 2024-05-30T07:02:23.421 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56949.log 2024-05-30T07:02:23.422 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41626.log.gz 2024-05-30T07:02:23.422 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38298.log 2024-05-30T07:02:23.423 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45042.log: 88.0%/var/log/ceph/ceph-client.admin.56949.log: -- replaced with /var/log/ceph/ceph-client.admin.45042.log.gz 2024-05-30T07:02:23.423 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54044.log 2024-05-30T07:02:23.424 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56949.log.gz 2024-05-30T07:02:23.425 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48838.log 2024-05-30T07:02:23.425 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38298.log.gz 2024-05-30T07:02:23.425 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39627.log 2024-05-30T07:02:23.426 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54044.log.gz 2024-05-30T07:02:23.427 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40048.log 2024-05-30T07:02:23.427 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48838.log.gz 2024-05-30T07:02:23.428 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42435.log 2024-05-30T07:02:23.429 INFO:teuthology.orchestra.run.smithi037.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.39627.log.gz 2024-05-30T07:02:23.429 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51756.log 2024-05-30T07:02:23.430 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40048.log.gz 2024-05-30T07:02:23.430 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43028.log 2024-05-30T07:02:23.431 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42435.log.gz 2024-05-30T07:02:23.431 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48927.log 2024-05-30T07:02:23.432 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51756.log.gz 2024-05-30T07:02:23.432 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55668.log 2024-05-30T07:02:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48927.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43028.log.gz 2024-05-30T07:02:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46291.log 2024-05-30T07:02:23.434 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48927.log.gz 2024-05-30T07:02:23.434 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39767.log 2024-05-30T07:02:23.435 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55668.log.gz 2024-05-30T07:02:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38652.log 2024-05-30T07:02:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46291.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46291.log.gz 2024-05-30T07:02:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38933.log 2024-05-30T07:02:23.437 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39767.log.gz 2024-05-30T07:02:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45825.log 2024-05-30T07:02:23.438 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38652.log.gz 2024-05-30T07:02:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.38933.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35785.log 2024-05-30T07:02:23.439 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45825.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38933.log.gz 2024-05-30T07:02:23.440 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56037.log 2024-05-30T07:02:23.440 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45825.log.gz 2024-05-30T07:02:23.441 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49845.log 2024-05-30T07:02:23.441 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35785.log.gz 2024-05-30T07:02:23.442 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38194.log 2024-05-30T07:02:23.442 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56037.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56037.log.gz 2024-05-30T07:02:23.443 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47339.log 2024-05-30T07:02:23.443 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49845.log.gz 2024-05-30T07:02:23.444 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38959.log 2024-05-30T07:02:23.444 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38194.log.gz 2024-05-30T07:02:23.445 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38756.log 2024-05-30T07:02:23.445 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47339.log.gz 2024-05-30T07:02:23.446 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43646.log 2024-05-30T07:02:23.446 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38959.log.gz 2024-05-30T07:02:23.447 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35759.log 2024-05-30T07:02:23.447 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38756.log.gz 2024-05-30T07:02:23.448 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41763.log 2024-05-30T07:02:23.448 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43646.log: /var/log/ceph/ceph-client.admin.35759.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43646.log.gz 2024-05-30T07:02:23.449 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51866.log 2024-05-30T07:02:23.449 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35759.log.gz 2024-05-30T07:02:23.450 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47417.log 2024-05-30T07:02:23.450 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41763.log.gz 2024-05-30T07:02:23.451 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46572.log 2024-05-30T07:02:23.451 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51866.log: 88.7%/var/log/ceph/ceph-client.admin.47417.log: -- replaced with /var/log/ceph/ceph-client.admin.51866.log.gz 2024-05-30T07:02:23.452 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34015.log 2024-05-30T07:02:23.452 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47417.log.gz 2024-05-30T07:02:23.453 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51668.log 2024-05-30T07:02:23.454 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46572.log.gz 2024-05-30T07:02:23.454 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46442.log 2024-05-30T07:02:23.455 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34015.log.gz 2024-05-30T07:02:23.455 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46625.log 2024-05-30T07:02:23.456 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51668.log: /var/log/ceph/ceph-client.admin.46442.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51668.log.gz 2024-05-30T07:02:23.456 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36970.log 2024-05-30T07:02:23.457 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46442.log.gz 2024-05-30T07:02:23.458 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50697.log 2024-05-30T07:02:23.458 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46625.log.gz 2024-05-30T07:02:23.458 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56819.log 2024-05-30T07:02:23.459 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36970.log.gz 2024-05-30T07:02:23.460 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34982.log 2024-05-30T07:02:23.460 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50697.log.gz 2024-05-30T07:02:23.461 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44629.log 2024-05-30T07:02:23.461 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56819.log.gz 2024-05-30T07:02:23.462 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.34982.log: -- /var/log/ceph/ceph-client.admin.49065.log 2024-05-30T07:02:23.462 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34982.log.gz 2024-05-30T07:02:23.463 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55413.log 2024-05-30T07:02:23.463 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44629.log.gz 2024-05-30T07:02:23.464 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50957.log 2024-05-30T07:02:23.464 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49065.log.gz 2024-05-30T07:02:23.465 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46213.log 2024-05-30T07:02:23.465 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55413.log.gz 2024-05-30T07:02:23.466 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49517.log 2024-05-30T07:02:23.466 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50957.log.gz 2024-05-30T07:02:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52199.log 2024-05-30T07:02:23.467 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46213.log.gz 2024-05-30T07:02:23.468 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35421.log 2024-05-30T07:02:23.468 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49517.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49517.log.gz/var/log/ceph/ceph-client.admin.52199.log: 2024-05-30T07:02:23.469 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52199.log.gz 2024-05-30T07:02:23.470 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46054.log 2024-05-30T07:02:23.470 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33682.log 2024-05-30T07:02:23.471 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35421.log.gz 2024-05-30T07:02:23.472 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37458.log 2024-05-30T07:02:23.472 INFO:teuthology.orchestra.run.smithi037.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.46054.log.gz 2024-05-30T07:02:23.472 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47475.log 2024-05-30T07:02:23.473 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33682.log.gz 2024-05-30T07:02:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33654.log 2024-05-30T07:02:23.474 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37458.log.gz 2024-05-30T07:02:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53432.log 2024-05-30T07:02:23.475 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47475.log.gz 2024-05-30T07:02:23.475 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35473.log 2024-05-30T07:02:23.476 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33654.log.gz 2024-05-30T07:02:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53432.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53432.log.gz 2024-05-30T07:02:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45232.log 2024-05-30T07:02:23.478 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36690.log 2024-05-30T07:02:23.478 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35473.log.gz 2024-05-30T07:02:23.479 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38142.log 2024-05-30T07:02:23.479 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45232.log.gz 2024-05-30T07:02:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46861.log 2024-05-30T07:02:23.480 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36690.log.gz 2024-05-30T07:02:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37951.log 2024-05-30T07:02:23.482 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38142.log.gz 2024-05-30T07:02:23.482 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43568.log 2024-05-30T07:02:23.483 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46861.log.gz 2024-05-30T07:02:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37951.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37951.log.gz 2024-05-30T07:02:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43136.log 2024-05-30T07:02:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50001.log 2024-05-30T07:02:23.485 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43136.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43568.log.gz 2024-05-30T07:02:23.486 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57053.log 2024-05-30T07:02:23.486 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43136.log.gz 2024-05-30T07:02:23.487 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53267.log 2024-05-30T07:02:23.487 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50001.log.gz 2024-05-30T07:02:23.487 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43906.log 2024-05-30T07:02:23.490 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53267.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57053.log.gz 2024-05-30T07:02:23.490 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41217.log 2024-05-30T07:02:23.490 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53267.log.gz 2024-05-30T07:02:23.491 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40577.log 2024-05-30T07:02:23.491 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43906.log.gz 2024-05-30T07:02:23.491 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39037.log 2024-05-30T07:02:23.492 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41217.log: /var/log/ceph/ceph-client.admin.40577.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41217.log.gz 2024-05-30T07:02:23.492 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52022.log 2024-05-30T07:02:23.492 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40577.log.gz 2024-05-30T07:02:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52759.log 2024-05-30T07:02:23.493 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39037.log.gz 2024-05-30T07:02:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.52022.log: -- /var/log/ceph/ceph-client.admin.52537.log 2024-05-30T07:02:23.494 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9%/var/log/ceph/ceph-client.admin.52759.log: -- replaced with /var/log/ceph/ceph-client.admin.52022.log.gz 2024-05-30T07:02:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38828.log 2024-05-30T07:02:23.495 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52759.log.gz 2024-05-30T07:02:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44603.log 2024-05-30T07:02:23.496 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52537.log.gz 2024-05-30T07:02:23.497 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49683.log 2024-05-30T07:02:23.497 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38828.log.gz 2024-05-30T07:02:23.498 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38412.log 2024-05-30T07:02:23.498 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44603.log.gz 2024-05-30T07:02:23.499 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49683.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-30T07:02:23.499 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49683.log.gz 2024-05-30T07:02:23.500 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54935.log 2024-05-30T07:02:23.501 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38412.log.gz 2024-05-30T07:02:23.501 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33469.log 2024-05-30T07:02:23.503 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53992.log 2024-05-30T07:02:23.503 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54935.log.gz 2024-05-30T07:02:23.504 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37075.log 2024-05-30T07:02:23.504 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33469.log.gz 2024-05-30T07:02:23.504 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40392.log 2024-05-30T07:02:23.505 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53992.log.gz 2024-05-30T07:02:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46520.log 2024-05-30T07:02:23.506 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37075.log.gz 2024-05-30T07:02:23.507 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39300.log 2024-05-30T07:02:23.507 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40392.log.gz 2024-05-30T07:02:23.508 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56400.log 2024-05-30T07:02:23.508 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46520.log.gz 2024-05-30T07:02:23.509 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51616.log 2024-05-30T07:02:23.510 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39300.log.gz 2024-05-30T07:02:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47225.log 2024-05-30T07:02:23.510 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56400.log.gz 2024-05-30T07:02:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34430.log 2024-05-30T07:02:23.511 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51616.log.gz 2024-05-30T07:02:23.512 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48055.log 2024-05-30T07:02:23.513 INFO:teuthology.orchestra.run.smithi037.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47225.log.gz 2024-05-30T07:02:23.514 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36079.log 2024-05-30T07:02:23.514 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34430.log.gz 2024-05-30T07:02:23.514 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47527.log 2024-05-30T07:02:23.515 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48055.log.gz 2024-05-30T07:02:23.516 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34696.log 2024-05-30T07:02:23.516 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36079.log.gz 2024-05-30T07:02:23.517 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34003.log 2024-05-30T07:02:23.517 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47527.log.gz 2024-05-30T07:02:23.518 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49949.log 2024-05-30T07:02:23.519 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34696.log.gz 2024-05-30T07:02:23.519 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54388.log 2024-05-30T07:02:23.519 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34003.log.gz 2024-05-30T07:02:23.521 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53588.log 2024-05-30T07:02:23.521 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49949.log.gz 2024-05-30T07:02:23.522 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56089.log 2024-05-30T07:02:23.522 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54388.log.gz 2024-05-30T07:02:23.523 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55746.log 2024-05-30T07:02:23.523 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53588.log.gz 2024-05-30T07:02:23.524 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43698.log 2024-05-30T07:02:23.525 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.56089.log.gz 2024-05-30T07:02:23.525 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54128.log 2024-05-30T07:02:23.525 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55746.log.gz 2024-05-30T07:02:23.526 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36612.log 2024-05-30T07:02:23.527 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43698.log.gz 2024-05-30T07:02:23.528 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50131.log 2024-05-30T07:02:23.528 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54128.log.gz 2024-05-30T07:02:23.528 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54824.log 2024-05-30T07:02:23.529 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36612.log.gz 2024-05-30T07:02:23.529 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48567.log 2024-05-30T07:02:23.530 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50131.log.gz 2024-05-30T07:02:23.531 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48721.log 2024-05-30T07:02:23.531 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54824.log.gz 2024-05-30T07:02:23.532 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48359.log 2024-05-30T07:02:23.532 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48567.log.gz 2024-05-30T07:02:23.533 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36768.log 2024-05-30T07:02:23.533 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48721.log.gz 2024-05-30T07:02:23.534 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54987.log 2024-05-30T07:02:23.535 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48359.log.gz 2024-05-30T07:02:23.535 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34020.log 2024-05-30T07:02:23.536 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36768.log.gz 2024-05-30T07:02:23.536 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56425.log 2024-05-30T07:02:23.537 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54987.log.gz 2024-05-30T07:02:23.538 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39497.log 2024-05-30T07:02:23.538 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34020.log.gz 2024-05-30T07:02:23.539 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55221.log 2024-05-30T07:02:23.539 INFO:teuthology.orchestra.run.smithi037.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.56425.log.gz 2024-05-30T07:02:23.540 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42409.log 2024-05-30T07:02:23.540 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39497.log.gz 2024-05-30T07:02:23.541 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41165.log 2024-05-30T07:02:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42409.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55221.log.gz 2024-05-30T07:02:23.542 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44733.log 2024-05-30T07:02:23.543 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42409.log.gz 2024-05-30T07:02:23.543 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45494.log 2024-05-30T07:02:23.544 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41165.log.gz 2024-05-30T07:02:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44873.log 2024-05-30T07:02:23.545 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44733.log.gz 2024-05-30T07:02:23.545 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35889.log 2024-05-30T07:02:23.546 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45494.log.gz 2024-05-30T07:02:23.547 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45310.log 2024-05-30T07:02:23.547 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44873.log.gz 2024-05-30T07:02:23.548 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39995.log 2024-05-30T07:02:23.548 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35889.log.gz 2024-05-30T07:02:23.549 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42541.log 2024-05-30T07:02:23.549 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45310.log.gz 2024-05-30T07:02:23.550 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46080.log 2024-05-30T07:02:23.550 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39995.log.gz 2024-05-30T07:02:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52590.log 2024-05-30T07:02:23.552 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42541.log.gz 2024-05-30T07:02:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33864.log 2024-05-30T07:02:23.553 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46080.log.gz 2024-05-30T07:02:23.553 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55271.log 2024-05-30T07:02:23.554 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52590.log.gz 2024-05-30T07:02:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55491.log 2024-05-30T07:02:23.555 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33864.log.gz 2024-05-30T07:02:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46783.log 2024-05-30T07:02:23.556 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55271.log.gz 2024-05-30T07:02:23.557 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56845.log 2024-05-30T07:02:23.557 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55491.log.gz 2024-05-30T07:02:23.558 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48199.log 2024-05-30T07:02:23.559 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46783.log.gz 2024-05-30T07:02:23.560 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53536.log 2024-05-30T07:02:23.560 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56845.log.gz 2024-05-30T07:02:23.561 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38350.log 2024-05-30T07:02:23.561 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48199.log.gz 2024-05-30T07:02:23.562 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52733.log 2024-05-30T07:02:23.562 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53536.log.gz 2024-05-30T07:02:23.563 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37350.log 2024-05-30T07:02:23.563 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38350.log.gz 2024-05-30T07:02:23.564 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52277.log 2024-05-30T07:02:23.564 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52733.log.gz 2024-05-30T07:02:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56273.log 2024-05-30T07:02:23.565 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37350.log.gz 2024-05-30T07:02:23.566 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52225.log 2024-05-30T07:02:23.566 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52277.log.gz 2024-05-30T07:02:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47095.log 2024-05-30T07:02:23.568 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56273.log.gz 2024-05-30T07:02:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47860.log 2024-05-30T07:02:23.569 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52225.log.gz 2024-05-30T07:02:23.570 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47095.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47095.log.gz 2024-05-30T07:02:23.570 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36001.log 2024-05-30T07:02:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47860.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47860.log.gz 2024-05-30T07:02:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-30T07:02:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53075.log 2024-05-30T07:02:23.573 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36001.log.gz 2024-05-30T07:02:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53484.log 2024-05-30T07:02:23.576 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37023.log 2024-05-30T07:02:23.576 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53484.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.53075.log.gz 2024-05-30T07:02:23.576 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53484.log.gz 2024-05-30T07:02:23.577 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37023.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37023.log.gz 2024-05-30T07:02:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41789.log 2024-05-30T07:02:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47938.log 2024-05-30T07:02:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42567.log 2024-05-30T07:02:23.580 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41789.log.gz 2024-05-30T07:02:23.582 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47938.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47938.log.gz 2024-05-30T07:02:23.582 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42567.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42567.log.gz 2024-05-30T07:02:23.583 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46939.log 2024-05-30T07:02:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39219.log 2024-05-30T07:02:23.586 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37702.log 2024-05-30T07:02:23.586 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46939.log.gz 2024-05-30T07:02:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39219.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39219.log.gz 2024-05-30T07:02:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37702.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37702.log.gz 2024-05-30T07:02:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38548.log 2024-05-30T07:02:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40847.log 2024-05-30T07:02:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40821.log 2024-05-30T07:02:23.591 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38548.log.gz 2024-05-30T07:02:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40847.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40847.log.gz 2024-05-30T07:02:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40821.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40821.log.gz 2024-05-30T07:02:23.594 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52446.log 2024-05-30T07:02:23.595 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35863.log 2024-05-30T07:02:23.597 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37127.log 2024-05-30T07:02:23.597 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52446.log.gz 2024-05-30T07:02:23.597 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35863.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35863.log.gz 2024-05-30T07:02:23.598 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37127.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37127.log.gz 2024-05-30T07:02:23.599 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55616.log 2024-05-30T07:02:23.600 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37205.log 2024-05-30T07:02:23.602 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54096.log 2024-05-30T07:02:23.602 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55616.log.gz 2024-05-30T07:02:23.602 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37205.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37205.log.gz 2024-05-30T07:02:23.604 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54096.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54096.log.gz 2024-05-30T07:02:23.604 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51405.log 2024-05-30T07:02:23.605 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54798.log 2024-05-30T07:02:23.607 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35068.log 2024-05-30T07:02:23.608 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51405.log.gz 2024-05-30T07:02:23.608 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54798.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54798.log.gz 2024-05-30T07:02:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35068.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35068.log.gz 2024-05-30T07:02:23.610 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56715.log 2024-05-30T07:02:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36456.log 2024-05-30T07:02:23.613 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54018.log 2024-05-30T07:02:23.613 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56715.log.gz 2024-05-30T07:02:23.613 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37049.log 2024-05-30T07:02:23.613 INFO:teuthology.orchestra.run.smithi037.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36456.log.gz 2024-05-30T07:02:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54018.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54018.log.gz 2024-05-30T07:02:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53720.log 2024-05-30T07:02:23.616 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37049.log.gz 2024-05-30T07:02:23.616 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46809.log 2024-05-30T07:02:23.618 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35008.log 2024-05-30T07:02:23.618 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53720.log.gz 2024-05-30T07:02:23.619 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46809.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46809.log.gz 2024-05-30T07:02:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35008.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35008.log.gz 2024-05-30T07:02:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35655.log 2024-05-30T07:02:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39445.log 2024-05-30T07:02:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39549.log 2024-05-30T07:02:23.624 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35655.log.gz 2024-05-30T07:02:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39445.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39445.log.gz 2024-05-30T07:02:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39549.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39549.log.gz 2024-05-30T07:02:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37612.log 2024-05-30T07:02:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51834.log 2024-05-30T07:02:23.629 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44356.log 2024-05-30T07:02:23.629 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37612.log.gz 2024-05-30T07:02:23.630 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51834.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51834.log.gz 2024-05-30T07:02:23.631 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44356.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44356.log.gz 2024-05-30T07:02:23.632 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47043.log 2024-05-30T07:02:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52128.log 2024-05-30T07:02:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41139.log 2024-05-30T07:02:23.635 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47043.log.gz 2024-05-30T07:02:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43458.log 2024-05-30T07:02:23.636 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52128.log.gz 2024-05-30T07:02:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41139.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41139.log.gz 2024-05-30T07:02:23.637 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34930.log 2024-05-30T07:02:23.639 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43458.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43458.log.gz 2024-05-30T07:02:23.639 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5/var/log/ceph/ceph-client.admin.34930.log: --verbose -- /var/log/ceph/ceph-client.admin.47683.log 2024-05-30T07:02:23.640 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34930.log.gz 2024-05-30T07:02:23.640 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48812.log 2024-05-30T07:02:23.642 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52355.log 2024-05-30T07:02:23.642 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47683.log.gz 2024-05-30T07:02:23.643 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48812.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48812.log.gz 2024-05-30T07:02:23.643 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34410.log 2024-05-30T07:02:23.644 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53774.log 2024-05-30T07:02:23.644 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52355.log.gz 2024-05-30T07:02:23.645 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48645.log 2024-05-30T07:02:23.646 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34410.log.gz 2024-05-30T07:02:23.647 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53774.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53774.log.gz 2024-05-30T07:02:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48645.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48645.log.gz 2024-05-30T07:02:23.648 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54258.log 2024-05-30T07:02:23.649 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37869.log 2024-05-30T07:02:23.651 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46757.log 2024-05-30T07:02:23.651 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54258.log.gz 2024-05-30T07:02:23.652 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53293.log 2024-05-30T07:02:23.652 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37869.log.gz 2024-05-30T07:02:23.653 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46757.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46757.log.gz 2024-05-30T07:02:23.654 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36534.log 2024-05-30T07:02:23.655 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53293.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53293.log.gz 2024-05-30T07:02:23.655 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41477.log 2024-05-30T07:02:23.656 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57287.log 2024-05-30T07:02:23.656 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36534.log.gz 2024-05-30T07:02:23.658 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41477.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41477.log.gz 2024-05-30T07:02:23.658 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57287.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57287.log.gz 2024-05-30T07:02:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34618.log 2024-05-30T07:02:23.660 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41288.log 2024-05-30T07:02:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36053.log 2024-05-30T07:02:23.662 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34618.log.gz 2024-05-30T07:02:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41288.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41288.log.gz 2024-05-30T07:02:23.663 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36053.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36053.log.gz 2024-05-30T07:02:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34422.log 2024-05-30T07:02:23.665 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48172.log 2024-05-30T07:02:23.666 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48769.log 2024-05-30T07:02:23.666 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34422.log.gz 2024-05-30T07:02:23.668 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48172.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48172.log.gz 2024-05-30T07:02:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.48769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48769.log.gz 2024-05-30T07:02:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46546.log 2024-05-30T07:02:23.670 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35229.log 2024-05-30T07:02:23.671 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45102.log 2024-05-30T07:02:23.671 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46546.log.gz 2024-05-30T07:02:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35229.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35229.log.gz 2024-05-30T07:02:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51782.log 2024-05-30T07:02:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53562.log 2024-05-30T07:02:23.674 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45102.log.gz 2024-05-30T07:02:23.675 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44063.log 2024-05-30T07:02:23.676 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51782.log.gz 2024-05-30T07:02:23.677 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53562.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53562.log.gz 2024-05-30T07:02:23.678 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44063.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44063.log.gz 2024-05-30T07:02:23.678 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57105.log 2024-05-30T07:02:23.679 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38855.log 2024-05-30T07:02:23.681 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46705.log 2024-05-30T07:02:23.681 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57105.log.gz 2024-05-30T07:02:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38855.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38855.log.gz 2024-05-30T07:02:23.683 INFO:teuthology.orchestra.run.smithi105.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-30T07:02:23.684 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46705.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46705.log.gz 2024-05-30T07:02:23.684 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36243.log 2024-05-30T07:02:23.684 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47832.log 2024-05-30T07:02:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41113.log 2024-05-30T07:02:23.686 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36243.log.gz 2024-05-30T07:02:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47832.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47832.log.gz 2024-05-30T07:02:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41113.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41113.log.gz 2024-05-30T07:02:23.689 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52815.log 2024-05-30T07:02:23.690 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52329.log 2024-05-30T07:02:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46004.log 2024-05-30T07:02:23.692 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52815.log.gz 2024-05-30T07:02:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52329.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52329.log.gz 2024-05-30T07:02:23.694 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46004.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46004.log.gz 2024-05-30T07:02:23.694 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44128.log 2024-05-30T07:02:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35499.log 2024-05-30T07:02:23.696 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41997.log 2024-05-30T07:02:23.697 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44128.log.gz 2024-05-30T07:02:23.698 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35499.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35499.log.gz 2024-05-30T07:02:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41997.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41997.log.gz 2024-05-30T07:02:23.700 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54961.log 2024-05-30T07:02:23.700 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34644.log 2024-05-30T07:02:23.702 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41815.log 2024-05-30T07:02:23.702 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54961.log.gz 2024-05-30T07:02:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34644.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34644.log.gz 2024-05-30T07:02:23.704 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41815.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41815.log.gz 2024-05-30T07:02:23.705 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34826.log 2024-05-30T07:02:23.706 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44473.log 2024-05-30T07:02:23.707 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34852.log 2024-05-30T07:02:23.708 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34826.log.gz 2024-05-30T07:02:23.709 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44473.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44473.log.gz 2024-05-30T07:02:23.709 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34852.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34852.log.gz 2024-05-30T07:02:23.710 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35577.log 2024-05-30T07:02:23.711 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36716.log 2024-05-30T07:02:23.713 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43542.log 2024-05-30T07:02:23.713 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35577.log.gz 2024-05-30T07:02:23.714 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36716.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36716.log.gz 2024-05-30T07:02:23.715 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43542.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43542.log.gz 2024-05-30T07:02:23.715 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33548.log 2024-05-30T07:02:23.716 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44577.log 2024-05-30T07:02:23.718 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42293.log 2024-05-30T07:02:23.718 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33548.log.gz 2024-05-30T07:02:23.719 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56011.log 2024-05-30T07:02:23.719 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44577.log.gz 2024-05-30T07:02:23.720 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42293.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42293.log.gz 2024-05-30T07:02:23.721 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52414.log 2024-05-30T07:02:23.722 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56011.log.gz 2024-05-30T07:02:23.722 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56375.log 2024-05-30T07:02:23.724 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51431.log 2024-05-30T07:02:23.724 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52414.log.gz 2024-05-30T07:02:23.725 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43056.log 2024-05-30T07:02:23.725 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56375.log.gz 2024-05-30T07:02:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51431.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51431.log.gz 2024-05-30T07:02:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40629.log 2024-05-30T07:02:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43056.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43056.log.gz 2024-05-30T07:02:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51996.log 2024-05-30T07:02:23.729 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54642.log 2024-05-30T07:02:23.729 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40629.log.gz 2024-05-30T07:02:23.730 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51996.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-30T07:02:23.730 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51996.log.gz 2024-05-30T07:02:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54642.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54642.log.gz 2024-05-30T07:02:23.737 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37536.log 2024-05-30T07:02:23.737 INFO:teuthology.orchestra.run.smithi037.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-30T07:02:23.738 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48120.log 2024-05-30T07:02:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57209.log 2024-05-30T07:02:23.740 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37536.log.gz 2024-05-30T07:02:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33968.log 2024-05-30T07:02:23.741 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48120.log.gz 2024-05-30T07:02:23.742 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57209.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57209.log.gz 2024-05-30T07:02:23.742 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39819.log 2024-05-30T07:02:23.743 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33968.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33968.log.gz 2024-05-30T07:02:23.743 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45530.log 2024-05-30T07:02:23.744 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43432.log 2024-05-30T07:02:23.745 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39819.log.gz 2024-05-30T07:02:23.746 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45530.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45530.log.gz 2024-05-30T07:02:23.747 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43432.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43432.log.gz 2024-05-30T07:02:23.747 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50443.log 2024-05-30T07:02:23.749 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46106.log 2024-05-30T07:02:23.750 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39272.log 2024-05-30T07:02:23.750 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50443.log.gz 2024-05-30T07:02:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43880.log 2024-05-30T07:02:23.751 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46106.log.gz 2024-05-30T07:02:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39272.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39272.log.gz 2024-05-30T07:02:23.753 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41574.log 2024-05-30T07:02:23.753 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43880.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43880.log.gz 2024-05-30T07:02:23.754 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49249.log 2024-05-30T07:02:23.755 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47735.log 2024-05-30T07:02:23.756 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41574.log.gz 2024-05-30T07:02:23.756 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49249.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49249.log.gz 2024-05-30T07:02:23.757 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47735.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47735.log.gz 2024-05-30T07:02:23.758 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56793.log 2024-05-30T07:02:23.759 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54538.log 2024-05-30T07:02:23.760 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52102.log 2024-05-30T07:02:23.761 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56793.log.gz 2024-05-30T07:02:23.761 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54538.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54538.log.gz 2024-05-30T07:02:23.762 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52102.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52102.log.gz 2024-05-30T07:02:23.763 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47173.log 2024-05-30T07:02:23.764 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45556.log 2024-05-30T07:02:23.766 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57027.log 2024-05-30T07:02:23.766 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47173.log.gz 2024-05-30T07:02:23.767 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45556.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45556.log.gz 2024-05-30T07:02:23.768 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57027.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57027.log.gz 2024-05-30T07:02:23.768 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39011.log 2024-05-30T07:02:23.769 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40158.log 2024-05-30T07:02:23.771 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49197.log 2024-05-30T07:02:23.772 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39011.log.gz 2024-05-30T07:02:23.772 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40158.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40158.log.gz 2024-05-30T07:02:23.773 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37780.log 2024-05-30T07:02:23.773 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49197.log.gz 2024-05-30T07:02:23.774 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43828.log 2024-05-30T07:02:23.776 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56221.log 2024-05-30T07:02:23.776 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37780.log.gz 2024-05-30T07:02:23.777 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47069.log 2024-05-30T07:02:23.777 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43828.log.gz 2024-05-30T07:02:23.778 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56221.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56221.log.gz 2024-05-30T07:02:23.778 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27891.log 2024-05-30T07:02:23.779 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47069.log.gz 2024-05-30T07:02:23.779 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36378.log 2024-05-30T07:02:23.781 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.27891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34228.log 2024-05-30T07:02:23.781 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27891.log.gz 2024-05-30T07:02:23.782 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36378.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36378.log.gz 2024-05-30T07:02:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34228.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34228.log.gz 2024-05-30T07:02:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37676.log 2024-05-30T07:02:23.785 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54070.log 2024-05-30T07:02:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54675.log 2024-05-30T07:02:23.787 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37676.log.gz 2024-05-30T07:02:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48385.log 2024-05-30T07:02:23.787 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54070.log.gz 2024-05-30T07:02:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54675.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54675.log.gz 2024-05-30T07:02:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.48385.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46679.log 2024-05-30T07:02:23.790 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48385.log.gz 2024-05-30T07:02:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42897.log 2024-05-30T07:02:23.791 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37179.log 2024-05-30T07:02:23.792 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46679.log.gz 2024-05-30T07:02:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42897.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42897.log.gz 2024-05-30T07:02:23.794 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37179.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37179.log.gz 2024-05-30T07:02:23.794 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48864.log 2024-05-30T07:02:23.795 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50550.log 2024-05-30T07:02:23.797 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37562.log 2024-05-30T07:02:23.797 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48864.log.gz 2024-05-30T07:02:23.798 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50550.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50550.log.gz 2024-05-30T07:02:23.800 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37562.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.37562.log.gz 2024-05-30T07:02:23.800 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57079.log 2024-05-30T07:02:23.801 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53930.log 2024-05-30T07:02:23.803 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48437.log 2024-05-30T07:02:23.803 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57079.log.gz 2024-05-30T07:02:23.804 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53930.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53930.log.gz 2024-05-30T07:02:23.805 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48437.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48437.log.gz 2024-05-30T07:02:23.805 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42127.log 2024-05-30T07:02:23.806 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34010.log 2024-05-30T07:02:23.808 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46359.log 2024-05-30T07:02:23.808 INFO:teuthology.orchestra.run.smithi037.stderr: 91.1%/var/log/ceph/ceph-client.admin.34010.log: -- replaced with /var/log/ceph/ceph-client.admin.42127.log.gz 2024-05-30T07:02:23.809 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34010.log.gz 2024-05-30T07:02:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46359.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46359.log.gz 2024-05-30T07:02:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34424.log 2024-05-30T07:02:23.811 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43162.log 2024-05-30T07:02:23.813 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33786.log 2024-05-30T07:02:23.813 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34424.log.gz 2024-05-30T07:02:23.814 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43162.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43162.log.gz 2024-05-30T07:02:23.816 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33786.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33786.log.gz 2024-05-30T07:02:23.816 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45878.log 2024-05-30T07:02:23.817 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51033.log 2024-05-30T07:02:23.819 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55013.log 2024-05-30T07:02:23.819 INFO:teuthology.orchestra.run.smithi037.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.45878.log.gz 2024-05-30T07:02:23.819 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51033.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51033.log.gz 2024-05-30T07:02:23.820 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55013.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55013.log.gz 2024-05-30T07:02:23.821 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52381.log 2024-05-30T07:02:23.822 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37484.log 2024-05-30T07:02:23.824 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36214.log 2024-05-30T07:02:23.824 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52381.log.gz 2024-05-30T07:02:23.824 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41009.log 2024-05-30T07:02:23.825 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37484.log.gz 2024-05-30T07:02:23.826 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36214.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36214.log.gz 2024-05-30T07:02:23.826 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56741.log 2024-05-30T07:02:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41009.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41009.log.gz 2024-05-30T07:02:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50983.log 2024-05-30T07:02:23.829 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42775.log 2024-05-30T07:02:23.829 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56741.log.gz 2024-05-30T07:02:23.830 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55854.log 2024-05-30T07:02:23.831 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50983.log.gz 2024-05-30T07:02:23.831 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41061.log 2024-05-30T07:02:23.832 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42775.log.gz 2024-05-30T07:02:23.833 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55854.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.55854.log.gz 2024-05-30T07:02:23.833 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37843.log 2024-05-30T07:02:23.834 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41061.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41061.log.gz 2024-05-30T07:02:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52563.log 2024-05-30T07:02:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51537.log 2024-05-30T07:02:23.836 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37843.log.gz 2024-05-30T07:02:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52563.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52563.log.gz 2024-05-30T07:02:23.838 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51537.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51537.log.gz 2024-05-30T07:02:23.839 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49465.log 2024-05-30T07:02:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52893.log 2024-05-30T07:02:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37380.log 2024-05-30T07:02:23.842 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49465.log.gz 2024-05-30T07:02:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52893.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52893.log.gz 2024-05-30T07:02:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37380.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37380.log.gz 2024-05-30T07:02:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54486.log 2024-05-30T07:02:23.845 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54616.log 2024-05-30T07:02:23.846 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41893.log 2024-05-30T07:02:23.846 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54486.log.gz 2024-05-30T07:02:23.848 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54616.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54616.log.gz 2024-05-30T07:02:23.849 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49923.log 2024-05-30T07:02:23.849 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41893.log.gz 2024-05-30T07:02:23.850 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49327.log 2024-05-30T07:02:23.851 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34722.log 2024-05-30T07:02:23.852 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49923.log.gz 2024-05-30T07:02:23.853 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49327.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49327.log.gz 2024-05-30T07:02:23.854 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34722.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34722.log.gz 2024-05-30T07:02:23.854 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40931.log 2024-05-30T07:02:23.855 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47553.log 2024-05-30T07:02:23.857 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55642.log 2024-05-30T07:02:23.857 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40931.log.gz 2024-05-30T07:02:23.858 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47553.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47553.log.gz 2024-05-30T07:02:23.859 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55642.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55642.log.gz 2024-05-30T07:02:23.859 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57237.log 2024-05-30T07:02:23.860 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57183.log 2024-05-30T07:02:23.862 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42267.log 2024-05-30T07:02:23.862 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57237.log.gz 2024-05-30T07:02:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57183.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57183.log.gz 2024-05-30T07:02:23.864 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42267.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42267.log.gz 2024-05-30T07:02:23.865 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44499.log 2024-05-30T07:02:23.866 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43854.log 2024-05-30T07:02:23.868 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43484.log 2024-05-30T07:02:23.868 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44499.log.gz 2024-05-30T07:02:23.868 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53023.log 2024-05-30T07:02:23.868 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43854.log.gz 2024-05-30T07:02:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43484.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43484.log.gz 2024-05-30T07:02:23.871 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56923.log 2024-05-30T07:02:23.871 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53023.log.gz 2024-05-30T07:02:23.871 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42371.log 2024-05-30T07:02:23.873 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44272.log 2024-05-30T07:02:23.873 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56923.log.gz 2024-05-30T07:02:23.874 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42371.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42371.log.gz 2024-05-30T07:02:23.875 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44272.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44272.log.gz 2024-05-30T07:02:23.875 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45364.log 2024-05-30T07:02:23.877 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38003.log 2024-05-30T07:02:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45582.log 2024-05-30T07:02:23.879 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45364.log.gz 2024-05-30T07:02:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39969.log 2024-05-30T07:02:23.879 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38003.log.gz 2024-05-30T07:02:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45582.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45582.log.gz 2024-05-30T07:02:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50613.log 2024-05-30T07:02:23.882 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39969.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39969.log.gz 2024-05-30T07:02:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42075.log 2024-05-30T07:02:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50613.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.44899.log 2024-05-30T07:02:23.884 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50613.log.gz 2024-05-30T07:02:23.885 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47780.log 2024-05-30T07:02:23.885 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42075.log.gz 2024-05-30T07:02:23.886 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52707.log 2024-05-30T07:02:23.886 INFO:teuthology.orchestra.run.smithi037.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44899.log.gz 2024-05-30T07:02:23.888 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47780.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47780.log.gz 2024-05-30T07:02:23.888 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43594.log 2024-05-30T07:02:23.889 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52707.log.gz 2024-05-30T07:02:23.889 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33522.log 2024-05-30T07:02:23.891 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54154.log 2024-05-30T07:02:23.891 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43594.log.gz 2024-05-30T07:02:23.891 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33522.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33522.log.gz 2024-05-30T07:02:23.893 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54154.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54154.log.gz 2024-05-30T07:02:23.893 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37235.log 2024-05-30T07:02:23.894 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49543.log 2024-05-30T07:02:23.896 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54460.log 2024-05-30T07:02:23.896 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37235.log.gz 2024-05-30T07:02:23.897 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52841.log 2024-05-30T07:02:23.897 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49543.log.gz 2024-05-30T07:02:23.898 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54460.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54460.log.gz 2024-05-30T07:02:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53878.log 2024-05-30T07:02:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52841.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52841.log.gz 2024-05-30T07:02:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37432.log 2024-05-30T07:02:23.901 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38083.log 2024-05-30T07:02:23.901 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53878.log.gz 2024-05-30T07:02:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37432.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37432.log.gz 2024-05-30T07:02:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38083.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38083.log.gz 2024-05-30T07:02:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34007.log 2024-05-30T07:02:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53319.log 2024-05-30T07:02:23.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50469.log 2024-05-30T07:02:23.907 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34007.log.gz 2024-05-30T07:02:23.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55335.log 2024-05-30T07:02:23.908 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53319.log.gz 2024-05-30T07:02:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50469.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50469.log.gz 2024-05-30T07:02:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36794.log 2024-05-30T07:02:23.910 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55335.log.gz 2024-05-30T07:02:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43266.log 2024-05-30T07:02:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48953.log 2024-05-30T07:02:23.912 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36794.log.gz 2024-05-30T07:02:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43266.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43266.log.gz 2024-05-30T07:02:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48953.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48953.log.gz 2024-05-30T07:02:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2024-05-30T07:02:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35811.log 2024-05-30T07:02:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51175.log 2024-05-30T07:02:23.918 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gz 2024-05-30T07:02:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35811.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35811.log.gz 2024-05-30T07:02:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39793.log 2024-05-30T07:02:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51175.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51175.log.gz 2024-05-30T07:02:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34022.log 2024-05-30T07:02:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47277.log 2024-05-30T07:02:23.925 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39793.log.gz 2024-05-30T07:02:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34022.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34022.log.gz 2024-05-30T07:02:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47277.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47277.log.gz 2024-05-30T07:02:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49145.log 2024-05-30T07:02:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44037.log 2024-05-30T07:02:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48541.log 2024-05-30T07:02:23.927 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49145.log.gz 2024-05-30T07:02:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44037.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44037.log.gz 2024-05-30T07:02:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48541.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48541.log.gz 2024-05-30T07:02:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40497.log 2024-05-30T07:02:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49761.log 2024-05-30T07:02:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36482.log 2024-05-30T07:02:23.933 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40497.log.gz 2024-05-30T07:02:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49761.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49761.log.gz 2024-05-30T07:02:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36482.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36482.log.gz 2024-05-30T07:02:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52919.log 2024-05-30T07:02:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51511.log 2024-05-30T07:02:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52919.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-30T07:02:23.938 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52919.log.gz 2024-05-30T07:02:23.940 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48253.log 2024-05-30T07:02:23.940 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51511.log.gz 2024-05-30T07:02:23.942 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.48253.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48253.log.gz 2024-05-30T07:02:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-30T07:02:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42345.log 2024-05-30T07:02:23.945 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.c.log: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-30T07:02:23.946 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56450.log 2024-05-30T07:02:23.947 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42345.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42345.log.gz 2024-05-30T07:02:23.948 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56450.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.56450.log.gz 2024-05-30T07:02:23.948 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48489.log 2024-05-30T07:02:23.949 INFO:teuthology.orchestra.run.smithi105.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-30T07:02:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52644.log 2024-05-30T07:02:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48489.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48489.log.gz 2024-05-30T07:02:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52644.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52644.log.gz 2024-05-30T07:02:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45468.log 2024-05-30T07:02:23.954 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-30T07:02:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45468.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45468.log.gz 2024-05-30T07:02:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44707.log 2024-05-30T07:02:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36430.log 2024-05-30T07:02:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34016.log 2024-05-30T07:02:23.964 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44707.log.gz 2024-05-30T07:02:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45797.log 2024-05-30T07:02:23.965 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36430.log.gz 2024-05-30T07:02:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34016.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34016.log.gz 2024-05-30T07:02:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48786.log 2024-05-30T07:02:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35941.log 2024-05-30T07:02:23.972 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6%/var/log/ceph/ceph-client.admin.45797.log: -- replaced with /var/log/ceph/ceph-client.admin.48786.log.gz 2024-05-30T07:02:23.974 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56324.log 2024-05-30T07:02:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40707.log 2024-05-30T07:02:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35941.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45797.log.gz 2024-05-30T07:02:23.978 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35941.log.gz 2024-05-30T07:02:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56324.log: /var/log/ceph/ceph-client.admin.40707.log: 87.9% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40707.log.gz 2024-05-30T07:02:23.979 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56324.log.gz 2024-05-30T07:02:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51590.log 2024-05-30T07:02:23.982 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34229.log 2024-05-30T07:02:23.983 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51590.log.gz 2024-05-30T07:02:23.986 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.34229.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52076.log 2024-05-30T07:02:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52076.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52076.log.gz 2024-05-30T07:02:23.990 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34229.log.gz 2024-05-30T07:02:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50352.log 2024-05-30T07:02:23.993 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50352.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50352.log.gz 2024-05-30T07:02:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56143.log 2024-05-30T07:02:23.996 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56143.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56143.log.gz 2024-05-30T07:02:23.997 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37101.log 2024-05-30T07:02:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37101.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37101.log.gz 2024-05-30T07:02:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42023.log 2024-05-30T07:02:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50905.log 2024-05-30T07:02:24.003 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42023.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42023.log.gz 2024-05-30T07:02:24.006 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50905.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50905.log.gz 2024-05-30T07:02:24.006 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36269.log 2024-05-30T07:02:24.009 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36269.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36269.log.gz 2024-05-30T07:02:24.009 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41971.log 2024-05-30T07:02:24.012 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41971.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41971.log.gz 2024-05-30T07:02:24.012 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55905.log 2024-05-30T07:02:24.015 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2024-05-30T07:02:24.015 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55905.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55905.log.gz 2024-05-30T07:02:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50079.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2024-05-30T07:02:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37899.log 2024-05-30T07:02:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37899.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37899.log.gz 2024-05-30T07:02:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47121.log 2024-05-30T07:02:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47121.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47121.log.gz 2024-05-30T07:02:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33890.log 2024-05-30T07:02:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52997.log 2024-05-30T07:02:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33890.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33890.log.gz 2024-05-30T07:02:24.030 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52997.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52997.log.gz 2024-05-30T07:02:24.030 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44925.log 2024-05-30T07:02:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44925.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44925.log.gz 2024-05-30T07:02:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36295.log 2024-05-30T07:02:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36295.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36295.log.gz 2024-05-30T07:02:24.037 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41418.log 2024-05-30T07:02:24.039 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41418.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41418.log.gz 2024-05-30T07:02:24.040 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46468.log 2024-05-30T07:02:24.042 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46468.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46468.log.gz 2024-05-30T07:02:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46965.log 2024-05-30T07:02:24.045 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50578.log 2024-05-30T07:02:24.046 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46965.log.gz 2024-05-30T07:02:24.047 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55879.log 2024-05-30T07:02:24.049 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50578.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50578.log.gz 2024-05-30T07:02:24.050 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46653.log 2024-05-30T07:02:24.051 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55879.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55879.log.gz 2024-05-30T07:02:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46653.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46653.log.gz 2024-05-30T07:02:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43240.log 2024-05-30T07:02:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43240.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43240.log.gz 2024-05-30T07:02:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57001.log 2024-05-30T07:02:24.060 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57001.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57001.log.gz 2024-05-30T07:02:24.061 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56581.log 2024-05-30T07:02:24.063 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56581.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56581.log.gz 2024-05-30T07:02:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47147.log 2024-05-30T07:02:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52867.log 2024-05-30T07:02:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47147.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47147.log.gz 2024-05-30T07:02:24.070 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52867.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52867.log.gz 2024-05-30T07:02:24.070 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33626.log 2024-05-30T07:02:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33626.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33626.log.gz 2024-05-30T07:02:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42845.log 2024-05-30T07:02:24.076 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42845.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42845.log.gz 2024-05-30T07:02:24.076 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42619.log 2024-05-30T07:02:24.081 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53748.log 2024-05-30T07:02:24.081 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42619.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42619.log.gz 2024-05-30T07:02:24.081 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53748.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53748.log.gz 2024-05-30T07:02:24.082 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22973.log 2024-05-30T07:02:24.084 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.tmp-client.admin.22973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45068.log 2024-05-30T07:02:24.085 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22973.log.gz 2024-05-30T07:02:24.087 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50639.log 2024-05-30T07:02:24.089 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45068.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45068.log.gz 2024-05-30T07:02:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.50639.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41444.log 2024-05-30T07:02:24.092 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50639.log.gz 2024-05-30T07:02:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42489.log 2024-05-30T07:02:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41444.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41444.log.gz 2024-05-30T07:02:24.098 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.42489.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42489.log.gz 2024-05-30T07:02:24.099 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33404.log 2024-05-30T07:02:24.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33404.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33404.log.gz 2024-05-30T07:02:24.102 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42177.log 2024-05-30T07:02:24.106 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51265.log 2024-05-30T07:02:24.106 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42177.log.gz 2024-05-30T07:02:24.107 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40366.log 2024-05-30T07:02:24.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40366.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40366.log.gz 2024-05-30T07:02:24.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51265.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51265.log.gz 2024-05-30T07:02:24.112 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36162.log 2024-05-30T07:02:24.115 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36162.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36162.log.gz 2024-05-30T07:02:24.115 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52616.log 2024-05-30T07:02:24.118 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52616.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52616.log.gz 2024-05-30T07:02:24.118 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37977.log 2024-05-30T07:02:24.121 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41035.log 2024-05-30T07:02:24.121 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37977.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37977.log.gz 2024-05-30T07:02:24.122 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45954.log 2024-05-30T07:02:24.124 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41035.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41035.log.gz 2024-05-30T07:02:24.127 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45954.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.45954.log.gz 2024-05-30T07:02:24.127 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34748.log 2024-05-30T07:02:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34748.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34748.log.gz 2024-05-30T07:02:24.130 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56247.log 2024-05-30T07:02:24.133 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56247.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56247.log.gz 2024-05-30T07:02:24.133 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56299.log 2024-05-30T07:02:24.136 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56299.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56299.log.gz 2024-05-30T07:02:24.136 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36110.log 2024-05-30T07:02:24.140 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36847.log 2024-05-30T07:02:24.141 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36110.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36110.log.gz 2024-05-30T07:02:24.141 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33942.log 2024-05-30T07:02:24.141 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36847.log.gz 2024-05-30T07:02:24.143 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55532.log 2024-05-30T07:02:24.145 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46494.log 2024-05-30T07:02:24.146 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55532.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55532.log.gz 2024-05-30T07:02:24.147 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33942.log.gz 2024-05-30T07:02:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46494.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46494.log.gz 2024-05-30T07:02:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43188.log 2024-05-30T07:02:24.152 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40759.log 2024-05-30T07:02:24.154 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43188.log.gz 2024-05-30T07:02:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41945.log 2024-05-30T07:02:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.40759.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48890.log 2024-05-30T07:02:24.161 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8%/var/log/ceph/ceph-client.admin.48890.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48890.log.gz 2024-05-30T07:02:24.161 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40759.log.gz 2024-05-30T07:02:24.162 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55361.log 2024-05-30T07:02:24.162 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41945.log.gz 2024-05-30T07:02:24.164 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55361.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55361.log.gz 2024-05-30T07:02:24.165 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43001.log 2024-05-30T07:02:24.168 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43001.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43001.log.gz 2024-05-30T07:02:24.168 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53189.log 2024-05-30T07:02:24.171 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53189.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53189.log.gz 2024-05-30T07:02:24.171 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51564.log 2024-05-30T07:02:24.173 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49819.log 2024-05-30T07:02:24.174 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51564.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51564.log.gz 2024-05-30T07:02:24.176 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54512.log 2024-05-30T07:02:24.178 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50287.log 2024-05-30T07:02:24.178 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54512.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49819.log.gz 2024-05-30T07:02:24.179 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54512.log.gz 2024-05-30T07:02:24.181 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50287.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50287.log.gz 2024-05-30T07:02:24.181 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51123.log 2024-05-30T07:02:24.185 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51123.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51123.log.gz 2024-05-30T07:02:24.185 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38168.log 2024-05-30T07:02:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38168.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38168.log.gz 2024-05-30T07:02:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54707.log 2024-05-30T07:02:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56555.log 2024-05-30T07:02:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54707.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54707.log.gz 2024-05-30T07:02:24.194 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56555.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56555.log.gz 2024-05-30T07:02:24.194 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52672.log 2024-05-30T07:02:24.197 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52672.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52672.log.gz 2024-05-30T07:02:24.197 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38626.log 2024-05-30T07:02:24.200 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38626.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38626.log.gz 2024-05-30T07:02:24.200 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55720.log 2024-05-30T07:02:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36586.log 2024-05-30T07:02:24.203 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55720.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55720.log.gz 2024-05-30T07:02:24.205 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53642.log 2024-05-30T07:02:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36586.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36586.log.gz 2024-05-30T07:02:24.209 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50879.log 2024-05-30T07:02:24.209 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53642.log.gz 2024-05-30T07:02:24.210 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36404.log 2024-05-30T07:02:24.212 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50879.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50879.log.gz 2024-05-30T07:02:24.213 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44417.log 2024-05-30T07:02:24.217 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36404.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36404.log.gz 2024-05-30T07:02:24.218 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.44417.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45154.log 2024-05-30T07:02:24.218 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44417.log.gz 2024-05-30T07:02:24.220 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41087.log 2024-05-30T07:02:24.220 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45154.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45154.log.gz 2024-05-30T07:02:24.223 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41087.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41087.log.gz 2024-05-30T07:02:24.223 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55957.log 2024-05-30T07:02:24.227 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55957.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55957.log.gz 2024-05-30T07:02:24.227 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54232.log 2024-05-30T07:02:24.230 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54232.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54232.log.gz 2024-05-30T07:02:24.230 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44977.log 2024-05-30T07:02:24.236 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44977.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44977.log.gz 2024-05-30T07:02:24.236 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38029.log 2024-05-30T07:02:24.236 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38029.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38029.log.gz 2024-05-30T07:02:24.236 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50183.log 2024-05-30T07:02:24.239 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50183.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50183.log.gz 2024-05-30T07:02:24.239 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28000.log 2024-05-30T07:02:24.242 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.28000.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28000.log.gz 2024-05-30T07:02:24.242 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48515.log 2024-05-30T07:02:24.246 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47199.log 2024-05-30T07:02:24.246 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48515.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48515.log.gz 2024-05-30T07:02:24.246 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53172.log 2024-05-30T07:02:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47199.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47199.log.gz 2024-05-30T07:02:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.53172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53172.log.gz 2024-05-30T07:02:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53800.log 2024-05-30T07:02:24.253 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53800.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53800.log.gz 2024-05-30T07:02:24.253 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53391.log 2024-05-30T07:02:24.256 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53391.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53391.log.gz 2024-05-30T07:02:24.256 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45634.log 2024-05-30T07:02:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45634.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45634.log.gz 2024-05-30T07:02:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44391.log 2024-05-30T07:02:24.263 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42723.log 2024-05-30T07:02:24.263 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44391.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44391.log.gz 2024-05-30T07:02:24.263 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47886.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42723.log.gz 2024-05-30T07:02:24.263 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-30T07:02:24.266 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47886.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47886.log.gz 2024-05-30T07:02:24.266 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39070.log 2024-05-30T07:02:24.269 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39070.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39070.log.gz 2024-05-30T07:02:24.269 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48023.log 2024-05-30T07:02:24.270 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50522.log 2024-05-30T07:02:24.272 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48023.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48023.log.gz 2024-05-30T07:02:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51291.log 2024-05-30T07:02:24.276 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50522.log.gz 2024-05-30T07:02:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2024-05-30T07:02:24.279 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51291.log.gz 2024-05-30T07:02:24.282 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46887.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2024-05-30T07:02:24.282 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42871.log 2024-05-30T07:02:24.285 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42871.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42871.log.gz 2024-05-30T07:02:24.285 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36027.log 2024-05-30T07:02:24.288 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36027.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36027.log.gz 2024-05-30T07:02:24.289 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42049.log 2024-05-30T07:02:24.291 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42049.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42049.log.gz 2024-05-30T07:02:24.292 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47313.log 2024-05-30T07:02:24.295 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47313.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47313.log.gz 2024-05-30T07:02:24.295 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48619.log 2024-05-30T07:02:24.296 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39471.log 2024-05-30T07:02:24.298 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48619.log: /var/log/ceph/ceph-client.admin.39471.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48619.log.gz 2024-05-30T07:02:24.298 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46029.log 2024-05-30T07:02:24.298 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39471.log.gz 2024-05-30T07:02:24.301 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46029.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46029.log.gz 2024-05-30T07:02:24.302 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39363.log 2024-05-30T07:02:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39363.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39363.log.gz 2024-05-30T07:02:24.305 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38704.log 2024-05-30T07:02:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38704.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38704.log.gz 2024-05-30T07:02:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38386.log 2024-05-30T07:02:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38386.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38386.log.gz 2024-05-30T07:02:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55826.log 2024-05-30T07:02:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35837.log 2024-05-30T07:02:24.314 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55826.log.gz 2024-05-30T07:02:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55065.log 2024-05-30T07:02:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35837.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35837.log.gz 2024-05-30T07:02:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55065.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55065.log.gz 2024-05-30T07:02:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40551.log 2024-05-30T07:02:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40551.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40551.log.gz 2024-05-30T07:02:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53826.log 2024-05-30T07:02:24.326 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53826.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53826.log.gz 2024-05-30T07:02:24.327 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44951.log 2024-05-30T07:02:24.328 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49091.log 2024-05-30T07:02:24.330 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44951.log: /var/log/ceph/ceph-client.admin.49091.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44951.log.gz 2024-05-30T07:02:24.330 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43724.log 2024-05-30T07:02:24.330 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49091.log.gz 2024-05-30T07:02:24.333 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43724.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43724.log.gz 2024-05-30T07:02:24.333 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44759.log 2024-05-30T07:02:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44759.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.44759.log.gz 2024-05-30T07:02:24.337 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35707.log 2024-05-30T07:02:24.340 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35707.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35707.log.gz 2024-05-30T07:02:24.340 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49735.log 2024-05-30T07:02:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53510.log 2024-05-30T07:02:24.343 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49735.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49735.log.gz 2024-05-30T07:02:24.345 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44096.log 2024-05-30T07:02:24.348 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51227.log 2024-05-30T07:02:24.348 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44096.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44096.log.gz 2024-05-30T07:02:24.349 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53510.log.gz 2024-05-30T07:02:24.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51227.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51227.log.gz 2024-05-30T07:02:24.352 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56063.log 2024-05-30T07:02:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56063.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56063.log.gz 2024-05-30T07:02:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41366.log 2024-05-30T07:02:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41366.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41366.log.gz 2024-05-30T07:02:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51808.log 2024-05-30T07:02:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45660.log 2024-05-30T07:02:24.361 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51808.log.gz 2024-05-30T07:02:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51892.log 2024-05-30T07:02:24.365 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45660.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45660.log.gz 2024-05-30T07:02:24.367 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.51892.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43750.log 2024-05-30T07:02:24.368 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51892.log.gz 2024-05-30T07:02:24.370 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34774.log 2024-05-30T07:02:24.371 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43750.log.gz 2024-05-30T07:02:24.374 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38678.log 2024-05-30T07:02:24.374 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34774.log.gz 2024-05-30T07:02:24.377 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49871.log 2024-05-30T07:02:24.381 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49871.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49871.log.gz 2024-05-30T07:02:24.381 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38678.log.gz 2024-05-30T07:02:24.381 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45713.log 2024-05-30T07:02:24.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45713.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45713.log.gz 2024-05-30T07:02:24.384 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40340.log 2024-05-30T07:02:24.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40340.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40340.log.gz 2024-05-30T07:02:24.387 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50027.log 2024-05-30T07:02:24.390 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50027.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50027.log.gz 2024-05-30T07:02:24.390 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44681.log 2024-05-30T07:02:24.393 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38114.log 2024-05-30T07:02:24.394 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44681.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44681.log.gz 2024-05-30T07:02:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38114.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38114.log.gz 2024-05-30T07:02:24.397 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47605.log 2024-05-30T07:02:24.400 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47605.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47605.log.gz 2024-05-30T07:02:24.400 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34800.log 2024-05-30T07:02:24.403 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34800.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34800.log.gz 2024-05-30T07:02:24.403 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43214.log 2024-05-30T07:02:24.406 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55439.log 2024-05-30T07:02:24.407 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43214.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43214.log.gz 2024-05-30T07:02:24.407 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48281.log 2024-05-30T07:02:24.407 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55439.log.gz 2024-05-30T07:02:24.409 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40444.log 2024-05-30T07:02:24.410 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48281.log.gz 2024-05-30T07:02:24.411 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42463.log 2024-05-30T07:02:24.417 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40444.log: /var/log/ceph/ceph-client.admin.42463.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40444.log.gz 2024-05-30T07:02:24.417 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55195.log 2024-05-30T07:02:24.417 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42463.log.gz 2024-05-30T07:02:24.418 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55195.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55195.log.gz 2024-05-30T07:02:24.418 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40733.log 2024-05-30T07:02:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40733.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40733.log.gz 2024-05-30T07:02:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35603.log 2024-05-30T07:02:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51944.log 2024-05-30T07:02:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35603.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35603.log.gz 2024-05-30T07:02:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50671.log 2024-05-30T07:02:24.426 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51944.log.gz 2024-05-30T07:02:24.428 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50671.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50671.log.gz 2024-05-30T07:02:24.429 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38600.log 2024-05-30T07:02:24.431 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.38600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41707.log 2024-05-30T07:02:24.432 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38600.log.gz 2024-05-30T07:02:24.434 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33812.log 2024-05-30T07:02:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41707.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41707.log.gz 2024-05-30T07:02:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.33812.log: /var/log/ceph/ceph-client.admin.55983.log 2024-05-30T07:02:24.440 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33812.log.gz 2024-05-30T07:02:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37153.log 2024-05-30T07:02:24.443 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55983.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55983.log.gz 2024-05-30T07:02:24.447 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37153.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37153.log.gz 2024-05-30T07:02:24.447 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34018.log 2024-05-30T07:02:24.453 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50775.log 2024-05-30T07:02:24.453 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50775.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50775.log.gz 2024-05-30T07:02:24.453 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41340.log 2024-05-30T07:02:24.453 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34018.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34018.log.gz 2024-05-30T07:02:24.455 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55169.log 2024-05-30T07:02:24.456 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41340.log.gz 2024-05-30T07:02:24.457 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56975.log 2024-05-30T07:02:24.462 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55169.log: /var/log/ceph/ceph-client.admin.56975.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40525.log 2024-05-30T07:02:24.462 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55169.log.gz 2024-05-30T07:02:24.463 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56975.log.gz 2024-05-30T07:02:24.465 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51459.log 2024-05-30T07:02:24.469 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40525.log: /var/log/ceph/ceph-client.admin.51459.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51459.log.gz 2024-05-30T07:02:24.470 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40525.log.gz 2024-05-30T07:02:24.470 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.44011.log 2024-05-30T07:02:24.476 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44011.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44011.log.gz 2024-05-30T07:02:24.476 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48987.log 2024-05-30T07:02:24.476 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48987.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48987.log.gz 2024-05-30T07:02:24.476 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56349.log 2024-05-30T07:02:24.479 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56349.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.56349.log.gz 2024-05-30T07:02:24.479 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56477.log 2024-05-30T07:02:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45687.log 2024-05-30T07:02:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56477.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56477.log.gz 2024-05-30T07:02:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45687.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45687.log.gz 2024-05-30T07:02:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48593.log 2024-05-30T07:02:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48593.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48593.log.gz 2024-05-30T07:02:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37659.log 2024-05-30T07:02:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.37659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37659.log.gz 2024-05-30T07:02:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43620.log 2024-05-30T07:02:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43620.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43620.log.gz 2024-05-30T07:02:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33734.log 2024-05-30T07:02:24.497 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50853.log 2024-05-30T07:02:24.497 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33734.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33734.log.gz 2024-05-30T07:02:24.499 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39724.log 2024-05-30T07:02:24.500 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50853.log.gz 2024-05-30T07:02:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.39724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35447.log 2024-05-30T07:02:24.503 INFO:teuthology.orchestra.run.smithi037.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39724.log.gz 2024-05-30T07:02:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45771.log 2024-05-30T07:02:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.35447.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35447.log.gz 2024-05-30T07:02:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45771.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45771.log.gz 2024-05-30T07:02:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40021.log 2024-05-30T07:02:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40021.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40021.log.gz 2024-05-30T07:02:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50320.log 2024-05-30T07:02:24.519 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50320.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50320.log.gz 2024-05-30T07:02:24.519 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45416.log 2024-05-30T07:02:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45416.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45416.log.gz 2024-05-30T07:02:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36638.log 2024-05-30T07:02:24.523 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36638.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36638.log.gz 2024-05-30T07:02:24.523 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54772.log 2024-05-30T07:02:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54772.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54772.log.gz 2024-05-30T07:02:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54851.log 2024-05-30T07:02:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33371.log 2024-05-30T07:02:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54851.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54851.log.gz 2024-05-30T07:02:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.33371.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33371.log.gz 2024-05-30T07:02:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44809.log 2024-05-30T07:02:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44809.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44809.log.gz 2024-05-30T07:02:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34956.log 2024-05-30T07:02:24.538 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.34956.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34956.log.gz 2024-05-30T07:02:24.538 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56502.log 2024-05-30T07:02:24.541 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43932.log 2024-05-30T07:02:24.541 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56502.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56502.log.gz 2024-05-30T07:02:24.544 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43932.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43932.log.gz 2024-05-30T07:02:24.610 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41919.log 2024-05-30T07:02:24.613 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.41919.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41919.log.gz 2024-05-30T07:02:24.613 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53049.log 2024-05-30T07:02:24.613 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53049.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53049.log.gz 2024-05-30T07:02:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43370.log 2024-05-30T07:02:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47990.log 2024-05-30T07:02:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43370.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43370.log.gz 2024-05-30T07:02:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47449.log 2024-05-30T07:02:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47990.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47990.log.gz 2024-05-30T07:02:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47449.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47449.log.gz 2024-05-30T07:02:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37298.log 2024-05-30T07:02:24.614 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37298.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37298.log.gz 2024-05-30T07:02:24.615 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42224.log 2024-05-30T07:02:24.615 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.42224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42224.log.gz 2024-05-30T07:02:24.615 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40314.log 2024-05-30T07:02:24.615 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40314.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40314.log.gz 2024-05-30T07:02:24.615 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49275.log 2024-05-30T07:02:24.615 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36944.log 2024-05-30T07:02:24.615 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49275.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49275.log.gz 2024-05-30T07:02:24.615 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40418.log 2024-05-30T07:02:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.36944.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36944.log.gz 2024-05-30T07:02:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56169.log 2024-05-30T07:02:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.40418.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40418.log.gz 2024-05-30T07:02:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56169.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56169.log.gz 2024-05-30T07:02:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48463.log 2024-05-30T07:02:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48463.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48463.log.gz 2024-05-30T07:02:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51149.log 2024-05-30T07:02:24.616 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39389.log 2024-05-30T07:02:24.617 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51149.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51149.log.gz 2024-05-30T07:02:24.617 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.39389.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39389.log.gz 2024-05-30T07:02:24.617 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35315.log 2024-05-30T07:02:24.617 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.2.35315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35315.log.gz 2024-05-30T07:02:24.617 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49039.log 2024-05-30T07:02:24.617 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49039.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49039.log.gz 2024-05-30T07:02:24.649 INFO:teuthology.orchestra.run.smithi105.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-30T07:02:24.671 INFO:teuthology.orchestra.run.smithi037.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-30T07:02:25.384 INFO:teuthology.orchestra.run.smithi105.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-30T07:02:25.522 INFO:teuthology.orchestra.run.smithi037.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-30T07:02:26.795 INFO:teuthology.orchestra.run.smithi105.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-30T07:02:27.906 INFO:teuthology.orchestra.run.smithi105.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-30T07:02:28.021 INFO:teuthology.orchestra.run.smithi037.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-30T07:02:28.117 INFO:teuthology.orchestra.run.smithi037.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-30T07:02:28.290 INFO:teuthology.orchestra.run.smithi037.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-30T07:02:28.365 INFO:teuthology.orchestra.run.smithi105.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-30T07:02:28.507 INFO:teuthology.orchestra.run.smithi105.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-30T07:02:28.648 INFO:teuthology.orchestra.run.smithi037.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-30T07:02:28.721 INFO:teuthology.orchestra.run.smithi037.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-30T07:02:28.723 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-05-30T07:02:28.723 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m5.584s 2024-05-30T07:02:28.723 INFO:teuthology.orchestra.run.smithi037.stderr:user 0m26.170s 2024-05-30T07:02:28.723 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m3.280s 2024-05-30T07:02:29.454 INFO:teuthology.orchestra.run.smithi105.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-30T07:02:29.456 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-05-30T07:02:29.457 INFO:teuthology.orchestra.run.smithi105.stderr:real 0m6.303s 2024-05-30T07:02:29.457 INFO:teuthology.orchestra.run.smithi105.stderr:user 0m27.445s 2024-05-30T07:02:29.457 INFO:teuthology.orchestra.run.smithi105.stderr:sys 0m2.092s 2024-05-30T07:02:29.458 INFO:tasks.ceph:Archiving logs... 2024-05-30T07:02:29.458 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027/remote/smithi037/log 2024-05-30T07:02:29.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-30T07:02:32.538 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027/remote/smithi105/log 2024-05-30T07:02:32.539 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-30T07:02:35.294 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-30T07:02:35.303 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-30T07:02:35.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-30T07:02:35.307 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-30T07:02:35.395 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-30T07:02:35.404 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-30T07:02:35.404 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-30T07:02:35.407 DEBUG:teuthology.orchestra.run.smithi105:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-30T07:02:35.420 INFO:teuthology.orchestra.run.smithi037.stdout: remote refid st t when poll reach delay offset jitter 2024-05-30T07:02:35.420 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================== 2024-05-30T07:02:35.420 INFO:teuthology.orchestra.run.smithi037.stdout:*hv01.front.sepi 67.205.162.81 3 u 30 128 377 0.070 -2.724 0.067 2024-05-30T07:02:35.420 INFO:teuthology.orchestra.run.smithi037.stdout:+hv02.front.sepi 63.231.80.2 3 u 84 128 377 0.092 +0.074 0.127 2024-05-30T07:02:35.420 INFO:teuthology.orchestra.run.smithi037.stdout:+hv03.front.sepi 74.6.168.72 3 u 77 128 377 0.078 -0.124 0.219 2024-05-30T07:02:35.421 INFO:teuthology.orchestra.run.smithi037.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-05-30T07:02:35.422 INFO:teuthology.orchestra.run.smithi105.stdout: remote refid st t when poll reach delay offset jitter 2024-05-30T07:02:35.423 INFO:teuthology.orchestra.run.smithi105.stdout:============================================================================== 2024-05-30T07:02:35.423 INFO:teuthology.orchestra.run.smithi105.stdout:+hv01.front.sepi 67.205.162.81 3 u 29 64 377 0.090 -6.067 0.375 2024-05-30T07:02:35.423 INFO:teuthology.orchestra.run.smithi105.stdout:*hv02.front.sepi 63.231.80.2 3 u 22 64 377 0.065 -3.244 0.336 2024-05-30T07:02:35.423 INFO:teuthology.orchestra.run.smithi105.stdout:+hv03.front.sepi 74.6.168.72 3 u 21 64 377 0.074 -3.265 0.290 2024-05-30T07:02:35.423 INFO:teuthology.orchestra.run.smithi105.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-05-30T07:02:35.424 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-30T07:02:35.433 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-30T07:02:35.434 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-30T07:02:35.444 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-30T07:02:35.453 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-30T07:02:35.462 INFO:teuthology.task.internal:Duration was 1933.513782 seconds 2024-05-30T07:02:35.462 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-30T07:02:35.471 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-30T07:02:35.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-30T07:02:35.475 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-30T07:02:35.585 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-30T07:02:35.586 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-05-30T07:02:35.586 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-30T07:02:35.606 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi105.front.sepia.ceph.com 2024-05-30T07:02:35.607 DEBUG:teuthology.orchestra.run.smithi105:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-30T07:02:35.628 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-30T07:02:35.628 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-30T07:02:35.651 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-30T07:02:35.709 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-30T07:02:35.710 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-30T07:02:35.713 DEBUG:teuthology.orchestra.run.smithi105:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-30T07:02:35.821 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-30T07:02:35.831 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-30T07:02:35.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-30T07:02:35.852 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-30T07:02:35.872 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-30T07:02:35.882 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-30T07:02:35.895 DEBUG:teuthology.orchestra.run.smithi105:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-30T07:02:35.910 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-05-30T07:02:35.932 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = core 2024-05-30T07:02:35.950 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-30T07:02:35.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T07:02:35.978 DEBUG:teuthology.orchestra.run.smithi105:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-30T07:02:36.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-30T07:02:36.002 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-30T07:02:36.013 INFO:teuthology.task.internal:Transferring archived files... 2024-05-30T07:02:36.013 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027/remote/smithi037 2024-05-30T07:02:36.014 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-30T07:02:36.048 DEBUG:teuthology.misc:Transferring archived files from smithi105:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-30_06:18:46-fs:volumes-rishabh-clone-stats-testing-default-smithi/7734027/remote/smithi105 2024-05-30T07:02:36.048 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-30T07:02:36.073 INFO:teuthology.task.internal:Removing archive directory... 2024-05-30T07:02:36.074 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-30T07:02:36.095 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-30T07:02:36.123 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-30T07:02:36.141 INFO:teuthology.task.internal:Not uploading archives. 2024-05-30T07:02:36.142 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-30T07:02:36.153 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-30T07:02:36.153 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-30T07:02:36.157 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-30T07:02:36.162 INFO:teuthology.orchestra.run.smithi037.stdout: 655432 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 30 07:02 /home/ubuntu/cephtest 2024-05-30T07:02:36.171 INFO:teuthology.orchestra.run.smithi105.stdout: 655427 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 30 07:02 /home/ubuntu/cephtest 2024-05-30T07:02:36.173 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-30T07:02:36.183 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-30T07:02:36.208 INFO:teuthology.run:Summary data: client.0-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 client.1-kernel-sha1: b9459a26b0888785d05c47deb35abc9d0354ab93 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone-progress}} duration: 1933.5137822628021 failure_reason: 'Test failure: test_when_7_clones_are_cancelled (tasks.cephfs.test_volumes.TestCloneProgressReporter)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=65a25681882242838764e904aab13f9c status: fail success: false 2024-05-30T07:02:36.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-30T07:02:36.295 INFO:teuthology.run:FAIL